From llvm-testresults at cs.uiuc.edu Mon Oct 1 02:22:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 1 Oct 2012 04:22:27 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121001092227.CA10F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4436?compare_to=4433&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4436, Order: 164927, Start Time: 2012-10-01 08:01:26, End Time: 2012-10-01 09:24:06 To: 4433, Order: 164925, Start Time: 2012-10-01 02:18:10, End Time: 2012-10-01 03:40:55 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 13 (74 on baseline) Performance Improvements: 1 (47 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 959 (770 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.62% (0.7642 => 0.7995, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.58% (0.4603 => 0.4768, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.43% (1.4281 => 1.4628, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.37% (0.8366 => 0.8481, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.20% (0.8566 => 0.8669, std.dev.: 0.0039) MultiSource/Applications/SPASS/SPASS: 1.06% (13.7188 => 13.8640, std.dev.: 0.0489) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.00% (13.0888 => 13.2198, std.dev.: 0.0267) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/himenobmtxpa: 3.50% (4.2594 => 4.4085, std.dev.: 0.0316) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.94% (0.3949 => 0.4065, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.83% (2.5364 => 2.6081, std.dev.: 0.0190) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.21% (58.9536 => 60.2584, std.dev.: 0.3782) MultiSource/Applications/SPASS/SPASS: 1.80% (8.1861 => 8.3337, std.dev.: 0.0397) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.60% (1.2764 => 1.2968, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.02% (4.5442 => 4.4977, std.dev.: 0.0145) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.47% (1.0092 => 1.0139, std.dev.: 0.0101) MultiSource/Applications/sqlite3/sqlite3: 1.44% (0.6114 => 0.6202, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 0.12% (0.1675 => 0.1677, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.19% (0.1570 => 0.1567, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.56% (0.3082 => 0.3161, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.75% (0.2327 => 0.2391, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.76% (0.3154 => 0.3130, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.01% (0.2277 => 0.2300, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/mandel: 0.44% (0.0453 => 0.0455, std.dev.: 0.0021) SingleSource/UnitTests/2003-05-07-VarArgs: 14.10% (0.0078 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: 13.75% (0.0080 => 0.0091, std.dev.: 0.0007) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.26% (0.0239 => 0.0242, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 2.63% (0.0190 => 0.0195, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.98% (0.0368 => 0.0390, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 4.47% (0.0291 => 0.0304) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.79% (0.0280 => 0.0285, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.88% (0.0319 => 0.0325, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/casts: 4.57% (0.0175 => 0.0183, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -1.74% (0.0115 => 0.0113, std.dev.: 0.0039) SingleSource/UnitTests/Vector/multiplies: 1.61% (0.0249 => 0.0253, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -2.74% (0.0329 => 0.0320, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 400.00% (0.0001 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.88% (0.1440 => 0.1467, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 1.39% (1.4966 => 1.5174, std.dev.: 0.0252) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.84% (0.1512 => 0.1454, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.15% (0.4068 => 0.4062, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.52% (0.1356 => 0.1349, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.16% (0.0613 => 0.0614, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.06% (0.0178 => 0.0169, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.32% (0.0558 => 0.0610, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.19% (1.1286 => 1.1265, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 145.45% (0.0011 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 160.00% (0.0005 => 0.0013, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.33% (0.0609 => 0.0611, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 45.51% (0.0156 => 0.0227, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 2.90% (0.7656 => 0.7878, std.dev.: 0.0138) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.13% (1.6006 => 1.5985, std.dev.: 0.0016) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 202.50% (0.0040 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -27.16% (4.1772 => 3.0427, std.dev.: 0.0352) SingleSource/Benchmarks/Shootout-C++/except: 82466.67% (0.0006 => 0.4954, std.dev.: 0.0029) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.09% (0.0745 => 0.0917, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.70% (0.1414 => 0.1537, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.49% (0.6410 => 0.6954, std.dev.: 0.0048) MultiSource/Benchmarks/PAQ8p/paq8p: 8.30% (2.1763 => 2.3570, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/bigfib: 7.80% (0.5309 => 0.5723, std.dev.: 0.0021) MultiSource/Applications/minisat/minisat: 6.80% (0.6173 => 0.6593, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 6.00% (1.1653 => 1.2352, std.dev.: 0.0083) MultiSource/Applications/lemon/lemon: 5.96% (1.0046 => 1.0645, std.dev.: 0.0109) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.61% (0.3582 => 0.3783, std.dev.: 0.0067) MultiSource/Applications/kimwitu++/kc: 5.02% (15.3105 => 16.0797, std.dev.: 0.0313) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.86% (0.2552 => 0.2676, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: 4.62% (3.0225 => 3.1621, std.dev.: 0.0167) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.58% (12.6413 => 13.2198, std.dev.: 0.0267) MultiSource/Applications/lambda-0_1_3/lambda: 4.51% (0.6915 => 0.7227, std.dev.: 0.0072) MultiSource/Benchmarks/Bullet/bullet: 4.48% (29.3170 => 30.6292, std.dev.: 0.0341) MultiSource/Benchmarks/McCat/18-imp/imp: 4.23% (0.3217 => 0.3353, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.22% (0.2654 => 0.2766, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.22% (0.2797 => 0.2915, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.21% (0.2806 => 0.2924, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.15% (0.3901 => 0.4063, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.12% (0.4880 => 0.5081, std.dev.: 0.0075) MultiSource/Applications/SPASS/SPASS: 4.05% (13.3238 => 13.8640, std.dev.: 0.0489) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.99% (1.5150 => 1.5754, std.dev.: 0.0190) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.86% (0.4248 => 0.4412, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 3.77% (1.1440 => 1.1871, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.74% (0.4596 => 0.4768, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.65% (1.4113 => 1.4628, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.58% (0.5636 => 0.5838, std.dev.: 0.0073) MultiSource/Applications/oggenc/oggenc: 3.58% (4.7455 => 4.9153, std.dev.: 0.0193) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.54% (0.7722 => 0.7995, std.dev.: 0.0103) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.26% (0.8569 => 0.8848, std.dev.: 0.0053) MultiSource/Applications/siod/siod: 3.10% (2.0972 => 2.1622, std.dev.: 0.0141) MultiSource/Benchmarks/mafft/pairlocalalign: 3.08% (8.2186 => 8.4716, std.dev.: 0.0255) MultiSource/Applications/JM/lencod/lencod: 3.06% (14.7256 => 15.1759, std.dev.: 0.0457) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.82% (3.0758 => 3.1626, std.dev.: 0.0278) MultiSource/Applications/JM/ldecod/ldecod: 2.76% (6.4908 => 6.6698, std.dev.: 0.0296) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.67% (1.0689 => 1.0974, std.dev.: 0.0029) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.58% (6.2546 => 6.4162, std.dev.: 0.0436) MultiSource/Applications/hbd/hbd: 2.56% (1.3268 => 1.3607, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.52% (0.7226 => 0.7408, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.51% (4.2616 => 4.3687, std.dev.: 0.0129) MultiSource/Applications/lua/lua: 2.44% (3.5980 => 3.6857, std.dev.: 0.0313) MultiSource/Applications/ClamAV/clamscan: 2.36% (14.6079 => 14.9520, std.dev.: 0.0672) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.23% (4.0318 => 4.1218, std.dev.: 0.0304) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.22% (1.4408 => 1.4728, std.dev.: 0.0117) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.14% (1.4189 => 1.4492, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.00% (0.5963 => 0.6082, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.86% (2.0317 => 2.0694, std.dev.: 0.0130) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.47% (1.6538 => 2.3396, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/matrix: 22.15% (3.4629 => 4.2298, std.dev.: 0.0182) SingleSource/Benchmarks/Shootout/ary3: 14.68% (1.7426 => 1.9985, std.dev.: 0.0121) SingleSource/Benchmarks/Stanford/Puzzle: 13.75% (0.1433 => 0.1630, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.43% (4.0101 => 4.5486, std.dev.: 0.0262) SingleSource/Benchmarks/McGill/queens: 11.09% (1.6261 => 1.8064, std.dev.: 0.0075) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.75% (0.2857 => 0.3107, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/lists: 8.58% (7.0025 => 7.6033, std.dev.: 0.0124) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.70% (40.4792 => 42.7861, std.dev.: 0.3505) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.12% (0.3301 => 0.3470, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.64% (4.2129 => 4.4085, std.dev.: 0.0316) SingleSource/Benchmarks/Misc/fp-convert: 4.14% (15.2242 => 15.8540, std.dev.: 0.0474) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.89% (3.4080 => 3.5406, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.67% (0.8498 => 0.8810, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/dt: 3.57% (0.9851 => 1.0203, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.01% (0.5587 => 0.5755, std.dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 2.99% (14.4877 => 14.9214, std.dev.: 0.0026) MultiSource/Benchmarks/sim/sim: 2.79% (3.8907 => 3.9993, std.dev.: 0.0149) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.69% (0.5876 => 0.6034, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.39% (4.6127 => 4.7229, std.dev.: 0.0119) MultiSource/Applications/siod/siod: 2.16% (3.5520 => 3.6287, std.dev.: 0.0245) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.12% (6.6312 => 6.7718, std.dev.: 0.0128) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.90% (1.2726 => 1.2968, std.dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/dry: 1.84% (2.4013 => 2.4454, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/whetstone: 1.78% (2.3453 => 2.3871, std.dev.: 0.0112) MultiSource/Benchmarks/Olden/power/power: 1.46% (1.4184 => 1.4391, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.26% (0.3497 => 0.2124, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.73% (5.2665 => 4.1219, std.dev.: 0.0197) SingleSource/Benchmarks/Shootout-C++/ary3: -20.65% (1.7473 => 1.3865, std.dev.: 0.0268) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.54% (1.1647 => 0.9604, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.96% (15.8312 => 13.3052, std.dev.: 0.1006) MultiSource/Benchmarks/McCat/17-bintr/bintr: -13.85% (0.0917 => 0.0790, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1578, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/moments: -9.16% (0.1114 => 0.1012, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.49% (3.2007 => 2.9291, std.dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.27% (1.4034 => 1.2873, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -7.35% (7.6833 => 7.1189, std.dev.: 0.0215) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.93% (3.6254 => 3.3743, std.dev.: 0.0380) SingleSource/Benchmarks/Shootout-C++/fibo: -6.55% (4.6355 => 4.3317, std.dev.: 0.0206) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.47% (2.0027 => 1.8732, std.dev.: 0.0139) SingleSource/Benchmarks/Misc/richards_benchmark: -6.31% (1.4441 => 1.3530, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout/heapsort: -6.18% (3.2159 => 3.0173, std.dev.: 0.0741) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.95% (2.9728 => 2.7959, std.dev.: 0.0297) MultiSource/Applications/SIBsim4/SIBsim4: -5.79% (3.4230 => 3.2248, std.dev.: 0.0221) MultiSource/Benchmarks/mafft/pairlocalalign: -5.56% (62.4126 => 58.9410, std.dev.: 0.0661) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.47% (3.9413 => 3.7258, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/fib2: -5.19% (4.4195 => 4.1901, std.dev.: 0.0135) MultiSource/Benchmarks/FreeBench/distray/distray: -5.11% (0.2664 => 0.2528, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.62% (0.4564 => 0.4353, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: -4.27% (0.3746 => 0.3586, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -4.10% (2.5166 => 2.4135, std.dev.: 0.0023) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.13% (1.2722 => 1.2324, std.dev.: 0.0049) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.05% (1.2959 => 1.2564, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/methcall: -2.97% (9.2503 => 8.9754, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/flops: -2.69% (9.5474 => 9.2901, std.dev.: 0.0101) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.60% (0.6119 => 0.5960, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.50% (3.7496 => 3.6557, std.dev.: 0.0323) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.36% (2.4457 => 2.3879, std.dev.: 0.0146) MultiSource/Applications/lua/lua: -2.33% (29.5232 => 28.8339, std.dev.: 0.1393) MultiSource/Applications/SPASS/SPASS: -2.33% (8.5323 => 8.3337, std.dev.: 0.0397) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.33% (45.4683 => 44.4109, std.dev.: 0.3984) MultiSource/Benchmarks/PAQ8p/paq8p: -2.26% (92.7467 => 90.6497, std.dev.: 0.1819) MultiSource/Applications/JM/lencod/lencod: -2.21% (6.7458 => 6.5970, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash2: -1.89% (3.4876 => 3.4216, std.dev.: 0.0133) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.89% (2.3569 => 2.3123, std.dev.: 0.0173) MultiSource/Applications/aha/aha: -1.79% (3.4286 => 3.3672, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.66% (1.0686 => 1.0509, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -1.62% (1.0926 => 1.0749, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.48% (1.1683 => 1.1510, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3138, std.dev.: 0.0248) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.32% (27.1724 => 26.8139, std.dev.: 0.0630) SingleSource/Benchmarks/Dhrystone/fldry: -1.25% (2.4971 => 2.4658, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/lists: -1.02% (16.5617 => 16.3925, std.dev.: 0.0332) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.59% (0.9980 => 1.0139, std.dev.: 0.0101) MultiSource/Applications/sqlite3/sqlite3: 2.99% (0.6022 => 0.6202, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 0.66% (0.1666 => 0.1677, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.84% (0.1554 => 0.1567, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.53% (0.3083 => 0.3161, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.13% (0.2394 => 0.2391, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.42% (0.3175 => 0.3130, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.09% (0.2302 => 0.2300, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/mandel: 1.34% (0.0449 => 0.0455, std.dev.: 0.0021) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: 1.11% (0.0090 => 0.0091, std.dev.: 0.0007) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.83% (0.0240 => 0.0242, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.56% (0.0192 => 0.0195, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0390 => 0.0390, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.00% (0.0301 => 0.0304) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.35% (0.0284 => 0.0285, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.31% (0.0324 => 0.0325, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/casts: 3.39% (0.0177 => 0.0183, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -40.21% (0.0189 => 0.0113, std.dev.: 0.0039) SingleSource/UnitTests/Vector/multiplies: 1.61% (0.0249 => 0.0253, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -1.54% (0.0325 => 0.0320, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.66% (0.1429 => 0.1467, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 1.03% (1.5019 => 1.5174, std.dev.: 0.0252) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.13% (0.1501 => 0.1454, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.74% (0.4264 => 0.4062, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.37% (0.1344 => 0.1349, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.24% (0.0589 => 0.0614, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -27.16% (0.0232 => 0.0169, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.54% (0.0639 => 0.0610, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.75% (1.1350 => 1.1265, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 350.00% (0.0006 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -45.83% (0.0024 => 0.0013, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.08% (0.0637 => 0.0611, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.72% (0.0246 => 0.0227, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 4.47% (0.7541 => 0.7878, std.dev.: 0.0138) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.05% (1.5363 => 1.5985, std.dev.: 0.0016) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 1 02:33:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 1 Oct 2012 04:33:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121001093341.D5D572A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4437?compare_to=4434&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4437, Order: 164927, Start Time: 2012-10-01 08:14:35, End Time: 2012-10-01 09:35:19 To: 4434, Order: 164925, Start Time: 2012-10-01 02:30:50, End Time: 2012-10-01 03:51:01 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (146 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 92 (18 on baseline) Unchanged Tests: 950 (702 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.65% (0.5728 => 0.5765, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 0.29% (15.9218 => 15.9672, std.dev.: 0.0261) MultiSource/Applications/kimwitu++/kc: 0.32% (14.8267 => 14.8745, std.dev.: 0.0115) MultiSource/Benchmarks/Bullet/bullet: 0.41% (83.1106 => 83.4483, std.dev.: 0.0780) MultiSource/Benchmarks/MallocBench/gs/gs: 0.26% (4.3261 => 4.3374, std.dev.: 0.0209) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.66% (0.0458 => 0.0461) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.87% (0.0459 => 0.0463) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.70% (0.0427 => 0.0430, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.70% (0.0429 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.96% (0.0416 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.72% (0.0418 => 0.0421, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.98% (0.0410 => 0.0414) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.73% (0.0412 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.70% (0.0429 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.70% (0.0430 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.71% (0.0423 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.71% (0.0424 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.73% (0.0412 => 0.0415, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.97% (0.0414 => 0.0418, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.95% (0.0420 => 0.0424) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.47% (0.0422 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.93% (0.0431 => 0.0435, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.46% (0.0433 => 0.0448, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.74% (0.0408 => 0.0411) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.73% (0.0409 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.71% (0.0420 => 0.0423, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.71% (0.0421 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.49% (0.0412 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.73% (0.0413 => 0.0416) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.99% (0.0403 => 0.0407) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.49% (0.0405 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.00% (0.0401 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.74% (0.0403 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.45% (0.0441 => 0.0443) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.91% (0.0440 => 0.0444, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.75% (0.0401 => 0.0404, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.75% (0.0402 => 0.0405, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.75% (0.0402 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.99% (0.0403 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.73% (0.0410 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.73% (0.0411 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.33% (1.2247 => 1.2288, std.dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.40% (7.4919 => 7.5217, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.38% (3.6951 => 3.7092, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.33% (0.6447 => 0.6468, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1431 => 0.1432, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.77% (0.0650 => 0.0668, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: 31.95% (63.2438 => 83.4483, std.dev.: 0.0780) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14235.56% (0.0720 => 10.3216, std.dev.: 0.0052) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 47.65% (10.3673 => 15.3071, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: 30.64% (0.1622 => 0.2119, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.66% (2.2022 => 2.5251, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.46% (7.0540 => 8.0740, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/flops: 13.48% (0.1432 => 0.1625, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 13.09% (1.1194 => 1.2659, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.95% (0.0834 => 0.0942, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.77% (0.1566 => 0.1766, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.72% (1.7609 => 1.9672, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/trivial-interface: 11.46% (0.3473 => 0.3871, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.29% (0.3543 => 0.3943, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-4: 11.18% (0.3543 => 0.3939, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 11.12% (0.3497 => 0.3886, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.12% (0.3516 => 0.3907, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.12% (0.3561 => 0.3957, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.88% (0.3694 => 0.4096, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: 10.67% (0.3927 => 0.4346, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions: 10.55% (0.3828 => 0.4232, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.37% (0.3886 => 0.4289, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.85% (0.1584 => 0.1740, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 9.54% (0.3282 => 0.3595, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.44% (0.3177 => 0.3477, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.11% (0.1438 => 0.1569, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.11% (0.1625 => 0.1773, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 8.50% (10.4361 => 11.3236, std.dev.: 0.0210) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.20% (0.4879 => 0.5279, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: 8.13% (0.1440 => 0.1557, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.80% (0.2065 => 0.2226, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: 7.73% (0.1655 => 0.1783, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 7.73% (0.6030 => 0.6496, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 7.70% (9.4845 => 10.2149, std.dev.: 0.0094) SingleSource/UnitTests/ObjC++/Hello: 7.65% (0.5925 => 0.6378, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 7.57% (5.7591 => 6.1951, std.dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: 7.20% (0.7433 => 0.7968, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: 7.17% (0.7115 => 0.7625, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.15% (0.6675 => 0.7152, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.13% (0.8172 => 0.8755, std.dev.: 0.0109) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.11% (0.2700 => 0.2892, std.dev.: 0.0013) MultiSource/Applications/d/make_dparser: 7.08% (3.3354 => 3.5715, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: 7.05% (0.2554 => 0.2734, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/18-imp/imp: 7.04% (0.3423 => 0.3664, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 7.02% (0.1695 => 0.1814, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.01% (0.5860 => 0.6271, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.91% (0.5105 => 0.5458, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.91% (0.4615 => 0.4934, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference: 6.84% (0.7326 => 0.7827, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.69% (0.2271 => 0.2423, std.dev.: 0.0028) MultiSource/Applications/sgefa/sgefa: 6.69% (0.3109 => 0.3317, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.62% (1.5415 => 1.6436, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.49% (8.1363 => 8.6645, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.47% (1.3050 => 1.3894, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.43% (4.2646 => 4.5389, std.dev.: 0.0156) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.41% (0.2107 => 0.2242, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.36% (0.5569 => 0.5923, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.35% (0.3307 => 0.3517, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 6.34% (0.3422 => 0.3639, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.30% (5.0018 => 5.3168, std.dev.: 0.0092) MultiSource/Applications/spiff/spiff: 6.28% (0.7835 => 0.8327, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.26% (0.4103 => 0.4360, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.25% (4.9449 => 5.2540, std.dev.: 0.0108) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.23% (0.4636 => 0.4925, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.21% (0.8067 => 0.8568, std.dev.: 0.0093) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.19% (0.1940 => 0.2060, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.16% (0.2758 => 0.2928, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.12% (0.3826 => 0.4060, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.03% (0.4064 => 0.4309, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.95% (0.2891 => 0.3063, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.93% (0.3121 => 0.3306, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash: 5.90% (0.4289 => 0.4542, std.dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 5.89% (0.2905 => 0.3076, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 5.86% (0.2831 => 0.2997, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.85% (7.9617 => 8.4275, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.84% (0.3136 => 0.3319, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: 5.83% (0.2725 => 0.2884, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.82% (0.3162 => 0.3346, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 5.79% (1.1642 => 1.2316, std.dev.: 0.0089) MultiSource/Benchmarks/Olden/bh/bh: 5.79% (0.3092 => 0.3271, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 5.79% (1.5603 => 1.6506, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/bigfib: 5.78% (0.6456 => 0.6829, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.77% (0.3865 => 0.4088, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 5.75% (3.8723 => 4.0950, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.71% (0.9765 => 1.0323, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.70% (0.3650 => 0.3858, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.70% (0.2756 => 0.2913, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 5.69% (0.3232 => 0.3416, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.61% (0.3441 => 0.3634, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary3: 5.60% (0.3283 => 0.3467, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.60% (2.0665 => 2.1823, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.59% (0.4203 => 0.4438, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.58% (0.3098 => 0.3271, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 5.55% (21.9371 => 23.1555, std.dev.: 0.0335) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.52% (0.5020 => 0.5297, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/wc: 5.50% (0.3052 => 0.3220, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.50% (0.2871 => 0.3029, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.49% (0.2714 => 0.2863, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 5.48% (0.4048 => 0.4270, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 5.43% (0.4620 => 0.4871, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.43% (0.2872 => 0.3028, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 5.41% (0.3603 => 0.3798, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 5.41% (0.3180 => 0.3352, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 5.40% (0.3387 => 0.3570, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 5.40% (0.3684 => 0.3883, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.36% (1.1861 => 1.2497, std.dev.: 0.0031) MultiSource/Applications/lemon/lemon: 5.35% (1.0722 => 1.1296, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/random: 5.35% (0.2802 => 0.2952, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.34% (0.3935 => 0.4145, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 5.30% (2.0273 => 2.1348, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.30% (0.2793 => 0.2941, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 5.25% (0.2877 => 0.3028, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.21% (0.3379 => 0.3555, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 5.16% (0.4299 => 0.4521, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.15% (0.2603 => 0.2737, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 4.82% (2.2969 => 2.4075, std.dev.: 0.0226) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.70% (0.6450 => 0.6753, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/football/football: 4.66% (0.8921 => 0.9337, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.55% (0.5981 => 0.6253, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.32% (1.5859 => 1.6544, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.12% (1.4186 => 1.4770, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.93% (14.3668 => 14.9313, std.dev.: 0.0182) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.77% (2.2024 => 2.2854, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 3.75% (1.2842 => 1.3323, std.dev.: 0.0043) MultiSource/Benchmarks/nbench/nbench: 3.61% (1.1840 => 1.2267, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.51% (0.3817 => 0.3951, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.79% (0.8101 => 0.8327, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 1.49% (17.1811 => 17.4368, std.dev.: 0.0189) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.47% (3.8922 => 3.9496, std.dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8961, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.26% (1.1145 => 1.3849, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0012) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4500, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.1578 => 3.3688, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/richards_benchmark: 6.61% (1.1396 => 1.2149, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.39% (3.6395 => 3.7627, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.99% (4.2280 => 4.3543, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 1.34% (11.6436 => 11.7993, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.10% (9.1159 => 9.2163, std.dev.: 0.0385) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.03% (6.5088 => 6.5757, std.dev.: 0.0087) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1278, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -80.19% (0.8651 => 0.1714, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.23% (5.2763 => 3.2592, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.39% (5.3855 => 3.9104, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.08% (5.3526 => 3.9031, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -14.75% (54.1659 => 46.1770, std.dev.: 0.0252) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.91% (2.9384 => 2.6179, std.dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: -8.05% (22.1758 => 20.3913, std.dev.: 0.0588) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4235, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: -11.54% (1.2373 => 1.0945, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/mandel-2: -10.41% (1.5373 => 1.3772, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.32% (19.9488 => 18.2894, std.dev.: 0.0229) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.96% (4.8142 => 4.4790) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.63% (1.8329 => 1.7113, std.dev.: 0.0157) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7918, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.98% (1.5835 => 1.5047, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.87% (1.6805 => 1.5987, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.79% (1.5660 => 1.4910, std.dev.: 0.0033) MultiSource/Applications/siod/siod: -3.70% (3.2827 => 3.1612, std.dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5011, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.25% (0.4808 => 0.4700, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.05% (8.1563 => 7.9887, std.dev.: 0.0096) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.04% (8.6802 => 8.5027, std.dev.: 0.0240) SingleSource/Benchmarks/Misc/salsa20: -2.04% (10.2830 => 10.0733, std.dev.: 0.0157) MultiSource/Applications/hexxagon/hexxagon: -1.80% (12.4730 => 12.2491, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6812, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.53% (2.5528 => 2.5138, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.44% (9.5636 => 9.4260, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout/hash: -1.08% (4.9088 => 4.8560, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.00% (6.2999 => 6.2368, std.dev.: 0.0035) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.25% (0.5229 => 0.5765, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 6.52% (14.9895 => 15.9672, std.dev.: 0.0261) MultiSource/Applications/kimwitu++/kc: 5.08% (14.1553 => 14.8745, std.dev.: 0.0115) MultiSource/Benchmarks/MallocBench/gs/gs: 5.52% (4.1105 => 4.3374, std.dev.: 0.0209) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.22% (1.1048 => 1.2288, std.dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.08% (7.1582 => 7.5217, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.11% (3.4629 => 3.7092, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.95% (0.6222 => 0.6468, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.43% (0.2116 => 0.0668, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 1 02:38:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 1 Oct 2012 04:38:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121001093841.0DB4A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4438?compare_to=4429&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4438, Order: 164927, Start Time: 2012-10-01 08:14:37, End Time: 2012-10-01 09:40:18 To: 4429, Order: 164919, Start Time: 2012-09-30 20:30:21, End Time: 2012-09-30 21:56:02 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 0 (175 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1039 (695 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.01% (2.7524 => 2.7528, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.00% (2.1153 => 2.1154, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.00% (4.9748 => 4.9749, std.dev.: 0.0002) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.50% (2.0176 => 2.4312, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.60% (0.1410 => 0.1644, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 14.65% (0.0826 => 0.0947, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.50% (0.1072 => 0.1206, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.33% (0.0819 => 0.0920, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 11.76% (0.5818 => 0.6502, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 11.55% (0.5748 => 0.6412, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.32% (0.1413 => 0.1573, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 10.96% (0.1013 => 0.1124, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 10.93% (0.7061 => 0.7833, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 10.93% (0.4328 => 0.4801, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 10.64% (0.2781 => 0.3077, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.57% (3.9660 => 4.3852, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 10.46% (0.4062 => 0.4487, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 10.29% (1.3693 => 1.5102, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 10.27% (0.7038 => 0.7761, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.26% (0.1588 => 0.1751, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.25% (0.2596 => 0.2862, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.24% (0.2782 => 0.3067, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.11% (0.3899 => 0.4293, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.07% (0.2721 => 0.2995, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.96% (0.7710 => 0.8478, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.93% (0.3022 => 0.3322, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 9.86% (0.2607 => 0.2864, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 9.81% (0.2690 => 0.2954, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.81% (0.3485 => 0.3827, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.77% (1.9828 => 2.1766, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.76% (0.5265 => 0.5779, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.76% (0.2655 => 0.2914, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.74% (0.6959 => 0.7637, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/lists: 9.72% (0.3293 => 0.3613, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.71% (0.6283 => 0.6893, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/fibo: 9.70% (0.2628 => 0.2883, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 9.67% (0.2760 => 0.3027, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.66% (0.3489 => 0.3826, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: 9.63% (0.2761 => 0.3027, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.62% (1.2193 => 1.3366, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.61% (0.3580 => 0.3924, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.61% (0.2966 => 0.3251, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 9.60% (0.2937 => 0.3219, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 9.57% (0.2726 => 0.2987, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.57% (0.9199 => 1.0079, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.55% (0.2765 => 0.3029, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.48% (0.3756 => 0.4112, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.44% (0.4016 => 0.4395, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.38% (0.2696 => 0.2949, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary: 9.37% (0.3107 => 0.3398, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 9.36% (13.8202 => 15.1136, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/ary3: 9.27% (0.3149 => 0.3441, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.26% (1.4563 => 1.5911, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.24% (1.1364 => 1.2414, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 9.17% (0.2988 => 0.3262, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 9.13% (0.3868 => 0.4221, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 9.09% (0.3453 => 0.3767, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.08% (0.4791 => 0.5226, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.04% (0.4390 => 0.4787, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists1: 9.00% (0.3534 => 0.3852, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 8.99% (0.3192 => 0.3479, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.96% (0.1986 => 0.2164, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.95% (0.3130 => 0.3410, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.71% (0.1435 => 0.1560, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.70% (0.5577 => 0.6062, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: 8.68% (0.1589 => 0.1727, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 8.62% (1.0313 => 1.1202, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.54% (0.1276 => 0.1385, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.51% (0.2127 => 0.2308, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.50% (0.3246 => 0.3522, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 8.41% (0.2995 => 0.3247, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 8.35% (0.2945 => 0.3191, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.33% (0.3578 => 0.3876, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.31% (0.4379 => 0.4743, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.28% (0.3914 => 0.4238, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/for-in: 8.26% (0.3789 => 0.4102, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.19% (0.4003 => 0.4331, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.17% (0.2914 => 0.3152, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 8.16% (1.1061 => 1.1964, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-4: 8.12% (0.3646 => 0.3942, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/synchronized: 8.11% (0.3663 => 0.3960, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.08% (0.3601 => 0.3892, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 8.06% (3.8646 => 4.1760, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.05% (0.3650 => 0.3944, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.04% (0.5637 => 0.6090, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 8.00% (0.3623 => 0.3913, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 8.00% (0.2925 => 0.3159, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.00% (7.2180 => 7.7953, std.dev.: 0.0102) SingleSource/UnitTests/ObjC/property: 7.99% (0.3940 => 0.4255, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 7.98% (0.7506 => 0.8105, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.96% (0.7460 => 0.8054, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 7.94% (0.2243 => 0.2421, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 7.86% (16.6129 => 17.9186, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/football/football: 7.85% (0.8310 => 0.8962, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 7.80% (0.3220 => 0.3471, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.75% (3.6692 => 3.9537, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.75% (0.3755 => 0.4046, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 7.65% (0.6744 => 0.7260, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.61% (0.1865 => 0.2007, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 7.59% (3.1889 => 3.4309, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.59% (0.6576 => 0.7075, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.58% (0.8698 => 0.9357, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.56% (0.2023 => 0.2176, std.dev.: 0.0015) MultiSource/Applications/siod/siod: 7.56% (2.1791 => 2.3438, std.dev.: 0.0078) MultiSource/Applications/viterbi/viterbi: 7.37% (0.1478 => 0.1587, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 7.36% (1.9270 => 2.0689, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 7.31% (1.0594 => 1.1368, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.27% (0.1789 => 0.1919, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.10% (1.3245 => 1.4185, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/em3d/em3d: 7.06% (0.1657 => 0.1774, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.90% (1.3819 => 1.4772, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.86% (1.3813 => 1.4760, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 6.84% (14.8535 => 15.8689, std.dev.: 0.0101) MultiSource/Benchmarks/Olden/bh/bh: 6.79% (0.2859 => 0.3053, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.76% (4.4433 => 4.7438, std.dev.: 0.0080) MultiSource/Benchmarks/McCat/05-eks/eks: 6.73% (0.4113 => 0.4390, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.72% (4.3801 => 4.6746, std.dev.: 0.0037) MultiSource/Applications/SIBsim4/SIBsim4: 6.71% (1.2749 => 1.3604, std.dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 6.69% (4.6629 => 4.9748, std.dev.: 0.0071) MultiSource/Applications/hexxagon/hexxagon: 6.65% (1.2292 => 1.3110, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 6.55% (8.4961 => 9.0525, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.39% (0.6135 => 0.6527, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.31% (0.2140 => 0.2275, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.31% (0.8818 => 0.9374, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.20% (0.2321 => 0.2465, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.16% (0.1819 => 0.1931, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.12% (1.1333 => 1.2027, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 6.08% (0.6250 => 0.6630, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 6.07% (0.3131 => 0.3321, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.03% (3.2742 => 3.4715, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.99% (13.2842 => 14.0797, std.dev.: 0.0114) MultiSource/Applications/ClamAV/clamscan: 5.94% (14.5298 => 15.3922, std.dev.: 0.0124) MultiSource/Applications/JM/ldecod/ldecod: 5.87% (6.5754 => 6.9616, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.83% (0.2504 => 0.2650, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.79% (0.3245 => 0.3433, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.74% (0.4805 => 0.5081, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.72% (4.9865 => 5.2719, std.dev.: 0.0174) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.41% (0.3511 => 0.3701, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.25% (1.5188 => 1.5985, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.20% (0.9108 => 0.9582, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 4.95% (3.7467 => 3.9321, std.dev.: 0.0074) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.84% (6.2785 => 6.5822, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.67% (2.1007 => 2.1988, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 4.18% (33.2944 => 34.6874, std.dev.: 0.0377) MultiSource/Applications/sqlite3/sqlite3: 2.61% (16.2614 => 16.6855, std.dev.: 0.0134) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.49% (5.7573 => 7.5128, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.53% (1.8175 => 2.2633, std.dev.: 0.0269) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.70% (0.1322 => 0.1437, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 8.54% (1.1560 => 1.2547, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4143, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.22% (1.2998 => 1.3806, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0044, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.10% (11.2619 => 11.7236, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.89% (1.7081 => 1.7746, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9850, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 2.92% (10.7476 => 11.0619, std.dev.: 0.0260) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.15% (7.4271 => 7.5869, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/ffbench: 1.68% (0.8273 => 0.8412, std.dev.: 0.0042) MultiSource/Applications/lemon/lemon: 1.59% (1.4298 => 1.4525, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5140, std.dev.: 0.0034) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2068, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.26% (5.5130 => 5.5826, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9675, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1885, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 1.09% (12.0921 => 12.2233, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (2.2986 => 2.3234, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5855, std.dev.: 0.0069) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.07% (0.4657 => 0.3955, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.53% (22.5627 => 21.9921, std.dev.: 0.0119) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.24% (1.2308 => 1.0924, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.14% (20.3410 => 18.2776, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.74% (1.3780 => 1.2989, std.dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.18% (2.6470 => 2.5099, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.43% (5.0168 => 4.7944, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.55% (3.2729 => 3.1566, std.dev.: 0.0220) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.42% (1.7688 => 1.7083, std.dev.: 0.0054) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.96% (0.4867 => 0.4723, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.68% (3.0263 => 2.9451, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4786, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.33% (1.9762 => 1.9302, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: -2.13% (0.5449 => 0.5333, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7070, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.78% (0.6615 => 0.6497, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.65% (6.3560 => 6.2511, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.64% (0.6589 => 0.6481, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.50% (7.3305 => 7.2203, std.dev.: 0.0187) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0071, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8620, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2502, std.dev.: 0.0019) MultiSource/Applications/lua/lua: -1.23% (26.5159 => 26.1891, std.dev.: 0.0372) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4949, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.13% (6.6320 => 6.5568, std.dev.: 0.0144) MultiSource/Applications/viterbi/viterbi: -1.06% (4.4810 => 4.4333, std.dev.: 0.0054) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 1 04:00:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 1 Oct 2012 06:00:45 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121001110045.EF1A62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4439?compare_to=4436&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4439, Order: 164931, Start Time: 2012-10-01 09:39:53, End Time: 2012-10-01 11:02:25 To: 4436, Order: 164927, Start Time: 2012-10-01 08:01:26, End Time: 2012-10-01 09:24:06 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 13 (90 on baseline) Performance Improvements: 3 (40 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 957 (761 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 4.25% (8.9116 => 9.2903, std.dev.: 0.1030) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.94% (0.8981 => 0.9335, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.56% (0.5512 => 0.5708, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.30% (0.5975 => 0.6172, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.07% (0.7408 => 0.7561, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.04% (4.3130 => 4.4009, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: 2.02% (1.3607 => 1.3882, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.75% (1.5754 => 1.6029, std.dev.: 0.0095) MultiSource/Applications/lua/lua: 1.15% (3.6857 => 3.7281, std.dev.: 0.0101) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.05% (6.4162 => 6.4833, std.dev.: 0.0251) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.87% (21.8121 => 22.6552, std.dev.: 0.0732) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.58% (0.7579 => 0.7850, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/heapsort: 2.71% (3.2310 => 3.3187, std.dev.: 0.0131) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -5.93% (24.3810 => 22.9355, std.dev.: 0.0956) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.14% (1.0948 => 1.0714, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.32% (1.1510 => 1.1358, std.dev.: 0.0021) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.46% (1.0139 => 1.0287, std.dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: -0.53% (0.6202 => 0.6169, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: 0.72% (0.1677 => 0.1689, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.53% (0.1567 => 0.1591, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.63% (0.3161 => 0.3141, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.59% (0.2391 => 0.2405, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.00% (0.3130 => 0.3224, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.87% (0.2300 => 0.2320, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel: -3.96% (0.0455 => 0.0437, std.dev.: 0.0012) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -1.10% (0.0091 => 0.0090, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.41% (0.0242 => 0.0241, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.51% (0.0195 => 0.0196, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.51% (0.0390 => 0.0392, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.33% (0.0304 => 0.0305, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -27.72% (0.0285 => 0.0206, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.62% (0.0325 => 0.0327, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -0.55% (0.0183 => 0.0182, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 72.57% (0.0113 => 0.0195, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0253 => 0.0254, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 3.75% (0.0320 => 0.0332, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 120.00% (0.0005 => 0.0011) MultiSource/Applications/ClamAV/clamscan: -1.02% (0.1467 => 0.1452, std.dev.: 0.0031) MultiSource/Applications/lemon/lemon: -0.03% (1.5174 => 1.5170, std.dev.: 0.0212) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.62% (0.1454 => 0.1445, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.66% (0.4062 => 0.4170, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.22% (0.1349 => 0.1352, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.05% (0.0614 => 0.0645, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 56.80% (0.0169 => 0.0265, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.92% (0.0610 => 0.0580, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.02% (1.1265 => 1.1267, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0027 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -46.15% (0.0013 => 0.0007, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.91% (0.0611 => 0.0641, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.54% (0.0227 => 0.0194, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.83% (0.7878 => 0.7655, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.04% (1.5985 => 1.5979, std.dev.: 0.0011) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.61% (4.1772 => 3.1075, std.dev.: 0.0366) SingleSource/Benchmarks/Shootout-C++/except: 82600.00% (0.0006 => 0.4962, std.dev.: 0.0047) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: -50.00% (0.0006 => 0.0003, std.dev.: 0.0001) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 24.70% (0.0745 => 0.0929, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.81% (0.1414 => 0.1581, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 8.13% (2.1763 => 2.3533, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.11% (0.6410 => 0.6930, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/bigfib: 8.04% (0.5309 => 0.5736, std.dev.: 0.0035) MultiSource/Applications/minisat/minisat: 7.27% (0.6173 => 0.6622, std.dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 7.05% (1.1653 => 1.2474, std.dev.: 0.0069) MultiSource/Applications/lemon/lemon: 6.75% (1.0046 => 1.0724, std.dev.: 0.0114) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.11% (0.3582 => 0.3801, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.80% (1.5150 => 1.6029, std.dev.: 0.0095) MultiSource/Applications/lambda-0_1_3/lambda: 5.67% (0.6915 => 0.7307, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.53% (0.2552 => 0.2693, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.23% (0.4248 => 0.4470, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 5.22% (0.3217 => 0.3385, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 5.12% (15.3105 => 16.0940, std.dev.: 0.1773) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.09% (0.5740 => 0.6032, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.03% (0.6069 => 0.6374, std.dev.: 0.0080) MultiSource/Applications/d/make_dparser: 4.76% (3.0225 => 3.1664, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.65% (0.4880 => 0.5107, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.64% (0.7226 => 0.7561, std.dev.: 0.0027) MultiSource/Applications/hbd/hbd: 4.63% (1.3268 => 1.3882, std.dev.: 0.0065) MultiSource/Benchmarks/Bullet/bullet: 4.54% (29.3170 => 30.6472, std.dev.: 0.2408) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.48% (0.2654 => 0.2773, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.48% (0.7639 => 0.7981, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.47% (0.7722 => 0.8067, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.21% (1.1827 => 1.2325, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.15% (0.2797 => 0.2913, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.10% (12.6413 => 13.1594, std.dev.: 0.0980) MultiSource/Benchmarks/McCat/09-vor/vor: 4.10% (0.3026 => 0.3150, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.09% (0.2886 => 0.3004, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.96% (0.5937 => 0.6172, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.96% (0.2806 => 0.2917, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.90% (0.3901 => 0.4053, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.82% (0.3062 => 0.3179, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.73% (0.7784 => 0.8074, std.dev.: 0.0067) MultiSource/Applications/Burg/burg: 3.72% (1.1440 => 1.1866, std.dev.: 0.0092) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.72% (0.3008 => 0.3120, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.69% (3.0758 => 3.1894, std.dev.: 0.0313) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.66% (6.2546 => 6.4833, std.dev.: 0.0251) MultiSource/Applications/siod/siod: 3.64% (2.0972 => 2.1735, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.62% (1.4408 => 1.4929, std.dev.: 0.0180) MultiSource/Applications/lua/lua: 3.62% (3.5980 => 3.7281, std.dev.: 0.0101) MultiSource/Applications/ClamAV/clamscan: 3.45% (14.6079 => 15.1113, std.dev.: 0.0647) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.32% (1.4189 => 1.4660, std.dev.: 0.0112) MultiSource/Applications/oggenc/oggenc: 3.29% (4.7455 => 4.9018, std.dev.: 0.0290) SingleSource/UnitTests/Vector/constpool: 3.25% (8.9977 => 9.2903, std.dev.: 0.1030) MultiSource/Benchmarks/sim/sim: 3.24% (0.3084 => 0.3184, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.20% (1.4113 => 1.4565, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.15% (4.0318 => 4.1588, std.dev.: 0.0143) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.12% (1.2021 => 1.2396, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.12% (0.5963 => 0.6149, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 3.09% (8.2186 => 8.4723, std.dev.: 0.0553) MultiSource/Applications/JM/ldecod/ldecod: 2.95% (6.4908 => 6.6820, std.dev.: 0.0246) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.94% (4.3380 => 4.4656, std.dev.: 0.0350) MultiSource/Applications/JM/lencod/lencod: 2.80% (14.7256 => 15.1377, std.dev.: 0.1173) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.79% (4.2815 => 4.4009, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 2.75% (1.8798 => 1.9315, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.63% (8.2559 => 8.4734, std.dev.: 0.0733) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.48% (0.4562 => 0.4675, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.42% (1.6538 => 2.3388, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 21.85% (3.4629 => 4.2196, std.dev.: 0.0042) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 15.05% (0.0917 => 0.1055, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/ary3: 14.68% (1.7426 => 1.9984, std.dev.: 0.0159) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.77% (4.0101 => 4.5621, std.dev.: 0.0719) SingleSource/Benchmarks/McGill/queens: 11.08% (1.6261 => 1.8062, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.69% (3.0256 => 3.3187, std.dev.: 0.0131) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.28% (0.2857 => 0.3122, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/lists: 8.65% (7.0025 => 7.6079, std.dev.: 0.0090) SingleSource/Benchmarks/Stanford/Puzzle: 8.58% (0.1433 => 0.1556, std.dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 8.33% (21.1721 => 22.9355, std.dev.: 0.0956) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.47% (1.0063 => 1.0714, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.07% (40.4792 => 42.9374, std.dev.: 0.1977) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.85% (0.3301 => 0.3494, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: 4.11% (15.2242 => 15.8500, std.dev.: 0.0164) SingleSource/Benchmarks/Misc/dt: 3.90% (0.9851 => 1.0235, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.88% (3.4080 => 3.5401, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.56% (0.5587 => 0.5786, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.17% (0.7609 => 0.7850, std.dev.: 0.0058) MultiSource/Benchmarks/sim/sim: 3.12% (3.8907 => 4.0122, std.dev.: 0.0149) MultiSource/Applications/hexxagon/hexxagon: 2.79% (14.4877 => 14.8920, std.dev.: 0.0180) MultiSource/Benchmarks/FreeBench/mason/mason: 2.72% (0.5004 => 0.5140, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 2.46% (0.6308 => 0.6463, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.45% (0.5876 => 0.6020, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 2.29% (3.5520 => 3.6335, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.23% (6.6312 => 6.7794, std.dev.: 0.0080) SingleSource/Benchmarks/Dhrystone/dry: 2.12% (2.4013 => 2.4522, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.72% (4.5056 => 4.5831, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/power/power: 1.45% (1.4184 => 1.4390, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.42% (22.3381 => 22.6552, std.dev.: 0.0732) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.01% (1.2726 => 1.2855, std.dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.46% (0.3497 => 0.2082, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.23% (5.2665 => 4.1484, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/ary3: -20.53% (1.7473 => 1.3885, std.dev.: 0.0388) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.47% (15.8312 => 13.0660, std.dev.: 0.2153) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.32% (1.1647 => 0.9630, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1584, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: -9.07% (0.1114 => 0.1013, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.40% (3.2007 => 2.9319, std.dev.: 0.0330) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.29% (1.4034 => 1.2871, std.dev.: 0.0094) MultiSource/Applications/lambda-0_1_3/lambda: -7.19% (7.6833 => 7.1308, std.dev.: 0.0171) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.89% (3.6254 => 3.3756, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.64% (2.0027 => 1.8698, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/fibo: -6.62% (4.6355 => 4.3288, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/richards_benchmark: -6.18% (1.4441 => 1.3548, std.dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.00% (2.9728 => 2.7944, std.dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: -5.71% (3.4230 => 3.2277, std.dev.: 0.0233) MultiSource/Benchmarks/mafft/pairlocalalign: -5.57% (62.4126 => 58.9341, std.dev.: 0.1777) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.46% (3.9413 => 3.7261, std.dev.: 0.0304) SingleSource/Benchmarks/Shootout/fib2: -5.24% (4.4195 => 4.1879, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.02% (0.4140 => 0.3932, std.dev.: 0.0065) MultiSource/Applications/sgefa/sgefa: -4.59% (0.3746 => 0.3574, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.47% (0.4564 => 0.4360, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -4.27% (2.5166 => 2.4092, std.dev.: 0.0196) SingleSource/Benchmarks/Shootout-C++/methcall: -4.26% (9.2503 => 8.8565, std.dev.: 0.0536) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.78% (1.1683 => 1.1358, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2848, std.dev.: 0.0065) MultiSource/Applications/lua/lua: -2.66% (29.5232 => 28.7375, std.dev.: 0.1958) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.36% (2.4457 => 2.3879, std.dev.: 0.0114) MultiSource/Benchmarks/PAQ8p/paq8p: -2.36% (92.7467 => 90.5551, std.dev.: 0.1317) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.18% (3.7496 => 3.6679, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/hash2: -2.00% (3.4876 => 3.4179, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.94% (1.8739 => 1.8376, std.dev.: 0.0058) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.91% (2.3569 => 2.3118, std.dev.: 0.0017) MultiSource/Applications/aha/aha: -1.81% (3.4286 => 3.3667, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.64% (9.3855 => 9.2316, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -1.54% (1.0926 => 1.0758, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3155, std.dev.: 0.0048) SingleSource/Benchmarks/Dhrystone/fldry: -1.33% (2.4971 => 2.4639, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.28% (2.8964 => 2.8592, std.dev.: 0.0065) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 3.08% (0.9980 => 1.0287, std.dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: 2.44% (0.6022 => 0.6169, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: 1.38% (0.1666 => 0.1689, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.38% (0.1554 => 0.1591, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.88% (0.3083 => 0.3141, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.46% (0.2394 => 0.2405, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.54% (0.3175 => 0.3224, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.78% (0.2302 => 0.2320, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel: -2.67% (0.0449 => 0.0437, std.dev.: 0.0012) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.42% (0.0240 => 0.0241, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 2.08% (0.0192 => 0.0196, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.51% (0.0390 => 0.0392, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.33% (0.0301 => 0.0305, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -27.46% (0.0284 => 0.0206, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.93% (0.0324 => 0.0327, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 2.82% (0.0177 => 0.0182, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 3.17% (0.0189 => 0.0195, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 2.01% (0.0249 => 0.0254, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 2.15% (0.0325 => 0.0332, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 10.00% (0.0010 => 0.0011) MultiSource/Applications/ClamAV/clamscan: 1.61% (0.1429 => 0.1452, std.dev.: 0.0031) MultiSource/Applications/lemon/lemon: 1.01% (1.5019 => 1.5170, std.dev.: 0.0212) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.73% (0.1501 => 0.1445, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.20% (0.4264 => 0.4170, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.60% (0.1344 => 0.1352, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.51% (0.0589 => 0.0645, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 14.22% (0.0232 => 0.0265, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.23% (0.0639 => 0.0580, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.73% (1.1350 => 1.1267, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 350.00% (0.0006 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -70.83% (0.0024 => 0.0007, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.63% (0.0637 => 0.0641, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -21.14% (0.0246 => 0.0194, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.51% (0.7541 => 0.7655, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.01% (1.5363 => 1.5979, std.dev.: 0.0011) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 1 04:22:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 1 Oct 2012 06:22:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121001112237.D46522A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4440?compare_to=4435&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4440, Order: 164927, Start Time: 2012-10-01 08:14:24, End Time: 2012-10-01 11:24:16 To: 4435, Order: 164925, Start Time: 2012-10-01 02:30:25, End Time: 2012-10-01 05:40:23 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 0 (136 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (131 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1039 (757 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.02% (9.8083 => 9.8098, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.03% (9.4111 => 9.4137, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.06% (16.9530 => 16.9636, std.dev.: 0.0004) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 12.64% (0.3488 => 0.3929, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 12.54% (0.3446 => 0.3878, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 12.53% (0.3465 => 0.3899, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.50% (0.3496 => 0.3933, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.49% (0.3460 => 0.3892, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.42% (0.3469 => 0.3900, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.41% (0.3442 => 0.3869, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.08% (0.3650 => 0.4091, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.05% (0.3643 => 0.4082, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.76% (0.1063 => 0.1188, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/parameter-passing: 11.73% (0.3724 => 0.4161, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 11.02% (1.5932 => 1.7688, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference-object: 9.02% (0.5889 => 0.6420, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.93% (0.5826 => 0.6346, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 8.46% (0.1218 => 0.1321, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 8.15% (0.1619 => 0.1751, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.86% (0.2875 => 0.3101, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 7.60% (0.2725 => 0.2932, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.52% (0.7171 => 0.7710, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hello: 7.48% (0.2714 => 0.2917, std.dev.: 0.0019) SingleSource/Regression/C++/ofstream_ctor: 7.46% (0.3004 => 0.3228, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.45% (0.2738 => 0.2942, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.45% (0.3195 => 0.3433, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.40% (0.2811 => 0.3019, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 7.38% (0.2750 => 0.2953, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.37% (0.2729 => 0.2930, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 7.35% (0.2803 => 0.3009, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 7.29% (0.2813 => 0.3018, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 7.26% (0.2823 => 0.3028, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.23% (0.2792 => 0.2994, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/wc: 7.17% (0.3096 => 0.3318, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.16% (2.0673 => 2.2153, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 7.16% (0.2780 => 0.2979, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.16% (3.5627 => 3.8177, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.16% (1.6211 => 1.7371, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.15% (0.4361 => 0.4673, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.12% (1.3152 => 1.4089, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/09-vor/vor: 7.11% (0.1505 => 0.1612, std.dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 7.10% (0.9909 => 1.0613, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.10% (0.1620 => 0.1735, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 7.07% (0.3267 => 0.3498, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.05% (2.7292 => 2.9216, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/ary: 7.03% (0.3258 => 0.3487, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.03% (0.4994 => 0.5345, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.02% (0.5000 => 0.5351, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.97% (0.2911 => 0.3114, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.93% (0.3348 => 0.3580, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.93% (0.3060 => 0.3272, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 6.84% (0.3317 => 0.3544, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 6.83% (5.5417 => 5.9200, std.dev.: 0.0224) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.82% (0.3124 => 0.3337, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.81% (0.3362 => 0.3591, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.79% (0.3282 => 0.3505, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.79% (1.0781 => 1.1513, std.dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.75% (0.2014 => 0.2150, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.68% (0.3625 => 0.3867, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 6.66% (0.3678 => 0.3923, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 6.59% (0.3477 => 0.3706, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.51% (0.3930 => 0.4186, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sieve: 6.44% (0.3726 => 0.3966, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/hash: 6.42% (0.4146 => 0.4412, std.dev.: 0.0094) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.38% (0.3890 => 0.4138, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.31% (0.3690 => 0.3923, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.30% (0.4251 => 0.4519, std.dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: 6.13% (4.2109 => 4.4692, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.10% (0.2736 => 0.2903, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.03% (0.3981 => 0.4221, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 5.96% (0.2566 => 0.2719, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.95% (0.5026 => 0.5325, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.93% (0.3845 => 0.4073, std.dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 5.92% (2.1013 => 2.2256, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.85% (0.4139 => 0.4381, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.83% (0.2866 => 0.3033, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.80% (4.4195 => 4.6759, std.dev.: 0.0050) MultiSource/Applications/spiff/spiff: 5.76% (0.4029 => 0.4261, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 5.69% (0.5012 => 0.5297, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 5.68% (23.5202 => 24.8555, std.dev.: 0.0304) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.66% (0.5900 => 0.6234, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.66% (0.2068 => 0.2185, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.59% (0.1968 => 0.2078, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 5.57% (4.6177 => 4.8750, std.dev.: 0.0159) MultiSource/Benchmarks/MallocBench/gs/gs: 5.57% (1.8794 => 1.9840, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.56% (0.3903 => 0.4120, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.52% (0.2737 => 0.2888, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.52% (0.6435 => 0.6790, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 5.41% (0.6634 => 0.6993, std.dev.: 0.0042) MultiSource/Applications/JM/ldecod/ldecod: 5.38% (2.1653 => 2.2818, std.dev.: 0.0022) MultiSource/Applications/lua/lua: 5.37% (1.4269 => 1.5035, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.35% (0.3084 => 0.3249, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 5.17% (0.5546 => 0.5833, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.13% (0.4658 => 0.4897, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.10% (0.2040 => 0.2144, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.02% (1.9966 => 2.0969, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.02% (0.2969 => 0.3118, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.01% (0.3271 => 0.3435, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.97% (1.9694 => 2.0672, std.dev.: 0.0038) MultiSource/Applications/minisat/minisat: 4.89% (0.3336 => 0.3499, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 4.87% (0.2075 => 0.2176, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.80% (0.2103 => 0.2204, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 4.77% (0.7875 => 0.8251, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 4.67% (0.9697 => 1.0150, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: 4.47% (2.0346 => 2.1256, std.dev.: 0.0037) MultiSource/Applications/SIBsim4/SIBsim4: 4.27% (0.2691 => 0.2806, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.23% (0.7426 => 0.7740, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 4.22% (0.2391 => 0.2492, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 4.19% (0.4847 => 0.5050, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.86% (0.5361 => 0.5568, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.65% (0.5584 => 0.5788, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.61% (11.6398 => 12.0600, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.39% (4.6926 => 4.8516, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.32% (0.3792 => 0.3918, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.15% (0.4253 => 0.4387, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 2.07% (11.9555 => 12.2029, std.dev.: 0.0074) SingleSource/UnitTests/Vector/constpool: 1.48% (2.4764 => 2.5131, std.dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6110, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6759, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-2: 4.92% (1.8057 => 1.8945, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1708, std.dev.: 0.0957) SingleSource/Benchmarks/Dhrystone/dry: 4.17% (14.0481 => 14.6338, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2073, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.93% (41.7953 => 42.6015, std.dev.: 0.0190) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5055, std.dev.: 0.0205) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.59% (3.1722 => 3.2226, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2874, std.dev.: 0.0019) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5141, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.14% (1.0927 => 1.1052, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.10% (2.0820 => 2.1049, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5818, std.dev.: 0.0141) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.75% (25.4195 => 16.5866, std.dev.: 0.0072) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9772, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7883, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary2: -6.33% (0.2402 => 0.2250, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7988, std.dev.: 0.0081) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7741, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.45% (0.6293 => 0.6139, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: -2.43% (17.2379 => 16.8183, std.dev.: 0.0194) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.68% (10.7630 => 10.5820, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4983, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0453, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 1 04:23:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 1 Oct 2012 06:23:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121001112324.CF0B82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4441?compare_to=4437&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4441, Order: 164931, Start Time: 2012-10-01 10:04:46, End Time: 2012-10-01 11:25:03 To: 4437, Order: 164927, Start Time: 2012-10-01 08:14:35, End Time: 2012-10-01 09:35:19 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (145 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 92 (18 on baseline) Unchanged Tests: 950 (703 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.26% (0.5765 => 0.5750, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: -0.03% (15.9672 => 15.9626, std.dev.: 0.0137) MultiSource/Applications/kimwitu++/kc: -0.07% (14.8745 => 14.8645, std.dev.: 0.0056) MultiSource/Benchmarks/Bullet/bullet: -0.35% (83.4483 => 83.1598, std.dev.: 0.0195) MultiSource/Benchmarks/MallocBench/gs/gs: -0.14% (4.3374 => 4.3313, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.22% (0.0461 => 0.0460, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.22% (0.0463 => 0.0462, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.23% (0.0430 => 0.0429, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.23% (0.0432 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.24% (0.0420 => 0.0419) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.24% (0.0421 => 0.0420, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.24% (0.0414 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.24% (0.0415 => 0.0414, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.23% (0.0432 => 0.0431) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.23% (0.0433 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.23% (0.0426 => 0.0425) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.23% (0.0427 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.24% (0.0415 => 0.0414, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.24% (0.0418 => 0.0417, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.47% (0.0424 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.24% (0.0424 => 0.0423, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.23% (0.0435 => 0.0434) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.90% (0.0448 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.24% (0.0411 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.24% (0.0412 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.24% (0.0423 => 0.0422, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.24% (0.0424 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0414 => 0.0414) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.24% (0.0416 => 0.0415, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.25% (0.0407 => 0.0406) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.25% (0.0407 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.25% (0.0405 => 0.0404) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0406 => 0.0406) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.23% (0.0443 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.23% (0.0444 => 0.0443) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.25% (0.0404 => 0.0403, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.25% (0.0405 => 0.0404) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.25% (0.0405 => 0.0404) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.49% (0.0407 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.24% (0.0413 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.24% (0.0414 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.01% (1.2288 => 1.2287, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.07% (7.5217 => 7.5267, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.01% (3.7092 => 3.7087, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.11% (0.6468 => 0.6475, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1432 => 0.1431, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.99% (0.0668 => 0.0648, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: 31.49% (63.2438 => 83.1598, std.dev.: 0.0195) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14235.14% (0.0720 => 10.3213, std.dev.: 0.0082) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 46.88% (10.3673 => 15.2273, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: 28.05% (0.1622 => 0.2077, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.24% (2.2022 => 2.5157, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.21% (7.0540 => 8.0563, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops: 13.90% (0.1432 => 0.1631, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 13.25% (1.1194 => 1.2677, std.dev.: 0.0027) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.77% (0.1566 => 0.1766, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.78% (1.7609 => 1.9684, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.34% (0.3473 => 0.3867, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.15% (0.3543 => 0.3938, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.10% (0.3497 => 0.3885, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.09% (0.3543 => 0.3936, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.98% (0.3516 => 0.3902, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.95% (0.3561 => 0.3951, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.69% (0.3694 => 0.4089, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.52% (0.3927 => 0.4340, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.50% (0.3828 => 0.4230, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.29% (0.3886 => 0.4286, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.72% (0.1584 => 0.1738, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 9.23% (0.3282 => 0.3585, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 8.46% (10.4361 => 11.3194, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.12% (0.4879 => 0.5275, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.87% (0.3177 => 0.3427, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference-object: 7.81% (0.6030 => 0.6501, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.79% (0.1438 => 0.1550, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 7.76% (0.5925 => 0.6385, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/power/power: 7.71% (0.1440 => 0.1551, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 7.67% (9.4845 => 10.2120, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.31% (0.6675 => 0.7163, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 7.15% (0.7115 => 0.7624, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 7.01% (0.7433 => 0.7954, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 6.97% (5.7591 => 6.1605, std.dev.: 0.0072) SingleSource/UnitTests/ObjC++/property-reference: 6.95% (0.7326 => 0.7835, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.89% (0.2700 => 0.2886, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 6.87% (0.3423 => 0.3658, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.83% (0.2065 => 0.2206, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.82% (0.5105 => 0.5453, std.dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 6.79% (0.3109 => 0.3320, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 6.78% (0.1695 => 0.1810, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.78% (0.2271 => 0.2425, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.74% (0.4615 => 0.4926, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 6.70% (0.2554 => 0.2725, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.65% (0.1625 => 0.1733, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: 6.63% (0.3422 => 0.3649, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 6.57% (3.3354 => 3.5544, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.52% (0.5860 => 0.6242, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.51% (1.5415 => 1.6418, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.47% (4.2646 => 4.5406, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.44% (8.1363 => 8.6606, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.43% (1.3050 => 1.3889, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.35% (0.8172 => 0.8691, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.31% (4.9449 => 5.2570, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.24% (5.0018 => 5.3140, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.23% (0.3307 => 0.3513, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.20% (0.5569 => 0.5914, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.19% (0.2891 => 0.3070, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 6.18% (0.7835 => 0.8319, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.16% (0.2758 => 0.2928, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.15% (0.4636 => 0.4921, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.09% (0.8067 => 0.8558, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.08% (0.4064 => 0.4311, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.08% (0.2831 => 0.3003, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.07% (0.2107 => 0.2235, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.00% (0.4103 => 0.4349, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/fibo: 5.94% (0.2725 => 0.2887, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary3: 5.94% (0.3283 => 0.3478, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.93% (0.3121 => 0.3306, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 5.92% (0.4289 => 0.4543, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.87% (0.3865 => 0.4092, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.85% (0.3232 => 0.3421, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.84% (0.3650 => 0.3863, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.84% (0.3136 => 0.3319, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: 5.82% (0.3092 => 0.3272, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.82% (0.9765 => 1.0333, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 5.81% (0.6456 => 0.6831, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.78% (0.5020 => 0.5310, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.77% (0.1940 => 0.2052, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.77% (0.2756 => 0.2915, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/wc: 5.77% (0.3052 => 0.3228, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.75% (0.3826 => 0.4046, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 5.75% (0.2714 => 0.2870, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.72% (0.3162 => 0.3343, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 5.71% (0.3098 => 0.3275, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 5.71% (0.2871 => 0.3035, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.71% (0.4203 => 0.4443, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.68% (2.0665 => 2.1839, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.67% (7.9617 => 8.4129, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: 5.66% (1.1642 => 1.2301, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/sieve: 5.61% (0.3603 => 0.3805, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.61% (0.2872 => 0.3033, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.59% (0.2793 => 0.2949, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.58% (0.4620 => 0.4878, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 5.58% (0.4048 => 0.4274, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.56% (0.3684 => 0.3889, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 5.52% (0.3387 => 0.3574, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 5.51% (1.5603 => 1.6462, std.dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 5.50% (21.9371 => 23.1433, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/random: 5.46% (0.2802 => 0.2955, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.46% (0.2877 => 0.3034, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 5.44% (0.3180 => 0.3353, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 5.41% (3.8723 => 4.0816, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary2: 5.39% (0.3379 => 0.3561, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.37% (1.1861 => 1.2498, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 5.36% (1.0722 => 1.1297, std.dev.: 0.0132) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.34% (0.3935 => 0.4145, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.26% (0.3441 => 0.3622, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.22% (0.2603 => 0.2739, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 5.12% (2.0273 => 2.1310, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: 5.02% (0.4299 => 0.4515, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.76% (0.6450 => 0.6757, std.dev.: 0.0094) MultiSource/Applications/siod/siod: 4.71% (2.2969 => 2.4050, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/football/football: 4.70% (0.8921 => 0.9340, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.43% (0.5981 => 0.6246, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.41% (1.5859 => 1.6559, std.dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 4.10% (1.1840 => 1.2325, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.10% (1.4186 => 1.4767, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.99% (14.3668 => 14.9404, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/objinst: 3.90% (0.3131 => 0.3253, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.85% (2.2024 => 2.2873, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 3.85% (1.2842 => 1.3337, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.33% (0.3817 => 0.3944, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.77% (0.8101 => 0.8325, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.44% (3.8922 => 3.9483, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 1.42% (17.1811 => 17.4246, std.dev.: 0.0204) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 9.22% (3.1595 => 3.4507, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 6.69% (1.1396 => 1.2158, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.64% (3.1578 => 3.3676, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.49% (3.6395 => 3.7666, std.dev.: 0.0025) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.10% (4.2280 => 4.3591, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0002) MultiSource/Benchmarks/llubenchmark/llu: 1.64% (3.7781 => 3.8400, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.36% (0.9540 => 0.9670, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7981, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.10% (6.5088 => 6.5803, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 1.00% (9.1159 => 9.2074, std.dev.: 0.0327) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1282, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.19% (0.8651 => 0.1714, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.18% (5.2763 => 3.2619, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.55% (5.3855 => 3.9017, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.16% (5.3526 => 3.8988, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -14.73% (54.1659 => 46.1896, std.dev.: 0.0104) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.96% (2.9384 => 2.6163, std.dev.: 0.0078) MultiSource/Applications/ClamAV/clamscan: -8.04% (22.1758 => 20.3936, std.dev.: 0.0143) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.95% (1.6925 => 1.4226, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/chomp: -12.33% (1.2373 => 1.0848, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel-2: -10.38% (1.5373 => 1.3778, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.28% (19.9488 => 18.2973, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4787, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.73% (1.8329 => 1.7095, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5753, std.dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0019) MultiSource/Benchmarks/sim/sim: -5.09% (5.0483 => 4.7915) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.03% (1.6805 => 1.5960, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5072, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.61% (3.2827 => 3.1642, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.07% (32.5116 => 31.5146, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.19% (8.6802 => 8.4904, std.dev.: 0.0224) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.12% (0.4808 => 0.4706, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -1.97% (10.2830 => 10.0807, std.dev.: 0.0219) MultiSource/Applications/hexxagon/hexxagon: -1.77% (12.4730 => 12.2518, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.75% (8.1563 => 8.0133, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6805, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091) SingleSource/UnitTests/Vector/multiplies: -1.63% (2.5528 => 2.5111, std.dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4213, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -1.10% (6.2999 => 6.2306, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8587, std.dev.: 0.0029) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.96% (0.5229 => 0.5750, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 6.49% (14.9895 => 15.9626, std.dev.: 0.0137) MultiSource/Applications/kimwitu++/kc: 5.01% (14.1553 => 14.8645, std.dev.: 0.0056) MultiSource/Benchmarks/MallocBench/gs/gs: 5.37% (4.1105 => 4.3313, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.21% (1.1048 => 1.2287, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.15% (7.1582 => 7.5267, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.10% (3.4629 => 3.7087, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.07% (0.6222 => 0.6475, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 1 04:33:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 1 Oct 2012 06:33:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121001113309.833762A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4442?compare_to=4438&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4442, Order: 164931, Start Time: 2012-10-01 10:09:25, End Time: 2012-10-01 11:34:48 To: 4438, Order: 164927, Start Time: 2012-10-01 08:14:37, End Time: 2012-10-01 09:40:18 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 2 (174 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1037 (697 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 1.13% (3.6860 => 3.7275, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.06% (55.7626 => 56.3546, std.dev.: 0.0951) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.01% (2.7528 => 2.7525, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (2.1154 => 2.1154, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.00% (4.9749 => 4.9750, std.dev.: 0.0082) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.90% (2.0176 => 2.4191, std.dev.: 0.0108) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.31% (0.1410 => 0.1640, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 14.41% (0.0826 => 0.0945, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.06% (0.1072 => 0.1212, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 11.72% (0.5818 => 0.6500, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 11.57% (0.5748 => 0.6413, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 11.14% (0.4328 => 0.4810, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 10.92% (0.7061 => 0.7832, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.83% (0.1413 => 0.1566, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 10.61% (0.2781 => 0.3076, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 10.46% (0.1013 => 0.1119, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.42% (0.2782 => 0.3072, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.33% (0.1588 => 0.1752, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 10.27% (0.4062 => 0.4479, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.17% (3.9660 => 4.3692, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.13% (0.3899 => 0.4294, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 10.03% (1.3693 => 1.5067, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.95% (0.1327 => 0.1459, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 9.92% (0.7038 => 0.7736, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 9.89% (0.2690 => 0.2956, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.86% (0.2596 => 0.2852, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.86% (0.3022 => 0.3320, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 9.86% (0.2607 => 0.2864, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 9.86% (0.2628 => 0.2887, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.83% (0.2655 => 0.2916, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 9.79% (0.2726 => 0.2993, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3485 => 0.3825, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.73% (1.9828 => 2.1758, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.73% (0.2765 => 0.3034, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.65% (0.7710 => 0.8454, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.65% (0.5265 => 0.5773, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/except: 9.64% (0.2760 => 0.3026, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.64% (0.3580 => 0.3925, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 9.60% (0.2937 => 0.3219, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.54% (0.2966 => 0.3249, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 9.53% (0.2761 => 0.3024, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.50% (0.3756 => 0.4113, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.48% (0.2721 => 0.2979, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 9.47% (0.3293 => 0.3605, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 9.46% (0.3107 => 0.3401, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 9.43% (0.3149 => 0.3446, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.43% (0.3489 => 0.3818, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.42% (0.2696 => 0.2950, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.41% (0.4016 => 0.4394, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.41% (0.6959 => 0.7614, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 9.41% (0.3868 => 0.4232, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.39% (1.2193 => 1.3338, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.39% (0.6283 => 0.6873, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.19% (0.9199 => 1.0044, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 9.10% (0.2988 => 0.3260, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 9.09% (0.3453 => 0.3767, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 9.03% (13.8202 => 15.0676, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.02% (1.4563 => 1.5877, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 8.96% (0.3192 => 0.3478, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.94% (1.1364 => 1.2380, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.89% (0.4791 => 0.5217, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 8.80% (0.3534 => 0.3845, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.75% (0.4390 => 0.4774, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.61% (0.1986 => 0.2157, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.53% (0.3130 => 0.3397, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 8.39% (0.2945 => 0.3192, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 8.37% (0.1589 => 0.1722, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.36% (0.1435 => 0.1555, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.32% (0.5577 => 0.6041, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 8.28% (1.0313 => 1.1167, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 8.19% (0.3578 => 0.3871, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 8.18% (0.2995 => 0.3240, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.17% (0.4003 => 0.4330, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 8.15% (0.3646 => 0.3943, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.13% (0.2127 => 0.2300, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.13% (0.3789 => 0.4097, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.12% (0.3914 => 0.4232, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.11% (0.3601 => 0.3893, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.07% (0.1276 => 0.1379, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.04% (0.4379 => 0.4731, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.03% (0.3650 => 0.3943, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.03% (0.3663 => 0.3957, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.01% (0.3246 => 0.3506, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.99% (0.3940 => 0.4255, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-3: 7.98% (0.3623 => 0.3912, std.dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.93% (0.2914 => 0.3145, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 7.89% (1.1061 => 1.1934, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 7.83% (3.8646 => 4.1673, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 7.76% (16.6129 => 17.9028, std.dev.: 0.0286) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.75% (0.3755 => 0.4046, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 7.73% (0.7506 => 0.8086, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.68% (7.2180 => 7.7725, std.dev.: 0.0073) MultiSource/Benchmarks/McCat/18-imp/imp: 7.58% (0.3220 => 0.3464, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.57% (0.5637 => 0.6064, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 7.56% (0.8310 => 0.8938, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.51% (3.6692 => 3.9446, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/08-main/main: 7.49% (0.2243 => 0.2411, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.47% (0.6576 => 0.7067, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.45% (0.8698 => 0.9346, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 7.44% (0.6744 => 0.7246, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 7.42% (0.2925 => 0.3142, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.35% (0.7460 => 0.8008, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 7.32% (3.1889 => 3.4223, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.27% (0.2023 => 0.2170, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.24% (0.1865 => 0.2000, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 7.20% (2.1791 => 2.3361, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.18% (1.3813 => 1.4805, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.10% (1.3819 => 1.4800, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 7.09% (1.9270 => 2.0636, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.07% (0.1569 => 0.1680, std.dev.: 0.0025) MultiSource/Applications/viterbi/viterbi: 7.04% (0.1478 => 0.1582, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.99% (0.1789 => 0.1914, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.90% (1.0594 => 1.1325, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.89% (1.3245 => 1.4158, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 6.70% (0.1657 => 0.1768, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 6.58% (14.8535 => 15.8305, std.dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: 6.57% (1.2292 => 1.3100, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.52% (0.4113 => 0.4381, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.47% (4.3801 => 4.6635, std.dev.: 0.0059) MultiSource/Applications/SIBsim4/SIBsim4: 6.40% (1.2749 => 1.3565, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.38% (4.4433 => 4.7270, std.dev.: 0.0092) MultiSource/Benchmarks/Olden/bh/bh: 6.37% (0.2859 => 0.3041, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.32% (0.6135 => 0.6523, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 6.30% (8.4961 => 9.0317, std.dev.: 0.0060) MultiSource/Applications/oggenc/oggenc: 6.29% (4.6629 => 4.9560, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.08% (0.8818 => 0.9354, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.03% (0.2140 => 0.2269, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.88% (1.1333 => 1.1999, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: 5.86% (0.6250 => 0.6616, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 5.84% (0.3131 => 0.3314, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.82% (0.2321 => 0.2456, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 5.78% (14.5298 => 15.3693, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.75% (0.2504 => 0.2648, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.73% (3.2742 => 3.4617, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 5.67% (6.5754 => 6.9483, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.64% (4.9865 => 5.2677, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.60% (0.4805 => 0.5074, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.59% (13.2842 => 14.0270, std.dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.58% (0.3245 => 0.3426, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.33% (0.3511 => 0.3698, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.88% (1.5188 => 1.5929, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.75% (0.9108 => 0.9541, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 4.72% (3.7467 => 3.9235, std.dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.54% (6.2785 => 6.5636, std.dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.50% (2.1007 => 2.1952, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 4.10% (33.2944 => 34.6582, std.dev.: 0.0124) MultiSource/Applications/sqlite3/sqlite3: 2.26% (16.2614 => 16.6295, std.dev.: 0.0232) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5170, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.06% (1.0895 => 1.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.26% (1.8175 => 2.2585, std.dev.: 0.0458) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 8.57% (1.1560 => 1.2551, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 8.47% (0.1322 => 0.1434, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4141, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.13% (1.2998 => 1.3795, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0049, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.09% (11.2619 => 11.7227, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7747, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9862, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.27% (10.7476 => 11.0993, std.dev.: 0.0288) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.15% (7.4271 => 7.5866, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.52% (1.4298 => 1.4516, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0497, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5136, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.29% (5.5130 => 5.5842, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1879, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 1.09% (12.0921 => 12.2234, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (2.2986 => 2.3233, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 1.03% (12.4560 => 12.5838, std.dev.: 0.0096) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.10% (0.4657 => 0.3954, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.81% (22.5627 => 21.9296, std.dev.: 0.0078) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.90% (1.2308 => 1.0843, std.dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.31% (20.3410 => 18.2445, std.dev.: 0.0277) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.66% (1.3780 => 1.3000, std.dev.: 0.0099) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0037) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7941, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1560, std.dev.: 0.0102) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.39% (1.7688 => 1.7088, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.04% (0.4867 => 0.4719, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.75% (3.0263 => 2.9430, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4786, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -2.28% (1.9762 => 1.9311, std.dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7054, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.80% (0.6615 => 0.6496, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.69% (6.3560 => 6.2488, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.51% (7.3305 => 7.2201, std.dev.: 0.0291) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0069, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8663, std.dev.: 0.0124) MultiSource/Applications/lua/lua: -1.28% (26.5159 => 26.1774, std.dev.: 0.0165) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2501, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4940, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: -1.13% (9.3358 => 9.2303, std.dev.: 0.0086) MultiSource/Applications/viterbi/viterbi: -1.03% (4.4810 => 4.4348, std.dev.: 0.0038) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 1 05:40:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 1 Oct 2012 07:40:55 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121001124055.7852B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4443?compare_to=4439&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4443, Order: 164932, Start Time: 2012-10-01 11:18:32, End Time: 2012-10-01 12:42:35 To: 4439, Order: 164931, Start Time: 2012-10-01 09:39:53, End Time: 2012-10-01 11:02:25 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 14 (63 on baseline) Performance Improvements: 23 (44 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 936 (784 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.12% (0.8201 => 0.8375, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.10% (0.8317 => 0.8492, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.82% (0.8407 => 0.8560, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.74% (0.8114 => 0.8255, std.dev.: 0.0025) MultiSource/Benchmarks/PAQ8p/paq8p: 1.60% (2.3533 => 2.3909, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.51% (0.7886 => 0.8005, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.39% (0.7984 => 0.8095, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.85% (1.1779 => 1.2233, std.dev.: 0.0105) MultiSource/Benchmarks/Bullet/bullet: 2.50% (6.8975 => 7.0700, std.dev.: 0.0418) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.90% (2.4409 => 2.4872, std.dev.: 0.0150) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.55% (1.6093 => 1.6342, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.26% (4.3318 => 4.3862, std.dev.: 0.0204) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.17% (1.8376 => 1.8591, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 1.06% (8.8565 => 8.9502, std.dev.: 0.0130) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.90% (0.6032 => 0.5676, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -4.42% (0.6172 => 0.5899, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.09% (0.3004 => 0.2881, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.05% (0.8067 => 0.7740, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/loader/loader: -3.87% (0.2917 => 0.2804, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -3.58% (0.4668 => 0.4501, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -3.52% (0.5885 => 0.5678, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -3.27% (0.9335 => 0.9030, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -3.12% (0.5708 => 0.5530, std.dev.: 0.0066) MultiSource/Benchmarks/MallocBench/gs/gs: -2.83% (4.0247 => 3.9108, std.dev.: 0.0286) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.53% (0.8074 => 0.7870, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.50% (0.7561 => 0.7372, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -2.48% (1.3104 => 1.2779, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -2.25% (8.4734 => 8.2827, std.dev.: 0.0314) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.97% (1.2308 => 1.2066, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -1.95% (1.2325 => 1.2085, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.90% (4.4009 => 4.3173, std.dev.: 0.0187) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.65% (4.3906 => 4.3181, std.dev.: 0.0166) MultiSource/Applications/hbd/hbd: -1.60% (1.3882 => 1.3660, std.dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.60% (6.4833 => 6.3797, std.dev.: 0.0294) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.56% (1.4660 => 1.4431, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -1.11% (1.6029 => 1.5851, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MallocBench/gs/gs: -12.23% (0.0826 => 0.0725, std.dev.: 0.0038) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -2.33% (1.0287 => 1.0047, std.dev.: 0.0449) MultiSource/Applications/sqlite3/sqlite3: -0.92% (0.6169 => 0.6112, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/08-main/main: -0.95% (0.1689 => 0.1673, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.53% (0.1591 => 0.1519, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.41% (0.3141 => 0.3034, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.62% (0.2405 => 0.2318, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.52% (0.3224 => 0.3175, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.82% (0.2320 => 0.2301, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel: -13.96% (0.0437 => 0.0376, std.dev.: 0.0035) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0009) SingleSource/UnitTests/2003-08-11-VaListArg: -53.33% (0.0090 => 0.0042, std.dev.: 0.0023) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.66% (0.0241 => 0.0237, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -9.69% (0.0196 => 0.0177, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.81% (0.0392 => 0.0381, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -25.25% (0.0305 => 0.0228, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 7.77% (0.0206 => 0.0222, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.14% (0.0327 => 0.0320, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -28.57% (0.0182 => 0.0130, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/test1: -3.08% (0.0195 => 0.0189, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -1.57% (0.0254 => 0.0250, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -11.45% (0.0332 => 0.0294, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -54.55% (0.0011 => 0.0005) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1452 => 0.1453, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: -8.55% (1.5170 => 1.3873, std.dev.: 0.0693) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.25% (0.1445 => 0.1427, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.45% (0.4170 => 0.4068, std.dev.: 0.0214) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.17% (0.1352 => 0.1449, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -15.97% (0.0645 => 0.0542, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -24.91% (0.0265 => 0.0199, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.66% (0.0580 => 0.0607, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.30% (1.1267 => 1.1301, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -40.74% (0.0027 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -28.57% (0.0007 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.39% (0.0641 => 0.0568, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.53% (0.0194 => 0.0160, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.07% (0.7655 => 0.7650, std.dev.: 0.0135) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 0.15% (1.5979 => 1.6003, std.dev.: 0.0030) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -58.68% (0.0121 => 0.0050, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.95% (4.1772 => 3.0933, std.dev.: 0.0320) SingleSource/Benchmarks/Shootout-C++/except: 82433.33% (0.0006 => 0.4952, std.dev.: 0.0015) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -16.67% (0.0006 => 0.0005, std.dev.: 0.0001) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.62% (0.0745 => 0.0921, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 9.86% (2.1763 => 2.3909, std.dev.: 0.0104) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.62% (0.1414 => 0.1550, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.49% (0.1159 => 0.1269, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 6.93% (0.5309 => 0.5677, std.dev.: 0.0032) MultiSource/Applications/minisat/minisat: 6.85% (0.6173 => 0.6596, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.83% (0.6410 => 0.6848, std.dev.: 0.0073) MultiSource/Applications/lemon/lemon: 6.79% (1.0046 => 1.0728, std.dev.: 0.0198) MultiSource/Applications/SIBsim4/SIBsim4: 6.14% (1.1653 => 1.2369, std.dev.: 0.0061) MultiSource/Applications/lambda-0_1_3/lambda: 5.41% (0.6915 => 0.7289, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.37% (0.2552 => 0.2689, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.30% (0.3582 => 0.3772, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 5.18% (29.3170 => 30.8366, std.dev.: 0.0796) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.63% (0.6069 => 0.6350, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.63% (1.5150 => 1.5851, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.24% (0.4880 => 0.5087, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.11% (0.7639 => 0.7953, std.dev.: 0.0080) MultiSource/Benchmarks/mafft/pairlocalalign: 3.82% (8.2186 => 8.5329, std.dev.: 0.0091) MultiSource/Applications/Burg/burg: 3.60% (1.1440 => 1.1852, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.53% (12.6413 => 13.0880, std.dev.: 0.1037) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.38% (1.1672 => 1.2066, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.34% (0.4248 => 0.4390, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.33% (0.3901 => 0.4031, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: 3.33% (0.3217 => 0.3324, std.dev.: 0.0028) MultiSource/Applications/hbd/hbd: 2.95% (1.3268 => 1.3660, std.dev.: 0.0024) MultiSource/Applications/lua/lua: 2.91% (3.5980 => 3.7028, std.dev.: 0.0081) MultiSource/Applications/JM/ldecod/ldecod: 2.81% (6.4908 => 6.6734, std.dev.: 0.0643) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.52% (1.2021 => 1.2324, std.dev.: 0.0082) MultiSource/Applications/ClamAV/clamscan: 2.48% (14.6079 => 14.9695, std.dev.: 0.0686) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.37% (1.0689 => 1.0942, std.dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 2.25% (1.0821 => 1.1065, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.18% (1.1827 => 1.2085, std.dev.: 0.0077) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.00% (6.2546 => 6.3797, std.dev.: 0.0294) MultiSource/Benchmarks/Prolangs-C/football/football: 1.93% (0.8405 => 0.8567, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.89% (4.0318 => 4.1079, std.dev.: 0.0222) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.79% (0.5963 => 0.6070, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.71% (1.4189 => 1.4431, std.dev.: 0.0053) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.33% (4.2616 => 4.3181, std.dev.: 0.0166) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.36% (1.6538 => 2.3378, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 22.12% (3.4629 => 4.2290, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/ary3: 14.77% (1.7426 => 2.0000, std.dev.: 0.0915) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.45% (4.0101 => 4.5495, std.dev.: 0.0413) SingleSource/Benchmarks/McGill/queens: 10.80% (1.6261 => 1.8017, std.dev.: 0.0024) SingleSource/Benchmarks/Stanford/Puzzle: 10.26% (0.1433 => 0.1580, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/lists: 9.54% (7.0025 => 7.6704, std.dev.: 0.0270) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.24% (0.3301 => 0.3540, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/dt: 4.16% (0.9851 => 1.0261, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.11% (4.2129 => 4.3862, std.dev.: 0.0204) SingleSource/Benchmarks/Misc/fp-convert: 3.98% (15.2242 => 15.8302, std.dev.: 0.0478) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.85% (3.4080 => 3.5393, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.26% (0.5587 => 0.5769, std.dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 2.73% (14.4877 => 14.8834, std.dev.: 0.0236) MultiSource/Benchmarks/sim/sim: 2.71% (3.8907 => 3.9961, std.dev.: 0.0147) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.54% (0.5876 => 0.6025, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/mason/mason: 2.38% (0.5004 => 0.5123, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 2.17% (0.6308 => 0.6445, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.15% (6.6312 => 6.7736, std.dev.: 0.0178) SingleSource/Benchmarks/Dhrystone/dry: 2.07% (2.4013 => 2.4509, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/whetstone: 1.89% (2.3453 => 2.3896, std.dev.: 0.0162) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.71% (2.4455 => 2.4872, std.dev.: 0.0150) MultiSource/Benchmarks/Olden/em3d/em3d: 1.45% (4.6414 => 4.7086, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.44% (1.6110 => 1.6342, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/power/power: 1.39% (1.4184 => 1.4381, std.dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.83% (0.3497 => 0.2104, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -32.48% (0.0311 => 0.0210, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.89% (5.2665 => 4.1138, std.dev.: 0.0815) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.58% (1.1647 => 0.9599, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.14% (15.8312 => 13.2758, std.dev.: 0.1226) MultiSource/Benchmarks/McCat/17-bintr/bintr: -12.54% (0.0917 => 0.0802, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1596, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/moments: -9.25% (0.1114 => 0.1011, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.33% (1.4034 => 1.2865, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.55% (3.2007 => 2.9590, std.dev.: 0.0252) MultiSource/Applications/lambda-0_1_3/lambda: -7.14% (7.6833 => 7.1350, std.dev.: 0.0329) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.71% (3.6254 => 3.3822, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.56% (2.0027 => 1.8713, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: -6.44% (4.6355 => 4.3372, std.dev.: 0.0159) SingleSource/Benchmarks/Misc/richards_benchmark: -6.18% (1.4441 => 1.3549, std.dev.: 0.0106) MultiSource/Applications/SIBsim4/SIBsim4: -6.05% (3.4230 => 3.2158, std.dev.: 0.0243) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7948, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/distray/distray: -5.82% (0.2664 => 0.2509, std.dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: -5.44% (62.4126 => 59.0154, std.dev.: 0.0390) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.31% (3.9413 => 3.7321, std.dev.: 0.0271) SingleSource/Benchmarks/Shootout/fib2: -5.22% (4.4195 => 4.1888, std.dev.: 0.0146) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.77% (1.4021 => 1.3352, std.dev.: 0.0143) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.75% (0.4564 => 0.4347, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: -4.24% (0.3746 => 0.3587, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: -4.11% (2.5166 => 2.4132, std.dev.: 0.0211) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.84% (1.2722 => 1.2233, std.dev.: 0.0105) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.82% (0.4140 => 0.3982, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: -3.24% (9.2503 => 8.9502, std.dev.: 0.0130) SingleSource/Benchmarks/McGill/misr: -2.96% (0.4296 => 0.4169, std.dev.: 0.0022) MultiSource/Applications/lua/lua: -2.74% (29.5232 => 28.7138, std.dev.: 0.2513) SingleSource/Benchmarks/Misc/flops: -2.74% (9.5474 => 9.2862, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.60% (3.7496 => 3.6520, std.dev.: 0.0238) MultiSource/Applications/JM/lencod/lencod: -2.31% (6.7458 => 6.5899, std.dev.: 0.0569) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.15% (1.1683 => 1.1432, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.04% (0.6119 => 0.5994, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/neural/neural: -2.01% (1.0926 => 1.0706, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: -2.00% (3.4876 => 3.4178, std.dev.: 0.0056) MultiSource/Benchmarks/PAQ8p/paq8p: -1.83% (92.7467 => 91.0533, std.dev.: 0.1078) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.57% (9.3855 => 9.2379, std.dev.: 0.0111) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.34% (25.6658 => 25.3215, std.dev.: 0.0101) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.26% (27.1724 => 26.8289, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.13% (1.7361 => 1.7165, std.dev.: 0.0074) SingleSource/Benchmarks/Dhrystone/fldry: -1.13% (2.4971 => 2.4690, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.67% (0.9980 => 1.0047, std.dev.: 0.0449) MultiSource/Applications/sqlite3/sqlite3: 1.49% (0.6022 => 0.6112, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/08-main/main: 0.42% (0.1666 => 0.1673, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.25% (0.1554 => 0.1519, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.59% (0.3083 => 0.3034, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.17% (0.2394 => 0.2318, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.3175 => 0.3175, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.04% (0.2302 => 0.2301, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel: -16.26% (0.0449 => 0.0376, std.dev.: 0.0035) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0009) SingleSource/UnitTests/2003-08-11-VaListArg: -53.33% (0.0090 => 0.0042, std.dev.: 0.0023) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.25% (0.0240 => 0.0237, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -7.81% (0.0192 => 0.0177, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.31% (0.0390 => 0.0381, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -24.25% (0.0301 => 0.0228, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -21.83% (0.0284 => 0.0222, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.23% (0.0324 => 0.0320, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -26.55% (0.0177 => 0.0130, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0189 => 0.0189, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0249 => 0.0250, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -9.54% (0.0325 => 0.0294, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005) MultiSource/Applications/ClamAV/clamscan: 1.68% (0.1429 => 0.1453, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: -7.63% (1.5019 => 1.3873, std.dev.: 0.0693) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -4.93% (0.1501 => 0.1427, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.60% (0.4264 => 0.4068, std.dev.: 0.0214) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.81% (0.1344 => 0.1449, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.98% (0.0589 => 0.0542, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -14.22% (0.0232 => 0.0199, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.01% (0.0639 => 0.0607, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.43% (1.1350 => 1.1301, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 166.67% (0.0006 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.83% (0.0637 => 0.0568, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -34.96% (0.0246 => 0.0160, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.45% (0.7541 => 0.7650, std.dev.: 0.0135) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 4.17% (1.5363 => 1.6003, std.dev.: 0.0030) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -28.57% (0.0070 => 0.0050, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 1 06:12:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 1 Oct 2012 08:12:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121001131252.B61C62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4444?compare_to=4441&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4444, Order: 164933, Start Time: 2012-10-01 11:54:13, End Time: 2012-10-01 13:14:30 To: 4441, Order: 164931, Start Time: 2012-10-01 10:04:46, End Time: 2012-10-01 11:25:03 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (145 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 92 (18 on baseline) Unchanged Tests: 950 (704 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.19% (0.5750 => 0.5761, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 0.16% (15.9626 => 15.9883, std.dev.: 0.0219) MultiSource/Applications/kimwitu++/kc: 0.32% (14.8645 => 14.9127, std.dev.: 0.0191) MultiSource/Benchmarks/Bullet/bullet: 0.55% (83.1598 => 83.6146, std.dev.: 0.0129) MultiSource/Benchmarks/MallocBench/gs/gs: 0.28% (4.3313 => 4.3434, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.22% (0.0460 => 0.0459, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0462 => 0.0462, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.23% (0.0429 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.23% (0.0431 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.24% (0.0419 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0420 => 0.0420, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.24% (0.0413 => 0.0412, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0414 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.23% (0.0431 => 0.0430, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.23% (0.0432 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0425 => 0.0425) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0426 => 0.0426) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0414 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.24% (0.0417 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.24% (0.0422 => 0.0421, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0423 => 0.0423) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.23% (0.0434 => 0.0433, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.23% (0.0435 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.24% (0.0410 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0411 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0422 => 0.0422, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.24% (0.0423 => 0.0422, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.24% (0.0414 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.24% (0.0415 => 0.0414) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.25% (0.0406 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0406 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0404 => 0.0404, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.25% (0.0406 => 0.0405, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.23% (0.0442 => 0.0441, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.45% (0.0443 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.25% (0.0403 => 0.0402, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.25% (0.0404 => 0.0403, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.25% (0.0404 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.25% (0.0405 => 0.0404, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0412 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0413 => 0.0413) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.20% (1.2287 => 1.2311, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.19% (7.5267 => 7.5408, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.28% (3.7087 => 3.7191, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.14% (0.6475 => 0.6484, std.dev.: 0.0030) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.14% (0.1431 => 0.1433, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0648 => 0.0647, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: 32.21% (63.2438 => 83.6146, std.dev.: 0.0129) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14233.75% (0.0720 => 10.3203, std.dev.: 0.0078) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 46.61% (10.3673 => 15.2000, std.dev.: 0.0132) SingleSource/Benchmarks/Misc/richards_benchmark: 29.59% (0.1622 => 0.2102, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.31% (7.0540 => 8.0634, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.10% (2.2022 => 2.5127, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/flops: 13.83% (0.1432 => 0.1630, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.09% (0.1566 => 0.1771, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.77% (1.1194 => 1.2624, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.94% (1.7609 => 1.9712, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 10.45% (0.3473 => 0.3836, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.30% (0.3543 => 0.3908, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.27% (0.3543 => 0.3907, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.27% (0.3497 => 0.3856, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.23% (0.1584 => 0.1746, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 10.19% (0.3561 => 0.3924, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.13% (0.3516 => 0.3872, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.96% (0.3694 => 0.4062, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 9.91% (0.3927 => 0.4316, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.80% (0.3828 => 0.4203, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/oourafft: 9.57% (0.3282 => 0.3596, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.55% (0.3886 => 0.4257, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 8.95% (10.4361 => 11.3699, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.26% (0.4879 => 0.5282, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 8.10% (0.1655 => 0.1789, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 7.99% (0.1440 => 0.1555, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.90% (0.3177 => 0.3428, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 7.81% (0.6030 => 0.6501, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 7.79% (9.4845 => 10.2232, std.dev.: 0.0132) SingleSource/UnitTests/ObjC++/Hello: 7.73% (0.5925 => 0.6383, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.72% (0.1438 => 0.1549, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.58% (0.6675 => 0.7181, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 7.43% (0.7115 => 0.7644, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 7.43% (0.7433 => 0.7985, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 7.36% (5.7591 => 6.1831, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.25% (0.5105 => 0.5475, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 7.24% (0.2554 => 0.2739, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 7.24% (0.3109 => 0.3334, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.20% (0.1625 => 0.1742, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.15% (0.2700 => 0.2893, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.04% (0.4615 => 0.4940, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 6.98% (0.7326 => 0.7837, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 6.96% (0.1695 => 0.1813, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.89% (0.5860 => 0.6264, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 6.84% (3.3354 => 3.5635, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.83% (0.2065 => 0.2206) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.83% (0.2271 => 0.2426, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 6.81% (0.3423 => 0.3656, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 6.80% (0.7835 => 0.8368, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.75% (0.8172 => 0.8724, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.75% (0.4103 => 0.4380, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.69% (1.3050 => 1.3923, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.68% (4.2646 => 4.5493, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.66% (1.5415 => 1.6441, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.61% (0.2891 => 0.3082, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.56% (0.3307 => 0.3524, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.53% (0.8067 => 0.8594, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.52% (0.5569 => 0.5932, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.52% (8.1363 => 8.6664, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: 6.46% (0.3422 => 0.3643) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.45% (5.0018 => 5.3242, std.dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.34% (0.3121 => 0.3319, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.34% (0.4636 => 0.4930, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.31% (0.2758 => 0.2932, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.26% (0.2107 => 0.2239, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.26% (4.9449 => 5.2545, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hash: 6.20% (0.4289 => 0.4555, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 6.20% (0.2905 => 0.3085, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.17% (0.2725 => 0.2893, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.12% (0.3136 => 0.3328, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.11% (0.3865 => 0.4101, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.08% (0.1940 => 0.2058, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 6.06% (0.6456 => 0.6847, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.05% (0.4064 => 0.4310) MultiSource/Benchmarks/Olden/bh/bh: 6.05% (0.3092 => 0.3279, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.00% (7.9617 => 8.4391, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.98% (0.9765 => 1.0349, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.97% (0.2831 => 0.3000, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.97% (0.2714 => 0.2876, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.95% (0.4203 => 0.4453, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.94% (0.5020 => 0.5318, std.dev.: 0.0027) MultiSource/Applications/Burg/burg: 5.94% (1.1642 => 1.2333, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.91% (0.2756 => 0.2919, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 5.91% (0.3603 => 0.3816, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.87% (0.3052 => 0.3231, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.86% (2.0665 => 2.1875, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 5.85% (0.2871 => 0.3039, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 5.85% (1.5603 => 1.6516, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.84% (0.3650 => 0.3863, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.78% (0.2872 => 0.3038, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.78% (0.3098 => 0.3277, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.76% (0.2793 => 0.2954, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 5.75% (0.3232 => 0.3418, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.73% (0.3283 => 0.3471, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.72% (0.3162 => 0.3343, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 5.71% (0.2802 => 0.2962, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.67% (0.3826 => 0.4043, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 5.67% (0.2877 => 0.3040, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 5.66% (21.9371 => 23.1796, std.dev.: 0.0185) SingleSource/Benchmarks/Shootout-C++/moments: 5.63% (0.4048 => 0.4276, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 5.63% (0.4299 => 0.4541, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 5.61% (3.8723 => 4.0897, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/hash2: 5.61% (0.4620 => 0.4879, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 5.54% (1.0722 => 1.1316, std.dev.: 0.0103) MultiSource/Benchmarks/McCat/09-vor/vor: 5.53% (0.3180 => 0.3356, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.53% (1.1861 => 1.2517, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 5.52% (0.3387 => 0.3574, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 5.48% (0.3684 => 0.3886, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.39% (0.3935 => 0.4147, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 5.38% (2.0273 => 2.1363, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.35% (0.3441 => 0.3625, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 5.30% (0.3379 => 0.3558, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.22% (0.2603 => 0.2739, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.04% (0.6450 => 0.6775, std.dev.: 0.0084) MultiSource/Applications/siod/siod: 4.91% (2.2969 => 2.4097, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/football/football: 4.89% (0.8921 => 0.9357, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.80% (0.5981 => 0.6268, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.61% (1.5859 => 1.6590, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.33% (1.4186 => 1.4800, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.14% (1.2842 => 1.3374, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.11% (2.2024 => 2.2930, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.05% (14.3668 => 14.9487, std.dev.: 0.0076) MultiSource/Benchmarks/nbench/nbench: 4.03% (1.1840 => 1.2317, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 3.90% (0.3131 => 0.3253, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.79% (0.8101 => 0.8327, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.67% (0.3817 => 0.3919, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.83% (3.8922 => 3.9633, std.dev.: 0.0150) MultiSource/Applications/sqlite3/sqlite3: 1.62% (17.1811 => 17.4589, std.dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.22% (1.1145 => 1.3844, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.21% (3.1595 => 3.4505, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.70% (3.1578 => 3.3695, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/richards_benchmark: 6.59% (1.1396 => 1.2147, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.46% (3.6395 => 3.7656, std.dev.: 0.0082) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.97% (4.2280 => 4.3534, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7984, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.13% (9.1159 => 9.2190, std.dev.: 0.0337) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1280, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.16% (0.8651 => 0.1716, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.19% (5.2763 => 3.2611, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.82% (5.3855 => 3.8872, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.38% (5.3526 => 3.8869, std.dev.: 0.0087) SingleSource/UnitTests/Vector/constpool: -14.78% (54.1659 => 46.1616, std.dev.: 0.0173) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.07% (2.9384 => 2.6131, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -7.81% (22.1758 => 20.4433, std.dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.90% (1.6925 => 1.4234, std.dev.: 0.0029) SingleSource/Benchmarks/McGill/chomp: -11.65% (1.2373 => 1.0932, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel-2: -10.36% (1.5373 => 1.3781, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.16% (19.9488 => 18.3201, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.70% (1.8329 => 1.7101, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8483, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: -5.09% (5.0483 => 4.7915, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.97% (1.6805 => 1.5969, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.61% (1.5835 => 1.5105, std.dev.: 0.0013) MultiSource/Applications/siod/siod: -3.73% (3.2827 => 3.1603, std.dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5039, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3306, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.08% (0.4808 => 0.4708, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.95% (8.1563 => 7.9969, std.dev.: 0.0098) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.82% (8.6802 => 8.5220, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/salsa20: -1.79% (10.2830 => 10.0990, std.dev.: 0.0160) MultiSource/Applications/hexxagon/hexxagon: -1.76% (12.4730 => 12.2530, std.dev.: 0.0022) SingleSource/UnitTests/Vector/multiplies: -1.75% (2.5528 => 2.5080, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: -1.69% (8.8334 => 8.6844, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -1.64% (1.1277 => 1.1092, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4200, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: -1.24% (6.2999 => 6.2216, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.17% (0.5229 => 0.5761, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 6.66% (14.9895 => 15.9883, std.dev.: 0.0219) MultiSource/Applications/kimwitu++/kc: 5.35% (14.1553 => 14.9127, std.dev.: 0.0191) MultiSource/Benchmarks/MallocBench/gs/gs: 5.67% (4.1105 => 4.3434, std.dev.: 0.0084) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.43% (1.1048 => 1.2311, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.34% (7.1582 => 7.5408, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.40% (3.4629 => 3.7191, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.21% (0.6222 => 0.6484, std.dev.: 0.0030) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.42% (0.2116 => 0.0647, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 1 06:27:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 1 Oct 2012 08:27:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121001132733.0452B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4445?compare_to=4442&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4445, Order: 164933, Start Time: 2012-10-01 12:03:37, End Time: 2012-10-01 13:29:11 To: 4442, Order: 164931, Start Time: 2012-10-01 10:09:25, End Time: 2012-10-01 11:34:48 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 1 (180 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1038 (690 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.93% (77.9911 => 80.2792, std.dev.: 0.6339) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.01% (2.7525 => 2.7528, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (2.1154 => 2.1154, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.01% (4.9750 => 4.9745, std.dev.: 0.0012) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.01% (2.0176 => 2.4414, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.60% (0.1410 => 0.1644, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 15.13% (0.0826 => 0.0951, std.dev.: 0.0015) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.43% (0.1072 => 0.1216, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 11.44% (0.4328 => 0.4823, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 11.31% (0.5818 => 0.6476, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.25% (0.1413 => 0.1572, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 11.18% (0.2781 => 0.3092, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 11.05% (0.5748 => 0.6383, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 10.86% (0.1013 => 0.1123, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.86% (0.2782 => 0.3084, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.83% (0.1588 => 0.1760, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 10.64% (1.3693 => 1.5150, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.58% (0.0964 => 0.1066, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference: 10.58% (0.7061 => 0.7808, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 10.56% (0.4062 => 0.4491, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.56% (3.9660 => 4.3848, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.49% (0.3899 => 0.4308, std.dev.: 0.0045) MultiSource/Applications/lambda-0_1_3/lambda: 10.49% (0.7038 => 0.7776, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.46% (0.3022 => 0.3338, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 10.43% (0.2607 => 0.2879, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.40% (0.2655 => 0.2931, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 10.33% (0.2690 => 0.2968, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/except: 10.33% (0.2760 => 0.3045, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.29% (0.2596 => 0.2863, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 10.27% (0.2628 => 0.2898, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 10.25% (0.2937 => 0.3238, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.24% (0.3485 => 0.3842, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 10.23% (0.2726 => 0.3005, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.16% (1.9828 => 2.1842, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.10% (0.1327 => 0.1461, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.09% (0.2765 => 0.3044, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.06% (0.3489 => 0.3840, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.05% (0.2966 => 0.3264, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.03% (0.3580 => 0.3939, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 10.02% (0.3293 => 0.3623, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 10.01% (0.3107 => 0.3418, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 10.00% (0.2761 => 0.3037, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.93% (0.3756 => 0.4129, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 9.91% (0.3149 => 0.3461, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.90% (0.2696 => 0.2963, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.90% (0.6283 => 0.6905, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.85% (0.2721 => 0.2989, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.81% (0.4016 => 0.4410, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.67% (0.6959 => 0.7632, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.67% (0.5265 => 0.5774, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.65% (1.2193 => 1.3370, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/matrix: 9.64% (0.2988 => 0.3276, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.62% (0.7710 => 0.8452, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary2: 9.62% (0.3192 => 0.3499, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.58% (0.9199 => 1.0080, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 9.57% (0.3868 => 0.4238, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.54% (0.4791 => 0.5248, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 9.51% (0.1062 => 0.1163, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 9.50% (0.3453 => 0.3781, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.34% (0.4390 => 0.4800, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.31% (1.1364 => 1.2422, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 9.31% (13.8202 => 15.1063, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/lists1: 9.20% (0.3534 => 0.3859, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.19% (1.4563 => 1.5901, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.11% (0.3130 => 0.3415, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 9.06% (0.1589 => 0.1733, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.00% (0.5577 => 0.6079, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.92% (0.1435 => 0.1563, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.86% (0.1276 => 0.1389, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.82% (0.1157 => 0.1259, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 8.79% (0.2945 => 0.3204, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 8.68% (0.2995 => 0.3255, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.66% (0.1986 => 0.2158, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 8.65% (1.0313 => 1.1205, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.38% (0.3246 => 0.3518, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.31% (0.3755 => 0.4067, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.23% (0.2127 => 0.2302, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.22% (0.4379 => 0.4739, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 8.10% (3.8646 => 4.1776, std.dev.: 0.0046) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.10% (0.2914 => 0.3150, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 8.10% (0.8310 => 0.8983, std.dev.: 0.0048) MultiSource/Applications/kimwitu++/kc: 8.08% (16.6129 => 17.9546, std.dev.: 0.0125) MultiSource/Applications/Burg/burg: 8.07% (1.1061 => 1.1954, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.04% (0.8698 => 0.9397, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.88% (0.5637 => 0.6081, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.83% (3.6692 => 3.9565, std.dev.: 0.0059) MultiSource/Applications/minisat/minisat: 7.78% (0.6744 => 0.7269, std.dev.: 0.0051) MultiSource/Applications/spiff/spiff: 7.78% (0.7506 => 0.8090, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 7.69% (0.2925 => 0.3150, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 7.68% (2.1791 => 2.3464, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 7.67% (0.2243 => 0.2415, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.65% (0.1569 => 0.1689, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 7.64% (0.3220 => 0.3466, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.63% (7.2180 => 7.7689, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.63% (0.7460 => 0.8029, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.57% (0.6576 => 0.7074, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.56% (0.2023 => 0.2176, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 7.56% (1.0594 => 1.1395, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 7.54% (3.1889 => 3.4295, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.51% (0.1865 => 0.2005, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 7.41% (1.9270 => 2.0697, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/parameter-passing: 7.29% (0.4003 => 0.4295, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 7.24% (0.3646 => 0.3910, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.24% (0.3578 => 0.3837, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.23% (0.3789 => 0.4063, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.20% (0.3914 => 0.4196, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 7.19% (0.3601 => 0.3860, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.13% (1.3245 => 1.4189, std.dev.: 0.0100) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.10% (0.1789 => 0.1916, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.10% (0.3663 => 0.3923, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.08% (0.3940 => 0.4219, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.07% (0.3650 => 0.3908, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 7.00% (0.1657 => 0.1773, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 6.98% (0.3623 => 0.3876, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 6.97% (0.1478 => 0.1581, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 6.96% (1.2749 => 1.3636, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/05-eks/eks: 6.95% (0.4113 => 0.4399, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 6.88% (1.2292 => 1.3138, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.86% (1.3819 => 1.4767, std.dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 6.84% (14.8535 => 15.8689, std.dev.: 0.0101) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.81% (1.3813 => 1.4753, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 6.72% (8.4961 => 9.0674, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.69% (0.8818 => 0.9408, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.61% (4.3801 => 4.6695, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.59% (4.4433 => 4.7363, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: 6.54% (0.2859 => 0.3046, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.52% (3.2742 => 3.4878, std.dev.: 0.0039) MultiSource/Applications/oggenc/oggenc: 6.43% (4.6629 => 4.9627, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.39% (0.6135 => 0.6527, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 6.35% (0.6250 => 0.6647, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.27% (1.1333 => 1.2044, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.21% (0.2140 => 0.2273, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 6.10% (0.3131 => 0.3322, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 6.07% (14.5298 => 15.4120, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.03% (13.2842 => 14.0855, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.97% (4.9865 => 5.2844, std.dev.: 0.0187) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.95% (0.2321 => 0.2459) MultiSource/Applications/JM/ldecod/ldecod: 5.91% (6.5754 => 6.9642, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.91% (0.2504 => 0.2652, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.81% (0.4805 => 0.5084, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.79% (0.3245 => 0.3433, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.61% (0.3511 => 0.3708, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.55% (0.1819 => 0.1920, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.40% (0.9108 => 0.9600, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.31% (1.5188 => 1.5994, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 5.01% (3.7467 => 3.9344, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.83% (2.1007 => 2.2021, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.60% (6.2785 => 6.5671, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 4.12% (33.2944 => 34.6668, std.dev.: 0.0121) MultiSource/Applications/sqlite3/sqlite3: 2.47% (16.2614 => 16.6629, std.dev.: 0.0172) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5164, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/fbench: 24.57% (1.8175 => 2.2640, std.dev.: 0.0512) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.57% (1.1560 => 1.2551, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4144, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.05% (1.2998 => 1.3784, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0039, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.2619 => 11.7248, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.41% (10.7476 => 11.1144, std.dev.: 0.0366) SingleSource/Benchmarks/Misc/flops-6: 3.35% (1.9199 => 1.9843, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.11% (7.4271 => 7.5836, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.54% (1.4298 => 1.4518, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5124, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 1.29% (5.5130 => 5.5839, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1870, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 1.08% (12.0921 => 12.2232, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (2.2986 => 2.3233, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5872, std.dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.05% (8.8259 => 8.9182, std.dev.: 0.0163) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.87% (0.4657 => 0.3918, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.30% (22.5627 => 22.0436, std.dev.: 0.0114) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544) SingleSource/Benchmarks/McGill/chomp: -11.24% (1.2308 => 1.0925, std.dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.04% (20.3410 => 18.2981, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.26% (1.3780 => 1.3055, std.dev.: 0.0029) SingleSource/UnitTests/Vector/multiplies: -5.08% (2.6470 => 2.5125, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7940, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.48% (3.2729 => 3.1589, std.dev.: 0.0063) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.44% (1.7688 => 1.7079, std.dev.: 0.0055) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.02% (0.4867 => 0.4720, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.76% (3.0263 => 2.9428, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4786, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.29% (1.9762 => 1.9310, std.dev.: 0.0006) SingleSource/Regression/C/uint64_to_float: -2.11% (0.5449 => 0.5334) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7056, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.78% (0.6615 => 0.6497) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.68% (0.6589 => 0.6478, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.67% (6.3560 => 6.2496, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.51% (7.3305 => 7.2200, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0069, std.dev.: 0.0006) MultiSource/Applications/lua/lua: -1.41% (26.5159 => 26.1422, std.dev.: 0.0336) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8633, std.dev.: 0.0046) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2502, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: -1.14% (9.3358 => 9.2295, std.dev.: 0.0170) MultiSource/Applications/viterbi/viterbi: -1.01% (4.4810 => 4.4358, std.dev.: 0.0023) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 1 07:20:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 1 Oct 2012 09:20:13 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121001142013.0E54D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4446?compare_to=4443&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4446, Order: 164940, Start Time: 2012-10-01 12:58:57, End Time: 2012-10-01 14:21:52 To: 4443, Order: 164932, Start Time: 2012-10-01 11:18:32, End Time: 2012-10-01 12:42:35 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 6 (80 on baseline) Performance Improvements: 5 (46 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 962 (765 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.89% (0.2881 => 0.2993, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.56% (1.4065 => 1.4285, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 1.20% (0.9425 => 0.9538, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 1.70% (1.2393 => 1.2604, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.62% (4.3862 => 4.4572, std.dev.: 0.0067) MultiSource/Applications/SPASS/SPASS: 1.54% (8.3322 => 8.4608, std.dev.: 0.0319) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.22% (0.8920 => 0.8722, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.15% (0.8492 => 0.8309, std.dev.: 0.0057) MultiSource/Benchmarks/PAQ8p/paq8p: -1.15% (2.3909 => 2.3633, std.dev.: 0.0070) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.81% (2.4872 => 2.4423, std.dev.: 0.0048) MultiSource/Applications/minisat/minisat: -1.79% (6.3226 => 6.2092, std.dev.: 0.0424) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.85% (1.0047 => 0.9962, std.dev.: 0.0101) MultiSource/Applications/sqlite3/sqlite3: 0.16% (0.6112 => 0.6122, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/08-main/main: -0.12% (0.1673 => 0.1671, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.90% (0.1519 => 0.1563, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.33% (0.3034 => 0.3135, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.62% (0.2318 => 0.2425, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.32% (0.3175 => 0.3217, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.43% (0.2301 => 0.2334, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: 3.19% (0.0376 => 0.0388, std.dev.: 0.0037) SingleSource/UnitTests/2003-05-07-VarArgs: -46.59% (0.0088 => 0.0047, std.dev.: 0.0021) SingleSource/UnitTests/2003-08-11-VaListArg: 116.67% (0.0042 => 0.0091, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.27% (0.0237 => 0.0240, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 8.47% (0.0177 => 0.0192, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.36% (0.0381 => 0.0390, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.82% (0.0228 => 0.0296, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 26.58% (0.0222 => 0.0281, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.81% (0.0320 => 0.0311, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: 36.92% (0.0130 => 0.0178, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -17.99% (0.0189 => 0.0155, std.dev.: 0.0019) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0250 => 0.0251, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -12.59% (0.0294 => 0.0257, std.dev.: 0.0034) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.55% (0.1453 => 0.1445, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 11.57% (1.3873 => 1.5478, std.dev.: 0.0204) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 8.34% (0.1427 => 0.1546, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.99% (0.4068 => 0.4149, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.76% (0.1449 => 0.1351, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.92% (0.0542 => 0.0547, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 28.64% (0.0199 => 0.0256, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.32% (0.0607 => 0.0615, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.04% (1.1301 => 1.1305, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -31.25% (0.0016 => 0.0011, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 140.00% (0.0005 => 0.0012, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.51% (0.0568 => 0.0605, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.88% (0.0160 => 0.0133, std.dev.: 0.0057) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.01% (0.7650 => 0.7649, std.dev.: 0.0138) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/uint64_to_float: 1.02% (1.6003 => 1.6167, std.dev.: 0.0054) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 96.00% (0.0050 => 0.0098, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.95% (4.1772 => 3.0932, std.dev.: 0.0239) SingleSource/Benchmarks/Shootout-C++/except: 83083.33% (0.0006 => 0.4991, std.dev.: 0.0034) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: -80.00% (0.0005 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C++/EH/function_try_block: -50.00% (0.0006 => 0.0003, std.dev.: 0.0001) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.49% (0.0745 => 0.0920, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.97% (0.1159 => 0.1263, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 8.59% (2.1763 => 2.3633, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/bigfib: 8.19% (0.5309 => 0.5744, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.16% (0.6410 => 0.6933, std.dev.: 0.0025) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.99% (0.1414 => 0.1527, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.86% (0.2552 => 0.2727, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 6.84% (0.6173 => 0.6595, std.dev.: 0.0079) MultiSource/Applications/lemon/lemon: 6.62% (1.0046 => 1.0711, std.dev.: 0.0169) MultiSource/Applications/SIBsim4/SIBsim4: 6.35% (1.1653 => 1.2393, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.17% (0.3582 => 0.3803, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 5.89% (0.6915 => 0.7322, std.dev.: 0.0038) MultiSource/Applications/kimwitu++/kc: 5.43% (15.3105 => 16.1426, std.dev.: 0.0351) MultiSource/Benchmarks/Bullet/bullet: 5.43% (29.3170 => 30.9082, std.dev.: 0.0761) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.32% (0.6069 => 0.6392, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.13% (0.2106 => 0.2214, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.82% (0.7639 => 0.8007, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.75% (0.4880 => 0.5112, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.57% (1.5150 => 1.5842, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.31% (0.3062 => 0.3194, std.dev.: 0.0019) MultiSource/Applications/d/make_dparser: 4.28% (3.0225 => 3.1518, std.dev.: 0.0336) MultiSource/Applications/oggenc/oggenc: 4.20% (4.7455 => 4.9447, std.dev.: 0.0283) MultiSource/Benchmarks/McCat/18-imp/imp: 4.01% (0.3217 => 0.3346, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.90% (0.2797 => 0.2906, std.dev.: 0.0029) MultiSource/Applications/hbd/hbd: 3.75% (1.3268 => 1.3766, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.71% (0.2886 => 0.2993, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.60% (13.3238 => 13.8032, std.dev.: 0.1222) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.56% (0.2952 => 0.3057, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.49% (0.3901 => 0.4037, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 3.48% (2.0972 => 2.1701, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.44% (12.6413 => 13.0756, std.dev.: 0.1001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.39% (1.2021 => 1.2429, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 3.28% (8.2186 => 8.4885, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.18% (1.4408 => 1.4866, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.13% (0.3418 => 0.3525, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.09% (3.0758 => 3.1708, std.dev.: 0.0079) MultiSource/Applications/ClamAV/clamscan: 2.89% (14.6079 => 15.0303, std.dev.: 0.0644) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.73% (2.0317 => 2.0872, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 2.65% (6.4908 => 6.6629, std.dev.: 0.0543) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.61% (0.8569 => 0.8793, std.dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 2.52% (14.7256 => 15.0965, std.dev.: 0.0791) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.51% (1.3935 => 1.4285, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.41% (6.2546 => 6.4051, std.dev.: 0.0303) MultiSource/Benchmarks/nbench/nbench: 2.26% (1.0821 => 1.1066, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.15% (1.4113 => 1.4417, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.08% (1.4189 => 1.4484, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/football/football: 2.06% (0.8405 => 0.8578, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 2.03% (3.5980 => 3.6711, std.dev.: 0.0272) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.84% (4.0318 => 4.1060, std.dev.: 0.0158) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.64% (4.2616 => 4.3314, std.dev.: 0.0093) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.33% (4.3380 => 4.3955, std.dev.: 0.0214) MultiSource/Applications/hexxagon/hexxagon: 1.20% (0.9425 => 0.9538, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 47.51% (0.0261 => 0.0385, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/pi: 41.39% (1.6538 => 2.3383, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2286, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout/ary3: 15.29% (1.7426 => 2.0090, std.dev.: 0.0378) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.40% (4.0101 => 4.5474, std.dev.: 0.0510) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.87% (0.0917 => 0.1035, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/queens: 11.09% (1.6261 => 1.8065, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.89% (0.2857 => 0.3111, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: 8.68% (7.0025 => 7.6100, std.dev.: 0.0429) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.20% (1.0063 => 1.0888, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.24% (0.3301 => 0.3507, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.80% (4.2129 => 4.4572, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/dt: 4.38% (0.9851 => 1.0282, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: 4.03% (15.2242 => 15.8372, std.dev.: 0.0519) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5413, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.84% (2.6656 => 2.7412, std.dev.: 0.0134) MultiSource/Applications/hexxagon/hexxagon: 2.81% (14.4877 => 14.8953, std.dev.: 0.0194) SingleSource/Benchmarks/Shootout-C++/hash: 2.76% (0.6308 => 0.6482, std.dev.: 0.0021) MultiSource/Benchmarks/sim/sim: 2.75% (3.8907 => 3.9975, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.73% (4.6127 => 4.7387, std.dev.: 0.0216) MultiSource/Benchmarks/FreeBench/mason/mason: 2.38% (0.5004 => 0.5123, std.dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: 2.24% (2.4013 => 2.4550, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.14% (6.6312 => 6.7730, std.dev.: 0.0036) MultiSource/Applications/siod/siod: 2.02% (3.5520 => 3.6238, std.dev.: 0.0242) SingleSource/Benchmarks/Misc/whetstone: 1.87% (2.3453 => 2.3891, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 1.84% (0.5876 => 0.5984, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/power/power: 1.45% (1.4184 => 1.4389, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.06% (4.6414 => 4.6904, std.dev.: 0.0071) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.69% (0.3497 => 0.2109, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.11% (5.2665 => 4.1550, std.dev.: 0.0575) SingleSource/Benchmarks/Shootout-C++/ary3: -17.72% (1.7473 => 1.4376, std.dev.: 0.0576) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.56% (1.1647 => 0.9602, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.36% (15.8312 => 13.3996, std.dev.: 0.0281) SingleSource/Benchmarks/Shootout/sieve: -12.20% (8.1594 => 7.1639, std.dev.: 0.0281) MultiSource/Benchmarks/McCat/17-bintr/bintr: -10.91% (0.0917 => 0.0817, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/moments: -9.34% (0.1114 => 0.1010, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.88% (1.4034 => 1.2788, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.24% (3.2007 => 2.9691, std.dev.: 0.0244) MultiSource/Applications/lambda-0_1_3/lambda: -7.22% (7.6833 => 7.1282, std.dev.: 0.0610) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.96% (3.6254 => 3.3729, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/fibo: -6.50% (4.6355 => 4.3341, std.dev.: 0.0095) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.50% (2.0027 => 1.8725, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/richards_benchmark: -6.38% (1.4441 => 1.3519, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: -6.13% (3.4230 => 3.2131, std.dev.: 0.0163) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.00% (2.9728 => 2.7945, std.dev.: 0.0150) MultiSource/Benchmarks/mafft/pairlocalalign: -5.56% (62.4126 => 58.9442, std.dev.: 0.0865) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.48% (3.9413 => 3.7254, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.20% (3.6023 => 3.4150, std.dev.: 0.0430) SingleSource/Benchmarks/Shootout/fib2: -5.04% (4.4195 => 4.1966, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.80% (0.4564 => 0.4345, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -4.32% (0.3746 => 0.3584, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/distray/distray: -4.28% (0.2664 => 0.2550, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: -4.26% (2.5166 => 2.4093, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.23% (0.4140 => 0.3965, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/methcall: -3.01% (9.2503 => 8.9723, std.dev.: 0.0244) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.74% (1.2959 => 1.2604, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/flops: -2.70% (9.5474 => 9.2894, std.dev.: 0.0018) MultiSource/Applications/lua/lua: -2.64% (29.5232 => 28.7427, std.dev.: 0.0807) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.37% (3.7496 => 3.6607, std.dev.: 0.0096) MultiSource/Applications/JM/lencod/lencod: -2.28% (6.7458 => 6.5918, std.dev.: 0.0122) MultiSource/Benchmarks/PAQ8p/paq8p: -2.21% (92.7467 => 90.6992, std.dev.: 0.3945) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.14% (1.1683 => 1.1433, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: -2.02% (3.4876 => 3.4171, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.95% (2.3569 => 2.3110, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -1.67% (1.0926 => 1.0743, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.67% (0.6119 => 0.6017, std.dev.: 0.0011) MultiSource/Applications/aha/aha: -1.66% (3.4286 => 3.3716, std.dev.: 0.0181) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.57% (1.8739 => 1.8445, std.dev.: 0.0105) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.55% (9.3855 => 9.2403, std.dev.: 0.0326) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.28% (27.1724 => 26.8257, std.dev.: 0.0126) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.27% (25.6658 => 25.3411, std.dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/lists: -1.16% (16.5617 => 16.3702, std.dev.: 0.0672) SingleSource/Benchmarks/Misc/oourafft: -1.02% (3.8200 => 3.7811, std.dev.: 0.0123) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.18% (0.9980 => 0.9962, std.dev.: 0.0101) MultiSource/Applications/sqlite3/sqlite3: 1.66% (0.6022 => 0.6122, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/08-main/main: 0.30% (0.1666 => 0.1671, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.58% (0.1554 => 0.1563, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.69% (0.3083 => 0.3135, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (0.2394 => 0.2425, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.32% (0.3175 => 0.3217, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.39% (0.2302 => 0.2334, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: -13.59% (0.0449 => 0.0388, std.dev.: 0.0037) SingleSource/UnitTests/2003-05-07-VarArgs: -47.19% (0.0089 => 0.0047, std.dev.: 0.0021) SingleSource/UnitTests/2003-08-11-VaListArg: 1.11% (0.0090 => 0.0091, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0240 => 0.0240, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0192 => 0.0192, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0390 => 0.0390, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.66% (0.0301 => 0.0296, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.06% (0.0284 => 0.0281, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -4.01% (0.0324 => 0.0311, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0177 => 0.0178, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -17.99% (0.0189 => 0.0155, std.dev.: 0.0019) SingleSource/UnitTests/Vector/multiplies: 0.80% (0.0249 => 0.0251, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -20.92% (0.0325 => 0.0257, std.dev.: 0.0034) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.12% (0.1429 => 0.1445, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 3.06% (1.5019 => 1.5478, std.dev.: 0.0204) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 3.00% (0.1501 => 0.1546, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.70% (0.4264 => 0.4149, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.52% (0.1344 => 0.1351, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.13% (0.0589 => 0.0547, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 10.34% (0.0232 => 0.0256, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.76% (0.0639 => 0.0615, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.40% (1.1350 => 1.1305, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 83.33% (0.0006 => 0.0011, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -50.00% (0.0024 => 0.0012, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.02% (0.0637 => 0.0605, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -45.93% (0.0246 => 0.0133, std.dev.: 0.0057) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.43% (0.7541 => 0.7649, std.dev.: 0.0138) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 5.23% (1.5363 => 1.6167, std.dev.: 0.0054) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 40.00% (0.0070 => 0.0098, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 1 08:01:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 1 Oct 2012 10:01:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121001150121.B846E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4447?compare_to=4440&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4447, Order: 164933, Start Time: 2012-10-01 11:53:15, End Time: 2012-10-01 15:03:00 To: 4440, Order: 164927, Start Time: 2012-10-01 08:14:24, End Time: 2012-10-01 11:24:16 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 0 (128 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (131 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1038 (765 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.10% (2.9216 => 2.8896, std.dev.: 0.0063) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.05% (9.8098 => 9.8147, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.04% (9.4137 => 9.4101, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.04% (16.9636 => 16.9575, std.dev.: 0.0034) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 11.23% (0.3446 => 0.3833, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.21% (0.3488 => 0.3879, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.13% (0.3442 => 0.3825, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.02% (0.3465 => 0.3847, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.98% (0.3496 => 0.3880, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.93% (0.3469 => 0.3848, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 10.92% (0.3460 => 0.3838, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.68% (0.3643 => 0.4032, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.66% (0.3650 => 0.4039, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 10.45% (0.3724 => 0.4113, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 9.92% (1.5932 => 1.7512, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.79% (0.5826 => 0.6280, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference-object: 7.69% (0.5889 => 0.6342, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.48% (0.2875 => 0.3090, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.39% (0.3004 => 0.3226, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 7.32% (0.2813 => 0.3019, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 7.30% (0.2823 => 0.3029, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 7.27% (0.2780 => 0.2982, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.26% (0.3195 => 0.3427, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.23% (0.2725 => 0.2922, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 7.18% (0.2714 => 0.2909, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.16% (0.3060 => 0.3279, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.15% (0.2911 => 0.3119, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.13% (0.2792 => 0.2991, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.10% (0.1619 => 0.1734, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.09% (0.2738 => 0.2932, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 7.03% (0.2803 => 0.3000, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2750 => 0.2943, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.00% (2.0673 => 2.2120, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.00% (0.2729 => 0.2920, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 6.97% (0.2811 => 0.3007, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 6.92% (0.9909 => 1.0595, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wc: 6.91% (0.3096 => 0.3310, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.81% (0.3317 => 0.3543, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.80% (0.3267 => 0.3489, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.75% (0.3362 => 0.3589, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 6.72% (0.3258 => 0.3477, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.71% (0.4994 => 0.5329, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.65% (0.4361 => 0.4651, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: 6.60% (0.3348 => 0.3569, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.58% (0.5000 => 0.5329, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 6.58% (0.3726 => 0.3971, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.57% (1.6211 => 1.7276, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference: 6.57% (0.7171 => 0.7642, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.53% (0.3124 => 0.3328, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.52% (1.3152 => 1.4010, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/moments: 6.50% (0.3678 => 0.3917, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.49% (0.3282 => 0.3495, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.46% (0.3625 => 0.3859, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 6.44% (0.3477 => 0.3701, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.36% (3.5627 => 3.7894, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.36% (0.1620 => 0.1723, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 6.25% (5.5417 => 5.8880, std.dev.: 0.0109) MultiSource/Applications/d/make_dparser: 6.18% (1.0781 => 1.1447, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.10% (0.3690 => 0.3915, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/hash: 6.05% (0.4146 => 0.4397, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 6.05% (0.4251 => 0.4508, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.01% (0.2014 => 0.2135, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.88% (2.7292 => 2.8896, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.80% (0.3981 => 0.4212, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.79% (0.5026 => 0.5317, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.75% (0.3930 => 0.4156, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.70% (0.3845 => 0.4064, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 5.59% (0.5012 => 0.5292, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.56% (0.2736 => 0.2888, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 5.53% (23.5202 => 24.8207, std.dev.: 0.0135) MultiSource/Benchmarks/nbench/nbench: 5.49% (0.2566 => 0.2707, std.dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: 5.47% (4.2109 => 4.4413, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.45% (0.6435 => 0.6786, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.38% (4.4195 => 4.6572, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 5.35% (1.8794 => 1.9799, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.27% (0.2068 => 0.2177, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.24% (0.4139 => 0.4356, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 5.23% (0.6634 => 0.6981, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.22% (0.3084 => 0.3245, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.20% (0.2866 => 0.3015, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.19% (0.2737 => 0.2879, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.14% (0.3890 => 0.4090, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.13% (0.1968 => 0.2069, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 5.09% (2.1013 => 2.2083, std.dev.: 0.0080) MultiSource/Applications/spiff/spiff: 5.06% (0.4029 => 0.4233, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.05% (0.3903 => 0.4100, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 4.87% (4.6177 => 4.8428, std.dev.: 0.0056) MultiSource/Applications/Burg/burg: 4.87% (0.5546 => 0.5816, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.85% (0.5900 => 0.6186, std.dev.: 0.0035) MultiSource/Applications/hbd/hbd: 4.83% (0.9697 => 1.0165, std.dev.: 0.0026) MultiSource/Applications/lua/lua: 4.77% (1.4269 => 1.4949, std.dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 4.74% (2.1653 => 2.2680, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 4.74% (0.3336 => 0.3494, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.72% (0.4658 => 0.4878, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.46% (0.3271 => 0.3417, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.43% (1.9694 => 2.0566, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.41% (0.2969 => 0.3100, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.22% (1.9966 => 2.0808, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 4.21% (2.0346 => 2.1202, std.dev.: 0.0018) MultiSource/Applications/treecc/treecc: 4.17% (0.7875 => 0.8203, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 3.94% (0.4847 => 0.5038, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.92% (0.7426 => 0.7717, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.56% (0.5361 => 0.5552, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.47% (0.5584 => 0.5778, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.44% (11.6398 => 12.0398, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.20% (4.6926 => 4.8428, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.99% (0.4253 => 0.4380, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 2.92% (0.3498 => 0.3600, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 1.75% (11.9555 => 12.1650, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6101, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 5.33% (0.2122 => 0.2235, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6743, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-2: 4.69% (1.8057 => 1.8904, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1649, std.dev.: 0.0573) SingleSource/Benchmarks/Dhrystone/dry: 4.17% (14.0481 => 14.6340, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/ary3: 2.09% (15.8721 => 16.2036, std.dev.: 0.0050) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.94% (41.7953 => 42.6063, std.dev.: 0.0243) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5069, std.dev.: 0.0225) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.63% (3.1722 => 3.2240, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2867, std.dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.41% (2.0820 => 2.1114, std.dev.: 0.0043) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5137, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5959, std.dev.: 0.0200) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.89% (25.4195 => 16.5506, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/ary2: -8.08% (0.2402 => 0.2208, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9742, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7889, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9575, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.57% (11.2080 => 10.8080, std.dev.: 0.0010) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.84% (0.6293 => 0.6114, std.dev.: 0.0052) SingleSource/Benchmarks/Dhrystone/fldry: -2.44% (17.2379 => 16.8167, std.dev.: 0.0430) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5777, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4984, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0436, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 1 08:59:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 1 Oct 2012 10:59:57 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121001155957.644FE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4448?compare_to=4446&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4448, Order: 164943, Start Time: 2012-10-01 14:37:57, End Time: 2012-10-01 16:01:37 To: 4446, Order: 164940, Start Time: 2012-10-01 12:58:57, End Time: 2012-10-01 14:21:52 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 13 (89 on baseline) Performance Improvements: 1 (42 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 959 (760 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.28% (0.5758 => 0.5947, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.21% (0.9024 => 0.9223, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.02% (0.5505 => 0.5616, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.00% (1.2010 => 1.2250, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.81% (0.6392 => 0.6508, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.44% (4.3240 => 4.3863, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.27% (1.0790 => 1.0927, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.67% (1.3696 => 1.4062, std.dev.: 0.0106) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.97% (4.1550 => 4.2370, std.dev.: 0.0122) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.51% (4.0906 => 4.1522, std.dev.: 0.0155) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.44% (4.4814 => 4.5461, std.dev.: 0.0128) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.28% (2.7412 => 2.7763, std.dev.: 0.0121) SingleSource/Benchmarks/Misc/ReedSolomon: 1.08% (8.4531 => 8.5444, std.dev.: 0.0198) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.11% (4.7387 => 4.6860, std.dev.: 0.0131) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.55% (0.9962 => 1.0017, std.dev.: 0.0109) MultiSource/Applications/sqlite3/sqlite3: 0.49% (0.6122 => 0.6152, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: -3.41% (0.1671 => 0.1614, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.66% (0.1563 => 0.1537, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.06% (0.3135 => 0.3137, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.21% (0.2425 => 0.2430, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.40% (0.3217 => 0.3230, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.90% (0.2334 => 0.2313, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel: 17.27% (0.0388 => 0.0455, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: 89.36% (0.0047 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: -16.48% (0.0091 => 0.0076, std.dev.: 0.0008) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -10.83% (0.0240 => 0.0214, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.04% (0.0192 => 0.0194, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.26% (0.0390 => 0.0389, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -25.00% (0.0296 => 0.0222, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.71% (0.0281 => 0.0279, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -18.97% (0.0311 => 0.0252, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/casts: -3.37% (0.0178 => 0.0172, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 24.52% (0.0155 => 0.0193) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0251 => 0.0252, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -1.95% (0.0257 => 0.0252, std.dev.: 0.0038) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 120.00% (0.0005 => 0.0011) MultiSource/Applications/ClamAV/clamscan: 0.21% (0.1445 => 0.1448, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: -0.74% (1.5478 => 1.5363, std.dev.: 0.0111) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.49% (0.1546 => 0.1492, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.77% (0.4149 => 0.4034, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.44% (0.1351 => 0.1465, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 12.43% (0.0547 => 0.0615, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -19.92% (0.0256 => 0.0205, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.58% (0.0615 => 0.0593, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.23% (1.1305 => 1.1279, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 145.45% (0.0011 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 33.33% (0.0012 => 0.0016, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.14% (0.0605 => 0.0586, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 97.74% (0.0133 => 0.0263, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.44% (0.7649 => 0.7683, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -1.11% (1.6167 => 1.5987, std.dev.: 0.0060) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 23.47% (0.0098 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.97% (4.1772 => 3.0925, std.dev.: 0.0323) SingleSource/Benchmarks/Shootout-C++/except: 82366.67% (0.0006 => 0.4948, std.dev.: 0.0047) SingleSource/Regression/C++/EH/ctor_dtor_count: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.62% (0.0745 => 0.0921, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.84% (0.1414 => 0.1539, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 8.80% (0.5309 => 0.5776, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.19% (0.6410 => 0.6935, std.dev.: 0.0067) MultiSource/Benchmarks/PAQ8p/paq8p: 7.96% (2.1763 => 2.3495, std.dev.: 0.0570) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.23% (0.6069 => 0.6508, std.dev.: 0.0017) MultiSource/Applications/minisat/minisat: 6.67% (0.6173 => 0.6585, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.23% (0.2552 => 0.2711, std.dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: 6.16% (1.1653 => 1.2371, std.dev.: 0.0049) MultiSource/Applications/lemon/lemon: 6.00% (1.0046 => 1.0649, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.00% (0.3582 => 0.3797, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/18-imp/imp: 5.66% (0.3217 => 0.3399, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 5.54% (0.6915 => 0.7298, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.49% (0.4880 => 0.5148, std.dev.: 0.0024) MultiSource/Applications/kimwitu++/kc: 5.28% (15.3105 => 16.1185, std.dev.: 0.0817) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.20% (1.5150 => 1.5938, std.dev.: 0.0204) MultiSource/Benchmarks/Bullet/bullet: 5.08% (29.3170 => 30.8073, std.dev.: 0.2121) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.01% (0.7639 => 0.8022, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.95% (1.1672 => 1.2250, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.85% (0.4248 => 0.4454, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.54% (0.2797 => 0.2924, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.51% (0.2662 => 0.2782, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 4.35% (3.0225 => 3.1540, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.25% (1.4408 => 1.5021, std.dev.: 0.0081) MultiSource/Applications/hbd/hbd: 4.19% (1.3268 => 1.3824, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.18% (0.3062 => 0.3190, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.18% (2.0317 => 2.1166, std.dev.: 0.0257) MultiSource/Applications/Burg/burg: 4.13% (1.1440 => 1.1912, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.90% (12.6413 => 13.1348, std.dev.: 0.1180) MultiSource/Applications/oggenc/oggenc: 3.79% (4.7455 => 4.9255, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: 3.77% (0.3847 => 0.3992, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.77% (0.3901 => 0.4048, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.73% (3.0758 => 3.1904, std.dev.: 0.0378) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.61% (0.5740 => 0.5947, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.55% (0.7722 => 0.7996, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.38% (0.7226 => 0.7470, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.32% (1.2021 => 1.2420, std.dev.: 0.0115) MultiSource/Applications/SPASS/SPASS: 3.28% (13.3238 => 13.7607, std.dev.: 0.0311) SingleSource/Benchmarks/Shootout-C++/hash: 3.27% (0.3520 => 0.3635, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.27% (6.2546 => 6.4589, std.dev.: 0.0237) MultiSource/Applications/siod/siod: 3.25% (2.0972 => 2.1654, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.25% (0.3418 => 0.3529, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.20% (1.1827 => 1.2206, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/football/football: 2.97% (0.8405 => 0.8655, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 2.87% (14.6079 => 15.0278, std.dev.: 0.0442) MultiSource/Applications/JM/ldecod/ldecod: 2.82% (6.4908 => 6.6741, std.dev.: 0.0175) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.81% (4.0318 => 4.1450, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.74% (1.4113 => 1.4499, std.dev.: 0.0042) MultiSource/Benchmarks/nbench/nbench: 2.73% (1.0821 => 1.1116, std.dev.: 0.0042) MultiSource/Benchmarks/mafft/pairlocalalign: 2.70% (8.2186 => 8.4407, std.dev.: 0.0521) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.45% (4.2815 => 4.3863, std.dev.: 0.0073) MultiSource/Applications/treecc/treecc: 2.39% (1.8798 => 1.9248, std.dev.: 0.0127) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.39% (0.8569 => 0.8774, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.39% (1.3935 => 1.4268, std.dev.: 0.0088) MultiSource/Applications/JM/lencod/lencod: 2.37% (14.7256 => 15.0746, std.dev.: 0.0770) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.28% (1.4189 => 1.4513, std.dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 2.28% (0.9425 => 0.9640, std.dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.23% (1.0689 => 1.0927, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.15% (0.9029 => 0.9223, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.95% (4.3380 => 4.4228, std.dev.: 0.0155) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.91% (0.5963 => 0.6077, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.84% (0.5937 => 0.6046, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.40% (1.6538 => 2.3384, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2278, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.58% (0.0766 => 0.0916, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/ary3: 14.90% (1.7426 => 2.0023, std.dev.: 0.0479) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.20% (4.0101 => 4.5394, std.dev.: 0.0346) SingleSource/Benchmarks/Stanford/Puzzle: 11.65% (0.1433 => 0.1600, std.dev.: 0.0053) SingleSource/Benchmarks/McGill/queens: 11.06% (1.6261 => 1.8059, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: 8.92% (7.0025 => 7.6271, std.dev.: 0.0401) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.61% (0.2857 => 0.3103, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.00% (0.3301 => 0.3499, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.02% (4.2129 => 4.4242, std.dev.: 0.0156) SingleSource/Benchmarks/Misc/fp-convert: 4.66% (15.2242 => 15.9336, std.dev.: 0.0193) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 4.15% (2.6656 => 2.7763, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/hash: 3.93% (0.6308 => 0.6556, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/dt: 3.83% (0.9851 => 1.0228, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.80% (3.4080 => 3.5374, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.54% (0.5587 => 0.5785, std.dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 2.78% (14.4877 => 14.8900, std.dev.: 0.0485) MultiSource/Benchmarks/sim/sim: 2.69% (3.8907 => 3.9952, std.dev.: 0.0077) MultiSource/Benchmarks/FreeBench/mason/mason: 2.42% (0.5004 => 0.5125, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 2.25% (3.5520 => 3.6320, std.dev.: 0.0214) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.18% (6.6312 => 6.7755, std.dev.: 0.0142) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.12% (4.0659 => 4.1522, std.dev.: 0.0155) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.59% (4.6127 => 4.6860, std.dev.: 0.0131) MultiSource/Benchmarks/Olden/power/power: 1.45% (1.4184 => 1.4390, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: 1.25% (2.3453 => 2.3746, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.05% (1.6110 => 1.6279, std.dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.58% (0.3497 => 0.2043, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/lpbench: -19.55% (5.2665 => 4.2370, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/ary3: -19.38% (1.7473 => 1.4086, std.dev.: 0.0221) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.60% (1.1647 => 0.9597, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.28% (15.8312 => 13.4116, std.dev.: 0.0809) SingleSource/Benchmarks/Shootout/sieve: -12.32% (8.1594 => 7.1540, std.dev.: 0.0362) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.39% (1.4034 => 1.2857, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.30% (3.2007 => 2.9350, std.dev.: 0.0142) MultiSource/Applications/lambda-0_1_3/lambda: -7.25% (7.6833 => 7.1259, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.96% (3.6254 => 3.3732, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/fibo: -6.60% (4.6355 => 4.3295, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.49% (2.0027 => 1.8727, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -6.31% (1.4441 => 1.3530, std.dev.: 0.0070) MultiSource/Applications/SIBsim4/SIBsim4: -6.18% (3.4230 => 3.2115, std.dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.06% (2.9728 => 2.7927, std.dev.: 0.0166) MultiSource/Benchmarks/mafft/pairlocalalign: -5.59% (62.4126 => 58.9249, std.dev.: 0.0322) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.46% (3.9413 => 3.7262, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout/fib2: -5.21% (4.4195 => 4.1893, std.dev.: 0.0136) MultiSource/Benchmarks/Olden/bh/bh: -4.51% (2.5166 => 2.4030, std.dev.: 0.0071) MultiSource/Benchmarks/PAQ8p/paq8p: -4.50% (92.7467 => 88.5687, std.dev.: 1.3160) MultiSource/Applications/sgefa/sgefa: -4.14% (0.3746 => 0.3591, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.12% (0.4564 => 0.4376, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/misr: -3.58% (0.4296 => 0.4142, std.dev.: 0.0033) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.26% (1.2959 => 1.2536, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/methcall: -2.88% (9.2503 => 8.9836, std.dev.: 0.0138) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.83% (0.4140 => 0.4023, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2853, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -2.55% (1.8739 => 1.8261, std.dev.: 0.0070) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.38% (2.8964 => 2.8275, std.dev.: 0.0246) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.36% (1.1683 => 1.1407, std.dev.: 0.0022) MultiSource/Applications/lua/lua: -2.31% (29.5232 => 28.8422, std.dev.: 0.0592) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.25% (3.7496 => 3.6654, std.dev.: 0.0154) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.18% (2.4457 => 2.3925, std.dev.: 0.0139) MultiSource/Applications/JM/lencod/lencod: -2.09% (6.7458 => 6.6047, std.dev.: 0.0143) MultiSource/Applications/aha/aha: -1.97% (3.4286 => 3.3612, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/hash2: -1.75% (3.4876 => 3.4265, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/neural/neural: -1.69% (1.0926 => 1.0741, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.67% (1.0686 => 1.0508, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.54% (9.3855 => 9.2411, std.dev.: 0.0244) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.40% (27.1724 => 26.7918, std.dev.: 0.0128) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3126, std.dev.: 0.0811) SingleSource/Benchmarks/Shootout-C++/lists: -1.30% (16.5617 => 16.3463, std.dev.: 0.0075) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.37% (0.9980 => 1.0017, std.dev.: 0.0109) MultiSource/Applications/sqlite3/sqlite3: 2.16% (0.6022 => 0.6152, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: -3.12% (0.1666 => 0.1614, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.09% (0.1554 => 0.1537, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.75% (0.3083 => 0.3137, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.50% (0.2394 => 0.2430, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.73% (0.3175 => 0.3230, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.48% (0.2302 => 0.2313, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel: 1.34% (0.0449 => 0.0455, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: -15.56% (0.0090 => 0.0076, std.dev.: 0.0008) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -10.83% (0.0240 => 0.0214, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.04% (0.0192 => 0.0194, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.26% (0.0390 => 0.0389, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -26.25% (0.0301 => 0.0222, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.76% (0.0284 => 0.0279, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -22.22% (0.0324 => 0.0252, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/casts: -2.82% (0.0177 => 0.0172, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 2.12% (0.0189 => 0.0193) SingleSource/UnitTests/Vector/multiplies: 1.20% (0.0249 => 0.0252, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -22.46% (0.0325 => 0.0252, std.dev.: 0.0038) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 10.00% (0.0010 => 0.0011) MultiSource/Applications/ClamAV/clamscan: 1.33% (0.1429 => 0.1448, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 2.29% (1.5019 => 1.5363, std.dev.: 0.0111) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.60% (0.1501 => 0.1492, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.39% (0.4264 => 0.4034, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.00% (0.1344 => 0.1465, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.41% (0.0589 => 0.0615, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -11.64% (0.0232 => 0.0205, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.20% (0.0639 => 0.0593, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.63% (1.1350 => 1.1279, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 350.00% (0.0006 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -33.33% (0.0024 => 0.0016, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.01% (0.0637 => 0.0586, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.91% (0.0246 => 0.0263, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.88% (0.7541 => 0.7683, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.06% (1.5363 => 1.5987, std.dev.: 0.0060) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 300.00% (0.0001 => 0.0004, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 1 09:57:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 1 Oct 2012 11:57:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121001165730.30C312A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4449?compare_to=4444&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4449, Order: 164943, Start Time: 2012-10-01 15:38:29, End Time: 2012-10-01 16:59:09 To: 4444, Order: 164933, Start Time: 2012-10-01 11:54:13, End Time: 2012-10-01 13:14:30 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (145 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 92 (18 on baseline) Unchanged Tests: 949 (704 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -4.27% (15.2000 => 14.5505, std.dev.: 0.0046) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.50% (0.5761 => 0.5732, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: -0.22% (15.9883 => 15.9536, std.dev.: 0.0075) MultiSource/Applications/kimwitu++/kc: -0.49% (14.9127 => 14.8399, std.dev.: 0.0033) MultiSource/Benchmarks/Bullet/bullet: -0.65% (83.6146 => 83.0713, std.dev.: 0.0222) MultiSource/Benchmarks/MallocBench/gs/gs: -0.40% (4.3434 => 4.3259, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0459 => 0.0459, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.43% (0.0462 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.47% (0.0430 => 0.0428) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.23% (0.0430 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.24% (0.0418 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.24% (0.0420 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0412 => 0.0412, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.24% (0.0414 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.23% (0.0430 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.23% (0.0431 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.47% (0.0425 => 0.0423, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.23% (0.0426 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0414 => 0.0414, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.24% (0.0416 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0421 => 0.0421) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.24% (0.0423 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.23% (0.0433 => 0.0432, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.84% (0.0434 => 0.0455, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.24% (0.0409 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.24% (0.0411 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.24% (0.0422 => 0.0421, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0422 => 0.0422, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.24% (0.0413 => 0.0412) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.24% (0.0414 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0405 => 0.0405) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.25% (0.0406 => 0.0405) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.25% (0.0404 => 0.0403) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.25% (0.0405 => 0.0404, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.23% (0.0441 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0441 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0402 => 0.0402) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0403 => 0.0403) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.49% (0.0405 => 0.0403, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0404 => 0.0404, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.49% (0.0412 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.24% (0.0413 => 0.0412, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.28% (1.2311 => 1.2277, std.dev.: 0.0088) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.33% (7.5408 => 7.5158, std.dev.: 0.0135) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.11% (3.7191 => 3.7149, std.dev.: 0.0257) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.37% (0.6484 => 0.6460, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.14% (0.1433 => 0.1431, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.25% (0.0647 => 0.0668, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: 31.35% (63.2438 => 83.0713, std.dev.: 0.0222) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14234.72% (0.0720 => 10.3210, std.dev.: 0.0050) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 40.35% (10.3673 => 14.5505, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/richards_benchmark: 28.30% (0.1622 => 0.2081, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.21% (7.0540 => 8.0562, std.dev.: 0.0083) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.58% (2.2022 => 2.5012, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 13.20% (0.1432 => 0.1621, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.96% (1.1194 => 1.2645, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.71% (0.1566 => 0.1765, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.77% (1.7609 => 1.9681, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.19% (0.3543 => 0.3904, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.72% (0.1584 => 0.1738, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 9.62% (0.3473 => 0.3807, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.38% (0.3561 => 0.3895, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.34% (0.3543 => 0.3874, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.33% (0.3516 => 0.3844, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.29% (0.3497 => 0.3822, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 9.12% (0.1655 => 0.1806, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 9.10% (0.3694 => 0.4030, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 9.09% (0.3828 => 0.4176, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 9.02% (0.3282 => 0.3578, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 9.01% (0.3927 => 0.4281, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.87% (0.4879 => 0.5312, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.62% (0.3886 => 0.4221, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 8.41% (10.4361 => 11.3139, std.dev.: 0.0117) MultiSource/Benchmarks/Olden/power/power: 7.78% (0.1440 => 0.1552, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 7.66% (9.4845 => 10.2107, std.dev.: 0.0126) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.52% (0.3177 => 0.3416, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.49% (0.6675 => 0.7175, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.39% (0.8172 => 0.8776, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.37% (0.1438 => 0.1544, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 7.34% (0.7115 => 0.7637, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.07% (0.5105 => 0.5466, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 6.98% (0.3109 => 0.3326, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 6.94% (0.7433 => 0.7949, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.93% (1.5415 => 1.6483, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 6.89% (0.5925 => 0.6333, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.88% (0.6030 => 0.6445, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 6.86% (5.7591 => 6.1542, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.70% (0.2700 => 0.2881, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.65% (0.1625 => 0.1733, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.63% (0.4615 => 0.4921, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 6.60% (0.3423 => 0.3649, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 6.56% (3.3354 => 3.5543, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.52% (0.5860 => 0.6242, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.52% (0.2271 => 0.2419, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 6.46% (0.2554 => 0.2719, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.46% (1.3050 => 1.3893, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.44% (0.2065 => 0.2198, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 6.37% (0.1695 => 0.1803, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.36% (0.4636 => 0.4931, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.35% (0.2758 => 0.2933, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.27% (4.2646 => 4.5321, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.26% (0.3307 => 0.3514, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.25% (0.5569 => 0.5917, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.23% (4.9449 => 5.2529, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.18% (8.1363 => 8.6395, std.dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference: 6.18% (0.7326 => 0.7779, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/fibo: 6.13% (0.2725 => 0.2892, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.10% (0.8067 => 0.8559, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.10% (5.0018 => 5.3067, std.dev.: 0.0053) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.02% (0.3121 => 0.3309, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.99% (0.2756 => 0.2921, std.dev.: 0.0063) MultiSource/Applications/spiff/spiff: 5.93% (0.7835 => 0.8300, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/hello: 5.93% (0.2714 => 0.2875, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.86% (0.5020 => 0.5314, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.81% (0.2891 => 0.3059, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash: 5.81% (0.4289 => 0.4538, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.79% (0.2107 => 0.2229, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.78% (0.2905 => 0.3073, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.73% (0.2793 => 0.2953, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 5.70% (0.6456 => 0.6824, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.68% (0.4064 => 0.4295, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.67% (0.1940 => 0.2050, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.66% (0.9765 => 1.0318, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 5.63% (0.3092 => 0.3266, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.61% (0.4103 => 0.4333, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.60% (0.1892 => 0.1998, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.58% (0.2831 => 0.2989, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.54% (7.9617 => 8.4024, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/matrix: 5.49% (0.3098 => 0.3268, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.49% (0.3865 => 0.4077, std.dev.: 0.0060) MultiSource/Benchmarks/sim/sim: 5.46% (0.3387 => 0.3572, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 5.45% (1.1642 => 1.2276, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/wc: 5.44% (0.3052 => 0.3218, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.42% (0.4203 => 0.4431, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.42% (0.3650 => 0.3848, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ary2: 5.42% (0.3379 => 0.3562, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 5.41% (1.0722 => 1.1302, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 5.37% (3.8723 => 4.0801, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.36% (0.3826 => 0.4031, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.35% (0.3232 => 0.3405, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.34% (0.2603 => 0.2742, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 5.34% (0.4048 => 0.4264, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 5.33% (0.3283 => 0.3458, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 5.33% (21.9371 => 23.1058, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hash2: 5.30% (0.4620 => 0.4865, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.29% (2.0665 => 2.1759, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.29% (0.3136 => 0.3302, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.29% (1.1861 => 1.2488, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.26% (0.2872 => 0.3023, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 5.19% (0.2871 => 0.3020, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.18% (0.3684 => 0.3875, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.17% (0.3441 => 0.3619, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.15% (0.3162 => 0.3325, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 5.13% (0.3180 => 0.3343, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 5.12% (1.5603 => 1.6402, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/05-eks/eks: 5.12% (0.4299 => 0.4519, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 5.11% (0.2877 => 0.3024, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 5.11% (0.3603 => 0.3787, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.00% (0.2802 => 0.2942, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.95% (2.0273 => 2.1277, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.93% (0.3935 => 0.4129, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.90% (0.6450 => 0.6766, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 4.69% (0.8921 => 0.9339, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.59% (1.5859 => 1.6587, std.dev.: 0.0061) MultiSource/Applications/siod/siod: 4.52% (2.2969 => 2.4008, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.31% (0.5981 => 0.6239, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.98% (1.4186 => 1.4751, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.92% (2.2024 => 2.2888, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 3.80% (1.1840 => 1.2290, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.75% (14.3668 => 14.9055, std.dev.: 0.0158) MultiSource/Applications/hexxagon/hexxagon: 3.50% (1.2842 => 1.3291, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 3.42% (0.3131 => 0.3238, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.63% (0.8101 => 0.8314, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 1.73% (17.1811 => 17.4780, std.dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.51% (3.8922 => 3.9510, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.25% (1.1145 => 1.3848, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4500, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 6.75% (1.1396 => 1.2165, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (3.1578 => 3.3673, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.75% (0.4162 => 0.4318, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.51% (3.6395 => 3.7672, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.83% (4.2280 => 4.3475, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.28% (1.7254 => 1.7647, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.38% (9.1159 => 9.2415, std.dev.: 0.0305) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7987, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.11% (2.1825 => 2.2067, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.00% (6.5088 => 6.5740, std.dev.: 0.0074) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.06% (6.6874 => 0.1297, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.18% (0.8651 => 0.1715, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.12% (5.2763 => 3.2649, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.74% (5.3855 => 3.8914, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.40% (5.3526 => 3.8861, std.dev.: 0.0028) SingleSource/UnitTests/Vector/constpool: -14.71% (54.1659 => 46.1973, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.00% (2.9384 => 2.6151, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -8.03% (22.1758 => 20.3957, std.dev.: 0.0136) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -16.12% (1.6925 => 1.4197, std.dev.: 0.0046) SingleSource/Benchmarks/McGill/chomp: -11.19% (1.2373 => 1.0988, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel-2: -10.37% (1.5373 => 1.3779, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.40% (19.9488 => 18.2735, std.dev.: 0.0353) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4787, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.67% (1.8329 => 1.7106, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8483, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -5.25% (1.5835 => 1.5003, std.dev.: 0.0037) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7916, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.98% (1.6805 => 1.5968, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.54% (3.2827 => 3.1666, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5017, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.65% (1.3677 => 1.3314, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.03% (8.1563 => 7.9908, std.dev.: 0.0129) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.00% (8.6802 => 8.5062, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0869, std.dev.: 0.0180) MultiSource/Applications/hexxagon/hexxagon: -1.79% (12.4730 => 12.2502, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6834, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0009) SingleSource/UnitTests/Vector/multiplies: -1.56% (2.5528 => 2.5129, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4215, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8574, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2350, std.dev.: 0.0062) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.62% (0.5229 => 0.5732, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 6.43% (14.9895 => 15.9536, std.dev.: 0.0075) MultiSource/Applications/kimwitu++/kc: 4.84% (14.1553 => 14.8399, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/gs/gs: 5.24% (4.1105 => 4.3259, std.dev.: 0.0144) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.12% (1.1048 => 1.2277, std.dev.: 0.0088) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.00% (7.1582 => 7.5158, std.dev.: 0.0135) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.28% (3.4629 => 3.7149, std.dev.: 0.0257) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.83% (0.6222 => 0.6460, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.43% (0.2116 => 0.0668, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 1 10:21:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 1 Oct 2012 12:21:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121001172128.097972A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4450?compare_to=4445&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4450, Order: 164945, Start Time: 2012-10-01 15:57:32, End Time: 2012-10-01 17:23:06 To: 4445, Order: 164933, Start Time: 2012-10-01 12:03:37, End Time: 2012-10-01 13:29:11 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 1 (179 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1038 (692 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.67% (55.0698 => 56.5378, std.dev.: 0.1162) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.00% (2.7528 => 2.7527, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.00% (2.1154 => 2.1155) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.01% (4.9745 => 4.9749, std.dev.: 0.0011) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.61% (2.0176 => 2.4537, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.81% (0.1410 => 0.1647, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 15.13% (0.0826 => 0.0951, std.dev.: 0.0009) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.97% (0.1072 => 0.1211, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.32% (0.1413 => 0.1573, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 11.16% (0.4328 => 0.4811, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.15% (0.1588 => 0.1765, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 10.88% (0.5818 => 0.6451, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.68% (0.0964 => 0.1067, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 10.66% (0.1013 => 0.1121, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.66% (3.9660 => 4.3887, std.dev.: 0.0077) SingleSource/Regression/C++/ofstream_ctor: 10.61% (0.2781 => 0.3076, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 10.50% (0.7038 => 0.7777, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 10.49% (0.5748 => 0.6351, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 10.44% (1.3693 => 1.5122, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.35% (0.2782 => 0.3070, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 10.34% (0.4062 => 0.4482, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.22% (0.2721 => 0.2999, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.19% (0.6283 => 0.6923, std.dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference: 10.17% (0.7061 => 0.7779, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.16% (0.3899 => 0.4295, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.10% (0.1327 => 0.1461, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.02% (0.2596 => 0.2856, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.93% (0.3022 => 0.3322, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 9.90% (0.2607 => 0.2865, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 9.85% (0.2690 => 0.2955, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.83% (0.2655 => 0.2916, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 9.79% (0.2726 => 0.2993, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 9.78% (0.2760 => 0.3030, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.78% (0.3580 => 0.3930, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3485 => 0.3825, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 9.74% (0.2628 => 0.2884, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.71% (1.9828 => 2.1754, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/wc: 9.70% (0.2937 => 0.3222, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.67% (0.6959 => 0.7632, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.66% (0.4791 => 0.5254, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.66% (1.2193 => 1.3371, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.64% (0.9199 => 1.0086, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 9.63% (0.2761 => 0.3027, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 9.63% (0.3293 => 0.3610, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 9.62% (0.3107 => 0.3406, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.62% (0.2765 => 0.3031, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.61% (0.2966 => 0.3251, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.60% (0.7710 => 0.8450, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 9.53% (0.3149 => 0.3449, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.52% (0.5265 => 0.5766, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 9.51% (13.8202 => 15.1348, std.dev.: 0.0093) MultiSource/Applications/aha/aha: 9.51% (0.1062 => 0.1163, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.50% (0.3756 => 0.4113, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.49% (1.4563 => 1.5945, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.46% (0.4016 => 0.4396, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.46% (0.3489 => 0.3819, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.41% (1.1364 => 1.2433, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.38% (0.2696 => 0.2949, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 9.34% (0.2988 => 0.3267, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 9.33% (0.3868 => 0.4229, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 9.27% (0.3453 => 0.3773, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 9.21% (0.3192 => 0.3486, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.17% (0.3130 => 0.3417, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 9.13% (0.1589 => 0.1734, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.06% (0.1435 => 0.1565, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.95% (0.4390 => 0.4783, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 8.89% (0.3534 => 0.3848, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 8.86% (1.0313 => 1.1227, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.82% (0.1157 => 0.1259, std.dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 8.71% (0.2995 => 0.3256, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.70% (0.1276 => 0.1387, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.59% (0.6576 => 0.7141, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.55% (0.5577 => 0.6054, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 8.49% (0.2945 => 0.3195, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.46% (0.1986 => 0.2154, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.40% (0.4379 => 0.4747, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.37% (0.2127 => 0.2305, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.32% (0.3246 => 0.3516, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.27% (0.2914 => 0.3155, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 8.18% (1.1061 => 1.1966, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.15% (3.6692 => 3.9681, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/gs/gs: 8.14% (3.8646 => 4.1792, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/football/football: 8.10% (0.8310 => 0.8983, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 7.98% (0.6744 => 0.7282, std.dev.: 0.0051) MultiSource/Applications/kimwitu++/kc: 7.98% (16.6129 => 17.9378, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.91% (0.5637 => 0.6083, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.86% (0.3755 => 0.4050, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.83% (7.2180 => 7.7832, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/09-vor/vor: 7.79% (0.2925 => 0.3153, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.78% (0.8698 => 0.9375, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 7.77% (0.7506 => 0.8089, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 7.76% (3.1889 => 3.4363, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 7.76% (0.2243 => 0.2417, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 7.70% (0.3220 => 0.3468, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 7.70% (2.1791 => 2.3468, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.66% (1.3819 => 1.4878, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.64% (1.3813 => 1.4869, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.61% (0.7460 => 0.8028, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 7.53% (1.0594 => 1.1392, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.52% (0.1569 => 0.1687, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.46% (0.2023 => 0.2174, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 7.37% (1.9270 => 2.0690, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/parameter-passing: 7.24% (0.4003 => 0.4293, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.24% (0.3578 => 0.3837, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.20% (0.3914 => 0.4196, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.20% (1.3245 => 1.4198, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 7.19% (0.3646 => 0.3908, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.18% (0.3789 => 0.4061, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 7.13% (14.8535 => 15.9132, std.dev.: 0.0134) SingleSource/UnitTests/ObjC/exceptions-2: 7.11% (0.3601 => 0.3857, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.11% (0.3940 => 0.4220, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.10% (0.1789 => 0.1916, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 7.10% (0.3663 => 0.3923, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 7.00% (0.4113 => 0.4401, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 7.00% (0.1657 => 0.1773, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.99% (0.3650 => 0.3905, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 6.98% (8.4961 => 9.0889, std.dev.: 0.0151) MultiSource/Applications/viterbi/viterbi: 6.97% (0.1478 => 0.1581, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 6.94% (1.2749 => 1.3634, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 6.93% (0.3623 => 0.3874, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 6.86% (0.2859 => 0.3055, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.85% (0.8818 => 0.9422, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.76% (0.6135 => 0.6550, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.68% (4.3801 => 4.6728, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.66% (4.4433 => 4.7391, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 6.64% (0.3131 => 0.3339, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 6.58% (1.2292 => 1.3101, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.58% (0.3511 => 0.3742, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 6.56% (4.6629 => 4.9689, std.dev.: 0.0147) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.36% (1.1333 => 1.2054, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.31% (0.2140 => 0.2275, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 6.30% (6.5754 => 6.9896, std.dev.: 0.0042) MultiSource/Applications/ClamAV/clamscan: 6.27% (14.5298 => 15.4402, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.25% (3.2742 => 3.4790, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: 6.22% (0.6250 => 0.6639, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.16% (0.3245 => 0.3445, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.10% (13.2842 => 14.0943, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.07% (0.2504 => 0.2656, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.99% (4.9865 => 5.2854, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.95% (0.2321 => 0.2459, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.85% (0.4805 => 0.5086, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.83% (0.1819 => 0.1925, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.62% (1.5188 => 1.6041, std.dev.: 0.0172) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.49% (0.9108 => 0.9608, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 5.06% (3.7467 => 3.9361, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.93% (2.1007 => 2.2042, std.dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.72% (6.2785 => 6.5746, std.dev.: 0.0038) MultiSource/Benchmarks/Bullet/bullet: 4.46% (33.2944 => 34.7798, std.dev.: 0.0070) MultiSource/Applications/sqlite3/sqlite3: 2.68% (16.2614 => 16.6972, std.dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5131, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 24.25% (1.8175 => 2.2582, std.dev.: 0.0502) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 8.62% (1.1560 => 1.2556, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4143, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.29% (1.2998 => 1.3816, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0004, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0040, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.12% (11.2619 => 11.7255, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7758, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: 3.33% (1.9199 => 1.9838, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 3.03% (10.7476 => 11.0736, std.dev.: 0.0115) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.06% (7.4271 => 7.5798, std.dev.: 0.0122) SingleSource/Benchmarks/Misc/ffbench: 1.76% (0.8273 => 0.8419, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4529, std.dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5139, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9698, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 1.31% (5.5130 => 5.5852, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1872, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.10% (12.4560 => 12.5936, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 1.09% (12.0921 => 12.2239, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (2.2986 => 2.3234, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.01% (8.8259 => 8.9154, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.89% (0.4657 => 0.3917, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.26% (22.5627 => 22.0526, std.dev.: 0.0111) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.33% (1.0460 => 0.8543, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/chomp: -12.02% (1.2308 => 1.0828, std.dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.27% (20.3410 => 18.2520, std.dev.: 0.0193) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.60% (1.3780 => 1.3008, std.dev.: 0.0120) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.11% (2.6470 => 2.5118, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7940, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1562, std.dev.: 0.0028) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.50% (1.7688 => 1.7069, std.dev.: 0.0189) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.66% (3.0263 => 2.9458, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.31% (1.9762 => 1.9305, std.dev.: 0.0007) SingleSource/Regression/C/uint64_to_float: -2.11% (0.5449 => 0.5334) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7053, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.81% (0.6589 => 0.6470, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.80% (0.6615 => 0.6496, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.77% (6.3560 => 6.2437, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.53% (7.3305 => 7.2183, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0071, std.dev.: 0.0006) MultiSource/Applications/lua/lua: -1.40% (26.5159 => 26.1443, std.dev.: 0.0298) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8681, std.dev.: 0.0055) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2508, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4948, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: -1.02% (4.4810 => 4.4351, std.dev.: 0.0039) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 1 10:39:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 1 Oct 2012 12:39:38 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121001173938.663B82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4451?compare_to=4448&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4451, Order: 164945, Start Time: 2012-10-01 16:17:30, End Time: 2012-10-01 17:41:18 To: 4448, Order: 164943, Start Time: 2012-10-01 14:37:57, End Time: 2012-10-01 16:01:37 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 11 (85 on baseline) Performance Improvements: 5 (41 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 957 (765 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.76% (0.8390 => 0.8538, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.37% (0.8714 => 0.8833, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.32% (0.8541 => 0.8654, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.27% (4.3008 => 4.3556, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.25% (0.8170 => 0.8272, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.13% (1.2420 => 1.2560, std.dev.: 0.0029) MultiSource/Applications/lua/lua: 1.08% (3.6717 => 3.7112, std.dev.: 0.0111) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.95% (88.5687 => 91.1806, std.dev.: 0.2195) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 2.33% (1.8261 => 1.8686, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.53% (6.3474 => 6.4442, std.dev.: 0.0267) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.43% (2.9185 => 2.9601, std.dev.: 0.0068) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.87% (0.5947 => 0.5717, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.11% (0.7996 => 0.7747, std.dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.89% (43.8401 => 42.1339, std.dev.: 0.6506) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -1.29% (2.7763 => 2.7405, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -1.24% (4.1522 => 4.1008, std.dev.: 0.0112) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.35% (1.0017 => 1.0152, std.dev.: 0.0085) MultiSource/Applications/sqlite3/sqlite3: 0.54% (0.6152 => 0.6185, std.dev.: 0.0118) MultiSource/Benchmarks/McCat/08-main/main: 2.04% (0.1614 => 0.1647, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.95% (0.1537 => 0.1567, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.19% (0.3137 => 0.3131, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.59% (0.2430 => 0.2367, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.65% (0.3230 => 0.3209, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (0.2313 => 0.2289, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: 0.66% (0.0455 => 0.0458, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0007) SingleSource/UnitTests/2003-08-11-VaListArg: 19.74% (0.0076 => 0.0091, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 13.08% (0.0214 => 0.0242, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -25.77% (0.0194 => 0.0144, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.77% (0.0389 => 0.0392, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 34.68% (0.0222 => 0.0299, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.08% (0.0279 => 0.0282, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.38% (0.0252 => 0.0246, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/casts: 3.49% (0.0172 => 0.0178, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -30.57% (0.0193 => 0.0134, std.dev.: 0.0028) SingleSource/UnitTests/Vector/multiplies: -1.19% (0.0252 => 0.0249, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: 30.16% (0.0252 => 0.0328, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -54.55% (0.0011 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.48% (0.1448 => 0.1455, std.dev.: 0.0027) MultiSource/Applications/lemon/lemon: -5.09% (1.5363 => 1.4581, std.dev.: 0.0209) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.07% (0.1492 => 0.1508, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.07% (0.4034 => 0.4031, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.82% (0.1465 => 0.1453, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.43% (0.0615 => 0.0557, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -8.78% (0.0205 => 0.0187, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 6.24% (0.0593 => 0.0630, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.37% (1.1279 => 1.1237, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -44.44% (0.0027 => 0.0015, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -93.75% (0.0016 => 0.0001, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.46% (0.0586 => 0.0618, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -37.26% (0.0263 => 0.0165, std.dev.: 0.0062) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.29% (0.7683 => 0.7661, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.01% (1.5987 => 1.5986, std.dev.: 0.0024) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 25.00% (0.0004 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.98% (4.1772 => 3.0921, std.dev.: 0.0330) SingleSource/Benchmarks/Shootout-C++/except: 83033.33% (0.0006 => 0.4988, std.dev.: 0.0016) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/exception_spec_test: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_rethrow: -66.67% (0.0006 => 0.0002, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: -50.00% (0.0004 => 0.0002, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.14% (0.6410 => 0.6996, std.dev.: 0.0036) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.84% (0.1414 => 0.1539, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 8.64% (2.1763 => 2.3644, std.dev.: 0.0173) SingleSource/Benchmarks/Misc-C++/bigfib: 8.51% (0.5309 => 0.5761, std.dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 7.65% (1.1653 => 1.2544, std.dev.: 0.0075) MultiSource/Applications/minisat/minisat: 7.48% (0.6173 => 0.6635, std.dev.: 0.0057) MultiSource/Applications/lemon/lemon: 6.82% (1.0046 => 1.0731, std.dev.: 0.0122) MultiSource/Applications/kimwitu++/kc: 6.81% (15.3105 => 16.3536, std.dev.: 0.1215) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.28% (0.3582 => 0.3807, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 6.20% (0.6915 => 0.7344, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.91% (1.5150 => 1.6045, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.53% (0.2552 => 0.2693, std.dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: 5.31% (29.3170 => 30.8739, std.dev.: 0.0633) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.15% (0.3901 => 0.4102, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 5.13% (4.7455 => 4.9890, std.dev.: 0.0319) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.98% (0.6069 => 0.6371, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.90% (0.7639 => 0.8013, std.dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 4.84% (13.3238 => 13.9688, std.dev.: 0.1598) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.72% (0.2797 => 0.2929, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.65% (12.6413 => 13.2291, std.dev.: 0.0569) MultiSource/Applications/hbd/hbd: 4.60% (1.3268 => 1.3878, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.48% (1.2021 => 1.2560, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.36% (0.7226 => 0.7541, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.30% (0.4880 => 0.5090, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.24% (0.2662 => 0.2775, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash: 4.06% (0.3520 => 0.3663, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 3.97% (2.0972 => 2.1804, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/lists1: 3.90% (0.2771 => 0.2879, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.85% (0.3062 => 0.3180, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.84% (0.4248 => 0.4411, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.83% (0.3418 => 0.3549, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 3.79% (6.4908 => 6.7365, std.dev.: 0.0382) MultiSource/Benchmarks/McCat/18-imp/imp: 3.73% (0.3217 => 0.3337, std.dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 3.63% (14.6079 => 15.1377, std.dev.: 0.0097) MultiSource/Applications/JM/lencod/lencod: 3.60% (14.7256 => 15.2557, std.dev.: 0.0991) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.56% (0.2952 => 0.3057, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.26% (1.0821 => 1.1174, std.dev.: 0.0112) MultiSource/Benchmarks/mafft/pairlocalalign: 3.23% (8.2186 => 8.4838, std.dev.: 0.0795) MultiSource/Applications/lua/lua: 3.15% (3.5980 => 3.7112, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/football/football: 3.11% (0.8405 => 0.8666, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hash2: 3.09% (0.3847 => 0.3966, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.05% (1.1672 => 1.2028, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.02% (1.4113 => 1.4539, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 2.93% (0.3412 => 0.3512, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.91% (0.8569 => 0.8818, std.dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.85% (6.2546 => 6.4326, std.dev.: 0.0375) MultiSource/Applications/treecc/treecc: 2.76% (1.8798 => 1.9316, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.65% (1.1827 => 1.2140, std.dev.: 0.0114) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.64% (1.0689 => 1.0971, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.53% (0.5937 => 0.6087, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.50% (0.5636 => 0.5777, std.dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 2.46% (0.9425 => 0.9657, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.35% (4.3380 => 4.4399, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.27% (4.0318 => 4.1235, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.21% (4.2616 => 4.3556, std.dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.94% (1.3935 => 1.4206, std.dev.: 0.0068) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.44% (1.6538 => 2.3391, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/matrix: 22.14% (3.4629 => 4.2295, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.02% (0.0766 => 0.0904, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/ary3: 15.01% (1.7426 => 2.0041, std.dev.: 0.0251) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.40% (4.0101 => 4.5473, std.dev.: 0.0118) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.00% (0.0917 => 0.1027, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/queens: 11.04% (1.6261 => 1.8056, std.dev.: 0.0014) SingleSource/Benchmarks/Stanford/Puzzle: 10.05% (0.1433 => 0.1577, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.42% (0.2857 => 0.3126, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/lists: 8.89% (7.0025 => 7.6247, std.dev.: 0.0149) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.97% (1.0063 => 1.0865, std.dev.: 0.0183) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.15% (0.3301 => 0.3504, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.66% (4.2129 => 4.4512, std.dev.: 0.0410) SingleSource/Benchmarks/Misc/dt: 4.19% (0.9851 => 1.0264, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: 3.92% (15.2242 => 15.8206, std.dev.: 0.0732) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.85% (3.4080 => 3.5391, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.28% (0.5587 => 0.5770, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 3.08% (3.5520 => 3.6614, std.dev.: 0.0090) MultiSource/Applications/hexxagon/hexxagon: 2.96% (14.4877 => 14.9161, std.dev.: 0.0564) MultiSource/Benchmarks/sim/sim: 2.81% (3.8907 => 4.0001, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.81% (2.6656 => 2.7405, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/hash: 2.76% (0.6308 => 0.6482, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/mason/mason: 2.42% (0.5004 => 0.5125, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.19% (4.6127 => 4.7137, std.dev.: 0.0204) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.12% (6.6312 => 6.7716, std.dev.: 0.0116) SingleSource/Benchmarks/Dhrystone/dry: 1.85% (2.4013 => 2.4458, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.54% (2.9152 => 2.9601, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/power/power: 1.50% (1.4184 => 1.4397, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (4.6414 => 4.6922, std.dev.: 0.0170) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.12% (0.3497 => 0.2129, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.73% (5.2665 => 4.1220, std.dev.: 0.0909) SingleSource/Benchmarks/Shootout-C++/ary3: -20.27% (1.7473 => 1.3931, std.dev.: 0.0272) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.40% (1.1647 => 0.9621, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.46% (15.8312 => 13.3832, std.dev.: 0.0753) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1596, std.dev.: 0.0146) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.32% (1.4034 => 1.2867, std.dev.: 0.0305) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.67% (3.2007 => 2.9553, std.dev.: 0.0185) MultiSource/Applications/lambda-0_1_3/lambda: -6.98% (7.6833 => 7.1467, std.dev.: 0.0414) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.80% (3.6254 => 3.3789, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/fibo: -6.47% (4.6355 => 4.3357, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: -6.43% (1.4441 => 1.3512, std.dev.: 0.0146) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.43% (2.0027 => 1.8739, std.dev.: 0.0138) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.07% (2.9728 => 2.7924, std.dev.: 0.0180) MultiSource/Benchmarks/mafft/pairlocalalign: -5.49% (62.4126 => 58.9878, std.dev.: 0.0345) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.47% (3.9413 => 3.7259, std.dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: -5.27% (3.4230 => 3.2425, std.dev.: 0.0242) SingleSource/Benchmarks/Shootout/fib2: -5.21% (4.4195 => 4.1893, std.dev.: 0.0097) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.58% (0.4564 => 0.4355, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/misr: -4.35% (0.4296 => 0.4109, std.dev.: 0.0033) MultiSource/Applications/sgefa/sgefa: -4.27% (0.3746 => 0.3586, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/bh/bh: -3.99% (2.5166 => 2.4162, std.dev.: 0.0219) SingleSource/Benchmarks/Shootout-C++/methcall: -3.61% (9.2503 => 8.9164, std.dev.: 0.0481) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.76% (3.7496 => 3.6462, std.dev.: 0.0185) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.73% (45.4683 => 44.2251, std.dev.: 0.4378) SingleSource/Benchmarks/Misc/flops: -2.67% (9.5474 => 9.2922, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.64% (2.4457 => 2.3812, std.dev.: 0.0214) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.21% (0.6119 => 0.5984, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/neural/neural: -2.04% (1.0926 => 1.0703, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: -1.97% (3.4876 => 3.4190, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.90% (1.1683 => 1.1461, std.dev.: 0.0009) MultiSource/Applications/aha/aha: -1.89% (3.4286 => 3.3637, std.dev.: 0.0067) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.85% (2.3569 => 2.3134, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -1.69% (92.7467 => 91.1806, std.dev.: 0.2195) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.49% (9.3855 => 9.2461, std.dev.: 0.0117) MultiSource/Applications/JM/lencod/lencod: -1.46% (6.7458 => 6.6475, std.dev.: 0.0139) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3161, std.dev.: 0.0275) MultiSource/Applications/lua/lua: -1.34% (29.5232 => 29.1265, std.dev.: 0.0901) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.28% (27.1724 => 26.8241, std.dev.: 0.0229) SingleSource/Benchmarks/Shootout-C++/lists: -1.25% (16.5617 => 16.3553, std.dev.: 0.0592) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.72% (0.9980 => 1.0152, std.dev.: 0.0085) MultiSource/Applications/sqlite3/sqlite3: 2.71% (0.6022 => 0.6185, std.dev.: 0.0118) MultiSource/Benchmarks/McCat/08-main/main: -1.14% (0.1666 => 0.1647, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.84% (0.1554 => 0.1567, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.56% (0.3083 => 0.3131, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.13% (0.2394 => 0.2367, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.07% (0.3175 => 0.3209, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.56% (0.2302 => 0.2289, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: 2.00% (0.0449 => 0.0458, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0007) SingleSource/UnitTests/2003-08-11-VaListArg: 1.11% (0.0090 => 0.0091, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.83% (0.0240 => 0.0242, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -25.00% (0.0192 => 0.0144, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.51% (0.0390 => 0.0392, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.66% (0.0301 => 0.0299, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.70% (0.0284 => 0.0282, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -24.07% (0.0324 => 0.0246, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0177 => 0.0178, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -29.10% (0.0189 => 0.0134, std.dev.: 0.0028) SingleSource/UnitTests/Vector/multiplies: - (0.0249 => 0.0249, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: 0.92% (0.0325 => 0.0328, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.82% (0.1429 => 0.1455, std.dev.: 0.0027) MultiSource/Applications/lemon/lemon: -2.92% (1.5019 => 1.4581, std.dev.: 0.0209) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.47% (0.1501 => 0.1508, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.46% (0.4264 => 0.4031, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.11% (0.1344 => 0.1453, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.43% (0.0589 => 0.0557, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -19.40% (0.0232 => 0.0187, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.41% (0.0639 => 0.0630, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.00% (1.1350 => 1.1237, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 150.00% (0.0006 => 0.0015, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -95.83% (0.0024 => 0.0001, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.98% (0.0637 => 0.0618, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.93% (0.0246 => 0.0165, std.dev.: 0.0062) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.59% (0.7541 => 0.7661, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.06% (1.5363 => 1.5986, std.dev.: 0.0024) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 1 11:45:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 1 Oct 2012 13:45:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121001184502.2716A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4452?compare_to=4447&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4452, Order: 164943, Start Time: 2012-10-01 15:31:50, End Time: 2012-10-01 18:42:21 To: 4447, Order: 164933, Start Time: 2012-10-01 11:53:15, End Time: 2012-10-01 15:03:00 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 1 (127 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (131 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1037 (766 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.04% (126.3943 => 130.2411, std.dev.: 0.2423) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.82% (2.5104 => 2.4648, std.dev.: 0.0152) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.06% (9.8147 => 9.8091, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.01% (9.4101 => 9.4112, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.01% (16.9575 => 16.9558, std.dev.: 0.0009) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 11.21% (0.3488 => 0.3879, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.14% (0.3446 => 0.3830, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 11.13% (0.3496 => 0.3885, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.08% (0.3465 => 0.3849, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 11.04% (0.3460 => 0.3842, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.01% (0.3469 => 0.3851, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 11.01% (0.3442 => 0.3821, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 10.82% (0.3650 => 0.4045, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.76% (0.3643 => 0.4035, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 10.42% (0.3724 => 0.4112, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.88% (0.1063 => 0.1168, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 9.55% (1.5932 => 1.7454, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 8.14% (0.5826 => 0.6300, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 8.03% (0.5889 => 0.6362, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 7.66% (0.1619 => 0.1743, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.27% (0.2875 => 0.3084, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.17% (0.3195 => 0.3424, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.12% (0.3004 => 0.3218, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 7.02% (0.2750 => 0.2943, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.01% (0.2811 => 0.3008, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.97% (0.2813 => 0.3009, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.96% (0.2714 => 0.2903, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 6.94% (0.2823 => 0.3019, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.94% (0.2725 => 0.2914, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.90% (0.2738 => 0.2927, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.90% (1.3152 => 1.4059, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.88% (0.4361 => 0.4661, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.85% (0.2729 => 0.2916, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.84% (0.2792 => 0.2983, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.82% (1.6211 => 1.7317, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/matrix: 6.73% (0.2780 => 0.2967, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 6.72% (0.7171 => 0.7653, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/random: 6.71% (0.2803 => 0.2991, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.70% (0.2911 => 0.3106, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 6.69% (0.9909 => 1.0572) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.64% (3.5627 => 3.7994, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 6.61% (0.3267 => 0.3483, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.60% (2.0673 => 2.2038, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 6.60% (0.3258 => 0.3473, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 6.56% (0.3096 => 0.3299, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.54% (0.3060 => 0.3260, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.45% (0.3317 => 0.3531, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 6.41% (5.5417 => 5.8971, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/hash: 6.39% (0.4146 => 0.4411, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.39% (0.4994 => 0.5313, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.34% (0.3124 => 0.3322, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.23% (0.1620 => 0.1721, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.23% (0.3726 => 0.3958, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 6.21% (0.3348 => 0.3556, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.21% (0.3625 => 0.3850, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.16% (0.2014 => 0.2138, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.15% (1.0781 => 1.1444, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.14% (0.5000 => 0.5307, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 6.13% (0.3477 => 0.3690, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 6.09% (0.3678 => 0.3902, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.06% (0.3282 => 0.3481, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.97% (2.7292 => 2.8922, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.93% (0.5026 => 0.5324, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.93% (0.3930 => 0.4163, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.83% (0.3690 => 0.3905, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 5.82% (4.2109 => 4.4558, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hash2: 5.72% (0.4251 => 0.4494, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 5.65% (0.2566 => 0.2711, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.64% (0.3845 => 0.4062, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.60% (0.3981 => 0.4204, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.56% (0.2736 => 0.2888, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 5.55% (0.6634 => 0.7002, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 5.54% (1.8794 => 1.9835, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.51% (4.4195 => 4.6632, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.51% (0.2068 => 0.2182, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.35% (0.3890 => 0.4098, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 5.34% (2.1013 => 2.2135, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.33% (0.6435 => 0.6778, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.32% (0.4139 => 0.4359, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.27% (0.2866 => 0.3017, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 5.24% (23.5202 => 24.7516, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.23% (0.3903 => 0.4107, std.dev.: 0.0044) MultiSource/Applications/spiff/spiff: 5.19% (0.4029 => 0.4238, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.18% (0.1968 => 0.2070, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 5.15% (4.6177 => 4.8553, std.dev.: 0.0074) MultiSource/Applications/lua/lua: 5.10% (1.4269 => 1.4997, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.08% (0.2737 => 0.2876, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 5.07% (0.5012 => 0.5266, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.05% (0.2040 => 0.2143, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.00% (0.5900 => 0.6195, std.dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: 5.00% (2.1653 => 2.2735, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.93% (0.3084 => 0.3236, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 4.78% (0.5546 => 0.5811, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.77% (0.3271 => 0.3427, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.70% (0.4658 => 0.4877, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 4.65% (0.3336 => 0.3491, std.dev.: 0.0022) MultiSource/Applications/hbd/hbd: 4.62% (0.9697 => 1.0145, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.48% (1.9694 => 2.0576, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.45% (0.2969 => 0.3101, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.36% (1.9966 => 2.0837, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: 4.34% (0.7875 => 0.8217, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 4.29% (2.0346 => 2.1218, std.dev.: 0.0056) MultiSource/Benchmarks/PAQ8p/paq8p: 4.15% (0.4847 => 0.5048, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 4.05% (0.2691 => 0.2800, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.84% (0.7426 => 0.7711, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.55% (0.4253 => 0.4404, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.46% (0.5584 => 0.5777, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.09% (11.6398 => 11.9991, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.90% (4.6926 => 4.8289, std.dev.: 0.0103) MultiSource/Applications/lambda-0_1_3/lambda: 2.86% (0.3498 => 0.3598, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 1.70% (11.9555 => 12.1586, std.dev.: 0.0083) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6095, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-2: 5.16% (1.8057 => 1.8989, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6681, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1689, std.dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/dry: 4.24% (14.0481 => 14.6439, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1994, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.05% (41.7953 => 42.6541, std.dev.: 0.0098) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5051, std.dev.: 0.0020) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2219, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.37% (7.1849 => 7.2836, std.dev.: 0.0032) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5130, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5866, std.dev.: 0.0120) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.87% (25.4195 => 16.5548, std.dev.: 0.0139) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9768, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7990, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: -6.54% (0.2402 => 0.2245, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -3.58% (11.2080 => 10.8072, std.dev.: 0.0099) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7738, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.00% (0.6293 => 0.6104, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.75% (17.2379 => 16.7646, std.dev.: 0.0194) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.82% (10.7630 => 10.5666, std.dev.: 0.0075) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4980, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0428, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 1 11:46:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 1 Oct 2012 13:46:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121001184656.9161B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4453?compare_to=4449&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4453, Order: 164946, Start Time: 2012-10-01 17:28:16, End Time: 2012-10-01 18:48:34 To: 4449, Order: 164943, Start Time: 2012-10-01 15:38:29, End Time: 2012-10-01 16:59:09 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (145 on baseline) Performance Improvements: 2 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 92 (18 on baseline) Unchanged Tests: 946 (705 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.49% (14.5505 => 14.9123, std.dev.: 0.0089) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.26% (55.0817 => 56.3293, std.dev.: 0.1116) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.24% (0.8776 => 0.8667, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.73% (1.3142 => 1.2915, std.dev.: 0.0043) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.03% (0.5732 => 0.5734, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 0.10% (15.9536 => 15.9700, std.dev.: 0.0075) MultiSource/Applications/kimwitu++/kc: 0.07% (14.8399 => 14.8504, std.dev.: 0.0084) MultiSource/Benchmarks/Bullet/bullet: 0.45% (83.0713 => 83.4419, std.dev.: 0.0271) MultiSource/Benchmarks/MallocBench/gs/gs: -0.01% (4.3259 => 4.3254, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.44% (0.0459 => 0.0457) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.43% (0.0460 => 0.0458, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.47% (0.0428 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.23% (0.0429 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.24% (0.0417 => 0.0416, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.24% (0.0419 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.49% (0.0412 => 0.0410) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.48% (0.0413 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.23% (0.0429 => 0.0428, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.23% (0.0430 => 0.0429) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.24% (0.0423 => 0.0422, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.24% (0.0425 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.48% (0.0414 => 0.0412, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.24% (0.0415 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.48% (0.0421 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.47% (0.0422 => 0.0420, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.23% (0.0432 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.44% (0.0455 => 0.0453, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0408 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.49% (0.0410 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.48% (0.0421 => 0.0419) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.47% (0.0422 => 0.0420, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.24% (0.0412 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.24% (0.0413 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.49% (0.0405 => 0.0403) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.49% (0.0405 => 0.0403, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.50% (0.0403 => 0.0401, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.25% (0.0404 => 0.0403, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.23% (0.0440 => 0.0439, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.23% (0.0441 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.50% (0.0402 => 0.0400, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.50% (0.0403 => 0.0401, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.25% (0.0403 => 0.0402, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.25% (0.0404 => 0.0403, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.24% (0.0410 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.49% (0.0412 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.08% (1.2277 => 1.2287, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.17% (7.5158 => 7.5028, std.dev.: 0.0140) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.27% (3.7149 => 3.7049, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.05% (0.6460 => 0.6463, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1431 => 0.1430, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0668 => 0.0667, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: 31.94% (63.2438 => 83.4419, std.dev.: 0.0271) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14232.50% (0.0720 => 10.3194, std.dev.: 0.0100) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 43.84% (10.3673 => 14.9123, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/richards_benchmark: 28.42% (0.1622 => 0.2083, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.35% (7.0540 => 8.0666, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.05% (2.2022 => 2.5117, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 13.90% (0.1432 => 0.1631, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.92% (1.1194 => 1.2640, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.58% (0.1566 => 0.1763, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.81% (1.7609 => 1.9689, std.dev.: 0.0037) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.66% (0.1584 => 0.1737, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 9.48% (0.3282 => 0.3593, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.10% (0.3473 => 0.3789, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.06% (0.3543 => 0.3864, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 8.85% (0.3516 => 0.3827, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.84% (0.3497 => 0.3806, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.83% (0.3543 => 0.3856, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.82% (0.3561 => 0.3875, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.64% (0.3694 => 0.4013, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.54% (0.3828 => 0.4155, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.51% (0.3927 => 0.4261, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.31% (0.3886 => 0.4209, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.28% (0.3177 => 0.3440, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 8.15% (10.4361 => 11.2869, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.14% (0.4879 => 0.5276, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/chomp: 7.79% (0.1655 => 0.1784, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: 7.78% (0.1440 => 0.1552, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 7.60% (9.4845 => 10.2055, std.dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.45% (0.6675 => 0.7172, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.30% (0.1438 => 0.1543, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 7.29% (0.7115 => 0.7634, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 6.98% (0.3109 => 0.3326, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 6.93% (0.7433 => 0.7948, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.93% (0.2700 => 0.2887, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 6.86% (5.7591 => 6.1544, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.84% (0.5105 => 0.5454, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 6.77% (0.5925 => 0.6326, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.75% (1.5415 => 1.6456, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 6.75% (0.6030 => 0.6437, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.59% (3.3354 => 3.5553, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.58% (0.1625 => 0.1732, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.57% (0.4615 => 0.4918, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.54% (0.5860 => 0.6243, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.52% (0.2271 => 0.2419, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 6.49% (0.3423 => 0.3645, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 6.38% (0.2554 => 0.2717, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 6.31% (0.1695 => 0.1802, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.29% (1.3050 => 1.3871, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.23% (4.2646 => 4.5304, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.16% (0.5569 => 0.5912, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference: 6.14% (0.7326 => 0.7776, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.13% (0.1940 => 0.2059, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.11% (4.9449 => 5.2472, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.08% (0.3307 => 0.3508, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.06% (0.8172 => 0.8667, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.05% (8.1363 => 8.6287, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.02% (5.0018 => 5.3031, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.00% (0.8067 => 0.8551, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists: 5.96% (0.3422 => 0.3626, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.96% (0.2065 => 0.2188, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.91% (0.4636 => 0.4910, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.85% (0.4103 => 0.4343, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.79% (0.2107 => 0.2229, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.78% (0.2891 => 0.3058, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.77% (0.2758 => 0.2917, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.74% (0.3121 => 0.3300, std.dev.: 0.0034) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.72% (7.9617 => 8.4170, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/bh/bh: 5.69% (0.3092 => 0.3268, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 5.68% (0.7835 => 0.8280, std.dev.: 0.0016) SingleSource/Regression/C++/ofstream_ctor: 5.65% (0.2905 => 0.3069, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 5.62% (0.6456 => 0.6819, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.59% (0.4064 => 0.4291, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.56% (0.5020 => 0.5299, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.53% (0.9765 => 1.0305, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 5.52% (1.1642 => 1.2285, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.48% (0.3650 => 0.3850, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 5.48% (0.4289 => 0.4524, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/fibo: 5.47% (0.2725 => 0.2874, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.46% (0.3865 => 0.4076, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 5.41% (1.0722 => 1.1302, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.40% (0.2831 => 0.2984, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 5.40% (0.3387 => 0.3570, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.40% (0.4203 => 0.4430, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 5.39% (0.4620 => 0.4869, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.38% (2.0665 => 2.1777, std.dev.: 0.0024) MultiSource/Applications/lua/lua: 5.33% (3.8723 => 4.0788, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.33% (0.3826 => 0.4030, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.33% (0.3136 => 0.3303, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.26% (0.3098 => 0.3261, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.23% (1.1861 => 1.2481, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.22% (0.2756 => 0.2900, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 5.22% (0.3603 => 0.3791, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 5.21% (0.4048 => 0.4259, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.21% (0.3935 => 0.4140, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.20% (0.3232 => 0.3400, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.20% (1.5603 => 1.6414, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/except: 5.19% (0.2871 => 0.3020, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.19% (0.2872 => 0.3021, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.19% (0.3162 => 0.3326, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 5.18% (21.9371 => 23.0739, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ary3: 5.18% (0.3283 => 0.3453, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.17% (0.2802 => 0.2947, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hello: 5.12% (0.2714 => 0.2853, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.11% (0.3441 => 0.3617, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 5.09% (0.4299 => 0.4518, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.08% (0.3052 => 0.3207, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 5.08% (0.3684 => 0.3871, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.07% (0.2603 => 0.2735, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.05% (0.2793 => 0.2934, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 5.03% (0.3180 => 0.3340, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 5.01% (0.2877 => 0.3021, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 4.91% (2.0273 => 2.1269, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary2: 4.82% (0.3379 => 0.3542, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.79% (0.6450 => 0.6759, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 4.65% (0.8921 => 0.9336, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 4.56% (2.2969 => 2.4016, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.55% (1.5859 => 1.6581, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.30% (0.5981 => 0.6238, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.05% (1.4186 => 1.4761, std.dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.98% (2.2024 => 2.2900, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 3.92% (1.1840 => 1.2304, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.75% (14.3668 => 14.9058, std.dev.: 0.0182) MultiSource/Applications/hexxagon/hexxagon: 3.51% (1.2842 => 1.3293, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 3.35% (0.3131 => 0.3236, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.52% (0.8101 => 0.8305, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (3.8922 => 3.9585, std.dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: 1.59% (17.1811 => 17.4543, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.26% (1.1145 => 1.3849, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 9.23% (3.1595 => 3.4512, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 6.70% (1.1396 => 1.2160, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3682, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.56% (3.6395 => 3.7692, std.dev.: 0.0047) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.86% (4.2280 => 4.3490, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.33% (1.7254 => 1.7656, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7988, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.13% (6.5088 => 6.5824, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.09% (9.1159 => 9.2153, std.dev.: 0.0195) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1278, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.19% (0.8651 => 0.1714, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.25% (5.2763 => 3.2583, std.dev.: 0.0129) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.85% (5.3855 => 3.8854, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.49% (5.3526 => 3.8812, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -14.80% (54.1659 => 46.1471, std.dev.: 0.0264) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.11% (2.9384 => 2.6118, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -8.04% (22.1758 => 20.3937, std.dev.: 0.0119) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.99% (1.6925 => 1.4219, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/chomp: -12.03% (1.2373 => 1.0884, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/mandel-2: -10.47% (1.5373 => 1.3764, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.35% (19.9488 => 18.2824, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4788) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.66% (1.8329 => 1.7108, std.dev.: 0.0178) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0144) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7917, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.99% (1.6805 => 1.5966, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5085, std.dev.: 0.0016) MultiSource/Applications/siod/siod: -3.70% (3.2827 => 3.1612, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5053, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.20% (0.4808 => 0.4702, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -2.02% (10.2830 => 10.0755, std.dev.: 0.0157) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.98% (8.6802 => 8.5080, std.dev.: 0.0048) MultiSource/Applications/hexxagon/hexxagon: -1.76% (12.4730 => 12.2533, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6817, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.69% (8.1563 => 8.0188, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4207, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -1.47% (2.5528 => 2.5152, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.66% (0.5229 => 0.5734, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 6.54% (14.9895 => 15.9700, std.dev.: 0.0075) MultiSource/Applications/kimwitu++/kc: 4.91% (14.1553 => 14.8504, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/gs/gs: 5.23% (4.1105 => 4.3254, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.21% (1.1048 => 1.2287, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.81% (7.1582 => 7.5028, std.dev.: 0.0140) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.99% (3.4629 => 3.7049, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.87% (0.6222 => 0.6463, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.70% (0.1485 => 0.1430, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.48% (0.2116 => 0.0667, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 1 12:16:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 1 Oct 2012 14:16:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121001191607.1B9152A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4454?compare_to=4450&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4454, Order: 164949, Start Time: 2012-10-01 17:52:06, End Time: 2012-10-01 19:17:45 To: 4450, Order: 164945, Start Time: 2012-10-01 15:57:32, End Time: 2012-10-01 17:23:06 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 0 (178 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1039 (692 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.01% (2.7527 => 2.7525, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.01% (2.1155 => 2.1153, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.01% (4.9749 => 4.9746, std.dev.: 0.0089) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.13% (2.0176 => 2.4439, std.dev.: 0.0056) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.45% (0.1410 => 0.1642, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 14.89% (0.0826 => 0.0949, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.15% (0.1072 => 0.1213, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 11.50% (0.5818 => 0.6487, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 11.36% (0.5748 => 0.6401, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.18% (0.1413 => 0.1571, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 10.82% (0.7061 => 0.7825, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 10.81% (0.4328 => 0.4796, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 10.76% (0.1013 => 0.1122, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.58% (0.0964 => 0.1066, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.52% (0.1588 => 0.1755, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.41% (3.9660 => 4.3790, std.dev.: 0.0092) MultiSource/Applications/lambda-0_1_3/lambda: 10.30% (0.7038 => 0.7763, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 10.25% (0.2781 => 0.3066, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.23% (0.3899 => 0.4298, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.17% (0.1327 => 0.1462, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.14% (0.2721 => 0.2997, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.98% (0.2596 => 0.2855, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 9.97% (0.4062 => 0.4467, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.96% (0.2782 => 0.3059, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 9.93% (1.3693 => 1.5053, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 9.82% (0.2607 => 0.2863, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 9.74% (0.2690 => 0.2952, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.72% (0.6283 => 0.6894, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 9.70% (0.1062 => 0.1165, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.70% (0.3022 => 0.3315, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.64% (1.2193 => 1.3369, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.61% (0.3485 => 0.3820, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.58% (0.6959 => 0.7626, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.53% (0.2655 => 0.2908, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.51% (1.9828 => 2.1714, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.50% (0.9199 => 1.0073, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 9.49% (13.8202 => 15.1324, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.48% (0.7710 => 0.8441, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.48% (0.5265 => 0.5764, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.43% (0.4791 => 0.5243, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 9.42% (0.2760 => 0.3020, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.41% (0.3580 => 0.3917, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.37% (1.4563 => 1.5927, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.33% (0.2765 => 0.3023, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 9.32% (0.3293 => 0.3600, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 9.32% (0.2628 => 0.2873, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.31% (0.3489 => 0.3814, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 9.31% (0.2761 => 0.3018, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.31% (0.2966 => 0.3242, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.29% (0.3756 => 0.4105, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.27% (0.2696 => 0.2946, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.26% (0.4016 => 0.4388, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 9.26% (0.2937 => 0.3209, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 9.21% (0.2726 => 0.2977, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.18% (1.1364 => 1.2407, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.17% (0.3130 => 0.3417, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.12% (0.6576 => 0.7176, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 9.07% (0.3868 => 0.4219, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 9.05% (0.3192 => 0.3481, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 9.04% (0.3107 => 0.3388, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 8.89% (0.3149 => 0.3429, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 8.87% (0.2988 => 0.3253, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.79% (0.4390 => 0.4776, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 8.76% (1.0313 => 1.1216, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 8.75% (0.3453 => 0.3755, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 8.68% (0.1589 => 0.1727, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.64% (0.1157 => 0.1257, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.64% (0.5577 => 0.6059, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.64% (0.1435 => 0.1559, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.54% (0.1276 => 0.1385, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 8.52% (0.3534 => 0.3835, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 8.25% (0.2995 => 0.3242, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.16% (0.3246 => 0.3511, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 8.14% (1.1061 => 1.1961, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.13% (0.2127 => 0.2300, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 8.13% (3.8646 => 4.1789, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/objinst: 8.12% (0.2945 => 0.3184, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.08% (0.4379 => 0.4733, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.01% (0.1986 => 0.2145, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.96% (0.2914 => 0.3146, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 7.92% (0.8310 => 0.8968, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 7.88% (16.6129 => 17.9219, std.dev.: 0.0262) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.87% (3.6692 => 3.9578, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.79% (0.5637 => 0.6076, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 7.73% (0.2925 => 0.3151, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 7.69% (0.7506 => 0.8083, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.67% (7.2180 => 7.7717, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/18-imp/imp: 7.67% (0.3220 => 0.3467, std.dev.: 0.0022) MultiSource/Applications/d/make_dparser: 7.64% (3.1889 => 3.4326, std.dev.: 0.0056) MultiSource/Applications/minisat/minisat: 7.61% (0.6744 => 0.7257, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 7.60% (2.1791 => 2.3447, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.60% (0.8698 => 0.9359, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/08-main/main: 7.58% (0.2243 => 0.2413, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.55% (0.7460 => 0.8023, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.51% (0.3755 => 0.4037, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.39% (0.1569 => 0.1685, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 7.39% (1.0594 => 1.1377, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.38% (0.3511 => 0.3770, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.32% (0.2023 => 0.2171, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.29% (0.1865 => 0.2001, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 7.21% (1.9270 => 2.0660, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.19% (1.3819 => 1.4812, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.16% (1.3813 => 1.4802, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.00% (1.3245 => 1.4172, std.dev.: 0.0084) SingleSource/UnitTests/ObjC/for-in: 6.99% (0.3789 => 0.4054, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 6.99% (0.3578 => 0.3828, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.94% (0.4003 => 0.4281, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 6.94% (0.1657 => 0.1772, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 6.90% (0.1478 => 0.1580, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.90% (0.3914 => 0.4184, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 6.87% (14.8535 => 15.8735, std.dev.: 0.0089) SingleSource/UnitTests/ObjC/exceptions-4: 6.83% (0.3646 => 0.3895, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 6.80% (0.3601 => 0.3846, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.80% (0.3940 => 0.4208, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 6.77% (0.3663 => 0.3911, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 6.75% (1.2749 => 1.3609, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.71% (0.3650 => 0.3895, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 6.68% (0.3623 => 0.3865, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.65% (0.1789 => 0.1908, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 6.62% (4.6629 => 4.9715, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/bh/bh: 6.61% (0.2859 => 0.3048, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 6.56% (8.4961 => 9.0534, std.dev.: 0.0099) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.49% (0.6135 => 0.6533, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.48% (0.8818 => 0.9389, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.45% (4.3801 => 4.6627, std.dev.: 0.0114) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.44% (4.4433 => 4.7294, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 6.42% (0.3131 => 0.3332, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 6.37% (1.2292 => 1.3075, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 6.32% (0.4113 => 0.4373, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 6.10% (6.5754 => 6.9766, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.10% (1.1333 => 1.2024, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.07% (0.2140 => 0.2270, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 6.02% (14.5298 => 15.4040, std.dev.: 0.0241) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.01% (13.2842 => 14.0824, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.01% (4.9865 => 5.2860, std.dev.: 0.0123) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.90% (0.2321 => 0.2458, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.87% (0.4805 => 0.5087, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 5.86% (0.6250 => 0.6616, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.79% (3.2742 => 3.4637, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.66% (0.1819 => 0.1922, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.58% (0.3245 => 0.3426, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.26% (1.5188 => 1.5987, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 5.07% (3.7467 => 3.9365, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.04% (0.9108 => 0.9567, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.66% (2.1007 => 2.1986, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.37% (6.2785 => 6.5526, std.dev.: 0.0043) MultiSource/Benchmarks/Bullet/bullet: 4.15% (33.2944 => 34.6751, std.dev.: 0.0081) MultiSource/Applications/sqlite3/sqlite3: 2.76% (16.2614 => 16.7110, std.dev.: 0.0219) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5179, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.46% (1.8175 => 2.2621, std.dev.: 0.0109) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.69% (1.1560 => 1.2565, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4138, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.22% (1.2998 => 1.3806, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.64% (1.9144 => 2.0032, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.12% (11.2619 => 11.7257, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9860, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.04% (10.7476 => 11.0748, std.dev.: 0.0625) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.09% (7.4271 => 7.5824, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.56% (1.4298 => 1.4521, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.53% (2.0200 => 2.0509, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5136, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.30% (5.5130 => 5.5847, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9679, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1879, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.13% (12.4560 => 12.5964, std.dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 1.09% (12.0921 => 12.2245, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (2.2986 => 2.3235, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.19% (0.4657 => 0.3903, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.45% (22.5627 => 22.0104, std.dev.: 0.0083) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544) SingleSource/Benchmarks/McGill/chomp: -11.63% (1.2308 => 1.0876, std.dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.12% (20.3410 => 18.2831, std.dev.: 0.0163) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.55% (1.3780 => 1.2878, std.dev.: 0.0181) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.15% (1.9290 => 1.8103, std.dev.: 0.0117) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5141, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7939, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.53% (3.2729 => 3.1573, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.53% (1.7688 => 1.7064, std.dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.02% (0.4867 => 0.4720, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.68% (3.0263 => 2.9451, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4785, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.33% (1.9762 => 1.9302, std.dev.: 0.0008) SingleSource/Regression/C/uint64_to_float: -2.13% (0.5449 => 0.5333, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.86% (6.3560 => 6.2380, std.dev.: 0.0078) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7063, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.82% (0.6589 => 0.6469, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.80% (0.6615 => 0.6496, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.48% (7.3305 => 7.2223, std.dev.: 0.0114) SingleSource/Benchmarks/Misc/ReedSolomon: -1.42% (7.1097 => 7.0084, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2503, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4952, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.18% (3.9173 => 3.8711, std.dev.: 0.0042) MultiSource/Applications/lua/lua: -1.18% (26.5159 => 26.2037, std.dev.: 0.0172) MultiSource/Applications/minisat/minisat: -1.08% (9.3358 => 9.2351, std.dev.: 0.0149) MultiSource/Applications/viterbi/viterbi: -1.03% (4.4810 => 4.4350, std.dev.: 0.0029) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 1 12:18:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 1 Oct 2012 14:18:57 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121001191857.53AF12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4455?compare_to=4451&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4455, Order: 164949, Start Time: 2012-10-01 17:57:21, End Time: 2012-10-01 19:20:38 To: 4451, Order: 164945, Start Time: 2012-10-01 16:17:30, End Time: 2012-10-01 17:41:18 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 3 (69 on baseline) Performance Improvements: 8 (43 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 962 (779 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 8.58% (21.3727 => 23.2057, std.dev.: 0.5643) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.63% (1.4213 => 1.4445, std.dev.: 0.0061) MultiSource/Benchmarks/llubenchmark/llu: 1.58% (1.9946 => 2.0262, std.dev.: 0.0066) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: -1.43% (1.2544 => 1.2365, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: -1.36% (16.3536 => 16.1312, std.dev.: 0.0532) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.27% (4.3556 => 4.3005, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.26% (0.8345 => 0.8240, std.dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -2.43% (1.8686 => 1.8232, std.dev.: 0.0109) MultiSource/Benchmarks/Bullet/bullet: -1.20% (6.9961 => 6.9121, std.dev.: 0.0306) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.07% (1.2625 => 1.2490, std.dev.: 0.0039) MultiSource/Applications/lua/lua: -1.06% (29.1265 => 28.8185, std.dev.: 0.1035) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.69% (1.0152 => 1.0222, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: -0.89% (0.6185 => 0.6130, std.dev.: 0.0085) MultiSource/Benchmarks/McCat/08-main/main: 4.13% (0.1647 => 0.1715, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.72% (0.1567 => 0.1446, std.dev.: 0.0072) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.29% (0.3131 => 0.3140, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.93% (0.2367 => 0.2345, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.87% (0.3209 => 0.3237, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.44% (0.2289 => 0.2279, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel: -19.21% (0.0458 => 0.0370, std.dev.: 0.0036) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0088 => 0.0088, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -2.20% (0.0091 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.24% (0.0242 => 0.0239, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -2.78% (0.0144 => 0.0140, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.02% (0.0392 => 0.0388, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.33% (0.0299 => 0.0300, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.71% (0.0282 => 0.0284, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 31.71% (0.0246 => 0.0324, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0178 => 0.0179, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 42.54% (0.0134 => 0.0191, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0249 => 0.0250, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -7.62% (0.0328 => 0.0303, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -2.06% (0.1455 => 0.1425, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 3.08% (1.4581 => 1.5030, std.dev.: 0.0250) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.20% (0.1508 => 0.1511, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.62% (0.4031 => 0.4006, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.13% (0.1453 => 0.1364, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.39% (0.0557 => 0.0527, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 20.86% (0.0187 => 0.0226, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.46% (0.0630 => 0.0583, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.20% (1.1237 => 1.1260, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -80.00% (0.0015 => 0.0003, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 400.00% (0.0001 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.65% (0.0618 => 0.0622, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.52% (0.0165 => 0.0146, std.dev.: 0.0054) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.10% (0.7661 => 0.7653, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.10% (1.5986 => 1.6002, std.dev.: 0.0039) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.63% (4.1772 => 3.0649, std.dev.: 0.0311) SingleSource/Benchmarks/Shootout-C++/except: 80800.00% (0.0006 => 0.4854, std.dev.: 0.0057) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.74% (0.0745 => 0.0907, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.38% (0.6410 => 0.6947, std.dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: 7.85% (2.1763 => 2.3472, std.dev.: 0.0339) SingleSource/Benchmarks/Misc-C++/bigfib: 7.82% (0.5309 => 0.5724, std.dev.: 0.0050) MultiSource/Applications/minisat/minisat: 6.93% (0.6173 => 0.6601, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.82% (0.2552 => 0.2726, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.28% (0.3582 => 0.3807, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 6.27% (1.0046 => 1.0676, std.dev.: 0.0136) MultiSource/Applications/SIBsim4/SIBsim4: 6.11% (1.1653 => 1.2365, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.79% (0.2106 => 0.2228, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.45% (1.5150 => 1.5976, std.dev.: 0.0039) MultiSource/Applications/kimwitu++/kc: 5.36% (15.3105 => 16.1312, std.dev.: 0.0532) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.17% (0.6069 => 0.6383, std.dev.: 0.0054) MultiSource/Applications/lambda-0_1_3/lambda: 5.15% (0.6915 => 0.7271, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.91% (0.7639 => 0.8014, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/lists: 4.86% (0.2347 => 0.2461, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.82% (0.4880 => 0.5115, std.dev.: 0.0022) MultiSource/Benchmarks/Bullet/bullet: 4.77% (29.3170 => 30.7149, std.dev.: 0.0611) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.43% (0.4248 => 0.4436, std.dev.: 0.0043) MultiSource/Applications/d/make_dparser: 4.40% (3.0225 => 3.1556, std.dev.: 0.0300) MultiSource/Benchmarks/McCat/18-imp/imp: 4.38% (0.3217 => 0.3358, std.dev.: 0.0019) MultiSource/Applications/hbd/hbd: 4.35% (1.3268 => 1.3845, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.08% (0.3901 => 0.4060, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.97% (0.2797 => 0.2908, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.95% (12.6413 => 13.1409, std.dev.: 0.0303) SingleSource/Benchmarks/Shootout-C++/hash2: 3.64% (0.3847 => 0.3987, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.59% (0.3062 => 0.3172, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 3.45% (13.3238 => 13.7841, std.dev.: 0.1214) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.36% (1.2021 => 1.2425, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.31% (0.3418 => 0.3531, std.dev.: 0.0032) MultiSource/Applications/Burg/burg: 3.26% (1.1440 => 1.1813, std.dev.: 0.0102) MultiSource/Benchmarks/mafft/pairlocalalign: 3.18% (8.2186 => 8.4796, std.dev.: 0.0660) MultiSource/Benchmarks/nbench/nbench: 3.08% (1.0821 => 1.1154, std.dev.: 0.0038) MultiSource/Applications/lua/lua: 3.03% (3.5980 => 3.7069, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.97% (1.1827 => 1.2178, std.dev.: 0.0095) MultiSource/Applications/treecc/treecc: 2.94% (1.8798 => 1.9351, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.89% (6.2546 => 6.4355, std.dev.: 0.0168) MultiSource/Applications/ClamAV/clamscan: 2.68% (14.6079 => 14.9992, std.dev.: 0.1291) MultiSource/Applications/JM/lencod/lencod: 2.65% (14.7256 => 15.1154, std.dev.: 0.1311) MultiSource/Benchmarks/Prolangs-C/football/football: 2.58% (0.8405 => 0.8622, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.55% (4.0318 => 4.1346, std.dev.: 0.0084) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.38% (0.8569 => 0.8773, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 1.70% (0.9425 => 0.9585, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.62% (1.0689 => 1.0862, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 47.13% (0.0261 => 0.0384, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/pi: 41.45% (1.6538 => 2.3393, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 22.06% (3.4629 => 4.2268, std.dev.: 0.0587) SingleSource/Benchmarks/Shootout/ary3: 14.62% (1.7426 => 1.9973, std.dev.: 0.0249) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.63% (4.0101 => 4.5567, std.dev.: 0.0798) SingleSource/Benchmarks/McGill/queens: 10.80% (1.6261 => 1.8018, std.dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 9.61% (21.1721 => 23.2057, std.dev.: 0.5643) SingleSource/Benchmarks/Shootout/lists: 8.59% (7.0025 => 7.6038, std.dev.: 0.0673) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.33% (0.2857 => 0.3095, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.42% (0.3301 => 0.3480, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.73% (40.4792 => 42.3955, std.dev.: 0.3223) MultiSource/Benchmarks/Ptrdist/ft/ft: 4.60% (0.8498 => 0.8889, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/fp-convert: 4.55% (15.2242 => 15.9164, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/dt: 4.30% (0.9851 => 1.0275, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.88% (3.4080 => 3.5403, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.90% (0.5587 => 0.5749, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.81% (2.6656 => 2.7404, std.dev.: 0.0254) MultiSource/Applications/hexxagon/hexxagon: 2.80% (14.4877 => 14.8930, std.dev.: 0.0446) MultiSource/Benchmarks/sim/sim: 2.69% (3.8907 => 3.9952, std.dev.: 0.0105) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.42% (2.4042 => 2.4624, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/mason/mason: 2.38% (0.5004 => 0.5123, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.16% (6.6312 => 6.7743, std.dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/dry: 1.89% (2.4013 => 2.4466, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/power/power: 1.45% (1.4184 => 1.4389, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.09% (5.1938 => 5.2504, std.dev.: 0.0187) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.15% (0.3497 => 0.2128, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.57% (5.2665 => 4.0779, std.dev.: 0.1774) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.52% (1.1647 => 0.9606, std.dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.65% (15.8312 => 13.3539, std.dev.: 0.1837) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1587, std.dev.: 0.0127) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2859, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.23% (3.2007 => 2.9372, std.dev.: 0.0639) MultiSource/Applications/lambda-0_1_3/lambda: -7.22% (7.6833 => 7.1285, std.dev.: 0.0181) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.88% (3.6254 => 3.3760, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/fibo: -6.60% (4.6355 => 4.3294, std.dev.: 0.0288) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.52% (2.0027 => 1.8722, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: -6.17% (3.4230 => 3.2118, std.dev.: 0.0396) SingleSource/Benchmarks/Misc/richards_benchmark: -6.02% (1.4441 => 1.3572, std.dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.98% (2.9728 => 2.7950, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -5.59% (62.4126 => 58.9226, std.dev.: 0.0308) MultiSource/Benchmarks/FreeBench/distray/distray: -5.56% (0.2664 => 0.2516, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.47% (3.9413 => 3.7259, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/fib2: -5.28% (4.4195 => 4.1861, std.dev.: 0.0155) MultiSource/Applications/sgefa/sgefa: -4.91% (0.3746 => 0.3562, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.56% (0.4564 => 0.4356, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/bh/bh: -4.32% (2.5166 => 2.4079, std.dev.: 0.0021) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.75% (1.2722 => 1.2245, std.dev.: 0.0039) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.62% (1.2959 => 1.2490, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/methcall: -3.26% (9.2503 => 8.9491, std.dev.: 0.0468) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -2.71% (1.8739 => 1.8232, std.dev.: 0.0109) SingleSource/Benchmarks/Misc/flops: -2.69% (9.5474 => 9.2907, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.55% (3.7496 => 3.6540, std.dev.: 0.0195) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.54% (0.4140 => 0.4035, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/misr: -2.51% (0.4296 => 0.4188, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.50% (1.1683 => 1.1391, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.42% (2.4457 => 2.3866, std.dev.: 0.0205) MultiSource/Applications/lua/lua: -2.39% (29.5232 => 28.8185, std.dev.: 0.1035) MultiSource/Applications/JM/lencod/lencod: -2.24% (6.7458 => 6.5947, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/hash2: -1.91% (3.4876 => 3.4209, std.dev.: 0.0201) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.87% (2.3569 => 2.3129, std.dev.: 0.0138) MultiSource/Benchmarks/FreeBench/neural/neural: -1.67% (1.0926 => 1.0743, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.58% (9.3855 => 9.2371, std.dev.: 0.0228) MultiSource/Benchmarks/PAQ8p/paq8p: -1.51% (92.7467 => 91.3501, std.dev.: 0.4868) SingleSource/Benchmarks/Dhrystone/fldry: -1.49% (2.4971 => 2.4598, std.dev.: 0.0080) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3070, std.dev.: 0.0328) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.31% (27.1724 => 26.8176, std.dev.: 0.0214) SingleSource/Benchmarks/Misc/fbench: -1.17% (3.4659 => 3.4252, std.dev.: 0.0151) MultiSource/Benchmarks/NPB-serial/is/is: -1.01% (13.4743 => 13.3387, std.dev.: 0.0430) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.42% (0.9980 => 1.0222, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 1.79% (0.6022 => 0.6130, std.dev.: 0.0085) MultiSource/Benchmarks/McCat/08-main/main: 2.94% (0.1666 => 0.1715, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.95% (0.1554 => 0.1446, std.dev.: 0.0072) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.85% (0.3083 => 0.3140, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.05% (0.2394 => 0.2345, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.95% (0.3175 => 0.3237, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.00% (0.2302 => 0.2279, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel: -17.59% (0.0449 => 0.0370, std.dev.: 0.0036) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.42% (0.0240 => 0.0239, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -27.08% (0.0192 => 0.0140, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.51% (0.0390 => 0.0388, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.33% (0.0301 => 0.0300, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0284 => 0.0284, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0324 => 0.0324, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 1.13% (0.0177 => 0.0179, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 1.06% (0.0189 => 0.0191, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0249 => 0.0250, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -6.77% (0.0325 => 0.0303, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.28% (0.1429 => 0.1425, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 0.07% (1.5019 => 1.5030, std.dev.: 0.0250) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.67% (0.1501 => 0.1511, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.05% (0.4264 => 0.4006, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.49% (0.1344 => 0.1364, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.53% (0.0589 => 0.0527, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.59% (0.0232 => 0.0226, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.76% (0.0639 => 0.0583, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.79% (1.1350 => 1.1260, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -50.00% (0.0006 => 0.0003, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.35% (0.0637 => 0.0622, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.65% (0.0246 => 0.0146, std.dev.: 0.0054) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.49% (0.7541 => 0.7653, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.16% (1.5363 => 1.6002, std.dev.: 0.0039) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 1 13:36:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 1 Oct 2012 15:36:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121001203626.B0BB92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4456?compare_to=4453&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4456, Order: 164954, Start Time: 2012-10-01 19:17:40, End Time: 2012-10-01 20:38:05 To: 4453, Order: 164946, Start Time: 2012-10-01 17:28:16, End Time: 2012-10-01 18:48:34 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (146 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 92 (18 on baseline) Unchanged Tests: 948 (703 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (14.9123 => 15.1202, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.08% (2.1777 => 2.2013, std.dev.: 0.0005) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.40% (0.5734 => 0.5757, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 0.23% (15.9700 => 16.0068, std.dev.: 0.0093) MultiSource/Applications/kimwitu++/kc: 0.64% (14.8504 => 14.9448, std.dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: -0.00% (83.4419 => 83.4397, std.dev.: 0.2498) MultiSource/Benchmarks/MallocBench/gs/gs: 0.29% (4.3254 => 4.3378, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.88% (0.0457 => 0.0461, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.09% (0.0458 => 0.0463, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.94% (0.0426 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.93% (0.0428 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.96% (0.0416 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.72% (0.0418 => 0.0421, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.98% (0.0410 => 0.0414) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.22% (0.0411 => 0.0416) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.93% (0.0428 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.93% (0.0429 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.95% (0.0422 => 0.0426, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.71% (0.0424 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.73% (0.0412 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.72% (0.0414 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.95% (0.0419 => 0.0423, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.19% (0.0420 => 0.0425) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.93% (0.0431 => 0.0435, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.75% (0.0453 => 0.0436, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.74% (0.0408 => 0.0411) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.98% (0.0408 => 0.0412, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.95% (0.0419 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.19% (0.0420 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.97% (0.0411 => 0.0415) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.97% (0.0412 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.99% (0.0403 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.99% (0.0403 => 0.0407, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.00% (0.0401 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.99% (0.0403 => 0.0407) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.91% (0.0439 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.91% (0.0440 => 0.0444, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.00% (0.0400 => 0.0404, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.00% (0.0401 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.75% (0.0402 => 0.0405) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.74% (0.0403 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.98% (0.0409 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.98% (0.0410 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.18% (1.2287 => 1.2309, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.84% (7.5028 => 7.5658, std.dev.: 0.0130) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.71% (3.7049 => 3.7312, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.82% (0.6463 => 0.6516, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1430 => 0.1431) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.15% (0.0667 => 0.0646, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: 31.93% (63.2438 => 83.4397, std.dev.: 0.2498) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14237.36% (0.0720 => 10.3229, std.dev.: 0.0108) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 45.85% (10.3673 => 15.1202, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/richards_benchmark: 29.04% (0.1622 => 0.2093, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.87% (2.2022 => 2.5297, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.75% (0.0834 => 0.0957, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 14.46% (0.1432 => 0.1639, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.40% (7.0540 => 8.0697, std.dev.: 0.0311) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.84% (1.1194 => 1.2631, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.64% (0.1566 => 0.1764, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.81% (1.7609 => 1.9689, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.78% (0.3543 => 0.3925, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.37% (0.3473 => 0.3833, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.10% (0.3516 => 0.3871, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.09% (0.3497 => 0.3850, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.08% (0.3561 => 0.3920, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.08% (0.3543 => 0.3900, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 9.78% (0.3282 => 0.3603, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.77% (0.3694 => 0.4055, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.61% (0.3828 => 0.4196, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.60% (0.1584 => 0.1736, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.57% (0.3927 => 0.4303, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.42% (0.3886 => 0.4252, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 8.97% (10.4361 => 11.3720, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.34% (0.4879 => 0.5286, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 8.16% (0.6030 => 0.6522, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.14% (0.5925 => 0.6407, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/power/power: 8.06% (0.1440 => 0.1556, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.03% (0.3177 => 0.3432, std.dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 7.92% (9.4845 => 10.2358, std.dev.: 0.0076) SingleSource/Benchmarks/McGill/chomp: 7.79% (0.1655 => 0.1784, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 7.69% (5.7591 => 6.2020, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.63% (0.6675 => 0.7184, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 7.59% (0.7115 => 0.7655, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.44% (0.1438 => 0.1545, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 7.41% (0.7433 => 0.7984, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference: 7.38% (0.7326 => 0.7867, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.26% (0.2891 => 0.3101, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.26% (0.2700 => 0.2896, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.19% (0.5105 => 0.5472, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 7.19% (0.3422 => 0.3668, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 7.10% (3.3354 => 3.5723, std.dev.: 0.0112) MultiSource/Applications/sgefa/sgefa: 7.01% (0.3109 => 0.3327, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.89% (0.1625 => 0.1737, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.87% (0.4103 => 0.4385, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hello: 6.85% (0.2714 => 0.2900, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.85% (0.2905 => 0.3104, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.83% (0.3307 => 0.3533, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.83% (0.2271 => 0.2426, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 6.81% (0.4289 => 0.4581, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 6.79% (0.2725 => 0.2910, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.78% (0.4615 => 0.4928, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.77% (0.4636 => 0.4950, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.77% (1.5415 => 1.6458, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/18-imp/imp: 6.75% (0.3423 => 0.3654, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.75% (0.2831 => 0.3022, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.74% (0.4064 => 0.4338, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.70% (1.3050 => 1.3924, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.68% (0.2756 => 0.2940, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.67% (0.3162 => 0.3373, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 6.66% (0.2554 => 0.2724, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.61% (4.2646 => 4.5465, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/em3d/em3d: 6.61% (0.1695 => 0.1807, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.57% (0.5860 => 0.6245, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.52% (2.0665 => 2.2013, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.52% (0.4203 => 0.4477, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.52% (0.3283 => 0.3497, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.52% (8.1363 => 8.6664, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.51% (0.3136 => 0.3340, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 6.49% (0.3603 => 0.3837, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.49% (0.3865 => 0.4116, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.46% (5.0018 => 5.3250, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.44% (0.2065 => 0.2198, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.44% (0.3650 => 0.3885, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.44% (0.3232 => 0.3440, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.42% (0.3098 => 0.3297, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.42% (0.3052 => 0.3248, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.41% (0.2793 => 0.2972, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.41% (0.2872 => 0.3056, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.39% (0.5569 => 0.5925, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.34% (4.9449 => 5.2584, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/random: 6.32% (0.2802 => 0.2979, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.29% (0.2877 => 0.3058, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 6.29% (0.6456 => 0.6862, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.27% (0.3826 => 0.4066, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 6.23% (0.4048 => 0.4300, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.21% (0.4620 => 0.4907, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.20% (7.9617 => 8.4556, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary2: 6.16% (0.3379 => 0.3587, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.14% (0.8067 => 0.8562, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.13% (0.8172 => 0.8673, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.12% (0.2107 => 0.2236, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 6.03% (0.3684 => 0.3906, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.02% (0.3121 => 0.3309, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.02% (0.3935 => 0.4172, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.02% (0.2758 => 0.2924, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: 5.95% (0.3092 => 0.3276, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.92% (0.1892 => 0.2004, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.92% (0.5020 => 0.5317, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 5.91% (0.7835 => 0.8298, std.dev.: 0.0026) MultiSource/Applications/hbd/hbd: 5.90% (1.5603 => 1.6523, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 5.83% (1.1642 => 1.2321, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.82% (0.1940 => 0.2053, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 5.79% (0.3387 => 0.3583, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.76% (0.9765 => 1.0327, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 5.68% (3.8723 => 4.0924, std.dev.: 0.0148) MultiSource/Applications/lemon/lemon: 5.57% (1.0722 => 1.1319, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.56% (1.1861 => 1.2521, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 5.44% (21.9371 => 23.1313, std.dev.: 0.0176) MultiSource/Benchmarks/McCat/09-vor/vor: 5.44% (0.3180 => 0.3353, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 5.35% (2.0273 => 2.1357, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.26% (0.3441 => 0.3622, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.22% (0.2603 => 0.2739, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 5.02% (0.4299 => 0.4515, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.91% (0.6450 => 0.6767, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 4.77% (2.2969 => 2.4065, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 4.76% (0.3131 => 0.3280, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 4.74% (0.8921 => 0.9344, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.57% (1.5859 => 1.6584, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.51% (0.5981 => 0.6251, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 4.39% (1.2842 => 1.3406, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.26% (1.4186 => 1.4790, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.20% (14.3668 => 14.9708, std.dev.: 0.0160) MultiSource/Benchmarks/nbench/nbench: 3.99% (1.1840 => 1.2312, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.94% (2.2024 => 2.2891, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.07% (0.8101 => 0.8350, std.dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: 1.85% (17.1811 => 17.4983, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.71% (3.8922 => 3.9588, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4498, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (3.1578 => 3.3678, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/richards_benchmark: 6.56% (1.1396 => 1.2144, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.74% (3.6395 => 3.7756, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.78% (4.2280 => 4.3456, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.34% (1.7254 => 1.7658, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7988, std.dev.: 0.0067) MultiSource/Applications/minisat/minisat: 1.19% (9.1159 => 9.2241, std.dev.: 0.0119) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.01% (6.5088 => 6.5745, std.dev.: 0.0070) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1279, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.19% (0.8651 => 0.1714, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.19% (5.2763 => 3.2612, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.28% (5.3855 => 3.9165, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -26.89% (5.3526 => 3.9132, std.dev.: 0.0019) SingleSource/UnitTests/Vector/constpool: -14.89% (54.1659 => 46.1028, std.dev.: 0.0271) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.97% (2.9384 => 2.6160, std.dev.: 0.0086) MultiSource/Applications/ClamAV/clamscan: -7.84% (22.1758 => 20.4371, std.dev.: 0.0076) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4247, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -12.08% (1.2373 => 1.0878, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/mandel-2: -10.21% (1.5373 => 1.3803, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.31% (19.9488 => 18.2905, std.dev.: 0.0918) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4787, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.70% (1.8329 => 1.7101, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5753, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7916) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.96% (1.6805 => 1.5972, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -4.93% (1.5835 => 1.5055, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.70% (3.2827 => 3.1613, std.dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4966, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.41% (0.4808 => 0.4692, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.97% (8.6802 => 8.5088, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/salsa20: -1.90% (10.2830 => 10.0872, std.dev.: 0.0238) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.75% (8.1563 => 8.0132, std.dev.: 0.0071) MultiSource/Applications/hexxagon/hexxagon: -1.75% (12.4730 => 12.2543, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6820, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.51% (2.5528 => 2.5142, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4222, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/lists: -1.11% (6.2999 => 6.2299, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.10% (0.5229 => 0.5757, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 6.79% (14.9895 => 16.0068, std.dev.: 0.0093) MultiSource/Applications/kimwitu++/kc: 5.58% (14.1553 => 14.9448, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 5.53% (4.1105 => 4.3378, std.dev.: 0.0097) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.41% (1.1048 => 1.2309, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.69% (7.1582 => 7.5658, std.dev.: 0.0130) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.75% (3.4629 => 3.7312, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.73% (0.6222 => 0.6516, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.47% (0.2116 => 0.0646, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 1 15:24:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 1 Oct 2012 17:24:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121001222408.952C72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4457?compare_to=4452&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4457, Order: 164954, Start Time: 2012-10-01 19:15:40, End Time: 2012-10-01 22:25:47 To: 4452, Order: 164943, Start Time: 2012-10-01 15:31:50, End Time: 2012-10-01 18:42:21 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 1 (127 on baseline) Performance Improvements: 0 (15 on baseline) Added Tests: 0 (131 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1038 (766 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.49% (54.1215 => 54.9274, std.dev.: 0.0062) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.03% (9.8091 => 9.8124, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.01% (9.4112 => 9.4122, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.03% (16.9558 => 16.9511, std.dev.: 0.0032) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.19% (0.1063 => 0.1182, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 10.09% (1.5932 => 1.7540, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.06% (0.3488 => 0.3839, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.04% (0.3465 => 0.3813, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.01% (0.3496 => 0.3846, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 9.99% (0.3442 => 0.3786, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 9.98% (0.3446 => 0.3790, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-3: 9.91% (0.3460 => 0.3803, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.89% (0.3469 => 0.3812, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 9.67% (0.3650 => 0.4003, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 9.61% (0.3643 => 0.3993, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.40% (0.3724 => 0.4074, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.34% (0.5826 => 0.6312, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.20% (0.5889 => 0.6372, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.07% (0.2875 => 0.3107, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 7.91% (0.1619 => 0.1747, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.66% (0.3004 => 0.3234, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.60% (0.2738 => 0.2946, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 7.53% (0.1421 => 0.1528, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.49% (0.2725 => 0.2929, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.47% (0.1620 => 0.1741, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.46% (0.2803 => 0.3012, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.38% (0.2750 => 0.2953, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.37% (0.2729 => 0.2930, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 7.33% (0.2823 => 0.3030, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 7.33% (0.2714 => 0.2913, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.32% (0.2813 => 0.3019, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.31% (2.0673 => 2.2184, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.30% (0.9909 => 1.0632, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.29% (0.3195 => 0.3428, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 7.19% (0.2780 => 0.2980, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.13% (0.2792 => 0.2991, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.09% (0.3060 => 0.3277, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 7.06% (0.7171 => 0.7677, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/wc: 7.01% (0.3096 => 0.3313, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 7.01% (0.2811 => 0.3008, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.97% (0.2911 => 0.3114, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.95% (0.3267 => 0.3494, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.91% (0.3258 => 0.3483, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.81% (0.3362 => 0.3591, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.72% (0.3124 => 0.3334, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 6.72% (0.3348 => 0.3573, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 6.72% (0.3678 => 0.3925, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.69% (0.3317 => 0.3539, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.68% (1.3152 => 1.4031, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.59% (1.6211 => 1.7280, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.59% (0.3625 => 0.3864, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.58% (0.3282 => 0.3498, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.54% (0.4146 => 0.4417, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.33% (0.3477 => 0.3697, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.28% (0.4361 => 0.4635, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.26% (3.5627 => 3.7856, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.23% (0.4994 => 0.5305, std.dev.: 0.0024) MultiSource/Applications/d/make_dparser: 6.15% (1.0781 => 1.1444, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.13% (0.5026 => 0.5334, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.11% (0.3845 => 0.4080, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 6.08% (5.5417 => 5.8789, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/hash2: 6.07% (0.4251 => 0.4509, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.04% (0.3690 => 0.3913, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.04% (0.5000 => 0.5302, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.93% (0.3981 => 0.4217, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 5.91% (23.5202 => 24.9099, std.dev.: 0.0165) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.79% (2.7292 => 2.8872, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.65% (0.2866 => 0.3028, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.61% (4.4195 => 4.6676, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.61% (0.2014 => 0.2127, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.60% (0.3930 => 0.4150, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.39% (0.5900 => 0.6218, std.dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 5.36% (4.2109 => 4.4368, std.dev.: 0.0128) MultiSource/Applications/spiff/spiff: 5.36% (0.4029 => 0.4245, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 5.34% (0.2566 => 0.2703, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.34% (0.2736 => 0.2882, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 5.33% (0.5012 => 0.5279, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.31% (0.6435 => 0.6777, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 5.30% (0.2075 => 0.2185, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.29% (0.4139 => 0.4358, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 5.29% (1.8794 => 1.9788, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.13% (0.2068 => 0.2174, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.04% (0.2737 => 0.2875, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.02% (0.3903 => 0.4099, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 4.98% (2.1013 => 2.2059, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.88% (0.3890 => 0.4080, std.dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: 4.86% (4.6177 => 4.8420, std.dev.: 0.0017) MultiSource/Applications/lua/lua: 4.81% (1.4269 => 1.4955, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 4.73% (0.6634 => 0.6948, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.64% (0.4658 => 0.4874, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 4.60% (2.1653 => 2.2650, std.dev.: 0.0026) MultiSource/Applications/Burg/burg: 4.56% (0.5546 => 0.5799, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 4.55% (0.9697 => 1.0138, std.dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 4.53% (0.2691 => 0.2813, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 4.53% (0.3336 => 0.3487, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.43% (0.3271 => 0.3416, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.43% (1.9694 => 2.0566, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.36% (0.7875 => 0.8218, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.33% (0.4253 => 0.4437, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 4.29% (2.0346 => 2.1218, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.21% (0.2969 => 0.3094, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.05% (1.9966 => 2.0775, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: 3.82% (0.4847 => 0.5032, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.49% (0.7426 => 0.7685, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.19% (0.5361 => 0.5532, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.97% (0.5584 => 0.5750, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.97% (11.6398 => 11.9856, std.dev.: 0.0153) MultiSource/Applications/lambda-0_1_3/lambda: 2.94% (0.3498 => 0.3601, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.88% (4.6926 => 4.8278, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 1.84% (11.9555 => 12.1755, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6111, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6745, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-2: 4.75% (1.8057 => 1.8915, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1695, std.dev.: 0.1461) SingleSource/Benchmarks/Dhrystone/dry: 4.13% (14.0481 => 14.6276, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1918, std.dev.: 0.0434) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5041, std.dev.: 0.0095) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.76% (41.7953 => 42.5320, std.dev.: 0.0607) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.51% (3.1722 => 3.2202, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2878, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5399, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5894, std.dev.: 0.0221) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.85% (25.4195 => 16.5609, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary2: -8.66% (0.2402 => 0.2194, std.dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9780, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8018, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9575, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417) SingleSource/UnitTests/Vector/build2: -3.57% (11.2080 => 10.8081, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std.dev.: 0.0034) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7744, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188) SingleSource/Benchmarks/Dhrystone/fldry: -2.79% (17.2379 => 16.7578, std.dev.: 0.0900) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.69% (10.7630 => 10.5810, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4983, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0422, std.dev.: 0.0023) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 1 15:36:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 1 Oct 2012 17:36:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121001223633.6C43B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4458?compare_to=4454&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4458, Order: 164968, Start Time: 2012-10-01 21:12:38, End Time: 2012-10-01 22:38:09 To: 4454, Order: 164949, Start Time: 2012-10-01 17:52:06, End Time: 2012-10-01 19:17:45 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 2 (175 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1037 (696 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.13% (41.6667 => 42.5560, std.dev.: 0.0247) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.53% (1.2878 => 1.3075, std.dev.: 0.0067) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.01% (2.7525 => 2.7522, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (2.1153 => 2.1153, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.01% (4.9746 => 4.9750, std.dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.17% (2.0176 => 2.4448, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.24% (0.1410 => 0.1639, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 14.41% (0.0826 => 0.0945, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.92% (0.0819 => 0.0933, std.dev.: 0.0012) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.85% (0.1072 => 0.1199, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 11.65% (0.5818 => 0.6496, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 11.57% (0.5748 => 0.6413, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 10.91% (0.4328 => 0.4800, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 10.88% (0.7061 => 0.7829, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 10.75% (0.2781 => 0.3080) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.69% (0.1413 => 0.1564, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.64% (0.1588 => 0.1757, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 10.58% (1.3693 => 1.5142, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 10.46% (0.1013 => 0.1119, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.46% (0.2782 => 0.3073, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 10.44% (0.4062 => 0.4486, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.18% (0.2721 => 0.2998, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.11% (3.9660 => 4.3668, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.03% (0.3899 => 0.4290, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 9.93% (0.7038 => 0.7737, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 9.93% (0.2628 => 0.2889, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 9.90% (0.2607 => 0.2865, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.83% (0.2655 => 0.2916, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.83% (0.3022 => 0.3319, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.81% (1.9828 => 2.1773, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 9.78% (0.2690 => 0.2953, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 9.77% (0.2937 => 0.3224, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.72% (0.1327 => 0.1456, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.67% (0.3485 => 0.3822, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.66% (0.2765 => 0.3032, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 9.64% (0.2760 => 0.3026, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/methcall: 9.63% (0.2761 => 0.3027, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.63% (0.6283 => 0.6888, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.60% (0.3489 => 0.3824, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.59% (0.2596 => 0.2845, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 9.57% (0.2726 => 0.2987, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.56% (0.4016 => 0.4400, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.56% (0.3756 => 0.4115, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.53% (0.3580 => 0.3921, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.51% (0.2966 => 0.3248, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.50% (0.2696 => 0.2952, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 9.46% (0.3107 => 0.3401, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 9.44% (0.3293 => 0.3604, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 9.34% (0.3149 => 0.3443, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.30% (0.7710 => 0.8427, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.28% (1.2193 => 1.3324, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.27% (0.4791 => 0.5235, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.18% (0.6959 => 0.7598, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 9.17% (0.2988 => 0.3262, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 9.15% (0.3868 => 0.4222, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 9.15% (0.3453 => 0.3769, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 9.15% (0.3192 => 0.3484, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.13% (0.4390 => 0.4791, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.08% (0.5265 => 0.5743, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.08% (0.9199 => 1.0034, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.02% (1.1364 => 1.2389, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.92% (1.4563 => 1.5862, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.85% (0.3130 => 0.3407, std.dev.: 0.0101) MultiSource/Applications/SPASS/SPASS: 8.83% (13.8202 => 15.0406, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: 8.81% (0.1589 => 0.1729, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 8.77% (0.3534 => 0.3844, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.73% (0.6576 => 0.7150, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.50% (0.1435 => 0.1557, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 8.48% (0.2995 => 0.3249, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 8.41% (1.0313 => 1.1180, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 8.35% (0.2945 => 0.3191, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.04% (0.3246 => 0.3507, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.03% (0.5577 => 0.6025, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.99% (0.1276 => 0.1378) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.86% (0.4379 => 0.4723, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: 7.78% (1.1061 => 1.1922, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.76% (0.2127 => 0.2292, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.75% (0.3755 => 0.4046, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 7.71% (3.8646 => 4.1626, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.68% (0.8698 => 0.9366, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.66% (3.6692 => 3.9502, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 7.65% (16.6129 => 17.8832, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/football/football: 7.63% (0.8310 => 0.8944, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.55% (0.1986 => 0.2136, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.55% (0.2914 => 0.3134, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.54% (0.5637 => 0.6062, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 7.41% (0.6744 => 0.7244, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.39% (0.7460 => 0.8011, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/09-vor/vor: 7.32% (0.2925 => 0.3139, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 7.29% (3.1889 => 3.4213, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.27% (1.3819 => 1.4824, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.26% (1.3813 => 1.4816, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 7.24% (1.0594 => 1.1361, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.23% (7.2180 => 7.7398, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/18-imp/imp: 7.20% (0.3220 => 0.3452, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 7.13% (0.2243 => 0.2403, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 7.10% (0.7506 => 0.8039, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 7.05% (2.1791 => 2.3327, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.01% (0.1569 => 0.1679, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.98% (4.6629 => 4.9885, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.97% (0.2023 => 0.2164, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 6.87% (1.9270 => 2.0594, std.dev.: 0.0093) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.81% (0.1865 => 0.1992, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.69% (0.3511 => 0.3746, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.65% (0.1819 => 0.1940, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.65% (0.1789 => 0.1908) MultiSource/Applications/SIBsim4/SIBsim4: 6.64% (1.2749 => 1.3596, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.61% (1.3245 => 1.4120, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.58% (0.8818 => 0.9398, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 6.56% (14.8535 => 15.8278, std.dev.: 0.0117) MultiSource/Benchmarks/Olden/em3d/em3d: 6.52% (0.1657 => 0.1765, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 6.50% (1.2292 => 1.3091, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 6.46% (8.4961 => 9.0453, std.dev.: 0.0128) MultiSource/Benchmarks/McCat/05-eks/eks: 6.35% (0.4113 => 0.4374, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.28% (4.3801 => 4.6550, std.dev.: 0.0120) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.21% (4.4433 => 4.7192, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 6.16% (0.2859 => 0.3035, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.08% (0.6135 => 0.6508, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.05% (0.4003 => 0.4245, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 6.04% (0.3131 => 0.3320, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 5.98% (0.3914 => 0.4148, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.96% (1.1333 => 1.2008, std.dev.: 0.0081) SingleSource/UnitTests/ObjC/trivial-interface: 5.95% (0.3578 => 0.3791, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.93% (0.2140 => 0.2267, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 5.89% (6.5754 => 6.9630, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 5.86% (0.3789 => 0.4011, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 5.84% (0.6250 => 0.6615, std.dev.: 0.0047) MultiSource/Applications/ClamAV/clamscan: 5.83% (14.5298 => 15.3763, std.dev.: 0.0072) SingleSource/UnitTests/ObjC/exceptions-4: 5.81% (0.3646 => 0.3858, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 5.81% (0.3940 => 0.4169, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.79% (0.2504 => 0.2649, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 5.73% (0.3663 => 0.3873, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.73% (0.3245 => 0.3431, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 5.72% (0.3601 => 0.3807, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.71% (3.2742 => 3.4613, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.63% (13.2842 => 14.0318, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.62% (0.4805 => 0.5075, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.62% (0.3650 => 0.3855, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 5.60% (0.3623 => 0.3826, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.56% (0.2321 => 0.2450, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.54% (4.9865 => 5.2626, std.dev.: 0.0220) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.36% (0.9108 => 0.9596, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.04% (1.5188 => 1.5953, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 4.54% (3.7467 => 3.9169, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 4.41% (33.2944 => 34.7617, std.dev.: 0.0149) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.28% (2.1007 => 2.1907, std.dev.: 0.0075) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.11% (6.2785 => 6.5366, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: 2.28% (16.2614 => 16.6317, std.dev.: 0.0141) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5179, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 25.09% (1.8175 => 2.2736, std.dev.: 0.0452) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.06% (1.0895 => 1.3625, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.75% (1.1560 => 1.2571, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.70% (0.1322 => 0.1437, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4142, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.18% (1.2998 => 1.3801, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9999, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626) SingleSource/Benchmarks/Misc/flops-5: 4.77% (1.9144 => 2.0057, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.11% (11.2619 => 11.7243, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9855, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 3.39% (10.7476 => 11.1119, std.dev.: 0.0322) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.22% (7.4271 => 7.5917, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.56% (1.4298 => 1.4521, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5143, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 1.27% (5.5130 => 5.5829, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1860, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 1.11% (12.4560 => 12.5943, std.dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: 1.11% (12.0921 => 12.2261, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (2.2986 => 2.3232, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.99% (0.4657 => 0.3866, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.63% (22.5627 => 21.9683, std.dev.: 0.0134) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.50% (1.2308 => 1.0893, std.dev.: 0.0342) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.11% (20.3410 => 18.2854, std.dev.: 0.0178) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.12% (1.3780 => 1.3075, std.dev.: 0.0067) SingleSource/UnitTests/Vector/multiplies: -5.09% (2.6470 => 2.5124, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7941, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.50% (3.2729 => 3.1582, std.dev.: 0.0246) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.37% (1.7688 => 1.7092, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.10% (0.4867 => 0.4716, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -2.78% (3.0263 => 2.9421, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4787, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.34% (1.9762 => 1.9299, std.dev.: 0.0010) SingleSource/Regression/C/uint64_to_float: -2.11% (0.5449 => 0.5334, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.85% (6.3560 => 6.2386, std.dev.: 0.0063) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7039, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.80% (0.6615 => 0.6496, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.70% (0.6589 => 0.6477, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.55% (7.3305 => 7.2169, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0068, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8657, std.dev.: 0.0020) MultiSource/Applications/lua/lua: -1.28% (26.5159 => 26.1778, std.dev.: 0.0345) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2508, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4955, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.05% (6.6320 => 6.5623, std.dev.: 0.0080) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 1 15:39:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 1 Oct 2012 17:39:44 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121001223944.3AB2C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4459?compare_to=4455&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4459, Order: 164969, Start Time: 2012-10-01 21:18:02, End Time: 2012-10-01 22:41:24 To: 4455, Order: 164949, Start Time: 2012-10-01 17:57:21, End Time: 2012-10-01 19:20:38 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 11 (74 on baseline) Performance Improvements: 3 (47 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 959 (770 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 5.10% (8.5353 => 8.9704, std.dev.: 0.0568) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.83% (0.8931 => 0.9094, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.44% (0.8585 => 0.8709, std.dev.: 0.0027) MultiSource/Benchmarks/PAQ8p/paq8p: 1.38% (2.3472 => 2.3796, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.26% (0.7945 => 0.8045, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.17% (0.8548 => 0.8648, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 1.06% (13.7841 => 13.9306, std.dev.: 0.0228) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 2.60% (1.9973 => 2.0492, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/hash: 1.70% (0.6415 => 0.6524, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.39% (4.4742 => 4.5362, std.dev.: 0.0166) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.23% (4.6688 => 4.7264, std.dev.: 0.0092) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.71% (1.4246 => 1.4002, std.dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -1.48% (44.4840 => 43.8245, std.dev.: 0.0805) MultiSource/Benchmarks/llubenchmark/llu: -1.39% (2.0262 => 1.9981, std.dev.: 0.0015) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.46% (1.0222 => 1.0269, std.dev.: 0.0086) MultiSource/Applications/sqlite3/sqlite3: -0.15% (0.6130 => 0.6121, std.dev.: 0.0104) MultiSource/Benchmarks/McCat/08-main/main: -2.62% (0.1715 => 0.1670, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.33% (0.1446 => 0.1523, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.42% (0.3140 => 0.3064, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.66% (0.2345 => 0.2384, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.67% (0.3237 => 0.3183, std.dev.: 0.0130) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.01% (0.2279 => 0.2302, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel: 22.97% (0.0370 => 0.0455, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0088 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: 3.37% (0.0089 => 0.0092, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.42% (0.0239 => 0.0240, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 39.29% (0.0140 => 0.0195, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.52% (0.0388 => 0.0390, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.67% (0.0300 => 0.0302, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.87% (0.0284 => 0.0273, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.31% (0.0324 => 0.0323, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: 1.12% (0.0179 => 0.0181, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -4.71% (0.0191 => 0.0182, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.20% (0.0250 => 0.0237, std.dev.: 0.0009) SingleSource/UnitTests/byval-alignment: 5.94% (0.0303 => 0.0321, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 1.96% (0.1425 => 0.1453, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 2.06% (1.5030 => 1.5340, std.dev.: 0.0141) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -4.04% (0.1511 => 0.1450, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.87% (0.4006 => 0.4041, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.57% (0.1364 => 0.1440, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.06% (0.0527 => 0.0580, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -18.58% (0.0226 => 0.0184, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.98% (0.0583 => 0.0647, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.50% (1.1260 => 1.1316, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 466.67% (0.0003 => 0.0017, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.88% (0.0622 => 0.0573, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 38.36% (0.0146 => 0.0202, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.47% (0.7653 => 0.7689, std.dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: -0.53% (1.6002 => 1.5917, std.dev.: 0.0057) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.16% (4.1772 => 3.0843, std.dev.: 0.0262) SingleSource/Benchmarks/Shootout-C++/except: 82516.67% (0.0006 => 0.4957, std.dev.: 0.0143) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/exception_spec_test: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006, std.dev.: 0.0001) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.68% (0.0745 => 0.0914, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 9.34% (2.1763 => 2.3796, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: 8.42% (0.5309 => 0.5756, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.42% (0.1414 => 0.1533, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.43% (0.6410 => 0.6886, std.dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 6.90% (1.1653 => 1.2457, std.dev.: 0.0094) MultiSource/Applications/lemon/lemon: 6.71% (1.0046 => 1.0720, std.dev.: 0.0042) MultiSource/Applications/minisat/minisat: 6.40% (0.6173 => 0.6568, std.dev.: 0.0034) MultiSource/Applications/kimwitu++/kc: 5.49% (15.3105 => 16.1512, std.dev.: 0.0866) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.49% (0.2552 => 0.2692, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.30% (0.3582 => 0.3772, std.dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 5.26% (0.6915 => 0.7279, std.dev.: 0.0114) MultiSource/Applications/d/make_dparser: 4.85% (3.0225 => 3.1690, std.dev.: 0.0259) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.58% (0.7639 => 0.7989, std.dev.: 0.0081) MultiSource/Applications/SPASS/SPASS: 4.55% (13.3238 => 13.9306, std.dev.: 0.0228) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.53% (0.4880 => 0.5101, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.43% (0.3901 => 0.4074, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/lists: 4.43% (0.2347 => 0.2451, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.28% (12.6413 => 13.1826, std.dev.: 0.0650) MultiSource/Benchmarks/Bullet/bullet: 4.10% (29.3170 => 30.5191, std.dev.: 0.1215) MultiSource/Applications/Burg/burg: 4.09% (1.1440 => 1.1908, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 4.03% (3.5980 => 3.7430, std.dev.: 0.0348) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.93% (0.4248 => 0.4415, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.83% (0.2797 => 0.2904, std.dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 3.78% (4.7455 => 4.9249, std.dev.: 0.0357) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.76% (1.5150 => 1.5720, std.dev.: 0.0128) MultiSource/Applications/JM/lencod/lencod: 3.53% (14.7256 => 15.2458, std.dev.: 0.0208) MultiSource/Applications/siod/siod: 3.48% (2.0972 => 2.1702, std.dev.: 0.0180) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.28% (1.1672 => 1.2055, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.27% (0.8569 => 0.8849, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.23% (1.2021 => 1.2409, std.dev.: 0.0059) MultiSource/Applications/ClamAV/clamscan: 3.21% (14.6079 => 15.0767, std.dev.: 0.0893) MultiSource/Applications/treecc/treecc: 3.20% (1.8798 => 1.9399, std.dev.: 0.0192) MultiSource/Applications/JM/ldecod/ldecod: 3.19% (6.4908 => 6.6980, std.dev.: 0.0424) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.15% (1.1827 => 1.2199, std.dev.: 0.0087) MultiSource/Benchmarks/mafft/pairlocalalign: 2.89% (8.2186 => 8.4560, std.dev.: 0.0490) MultiSource/Benchmarks/nbench/nbench: 2.87% (1.0821 => 1.1132, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.84% (1.4408 => 1.4817, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/football/football: 2.69% (0.8405 => 0.8631, std.dev.: 0.0036) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.67% (6.2546 => 6.4219, std.dev.: 0.0296) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.21% (0.7226 => 0.7386, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.17% (1.4113 => 1.4419, std.dev.: 0.0066) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.87% (4.2616 => 4.3412, std.dev.: 0.0136) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.36% (4.3380 => 4.3971, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.35% (1.2742 => 1.2914, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.11% (1.4189 => 1.4347, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 42.59% (0.0263 => 0.0375, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/pi: 41.39% (1.6538 => 2.3383, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 39.46% (0.0261 => 0.0364, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: 22.32% (3.4629 => 4.2359, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout/ary3: 17.59% (1.7426 => 2.0492, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.59% (4.0101 => 4.5550, std.dev.: 0.0169) SingleSource/Benchmarks/Stanford/Puzzle: 12.70% (0.1433 => 0.1615, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/queens: 10.80% (1.6261 => 1.8018, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout/lists: 9.21% (7.0025 => 7.6477, std.dev.: 0.0501) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.68% (0.2857 => 0.3105, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.39% (1.0063 => 1.0907, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.33% (0.3301 => 0.3510, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: 4.58% (15.2242 => 15.9209, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/dt: 4.18% (0.9851 => 1.0263, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.92% (3.4080 => 3.5416, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 3.42% (0.6308 => 0.6524, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.02% (0.5587 => 0.5756, std.dev.: 0.0030) MultiSource/Benchmarks/sim/sim: 2.92% (3.8907 => 4.0042, std.dev.: 0.0134) MultiSource/Applications/hexxagon/hexxagon: 2.81% (14.4877 => 14.8941, std.dev.: 0.1451) MultiSource/Applications/siod/siod: 2.78% (3.5520 => 3.6506, std.dev.: 0.0132) SingleSource/Benchmarks/Dhrystone/dry: 2.73% (2.4013 => 2.4668, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.46% (4.6127 => 4.7264, std.dev.: 0.0092) MultiSource/Benchmarks/FreeBench/mason/mason: 2.42% (0.5004 => 0.5125, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.22% (2.6656 => 2.7247, std.dev.: 0.0191) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.18% (6.6312 => 6.7756, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/power/power: 1.49% (1.4184 => 1.4395, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.39% (2.4042 => 2.4376, std.dev.: 0.0103) MultiSource/Benchmarks/Olden/em3d/em3d: 1.00% (4.6414 => 4.6879, std.dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.00% (0.2080 => 0.1976, std.dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.18% (0.3497 => 0.2127, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.88% (5.2665 => 4.1668, std.dev.: 0.1110) SingleSource/Benchmarks/Shootout-C++/ary3: -18.74% (1.7473 => 1.4198, std.dev.: 0.0350) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.58% (1.1647 => 0.9600, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.26% (15.8312 => 13.2575, std.dev.: 0.1518) SingleSource/Benchmarks/Shootout/sieve: -12.07% (8.1594 => 7.1749, std.dev.: 0.0213) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2863, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.16% (3.2007 => 2.9396, std.dev.: 0.0099) MultiSource/Applications/lambda-0_1_3/lambda: -7.11% (7.6833 => 7.1372, std.dev.: 0.0640) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.85% (3.6254 => 3.3769, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: -6.51% (1.4441 => 1.3501, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/fibo: -6.46% (4.6355 => 4.3359, std.dev.: 0.0188) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.44% (2.0027 => 1.8737, std.dev.: 0.0084) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.95% (2.9728 => 2.7958, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: -5.63% (3.4230 => 3.2304, std.dev.: 0.0109) MultiSource/Benchmarks/mafft/pairlocalalign: -5.59% (62.4126 => 58.9220, std.dev.: 0.1467) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.47% (3.9413 => 3.7257, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/fib2: -5.20% (4.4195 => 4.1898, std.dev.: 0.0096) MultiSource/Benchmarks/FreeBench/distray/distray: -4.88% (0.2664 => 0.2534, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.86% (0.4140 => 0.3939, std.dev.: 0.0036) MultiSource/Applications/sgefa/sgefa: -4.43% (0.3746 => 0.3580, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.29% (0.4564 => 0.4368, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -3.96% (2.5166 => 2.4169, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.62% (45.4683 => 43.8245, std.dev.: 0.0805) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.61% (1.2722 => 1.2263, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/misr: -3.56% (0.4296 => 0.4143, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: -3.51% (9.2503 => 8.9258, std.dev.: 0.0178) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.06% (3.7496 => 3.6347, std.dev.: 0.0216) SingleSource/Benchmarks/Misc/flops: -2.70% (9.5474 => 9.2899, std.dev.: 0.0207) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.54% (2.4457 => 2.3836, std.dev.: 0.0163) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.48% (1.1683 => 1.1393, std.dev.: 0.0056) MultiSource/Applications/JM/lencod/lencod: -2.18% (6.7458 => 6.5985, std.dev.: 0.0561) MultiSource/Applications/lua/lua: -2.15% (29.5232 => 28.8881, std.dev.: 0.0328) MultiSource/Benchmarks/PAQ8p/paq8p: -2.09% (92.7467 => 90.8048, std.dev.: 0.2511) SingleSource/Benchmarks/Shootout-C++/hash2: -1.96% (3.4876 => 3.4194, std.dev.: 0.0096) MultiSource/Applications/aha/aha: -1.87% (3.4286 => 3.3645, std.dev.: 0.0087) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.82% (2.8964 => 2.8437, std.dev.: 0.0200) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.72% (2.3569 => 2.3163, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/neural/neural: -1.62% (1.0926 => 1.0749, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.58% (1.0686 => 1.0517, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.34% (27.1724 => 26.8084, std.dev.: 0.0394) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.33% (9.3855 => 9.2604, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.17% (25.6658 => 25.3648, std.dev.: 0.0597) SingleSource/Benchmarks/Dhrystone/fldry: -1.07% (2.4971 => 2.4703, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/oourafft: -1.05% (3.8200 => 3.7800, std.dev.: 0.0052) MultiSource/Benchmarks/llubenchmark/llu: -1.04% (2.0192 => 1.9981, std.dev.: 0.0015) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.90% (0.9980 => 1.0269, std.dev.: 0.0086) MultiSource/Applications/sqlite3/sqlite3: 1.64% (0.6022 => 0.6121, std.dev.: 0.0104) MultiSource/Benchmarks/McCat/08-main/main: 0.24% (0.1666 => 0.1670, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.99% (0.1554 => 0.1523, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.62% (0.3083 => 0.3064, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.42% (0.2394 => 0.2384, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.25% (0.3175 => 0.3183, std.dev.: 0.0130) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.2302 => 0.2302, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel: 1.34% (0.0449 => 0.0455, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: 2.22% (0.0090 => 0.0092, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0240 => 0.0240, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.56% (0.0192 => 0.0195, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0390 => 0.0390, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.33% (0.0301 => 0.0302, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.87% (0.0284 => 0.0273, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.31% (0.0324 => 0.0323, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: 2.26% (0.0177 => 0.0181, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -3.70% (0.0189 => 0.0182, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -4.82% (0.0249 => 0.0237, std.dev.: 0.0009) SingleSource/UnitTests/byval-alignment: -1.23% (0.0325 => 0.0321, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 1.68% (0.1429 => 0.1453, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 2.14% (1.5019 => 1.5340, std.dev.: 0.0141) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.40% (0.1501 => 0.1450, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.23% (0.4264 => 0.4041, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.14% (0.1344 => 0.1440, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.53% (0.0589 => 0.0580, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -20.69% (0.0232 => 0.0184, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.25% (0.0639 => 0.0647, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.30% (1.1350 => 1.1316, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 183.33% (0.0006 => 0.0017, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.05% (0.0637 => 0.0573, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.89% (0.0246 => 0.0202, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.96% (0.7541 => 0.7689, std.dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 3.61% (1.5363 => 1.5917, std.dev.: 0.0057) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 1 15:54:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 1 Oct 2012 17:54:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121001225443.ACA982A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4460?compare_to=4456&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4460, Order: 164970, Start Time: 2012-10-01 21:35:56, End Time: 2012-10-01 22:56:19 To: 4456, Order: 164954, Start Time: 2012-10-01 19:17:40, End Time: 2012-10-01 20:38:05 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (143 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 92 (18 on baseline) Unchanged Tests: 947 (707 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.75% (15.1202 => 15.6878, std.dev.: 0.0098) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.22% (78.7340 => 80.4814, std.dev.: 0.3703) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.19% (1.2909 => 1.3062, std.dev.: 0.0032) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.16% (0.5757 => 0.5748, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: -0.34% (16.0068 => 15.9529, std.dev.: 0.0099) MultiSource/Applications/kimwitu++/kc: -0.22% (14.9448 => 14.9112, std.dev.: 0.0130) MultiSource/Benchmarks/Bullet/bullet: 0.35% (83.4397 => 83.7307, std.dev.: 0.0176) MultiSource/Benchmarks/MallocBench/gs/gs: -0.18% (4.3378 => 4.3300, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.08% (0.0461 => 0.0456, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.08% (0.0463 => 0.0458) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.16% (0.0430 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.16% (0.0432 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.19% (0.0420 => 0.0415, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.71% (0.0421 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.21% (0.0414 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.44% (0.0416 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.39% (0.0432 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.15% (0.0433 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.94% (0.0426 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.94% (0.0427 => 0.0423) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.96% (0.0415 => 0.0411) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.20% (0.0417 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.95% (0.0423 => 0.0419) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.18% (0.0425 => 0.0420, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.15% (0.0435 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.15% (0.0436 => 0.0431, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.22% (0.0411 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.97% (0.0412 => 0.0408) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.18% (0.0423 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.41% (0.0425 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.20% (0.0415 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -1.20% (0.0416 => 0.0411) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -1.23% (0.0407 => 0.0402, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -1.23% (0.0407 => 0.0402, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -1.23% (0.0405 => 0.0400, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -1.23% (0.0407 => 0.0402, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.13% (0.0443 => 0.0438) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.13% (0.0444 => 0.0439) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -1.24% (0.0404 => 0.0399, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -1.23% (0.0405 => 0.0400, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.99% (0.0405 => 0.0401) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.99% (0.0406 => 0.0402) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.97% (0.0413 => 0.0409, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.97% (0.0414 => 0.0410) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.06% (1.2309 => 1.2301, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.42% (7.5658 => 7.5342, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.21% (3.7312 => 3.7235, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.23% (0.6516 => 0.6501, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1431 => 0.1430, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.88% (0.0646 => 0.0684, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: 32.39% (63.2438 => 83.7307, std.dev.: 0.0176) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14233.47% (0.0720 => 10.3201, std.dev.: 0.0044) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 51.32% (10.3673 => 15.6878, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/richards_benchmark: 29.16% (0.1622 => 0.2095, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.27% (2.2022 => 2.5165, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.07% (7.0540 => 8.0467, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 13.69% (0.1432 => 0.1628, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.95% (0.0834 => 0.0942, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.73% (1.1194 => 1.2619, std.dev.: 0.0053) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.52% (0.1566 => 0.1762, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.06% (1.7609 => 1.9557, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 10.33% (0.3282 => 0.3621, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.53% (0.1584 => 0.1735, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.24% (0.3473 => 0.3794, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.18% (0.3561 => 0.3888, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.06% (0.3543 => 0.3864, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-2: 9.04% (0.3497 => 0.3813, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.03% (0.3543 => 0.3863, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.99% (0.3516 => 0.3832, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.96% (0.3694 => 0.4025, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 8.70% (0.3828 => 0.4161, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.63% (0.3927 => 0.4266, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/property: 8.52% (0.3886 => 0.4217, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.22% (0.4879 => 0.5280, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 8.19% (10.4361 => 11.2906, std.dev.: 0.0233) SingleSource/UnitTests/ObjC++/Hello: 8.10% (0.5925 => 0.6405, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.04% (0.6030 => 0.6515, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 7.85% (0.1440 => 0.1553, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 7.55% (9.4845 => 10.2009, std.dev.: 0.0178) MultiSource/Applications/minisat/minisat: 7.55% (0.7115 => 0.7652, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.54% (0.6675 => 0.7178, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 7.53% (5.7591 => 6.1926, std.dev.: 0.0050) SingleSource/Benchmarks/McGill/chomp: 7.49% (0.1655 => 0.1779, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.49% (0.3177 => 0.3415, std.dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 7.48% (0.7433 => 0.7989, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 7.23% (0.7326 => 0.7856, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.22% (0.2065 => 0.2214, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.14% (0.4636 => 0.4967, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.11% (0.5105 => 0.5468, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.06% (0.4615 => 0.4941, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.95% (0.1625 => 0.1738, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.90% (0.3422 => 0.3658, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 6.83% (3.3354 => 3.5633, std.dev.: 0.0026) MultiSource/Applications/sgefa/sgefa: 6.82% (0.3109 => 0.3321, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.81% (0.2700 => 0.2884, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.73% (0.4103 => 0.4379, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.68% (1.5415 => 1.6444, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.67% (0.8067 => 0.8605, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 6.64% (0.2905 => 0.3098, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.64% (0.2891 => 0.3083, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 6.54% (0.3423 => 0.3647, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.51% (0.8172 => 0.8704, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 6.48% (0.4289 => 0.4567, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.47% (0.2271 => 0.2418, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.46% (0.2831 => 0.3014, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.46% (4.2646 => 4.5401, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.43% (1.3050 => 1.3889, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.38% (0.3307 => 0.3518, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.32% (0.4064 => 0.4321, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.31% (0.5860 => 0.6230, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.31% (0.2725 => 0.2897, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 6.25% (0.1695 => 0.1801, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.24% (0.3865 => 0.4106, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.20% (0.2756 => 0.2927, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.20% (0.3162 => 0.3358, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 6.19% (0.2554 => 0.2712, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.17% (5.0018 => 5.3102, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.16% (0.3650 => 0.3875, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.15% (0.3283 => 0.3485, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 6.15% (0.6456 => 0.6853, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.14% (0.5569 => 0.5911, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.14% (0.4203 => 0.4461, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.13% (4.9449 => 5.2479, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/hello: 6.12% (0.2714 => 0.2880, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 6.10% (0.3232 => 0.3429, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.09% (0.3136 => 0.3327, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.09% (2.0665 => 2.1923, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/wc: 6.06% (0.3052 => 0.3237, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.06% (0.2871 => 0.3045, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.05% (0.4048 => 0.4293, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.04% (8.1363 => 8.6281, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.02% (0.2872 => 0.3045, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 6.01% (0.7835 => 0.8306, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/matrix: 6.00% (0.3098 => 0.3284, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 5.98% (1.5603 => 1.6536, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.98% (0.2793 => 0.2960, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 5.97% (0.3603 => 0.3818, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.96% (0.2802 => 0.2969, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.96% (0.3826 => 0.4054, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.94% (0.2877 => 0.3048, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 5.93% (0.4620 => 0.4894, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.87% (0.2758 => 0.2920, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.84% (0.2107 => 0.2230, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 5.75% (0.3684 => 0.3896, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.71% (0.9765 => 1.0323, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.70% (0.3121 => 0.3299, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 5.68% (0.3379 => 0.3571, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.68% (0.5020 => 0.5305, std.dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.67% (0.1940 => 0.2050, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 5.66% (1.1642 => 1.2301, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: 5.63% (0.3092 => 0.3266, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 5.49% (3.8723 => 4.0848, std.dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.48% (7.9617 => 8.3978, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 5.46% (0.3387 => 0.3572, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 5.41% (21.9371 => 23.1243, std.dev.: 0.0131) MultiSource/Applications/lemon/lemon: 5.40% (1.0722 => 1.1301, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.25% (1.1861 => 1.2484, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.14% (0.3441 => 0.3618, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 5.06% (0.3180 => 0.3341, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.03% (0.2603 => 0.2734, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 4.93% (2.0273 => 2.1272, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/05-eks/eks: 4.82% (0.4299 => 0.4506, std.dev.: 0.0043) MultiSource/Applications/siod/siod: 4.71% (2.2969 => 2.4051, std.dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C/football/football: 4.69% (0.8921 => 0.9339, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.65% (0.6450 => 0.6750, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.40% (0.5981 => 0.6244, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.39% (1.5859 => 1.6556, std.dev.: 0.0129) MultiSource/Applications/hexxagon/hexxagon: 4.20% (1.2842 => 1.3382, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 4.18% (0.3131 => 0.3262, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.03% (1.4186 => 1.4758, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.93% (14.3668 => 14.9308, std.dev.: 0.0153) MultiSource/Benchmarks/nbench/nbench: 3.88% (1.1840 => 1.2299, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.81% (2.2024 => 2.2864, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.85% (0.8101 => 0.8332, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.69% (17.1811 => 17.4713, std.dev.: 0.0185) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.53% (3.8922 => 3.9516, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/methcall: 146.51% (5.3999 => 13.3115, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.38% (0.2944 => 0.3279, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.22% (3.1595 => 3.4507, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (3.1578 => 3.3678, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 6.63% (1.1396 => 1.2151, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.63% (3.6395 => 3.7716, std.dev.: 0.0030) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.82% (4.2280 => 4.3473, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7984, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.10% (6.5088 => 6.5805, std.dev.: 0.0096) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.10% (6.6874 => 0.1273) SingleSource/Benchmarks/Misc/salsa20: -80.30% (0.8651 => 0.1704, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.50% (5.2763 => 3.2450, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.88% (5.3855 => 3.8840, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -27.54% (5.3526 => 3.8784, std.dev.: 0.0055) SingleSource/UnitTests/Vector/constpool: -14.80% (54.1659 => 46.1490, std.dev.: 0.0143) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.23% (2.9384 => 2.6083, std.dev.: 0.0035) MultiSource/Applications/ClamAV/clamscan: -8.09% (22.1758 => 20.3821, std.dev.: 0.0234) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -15.74% (1.6925 => 1.4261, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/chomp: -11.26% (1.2373 => 1.0980, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel-2: -10.45% (1.5373 => 1.3766, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.31% (19.9488 => 18.2916, std.dev.: 0.0163) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.66% (1.8329 => 1.7109, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: -5.09% (5.0483 => 4.7914, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.97% (1.6805 => 1.5970, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.67% (1.5835 => 1.5095, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -3.64% (3.2827 => 3.1633, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5009, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -1.97% (10.2830 => 10.0803, std.dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.92% (8.6802 => 8.5138, std.dev.: 0.0096) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.80% (8.1563 => 8.0093, std.dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: -1.77% (12.4730 => 12.2526, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6835, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5122, std.dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4213, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8572, std.dev.: 0.0111) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.93% (0.5229 => 0.5748, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 6.43% (14.9895 => 15.9529, std.dev.: 0.0099) MultiSource/Applications/kimwitu++/kc: 5.34% (14.1553 => 14.9112, std.dev.: 0.0130) MultiSource/Benchmarks/MallocBench/gs/gs: 5.34% (4.1105 => 4.3300, std.dev.: 0.0191) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.34% (1.1048 => 1.2301, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.25% (7.1582 => 7.5342, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.53% (3.4629 => 3.7235, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.48% (0.6222 => 0.6501, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.70% (0.1485 => 0.1430, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.67% (0.2116 => 0.0684, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 1 17:36:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 1 Oct 2012 19:36:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121002003647.9CB362A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4461?compare_to=4458&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4461, Order: 164974, Start Time: 2012-10-01 23:07:17, End Time: 2012-10-02 00:32:50 To: 4458, Order: 164968, Start Time: 2012-10-01 21:12:38, End Time: 2012-10-01 22:38:09 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 1 (178 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1038 (693 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.95% (78.5514 => 80.8689, std.dev.: 0.7281) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.01% (2.7522 => 2.7525, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.00% (2.1153 => 2.1154, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.00% (4.9750 => 4.9748, std.dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.13% (2.0176 => 2.4439, std.dev.: 0.0155) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.17% (0.1410 => 0.1638, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 14.89% (0.0826 => 0.0949, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.43% (0.0819 => 0.0929, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 12.03% (0.5818 => 0.6518, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.94% (0.1072 => 0.1200, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 11.86% (0.5748 => 0.6430, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 11.30% (0.4062 => 0.4521, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 11.25% (0.4328 => 0.4815, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 11.19% (0.7061 => 0.7851, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 11.08% (0.2781 => 0.3089, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.90% (0.1413 => 0.1567, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.82% (0.2782 => 0.3083, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 10.72% (1.3693 => 1.5161, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.52% (0.1588 => 0.1755, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 10.46% (0.1013 => 0.1119, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.39% (0.3022 => 0.3336, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.36% (0.2655 => 0.2930, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.28% (0.3899 => 0.4300, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 10.28% (0.2607 => 0.2875, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 10.16% (0.2628 => 0.2895, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.16% (3.9660 => 4.3689, std.dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 10.14% (0.7038 => 0.7752, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: 10.11% (0.2690 => 0.2962, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 10.08% (0.2937 => 0.3233, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.06% (1.9828 => 2.1822, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: 10.04% (0.2760 => 0.3037, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.01% (0.3485 => 0.3834, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.00% (0.3489 => 0.3838, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.98% (0.2765 => 0.3041, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 9.90% (0.2726 => 0.2996, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 9.89% (0.2761 => 0.3034, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 9.85% (0.3107 => 0.3413, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.84% (0.2966 => 0.3258, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.84% (0.4016 => 0.4411, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.80% (0.3580 => 0.3931, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.79% (0.2696 => 0.2960, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 9.78% (0.3293 => 0.3615, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.78% (0.2721 => 0.2987, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.77% (0.6283 => 0.6897, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.72% (0.1327 => 0.1456, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.72% (0.3756 => 0.4121, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 9.69% (0.3149 => 0.3454, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.55% (0.2596 => 0.2844, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 9.53% (0.3453 => 0.3782, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.49% (1.2193 => 1.3350, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 9.47% (0.2988 => 0.3271, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 9.46% (0.3192 => 0.3494, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 9.41% (0.3868 => 0.4232, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.34% (0.4390 => 0.4800, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.34% (0.9199 => 1.0058, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.33% (0.5265 => 0.5756, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.28% (0.6959 => 0.7605, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.25% (1.4563 => 1.5910, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.18% (1.1364 => 1.2407, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.14% (0.4791 => 0.5229, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.14% (0.3130 => 0.3416, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 9.11% (0.3534 => 0.3856, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 9.03% (13.8202 => 15.0687, std.dev.: 0.0194) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.00% (0.7710 => 0.8404, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.94% (0.6576 => 0.7164, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 8.73% (0.2945 => 0.3202, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 8.66% (1.0313 => 1.1206, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 8.62% (0.1589 => 0.1726, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.50% (0.1435 => 0.1557, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 8.35% (0.2995 => 0.3245, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.31% (0.1276 => 0.1382, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.23% (0.5577 => 0.6036, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 7.99% (0.8310 => 0.8974, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.99% (0.3755 => 0.4055, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.95% (0.3246 => 0.3504, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 7.86% (0.6744 => 0.7274, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 7.86% (16.6129 => 17.9182, std.dev.: 0.0145) MultiSource/Benchmarks/MallocBench/gs/gs: 7.85% (3.8646 => 4.1678, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.77% (0.8698 => 0.9374, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.76% (0.4379 => 0.4719, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.75% (1.1061 => 1.1918, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.71% (0.2127 => 0.2291, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.70% (0.5637 => 0.6071, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.69% (3.6692 => 3.9514, std.dev.: 0.0040) MultiSource/Applications/d/make_dparser: 7.54% (3.1889 => 3.4295, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.49% (0.7460 => 0.8019, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.45% (0.1986 => 0.2134, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.41% (0.2914 => 0.3130, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 7.37% (2.1791 => 2.3397, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.37% (7.2180 => 7.7499, std.dev.: 0.0083) MultiSource/Benchmarks/McCat/18-imp/imp: 7.33% (0.3220 => 0.3456, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 7.30% (0.7506 => 0.8054, std.dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 7.24% (4.6629 => 5.0007, std.dev.: 0.0055) MultiSource/Benchmarks/nbench/nbench: 7.23% (1.0594 => 1.1360, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.12% (0.2023 => 0.2167, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 7.11% (0.2925 => 0.3133, std.dev.: 0.0026) MultiSource/Applications/treecc/treecc: 7.05% (1.9270 => 2.0628, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.01% (0.1569 => 0.1679, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 7.00% (0.2243 => 0.2400, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 6.83% (0.1478 => 0.1579, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 6.82% (1.2749 => 1.3619, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.81% (0.1865 => 0.1992, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 6.81% (1.2292 => 1.3129, std.dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 6.79% (14.8535 => 15.8625, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.78% (1.3245 => 1.4143, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.76% (0.1819 => 0.1942, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.71% (0.8818 => 0.9410, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.61% (1.3813 => 1.4726, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.54% (1.3819 => 1.4723, std.dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: 6.50% (8.4961 => 9.0485, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.48% (0.1789 => 0.1905, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.45% (4.3801 => 4.6627, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.38% (4.4433 => 4.7270, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/em3d/em3d: 6.34% (0.1657 => 0.1762, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 6.30% (0.4113 => 0.4372, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.28% (0.6135 => 0.6520, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 6.26% (0.3131 => 0.3327, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 6.22% (0.6250 => 0.6639, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 6.19% (0.2859 => 0.3036, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/for-in: 5.99% (0.3789 => 0.4016, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.98% (0.2140 => 0.2268, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.96% (1.1333 => 1.2009, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 5.95% (0.3914 => 0.4147, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 5.95% (0.4003 => 0.4241, std.dev.: 0.0078) MultiSource/Applications/JM/ldecod/ldecod: 5.94% (6.5754 => 6.9663, std.dev.: 0.0099) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.91% (0.2504 => 0.2652, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 5.90% (0.3646 => 0.3861, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 5.89% (14.5298 => 15.3861, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.88% (13.2842 => 14.0653, std.dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.88% (3.2742 => 3.4666, std.dev.: 0.0064) SingleSource/UnitTests/ObjC/trivial-interface: 5.84% (0.3578 => 0.3787, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.84% (0.3511 => 0.3716, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.79% (0.3245 => 0.3433, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 5.76% (0.3940 => 0.4167, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 5.71% (0.3663 => 0.3872, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 5.69% (0.3601 => 0.3806, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.68% (0.4805 => 0.5078, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.67% (4.9865 => 5.2690, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.62% (0.3650 => 0.3855, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 5.60% (0.3623 => 0.3826, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.51% (0.2321 => 0.2449, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.23% (0.9108 => 0.9584, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.20% (1.5188 => 1.5978, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 4.71% (3.7467 => 3.9231, std.dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: 4.65% (33.2944 => 34.8428, std.dev.: 0.0140) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.60% (2.1007 => 2.1974, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.19% (6.2785 => 6.5416, std.dev.: 0.0052) MultiSource/Applications/sqlite3/sqlite3: 2.60% (16.2614 => 16.6846, std.dev.: 0.0239) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5172, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 23.60% (1.8175 => 2.2465, std.dev.: 0.0591) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.68% (1.1560 => 1.2563, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.54% (3.1736 => 3.4130, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.26% (1.2998 => 1.3812, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0006, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0040, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.10% (11.2619 => 11.7240, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.89% (1.7081 => 1.7745, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 3.38% (1.9199 => 1.9847, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 3.07% (10.7476 => 11.0771, std.dev.: 0.0263) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.08% (7.4271 => 7.5817, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std.dev.: 0.0054) MultiSource/Applications/lemon/lemon: 1.55% (1.4298 => 1.4520, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0031) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5149, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9688, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/oourafft: 1.30% (5.5130 => 5.5847, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1870, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists: 1.11% (12.4560 => 12.5946, std.dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 1.10% (12.0921 => 12.2250, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (2.2986 => 2.3233, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.02% (3.6469 => 3.6841, std.dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -17.01% (0.4657 => 0.3865, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.56% (22.5627 => 21.9845, std.dev.: 0.0175) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.72% (1.2308 => 1.0865, std.dev.: 0.0099) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.18% (20.3410 => 18.2703, std.dev.: 0.0166) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.50% (1.3780 => 1.3022, std.dev.: 0.0074) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0051) SingleSource/UnitTests/Vector/multiplies: -5.15% (2.6470 => 2.5107, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7941, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.47% (1.7688 => 1.7074, std.dev.: 0.0012) MultiSource/Applications/siod/siod: -3.02% (3.2729 => 3.1739, std.dev.: 0.0215) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.96% (0.4867 => 0.4723, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.73% (3.0263 => 2.9436, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4786, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.26% (1.9762 => 1.9315, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: -2.11% (0.5449 => 0.5334, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7069, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.80% (0.6615 => 0.6496, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.75% (6.3560 => 6.2449, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.67% (0.6589 => 0.6479, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.48% (7.3305 => 7.2222, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0069, std.dev.: 0.0006) MultiSource/Applications/lua/lua: -1.37% (26.5159 => 26.1525, std.dev.: 0.0232) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2506, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -1.19% (3.9173 => 3.8706, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4955, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -1.00% (9.3358 => 9.2420, std.dev.: 0.0086) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 1 19:03:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 1 Oct 2012 21:03:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121002020323.A514D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4462?compare_to=4457&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4462, Order: 164972, Start Time: 2012-10-01 22:54:51, End Time: 2012-10-02 02:05:01 To: 4457, Order: 164954, Start Time: 2012-10-01 19:15:40, End Time: 2012-10-01 22:25:47 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 3 (124 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (131 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1035 (769 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 4.23% (0.3829 => 0.3991, std.dev.: 0.0058) MultiSource/Applications/oggenc/oggenc: 2.05% (1.7540 => 1.7899, std.dev.: 0.0128) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.08% (2.0901 => 2.1126, std.dev.: 0.0087) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.16% (2.5183 => 2.4890, std.dev.: 0.0033) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.03% (9.8124 => 9.8091, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.03% (9.4122 => 9.4093, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.05% (16.9511 => 16.9596, std.dev.: 0.0044) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 12.35% (1.5932 => 1.7899, std.dev.: 0.0128) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.38% (0.1063 => 0.1184, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.95% (0.3496 => 0.3844, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.93% (0.3465 => 0.3809, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.92% (0.3488 => 0.3834, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 9.91% (0.3442 => 0.3783, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.90% (0.3446 => 0.3787, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 9.83% (0.3469 => 0.3810, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.80% (0.3460 => 0.3799, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 9.59% (0.3650 => 0.4000, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.58% (0.3643 => 0.3992, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.34% (0.3724 => 0.4072, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.51% (0.5826 => 0.6322, std.dev.: 0.0079) SingleSource/UnitTests/ObjC++/property-reference-object: 8.51% (0.5889 => 0.6390, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.03% (0.2875 => 0.3077, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 6.90% (0.7171 => 0.7666, std.dev.: 0.0034) SingleSource/Regression/C++/ofstream_ctor: 6.76% (0.3004 => 0.3207, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.72% (0.2725 => 0.2908, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.69% (0.2750 => 0.2934, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.65% (0.2738 => 0.2920, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.63% (0.2729 => 0.2910, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.60% (0.2714 => 0.2893, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.54% (0.3195 => 0.3404, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.49% (0.2803 => 0.2985, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 6.48% (0.2823 => 0.3006, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/05-eks/eks: 6.42% (0.1619 => 0.1723, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.40% (2.0673 => 2.1996, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/wc: 6.40% (0.3096 => 0.3294, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.36% (0.2813 => 0.2992, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: 6.34% (0.3267 => 0.3474, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.30% (0.2792 => 0.2968, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.30% (0.2811 => 0.2988, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.29% (0.2780 => 0.2955, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 6.28% (0.9909 => 1.0531, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.27% (0.3124 => 0.3320, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.26% (0.3258 => 0.3462, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.25% (0.4994 => 0.5306, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.23% (1.3152 => 1.3972, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.15% (0.2911 => 0.3090, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.05% (0.3060 => 0.3245, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.04% (0.5000 => 0.5302, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 6.03% (0.3317 => 0.3517, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 6.01% (0.4146 => 0.4395, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 5.91% (0.3348 => 0.3546, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.90% (0.3625 => 0.3839, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 5.90% (0.3477 => 0.3682, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.89% (1.6211 => 1.7166, std.dev.: 0.0029) MultiSource/Applications/d/make_dparser: 5.89% (1.0781 => 1.1416, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.89% (0.3362 => 0.3560, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.87% (0.4361 => 0.4617, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 5.82% (0.3678 => 0.3892, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.76% (0.3282 => 0.3471, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 5.72% (0.3726 => 0.3939, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.68% (3.5627 => 3.7650, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.56% (0.3690 => 0.3895, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 5.53% (5.5417 => 5.8479, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hash2: 5.39% (0.4251 => 0.4480, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.22% (0.3981 => 0.4189, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.21% (0.2014 => 0.2119, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 5.19% (23.5202 => 24.7405, std.dev.: 0.0106) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.15% (0.3845 => 0.4043, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.09% (0.3930 => 0.4130, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.08% (0.2736 => 0.2875, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.05% (0.5026 => 0.5280, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 4.99% (0.2566 => 0.2694, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 4.97% (4.2109 => 4.4200, std.dev.: 0.0071) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.93% (0.4139 => 0.4343, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 4.91% (0.5012 => 0.5258, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.80% (2.7292 => 2.8603, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.63% (0.6435 => 0.6733, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.63% (4.4195 => 4.6241, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.61% (0.5900 => 0.6172, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.60% (0.3084 => 0.3226, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.58% (0.3890 => 0.4068, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 4.54% (1.8794 => 1.9648, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.53% (0.2737 => 0.2861, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.51% (0.4658 => 0.4868, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.50% (0.2866 => 0.2995, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 4.44% (4.6177 => 4.8229, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.43% (0.3903 => 0.4076, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.42% (0.4029 => 0.4207, std.dev.: 0.0055) MultiSource/Applications/hbd/hbd: 4.40% (0.9697 => 1.0124, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 4.36% (2.1013 => 2.1930, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 4.28% (2.1653 => 2.2580, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 4.27% (0.6634 => 0.6917, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 4.05% (1.4269 => 1.4847, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 4.05% (0.3336 => 0.3471, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.01% (0.2969 => 0.3088, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 3.98% (0.5546 => 0.5767, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.94% (0.3271 => 0.3400, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 3.82% (2.0346 => 2.1123, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 3.80% (0.7875 => 0.8174, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.60% (1.9694 => 2.0402, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.49% (1.9966 => 2.0662, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 3.42% (0.4847 => 0.5013, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.10% (0.4253 => 0.4385, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.06% (0.7426 => 0.7653, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.91% (0.5361 => 0.5517, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.83% (0.5584 => 0.5742, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.49% (11.6398 => 11.9302, std.dev.: 0.0197) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.32% (4.6926 => 4.8013, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 1.32% (11.9555 => 12.1128, std.dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6109, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6729, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-2: 4.99% (1.8057 => 1.8958, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1639, std.dev.: 0.0193) SingleSource/Benchmarks/Dhrystone/dry: 4.14% (14.0481 => 14.6293, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2065, std.dev.: 0.0464) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5030, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.88% (41.7953 => 42.5811, std.dev.: 0.0343) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.61% (3.1722 => 3.2232, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.47% (2.0820 => 2.1126, std.dev.: 0.0087) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2881, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5143, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5991, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.89% (25.4195 => 16.5497, std.dev.: 0.0280) SingleSource/Benchmarks/Shootout-C++/ary2: -10.49% (0.2402 => 0.2150, std.dev.: 0.0048) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9759, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7946, std.dev.: 0.0130) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9575, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.69% (11.2080 => 10.7942, std.dev.: 0.0062) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7736, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/fldry: -2.80% (17.2379 => 16.7546, std.dev.: 0.0628) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.89% (0.6293 => 0.6174, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5802, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4984, std.dev.: 0.0064) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0427, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 1 19:08:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 1 Oct 2012 21:08:02 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121002020802.2850D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4463?compare_to=4459&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4463, Order: 164982, Start Time: 2012-10-02 00:47:02, End Time: 2012-10-02 02:09:42 To: 4459, Order: 164969, Start Time: 2012-10-01 21:18:02, End Time: 2012-10-01 22:41:24 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 5 (61 on baseline) Performance Improvements: 7 (41 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 961 (789 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/viterbi/viterbi: 7.09% (0.1411 => 0.1511, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 2.66% (0.4174 => 0.4285, std.dev.: 0.0021) MultiSource/Applications/hbd/hbd: 1.13% (1.3475 => 1.3627, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.35% (43.8245 => 44.4178, std.dev.: 0.1475) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.05% (5.8590 => 5.9203, std.dev.: 0.0100) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.19% (0.9094 => 0.8895, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.67% (0.9021 => 0.8870, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.40% (0.8648 => 0.8527, std.dev.: 0.0031) MultiSource/Applications/lua/lua: -1.13% (3.7430 => 3.7007, std.dev.: 0.0123) MultiSource/Applications/treecc/treecc: -1.05% (1.9399 => 1.9196, std.dev.: 0.0078) MultiSource/Applications/Burg/burg: -1.03% (1.1908 => 1.1785, std.dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -1.64% (2.0492 => 2.0156, std.dev.: 0.0125) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.92% (1.0269 => 1.0072, std.dev.: 0.0199) MultiSource/Applications/sqlite3/sqlite3: -0.36% (0.6121 => 0.6099, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: -3.11% (0.1670 => 0.1618, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.82% (0.1523 => 0.1566, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.20% (0.3064 => 0.3058, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.31% (0.2384 => 0.2329, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.69% (0.3183 => 0.3161, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.09% (0.2302 => 0.2277, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -1.32% (0.0455 => 0.0449, std.dev.: 0.0004) SingleSource/UnitTests/2003-05-07-VarArgs: -63.64% (0.0088 => 0.0032, std.dev.: 0.0028) SingleSource/UnitTests/2003-08-11-VaListArg: -3.26% (0.0092 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0240 => 0.0240, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.54% (0.0195 => 0.0192, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.05% (0.0390 => 0.0382, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.99% (0.0302 => 0.0296, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.20% (0.0273 => 0.0279, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.62% (0.0323 => 0.0321, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -1.66% (0.0181 => 0.0178, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 4.40% (0.0182 => 0.0190, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: 4.22% (0.0237 => 0.0247, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: 0.93% (0.0321 => 0.0324, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.83% (0.1453 => 0.1441, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -2.25% (1.5340 => 1.4995, std.dev.: 0.0200) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.59% (0.1450 => 0.1427, std.dev.: 0.0052) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.69% (0.4041 => 0.4069, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.62% (0.1440 => 0.1431, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 500.00% (0.0001 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.69% (0.0580 => 0.0613, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.98% (0.0184 => 0.0173, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -12.98% (0.0647 => 0.0563, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.06% (1.1316 => 1.1309, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -35.29% (0.0017 => 0.0011, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.17% (0.0573 => 0.0572, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.97% (0.0202 => 0.0208, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.60% (0.7689 => 0.7643, std.dev.: 0.0086) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.61% (1.5917 => 1.6014, std.dev.: 0.0082) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.75% (4.1772 => 3.1014, std.dev.: 0.0296) SingleSource/Benchmarks/Shootout-C++/except: 81133.33% (0.0006 => 0.4874, std.dev.: 0.0048) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_throw: -50.00% (0.0006 => 0.0003, std.dev.: 0.0001) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.82% (0.0745 => 0.0915, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 7.69% (2.1763 => 2.3437, std.dev.: 0.0191) SingleSource/Benchmarks/Misc-C++/bigfib: 7.20% (0.5309 => 0.5691, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.16% (0.6410 => 0.6869, std.dev.: 0.0073) MultiSource/Applications/minisat/minisat: 6.71% (0.6173 => 0.6587, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.59% (0.3582 => 0.3818, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 6.45% (1.0046 => 1.0694, std.dev.: 0.0084) MultiSource/Applications/SIBsim4/SIBsim4: 6.05% (1.1653 => 1.2358, std.dev.: 0.0133) MultiSource/Applications/kimwitu++/kc: 5.42% (15.3105 => 16.1407, std.dev.: 0.1467) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.21% (0.6069 => 0.6385, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.65% (0.4880 => 0.5107, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.47% (0.2552 => 0.2666, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/18-imp/imp: 4.41% (0.3217 => 0.3359, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.07% (1.5150 => 1.5766, std.dev.: 0.0236) MultiSource/Applications/d/make_dparser: 3.97% (3.0225 => 3.1424, std.dev.: 0.0053) MultiSource/Benchmarks/Bullet/bullet: 3.76% (29.3170 => 30.4197, std.dev.: 0.2324) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.72% (0.3901 => 0.4046, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.48% (0.4248 => 0.4396, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 3.02% (4.7455 => 4.8890, std.dev.: 0.0284) MultiSource/Applications/Burg/burg: 3.02% (1.1440 => 1.1785, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 3.02% (13.3238 => 13.7256, std.dev.: 0.1154) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.97% (1.2021 => 1.2378, std.dev.: 0.0064) MultiSource/Applications/siod/siod: 2.88% (2.0972 => 2.1577, std.dev.: 0.0040) MultiSource/Applications/lua/lua: 2.85% (3.5980 => 3.7007, std.dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.73% (3.0758 => 3.1597, std.dev.: 0.0073) MultiSource/Applications/hbd/hbd: 2.71% (1.3268 => 1.3627, std.dev.: 0.0054) MultiSource/Applications/JM/lencod/lencod: 2.63% (14.7256 => 15.1128, std.dev.: 0.1136) MultiSource/Benchmarks/mafft/pairlocalalign: 2.21% (8.2186 => 8.4004, std.dev.: 0.0634) MultiSource/Applications/ClamAV/clamscan: 2.18% (14.6079 => 14.9260, std.dev.: 0.0501) MultiSource/Applications/JM/ldecod/ldecod: 2.16% (6.4908 => 6.6312, std.dev.: 0.0485) MultiSource/Applications/treecc/treecc: 2.12% (1.8798 => 1.9196, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.76% (2.0317 => 2.0675, std.dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.40% (1.6538 => 2.3384, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/city/city: 40.61% (0.0261 => 0.0367, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: 22.12% (3.4629 => 4.2288, std.dev.: 0.0246) SingleSource/Benchmarks/Shootout/ary3: 15.67% (1.7426 => 2.0156, std.dev.: 0.0125) SingleSource/Benchmarks/Stanford/Puzzle: 14.10% (0.1433 => 0.1635, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.39% (4.0101 => 4.5470, std.dev.: 0.0255) SingleSource/Benchmarks/McGill/queens: 11.16% (1.6261 => 1.8076, std.dev.: 0.0165) SingleSource/Benchmarks/Shootout/lists: 9.11% (7.0025 => 7.6407, std.dev.: 0.0544) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.23% (0.2857 => 0.3092, std.dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 8.22% (21.1721 => 22.9121, std.dev.: 0.0837) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.99% (1.0063 => 1.0867, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.01% (3.0256 => 3.2376, std.dev.: 0.0767) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.15% (0.3301 => 0.3504, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.29% (40.4792 => 42.6225, std.dev.: 0.4423) SingleSource/Benchmarks/Misc/dt: 4.48% (0.9851 => 1.0292, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: 4.32% (15.2242 => 15.8814, std.dev.: 0.0269) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.87% (3.4080 => 3.5398, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.36% (0.5587 => 0.5775, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 2.90% (14.4877 => 14.9080, std.dev.: 0.0611) SingleSource/Benchmarks/Shootout-C++/hash: 2.90% (0.6308 => 0.6491, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 2.79% (3.8907 => 3.9992, std.dev.: 0.0113) MultiSource/Applications/siod/siod: 2.55% (3.5520 => 3.6424, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/mason/mason: 2.46% (0.5004 => 0.5127, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.16% (6.6312 => 6.7746, std.dev.: 0.0070) SingleSource/Benchmarks/Dhrystone/dry: 2.15% (2.4013 => 2.4530, std.dev.: 0.0151) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.67% (2.4042 => 2.4444, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/power/power: 1.58% (1.4184 => 1.4408, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.47% (4.6127 => 4.6806, std.dev.: 0.0165) MultiSource/Benchmarks/Olden/em3d/em3d: 1.02% (4.6414 => 4.6887, std.dev.: 0.0182) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.49% (0.3497 => 0.2116, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.99% (5.2665 => 4.1082, std.dev.: 0.0613) SingleSource/Benchmarks/Shootout-C++/ary3: -18.57% (1.7473 => 1.4229, std.dev.: 0.1183) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.56% (1.1647 => 0.9602, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.33% (15.8312 => 13.4038, std.dev.: 0.1643) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1596, std.dev.: 0.0687) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.44% (3.2007 => 2.9307, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2864, std.dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: -7.12% (7.6833 => 7.1360, std.dev.: 0.0392) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.83% (3.6254 => 3.3778, std.dev.: 0.0200) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.56% (2.0027 => 1.8714, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/fibo: -6.14% (4.6355 => 4.3509, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -6.13% (1.4441 => 1.3556, std.dev.: 0.0135) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.95% (2.9728 => 2.7959, std.dev.: 0.0100) MultiSource/Applications/SIBsim4/SIBsim4: -5.85% (3.4230 => 3.2229, std.dev.: 0.0096) MultiSource/Benchmarks/mafft/pairlocalalign: -5.50% (62.4126 => 58.9811, std.dev.: 0.0984) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.45% (3.9413 => 3.7264, std.dev.: 0.0339) SingleSource/Benchmarks/Shootout/fib2: -5.16% (4.4195 => 4.1913, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.67% (0.4564 => 0.4351, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.21% (3.6023 => 3.4506, std.dev.: 0.0426) MultiSource/Benchmarks/Olden/bh/bh: -3.60% (2.5166 => 2.4259, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/methcall: -3.52% (9.2503 => 8.9243, std.dev.: 0.0217) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.44% (1.2722 => 1.2284, std.dev.: 0.0156) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.80% (0.4140 => 0.4024, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: -2.70% (9.5474 => 9.2893, std.dev.: 0.0177) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.40% (3.7496 => 3.6597, std.dev.: 0.0164) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.38% (1.1683 => 1.1405, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.31% (45.4683 => 44.4178, std.dev.: 0.1475) MultiSource/Applications/JM/lencod/lencod: -2.06% (6.7458 => 6.6066, std.dev.: 0.0360) SingleSource/Benchmarks/Shootout-C++/hash2: -1.96% (3.4876 => 3.4191, std.dev.: 0.0133) MultiSource/Benchmarks/PAQ8p/paq8p: -1.89% (92.7467 => 90.9947, std.dev.: 0.3738) MultiSource/Applications/aha/aha: -1.85% (3.4286 => 3.3651, std.dev.: 0.0111) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.68% (2.3569 => 2.3173, std.dev.: 0.0048) MultiSource/Applications/lua/lua: -1.67% (29.5232 => 29.0308, std.dev.: 0.1814) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.57% (2.4457 => 2.4074, std.dev.: 0.0103) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0755, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.47% (9.3855 => 9.2477, std.dev.: 0.0173) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3177, std.dev.: 0.0980) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.28% (27.1724 => 26.8256, std.dev.: 0.0174) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.19% (1.8739 => 1.8516, std.dev.: 0.0041) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.92% (0.9980 => 1.0072, std.dev.: 0.0199) MultiSource/Applications/sqlite3/sqlite3: 1.28% (0.6022 => 0.6099, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: -2.88% (0.1666 => 0.1618, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.77% (0.1554 => 0.1566, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.81% (0.3083 => 0.3058, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.72% (0.2394 => 0.2329, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.44% (0.3175 => 0.3161, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.09% (0.2302 => 0.2277, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: - (0.0449 => 0.0449, std.dev.: 0.0004) SingleSource/UnitTests/2003-05-07-VarArgs: -64.04% (0.0089 => 0.0032, std.dev.: 0.0028) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0240 => 0.0240, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0192 => 0.0192, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.05% (0.0390 => 0.0382, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.66% (0.0301 => 0.0296, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.76% (0.0284 => 0.0279, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0324 => 0.0321, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0177 => 0.0178, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 0.53% (0.0189 => 0.0190, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -0.80% (0.0249 => 0.0247, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: -0.31% (0.0325 => 0.0324, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.84% (0.1429 => 0.1441, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -0.16% (1.5019 => 1.4995, std.dev.: 0.0200) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -4.93% (0.1501 => 0.1427, std.dev.: 0.0052) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.57% (0.4264 => 0.4069, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.47% (0.1344 => 0.1431, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.07% (0.0589 => 0.0613, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -25.43% (0.0232 => 0.0173, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.89% (0.0639 => 0.0563, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.36% (1.1350 => 1.1309, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 83.33% (0.0006 => 0.0011, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.20% (0.0637 => 0.0572, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -15.45% (0.0246 => 0.0208, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.35% (0.7541 => 0.7643, std.dev.: 0.0086) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.24% (1.5363 => 1.6014, std.dev.: 0.0082) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 1 19:31:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 1 Oct 2012 21:31:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121002023120.8FE2E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4464?compare_to=4461&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4464, Order: 164983, Start Time: 2012-10-02 01:07:26, End Time: 2012-10-02 02:32:58 To: 4461, Order: 164974, Start Time: 2012-10-01 23:07:17, End Time: 2012-10-02 00:32:50 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 0 (177 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1039 (694 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.02% (2.7525 => 2.7520, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (2.1154 => 2.1154, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.01% (4.9748 => 4.9751, std.dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.40% (2.0176 => 2.4291, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.88% (0.1410 => 0.1648, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 14.53% (0.0826 => 0.0946, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 11.57% (0.5818 => 0.6491, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 11.43% (0.5748 => 0.6405, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 11.28% (0.4328 => 0.4816, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 11.06% (0.1013 => 0.1125, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 10.97% (0.2781 => 0.3086, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 10.96% (0.4062 => 0.4507, std.dev.: 0.0091) SingleSource/UnitTests/ObjC++/property-reference: 10.74% (0.7061 => 0.7819, std.dev.: 0.0052) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.73% (0.1072 => 0.1187, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.69% (0.1413 => 0.1564, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.50% (0.2782 => 0.3074, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.25% (0.2721 => 0.3000, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.20% (0.1588 => 0.1750, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 10.19% (1.3693 => 1.5088, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.18% (0.3899 => 0.4296, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.16% (3.9660 => 4.3690, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.09% (0.3022 => 0.3327, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hello: 10.05% (0.2607 => 0.2869, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.04% (0.3485 => 0.3835, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.00% (1.9828 => 2.1810, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.98% (0.2655 => 0.2920, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 9.96% (0.2690 => 0.2958, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 9.91% (0.2937 => 0.3228, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 9.89% (0.2628 => 0.2888, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 9.85% (0.7038 => 0.7731, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.80% (0.3489 => 0.3831, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.80% (0.2765 => 0.3036, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 9.79% (0.2726 => 0.2993, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/except: 9.78% (0.2760 => 0.3030, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.74% (0.2966 => 0.3255, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 9.74% (0.2761 => 0.3030, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.71% (0.2596 => 0.2848, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.69% (0.3756 => 0.4120, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.66% (0.3580 => 0.3926, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.65% (0.6283 => 0.6889, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.64% (0.2696 => 0.2956, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.56% (0.4016 => 0.4400, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 9.54% (0.3868 => 0.4237, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 9.54% (0.3293 => 0.3607, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 9.53% (0.3149 => 0.3449, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 9.49% (0.3107 => 0.3402, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.40% (1.2193 => 1.3339, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.34% (0.1327 => 0.1451, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 9.34% (0.2988 => 0.3267, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 9.27% (0.3192 => 0.3488, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.27% (0.5265 => 0.5753, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 9.27% (0.3453 => 0.3773, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.26% (0.7710 => 0.8424, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.25% (0.9199 => 1.0050, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.23% (0.6959 => 0.7601, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.12% (1.4563 => 1.5891, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 9.10% (13.8202 => 15.0773, std.dev.: 0.0150) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.98% (1.1364 => 1.2385, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 8.97% (0.3534 => 0.3851, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.92% (0.1435 => 0.1563, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.91% (0.4791 => 0.5218, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.91% (0.4390 => 0.4781, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.69% (0.3130 => 0.3402, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 8.52% (0.2945 => 0.3196, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 8.43% (1.0313 => 1.1182, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 8.37% (0.1589 => 0.1722) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.30% (0.6576 => 0.7122, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.25% (0.5577 => 0.6037, std.dev.: 0.0072) MultiSource/Applications/sgefa/sgefa: 8.15% (0.2995 => 0.3239, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.90% (0.2127 => 0.2295, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.89% (0.3246 => 0.3502, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.84% (0.1276 => 0.1376, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.80% (0.3755 => 0.4048, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/football/football: 7.76% (0.8310 => 0.8955, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 7.76% (0.6744 => 0.7267, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 7.74% (1.1061 => 1.1917, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.72% (0.4379 => 0.4717, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 7.67% (16.6129 => 17.8871, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 7.67% (3.8646 => 4.1610, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.67% (0.8698 => 0.9365, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.65% (0.5637 => 0.6068, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.60% (0.1986 => 0.2137, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.56% (3.6692 => 3.9465, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.49% (7.2180 => 7.7589, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.45% (0.7460 => 0.8016, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.45% (0.2914 => 0.3131, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 7.42% (0.3220 => 0.3459, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 7.30% (0.7506 => 0.8054, std.dev.: 0.0044) MultiSource/Applications/d/make_dparser: 7.29% (3.1889 => 3.4215, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/09-vor/vor: 7.28% (0.2925 => 0.3138, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 7.18% (0.2243 => 0.2404, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.07% (0.1569 => 0.1680, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 7.02% (2.1791 => 2.3321, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.97% (0.2023 => 0.2164, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 6.97% (0.1478 => 0.1581, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 6.97% (1.0594 => 1.1332, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 6.92% (1.9270 => 2.0603, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.92% (0.1865 => 0.1994, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 6.89% (1.2749 => 1.3628, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 6.76% (1.2292 => 1.3123, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.75% (1.3245 => 1.4139, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.70% (0.8818 => 0.9409, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 6.57% (14.8535 => 15.8293, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.52% (0.3511 => 0.3740, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 6.52% (0.3914 => 0.4169, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.48% (0.1789 => 0.1905, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.39% (4.3801 => 4.6600, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 6.37% (0.3578 => 0.3806, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.35% (0.4003 => 0.4257, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 6.34% (0.1657 => 0.1762) SingleSource/UnitTests/ObjC/for-in: 6.33% (0.3789 => 0.4029, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 6.28% (8.4961 => 9.0296, std.dev.: 0.0061) MultiSource/Applications/oggenc/oggenc: 6.26% (4.6629 => 4.9548, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions-4: 6.25% (0.3646 => 0.3874, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.21% (0.2140 => 0.2273, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 6.20% (0.4113 => 0.4368, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/property: 6.19% (0.3940 => 0.4184, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.18% (0.6135 => 0.6514, std.dev.: 0.0102) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.17% (4.4433 => 4.7173, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions-2: 6.16% (0.3601 => 0.3823, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.16% (0.3650 => 0.3875, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: 6.16% (0.3131 => 0.3324, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.12% (0.3663 => 0.3887, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.11% (0.2504 => 0.2657, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 6.10% (0.3623 => 0.3844, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 6.10% (0.6250 => 0.6631, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.04% (1.3819 => 1.4653, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.02% (1.3813 => 1.4645, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.96% (1.1333 => 1.2009, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: 5.95% (0.2859 => 0.3029, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.86% (4.9865 => 5.2785, std.dev.: 0.0034) MultiSource/Applications/JM/ldecod/ldecod: 5.84% (6.5754 => 6.9592, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.79% (0.3245 => 0.3433, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 5.79% (14.5298 => 15.3709, std.dev.: 0.0064) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.77% (0.1819 => 0.1924, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.77% (13.2842 => 14.0509, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.66% (3.2742 => 3.4595, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.64% (0.4805 => 0.5076, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.51% (0.2321 => 0.2449, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.16% (1.5188 => 1.5971, std.dev.: 0.0174) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.02% (0.9108 => 0.9565, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 4.70% (3.7467 => 3.9228, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 4.48% (33.2944 => 34.7851, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.39% (2.1007 => 2.1930, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.18% (6.2785 => 6.5412, std.dev.: 0.0046) MultiSource/Applications/sqlite3/sqlite3: 2.42% (16.2614 => 16.6555, std.dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5157, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 23.86% (1.8175 => 2.2512, std.dev.: 0.0137) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.67% (1.1560 => 1.2562, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4140, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.14% (1.2998 => 1.3796, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0039, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.65% (0.3139 => 0.3285, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.12% (11.2619 => 11.7259, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9853, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 3.06% (10.7476 => 11.0760, std.dev.: 0.0141) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.14% (7.4271 => 7.5859, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.50% (1.4298 => 1.4513, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5138, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9692, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.32% (5.5130 => 5.5859, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1879, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 1.14% (12.4560 => 12.5976, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 1.08% (12.0921 => 12.2225, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (2.2986 => 2.3233, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.03% (3.6469 => 3.6846, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -16.60% (0.4657 => 0.3884, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -3.75% (0.2670 => 0.2570, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.57% (22.5627 => 21.9823, std.dev.: 0.0083) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: -12.38% (1.2308 => 1.0784, std.dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.12% (20.3410 => 18.2825, std.dev.: 0.0112) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.36% (1.3780 => 1.2903, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5150, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7940, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1560, std.dev.: 0.0054) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.46% (1.7688 => 1.7076, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.68% (3.0263 => 2.9452, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4786, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.33% (1.9762 => 1.9302, std.dev.: 0.0008) SingleSource/Regression/C/uint64_to_float: -2.11% (0.5449 => 0.5334) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (28.2225 => 27.7050, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.80% (0.6615 => 0.6496, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.73% (7.3305 => 7.2034, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout/lists: -1.73% (6.3560 => 6.2460, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.73% (0.6589 => 0.6475, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0078, std.dev.: 0.0006) MultiSource/Applications/lua/lua: -1.39% (26.5159 => 26.1465, std.dev.: 0.0364) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2507, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.16% (2.5254 => 2.4960, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.10% (3.9173 => 3.8742, std.dev.: 0.0033) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 1 19:43:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 1 Oct 2012 21:43:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121002024356.829852A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4465?compare_to=4460&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4465, Order: 164983, Start Time: 2012-10-02 01:25:06, End Time: 2012-10-02 02:45:35 To: 4460, Order: 164970, Start Time: 2012-10-01 21:35:56, End Time: 2012-10-01 22:56:19 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (147 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 92 (18 on baseline) Unchanged Tests: 947 (702 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.21% (0.8704 => 0.8809, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.78% (54.8667 => 56.3926, std.dev.: 0.1255) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -4.47% (15.6878 => 14.9868, std.dev.: 0.0072) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.17% (0.5748 => 0.5758, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 0.22% (15.9529 => 15.9878, std.dev.: 0.0136) MultiSource/Applications/kimwitu++/kc: 0.00% (14.9112 => 14.9117, std.dev.: 0.0249) MultiSource/Benchmarks/Bullet/bullet: 0.21% (83.7307 => 83.9055, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/gs/gs: 0.16% (4.3300 => 4.3369, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0456 => 0.0456, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0458 => 0.0458) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.24% (0.0425 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.23% (0.0427 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.24% (0.0415 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.24% (0.0418 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.24% (0.0409 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.24% (0.0410 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.23% (0.0426 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.23% (0.0428 => 0.0429) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0422 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0423 => 0.0423, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.24% (0.0411 => 0.0412, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.24% (0.0412 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0419 => 0.0419) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0420 => 0.0420, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0430 => 0.0430, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.93% (0.0431 => 0.0435, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.25% (0.0406 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0408 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.24% (0.0418 => 0.0419) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.24% (0.0419 => 0.0420) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0410 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.24% (0.0411 => 0.0412) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.25% (0.0402 => 0.0403, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.25% (0.0402 => 0.0403, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.25% (0.0400 => 0.0401) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0402 => 0.0402, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0438 => 0.0438) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0439 => 0.0439, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.25% (0.0399 => 0.0400, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.25% (0.0400 => 0.0401, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.25% (0.0401 => 0.0402, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0402 => 0.0402, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0409 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0410 => 0.0410) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.01% (1.2301 => 1.2300, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.10% (7.5342 => 7.5415, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.02% (3.7235 => 3.7241, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.17% (0.6501 => 0.6490, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1430 => 0.1431, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0684 => 0.0683, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: 32.67% (63.2438 => 83.9055, std.dev.: 0.0057) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14230.00% (0.0720 => 10.3176, std.dev.: 0.0034) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 44.56% (10.3673 => 14.9868, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/richards_benchmark: 28.98% (0.1622 => 0.2092, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.43% (2.2022 => 2.5419, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.83% (7.0540 => 8.0998, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 13.69% (0.1432 => 0.1628, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 13.17% (1.1194 => 1.2668, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.84% (0.1566 => 0.1767, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.47% (0.0834 => 0.0938, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.91% (1.7609 => 1.9707, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/oourafft: 10.09% (0.3282 => 0.3613, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.04% (0.1584 => 0.1743, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.73% (0.3473 => 0.3811, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.71% (0.3543 => 0.3887, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 9.58% (0.3497 => 0.3832, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-4: 9.48% (0.3543 => 0.3879, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 9.47% (0.3516 => 0.3849, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/synchronized: 9.41% (0.3561 => 0.3896, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.23% (0.3694 => 0.4035, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 9.12% (0.3927 => 0.4285, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 9.09% (0.3828 => 0.4176, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 8.82% (10.4361 => 11.3565, std.dev.: 0.0102) SingleSource/UnitTests/ObjC/property: 8.80% (0.3886 => 0.4228, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.61% (0.4879 => 0.5299, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 8.20% (0.5925 => 0.6411, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.14% (0.6030 => 0.6521, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 8.12% (9.4845 => 10.2546, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/power/power: 8.06% (0.1440 => 0.1556, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 8.04% (0.1655 => 0.1788, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.99% (0.3177 => 0.3431, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.93% (0.6675 => 0.7204, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.79% (0.8172 => 0.8809, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.78% (0.5105 => 0.5502, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 7.74% (0.7115 => 0.7666, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.72% (0.1438 => 0.1549, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 7.40% (5.7591 => 6.1854, std.dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: 7.31% (0.7433 => 0.7976, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference: 7.18% (0.7326 => 0.7852, std.dev.: 0.0026) MultiSource/Applications/sgefa/sgefa: 7.17% (0.3109 => 0.3332, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.04% (0.2700 => 0.2890, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 6.87% (0.3423 => 0.3658, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.85% (1.5415 => 1.6471, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.83% (0.1625 => 0.1736, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.83% (0.4615 => 0.4930, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 6.81% (3.3354 => 3.5625, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/08-main/main: 6.77% (0.2554 => 0.2727, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.69% (0.8067 => 0.8607, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.69% (0.2271 => 0.2423, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.67% (4.2646 => 4.5492, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.62% (0.5860 => 0.6248, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.61% (1.3050 => 1.3913, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.53% (0.3307 => 0.3523, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 6.52% (0.3422 => 0.3645, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 6.49% (0.1695 => 0.1805, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.48% (0.5569 => 0.5930, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.45% (0.4636 => 0.4935, std.dev.: 0.0095) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.44% (0.1940 => 0.2065, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.40% (0.2891 => 0.3076, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.34% (5.0018 => 5.3190, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.34% (8.1363 => 8.6522, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.31% (4.9449 => 5.2568, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.25% (0.2065 => 0.2194, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.24% (0.5020 => 0.5333, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash: 6.23% (0.4289 => 0.4556, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 6.09% (0.2905 => 0.3082, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 6.06% (0.6456 => 0.6847, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.05% (0.4064 => 0.4310, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.00% (0.2831 => 0.3001, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 5.98% (0.2725 => 0.2888, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.98% (0.3865 => 0.4096, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.97% (0.4103 => 0.4348, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.96% (0.3121 => 0.3307, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 5.95% (0.3092 => 0.3276, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.95% (0.4203 => 0.4453, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.95% (0.3650 => 0.3867, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.94% (0.3283 => 0.3478, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 5.93% (0.7835 => 0.8300, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.93% (0.2107 => 0.2232, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.92% (0.1892 => 0.2004, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.91% (0.2758 => 0.2921, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/matrix: 5.91% (0.3098 => 0.3281, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.88% (0.3232 => 0.3422, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.86% (0.9765 => 1.0337, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/moments: 5.85% (0.4048 => 0.4285, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.83% (0.3603 => 0.3813, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.83% (1.5603 => 1.6512, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.81% (0.2872 => 0.3039, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.81% (7.9617 => 8.4245, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.81% (2.0665 => 2.1866, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.80% (0.3136 => 0.3318, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 5.78% (0.2714 => 0.2871, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.78% (0.2871 => 0.3037, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.77% (0.2756 => 0.2915, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.77% (0.3052 => 0.3228, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 5.74% (1.1642 => 1.2310, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 5.74% (0.4620 => 0.4885, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.72% (0.3162 => 0.3343, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.72% (0.3826 => 0.4045, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 5.72% (21.9371 => 23.1921, std.dev.: 0.0161) MultiSource/Applications/lua/lua: 5.63% (3.8723 => 4.0903, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/05-eks/eks: 5.61% (0.4299 => 0.4540, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 5.59% (1.0722 => 1.1321, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.59% (0.2793 => 0.2949, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.57% (0.2802 => 0.2958, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 5.55% (0.3387 => 0.3575, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.54% (0.3935 => 0.4153, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.43% (1.1861 => 1.2505, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/lists1: 5.43% (0.3684 => 0.3884, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.42% (0.3379 => 0.3562, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.39% (0.2877 => 0.3032, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.34% (0.2603 => 0.2742, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.26% (0.3441 => 0.3622, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 5.25% (2.0273 => 2.1338, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/09-vor/vor: 5.19% (0.3180 => 0.3345, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 5.01% (0.8921 => 0.9368, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.84% (0.6450 => 0.6762, std.dev.: 0.0018) MultiSource/Applications/siod/siod: 4.72% (2.2969 => 2.4053, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.62% (1.5859 => 1.6592, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.56% (0.5981 => 0.6254, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.32% (1.4186 => 1.4799, std.dev.: 0.0048) MultiSource/Benchmarks/nbench/nbench: 4.12% (1.1840 => 1.2328, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.08% (2.2024 => 2.2922, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.99% (14.3668 => 14.9398, std.dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: 3.81% (1.2842 => 1.3331, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 3.74% (0.3131 => 0.3248, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.99% (0.8101 => 0.8343, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.89% (3.8922 => 3.9659, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: 1.69% (17.1811 => 17.4716, std.dev.: 0.0114) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.92% (0.1421 => 0.1562, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 9.20% (3.1595 => 3.4502, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 6.69% (1.1396 => 1.2158, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (3.1578 => 3.3679, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.53% (3.6395 => 3.7679, std.dev.: 0.0030) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.81% (4.2280 => 4.3469, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.34% (1.7254 => 1.7657, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7985, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.26% (9.1159 => 9.2307, std.dev.: 0.0302) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5754, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1280, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.14% (5.2763 => 3.2638, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.33% (5.3855 => 3.9139, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -26.89% (5.3526 => 3.9131, std.dev.: 0.0054) SingleSource/UnitTests/Vector/constpool: -14.79% (54.1659 => 46.1550, std.dev.: 0.0109) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.02% (2.9384 => 2.6146, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -7.76% (22.1758 => 20.4539, std.dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -16.04% (1.6925 => 1.4211, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: -12.05% (1.2373 => 1.0882, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/mandel-2: -10.28% (1.5373 => 1.3793, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.28% (19.9488 => 18.2969, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4787, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.63% (1.8329 => 1.7113, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7916, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.96% (1.6805 => 1.5971, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) SingleSource/Benchmarks/Misc/flops-5: -4.87% (1.5835 => 1.5064, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.72% (3.2827 => 3.1607, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5024, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.08% (8.6802 => 8.5000, std.dev.: 0.0221) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.02% (8.1563 => 7.9918, std.dev.: 0.0123) MultiSource/Applications/hexxagon/hexxagon: -1.79% (12.4730 => 12.2498, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -1.77% (10.2830 => 10.1005, std.dev.: 0.0238) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6796, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.65% (2.5528 => 2.5107, std.dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4211, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout/lists: -1.36% (6.2999 => 6.2141, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout/hash: -1.08% (4.9088 => 4.8557, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.12% (0.5229 => 0.5758, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 6.66% (14.9895 => 15.9878, std.dev.: 0.0136) MultiSource/Applications/kimwitu++/kc: 5.34% (14.1553 => 14.9117, std.dev.: 0.0249) MultiSource/Benchmarks/MallocBench/gs/gs: 5.51% (4.1105 => 4.3369, std.dev.: 0.0092) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.33% (1.1048 => 1.2300, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.35% (7.1582 => 7.5415, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.54% (3.4629 => 3.7241, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.31% (0.6222 => 0.6490, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.72% (0.2116 => 0.0683, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 1 20:46:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 1 Oct 2012 22:46:11 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121002034611.D24032A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4466?compare_to=4463&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4466, Order: 164984, Start Time: 2012-10-02 02:25:30, End Time: 2012-10-02 03:47:52 To: 4463, Order: 164982, Start Time: 2012-10-02 00:47:02, End Time: 2012-10-02 02:09:42 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (10 on baseline) Performance Regressions: 20 (84 on baseline) Performance Improvements: 1 (41 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 952 (766 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.23% (0.5450 => 0.5844, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.76% (0.7637 => 0.8077, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.22% (0.2843 => 0.2963, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.17% (0.7636 => 0.7878, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.66% (0.8924 => 0.9161, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.97% (1.2013 => 1.2250, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.87% (1.3857 => 1.4116, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 1.78% (3.8997 => 3.9691, std.dev.: 0.0183) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.68% (1.2748 => 1.2962, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.50% (0.7335 => 0.7445, std.dev.: 0.0018) MultiSource/Applications/treecc/treecc: 1.32% (1.9196 => 1.9450, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.30% (8.2550 => 8.3627, std.dev.: 0.0360) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.26% (4.3689 => 4.4238, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.21% (0.8323 => 0.8424, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 1.06% (0.9439 => 0.9539, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.03% (1.4307 => 1.4455, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.01% (4.2972 => 4.3406, std.dev.: 0.0153) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/except: 2.32% (0.4874 => 0.4987, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/whetstone: 1.67% (2.3552 => 2.3946, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.10% (4.7524 => 4.8045, std.dev.: 0.0129) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -5.64% (9.0343 => 8.5250, std.dev.: 0.0749) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.63% (1.0072 => 1.0135, std.dev.: 0.0068) MultiSource/Applications/sqlite3/sqlite3: 1.46% (0.6099 => 0.6188, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/08-main/main: 3.89% (0.1618 => 0.1681, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.19% (0.1566 => 0.1569, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.06% (0.3058 => 0.3121, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.39% (0.2329 => 0.2320, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.55% (0.3161 => 0.3210, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.20% (0.2277 => 0.2327, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: 0.45% (0.0449 => 0.0451, std.dev.: 0.0016) SingleSource/UnitTests/2003-05-07-VarArgs: 175.00% (0.0032 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0089 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.08% (0.0240 => 0.0245, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.56% (0.0192 => 0.0195, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.57% (0.0382 => 0.0388, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.01% (0.0296 => 0.0299, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.15% (0.0279 => 0.0285, std.dev.: 0.0056) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.62% (0.0321 => 0.0323, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 1.69% (0.0178 => 0.0181, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 2.11% (0.0190 => 0.0194, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -4.86% (0.0247 => 0.0235, std.dev.: 0.0010) SingleSource/UnitTests/byval-alignment: 0.93% (0.0324 => 0.0327, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 100.00% (0.0005 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.76% (0.1441 => 0.1452, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 1.43% (1.4995 => 1.5209, std.dev.: 0.0238) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 5.96% (0.1427 => 0.1512, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: 150.00% (0.0002 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.62% (0.4069 => 0.4257, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.33% (0.1431 => 0.1369, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.06% (0.0613 => 0.0644, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 21.97% (0.0173 => 0.0211, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.37% (0.0563 => 0.0582, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.45% (1.1309 => 1.1258, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 145.45% (0.0011 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 380.00% (0.0005 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.20% (0.0572 => 0.0548, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.37% (0.0208 => 0.0215, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.13% (0.7643 => 0.7653, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.18% (1.6014 => 1.5985, std.dev.: 0.0070) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.19% (4.1772 => 3.0834, std.dev.: 0.0234) SingleSource/Benchmarks/Shootout-C++/except: 83016.67% (0.0006 => 0.4987, std.dev.: 0.0024) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.82% (0.0745 => 0.0915, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.48% (0.1414 => 0.1548, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.06% (0.1159 => 0.1264, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 8.46% (0.5309 => 0.5758, std.dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: 8.02% (2.1763 => 2.3509, std.dev.: 0.0087) MultiSource/Applications/minisat/minisat: 7.40% (0.6173 => 0.6630, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.00% (0.6410 => 0.6859, std.dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: 6.69% (1.1653 => 1.2433, std.dev.: 0.0047) MultiSource/Applications/lemon/lemon: 6.43% (1.0046 => 1.0692, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.06% (0.3582 => 0.3799, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.60% (0.2552 => 0.2695, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 5.45% (0.6915 => 0.7292, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.14% (0.6069 => 0.6381, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 5.01% (15.3105 => 16.0782, std.dev.: 0.0321) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.00% (1.5150 => 1.5908, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/18-imp/imp: 4.76% (0.3217 => 0.3370, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: 4.63% (29.3170 => 30.6749, std.dev.: 0.0521) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.60% (0.7722 => 0.8077, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.49% (0.7639 => 0.7982, std.dev.: 0.0031) MultiSource/Applications/d/make_dparser: 4.43% (3.0225 => 3.1565, std.dev.: 0.0328) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.30% (0.4880 => 0.5090, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.17% (0.4248 => 0.4425, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.08% (0.3062 => 0.3187, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.97% (0.2797 => 0.2908, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.94% (12.6413 => 13.1399, std.dev.: 0.0267) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.92% (0.3901 => 0.4054, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 3.79% (13.3238 => 13.8290, std.dev.: 0.1601) MultiSource/Applications/oggenc/oggenc: 3.78% (4.7455 => 4.9247, std.dev.: 0.0582) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.76% (1.1672 => 1.2111, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/09-vor/vor: 3.70% (0.3026 => 0.3138, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.58% (1.1827 => 1.2250, std.dev.: 0.0072) MultiSource/Applications/treecc/treecc: 3.47% (1.8798 => 1.9450, std.dev.: 0.0056) MultiSource/Applications/Burg/burg: 3.46% (1.1440 => 1.1836, std.dev.: 0.0146) MultiSource/Applications/hbd/hbd: 3.23% (1.3268 => 1.3696, std.dev.: 0.0096) MultiSource/Applications/JM/ldecod/ldecod: 3.15% (6.4908 => 6.6951, std.dev.: 0.0371) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.03% (0.7226 => 0.7445, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.03% (1.2021 => 1.2385, std.dev.: 0.0031) MultiSource/Applications/ClamAV/clamscan: 3.02% (14.6079 => 15.0489, std.dev.: 0.0922) MultiSource/Benchmarks/mafft/pairlocalalign: 2.90% (8.2186 => 8.4571, std.dev.: 0.0133) MultiSource/Applications/lua/lua: 2.89% (3.5980 => 3.7021, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.82% (1.4408 => 1.4815, std.dev.: 0.0094) MultiSource/Applications/JM/lencod/lencod: 2.72% (14.7256 => 15.1262, std.dev.: 0.0917) MultiSource/Benchmarks/nbench/nbench: 2.72% (1.0821 => 1.1115, std.dev.: 0.0107) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.68% (6.2546 => 6.4223, std.dev.: 0.0208) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.57% (4.0318 => 4.1355, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.42% (0.8569 => 0.8776, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/gs/gs: 2.31% (3.8796 => 3.9691, std.dev.: 0.0183) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.27% (1.4113 => 1.4433, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.10% (2.0317 => 2.0743, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.98% (4.3380 => 4.4238, std.dev.: 0.0191) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.87% (1.4189 => 1.4455, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.83% (0.5636 => 0.5739, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.73% (1.2742 => 1.2962, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.46% (0.9029 => 0.9161, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.38% (4.2815 => 4.3406, std.dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.30% (1.3935 => 1.4116, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.29% (8.2559 => 8.3627, std.dev.: 0.0360) MultiSource/Applications/hexxagon/hexxagon: 1.21% (0.9425 => 0.9539, std.dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.36% (1.6538 => 2.3378, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 22.10% (3.4629 => 4.2281, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout/ary3: 14.58% (1.7426 => 1.9967, std.dev.: 0.0257) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.69% (4.0101 => 4.5589, std.dev.: 0.0750) SingleSource/Benchmarks/Stanford/Puzzle: 13.61% (0.1433 => 0.1628, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 10.80% (1.6261 => 1.8018, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.07% (0.2857 => 0.3116, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/lists: 8.71% (7.0025 => 7.6126, std.dev.: 0.0750) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.90% (1.0063 => 1.0858, std.dev.: 0.0265) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.39% (0.3301 => 0.3479, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.38% (40.4792 => 42.6568, std.dev.: 0.3556) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5414, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: 3.83% (15.2242 => 15.8069, std.dev.: 0.0753) SingleSource/Benchmarks/Misc/dt: 3.76% (0.9851 => 1.0221, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.53% (0.5587 => 0.5784, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.22% (0.8498 => 0.8772, std.dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: 2.81% (14.4877 => 14.8955, std.dev.: 0.0180) MultiSource/Benchmarks/FreeBench/mason/mason: 2.70% (0.5004 => 0.5139, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.54% (4.2129 => 4.3198, std.dev.: 0.0304) MultiSource/Applications/siod/siod: 2.41% (3.5520 => 3.6375, std.dev.: 0.0252) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.31% (0.5876 => 0.6012, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.13% (6.6312 => 6.7727, std.dev.: 0.0142) SingleSource/Benchmarks/Misc/whetstone: 2.10% (2.3453 => 2.3946, std.dev.: 0.0070) SingleSource/Benchmarks/Dhrystone/dry: 2.03% (2.4013 => 2.4500, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: 1.95% (0.6308 => 0.6431, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.4184 => 1.4393, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -5.25% (8.9977 => 8.5250, std.dev.: 0.0749) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.21% (0.3497 => 0.2126, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.32% (5.2665 => 4.0911, std.dev.: 0.1215) SingleSource/Benchmarks/Shootout-C++/ary3: -20.05% (1.7473 => 1.3969, std.dev.: 0.0144) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -17.30% (1.1647 => 0.9632, std.dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.20% (15.8312 => 13.2665, std.dev.: 0.0858) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1590, std.dev.: 0.0906) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.29% (1.4034 => 1.2870, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.12% (3.2007 => 2.9407, std.dev.: 0.0551) MultiSource/Applications/lambda-0_1_3/lambda: -7.24% (7.6833 => 7.1272, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.97% (3.6254 => 3.3727, std.dev.: 0.0286) SingleSource/Benchmarks/Shootout-C++/fibo: -6.56% (4.6355 => 4.3313, std.dev.: 0.0228) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.56% (2.0027 => 1.8713, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -6.26% (1.4441 => 1.3537, std.dev.: 0.0174) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.00% (2.9728 => 2.7944, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -5.55% (62.4126 => 58.9518, std.dev.: 0.3073) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.47% (3.9413 => 3.7259, std.dev.: 0.0299) SingleSource/Benchmarks/Shootout/fib2: -5.18% (4.4195 => 4.1907, std.dev.: 0.0280) MultiSource/Applications/SIBsim4/SIBsim4: -4.97% (3.4230 => 3.2530, std.dev.: 0.0125) MultiSource/Applications/sgefa/sgefa: -4.48% (0.3746 => 0.3578, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.34% (0.4564 => 0.4366, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -4.18% (2.5166 => 2.4113, std.dev.: 0.0219) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.02% (1.2722 => 1.2211, std.dev.: 0.0163) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.85% (2.4457 => 2.3515, std.dev.: 0.0246) SingleSource/Benchmarks/McGill/misr: -3.47% (0.4296 => 0.4147, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: -3.40% (9.2503 => 8.9362, std.dev.: 0.0516) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.04% (0.4140 => 0.4014, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.82% (3.7496 => 3.6440, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/flops: -2.75% (9.5474 => 9.2847, std.dev.: 0.0139) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.42% (1.1683 => 1.1400, std.dev.: 0.0060) MultiSource/Applications/lua/lua: -2.36% (29.5232 => 28.8270, std.dev.: 0.0373) MultiSource/Benchmarks/PAQ8p/paq8p: -2.26% (92.7467 => 90.6547, std.dev.: 0.0931) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.91% (1.8739 => 1.8382, std.dev.: 0.0107) MultiSource/Benchmarks/FreeBench/neural/neural: -1.88% (1.0926 => 1.0721, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.81% (1.0686 => 1.0493, std.dev.: 0.0014) MultiSource/Applications/aha/aha: -1.80% (3.4286 => 3.3669, std.dev.: 0.0217) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.78% (2.3569 => 2.3149, std.dev.: 0.0046) MultiSource/Applications/JM/lencod/lencod: -1.71% (6.7458 => 6.6305, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.63% (9.3855 => 9.2322, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3061, std.dev.: 0.1143) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.40% (27.1724 => 26.7933, std.dev.: 0.1255) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.55% (0.9980 => 1.0135, std.dev.: 0.0068) MultiSource/Applications/sqlite3/sqlite3: 2.76% (0.6022 => 0.6188, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/08-main/main: 0.90% (0.1666 => 0.1681, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.97% (0.1554 => 0.1569, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.23% (0.3083 => 0.3121, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.09% (0.2394 => 0.2320, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.10% (0.3175 => 0.3210, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.09% (0.2302 => 0.2327, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: 0.45% (0.0449 => 0.0451, std.dev.: 0.0016) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.08% (0.0240 => 0.0245, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.56% (0.0192 => 0.0195, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.51% (0.0390 => 0.0388, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.66% (0.0301 => 0.0299, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.35% (0.0284 => 0.0285, std.dev.: 0.0056) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.31% (0.0324 => 0.0323, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 2.26% (0.0177 => 0.0181, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 2.65% (0.0189 => 0.0194, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.62% (0.0249 => 0.0235, std.dev.: 0.0010) SingleSource/UnitTests/byval-alignment: 0.62% (0.0325 => 0.0327, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.61% (0.1429 => 0.1452, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 1.27% (1.5019 => 1.5209, std.dev.: 0.0238) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.73% (0.1501 => 0.1512, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.16% (0.4264 => 0.4257, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.86% (0.1344 => 0.1369, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.34% (0.0589 => 0.0644, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -9.05% (0.0232 => 0.0211, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.92% (0.0639 => 0.0582, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.81% (1.1350 => 1.1258, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 350.00% (0.0006 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.97% (0.0637 => 0.0548, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.60% (0.0246 => 0.0215, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.49% (0.7541 => 0.7653, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 4.05% (1.5363 => 1.5985, std.dev.: 0.0070) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 1 21:27:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 1 Oct 2012 23:27:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121002042729.DD8722A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4467?compare_to=4464&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4467, Order: 164984, Start Time: 2012-10-02 03:01:51, End Time: 2012-10-02 04:27:25 To: 4464, Order: 164983, Start Time: 2012-10-02 01:07:26, End Time: 2012-10-02 02:32:58 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 2 (175 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1037 (696 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.79% (54.3175 => 56.3743, std.dev.: 0.0834) SingleSource/Benchmarks/McGill/chomp: 1.63% (1.0784 => 1.0960, std.dev.: 0.0028) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.03% (2.7520 => 2.7528, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (2.1154 => 2.1154, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.01% (4.9751 => 4.9748, std.dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.03% (2.0176 => 2.4420, std.dev.: 0.0037) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.31% (0.1410 => 0.1640, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 14.89% (0.0826 => 0.0949) SingleSource/UnitTests/ObjC++/property-reference-object: 12.74% (0.5818 => 0.6559, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 12.61% (0.5748 => 0.6473, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 11.66% (0.7061 => 0.7884, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 11.34% (0.4328 => 0.4819, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 11.23% (0.4062 => 0.4518, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.11% (0.1413 => 0.1570, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 11.11% (0.2781 => 0.3090, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 10.76% (0.1013 => 0.1122, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.73% (0.1072 => 0.1187, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.71% (0.2782 => 0.3080, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.58% (0.1588 => 0.1756, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 10.43% (1.3693 => 1.5121, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.40% (3.9660 => 4.3783, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.39% (0.3899 => 0.4304, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.32% (0.3022 => 0.3334, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.24% (0.2655 => 0.2927, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 10.20% (0.2607 => 0.2873, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.16% (0.3485 => 0.3839, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.16% (1.9828 => 2.1842, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 10.15% (0.2690 => 0.2963, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.07% (0.2721 => 0.2995, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 10.04% (0.2760 => 0.3037, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 10.01% (0.2937 => 0.3231, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 10.01% (0.2628 => 0.2891, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 10.00% (0.2761 => 0.3037, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 9.98% (0.2726 => 0.2998, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.91% (0.2765 => 0.3039, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.91% (0.7710 => 0.8474, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 9.89% (0.7038 => 0.7734, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 9.87% (0.3293 => 0.3618, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.86% (0.4016 => 0.4412, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.85% (0.3756 => 0.4126, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.84% (0.2966 => 0.3258, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.83% (0.3580 => 0.3932, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.83% (0.2696 => 0.2961, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.82% (0.2596 => 0.2851, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.80% (0.3489 => 0.3831, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.79% (0.6283 => 0.6898, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 9.77% (0.3868 => 0.4246, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 9.75% (0.3107 => 0.3410, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.67% (1.2193 => 1.3372, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.65% (0.1327 => 0.1455, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.60% (0.6959 => 0.7627, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary3: 9.53% (0.3149 => 0.3449, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 9.47% (0.2988 => 0.3271, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 9.47% (0.3453 => 0.3780, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.44% (0.5265 => 0.5762, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.36% (0.9199 => 1.0060, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 9.34% (0.3192 => 0.3490, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 9.32% (13.8202 => 15.1088, std.dev.: 0.0154) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.26% (1.4563 => 1.5911, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.16% (0.4791 => 0.5230, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 9.14% (0.3534 => 0.3857, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.07% (0.4390 => 0.4788, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.06% (1.1364 => 1.2394, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.88% (0.3130 => 0.3408, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.77% (0.6576 => 0.7153, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 8.75% (0.1589 => 0.1728, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 8.69% (0.2945 => 0.3201, std.dev.: 0.0095) MultiSource/Applications/lemon/lemon: 8.58% (1.0313 => 1.1198, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.57% (0.1435 => 0.1558, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.46% (0.5577 => 0.6049, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 8.28% (0.2995 => 0.3243, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.27% (0.2127 => 0.2303, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.21% (0.1986 => 0.2149, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.07% (0.3755 => 0.4058, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.02% (0.4379 => 0.4730, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.01% (0.3246 => 0.3506, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.00% (0.2914 => 0.3147, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 7.99% (0.6744 => 0.7283, std.dev.: 0.0027) MultiSource/Applications/Burg/burg: 7.95% (1.1061 => 1.1940, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 7.92% (0.8310 => 0.8968, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.85% (3.6692 => 3.9572, std.dev.: 0.0046) MultiSource/Applications/kimwitu++/kc: 7.84% (16.6129 => 17.9152, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.82% (0.8698 => 0.9378, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.81% (0.5637 => 0.6077, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.80% (7.2180 => 7.7812, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/gs/gs: 7.74% (3.8646 => 4.1639, std.dev.: 0.0115) MultiSource/Benchmarks/McCat/18-imp/imp: 7.64% (0.3220 => 0.3466, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 7.61% (0.7506 => 0.8077, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.60% (0.7460 => 0.8027, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/09-vor/vor: 7.52% (0.2925 => 0.3145, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 7.47% (3.1889 => 3.4272, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.46% (0.1569 => 0.1686, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 7.45% (0.2243 => 0.2410, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 7.41% (0.3578 => 0.3843, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.36% (0.3601 => 0.3866, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: 7.32% (0.4003 => 0.4296, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.31% (0.3789 => 0.4066, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.27% (0.2023 => 0.2170, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.24% (0.3646 => 0.3910, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.23% (0.3650 => 0.3914, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.23% (0.3914 => 0.4197, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 7.14% (1.0594 => 1.1350, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 7.13% (2.1791 => 2.3345, std.dev.: 0.0173) MultiSource/Applications/treecc/treecc: 7.13% (1.9270 => 2.0644, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/synchronized: 7.13% (0.3663 => 0.3924, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.10% (0.8818 => 0.9444, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.08% (0.1865 => 0.1997, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.06% (0.3940 => 0.4218, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-3: 7.01% (0.3623 => 0.3877, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.01% (1.3245 => 1.4173, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 6.97% (0.1478 => 0.1581, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 6.96% (1.2749 => 1.3636, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 6.92% (1.2292 => 1.3142, std.dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 6.85% (14.8535 => 15.8707, std.dev.: 0.0097) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.82% (0.1789 => 0.1911, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.64% (0.3511 => 0.3744, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 6.61% (0.4113 => 0.4385, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/em3d/em3d: 6.58% (0.1657 => 0.1766, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.52% (0.6135 => 0.6535, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 6.52% (8.4961 => 9.0500, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.52% (4.3801 => 4.6656, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.50% (0.2140 => 0.2279, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.50% (4.4433 => 4.7319, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: 6.36% (0.3131 => 0.3330, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.35% (1.3813 => 1.4690, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/bigfib: 6.27% (0.6250 => 0.6642, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.27% (1.3819 => 1.4685, std.dev.: 0.0032) MultiSource/Applications/oggenc/oggenc: 6.18% (4.6629 => 4.9509, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 6.16% (0.2859 => 0.3035, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.08% (13.2842 => 14.0915, std.dev.: 0.0123) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.07% (4.9865 => 5.2891, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.06% (1.1333 => 1.2020, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 6.04% (6.5754 => 6.9726, std.dev.: 0.0145) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.03% (0.2504 => 0.2655, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.00% (3.2742 => 3.4707, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.98% (0.3245 => 0.3439, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 5.91% (14.5298 => 15.3890, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.89% (0.4805 => 0.5088, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.88% (0.1819 => 0.1926, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.73% (0.2321 => 0.2454, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.29% (1.5188 => 1.5991, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.26% (0.9108 => 0.9587, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 4.89% (3.7467 => 3.9301, std.dev.: 0.0098) MultiSource/Benchmarks/Bullet/bullet: 4.64% (33.2944 => 34.8389, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.63% (2.1007 => 2.1980, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.60% (6.2785 => 6.5675, std.dev.: 0.0168) MultiSource/Applications/sqlite3/sqlite3: 2.58% (16.2614 => 16.6806, std.dev.: 0.0119) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.79% (0.4846 => 0.6968, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5161, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.38% (1.8175 => 2.2606, std.dev.: 0.0161) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 8.66% (1.1560 => 1.2561, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/mst/mst: 8.47% (0.1322 => 0.1434, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4137, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.15% (1.2998 => 1.3798, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626) SingleSource/Benchmarks/Misc/flops-5: 4.63% (1.9144 => 2.0031, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.10% (11.2619 => 11.7236, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.35% (1.9199 => 1.9842, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 2.82% (10.7476 => 11.0503, std.dev.: 0.0369) SingleSource/Benchmarks/Misc/salsa20: 2.31% (7.4271 => 7.5984, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.50% (1.4298 => 1.4512, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5134, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/oourafft: 1.28% (5.5130 => 5.5836, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9677, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1878, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 1.14% (12.4560 => 12.5981, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 1.09% (12.0921 => 12.2242, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (2.2986 => 2.3233, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/block-byref-aggr: -15.74% (0.4657 => 0.3924, std.dev.: 0.0061) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.35% (22.5627 => 22.0331, std.dev.: 0.0077) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.33% (1.0460 => 0.8543, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.95% (1.2308 => 1.0960, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.07% (20.3410 => 18.2930, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.70% (1.3780 => 1.2995, std.dev.: 0.0098) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3744, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.16% (2.6470 => 2.5105, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.44% (5.0168 => 4.7939, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.52% (3.2729 => 3.1578, std.dev.: 0.0254) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.41% (1.7688 => 1.7085, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.96% (0.4867 => 0.4723, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.70% (3.0263 => 2.9446, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4788, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.21% (1.9762 => 1.9325, std.dev.: 0.0097) MultiSource/Benchmarks/mafft/pairlocalalign: -1.84% (28.2225 => 27.7046, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.80% (0.6615 => 0.6496, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -1.71% (6.3560 => 6.2473, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.65% (0.6589 => 0.6480, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.51% (7.3305 => 7.2201, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0076, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: -1.29% (9.3358 => 9.2150, std.dev.: 0.0130) MultiSource/Applications/lua/lua: -1.28% (26.5159 => 26.1774, std.dev.: 0.0163) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2507, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4950, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.16% (3.9173 => 3.8718, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.03% (6.6320 => 6.5639, std.dev.: 0.0094) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 1 21:33:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 1 Oct 2012 23:33:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121002043321.7DDCE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4468?compare_to=4465&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4468, Order: 164984, Start Time: 2012-10-02 03:14:41, End Time: 2012-10-02 04:35:00 To: 4465, Order: 164983, Start Time: 2012-10-02 01:25:06, End Time: 2012-10-02 02:45:35 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (148 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 92 (18 on baseline) Unchanged Tests: 949 (701 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.28% (0.8809 => 0.8696, std.dev.: 0.0021) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.07% (0.5758 => 0.5754, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 0.07% (15.9878 => 15.9993, std.dev.: 0.0241) MultiSource/Applications/kimwitu++/kc: 0.07% (14.9117 => 14.9219, std.dev.: 0.0141) MultiSource/Benchmarks/Bullet/bullet: 0.05% (83.9055 => 83.9437, std.dev.: 0.0233) MultiSource/Benchmarks/MallocBench/gs/gs: -0.05% (4.3369 => 4.3348, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.22% (0.0456 => 0.0457, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.22% (0.0458 => 0.0459, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.23% (0.0426 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.23% (0.0428 => 0.0429, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.24% (0.0416 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.24% (0.0417 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.49% (0.0410 => 0.0412, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.24% (0.0411 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.23% (0.0427 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.23% (0.0429 => 0.0430, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.24% (0.0422 => 0.0423) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.24% (0.0423 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.24% (0.0412 => 0.0413) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.24% (0.0413 => 0.0414, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.24% (0.0419 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.24% (0.0420 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.47% (0.0430 => 0.0432, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.46% (0.0435 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.25% (0.0407 => 0.0408) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.25% (0.0408 => 0.0409, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0419 => 0.0419, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.24% (0.0420 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.49% (0.0410 => 0.0412, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.24% (0.0412 => 0.0413) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0403 => 0.0403, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.50% (0.0403 => 0.0405, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.25% (0.0401 => 0.0402) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.50% (0.0402 => 0.0404, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.23% (0.0438 => 0.0439, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.46% (0.0439 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.25% (0.0400 => 0.0401, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.25% (0.0401 => 0.0402, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0402 => 0.0402, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.25% (0.0402 => 0.0403, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.24% (0.0409 => 0.0410, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.24% (0.0410 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.07% (1.2300 => 1.2309, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.19% (7.5415 => 7.5560, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.06% (3.7241 => 3.7262, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.62% (0.6490 => 0.6530, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1431 => 0.1431, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.12% (0.0683 => 0.0648, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: 32.73% (63.2438 => 83.9437, std.dev.: 0.0233) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/JM/lencod/lencod: 14229.72% (0.0720 => 10.3174, std.dev.: 0.0107) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 44.49% (10.3673 => 14.9800, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/richards_benchmark: 29.10% (0.1622 => 0.2094, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.38% (2.2022 => 2.5408, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.95% (7.0540 => 8.1087, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 13.69% (0.1432 => 0.1628, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 13.32% (1.1194 => 1.2685, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.90% (0.1566 => 0.1768, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.86% (1.7609 => 1.9697, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.80% (0.3473 => 0.3848, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.73% (0.3543 => 0.3923, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 10.52% (0.3497 => 0.3865, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.47% (0.3543 => 0.3914, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.45% (0.3561 => 0.3933, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.38% (0.3516 => 0.3881, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.29% (0.1584 => 0.1747, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 10.18% (0.3282 => 0.3616, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 10.15% (0.3694 => 0.4069, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.98% (0.3927 => 0.4319, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.90% (0.3828 => 0.4207, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 9.73% (0.3886 => 0.4264, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 8.82% (10.4361 => 11.3564, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.61% (0.4879 => 0.5299, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 8.59% (0.5925 => 0.6434, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.44% (0.6030 => 0.6539, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 8.16% (0.1655 => 0.1790, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 8.13% (9.4845 => 10.2552, std.dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.01% (0.6675 => 0.7210, std.dev.: 0.0122) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.00% (0.1438 => 0.1553, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.99% (0.3177 => 0.3431, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 7.99% (0.1440 => 0.1555, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 7.67% (0.7326 => 0.7888, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.62% (0.5105 => 0.5494, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 7.58% (0.7115 => 0.7654, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 7.35% (0.7433 => 0.7979, std.dev.: 0.0019) MultiSource/Applications/sgefa/sgefa: 7.33% (0.3109 => 0.3337, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 7.29% (5.7591 => 6.1790, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.16% (0.2891 => 0.3098, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 7.07% (0.3422 => 0.3664, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.04% (0.2700 => 0.2890, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.02% (0.3307 => 0.3539, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 7.01% (0.2554 => 0.2733, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.97% (0.2725 => 0.2915, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 6.95% (0.4289 => 0.4587, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.91% (0.4615 => 0.4934, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.87% (0.2271 => 0.2427, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.87% (3.3354 => 3.5644, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/18-imp/imp: 6.87% (0.3423 => 0.3658, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 6.84% (0.1695 => 0.1811, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.84% (1.5415 => 1.6469, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.83% (0.1625 => 0.1736, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.82% (0.4636 => 0.4952, std.dev.: 0.0032) SingleSource/Regression/C++/ofstream_ctor: 6.82% (0.2905 => 0.3103, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.73% (4.2646 => 4.5516, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.72% (0.5860 => 0.6254, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.70% (1.3050 => 1.3924, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.64% (0.2831 => 0.3019, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.63% (0.2065 => 0.2202, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.62% (0.1510 => 0.1610, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.60% (0.3136 => 0.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.60% (0.3865 => 0.4120, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.56% (5.0018 => 5.3297, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.54% (0.4203 => 0.4478, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.53% (0.2756 => 0.2936, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.52% (0.4064 => 0.4329, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.52% (8.1363 => 8.6666, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.51% (0.2872 => 0.3059, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 6.49% (0.3603 => 0.3837, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.49% (0.3098 => 0.3299, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.49% (0.3283 => 0.3496, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.48% (2.0665 => 2.2005, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.48% (0.2871 => 0.3057, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.47% (0.3650 => 0.3886, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.44% (4.9449 => 5.2635, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.43% (0.5020 => 0.5343, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wc: 6.42% (0.3052 => 0.3248, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.41% (0.8172 => 0.8696, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.41% (0.4103 => 0.4366, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 6.40% (0.3232 => 0.3439, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/bigfib: 6.40% (0.6456 => 0.6869, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 6.37% (0.2714 => 0.2887, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.37% (0.8067 => 0.8581, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.31% (0.2758 => 0.2932, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.30% (0.2793 => 0.2969, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.28% (0.5569 => 0.5919, std.dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.28% (0.3121 => 0.3317, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.27% (0.3826 => 0.4066, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 6.25% (0.4048 => 0.4301, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.25% (0.2802 => 0.2977, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.21% (0.4620 => 0.4907, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.17% (0.2107 => 0.2237, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.17% (0.3162 => 0.3357, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.12% (0.2877 => 0.3053, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 6.05% (1.5603 => 1.6547, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: 6.05% (0.7835 => 0.8309, std.dev.: 0.0034) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.03% (7.9617 => 8.4414, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.97% (0.3935 => 0.4170, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 5.95% (0.3379 => 0.3580, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 5.94% (0.3684 => 0.3903, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 5.92% (0.3092 => 0.3275, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.90% (0.9765 => 1.0341, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.88% (0.1940 => 0.2054, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 5.88% (1.1642 => 1.2326, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 5.86% (0.4299 => 0.4551, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 5.80% (21.9371 => 23.2098, std.dev.: 0.0241) MultiSource/Applications/lemon/lemon: 5.62% (1.0722 => 1.1325, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 5.59% (3.8723 => 4.0886, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.52% (0.3441 => 0.3631, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 5.49% (0.3387 => 0.3573, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.45% (1.1861 => 1.2507, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.42% (0.2603 => 0.2744, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 5.41% (0.3180 => 0.3352, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 5.23% (2.0273 => 2.1333, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/football/football: 5.06% (0.8921 => 0.9372, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.93% (0.6450 => 0.6768, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 4.78% (2.2969 => 2.4068, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.71% (0.5981 => 0.6263, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.56% (1.5859 => 1.6582, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.41% (0.2266 => 0.2366, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.41% (0.3131 => 0.3269, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.38% (1.4186 => 1.4807, std.dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 4.32% (1.2842 => 1.3397, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 4.12% (1.1840 => 1.2328, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.10% (2.2024 => 2.2928, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.09% (14.3668 => 14.9551, std.dev.: 0.0141) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.27% (0.8101 => 0.8366, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.86% (0.3817 => 0.3926, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (3.8922 => 3.9626, std.dev.: 0.0086) MultiSource/Applications/sqlite3/sqlite3: 1.78% (17.1811 => 17.4877, std.dev.: 0.0220) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8953, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.26% (1.1145 => 1.3849, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4499, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.64% (3.1578 => 3.3675, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 6.55% (1.1396 => 1.2142, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.44% (3.6395 => 3.7647, std.dev.: 0.0085) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.06% (4.2280 => 4.3572, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7655, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7983, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.02% (9.1159 => 9.2089, std.dev.: 0.0328) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5752, std.dev.: 0.0087) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1284, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.18% (0.8651 => 0.1715, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.12% (5.2763 => 3.2649, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.34% (5.3855 => 3.9131, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -26.93% (5.3526 => 3.9113, std.dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -14.73% (54.1659 => 46.1863, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.88% (2.9384 => 2.6186, std.dev.: 0.0059) MultiSource/Applications/ClamAV/clamscan: -7.81% (22.1758 => 20.4446, std.dev.: 0.0288) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204) SingleSource/Benchmarks/Misc/mandel: -33.60% (1.1492 => 0.7631) SingleSource/Benchmarks/Misc/flops-6: -16.01% (1.6925 => 1.4215, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/chomp: -12.22% (1.2373 => 1.0861, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/mandel-2: -10.36% (1.5373 => 1.3781, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.40% (19.9488 => 18.2728, std.dev.: 0.0220) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.69% (1.8329 => 1.7103, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -5.08% (5.0483 => 4.7916, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.03% (1.6805 => 1.5959, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.88% (1.5835 => 1.5062, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.59% (3.2827 => 3.1648, std.dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4982, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3311, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.08% (8.1563 => 7.9864, std.dev.: 0.0210) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.91% (8.6802 => 8.5148, std.dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: -1.79% (12.4730 => 12.2496, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6830, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -1.69% (2.5528 => 2.5097, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: -1.64% (1.1277 => 1.1092) SingleSource/Benchmarks/Misc/salsa20: -1.57% (10.2830 => 10.1217, std.dev.: 0.0224) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4220, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout/lists: -1.13% (6.2999 => 6.2288, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8575, std.dev.: 0.0077) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.04% (0.5229 => 0.5754, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 6.74% (14.9895 => 15.9993, std.dev.: 0.0241) MultiSource/Applications/kimwitu++/kc: 5.42% (14.1553 => 14.9219, std.dev.: 0.0141) MultiSource/Benchmarks/MallocBench/gs/gs: 5.46% (4.1105 => 4.3348, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.41% (1.1048 => 1.2309, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.56% (7.1582 => 7.5560, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.60% (3.4629 => 3.7262, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.95% (0.6222 => 0.6530, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 1 22:45:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 2 Oct 2012 00:45:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121002054507.8ECCE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4469?compare_to=4462&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4469, Order: 164984, Start Time: 2012-10-02 02:34:03, End Time: 2012-10-02 05:44:02 To: 4462, Order: 164972, Start Time: 2012-10-01 22:54:51, End Time: 2012-10-02 02:05:01 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 6 (127 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (131 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1032 (766 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.50% (2.1996 => 2.2326, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 1.39% (1.0531 => 1.0677, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 1.30% (0.7666 => 0.7766, std.dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.19% (2.8603 => 2.8944, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 9.06% (0.2086 => 0.2275, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.34% (124.1879 => 129.5750, std.dev.: 1.0069) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -2.98% (1.7899 => 1.7365, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.01% (9.8091 => 9.8083, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.03% (9.4093 => 9.4125, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.01% (16.9596 => 16.9576, std.dev.: 0.0023) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 11.58% (0.3446 => 0.3845, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 11.46% (0.3465 => 0.3862, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.45% (0.3442 => 0.3836, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.41% (0.3496 => 0.3895, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.39% (0.3460 => 0.3854, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.35% (0.3488 => 0.3884, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.30% (0.3469 => 0.3861, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.01% (0.3650 => 0.4052, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.90% (0.3643 => 0.4040, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.82% (0.1063 => 0.1178, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/parameter-passing: 10.74% (0.3724 => 0.4124, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.92% (0.5826 => 0.6404, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 9.87% (0.5889 => 0.6470, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 8.99% (1.5932 => 1.7365, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.91% (0.2738 => 0.2982, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.63% (0.2875 => 0.3123, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 8.32% (0.3004 => 0.3254, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.30% (0.7171 => 0.7766, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/fibo: 8.29% (0.2725 => 0.2951, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 8.29% (0.2714 => 0.2939, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 8.25% (0.2750 => 0.2977, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 8.22% (0.2823 => 0.3055, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.21% (0.2729 => 0.2953, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 8.13% (0.2803 => 0.3031, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.11% (0.3195 => 0.3454, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 8.11% (0.2813 => 0.3041, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.00% (2.0673 => 2.2326, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.99% (0.2792 => 0.3015, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 7.99% (0.2780 => 0.3002, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 7.93% (0.2811 => 0.3034, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 7.88% (0.3096 => 0.3340, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.80% (0.2911 => 0.3138, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 7.75% (0.9909 => 1.0677, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 7.71% (0.3267 => 0.3519, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.67% (0.3258 => 0.3508, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.61% (0.3060 => 0.3293, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.55% (0.3124 => 0.3360, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 7.53% (0.3348 => 0.3600, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 7.48% (0.3317 => 0.3565, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.46% (0.3282 => 0.3527, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.45% (0.3625 => 0.3895, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.41% (0.3362 => 0.3611, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 7.34% (0.3678 => 0.3948, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.24% (0.4146 => 0.4446, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 7.19% (0.3477 => 0.3727, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 7.10% (0.1619 => 0.1734, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 7.09% (0.3726 => 0.3990, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.88% (0.3690 => 0.3944, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 6.75% (0.4251 => 0.4538, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.74% (1.3152 => 1.4038, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.68% (0.3981 => 0.4247, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.66% (1.6211 => 1.7291, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.55% (0.3845 => 0.4097, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.40% (0.4361 => 0.4640, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 6.27% (5.5417 => 5.8890, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.24% (3.5627 => 3.7850, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.23% (0.1620 => 0.1721, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.23% (0.4994 => 0.5305, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.12% (0.5000 => 0.5306, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.06% (0.2014 => 0.2136, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.05% (2.7292 => 2.8944, std.dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: 6.04% (23.5202 => 24.9411, std.dev.: 0.0048) MultiSource/Applications/d/make_dparser: 5.97% (1.0781 => 1.1425, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 5.95% (0.5012 => 0.5310, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.77% (0.6435 => 0.6806, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.67% (0.3930 => 0.4153, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.63% (0.2737 => 0.2891, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.61% (0.5026 => 0.5308, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.52% (0.2736 => 0.2887, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.51% (0.2068 => 0.2182, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.36% (0.5900 => 0.6216, std.dev.: 0.0034) MultiSource/Applications/siod/siod: 5.28% (0.6634 => 0.6984, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 5.25% (4.2109 => 4.4320, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.21% (4.4195 => 4.6496, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.20% (0.2866 => 0.3015, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 5.08% (1.8794 => 1.9748, std.dev.: 0.0050) MultiSource/Benchmarks/nbench/nbench: 5.07% (0.2566 => 0.2696, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.05% (0.4139 => 0.4348, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.99% (0.3084 => 0.3238, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 4.91% (0.4029 => 0.4227, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 4.88% (0.9697 => 1.0170, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 4.83% (2.1013 => 2.2027, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.82% (0.3903 => 0.4091, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.76% (0.3890 => 0.4075, std.dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 4.72% (4.6177 => 4.8355, std.dev.: 0.0131) MultiSource/Applications/JM/ldecod/ldecod: 4.62% (2.1653 => 2.2654, std.dev.: 0.0017) MultiSource/Applications/lua/lua: 4.61% (1.4269 => 1.4927, std.dev.: 0.0019) MultiSource/Applications/minisat/minisat: 4.56% (0.3336 => 0.3488, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 4.54% (0.5546 => 0.5798, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.49% (0.4658 => 0.4867, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.27% (1.9694 => 2.0535, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.24% (0.2969 => 0.3095, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.19% (0.3271 => 0.3408, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 4.05% (0.7875 => 0.8194, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.99% (1.9966 => 2.0763, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 3.96% (2.0346 => 2.1152, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.67% (0.4253 => 0.4409, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 3.61% (0.4847 => 0.5022, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.47% (0.7426 => 0.7684, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.23% (0.5361 => 0.5534, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.16% (11.6398 => 12.0079, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.08% (0.5584 => 0.5756, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.95% (4.6926 => 4.8311, std.dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: 2.07% (11.9555 => 12.2025, std.dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 7.21% (0.2122 => 0.2275, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.45% (3.3903 => 3.6090, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6755, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-2: 4.79% (1.8057 => 1.8922, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1689, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/dry: 4.12% (14.0481 => 14.6273, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2010, std.dev.: 0.0054) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.07% (41.7953 => 42.6604, std.dev.: 0.0052) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5060, std.dev.: 0.0046) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.60% (3.1722 => 3.2230, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2896, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5126, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5950, std.dev.: 0.0168) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.00% (105.3826 => 106.4368, std.dev.: 0.0562) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.75% (25.4195 => 16.5855, std.dev.: 0.0101) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9751, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7955, std.dev.: 0.0112) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: -7.20% (0.2402 => 0.2229, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -3.71% (11.2080 => 10.7925, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std.dev.: 0.0019) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7736, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -2.67% (17.2379 => 16.7781, std.dev.: 0.0398) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5790, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4983, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7160, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0428, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 1 23:19:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 2 Oct 2012 01:19:28 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121002061928.4683C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4470?compare_to=4466&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4470, Order: 164987, Start Time: 2012-10-02 04:51:28, End Time: 2012-10-02 06:17:31 To: 4466, Order: 164984, Start Time: 2012-10-02 02:25:30, End Time: 2012-10-02 03:47:52 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 4 (4 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 11 (62 on baseline) Performance Improvements: 11 (50 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 69 (69 on baseline) Unchanged Tests: 947 (775 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Applications/JM/lencod/lencod: -96.54% (6.6305 => 0.2294, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: -91.40% (6.8862 => 0.5924, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/09-vor/vor: 20992.33% (0.1265 => 26.6818, std.dev.: 0.0560) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.95% (1.1102 => 0.0005, std.dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.99% (2.4276 => 2.6945, std.dev.: 0.0483) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.21% (0.9632 => 1.0519, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.35% (13.2665 => 14.2419, std.dev.: 0.2331) MultiSource/Benchmarks/FreeBench/mason/mason: 6.58% (0.5139 => 0.5477, std.dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.64% (0.8772 => 0.9267, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/bisort/bisort: 4.83% (0.6457 => 0.6769, std.dev.: 0.0089) SingleSource/Benchmarks/CoyoteBench/lpbench: 4.18% (4.0911 => 4.2622, std.dev.: 0.0464) MultiSource/Applications/lua/lua: 3.48% (28.8270 => 29.8307, std.dev.: 0.2279) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.46% (1.3421 => 1.3751, std.dev.: 0.0112) MultiSource/Benchmarks/mafft/pairlocalalign: 1.46% (58.9518 => 59.8148, std.dev.: 0.0519) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.19% (2.4465 => 2.4757, std.dev.: 0.0060) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.14% (0.3043 => 0.1639, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -45.77% (0.0603 => 0.0327, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -23.11% (1.4455 => 1.1115, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -22.07% (1.4433 => 1.1247, std.dev.: 0.0158) MultiSource/Applications/ClamAV/clamscan: -3.86% (15.0489 => 14.4679, std.dev.: 0.0672) MultiSource/Benchmarks/MallocBench/gs/gs: -1.57% (3.9691 => 3.9067, std.dev.: 0.0139) MultiSource/Benchmarks/Bullet/bullet: -1.43% (30.6749 => 30.2370, std.dev.: 0.0981) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -14.96% (1.7318 => 1.4727, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -6.07% (6.9098 => 6.4907, std.dev.: 0.1359) SingleSource/Benchmarks/Misc/flops: -5.80% (9.2847 => 8.7460, std.dev.: 0.0023) MultiSource/Benchmarks/sim/sim: -4.73% (4.0019 => 3.8126, std.dev.: 0.0123) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.98% (1.0135 => 1.0036, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -1.15% (0.6188 => 0.6117, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: 6.01% (0.1681 => 0.1782, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.53% (0.1569 => 0.1498, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.38% (0.3121 => 0.3109, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.09% (0.2320 => 0.2318, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.37% (0.3210 => 0.3198, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.52% (0.2327 => 0.2315, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/mandel: -18.63% (0.0451 => 0.0367, std.dev.: 0.0040) SingleSource/UnitTests/2003-05-07-VarArgs: -3.41% (0.0088 => 0.0085, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -1.12% (0.0089 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -24.49% (0.0245 => 0.0185, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -2.05% (0.0195 => 0.0191, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.52% (0.0388 => 0.0386, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.67% (0.0299 => 0.0297, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -9.82% (0.0285 => 0.0257, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.62% (0.0323 => 0.0321, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -44.20% (0.0181 => 0.0101, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/test1: -1.55% (0.0194 => 0.0191, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: 5.96% (0.0235 => 0.0249, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -22.94% (0.0327 => 0.0252, std.dev.: 0.0032) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.34% (0.1452 => 0.1457, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 1.78% (1.5209 => 1.5479, std.dev.: 0.0094) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.17% (0.1512 => 0.1464, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.76% (0.4257 => 0.4012, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.11% (0.1369 => 0.1439, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.16% (0.0644 => 0.0585, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.84% (0.0211 => 0.0217, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.28% (0.0582 => 0.0636, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.43% (1.1258 => 1.1306, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -40.74% (0.0027 => 0.0016, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.01% (0.0548 => 0.0570, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.95% (0.0215 => 0.0142, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.14% (0.7653 => 0.7664, std.dev.: 0.0086) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 6.76% (1.5985 => 1.7065, std.dev.: 0.0060) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 100.00% (0.0001 => 0.0002, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Applications/JM/lencod/lencod: -96.60% (6.7458 => 0.2294, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: -91.50% (6.9722 => 0.5924, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/09-vor/vor: 21469.77% (0.1237 => 26.6818, std.dev.: 0.0560) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.40% (4.1772 => 3.1164, std.dev.: 0.0254) SingleSource/Benchmarks/Shootout-C++/except: 82400.00% (0.0006 => 0.4950, std.dev.: 0.0101) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -33.33% (0.0006 => 0.0004, std.dev.: 0.0001) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: -83.33% (0.0006 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: -75.00% (0.0004 => 0.0001, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.28% (0.0745 => 0.0911, std.dev.: 0.0023) MultiSource/Benchmarks/PAQ8p/paq8p: 8.48% (2.1763 => 2.3608, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: 7.61% (0.5309 => 0.5713, std.dev.: 0.0032) MultiSource/Applications/minisat/minisat: 7.52% (0.6173 => 0.6637, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.18% (0.6410 => 0.6870, std.dev.: 0.0058) MultiSource/Applications/SIBsim4/SIBsim4: 6.20% (1.1653 => 1.2376, std.dev.: 0.0059) MultiSource/Applications/lemon/lemon: 6.08% (1.0046 => 1.0657, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.52% (1.5150 => 1.5987, std.dev.: 0.0133) MultiSource/Applications/kimwitu++/kc: 5.34% (15.3105 => 16.1282, std.dev.: 0.1691) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.25% (0.7639 => 0.8040, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.17% (0.6069 => 0.6383, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.13% (0.2552 => 0.2683, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.86% (0.2797 => 0.2933, std.dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: 4.84% (0.6915 => 0.7250, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: 4.70% (3.0225 => 3.1647, std.dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.39% (0.4880 => 0.5094, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.28% (0.3901 => 0.4068, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.21% (12.6413 => 13.1735, std.dev.: 0.0763) MultiSource/Applications/siod/siod: 3.74% (2.0972 => 2.1757, std.dev.: 0.0122) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.63% (0.4248 => 0.4402, std.dev.: 0.0038) MultiSource/Applications/oggenc/oggenc: 3.58% (4.7455 => 4.9156, std.dev.: 0.0655) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.46% (0.3062 => 0.3168, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.40% (1.2021 => 1.2430, std.dev.: 0.0071) MultiSource/Applications/Burg/burg: 3.37% (1.1440 => 1.1826, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 3.29% (13.3238 => 13.7622, std.dev.: 0.0612) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.24% (3.0758 => 3.1755, std.dev.: 0.0139) MultiSource/Benchmarks/Bullet/bullet: 3.14% (29.3170 => 30.2370, std.dev.: 0.0981) MultiSource/Applications/hbd/hbd: 3.01% (1.3268 => 1.3667, std.dev.: 0.0120) MultiSource/Benchmarks/mafft/pairlocalalign: 2.71% (8.2186 => 8.4417, std.dev.: 0.0263) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.64% (1.1827 => 1.2139, std.dev.: 0.0078) MultiSource/Benchmarks/nbench/nbench: 2.51% (1.0821 => 1.1093, std.dev.: 0.0087) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.51% (6.2546 => 6.4116, std.dev.: 0.0297) MultiSource/Applications/treecc/treecc: 2.50% (1.8798 => 1.9268, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/football/football: 2.24% (0.8405 => 0.8593, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.01% (0.7226 => 0.7371, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.61% (1.0689 => 1.0861, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.49% (1.6538 => 2.3399, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2284, std.dev.: 0.0057) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 15.70% (0.0917 => 0.1061, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/ary3: 15.08% (1.7426 => 2.0053, std.dev.: 0.0223) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.64% (4.0101 => 4.5571, std.dev.: 0.0164) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.07% (2.4042 => 2.6945, std.dev.: 0.0483) SingleSource/Benchmarks/McGill/queens: 11.09% (1.6261 => 1.8065, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/mason/mason: 9.45% (0.5004 => 0.5477, std.dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.05% (0.8498 => 0.9267, std.dev.: 0.0064) SingleSource/Benchmarks/Stanford/Puzzle: 8.93% (0.1433 => 0.1561, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/lists: 8.60% (7.0025 => 7.6048, std.dev.: 0.0195) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.88% (1.0063 => 1.0856, std.dev.: 0.0270) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.94% (0.3301 => 0.3497, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.49% (40.4792 => 42.7005, std.dev.: 0.4578) MultiSource/Benchmarks/Olden/bisort/bisort: 4.80% (0.6459 => 0.6769, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.52% (0.7609 => 0.7953, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/dt: 4.31% (0.9851 => 1.0276, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.67% (3.4080 => 3.5332, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.35% (0.5587 => 0.5774, std.dev.: 0.0069) MultiSource/Applications/siod/siod: 2.85% (3.5520 => 3.6533, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.81% (6.6312 => 6.8176, std.dev.: 0.0232) MultiSource/Applications/hexxagon/hexxagon: 2.78% (14.4877 => 14.8911, std.dev.: 0.0206) SingleSource/Benchmarks/Dhrystone/dry: 1.95% (2.4013 => 2.4482, std.dev.: 0.0131) MultiSource/Benchmarks/Olden/power/power: 1.52% (1.4184 => 1.4399, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.25% (2.9152 => 2.9517, std.dev.: 0.0097) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.23% (2.4455 => 2.4757, std.dev.: 0.0060) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -45.29% (0.2996 => 0.1639, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.67% (0.0591 => 0.0327, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -21.66% (1.4189 => 1.1115, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -20.31% (1.4113 => 1.1247, std.dev.: 0.0158) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.78% (0.3497 => 0.2071, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary3: -20.91% (1.7473 => 1.3819, std.dev.: 0.0373) SingleSource/Benchmarks/CoyoteBench/lpbench: -19.07% (5.2665 => 4.2622, std.dev.: 0.0464) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.17% (1.7361 => 1.4727, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/17-bintr/bintr: -13.09% (0.0917 => 0.0797, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1587, std.dev.: 0.0091) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -10.04% (15.8312 => 14.2419, std.dev.: 0.2331) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.68% (1.1647 => 1.0519, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -9.16% (0.1114 => 0.1012, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: -8.39% (9.5474 => 8.7460, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2860, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.00% (3.2007 => 2.9446, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.76% (3.6254 => 3.3803, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: -6.57% (7.6833 => 7.1786, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.54% (2.0027 => 1.8718, std.dev.: 0.0214) SingleSource/Benchmarks/Shootout-C++/fibo: -6.48% (4.6355 => 4.3349, std.dev.: 0.0147) SingleSource/Benchmarks/Misc/richards_benchmark: -6.46% (1.4441 => 1.3508, std.dev.: 0.0203) MultiSource/Benchmarks/FreeBench/distray/distray: -6.34% (0.2664 => 0.2495, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.06% (2.9728 => 2.7927, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.72% (3.6023 => 3.3963, std.dev.: 0.0620) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.45% (3.9413 => 3.7264, std.dev.: 0.0047) MultiSource/Applications/SIBsim4/SIBsim4: -5.36% (3.4230 => 3.2396, std.dev.: 0.0230) SingleSource/Benchmarks/Shootout/fib2: -5.29% (4.4195 => 4.1859, std.dev.: 0.0119) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.86% (0.4140 => 0.3939, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.71% (0.4564 => 0.4349, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: -4.45% (2.5166 => 2.4047, std.dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: -4.16% (62.4126 => 59.8148, std.dev.: 0.0519) SingleSource/Benchmarks/McGill/misr: -3.40% (0.4296 => 0.4150, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/methcall: -3.31% (9.2503 => 8.9443, std.dev.: 0.0295) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.15% (45.4683 => 44.0347, std.dev.: 0.1212) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.00% (1.2722 => 1.2340, std.dev.: 0.0126) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.94% (1.2959 => 1.2578, std.dev.: 0.0107) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.61% (1.1683 => 1.1378, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.49% (3.7496 => 3.6563, std.dev.: 0.0314) MultiSource/Benchmarks/sim/sim: -2.01% (3.8907 => 3.8126, std.dev.: 0.0123) MultiSource/Benchmarks/PAQ8p/paq8p: -1.91% (92.7467 => 90.9711, std.dev.: 0.2002) MultiSource/Applications/aha/aha: -1.84% (3.4286 => 3.3655, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/hash2: -1.84% (3.4876 => 3.4235, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/neural/neural: -1.64% (1.0926 => 1.0747, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.56% (1.8739 => 1.8446, std.dev.: 0.0111) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.52% (9.3855 => 9.2432, std.dev.: 0.0107) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3143, std.dev.: 0.0551) SingleSource/Benchmarks/Dhrystone/fldry: -1.34% (2.4971 => 2.4637, std.dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.32% (27.1724 => 26.8131, std.dev.: 0.0359) SingleSource/Benchmarks/Shootout-C++/lists: -1.28% (16.5617 => 16.3505, std.dev.: 0.0640) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.56% (0.9980 => 1.0036, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.58% (0.6022 => 0.6117, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: 6.96% (0.1666 => 0.1782, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.60% (0.1554 => 0.1498, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.84% (0.3083 => 0.3109, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.17% (0.2394 => 0.2318, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.72% (0.3175 => 0.3198, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.56% (0.2302 => 0.2315, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/mandel: -18.26% (0.0449 => 0.0367, std.dev.: 0.0040) SingleSource/UnitTests/2003-05-07-VarArgs: -4.49% (0.0089 => 0.0085, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -2.22% (0.0090 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -22.92% (0.0240 => 0.0185, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0192 => 0.0191, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.03% (0.0390 => 0.0386, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.33% (0.0301 => 0.0297, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -9.51% (0.0284 => 0.0257, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0324 => 0.0321, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -42.94% (0.0177 => 0.0101, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/test1: 1.06% (0.0189 => 0.0191, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0249 => 0.0249, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -22.46% (0.0325 => 0.0252, std.dev.: 0.0032) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 1.96% (0.1429 => 0.1457, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 3.06% (1.5019 => 1.5479, std.dev.: 0.0094) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -2.47% (0.1501 => 0.1464, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.91% (0.4264 => 0.4012, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.07% (0.1344 => 0.1439, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.68% (0.0589 => 0.0585, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -6.47% (0.0232 => 0.0217, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.47% (0.0639 => 0.0636, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.39% (1.1350 => 1.1306, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 166.67% (0.0006 => 0.0016, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.52% (0.0637 => 0.0570, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -42.28% (0.0246 => 0.0142, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.63% (0.7541 => 0.7664, std.dev.: 0.0086) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.08% (1.5363 => 1.7065, std.dev.: 0.0060) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 1 23:22:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 2 Oct 2012 01:22:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121002062222.48A2F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4471?compare_to=4468&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4471, Order: 164987, Start Time: 2012-10-02 05:04:28, End Time: 2012-10-02 06:24:00 To: 4468, Order: 164984, Start Time: 2012-10-02 03:14:41, End Time: 2012-10-02 04:35:00 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 3 (4 on baseline) Performance Regressions: 6 (147 on baseline) Performance Improvements: 13 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 931 (697 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 23.95% (14.9219 => 18.4950, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++-EH/spirit: 46.90% (3.7262 => 5.4739, std.dev.: 0.0038) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++-EH/spirit: 10004600.00% (0.0001 => 10.0047, std.dev.: 0.0020) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 37.65% (0.2733 => 0.3762, std.dev.: 0.0086) MultiSource/Benchmarks/FreeBench/distray/distray: 21.24% (0.1130 => 0.1370, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 1.35% (11.3564 => 11.5102, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.11% (1.6469 => 1.6652, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 5.25% (0.5333 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 1.08% (1.0861 => 1.0978, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/FreeBench/mason/mason: -18.67% (0.0857 => 0.0697, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.19% (1.2685 => 1.1519, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -7.61% (3.9113 => 3.6136, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.57% (3.9131 => 3.6167, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bh/bh: -5.37% (0.3275 => 0.3099, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.77% (0.4170 => 0.3971, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -2.87% (20.4446 => 19.8581, std.dev.: 0.0183) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.42% (14.9551 => 14.7425, std.dev.: 0.0134) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.38% (0.0994 => 0.0861, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -10.38% (0.2167 => 0.1942, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.39% (0.9984 => 0.9546, std.dev.: 0.0041) SingleSource/UnitTests/Vector/build2: -2.15% (1.3862 => 1.3564) MultiSource/Applications/lua/lua: -1.15% (26.3013 => 25.9987, std.dev.: 0.0209) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.23% (0.5754 => 0.5767, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: -0.00% (15.9993 => 15.9991, std.dev.: 0.0170) MultiSource/Benchmarks/Bullet/bullet: -35.52% (83.9437 => 54.1303, std.dev.: 0.0306) MultiSource/Benchmarks/MallocBench/gs/gs: -0.12% (4.3348 => 4.3294, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0457 => 0.0457, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0459 => 0.0459, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0427 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0429 => 0.0429) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0418 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.24% (0.0412 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0412 => 0.0412, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0428 => 0.0428, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0430 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0423 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0424 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0413 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.24% (0.0414 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.24% (0.0420 => 0.0421, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0421 => 0.0421, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0432 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0433 => 0.0433) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0408 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.24% (0.0409 => 0.0410) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.24% (0.0419 => 0.0420) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0421 => 0.0421) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0412 => 0.0412) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0413 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0403 => 0.0403, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.25% (0.0405 => 0.0404, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0402 => 0.0402, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0404 => 0.0404, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.23% (0.0439 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0441 => 0.0441, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0401 => 0.0401, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0402 => 0.0402, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0402 => 0.0402, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.25% (0.0403 => 0.0404, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0410 => 0.0410) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0411 => 0.0411, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.02% (1.2309 => 1.2306, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.17% (7.5560 => 7.5432, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.79% (0.6530 => 0.7300, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35600.00% (0.0001 => 0.0357, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 0.14% (0.1431 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.70% (0.0648 => 0.0672, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -14.41% (63.2438 => 54.1303, std.dev.: 0.0306) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 30.66% (14.1553 => 18.4950, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++-EH/spirit: 58.07% (3.4629 => 5.4739, std.dev.: 0.0038) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14236.81% (0.0720 => 10.3225, std.dev.: 0.0122) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10004600.00% (0.0001 => 10.0047, std.dev.: 0.0020) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 47.30% (0.2554 => 0.3762, std.dev.: 0.0086) MultiSource/Benchmarks/PAQ8p/paq8p: 44.43% (10.3673 => 14.9736, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/distray/distray: 29.73% (0.1056 => 0.1370, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 29.41% (0.1622 => 0.2099, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.22% (2.2022 => 2.5374, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.43% (7.0540 => 8.0721, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/flops: 13.76% (0.1432 => 0.1629, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.96% (0.1566 => 0.1769, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.02% (1.7609 => 1.9726, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.18% (0.3543 => 0.3939, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.77% (0.3473 => 0.3847, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.53% (0.3543 => 0.3916, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.52% (0.3497 => 0.3865, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.45% (0.3561 => 0.3933, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.44% (0.3516 => 0.3883, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 10.29% (10.4361 => 11.5102, std.dev.: 0.0105) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.23% (0.1584 => 0.1746, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 10.21% (0.3694 => 0.4071, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 10.15% (0.3282 => 0.3615, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions: 10.01% (0.3828 => 0.4211, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.98% (0.3927 => 0.4319, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.75% (0.3886 => 0.4265, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.65% (0.4879 => 0.5301, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/Hello: 8.56% (0.5925 => 0.6432, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.51% (0.6030 => 0.6543, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 8.33% (0.1440 => 0.1560, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 8.28% (0.1655 => 0.1792, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 8.05% (9.4845 => 10.2478, std.dev.: 0.0105) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.03% (0.3177 => 0.3432, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.02% (1.5415 => 1.6652, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.00% (0.6675 => 0.7209, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.00% (0.1438 => 0.1553, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.94% (0.2065 => 0.2229, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 7.87% (0.7115 => 0.7675, std.dev.: 0.0048) SingleSource/UnitTests/ObjC++/property-reference: 7.66% (0.7326 => 0.7887, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 7.53% (0.3109 => 0.3343, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 7.40% (0.7433 => 0.7983, std.dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.28% (0.4615 => 0.4951, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 7.24% (5.7591 => 6.1763, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.15% (0.5105 => 0.5470, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 7.10% (0.3422 => 0.3665, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.07% (1.3050 => 1.3972, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.05% (0.2271 => 0.2431, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/em3d/em3d: 7.02% (0.1695 => 0.1814, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 6.98% (0.3423 => 0.3662, std.dev.: 0.0018) MultiSource/Applications/d/make_dparser: 6.96% (3.3354 => 3.5675, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.95% (0.2891 => 0.3092, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.89% (0.1625 => 0.1737, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.89% (0.2700 => 0.2886, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.85% (0.2905 => 0.3104, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.82% (0.1510 => 0.1613, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.78% (0.2831 => 0.3023, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.73% (4.2646 => 4.5517, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/fibo: 6.72% (0.2725 => 0.2908, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.71% (0.5860 => 0.6253, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.69% (0.4203 => 0.4484, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.67% (0.4289 => 0.4575, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.63% (8.1363 => 8.6757, std.dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.62% (0.4636 => 0.4943, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.57% (0.3865 => 0.4119, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.57% (4.9449 => 5.2698, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/except: 6.55% (0.2871 => 0.3059, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.53% (0.4103 => 0.4371, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 6.52% (0.4048 => 0.4312, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.52% (0.3650 => 0.3888, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.52% (0.3098 => 0.3300, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.51% (0.2872 => 0.3059, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.51% (0.8067 => 0.8592, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary: 6.50% (0.3232 => 0.3442, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.48% (5.0018 => 5.3258, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/bigfib: 6.47% (0.6456 => 0.6874, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.46% (0.3283 => 0.3495, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.46% (2.0665 => 2.1999, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hello: 6.45% (0.2714 => 0.2889, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 6.44% (0.3603 => 0.3835, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.44% (0.8172 => 0.8698, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.43% (0.5020 => 0.5343, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.42% (0.2756 => 0.2933, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 6.42% (0.3052 => 0.3248, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.41% (0.3136 => 0.3337, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.39% (0.9765 => 1.0389, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.38% (0.3307 => 0.3518, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.36% (0.5569 => 0.5923, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.35% (0.2758 => 0.2933, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash2: 6.34% (0.4620 => 0.4913, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.34% (0.2793 => 0.2970, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.28% (0.3121 => 0.3317, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.27% (0.3826 => 0.4066, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.26% (0.2107 => 0.2239, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 6.25% (0.2802 => 0.2977, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.22% (7.9617 => 8.4569, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.20% (0.3162 => 0.3358, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 6.17% (1.5603 => 1.6566, std.dev.: 0.0054) MultiSource/Applications/spiff/spiff: 6.14% (0.7835 => 0.8316, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/methcall: 6.12% (0.2877 => 0.3053, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.00% (0.3684 => 0.3905, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.98% (0.1940 => 0.2056, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 5.93% (1.1642 => 1.2332, std.dev.: 0.0044) MultiSource/Benchmarks/sim/sim: 5.88% (0.3387 => 0.3586, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 5.86% (0.3379 => 0.3577, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 5.78% (3.8723 => 4.0963, std.dev.: 0.0174) MultiSource/Applications/JM/lencod/lencod: 5.77% (21.9371 => 23.2030, std.dev.: 0.0221) MultiSource/Benchmarks/McCat/05-eks/eks: 5.75% (0.4299 => 0.4546, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 5.75% (1.0722 => 1.1338, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.46% (0.2603 => 0.2745, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 5.44% (0.3180 => 0.3353, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.41% (0.3441 => 0.3627, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.35% (1.1861 => 1.2495, std.dev.: 0.0014) MultiSource/Applications/treecc/treecc: 5.31% (2.0273 => 2.1349, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/football/football: 5.17% (0.8921 => 0.9382, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.07% (0.6450 => 0.6777, std.dev.: 0.0085) MultiSource/Applications/siod/siod: 4.98% (2.2969 => 2.4114, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.87% (0.5981 => 0.6272, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.68% (0.4064 => 0.4254, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.61% (1.5859 => 1.6590, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.38% (1.4186 => 1.4808, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/objinst: 4.34% (0.3131 => 0.3267, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 4.33% (1.2842 => 1.3398, std.dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 4.14% (1.1840 => 1.2330, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.08% (2.2024 => 2.2922, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.06% (0.8101 => 0.8349, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.90% (1.1194 => 1.1519, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.88% (0.3817 => 0.3927, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.62% (14.3668 => 14.7425, std.dev.: 0.0134) MultiSource/Applications/sqlite3/sqlite3: 2.13% (17.1811 => 17.5476, std.dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.83% (3.8922 => 3.9633, std.dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.51% (5.3999 => 13.3115, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4499, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (3.1578 => 3.3678, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 6.59% (1.1396 => 1.2147, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.56% (3.6395 => 3.7690, std.dev.: 0.0073) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.91% (4.2280 => 4.3511, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.33% (1.7254 => 1.7656, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.55% (0.8275 => 0.8403, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 1.40% (11.6436 => 11.8071, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.35% (0.9540 => 0.9669, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.09% (9.1159 => 9.2152, std.dev.: 0.0202) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.99% (6.6874 => 0.1345, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.07% (0.8651 => 0.1724, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.03% (5.2763 => 3.2698, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.84% (5.3855 => 3.6167, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.49% (5.3526 => 3.6136, std.dev.: 0.0053) SingleSource/UnitTests/Vector/constpool: -14.79% (54.1659 => 46.1522, std.dev.: 0.0166) MultiSource/Benchmarks/FreeBench/mason/mason: -14.06% (0.0811 => 0.0697, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.99% (2.9384 => 2.6155, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -10.45% (22.1758 => 19.8581, std.dev.: 0.0183) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4233, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.73% (0.0998 => 0.0861, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.27% (1.2373 => 1.0978, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3784, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/mason/mason: -10.13% (0.2161 => 0.1942, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.46% (19.9488 => 18.2620, std.dev.: 0.0284) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4787, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.66% (1.8329 => 1.7109, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.97% (1.6805 => 1.5969, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: -4.63% (1.5835 => 1.5102, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.13% (0.9957 => 0.9546, std.dev.: 0.0041) MultiSource/Applications/siod/siod: -3.63% (3.2827 => 3.1636, std.dev.: 0.0071) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4947, std.dev.: 0.0102) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.71% (1.3677 => 1.3307, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -2.44% (12.4730 => 12.1689, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.19% (8.1563 => 7.9776, std.dev.: 0.0143) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.93% (8.6802 => 8.5127, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/salsa20: -1.81% (10.2830 => 10.0966, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6814, std.dev.: 0.0018) SingleSource/UnitTests/Vector/multiplies: -1.51% (2.5528 => 2.5143, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4206, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -1.47% (4.6441 => 4.5760, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/lists: -1.15% (6.2999 => 6.2273, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8591, std.dev.: 0.0078) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.29% (0.5229 => 0.5767, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 6.74% (14.9895 => 15.9991, std.dev.: 0.0170) MultiSource/Benchmarks/MallocBench/gs/gs: 5.33% (4.1105 => 4.3294, std.dev.: 0.0151) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.39% (1.1048 => 1.2306, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.38% (7.1582 => 7.5432, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_container: 17.33% (0.6222 => 0.7300, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35600.00% (0.0001 => 0.0357, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.24% (0.2116 => 0.0672, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 1 23:28:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 2 Oct 2012 01:28:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121002062812.ADBCA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4472?compare_to=4467&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4472, Order: 164987, Start Time: 2012-10-02 05:04:26, End Time: 2012-10-02 06:29:51 To: 4467, Order: 164984, Start Time: 2012-10-02 03:01:51, End Time: 2012-10-02 04:27:25 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 5 (171 on baseline) Performance Improvements: 14 (38 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1020 (695 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 5.44% (0.2410 => 0.2541, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: 8.54% (2.0949 => 2.2738, std.dev.: 0.0029) SingleSource/Regression/C/uint64_to_float: 5.19% (0.5334 => 0.5611, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.17% (27.7046 => 28.0299, std.dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: 1.10% (7.2201 => 7.2992, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -45.71% (0.2575 => 0.1398, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -43.60% (0.0617 => 0.0348, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.82% (1.4690 => 1.1778, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.66% (1.4685 => 1.1798, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/mason/mason: -19.21% (0.0734 => 0.0593, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -5.47% (0.3035 => 0.2869, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -4.16% (34.8389 => 33.3893, std.dev.: 0.0211) MultiSource/Applications/ClamAV/clamscan: -3.23% (15.3890 => 14.8925, std.dev.: 0.0155) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.13% (22.0331 => 21.5630, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.44% (14.0915 => 13.8886, std.dev.: 0.0178) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.48% (0.0994 => 0.0860, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -9.00% (0.2166 => 0.1971, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.16% (0.9963 => 0.9648, std.dev.: 0.0029) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.00% (2.7528 => 2.7527, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.00% (2.1154 => 2.1153, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.00% (4.9748 => 4.9747, std.dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.00% (2.0176 => 2.4412, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.31% (0.1410 => 0.1640, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 14.77% (0.0826 => 0.0948, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 13.29% (0.2243 => 0.2541, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 12.67% (0.5818 => 0.6555, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: 12.56% (0.5748 => 0.6470, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 11.78% (0.7061 => 0.7893, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 11.28% (0.4062 => 0.4520, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 11.25% (0.4328 => 0.4815, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 11.00% (0.2781 => 0.3087, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.97% (0.1413 => 0.1568, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.82% (0.1072 => 0.1188) MultiSource/Benchmarks/Olden/tsp/tsp: 10.76% (0.1013 => 0.1122, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.71% (0.2782 => 0.3080, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.57% (0.3899 => 0.4311, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 10.53% (1.3693 => 1.5135, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.50% (0.3485 => 0.3851, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.45% (0.1588 => 0.1754, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.43% (3.9660 => 4.3795, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.42% (0.3022 => 0.3337, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.28% (0.2655 => 0.2928, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.20% (0.2765 => 0.3047, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 10.15% (0.2690 => 0.2963, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.14% (0.2721 => 0.2997, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.14% (1.9828 => 2.1838, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 10.13% (0.2607 => 0.2871, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 10.12% (0.2628 => 0.2894, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.11% (1.4563 => 1.6036, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/except: 10.07% (0.2760 => 0.3038, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.03% (0.7710 => 0.8483, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 10.01% (0.2726 => 0.2999, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 10.00% (0.2761 => 0.3037, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.00% (0.6283 => 0.6911, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.99% (0.4016 => 0.4417, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.98% (0.2966 => 0.3262, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 9.95% (0.7038 => 0.7738, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/lists: 9.93% (0.3293 => 0.3620, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 9.91% (0.2937 => 0.3228, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.91% (1.2193 => 1.3401, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.90% (0.3756 => 0.4128, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 9.90% (0.3868 => 0.4251, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.89% (0.9199 => 1.0109, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.89% (0.3489 => 0.3834, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.87% (0.1327 => 0.1458, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.86% (0.2596 => 0.2852, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.86% (0.3580 => 0.3933, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.83% (0.2696 => 0.2961, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 9.75% (0.3107 => 0.3410, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 9.65% (0.3149 => 0.3453, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.57% (0.5265 => 0.5769, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.56% (0.6959 => 0.7624, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: 9.50% (0.3453 => 0.3781, std.dev.: 0.0045) MultiSource/Applications/SPASS/SPASS: 9.45% (13.8202 => 15.1263, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/matrix: 9.44% (0.2988 => 0.3270, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 9.40% (0.3192 => 0.3492, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 9.28% (0.3534 => 0.3862, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.27% (1.1364 => 1.2418, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.16% (0.4390 => 0.4792, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.88% (0.3130 => 0.3408, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 8.87% (0.1589 => 0.1730, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 8.79% (0.2945 => 0.3204, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.68% (0.4791 => 0.5207, std.dev.: 0.0121) MultiSource/Applications/lemon/lemon: 8.67% (1.0313 => 1.1207, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.67% (0.6576 => 0.7146, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.64% (0.1435 => 0.1559) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.50% (0.5577 => 0.6051, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 8.38% (0.2995 => 0.3246, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.34% (0.2914 => 0.3157, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.32% (0.2127 => 0.2304, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.18% (0.3755 => 0.4062, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.18% (0.4379 => 0.4737, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 8.17% (16.6129 => 17.9701, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.16% (0.8698 => 0.9408, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.11% (0.1986 => 0.2147, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 8.02% (1.1061 => 1.1948, std.dev.: 0.0057) MultiSource/Applications/minisat/minisat: 8.01% (0.6744 => 0.7284, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 8.00% (0.8310 => 0.8975, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.95% (0.3246 => 0.3504, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.78% (7.2180 => 7.7798, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.72% (0.7460 => 0.8036, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.72% (0.5637 => 0.6072, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 7.69% (0.7506 => 0.8083, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 7.67% (0.3220 => 0.3467, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 7.51% (3.1889 => 3.4283, std.dev.: 0.0063) MultiSource/Benchmarks/nbench/nbench: 7.38% (1.0594 => 1.1376, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.35% (0.3578 => 0.3841, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.33% (0.3914 => 0.4201, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 7.32% (0.2925 => 0.3139, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.32% (0.2023 => 0.2171, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 7.30% (2.1791 => 2.3382, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-4: 7.30% (0.3646 => 0.3912, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 7.27% (3.8646 => 4.1455, std.dev.: 0.0075) SingleSource/UnitTests/ObjC/for-in: 7.26% (0.3789 => 0.4064, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.25% (0.3601 => 0.3862, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.24% (0.4003 => 0.4293, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/property: 7.23% (0.3940 => 0.4225, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.21% (0.3663 => 0.3927, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 7.20% (1.2749 => 1.3667, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.18% (0.3650 => 0.3912, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 7.17% (0.1478 => 0.1584, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 7.16% (1.9270 => 2.0650, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-3: 7.09% (0.3623 => 0.3880, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.08% (0.1865 => 0.1997, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.98% (3.6692 => 3.9254, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 6.90% (0.3131 => 0.3347, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 6.87% (14.8535 => 15.8732, std.dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: 6.84% (1.2292 => 1.3133, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.84% (1.3245 => 1.4151, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.82% (0.1569 => 0.1676, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.82% (0.1789 => 0.1911, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.78% (0.8818 => 0.9416, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 6.70% (0.1657 => 0.1768, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.69% (4.3801 => 4.6732, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/05-eks/eks: 6.66% (0.4113 => 0.4387, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 6.61% (8.4961 => 9.0581, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 6.54% (0.6250 => 0.6659, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.54% (0.6135 => 0.6536, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.50% (4.4433 => 4.7322, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.44% (0.3511 => 0.3737, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.36% (0.2140 => 0.2276, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 6.23% (4.6629 => 4.9535, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.07% (3.2742 => 3.4730, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.05% (0.1819 => 0.1929, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.04% (4.9865 => 5.2875, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.03% (0.2504 => 0.2655, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.99% (1.1333 => 1.2012, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.85% (0.4805 => 0.5086, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.52% (0.3245 => 0.3424, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 5.44% (6.5754 => 6.9328, std.dev.: 0.0137) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.31% (0.9108 => 0.9592, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.26% (1.5188 => 1.5987, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 4.89% (3.7467 => 3.9301, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.83% (0.2321 => 0.2433, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.73% (2.1007 => 2.2001, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.70% (6.2785 => 6.5736, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.55% (13.2842 => 13.8886, std.dev.: 0.0178) MultiSource/Applications/sqlite3/sqlite3: 2.97% (16.2614 => 16.7446, std.dev.: 0.0081) MultiSource/Applications/ClamAV/clamscan: 2.50% (14.5298 => 14.8925, std.dev.: 0.0155) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.61% (5.7573 => 7.5194, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.09% (1.0895 => 1.3629, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 24.94% (1.8175 => 2.2707, std.dev.: 0.0107) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 8.61% (1.1560 => 1.2555, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.61% (3.1736 => 3.4151, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 5.99% (1.2998 => 1.3776, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0047, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.49% (0.3139 => 0.3280, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.94% (11.2619 => 11.7052, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 3.56% (10.7476 => 11.1298, std.dev.: 0.0261) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9856, std.dev.: 0.0008) SingleSource/Regression/C/uint64_to_float: 2.97% (0.5449 => 0.5611, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.07% (7.4271 => 7.5812, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5143, std.dev.: 0.0098) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.28% (5.5130 => 5.5837, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9676, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1860, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 1.11% (12.4560 => 12.5938, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.02% (8.8259 => 8.9158, std.dev.: 0.0156) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.00% (9.9194 => 10.0188, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.64% (0.2670 => 0.1398, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -16.12% (0.0707 => 0.0593, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.78% (0.4657 => 0.3922, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.73% (1.3813 => 1.1778, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.62% (1.3819 => 1.1798, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.43% (22.5627 => 21.5630, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.74% (0.0997 => 0.0860, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.93% (0.2238 => 0.1971, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.87% (1.2308 => 1.0970, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.04% (20.3410 => 18.2983, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.44% (1.3780 => 1.3031, std.dev.: 0.0065) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5148, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.55% (3.2729 => 3.1567, std.dev.: 0.0178) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.48% (0.9996 => 0.9648, std.dev.: 0.0029) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.38% (1.7688 => 1.7090, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.38% (3.0263 => 2.9542, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.30% (1.9762 => 1.9307, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.96% (0.6589 => 0.6460, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.83% (6.3560 => 6.2397, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -1.65% (26.5159 => 26.0771, std.dev.: 0.0434) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0069, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.22% (3.9173 => 3.8697, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4949, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2586, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.09% (6.6320 => 6.5597, std.dev.: 0.0085) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.03% (1.0310 => 1.0204, std.dev.: 0.0019) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 2 01:04:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 2 Oct 2012 03:04:33 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121002080433.725122A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4473?compare_to=4470&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4473, Order: 164990, Start Time: 2012-10-02 06:37:06, End Time: 2012-10-02 08:06:13 To: 4470, Order: 164987, Start Time: 2012-10-02 04:51:28, End Time: 2012-10-02 06:17:31 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 4 (8 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 12 (65 on baseline) Performance Improvements: 25 (45 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 73 (69 on baseline) Unchanged Tests: 928 (773 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -1.94% (4.0724 => 3.9935, std.dev.: 0.0158) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -5.26% (60.1500 => 56.9861, std.dev.: 1.1889) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -0.25% (2.9446 => 2.9372, std.dev.: 0.0122) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 5.77% (2.3170 => 2.4506, std.dev.: 0.5206) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.02% (0.8847 => 0.9026, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.92% (0.5585 => 0.5692, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.25% (1.1115 => 1.1254, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/power/power: 15.49% (1.4399 => 1.6630, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.04% (5.0285 => 5.3826, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 7.00% (5.0212 => 5.3726, std.dev.: 0.0267) MultiSource/Benchmarks/mafft/pairlocalalign: 6.33% (59.8148 => 63.6023, std.dev.: 0.2106) MultiSource/Benchmarks/PAQ8p/paq8p: 5.88% (90.9711 => 96.3192, std.dev.: 0.1382) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.17% (0.3939 => 0.4064, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.66% (39.3906 => 40.4382, std.dev.: 0.3587) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 1.85% (0.5935 => 0.6045, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.19% (5.1283 => 5.1894, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.99% (13.1735 => 12.9118, std.dev.: 0.0691) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.55% (3.1755 => 3.1264, std.dev.: 0.0169) MultiSource/Applications/siod/siod: -1.12% (2.1757 => 2.1514, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.07% (4.3345 => 4.2881, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -22.18% (4.8686 => 3.7886, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -22.17% (4.8690 => 3.7893, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.23% (14.2419 => 11.5036, std.dev.: 0.7145) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -16.49% (9.7647 => 8.1543, std.dev.: 0.0218) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -13.02% (9.7687 => 8.4970, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -12.16% (4.5571 => 4.0030, std.dev.: 0.0394) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -11.36% (6.4338 => 5.7028, std.dev.: 0.0434) MultiSource/Benchmarks/FreeBench/neural/neural: -10.53% (1.0747 => 0.9615, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -7.56% (3.5332 => 3.2660, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.53% (6.3739 => 6.0214, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.30% (1.5890 => 1.5048, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.00% (3.5214 => 3.3452, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.68% (12.0934 => 11.5277, std.dev.: 0.0414) MultiSource/Benchmarks/Prolangs-C++/primes/primes: -4.36% (0.7953 => 0.7606, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.22% (11.7665 => 11.2702, std.dev.: 0.0312) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.02% (3.4962 => 3.3558, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -3.14% (2.4047 => 2.3293, std.dev.: 0.0074) MultiSource/Applications/sgefa/sgefa: -2.96% (0.3584 => 0.3478, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.39% (2.4034 => 2.3459, std.dev.: 0.0171) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.00% (9.2432 => 9.0581, std.dev.: 0.0294) SingleSource/Benchmarks/Misc/fp-convert: -1.82% (15.5765 => 15.2931, std.dev.: 0.0661) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.73% (1.0036 => 0.9963, std.dev.: 0.0133) MultiSource/Applications/sqlite3/sqlite3: -0.28% (0.6117 => 0.6100, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/08-main/main: -1.63% (0.1782 => 0.1753, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.47% (0.1498 => 0.1550, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.87% (0.3109 => 0.3082, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.89% (0.2318 => 0.2385, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.10% (0.3198 => 0.3131, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.69% (0.2315 => 0.2299, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: 17.71% (0.0367 => 0.0432, std.dev.: 0.0008) SingleSource/UnitTests/2003-05-07-VarArgs: -62.35% (0.0085 => 0.0032, std.dev.: 0.0029) SingleSource/UnitTests/2003-08-11-VaListArg: 1.14% (0.0088 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 3.78% (0.0185 => 0.0192, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0191 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -22.28% (0.0386 => 0.0300, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.34% (0.0297 => 0.0296, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 8.95% (0.0257 => 0.0280, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -8.72% (0.0321 => 0.0293, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/casts: 26.73% (0.0101 => 0.0128, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/test1: -43.46% (0.0191 => 0.0108, std.dev.: 0.0035) SingleSource/UnitTests/Vector/multiplies: - (0.0249 => 0.0249, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: 11.51% (0.0252 => 0.0281, std.dev.: 0.0019) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.75% (0.1457 => 0.1468, std.dev.: 0.0067) MultiSource/Applications/JM/lencod/lencod: -0.39% (0.2294 => 0.2285, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -3.75% (1.5479 => 1.4898, std.dev.: 0.0397) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.48% (0.1464 => 0.1471, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/Bullet/bullet: -0.84% (0.5924 => 0.5874, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 0.33% (26.6818 => 26.7690, std.dev.: 0.1949) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.07% (0.4012 => 0.4055, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.49% (0.1439 => 0.1360, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.74% (0.0585 => 0.0528, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -21.66% (0.0217 => 0.0170, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.36% (0.0636 => 0.0621, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.12% (1.1306 => 1.1292, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -25.00% (0.0016 => 0.0012, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.16% (0.0570 => 0.0552, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.54% (0.0142 => 0.0174, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.17% (0.7664 => 0.7651, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: - (1.7065 => 1.7065, std.dev.: 0.0153) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 150.00% (0.0002 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt MultiSource/Applications/JM/lencod/lencod: -96.61% (6.7458 => 0.2285, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -91.58% (6.9722 => 0.5874, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/09-vor/vor: 21540.26% (0.1237 => 26.7690, std.dev.: 0.1949) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -1.78% (4.0659 => 3.9935, std.dev.: 0.0158) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -6.84% (61.1734 => 56.9861, std.dev.: 1.1889) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.23% (3.2007 => 2.9372, std.dev.: 0.0122) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.93% (2.3580 => 2.4506, std.dev.: 0.5206) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.73% (4.1772 => 3.1024, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/except: 82716.67% (0.0006 => 0.4969, std.dev.: 0.0031) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.01% (0.0745 => 0.0909, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.49% (0.6410 => 0.6954, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 8.15% (2.1763 => 2.3537, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/bigfib: 6.95% (0.5309 => 0.5678, std.dev.: 0.0039) MultiSource/Applications/minisat/minisat: 6.42% (0.6173 => 0.6569, std.dev.: 0.0053) MultiSource/Applications/SIBsim4/SIBsim4: 6.18% (1.1653 => 1.2373, std.dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.09% (0.3582 => 0.3800, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.47% (1.5150 => 1.5978, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.25% (0.2552 => 0.2686, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.20% (0.2654 => 0.2792, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.51% (0.6069 => 0.6343, std.dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 4.35% (0.6915 => 0.7216, std.dev.: 0.0101) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.31% (0.7639 => 0.7968, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.05% (0.4248 => 0.4420, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 3.90% (3.0225 => 3.1403, std.dev.: 0.0161) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.79% (0.3901 => 0.4049, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.69% (0.4880 => 0.5060, std.dev.: 0.0068) MultiSource/Applications/SPASS/SPASS: 2.99% (13.3238 => 13.7223, std.dev.: 0.0805) MultiSource/Applications/Burg/burg: 2.98% (1.1440 => 1.1781, std.dev.: 0.0034) MultiSource/Applications/oggenc/oggenc: 2.95% (4.7455 => 4.8857, std.dev.: 0.0302) MultiSource/Benchmarks/Bullet/bullet: 2.87% (29.3170 => 30.1582, std.dev.: 0.2275) MultiSource/Benchmarks/mafft/pairlocalalign: 2.84% (8.2186 => 8.4522, std.dev.: 0.0862) MultiSource/Applications/siod/siod: 2.58% (2.0972 => 2.1514, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.55% (1.2021 => 1.2327, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.54% (2.0317 => 2.0833, std.dev.: 0.0081) MultiSource/Applications/JM/lencod/lencod: 2.17% (14.7256 => 15.0449, std.dev.: 0.0737) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.16% (6.2546 => 6.3900, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.14% (12.6413 => 12.9118, std.dev.: 0.0691) MultiSource/Applications/treecc/treecc: 2.13% (1.8798 => 1.9199, std.dev.: 0.0099) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.09% (0.8569 => 0.8748, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.08% (0.7226 => 0.7376, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.00% (1.0689 => 1.0903, std.dev.: 0.0067) MultiSource/Benchmarks/nbench/nbench: 2.00% (1.0821 => 1.1037, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.93% (1.4408 => 1.4686, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.85% (4.0318 => 4.1063, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/football/football: 1.76% (0.8405 => 0.8553, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.65% (3.0758 => 3.1264, std.dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.17% (1.3935 => 1.4098, std.dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 49.81% (0.0261 => 0.0391, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/pi: 41.12% (1.6538 => 2.3338, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2277, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/power/power: 17.24% (1.4184 => 1.6630, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/ary3: 15.26% (1.7426 => 2.0086, std.dev.: 0.0560) SingleSource/Benchmarks/Stanford/Puzzle: 14.03% (0.1433 => 0.1634, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.34% (2.4042 => 2.7250, std.dev.: 0.0659) SingleSource/Benchmarks/McGill/queens: 10.63% (1.6261 => 1.7989, std.dev.: 0.0175) MultiSource/Benchmarks/FreeBench/mason/mason: 9.87% (0.5004 => 0.5498, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 9.46% (0.1417 => 0.1551, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.17% (0.2857 => 0.3119, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout/lists: 8.68% (7.0025 => 7.6104, std.dev.: 0.0301) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.21% (1.0063 => 1.0789, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.09% (0.3301 => 0.3535, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bisort/bisort: 5.25% (0.6459 => 0.6798, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/dt: 4.21% (0.9851 => 1.0266, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.89% (38.9255 => 40.4382, std.dev.: 0.3587) MultiSource/Benchmarks/PAQ8p/paq8p: 3.85% (92.7467 => 96.3192, std.dev.: 0.1382) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.31% (40.4792 => 41.8182, std.dev.: 0.5197) MultiSource/Applications/hexxagon/hexxagon: 3.06% (14.4877 => 14.9312, std.dev.: 0.0456) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.06% (0.5587 => 0.5758, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.88% (0.5876 => 0.6045, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.80% (6.6312 => 6.8169, std.dev.: 0.0018) MultiSource/Applications/siod/siod: 2.80% (3.5520 => 3.6514, std.dev.: 0.0135) SingleSource/Benchmarks/Dhrystone/dry: 2.03% (2.4013 => 2.4501, std.dev.: 0.0077) MultiSource/Benchmarks/mafft/pairlocalalign: 1.91% (62.4126 => 63.6023, std.dev.: 0.2106) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.62% (4.6127 => 4.6875, std.dev.: 0.0097) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -45.36% (0.2996 => 0.1637, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.84% (0.0591 => 0.0326, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.69% (1.4189 => 1.1254, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -20.01% (1.4113 => 1.1289, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.62% (0.7784 => 0.7658, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.84% (0.3497 => 0.2034, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -34.73% (0.0311 => 0.0203, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -27.34% (15.8312 => 11.5036, std.dev.: 0.7145) SingleSource/Benchmarks/Shootout-C++/ary3: -19.51% (1.7473 => 1.4064, std.dev.: 0.0586) SingleSource/Benchmarks/CoyoteBench/lpbench: -18.15% (5.2665 => 4.3105, std.dev.: 0.2740) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.24% (1.7361 => 1.4716, std.dev.: 0.0184) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1586, std.dev.: 0.0340) MultiSource/Benchmarks/FreeBench/neural/neural: -12.00% (1.0926 => 0.9615, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.69% (1.1647 => 1.0518, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.90% (1.4034 => 1.2785, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: -8.43% (9.5474 => 8.7422, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/bh/bh: -7.44% (2.5166 => 2.3293, std.dev.: 0.0074) MultiSource/Applications/sgefa/sgefa: -7.15% (0.3746 => 0.3478, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.78% (3.6254 => 3.3796, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -6.73% (7.6833 => 7.1663, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/fibo: -6.58% (4.6355 => 4.3306, std.dev.: 0.0365) SingleSource/Benchmarks/Misc/richards_benchmark: -6.50% (1.4441 => 1.3502, std.dev.: 0.0096) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.48% (2.0027 => 1.8730, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7946, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.48% (3.9413 => 3.7252, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: -5.41% (3.4230 => 3.2378, std.dev.: 0.0278) SingleSource/Benchmarks/Shootout/fib2: -5.30% (4.4195 => 4.1852, std.dev.: 0.0121) SingleSource/Benchmarks/BenchmarkGame/n-body: -4.78% (1.5803 => 1.5048, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/distray/distray: -4.77% (0.2664 => 0.2537, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.65% (0.4564 => 0.4352, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.30% (45.4683 => 43.5113, std.dev.: 0.4119) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -4.17% (3.4080 => 3.2660, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: -4.08% (2.4457 => 2.3459, std.dev.: 0.0171) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.49% (9.3855 => 9.0581, std.dev.: 0.0294) SingleSource/Benchmarks/Shootout-C++/methcall: -2.88% (9.2503 => 8.9840, std.dev.: 0.0364) SingleSource/Benchmarks/McGill/misr: -2.70% (0.4296 => 0.4180, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.64% (3.7496 => 3.6505, std.dev.: 0.0383) MultiSource/Applications/aha/aha: -1.98% (3.4286 => 3.3607, std.dev.: 0.0084) MultiSource/Benchmarks/sim/sim: -1.97% (3.8907 => 3.8142, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/hash2: -1.96% (3.4876 => 3.4194, std.dev.: 0.0190) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.81% (2.3569 => 2.3143, std.dev.: 0.0159) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -1.57% (2.4971 => 2.4579, std.dev.: 0.0143) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3087, std.dev.: 0.0582) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.36% (27.1724 => 26.8035, std.dev.: 0.0162) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.17% (0.9980 => 0.9963, std.dev.: 0.0133) MultiSource/Applications/sqlite3/sqlite3: 1.30% (0.6022 => 0.6100, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/08-main/main: 5.22% (0.1666 => 0.1753, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.26% (0.1554 => 0.1550, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.03% (0.3083 => 0.3082, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.38% (0.2394 => 0.2385, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.39% (0.3175 => 0.3131, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.13% (0.2302 => 0.2299, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -3.79% (0.0449 => 0.0432, std.dev.: 0.0008) SingleSource/UnitTests/2003-05-07-VarArgs: -64.04% (0.0089 => 0.0032, std.dev.: 0.0029) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -20.00% (0.0240 => 0.0192, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0192 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -23.08% (0.0390 => 0.0300, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.66% (0.0301 => 0.0296, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.41% (0.0284 => 0.0280, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -9.57% (0.0324 => 0.0293, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/casts: -27.68% (0.0177 => 0.0128, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/test1: -42.86% (0.0189 => 0.0108, std.dev.: 0.0035) SingleSource/UnitTests/Vector/multiplies: - (0.0249 => 0.0249, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -13.54% (0.0325 => 0.0281, std.dev.: 0.0019) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.73% (0.1429 => 0.1468, std.dev.: 0.0067) MultiSource/Applications/lemon/lemon: -0.81% (1.5019 => 1.4898, std.dev.: 0.0397) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -2.00% (0.1501 => 0.1471, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.90% (0.4264 => 0.4055, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.19% (0.1344 => 0.1360, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.36% (0.0589 => 0.0528, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -26.72% (0.0232 => 0.0170, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.82% (0.0639 => 0.0621, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.51% (1.1350 => 1.1292, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.34% (0.0637 => 0.0552, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -29.27% (0.0246 => 0.0174, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.46% (0.7541 => 0.7651, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.08% (1.5363 => 1.7065, std.dev.: 0.0153) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 2 01:13:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 2 Oct 2012 03:13:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121002081319.9D3B22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4474?compare_to=4471&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4474, Order: 164990, Start Time: 2012-10-02 06:53:06, End Time: 2012-10-02 08:14:58 To: 4471, Order: 164987, Start Time: 2012-10-02 05:04:28, End Time: 2012-10-02 06:24:00 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (139 on baseline) Performance Improvements: 5 (46 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 946 (702 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mafft/pairlocalalign: 1.61% (10.2478 => 10.4126, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/power/power: 31.75% (1.1167 => 1.4712, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.02% (2.5374 => 2.5114, std.dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/n-body: -10.24% (1.3307 => 1.1944, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.58% (0.3625 => 0.3314, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.45% (13.4707 => 12.7363, std.dev.: 0.0660) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.15% (0.2432 => 0.2331, std.dev.: 0.0011) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.02% (0.5767 => 0.5768, std.dev.: 0.0070) MultiSource/Applications/SPASS/SPASS: -0.20% (15.9991 => 15.9679, std.dev.: 0.0307) MultiSource/Benchmarks/Bullet/bullet: -0.25% (54.1303 => 53.9971, std.dev.: 0.0560) MultiSource/Benchmarks/MallocBench/gs/gs: -0.36% (4.3294 => 4.3139, std.dev.: 0.0208) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.88% (0.0457 => 0.0461, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.87% (0.0459 => 0.0463, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.94% (0.0427 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.70% (0.0429 => 0.0432, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.48% (0.0417 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.96% (0.0418 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.73% (0.0411 => 0.0414, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.73% (0.0412 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.93% (0.0428 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.70% (0.0430 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.95% (0.0423 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.94% (0.0424 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.73% (0.0413 => 0.0416, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.48% (0.0415 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.71% (0.0421 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.95% (0.0421 => 0.0425) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.69% (0.0432 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.54% (0.0433 => 0.0457, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.74% (0.0408 => 0.0411, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.73% (0.0410 => 0.0413, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.71% (0.0420 => 0.0423, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.71% (0.0421 => 0.0424, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.73% (0.0412 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.73% (0.0413 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.99% (0.0403 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.99% (0.0404 => 0.0408) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.75% (0.0402 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.74% (0.0404 => 0.0407, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.68% (0.0440 => 0.0443, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.68% (0.0441 => 0.0444, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.75% (0.0401 => 0.0404, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.00% (0.0402 => 0.0406) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.75% (0.0402 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.74% (0.0404 => 0.0407) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.73% (0.0410 => 0.0413, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.97% (0.0411 => 0.0415) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.04% (1.2306 => 1.2301, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.01% (7.5432 => 7.5436, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.11% (0.7300 => 0.7292, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0357 => 0.0357, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 0.14% (0.1433 => 0.1435, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0672 => 0.0672, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -14.62% (63.2438 => 53.9971, std.dev.: 0.0560) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 30.44% (14.1553 => 18.4635, std.dev.: 0.0173) SingleSource/Benchmarks/Misc-C++-EH/spirit: 57.93% (3.4629 => 5.4690, std.dev.: 0.0125) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14239.31% (0.0720 => 10.3243, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10004100.00% (0.0001 => 10.0042, std.dev.: 0.0009) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 46.20% (0.2554 => 0.3734, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: 44.58% (10.3673 => 14.9890, std.dev.: 0.0105) MultiSource/Benchmarks/FreeBench/distray/distray: 29.45% (0.1056 => 0.1367, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 29.22% (0.1622 => 0.2096, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.04% (2.2022 => 2.5114, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.77% (7.0540 => 8.0254, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/flops: 13.69% (0.1432 => 0.1628, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.96% (0.1566 => 0.1769, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.57% (1.7609 => 1.9647, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.06% (0.3543 => 0.3935, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/trivial-interface: 11.06% (0.3473 => 0.3857, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.81% (0.3543 => 0.3926, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.81% (0.3516 => 0.3896, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.75% (0.3497 => 0.3873, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.70% (0.3561 => 0.3942, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.45% (0.3694 => 0.4080, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions: 10.32% (0.3828 => 0.4223, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.19% (0.3927 => 0.4327, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.98% (0.3886 => 0.4274, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 9.90% (10.4361 => 11.4694, std.dev.: 0.0214) MultiSource/Benchmarks/mafft/pairlocalalign: 9.79% (9.4845 => 10.4126, std.dev.: 0.0058) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.66% (0.1584 => 0.1737, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 9.26% (0.3282 => 0.3586, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 8.96% (0.5925 => 0.6456, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference-object: 8.81% (0.6030 => 0.6561, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.57% (0.7326 => 0.7954, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.55% (0.4879 => 0.5296, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.47% (0.3177 => 0.3446, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: 7.92% (0.1655 => 0.1786, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 7.69% (0.7115 => 0.7662, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.65% (0.1438 => 0.1548, std.dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.50% (0.3121 => 0.3355, std.dev.: 0.0025) MultiSource/Applications/sgefa/sgefa: 7.43% (0.3109 => 0.3340, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.38% (1.5415 => 1.6553, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.34% (0.2603 => 0.2794, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 7.19% (5.7591 => 6.1734, std.dev.: 0.0125) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.00% (0.4615 => 0.4938, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists: 6.98% (0.3422 => 0.3661, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 6.98% (0.3423 => 0.3662, std.dev.: 0.0093) MultiSource/Applications/lambda-0_1_3/lambda: 6.92% (0.7433 => 0.7947, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.91% (0.2271 => 0.2428, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.88% (0.2891 => 0.3090, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.86% (0.4636 => 0.4954, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 6.78% (0.1695 => 0.1810, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.78% (1.3050 => 1.3935, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.78% (0.2065 => 0.2205, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.78% (0.4103 => 0.4381, std.dev.: 0.0023) MultiSource/Applications/d/make_dparser: 6.74% (3.3354 => 3.5602, std.dev.: 0.0113) SingleSource/Regression/C++/ofstream_ctor: 6.71% (0.2905 => 0.3100, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.71% (0.1625 => 0.1734, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.67% (0.8172 => 0.8717, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.61% (0.4203 => 0.4481, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.60% (0.5105 => 0.5442, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/strcat: 6.57% (0.2831 => 0.3017, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.56% (4.2646 => 4.5442, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.52% (0.5860 => 0.6242, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/fibo: 6.50% (0.2725 => 0.2902, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 6.45% (0.3052 => 0.3249, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.44% (0.4289 => 0.4565, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.41% (0.3650 => 0.3884, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.41% (0.8067 => 0.8584, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/moments: 6.40% (0.4048 => 0.4307, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.39% (0.3865 => 0.4112, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 6.38% (0.6456 => 0.6868, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.36% (2.0665 => 2.1980, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.35% (0.3307 => 0.3517, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.35% (0.2756 => 0.2931, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 6.34% (0.3232 => 0.3437, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.30% (0.2872 => 0.3053, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.30% (0.9765 => 1.0380, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/matrix: 6.29% (0.3098 => 0.3293, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.28% (0.3136 => 0.3333, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.27% (0.2793 => 0.2968, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.26% (0.2700 => 0.2869, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.25% (5.0018 => 5.3145, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.25% (8.1363 => 8.6449, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/random: 6.25% (0.2802 => 0.2977, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 6.24% (0.7835 => 0.8324, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.23% (0.5569 => 0.5916, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.23% (0.3162 => 0.3359, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.21% (4.9449 => 5.2520, std.dev.: 0.0135) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.16% (7.9617 => 8.4521, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.12% (0.3826 => 0.4060, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 6.10% (0.4620 => 0.4902, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.09% (0.2758 => 0.2926, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hello: 6.08% (0.2714 => 0.2879, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.07% (0.2107 => 0.2235, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: 6.03% (0.3283 => 0.3481, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.02% (0.3603 => 0.3820, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.01% (0.2877 => 0.3050, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 5.99% (1.1642 => 1.2339, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/lists1: 5.92% (0.3684 => 0.3902, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.90% (1.5603 => 1.6523, std.dev.: 0.0135) MultiSource/Benchmarks/sim/sim: 5.85% (0.3387 => 0.3585, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 5.80% (21.9371 => 23.2105, std.dev.: 0.0380) SingleSource/Benchmarks/Shootout-C++/ary2: 5.62% (0.3379 => 0.3569, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.57% (0.1940 => 0.2048, std.dev.: 0.0015) MultiSource/Applications/lua/lua: 5.51% (3.8723 => 4.0855, std.dev.: 0.0186) MultiSource/Applications/lemon/lemon: 5.39% (1.0722 => 1.1300, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 5.30% (0.4299 => 0.4527, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.26% (0.3441 => 0.3622, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.24% (1.1861 => 1.2482, std.dev.: 0.0030) MultiSource/Applications/treecc/treecc: 5.22% (2.0273 => 2.1331, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/09-vor/vor: 5.19% (0.3180 => 0.3345, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.87% (0.4064 => 0.4262, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 4.77% (2.2969 => 2.4065, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/football/football: 4.71% (0.8921 => 0.9341, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.65% (0.6450 => 0.6750, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.46% (0.5981 => 0.6248, std.dev.: 0.0077) MultiSource/Applications/hexxagon/hexxagon: 4.28% (1.2842 => 1.3392, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/objinst: 4.18% (0.3131 => 0.3262, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.92% (1.4186 => 1.4742, std.dev.: 0.0061) MultiSource/Benchmarks/nbench/nbench: 3.77% (1.1840 => 1.2286, std.dev.: 0.0101) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.12% (0.3817 => 0.3936, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.86% (0.8101 => 0.8333, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.50% (1.1194 => 1.1474, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.50% (14.3668 => 14.7259, std.dev.: 0.0121) MultiSource/Applications/sqlite3/sqlite3: 1.96% (17.1811 => 17.5173, std.dev.: 0.0254) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/power/power: 30.46% (1.1277 => 1.4712, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.25% (1.1145 => 1.3848, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.18% (3.1595 => 3.4497, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 6.66% (1.1396 => 1.2155, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (3.1578 => 3.3671, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.4162 => 0.4322, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.76% (3.6395 => 3.7762, std.dev.: 0.0034) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.86% (4.2280 => 4.3489, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.35% (1.7254 => 1.7660, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.11% (11.6436 => 11.7723, std.dev.: 0.0068) MultiSource/Applications/minisat/minisat: 1.02% (9.1159 => 9.2091, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1280, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: -80.27% (0.8651 => 0.1707, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.25% (5.2763 => 3.2581, std.dev.: 0.0126) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.27% (5.3855 => 3.5939, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.84% (5.3526 => 3.5947, std.dev.: 0.0046) SingleSource/UnitTests/Vector/constpool: -14.79% (54.1659 => 46.1529, std.dev.: 0.0157) MultiSource/Benchmarks/FreeBench/mason/mason: -14.55% (0.0811 => 0.0693, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.11% (2.9384 => 2.6118, std.dev.: 0.0023) MultiSource/Applications/ClamAV/clamscan: -10.68% (22.1758 => 19.8072, std.dev.: 0.0483) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -43.00% (0.0400 => 0.0228, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel: -33.38% (1.1492 => 0.7656, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: -15.94% (1.6925 => 1.4227, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.53% (0.0998 => 0.0863, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: -12.67% (1.3677 => 1.1944, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -12.35% (1.2373 => 1.0845, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/mandel-2: -10.35% (1.5373 => 1.3782, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/mason/mason: -9.95% (0.2161 => 0.1946, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.47% (19.9488 => 18.2601, std.dev.: 0.0300) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.65% (0.2497 => 0.2331, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.59% (1.8329 => 1.7121, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5753, std.dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/fldry: -5.57% (1.9577 => 1.8487, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.22% (13.4384 => 12.7363, std.dev.: 0.0660) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.99% (1.6805 => 1.5966, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7966, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.64% (1.5835 => 1.5100, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.40% (0.9957 => 0.9519, std.dev.: 0.0089) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.30% (0.3463 => 0.3314, std.dev.: 0.0012) MultiSource/Applications/siod/siod: -3.69% (3.2827 => 3.1615, std.dev.: 0.0039) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.42% (32.5116 => 31.4000, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.47% (8.6802 => 8.4656, std.dev.: 0.0254) MultiSource/Applications/hexxagon/hexxagon: -2.42% (12.4730 => 12.1712, std.dev.: 0.0017) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.95% (10.2830 => 10.0822, std.dev.: 0.0243) SingleSource/UnitTests/Vector/multiplies: -1.82% (2.5528 => 2.5063, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.76% (8.1563 => 8.0124, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6808, std.dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std.dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: -1.47% (4.6441 => 4.5759, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/lists: -1.17% (6.2999 => 6.2263, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8563, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.31% (0.5229 => 0.5768, std.dev.: 0.0070) MultiSource/Applications/SPASS/SPASS: 6.53% (14.9895 => 15.9679, std.dev.: 0.0307) MultiSource/Benchmarks/MallocBench/gs/gs: 4.95% (4.1105 => 4.3139, std.dev.: 0.0208) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.34% (1.1048 => 1.2301, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.38% (7.1582 => 7.5436, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/stepanov_container: 17.20% (0.6222 => 0.7292, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35600.00% (0.0001 => 0.0357, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.37% (0.1485 => 0.1435, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.24% (0.2116 => 0.0672, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 2 01:25:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 2 Oct 2012 03:25:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121002082552.7D76A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4475?compare_to=4472&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4475, Order: 164992, Start Time: 2012-10-02 06:59:00, End Time: 2012-10-02 08:26:42 To: 4472, Order: 164987, Start Time: 2012-10-02 05:04:26, End Time: 2012-10-02 06:29:51 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 1 (151 on baseline) Performance Improvements: 4 (38 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1034 (715 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 3.01% (42.5245 => 43.8029, std.dev.: 0.1319) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.58% (0.3625 => 0.3314, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.30% (13.4617 => 12.7481, std.dev.: 0.0183) MultiSource/Benchmarks/llubenchmark/llu: -2.58% (3.9122 => 3.8111, std.dev.: 0.0369) MultiSource/Benchmarks/mafft/pairlocalalign: -1.19% (28.0299 => 27.6956, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.00% (2.7527 => 2.7528, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.00% (2.1153 => 2.1154, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.01% (4.9747 => 4.9751, std.dev.: 0.0065) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.86% (2.0176 => 2.4385, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.31% (0.1410 => 0.1640, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 15.25% (0.0826 => 0.0952, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/08-main/main: 13.37% (0.2243 => 0.2543, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 12.15% (0.5818 => 0.6525, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 12.13% (0.5748 => 0.6445, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 11.55% (0.4062 => 0.4531, std.dev.: 0.0079) SingleSource/UnitTests/ObjC++/property-reference: 11.46% (0.7061 => 0.7870, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 11.21% (0.4328 => 0.4813, std.dev.: 0.0102) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.18% (0.1413 => 0.1571, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 10.96% (0.1013 => 0.1124, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 10.93% (0.2781 => 0.3085, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.67% (0.3485 => 0.3857, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.61% (3.9660 => 4.3867, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.57% (0.2782 => 0.3076, std.dev.: 0.0109) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.54% (0.1072 => 0.1185, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.52% (0.1588 => 0.1755, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.41% (0.3899 => 0.4305, std.dev.: 0.0018) MultiSource/Applications/hbd/hbd: 10.38% (1.3693 => 1.5114, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.38% (0.7710 => 0.8510, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.33% (0.2721 => 0.3002, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.32% (0.3022 => 0.3334, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.32% (0.2596 => 0.2864, std.dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: 10.29% (0.7038 => 0.7762, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hello: 10.24% (0.2607 => 0.2874, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.18% (1.4563 => 1.6046, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/random: 10.15% (0.2690 => 0.2963, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.11% (0.4016 => 0.4422, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/ary: 10.04% (0.3107 => 0.3419, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.04% (1.9828 => 2.1818, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.02% (0.9199 => 1.0121, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 10.01% (0.2628 => 0.2891, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/except: 9.96% (0.2760 => 0.3035, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.96% (0.6959 => 0.7652, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.95% (0.2765 => 0.3040, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/strcat: 9.94% (0.2726 => 0.2997, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/wc: 9.91% (0.2937 => 0.3228, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.88% (0.6283 => 0.6904, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/lists: 9.87% (0.3293 => 0.3618, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.87% (1.2193 => 1.3396, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.83% (0.3489 => 0.3832, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.81% (0.2966 => 0.3257, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.80% (0.3580 => 0.3931, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.80% (0.1327 => 0.1457, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.74% (0.5265 => 0.5778, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.72% (0.2696 => 0.2958, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary3: 9.65% (0.3149 => 0.3453, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/sieve: 9.53% (0.3453 => 0.3782, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/matrix: 9.44% (0.2988 => 0.3270, std.dev.: 0.0062) MultiSource/Applications/SPASS/SPASS: 9.44% (13.8202 => 15.1243, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.35% (1.1364 => 1.2426, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary2: 9.30% (0.3192 => 0.3489, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.98% (0.3130 => 0.3411, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 8.88% (0.2995 => 0.3261, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.79% (0.5577 => 0.6067, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.78% (0.1276 => 0.1388, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 8.73% (1.0313 => 1.1213, std.dev.: 0.0079) SingleSource/Benchmarks/McGill/chomp: 8.68% (0.1589 => 0.1727, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.61% (0.1986 => 0.2157, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 8.59% (0.2945 => 0.3198, std.dev.: 0.0073) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.54% (0.4379 => 0.4753, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.52% (0.6576 => 0.7136, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.50% (0.1435 => 0.1557, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.37% (0.2127 => 0.2305, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 8.36% (0.3578 => 0.3877, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 8.34% (1.1061 => 1.1984, std.dev.: 0.0043) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.27% (0.2914 => 0.3155, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 8.26% (0.3646 => 0.3947, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 8.23% (0.3789 => 0.4101, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.23% (0.2504 => 0.2710, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 8.16% (16.6129 => 17.9687, std.dev.: 0.0280) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.13% (0.8698 => 0.9405, std.dev.: 0.0205) SingleSource/UnitTests/ObjC/exceptions-2: 8.11% (0.3601 => 0.3893, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 8.10% (0.3914 => 0.4231, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 8.07% (0.8310 => 0.8981, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.07% (0.3246 => 0.3508, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.05% (0.3650 => 0.3944, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 8.05% (0.6744 => 0.7287, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/parameter-passing: 8.04% (0.4003 => 0.4325, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.04% (0.5637 => 0.6090, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.94% (0.3663 => 0.3954, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.94% (0.3940 => 0.4253, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.91% (7.2180 => 7.7893, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-3: 7.89% (0.3623 => 0.3909, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 7.86% (3.1889 => 3.4395, std.dev.: 0.0075) MultiSource/Benchmarks/McCat/18-imp/imp: 7.83% (0.3220 => 0.3472, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 7.82% (0.7506 => 0.8093, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.81% (0.2023 => 0.2181, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.75% (3.6692 => 3.9535, std.dev.: 0.0056) MultiSource/Benchmarks/nbench/nbench: 7.66% (1.0594 => 1.1406, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.64% (0.7460 => 0.8030, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 7.58% (3.8646 => 4.1574, std.dev.: 0.0033) MultiSource/Applications/treecc/treecc: 7.46% (1.9270 => 2.0708, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 7.45% (0.2925 => 0.3143, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 7.41% (2.1791 => 2.3406, std.dev.: 0.0092) MultiSource/Applications/viterbi/viterbi: 7.37% (0.1478 => 0.1587, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.24% (0.1865 => 0.2000, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.15% (0.1789 => 0.1917, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 7.12% (0.1657 => 0.1775, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.07% (1.3245 => 1.4182, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 6.96% (1.2749 => 1.3636, std.dev.: 0.0024) MultiSource/Benchmarks/sim/sim: 6.93% (0.3131 => 0.3348, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.93% (0.6135 => 0.6560, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 6.88% (14.8535 => 15.8755, std.dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 6.83% (8.4961 => 9.0767, std.dev.: 0.0072) MultiSource/Applications/hexxagon/hexxagon: 6.77% (1.2292 => 1.3124, std.dev.: 0.0109) MultiSource/Benchmarks/McCat/05-eks/eks: 6.71% (0.4113 => 0.4389, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.65% (4.3801 => 4.6712, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.57% (4.4433 => 4.7353, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.37% (0.8818 => 0.9380, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.31% (0.2140 => 0.2275, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 5.95% (4.6629 => 4.9403, std.dev.: 0.0214) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.94% (1.1333 => 1.2006, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.76% (0.3245 => 0.3432, std.dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.75% (0.3511 => 0.3713, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 5.44% (6.5754 => 6.9331, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.30% (0.2321 => 0.2444, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.17% (0.9108 => 0.9579, std.dev.: 0.0158) MultiSource/Applications/lua/lua: 5.05% (3.7467 => 3.9358, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.79% (6.2785 => 6.5794, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.68% (13.2842 => 13.9057, std.dev.: 0.0122) MultiSource/Applications/sqlite3/sqlite3: 3.10% (16.2614 => 16.7657, std.dev.: 0.0081) MultiSource/Applications/ClamAV/clamscan: 2.67% (14.5298 => 14.9171, std.dev.: 0.0174) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5156, std.dev.: 0.0535) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.09% (1.0895 => 1.3629, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.35% (1.8175 => 2.2600, std.dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.56% (1.1560 => 1.2550, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (3.1736 => 3.4147, std.dev.: 0.0148) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 5.99% (1.2998 => 1.3776, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0042, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.95% (11.2619 => 11.7073, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.85% (1.7081 => 1.7738, std.dev.: 0.0051) MultiSource/Applications/SPASS/SPASS: 3.53% (10.7476 => 11.1267, std.dev.: 0.0531) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9853, std.dev.: 0.0019) SingleSource/Regression/C/uint64_to_float: 2.97% (0.5449 => 0.5611, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: 2.17% (7.4271 => 7.5881, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0051) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5149, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: 1.27% (5.5130 => 5.5829, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1879, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std.dev.: 0.0177) MultiSource/Benchmarks/Olden/em3d/em3d: 1.13% (3.1071 => 3.1422, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.01% (1.4298 => 1.4443, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.00% (9.9194 => 10.0189, std.dev.: 0.0142) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.75% (0.2670 => 0.1395, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -16.12% (0.0707 => 0.0593) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.18% (0.4657 => 0.3950, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.71% (1.3813 => 1.1781, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.50% (1.3819 => 1.1815, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.49% (22.5627 => 21.5507, std.dev.: 0.0130) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.97% (0.2238 => 0.1970, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.94% (1.2308 => 1.0962, std.dev.: 0.0479) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.15% (20.3410 => 18.2770, std.dev.: 0.0166) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0263) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0205) SingleSource/UnitTests/Vector/multiplies: -5.12% (2.6470 => 2.5114, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.63% (13.3668 => 12.7481, std.dev.: 0.0183) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.45% (0.9996 => 0.9551, std.dev.: 0.0052) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8005, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.16% (0.3458 => 0.3314, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.58% (3.2729 => 3.1557, std.dev.: 0.0191) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.45% (1.7688 => 1.7078, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/lists: -3.23% (6.3560 => 6.1507, std.dev.: 0.0445) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.10% (0.4867 => 0.4716, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0016) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Applications/spiff/spiff: -2.31% (3.0263 => 2.9565, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: -2.30% (1.9762 => 1.9307, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.99% (0.6589 => 0.6458, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6956, std.dev.: 0.0016) MultiSource/Applications/lua/lua: -1.67% (26.5159 => 26.0723, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0070, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4949, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.15% (5.3167 => 5.2558, std.dev.: 0.0014) MultiSource/Applications/viterbi/viterbi: -1.05% (4.4810 => 4.4339, std.dev.: 0.0043) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 2 02:26:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 2 Oct 2012 04:26:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121002092612.6E5782A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4476?compare_to=4469&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4476, Order: 164990, Start Time: 2012-10-02 06:15:52, End Time: 2012-10-02 09:27:51 To: 4469, Order: 164984, Start Time: 2012-10-02 02:34:03, End Time: 2012-10-02 05:44:02 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 4 (126 on baseline) Performance Improvements: 9 (16 on baseline) Added Tests: 0 (131 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1026 (766 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mafft/pairlocalalign: 1.05% (2.2027 => 2.2259, std.dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.86% (14.7275 => 15.2959, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.38% (14.8851 => 15.3883, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.11% (6.9588 => 7.0358, std.dev.: 0.0143) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -16.80% (74.5882 => 62.0579, std.dev.: 0.1351) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -9.81% (118.5157 => 106.8864, std.dev.: 0.1928) MultiSource/Applications/sgefa/sgefa: -9.22% (1.5549 => 1.4116, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.00% (14.4050 => 13.9734, std.dev.: 0.0650) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.71% (2.0856 => 2.0290, std.dev.: 0.0219) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.65% (21.9721 => 21.3897, std.dev.: 0.0294) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.32% (54.7653 => 53.4957, std.dev.: 0.0787) MultiSource/Benchmarks/Olden/power/power: -2.19% (3.2416 => 3.1705, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.03% (42.6604 => 41.7947, std.dev.: 0.0060) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.01% (9.8083 => 9.8097, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.02% (9.4125 => 9.4148, std.dev.: 0.0380) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.14% (16.9576 => 16.9332, std.dev.: 0.0158) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 12.47% (0.3488 => 0.3923, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 12.43% (0.3460 => 0.3890, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 12.41% (0.3465 => 0.3895, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 12.36% (0.3446 => 0.3872, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 12.29% (0.3442 => 0.3865, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.19% (0.3496 => 0.3922, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.16% (0.3469 => 0.3891, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.89% (0.3643 => 0.4076, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.81% (0.3650 => 0.4081, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 11.57% (0.3724 => 0.4155, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 10.18% (0.5826 => 0.6419, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: 9.98% (0.5889 => 0.6477, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 9.33% (1.5932 => 1.7418, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.13% (0.2738 => 0.2988, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.66% (0.2875 => 0.3124, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.65% (0.7171 => 0.7791, std.dev.: 0.0021) SingleSource/Regression/C++/ofstream_ctor: 8.49% (0.3004 => 0.3259, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 8.44% (0.2750 => 0.2982, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 8.40% (0.2714 => 0.2942, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 8.37% (0.2725 => 0.2953, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.32% (0.2729 => 0.2956, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 8.28% (0.1619 => 0.1753, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 8.24% (0.2780 => 0.3009, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 8.21% (0.2803 => 0.3033, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.20% (2.0673 => 2.2369, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/objinst: 8.18% (0.2823 => 0.3054, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.17% (0.3195 => 0.3456, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 8.12% (0.9909 => 1.0714, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.09% (0.2792 => 0.3018, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 8.03% (0.2813 => 0.3039, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 8.01% (0.3096 => 0.3344, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.97% (0.2911 => 0.3143, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.96% (0.3267 => 0.3527, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.92% (0.3258 => 0.3516, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.91% (0.3060 => 0.3302, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 7.90% (0.2811 => 0.3033, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.73% (0.3362 => 0.3622, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.68% (0.3124 => 0.3364, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 7.65% (0.3348 => 0.3604, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.63% (1.3152 => 1.4156, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 7.63% (0.3317 => 0.3570, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.50% (0.3625 => 0.3897, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 7.48% (0.3678 => 0.3953, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.45% (0.3690 => 0.3965, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 7.43% (0.4146 => 0.4454, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.40% (0.3282 => 0.3525, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.40% (1.6211 => 1.7411, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/sieve: 7.35% (0.3726 => 0.4000, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.33% (0.3845 => 0.4127, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 7.23% (5.5417 => 5.9426, std.dev.: 0.0183) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.22% (0.1620 => 0.1737, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 7.22% (0.3477 => 0.3728, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.19% (3.5627 => 3.8190, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.04% (0.4361 => 0.4668, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.01% (0.4251 => 0.4549, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.83% (0.3981 => 0.4253, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.77% (0.4994 => 0.5332, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.76% (0.5000 => 0.5338, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 6.62% (1.0781 => 1.1495, std.dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: 6.59% (23.5202 => 25.0706, std.dev.: 0.0126) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.49% (2.7292 => 2.9064, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.33% (0.2068 => 0.2199, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.28% (0.2866 => 0.3046, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.16% (0.3930 => 0.4172, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 6.15% (0.5012 => 0.5320, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.08% (0.6435 => 0.6826, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.07% (0.2736 => 0.2902, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.01% (0.5026 => 0.5328, std.dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 6.00% (0.2566 => 0.2720, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.99% (0.2737 => 0.2901, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.95% (4.4195 => 4.6825, std.dev.: 0.0097) MultiSource/Benchmarks/mafft/pairlocalalign: 5.93% (2.1013 => 2.2259, std.dev.: 0.0071) MultiSource/Applications/ClamAV/clamscan: 5.92% (4.2109 => 4.4601, std.dev.: 0.0116) MultiSource/Applications/siod/siod: 5.88% (0.6634 => 0.7024, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/gs/gs: 5.73% (1.8794 => 1.9870, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 5.68% (0.4029 => 0.4258, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 5.50% (4.6177 => 4.8719, std.dev.: 0.0087) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.36% (0.4139 => 0.4361, std.dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 5.35% (2.1653 => 2.2812, std.dev.: 0.0067) MultiSource/Applications/lua/lua: 5.35% (1.4269 => 1.5032, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.32% (0.3084 => 0.3248, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 5.30% (0.2075 => 0.2185, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.28% (0.3903 => 0.4109, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.24% (0.3890 => 0.4094, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.23% (0.1968 => 0.2071, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.20% (0.4658 => 0.4900, std.dev.: 0.0022) MultiSource/Applications/hbd/hbd: 5.17% (0.9697 => 1.0198, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.04% (0.3271 => 0.3436, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 5.01% (0.3336 => 0.3503, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.86% (1.9694 => 2.0651, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.85% (0.2103 => 0.2205, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.84% (1.9966 => 2.0932, std.dev.: 0.0044) MultiSource/Applications/SIBsim4/SIBsim4: 4.76% (0.2691 => 0.2819, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 4.74% (0.5546 => 0.5809, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.45% (0.2969 => 0.3101, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.44% (0.4253 => 0.4442, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 4.30% (2.0346 => 2.1220, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: 4.17% (0.4847 => 0.5049, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.85% (0.7426 => 0.7712, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.49% (0.5361 => 0.5548, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.48% (11.6398 => 12.0443, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.35% (0.5584 => 0.5771, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.34% (4.6926 => 4.8495, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.06% (0.3792 => 0.3908, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 2.45% (11.9555 => 12.2482, std.dev.: 0.0124) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 7.35% (0.2122 => 0.2278, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 5.94% (3.3903 => 3.5918, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (12.0509 => 12.6688, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/flops: 4.75% (15.4430 => 16.1767, std.dev.: 0.1406) SingleSource/Benchmarks/Misc/flops-2: 4.49% (1.8057 => 1.8868, std.dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/dry: 4.20% (14.0481 => 14.6384, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1929, std.dev.: 0.0089) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5045, std.dev.: 0.0256) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.71% (3.1722 => 3.2264, std.dev.: 0.0027) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.38% (1.0142 => 1.0282, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.36% (7.1849 => 7.2828, std.dev.: 0.0185) MultiSource/Benchmarks/BitBench/five11/five11: 1.14% (8.4155 => 8.5112, std.dev.: 0.0107) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.11% (6.9584 => 7.0358, std.dev.: 0.0143) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5939, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std.dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.83% (25.4195 => 16.5656, std.dev.: 0.0122) MultiSource/Applications/sgefa/sgefa: -9.25% (1.5554 => 1.4116, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -8.33% (0.2402 => 0.2202, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9745, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7882, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/tsp/tsp: -7.19% (2.1113 => 1.9595) MultiSource/Benchmarks/Olden/power/power: -5.82% (3.3665 => 3.1705, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8038, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.02% (0.6293 => 0.6103, std.dev.: 0.0041) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7740, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.65% (17.2379 => 16.7818, std.dev.: 0.0249) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.48% (21.9346 => 21.3897, std.dev.: 0.0294) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5764, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0246) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0432, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 2 02:54:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 2 Oct 2012 04:54:54 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121002095454.BC54C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4477?compare_to=4473&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4477, Order: 164992, Start Time: 2012-10-02 08:26:00, End Time: 2012-10-02 09:56:35 To: 4473, Order: 164990, Start Time: 2012-10-02 06:37:06, End Time: 2012-10-02 08:06:13 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (8 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 6 (67 on baseline) Performance Improvements: 4 (46 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 77 (69 on baseline) Unchanged Tests: 955 (770 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.45% (0.1014 => 0.1120, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.28% (0.4169 => 0.4431, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.99% (0.2086 => 0.2190, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.60% (1.2011 => 1.2203, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.50% (2.5774 => 2.6676, std.dev.: 0.0326) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.43% (2.3459 => 2.4030, std.dev.: 0.0144) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -11.72% (3.4383 => 3.0353, std.dev.: 0.0934) SingleSource/Benchmarks/CoyoteBench/lpbench: -2.63% (4.3105 => 4.1971, std.dev.: 0.0430) SingleSource/Benchmarks/McGill/chomp: -2.12% (1.0269 => 1.0051, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.27% (4.4980 => 4.4407, std.dev.: 0.0029) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.10% (0.9963 => 0.9953, std.dev.: 0.0135) MultiSource/Applications/sqlite3/sqlite3: 0.74% (0.6100 => 0.6145, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/08-main/main: - (0.1753 => 0.1753, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.65% (0.1550 => 0.1560, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.49% (0.3082 => 0.3097, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.88% (0.2385 => 0.2364, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.32% (0.3131 => 0.3141, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.17% (0.2299 => 0.2295, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel: 0.23% (0.0432 => 0.0433, std.dev.: 0.0008) SingleSource/UnitTests/2003-05-07-VarArgs: -6.25% (0.0032 => 0.0030, std.dev.: 0.0027) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0089 => 0.0089, std.dev.: 0.0007) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 25.00% (0.0192 => 0.0240, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -41.88% (0.0191 => 0.0111, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 25.67% (0.0300 => 0.0377, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -12.50% (0.0296 => 0.0259, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -31.07% (0.0280 => 0.0193, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.34% (0.0293 => 0.0294, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/casts: 21.87% (0.0128 => 0.0156, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/test1: 76.85% (0.0108 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0249 => 0.0249, std.dev.: 0.0026) SingleSource/UnitTests/byval-alignment: 14.95% (0.0281 => 0.0323, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005) MultiSource/Applications/ClamAV/clamscan: -0.61% (0.1468 => 0.1459, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 0.18% (0.2285 => 0.2289, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.48% (1.4898 => 1.5119, std.dev.: 0.0358) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 2.24% (0.1471 => 0.1504, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/Bullet/bullet: -0.17% (0.5874 => 0.5864, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 0.27% (26.7690 => 26.8402, std.dev.: 0.0560) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.54% (0.4055 => 0.4077, std.dev.: 0.0215) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.57% (0.1360 => 0.1395, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.65% (0.0528 => 0.0542, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 12.94% (0.0170 => 0.0192, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 6.76% (0.0621 => 0.0663, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.89% (1.1292 => 1.1393, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 33.33% (0.0012 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.91% (0.0552 => 0.0557, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.79% (0.0174 => 0.0150, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.01% (0.7651 => 0.7652, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 0.80% (3.9935 => 4.0255, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.08% (56.9861 => 58.7431, std.dev.: 0.9409) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -0.38% (2.9372 => 2.9261, std.dev.: 0.0205) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -2.89% (2.4506 => 2.3799, std.dev.: 0.1132) SingleSource/Regression/C/2003-05-21-UnionBitfields: -50.00% (0.0002 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.04% (1.7065 => 1.7058, std.dev.: 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt MultiSource/Applications/JM/lencod/lencod: -96.61% (6.7458 => 0.2289, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: -91.59% (6.9722 => 0.5864, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/09-vor/vor: 21597.82% (0.1237 => 26.8402, std.dev.: 0.0560) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -0.99% (4.0659 => 4.0255, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.97% (61.1734 => 58.7431, std.dev.: 0.9409) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.58% (3.2007 => 2.9261, std.dev.: 0.0205) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 0.93% (2.3580 => 2.3799, std.dev.: 0.1132) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.47% (4.1772 => 3.0713, std.dev.: 0.0226) SingleSource/Benchmarks/Shootout-C++/except: 82533.33% (0.0006 => 0.4958, std.dev.: 0.0011) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.42% (0.0745 => 0.0912, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.85% (0.6410 => 0.6913, std.dev.: 0.0035) MultiSource/Benchmarks/PAQ8p/paq8p: 7.31% (2.1763 => 2.3354, std.dev.: 0.0316) SingleSource/Benchmarks/Misc-C++/bigfib: 6.82% (0.5309 => 0.5671, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 6.25% (0.6173 => 0.6559, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.97% (0.3582 => 0.3796, std.dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: 5.79% (1.1653 => 1.2328, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.69% (0.2654 => 0.2805, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.45% (1.5150 => 1.5976, std.dev.: 0.0065) MultiSource/Applications/lemon/lemon: 5.38% (1.0046 => 1.0586, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.29% (0.2552 => 0.2687, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 4.30% (15.3105 => 15.9695, std.dev.: 0.1607) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.30% (0.6069 => 0.6330, std.dev.: 0.0020) MultiSource/Applications/d/make_dparser: 3.95% (3.0225 => 3.1419, std.dev.: 0.0222) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.90% (0.2797 => 0.2906, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.77% (0.7639 => 0.7927, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.30% (0.4880 => 0.5041, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.23% (0.4248 => 0.4385, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.18% (1.1827 => 1.2203, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 2.92% (8.2186 => 8.4589, std.dev.: 0.0554) MultiSource/Applications/SPASS/SPASS: 2.92% (13.3238 => 13.7126, std.dev.: 0.0786) MultiSource/Applications/oggenc/oggenc: 2.86% (4.7455 => 4.8814, std.dev.: 0.0222) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.85% (1.2021 => 1.2364, std.dev.: 0.0032) MultiSource/Applications/hbd/hbd: 2.83% (1.3268 => 1.3644, std.dev.: 0.0135) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.69% (1.1672 => 1.1986, std.dev.: 0.0092) MultiSource/Benchmarks/Bullet/bullet: 2.67% (29.3170 => 30.0995, std.dev.: 0.1841) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.61% (6.2546 => 6.4180, std.dev.: 0.0185) MultiSource/Applications/siod/siod: 2.58% (2.0972 => 2.1514, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.37% (12.6413 => 12.9410, std.dev.: 0.0557) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.27% (3.0758 => 3.1456, std.dev.: 0.0112) MultiSource/Applications/JM/lencod/lencod: 2.07% (14.7256 => 15.0302, std.dev.: 0.1166) MultiSource/Applications/Burg/burg: 2.06% (1.1440 => 1.1676, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.00% (0.8569 => 0.8740, std.dev.: 0.0052) MultiSource/Benchmarks/nbench/nbench: 1.97% (1.0821 => 1.1034, std.dev.: 0.0037) MultiSource/Applications/treecc/treecc: 1.92% (1.8798 => 1.9158, std.dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.87% (1.4408 => 1.4677, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 1.85% (6.4908 => 6.6106, std.dev.: 0.0188) MultiSource/Benchmarks/Prolangs-C/football/football: 1.84% (0.8405 => 0.8560, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.61% (4.0318 => 4.0967, std.dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.57% (2.0317 => 2.0635, std.dev.: 0.0106) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.39% (1.0689 => 1.0838, std.dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.40% (1.6538 => 2.3385, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/city/city: 41.38% (0.0261 => 0.0369, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2278, std.dev.: 0.0113) MultiSource/Benchmarks/Olden/power/power: 17.81% (1.4184 => 1.6710, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: 14.66% (1.7426 => 1.9980, std.dev.: 0.0142) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.41% (2.4042 => 2.7025, std.dev.: 0.0108) SingleSource/Benchmarks/McGill/queens: 11.09% (1.6261 => 1.8064, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 10.33% (0.1433 => 0.1581, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.65% (0.2857 => 0.3104, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/mason/mason: 8.63% (0.5004 => 0.5436, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/lists: 8.40% (7.0025 => 7.5906, std.dev.: 0.0175) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.80% (1.0063 => 1.0747, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.97% (0.3301 => 0.3498, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/dt: 4.53% (0.9851 => 1.0297, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 3.94% (92.7467 => 96.3988, std.dev.: 0.4040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.36% (40.4792 => 41.8411, std.dev.: 0.5159) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.26% (0.5587 => 0.5769, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.18% (0.5876 => 0.6063, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.87% (6.6312 => 6.8212, std.dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 2.75% (14.4877 => 14.8865, std.dev.: 0.0642) MultiSource/Applications/siod/siod: 2.54% (3.5520 => 3.6422, std.dev.: 0.0126) MultiSource/Benchmarks/mafft/pairlocalalign: 1.90% (62.4126 => 63.6000, std.dev.: 0.3300) SingleSource/Benchmarks/Dhrystone/dry: 1.89% (2.4013 => 2.4466, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.49% (1.2726 => 1.2915, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.18% (2.4455 => 2.4744, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/whetstone: 1.15% (2.3453 => 2.3723, std.dev.: 0.0066) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -45.66% (0.2996 => 0.1628, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -45.01% (0.0591 => 0.0325, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -21.26% (1.4189 => 1.1172, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -20.36% (1.4113 => 1.1239, std.dev.: 0.0087) MultiSource/Applications/spiff/spiff: -1.59% (0.7738 => 0.7615, std.dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -42.61% (0.3497 => 0.2007, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -36.98% (0.0311 => 0.0196, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -27.21% (15.8312 => 11.5233, std.dev.: 0.1127) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.31% (5.2665 => 4.1971, std.dev.: 0.0430) SingleSource/Benchmarks/Shootout-C++/ary3: -19.96% (1.7473 => 1.3985, std.dev.: 0.1037) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.32% (1.7361 => 1.4702, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout/sieve: -12.35% (8.1594 => 7.1517, std.dev.: 0.0770) MultiSource/Benchmarks/FreeBench/neural/neural: -11.50% (1.0926 => 0.9670, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: -11.34% (0.0917 => 0.0813, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.37% (1.1647 => 1.0439, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.97% (1.4034 => 1.2775, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops: -8.30% (9.5474 => 8.7546, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: -7.66% (2.5166 => 2.3238, std.dev.: 0.0123) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.97% (3.6254 => 3.3726, std.dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: -6.88% (7.6833 => 7.1545, std.dev.: 0.0552) SingleSource/Benchmarks/Shootout-C++/fibo: -6.56% (4.6355 => 4.3314, std.dev.: 0.0052) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.54% (2.0027 => 1.8718, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/richards_benchmark: -6.49% (1.4441 => 1.3504, std.dev.: 0.0124) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.01% (2.9728 => 2.7942, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.47% (3.9413 => 3.7258, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: -5.37% (3.4230 => 3.2393, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout/fib2: -5.28% (4.4195 => 4.1861, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/distray/distray: -4.99% (0.2664 => 0.2531, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/n-body: -4.85% (1.5803 => 1.5036, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.62% (0.4564 => 0.4353, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -4.19% (3.4080 => 3.2653, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.84% (1.2722 => 1.2233, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/misr: -3.79% (0.4296 => 0.4133, std.dev.: 0.0029) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.55% (1.2959 => 1.2499, std.dev.: 0.0112) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.53% (9.3855 => 9.0546, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.25% (3.7496 => 3.6276, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/methcall: -3.16% (9.2503 => 8.9583, std.dev.: 0.0206) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.38% (1.1683 => 1.1405, std.dev.: 0.0020) MultiSource/Applications/aha/aha: -2.04% (3.4286 => 3.3587, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash2: -1.88% (3.4876 => 3.4220, std.dev.: 0.0144) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.75% (2.4457 => 2.4030, std.dev.: 0.0144) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.50% (2.3569 => 2.3215, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3067, std.dev.: 0.0052) SingleSource/Benchmarks/Dhrystone/fldry: -1.34% (2.4971 => 2.4637, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/lists: -1.32% (16.5617 => 16.3426, std.dev.: 0.0681) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.27% (0.9980 => 0.9953, std.dev.: 0.0135) MultiSource/Applications/sqlite3/sqlite3: 2.04% (0.6022 => 0.6145, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/08-main/main: 5.22% (0.1666 => 0.1753, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.39% (0.1554 => 0.1560, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.45% (0.3083 => 0.3097, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.25% (0.2394 => 0.2364, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.07% (0.3175 => 0.3141, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.30% (0.2302 => 0.2295, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel: -3.56% (0.0449 => 0.0433, std.dev.: 0.0008) SingleSource/UnitTests/2003-05-07-VarArgs: -66.29% (0.0089 => 0.0030, std.dev.: 0.0027) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0007) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0240 => 0.0240, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -42.19% (0.0192 => 0.0111, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.33% (0.0390 => 0.0377, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.95% (0.0301 => 0.0259, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -32.04% (0.0284 => 0.0193, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -9.26% (0.0324 => 0.0294, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/casts: -11.86% (0.0177 => 0.0156, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/test1: 1.06% (0.0189 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0249 => 0.0249, std.dev.: 0.0026) SingleSource/UnitTests/byval-alignment: -0.62% (0.0325 => 0.0323, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005) MultiSource/Applications/ClamAV/clamscan: 2.10% (0.1429 => 0.1459, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 0.67% (1.5019 => 1.5119, std.dev.: 0.0358) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.20% (0.1501 => 0.1504, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.39% (0.4264 => 0.4077, std.dev.: 0.0215) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.79% (0.1344 => 0.1395, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.98% (0.0589 => 0.0542, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -17.24% (0.0232 => 0.0192, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.76% (0.0639 => 0.0663, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.38% (1.1350 => 1.1393, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 166.67% (0.0006 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.56% (0.0637 => 0.0557, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.02% (0.0246 => 0.0150, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.47% (0.7541 => 0.7652, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.03% (1.5363 => 1.7058, std.dev.: 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 2 03:02:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 2 Oct 2012 05:02:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121002100256.C106E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4478?compare_to=4474&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4478, Order: 164992, Start Time: 2012-10-02 08:44:21, End Time: 2012-10-02 10:04:01 To: 4474, Order: 164990, Start Time: 2012-10-02 06:53:06, End Time: 2012-10-02 08:14:58 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (146 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 952 (696 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.21% (1.0845 => 1.0976, std.dev.: 0.0026) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.23% (0.5768 => 0.5755, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 0.10% (15.9679 => 15.9841, std.dev.: 0.0095) MultiSource/Benchmarks/Bullet/bullet: -0.02% (53.9971 => 53.9855, std.dev.: 0.0305) MultiSource/Benchmarks/MallocBench/gs/gs: 0.18% (4.3139 => 4.3216, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.22% (0.0461 => 0.0462, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0463 => 0.0463, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0431 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.23% (0.0432 => 0.0433) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.24% (0.0419 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.24% (0.0422 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.24% (0.0414 => 0.0415, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.24% (0.0415 => 0.0416) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0432 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0433 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.23% (0.0427 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0428 => 0.0428, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0416 => 0.0416) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.24% (0.0417 => 0.0418) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0424 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0425 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0435 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.16% (0.0457 => 0.0438, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.24% (0.0411 => 0.0412, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0413 => 0.0413) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0423 => 0.0423, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0424 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0415 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0416 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0407 => 0.0407) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0408 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0405 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0407 => 0.0407) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0443 => 0.0443, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0444 => 0.0444, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.74% (0.0404 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.25% (0.0406 => 0.0405, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.25% (0.0405 => 0.0406, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.25% (0.0407 => 0.0406, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.24% (0.0413 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0415 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.14% (1.2301 => 1.2284, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.10% (7.5436 => 7.5360, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.08% (0.7292 => 0.7286, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.56% (0.0357 => 0.0359, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1435 => 0.1434, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.12% (0.0672 => 0.0651, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -14.64% (63.2438 => 53.9855, std.dev.: 0.0305) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 30.49% (14.1553 => 18.4707, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++-EH/spirit: 57.99% (3.4629 => 5.4709, std.dev.: 0.0161) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14234.86% (0.0720 => 10.3211, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10004100.00% (0.0001 => 10.0042, std.dev.: 0.0019) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 46.20% (0.2554 => 0.3734, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: 44.60% (10.3673 => 14.9906, std.dev.: 0.0096) MultiSource/Benchmarks/FreeBench/distray/distray: 29.45% (0.1056 => 0.1367, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 29.22% (0.1622 => 0.2096, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.13% (2.2022 => 2.5133, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 13.69% (0.1432 => 0.1628, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.66% (7.0540 => 8.0179, std.dev.: 0.0119) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.58% (0.1566 => 0.1763, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.44% (1.7609 => 1.9624, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/trivial-interface: 11.06% (0.3473 => 0.3857, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.89% (0.3543 => 0.3929, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.87% (0.3497 => 0.3877, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.78% (0.3543 => 0.3925, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.75% (0.3516 => 0.3894, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.73% (0.3561 => 0.3943, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.42% (0.3694 => 0.4079, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.29% (0.3828 => 0.4222, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.29% (0.3927 => 0.4331, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.04% (0.3886 => 0.4276, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 9.91% (10.4361 => 11.4708, std.dev.: 0.0135) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.72% (0.1584 => 0.1738, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 9.64% (9.4845 => 10.3988, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/oourafft: 9.29% (0.3282 => 0.3587, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 8.96% (0.5925 => 0.6456, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.86% (0.6030 => 0.6564, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 8.16% (0.1655 => 0.1790, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.12% (0.4879 => 0.5275, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 7.93% (0.7326 => 0.7907, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.84% (0.3177 => 0.3426, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.65% (0.1438 => 0.1548, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.61% (0.6675 => 0.7183, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 7.60% (0.7115 => 0.7656, std.dev.: 0.0023) MultiSource/Applications/sgefa/sgefa: 7.43% (0.3109 => 0.3340, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.41% (0.2603 => 0.2796, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.37% (1.5415 => 1.6551, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 7.25% (0.3423 => 0.3671, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.24% (0.4615 => 0.4949, std.dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 7.23% (5.7591 => 6.1752, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.13% (0.2271 => 0.2433, std.dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: 7.12% (0.7433 => 0.7962, std.dev.: 0.0042) MultiSource/Applications/d/make_dparser: 7.02% (3.3354 => 3.5696, std.dev.: 0.0120) MultiSource/Benchmarks/Olden/em3d/em3d: 7.02% (0.1695 => 0.1814, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.97% (0.4103 => 0.4389, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 6.93% (0.3422 => 0.3659, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 6.83% (0.7835 => 0.8370, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.81% (1.3050 => 1.3939, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.78% (0.2891 => 0.3087, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.78% (0.5105 => 0.5451, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.77% (0.1625 => 0.1735, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.63% (0.2065 => 0.2202, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 6.57% (0.2905 => 0.3096, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.56% (4.2646 => 4.5444, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.55% (0.5860 => 0.6244, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.54% (0.4203 => 0.4478, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.53% (0.9765 => 1.0403, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.52% (4.9449 => 5.2673, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.46% (2.0665 => 2.2000, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 6.45% (0.3052 => 0.3249, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.44% (0.3121 => 0.3322, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/strcat: 6.43% (0.2831 => 0.3013, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 6.42% (0.4048 => 0.4308, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.42% (0.2756 => 0.2933, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.42% (0.3865 => 0.4113, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.39% (0.4289 => 0.4563, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.38% (0.3650 => 0.3883, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.36% (0.8172 => 0.8692, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.35% (0.3136 => 0.3335, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.33% (0.2700 => 0.2871, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.32% (8.1363 => 8.6508, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.31% (0.5020 => 0.5337, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.31% (0.2725 => 0.2897, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.31% (0.3232 => 0.3436, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.29% (0.3307 => 0.3515, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.29% (5.0018 => 5.3162, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.28% (0.8067 => 0.8574, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.28% (0.5569 => 0.5919, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.27% (0.2872 => 0.3052, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 6.24% (0.6456 => 0.6859, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.23% (0.2871 => 0.3050, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.23% (0.3098 => 0.3291, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.23% (0.2714 => 0.2883, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.17% (0.2107 => 0.2237, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.16% (0.2793 => 0.2965, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.15% (7.9617 => 8.4513, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/random: 6.14% (0.2802 => 0.2974, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.14% (0.3162 => 0.3356, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 6.09% (1.1642 => 1.2351, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.02% (0.2758 => 0.2924, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.02% (0.4636 => 0.4915, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.01% (0.3826 => 0.4056, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 6.00% (0.3283 => 0.3480, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.00% (0.3603 => 0.3819, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.98% (0.2877 => 0.3049, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.97% (0.3684 => 0.3904, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 5.93% (0.4620 => 0.4894, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 5.90% (0.3387 => 0.3587, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 5.90% (21.9371 => 23.2306, std.dev.: 0.0272) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.82% (0.1940 => 0.2053, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 5.82% (1.5603 => 1.6511, std.dev.: 0.0075) MultiSource/Applications/lua/lua: 5.67% (3.8723 => 4.0918, std.dev.: 0.0255) SingleSource/Benchmarks/Shootout-C++/ary2: 5.59% (0.3379 => 0.3568, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 5.50% (1.0722 => 1.1312, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 5.44% (0.4299 => 0.4533, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.43% (0.3441 => 0.3628, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.28% (1.1861 => 1.2487, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 5.13% (2.0273 => 2.1314, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/09-vor/vor: 5.13% (0.3180 => 0.3343, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.98% (0.6450 => 0.6771, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 4.81% (2.2969 => 2.4073, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/football/football: 4.76% (0.8921 => 0.9346, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.60% (0.4064 => 0.4251, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.59% (1.5859 => 1.6587, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.56% (0.5981 => 0.6254, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/objinst: 4.25% (0.3131 => 0.3264, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 4.20% (1.2842 => 1.3381, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.12% (1.4186 => 1.4771, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.03% (2.2024 => 2.2911, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 3.83% (1.1840 => 1.2293, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.20% (0.3817 => 0.3939, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.85% (0.8101 => 0.8332, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.57% (14.3668 => 14.7361, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.44% (1.1194 => 1.1467, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.11% (17.1811 => 17.5428, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.66% (3.8922 => 3.9568, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 30.44% (1.1277 => 1.4710, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.25% (1.1145 => 1.3848, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.21% (3.1595 => 3.4505, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (3.1578 => 3.3672, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 6.61% (1.1396 => 1.2149, std.dev.: 0.0008) SingleSource/Regression/C/uint64_to_float: 3.64% (0.5413 => 0.5610, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.45% (3.6395 => 3.7650, std.dev.: 0.0108) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.86% (4.2280 => 4.3491, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7652, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (0.8275 => 0.8405, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.10% (6.5088 => 6.5803, std.dev.: 0.0034) MultiSource/Applications/minisat/minisat: 1.09% (9.1159 => 9.2150, std.dev.: 0.0342) MultiSource/Benchmarks/nbench/nbench: 1.00% (11.6436 => 11.7603, std.dev.: 0.0072) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1281, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -80.27% (0.8651 => 0.1707, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.20% (5.2763 => 3.2605, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.25% (5.3855 => 3.5947, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.88% (5.3526 => 3.5927, std.dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -14.79% (54.1659 => 46.1571, std.dev.: 0.0170) MultiSource/Benchmarks/FreeBench/mason/mason: -14.30% (0.0811 => 0.0695, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.16% (2.9384 => 2.6104, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -10.67% (22.1758 => 19.8086, std.dev.: 0.0319) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4248, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.63% (0.0998 => 0.0862, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: -12.67% (1.3677 => 1.1944, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.29% (1.2373 => 1.0976, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel-2: -10.33% (1.5373 => 1.3785, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/mason/mason: -10.09% (0.2161 => 0.1943, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.36% (19.9488 => 18.2813, std.dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.69% (1.8329 => 1.7103, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.65% (0.2497 => 0.2331, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.49% (13.4384 => 12.7012, std.dev.: 0.0721) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.02% (1.6805 => 1.5961, std.dev.: 0.0043) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.84% (1.5835 => 1.5068, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.79% (1.5660 => 1.4910, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.30% (0.3463 => 0.3314) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.13% (0.9957 => 0.9546, std.dev.: 0.0043) MultiSource/Applications/siod/siod: -3.57% (3.2827 => 3.1654, std.dev.: 0.0154) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.42% (32.5116 => 31.4010, std.dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: -2.40% (12.4730 => 12.1739, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.22% (8.6802 => 8.4874, std.dev.: 0.0188) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.85% (10.2830 => 10.0924, std.dev.: 0.0331) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.83% (8.1563 => 8.0072, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6789, std.dev.: 0.0026) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5141, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4204, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: -1.45% (4.6441 => 4.5768, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: -1.13% (6.2999 => 6.2289, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.06% (0.5229 => 0.5755, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 6.64% (14.9895 => 15.9841, std.dev.: 0.0095) MultiSource/Benchmarks/MallocBench/gs/gs: 5.14% (4.1105 => 4.3216, std.dev.: 0.0134) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.19% (1.1048 => 1.2284, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.28% (7.1582 => 7.5360, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: 17.10% (0.6222 => 0.7286, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35800.00% (0.0001 => 0.0359, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.43% (0.1485 => 0.1434, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 2 04:12:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 2 Oct 2012 06:12:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121002111250.196462A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4479?compare_to=4475&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4479, Order: 164993, Start Time: 2012-10-02 09:48:43, End Time: 2012-10-02 11:14:29 To: 4475, Order: 164992, Start Time: 2012-10-02 06:59:00, End Time: 2012-10-02 08:26:42 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 1 (172 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1038 (692 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/lists: 1.51% (6.1507 => 6.2437, std.dev.: 0.0056) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.00% (2.7528 => 2.7529, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (2.1154 => 2.1154, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.01% (4.9751 => 4.9747, std.dev.: 0.0019) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.87% (2.0176 => 2.4387, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 16.71% (0.0826 => 0.0964, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.67% (0.1410 => 0.1645, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 13.29% (0.2243 => 0.2541, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 12.53% (0.5818 => 0.6547, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 12.46% (0.5748 => 0.6464, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference: 11.88% (0.7061 => 0.7900, std.dev.: 0.0018) SingleSource/Regression/C++/ofstream_ctor: 11.54% (0.2781 => 0.3102, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 11.44% (0.4328 => 0.4823, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 11.10% (0.4062 => 0.4513, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 11.02% (0.1062 => 0.1179, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.97% (0.1413 => 0.1568, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.93% (0.2782 => 0.3086, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 10.86% (0.1013 => 0.1123, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.85% (0.3022 => 0.3350, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.82% (0.3899 => 0.4321, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.62% (0.3485 => 0.3855, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 10.60% (1.3693 => 1.5145, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 10.55% (0.2607 => 0.2882, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.51% (0.2655 => 0.2934, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.49% (1.9828 => 2.1907, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.47% (0.1327 => 0.1466, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.46% (0.4390 => 0.4849, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/random: 10.45% (0.2690 => 0.2971, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.44% (3.9660 => 4.3799, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 10.42% (0.2726 => 0.3010, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/fibo: 10.39% (0.2628 => 0.2901, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 10.36% (0.2760 => 0.3046, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.33% (0.1588 => 0.1752, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.33% (0.2721 => 0.3002, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 10.32% (0.2937 => 0.3240, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.28% (0.2966 => 0.3271, std.dev.: 0.0006) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.26% (0.1072 => 0.1182, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.25% (1.4563 => 1.6056, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.22% (0.3756 => 0.4140, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 10.21% (0.2761 => 0.3043, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.21% (0.4016 => 0.4426, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.21% (0.7710 => 0.8497, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.20% (0.2765 => 0.3047, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 10.19% (0.7038 => 0.7755, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 10.17% (0.3293 => 0.3628, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.13% (0.2696 => 0.2969, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 10.08% (0.3868 => 0.4258, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.04% (0.6283 => 0.6914, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.03% (0.3489 => 0.3839, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 10.01% (0.3107 => 0.3418, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.00% (0.3580 => 0.3938, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.94% (0.2596 => 0.2854, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary3: 9.91% (0.3149 => 0.3461, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.88% (1.2193 => 1.3398, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.88% (0.5265 => 0.5785) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.82% (0.9199 => 1.0102, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.73% (0.6959 => 0.7636, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 9.71% (0.2988 => 0.3278, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 9.70% (0.3453 => 0.3788, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.58% (0.6576 => 0.7206, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 9.56% (0.3192 => 0.3497, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 9.54% (0.3534 => 0.3871, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 9.39% (13.8202 => 15.1180, std.dev.: 0.0167) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.16% (1.1364 => 1.2405, std.dev.: 0.0026) MultiSource/Applications/sgefa/sgefa: 8.98% (0.2995 => 0.3264, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 8.96% (0.2945 => 0.3209, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.95% (0.3130 => 0.3410, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.93% (0.5577 => 0.6075, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.91% (0.1986 => 0.2163, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.66% (0.4791 => 0.5206, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 8.62% (1.0313 => 1.1202, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 8.56% (0.1589 => 0.1725, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.56% (0.2127 => 0.2309, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.50% (0.1435 => 0.1557, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.44% (0.2914 => 0.3160, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.39% (0.1276 => 0.1383, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 8.36% (0.6744 => 0.7308, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.34% (0.3755 => 0.4068, std.dev.: 0.0093) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.34% (0.4379 => 0.4744, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.28% (0.8698 => 0.9418, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.19% (0.2504 => 0.2709, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 8.12% (16.6129 => 17.9615, std.dev.: 0.0086) MultiSource/Applications/Burg/burg: 8.11% (1.1061 => 1.1958, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.10% (0.3246 => 0.3509, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 8.07% (0.8310 => 0.8981, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 8.04% (0.3220 => 0.3479, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.85% (7.2180 => 7.7843, std.dev.: 0.0119) MultiSource/Applications/spiff/spiff: 7.79% (0.7506 => 0.8091, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 7.78% (1.0594 => 1.1418, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.76% (3.6692 => 3.9538, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.72% (0.5637 => 0.6072, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.64% (0.7460 => 0.8030, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: 7.50% (3.1889 => 3.4281, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/gs/gs: 7.48% (3.8646 => 4.1537, std.dev.: 0.0075) MultiSource/Benchmarks/McCat/09-vor/vor: 7.38% (0.2925 => 0.3141, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.27% (0.2023 => 0.2170, std.dev.: 0.0023) MultiSource/Applications/viterbi/viterbi: 7.24% (0.1478 => 0.1585, std.dev.: 0.0018) MultiSource/Applications/treecc/treecc: 7.23% (1.9270 => 2.0663, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.18% (0.3650 => 0.3912, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 7.18% (2.1791 => 2.3355, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/trivial-interface: 7.15% (0.3578 => 0.3834, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.13% (1.3245 => 1.4190, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions: 7.13% (0.3914 => 0.4193, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/for-in: 7.10% (0.3789 => 0.4058, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 7.10% (1.2749 => 1.3654, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.08% (0.1865 => 0.1997, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.08% (0.3646 => 0.3904, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 7.07% (14.8535 => 15.9032, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/em3d/em3d: 7.06% (0.1657 => 0.1774, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 7.06% (0.3131 => 0.3352, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: 7.04% (0.4003 => 0.4285, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.04% (0.1789 => 0.1915, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 7.03% (1.2292 => 1.3156, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 7.03% (0.3601 => 0.3854, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.96% (0.3663 => 0.3918, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 6.96% (8.4961 => 9.0873, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/property: 6.95% (0.3940 => 0.4214, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.94% (0.6135 => 0.6561, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.82% (0.1569 => 0.1676, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.82% (0.3623 => 0.3870, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.75% (4.3801 => 4.6759, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 6.66% (0.6250 => 0.6666, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.65% (4.4433 => 4.7386, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/05-eks/eks: 6.61% (0.4113 => 0.4385, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.41% (0.3511 => 0.3736, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.37% (0.8818 => 0.9380, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.36% (0.2140 => 0.2276, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.23% (4.9865 => 5.2971, std.dev.: 0.0024) MultiSource/Applications/oggenc/oggenc: 6.00% (4.6629 => 4.9428, std.dev.: 0.0129) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.93% (1.1333 => 1.2005, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.93% (3.2742 => 3.4683, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.83% (0.4805 => 0.5085, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.70% (0.3245 => 0.3430, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.57% (6.5754 => 6.9415, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/oourafft: 5.53% (0.2008 => 0.2119, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.15% (0.9108 => 0.9577, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.11% (1.5188 => 1.5964, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.00% (0.2321 => 0.2437, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 4.99% (3.7467 => 3.9335, std.dev.: 0.0152) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.78% (6.2785 => 6.5788, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.69% (2.1007 => 2.1993, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.61% (13.2842 => 13.8969, std.dev.: 0.0230) MultiSource/Applications/sqlite3/sqlite3: 3.15% (16.2614 => 16.7734, std.dev.: 0.0216) MultiSource/Applications/ClamAV/clamscan: 2.52% (14.5298 => 14.8961, std.dev.: 0.0113) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5188, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/fbench: 25.41% (1.8175 => 2.2793, std.dev.: 0.0161) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/mst/mst: 8.77% (0.1322 => 0.1438) SingleSource/Benchmarks/Misc/richards_benchmark: 8.60% (1.1560 => 1.2554, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4139, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.20% (1.2998 => 1.3804, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.64% (1.9144 => 2.0032, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.94% (11.2619 => 11.7057, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.57% (10.7476 => 11.1316, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9858, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.15% (7.4271 => 7.5868, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5143, std.dev.: 0.0108) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.30% (5.5130 => 5.5849, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9679, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1877, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/em3d/em3d: 1.14% (3.1071 => 3.1424, std.dev.: 0.0030) MultiSource/Applications/lemon/lemon: 1.09% (1.4298 => 1.4454, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5881, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.00% (9.9194 => 10.0187, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.72% (0.2670 => 0.1396, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.04% (0.4657 => 0.3910, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -15.98% (0.0707 => 0.0594, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.69% (1.3819 => 1.1789, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.64% (1.3813 => 1.1791, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.28% (22.5627 => 21.5967, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.74% (0.0997 => 0.0860, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/mason/mason: -12.20% (0.2238 => 0.1965, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -10.71% (1.2308 => 1.0990, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.17% (20.3410 => 18.2724, std.dev.: 0.0168) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.21% (1.3780 => 1.3062, std.dev.: 0.0034) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5144, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.77% (0.9996 => 0.9519, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.40% (13.3668 => 12.7780, std.dev.: 0.0295) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.16% (0.3458 => 0.3314, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.49% (1.7688 => 1.7070, std.dev.: 0.0175) MultiSource/Applications/siod/siod: -3.47% (3.2729 => 3.1594, std.dev.: 0.0261) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.10% (0.4867 => 0.4716, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.50% (3.0263 => 2.9506, std.dev.: 0.0027) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.31% (1.9762 => 1.9305, std.dev.: 0.0095) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.91% (0.6589 => 0.6463, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6929, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/lists: -1.77% (6.3560 => 6.2437, std.dev.: 0.0056) MultiSource/Applications/lua/lua: -1.70% (26.5159 => 26.0658, std.dev.: 0.0205) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0067, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8658, std.dev.: 0.0060) MultiSource/Applications/minisat/minisat: -1.24% (9.3358 => 9.2197, std.dev.: 0.0331) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4948, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2587, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 2 04:45:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 2 Oct 2012 06:45:42 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121002114542.5F58E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4480?compare_to=4477&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4480, Order: 164995, Start Time: 2012-10-02 10:13:32, End Time: 2012-10-02 11:47:23 To: 4477, Order: 164992, Start Time: 2012-10-02 08:26:00, End Time: 2012-10-02 09:56:35 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (8 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 19 (64 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 77 (69 on baseline) Unchanged Tests: 945 (780 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.17% (0.5612 => 0.5790, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.98% (0.5646 => 0.5814, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 2.13% (0.9399 => 0.9599, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 1.72% (1.1034 => 1.1224, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.43% (0.9543 => 0.9679, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.38% (0.8508 => 0.8625, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.33% (0.8185 => 0.8294, std.dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 1.30% (14.3897 => 14.5768, std.dev.: 0.0338) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 13.56% (19.7655 => 22.4448, std.dev.: 1.0315) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.78% (3.0357 => 3.3630, std.dev.: 0.0370) SingleSource/Benchmarks/Shootout/heapsort: 9.83% (3.0353 => 3.3338, std.dev.: 0.0717) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.96% (5.0218 => 5.3712, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 6.23% (43.4857 => 46.1928, std.dev.: 0.1160) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.70% (11.5233 => 11.7188, std.dev.: 0.0336) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.68% (41.8411 => 42.5429, std.dev.: 0.1849) SingleSource/Benchmarks/Misc/mandel-2: 1.59% (3.0713 => 3.1201, std.dev.: 0.0126) SingleSource/Benchmarks/Misc/ffbench: 1.43% (1.3990 => 1.4190, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.32% (2.6808 => 2.7163, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.27% (4.6693 => 4.7288, std.dev.: 0.0153) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: -3.87% (0.7914 => 0.7608, std.dev.: 0.0033) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.21% (0.9953 => 0.9974, std.dev.: 0.0071) MultiSource/Applications/sqlite3/sqlite3: 0.02% (0.6145 => 0.6146, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/08-main/main: 1.43% (0.1753 => 0.1778, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.81% (0.1560 => 0.1485, std.dev.: 0.0048) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.03% (0.3097 => 0.3096, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.44% (0.2364 => 0.2330, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.41% (0.3141 => 0.3128, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.04% (0.2295 => 0.2296, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: -3.70% (0.0433 => 0.0417, std.dev.: 0.0018) SingleSource/UnitTests/2003-05-07-VarArgs: -3.33% (0.0030 => 0.0029, std.dev.: 0.0029) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0089 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.42% (0.0240 => 0.0239, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 71.17% (0.0111 => 0.0190, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -8.75% (0.0377 => 0.0344, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 14.67% (0.0259 => 0.0297, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 46.11% (0.0193 => 0.0282, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 4.08% (0.0294 => 0.0306, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: 11.54% (0.0156 => 0.0174, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/test1: -0.52% (0.0191 => 0.0190, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: - (0.0249 => 0.0249, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -18.58% (0.0323 => 0.0263, std.dev.: 0.0029) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005) MultiSource/Applications/ClamAV/clamscan: 0.96% (0.1459 => 0.1473, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -0.83% (0.2289 => 0.2270, std.dev.: 0.0025) MultiSource/Applications/lemon/lemon: -0.47% (1.5119 => 1.5048, std.dev.: 0.0443) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -2.99% (0.1504 => 0.1459, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: 0.38% (0.5864 => 0.5886, std.dev.: 0.0101) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 0.30% (26.8402 => 26.9211, std.dev.: 0.0758) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.54% (0.4077 => 0.4055, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.23% (0.1395 => 0.1440, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.18% (0.0542 => 0.0543, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -10.94% (0.0192 => 0.0171, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.15% (0.0663 => 0.0664, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.90% (1.1393 => 1.1291, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -25.00% (0.0016 => 0.0012, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.92% (0.0557 => 0.0590, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.00% (0.0150 => 0.0159, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.26% (0.7652 => 0.7672, std.dev.: 0.0079) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 0.21% (4.0255 => 4.0341, std.dev.: 0.0357) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.49% (58.7431 => 59.6172, std.dev.: 0.5409) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 0.90% (2.9261 => 2.9524, std.dev.: 0.0228) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -3.81% (2.3799 => 2.2893, std.dev.: 0.0463) SingleSource/Regression/C/2003-05-21-UnionBitfields: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.01% (1.7058 => 1.7059, std.dev.: 0.0161) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt MultiSource/Applications/JM/lencod/lencod: -96.63% (6.7458 => 0.2270, std.dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: -91.56% (6.9722 => 0.5886, std.dev.: 0.0101) MultiSource/Benchmarks/McCat/09-vor/vor: 21663.22% (0.1237 => 26.9211, std.dev.: 0.0758) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -0.78% (4.0659 => 4.0341, std.dev.: 0.0357) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.54% (61.1734 => 59.6172, std.dev.: 0.5409) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.76% (3.2007 => 2.9524, std.dev.: 0.0228) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -2.91% (2.3580 => 2.2893, std.dev.: 0.0463) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.31% (4.1772 => 3.1201, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/except: 82200.00% (0.0006 => 0.4938, std.dev.: 0.0046) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.82% (0.0745 => 0.0915, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.35% (0.6410 => 0.6945, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 7.46% (0.5309 => 0.5705, std.dev.: 0.0026) MultiSource/Benchmarks/PAQ8p/paq8p: 7.32% (2.1763 => 2.3357, std.dev.: 0.0162) MultiSource/Applications/minisat/minisat: 6.42% (0.6173 => 0.6569, std.dev.: 0.0056) MultiSource/Applications/lemon/lemon: 6.19% (1.0046 => 1.0668, std.dev.: 0.0113) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.09% (0.3582 => 0.3800, std.dev.: 0.0030) MultiSource/Applications/SIBsim4/SIBsim4: 5.69% (1.1653 => 1.2316, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.29% (0.2552 => 0.2687, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.09% (0.2654 => 0.2789, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 4.91% (15.3105 => 16.0620, std.dev.: 0.0518) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.84% (1.5150 => 1.5884, std.dev.: 0.0103) MultiSource/Applications/d/make_dparser: 4.49% (3.0225 => 3.1582, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.48% (0.6069 => 0.6341, std.dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: 4.47% (0.6915 => 0.7224, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.20% (0.7639 => 0.7960, std.dev.: 0.0036) MultiSource/Applications/oggenc/oggenc: 4.03% (4.7455 => 4.9368, std.dev.: 0.0536) MultiSource/Applications/hbd/hbd: 3.98% (1.3268 => 1.3796, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.74% (1.2021 => 1.2471, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 3.72% (1.0821 => 1.1224, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.72% (0.2797 => 0.2901, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 3.39% (0.3217 => 0.3326, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.34% (13.3238 => 13.7693, std.dev.: 0.0589) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.30% (0.4880 => 0.5041, std.dev.: 0.0023) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.99% (6.2546 => 6.4416, std.dev.: 0.0327) MultiSource/Benchmarks/Prolangs-C/football/football: 2.94% (0.8405 => 0.8652, std.dev.: 0.0058) MultiSource/Benchmarks/Bullet/bullet: 2.84% (29.3170 => 30.1509, std.dev.: 0.2442) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.73% (0.5636 => 0.5790, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.69% (3.0758 => 3.1586, std.dev.: 0.0301) MultiSource/Benchmarks/mafft/pairlocalalign: 2.68% (8.2186 => 8.4387, std.dev.: 0.0837) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.66% (0.5937 => 0.6095, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.65% (12.6413 => 12.9768, std.dev.: 0.0598) MultiSource/Applications/Burg/burg: 2.54% (1.1440 => 1.1731, std.dev.: 0.0089) MultiSource/Applications/JM/lencod/lencod: 2.42% (14.7256 => 15.0818, std.dev.: 0.0662) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.99% (1.4408 => 1.4694, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 1.85% (0.9425 => 0.9599, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.34% (4.3380 => 4.3962, std.dev.: 0.0148) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.45% (1.6538 => 2.3393, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 22.13% (3.4629 => 4.2293, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/power/power: 17.86% (1.4184 => 1.6717, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: 14.96% (1.7426 => 2.0033, std.dev.: 0.0268) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.75% (0.0766 => 0.0879, std.dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.46% (2.4042 => 2.7037, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/heapsort: 11.15% (3.0256 => 3.3630, std.dev.: 0.0370) SingleSource/Benchmarks/McGill/queens: 11.09% (1.6261 => 1.8065, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: 9.95% (0.5004 => 0.5502, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout/lists: 9.22% (7.0025 => 7.6478, std.dev.: 0.0115) SingleSource/Benchmarks/Stanford/Puzzle: 9.14% (0.1433 => 0.1564, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.61% (0.2857 => 0.3103, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.48% (0.3301 => 0.3548, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.10% (40.4792 => 42.5429, std.dev.: 0.1849) MultiSource/Benchmarks/PAQ8p/paq8p: 4.43% (92.7467 => 96.8576, std.dev.: 0.4564) MultiSource/Benchmarks/Olden/bisort/bisort: 4.23% (0.6459 => 0.6732, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/dt: 4.14% (0.9851 => 1.0259, std.dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.04% (14.4877 => 14.9283, std.dev.: 0.0121) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.90% (0.5587 => 0.5749, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.85% (6.6312 => 6.8204, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 2.60% (0.6308 => 0.6472, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.52% (4.6127 => 4.7288, std.dev.: 0.0153) MultiSource/Benchmarks/mafft/pairlocalalign: 2.32% (62.4126 => 63.8633, std.dev.: 0.0607) SingleSource/Benchmarks/Dhrystone/dry: 2.02% (2.4013 => 2.4499, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.90% (2.6656 => 2.7163, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.59% (45.4683 => 46.1928, std.dev.: 0.1160) SingleSource/Benchmarks/Misc/fp-convert: 1.48% (15.2242 => 15.4500, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -45.63% (0.2996 => 0.1629, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -45.18% (0.0591 => 0.0324) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.58% (1.4189 => 1.1269, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -20.53% (1.4113 => 1.1216, std.dev.: 0.0084) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.98% (0.3497 => 0.2099, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -25.98% (15.8312 => 11.7188, std.dev.: 0.0336) SingleSource/Benchmarks/Shootout-C++/ary3: -19.89% (1.7473 => 1.3997, std.dev.: 0.0271) SingleSource/Benchmarks/CoyoteBench/lpbench: -19.58% (5.2665 => 4.2354, std.dev.: 0.0431) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.11% (1.7361 => 1.4737, std.dev.: 0.0270) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1587, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/neural/neural: -11.44% (1.0926 => 0.9676, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.75% (1.1647 => 1.0511, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: -8.46% (9.5474 => 8.7399, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.39% (1.4034 => 1.2857, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -7.26% (2.5166 => 2.3339, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: -7.02% (0.3746 => 0.3483, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.97% (3.6254 => 3.3727, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.81% (2.0027 => 1.8663, std.dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: -6.68% (7.6833 => 7.1699, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/fibo: -6.45% (4.6355 => 4.3364, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/richards_benchmark: -6.07% (1.4441 => 1.3565, std.dev.: 0.0170) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.02% (2.9728 => 2.7938, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.46% (3.9413 => 3.7261, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: -5.42% (3.4230 => 3.2376, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout/fib2: -5.22% (4.4195 => 4.1888, std.dev.: 0.0062) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.61% (1.2722 => 1.2136, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.29% (0.4564 => 0.4368, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -4.25% (3.4080 => 3.2631, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: -4.09% (9.2503 => 8.8717, std.dev.: 0.0481) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.46% (1.2959 => 1.2511, std.dev.: 0.0073) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.24% (9.3855 => 9.0818, std.dev.: 0.0158) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.88% (3.7496 => 3.6416, std.dev.: 0.0404) SingleSource/Benchmarks/McGill/misr: -2.49% (0.4296 => 0.4189, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: -1.97% (3.4876 => 3.4190, std.dev.: 0.0055) MultiSource/Benchmarks/sim/sim: -1.84% (3.8907 => 3.8193, std.dev.: 0.0154) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.83% (2.3569 => 2.3138, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.67% (1.8739 => 1.8426, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.60% (1.0686 => 1.0515, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.35% (25.6658 => 25.3195, std.dev.: 0.0404) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.06% (0.9980 => 0.9974, std.dev.: 0.0071) MultiSource/Applications/sqlite3/sqlite3: 2.06% (0.6022 => 0.6146, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/08-main/main: 6.72% (0.1666 => 0.1778, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.44% (0.1554 => 0.1485, std.dev.: 0.0048) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.42% (0.3083 => 0.3096, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.67% (0.2394 => 0.2330, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.48% (0.3175 => 0.3128, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.26% (0.2302 => 0.2296, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: -7.13% (0.0449 => 0.0417, std.dev.: 0.0018) SingleSource/UnitTests/2003-05-07-VarArgs: -67.42% (0.0089 => 0.0029, std.dev.: 0.0029) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.42% (0.0240 => 0.0239, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.04% (0.0192 => 0.0190, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -11.79% (0.0390 => 0.0344, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.33% (0.0301 => 0.0297, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.70% (0.0284 => 0.0282, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -5.56% (0.0324 => 0.0306, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: -1.69% (0.0177 => 0.0174, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/test1: 0.53% (0.0189 => 0.0190, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: - (0.0249 => 0.0249, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -19.08% (0.0325 => 0.0263, std.dev.: 0.0029) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005) MultiSource/Applications/ClamAV/clamscan: 3.08% (0.1429 => 0.1473, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 0.19% (1.5019 => 1.5048, std.dev.: 0.0443) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -2.80% (0.1501 => 0.1459, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.90% (0.4264 => 0.4055, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.14% (0.1344 => 0.1440, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.81% (0.0589 => 0.0543, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -26.29% (0.0232 => 0.0171, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.91% (0.0639 => 0.0664, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.52% (1.1350 => 1.1291, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.38% (0.0637 => 0.0590, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -35.37% (0.0246 => 0.0159, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.74% (0.7541 => 0.7672, std.dev.: 0.0079) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.04% (1.5363 => 1.7059, std.dev.: 0.0161) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 2 04:52:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 2 Oct 2012 06:52:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121002115207.4711C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4481?compare_to=4478&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4481, Order: 164995, Start Time: 2012-10-02 10:33:51, End Time: 2012-10-02 11:53:46 To: 4478, Order: 164992, Start Time: 2012-10-02 08:44:21, End Time: 2012-10-02 10:04:01 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (146 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 951 (695 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 15.67% (0.3937 => 0.4554, std.dev.: 0.0151) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.24% (80.4157 => 81.4097, std.dev.: 0.3807) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.10% (0.5755 => 0.5761, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 0.16% (15.9841 => 16.0098, std.dev.: 0.0088) MultiSource/Benchmarks/Bullet/bullet: 0.27% (53.9855 => 54.1298, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/gs/gs: -0.08% (4.3216 => 4.3180, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.43% (0.0462 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.43% (0.0463 => 0.0461, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.46% (0.0431 => 0.0429, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.69% (0.0433 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.48% (0.0420 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.24% (0.0421 => 0.0420) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.48% (0.0415 => 0.0413) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.48% (0.0416 => 0.0414) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.46% (0.0432 => 0.0430, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.23% (0.0433 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.23% (0.0426 => 0.0425) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.47% (0.0428 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.48% (0.0416 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.48% (0.0418 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.47% (0.0424 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.47% (0.0425 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.23% (0.0435 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.91% (0.0438 => 0.0434, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.49% (0.0412 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.48% (0.0413 => 0.0411) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.24% (0.0423 => 0.0422, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.24% (0.0424 => 0.0423) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.24% (0.0415 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.48% (0.0416 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.49% (0.0407 => 0.0405, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.49% (0.0408 => 0.0406, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.25% (0.0405 => 0.0404) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.25% (0.0407 => 0.0406) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.23% (0.0443 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.45% (0.0444 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.74% (0.0407 => 0.0404) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.25% (0.0405 => 0.0404, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.49% (0.0406 => 0.0404, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0406 => 0.0406) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.48% (0.0414 => 0.0412, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.48% (0.0415 => 0.0413) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.12% (1.2284 => 1.2299, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.27% (7.5360 => 7.5560, std.dev.: 0.0138) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.36% (0.7286 => 0.7312, std.dev.: 0.0035) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.28% (0.0359 => 0.0358, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1434 => 0.1435, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.69% (0.0651 => 0.0662, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -14.41% (63.2438 => 54.1298, std.dev.: 0.0035) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 30.78% (14.1553 => 18.5123, std.dev.: 0.0175) SingleSource/Benchmarks/Misc-C++-EH/spirit: 58.46% (3.4629 => 5.4874, std.dev.: 0.0020) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14245.69% (0.0720 => 10.3289, std.dev.: 0.0101) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10005100.00% (0.0001 => 10.0052, std.dev.: 0.0012) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 46.28% (0.2554 => 0.3736, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 44.50% (10.3673 => 14.9811, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/richards_benchmark: 29.90% (0.1622 => 0.2107, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 29.73% (0.1056 => 0.1370, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.96% (2.2022 => 2.5097, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 13.90% (0.1432 => 0.1631) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.57% (7.0540 => 8.0114, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.71% (0.1566 => 0.1765, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.91% (1.7609 => 1.9707, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 10.40% (10.4361 => 11.5210, std.dev.: 0.0141) SingleSource/UnitTests/ObjC/trivial-interface: 10.37% (0.3473 => 0.3833, std.dev.: 0.0071) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.10% (0.1584 => 0.1744, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.08% (0.3543 => 0.3900, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.05% (0.3543 => 0.3899, std.dev.: 0.0079) SingleSource/UnitTests/ObjC/exceptions-2: 10.04% (0.3497 => 0.3848, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-3: 10.01% (0.3516 => 0.3868, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 9.97% (0.3561 => 0.3916, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.94% (0.3694 => 0.4061, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 9.90% (9.4845 => 10.4239, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/exceptions: 9.59% (0.3828 => 0.4195, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.55% (0.3927 => 0.4302, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/property: 9.34% (0.3886 => 0.4249, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 9.29% (0.3282 => 0.3587, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 9.06% (0.5925 => 0.6462, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.99% (0.6030 => 0.6572, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.32% (0.4879 => 0.5285, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 8.15% (0.7326 => 0.7923, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: 8.10% (0.1655 => 0.1789, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.93% (0.3177 => 0.3429, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.84% (0.6675 => 0.7198, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 7.80% (0.7115 => 0.7670, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 7.59% (0.3109 => 0.3345, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.59% (1.5415 => 1.6585, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.53% (0.2603 => 0.2799, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.51% (0.1438 => 0.1546, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 7.39% (0.7433 => 0.7982, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 7.19% (0.3422 => 0.3668, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.16% (0.2891 => 0.3098, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 7.16% (0.2905 => 0.3113, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.13% (0.4615 => 0.4944, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 7.12% (5.7591 => 6.1692, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.03% (0.5105 => 0.5464, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 7.02% (0.1695 => 0.1814, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.00% (0.2271 => 0.2430, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.99% (0.4636 => 0.4960, std.dev.: 0.0022) MultiSource/Applications/d/make_dparser: 6.99% (3.3354 => 3.5684, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/18-imp/imp: 6.98% (0.3423 => 0.3662, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.87% (0.4103 => 0.4385, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.85% (0.2831 => 0.3025, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.84% (1.3050 => 1.3942, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.77% (0.1625 => 0.1735, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.75% (0.3865 => 0.4126, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.73% (0.4203 => 0.4486, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.71% (2.0665 => 2.2052, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.70% (0.3136 => 0.3346, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 6.69% (0.7835 => 0.8359, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.68% (0.2756 => 0.2940, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 6.68% (0.6456 => 0.6887, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.66% (4.2646 => 4.5488, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.66% (0.3650 => 0.3893, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.64% (0.4289 => 0.4574, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.64% (0.2725 => 0.2906, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.63% (0.2065 => 0.2202, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.62% (0.1510 => 0.1610, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.62% (0.3307 => 0.3526, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 6.62% (0.3052 => 0.3254, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.60% (0.5860 => 0.6247, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 6.59% (0.3232 => 0.3445, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.57% (0.4048 => 0.4314, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.53% (0.2877 => 0.3065, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.52% (0.3098 => 0.3300, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.52% (0.2700 => 0.2876, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.51% (0.3162 => 0.3368, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.51% (0.2871 => 0.3058) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.51% (0.2872 => 0.3059, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.46% (0.3826 => 0.4073, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.45% (0.2714 => 0.2889, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.44% (0.2793 => 0.2973, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.44% (8.1363 => 8.6601, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/random: 6.39% (0.2802 => 0.2981, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.37% (7.9617 => 8.4691, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.36% (5.0018 => 5.3199, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.34% (0.5569 => 0.5922, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.34% (4.9449 => 5.2582, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 6.34% (0.3283 => 0.3491, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.33% (0.5020 => 0.5338, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.30% (0.8172 => 0.8687, std.dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.28% (0.3121 => 0.3317, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.27% (0.3603 => 0.3829, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.19% (0.3684 => 0.3912, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.18% (0.9765 => 1.0368, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 6.17% (0.4620 => 0.4905, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.16% (0.8067 => 0.8564, std.dev.: 0.0038) MultiSource/Benchmarks/sim/sim: 6.11% (0.3387 => 0.3594, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.07% (0.2107 => 0.2235, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.02% (0.2758 => 0.2924, std.dev.: 0.0018) MultiSource/Applications/hbd/hbd: 6.02% (1.5603 => 1.6542, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary2: 6.01% (0.3379 => 0.3582, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.98% (0.1940 => 0.2056, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 5.90% (21.9371 => 23.2310, std.dev.: 0.0140) MultiSource/Applications/Burg/burg: 5.77% (1.1642 => 1.2314, std.dev.: 0.0075) MultiSource/Applications/lua/lua: 5.73% (3.8723 => 4.0940, std.dev.: 0.0027) MultiSource/Applications/lemon/lemon: 5.55% (1.0722 => 1.1317, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 5.42% (0.4299 => 0.4532, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.41% (0.3441 => 0.3627, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.36% (1.1861 => 1.2497, std.dev.: 0.0102) MultiSource/Applications/treecc/treecc: 5.34% (2.0273 => 2.1356, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/09-vor/vor: 5.22% (0.3180 => 0.3346, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.90% (0.4064 => 0.4263, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.88% (0.8921 => 0.9356, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.84% (0.6450 => 0.6762, std.dev.: 0.0030) MultiSource/Applications/siod/siod: 4.78% (2.2969 => 2.4067, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.72% (1.5859 => 1.6608, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/objinst: 4.69% (0.3131 => 0.3278, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.60% (0.5981 => 0.6256, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.43% (1.2842 => 1.3411, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.23% (1.4186 => 1.4786, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.15% (2.2024 => 2.2937, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.02% (1.1840 => 1.2316, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.12% (0.8101 => 0.8354, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.67% (14.3668 => 14.7502, std.dev.: 0.0146) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.54% (1.1194 => 1.1478, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 2.26% (17.1811 => 17.5691, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.86% (3.8922 => 3.9645, std.dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: 30.45% (1.1277 => 1.4711, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.25% (1.1145 => 1.3848, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4498, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (3.1578 => 3.3678, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/richards_benchmark: 6.55% (1.1396 => 1.2143, std.dev.: 0.0007) SingleSource/Regression/C/uint64_to_float: 3.71% (0.5413 => 0.5614, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.52% (3.6395 => 3.7677, std.dev.: 0.0035) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.67% (4.2280 => 4.3407, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7652, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.55% (0.8275 => 0.8403, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.36% (0.9540 => 0.9670, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.08% (6.5088 => 6.5788, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 1.02% (11.6436 => 11.7626, std.dev.: 0.0081) MultiSource/Applications/minisat/minisat: 1.01% (9.1159 => 9.2079, std.dev.: 0.0096) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1281, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.14% (0.8651 => 0.1718, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.12% (5.2763 => 3.2651, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.27% (5.3855 => 3.5940, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.92% (5.3526 => 3.5905, std.dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -14.79% (54.1659 => 46.1558, std.dev.: 0.0176) MultiSource/Benchmarks/FreeBench/mason/mason: -14.43% (0.0811 => 0.0694, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.03% (2.9384 => 2.6143, std.dev.: 0.0155) MultiSource/Applications/ClamAV/clamscan: -10.49% (22.1758 => 19.8497, std.dev.: 0.0313) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7652, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4245, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.83% (0.0998 => 0.0860, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: -12.67% (1.3677 => 1.1944, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -12.00% (1.2373 => 1.0888, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/mandel-2: -10.47% (1.5373 => 1.3763, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/mason/mason: -9.76% (0.2161 => 0.1950, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.37% (19.9488 => 18.2795, std.dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.78% (1.8329 => 1.7086, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.65% (0.2497 => 0.2331, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.18% (13.4384 => 12.7417, std.dev.: 0.0185) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.00% (1.6805 => 1.5965, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.79% (1.5660 => 1.4910, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.64% (1.5835 => 1.5100, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.30% (0.3463 => 0.3314, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.28% (0.9957 => 0.9531, std.dev.: 0.0040) MultiSource/Applications/siod/siod: -3.63% (3.2827 => 3.1635, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.41% (32.5116 => 31.4022, std.dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: -2.40% (12.4730 => 12.1732, std.dev.: 0.0021) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.02% (8.6802 => 8.5048, std.dev.: 0.0239) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.92% (8.1563 => 7.9996, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: -1.83% (10.2830 => 10.0948, std.dev.: 0.0115) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6834, std.dev.: 0.0009) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5118, std.dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4214, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -1.45% (4.6441 => 4.5769, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8593, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout/lists: -1.00% (6.2999 => 6.2369, std.dev.: 0.0044) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.17% (0.5229 => 0.5761, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 6.81% (14.9895 => 16.0098, std.dev.: 0.0088) MultiSource/Benchmarks/MallocBench/gs/gs: 5.05% (4.1105 => 4.3180, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.32% (1.1048 => 1.2299, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.56% (7.1582 => 7.5560, std.dev.: 0.0138) SingleSource/Benchmarks/Misc-C++/stepanov_container: 17.52% (0.6222 => 0.7312, std.dev.: 0.0035) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35700.00% (0.0001 => 0.0358, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.37% (0.1485 => 0.1435, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.71% (0.2116 => 0.0662, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 2 06:04:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 2 Oct 2012 08:04:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121002130426.1B0712A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4482?compare_to=4476&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4482, Order: 164993, Start Time: 2012-10-02 09:57:02, End Time: 2012-10-02 13:06:05 To: 4476, Order: 164990, Start Time: 2012-10-02 06:15:52, End Time: 2012-10-02 09:27:51 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 1 (131 on baseline) Performance Improvements: 1 (16 on baseline) Added Tests: 0 (131 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1037 (761 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 4.16% (2.0290 => 2.1134, std.dev.: 0.0055) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.32% (2.4961 => 2.4631, std.dev.: 0.0100) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.01% (9.8097 => 9.8110, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.02% (9.4148 => 9.4128, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.01% (16.9332 => 16.9349, std.dev.: 0.0002) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 11.69% (0.3446 => 0.3849, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/for-in: 11.61% (0.3496 => 0.3902, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.57% (0.3465 => 0.3866, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.53% (0.3488 => 0.3890, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 11.42% (0.3460 => 0.3855, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.36% (0.3442 => 0.3833, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.30% (0.3469 => 0.3861, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.10% (0.3650 => 0.4055, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.03% (0.3643 => 0.4045, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.79% (0.3724 => 0.4126, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 10.35% (0.5826 => 0.6429, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 10.22% (0.5889 => 0.6491, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.60% (0.1063 => 0.1165, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.11% (0.2875 => 0.3137, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.91% (0.7171 => 0.7810, std.dev.: 0.0030) MultiSource/Applications/oggenc/oggenc: 8.76% (1.5932 => 1.7328, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 8.72% (0.3004 => 0.3266, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 8.67% (0.2803 => 0.3046, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 8.66% (0.2714 => 0.2949, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.66% (0.2738 => 0.2975, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: 8.62% (0.2725 => 0.2960, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.55% (0.2911 => 0.3160, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3195 => 0.3468, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 8.50% (0.2823 => 0.3063, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.50% (0.2729 => 0.2961, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 8.50% (0.2813 => 0.3052, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 8.47% (0.2750 => 0.2983, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.31% (0.2792 => 0.3024, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 8.29% (0.2811 => 0.3044, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 8.25% (0.9909 => 1.0726, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/matrix: 8.24% (0.2780 => 0.3009, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 8.20% (0.3096 => 0.3350, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.15% (2.0673 => 2.2357, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 8.05% (0.3267 => 0.3530, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 8.03% (0.1619 => 0.1749, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.01% (0.3060 => 0.3305, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 7.98% (0.3258 => 0.3518, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 7.96% (0.3317 => 0.3581, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.83% (0.3625 => 0.3909, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.82% (0.3362 => 0.3625, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 7.80% (0.3348 => 0.3609, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.71% (0.3282 => 0.3535, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 7.69% (0.4146 => 0.4465, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.65% (0.3124 => 0.3363, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.62% (1.3152 => 1.4154, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 7.53% (0.3678 => 0.3955, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.43% (0.3690 => 0.3964, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sieve: 7.38% (0.3726 => 0.4001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 7.36% (0.3477 => 0.3733, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.27% (0.4994 => 0.5357, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.19% (1.6211 => 1.7376, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 7.03% (0.4251 => 0.4550, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.95% (0.2014 => 0.2154, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.88% (3.5627 => 3.8079, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.85% (0.1620 => 0.1731, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.83% (0.4361 => 0.4659, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.81% (0.3981 => 0.4252, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 6.77% (5.5417 => 5.9171, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.76% (0.3845 => 0.4105, std.dev.: 0.0034) MultiSource/Benchmarks/Bullet/bullet: 6.68% (23.5202 => 25.0920, std.dev.: 0.0166) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.53% (2.7292 => 2.9075, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.43% (0.2737 => 0.2913, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 6.42% (0.5012 => 0.5334, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 6.38% (1.0781 => 1.1469, std.dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 6.35% (0.2566 => 0.2729, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.34% (0.6435 => 0.6843, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.29% (0.2068 => 0.2198, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.24% (0.5000 => 0.5312, std.dev.: 0.0016) MultiSource/Applications/spiff/spiff: 6.11% (0.4029 => 0.4275, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.07% (0.5026 => 0.5331, std.dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: 6.05% (2.1013 => 2.2284, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.03% (0.3930 => 0.4167, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 6.00% (0.3336 => 0.3536, std.dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: 5.95% (4.2109 => 4.4616, std.dev.: 0.0060) MultiSource/Applications/siod/siod: 5.94% (0.6634 => 0.7028, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.93% (0.5900 => 0.6250, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.88% (0.2736 => 0.2897, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.85% (0.4139 => 0.4381, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.79% (4.4195 => 4.6753, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.69% (0.2866 => 0.3029, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: 5.52% (1.8794 => 1.9831, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.51% (0.3084 => 0.3254, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 5.48% (1.4269 => 1.5051, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.46% (0.3903 => 0.4116, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 5.40% (4.6177 => 4.8671, std.dev.: 0.0084) MultiSource/Applications/JM/ldecod/ldecod: 5.37% (2.1653 => 2.2815, std.dev.: 0.0127) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.35% (0.3890 => 0.4098, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.34% (0.1968 => 0.2073, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: 5.28% (0.9697 => 1.0209, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.04% (0.2103 => 0.2209, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 4.98% (0.5546 => 0.5822, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 4.83% (0.2691 => 0.2821, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.83% (0.4658 => 0.4883, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 4.82% (0.2075 => 0.2175, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.80% (0.3271 => 0.3428, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 4.75% (0.7875 => 0.8249, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.74% (1.9694 => 2.0627, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.68% (0.2969 => 0.3108, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.41% (1.9966 => 2.0846, std.dev.: 0.0030) MultiSource/Benchmarks/PAQ8p/paq8p: 4.29% (0.4847 => 0.5055, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.17% (0.7426 => 0.7736, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 4.17% (2.0346 => 2.1194, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.97% (0.4253 => 0.4422, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.93% (11.6398 => 12.0973, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.77% (0.5361 => 0.5563, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.60% (0.5584 => 0.5785, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.44% (4.6926 => 4.8538, std.dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: 3.29% (0.3498 => 0.3613, std.dev.: 0.0029) MultiSource/Applications/kimwitu++/kc: 2.71% (11.9555 => 12.2797, std.dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 5.81% (3.3903 => 3.5874, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary: 5.80% (0.2122 => 0.2245, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6701, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-2: 5.09% (1.8057 => 1.8977, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1653, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: 4.24% (14.0481 => 14.6436, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1950, std.dev.: 0.0500) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5079, std.dev.: 0.0130) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.70% (3.1722 => 3.2260, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.51% (2.0820 => 2.1134, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2870, std.dev.: 0.0025) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5137, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.10% (6.9584 => 7.0350, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5830, std.dev.: 0.0063) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.90% (25.4195 => 16.5481, std.dev.: 0.0174) MultiSource/Applications/sgefa/sgefa: -9.23% (1.5554 => 1.4119) SingleSource/Benchmarks/Shootout-C++/ary2: -8.70% (0.2402 => 0.2193, std.dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9759, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8073, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: -7.30% (2.1113 => 1.9571, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -5.83% (3.3665 => 3.1703, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7958, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.00% (0.6293 => 0.6104, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.94% (21.9346 => 21.2903, std.dev.: 0.0960) MultiSource/Applications/siod/siod: -2.92% (6.9842 => 6.7802, std.dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: -2.54% (17.2379 => 16.7993, std.dev.: 0.0151) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.82% (10.7630 => 10.5673, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0427, std.dev.: 0.0008) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 2 06:07:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 2 Oct 2012 08:07:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121002130753.3E09F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4483?compare_to=4479&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4483, Order: 164996, Start Time: 2012-10-02 11:43:56, End Time: 2012-10-02 13:09:32 To: 4479, Order: 164993, Start Time: 2012-10-02 09:48:43, End Time: 2012-10-02 11:14:29 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 0 (171 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1039 (692 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.02% (2.7529 => 2.7523, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.00% (2.1154 => 2.1155) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.01% (4.9747 => 4.9751, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.67% (2.0176 => 2.4347, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.45% (0.1410 => 0.1642, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 14.16% (0.0826 => 0.0943, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 13.20% (0.2243 => 0.2539, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 12.58% (0.5818 => 0.6550, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 12.32% (0.5748 => 0.6456, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 11.70% (0.7061 => 0.7887, std.dev.: 0.0019) SingleSource/Regression/C++/ofstream_ctor: 11.61% (0.2781 => 0.3104, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 11.55% (0.4328 => 0.4828, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 11.47% (0.4062 => 0.4528, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.45% (0.3022 => 0.3368, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.00% (0.2782 => 0.3088, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.97% (0.1413 => 0.1568, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.87% (0.3899 => 0.4323, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 10.86% (0.1013 => 0.1123) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.65% (0.3485 => 0.3856, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 10.63% (0.2607 => 0.2884, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 10.56% (0.2690 => 0.2974, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.55% (0.2655 => 0.2935, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 10.53% (1.3693 => 1.5135, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.45% (0.2966 => 0.3276, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.44% (1.9828 => 2.1898, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 10.42% (0.2726 => 0.3010, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.40% (0.1327 => 0.1465, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.37% (3.9660 => 4.3774, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.36% (0.2721 => 0.3003, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 10.36% (0.2760 => 0.3046, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 10.35% (0.2628 => 0.2900, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.33% (0.1588 => 0.1752, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.28% (0.3580 => 0.3948, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 10.23% (0.7038 => 0.7758, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 10.21% (0.2937 => 0.3237, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.20% (0.2765 => 0.3047, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.18% (0.4016 => 0.4425, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 10.18% (0.2761 => 0.3042, std.dev.: 0.0006) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.17% (0.1072 => 0.1181, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.14% (0.3756 => 0.4137, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 10.14% (0.3107 => 0.3422, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.13% (0.2696 => 0.2969, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.11% (1.4563 => 1.6036, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.09% (0.3489 => 0.3841, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists: 10.08% (0.3293 => 0.3625, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 10.06% (0.3868 => 0.4257, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.05% (0.4390 => 0.4831, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 10.00% (0.3149 => 0.3464, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.94% (0.7710 => 0.8476, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.90% (0.2596 => 0.2853, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.90% (0.6283 => 0.6905, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.90% (1.2193 => 1.3400, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.88% (0.9199 => 1.0108, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.80% (0.5265 => 0.5781, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 9.77% (0.2988 => 0.3280, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 9.71% (0.3192 => 0.3502, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 9.64% (0.3453 => 0.3786, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.53% (0.6959 => 0.7622, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists1: 9.48% (0.3534 => 0.3869, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 9.37% (13.8202 => 15.1145, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.27% (1.1364 => 1.2418, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.25% (0.6576 => 0.7184, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.17% (0.3130 => 0.3417, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 8.90% (0.2945 => 0.3207, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 8.85% (0.2995 => 0.3260, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.73% (0.1157 => 0.1258, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 8.69% (1.0313 => 1.1209, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.62% (0.4791 => 0.5204, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.54% (0.1276 => 0.1385, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.50% (0.1435 => 0.1557, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.48% (0.5577 => 0.6050, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.46% (0.1986 => 0.2154, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.45% (0.4379 => 0.4749, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.42% (0.2127 => 0.2306, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.39% (0.3755 => 0.4070, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.30% (0.8698 => 0.9420, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 8.12% (0.8310 => 0.8985, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.10% (0.3246 => 0.3509, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 8.09% (16.6129 => 17.9572, std.dev.: 0.0234) MultiSource/Applications/minisat/minisat: 8.04% (0.6744 => 0.7286, std.dev.: 0.0114) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.03% (0.2914 => 0.3148, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.03% (0.2504 => 0.2705, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 7.91% (1.0594 => 1.1432, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 7.87% (1.1061 => 1.1932, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.85% (7.2180 => 7.7845, std.dev.: 0.0042) MultiSource/Applications/spiff/spiff: 7.82% (0.7506 => 0.8093, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.79% (0.7460 => 0.8041, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.76% (3.6692 => 3.9541, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 7.76% (0.3220 => 0.3470, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.70% (0.5637 => 0.6071, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 7.58% (3.1889 => 3.4307, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/gs/gs: 7.44% (3.8646 => 4.1520, std.dev.: 0.0166) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.37% (0.2023 => 0.2172, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.29% (0.1865 => 0.2001, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 7.25% (0.2925 => 0.3137, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.21% (0.3646 => 0.3909, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 7.19% (2.1791 => 2.3357, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/em3d/em3d: 7.18% (0.1657 => 0.1776, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.15% (0.3578 => 0.3834, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 7.15% (1.9270 => 2.0647, std.dev.: 0.0064) SingleSource/UnitTests/ObjC/for-in: 7.13% (0.3789 => 0.4059, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 7.10% (0.1478 => 0.1583, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 7.10% (0.3914 => 0.4192, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 7.09% (0.3131 => 0.3353, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.07% (1.3245 => 1.4182, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 7.05% (1.2749 => 1.3648, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.04% (0.4003 => 0.4285, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 7.04% (0.3663 => 0.3921, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.99% (0.3650 => 0.3905, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.97% (0.3601 => 0.3852, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 6.97% (14.8535 => 15.8883, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/property: 6.95% (0.3940 => 0.4214, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.95% (0.1569 => 0.1678, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.93% (0.1789 => 0.1913, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.90% (0.3623 => 0.3873, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 6.89% (8.4961 => 9.0816, std.dev.: 0.0103) MultiSource/Applications/hexxagon/hexxagon: 6.87% (1.2292 => 1.3136, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.68% (0.2140 => 0.2283, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.66% (4.3801 => 4.6717, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/bigfib: 6.59% (0.6250 => 0.6662, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.58% (4.4433 => 4.7357, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/05-eks/eks: 6.56% (0.4113 => 0.4383, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.52% (0.3511 => 0.3740, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.47% (0.6135 => 0.6532, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.40% (0.8818 => 0.9382, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.25% (4.9865 => 5.2984, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.97% (3.2742 => 3.4697, std.dev.: 0.0042) MultiSource/Applications/oggenc/oggenc: 5.92% (4.6629 => 4.9391, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.89% (0.4805 => 0.5088, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.85% (1.1333 => 1.1996, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.67% (0.3245 => 0.3429, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 5.56% (6.5754 => 6.9411, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.18% (1.5188 => 1.5974, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.08% (0.9108 => 0.9571, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.95% (0.2321 => 0.2436, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 4.93% (3.7467 => 3.9315, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.85% (6.2785 => 6.5833, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.70% (2.1007 => 2.1994, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.67% (13.2842 => 13.9047, std.dev.: 0.0081) MultiSource/Applications/sqlite3/sqlite3: 3.06% (16.2614 => 16.7597, std.dev.: 0.0054) MultiSource/Applications/ClamAV/clamscan: 2.49% (14.5298 => 14.8921, std.dev.: 0.0153) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5187, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.20% (1.8175 => 2.2573, std.dev.: 0.0482) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.60% (1.1560 => 1.2554, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4138, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.27% (1.2998 => 1.3813, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.64% (0.2093 => 0.2211, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0047, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.94% (11.2619 => 11.7055, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9862, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.40% (10.7476 => 11.1126, std.dev.: 0.0801) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 2.17% (7.4271 => 7.5880, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5140, std.dev.: 0.0065) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.30% (5.5130 => 5.5849, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1882, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 1.15% (12.4560 => 12.5995, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/em3d/em3d: 1.13% (3.1071 => 3.1421, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.09% (1.4298 => 1.4454, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.00% (9.9194 => 10.0187, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.72% (0.2670 => 0.1396, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/mason/mason: -15.98% (0.0707 => 0.0594, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.98% (0.4657 => 0.3913, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.79% (1.3819 => 1.1775, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.62% (1.3813 => 1.1793, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.35% (22.5627 => 21.5812, std.dev.: 0.0183) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.64% (0.0997 => 0.0861, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -11.89% (0.2238 => 0.1972, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.94% (1.2308 => 1.0962, std.dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.14% (20.3410 => 18.2793, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.96% (1.3780 => 1.2959, std.dev.: 0.0060) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.17% (2.6470 => 2.5102, std.dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.60% (13.3668 => 12.7513, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.16% (0.3458 => 0.3314, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.09% (0.9996 => 0.9587, std.dev.: 0.0088) MultiSource/Applications/siod/siod: -3.55% (3.2729 => 3.1568, std.dev.: 0.0037) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.48% (1.7688 => 1.7072, std.dev.: 0.0058) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4785, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.47% (3.0263 => 2.9517, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.27% (1.9762 => 1.9314, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.96% (0.6589 => 0.6460, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6944, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.71% (6.3560 => 6.2471, std.dev.: 0.0046) MultiSource/Applications/lua/lua: -1.70% (26.5159 => 26.0642, std.dev.: 0.0331) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0067, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8654, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4952, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2571, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: -1.11% (9.3358 => 9.2320, std.dev.: 0.0372) MultiSource/Applications/viterbi/viterbi: -1.05% (4.4810 => 4.4340, std.dev.: 0.0029) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 2 06:30:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 2 Oct 2012 08:30:28 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121002133028.E5D172A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4484?compare_to=4480&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4484, Order: 164996, Start Time: 2012-10-02 12:03:13, End Time: 2012-10-02 13:32:10 To: 4480, Order: 164995, Start Time: 2012-10-02 10:13:32, End Time: 2012-10-02 11:47:23 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (8 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 10 (63 on baseline) Performance Improvements: 10 (48 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 77 (69 on baseline) Unchanged Tests: 945 (772 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.09% (0.0642 => 0.0771, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.81% (0.1864 => 0.1991, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.86% (0.5903 => 0.6013, std.dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: 1.62% (8.8200 => 8.9627, std.dev.: 0.0447) MultiSource/Applications/lua/lua: 1.08% (3.6395 => 3.6788, std.dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 6.34% (22.4448 => 23.8684, std.dev.: 0.1357) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.65% (1.3517 => 1.4145, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.26% (1.8426 => 1.8659, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.15% (2.3861 => 2.4135, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.12% (22.4891 => 22.7411, std.dev.: 0.0909) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -2.90% (0.8923 => 0.8664, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -2.03% (0.6095 => 0.5971, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.68% (0.7390 => 0.7266, std.dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: -1.56% (1.1224 => 1.1049, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -1.31% (14.5768 => 14.3862, std.dev.: 0.0112) MultiSource/Applications/oggenc/oggenc: -1.29% (4.9368 => 4.8729, std.dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: -1.15% (6.6214 => 6.5451, std.dev.: 0.0061) MultiSource/Applications/hexxagon/hexxagon: -1.11% (0.9599 => 0.9492, std.dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -7.08% (46.1928 => 42.9230, std.dev.: 0.3834) MultiSource/Applications/SPASS/SPASS: -3.26% (8.3610 => 8.0885, std.dev.: 0.0371) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.68% (0.9974 => 1.0142, std.dev.: 0.0134) MultiSource/Applications/sqlite3/sqlite3: -0.72% (0.6146 => 0.6102, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/08-main/main: 0.39% (0.1778 => 0.1785, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.32% (0.1485 => 0.1564, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.52% (0.3096 => 0.3112, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.69% (0.2330 => 0.2346, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.51% (0.3128 => 0.3144, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.04% (0.2296 => 0.2297, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel: 8.15% (0.0417 => 0.0451, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: 34.48% (0.0029 => 0.0039, std.dev.: 0.0020) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0089 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.42% (0.0239 => 0.0238, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.21% (0.0190 => 0.0182, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 11.34% (0.0344 => 0.0383, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -21.55% (0.0297 => 0.0233, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.42% (0.0282 => 0.0278, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 3.92% (0.0306 => 0.0318, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: 1.15% (0.0174 => 0.0176, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -0.53% (0.0190 => 0.0189, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0249 => 0.0249, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: 22.81% (0.0263 => 0.0323, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005) MultiSource/Applications/ClamAV/clamscan: -0.95% (0.1473 => 0.1459, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -0.35% (0.2270 => 0.2262, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: -0.01% (1.5048 => 1.5046, std.dev.: 0.0291) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 1.51% (0.1459 => 0.1481, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/Bullet/bullet: 0.44% (0.5886 => 0.5912, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: -0.20% (26.9211 => 26.8675, std.dev.: 0.1848) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.12% (0.4055 => 0.4060, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.14% (0.1440 => 0.1442, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: - (0.0543 => 0.0543, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 11.11% (0.0171 => 0.0190, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.45% (0.0664 => 0.0661, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.15% (1.1291 => 1.1308, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0012 => 0.0012, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.80% (0.0590 => 0.0544, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.03% (0.0159 => 0.0151, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.35% (0.7672 => 0.7645, std.dev.: 0.0225) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -0.91% (4.0341 => 3.9974, std.dev.: 0.0236) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.41% (59.6172 => 58.1813, std.dev.: 1.2200) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -0.63% (2.9524 => 2.9338, std.dev.: 0.0179) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.00% (2.2893 => 2.6784, std.dev.: 0.1583) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 0.01% (1.7059 => 1.7060, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 150.00% (0.0002 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt MultiSource/Applications/JM/lencod/lencod: -96.65% (6.7458 => 0.2262, std.dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: -91.52% (6.9722 => 0.5912, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: 21619.89% (0.1237 => 26.8675, std.dev.: 0.1848) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -1.68% (4.0659 => 3.9974, std.dev.: 0.0236) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -4.89% (61.1734 => 58.1813, std.dev.: 1.2200) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.34% (3.2007 => 2.9338, std.dev.: 0.0179) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 13.59% (2.3580 => 2.6784, std.dev.: 0.1583) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.58% (4.1772 => 3.0670, std.dev.: 0.0442) SingleSource/Benchmarks/Shootout-C++/except: 81850.00% (0.0006 => 0.4917, std.dev.: 0.0069) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.42% (0.0745 => 0.0912, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.97% (0.6410 => 0.6921, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 7.33% (2.1763 => 2.3358, std.dev.: 0.0114) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.28% (0.1414 => 0.1517, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 7.21% (0.5309 => 0.5692, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 5.95% (0.6173 => 0.6540, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.72% (0.3582 => 0.3787, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 5.03% (1.1653 => 1.2239, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.02% (0.2552 => 0.2680, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.01% (0.2654 => 0.2787, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: 4.80% (1.0046 => 1.0528, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.77% (1.5150 => 1.5873, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 4.58% (0.6915 => 0.7232, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.45% (0.6069 => 0.6339, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.33% (0.2797 => 0.2918, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 4.24% (15.3105 => 15.9590, std.dev.: 0.0165) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.05% (0.7639 => 0.7948, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.65% (0.4248 => 0.4403, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 3.59% (1.3268 => 1.3744, std.dev.: 0.0040) MultiSource/Applications/d/make_dparser: 3.51% (3.0225 => 3.1285, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.30% (0.4880 => 0.5041, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.20% (0.3901 => 0.4026, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.72% (1.1827 => 1.2149, std.dev.: 0.0033) MultiSource/Applications/oggenc/oggenc: 2.68% (4.7455 => 4.8729, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.66% (1.2021 => 1.2341, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.65% (1.1672 => 1.1981, std.dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: 2.61% (29.3170 => 30.0809, std.dev.: 0.2805) MultiSource/Applications/SPASS/SPASS: 2.56% (13.3238 => 13.6644, std.dev.: 0.0288) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.35% (6.2546 => 6.4016, std.dev.: 0.0046) MultiSource/Applications/lua/lua: 2.25% (3.5980 => 3.6788, std.dev.: 0.0049) MultiSource/Benchmarks/nbench/nbench: 2.11% (1.0821 => 1.1049, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 2.06% (2.0972 => 2.1405, std.dev.: 0.0036) MultiSource/Applications/Burg/burg: 1.95% (1.1440 => 1.1663, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (3.0758 => 3.1341, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.79% (12.6413 => 12.8672, std.dev.: 0.0286) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.68% (0.8569 => 0.8713, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.60% (1.4408 => 1.4638, std.dev.: 0.0043) MultiSource/Applications/treecc/treecc: 1.59% (1.8798 => 1.9096, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.58% (4.0318 => 4.0957, std.dev.: 0.0080) MultiSource/Applications/JM/lencod/lencod: 1.54% (14.7256 => 14.9525, std.dev.: 0.0338) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.43% (1.0689 => 1.0842, std.dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.39% (1.6538 => 2.3383, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2276, std.dev.: 0.0188) MultiSource/Benchmarks/Olden/power/power: 17.83% (1.4184 => 1.6713, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/ary3: 14.61% (1.7426 => 1.9972, std.dev.: 0.0407) MultiSource/Benchmarks/nbench/nbench: 12.74% (21.1721 => 23.8684, std.dev.: 0.1357) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.41% (2.4042 => 2.6784, std.dev.: 0.0419) SingleSource/Benchmarks/McGill/queens: 10.98% (1.6261 => 1.8047, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.82% (0.2857 => 0.3109, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/lists: 8.81% (7.0025 => 7.6192, std.dev.: 0.0228) MultiSource/Benchmarks/FreeBench/mason/mason: 8.39% (0.5004 => 0.5424, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.61% (1.0063 => 1.0829, std.dev.: 0.0069) SingleSource/Benchmarks/Stanford/Puzzle: 7.47% (0.1433 => 0.1540, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/dt: 4.40% (0.9851 => 1.0284, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 3.80% (92.7467 => 96.2695, std.dev.: 0.1120) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.35% (0.5587 => 0.5774, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.88% (6.6312 => 6.8224, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 2.87% (0.3591 => 0.3694, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 2.77% (14.4877 => 14.8890, std.dev.: 0.0132) SingleSource/Benchmarks/Dhrystone/dry: 2.03% (2.4013 => 2.4500, std.dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: 1.82% (62.4126 => 63.5485, std.dev.: 0.2818) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.80% (22.3381 => 22.7411, std.dev.: 0.0909) SingleSource/Benchmarks/Misc/fp-convert: 1.47% (15.2242 => 15.4480, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -45.76% (0.2996 => 0.1625, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -45.35% (0.0591 => 0.0323, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -20.45% (1.4113 => 1.1227, std.dev.: 0.0120) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.33% (1.4189 => 1.1305, std.dev.: 0.0110) MultiSource/Benchmarks/Olden/em3d/em3d: -6.64% (0.1642 => 0.1533, std.dev.: 0.0039) MultiSource/Applications/ClamAV/clamscan: -1.52% (14.6079 => 14.3862, std.dev.: 0.0112) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.01% (0.3497 => 0.2098, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -26.85% (15.8312 => 11.5803, std.dev.: 0.1316) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.60% (5.2665 => 4.1290, std.dev.: 0.0808) SingleSource/Benchmarks/Shootout-C++/ary3: -19.84% (1.7473 => 1.4006, std.dev.: 0.0838) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.21% (1.7361 => 1.4720, std.dev.: 0.0286) MultiSource/Benchmarks/McCat/17-bintr/bintr: -14.18% (0.0917 => 0.0787, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1577, std.dev.: 0.0108) MultiSource/Benchmarks/FreeBench/neural/neural: -12.04% (1.0926 => 0.9610, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.75% (1.1647 => 1.0511, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.83% (1.4034 => 1.2795, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: -8.36% (9.5474 => 8.7489, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: -7.45% (2.5166 => 2.3292, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.99% (3.6254 => 3.3721, std.dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: -6.94% (7.6833 => 7.1503, std.dev.: 0.0231) SingleSource/Benchmarks/Shootout-C++/fibo: -6.62% (4.6355 => 4.3285, std.dev.: 0.0161) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.47% (2.0027 => 1.8732, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -6.46% (1.4441 => 1.3508, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.00% (2.9728 => 2.7943, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -5.60% (45.4683 => 42.9230, std.dev.: 0.3834) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.40% (3.9413 => 3.7285, std.dev.: 0.0330) MultiSource/Applications/SIBsim4/SIBsim4: -5.38% (3.4230 => 3.2388, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/fib2: -5.27% (4.4195 => 4.1866, std.dev.: 0.0125) MultiSource/Applications/SPASS/SPASS: -5.20% (8.5323 => 8.0885, std.dev.: 0.0371) SingleSource/Benchmarks/BenchmarkGame/n-body: -4.85% (1.5803 => 1.5037, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/distray/distray: -4.77% (0.2664 => 0.2537, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.67% (0.4564 => 0.4351, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -4.30% (3.4080 => 3.2615, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.84% (1.2722 => 1.2234, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.59% (9.3855 => 9.0482, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/methcall: -3.25% (9.2503 => 8.9494, std.dev.: 0.0316) SingleSource/Benchmarks/McGill/misr: -2.96% (0.4296 => 0.4169, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.46% (3.7496 => 3.6572, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.25% (1.0686 => 1.0446, std.dev.: 0.0031) MultiSource/Applications/aha/aha: -1.92% (3.4286 => 3.3626, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: -1.89% (3.8907 => 3.8173, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash2: -1.64% (3.4876 => 3.4303, std.dev.: 0.0106) SingleSource/Benchmarks/Dhrystone/fldry: -1.52% (2.4971 => 2.4591, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3068, std.dev.: 0.0103) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.40% (27.1724 => 26.7925, std.dev.: 0.0112) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.32% (2.4457 => 2.4135, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.23% (1.1683 => 1.1539, std.dev.: 0.0054) SingleSource/Benchmarks/McGill/chomp: -1.11% (1.0194 => 1.0081, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.62% (0.9980 => 1.0142, std.dev.: 0.0134) MultiSource/Applications/sqlite3/sqlite3: 1.33% (0.6022 => 0.6102, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/08-main/main: 7.14% (0.1666 => 0.1785, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.64% (0.1554 => 0.1564, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.94% (0.3083 => 0.3112, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.01% (0.2394 => 0.2346, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.98% (0.3175 => 0.3144, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.22% (0.2302 => 0.2297, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel: 0.45% (0.0449 => 0.0451, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: -56.18% (0.0089 => 0.0039, std.dev.: 0.0020) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.83% (0.0240 => 0.0238, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.21% (0.0192 => 0.0182, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.79% (0.0390 => 0.0383, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -22.59% (0.0301 => 0.0233, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.11% (0.0284 => 0.0278, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.85% (0.0324 => 0.0318, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: -0.56% (0.0177 => 0.0176, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0189 => 0.0189, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0249 => 0.0249, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -0.62% (0.0325 => 0.0323, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005) MultiSource/Applications/ClamAV/clamscan: 2.10% (0.1429 => 0.1459, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 0.18% (1.5019 => 1.5046, std.dev.: 0.0291) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.33% (0.1501 => 0.1481, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.78% (0.4264 => 0.4060, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.29% (0.1344 => 0.1442, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.81% (0.0589 => 0.0543, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -18.10% (0.0232 => 0.0190, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.44% (0.0639 => 0.0661, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.37% (1.1350 => 1.1308, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.60% (0.0637 => 0.0544, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.62% (0.0246 => 0.0151, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.38% (0.7541 => 0.7645, std.dev.: 0.0225) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 11.05% (1.5363 => 1.7060, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 2 06:40:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 2 Oct 2012 08:40:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121002134059.59FE82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4485?compare_to=4481&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4485, Order: 164996, Start Time: 2012-10-02 12:23:06, End Time: 2012-10-02 13:42:39 To: 4481, Order: 164995, Start Time: 2012-10-02 10:33:51, End Time: 2012-10-02 11:53:46 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (145 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 953 (696 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.02% (0.5761 => 0.5762, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: -0.08% (16.0098 => 15.9964, std.dev.: 0.0209) MultiSource/Benchmarks/Bullet/bullet: -0.00% (54.1298 => 54.1274, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/gs/gs: 0.01% (4.3180 => 4.3184, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0460 => 0.0460, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.22% (0.0461 => 0.0462) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0429 => 0.0429) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.23% (0.0430 => 0.0431) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0418 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0420 => 0.0420, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0413 => 0.0413, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0414 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.23% (0.0430 => 0.0431) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0432 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0425 => 0.0425) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0426 => 0.0426) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.24% (0.0414 => 0.0415, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0416 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0422 => 0.0422, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0423 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.23% (0.0434 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.23% (0.0434 => 0.0435, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.24% (0.0410 => 0.0411, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.24% (0.0411 => 0.0412, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0422 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0423 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0414 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.24% (0.0414 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.25% (0.0405 => 0.0406) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0406 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0404 => 0.0404, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0406 => 0.0406) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.23% (0.0442 => 0.0441, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0442 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0404 => 0.0404) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.25% (0.0404 => 0.0405) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0404 => 0.0404, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.25% (0.0406 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0412 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0413 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.07% (1.2299 => 1.2290, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.09% (7.5560 => 7.5627, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.07% (0.7312 => 0.7307, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.56% (0.0358 => 0.0360, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1435 => 0.1434, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.36% (0.0662 => 0.0671, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -14.41% (63.2438 => 54.1274, std.dev.: 0.0065) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 30.86% (14.1553 => 18.5233, std.dev.: 0.0202) SingleSource/Benchmarks/Misc-C++-EH/spirit: 58.49% (3.4629 => 5.4884, std.dev.: 0.0021) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14235.42% (0.0720 => 10.3215, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10004200.00% (0.0001 => 10.0043, std.dev.: 0.0018) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 46.48% (0.2554 => 0.3741, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 44.48% (10.3673 => 14.9784, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/richards_benchmark: 29.96% (0.1622 => 0.2108, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/distray/distray: 29.64% (0.1056 => 0.1369, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 13.97% (0.1432 => 0.1632, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.95% (2.2022 => 2.5095, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.56% (7.0540 => 8.0104, std.dev.: 0.0023) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.64% (0.1566 => 0.1764, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.95% (1.7609 => 1.9714, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 10.35% (10.4361 => 11.5159, std.dev.: 0.0176) SingleSource/UnitTests/ObjC/trivial-interface: 10.31% (0.3473 => 0.3831, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.10% (0.3543 => 0.3901, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.07% (0.3497 => 0.3849, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.04% (0.1584 => 0.1743, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.01% (0.3516 => 0.3868, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.99% (0.3543 => 0.3897, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.97% (0.3561 => 0.3916, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 9.90% (9.4845 => 10.4232, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/for-in: 9.85% (0.3694 => 0.4058, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.61% (0.3828 => 0.4196, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.55% (0.3927 => 0.4302, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.42% (0.3886 => 0.4252, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 9.23% (0.3282 => 0.3585, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.13% (0.5925 => 0.6466, std.dev.: 0.0080) SingleSource/UnitTests/ObjC++/property-reference-object: 9.00% (0.6030 => 0.6573, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.81% (0.4879 => 0.5309, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 8.34% (0.1655 => 0.1793, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.22% (0.7326 => 0.7928, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.99% (0.3177 => 0.3431, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.91% (0.6675 => 0.7203, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 7.77% (0.7115 => 0.7668, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 7.66% (0.3109 => 0.3347, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.59% (1.5415 => 1.6585, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.45% (0.2603 => 0.2797, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.44% (0.1438 => 0.1545, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.43% (0.4615 => 0.4958, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 7.41% (0.7433 => 0.7984, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.33% (0.2905 => 0.3118, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.23% (0.2891 => 0.3100, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 7.22% (0.3422 => 0.3669, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 7.10% (5.7591 => 6.1680, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 7.09% (3.3354 => 3.5718, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 7.07% (0.3423 => 0.3665, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.03% (0.5105 => 0.5464, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 7.02% (0.1695 => 0.1814, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.99% (0.4103 => 0.4390, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.95% (1.3050 => 1.3957, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.92% (0.3136 => 0.3353, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.89% (0.1625 => 0.1737, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.83% (0.2271 => 0.2426, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 6.82% (0.2831 => 0.3024, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.82% (0.4636 => 0.4952, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.76% (0.4203 => 0.4487, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.75% (0.3052 => 0.3258, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.74% (4.2646 => 4.5522, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.73% (0.3865 => 0.4125, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.71% (0.5860 => 0.6253, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 6.69% (0.4048 => 0.4319, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 6.69% (0.6456 => 0.6888, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.68% (0.3650 => 0.3894, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.68% (0.3232 => 0.3448, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.68% (2.0665 => 2.2045, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.68% (0.2756 => 0.2940, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.67% (0.4289 => 0.4575) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.65% (0.3307 => 0.3527, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.65% (0.2872 => 0.3063, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.64% (0.2725 => 0.2906, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.62% (0.2871 => 0.3061, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.61% (0.5020 => 0.5352, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.54% (0.2065 => 0.2200, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.53% (0.2877 => 0.3065, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.53% (0.2802 => 0.2985, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 6.52% (0.7835 => 0.8346, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: 6.52% (0.3098 => 0.3300, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.52% (5.0018 => 5.3279, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.52% (0.2793 => 0.2975, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.51% (0.3826 => 0.4075, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.48% (0.2714 => 0.2890, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.48% (0.3162 => 0.3367, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.44% (0.2700 => 0.2874, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.43% (0.8067 => 0.8586, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.43% (8.1363 => 8.6596, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary3: 6.43% (0.3283 => 0.3494, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.41% (0.2107 => 0.2242, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.40% (7.9617 => 8.4710, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/sieve: 6.38% (0.3603 => 0.3833, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 6.38% (0.3387 => 0.3603, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.37% (4.9449 => 5.2599, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.36% (0.5569 => 0.5923, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.33% (0.9765 => 1.0383, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.33% (0.8172 => 0.8689, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 6.32% (0.4620 => 0.4912, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.18% (0.3121 => 0.3314, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.13% (0.3684 => 0.3910, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.06% (0.2758 => 0.2925, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.03% (0.1940 => 0.2057, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 5.97% (1.5603 => 1.6535, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: 5.94% (1.1642 => 1.2334, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.92% (0.3379 => 0.3579, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 5.89% (21.9371 => 23.2288, std.dev.: 0.0242) MultiSource/Applications/lua/lua: 5.80% (3.8723 => 4.0968, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 5.64% (1.0722 => 1.1327, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.52% (0.3441 => 0.3631, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 5.44% (0.3180 => 0.3353, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 5.37% (0.4299 => 0.4530, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.35% (1.1861 => 1.2496, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 5.26% (2.0273 => 2.1339, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.09% (0.4064 => 0.4271, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 4.99% (2.2969 => 2.4115, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.98% (0.6450 => 0.6771, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 4.97% (0.8921 => 0.9364, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.77% (1.5859 => 1.6616, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 4.76% (0.3131 => 0.3280, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.65% (0.5981 => 0.6259, std.dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 4.53% (1.2842 => 1.3424, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.22% (1.4186 => 1.4784, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.17% (2.2024 => 2.2942, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.00% (1.1840 => 1.2314, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.09% (0.8101 => 0.8351, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.68% (14.3668 => 14.7523, std.dev.: 0.0120) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.62% (1.1194 => 1.1487, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 2.20% (17.1811 => 17.5596, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (3.8922 => 3.9624, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: 30.45% (1.1277 => 1.4711, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.58% (0.2944 => 0.3285, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2173, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4499, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3683, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 6.64% (1.1396 => 1.2153, std.dev.: 0.0006) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.55% (3.6395 => 3.7688, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.79% (4.2280 => 4.3461, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7655, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (0.8275 => 0.8405, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.15% (6.5088 => 6.5839, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.14% (2.1825 => 2.2073) MultiSource/Benchmarks/nbench/nbench: 1.02% (11.6436 => 11.7626, std.dev.: 0.0038) MultiSource/Applications/minisat/minisat: 1.02% (9.1159 => 9.2089, std.dev.: 0.0108) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1281, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.15% (0.8651 => 0.1717, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.13% (5.2763 => 3.2645, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.23% (5.3855 => 3.5958, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.91% (5.3526 => 3.5911, std.dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -14.77% (54.1659 => 46.1680, std.dev.: 0.0144) MultiSource/Benchmarks/FreeBench/mason/mason: -14.30% (0.0811 => 0.0695, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.07% (2.9384 => 2.6132, std.dev.: 0.0026) MultiSource/Applications/ClamAV/clamscan: -10.49% (22.1758 => 19.8490, std.dev.: 0.0158) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.39% (1.1492 => 0.7655, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4248, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.03% (0.0998 => 0.0858, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: -12.67% (1.3677 => 1.1944, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -12.25% (1.2373 => 1.0857, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/mandel-2: -10.36% (1.5373 => 1.3781, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/mason/mason: -10.09% (0.2161 => 0.1943, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.47% (19.9488 => 18.2594, std.dev.: 0.0290) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4787, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.73% (1.8329 => 1.7096, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.65% (0.2497 => 0.2331) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.55% (1.9577 => 1.8490, std.dev.: 0.0136) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.45% (13.4384 => 12.7056, std.dev.: 0.0249) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.99% (1.6805 => 1.5966, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5065, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.30% (0.3463 => 0.3314, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.16% (0.9957 => 0.9543, std.dev.: 0.0078) MultiSource/Applications/siod/siod: -3.64% (3.2827 => 3.1631, std.dev.: 0.0034) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.40% (32.5116 => 31.4059, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: -2.42% (12.4730 => 12.1707, std.dev.: 0.0018) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.05% (8.6802 => 8.5025, std.dev.: 0.0176) SingleSource/Benchmarks/Misc/salsa20: -1.82% (10.2830 => 10.0958, std.dev.: 0.0176) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6829, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.66% (8.1563 => 8.0208, std.dev.: 0.0058) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5141, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4208, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: -1.44% (4.6441 => 4.5774, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/lists: -1.20% (6.2999 => 6.2243, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8578, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.19% (0.5229 => 0.5762, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 6.72% (14.9895 => 15.9964, std.dev.: 0.0209) MultiSource/Benchmarks/MallocBench/gs/gs: 5.06% (4.1105 => 4.3184, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.24% (1.1048 => 1.2290, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.65% (7.1582 => 7.5627, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/stepanov_container: 17.44% (0.6222 => 0.7307, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35900.00% (0.0001 => 0.0360, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.43% (0.1485 => 0.1434, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.29% (0.2116 => 0.0671, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 2 08:02:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 2 Oct 2012 10:02:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121002150240.647E02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4486?compare_to=4483&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4486, Order: 165002, Start Time: 2012-10-02 13:38:34, End Time: 2012-10-02 15:04:19 To: 4483, Order: 164996, Start Time: 2012-10-02 11:43:56, End Time: 2012-10-02 13:09:32 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 1 (170 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1038 (694 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.82% (78.5908 => 80.0234, std.dev.: 0.2454) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.03% (2.7523 => 2.7530, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.00% (2.1155 => 2.1154, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.00% (4.9751 => 4.9750, std.dev.: 0.0003) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.72% (2.0176 => 2.4356, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.10% (0.1410 => 0.1637, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 14.16% (0.0826 => 0.0943, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 13.24% (0.2243 => 0.2540, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 11.84% (0.5818 => 0.6507, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 11.77% (0.7061 => 0.7892, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/Hello: 11.73% (0.5748 => 0.6422, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 11.05% (0.4062 => 0.4511, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 10.86% (0.1013 => 0.1123, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.85% (0.3022 => 0.3350, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 10.82% (0.2781 => 0.3082, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 10.79% (0.4328 => 0.4795, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.76% (0.1413 => 0.1565, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 10.72% (1.3693 => 1.5161, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.51% (0.2721 => 0.3007, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.46% (3.9660 => 4.3808, std.dev.: 0.0039) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.45% (0.1072 => 0.1184, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.42% (0.2782 => 0.3072, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.33% (0.1588 => 0.1752, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.32% (0.1327 => 0.1464, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.19% (0.3485 => 0.3840, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.17% (0.2655 => 0.2925, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.04% (0.7710 => 0.8484, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.03% (0.3899 => 0.4290, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 9.97% (0.2607 => 0.2867, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.96% (1.4563 => 1.6014, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.90% (0.2596 => 0.2853, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 9.74% (0.2690 => 0.2952, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.74% (1.9828 => 2.1759, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.73% (1.2193 => 1.3379, std.dev.: 0.0090) MultiSource/Applications/lambda-0_1_3/lambda: 9.72% (0.7038 => 0.7722, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.71% (0.9199 => 1.0092, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 9.70% (0.2628 => 0.2883, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 9.68% (0.2726 => 0.2990, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 9.64% (0.2760 => 0.3026, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/wc: 9.64% (0.2937 => 0.3220, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.62% (0.1986 => 0.2177, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.61% (0.2966 => 0.3251, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.59% (0.4016 => 0.4401, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.57% (0.6283 => 0.6884, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 9.56% (0.2761 => 0.3025, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.56% (0.3756 => 0.4115, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.55% (0.2765 => 0.3029, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 9.54% (0.3868 => 0.4237, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.53% (0.5265 => 0.5767, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.50% (0.4390 => 0.4807, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 9.46% (0.3107 => 0.3401, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.46% (0.3489 => 0.3819, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.42% (0.2696 => 0.2950, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.41% (0.3580 => 0.3917, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: 9.38% (0.3293 => 0.3602, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 9.37% (0.3149 => 0.3444, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 9.31% (13.8202 => 15.1069, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.21% (0.6959 => 0.7600, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.04% (1.1364 => 1.2391, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/sieve: 8.98% (0.3453 => 0.3763, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 8.97% (0.2988 => 0.3256, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 8.91% (0.3534 => 0.3849, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 8.87% (0.3192 => 0.3475, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.71% (0.6576 => 0.7149, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.64% (0.1157 => 0.1257, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.63% (0.3130 => 0.3400, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.52% (0.4379 => 0.4752, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.48% (0.5577 => 0.6050, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 8.45% (0.2995 => 0.3248, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 8.42% (1.0313 => 1.1181, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.41% (0.4791 => 0.5194, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/objinst: 8.39% (0.2945 => 0.3192, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.39% (0.1276 => 0.1383, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 8.31% (0.1589 => 0.1721, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.27% (0.2127 => 0.2303, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.22% (0.1435 => 0.1553, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 7.98% (0.1478 => 0.1596, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 7.98% (1.1061 => 1.1944, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.92% (7.2180 => 7.7898, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.91% (0.2504 => 0.2702, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.89% (0.2914 => 0.3144, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.88% (0.8698 => 0.9383, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 7.83% (0.6744 => 0.7272, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 7.79% (16.6129 => 17.9070, std.dev.: 0.0217) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.78% (0.3755 => 0.4047, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.76% (0.3246 => 0.3498, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 7.76% (0.8310 => 0.8955, std.dev.: 0.0032) MultiSource/Applications/spiff/spiff: 7.69% (0.7506 => 0.8083, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 7.67% (1.0594 => 1.1407, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/18-imp/imp: 7.67% (0.3220 => 0.3467, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.65% (3.6692 => 3.9498, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.61% (0.7460 => 0.8028, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.61% (0.5637 => 0.6066, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 7.60% (3.1889 => 3.4311, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 7.52% (0.2925 => 0.3145, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/trivial-interface: 7.49% (0.3578 => 0.3846, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.45% (0.3650 => 0.3922, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 7.41% (3.8646 => 4.1508, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-4: 7.32% (0.3646 => 0.3913, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.32% (0.4003 => 0.4296, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 7.31% (0.3789 => 0.4066, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.28% (0.3914 => 0.4199, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.28% (0.3601 => 0.3863, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.26% (0.3940 => 0.4226, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.22% (0.2023 => 0.2169, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/synchronized: 7.21% (0.3663 => 0.3927, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.18% (0.1865 => 0.1999, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 7.13% (2.1791 => 2.3345, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/exceptions-3: 7.12% (0.3623 => 0.3881, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 7.05% (1.9270 => 2.0629, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.99% (0.1789 => 0.1914, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 6.95% (1.2749 => 1.3635, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 6.86% (14.8535 => 15.8726, std.dev.: 0.0118) MultiSource/Benchmarks/Olden/em3d/em3d: 6.82% (0.1657 => 0.1770, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 6.77% (0.3131 => 0.3343, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.71% (0.8818 => 0.9410, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.68% (1.3245 => 1.4130, std.dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 6.65% (8.4961 => 9.0609, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.63% (0.1569 => 0.1673, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.62% (4.3801 => 4.6700, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.58% (4.4433 => 4.7358, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.42% (0.6135 => 0.6529, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 6.41% (1.2292 => 1.3080, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.40% (0.2140 => 0.2277, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.39% (0.4113 => 0.4376, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.01% (0.3511 => 0.3722, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 5.95% (0.6250 => 0.6622, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.88% (4.9865 => 5.2795, std.dev.: 0.0095) MultiSource/Applications/oggenc/oggenc: 5.83% (4.6629 => 4.9347, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.78% (1.1333 => 1.1988, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.45% (3.2742 => 3.4528, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.39% (0.4805 => 0.5064, std.dev.: 0.0042) MultiSource/Applications/JM/ldecod/ldecod: 5.38% (6.5754 => 6.9289, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.36% (0.3245 => 0.3419, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.21% (0.2321 => 0.2442, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 5.07% (3.7467 => 3.9366, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.87% (0.9108 => 0.9552, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.80% (1.5188 => 1.5917, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.76% (13.2842 => 13.9168, std.dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.74% (6.2785 => 6.5762, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.28% (2.1007 => 2.1907, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 3.08% (16.2614 => 16.7616, std.dev.: 0.0175) MultiSource/Applications/ClamAV/clamscan: 2.48% (14.5298 => 14.8896, std.dev.: 0.0081) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5169, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.20% (1.8175 => 2.2574, std.dev.: 0.0501) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 8.65% (1.1560 => 1.2560, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4145, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.16% (1.2998 => 1.3799, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0044, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.94% (11.2619 => 11.7056, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7747, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.39% (10.7476 => 11.1123, std.dev.: 0.0686) SingleSource/Benchmarks/Misc/flops-6: 3.37% (1.9199 => 1.9846, std.dev.: 0.0009) SingleSource/Regression/C/uint64_to_float: 3.03% (0.5449 => 0.5614, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.13% (7.4271 => 7.5850, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/ffbench: 1.75% (0.8273 => 0.8418, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5137, std.dev.: 0.0076) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.30% (5.5130 => 5.5849, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1885, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.13% (3.1071 => 3.1422, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5875, std.dev.: 0.0094) MultiSource/Applications/lemon/lemon: 1.05% (1.4298 => 1.4448, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.00% (9.9194 => 10.0189, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.68% (0.2670 => 0.1397, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -15.84% (0.0707 => 0.0595) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.80% (0.4657 => 0.3921, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.69% (1.3813 => 1.1784, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.57% (1.3819 => 1.1805, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.49% (22.5627 => 21.5495, std.dev.: 0.0222) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.64% (0.0997 => 0.0861, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -12.15% (0.2238 => 0.1966, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.98% (1.2308 => 1.0956, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.19% (20.3410 => 18.2692, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std.dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.86% (1.3780 => 1.2973, std.dev.: 0.0178) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5149, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.53% (13.3668 => 12.7617, std.dev.: 0.0248) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.16% (0.3458 => 0.3314) MultiSource/Applications/siod/siod: -3.53% (3.2729 => 3.1574, std.dev.: 0.0039) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.42% (1.7688 => 1.7083, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.33% (0.9996 => 0.9663, std.dev.: 0.0024) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.96% (0.4867 => 0.4723, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4786, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.39% (3.0263 => 2.9541, std.dev.: 0.0015) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.25% (1.9762 => 1.9318, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.93% (0.6589 => 0.6462, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6954, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: -1.75% (6.3560 => 6.2448, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -1.61% (26.5159 => 26.0898, std.dev.: 0.0132) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0075, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8663, std.dev.: 0.0100) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4941, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: -1.22% (9.3358 => 9.2220, std.dev.: 0.0090) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2570, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 2 08:25:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 2 Oct 2012 10:25:13 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121002152513.1B6602A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4487?compare_to=4484&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4487, Order: 165005, Start Time: 2012-10-02 13:48:07, End Time: 2012-10-02 15:26:54 To: 4484, Order: 164996, Start Time: 2012-10-02 12:03:13, End Time: 2012-10-02 13:32:10 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (8 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 16 (69 on baseline) Performance Improvements: 2 (47 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 77 (69 on baseline) Unchanged Tests: 947 (767 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/sgefa/sgefa: 3.66% (0.2923 => 0.3030, std.dev.: 0.0025) MultiSource/Applications/siod/siod: 2.56% (2.1405 => 2.1953, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.45% (0.8332 => 0.8536, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.33% (0.8503 => 0.8701, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.95% (1.4638 => 1.4924, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.85% (0.8713 => 0.8874, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.54% (3.1341 => 3.1824, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.39% (12.8672 => 13.0462, std.dev.: 0.0603) MultiSource/Applications/d/make_dparser: 1.34% (3.1285 => 3.1704, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C/football/football: 1.31% (0.8526 => 0.8638, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: 5.21% (0.6559 => 0.6901, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 4.45% (42.9230 => 44.8337, std.dev.: 0.1645) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.27% (0.3399 => 0.3510, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.02% (0.5895 => 0.6073, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.00% (4.4462 => 4.5350, std.dev.: 0.0313) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.30% (2.6847 => 2.7196, std.dev.: 0.0099) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.79% (8.9627 => 8.5334, std.dev.: 0.0601) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/ffbench: -1.49% (1.4117 => 1.3906, std.dev.: 0.0067) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.25% (1.0142 => 1.0015, std.dev.: 0.0124) MultiSource/Applications/sqlite3/sqlite3: 1.10% (0.6102 => 0.6169, std.dev.: 0.0121) MultiSource/Benchmarks/McCat/08-main/main: 0.39% (0.1785 => 0.1792, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.90% (0.1564 => 0.1550, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.45% (0.3112 => 0.3098, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.53% (0.2346 => 0.2310, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.25% (0.3144 => 0.3136, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.26% (0.2297 => 0.2303, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: -1.33% (0.0451 => 0.0445, std.dev.: 0.0004) SingleSource/UnitTests/2003-05-07-VarArgs: 125.64% (0.0039 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -64.04% (0.0089 => 0.0032, std.dev.: 0.0028) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -10.08% (0.0238 => 0.0214, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -14.29% (0.0182 => 0.0156, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -20.10% (0.0383 => 0.0306, std.dev.: 0.0073) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.29% (0.0233 => 0.0230, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -7.19% (0.0278 => 0.0258, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -23.58% (0.0318 => 0.0243, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/casts: 2.84% (0.0176 => 0.0181, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/test1: -20.63% (0.0189 => 0.0150, std.dev.: 0.0021) SingleSource/UnitTests/Vector/multiplies: 1.20% (0.0249 => 0.0252, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: 0.62% (0.0323 => 0.0325, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.21% (0.1459 => 0.1462, std.dev.: 0.0039) MultiSource/Applications/JM/lencod/lencod: 1.81% (0.2262 => 0.2303, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 3.41% (1.5046 => 1.5559, std.dev.: 0.0158) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 3.04% (0.1481 => 0.1526, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/Bullet/bullet: -0.14% (0.5912 => 0.5904, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -0.41% (26.8675 => 26.7580, std.dev.: 0.1270) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.61% (0.4060 => 0.4166, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.28% (0.1442 => 0.1438, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.47% (0.0543 => 0.0551, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -10.53% (0.0190 => 0.0170, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -12.71% (0.0661 => 0.0577, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.20% (1.1308 => 1.1285, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0012 => 0.0012, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.99% (0.0544 => 0.0582, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 31.13% (0.0151 => 0.0198, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.12% (0.7645 => 0.7654, std.dev.: 0.0114) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 0.31% (3.9974 => 4.0098, std.dev.: 0.0151) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.25% (58.1813 => 59.4926, std.dev.: 0.6248) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -0.80% (2.9338 => 2.9102, std.dev.: 0.0308) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -13.29% (2.6784 => 2.3225, std.dev.: 0.0742) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.04% (1.7060 => 1.7066, std.dev.: 0.0050) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -25.62% (0.0121 => 0.0090, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt MultiSource/Applications/JM/lencod/lencod: -96.59% (6.7458 => 0.2303, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: -91.53% (6.9722 => 0.5904, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/09-vor/vor: 21531.37% (0.1237 => 26.7580, std.dev.: 0.1270) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -1.38% (4.0659 => 4.0098, std.dev.: 0.0151) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.75% (61.1734 => 59.4926, std.dev.: 0.6248) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -9.08% (3.2007 => 2.9102, std.dev.: 0.0308) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -1.51% (2.3580 => 2.3225, std.dev.: 0.0742) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.16% (4.1772 => 3.0846, std.dev.: 0.0662) SingleSource/Benchmarks/Shootout-C++/except: 82383.33% (0.0006 => 0.4949, std.dev.: 0.0033) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: -75.00% (0.0004 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 24.56% (0.0745 => 0.0928, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.84% (0.1159 => 0.1273, std.dev.: 0.0027) MultiSource/Benchmarks/PAQ8p/paq8p: 8.55% (2.1763 => 2.3623, std.dev.: 0.0269) SingleSource/Benchmarks/Misc-C++/bigfib: 7.74% (0.5309 => 0.5720, std.dev.: 0.0051) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.57% (0.1414 => 0.1521, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.52% (0.6410 => 0.6892, std.dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 6.88% (1.1653 => 1.2455, std.dev.: 0.0147) MultiSource/Applications/lemon/lemon: 6.83% (1.0046 => 1.0732, std.dev.: 0.0251) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.70% (0.3582 => 0.3786, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.56% (1.5150 => 1.5993, std.dev.: 0.0032) MultiSource/Applications/kimwitu++/kc: 5.44% (15.3105 => 16.1434, std.dev.: 0.2665) MultiSource/Applications/lambda-0_1_3/lambda: 5.41% (0.6915 => 0.7289, std.dev.: 0.0124) MultiSource/Applications/sgefa/sgefa: 5.32% (0.2877 => 0.3030, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.07% (0.6069 => 0.6377, std.dev.: 0.0029) MultiSource/Applications/d/make_dparser: 4.89% (3.0225 => 3.1704, std.dev.: 0.0162) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.79% (0.7639 => 0.8005, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.72% (0.3901 => 0.4085, std.dev.: 0.0023) MultiSource/Applications/siod/siod: 4.68% (2.0972 => 2.1953, std.dev.: 0.0104) MultiSource/Benchmarks/McCat/18-imp/imp: 4.20% (0.3217 => 0.3352, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 4.04% (13.3238 => 13.8615, std.dev.: 0.0902) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.91% (0.4248 => 0.4414, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.73% (0.4880 => 0.5062, std.dev.: 0.0058) MultiSource/Benchmarks/Bullet/bullet: 3.72% (29.3170 => 30.4069, std.dev.: 0.2025) MultiSource/Applications/oggenc/oggenc: 3.62% (4.7455 => 4.9175, std.dev.: 0.0486) MultiSource/Benchmarks/mafft/pairlocalalign: 3.59% (8.2186 => 8.5135, std.dev.: 0.0413) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.58% (1.4408 => 1.4924, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.57% (1.2021 => 1.2450, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.56% (0.8569 => 0.8874, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.47% (3.0758 => 3.1824, std.dev.: 0.0053) MultiSource/Applications/Burg/burg: 3.42% (1.1440 => 1.1831, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.20% (12.6413 => 13.0462, std.dev.: 0.0603) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.81% (6.2546 => 6.4303, std.dev.: 0.0542) MultiSource/Applications/JM/lencod/lencod: 2.79% (14.7256 => 15.1371, std.dev.: 0.1435) MultiSource/Benchmarks/Prolangs-C/football/football: 2.77% (0.8405 => 0.8638, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.71% (1.0689 => 1.0979, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.67% (1.1827 => 1.2143, std.dev.: 0.0061) MultiSource/Benchmarks/nbench/nbench: 2.62% (1.0821 => 1.1105, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.56% (1.1672 => 1.1971, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.48% (2.0317 => 2.0820, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.46% (4.0318 => 4.1311, std.dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.51% (1.2742 => 1.2934, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.40% (4.2815 => 4.3416, std.dev.: 0.0147) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 57.85% (0.0261 => 0.0412, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/pi: 41.44% (1.6538 => 2.3392, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 22.10% (3.4629 => 4.2282, std.dev.: 0.0116) MultiSource/Benchmarks/Olden/power/power: 17.84% (1.4184 => 1.6714, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/ary3: 14.85% (1.7426 => 2.0013, std.dev.: 0.0215) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.76% (0.0917 => 0.1034, std.dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.47% (2.4042 => 2.7041, std.dev.: 0.0048) SingleSource/Benchmarks/McGill/queens: 11.12% (1.6261 => 1.8069, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/mason/mason: 9.85% (0.5004 => 0.5497, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/lists: 8.91% (7.0025 => 7.6266, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.54% (0.2857 => 0.3101, std.dev.: 0.0029) SingleSource/Benchmarks/Stanford/Puzzle: 8.03% (0.1433 => 0.1548, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.86% (1.0063 => 1.0854, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/mst/mst: 7.41% (0.1417 => 0.1522, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/bisort/bisort: 6.84% (0.6459 => 0.6901, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.33% (0.3301 => 0.3510, std.dev.: 0.0027) MultiSource/Benchmarks/PAQ8p/paq8p: 4.26% (92.7467 => 96.6996, std.dev.: 0.7156) SingleSource/Benchmarks/Misc/dt: 3.74% (0.9851 => 1.0219, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.62% (0.5587 => 0.5789, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.35% (0.5876 => 0.6073, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.91% (6.6312 => 6.8240, std.dev.: 0.0096) MultiSource/Applications/siod/siod: 2.84% (3.5520 => 3.6528, std.dev.: 0.0079) MultiSource/Applications/hexxagon/hexxagon: 2.77% (14.4877 => 14.8895, std.dev.: 0.0266) SingleSource/Benchmarks/Shootout-C++/hash: 2.46% (0.6308 => 0.6463, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 2.34% (62.4126 => 63.8730, std.dev.: 0.1260) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.03% (2.6656 => 2.7196, std.dev.: 0.0099) SingleSource/Benchmarks/Dhrystone/dry: 1.86% (2.4013 => 2.4460, std.dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -45.56% (0.2996 => 0.1631, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.50% (0.0591 => 0.0328, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -20.32% (1.4113 => 1.1245, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.31% (1.4189 => 1.1307, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.91% (0.2080 => 0.1957, std.dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -5.16% (8.9977 => 8.5334, std.dev.: 0.0601) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.41% (0.3497 => 0.2084, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -26.03% (15.8312 => 11.7107, std.dev.: 0.0630) SingleSource/Benchmarks/Shootout-C++/ary3: -20.39% (1.7473 => 1.3911, std.dev.: 0.0106) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.31% (5.2665 => 4.1969, std.dev.: 0.0364) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.21% (1.7361 => 1.4721, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1585, std.dev.: 0.0094) MultiSource/Benchmarks/FreeBench/neural/neural: -11.47% (1.0926 => 0.9673, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.61% (1.1647 => 1.0528, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/flops: -8.36% (9.5474 => 8.7496, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2864, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: -7.17% (2.5166 => 2.3361, std.dev.: 0.0153) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.92% (3.6254 => 3.3744, std.dev.: 0.0264) MultiSource/Applications/sgefa/sgefa: -6.91% (0.3746 => 0.3487, std.dev.: 0.0088) MultiSource/Applications/lambda-0_1_3/lambda: -6.70% (7.6833 => 7.1682, std.dev.: 0.0533) SingleSource/Benchmarks/Shootout-C++/fibo: -6.54% (4.6355 => 4.3323, std.dev.: 0.0092) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.49% (2.0027 => 1.8727, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -6.29% (1.4441 => 1.3532, std.dev.: 0.0141) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.98% (2.9728 => 2.7950, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.46% (3.9413 => 3.7263, std.dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: -5.26% (3.4230 => 3.2429, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout/fib2: -5.21% (4.4195 => 4.1892, std.dev.: 0.0178) MultiSource/Benchmarks/FreeBench/distray/distray: -4.95% (0.2664 => 0.2532, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: -4.94% (1.5803 => 1.5023, std.dev.: 0.0116) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.38% (0.4564 => 0.4364, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -4.24% (3.4080 => 3.2635, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.22% (9.3855 => 9.0831, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/methcall: -3.20% (9.2503 => 8.9545, std.dev.: 0.0235) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.64% (3.7496 => 3.6506, std.dev.: 0.0294) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.07% (1.1683 => 1.1441, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: -1.90% (3.4876 => 3.4215, std.dev.: 0.0065) MultiSource/Benchmarks/sim/sim: -1.89% (3.8907 => 3.8172, std.dev.: 0.0098) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.86% (2.3569 => 2.3131, std.dev.: 0.0052) MultiSource/Applications/aha/aha: -1.81% (3.4286 => 3.3665, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: -1.49% (1.4117 => 1.3906, std.dev.: 0.0067) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.42% (27.1724 => 26.7852, std.dev.: 0.0502) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -1.40% (45.4683 => 44.8337, std.dev.: 0.1645) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3131, std.dev.: 0.0224) SingleSource/Benchmarks/Shootout-C++/lists: -1.34% (16.5617 => 16.3390, std.dev.: 0.0356) SingleSource/Benchmarks/Dhrystone/fldry: -1.29% (2.4971 => 2.4649, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: -1.20% (1.0194 => 1.0072, std.dev.: 0.0047) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.35% (0.9980 => 1.0015, std.dev.: 0.0124) MultiSource/Applications/sqlite3/sqlite3: 2.44% (0.6022 => 0.6169, std.dev.: 0.0121) MultiSource/Benchmarks/McCat/08-main/main: 7.56% (0.1666 => 0.1792, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.26% (0.1554 => 0.1550, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.49% (0.3083 => 0.3098, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.51% (0.2394 => 0.2310, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.23% (0.3175 => 0.3136, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.04% (0.2302 => 0.2303, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: -0.89% (0.0449 => 0.0445, std.dev.: 0.0004) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -64.44% (0.0090 => 0.0032, std.dev.: 0.0028) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -10.83% (0.0240 => 0.0214, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -18.75% (0.0192 => 0.0156, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -21.54% (0.0390 => 0.0306, std.dev.: 0.0073) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -23.59% (0.0301 => 0.0230, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -9.15% (0.0284 => 0.0258, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -25.00% (0.0324 => 0.0243, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/casts: 2.26% (0.0177 => 0.0181, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/test1: -20.63% (0.0189 => 0.0150, std.dev.: 0.0021) SingleSource/UnitTests/Vector/multiplies: 1.20% (0.0249 => 0.0252, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0325 => 0.0325, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.31% (0.1429 => 0.1462, std.dev.: 0.0039) MultiSource/Applications/lemon/lemon: 3.60% (1.5019 => 1.5559, std.dev.: 0.0158) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 1.67% (0.1501 => 0.1526, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.30% (0.4264 => 0.4166, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.99% (0.1344 => 0.1438, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.45% (0.0589 => 0.0551, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -26.72% (0.0232 => 0.0170, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.70% (0.0639 => 0.0577, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.57% (1.1350 => 1.1285, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.63% (0.0637 => 0.0582, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.51% (0.0246 => 0.0198, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.50% (0.7541 => 0.7654, std.dev.: 0.0114) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.09% (1.5363 => 1.7066, std.dev.: 0.0050) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 28.57% (0.0070 => 0.0090, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 2 08:29:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 2 Oct 2012 10:29:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121002152940.00FD52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4488?compare_to=4485&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4488, Order: 165005, Start Time: 2012-10-02 14:11:48, End Time: 2012-10-02 15:31:19 To: 4485, Order: 164996, Start Time: 2012-10-02 12:23:06, End Time: 2012-10-02 13:42:39 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (147 on baseline) Performance Improvements: 1 (46 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 952 (694 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.36% (14.9784 => 14.7753, std.dev.: 0.0106) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.05% (0.5762 => 0.5765, std.dev.: 0.0084) MultiSource/Applications/SPASS/SPASS: 0.17% (15.9964 => 16.0236, std.dev.: 0.0063) MultiSource/Benchmarks/Bullet/bullet: 0.17% (54.1274 => 54.2175, std.dev.: 0.0147) MultiSource/Benchmarks/MallocBench/gs/gs: -0.01% (4.3184 => 4.3179, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.65% (0.0460 => 0.0463) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.43% (0.0462 => 0.0464, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.70% (0.0429 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.46% (0.0431 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.72% (0.0418 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.71% (0.0420 => 0.0423) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.48% (0.0413 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.48% (0.0414 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.70% (0.0431 => 0.0434) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.46% (0.0432 => 0.0434, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.71% (0.0425 => 0.0428, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.70% (0.0426 => 0.0429) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.48% (0.0415 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.72% (0.0416 => 0.0419) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.71% (0.0422 => 0.0425) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.95% (0.0423 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.69% (0.0433 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.46% (0.0435 => 0.0437, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.49% (0.0411 => 0.0413) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.49% (0.0412 => 0.0414) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.71% (0.0422 => 0.0425) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.71% (0.0423 => 0.0426) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.48% (0.0414 => 0.0416) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.48% (0.0415 => 0.0417, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.49% (0.0406 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.74% (0.0406 => 0.0409) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.50% (0.0404 => 0.0406, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.49% (0.0406 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.68% (0.0441 => 0.0444, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.68% (0.0442 => 0.0445, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.50% (0.0404 => 0.0406) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.49% (0.0405 => 0.0407) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.74% (0.0404 => 0.0407) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.49% (0.0405 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.49% (0.0412 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.48% (0.0413 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.07% (1.2290 => 1.2298, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.02% (7.5627 => 7.5615, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.10% (0.7307 => 0.7314, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.56% (0.0360 => 0.0362) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1434 => 0.1435) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.83% (0.0671 => 0.0652, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -14.27% (63.2438 => 54.2175, std.dev.: 0.0147) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 30.68% (14.1553 => 18.4988, std.dev.: 0.0139) SingleSource/Benchmarks/Misc-C++-EH/spirit: 58.47% (3.4629 => 5.4878, std.dev.: 0.0207) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14236.39% (0.0720 => 10.3222, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10006100.00% (0.0001 => 10.0062, std.dev.: 0.0009) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 46.28% (0.2554 => 0.3736) MultiSource/Benchmarks/PAQ8p/paq8p: 42.52% (10.3673 => 14.7753, std.dev.: 0.0106) MultiSource/Benchmarks/FreeBench/distray/distray: 29.92% (0.1056 => 0.1372, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 29.84% (0.1622 => 0.2106, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.00% (2.2022 => 2.5104, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 13.90% (0.1432 => 0.1631, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.56% (7.0540 => 8.0108, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.77% (0.1566 => 0.1766, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.99% (1.7609 => 1.9721, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.37% (0.3543 => 0.3946, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/trivial-interface: 10.88% (0.3473 => 0.3851, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.70% (0.3543 => 0.3922, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 10.67% (0.3497 => 0.3870, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.47% (0.3561 => 0.3934, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 10.47% (10.4361 => 11.5291, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-3: 10.41% (0.3516 => 0.3882, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.26% (0.3694 => 0.4073, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.08% (0.3927 => 0.4323, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.06% (0.3828 => 0.4213, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 9.99% (9.4845 => 10.4316, std.dev.: 0.0049) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.97% (0.1584 => 0.1742, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.80% (0.3886 => 0.4267, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 9.35% (0.3282 => 0.3589, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.20% (0.5925 => 0.6470, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.97% (0.6030 => 0.6571, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.28% (0.4879 => 0.5283, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.25% (0.3177 => 0.3439, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 8.22% (0.1655 => 0.1791, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 8.04% (0.7326 => 0.7915, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 7.93% (0.7115 => 0.7679, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.87% (0.6675 => 0.7200, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.79% (0.1438 => 0.1550, std.dev.: 0.0028) MultiSource/Applications/sgefa/sgefa: 7.69% (0.3109 => 0.3348, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.65% (1.5415 => 1.6595, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.61% (0.2603 => 0.2801, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.37% (0.2905 => 0.3119, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 7.31% (0.7433 => 0.7976, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.28% (0.4615 => 0.4951, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: 7.22% (0.3422 => 0.3669, std.dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 7.22% (5.7591 => 6.1747, std.dev.: 0.0187) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.19% (0.2891 => 0.3099, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.17% (0.4103 => 0.4397, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 7.05% (3.3354 => 3.5706, std.dev.: 0.0084) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.05% (0.2271 => 0.2431, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/em3d/em3d: 7.02% (0.1695 => 0.1814, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.02% (0.1625 => 0.1739, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/18-imp/imp: 7.01% (0.3423 => 0.3663) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.93% (0.5105 => 0.5459, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.92% (0.2065 => 0.2208, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.92% (1.3050 => 1.3953, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.86% (0.4636 => 0.4954, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 6.85% (0.2831 => 0.3025, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.82% (0.2872 => 0.3068, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.82% (0.1510 => 0.1613, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 6.82% (0.6456 => 0.6896, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.81% (0.3098 => 0.3309, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.81% (0.5860 => 0.6259, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.80% (0.2793 => 0.2983, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 6.78% (0.3232 => 0.3451, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.77% (4.2646 => 4.5532, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash: 6.76% (0.4289 => 0.4579, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.75% (0.3865 => 0.4126, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.75% (0.2725 => 0.2909, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 6.75% (0.3052 => 0.3258, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.73% (0.4203 => 0.4486, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.73% (0.3136 => 0.3347, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.71% (0.3307 => 0.3529, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.65% (2.0665 => 2.2040, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/moments: 6.65% (0.4048 => 0.4317, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.64% (0.2756 => 0.2939, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.64% (8.1363 => 8.6763, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/except: 6.62% (0.2871 => 0.3061, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.61% (0.3283 => 0.3500, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.60% (0.3650 => 0.3891, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.59% (0.2700 => 0.2878, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.56% (0.8172 => 0.8708, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.55% (0.9765 => 1.0405, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.53% (5.0018 => 5.3285, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/random: 6.53% (0.2802 => 0.2985, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.51% (0.3162 => 0.3368, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 6.48% (0.2714 => 0.2890, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.48% (0.5569 => 0.5930, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.47% (4.9449 => 5.2649, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 6.45% (0.4620 => 0.4918) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.43% (0.5020 => 0.5343, std.dev.: 0.0052) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.41% (0.3121 => 0.3321, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.41% (0.2107 => 0.2242, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.41% (7.9617 => 8.4718, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/methcall: 6.40% (0.2877 => 0.3061, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 6.38% (0.3684 => 0.3919, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.38% (0.3826 => 0.4070, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.35% (0.8067 => 0.8579, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sieve: 6.33% (0.3603 => 0.3831, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.27% (0.2758 => 0.2931, std.dev.: 0.0020) MultiSource/Applications/spiff/spiff: 6.24% (0.7835 => 0.8324, std.dev.: 0.0038) MultiSource/Applications/hbd/hbd: 6.20% (1.5603 => 1.6571, std.dev.: 0.0100) MultiSource/Applications/Burg/burg: 6.06% (1.1642 => 1.2347, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.98% (0.1940 => 0.2056, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 5.89% (0.3379 => 0.3578, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 5.87% (21.9371 => 23.2255, std.dev.: 0.0047) MultiSource/Benchmarks/sim/sim: 5.85% (0.3387 => 0.3585, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 5.84% (3.8723 => 4.0983, std.dev.: 0.0082) MultiSource/Applications/lemon/lemon: 5.64% (1.0722 => 1.1327, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 5.56% (0.4299 => 0.4538, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 5.50% (0.3180 => 0.3355, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.41% (0.3441 => 0.3627, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.35% (1.1861 => 1.2495, std.dev.: 0.0040) MultiSource/Applications/treecc/treecc: 5.33% (2.0273 => 2.1354, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 5.02% (0.8921 => 0.9369, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.97% (0.4064 => 0.4266, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.93% (0.6450 => 0.6768, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 4.78% (2.2969 => 2.4068, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.74% (1.5859 => 1.6611, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.70% (0.5981 => 0.6262, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.60% (0.3131 => 0.3275, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 4.51% (1.2842 => 1.3421, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.20% (1.4186 => 1.4782, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.15% (2.2024 => 2.2937, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.10% (1.1840 => 1.2325, std.dev.: 0.0055) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.15% (0.8101 => 0.8356, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.96% (0.3817 => 0.3930, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.73% (1.1194 => 1.1500, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.71% (14.3668 => 14.7568, std.dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: 2.18% (17.1811 => 17.5559, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.76% (3.8922 => 3.9607, std.dev.: 0.0159) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8962, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 30.45% (1.1277 => 1.4711, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.25% (1.1145 => 1.3848) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2173, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 9.20% (3.1595 => 3.4502, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.1578 => 3.3686, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 6.61% (1.1396 => 1.2149, std.dev.: 0.0007) SingleSource/Regression/C/uint64_to_float: 3.71% (0.5413 => 0.5614) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.48% (3.6395 => 3.7662, std.dev.: 0.0049) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.72% (4.2280 => 4.3430, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.28% (1.7254 => 1.7647, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (0.8275 => 0.8405, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.08% (6.5088 => 6.5793, std.dev.: 0.0046) MultiSource/Applications/minisat/minisat: 1.08% (9.1159 => 9.2145, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 1.03% (11.6436 => 11.7632, std.dev.: 0.0060) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1286, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.08% (0.8651 => 0.1723, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.24% (5.2763 => 3.2589, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.32% (5.3855 => 3.5913, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.96% (5.3526 => 3.5886, std.dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -14.80% (54.1659 => 46.1469, std.dev.: 0.0261) MultiSource/Benchmarks/FreeBench/mason/mason: -14.18% (0.0811 => 0.0696, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.27% (2.9384 => 2.6073, std.dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: -10.45% (22.1758 => 19.8581, std.dev.: 0.0141) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7645, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.94% (1.6925 => 1.4228, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.03% (0.0998 => 0.0858, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: -12.67% (1.3677 => 1.1944, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.62% (1.2373 => 1.0935, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -10.45% (1.5373 => 1.3767, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/mason/mason: -10.09% (0.2161 => 0.1943, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.23% (19.9488 => 18.3064, std.dev.: 0.0150) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.65% (0.2497 => 0.2331, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.61% (1.8329 => 1.7118, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.20% (13.4384 => 12.7394, std.dev.: 0.0195) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.01% (1.6805 => 1.5963, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.98% (5.0483 => 4.7967, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.87% (1.5835 => 1.5064, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.30% (0.3463 => 0.3314, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.05% (0.9957 => 0.9554, std.dev.: 0.0034) MultiSource/Applications/siod/siod: -3.71% (3.2827 => 3.1608, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.43% (32.5116 => 31.3976, std.dev.: 0.0067) MultiSource/Applications/hexxagon/hexxagon: -2.43% (12.4730 => 12.1697, std.dev.: 0.0023) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.12% (0.4808 => 0.4706, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.06% (8.6802 => 8.5013, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.00% (8.1563 => 7.9932, std.dev.: 0.0149) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6813, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -1.72% (10.2830 => 10.1064, std.dev.: 0.0056) SingleSource/UnitTests/Vector/multiplies: -1.51% (2.5528 => 2.5142, std.dev.: 0.0047) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4213, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -1.44% (4.6441 => 4.5772, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/lists: -1.04% (6.2999 => 6.2341, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.25% (0.5229 => 0.5765, std.dev.: 0.0084) MultiSource/Applications/SPASS/SPASS: 6.90% (14.9895 => 16.0236, std.dev.: 0.0063) MultiSource/Benchmarks/MallocBench/gs/gs: 5.05% (4.1105 => 4.3179, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.31% (1.1048 => 1.2298, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.63% (7.1582 => 7.5615, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_container: 17.55% (0.6222 => 0.7314, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36100.00% (0.0001 => 0.0362) MultiSource/Applications/oggenc/oggenc: -3.37% (0.1485 => 0.1435) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 2 10:08:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 2 Oct 2012 12:08:17 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121002170817.9B1462A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4489?compare_to=4487&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4489, Order: 165017, Start Time: 2012-10-02 15:43:16, End Time: 2012-10-02 17:09:58 To: 4487, Order: 165005, Start Time: 2012-10-02 13:48:07, End Time: 2012-10-02 15:26:54 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (8 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 6 (72 on baseline) Performance Improvements: 4 (46 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 77 (69 on baseline) Unchanged Tests: 955 (765 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/treeadd/treeadd: 59.41% (0.0239 => 0.0381, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.82% (0.2845 => 0.2982, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.21% (0.7604 => 0.7848, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 6.18% (0.8863 => 0.9411, std.dev.: 0.0185) MultiSource/Benchmarks/nbench/nbench: 3.54% (21.4124 => 22.1703, std.dev.: 0.1819) SingleSource/Benchmarks/Misc/whetstone: 1.92% (2.3695 => 2.4151, std.dev.: 0.0080) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.34% (0.3115 => 0.3011, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.47% (1.0979 => 1.0818, std.dev.: 0.0035) MultiSource/Applications/siod/siod: -1.34% (2.1953 => 2.1658, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -1.29% (4.0557 => 4.0032, std.dev.: 0.0154) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.38% (1.0015 => 0.9977, std.dev.: 0.0122) MultiSource/Applications/sqlite3/sqlite3: -0.26% (0.6169 => 0.6153, std.dev.: 0.0087) MultiSource/Benchmarks/McCat/08-main/main: -0.61% (0.1792 => 0.1781, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.23% (0.1550 => 0.1569, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.52% (0.3098 => 0.3051, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.00% (0.2310 => 0.2287, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.75% (0.3136 => 0.3191, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.17% (0.2303 => 0.2230, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel: -3.60% (0.0445 => 0.0429, std.dev.: 0.0010) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0088 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -9.38% (0.0032 => 0.0029, std.dev.: 0.0029) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -21.50% (0.0214 => 0.0168, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -18.59% (0.0156 => 0.0127, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 25.16% (0.0306 => 0.0383, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.43% (0.0230 => 0.0231, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 8.14% (0.0258 => 0.0279, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 24.28% (0.0243 => 0.0302, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: -2.21% (0.0181 => 0.0177, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -23.33% (0.0150 => 0.0115, std.dev.: 0.0051) SingleSource/UnitTests/Vector/multiplies: -1.19% (0.0252 => 0.0249, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -14.77% (0.0325 => 0.0277, std.dev.: 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005) MultiSource/Applications/ClamAV/clamscan: 4.17% (0.1462 => 0.1523, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: -0.56% (0.2303 => 0.2290, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: -0.37% (1.5559 => 1.5502, std.dev.: 0.0279) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.51% (0.1526 => 0.1503, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -0.02% (0.5904 => 0.5903, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 0.62% (26.7580 => 26.9241, std.dev.: 0.1227) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.72% (0.4166 => 0.4011, std.dev.: 0.0192) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.25% (0.1438 => 0.1420, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.26% (0.0551 => 0.0580, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.71% (0.0170 => 0.0162, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.87% (0.0577 => 0.0582, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.26% (1.1285 => 1.1256, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0012 => 0.0012, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.84% (0.0582 => 0.0548, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.81% (0.0198 => 0.0137, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.05% (0.7654 => 0.7650, std.dev.: 0.0080) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -0.20% (4.0098 => 4.0016, std.dev.: 0.0263) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -0.10% (59.4926 => 59.4340, std.dev.: 0.4343) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 0.61% (2.9102 => 2.9280, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 10.41% (2.3225 => 2.5642, std.dev.: 0.0781) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.13% (1.7066 => 1.7043, std.dev.: 0.0011) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 34.44% (0.0090 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt MultiSource/Applications/JM/lencod/lencod: -96.61% (6.7458 => 0.2290, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -91.53% (6.9722 => 0.5903, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/09-vor/vor: 21665.64% (0.1237 => 26.9241, std.dev.: 0.1227) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -1.58% (4.0659 => 4.0016, std.dev.: 0.0263) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.84% (61.1734 => 59.4340, std.dev.: 0.4343) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.52% (3.2007 => 2.9280, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 8.74% (2.3580 => 2.5642, std.dev.: 0.0781) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.14% (4.1772 => 3.1270, std.dev.: 0.0879) SingleSource/Benchmarks/Shootout-C++/except: 82333.33% (0.0006 => 0.4946, std.dev.: 0.0053) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.15% (0.0745 => 0.0910, std.dev.: 0.0026) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.49% (0.1414 => 0.1534, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: 8.34% (0.5309 => 0.5752, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.14% (0.6410 => 0.6932, std.dev.: 0.0183) MultiSource/Benchmarks/PAQ8p/paq8p: 8.14% (2.1763 => 2.3535, std.dev.: 0.0257) MultiSource/Applications/minisat/minisat: 7.18% (0.6173 => 0.6616, std.dev.: 0.0087) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.90% (0.3582 => 0.3829, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.29% (0.2654 => 0.2821, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.15% (1.5150 => 1.6082, std.dev.: 0.0293) MultiSource/Applications/lemon/lemon: 5.96% (1.0046 => 1.0645, std.dev.: 0.0196) MultiSource/Applications/SIBsim4/SIBsim4: 5.80% (1.1653 => 1.2329, std.dev.: 0.0174) MultiSource/Applications/kimwitu++/kc: 5.39% (15.3105 => 16.1355, std.dev.: 0.2013) MultiSource/Applications/lambda-0_1_3/lambda: 5.23% (0.6915 => 0.7277, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.11% (0.2797 => 0.2940, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.07% (0.6069 => 0.6377, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.48% (0.7639 => 0.7981, std.dev.: 0.0121) MultiSource/Applications/d/make_dparser: 4.19% (3.0225 => 3.1491, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.69% (0.3901 => 0.4045, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 3.65% (1.1440 => 1.1858, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.56% (0.3062 => 0.3171, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 3.51% (0.3217 => 0.3330, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.44% (0.4248 => 0.4394, std.dev.: 0.0053) MultiSource/Applications/SPASS/SPASS: 3.33% (13.3238 => 13.7669, std.dev.: 0.0901) MultiSource/Applications/siod/siod: 3.27% (2.0972 => 2.1658, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.20% (0.4880 => 0.5036, std.dev.: 0.0042) MultiSource/Applications/oggenc/oggenc: 3.19% (4.7455 => 4.8967, std.dev.: 0.0181) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.16% (6.2546 => 6.4525, std.dev.: 0.0217) MultiSource/Applications/hbd/hbd: 3.12% (1.3268 => 1.3682, std.dev.: 0.0130) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.96% (1.1672 => 1.2018, std.dev.: 0.0076) MultiSource/Applications/lua/lua: 2.88% (3.5980 => 3.7018, std.dev.: 0.0270) MultiSource/Benchmarks/Bullet/bullet: 2.84% (29.3170 => 30.1487, std.dev.: 0.0415) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.80% (1.2021 => 1.2357, std.dev.: 0.0085) MultiSource/Benchmarks/mafft/pairlocalalign: 2.66% (8.2186 => 8.4375, std.dev.: 0.0116) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.43% (0.8569 => 0.8777, std.dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: 2.18% (14.7256 => 15.0467, std.dev.: 0.0453) MultiSource/Applications/treecc/treecc: 2.15% (1.8798 => 1.9203, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.11% (0.5937 => 0.6062, std.dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 2.09% (6.4908 => 6.6265, std.dev.: 0.0233) MultiSource/Benchmarks/Prolangs-C/football/football: 1.70% (0.8405 => 0.8548, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.63% (0.7722 => 0.7848, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.31% (4.2616 => 4.3173, std.dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.21% (1.0689 => 1.0818, std.dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.44% (1.6538 => 2.3392, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2277, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 17.82% (1.4184 => 1.6712, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/ary3: 14.62% (1.7426 => 1.9973, std.dev.: 0.0542) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.05% (2.4042 => 2.7421, std.dev.: 0.0196) SingleSource/Benchmarks/Stanford/Puzzle: 13.68% (0.1433 => 0.1629, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.74% (0.8498 => 0.9411, std.dev.: 0.0185) SingleSource/Benchmarks/McGill/queens: 10.63% (1.6261 => 1.7989, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/mst/mst: 10.52% (0.1417 => 0.1566, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/mason/mason: 9.51% (0.5004 => 0.5480, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: 9.06% (7.0025 => 7.6370, std.dev.: 0.0231) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.75% (0.2857 => 0.3107, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.91% (0.3301 => 0.3562, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.34% (1.0063 => 1.0802, std.dev.: 0.0128) MultiSource/Benchmarks/Olden/bisort/bisort: 6.83% (0.6459 => 0.6900, std.dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 4.71% (21.1721 => 22.1703, std.dev.: 0.1819) SingleSource/Benchmarks/Misc/dt: 4.07% (0.9851 => 1.0252, std.dev.: 0.0026) MultiSource/Benchmarks/PAQ8p/paq8p: 3.80% (92.7467 => 96.2725, std.dev.: 0.7688) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.22% (40.4792 => 41.7818, std.dev.: 0.4026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.11% (0.5587 => 0.5761, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/whetstone: 2.98% (2.3453 => 2.4151, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.81% (6.6312 => 6.8174, std.dev.: 0.0203) MultiSource/Applications/hexxagon/hexxagon: 2.80% (14.4877 => 14.8937, std.dev.: 0.0763) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.06% (0.5876 => 0.5997, std.dev.: 0.0046) MultiSource/Applications/siod/siod: 2.01% (3.5520 => 3.6234, std.dev.: 0.0159) MultiSource/Benchmarks/mafft/pairlocalalign: 1.92% (62.4126 => 63.6135, std.dev.: 0.2664) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.92% (4.6127 => 4.7014, std.dev.: 0.0179) SingleSource/Benchmarks/Dhrystone/dry: 1.92% (2.4013 => 2.4474, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: 1.48% (15.2242 => 15.4499, std.dev.: 0.0230) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.4455 => 2.4706, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -45.29% (0.2996 => 0.1639, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -45.18% (0.0591 => 0.0324, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.66% (1.4189 => 1.1258, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.84% (1.4113 => 1.1313, std.dev.: 0.0263) SingleSource/UnitTests/Vector/constpool: -6.84% (8.9977 => 8.3824, std.dev.: 0.1832) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.95% (0.3497 => 0.2065, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -25.51% (15.8312 => 11.7932, std.dev.: 0.0639) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.41% (5.2665 => 4.1915, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary3: -20.13% (1.7473 => 1.3955, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.17% (1.7361 => 1.4727, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1604, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/neural/neural: -11.49% (1.0926 => 0.9671, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -10.98% (3.6023 => 3.2069, std.dev.: 0.1255) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.68% (1.1647 => 1.0520, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: -8.53% (9.5474 => 8.7331, std.dev.: 0.0105) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2860, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/bh/bh: -7.28% (2.5166 => 2.3334, std.dev.: 0.0095) MultiSource/Applications/sgefa/sgefa: -7.18% (0.3746 => 0.3477, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.92% (3.6254 => 3.3747, std.dev.: 0.0233) MultiSource/Applications/lambda-0_1_3/lambda: -6.66% (7.6833 => 7.1713, std.dev.: 0.0294) SingleSource/Benchmarks/Shootout-C++/fibo: -6.63% (4.6355 => 4.3282, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/richards_benchmark: -6.51% (1.4441 => 1.3501, std.dev.: 0.0111) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.43% (2.0027 => 1.8739, std.dev.: 0.0096) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.02% (2.9728 => 2.7938, std.dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.45% (3.9413 => 3.7265, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/fib2: -5.29% (4.4195 => 4.1858, std.dev.: 0.0070) MultiSource/Applications/SIBsim4/SIBsim4: -5.23% (3.4230 => 3.2440, std.dev.: 0.0085) SingleSource/Benchmarks/BenchmarkGame/n-body: -4.87% (1.5803 => 1.5033, std.dev.: 0.0241) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.67% (0.4564 => 0.4351, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/distray/distray: -4.62% (0.2664 => 0.2541, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -4.20% (3.4080 => 3.2647, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: -3.92% (8.5323 => 8.1980, std.dev.: 0.0406) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.45% (9.3855 => 9.0620, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/methcall: -3.14% (9.2503 => 8.9601, std.dev.: 0.0283) SingleSource/Benchmarks/McGill/misr: -2.82% (0.4296 => 0.4175, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.75% (3.7496 => 3.6465, std.dev.: 0.0099) MultiSource/Applications/aha/aha: -2.04% (3.4286 => 3.3586, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/hash2: -2.02% (3.4876 => 3.4173, std.dev.: 0.0019) MultiSource/Benchmarks/sim/sim: -2.00% (3.8907 => 3.8130, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.79% (2.3569 => 2.3148, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.68% (1.0686 => 1.0507, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.61% (1.1683 => 1.1495, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3074, std.dev.: 0.0104) SingleSource/Benchmarks/Dhrystone/fldry: -1.38% (2.4971 => 2.4627, std.dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.33% (27.1724 => 26.8114, std.dev.: 0.0335) SingleSource/Benchmarks/Shootout-C++/lists: -1.11% (16.5617 => 16.3783, std.dev.: 0.0523) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.03% (0.9980 => 0.9977, std.dev.: 0.0122) MultiSource/Applications/sqlite3/sqlite3: 2.18% (0.6022 => 0.6153, std.dev.: 0.0087) MultiSource/Benchmarks/McCat/08-main/main: 6.90% (0.1666 => 0.1781, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.97% (0.1554 => 0.1569, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.04% (0.3083 => 0.3051, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.47% (0.2394 => 0.2287, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.50% (0.3175 => 0.3191, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.13% (0.2302 => 0.2230, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel: -4.45% (0.0449 => 0.0429, std.dev.: 0.0010) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -67.78% (0.0090 => 0.0029, std.dev.: 0.0029) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -30.00% (0.0240 => 0.0168, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -33.85% (0.0192 => 0.0127, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.79% (0.0390 => 0.0383, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -23.26% (0.0301 => 0.0231, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.76% (0.0284 => 0.0279, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -6.79% (0.0324 => 0.0302, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0177 => 0.0177, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -39.15% (0.0189 => 0.0115, std.dev.: 0.0051) SingleSource/UnitTests/Vector/multiplies: - (0.0249 => 0.0249, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -14.77% (0.0325 => 0.0277, std.dev.: 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005) MultiSource/Applications/ClamAV/clamscan: 6.58% (0.1429 => 0.1523, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 3.22% (1.5019 => 1.5502, std.dev.: 0.0279) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.13% (0.1501 => 0.1503, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.93% (0.4264 => 0.4011, std.dev.: 0.0192) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.65% (0.1344 => 0.1420, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.53% (0.0589 => 0.0580, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -30.17% (0.0232 => 0.0162, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.92% (0.0639 => 0.0582, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.83% (1.1350 => 1.1256, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.97% (0.0637 => 0.0548, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -44.31% (0.0246 => 0.0137, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.45% (0.7541 => 0.7650, std.dev.: 0.0080) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 10.94% (1.5363 => 1.7043, std.dev.: 0.0011) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 2 10:18:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 2 Oct 2012 12:18:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121002171818.5F9C02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4490?compare_to=4488&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4490, Order: 165017, Start Time: 2012-10-02 16:00:28, End Time: 2012-10-02 17:19:58 To: 4488, Order: 165005, Start Time: 2012-10-02 14:11:48, End Time: 2012-10-02 15:31:19 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (145 on baseline) Performance Improvements: 0 (47 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 951 (695 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.02% (14.7753 => 14.9261, std.dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.59% (1.2907 => 1.3241, std.dev.: 0.0050) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.10% (0.5765 => 0.5759, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: -0.21% (16.0236 => 15.9901, std.dev.: 0.0132) MultiSource/Benchmarks/Bullet/bullet: -0.15% (54.2175 => 54.1376, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/gs/gs: 0.01% (4.3179 => 4.3185, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.86% (0.0463 => 0.0459, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.22% (0.0464 => 0.0463) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.93% (0.0432 => 0.0428, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.69% (0.0433 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.48% (0.0421 => 0.0419) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.71% (0.0423 => 0.0420, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.48% (0.0415 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.72% (0.0416 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.69% (0.0434 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.46% (0.0434 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.70% (0.0428 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.47% (0.0429 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.48% (0.0417 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.48% (0.0419 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.47% (0.0425 => 0.0423, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.70% (0.0427 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.69% (0.0436 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.46% (0.0437 => 0.0435, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.97% (0.0413 => 0.0409, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.72% (0.0414 => 0.0411, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.94% (0.0425 => 0.0421, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.70% (0.0426 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.48% (0.0416 => 0.0414) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.72% (0.0417 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.49% (0.0408 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.49% (0.0409 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.49% (0.0406 => 0.0404, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.49% (0.0408 => 0.0406) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.45% (0.0444 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.45% (0.0445 => 0.0443) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.74% (0.0406 => 0.0403, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.49% (0.0407 => 0.0405) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.74% (0.0407 => 0.0404, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.49% (0.0407 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.48% (0.0414 => 0.0412, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.48% (0.0415 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.05% (1.2298 => 1.2292, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.14% (7.5615 => 7.5510, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.18% (0.7314 => 0.7301, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.83% (0.0362 => 0.0359, std.dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: - (0.1435 => 0.1435, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0652 => 0.0651, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -14.40% (63.2438 => 54.1376, std.dev.: 0.0030) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 30.59% (14.1553 => 18.4860, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++-EH/spirit: 58.22% (3.4629 => 5.4790, std.dev.: 0.0055) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14234.17% (0.0720 => 10.3206, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10004500.00% (0.0001 => 10.0046, std.dev.: 0.0009) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 46.95% (0.2554 => 0.3753, std.dev.: 0.0058) MultiSource/Benchmarks/PAQ8p/paq8p: 43.97% (10.3673 => 14.9261, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 31.01% (0.1622 => 0.2125, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 29.83% (0.1056 => 0.1371, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.14% (2.2022 => 2.5137, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.91% (7.0540 => 8.0355, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 13.76% (0.1432 => 0.1629, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.58% (0.1566 => 0.1763, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.72% (0.3473 => 0.3880, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.61% (1.7609 => 1.9654, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.54% (0.3543 => 0.3952, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.43% (0.3516 => 0.3918, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.43% (0.3543 => 0.3948, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.41% (0.3497 => 0.3896, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.40% (0.3561 => 0.3967, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.13% (0.3694 => 0.4105, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.89% (0.3828 => 0.4245, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/parameter-passing: 10.72% (0.3927 => 0.4348, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.60% (0.3886 => 0.4298, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 9.93% (9.4845 => 10.4265, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 9.75% (10.4361 => 11.4532, std.dev.: 0.0052) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.72% (0.1584 => 0.1738, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 9.55% (0.6030 => 0.6606, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/Hello: 9.47% (0.5925 => 0.6486, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 8.96% (0.3282 => 0.3576, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 8.79% (0.7326 => 0.7970, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.00% (0.1438 => 0.1553, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 7.98% (0.1655 => 0.1787, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.97% (0.4879 => 0.5268, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.93% (0.3177 => 0.3429, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.85% (0.6675 => 0.7199, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 7.84% (0.7115 => 0.7673, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.54% (1.5415 => 1.6577, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 7.45% (0.3422 => 0.3677, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.44% (0.2891 => 0.3106, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 7.42% (0.2831 => 0.3041, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.41% (0.2603 => 0.2796, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 7.38% (0.2725 => 0.2926, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 7.30% (0.3109 => 0.3336, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 7.30% (0.2905 => 0.3117, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 7.26% (0.7433 => 0.7973, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.24% (0.4615 => 0.4949, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.22% (0.2065 => 0.2214, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.14% (0.4636 => 0.4967, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.13% (0.2271 => 0.2433, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 7.11% (5.7591 => 6.1686, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/wc: 7.08% (0.3052 => 0.3268, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.06% (0.3865 => 0.4138, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.04% (0.2756 => 0.2950, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 7.02% (0.1695 => 0.1814, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.02% (0.4103 => 0.4391, std.dev.: 0.0023) MultiSource/Applications/d/make_dparser: 7.01% (3.3354 => 3.5691, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary: 6.99% (0.3232 => 0.3458, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.98% (1.3050 => 1.3961, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.97% (0.2871 => 0.3071, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.92% (0.4203 => 0.4494, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.91% (0.8172 => 0.8737, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.90% (0.5105 => 0.5457, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 6.89% (0.3423 => 0.3659, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.86% (0.2872 => 0.3069, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.86% (0.3136 => 0.3351, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.83% (0.1625 => 0.1736, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.82% (2.0665 => 2.2074, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/moments: 6.82% (0.4048 => 0.4324, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.81% (0.4289 => 0.4581, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.79% (0.3650 => 0.3898, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 6.78% (0.2714 => 0.2898, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.77% (0.3162 => 0.3376, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.77% (0.2793 => 0.2982, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.75% (0.3098 => 0.3307, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.75% (0.2802 => 0.2991, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.74% (0.3307 => 0.3530, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: 6.71% (0.2877 => 0.3070, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.71% (0.5860 => 0.6253, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.68% (8.1363 => 8.6802, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 6.64% (0.6456 => 0.6885, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.62% (4.2646 => 4.5471, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.62% (0.1510 => 0.1610, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.56% (0.4620 => 0.4923, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 6.55% (0.3603 => 0.3839, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 6.54% (0.3684 => 0.3925, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.50% (0.5569 => 0.5931, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.46% (0.3826 => 0.4073, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.44% (0.2700 => 0.2874, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.42% (4.9449 => 5.2625, std.dev.: 0.0102) MultiSource/Applications/spiff/spiff: 6.38% (0.7835 => 0.8335, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.37% (5.0018 => 5.3206, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.33% (0.5020 => 0.5338, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.33% (0.3379 => 0.3593, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.30% (0.9765 => 1.0380, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.27% (0.2758 => 0.2931, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.26% (0.2107 => 0.2239, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 6.26% (1.5603 => 1.6579, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 6.23% (0.3387 => 0.3598, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.22% (0.3121 => 0.3315, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.13% (7.9617 => 8.4496, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.01% (0.8067 => 0.8552, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.93% (0.1940 => 0.2055, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 5.80% (1.1642 => 1.2317, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 5.69% (3.8723 => 4.0925, std.dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: 5.65% (21.9371 => 23.1767, std.dev.: 0.0227) MultiSource/Applications/lemon/lemon: 5.52% (1.0722 => 1.1314, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.35% (0.3441 => 0.3625, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.34% (1.1861 => 1.2494, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 5.28% (0.3180 => 0.3348, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 5.21% (0.4299 => 0.4523) MultiSource/Applications/treecc/treecc: 5.19% (2.0273 => 2.1326, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.07% (0.4064 => 0.4270, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.82% (0.6450 => 0.6761, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.80% (0.8921 => 0.9349, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 4.76% (0.3131 => 0.3280, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 4.73% (2.2969 => 2.4056, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.70% (0.5981 => 0.6262, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 4.63% (1.2842 => 1.3437, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.60% (1.5859 => 1.6588, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.14% (1.4186 => 1.4774, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.04% (2.2024 => 2.2914, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.92% (1.1840 => 1.2304, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.72% (0.3817 => 0.3959, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.00% (0.8101 => 0.8344, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.77% (14.3668 => 14.7649, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.58% (1.1194 => 1.1483, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.17% (17.1811 => 17.5545, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.63% (3.8922 => 3.9556, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 30.45% (1.1277 => 1.4711, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.20% (3.1595 => 3.4501, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 6.75% (1.1396 => 1.2165, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.71% (3.1578 => 3.3696, std.dev.: 0.0021) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.54% (3.6395 => 3.7684, std.dev.: 0.0094) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.68% (4.2280 => 4.3414, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.28% (1.7254 => 1.7648, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (0.8275 => 0.8405, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.50% (1.3045 => 1.3241, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.02% (11.6436 => 11.7619, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1279, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.15% (0.8651 => 0.1717, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.39% (5.2763 => 3.2509, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.85% (5.3855 => 3.6166, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.54% (5.3526 => 3.6110, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -14.78% (54.1659 => 46.1621, std.dev.: 0.0830) MultiSource/Benchmarks/FreeBench/mason/mason: -14.30% (0.0811 => 0.0695, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.18% (2.9384 => 2.6099, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -10.50% (22.1758 => 19.8483, std.dev.: 0.0275) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.44% (1.1492 => 0.7649, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -15.63% (1.6925 => 1.4279, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.63% (0.0998 => 0.0862, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: -12.67% (1.3677 => 1.1944, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -12.12% (1.2373 => 1.0873, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3784, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -10.04% (0.2161 => 0.1944, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.36% (19.9488 => 18.2809, std.dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.65% (0.2497 => 0.2331, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.60% (1.8329 => 1.7119, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8479, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-5: -5.03% (1.5835 => 1.5039, std.dev.: 0.0032) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.98% (1.6805 => 1.5968, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.80% (13.4384 => 12.7938, std.dev.: 0.0277) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.30% (0.3463 => 0.3314, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.15% (0.9957 => 0.9544, std.dev.: 0.0051) MultiSource/Applications/siod/siod: -3.69% (3.2827 => 3.1616, std.dev.: 0.0080) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.41% (32.5116 => 31.4019, std.dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: -2.43% (12.4730 => 12.1695, std.dev.: 0.0014) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.12% (0.4808 => 0.4706, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.08% (8.6802 => 8.4997, std.dev.: 0.0230) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.95% (8.1563 => 7.9973, std.dev.: 0.0154) SingleSource/Benchmarks/Misc/salsa20: -1.76% (10.2830 => 10.1022, std.dev.: 0.0141) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6792, std.dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.54% (2.5528 => 2.5135, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -1.48% (4.6441 => 4.5752, std.dev.: 0.0026) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4234, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8575, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2358, std.dev.: 0.0082) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.14% (0.5229 => 0.5759, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 6.68% (14.9895 => 15.9901, std.dev.: 0.0132) MultiSource/Benchmarks/MallocBench/gs/gs: 5.06% (4.1105 => 4.3185, std.dev.: 0.0107) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.26% (1.1048 => 1.2292, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.49% (7.1582 => 7.5510, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 17.34% (0.6222 => 0.7301, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35800.00% (0.0001 => 0.0359, std.dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: -3.37% (0.1485 => 0.1435, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 2 11:53:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 2 Oct 2012 13:53:25 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121002185325.CC2D62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4491?compare_to=4489&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4491, Order: 165025, Start Time: 2012-10-02 17:26:10, End Time: 2012-10-02 18:55:06 To: 4489, Order: 165017, Start Time: 2012-10-02 15:43:16, End Time: 2012-10-02 17:09:58 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (8 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 5 (59 on baseline) Performance Improvements: 6 (43 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 77 (69 on baseline) Unchanged Tests: 954 (781 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 5.60% (8.3824 => 8.8522, std.dev.: 0.1477) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.59% (1.1910 => 1.2218, std.dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: 6.55% (3.0309 => 3.2295, std.dev.: 0.0765) SingleSource/Benchmarks/Misc/ffbench: 3.66% (1.3570 => 1.4066, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.82% (6.4197 => 6.6009, std.dev.: 0.0390) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc-C++/bigfib: -1.76% (0.5752 => 0.5651, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.39% (0.9021 => 0.8896, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -1.33% (0.7968 => 0.7862, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.16% (13.0556 => 12.9045, std.dev.: 0.0551) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/whetstone: -2.34% (2.4151 => 2.3587, std.dev.: 0.0109) SingleSource/Benchmarks/Misc/mandel-2: -1.22% (3.1270 => 3.0889, std.dev.: 0.0126) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.08% (0.9977 => 1.0085, std.dev.: 0.0120) MultiSource/Applications/sqlite3/sqlite3: -1.53% (0.6153 => 0.6059, std.dev.: 0.0098) MultiSource/Benchmarks/McCat/08-main/main: -0.17% (0.1781 => 0.1778, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.35% (0.1569 => 0.1485, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.21% (0.3051 => 0.3088, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.17% (0.2287 => 0.2283, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.10% (0.3191 => 0.3092, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.85% (0.2230 => 0.2249, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel: -3.03% (0.0429 => 0.0416, std.dev.: 0.0015) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0088 => 0.0088, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: 158.62% (0.0029 => 0.0075, std.dev.: 0.0006) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 39.88% (0.0168 => 0.0235, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 48.82% (0.0127 => 0.0189, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.26% (0.0383 => 0.0382, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 6.93% (0.0231 => 0.0247, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.36% (0.0279 => 0.0278, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 6.29% (0.0302 => 0.0321, std.dev.: 0.0073) SingleSource/UnitTests/Vector/Altivec/casts: -1.13% (0.0177 => 0.0175, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 11.30% (0.0115 => 0.0128, std.dev.: 0.0051) SingleSource/UnitTests/Vector/multiplies: -0.40% (0.0249 => 0.0248, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 16.61% (0.0277 => 0.0323, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005) MultiSource/Applications/ClamAV/clamscan: -4.92% (0.1523 => 0.1448, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 0.39% (0.2290 => 0.2299, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: -6.56% (1.5502 => 1.4485, std.dev.: 0.0308) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.80% (0.1503 => 0.1476, std.dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -0.53% (0.5903 => 0.5872, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: -0.50% (26.9241 => 26.7893, std.dev.: 0.0911) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.00% (0.4011 => 0.4051, std.dev.: 0.0261) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.63% (0.1420 => 0.1429, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.59% (0.0580 => 0.0536, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 26.54% (0.0162 => 0.0205, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.44% (0.0582 => 0.0602, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.54% (1.1256 => 1.1195, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -33.33% (0.0012 => 0.0008, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.55% (0.0548 => 0.0545, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.73% (0.0137 => 0.0136, std.dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.16% (0.7650 => 0.7662, std.dev.: 0.0172) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 0.38% (4.0016 => 4.0170, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -0.01% (59.4340 => 59.4261, std.dev.: 0.2844) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 0.18% (2.9280 => 2.9333, std.dev.: 0.2074) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -3.54% (2.5642 => 2.4735, std.dev.: 0.3770) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.15% (1.7043 => 1.7068, std.dev.: 0.0092) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -48.76% (0.0121 => 0.0062, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt MultiSource/Applications/JM/lencod/lencod: -96.59% (6.7458 => 0.2299, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -91.58% (6.9722 => 0.5872, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/09-vor/vor: 21556.67% (0.1237 => 26.7893, std.dev.: 0.0911) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -1.20% (4.0659 => 4.0170, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.86% (61.1734 => 59.4261, std.dev.: 0.2844) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.35% (3.2007 => 2.9333, std.dev.: 0.2074) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.90% (2.3580 => 2.4735, std.dev.: 0.3770) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.05% (4.1772 => 3.0889, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/except: 82316.67% (0.0006 => 0.4945, std.dev.: 0.0012) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -33.33% (0.0006 => 0.0004, std.dev.: 0.0001) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.01% (0.0745 => 0.0909, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.55% (0.6410 => 0.6894, std.dev.: 0.0051) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.21% (0.1414 => 0.1516, std.dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: 7.02% (2.1763 => 2.3291, std.dev.: 0.0153) SingleSource/Benchmarks/Misc-C++/bigfib: 6.44% (0.5309 => 0.5651, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: 6.04% (0.6173 => 0.6546, std.dev.: 0.0070) MultiSource/Applications/lemon/lemon: 5.79% (1.0046 => 1.0628, std.dev.: 0.0050) MultiSource/Applications/SIBsim4/SIBsim4: 5.35% (1.1653 => 1.2276, std.dev.: 0.0136) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.24% (0.2654 => 0.2793, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.22% (0.2797 => 0.2943, std.dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: 5.15% (0.6915 => 0.7271, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 4.90% (15.3105 => 16.0610, std.dev.: 0.2290) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.89% (0.3582 => 0.3757, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.65% (1.5150 => 1.5854, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.51% (0.2552 => 0.2667, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.47% (0.6069 => 0.6340, std.dev.: 0.0056) MultiSource/Applications/d/make_dparser: 3.75% (3.0225 => 3.1358, std.dev.: 0.0192) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.44% (0.4248 => 0.4394, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.31% (1.1827 => 1.2218, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.16% (0.4880 => 0.5034, std.dev.: 0.0048) MultiSource/Applications/oggenc/oggenc: 3.11% (4.7455 => 4.8929, std.dev.: 0.0466) MultiSource/Benchmarks/mafft/pairlocalalign: 3.05% (8.2186 => 8.4692, std.dev.: 0.0293) MultiSource/Benchmarks/Bullet/bullet: 2.95% (29.3170 => 30.1816, std.dev.: 0.1847) MultiSource/Applications/siod/siod: 2.56% (2.0972 => 2.1508, std.dev.: 0.0173) MultiSource/Benchmarks/Prolangs-C/football/football: 2.51% (0.8405 => 0.8616, std.dev.: 0.0047) MultiSource/Applications/SPASS/SPASS: 2.45% (13.3238 => 13.6497, std.dev.: 0.1217) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.28% (6.2546 => 6.3975, std.dev.: 0.0505) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.19% (1.2021 => 1.2284, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.08% (12.6413 => 12.9045, std.dev.: 0.0551) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.92% (0.5937 => 0.6051, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.86% (3.0758 => 3.1331, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.68% (1.4408 => 1.4650, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.62% (2.0317 => 2.0647, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.48% (1.2742 => 1.2931, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.41% (4.0318 => 4.0888, std.dev.: 0.0168) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.40% (1.6538 => 2.3384, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: 22.10% (3.4629 => 4.2282, std.dev.: 0.0259) MultiSource/Benchmarks/Olden/power/power: 17.81% (1.4184 => 1.6710, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: 15.24% (1.7426 => 2.0082, std.dev.: 0.0208) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.58% (2.4042 => 2.6827, std.dev.: 0.0548) SingleSource/Benchmarks/McGill/queens: 11.11% (1.6261 => 1.8068, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.86% (0.2857 => 0.3110, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: 8.84% (7.0025 => 7.6213, std.dev.: 0.0422) MultiSource/Benchmarks/FreeBench/mason/mason: 8.37% (0.5004 => 0.5423, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.29% (1.0063 => 1.0897, std.dev.: 0.0231) SingleSource/Benchmarks/Stanford/Puzzle: 8.09% (0.1433 => 0.1549, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.74% (3.0256 => 3.2295, std.dev.: 0.0765) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.10% (4.2129 => 4.4698, std.dev.: 0.0762) SingleSource/Benchmarks/Misc/dt: 4.13% (0.9851 => 1.0258, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: 3.72% (92.7467 => 96.1959, std.dev.: 0.5519) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.06% (0.5587 => 0.5758, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.80% (6.6312 => 6.8167, std.dev.: 0.0233) MultiSource/Applications/hexxagon/hexxagon: 2.74% (14.4877 => 14.8852, std.dev.: 0.0442) MultiSource/Applications/siod/siod: 2.72% (3.5520 => 3.6485, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/hash: 2.41% (0.6308 => 0.6460, std.dev.: 0.0042) MultiSource/Benchmarks/mafft/pairlocalalign: 1.81% (62.4126 => 63.5399, std.dev.: 0.2036) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.66% (4.6127 => 4.6892, std.dev.: 0.0281) SingleSource/Benchmarks/Dhrystone/dry: 1.63% (2.4013 => 2.4405, std.dev.: 0.0149) SingleSource/Benchmarks/Misc/fp-convert: 1.35% (15.2242 => 15.4302, std.dev.: 0.0092) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.13% (0.2996 => 0.1614, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -45.18% (0.0591 => 0.0324, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -21.54% (1.4189 => 1.1132, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -20.74% (1.4113 => 1.1186, std.dev.: 0.0122) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.35% (0.3497 => 0.2051, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -34.73% (0.0311 => 0.0203, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -27.30% (15.8312 => 11.5096, std.dev.: 0.1202) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.12% (5.2665 => 4.1541, std.dev.: 0.0802) SingleSource/Benchmarks/Shootout-C++/ary3: -20.24% (1.7473 => 1.3936, std.dev.: 0.0372) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.03% (1.7361 => 1.4751, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/17-bintr/bintr: -13.09% (0.0917 => 0.0797, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1581, std.dev.: 0.0176) MultiSource/Benchmarks/FreeBench/neural/neural: -11.38% (1.0926 => 0.9683, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.68% (1.1647 => 1.0519, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.36% (1.4034 => 1.2861, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: -8.34% (9.5474 => 8.7507, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/bh/bh: -7.53% (2.5166 => 2.3272, std.dev.: 0.0126) MultiSource/Applications/sgefa/sgefa: -7.34% (0.3746 => 0.3471, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.90% (3.6254 => 3.3754, std.dev.: 0.0084) MultiSource/Applications/lambda-0_1_3/lambda: -6.80% (7.6833 => 7.1611, std.dev.: 0.0305) SingleSource/Benchmarks/Shootout-C++/fibo: -6.59% (4.6355 => 4.3300, std.dev.: 0.0312) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.49% (2.0027 => 1.8728, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -6.40% (1.4441 => 1.3517, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.96% (2.9728 => 2.7955, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.49% (3.9413 => 3.7249, std.dev.: 0.0124) MultiSource/Applications/SIBsim4/SIBsim4: -5.45% (3.4230 => 3.2365, std.dev.: 0.0217) MultiSource/Benchmarks/FreeBench/distray/distray: -5.26% (0.2664 => 0.2524, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/fib2: -5.21% (4.4195 => 4.1893, std.dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/n-body: -4.83% (1.5803 => 1.5039, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.75% (0.4564 => 0.4347, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -4.31% (3.4080 => 3.2610, std.dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.39% (9.3855 => 9.0677, std.dev.: 0.0097) SingleSource/Benchmarks/McGill/misr: -3.17% (0.4296 => 0.4160, std.dev.: 0.0028) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.02% (1.2722 => 1.2338, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.86% (3.7496 => 3.6424, std.dev.: 0.0319) SingleSource/Benchmarks/Shootout-C++/methcall: -2.66% (9.2503 => 9.0047, std.dev.: 0.0360) SingleSource/Benchmarks/Shootout-C++/hash2: -1.92% (3.4876 => 3.4205, std.dev.: 0.0059) MultiSource/Benchmarks/sim/sim: -1.91% (3.8907 => 3.8163, std.dev.: 0.0061) MultiSource/Applications/aha/aha: -1.87% (3.4286 => 3.3644, std.dev.: 0.0152) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.86% (2.3569 => 2.3130, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.43% (27.1724 => 26.7826, std.dev.: 0.0335) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3097, std.dev.: 0.0944) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.05% (0.9980 => 1.0085, std.dev.: 0.0120) MultiSource/Applications/sqlite3/sqlite3: 0.61% (0.6022 => 0.6059, std.dev.: 0.0098) MultiSource/Benchmarks/McCat/08-main/main: 6.72% (0.1666 => 0.1778, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.44% (0.1554 => 0.1485, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.16% (0.3083 => 0.3088, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.64% (0.2394 => 0.2283, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.61% (0.3175 => 0.3092, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.30% (0.2302 => 0.2249, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel: -7.35% (0.0449 => 0.0416, std.dev.: 0.0015) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: -16.67% (0.0090 => 0.0075, std.dev.: 0.0006) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -2.08% (0.0240 => 0.0235, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.56% (0.0192 => 0.0189, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.05% (0.0390 => 0.0382, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -17.94% (0.0301 => 0.0247, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.11% (0.0284 => 0.0278, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0324 => 0.0321, std.dev.: 0.0073) SingleSource/UnitTests/Vector/Altivec/casts: -1.13% (0.0177 => 0.0175, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -32.28% (0.0189 => 0.0128, std.dev.: 0.0051) SingleSource/UnitTests/Vector/multiplies: -0.40% (0.0249 => 0.0248, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -0.62% (0.0325 => 0.0323, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005) MultiSource/Applications/ClamAV/clamscan: 1.33% (0.1429 => 0.1448, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: -3.56% (1.5019 => 1.4485, std.dev.: 0.0308) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.67% (0.1501 => 0.1476, std.dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.00% (0.4264 => 0.4051, std.dev.: 0.0261) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.32% (0.1344 => 0.1429, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.00% (0.0589 => 0.0536, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -11.64% (0.0232 => 0.0205, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.79% (0.0639 => 0.0602, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.37% (1.1350 => 1.1195, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 33.33% (0.0006 => 0.0008, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.44% (0.0637 => 0.0545, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -44.72% (0.0246 => 0.0136, std.dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.60% (0.7541 => 0.7662, std.dev.: 0.0172) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.10% (1.5363 => 1.7068, std.dev.: 0.0092) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -11.43% (0.0070 => 0.0062, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 2 12:06:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 2 Oct 2012 14:06:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121002190650.1A25C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4492?compare_to=4490&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4492, Order: 165025, Start Time: 2012-10-02 17:49:05, End Time: 2012-10-02 19:08:30 To: 4490, Order: 165017, Start Time: 2012-10-02 16:00:28, End Time: 2012-10-02 17:19:58 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (143 on baseline) Performance Improvements: 3 (47 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 949 (697 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.70% (54.5451 => 56.5652, std.dev.: 0.0595) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.22% (3.6166 => 3.5723, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.13% (3.6110 => 3.5703, std.dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.55% (1.3241 => 1.2903, std.dev.: 0.0098) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.52% (0.5759 => 0.5729, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: -0.36% (15.9901 => 15.9333, std.dev.: 0.0129) MultiSource/Benchmarks/Bullet/bullet: -0.40% (54.1376 => 53.9208, std.dev.: 0.0339) MultiSource/Benchmarks/MallocBench/gs/gs: -0.41% (4.3185 => 4.3010, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.22% (0.0459 => 0.0458, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.86% (0.0463 => 0.0459, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.23% (0.0428 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.23% (0.0430 => 0.0429) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.48% (0.0419 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.24% (0.0420 => 0.0419) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.24% (0.0413 => 0.0412, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0413 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.70% (0.0431 => 0.0428, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.46% (0.0432 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.47% (0.0425 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.47% (0.0427 => 0.0425) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.24% (0.0415 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.48% (0.0417 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.71% (0.0423 => 0.0420, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.47% (0.0424 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.23% (0.0433 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.23% (0.0435 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0409 => 0.0409) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.24% (0.0411 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0421 => 0.0421, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.24% (0.0423 => 0.0422, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.48% (0.0414 => 0.0412) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.24% (0.0414 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.49% (0.0406 => 0.0404, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.49% (0.0407 => 0.0405, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.25% (0.0404 => 0.0403, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.25% (0.0406 => 0.0405, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.45% (0.0442 => 0.0440, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.45% (0.0443 => 0.0441) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0403 => 0.0403, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.49% (0.0405 => 0.0403, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.25% (0.0404 => 0.0403, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.25% (0.0405 => 0.0404, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.24% (0.0412 => 0.0411, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.24% (0.0413 => 0.0412, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.34% (1.2292 => 1.2250, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.21% (7.5510 => 7.5349, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.22% (0.7301 => 0.7285, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.28% (0.0359 => 0.0358, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: - (0.1435 => 0.1435) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.61% (0.0651 => 0.0655, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -14.74% (63.2438 => 53.9208, std.dev.: 0.0339) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 30.18% (14.1553 => 18.4270, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++-EH/spirit: 57.75% (3.4629 => 5.4628, std.dev.: 0.0055) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14246.25% (0.0720 => 10.3293, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10007200.00% (0.0001 => 10.0073, std.dev.: 0.0044) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 45.73% (0.2554 => 0.3722, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 43.21% (10.3673 => 14.8468, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/distray/distray: 29.07% (0.1056 => 0.1363, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 28.24% (0.1622 => 0.2080, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.21% (2.2022 => 2.4932, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.04% (7.0540 => 7.9736, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/flops: 12.99% (0.1432 => 0.1618, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.07% (0.1566 => 0.1755, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.81% (1.7609 => 1.9512, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 10.77% (0.3473 => 0.3847, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.58% (0.3543 => 0.3918, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.52% (0.3497 => 0.3865, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.41% (0.3543 => 0.3912, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.36% (0.3561 => 0.3930, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 10.32% (0.3516 => 0.3879, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.10% (0.3694 => 0.4067, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.06% (0.3927 => 0.4322, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 9.85% (0.3828 => 0.4205, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 9.65% (10.4361 => 11.4437, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/property: 9.62% (0.3886 => 0.4260, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.53% (0.1584 => 0.1735) MultiSource/Benchmarks/mafft/pairlocalalign: 9.40% (9.4845 => 10.3759, std.dev.: 0.0044) SingleSource/UnitTests/ObjC++/Hello: 9.15% (0.5925 => 0.6467, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 8.97% (0.6030 => 0.6571, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 8.59% (0.3282 => 0.3564, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 8.09% (0.7326 => 0.7919, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/chomp: 7.92% (0.1655 => 0.1786, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.48% (0.6675 => 0.7174, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 7.46% (0.7115 => 0.7646, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.37% (0.3177 => 0.3411, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.32% (0.4879 => 0.5236, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.29% (1.5415 => 1.6539, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.26% (0.2603 => 0.2792, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 7.13% (0.7433 => 0.7963, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 7.08% (0.3109 => 0.3329, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.06% (0.2891 => 0.3095, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.99% (0.2905 => 0.3108, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 6.98% (0.3422 => 0.3661, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.98% (0.4615 => 0.4937, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 6.84% (0.1695 => 0.1811, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 6.82% (5.7591 => 6.1518, std.dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.79% (0.4636 => 0.4951, std.dev.: 0.0119) MultiSource/Applications/d/make_dparser: 6.76% (3.3354 => 3.5609, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.75% (0.3052 => 0.3258, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.73% (0.2065 => 0.2204, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.71% (0.3650 => 0.3895, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.70% (0.3136 => 0.3346, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.69% (0.2271 => 0.2423, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.65% (0.4103 => 0.4376, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 6.65% (0.2871 => 0.3062, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/strcat: 6.61% (0.2831 => 0.3018, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.59% (0.4203 => 0.4480, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.58% (0.5105 => 0.5441, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 6.57% (0.3423 => 0.3648, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.56% (2.0665 => 2.2020, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.54% (1.3050 => 1.3903, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/fibo: 6.53% (0.2725 => 0.2903, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.53% (0.2756 => 0.2936, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.51% (0.4289 => 0.4568, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 6.50% (0.3232 => 0.3442, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.46% (0.1625 => 0.1730, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.44% (0.3865 => 0.4114, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.44% (0.2872 => 0.3057, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.42% (0.5860 => 0.6236, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 6.39% (0.3098 => 0.3296, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.34% (0.2793 => 0.2970, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.33% (4.2646 => 4.5346, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/ary3: 6.31% (0.3283 => 0.3490, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.30% (0.2714 => 0.2885, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.30% (0.2700 => 0.2870, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.29% (0.2877 => 0.3058, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.29% (0.8172 => 0.8686, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: 6.28% (0.2802 => 0.2978, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.27% (0.3826 => 0.4066, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.27% (0.3603 => 0.3829, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.26% (0.3162 => 0.3360, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.23% (0.3307 => 0.3513, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 6.23% (0.6456 => 0.6858, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 6.23% (0.4048 => 0.4300, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.18% (5.0018 => 5.3111, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.17% (8.1363 => 8.6384, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.07% (4.9449 => 5.2453, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 6.06% (0.4620 => 0.4900, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.03% (0.5569 => 0.5905, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 6.03% (0.3684 => 0.3906, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.00% (0.9765 => 1.0351, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.96% (0.5020 => 0.5319, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.93% (0.2107 => 0.2232, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.91% (0.2758 => 0.2921, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 5.91% (0.7835 => 0.8298, std.dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.83% (0.3121 => 0.3303, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 5.76% (0.3387 => 0.3582, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.73% (0.8067 => 0.8529, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 5.68% (1.5603 => 1.6490, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary2: 5.68% (0.3379 => 0.3571, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.67% (0.1940 => 0.2050, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 5.57% (1.1642 => 1.2291, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.56% (7.9617 => 8.4042, std.dev.: 0.0070) MultiSource/Applications/lua/lua: 5.39% (3.8723 => 4.0810, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 5.34% (1.0722 => 1.1295, std.dev.: 0.0053) MultiSource/Applications/JM/lencod/lencod: 5.14% (21.9371 => 23.0640, std.dev.: 0.0091) MultiSource/Benchmarks/McCat/09-vor/vor: 5.09% (0.3180 => 0.3342, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.01% (1.1861 => 1.2455, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 5.00% (0.4299 => 0.4514, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 4.95% (2.0273 => 2.1277, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.91% (0.3441 => 0.3610, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.62% (0.6450 => 0.6748, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.58% (0.4064 => 0.4250, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 4.50% (0.8921 => 0.9322, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 4.47% (2.2969 => 2.3995, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 4.41% (0.3131 => 0.3269, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.30% (0.5981 => 0.6238, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.18% (1.5859 => 1.6522, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.14% (1.2842 => 1.3374, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.83% (1.4186 => 1.4729, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.62% (2.2024 => 2.2821, std.dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 3.51% (1.1840 => 1.2256, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.75% (0.8101 => 0.8324, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.75% (0.3817 => 0.3922, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.65% (14.3668 => 14.7472, std.dev.: 0.0102) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.05% (1.1194 => 1.1424, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.99% (17.1811 => 17.5235, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.10% (3.8922 => 3.9350, std.dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 30.46% (1.1277 => 1.4712, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.25% (1.1145 => 1.3848, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.23% (3.1595 => 3.4511, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3691, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 6.56% (1.1396 => 1.2144, std.dev.: 0.0010) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.42% (3.6395 => 3.7639, std.dev.: 0.0084) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.85% (4.2280 => 4.3485, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.33% (1.7254 => 1.7656, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.02% (11.6436 => 11.7627, std.dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1275, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.40% (0.8651 => 0.1696, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.48% (5.2763 => 3.2461, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.67% (5.3855 => 3.5723, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -33.30% (5.3526 => 3.5703, std.dev.: 0.0028) SingleSource/UnitTests/Vector/constpool: -14.79% (54.1659 => 46.1554, std.dev.: 0.0077) MultiSource/Benchmarks/FreeBench/mason/mason: -14.67% (0.0811 => 0.0692, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.43% (2.9384 => 2.6024, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -10.76% (22.1758 => 19.7896, std.dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.44% (1.1492 => 0.7649, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.80% (1.6925 => 1.4251, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.43% (0.0998 => 0.0864, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -12.67% (1.3677 => 1.1944, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -11.81% (1.2373 => 1.0912, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/mandel-2: -10.32% (1.5373 => 1.3787, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -10.09% (0.2161 => 0.1943, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.41% (19.9488 => 18.2721, std.dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.70% (1.8329 => 1.7101, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.65% (0.2497 => 0.2331, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.36% (13.4384 => 12.7176, std.dev.: 0.0664) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.96% (1.6805 => 1.5971, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: -4.66% (1.5835 => 1.5097, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.30% (0.3463 => 0.3314) MultiSource/Applications/siod/siod: -3.63% (3.2827 => 3.1635, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.62% (0.9957 => 0.9597, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.43% (32.5116 => 31.3964, std.dev.: 0.0060) MultiSource/Applications/hexxagon/hexxagon: -2.42% (12.4730 => 12.1706, std.dev.: 0.0021) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.05% (8.6802 => 8.5026, std.dev.: 0.0160) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0869, std.dev.: 0.0073) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.85% (8.1563 => 8.0056, std.dev.: 0.0073) SingleSource/UnitTests/Vector/multiplies: -1.79% (2.5528 => 2.5072, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6813, std.dev.: 0.0028) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4212, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: -1.49% (4.6441 => 4.5751, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/lists: -1.16% (6.2999 => 6.2270, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8573, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.04% (1.0313 => 1.0206, std.dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.56% (0.5229 => 0.5729, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 6.30% (14.9895 => 15.9333, std.dev.: 0.0129) MultiSource/Benchmarks/MallocBench/gs/gs: 4.63% (4.1105 => 4.3010, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.88% (1.1048 => 1.2250, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.26% (7.1582 => 7.5349, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++/stepanov_container: 17.08% (0.6222 => 0.7285, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35700.00% (0.0001 => 0.0358, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.37% (0.1485 => 0.1435) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.05% (0.2116 => 0.0655, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 2 13:25:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 2 Oct 2012 15:25:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121002202547.ABA922A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4493?compare_to=4482&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4493, Order: 165025, Start Time: 2012-10-02 17:18:21, End Time: 2012-10-02 20:27:27 To: 4482, Order: 164993, Start Time: 2012-10-02 09:57:02, End Time: 2012-10-02 13:06:05 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 2 (132 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (131 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1037 (760 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.26% (1.7328 => 1.7546, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.33% (2.7898 => 2.8269, std.dev.: 0.0052) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.02% (9.8110 => 9.8095, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.02% (9.4128 => 9.4111, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.05% (16.9349 => 16.9271, std.dev.: 0.0027) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.51% (0.3446 => 0.3877, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 12.47% (0.3465 => 0.3897, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.46% (0.3442 => 0.3871, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.44% (0.3488 => 0.3922, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: 12.37% (0.3460 => 0.3888, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.36% (0.3496 => 0.3928, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.28% (0.3469 => 0.3895, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.97% (0.3650 => 0.4087, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.97% (0.3643 => 0.4079, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.79% (0.3724 => 0.4163, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.63% (0.1063 => 0.1176, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 10.13% (1.5932 => 1.7546, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.96% (0.5826 => 0.6406, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 9.85% (0.5889 => 0.6469, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 8.59% (0.1619 => 0.1758, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 8.37% (0.1218 => 0.1320, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 8.19% (0.7171 => 0.7758, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.11% (0.2738 => 0.2960, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.07% (0.2875 => 0.3107, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 8.03% (0.2566 => 0.2772, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.01% (1.3152 => 1.4205, std.dev.: 0.0050) SingleSource/Regression/C++/ofstream_ctor: 7.86% (0.3004 => 0.3240, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.83% (0.4994 => 0.5385, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.72% (0.5000 => 0.5386, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.67% (0.2750 => 0.2961, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.67% (0.2725 => 0.2934, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.67% (0.3195 => 0.3440, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.66% (0.2714 => 0.2922, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.56% (1.6211 => 1.7437, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 7.55% (0.9909 => 1.0657, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 7.55% (0.2823 => 0.3036, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.51% (0.2729 => 0.2934, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.48% (0.3060 => 0.3289, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/methcall: 7.47% (0.2813 => 0.3023, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/random: 7.46% (0.2803 => 0.3012, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.45% (2.0673 => 2.2214, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.45% (0.2014 => 0.2164, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 7.43% (0.3096 => 0.3326, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.41% (3.5627 => 3.8267, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: 7.41% (0.2780 => 0.2986, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.38% (0.2792 => 0.2998, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.35% (0.2911 => 0.3125, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.35% (0.1620 => 0.1739, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.31% (0.4361 => 0.4680, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 7.29% (0.2811 => 0.3016, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.20% (0.3362 => 0.3604, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.16% (0.1968 => 0.2109, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 7.13% (0.3267 => 0.3500, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.09% (0.3258 => 0.3489, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.03% (0.3625 => 0.3880, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 7.03% (5.5417 => 5.9312, std.dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.99% (2.7292 => 2.9199, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.95% (0.3282 => 0.3510, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.95% (0.3124 => 0.3341, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.92% (0.3845 => 0.4111, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/moments: 6.88% (0.3678 => 0.3931, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 6.87% (0.3317 => 0.3545, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 6.82% (0.3726 => 0.3980, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 6.81% (0.3348 => 0.3576, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 6.75% (23.5202 => 25.1084, std.dev.: 0.0088) MultiSource/Applications/d/make_dparser: 6.74% (1.0781 => 1.1508, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.72% (0.3930 => 0.4194, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 6.64% (0.3477 => 0.3708, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.61% (0.5026 => 0.5358, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.42% (0.5900 => 0.6279, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.40% (0.3690 => 0.3926, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.35% (0.4251 => 0.4521, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.34% (0.4146 => 0.4409, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.33% (0.4139 => 0.4401, std.dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: 6.24% (4.2109 => 4.4737, std.dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: 6.22% (2.1013 => 2.2319, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.21% (0.2736 => 0.2906, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.05% (0.3981 => 0.4222, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.05% (0.3903 => 0.4139, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.04% (0.2866 => 0.3039, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 6.02% (0.2691 => 0.2853, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 5.94% (1.8794 => 1.9910, std.dev.: 0.0017) MultiSource/Applications/spiff/spiff: 5.93% (0.4029 => 0.4268, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.87% (4.4195 => 4.6789, std.dev.: 0.0040) MultiSource/Applications/siod/siod: 5.83% (0.6634 => 0.7021, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 5.77% (0.5012 => 0.5301, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.72% (0.6435 => 0.6803, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.61% (0.2068 => 0.2184, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.60% (0.3890 => 0.4108, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.59% (0.3271 => 0.3454, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.52% (0.2737 => 0.2888, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 5.50% (4.6177 => 4.8718, std.dev.: 0.0037) MultiSource/Applications/lua/lua: 5.50% (1.4269 => 1.5054, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.38% (0.3084 => 0.3250, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 5.35% (2.1653 => 2.2811, std.dev.: 0.0024) MultiSource/Applications/hbd/hbd: 5.29% (0.9697 => 1.0210, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 5.25% (0.5546 => 0.5837, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.22% (0.4658 => 0.4901, std.dev.: 0.0025) MultiSource/Applications/minisat/minisat: 5.22% (0.3336 => 0.3510, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.17% (1.9694 => 2.0712, std.dev.: 0.0014) MultiSource/Applications/treecc/treecc: 4.99% (0.7875 => 0.8268, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.93% (1.9966 => 2.0951, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.88% (0.2969 => 0.3114, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.76% (0.2103 => 0.2203, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 4.46% (2.0346 => 2.1253, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 4.39% (0.4847 => 0.5060, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.96% (0.7426 => 0.7720, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.75% (0.5361 => 0.5562, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.47% (0.5584 => 0.5778, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.35% (11.6398 => 12.0301, std.dev.: 0.0078) MultiSource/Applications/lambda-0_1_3/lambda: 3.32% (0.3498 => 0.3614, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.27% (0.3792 => 0.3916, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.24% (0.4253 => 0.4391, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.22% (4.6926 => 4.8437, std.dev.: 0.0032) MultiSource/Applications/kimwitu++/kc: 2.21% (11.9555 => 12.2199, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 5.76% (3.3903 => 3.5857, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6706, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-2: 5.08% (1.8057 => 1.8975, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1651, std.dev.: 0.0060) SingleSource/Benchmarks/Dhrystone/dry: 4.25% (14.0481 => 14.6445, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2092, std.dev.: 0.0434) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5045, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.81% (2.0820 => 2.1197, std.dev.: 0.0072) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.67% (3.1722 => 3.2251, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2866, std.dev.: 0.0020) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.13% (6.9584 => 7.0367, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5903, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.05% (105.3826 => 106.4876, std.dev.: 0.0084) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5622, std.dev.: 0.0216) SingleSource/Benchmarks/Shootout-C++/ary2: -10.12% (0.2402 => 0.2159, std.dev.: 0.0039) MultiSource/Applications/sgefa/sgefa: -9.24% (1.5554 => 1.4117, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9764, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.66% (35.5013 => 32.7829, std.dev.: 0.0156) MultiSource/Benchmarks/Olden/tsp/tsp: -7.31% (2.1113 => 1.9570, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -5.82% (3.3665 => 3.1705, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7974, std.dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.14% (21.9346 => 21.2457, std.dev.: 0.1237) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7738, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5190, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.96% (0.6293 => 0.6107, std.dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/fldry: -2.36% (17.2379 => 16.8305, std.dev.: 0.0206) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5725, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0427, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 2 13:36:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 2 Oct 2012 15:36:42 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121002203642.23E6B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4494?compare_to=4491&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4494, Order: 165030, Start Time: 2012-10-02 19:11:45, End Time: 2012-10-02 20:38:22 To: 4491, Order: 165025, Start Time: 2012-10-02 17:26:10, End Time: 2012-10-02 18:55:06 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (8 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 12 (71 on baseline) Performance Improvements: 1 (44 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 77 (69 on baseline) Unchanged Tests: 952 (768 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.15% (0.2234 => 0.2349, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.01% (0.7648 => 0.8031, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.95% (0.8984 => 0.9249, std.dev.: 0.0092) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.65% (6.3975 => 6.5030, std.dev.: 0.0138) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.63% (1.1132 => 1.1313, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.41% (12.9045 => 13.0863, std.dev.: 0.0264) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.30% (4.0888 => 4.1421, std.dev.: 0.0066) MultiSource/Benchmarks/nbench/nbench: 1.21% (1.1102 => 1.1236, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.04% (1.2284 => 1.2412, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.20% (0.3365 => 0.3540, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.17% (2.6827 => 2.7945, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/ffbench: 1.05% (1.4066 => 1.4214, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -1.32% (9.0047 => 8.8862, std.dev.: 0.0425) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.37% (1.0085 => 1.0122, std.dev.: 0.0155) MultiSource/Applications/sqlite3/sqlite3: 1.29% (0.6059 => 0.6137, std.dev.: 0.0100) MultiSource/Benchmarks/McCat/08-main/main: -0.51% (0.1778 => 0.1769, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.82% (0.1485 => 0.1512, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.36% (0.3088 => 0.3130, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.22% (0.2283 => 0.2288, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.52% (0.3092 => 0.3170, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.29% (0.2249 => 0.2278, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel: -0.24% (0.0416 => 0.0415, std.dev.: 0.0040) SingleSource/UnitTests/2003-05-07-VarArgs: -1.14% (0.0088 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: 20.00% (0.0075 => 0.0090, std.dev.: 0.0007) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -31.06% (0.0235 => 0.0162, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 3.17% (0.0189 => 0.0195, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -20.16% (0.0382 => 0.0305, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 7.29% (0.0247 => 0.0265, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.52% (0.0278 => 0.0285, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -19.31% (0.0321 => 0.0259, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/casts: -9.14% (0.0175 => 0.0159, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/test1: -7.03% (0.0128 => 0.0119, std.dev.: 0.0035) SingleSource/UnitTests/Vector/multiplies: 0.81% (0.0248 => 0.0250, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -11.15% (0.0323 => 0.0287, std.dev.: 0.0017) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005) MultiSource/Applications/ClamAV/clamscan: 0.90% (0.1448 => 0.1461, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: -0.30% (0.2299 => 0.2292, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 4.56% (1.4485 => 1.5146, std.dev.: 0.0203) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.41% (0.1476 => 0.1482, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/Bullet/bullet: 0.15% (0.5872 => 0.5881, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -0.23% (26.7893 => 26.7274, std.dev.: 0.2864) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.26% (0.4051 => 0.4000, std.dev.: 0.0145) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.29% (0.1429 => 0.1382, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.56% (0.0536 => 0.0533, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 16.10% (0.0205 => 0.0238, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.30% (0.0602 => 0.0664, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.05% (1.1195 => 1.1313, std.dev.: 0.0130) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 50.00% (0.0008 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.11% (0.0545 => 0.0611, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 50.74% (0.0136 => 0.0205, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.17% (0.7662 => 0.7649, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 0.10% (4.0170 => 4.0212, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 0.08% (59.4261 => 59.4742, std.dev.: 0.6905) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -0.61% (2.9333 => 2.9153, std.dev.: 0.0387) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -6.36% (2.4735 => 2.3161, std.dev.: 0.0766) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 0.04% (1.7068 => 1.7074, std.dev.: 0.0050) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -16.13% (0.0062 => 0.0052, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt MultiSource/Applications/JM/lencod/lencod: -96.60% (6.7458 => 0.2292, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -91.57% (6.9722 => 0.5881, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/09-vor/vor: 21506.63% (0.1237 => 26.7274, std.dev.: 0.2864) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -1.10% (4.0659 => 4.0212, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.78% (61.1734 => 59.4742, std.dev.: 0.6905) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.92% (3.2007 => 2.9153, std.dev.: 0.0387) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -1.78% (2.3580 => 2.3161, std.dev.: 0.0766) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -27.02% (4.1772 => 3.0487, std.dev.: 0.0617) SingleSource/Benchmarks/Shootout-C++/except: 82616.67% (0.0006 => 0.4963, std.dev.: 0.0070) SingleSource/Regression/C++/EH/ctor_dtor_count: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/exception_spec_test: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.52% (0.0745 => 0.0883, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: 8.73% (2.1763 => 2.3663, std.dev.: 0.0237) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.63% (0.1159 => 0.1259, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.27% (0.6410 => 0.6940, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/bigfib: 8.16% (0.5309 => 0.5742, std.dev.: 0.0043) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.06% (0.1414 => 0.1528, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.29% (0.3582 => 0.3843, std.dev.: 0.0034) MultiSource/Applications/minisat/minisat: 6.95% (0.6173 => 0.6602, std.dev.: 0.0086) MultiSource/Applications/lemon/lemon: 6.31% (1.0046 => 1.0680, std.dev.: 0.0053) MultiSource/Applications/SIBsim4/SIBsim4: 6.13% (1.1653 => 1.2367, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.92% (0.2654 => 0.2811, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.66% (1.5150 => 1.6008, std.dev.: 0.0113) MultiSource/Applications/kimwitu++/kc: 5.34% (15.3105 => 16.1287, std.dev.: 0.2216) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.31% (0.6069 => 0.6391, std.dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: 4.87% (0.6915 => 0.7252, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.43% (0.2797 => 0.2921, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.43% (0.2552 => 0.2665, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.41% (0.7639 => 0.7976, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.21% (0.7226 => 0.7530, std.dev.: 0.0118) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.00% (0.7722 => 0.8031, std.dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.97% (6.2546 => 6.5030, std.dev.: 0.0138) MultiSource/Applications/d/make_dparser: 3.94% (3.0225 => 3.1416, std.dev.: 0.0293) MultiSource/Benchmarks/nbench/nbench: 3.84% (1.0821 => 1.1236, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.59% (0.4880 => 0.5055, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.58% (0.4248 => 0.4400, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.52% (12.6413 => 13.0863, std.dev.: 0.0264) MultiSource/Applications/siod/siod: 3.38% (2.0972 => 2.1681, std.dev.: 0.0164) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.25% (1.2021 => 1.2412, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 3.10% (8.2186 => 8.4734, std.dev.: 0.0583) MultiSource/Applications/oggenc/oggenc: 3.03% (4.7455 => 4.8895, std.dev.: 0.0170) MultiSource/Benchmarks/Bullet/bullet: 2.92% (29.3170 => 30.1727, std.dev.: 0.1832) MultiSource/Applications/SPASS/SPASS: 2.87% (13.3238 => 13.7061, std.dev.: 0.0883) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.80% (0.8569 => 0.8809, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.78% (1.4408 => 1.4808, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.74% (4.0318 => 4.1421, std.dev.: 0.0066) MultiSource/Applications/lua/lua: 2.62% (3.5980 => 3.6924, std.dev.: 0.0213) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.32% (0.5636 => 0.5767, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 2.18% (14.7256 => 15.0459, std.dev.: 0.1198) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.13% (1.2742 => 1.3014, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.46% (1.6538 => 2.3395, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/matrix: 22.12% (3.4629 => 4.2290, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/power/power: 17.81% (1.4184 => 1.6710, std.dev.: 0.0041) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 16.68% (0.0917 => 0.1070, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.23% (2.4042 => 2.7945, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout/ary3: 14.90% (1.7426 => 2.0022, std.dev.: 0.0555) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.10% (0.0766 => 0.0874, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/queens: 11.08% (1.6261 => 1.8063, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/mason/mason: 9.99% (0.5004 => 0.5504, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: 9.17% (7.0025 => 7.6444, std.dev.: 0.0306) SingleSource/Benchmarks/Stanford/Puzzle: 9.14% (0.1433 => 0.1564, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.10% (0.2857 => 0.3117, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.21% (1.0063 => 1.0889, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.24% (0.3301 => 0.3540, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 6.37% (21.1721 => 22.5198, std.dev.: 0.4336) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.13% (4.2129 => 4.4713, std.dev.: 0.0480) SingleSource/Benchmarks/Misc/dt: 4.51% (0.9851 => 1.0295, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 3.66% (92.7467 => 96.1454, std.dev.: 0.4346) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.97% (0.5587 => 0.5753, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 2.95% (14.4877 => 14.9144, std.dev.: 0.0702) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.87% (6.6312 => 6.8213, std.dev.: 0.0026) MultiSource/Applications/siod/siod: 2.56% (3.5520 => 3.6428, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/hash: 2.39% (0.6308 => 0.6459, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.36% (4.6127 => 4.7214, std.dev.: 0.0251) SingleSource/Benchmarks/Dhrystone/dry: 2.17% (2.4013 => 2.4535, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.07% (2.6656 => 2.7208, std.dev.: 0.0076) MultiSource/Applications/lua/lua: 1.72% (29.5232 => 30.0310, std.dev.: 0.1109) SingleSource/Benchmarks/Misc/fp-convert: 1.48% (15.2242 => 15.4500, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.46% (1.6110 => 1.6346, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.40% (22.3381 => 22.6511, std.dev.: 0.0855) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.40% (2.4455 => 2.4797, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/whetstone: 1.22% (2.3453 => 2.3740, std.dev.: 0.0092) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.67% (0.0591 => 0.0327, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -44.43% (0.2996 => 0.1665, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.27% (1.4189 => 1.1313, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.82% (1.4113 => 1.1316, std.dev.: 0.0089) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.84% (0.3497 => 0.2069, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -32.80% (0.0311 => 0.0209, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -27.29% (15.8312 => 11.5107, std.dev.: 0.1007) SingleSource/Benchmarks/CoyoteBench/lpbench: -19.34% (5.2665 => 4.2482, std.dev.: 0.0457) SingleSource/Benchmarks/Shootout-C++/ary3: -18.55% (1.7473 => 1.4232, std.dev.: 0.0238) SingleSource/Benchmarks/Shootout-C++/ackermann: -15.95% (3.6023 => 3.0279, std.dev.: 0.1976) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.18% (1.7361 => 1.4726, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1608, std.dev.: 0.0306) MultiSource/Benchmarks/FreeBench/neural/neural: -11.91% (1.0926 => 0.9625, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.96% (1.1647 => 1.0487, std.dev.: 0.0091) MultiSource/Applications/sgefa/sgefa: -8.49% (0.3746 => 0.3428, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: -8.44% (9.5474 => 8.7412, std.dev.: 0.0112) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2859, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/bh/bh: -7.38% (2.5166 => 2.3308, std.dev.: 0.0444) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.83% (3.6254 => 3.3777, std.dev.: 0.0520) MultiSource/Applications/lambda-0_1_3/lambda: -6.74% (7.6833 => 7.1653, std.dev.: 0.0077) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.48% (2.0027 => 1.8729, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: -6.35% (4.6355 => 4.3410, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/richards_benchmark: -6.22% (1.4441 => 1.3543, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.00% (2.9728 => 2.7944, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/distray/distray: -5.78% (0.2664 => 0.2510, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.46% (3.9413 => 3.7261, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: -5.36% (3.4230 => 3.2394, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.28% (0.4564 => 0.4323, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/fib2: -5.17% (4.4195 => 4.1912, std.dev.: 0.0127) SingleSource/Benchmarks/BenchmarkGame/n-body: -4.89% (1.5803 => 1.5031, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -4.20% (3.4080 => 3.2650, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/methcall: -3.94% (9.2503 => 8.8862, std.dev.: 0.0425) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.72% (45.4683 => 43.7761, std.dev.: 0.6011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.60% (9.3855 => 9.0479, std.dev.: 0.0199) SingleSource/Benchmarks/McGill/misr: -3.26% (0.4296 => 0.4156, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.40% (3.7496 => 3.6595, std.dev.: 0.0281) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.38% (1.1683 => 1.1405, std.dev.: 0.0104) MultiSource/Applications/aha/aha: -2.02% (3.4286 => 3.3593, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/hash2: -2.02% (3.4876 => 3.4172, std.dev.: 0.0154) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.85% (2.3569 => 2.3134, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3180, std.dev.: 0.0164) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.34% (27.1724 => 26.8080, std.dev.: 0.0373) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.24% (2.4457 => 2.4154, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.42% (0.9980 => 1.0122, std.dev.: 0.0155) MultiSource/Applications/sqlite3/sqlite3: 1.91% (0.6022 => 0.6137, std.dev.: 0.0100) MultiSource/Benchmarks/McCat/08-main/main: 6.18% (0.1666 => 0.1769, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.70% (0.1554 => 0.1512, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.52% (0.3083 => 0.3130, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.43% (0.2394 => 0.2288, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.16% (0.3175 => 0.3170, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (0.2302 => 0.2278, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel: -7.57% (0.0449 => 0.0415, std.dev.: 0.0040) SingleSource/UnitTests/2003-05-07-VarArgs: -2.25% (0.0089 => 0.0087, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0007) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -32.50% (0.0240 => 0.0162, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.56% (0.0192 => 0.0195, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -21.79% (0.0390 => 0.0305, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -11.96% (0.0301 => 0.0265, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.35% (0.0284 => 0.0285, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -20.06% (0.0324 => 0.0259, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/casts: -10.17% (0.0177 => 0.0159, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/test1: -37.04% (0.0189 => 0.0119, std.dev.: 0.0035) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0249 => 0.0250, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -11.69% (0.0325 => 0.0287, std.dev.: 0.0017) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005) MultiSource/Applications/ClamAV/clamscan: 2.24% (0.1429 => 0.1461, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 0.85% (1.5019 => 1.5146, std.dev.: 0.0203) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.27% (0.1501 => 0.1482, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.19% (0.4264 => 0.4000, std.dev.: 0.0145) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.83% (0.1344 => 0.1382, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.51% (0.0589 => 0.0533, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.59% (0.0232 => 0.0238, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.91% (0.0639 => 0.0664, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.33% (1.1350 => 1.1313, std.dev.: 0.0130) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.08% (0.0637 => 0.0611, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.67% (0.0246 => 0.0205, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.43% (0.7541 => 0.7649, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 11.14% (1.5363 => 1.7074, std.dev.: 0.0050) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -25.71% (0.0070 => 0.0052, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 2 13:55:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 2 Oct 2012 15:55:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121002205526.DD9072A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4495?compare_to=4492&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4495, Order: 165032, Start Time: 2012-10-02 19:37:42, End Time: 2012-10-02 20:57:06 To: 4492, Order: 165025, Start Time: 2012-10-02 17:49:05, End Time: 2012-10-02 19:08:30 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (145 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 951 (697 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.61% (78.4602 => 81.2956, std.dev.: 0.2394) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.36% (1.2903 => 1.3078, std.dev.: 0.0023) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.05% (0.5729 => 0.5732, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -0.00% (15.9333 => 15.9328, std.dev.: 0.0117) MultiSource/Benchmarks/Bullet/bullet: 0.15% (53.9208 => 54.0040, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/gs/gs: 0.10% (4.3010 => 4.3055, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.22% (0.0458 => 0.0457, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0459 => 0.0459) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0427 => 0.0427, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0429 => 0.0429, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0417 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.24% (0.0419 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.24% (0.0412 => 0.0411, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.24% (0.0413 => 0.0412, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.23% (0.0428 => 0.0429, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0430 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0423 => 0.0423, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.24% (0.0425 => 0.0424) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.48% (0.0414 => 0.0412, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.24% (0.0415 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0420 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.24% (0.0422 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.23% (0.0432 => 0.0431, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.46% (0.0434 => 0.0432, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0409 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.24% (0.0410 => 0.0409, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.24% (0.0421 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.24% (0.0422 => 0.0421) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.24% (0.0412 => 0.0411, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.24% (0.0413 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.25% (0.0404 => 0.0403, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0405 => 0.0405, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.25% (0.0403 => 0.0402, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.25% (0.0405 => 0.0404, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.23% (0.0440 => 0.0439, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.23% (0.0441 => 0.0440, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.50% (0.0403 => 0.0401, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.25% (0.0403 => 0.0402, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.25% (0.0403 => 0.0402, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.25% (0.0404 => 0.0403, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.49% (0.0411 => 0.0409, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.24% (0.0412 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.12% (1.2250 => 1.2265, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.02% (7.5349 => 7.5337, std.dev.: 0.0194) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.19% (0.7285 => 0.7271, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -1.12% (0.0358 => 0.0354, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1435 => 0.1434, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.31% (0.0655 => 0.0653, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -14.61% (63.2438 => 54.0040, std.dev.: 0.0031) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 30.23% (14.1553 => 18.4351, std.dev.: 0.0124) SingleSource/Benchmarks/Misc-C++-EH/spirit: 57.81% (3.4629 => 5.4648, std.dev.: 0.0101) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14240.28% (0.0720 => 10.3250, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10004100.00% (0.0001 => 10.0042, std.dev.: 0.0030) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 47.06% (0.2554 => 0.3756, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 42.69% (10.3673 => 14.7932, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/distray/distray: 29.36% (0.1056 => 0.1366, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 28.36% (0.1622 => 0.2082, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.35% (2.2022 => 2.4962, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.08% (7.0540 => 7.9764, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 12.99% (0.1432 => 0.1618, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.52% (0.1566 => 0.1762, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.16% (1.7609 => 1.9575, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.48% (0.3473 => 0.3837, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.44% (0.3516 => 0.3883, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.30% (0.3543 => 0.3908, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.28% (0.3561 => 0.3927, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.27% (0.3543 => 0.3907, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 10.27% (0.3497 => 0.3856, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 10.02% (10.4361 => 11.4817, std.dev.: 0.0119) SingleSource/UnitTests/ObjC/for-in: 9.96% (0.3694 => 0.4062, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 9.77% (0.3828 => 0.4202, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 9.73% (0.3927 => 0.4309, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.72% (0.1584 => 0.1738, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/property: 9.65% (0.3886 => 0.4261, std.dev.: 0.0058) MultiSource/Benchmarks/mafft/pairlocalalign: 9.32% (9.4845 => 10.3689, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/oourafft: 8.96% (0.3282 => 0.3576, std.dev.: 0.0058) SingleSource/UnitTests/ObjC++/Hello: 8.79% (0.5925 => 0.6446, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.74% (0.6030 => 0.6557, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 8.16% (0.1655 => 0.1790, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 7.86% (0.7326 => 0.7902, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.79% (0.1438 => 0.1550, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.77% (0.4879 => 0.5258, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.62% (0.3177 => 0.3419, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 7.56% (0.7115 => 0.7653, std.dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.46% (0.6675 => 0.7173, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 7.30% (0.3109 => 0.3336, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.30% (0.2603 => 0.2793, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.12% (1.5415 => 1.6513, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 7.08% (0.7433 => 0.7959, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.98% (0.4615 => 0.4937, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 6.90% (0.1695 => 0.1812, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.88% (0.2891 => 0.3090, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists: 6.84% (0.3422 => 0.3656, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.78% (0.2905 => 0.3102, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.74% (0.2271 => 0.2424, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.73% (0.2065 => 0.2204, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.72% (0.3052 => 0.3257, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.71% (0.4636 => 0.4947, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.65% (0.4103 => 0.4376, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 6.63% (0.3423 => 0.3650, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.62% (1.3050 => 1.3914, std.dev.: 0.0094) MultiSource/Applications/d/make_dparser: 6.59% (3.3354 => 3.5551, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.54% (0.5860 => 0.6243, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.52% (0.1625 => 0.1731, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.50% (0.5105 => 0.5437, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.50% (0.5569 => 0.5931, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.49% (0.3865 => 0.4116, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.49% (0.3098 => 0.3299, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 6.47% (5.7591 => 6.1320, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/strcat: 6.46% (0.2831 => 0.3014, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.42% (0.2756 => 0.2933, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.41% (0.3650 => 0.3884, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.39% (0.3162 => 0.3364, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.38% (4.2646 => 4.5366, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.38% (0.3136 => 0.3336, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.38% (0.4203 => 0.4471, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.35% (0.2725 => 0.2898, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.34% (0.4289 => 0.4561, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.33% (0.2700 => 0.2871, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.31% (2.0665 => 2.1969, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 6.27% (0.4048 => 0.4302, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.27% (0.2793 => 0.2968, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.25% (0.3232 => 0.3434, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 6.24% (0.6456 => 0.6859, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.23% (0.2872 => 0.3051, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.23% (0.2714 => 0.2883, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.22% (0.8172 => 0.8680, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/random: 6.21% (0.2802 => 0.2976, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.17% (8.1363 => 8.6386, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.14% (0.3826 => 0.4061, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.13% (0.2871 => 0.3047, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.12% (0.2877 => 0.3053, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.08% (0.9765 => 1.0359, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.08% (0.3307 => 0.3508, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.05% (5.0018 => 5.3045, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.04% (4.9449 => 5.2437, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.04% (0.8067 => 0.8554, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.00% (0.3283 => 0.3480, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.99% (0.3121 => 0.3308, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.98% (0.2758 => 0.2923, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 5.95% (0.7835 => 0.8301, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.93% (0.2107 => 0.2232, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 5.89% (0.3684 => 0.3901, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 5.86% (0.3603 => 0.3814, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.84% (0.5020 => 0.5313, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 5.79% (0.3387 => 0.3583, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.78% (0.4620 => 0.4887, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.72% (0.1940 => 0.2051, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 5.67% (1.1642 => 1.2302, std.dev.: 0.0087) MultiSource/Applications/hbd/hbd: 5.58% (1.5603 => 1.6473, std.dev.: 0.0031) MultiSource/Applications/lua/lua: 5.51% (3.8723 => 4.0855, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary2: 5.50% (0.3379 => 0.3565, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.50% (7.9617 => 8.3992, std.dev.: 0.0051) MultiSource/Applications/lemon/lemon: 5.33% (1.0722 => 1.1293, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.32% (0.3441 => 0.3624, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/05-eks/eks: 5.30% (0.4299 => 0.4527, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 5.09% (0.3180 => 0.3342, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 5.06% (2.0273 => 2.1298, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.05% (1.1861 => 1.2460, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 4.81% (21.9371 => 22.9933, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.60% (0.5981 => 0.6256, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 4.60% (0.8921 => 0.9331, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.59% (0.6450 => 0.6746, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 4.51% (2.2969 => 2.4004, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.45% (0.4064 => 0.4245, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.32% (1.5859 => 1.6544, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.25% (0.3131 => 0.3264, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 4.11% (1.2842 => 1.3370, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.92% (1.4186 => 1.4742, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.74% (2.2024 => 2.2848, std.dev.: 0.0189) MultiSource/Benchmarks/nbench/nbench: 3.47% (1.1840 => 1.2251, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.86% (0.8101 => 0.8333, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.70% (0.3817 => 0.3920, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.44% (14.3668 => 14.7170, std.dev.: 0.0164) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.13% (1.1194 => 1.1432, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: 1.92% (17.1811 => 17.5107, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.35% (3.8922 => 3.9448, std.dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: 30.45% (1.1277 => 1.4711, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.25% (1.1145 => 1.3848, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.21% (3.1595 => 3.4506, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 6.71% (1.1396 => 1.2161, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 6.64% (3.1578 => 3.3675, std.dev.: 0.0010) SingleSource/Regression/C/uint64_to_float: 3.71% (0.5413 => 0.5614) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.47% (3.6395 => 3.7658, std.dev.: 0.0043) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.79% (4.2280 => 4.3459, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (0.8275 => 0.8405, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.04% (9.1159 => 9.2108, std.dev.: 0.0146) MultiSource/Benchmarks/nbench/nbench: 1.02% (11.6436 => 11.7619, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1275, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.41% (0.8651 => 0.1695, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.33% (5.2763 => 3.2539, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.53% (5.3855 => 3.5800, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -33.08% (5.3526 => 3.5821, std.dev.: 0.0083) SingleSource/UnitTests/Vector/constpool: -14.74% (54.1659 => 46.1828, std.dev.: 0.0302) MultiSource/Benchmarks/FreeBench/mason/mason: -14.67% (0.0811 => 0.0692, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.30% (2.9384 => 2.6063, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -10.81% (22.1758 => 19.7787, std.dev.: 0.0117) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7645, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4233, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.63% (0.0998 => 0.0862, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: -12.67% (1.3677 => 1.1944, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.29% (1.2373 => 1.0976, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel-2: -10.32% (1.5373 => 1.3787, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -10.13% (0.2161 => 0.1942, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.47% (19.9488 => 18.2600, std.dev.: 0.1158) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.65% (0.2497 => 0.2331) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.61% (1.8329 => 1.7118, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.13% (13.4384 => 12.7485, std.dev.: 0.0578) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.99% (1.6805 => 1.5967, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909) SingleSource/Benchmarks/Misc/flops-5: -4.57% (1.5835 => 1.5111, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.33% (0.3463 => 0.3313, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.72% (0.9957 => 0.9587, std.dev.: 0.0024) MultiSource/Applications/siod/siod: -3.63% (3.2827 => 3.1636, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.42% (32.5116 => 31.3998, std.dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: -2.41% (12.4730 => 12.1727, std.dev.: 0.0013) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.94% (8.6802 => 8.5114, std.dev.: 0.0131) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.93% (8.1563 => 7.9987, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6813, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -1.70% (10.2830 => 10.1082, std.dev.: 0.0060) SingleSource/UnitTests/Vector/multiplies: -1.66% (2.5528 => 2.5103, std.dev.: 0.0020) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4220, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: -1.47% (4.6441 => 4.5759, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -1.15% (6.2999 => 6.2275, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.62% (0.5229 => 0.5732, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 6.29% (14.9895 => 15.9328, std.dev.: 0.0117) MultiSource/Benchmarks/MallocBench/gs/gs: 4.74% (4.1105 => 4.3055, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.02% (1.1048 => 1.2265, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.25% (7.1582 => 7.5337, std.dev.: 0.0194) SingleSource/Benchmarks/Misc-C++/stepanov_container: 16.86% (0.6222 => 0.7271, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35300.00% (0.0001 => 0.0354, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -3.43% (0.1485 => 0.1434, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.14% (0.2116 => 0.0653, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 2 13:58:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 2 Oct 2012 15:58:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121002205845.E5BF42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4496?compare_to=4486&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4496, Order: 165032, Start Time: 2012-10-02 19:34:56, End Time: 2012-10-02 21:00:25 To: 4486, Order: 165002, Start Time: 2012-10-02 13:38:34, End Time: 2012-10-02 15:04:19 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 1 (172 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1037 (693 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.85% (54.3699 => 56.4653, std.dev.: 0.0970) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.52% (0.9663 => 0.9516, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.01% (2.7530 => 2.7526, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (2.1154 => 2.1154, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.09% (4.9750 => 4.9704, std.dev.: 0.0023) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.88% (2.0176 => 2.4388, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.52% (0.1410 => 0.1643, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 14.41% (0.0826 => 0.0945, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 13.51% (0.2243 => 0.2546, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.69% (0.1072 => 0.1208, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 12.67% (0.5818 => 0.6555, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 12.44% (0.5748 => 0.6463, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 11.71% (0.7061 => 0.7888, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 11.67% (0.4062 => 0.4536, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 11.62% (0.4328 => 0.4831, std.dev.: 0.0035) SingleSource/Regression/C++/ofstream_ctor: 11.54% (0.2781 => 0.3102, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.11% (0.2782 => 0.3091, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.05% (0.3899 => 0.4330, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.04% (0.1413 => 0.1569, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.04% (0.2655 => 0.2948, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.85% (0.3022 => 0.3350, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.85% (0.3485 => 0.3863, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 10.76% (0.1013 => 0.1122, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 10.75% (1.3693 => 1.5165, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/except: 10.72% (0.2760 => 0.3056, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 10.63% (0.2690 => 0.2976, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 10.63% (0.2607 => 0.2884, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.60% (0.2765 => 0.3058, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 10.56% (0.7038 => 0.7781, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.55% (0.1327 => 0.1467, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.54% (1.9828 => 2.1917, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/methcall: 10.50% (0.2761 => 0.3051, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 10.50% (0.2628 => 0.2904, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.48% (0.4016 => 0.4437, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.48% (0.0964 => 0.1065) SingleSource/Benchmarks/Shootout-C++/strcat: 10.45% (0.2726 => 0.3011, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 10.45% (0.2937 => 0.3244, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.44% (3.9660 => 4.3799, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 10.42% (0.3868 => 0.4271, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.39% (0.1588 => 0.1753, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.38% (0.2966 => 0.3274, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.30% (0.3756 => 0.4143, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.30% (1.4563 => 1.6063, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.29% (0.2721 => 0.3001, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.27% (0.2696 => 0.2973, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.25% (0.3580 => 0.3947, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.25% (0.4390 => 0.4840, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 10.23% (0.3293 => 0.3630, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.23% (0.3489 => 0.3846, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 10.17% (0.3453 => 0.3804, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 10.07% (0.3107 => 0.3420, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 10.07% (0.3149 => 0.3466, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.95% (1.2193 => 1.3406, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: 9.94% (0.2988 => 0.3285, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.92% (0.6283 => 0.6906, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.90% (0.2596 => 0.2853, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.79% (0.6959 => 0.7640, std.dev.: 0.0078) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.78% (0.7710 => 0.8464, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: 9.77% (0.3192 => 0.3504, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.76% (0.5265 => 0.5779, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.74% (0.9199 => 1.0095, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists1: 9.65% (0.3534 => 0.3875) MultiSource/Applications/SPASS/SPASS: 9.39% (13.8202 => 15.1180, std.dev.: 0.0136) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.27% (1.1364 => 1.2418, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.25% (0.1157 => 0.1264, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.17% (0.3130 => 0.3417, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.06% (0.6576 => 0.7172, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 9.03% (0.2945 => 0.3211, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 9.00% (0.1589 => 0.1732, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.85% (0.1435 => 0.1562, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.78% (0.1276 => 0.1388, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.76% (0.1986 => 0.2160, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 8.71% (1.0313 => 1.1211, std.dev.: 0.0173) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.61% (0.5577 => 0.6057, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.60% (0.4791 => 0.5203, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 8.55% (0.2995 => 0.3251, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.50% (0.4379 => 0.4751, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 8.46% (16.6129 => 18.0190, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.42% (0.3755 => 0.4071, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.32% (0.2127 => 0.2304, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.28% (0.8698 => 0.9418, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.27% (0.2914 => 0.3155, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 8.17% (0.6744 => 0.7295, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 8.14% (1.1061 => 1.1961, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.10% (0.3246 => 0.3509, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.03% (0.2504 => 0.2705, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.95% (3.6692 => 3.9609, std.dev.: 0.0106) MultiSource/Benchmarks/MallocBench/gs/gs: 7.95% (3.8646 => 4.1718, std.dev.: 0.0056) MultiSource/Applications/spiff/spiff: 7.87% (0.7506 => 0.8097, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 7.85% (0.8310 => 0.8962, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 7.80% (0.3220 => 0.3471, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.79% (7.2180 => 7.7801, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.77% (0.5637 => 0.6075, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.71% (0.7460 => 0.8035, std.dev.: 0.0022) MultiSource/Applications/d/make_dparser: 7.60% (3.1889 => 3.4311, std.dev.: 0.0043) MultiSource/Applications/siod/siod: 7.57% (2.1791 => 2.3440, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.56% (0.1865 => 0.2006, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 7.52% (0.2925 => 0.3145, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 7.46% (1.0594 => 1.1384, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.32% (0.2023 => 0.2171, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 7.31% (1.9270 => 2.0678, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 7.18% (0.1657 => 0.1776, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.08% (0.3914 => 0.4191, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 7.07% (1.2292 => 1.3161, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: 7.02% (0.3578 => 0.3829, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.99% (0.4003 => 0.4283, std.dev.: 0.0028) MultiSource/Applications/viterbi/viterbi: 6.97% (0.1478 => 0.1581, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.92% (1.3245 => 1.4162, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.88% (0.1569 => 0.1677, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 6.87% (0.3131 => 0.3346, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 6.86% (0.3789 => 0.4049, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.86% (0.8818 => 0.9423, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/exceptions-4: 6.86% (0.3646 => 0.3896, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 6.85% (0.3940 => 0.4210, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.85% (0.3663 => 0.3914, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 6.82% (14.8535 => 15.8671, std.dev.: 0.0070) MultiSource/Applications/SIBsim4/SIBsim4: 6.80% (1.2749 => 1.3616, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 6.80% (8.4961 => 9.0738, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/bigfib: 6.78% (0.6250 => 0.6674, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 6.78% (0.3601 => 0.3845, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.76% (0.1789 => 0.1910, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.74% (0.3650 => 0.3896, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 6.68% (0.3623 => 0.3865, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.65% (4.3801 => 4.6715, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 6.61% (0.4113 => 0.4385, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.60% (0.6135 => 0.6540, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.56% (4.4433 => 4.7348, std.dev.: 0.0038) MultiSource/Applications/oggenc/oggenc: 6.46% (4.6629 => 4.9639, std.dev.: 0.0075) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.31% (0.2140 => 0.2275, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.21% (0.3511 => 0.3729, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.10% (4.9865 => 5.2906, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.02% (1.1333 => 1.2015, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.85% (3.2742 => 3.4656, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.76% (0.4805 => 0.5082, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.66% (0.1819 => 0.1922, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.64% (0.3245 => 0.3428) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.50% (1.5188 => 1.6024, std.dev.: 0.0136) MultiSource/Applications/JM/ldecod/ldecod: 5.35% (6.5754 => 6.9270, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.34% (0.2321 => 0.2445, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.25% (0.9108 => 0.9586, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 5.23% (3.7467 => 3.9426, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.74% (2.1007 => 2.2003, std.dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.72% (6.2785 => 6.5748, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.52% (13.2842 => 13.8853, std.dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: 3.04% (16.2614 => 16.7558, std.dev.: 0.0071) MultiSource/Applications/ClamAV/clamscan: 2.52% (14.5298 => 14.8960, std.dev.: 0.0112) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5162, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.27% (1.8175 => 2.2586, std.dev.: 0.0175) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.59% (1.1560 => 1.2553, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.61% (3.1736 => 3.4152, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.34% (1.2998 => 1.3822, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0050, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.93% (11.2619 => 11.7040, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7748, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.56% (10.7476 => 11.1297, std.dev.: 0.0165) SingleSource/Benchmarks/Misc/flops-6: 3.47% (1.9199 => 1.9866, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.15% (7.4271 => 7.5871, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5135, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.27% (5.5130 => 5.5829, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1887, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.12% (3.1071 => 3.1420, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5864, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.00% (9.9194 => 10.0188, std.dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.87% (0.2670 => 0.1392, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -16.12% (0.0707 => 0.0593, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.02% (0.4657 => 0.3911, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.62% (1.3813 => 1.1794, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.57% (1.3819 => 1.1805, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.33% (22.5627 => 21.5862, std.dev.: 0.0065) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.44% (0.0997 => 0.0863, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.97% (0.2238 => 0.1970, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.42% (1.2308 => 1.0902, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.26% (20.3410 => 18.2542, std.dev.: 0.0278) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.31% (1.3780 => 1.3048, std.dev.: 0.0024) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.80% (0.9996 => 0.9516, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.65% (13.3668 => 12.7456, std.dev.: 0.0653) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.16% (0.3458 => 0.3314, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.55% (3.2729 => 3.1567, std.dev.: 0.0025) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.41% (1.7688 => 1.7084, std.dev.: 0.0087) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.04% (0.4867 => 0.4719, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.38% (3.0263 => 2.9543, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.25% (1.9762 => 1.9317, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6946, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/lists: -1.71% (6.3560 => 6.2474, std.dev.: 0.0114) MultiSource/Applications/lua/lua: -1.71% (26.5159 => 26.0633, std.dev.: 0.0333) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0071, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8684, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.16% (2.5254 => 2.4960, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2585, std.dev.: 0.0019) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 2 15:26:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 2 Oct 2012 17:26:30 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121002222630.A0E932A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4497?compare_to=4494&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4497, Order: 165039, Start Time: 2012-10-02 20:54:21, End Time: 2012-10-02 22:28:11 To: 4494, Order: 165030, Start Time: 2012-10-02 19:11:45, End Time: 2012-10-02 20:38:22 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (8 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 13 (78 on baseline) Performance Improvements: 3 (44 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 77 (69 on baseline) Unchanged Tests: 949 (761 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 2.68% (4.8895 => 5.0203, std.dev.: 0.0269) MultiSource/Applications/treecc/treecc: 1.95% (1.9149 => 1.9523, std.dev.: 0.0127) MultiSource/Applications/siod/siod: 1.69% (2.1681 => 2.2047, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/football/football: 1.64% (0.8580 => 0.8721, std.dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: 1.21% (0.9450 => 0.9564, std.dev.: 0.0029) MultiSource/Applications/hbd/hbd: 1.13% (1.3465 => 1.3617, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/mafft/pairlocalalign: 11.79% (56.9559 => 63.6700, std.dev.: 0.2075) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.93% (1.3383 => 1.4177, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 4.31% (43.7761 => 45.6643, std.dev.: 0.3016) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.58% (2.9408 => 2.9873, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.49% (41.4952 => 42.1127, std.dev.: 0.1455) SingleSource/Benchmarks/Misc/ReedSolomon: 1.19% (8.4583 => 8.5587, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/methcall: 1.03% (8.8862 => 8.9775, std.dev.: 0.0268) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.60% (0.8031 => 0.7742, std.dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.34% (6.5030 => 6.4161, std.dev.: 0.0307) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.31% (0.9249 => 0.9128, std.dev.: 0.0022) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.37% (1.0122 => 0.9983, std.dev.: 0.0171) MultiSource/Applications/sqlite3/sqlite3: 1.52% (0.6137 => 0.6230, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/08-main/main: -0.85% (0.1769 => 0.1754, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.58% (0.1512 => 0.1551, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.32% (0.3130 => 0.3140, std.dev.: 0.0200) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.57% (0.2288 => 0.2301, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.30% (0.3170 => 0.3243, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.77% (0.2278 => 0.2341, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: 6.51% (0.0415 => 0.0442, std.dev.: 0.0008) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0087 => 0.0087, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 23.46% (0.0162 => 0.0200, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.54% (0.0195 => 0.0192, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 26.56% (0.0305 => 0.0386, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 11.70% (0.0265 => 0.0296, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.40% (0.0285 => 0.0281, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -8.11% (0.0259 => 0.0238, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/casts: -11.32% (0.0159 => 0.0141, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/test1: 18.49% (0.0119 => 0.0141, std.dev.: 0.0024) SingleSource/UnitTests/Vector/multiplies: -0.40% (0.0250 => 0.0249, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 9.41% (0.0287 => 0.0314, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 0.27% (0.1461 => 0.1465, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 0.35% (0.2292 => 0.2300, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -6.80% (1.5146 => 1.4116, std.dev.: 0.0712) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.94% (0.1482 => 0.1496, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/Bullet/bullet: 1.05% (0.5881 => 0.5943, std.dev.: 0.0099) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -4.65% (26.7274 => 25.4854, std.dev.: 0.7891) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.60% (0.4000 => 0.4024, std.dev.: 0.0197) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.37% (0.1382 => 0.1363, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.69% (0.0533 => 0.0574, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -28.99% (0.0238 => 0.0169, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.30% (0.0664 => 0.0666, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.77% (1.1313 => 1.1400, std.dev.: 0.0417) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -8.33% (0.0012 => 0.0011, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.13% (0.0611 => 0.0543, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.88% (0.0205 => 0.0195, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.56% (0.7649 => 0.7692, std.dev.: 0.0221) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 0.36% (4.0212 => 4.0356, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 0.05% (59.4742 => 59.5035, std.dev.: 0.2885) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 3.69% (2.9153 => 3.0230, std.dev.: 0.1639) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -1.08% (2.3161 => 2.2912, std.dev.: 0.0390) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.06% (1.7074 => 1.7063, std.dev.: 0.0005) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 51.92% (0.0052 => 0.0079, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt MultiSource/Applications/JM/lencod/lencod: -96.59% (6.7458 => 0.2300, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -91.48% (6.9722 => 0.5943, std.dev.: 0.0099) MultiSource/Benchmarks/McCat/09-vor/vor: 20502.59% (0.1237 => 25.4854, std.dev.: 0.7891) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -0.75% (4.0659 => 4.0356, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.73% (61.1734 => 59.5035, std.dev.: 0.2885) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -5.55% (3.2007 => 3.0230, std.dev.: 0.1639) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -2.83% (2.3580 => 2.2912, std.dev.: 0.0390) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.35% (4.1772 => 3.1182, std.dev.: 0.0566) SingleSource/Benchmarks/Shootout-C++/except: 82716.67% (0.0006 => 0.4969, std.dev.: 0.0030) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.36% (0.0745 => 0.0919, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 8.91% (2.1763 => 2.3701, std.dev.: 0.0208) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.10% (0.6410 => 0.6929, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.36% (0.1414 => 0.1518, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 7.24% (0.6173 => 0.6620, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: 6.97% (0.5309 => 0.5679, std.dev.: 0.0069) MultiSource/Applications/lemon/lemon: 6.71% (1.0046 => 1.0720, std.dev.: 0.0116) MultiSource/Applications/lambda-0_1_3/lambda: 6.26% (0.6915 => 0.7348, std.dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: 6.09% (1.1653 => 1.2363, std.dev.: 0.0072) MultiSource/Applications/oggenc/oggenc: 5.79% (4.7455 => 5.0203, std.dev.: 0.0269) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.71% (0.7639 => 0.8075, std.dev.: 0.0082) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.56% (0.3582 => 0.3781, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.49% (0.2552 => 0.2692, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.39% (0.2654 => 0.2797, std.dev.: 0.0044) MultiSource/Applications/kimwitu++/kc: 5.36% (15.3105 => 16.1315, std.dev.: 0.2791) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.21% (1.5150 => 1.5940, std.dev.: 0.0112) MultiSource/Applications/d/make_dparser: 5.13% (3.0225 => 3.1777, std.dev.: 0.0234) MultiSource/Applications/siod/siod: 5.13% (2.0972 => 2.2047, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.84% (0.6069 => 0.6363, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/18-imp/imp: 4.72% (0.3217 => 0.3369, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.63% (0.4880 => 0.5106, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.56% (0.3901 => 0.4079, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 4.49% (13.3238 => 13.9214, std.dev.: 0.0849) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.25% (1.0689 => 1.1143, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.08% (0.2797 => 0.2911, std.dev.: 0.0017) MultiSource/Applications/Burg/burg: 4.02% (1.1440 => 1.1900, std.dev.: 0.0123) MultiSource/Applications/treecc/treecc: 3.86% (1.8798 => 1.9523, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/football/football: 3.76% (0.8405 => 0.8721, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.74% (0.4248 => 0.4407, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.64% (0.5636 => 0.5841, std.dev.: 0.0034) MultiSource/Applications/sgefa/sgefa: 3.48% (0.2877 => 0.2977, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.29% (0.8569 => 0.8851, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.17% (0.7226 => 0.7455, std.dev.: 0.0066) MultiSource/Applications/JM/lencod/lencod: 3.13% (14.7256 => 15.1872, std.dev.: 0.0671) MultiSource/Applications/lua/lua: 3.05% (3.5980 => 3.7077, std.dev.: 0.0189) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.98% (0.3418 => 0.3520, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 2.87% (1.0821 => 1.1132, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.76% (1.2021 => 1.2353, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.75% (12.6413 => 12.9885, std.dev.: 0.0918) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.66% (1.1672 => 1.1983, std.dev.: 0.0056) MultiSource/Benchmarks/mafft/pairlocalalign: 2.65% (8.2186 => 8.4368, std.dev.: 0.0613) MultiSource/Applications/hbd/hbd: 2.63% (1.3268 => 1.3617, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.58% (6.2546 => 6.4161, std.dev.: 0.0307) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.47% (0.5963 => 0.6110, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.38% (1.1827 => 1.2108, std.dev.: 0.0095) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.86% (4.2616 => 4.3410, std.dev.: 0.0208) MultiSource/Benchmarks/MallocBench/gs/gs: 1.79% (3.8796 => 3.9490, std.dev.: 0.0122) MultiSource/Applications/hexxagon/hexxagon: 1.47% (0.9425 => 0.9564, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.34% (1.6538 => 2.3375, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2275, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/power/power: 17.89% (1.4184 => 1.6722, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/ary3: 14.62% (1.7426 => 1.9974, std.dev.: 0.0261) SingleSource/Benchmarks/Stanford/Puzzle: 14.03% (0.1433 => 0.1634, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 13.30% (0.0917 => 0.1039, std.dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.49% (2.4042 => 2.7046, std.dev.: 0.0547) SingleSource/Benchmarks/McGill/queens: 11.08% (1.6261 => 1.8062, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.66% (0.2857 => 0.3133, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/lists: 8.55% (7.0025 => 7.6014, std.dev.: 0.0233) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.52% (1.0063 => 1.0920, std.dev.: 0.0064) MultiSource/Benchmarks/FreeBench/mason/mason: 8.31% (0.5004 => 0.5420, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.42% (0.3301 => 0.3513, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.84% (0.7609 => 0.7977, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/dt: 4.29% (0.9851 => 1.0274, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.04% (40.4792 => 42.1127, std.dev.: 0.1455) MultiSource/Benchmarks/PAQ8p/paq8p: 3.72% (92.7467 => 96.1958, std.dev.: 0.9782) MultiSource/Applications/siod/siod: 3.27% (3.5520 => 3.6681, std.dev.: 0.0234) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.97% (0.5587 => 0.5753, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.93% (0.5876 => 0.6048, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.85% (6.6312 => 6.8205, std.dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 2.77% (14.4877 => 14.8895, std.dev.: 0.0235) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.47% (2.9152 => 2.9873, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/hash: 2.25% (0.6308 => 0.6450, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.08% (4.6127 => 4.7085, std.dev.: 0.0112) MultiSource/Benchmarks/mafft/pairlocalalign: 2.01% (62.4126 => 63.6700, std.dev.: 0.2075) SingleSource/Benchmarks/Dhrystone/dry: 1.93% (2.4013 => 2.4476, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 1.71% (29.5232 => 30.0287, std.dev.: 0.1098) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.50% (2.6656 => 2.7057, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/em3d/em3d: 1.40% (4.6414 => 4.7062, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -46.02% (0.0591 => 0.0319, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -45.49% (0.2996 => 0.1633, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.70% (1.4189 => 1.1252, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -20.05% (1.4113 => 1.1284, std.dev.: 0.0141) SingleSource/UnitTests/Vector/constpool: -6.95% (8.9977 => 8.3722, std.dev.: 0.2254) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.90% (0.2080 => 0.1978, std.dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.21% (0.3497 => 0.2091, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -26.95% (15.8312 => 11.5641, std.dev.: 0.1336) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.53% (5.2665 => 4.1324, std.dev.: 0.1101) SingleSource/Benchmarks/Shootout-C++/ary3: -18.84% (1.7473 => 1.4181, std.dev.: 0.0254) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.19% (1.7361 => 1.4723, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1580, std.dev.: 0.0288) MultiSource/Benchmarks/FreeBench/neural/neural: -11.45% (1.0926 => 0.9675, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.61% (1.1647 => 1.0528, std.dev.: 0.0160) SingleSource/Benchmarks/Misc/flops: -8.39% (9.5474 => 8.7463, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.31% (1.4034 => 1.2868, std.dev.: 0.0308) MultiSource/Benchmarks/Olden/bh/bh: -7.18% (2.5166 => 2.3358, std.dev.: 0.0254) MultiSource/Applications/sgefa/sgefa: -6.99% (0.3746 => 0.3484, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.84% (3.6254 => 3.3775, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/fibo: -6.58% (4.6355 => 4.3303, std.dev.: 0.0059) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.55% (2.0027 => 1.8715, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -6.55% (7.6833 => 7.1802, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/richards_benchmark: -6.50% (1.4441 => 1.3502, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.94% (2.9728 => 2.7961, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: -5.69% (3.4230 => 3.2284, std.dev.: 0.0305) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.46% (3.9413 => 3.7263, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/fib2: -5.26% (4.4195 => 4.1869, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.93% (0.4564 => 0.4339, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: -4.80% (1.5803 => 1.5044, std.dev.: 0.0123) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -4.02% (3.4080 => 3.2711, std.dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.52% (9.3855 => 9.0550, std.dev.: 0.0325) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.20% (3.7496 => 3.6295, std.dev.: 0.0315) SingleSource/Benchmarks/Shootout-C++/methcall: -2.95% (9.2503 => 8.9775, std.dev.: 0.0268) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.77% (1.1683 => 1.1359, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/hash2: -1.85% (3.4876 => 3.4230, std.dev.: 0.0210) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.74% (2.3569 => 2.3159, std.dev.: 0.0035) MultiSource/Applications/aha/aha: -1.71% (3.4286 => 3.3700, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.57% (1.0686 => 1.0518, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.51% (2.4457 => 2.4088, std.dev.: 0.0045) MultiSource/Benchmarks/sim/sim: -1.45% (3.8907 => 3.8344, std.dev.: 0.0155) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3067, std.dev.: 0.0193) SingleSource/Benchmarks/Dhrystone/fldry: -1.30% (2.4971 => 2.4647, std.dev.: 0.0034) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.25% (27.1724 => 26.8323, std.dev.: 0.1276) SingleSource/Benchmarks/Shootout-C++/lists: -1.14% (16.5617 => 16.3730, std.dev.: 0.0524) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.03% (0.9980 => 0.9983, std.dev.: 0.0171) MultiSource/Applications/sqlite3/sqlite3: 3.45% (0.6022 => 0.6230, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/08-main/main: 5.28% (0.1666 => 0.1754, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.19% (0.1554 => 0.1551, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.85% (0.3083 => 0.3140, std.dev.: 0.0200) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.88% (0.2394 => 0.2301, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.14% (0.3175 => 0.3243, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.69% (0.2302 => 0.2341, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -1.56% (0.0449 => 0.0442, std.dev.: 0.0008) SingleSource/UnitTests/2003-05-07-VarArgs: -2.25% (0.0089 => 0.0087, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: -1.11% (0.0090 => 0.0089, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -16.67% (0.0240 => 0.0200, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0192 => 0.0192, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.03% (0.0390 => 0.0386, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.66% (0.0301 => 0.0296, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.06% (0.0284 => 0.0281, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -26.54% (0.0324 => 0.0238, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/casts: -20.34% (0.0177 => 0.0141, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/test1: -25.40% (0.0189 => 0.0141, std.dev.: 0.0024) SingleSource/UnitTests/Vector/multiplies: - (0.0249 => 0.0249, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -3.38% (0.0325 => 0.0314, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 2.52% (0.1429 => 0.1465, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -6.01% (1.5019 => 1.4116, std.dev.: 0.0712) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.33% (0.1501 => 0.1496, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.63% (0.4264 => 0.4024, std.dev.: 0.0197) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.41% (0.1344 => 0.1363, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.55% (0.0589 => 0.0574, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -27.16% (0.0232 => 0.0169, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.23% (0.0639 => 0.0666, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.44% (1.1350 => 1.1400, std.dev.: 0.0417) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 83.33% (0.0006 => 0.0011, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.76% (0.0637 => 0.0543, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.73% (0.0246 => 0.0195, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 2.00% (0.7541 => 0.7692, std.dev.: 0.0221) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.07% (1.5363 => 1.7063, std.dev.: 0.0005) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 12.86% (0.0070 => 0.0079, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 2 15:43:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 2 Oct 2012 17:43:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121002224358.BB4DB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4498?compare_to=4495&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4498, Order: 165043, Start Time: 2012-10-02 21:26:11, End Time: 2012-10-02 22:45:38 To: 4495, Order: 165032, Start Time: 2012-10-02 19:37:42, End Time: 2012-10-02 20:57:06 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (145 on baseline) Performance Improvements: 1 (45 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 952 (697 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.93% (81.2956 => 79.7285, std.dev.: 0.3739) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.10% (0.5732 => 0.5738, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 0.23% (15.9328 => 15.9691, std.dev.: 0.0057) MultiSource/Benchmarks/Bullet/bullet: 0.19% (54.0040 => 54.1064, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/gs/gs: 0.25% (4.3055 => 4.3164, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.44% (0.0457 => 0.0459) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.44% (0.0459 => 0.0461, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.23% (0.0427 => 0.0428) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.23% (0.0429 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.24% (0.0417 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.48% (0.0418 => 0.0420) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.24% (0.0411 => 0.0412) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.49% (0.0412 => 0.0414) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0429 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.23% (0.0430 => 0.0431) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.24% (0.0423 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.24% (0.0424 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.49% (0.0412 => 0.0414) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.48% (0.0414 => 0.0416) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.24% (0.0420 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.48% (0.0421 => 0.0423) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.23% (0.0431 => 0.0432, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.46% (0.0432 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0409 => 0.0409, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.49% (0.0409 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.24% (0.0420 => 0.0421, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.48% (0.0421 => 0.0423, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.24% (0.0411 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.49% (0.0412 => 0.0414) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.50% (0.0403 => 0.0405, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.25% (0.0405 => 0.0406) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.25% (0.0402 => 0.0403, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.25% (0.0404 => 0.0405) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.23% (0.0439 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.45% (0.0440 => 0.0442, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.50% (0.0401 => 0.0403, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.50% (0.0402 => 0.0404, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.50% (0.0402 => 0.0404, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.50% (0.0403 => 0.0405) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.49% (0.0409 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.49% (0.0411 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.16% (1.2265 => 1.2285, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.12% (7.5337 => 7.5426, std.dev.: 0.0140) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.11% (0.7271 => 0.7279, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 1.69% (0.0354 => 0.0360, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: - (0.1434 => 0.1434, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.31% (0.0653 => 0.0651, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -14.45% (63.2438 => 54.1064, std.dev.: 0.0084) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 30.27% (14.1553 => 18.4408, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++-EH/spirit: 57.69% (3.4629 => 5.4607, std.dev.: 0.0053) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14232.78% (0.0720 => 10.3196, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10004800.00% (0.0001 => 10.0049, std.dev.: 0.0038) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 47.42% (0.2554 => 0.3765, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 42.58% (10.3673 => 14.7819, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/distray/distray: 29.64% (0.1056 => 0.1369, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 29.41% (0.1622 => 0.2099, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.71% (2.2022 => 2.5041, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.63% (7.0540 => 8.0153, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/flops: 13.48% (0.1432 => 0.1625, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.71% (0.1566 => 0.1765, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.54% (1.7609 => 1.9641, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.88% (0.3473 => 0.3851, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.61% (0.3543 => 0.3919, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.61% (0.3543 => 0.3919, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.59% (0.3561 => 0.3938, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.58% (0.3497 => 0.3867, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.52% (0.3516 => 0.3886, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.42% (0.3694 => 0.4079, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.14% (0.3828 => 0.4216, std.dev.: 0.0047) MultiSource/Applications/JM/ldecod/ldecod: 10.06% (10.4361 => 11.4862, std.dev.: 0.0088) SingleSource/UnitTests/ObjC/parameter-passing: 10.01% (0.3927 => 0.4320, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 9.96% (0.3886 => 0.4273, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.85% (0.1584 => 0.1740, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 9.55% (9.4845 => 10.3901, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/oourafft: 9.32% (0.3282 => 0.3588, std.dev.: 0.0057) SingleSource/UnitTests/ObjC++/Hello: 8.68% (0.5925 => 0.6439, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.54% (0.6030 => 0.6545, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.87% (0.4879 => 0.5263, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 7.85% (0.1655 => 0.1785, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.81% (0.3177 => 0.3425, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 7.63% (0.7326 => 0.7885, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.60% (0.6675 => 0.7182, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 7.52% (0.7115 => 0.7650, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 7.46% (0.3109 => 0.3341, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.38% (0.2603 => 0.2795, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.37% (1.5415 => 1.6551, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 7.36% (0.7433 => 0.7980, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 7.25% (5.7591 => 6.1766, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.16% (0.1438 => 0.1541, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 7.14% (0.1695 => 0.1816, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.06% (0.4615 => 0.4941, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 7.04% (0.3423 => 0.3664, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.96% (0.2271 => 0.2429, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.93% (0.2700 => 0.2887, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.92% (0.2065 => 0.2208, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.84% (1.3050 => 1.3942, std.dev.: 0.0089) MultiSource/Applications/d/make_dparser: 6.81% (3.3354 => 3.5624, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: 6.78% (0.3422 => 0.3654, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.68% (0.2891 => 0.3084, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.66% (0.8172 => 0.8716, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.62% (0.5860 => 0.6248, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.62% (0.5105 => 0.5443, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.60% (4.2646 => 4.5460, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.53% (0.2756 => 0.2936, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.46% (0.1625 => 0.1730, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 6.44% (0.2905 => 0.3092, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.41% (0.4289 => 0.4564, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.39% (8.1363 => 8.6560, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.38% (0.8067 => 0.8582, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.38% (0.2758 => 0.2934, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.36% (0.4103 => 0.4364, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.32% (0.2831 => 0.3010, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.32% (0.5569 => 0.5921, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.32% (0.4636 => 0.4929, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.31% (0.4203 => 0.4468, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.30% (5.0018 => 5.3171, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.27% (0.3650 => 0.3879, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.26% (0.3052 => 0.3243, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 6.26% (0.6456 => 0.6860, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.26% (0.9765 => 1.0376, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.25% (0.3136 => 0.3332, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.25% (0.3232 => 0.3434, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.22% (4.9449 => 5.2526, std.dev.: 0.0049) MultiSource/Applications/spiff/spiff: 6.22% (0.7835 => 0.8322, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.17% (0.2107 => 0.2237, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 6.17% (0.3098 => 0.3289, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/fibo: 6.17% (0.2725 => 0.2893, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.16% (0.3865 => 0.4103, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.14% (0.3307 => 0.3510, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.12% (0.3121 => 0.3312, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.12% (0.5020 => 0.5327, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 6.10% (0.2871 => 0.3046, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 6.05% (0.4048 => 0.4293, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.04% (0.3162 => 0.3353, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.03% (2.0665 => 2.1912, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.02% (0.2872 => 0.3045, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.01% (0.2877 => 0.3050, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.99% (0.3826 => 0.4055, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.98% (0.1940 => 0.2056, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 5.97% (0.3684 => 0.3904, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.94% (0.2793 => 0.2959, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 5.92% (0.2802 => 0.2968, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 5.88% (0.3387 => 0.3586, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 5.86% (0.2714 => 0.2873, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 5.86% (0.3603 => 0.3814, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 5.79% (1.1642 => 1.2316, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/hash2: 5.78% (0.4620 => 0.4887, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 5.76% (0.3283 => 0.3472, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 5.74% (1.5603 => 1.6498, std.dev.: 0.0034) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.72% (7.9617 => 8.4170, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.70% (0.3441 => 0.3637, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 5.63% (3.8723 => 4.0903, std.dev.: 0.0020) MultiSource/Applications/lemon/lemon: 5.57% (1.0722 => 1.1319, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 5.50% (0.3180 => 0.3355, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 5.35% (0.4299 => 0.4529, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 5.33% (0.3379 => 0.3559, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.31% (1.1861 => 1.2491, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 5.25% (2.0273 => 2.1338, std.dev.: 0.0041) MultiSource/Applications/JM/lencod/lencod: 5.08% (21.9371 => 23.0520, std.dev.: 0.0175) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.81% (0.6450 => 0.6760, std.dev.: 0.0042) MultiSource/Applications/siod/siod: 4.78% (2.2969 => 2.4066, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.71% (0.5981 => 0.6263, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 4.70% (0.8921 => 0.9340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.43% (0.4064 => 0.4244, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.41% (1.5859 => 1.6558, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 4.41% (0.3131 => 0.3269, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.08% (1.4186 => 1.4765, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 4.03% (1.2842 => 1.3359, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.95% (2.2024 => 2.2895, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.79% (1.1840 => 1.2289, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.97% (0.8101 => 0.8342, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.93% (0.3817 => 0.3929, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.55% (14.3668 => 14.7336, std.dev.: 0.0167) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.41% (1.1194 => 1.1464, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 2.06% (17.1811 => 17.5353, std.dev.: 0.0236) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.53% (3.8922 => 3.9516, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8963, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: 30.45% (1.1277 => 1.4711, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.21% (3.1595 => 3.4506, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.73% (3.1578 => 3.3704, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/richards_benchmark: 6.57% (1.1396 => 1.2145, std.dev.: 0.0008) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.34% (3.6395 => 3.7611, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.87% (4.2280 => 4.3493, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.33% (1.7254 => 1.7656, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 1.11% (2.1825 => 2.2068, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.08% (6.5088 => 6.5788, std.dev.: 0.0055) MultiSource/Benchmarks/nbench/nbench: 1.00% (11.6436 => 11.7604, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1283) SingleSource/Benchmarks/Misc/salsa20: -80.14% (0.8651 => 0.1718, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.43% (5.2763 => 3.2485, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.93% (5.3855 => 3.6123, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.57% (5.3526 => 3.6092, std.dev.: 0.0046) SingleSource/UnitTests/Vector/constpool: -14.78% (54.1659 => 46.1593, std.dev.: 0.0431) MultiSource/Benchmarks/FreeBench/mason/mason: -14.55% (0.0811 => 0.0693, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.03% (2.9384 => 2.6143, std.dev.: 0.0077) MultiSource/Applications/ClamAV/clamscan: -10.54% (22.1758 => 19.8383, std.dev.: 0.0150) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.34% (1.1492 => 0.7660, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4233, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.43% (0.0998 => 0.0864, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -12.66% (1.3677 => 1.1945) SingleSource/Benchmarks/McGill/chomp: -11.26% (1.2373 => 1.0980, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: -10.37% (1.5373 => 1.3779, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/mason/mason: -10.13% (0.2161 => 0.1942, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.34% (19.9488 => 18.2858, std.dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.72% (1.8329 => 1.7098, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.65% (0.2497 => 0.2331) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.27% (13.4384 => 12.7300, std.dev.: 0.0053) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.99% (1.6805 => 1.5966, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.52% (1.5835 => 1.5119, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.39% (0.9957 => 0.9520, std.dev.: 0.0106) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.30% (0.3463 => 0.3314, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.65% (3.2827 => 3.1628, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.42% (32.5116 => 31.4003, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: -2.43% (12.4730 => 12.1702, std.dev.: 0.0035) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.91% (8.6802 => 8.5143, std.dev.: 0.0180) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.89% (8.1563 => 8.0025, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6832, std.dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5117, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: -1.52% (4.6441 => 4.5736, std.dev.: 0.0026) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/salsa20: -1.45% (10.2830 => 10.1337, std.dev.: 0.0175) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8579, std.dev.: 0.0117) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.73% (0.5229 => 0.5738, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 6.54% (14.9895 => 15.9691, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/gs/gs: 5.01% (4.1105 => 4.3164, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.20% (1.1048 => 1.2285, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.37% (7.1582 => 7.5426, std.dev.: 0.0140) SingleSource/Benchmarks/Misc-C++/stepanov_container: 16.99% (0.6222 => 0.7279, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35900.00% (0.0001 => 0.0360, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: -3.43% (0.1485 => 0.1434, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 2 17:03:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 2 Oct 2012 19:03:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121003000338.8A3532A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4499?compare_to=4493&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4499, Order: 165039, Start Time: 2012-10-02 20:56:23, End Time: 2012-10-03 00:05:19 To: 4493, Order: 165025, Start Time: 2012-10-02 17:18:21, End Time: 2012-10-02 20:27:27 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 0 (126 on baseline) Performance Improvements: 2 (16 on baseline) Added Tests: 0 (131 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1037 (766 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.15% (1.7546 => 1.7345, std.dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/whetstone: -1.58% (2.8269 => 2.7821, std.dev.: 0.0075) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.00% (9.8095 => 9.8091, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.01% (9.4111 => 9.4122, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.02% (16.9271 => 16.9297, std.dev.: 0.0017) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 11.40% (0.3446 => 0.3839, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.40% (0.3465 => 0.3860, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.38% (0.3496 => 0.3894, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.35% (0.3488 => 0.3884, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/trivial-interface: 11.30% (0.3442 => 0.3831, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.27% (0.3460 => 0.3850, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.24% (0.3469 => 0.3859, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.01% (0.3650 => 0.4052, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.90% (0.3643 => 0.4040, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.71% (0.3724 => 0.4123, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.85% (0.5826 => 0.6400, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.81% (0.5889 => 0.6467, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 8.87% (1.5932 => 1.7345, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference: 8.53% (0.7171 => 0.7783, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.90% (0.2875 => 0.3102, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 7.84% (0.1619 => 0.1746, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 7.76% (0.3004 => 0.3237, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.60% (0.2738 => 0.2946, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 7.60% (0.2725 => 0.2932, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 7.52% (0.2714 => 0.2918, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.45% (0.3195 => 0.3433, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.44% (0.2729 => 0.2932, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.38% (0.2803 => 0.3010, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.38% (0.2750 => 0.2953, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.36% (0.2813 => 0.3020, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.34% (0.2792 => 0.2997, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 7.33% (0.2823 => 0.3030, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 7.30% (0.2780 => 0.2983, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 7.24% (0.3096 => 0.3320, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.23% (2.0673 => 2.2168, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.21% (0.2911 => 0.3121, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.15% (1.3152 => 1.4093, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/except: 7.11% (0.2811 => 0.3011, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.08% (1.6211 => 1.7359, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 7.07% (0.9909 => 1.0610, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.3267 => 0.3497, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.03% (0.3258 => 0.3487, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.96% (0.3060 => 0.3273, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 6.90% (0.3317 => 0.3546, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.87% (0.3362 => 0.3593, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.83% (0.4994 => 0.5335, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/moments: 6.80% (0.3678 => 0.3928, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.76% (0.3282 => 0.3504, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.75% (0.3124 => 0.3335, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.74% (3.5627 => 3.8027, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.68% (0.3625 => 0.3867, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.65% (0.4361 => 0.4651, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.60% (0.1620 => 0.1727, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.60% (0.2014 => 0.2147, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 6.57% (0.3348 => 0.3568, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: 6.53% (0.3477 => 0.3704, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.52% (0.3726 => 0.3969, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.50% (0.3845 => 0.4095, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.43% (0.2736 => 0.2912, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.32% (0.4146 => 0.4408, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 6.30% (23.5202 => 25.0027, std.dev.: 0.0108) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.25% (2.7292 => 2.8998, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 6.21% (5.5417 => 5.8860, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/hash2: 6.21% (0.4251 => 0.4515, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.18% (0.3690 => 0.3918, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.10% (0.5000 => 0.5305, std.dev.: 0.0027) MultiSource/Applications/d/make_dparser: 6.02% (1.0781 => 1.1430, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.95% (0.3981 => 0.4218, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.81% (0.5026 => 0.5318, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 5.81% (0.2566 => 0.2715, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 5.75% (4.2109 => 4.4532, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.75% (0.3930 => 0.4156, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.67% (0.6435 => 0.6800, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 5.61% (0.5012 => 0.5293, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.56% (0.5900 => 0.6228, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 5.55% (2.1013 => 2.2179, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.35% (0.3084 => 0.3249, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.35% (0.3890 => 0.4098, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.34% (0.2866 => 0.3019, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.33% (0.2737 => 0.2883, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.32% (0.2068 => 0.2178, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.24% (0.4139 => 0.4356, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 5.22% (0.6634 => 0.6980, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.20% (0.3903 => 0.4106, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.11% (0.4658 => 0.4896, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.10% (4.4195 => 4.6449, std.dev.: 0.0119) MultiSource/Benchmarks/MallocBench/gs/gs: 5.09% (1.8794 => 1.9750, std.dev.: 0.0047) MultiSource/Applications/spiff/spiff: 5.04% (0.4029 => 0.4232, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 4.95% (4.6177 => 4.8461, std.dev.: 0.0037) MultiSource/Applications/minisat/minisat: 4.92% (0.3336 => 0.3500, std.dev.: 0.0027) MultiSource/Applications/lua/lua: 4.91% (1.4269 => 1.4970, std.dev.: 0.0034) MultiSource/Applications/hbd/hbd: 4.88% (0.9697 => 1.0170, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 4.73% (2.1653 => 2.2677, std.dev.: 0.0023) MultiSource/Applications/Burg/burg: 4.58% (0.5546 => 0.5800, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.55% (0.2969 => 0.3104, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.52% (0.3271 => 0.3419, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 4.41% (0.7875 => 0.8222, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.26% (1.9966 => 2.0817, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.22% (1.9694 => 2.0525, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: 3.97% (2.0346 => 2.1154, std.dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: 3.92% (0.4847 => 0.5037, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 3.90% (0.2691 => 0.2796, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.70% (0.7426 => 0.7701, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.67% (0.5361 => 0.5558, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.37% (0.5584 => 0.5772, std.dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 3.32% (0.3498 => 0.3614, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.11% (11.6398 => 12.0022, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.07% (4.6926 => 4.8366, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.87% (0.4253 => 0.4375, std.dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 2.09% (11.9555 => 12.2051, std.dev.: 0.0167) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 5.86% (3.3903 => 3.5890, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.22% (12.0509 => 12.6802, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-2: 4.89% (1.8057 => 1.8940, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1672, std.dev.: 0.1141) SingleSource/Benchmarks/Dhrystone/dry: 4.28% (14.0481 => 14.6499, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 2.10% (15.8721 => 16.2059, std.dev.: 0.0039) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5042, std.dev.: 0.0042) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.66% (3.1722 => 3.2247, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.35% (7.1849 => 7.2816, std.dev.: 0.0025) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5138, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.12% (6.9584 => 7.0363, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.08% (50.0626 => 50.6012, std.dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.01% (105.3826 => 106.4462, std.dev.: 0.1163) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.73% (25.4195 => 16.5910, std.dev.: 0.0037) MultiSource/Applications/sgefa/sgefa: -9.26% (1.5554 => 1.4114, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9767, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8014, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/ary2: -7.54% (0.2402 => 0.2221, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9586, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: -5.83% (3.3665 => 3.1703, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.67% (11.2080 => 10.7965, std.dev.: 0.0144) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.31% (21.9346 => 21.2095, std.dev.: 0.0534) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7727, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.61% (0.6293 => 0.6129, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: -2.51% (17.2379 => 16.8045, std.dev.: 0.0275) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5727, std.dev.: 0.0053) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0464, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 2 17:56:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 2 Oct 2012 19:56:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121003005624.4F3492A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4500?compare_to=4496&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4500, Order: 165065, Start Time: 2012-10-02 23:32:41, End Time: 2012-10-03 00:58:04 To: 4496, Order: 165032, Start Time: 2012-10-02 19:34:56, End Time: 2012-10-02 21:00:25 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 0 (172 on baseline) Performance Improvements: 3 (40 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1036 (692 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference-object: -1.68% (0.6555 => 0.6445, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -1.62% (0.6463 => 0.6358, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference: -1.45% (0.7888 => 0.7774, std.dev.: 0.0039) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.00% (2.7526 => 2.7525, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (2.1154 => 2.1154, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.09% (4.9704 => 4.9748, std.dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.09% (2.0176 => 2.4432, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.10% (0.1410 => 0.1637, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 14.89% (0.0826 => 0.0949, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.55% (0.0819 => 0.0930, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 13.11% (0.2243 => 0.2537, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 11.03% (0.4062 => 0.4510, std.dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: 10.93% (0.2781 => 0.3085, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 10.93% (0.4328 => 0.4801, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.92% (0.2721 => 0.3018, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 10.78% (0.5818 => 0.6445, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.69% (0.1413 => 0.1564, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.61% (0.5748 => 0.6358, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: 10.46% (0.1013 => 0.1119, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.42% (0.2782 => 0.3072, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.39% (0.1588 => 0.1753, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 10.38% (1.3693 => 1.5115, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.28% (3.9660 => 4.3739, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 10.10% (0.7061 => 0.7774, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.07% (0.3485 => 0.3836, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.06% (0.3022 => 0.3326, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 10.01% (0.2607 => 0.2868, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.99% (1.4563 => 1.6018, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.94% (0.2655 => 0.2919, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.90% (0.3899 => 0.4285, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 9.89% (0.2690 => 0.2956, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.84% (0.2966 => 0.3258, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 9.83% (0.2726 => 0.2994, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.82% (1.9828 => 2.1776, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 9.82% (0.2760 => 0.3031, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/fibo: 9.78% (0.2628 => 0.2885, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.73% (0.2765 => 0.3034, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.72% (1.2193 => 1.3378, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.72% (0.1276 => 0.1400, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.71% (0.7710 => 0.8459, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.70% (0.9199 => 1.0091, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 9.67% (0.2761 => 0.3028, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 9.67% (0.2937 => 0.3221, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 9.67% (0.3868 => 0.4242, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.65% (0.1327 => 0.1455, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.64% (0.4016 => 0.4403, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 9.63% (0.7038 => 0.7716, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.63% (0.3489 => 0.3825, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 9.60% (0.3293 => 0.3609, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.59% (0.2596 => 0.2845, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.59% (0.4390 => 0.4811, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.57% (0.6283 => 0.6884, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.53% (0.3756 => 0.4114, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.51% (0.1072 => 0.1174, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.50% (0.3580 => 0.3920, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 9.46% (0.3107 => 0.3401, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 9.40% (0.3149 => 0.3445, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.38% (0.2696 => 0.2949, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.35% (0.6959 => 0.7610, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.33% (0.5265 => 0.5756, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/sieve: 9.30% (0.3453 => 0.3774, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.22% (1.1364 => 1.2412, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/matrix: 9.20% (0.2988 => 0.3263, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 9.12% (0.3192 => 0.3483, std.dev.: 0.0043) MultiSource/Applications/SPASS/SPASS: 9.01% (13.8202 => 15.0659, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/lists1: 8.89% (0.3534 => 0.3848, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.79% (0.3130 => 0.3405, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.74% (0.6576 => 0.7151, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 8.61% (0.2995 => 0.3253, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.57% (0.1435 => 0.1558, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 8.50% (0.1589 => 0.1724, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.45% (0.5577 => 0.6048, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 8.42% (0.2945 => 0.3193, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 8.40% (1.0313 => 1.1179, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.35% (0.4791 => 0.5191, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.29% (0.4379 => 0.4742, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.09% (0.2127 => 0.2299, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.99% (0.2504 => 0.2704, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.98% (0.3246 => 0.3505, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 7.92% (0.6744 => 0.7278, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 7.91% (16.6129 => 17.9273, std.dev.: 0.0153) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.86% (0.2914 => 0.3143, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 7.86% (0.8310 => 0.8963, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.1986 => 0.2142, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.78% (0.3755 => 0.4047, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 7.78% (1.1061 => 1.1921, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.77% (0.8698 => 0.9374, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.77% (0.5637 => 0.6075, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.76% (0.2140 => 0.2306, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 7.74% (1.0594 => 1.1414, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.70% (3.6692 => 3.9516, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.62% (7.2180 => 7.7681, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.60% (0.3511 => 0.3778, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.57% (0.7460 => 0.8025, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 7.54% (0.7506 => 0.8072, std.dev.: 0.0073) MultiSource/Benchmarks/McCat/18-imp/imp: 7.52% (0.3220 => 0.3462, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 7.48% (3.1889 => 3.4275, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/09-vor/vor: 7.28% (0.2925 => 0.3138, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 7.19% (3.8646 => 4.1423, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.17% (0.2023 => 0.2168, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.02% (0.1865 => 0.1996) MultiSource/Applications/siod/siod: 6.97% (2.1791 => 2.3309, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 6.91% (14.8535 => 15.8805, std.dev.: 0.0079) MultiSource/Applications/oggenc/oggenc: 6.89% (4.6629 => 4.9844, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 6.83% (0.1478 => 0.1579, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.83% (0.8818 => 0.9420, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 6.81% (1.9270 => 2.0583, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 6.80% (0.3131 => 0.3344, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 6.76% (8.4961 => 9.0702, std.dev.: 0.0129) MultiSource/Applications/SIBsim4/SIBsim4: 6.73% (1.2749 => 1.3607, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.71% (0.1789 => 0.1909, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.71% (0.1819 => 0.1941, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.68% (1.3245 => 1.4130, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 6.64% (0.1657 => 0.1767, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 6.61% (0.4113 => 0.4385, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.50% (0.1569 => 0.1671) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.41% (4.3801 => 4.6609, std.dev.: 0.0117) MultiSource/Applications/hexxagon/hexxagon: 6.39% (1.2292 => 1.3078, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.32% (4.4433 => 4.7241, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.31% (0.6135 => 0.6522, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 6.18% (0.6250 => 0.6636, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 6.01% (0.3578 => 0.3793, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 5.99% (0.3789 => 0.4016, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 5.98% (0.3914 => 0.4148, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 5.95% (0.4003 => 0.4241, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 5.89% (0.3601 => 0.3813, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.87% (0.3646 => 0.3860, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 5.84% (0.3940 => 0.4170, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.82% (3.2742 => 3.4648, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/synchronized: 5.81% (0.3663 => 0.3876, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.75% (0.3650 => 0.3860, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.75% (1.1333 => 1.1985, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.71% (4.9865 => 5.2713, std.dev.: 0.0132) SingleSource/UnitTests/ObjC/exceptions-3: 5.63% (0.3623 => 0.3827, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.60% (0.4805 => 0.5074, std.dev.: 0.0047) MultiSource/Applications/JM/ldecod/ldecod: 5.37% (6.5754 => 6.9284, std.dev.: 0.0086) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.36% (0.9108 => 0.9596, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.21% (0.3245 => 0.3414, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.06% (1.5188 => 1.5956, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.87% (0.2321 => 0.2434, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 4.82% (3.7467 => 3.9272, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.56% (2.1007 => 2.1964, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.44% (13.2842 => 13.8736, std.dev.: 0.0171) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.40% (6.2785 => 6.5549, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 2.90% (16.2614 => 16.7323, std.dev.: 0.0174) MultiSource/Applications/ClamAV/clamscan: 2.33% (14.5298 => 14.8690, std.dev.: 0.0158) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5141, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fbench: 24.37% (1.8175 => 2.2605, std.dev.: 0.0141) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.67% (1.1560 => 1.2562, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (3.1736 => 3.4148, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.28% (1.2998 => 1.3814, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0049, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.65% (0.3139 => 0.3285, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.93% (11.2619 => 11.7042, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.89% (1.7081 => 1.7746, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.39% (10.7476 => 11.1115, std.dev.: 0.0630) SingleSource/Benchmarks/Misc/flops-6: 3.35% (1.9199 => 1.9842, std.dev.: 0.0017) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.15% (7.4271 => 7.5867, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/ffbench: 1.69% (0.8273 => 0.8413, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5127, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 1.32% (5.5130 => 5.5855, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9680, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1869, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.13% (3.1071 => 3.1422, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.09% (8.8259 => 8.9222, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/lists: 1.07% (12.4560 => 12.5889, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.00% (9.9194 => 10.0190, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.68% (0.2670 => 0.1397) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.94% (0.4657 => 0.3868, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -15.98% (0.0707 => 0.0594, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.49% (1.3819 => 1.1817, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.46% (1.3813 => 1.1816, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.54% (22.5627 => 21.5394, std.dev.: 0.0105) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.44% (0.0997 => 0.0863, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/mason/mason: -12.20% (0.2238 => 0.1965, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -11.33% (1.2308 => 1.0913, std.dev.: 0.0331) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.22% (20.3410 => 18.2628, std.dev.: 0.0170) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.33% (1.3780 => 1.3046, std.dev.: 0.0033) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5136, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.80% (0.9996 => 0.9516, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.72% (13.3668 => 12.7363, std.dev.: 0.0191) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8004, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.16% (0.3458 => 0.3314) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1562, std.dev.: 0.0200) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.38% (1.7688 => 1.7091, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.94% (0.4867 => 0.4724, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.46% (3.0263 => 2.9520, std.dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.29% (1.9762 => 1.9309, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.90% (0.6589 => 0.6464, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6940, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/lists: -1.70% (6.3560 => 6.2479, std.dev.: 0.0056) MultiSource/Applications/lua/lua: -1.70% (26.5159 => 26.0655, std.dev.: 0.0354) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0068, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: -1.32% (9.3358 => 9.2130, std.dev.: 0.0106) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4948, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.14% (3.9173 => 3.8725, std.dev.: 0.0133) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2574, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 2 19:12:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 2 Oct 2012 21:12:26 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121003021226.58F202A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4501?compare_to=4497&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4501, Order: 165073, Start Time: 2012-10-03 00:47:21, End Time: 2012-10-03 02:14:08 To: 4497, Order: 165039, Start Time: 2012-10-02 20:54:21, End Time: 2012-10-02 22:28:11 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (8 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 2 (59 on baseline) Performance Improvements: 11 (46 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 77 (69 on baseline) Unchanged Tests: 952 (778 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.08% (0.9504 => 0.9702, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 11.11% (3.3033 => 3.6703, std.dev.: 0.0904) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Ptrdist/bc/bc: -2.50% (1.1143 => 1.0864, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.41% (0.5841 => 0.5700, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.70% (0.6110 => 0.6006, std.dev.: 0.0038) MultiSource/Benchmarks/PAQ8p/paq8p: -1.57% (2.3701 => 2.3328, std.dev.: 0.0111) MultiSource/Applications/treecc/treecc: -1.43% (1.9523 => 1.9243, std.dev.: 0.0073) MultiSource/Applications/SPASS/SPASS: -1.25% (13.9214 => 13.7475, std.dev.: 0.0636) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.21% (0.8239 => 0.8139, std.dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -5.40% (0.7202 => 0.6813, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/primes/primes: -4.34% (0.7977 => 0.7631, std.dev.: 0.0085) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.66% (1.4177 => 1.3658, std.dev.: 0.0171) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.80% (45.6643 => 44.3846, std.dev.: 0.1739) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.35% (0.9983 => 1.0018, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: -1.94% (0.6230 => 0.6109, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/08-main/main: 2.85% (0.1754 => 0.1804, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.39% (0.1551 => 0.1545, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.36% (0.3140 => 0.3066, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.04% (0.2301 => 0.2348, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.29% (0.3243 => 0.3104, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.84% (0.2341 => 0.2298, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: 1.58% (0.0442 => 0.0449, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -65.52% (0.0087 => 0.0030, std.dev.: 0.0027) SingleSource/UnitTests/2003-08-11-VaListArg: -50.56% (0.0089 => 0.0044, std.dev.: 0.0022) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -8.50% (0.0200 => 0.0183, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -28.12% (0.0192 => 0.0138, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.52% (0.0386 => 0.0388, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -23.65% (0.0296 => 0.0226, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.36% (0.0281 => 0.0282) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 16.39% (0.0238 => 0.0277, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/casts: 26.24% (0.0141 => 0.0178, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -10.64% (0.0141 => 0.0126, std.dev.: 0.0032) SingleSource/UnitTests/Vector/multiplies: -0.40% (0.0249 => 0.0248, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -1.91% (0.0314 => 0.0308, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005) MultiSource/Applications/ClamAV/clamscan: -0.34% (0.1465 => 0.1460, std.dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: -0.43% (0.2300 => 0.2290, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 5.89% (1.4116 => 1.4948, std.dev.: 0.0394) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.33% (0.1496 => 0.1491, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.14% (0.5943 => 0.5875, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 4.69% (25.4854 => 26.6810, std.dev.: 0.2428) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.87% (0.4024 => 0.4059, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.09% (0.1363 => 0.1446, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.87% (0.0574 => 0.0579, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 4.14% (0.0169 => 0.0176, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.50% (0.0666 => 0.0636, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.69% (1.1400 => 1.1207, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 9.09% (0.0011 => 0.0012, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.97% (0.0543 => 0.0570, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -21.54% (0.0195 => 0.0153, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.57% (0.7692 => 0.7648, std.dev.: 0.0104) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -0.61% (4.0356 => 4.0111, std.dev.: 0.0158) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -0.37% (59.5035 => 59.2854, std.dev.: 0.4796) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.52% (3.0230 => 2.9468, std.dev.: 0.0296) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 0.37% (2.2912 => 2.2996, std.dev.: 0.0889) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.01% (1.7063 => 1.7065, std.dev.: 0.0014) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: 150.00% (0.0002 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 53.16% (0.0079 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt MultiSource/Applications/JM/lencod/lencod: -96.61% (6.7458 => 0.2290, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -91.57% (6.9722 => 0.5875, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/09-vor/vor: 21469.12% (0.1237 => 26.6810, std.dev.: 0.2428) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -1.35% (4.0659 => 4.0111, std.dev.: 0.0158) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.09% (61.1734 => 59.2854, std.dev.: 0.4796) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.93% (3.2007 => 2.9468, std.dev.: 0.0296) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -2.48% (2.3580 => 2.2996, std.dev.: 0.0889) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.59% (4.1772 => 3.0665, std.dev.: 0.0408) SingleSource/Benchmarks/Shootout-C++/except: 82566.67% (0.0006 => 0.4960, std.dev.: 0.0038) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.42% (0.0745 => 0.0912, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.41% (0.6410 => 0.6949, std.dev.: 0.0043) MultiSource/Applications/minisat/minisat: 7.92% (0.6173 => 0.6662, std.dev.: 0.0076) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.92% (0.1414 => 0.1526, std.dev.: 0.0029) MultiSource/Applications/SIBsim4/SIBsim4: 7.39% (1.1653 => 1.2514, std.dev.: 0.0142) MultiSource/Benchmarks/PAQ8p/paq8p: 7.19% (2.1763 => 2.3328, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/bigfib: 6.91% (0.5309 => 0.5676, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.58% (1.5150 => 1.5995, std.dev.: 0.0080) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.56% (0.3582 => 0.3781, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: 5.54% (1.0046 => 1.0603, std.dev.: 0.0183) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.35% (0.2654 => 0.2796, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 5.21% (15.3105 => 16.1078, std.dev.: 0.1807) MultiSource/Applications/lambda-0_1_3/lambda: 4.97% (0.6915 => 0.7259, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.55% (0.2552 => 0.2668, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.40% (0.6069 => 0.6336, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.25% (0.2797 => 0.2916, std.dev.: 0.0017) MultiSource/Applications/d/make_dparser: 4.08% (3.0225 => 3.1458, std.dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.79% (0.3901 => 0.4049, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.67% (3.0758 => 3.1887, std.dev.: 0.0379) MultiSource/Applications/siod/siod: 3.58% (2.0972 => 2.1722, std.dev.: 0.0142) MultiSource/Benchmarks/nbench/nbench: 3.29% (1.0821 => 1.1177, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.26% (1.1672 => 1.2053, std.dev.: 0.0047) MultiSource/Applications/SPASS/SPASS: 3.18% (13.3238 => 13.7475, std.dev.: 0.0636) MultiSource/Benchmarks/Bullet/bullet: 2.96% (29.3170 => 30.1836, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.73% (1.2021 => 1.2349, std.dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.69% (6.2546 => 6.4231, std.dev.: 0.0331) MultiSource/Applications/lua/lua: 2.60% (3.5980 => 3.6914, std.dev.: 0.0136) MultiSource/Applications/treecc/treecc: 2.37% (1.8798 => 1.9243, std.dev.: 0.0073) MultiSource/Benchmarks/mafft/pairlocalalign: 2.34% (8.2186 => 8.4106, std.dev.: 0.0196) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.07% (4.0318 => 4.1153, std.dev.: 0.0107) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.47% (4.3380 => 4.4016, std.dev.: 0.0158) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 47.13% (0.0261 => 0.0384, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/pi: 41.16% (1.6538 => 2.3345, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2279, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/power/power: 17.89% (1.4184 => 1.6721, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.45% (0.0766 => 0.0892, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/ary3: 15.14% (1.7426 => 2.0065, std.dev.: 0.0226) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.28% (2.4042 => 2.6995, std.dev.: 0.0303) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.10% (0.0917 => 0.1028, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/queens: 10.99% (1.6261 => 1.8048, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/Puzzle: 9.21% (0.1433 => 0.1565, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/mason/mason: 9.03% (0.5004 => 0.5456, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/lists: 8.88% (7.0025 => 7.6240, std.dev.: 0.0089) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.64% (1.0063 => 1.0932, std.dev.: 0.0106) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.51% (0.2857 => 0.3100, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.91% (0.3301 => 0.3496, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/bisort/bisort: 5.48% (0.6459 => 0.6813, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/dt: 4.43% (0.9851 => 1.0287, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.82% (40.4792 => 42.0250, std.dev.: 0.2921) MultiSource/Benchmarks/PAQ8p/paq8p: 3.56% (92.7467 => 96.0458, std.dev.: 0.1543) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.13% (0.5587 => 0.5762, std.dev.: 0.0047) MultiSource/Applications/siod/siod: 3.01% (3.5520 => 3.6590, std.dev.: 0.0152) MultiSource/Applications/hexxagon/hexxagon: 2.85% (14.4877 => 14.9010, std.dev.: 0.0284) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.84% (6.6312 => 6.8194, std.dev.: 0.0069) MultiSource/Benchmarks/mafft/pairlocalalign: 2.70% (62.4126 => 64.1001, std.dev.: 0.0832) SingleSource/Benchmarks/Shootout-C++/hash: 2.46% (0.6308 => 0.6463, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.51% (4.6127 => 4.6822, std.dev.: 0.0170) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.34% (2.9152 => 2.9543, std.dev.: 0.0136) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.10% (2.4455 => 2.4724, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -46.70% (0.0591 => 0.0315, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -45.39% (0.2996 => 0.1636, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.21% (1.4189 => 1.1321, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.77% (1.4113 => 1.1323, std.dev.: 0.0030) SingleSource/UnitTests/Vector/constpool: -8.20% (8.9977 => 8.2603, std.dev.: 0.2051) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -42.49% (0.3497 => 0.2011, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -26.77% (15.8312 => 11.5933, std.dev.: 0.0864) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.41% (5.2665 => 4.1388, std.dev.: 0.1111) SingleSource/Benchmarks/Shootout-C++/ary3: -20.64% (1.7473 => 1.3866, std.dev.: 0.0514) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.04% (1.7361 => 1.4750, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1587, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: -11.50% (1.0926 => 0.9670, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.70% (1.1647 => 1.0517, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: -8.39% (9.5474 => 8.7459, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.39% (1.4034 => 1.2856, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -7.39% (2.5166 => 2.3305, std.dev.: 0.0125) MultiSource/Applications/sgefa/sgefa: -7.05% (0.3746 => 0.3482, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.93% (3.6254 => 3.3742, std.dev.: 0.0042) MultiSource/Applications/lambda-0_1_3/lambda: -6.77% (7.6833 => 7.1631, std.dev.: 0.0217) SingleSource/Benchmarks/Shootout-C++/fibo: -6.58% (4.6355 => 4.3304, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.48% (2.0027 => 1.8730, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -6.20% (1.4441 => 1.3545, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.02% (2.9728 => 2.7939, std.dev.: 0.0077) MultiSource/Benchmarks/FreeBench/distray/distray: -5.78% (0.2664 => 0.2510, std.dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: -5.63% (3.4230 => 3.2303, std.dev.: 0.0604) SingleSource/Benchmarks/Shootout/fib2: -5.47% (4.4195 => 4.1779, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.46% (3.9413 => 3.7262, std.dev.: 0.0160) SingleSource/Benchmarks/BenchmarkGame/n-body: -4.77% (1.5803 => 1.5049, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.69% (0.4564 => 0.4350, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -4.22% (3.4080 => 3.2641, std.dev.: 0.0053) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.89% (1.2722 => 1.2227, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/methcall: -3.75% (9.2503 => 8.9037, std.dev.: 0.0832) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.67% (9.3855 => 9.0409, std.dev.: 0.0244) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.38% (45.4683 => 44.3846, std.dev.: 0.1739) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.25% (3.7496 => 3.6652, std.dev.: 0.0236) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.17% (1.1683 => 1.1430, std.dev.: 0.0015) MultiSource/Benchmarks/sim/sim: -2.09% (3.8907 => 3.8093, std.dev.: 0.0039) MultiSource/Applications/aha/aha: -1.94% (3.4286 => 3.3620, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: -1.85% (3.4876 => 3.4232, std.dev.: 0.0198) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.83% (2.3569 => 2.3138, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -1.41% (2.4971 => 2.4620, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3054, std.dev.: 0.0257) MultiSource/Applications/spiff/spiff: -1.36% (2.8599 => 2.8209, std.dev.: 0.0108) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.31% (27.1724 => 26.8168, std.dev.: 0.0767) SingleSource/Benchmarks/Shootout-C++/lists: -1.13% (16.5617 => 16.3747, std.dev.: 0.0293) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.38% (0.9980 => 1.0018, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.44% (0.6022 => 0.6109, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/08-main/main: 8.28% (0.1666 => 0.1804, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.58% (0.1554 => 0.1545, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.55% (0.3083 => 0.3066, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.92% (0.2394 => 0.2348, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.24% (0.3175 => 0.3104, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.17% (0.2302 => 0.2298, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: - (0.0449 => 0.0449, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: -66.29% (0.0089 => 0.0030, std.dev.: 0.0027) SingleSource/UnitTests/2003-08-11-VaListArg: -51.11% (0.0090 => 0.0044, std.dev.: 0.0022) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -23.75% (0.0240 => 0.0183, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -28.12% (0.0192 => 0.0138, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.51% (0.0390 => 0.0388, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -24.92% (0.0301 => 0.0226, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.70% (0.0284 => 0.0282) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -14.51% (0.0324 => 0.0277, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0177 => 0.0178, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -33.33% (0.0189 => 0.0126, std.dev.: 0.0032) SingleSource/UnitTests/Vector/multiplies: -0.40% (0.0249 => 0.0248, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -5.23% (0.0325 => 0.0308, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005) MultiSource/Applications/ClamAV/clamscan: 2.17% (0.1429 => 0.1460, std.dev.: 0.0032) MultiSource/Applications/lemon/lemon: -0.47% (1.5019 => 1.4948, std.dev.: 0.0394) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.67% (0.1501 => 0.1491, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.81% (0.4264 => 0.4059, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.59% (0.1344 => 0.1446, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.70% (0.0589 => 0.0579, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -24.14% (0.0232 => 0.0176, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.47% (0.0639 => 0.0636, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.26% (1.1350 => 1.1207, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.52% (0.0637 => 0.0570, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -37.80% (0.0246 => 0.0153, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.42% (0.7541 => 0.7648, std.dev.: 0.0104) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.08% (1.5363 => 1.7065, std.dev.: 0.0014) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 2 19:28:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 2 Oct 2012 21:28:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121003022848.9A79F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4502?compare_to=4498&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4502, Order: 165073, Start Time: 2012-10-03 01:10:47, End Time: 2012-10-03 02:30:27 To: 4498, Order: 165043, Start Time: 2012-10-02 21:26:11, End Time: 2012-10-02 22:45:38 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (147 on baseline) Performance Improvements: 0 (47 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 951 (693 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.30% (14.7819 => 15.1219, std.dev.: 0.0154) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.42% (1.2941 => 1.3125, std.dev.: 0.0012) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.02% (0.5738 => 0.5739, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: -0.07% (15.9691 => 15.9587, std.dev.: 0.0118) MultiSource/Benchmarks/Bullet/bullet: -0.01% (54.1064 => 54.1017, std.dev.: 0.0124) MultiSource/Benchmarks/MallocBench/gs/gs: -0.18% (4.3164 => 4.3085, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.22% (0.0459 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.22% (0.0461 => 0.0462) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.47% (0.0428 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.23% (0.0430 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.24% (0.0418 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.24% (0.0420 => 0.0421, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.49% (0.0412 => 0.0414) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.24% (0.0414 => 0.0415, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.47% (0.0429 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.46% (0.0431 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.47% (0.0424 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.47% (0.0425 => 0.0427, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.24% (0.0414 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.24% (0.0416 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.48% (0.0421 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.24% (0.0423 => 0.0424, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.46% (0.0432 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.07% (0.0434 => 0.0456, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.73% (0.0409 => 0.0412) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.24% (0.0411 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.48% (0.0421 => 0.0423, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.24% (0.0423 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.49% (0.0412 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.48% (0.0414 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.25% (0.0405 => 0.0406) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.25% (0.0406 => 0.0407) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.50% (0.0403 => 0.0405) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.49% (0.0405 => 0.0407, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.45% (0.0440 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.45% (0.0442 => 0.0444, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.25% (0.0403 => 0.0404) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.25% (0.0404 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.25% (0.0404 => 0.0405) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.25% (0.0405 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.49% (0.0411 => 0.0413) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.24% (0.0413 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.01% (1.2285 => 1.2284, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.05% (7.5426 => 7.5390, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.18% (0.7279 => 0.7292, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.28% (0.0360 => 0.0361, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: - (0.1434 => 0.1434, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.30% (0.0651 => 0.0666, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -14.46% (63.2438 => 54.1017, std.dev.: 0.0124) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 30.52% (14.1553 => 18.4759, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++-EH/spirit: 58.01% (3.4629 => 5.4717, std.dev.: 0.0227) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14228.19% (0.0720 => 10.3163, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10003700.00% (0.0001 => 10.0038, std.dev.: 0.0061) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 45.97% (0.2554 => 0.3728, std.dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: 45.86% (10.3673 => 15.1219, std.dev.: 0.0154) SingleSource/Benchmarks/Misc/richards_benchmark: 30.21% (0.1622 => 0.2112, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 29.64% (0.1056 => 0.1369, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 13.83% (0.1432 => 0.1630, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.44% (2.2022 => 2.4982, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.30% (7.0540 => 7.9922, std.dev.: 0.0118) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.77% (0.1566 => 0.1766, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.59% (0.0834 => 0.0939, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.66% (1.7609 => 1.9662, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.61% (0.3543 => 0.3919, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 10.45% (0.3473 => 0.3836, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 10.38% (0.3497 => 0.3860, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.25% (0.3561 => 0.3926, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-4: 10.25% (0.3543 => 0.3906, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.24% (0.3516 => 0.3876, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.04% (0.1584 => 0.1743, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.99% (0.3694 => 0.4063, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 9.98% (10.4361 => 11.4772, std.dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: 9.86% (9.4845 => 10.4201, std.dev.: 0.0108) SingleSource/UnitTests/ObjC/parameter-passing: 9.85% (0.3927 => 0.4314, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.85% (0.3828 => 0.4205, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.65% (0.3886 => 0.4261, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 9.08% (0.3282 => 0.3580, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.41% (0.1438 => 0.1559, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.40% (0.4879 => 0.5289, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 8.05% (0.5925 => 0.6402, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 8.04% (0.1655 => 0.1788, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 7.98% (0.6030 => 0.6511, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.96% (0.3177 => 0.3430, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.67% (0.6675 => 0.7187, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.61% (0.2603 => 0.2801, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 7.59% (0.3109 => 0.3345, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 7.54% (5.7591 => 6.1936, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.49% (1.5415 => 1.6570, std.dev.: 0.0060) MultiSource/Applications/minisat/minisat: 7.42% (0.7115 => 0.7643, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference: 7.25% (0.7326 => 0.7857, std.dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 7.14% (0.7433 => 0.7964, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 7.14% (0.1695 => 0.1816, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.13% (0.4615 => 0.4944, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists: 7.07% (0.3422 => 0.3664, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.06% (0.2891 => 0.3095, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.91% (0.2271 => 0.2428, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.88% (0.2905 => 0.3105, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.88% (0.2065 => 0.2207, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.87% (0.4103 => 0.4385, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.84% (0.5105 => 0.5454, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.83% (0.8172 => 0.8730, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.83% (1.3050 => 1.3941, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 6.81% (0.3423 => 0.3656, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 6.75% (3.3354 => 3.5605, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 6.75% (0.2831 => 0.3022, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.69% (0.5860 => 0.6252, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.66% (0.3136 => 0.3345, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.65% (0.3232 => 0.3447, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 6.65% (0.4048 => 0.4317, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.59% (0.3052 => 0.3253, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.58% (0.1625 => 0.1732, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.58% (0.3650 => 0.3890, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.57% (0.2725 => 0.2904, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.57% (0.2756 => 0.2937, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.56% (2.0665 => 2.2020, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash: 6.55% (0.4289 => 0.4570, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.55% (0.3865 => 0.4118, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.54% (4.2646 => 4.5434, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.52% (0.4203 => 0.4477, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.51% (0.3162 => 0.3368, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.51% (0.8067 => 0.8592, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 6.51% (0.6456 => 0.6876, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.47% (0.2877 => 0.3063, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 6.46% (0.3098 => 0.3298, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/except: 6.44% (0.2871 => 0.3056, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.41% (0.2700 => 0.2873, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.41% (0.2872 => 0.3056, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.39% (0.2802 => 0.2981, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.37% (0.2793 => 0.2971, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.35% (0.3826 => 0.4069, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/hello: 6.30% (0.2714 => 0.2885, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 6.28% (0.7835 => 0.8327, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary3: 6.27% (0.3283 => 0.3489, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.27% (4.9449 => 5.2550, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.27% (8.1363 => 8.6464, std.dev.: 0.0111) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.25% (7.9617 => 8.4597, std.dev.: 0.0103) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.22% (0.2107 => 0.2238, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 6.20% (1.5603 => 1.6571, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.20% (0.5569 => 0.5914, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.19% (5.0018 => 5.3113, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/lists1: 6.16% (0.3684 => 0.3911, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.15% (0.3121 => 0.3313, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.15% (0.4636 => 0.4921, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.14% (0.3307 => 0.3510, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.13% (0.3603 => 0.3824, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.13% (0.4620 => 0.4903, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.11% (0.9765 => 1.0362, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.06% (0.2758 => 0.2925, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.02% (0.5020 => 0.5322, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 5.95% (0.4299 => 0.4555, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 5.95% (0.3379 => 0.3580, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.82% (0.1940 => 0.2053, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 5.76% (1.1642 => 1.2312, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 5.70% (0.3387 => 0.3580, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 5.48% (3.8723 => 4.0845, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.34% (1.1861 => 1.2494, std.dev.: 0.0038) MultiSource/Applications/lemon/lemon: 5.33% (1.0722 => 1.1293, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.14% (0.3441 => 0.3618, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 5.09% (0.3180 => 0.3342, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 5.01% (2.0273 => 2.1289, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: 4.83% (0.8921 => 0.9352, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.81% (0.6450 => 0.6760, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 4.80% (21.9371 => 22.9897, std.dev.: 0.0216) MultiSource/Applications/siod/siod: 4.77% (2.2969 => 2.4065, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.72% (0.4064 => 0.4256, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 4.60% (0.3131 => 0.3275, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.58% (1.5859 => 1.6586, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.55% (0.5981 => 0.6253, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.24% (1.2842 => 1.3386, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.16% (2.2024 => 2.2940, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.00% (1.1840 => 1.2314, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.99% (1.4186 => 1.4752, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.97% (0.8101 => 0.8342, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.70% (0.3817 => 0.3920, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.40% (14.3668 => 14.7118, std.dev.: 0.0115) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.24% (1.1194 => 1.1445, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.76% (17.1811 => 17.4841, std.dev.: 0.0161) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.68% (3.8922 => 3.9576, std.dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 30.45% (1.1277 => 1.4711, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 10.15% (3.1595 => 3.4802, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 6.69% (1.1396 => 1.2158, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3685, std.dev.: 0.0033) SingleSource/Regression/C/uint64_to_float: 3.66% (0.5413 => 0.5611, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.49% (3.6395 => 3.7667, std.dev.: 0.0043) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.72% (4.2280 => 4.3432, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.34% (1.7254 => 1.7657, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.53% (0.8275 => 0.8402, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.34% (0.9540 => 0.9668, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.12% (6.5088 => 6.5814, std.dev.: 0.0052) MultiSource/Applications/minisat/minisat: 1.04% (9.1159 => 9.2105, std.dev.: 0.0056) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7616, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1283, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -80.36% (0.8651 => 0.1699, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.12% (5.2763 => 3.2649, std.dev.: 0.0140) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.39% (5.3855 => 3.5874, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -33.06% (5.3526 => 3.5832, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -14.90% (54.1659 => 46.0942, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/mason/mason: -14.30% (0.0811 => 0.0695, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.95% (2.9384 => 2.6166, std.dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: -10.80% (22.1758 => 19.7818, std.dev.: 0.0137) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.46% (1.1492 => 0.7647, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4246, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.83% (0.0998 => 0.0860, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: -12.67% (1.3677 => 1.1944, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.81% (1.2373 => 1.0912, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/mandel-2: -10.40% (1.5373 => 1.3774, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -10.09% (0.2161 => 0.1943, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.35% (19.9488 => 18.2823, std.dev.: 0.0215) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.68% (1.8329 => 1.7104, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.65% (0.2497 => 0.2331, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.33% (13.4384 => 12.7220, std.dev.: 0.0129) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.01% (1.6805 => 1.5963, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.98% (5.0483 => 4.7968, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5065, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.30% (0.3463 => 0.3314, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.30% (0.9957 => 0.9529, std.dev.: 0.0077) MultiSource/Applications/siod/siod: -3.72% (3.2827 => 3.1607, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.40% (32.5116 => 31.4058, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: -2.43% (12.4730 => 12.1700, std.dev.: 0.0013) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.10% (0.4808 => 0.4707, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.98% (8.1563 => 7.9945, std.dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.82% (8.6802 => 8.5224, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6816, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -1.72% (10.2830 => 10.1064, std.dev.: 0.0140) SingleSource/UnitTests/Vector/multiplies: -1.57% (2.5528 => 2.5126, std.dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: -1.51% (9.5636 => 9.4194, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: -1.51% (4.6441 => 4.5741, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8574, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout/lists: -1.04% (6.2999 => 6.2346, std.dev.: 0.0074) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.75% (0.5229 => 0.5739, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 6.47% (14.9895 => 15.9587, std.dev.: 0.0118) MultiSource/Benchmarks/MallocBench/gs/gs: 4.82% (4.1105 => 4.3085, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.19% (1.1048 => 1.2284, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.32% (7.1582 => 7.5390, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/stepanov_container: 17.20% (0.6222 => 0.7292, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36000.00% (0.0001 => 0.0361, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.43% (0.1485 => 0.1434, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.53% (0.2116 => 0.0666, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 2 20:41:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 2 Oct 2012 22:41:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121003034117.950BA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4503?compare_to=4499&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4503, Order: 165072, Start Time: 2012-10-03 00:34:16, End Time: 2012-10-03 03:42:57 To: 4499, Order: 165039, Start Time: 2012-10-02 20:56:23, End Time: 2012-10-03 00:05:19 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 3 (130 on baseline) Performance Improvements: 2 (18 on baseline) Added Tests: 0 (131 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1034 (760 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.61% (1.7345 => 1.7624, std.dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.51% (79.8579 => 82.6643, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.96% (2.0743 => 2.1149, std.dev.: 0.0075) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.13% (106.4462 => 104.1813, std.dev.: 0.0503) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.04% (41.7961 => 41.3628, std.dev.: 0.0087) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.02% (9.8091 => 9.8112, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.01% (9.4122 => 9.4112, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.05% (16.9297 => 16.9218, std.dev.: 0.0055) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 11.81% (0.3446 => 0.3853, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.80% (0.3465 => 0.3874, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.80% (0.3442 => 0.3848, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.70% (0.3496 => 0.3905, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.67% (0.3488 => 0.3895, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.56% (0.3460 => 0.3860, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.56% (0.3469 => 0.3870, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.26% (0.3650 => 0.4061, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/exceptions: 11.20% (0.3643 => 0.4051, std.dev.: 0.0064) SingleSource/UnitTests/ObjC/parameter-passing: 11.04% (0.3724 => 0.4135, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.82% (0.1063 => 0.1178, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 10.62% (1.5932 => 1.7624, std.dev.: 0.0053) SingleSource/UnitTests/ObjC++/Hello: 9.27% (0.5826 => 0.6366, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.20% (0.5889 => 0.6431, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.77% (0.2875 => 0.3127, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.20% (1.3152 => 1.4230, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 8.15% (0.1619 => 0.1751, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 8.12% (0.3004 => 0.3248, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 8.11% (0.2725 => 0.2946, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.08% (0.3195 => 0.3453, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.07% (0.2738 => 0.2959, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 8.04% (0.2750 => 0.2971, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 8.03% (0.2714 => 0.2932, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.99% (0.2729 => 0.2947, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 7.97% (0.2823 => 0.3048, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 7.93% (0.2813 => 0.3036, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 7.92% (0.2803 => 0.3025, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.88% (0.2792 => 0.3012, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 7.84% (0.2780 => 0.2998, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.82% (2.0673 => 2.2290, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 7.77% (0.7171 => 0.7728, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.76% (0.2911 => 0.3137, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.76% (0.2811 => 0.3029, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.75% (0.3096 => 0.3336, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 7.62% (0.9909 => 1.0664, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.48% (0.3060 => 0.3289, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 7.47% (0.3267 => 0.3511, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.47% (0.3362 => 0.3613, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 7.40% (0.3258 => 0.3499, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.35% (0.4994 => 0.5361, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.30% (1.6211 => 1.7395, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary2: 7.27% (0.3317 => 0.3558, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.25% (0.3282 => 0.3520, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.23% (0.3124 => 0.3350, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.20% (0.4361 => 0.4675, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 7.18% (0.3678 => 0.3942, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.17% (3.5627 => 3.8182, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: 7.17% (0.3348 => 0.3588, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 7.08% (0.3477 => 0.3723, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.06% (0.3625 => 0.3881, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 7.06% (0.3726 => 0.3989, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.05% (0.2014 => 0.2156, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.91% (0.1620 => 0.1732, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.89% (0.3845 => 0.4110, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.80% (0.2736 => 0.2922, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.78% (0.3690 => 0.3940, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.76% (0.5000 => 0.5338, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 6.75% (0.4251 => 0.4538, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.75% (2.7292 => 2.9134, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/hash: 6.71% (0.4146 => 0.4424, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.66% (0.3981 => 0.4246, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 6.60% (5.5417 => 5.9074, std.dev.: 0.0045) MultiSource/Applications/d/make_dparser: 6.50% (1.0781 => 1.1482, std.dev.: 0.0101) MultiSource/Benchmarks/Bullet/bullet: 6.40% (23.5202 => 25.0255, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.39% (0.3930 => 0.4181, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.27% (0.5026 => 0.5341, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 6.12% (2.1013 => 2.2300, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.03% (0.6435 => 0.6823, std.dev.: 0.0080) MultiSource/Benchmarks/nbench/nbench: 6.00% (0.2566 => 0.2720, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 5.99% (0.5012 => 0.5312, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 5.87% (4.2109 => 4.4582, std.dev.: 0.0041) MultiSource/Applications/siod/siod: 5.82% (0.6634 => 0.7020, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.81% (0.3890 => 0.4116, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.80% (4.4195 => 4.6760, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.79% (0.2866 => 0.3032, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.75% (0.2068 => 0.2187, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.73% (0.4139 => 0.4376, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.70% (0.2737 => 0.2893, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.67% (0.4658 => 0.4922, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 5.67% (1.8794 => 1.9859, std.dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: 5.54% (4.6177 => 4.8737, std.dev.: 0.0095) MultiSource/Applications/spiff/spiff: 5.53% (0.4029 => 0.4252, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.45% (0.3084 => 0.3252, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.44% (0.5900 => 0.6221, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 5.41% (1.4269 => 1.5041, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.41% (0.3903 => 0.4114, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.38% (0.3271 => 0.3447, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 5.38% (2.1653 => 2.2817, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.28% (0.1968 => 0.2072, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 5.10% (0.5546 => 0.5829, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: 5.07% (0.3336 => 0.3505, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: 5.06% (0.9697 => 1.0188, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.98% (1.9694 => 2.0674, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.78% (0.2969 => 0.3111, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.72% (1.9966 => 2.0908, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 4.56% (0.7875 => 0.8234, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 4.48% (0.4847 => 0.5064, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 4.47% (2.0346 => 2.1256, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 4.42% (0.2691 => 0.2810, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.01% (0.7426 => 0.7724, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.81% (0.5361 => 0.5565, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.51% (0.5584 => 0.5780, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.48% (11.6398 => 12.0446, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.46% (4.6926 => 4.8548, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.41% (0.4253 => 0.4398, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 3.09% (0.3498 => 0.3606, std.dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: 2.32% (11.9555 => 12.2334, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0300, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700) SingleSource/Benchmarks/Shootout-C++/ary: 6.03% (0.2122 => 0.2250, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/n-body: 5.88% (3.3903 => 3.5896, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 5.22% (12.0509 => 12.6802, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/flops-2: 4.70% (1.8057 => 1.8905, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1676, std.dev.: 0.0555) SingleSource/Benchmarks/Dhrystone/dry: 4.31% (14.0481 => 14.6537, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.41% (79.9355 => 82.6643, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/ary3: 2.09% (15.8721 => 16.2042, std.dev.: 0.0065) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5062, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.70% (3.1722 => 3.2262, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.58% (2.0820 => 2.1149, std.dev.: 0.0075) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2854, std.dev.: 0.0028) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.12% (6.9584 => 7.0363, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5917, std.dev.: 0.0149) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.88% (25.4195 => 16.5533, std.dev.: 0.0169) MultiSource/Applications/sgefa/sgefa: -9.25% (1.5554 => 1.4115, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9756, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8024, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary2: -6.45% (0.2402 => 0.2247, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -5.83% (3.3665 => 3.1704, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.72% (11.2080 => 10.7912, std.dev.: 0.0072) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7736, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.96% (0.6293 => 0.6107, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.84% (21.9346 => 21.3127, std.dev.: 0.0740) SingleSource/Benchmarks/Dhrystone/fldry: -2.83% (17.2379 => 16.7495, std.dev.: 0.0543) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5781, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.14% (105.3826 => 104.1813, std.dev.: 0.0503) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0434, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.03% (41.7953 => 41.3628, std.dev.: 0.0087) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 2 20:55:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 2 Oct 2012 22:55:27 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121003035527.F19512A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4504?compare_to=4501&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4504, Order: 165087, Start Time: 2012-10-03 02:30:01, End Time: 2012-10-03 03:57:09 To: 4501, Order: 165073, Start Time: 2012-10-03 00:47:21, End Time: 2012-10-03 02:14:08 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 1 (9 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 11 (76 on baseline) Performance Improvements: 8 (50 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 77 (69 on baseline) Unchanged Tests: 945 (756 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.66% (42.0250 => 40.4881, std.dev.: 0.3851) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.22% (0.8853 => 0.8961, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/sgefa/sgefa: 23.87% (0.3482 => 0.4313, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.41% (3.0158 => 3.2996, std.dev.: 0.0519) SingleSource/Benchmarks/Shootout/heapsort: 7.38% (3.0465 => 3.2713, std.dev.: 0.0840) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.94% (0.7631 => 0.8084, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 3.09% (5.6974 => 5.8737, std.dev.: 0.0180) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.88% (1.2676 => 1.3041, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.69% (2.6930 => 2.7386, std.dev.: 0.0125) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.36% (11.5933 => 11.7510, std.dev.: 0.0310) SingleSource/Benchmarks/Misc/fbench: 1.25% (3.3977 => 3.4402, std.dev.: 0.0075) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.02% (1.2227 => 1.2352, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.06% (0.7840 => 0.7522, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -2.31% (0.8066 => 0.7880, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.68% (3.1887 => 3.1352, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.39% (0.9702 => 0.9567, std.dev.: 0.0041) MultiSource/Applications/SIBsim4/SIBsim4: -1.15% (1.2514 => 1.2370, std.dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: -10.42% (3.6703 => 3.2879, std.dev.: 0.1046) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.63% (0.4159 => 0.3925, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -2.34% (6.0328 => 5.8919, std.dev.: 0.0040) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.41% (1.0018 => 1.0059, std.dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: 2.16% (0.6109 => 0.6241, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/08-main/main: -0.39% (0.1804 => 0.1797, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.91% (0.1545 => 0.1500, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.40% (0.3066 => 0.3109, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.26% (0.2348 => 0.2354, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.77% (0.3104 => 0.3190, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.09% (0.2298 => 0.2323, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel: 1.11% (0.0449 => 0.0454, std.dev.: 0.0019) SingleSource/UnitTests/2003-05-07-VarArgs: 196.67% (0.0030 => 0.0089) SingleSource/UnitTests/2003-08-11-VaListArg: 104.55% (0.0044 => 0.0090, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.74% (0.0183 => 0.0199, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -15.22% (0.0138 => 0.0117, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.64% (0.0388 => 0.0370, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -3.54% (0.0226 => 0.0218, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.42% (0.0282 => 0.0286, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 16.61% (0.0277 => 0.0323, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 1.69% (0.0178 => 0.0181, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -7.14% (0.0126 => 0.0117, std.dev.: 0.0025) SingleSource/UnitTests/Vector/multiplies: 1.21% (0.0248 => 0.0251, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: 6.17% (0.0308 => 0.0327, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.34% (0.1460 => 0.1465, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 0.52% (0.2290 => 0.2302, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: -1.08% (1.4948 => 1.4786, std.dev.: 0.0438) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.54% (0.1491 => 0.1483, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -0.20% (0.5875 => 0.5863, std.dev.: 0.0115) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 0.50% (26.6810 => 26.8135, std.dev.: 0.2096) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.25% (0.4059 => 0.4069, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.02% (0.1446 => 0.1359, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.39% (0.0579 => 0.0542, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.70% (0.0176 => 0.0173, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.39% (0.0636 => 0.0589, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.41% (1.1207 => 1.1253, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 25.00% (0.0012 => 0.0015, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.68% (0.0570 => 0.0591, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.84% (0.0153 => 0.0141, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.50% (0.7648 => 0.7686, std.dev.: 0.0215) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 0.38% (4.0111 => 4.0265, std.dev.: 0.0145) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 0.06% (59.2854 => 59.3238, std.dev.: 0.5820) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -0.05% (2.9468 => 2.9453, std.dev.: 0.0408) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.35% (2.2996 => 2.3766, std.dev.: 0.3148) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.01% (1.7065 => 1.7067, std.dev.: 0.0162) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -61.98% (0.0121 => 0.0046, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt MultiSource/Applications/JM/lencod/lencod: -96.59% (6.7458 => 0.2302, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -91.59% (6.9722 => 0.5863, std.dev.: 0.0115) MultiSource/Benchmarks/McCat/09-vor/vor: 21576.23% (0.1237 => 26.8135, std.dev.: 0.2096) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -0.97% (4.0659 => 4.0265, std.dev.: 0.0145) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 0.02% (40.4792 => 40.4881, std.dev.: 0.3851) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.02% (61.1734 => 59.3238, std.dev.: 0.5820) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.98% (3.2007 => 2.9453, std.dev.: 0.0408) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 0.79% (2.3580 => 2.3766, std.dev.: 0.3148) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.57% (4.1772 => 3.1090, std.dev.: 0.0532) SingleSource/Benchmarks/Shootout-C++/except: 82250.00% (0.0006 => 0.4941, std.dev.: 0.0025) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.28% (0.0745 => 0.0911, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.89% (0.1159 => 0.1262, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 7.96% (2.1763 => 2.3495, std.dev.: 0.0469) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.92% (0.1414 => 0.1526, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 6.97% (0.5309 => 0.5679, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.86% (0.6410 => 0.6850, std.dev.: 0.0058) MultiSource/Applications/minisat/minisat: 6.59% (0.6173 => 0.6580, std.dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 6.15% (1.1653 => 1.2370, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 6.02% (1.0046 => 1.0651, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.61% (0.3582 => 0.3783, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.32% (1.5150 => 1.5956, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.29% (0.2552 => 0.2687, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 5.27% (15.3105 => 16.1179, std.dev.: 0.1026) MultiSource/Applications/lambda-0_1_3/lambda: 4.87% (0.6915 => 0.7252, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.68% (0.6069 => 0.6353, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.56% (0.2654 => 0.2775, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.28% (0.3062 => 0.3193, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.15% (0.7639 => 0.7956, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.90% (0.3901 => 0.4053, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/18-imp/imp: 3.89% (0.3217 => 0.3342, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.86% (0.4248 => 0.4412, std.dev.: 0.0045) MultiSource/Benchmarks/Bullet/bullet: 3.73% (29.3170 => 30.4108, std.dev.: 0.0933) MultiSource/Applications/d/make_dparser: 3.61% (3.0225 => 3.1316, std.dev.: 0.0185) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.34% (1.1827 => 1.2222, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.33% (13.3238 => 13.7672, std.dev.: 0.1000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.26% (0.4880 => 0.5039, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.26% (1.1672 => 1.2052, std.dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: 3.23% (8.2186 => 8.4843, std.dev.: 0.0386) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.93% (1.2021 => 1.2373, std.dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 2.89% (1.0821 => 1.1134, std.dev.: 0.0104) MultiSource/Applications/siod/siod: 2.77% (2.0972 => 2.1553, std.dev.: 0.0159) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.67% (12.6413 => 12.9793, std.dev.: 0.0656) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.67% (6.2546 => 6.4217, std.dev.: 0.0108) MultiSource/Applications/oggenc/oggenc: 2.66% (4.7455 => 4.8715, std.dev.: 0.0187) MultiSource/Applications/hbd/hbd: 2.34% (1.3268 => 1.3578, std.dev.: 0.0106) MultiSource/Applications/JM/lencod/lencod: 2.31% (14.7256 => 15.0658, std.dev.: 0.0653) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.21% (0.8569 => 0.8758, std.dev.: 0.0023) MultiSource/Applications/lua/lua: 2.07% (3.5980 => 3.6725, std.dev.: 0.0162) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.03% (2.0317 => 2.0729, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.01% (1.4408 => 1.4698, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.93% (3.0758 => 3.1352, std.dev.: 0.0121) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.93% (1.0689 => 1.0895, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.29% (4.0318 => 4.0839, std.dev.: 0.0115) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.29% (4.2616 => 4.3165, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.05% (8.2559 => 8.3423, std.dev.: 0.0242) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 49.81% (0.0263 => 0.0394, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/pi: 41.41% (1.6538 => 2.3386, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/matrix: 22.13% (3.4629 => 4.2292, std.dev.: 0.0228) MultiSource/Benchmarks/Olden/power/power: 17.84% (1.4184 => 1.6714, std.dev.: 0.0032) MultiSource/Applications/sgefa/sgefa: 15.14% (0.3746 => 0.4313, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout/ary3: 14.97% (1.7426 => 2.0035, std.dev.: 0.0227) SingleSource/Benchmarks/Stanford/Puzzle: 13.54% (0.1433 => 0.1627, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.88% (2.4042 => 2.7138, std.dev.: 0.0144) SingleSource/Benchmarks/McGill/queens: 11.08% (1.6261 => 1.8063, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.06% (3.0256 => 3.2996, std.dev.: 0.0519) SingleSource/Benchmarks/Shootout/lists: 8.65% (7.0025 => 7.6082, std.dev.: 0.0264) MultiSource/Benchmarks/FreeBench/mason/mason: 8.59% (0.5004 => 0.5434, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.30% (0.2857 => 0.3094, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.07% (1.0063 => 1.0875, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 6.24% (0.7609 => 0.8084, std.dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.88% (0.8498 => 0.8998, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.85% (0.3301 => 0.3494, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/bisort/bisort: 5.84% (0.6459 => 0.6836, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/dt: 4.35% (0.9851 => 1.0280, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 4.06% (92.7467 => 96.5153, std.dev.: 0.6392) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.28% (0.5587 => 0.5770, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.85% (6.6312 => 6.8205, std.dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 2.84% (14.4877 => 14.8996, std.dev.: 0.0231) SingleSource/Benchmarks/Shootout-C++/hash: 2.74% (0.6308 => 0.6481, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.74% (2.6656 => 2.7386, std.dev.: 0.0125) MultiSource/Applications/siod/siod: 2.67% (3.5520 => 3.6468, std.dev.: 0.0124) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.48% (1.2726 => 1.3041, std.dev.: 0.0079) MultiSource/Benchmarks/mafft/pairlocalalign: 2.20% (62.4126 => 63.7878, std.dev.: 0.0541) SingleSource/Benchmarks/Dhrystone/dry: 2.17% (2.4013 => 2.4534, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.99% (4.6127 => 4.7047, std.dev.: 0.0153) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (2.4455 => 2.4720, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -45.43% (0.2996 => 0.1635, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -45.18% (0.0591 => 0.0324, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.99% (1.4189 => 1.1211, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -20.31% (1.4113 => 1.1246, std.dev.: 0.0072) SingleSource/UnitTests/Vector/constpool: -9.65% (8.9977 => 8.1291, std.dev.: 0.3136) MultiSource/Benchmarks/VersaBench/dbms/dbms: -2.59% (0.7722 => 0.7522, std.dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.98% (0.3497 => 0.2029, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -25.77% (15.8312 => 11.7510, std.dev.: 0.0310) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.32% (5.2665 => 4.1965, std.dev.: 0.0621) SingleSource/Benchmarks/Shootout-C++/ary3: -19.59% (1.7473 => 1.4050, std.dev.: 0.0265) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.07% (1.7361 => 1.4744, std.dev.: 0.0240) MultiSource/Benchmarks/McCat/17-bintr/bintr: -13.20% (0.0917 => 0.0796, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1597, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/neural/neural: -11.49% (1.0926 => 0.9671, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.37% (1.1647 => 1.0439, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ackermann: -8.73% (3.6023 => 3.2879, std.dev.: 0.1046) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2863, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: -8.34% (9.5474 => 8.7515, std.dev.: 0.0172) MultiSource/Benchmarks/Olden/bh/bh: -7.04% (2.5166 => 2.3394, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.83% (3.6254 => 3.3779, std.dev.: 0.0094) MultiSource/Applications/lambda-0_1_3/lambda: -6.51% (7.6833 => 7.1829, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.50% (2.0027 => 1.8725, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -6.49% (4.6355 => 4.3348, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/richards_benchmark: -5.99% (1.4441 => 1.3576, std.dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.95% (2.9728 => 2.7958, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.48% (3.9413 => 3.7255, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.19% (0.4140 => 0.3925, std.dev.: 0.0021) MultiSource/Applications/SIBsim4/SIBsim4: -5.16% (3.4230 => 3.2465, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout/fib2: -5.10% (4.4195 => 4.1939, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.95% (0.4564 => 0.4338, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: -4.91% (1.5803 => 1.5027, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/distray/distray: -4.24% (0.2664 => 0.2551, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -4.17% (3.4080 => 3.2658, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.97% (1.2959 => 1.2445, std.dev.: 0.0076) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.51% (9.3855 => 9.0560, std.dev.: 0.0457) SingleSource/Benchmarks/McGill/misr: -3.42% (0.4296 => 0.4149, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: -3.37% (9.2503 => 8.9384, std.dev.: 0.0186) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.05% (45.4683 => 44.0813, std.dev.: 0.2076) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.91% (1.2722 => 1.2352, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: -2.00% (3.4876 => 3.4179, std.dev.: 0.0037) MultiSource/Applications/aha/aha: -1.98% (3.4286 => 3.3607, std.dev.: 0.0065) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.86% (2.3569 => 2.3130, std.dev.: 0.0021) MultiSource/Benchmarks/sim/sim: -1.79% (3.8907 => 3.8209, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.69% (2.4457 => 2.4044, std.dev.: 0.0154) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std.dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.40% (27.1724 => 26.7918, std.dev.: 0.0238) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.35% (25.6658 => 25.3184, std.dev.: 0.0320) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.31% (1.8739 => 1.8494, std.dev.: 0.0081) SingleSource/Benchmarks/McGill/chomp: -1.30% (1.0194 => 1.0061, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/fldry: -1.09% (2.4971 => 2.4700, std.dev.: 0.0098) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.79% (0.9980 => 1.0059, std.dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: 3.64% (0.6022 => 0.6241, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/08-main/main: 7.86% (0.1666 => 0.1797, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.47% (0.1554 => 0.1500, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.84% (0.3083 => 0.3109, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.67% (0.2394 => 0.2354, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.47% (0.3175 => 0.3190, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.91% (0.2302 => 0.2323, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel: 1.11% (0.0449 => 0.0454, std.dev.: 0.0019) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0090 => 0.0090, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -17.08% (0.0240 => 0.0199, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -39.06% (0.0192 => 0.0117, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.13% (0.0390 => 0.0370, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -27.57% (0.0301 => 0.0218, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.70% (0.0284 => 0.0286, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.31% (0.0324 => 0.0323, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 2.26% (0.0177 => 0.0181, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -38.10% (0.0189 => 0.0117, std.dev.: 0.0025) SingleSource/UnitTests/Vector/multiplies: 0.80% (0.0249 => 0.0251, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: 0.62% (0.0325 => 0.0327, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.52% (0.1429 => 0.1465, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: -1.55% (1.5019 => 1.4786, std.dev.: 0.0438) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.20% (0.1501 => 0.1483, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.57% (0.4264 => 0.4069, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.12% (0.1344 => 0.1359, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.98% (0.0589 => 0.0542, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -25.43% (0.0232 => 0.0173, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.82% (0.0639 => 0.0589, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.85% (1.1350 => 1.1253, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 150.00% (0.0006 => 0.0015, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.22% (0.0637 => 0.0591, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -42.68% (0.0246 => 0.0141, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.92% (0.7541 => 0.7686, std.dev.: 0.0215) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.09% (1.5363 => 1.7067, std.dev.: 0.0162) SingleSource/UnitTests/2003-05-07-VarArgs: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -34.29% (0.0070 => 0.0046, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 2 22:40:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 3 Oct 2012 00:40:57 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121003054057.779222A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4505?compare_to=4504&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4505, Order: 165088, Start Time: 2012-10-03 04:13:33, End Time: 2012-10-03 05:42:38 To: 4504, Order: 165087, Start Time: 2012-10-03 02:30:01, End Time: 2012-10-03 03:57:09 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (9 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 7 (68 on baseline) Performance Improvements: 4 (45 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 78 (69 on baseline) Unchanged Tests: 953 (769 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.04% (0.4365 => 0.4585, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.46% (0.8521 => 0.8645, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/himenobmtxpa: 7.74% (4.3283 => 4.6631, std.dev.: 0.0628) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.93% (21.1974 => 22.0307, std.dev.: 0.2666) SingleSource/Benchmarks/Misc/ffbench: 1.96% (1.3801 => 1.4071, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.44% (4.5117 => 4.5765, std.dev.: 0.0233) MultiSource/Benchmarks/BitBench/five11/five11: 1.19% (5.2027 => 5.2644, std.dev.: 0.0107) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -1.02% (1.2222 => 1.2097, std.dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -2.19% (1.3041 => 1.2755, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -1.40% (2.7386 => 2.7003, std.dev.: 0.0124) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.01% (1.2352 => 1.2227, std.dev.: 0.0045) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.28% (1.0059 => 1.0031, std.dev.: 0.0093) MultiSource/Applications/sqlite3/sqlite3: -2.82% (0.6241 => 0.6065, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/08-main/main: -0.39% (0.1797 => 0.1790, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.93% (0.1500 => 0.1589, std.dev.: 0.0052) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.06% (0.3109 => 0.3111, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.68% (0.2354 => 0.2338, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.63% (0.3190 => 0.3210, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (0.2323 => 0.2298, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel: -15.86% (0.0454 => 0.0382, std.dev.: 0.0036) SingleSource/UnitTests/2003-05-07-VarArgs: -23.60% (0.0089 => 0.0068, std.dev.: 0.0010) SingleSource/UnitTests/2003-08-11-VaListArg: -67.78% (0.0090 => 0.0029, std.dev.: 0.0030) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 20.60% (0.0199 => 0.0240, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 67.52% (0.0117 => 0.0196, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.86% (0.0370 => 0.0388, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 12.84% (0.0218 => 0.0246, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.70% (0.0286 => 0.0284, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -19.50% (0.0323 => 0.0260, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0181 => 0.0181, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/test1: 65.81% (0.0117 => 0.0194, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: 1.99% (0.0251 => 0.0256) SingleSource/UnitTests/byval-alignment: -10.70% (0.0327 => 0.0292, std.dev.: 0.0017) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1465 => 0.1464, std.dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 0.17% (0.2302 => 0.2306, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.49% (1.4786 => 1.5006, std.dev.: 0.0267) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 2.63% (0.1483 => 0.1522, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/Bullet/bullet: 0.68% (0.5863 => 0.5903, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 0.03% (26.8135 => 26.8223, std.dev.: 0.1185) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.32% (0.4069 => 0.4056, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.67% (0.1359 => 0.1436, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.80% (0.0542 => 0.0568, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.94% (0.0173 => 0.0185, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.55% (0.0589 => 0.0604, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.34% (1.1253 => 1.1215, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -66.67% (0.0015 => 0.0005, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0591 => 0.0591, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 9.22% (0.0141 => 0.0154, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.48% (0.7686 => 0.7649, std.dev.: 0.0087) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -0.68% (4.0265 => 3.9991, std.dev.: 0.0441) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 0.25% (40.4881 => 40.5873, std.dev.: 0.2345) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 0.29% (59.3238 => 59.4945, std.dev.: 0.5994) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -0.59% (2.9453 => 2.9280, std.dev.: 0.0286) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -0.96% (2.3766 => 2.3538, std.dev.: 0.1648) SingleSource/Regression/C/2003-05-21-UnionBitfields: 300.00% (0.0001 => 0.0004, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.06% (1.7067 => 1.7057, std.dev.: 0.0004) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0000 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 163.04% (0.0046 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt MultiSource/Applications/JM/lencod/lencod: -96.58% (6.7458 => 0.2306, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: -91.53% (6.9722 => 0.5903, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 21583.35% (0.1237 => 26.8223, std.dev.: 0.1185) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -1.64% (4.0659 => 3.9991, std.dev.: 0.0441) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 0.27% (40.4792 => 40.5873, std.dev.: 0.2345) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.74% (61.1734 => 59.4945, std.dev.: 0.5994) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.52% (3.2007 => 2.9280, std.dev.: 0.0286) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -0.18% (2.3580 => 2.3538, std.dev.: 0.1648) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -24.97% (4.1772 => 3.1343, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/except: 82183.33% (0.0006 => 0.4937, std.dev.: 0.0033) SingleSource/Regression/C++/EH/ctor_dtor_count: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.49% (0.0745 => 0.0920, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.53% (0.1159 => 0.1281, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.36% (0.6410 => 0.6946, std.dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: 7.45% (2.1763 => 2.3385, std.dev.: 0.0217) SingleSource/Benchmarks/Misc-C++/bigfib: 7.25% (0.5309 => 0.5694, std.dev.: 0.0040) MultiSource/Applications/minisat/minisat: 6.40% (0.6173 => 0.6568, std.dev.: 0.0028) MultiSource/Applications/lemon/lemon: 5.64% (1.0046 => 1.0613, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.53% (0.2552 => 0.2693, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 5.32% (1.1653 => 1.2273, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.23% (1.5150 => 1.5942, std.dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 4.92% (0.6915 => 0.7255, std.dev.: 0.0088) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.2654 => 0.2783, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 4.84% (15.3105 => 16.0514, std.dev.: 0.0613) MultiSource/Benchmarks/McCat/18-imp/imp: 4.57% (0.3217 => 0.3364, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.47% (0.3582 => 0.3742, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.44% (0.7639 => 0.7978, std.dev.: 0.0034) MultiSource/Applications/d/make_dparser: 4.31% (3.0225 => 3.1529, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.11% (0.2797 => 0.2912, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.65% (0.4880 => 0.5058, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 3.43% (13.3238 => 13.7806, std.dev.: 0.0281) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.38% (0.3901 => 0.4033, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 3.37% (1.1440 => 1.1826, std.dev.: 0.0121) MultiSource/Benchmarks/Bullet/bullet: 3.32% (29.3170 => 30.2912, std.dev.: 0.2247) MultiSource/Benchmarks/mafft/pairlocalalign: 2.99% (8.2186 => 8.4644, std.dev.: 0.0601) MultiSource/Applications/siod/siod: 2.89% (2.0972 => 2.1578, std.dev.: 0.0046) MultiSource/Applications/lua/lua: 2.78% (3.5980 => 3.6981, std.dev.: 0.0156) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.75% (1.2021 => 1.2351, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.44% (1.4408 => 1.4760, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.39% (12.6413 => 12.9428, std.dev.: 0.0538) MultiSource/Applications/treecc/treecc: 2.37% (1.8798 => 1.9243, std.dev.: 0.0082) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.29% (6.2546 => 6.3980, std.dev.: 0.0525) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.28% (1.1827 => 1.2097, std.dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 2.25% (1.0821 => 1.1064, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.23% (0.8569 => 0.8760, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.23% (3.0758 => 3.1443, std.dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.94% (0.7226 => 0.7366, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.76% (4.0318 => 4.1027, std.dev.: 0.0121) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.49% (4.2616 => 4.3253, std.dev.: 0.0129) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.38% (1.0689 => 1.0836, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.05% (8.2559 => 8.3424, std.dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.47% (1.6538 => 2.3396, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2279, std.dev.: 0.0267) MultiSource/Benchmarks/Olden/power/power: 17.85% (1.4184 => 1.6716, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 15.32% (0.3746 => 0.4320, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: 14.93% (1.7426 => 2.0028, std.dev.: 0.0408) SingleSource/Benchmarks/McGill/queens: 11.06% (1.6261 => 1.8060, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.69% (4.2129 => 4.6631, std.dev.: 0.0628) SingleSource/Benchmarks/Stanford/Puzzle: 8.79% (0.1433 => 0.1559, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/lists: 8.68% (7.0025 => 7.6101, std.dev.: 0.0754) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.54% (0.2857 => 0.3101, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/mason/mason: 8.29% (0.5004 => 0.5419, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 7.70% (0.7609 => 0.8195, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.33% (0.3301 => 0.3543, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.92% (1.0063 => 1.0759, std.dev.: 0.0215) SingleSource/Benchmarks/Misc/dt: 4.28% (0.9851 => 1.0273, std.dev.: 0.0037) MultiSource/Benchmarks/PAQ8p/paq8p: 3.71% (92.7467 => 96.1839, std.dev.: 0.3471) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.38% (0.5587 => 0.5776, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.84% (6.6312 => 6.8195, std.dev.: 0.0129) MultiSource/Applications/hexxagon/hexxagon: 2.77% (14.4877 => 14.8895, std.dev.: 0.0592) MultiSource/Applications/siod/siod: 2.66% (3.5520 => 3.6465, std.dev.: 0.0273) SingleSource/Benchmarks/Shootout-C++/hash: 2.57% (0.6308 => 0.6470, std.dev.: 0.0058) MultiSource/Benchmarks/mafft/pairlocalalign: 2.31% (62.4126 => 63.8557, std.dev.: 0.1010) SingleSource/Benchmarks/Dhrystone/dry: 1.96% (2.4013 => 2.4484, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.73% (4.6127 => 4.6924, std.dev.: 0.0185) SingleSource/Benchmarks/Misc/whetstone: 1.71% (2.3453 => 2.3855, std.dev.: 0.0148) MultiSource/Benchmarks/BitBench/five11/five11: 1.36% (5.1938 => 5.2644, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.30% (2.6656 => 2.7003, std.dev.: 0.0124) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.13% (2.4455 => 2.4731, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -45.16% (0.2996 => 0.1643, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.84% (0.0591 => 0.0326, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.57% (1.4189 => 1.1271, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.97% (1.4113 => 1.1295, std.dev.: 0.0069) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.63% (0.3497 => 0.2076, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -27.27% (15.8312 => 11.5146, std.dev.: 0.1600) SingleSource/Benchmarks/Shootout-C++/ary3: -20.80% (1.7473 => 1.3838, std.dev.: 0.0898) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.19% (5.2665 => 4.2033, std.dev.: 0.0810) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -14.91% (1.7361 => 1.4773, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1585, std.dev.: 0.0708) MultiSource/Benchmarks/FreeBench/neural/neural: -11.44% (1.0926 => 0.9676, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.65% (1.1647 => 1.0523, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: -8.42% (9.5474 => 8.7435, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.36% (1.4034 => 1.2861, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: -7.61% (3.6023 => 3.3283, std.dev.: 0.0419) MultiSource/Benchmarks/Olden/bh/bh: -7.12% (2.5166 => 2.3375, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.91% (3.6254 => 3.3749, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/fibo: -6.62% (4.6355 => 4.3286, std.dev.: 0.0233) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.48% (2.0027 => 1.8730, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -6.27% (7.6833 => 7.2017, std.dev.: 0.0219) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -5.97% (45.4683 => 42.7561, std.dev.: 0.8858) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.92% (2.9728 => 2.7969, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/richards_benchmark: -5.49% (1.4441 => 1.3648, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.48% (3.9413 => 3.7254, std.dev.: 0.0087) MultiSource/Applications/SIBsim4/SIBsim4: -5.46% (3.4230 => 3.2361, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout/fib2: -5.32% (4.4195 => 4.1843, std.dev.: 0.0350) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.57% (0.4140 => 0.3951, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.52% (1.2959 => 1.2373, std.dev.: 0.0181) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.34% (0.4564 => 0.4366, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -4.21% (3.4080 => 3.2646, std.dev.: 0.0027) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.89% (1.2722 => 1.2227, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/misr: -3.72% (0.4296 => 0.4136, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.37% (9.3855 => 9.0695, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/methcall: -3.13% (9.2503 => 8.9607, std.dev.: 0.0284) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.79% (3.7496 => 3.6450, std.dev.: 0.0322) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.24% (2.3569 => 2.3040, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.16% (1.1683 => 1.1431, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/hash2: -2.03% (3.4876 => 3.4168, std.dev.: 0.0213) MultiSource/Applications/aha/aha: -1.96% (3.4286 => 3.3615, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.82% (1.0686 => 1.0492, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: -1.78% (3.8907 => 3.8216, std.dev.: 0.0049) SingleSource/Benchmarks/Dhrystone/fldry: -1.41% (2.4971 => 2.4618, std.dev.: 0.0030) MultiSource/Benchmarks/llubenchmark/llu: -1.41% (2.0192 => 1.9908, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3094, std.dev.: 0.0967) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.36% (27.1724 => 26.8015, std.dev.: 0.0171) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.51% (0.9980 => 1.0031, std.dev.: 0.0093) MultiSource/Applications/sqlite3/sqlite3: 0.71% (0.6022 => 0.6065, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/08-main/main: 7.44% (0.1666 => 0.1790, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.25% (0.1554 => 0.1589, std.dev.: 0.0052) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.91% (0.3083 => 0.3111, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.34% (0.2394 => 0.2338, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.10% (0.3175 => 0.3210, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.17% (0.2302 => 0.2298, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel: -14.92% (0.0449 => 0.0382, std.dev.: 0.0036) SingleSource/UnitTests/2003-05-07-VarArgs: -23.60% (0.0089 => 0.0068, std.dev.: 0.0010) SingleSource/UnitTests/2003-08-11-VaListArg: -67.78% (0.0090 => 0.0029, std.dev.: 0.0030) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0240 => 0.0240, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 2.08% (0.0192 => 0.0196, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.51% (0.0390 => 0.0388, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -18.27% (0.0301 => 0.0246, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0284 => 0.0284, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -19.75% (0.0324 => 0.0260, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/casts: 2.26% (0.0177 => 0.0181, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/test1: 2.65% (0.0189 => 0.0194, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: 2.81% (0.0249 => 0.0256) SingleSource/UnitTests/byval-alignment: -10.15% (0.0325 => 0.0292, std.dev.: 0.0017) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.45% (0.1429 => 0.1464, std.dev.: 0.0045) MultiSource/Applications/lemon/lemon: -0.09% (1.5019 => 1.5006, std.dev.: 0.0267) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 1.40% (0.1501 => 0.1522, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.88% (0.4264 => 0.4056, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.85% (0.1344 => 0.1436, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.57% (0.0589 => 0.0568, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -20.26% (0.0232 => 0.0185, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.48% (0.0639 => 0.0604, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.19% (1.1350 => 1.1215, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -16.67% (0.0006 => 0.0005, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.22% (0.0637 => 0.0591, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -37.40% (0.0246 => 0.0154, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.43% (0.7541 => 0.7649, std.dev.: 0.0087) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.03% (1.5363 => 1.7057, std.dev.: 0.0004) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 2 23:19:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 3 Oct 2012 01:19:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121003061934.5603F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4506?compare_to=4502&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4506, Order: 165089, Start Time: 2012-10-03 05:01:51, End Time: 2012-10-03 06:21:14 To: 4502, Order: 165073, Start Time: 2012-10-03 01:10:47, End Time: 2012-10-03 02:30:27 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (147 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 952 (695 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.06% (15.1219 => 15.4338, std.dev.: 0.0078) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.23% (0.5739 => 0.5752, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 0.15% (15.9587 => 15.9832, std.dev.: 0.0100) MultiSource/Benchmarks/Bullet/bullet: -0.14% (54.1017 => 54.0259, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/gs/gs: 0.31% (4.3085 => 4.3220, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0460 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0462 => 0.0462) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.23% (0.0430 => 0.0429) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0431 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.24% (0.0419 => 0.0418, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.24% (0.0421 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.24% (0.0414 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.24% (0.0415 => 0.0414) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.23% (0.0431 => 0.0430, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.23% (0.0433 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.23% (0.0426 => 0.0425) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.23% (0.0427 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.24% (0.0415 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.24% (0.0417 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.24% (0.0423 => 0.0422, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.24% (0.0424 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.23% (0.0434 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.61% (0.0456 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.49% (0.0412 => 0.0410) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.24% (0.0412 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.24% (0.0423 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.24% (0.0424 => 0.0423) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.24% (0.0414 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.24% (0.0416 => 0.0415) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.25% (0.0406 => 0.0405, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.25% (0.0407 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.25% (0.0405 => 0.0404, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.49% (0.0407 => 0.0405, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.23% (0.0442 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.23% (0.0444 => 0.0443, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.25% (0.0404 => 0.0403, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.25% (0.0405 => 0.0404) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.25% (0.0405 => 0.0404, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.25% (0.0406 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.48% (0.0413 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.24% (0.0414 => 0.0413) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.03% (1.2284 => 1.2288, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.07% (7.5390 => 7.5338, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.25% (0.7292 => 0.7274, std.dev.: 0.0037) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.55% (0.0361 => 0.0359, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1434 => 0.1435, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.25% (0.0666 => 0.0651, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -14.58% (63.2438 => 54.0259, std.dev.: 0.0039) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 30.68% (14.1553 => 18.4980, std.dev.: 0.0146) SingleSource/Benchmarks/Misc-C++-EH/spirit: 57.79% (3.4629 => 5.4641, std.dev.: 0.0045) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14224.44% (0.0720 => 10.3136, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10003300.00% (0.0001 => 10.0034, std.dev.: 0.0022) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 48.87% (10.3673 => 15.4338, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/08-main/main: 47.53% (0.2554 => 0.3768, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/distray/distray: 29.92% (0.1056 => 0.1372, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 29.28% (0.1622 => 0.2097, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.81% (2.2022 => 2.5064, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/flops: 13.69% (0.1432 => 0.1628, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.13% (7.0540 => 7.9803, std.dev.: 0.0195) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.07% (0.0834 => 0.0943, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.64% (0.1566 => 0.1764, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.28% (1.7609 => 1.9595, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 11.11% (0.3473 => 0.3859, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.98% (0.3543 => 0.3932, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 10.90% (0.3497 => 0.3878, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-4: 10.81% (0.3543 => 0.3926, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.69% (0.3516 => 0.3892, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.64% (0.3561 => 0.3940, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.42% (0.3694 => 0.4079, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.42% (0.3927 => 0.4336, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 10.27% (0.3828 => 0.4221, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.06% (0.3886 => 0.4277, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.85% (0.1584 => 0.1740, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 9.63% (9.4845 => 10.3975, std.dev.: 0.0031) MultiSource/Applications/JM/ldecod/ldecod: 9.62% (10.4361 => 11.4405, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/oourafft: 8.99% (0.3282 => 0.3577, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 8.14% (0.5925 => 0.6407, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.04% (0.6030 => 0.6515, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 7.92% (0.1655 => 0.1786, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.87% (0.4879 => 0.5263, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.87% (0.3177 => 0.3427, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 7.71% (0.7326 => 0.7891, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.65% (0.1438 => 0.1548, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.52% (0.6675 => 0.7177, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 7.49% (5.7591 => 6.1907, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.45% (0.2603 => 0.2797, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.44% (1.5415 => 1.6562, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: 7.43% (0.7115 => 0.7644, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 7.33% (0.3109 => 0.3337, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 7.22% (0.7433 => 0.7970, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.19% (0.4615 => 0.4947, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 6.96% (3.3354 => 3.5674, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 6.90% (0.1695 => 0.1812, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 6.84% (0.3423 => 0.3657, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.83% (0.1625 => 0.1736, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.83% (0.2065 => 0.2206, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.81% (1.3050 => 1.3939, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.78% (0.2271 => 0.2425, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.78% (0.2700 => 0.2883, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 6.69% (0.3422 => 0.3651, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.68% (0.2905 => 0.3099, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.64% (0.5105 => 0.5444, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.64% (0.5860 => 0.6249, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.63% (4.2646 => 4.5472, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.62% (0.1510 => 0.1610, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.57% (0.2891 => 0.3081, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.56% (0.4103 => 0.4372, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.38% (0.8172 => 0.8693, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.36% (0.5569 => 0.5923, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.35% (0.3136 => 0.3335, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.32% (8.1363 => 8.6505, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.32% (5.0018 => 5.3177, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.31% (0.4203 => 0.4468, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.30% (0.3650 => 0.3880, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.29% (4.9449 => 5.2561, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.28% (0.8067 => 0.8574, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/except: 6.23% (0.2871 => 0.3050, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.23% (0.9765 => 1.0373, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 6.23% (0.4048 => 0.4300, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.22% (2.0665 => 2.1951, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 6.22% (0.2831 => 0.3007, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 6.20% (0.6456 => 0.6856, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.17% (0.2107 => 0.2237, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.16% (0.3865 => 0.4103, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.14% (0.3162 => 0.3356, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.13% (0.2756 => 0.2925, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.13% (0.4289 => 0.4552, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.13% (0.3052 => 0.3239, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.13% (0.3232 => 0.3430, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 6.11% (0.7835 => 0.8314, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.11% (0.3307 => 0.3509, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.10% (0.3098 => 0.3287, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/fibo: 6.09% (0.2725 => 0.2891, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.09% (0.3826 => 0.4059, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.09% (0.3121 => 0.3311, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.08% (0.2877 => 0.3052, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.02% (0.2872 => 0.3045, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.02% (0.2758 => 0.2924, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.98% (0.5020 => 0.5320, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.88% (0.1940 => 0.2054, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 5.88% (0.3387 => 0.3586, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.87% (7.9617 => 8.4288, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/random: 5.85% (0.2802 => 0.2966, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 5.84% (1.1642 => 1.2322, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.84% (0.2793 => 0.2956, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 5.83% (0.3603 => 0.3813, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 5.82% (0.4620 => 0.4889, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.82% (0.2714 => 0.2872, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 5.81% (0.3684 => 0.3898, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.80% (0.4636 => 0.4905, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.73% (0.3283 => 0.3471, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 5.72% (1.5603 => 1.6495, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 5.61% (3.8723 => 4.0895, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.50% (1.1861 => 1.2513, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 5.48% (1.0722 => 1.1310, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.46% (0.3441 => 0.3629, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 5.44% (0.4299 => 0.4533, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary2: 5.42% (0.3379 => 0.3562, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.39% (0.1892 => 0.1994, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 5.28% (0.3180 => 0.3348, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 5.25% (21.9371 => 23.0896, std.dev.: 0.0101) MultiSource/Applications/treecc/treecc: 5.22% (2.0273 => 2.1331, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.91% (0.6450 => 0.6767, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 4.78% (2.2969 => 2.4066, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 4.71% (0.8921 => 0.9341, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.65% (0.5981 => 0.6259, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.46% (1.5859 => 1.6566, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.40% (0.4064 => 0.4243, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.22% (0.3131 => 0.3263, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.10% (1.4186 => 1.4768, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 4.01% (1.2842 => 1.3357, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 3.90% (1.1840 => 1.2302, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.90% (2.2024 => 2.2883, std.dev.: 0.0183) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.22% (0.3817 => 0.3940, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.11% (0.8101 => 0.8353, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.57% (14.3668 => 14.7359, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.32% (1.1194 => 1.1454, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.93% (17.1811 => 17.5119, std.dev.: 0.0248) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.48% (3.8922 => 3.9499, std.dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8963, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 146.54% (5.3999 => 13.3129, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 30.45% (1.1277 => 1.4711, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.22% (1.1145 => 1.3844, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 10.15% (3.1595 => 3.4802, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/Puzzle: 9.85% (0.1421 => 0.1561, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash2: 6.64% (3.1578 => 3.3674, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 6.63% (1.1396 => 1.2151, std.dev.: 0.0006) SingleSource/Regression/C/uint64_to_float: 3.64% (0.5413 => 0.5610, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.54% (3.6395 => 3.7683, std.dev.: 0.0092) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.74% (4.2280 => 4.3438, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.33% (1.7254 => 1.7656, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.55% (0.8275 => 0.8403, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.02% (11.6436 => 11.7620, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1284, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.40% (0.8651 => 0.1696, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.33% (5.2763 => 3.2538, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.38% (5.3855 => 3.5880, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.96% (5.3526 => 3.5886, std.dev.: 0.0059) SingleSource/UnitTests/Vector/constpool: -14.90% (54.1659 => 46.0946, std.dev.: 0.0583) MultiSource/Benchmarks/FreeBench/mason/mason: -14.55% (0.0811 => 0.0693, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.12% (2.9384 => 2.6116, std.dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: -10.66% (22.1758 => 19.8125, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: -33.37% (1.1492 => 0.7657, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.94% (1.6925 => 1.4228, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.63% (0.0998 => 0.0862, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: -12.67% (1.3677 => 1.1944, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.23% (1.2373 => 1.0983, std.dev.: 0.0149) SingleSource/Benchmarks/Misc/mandel-2: -10.30% (1.5373 => 1.3789, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -10.04% (0.2161 => 0.1944, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.16% (19.9488 => 18.3201, std.dev.: 0.0344) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.71% (1.8329 => 1.7100, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.65% (0.2497 => 0.2331) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.26% (13.4384 => 12.7316, std.dev.: 0.0277) SingleSource/Benchmarks/Misc/flops-5: -5.06% (1.5835 => 1.5033, std.dev.: 0.0049) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.99% (1.6805 => 1.5966, std.dev.: 0.0040) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.30% (0.3463 => 0.3314) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.87% (0.9957 => 0.9572, std.dev.: 0.0087) MultiSource/Applications/siod/siod: -3.60% (3.2827 => 3.1646, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.40% (32.5116 => 31.4050, std.dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: -2.41% (12.4730 => 12.1730, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.98% (10.2830 => 10.0793, std.dev.: 0.0244) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.88% (8.6802 => 8.5166, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.83% (8.1563 => 8.0073, std.dev.: 0.0116) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6821, std.dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: -1.57% (2.5528 => 2.5127, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: -1.56% (4.6441 => 4.5717, std.dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: -1.51% (9.5636 => 9.4194, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/lists: -1.04% (6.2999 => 6.2343, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.00% (0.5229 => 0.5752, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 6.63% (14.9895 => 15.9832, std.dev.: 0.0100) MultiSource/Benchmarks/MallocBench/gs/gs: 5.15% (4.1105 => 4.3220, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.22% (1.1048 => 1.2288, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.25% (7.1582 => 7.5338, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/stepanov_container: 16.91% (0.6222 => 0.7274, std.dev.: 0.0037) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35800.00% (0.0001 => 0.0359, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.37% (0.1485 => 0.1435, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 3 00:22:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 3 Oct 2012 02:22:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121003072212.327182A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4507?compare_to=4503&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4507, Order: 165088, Start Time: 2012-10-03 04:11:56, End Time: 2012-10-03 07:23:51 To: 4503, Order: 165072, Start Time: 2012-10-03 00:34:16, End Time: 2012-10-03 03:42:57 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 2 (119 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (131 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1037 (772 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.63% (1.7624 => 1.7912, std.dev.: 0.0044) MultiSource/Applications/SPASS/SPASS: 1.02% (5.9074 => 5.9674, std.dev.: 0.0051) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.03% (9.8112 => 9.8084, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.02% (9.4112 => 9.4131, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.05% (16.9218 => 16.9309, std.dev.: 0.0075) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 12.43% (1.5932 => 1.7912, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.73% (0.3488 => 0.3897, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.72% (0.3446 => 0.3850, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.72% (0.3465 => 0.3871, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.67% (0.3496 => 0.3904, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.65% (0.3442 => 0.3843, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.65% (0.3469 => 0.3873, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.62% (0.3460 => 0.3862, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.40% (0.3650 => 0.4066, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 11.28% (0.3643 => 0.4054, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.14% (0.3724 => 0.4139, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.37% (0.5826 => 0.6372, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 9.20% (0.5889 => 0.6431, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 8.92% (0.3004 => 0.3272, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.77% (0.2875 => 0.3127, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 8.34% (0.1619 => 0.1754, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: 8.29% (0.1218 => 0.1319, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.08% (0.3195 => 0.3453, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 8.07% (0.2725 => 0.2945, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 8.06% (0.2803 => 0.3029, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 8.00% (0.2714 => 0.2931, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.96% (0.2738 => 0.2956, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 7.93% (0.2823 => 0.3047, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 7.93% (0.2813 => 0.3036, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 7.93% (0.2750 => 0.2968, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.91% (0.7171 => 0.7738, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.88% (0.2729 => 0.2944, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.85% (2.0673 => 2.2295, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.77% (0.2792 => 0.3009) SingleSource/Benchmarks/Shootout-C++/matrix: 7.77% (0.2780 => 0.2996, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 7.75% (0.3096 => 0.3336, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.75% (0.4361 => 0.4699, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 7.68% (5.5417 => 5.9674, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.67% (0.3362 => 0.3620, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.66% (0.2911 => 0.3134, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 7.62% (0.9909 => 1.0664, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary3: 7.59% (0.3267 => 0.3515, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 7.56% (0.3348 => 0.3601, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.56% (1.6211 => 1.7436, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 7.55% (0.3258 => 0.3504, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.55% (0.3060 => 0.3291, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 7.54% (0.2811 => 0.3023, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 7.51% (0.3317 => 0.3566, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 7.48% (0.4146 => 0.4456, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.48% (0.3625 => 0.3896) SingleSource/Benchmarks/Shootout-C++/moments: 7.42% (0.3678 => 0.3951, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 7.40% (1.0781 => 1.1579, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.39% (0.3124 => 0.3355, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.37% (0.3282 => 0.3524, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.37% (3.5627 => 3.8251, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/lists1: 7.28% (0.3477 => 0.3730, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 7.25% (0.3726 => 0.3996, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 7.04% (0.1421 => 0.1521, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 7.01% (23.5202 => 25.1700, std.dev.: 0.0253) SingleSource/Benchmarks/Shootout-C++/hash2: 6.89% (0.4251 => 0.4544, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.83% (0.3690 => 0.3942, std.dev.: 0.0015) MultiSource/Applications/siod/siod: 6.80% (0.6634 => 0.7085, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.77% (0.3930 => 0.4196, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.76% (0.3845 => 0.4105, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.71% (0.3981 => 0.4248, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.62% (0.2736 => 0.2917, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.49% (0.3084 => 0.3284, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 6.45% (2.1013 => 2.2368, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.43% (0.6435 => 0.6849, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 6.43% (4.2109 => 4.4815, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/bigfib: 6.40% (0.5012 => 0.5333, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.36% (0.2737 => 0.2911, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.21% (0.2866 => 0.3044, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.19% (0.2068 => 0.2196, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.16% (0.4139 => 0.4394, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 6.11% (1.8794 => 1.9942, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.89% (0.3903 => 0.4133, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 5.88% (0.4029 => 0.4266, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 5.87% (1.4269 => 1.5106, std.dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: 5.84% (4.6177 => 4.8874, std.dev.: 0.0137) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.83% (0.2040 => 0.2159, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 5.76% (0.3336 => 0.3528, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.74% (0.1968 => 0.2081, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.71% (0.2103 => 0.2223, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 5.70% (0.5546 => 0.5862, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 5.67% (2.1653 => 2.2880, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.52% (0.4658 => 0.4915, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 5.36% (0.4847 => 0.5107, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 5.35% (0.9697 => 1.0216, std.dev.: 0.0061) MultiSource/Applications/sqlite3/sqlite3: 5.34% (2.0346 => 2.1432, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.32% (0.3271 => 0.3445, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 5.20% (0.2075 => 0.2183, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.19% (0.2969 => 0.3123, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 5.07% (0.7875 => 0.8274, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 4.94% (0.2391 => 0.2509, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.92% (0.7426 => 0.7791, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.68% (0.5361 => 0.5612, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 4.65% (0.2691 => 0.2816, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.36% (11.6398 => 12.1468, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.35% (0.5584 => 0.5827, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.07% (4.6926 => 4.8834, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 3.89% (0.3498 => 0.3634, std.dev.: 0.0031) MultiSource/Applications/kimwitu++/kc: 2.92% (11.9555 => 12.3049, std.dev.: 0.0093) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0132) SingleSource/Benchmarks/BenchmarkGame/n-body: 5.92% (3.3903 => 3.5910, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.47% (0.2122 => 0.2238, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6706, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-2: 5.00% (1.8057 => 1.8960, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1640, std.dev.: 0.0376) SingleSource/Benchmarks/Dhrystone/dry: 4.28% (14.0481 => 14.6488, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.40% (79.9355 => 82.6544, std.dev.: 0.0190) SingleSource/Benchmarks/Shootout-C++/ary3: 2.09% (15.8721 => 16.2032, std.dev.: 0.0038) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5001, std.dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.56% (3.1722 => 3.2216, std.dev.: 0.0029) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0037) MultiSource/Benchmarks/BitBench/five11/five11: 1.20% (8.4155 => 8.5163, std.dev.: 0.0091) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.12% (6.9584 => 7.0364, std.dev.: 0.0182) SingleSource/Benchmarks/CoyoteBench/almabench: 1.12% (12.4025 => 12.5410, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5941, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.89% (25.4195 => 16.5502, std.dev.: 0.0202) MultiSource/Applications/sgefa/sgefa: -9.25% (1.5554 => 1.4115, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9756, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7942, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/tsp/tsp: -7.19% (2.1113 => 1.9595, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -7.04% (0.2402 => 0.2233, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -5.83% (3.3665 => 3.1704, std.dev.: 0.0012) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8018, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.13% (0.6293 => 0.6096, std.dev.: 0.0049) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7747, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188) SingleSource/Benchmarks/Dhrystone/fldry: -2.60% (17.2379 => 16.7898, std.dev.: 0.0319) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.46% (21.9346 => 21.3942, std.dev.: 0.0240) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5788, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.18% (105.3826 => 104.1405, std.dev.: 0.0377) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0443, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.04% (41.7953 => 41.3591, std.dev.: 0.0159) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 3 01:11:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 3 Oct 2012 03:11:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121003081128.F22562A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4508?compare_to=4506&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4508, Order: 165091, Start Time: 2012-10-03 06:50:22, End Time: 2012-10-03 08:13:08 To: 4506, Order: 165089, Start Time: 2012-10-03 05:01:51, End Time: 2012-10-03 06:21:14 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 3 (143 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 950 (698 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 22.40% (0.4160 => 0.5092, std.dev.: 0.0290) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.53% (0.8693 => 0.8826, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.18% (7.9557 => 8.0497, std.dev.: 0.0170) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 1.04% (0.5752 => 0.5812, std.dev.: 0.0060) MultiSource/Applications/SPASS/SPASS: 0.13% (15.9832 => 16.0042, std.dev.: 0.3444) MultiSource/Benchmarks/Bullet/bullet: 0.06% (54.0259 => 54.0607, std.dev.: 0.0766) MultiSource/Benchmarks/MallocBench/gs/gs: 0.12% (4.3220 => 4.3274, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0460 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.22% (0.0462 => 0.0461, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.23% (0.0429 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0431 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0418 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.24% (0.0420 => 0.0421, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.24% (0.0413 => 0.0412, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0414 => 0.0414, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.23% (0.0430 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0432 => 0.0432, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0425 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0426 => 0.0426, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.24% (0.0414 => 0.0415, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0416 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0422 => 0.0422, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.24% (0.0423 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.23% (0.0433 => 0.0434) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.06% (0.0435 => 0.0457, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.24% (0.0410 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0411 => 0.0411, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0422 => 0.0422, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0423 => 0.0423, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.24% (0.0413 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0415 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0405 => 0.0405, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0406 => 0.0406, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0404 => 0.0404, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.25% (0.0405 => 0.0406, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.23% (0.0441 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0443 => 0.0443, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0403 => 0.0403, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0404 => 0.0404, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.25% (0.0404 => 0.0405, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0405 => 0.0405, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0411 => 0.0411, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.24% (0.0413 => 0.0414, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.05% (1.2288 => 1.2294, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.11% (7.5338 => 7.5423, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.18% (0.7274 => 0.7287, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 1.95% (0.0359 => 0.0366, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 0.14% (0.1435 => 0.1437, std.dev.: 0.0038) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.45% (0.0651 => 0.0693, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -14.52% (63.2438 => 54.0607, std.dev.: 0.0766) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 30.67% (14.1553 => 18.4966, std.dev.: 0.0239) SingleSource/Benchmarks/Misc-C++-EH/spirit: 57.84% (3.4629 => 5.4658, std.dev.: 0.0099) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14219.31% (0.0720 => 10.3099, std.dev.: 0.0655) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10004600.00% (0.0001 => 10.0047, std.dev.: 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 48.96% (10.3673 => 15.4431, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: 47.61% (0.2554 => 0.3770, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: 30.46% (0.1622 => 0.2116, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 30.02% (0.1056 => 0.1373, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.83% (0.0834 => 0.0966, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 13.76% (0.1432 => 0.1629) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.59% (2.2022 => 2.5014, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.17% (7.0540 => 7.9833, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.91% (0.0798 => 0.0901, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.90% (0.1566 => 0.1768, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.28% (1.7609 => 1.9595, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/trivial-interface: 10.97% (0.3473 => 0.3854, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.84% (0.3543 => 0.3927, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/synchronized: 10.81% (0.3561 => 0.3946, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.78% (0.3543 => 0.3925, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-2: 10.67% (0.3497 => 0.3870, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 10.67% (0.3516 => 0.3891, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 10.48% (0.3694 => 0.4081, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 10.21% (0.3927 => 0.4328, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 10.19% (0.3828 => 0.4218, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 10.04% (0.3886 => 0.4276, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.91% (0.1584 => 0.1741, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 9.79% (10.4361 => 11.4574, std.dev.: 0.2184) MultiSource/Benchmarks/mafft/pairlocalalign: 9.61% (9.4845 => 10.3963, std.dev.: 0.0148) SingleSource/Benchmarks/Misc/oourafft: 9.17% (0.3282 => 0.3583, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 8.64% (0.1655 => 0.1798, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.03% (0.5925 => 0.6401, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.03% (0.3177 => 0.3432, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.00% (0.8172 => 0.8826, std.dev.: 0.0038) SingleSource/UnitTests/ObjC++/property-reference-object: 7.99% (0.6030 => 0.6512, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 7.91% (0.3109 => 0.3355, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.85% (0.4879 => 0.5262, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.82% (0.3121 => 0.3365, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.72% (0.2758 => 0.2971, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.65% (0.1438 => 0.1548, std.dev.: 0.0019) MultiSource/Applications/minisat/minisat: 7.65% (0.7115 => 0.7659, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.58% (1.5415 => 1.6583, std.dev.: 0.0058) MultiSource/Applications/lambda-0_1_3/lambda: 7.56% (0.7433 => 0.7995, std.dev.: 0.0031) MultiSource/Applications/oggenc/oggenc: 7.53% (5.7591 => 6.1929, std.dev.: 0.1111) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.48% (0.6675 => 0.7174, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.45% (0.2603 => 0.2797, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.28% (0.4615 => 0.4951, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.28% (0.8067 => 0.8654, std.dev.: 0.0071) MultiSource/Applications/d/make_dparser: 7.26% (3.3354 => 3.5776, std.dev.: 0.0759) SingleSource/UnitTests/ObjC++/property-reference: 7.25% (0.7326 => 0.7857, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.12% (0.2065 => 0.2212, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/18-imp/imp: 7.10% (0.3423 => 0.3666, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.09% (0.2271 => 0.2432, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/em3d/em3d: 7.08% (0.1695 => 0.1815, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.06% (0.1940 => 0.2077, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.88% (0.5860 => 0.6263, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.83% (0.1625 => 0.1736, std.dev.: 0.0028) SingleSource/Regression/C++/ofstream_ctor: 6.82% (0.2905 => 0.3103, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.79% (1.3050 => 1.3936, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.78% (0.2700 => 0.2883, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.77% (0.5569 => 0.5946, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.76% (0.5105 => 0.5450, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.70% (0.4103 => 0.4378, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.64% (4.2646 => 4.5476, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/lists: 6.63% (0.3422 => 0.3649, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.62% (0.1510 => 0.1610, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.46% (4.9449 => 5.2642, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.43% (0.2891 => 0.3077, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.43% (5.0018 => 5.3233, std.dev.: 0.0174) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.38% (0.3650 => 0.3883, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.37% (2.0665 => 2.1981, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.36% (0.3865 => 0.4111, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.36% (8.1363 => 8.6541, std.dev.: 0.0101) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.32% (0.4636 => 0.4929, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: 6.30% (0.2871 => 0.3052, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.28% (0.3136 => 0.3333, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.26% (0.2107 => 0.2239, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.25% (0.3826 => 0.4065, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.23% (0.2793 => 0.2967, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.22% (0.9765 => 1.0372, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/fibo: 6.20% (0.2725 => 0.2894, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/matrix: 6.20% (0.3098 => 0.3290, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.19% (0.4203 => 0.4463, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.16% (0.3052 => 0.3240, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.13% (0.2756 => 0.2925, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.11% (0.3307 => 0.3509, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.10% (0.3162 => 0.3355, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 6.09% (0.6456 => 0.6849, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4289 => 0.4550, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.08% (0.5020 => 0.5325, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/methcall: 6.01% (0.2877 => 0.3050, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 6.00% (0.4048 => 0.4291, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.97% (0.3232 => 0.3425, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.92% (0.2872 => 0.3042, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 5.90% (0.3387 => 0.3587, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 5.89% (1.5603 => 1.6522, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/hello: 5.86% (0.2714 => 0.2873, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 5.81% (0.3684 => 0.3898, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 5.77% (3.8723 => 4.0959, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/ary3: 5.76% (0.3283 => 0.3472, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 5.75% (0.2802 => 0.2963, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 5.74% (0.4620 => 0.4885, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.73% (7.9617 => 8.4182, std.dev.: 0.0203) SingleSource/Benchmarks/Shootout-C++/sieve: 5.72% (0.3603 => 0.3809, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.71% (0.1892 => 0.2000, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 5.47% (0.4299 => 0.4534, std.dev.: 0.0027) MultiSource/Applications/lemon/lemon: 5.46% (1.0722 => 1.1307, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 5.45% (0.3379 => 0.3563, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.44% (0.6450 => 0.6801, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/09-vor/vor: 5.41% (0.3180 => 0.3352, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.41% (0.3441 => 0.3627, std.dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: 5.39% (21.9371 => 23.1185, std.dev.: 0.4030) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.35% (1.1861 => 1.2495, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 4.95% (0.8921 => 0.9363, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.70% (0.5981 => 0.6262, std.dev.: 0.0037) MultiSource/Applications/hexxagon/hexxagon: 4.52% (1.2842 => 1.3422, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.45% (0.4064 => 0.4245, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.37% (1.5859 => 1.6552, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.31% (1.4186 => 1.4797, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/objinst: 4.15% (0.3131 => 0.3261, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 3.92% (1.1840 => 1.2304, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.85% (2.2024 => 2.2872, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.15% (0.8101 => 0.8356, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.12% (0.3817 => 0.3936, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.56% (14.3668 => 14.7341, std.dev.: 0.0202) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.39% (1.1194 => 1.1462, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.93% (17.1811 => 17.5123, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.58% (3.8922 => 3.9537, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 30.46% (1.1277 => 1.4712, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.68% (0.2944 => 0.3288, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 10.18% (3.1595 => 3.4810, std.dev.: 0.0081) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 6.64% (3.1578 => 3.3674, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: 6.58% (1.1396 => 1.2146, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.87% (0.4162 => 0.4323, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.49% (3.6395 => 3.7666, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.71% (4.2280 => 4.3426, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.34% (1.7254 => 1.7658, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.55% (0.8275 => 0.8403, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.02% (11.6436 => 11.7626, std.dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.05% (6.6874 => 0.1304, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -80.37% (0.8651 => 0.1698, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.25% (5.2763 => 3.2582, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.35% (5.3855 => 3.5897, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -33.03% (5.3526 => 3.5848, std.dev.: 0.0058) SingleSource/UnitTests/Vector/constpool: -14.83% (54.1659 => 46.1348, std.dev.: 0.0160) MultiSource/Benchmarks/FreeBench/mason/mason: -14.43% (0.0811 => 0.0694, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.00% (2.9384 => 2.6152, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -10.55% (22.1758 => 19.8355, std.dev.: 0.0882) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.73% (1.6925 => 1.4263, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.43% (0.0998 => 0.0864, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: -12.67% (1.3677 => 1.1944, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.36% (1.2373 => 1.0967, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -10.38% (1.5373 => 1.3778, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/mason/mason: -10.04% (0.2161 => 0.1944, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.48% (19.9488 => 18.2575, std.dev.: 0.0287) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.68% (1.8329 => 1.7104, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.65% (0.2497 => 0.2331, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.14% (13.4384 => 12.7477, std.dev.: 0.0078) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.98% (1.6805 => 1.5968, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.67% (1.5835 => 1.5096, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.30% (0.3463 => 0.3314, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.02% (0.9957 => 0.9557, std.dev.: 0.0031) MultiSource/Applications/siod/siod: -3.68% (3.2827 => 3.1619, std.dev.: 0.0397) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.41% (32.5116 => 31.4021, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: -2.41% (12.4730 => 12.1719, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.28% (8.1563 => 7.9703, std.dev.: 0.0142) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.95% (8.6802 => 8.5107, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6809, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -1.68% (10.2830 => 10.1106, std.dev.: 0.0092) SingleSource/UnitTests/Vector/multiplies: -1.55% (2.5528 => 2.5133, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -1.53% (4.6441 => 4.5729, std.dev.: 0.0025) MultiSource/Benchmarks/NPB-serial/is/is: -1.46% (9.5636 => 9.4244, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/lists: -1.07% (6.2999 => 6.2323, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8578, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 11.15% (0.5229 => 0.5812, std.dev.: 0.0060) MultiSource/Applications/SPASS/SPASS: 6.77% (14.9895 => 16.0042, std.dev.: 0.3444) MultiSource/Benchmarks/MallocBench/gs/gs: 5.28% (4.1105 => 4.3274, std.dev.: 0.0170) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.28% (1.1048 => 1.2294, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.37% (7.1582 => 7.5423, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/stepanov_container: 17.12% (0.6222 => 0.7287, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36500.00% (0.0001 => 0.0366, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.23% (0.1485 => 0.1437, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.25% (0.2116 => 0.0693, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 3 02:00:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 3 Oct 2012 04:00:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121003090023.6BADE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4509?compare_to=4500&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4509, Order: 165095, Start Time: 2012-10-03 07:36:47, End Time: 2012-10-03 09:02:03 To: 4500, Order: 165065, Start Time: 2012-10-02 23:32:41, End Time: 2012-10-03 00:58:04 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 2 (5 on baseline) Performance Regressions: 1 (172 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1036 (690 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.58% (33.4100 => 33.2159, std.dev.: 0.0466) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (7.2827 => 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.31% (77.7959 => 80.3719, std.dev.: 0.5581) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (2.7525 => 2.7525, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (2.1154 => 2.1154, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (4.9748 => 4.9748, std.dev.: 0.0012) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.24% (33.2944 => 33.2159, std.dev.: 0.0466) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: -100.00% (7.3305 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.23% (2.0176 => 2.4258, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.31% (0.1410 => 0.1640, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.41% (0.0819 => 0.0937, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 14.04% (0.0826 => 0.0942, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 13.55% (0.2243 => 0.2547, std.dev.: 0.0060) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.19% (0.1072 => 0.1192, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 11.03% (0.5818 => 0.6460, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/hash2: 10.98% (0.4328 => 0.4803, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.90% (0.1413 => 0.1567, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 10.90% (0.2781 => 0.3084, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/Hello: 10.86% (0.5748 => 0.6372, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 10.66% (0.1013 => 0.1121, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.45% (0.1588 => 0.1754, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.44% (0.2721 => 0.3005, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 10.32% (0.7061 => 0.7790, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.28% (0.2782 => 0.3068, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 10.20% (1.3693 => 1.5090, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 10.19% (0.4062 => 0.4476, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.14% (3.9660 => 4.3681, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.07% (0.3485 => 0.3836, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.05% (0.3899 => 0.4291, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.02% (0.1327 => 0.1460, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.99% (0.3022 => 0.3324, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 9.97% (0.2607 => 0.2867, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 9.96% (0.7038 => 0.7739, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.94% (0.2596 => 0.2854, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/random: 9.93% (0.2690 => 0.2957, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.87% (1.2193 => 1.3397, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 9.83% (0.2726 => 0.2994, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.83% (0.2655 => 0.2916, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 9.78% (0.2628 => 0.2885, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.76% (0.2765 => 0.3035, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.76% (1.4563 => 1.5984, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.74% (1.9828 => 2.1760, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 9.71% (0.2760 => 0.3028, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.71% (0.9199 => 1.0092, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 9.70% (0.2937 => 0.3222, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.68% (0.2966 => 0.3253, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 9.67% (0.2761 => 0.3028, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.61% (0.4016 => 0.4402, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/lists: 9.60% (0.3293 => 0.3609, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.58% (0.3756 => 0.4116, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.58% (0.3580 => 0.3923, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.53% (0.5265 => 0.5767, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.53% (0.2696 => 0.2953, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.52% (0.3489 => 0.3821, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 9.51% (0.3868 => 0.4236, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.50% (0.6283 => 0.6880, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.47% (0.6959 => 0.7618, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 9.43% (0.3107 => 0.3400, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.35% (0.7710 => 0.8431, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary3: 9.27% (0.3149 => 0.3441, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 9.21% (0.3453 => 0.3771, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 9.20% (0.2988 => 0.3263, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 9.12% (13.8202 => 15.0810, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/ary2: 9.12% (0.3192 => 0.3483, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.10% (1.1364 => 1.2398, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists1: 8.97% (0.3534 => 0.3851, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.93% (0.1276 => 0.1390, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.86% (0.4390 => 0.4779, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.75% (0.3130 => 0.3404, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 8.71% (0.2995 => 0.3256, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.56% (0.1986 => 0.2156, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.50% (0.1435 => 0.1557, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.47% (0.4379 => 0.4750, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 8.46% (1.0313 => 1.1185, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.45% (0.5577 => 0.6048, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 8.37% (0.1589 => 0.1722, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.35% (0.4791 => 0.5191, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.33% (0.6576 => 0.7124, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 8.32% (0.2945 => 0.3190, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.18% (0.2127 => 0.2301, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.11% (0.2504 => 0.2707, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.03% (0.2914 => 0.3148, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 8.02% (1.1061 => 1.1948, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.98% (0.3246 => 0.3505, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.96% (0.3755 => 0.4054, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 7.92% (16.6129 => 17.9289, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.89% (0.8698 => 0.9384, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 7.85% (0.8310 => 0.8962, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.84% (0.7460 => 0.8045, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.76% (7.2180 => 7.7784, std.dev.: 0.0061) MultiSource/Applications/minisat/minisat: 7.71% (0.6744 => 0.7264, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.68% (0.5637 => 0.6070, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 7.65% (3.1889 => 3.4329, std.dev.: 0.0137) MultiSource/Benchmarks/McCat/18-imp/imp: 7.61% (0.3220 => 0.3465, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.59% (3.6692 => 3.9478, std.dev.: 0.0062) MultiSource/Applications/spiff/spiff: 7.54% (0.7506 => 0.8072, std.dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 7.36% (1.0594 => 1.1374, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 7.35% (0.3578 => 0.3841, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 7.32% (3.8646 => 4.1475, std.dev.: 0.0115) MultiSource/Applications/oggenc/oggenc: 7.26% (4.6629 => 5.0015, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 7.24% (0.4003 => 0.4293, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.23% (0.3789 => 0.4063, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.21% (0.3646 => 0.3909, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.20% (0.1819 => 0.1950, std.dev.: 0.0041) MultiSource/Applications/siod/siod: 7.19% (2.1791 => 2.3358, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/09-vor/vor: 7.18% (0.2925 => 0.3135, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.15% (0.3914 => 0.4194, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.15% (0.3650 => 0.3911, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.13% (0.1865 => 0.1998, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.12% (0.2023 => 0.2167, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-2: 7.11% (0.3601 => 0.3857, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 7.10% (0.1478 => 0.1583, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 7.07% (0.3663 => 0.3922, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 7.06% (1.9270 => 2.0630, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/property: 7.06% (0.3940 => 0.4218, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.99% (0.1789 => 0.1914, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.98% (0.3623 => 0.3876, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 6.94% (0.1657 => 0.1772, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 6.79% (8.4961 => 9.0726, std.dev.: 0.0094) MultiSource/Applications/SIBsim4/SIBsim4: 6.78% (1.2749 => 1.3613, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.76% (1.3245 => 1.4141, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 6.71% (0.3131 => 0.3341, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 6.69% (14.8535 => 15.8475, std.dev.: 0.0153) MultiSource/Benchmarks/McCat/05-eks/eks: 6.66% (0.4113 => 0.4387, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.56% (4.3801 => 4.6676, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.54% (0.2140 => 0.2280, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.52% (4.4433 => 4.7331, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.50% (0.8818 => 0.9391, std.dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 6.48% (1.2292 => 1.3088, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.44% (0.1569 => 0.1670, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.41% (0.6135 => 0.6528, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 6.03% (0.6250 => 0.6627, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.92% (0.3511 => 0.3719, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.92% (1.1333 => 1.2004, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.85% (3.2742 => 3.4659, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.64% (0.4805 => 0.5076, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.49% (4.9865 => 5.2605, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.38% (0.9108 => 0.9598, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 5.29% (6.5754 => 6.9230, std.dev.: 0.0196) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.17% (0.2321 => 0.2441, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.12% (0.3245 => 0.3411, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.98% (1.5188 => 1.5944, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 4.89% (3.7467 => 3.9299, std.dev.: 0.0034) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.76% (6.2785 => 6.5771, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.55% (2.1007 => 2.1962, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.49% (13.2842 => 13.8802, std.dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: 2.93% (16.2614 => 16.7376, std.dev.: 0.0139) MultiSource/Applications/ClamAV/clamscan: 2.38% (14.5298 => 14.8761, std.dev.: 0.0093) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5174, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.09% (1.0895 => 1.3629, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.42% (1.8175 => 2.2613, std.dev.: 0.0113) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.58% (1.1560 => 1.2552, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4141, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.24% (1.2998 => 1.3809, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0049, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.65% (0.3139 => 0.3285, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.95% (11.2619 => 11.7064, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9858, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.39% (10.7476 => 11.1116, std.dev.: 0.0158) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613) SingleSource/Benchmarks/Misc/salsa20: 2.28% (7.4271 => 7.5963, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0507, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5139, std.dev.: 0.0034) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2068, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.29% (5.5130 => 5.5842, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9680, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1882, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.13% (3.1071 => 3.1421, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.13% (8.8259 => 8.9252, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/lists: 1.11% (12.4560 => 12.5946, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.00% (9.9194 => 10.0188, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.79% (0.2670 => 0.1394, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -16.12% (0.0707 => 0.0593, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.91% (0.4657 => 0.3916, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.46% (1.3813 => 1.1815, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.41% (1.3819 => 1.1827, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.58% (22.5627 => 21.5294, std.dev.: 0.0219) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.20% (0.2238 => 0.1965, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.93% (1.2308 => 1.0963, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.13% (20.3410 => 18.2801, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.86% (1.3780 => 1.2973, std.dev.: 0.0085) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0045) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5144, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.95% (13.3668 => 12.7052, std.dev.: 0.0397) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.68% (0.9996 => 0.9528, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.16% (0.3458 => 0.3314, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.58% (3.2729 => 3.1557, std.dev.: 0.0068) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.51% (1.7688 => 1.7067, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4786, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.42% (3.0263 => 2.9531, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.33% (1.9762 => 1.9302, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.88% (0.6589 => 0.6465, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6944, std.dev.: 0.0024) MultiSource/Applications/lua/lua: -1.76% (26.5159 => 26.0494, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2532, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0065, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8621, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.25% (2.5254 => 2.4939, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: -1.21% (9.3358 => 9.2226, std.dev.: 0.0191) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2581, std.dev.: 0.0005) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 3 03:06:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 3 Oct 2012 05:06:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121003100632.C8CD52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4510?compare_to=4508&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4510, Order: 165098, Start Time: 2012-10-03 08:42:40, End Time: 2012-10-03 10:02:29 To: 4508, Order: 165091, Start Time: 2012-10-03 06:50:22, End Time: 2012-10-03 08:13:08 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (146 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 953 (695 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.88% (0.5812 => 0.5761, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 0.31% (16.0042 => 16.0541, std.dev.: 0.0103) MultiSource/Benchmarks/Bullet/bullet: 0.17% (54.0607 => 54.1508, std.dev.: 0.0662) MultiSource/Benchmarks/MallocBench/gs/gs: -0.12% (4.3274 => 4.3222, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.22% (0.0460 => 0.0461, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.43% (0.0461 => 0.0463, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0430 => 0.0430, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.23% (0.0431 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.48% (0.0418 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0421 => 0.0421, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.49% (0.0412 => 0.0414) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.24% (0.0414 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0431 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.23% (0.0432 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.24% (0.0425 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.47% (0.0426 => 0.0428) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.24% (0.0415 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.72% (0.0416 => 0.0419, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.47% (0.0422 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.24% (0.0424 => 0.0425) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.23% (0.0434 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.60% (0.0457 => 0.0436, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0411 => 0.0411) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.49% (0.0411 => 0.0413) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.24% (0.0422 => 0.0423) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.24% (0.0423 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0414 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.24% (0.0415 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.25% (0.0405 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.25% (0.0406 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.25% (0.0404 => 0.0405) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.25% (0.0406 => 0.0407) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.23% (0.0442 => 0.0443) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.23% (0.0443 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.25% (0.0403 => 0.0404, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.74% (0.0404 => 0.0407, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0405 => 0.0405) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.25% (0.0405 => 0.0406) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.49% (0.0411 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0414 => 0.0414) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.20% (1.2294 => 1.2319, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.07% (7.5423 => 7.5475, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.16% (0.7287 => 0.7299, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.55% (0.0366 => 0.0364, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1437 => 0.1436, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.06% (0.0693 => 0.0651, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -14.38% (63.2438 => 54.1508, std.dev.: 0.0662) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 30.87% (14.1553 => 18.5248, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++-EH/spirit: 58.19% (3.4629 => 5.4778, std.dev.: 0.0013) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14235.69% (0.0720 => 10.3217, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10004500.00% (0.0001 => 10.0046, std.dev.: 0.0048) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 50.23% (10.3673 => 15.5746, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: 46.71% (0.2554 => 0.3747, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/distray/distray: 29.73% (0.1056 => 0.1370, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 28.85% (0.1622 => 0.2090, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 14.18% (0.1432 => 0.1635, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.73% (2.2022 => 2.5046, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.63% (7.0540 => 8.0152, std.dev.: 0.0053) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.15% (0.1566 => 0.1772, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.07% (0.0834 => 0.0943, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.51% (1.7609 => 1.9635, std.dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 10.28% (10.4361 => 11.5093, std.dev.: 0.0165) SingleSource/UnitTests/ObjC/trivial-interface: 10.25% (0.3473 => 0.3829, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.10% (0.3543 => 0.3901, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.00% (0.3561 => 0.3917, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.97% (0.1584 => 0.1742, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 9.95% (0.3516 => 0.3866, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 9.95% (0.3497 => 0.3845, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.94% (0.3543 => 0.3895, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 9.80% (9.4845 => 10.4136, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/for-in: 9.75% (0.3694 => 0.4054, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.67% (0.3828 => 0.4198, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 9.50% (0.3927 => 0.4300, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/property: 9.47% (0.3886 => 0.4254, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 9.14% (0.3282 => 0.3582, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.30% (0.4879 => 0.5284, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.18% (0.3177 => 0.3437, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.14% (0.1438 => 0.1555, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 7.98% (0.5925 => 0.6398, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 7.98% (0.1655 => 0.1787, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.88% (0.6030 => 0.6505, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.80% (1.5415 => 1.6617, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.78% (0.6675 => 0.7194, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 7.77% (0.7115 => 0.7668, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.72% (0.2603 => 0.2804, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 7.59% (0.7433 => 0.7997, std.dev.: 0.0034) MultiSource/Applications/oggenc/oggenc: 7.56% (5.7591 => 6.1943, std.dev.: 0.0137) MultiSource/Applications/sgefa/sgefa: 7.49% (0.3109 => 0.3342, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.24% (0.4615 => 0.4949, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference: 7.21% (0.7326 => 0.7854, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/em3d/em3d: 7.14% (0.1695 => 0.1816, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/18-imp/imp: 7.10% (0.3423 => 0.3666, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.09% (0.2271 => 0.2432, std.dev.: 0.0026) MultiSource/Applications/d/make_dparser: 7.03% (3.3354 => 3.5698, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.02% (1.3050 => 1.3966, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.02% (0.1625 => 0.1739, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: 6.94% (0.1440 => 0.1540, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.89% (0.1510 => 0.1614) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.85% (0.2891 => 0.3089, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 6.84% (0.3422 => 0.3656, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.81% (0.5860 => 0.6259, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.78% (4.2646 => 4.5539, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.78% (0.8067 => 0.8614, std.dev.: 0.0174) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.78% (0.5105 => 0.5451, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.74% (0.2700 => 0.2882, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.73% (0.2065 => 0.2204, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.68% (0.4103 => 0.4377, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.64% (0.2758 => 0.2941, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.62% (0.4636 => 0.4943, std.dev.: 0.0021) SingleSource/Regression/C++/ofstream_ctor: 6.61% (0.2905 => 0.3097, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.56% (0.3307 => 0.3524, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.52% (0.9765 => 1.0402, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.48% (0.5569 => 0.5930, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.43% (0.5020 => 0.5343, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/strcat: 6.43% (0.2831 => 0.3013, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.42% (0.4203 => 0.4473, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.41% (0.3136 => 0.3337, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.41% (8.1363 => 8.6575, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/ary: 6.40% (0.3232 => 0.3439, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.40% (0.3826 => 0.4071, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.40% (2.0665 => 2.1988, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.39% (0.4289 => 0.4563, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.32% (5.0018 => 5.3180, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.31% (0.3865 => 0.4109, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.31% (0.2107 => 0.2240, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.31% (4.9449 => 5.2569, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/bigfib: 6.30% (0.6456 => 0.6863, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 6.29% (0.3052 => 0.3244, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.27% (0.8172 => 0.8684, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.26% (0.3162 => 0.3360, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 6.25% (0.7835 => 0.8325, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/moments: 6.25% (0.4048 => 0.4301, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.24% (0.2756 => 0.2928, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.24% (0.2725 => 0.2895, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.20% (0.2871 => 0.3049, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 6.18% (1.1642 => 1.2362, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/matrix: 6.13% (0.3098 => 0.3288, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.12% (0.3121 => 0.3312, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.06% (0.2872 => 0.3046, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 6.03% (1.5603 => 1.6544, std.dev.: 0.0125) MultiSource/Benchmarks/sim/sim: 6.02% (0.3387 => 0.3591, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.02% (0.2793 => 0.2961, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.97% (0.3283 => 0.3479, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 5.94% (0.3684 => 0.3903, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.94% (0.2877 => 0.3048, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.94% (0.3603 => 0.3817, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 5.93% (0.2714 => 0.2875, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 5.93% (0.4620 => 0.4894, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.93% (0.1940 => 0.2055, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/random: 5.92% (0.2802 => 0.2968, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 5.82% (3.8723 => 4.0978, std.dev.: 0.0153) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.75% (7.9617 => 8.4191, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.67% (0.3441 => 0.3636, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/09-vor/vor: 5.57% (0.3180 => 0.3357, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 5.56% (1.0722 => 1.1318, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 5.50% (0.3379 => 0.3565, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.49% (1.1861 => 1.2512, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.44% (0.1892 => 0.1995, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 5.37% (0.4299 => 0.4530, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 5.34% (2.0273 => 2.1355, std.dev.: 0.0028) MultiSource/Applications/siod/siod: 5.10% (2.2969 => 2.4141, std.dev.: 0.0119) MultiSource/Applications/JM/lencod/lencod: 5.01% (21.9371 => 23.0360, std.dev.: 0.0230) MultiSource/Benchmarks/Prolangs-C/football/football: 4.94% (0.8921 => 0.9362, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.82% (0.6450 => 0.6761, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.75% (1.5859 => 1.6613, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.71% (0.5981 => 0.6263, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.60% (0.4064 => 0.4251, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.33% (2.2024 => 2.2978, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/objinst: 4.31% (0.3131 => 0.3266, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.28% (1.4186 => 1.4793, std.dev.: 0.0072) MultiSource/Applications/hexxagon/hexxagon: 4.21% (1.2842 => 1.3383, std.dev.: 0.0039) MultiSource/Benchmarks/nbench/nbench: 4.07% (1.1840 => 1.2322, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.27% (0.8101 => 0.8366, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.74% (14.3668 => 14.7600, std.dev.: 0.0112) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.56% (1.1194 => 1.1481, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 2.12% (17.1811 => 17.5453, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.65% (3.8922 => 3.9563, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/power/power: 30.45% (1.1277 => 1.4711, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 10.16% (3.1595 => 3.4805, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3690, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 6.56% (1.1396 => 1.2144, std.dev.: 0.0009) SingleSource/Regression/C/uint64_to_float: 3.68% (0.5413 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.59% (3.6395 => 3.7700, std.dev.: 0.0041) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.72% (4.2280 => 4.3431, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7650, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.55% (0.8275 => 0.8403, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.02% (11.6436 => 11.7626, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1284, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: -80.27% (0.8651 => 0.1707, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.20% (5.2763 => 3.2609, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.23% (5.3855 => 3.5961, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -33.00% (5.3526 => 3.5864, std.dev.: 0.0059) SingleSource/UnitTests/Vector/constpool: -14.83% (54.1659 => 46.1348, std.dev.: 0.0116) MultiSource/Benchmarks/FreeBench/mason/mason: -14.30% (0.0811 => 0.0695, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.16% (2.9384 => 2.6104, std.dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: -10.52% (22.1758 => 19.8425, std.dev.: 0.0397) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: -33.46% (1.1492 => 0.7647, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -16.04% (1.6925 => 1.4211, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.93% (0.0998 => 0.0859, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: -12.67% (1.3677 => 1.1944, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.90% (1.2373 => 1.0901, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3783, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/mason/mason: -10.00% (0.2161 => 0.1945, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.37% (19.9488 => 18.2799, std.dev.: 0.0692) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.78% (1.8329 => 1.7086, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.65% (0.2497 => 0.2331, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.14% (13.4384 => 12.7481, std.dev.: 0.0500) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.96% (1.6805 => 1.5971, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.67% (1.5835 => 1.5095, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.30% (0.3463 => 0.3314, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.57% (0.9957 => 0.9602, std.dev.: 0.0029) MultiSource/Applications/siod/siod: -3.56% (3.2827 => 3.1658, std.dev.: 0.0065) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.41% (32.5116 => 31.4024, std.dev.: 0.0037) MultiSource/Applications/hexxagon/hexxagon: -2.41% (12.4730 => 12.1728, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.05% (8.6802 => 8.5023, std.dev.: 0.0091) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.91% (8.1563 => 8.0004, std.dev.: 0.0149) SingleSource/Benchmarks/Misc/salsa20: -1.87% (10.2830 => 10.0911, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6803, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.58% (2.5528 => 2.5125, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -1.56% (4.6441 => 4.5716, std.dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4223, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout/lists: -1.27% (6.2999 => 6.2202, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8569, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.17% (0.5229 => 0.5761, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 7.10% (14.9895 => 16.0541, std.dev.: 0.0103) MultiSource/Benchmarks/MallocBench/gs/gs: 5.15% (4.1105 => 4.3222, std.dev.: 0.0156) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.50% (1.1048 => 1.2319, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.44% (7.1582 => 7.5475, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 17.31% (0.6222 => 0.7299, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36300.00% (0.0001 => 0.0364, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.30% (0.1485 => 0.1436, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 3 03:54:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 3 Oct 2012 05:54:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121003105432.E751A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4511?compare_to=4509&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4511, Order: 165103, Start Time: 2012-10-03 09:31:10, End Time: 2012-10-03 10:56:13 To: 4509, Order: 165095, Start Time: 2012-10-03 07:36:47, End Time: 2012-10-03 09:02:03 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (5 on baseline) Performance Regressions: 1 (170 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 5 (0 on baseline) Unchanged Tests: 1036 (693 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.72% (54.4976 => 56.5260, std.dev.: 0.0343) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.33% (33.2159 => 33.3246, std.dev.: 0.0176) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.00% (2.7525 => 2.7524, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.00% (2.1154 => 2.1153, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.01% (4.9748 => 4.9751, std.dev.: 0.0018) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.09% (33.2944 => 33.3246, std.dev.: 0.0176) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: -100.00% (7.3305 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.55% (2.0176 => 2.4322, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.31% (0.1410 => 0.1640, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 14.77% (0.0826 => 0.0948, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 13.33% (0.2243 => 0.2542, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.45% (0.0819 => 0.0921, std.dev.: 0.0008) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.29% (0.1072 => 0.1193, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 11.25% (0.2781 => 0.3094, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 11.23% (0.4328 => 0.4814, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 11.05% (0.5818 => 0.6461, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.90% (0.1413 => 0.1567, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.86% (0.2782 => 0.3084, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 10.76% (0.1013 => 0.1122, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 10.76% (0.4062 => 0.4499, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/Hello: 10.72% (0.5748 => 0.6364, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.62% (0.3485 => 0.3855, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.55% (0.2655 => 0.2935, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 10.45% (0.2690 => 0.2971, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.42% (0.3022 => 0.3337, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.42% (3.9660 => 4.3791, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.36% (0.3899 => 0.4303, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 10.36% (0.2761 => 0.3047, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 10.35% (0.7061 => 0.7792, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.33% (0.4016 => 0.4431, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 10.32% (0.2607 => 0.2876, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.31% (0.2765 => 0.3050, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.26% (0.1588 => 0.1751, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.24% (1.9828 => 2.1858, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/fibo: 10.20% (0.2628 => 0.2896, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 10.16% (1.3693 => 1.5084, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 10.14% (0.7038 => 0.7752, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 10.11% (0.2937 => 0.3234, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 10.11% (0.3453 => 0.3802, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 10.05% (0.2726 => 0.3000, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 10.04% (0.2760 => 0.3037, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.01% (0.2696 => 0.2966, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.00% (0.2721 => 0.2993, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.98% (0.2966 => 0.3262, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 9.98% (0.3868 => 0.4254, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.98% (0.2596 => 0.2855, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 9.93% (0.3293 => 0.3620, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.89% (0.3580 => 0.3934, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.89% (0.3489 => 0.3834, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.88% (0.6283 => 0.6904, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.88% (0.3756 => 0.4127, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.85% (1.4563 => 1.5997, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary: 9.82% (0.3107 => 0.3412, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.82% (0.9199 => 1.0102, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 9.81% (0.3149 => 0.3458, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.81% (0.7710 => 0.8466, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.79% (1.2193 => 1.3387, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.72% (0.1327 => 0.1456, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.69% (0.5265 => 0.5775, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 9.64% (0.2988 => 0.3276, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 9.56% (0.3192 => 0.3497, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.50% (0.6959 => 0.7620, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 9.35% (13.8202 => 15.1118, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/lists1: 9.31% (0.3534 => 0.3863, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.29% (0.4390 => 0.4798, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.19% (1.1364 => 1.2408, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.09% (0.1276 => 0.1392, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.97% (0.5577 => 0.6077, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.95% (0.3130 => 0.3410, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.90% (0.1157 => 0.1260, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 8.76% (0.2945 => 0.3203, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 8.65% (0.2995 => 0.3254, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.61% (0.6576 => 0.7142, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.58% (0.4791 => 0.5202, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 8.51% (1.0313 => 1.1191, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 8.43% (0.1589 => 0.1723, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.38% (0.4379 => 0.4746, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.36% (0.1435 => 0.1555, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.26% (0.1986 => 0.2150, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.16% (0.8698 => 0.9408, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.15% (0.3755 => 0.4061, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.13% (0.3246 => 0.3510, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 8.11% (16.6129 => 17.9609, std.dev.: 0.0185) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.09% (0.2127 => 0.2299, std.dev.: 0.0019) MultiSource/Applications/Burg/burg: 8.01% (1.1061 => 1.1947, std.dev.: 0.0071) MultiSource/Applications/minisat/minisat: 7.98% (0.6744 => 0.7282, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.95% (0.7460 => 0.8053, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.91% (0.2504 => 0.2702, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 7.88% (0.8310 => 0.8965, std.dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.86% (0.2914 => 0.3143, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.82% (0.5637 => 0.6078, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.78% (7.2180 => 7.7792, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/18-imp/imp: 7.73% (0.3220 => 0.3469, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 7.55% (3.1889 => 3.4298, std.dev.: 0.0066) MultiSource/Applications/spiff/spiff: 7.55% (0.7506 => 0.8073, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.53% (3.6692 => 3.9455, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 7.37% (3.8646 => 4.1493, std.dev.: 0.0146) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.37% (0.2023 => 0.2172, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 7.32% (1.0594 => 1.1370, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/09-vor/vor: 7.25% (0.2925 => 0.3137, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 7.22% (2.1791 => 2.3365, std.dev.: 0.0061) MultiSource/Applications/treecc/treecc: 7.17% (1.9270 => 2.0652, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.09% (0.8818 => 0.9443, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.08% (0.1865 => 0.1997, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/for-in: 6.97% (0.3789 => 0.4053, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 6.94% (0.1657 => 0.1772, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 6.87% (1.2749 => 1.3625, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.83% (1.3245 => 1.4149, std.dev.: 0.0085) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.82% (0.1789 => 0.1911, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.80% (0.3663 => 0.3912, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.80% (0.3914 => 0.4180, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 6.79% (14.8535 => 15.8627, std.dev.: 0.0104) SingleSource/UnitTests/ObjC/trivial-interface: 6.79% (0.3578 => 0.3821, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.77% (4.6629 => 4.9788, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/parameter-passing: 6.77% (0.4003 => 0.4274, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 6.77% (1.2292 => 1.3124, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 6.75% (0.3646 => 0.3892, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.73% (0.3940 => 0.4205, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 6.71% (0.3131 => 0.3341, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.69% (0.1569 => 0.1674, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 6.66% (0.3601 => 0.3841, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.66% (0.3650 => 0.3893, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 6.64% (0.4113 => 0.4386, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 6.62% (8.4961 => 9.0586, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-3: 6.51% (0.3623 => 0.3859, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.43% (0.1819 => 0.1936, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.42% (4.3801 => 4.6613, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.40% (4.4433 => 4.7278, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.39% (0.6135 => 0.6527, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 6.26% (0.6250 => 0.6641, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.03% (0.2140 => 0.2269, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.89% (1.1333 => 1.2001, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.79% (3.2742 => 3.4638, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.76% (4.9865 => 5.2736, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.55% (0.3511 => 0.3706, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.39% (0.3245 => 0.3420, std.dev.: 0.0037) MultiSource/Applications/JM/ldecod/ldecod: 5.33% (6.5754 => 6.9261, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.31% (0.9108 => 0.9592, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.13% (0.2321 => 0.2440, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.03% (1.5188 => 1.5952, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 4.91% (3.7467 => 3.9307, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.60% (6.2785 => 6.5676, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.51% (2.1007 => 2.1954, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.37% (13.2842 => 13.8650, std.dev.: 0.0193) MultiSource/Applications/sqlite3/sqlite3: 2.92% (16.2614 => 16.7370, std.dev.: 0.0172) MultiSource/Applications/ClamAV/clamscan: 2.40% (14.5298 => 14.8780, std.dev.: 0.0122) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5137, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.09% (1.0895 => 1.3629, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.56% (1.8175 => 2.2639, std.dev.: 0.0480) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.62% (1.1560 => 1.2556, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.61% (3.1736 => 3.4152, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.22% (1.2998 => 1.3807, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0036, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.93% (11.2619 => 11.7043, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7748, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.49% (10.7476 => 11.1228, std.dev.: 0.0145) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9859, std.dev.: 0.0008) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309) SingleSource/Benchmarks/Misc/salsa20: 2.23% (7.4271 => 7.5929, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5133, std.dev.: 0.0108) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.31% (5.5130 => 5.5852, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1885, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.13% (3.1071 => 3.1421, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.07% (12.4560 => 12.5889, std.dev.: 0.0072) MultiSource/Applications/lemon/lemon: 1.06% (1.4298 => 1.4450, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.01% (9.9194 => 10.0195, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.79% (0.2670 => 0.1394, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -16.41% (0.0707 => 0.0591, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.28% (0.4657 => 0.3899, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.73% (1.3813 => 1.1778, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.59% (1.3819 => 1.1803, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.58% (22.5627 => 21.5288, std.dev.: 0.0093) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.34% (0.0997 => 0.0864, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -12.15% (0.2238 => 0.1966, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/chomp: -12.13% (1.2308 => 1.0815, std.dev.: 0.0070) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.19% (20.3410 => 18.2692, std.dev.: 0.0213) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.12% (1.3780 => 1.2937, std.dev.: 0.0116) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742) SingleSource/UnitTests/Vector/multiplies: -5.23% (2.6470 => 2.5086, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.81% (13.3668 => 12.7232, std.dev.: 0.0261) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.42% (0.9996 => 0.9554, std.dev.: 0.0074) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.16% (0.3458 => 0.3314, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.43% (1.7688 => 1.7082, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.12% (0.4867 => 0.4715, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -3.00% (3.2729 => 3.1748, std.dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.45% (3.0263 => 2.9522, std.dev.: 0.0038) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.34% (1.9762 => 1.9300, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.90% (0.6589 => 0.6464, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.88% (28.2225 => 27.6928, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/lists: -1.82% (6.3560 => 6.2401, std.dev.: 0.0059) MultiSource/Applications/lua/lua: -1.74% (26.5159 => 26.0558, std.dev.: 0.0238) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0074, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4947, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: -1.13% (4.4810 => 4.4302, std.dev.: 0.0042) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2572, std.dev.: 0.0006) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 3 04:00:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 3 Oct 2012 06:00:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121003110033.3B7852A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4512?compare_to=4507&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4512, Order: 165095, Start Time: 2012-10-03 07:52:59, End Time: 2012-10-03 11:02:14 To: 4507, Order: 165088, Start Time: 2012-10-03 04:11:56, End Time: 2012-10-03 07:23:51 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 1 (136 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (131 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1038 (754 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.15% (2.0637 => 2.1080, std.dev.: 0.0113) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.01% (9.8084 => 9.8071, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.01% (9.4131 => 9.4125, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.03% (16.9309 => 16.9364, std.dev.: 0.0019) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.16% (0.0625 => 0.0726, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.42% (0.1063 => 0.1195, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 12.33% (1.5932 => 1.7897, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.88% (0.3446 => 0.3821, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 10.76% (0.3465 => 0.3838, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.70% (0.3496 => 0.3870, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.69% (0.3488 => 0.3861, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 10.69% (0.3442 => 0.3810, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.61% (0.3460 => 0.3827, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.58% (0.3469 => 0.3836, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.41% (0.3650 => 0.4030, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 10.32% (0.3643 => 0.4019, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.26% (0.3724 => 0.4106, std.dev.: 0.0032) SingleSource/UnitTests/ObjC++/Hello: 8.58% (0.5826 => 0.6326, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 8.58% (0.5889 => 0.6394, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 8.19% (0.3004 => 0.3250, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 8.03% (0.1619 => 0.1749, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.00% (0.2738 => 0.2957, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.96% (1.3152 => 1.4199, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.85% (0.4994 => 0.5386, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.58% (0.2875 => 0.3093, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 7.48% (5.5417 => 5.9562, std.dev.: 0.0047) SingleSource/UnitTests/ObjC++/property-reference: 7.47% (0.7171 => 0.7707, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/18-imp/imp: 7.46% (0.1421 => 0.1527, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 7.44% (0.2714 => 0.2916, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.39% (0.3195 => 0.3431, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 7.30% (0.2725 => 0.2924, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 7.28% (1.0781 => 1.1566, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.27% (0.4361 => 0.4678, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 7.26% (0.2823 => 0.3028, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.26% (0.2729 => 0.2927, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.25% (0.2813 => 0.3017, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.21% (1.6211 => 1.7380, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 7.21% (0.2803 => 0.3005, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.20% (0.2792 => 0.2993, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 7.16% (0.2780 => 0.2979, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.15% (2.0673 => 2.2152, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.15% (0.3930 => 0.4211, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 7.13% (0.2750 => 0.2946, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 7.11% (0.3096 => 0.3316, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 7.09% (0.4146 => 0.4440, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.08% (0.5000 => 0.5354, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 7.07% (0.9909 => 1.0610, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.06% (0.3060 => 0.3276, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 7.04% (0.2811 => 0.3009, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.02% (0.3362 => 0.3598, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.00% (0.2014 => 0.2155, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.98% (0.2736 => 0.2927, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.98% (0.3625 => 0.3878, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.97% (0.2911 => 0.3114, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 6.96% (0.3317 => 0.3548, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.96% (3.5627 => 3.8105, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary3: 6.95% (0.3267 => 0.3494, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 6.94% (0.3258 => 0.3484, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 6.92% (23.5202 => 25.1468, std.dev.: 0.0118) MultiSource/Benchmarks/nbench/nbench: 6.82% (0.2566 => 0.2741, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: 6.74% (0.3678 => 0.3926, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.73% (0.3282 => 0.3503) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.73% (0.1620 => 0.1729, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 6.72% (0.3348 => 0.3573, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: 6.68% (0.3726 => 0.3975, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (0.4251 => 0.4535, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 6.67% (0.3477 => 0.3709, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.67% (0.5026 => 0.5361, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.66% (0.3124 => 0.3332, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.37% (0.3690 => 0.3925, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 6.36% (2.1013 => 2.2349, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.32% (2.7292 => 2.9018, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 6.26% (0.6634 => 0.7049, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.23% (0.6435 => 0.6836, std.dev.: 0.0142) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.19% (0.4139 => 0.4395, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 6.18% (0.3336 => 0.3542, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.15% (0.3981 => 0.4226, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 6.12% (4.2109 => 4.4688, std.dev.: 0.0071) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.06% (0.3845 => 0.4078, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.04% (0.2068 => 0.2193, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.99% (4.4195 => 4.6844, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.96% (0.2737 => 0.2900, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.93% (0.3084 => 0.3267, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 5.91% (0.5012 => 0.5308, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.86% (0.2866 => 0.3034, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 5.77% (1.4269 => 1.5092, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/gs/gs: 5.76% (1.8794 => 1.9877, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.73% (0.3890 => 0.4113, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 5.62% (4.6177 => 4.8772, std.dev.: 0.0170) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.59% (0.5900 => 0.6230, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.51% (0.3903 => 0.4118, std.dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 5.49% (2.1653 => 2.2841, std.dev.: 0.0073) MultiSource/Applications/spiff/spiff: 5.49% (0.4029 => 0.4250, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.42% (0.2103 => 0.2217, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.39% (0.2040 => 0.2150, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.28% (0.1968 => 0.2072, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: 5.28% (0.5546 => 0.5839, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.23% (0.3271 => 0.3442, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 5.20% (0.2691 => 0.2831, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: 5.18% (2.0346 => 2.1399, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.07% (0.4658 => 0.4894, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 5.01% (0.2075 => 0.2179, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 5.00% (0.9697 => 1.0182, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 4.97% (0.4847 => 0.5088, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.94% (0.7426 => 0.7793, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.79% (0.5361 => 0.5618, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 4.79% (0.7875 => 0.8252, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 4.77% (0.2391 => 0.2505, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.71% (1.9694 => 2.0622, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.68% (0.2969 => 0.3108, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.55% (1.9966 => 2.0875, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.28% (0.5584 => 0.5823, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.21% (11.6398 => 12.1294, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.91% (4.6926 => 4.8759, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.86% (0.4253 => 0.4417, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 3.43% (0.3498 => 0.3618, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 2.72% (11.9555 => 12.2807, std.dev.: 0.0090) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0294, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.33% (0.5917 => 0.6706, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 5.83% (3.3903 => 3.5880, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: 5.42% (0.2122 => 0.2237, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6727, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1723, std.dev.: 0.0350) SingleSource/Benchmarks/Misc/flops-2: 4.52% (1.8057 => 1.8873, std.dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/dry: 4.30% (14.0481 => 14.6528, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.42% (79.9355 => 82.6684, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1940, std.dev.: 0.0069) MultiSource/Applications/viterbi/viterbi: 1.90% (46.6247 => 47.5085, std.dev.: 0.0054) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.59% (3.1722 => 3.2227, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2865, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5128, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.12% (6.9584 => 7.0360, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.04% (1.0927 => 1.1041, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5841, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.90% (25.4195 => 16.5492, std.dev.: 0.0235) MultiSource/Applications/sgefa/sgefa: -9.24% (1.5554 => 1.4117, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -8.62% (0.2402 => 0.2195, std.dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9745, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7908, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9583, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -5.82% (3.3665 => 3.1705, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7974, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.37% (21.9346 => 21.1962, std.dev.: 0.0590) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.07% (0.6293 => 0.6100, std.dev.: 0.0046) MultiSource/Applications/siod/siod: -2.98% (6.9842 => 6.7758, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.58% (17.2379 => 16.7940, std.dev.: 0.0600) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5785, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.14% (105.3826 => 104.1766, std.dev.: 0.0241) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0416, std.dev.: 0.0046) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.03% (41.7953 => 41.3646, std.dev.: 0.0160) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 3 04:31:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 3 Oct 2012 06:31:25 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121003113125.1F08C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4513?compare_to=4505&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4513, Order: 165105, Start Time: 2012-10-03 10:07:35, End Time: 2012-10-03 11:33:06 To: 4505, Order: 165088, Start Time: 2012-10-03 04:13:33, End Time: 2012-10-03 05:42:38 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (9 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 11 (75 on baseline) Performance Improvements: 1 (50 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 78 (69 on baseline) Unchanged Tests: 952 (757 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.67% (0.8035 => 0.8169, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.61% (0.8137 => 0.8268, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/football/football: 1.45% (0.8485 => 0.8608, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.29% (0.9740 => 0.9866, std.dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: 12.14% (0.1409 => 0.1580, std.dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.63% (2.4549 => 2.7158, std.dev.: 0.0105) MultiSource/Benchmarks/VersaBench/bmm/bmm: 4.59% (2.8602 => 2.9916, std.dev.: 0.0408) MultiSource/Benchmarks/Olden/bisort/bisort: 2.93% (0.6581 => 0.6774, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.71% (1.0759 => 1.1051, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.79% (1.6101 => 1.6390, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.40% (42.7561 => 43.3553, std.dev.: 0.0526) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.62% (0.8515 => 0.8377, std.dev.: 0.0045) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.53% (1.0031 => 0.9978, std.dev.: 0.0105) MultiSource/Applications/sqlite3/sqlite3: 0.08% (0.6065 => 0.6070, std.dev.: 0.0073) MultiSource/Benchmarks/McCat/08-main/main: 0.73% (0.1790 => 0.1803, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.76% (0.1589 => 0.1561, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.83% (0.3111 => 0.3054, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.98% (0.2338 => 0.2315, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.62% (0.3210 => 0.3190, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.13% (0.2298 => 0.2295, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/mandel: 17.28% (0.0382 => 0.0448, std.dev.: 0.0004) SingleSource/UnitTests/2003-05-07-VarArgs: -55.88% (0.0068 => 0.0030, std.dev.: 0.0024) SingleSource/UnitTests/2003-08-11-VaListArg: 44.83% (0.0029 => 0.0042, std.dev.: 0.0022) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.42% (0.0240 => 0.0239, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -2.55% (0.0196 => 0.0191, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0388 => 0.0388, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 21.54% (0.0246 => 0.0299, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.70% (0.0284 => 0.0282, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 25.00% (0.0260 => 0.0325, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -1.66% (0.0181 => 0.0178, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -35.05% (0.0194 => 0.0126, std.dev.: 0.0031) SingleSource/UnitTests/Vector/multiplies: -1.56% (0.0256 => 0.0252, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -3.42% (0.0292 => 0.0282, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -3.48% (0.1464 => 0.1413, std.dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: -0.17% (0.2306 => 0.2302, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: -0.45% (1.5006 => 1.4939, std.dev.: 0.0293) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.22% (0.1522 => 0.1473, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -0.20% (0.5903 => 0.5891, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -0.97% (26.8223 => 26.5629, std.dev.: 0.1357) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.69% (0.4056 => 0.4028, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.76% (0.1436 => 0.1382, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.23% (0.0568 => 0.0592, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -7.57% (0.0185 => 0.0171, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.31% (0.0604 => 0.0584, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.86% (1.1215 => 1.1311, std.dev.: 0.0120) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 200.00% (0.0005 => 0.0015, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.43% (0.0591 => 0.0553, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.14% (0.0154 => 0.0143, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.03% (0.7649 => 0.7647, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 0.11% (3.9991 => 4.0034, std.dev.: 0.0158) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -2.78% (40.5873 => 39.4601, std.dev.: 0.5653) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.97% (59.4945 => 58.3235, std.dev.: 0.7808) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 0.10% (2.9280 => 2.9310, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 27.56% (2.3538 => 3.0026, std.dev.: 0.1702) SingleSource/Regression/C/2003-05-21-UnionBitfields: 25.00% (0.0004 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.09% (1.7057 => 1.7072, std.dev.: 0.0140) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt MultiSource/Applications/JM/lencod/lencod: -96.59% (6.7458 => 0.2302, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: -91.55% (6.9722 => 0.5891, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: 21373.65% (0.1237 => 26.5629, std.dev.: 0.1357) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -1.54% (4.0659 => 4.0034, std.dev.: 0.0158) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -2.52% (40.4792 => 39.4601, std.dev.: 0.5653) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -4.66% (61.1734 => 58.3235, std.dev.: 0.7808) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.43% (3.2007 => 2.9310, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 27.34% (2.3580 => 3.0026, std.dev.: 0.1702) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -25.31% (4.1772 => 3.1201, std.dev.: 0.0349) SingleSource/Benchmarks/Shootout-C++/except: 82400.00% (0.0006 => 0.4950, std.dev.: 0.0005) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/throw_rethrow_test: 50.00% (0.0004 => 0.0006, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.55% (0.0745 => 0.0913, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.80% (0.1159 => 0.1261, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 7.33% (0.5309 => 0.5698, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 7.23% (2.1763 => 2.3337, std.dev.: 0.0283) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.21% (0.6410 => 0.6872, std.dev.: 0.0023) MultiSource/Applications/minisat/minisat: 6.56% (0.6173 => 0.6578, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.50% (0.3582 => 0.3815, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 5.89% (1.0046 => 1.0638, std.dev.: 0.0044) MultiSource/Applications/SIBsim4/SIBsim4: 5.58% (1.1653 => 1.2303, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.12% (0.2654 => 0.2790, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 5.12% (15.3105 => 16.0950, std.dev.: 0.0517) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.94% (0.2552 => 0.2678, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.87% (1.5150 => 1.5888, std.dev.: 0.0082) MultiSource/Applications/lambda-0_1_3/lambda: 4.66% (0.6915 => 0.7237, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.58% (0.6069 => 0.6347, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 4.11% (3.0225 => 3.1467, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.97% (0.2797 => 0.2908, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.90% (0.3901 => 0.4053, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.86% (0.7639 => 0.7934, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/18-imp/imp: 3.42% (0.3217 => 0.3327, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.39% (0.4248 => 0.4392, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 3.32% (1.1440 => 1.1820, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.32% (0.4880 => 0.5042, std.dev.: 0.0040) MultiSource/Applications/SPASS/SPASS: 3.05% (13.3238 => 13.7296, std.dev.: 0.0268) MultiSource/Applications/oggenc/oggenc: 2.90% (4.7455 => 4.8833, std.dev.: 0.0137) MultiSource/Benchmarks/Bullet/bullet: 2.88% (29.3170 => 30.1601, std.dev.: 0.2232) MultiSource/Applications/hbd/hbd: 2.83% (1.3268 => 1.3643, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.76% (1.1827 => 1.2153, std.dev.: 0.0044) MultiSource/Applications/siod/siod: 2.66% (2.0972 => 2.1530, std.dev.: 0.0075) MultiSource/Benchmarks/mafft/pairlocalalign: 2.59% (8.2186 => 8.4313, std.dev.: 0.0443) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.54% (1.1672 => 1.1968, std.dev.: 0.0060) MultiSource/Applications/lua/lua: 2.53% (3.5980 => 3.6891, std.dev.: 0.0122) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.45% (6.2546 => 6.4081, std.dev.: 0.0117) MultiSource/Benchmarks/nbench/nbench: 2.45% (1.0821 => 1.1086, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/football/football: 2.42% (0.8405 => 0.8608, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.31% (12.6413 => 12.9339, std.dev.: 0.0788) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.26% (0.7226 => 0.7389, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.25% (0.8569 => 0.8762, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.22% (3.0758 => 3.1442, std.dev.: 0.0255) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.18% (1.2021 => 1.2283, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.17% (1.0689 => 1.0921, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 2.03% (14.7256 => 15.0245, std.dev.: 0.0404) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.71% (1.4408 => 1.4655, std.dev.: 0.0077) MultiSource/Applications/JM/ldecod/ldecod: 1.67% (6.4908 => 6.5994, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.42% (4.0318 => 4.0892, std.dev.: 0.0112) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.05% (4.3380 => 4.3837, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.03% (4.2815 => 4.3254, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 44.44% (0.0261 => 0.0377, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/pi: 41.41% (1.6538 => 2.3386, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 22.10% (3.4629 => 4.2281, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 17.81% (1.4184 => 1.6710, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 16.14% (0.0917 => 0.1065, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 15.32% (0.3746 => 0.4320, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: 14.63% (1.7426 => 1.9976, std.dev.: 0.0124) SingleSource/Benchmarks/Stanford/Puzzle: 13.89% (0.1433 => 0.1632, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.45% (0.0766 => 0.0869, std.dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.96% (2.4042 => 2.7158, std.dev.: 0.0105) MultiSource/Benchmarks/Olden/mst/mst: 11.50% (0.1417 => 0.1580, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/queens: 11.09% (1.6261 => 1.8064, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.82% (1.0063 => 1.1051, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.86% (0.2857 => 0.3110, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: 8.83% (7.0025 => 7.6205, std.dev.: 0.0499) MultiSource/Benchmarks/FreeBench/mason/mason: 8.35% (0.5004 => 0.5422, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.39% (0.3301 => 0.3545, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bisort/bisort: 4.88% (0.6459 => 0.6774, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/dt: 4.60% (0.9851 => 1.0304, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 3.77% (92.7467 => 96.2464, std.dev.: 0.8313) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.11% (0.5587 => 0.5761, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.84% (6.6312 => 6.8196, std.dev.: 0.0055) MultiSource/Applications/hexxagon/hexxagon: 2.77% (14.4877 => 14.8883, std.dev.: 0.0147) MultiSource/Applications/siod/siod: 2.74% (3.5520 => 3.6495, std.dev.: 0.0181) SingleSource/Benchmarks/Dhrystone/dry: 2.30% (2.4013 => 2.4565, std.dev.: 0.0167) MultiSource/Benchmarks/mafft/pairlocalalign: 2.09% (62.4126 => 63.7194, std.dev.: 0.1855) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.91% (4.6127 => 4.7009, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.74% (1.6110 => 1.6390, std.dev.: 0.0081) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -45.19% (0.2996 => 0.1642, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.50% (0.0591 => 0.0328, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.69% (1.4189 => 1.1253, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -20.31% (1.4113 => 1.1246, std.dev.: 0.0094) SingleSource/UnitTests/Vector/constpool: -5.81% (8.9977 => 8.4746, std.dev.: 0.1264) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.49% (0.3497 => 0.2046, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -27.13% (15.8312 => 11.5358, std.dev.: 0.1300) SingleSource/Benchmarks/Shootout-C++/ary3: -20.15% (1.7473 => 1.3953, std.dev.: 0.0544) SingleSource/Benchmarks/CoyoteBench/lpbench: -19.35% (5.2665 => 4.2474, std.dev.: 0.2747) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.14% (1.7361 => 1.4732, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1586, std.dev.: 0.0376) MultiSource/Benchmarks/FreeBench/neural/neural: -12.04% (1.0926 => 0.9610, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.69% (1.1647 => 1.0518, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2859, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: -8.34% (9.5474 => 8.7510, std.dev.: 0.0114) MultiSource/Benchmarks/Olden/bh/bh: -7.01% (2.5166 => 2.3402, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.87% (3.6254 => 3.3765, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: -6.73% (7.6833 => 7.1663, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/fibo: -6.56% (4.6355 => 4.3315, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.45% (2.0027 => 1.8736, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/richards_benchmark: -6.34% (1.4441 => 1.3526, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.25% (2.9728 => 2.7869, std.dev.: 0.0046) MultiSource/Applications/SIBsim4/SIBsim4: -5.55% (3.4230 => 3.2331, std.dev.: 0.0191) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.47% (3.9413 => 3.7257, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout/fib2: -5.35% (4.4195 => 4.1829, std.dev.: 0.0202) SingleSource/Benchmarks/Shootout-C++/methcall: -4.91% (9.2503 => 8.7963, std.dev.: 0.0892) SingleSource/Benchmarks/BenchmarkGame/n-body: -4.88% (1.5803 => 1.5032, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -4.69% (8.5323 => 8.1324, std.dev.: 0.0684) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.65% (45.4683 => 43.3553, std.dev.: 0.0526) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.47% (0.4564 => 0.4360, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.47% (0.4140 => 0.3955, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -4.31% (3.4080 => 3.2612, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.17% (1.2959 => 1.2418, std.dev.: 0.0177) MultiSource/Benchmarks/FreeBench/distray/distray: -3.94% (0.2664 => 0.2559, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.82% (1.2722 => 1.2236, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/misr: -3.65% (0.4296 => 0.4139, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.50% (9.3855 => 9.0571, std.dev.: 0.0224) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.45% (3.7496 => 3.6201, std.dev.: 0.0263) MultiSource/Applications/aha/aha: -2.15% (3.4286 => 3.3548, std.dev.: 0.0194) SingleSource/Benchmarks/Shootout-C++/hash2: -1.90% (3.4876 => 3.4215, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: -1.86% (3.8907 => 3.8183, std.dev.: 0.0099) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.79% (2.3569 => 2.3146, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.73% (1.1683 => 1.1481, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.67% (1.0686 => 1.0508, std.dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/fldry: -1.42% (2.4971 => 2.4616, std.dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3122, std.dev.: 0.0694) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.37% (1.8739 => 1.8482, std.dev.: 0.0075) SingleSource/Benchmarks/McGill/chomp: -1.34% (1.0194 => 1.0057, std.dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.33% (27.1724 => 26.8106, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/lists: -1.16% (16.5617 => 16.3700, std.dev.: 0.0149) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.02% (0.9980 => 0.9978, std.dev.: 0.0105) MultiSource/Applications/sqlite3/sqlite3: 0.80% (0.6022 => 0.6070, std.dev.: 0.0073) MultiSource/Benchmarks/McCat/08-main/main: 8.22% (0.1666 => 0.1803, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.45% (0.1554 => 0.1561, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.94% (0.3083 => 0.3054, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.30% (0.2394 => 0.2315, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.47% (0.3175 => 0.3190, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.30% (0.2302 => 0.2295, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/mandel: -0.22% (0.0449 => 0.0448, std.dev.: 0.0004) SingleSource/UnitTests/2003-05-07-VarArgs: -66.29% (0.0089 => 0.0030, std.dev.: 0.0024) SingleSource/UnitTests/2003-08-11-VaListArg: -53.33% (0.0090 => 0.0042, std.dev.: 0.0022) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.42% (0.0240 => 0.0239, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0192 => 0.0191, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.51% (0.0390 => 0.0388, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.66% (0.0301 => 0.0299, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.70% (0.0284 => 0.0282, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.31% (0.0324 => 0.0325, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0177 => 0.0178, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -33.33% (0.0189 => 0.0126, std.dev.: 0.0031) SingleSource/UnitTests/Vector/multiplies: 1.20% (0.0249 => 0.0252, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -13.23% (0.0325 => 0.0282, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -1.12% (0.1429 => 0.1413, std.dev.: 0.0023) MultiSource/Applications/lemon/lemon: -0.53% (1.5019 => 1.4939, std.dev.: 0.0293) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.87% (0.1501 => 0.1473, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.53% (0.4264 => 0.4028, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.83% (0.1344 => 0.1382, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.51% (0.0589 => 0.0592, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -26.29% (0.0232 => 0.0171, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.61% (0.0639 => 0.0584, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.34% (1.1350 => 1.1311, std.dev.: 0.0120) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 150.00% (0.0006 => 0.0015, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.19% (0.0637 => 0.0553, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -41.87% (0.0246 => 0.0143, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.41% (0.7541 => 0.7647, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.12% (1.5363 => 1.7072, std.dev.: 0.0140) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 3 04:55:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 3 Oct 2012 06:55:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121003115529.08CCB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4514?compare_to=4510&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4514, Order: 165105, Start Time: 2012-10-03 10:37:29, End Time: 2012-10-03 11:57:09 To: 4510, Order: 165098, Start Time: 2012-10-03 08:42:40, End Time: 2012-10-03 10:02:29 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (145 on baseline) Performance Improvements: 2 (45 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 950 (697 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.39% (77.4919 => 80.1186, std.dev.: 0.3605) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.48% (15.5746 => 15.1878, std.dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.27% (3.8218 => 3.7734, std.dev.: 0.0092) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.03% (0.5761 => 0.5763, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: -0.16% (16.0541 => 16.0283, std.dev.: 0.0096) MultiSource/Benchmarks/Bullet/bullet: -0.04% (54.1508 => 54.1288, std.dev.: 0.0296) MultiSource/Benchmarks/MallocBench/gs/gs: 0.06% (4.3222 => 4.3249, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.22% (0.0461 => 0.0462, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.22% (0.0463 => 0.0464, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.47% (0.0430 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.23% (0.0432 => 0.0433) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.24% (0.0420 => 0.0421, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.24% (0.0421 => 0.0422, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0414 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.24% (0.0415 => 0.0416) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.46% (0.0431 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.23% (0.0433 => 0.0434) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.23% (0.0426 => 0.0427, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.23% (0.0428 => 0.0429, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0416 => 0.0416, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.24% (0.0419 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0424 => 0.0424) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.24% (0.0425 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0435 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.44% (0.0436 => 0.0451, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.24% (0.0411 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0413 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.24% (0.0423 => 0.0424) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.24% (0.0424 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.24% (0.0414 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.24% (0.0416 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.25% (0.0406 => 0.0407) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.25% (0.0407 => 0.0408, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0405 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.25% (0.0407 => 0.0408, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.23% (0.0443 => 0.0444) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.23% (0.0444 => 0.0445, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.25% (0.0404 => 0.0405) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.25% (0.0407 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.25% (0.0405 => 0.0406) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.25% (0.0406 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.24% (0.0413 => 0.0414) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.48% (0.0414 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.17% (1.2319 => 1.2340, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.07% (7.5475 => 7.5420, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.29% (0.7299 => 0.7278, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.27% (0.0364 => 0.0363, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -0.14% (0.1436 => 0.1434, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0651 => 0.0652, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -14.41% (63.2438 => 54.1288, std.dev.: 0.0296) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 30.59% (14.1553 => 18.4854, std.dev.: 0.0143) SingleSource/Benchmarks/Misc-C++-EH/spirit: 57.86% (3.4629 => 5.4664, std.dev.: 0.0062) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14232.50% (0.0720 => 10.3194, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10004900.00% (0.0001 => 10.0050, std.dev.: 0.0046) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 46.95% (0.2554 => 0.3753, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 46.50% (10.3673 => 15.1878, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/distray/distray: 29.73% (0.1056 => 0.1370, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 29.59% (0.1622 => 0.2102, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 14.59% (0.1432 => 0.1641, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.90% (2.2022 => 2.5083, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.24% (7.0540 => 7.9877, std.dev.: 0.0041) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.22% (0.1566 => 0.1773, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.19% (0.0834 => 0.0944, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.81% (1.7609 => 1.9688, std.dev.: 0.0072) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.10% (0.1584 => 0.1744, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 10.07% (10.4361 => 11.4871, std.dev.: 0.0204) SingleSource/UnitTests/ObjC/trivial-interface: 9.79% (0.3473 => 0.3813, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 9.74% (9.4845 => 10.4085, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.71% (0.3543 => 0.3887, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.70% (0.3516 => 0.3857, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.64% (0.3497 => 0.3834, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 9.60% (0.3561 => 0.3903, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.60% (0.3543 => 0.3883, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.37% (0.3694 => 0.4040, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 9.31% (0.1655 => 0.1809, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.19% (0.3927 => 0.4288, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions: 9.17% (0.3828 => 0.4179, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.14% (0.3886 => 0.4241, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 9.11% (0.3282 => 0.3581, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.85% (0.4879 => 0.5311, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.09% (0.3177 => 0.3434, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.07% (0.1438 => 0.1554, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 7.70% (0.7115 => 0.7663, std.dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: 7.70% (5.7591 => 6.2024, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 7.70% (0.5925 => 0.6381, std.dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference-object: 7.66% (0.6030 => 0.6492, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.64% (0.6675 => 0.7185, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 7.62% (0.3109 => 0.3346, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.61% (1.5415 => 1.6588, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 7.57% (0.7433 => 0.7996, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.53% (0.2603 => 0.2799, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.22% (0.4615 => 0.4948, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.02% (0.2905 => 0.3109, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 7.02% (0.1695 => 0.1814, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 7.01% (0.1440 => 0.1541, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 6.98% (0.3423 => 0.3662, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.97% (1.3050 => 1.3959, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 6.95% (0.7326 => 0.7835, std.dev.: 0.0030) MultiSource/Applications/d/make_dparser: 6.90% (3.3354 => 3.5657, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.82% (0.5105 => 0.5453, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.77% (0.1625 => 0.1735, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.75% (0.2756 => 0.2942, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.74% (4.2646 => 4.5521, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.74% (0.2271 => 0.2424, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.68% (0.2065 => 0.2203, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: 6.68% (0.2725 => 0.2907, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.66% (0.5860 => 0.6250, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.58% (0.4103 => 0.4373, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.56% (0.2700 => 0.2877, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.55% (0.2793 => 0.2976, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.54% (0.2891 => 0.3080, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 6.52% (0.2714 => 0.2891, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 6.47% (0.7835 => 0.8342, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.46% (0.8172 => 0.8700, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.45% (0.5569 => 0.5928, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.45% (0.8067 => 0.8587, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.44% (0.3650 => 0.3885, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.43% (0.4636 => 0.4934, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.42% (0.9765 => 1.0392, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.41% (8.1363 => 8.6577, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.35% (0.3136 => 0.3335, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.35% (0.2758 => 0.2933, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.27% (5.0018 => 5.3155, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.27% (4.9449 => 5.2548, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.26% (0.3865 => 0.4107, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.22% (0.3826 => 0.4064, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 6.21% (0.6456 => 0.6857, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.20% (0.5020 => 0.5331, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.19% (2.0665 => 2.1945, std.dev.: 0.0088) MultiSource/Benchmarks/sim/sim: 6.17% (0.3387 => 0.3596, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.17% (0.2107 => 0.2237, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.14% (0.4203 => 0.4461, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.13% (0.4289 => 0.4552, std.dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.12% (0.3121 => 0.3312, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/strcat: 6.11% (0.2831 => 0.3004, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.05% (0.3307 => 0.3507, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.04% (0.3098 => 0.3285, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.03% (0.3052 => 0.3236, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 6.00% (0.3232 => 0.3426, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 5.98% (0.4048 => 0.4290, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.98% (0.3162 => 0.3351, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.89% (0.2871 => 0.3040, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.88% (0.2872 => 0.3041, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 5.86% (0.3379 => 0.3577, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.85% (0.2802 => 0.2966, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.85% (0.3283 => 0.3475, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 5.84% (1.1642 => 1.2322, std.dev.: 0.0046) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.78% (7.9617 => 8.4217, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/methcall: 5.77% (0.2877 => 0.3043, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 5.76% (3.8723 => 4.0952, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 5.74% (0.4620 => 0.4885, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.67% (0.1940 => 0.2050, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.66% (0.3603 => 0.3807, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 5.65% (0.3684 => 0.3892, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 5.64% (1.0722 => 1.1327, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 5.64% (1.5603 => 1.6483, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.52% (0.3441 => 0.3631, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.45% (1.1861 => 1.2507, std.dev.: 0.0091) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.44% (0.1892 => 0.1995, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 5.37% (0.4299 => 0.4530, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 5.21% (21.9371 => 23.0793, std.dev.: 0.0179) MultiSource/Benchmarks/McCat/09-vor/vor: 5.19% (0.3180 => 0.3345, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 5.13% (2.0273 => 2.1314, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/football/football: 5.01% (0.8921 => 0.9368, std.dev.: 0.0025) MultiSource/Applications/siod/siod: 4.88% (2.2969 => 2.4089, std.dev.: 0.0189) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.82% (0.5981 => 0.6269, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.74% (0.6450 => 0.6756, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.68% (1.5859 => 1.6601, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.43% (0.4064 => 0.4244, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.43% (1.4186 => 1.4814, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.13% (2.2024 => 2.2933, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 4.03% (1.2842 => 1.3360, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.02% (1.1840 => 1.2316, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/objinst: 3.96% (0.3131 => 0.3255, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.07% (0.8101 => 0.8350, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.61% (14.3668 => 14.7412, std.dev.: 0.0174) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.47% (1.1194 => 1.1471, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 2.18% (17.1811 => 17.5555, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.83% (3.8922 => 3.9633, std.dev.: 0.0091) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: 30.45% (1.1277 => 1.4711, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 10.17% (3.1595 => 3.4809, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3683, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/richards_benchmark: 6.55% (1.1396 => 1.2143, std.dev.: 0.0007) SingleSource/Regression/C/uint64_to_float: 3.71% (0.5413 => 0.5614, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.65% (3.6395 => 3.7723, std.dev.: 0.0017) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.76% (4.2280 => 4.3446, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7651, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.02% (11.6436 => 11.7620, std.dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1281, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.04% (0.8651 => 0.1727, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.09% (5.2763 => 3.2664, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.22% (5.3855 => 3.5965, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.87% (5.3526 => 3.5931, std.dev.: 0.0020) SingleSource/UnitTests/Vector/constpool: -14.86% (54.1659 => 46.1160, std.dev.: 0.0199) MultiSource/Benchmarks/FreeBench/mason/mason: -14.43% (0.0811 => 0.0694, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.12% (2.9384 => 2.6116, std.dev.: 0.0130) MultiSource/Applications/ClamAV/clamscan: -10.58% (22.1758 => 19.8303, std.dev.: 0.0229) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7653, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: -16.18% (1.6925 => 1.4187, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.83% (0.0998 => 0.0860, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: -12.67% (1.3677 => 1.1944, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.35% (1.2373 => 1.0969, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/mandel-2: -10.29% (1.5373 => 1.3791, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/mason/mason: -9.81% (0.2161 => 0.1949, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.37% (19.9488 => 18.2781, std.dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.72% (1.8329 => 1.7097, std.dev.: 0.0177) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.65% (0.2497 => 0.2331, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.62% (2.7294 => 2.5759, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.00% (1.6805 => 1.5965, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.95% (13.4384 => 12.7729, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5066, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.30% (0.3463 => 0.3314, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.17% (0.9957 => 0.9542, std.dev.: 0.0041) MultiSource/Applications/siod/siod: -3.81% (3.2827 => 3.1576, std.dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.42% (32.5116 => 31.4013, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: -2.43% (12.4730 => 12.1704, std.dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.88% (10.2830 => 10.0892, std.dev.: 0.0098) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.82% (8.6802 => 8.5224, std.dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.78% (8.1563 => 8.0115, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6818, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: -1.56% (4.6441 => 4.5715, std.dev.: 0.0042) SingleSource/UnitTests/Vector/multiplies: -1.54% (2.5528 => 2.5136, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4198, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.13% (6.2999 => 6.2285, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.21% (0.5229 => 0.5763, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 6.93% (14.9895 => 16.0283, std.dev.: 0.0096) MultiSource/Benchmarks/MallocBench/gs/gs: 5.22% (4.1105 => 4.3249, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.69% (1.1048 => 1.2340, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.36% (7.1582 => 7.5420, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/stepanov_container: 16.97% (0.6222 => 0.7278, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36200.00% (0.0001 => 0.0363, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.43% (0.1485 => 0.1434, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 3 05:48:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 3 Oct 2012 07:48:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121003124828.AA07E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4515?compare_to=4511&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4515, Order: 165105, Start Time: 2012-10-03 11:25:05, End Time: 2012-10-03 12:50:09 To: 4511, Order: 165103, Start Time: 2012-10-03 09:31:10, End Time: 2012-10-03 10:56:13 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (5 on baseline) Performance Regressions: 1 (172 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 5 (0 on baseline) Unchanged Tests: 1036 (690 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.28% (3.7678 => 3.8159, std.dev.: 0.0171) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.00% (33.3246 => 33.3248, std.dev.: 0.0148) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.01% (2.7524 => 2.7521, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (2.1153 => 2.1153, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.01% (4.9751 => 4.9744, std.dev.: 0.0002) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.09% (33.2944 => 33.3248, std.dev.: 0.0148) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: -100.00% (7.3305 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.54% (2.0176 => 2.4320, std.dev.: 0.0058) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.45% (0.1410 => 0.1642, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 14.65% (0.0826 => 0.0947, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 13.24% (0.2243 => 0.2540, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.70% (0.0819 => 0.0923, std.dev.: 0.0009) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.29% (0.1072 => 0.1193, std.dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 11.25% (0.2781 => 0.3094, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 11.23% (0.4328 => 0.4814, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 11.07% (0.7061 => 0.7843, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.93% (0.2782 => 0.3086, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 10.90% (0.5818 => 0.6452, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 10.86% (0.1013 => 0.1123, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.83% (0.1413 => 0.1566, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 10.82% (0.5748 => 0.6370, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 10.64% (0.4062 => 0.4494, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.47% (0.3485 => 0.3850, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 10.45% (0.2690 => 0.2971, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 10.43% (0.2607 => 0.2879, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.42% (0.2765 => 0.3053, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.40% (3.9660 => 4.3786, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.39% (0.3022 => 0.3336, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.39% (0.3899 => 0.4304, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.36% (0.2655 => 0.2930, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.33% (0.1588 => 0.1752) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.28% (0.4016 => 0.4429, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 10.27% (0.2628 => 0.2898, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.27% (1.9828 => 2.1864, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 10.21% (0.2937 => 0.3237, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 10.18% (0.2760 => 0.3041, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.18% (0.2721 => 0.2998, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 10.16% (0.2726 => 0.3003, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 10.14% (1.3693 => 1.5082, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: 10.02% (0.7038 => 0.7743, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.01% (0.2966 => 0.3263, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.98% (0.2696 => 0.2965, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 9.96% (0.2761 => 0.3036, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.95% (0.1327 => 0.1459, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.93% (0.3756 => 0.4129, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 9.93% (0.3293 => 0.3620, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.91% (1.4563 => 1.6006, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.89% (0.6959 => 0.7647, std.dev.: 0.0068) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.89% (0.4390 => 0.4824, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 9.88% (0.3107 => 0.3414, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.84% (0.9199 => 1.0104, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 9.82% (0.3868 => 0.4248, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.80% (0.3580 => 0.3931, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.80% (0.6283 => 0.6899, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.79% (1.2193 => 1.3387, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.77% (0.3489 => 0.3830, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 9.76% (0.3453 => 0.3790, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.75% (0.2596 => 0.2849, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 9.72% (0.3149 => 0.3455, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.59% (0.5265 => 0.5770, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 9.52% (0.3192 => 0.3496, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 9.50% (0.2988 => 0.3272, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.49% (0.7710 => 0.8442, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 9.34% (13.8202 => 15.1110, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/lists1: 9.25% (0.3534 => 0.3861, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.24% (1.1364 => 1.2414, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.17% (0.1276 => 0.1393, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.95% (0.3130 => 0.3410, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 8.75% (0.1589 => 0.1728, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.73% (0.1157 => 0.1258, std.dev.: 0.0025) MultiSource/Applications/sgefa/sgefa: 8.65% (0.2995 => 0.3254, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 8.62% (0.2945 => 0.3199, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.59% (0.6576 => 0.7141, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 8.54% (1.0313 => 1.1194, std.dev.: 0.0154) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.54% (0.4379 => 0.4753, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.45% (0.4791 => 0.5196, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.43% (0.5577 => 0.6047, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.36% (0.1435 => 0.1555, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.21% (0.1986 => 0.2149, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 8.16% (16.6129 => 17.9679, std.dev.: 0.0157) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.15% (0.8698 => 0.9407, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.15% (0.3755 => 0.4061, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.13% (0.2127 => 0.2300, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.13% (0.3246 => 0.3510, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.99% (0.7460 => 0.8056, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.99% (0.2504 => 0.2704, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 7.98% (1.1061 => 1.1944, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.83% (7.2180 => 7.7835, std.dev.: 0.0038) MultiSource/Applications/minisat/minisat: 7.77% (0.6744 => 0.7268, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 7.75% (0.8310 => 0.8954, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.72% (0.2914 => 0.3139, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.64% (3.6692 => 3.9495, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 7.63% (0.7506 => 0.8079, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.63% (0.5637 => 0.6067, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 7.61% (0.3220 => 0.3465, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 7.54% (3.1889 => 3.4293, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: 7.40% (3.8646 => 4.1505, std.dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 7.38% (1.0594 => 1.1376, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 7.37% (2.1791 => 2.3396, std.dev.: 0.0154) MultiSource/Benchmarks/McCat/09-vor/vor: 7.28% (0.2925 => 0.3138, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.27% (0.2023 => 0.2170, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 7.16% (1.9270 => 2.0649, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.13% (0.1865 => 0.1998, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.95% (0.8818 => 0.9431, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.93% (0.1789 => 0.1913, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 6.90% (1.2749 => 1.3629, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.88% (1.3245 => 1.4156, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 6.87% (0.3914 => 0.4183, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.84% (0.4003 => 0.4277, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.81% (0.3789 => 0.4047, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 6.80% (0.3131 => 0.3344, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 6.80% (0.3646 => 0.3894, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 6.79% (14.8535 => 15.8624, std.dev.: 0.0063) MultiSource/Applications/oggenc/oggenc: 6.79% (4.6629 => 4.9796, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 6.79% (0.3578 => 0.3821, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 6.76% (0.1657 => 0.1769, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 6.75% (1.2292 => 1.3122, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 6.69% (0.3601 => 0.3842, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/synchronized: 6.66% (0.3663 => 0.3907, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.66% (0.3650 => 0.3893, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 6.65% (0.3940 => 0.4202, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 6.64% (0.4113 => 0.4386, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.63% (0.1569 => 0.1673, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 6.60% (8.4961 => 9.0570, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/exceptions-3: 6.57% (0.3623 => 0.3861, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.54% (0.6135 => 0.6536, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.45% (4.3801 => 4.6625, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.37% (4.4433 => 4.7262, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/bigfib: 6.34% (0.6250 => 0.6646, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.32% (0.1819 => 0.1934, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.98% (0.2140 => 0.2268, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.96% (1.1333 => 1.2008, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.77% (4.9865 => 5.2742, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.74% (0.4805 => 0.5081, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.74% (3.2742 => 3.4620, std.dev.: 0.0197) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.61% (0.3511 => 0.3708, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.49% (0.3245 => 0.3423, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 5.35% (6.5754 => 6.9270, std.dev.: 0.0109) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.35% (0.9108 => 0.9595, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.13% (0.2321 => 0.2440, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.12% (1.5188 => 1.5966, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 4.97% (3.7467 => 3.9330, std.dev.: 0.0076) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.65% (6.2785 => 6.5703, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.54% (2.1007 => 2.1961, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.35% (13.2842 => 13.8622, std.dev.: 0.0141) MultiSource/Applications/sqlite3/sqlite3: 3.00% (16.2614 => 16.7490, std.dev.: 0.0136) MultiSource/Applications/ClamAV/clamscan: 2.40% (14.5298 => 14.8783, std.dev.: 0.0205) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.73% (0.4846 => 0.6965, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.46% (5.7573 => 7.5110, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.06% (1.0895 => 1.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.37% (1.8175 => 2.2604, std.dev.: 0.0122) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 8.69% (1.1560 => 1.2565, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4146, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.16% (1.2998 => 1.3799, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9998, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0042, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.92% (11.2619 => 11.7039, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-6: 3.48% (1.9199 => 1.9867, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.32% (10.7476 => 11.1047, std.dev.: 0.0556) SingleSource/Regression/C/uint64_to_float: 3.03% (0.5449 => 0.5614) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.13% (7.4271 => 7.5850, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5134, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 1.26% (5.5130 => 5.5827, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1880, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.13% (3.1071 => 3.1421, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.12% (12.4560 => 12.5956, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 1.01% (1.4298 => 1.4442, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.00% (9.9194 => 10.0186, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.79% (0.2670 => 0.1394, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -16.41% (0.0707 => 0.0591, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.26% (0.4657 => 0.3900, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.65% (1.3813 => 1.1790, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.60% (1.3819 => 1.1802, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.55% (22.5627 => 21.5367, std.dev.: 0.0080) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -12.15% (0.2238 => 0.1966) SingleSource/Benchmarks/McGill/chomp: -11.26% (1.2308 => 1.0922, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.21% (20.3410 => 18.2642, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.11% (1.3780 => 1.2938, std.dev.: 0.0095) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5151, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.56% (13.3668 => 12.7572, std.dev.: 0.0316) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.45% (0.9996 => 0.9551, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.16% (0.3458 => 0.3314, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.49% (3.2729 => 3.1588, std.dev.: 0.0043) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.43% (1.7688 => 1.7081, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -2.44% (3.0263 => 2.9525, std.dev.: 0.0021) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.27% (1.9762 => 1.9314, std.dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6945, std.dev.: 0.0019) MultiSource/Applications/lua/lua: -1.76% (26.5159 => 26.0488, std.dev.: 0.0297) SingleSource/Benchmarks/Shootout/lists: -1.75% (6.3560 => 6.2447, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0068, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8623, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4936, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: -1.17% (9.3358 => 9.2263, std.dev.: 0.0133) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2570, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 3 07:38:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 3 Oct 2012 09:38:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121003143852.4A0732A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4516?compare_to=4512&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4516, Order: 165105, Start Time: 2012-10-03 11:31:19, End Time: 2012-10-03 14:40:33 To: 4512, Order: 165095, Start Time: 2012-10-03 07:52:59, End Time: 2012-10-03 11:02:14 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 1 (135 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (131 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1038 (755 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.16% (132.2288 => 135.0823, std.dev.: 0.7294) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.02% (9.8071 => 9.8093, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.04% (9.4125 => 9.4086, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.02% (16.9364 => 16.9333, std.dev.: 0.0076) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.12% (0.0625 => 0.0732, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.89% (0.1063 => 0.1200, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 12.47% (1.5932 => 1.7919, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.01% (0.3465 => 0.3881, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.98% (0.3446 => 0.3859, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.91% (0.3460 => 0.3872, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.90% (0.3488 => 0.3903, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 11.88% (0.3442 => 0.3851, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.81% (0.3496 => 0.3909, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 11.79% (0.3469 => 0.3878, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.48% (0.3650 => 0.4069, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.39% (0.3643 => 0.4058, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.22% (0.3724 => 0.4142, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.74% (0.5826 => 0.6335, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.71% (0.5889 => 0.6402, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.22% (1.3152 => 1.4233, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/05-eks/eks: 8.15% (0.1619 => 0.1751, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.07% (0.2875 => 0.3107, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.05% (0.4994 => 0.5396, std.dev.: 0.0019) SingleSource/Regression/C++/ofstream_ctor: 7.99% (0.3004 => 0.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.79% (0.3195 => 0.3444, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 7.78% (0.2725 => 0.2937, std.dev.: 0.0036) MultiSource/Applications/d/make_dparser: 7.73% (1.0781 => 1.1614, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.71% (0.2738 => 0.2949, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.70% (0.2714 => 0.2923, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.64% (2.0673 => 2.2253, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.62% (0.2729 => 0.2937, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 7.62% (0.2823 => 0.3038, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.61% (0.2813 => 0.3027, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.59% (0.2911 => 0.3132, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.57% (0.9909 => 1.0659, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/random: 7.56% (0.2803 => 0.3015, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/matrix: 7.55% (0.2780 => 0.2990, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 7.53% (0.2750 => 0.2957, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.52% (0.2792 => 0.3002, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.50% (1.6211 => 1.7427, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.50% (0.3362 => 0.3614, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.48% (0.3060 => 0.3289, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 7.46% (5.5417 => 5.9551, std.dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference: 7.42% (0.7171 => 0.7703, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 7.40% (0.2566 => 0.2756, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.35% (0.2014 => 0.2162, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.34% (0.4361 => 0.4681, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/wc: 7.33% (0.3096 => 0.3323, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 7.32% (0.3267 => 0.3506, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.30% (0.1383 => 0.1484, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 7.29% (0.2811 => 0.3016, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 7.21% (0.3258 => 0.3493, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.21% (3.5627 => 3.8194, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/hash: 7.16% (0.4146 => 0.4443, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.16% (0.5000 => 0.5358, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.11% (0.3124 => 0.3346, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 7.07% (0.3678 => 0.3938, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.04% (0.3282 => 0.3513, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.03% (0.3625 => 0.3880, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 7.02% (0.3317 => 0.3550, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.00% (0.5026 => 0.5378, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 6.99% (0.3348 => 0.3582, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.94% (0.2736 => 0.2926, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.92% (0.3726 => 0.3984, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.91% (0.1620 => 0.1732, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.87% (2.7292 => 2.9167, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 6.84% (0.3477 => 0.3715, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.84% (0.3845 => 0.4108, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 6.70% (4.2109 => 4.4932, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (0.4251 => 0.4535, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 6.64% (2.1013 => 2.2409, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.61% (0.3690 => 0.3934, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.59% (0.3930 => 0.4189, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: 6.59% (23.5202 => 25.0698, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.56% (0.2866 => 0.3054, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.50% (0.4139 => 0.4408, std.dev.: 0.0015) MultiSource/Applications/siod/siod: 6.48% (0.6634 => 0.7064, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.46% (0.3981 => 0.4238, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.23% (0.2040 => 0.2167, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.11% (4.4195 => 4.6897, std.dev.: 0.0102) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.04% (0.3890 => 0.4125, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 6.01% (0.5012 => 0.5313, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 5.98% (1.8794 => 1.9917, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.97% (0.6435 => 0.6819, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.93% (0.5900 => 0.6250, std.dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 5.93% (4.6177 => 4.8914, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.90% (0.2068 => 0.2190, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.85% (0.2737 => 0.2897, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.82% (0.3903 => 0.4130, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 5.80% (1.4269 => 1.5097, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.77% (0.3084 => 0.3262, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.74% (0.1968 => 0.2081, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 5.73% (0.4029 => 0.4260, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 5.72% (0.5546 => 0.5863, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 5.61% (0.3336 => 0.3523, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 5.54% (2.1653 => 2.2853, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.50% (0.3271 => 0.3451, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.41% (0.4658 => 0.4910, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.33% (0.2103 => 0.2215, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 5.20% (0.2075 => 0.2183, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 5.18% (2.0346 => 2.1399, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.98% (0.2969 => 0.3117, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 4.98% (0.7875 => 0.8267, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.89% (1.9694 => 2.0658, std.dev.: 0.0027) MultiSource/Benchmarks/PAQ8p/paq8p: 4.87% (0.4847 => 0.5083, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 4.85% (0.9697 => 1.0167, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.79% (1.9966 => 2.0923, std.dev.: 0.0024) MultiSource/Applications/lemon/lemon: 4.77% (0.2391 => 0.2505, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 4.65% (0.2691 => 0.2816, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.61% (0.7426 => 0.7768, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.35% (0.4253 => 0.4438, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.22% (0.5361 => 0.5587, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.05% (0.5584 => 0.5810, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.03% (11.6398 => 12.1093, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.79% (4.6926 => 4.8703, std.dev.: 0.0120) MultiSource/Applications/lambda-0_1_3/lambda: 3.49% (0.3498 => 0.3620, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.66% (0.3792 => 0.3893, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 2.66% (11.9555 => 12.2735, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 5.85% (3.3903 => 3.5888, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6731, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1657, std.dev.: 0.1440) SingleSource/Benchmarks/Misc/flops-2: 4.61% (1.8057 => 1.8890, std.dev.: 0.0066) SingleSource/Benchmarks/Dhrystone/dry: 4.18% (14.0481 => 14.6347, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.41% (79.9355 => 82.6613, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1997, std.dev.: 0.0063) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5063, std.dev.: 0.0055) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.56% (3.1722 => 3.2217, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2852, std.dev.: 0.0032) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5123, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.11% (6.9584 => 7.0355, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5858, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5644, std.dev.: 0.0192) MultiSource/Applications/sgefa/sgefa: -9.25% (1.5554 => 1.4116, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9782, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7994, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: -6.45% (0.2402 => 0.2247, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: -5.83% (3.3665 => 3.1704, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.70% (11.2080 => 10.7938, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std.dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.06% (21.9346 => 21.2626, std.dev.: 0.1316) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7726, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5190, std.dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: -2.55% (17.2379 => 16.7989, std.dev.: 0.0582) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5739, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.07% (105.3826 => 104.2520, std.dev.: 0.0525) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0457, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.01% (41.7953 => 41.3748, std.dev.: 0.0062) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 3 07:52:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 3 Oct 2012 09:52:49 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121003145249.2CAA32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4517?compare_to=4513&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4517, Order: 165107, Start Time: 2012-10-03 13:28:23, End Time: 2012-10-03 14:54:31 To: 4513, Order: 165105, Start Time: 2012-10-03 10:07:35, End Time: 2012-10-03 11:33:06 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (9 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 19 (66 on baseline) Performance Improvements: 3 (48 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 78 (69 on baseline) Unchanged Tests: 942 (768 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 5.76% (0.1752 => 0.1853, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.93% (0.7582 => 0.7804, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.70% (0.7881 => 0.8094, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.91% (0.8911 => 0.9081, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.72% (0.8719 => 0.8869, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.67% (0.8318 => 0.8457, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.56% (0.8156 => 0.8283, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.54% (0.8040 => 0.8164, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.51% (0.7901 => 0.8020, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.31% (1.2713 => 1.2879, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.06% (4.0892 => 4.1324, std.dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.80% (39.1531 => 42.5994, std.dev.: 0.5283) SingleSource/Benchmarks/Shootout-C++/ary3: 6.31% (1.3953 => 1.4833, std.dev.: 0.0161) MultiSource/Benchmarks/Ptrdist/ft/ft: 4.88% (0.8973 => 0.9411, std.dev.: 0.0069) MultiSource/Benchmarks/nbench/nbench: 4.87% (21.2296 => 22.2644, std.dev.: 0.0932) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.39% (2.3773 => 2.4342, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/ffbench: 1.90% (1.3919 => 1.4184, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/methcall: 1.47% (8.7963 => 8.9252, std.dev.: 0.0228) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.02% (11.5358 => 11.6534, std.dev.: 0.0404) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.09% (1.1051 => 1.0820, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.66% (1.6390 => 1.6118, std.dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/lpbench: -1.47% (4.2474 => 4.1848, std.dev.: 0.0213) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.02% (0.9978 => 1.0080, std.dev.: 0.0086) MultiSource/Applications/sqlite3/sqlite3: 0.38% (0.6070 => 0.6093, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/08-main/main: -0.28% (0.1803 => 0.1798, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.35% (0.1561 => 0.1582, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.02% (0.3054 => 0.3085, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.30% (0.2315 => 0.2308, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.09% (0.3190 => 0.3187, std.dev.: 0.0148) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.31% (0.2295 => 0.2302, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: 0.67% (0.0448 => 0.0451, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: 3.33% (0.0030 => 0.0031, std.dev.: 0.0026) SingleSource/UnitTests/2003-08-11-VaListArg: -28.57% (0.0042 => 0.0030, std.dev.: 0.0029) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -26.78% (0.0239 => 0.0175, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.52% (0.0191 => 0.0192, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.52% (0.0388 => 0.0386, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -16.39% (0.0299 => 0.0250, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.19% (0.0282 => 0.0273, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.23% (0.0325 => 0.0321, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0178 => 0.0178, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -5.56% (0.0126 => 0.0119, std.dev.: 0.0029) SingleSource/UnitTests/Vector/multiplies: -2.78% (0.0252 => 0.0245, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 14.89% (0.0282 => 0.0324, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 20.00% (0.0005 => 0.0006, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 3.33% (0.1413 => 0.1460, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: - (0.2302 => 0.2302, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 0.91% (1.4939 => 1.5075, std.dev.: 0.0156) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.41% (0.1473 => 0.1479, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -0.37% (0.5891 => 0.5869, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 0.81% (26.5629 => 26.7772, std.dev.: 0.1974) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.05% (0.4028 => 0.4030, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.07% (0.1382 => 0.1381, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.86% (0.0592 => 0.0581, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 30.41% (0.0171 => 0.0223, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.73% (0.0584 => 0.0635, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.89% (1.1311 => 1.1210, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0015 => 0.0015, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.54% (0.0553 => 0.0550, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.80% (0.0143 => 0.0139, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.01% (0.7647 => 0.7648, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 0.61% (4.0034 => 4.0277, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.48% (39.4601 => 40.4393, std.dev.: 0.2406) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.82% (58.3235 => 59.3832, std.dev.: 0.4694) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 0.43% (2.9310 => 2.9437, std.dev.: 0.1399) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -20.95% (3.0026 => 2.3736, std.dev.: 0.1763) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: -0.01% (1.7072 => 1.7070, std.dev.: 0.0022) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -63.64% (0.0121 => 0.0044, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt MultiSource/Applications/JM/lencod/lencod: -96.59% (6.7458 => 0.2302, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -91.58% (6.9722 => 0.5869, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: 21546.89% (0.1237 => 26.7772, std.dev.: 0.1974) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -0.94% (4.0659 => 4.0277, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -0.10% (40.4792 => 40.4393, std.dev.: 0.2406) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.93% (61.1734 => 59.3832, std.dev.: 0.4694) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.03% (3.2007 => 2.9437, std.dev.: 0.1399) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 0.66% (2.3580 => 2.3736, std.dev.: 0.1763) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -24.89% (4.1772 => 3.1375, std.dev.: 0.0379) SingleSource/Benchmarks/Shootout-C++/except: 82283.33% (0.0006 => 0.4943, std.dev.: 0.0013) SingleSource/Regression/C++/EH/ctor_dtor_count: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 21.88% (0.0745 => 0.0908, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.91% (0.1414 => 0.1540, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.72% (0.6410 => 0.6905, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: 7.14% (2.1763 => 2.3317, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/bigfib: 6.59% (0.5309 => 0.5659, std.dev.: 0.0038) MultiSource/Applications/minisat/minisat: 6.06% (0.6173 => 0.6547, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.75% (0.3582 => 0.3788, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 5.69% (1.1653 => 1.2316, std.dev.: 0.0085) MultiSource/Applications/lemon/lemon: 5.37% (1.0046 => 1.0585, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.13% (1.5150 => 1.5927, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.05% (0.2654 => 0.2788, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.74% (0.7639 => 0.8001, std.dev.: 0.0034) MultiSource/Applications/kimwitu++/kc: 4.70% (15.3105 => 16.0302, std.dev.: 0.0517) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.58% (0.2797 => 0.2925, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.43% (0.2552 => 0.2665, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.23% (0.6069 => 0.6326, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.23% (0.3901 => 0.4066, std.dev.: 0.0037) MultiSource/Applications/d/make_dparser: 3.83% (3.0225 => 3.1382, std.dev.: 0.0439) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.79% (0.4248 => 0.4409, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.48% (0.4880 => 0.5050, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/18-imp/imp: 3.48% (0.3217 => 0.3329, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.42% (1.1827 => 1.2231, std.dev.: 0.0121) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.09% (6.2546 => 6.4477, std.dev.: 0.0677) MultiSource/Applications/hbd/hbd: 3.08% (1.3268 => 1.3677, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.07% (0.3418 => 0.3523, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.92% (1.0821 => 1.1137, std.dev.: 0.0110) MultiSource/Benchmarks/Bullet/bullet: 2.77% (29.3170 => 30.1279, std.dev.: 0.0749) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.72% (1.1672 => 1.1990, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.66% (0.7226 => 0.7418, std.dev.: 0.0041) MultiSource/Applications/lua/lua: 2.56% (3.5980 => 3.6901, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.50% (4.0318 => 4.1324, std.dev.: 0.0052) MultiSource/Benchmarks/mafft/pairlocalalign: 2.49% (8.2186 => 8.4229, std.dev.: 0.0237) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.36% (12.6413 => 12.9401, std.dev.: 0.0431) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.36% (1.2021 => 1.2305, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.33% (1.0689 => 1.0938, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.10% (0.8569 => 0.8749, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/football/football: 2.07% (0.8405 => 0.8579, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.51% (4.2815 => 4.3461, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.26% (8.2559 => 8.3599, std.dev.: 0.0382) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.08% (1.2742 => 1.2879, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.01% (4.3380 => 4.3819, std.dev.: 0.0159) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.39% (1.6538 => 2.3383, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/matrix: 22.10% (3.4629 => 4.2281, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 17.79% (1.4184 => 1.6708, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 15.08% (0.3746 => 0.4311, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout/ary3: 14.63% (1.7426 => 1.9976, std.dev.: 0.0238) SingleSource/Benchmarks/McGill/queens: 11.10% (1.6261 => 1.8066, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.74% (0.8498 => 0.9411, std.dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.44% (38.9255 => 42.5994, std.dev.: 0.5283) SingleSource/Benchmarks/Shootout/lists: 8.77% (7.0025 => 7.6167, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.58% (0.2857 => 0.3102, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/mason/mason: 8.07% (0.5004 => 0.5408, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.52% (1.0063 => 1.0820, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.00% (0.3301 => 0.3532, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 5.16% (21.1721 => 22.2644, std.dev.: 0.0932) SingleSource/Benchmarks/Misc/dt: 4.12% (0.9851 => 1.0257, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.22% (0.5587 => 0.5767, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.79% (6.6312 => 6.8165, std.dev.: 0.0137) MultiSource/Applications/hexxagon/hexxagon: 2.79% (14.4877 => 14.8913, std.dev.: 0.0224) MultiSource/Benchmarks/mafft/pairlocalalign: 2.30% (62.4126 => 63.8483, std.dev.: 0.1492) MultiSource/Applications/siod/siod: 2.05% (3.5520 => 3.6248, std.dev.: 0.0178) SingleSource/Benchmarks/Dhrystone/dry: 1.97% (2.4013 => 2.4486, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.78% (4.6127 => 4.6949, std.dev.: 0.0110) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.70% (2.4455 => 2.4870, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/fp-convert: 1.50% (15.2242 => 15.4531, std.dev.: 0.0179) SingleSource/Benchmarks/Misc/whetstone: 1.18% (2.3453 => 2.3729, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -45.01% (0.0591 => 0.0325, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -44.99% (0.2996 => 0.1648, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -20.34% (1.4113 => 1.1243, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.99% (1.4189 => 1.1353, std.dev.: 0.0064) SingleSource/UnitTests/Vector/constpool: -6.56% (8.9977 => 8.4072, std.dev.: 0.0979) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.26% (0.3497 => 0.2054, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -34.41% (0.0311 => 0.0204, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -26.39% (15.8312 => 11.6534, std.dev.: 0.0404) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.54% (5.2665 => 4.1848, std.dev.: 0.0213) SingleSource/Benchmarks/Shootout-C++/ary3: -15.11% (1.7473 => 1.4833, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout/sieve: -12.32% (8.1594 => 7.1544, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/17-bintr/bintr: -12.00% (0.0917 => 0.0807, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/neural/neural: -11.53% (1.0926 => 0.9666, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.73% (1.1647 => 1.0514, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: -8.49% (9.5474 => 8.7364, std.dev.: 0.0121) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.38% (1.4034 => 1.2858, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -7.22% (2.5166 => 2.3348, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.88% (3.6254 => 3.3760, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: -6.70% (4.6355 => 4.3247, std.dev.: 0.0060) MultiSource/Applications/lambda-0_1_3/lambda: -6.69% (7.6833 => 7.1692, std.dev.: 0.0257) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.49% (2.0027 => 1.8727, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -6.15% (1.4441 => 1.3553, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7948, std.dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: -5.64% (3.4230 => 3.2301, std.dev.: 0.0308) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.47% (3.9413 => 3.7258, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/fib2: -5.30% (4.4195 => 4.1851, std.dev.: 0.0099) SingleSource/Benchmarks/BenchmarkGame/n-body: -4.89% (1.5803 => 1.5031, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.4140 => 0.3938, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/distray/distray: -4.65% (0.2664 => 0.2540, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.60% (0.4564 => 0.4354, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.35% (1.2959 => 1.2395, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -4.22% (3.4080 => 3.2643, std.dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.51% (9.3855 => 9.0556, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/methcall: -3.51% (9.2503 => 8.9252, std.dev.: 0.0228) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.14% (1.2722 => 1.2322, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.13% (45.4683 => 44.0435, std.dev.: 0.4263) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.60% (3.7496 => 3.6522, std.dev.: 0.0055) MultiSource/Benchmarks/sim/sim: -2.15% (3.8907 => 3.8069, std.dev.: 0.0076) MultiSource/Applications/aha/aha: -2.10% (3.4286 => 3.3565, std.dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.06% (1.1683 => 1.1442, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/hash2: -2.01% (3.4876 => 3.4176, std.dev.: 0.0104) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.91% (2.3569 => 2.3120, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -1.61% (16.5617 => 16.2954, std.dev.: 0.0441) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3118, std.dev.: 0.0193) SingleSource/Benchmarks/Dhrystone/fldry: -1.35% (2.4971 => 2.4635, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.32% (27.1724 => 26.8124, std.dev.: 0.0938) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.21% (1.8739 => 1.8513, std.dev.: 0.0067) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.00% (0.9980 => 1.0080, std.dev.: 0.0086) MultiSource/Applications/sqlite3/sqlite3: 1.18% (0.6022 => 0.6093, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/08-main/main: 7.92% (0.1666 => 0.1798, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.80% (0.1554 => 0.1582, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.06% (0.3083 => 0.3085, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.59% (0.2394 => 0.2308, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.38% (0.3175 => 0.3187, std.dev.: 0.0148) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.2302 => 0.2302, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: 0.45% (0.0449 => 0.0451, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: -65.17% (0.0089 => 0.0031, std.dev.: 0.0026) SingleSource/UnitTests/2003-08-11-VaListArg: -66.67% (0.0090 => 0.0030, std.dev.: 0.0029) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -27.08% (0.0240 => 0.0175, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0192 => 0.0192, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.03% (0.0390 => 0.0386, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -16.94% (0.0301 => 0.0250, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.87% (0.0284 => 0.0273, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0324 => 0.0321, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0177 => 0.0178, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -37.04% (0.0189 => 0.0119, std.dev.: 0.0029) SingleSource/UnitTests/Vector/multiplies: -1.61% (0.0249 => 0.0245, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -0.31% (0.0325 => 0.0324, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -40.00% (0.0010 => 0.0006, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.17% (0.1429 => 0.1460, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 0.37% (1.5019 => 1.5075, std.dev.: 0.0156) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.47% (0.1501 => 0.1479, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.49% (0.4264 => 0.4030, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.75% (0.1344 => 0.1381, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.36% (0.0589 => 0.0581, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.88% (0.0232 => 0.0223, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.63% (0.0639 => 0.0635, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.23% (1.1350 => 1.1210, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 150.00% (0.0006 => 0.0015, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.66% (0.0637 => 0.0550, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -43.50% (0.0246 => 0.0139, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.42% (0.7541 => 0.7648, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 11.11% (1.5363 => 1.7070, std.dev.: 0.0022) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -37.14% (0.0070 => 0.0044, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 3 07:58:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 3 Oct 2012 09:58:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121003145858.E64EE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4518?compare_to=4514&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4518, Order: 165107, Start Time: 2012-10-03 13:40:53, End Time: 2012-10-03 15:00:39 To: 4514, Order: 165105, Start Time: 2012-10-03 10:37:29, End Time: 2012-10-03 11:57:09 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (148 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 952 (694 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.06% (55.8215 => 56.4117, std.dev.: 0.1408) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.16% (0.5763 => 0.5754, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: -0.10% (16.0283 => 16.0117, std.dev.: 0.0200) MultiSource/Benchmarks/Bullet/bullet: 0.02% (54.1288 => 54.1388, std.dev.: 0.0242) MultiSource/Benchmarks/MallocBench/gs/gs: 0.06% (4.3249 => 4.3274, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0462 => 0.0462, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0464 => 0.0464, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0432 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0433 => 0.0433) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.24% (0.0421 => 0.0420, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0422 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0414 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0416 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0433 => 0.0433, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0434 => 0.0434, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0427 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0429 => 0.0429) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0416 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0418 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0424 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.23% (0.0426 => 0.0425, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0435 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.66% (0.0451 => 0.0439, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.24% (0.0412 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0413 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0424 => 0.0424, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0425 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0415 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0407 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0408 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.25% (0.0405 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0408 => 0.0408) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0444 => 0.0444, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0445 => 0.0445, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0405 => 0.0405, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0406 => 0.0406, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.25% (0.0406 => 0.0407, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.25% (0.0407 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.24% (0.0414 => 0.0415, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.24% (0.0416 => 0.0415, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.24% (1.2340 => 1.2310, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.02% (7.5420 => 7.5405, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.03% (0.7278 => 0.7276, std.dev.: 0.0049) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.28% (0.0363 => 0.0364, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: - (0.1434 => 0.1434, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.07% (0.0652 => 0.0672, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -14.40% (63.2438 => 54.1388, std.dev.: 0.0242) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 30.64% (14.1553 => 18.4923, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++-EH/spirit: 58.00% (3.4629 => 5.4714, std.dev.: 0.0017) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14236.53% (0.0720 => 10.3223, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10004800.00% (0.0001 => 10.0049, std.dev.: 0.0027) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 47.18% (0.2554 => 0.3759, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 46.42% (10.3673 => 15.1799, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/distray/distray: 29.83% (0.1056 => 0.1371, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 29.59% (0.1622 => 0.2102, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 14.59% (0.1432 => 0.1641, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.89% (2.2022 => 2.5080, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.43% (0.0834 => 0.0946, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.35% (7.0540 => 7.9954, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.22% (0.1566 => 0.1773, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.78% (1.7609 => 1.9684, std.dev.: 0.0035) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.16% (0.1584 => 0.1745, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 9.96% (10.4361 => 11.4755, std.dev.: 0.0072) SingleSource/UnitTests/ObjC/trivial-interface: 9.90% (0.3473 => 0.3817, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 9.72% (9.4845 => 10.4065, std.dev.: 0.0063) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.65% (0.3543 => 0.3885, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 9.62% (0.3543 => 0.3884, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.58% (0.3497 => 0.3832, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.58% (0.3561 => 0.3902, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.56% (0.3516 => 0.3852, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.31% (0.3694 => 0.4038, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 9.23% (0.3282 => 0.3585, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.19% (0.3927 => 0.4288, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.14% (0.3828 => 0.4178, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.98% (0.3886 => 0.4235, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.85% (0.4879 => 0.5311, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.72% (0.3177 => 0.3454, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.07% (0.1438 => 0.1554, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 8.04% (0.1655 => 0.1788, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.70% (0.6675 => 0.7189, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 7.67% (5.7591 => 6.2008, std.dev.: 0.0067) MultiSource/Applications/sgefa/sgefa: 7.66% (0.3109 => 0.3347, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.65% (0.2603 => 0.2802, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 7.62% (0.7115 => 0.7657, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.60% (1.5415 => 1.6587, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 7.60% (0.6030 => 0.6488, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.51% (0.5925 => 0.6370, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 7.43% (0.7433 => 0.7985, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.24% (0.4615 => 0.4949, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 7.13% (0.3423 => 0.3667, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 7.08% (0.1440 => 0.1542, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.97% (1.3050 => 1.3960, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.97% (0.5569 => 0.5957, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 6.96% (3.3354 => 3.5676, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 6.84% (0.1695 => 0.1811, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.84% (0.5860 => 0.6261, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 6.84% (0.7326 => 0.7827, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.77% (0.1625 => 0.1735, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.76% (0.5105 => 0.5450, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.69% (0.2271 => 0.2423, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.67% (4.2646 => 4.5490, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.64% (0.8067 => 0.8603, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists: 6.63% (0.3422 => 0.3649, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.63% (0.8172 => 0.8714, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.62% (0.1510 => 0.1610, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.56% (0.2700 => 0.2877, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.51% (0.4103 => 0.4370, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.49% (0.2065 => 0.2199, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.47% (0.2891 => 0.3078, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.41% (0.9765 => 1.0391, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 6.40% (0.2905 => 0.3091, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.36% (4.9449 => 5.2593, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.36% (5.0018 => 5.3197, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.34% (8.1363 => 8.6523, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.30% (0.3650 => 0.3880, std.dev.: 0.0086) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.26% (0.2107 => 0.2239, std.dev.: 0.0024) MultiSource/Benchmarks/sim/sim: 6.20% (0.3387 => 0.3597, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.20% (0.2758 => 0.2929, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.19% (0.3136 => 0.3330, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.18% (0.3865 => 0.4104, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.17% (0.2756 => 0.2926, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 6.16% (0.6456 => 0.6854, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/strcat: 6.15% (0.2831 => 0.3005, std.dev.: 0.0037) MultiSource/Applications/spiff/spiff: 6.13% (0.7835 => 0.8315, std.dev.: 0.0055) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.12% (0.3121 => 0.3312, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wc: 6.09% (0.3052 => 0.3238, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.09% (0.4203 => 0.4459, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.09% (0.4289 => 0.4550, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.07% (2.0665 => 2.1919, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/fibo: 6.06% (0.2725 => 0.2890, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.05% (0.3307 => 0.3507, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.04% (0.5020 => 0.5323, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 6.03% (0.4048 => 0.4292, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 6.00% (0.3098 => 0.3284, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.00% (0.3232 => 0.3426, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.99% (0.3826 => 0.4055, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.98% (0.3162 => 0.3351, std.dev.: 0.0023) MultiSource/Applications/Burg/burg: 5.93% (1.1642 => 1.2332, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/random: 5.89% (0.2802 => 0.2967, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.89% (0.2871 => 0.3040, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.88% (0.2872 => 0.3041, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.86% (0.2714 => 0.2873, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.85% (0.4636 => 0.4907, std.dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.82% (7.9617 => 8.4251, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.81% (0.3441 => 0.3641, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.80% (0.2793 => 0.2955, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.77% (0.1940 => 0.2052, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 5.77% (0.2877 => 0.3043, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.76% (0.1892 => 0.2001, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 5.73% (0.3283 => 0.3471, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 5.72% (3.8723 => 4.0938, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sieve: 5.72% (0.3603 => 0.3809, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 5.72% (1.5603 => 1.6495, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 5.71% (1.0722 => 1.1334, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.61% (0.4620 => 0.4879, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 5.59% (0.3684 => 0.3890, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 5.49% (0.4299 => 0.4535, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.45% (1.1861 => 1.2507, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 5.44% (0.3180 => 0.3353, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.27% (0.3379 => 0.3557, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 5.22% (21.9371 => 23.0817, std.dev.: 0.0117) MultiSource/Applications/treecc/treecc: 5.11% (2.0273 => 2.1309, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/football/football: 5.03% (0.8921 => 0.9370, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 4.98% (2.2969 => 2.4113, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.96% (0.6450 => 0.6770, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.83% (0.5981 => 0.6270, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.82% (1.5859 => 1.6624, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.43% (0.4064 => 0.4244, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.21% (1.4186 => 1.4783, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.17% (2.2024 => 2.2942, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.01% (1.2842 => 1.3357, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 3.99% (0.3131 => 0.3256, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.94% (1.1840 => 1.2307, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.42% (0.8101 => 0.8378, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.79% (14.3668 => 14.7672, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.51% (1.1194 => 1.1475, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 2.13% (17.1811 => 17.5476, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.75% (3.8922 => 3.9604, std.dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 30.45% (1.1277 => 1.4711, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 10.15% (3.1595 => 3.4802, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (3.1578 => 3.3679, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 6.57% (1.1396 => 1.2145, std.dev.: 0.0008) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.55% (3.6395 => 3.7688, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.81% (4.2280 => 4.3467, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.48% (0.9540 => 0.9681, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.14% (9.1159 => 9.2198, std.dev.: 0.0111) SingleSource/Benchmarks/McGill/queens: 1.14% (2.1825 => 2.2073) MultiSource/Benchmarks/nbench/nbench: 1.02% (11.6436 => 11.7619, std.dev.: 0.0093) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1281, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -80.28% (0.8651 => 0.1706, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.09% (5.2763 => 3.2666, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.20% (5.3855 => 3.5977, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.84% (5.3526 => 3.5949, std.dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -14.89% (54.1659 => 46.1027, std.dev.: 0.0165) MultiSource/Benchmarks/FreeBench/mason/mason: -14.30% (0.0811 => 0.0695) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.20% (2.9384 => 2.6094, std.dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: -10.59% (22.1758 => 19.8277, std.dev.: 0.0082) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4248, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.83% (0.0998 => 0.0860, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: -12.67% (1.3677 => 1.1944, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.64% (1.2373 => 1.0933, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel-2: -10.36% (1.5373 => 1.3781, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/mason/mason: -10.04% (0.2161 => 0.1944, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.32% (19.9488 => 18.2894, std.dev.: 0.0171) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.73% (1.8329 => 1.7095, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.65% (0.2497 => 0.2331) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.64% (1.9577 => 1.8473, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.97% (1.6805 => 1.5969, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.92% (13.4384 => 12.7773, std.dev.: 0.0064) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5080, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.30% (0.3463 => 0.3314, std.dev.: 0.0013) MultiSource/Applications/siod/siod: -3.63% (3.2827 => 3.1635, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.41% (32.5116 => 31.4022, std.dev.: 0.0064) MultiSource/Applications/hexxagon/hexxagon: -2.43% (12.4730 => 12.1698, std.dev.: 0.0019) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0849, std.dev.: 0.0133) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.83% (8.6802 => 8.5212, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6811, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.64% (8.1563 => 8.0223, std.dev.: 0.0085) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5123, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -1.55% (4.6441 => 4.5722, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4208, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/lists: -1.17% (6.2999 => 6.2265, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8574, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.04% (0.5229 => 0.5754, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 6.82% (14.9895 => 16.0117, std.dev.: 0.0200) MultiSource/Benchmarks/MallocBench/gs/gs: 5.28% (4.1105 => 4.3274, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.42% (1.1048 => 1.2310, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.34% (7.1582 => 7.5405, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/stepanov_container: 16.94% (0.6222 => 0.7276, std.dev.: 0.0049) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36300.00% (0.0001 => 0.0364, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.43% (0.1485 => 0.1434, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.24% (0.2116 => 0.0672, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 3 08:03:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 3 Oct 2012 10:03:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121003150356.367982A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4519?compare_to=4515&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4519, Order: 165107, Start Time: 2012-10-03 13:40:33, End Time: 2012-10-03 15:05:37 To: 4515, Order: 165105, Start Time: 2012-10-03 11:25:05, End Time: 2012-10-03 12:50:09 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (5 on baseline) Performance Regressions: 0 (173 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 5 (0 on baseline) Unchanged Tests: 1037 (687 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.02% (33.3248 => 33.3326, std.dev.: 0.0087) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.03% (2.7521 => 2.7528, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.00% (2.1153 => 2.1154, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.01% (4.9744 => 4.9750, std.dev.: 0.0008) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.11% (33.2944 => 33.3326, std.dev.: 0.0087) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: -100.00% (7.3305 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.50% (2.0176 => 2.4313, std.dev.: 0.0084) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.45% (0.1410 => 0.1642, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 14.65% (0.0826 => 0.0947, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 13.24% (0.2243 => 0.2540, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.58% (0.0819 => 0.0922, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 11.47% (0.2781 => 0.3100, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 11.46% (0.4328 => 0.4824, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.29% (0.1072 => 0.1193, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.97% (0.1413 => 0.1568, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 10.93% (0.7061 => 0.7833, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference-object: 10.93% (0.5818 => 0.6454, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.89% (0.2782 => 0.3085, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.82% (0.5748 => 0.6370, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/tsp/tsp: 10.76% (0.1013 => 0.1122, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 10.56% (0.4062 => 0.4491, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.47% (0.3485 => 0.3850, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.47% (0.2655 => 0.2933, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 10.43% (0.2607 => 0.2879, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.42% (0.3022 => 0.3337, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.38% (0.2765 => 0.3052, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.38% (3.9660 => 4.3776, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/random: 10.37% (0.2690 => 0.2969, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.36% (0.3899 => 0.4303, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.26% (1.9828 => 2.1862, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/except: 10.25% (0.2760 => 0.3043, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 10.21% (0.2937 => 0.3237, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 10.16% (0.2726 => 0.3003, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 10.16% (0.2628 => 0.2895, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.14% (0.1588 => 0.1749, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 10.11% (1.3693 => 1.5078, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.11% (0.4016 => 0.4422, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.11% (0.2721 => 0.2996, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 10.02% (0.7038 => 0.7743, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 10.00% (0.2761 => 0.3037, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 9.99% (0.3293 => 0.3622, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.98% (0.2966 => 0.3262, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.98% (0.2596 => 0.2855, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 9.94% (0.3149 => 0.3462, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.92% (0.9199 => 1.0112, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.92% (0.3489 => 0.3835, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.90% (0.2696 => 0.2963, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.85% (1.4563 => 1.5997, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.83% (0.3580 => 0.3932, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.83% (1.2193 => 1.3391, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 9.82% (0.3868 => 0.4248, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.82% (0.4390 => 0.4821, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 9.82% (0.3107 => 0.3412, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.80% (0.6283 => 0.6899, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.80% (0.1327 => 0.1457, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 9.79% (0.3453 => 0.3791, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.77% (0.3756 => 0.4123, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.62% (0.7710 => 0.8452, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.59% (0.5265 => 0.5770, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 9.54% (0.2988 => 0.3273, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.51% (0.6959 => 0.7621, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary2: 9.40% (0.3192 => 0.3492, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 9.32% (13.8202 => 15.1082, std.dev.: 0.0193) SingleSource/Benchmarks/Shootout-C++/lists1: 9.28% (0.3534 => 0.3862, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.22% (1.1364 => 1.2412, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.95% (0.3130 => 0.3410, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.93% (0.1276 => 0.1390, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.82% (0.1157 => 0.1259, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 8.75% (0.1589 => 0.1728, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 8.66% (0.2945 => 0.3200, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.64% (0.6576 => 0.7144, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 8.58% (0.2995 => 0.3252, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 8.47% (1.0313 => 1.1187, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.47% (0.4791 => 0.5197, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.45% (0.5577 => 0.6048, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.36% (0.4379 => 0.4745, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.29% (0.1435 => 0.1554, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.28% (0.3755 => 0.4066, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.26% (0.3246 => 0.3514, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 8.22% (16.6129 => 17.9783, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.12% (0.8698 => 0.9404, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.11% (0.1986 => 0.2147, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.07% (0.2504 => 0.2706, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.04% (0.2127 => 0.2298, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 7.94% (1.1061 => 1.1939, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 7.86% (0.8310 => 0.8963, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 7.84% (0.6744 => 0.7273, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.82% (0.2914 => 0.3142, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.80% (7.2180 => 7.7807, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.75% (0.5637 => 0.6074, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.72% (0.7460 => 0.8036, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.66% (3.6692 => 3.9501, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/18-imp/imp: 7.64% (0.3220 => 0.3466, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 7.63% (0.7506 => 0.8079, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 7.49% (3.1889 => 3.4278, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 7.42% (3.8646 => 4.1514, std.dev.: 0.0053) MultiSource/Applications/siod/siod: 7.33% (2.1791 => 2.3388, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/09-vor/vor: 7.32% (0.2925 => 0.3139, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.32% (0.2023 => 0.2171, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 7.32% (1.0594 => 1.1369, std.dev.: 0.0051) MultiSource/Applications/treecc/treecc: 7.18% (1.9270 => 2.0653, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.08% (0.1865 => 0.1997, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 7.02% (0.3578 => 0.3829, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 6.92% (0.4003 => 0.4280, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.92% (0.8818 => 0.9428, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 6.88% (0.3646 => 0.3897, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 6.87% (0.3914 => 0.4183, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 6.83% (0.1478 => 0.1579, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.83% (1.3245 => 1.4150, std.dev.: 0.0103) MultiSource/Benchmarks/Olden/em3d/em3d: 6.82% (0.1657 => 0.1770, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 6.81% (4.6629 => 4.9805, std.dev.: 0.0158) MultiSource/Applications/JM/lencod/lencod: 6.79% (14.8535 => 15.8623, std.dev.: 0.0167) SingleSource/UnitTests/ObjC/for-in: 6.78% (0.3789 => 0.4046, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 6.78% (1.2749 => 1.3613, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.77% (0.3650 => 0.3897, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.76% (0.1789 => 0.1910, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-2: 6.72% (0.3601 => 0.3843, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 6.71% (1.2292 => 1.3117, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 6.70% (0.3940 => 0.4204, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 6.68% (0.3131 => 0.3340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.63% (0.1569 => 0.1673, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 6.63% (8.4961 => 9.0590, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/05-eks/eks: 6.61% (0.4113 => 0.4385, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/synchronized: 6.61% (0.3663 => 0.3905, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.57% (0.3623 => 0.3861, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.57% (0.6135 => 0.6538, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.46% (4.3801 => 4.6631, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.39% (4.4433 => 4.7272, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.38% (0.1819 => 0.1935, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 6.24% (0.6250 => 0.6640, std.dev.: 0.0052) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.07% (0.2140 => 0.2270, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.00% (1.1333 => 1.2013, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.82% (3.2742 => 3.4647, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.76% (4.9865 => 5.2737, std.dev.: 0.0170) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.66% (0.4805 => 0.5077, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.58% (0.3511 => 0.3707, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.52% (0.3245 => 0.3424, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.39% (0.2321 => 0.2446, std.dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 5.34% (6.5754 => 6.9267, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.34% (0.9108 => 0.9594, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.06% (1.5188 => 1.5956, std.dev.: 0.0184) MultiSource/Applications/lua/lua: 4.87% (3.7467 => 3.9291, std.dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.60% (6.2785 => 6.5673, std.dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.53% (2.1007 => 2.1958, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.37% (13.2842 => 13.8652, std.dev.: 0.0070) MultiSource/Applications/sqlite3/sqlite3: 2.92% (16.2614 => 16.7357, std.dev.: 0.0241) MultiSource/Applications/ClamAV/clamscan: 2.44% (14.5298 => 14.8845, std.dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.47% (5.7573 => 7.5116, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.18% (1.8175 => 2.2569, std.dev.: 0.0208) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 8.55% (1.1560 => 1.2548, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4137, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.21% (1.2998 => 1.3805, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9999, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0049, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.93% (11.2619 => 11.7042, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7747, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9849, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 3.38% (10.7476 => 11.1109, std.dev.: 0.0193) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.14% (7.4271 => 7.5858, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/ffbench: 1.67% (0.8273 => 0.8411, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5133, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 1.31% (5.5130 => 5.5850, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1881, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.13% (3.1071 => 3.1422, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.08% (1.4298 => 1.4452, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5885, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.01% (9.9194 => 10.0193, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.79% (0.2670 => 0.1394, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -16.27% (0.0707 => 0.0592) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.17% (0.4657 => 0.3904, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.75% (1.3813 => 1.1776, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.66% (1.3819 => 1.1793, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.61% (22.5627 => 21.5226, std.dev.: 0.0187) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.64% (0.0997 => 0.0861, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.06% (0.2238 => 0.1968, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.51% (1.2308 => 1.1015, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.15% (20.3410 => 18.2754, std.dev.: 0.0137) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.75% (1.3780 => 1.2988, std.dev.: 0.0123) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.93% (13.3668 => 12.7077, std.dev.: 0.0254) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.82% (0.9996 => 0.9514, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.16% (0.3458 => 0.3314, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.50% (3.2729 => 3.1582, std.dev.: 0.0090) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.39% (1.7688 => 1.7088, std.dev.: 0.0165) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.21% (0.4867 => 0.4711, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.35% (1.9762 => 1.9297, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: -2.34% (3.0263 => 2.9555, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.00% (0.6589 => 0.6457, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6934, std.dev.: 0.0027) MultiSource/Applications/lua/lua: -1.79% (26.5159 => 26.0402, std.dev.: 0.0316) SingleSource/Benchmarks/Shootout/lists: -1.67% (6.3560 => 6.2498, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0076, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.23% (3.9173 => 3.8691, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4948, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: -1.19% (9.3358 => 9.2243, std.dev.: 0.0315) MultiSource/Applications/viterbi/viterbi: -1.13% (4.4810 => 4.4303, std.dev.: 0.0069) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2575, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.01% (6.6320 => 6.5649, std.dev.: 0.0098) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 3 09:35:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 3 Oct 2012 11:35:50 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121003163550.740FC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4520?compare_to=4517&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4520, Order: 165119, Start Time: 2012-10-03 15:10:24, End Time: 2012-10-03 16:37:32 To: 4517, Order: 165107, Start Time: 2012-10-03 13:28:23, End Time: 2012-10-03 14:54:31 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (9 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 10 (67 on baseline) Performance Improvements: 7 (48 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 78 (69 on baseline) Unchanged Tests: 947 (767 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.25% (2.4845 => 2.7144, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.28% (3.1109 => 3.3686, std.dev.: 0.0719) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.98% (5.0220 => 5.3727, std.dev.: 0.0095) MultiSource/Benchmarks/PAQ8p/paq8p: 6.22% (91.1041 => 96.7687, std.dev.: 0.4456) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.14% (2.5785 => 2.7111, std.dev.: 0.0189) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.96% (0.7551 => 0.7850, std.dev.: 0.0077) SingleSource/Benchmarks/CoyoteBench/lpbench: 2.42% (4.1848 => 4.2861, std.dev.: 0.0282) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.97% (1.3571 => 1.3839, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/lists: 1.19% (16.2954 => 16.4900, std.dev.: 0.0583) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.01% (5.8438 => 5.9026, std.dev.: 0.0063) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -2.01% (0.8664 => 0.8490, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.59% (0.9081 => 0.8937, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -1.52% (0.8164 => 0.8040, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.46% (0.9866 => 0.9722, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.45% (0.8799 => 0.8671, std.dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -7.45% (42.5994 => 39.4242, std.dev.: 0.1510) MultiSource/Applications/SPASS/SPASS: -3.40% (8.4254 => 8.1391, std.dev.: 0.1078) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.60% (1.0080 => 0.9919, std.dev.: 0.0793) MultiSource/Applications/sqlite3/sqlite3: -0.54% (0.6093 => 0.6060, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/08-main/main: -1.17% (0.1798 => 0.1777, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.90% (0.1582 => 0.1552, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.19% (0.3085 => 0.3079, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.43% (0.2308 => 0.2275, std.dev.: 0.0101) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.73% (0.3187 => 0.3132, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.52% (0.2302 => 0.2244, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel: -12.42% (0.0451 => 0.0395, std.dev.: 0.0024) SingleSource/UnitTests/2003-05-07-VarArgs: 187.10% (0.0031 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: 3.33% (0.0030 => 0.0031, std.dev.: 0.0028) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 13.14% (0.0175 => 0.0198, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0192 => 0.0191, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0386 => 0.0386, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 18.80% (0.0250 => 0.0297, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.30% (0.0273 => 0.0282, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -25.23% (0.0321 => 0.0240, std.dev.: 0.0087) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0178 => 0.0178, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 15.97% (0.0119 => 0.0138, std.dev.: 0.0025) SingleSource/UnitTests/Vector/multiplies: 2.45% (0.0245 => 0.0251, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -12.35% (0.0324 => 0.0284, std.dev.: 0.0019) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0006 => 0.0006, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.14% (0.1460 => 0.1462, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -0.30% (0.2302 => 0.2295, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 2.44% (1.5075 => 1.5443, std.dev.: 0.0122) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.79% (0.1479 => 0.1423, std.dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: 0.22% (0.5869 => 0.5882, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -1.75% (26.7772 => 26.3092, std.dev.: 0.2695) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.72% (0.4030 => 0.4001, std.dev.: 0.0232) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.34% (0.1381 => 0.1441, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.43% (0.0581 => 0.0532, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -26.01% (0.0223 => 0.0165, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.45% (0.0635 => 0.0575, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.54% (1.1210 => 1.1270, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 6.67% (0.0015 => 0.0016, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.82% (0.0550 => 0.0540, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0139 => 0.0139, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.12% (0.7648 => 0.7657, std.dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -0.32% (4.0277 => 4.0147, std.dev.: 0.0160) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 0.36% (40.4393 => 40.5861, std.dev.: 0.1717) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 0.20% (59.3832 => 59.5046, std.dev.: 0.2944) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -0.64% (2.9437 => 2.9249, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -2.94% (2.3736 => 2.3039, std.dev.: 0.1435) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: 25.00% (0.0004 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.04% (1.7070 => 1.7063, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 175.00% (0.0044 => 0.0121, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt MultiSource/Applications/JM/lencod/lencod: -96.60% (6.7458 => 0.2295, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -91.56% (6.9722 => 0.5882, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/09-vor/vor: 21168.55% (0.1237 => 26.3092, std.dev.: 0.2695) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -1.26% (4.0659 => 4.0147, std.dev.: 0.0160) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 0.26% (40.4792 => 40.5861, std.dev.: 0.1717) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.73% (61.1734 => 59.5046, std.dev.: 0.2944) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.62% (3.2007 => 2.9249, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -2.29% (2.3580 => 2.3039, std.dev.: 0.1435) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.26% (4.1772 => 3.0802, std.dev.: 0.0700) SingleSource/Benchmarks/Shootout-C++/except: 82533.33% (0.0006 => 0.4958, std.dev.: 0.0016) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.28% (0.0745 => 0.0911, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.05% (0.1414 => 0.1542, std.dev.: 0.0026) MultiSource/Benchmarks/PAQ8p/paq8p: 7.51% (2.1763 => 2.3397, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.15% (0.6410 => 0.6868, std.dev.: 0.0031) MultiSource/Applications/minisat/minisat: 6.61% (0.6173 => 0.6581, std.dev.: 0.0034) MultiSource/Applications/lemon/lemon: 5.90% (1.0046 => 1.0639, std.dev.: 0.0087) MultiSource/Applications/SIBsim4/SIBsim4: 5.62% (1.1653 => 1.2308, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.08% (0.2797 => 0.2939, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 5.06% (15.3105 => 16.0857, std.dev.: 0.2564) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.86% (0.2552 => 0.2676, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.80% (0.3582 => 0.3754, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.45% (0.2654 => 0.2772, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 4.40% (0.6915 => 0.7219, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.36% (0.3901 => 0.4071, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.26% (1.5150 => 1.5795, std.dev.: 0.0140) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.22% (0.6069 => 0.6325, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.20% (0.7639 => 0.7960, std.dev.: 0.0055) MultiSource/Applications/d/make_dparser: 3.81% (3.0225 => 3.1377, std.dev.: 0.0218) MultiSource/Applications/oggenc/oggenc: 3.61% (4.7455 => 4.9166, std.dev.: 0.0211) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.58% (0.4248 => 0.4400, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.28% (0.4880 => 0.5040, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 3.13% (29.3170 => 30.2347, std.dev.: 0.2815) MultiSource/Applications/siod/siod: 3.12% (2.0972 => 2.1626, std.dev.: 0.0100) MultiSource/Benchmarks/McCat/18-imp/imp: 3.11% (0.3217 => 0.3317, std.dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 2.93% (13.3238 => 13.7146, std.dev.: 0.0975) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.70% (3.0758 => 3.1588, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 2.56% (8.2186 => 8.4289, std.dev.: 0.0752) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.15% (2.0317 => 2.0753, std.dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: 2.03% (14.7256 => 15.0249, std.dev.: 0.0556) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.99% (6.2546 => 6.3792, std.dev.: 0.0450) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.99% (1.4408 => 1.4695, std.dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: 1.97% (1.0821 => 1.1034, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/football/football: 1.94% (0.8405 => 0.8568, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.87% (1.1672 => 1.1890, std.dev.: 0.0034) MultiSource/Applications/lua/lua: 1.86% (3.5980 => 3.6649, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.70% (1.0689 => 1.0871, std.dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 49.81% (0.0261 => 0.0391, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/pi: 41.35% (1.6538 => 2.3376, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2286, std.dev.: 0.0169) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.02% (0.0766 => 0.0904, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 17.80% (1.4184 => 1.6709, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 15.70% (0.0917 => 0.1061, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: 15.63% (1.7426 => 2.0150, std.dev.: 0.0421) MultiSource/Applications/sgefa/sgefa: 14.98% (0.3746 => 0.4307, std.dev.: 0.0074) SingleSource/Benchmarks/Stanford/Puzzle: 13.54% (0.1433 => 0.1627, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.90% (2.4042 => 2.7144, std.dev.: 0.0093) SingleSource/Benchmarks/McGill/queens: 11.08% (1.6261 => 1.8063, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/mason/mason: 9.27% (0.5004 => 0.5468, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.20% (1.0063 => 1.0989, std.dev.: 0.0119) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.93% (0.2857 => 0.3112, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/lists: 8.63% (7.0025 => 7.6066, std.dev.: 0.0337) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.48% (0.3301 => 0.3548, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.86% (4.2129 => 4.4599, std.dev.: 0.0602) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.34% (2.5984 => 2.7111, std.dev.: 0.0189) MultiSource/Benchmarks/PAQ8p/paq8p: 4.34% (92.7467 => 96.7687, std.dev.: 0.4456) SingleSource/Benchmarks/Misc/dt: 4.22% (0.9851 => 1.0267, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.24% (0.5587 => 0.5768, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.17% (0.7609 => 0.7850, std.dev.: 0.0077) MultiSource/Applications/siod/siod: 3.06% (3.5520 => 3.6607, std.dev.: 0.0098) MultiSource/Applications/hexxagon/hexxagon: 2.87% (14.4877 => 14.9035, std.dev.: 0.0122) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.83% (6.6312 => 6.8187, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.46% (4.6127 => 4.7261, std.dev.: 0.0177) SingleSource/Benchmarks/Dhrystone/dry: 2.40% (2.4013 => 2.4589, std.dev.: 0.0053) MultiSource/Benchmarks/mafft/pairlocalalign: 1.93% (62.4126 => 63.6178, std.dev.: 0.1744) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.50% (2.9152 => 2.9589, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.28% (38.9255 => 39.4242, std.dev.: 0.1510) MultiSource/Benchmarks/Olden/em3d/em3d: 1.01% (4.6414 => 4.6882, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -45.96% (0.2996 => 0.1619, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -45.01% (0.0591 => 0.0325, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -21.54% (1.4189 => 1.1132, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -20.58% (1.4113 => 1.1209, std.dev.: 0.0069) MultiSource/Applications/ClamAV/clamscan: -1.54% (14.6079 => 14.3836, std.dev.: 0.0428) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -42.58% (0.3497 => 0.2008, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -33.12% (0.0311 => 0.0208, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -25.77% (15.8312 => 11.7509, std.dev.: 0.5165) SingleSource/Benchmarks/CoyoteBench/lpbench: -18.62% (5.2665 => 4.2861, std.dev.: 0.0282) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -14.97% (1.7361 => 1.4762, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary3: -14.89% (1.7473 => 1.4871, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: -12.15% (1.0926 => 0.9599, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/sieve: -12.13% (8.1594 => 7.1693, std.dev.: 0.0107) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.89% (1.1647 => 1.0495, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.85% (1.4034 => 1.2792, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: -8.33% (9.5474 => 8.7523, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/bh/bh: -7.43% (2.5166 => 2.3297, std.dev.: 0.0173) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.74% (3.6254 => 3.3810, std.dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: -6.71% (7.6833 => 7.1676, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.49% (3.6023 => 3.3686, std.dev.: 0.0719) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -6.49% (2.0027 => 1.8728, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: -6.44% (4.6355 => 4.3369, std.dev.: 0.0146) SingleSource/Benchmarks/Misc/richards_benchmark: -6.36% (1.4441 => 1.3523, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.08% (2.9728 => 2.7922, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.47% (3.9413 => 3.7258, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/fib2: -5.16% (4.4195 => 4.1913, std.dev.: 0.0049) MultiSource/Applications/SIBsim4/SIBsim4: -5.16% (3.4230 => 3.2463, std.dev.: 0.0094) SingleSource/Benchmarks/BenchmarkGame/n-body: -4.82% (1.5803 => 1.5041, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.61% (0.4140 => 0.3949, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: -4.61% (8.5323 => 8.1391, std.dev.: 0.1078) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.53% (9.3855 => 8.9602, std.dev.: 0.0495) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.45% (0.4564 => 0.4361, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.32% (45.4683 => 43.5046, std.dev.: 0.3540) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -4.16% (3.4080 => 3.2661, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/misr: -3.91% (0.4296 => 0.4128, std.dev.: 0.0035) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.91% (1.2722 => 1.2225, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/methcall: -3.31% (9.2503 => 8.9442, std.dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.33% (2.4457 => 2.3886, std.dev.: 0.0205) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.15% (3.7496 => 3.6688, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.95% (1.1683 => 1.1455, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/hash2: -1.88% (3.4876 => 3.4221, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.85% (2.3569 => 2.3132, std.dev.: 0.0123) MultiSource/Applications/aha/aha: -1.81% (3.4286 => 3.3664, std.dev.: 0.0169) MultiSource/Benchmarks/sim/sim: -1.78% (3.8907 => 3.8215, std.dev.: 0.0135) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.37% (27.1724 => 26.7993, std.dev.: 0.0522) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3178, std.dev.: 0.0521) SingleSource/Benchmarks/Dhrystone/fldry: -1.07% (2.4971 => 2.4704, std.dev.: 0.0078) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.61% (0.9980 => 0.9919, std.dev.: 0.0793) MultiSource/Applications/sqlite3/sqlite3: 0.63% (0.6022 => 0.6060, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/08-main/main: 6.66% (0.1666 => 0.1777, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.13% (0.1554 => 0.1552, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.13% (0.3083 => 0.3079, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.97% (0.2394 => 0.2275, std.dev.: 0.0101) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.35% (0.3175 => 0.3132, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.52% (0.2302 => 0.2244, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel: -12.03% (0.0449 => 0.0395, std.dev.: 0.0024) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0089 => 0.0089, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: -65.56% (0.0090 => 0.0031, std.dev.: 0.0028) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -17.50% (0.0240 => 0.0198, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.52% (0.0192 => 0.0191, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.03% (0.0390 => 0.0386, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.33% (0.0301 => 0.0297, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.70% (0.0284 => 0.0282, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -25.93% (0.0324 => 0.0240, std.dev.: 0.0087) SingleSource/UnitTests/Vector/Altivec/casts: 0.56% (0.0177 => 0.0178, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -26.98% (0.0189 => 0.0138, std.dev.: 0.0025) SingleSource/UnitTests/Vector/multiplies: 0.80% (0.0249 => 0.0251, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -12.62% (0.0325 => 0.0284, std.dev.: 0.0019) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -40.00% (0.0010 => 0.0006, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.31% (0.1429 => 0.1462, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 2.82% (1.5019 => 1.5443, std.dev.: 0.0122) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -5.20% (0.1501 => 0.1423, std.dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.17% (0.4264 => 0.4001, std.dev.: 0.0232) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.22% (0.1344 => 0.1441, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.68% (0.0589 => 0.0532, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -28.88% (0.0232 => 0.0165, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.02% (0.0639 => 0.0575, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.70% (1.1350 => 1.1270, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 166.67% (0.0006 => 0.0016, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -15.23% (0.0637 => 0.0540, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -43.50% (0.0246 => 0.0139, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.54% (0.7541 => 0.7657, std.dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.07% (1.5363 => 1.7063, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 3 09:47:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 3 Oct 2012 11:47:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121003164740.775A32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4521?compare_to=4518&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4521, Order: 165119, Start Time: 2012-10-03 15:29:47, End Time: 2012-10-03 16:49:20 To: 4518, Order: 165107, Start Time: 2012-10-03 13:40:53, End Time: 2012-10-03 15:00:39 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (146 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 953 (695 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.10% (0.5754 => 0.5760, std.dev.: 0.0052) MultiSource/Applications/SPASS/SPASS: -0.03% (16.0117 => 16.0065, std.dev.: 0.0177) MultiSource/Benchmarks/Bullet/bullet: 0.07% (54.1388 => 54.1744, std.dev.: 0.0485) MultiSource/Benchmarks/MallocBench/gs/gs: -0.19% (4.3274 => 4.3193, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0462 => 0.0462) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0464 => 0.0464, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0432 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0433 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.24% (0.0420 => 0.0421, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.24% (0.0422 => 0.0423) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.24% (0.0414 => 0.0415) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0416 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0433 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0434 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0427 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0429 => 0.0429) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.24% (0.0416 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.24% (0.0418 => 0.0419) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0424 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.24% (0.0425 => 0.0426) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.23% (0.0435 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.56% (0.0439 => 0.0459, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.24% (0.0413 => 0.0412) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.24% (0.0413 => 0.0414, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0424 => 0.0424) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.24% (0.0425 => 0.0426) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.24% (0.0415 => 0.0416) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0407 => 0.0407, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.25% (0.0408 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0406 => 0.0406) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0408 => 0.0408) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0444 => 0.0444, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0445 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0405 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0406 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0407 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.25% (0.0408 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0415 => 0.0415) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0415 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.10% (1.2310 => 1.2322, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.04% (7.5405 => 7.5375, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.03% (0.7276 => 0.7278, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0364 => 0.0364, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: - (0.1434 => 0.1434, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.12% (0.0672 => 0.0651, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -14.34% (63.2438 => 54.1744, std.dev.: 0.0485) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 30.68% (14.1553 => 18.4980, std.dev.: 0.0101) SingleSource/Benchmarks/Misc-C++-EH/spirit: 58.05% (3.4629 => 5.4731, std.dev.: 0.0141) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14222.78% (0.0720 => 10.3124, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10004200.00% (0.0001 => 10.0043, std.dev.: 0.0030) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 47.06% (0.2554 => 0.3756, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 46.65% (10.3673 => 15.2032, std.dev.: 0.0083) MultiSource/Benchmarks/FreeBench/distray/distray: 29.92% (0.1056 => 0.1372, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 29.47% (0.1622 => 0.2100, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 14.53% (0.1432 => 0.1640) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.13% (2.2022 => 2.5134, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.60% (7.0540 => 8.0135, std.dev.: 0.0115) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.55% (0.0834 => 0.0947) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.96% (0.1566 => 0.1769, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.00% (1.7609 => 1.9722, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/trivial-interface: 10.19% (0.3473 => 0.3827, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.16% (0.1584 => 0.1745, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 10.05% (0.3561 => 0.3919, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.05% (0.3543 => 0.3899, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 10.04% (10.4361 => 11.4839, std.dev.: 0.0071) SingleSource/UnitTests/ObjC/exceptions-3: 10.04% (0.3516 => 0.3869, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.95% (0.3497 => 0.3845, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 9.91% (0.3543 => 0.3894, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 9.77% (9.4845 => 10.4110, std.dev.: 0.0161) SingleSource/UnitTests/ObjC/for-in: 9.69% (0.3694 => 0.4052, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.52% (0.3886 => 0.4256, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 9.50% (0.3927 => 0.4300, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.48% (0.3828 => 0.4191, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 9.38% (0.3282 => 0.3590, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.49% (0.4879 => 0.5293, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.28% (0.3177 => 0.3440, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 8.16% (0.1655 => 0.1790, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.07% (0.1438 => 0.1554, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.99% (0.2065 => 0.2230, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.96% (0.6030 => 0.6510, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 7.81% (5.7591 => 6.2088, std.dev.: 0.0177) SingleSource/UnitTests/ObjC++/Hello: 7.80% (0.5925 => 0.6387, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 7.70% (0.7115 => 0.7663, std.dev.: 0.0032) MultiSource/Applications/sgefa/sgefa: 7.62% (0.3109 => 0.3346, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.60% (0.6675 => 0.7182, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.53% (0.2603 => 0.2799, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.48% (1.5415 => 1.6568, std.dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 7.43% (0.7433 => 0.7985, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.28% (0.4615 => 0.4951, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 7.22% (0.1440 => 0.1544, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 7.13% (0.7326 => 0.7848, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.97% (1.3050 => 1.3960, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 6.96% (0.1695 => 0.1813, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.95% (0.1625 => 0.1738, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 6.95% (0.3423 => 0.3661, std.dev.: 0.0025) MultiSource/Applications/d/make_dparser: 6.94% (3.3354 => 3.5668, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.91% (0.2271 => 0.2428, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.87% (0.4103 => 0.4385, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.81% (0.2891 => 0.3088, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/lists: 6.81% (0.3422 => 0.3655, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.72% (0.5105 => 0.5448, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.71% (0.5860 => 0.6253, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.69% (4.2646 => 4.5500, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.63% (0.2700 => 0.2879, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.61% (0.2905 => 0.3097, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 6.50% (0.7835 => 0.8344, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.48% (0.3162 => 0.3367, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.43% (0.8067 => 0.8586, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.43% (8.1363 => 8.6593, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.42% (0.3865 => 0.4113, std.dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.41% (0.3121 => 0.3321, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.40% (0.8172 => 0.8695, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.39% (0.5569 => 0.5925, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/wc: 6.39% (0.3052 => 0.3247, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.38% (0.9765 => 1.0388, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.36% (5.0018 => 5.3200, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.36% (0.3650 => 0.3882, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.35% (4.9449 => 5.2589, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.35% (0.3136 => 0.3335, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.33% (0.4203 => 0.4469, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.32% (0.2831 => 0.3010, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.32% (0.4289 => 0.4560, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/fibo: 6.31% (0.2725 => 0.2897, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/bigfib: 6.30% (0.6456 => 0.6863, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.29% (2.0665 => 2.1964, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.26% (0.2107 => 0.2239, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.24% (0.2758 => 0.2930, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.24% (0.5020 => 0.5333, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.20% (0.2756 => 0.2927, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 6.19% (0.3232 => 0.3432, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.17% (0.3826 => 0.4062, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: 6.17% (0.2871 => 0.3048, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.15% (0.4636 => 0.4921, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.14% (0.3307 => 0.3510, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.13% (0.2872 => 0.3048, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 6.13% (1.5603 => 1.6559, std.dev.: 0.0053) MultiSource/Benchmarks/sim/sim: 6.11% (0.3387 => 0.3594, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.10% (0.2802 => 0.2973, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 6.10% (0.4048 => 0.4295, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 6.10% (0.3098 => 0.3287, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.08% (0.2714 => 0.2879, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.05% (0.2793 => 0.2962, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.98% (7.9617 => 8.4382, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/lists1: 5.94% (0.3684 => 0.3903, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.94% (0.3283 => 0.3478, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.93% (0.1940 => 0.2055, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 5.91% (1.1642 => 1.2330, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/sieve: 5.88% (0.3603 => 0.3815, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.82% (0.4620 => 0.4889, std.dev.: 0.0049) MultiSource/Applications/lua/lua: 5.76% (3.8723 => 4.0955, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.67% (0.3441 => 0.3636, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 5.63% (0.4299 => 0.4541, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 5.60% (1.0722 => 1.1322, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.53% (0.3379 => 0.3566, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.41% (1.1861 => 1.2503, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.39% (0.1892 => 0.1994, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 5.33% (21.9371 => 23.1066, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/09-vor/vor: 5.19% (0.3180 => 0.3345, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 5.13% (2.0273 => 2.1312, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/football/football: 5.02% (0.8921 => 0.9369, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.95% (0.6450 => 0.6769, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 4.91% (2.2969 => 2.4096, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.78% (0.5981 => 0.6267, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.71% (1.5859 => 1.6606, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.58% (0.4064 => 0.4250, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 4.34% (0.3131 => 0.3267, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.23% (1.4186 => 1.4786, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: 4.20% (1.2842 => 1.3382, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.10% (2.2024 => 2.2927, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.99% (1.1840 => 1.2312, std.dev.: 0.0095) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.27% (0.8101 => 0.8366, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.62% (14.3668 => 14.7433, std.dev.: 0.0095) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.61% (1.1194 => 1.1486, std.dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: 2.09% (17.1811 => 17.5396, std.dev.: 0.0213) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.78% (3.8922 => 3.9613, std.dev.: 0.0153) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 30.45% (1.1277 => 1.4711, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 10.20% (3.1595 => 3.4819, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3684, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 6.63% (1.1396 => 1.2152, std.dev.: 0.0006) SingleSource/Regression/C/uint64_to_float: 3.62% (0.5413 => 0.5609, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.40% (3.6395 => 3.7634, std.dev.: 0.0056) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.75% (4.2280 => 4.3443, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7652, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.01% (11.6436 => 11.7616, std.dev.: 0.0023) MultiSource/Applications/minisat/minisat: 1.00% (9.1159 => 9.2072, std.dev.: 0.0083) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1282, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.16% (0.8651 => 0.1716, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.18% (5.2763 => 3.2619, std.dev.: 0.0126) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.90% (5.3855 => 3.6139, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.62% (5.3526 => 3.6068, std.dev.: 0.0024) SingleSource/UnitTests/Vector/constpool: -14.90% (54.1659 => 46.0940, std.dev.: 0.0420) MultiSource/Benchmarks/FreeBench/mason/mason: -14.18% (0.0811 => 0.0696, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.03% (2.9384 => 2.6143, std.dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: -10.52% (22.1758 => 19.8422, std.dev.: 0.0341) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.53% (1.1492 => 0.7639, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4232, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.53% (0.0998 => 0.0863, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -12.67% (1.3677 => 1.1944, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.23% (1.2373 => 1.0984, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -10.36% (1.5373 => 1.3780, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/mason/mason: -10.13% (0.2161 => 0.1942, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.41% (19.9488 => 18.2719, std.dev.: 0.0521) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4787, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.72% (1.8329 => 1.7097, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.65% (0.2497 => 0.2331, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.19% (13.4384 => 12.7408, std.dev.: 0.0281) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.00% (1.6805 => 1.5965, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: -4.98% (5.0483 => 4.7967, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.64% (1.5835 => 1.5101, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.39% (0.9957 => 0.9520, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.33% (0.3463 => 0.3313, std.dev.: 0.0012) MultiSource/Applications/siod/siod: -3.69% (3.2827 => 3.1615, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.43% (32.5116 => 31.3966, std.dev.: 0.0084) MultiSource/Applications/hexxagon/hexxagon: -2.44% (12.4730 => 12.1691, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.23% (8.1563 => 7.9744, std.dev.: 0.0239) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.06% (8.6802 => 8.5017, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0843, std.dev.: 0.0205) SingleSource/UnitTests/Vector/multiplies: -1.74% (2.5528 => 2.5084, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6823, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -1.56% (4.6441 => 4.5718, std.dev.: 0.0023) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4214, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8575, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/lists: -1.04% (6.2999 => 6.2342, std.dev.: 0.0048) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.15% (0.5229 => 0.5760, std.dev.: 0.0052) MultiSource/Applications/SPASS/SPASS: 6.78% (14.9895 => 16.0065, std.dev.: 0.0177) MultiSource/Benchmarks/MallocBench/gs/gs: 5.08% (4.1105 => 4.3193, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.53% (1.1048 => 1.2322, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.30% (7.1582 => 7.5375, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_container: 16.97% (0.6222 => 0.7278, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36300.00% (0.0001 => 0.0364, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.43% (0.1485 => 0.1434, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 3 09:58:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 3 Oct 2012 11:58:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121003165801.BFEDF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4522?compare_to=4519&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4522, Order: 165119, Start Time: 2012-10-03 15:34:36, End Time: 2012-10-03 16:59:42 To: 4519, Order: 165107, Start Time: 2012-10-03 13:40:33, End Time: 2012-10-03 15:05:37 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (5 on baseline) Performance Regressions: 2 (173 on baseline) Performance Improvements: 1 (41 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 5 (0 on baseline) Unchanged Tests: 1034 (688 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.98% (54.6646 => 55.7477, std.dev.: 0.4156) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.38% (79.7032 => 80.7998, std.dev.: 0.2942) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -6.88% (0.4300 => 0.4004, std.dev.: 0.0097) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.05% (33.3326 => 33.3169, std.dev.: 0.0044) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.03% (2.7528 => 2.7521, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.00% (2.1154 => 2.1153, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (4.9750 => 4.9750, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.07% (33.2944 => 33.3169, std.dev.: 0.0044) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: -100.00% (7.3305 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.49% (2.0176 => 2.4311, std.dev.: 0.0056) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.31% (0.1410 => 0.1640, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 14.89% (0.0826 => 0.0949, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.65% (0.0819 => 0.0939, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 13.29% (0.2243 => 0.2541, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 11.51% (0.2781 => 0.3101, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 11.39% (0.4328 => 0.4821, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 11.33% (0.5818 => 0.6477, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.19% (0.1072 => 0.1192, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 11.13% (0.5748 => 0.6388, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.04% (0.2782 => 0.3089, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.97% (0.1413 => 0.1568, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 10.88% (0.7061 => 0.7829, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/tsp/tsp: 10.86% (0.1013 => 0.1123, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 10.68% (0.4062 => 0.4496, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.62% (0.3485 => 0.3855, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.56% (0.2765 => 0.3057, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 10.55% (0.2607 => 0.2882, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.49% (0.3022 => 0.3339, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.48% (3.9660 => 4.3816, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/random: 10.45% (0.2690 => 0.2971, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.39% (1.9828 => 2.1888, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/fibo: 10.39% (0.2628 => 0.2901, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.36% (0.2655 => 0.2930, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.33% (0.1588 => 0.1752, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 10.29% (1.3693 => 1.5102, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/except: 10.25% (0.2760 => 0.3043, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.23% (0.4016 => 0.4427, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.23% (0.3899 => 0.4298, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 10.21% (0.2937 => 0.3237, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 10.20% (0.2726 => 0.3004, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 10.18% (0.2761 => 0.3042, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.15% (0.2966 => 0.3267, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 10.14% (0.7038 => 0.7752, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 10.14% (0.3293 => 0.3627, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.10% (0.1327 => 0.1461) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.09% (0.2696 => 0.2968, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.07% (1.4563 => 1.6030, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 10.01% (0.3107 => 0.3418, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 9.99% (0.3453 => 0.3798, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.98% (0.2596 => 0.2855, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.97% (0.3580 => 0.3937, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 9.94% (0.3149 => 0.3462, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.92% (0.9199 => 1.0112, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.92% (0.2721 => 0.2991, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.92% (0.3489 => 0.3835, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.90% (0.6959 => 0.7648, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.88% (0.3756 => 0.4127, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 9.85% (0.3868 => 0.4249, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.84% (0.6283 => 0.6901, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.83% (0.7710 => 0.8468, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.82% (0.4390 => 0.4821, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.81% (1.2193 => 1.3389, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 9.81% (0.2988 => 0.3281, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 9.52% (0.3192 => 0.3496, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.50% (0.5265 => 0.5765, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 9.39% (0.3534 => 0.3866, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 9.37% (13.8202 => 15.1152, std.dev.: 0.0097) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.26% (1.1364 => 1.2416, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.01% (0.1276 => 0.1391, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.98% (0.3130 => 0.3411, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.95% (0.4379 => 0.4771, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.90% (0.1157 => 0.1260, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 8.79% (0.2945 => 0.3204, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.79% (0.6576 => 0.7154, std.dev.: 0.0025) MultiSource/Applications/sgefa/sgefa: 8.65% (0.2995 => 0.3254, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 8.62% (0.1589 => 0.1726, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.54% (0.5577 => 0.6053, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 8.51% (1.0313 => 1.1191, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.43% (0.4791 => 0.5195, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.41% (0.1986 => 0.2153, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.29% (0.1435 => 0.1554, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 8.24% (16.6129 => 17.9817, std.dev.: 0.0097) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.18% (0.2127 => 0.2301, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.18% (0.3755 => 0.4062, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.16% (0.8698 => 0.9408, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.13% (0.3246 => 0.3510, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 8.06% (1.1061 => 1.1952, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.99% (0.2504 => 0.2704, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 7.96% (0.6744 => 0.7281, std.dev.: 0.0077) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.96% (0.2914 => 0.3146, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.90% (7.2180 => 7.7882, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/football/football: 7.88% (0.8310 => 0.8965, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.81% (0.5637 => 0.6077, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.79% (3.6692 => 3.9550, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.77% (0.7460 => 0.8040, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 7.64% (0.3220 => 0.3466, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 7.63% (0.7506 => 0.8079, std.dev.: 0.0080) MultiSource/Applications/d/make_dparser: 7.51% (3.1889 => 3.4284, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.48% (0.1819 => 0.1955, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 7.42% (0.2925 => 0.3142, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 7.41% (3.8646 => 4.1509, std.dev.: 0.0035) MultiSource/Applications/siod/siod: 7.37% (2.1791 => 2.3396, std.dev.: 0.0067) MultiSource/Benchmarks/nbench/nbench: 7.33% (1.0594 => 1.1371, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.32% (0.2023 => 0.2171, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 7.28% (1.9270 => 2.0672, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.27% (0.3578 => 0.3838, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.22% (0.4003 => 0.4292, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.18% (0.1865 => 0.1999, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions: 7.15% (0.3914 => 0.4194, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 7.12% (1.2749 => 1.3657, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 7.10% (0.1478 => 0.1583, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 7.10% (0.3789 => 0.4058, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.09% (0.8818 => 0.9443, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.05% (0.3646 => 0.3903, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.04% (0.3650 => 0.3907, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 7.03% (0.3601 => 0.3854, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.99% (0.3663 => 0.3919, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.98% (0.3940 => 0.4215, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.93% (0.1789 => 0.1913, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 6.93% (0.4113 => 0.4398, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 6.88% (0.1657 => 0.1771, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.87% (1.3245 => 1.4155, std.dev.: 0.0044) MultiSource/Applications/JM/lencod/lencod: 6.84% (14.8535 => 15.8702, std.dev.: 0.0136) SingleSource/UnitTests/ObjC/exceptions-3: 6.82% (0.3623 => 0.3870, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 6.81% (1.2292 => 1.3129, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 6.80% (0.3131 => 0.3344, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.69% (0.1569 => 0.1674, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 6.62% (8.4961 => 9.0582, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.61% (4.3801 => 4.6697, std.dev.: 0.0039) MultiSource/Applications/oggenc/oggenc: 6.57% (4.6629 => 4.9692, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/bigfib: 6.50% (0.6250 => 0.6656, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.47% (4.4433 => 4.7309, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.45% (0.6135 => 0.6531, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.07% (0.2140 => 0.2270, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.02% (1.1333 => 1.2015, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.91% (3.2742 => 3.4677, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.81% (4.9865 => 5.2761, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.76% (0.4805 => 0.5082, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.76% (0.3245 => 0.3432, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.61% (0.3511 => 0.3708, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 5.33% (6.5754 => 6.9260, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.31% (0.9108 => 0.9592, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.13% (0.2321 => 0.2440, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.06% (1.5188 => 1.5956, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 4.98% (3.7467 => 3.9332, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.76% (6.2785 => 6.5774, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.63% (2.1007 => 2.1980, std.dev.: 0.0201) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.45% (13.2842 => 13.8750, std.dev.: 0.0214) MultiSource/Applications/sqlite3/sqlite3: 2.92% (16.2614 => 16.7365, std.dev.: 0.0183) MultiSource/Applications/ClamAV/clamscan: 2.53% (14.5298 => 14.8970, std.dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5160, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.09% (1.0895 => 1.3629, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/fbench: 24.09% (1.8175 => 2.2554, std.dev.: 0.0394) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 8.59% (1.1560 => 1.2553, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4142, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.26% (1.2998 => 1.3812, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.16% (0.2093 => 0.2201, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0047, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.93% (11.2619 => 11.7049, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9857, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.41% (10.7476 => 11.1140, std.dev.: 0.0216) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.13% (7.4271 => 7.5851, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5134, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.28% (5.5130 => 5.5835, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1858, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137) MultiSource/Benchmarks/Olden/em3d/em3d: 1.13% (3.1071 => 3.1421, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.09% (12.4560 => 12.5914, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.00% (9.9194 => 10.0189, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.00% (1.4298 => 1.4441, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.79% (0.2670 => 0.1394) MultiSource/Benchmarks/FreeBench/mason/mason: -16.41% (0.0707 => 0.0591, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.95% (0.4657 => 0.3914, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.78% (1.3819 => 1.1776, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.54% (1.3813 => 1.1804, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.58% (22.5627 => 21.5302, std.dev.: 0.0114) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.14% (0.0997 => 0.0856, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -12.15% (0.2238 => 0.1966, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.33% (1.2308 => 1.0914, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.06% (20.3410 => 18.2957, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.01% (1.3780 => 1.3089, std.dev.: 0.0041) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.62% (13.3668 => 12.7497, std.dev.: 0.0240) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.16% (0.3458 => 0.3314) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.15% (0.9996 => 0.9581, std.dev.: 0.0126) MultiSource/Applications/siod/siod: -3.58% (3.2729 => 3.1557, std.dev.: 0.0176) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.40% (1.7688 => 1.7087, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.49% (3.0263 => 2.9509, std.dev.: 0.0020) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.27% (1.9762 => 1.9313, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.99% (0.6589 => 0.6458, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.87% (28.2225 => 27.6934, std.dev.: 0.0017) MultiSource/Applications/lua/lua: -1.77% (26.5159 => 26.0461, std.dev.: 0.0396) SingleSource/Benchmarks/Shootout/lists: -1.73% (6.3560 => 6.2462, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0064, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8637, std.dev.: 0.0053) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4952, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: -1.18% (9.3358 => 9.2256, std.dev.: 0.0160) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2573, std.dev.: 0.0029) MultiSource/Applications/viterbi/viterbi: -1.06% (4.4810 => 4.4333, std.dev.: 0.0051) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 3 11:19:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 3 Oct 2012 13:19:39 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121003181939.4CE3B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4523?compare_to=4520&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4523, Order: 165126, Start Time: 2012-10-03 16:54:03, End Time: 2012-10-03 18:21:21 To: 4520, Order: 165119, Start Time: 2012-10-03 15:10:24, End Time: 2012-10-03 16:37:32 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (9 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 16 (74 on baseline) Performance Improvements: 3 (45 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 78 (69 on baseline) Unchanged Tests: 945 (763 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.10% (0.7518 => 0.7826, std.dev.: 0.0046) MultiSource/Applications/spiff/spiff: 2.76% (0.7538 => 0.7746, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.35% (0.4592 => 0.4700, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.33% (1.1132 => 1.1391, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 1.91% (0.9284 => 0.9461, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.75% (0.6868 => 0.6988, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.69% (4.3435 => 4.4167, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.68% (0.5949 => 0.6049, std.dev.: 0.0028) MultiSource/Applications/treecc/treecc: 1.38% (1.9041 => 1.9303, std.dev.: 0.0086) MultiSource/Benchmarks/nbench/nbench: 1.11% (1.1034 => 1.1157, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.04% (6.3792 => 6.4458, std.dev.: 0.0097) MultiSource/Applications/lua/lua: 1.04% (3.6649 => 3.7031, std.dev.: 0.0116) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 6.83% (1.8728 => 2.0007, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.43% (0.6056 => 0.6203, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.04% (8.9602 => 9.0533, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.00% (4.4479 => 4.4925, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -4.66% (29.9429 => 28.5476, std.dev.: 0.1499) SingleSource/Benchmarks/Dhrystone/dry: -4.51% (2.4589 => 2.3481, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -2.76% (14.9035 => 14.4927, std.dev.: 0.0990) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.30% (0.9919 => 1.0147, std.dev.: 0.0094) MultiSource/Applications/sqlite3/sqlite3: 1.75% (0.6060 => 0.6166, std.dev.: 0.0079) MultiSource/Benchmarks/McCat/08-main/main: -2.53% (0.1777 => 0.1732, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.35% (0.1552 => 0.1531, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.66% (0.3079 => 0.3130, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.08% (0.2275 => 0.2345, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.45% (0.3132 => 0.3118, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.48% (0.2244 => 0.2322, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel: -2.03% (0.0395 => 0.0387, std.dev.: 0.0032) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: 129.03% (0.0031 => 0.0071, std.dev.: 0.0009) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 20.71% (0.0198 => 0.0239, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.05% (0.0191 => 0.0193, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.26% (0.0386 => 0.0387, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.34% (0.0297 => 0.0298, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0282 => 0.0282, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 34.58% (0.0240 => 0.0323, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: 1.12% (0.0178 => 0.0180, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 39.13% (0.0138 => 0.0192, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -1.20% (0.0251 => 0.0248, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 9.51% (0.0284 => 0.0311, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -16.67% (0.0006 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.27% (0.1462 => 0.1458, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 0.13% (0.2295 => 0.2298, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -0.95% (1.5443 => 1.5297, std.dev.: 0.0146) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1423 => 0.1422, std.dev.: 0.0046) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.79% (0.5882 => 0.5777, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 1.31% (26.3092 => 26.6527, std.dev.: 0.3073) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.67% (0.4001 => 0.4028, std.dev.: 0.0281) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.41% (0.1441 => 0.1363, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.75% (0.0532 => 0.0528, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 4.24% (0.0165 => 0.0172, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.39% (0.0575 => 0.0583, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.09% (1.1270 => 1.1260, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -25.00% (0.0016 => 0.0012, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.89% (0.0540 => 0.0561, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.16% (0.0139 => 0.0136, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.04% (0.7657 => 0.7654, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 0.82% (4.0147 => 4.0478, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.04% (40.5861 => 41.0068, std.dev.: 0.0631) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 0.87% (59.5046 => 60.0213, std.dev.: 0.1025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -0.43% (2.9249 => 2.9123, std.dev.: 0.0150) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -0.61% (2.3039 => 2.2898, std.dev.: 0.1353) SingleSource/Regression/C/2003-05-21-UnionBitfields: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.02% (1.7063 => 1.7067, std.dev.: 0.0005) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: 25.00% (0.0004 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -4.13% (0.0121 => 0.0116, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt MultiSource/Applications/JM/lencod/lencod: -96.59% (6.7458 => 0.2298, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -91.71% (6.9722 => 0.5777, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: 21446.24% (0.1237 => 26.6527, std.dev.: 0.3073) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -0.45% (4.0659 => 4.0478, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.30% (40.4792 => 41.0068, std.dev.: 0.0631) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.88% (61.1734 => 60.0213, std.dev.: 0.1025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -9.01% (3.2007 => 2.9123, std.dev.: 0.0150) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -2.89% (2.3580 => 2.2898, std.dev.: 0.1353) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -26.33% (4.1772 => 3.0775, std.dev.: 0.0501) SingleSource/Benchmarks/Shootout-C++/except: 82433.33% (0.0006 => 0.4952, std.dev.: 0.0040) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.36% (0.0745 => 0.0919, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.76% (0.1414 => 0.1552, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.49% (0.1159 => 0.1269, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.02% (0.6410 => 0.6988, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 7.91% (2.1763 => 2.3484, std.dev.: 0.0376) SingleSource/Benchmarks/Misc-C++/bigfib: 7.67% (0.5309 => 0.5716, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.06% (0.3582 => 0.3835, std.dev.: 0.0022) MultiSource/Applications/minisat/minisat: 6.90% (0.6173 => 0.6599, std.dev.: 0.0078) MultiSource/Applications/kimwitu++/kc: 6.18% (15.3105 => 16.2563, std.dev.: 0.2064) MultiSource/Applications/lemon/lemon: 6.07% (1.0046 => 1.0656, std.dev.: 0.0106) MultiSource/Applications/SIBsim4/SIBsim4: 5.93% (1.1653 => 1.2344, std.dev.: 0.0152) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.69% (0.2654 => 0.2805, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.53% (0.2552 => 0.2693, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.04% (1.5150 => 1.5913, std.dev.: 0.0064) MultiSource/Applications/lambda-0_1_3/lambda: 5.00% (0.6915 => 0.7261, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.79% (0.6069 => 0.6360, std.dev.: 0.0017) MultiSource/Applications/d/make_dparser: 4.34% (3.0225 => 3.1536, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.31% (0.7639 => 0.7968, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.25% (0.2797 => 0.2916, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.10% (0.3901 => 0.4061, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.00% (0.4248 => 0.4418, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.69% (0.3062 => 0.3175, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.48% (0.4880 => 0.5050, std.dev.: 0.0045) MultiSource/Applications/SPASS/SPASS: 3.47% (13.3238 => 13.7856, std.dev.: 0.0584) MultiSource/Benchmarks/McCat/18-imp/imp: 3.45% (0.3217 => 0.3328, std.dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: 3.28% (4.7455 => 4.9013, std.dev.: 0.0139) MultiSource/Benchmarks/Bullet/bullet: 3.19% (29.3170 => 30.2518, std.dev.: 0.2034) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.17% (1.1827 => 1.2202, std.dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 3.11% (1.0821 => 1.1157, std.dev.: 0.0018) MultiSource/Applications/siod/siod: 3.10% (2.0972 => 2.1622, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.06% (6.2546 => 6.4458, std.dev.: 0.0097) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.02% (0.4562 => 0.4700, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.01% (1.4408 => 1.4841, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.97% (3.0758 => 3.1673, std.dev.: 0.0226) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.93% (1.2021 => 1.2373, std.dev.: 0.0054) MultiSource/Applications/lua/lua: 2.92% (3.5980 => 3.7031, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/football/football: 2.75% (0.8405 => 0.8636, std.dev.: 0.0023) MultiSource/Applications/treecc/treecc: 2.69% (1.8798 => 1.9303, std.dev.: 0.0086) MultiSource/Applications/hbd/hbd: 2.61% (1.3268 => 1.3614, std.dev.: 0.0079) MultiSource/Benchmarks/mafft/pairlocalalign: 2.56% (8.2186 => 8.4292, std.dev.: 0.0658) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.55% (12.6413 => 12.9633, std.dev.: 0.0610) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.54% (0.8569 => 0.8787, std.dev.: 0.0047) MultiSource/Applications/JM/lencod/lencod: 2.20% (14.7256 => 15.0497, std.dev.: 0.0816) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.11% (2.0317 => 2.0745, std.dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.98% (0.7226 => 0.7369, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.84% (4.0318 => 4.1060, std.dev.: 0.0200) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.81% (4.3380 => 4.4167, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.78% (1.0689 => 1.0879, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.66% (4.2616 => 4.3322, std.dev.: 0.0250) MultiSource/Applications/JM/ldecod/ldecod: 1.63% (6.4908 => 6.5963, std.dev.: 0.0154) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 47.13% (0.0261 => 0.0384, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/Bubblesort: 42.97% (0.0263 => 0.0376, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/pi: 41.40% (1.6538 => 2.3384, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2276, std.dev.: 0.0437) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.28% (0.0766 => 0.0906, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 17.84% (1.4184 => 1.6715, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: 15.16% (1.7426 => 2.0067, std.dev.: 0.0253) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.84% (2.4042 => 2.6889, std.dev.: 0.1071) SingleSource/Benchmarks/McGill/queens: 11.06% (1.6261 => 1.8060, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/mason/mason: 9.85% (0.5004 => 0.5497, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.14% (0.2857 => 0.3118, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: 8.68% (7.0025 => 7.6102, std.dev.: 0.0730) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.65% (1.0063 => 1.0732, std.dev.: 0.0109) MultiSource/Benchmarks/PAQ8p/paq8p: 4.64% (92.7467 => 97.0525, std.dev.: 0.2944) SingleSource/Benchmarks/Misc/dt: 4.18% (0.9851 => 1.0263, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.31% (0.5587 => 0.5772, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.82% (6.6312 => 6.8183, std.dev.: 0.0025) MultiSource/Applications/siod/siod: 2.68% (3.5520 => 3.6472, std.dev.: 0.0141) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.47% (0.5876 => 0.6021, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 2.03% (62.4126 => 63.6783, std.dev.: 0.1703) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.70% (4.6127 => 4.6912, std.dev.: 0.0258) SingleSource/Benchmarks/Misc/fp-convert: 1.46% (15.2242 => 15.4464, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.12% (1.6110 => 1.6291, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.05% (2.4455 => 2.4712, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.84% (0.0591 => 0.0326, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -43.72% (0.2996 => 0.1686, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -22.11% (1.4113 => 1.0993, std.dev.: 0.0219) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.72% (1.4189 => 1.1391, std.dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -7.16% (8.9977 => 8.3532, std.dev.: 0.2256) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -42.18% (0.3497 => 0.2022, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -27.25% (15.8312 => 11.5170, std.dev.: 0.1111) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.26% (5.2665 => 4.1469, std.dev.: 0.0739) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -14.84% (1.7361 => 1.4785, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1572, std.dev.: 0.0285) MultiSource/Benchmarks/FreeBench/neural/neural: -11.50% (1.0926 => 0.9669, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.65% (1.1647 => 1.0523, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: -8.47% (9.5474 => 8.7389, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2863, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -7.58% (2.5166 => 2.3259, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.83% (3.6254 => 3.3777, std.dev.: 0.0053) MultiSource/Applications/lambda-0_1_3/lambda: -6.70% (7.6833 => 7.1687, std.dev.: 0.0333) SingleSource/Benchmarks/Shootout-C++/fibo: -6.63% (4.6355 => 4.3283, std.dev.: 0.0707) SingleSource/Benchmarks/Misc/richards_benchmark: -6.16% (1.4441 => 1.3551, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.96% (2.9728 => 2.7955, std.dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: -5.91% (3.4230 => 3.2206, std.dev.: 0.0169) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.46% (3.9413 => 3.7260, std.dev.: 0.0344) SingleSource/Benchmarks/BenchmarkGame/n-body: -5.37% (1.5803 => 1.4955, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/fib2: -5.29% (4.4195 => 4.1857, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/distray/distray: -4.88% (0.2664 => 0.2534, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.78% (0.4140 => 0.3942, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.36% (0.4564 => 0.4365, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -4.20% (3.4080 => 3.2649, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.54% (9.3855 => 9.0533, std.dev.: 0.0070) MultiSource/Applications/lua/lua: -3.30% (29.5232 => 28.5476, std.dev.: 0.1499) SingleSource/Benchmarks/McGill/misr: -3.14% (0.4296 => 0.4161, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: -3.13% (9.2503 => 8.9606, std.dev.: 0.0157) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.48% (1.1683 => 1.1393, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.25% (3.7496 => 3.6651, std.dev.: 0.0108) SingleSource/Benchmarks/Dhrystone/dry: -2.22% (2.4013 => 2.3481, std.dev.: 0.0007) MultiSource/Applications/aha/aha: -1.95% (3.4286 => 3.3618, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/hash2: -1.93% (3.4876 => 3.4202, std.dev.: 0.0079) MultiSource/Benchmarks/sim/sim: -1.93% (3.8907 => 3.8157, std.dev.: 0.0079) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.82% (2.3569 => 2.3139, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.39% (1.8739 => 1.8478, std.dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3094, std.dev.: 0.0069) SingleSource/Benchmarks/Dhrystone/fldry: -1.32% (2.4971 => 2.4642, std.dev.: 0.0063) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.31% (27.1724 => 26.8176, std.dev.: 0.0177) SingleSource/Benchmarks/Misc/ffbench: -1.06% (1.4117 => 1.3968, std.dev.: 0.0056) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.67% (0.9980 => 1.0147, std.dev.: 0.0094) MultiSource/Applications/sqlite3/sqlite3: 2.39% (0.6022 => 0.6166, std.dev.: 0.0079) MultiSource/Benchmarks/McCat/08-main/main: 3.96% (0.1666 => 0.1732, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.48% (0.1554 => 0.1531, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.52% (0.3083 => 0.3130, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.05% (0.2394 => 0.2345, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.80% (0.3175 => 0.3118, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.87% (0.2302 => 0.2322, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel: -13.81% (0.0449 => 0.0387, std.dev.: 0.0032) SingleSource/UnitTests/2003-05-07-VarArgs: -1.12% (0.0089 => 0.0088, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: -21.11% (0.0090 => 0.0071, std.dev.: 0.0009) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.42% (0.0240 => 0.0239, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.52% (0.0192 => 0.0193, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.77% (0.0390 => 0.0387, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.00% (0.0301 => 0.0298, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.70% (0.0284 => 0.0282, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.31% (0.0324 => 0.0323, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: 1.69% (0.0177 => 0.0180, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 1.59% (0.0189 => 0.0192, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -0.40% (0.0249 => 0.0248, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -4.31% (0.0325 => 0.0311, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.03% (0.1429 => 0.1458, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.85% (1.5019 => 1.5297, std.dev.: 0.0146) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -5.26% (0.1501 => 0.1422, std.dev.: 0.0046) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.53% (0.4264 => 0.4028, std.dev.: 0.0281) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.41% (0.1344 => 0.1363, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.36% (0.0589 => 0.0528, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -25.86% (0.0232 => 0.0172, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.76% (0.0639 => 0.0583, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.79% (1.1350 => 1.1260, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.93% (0.0637 => 0.0561, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -44.72% (0.0246 => 0.0136, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.50% (0.7541 => 0.7654, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.09% (1.5363 => 1.7067, std.dev.: 0.0005) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 65.71% (0.0070 => 0.0116, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 3 11:36:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 3 Oct 2012 13:36:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121003183627.D108E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4524?compare_to=4521&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4524, Order: 165129, Start Time: 2012-10-03 17:18:35, End Time: 2012-10-03 18:38:08 To: 4521, Order: 165119, Start Time: 2012-10-03 15:29:47, End Time: 2012-10-03 16:49:20 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (148 on baseline) Performance Improvements: 2 (46 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 949 (693 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: 2.91% (1.2152 => 1.2506, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.65% (79.2664 => 81.3687, std.dev.: 0.1379) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.89% (15.2032 => 14.9152, std.dev.: 0.0092) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lemon/lemon: -1.09% (1.4543 => 1.4385, std.dev.: 0.0011) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.5760 => 0.5760, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 0.13% (16.0065 => 16.0268, std.dev.: 0.0090) MultiSource/Benchmarks/Bullet/bullet: 0.01% (54.1744 => 54.1810, std.dev.: 0.0082) MultiSource/Benchmarks/MallocBench/gs/gs: 0.06% (4.3193 => 4.3220, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0462 => 0.0462, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.22% (0.0464 => 0.0463, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.23% (0.0432 => 0.0431) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0433 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.24% (0.0421 => 0.0420, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.24% (0.0423 => 0.0422, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0415 => 0.0415) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0416 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.23% (0.0433 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0434 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.23% (0.0427 => 0.0426, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.23% (0.0429 => 0.0428) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.24% (0.0417 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.24% (0.0419 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0424 => 0.0424, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.23% (0.0426 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.23% (0.0436 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.96% (0.0459 => 0.0450, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0412 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.24% (0.0414 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.24% (0.0424 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.23% (0.0426 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.24% (0.0416 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0407 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.24% (0.0409 => 0.0408, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0406 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.25% (0.0408 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0444 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0445 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0405 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0406 => 0.0406, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.25% (0.0407 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0407 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.48% (0.0415 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0415 => 0.0415) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (1.2322 => 1.2322, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.33% (7.5375 => 7.5123, std.dev.: 0.0219) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.21% (0.7278 => 0.7263, std.dev.: 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -1.37% (0.0364 => 0.0359, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1434 => 0.1435) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.77% (0.0651 => 0.0656, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -14.33% (63.2438 => 54.1810, std.dev.: 0.0082) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 30.52% (14.1553 => 18.4751, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++-EH/spirit: 57.54% (3.4629 => 5.4556, std.dev.: 0.0030) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14223.19% (0.0720 => 10.3127, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9951900.00% (0.0001 => 9.9520, std.dev.: 0.0013) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 47.34% (0.2554 => 0.3763, std.dev.: 0.0070) MultiSource/Benchmarks/PAQ8p/paq8p: 43.87% (10.3673 => 14.9152, std.dev.: 0.0092) MultiSource/Benchmarks/FreeBench/distray/distray: 30.30% (0.1056 => 0.1376, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 30.27% (0.1622 => 0.2113, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.74% (2.2022 => 2.5268, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 14.32% (0.1432 => 0.1637, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.82% (7.0540 => 8.0287, std.dev.: 0.0044) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.15% (0.1566 => 0.1772, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.35% (0.0834 => 0.0937, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.04% (1.7609 => 1.9730, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.06% (0.3543 => 0.3935, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 10.85% (10.4361 => 11.5684, std.dev.: 0.0140) SingleSource/UnitTests/ObjC/trivial-interface: 10.62% (0.3473 => 0.3842, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.42% (0.1584 => 0.1749, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/exceptions-3: 10.38% (0.3516 => 0.3881, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.38% (0.3497 => 0.3860, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.36% (0.3543 => 0.3910, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.33% (0.3561 => 0.3929, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.10% (0.3694 => 0.4067, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.96% (0.3927 => 0.4318, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.93% (0.3828 => 0.4208, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 9.87% (9.4845 => 10.4205, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/property: 9.78% (0.3886 => 0.4266, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/oourafft: 9.57% (0.3282 => 0.3596, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.67% (0.4879 => 0.5302, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.28% (0.3177 => 0.3440, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.28% (0.1438 => 0.1557, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 8.07% (0.5925 => 0.6403, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.99% (0.6030 => 0.6512, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 7.98% (0.1655 => 0.1787, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.86% (1.5415 => 1.6626, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.76% (0.2603 => 0.2805, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.75% (0.6675 => 0.7192, std.dev.: 0.0059) MultiSource/Applications/sgefa/sgefa: 7.69% (0.3109 => 0.3348, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 7.66% (5.7591 => 6.2002, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: 7.63% (0.7115 => 0.7658, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 7.33% (0.7433 => 0.7978, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.32% (0.4615 => 0.4953, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 7.26% (0.7326 => 0.7858, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 7.26% (0.1695 => 0.1818, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 7.15% (0.1440 => 0.1543, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 7.13% (0.3423 => 0.3667, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.06% (1.3050 => 1.3971, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.00% (0.5860 => 0.6270, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.97% (0.2065 => 0.2209, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.96% (0.2271 => 0.2429, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.91% (0.5105 => 0.5458, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: 6.88% (3.3354 => 3.5648, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.83% (0.1625 => 0.1736, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.79% (4.2646 => 4.5541, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.78% (0.2700 => 0.2883, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.73% (0.8172 => 0.8722, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists: 6.72% (0.3422 => 0.3652, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.69% (0.1510 => 0.1611, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.58% (0.8067 => 0.8598, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.57% (0.2891 => 0.3081, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.56% (8.1363 => 8.6701, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.54% (0.5569 => 0.5933, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.51% (0.4636 => 0.4938, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.46% (5.0018 => 5.3247, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.44% (0.9765 => 1.0394, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.41% (0.3121 => 0.3321, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 6.39% (0.2831 => 0.3012, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.38% (4.9449 => 5.2603, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.36% (0.2107 => 0.2241, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.35% (0.3136 => 0.3335, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 6.30% (0.2905 => 0.3088, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.27% (0.2758 => 0.2931, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.26% (0.4103 => 0.4360, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.25% (0.3232 => 0.3434) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.24% (0.2756 => 0.2928, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.23% (0.4203 => 0.4465, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.21% (0.3865 => 0.4105, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 6.20% (0.6456 => 0.6856, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.20% (0.5020 => 0.5331, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 6.19% (0.3052 => 0.3241, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.18% (0.4289 => 0.4554, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.16% (0.3650 => 0.3875, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 6.15% (0.7835 => 0.8317, std.dev.: 0.0048) MultiSource/Benchmarks/sim/sim: 6.11% (0.3387 => 0.3594, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.11% (0.3307 => 0.3509, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.09% (7.9617 => 8.4462, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/moments: 6.08% (0.4048 => 0.4294, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.04% (2.0665 => 2.1914, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 6.04% (0.3098 => 0.3285, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 6.02% (1.5603 => 1.6543, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.02% (0.2872 => 0.3045, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.02% (0.2725 => 0.2889, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.02% (0.2793 => 0.2961, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.00% (0.2802 => 0.2970, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 6.00% (1.1642 => 1.2340, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.99% (0.3826 => 0.4055, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.95% (0.3162 => 0.3350, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 5.91% (21.9371 => 23.2337, std.dev.: 0.0123) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.88% (0.1940 => 0.2054, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.85% (0.2871 => 0.3039, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.85% (0.3283 => 0.3475, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 5.82% (0.2714 => 0.2872, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.75% (0.3441 => 0.3639, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.74% (0.2877 => 0.3042, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.69% (0.3603 => 0.3808, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 5.68% (1.0722 => 1.1331, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 5.67% (3.8723 => 4.0919, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 5.59% (0.3684 => 0.3890, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 5.56% (0.4620 => 0.4877, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.54% (1.1861 => 1.2518, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 5.49% (0.4299 => 0.4535, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 5.47% (0.3379 => 0.3564, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 5.19% (0.3180 => 0.3345, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 5.18% (2.0273 => 2.1324, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/football/football: 5.01% (0.8921 => 0.9368, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.96% (0.6450 => 0.6770, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 4.85% (2.2969 => 2.4084, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.85% (0.5981 => 0.6271, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.62% (1.5859 => 1.6592, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.48% (0.4064 => 0.4246, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.33% (1.4186 => 1.4800, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.12% (2.2024 => 2.2931, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.06% (1.1840 => 1.2321, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.06% (1.2842 => 1.3363, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 3.96% (0.3131 => 0.3255, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.35% (0.8101 => 0.8372, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.88% (0.3817 => 0.3927, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.83% (1.1194 => 1.1511, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.70% (14.3668 => 14.7540, std.dev.: 0.0176) MultiSource/Applications/sqlite3/sqlite3: 2.21% (17.1811 => 17.5613, std.dev.: 0.0264) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.99% (3.8922 => 3.9696, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 30.44% (1.1277 => 1.4710, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.68% (0.2944 => 0.3288, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 10.17% (3.1595 => 3.4808, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.85% (0.1421 => 0.1561, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: 9.74% (1.1396 => 1.2506, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (3.1578 => 3.3679, std.dev.: 0.0010) SingleSource/Regression/C/uint64_to_float: 3.68% (0.5413 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.57% (3.6395 => 3.7695, std.dev.: 0.0026) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.70% (4.2280 => 4.3422, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7650, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.55% (0.8275 => 0.8403, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.05% (6.5088 => 6.5772, std.dev.: 0.0043) MultiSource/Benchmarks/nbench/nbench: 1.04% (11.6436 => 11.7644, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1286, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -80.15% (0.8651 => 0.1717, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.04% (5.2763 => 3.2694, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.73% (5.3855 => 3.6228, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.32% (5.3526 => 3.6224, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -14.77% (54.1659 => 46.1681, std.dev.: 0.0199) MultiSource/Benchmarks/FreeBench/mason/mason: -14.18% (0.0811 => 0.0696, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.85% (2.9384 => 2.6196, std.dev.: 0.0174) MultiSource/Applications/ClamAV/clamscan: -10.41% (22.1758 => 19.8668, std.dev.: 0.0243) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.40% (1.1492 => 0.7654, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.70% (1.6925 => 1.4268, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.83% (0.0998 => 0.0860, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: -12.66% (1.3677 => 1.1945) SingleSource/Benchmarks/McGill/chomp: -11.38% (1.2373 => 1.0965, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -10.36% (1.5373 => 1.3780, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/mason/mason: -10.13% (0.2161 => 0.1942, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.23% (19.9488 => 18.3062, std.dev.: 0.0366) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.69% (0.2497 => 0.2330, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.66% (1.8329 => 1.7108, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0023) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.31% (1.6805 => 1.5913, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.15% (13.4384 => 12.7464, std.dev.: 0.0257) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.79% (1.5660 => 1.4910, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.61% (1.5835 => 1.5105, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.32% (0.9957 => 0.9527, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.30% (0.3463 => 0.3314) MultiSource/Applications/siod/siod: -3.65% (3.2827 => 3.1629, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.44% (32.5116 => 31.3941, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: -2.99% (12.4730 => 12.1006, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.04% (8.1563 => 7.9900, std.dev.: 0.0076) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.92% (8.6802 => 8.5136, std.dev.: 0.0069) SingleSource/UnitTests/Vector/multiplies: -1.74% (2.5528 => 2.5085, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6818, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -1.70% (10.2830 => 10.1078, std.dev.: 0.0220) MultiSource/Applications/sqlite3/sqlite3: -1.66% (4.6441 => 4.5669, std.dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4204, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/lists: -1.13% (6.2999 => 6.2287, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8587, std.dev.: 0.0180) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.15% (0.5229 => 0.5760, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 6.92% (14.9895 => 16.0268, std.dev.: 0.0090) MultiSource/Benchmarks/MallocBench/gs/gs: 5.15% (4.1105 => 4.3220, std.dev.: 0.0090) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.53% (1.1048 => 1.2322, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.95% (7.1582 => 7.5123, std.dev.: 0.0219) SingleSource/Benchmarks/Misc-C++/stepanov_container: 16.73% (0.6222 => 0.7263, std.dev.: 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35800.00% (0.0001 => 0.0359, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.37% (0.1485 => 0.1435) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.00% (0.2116 => 0.0656, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 3 11:42:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 3 Oct 2012 13:42:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121003184229.3F24F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4525?compare_to=4516&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4525, Order: 165119, Start Time: 2012-10-03 15:35:18, End Time: 2012-10-03 18:44:10 To: 4516, Order: 165105, Start Time: 2012-10-03 11:31:19, End Time: 2012-10-03 14:40:33 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 1 (134 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (131 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1037 (756 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.07% (52.8014 => 53.3644, std.dev.: 0.1649) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.20% (135.0823 => 130.7614, std.dev.: 0.6521) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.01% (9.8093 => 9.8101, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.03% (9.4086 => 9.4111, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.03% (16.9333 => 16.9391, std.dev.: 0.0065) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.65% (0.3446 => 0.3882, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.50% (0.3488 => 0.3924, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.50% (0.3465 => 0.3898, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.43% (0.3460 => 0.3890, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.41% (0.3442 => 0.3869, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.36% (0.3496 => 0.3928, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.28% (0.3469 => 0.3895, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.23% (0.1063 => 0.1193, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 11.98% (1.5932 => 1.7841, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 11.97% (0.3650 => 0.4087, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.97% (0.3643 => 0.4079, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.79% (0.3724 => 0.4163, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.17% (0.5826 => 0.6360, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 9.14% (0.5889 => 0.6427, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 8.59% (0.1619 => 0.1758, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 8.44% (0.1421 => 0.1541, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.40% (0.2738 => 0.2968, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.39% (1.3152 => 1.4256, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.14% (0.2875 => 0.3109, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.99% (0.3004 => 0.3244, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.86% (0.3195 => 0.3446, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 7.82% (0.2725 => 0.2938, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.81% (0.2714 => 0.2926, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.81% (0.4994 => 0.5384, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 7.76% (0.2823 => 0.3042, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 7.75% (0.7171 => 0.7727, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 7.75% (5.5417 => 5.9711, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.66% (0.2792 => 0.3006, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.66% (0.2729 => 0.2938, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 7.64% (0.2813 => 0.3028, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.64% (0.2750 => 0.2960, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 7.63% (0.2803 => 0.3017, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.62% (3.5627 => 3.8340, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.57% (2.0673 => 2.2237, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.56% (1.6211 => 1.7437, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 7.52% (0.2780 => 0.2989, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.50% (0.4361 => 0.4688, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 7.46% (0.9909 => 1.0648, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.45% (0.3060 => 0.3288, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.45% (0.2014 => 0.2164, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.44% (0.2811 => 0.3020, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.39% (0.2911 => 0.3126, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.38% (0.5000 => 0.5369, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.38% (0.3362 => 0.3610, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 7.36% (0.3096 => 0.3324, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.36% (0.4146 => 0.4451, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.28% (0.1620 => 0.1738, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 7.27% (0.3258 => 0.3495, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 7.26% (1.0781 => 1.1564, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary3: 7.25% (0.3267 => 0.3504, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.22% (2.7292 => 2.9262, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.17% (0.3124 => 0.3348, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.16% (0.3282 => 0.3517, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 7.15% (0.3317 => 0.3554, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.09% (0.3625 => 0.3882, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 7.02% (0.3348 => 0.3583, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 7.01% (0.3678 => 0.3936, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 6.93% (0.3477 => 0.3718, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.79% (0.3726 => 0.3979, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.75% (0.3690 => 0.3939, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.73% (0.5026 => 0.5364, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.69% (0.3930 => 0.4193, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.67% (0.4139 => 0.4415, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 6.56% (23.5202 => 25.0635, std.dev.: 0.0151) MultiSource/Benchmarks/mafft/pairlocalalign: 6.56% (2.1013 => 2.2391, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash2: 6.52% (0.4251 => 0.4528, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 6.47% (0.2566 => 0.2732, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.45% (0.3845 => 0.4093, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.43% (0.3981 => 0.4237, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.36% (0.2736 => 0.2910, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 6.34% (4.2109 => 4.4778, std.dev.: 0.0039) MultiSource/Applications/siod/siod: 6.32% (0.6634 => 0.7053, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.13% (0.2040 => 0.2165, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.11% (0.6435 => 0.6828, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.11% (0.2866 => 0.3041, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 6.05% (0.5012 => 0.5315, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.04% (0.3890 => 0.4125, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.00% (0.5900 => 0.6254, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.00% (0.2068 => 0.2192, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 5.96% (0.4029 => 0.4269, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.92% (0.2737 => 0.2899, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 5.88% (1.8794 => 1.9900, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.88% (4.4195 => 4.6793, std.dev.: 0.0063) MultiSource/Applications/JM/lencod/lencod: 5.87% (4.6177 => 4.8888, std.dev.: 0.0046) MultiSource/Applications/lua/lua: 5.82% (1.4269 => 1.5099, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.71% (0.3084 => 0.3260, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 5.70% (2.1653 => 2.2887, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.64% (0.1968 => 0.2079, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.64% (0.3903 => 0.4123, std.dev.: 0.0048) MultiSource/Applications/minisat/minisat: 5.61% (0.3336 => 0.3523, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.44% (0.3271 => 0.3449, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.39% (0.4658 => 0.4909, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 5.27% (0.5546 => 0.5838, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.23% (0.2103 => 0.2213, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 5.16% (0.2075 => 0.2182, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.11% (1.9966 => 2.0986, std.dev.: 0.0023) MultiSource/Applications/treecc/treecc: 5.10% (0.7875 => 0.8277, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 5.10% (0.2391 => 0.2513, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.06% (1.9694 => 2.0691, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.05% (0.2969 => 0.3119, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 5.02% (2.0346 => 2.1367, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 4.96% (0.9697 => 1.0178, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: 4.85% (0.4847 => 0.5082, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 4.65% (0.2691 => 0.2816, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.48% (0.7426 => 0.7759, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.42% (0.5361 => 0.5598, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.07% (0.4253 => 0.4426, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (0.5584 => 0.5807, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.94% (11.6398 => 12.0980, std.dev.: 0.0044) MultiSource/Applications/lambda-0_1_3/lambda: 3.83% (0.3498 => 0.3632, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.56% (4.6926 => 4.8598, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.24% (0.3792 => 0.3915, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 2.58% (11.9555 => 12.2641, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.22% (0.5917 => 0.6699, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 5.85% (3.3903 => 3.5886, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.22% (12.0509 => 12.6797, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1669, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-2: 4.65% (1.8057 => 1.8897, std.dev.: 0.0052) SingleSource/Benchmarks/Dhrystone/dry: 4.20% (14.0481 => 14.6386, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.42% (79.9355 => 82.6670, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1923, std.dev.: 0.0062) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5068, std.dev.: 0.0067) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.71% (3.1722 => 3.2263, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2869, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5128, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.12% (6.9584 => 7.0366, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5810, std.dev.: 0.0330) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5626, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/ary2: -10.78% (0.2402 => 0.2143, std.dev.: 0.0041) MultiSource/Applications/sgefa/sgefa: -9.26% (1.5554 => 1.4114, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9759, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8035, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9583, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -5.82% (3.3665 => 3.1705, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8019, std.dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.43% (21.9346 => 21.1822, std.dev.: 0.0764) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0013) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7726, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.65% (17.2379 => 16.7807, std.dev.: 0.0516) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5704, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (105.3826 => 104.1588, std.dev.: 0.0551) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0428, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.03% (41.7953 => 41.3652, std.dev.: 0.0101) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 3 11:52:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 3 Oct 2012 13:52:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121003185215.74BB12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4526?compare_to=4522&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4526, Order: 165130, Start Time: 2012-10-03 17:28:41, End Time: 2012-10-03 18:53:55 To: 4522, Order: 165119, Start Time: 2012-10-03 15:34:36, End Time: 2012-10-03 16:59:42 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (5 on baseline) Performance Regressions: 4 (175 on baseline) Performance Improvements: 1 (43 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 5 (0 on baseline) Unchanged Tests: 1032 (684 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: 2.33% (1.2553 => 1.2846, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 1.88% (2.2554 => 2.2979, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/lowercase: 1.45% (7.9349 => 8.0497, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.25% (3.1728 => 3.2125, std.dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/sqlite3/sqlite3: -1.50% (4.5944 => 4.5255, std.dev.: 0.0030) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.27% (33.3169 => 33.2256, std.dev.: 0.0074) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (2.7521 => 2.7521, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.00% (2.1153 => 2.1152, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (4.9750 => 4.9750, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.21% (33.2944 => 33.2256, std.dev.: 0.0074) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: -100.00% (7.3305 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.46% (2.0176 => 2.4304, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.60% (0.1410 => 0.1644, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 14.65% (0.0826 => 0.0947, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 13.51% (0.2243 => 0.2546, std.dev.: 0.0008) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.94% (0.1072 => 0.1200, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 11.65% (0.1013 => 0.1131, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 11.36% (0.5818 => 0.6479, std.dev.: 0.0085) SingleSource/UnitTests/ObjC++/Hello: 11.33% (0.5748 => 0.6399, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.11% (0.1413 => 0.1570, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 11.10% (0.7061 => 0.7845, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 11.04% (0.4328 => 0.4806, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.90% (0.2596 => 0.2879, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 10.79% (0.2781 => 0.3081, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.42% (0.3485 => 0.3848, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.39% (0.2782 => 0.3071, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.37% (3.9660 => 4.3771, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.33% (0.2721 => 0.3002, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.31% (0.3899 => 0.4301, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 10.29% (0.4062 => 0.4480, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: 10.28% (1.3693 => 1.5100, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.26% (0.1588 => 0.1751, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.25% (0.1327 => 0.1463, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.08% (0.7710 => 0.8487, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.06% (0.3022 => 0.3326, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 10.05% (0.7038 => 0.7745, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 10.01% (0.2607 => 0.2868, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.00% (0.9199 => 1.0119, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 10.00% (0.2690 => 0.2959, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.88% (0.2966 => 0.3259, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.86% (0.3580 => 0.3933, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 9.86% (0.2760 => 0.3032, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 9.85% (0.2761 => 0.3033, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.85% (1.4563 => 1.5997, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.83% (0.2655 => 0.2916, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 9.82% (0.2628 => 0.2886, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.82% (1.2193 => 1.3390, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.81% (1.9828 => 2.1774, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 9.78% (0.3293 => 0.3615, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.77% (0.3489 => 0.3830, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.74% (0.5265 => 0.5778, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.74% (0.6959 => 0.7637, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wc: 9.70% (0.2937 => 0.3222, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.69% (0.2765 => 0.3033, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 9.68% (0.2726 => 0.2990, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.66% (0.4016 => 0.4404, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.64% (0.3756 => 0.4118, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 9.60% (0.1062 => 0.1164, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 9.54% (0.3868 => 0.4237, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.50% (0.6283 => 0.6880, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.50% (0.2696 => 0.2952, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.48% (0.4390 => 0.4806, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 9.40% (0.3107 => 0.3399, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 9.30% (0.3149 => 0.3442, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 9.27% (0.3192 => 0.3488, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.27% (1.1364 => 1.2417, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.26% (0.1986 => 0.2170, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 9.26% (13.8202 => 15.1003, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/matrix: 9.24% (0.2988 => 0.3264, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 9.15% (0.3453 => 0.3769, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 9.11% (0.3534 => 0.3856, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.06% (0.5577 => 0.6082, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.01% (0.1276 => 0.1391, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.90% (0.1157 => 0.1260, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.88% (0.3130 => 0.3408, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 8.61% (0.2995 => 0.3253, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.59% (0.4379 => 0.4755, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.50% (0.3246 => 0.3522, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 8.48% (1.0313 => 1.1188, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 8.43% (0.1589 => 0.1723, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.41% (0.2914 => 0.3159, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 8.39% (0.2945 => 0.3192, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.36% (0.6576 => 0.7126, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.36% (0.1435 => 0.1555, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.35% (0.4791 => 0.5191, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.27% (0.2127 => 0.2303, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 8.20% (16.6129 => 17.9745, std.dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.14% (0.5637 => 0.6096, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 8.14% (1.1061 => 1.1961, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.06% (0.7460 => 0.8061, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.89% (0.8698 => 0.9384, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.88% (0.3755 => 0.4051, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.87% (0.2504 => 0.2701, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 7.86% (0.7506 => 0.8096, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.83% (7.2180 => 7.7829, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/football/football: 7.82% (0.8310 => 0.8960, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 7.73% (0.3220 => 0.3469, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.71% (3.6692 => 3.9521, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 7.68% (0.6744 => 0.7262, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/09-vor/vor: 7.56% (0.2925 => 0.3146, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 7.52% (3.8646 => 4.1554, std.dev.: 0.0033) MultiSource/Applications/siod/siod: 7.50% (2.1791 => 2.3425, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.46% (0.2023 => 0.2174, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.45% (0.1865 => 0.2004, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 7.43% (1.0594 => 1.1381, std.dev.: 0.0017) MultiSource/Applications/d/make_dparser: 7.41% (3.1889 => 3.4251, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 7.29% (1.9270 => 2.0674, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/em3d/em3d: 7.18% (0.1657 => 0.1776, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 7.17% (0.1478 => 0.1584, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.99% (0.1789 => 0.1914, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.95% (1.3245 => 1.4166, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 6.93% (0.3578 => 0.3826, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 6.82% (0.4003 => 0.4276, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.81% (0.4113 => 0.4393, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/for-in: 6.78% (0.3789 => 0.4046, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.77% (0.3914 => 0.4179, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 6.76% (1.2749 => 1.3611, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 6.74% (0.3131 => 0.3342, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 6.68% (14.8535 => 15.8454, std.dev.: 0.0129) SingleSource/UnitTests/ObjC/synchronized: 6.63% (0.3663 => 0.3906, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.62% (0.3940 => 0.4201, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.61% (0.3646 => 0.3887, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 6.58% (8.4961 => 9.0554, std.dev.: 0.0107) SingleSource/UnitTests/ObjC/exceptions-2: 6.58% (0.3601 => 0.3838, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.58% (0.3650 => 0.3890, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 6.57% (1.2292 => 1.3100, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.56% (0.1569 => 0.1672, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.55% (0.8818 => 0.9396, std.dev.: 0.0101) MultiSource/Applications/oggenc/oggenc: 6.53% (4.6629 => 4.9672, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-3: 6.51% (0.3623 => 0.3859, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.46% (4.3801 => 4.6632, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.45% (0.2140 => 0.2278, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.42% (0.6135 => 0.6529, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.38% (0.1819 => 0.1935, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.34% (4.4433 => 4.7251, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/bigfib: 6.26% (0.6250 => 0.6641, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.18% (0.3511 => 0.3728, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.96% (1.1333 => 1.2008, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.77% (3.2742 => 3.4630, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.58% (0.4805 => 0.5073, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.50% (4.9865 => 5.2608, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.21% (0.3245 => 0.3414, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.19% (6.5754 => 6.9169, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.03% (0.9108 => 0.9566, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.98% (1.5188 => 1.5945, std.dev.: 0.0030) MultiSource/Applications/lua/lua: 4.89% (3.7467 => 3.9299, std.dev.: 0.0118) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.71% (6.2785 => 6.5742, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.41% (2.1007 => 2.1934, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.39% (13.2842 => 13.8678, std.dev.: 0.0196) MultiSource/Applications/sqlite3/sqlite3: 2.98% (16.2614 => 16.7461, std.dev.: 0.0116) MultiSource/Applications/ClamAV/clamscan: 2.38% (14.5298 => 14.8763, std.dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5184, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: 26.43% (1.8175 => 2.2979, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 11.12% (1.1560 => 1.2846, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.56% (3.1736 => 3.4136, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.34% (1.2998 => 1.3822, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.83% (0.2093 => 0.2194, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: 4.64% (1.9144 => 2.0032, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6762, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9853, std.dev.: 0.0013) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.61% (10.7476 => 11.0280, std.dev.: 0.0509) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.16% (7.4271 => 7.5876, std.dev.: 0.0031) MultiSource/Applications/lemon/lemon: 1.78% (1.4298 => 1.4552, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5123, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9695, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 1.29% (5.5130 => 5.5842, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1876, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/em3d/em3d: 1.15% (3.1071 => 3.1427, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.11% (8.8259 => 8.9237, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0274, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5911, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.83% (0.2670 => 0.1393, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.28% (0.4657 => 0.3899, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -16.12% (0.0707 => 0.0593, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.65% (1.3813 => 1.1789, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.48% (1.3819 => 1.1818, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.47% (22.5627 => 21.5550, std.dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.84% (0.0997 => 0.0859, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -12.29% (0.2238 => 0.1963, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -11.03% (1.2308 => 1.0950, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.16% (20.3410 => 18.2736, std.dev.: 0.0115) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.97% (1.3780 => 1.2957, std.dev.: 0.0156) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5138, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.86% (13.3668 => 12.7170, std.dev.: 0.0265) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.54% (0.9996 => 0.9542, std.dev.: 0.0082) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.16% (0.3458 => 0.3314, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.43% (1.7688 => 1.7082, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.14% (0.4867 => 0.4714, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -2.96% (3.2729 => 3.1761, std.dev.: 0.0176) MultiSource/Applications/lua/lua: -2.54% (26.5159 => 25.8434, std.dev.: 0.0214) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.40% (3.0263 => 2.9536, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -2.37% (1.9762 => 1.9293, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.09% (0.6589 => 0.6451, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.7016, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/lists: -1.81% (6.3560 => 6.2410, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: -1.47% (4.5928 => 4.5255, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0060, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8640, std.dev.: 0.0175) MultiSource/Applications/minisat/minisat: -1.20% (9.3358 => 9.2241, std.dev.: 0.0129) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4955, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2583, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.08% (6.6320 => 6.5602, std.dev.: 0.0085) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 3 13:06:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 3 Oct 2012 15:06:28 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121003200628.301B02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4527?compare_to=4523&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4527, Order: 165135, Start Time: 2012-10-03 18:38:55, End Time: 2012-10-03 20:08:10 To: 4523, Order: 165126, Start Time: 2012-10-03 16:54:03, End Time: 2012-10-03 18:21:21 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (9 on baseline) New Passes: 0 (10 on baseline) Performance Regressions: 11 (66 on baseline) Performance Improvements: 2 (46 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 78 (69 on baseline) Unchanged Tests: 951 (770 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.34% (1.0993 => 1.1360, std.dev.: 0.0091) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.58% (0.7669 => 0.7867, std.dev.: 0.0054) MultiSource/Benchmarks/PAQ8p/paq8p: 2.51% (2.3484 => 2.4074, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.13% (0.8671 => 0.8856, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.33% (0.8890 => 0.9008, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.07% (1.5913 => 1.6083, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/sgefa/sgefa: 23.70% (0.3473 => 0.4296, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ackermann: 13.08% (3.0403 => 3.4381, std.dev.: 0.0354) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.25% (0.3330 => 0.3538, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.95% (0.9042 => 0.9580, std.dev.: 0.0144) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.76% (21.2858 => 22.0859, std.dev.: 0.2228) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.23% (1.1391 => 1.1251, std.dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.06% (3.6651 => 3.6262, std.dev.: 0.0078) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.80% (1.0147 => 1.0066, std.dev.: 0.0084) MultiSource/Applications/sqlite3/sqlite3: -1.44% (0.6166 => 0.6077, std.dev.: 0.0111) MultiSource/Benchmarks/McCat/08-main/main: 4.10% (0.1732 => 0.1803, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.94% (0.1531 => 0.1576, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.40% (0.3130 => 0.3055, std.dev.: 0.0153) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.85% (0.2345 => 0.2325, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.22% (0.3118 => 0.3080, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.76% (0.2322 => 0.2258, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel: -2.07% (0.0387 => 0.0379, std.dev.: 0.0036) SingleSource/UnitTests/2003-05-07-VarArgs: -20.45% (0.0088 => 0.0070, std.dev.: 0.0009) SingleSource/UnitTests/2003-08-11-VaListArg: -35.21% (0.0071 => 0.0046, std.dev.: 0.0022) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -23.85% (0.0239 => 0.0182, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -42.49% (0.0193 => 0.0111, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -16.80% (0.0387 => 0.0322, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0298 => 0.0298, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.06% (0.0282 => 0.0279, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -4.02% (0.0323 => 0.0310, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: -50.00% (0.0180 => 0.0090, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/test1: -1.56% (0.0192 => 0.0189, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0248 => 0.0249, std.dev.: 0.0016) SingleSource/UnitTests/byval-alignment: -9.32% (0.0311 => 0.0282, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005) MultiSource/Applications/ClamAV/clamscan: 0.27% (0.1458 => 0.1462, std.dev.: 0.0038) MultiSource/Applications/JM/lencod/lencod: -1.57% (0.2298 => 0.2262, std.dev.: 0.0040) MultiSource/Applications/lemon/lemon: 0.27% (1.5297 => 1.5339, std.dev.: 0.0050) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.13% (0.1422 => 0.1438, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -0.12% (0.5777 => 0.5770, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 0.29% (26.6527 => 26.7288, std.dev.: 0.1003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 6.31% (0.4028 => 0.4282, std.dev.: 0.0351) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.35% (0.1363 => 0.1395, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.06% (0.0528 => 0.0560, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.33% (0.0172 => 0.0176, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.72% (0.0583 => 0.0663, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.24% (1.1260 => 1.1287, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0012 => 0.0012, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.32% (0.0561 => 0.0548, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 10.29% (0.0136 => 0.0150, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.01% (0.7654 => 0.7653, std.dev.: 0.0092) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -0.94% (4.0478 => 4.0099, std.dev.: 0.0152) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 0.14% (41.0068 => 41.0635, std.dev.: 0.2806) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -0.81% (60.0213 => 59.5326, std.dev.: 0.2041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 0.46% (2.9123 => 2.9257, std.dev.: 0.0393) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 2.00% (2.2898 => 2.3355, std.dev.: 0.1445) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: -0.24% (1.7067 => 1.7026, std.dev.: 0.0024) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 4.31% (0.0116 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt MultiSource/Applications/JM/lencod/lencod: -96.65% (6.7458 => 0.2262, std.dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: -91.72% (6.9722 => 0.5770, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/09-vor/vor: 21507.76% (0.1237 => 26.7288, std.dev.: 0.1003) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -1.38% (4.0659 => 4.0099, std.dev.: 0.0152) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.44% (40.4792 => 41.0635, std.dev.: 0.2806) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.68% (61.1734 => 59.5326, std.dev.: 0.2041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.59% (3.2007 => 2.9257, std.dev.: 0.0393) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -0.95% (2.3580 => 2.3355, std.dev.: 0.1445) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Benchmarks/Misc/mandel-2: -27.30% (4.1772 => 3.0368, std.dev.: 0.0528) SingleSource/Benchmarks/Shootout-C++/except: 82833.33% (0.0006 => 0.4976, std.dev.: 0.0009) SingleSource/Regression/C++/EH/ctor_dtor_count: -50.00% (0.0006 => 0.0003, std.dev.: 0.0001) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 24.70% (0.0745 => 0.0929, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 10.62% (2.1763 => 2.4074, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.09% (0.1159 => 0.1276, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.27% (0.6410 => 0.7004, std.dev.: 0.0073) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.99% (0.1414 => 0.1527, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 7.46% (0.5309 => 0.5705, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.20% (0.3582 => 0.3840, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 6.84% (0.6173 => 0.6595, std.dev.: 0.0055) MultiSource/Applications/lemon/lemon: 6.43% (1.0046 => 1.0692, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.16% (1.5150 => 1.6083, std.dev.: 0.0060) MultiSource/Applications/SIBsim4/SIBsim4: 5.83% (1.1653 => 1.2332, std.dev.: 0.0189) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.45% (0.2552 => 0.2691, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.08% (0.2797 => 0.2939, std.dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 4.93% (0.6915 => 0.7256, std.dev.: 0.0027) MultiSource/Applications/kimwitu++/kc: 4.87% (15.3105 => 16.0559, std.dev.: 0.1747) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.56% (0.6069 => 0.6346, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.51% (0.2662 => 0.2782, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.23% (0.7639 => 0.7962, std.dev.: 0.0060) MultiSource/Applications/d/make_dparser: 3.97% (3.0225 => 3.1426, std.dev.: 0.0248) MultiSource/Benchmarks/Bullet/bullet: 3.66% (29.3170 => 30.3901, std.dev.: 0.1352) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.66% (1.2021 => 1.2461, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.59% (0.3901 => 0.4041, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: 3.57% (1.1440 => 1.1848, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.50% (0.4880 => 0.5051, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/18-imp/imp: 3.45% (0.3217 => 0.3328, std.dev.: 0.0019) MultiSource/Applications/hbd/hbd: 3.42% (1.3268 => 1.3722, std.dev.: 0.0090) MultiSource/Benchmarks/mafft/pairlocalalign: 3.38% (8.2186 => 8.4963, std.dev.: 0.0319) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.28% (1.1672 => 1.2055, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.23% (0.4248 => 0.4385, std.dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.08% (6.2546 => 6.4471, std.dev.: 0.0270) MultiSource/Applications/lua/lua: 2.83% (3.5980 => 3.6999, std.dev.: 0.0107) MultiSource/Benchmarks/nbench/nbench: 2.69% (1.0821 => 1.1112, std.dev.: 0.0037) MultiSource/Applications/treecc/treecc: 2.64% (1.8798 => 1.9295, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.61% (12.6413 => 12.9717, std.dev.: 0.0808) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.49% (4.0318 => 4.1323, std.dev.: 0.0089) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.36% (1.0689 => 1.0941, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.19% (0.8569 => 0.8757, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.90% (0.7226 => 0.7363, std.dev.: 0.0052) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.88% (0.7722 => 0.7867, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.45% (4.2815 => 4.3435, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.37% (4.3380 => 4.3973, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 41.83% (0.0263 => 0.0373, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/pi: 41.38% (1.6538 => 2.3382, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2286, std.dev.: 0.0126) MultiSource/Benchmarks/Olden/power/power: 17.81% (1.4184 => 1.6710, std.dev.: 0.0071) MultiSource/Applications/sgefa/sgefa: 14.68% (0.3746 => 0.4296, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/ary3: 14.59% (1.7426 => 1.9969, std.dev.: 0.0327) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.71% (0.0766 => 0.0871, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.73% (0.8498 => 0.9580, std.dev.: 0.0144) SingleSource/Benchmarks/McGill/queens: 11.09% (1.6261 => 1.8064, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/mason/mason: 9.81% (0.5004 => 0.5495, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: 8.77% (7.0025 => 7.6163, std.dev.: 0.0227) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.54% (0.2857 => 0.3101, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bisort/bisort: 7.83% (0.6459 => 0.6965, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.47% (1.0063 => 1.0815, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.18% (0.3301 => 0.3538, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 5.19% (92.7467 => 97.5628, std.dev.: 0.2233) SingleSource/Benchmarks/Shootout-C++/hash: 4.71% (0.6308 => 0.6605, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/dt: 4.34% (0.9851 => 1.0279, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.24% (0.5587 => 0.5768, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.82% (6.6312 => 6.8181, std.dev.: 0.0124) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.65% (0.5876 => 0.6032, std.dev.: 0.0017) MultiSource/Applications/siod/siod: 2.31% (3.5520 => 3.6342, std.dev.: 0.0318) MultiSource/Benchmarks/mafft/pairlocalalign: 1.79% (62.4126 => 63.5287, std.dev.: 0.1329) SingleSource/Benchmarks/Misc/fp-convert: 1.46% (15.2242 => 15.4472, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.02% (2.4455 => 2.4705, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -44.39% (0.2996 => 0.1666, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -43.82% (0.0591 => 0.0332, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.71% (1.4189 => 1.1251, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.51% (1.4113 => 1.1360, std.dev.: 0.0091) MultiSource/Benchmarks/Olden/em3d/em3d: -7.43% (0.1642 => 0.1520, std.dev.: 0.0046) SingleSource/UnitTests/Vector/constpool: -5.38% (8.9977 => 8.5140, std.dev.: 0.1826) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.95% (0.3497 => 0.2030, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -27.38% (15.8312 => 11.4974, std.dev.: 0.1238) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.43% (5.2665 => 4.1381, std.dev.: 0.1315) SingleSource/Benchmarks/Shootout-C++/ary3: -20.43% (1.7473 => 1.3904, std.dev.: 0.0479) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.11% (1.7361 => 1.4737, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/17-bintr/bintr: -13.20% (0.0917 => 0.0796, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1583, std.dev.: 0.0163) MultiSource/Benchmarks/FreeBench/neural/neural: -11.43% (1.0926 => 0.9677, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.67% (1.1647 => 1.0521, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: -8.45% (9.5474 => 8.7408, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.32% (1.4034 => 1.2867, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: -7.34% (2.5166 => 2.3319, std.dev.: 0.0270) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.76% (3.6254 => 3.3804, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/fibo: -6.63% (4.6355 => 4.3280, std.dev.: 0.0073) MultiSource/Applications/lambda-0_1_3/lambda: -6.47% (7.6833 => 7.1863, std.dev.: 0.0422) SingleSource/Benchmarks/Misc/richards_benchmark: -6.24% (1.4441 => 1.3540, std.dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.97% (2.9728 => 2.7952, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: -5.45% (3.4230 => 3.2366, std.dev.: 0.0443) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.39% (3.9413 => 3.7290, std.dev.: 0.0324) SingleSource/Benchmarks/Shootout/fib2: -5.31% (4.4195 => 4.1850, std.dev.: 0.0169) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.14% (0.4140 => 0.3927, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.95% (0.4564 => 0.4338, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/n-body: -4.75% (1.5803 => 1.5053, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.56% (3.6023 => 3.4381, std.dev.: 0.0354) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -4.28% (3.4080 => 3.2622, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/methcall: -3.86% (9.2503 => 8.8928, std.dev.: 0.0316) MultiSource/Applications/lua/lua: -3.64% (29.5232 => 28.4500, std.dev.: 0.3520) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.48% (9.3855 => 9.0591, std.dev.: 0.0302) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.37% (1.2722 => 1.2293, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.29% (3.7496 => 3.6262, std.dev.: 0.0078) SingleSource/Benchmarks/Dhrystone/dry: -2.23% (2.4013 => 2.3477, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.88% (2.3569 => 2.3127, std.dev.: 0.0113) MultiSource/Applications/aha/aha: -1.83% (3.4286 => 3.3658, std.dev.: 0.0215) SingleSource/Benchmarks/Shootout-C++/hash2: -1.71% (3.4876 => 3.4280, std.dev.: 0.0027) MultiSource/Benchmarks/sim/sim: -1.69% (3.8907 => 3.8249, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3081, std.dev.: 0.0165) SingleSource/Benchmarks/Dhrystone/fldry: -1.36% (2.4971 => 2.4632, std.dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.31% (27.1724 => 26.8164, std.dev.: 0.0804) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.17% (1.8739 => 1.8520, std.dev.: 0.0035) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.86% (0.9980 => 1.0066, std.dev.: 0.0084) MultiSource/Applications/sqlite3/sqlite3: 0.91% (0.6022 => 0.6077, std.dev.: 0.0111) MultiSource/Benchmarks/McCat/08-main/main: 8.22% (0.1666 => 0.1803, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.42% (0.1554 => 0.1576, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.91% (0.3083 => 0.3055, std.dev.: 0.0153) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.88% (0.2394 => 0.2325, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.99% (0.3175 => 0.3080, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.91% (0.2302 => 0.2258, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel: -15.59% (0.0449 => 0.0379, std.dev.: 0.0036) SingleSource/UnitTests/2003-05-07-VarArgs: -21.35% (0.0089 => 0.0070, std.dev.: 0.0009) SingleSource/UnitTests/2003-08-11-VaListArg: -48.89% (0.0090 => 0.0046, std.dev.: 0.0022) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -24.17% (0.0240 => 0.0182, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -42.19% (0.0192 => 0.0111, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -17.44% (0.0390 => 0.0322, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.00% (0.0301 => 0.0298, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.76% (0.0284 => 0.0279, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -4.32% (0.0324 => 0.0310, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: -49.15% (0.0177 => 0.0090, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0189 => 0.0189, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0249 => 0.0249, std.dev.: 0.0016) SingleSource/UnitTests/byval-alignment: -13.23% (0.0325 => 0.0282, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005) MultiSource/Applications/ClamAV/clamscan: 2.31% (0.1429 => 0.1462, std.dev.: 0.0038) MultiSource/Applications/lemon/lemon: 2.13% (1.5019 => 1.5339, std.dev.: 0.0050) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -4.20% (0.1501 => 0.1438, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.42% (0.4264 => 0.4282, std.dev.: 0.0351) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.79% (0.1344 => 0.1395, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.92% (0.0589 => 0.0560, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -24.14% (0.0232 => 0.0176, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.76% (0.0639 => 0.0663, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.56% (1.1350 => 1.1287, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.97% (0.0637 => 0.0548, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.02% (0.0246 => 0.0150, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.49% (0.7541 => 0.7653, std.dev.: 0.0092) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 10.82% (1.5363 => 1.7026, std.dev.: 0.0024) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 3 13:25:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 3 Oct 2012 15:25:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121003202521.81DC12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4528?compare_to=4524&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4528, Order: 165136, Start Time: 2012-10-03 19:07:16, End Time: 2012-10-03 20:26:59 To: 4524, Order: 165129, Start Time: 2012-10-03 17:18:35, End Time: 2012-10-03 18:38:08 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (144 on baseline) Performance Improvements: 1 (46 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 950 (697 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 5.07% (0.4478 => 0.4705, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.93% (54.5473 => 56.1463, std.dev.: 0.2084) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.35% (1.3080 => 1.2903, std.dev.: 0.0068) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.02% (0.5760 => 0.5759, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 0.04% (16.0268 => 16.0329, std.dev.: 0.0132) MultiSource/Benchmarks/Bullet/bullet: -0.24% (54.1810 => 54.0522, std.dev.: 0.0105) MultiSource/Benchmarks/MallocBench/gs/gs: 0.34% (4.3220 => 4.3367, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.43% (0.0462 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.65% (0.0463 => 0.0460, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.46% (0.0431 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.23% (0.0433 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.48% (0.0420 => 0.0418, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.47% (0.0422 => 0.0420, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.72% (0.0415 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.24% (0.0416 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.46% (0.0432 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.69% (0.0434 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.23% (0.0426 => 0.0425, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.47% (0.0428 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.48% (0.0416 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.24% (0.0418 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.47% (0.0424 => 0.0422, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.47% (0.0425 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.46% (0.0435 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.33% (0.0450 => 0.0435, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.73% (0.0412 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.48% (0.0413 => 0.0411, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.47% (0.0423 => 0.0421, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.24% (0.0425 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.24% (0.0415 => 0.0414) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.48% (0.0417 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.49% (0.0407 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.25% (0.0408 => 0.0407, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.49% (0.0406 => 0.0404) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.25% (0.0407 => 0.0406, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.45% (0.0444 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.45% (0.0445 => 0.0443, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.25% (0.0405 => 0.0404) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.49% (0.0406 => 0.0404, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.49% (0.0406 => 0.0404, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.49% (0.0407 => 0.0405, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.24% (0.0413 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.24% (0.0415 => 0.0414, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.04% (1.2322 => 1.2317, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.17% (7.5123 => 7.5248, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.7263 => 0.7263, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.56% (0.0359 => 0.0361, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: - (0.1435 => 0.1435) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.07% (0.0656 => 0.0649, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -14.53% (63.2438 => 54.0522, std.dev.: 0.0105) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 30.59% (14.1553 => 18.4847, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++-EH/spirit: 58.19% (3.4629 => 5.4779, std.dev.: 0.0281) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14227.78% (0.0720 => 10.3160, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9951700.00% (0.0001 => 9.9518, std.dev.: 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 46.59% (0.2554 => 0.3744, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 42.78% (10.3673 => 14.8021, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/richards_benchmark: 30.27% (0.1622 => 0.2113, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: 29.73% (0.1056 => 0.1370, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.18% (2.2022 => 2.5366, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops: 13.90% (0.1432 => 0.1631) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.85% (7.0540 => 8.0308, std.dev.: 0.0137) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.22% (0.1566 => 0.1773, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.11% (0.0834 => 0.0935, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.72% (1.7609 => 1.9673, std.dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: 11.46% (10.4361 => 11.6316, std.dev.: 0.0172) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.53% (0.3543 => 0.3916, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.29% (0.1584 => 0.1747, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/oourafft: 10.21% (0.3282 => 0.3617, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 10.18% (9.4845 => 10.4503, std.dev.: 0.0072) SingleSource/UnitTests/ObjC/trivial-interface: 10.14% (0.3473 => 0.3825, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.92% (0.3497 => 0.3844, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 9.81% (0.3516 => 0.3861, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 9.80% (0.3561 => 0.3910, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.79% (0.3543 => 0.3890, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.56% (0.3694 => 0.4047, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.47% (0.3927 => 0.4299, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.46% (0.3828 => 0.4190, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.29% (0.3886 => 0.4247, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.67% (0.4879 => 0.5302, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: 8.46% (0.1655 => 0.1795, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.15% (0.3177 => 0.3436, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.93% (0.1438 => 0.1552, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 7.91% (0.3109 => 0.3355, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.88% (1.5415 => 1.6630, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.87% (0.6675 => 0.7200, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.76% (0.2603 => 0.2805, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 7.74% (0.7115 => 0.7666, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 7.74% (0.7433 => 0.8008, std.dev.: 0.0132) MultiSource/Applications/oggenc/oggenc: 7.64% (5.7591 => 6.1993, std.dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.39% (0.4615 => 0.4956, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 7.26% (0.6030 => 0.6468, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/Hello: 7.22% (0.5925 => 0.6353, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 7.22% (3.3354 => 3.5763, std.dev.: 0.0161) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.20% (0.1625 => 0.1742, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.19% (0.5105 => 0.5472, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.10% (1.3050 => 1.3977, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.05% (0.2271 => 0.2431, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.04% (0.2700 => 0.2890, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 7.02% (0.1695 => 0.1814, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 6.98% (0.3423 => 0.3662, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.90% (0.8067 => 0.8624, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.83% (0.5860 => 0.6260, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.76% (4.2646 => 4.5529, std.dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.75% (0.1510 => 0.1612, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.69% (5.0018 => 5.3366, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.66% (8.1363 => 8.6780, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.66% (0.8172 => 0.8716, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.63% (0.2065 => 0.2202, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference: 6.62% (0.7326 => 0.7811, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.62% (0.9765 => 1.0411, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.58% (4.9449 => 5.2701, std.dev.: 0.0170) MultiSource/Benchmarks/sim/sim: 6.52% (0.3387 => 0.3608, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 6.52% (0.3422 => 0.3645, std.dev.: 0.0055) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.50% (7.9617 => 8.4793, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.46% (0.5569 => 0.5929, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.41% (0.2107 => 0.2242, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.38% (0.3121 => 0.3320, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.36% (0.4636 => 0.4931, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 6.34% (0.7835 => 0.8332, std.dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.31% (0.5020 => 0.5337, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.31% (0.2758 => 0.2932, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.26% (0.4103 => 0.4360, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.24% (0.1940 => 0.2061, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 6.20% (0.2905 => 0.3085, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.17% (0.3307 => 0.3511, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 6.12% (0.6456 => 0.6851, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 6.11% (1.1642 => 1.2353, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.09% (0.2891 => 0.3067, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 6.08% (1.5603 => 1.6552, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/strcat: 6.00% (0.2831 => 0.3001, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.00% (0.4203 => 0.4455, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.99% (0.4289 => 0.4546, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.94% (0.3232 => 0.3424, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.89% (0.3650 => 0.3865, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.87% (0.3441 => 0.3643, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 5.87% (1.0722 => 1.1351, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.85% (0.3865 => 0.4091, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 5.84% (3.8723 => 4.0985, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.80% (0.3136 => 0.3318, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 5.78% (0.4048 => 0.4282, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.72% (2.0665 => 2.1848, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: 5.71% (0.3098 => 0.3275, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.69% (0.3162 => 0.3342, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.67% (0.3826 => 0.4043, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.64% (0.2872 => 0.3034, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.64% (0.3052 => 0.3224, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.62% (1.1861 => 1.2528, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.59% (0.2756 => 0.2910, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 5.58% (0.4299 => 0.4539, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/fibo: 5.58% (0.2725 => 0.2877, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 5.56% (21.9371 => 23.1575, std.dev.: 0.0280) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.55% (0.6450 => 0.6808, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/ary3: 5.54% (0.3283 => 0.3465, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 5.54% (0.2871 => 0.3030, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.52% (0.5981 => 0.6311, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.50% (0.4620 => 0.4874, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 5.49% (0.2877 => 0.3035, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/sieve: 5.44% (0.3603 => 0.3799, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.42% (0.2802 => 0.2954, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 5.41% (0.3180 => 0.3352, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 5.41% (2.0273 => 2.1369, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.37% (0.2793 => 0.2943, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 5.34% (0.2714 => 0.2859, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 5.27% (0.3684 => 0.3878, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 5.16% (0.8921 => 0.9381, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 5.11% (2.2969 => 2.4142, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.77% (1.5859 => 1.6615, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.44% (1.4186 => 1.4816, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.43% (0.4064 => 0.4244, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.25% (2.2024 => 2.2960, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.16% (1.1840 => 1.2332, std.dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.70% (1.2842 => 1.3317, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 3.67% (0.3131 => 0.3246, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.25% (0.8101 => 0.8364, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.87% (14.3668 => 14.7791, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.55% (1.1194 => 1.1480, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.42% (17.1811 => 17.5967, std.dev.: 0.0223) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.03% (3.8922 => 3.9712, std.dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 30.45% (1.1277 => 1.4711, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9648, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 10.15% (3.1595 => 3.4803, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.95% (1.1396 => 1.2530, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 9.85% (0.1421 => 0.1561, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.70% (3.1578 => 3.3695, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 3.68% (0.5413 => 0.5612, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.33% (3.6395 => 3.7608, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.56% (4.2280 => 4.3362, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7651, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.49% (0.9540 => 0.9682, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.03% (11.6436 => 11.7630, std.dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1281, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.25% (5.2763 => 3.2583, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.10% (5.3855 => 3.6031, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.77% (5.3526 => 3.5985, std.dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -14.77% (54.1659 => 46.1674, std.dev.: 0.0143) MultiSource/Benchmarks/FreeBench/mason/mason: -14.06% (0.0811 => 0.0697, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.06% (2.9384 => 2.6135, std.dev.: 0.0040) MultiSource/Applications/ClamAV/clamscan: -10.43% (22.1758 => 19.8634, std.dev.: 0.0091) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7636, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: -15.99% (1.6925 => 1.4218, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.73% (0.0998 => 0.0861, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: -12.67% (1.3677 => 1.1944, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.33% (1.2373 => 1.0971, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/mandel-2: -10.43% (1.5373 => 1.3770, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/mason/mason: -9.72% (0.2161 => 0.1951, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.41% (19.9488 => 18.2710, std.dev.: 0.0251) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.69% (1.8329 => 1.7102, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.65% (0.2497 => 0.2331) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.28% (1.6805 => 1.5918, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.93% (13.4384 => 12.7764, std.dev.: 0.0550) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909) SingleSource/Benchmarks/Misc/flops-5: -4.56% (1.5835 => 1.5113, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.30% (0.3463 => 0.3314, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.70% (3.2827 => 3.1614, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.62% (0.9957 => 0.9597, std.dev.: 0.0060) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.41% (32.5116 => 31.4028, std.dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: -2.99% (12.4730 => 12.0996, std.dev.: 0.0012) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.96% (8.1563 => 7.9961, std.dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.82% (8.6802 => 8.5226, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: -1.73% (10.2830 => 10.1048, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6831, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -1.68% (4.6441 => 4.5662, std.dev.: 0.0019) SingleSource/UnitTests/Vector/multiplies: -1.54% (2.5528 => 2.5136, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4200, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/lists: -1.15% (6.2999 => 6.2275, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8587, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.14% (0.5229 => 0.5759, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 6.96% (14.9895 => 16.0329, std.dev.: 0.0132) MultiSource/Benchmarks/MallocBench/gs/gs: 5.50% (4.1105 => 4.3367, std.dev.: 0.0187) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.49% (1.1048 => 1.2317, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.12% (7.1582 => 7.5248, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 16.73% (0.6222 => 0.7263, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36000.00% (0.0001 => 0.0361, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -3.37% (0.1485 => 0.1435) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 3 13:46:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 3 Oct 2012 15:46:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121003204631.0465B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4529?compare_to=4526&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4529, Order: 165139, Start Time: 2012-10-03 19:23:08, End Time: 2012-10-03 20:48:10 To: 4526, Order: 165130, Start Time: 2012-10-03 17:28:41, End Time: 2012-10-03 18:53:55 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (5 on baseline) Performance Regressions: 0 (174 on baseline) Performance Improvements: 1 (41 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 5 (0 on baseline) Unchanged Tests: 1036 (687 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -1.68% (2.2979 => 2.2592, std.dev.: 0.0137) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.13% (33.2256 => 33.1828, std.dev.: 0.0179) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.00% (2.7521 => 2.7522, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.01% (2.1152 => 2.1154, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.00% (4.9750 => 4.9748, std.dev.: 0.0089) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.34% (33.2944 => 33.1828, std.dev.: 0.0179) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: -100.00% (7.3305 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.58% (2.0176 => 2.4328, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.17% (0.1410 => 0.1638, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 14.77% (0.0826 => 0.0948) MultiSource/Benchmarks/McCat/08-main/main: 13.37% (0.2243 => 0.2543, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.19% (0.0819 => 0.0927, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.04% (0.1413 => 0.1569, std.dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference-object: 10.90% (0.5818 => 0.6452, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 10.86% (0.1013 => 0.1123, std.dev.: 0.0009) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.82% (0.1072 => 0.1188, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 10.79% (0.4328 => 0.4795, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.70% (0.5748 => 0.6363, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.44% (0.2721 => 0.3005, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 10.34% (0.7061 => 0.7791, std.dev.: 0.0018) MultiSource/Applications/hbd/hbd: 10.25% (1.3693 => 1.5096, std.dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 10.14% (0.2781 => 0.3063, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.14% (3.9660 => 4.3680, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 10.00% (0.7038 => 0.7742, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/hash: 10.00% (0.4062 => 0.4468, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.90% (0.6959 => 0.7648, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.90% (0.7710 => 0.8473, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.89% (0.1588 => 0.1745, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.88% (0.9199 => 1.0108, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.87% (0.3899 => 0.4284, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.87% (0.1327 => 0.1458, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.86% (0.2596 => 0.2852, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.81% (0.2782 => 0.3055, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.79% (1.4563 => 1.5988, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.69% (1.2193 => 1.3375, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.60% (0.6283 => 0.6886, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.58% (0.3485 => 0.3819, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.43% (0.3022 => 0.3307, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.40% (0.3489 => 0.3817, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 9.38% (0.2761 => 0.3020, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.36% (0.5265 => 0.5758, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 9.36% (0.2607 => 0.2851, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.34% (0.2966 => 0.3243, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.33% (0.3580 => 0.3914, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.33% (1.9828 => 2.1677, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 9.29% (0.2690 => 0.2940, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 9.28% (0.2760 => 0.3016, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.27% (0.2655 => 0.2901, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.26% (0.4016 => 0.4388, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/strcat: 9.24% (0.2726 => 0.2978, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.21% (0.3756 => 0.4102, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 9.19% (13.8202 => 15.0901, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/fibo: 9.17% (0.2628 => 0.2869, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.17% (1.1364 => 1.2406, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.15% (0.2765 => 0.3018, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 9.09% (0.2937 => 0.3204, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 9.08% (0.3293 => 0.3592, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.07% (0.4390 => 0.4788, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 8.97% (0.3868 => 0.4215, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.90% (0.2696 => 0.2936, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 8.88% (0.3107 => 0.3383, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 8.83% (0.3149 => 0.3427, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.79% (0.3130 => 0.3405, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.71% (0.1986 => 0.2159, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 8.69% (0.3453 => 0.3753, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 8.67% (0.2988 => 0.3247, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.64% (0.1157 => 0.1257, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 8.49% (1.0313 => 1.1189, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 8.46% (0.3192 => 0.3462, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.45% (0.5577 => 0.6048, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 8.43% (0.3534 => 0.3832, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.41% (0.4791 => 0.5194, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.39% (0.1276 => 0.1383, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 8.38% (0.2995 => 0.3246, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.32% (0.2127 => 0.2304, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.31% (0.4379 => 0.4743, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 8.31% (0.1589 => 0.1721, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 8.25% (0.2945 => 0.3188, std.dev.: 0.0078) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.13% (0.2914 => 0.3151, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.10% (0.3246 => 0.3509, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.00% (0.5637 => 0.6088, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.94% (0.1435 => 0.1549, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 7.90% (1.1061 => 1.1935, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.87% (0.7460 => 0.8047, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 7.85% (16.6129 => 17.9167, std.dev.: 0.0157) MultiSource/Applications/minisat/minisat: 7.83% (0.6744 => 0.7272, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.83% (0.2504 => 0.2700, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 7.74% (0.8310 => 0.8953, std.dev.: 0.0101) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.74% (0.8698 => 0.9371, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.68% (7.2180 => 7.7721, std.dev.: 0.0069) MultiSource/Benchmarks/McCat/18-imp/imp: 7.64% (0.3220 => 0.3466, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.61% (3.6692 => 3.9486, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 7.61% (0.7506 => 0.8077, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.59% (0.3755 => 0.4040, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 7.49% (3.1889 => 3.4276, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 7.43% (3.8646 => 4.1519, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/09-vor/vor: 7.42% (0.2925 => 0.3142, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 7.37% (0.1478 => 0.1587, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 7.32% (1.0594 => 1.1370, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.32% (0.2023 => 0.2171, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.29% (0.1865 => 0.2001, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 7.16% (1.9270 => 2.0650, std.dev.: 0.0166) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.13% (0.6576 => 0.7045, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 7.01% (2.1791 => 2.3319, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/trivial-interface: 6.90% (0.3578 => 0.3825, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.87% (0.1819 => 0.1944, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.86% (0.3646 => 0.3896, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.85% (0.3914 => 0.4182, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 6.83% (1.2749 => 1.3620, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.82% (0.1569 => 0.1676, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 6.82% (0.1657 => 0.1770, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.82% (0.1789 => 0.1911, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.81% (0.3789 => 0.4047, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 6.80% (0.3601 => 0.3846, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.80% (1.3245 => 1.4146, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 6.80% (0.3663 => 0.3912, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 6.77% (0.3131 => 0.3343, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 6.74% (0.4003 => 0.4273, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.68% (0.3650 => 0.3894, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.68% (0.3940 => 0.4203, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 6.65% (14.8535 => 15.8406, std.dev.: 0.0122) MultiSource/Applications/oggenc/oggenc: 6.64% (4.6629 => 4.9724, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-3: 6.62% (0.3623 => 0.3863, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 6.52% (8.4961 => 9.0501, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.40% (4.3801 => 4.6604, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.31% (0.6135 => 0.6522, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.30% (4.4433 => 4.7232, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.26% (0.2140 => 0.2274, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: 6.15% (0.4113 => 0.4366, std.dev.: 0.0079) MultiSource/Applications/hexxagon/hexxagon: 6.09% (1.2292 => 1.3040, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.00% (0.8818 => 0.9347, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.95% (0.3511 => 0.3720, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.83% (1.1333 => 1.1994, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 5.79% (0.6250 => 0.6612, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.72% (4.9865 => 5.2715, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.70% (3.2742 => 3.4608, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.66% (0.4805 => 0.5077, std.dev.: 0.0051) MultiSource/Applications/JM/ldecod/ldecod: 5.22% (6.5754 => 6.9184, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.05% (0.3245 => 0.3409, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.04% (0.2321 => 0.2438, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.02% (1.5188 => 1.5951, std.dev.: 0.0062) MultiSource/Applications/lua/lua: 4.85% (3.7467 => 3.9283, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.83% (0.9108 => 0.9548, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.63% (6.2785 => 6.5691, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.55% (2.1007 => 2.1963, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.47% (13.2842 => 13.8776, std.dev.: 0.0143) MultiSource/Applications/sqlite3/sqlite3: 2.89% (16.2614 => 16.7311, std.dev.: 0.0090) MultiSource/Applications/ClamAV/clamscan: 2.34% (14.5298 => 14.8695, std.dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5137, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.30% (1.8175 => 2.2592, std.dev.: 0.0137) SingleSource/Benchmarks/Misc/richards_benchmark: 11.03% (1.1560 => 1.2835, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922) MultiSource/Benchmarks/Olden/mst/mst: 8.47% (0.1322 => 0.1434, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (3.1736 => 3.4147, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.29% (1.2998 => 1.3815, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0050, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.65% (0.3139 => 0.3285, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6764, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9853, std.dev.: 0.0019) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.76% (10.7476 => 11.0442, std.dev.: 0.0460) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.15% (7.4271 => 7.5871, std.dev.: 0.0037) MultiSource/Applications/lemon/lemon: 1.81% (1.4298 => 1.4557, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5144, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0496, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.44% (2.1753 => 2.2067, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.31% (5.5130 => 5.5850, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1876, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.13% (3.1071 => 3.1421, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 1.10% (12.4560 => 12.5933, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0274, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.03% (8.8259 => 8.9172, std.dev.: 0.0151) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.87% (0.2670 => 0.1392, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -16.27% (0.0707 => 0.0592, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.21% (0.4657 => 0.3902, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.68% (1.3819 => 1.1790, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.67% (1.3813 => 1.1786, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.53% (22.5627 => 21.5398, std.dev.: 0.0060) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.64% (0.0997 => 0.0861, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.06% (0.2238 => 0.1968, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.49% (1.2308 => 1.0894, std.dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.11% (20.3410 => 18.2853, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.41% (1.3780 => 1.3035, std.dev.: 0.0150) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5149, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.84% (13.3668 => 12.7199, std.dev.: 0.0518) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.52% (0.9996 => 0.9544, std.dev.: 0.0149) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8004, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.16% (0.3458 => 0.3314, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.56% (3.2729 => 3.1565, std.dev.: 0.0044) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.50% (1.7688 => 1.7069, std.dev.: 0.0024) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.54% (26.5159 => 25.8420, std.dev.: 0.0229) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.39% (3.0263 => 2.9539, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: -2.37% (1.9762 => 1.9294, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.90% (0.6589 => 0.6464, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.7014, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/lists: -1.70% (6.3560 => 6.2479, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: -1.49% (4.5928 => 4.5245, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0072, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.22% (3.9173 => 3.8697, std.dev.: 0.0171) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.16% (2.5254 => 2.4961, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2571, std.dev.: 0.0008) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 3 14:52:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 3 Oct 2012 16:52:48 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121003215248.C2ECB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4530?compare_to=4527&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4530, Order: 165150, Start Time: 2012-10-03 20:24:19, End Time: 2012-10-03 21:54:31 To: 4527, Order: 165135, Start Time: 2012-10-03 18:38:55, End Time: 2012-10-03 20:08:10 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (9 on baseline) New Passes: 4 (14 on baseline) Performance Regressions: 11 (51 on baseline) Performance Improvements: 3 (44 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 74 (65 on baseline) Unchanged Tests: 950 (787 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 194.29% (0.0070 => 0.0206, std.dev.: 0.0004) SingleSource/UnitTests/2003-08-11-VaListArg: 432.61% (0.0046 => 0.0245, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: 400.00% (0.0001 => 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 22.22% (0.0630 => 0.0770, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/em3d/em3d: 7.43% (0.1520 => 0.1633, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.84% (0.8497 => 0.8653, std.dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 1.15% (6.6117 => 6.6880, std.dev.: 0.0139) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.51% (2.4698 => 2.7294, std.dev.: 0.0157) MultiSource/Applications/lua/lua: 6.81% (28.4500 => 30.3871, std.dev.: 0.1184) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.07% (4.3086 => 4.4408, std.dev.: 0.0319) SingleSource/Benchmarks/Misc/mandel-2: 3.03% (3.0368 => 3.1287, std.dev.: 0.0178) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.44% (11.4974 => 11.7779, std.dev.: 0.0542) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.49% (4.6559 => 4.7251, std.dev.: 0.0152) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.47% (5.8442 => 5.9299, std.dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.42% (2.4074 => 2.3492, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.08% (0.8856 => 0.8672, std.dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash: -2.03% (0.6605 => 0.6471, std.dev.: 0.0033) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.63% (1.0066 => 1.0129, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: 1.99% (0.6077 => 0.6198, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/08-main/main: -2.55% (0.1803 => 0.1757, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.08% (0.1576 => 0.1496, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.47% (0.3055 => 0.3100, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.41% (0.2325 => 0.2381, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.27% (0.3080 => 0.3150, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.30% (0.2258 => 0.2310, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: 20.05% (0.0379 => 0.0455, std.dev.: 0.0029) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 16.48% (0.0182 => 0.0212, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 62.16% (0.0111 => 0.0180, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 20.81% (0.0322 => 0.0389, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -16.11% (0.0298 => 0.0250, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -17.56% (0.0279 => 0.0230, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 5.48% (0.0310 => 0.0327, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 102.22% (0.0090 => 0.0182, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -34.92% (0.0189 => 0.0123, std.dev.: 0.0034) SingleSource/UnitTests/Vector/multiplies: - (0.0249 => 0.0249, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -9.22% (0.0282 => 0.0256, std.dev.: 0.0031) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.64% (0.1462 => 0.1486, std.dev.: 0.0039) MultiSource/Applications/JM/lencod/lencod: 1.72% (0.2262 => 0.2301, std.dev.: 0.0063) MultiSource/Applications/lemon/lemon: -4.51% (1.5339 => 1.4647, std.dev.: 0.0558) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: 2.85% (0.1438 => 0.1479, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: 0.47% (0.5770 => 0.5797, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 0.17% (26.7288 => 26.7739, std.dev.: 0.0491) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.07% (0.4282 => 0.4065, std.dev.: 0.0307) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.58% (0.1395 => 0.1359, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.96% (0.0560 => 0.0549, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.11% (0.0176 => 0.0167, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.61% (0.0663 => 0.0586, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.07% (1.1287 => 1.1295, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0012 => 0.0012, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.47% (0.0548 => 0.0567, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.00% (0.0150 => 0.0135, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.17% (0.7653 => 0.7666, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 0.51% (4.0099 => 4.0304, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -0.92% (41.0635 => 40.6870, std.dev.: 0.3593) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 0.18% (59.5326 => 59.6408, std.dev.: 0.4368) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 0.12% (2.9257 => 2.9291, std.dev.: 0.0724) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 0.01% (2.3355 => 2.3358, std.dev.: 0.1106) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.28% (1.7026 => 1.7073, std.dev.: 0.0020) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt MultiSource/Applications/JM/lencod/lencod: -96.59% (6.7458 => 0.2301, std.dev.: 0.0063) MultiSource/Benchmarks/Bullet/bullet: -91.69% (6.9722 => 0.5797, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 21544.22% (0.1237 => 26.7739, std.dev.: 0.0491) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -0.87% (4.0659 => 4.0304, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 0.51% (40.4792 => 40.6870, std.dev.: 0.3593) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.51% (61.1734 => 59.6408, std.dev.: 0.4368) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.49% (3.2007 => 2.9291, std.dev.: 0.0724) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -0.94% (2.3580 => 2.3358, std.dev.: 0.1106) New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 131.46% (0.0089 => 0.0206, std.dev.: 0.0004) SingleSource/UnitTests/2003-08-11-VaListArg: 172.22% (0.0090 => 0.0245, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -25.10% (4.1772 => 3.1287, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/except: 82766.67% (0.0006 => 0.4972, std.dev.: 0.0031) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: -75.00% (0.0004 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.15% (0.0745 => 0.0910, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.44% (0.6410 => 0.6951, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.99% (0.1414 => 0.1527, std.dev.: 0.0032) MultiSource/Benchmarks/PAQ8p/paq8p: 7.94% (2.1763 => 2.3492, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/bigfib: 7.16% (0.5309 => 0.5689, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.53% (0.3582 => 0.3816, std.dev.: 0.0020) MultiSource/Applications/lemon/lemon: 6.29% (1.0046 => 1.0678, std.dev.: 0.0228) MultiSource/Applications/SIBsim4/SIBsim4: 6.26% (1.1653 => 1.2382, std.dev.: 0.0076) MultiSource/Applications/minisat/minisat: 6.25% (0.6173 => 0.6559, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.92% (0.2552 => 0.2703, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 5.33% (15.3105 => 16.1266, std.dev.: 0.2258) MultiSource/Applications/lambda-0_1_3/lambda: 5.09% (0.6915 => 0.7267, std.dev.: 0.0058) MultiSource/Applications/d/make_dparser: 4.57% (3.0225 => 3.1607, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.33% (0.2797 => 0.2918, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.32% (1.5150 => 1.5805, std.dev.: 0.0214) MultiSource/Applications/siod/siod: 4.02% (2.0972 => 2.1815, std.dev.: 0.0303) MultiSource/Applications/Burg/burg: 3.91% (1.1440 => 1.1887, std.dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: 3.89% (13.3238 => 13.8419, std.dev.: 0.0732) MultiSource/Applications/oggenc/oggenc: 3.43% (4.7455 => 4.9084, std.dev.: 0.0522) MultiSource/Applications/JM/lencod/lencod: 3.07% (14.7256 => 15.1776, std.dev.: 0.0347) MultiSource/Applications/JM/ldecod/ldecod: 3.04% (6.4908 => 6.6880, std.dev.: 0.0139) MultiSource/Benchmarks/Bullet/bullet: 2.98% (29.3170 => 30.1918, std.dev.: 0.1136) MultiSource/Benchmarks/mafft/pairlocalalign: 2.72% (8.2186 => 8.4419, std.dev.: 0.0417) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.65% (1.2021 => 1.2339, std.dev.: 0.0102) MultiSource/Applications/lua/lua: 2.18% (3.5980 => 3.6765, std.dev.: 0.0141) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 44.44% (0.0261 => 0.0377, std.dev.: 0.0021) SingleSource/Benchmarks/Stanford/Bubblesort: 44.11% (0.0263 => 0.0379, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/pi: 41.40% (1.6538 => 2.3385, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: 22.24% (3.4629 => 4.2332, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/power/power: 17.81% (1.4184 => 1.6710, std.dev.: 0.0083) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 16.47% (0.0917 => 0.1068, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 15.32% (0.3746 => 0.4320, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/ary3: 14.78% (1.7426 => 2.0001, std.dev.: 0.0273) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.49% (0.0766 => 0.0877, std.dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.53% (2.4042 => 2.7294, std.dev.: 0.0157) SingleSource/Benchmarks/Stanford/Puzzle: 11.24% (0.1433 => 0.1594, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/queens: 11.11% (1.6261 => 1.8067, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/mason/mason: 9.99% (0.5004 => 0.5504, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.00% (0.2857 => 0.3114, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout/lists: 8.87% (7.0025 => 7.6239, std.dev.: 0.0214) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.41% (4.2129 => 4.4408, std.dev.: 0.0319) MultiSource/Benchmarks/PAQ8p/paq8p: 4.71% (92.7467 => 97.1180, std.dev.: 0.0849) SingleSource/Benchmarks/Misc/dt: 3.87% (0.9851 => 1.0232, std.dev.: 0.0034) MultiSource/Applications/siod/siod: 3.35% (3.5520 => 3.6711, std.dev.: 0.0280) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.13% (0.5587 => 0.5762, std.dev.: 0.0017) MultiSource/Applications/lua/lua: 2.93% (29.5232 => 30.3871, std.dev.: 0.1184) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.82% (6.6312 => 6.8184, std.dev.: 0.0609) SingleSource/Benchmarks/Shootout-C++/hash: 2.58% (0.6308 => 0.6471, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.44% (4.6127 => 4.7251, std.dev.: 0.0152) MultiSource/Benchmarks/mafft/pairlocalalign: 2.36% (62.4126 => 63.8831, std.dev.: 0.0624) SingleSource/Benchmarks/Misc/fp-convert: 1.47% (15.2242 => 15.4481, std.dev.: 0.0080) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -44.86% (0.2996 => 0.1652, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.67% (0.0591 => 0.0327, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -20.68% (1.4113 => 1.1195, std.dev.: 0.0163) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.65% (1.4189 => 1.1259, std.dev.: 0.0377) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.52% (0.3497 => 0.2080, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -25.60% (15.8312 => 11.7779, std.dev.: 0.0542) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.30% (5.2665 => 4.1972, std.dev.: 0.0728) SingleSource/Benchmarks/Shootout-C++/ary3: -19.89% (1.7473 => 1.3997, std.dev.: 0.0387) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -14.99% (1.7361 => 1.4759, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1608, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/ackermann: -11.91% (3.6023 => 3.1731, std.dev.: 0.1030) MultiSource/Benchmarks/FreeBench/neural/neural: -11.45% (1.0926 => 0.9675, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.64% (1.1647 => 1.0524, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: -8.42% (9.5474 => 8.7431, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.32% (1.4034 => 1.2866, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/bh/bh: -7.51% (2.5166 => 2.3276, std.dev.: 0.0233) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.94% (3.6254 => 3.3737, std.dev.: 0.0094) MultiSource/Applications/lambda-0_1_3/lambda: -6.69% (7.6833 => 7.1691, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/richards_benchmark: -6.46% (1.4441 => 1.3508, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/fibo: -6.42% (4.6355 => 4.3381, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.98% (2.9728 => 2.7951, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.45% (3.9413 => 3.7266, std.dev.: 0.0113) MultiSource/Applications/SIBsim4/SIBsim4: -5.40% (3.4230 => 3.2382, std.dev.: 0.0253) SingleSource/Benchmarks/Shootout/fib2: -4.97% (4.4195 => 4.1998, std.dev.: 0.0229) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.93% (0.4564 => 0.4339, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.93% (0.4140 => 0.3936, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/n-body: -4.72% (1.5803 => 1.5057, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/distray/distray: -4.17% (0.2664 => 0.2553, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -4.12% (3.4080 => 3.2675, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.54% (9.3855 => 9.0536, std.dev.: 0.0231) SingleSource/Benchmarks/Shootout-C++/methcall: -3.37% (9.2503 => 8.9385, std.dev.: 0.0569) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.07% (3.7496 => 3.6344, std.dev.: 0.0342) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.94% (1.1683 => 1.1339, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/dry: -2.09% (2.4013 => 2.3510, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/hash2: -1.93% (3.4876 => 3.4202, std.dev.: 0.0024) MultiSource/Benchmarks/sim/sim: -1.86% (3.8907 => 3.8182, std.dev.: 0.0091) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.70% (2.3569 => 2.3168, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.47% (1.8739 => 1.8464, std.dev.: 0.0094) MultiSource/Applications/aha/aha: -1.39% (3.4286 => 3.3810, std.dev.: 0.0085) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (25.6658 => 25.3174, std.dev.: 0.0424) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.36% (1.0686 => 1.0541, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.28% (27.1724 => 26.8234, std.dev.: 0.1112) MultiSource/Applications/SPASS/SPASS: -1.25% (8.5323 => 8.4259, std.dev.: 0.0392) SingleSource/Benchmarks/Dhrystone/fldry: -1.14% (2.4971 => 2.4687, std.dev.: 0.0007) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.49% (0.9980 => 1.0129, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: 2.92% (0.6022 => 0.6198, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/08-main/main: 5.46% (0.1666 => 0.1757, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.73% (0.1554 => 0.1496, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.55% (0.3083 => 0.3100, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.54% (0.2394 => 0.2381, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.79% (0.3175 => 0.3150, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.35% (0.2302 => 0.2310, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: 1.34% (0.0449 => 0.0455, std.dev.: 0.0029) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -11.67% (0.0240 => 0.0212, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -6.25% (0.0192 => 0.0180, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.26% (0.0390 => 0.0389, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -16.94% (0.0301 => 0.0250, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -19.01% (0.0284 => 0.0230, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.93% (0.0324 => 0.0327, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 2.82% (0.0177 => 0.0182, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -34.92% (0.0189 => 0.0123, std.dev.: 0.0034) SingleSource/UnitTests/Vector/multiplies: - (0.0249 => 0.0249, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -21.23% (0.0325 => 0.0256, std.dev.: 0.0031) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 3.99% (0.1429 => 0.1486, std.dev.: 0.0039) MultiSource/Applications/lemon/lemon: -2.48% (1.5019 => 1.4647, std.dev.: 0.0558) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.47% (0.1501 => 0.1479, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.67% (0.4264 => 0.4065, std.dev.: 0.0307) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.12% (0.1344 => 0.1359, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.79% (0.0589 => 0.0549, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -28.02% (0.0232 => 0.0167, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.29% (0.0639 => 0.0586, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.48% (1.1350 => 1.1295, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.99% (0.0637 => 0.0567, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -45.12% (0.0246 => 0.0135, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.66% (0.7541 => 0.7666, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.13% (1.5363 => 1.7073, std.dev.: 0.0020) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 3 15:14:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 3 Oct 2012 17:14:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121003221427.0156A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4531?compare_to=4528&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4531, Order: 165150, Start Time: 2012-10-03 20:56:25, End Time: 2012-10-03 22:16:07 To: 4528, Order: 165136, Start Time: 2012-10-03 19:07:16, End Time: 2012-10-03 20:26:59 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (147 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 952 (695 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 6.77% (14.8021 => 15.8046, std.dev.: 0.0024) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.28% (0.5759 => 0.5775, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: -0.04% (16.0329 => 16.0270, std.dev.: 0.0181) MultiSource/Benchmarks/Bullet/bullet: 0.26% (54.0522 => 54.1910, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/gs/gs: 0.06% (4.3367 => 4.3391, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.22% (0.0460 => 0.0461, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.65% (0.0460 => 0.0463, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.70% (0.0429 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.23% (0.0432 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.72% (0.0418 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.48% (0.0420 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.73% (0.0412 => 0.0415) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.24% (0.0415 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.70% (0.0430 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.70% (0.0431 => 0.0434) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.47% (0.0425 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.47% (0.0426 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.48% (0.0414 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.48% (0.0417 => 0.0419) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.24% (0.0422 => 0.0423, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.71% (0.0423 => 0.0426) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.46% (0.0433 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.46% (0.0435 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.49% (0.0409 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.73% (0.0411 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.71% (0.0421 => 0.0424) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.23% (0.0426 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.48% (0.0414 => 0.0416) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.48% (0.0415 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.49% (0.0405 => 0.0407) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.49% (0.0407 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.50% (0.0404 => 0.0406) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.49% (0.0406 => 0.0408, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.23% (0.0442 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.45% (0.0443 => 0.0445, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.50% (0.0404 => 0.0406, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.74% (0.0404 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.50% (0.0404 => 0.0406, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.49% (0.0405 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.49% (0.0412 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.48% (0.0414 => 0.0416) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.43% (1.2317 => 1.2370, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.16% (7.5248 => 7.5372, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.06% (0.7263 => 0.7267, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.28% (0.0361 => 0.0360, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1435 => 0.1434, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0649 => 0.0649, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -14.31% (63.2438 => 54.1910, std.dev.: 0.0044) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 30.92% (14.1553 => 18.5321, std.dev.: 0.0285) SingleSource/Benchmarks/Misc-C++-EH/spirit: 58.17% (3.4629 => 5.4771, std.dev.: 0.0029) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14223.89% (0.0720 => 10.3132, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952300.00% (0.0001 => 9.9524, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 52.45% (10.3673 => 15.8046, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: 46.40% (0.2554 => 0.3739, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 30.52% (0.1622 => 0.2117, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 30.49% (0.1056 => 0.1378, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.47% (2.2022 => 2.5428, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 14.53% (0.1432 => 0.1640, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.04% (7.0540 => 8.0446, std.dev.: 0.0087) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.41% (0.1566 => 0.1776, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.11% (0.0834 => 0.0935, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.07% (1.7609 => 1.9735, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 10.97% (0.3282 => 0.3642, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 10.88% (10.4361 => 11.5715, std.dev.: 0.0131) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.61% (0.1584 => 0.1752, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 10.24% (9.4845 => 10.4557, std.dev.: 0.0090) SingleSource/UnitTests/ObjC/trivial-interface: 9.47% (0.3473 => 0.3802, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.43% (0.3543 => 0.3877, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 9.22% (0.3516 => 0.3840, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.18% (0.3497 => 0.3818, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 9.15% (0.3561 => 0.3887, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.09% (0.3543 => 0.3865, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 8.99% (0.3828 => 0.4172, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.96% (0.3694 => 0.4025, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.94% (0.3927 => 0.4278, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.94% (0.4879 => 0.5315, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 8.76% (0.1655 => 0.1800, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/property: 8.72% (0.3886 => 0.4225, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.56% (0.3177 => 0.3449, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 8.17% (0.3109 => 0.3363, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 8.04% (0.7115 => 0.7687, std.dev.: 0.0096) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.04% (0.4615 => 0.4986, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.04% (1.5415 => 1.6654, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.94% (0.6675 => 0.7205, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.93% (0.1438 => 0.1552, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 7.88% (0.7433 => 0.8019, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.80% (0.2603 => 0.2806, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.78% (0.5925 => 0.6386, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.78% (0.6030 => 0.6499, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 7.67% (0.1695 => 0.1825, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 7.66% (5.7591 => 6.2002, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.51% (0.1625 => 0.1747, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.49% (0.2271 => 0.2441, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.41% (0.2065 => 0.2218, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.37% (0.5105 => 0.5481, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/18-imp/imp: 7.36% (0.3423 => 0.3675, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.30% (0.2700 => 0.2897, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.22% (0.8172 => 0.8762, std.dev.: 0.0039) MultiSource/Applications/d/make_dparser: 7.21% (3.3354 => 3.5758, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.20% (0.5860 => 0.6282, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.20% (1.3050 => 1.3989, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.15% (4.2646 => 4.5697, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.14% (0.8067 => 0.8643, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.09% (0.1510 => 0.1617, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 7.08% (0.1440 => 0.1542, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.06% (0.7326 => 0.7843, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.93% (0.2758 => 0.2949, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.90% (0.9765 => 1.0439, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.87% (5.0018 => 5.3455, std.dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.86% (0.3121 => 0.3335, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.84% (4.9449 => 5.2832, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.82% (8.1363 => 8.6911, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 6.78% (0.3422 => 0.3654, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.77% (0.4636 => 0.4950, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.74% (0.2107 => 0.2249, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.73% (0.5569 => 0.5944, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.60% (0.1940 => 0.2068, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 6.55% (0.3387 => 0.3609, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.53% (0.2831 => 0.3016, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 6.49% (1.1642 => 1.2397, std.dev.: 0.0059) MultiSource/Applications/spiff/spiff: 6.42% (0.7835 => 0.8338, std.dev.: 0.0049) SingleSource/Regression/C++/ofstream_ctor: 6.40% (0.2905 => 0.3091, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.40% (0.2891 => 0.3076, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.39% (7.9617 => 8.4708, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.35% (0.5020 => 0.5339, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 6.30% (0.4048 => 0.4303, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/bigfib: 6.27% (0.6456 => 0.6861, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.26% (0.3307 => 0.3514, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.25% (0.3650 => 0.3878, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.23% (0.4203 => 0.4465, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 6.19% (1.5603 => 1.6569, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary: 6.19% (0.3232 => 0.3432, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.15% (0.3136 => 0.3329, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.14% (0.3162 => 0.3356, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.11% (0.3865 => 0.4101, std.dev.: 0.0035) MultiSource/Applications/lua/lua: 6.10% (3.8723 => 4.1084, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.09% (2.0665 => 2.1923, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.07% (0.3441 => 0.3650, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.06% (0.3826 => 0.4058, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.06% (0.3052 => 0.3237, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.04% (0.4289 => 0.4548, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.99% (0.2872 => 0.3044, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.98% (0.2725 => 0.2888, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 5.97% (1.0722 => 1.1362, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/except: 5.92% (0.2871 => 0.3041, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.91% (0.3283 => 0.3477, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.88% (0.2756 => 0.2918, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 5.88% (21.9371 => 23.2265, std.dev.: 0.0258) MultiSource/Benchmarks/McCat/05-eks/eks: 5.86% (0.4299 => 0.4551, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 5.84% (0.3098 => 0.3279, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 5.77% (0.3603 => 0.3811, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.75% (1.1861 => 1.2543, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 5.75% (0.2802 => 0.2963, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 5.74% (0.4620 => 0.4885, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 5.72% (0.3180 => 0.3362, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.71% (0.2714 => 0.2869, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 5.70% (0.2877 => 0.3041, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.66% (0.2793 => 0.2951, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 5.59% (0.3684 => 0.3890, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 5.53% (2.0273 => 2.1395, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 5.47% (0.3379 => 0.3564, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.41% (0.6450 => 0.6799, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 5.37% (0.8921 => 0.9400, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.33% (0.5981 => 0.6300, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 5.25% (2.2969 => 2.4174, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.92% (1.5859 => 1.6639, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.63% (0.2266 => 0.2371, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.63% (1.4186 => 1.4843, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.38% (0.4064 => 0.4242, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.33% (1.1840 => 1.2353, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.20% (2.2024 => 2.2950, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 4.13% (1.2842 => 1.3373, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 4.02% (0.3131 => 0.3257, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.63% (0.8101 => 0.8395, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.10% (14.3668 => 14.8128, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.01% (0.3427 => 0.3530, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.39% (17.1811 => 17.5915, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.17% (3.8922 => 3.9765, std.dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 30.46% (1.1277 => 1.4712, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.25% (1.1145 => 1.3848, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 10.15% (3.1595 => 3.4803, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.98% (1.1396 => 1.2533, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3684, std.dev.: 0.0009) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.59% (3.6395 => 3.7703, std.dev.: 0.0100) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.71% (4.2280 => 4.3424, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.34% (1.7254 => 1.7657, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.03% (11.6436 => 11.7636, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.00% (9.1159 => 9.2075, std.dev.: 0.0343) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1288, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -80.13% (0.8651 => 0.1719, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.27% (5.2763 => 3.2568, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.95% (5.3855 => 3.6112, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.58% (5.3526 => 3.6087, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -14.72% (54.1659 => 46.1945, std.dev.: 0.0195) MultiSource/Benchmarks/FreeBench/mason/mason: -13.93% (0.0811 => 0.0698, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.84% (2.9384 => 2.6198, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -10.35% (22.1758 => 19.8801, std.dev.: 0.0396) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.35% (1.1492 => 0.7659, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.95% (1.6925 => 1.4225, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.53% (0.0998 => 0.0863, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -12.67% (1.3677 => 1.1944, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.16% (1.2373 => 1.0992, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -10.32% (1.5373 => 1.3787, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/mason/mason: -10.04% (0.2161 => 0.1944, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.32% (19.9488 => 18.2893, std.dev.: 0.0274) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4787, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.67% (1.8329 => 1.7106, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.65% (0.2497 => 0.2331) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5758, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.36% (1.6805 => 1.5905, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.16% (13.4384 => 12.7453, std.dev.: 0.0525) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7966, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.69% (1.5835 => 1.5093, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.30% (0.3463 => 0.3314, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.93% (0.9957 => 0.9566, std.dev.: 0.0045) MultiSource/Applications/siod/siod: -3.63% (3.2827 => 3.1636, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.42% (32.5116 => 31.4008, std.dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0987, std.dev.: 0.0016) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Applications/sqlite3/sqlite3: -1.93% (4.6441 => 4.5546, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.88% (8.6802 => 8.5172, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6813, std.dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5094, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.65% (8.1563 => 8.0215, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/salsa20: -1.59% (10.2830 => 10.1191, std.dev.: 0.0159) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4208, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8580, std.dev.: 0.0029) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.44% (0.5229 => 0.5775, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 6.92% (14.9895 => 16.0270, std.dev.: 0.0181) MultiSource/Benchmarks/MallocBench/gs/gs: 5.56% (4.1105 => 4.3391, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.97% (1.1048 => 1.2370, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.29% (7.1582 => 7.5372, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/stepanov_container: 16.80% (0.6222 => 0.7267, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35900.00% (0.0001 => 0.0360, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.43% (0.1485 => 0.1434, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 3 15:20:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 3 Oct 2012 17:20:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121003222031.C45D62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4532?compare_to=4525&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4532, Order: 165138, Start Time: 2012-10-03 19:13:16, End Time: 2012-10-03 22:22:12 To: 4525, Order: 165119, Start Time: 2012-10-03 15:35:18, End Time: 2012-10-03 18:44:10 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 2 (135 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (131 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1037 (756 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 4.85% (0.2143 => 0.2247, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.59% (2.0927 => 2.1260, std.dev.: 0.0043) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.01% (9.8101 => 9.8115, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.02% (9.4111 => 9.4096, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.07% (16.9391 => 16.9266, std.dev.: 0.0015) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.85% (0.1063 => 0.1189, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 11.79% (1.5932 => 1.7810, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.58% (0.3488 => 0.3892, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/exceptions-2: 11.58% (0.3446 => 0.3845, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.54% (0.3465 => 0.3865, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.44% (0.3496 => 0.3896, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/trivial-interface: 11.42% (0.3442 => 0.3835, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.42% (0.3460 => 0.3855, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.36% (0.3469 => 0.3863, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.29% (0.3650 => 0.4062, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions: 11.09% (0.3643 => 0.4047, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.82% (0.3724 => 0.4127, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/Hello: 9.46% (0.5826 => 0.6377, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.39% (0.5889 => 0.6442, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 8.77% (0.1505 => 0.1637, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 8.62% (0.1218 => 0.1323, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 8.40% (0.1619 => 0.1755, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.29% (1.3152 => 1.4242, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.17% (0.2875 => 0.3110, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.15% (0.4994 => 0.5401, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference: 7.99% (0.7171 => 0.7744, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/matrix: 7.91% (0.2780 => 0.3000, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 7.84% (0.9909 => 1.0686, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: 7.83% (0.2811 => 0.3031, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.82% (0.3195 => 0.3445, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.78% (0.2725 => 0.2937, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.77% (0.2714 => 0.2925, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 7.76% (0.3004 => 0.3237, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 7.75% (0.2813 => 0.3031, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.74% (0.2738 => 0.2950, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.73% (0.2729 => 0.2940, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 7.72% (0.2823 => 0.3041, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 7.71% (0.2750 => 0.2962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.70% (0.2792 => 0.3007, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.69% (0.2911 => 0.3135, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.66% (2.0673 => 2.2257, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.64% (0.4361 => 0.4694, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.62% (1.6211 => 1.7446, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 7.56% (0.2803 => 0.3015, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 7.56% (0.3096 => 0.3330, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 7.44% (5.5417 => 5.9542, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.38% (0.3362 => 0.3610, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.34% (0.3625 => 0.3891, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.33% (0.3124 => 0.3353, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.32% (0.3060 => 0.3284, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 7.32% (0.3267 => 0.3506, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.31% (3.5627 => 3.8233, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.30% (0.2014 => 0.2161, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.28% (0.1620 => 0.1738, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.28% (0.3282 => 0.3521, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 7.27% (0.3317 => 0.3558, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.24% (0.2736 => 0.2934, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 7.21% (0.3258 => 0.3493, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.21% (0.4146 => 0.4445, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.16% (0.5000 => 0.5358, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 7.14% (0.3348 => 0.3587, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.06% (2.7292 => 2.9219, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 7.04% (0.3678 => 0.3937, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.95% (0.3726 => 0.3985, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.94% (0.3845 => 0.4112, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 6.88% (1.0781 => 1.1523, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists1: 6.82% (0.3477 => 0.3714, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.81% (0.4139 => 0.4421, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 6.78% (2.1013 => 2.2438, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 6.78% (23.5202 => 25.1144, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.67% (0.5026 => 0.5361, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.64% (0.3930 => 0.4191, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 6.54% (0.4251 => 0.4529, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.50% (0.3690 => 0.3930, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 6.47% (0.2566 => 0.2732, std.dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 6.43% (4.2109 => 4.4816, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.38% (0.3981 => 0.4235, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 6.23% (0.6634 => 0.7047, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 6.20% (1.8794 => 1.9960, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.19% (4.4195 => 4.6932, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 6.15% (0.5012 => 0.5320, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.11% (0.2866 => 0.3041, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 6.06% (0.4029 => 0.4273, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.00% (0.2068 => 0.2192, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.99% (0.3890 => 0.4123, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.92% (0.3903 => 0.4134, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.88% (0.2737 => 0.2898, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.86% (0.6435 => 0.6812, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 5.75% (1.4269 => 1.5090, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.74% (0.1968 => 0.2081, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.73% (0.5900 => 0.6238, std.dev.: 0.0037) MultiSource/Applications/JM/lencod/lencod: 5.71% (4.6177 => 4.8816, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.71% (0.3084 => 0.3260, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 5.68% (0.5546 => 0.5861, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.59% (0.2040 => 0.2154, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.47% (0.4658 => 0.4913, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 5.46% (0.9697 => 1.0226, std.dev.: 0.0029) MultiSource/Applications/JM/ldecod/ldecod: 5.43% (2.1653 => 2.2828, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.39% (0.2969 => 0.3129, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.29% (0.3271 => 0.3444, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 5.20% (0.2075 => 0.2183, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.04% (0.2103 => 0.2209, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 5.03% (0.7875 => 0.8271, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 4.98% (2.0346 => 2.1359, std.dev.: 0.0112) MultiSource/Benchmarks/PAQ8p/paq8p: 4.83% (0.4847 => 0.5081, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.75% (1.9694 => 2.0630, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.72% (1.9966 => 2.0908, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: 4.64% (0.2391 => 0.2502, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 4.57% (0.2691 => 0.2814, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.00% (0.7426 => 0.7723, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.99% (0.5361 => 0.5575, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.85% (0.5584 => 0.5799, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.60% (11.6398 => 12.0585, std.dev.: 0.0066) MultiSource/Applications/lambda-0_1_3/lambda: 3.49% (0.3498 => 0.3620, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.40% (4.6926 => 4.8522, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.99% (0.4253 => 0.4380, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 2.48% (11.9555 => 12.2521, std.dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.55% (0.2122 => 0.2261, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/n-body: 5.78% (3.3903 => 3.5861, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6761, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-2: 5.12% (1.8057 => 1.8982, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1666, std.dev.: 0.0244) SingleSource/Benchmarks/Dhrystone/dry: 4.26% (14.0481 => 14.6463, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.42% (79.9355 => 82.6711, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.11% (2.0820 => 2.1260, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1947, std.dev.: 0.0088) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5022, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.71% (3.1722 => 3.2265, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2848, std.dev.: 0.0029) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5139, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.14% (6.9584 => 7.0374, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5917, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.88% (25.4195 => 16.5539, std.dev.: 0.0187) MultiSource/Applications/sgefa/sgefa: -9.25% (1.5554 => 1.4115, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9769, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8036, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -6.45% (0.2402 => 0.2247, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: -5.83% (3.3665 => 3.1703, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8017, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.15% (21.9346 => 21.2440, std.dev.: 0.0910) SingleSource/Benchmarks/Dhrystone/fldry: -3.10% (17.2379 => 16.7028, std.dev.: 0.0984) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.97% (0.6293 => 0.6106, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5790, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.20% (105.3826 => 104.1150, std.dev.: 0.0906) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0462, std.dev.: 0.0010) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 3 15:41:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 3 Oct 2012 17:41:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121003224108.D4BC72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4533?compare_to=4529&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4533, Order: 165150, Start Time: 2012-10-03 21:17:08, End Time: 2012-10-03 22:42:49 To: 4529, Order: 165139, Start Time: 2012-10-03 19:23:08, End Time: 2012-10-03 20:48:10 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (5 on baseline) Performance Regressions: 1 (177 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 5 (0 on baseline) Unchanged Tests: 1036 (683 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.11% (55.6993 => 56.3158, std.dev.: 0.1007) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.28% (33.1828 => 33.2756, std.dev.: 0.0084) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.01% (2.7522 => 2.7524, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.00% (2.1154 => 2.1153, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.00% (4.9748 => 4.9747, std.dev.: 0.0003) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.06% (33.2944 => 33.2756, std.dev.: 0.0084) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: -100.00% (7.3305 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 19.97% (2.0176 => 2.4206, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.74% (0.1410 => 0.1646, std.dev.: 0.0008) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.95% (0.1072 => 0.1243, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 14.89% (0.0826 => 0.0949, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 13.78% (0.2243 => 0.2552, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.31% (0.0819 => 0.0928, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.98% (0.1327 => 0.1486, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 11.29% (0.5818 => 0.6475, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 11.25% (0.1013 => 0.1127, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.11% (0.1413 => 0.1570, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 11.10% (0.5748 => 0.6386, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.95% (0.2721 => 0.3019, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.79% (0.2596 => 0.2876, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 10.63% (0.7038 => 0.7786, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.62% (0.3022 => 0.3343, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 10.59% (0.7061 => 0.7809, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.58% (0.0964 => 0.1066, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 10.56% (0.4062 => 0.4491, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.53% (3.9660 => 4.3835, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.51% (0.7710 => 0.8520, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 10.49% (0.4328 => 0.4782, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 10.46% (1.3693 => 1.5125, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.33% (0.6959 => 0.7678, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.23% (0.3899 => 0.4298, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.22% (1.4563 => 1.6051, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.18% (0.9199 => 1.0135, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.14% (0.1588 => 0.1749, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 10.07% (0.2781 => 0.3061, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 9.98% (0.1062 => 0.1168, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.92% (0.3580 => 0.3935, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.83% (1.2193 => 1.3392, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.80% (0.5265 => 0.5781, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.71% (0.2782 => 0.3052, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.70% (0.3485 => 0.3823, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.67% (0.1075 => 0.1179, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 9.53% (0.2761 => 0.3024, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.50% (0.6283 => 0.6880, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.47% (0.2966 => 0.3247, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 9.44% (0.2690 => 0.2944, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 9.44% (0.2607 => 0.2853, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.42% (0.2655 => 0.2905, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.40% (0.1276 => 0.1396, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.40% (0.3489 => 0.3817, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.33% (0.1157 => 0.1265, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.33% (0.2914 => 0.3186, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.31% (1.9828 => 2.1674, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.27% (0.3756 => 0.4104, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.26% (0.1986 => 0.2170, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 9.25% (0.2628 => 0.2871, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.22% (0.2765 => 0.3020, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.22% (1.1364 => 1.2412, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.21% (0.4016 => 0.4386, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 9.20% (0.2760 => 0.3014, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 9.19% (13.8202 => 15.0909, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/strcat: 9.17% (0.2726 => 0.2976, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 9.14% (0.3293 => 0.3594, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 9.12% (0.2937 => 0.3205, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.05% (0.2696 => 0.2940, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.95% (0.3130 => 0.3410, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 8.95% (0.3868 => 0.4214, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.84% (0.4390 => 0.4778, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 8.83% (0.3149 => 0.3427, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 8.82% (0.3107 => 0.3381, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 8.81% (0.1589 => 0.1729, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.77% (0.4379 => 0.4763, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 8.77% (0.2988 => 0.3250, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.75% (0.5577 => 0.6065, std.dev.: 0.0057) MultiSource/Applications/sgefa/sgefa: 8.75% (0.2995 => 0.3257, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 8.69% (0.3453 => 0.3753, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 8.62% (0.3192 => 0.3467, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.51% (0.2127 => 0.2308, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.50% (0.1435 => 0.1557, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 8.45% (1.1061 => 1.1996, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.44% (0.3246 => 0.3520, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 8.44% (1.0313 => 1.1183, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 8.40% (0.3534 => 0.3831, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.37% (0.4791 => 0.5192, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 8.36% (16.6129 => 18.0022, std.dev.: 0.0109) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.28% (0.7460 => 0.8078, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 8.25% (0.2945 => 0.3188, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.21% (0.6576 => 0.7116, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.14% (0.5637 => 0.6096, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 8.10% (0.2925 => 0.3162, std.dev.: 0.0019) MultiSource/Applications/spiff/spiff: 8.10% (0.7506 => 0.8114, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.03% (0.2504 => 0.2705) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.99% (0.1865 => 0.2014, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/gs/gs: 7.89% (3.8646 => 4.1695, std.dev.: 0.0102) MultiSource/Benchmarks/McCat/18-imp/imp: 7.89% (0.3220 => 0.3474, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.85% (3.6692 => 3.9571, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.84% (7.2180 => 7.7836, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/football/football: 7.83% (0.8310 => 0.8961, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.76% (0.8698 => 0.9373, std.dev.: 0.0144) MultiSource/Applications/minisat/minisat: 7.74% (0.6744 => 0.7266, std.dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 7.71% (1.0594 => 1.1411, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.66% (0.2023 => 0.2178, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 7.62% (2.1791 => 2.3451, std.dev.: 0.0083) MultiSource/Applications/d/make_dparser: 7.49% (3.1889 => 3.4278, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 7.48% (0.1657 => 0.1781, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.43% (0.3755 => 0.4034, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 7.40% (1.9270 => 2.0696, std.dev.: 0.0070) MultiSource/Applications/viterbi/viterbi: 7.17% (0.1478 => 0.1584, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.17% (0.4003 => 0.4290, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.15% (0.1789 => 0.1917, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.07% (1.3245 => 1.4181, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 7.06% (0.3940 => 0.4218, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.02% (0.3578 => 0.3829, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.00% (0.3914 => 0.4188, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 6.94% (0.3601 => 0.3851, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.94% (0.3789 => 0.4052, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.91% (0.3646 => 0.3898, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 6.90% (0.4113 => 0.4397, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.88% (0.1569 => 0.1677, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.88% (0.3650 => 0.3901, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 6.85% (0.3663 => 0.3914, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.82% (0.2140 => 0.2286, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.76% (0.1819 => 0.1942, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 6.74% (8.4961 => 9.0688, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions-3: 6.71% (0.3623 => 0.3866, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 6.68% (0.3131 => 0.3340, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.67% (0.6135 => 0.6544, std.dev.: 0.0053) MultiSource/Applications/JM/lencod/lencod: 6.66% (14.8535 => 15.8432, std.dev.: 0.0093) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.64% (0.3511 => 0.3744, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 6.63% (1.2749 => 1.3594, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.55% (4.3801 => 4.6669, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.54% (0.8818 => 0.9395, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.50% (4.6629 => 4.9662, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.48% (4.4433 => 4.7313, std.dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: 6.17% (1.2292 => 1.3051, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.09% (1.1333 => 1.2023, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.91% (3.2742 => 3.4677, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.76% (4.9865 => 5.2739, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/bigfib: 5.73% (0.6250 => 0.6608, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.69% (0.2321 => 0.2453, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.47% (0.4805 => 0.5068, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.22% (1.5188 => 1.5981, std.dev.: 0.0062) MultiSource/Applications/JM/ldecod/ldecod: 5.22% (6.5754 => 6.9186, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.13% (0.9108 => 0.9575, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 5.10% (3.7467 => 3.9379, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.08% (0.3245 => 0.3410, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.95% (6.2785 => 6.5891, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.65% (2.1007 => 2.1984, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.38% (13.2842 => 13.8661, std.dev.: 0.0079) MultiSource/Applications/sqlite3/sqlite3: 2.75% (16.2614 => 16.7093, std.dev.: 0.0054) MultiSource/Applications/ClamAV/clamscan: 2.30% (14.5298 => 14.8634, std.dev.: 0.0133) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 30.42% (5.7573 => 7.5084, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 25.06% (1.8175 => 2.2729, std.dev.: 0.0441) SingleSource/Benchmarks/Misc/richards_benchmark: 11.06% (1.1560 => 1.2838, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.63% (3.1736 => 3.4156, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: 6.31% (1.2998 => 1.3818, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.64% (1.9144 => 2.0033, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.88% (1.7081 => 1.7744, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6770, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-6: 3.46% (1.9199 => 1.9863, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.72% (10.7476 => 11.0400, std.dev.: 0.0296) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.15% (7.4271 => 7.5865, std.dev.: 0.0059) MultiSource/Applications/lemon/lemon: 1.79% (1.4298 => 1.4554, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5132, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/oourafft: 1.29% (5.5130 => 5.5843, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9684, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1874, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.13% (3.1071 => 3.1423, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0275, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 1.03% (12.4560 => 12.5847, std.dev.: 0.0069) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.72% (0.2670 => 0.1396, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.10% (0.4657 => 0.3907, std.dev.: 0.0090) MultiSource/Benchmarks/FreeBench/mason/mason: -15.98% (0.0707 => 0.0594, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.50% (1.3813 => 1.1810, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.28% (1.3819 => 1.1846, std.dev.: 0.0073) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.68% (22.5627 => 21.5067, std.dev.: 0.0200) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.15% (0.2238 => 0.1966, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.91% (1.2308 => 1.0965, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.16% (20.3410 => 18.2744, std.dev.: 0.0172) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2639, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.92% (1.3780 => 1.2964, std.dev.: 0.0086) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.23% (2.6470 => 2.5085, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.53% (0.9996 => 0.9543, std.dev.: 0.0076) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.37% (13.3668 => 12.7829, std.dev.: 0.0411) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.19% (0.3458 => 0.3313, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.58% (3.2729 => 3.1556, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.49% (1.7688 => 1.7070, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.96% (0.4867 => 0.4723, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -2.60% (26.5159 => 25.8261, std.dev.: 0.0291) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.42% (3.0263 => 2.9530, std.dev.: 0.0013) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.28% (1.9762 => 1.9311, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.02% (0.6589 => 0.6456, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.85% (28.2225 => 27.7017, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/lists: -1.73% (6.3560 => 6.2460, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0066, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8623, std.dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: -1.35% (4.5928 => 4.5308, std.dev.: 0.0025) MultiSource/Applications/minisat/minisat: -1.26% (9.3358 => 9.2179, std.dev.: 0.0450) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4942, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2570, std.dev.: 0.0006) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 3 17:03:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 3 Oct 2012 19:03:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121004000320.27A622A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/4534?compare_to=4531&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4534, Order: 165173, Start Time: 2012-10-03 22:45:26, End Time: 2012-10-04 00:04:59 To: 4531, Order: 165150, Start Time: 2012-10-03 20:56:25, End Time: 2012-10-03 22:16:07 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 4 (150 on baseline) Performance Improvements: 5 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 944 (695 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/n-body: 11.37% (1.1944 => 1.3302, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 9.38% (0.3314 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.36% (12.7453 => 13.4288, std.dev.: 0.0326) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.46% (0.2331 => 0.2435, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.19% (15.8046 => 15.4579, std.dev.: 0.0071) MultiSource/Benchmarks/mafft/pairlocalalign: -1.61% (10.4557 => 10.2877, std.dev.: 0.0131) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/power/power: -24.10% (1.4712 => 1.1166) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.14% (43.8923 => 42.5144, std.dev.: 0.1598) MultiSource/Benchmarks/Olden/bh/bh: -1.04% (1.9482 => 1.9280, std.dev.: 0.0011) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.24% (0.5775 => 0.5789, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 0.21% (16.0270 => 16.0612, std.dev.: 0.0149) MultiSource/Benchmarks/Bullet/bullet: -0.13% (54.1910 => 54.1194, std.dev.: 0.0155) MultiSource/Benchmarks/MallocBench/gs/gs: 0.20% (4.3391 => 4.3476, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.30% (0.0461 => 0.0467, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.30% (0.0463 => 0.0469, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.16% (0.0432 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.92% (0.0433 => 0.0437, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.19% (0.0421 => 0.0426, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.18% (0.0422 => 0.0427, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.72% (0.0415 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.96% (0.0416 => 0.0420, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.15% (0.0433 => 0.0438) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.15% (0.0434 => 0.0439, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.17% (0.0427 => 0.0432, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.40% (0.0428 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.44% (0.0416 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.95% (0.0419 => 0.0423, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.42% (0.0423 => 0.0429, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.17% (0.0426 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.38% (0.0435 => 0.0441, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.37% (0.0437 => 0.0443, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.22% (0.0411 => 0.0416, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.21% (0.0414 => 0.0419, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.18% (0.0424 => 0.0429, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.41% (0.0425 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.96% (0.0416 => 0.0420, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.20% (0.0417 => 0.0422, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.23% (0.0407 => 0.0412) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.98% (0.0409 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.99% (0.0406 => 0.0410, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.23% (0.0408 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.35% (0.0443 => 0.0449, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.12% (0.0445 => 0.0450, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.99% (0.0406 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.98% (0.0407 => 0.0411, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.23% (0.0406 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.98% (0.0407 => 0.0411, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.21% (0.0414 => 0.0419) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.96% (0.0416 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.09% (1.2370 => 1.2359, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.09% (7.5372 => 7.5443, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.26% (0.7267 => 0.7286, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.83% (0.0360 => 0.0363, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1434 => 0.1433, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.86% (0.0649 => 0.0687, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -14.43% (63.2438 => 54.1194, std.dev.: 0.0155) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 30.99% (14.1553 => 18.5415, std.dev.: 0.0221) SingleSource/Benchmarks/Misc-C++-EH/spirit: 58.39% (3.4629 => 5.4849, std.dev.: 0.0022) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14217.36% (0.0720 => 10.3085, std.dev.: 0.0131) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952200.00% (0.0001 => 9.9523, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 49.10% (10.3673 => 15.4579, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/08-main/main: 47.89% (0.2554 => 0.3777, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 30.76% (0.1622 => 0.2121, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/distray/distray: 30.21% (0.1056 => 0.1375, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 14.87% (0.1432 => 0.1645, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.84% (2.2022 => 2.5290, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.92% (7.0540 => 8.0359, std.dev.: 0.0024) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.79% (0.1566 => 0.1782, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.83% (1.7609 => 1.9692, std.dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 11.75% (10.4361 => 11.6619, std.dev.: 0.0097) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.66% (0.3543 => 0.3956, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.23% (0.3473 => 0.3863, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.98% (0.3561 => 0.3952, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-2: 10.92% (0.3497 => 0.3879, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.92% (0.3543 => 0.3930, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.92% (0.3516 => 0.3900, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.58% (0.3694 => 0.4085, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.48% (0.3828 => 0.4229, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.47% (0.3927 => 0.4338, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.42% (0.1584 => 0.1749, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.24% (0.3886 => 0.4284, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 10.12% (0.3282 => 0.3614, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 9.03% (0.1440 => 0.1570, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.57% (0.4879 => 0.5297, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.55% (0.1438 => 0.1561, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 8.52% (0.1655 => 0.1796, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 8.47% (9.4845 => 10.2877, std.dev.: 0.0131) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.40% (0.3177 => 0.3444, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.14% (0.2065 => 0.2233, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.13% (1.5415 => 1.6669, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/Hello: 8.10% (0.5925 => 0.6405, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.07% (0.6675 => 0.7214, std.dev.: 0.0121) SingleSource/UnitTests/ObjC++/property-reference-object: 8.04% (0.6030 => 0.6515, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 7.90% (0.7115 => 0.7677, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 7.85% (0.3109 => 0.3353, std.dev.: 0.0075) MultiSource/Applications/lambda-0_1_3/lambda: 7.78% (0.7433 => 0.8011, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.70% (0.1337 => 0.1440, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.70% (0.8172 => 0.8801, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.67% (0.4615 => 0.4969, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.62% (0.2271 => 0.2444, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 7.59% (5.7591 => 6.1963, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/em3d/em3d: 7.55% (0.1695 => 0.1823, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.48% (1.3050 => 1.4026, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.46% (0.8067 => 0.8669, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.45% (0.1625 => 0.1746, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.35% (0.5860 => 0.6291, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 7.34% (0.7326 => 0.7864, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 7.33% (0.3423 => 0.3674, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 7.31% (3.3354 => 3.5792, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.28% (4.2646 => 4.5752, std.dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.22% (0.1510 => 0.1619, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.17% (0.5105 => 0.5471, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.14% (0.2758 => 0.2955, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.11% (0.2700 => 0.2892, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.07% (0.9765 => 1.0455, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.06% (0.5569 => 0.5962, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.04% (8.1363 => 8.7089, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.03% (4.9449 => 5.2926, std.dev.: 0.0103) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.00% (5.0018 => 5.3521, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/lists: 6.98% (0.3422 => 0.3661, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.98% (0.2107 => 0.2254, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.95% (0.3121 => 0.3338, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.86% (0.4636 => 0.4954, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 6.83% (0.7835 => 0.8370, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.78% (0.2891 => 0.3087, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.71% (0.3232 => 0.3449, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 6.71% (0.2831 => 0.3021, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 6.71% (1.1642 => 1.2423, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 6.68% (0.2905 => 0.3099, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.65% (0.1940 => 0.2069, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.57% (0.4203 => 0.4479, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.55% (0.5020 => 0.5349, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.53% (0.3307 => 0.3523, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 6.52% (0.6456 => 0.6877, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.51% (0.3162 => 0.3368, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.51% (7.9617 => 8.4799, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.51% (0.3136 => 0.3340, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.49% (0.3650 => 0.3887, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.47% (2.0665 => 2.2003, std.dev.: 0.0025) MultiSource/Benchmarks/sim/sim: 6.44% (0.3387 => 0.3605, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 6.43% (0.1555 => 0.1655, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.42% (0.4048 => 0.4308, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.37% (0.4289 => 0.4562, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.36% (0.3865 => 0.4111, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.36% (0.3098 => 0.3295, std.dev.: 0.0049) MultiSource/Applications/hbd/hbd: 6.33% (1.5603 => 1.6591, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/wc: 6.29% (0.3052 => 0.3244, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.27% (0.2871 => 0.3051, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.27% (0.2872 => 0.3052, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.25% (0.3441 => 0.3656, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 6.24% (0.3283 => 0.3488, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.24% (0.2756 => 0.2928, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 6.22% (0.3603 => 0.3827, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 6.20% (0.2725 => 0.2894, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.17% (0.3826 => 0.4062, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 6.15% (0.2714 => 0.2881, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 6.10% (3.8723 => 4.1085, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.09% (0.2793 => 0.2963, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 6.03% (0.2802 => 0.2971, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 6.02% (0.4299 => 0.4558, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.00% (0.4620 => 0.4897, std.dev.: 0.0045) MultiSource/Applications/lemon/lemon: 5.99% (1.0722 => 1.1364, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/methcall: 5.94% (0.2877 => 0.3048, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.89% (0.3684 => 0.3901, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.87% (1.1861 => 1.2557, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.84% (0.2603 => 0.2755, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 5.83% (2.0273 => 2.1454, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/09-vor/vor: 5.79% (0.3180 => 0.3364, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.74% (0.3379 => 0.3573, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.65% (0.5981 => 0.6319, std.dev.: 0.0023) MultiSource/Applications/siod/siod: 5.59% (2.2969 => 2.4253, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.53% (0.6450 => 0.6807, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 5.50% (21.9371 => 23.1439, std.dev.: 0.0174) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.50% (0.1892 => 0.1996, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 5.47% (0.8921 => 0.9409, std.dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.94% (1.5859 => 1.6642, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.67% (1.4186 => 1.4849, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 4.66% (1.1840 => 1.2392, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.60% (0.4064 => 0.4251, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.41% (2.2024 => 2.2995, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/objinst: 4.28% (0.3131 => 0.3265, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.23% (1.2842 => 1.3385, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.00% (0.8101 => 0.8425, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.22% (0.3817 => 0.3940, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.05% (14.3668 => 14.8055, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.95% (0.3427 => 0.3528, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 2.43% (17.1811 => 17.5979, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.30% (1.1194 => 1.1451, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.03% (3.8922 => 3.9712, std.dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 10.16% (3.1595 => 3.4805, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 9.87% (1.1396 => 1.2521, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3692, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.46% (3.6395 => 3.7656, std.dev.: 0.0075) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.81% (4.2280 => 4.3466, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8131, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.27% (9.1159 => 9.2314, std.dev.: 0.0195) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1286, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.35% (0.8651 => 0.1700, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.30% (5.2763 => 3.2556, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.29% (5.3855 => 3.5925, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.90% (5.3526 => 3.5915, std.dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -14.84% (54.1659 => 46.1298, std.dev.: 0.0114) MultiSource/Benchmarks/FreeBench/mason/mason: -13.81% (0.0811 => 0.0699, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.19% (2.9384 => 2.6095, std.dev.: 0.0060) MultiSource/Applications/ClamAV/clamscan: -10.37% (22.1758 => 19.8768, std.dev.: 0.0290) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.42% (1.1492 => 0.7651, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -16.14% (1.6925 => 1.4194, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.53% (0.0998 => 0.0863, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -12.12% (1.2373 => 1.0874, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3783, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -9.86% (0.2161 => 0.1948, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.54% (19.9488 => 18.2444, std.dev.: 0.0330) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.69% (1.8329 => 1.7103, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0021) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.27% (1.6805 => 1.5920, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5079, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.87% (0.9957 => 0.9572, std.dev.: 0.0066) MultiSource/Applications/siod/siod: -3.65% (3.2827 => 3.1628, std.dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4976, std.dev.: 0.0063) MultiSource/Applications/hexxagon/hexxagon: -3.02% (12.4730 => 12.0961, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.74% (1.3677 => 1.3302, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Applications/sqlite3/sqlite3: -1.92% (4.6441 => 4.5551, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.91% (8.1563 => 8.0005, std.dev.: 0.0188) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.89% (8.6802 => 8.5158, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/salsa20: -1.82% (10.2830 => 10.0963, std.dev.: 0.0152) SingleSource/Benchmarks/Misc/flops: -1.69% (8.8334 => 8.6837, std.dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.54% (2.5528 => 2.5135, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4225, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8582, std.dev.: 0.0037) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.71% (0.5229 => 0.5789, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 7.15% (14.9895 => 16.0612, std.dev.: 0.0149) MultiSource/Benchmarks/MallocBench/gs/gs: 5.77% (4.1105 => 4.3476, std.dev.: 0.0104) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.87% (1.1048 => 1.2359, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.39% (7.1582 => 7.5443, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/stepanov_container: 17.10% (0.6222 => 0.7286, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36200.00% (0.0001 => 0.0363, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.53% (0.2116 => 0.0687, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 3 17:35:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 3 Oct 2012 19:35:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121004003516.0A8932A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4535?compare_to=4533&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4535, Order: 165175, Start Time: 2012-10-03 23:11:48, End Time: 2012-10-04 00:36:56 To: 4533, Order: 165150, Start Time: 2012-10-03 21:17:08, End Time: 2012-10-03 22:42:49 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (5 on baseline) Performance Regressions: 4 (180 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 5 (0 on baseline) Unchanged Tests: 1032 (682 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.09% (2.1674 => 2.1911, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 9.42% (0.3313 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.92% (12.7829 => 13.4117, std.dev.: 0.0252) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.87% (0.9543 => 0.9721, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.32% (43.9062 => 42.4465, std.dev.: 0.0525) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.68% (33.2756 => 33.5003, std.dev.: 0.0183) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.01% (2.7524 => 2.7522, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.00% (2.1153 => 2.1154, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.00% (4.9747 => 4.9745, std.dev.: 0.0002) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.62% (33.2944 => 33.5003, std.dev.: 0.0183) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: -100.00% (7.3305 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.18% (2.0176 => 2.4450, std.dev.: 0.0121) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.30% (0.1410 => 0.1654, std.dev.: 0.0032) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.02% (0.1072 => 0.1233, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 14.89% (0.0826 => 0.0949, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 14.36% (0.2243 => 0.2565, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.06% (0.0819 => 0.0926, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.23% (0.0834 => 0.0936, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 12.19% (0.5818 => 0.6527, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 11.95% (0.5748 => 0.6435, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 11.85% (0.1013 => 0.1133) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.75% (0.1413 => 0.1579, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash2: 11.58% (0.4328 => 0.4829, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 11.37% (0.4062 => 0.4524, std.dev.: 0.0018) SingleSource/Regression/C++/ofstream_ctor: 11.36% (0.2781 => 0.3097, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 11.32% (0.7061 => 0.7860, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.06% (0.2596 => 0.2883, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.02% (3.9660 => 4.4029, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.99% (0.7710 => 0.8557, std.dev.: 0.0021) MultiSource/Applications/hbd/hbd: 10.98% (1.3693 => 1.5196, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.96% (0.2782 => 0.3087, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.95% (0.3899 => 0.4326, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.89% (0.0964 => 0.1069, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.88% (0.2721 => 0.3017, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.85% (0.1327 => 0.1471, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 10.80% (0.7038 => 0.7798, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.75% (0.3022 => 0.3347, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 10.72% (0.2761 => 0.3057, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.71% (0.1588 => 0.1758, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.62% (0.3485 => 0.3855, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 10.59% (0.2607 => 0.2883, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.59% (0.2966 => 0.3280, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.53% (0.3580 => 0.3957, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 10.52% (0.2690 => 0.2973, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.51% (0.2655 => 0.2934, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.51% (1.9828 => 2.1911, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.48% (0.9199 => 1.0163, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.46% (0.3489 => 0.3854, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.43% (0.5265 => 0.5814, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.38% (1.2193 => 1.3459, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.38% (1.4563 => 1.6075, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.38% (0.2765 => 0.3052, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 10.36% (0.2760 => 0.3046, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 10.35% (0.2937 => 0.3241, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 10.35% (0.2628 => 0.2900, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 10.31% (0.2726 => 0.3007, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.27% (0.6959 => 0.7674, std.dev.: 0.0013) MultiSource/Applications/aha/aha: 10.26% (0.1062 => 0.1171, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.23% (0.4016 => 0.4427, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 10.23% (0.3293 => 0.3630, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.20% (0.3756 => 0.4139, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.14% (0.1075 => 0.1184, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.11% (0.1276 => 0.1405, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 10.07% (0.3107 => 0.3420, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.05% (0.2696 => 0.2967, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.03% (0.6283 => 0.6913, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 9.97% (0.3149 => 0.3463, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 9.95% (0.3868 => 0.4253, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.92% (0.1986 => 0.2183, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.84% (0.4390 => 0.4822, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 9.81% (13.8202 => 15.1754, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/matrix: 9.77% (0.2988 => 0.3280, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 9.76% (0.3453 => 0.3790, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.69% (1.1364 => 1.2465, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: 9.68% (0.3192 => 0.3501, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 9.54% (0.2945 => 0.3226, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/lists1: 9.51% (0.3534 => 0.3870, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.46% (0.3130 => 0.3426, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.33% (0.1157 => 0.1265, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 9.19% (0.1589 => 0.1735) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.18% (0.5577 => 0.6089, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.09% (0.2914 => 0.3179, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.09% (0.4379 => 0.4777, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.07% (0.2127 => 0.2320, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.93% (0.4791 => 0.5219, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 8.87% (1.0313 => 1.1228, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 8.86% (16.6129 => 18.0850, std.dev.: 0.0073) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.85% (0.1435 => 0.1562, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 8.83% (1.1061 => 1.2038, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.74% (0.6576 => 0.7151, std.dev.: 0.0023) MultiSource/Applications/sgefa/sgefa: 8.68% (0.2995 => 0.3255, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.66% (0.3246 => 0.3527, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.64% (0.3578 => 0.3887, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.59% (0.4003 => 0.4347, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.59% (0.7460 => 0.8101, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 8.54% (0.3663 => 0.3976, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-4: 8.53% (0.3646 => 0.3957, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.52% (0.5637 => 0.6117, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 8.51% (0.7506 => 0.8145, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.47% (0.3789 => 0.4110, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.45% (7.2180 => 7.8276, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.44% (0.3650 => 0.3958, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.43% (0.3914 => 0.4244, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.42% (0.3755 => 0.4071, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: 8.41% (0.3601 => 0.3904, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.38% (0.3940 => 0.4270, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 8.34% (0.2925 => 0.3169, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 8.32% (0.3220 => 0.3488, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.31% (0.1865 => 0.2020, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.28% (0.8698 => 0.9418, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.26% (0.2023 => 0.2190, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.25% (0.3623 => 0.3922, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 8.24% (3.8646 => 4.1830, std.dev.: 0.0079) MultiSource/Applications/minisat/minisat: 8.13% (0.6744 => 0.7292, std.dev.: 0.0014) MultiSource/Applications/viterbi/viterbi: 8.05% (0.1478 => 0.1597, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 8.03% (0.8310 => 0.8977, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 7.98% (3.1889 => 3.4435, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 7.94% (2.1791 => 2.3522, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 7.85% (0.1657 => 0.1787, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.83% (0.1789 => 0.1929, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 7.72% (1.9270 => 2.0758, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.52% (3.6692 => 3.9450, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.46% (1.3245 => 1.4233, std.dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 7.46% (1.0594 => 1.1384, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.29% (0.2140 => 0.2296, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 7.27% (0.4113 => 0.4412, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 7.20% (14.8535 => 15.9223, std.dev.: 0.0115) MultiSource/Benchmarks/sim/sim: 7.15% (0.3131 => 0.3355, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.14% (0.1569 => 0.1681, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.08% (4.3801 => 4.6900, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 7.06% (8.4961 => 9.0958, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.04% (0.6135 => 0.6567, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.04% (0.1819 => 0.1947, std.dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 7.02% (4.6629 => 4.9903, std.dev.: 0.0052) MultiSource/Applications/hexxagon/hexxagon: 6.99% (1.2292 => 1.3151, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.99% (4.4433 => 4.7538, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.99% (0.8818 => 0.9434, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 6.98% (1.2749 => 1.3639, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.58% (0.3511 => 0.3742, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.51% (1.1333 => 1.2071, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 6.50% (0.6250 => 0.6656, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.29% (3.2742 => 3.4800, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.15% (0.2504 => 0.2658, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.12% (0.2321 => 0.2463, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.09% (4.9865 => 5.2903, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.93% (0.4805 => 0.5090, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 5.76% (6.5754 => 6.9540, std.dev.: 0.0136) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.74% (6.2785 => 6.6390, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.67% (0.3245 => 0.3429, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.52% (1.5188 => 1.6026, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.46% (0.9108 => 0.9605, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 5.41% (3.7467 => 3.9493, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.84% (2.1007 => 2.2024, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.80% (13.2842 => 13.9214, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: 3.10% (16.2614 => 16.7655, std.dev.: 0.0295) MultiSource/Applications/ClamAV/clamscan: 2.78% (14.5298 => 14.9335, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.46% (5.7573 => 7.5111, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/fbench: 25.26% (1.8175 => 2.2766, std.dev.: 0.0199) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.06% (1.0895 => 1.3625, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 11.15% (1.1560 => 1.2849, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4139, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.00% (1.2998 => 1.3778, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.69% (0.2093 => 0.2212, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.65% (1.9144 => 2.0034, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7748, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6762, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 3.36% (1.9199 => 1.9845, std.dev.: 0.0010) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613) MultiSource/Applications/SPASS/SPASS: 2.90% (10.7476 => 11.0594, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.13% (7.4271 => 7.5850, std.dev.: 0.0072) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4539, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5133, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9688, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.26% (5.5130 => 5.5826, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1869, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0272) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.07% (8.8259 => 8.9205, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/lists: 1.02% (12.4560 => 12.5829, std.dev.: 0.0070) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.60% (0.2670 => 0.1399, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -15.70% (0.0707 => 0.0596, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -14.88% (0.4657 => 0.3964, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.06% (1.3813 => 1.1871, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.04% (1.3819 => 1.1879, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.13% (22.5627 => 21.6314, std.dev.: 0.0155) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.34% (0.0997 => 0.0864, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -11.97% (0.2238 => 0.1970, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.94% (1.2308 => 1.0962, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.16% (20.3410 => 18.2747, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.98% (1.3780 => 1.2956, std.dev.: 0.0086) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.05% (2.6470 => 2.5133, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.54% (1.7688 => 1.7061, std.dev.: 0.0013) MultiSource/Applications/siod/siod: -3.19% (3.2729 => 3.1686, std.dev.: 0.0187) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.75% (0.9996 => 0.9721, std.dev.: 0.0013) MultiSource/Applications/lua/lua: -2.54% (26.5159 => 25.8433, std.dev.: 0.0267) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.38% (3.0263 => 2.9542, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -2.37% (1.9762 => 1.9294, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.96% (0.6589 => 0.6460, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.71% (6.3560 => 6.2471, std.dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: -1.66% (28.2225 => 27.7534, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511) MultiSource/Applications/sqlite3/sqlite3: -1.47% (4.5928 => 4.5254, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0059, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -1.22% (3.9173 => 3.8696, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4953, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2571, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: -1.10% (9.3358 => 9.2332, std.dev.: 0.0387) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 3 18:39:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 3 Oct 2012 20:39:49 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121004013949.A2D322A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4536?compare_to=4530&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4536, Order: 165182, Start Time: 2012-10-04 00:12:49, End Time: 2012-10-04 01:41:31 To: 4530, Order: 165150, Start Time: 2012-10-03 20:24:19, End Time: 2012-10-03 21:54:31 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 5 (14 on baseline) Performance Regressions: 33 (76 on baseline) Performance Improvements: 7 (46 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 69 (65 on baseline) Unchanged Tests: 928 (765 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.42% (4.0304 => 4.1281, std.dev.: 0.0101) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.51% (40.6870 => 42.9271, std.dev.: 0.3052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.25% (59.6408 => 61.5790, std.dev.: 0.0798) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 0.31% (2.9291 => 2.9382, std.dev.: 0.0173) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -2.54% (2.3358 => 2.2765, std.dev.: 0.1080) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.68% (0.4185 => 0.4590, std.dev.: 0.0063) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.58% (0.1333 => 0.1434, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.99% (0.5725 => 0.5896, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.91% (0.8913 => 0.9172, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.80% (0.7917 => 0.8139, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.40% (0.7947 => 0.8138, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.95% (0.7957 => 0.8112, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.67% (1.3984 => 1.4217, std.dev.: 0.0079) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.56% (0.8800 => 0.8937, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.55% (1.1195 => 1.1369, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.21% (1.2847 => 1.3003, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.16% (1.1855 => 1.1993, std.dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 28.62% (3.7894 => 4.8740, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.45% (3.7914 => 4.8700, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 19.37% (8.1556 => 9.7356, std.dev.: 0.0321) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.21% (11.7779 => 14.0409, std.dev.: 0.3190) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 15.14% (8.4934 => 9.7791, std.dev.: 0.0121) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.11% (4.0368 => 4.5660, std.dev.: 0.0089) MultiSource/Benchmarks/FreeBench/neural/neural: 10.29% (0.9675 => 1.0671, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.63% (0.3250 => 0.3563, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 9.29% (5.8883 => 6.4352, std.dev.: 0.0166) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 8.40% (3.2675 => 3.5421, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 5.57% (1.5057 => 1.5896, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 5.47% (3.3378 => 3.5203, std.dev.: 0.0254) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.03% (0.7558 => 0.7938, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.40% (3.3558 => 3.5036, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 4.03% (11.5606 => 12.0263, std.dev.: 0.0474) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.95% (11.2969 => 11.7434, std.dev.: 0.0611) MultiSource/Benchmarks/Olden/bh/bh: 3.76% (2.3276 => 2.4152, std.dev.: 0.0173) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.18% (2.6752 => 2.7604, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/fp-convert: 2.88% (15.4481 => 15.8932, std.dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.99% (9.0536 => 9.2341, std.dev.: 0.0258) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.07% (1.8464 => 1.8662, std.dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -1.53% (6.6880 => 6.5855, std.dev.: 0.0396) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/sgefa/sgefa: -16.67% (0.4320 => 0.3600, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: -13.85% (1.6710 => 1.4395, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.53% (5.3726 => 5.0219, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -6.48% (5.3822 => 5.0335, std.dev.: 0.0228) MultiSource/Benchmarks/PAQ8p/paq8p: -6.46% (97.1180 => 90.8414, std.dev.: 0.1178) MultiSource/Benchmarks/mafft/pairlocalalign: -6.41% (63.8831 => 59.7854, std.dev.: 0.0898) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.03% (1.0129 => 1.0132, std.dev.: 0.0060) MultiSource/Applications/sqlite3/sqlite3: -0.74% (0.6198 => 0.6152, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/08-main/main: -2.45% (0.1757 => 0.1714, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.55% (0.1496 => 0.1564, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.58% (0.3100 => 0.3149, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.50% (0.2381 => 0.2393, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.24% (0.3150 => 0.3252, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.04% (0.2310 => 0.2334, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: -9.01% (0.0455 => 0.0414, std.dev.: 0.0020) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.94% (0.0212 => 0.0214, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -33.89% (0.0180 => 0.0119, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.80% (0.0389 => 0.0382, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 23.60% (0.0250 => 0.0309, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 25.65% (0.0230 => 0.0289, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -22.02% (0.0327 => 0.0255, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/casts: 2.20% (0.0182 => 0.0186, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 39.02% (0.0123 => 0.0171, std.dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: 1.61% (0.0249 => 0.0253, std.dev.: 0.0054) SingleSource/UnitTests/byval-alignment: 5.08% (0.0256 => 0.0269, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005) MultiSource/Applications/ClamAV/clamscan: -1.35% (0.1486 => 0.1466, std.dev.: 0.0089) MultiSource/Applications/JM/lencod/lencod: -0.78% (0.2301 => 0.2283, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 2.86% (1.4647 => 1.5066, std.dev.: 0.0264) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 2.57% (0.1479 => 0.1517, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/Bullet/bullet: 0.41% (0.5797 => 0.5821, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 0.56% (26.7739 => 26.9250, std.dev.: 0.0955) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.01% (0.4065 => 0.4106, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.40% (0.1359 => 0.1340, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.36% (0.0549 => 0.0547, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 54.49% (0.0167 => 0.0258, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.14% (0.0586 => 0.0663, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.38% (1.1295 => 1.1252, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 33.33% (0.0012 => 0.0016) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.94% (0.0567 => 0.0612, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 54.07% (0.0135 => 0.0208, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.25% (0.7666 => 0.7762, std.dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: 500.00% (0.0001 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 0.20% (1.7073 => 1.7107, std.dev.: 0.0027) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -70.25% (0.0121 => 0.0036, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Applications/JM/lencod/lencod: -96.62% (6.7458 => 0.2283, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -91.65% (6.9722 => 0.5821, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/09-vor/vor: 21666.37% (0.1237 => 26.9250, std.dev.: 0.0955) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005, std.dev.: 0.0000) New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 139.33% (0.0089 => 0.0213, std.dev.: 0.0004) SingleSource/UnitTests/2003-08-11-VaListArg: 174.44% (0.0090 => 0.0247, std.dev.: 0.0002) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -25.13% (4.1772 => 3.1276, std.dev.: 0.0555) SingleSource/Benchmarks/Shootout-C++/except: 83600.00% (0.0006 => 0.5022, std.dev.: 0.0009) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_rethrow: -50.00% (0.0006 => 0.0003, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 24.30% (0.0745 => 0.0926, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 8.80% (2.1763 => 2.3678, std.dev.: 0.0159) SingleSource/Benchmarks/Misc-C++/bigfib: 8.74% (0.5309 => 0.5773, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.55% (0.6410 => 0.6958, std.dev.: 0.0022) MultiSource/Applications/minisat/minisat: 7.73% (0.6173 => 0.6650, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.48% (0.3582 => 0.3850, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 7.10% (15.3105 => 16.3976, std.dev.: 0.1204) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.07% (0.1414 => 0.1514, std.dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: 6.77% (0.6915 => 0.7383, std.dev.: 0.0048) MultiSource/Applications/SIBsim4/SIBsim4: 6.76% (1.1653 => 1.2441, std.dev.: 0.0050) MultiSource/Applications/lemon/lemon: 6.69% (1.0046 => 1.0718, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.66% (0.2552 => 0.2722, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.19% (0.7639 => 0.8112, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.77% (0.6069 => 0.6419, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.47% (1.5150 => 1.5978, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.13% (0.3901 => 0.4101, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.83% (0.2797 => 0.2932, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 4.72% (0.3217 => 0.3369, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.70% (0.2662 => 0.2787, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.52% (0.4248 => 0.4440, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.29% (0.8569 => 0.8937, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.26% (0.2654 => 0.2767, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 4.13% (3.0225 => 3.1472, std.dev.: 0.0207) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.05% (0.3062 => 0.3186, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.87% (1.1827 => 1.2285, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.73% (0.4880 => 0.5062, std.dev.: 0.0022) MultiSource/Benchmarks/Bullet/bullet: 3.50% (29.3170 => 30.3422, std.dev.: 0.1279) MultiSource/Applications/siod/siod: 3.35% (2.0972 => 2.1674, std.dev.: 0.0204) MultiSource/Applications/oggenc/oggenc: 3.32% (4.7455 => 4.9029, std.dev.: 0.0107) MultiSource/Benchmarks/mafft/pairlocalalign: 3.28% (8.2186 => 8.4881, std.dev.: 0.0279) MultiSource/Applications/SPASS/SPASS: 3.24% (13.3238 => 13.7553, std.dev.: 0.1005) MultiSource/Applications/lua/lua: 3.13% (3.5980 => 3.7106, std.dev.: 0.0331) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.05% (12.6413 => 13.0274, std.dev.: 0.0400) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.98% (6.2546 => 6.4412, std.dev.: 0.0226) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (0.8405 => 0.8653, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.93% (1.2021 => 1.2373, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.75% (1.1672 => 1.1993, std.dev.: 0.0053) MultiSource/Applications/hbd/hbd: 2.74% (1.3268 => 1.3632, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.72% (0.5740 => 0.5896, std.dev.: 0.0031) MultiSource/Applications/Burg/burg: 2.48% (1.1440 => 1.1724, std.dev.: 0.0079) MultiSource/Benchmarks/nbench/nbench: 2.46% (1.0821 => 1.1087, std.dev.: 0.0054) MultiSource/Applications/JM/lencod/lencod: 2.36% (14.7256 => 15.0733, std.dev.: 0.0699) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.35% (1.0689 => 1.0940, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.05% (1.2742 => 1.3003, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.02% (1.3935 => 1.4217, std.dev.: 0.0079) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.89% (4.2616 => 4.3423, std.dev.: 0.0295) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.42% (4.2815 => 4.3424, std.dev.: 0.0107) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.38% (4.3380 => 4.3977, std.dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.60% (1.6538 => 2.3418, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 22.59% (3.4629 => 4.2450, std.dev.: 0.0173) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.80% (0.0766 => 0.0910, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/ary3: 14.70% (1.7426 => 1.9987, std.dev.: 0.0345) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.37% (2.4042 => 2.7498, std.dev.: 0.0312) SingleSource/Benchmarks/Stanford/Puzzle: 14.03% (0.1433 => 0.1634, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.86% (4.0101 => 4.5660, std.dev.: 0.0089) SingleSource/Benchmarks/McGill/queens: 11.67% (1.6261 => 1.8159, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.28% (0.2857 => 0.3122, std.dev.: 0.0083) MultiSource/Benchmarks/FreeBench/mason/mason: 9.15% (0.5004 => 0.5462, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/lists: 8.63% (7.0025 => 7.6068, std.dev.: 0.0593) MultiSource/Benchmarks/Olden/bisort/bisort: 8.47% (0.6459 => 0.7006, std.dev.: 0.0154) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.30% (0.8498 => 0.9203, std.dev.: 0.0210) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.94% (0.3301 => 0.3563, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.05% (40.4792 => 42.9271, std.dev.: 0.3052) SingleSource/Benchmarks/Misc/dt: 4.46% (0.9851 => 1.0290, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: 4.39% (15.2242 => 15.8932, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.32% (0.7609 => 0.7938, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.93% (3.4080 => 3.5421, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.56% (2.6656 => 2.7604, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.17% (0.5587 => 0.5764, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 3.09% (29.5232 => 30.4364, std.dev.: 0.1035) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.82% (6.6312 => 6.8184, std.dev.: 0.0098) MultiSource/Applications/siod/siod: 2.69% (3.5520 => 3.6477, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.53% (4.0659 => 4.1281, std.dev.: 0.0101) MultiSource/Benchmarks/Olden/power/power: 1.49% (1.4184 => 1.4395, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.33% (2.4455 => 2.4780, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/em3d/em3d: 1.13% (4.6414 => 4.6937, std.dev.: 0.0129) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -44.93% (0.2996 => 0.1650, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.33% (0.0591 => 0.0329, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -21.03% (1.4189 => 1.1205, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.44% (1.4113 => 1.1369, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.01% (0.3497 => 0.2098, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.40% (5.2665 => 4.0870, std.dev.: 0.1192) SingleSource/Benchmarks/Shootout-C++/ary3: -17.36% (1.7473 => 1.4439, std.dev.: 0.0711) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.21% (1.7361 => 1.4720, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout/sieve: -12.12% (8.1594 => 7.1708, std.dev.: 0.0384) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -11.31% (15.8312 => 14.0409, std.dev.: 0.3190) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.59% (1.1647 => 1.0530, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/moments: -9.07% (0.1114 => 0.1013, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2864, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: -8.21% (9.5474 => 8.7636, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.20% (3.2007 => 2.9382, std.dev.: 0.0173) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.71% (3.6254 => 3.3820, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/fibo: -6.43% (4.6355 => 4.3373, std.dev.: 0.0224) SingleSource/Benchmarks/Misc/richards_benchmark: -6.42% (1.4441 => 1.3514, std.dev.: 0.0104) MultiSource/Benchmarks/FreeBench/distray/distray: -6.27% (0.2664 => 0.2497, std.dev.: 0.0040) MultiSource/Applications/lambda-0_1_3/lambda: -6.25% (7.6833 => 7.2028, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.89% (2.9728 => 2.7977, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.44% (3.9413 => 3.7270, std.dev.: 0.0143) MultiSource/Applications/SIBsim4/SIBsim4: -5.26% (3.4230 => 3.2431, std.dev.: 0.0302) SingleSource/Benchmarks/Shootout/fib2: -5.09% (4.4195 => 4.1947, std.dev.: 0.0127) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.64% (0.4140 => 0.3948, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.58% (0.4564 => 0.4355, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -4.21% (62.4126 => 59.7854, std.dev.: 0.0898) MultiSource/Benchmarks/Olden/bh/bh: -4.03% (2.5166 => 2.4152, std.dev.: 0.0173) MultiSource/Applications/sgefa/sgefa: -3.90% (0.3746 => 0.3600, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -3.43% (9.2503 => 8.9329, std.dev.: 0.0264) SingleSource/Benchmarks/McGill/misr: -3.05% (0.4296 => 0.4165, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.60% (1.2722 => 1.2391, std.dev.: 0.0078) SingleSource/Benchmarks/Dhrystone/dry: -2.45% (2.4013 => 2.3424, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.42% (3.7496 => 3.6590, std.dev.: 0.0103) MultiSource/Benchmarks/FreeBench/neural/neural: -2.33% (1.0926 => 1.0671, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.30% (1.1683 => 1.1414, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: -2.05% (92.7467 => 90.8414, std.dev.: 0.1178) SingleSource/Benchmarks/Shootout-C++/hash2: -1.93% (3.4876 => 3.4202, std.dev.: 0.0089) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.85% (2.3569 => 2.3134, std.dev.: 0.0028) MultiSource/Benchmarks/sim/sim: -1.80% (3.8907 => 3.8205, std.dev.: 0.0111) MultiSource/Applications/aha/aha: -1.72% (3.4286 => 3.3695, std.dev.: 0.0184) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.61% (9.3855 => 9.2341, std.dev.: 0.0258) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.26% (27.1724 => 26.8302, std.dev.: 0.0280) SingleSource/Benchmarks/Dhrystone/fldry: -1.22% (2.4971 => 2.4667, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.08% (25.6658 => 25.3894, std.dev.: 0.0511) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.52% (0.9980 => 1.0132, std.dev.: 0.0060) MultiSource/Applications/sqlite3/sqlite3: 2.16% (0.6022 => 0.6152, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/08-main/main: 2.88% (0.1666 => 0.1714, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.64% (0.1554 => 0.1564, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.14% (0.3083 => 0.3149, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.04% (0.2394 => 0.2393, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.43% (0.3175 => 0.3252, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.39% (0.2302 => 0.2334, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: -7.80% (0.0449 => 0.0414, std.dev.: 0.0020) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -10.83% (0.0240 => 0.0214, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -38.02% (0.0192 => 0.0119, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.05% (0.0390 => 0.0382, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 2.66% (0.0301 => 0.0309, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.76% (0.0284 => 0.0289, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -21.30% (0.0324 => 0.0255, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/casts: 5.08% (0.0177 => 0.0186, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -9.52% (0.0189 => 0.0171, std.dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: 1.61% (0.0249 => 0.0253, std.dev.: 0.0054) SingleSource/UnitTests/byval-alignment: -17.23% (0.0325 => 0.0269, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005) MultiSource/Applications/ClamAV/clamscan: 2.59% (0.1429 => 0.1466, std.dev.: 0.0089) MultiSource/Applications/lemon/lemon: 0.31% (1.5019 => 1.5066, std.dev.: 0.0264) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 1.07% (0.1501 => 0.1517, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.71% (0.4264 => 0.4106, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.30% (0.1344 => 0.1340, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.13% (0.0589 => 0.0547, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 11.21% (0.0232 => 0.0258, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.76% (0.0639 => 0.0663, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.86% (1.1350 => 1.1252, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 166.67% (0.0006 => 0.0016) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.92% (0.0637 => 0.0612, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -15.45% (0.0246 => 0.0208, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 2.93% (0.7541 => 0.7762, std.dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 11.35% (1.5363 => 1.7107, std.dev.: 0.0027) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -48.57% (0.0070 => 0.0036, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 3 18:52:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 3 Oct 2012 20:52:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121004015209.11EBB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4537?compare_to=4534&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4537, Order: 165185, Start Time: 2012-10-04 00:34:12, End Time: 2012-10-04 01:53:47 To: 4534, Order: 165173, Start Time: 2012-10-03 22:45:26, End Time: 2012-10-04 00:04:59 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (152 on baseline) Performance Improvements: 0 (44 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 951 (691 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.72% (78.8868 => 81.0347, std.dev.: 0.2452) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.37% (55.2907 => 56.6014, std.dev.: 0.0268) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.02% (0.5789 => 0.5788, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 0.02% (16.0612 => 16.0646, std.dev.: 0.0146) MultiSource/Benchmarks/Bullet/bullet: 0.05% (54.1194 => 54.1453, std.dev.: 0.0078) MultiSource/Benchmarks/MallocBench/gs/gs: -0.06% (4.3476 => 4.3450, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0467 => 0.0467) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0469 => 0.0469) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.23% (0.0437 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.23% (0.0437 => 0.0438) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.23% (0.0426 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0427 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.24% (0.0418 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.24% (0.0420 => 0.0421) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.23% (0.0438 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0439 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.23% (0.0432 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.23% (0.0434 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.24% (0.0422 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0423 => 0.0423) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0429 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.23% (0.0431 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.23% (0.0441 => 0.0440, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.23% (0.0443 => 0.0442, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.24% (0.0416 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.48% (0.0419 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.23% (0.0429 => 0.0428, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.23% (0.0431 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.24% (0.0420 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0422 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0412 => 0.0412, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0413 => 0.0413, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0410 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.24% (0.0413 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0449 => 0.0449) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0450 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0410 => 0.0410) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0411 => 0.0411) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0411 => 0.0411) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.24% (0.0411 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0419 => 0.0419, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0420 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.18% (1.2359 => 1.2381, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.05% (7.5443 => 7.5408, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.7286 => 0.7286, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.28% (0.0363 => 0.0362, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.73% (0.0687 => 0.0692, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -14.39% (63.2438 => 54.1453, std.dev.: 0.0078) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 31.03% (14.1553 => 18.5483, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++-EH/spirit: 58.25% (3.4629 => 5.4799, std.dev.: 0.0011) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14223.06% (0.0720 => 10.3126, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952100.00% (0.0001 => 9.9522, std.dev.: 0.0013) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 49.15% (10.3673 => 15.4628, std.dev.: 0.0094) MultiSource/Benchmarks/McCat/08-main/main: 47.89% (0.2554 => 0.3777, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 30.52% (0.1622 => 0.2117, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 30.40% (0.1056 => 0.1377, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 14.80% (0.1432 => 0.1644, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.75% (2.2022 => 2.5270, std.dev.: 0.0032) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.18% (0.1566 => 0.1788, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.07% (7.0540 => 8.0467, std.dev.: 0.0112) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.47% (0.0834 => 0.0938, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 11.89% (10.4361 => 11.6773, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.82% (1.7609 => 1.9690, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.57% (0.3543 => 0.3953, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.14% (0.3473 => 0.3860, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.98% (0.3516 => 0.3902, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.92% (0.3497 => 0.3879, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.87% (0.3561 => 0.3948, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.87% (0.3543 => 0.3928, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 10.56% (0.3694 => 0.4084, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.40% (0.3828 => 0.4226, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 10.39% (0.3927 => 0.4335, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.35% (0.1584 => 0.1748, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 10.34% (0.3886 => 0.4288, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 10.15% (0.3282 => 0.3615, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 9.10% (0.1440 => 0.1571, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.65% (0.4879 => 0.5301, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.55% (0.1438 => 0.1561, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 8.54% (9.4845 => 10.2946, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/chomp: 8.52% (0.1655 => 0.1796, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.44% (0.3177 => 0.3445, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.19% (1.5415 => 1.6678, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.15% (0.6675 => 0.7219, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.13% (0.6030 => 0.6520, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.12% (0.5925 => 0.6406, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 8.04% (0.3109 => 0.3359, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 8.01% (0.7115 => 0.7685, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 7.91% (0.7433 => 0.8021, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.85% (0.1337 => 0.1442, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.2065 => 0.2227, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.69% (0.4615 => 0.4970, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.66% (0.2271 => 0.2445, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 7.65% (5.7591 => 6.1997, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.64% (0.8172 => 0.8796, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.63% (0.1625 => 0.1749, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.53% (0.5860 => 0.6301, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.48% (1.3050 => 1.4026, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 7.42% (0.3423 => 0.3677, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.42% (0.1510 => 0.1622, std.dev.: 0.0019) MultiSource/Applications/d/make_dparser: 7.38% (3.3354 => 3.5815, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.36% (4.2646 => 4.5783, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 7.30% (0.7326 => 0.7861, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.30% (0.8067 => 0.8656, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.25% (0.5105 => 0.5475, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.16% (0.5569 => 0.5968, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.13% (8.1363 => 8.7168, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.12% (4.9449 => 5.2970, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.07% (0.2700 => 0.2891, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.07% (0.2758 => 0.2953, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.03% (0.9765 => 1.0451, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.02% (0.3121 => 0.3340, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.99% (5.0018 => 5.3516, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.98% (0.2107 => 0.2254, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 6.93% (0.3422 => 0.3659, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 6.83% (0.4289 => 0.4582, std.dev.: 0.0038) MultiSource/Applications/spiff/spiff: 6.79% (0.7835 => 0.8367, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.75% (0.2891 => 0.3086, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.65% (0.4103 => 0.4376, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.57% (0.2831 => 0.3017, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 6.56% (1.1642 => 1.2406, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/ary: 6.56% (0.3232 => 0.3444, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.55% (0.1940 => 0.2067, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.53% (0.5020 => 0.5348, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.53% (7.9617 => 8.4818, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/bigfib: 6.51% (0.6456 => 0.6876, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 6.47% (0.3387 => 0.3606, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.45% (0.3162 => 0.3366, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.44% (0.2905 => 0.3092, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 6.43% (0.1555 => 0.1655, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.41% (0.3307 => 0.3519, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.41% (0.3136 => 0.3337, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.41% (0.2871 => 0.3055, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.40% (0.4203 => 0.4472, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.38% (0.3650 => 0.3883, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 6.36% (1.5603 => 1.6596, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/moments: 6.27% (0.4048 => 0.4302, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.26% (0.3865 => 0.4107, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.23% (0.2872 => 0.3051, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.23% (0.3098 => 0.3291, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.22% (0.3441 => 0.3655, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.20% (0.2756 => 0.2927, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 6.20% (0.2725 => 0.2894, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.19% (2.0665 => 2.1945, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wc: 6.19% (0.3052 => 0.3241, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 6.18% (3.8723 => 4.1118, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary3: 6.15% (0.3283 => 0.3485, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.10% (0.4636 => 0.4919, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: 6.10% (0.4620 => 0.4902, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.09% (0.3826 => 0.4059, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 6.03% (1.0722 => 1.1369, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 6.00% (0.3603 => 0.3819, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.99% (0.2603 => 0.2759, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 5.98% (0.4299 => 0.4556, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.95% (1.1861 => 1.2567, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.94% (0.2793 => 0.2959, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.93% (0.2714 => 0.2875, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/random: 5.89% (0.2802 => 0.2967, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.87% (0.2877 => 0.3046, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 5.85% (0.3180 => 0.3366, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 5.84% (0.3684 => 0.3899, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.81% (0.1892 => 0.2002, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 5.79% (2.0273 => 2.1447, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/ary2: 5.65% (0.3379 => 0.3570, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.65% (0.5981 => 0.6319, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 5.54% (21.9371 => 23.1521, std.dev.: 0.0194) MultiSource/Benchmarks/Prolangs-C/football/football: 5.54% (0.8921 => 0.9415, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.43% (0.6450 => 0.6800, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 5.42% (2.2969 => 2.4214, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.25% (0.1906 => 0.2006, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.03% (1.5859 => 1.6656, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.80% (1.4186 => 1.4867, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.69% (1.1840 => 1.2395, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.65% (0.4064 => 0.4253, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.44% (2.2024 => 2.3002, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.41% (0.2266 => 0.2366, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.28% (0.3131 => 0.3265, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.17% (1.2842 => 1.3377, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.00% (0.8101 => 0.8425, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.27% (0.3817 => 0.3942, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.03% (0.3427 => 0.3531, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.98% (14.3668 => 14.7956, std.dev.: 0.0081) MultiSource/Applications/sqlite3/sqlite3: 2.59% (17.1811 => 17.6260, std.dev.: 0.0122) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.28% (1.1194 => 1.1449, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.12% (3.8922 => 3.9747, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 10.16% (3.1595 => 3.4805, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 9.72% (1.1396 => 1.2504, std.dev.: 0.0017) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.1578 => 3.3687, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.65% (0.3463 => 0.3624, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 3.68% (0.5413 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.39% (3.6395 => 3.7629, std.dev.: 0.0058) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.87% (4.2280 => 4.3495, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8131, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1287, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -80.34% (0.8651 => 0.1701, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.28% (5.2763 => 3.2566, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.17% (5.3855 => 3.5992, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.87% (5.3526 => 3.5930, std.dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -14.89% (54.1659 => 46.0990, std.dev.: 0.0205) MultiSource/Benchmarks/FreeBench/mason/mason: -13.93% (0.0811 => 0.0698, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.18% (2.9384 => 2.6099, std.dev.: 0.0036) MultiSource/Applications/ClamAV/clamscan: -10.27% (22.1758 => 19.8980, std.dev.: 0.0078) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7652, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: -15.96% (1.6925 => 1.4224, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.73% (0.0998 => 0.0861, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.51% (1.2373 => 1.0949, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: -10.30% (1.5373 => 1.3789, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/mason/mason: -10.09% (0.2161 => 0.1943, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.24% (19.9488 => 18.3060, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.76% (1.8329 => 1.7090, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.30% (1.6805 => 1.5915, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5066, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0008) MultiSource/Applications/siod/siod: -3.75% (3.2827 => 3.1596, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.21% (0.9957 => 0.9637, std.dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5066, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: -2.99% (12.4730 => 12.1003, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.69% (1.3677 => 1.3309, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.24% (8.6802 => 8.4859, std.dev.: 0.0181) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.08% (0.4808 => 0.4708, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.07% (8.1563 => 7.9875, std.dev.: 0.0242) MultiSource/Applications/sqlite3/sqlite3: -1.93% (4.6441 => 4.5543, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0860, std.dev.: 0.0115) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6800, std.dev.: 0.0022) SingleSource/UnitTests/Vector/multiplies: -1.51% (2.5528 => 2.5142, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4209, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.08% (6.2999 => 6.2320, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8571, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.69% (0.5229 => 0.5788, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 7.17% (14.9895 => 16.0646, std.dev.: 0.0146) MultiSource/Benchmarks/MallocBench/gs/gs: 5.70% (4.1105 => 4.3450, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.07% (1.1048 => 1.2381, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.34% (7.1582 => 7.5408, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 17.10% (0.6222 => 0.7286, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36100.00% (0.0001 => 0.0362, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.30% (0.2116 => 0.0692, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 3 18:59:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 3 Oct 2012 20:59:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121004015949.BE9712A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4538?compare_to=4532&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4538, Order: 165173, Start Time: 2012-10-03 22:51:25, End Time: 2012-10-04 02:01:29 To: 4532, Order: 165138, Start Time: 2012-10-03 19:13:16, End Time: 2012-10-03 22:22:12 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 11 (136 on baseline) Performance Improvements: 4 (17 on baseline) Added Tests: 0 (131 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1024 (755 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.21% (2.9219 => 2.9572, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.10% (2.0630 => 2.0856, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.01% (3.8233 => 3.8621, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 21.49% (61.6834 => 74.9409, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 10.70% (106.9361 => 118.3802, std.dev.: 0.0718) MultiSource/Applications/sgefa/sgefa: 10.12% (1.4115 => 1.5543, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 3.62% (21.2440 => 22.0123, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.06% (13.9730 => 14.4010, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/power/power: 2.25% (3.1703 => 3.2417, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.01% (52.9108 => 53.9751, std.dev.: 0.3880) SingleSource/Benchmarks/Misc/whetstone: 1.09% (2.7933 => 2.8238, std.dev.: 0.0104) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -3.65% (15.2927 => 14.7347, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.29% (15.3911 => 14.8847, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.25% (41.3809 => 40.8631, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.12% (7.0374 => 6.9583, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.03% (9.8115 => 9.8144, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.01% (9.4096 => 9.4088, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.12% (16.9266 => 16.9462, std.dev.: 0.0125) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 12.58% (0.3465 => 0.3901, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 12.56% (0.3496 => 0.3935, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-2: 12.48% (0.3446 => 0.3876, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.44% (0.3488 => 0.3922, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.43% (0.3442 => 0.3870, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.43% (0.3460 => 0.3890, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.34% (0.3469 => 0.3897, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.23% (0.1063 => 0.1193, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.16% (0.3650 => 0.4094, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 12.02% (0.3643 => 0.4081, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.82% (0.3724 => 0.4164, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 11.52% (1.5932 => 1.7768, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 10.54% (0.5826 => 0.6440, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 10.44% (0.5889 => 0.6504, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.30% (0.1107 => 0.1210, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 9.21% (0.4994 => 0.5454, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: 9.14% (0.1619 => 0.1767, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.11% (0.2875 => 0.3137, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 8.95% (0.1218 => 0.1327, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.94% (1.3152 => 1.4328, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 8.88% (0.7171 => 0.7808, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.86% (0.3195 => 0.3478, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 8.85% (0.3004 => 0.3270, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 8.84% (0.2725 => 0.2966, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 8.81% (0.2714 => 0.2953, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 8.80% (0.2750 => 0.2992, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/objinst: 8.75% (0.2823 => 0.3070, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.72% (0.2729 => 0.2967, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.66% (0.2738 => 0.2975, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.65% (2.0673 => 2.2461, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: 8.64% (0.2813 => 0.3056, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.60% (0.2792 => 0.3032, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 8.59% (0.3096 => 0.3362, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 8.53% (0.2803 => 0.3042, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 8.49% (0.2780 => 0.3016, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.49% (0.2911 => 0.3158, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.41% (1.6211 => 1.7575, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.40% (3.5627 => 3.8621, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.40% (0.1620 => 0.1756, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 8.39% (0.9909 => 1.0740, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/except: 8.36% (0.2811 => 0.3046, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.35% (2.7292 => 2.9572, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.30% (0.3060 => 0.3314, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 8.26% (0.3267 => 0.3537, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.21% (0.4361 => 0.4719, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 8.16% (0.3258 => 0.3524, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.12% (0.5000 => 0.5406, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 8.11% (0.3317 => 0.3586, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.00% (0.3362 => 0.3631, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash: 7.98% (0.4146 => 0.4477, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.97% (0.3124 => 0.3373, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.97% (0.2736 => 0.2954, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 7.88% (0.3678 => 0.3968, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.83% (0.3625 => 0.3909, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.83% (0.3282 => 0.3539, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.83% (0.4139 => 0.4463, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 7.80% (0.3348 => 0.3609, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.75% (0.2014 => 0.2170, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.71% (0.2866 => 0.3087, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: 7.65% (0.3726 => 0.4011, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 7.60% (0.1421 => 0.1529, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 7.58% (5.5417 => 5.9620, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/lists1: 7.56% (0.3477 => 0.3740, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 7.54% (1.0781 => 1.1594, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.53% (0.3930 => 0.4226, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash2: 7.46% (0.4251 => 0.4568, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.37% (0.3690 => 0.3962, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.36% (0.1549 => 0.1663, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 7.35% (23.5202 => 25.2499, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.34% (0.5026 => 0.5395, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.28% (0.3845 => 0.4125, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.21% (0.3981 => 0.4268, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 6.92% (2.1013 => 2.2468, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 6.90% (4.2109 => 4.5013, std.dev.: 0.0089) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.85% (0.5900 => 0.6304, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.81% (0.1968 => 0.2102, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 6.80% (0.4029 => 0.4303, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 6.78% (0.1505 => 0.1607, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 6.74% (0.5012 => 0.5350, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 6.74% (0.2566 => 0.2739, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.68% (0.3890 => 0.4150, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 6.68% (1.8794 => 2.0050, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.64% (0.3903 => 0.4162, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.61% (0.4658 => 0.4966, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.49% (4.4195 => 4.7063, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.46% (0.6435 => 0.6851, std.dev.: 0.0018) MultiSource/Applications/hbd/hbd: 6.45% (0.9697 => 1.0322, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.40% (0.2969 => 0.3159, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 6.39% (0.6634 => 0.7058, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.36% (0.2737 => 0.2911, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 6.31% (1.4269 => 1.5169, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.29% (0.2068 => 0.2198, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 6.24% (2.1653 => 2.3004, std.dev.: 0.0050) MultiSource/Applications/JM/lencod/lencod: 6.17% (4.6177 => 4.9026, std.dev.: 0.0087) MultiSource/Applications/Burg/burg: 6.09% (0.5546 => 0.5884, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.05% (0.3271 => 0.3469, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.03% (0.3084 => 0.3270, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 6.00% (0.3336 => 0.3536, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.93% (0.2040 => 0.2161, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.90% (1.9694 => 2.0856, std.dev.: 0.0029) MultiSource/Applications/treecc/treecc: 5.63% (0.7875 => 0.8318, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.55% (1.9966 => 2.1075, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 5.54% (0.2075 => 0.2190, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.52% (0.2103 => 0.2219, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 5.02% (0.2691 => 0.2826, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 4.99% (2.0346 => 2.1362, std.dev.: 0.0026) MultiSource/Benchmarks/PAQ8p/paq8p: 4.93% (0.4847 => 0.5086, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 4.56% (0.2391 => 0.2500, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.24% (0.7426 => 0.7741, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.07% (0.4253 => 0.4426, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.89% (0.5584 => 0.5801, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.70% (11.6398 => 12.0704, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.58% (4.6926 => 4.8604, std.dev.: 0.0117) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.32% (0.3792 => 0.3918, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 2.91% (11.9555 => 12.3039, std.dev.: 0.0127) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.26% (0.0734 => 0.0868, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 17.55% (2.5769 => 3.0292, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6109, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (12.0509 => 12.6786, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-2: 4.83% (1.8057 => 1.8929, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1673, std.dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/dry: 4.27% (14.0481 => 14.6484, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.41% (79.9355 => 82.6575, std.dev.: 0.0231) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2071, std.dev.: 0.0028) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5077, std.dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2220, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.37% (7.1849 => 7.2836, std.dev.: 0.0035) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5138, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5850, std.dev.: 0.0157) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.80% (25.4195 => 16.5728, std.dev.: 0.0207) SingleSource/Benchmarks/Shootout-C++/ary2: -8.95% (0.2402 => 0.2187, std.dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9775, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8010, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7983, std.dev.: 0.0094) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.05% (0.6293 => 0.6101, std.dev.: 0.0054) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7728, std.dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: -2.97% (17.2379 => 16.7258, std.dev.: 0.0472) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8631, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5759, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4953, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.18% (105.3826 => 104.1350, std.dev.: 0.0332) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0468, std.dev.: 0.0019) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 3 19:29:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 3 Oct 2012 21:29:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121004022921.C6C052A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4539?compare_to=4535&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4539, Order: 165188, Start Time: 2012-10-04 01:05:48, End Time: 2012-10-04 02:30:59 To: 4535, Order: 165175, Start Time: 2012-10-03 23:11:48, End Time: 2012-10-04 00:36:56 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (5 on baseline) Performance Regressions: 1 (180 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 5 (0 on baseline) Unchanged Tests: 1035 (682 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.48% (79.2967 => 81.2633, std.dev.: 0.0846) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -1.12% (2.2766 => 2.2512, std.dev.: 0.0029) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.02% (33.5003 => 33.5069, std.dev.: 0.0149) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.00% (2.7522 => 2.7523, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (2.1154 => 2.1154, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.01% (4.9745 => 4.9748, std.dev.: 0.0018) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.64% (33.2944 => 33.5069, std.dev.: 0.0149) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: -100.00% (7.3305 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.22% (2.0176 => 2.4457, std.dev.: 0.0150) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.09% (0.1410 => 0.1651, std.dev.: 0.0009) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.02% (0.1072 => 0.1233, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 14.89% (0.0826 => 0.0949, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 14.44% (0.2243 => 0.2567, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.82% (0.0819 => 0.0924, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 12.20% (0.5818 => 0.6528, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.11% (0.0834 => 0.0935, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 11.95% (0.5748 => 0.6435, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/tsp/tsp: 11.75% (0.1013 => 0.1132, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.61% (0.1413 => 0.1577, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 11.51% (0.4328 => 0.4826, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 11.40% (0.4062 => 0.4525, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference: 11.39% (0.7061 => 0.7865, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 11.33% (0.2781 => 0.3096, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.13% (0.3899 => 0.4333, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.08% (0.7710 => 0.8564, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.04% (0.2782 => 0.3089, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.01% (3.9660 => 4.4026, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.00% (0.0964 => 0.1070, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 10.99% (1.3693 => 1.5198, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.99% (0.2721 => 0.3020, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.93% (0.1327 => 0.1472, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 10.90% (0.7038 => 0.7805, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.86% (0.2596 => 0.2878, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.77% (0.1588 => 0.1759, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.69% (0.2966 => 0.3283, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 10.65% (0.2761 => 0.3055, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 10.63% (0.2690 => 0.2976, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.62% (0.3485 => 0.3855, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.61% (0.3580 => 0.3960, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.59% (0.3022 => 0.3342, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.57% (0.9199 => 1.0171, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 10.55% (0.2607 => 0.2882, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.55% (0.3489 => 0.3857, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.48% (0.6959 => 0.7688, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.47% (0.2655 => 0.2933, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.43% (0.5265 => 0.5814, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 10.43% (0.2628 => 0.2902, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 10.40% (0.2760 => 0.3047, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.38% (1.9828 => 2.1887, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 10.38% (0.2726 => 0.3009, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.36% (0.4016 => 0.4432, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.33% (0.1075 => 0.1186, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wc: 10.32% (0.2937 => 0.3240, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.31% (0.2765 => 0.3050, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.30% (1.2193 => 1.3449, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.28% (1.4563 => 1.6060, std.dev.: 0.0026) MultiSource/Applications/aha/aha: 10.26% (0.1062 => 0.1171, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 10.20% (0.3293 => 0.3629, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.12% (0.3756 => 0.4136, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.11% (0.1276 => 0.1405, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 10.11% (0.3107 => 0.3421, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.09% (0.2696 => 0.2968, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.04% (0.6283 => 0.6914, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 10.01% (0.3868 => 0.4255, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.00% (0.4390 => 0.4829, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.97% (0.1986 => 0.2184, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 9.94% (0.3149 => 0.3462, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 9.88% (13.8202 => 15.1858, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/matrix: 9.81% (0.2988 => 0.3281, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 9.73% (0.3453 => 0.3789, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 9.65% (0.3192 => 0.3500, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.63% (1.1364 => 1.2458, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.46% (0.3130 => 0.3426, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 9.42% (0.3534 => 0.3867, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 9.27% (0.2945 => 0.3218, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.18% (0.5577 => 0.6089, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.16% (0.1157 => 0.1263, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.13% (0.1435 => 0.1566, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.13% (0.2914 => 0.3180, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 9.13% (0.1589 => 0.1734, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.12% (0.2127 => 0.2321, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.09% (0.4379 => 0.4777, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 8.89% (0.7506 => 0.8173, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.85% (0.4791 => 0.5215, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 8.84% (1.1061 => 1.2039, std.dev.: 0.0045) MultiSource/Applications/kimwitu++/kc: 8.82% (16.6129 => 18.0785, std.dev.: 0.0209) MultiSource/Applications/lemon/lemon: 8.81% (1.0313 => 1.1222) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.81% (0.7460 => 0.8117, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.77% (0.6576 => 0.7153, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/parameter-passing: 8.69% (0.4003 => 0.4351, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 8.68% (0.2995 => 0.3255, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.66% (0.3578 => 0.3888, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.66% (0.3246 => 0.3527, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.59% (0.5637 => 0.6121, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.53% (0.3646 => 0.3957, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.52% (0.3789 => 0.4112, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.49% (7.2180 => 7.8306, std.dev.: 0.0090) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.47% (0.3650 => 0.3959, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.44% (0.3755 => 0.4072, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 8.43% (0.3914 => 0.4244, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.41% (0.3601 => 0.3904, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.41% (0.3663 => 0.3971, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.40% (0.3940 => 0.4271, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.36% (0.1865 => 0.2021, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.35% (0.8698 => 0.9424, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 8.34% (0.2925 => 0.3169, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 8.29% (3.8646 => 4.1849, std.dev.: 0.0161) SingleSource/UnitTests/ObjC/exceptions-3: 8.28% (0.3623 => 0.3923, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 8.24% (0.6744 => 0.7300, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 8.23% (0.3220 => 0.3485, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.21% (0.2023 => 0.2189, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 8.19% (0.1478 => 0.1599, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 8.03% (2.1791 => 2.3541, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 7.98% (0.8310 => 0.8973, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 7.96% (3.1889 => 3.4428, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/em3d/em3d: 7.91% (0.1657 => 0.1788, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.83% (0.1789 => 0.1929, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 7.76% (1.9270 => 2.0766, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 7.71% (1.0594 => 1.1411, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.41% (1.3245 => 1.4227, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.36% (3.6692 => 3.9391, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/05-eks/eks: 7.29% (0.4113 => 0.4413, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.20% (0.1569 => 0.1682, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.20% (0.2140 => 0.2294, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 7.17% (14.8535 => 15.9180, std.dev.: 0.0117) MultiSource/Benchmarks/sim/sim: 7.15% (0.3131 => 0.3355, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.12% (0.6135 => 0.6572, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.11% (4.3801 => 4.6915, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 7.06% (1.2292 => 1.3160, std.dev.: 0.0117) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.04% (0.1819 => 0.1947, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.02% (4.4433 => 4.7552, std.dev.: 0.0046) MultiSource/Applications/oggenc/oggenc: 7.00% (4.6629 => 4.9895, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 7.00% (1.2749 => 1.3641, std.dev.: 0.0135) MultiSource/Benchmarks/mafft/pairlocalalign: 6.99% (8.4961 => 9.0897, std.dev.: 0.0189) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.95% (0.8818 => 0.9431, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 6.61% (0.6250 => 0.6663, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.52% (1.1333 => 1.2072, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.47% (0.3511 => 0.3738, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.23% (3.2742 => 3.4782, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.12% (4.9865 => 5.2918, std.dev.: 0.0157) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.11% (0.2504 => 0.2657, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.99% (0.4805 => 0.5093, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.99% (0.2321 => 0.2460, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.74% (6.5754 => 6.9529, std.dev.: 0.0179) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.69% (6.2785 => 6.6360, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.67% (0.3245 => 0.3429, std.dev.: 0.0024) MultiSource/Applications/lua/lua: 5.46% (3.7467 => 3.9514, std.dev.: 0.0122) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.42% (0.9108 => 0.9602, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.42% (1.5188 => 1.6011, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.82% (13.2842 => 13.9250, std.dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.73% (2.1007 => 2.2001, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 3.14% (16.2614 => 16.7718, std.dev.: 0.0182) MultiSource/Applications/ClamAV/clamscan: 2.74% (14.5298 => 14.9286, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5135, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628) SingleSource/Benchmarks/Misc/fbench: 23.86% (1.8175 => 2.2512, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/richards_benchmark: 10.95% (1.1560 => 1.2826, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4141, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.09% (1.2998 => 1.3789, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.69% (0.2093 => 0.2212, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0044, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.67% (11.2619 => 11.6753, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 3.46% (1.9199 => 1.9863, std.dev.: 0.0013) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.88% (10.7476 => 11.0570, std.dev.: 0.0168) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.18% (7.4271 => 7.5889, std.dev.: 0.0031) MultiSource/Applications/lemon/lemon: 1.80% (1.4298 => 1.4556, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5135, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2068, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.29% (5.5130 => 5.5841, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1866, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0272, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.03% (12.4560 => 12.5838, std.dev.: 0.0088) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.60% (0.2670 => 0.1399, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -15.70% (0.0707 => 0.0596, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -14.90% (0.4657 => 0.3963, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.07% (1.3813 => 1.1869, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.96% (1.3819 => 1.1890, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.11% (22.5627 => 21.6358, std.dev.: 0.0126) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/mason/mason: -12.11% (0.2238 => 0.1967, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -11.06% (1.2308 => 1.0947, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.03% (20.3410 => 18.3009, std.dev.: 0.0232) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.38% (1.3780 => 1.3038, std.dev.: 0.0085) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0050) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5138, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.72% (0.9996 => 0.9524, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1561, std.dev.: 0.0059) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.51% (1.7688 => 1.7068, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.02% (0.4867 => 0.4720, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.57% (26.5159 => 25.8357, std.dev.: 0.0186) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.47% (3.0263 => 2.9517, std.dev.: 0.0013) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.35% (1.9762 => 1.9298, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.00% (0.6589 => 0.6457, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.73% (6.3560 => 6.2460, std.dev.: 0.0080) MultiSource/Benchmarks/mafft/pairlocalalign: -1.66% (28.2225 => 27.7531, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: -1.47% (4.5928 => 4.5255, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0070, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4950, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: -1.19% (9.3358 => 9.2243, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/heapsort: -1.17% (3.9173 => 3.8714, std.dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2582, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 3 20:25:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 3 Oct 2012 22:25:10 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121004032510.5574B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4540?compare_to=4536&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4540, Order: 165190, Start Time: 2012-10-04 01:58:07, End Time: 2012-10-04 03:26:52 To: 4536, Order: 165182, Start Time: 2012-10-04 00:12:49, End Time: 2012-10-04 01:41:31 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (14 on baseline) Performance Regressions: 7 (72 on baseline) Performance Improvements: 8 (45 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 69 (65 on baseline) Unchanged Tests: 958 (770 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: 7.51% (0.1517 => 0.1631, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.07% (0.2817 => 0.2988, std.dev.: 0.0031) MultiSource/Applications/spiff/spiff: 3.33% (0.7475 => 0.7724, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.25% (2.7498 => 2.8116, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/lpbench: 2.09% (4.0870 => 4.1723, std.dev.: 0.0150) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 1.83% (0.5963 => 0.6072, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.19% (42.9271 => 43.4384, std.dev.: 0.1569) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.84% (8.9660 => 8.6219, std.dev.: 0.0672) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.43% (0.8139 => 0.7941, std.dev.: 0.0073) MultiSource/Applications/lambda-0_1_3/lambda: -2.11% (0.7383 => 0.7227, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.27% (1.4955 => 1.4765, std.dev.: 0.0071) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MallocBench/gs/gs: -12.05% (0.0830 => 0.0730, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.95% (4.6997 => 4.5139, std.dev.: 0.0480) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.32% (1.2898 => 1.2728, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.22% (2.5802 => 2.5488, std.dev.: 0.0121) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.16% (1.0132 => 1.0116, std.dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: 0.96% (0.6152 => 0.6211, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: 5.48% (0.1714 => 0.1808, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.43% (0.1564 => 0.1526, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.10% (0.3149 => 0.3152, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.17% (0.2393 => 0.2365, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.72% (0.3252 => 0.3196, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.36% (0.2334 => 0.2279, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel: 10.14% (0.0414 => 0.0456, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.87% (0.0214 => 0.0210, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 33.61% (0.0119 => 0.0159, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -12.83% (0.0382 => 0.0333, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -27.51% (0.0309 => 0.0224, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.69% (0.0289 => 0.0287, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 29.80% (0.0255 => 0.0331, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -0.54% (0.0186 => 0.0185, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -7.02% (0.0171 => 0.0159, std.dev.: 0.0008) SingleSource/UnitTests/Vector/multiplies: -18.58% (0.0253 => 0.0206, std.dev.: 0.0018) SingleSource/UnitTests/byval-alignment: 22.68% (0.0269 => 0.0330, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.27% (0.1466 => 0.1462, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: -0.22% (0.2283 => 0.2278, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: -2.00% (1.5066 => 1.4764, std.dev.: 0.0515) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 2.64% (0.1517 => 0.1557, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -0.33% (0.5821 => 0.5802, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: -0.97% (26.9250 => 26.6651, std.dev.: 0.3799) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.66% (0.4106 => 0.4079, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.48% (0.1340 => 0.1400, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: - (0.0547 => 0.0547, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -23.26% (0.0258 => 0.0198, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.50% (0.0663 => 0.0600, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.30% (1.1252 => 1.1286, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0016 => 0.0016, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.64% (0.0612 => 0.0553, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.40% (0.0208 => 0.0151, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.39% (0.7762 => 0.7654, std.dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -16.67% (0.0006 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.26% (1.7107 => 1.7062, std.dev.: 0.0007) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 236.11% (0.0036 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Applications/JM/lencod/lencod: -96.62% (6.7458 => 0.2278, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: -91.68% (6.9722 => 0.5802, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 21456.27% (0.1237 => 26.6651, std.dev.: 0.3799) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005, std.dev.: 0.0000) New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 135.96% (0.0089 => 0.0210, std.dev.: 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: 173.33% (0.0090 => 0.0246, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -26.52% (4.1772 => 3.0692, std.dev.: 0.0450) SingleSource/Benchmarks/Shootout-C++/except: 82816.67% (0.0006 => 0.4975, std.dev.: 0.0041) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.55% (0.0745 => 0.0913, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.94% (0.6410 => 0.6983, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 7.91% (0.5309 => 0.5729, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.71% (0.1414 => 0.1523, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 7.71% (2.1763 => 2.3440, std.dev.: 0.0133) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.62% (0.3582 => 0.3819, std.dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: 6.42% (1.1653 => 1.2401, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.40% (1.5150 => 1.6120, std.dev.: 0.0168) MultiSource/Applications/minisat/minisat: 6.17% (0.6173 => 0.6554, std.dev.: 0.0036) MultiSource/Applications/lemon/lemon: 5.84% (1.0046 => 1.0633, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.64% (0.2552 => 0.2696, std.dev.: 0.0043) MultiSource/Applications/kimwitu++/kc: 5.25% (15.3105 => 16.1141, std.dev.: 0.1234) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.84% (0.6069 => 0.6363, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.72% (0.2797 => 0.2929, std.dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: 4.51% (0.6915 => 0.7227, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.50% (0.7639 => 0.7983, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.34% (0.3062 => 0.3195, std.dev.: 0.0013) MultiSource/Applications/d/make_dparser: 4.16% (3.0225 => 3.1481, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.07% (0.4248 => 0.4421, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.85% (0.3901 => 0.4051, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/18-imp/imp: 3.79% (0.3217 => 0.3339, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.69% (0.2952 => 0.3061, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.53% (0.2886 => 0.2988, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 3.35% (13.3238 => 13.7707, std.dev.: 0.0451) MultiSource/Applications/hbd/hbd: 3.35% (1.3268 => 1.3712, std.dev.: 0.0049) MultiSource/Applications/Burg/burg: 3.23% (1.1440 => 1.1810, std.dev.: 0.0092) MultiSource/Applications/siod/siod: 3.15% (2.0972 => 2.1633, std.dev.: 0.0116) MultiSource/Applications/oggenc/oggenc: 3.12% (4.7455 => 4.8937, std.dev.: 0.0116) MultiSource/Benchmarks/Bullet/bullet: 3.00% (29.3170 => 30.1958, std.dev.: 0.1957) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.99% (6.2546 => 6.4415, std.dev.: 0.0490) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.93% (12.6413 => 13.0112, std.dev.: 0.0870) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.84% (1.1672 => 1.2003, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.68% (0.5937 => 0.6096, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.63% (1.1827 => 1.2138, std.dev.: 0.0108) MultiSource/Benchmarks/mafft/pairlocalalign: 2.50% (8.2186 => 8.4244, std.dev.: 0.0563) MultiSource/Benchmarks/nbench/nbench: 2.50% (1.0821 => 1.1091, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.48% (1.4408 => 1.4765, std.dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.39% (1.0689 => 1.0945, std.dev.: 0.0038) MultiSource/Applications/lua/lua: 2.34% (3.5980 => 3.6822, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/football/football: 2.20% (0.8405 => 0.8590, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.03% (0.7226 => 0.7373, std.dev.: 0.0055) MultiSource/Applications/JM/lencod/lencod: 2.01% (14.7256 => 15.0221, std.dev.: 0.0683) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.39% (1.3935 => 1.4129, std.dev.: 0.0054) MultiSource/Applications/JM/ldecod/ldecod: 1.29% (6.4908 => 6.5744, std.dev.: 0.0314) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.41% (1.6538 => 2.3387, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2277, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.97% (0.0766 => 0.0896, std.dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.95% (2.4042 => 2.8116, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/ary3: 14.62% (1.7426 => 1.9974, std.dev.: 0.0152) SingleSource/Benchmarks/Stanford/Puzzle: 13.47% (0.1433 => 0.1626, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.46% (4.0101 => 4.5498, std.dev.: 0.0129) SingleSource/Benchmarks/McGill/queens: 10.68% (1.6261 => 1.7998, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/mason/mason: 9.81% (0.5004 => 0.5495, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/lists: 9.11% (7.0025 => 7.6406, std.dev.: 0.0060) MultiSource/Benchmarks/nbench/nbench: 9.00% (21.1721 => 23.0767, std.dev.: 0.6551) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.40% (0.2857 => 0.3097, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 7.31% (40.4792 => 43.4384, std.dev.: 0.1569) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.30% (0.3301 => 0.3542, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.24% (1.0063 => 1.0691, std.dev.: 0.0140) SingleSource/Benchmarks/Misc/dt: 4.41% (0.9851 => 1.0285, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/fp-convert: 4.07% (15.2242 => 15.8438, std.dev.: 0.0339) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.80% (3.4080 => 3.5375, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.34% (0.5876 => 0.6072, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.10% (0.5587 => 0.5760, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 2.85% (0.7609 => 0.7826, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.83% (6.6312 => 6.8191, std.dev.: 0.0189) MultiSource/Applications/siod/siod: 2.74% (3.5520 => 3.6495, std.dev.: 0.0092) MultiSource/Applications/lua/lua: 2.56% (29.5232 => 30.2790, std.dev.: 0.0490) SingleSource/Benchmarks/Shootout-C++/hash: 2.33% (0.6308 => 0.6455, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.64% (4.6127 => 4.6885, std.dev.: 0.0257) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.51% (22.3381 => 22.6760, std.dev.: 0.0505) MultiSource/Benchmarks/Olden/power/power: 1.43% (1.4184 => 1.4387, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -53.81% (0.0591 => 0.0273, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -44.63% (0.2996 => 0.1659, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.55% (1.4189 => 1.1415, std.dev.: 0.0157) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.02% (1.4113 => 1.1429, std.dev.: 0.0069) SingleSource/UnitTests/Vector/constpool: -4.18% (8.9977 => 8.6219, std.dev.: 0.0672) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.03% (0.3497 => 0.2132, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.78% (5.2665 => 4.1723, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/ary3: -19.62% (1.7473 => 1.4044, std.dev.: 0.0485) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.30% (15.8312 => 13.4096, std.dev.: 0.6402) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -14.86% (1.7361 => 1.4782, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/17-bintr/bintr: -12.54% (0.0917 => 0.0802, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1578, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.71% (1.1647 => 1.0516, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.42% (1.4034 => 1.2852, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: -8.38% (9.5474 => 8.7472, std.dev.: 0.0146) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.95% (3.2007 => 2.9462, std.dev.: 0.0135) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.87% (3.6254 => 3.3765, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/fibo: -6.73% (4.6355 => 4.3237, std.dev.: 0.0060) MultiSource/Applications/lambda-0_1_3/lambda: -6.68% (7.6833 => 7.1699, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7947, std.dev.: 0.0145) SingleSource/Benchmarks/Misc/richards_benchmark: -5.96% (1.4441 => 1.3581, std.dev.: 0.0061) MultiSource/Applications/SIBsim4/SIBsim4: -5.76% (3.4230 => 3.2257, std.dev.: 0.0186) SingleSource/Benchmarks/Shootout/fib2: -5.48% (4.4195 => 4.1775, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.46% (3.9413 => 3.7260, std.dev.: 0.0315) MultiSource/Benchmarks/Olden/bh/bh: -4.82% (2.5166 => 2.3954, std.dev.: 0.0150) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.71% (0.4564 => 0.4349, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/distray/distray: -4.58% (0.2664 => 0.2542, std.dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: -4.32% (0.3746 => 0.3584, std.dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: -4.18% (62.4126 => 59.8052, std.dev.: 0.0754) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.82% (0.4140 => 0.3982, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.81% (45.4683 => 43.7357, std.dev.: 0.3081) SingleSource/Benchmarks/McGill/misr: -3.38% (0.4296 => 0.4151, std.dev.: 0.0032) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.14% (1.2722 => 1.2322, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: -3.04% (9.2503 => 8.9690, std.dev.: 0.0262) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.64% (1.1683 => 1.1375, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.41% (3.7496 => 3.6592, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/hash2: -1.93% (3.4876 => 3.4202, std.dev.: 0.0119) MultiSource/Benchmarks/sim/sim: -1.93% (3.8907 => 3.8156, std.dev.: 0.0211) MultiSource/Benchmarks/PAQ8p/paq8p: -1.85% (92.7467 => 91.0338, std.dev.: 0.2053) MultiSource/Benchmarks/FreeBench/neural/neural: -1.79% (1.0926 => 1.0730, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.76% (9.3855 => 9.2200, std.dev.: 0.0091) MultiSource/Applications/aha/aha: -1.66% (3.4286 => 3.3717, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3102, std.dev.: 0.0089) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.38% (27.1724 => 26.7964, std.dev.: 0.0837) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.36% (0.9980 => 1.0116, std.dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: 3.14% (0.6022 => 0.6211, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: 8.52% (0.1666 => 0.1808, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.80% (0.1554 => 0.1526, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.24% (0.3083 => 0.3152, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.21% (0.2394 => 0.2365, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.66% (0.3175 => 0.3196, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.00% (0.2302 => 0.2279, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel: 1.56% (0.0449 => 0.0456, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -12.50% (0.0240 => 0.0210, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -17.19% (0.0192 => 0.0159, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -14.62% (0.0390 => 0.0333, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -25.58% (0.0301 => 0.0224, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.06% (0.0284 => 0.0287, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 2.16% (0.0324 => 0.0331, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 4.52% (0.0177 => 0.0185, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -15.87% (0.0189 => 0.0159, std.dev.: 0.0008) SingleSource/UnitTests/Vector/multiplies: -17.27% (0.0249 => 0.0206, std.dev.: 0.0018) SingleSource/UnitTests/byval-alignment: 1.54% (0.0325 => 0.0330, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.31% (0.1429 => 0.1462, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -1.70% (1.5019 => 1.4764, std.dev.: 0.0515) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 3.73% (0.1501 => 0.1557, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.34% (0.4264 => 0.4079, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.17% (0.1344 => 0.1400, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.13% (0.0589 => 0.0547, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -14.66% (0.0232 => 0.0198, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.10% (0.0639 => 0.0600, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.56% (1.1350 => 1.1286, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 166.67% (0.0006 => 0.0016, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.19% (0.0637 => 0.0553, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.62% (0.0246 => 0.0151, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.50% (0.7541 => 0.7654, std.dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.06% (1.5363 => 1.7062, std.dev.: 0.0007) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 3 20:40:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 3 Oct 2012 22:40:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121004034039.5398B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4541?compare_to=4537&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4541, Order: 165190, Start Time: 2012-10-04 02:22:53, End Time: 2012-10-04 03:42:20 To: 4537, Order: 165185, Start Time: 2012-10-04 00:34:12, End Time: 2012-10-04 01:53:47 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (153 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 952 (691 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.07% (1.5002 => 1.5162, std.dev.: 0.0059) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.05% (0.5788 => 0.5785, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 0.01% (16.0646 => 16.0661, std.dev.: 0.0186) MultiSource/Benchmarks/Bullet/bullet: -0.05% (54.1453 => 54.1166, std.dev.: 0.0223) MultiSource/Benchmarks/MallocBench/gs/gs: 0.08% (4.3450 => 4.3485, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0467 => 0.0467) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0469 => 0.0469, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0436 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0438 => 0.0438, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0425 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0427 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.24% (0.0419 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.24% (0.0421 => 0.0420, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0437 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0439 => 0.0439) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.23% (0.0431 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0433 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0421 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0423 => 0.0423) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0429 => 0.0429, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0430 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.23% (0.0440 => 0.0439, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0442 => 0.0442, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0417 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.24% (0.0417 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.23% (0.0428 => 0.0429) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0430 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.24% (0.0419 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0422 => 0.0422, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0412 => 0.0412) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0413 => 0.0413) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.24% (0.0410 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0412 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0449 => 0.0449, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0450 => 0.0450, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0410 => 0.0410) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0411 => 0.0411, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0411 => 0.0411, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0412 => 0.0412, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0419 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0420 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.13% (1.2381 => 1.2365, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.00% (7.5408 => 7.5411, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.7286 => 0.7286, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.28% (0.0362 => 0.0361, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1433 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.36% (0.0692 => 0.0648, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -14.43% (63.2438 => 54.1166, std.dev.: 0.0223) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 31.17% (14.1553 => 18.5671, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++-EH/spirit: 58.25% (3.4629 => 5.4799, std.dev.: 0.0038) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14219.31% (0.0720 => 10.3099, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9951500.00% (0.0001 => 9.9516, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 49.10% (10.3673 => 15.4574, std.dev.: 0.0146) MultiSource/Benchmarks/McCat/08-main/main: 48.04% (0.2554 => 0.3781, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 30.64% (0.1622 => 0.2119, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: 30.30% (0.1056 => 0.1376, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 14.80% (0.1432 => 0.1644, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.80% (2.2022 => 2.5282, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.97% (7.0540 => 8.0396, std.dev.: 0.0092) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.92% (0.1566 => 0.1784, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.23% (0.0834 => 0.0936, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.80% (1.7609 => 1.9686, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 11.74% (10.4361 => 11.6612, std.dev.: 0.0099) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.54% (0.3543 => 0.3952, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.09% (0.3473 => 0.3858, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.87% (0.3561 => 0.3948, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.87% (0.3543 => 0.3928, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.86% (0.3516 => 0.3898, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.84% (0.3497 => 0.3876, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.67% (0.3694 => 0.4088, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.48% (0.1584 => 0.1750, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.42% (0.3828 => 0.4227, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.39% (0.3927 => 0.4335, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.24% (0.3886 => 0.4284, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 10.21% (0.3282 => 0.3617, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 8.89% (0.1440 => 0.1568, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 8.64% (0.1655 => 0.1798, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.61% (0.4879 => 0.5299, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.55% (0.1438 => 0.1561, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 8.50% (9.4845 => 10.2904, std.dev.: 0.0153) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.40% (0.3177 => 0.3444, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 8.19% (0.7433 => 0.8042, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.14% (1.5415 => 1.6670, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 8.09% (0.6030 => 0.6518, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.07% (0.5925 => 0.6403, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.06% (0.6675 => 0.7213, std.dev.: 0.0043) MultiSource/Applications/minisat/minisat: 7.98% (0.7115 => 0.7683, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 7.98% (0.3109 => 0.3357, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.78% (0.1337 => 0.1441, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.70% (0.2065 => 0.2224, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.69% (0.4615 => 0.4970, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 7.68% (5.7591 => 6.2015, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/em3d/em3d: 7.67% (0.1695 => 0.1825, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 7.62% (3.3354 => 3.5896, std.dev.: 0.0081) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.62% (0.2271 => 0.2444, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.51% (0.5860 => 0.6300, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 7.48% (0.3423 => 0.3679, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.47% (0.8067 => 0.8670, std.dev.: 0.0131) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.44% (0.8172 => 0.8780, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.43% (1.3050 => 1.4020, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.38% (0.1625 => 0.1745, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.35% (4.2646 => 4.5781, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.35% (0.1510 => 0.1621, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.35% (0.5105 => 0.5480, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 7.33% (0.7326 => 0.7863, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.18% (0.9765 => 1.0466, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.15% (0.2700 => 0.2893, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.14% (0.2758 => 0.2955, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.12% (0.2107 => 0.2257, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.09% (0.5569 => 0.5964, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.08% (5.0018 => 5.3557, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.06% (8.1363 => 8.7111, std.dev.: 0.0051) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.98% (0.3121 => 0.3339, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/lists: 6.98% (0.3422 => 0.3661, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.96% (4.9449 => 5.2892, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.92% (0.4103 => 0.4387, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 6.83% (0.7835 => 0.8370, std.dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.77% (0.4636 => 0.4950, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 6.72% (1.5603 => 1.6651, std.dev.: 0.0029) MultiSource/Applications/Burg/burg: 6.68% (1.1642 => 1.2420, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.68% (0.2891 => 0.3084, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 6.61% (0.2831 => 0.3018, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.60% (0.1940 => 0.2068, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.56% (0.3232 => 0.3444, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.54% (0.2905 => 0.3095, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.53% (0.3307 => 0.3523, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.50% (7.9617 => 8.4790, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.50% (0.4203 => 0.4476, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.44% (0.3650 => 0.3885, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 6.43% (0.1555 => 0.1655, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 6.43% (0.6456 => 0.6871, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.42% (0.3162 => 0.3365, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.41% (0.5020 => 0.5342, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.41% (0.3136 => 0.3337, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 6.41% (0.3387 => 0.3604, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.37% (0.2871 => 0.3054, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 6.30% (3.8723 => 4.1164, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/hash: 6.30% (0.4289 => 0.4559, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.29% (0.3865 => 0.4108, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 6.27% (0.4048 => 0.4302, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.23% (0.3098 => 0.3291, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.23% (0.3052 => 0.3242, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.22% (2.0665 => 2.1951, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.22% (0.3441 => 0.3655, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 6.21% (0.3283 => 0.3487, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.20% (0.2756 => 0.2927, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 6.17% (0.2802 => 0.2975, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/fibo: 6.17% (0.2725 => 0.2893, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.14% (0.3826 => 0.4061, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.13% (0.2872 => 0.3048, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 6.10% (0.3180 => 0.3374, std.dev.: 0.0057) MultiSource/Applications/lemon/lemon: 6.10% (1.0722 => 1.1376, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 6.09% (0.4299 => 0.4561, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 6.08% (0.2714 => 0.2879, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.04% (0.4620 => 0.4899, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.01% (0.2877 => 0.3050, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 5.97% (0.3603 => 0.3818, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.93% (1.1861 => 1.2564, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 5.92% (0.3684 => 0.3902, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.91% (0.2793 => 0.2958, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.88% (0.2603 => 0.2756, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 5.81% (2.0273 => 2.1450, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.67% (0.5981 => 0.6320, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.66% (0.1892 => 0.1999, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.60% (0.6450 => 0.6811, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 5.58% (21.9371 => 23.1616, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/football/football: 5.52% (0.8921 => 0.9413, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 5.44% (2.2969 => 2.4218, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.03% (1.5859 => 1.6656, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.87% (1.4186 => 1.4877, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 4.62% (1.1840 => 1.2387, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.60% (0.4064 => 0.4251, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.41% (0.2266 => 0.2366, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.40% (2.2024 => 2.2992, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 4.28% (0.3131 => 0.3265, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.22% (1.2842 => 1.3384, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.01% (0.8101 => 0.8426, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.22% (0.3817 => 0.3940, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.00% (14.3668 => 14.7975, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.98% (0.3427 => 0.3529, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.56% (17.1811 => 17.6201, std.dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.42% (1.1194 => 1.1465, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.17% (3.8922 => 3.9766, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.51% (5.3999 => 13.3115, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2173, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 10.18% (3.1595 => 3.4810, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/richards_benchmark: 9.95% (1.1396 => 1.2530, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.61% (3.1578 => 3.3664, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.61% (3.6395 => 3.7708, std.dev.: 0.0030) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.89% (4.2280 => 4.3500, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.34% (1.7254 => 1.7657, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.47% (0.9540 => 0.9680, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8123, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.13% (6.5088 => 6.5826, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.07% (9.1159 => 9.2133, std.dev.: 0.0060) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1287, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.35% (0.8651 => 0.1700, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.19% (5.2763 => 3.2615, std.dev.: 0.0109) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.31% (5.3855 => 3.5915, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.94% (5.3526 => 3.5894, std.dev.: 0.0033) SingleSource/UnitTests/Vector/constpool: -14.84% (54.1659 => 46.1284, std.dev.: 0.0754) MultiSource/Benchmarks/FreeBench/mason/mason: -13.93% (0.0811 => 0.0698, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.19% (2.9384 => 2.6097, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -10.29% (22.1758 => 19.8939, std.dev.: 0.0112) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: -16.12% (1.6925 => 1.4196, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.73% (0.0998 => 0.0861, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -12.16% (1.2373 => 1.0869, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/mandel-2: -10.45% (1.5373 => 1.3767, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/mason/mason: -10.13% (0.2161 => 0.1942, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.38% (19.9488 => 18.2773, std.dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.71% (1.8329 => 1.7099, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.31% (1.6805 => 1.5913, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.68% (1.5835 => 1.5094, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.98% (0.9957 => 0.9561, std.dev.: 0.0015) MultiSource/Applications/siod/siod: -3.59% (3.2827 => 3.1648, std.dev.: 0.0448) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5016, std.dev.: 0.0053) MultiSource/Applications/hexxagon/hexxagon: -2.99% (12.4730 => 12.0996, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.09% (8.6802 => 8.4984, std.dev.: 0.0198) MultiSource/Applications/sqlite3/sqlite3: -1.95% (4.6441 => 4.5534, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -1.74% (10.2830 => 10.1040, std.dev.: 0.0148) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6803, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.65% (8.1563 => 8.0216, std.dev.: 0.0076) SingleSource/UnitTests/Vector/multiplies: -1.64% (2.5528 => 2.5110, std.dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4212, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.05% (6.2999 => 6.2339, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8592, std.dev.: 0.0072) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.63% (0.5229 => 0.5785, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 7.18% (14.9895 => 16.0661, std.dev.: 0.0186) MultiSource/Benchmarks/MallocBench/gs/gs: 5.79% (4.1105 => 4.3485, std.dev.: 0.0099) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.92% (1.1048 => 1.2365, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.35% (7.1582 => 7.5411, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 17.10% (0.6222 => 0.7286, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36000.00% (0.0001 => 0.0361, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 3 21:23:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 3 Oct 2012 23:23:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121004042327.01C412A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4542?compare_to=4539&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4542, Order: 165190, Start Time: 2012-10-04 02:59:57, End Time: 2012-10-04 04:25:08 To: 4539, Order: 165188, Start Time: 2012-10-04 01:05:48, End Time: 2012-10-04 02:30:59 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (5 on baseline) Performance Regressions: 0 (179 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 5 (0 on baseline) Unchanged Tests: 1037 (683 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.08% (33.5069 => 33.5329, std.dev.: 0.0075) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.02% (2.7523 => 2.7528, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (2.1154 => 2.1154, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.00% (4.9748 => 4.9749, std.dev.: 0.0003) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.72% (33.2944 => 33.5329, std.dev.: 0.0075) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: -100.00% (7.3305 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.19% (2.0176 => 2.4451, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.38% (0.1410 => 0.1655, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.93% (0.1072 => 0.1232, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 14.89% (0.0826 => 0.0949, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 14.36% (0.2243 => 0.2565, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.06% (0.0819 => 0.0926, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.23% (0.0834 => 0.0936, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.21% (0.1327 => 0.1489, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 12.13% (0.5818 => 0.6524, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 11.90% (0.5748 => 0.6432, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 11.85% (0.1013 => 0.1133, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.75% (0.1413 => 0.1579, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 11.64% (0.7061 => 0.7883, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 11.55% (0.4328 => 0.4828, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 11.36% (0.2781 => 0.3097, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.36% (0.3899 => 0.4342, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash: 11.35% (0.4062 => 0.4523, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.14% (0.7710 => 0.8569, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.10% (0.0964 => 0.1071, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.06% (3.9660 => 4.4045, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 11.03% (1.3693 => 1.5203, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.98% (0.2596 => 0.2881, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.96% (0.2782 => 0.3087, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.95% (0.2721 => 0.3019, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.89% (0.1588 => 0.1761, std.dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: 10.87% (0.7038 => 0.7803, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.70% (0.1075 => 0.1190, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.69% (0.3022 => 0.3345, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: 10.68% (0.2761 => 0.3056, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.62% (0.3485 => 0.3855, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 10.59% (0.2690 => 0.2975, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 10.59% (0.2607 => 0.2883, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.56% (1.9828 => 2.1921, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.53% (0.3580 => 0.3957, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.49% (0.2966 => 0.3277, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.48% (0.9199 => 1.0163, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.46% (0.6959 => 0.7687, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.43% (0.5265 => 0.5814, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.40% (0.2655 => 0.2931, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 10.39% (0.2628 => 0.2901, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.38% (1.2193 => 1.3459, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.38% (0.2765 => 0.3052, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 10.36% (0.1062 => 0.1172, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 10.34% (0.2726 => 0.3008, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 10.33% (0.2760 => 0.3045, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 10.32% (0.2937 => 0.3240, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.30% (1.4563 => 1.6063, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.29% (0.3489 => 0.3848, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.26% (0.4016 => 0.4428, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.23% (0.6283 => 0.6926, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.22% (0.1986 => 0.2189, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 10.17% (0.3293 => 0.3628, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.17% (0.3756 => 0.4138, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 10.07% (0.3149 => 0.3466, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.03% (0.1276 => 0.1404, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.01% (0.2696 => 0.2966, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 9.98% (0.3868 => 0.4254, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.95% (0.4390 => 0.4827, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 9.95% (0.3107 => 0.3416, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 9.82% (0.3453 => 0.3792, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 9.81% (13.8202 => 15.1765, std.dev.: 0.0137) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.73% (1.1364 => 1.2470, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 9.71% (0.2988 => 0.3278, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 9.68% (0.3192 => 0.3501, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.51% (0.2914 => 0.3191, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 9.42% (0.3534 => 0.3867, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.42% (0.1157 => 0.1266, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.39% (0.3130 => 0.3424, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 9.37% (0.2945 => 0.3221, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.25% (0.5577 => 0.6093, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.25% (0.4379 => 0.4784, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.17% (0.2127 => 0.2322, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 9.13% (0.1589 => 0.1734, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 8.98% (1.1061 => 1.2054, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.92% (0.1435 => 0.1563, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.91% (0.4791 => 0.5218, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 8.87% (16.6129 => 18.0859, std.dev.: 0.0087) MultiSource/Applications/lemon/lemon: 8.85% (1.0313 => 1.1226, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.84% (0.6576 => 0.7157, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.78% (0.3246 => 0.3531, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.69% (0.5637 => 0.6127, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.69% (0.3578 => 0.3889, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 8.68% (0.2995 => 0.3255, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 8.62% (0.2925 => 0.3177, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 8.59% (0.7506 => 0.8151, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.59% (0.7460 => 0.8101, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/parameter-passing: 8.54% (0.4003 => 0.4345, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/for-in: 8.52% (0.3789 => 0.4112, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.52% (7.2180 => 7.8327, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/exceptions: 8.51% (0.3914 => 0.4247, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 8.48% (0.3220 => 0.3493, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-4: 8.48% (0.3646 => 0.3955, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.47% (0.1865 => 0.2023, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.44% (0.3650 => 0.3958, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 8.43% (3.8646 => 4.1905, std.dev.: 0.0066) SingleSource/UnitTests/ObjC/property: 8.43% (0.3940 => 0.4272, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.42% (0.3755 => 0.4071, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-2: 8.41% (0.3601 => 0.3904, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.39% (0.8698 => 0.9428, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/synchronized: 8.38% (0.3663 => 0.3970, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 8.34% (0.3623 => 0.3925, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.21% (0.2023 => 0.2189) MultiSource/Applications/minisat/minisat: 8.17% (0.6744 => 0.7295, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 8.15% (0.8310 => 0.8987, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 8.06% (3.1889 => 3.4459, std.dev.: 0.0066) MultiSource/Applications/viterbi/viterbi: 7.92% (0.1478 => 0.1595, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 7.91% (2.1791 => 2.3515, std.dev.: 0.0173) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.83% (0.1789 => 0.1929, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 7.80% (1.9270 => 2.0773, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 7.79% (0.1657 => 0.1786, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 7.56% (1.0594 => 1.1395, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.53% (1.3245 => 1.4243, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.46% (3.6692 => 3.9429, std.dev.: 0.0131) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.43% (0.2140 => 0.2299, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.37% (4.3801 => 4.7027, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 7.25% (0.3131 => 0.3358, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.20% (0.4113 => 0.4409, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.15% (0.3511 => 0.3762, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 7.14% (14.8535 => 15.9145, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.11% (0.6135 => 0.6571, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.09% (0.1819 => 0.1948, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.07% (4.4433 => 4.7575, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 7.01% (8.4961 => 9.0913, std.dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: 7.00% (1.2292 => 1.3152, std.dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 6.99% (4.6629 => 4.9888, std.dev.: 0.0132) MultiSource/Applications/SIBsim4/SIBsim4: 6.98% (1.2749 => 1.3639, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.78% (0.8818 => 0.9416, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 6.53% (0.6250 => 0.6658, std.dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.41% (1.1333 => 1.2060, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.25% (3.2742 => 3.4789, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.16% (0.2321 => 0.2464, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.15% (0.2504 => 0.2658, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.09% (4.9865 => 5.2902, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.99% (0.4805 => 0.5093, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 5.84% (6.5754 => 6.9596, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.78% (6.2785 => 6.6414, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.70% (0.3245 => 0.3430, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 5.63% (3.7467 => 3.9575, std.dev.: 0.0119) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.39% (0.9108 => 0.9599, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.38% (1.5188 => 1.6005, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.84% (2.1007 => 2.2023, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.77% (13.2842 => 13.9185, std.dev.: 0.0155) MultiSource/Applications/sqlite3/sqlite3: 3.13% (16.2614 => 16.7705, std.dev.: 0.0117) MultiSource/Applications/ClamAV/clamscan: 2.71% (14.5298 => 14.9239, std.dev.: 0.0152) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.48% (5.7573 => 7.5123, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fbench: 24.24% (1.8175 => 2.2580, std.dev.: 0.0139) SingleSource/Benchmarks/Misc/richards_benchmark: 11.02% (1.1560 => 1.2834, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.63% (3.1736 => 3.4157, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.32% (1.2998 => 1.3820, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.67% (1.9144 => 2.0038, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.85% (1.7081 => 1.7739, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6769, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9851, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.77% (10.7476 => 11.0456, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.18% (7.4271 => 7.5888, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.78% (1.4298 => 1.4553, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5139, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2068, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9688, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/oourafft: 1.30% (5.5130 => 5.5847, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1875, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0266, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 1.07% (12.4560 => 12.5891, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.05% (8.8259 => 8.9189, std.dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.53% (0.2670 => 0.1401, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -15.70% (0.0707 => 0.0596, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -14.88% (0.4657 => 0.3964, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.01% (1.3819 => 1.1883, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.88% (1.3813 => 1.1896, std.dev.: 0.0081) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.13% (22.5627 => 21.6309, std.dev.: 0.0153) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.34% (0.0997 => 0.0864, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/mason/mason: -11.93% (0.2238 => 0.1971, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -11.17% (1.2308 => 1.0933, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.09% (20.3410 => 18.2886, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.64% (1.3780 => 1.3003, std.dev.: 0.0106) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.32% (0.9996 => 0.9564, std.dev.: 0.0040) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.55% (3.2729 => 3.1566, std.dev.: 0.0130) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.38% (1.7688 => 1.7090, std.dev.: 0.0173) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.96% (0.4867 => 0.4723, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.58% (26.5159 => 25.8315, std.dev.: 0.0191) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4785, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.38% (3.0263 => 2.9544, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -2.36% (1.9762 => 1.9296, std.dev.: 0.0115) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.99% (0.6589 => 0.6458, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.69% (6.3560 => 6.2487, std.dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: -1.66% (28.2225 => 27.7534, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: -1.47% (4.5928 => 4.5252, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0065, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8660, std.dev.: 0.0047) MultiSource/Applications/minisat/minisat: -1.27% (9.3358 => 9.2176, std.dev.: 0.0333) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4955, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2582, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 3 22:09:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 00:09:17 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121004050917.88ED72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4543?compare_to=4540&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4543, Order: 165196, Start Time: 2012-10-04 03:42:56, End Time: 2012-10-04 05:11:00 To: 4540, Order: 165190, Start Time: 2012-10-04 01:58:07, End Time: 2012-10-04 03:26:52 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (14 on baseline) Performance Regressions: 25 (67 on baseline) Performance Improvements: 2 (46 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 69 (65 on baseline) Unchanged Tests: 946 (774 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 3.22% (0.8610 => 0.8887, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.72% (0.8937 => 0.9180, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.62% (0.7783 => 0.7987, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.58% (0.8214 => 0.8426, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.52% (0.8850 => 0.9073, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.43% (0.8488 => 0.8694, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.34% (0.8128 => 0.8318, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.31% (0.8169 => 0.8358, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.27% (0.8333 => 0.8522, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.22% (0.8571 => 0.8761, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.14% (0.7962 => 0.8132, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.09% (0.8712 => 0.8894, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.87% (0.9753 => 0.9935, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.51% (0.8194 => 0.8318, std.dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: 12.95% (3.0059 => 3.3952, std.dev.: 0.1145) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 5.53% (6.1534 => 6.4936, std.dev.: 0.0502) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.26% (1.3433 => 1.4140, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.04% (2.9269 => 2.9866, std.dev.: 0.0224) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.55% (1.0691 => 1.0857, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/whetstone: 1.32% (2.3739 => 2.4053, std.dev.: 0.0033) MultiSource/Applications/SPASS/SPASS: 1.27% (8.2486 => 8.3533, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout/hash: 1.23% (4.2889 => 4.3416, std.dev.: 0.0140) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.22% (1.5948 => 1.6143, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.09% (5.8741 => 5.9379, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.02% (4.6885 => 4.7364, std.dev.: 0.0186) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -2.39% (4.8682 => 4.7517, std.dev.: 0.0137) MultiSource/Benchmarks/Ptrdist/ft/ft: -1.74% (0.9314 => 0.9152, std.dev.: 0.0022) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.05% (1.0116 => 1.0111, std.dev.: 0.0112) MultiSource/Applications/sqlite3/sqlite3: -1.90% (0.6211 => 0.6093, std.dev.: 0.0098) MultiSource/Benchmarks/McCat/08-main/main: -0.77% (0.1808 => 0.1794, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.75% (0.1526 => 0.1568, std.dev.: 0.0048) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.52% (0.3152 => 0.3104, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.08% (0.2365 => 0.2367, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.44% (0.3196 => 0.3210, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.67% (0.2279 => 0.2317, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/mandel: - (0.0456 => 0.0456, std.dev.: 0.0015) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 14.76% (0.0210 => 0.0241, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 21.38% (0.0159 => 0.0193, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 17.12% (0.0333 => 0.0390, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 35.27% (0.0224 => 0.0303, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.35% (0.0287 => 0.0286, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -5.44% (0.0331 => 0.0313, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: -23.24% (0.0185 => 0.0142, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/test1: -27.04% (0.0159 => 0.0116, std.dev.: 0.0033) SingleSource/UnitTests/Vector/multiplies: 21.84% (0.0206 => 0.0251, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -2.42% (0.0330 => 0.0322, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1462 => 0.1463, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 0.31% (0.2278 => 0.2285, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: -0.58% (1.4764 => 1.4678, std.dev.: 0.0383) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 1.35% (0.1557 => 0.1578, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -0.36% (0.5802 => 0.5781, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 0.18% (26.6651 => 26.7140, std.dev.: 0.1902) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.15% (0.4079 => 0.4085, std.dev.: 0.0202) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.36% (0.1400 => 0.1433, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.93% (0.0547 => 0.0531, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 5.05% (0.0198 => 0.0208, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.00% (0.0600 => 0.0576, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.30% (1.1286 => 1.1252, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0016 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.76% (0.0553 => 0.0607, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.57% (0.0151 => 0.0173, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.25% (0.7654 => 0.7903, std.dev.: 0.0178) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 0.10% (1.7062 => 1.7079, std.dev.: 0.0107) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -28.10% (0.0121 => 0.0087, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Applications/JM/lencod/lencod: -96.61% (6.7458 => 0.2285, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -91.71% (6.9722 => 0.5781, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/09-vor/vor: 21495.80% (0.1237 => 26.7140, std.dev.: 0.1902) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005) New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 75.28% (0.0089 => 0.0156, std.dev.: 0.0031) SingleSource/UnitTests/2003-08-11-VaListArg: 171.11% (0.0090 => 0.0244, std.dev.: 0.0004) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -25.23% (4.1772 => 3.1231, std.dev.: 0.0525) SingleSource/Benchmarks/Shootout-C++/except: 82300.00% (0.0006 => 0.4944, std.dev.: 0.0029) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: -50.00% (0.0006 => 0.0003, std.dev.: 0.0001) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0003, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.95% (0.0745 => 0.0916, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.27% (0.6410 => 0.7004, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.89% (0.1159 => 0.1262, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 8.71% (2.1763 => 2.3658, std.dev.: 0.0184) SingleSource/Benchmarks/Misc-C++/bigfib: 7.95% (0.5309 => 0.5731, std.dev.: 0.0048) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.36% (0.1414 => 0.1518, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 6.88% (0.6173 => 0.6598, std.dev.: 0.0102) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.62% (0.3582 => 0.3819, std.dev.: 0.0034) MultiSource/Applications/kimwitu++/kc: 6.51% (15.3105 => 16.3065, std.dev.: 0.1893) MultiSource/Applications/lemon/lemon: 6.36% (1.0046 => 1.0685, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.11% (0.2552 => 0.2708, std.dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: 5.63% (1.1653 => 1.2309, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.26% (1.5150 => 1.5947, std.dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.86% (0.6069 => 0.6364, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.72% (0.2797 => 0.2929, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.56% (0.3901 => 0.4079, std.dev.: 0.0016) MultiSource/Applications/Burg/burg: 4.31% (1.1440 => 1.1933, std.dev.: 0.0161) MultiSource/Applications/d/make_dparser: 4.29% (3.0225 => 3.1521, std.dev.: 0.0196) MultiSource/Applications/lambda-0_1_3/lambda: 4.28% (0.6915 => 0.7211, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.00% (0.2952 => 0.3070, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/18-imp/imp: 3.95% (0.3217 => 0.3344, std.dev.: 0.0044) MultiSource/Benchmarks/Bullet/bullet: 3.88% (29.3170 => 30.4557, std.dev.: 0.0992) MultiSource/Applications/siod/siod: 3.67% (2.0972 => 2.1741, std.dev.: 0.0202) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.45% (0.8569 => 0.8865, std.dev.: 0.0047) MultiSource/Applications/oggenc/oggenc: 3.26% (4.7455 => 4.9000, std.dev.: 0.0561) MultiSource/Applications/SPASS/SPASS: 3.23% (13.3238 => 13.7544, std.dev.: 0.0814) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.05% (1.1672 => 1.2028, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.94% (1.1827 => 1.2175, std.dev.: 0.0104) MultiSource/Applications/lua/lua: 2.87% (3.5980 => 3.7011, std.dev.: 0.0184) MultiSource/Benchmarks/Prolangs-C/football/football: 2.82% (0.8405 => 0.8642, std.dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 2.82% (8.2186 => 8.4503, std.dev.: 0.0441) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.48% (0.7226 => 0.7405, std.dev.: 0.0051) MultiSource/Applications/JM/lencod/lencod: 2.43% (14.7256 => 15.0834, std.dev.: 0.0504) MultiSource/Applications/hbd/hbd: 2.15% (1.3268 => 1.3553, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.86% (8.2559 => 8.4096, std.dev.: 0.0273) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.44% (1.6538 => 2.3391, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/matrix: 22.14% (3.4629 => 4.2295, std.dev.: 0.0159) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 17.45% (0.0917 => 0.1077, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: 14.94% (1.7426 => 2.0030, std.dev.: 0.0285) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.47% (2.4042 => 2.7521, std.dev.: 0.0350) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.60% (4.0101 => 4.5554, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/heapsort: 12.22% (3.0256 => 3.3952, std.dev.: 0.1145) SingleSource/Benchmarks/McGill/queens: 11.10% (1.6261 => 1.8066, std.dev.: 0.0337) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.63% (0.2857 => 0.3132, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: 8.58% (7.0025 => 7.6031, std.dev.: 0.0162) MultiSource/Benchmarks/FreeBench/mason/mason: 8.27% (0.5004 => 0.5418, std.dev.: 0.0099) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.89% (1.0063 => 1.0857, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.70% (0.8498 => 0.9152, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.51% (0.3301 => 0.3549, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.41% (4.2129 => 4.5252, std.dev.: 0.0614) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.98% (40.4792 => 43.3061, std.dev.: 0.2452) SingleSource/Benchmarks/Misc/dt: 4.32% (0.9851 => 1.0277, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: 4.26% (15.2242 => 15.8733, std.dev.: 0.0308) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.82% (3.4080 => 3.5381, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.58% (2.6656 => 2.7611, std.dev.: 0.0318) MultiSource/Applications/lua/lua: 3.38% (29.5232 => 30.5223, std.dev.: 0.1423) MultiSource/Applications/siod/siod: 3.29% (3.5520 => 3.6690, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.22% (0.5587 => 0.5767, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 3.17% (0.6308 => 0.6508, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.88% (6.6312 => 6.8222, std.dev.: 0.0083) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.68% (4.6127 => 4.7364, std.dev.: 0.0186) SingleSource/Benchmarks/Misc/whetstone: 2.56% (2.3453 => 2.4053, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.45% (2.9152 => 2.9866, std.dev.: 0.0224) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.62% (2.4455 => 2.4852, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.52% (22.3381 => 22.6769, std.dev.: 0.0425) MultiSource/Benchmarks/Olden/power/power: 1.52% (1.4184 => 1.4399, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/em3d/em3d: 1.16% (4.6414 => 4.6953, std.dev.: 0.0194) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -44.89% (0.2996 => 0.1651, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.84% (0.0591 => 0.0326, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -21.27% (1.4189 => 1.1171, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.71% (1.4113 => 1.1331, std.dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.24% (0.3497 => 0.2055, std.dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.96% (5.2665 => 4.1098, std.dev.: 0.0446) SingleSource/Benchmarks/Shootout-C++/ary3: -19.70% (1.7473 => 1.4031, std.dev.: 0.0295) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.36% (15.8312 => 13.0823, std.dev.: 0.8237) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.18% (1.7361 => 1.4725, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/17-bintr/bintr: -12.98% (0.0917 => 0.0798, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1584, std.dev.: 0.0440) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.76% (1.1647 => 1.0510, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.36% (1.4034 => 1.2861, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops: -8.35% (9.5474 => 8.7502, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.78% (3.2007 => 2.9516, std.dev.: 0.0221) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.87% (3.6254 => 3.3763, std.dev.: 0.0182) MultiSource/Applications/lambda-0_1_3/lambda: -6.61% (7.6833 => 7.1757, std.dev.: 0.0280) SingleSource/Benchmarks/Shootout-C++/fibo: -6.52% (4.6355 => 4.3334, std.dev.: 0.0158) SingleSource/Benchmarks/Misc/richards_benchmark: -6.15% (1.4441 => 1.3553, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.94% (2.9728 => 2.7963, std.dev.: 0.0337) MultiSource/Benchmarks/FreeBench/distray/distray: -5.82% (0.2664 => 0.2509, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.48% (3.9413 => 3.7255, std.dev.: 0.0051) MultiSource/Applications/SIBsim4/SIBsim4: -5.27% (3.4230 => 3.2425, std.dev.: 0.0137) MultiSource/Applications/sgefa/sgefa: -5.26% (0.3746 => 0.3549, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/fib2: -5.23% (4.4195 => 4.1882, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.80% (0.4564 => 0.4345, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -4.53% (2.5166 => 2.4026, std.dev.: 0.0138) MultiSource/Benchmarks/mafft/pairlocalalign: -4.14% (62.4126 => 59.8282, std.dev.: 0.1273) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.86% (0.4140 => 0.3980, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: -3.53% (9.2503 => 8.9240, std.dev.: 0.0421) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.69% (3.7496 => 3.6488, std.dev.: 0.0075) SingleSource/Benchmarks/Dhrystone/dry: -2.47% (2.4013 => 2.3419, std.dev.: 0.0099) MultiSource/Benchmarks/FreeBench/neural/neural: -2.27% (1.0926 => 1.0678, std.dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: -2.10% (8.5323 => 8.3533, std.dev.: 0.0145) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.04% (2.4457 => 2.3957, std.dev.: 0.0140) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.96% (1.1683 => 1.1454, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/hash2: -1.90% (3.4876 => 3.4215, std.dev.: 0.0194) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.78% (2.3569 => 2.3149, std.dev.: 0.0057) MultiSource/Benchmarks/sim/sim: -1.77% (3.8907 => 3.8218, std.dev.: 0.0140) MultiSource/Applications/aha/aha: -1.71% (3.4286 => 3.3698, std.dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.66% (9.3855 => 9.2293, std.dev.: 0.0182) MultiSource/Benchmarks/PAQ8p/paq8p: -1.65% (92.7467 => 91.2120, std.dev.: 0.1513) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.33% (25.6658 => 25.3235, std.dev.: 0.0268) SingleSource/Benchmarks/Dhrystone/fldry: -1.09% (2.4971 => 2.4698, std.dev.: 0.0068) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.05% (27.1724 => 26.8862, std.dev.: 0.0543) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.31% (0.9980 => 1.0111, std.dev.: 0.0112) MultiSource/Applications/sqlite3/sqlite3: 1.18% (0.6022 => 0.6093, std.dev.: 0.0098) MultiSource/Benchmarks/McCat/08-main/main: 7.68% (0.1666 => 0.1794, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.90% (0.1554 => 0.1568, std.dev.: 0.0048) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.68% (0.3083 => 0.3104, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.13% (0.2394 => 0.2367, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.10% (0.3175 => 0.3210, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.65% (0.2302 => 0.2317, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/mandel: 1.56% (0.0449 => 0.0456, std.dev.: 0.0015) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.42% (0.0240 => 0.0241, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.52% (0.0192 => 0.0193, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0390 => 0.0390, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.66% (0.0301 => 0.0303, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.70% (0.0284 => 0.0286, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.40% (0.0324 => 0.0313, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: -19.77% (0.0177 => 0.0142, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/test1: -38.62% (0.0189 => 0.0116, std.dev.: 0.0033) SingleSource/UnitTests/Vector/multiplies: 0.80% (0.0249 => 0.0251, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -0.92% (0.0325 => 0.0322, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.38% (0.1429 => 0.1463, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: -2.27% (1.5019 => 1.4678, std.dev.: 0.0383) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 5.13% (0.1501 => 0.1578, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.20% (0.4264 => 0.4085, std.dev.: 0.0202) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.62% (0.1344 => 0.1433, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.85% (0.0589 => 0.0531, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -10.34% (0.0232 => 0.0208, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.86% (0.0639 => 0.0576, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.86% (1.1350 => 1.1252, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 166.67% (0.0006 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.71% (0.0637 => 0.0607, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -29.67% (0.0246 => 0.0173, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 4.80% (0.7541 => 0.7903, std.dev.: 0.0178) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 11.17% (1.5363 => 1.7079, std.dev.: 0.0107) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 24.29% (0.0070 => 0.0087, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 3 22:29:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 00:29:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121004052925.D1E832A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4544?compare_to=4541&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4544, Order: 165197, Start Time: 2012-10-04 04:11:34, End Time: 2012-10-04 05:31:06 To: 4541, Order: 165190, Start Time: 2012-10-04 02:22:53, End Time: 2012-10-04 03:42:20 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (148 on baseline) Performance Improvements: 3 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 949 (697 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.23% (54.6021 => 56.3645, std.dev.: 0.1328) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -3.69% (11.6612 => 11.2305, std.dev.: 0.0207) MultiSource/Benchmarks/PAQ8p/paq8p: -1.66% (15.4574 => 15.2014, std.dev.: 0.0045) MultiSource/Applications/ClamAV/clamscan: -1.62% (19.8939 => 19.5722, std.dev.: 0.0257) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.24% (0.5785 => 0.5771, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -0.15% (16.0661 => 16.0423, std.dev.: 0.0143) MultiSource/Benchmarks/Bullet/bullet: -0.56% (54.1166 => 53.8133, std.dev.: 0.0136) MultiSource/Benchmarks/MallocBench/gs/gs: -0.14% (4.3485 => 4.3422, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.86% (0.0467 => 0.0463, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.85% (0.0469 => 0.0465, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.92% (0.0436 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.91% (0.0438 => 0.0434) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.71% (0.0425 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.17% (0.0427 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.72% (0.0418 => 0.0415) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.71% (0.0420 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.92% (0.0437 => 0.0433) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.14% (0.0439 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.16% (0.0432 => 0.0427, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.15% (0.0433 => 0.0428, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.71% (0.0421 => 0.0418) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.95% (0.0423 => 0.0419) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.17% (0.0429 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.16% (0.0430 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.91% (0.0439 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.13% (0.0442 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.20% (0.0417 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -1.20% (0.0418 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.17% (0.0429 => 0.0424) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.16% (0.0430 => 0.0425) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.19% (0.0420 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -1.42% (0.0422 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.97% (0.0412 => 0.0408, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.97% (0.0413 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.97% (0.0411 => 0.0407, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.97% (0.0412 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.11% (0.0449 => 0.0444) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.11% (0.0450 => 0.0445, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.98% (0.0410 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.97% (0.0411 => 0.0407) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.73% (0.0411 => 0.0408) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.73% (0.0412 => 0.0409) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.95% (0.0419 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.19% (0.0420 => 0.0415, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.06% (1.2365 => 1.2373, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.11% (7.5411 => 7.5329, std.dev.: 0.0120) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.15% (0.7286 => 0.7275, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.55% (0.0361 => 0.0359, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1432 => 0.1431, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 230.56% (0.0648 => 0.2142, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -14.91% (63.2438 => 53.8133, std.dev.: 0.0136) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 30.84% (14.1553 => 18.5202, std.dev.: 0.0225) SingleSource/Benchmarks/Misc-C++-EH/spirit: 58.27% (3.4629 => 5.4808, std.dev.: 0.0088) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14234.17% (0.0720 => 10.3206, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952000.00% (0.0001 => 9.9521, std.dev.: 0.0009) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 46.71% (0.2554 => 0.3747, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 46.63% (10.3673 => 15.2014, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/distray/distray: 29.55% (0.1056 => 0.1368, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 28.11% (0.1622 => 0.2078, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.14% (2.2022 => 2.5137, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.90% (7.0540 => 8.0348, std.dev.: 0.0047) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.67% (0.1566 => 0.1780, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 13.55% (0.1432 => 0.1626, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.77% (1.7609 => 1.9681, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.48% (0.0871 => 0.0971, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.54% (0.3473 => 0.3839, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.42% (0.1584 => 0.1749, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.41% (0.3543 => 0.3912, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.39% (0.3543 => 0.3911, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.32% (0.3497 => 0.3858, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.27% (0.3516 => 0.3877, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.22% (0.3561 => 0.3925, std.dev.: 0.0060) SingleSource/UnitTests/ObjC/for-in: 10.10% (0.3694 => 0.4067, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 9.96% (0.3927 => 0.4318, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 9.80% (0.3828 => 0.4203, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.68% (0.3886 => 0.4262, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/oourafft: 9.54% (0.3282 => 0.3595, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 8.47% (0.1440 => 0.1562, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 8.46% (0.1655 => 0.1795, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.28% (0.4879 => 0.5283, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.21% (1.5415 => 1.6681, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.09% (0.3177 => 0.3434, std.dev.: 0.0067) MultiSource/Applications/minisat/minisat: 8.00% (0.7115 => 0.7684, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 7.91% (9.4845 => 10.2349, std.dev.: 0.0040) MultiSource/Applications/lambda-0_1_3/lambda: 7.91% (0.7433 => 0.8021, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.90% (0.5925 => 0.6393, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.88% (0.6675 => 0.7201, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 7.76% (0.6030 => 0.6498, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.75% (0.2065 => 0.2225, std.dev.: 0.0021) MultiSource/Applications/sgefa/sgefa: 7.69% (0.3109 => 0.3348, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 7.65% (5.7591 => 6.1997, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.63% (0.1625 => 0.1749, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 7.61% (10.4361 => 11.2305, std.dev.: 0.0207) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.61% (0.4615 => 0.4966, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.57% (0.8172 => 0.8791, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.57% (0.2271 => 0.2443, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.51% (0.1438 => 0.1546, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.47% (1.3050 => 1.4025, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/em3d/em3d: 7.43% (0.1695 => 0.1821, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 7.39% (0.3423 => 0.3676, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.26% (0.2700 => 0.2896, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.24% (4.2646 => 4.5735, std.dev.: 0.0083) MultiSource/Applications/d/make_dparser: 7.23% (3.3354 => 3.5764, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.22% (0.1510 => 0.1619, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.22% (0.5860 => 0.6283, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 7.11% (0.7326 => 0.7847, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.11% (0.5569 => 0.5965, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.05% (8.1363 => 8.7097, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.01% (0.5105 => 0.5463, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.98% (0.9765 => 1.0447, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.95% (0.3121 => 0.3338, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.90% (0.8067 => 0.8624, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.85% (0.2758 => 0.2947, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.83% (0.2107 => 0.2251, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 6.82% (0.7835 => 0.8369, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.75% (4.9449 => 5.2789, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.75% (5.0018 => 5.3392, std.dev.: 0.0051) MultiSource/Applications/Burg/burg: 6.61% (1.1642 => 1.2412, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.60% (0.1940 => 0.2068, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.56% (0.3307 => 0.3524, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.56% (0.4636 => 0.4940, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.51% (0.4103 => 0.4370, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.47% (0.5020 => 0.5345, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 6.46% (0.3422 => 0.3643, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 6.44% (0.3387 => 0.3605, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 6.35% (0.6456 => 0.6866, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.31% (0.4203 => 0.4468, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.30% (0.2891 => 0.3073, std.dev.: 0.0040) MultiSource/Applications/lua/lua: 6.17% (3.8723 => 4.1111, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.16% (0.3441 => 0.3653, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 6.13% (0.2905 => 0.3083, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.08% (0.3865 => 0.4100, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 6.03% (0.4048 => 0.4292, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.00% (0.3650 => 0.3869, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 6.00% (1.5603 => 1.6539, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 5.99% (1.0722 => 1.1364, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 5.97% (0.4289 => 0.4545, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.94% (7.9617 => 8.4347, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/sieve: 5.94% (0.3603 => 0.3817, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 5.93% (0.3052 => 0.3233, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.92% (0.2603 => 0.2757, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.85% (0.3162 => 0.3347, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 5.84% (0.4299 => 0.4550, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.84% (0.3136 => 0.3319, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.82% (0.2714 => 0.2872, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 5.82% (0.3180 => 0.3365, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.82% (1.1861 => 1.2551, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 5.82% (0.2871 => 0.3038, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/matrix: 5.81% (0.3098 => 0.3278, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.80% (0.3826 => 0.4048, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 5.80% (2.0273 => 2.1449, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary: 5.79% (0.3232 => 0.3419, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.78% (0.2872 => 0.3038, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.76% (0.2831 => 0.2994, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.70% (0.2756 => 0.2913, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.70% (2.0665 => 2.1842, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/fibo: 5.69% (0.2725 => 0.2880, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 5.56% (0.4620 => 0.4877, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.54% (0.3684 => 0.3888, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.53% (0.2877 => 0.3036, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.50% (0.6450 => 0.6805, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.50% (0.5981 => 0.6310, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary3: 5.48% (0.3283 => 0.3463, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.48% (0.2793 => 0.2946, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.46% (0.2802 => 0.2955, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 5.35% (2.2969 => 2.4198, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/football/football: 5.30% (0.8921 => 0.9394, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.30% (0.3379 => 0.3558, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 5.22% (21.9371 => 23.0831, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.03% (1.5859 => 1.6657, std.dev.: 0.0187) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.77% (1.4186 => 1.4862, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.64% (2.2024 => 2.3047, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 4.41% (1.1840 => 1.2362, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.38% (0.4064 => 0.4242, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.02% (0.8101 => 0.8427, std.dev.: 0.0073) MultiSource/Applications/hexxagon/hexxagon: 3.96% (1.2842 => 1.3351, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 3.77% (0.3131 => 0.3249, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.02% (14.3668 => 14.8004, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.92% (0.3427 => 0.3527, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.72% (0.3817 => 0.3921, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.47% (17.1811 => 17.6053, std.dev.: 0.0079) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.32% (1.1194 => 1.1454, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.20% (3.8922 => 3.9778, std.dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3124, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 10.17% (3.1595 => 3.4809, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 9.82% (1.1396 => 1.2515, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3690, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.65% (0.3463 => 0.3624, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 3.68% (0.5413 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.66% (3.6395 => 3.7727, std.dev.: 0.0017) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.78% (4.2280 => 4.3454, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.29% (1.7254 => 1.7649, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8128, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.36% (0.9540 => 0.9670, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.09% (6.6874 => 0.1278, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.01% (0.8651 => 0.1729, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.49% (5.2763 => 3.2455, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.37% (5.3855 => 3.5886, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.93% (5.3526 => 3.5898, std.dev.: 0.0023) SingleSource/UnitTests/Vector/constpool: -14.57% (54.1659 => 46.2752, std.dev.: 0.0289) MultiSource/Benchmarks/FreeBench/mason/mason: -14.06% (0.0811 => 0.0697, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -11.74% (22.1758 => 19.5722, std.dev.: 0.0257) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.14% (2.9384 => 2.6111, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.52% (1.1492 => 0.7640, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4231, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.73% (0.0998 => 0.0861, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.37% (1.2373 => 1.0966, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -10.30% (1.5373 => 1.3790, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/mason/mason: -9.86% (0.2161 => 0.1948, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.29% (19.9488 => 18.2955, std.dev.: 0.0366) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.65% (1.8329 => 1.7111, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.30% (1.6805 => 1.5915, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.97% (1.5835 => 1.5048, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.78% (0.9957 => 0.9581, std.dev.: 0.0077) MultiSource/Applications/siod/siod: -3.60% (3.2827 => 3.1645, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4948, std.dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: -3.02% (12.4730 => 12.0959, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.70% (1.3677 => 1.3308, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.02% (8.1563 => 7.9912, std.dev.: 0.0178) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.97% (8.6802 => 8.5089, std.dev.: 0.0207) MultiSource/Applications/sqlite3/sqlite3: -1.93% (4.6441 => 4.5543, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6821, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -1.62% (10.2830 => 10.1164, std.dev.: 0.0124) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4202, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.37% (0.5229 => 0.5771, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 7.02% (14.9895 => 16.0423, std.dev.: 0.0143) MultiSource/Benchmarks/MallocBench/gs/gs: 5.64% (4.1105 => 4.3422, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.99% (1.1048 => 1.2373, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.23% (7.1582 => 7.5329, std.dev.: 0.0120) SingleSource/Benchmarks/Misc-C++/stepanov_container: 16.92% (0.6222 => 0.7275, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35800.00% (0.0001 => 0.0359, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.23% (0.2116 => 0.2142, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 3 22:38:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 00:38:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121004053857.0F63E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4545?compare_to=4538&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4545, Order: 165190, Start Time: 2012-10-04 02:30:40, End Time: 2012-10-04 05:40:38 To: 4538, Order: 165173, Start Time: 2012-10-03 22:51:25, End Time: 2012-10-04 02:01:29 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 1 (139 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (131 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1038 (752 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.44% (53.9751 => 54.7521, std.dev.: 0.0937) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.06% (9.8144 => 9.8083, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.02% (9.4088 => 9.4106, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.04% (16.9462 => 16.9527, std.dev.: 0.0088) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 12.50% (0.3465 => 0.3898, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 12.48% (0.3446 => 0.3876, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.44% (0.3488 => 0.3922, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/trivial-interface: 12.43% (0.3442 => 0.3870, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 12.39% (0.3496 => 0.3929, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.37% (0.3460 => 0.3888, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.37% (0.3469 => 0.3898, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.23% (0.1063 => 0.1193, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.05% (0.3643 => 0.4082, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.97% (0.3650 => 0.4087, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.87% (0.3724 => 0.4166, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 11.42% (1.5932 => 1.7751, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 10.56% (0.5826 => 0.6441, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 10.46% (0.5889 => 0.6505, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 9.55% (0.4994 => 0.5471, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.18% (0.2875 => 0.3139, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.12% (0.1107 => 0.1208, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 9.09% (0.2750 => 0.3000, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 9.08% (0.1619 => 0.1766, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 8.92% (0.2725 => 0.2968, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.90% (0.7171 => 0.7809, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 8.81% (0.2714 => 0.2953, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.80% (0.2738 => 0.2979, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.79% (0.3195 => 0.3476, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 8.79% (0.3004 => 0.3268, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 8.78% (0.1218 => 0.1325, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.68% (0.2729 => 0.2966, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 8.62% (0.3096 => 0.3363, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 8.61% (0.2823 => 0.3066, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 8.60% (0.2803 => 0.3044, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.58% (1.6211 => 1.7602, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/methcall: 8.57% (0.2813 => 0.3054, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 8.56% (0.2780 => 0.3018, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.52% (0.2792 => 0.3030, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.49% (2.0673 => 2.2428, std.dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 8.40% (0.9909 => 1.0741, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/except: 8.40% (0.2811 => 0.3047, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.40% (0.1620 => 0.1756, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 8.26% (0.3267 => 0.3537, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.26% (0.5000 => 0.5413, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.26% (1.3152 => 1.4238, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.24% (0.2911 => 0.3151, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.21% (0.4361 => 0.4719, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.20% (2.7292 => 2.9531, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.20% (0.3060 => 0.3311, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.20% (3.5627 => 3.8547, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary: 8.16% (0.3258 => 0.3524, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 8.02% (0.3317 => 0.3583, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash: 8.01% (0.4146 => 0.4478, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.00% (0.3362 => 0.3631, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.97% (0.3124 => 0.3373, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.86% (0.3282 => 0.3540, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 7.83% (0.3678 => 0.3966, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.78% (0.3625 => 0.3907, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 7.71% (0.3348 => 0.3606, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 7.68% (0.3726 => 0.4012, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.67% (0.1968 => 0.2119, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 7.67% (5.5417 => 5.9665, std.dev.: 0.0151) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.65% (0.2014 => 0.2168, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 7.59% (0.3477 => 0.3741, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.45% (0.3690 => 0.3965, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 7.43% (0.4251 => 0.4567, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 7.43% (1.0781 => 1.1582, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.35% (0.3930 => 0.4219, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 7.32% (0.1421 => 0.1525, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.30% (0.1549 => 0.1662, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.29% (0.5900 => 0.6330, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.25% (0.4139 => 0.4439, std.dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: 7.23% (23.5202 => 25.2209, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.20% (0.2736 => 0.2933, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.13% (0.3981 => 0.4265, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.05% (0.2866 => 0.3068, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.05% (0.3845 => 0.4116, std.dev.: 0.0047) MultiSource/Applications/ClamAV/clamscan: 6.95% (4.2109 => 4.5035, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.94% (0.3890 => 0.4160, std.dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 6.91% (2.1013 => 2.2466, std.dev.: 0.0026) MultiSource/Applications/spiff/spiff: 6.85% (0.4029 => 0.4305, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.82% (0.3903 => 0.4169, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 6.78% (0.5012 => 0.5352, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.65% (0.5026 => 0.5360, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/09-vor/vor: 6.64% (0.1505 => 0.1605, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 6.61% (1.8794 => 2.0037, std.dev.: 0.0077) MultiSource/Benchmarks/nbench/nbench: 6.55% (0.2566 => 0.2734, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 6.48% (0.9697 => 1.0325, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.46% (0.6435 => 0.6851, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.40% (0.2969 => 0.3159, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.36% (4.4195 => 4.7007, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.21% (0.2737 => 0.2907, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 6.20% (0.5546 => 0.5890, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.19% (0.2068 => 0.2196, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 6.19% (4.6177 => 4.9035, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.16% (0.3084 => 0.3274, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 6.15% (1.4269 => 1.5147, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.14% (0.3271 => 0.3472, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 6.06% (2.1653 => 2.2965, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.99% (0.4658 => 0.4937, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.98% (0.2040 => 0.2162, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 5.94% (0.6634 => 0.7028, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 5.79% (0.3336 => 0.3529, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.78% (1.9694 => 2.0832, std.dev.: 0.0038) MultiSource/Applications/treecc/treecc: 5.69% (0.7875 => 0.8323, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.68% (1.9966 => 2.1101, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/football/football: 5.40% (0.2075 => 0.2187, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.33% (0.2103 => 0.2215, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 5.14% (0.2391 => 0.2514, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 5.02% (2.0346 => 2.1368, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 4.95% (0.4847 => 0.5087, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 4.94% (0.2691 => 0.2824, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.48% (0.5361 => 0.5601, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.38% (0.7426 => 0.7751, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.08% (0.5584 => 0.5812, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.79% (11.6398 => 12.0811, std.dev.: 0.0126) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.64% (4.6926 => 4.8632, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.50% (0.4253 => 0.4402, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.24% (0.3792 => 0.3915, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 2.80% (11.9555 => 12.2908, std.dev.: 0.0097) SingleSource/UnitTests/Vector/constpool: 1.09% (2.4764 => 2.5035, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.54% (3.3903 => 3.6119, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 5.56% (0.2122 => 0.2240, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6734, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-2: 4.87% (1.8057 => 1.8936, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops: 4.65% (15.4430 => 16.1608, std.dev.: 0.0097) SingleSource/Benchmarks/Dhrystone/dry: 4.23% (14.0481 => 14.6426, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.42% (79.9355 => 82.6654, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary3: 2.00% (15.8721 => 16.1903, std.dev.: 0.0099) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5042, std.dev.: 0.0046) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.69% (3.1722 => 3.2259, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2886, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5933, std.dev.: 0.0187) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.85% (25.4195 => 16.5613, std.dev.: 0.0180) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9748, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7928, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/ary2: -7.24% (0.2402 => 0.2228, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9586, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7982, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.05% (0.6293 => 0.6101, std.dev.: 0.0020) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7729, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -2.95% (3.6262 => 3.5191, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -2.95% (17.2379 => 16.7302, std.dev.: 0.0722) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8680, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5729, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4955, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (105.3826 => 104.1596, std.dev.: 0.0727) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0459, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 3 23:17:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 01:17:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121004061743.2F3472A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4546?compare_to=4542&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4546, Order: 165199, Start Time: 2012-10-04 04:54:12, End Time: 2012-10-04 06:19:23 To: 4542, Order: 165190, Start Time: 2012-10-04 02:59:57, End Time: 2012-10-04 04:25:08 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (5 on baseline) Performance Regressions: 1 (171 on baseline) Performance Improvements: 4 (40 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 5 (0 on baseline) Unchanged Tests: 1032 (691 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 5.25% (28.2104 => 29.6908, std.dev.: 0.0907) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.45% (0.7157 => 0.7053, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -1.22% (4.1905 => 4.1392, std.dev.: 0.0060) MultiSource/Applications/kimwitu++/kc: -1.14% (18.0859 => 17.8806, std.dev.: 0.0104) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.11% (6.6414 => 6.5676, std.dev.: 0.0049) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -1.06% (33.5329 => 33.1778, std.dev.: 0.0108) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.03% (2.7528 => 2.7521, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (2.1154 => 2.1154, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.10% (4.9749 => 4.9699, std.dev.: 0.0024) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.35% (33.2944 => 33.1778, std.dev.: 0.0108) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: -100.00% (7.3305 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.71% (2.0176 => 2.4354, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.45% (0.1410 => 0.1642, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 14.41% (0.0826 => 0.0945, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 13.29% (0.2243 => 0.2541, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 11.14% (0.5818 => 0.6466, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.97% (0.1413 => 0.1568, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 10.96% (0.1013 => 0.1124, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 10.93% (0.5748 => 0.6376, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.85% (0.1327 => 0.1471, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.82% (0.2782 => 0.3083, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 10.81% (0.4328 => 0.4796, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/hash: 10.81% (0.4062 => 0.4501, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.79% (0.3022 => 0.3348, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 10.72% (0.2781 => 0.3079, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.45% (0.1588 => 0.1754, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 10.45% (1.3693 => 1.5124, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference: 10.42% (0.7061 => 0.7797, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.35% (3.9660 => 4.3763, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/fibo: 10.24% (0.2628 => 0.2897, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.22% (0.2721 => 0.2999, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.14% (0.7710 => 0.8492, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hello: 10.13% (0.2607 => 0.2871, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.09% (0.2655 => 0.2923, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.09% (0.2596 => 0.2858, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/random: 10.07% (0.2690 => 0.2961, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.95% (1.4563 => 1.6012, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.94% (0.9199 => 1.0113, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.93% (0.3485 => 0.3831, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.92% (0.3580 => 0.3935, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.91% (1.9828 => 2.1792, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.87% (0.2765 => 0.3038, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 9.84% (0.2937 => 0.3226, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.81% (0.2966 => 0.3257, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.81% (0.4016 => 0.4410, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.80% (0.3899 => 0.4281, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 9.78% (0.2760 => 0.3030, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.78% (1.2193 => 1.3385, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.77% (0.6283 => 0.6897, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 9.75% (0.7038 => 0.7724, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 9.69% (0.3293 => 0.3612, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.64% (0.2696 => 0.2956, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 9.60% (0.2761 => 0.3026, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 9.57% (0.2726 => 0.2987, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.53% (0.6959 => 0.7622, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.50% (0.5265 => 0.5765, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.48% (0.3756 => 0.4112, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/sieve: 9.47% (0.3453 => 0.3780, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.46% (0.3489 => 0.3819, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 9.40% (0.3149 => 0.3445, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.38% (0.4390 => 0.4802, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 9.38% (0.3868 => 0.4231, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 9.33% (0.3107 => 0.3397, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 9.30% (0.2988 => 0.3266, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.11% (1.1364 => 1.2399, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 9.00% (0.3534 => 0.3852, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 8.99% (13.8202 => 15.0627, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.97% (0.5577 => 0.6077, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.96% (0.1986 => 0.2164, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 8.96% (0.3192 => 0.3478, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.78% (0.1276 => 0.1388, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.66% (0.3130 => 0.3401, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 8.50% (0.1589 => 0.1724, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.47% (0.4791 => 0.5197, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.37% (0.2127 => 0.2305, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.36% (0.1435 => 0.1555, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 8.32% (0.2945 => 0.3190, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 8.25% (0.2995 => 0.3242, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 8.20% (1.0313 => 1.1159, std.dev.: 0.0148) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.13% (0.2914 => 0.3151, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.12% (0.5637 => 0.6095, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.04% (0.4379 => 0.4731, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 7.97% (1.1061 => 1.1943, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.95% (0.7460 => 0.8053, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.91% (0.3755 => 0.4052, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.89% (0.3246 => 0.3502, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.86% (7.2180 => 7.7852, std.dev.: 0.0081) MultiSource/Applications/spiff/spiff: 7.67% (0.7506 => 0.8082, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.65% (0.8698 => 0.9363, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 7.64% (0.8310 => 0.8945, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 7.63% (16.6129 => 17.8806, std.dev.: 0.0104) MultiSource/Benchmarks/nbench/nbench: 7.57% (1.0594 => 1.1396, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 7.53% (0.6744 => 0.7252, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 7.48% (0.3220 => 0.3461, std.dev.: 0.0017) MultiSource/Applications/d/make_dparser: 7.39% (3.1889 => 3.4245, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 7.35% (0.2925 => 0.3140, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.25% (0.6576 => 0.7053, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.22% (0.2023 => 0.2169, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.21% (0.1789 => 0.1918, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.13% (0.1865 => 0.1998, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 7.11% (3.8646 => 4.1392, std.dev.: 0.0060) MultiSource/Applications/viterbi/viterbi: 7.04% (0.1478 => 0.1582, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 7.00% (1.9270 => 2.0618, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.94% (0.8818 => 0.9430, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 6.94% (0.1657 => 0.1772, std.dev.: 0.0015) MultiSource/Applications/siod/siod: 6.88% (2.1791 => 2.3290, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/trivial-interface: 6.82% (0.3578 => 0.3822, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 6.78% (0.3789 => 0.4046, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 6.78% (1.2749 => 1.3613, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 6.76% (14.8535 => 15.8573, std.dev.: 0.0085) SingleSource/UnitTests/ObjC/exceptions-4: 6.72% (0.3646 => 0.3891, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.72% (0.3914 => 0.4177, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.72% (3.6692 => 3.9157, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.68% (1.3245 => 1.4130, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 6.67% (0.4003 => 0.4270, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 6.66% (0.3663 => 0.3907, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 6.64% (0.3131 => 0.3339, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.64% (0.3601 => 0.3840, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.63% (0.3650 => 0.3892, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 6.61% (0.4113 => 0.4385, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 6.60% (0.3623 => 0.3862, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/property: 6.45% (0.3940 => 0.4194, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.42% (4.4433 => 4.7284, std.dev.: 0.0087) MultiSource/Benchmarks/mafft/pairlocalalign: 6.41% (8.4961 => 9.0409, std.dev.: 0.0175) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.39% (4.3801 => 4.6599, std.dev.: 0.0123) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.36% (0.6135 => 0.6525, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.36% (0.2140 => 0.2276, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 6.35% (4.6629 => 4.9589, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 6.35% (1.2292 => 1.3072, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.18% (0.3511 => 0.3728, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.05% (0.1819 => 0.1929, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 5.90% (0.6250 => 0.6619, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.79% (1.1333 => 1.1989, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.67% (0.2504 => 0.2646, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.67% (3.2742 => 3.4598, std.dev.: 0.0150) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.41% (0.4805 => 0.5065, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.37% (4.9865 => 5.2542, std.dev.: 0.0102) MultiSource/Applications/JM/ldecod/ldecod: 5.26% (6.5754 => 6.9210, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.21% (0.3245 => 0.3414, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.00% (0.2321 => 0.2437, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.70% (0.9108 => 0.9536, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.68% (1.5188 => 1.5899, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 4.63% (3.7467 => 3.9201, std.dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.60% (6.2785 => 6.5676, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.48% (13.2842 => 13.8787, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.24% (2.1007 => 2.1898, std.dev.: 0.0071) MultiSource/Applications/sqlite3/sqlite3: 2.84% (16.2614 => 16.7233, std.dev.: 0.0223) MultiSource/Applications/ClamAV/clamscan: 2.33% (14.5298 => 14.8679, std.dev.: 0.0130) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5131, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fbench: 26.21% (1.8175 => 2.2939, std.dev.: 0.0211) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 11.14% (1.1560 => 1.2848, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.47% (0.1322 => 0.1434, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4144, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.22% (1.2998 => 1.3806, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.78% (1.9144 => 2.0059, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.89% (1.7081 => 1.7746, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.67% (11.2619 => 11.6751, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9861, std.dev.: 0.0006) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.73% (10.7476 => 11.0406, std.dev.: 0.0483) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.12% (7.4271 => 7.5848, std.dev.: 0.0073) MultiSource/Applications/lemon/lemon: 1.77% (1.4298 => 1.4551, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0497, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5128, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9692, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 1.29% (5.5130 => 5.5843, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1867, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists: 1.16% (12.4560 => 12.6008, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0268, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.87% (0.2670 => 0.1392, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -16.41% (0.0707 => 0.0591, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.23% (0.4657 => 0.3901, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.58% (1.3813 => 1.1799, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.57% (1.3819 => 1.1806, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.73% (22.5627 => 21.4963, std.dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.74% (0.0997 => 0.0860, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -12.06% (0.2238 => 0.1968, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -11.30% (1.2308 => 1.0917, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.11% (20.3410 => 18.2848, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/flops-3: -6.20% (2.4152 => 2.2654, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0123) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.07% (1.3780 => 1.2944, std.dev.: 0.0102) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.12% (2.6470 => 2.5116, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.59% (0.9996 => 0.9537, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8004, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.52% (3.2729 => 3.1578, std.dev.: 0.0081) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.49% (1.7688 => 1.7071, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.10% (0.4867 => 0.4716, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -2.62% (26.5159 => 25.8217, std.dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -2.48% (3.0263 => 2.9511, std.dev.: 0.0025) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.35% (1.9762 => 1.9298, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.02% (0.6589 => 0.6456, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.74% (6.3560 => 6.2456, std.dev.: 0.0052) MultiSource/Benchmarks/mafft/pairlocalalign: -1.66% (28.2225 => 27.7527, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511) MultiSource/Applications/sqlite3/sqlite3: -1.53% (4.5928 => 4.5226, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8596, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0062, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: -1.20% (9.3358 => 9.2236, std.dev.: 0.0075) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.16% (2.5254 => 2.4961, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2577, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 3 23:57:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 01:57:56 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121004065756.E02B82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4547?compare_to=4543&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4547, Order: 165202, Start Time: 2012-10-04 05:26:55, End Time: 2012-10-04 06:59:39 To: 4543, Order: 165196, Start Time: 2012-10-04 03:42:56, End Time: 2012-10-04 05:11:00 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (14 on baseline) Performance Regressions: 10 (71 on baseline) Performance Improvements: 4 (45 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 69 (65 on baseline) Unchanged Tests: 959 (771 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.03% (0.3071 => 0.3287, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.89% (0.2105 => 0.2229, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.12% (0.5636 => 0.5868, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.81% (0.2781 => 0.2887, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.33% (0.7797 => 0.8057, std.dev.: 0.0082) MultiSource/Benchmarks/McCat/05-eks/eks: 2.59% (0.4215 => 0.4324, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.39% (1.1171 => 1.1438, std.dev.: 0.0077) MultiSource/Benchmarks/MallocBench/gs/gs: 1.95% (3.8841 => 3.9597, std.dev.: 0.0291) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.92% (0.5899 => 0.6071, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.09% (39.1346 => 39.5612, std.dev.: 0.0970) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.28% (0.8694 => 0.8583, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: -9.86% (3.3952 => 3.0605, std.dev.: 0.0725) SingleSource/Benchmarks/Shootout-C++/ackermann: -9.07% (3.5407 => 3.2195, std.dev.: 0.0917) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.38% (1.4140 => 1.3804, std.dev.: 0.0114) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.74% (1.0111 => 1.0186, std.dev.: 0.0049) MultiSource/Applications/sqlite3/sqlite3: 1.10% (0.6093 => 0.6160, std.dev.: 0.0102) MultiSource/Benchmarks/McCat/08-main/main: 2.06% (0.1794 => 0.1831, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.32% (0.1568 => 0.1563, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.97% (0.3104 => 0.3134, std.dev.: 0.0130) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (0.2367 => 0.2397, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.81% (0.3210 => 0.3184, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.94% (0.2317 => 0.2272, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel: -9.21% (0.0456 => 0.0414, std.dev.: 0.0056) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -24.90% (0.0241 => 0.0181, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.55% (0.0193 => 0.0196, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -21.54% (0.0390 => 0.0306, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -16.83% (0.0303 => 0.0252, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.05% (0.0286 => 0.0289, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -9.27% (0.0313 => 0.0284, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/casts: 27.46% (0.0142 => 0.0181, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 43.97% (0.0116 => 0.0167, std.dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -8.76% (0.0251 => 0.0229, std.dev.: 0.0012) SingleSource/UnitTests/byval-alignment: -16.15% (0.0322 => 0.0270, std.dev.: 0.0025) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.14% (0.1463 => 0.1461, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 0.74% (0.2285 => 0.2302, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.64% (1.4678 => 1.4919, std.dev.: 0.0333) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -2.03% (0.1578 => 0.1546, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 1.02% (0.5781 => 0.5840, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 0.28% (26.7140 => 26.7877, std.dev.: 0.2162) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.64% (0.4085 => 0.4018, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.02% (0.1433 => 0.1404, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.92% (0.0531 => 0.0589, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -7.69% (0.0208 => 0.0192, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 7.47% (0.0576 => 0.0619, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.54% (1.1252 => 1.1313, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0016 => 0.0016) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.77% (0.0607 => 0.0572, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.29% (0.0173 => 0.0150, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.23% (0.7903 => 0.7648, std.dev.: 0.0252) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.09% (1.7079 => 1.7063, std.dev.: 0.0009) SingleSource/UnitTests/2003-07-09-SignedArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 39.08% (0.0087 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Applications/JM/lencod/lencod: -96.59% (6.7458 => 0.2302, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -91.62% (6.9722 => 0.5840, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/09-vor/vor: 21555.38% (0.1237 => 26.7877, std.dev.: 0.2162) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005) New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 141.57% (0.0089 => 0.0215, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: 97.78% (0.0090 => 0.0178, std.dev.: 0.0049) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -24.49% (4.1772 => 3.1543, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/except: 82500.00% (0.0006 => 0.4956, std.dev.: 0.0032) SingleSource/Regression/C++/EH/ctor_dtor_count: -50.00% (0.0006 => 0.0003, std.dev.: 0.0001) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: -20.00% (0.0005 => 0.0004, std.dev.: 0.0001) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.76% (0.0745 => 0.0922, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.44% (0.1159 => 0.1280, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.83% (0.1414 => 0.1553, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.47% (0.6410 => 0.7017, std.dev.: 0.0030) MultiSource/Benchmarks/PAQ8p/paq8p: 9.17% (2.1763 => 2.3758, std.dev.: 0.0233) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.85% (0.3582 => 0.3899, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 7.50% (0.5309 => 0.5707, std.dev.: 0.0029) MultiSource/Applications/minisat/minisat: 7.35% (0.6173 => 0.6627, std.dev.: 0.0048) MultiSource/Applications/SIBsim4/SIBsim4: 6.56% (1.1653 => 1.2417, std.dev.: 0.0292) MultiSource/Applications/lemon/lemon: 6.39% (1.0046 => 1.0688, std.dev.: 0.0093) MultiSource/Applications/kimwitu++/kc: 6.08% (15.3105 => 16.2421, std.dev.: 0.0630) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.93% (1.5150 => 1.6049, std.dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.76% (0.2552 => 0.2699, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 5.51% (0.6915 => 0.7296, std.dev.: 0.0139) MultiSource/Applications/Burg/burg: 5.02% (1.1440 => 1.2014, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.91% (0.6069 => 0.6367, std.dev.: 0.0041) MultiSource/Applications/d/make_dparser: 4.86% (3.0225 => 3.1693, std.dev.: 0.0520) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.83% (0.2797 => 0.2932, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.82% (0.3901 => 0.4089, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.53% (0.7639 => 0.7985, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.28% (0.7226 => 0.7535, std.dev.: 0.0056) MultiSource/Applications/SPASS/SPASS: 4.08% (13.3238 => 13.8680, std.dev.: 0.1860) MultiSource/Benchmarks/McCat/09-vor/vor: 4.06% (0.3026 => 0.3149, std.dev.: 0.0039) MultiSource/Benchmarks/nbench/nbench: 3.95% (1.0821 => 1.1248, std.dev.: 0.0119) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.94% (0.8569 => 0.8907, std.dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.81% (0.4880 => 0.5066, std.dev.: 0.0050) MultiSource/Benchmarks/mafft/pairlocalalign: 3.66% (8.2186 => 8.5194, std.dev.: 0.0866) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.66% (0.2952 => 0.3060, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.60% (6.2546 => 6.4798, std.dev.: 0.0573) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.54% (1.1672 => 1.2085, std.dev.: 0.0102) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.51% (0.7784 => 0.8057, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.37% (1.1827 => 1.2225, std.dev.: 0.0113) MultiSource/Applications/lua/lua: 3.07% (3.5980 => 3.7084, std.dev.: 0.0372) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.92% (12.6413 => 13.0100, std.dev.: 0.1221) MultiSource/Applications/treecc/treecc: 2.66% (1.8798 => 1.9298, std.dev.: 0.0177) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.46% (0.5520 => 0.5656, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.42% (1.2742 => 1.3050, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.41% (0.4562 => 0.4672, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.41% (8.2559 => 8.4546, std.dev.: 0.0304) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.38% (0.5963 => 0.6105, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.23% (0.5740 => 0.5868, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/gs/gs: 2.06% (3.8796 => 3.9597, std.dev.: 0.0291) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 45.21% (0.0261 => 0.0379, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/pi: 41.38% (1.6538 => 2.3382, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2278, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout/ary3: 14.62% (1.7426 => 1.9974, std.dev.: 0.0215) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.63% (4.0101 => 4.5568, std.dev.: 0.0135) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.58% (0.0766 => 0.0870, std.dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.03% (2.4042 => 2.7174, std.dev.: 0.0215) MultiSource/Benchmarks/nbench/nbench: 11.93% (21.1721 => 23.6975, std.dev.: 0.3909) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.34% (0.0917 => 0.1021, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/queens: 10.77% (1.6261 => 1.8012, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/lists: 9.00% (7.0025 => 7.6325, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/mason/mason: 8.91% (0.5004 => 0.5450, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.89% (0.2857 => 0.3111, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.02% (1.0063 => 1.0870, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.12% (40.4792 => 42.9577, std.dev.: 0.2242) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.63% (0.3301 => 0.3487, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/dt: 4.21% (0.9851 => 1.0266, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/fp-convert: 4.07% (15.2242 => 15.8432, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/hash: 4.01% (0.6308 => 0.6561, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.93% (3.4080 => 3.5420, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.32% (0.5876 => 0.6071, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.13% (0.5587 => 0.5762, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.87% (6.6312 => 6.8214, std.dev.: 0.0204) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.79% (2.6656 => 2.7399, std.dev.: 0.0176) MultiSource/Applications/lua/lua: 2.52% (29.5232 => 30.2669, std.dev.: 0.0399) MultiSource/Applications/siod/siod: 2.22% (3.5520 => 3.6308, std.dev.: 0.0240) SingleSource/Benchmarks/Misc/whetstone: 2.12% (2.3453 => 2.3950, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.63% (38.9255 => 39.5612, std.dev.: 0.0970) MultiSource/Benchmarks/Olden/power/power: 1.11% (1.4184 => 1.4342, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.67% (0.0591 => 0.0327, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -44.13% (0.2996 => 0.1674, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -20.14% (1.4113 => 1.1270, std.dev.: 0.0191) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.39% (1.4189 => 1.1438, std.dev.: 0.0077) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.29% (0.3497 => 0.2123, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.16% (5.2665 => 4.1522, std.dev.: 0.3100) SingleSource/Benchmarks/Shootout-C++/ary3: -19.59% (1.7473 => 1.4050, std.dev.: 0.0713) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.02% (1.7361 => 1.4754, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1593, std.dev.: 0.0152) MultiSource/Benchmarks/McCat/17-bintr/bintr: -11.45% (0.0917 => 0.0812, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ackermann: -10.63% (3.6023 => 3.2195, std.dev.: 0.0917) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.67% (1.1647 => 1.0521, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.69% (1.4034 => 1.2814, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: -8.39% (9.5474 => 8.7462, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.01% (3.2007 => 2.9443, std.dev.: 0.0127) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.88% (3.6254 => 3.3759, std.dev.: 0.0063) MultiSource/Applications/lambda-0_1_3/lambda: -6.61% (7.6833 => 7.1758, std.dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/fibo: -6.60% (4.6355 => 4.3296, std.dev.: 0.0155) SingleSource/Benchmarks/Misc/richards_benchmark: -6.31% (1.4441 => 1.3530, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7947, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: -5.96% (3.4230 => 3.2191, std.dev.: 0.0374) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.61% (3.9413 => 3.7203, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout/fib2: -5.21% (4.4195 => 4.1894, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.89% (0.4564 => 0.4341, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.4140 => 0.3938, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/bh/bh: -4.64% (2.5166 => 2.3999, std.dev.: 0.0112) MultiSource/Benchmarks/mafft/pairlocalalign: -4.22% (62.4126 => 59.7797, std.dev.: 0.1670) MultiSource/Benchmarks/FreeBench/distray/distray: -4.02% (0.2664 => 0.2557, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/misr: -3.47% (0.4296 => 0.4147, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.20% (3.7496 => 3.6296, std.dev.: 0.0187) SingleSource/Benchmarks/Shootout-C++/methcall: -3.11% (9.2503 => 8.9625, std.dev.: 0.0410) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.51% (1.1683 => 1.1390, std.dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.33% (2.4457 => 2.3887, std.dev.: 0.0164) SingleSource/Benchmarks/Dhrystone/dry: -2.27% (2.4013 => 2.3467, std.dev.: 0.0143) MultiSource/Benchmarks/FreeBench/neural/neural: -2.22% (1.0926 => 1.0683, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: -1.83% (3.4876 => 3.4239, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.77% (2.3569 => 2.3152, std.dev.: 0.0123) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.67% (9.3855 => 9.2286, std.dev.: 0.0188) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.65% (1.0686 => 1.0510, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -1.52% (3.8907 => 3.8317, std.dev.: 0.0053) MultiSource/Applications/aha/aha: -1.48% (3.4286 => 3.3780, std.dev.: 0.0132) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3116, std.dev.: 0.0605) SingleSource/Benchmarks/Dhrystone/fldry: -1.32% (2.4971 => 2.4642, std.dev.: 0.0086) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.25% (27.1724 => 26.8328, std.dev.: 0.0467) SingleSource/Benchmarks/Shootout-C++/lists: -1.21% (16.5617 => 16.3616, std.dev.: 0.0404) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.06% (0.9980 => 1.0186, std.dev.: 0.0049) MultiSource/Applications/sqlite3/sqlite3: 2.29% (0.6022 => 0.6160, std.dev.: 0.0102) MultiSource/Benchmarks/McCat/08-main/main: 9.90% (0.1666 => 0.1831, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.58% (0.1554 => 0.1563, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.65% (0.3083 => 0.3134, std.dev.: 0.0130) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.13% (0.2394 => 0.2397, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.28% (0.3175 => 0.3184, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.30% (0.2302 => 0.2272, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel: -7.80% (0.0449 => 0.0414, std.dev.: 0.0056) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -24.58% (0.0240 => 0.0181, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 2.08% (0.0192 => 0.0196, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -21.54% (0.0390 => 0.0306, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -16.28% (0.0301 => 0.0252, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.76% (0.0284 => 0.0289, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -12.35% (0.0324 => 0.0284, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/casts: 2.26% (0.0177 => 0.0181, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -11.64% (0.0189 => 0.0167, std.dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -8.03% (0.0249 => 0.0229, std.dev.: 0.0012) SingleSource/UnitTests/byval-alignment: -16.92% (0.0325 => 0.0270, std.dev.: 0.0025) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.24% (0.1429 => 0.1461, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -0.67% (1.5019 => 1.4919, std.dev.: 0.0333) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 3.00% (0.1501 => 0.1546, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.77% (0.4264 => 0.4018, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.46% (0.1344 => 0.1404, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: - (0.0589 => 0.0589, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -17.24% (0.0232 => 0.0192, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.13% (0.0639 => 0.0619, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.33% (1.1350 => 1.1313, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 166.67% (0.0006 => 0.0016) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.20% (0.0637 => 0.0572, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.02% (0.0246 => 0.0150, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.42% (0.7541 => 0.7648, std.dev.: 0.0252) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.07% (1.5363 => 1.7063, std.dev.: 0.0009) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 00:21:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 02:21:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121004072105.21FD72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4548?compare_to=4544&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4548, Order: 165203, Start Time: 2012-10-04 06:00:52, End Time: 2012-10-04 07:22:46 To: 4544, Order: 165197, Start Time: 2012-10-04 04:11:34, End Time: 2012-10-04 05:31:06 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 3 (142 on baseline) Performance Improvements: 0 (44 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 950 (701 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.70% (3.5898 => 3.6507, std.dev.: 0.0128) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.61% (3.5886 => 3.6464, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.13% (2.5137 => 2.5420, std.dev.: 0.0003) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.02% (0.5771 => 0.5770, std.dev.: 0.0054) MultiSource/Applications/SPASS/SPASS: -0.05% (16.0423 => 16.0348, std.dev.: 0.0380) MultiSource/Benchmarks/Bullet/bullet: 0.44% (53.8133 => 54.0506, std.dev.: 0.0732) MultiSource/Benchmarks/MallocBench/gs/gs: -0.12% (4.3422 => 4.3368, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0463 => 0.0463, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.22% (0.0465 => 0.0464, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0432 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0434 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.47% (0.0422 => 0.0424, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.24% (0.0422 => 0.0423, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0415 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.24% (0.0417 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0433 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0434 => 0.0434, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0427 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0428 => 0.0428, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0418 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0419 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.24% (0.0424 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.24% (0.0425 => 0.0426, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.23% (0.0435 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.23% (0.0437 => 0.0438, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.24% (0.0412 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.48% (0.0413 => 0.0415, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.24% (0.0424 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0425 => 0.0425, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.24% (0.0415 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.24% (0.0416 => 0.0417, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.25% (0.0408 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0409 => 0.0409, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.25% (0.0407 => 0.0408) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0408 => 0.0408, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0444 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0445 => 0.0445, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.25% (0.0406 => 0.0407) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.25% (0.0407 => 0.0406, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.25% (0.0408 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0409 => 0.0409, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0415 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0415 => 0.0415, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (1.2373 => 1.2373, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.12% (7.5329 => 7.5238, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.45% (0.7275 => 0.7308, std.dev.: 0.0187) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 1.39% (0.0359 => 0.0364, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1431 => 0.1431, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.75% (0.2142 => 0.2158, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -14.54% (63.2438 => 54.0506, std.dev.: 0.0732) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 30.55% (14.1553 => 18.4800, std.dev.: 0.0260) SingleSource/Benchmarks/Misc-C++-EH/spirit: 58.14% (3.4629 => 5.4761, std.dev.: 0.1364) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14243.89% (0.0720 => 10.3276, std.dev.: 0.0101) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952100.00% (0.0001 => 9.9522, std.dev.: 0.0117) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 47.22% (0.2554 => 0.3760, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: 45.57% (10.3673 => 15.0918, std.dev.: 0.0109) MultiSource/Benchmarks/FreeBench/distray/distray: 29.92% (0.1056 => 0.1372, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 27.50% (0.1622 => 0.2068, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.43% (2.2022 => 2.5420, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.61% (7.0540 => 8.0845, std.dev.: 0.0129) SingleSource/Benchmarks/Misc/flops: 14.32% (0.1432 => 0.1637, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.54% (0.1566 => 0.1778, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.71% (0.0834 => 0.0940, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.33% (1.7609 => 1.9780, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.42% (0.1584 => 0.1749, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 10.27% (0.3282 => 0.3619, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 9.79% (0.3473 => 0.3813, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 9.61% (0.3497 => 0.3833, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.60% (0.3543 => 0.3883, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 9.58% (0.3561 => 0.3902, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-4: 9.54% (0.3543 => 0.3881, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.53% (0.3516 => 0.3851, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.29% (0.3694 => 0.4037, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.12% (0.3828 => 0.4177, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.12% (0.3927 => 0.4285, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.03% (0.3886 => 0.4237, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.71% (0.4879 => 0.5304, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/power/power: 8.47% (0.1440 => 0.1562, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 8.46% (0.1655 => 0.1795, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 8.40% (9.4845 => 10.2813, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.34% (0.1438 => 0.1558, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.31% (0.3177 => 0.3441, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.19% (1.5415 => 1.6677, std.dev.: 0.0035) MultiSource/Applications/oggenc/oggenc: 8.12% (5.7591 => 6.2265, std.dev.: 0.0040) MultiSource/Applications/sgefa/sgefa: 8.07% (0.3109 => 0.3360, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/Hello: 7.97% (0.5925 => 0.6397, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 7.94% (0.7115 => 0.7680, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.91% (0.6675 => 0.7203, std.dev.: 0.0153) SingleSource/UnitTests/ObjC++/property-reference-object: 7.88% (0.6030 => 0.6505, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 7.67% (0.7433 => 0.8003, std.dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 7.61% (10.4361 => 11.2298, std.dev.: 0.0257) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.45% (0.5569 => 0.5984, std.dev.: 0.0064) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.44% (0.2271 => 0.2440, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.43% (0.4615 => 0.4958, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/18-imp/imp: 7.39% (0.3423 => 0.3676, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.39% (0.8172 => 0.8776, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.32% (1.3050 => 1.4005, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/em3d/em3d: 7.32% (0.1695 => 0.1819, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.26% (0.2065 => 0.2215, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.25% (0.5860 => 0.6285, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.15% (0.8067 => 0.8644, std.dev.: 0.0091) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.13% (4.2646 => 4.5687, std.dev.: 0.0043) MultiSource/Applications/d/make_dparser: 7.12% (3.3354 => 3.5728, std.dev.: 0.0068) SingleSource/UnitTests/ObjC++/property-reference: 7.11% (0.7326 => 0.7847, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.08% (0.1892 => 0.2026, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.00% (8.1363 => 8.7062, std.dev.: 0.0102) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.99% (0.4636 => 0.4960, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.95% (0.1510 => 0.1615, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.95% (0.2891 => 0.3092, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.93% (0.9765 => 1.0442, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.93% (0.2700 => 0.2887, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: 6.93% (0.3422 => 0.3659, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 6.85% (1.5603 => 1.6672, std.dev.: 0.0099) SingleSource/Regression/C++/ofstream_ctor: 6.82% (0.2905 => 0.3103, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.79% (0.3136 => 0.3349, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.78% (0.2758 => 0.2945, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.75% (4.9449 => 5.2788, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.74% (0.2107 => 0.2249, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.70% (0.3121 => 0.3330, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.68% (0.4103 => 0.4377, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 6.65% (0.3232 => 0.3447, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.65% (0.3052 => 0.3255, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.63% (5.0018 => 5.3336, std.dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.63% (0.3650 => 0.3892, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 6.60% (0.7835 => 0.8352, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/hash: 6.60% (0.4289 => 0.4572, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/05-eks/eks: 6.56% (0.4299 => 0.4581, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 6.53% (0.2831 => 0.3016, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.52% (0.3098 => 0.3300, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.51% (0.3162 => 0.3368, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 6.51% (1.1642 => 1.2400, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/fibo: 6.50% (0.2725 => 0.2902, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.49% (0.2756 => 0.2935, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.47% (0.4203 => 0.4475, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.47% (0.3865 => 0.4115, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.45% (2.0665 => 2.1998, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.41% (0.2872 => 0.3056, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.33% (0.2877 => 0.3059, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 6.32% (0.4048 => 0.4304, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 6.30% (0.2871 => 0.3052, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 6.29% (0.3387 => 0.3600, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.27% (0.2793 => 0.2968, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hello: 6.26% (0.2714 => 0.2884, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/random: 6.25% (0.2802 => 0.2977, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.24% (0.1940 => 0.2061, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.22% (0.3826 => 0.4064, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 6.19% (0.3603 => 0.3826, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.18% (0.3283 => 0.3486, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 6.16% (3.8723 => 4.1107, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.11% (0.3307 => 0.3509, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.10% (7.9617 => 8.4470, std.dev.: 0.0184) SingleSource/Benchmarks/Shootout-C++/lists1: 6.03% (0.3684 => 0.3906, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 5.91% (0.4620 => 0.4893, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.84% (0.3441 => 0.3642, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.80% (0.2603 => 0.2754, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 5.79% (21.9371 => 23.2081, std.dev.: 0.0221) SingleSource/Benchmarks/Shootout-C++/ary2: 5.77% (0.3379 => 0.3574, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 5.73% (1.0722 => 1.1336, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.72% (1.1861 => 1.2539, std.dev.: 0.0033) MultiSource/Applications/siod/siod: 5.59% (2.2969 => 2.4254, std.dev.: 0.0184) MultiSource/Applications/treecc/treecc: 5.51% (2.0273 => 2.1391, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/09-vor/vor: 5.47% (0.3180 => 0.3354, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.40% (0.5981 => 0.6304, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/football/football: 5.26% (0.8921 => 0.9390, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.21% (0.6450 => 0.6786, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.53% (1.4186 => 1.4829, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.50% (0.2266 => 0.2368, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.47% (0.3131 => 0.3271, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.46% (1.1840 => 1.2368, std.dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 4.38% (1.2842 => 1.3404, std.dev.: 0.0120) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.64% (0.8101 => 0.8396, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.03% (0.3427 => 0.3531, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.86% (1.1194 => 1.1514, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.81% (14.3668 => 14.7711, std.dev.: 0.0211) MultiSource/Applications/sqlite3/sqlite3: 2.24% (17.1811 => 17.5654, std.dev.: 0.0099) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 10.21% (3.1595 => 3.4820, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: 10.05% (1.1396 => 1.2541, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3681, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: 3.64% (0.5413 => 0.5610, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.48% (3.6395 => 3.7660, std.dev.: 0.0056) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.68% (4.2280 => 4.3412, std.dev.: 0.0179) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7651, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8131, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5754, std.dev.: 0.0094) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1284, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: -80.03% (0.8651 => 0.1728, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.20% (5.2763 => 3.2605, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.29% (5.3855 => 3.6464, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.80% (5.3526 => 3.6507, std.dev.: 0.0128) SingleSource/UnitTests/Vector/constpool: -14.64% (54.1659 => 46.2341, std.dev.: 0.0395) MultiSource/Benchmarks/FreeBench/mason/mason: -13.93% (0.0811 => 0.0698, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -11.62% (22.1758 => 19.5983, std.dev.: 0.0401) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.79% (2.9384 => 2.6213, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -33.45% (1.1492 => 0.7648, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4230, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.83% (0.0998 => 0.0860, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -12.37% (1.2373 => 1.0842, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/mandel-2: -10.42% (1.5373 => 1.3771, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/mason/mason: -10.13% (0.2161 => 0.1942, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.27% (19.9488 => 18.3000, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.71% (1.8329 => 1.7099, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.30% (1.6805 => 1.5915, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.52% (1.5835 => 1.5120, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.80% (0.9957 => 0.9579, std.dev.: 0.0024) MultiSource/Applications/siod/siod: -3.72% (3.2827 => 3.1605, std.dev.: 0.0075) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5022, std.dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0990, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.77% (1.3677 => 1.3298, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.37% (0.4808 => 0.4694, std.dev.: 0.0012) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.98% (10.2830 => 10.0797, std.dev.: 0.0226) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.95% (8.6802 => 8.5106, std.dev.: 0.0093) MultiSource/Applications/sqlite3/sqlite3: -1.86% (4.6441 => 4.5577, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6827, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.70% (8.1563 => 8.0180, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5141, std.dev.: 0.0033) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4234, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8577, std.dev.: 0.0034) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.35% (0.5229 => 0.5770, std.dev.: 0.0054) MultiSource/Applications/SPASS/SPASS: 6.97% (14.9895 => 16.0348, std.dev.: 0.0380) MultiSource/Benchmarks/MallocBench/gs/gs: 5.51% (4.1105 => 4.3368, std.dev.: 0.0139) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.99% (1.1048 => 1.2373, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.11% (7.1582 => 7.5238, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/stepanov_container: 17.45% (0.6222 => 0.7308, std.dev.: 0.0187) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36300.00% (0.0001 => 0.0364, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.98% (0.2116 => 0.2158, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 01:15:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 03:15:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121004081518.D82DB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4549?compare_to=4546&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4549, Order: 165204, Start Time: 2012-10-04 06:48:16, End Time: 2012-10-04 08:16:59 To: 4546, Order: 165199, Start Time: 2012-10-04 04:54:12, End Time: 2012-10-04 06:19:23 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (5 on baseline) Performance Regressions: 0 (153 on baseline) Performance Improvements: 0 (33 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 5 (0 on baseline) Unchanged Tests: 1037 (716 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.12% (33.1778 => 33.2176, std.dev.: 0.0134) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.02% (2.7521 => 2.7526, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.00% (2.1154 => 2.1153, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.09% (4.9699 => 4.9746, std.dev.: 0.0002) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.23% (33.2944 => 33.2176, std.dev.: 0.0134) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: -100.00% (7.3305 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.55% (2.0176 => 2.4322, std.dev.: 0.0165) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.80% (0.1410 => 0.1661, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/flops: 14.65% (0.0826 => 0.0947, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 13.64% (0.2243 => 0.2549, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.19% (0.0819 => 0.0927, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.46% (0.1413 => 0.1575, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/tsp/tsp: 11.25% (0.1013 => 0.1127, std.dev.: 0.0041) SingleSource/UnitTests/ObjC++/property-reference-object: 11.10% (0.5818 => 0.6464, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 11.09% (0.7061 => 0.7844, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.96% (0.1588 => 0.1762, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.86% (0.5748 => 0.6372, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.77% (0.2721 => 0.3014, std.dev.: 0.0009) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.73% (0.1072 => 0.1187, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 10.69% (1.3693 => 1.5157, std.dev.: 0.0418) SingleSource/Benchmarks/Shootout-C++/hash2: 10.67% (0.4328 => 0.4790, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.64% (3.9660 => 4.3878, std.dev.: 0.1249) MultiSource/Applications/lambda-0_1_3/lambda: 10.63% (0.7038 => 0.7786, std.dev.: 0.0265) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.58% (0.7710 => 0.8526, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: 10.56% (0.4062 => 0.4491, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.43% (0.6959 => 0.7685, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.43% (0.5265 => 0.5814, std.dev.: 0.0019) SingleSource/Regression/C++/ofstream_ctor: 10.36% (0.2781 => 0.3069, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.29% (1.4563 => 1.6062, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.29% (0.2596 => 0.2863, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.28% (0.2782 => 0.3068, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.16% (0.9199 => 1.0134, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.08% (1.2193 => 1.3422, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.83% (0.2655 => 0.2916, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.76% (0.3485 => 0.3825, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 9.74% (0.2607 => 0.2861, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 9.74% (0.2937 => 0.3223, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 9.70% (0.2628 => 0.2883) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.68% (0.6283 => 0.6891, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 9.67% (0.2690 => 0.2950, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.66% (0.3022 => 0.3314, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.65% (0.1327 => 0.1455, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.61% (1.9828 => 2.1733, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/except: 9.57% (0.2760 => 0.3024, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.56% (0.4016 => 0.4400, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.56% (1.1364 => 1.2450, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.55% (0.2765 => 0.3029, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.54% (0.2966 => 0.3249, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.54% (0.3899 => 0.4271, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.41% (0.3580 => 0.3917, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.40% (0.3489 => 0.3817, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.38% (0.2696 => 0.2949, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 9.34% (13.8202 => 15.1104, std.dev.: 0.2757) SingleSource/Benchmarks/Shootout-C++/strcat: 9.28% (0.2726 => 0.2979, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 9.27% (0.2761 => 0.3017, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.21% (0.1986 => 0.2169, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 9.20% (0.3293 => 0.3596, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.16% (0.3756 => 0.4100, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 9.13% (0.3868 => 0.4221, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 9.12% (0.3453 => 0.3768, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 9.10% (0.2988 => 0.3260, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 9.04% (0.3107 => 0.3388, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.04% (0.3130 => 0.3413, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary3: 8.99% (0.3149 => 0.3432, std.dev.: 0.0039) SingleSource/Benchmarks/McGill/chomp: 8.94% (0.1589 => 0.1731, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.89% (0.2127 => 0.2316, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/ary2: 8.87% (0.3192 => 0.3475, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.86% (0.4390 => 0.4779, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 8.85% (0.2995 => 0.3260, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.82% (0.5577 => 0.6069, std.dev.: 0.0028) MultiSource/Applications/Burg/burg: 8.78% (1.1061 => 1.2032, std.dev.: 0.0341) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.62% (0.1276 => 0.1386, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 8.60% (0.3534 => 0.3838, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.50% (0.4379 => 0.4751, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.48% (0.2914 => 0.3161, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.46% (0.5637 => 0.6114, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: 8.46% (0.7506 => 0.8141, std.dev.: 0.0201) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.45% (0.4791 => 0.5196, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.44% (0.3246 => 0.3520, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.12% (7.2180 => 7.8038, std.dev.: 0.0303) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.02% (0.3755 => 0.4056, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.01% (0.6576 => 0.7103, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/objinst: 7.98% (0.2945 => 0.3180, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 7.97% (0.8310 => 0.8972, std.dev.: 0.0062) MultiSource/Applications/kimwitu++/kc: 7.95% (16.6129 => 17.9329, std.dev.: 0.4795) MultiSource/Applications/d/make_dparser: 7.83% (3.1889 => 3.4387, std.dev.: 0.0749) SingleSource/UnitTests/ObjC/trivial-interface: 7.74% (0.3578 => 0.3855, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.68% (0.8698 => 0.9366, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/parameter-passing: 7.64% (0.4003 => 0.4309, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 7.63% (3.8646 => 4.1595, std.dev.: 0.0939) SingleSource/UnitTests/ObjC/for-in: 7.63% (0.3789 => 0.4078, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.62% (0.3646 => 0.3924, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 7.60% (1.0594 => 1.1399, std.dev.: 0.0126) SingleSource/UnitTests/ObjC/exceptions: 7.56% (0.3914 => 0.4210, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.56% (0.3650 => 0.3926, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-2: 7.55% (0.3601 => 0.3873, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.51% (0.3663 => 0.3938, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.49% (0.1789 => 0.1923) SingleSource/UnitTests/ObjC/exceptions-3: 7.48% (0.3623 => 0.3894, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 7.47% (1.9270 => 2.0709, std.dev.: 0.0444) SingleSource/UnitTests/ObjC/property: 7.39% (0.3940 => 0.4231, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 7.28% (1.2749 => 1.3677, std.dev.: 0.0337) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.26% (1.3245 => 1.4207, std.dev.: 0.0136) MultiSource/Applications/JM/lencod/lencod: 7.25% (14.8535 => 15.9298, std.dev.: 0.3476) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.16% (3.6692 => 3.9320, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.13% (0.8818 => 0.9447, std.dev.: 0.0019) MultiSource/Benchmarks/sim/sim: 7.06% (0.3131 => 0.3352, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.88% (4.3801 => 4.6815, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.86% (0.3511 => 0.3752, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.81% (4.4433 => 4.7459, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 6.77% (8.4961 => 9.0713, std.dev.: 0.0136) MultiSource/Applications/oggenc/oggenc: 6.75% (4.6629 => 4.9777, std.dev.: 0.0999) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.71% (0.1819 => 0.1941, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.64% (0.2140 => 0.2282, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.50% (0.1569 => 0.1671, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.97% (3.2742 => 3.4698, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 5.94% (0.6250 => 0.6621, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.79% (0.2504 => 0.2649, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.58% (4.9865 => 5.2649, std.dev.: 0.0175) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.26% (0.9108 => 0.9587, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.08% (0.3245 => 0.3410, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.01% (1.5188 => 1.5949, std.dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.01% (6.2785 => 6.5929, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.84% (13.2842 => 13.9268, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.45% (2.1007 => 2.1941, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5170, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.11% (1.0895 => 1.3631, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/fbench: 24.20% (1.8175 => 2.2574, std.dev.: 0.0245) SingleSource/Benchmarks/Misc/richards_benchmark: 11.12% (1.1560 => 1.2846, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (3.1736 => 3.4147, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.22% (1.2998 => 1.3807, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.97% (0.2093 => 0.2197, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 4.75% (1.9144 => 2.0053, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6764, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9861, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.17% (7.4271 => 7.5884, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/ffbench: 1.70% (0.8273 => 0.8414, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5153, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/queens: 1.43% (2.1753 => 2.2064, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9689, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/oourafft: 1.28% (5.5130 => 5.5834, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1872, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.11% (8.8259 => 8.9238, std.dev.: 0.0147) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0268, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5877, std.dev.: 0.0068) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.64% (0.2670 => 0.1398, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -15.98% (0.0707 => 0.0594, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.50% (0.4657 => 0.3935, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.31% (1.3813 => 1.1837, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.23% (1.3819 => 1.1852, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.56% (22.5627 => 21.5331, std.dev.: 0.0220) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0177) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.44% (0.0997 => 0.0863, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -11.89% (0.2238 => 0.1972, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: -11.33% (1.2308 => 1.0914, std.dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.18% (20.3410 => 18.2711, std.dev.: 0.0225) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.99% (1.3780 => 1.2955, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5149, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.68% (0.9996 => 0.9528, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8005, std.dev.: 0.0032) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1560, std.dev.: 0.0323) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.04% (0.4867 => 0.4719, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.45% (3.0263 => 2.9523, std.dev.: 0.0042) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.94% (0.6589 => 0.6461, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.66% (28.2225 => 27.7535, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454) SingleSource/Benchmarks/Shootout/lists: -1.64% (6.3560 => 6.2517, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0075, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4954, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.12% (3.9173 => 3.8733, std.dev.: 0.0119) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2587, std.dev.: 0.0119) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 01:43:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 03:43:30 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121004084330.338C82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4550?compare_to=4547&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4550, Order: 165208, Start Time: 2012-10-04 07:18:23, End Time: 2012-10-04 08:45:12 To: 4547, Order: 165202, Start Time: 2012-10-04 05:26:55, End Time: 2012-10-04 06:59:39 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (14 on baseline) Performance Regressions: 9 (77 on baseline) Performance Improvements: 4 (48 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 69 (65 on baseline) Unchanged Tests: 960 (762 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.68% (0.5634 => 0.5785, std.dev.: 0.0037) MultiSource/Applications/minisat/minisat: 2.46% (0.6627 => 0.6790, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.91% (4.3470 => 4.4302, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.19% (1.0956 => 1.1086, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.17% (1.1438 => 1.1572, std.dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.03% (6.4798 => 6.5466, std.dev.: 0.0138) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.83% (1.3804 => 1.4057, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.41% (6.3689 => 6.4590, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout/hash: 1.10% (4.2858 => 4.3329, std.dev.: 0.0086) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.66% (0.8057 => 0.7843, std.dev.: 0.0065) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -4.20% (0.6071 => 0.5816, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/mandel-2: -2.52% (3.1543 => 3.0748, std.dev.: 0.0268) MultiSource/Benchmarks/Olden/tsp/tsp: -1.67% (1.7789 => 1.7492, std.dev.: 0.0061) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.42% (1.0186 => 1.0331, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 0.37% (0.6160 => 0.6183, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/08-main/main: -1.97% (0.1831 => 0.1795, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.79% (0.1563 => 0.1535, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.39% (0.3134 => 0.3209, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.92% (0.2397 => 0.2375, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.75% (0.3184 => 0.3208, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.24% (0.2272 => 0.2323, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: 3.38% (0.0414 => 0.0428, std.dev.: 0.0015) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 20.99% (0.0181 => 0.0219, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.51% (0.0196 => 0.0197, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 28.76% (0.0306 => 0.0394, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -9.52% (0.0252 => 0.0228, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0289 => 0.0289, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 15.85% (0.0284 => 0.0329, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 1.66% (0.0181 => 0.0184, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 9.58% (0.0167 => 0.0183, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: 9.61% (0.0229 => 0.0251, std.dev.: 0.0024) SingleSource/UnitTests/byval-alignment: 21.85% (0.0270 => 0.0329, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.68% (0.1461 => 0.1471, std.dev.: 0.0055) MultiSource/Applications/JM/lencod/lencod: -0.52% (0.2302 => 0.2290, std.dev.: 0.0026) MultiSource/Applications/lemon/lemon: 1.79% (1.4919 => 1.5186, std.dev.: 0.0316) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -2.26% (0.1546 => 0.1511, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/Bullet/bullet: -0.14% (0.5840 => 0.5832, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: -0.03% (26.7877 => 26.7807, std.dev.: 0.0388) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.70% (0.4018 => 0.4046, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.42% (0.1404 => 0.1438, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.24% (0.0589 => 0.0564, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 14.06% (0.0192 => 0.0219, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.13% (0.0619 => 0.0612, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.49% (1.1313 => 1.1258, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0016 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.67% (0.0572 => 0.0593, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 33.33% (0.0150 => 0.0200, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.04% (0.7648 => 0.7651, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.01% (1.7063 => 1.7065, std.dev.: 0.0045) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -44.63% (0.0121 => 0.0067, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Applications/JM/lencod/lencod: -96.61% (6.7458 => 0.2290, std.dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: -91.64% (6.9722 => 0.5832, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/09-vor/vor: 21549.72% (0.1237 => 26.7807, std.dev.: 0.0388) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005, std.dev.: 0.0000) New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 143.82% (0.0089 => 0.0217, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: 170.00% (0.0090 => 0.0243, std.dev.: 0.0002) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -26.39% (4.1772 => 3.0748, std.dev.: 0.0268) SingleSource/Benchmarks/Shootout-C++/except: 81950.00% (0.0006 => 0.4923, std.dev.: 0.0016) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_throw: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.62% (0.0745 => 0.0921, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 10.00% (0.6173 => 0.6790, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.58% (0.6410 => 0.7024, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.71% (0.1159 => 0.1260, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.71% (0.3582 => 0.3894, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: 8.51% (2.1763 => 2.3614, std.dev.: 0.0140) SingleSource/Benchmarks/Misc-C++/bigfib: 8.36% (0.5309 => 0.5753, std.dev.: 0.0076) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.07% (0.1414 => 0.1514, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.58% (0.2552 => 0.2720, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 6.52% (15.3105 => 16.3084, std.dev.: 0.1376) MultiSource/Applications/lemon/lemon: 6.36% (1.0046 => 1.0685, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.10% (1.5150 => 1.6074, std.dev.: 0.0124) MultiSource/Applications/lambda-0_1_3/lambda: 6.03% (0.6915 => 0.7332, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.78% (0.6069 => 0.6420, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.50% (0.7639 => 0.8059, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.31% (0.3901 => 0.4108, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.01% (0.2797 => 0.2937, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.98% (0.8569 => 0.8996, std.dev.: 0.0026) MultiSource/Applications/d/make_dparser: 4.74% (3.0225 => 3.1657, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.72% (0.7226 => 0.7567, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.69% (1.1672 => 1.2219, std.dev.: 0.0186) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.67% (6.2546 => 6.5466, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.53% (1.1827 => 1.2363, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.37% (0.2654 => 0.2770, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.34% (1.2021 => 1.2543, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.29% (12.6413 => 13.1839, std.dev.: 0.1036) MultiSource/Benchmarks/nbench/nbench: 4.22% (1.0821 => 1.1278, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.15% (0.3062 => 0.3189, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 4.04% (13.3238 => 13.8620, std.dev.: 0.1524) MultiSource/Applications/hbd/hbd: 4.03% (1.3268 => 1.3803, std.dev.: 0.0085) MultiSource/Applications/siod/siod: 4.01% (2.0972 => 2.1813, std.dev.: 0.0165) MultiSource/Applications/Burg/burg: 3.92% (1.1440 => 1.1889, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.87% (0.4880 => 0.5069, std.dev.: 0.0066) MultiSource/Applications/lua/lua: 3.81% (3.5980 => 3.7350, std.dev.: 0.0117) MultiSource/Benchmarks/mafft/pairlocalalign: 3.80% (8.2186 => 8.5305, std.dev.: 0.0086) MultiSource/Benchmarks/Bullet/bullet: 3.77% (29.3170 => 30.4225, std.dev.: 0.0967) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.71% (1.0689 => 1.1086, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.47% (4.2815 => 4.4302, std.dev.: 0.0055) MultiSource/Applications/oggenc/oggenc: 3.33% (4.7455 => 4.9037, std.dev.: 0.0514) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.32% (0.5937 => 0.6134, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.30% (1.2742 => 1.3163, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.19% (4.2616 => 4.3976, std.dev.: 0.0292) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.84% (4.0318 => 4.1465, std.dev.: 0.0308) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.75% (4.3380 => 4.4572, std.dev.: 0.0231) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.64% (0.5636 => 0.5785, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash2: 2.63% (0.3847 => 0.3948, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 2.55% (3.8796 => 3.9787, std.dev.: 0.0265) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.43% (0.4562 => 0.4673, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.43% (8.2559 => 8.4563, std.dev.: 0.0602) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.94% (0.5520 => 0.5627, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.88% (0.5963 => 0.6075, std.dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.41% (1.6538 => 2.3386, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 21.94% (3.4629 => 4.2227, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/ary3: 14.68% (1.7426 => 1.9984, std.dev.: 0.0257) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.10% (2.4042 => 2.7431, std.dev.: 0.0535) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.85% (4.0101 => 4.5654, std.dev.: 0.0162) SingleSource/Benchmarks/Stanford/Puzzle: 13.82% (0.1433 => 0.1631, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 11.10% (1.6261 => 1.8066, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.01% (0.0917 => 0.1018, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/mason/mason: 9.47% (0.5004 => 0.5478, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.82% (0.2857 => 0.3109, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/lists: 8.69% (7.0025 => 7.6111, std.dev.: 0.0188) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.98% (1.0063 => 1.0866, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/bisort/bisort: 6.98% (0.6459 => 0.6910, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.76% (0.3301 => 0.3524, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/dt: 4.18% (0.9851 => 1.0263, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: 4.15% (15.2242 => 15.8565, std.dev.: 0.0267) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.92% (3.4080 => 3.5417, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 3.60% (0.3420 => 0.3543, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 3.02% (3.5520 => 3.6592, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.90% (6.6312 => 6.8232, std.dev.: 0.0108) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.86% (0.5587 => 0.5747, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 2.38% (29.5232 => 30.2258, std.dev.: 0.2591) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.13% (2.6656 => 2.7225, std.dev.: 0.0136) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.62% (4.6127 => 4.6873, std.dev.: 0.0191) MultiSource/Benchmarks/Olden/power/power: 1.07% (1.4184 => 1.4336, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.03% (2.4455 => 2.4706, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -47.04% (0.0591 => 0.0313, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -43.93% (0.2996 => 0.1680, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.56% (1.4113 => 1.1353, std.dev.: 0.0108) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.44% (1.4189 => 1.1572, std.dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.00% (0.3497 => 0.2133, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.32% (5.2665 => 4.1437, std.dev.: 0.1407) SingleSource/Benchmarks/Shootout-C++/ary3: -21.14% (1.7473 => 1.3780, std.dev.: 0.0968) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.15% (1.7361 => 1.4731, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -14.32% (15.8312 => 13.5647, std.dev.: 0.5522) SingleSource/Benchmarks/Shootout/sieve: -12.21% (8.1594 => 7.1630, std.dev.: 0.0532) SingleSource/Benchmarks/Shootout-C++/ackermann: -10.50% (3.6023 => 3.2240, std.dev.: 0.1326) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.67% (1.1647 => 1.0521, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -9.16% (0.1114 => 0.1012, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.78% (1.4034 => 1.2802, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/flops: -8.38% (9.5474 => 8.7472, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.27% (3.2007 => 2.9360, std.dev.: 0.0914) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.88% (3.6254 => 3.3759, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/fibo: -6.67% (4.6355 => 4.3261, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/richards_benchmark: -6.52% (1.4441 => 1.3500, std.dev.: 0.0113) MultiSource/Applications/lambda-0_1_3/lambda: -6.43% (7.6833 => 7.1892, std.dev.: 0.0342) MultiSource/Benchmarks/FreeBench/distray/distray: -6.08% (0.2664 => 0.2502, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.04% (2.9728 => 2.7932, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: -5.90% (3.4230 => 3.2212, std.dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.59% (3.9413 => 3.7211, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/fib2: -4.98% (4.4195 => 4.1993, std.dev.: 0.0083) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.84% (0.4564 => 0.4343, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -4.43% (2.5166 => 2.4050, std.dev.: 0.0072) MultiSource/Benchmarks/mafft/pairlocalalign: -4.19% (62.4126 => 59.8003, std.dev.: 0.0214) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.96% (0.4140 => 0.3976, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/methcall: -3.68% (9.2503 => 8.9102, std.dev.: 0.0452) SingleSource/Benchmarks/McGill/misr: -3.42% (0.4296 => 0.4149, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.08% (3.7496 => 3.6342, std.dev.: 0.0320) MultiSource/Applications/SPASS/SPASS: -2.53% (8.5323 => 8.3168, std.dev.: 0.0779) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.50% (1.1683 => 1.1391, std.dev.: 0.0053) SingleSource/Benchmarks/Dhrystone/dry: -2.17% (2.4013 => 2.3491, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: -2.11% (92.7467 => 90.7942, std.dev.: 0.2364) SingleSource/Benchmarks/Shootout-C++/hash2: -1.92% (3.4876 => 3.4205, std.dev.: 0.0015) MultiSource/Benchmarks/sim/sim: -1.74% (3.8907 => 3.8229, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.74% (2.3569 => 2.3159, std.dev.: 0.0060) MultiSource/Applications/aha/aha: -1.71% (3.4286 => 3.3701, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/neural/neural: -1.64% (1.0926 => 1.0747, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.61% (9.3855 => 9.2344, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.60% (1.0686 => 1.0515, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.34% (61.1734 => 60.3560, std.dev.: 0.2186) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.30% (27.1724 => 26.8180, std.dev.: 0.0419) SingleSource/Benchmarks/Dhrystone/fldry: -1.30% (2.4971 => 2.4647, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.29% (25.6658 => 25.3358, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/lists: -1.18% (16.5617 => 16.3667, std.dev.: 0.0663) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 3.52% (0.9980 => 1.0331, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 2.67% (0.6022 => 0.6183, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/08-main/main: 7.74% (0.1666 => 0.1795, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.22% (0.1554 => 0.1535, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.09% (0.3083 => 0.3209, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.79% (0.2394 => 0.2375, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.04% (0.3175 => 0.3208, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.91% (0.2302 => 0.2323, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -4.68% (0.0449 => 0.0428, std.dev.: 0.0015) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -8.75% (0.0240 => 0.0219, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 2.60% (0.0192 => 0.0197, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.03% (0.0390 => 0.0394, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -24.25% (0.0301 => 0.0228, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.76% (0.0284 => 0.0289, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.54% (0.0324 => 0.0329, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 3.95% (0.0177 => 0.0184, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -3.17% (0.0189 => 0.0183, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: 0.80% (0.0249 => 0.0251, std.dev.: 0.0024) SingleSource/UnitTests/byval-alignment: 1.23% (0.0325 => 0.0329, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.94% (0.1429 => 0.1471, std.dev.: 0.0055) MultiSource/Applications/lemon/lemon: 1.11% (1.5019 => 1.5186, std.dev.: 0.0316) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.67% (0.1501 => 0.1511, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.11% (0.4264 => 0.4046, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.99% (0.1344 => 0.1438, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.24% (0.0589 => 0.0564, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.60% (0.0232 => 0.0219, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.23% (0.0639 => 0.0612, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.81% (1.1350 => 1.1258, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 166.67% (0.0006 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.91% (0.0637 => 0.0593, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.70% (0.0246 => 0.0200, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.46% (0.7541 => 0.7651, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.08% (1.5363 => 1.7065, std.dev.: 0.0045) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -4.29% (0.0070 => 0.0067, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 02:13:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 04:13:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121004091309.88A272A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4551?compare_to=4548&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4551, Order: 165212, Start Time: 2012-10-04 07:55:15, End Time: 2012-10-04 09:14:50 To: 4548, Order: 165203, Start Time: 2012-10-04 06:00:52, End Time: 2012-10-04 07:22:46 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (145 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 953 (697 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.33% (0.5770 => 0.5751, std.dev.: 0.0043) MultiSource/Applications/SPASS/SPASS: -0.24% (16.0348 => 15.9970, std.dev.: 0.0199) MultiSource/Benchmarks/Bullet/bullet: 0.13% (54.0506 => 54.1182, std.dev.: 0.0482) MultiSource/Benchmarks/MallocBench/gs/gs: -0.16% (4.3368 => 4.3297, std.dev.: 0.0209) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0463 => 0.0463, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0464 => 0.0464, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0432 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0434 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.47% (0.0424 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.24% (0.0423 => 0.0422, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0415 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0416 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.23% (0.0433 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.23% (0.0434 => 0.0433, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.23% (0.0427 => 0.0428) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0428 => 0.0428, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0418 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.24% (0.0419 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0425 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0426 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.23% (0.0436 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.23% (0.0438 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.24% (0.0413 => 0.0412, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.24% (0.0415 => 0.0414, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.24% (0.0425 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.24% (0.0425 => 0.0426, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0416 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.24% (0.0417 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0407 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.24% (0.0409 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.25% (0.0408 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0408 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.23% (0.0444 => 0.0443, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.22% (0.0445 => 0.0444, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.49% (0.0407 => 0.0405, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0406 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.49% (0.0409 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.24% (0.0409 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.24% (0.0415 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0415 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.02% (1.2373 => 1.2371, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.00% (7.5238 => 7.5236, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.34% (0.7308 => 0.7283, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.55% (0.0364 => 0.0362, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1431 => 0.1431, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.23% (0.2158 => 0.2163, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -14.43% (63.2438 => 54.1182, std.dev.: 0.0482) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 30.43% (14.1553 => 18.4622, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++-EH/spirit: 58.51% (3.4629 => 5.4891, std.dev.: 0.0178) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14230.42% (0.0720 => 10.3179, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9951900.00% (0.0001 => 9.9520, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 46.99% (0.2554 => 0.3754, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 45.54% (10.3673 => 15.0881, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/distray/distray: 30.02% (0.1056 => 0.1373, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 29.16% (0.1622 => 0.2095, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.30% (2.2022 => 2.5392, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.68% (7.0540 => 8.0892, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.51% (0.0834 => 0.0955, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 13.41% (0.1432 => 0.1624, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.22% (0.1566 => 0.1773, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.11% (1.7609 => 1.9742, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 10.51% (0.3282 => 0.3627, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.39% (0.3473 => 0.3834, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.30% (0.3543 => 0.3908, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.23% (0.1584 => 0.1746, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.19% (0.3543 => 0.3904, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 10.09% (0.3497 => 0.3850, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.08% (0.3561 => 0.3920, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.04% (0.3516 => 0.3869, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.85% (0.3694 => 0.4058, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.64% (0.3828 => 0.4197, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 9.60% (0.3927 => 0.4304, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.44% (0.3886 => 0.4253, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.06% (0.4879 => 0.5321, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/power/power: 8.68% (0.1440 => 0.1565, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.31% (0.3177 => 0.3441, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 8.28% (0.1655 => 0.1792, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 8.19% (9.4845 => 10.2615, std.dev.: 0.0082) MultiSource/Applications/sgefa/sgefa: 8.14% (0.3109 => 0.3362, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.07% (0.1438 => 0.1554, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 7.96% (5.7591 => 6.2177, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.94% (0.6675 => 0.7205, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.84% (1.5415 => 1.6624, std.dev.: 0.0045) MultiSource/Applications/JM/ldecod/ldecod: 7.84% (10.4361 => 11.2545, std.dev.: 0.0521) MultiSource/Applications/minisat/minisat: 7.74% (0.7115 => 0.7666, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 7.64% (0.7433 => 0.8001, std.dev.: 0.0132) SingleSource/UnitTests/ObjC++/Hello: 7.58% (0.5925 => 0.6374, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 7.50% (0.6030 => 0.6482, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.41% (0.2065 => 0.2218, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.35% (0.2271 => 0.2438, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.26% (0.4615 => 0.4950, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.25% (0.8067 => 0.8652, std.dev.: 0.0013) MultiSource/Applications/d/make_dparser: 7.22% (3.3354 => 3.5763, std.dev.: 0.0159) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.19% (0.2700 => 0.2894, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 7.14% (0.1695 => 0.1816, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 7.13% (0.3423 => 0.3667, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.07% (0.5105 => 0.5466, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.03% (1.3050 => 1.3967, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.02% (0.1625 => 0.1739, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.95% (0.8172 => 0.8740, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.91% (0.5860 => 0.6265, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.88% (0.2891 => 0.3090, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 6.84% (0.7326 => 0.7827, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.82% (4.2646 => 4.5555, std.dev.: 0.0087) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.82% (0.1892 => 0.2021, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.81% (8.1363 => 8.6901, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.72% (0.5569 => 0.5943, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.71% (0.2758 => 0.2943, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.69% (0.1510 => 0.1611, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 6.66% (0.3422 => 0.3650, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.66% (5.0018 => 5.3347, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.63% (4.9449 => 5.2726, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.57% (0.3865 => 0.4119, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.56% (0.9765 => 1.0406, std.dev.: 0.0018) SingleSource/Regression/C++/ofstream_ctor: 6.54% (0.2905 => 0.3095, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.53% (0.2756 => 0.2936, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 6.52% (0.7835 => 0.8346, std.dev.: 0.0055) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.50% (0.3121 => 0.3324, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.50% (0.2107 => 0.2244, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.46% (0.4103 => 0.4368, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.41% (0.2793 => 0.2972, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 6.38% (0.3603 => 0.3833, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/wc: 6.36% (0.3052 => 0.3246, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 6.30% (0.6456 => 0.6863, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.29% (0.1940 => 0.2062, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 6.26% (1.5603 => 1.6579, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.23% (0.4203 => 0.4465, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 6.23% (0.4289 => 0.4556, std.dev.: 0.0031) MultiSource/Applications/Burg/burg: 6.21% (1.1642 => 1.2365, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/hello: 6.19% (0.2714 => 0.2882, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.17% (0.3162 => 0.3357, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.16% (0.3650 => 0.3875, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.16% (2.0665 => 2.1938, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.15% (0.3136 => 0.3329, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.14% (0.3826 => 0.4061, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/random: 6.14% (0.2802 => 0.2974, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.14% (0.5020 => 0.5328, std.dev.: 0.0025) MultiSource/Benchmarks/sim/sim: 6.11% (0.3387 => 0.3594, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 6.10% (0.3232 => 0.3429, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.08% (0.3307 => 0.3508, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.06% (0.2871 => 0.3045, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.06% (0.2872 => 0.3046, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 6.04% (0.3098 => 0.3285, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.03% (0.4048 => 0.4292, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.96% (7.9617 => 8.4360, std.dev.: 0.0040) MultiSource/Applications/JM/lencod/lencod: 5.93% (21.9371 => 23.2371, std.dev.: 0.2321) MultiSource/Applications/lua/lua: 5.85% (3.8723 => 4.0988, std.dev.: 0.0141) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.85% (0.4636 => 0.4907, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary3: 5.79% (0.3283 => 0.3473, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.75% (0.3684 => 0.3896, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 5.74% (1.0722 => 1.1337, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 5.74% (0.2877 => 0.3042, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 5.68% (0.4299 => 0.4543, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.67% (0.3441 => 0.3636, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 5.65% (0.4620 => 0.4881, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.65% (1.1861 => 1.2531, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 5.53% (0.3180 => 0.3356, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.53% (0.2603 => 0.2747, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 5.45% (2.0273 => 2.1377, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 5.45% (0.3379 => 0.3563, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.30% (0.6450 => 0.6792, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.18% (0.5981 => 0.6291, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 5.12% (0.8921 => 0.9378, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 5.00% (2.2969 => 2.4118, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.63% (0.4064 => 0.4252, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.60% (1.5859 => 1.6588, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.53% (1.4186 => 1.4828, std.dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 4.17% (1.1840 => 1.2334, std.dev.: 0.0060) MultiSource/Applications/hexxagon/hexxagon: 4.16% (1.2842 => 1.3376, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.11% (2.2024 => 2.2929, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 3.93% (0.3131 => 0.3254, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.51% (0.8101 => 0.8385, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.80% (14.3668 => 14.7697, std.dev.: 0.0087) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.69% (1.1194 => 1.1495, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 2.32% (17.1811 => 17.5797, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.88% (3.8922 => 3.9654, std.dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 10.16% (3.1595 => 3.4806, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 9.88% (1.1396 => 1.2522, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (3.1578 => 3.3678, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.57% (3.6395 => 3.7693, std.dev.: 0.0037) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.85% (4.2280 => 4.3485, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8132, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1282, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -80.06% (0.8651 => 0.1725, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.24% (5.2763 => 3.2588, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.74% (5.3855 => 3.6224, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.27% (5.3526 => 3.6252, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -14.63% (54.1659 => 46.2437, std.dev.: 0.0324) MultiSource/Benchmarks/FreeBench/mason/mason: -13.93% (0.0811 => 0.0698, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -11.78% (22.1758 => 19.5628, std.dev.: 0.0181) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.02% (2.9384 => 2.6147, std.dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -33.53% (1.1492 => 0.7639, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: -15.98% (1.6925 => 1.4221, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.83% (0.0998 => 0.0860, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -12.38% (1.2373 => 1.0841, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/mandel-2: -10.28% (1.5373 => 1.3792, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -9.90% (0.2161 => 0.1947, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.61% (19.9488 => 18.2307, std.dev.: 0.0261) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.75% (1.8329 => 1.7091, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.33% (1.6805 => 1.5910, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5080, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.82% (0.9957 => 0.9577, std.dev.: 0.0024) MultiSource/Applications/siod/siod: -3.61% (3.2827 => 3.1641, std.dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5037, std.dev.: 0.0065) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0992, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.67% (1.3677 => 1.3312, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.23% (0.4808 => 0.4701, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.15% (8.1563 => 7.9809, std.dev.: 0.0193) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.10% (8.6802 => 8.4975, std.dev.: 0.0130) MultiSource/Applications/sqlite3/sqlite3: -1.97% (4.6441 => 4.5527, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6812, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -1.69% (10.2830 => 10.1090, std.dev.: 0.0181) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.65% (2.5528 => 2.5108, std.dev.: 0.0021) MultiSource/Benchmarks/NPB-serial/is/is: -1.45% (9.5636 => 9.4248, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout/lists: -1.08% (6.2999 => 6.2317, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8571, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 9.98% (0.5229 => 0.5751, std.dev.: 0.0043) MultiSource/Applications/SPASS/SPASS: 6.72% (14.9895 => 15.9970, std.dev.: 0.0199) MultiSource/Benchmarks/MallocBench/gs/gs: 5.33% (4.1105 => 4.3297, std.dev.: 0.0209) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.98% (1.1048 => 1.2371, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.10% (7.1582 => 7.5236, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 17.05% (0.6222 => 0.7283, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36100.00% (0.0001 => 0.0362, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.22% (0.2116 => 0.2163, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 02:21:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 04:21:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121004092106.A04E02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4552?compare_to=4545&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4552, Order: 165204, Start Time: 2012-10-04 06:10:25, End Time: 2012-10-04 09:22:48 To: 4545, Order: 165190, Start Time: 2012-10-04 02:30:40, End Time: 2012-10-04 05:40:38 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 0 (127 on baseline) Performance Improvements: 6 (17 on baseline) Added Tests: 0 (131 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1033 (764 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference-object: -1.98% (0.6505 => 0.6376, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -1.94% (0.6441 => 0.6316, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: -1.40% (0.7809 => 0.7700, std.dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.18% (2.9531 => 2.9183, std.dev.: 0.0055) MultiSource/Benchmarks/mafft/pairlocalalign: -1.15% (2.2466 => 2.2208, std.dev.: 0.0085) MultiSource/Applications/hexxagon/hexxagon: -1.12% (1.0741 => 1.0621, std.dev.: 0.0033) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.01% (9.8083 => 9.8093, std.dev.: 0.0252) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.02% (9.4106 => 9.4128, std.dev.: 0.0316) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.05% (16.9527 => 16.9604, std.dev.: 0.0011) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.12% (0.0625 => 0.0732, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.08% (0.1063 => 0.1202, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 12.04% (1.5932 => 1.7851, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-2: 10.85% (0.3446 => 0.3820, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.84% (0.3496 => 0.3875, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.81% (0.3488 => 0.3865, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 10.79% (0.3465 => 0.3839, std.dev.: 0.0062) SingleSource/UnitTests/ObjC/trivial-interface: 10.78% (0.3442 => 0.3813, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.72% (0.3460 => 0.3831, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.67% (0.3469 => 0.3839, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.49% (0.3643 => 0.4025, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.44% (0.3650 => 0.4031, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.12% (0.3724 => 0.4101, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 8.52% (0.3004 => 0.3260, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.41% (0.5826 => 0.6316, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 8.34% (0.1619 => 0.1754, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 8.29% (0.1218 => 0.1319, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.29% (0.4994 => 0.5408, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 8.27% (0.5889 => 0.6376, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 8.16% (0.1421 => 0.1537, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.10% (1.3152 => 1.4217, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.02% (0.1620 => 0.1750, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.96% (0.2738 => 0.2956, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.78% (1.6211 => 1.7472, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.66% (0.5000 => 0.5383, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.65% (0.2875 => 0.3095, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.64% (0.4361 => 0.4694, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.54% (0.3195 => 0.3436, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.53% (0.3930 => 0.4226, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 7.44% (0.2823 => 0.3033, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.41% (0.2725 => 0.2927, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.41% (3.5627 => 3.8267, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/methcall: 7.39% (0.2813 => 0.3021, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.38% (0.7171 => 0.7700, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: 7.31% (0.2750 => 0.2951, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.30% (0.2714 => 0.2912, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.26% (0.2729 => 0.2927, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.25% (0.4139 => 0.4439, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.24% (2.0673 => 2.2169, std.dev.: 0.0492) MultiSource/Applications/d/make_dparser: 7.23% (1.0781 => 1.1561, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/matrix: 7.23% (0.2780 => 0.2981, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.22% (0.5026 => 0.5389, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.21% (0.2911 => 0.3121, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.20% (0.2792 => 0.2993, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 7.19% (0.9909 => 1.0621, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/random: 7.14% (0.2803 => 0.3003, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 7.11% (0.3096 => 0.3316, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary3: 7.07% (0.3267 => 0.3498, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 7.05% (5.5417 => 5.9325, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.05% (0.2014 => 0.2156, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.97% (0.2811 => 0.3007, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.94% (0.3845 => 0.4112, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.93% (2.7292 => 2.9183, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary: 6.91% (0.3258 => 0.3483, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.90% (0.5900 => 0.6307, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 6.90% (0.4146 => 0.4432, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 6.82% (0.3678 => 0.3929, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.81% (0.3317 => 0.3543, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 6.80% (23.5202 => 25.1192, std.dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.69% (0.2736 => 0.2919, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 6.63% (0.2566 => 0.2736, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.62% (0.3625 => 0.3865, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.57% (0.3348 => 0.3568, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 6.56% (0.3477 => 0.3705, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 6.52% (0.3726 => 0.3969, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.52% (0.1549 => 0.1650, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 6.50% (4.2109 => 4.4845, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/gs/gs: 6.43% (1.8794 => 2.0003, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 6.43% (0.4029 => 0.4288, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.42% (0.2866 => 0.3050, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 6.33% (0.4251 => 0.4520, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.23% (0.3903 => 0.4146, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 6.23% (0.6634 => 0.7047, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.18% (0.3690 => 0.3918, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.09% (0.3890 => 0.4127, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 6.03% (0.5012 => 0.5314, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 5.95% (4.6177 => 4.8926, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.93% (0.2969 => 0.3145, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.90% (0.3981 => 0.4216, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.90% (0.9697 => 1.0269, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.88% (0.4658 => 0.4932, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 5.88% (0.5546 => 0.5872, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 5.88% (0.3336 => 0.3532, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 5.84% (1.4269 => 1.5103, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.79% (0.1968 => 0.2082, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.74% (0.3084 => 0.3261, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.73% (4.4195 => 4.6726, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.69% (0.6435 => 0.6801, std.dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 5.69% (2.1013 => 2.2208, std.dev.: 0.0085) MultiSource/Applications/SIBsim4/SIBsim4: 5.65% (0.2691 => 0.2843, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.50% (0.3271 => 0.3451, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.46% (0.2068 => 0.2181, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 5.45% (2.1653 => 2.2834, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/football/football: 5.35% (0.2075 => 0.2186, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.33% (0.2737 => 0.2883, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.33% (1.9694 => 2.0743, std.dev.: 0.0051) MultiSource/Applications/treecc/treecc: 5.08% (0.7875 => 0.8275, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.99% (0.2103 => 0.2208, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.91% (1.9966 => 2.0947, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 4.54% (2.0346 => 2.1269, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.15% (0.7426 => 0.7734, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.81% (0.5584 => 0.5797, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.78% (11.6398 => 12.0797, std.dev.: 0.0318) MultiSource/Applications/lambda-0_1_3/lambda: 3.72% (0.3498 => 0.3628, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.51% (4.6926 => 4.8574, std.dev.: 0.0080) MultiSource/Applications/kimwitu++/kc: 2.46% (11.9555 => 12.2502, std.dev.: 0.0526) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.12% (0.0734 => 0.0867, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6098, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/objinst: 5.22% (12.0509 => 12.6796, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-2: 5.06% (1.8057 => 1.8971, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1690, std.dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/dry: 4.15% (14.0481 => 14.6315, std.dev.: 0.0123) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.41% (79.9355 => 82.6639, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1941, std.dev.: 0.0073) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5039, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.58% (3.1722 => 3.2222, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.46% (1.0927 => 1.1087, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2898, std.dev.: 0.0036) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5137, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5825, std.dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.75% (25.4195 => 16.5854, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/ary2: -8.74% (0.2402 => 0.2192, std.dev.: 0.0059) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9769, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8032, std.dev.: 0.0090) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8019, std.dev.: 0.0128) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std.dev.: 0.0063) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7730, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -2.36% (17.2379 => 16.8308, std.dev.: 0.0461) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8595, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5790, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4955, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (105.3826 => 104.1649, std.dev.: 0.0463) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0483, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 03:09:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 05:09:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121004100956.BC99A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4553?compare_to=4549&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4553, Order: 165215, Start Time: 2012-10-04 08:46:19, End Time: 2012-10-04 10:11:37 To: 4549, Order: 165204, Start Time: 2012-10-04 06:48:16, End Time: 2012-10-04 08:16:59 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (5 on baseline) Performance Regressions: 1 (179 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 5 (0 on baseline) Unchanged Tests: 1036 (683 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.47% (54.5503 => 56.4453, std.dev.: 0.0570) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.43% (33.2176 => 33.3610, std.dev.: 0.0153) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (2.7526 => 2.7526, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.00% (2.1153 => 2.1154, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.01% (4.9746 => 4.9750) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.20% (33.2944 => 33.3610, std.dev.: 0.0153) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: -100.00% (7.3305 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.65% (2.0176 => 2.4343, std.dev.: 0.0067) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.16% (0.1410 => 0.1652, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 15.01% (0.0826 => 0.0950, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.04% (0.0819 => 0.0934, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 14.00% (0.2243 => 0.2557, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 12.14% (0.1013 => 0.1136, std.dev.: 0.0006) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.13% (0.1072 => 0.1202, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 11.58% (0.2781 => 0.3103, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 11.58% (0.4328 => 0.4829, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 11.52% (0.5818 => 0.6488, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.46% (0.1413 => 0.1575) MultiSource/Applications/hbd/hbd: 11.44% (1.3693 => 1.5259, std.dev.: 0.0074) SingleSource/UnitTests/ObjC++/Hello: 11.17% (0.5748 => 0.6390, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference: 11.09% (0.7061 => 0.7844, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.97% (0.7710 => 0.8556, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.96% (0.2782 => 0.3087, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.92% (0.2721 => 0.3018, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.74% (3.9660 => 4.3921, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.71% (0.2765 => 0.3061, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.68% (0.0964 => 0.1067, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 10.66% (0.4062 => 0.4495, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.63% (0.2596 => 0.2872, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.62% (0.3022 => 0.3343, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.62% (1.4563 => 1.6109, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 10.60% (0.7038 => 0.7784, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.58% (0.1588 => 0.1756, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.47% (0.3485 => 0.3850, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.45% (0.9199 => 1.0160, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.41% (1.9828 => 2.1892, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.40% (0.1327 => 0.1465, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.40% (0.2655 => 0.2931, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 10.40% (0.2607 => 0.2878, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.39% (0.3899 => 0.4304, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 10.35% (0.2628 => 0.2900, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 10.33% (0.2690 => 0.2968, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.31% (0.5265 => 0.5808, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 10.29% (0.2760 => 0.3044, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.29% (0.3489 => 0.3848, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.28% (0.4016 => 0.4429, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.23% (0.6959 => 0.7671, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.23% (1.2193 => 1.3440, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.15% (0.2966 => 0.3267, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 10.15% (0.2937 => 0.3235, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 10.14% (0.3293 => 0.3627, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 10.14% (0.2761 => 0.3041, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 10.12% (0.2726 => 0.3002, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.08% (0.3580 => 0.3941, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.05% (0.2696 => 0.2967, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/ary3: 10.03% (0.3149 => 0.3465, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 9.97% (0.2988 => 0.3286) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.96% (0.3756 => 0.4130, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.95% (0.6283 => 0.6908, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 9.93% (0.3453 => 0.3796, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.89% (0.1062 => 0.1167, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 9.88% (0.3107 => 0.3414, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.86% (0.4390 => 0.4823, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 9.82% (0.3868 => 0.4248, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.65% (1.1364 => 1.2461, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 9.65% (0.3534 => 0.3875, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.58% (0.1075 => 0.1178, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 9.52% (0.3192 => 0.3496, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.47% (0.1986 => 0.2174, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 9.43% (13.8202 => 15.1236, std.dev.: 0.0166) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.40% (0.1276 => 0.1396, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.27% (0.3130 => 0.3420, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.20% (0.5577 => 0.6090, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/objinst: 9.10% (0.2945 => 0.3213, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.08% (0.1157 => 0.1262, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 9.06% (0.1589 => 0.1733, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 8.86% (1.0313 => 1.1227, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 8.81% (0.2995 => 0.3259, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.78% (0.1435 => 0.1561, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.77% (0.4379 => 0.4763, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.74% (0.2127 => 0.2313, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.69% (0.3246 => 0.3528, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.67% (0.5637 => 0.6126, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 8.65% (1.1061 => 1.2018, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.65% (0.7460 => 0.8105, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.64% (0.4791 => 0.5205, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.61% (0.2914 => 0.3165, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.52% (0.3755 => 0.4075, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 8.50% (16.6129 => 18.0244, std.dev.: 0.0174) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.33% (0.6576 => 0.7124, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.27% (0.8698 => 0.9417, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 8.26% (0.3220 => 0.3486, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 8.22% (0.7506 => 0.8123, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.22% (7.2180 => 7.8110, std.dev.: 0.0093) MultiSource/Benchmarks/MallocBench/gs/gs: 8.16% (3.8646 => 4.1799, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.15% (0.1865 => 0.2017, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 8.14% (0.6744 => 0.7293, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 8.11% (0.8310 => 0.8984, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 8.03% (0.2925 => 0.3160, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.91% (0.2023 => 0.2183, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 7.84% (3.1889 => 3.4390, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 7.75% (2.1791 => 2.3480, std.dev.: 0.0043) MultiSource/Applications/viterbi/viterbi: 7.71% (0.1478 => 0.1592, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.62% (1.3245 => 1.4254, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 7.57% (1.9270 => 2.0728, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/em3d/em3d: 7.54% (0.1657 => 0.1782, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 7.52% (1.0594 => 1.1391, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.43% (0.1789 => 0.1922, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.37% (0.1819 => 0.1953, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.23% (3.6692 => 3.9345, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.20% (0.1569 => 0.1682, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 7.10% (14.8535 => 15.9087, std.dev.: 0.0042) MultiSource/Benchmarks/sim/sim: 7.06% (0.3131 => 0.3352, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 7.05% (0.3914 => 0.4190, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 7.04% (0.4003 => 0.4285, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 7.04% (0.3578 => 0.3830, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.01% (0.2140 => 0.2290, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 7.00% (1.2292 => 1.3153, std.dev.: 0.0067) MultiSource/Applications/SIBsim4/SIBsim4: 7.00% (1.2749 => 1.3642, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.99% (4.3801 => 4.6861, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.94% (0.6135 => 0.6561, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.90% (4.4433 => 4.7499, std.dev.: 0.0079) MultiSource/Benchmarks/McCat/05-eks/eks: 6.86% (0.4113 => 0.4395, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.85% (0.3650 => 0.3900, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.84% (0.3789 => 0.4048, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.83% (0.3601 => 0.3847, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.80% (0.3940 => 0.4208, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.80% (0.3646 => 0.3894, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.77% (0.3663 => 0.3911, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 6.76% (4.6629 => 4.9781, std.dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 6.71% (8.4961 => 9.0666, std.dev.: 0.0072) SingleSource/UnitTests/ObjC/exceptions-3: 6.68% (0.3623 => 0.3865, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.52% (0.8818 => 0.9393, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 6.50% (0.6250 => 0.6656, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.47% (0.3511 => 0.3738, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.26% (1.1333 => 1.2042, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.19% (0.2504 => 0.2659, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.07% (3.2742 => 3.4731, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.90% (4.9865 => 5.2809, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.87% (0.4805 => 0.5087, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.64% (0.2321 => 0.2452, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 5.61% (6.5754 => 6.9445, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.61% (0.3245 => 0.3427, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.41% (1.5188 => 1.6010, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 5.35% (3.7467 => 3.9472, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.28% (0.9108 => 0.9589, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.11% (6.2785 => 6.5991, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.87% (13.2842 => 13.9317, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.72% (2.1007 => 2.1999, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 3.18% (16.2614 => 16.7778, std.dev.: 0.0058) MultiSource/Applications/ClamAV/clamscan: 2.68% (14.5298 => 14.9190, std.dev.: 0.0082) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5154, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.10% (1.0895 => 1.3630, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.30% (1.8175 => 2.2591, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/richards_benchmark: 11.02% (1.1560 => 1.2834, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.62% (3.1736 => 3.4153, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.20% (1.2998 => 1.3804, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.45% (0.2093 => 0.2207, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (1.7081 => 1.7749, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6774, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9862, std.dev.: 0.0008) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.58% (10.7476 => 11.0249, std.dev.: 0.0288) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.15% (7.4271 => 7.5865, std.dev.: 0.0035) MultiSource/Applications/lemon/lemon: 1.80% (1.4298 => 1.4556, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5140, std.dev.: 0.0082) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.32% (5.5130 => 5.5858, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2123, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1881, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 1.11% (12.4560 => 12.5937, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0267, std.dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.49% (0.2670 => 0.1402, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.04% (0.4657 => 0.3910, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -15.98% (0.0707 => 0.0594, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.23% (1.3813 => 1.1848, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.15% (1.3819 => 1.1863, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.35% (22.5627 => 21.5810, std.dev.: 0.0143) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.84% (0.0997 => 0.0859, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -11.93% (0.2238 => 0.1971, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.88% (1.2308 => 1.0969, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.14% (20.3410 => 18.2786, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.88% (1.3780 => 1.2970, std.dev.: 0.0231) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0052) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.58% (3.2729 => 3.1558, std.dev.: 0.0242) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.53% (1.7688 => 1.7064, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.14% (0.9996 => 0.9682, std.dev.: 0.0071) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.54% (26.5159 => 25.8436, std.dev.: 0.0212) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.52% (4.5947 => 4.4787, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.42% (3.0263 => 2.9530, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.33% (1.9762 => 1.9301, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.93% (0.6589 => 0.6462, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.71% (6.3560 => 6.2472, std.dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: -1.66% (28.2225 => 27.7531, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: -1.48% (4.5928 => 4.5248, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0082, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8669, std.dev.: 0.0062) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.15% (2.5254 => 2.4964, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2565, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.08% (9.3358 => 9.2353, std.dev.: 0.0371) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 03:31:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 05:31:16 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121004103116.57C7E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4554?compare_to=4550&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4554, Order: 165216, Start Time: 2012-10-04 09:01:15, End Time: 2012-10-04 10:32:59 To: 4550, Order: 165208, Start Time: 2012-10-04 07:18:23, End Time: 2012-10-04 08:45:12 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (14 on baseline) Performance Regressions: 3 (72 on baseline) Performance Improvements: 7 (47 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 69 (65 on baseline) Unchanged Tests: 963 (768 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Bullet/bullet: 1.01% (30.4225 => 30.7291, std.dev.: 0.0394) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.41% (41.8068 => 43.2322, std.dev.: 0.0236) SingleSource/Benchmarks/Shootout-C++/lists1: 2.05% (0.5768 => 0.5886, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.15% (0.7567 => 0.7253, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -2.57% (0.9028 => 0.8796, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.69% (0.8996 => 0.8844, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.50% (0.9140 => 0.9003, std.dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: -9.46% (0.1618 => 0.1465, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/ft/ft: -8.22% (0.9611 => 0.8821, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.41% (6.4590 => 6.3681, std.dev.: 0.0075) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.46% (1.0331 => 1.0180, std.dev.: 0.0081) MultiSource/Applications/sqlite3/sqlite3: 0.44% (0.6183 => 0.6210, std.dev.: 0.0103) MultiSource/Benchmarks/McCat/08-main/main: -1.89% (0.1795 => 0.1761, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.71% (0.1535 => 0.1592, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.37% (0.3209 => 0.3165, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.18% (0.2375 => 0.2347, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.78% (0.3208 => 0.3265, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.73% (0.2323 => 0.2340, std.dev.: 0.0109) SingleSource/Benchmarks/Misc/mandel: -9.35% (0.0428 => 0.0388, std.dev.: 0.0035) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 11.87% (0.0219 => 0.0245, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.02% (0.0197 => 0.0195, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.25% (0.0394 => 0.0395, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 5.70% (0.0228 => 0.0241, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -24.22% (0.0289 => 0.0219, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.30% (0.0329 => 0.0328, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 0.54% (0.0184 => 0.0185) SingleSource/UnitTests/Vector/Altivec/test1: -7.10% (0.0183 => 0.0170, std.dev.: 0.0014) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0251 => 0.0252, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 0.30% (0.0329 => 0.0330, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005) MultiSource/Applications/ClamAV/clamscan: -0.48% (0.1471 => 0.1464, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: -0.04% (0.2290 => 0.2289, std.dev.: 0.0087) MultiSource/Applications/lemon/lemon: 0.23% (1.5186 => 1.5221, std.dev.: 0.0288) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.26% (0.1511 => 0.1530, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -0.41% (0.5832 => 0.5808, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -0.19% (26.7807 => 26.7301, std.dev.: 0.0588) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.19% (0.4046 => 0.4094, std.dev.: 0.0639) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.17% (0.1438 => 0.1378, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.66% (0.0564 => 0.0579, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.39% (0.0219 => 0.0233, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.33% (0.0612 => 0.0663, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.37% (1.1258 => 1.1300, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -25.00% (0.0016 => 0.0012, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.67% (0.0593 => 0.0589, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.00% (0.0200 => 0.0180, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.39% (0.7651 => 0.7681, std.dev.: 0.0142) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.04% (1.7065 => 1.7072, std.dev.: 0.0011) SingleSource/UnitTests/2003-07-09-SignedArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 80.60% (0.0067 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Applications/JM/lencod/lencod: -96.61% (6.7458 => 0.2289, std.dev.: 0.0087) MultiSource/Benchmarks/Bullet/bullet: -91.67% (6.9722 => 0.5808, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/09-vor/vor: 21508.81% (0.1237 => 26.7301, std.dev.: 0.0588) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005) New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 146.07% (0.0089 => 0.0219, std.dev.: 0.0014) SingleSource/UnitTests/2003-08-11-VaListArg: 173.33% (0.0090 => 0.0246, std.dev.: 0.0002) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -26.19% (4.1772 => 3.0831, std.dev.: 0.0655) SingleSource/Benchmarks/Shootout-C++/except: 81066.67% (0.0006 => 0.4870, std.dev.: 0.0055) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: 200.00% (0.0001 => 0.0003, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.49% (0.0745 => 0.0920, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.61% (0.1159 => 0.1282, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 9.01% (2.1763 => 2.3723, std.dev.: 0.0337) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.92% (0.6410 => 0.6982, std.dev.: 0.0164) SingleSource/Benchmarks/Misc-C++/bigfib: 8.50% (0.5309 => 0.5760, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.07% (0.3582 => 0.3871, std.dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.85% (0.1414 => 0.1525, std.dev.: 0.0023) MultiSource/Applications/minisat/minisat: 7.57% (0.6173 => 0.6640, std.dev.: 0.0176) MultiSource/Applications/SIBsim4/SIBsim4: 6.55% (1.1653 => 1.2416, std.dev.: 0.0160) MultiSource/Applications/lemon/lemon: 6.54% (1.0046 => 1.0703, std.dev.: 0.0226) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.35% (0.2552 => 0.2714, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.97% (1.5150 => 1.6054, std.dev.: 0.0136) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.89% (0.7639 => 0.8089, std.dev.: 0.0083) MultiSource/Applications/kimwitu++/kc: 5.66% (15.3105 => 16.1776, std.dev.: 0.1766) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.51% (0.2797 => 0.2951, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.26% (0.6069 => 0.6388, std.dev.: 0.0077) MultiSource/Applications/d/make_dparser: 4.96% (3.0225 => 3.1724, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.94% (0.4248 => 0.4458, std.dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: 4.82% (29.3170 => 30.7291, std.dev.: 0.0394) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.45% (0.4880 => 0.5097, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.44% (0.2886 => 0.3014, std.dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 4.34% (1.0821 => 1.1291, std.dev.: 0.0100) MultiSource/Applications/SPASS/SPASS: 4.33% (13.3238 => 13.9008, std.dev.: 0.0489) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.30% (0.2952 => 0.3079, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.25% (0.3062 => 0.3192, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 4.17% (2.0972 => 2.1847, std.dev.: 0.0086) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.07% (0.2654 => 0.2762, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 3.97% (4.7455 => 4.9338, std.dev.: 0.0475) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.76% (3.0758 => 3.1914, std.dev.: 0.0277) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.72% (1.1827 => 1.2267, std.dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 3.71% (8.2186 => 8.5237, std.dev.: 0.0402) MultiSource/Applications/lua/lua: 3.70% (3.5980 => 3.7312, std.dev.: 0.0426) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.49% (12.6413 => 13.0825, std.dev.: 0.1703) MultiSource/Applications/treecc/treecc: 3.48% (1.8798 => 1.9453, std.dev.: 0.0035) MultiSource/Applications/Burg/burg: 3.44% (1.1440 => 1.1834, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.36% (1.4408 => 1.4892, std.dev.: 0.0175) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.21% (0.8569 => 0.8844, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: 3.04% (0.3847 => 0.3964, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash: 3.01% (0.3520 => 0.3626, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.99% (1.1672 => 1.2021, std.dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.64% (2.0317 => 2.0853, std.dev.: 0.0197) MultiSource/Applications/JM/ldecod/ldecod: 2.57% (6.4908 => 6.6579, std.dev.: 0.0508) MultiSource/Benchmarks/Prolangs-C/football/football: 2.43% (0.8405 => 0.8609, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.25% (0.5520 => 0.5644, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.10% (4.2616 => 4.3512, std.dev.: 0.0279) MultiSource/Benchmarks/MallocBench/gs/gs: 1.87% (3.8796 => 3.9523, std.dev.: 0.0210) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.75% (8.2559 => 8.4000, std.dev.: 0.0263) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 42.21% (0.0263 => 0.0374, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/pi: 41.44% (1.6538 => 2.3392, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2278, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout/ary3: 15.28% (1.7426 => 2.0088, std.dev.: 0.0148) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.70% (2.4042 => 2.7575, std.dev.: 0.0671) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.94% (4.0101 => 4.5693, std.dev.: 0.0084) SingleSource/Benchmarks/McGill/queens: 11.08% (1.6261 => 1.8063, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/mason/mason: 9.23% (0.5004 => 0.5466, std.dev.: 0.0019) SingleSource/Benchmarks/Stanford/Puzzle: 9.21% (0.1433 => 0.1565, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/lists: 8.59% (7.0025 => 7.6037, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.58% (0.2857 => 0.3102, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.46% (1.0063 => 1.0814, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.80% (40.4792 => 43.2322, std.dev.: 0.0236) MultiSource/Benchmarks/Olden/bisort/bisort: 6.77% (0.6459 => 0.6896, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.12% (0.3301 => 0.3470, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/dt: 4.40% (0.9851 => 1.0284, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: 4.18% (15.2242 => 15.8606, std.dev.: 0.0422) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.84% (3.4080 => 3.5389, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.60% (0.5587 => 0.5788, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.86% (6.6312 => 6.8209, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.51% (4.6127 => 4.7287, std.dev.: 0.0064) MultiSource/Applications/lua/lua: 2.30% (29.5232 => 30.2008, std.dev.: 0.2028) MultiSource/Applications/siod/siod: 2.11% (3.5520 => 3.6271, std.dev.: 0.0157) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.52% (2.4455 => 2.4826, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.4184 => 1.4392, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -43.99% (0.0591 => 0.0331, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -43.66% (0.2996 => 0.1688, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.75% (1.4113 => 1.1325, std.dev.: 0.0103) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.16% (1.4189 => 1.1471, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.06% (0.3497 => 0.2131, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.04% (5.2665 => 4.1583, std.dev.: 0.0534) SingleSource/Benchmarks/Shootout-C++/ary3: -19.88% (1.7473 => 1.3999, std.dev.: 0.0528) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.29% (15.8312 => 12.9363, std.dev.: 0.8801) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.19% (1.7361 => 1.4724, std.dev.: 0.0279) MultiSource/Benchmarks/McCat/17-bintr/bintr: -13.09% (0.0917 => 0.0797, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1585, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/moments: -9.69% (0.1114 => 0.1006, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.69% (1.1647 => 1.0518, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: -8.40% (9.5474 => 8.7454, std.dev.: 0.0332) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.33% (1.4034 => 1.2865, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.01% (3.2007 => 2.9444, std.dev.: 0.0201) MultiSource/Applications/lambda-0_1_3/lambda: -6.80% (7.6833 => 7.1611, std.dev.: 0.0392) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.76% (3.6254 => 3.3803, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/fibo: -6.60% (4.6355 => 4.3296, std.dev.: 0.0028) MultiSource/Applications/sgefa/sgefa: -6.27% (0.3746 => 0.3511, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.96% (2.9728 => 2.7955, std.dev.: 0.0131) MultiSource/Applications/SIBsim4/SIBsim4: -5.82% (3.4230 => 3.2238, std.dev.: 0.0279) SingleSource/Benchmarks/Misc/richards_benchmark: -5.57% (1.4441 => 1.3636, std.dev.: 0.0138) MultiSource/Benchmarks/FreeBench/distray/distray: -5.33% (0.2664 => 0.2522, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.22% (3.9413 => 3.7356, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout/fib2: -5.20% (4.4195 => 4.1895, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.91% (0.4564 => 0.4340, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: -4.66% (2.5166 => 2.3993, std.dev.: 0.0091) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.18% (0.4140 => 0.3967, std.dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: -4.14% (62.4126 => 59.8318, std.dev.: 0.0161) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.33% (1.2722 => 1.2298, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/methcall: -3.09% (9.2503 => 8.9648, std.dev.: 0.0272) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.38% (1.1683 => 1.1405, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/dry: -2.20% (2.4013 => 2.3485, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.12% (3.7496 => 3.6701, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hash2: -1.94% (3.4876 => 3.4200, std.dev.: 0.0246) MultiSource/Benchmarks/FreeBench/neural/neural: -1.89% (1.0926 => 1.0719, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.80% (2.3569 => 2.3144, std.dev.: 0.0040) MultiSource/Applications/aha/aha: -1.77% (3.4286 => 3.3680, std.dev.: 0.0038) MultiSource/Benchmarks/sim/sim: -1.74% (3.8907 => 3.8231, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.60% (1.0686 => 1.0515, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.59% (9.3855 => 9.2360, std.dev.: 0.0171) MultiSource/Benchmarks/PAQ8p/paq8p: -1.54% (92.7467 => 91.3206, std.dev.: 0.3721) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.35% (25.6658 => 25.3199, std.dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/fldry: -1.34% (2.4971 => 2.4636, std.dev.: 0.0040) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.25% (27.1724 => 26.8341, std.dev.: 0.0979) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.07% (61.1734 => 60.5190, std.dev.: 0.2129) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.00% (0.9980 => 1.0180, std.dev.: 0.0081) MultiSource/Applications/sqlite3/sqlite3: 3.12% (0.6022 => 0.6210, std.dev.: 0.0103) MultiSource/Benchmarks/McCat/08-main/main: 5.70% (0.1666 => 0.1761, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.45% (0.1554 => 0.1592, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.66% (0.3083 => 0.3165, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.96% (0.2394 => 0.2347, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.83% (0.3175 => 0.3265, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.65% (0.2302 => 0.2340, std.dev.: 0.0109) SingleSource/Benchmarks/Misc/mandel: -13.59% (0.0449 => 0.0388, std.dev.: 0.0035) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.08% (0.0240 => 0.0245, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.56% (0.0192 => 0.0195, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.28% (0.0390 => 0.0395, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -19.93% (0.0301 => 0.0241, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -22.89% (0.0284 => 0.0219, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.23% (0.0324 => 0.0328, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 4.52% (0.0177 => 0.0185) SingleSource/UnitTests/Vector/Altivec/test1: -10.05% (0.0189 => 0.0170, std.dev.: 0.0014) SingleSource/UnitTests/Vector/multiplies: 1.20% (0.0249 => 0.0252, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 1.54% (0.0325 => 0.0330, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005) MultiSource/Applications/ClamAV/clamscan: 2.45% (0.1429 => 0.1464, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.34% (1.5019 => 1.5221, std.dev.: 0.0288) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.93% (0.1501 => 0.1530, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.99% (0.4264 => 0.4094, std.dev.: 0.0639) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.53% (0.1344 => 0.1378, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.70% (0.0589 => 0.0579, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.43% (0.0232 => 0.0233, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.76% (0.0639 => 0.0663, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.44% (1.1350 => 1.1300, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.54% (0.0637 => 0.0589, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -26.83% (0.0246 => 0.0180, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.86% (0.7541 => 0.7681, std.dev.: 0.0142) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.12% (1.5363 => 1.7072, std.dev.: 0.0011) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 04:01:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 06:01:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121004110137.996F62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4555?compare_to=4551&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4555, Order: 165216, Start Time: 2012-10-04 09:43:45, End Time: 2012-10-04 11:03:19 To: 4551, Order: 165212, Start Time: 2012-10-04 07:55:15, End Time: 2012-10-04 09:14:50 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (147 on baseline) Performance Improvements: 0 (44 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 952 (696 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.10% (15.0881 => 15.2543, std.dev.: 0.0102) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.31% (0.5751 => 0.5769, std.dev.: 0.0097) MultiSource/Applications/SPASS/SPASS: 0.06% (15.9970 => 16.0068, std.dev.: 0.0064) MultiSource/Benchmarks/Bullet/bullet: -0.32% (54.1182 => 53.9435, std.dev.: 0.0201) MultiSource/Benchmarks/MallocBench/gs/gs: -0.02% (4.3297 => 4.3287, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.22% (0.0463 => 0.0464, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.43% (0.0464 => 0.0466) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.23% (0.0432 => 0.0433) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.23% (0.0434 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0422 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.24% (0.0422 => 0.0423, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0415 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0416 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.46% (0.0432 => 0.0434) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.23% (0.0433 => 0.0434, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.23% (0.0428 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.23% (0.0428 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0418 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.24% (0.0418 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0425 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0426 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.23% (0.0435 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0437 => 0.0437, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.24% (0.0412 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.24% (0.0414 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0424 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0426 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0416 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.24% (0.0416 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.49% (0.0407 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.25% (0.0408 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0407 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0408 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.23% (0.0443 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.23% (0.0444 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.25% (0.0405 => 0.0406, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.25% (0.0406 => 0.0407) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.74% (0.0407 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.25% (0.0408 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.48% (0.0414 => 0.0416) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.24% (0.0415 => 0.0416) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.01% (1.2371 => 1.2370, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.19% (7.5236 => 7.5379, std.dev.: 0.0400) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.30% (0.7283 => 0.7305, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.55% (0.0362 => 0.0360, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: - (0.1431 => 0.1431) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.06% (0.2163 => 0.2140, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -14.71% (63.2438 => 53.9435, std.dev.: 0.0201) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 30.75% (14.1553 => 18.5084, std.dev.: 0.0183) SingleSource/Benchmarks/Misc-C++-EH/spirit: 58.30% (3.4629 => 5.4817, std.dev.: 0.0024) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14229.72% (0.0720 => 10.3174, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952400.00% (0.0001 => 9.9525, std.dev.: 0.0012) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 47.14% (10.3673 => 15.2543, std.dev.: 0.0102) MultiSource/Benchmarks/McCat/08-main/main: 46.71% (0.2554 => 0.3747, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 29.73% (0.1056 => 0.1370, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 29.53% (0.1622 => 0.2101, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.73% (2.2022 => 2.5265, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.25% (7.0540 => 8.0595, std.dev.: 0.0156) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.47% (0.1566 => 0.1777) SingleSource/Benchmarks/Misc/flops: 13.41% (0.1432 => 0.1624, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.35% (0.0834 => 0.0937, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.80% (1.7609 => 1.9686, std.dev.: 0.0033) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.35% (0.1584 => 0.1748, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 10.16% (0.3473 => 0.3826, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 10.12% (0.3282 => 0.3614, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.02% (0.3543 => 0.3898, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.01% (0.3497 => 0.3847, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.96% (0.3543 => 0.3896, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.90% (0.3516 => 0.3864) SingleSource/UnitTests/ObjC/synchronized: 9.86% (0.3561 => 0.3912, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.61% (0.3694 => 0.4049, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.57% (0.3927 => 0.4303, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.51% (0.3828 => 0.4192, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.42% (0.3886 => 0.4252, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 8.61% (0.1440 => 0.1564, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 8.52% (0.1655 => 0.1796, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.32% (0.4879 => 0.5285, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.18% (0.3177 => 0.3437, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 8.12% (10.4361 => 11.2838, std.dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 8.12% (9.4845 => 10.2547, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.00% (0.6675 => 0.7209, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.00% (0.1438 => 0.1553, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 7.95% (0.5925 => 0.6396, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.84% (0.6030 => 0.6503, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.84% (1.5415 => 1.6623, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 7.82% (5.7591 => 6.2094, std.dev.: 0.0104) MultiSource/Applications/minisat/minisat: 7.80% (0.7115 => 0.7670, std.dev.: 0.0034) MultiSource/Applications/lambda-0_1_3/lambda: 7.63% (0.7433 => 0.8000, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 7.59% (0.3109 => 0.3345, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 7.45% (0.3423 => 0.3678, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.44% (0.2891 => 0.3106, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.41% (0.4615 => 0.4957, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.27% (0.2271 => 0.2436, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.22% (0.2065 => 0.2214, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 7.21% (3.3354 => 3.5758, std.dev.: 0.0199) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.20% (0.1625 => 0.1742, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 7.20% (0.1695 => 0.1817, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 7.13% (0.3422 => 0.3666, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.13% (1.3050 => 1.3980, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 7.13% (0.7326 => 0.7848, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.11% (0.2700 => 0.2892, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.08% (0.5860 => 0.6275, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.07% (0.8172 => 0.8750, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.07% (0.5105 => 0.5466, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 7.01% (0.3052 => 0.3266, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.95% (0.2905 => 0.3107, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.95% (4.2646 => 4.5609, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/fibo: 6.94% (0.2725 => 0.2914, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.89% (0.2756 => 0.2946, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.88% (0.3865 => 0.4131, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.85% (0.4103 => 0.4384, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.82% (0.1510 => 0.1613, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.82% (0.2714 => 0.2899, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.81% (8.1363 => 8.6904, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.77% (0.3162 => 0.3376, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/strcat: 6.71% (0.2831 => 0.3021, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 6.69% (0.6456 => 0.6888, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.67% (0.2802 => 0.2989, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.67% (0.9765 => 1.0416, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.66% (0.5569 => 0.5940, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.66% (0.2793 => 0.2979, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.65% (0.2872 => 0.3063, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.64% (0.4289 => 0.4574, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.64% (5.0018 => 5.3339, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.63% (0.3121 => 0.3328, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: 6.62% (0.3232 => 0.3446, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.61% (0.4203 => 0.4481, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.60% (0.3136 => 0.3343, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.60% (2.0665 => 2.2028, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.58% (4.9449 => 5.2701, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.55% (0.2107 => 0.2245, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.55% (0.3650 => 0.3889, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.55% (0.8067 => 0.8595, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 6.52% (0.3098 => 0.3300, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.51% (0.2871 => 0.3058, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 6.51% (0.7835 => 0.8345, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.49% (0.2758 => 0.2937, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 6.48% (1.5603 => 1.6614, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.46% (0.3826 => 0.4073, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 6.45% (0.4048 => 0.4309, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.38% (0.3307 => 0.3518, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.36% (0.2877 => 0.3060, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.36% (0.3603 => 0.3832, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.31% (0.3283 => 0.3490, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 6.29% (0.3387 => 0.3600, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 6.28% (1.1642 => 1.2373, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.24% (0.1940 => 0.2061, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.21% (0.4636 => 0.4924, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.20% (0.5020 => 0.5331, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 6.16% (0.3684 => 0.3911, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.15% (0.4620 => 0.4904, std.dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.98% (7.9617 => 8.4381, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/ary2: 5.92% (0.3379 => 0.3579, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 5.90% (3.8723 => 4.1009, std.dev.: 0.0091) MultiSource/Benchmarks/McCat/05-eks/eks: 5.89% (0.4299 => 0.4552, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 5.87% (1.0722 => 1.1351, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 5.73% (21.9371 => 23.1931, std.dev.: 0.0143) MultiSource/Benchmarks/McCat/09-vor/vor: 5.69% (0.3180 => 0.3361, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.67% (0.3441 => 0.3636, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.57% (1.1861 => 1.2522, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.53% (0.2603 => 0.2747, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.44% (0.1892 => 0.1995, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 5.39% (2.0273 => 2.1365, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.30% (0.6450 => 0.6792, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 5.17% (0.8921 => 0.9382, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.10% (0.5981 => 0.6286, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 5.09% (2.2969 => 2.4137, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.82% (0.4064 => 0.4260, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.74% (1.5859 => 1.6611, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 4.50% (0.3131 => 0.3272, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.48% (1.4186 => 1.4821, std.dev.: 0.0055) MultiSource/Applications/hexxagon/hexxagon: 4.42% (1.2842 => 1.3409, std.dev.: 0.0048) MultiSource/Benchmarks/nbench/nbench: 4.21% (1.1840 => 1.2339, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.19% (2.2024 => 2.2947, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.76% (0.8101 => 0.8406, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.80% (14.3668 => 14.7689, std.dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: 2.32% (17.1811 => 17.5795, std.dev.: 0.0178) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.19% (1.1194 => 1.1439, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.83% (3.8922 => 3.9634, std.dev.: 0.0128) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8963, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.22% (1.1145 => 1.3844, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.38% (0.2944 => 0.3279, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 10.15% (3.1595 => 3.4802, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Puzzle: 9.92% (0.1421 => 0.1562, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.80% (1.1396 => 1.2513, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 6.64% (3.1578 => 3.3675, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 3.68% (0.5413 => 0.5612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.53% (3.6395 => 3.7680, std.dev.: 0.0032) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.89% (4.2280 => 4.3504, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7652, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.55% (0.8275 => 0.8403, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8128, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.14% (2.1825 => 2.2073, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1283, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.38% (5.2763 => 3.2515, std.dev.: 0.0105) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.06% (5.3855 => 3.6050, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.64% (5.3526 => 3.6055, std.dev.: 0.0022) SingleSource/UnitTests/Vector/constpool: -14.77% (54.1659 => 46.1658, std.dev.: 0.0893) MultiSource/Benchmarks/FreeBench/mason/mason: -14.06% (0.0811 => 0.0697, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -11.92% (22.1758 => 19.5326, std.dev.: 0.0287) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.09% (2.9384 => 2.6125, std.dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.51% (1.1492 => 0.7641, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4246, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.63% (0.0998 => 0.0862, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -12.30% (1.2373 => 1.0851, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/mandel-2: -10.48% (1.5373 => 1.3762, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/mason/mason: -9.90% (0.2161 => 0.1947, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.29% (19.9488 => 18.2941, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.74% (1.8329 => 1.7093, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.30% (1.6805 => 1.5914, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-5: -5.01% (1.5835 => 1.5041, std.dev.: 0.0039) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0015) MultiSource/Applications/siod/siod: -3.77% (3.2827 => 3.1590, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.45% (0.9957 => 0.9613, std.dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5036, std.dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0993, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.67% (1.3677 => 1.3312, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.27% (8.1563 => 7.9713, std.dev.: 0.0168) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.03% (8.6802 => 8.5036, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0848, std.dev.: 0.0175) MultiSource/Applications/sqlite3/sqlite3: -1.92% (4.6441 => 4.5548, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: -1.69% (8.8334 => 8.6838, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.56% (2.5528 => 2.5129, std.dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4201, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8594, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/lists: -1.00% (6.2999 => 6.2368, std.dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.33% (0.5229 => 0.5769, std.dev.: 0.0097) MultiSource/Applications/SPASS/SPASS: 6.79% (14.9895 => 16.0068, std.dev.: 0.0064) MultiSource/Benchmarks/MallocBench/gs/gs: 5.31% (4.1105 => 4.3287, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.97% (1.1048 => 1.2370, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.30% (7.1582 => 7.5379, std.dev.: 0.0400) SingleSource/Benchmarks/Misc-C++/stepanov_container: 17.41% (0.6222 => 0.7305, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35900.00% (0.0001 => 0.0360, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.13% (0.2116 => 0.2140, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 05:04:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 07:04:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121004120405.B4F0A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4556?compare_to=4553&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4556, Order: 165216, Start Time: 2012-10-04 10:40:38, End Time: 2012-10-04 12:05:47 To: 4553, Order: 165215, Start Time: 2012-10-04 08:46:19, End Time: 2012-10-04 10:11:37 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (5 on baseline) Performance Regressions: 0 (176 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 5 (0 on baseline) Unchanged Tests: 1036 (686 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.21% (0.9682 => 0.9565, std.dev.: 0.0017) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.01% (33.3610 => 33.3628, std.dev.: 0.0032) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (2.7526 => 2.7526, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.00% (2.1154 => 2.1153, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.01% (4.9750 => 4.9745, std.dev.: 0.0017) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.21% (33.2944 => 33.3628, std.dev.: 0.0032) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: -100.00% (7.3305 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.58% (2.0176 => 2.4329, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.16% (0.1410 => 0.1652, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 15.01% (0.0826 => 0.0950, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 13.95% (0.2243 => 0.2556, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.68% (0.0819 => 0.0931, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.31% (0.1072 => 0.1204, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 11.94% (0.1013 => 0.1134, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 11.41% (0.5818 => 0.6482, std.dev.: 0.0036) SingleSource/UnitTests/ObjC++/property-reference: 11.40% (0.7061 => 0.7866, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.39% (0.1413 => 0.1574, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 11.37% (0.4328 => 0.4820, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.35% (0.7710 => 0.8585, std.dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 11.33% (0.2781 => 0.3096, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 11.26% (0.5748 => 0.6395, std.dev.: 0.0024) MultiSource/Applications/hbd/hbd: 11.12% (1.3693 => 1.5215, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.93% (0.2782 => 0.3086, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.88% (0.2721 => 0.3017, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.82% (3.9660 => 4.3951, std.dev.: 0.0089) MultiSource/Applications/lambda-0_1_3/lambda: 10.78% (0.7038 => 0.7797, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.77% (0.1588 => 0.1759, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.75% (0.2596 => 0.2875, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 10.71% (0.4062 => 0.4497, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.63% (0.1327 => 0.1468, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.62% (0.3022 => 0.3343, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.58% (0.0964 => 0.1066, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.52% (0.2765 => 0.3056, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.52% (1.9828 => 2.1914, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.50% (0.3485 => 0.3851, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.50% (0.9199 => 1.0165, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hello: 10.47% (0.2607 => 0.2880, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.46% (0.3899 => 0.4307, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.44% (1.4563 => 1.6084, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.40% (0.2655 => 0.2931, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 10.39% (0.2628 => 0.2901, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 10.37% (0.2690 => 0.2969, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.36% (0.4016 => 0.4432, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.26% (1.2193 => 1.3444, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 10.25% (0.2760 => 0.3043, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 10.25% (0.2761 => 0.3044, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.25% (0.6959 => 0.7672, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.22% (0.2966 => 0.3269, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.17% (0.3489 => 0.3844, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 10.17% (0.3293 => 0.3628, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 10.15% (0.2937 => 0.3235, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.14% (0.5265 => 0.5799, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 10.09% (0.2726 => 0.3001, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.00% (0.3580 => 0.3938, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.98% (0.3756 => 0.4131, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.98% (0.2696 => 0.2965, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 9.96% (0.3453 => 0.3797, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 9.91% (0.3149 => 0.3461, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/moments: 9.90% (0.3868 => 0.4251, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.86% (0.4390 => 0.4823, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.85% (0.6283 => 0.6902, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 9.85% (0.3107 => 0.3413, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 9.79% (0.1062 => 0.1166, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 9.71% (0.2988 => 0.3278, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 9.65% (0.3534 => 0.3875, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/ary2: 9.62% (0.3192 => 0.3499, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.60% (1.1364 => 1.2455, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 9.50% (13.8202 => 15.1328, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.49% (0.5577 => 0.6106, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.47% (0.1986 => 0.2174, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.33% (0.3130 => 0.3422, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.33% (0.1276 => 0.1395, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.25% (0.1157 => 0.1264, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.23% (0.4379 => 0.4783, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 9.06% (0.1589 => 0.1733, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.03% (0.2127 => 0.2319, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 8.95% (0.2995 => 0.3263, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 8.90% (0.2945 => 0.3207, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 8.88% (1.0313 => 1.1229, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.78% (0.1435 => 0.1561, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 8.72% (1.1061 => 1.2025, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.69% (0.3246 => 0.3528, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 8.66% (0.7506 => 0.8156, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.66% (0.5637 => 0.6125, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 8.62% (16.6129 => 18.0453, std.dev.: 0.0081) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.61% (0.2914 => 0.3165, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.60% (0.4791 => 0.5203, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.42% (0.7460 => 0.8088, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.26% (0.3755 => 0.4065, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.23% (0.8698 => 0.9414, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.21% (0.2023 => 0.2189, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 8.20% (3.8646 => 4.1816, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.19% (7.2180 => 7.8089, std.dev.: 0.0088) MultiSource/Applications/minisat/minisat: 8.16% (0.6744 => 0.7294, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 8.14% (0.2925 => 0.3163, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 8.09% (0.8310 => 0.8982, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/18-imp/imp: 8.04% (0.3220 => 0.3479, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.97% (0.6576 => 0.7100, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.94% (0.1865 => 0.2013, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 7.88% (3.1889 => 3.4401, std.dev.: 0.0125) MultiSource/Applications/siod/siod: 7.78% (2.1791 => 2.3486, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 7.66% (1.9270 => 2.0747, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 7.65% (0.1478 => 0.1591, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.49% (0.1789 => 0.1923, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 7.48% (0.1657 => 0.1781, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 7.48% (1.0594 => 1.1386, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.37% (1.3245 => 1.4221, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.24% (3.6692 => 3.9349, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/parameter-passing: 7.17% (0.4003 => 0.4290, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.09% (0.1819 => 0.1948, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 7.04% (14.8535 => 15.8994, std.dev.: 0.0183) MultiSource/Benchmarks/sim/sim: 7.03% (0.3131 => 0.3351, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 7.02% (1.2292 => 1.3155, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.01% (0.1569 => 0.1679, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.00% (0.3914 => 0.4188, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.00% (4.3801 => 4.6867, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/trivial-interface: 6.99% (0.3578 => 0.3828, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 6.97% (1.2749 => 1.3637, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/exceptions-2: 6.91% (0.3601 => 0.3850, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.89% (0.3789 => 0.4050, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.88% (0.3646 => 0.3897, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.86% (4.4433 => 4.7481, std.dev.: 0.0141) MultiSource/Applications/oggenc/oggenc: 6.83% (4.6629 => 4.9815, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.82% (0.2140 => 0.2286, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.82% (0.3650 => 0.3899, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 6.78% (0.4113 => 0.4392, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 6.77% (0.3663 => 0.3911, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.73% (0.6135 => 0.6548, std.dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 6.71% (8.4961 => 9.0663, std.dev.: 0.0153) SingleSource/UnitTests/ObjC/property: 6.70% (0.3940 => 0.4204, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 6.68% (0.3623 => 0.3865, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.46% (0.8818 => 0.9388, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 6.46% (0.6250 => 0.6654, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.44% (0.3511 => 0.3737, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.26% (1.1333 => 1.2042, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.11% (0.2504 => 0.2657, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.04% (3.2742 => 3.4721, std.dev.: 0.0137) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.01% (4.9865 => 5.2861, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.81% (0.4805 => 0.5084, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.73% (0.2321 => 0.2454, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.58% (0.3245 => 0.3426, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 5.57% (6.5754 => 6.9416, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 5.33% (3.7467 => 3.9465, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.30% (1.5188 => 1.5993, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.16% (0.9108 => 0.9578, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.09% (6.2785 => 6.5979, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.87% (2.1007 => 2.2030, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.79% (13.2842 => 13.9208, std.dev.: 0.0149) MultiSource/Applications/sqlite3/sqlite3: 3.12% (16.2614 => 16.7690, std.dev.: 0.0241) MultiSource/Applications/ClamAV/clamscan: 2.73% (14.5298 => 14.9265, std.dev.: 0.0192) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5144, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: 24.25% (1.8175 => 2.2582, std.dev.: 0.0180) SingleSource/Benchmarks/Misc/richards_benchmark: 11.14% (1.1560 => 1.2848, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.62% (3.1736 => 3.4155, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.35% (1.2998 => 1.3823, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0042, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6760, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9858, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.80% (10.7476 => 11.0481, std.dev.: 0.0451) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.20% (7.4271 => 7.5904, std.dev.: 0.0047) MultiSource/Applications/lemon/lemon: 2.03% (1.4298 => 1.4588, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/ffbench: 1.74% (0.8273 => 0.8417, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5139, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.30% (5.5130 => 5.5845, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1878, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0270, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5859, std.dev.: 0.0057) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.53% (0.2670 => 0.1401, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -15.98% (0.0707 => 0.0594, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.93% (0.4657 => 0.3915) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.23% (1.3819 => 1.1852, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.22% (1.3813 => 1.1849, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.35% (22.5627 => 21.5810, std.dev.: 0.0217) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.64% (0.0997 => 0.0861, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -12.15% (0.2238 => 0.1966, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -11.53% (1.2308 => 1.0889, std.dev.: 0.0092) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.24% (20.3410 => 18.2577, std.dev.: 0.0228) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.79% (1.3780 => 1.2982, std.dev.: 0.0055) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5139, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.31% (0.9996 => 0.9565, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.52% (3.2729 => 3.1576, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.44% (1.7688 => 1.7080, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.14% (0.4867 => 0.4714, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -2.56% (26.5159 => 25.8371, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.44% (3.0263 => 2.9526, std.dev.: 0.0017) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.30% (1.9762 => 1.9308, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.08% (0.6589 => 0.6452, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.81% (6.3560 => 6.2408, std.dev.: 0.0050) MultiSource/Benchmarks/mafft/pairlocalalign: -1.67% (28.2225 => 27.7522, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.59% (0.6615 => 0.6510, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0069, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -1.43% (4.5928 => 4.5270, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8667, std.dev.: 0.0025) MultiSource/Applications/minisat/minisat: -1.28% (9.3358 => 9.2161, std.dev.: 0.0179) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4950, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2585, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 05:15:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 07:15:52 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121004121552.F3F062A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4557?compare_to=4554&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4557, Order: 165217, Start Time: 2012-10-04 10:48:49, End Time: 2012-10-04 12:17:35 To: 4554, Order: 165216, Start Time: 2012-10-04 09:01:15, End Time: 2012-10-04 10:32:59 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Failures: 0 (4 on baseline) New Passes: 0 (14 on baseline) Performance Regressions: 5 (83 on baseline) Performance Improvements: 1 (48 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 69 (65 on baseline) Unchanged Tests: 967 (756 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.79% (0.8260 => 0.8408, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.67% (0.7842 => 0.7973, std.dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: 1.05% (0.9497 => 0.9597, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.77% (6.2617 => 6.4351, std.dev.: 0.0493) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.36% (1.4247 => 1.4441, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/SPASS/SPASS: -3.01% (8.4552 => 8.2009, std.dev.: 0.0578) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.15% (1.0180 => 1.0195, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: -0.60% (0.6210 => 0.6173, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: 3.12% (0.1761 => 0.1816, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.46% (0.1592 => 0.1505, std.dev.: 0.0122) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.53% (0.3165 => 0.3085, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.34% (0.2347 => 0.2355, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.09% (0.3265 => 0.3164, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.54% (0.2340 => 0.2304, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: 5.41% (0.0388 => 0.0409, std.dev.: 0.0024) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.63% (0.0245 => 0.0241, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -11.28% (0.0195 => 0.0173, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.04% (0.0395 => 0.0383, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 2.07% (0.0241 => 0.0246, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 27.40% (0.0219 => 0.0279, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -7.32% (0.0328 => 0.0304, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/casts: -2.70% (0.0185 => 0.0180, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -12.94% (0.0170 => 0.0148, std.dev.: 0.0018) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0252 => 0.0253, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -18.18% (0.0330 => 0.0270, std.dev.: 0.0026) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 40.00% (0.0005 => 0.0007, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -0.55% (0.1464 => 0.1456, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -1.66% (0.2289 => 0.2251, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: -3.02% (1.5221 => 1.4762, std.dev.: 0.0219) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.52% (0.1530 => 0.1522, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/Bullet/bullet: 0.21% (0.5808 => 0.5820, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -0.15% (26.7301 => 26.6899, std.dev.: 0.1535) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.05% (0.4094 => 0.4092, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.14% (0.1378 => 0.1435, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.25% (0.0579 => 0.0537, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -20.60% (0.0233 => 0.0185, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.15% (0.0663 => 0.0664, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.38% (1.1300 => 1.1257, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/bc/bc: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 41.67% (0.0012 => 0.0017, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.04% (0.0589 => 0.0577, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -23.33% (0.0180 => 0.0138, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.04% (0.7681 => 0.7678, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.08% (1.7072 => 1.7058, std.dev.: 0.0101) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Applications/JM/lencod/lencod: -96.66% (6.7458 => 0.2251, std.dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: -91.65% (6.9722 => 0.5820, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/09-vor/vor: 21476.31% (0.1237 => 26.6899, std.dev.: 0.1535) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.96% (1.1116 => 0.0005, std.dev.: 0.0000) New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 144.94% (0.0089 => 0.0218, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: 174.44% (0.0090 => 0.0247, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -25.98% (4.1772 => 3.0921, std.dev.: 0.0413) SingleSource/Benchmarks/Shootout-C++/except: 82050.00% (0.0006 => 0.4929, std.dev.: 0.0036) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.89% (0.0745 => 0.0923, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.58% (0.1159 => 0.1270, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.25% (0.6410 => 0.7003, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/bigfib: 9.10% (0.5309 => 0.5792, std.dev.: 0.0030) MultiSource/Benchmarks/PAQ8p/paq8p: 8.17% (2.1763 => 2.3542, std.dev.: 0.0194) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.59% (0.3582 => 0.3854, std.dev.: 0.0032) MultiSource/Applications/minisat/minisat: 7.35% (0.6173 => 0.6627, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.94% (0.2552 => 0.2729, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 6.34% (1.0046 => 1.0683, std.dev.: 0.0037) MultiSource/Applications/SIBsim4/SIBsim4: 6.22% (1.1653 => 1.2378, std.dev.: 0.0032) MultiSource/Applications/kimwitu++/kc: 6.12% (15.3105 => 16.2473, std.dev.: 0.0708) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.97% (0.7639 => 0.8095, std.dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: 5.86% (0.6915 => 0.7320, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.70% (0.6069 => 0.6415, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.61% (0.2797 => 0.2954, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.35% (1.5150 => 1.5961, std.dev.: 0.0138) MultiSource/Benchmarks/McCat/18-imp/imp: 5.28% (0.3217 => 0.3387, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.99% (0.4248 => 0.4460, std.dev.: 0.0018) MultiSource/Applications/d/make_dparser: 4.60% (3.0225 => 3.1614, std.dev.: 0.0221) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.41% (0.4880 => 0.5095, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 4.11% (13.3238 => 13.8717, std.dev.: 0.0954) MultiSource/Applications/Burg/burg: 4.05% (1.1440 => 1.1903, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.03% (0.2654 => 0.2761, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.02% (0.3062 => 0.3185, std.dev.: 0.0029) MultiSource/Applications/siod/siod: 3.91% (2.0972 => 2.1791, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.87% (0.2662 => 0.2765, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 3.86% (29.3170 => 30.4493, std.dev.: 0.2005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.74% (0.3418 => 0.3546, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.68% (3.0758 => 3.1891, std.dev.: 0.0377) MultiSource/Applications/lua/lua: 3.64% (3.5980 => 3.7291, std.dev.: 0.0043) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.64% (6.2546 => 6.4820, std.dev.: 0.0756) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.63% (2.0317 => 2.1054, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.62% (0.8569 => 0.8879, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists1: 3.61% (0.2771 => 0.2871, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.59% (1.4408 => 1.4925, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/hash2: 3.43% (0.3847 => 0.3979, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.42% (0.2952 => 0.3053, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: 3.36% (1.3268 => 1.3714, std.dev.: 0.0073) MultiSource/Applications/oggenc/oggenc: 3.36% (4.7455 => 4.9048, std.dev.: 0.0352) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.30% (1.1672 => 1.2057, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 3.27% (8.2186 => 8.4871, std.dev.: 0.0592) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.22% (1.1827 => 1.2208, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/hash: 3.21% (0.3520 => 0.3633, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.17% (1.2021 => 1.2402, std.dev.: 0.0130) MultiSource/Applications/JM/lencod/lencod: 3.03% (14.7256 => 15.1712, std.dev.: 0.0648) MultiSource/Applications/treecc/treecc: 2.86% (1.8798 => 1.9336, std.dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.81% (1.3935 => 1.4327, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.56% (0.4562 => 0.4679, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.52% (0.5963 => 0.6113, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.43% (0.5636 => 0.5773, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.41% (4.0318 => 4.1291, std.dev.: 0.0210) MultiSource/Applications/JM/ldecod/ldecod: 2.04% (6.4908 => 6.6229, std.dev.: 0.0279) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.83% (1.0689 => 1.0885, std.dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: 1.82% (0.9425 => 0.9597, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.67% (8.2559 => 8.3941, std.dev.: 0.0313) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.63% (4.2616 => 4.3310, std.dev.: 0.0222) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 40.86% (1.6538 => 2.3295, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2278, std.dev.: 0.0232) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 15.49% (0.0917 => 0.1059, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/ary3: 14.70% (1.7426 => 1.9987, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.48% (4.0101 => 4.5506, std.dev.: 0.0211) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.19% (2.4042 => 2.7213, std.dev.: 0.0365) SingleSource/Benchmarks/McGill/queens: 10.63% (1.6261 => 1.7990, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.10% (0.2857 => 0.3117, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: 8.78% (7.0025 => 7.6170, std.dev.: 0.0092) MultiSource/Benchmarks/FreeBench/mason/mason: 8.49% (0.5004 => 0.5429, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 8.31% (40.4792 => 43.8423, std.dev.: 0.5396) MultiSource/Benchmarks/Olden/bisort/bisort: 5.82% (0.6459 => 0.6835, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.63% (0.3301 => 0.3487, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.56% (2.5984 => 2.7168, std.dev.: 0.0241) SingleSource/Benchmarks/Misc/dt: 4.28% (0.9851 => 1.0273, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: 4.06% (15.2242 => 15.8428, std.dev.: 0.0107) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.86% (3.4080 => 3.5395, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.19% (0.5587 => 0.5765, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 3.01% (0.6308 => 0.6498, std.dev.: 0.0047) MultiSource/Applications/siod/siod: 2.96% (3.5520 => 3.6571, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.92% (2.6656 => 2.7435, std.dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.84% (6.6312 => 6.8194, std.dev.: 0.0055) MultiSource/Applications/lua/lua: 2.43% (29.5232 => 30.2393, std.dev.: 0.0687) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 1.91% (0.5876 => 0.5988, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/power/power: 1.45% (1.4184 => 1.4390, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.40% (4.0659 => 4.1230, std.dev.: 0.0075) MultiSource/Benchmarks/Olden/tsp/tsp: 1.11% (1.7330 => 1.7523, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.50% (0.0591 => 0.0328, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -44.29% (0.2996 => 0.1669, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -20.89% (1.4113 => 1.1165, std.dev.: 0.0305) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.00% (1.4189 => 1.1351, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.01% (0.3497 => 0.2063, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.73% (5.2665 => 4.1223, std.dev.: 0.0669) SingleSource/Benchmarks/Shootout-C++/ary3: -20.69% (1.7473 => 1.3857, std.dev.: 0.0820) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.52% (15.8312 => 13.3738, std.dev.: 0.5706) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.13% (1.7361 => 1.4735, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/17-bintr/bintr: -13.74% (0.0917 => 0.0791, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1580, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.69% (1.1647 => 1.0518, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/moments: -9.07% (0.1114 => 0.1013, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: -9.02% (1.4034 => 1.2768, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.37% (3.2007 => 2.9327, std.dev.: 0.0242) SingleSource/Benchmarks/Misc/flops: -8.36% (9.5474 => 8.7490, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.86% (3.6254 => 3.3767, std.dev.: 0.0160) MultiSource/Applications/lambda-0_1_3/lambda: -6.68% (7.6833 => 7.1702, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/richards_benchmark: -6.54% (1.4441 => 1.3496, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/fibo: -6.53% (4.6355 => 4.3327, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.12% (2.9728 => 2.7908, std.dev.: 0.0038) MultiSource/Applications/SIBsim4/SIBsim4: -5.92% (3.4230 => 3.2204, std.dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.46% (3.9413 => 3.7261, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/fib2: -5.26% (4.4195 => 4.1870, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/distray/distray: -4.99% (0.2664 => 0.2531, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.82% (0.4564 => 0.4344, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: -4.66% (2.5166 => 2.3994, std.dev.: 0.0037) MultiSource/Applications/sgefa/sgefa: -4.54% (0.3746 => 0.3576, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: -4.22% (62.4126 => 59.7809, std.dev.: 0.2652) MultiSource/Applications/SPASS/SPASS: -3.88% (8.5323 => 8.2009, std.dev.: 0.0578) SingleSource/Benchmarks/Shootout-C++/methcall: -3.30% (9.2503 => 8.9450, std.dev.: 0.0239) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.09% (1.2722 => 1.2329, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/misr: -3.07% (0.4296 => 0.4164, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.94% (3.7496 => 3.6394, std.dev.: 0.0418) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.80% (1.1683 => 1.1356, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.75% (0.4140 => 0.4026, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -2.25% (2.4013 => 2.3472, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/neural/neural: -2.08% (1.0926 => 1.0699, std.dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: -2.05% (92.7467 => 90.8411, std.dev.: 0.2808) MultiSource/Benchmarks/sim/sim: -1.96% (3.8907 => 3.8145, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: -1.90% (3.4876 => 3.4213, std.dev.: 0.0033) MultiSource/Applications/aha/aha: -1.90% (3.4286 => 3.3636, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.59% (9.3855 => 9.2367, std.dev.: 0.0225) SingleSource/Benchmarks/Dhrystone/fldry: -1.44% (2.4971 => 2.4611, std.dev.: 0.0048) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.40% (27.1724 => 26.7907, std.dev.: 0.0631) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3153, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/lists: -1.22% (16.5617 => 16.3594, std.dev.: 0.0471) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.15% (0.9980 => 1.0195, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 2.51% (0.6022 => 0.6173, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: 9.00% (0.1666 => 0.1816, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.15% (0.1554 => 0.1505, std.dev.: 0.0122) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.06% (0.3083 => 0.3085, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.63% (0.2394 => 0.2355, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.35% (0.3175 => 0.3164, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.09% (0.2302 => 0.2304, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -8.91% (0.0449 => 0.0409, std.dev.: 0.0024) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.42% (0.0240 => 0.0241, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -9.90% (0.0192 => 0.0173, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.79% (0.0390 => 0.0383, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -18.27% (0.0301 => 0.0246, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.76% (0.0284 => 0.0279, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -6.17% (0.0324 => 0.0304, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/casts: 1.69% (0.0177 => 0.0180, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -21.69% (0.0189 => 0.0148, std.dev.: 0.0018) SingleSource/UnitTests/Vector/multiplies: 1.61% (0.0249 => 0.0253, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -16.92% (0.0325 => 0.0270, std.dev.: 0.0026) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -30.00% (0.0010 => 0.0007, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 1.89% (0.1429 => 0.1456, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -1.71% (1.5019 => 1.4762, std.dev.: 0.0219) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.40% (0.1501 => 0.1522, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.03% (0.4264 => 0.4092, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.77% (0.1344 => 0.1435, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.83% (0.0589 => 0.0537, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -20.26% (0.0232 => 0.0185, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.91% (0.0639 => 0.0664, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.82% (1.1350 => 1.1257, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 183.33% (0.0006 => 0.0017, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.42% (0.0637 => 0.0577, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -43.90% (0.0246 => 0.0138, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.82% (0.7541 => 0.7678, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.03% (1.5363 => 1.7058, std.dev.: 0.0101) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 05:52:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 07:52:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121004125206.A37F32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4558?compare_to=4555&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4558, Order: 165220, Start Time: 2012-10-04 11:34:23, End Time: 2012-10-04 12:53:46 To: 4555, Order: 165216, Start Time: 2012-10-04 09:43:45, End Time: 2012-10-04 11:03:19 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (150 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 952 (694 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.24% (1.0851 => 1.0986, std.dev.: 0.0016) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.16% (0.5769 => 0.5778, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 0.12% (16.0068 => 16.0261, std.dev.: 0.0035) MultiSource/Benchmarks/Bullet/bullet: 0.61% (53.9435 => 54.2725, std.dev.: 0.0066) MultiSource/Benchmarks/MallocBench/gs/gs: 0.18% (4.3287 => 4.3366, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.65% (0.0464 => 0.0467, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.64% (0.0466 => 0.0469, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.92% (0.0433 => 0.0437, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.69% (0.0435 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.18% (0.0422 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.95% (0.0423 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.96% (0.0415 => 0.0419) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.96% (0.0416 => 0.0420, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.46% (0.0434 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.92% (0.0434 => 0.0438) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.94% (0.0427 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.93% (0.0429 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.96% (0.0418 => 0.0422, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.72% (0.0419 => 0.0422, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.71% (0.0425 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.94% (0.0426 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.92% (0.0436 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.92% (0.0437 => 0.0441) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.73% (0.0413 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.97% (0.0413 => 0.0417, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.94% (0.0424 => 0.0428) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.70% (0.0426 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.96% (0.0416 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.96% (0.0417 => 0.0421, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.49% (0.0409 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.73% (0.0409 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.98% (0.0407 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.98% (0.0408 => 0.0412, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.90% (0.0444 => 0.0448) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.67% (0.0445 => 0.0448, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.74% (0.0406 => 0.0409, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.49% (0.0407 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.24% (0.0410 => 0.0411, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.73% (0.0409 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.48% (0.0416 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.72% (0.0416 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.01% (1.2370 => 1.2371, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.23% (7.5379 => 7.5550, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.37% (0.7305 => 0.7332, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.56% (0.0360 => 0.0362, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: - (0.1431 => 0.1431) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.05% (0.2140 => 0.2139, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -14.19% (63.2438 => 54.2725, std.dev.: 0.0066) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 31.07% (14.1553 => 18.5531, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++-EH/spirit: 58.73% (3.4629 => 5.4968, std.dev.: 0.0246) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14225.97% (0.0720 => 10.3147, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952500.00% (0.0001 => 9.9526, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 47.61% (0.2554 => 0.3770, std.dev.: 0.0064) MultiSource/Benchmarks/PAQ8p/paq8p: 46.79% (10.3673 => 15.2178, std.dev.: 0.0102) MultiSource/Benchmarks/FreeBench/distray/distray: 30.40% (0.1056 => 0.1377, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 27.81% (0.1622 => 0.2073, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.20% (2.2022 => 2.5370, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.15% (7.0540 => 8.1226, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/flops: 13.83% (0.1432 => 0.1630, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.67% (0.0834 => 0.0948, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.35% (0.1566 => 0.1775, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.20% (1.7609 => 1.9757, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.51% (0.3473 => 0.3838, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 10.36% (0.3282 => 0.3622, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.30% (0.3543 => 0.3908, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.29% (0.3497 => 0.3857, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.25% (0.3543 => 0.3906, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.23% (0.1584 => 0.1746) SingleSource/UnitTests/ObjC/exceptions-3: 10.18% (0.3516 => 0.3874, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.17% (0.3561 => 0.3923, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.94% (0.3694 => 0.4061, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.87% (0.3828 => 0.4206, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.73% (0.3927 => 0.4309, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.50% (0.3886 => 0.4255, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 8.58% (0.1655 => 0.1797, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 8.54% (0.1440 => 0.1563, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.49% (0.4879 => 0.5293, std.dev.: 0.0034) SingleSource/UnitTests/ObjC++/Hello: 8.47% (0.5925 => 0.6427, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.34% (0.6030 => 0.6533, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.31% (0.3177 => 0.3441, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.16% (0.2891 => 0.3127, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.13% (0.6675 => 0.7218, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 8.12% (9.4845 => 10.2542, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.10% (1.5415 => 1.6664, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.07% (0.1438 => 0.1554, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 8.06% (0.7433 => 0.8032, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 7.90% (5.7591 => 6.2143, std.dev.: 0.0092) MultiSource/Applications/minisat/minisat: 7.86% (0.7115 => 0.7674, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.85% (0.1337 => 0.1442, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.80% (0.2065 => 0.2226, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 7.77% (0.3422 => 0.3688, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.73% (0.3052 => 0.3288, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 7.72% (0.3109 => 0.3349, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.67% (0.4615 => 0.4969, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.66% (0.2756 => 0.2967, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.64% (0.2905 => 0.3127, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/fibo: 7.63% (0.2725 => 0.2933, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.57% (0.8172 => 0.8791, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.57% (0.2271 => 0.2443, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 7.55% (0.1695 => 0.1823, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.55% (0.7326 => 0.7879, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.44% (0.2714 => 0.2916, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 7.42% (0.2831 => 0.3041, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 7.40% (10.4361 => 11.2086, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary: 7.39% (0.3232 => 0.3471, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 7.39% (0.3423 => 0.3676, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.37% (0.3865 => 0.4150, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.37% (0.3650 => 0.3919, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.35% (0.2802 => 0.3008, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.34% (0.2793 => 0.2998, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.33% (1.3050 => 1.4007, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.33% (0.2700 => 0.2898, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 7.31% (3.3354 => 3.5793, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.30% (0.3136 => 0.3365, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.28% (2.0665 => 2.2170, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.25% (4.2646 => 4.5738, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/except: 7.24% (0.2871 => 0.3079, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.23% (0.4289 => 0.4599, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.22% (0.5860 => 0.6283, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.21% (0.4103 => 0.4399, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.20% (0.1625 => 0.1742, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.19% (0.4203 => 0.4505, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.18% (0.3162 => 0.3389, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.17% (0.2872 => 0.3078, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 7.17% (0.3098 => 0.3320, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 7.16% (0.6456 => 0.6918, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.12% (8.1363 => 8.7158, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.09% (0.1510 => 0.1617, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.08% (0.4636 => 0.4964, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.07% (0.5569 => 0.5963, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.06% (0.3826 => 0.4096, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 7.04% (0.4048 => 0.4333, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.3283 => 0.3514, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.99% (0.5105 => 0.5462, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.99% (0.2877 => 0.3078, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.98% (0.9765 => 1.0447, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.96% (0.2758 => 0.2950, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.93% (0.2107 => 0.2253, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.88% (0.3603 => 0.3851, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.86% (5.0018 => 5.3450, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.77% (4.9449 => 5.2797, std.dev.: 0.0147) MultiSource/Applications/spiff/spiff: 6.76% (0.7835 => 0.8365, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 6.73% (0.3684 => 0.3932, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.73% (0.8067 => 0.8610, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 6.72% (1.5603 => 1.6651, std.dev.: 0.0061) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.66% (0.3121 => 0.3329, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.60% (0.4620 => 0.4925, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 6.60% (0.3379 => 0.3602, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.59% (0.3307 => 0.3525, std.dev.: 0.0015) MultiSource/Applications/viterbi/viterbi: 6.56% (0.1555 => 0.1657, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.55% (0.1940 => 0.2067, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 6.51% (1.1642 => 1.2400, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.33% (0.5020 => 0.5338, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 6.29% (0.3387 => 0.3600, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 6.22% (3.8723 => 4.1130, std.dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.18% (7.9617 => 8.4536, std.dev.: 0.0088) MultiSource/Applications/lemon/lemon: 5.94% (1.0722 => 1.1359, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.93% (0.3441 => 0.3645, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.89% (1.1861 => 1.2560, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 5.88% (0.3180 => 0.3367, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.88% (0.2603 => 0.2756, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 5.84% (0.4299 => 0.4550, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 5.68% (2.0273 => 2.1425, std.dev.: 0.0054) MultiSource/Applications/JM/lencod/lencod: 5.53% (21.9371 => 23.1504, std.dev.: 0.0120) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.51% (0.4064 => 0.4288, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.50% (0.5981 => 0.6310) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.49% (0.6450 => 0.6804, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 5.21% (0.8921 => 0.9386, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (0.3131 => 0.3294, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 5.18% (2.2969 => 2.4159, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.93% (1.2842 => 1.3475, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.91% (1.5859 => 1.6637, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.57% (1.4186 => 1.4835, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.46% (0.2266 => 0.2367, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.43% (1.1840 => 1.2365, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.33% (2.2024 => 2.2977, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.97% (0.8101 => 0.8423, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.01% (14.3668 => 14.7988, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.65% (0.3817 => 0.3918, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.51% (1.1194 => 1.1475, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.36% (17.1811 => 17.5866, std.dev.: 0.0223) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.15% (3.8922 => 3.9757, std.dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.51% (5.3999 => 13.3115, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 10.16% (3.1595 => 3.4804, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/Puzzle: 9.92% (0.1421 => 0.1562, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.87% (1.1396 => 1.2521, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (3.1578 => 3.3678, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.52% (3.6395 => 3.7677, std.dev.: 0.0050) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.75% (4.2280 => 4.3441, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.35% (1.7254 => 1.7660, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.55% (0.8275 => 0.8403, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8130, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1284, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.04% (0.8651 => 0.1727, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.30% (5.2763 => 3.2557, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.67% (5.3855 => 3.6262, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.24% (5.3526 => 3.6267, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -14.64% (54.1659 => 46.2367, std.dev.: 0.0153) MultiSource/Benchmarks/FreeBench/mason/mason: -13.81% (0.0811 => 0.0699, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -11.72% (22.1758 => 19.5774, std.dev.: 0.0148) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.95% (2.9384 => 2.6165, std.dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.35% (1.1492 => 0.7659, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.93% (1.6925 => 1.4229, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.13% (0.0998 => 0.0857, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -11.21% (1.2373 => 1.0986, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3734, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/mason/mason: -9.86% (0.2161 => 0.1948, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.44% (19.9488 => 18.2653, std.dev.: 0.0238) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.74% (1.8329 => 1.7093, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.31% (1.6805 => 1.5913, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -5.05% (1.5835 => 1.5036, std.dev.: 0.0018) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.35% (0.9957 => 0.9524, std.dev.: 0.0123) MultiSource/Applications/siod/siod: -3.61% (3.2827 => 3.1642, std.dev.: 0.0056) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5027, std.dev.: 0.0069) MultiSource/Applications/hexxagon/hexxagon: -2.98% (12.4730 => 12.1008, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.68% (1.3677 => 1.3310, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.07% (8.1563 => 7.9871, std.dev.: 0.0111) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.01% (8.6802 => 8.5055, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/salsa20: -1.97% (10.2830 => 10.0801, std.dev.: 0.0180) MultiSource/Applications/sqlite3/sqlite3: -1.90% (4.6441 => 4.5558, std.dev.: 0.0009) SingleSource/UnitTests/Vector/multiplies: -1.81% (2.5528 => 2.5067, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6814, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4203, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8578, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0554 => 1.0445, std.dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 10.50% (0.5229 => 0.5778, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 6.92% (14.9895 => 16.0261, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/gs/gs: 5.50% (4.1105 => 4.3366, std.dev.: 0.0093) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.98% (1.1048 => 1.2371, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.54% (7.1582 => 7.5550, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_container: 17.84% (0.6222 => 0.7332, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36100.00% (0.0001 => 0.0362, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.09% (0.2116 => 0.2139, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 3.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 06:00:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 08:00:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121004130039.7FD382A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4559?compare_to=4552&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4559, Order: 165216, Start Time: 2012-10-04 09:52:08, End Time: 2012-10-04 13:02:21 To: 4552, Order: 165204, Start Time: 2012-10-04 06:10:25, End Time: 2012-10-04 09:22:48 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 1 (130 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (131 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1038 (761 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.18% (125.2218 => 130.4589, std.dev.: 0.7072) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.04% (9.8093 => 9.8056, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (9.4128 => 9.4128, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.04% (16.9604 => 16.9542, std.dev.: 0.0037) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.76% (0.1063 => 0.1188, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 11.15% (1.5932 => 1.7709, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 10.42% (0.3446 => 0.3805, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.38% (0.3488 => 0.3850, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/trivial-interface: 10.34% (0.3442 => 0.3798, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.30% (0.3496 => 0.3856, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-3: 10.29% (0.3460 => 0.3816, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.27% (0.3465 => 0.3821, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.23% (0.3469 => 0.3824, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.10% (0.3643 => 0.4011, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/property: 10.08% (0.3650 => 0.4018, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.72% (0.3724 => 0.4086, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.89% (0.5826 => 0.6344, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.68% (0.5889 => 0.6400, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 8.21% (0.1619 => 0.1752, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 8.19% (0.3004 => 0.3250, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 8.04% (0.2750 => 0.2971, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.03% (0.2875 => 0.3106, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.01% (0.4994 => 0.5394, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 7.95% (0.1421 => 0.1534, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.89% (0.2738 => 0.2954, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 7.89% (0.2714 => 0.2928, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.88% (0.2792 => 0.3012, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 7.78% (0.2803 => 0.3021, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 7.75% (0.2813 => 0.3031, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 7.74% (0.2725 => 0.2936, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.73% (0.3195 => 0.3442, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 7.72% (0.2823 => 0.3041, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.72% (1.6211 => 1.7462, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.62% (0.2729 => 0.2937, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.59% (0.4361 => 0.4692, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 7.59% (0.2780 => 0.2991, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.58% (1.3152 => 1.4149, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/except: 7.58% (0.2811 => 0.3024, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.56% (2.0673 => 2.2236, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 7.56% (0.3096 => 0.3330, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.56% (0.2911 => 0.3131, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 7.49% (0.9909 => 1.0651, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.47% (0.1620 => 0.1741, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 7.45% (0.3317 => 0.3564, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.39% (0.3060 => 0.3286, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 7.38% (0.3267 => 0.3508, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 7.31% (0.4146 => 0.4449, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.29% (0.3362 => 0.3607, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.25% (0.7171 => 0.7691, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.24% (3.5627 => 3.8207, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 7.21% (0.3258 => 0.3493, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.20% (0.5000 => 0.5360, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.11% (0.3124 => 0.3346, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 7.01% (0.3678 => 0.3936, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 7.00% (0.3726 => 0.3987, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.98% (0.3625 => 0.3878, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists: 6.96% (0.3348 => 0.3581, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.95% (0.3282 => 0.3510, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.80% (0.2014 => 0.2151, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 6.79% (5.5417 => 5.9179, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/lists1: 6.79% (0.3477 => 0.3713, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.75% (0.4251 => 0.4538, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.67% (0.4139 => 0.4415, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 6.65% (23.5202 => 25.0844, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.62% (0.2736 => 0.2917, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.54% (0.3930 => 0.4187, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.53% (0.3690 => 0.3931, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.53% (0.3845 => 0.4096, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.47% (1.0781 => 1.1479, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 6.43% (4.2109 => 4.4817, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.43% (0.5026 => 0.5349, std.dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.38% (2.7292 => 2.9033, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.36% (0.3981 => 0.4234, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.34% (0.5900 => 0.6274, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 6.16% (1.8794 => 1.9951, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.14% (0.2866 => 0.3042, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 6.09% (0.3336 => 0.3539, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: 6.07% (0.5012 => 0.5316, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 6.01% (0.6634 => 0.7033, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 6.01% (0.9697 => 1.0280, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.99% (0.3890 => 0.4123, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.99% (0.4658 => 0.4937, std.dev.: 0.0022) MultiSource/Applications/spiff/spiff: 5.93% (0.4029 => 0.4268, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.89% (0.3903 => 0.4133, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.79% (0.1968 => 0.2082, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.73% (0.6435 => 0.6804, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.63% (4.4195 => 4.6683, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.3084 => 0.3257, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.61% (0.2068 => 0.2184, std.dev.: 0.0015) MultiSource/Applications/lua/lua: 5.59% (1.4269 => 1.5067, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 5.58% (2.1013 => 2.2186, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.56% (0.2969 => 0.3134, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 5.54% (2.1653 => 2.2853, std.dev.: 0.0080) MultiSource/Applications/Burg/burg: 5.46% (0.5546 => 0.5849, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.44% (0.3271 => 0.3449, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 5.44% (4.6177 => 4.8689, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.41% (0.2737 => 0.2885, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 5.24% (0.2691 => 0.2832, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.10% (0.2040 => 0.2144, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.90% (0.2103 => 0.2206, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 4.88% (0.7875 => 0.8259, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.87% (1.9694 => 2.0653, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.75% (1.9966 => 2.0914, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 4.44% (0.4847 => 0.5062, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 4.31% (2.0346 => 2.1223, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 4.15% (0.3498 => 0.3643, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.08% (0.7426 => 0.7729, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.92% (0.5361 => 0.5571, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.72% (0.5584 => 0.5792, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.44% (11.6398 => 12.0405, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.16% (4.6926 => 4.8409, std.dev.: 0.0019) MultiSource/Applications/kimwitu++/kc: 2.48% (11.9555 => 12.2515, std.dev.: 0.0096) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.45% (3.3903 => 3.6091, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary: 5.75% (0.2122 => 0.2244, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (12.0509 => 12.6786, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-2: 4.95% (1.8057 => 1.8951, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1673, std.dev.: 0.0641) SingleSource/Benchmarks/Dhrystone/dry: 4.20% (14.0481 => 14.6375, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.40% (79.9355 => 82.6552, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1945, std.dev.: 0.0040) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5078, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.76% (3.1722 => 3.2280, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2866, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.13% (8.4155 => 8.5110, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5806, std.dev.: 0.0205) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.86% (25.4195 => 16.5584, std.dev.: 0.0127) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9789, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7860, std.dev.: 0.0074) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9583, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary2: -6.29% (0.2402 => 0.2251, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.70% (11.2080 => 10.7928, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.04% (0.6293 => 0.6102, std.dev.: 0.0034) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7726, std.dev.: 0.0044) SingleSource/Benchmarks/Dhrystone/fldry: -3.01% (17.2379 => 16.7188, std.dev.: 0.0653) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8587, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5708, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4963, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.23% (105.3826 => 104.0884, std.dev.: 0.0383) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0443, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 06:56:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 08:56:12 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121004135612.8C35D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4560?compare_to=4557&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4560, Order: 165220, Start Time: 2012-10-04 12:33:44, End Time: 2012-10-04 13:57:56 To: 4557, Order: 165217, Start Time: 2012-10-04 10:48:49, End Time: 2012-10-04 12:17:35 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 4 (14 on baseline) Performance Regressions: 26 (89 on baseline) Performance Improvements: 5 (49 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 942 (753 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Applications/JM/lencod/lencod: 2865.30% (0.2251 => 6.6749, std.dev.: 0.0105) MultiSource/Benchmarks/Bullet/bullet: 1134.85% (0.5820 => 7.1868, std.dev.: 0.1110) MultiSource/Benchmarks/McCat/09-vor/vor: -99.52% (26.6899 => 0.1270, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 220880.00% (0.0005 => 1.1049, std.dev.: 0.0037) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 6.13% (0.2886 => 0.3063, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.63% (0.4389 => 0.4636, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.83% (0.2765 => 0.2871, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.82% (0.5702 => 0.5863, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.76% (1.1165 => 1.1473, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.21% (0.8479 => 0.8666, std.dev.: 0.0047) MultiSource/Applications/spiff/spiff: 2.11% (0.7715 => 0.7878, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.47% (1.1351 => 1.1518, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.43% (12.9983 => 13.1845, std.dev.: 0.0396) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.37% (1.2402 => 1.2572, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.32% (4.3758 => 4.4337, std.dev.: 0.0131) MultiSource/Applications/JM/ldecod/ldecod: 1.30% (6.6229 => 6.7093, std.dev.: 0.0177) MultiSource/Benchmarks/MallocBench/gs/gs: 1.17% (3.9234 => 3.9694, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.08% (4.3310 => 4.3776, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.01% (1.2907 => 1.3037, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.13% (0.0841 => 0.0943, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.24% (13.3738 => 14.6095, std.dev.: 0.1303) SingleSource/Benchmarks/Stanford/Puzzle: 6.60% (0.1531 => 0.1632, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 6.60% (2.2651 => 2.4145, std.dev.: 0.0175) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.29% (0.7546 => 0.7945, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.17% (4.6997 => 4.8018, std.dev.: 0.0386) SingleSource/Benchmarks/Misc/ffbench: 1.69% (1.3910 => 1.4145, std.dev.: 0.0086) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.67% (2.7213 => 2.7668, std.dev.: 0.0113) MultiSource/Benchmarks/llubenchmark/llu: 1.63% (1.9960 => 2.0286, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/ary3: 1.58% (1.9987 => 2.0303, std.dev.: 0.0047) MultiSource/Applications/spiff/spiff: 1.03% (2.8489 => 2.8783, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.56% (1.4327 => 1.4103, std.dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.11% (43.8423 => 42.4790, std.dev.: 0.4121) MultiSource/Applications/lua/lua: -2.53% (30.2393 => 29.4743, std.dev.: 0.2563) SingleSource/Benchmarks/Misc-C++/stepanov_container: -2.25% (4.6283 => 4.5241, std.dev.: 0.0205) SingleSource/Benchmarks/Shootout/heapsort: -1.55% (3.3709 => 3.3185, std.dev.: 0.0120) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.56% (1.0195 => 1.0138, std.dev.: 0.0046) MultiSource/Applications/sqlite3/sqlite3: 0.78% (0.6173 => 0.6221, std.dev.: 0.0090) MultiSource/Benchmarks/McCat/08-main/main: -2.48% (0.1816 => 0.1771, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.53% (0.1505 => 0.1482, std.dev.: 0.0054) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.71% (0.3085 => 0.3107, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.23% (0.2355 => 0.2384, std.dev.: 0.0131) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.20% (0.3164 => 0.3202, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.13% (0.2304 => 0.2307, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel: -4.16% (0.0409 => 0.0392, std.dev.: 0.0032) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -31.54% (0.0241 => 0.0165, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 8.09% (0.0173 => 0.0187, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.87% (0.0383 => 0.0394, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.41% (0.0246 => 0.0245, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.58% (0.0279 => 0.0289, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -10.53% (0.0304 => 0.0272, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/casts: -41.11% (0.0180 => 0.0106, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/test1: -5.41% (0.0148 => 0.0140, std.dev.: 0.0032) SingleSource/UnitTests/Vector/multiplies: 1.58% (0.0253 => 0.0257, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: 20.74% (0.0270 => 0.0326, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -28.57% (0.0007 => 0.0005, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 0.96% (0.1456 => 0.1470, std.dev.: 0.0052) MultiSource/Applications/lemon/lemon: -1.04% (1.4762 => 1.4609, std.dev.: 0.0590) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.29% (0.1522 => 0.1472, std.dev.: 0.0049) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.29% (0.4092 => 0.4080, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.53% (0.1435 => 0.1413, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 13.04% (0.0537 => 0.0607, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -9.19% (0.0185 => 0.0168, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.13% (0.0664 => 0.0610, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.77% (1.1257 => 1.1344, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 64.71% (0.0017 => 0.0028) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.23% (0.0577 => 0.0636, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 56.52% (0.0138 => 0.0216, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.17% (0.7678 => 0.7665, std.dev.: 0.0177) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: -0.29% (1.7058 => 1.7009, std.dev.: 0.0038) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 141.57% (0.0089 => 0.0215, std.dev.: 0.0006) SingleSource/UnitTests/2003-08-11-VaListArg: 174.44% (0.0090 => 0.0247, std.dev.: 0.0003) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -25.67% (4.1772 => 3.1049, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/except: 81400.00% (0.0006 => 0.4890, std.dev.: 0.0046) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: 200.00% (0.0001 => 0.0003, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.09% (0.0745 => 0.0917, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.39% (0.6410 => 0.7076, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.40% (0.1159 => 0.1268, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 8.77% (2.1763 => 2.3672, std.dev.: 0.0249) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.57% (0.3582 => 0.3889, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 7.69% (0.5309 => 0.5717, std.dev.: 0.0021) MultiSource/Applications/minisat/minisat: 7.47% (0.6173 => 0.6634, std.dev.: 0.0037) MultiSource/Applications/lemon/lemon: 7.47% (1.0046 => 1.0796, std.dev.: 0.0053) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.36% (0.1414 => 0.1518, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.51% (1.5150 => 1.6137, std.dev.: 0.0096) MultiSource/Applications/SIBsim4/SIBsim4: 6.12% (1.1653 => 1.2366, std.dev.: 0.0054) MultiSource/Applications/kimwitu++/kc: 5.90% (15.3105 => 16.2142, std.dev.: 0.2113) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.51% (0.3901 => 0.4116, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.45% (0.2552 => 0.2691, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 5.22% (0.6915 => 0.7276, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.11% (0.7639 => 0.8029, std.dev.: 0.0026) MultiSource/Applications/d/make_dparser: 4.97% (3.0225 => 3.1726, std.dev.: 0.0309) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.94% (0.6069 => 0.6369, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.58% (1.2021 => 1.2572, std.dev.: 0.0039) MultiSource/Applications/oggenc/oggenc: 4.56% (4.7455 => 4.9619, std.dev.: 0.0519) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.54% (0.2797 => 0.2924, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 4.48% (0.3217 => 0.3361, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 4.40% (13.3238 => 13.9100, std.dev.: 0.0695) MultiSource/Applications/siod/siod: 4.34% (2.0972 => 2.1883, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.30% (12.6413 => 13.1845, std.dev.: 0.0396) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.24% (0.4248 => 0.4428, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.18% (0.4880 => 0.5084, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 4.16% (0.8405 => 0.8755, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.02% (1.1672 => 1.2141, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.01% (1.1827 => 1.2301, std.dev.: 0.0149) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.00% (6.2546 => 6.5050, std.dev.: 0.0319) MultiSource/Applications/hbd/hbd: 3.94% (1.3268 => 1.3791, std.dev.: 0.0119) MultiSource/Benchmarks/nbench/nbench: 3.90% (1.0821 => 1.1243, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.88% (0.2654 => 0.2757, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.67% (0.7226 => 0.7491, std.dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 3.57% (14.7256 => 15.2512, std.dev.: 0.0489) MultiSource/Benchmarks/Olden/bh/bh: 3.55% (0.2820 => 0.2920, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 3.54% (29.3170 => 30.3546, std.dev.: 0.3325) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.52% (0.8569 => 0.8871, std.dev.: 0.0045) MultiSource/Applications/JM/ldecod/ldecod: 3.37% (6.4908 => 6.7093, std.dev.: 0.0177) MultiSource/Applications/treecc/treecc: 3.26% (1.8798 => 1.9410, std.dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.24% (3.0758 => 3.1755, std.dev.: 0.0326) MultiSource/Benchmarks/mafft/pairlocalalign: 3.12% (8.2186 => 8.4753, std.dev.: 0.0825) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.93% (0.5636 => 0.5801, std.dev.: 0.0036) MultiSource/Applications/lua/lua: 2.73% (3.5980 => 3.6964, std.dev.: 0.0258) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (4.2616 => 4.3776, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.51% (1.0689 => 1.0957, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.39% (0.9029 => 0.9245, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.33% (4.0318 => 4.1256, std.dev.: 0.0259) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.32% (1.2742 => 1.3037, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/gs/gs: 2.31% (3.8796 => 3.9694, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.21% (4.3380 => 4.4337, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.14% (0.5740 => 0.5863, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.03% (0.5520 => 0.5632, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.92% (8.2559 => 8.4144, std.dev.: 0.0419) MultiSource/Applications/hexxagon/hexxagon: 1.70% (0.9425 => 0.9585, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 47.91% (0.0263 => 0.0389, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/pi: 41.37% (1.6538 => 2.3379, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 23.11% (0.0766 => 0.0943, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 22.12% (3.4629 => 4.2289, std.dev.: 0.0232) SingleSource/Benchmarks/Shootout/ary3: 16.51% (1.7426 => 2.0303, std.dev.: 0.0047) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.08% (2.4042 => 2.7668, std.dev.: 0.0113) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.02% (4.0101 => 4.5722, std.dev.: 0.0188) SingleSource/Benchmarks/Stanford/Puzzle: 13.89% (0.1433 => 0.1632, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 11.10% (1.6261 => 1.8066, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/lists: 9.02% (7.0025 => 7.6342, std.dev.: 0.0202) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.82% (0.2857 => 0.3109, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/mason/mason: 8.69% (0.5004 => 0.5439, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.54% (0.3301 => 0.3550, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.94% (40.4792 => 42.4790, std.dev.: 0.4121) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.54% (4.2129 => 4.4040, std.dev.: 0.0550) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.43% (2.5984 => 2.7134, std.dev.: 0.0270) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.42% (0.7609 => 0.7945, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/fp-convert: 4.38% (15.2242 => 15.8916, std.dev.: 0.0216) SingleSource/Benchmarks/Misc/dt: 4.21% (0.9851 => 1.0266, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.86% (3.4080 => 3.5397, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: 3.19% (3.2159 => 3.3185, std.dev.: 0.0120) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.15% (0.5587 => 0.5763, std.dev.: 0.0033) MultiSource/Applications/siod/siod: 2.94% (3.5520 => 3.6564, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.81% (6.6312 => 6.8173, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/hash: 2.63% (0.6308 => 0.6474, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 2.40% (2.3580 => 2.4145, std.dev.: 0.0175) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.95% (2.6656 => 2.7177, std.dev.: 0.0110) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.84% (22.3381 => 22.7481, std.dev.: 0.0337) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.69% (4.6127 => 4.6905, std.dev.: 0.0284) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.40% (2.4455 => 2.4797, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 1.21% (1.4184 => 1.4356, std.dev.: 0.0021) MultiSource/Benchmarks/BitBench/five11/five11: 1.19% (5.1938 => 5.2556, std.dev.: 0.0198) MultiSource/Benchmarks/Olden/em3d/em3d: 1.02% (4.6414 => 4.6886, std.dev.: 0.0058) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.67% (0.0591 => 0.0327, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -43.72% (0.2996 => 0.1686, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.82% (1.4189 => 1.1518, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.71% (1.4113 => 1.1473, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.72% (0.3497 => 0.2038, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.09% (5.2665 => 4.1558, std.dev.: 0.0275) SingleSource/Benchmarks/Shootout-C++/ary3: -20.36% (1.7473 => 1.3915, std.dev.: 0.0127) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.49% (1.7361 => 1.4671, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout/sieve: -12.23% (8.1594 => 7.1616, std.dev.: 0.0195) SingleSource/Benchmarks/Shootout-C++/moments: -9.43% (0.1114 => 0.1009, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.28% (1.1647 => 1.0566, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: -8.41% (9.5474 => 8.7447, std.dev.: 0.0217) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.13% (1.4034 => 1.2893, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.72% (15.8312 => 14.6095, std.dev.: 0.1303) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.61% (3.2007 => 2.9570, std.dev.: 0.0289) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.83% (3.6254 => 3.3779, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -6.68% (7.6833 => 7.1703, std.dev.: 0.0184) SingleSource/Benchmarks/Shootout-C++/fibo: -6.53% (4.6355 => 4.3329, std.dev.: 0.0210) MultiSource/Benchmarks/FreeBench/distray/distray: -6.38% (0.2664 => 0.2494, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/richards_benchmark: -6.36% (1.4441 => 1.3522, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.02% (2.9728 => 2.7937, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -5.85% (1.4021 => 1.3201, std.dev.: 0.0288) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.46% (3.9413 => 3.7260, std.dev.: 0.0087) MultiSource/Benchmarks/Olden/bh/bh: -5.24% (2.5166 => 2.3847, std.dev.: 0.0137) MultiSource/Applications/SIBsim4/SIBsim4: -5.24% (3.4230 => 3.2438, std.dev.: 0.0251) SingleSource/Benchmarks/Shootout/fib2: -5.20% (4.4195 => 4.1895, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.29% (0.4564 => 0.4368, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -4.19% (62.4126 => 59.7972, std.dev.: 0.0883) MultiSource/Applications/sgefa/sgefa: -4.06% (0.3746 => 0.3594, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/misr: -3.35% (0.4296 => 0.4152, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/methcall: -3.33% (9.2503 => 8.9427, std.dev.: 0.0245) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.10% (1.2722 => 1.2327, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.31% (3.7496 => 3.6629, std.dev.: 0.0084) MultiSource/Benchmarks/PAQ8p/paq8p: -2.20% (92.7467 => 90.7034, std.dev.: 0.5312) SingleSource/Benchmarks/Dhrystone/dry: -2.13% (2.4013 => 2.3501, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.01% (1.1683 => 1.1448, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -1.96% (45.4683 => 44.5757, std.dev.: 0.3082) SingleSource/Benchmarks/Shootout-C++/hash2: -1.86% (3.4876 => 3.4229, std.dev.: 0.0087) MultiSource/Applications/aha/aha: -1.78% (3.4286 => 3.3677, std.dev.: 0.0107) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.75% (2.3569 => 2.3157, std.dev.: 0.0125) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std.dev.: 0.0043) MultiSource/Benchmarks/sim/sim: -1.48% (3.8907 => 3.8331, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/neural/neural: -1.37% (1.0926 => 1.0776, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.34% (25.6658 => 25.3221, std.dev.: 0.0384) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.24% (9.3855 => 9.2695, std.dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/fldry: -1.21% (2.4971 => 2.4668, std.dev.: 0.0081) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.13% (27.1724 => 26.8655, std.dev.: 0.0071) MultiSource/Applications/JM/lencod/lencod: -1.05% (6.7458 => 6.6749, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/oourafft: -1.01% (3.8200 => 3.7816, std.dev.: 0.0136) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.58% (0.9980 => 1.0138, std.dev.: 0.0046) MultiSource/Applications/sqlite3/sqlite3: 3.30% (0.6022 => 0.6221, std.dev.: 0.0090) MultiSource/Benchmarks/McCat/08-main/main: 6.30% (0.1666 => 0.1771, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.63% (0.1554 => 0.1482, std.dev.: 0.0054) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.78% (0.3083 => 0.3107, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.42% (0.2394 => 0.2384, std.dev.: 0.0131) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.85% (0.3175 => 0.3202, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.22% (0.2302 => 0.2307, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel: -12.69% (0.0449 => 0.0392, std.dev.: 0.0032) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -31.25% (0.0240 => 0.0165, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -2.60% (0.0192 => 0.0187, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.03% (0.0390 => 0.0394, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -18.60% (0.0301 => 0.0245, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.76% (0.0284 => 0.0289, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -16.05% (0.0324 => 0.0272, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/casts: -40.11% (0.0177 => 0.0106, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/test1: -25.93% (0.0189 => 0.0140, std.dev.: 0.0032) SingleSource/UnitTests/Vector/multiplies: 3.21% (0.0249 => 0.0257, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: 0.31% (0.0325 => 0.0326, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 2.87% (0.1429 => 0.1470, std.dev.: 0.0052) MultiSource/Applications/lemon/lemon: -2.73% (1.5019 => 1.4609, std.dev.: 0.0590) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.93% (0.1501 => 0.1472, std.dev.: 0.0049) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.32% (0.4264 => 0.4080, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.13% (0.1344 => 0.1413, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.06% (0.0589 => 0.0607, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -27.59% (0.0232 => 0.0168, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.54% (0.0639 => 0.0610, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.05% (1.1350 => 1.1344, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 366.67% (0.0006 => 0.0028) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.16% (0.0637 => 0.0636, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.20% (0.0246 => 0.0216, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.64% (0.7541 => 0.7665, std.dev.: 0.0177) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 10.71% (1.5363 => 1.7009, std.dev.: 0.0038) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 06:58:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 08:58:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121004135816.92A352A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4561?compare_to=4556&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4561, Order: 165220, Start Time: 2012-10-04 12:34:51, End Time: 2012-10-04 13:59:58 To: 4556, Order: 165216, Start Time: 2012-10-04 10:40:38, End Time: 2012-10-04 12:05:47 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (5 on baseline) Performance Regressions: 1 (177 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 5 (0 on baseline) Unchanged Tests: 1036 (685 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.77% (54.3231 => 56.3729, std.dev.: 0.1069) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.19% (33.3628 => 33.2991, std.dev.: 0.0141) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.00% (2.7526 => 2.7525, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (2.1153 => 2.1153, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.00% (4.9745 => 4.9747, std.dev.: 0.0004) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.01% (33.2944 => 33.2991, std.dev.: 0.0141) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: -100.00% (7.3305 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 20.32% (2.0176 => 2.4275, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.02% (0.1410 => 0.1650, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops: 14.89% (0.0826 => 0.0949) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.80% (0.0819 => 0.0932, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 13.64% (0.2243 => 0.2549, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 11.45% (0.1013 => 0.1129, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.38% (0.1072 => 0.1194, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.25% (0.1413 => 0.1572, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 11.21% (0.4328 => 0.4813, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 11.19% (0.5818 => 0.6469, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 11.15% (0.4062 => 0.4515, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 11.09% (1.3693 => 1.5212, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 10.98% (0.5748 => 0.6379, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 10.97% (0.2781 => 0.3086, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.92% (0.2721 => 0.3018, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.83% (0.7710 => 0.8545, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 10.78% (0.7061 => 0.7822, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.71% (0.2782 => 0.3080, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.62% (0.3022 => 0.3343, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.58% (0.1588 => 0.1756, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.52% (3.9660 => 4.3831, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.52% (0.2596 => 0.2869, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 10.43% (0.7038 => 0.7772, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.42% (0.1986 => 0.2193, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.42% (0.3485 => 0.3848, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 10.36% (0.2761 => 0.3047, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.32% (0.2655 => 0.2929, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 10.32% (0.2607 => 0.2876, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 10.31% (0.2726 => 0.3007, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.30% (1.4563 => 1.6063, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.28% (0.3899 => 0.4300, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.26% (0.9199 => 1.0143, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.22% (1.9828 => 2.1854, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 10.19% (0.2690 => 0.2964, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.13% (0.2765 => 0.3045, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 10.12% (0.2628 => 0.2894, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 10.11% (0.2760 => 0.3039, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.10% (1.2193 => 1.3424, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/wc: 10.04% (0.2937 => 0.3232, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.03% (0.5265 => 0.5793, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.97% (0.6959 => 0.7653, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 9.96% (0.3293 => 0.3621, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.95% (0.2966 => 0.3261, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 9.95% (0.3107 => 0.3416, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.93% (0.4390 => 0.4826, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.92% (0.3489 => 0.3835, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.91% (0.4016 => 0.4414, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 9.91% (0.3149 => 0.3461, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.87% (0.1327 => 0.1458, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.87% (0.2696 => 0.2962, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.83% (0.3580 => 0.3932, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.82% (0.3756 => 0.4125, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 9.72% (0.3868 => 0.4244, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.58% (0.6283 => 0.6885, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 9.52% (0.3192 => 0.3496, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.51% (0.1062 => 0.1163, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.49% (0.1075 => 0.1177, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.47% (1.1364 => 1.2440, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/sieve: 9.44% (0.3453 => 0.3779, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 9.40% (0.2988 => 0.3269, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 9.32% (13.8202 => 15.1088, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.17% (0.1276 => 0.1393, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 9.14% (0.3534 => 0.3857, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.98% (0.3130 => 0.3411, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.97% (0.5577 => 0.6077, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 8.81% (0.1589 => 0.1729, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 8.71% (0.2995 => 0.3256, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.70% (0.2127 => 0.2312, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 8.69% (0.2945 => 0.3201, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.68% (0.2914 => 0.3167, std.dev.: 0.0033) MultiSource/Applications/lemon/lemon: 8.67% (1.0313 => 1.1207, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.64% (0.1157 => 0.1257, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.64% (0.1435 => 0.1559, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.60% (0.3246 => 0.3525, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 8.53% (1.1061 => 1.2004, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.46% (0.5637 => 0.6114, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.45% (0.4379 => 0.4749, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.40% (0.7460 => 0.8087, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.33% (0.4791 => 0.5190, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.21% (7.2180 => 7.8106, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.20% (0.6576 => 0.7115, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 8.10% (0.7506 => 0.8114, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.10% (0.3755 => 0.4059, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 8.01% (16.6129 => 17.9442, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.01% (0.2023 => 0.2185, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 7.99% (0.8310 => 0.8974, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 7.95% (0.6744 => 0.7280, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 7.92% (0.3220 => 0.3475, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.90% (0.8698 => 0.9385, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 7.88% (0.3578 => 0.3860, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 7.86% (3.1889 => 3.4395, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: 7.83% (0.2925 => 0.3154, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 7.82% (0.3646 => 0.3931, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.79% (0.4003 => 0.4315, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.77% (0.1865 => 0.2010, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 7.76% (0.3789 => 0.4083, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 7.75% (3.8646 => 4.1641, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/exceptions-2: 7.72% (0.3601 => 0.3879, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 7.71% (1.0594 => 1.1411, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions: 7.66% (0.3914 => 0.4214, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.64% (0.3650 => 0.3929, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 7.59% (0.3663 => 0.3941, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 7.51% (0.1478 => 0.1589, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions-3: 7.51% (0.3623 => 0.3895, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.46% (0.3940 => 0.4234, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 7.44% (2.1791 => 2.3413, std.dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.43% (0.1789 => 0.1922, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 7.42% (0.1657 => 0.1780, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.35% (0.3511 => 0.3769, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 7.35% (1.9270 => 2.0686, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.16% (3.6692 => 3.9319, std.dev.: 0.0125) MultiSource/Benchmarks/sim/sim: 7.12% (0.3131 => 0.3354, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.09% (0.1819 => 0.1948, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.07% (1.3245 => 1.4182, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 7.03% (14.8535 => 15.8976, std.dev.: 0.0093) MultiSource/Applications/SIBsim4/SIBsim4: 6.93% (1.2749 => 1.3633, std.dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 6.92% (4.6629 => 4.9855, std.dev.: 0.0144) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.92% (0.2140 => 0.2288, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 6.91% (1.2292 => 1.3141, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.90% (4.4433 => 4.7497, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/05-eks/eks: 6.86% (0.4113 => 0.4395, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.85% (4.3801 => 4.6800, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: 6.61% (8.4961 => 9.0578, std.dev.: 0.0139) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.60% (0.6135 => 0.6540, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.56% (0.1569 => 0.1672, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.44% (0.8818 => 0.9386, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 6.37% (0.6250 => 0.6648, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.15% (1.1333 => 1.2030, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.91% (0.2504 => 0.2652, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.76% (3.2742 => 3.4628, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.74% (0.4805 => 0.5081, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 5.58% (6.5754 => 6.9422, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.54% (4.9865 => 5.2629, std.dev.: 0.0147) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.26% (0.2321 => 0.2443, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.20% (0.9108 => 0.9582, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 5.19% (3.7467 => 3.9410, std.dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.03% (6.2785 => 6.5942, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.95% (1.5188 => 1.5940, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.77% (13.2842 => 13.9177, std.dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.56% (2.1007 => 2.1965, std.dev.: 0.0124) MultiSource/Applications/sqlite3/sqlite3: 3.08% (16.2614 => 16.7616, std.dev.: 0.0143) MultiSource/Applications/ClamAV/clamscan: 2.61% (14.5298 => 14.9084, std.dev.: 0.0130) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5134, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.09% (1.0895 => 1.3629, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: 25.07% (1.8175 => 2.2731, std.dev.: 0.0271) SingleSource/Benchmarks/Misc/richards_benchmark: 11.15% (1.1560 => 1.2849, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4143, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.26% (1.2998 => 1.3812, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0004, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0039, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6770, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9858, std.dev.: 0.0011) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.84% (10.7476 => 11.0532, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.20% (7.4271 => 7.5908, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.81% (1.4298 => 1.4557, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 1.72% (0.8273 => 0.8415, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5134, std.dev.: 0.0044) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.38% (1.9433 => 1.9701, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.29% (5.5130 => 5.5839, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1873, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.10% (8.8259 => 8.9234, std.dev.: 0.0104) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0272, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5884, std.dev.: 0.0055) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.60% (0.2670 => 0.1399, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -15.70% (0.0707 => 0.0596, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.37% (0.4657 => 0.3941, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.24% (1.3813 => 1.1846, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.05% (1.3819 => 1.1877, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.59% (22.5627 => 21.5269, std.dev.: 0.0143) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.64% (0.0997 => 0.0861, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.89% (0.2238 => 0.1972, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -11.46% (1.2308 => 1.0897, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.22% (20.3410 => 18.2620, std.dev.: 0.0191) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.20% (1.9290 => 1.8094, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.80% (1.3780 => 1.2981, std.dev.: 0.0071) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.07% (2.6470 => 2.5127, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.72% (0.9996 => 0.9524, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8005, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1561, std.dev.: 0.0240) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.47% (1.7688 => 1.7075, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.18% (0.4867 => 0.4712, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.45% (3.0263 => 2.9523, std.dev.: 0.0008) MultiSource/Applications/lua/lua: -2.40% (26.5159 => 25.8794, std.dev.: 0.0083) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.28% (1.9762 => 1.9311, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -1.66% (28.2225 => 27.7533, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.64% (6.3560 => 6.2517, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: -1.47% (4.5928 => 4.5254, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0064, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8656, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4952, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -1.16% (9.3358 => 9.2277, std.dev.: 0.0277) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2568, std.dev.: 0.0010) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 07:40:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 09:40:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121004144037.840CC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4562?compare_to=4558&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4562, Order: 165223, Start Time: 2012-10-04 13:22:48, End Time: 2012-10-04 14:42:19 To: 4558, Order: 165220, Start Time: 2012-10-04 11:34:23, End Time: 2012-10-04 12:53:46 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 7 (155 on baseline) Performance Improvements: 2 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 944 (689 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 2.73% (11.2086 => 11.5147, std.dev.: 0.0105) MultiSource/Benchmarks/PAQ8p/paq8p: 1.95% (15.2178 => 15.5150, std.dev.: 0.0089) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.67% (2.5370 => 2.5794, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.60% (3.6262 => 3.6842, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.53% (3.6267 => 3.6823, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.04% (8.1226 => 8.2073, std.dev.: 0.0105) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.21% (1.5330 => 1.5515, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.34% (4.5235 => 4.4631, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.07% (1.3310 => 1.3168) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 1.30% (0.5778 => 0.5853, std.dev.: 0.0048) MultiSource/Applications/SPASS/SPASS: 0.63% (16.0261 => 16.1278, std.dev.: 0.0106) MultiSource/Benchmarks/Bullet/bullet: -0.97% (54.2725 => 53.7464, std.dev.: 0.0137) MultiSource/Benchmarks/MallocBench/gs/gs: 0.74% (4.3366 => 4.3687, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.43% (0.0467 => 0.0465, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.43% (0.0469 => 0.0467, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.46% (0.0437 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.23% (0.0438 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.70% (0.0427 => 0.0424, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.47% (0.0427 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.48% (0.0419 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.24% (0.0420 => 0.0419, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.23% (0.0436 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.46% (0.0438 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.46% (0.0431 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.69% (0.0433 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.47% (0.0422 => 0.0420) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.24% (0.0422 => 0.0421, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.23% (0.0428 => 0.0427, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.47% (0.0430 => 0.0428, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.45% (0.0440 => 0.0438, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.45% (0.0441 => 0.0439, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.48% (0.0416 => 0.0414, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.48% (0.0417 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.47% (0.0428 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.47% (0.0429 => 0.0427, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.48% (0.0420 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.48% (0.0421 => 0.0419) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.49% (0.0411 => 0.0409) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0412 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.49% (0.0411 => 0.0409) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.49% (0.0412 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.45% (0.0448 => 0.0446, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0448 => 0.0448, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.49% (0.0409 => 0.0407) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.24% (0.0409 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.24% (0.0411 => 0.0410, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.24% (0.0412 => 0.0411) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.48% (0.0418 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.24% (0.0419 => 0.0418, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.65% (1.2371 => 1.2451, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.70% (7.5550 => 7.6834, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.41% (0.7332 => 0.7362, std.dev.: 0.0017) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.55% (0.0362 => 0.0364) MultiSource/Applications/oggenc/oggenc: 0.21% (0.1431 => 0.1434, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.05% (0.2139 => 0.2140, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -15.02% (63.2438 => 53.7464, std.dev.: 0.0137) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 31.59% (14.1553 => 18.6264, std.dev.: 0.0211) SingleSource/Benchmarks/Misc-C++-EH/spirit: 59.92% (3.4629 => 5.5378, std.dev.: 0.0155) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14227.64% (0.0720 => 10.3159, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952100.00% (0.0001 => 9.9522, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 49.65% (10.3673 => 15.5150, std.dev.: 0.0089) MultiSource/Benchmarks/McCat/08-main/main: 47.57% (0.2554 => 0.3769, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 30.59% (0.1056 => 0.1379, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 29.41% (0.1622 => 0.2099, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.13% (2.2022 => 2.5794, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 16.35% (7.0540 => 8.2073, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/flops: 14.73% (0.1432 => 0.1643, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.11% (0.1566 => 0.1787, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.83% (0.0834 => 0.0941, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.59% (1.7609 => 1.9826, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/trivial-interface: 11.83% (0.3473 => 0.3884, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.83% (0.0871 => 0.0974, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-3: 11.66% (0.3516 => 0.3926, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.64% (0.3497 => 0.3904, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.63% (0.3543 => 0.3955, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.60% (0.3561 => 0.3974, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.57% (0.3543 => 0.3953, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.23% (0.3694 => 0.4109, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 11.15% (0.3282 => 0.3648, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.10% (0.3828 => 0.4253, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.05% (0.3927 => 0.4361, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/property: 10.89% (0.3886 => 0.4309, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.61% (0.1584 => 0.1752, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 10.34% (10.4361 => 11.5147, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.84% (0.4879 => 0.5359, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 9.58% (0.1440 => 0.1578, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.46% (0.1438 => 0.1574, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.22% (0.3177 => 0.3470, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 8.75% (9.4845 => 10.3145, std.dev.: 0.0070) SingleSource/Benchmarks/McGill/chomp: 8.70% (0.1655 => 0.1799, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 8.54% (5.7591 => 6.2507, std.dev.: 0.0181) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.49% (0.6675 => 0.7242, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 8.48% (0.7115 => 0.7718, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 8.46% (0.3109 => 0.3372, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.36% (0.4615 => 0.5001, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 8.33% (0.7433 => 0.8052, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.26% (1.5415 => 1.6688, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.23% (0.2065 => 0.2235, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 8.19% (0.5925 => 0.6410, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.18% (0.6030 => 0.6523, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 8.02% (0.1695 => 0.1831, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.00% (0.1625 => 0.1755, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 7.92% (0.3423 => 0.3694, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.88% (0.2271 => 0.2450, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.85% (1.3050 => 1.4074, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.83% (0.8172 => 0.8812, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.78% (0.1337 => 0.1441, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.75% (4.2646 => 4.5952, std.dev.: 0.0095) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.70% (0.2700 => 0.2908, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 7.69% (0.3422 => 0.3685, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 7.67% (3.3354 => 3.5911, std.dev.: 0.0087) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.63% (0.3121 => 0.3359, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.60% (0.4103 => 0.4415, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.54% (0.5860 => 0.6302, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.52% (8.1363 => 8.7479, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.51% (0.2891 => 0.3108, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.50% (0.5105 => 0.5488, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.45% (4.9449 => 5.3135, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.45% (5.0018 => 5.3746, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.45% (0.5569 => 0.5984, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.45% (0.2107 => 0.2264, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 7.44% (0.7326 => 0.7871, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.42% (0.1510 => 0.1622, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.39% (0.4289 => 0.4606, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.38% (0.2831 => 0.3040, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.30% (0.2905 => 0.3117, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 7.25% (0.6456 => 0.6924, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.23% (0.4203 => 0.4507, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.22% (0.3865 => 0.4144, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.22% (1.5603 => 1.6729, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/ary: 7.21% (0.3232 => 0.3465, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.20% (7.9617 => 8.5349, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.18% (0.2758 => 0.2956, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.18% (0.3650 => 0.3912, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.16% (0.9765 => 1.0464, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.15% (0.5020 => 0.5379, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 7.14% (0.4048 => 0.4337, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.14% (0.3307 => 0.3543, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 7.13% (0.3603 => 0.3860, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 7.10% (0.7835 => 0.8391, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/wc: 7.08% (0.3052 => 0.3268, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.08% (0.2756 => 0.2951, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 7.07% (0.3283 => 0.3515, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.07% (0.8067 => 0.8637, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.06% (0.1940 => 0.2077, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.05% (0.3136 => 0.3357, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.04% (0.2871 => 0.3073, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 7.01% (0.1555 => 0.1664, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/matrix: 7.00% (0.3098 => 0.3315, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.99% (0.3162 => 0.3383, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.99% (0.4636 => 0.4960, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.97% (0.2725 => 0.2915, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 6.97% (0.3387 => 0.3623, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.96% (0.2714 => 0.2903, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.95% (0.4620 => 0.4941, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.94% (2.0665 => 2.2099, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 6.88% (0.2877 => 0.3075, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.87% (0.3826 => 0.4089, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.84% (0.3684 => 0.3936, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.82% (0.2872 => 0.3068, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.78% (0.2802 => 0.2992, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 6.78% (1.1642 => 1.2431, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.73% (0.2793 => 0.2981, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.72% (0.3379 => 0.3606, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 6.71% (3.8723 => 4.1322, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 6.30% (0.4299 => 0.4570, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 6.27% (1.0722 => 1.1394, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.15% (0.2603 => 0.2763, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 6.13% (2.0273 => 2.1516, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.11% (1.1861 => 1.2586, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.10% (0.3441 => 0.3651, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 6.01% (21.9371 => 23.2559, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/09-vor/vor: 6.01% (0.3180 => 0.3371, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.97% (0.1892 => 0.2005, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.88% (0.6450 => 0.6829, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 5.80% (0.8921 => 0.9438, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.78% (0.5981 => 0.6327, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.74% (1.5859 => 1.6770, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 5.71% (2.2969 => 2.4281, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.59% (0.4064 => 0.4291, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.46% (0.1906 => 0.2010, std.dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 5.13% (1.2842 => 1.3501, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.00% (1.4186 => 1.4896, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.98% (0.3131 => 0.3287, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.94% (0.2266 => 0.2378, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.86% (1.1840 => 1.2416, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.85% (2.2024 => 2.3092, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.26% (0.8101 => 0.8446, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.85% (0.3817 => 0.3964, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.10% (14.3668 => 14.8116, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.04% (1.1194 => 1.1534, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.98% (0.3427 => 0.3529, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 2.63% (17.1811 => 17.6329, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.48% (3.8922 => 3.9887, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2173, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 10.17% (3.1595 => 3.4808, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 10.00% (1.1396 => 1.2536, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3681, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 3.68% (0.5413 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.59% (3.6395 => 3.7701, std.dev.: 0.0028) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.79% (4.2280 => 4.3460, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7652, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (0.8275 => 0.8405, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8131, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.17% (2.6546 => 2.6857, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.06% (6.6874 => 0.1296, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -80.04% (0.8651 => 0.1727, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.90% (5.2763 => 3.2766, std.dev.: 0.0151) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.59% (5.3855 => 3.6842, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.21% (5.3526 => 3.6823, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -14.51% (54.1659 => 46.3050, std.dev.: 0.0599) MultiSource/Benchmarks/FreeBench/mason/mason: -13.32% (0.0811 => 0.0703, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -11.22% (22.1758 => 19.6886, std.dev.: 0.0187) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.18% (2.9384 => 2.6394, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.46% (1.1492 => 0.7647, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -16.18% (1.6925 => 1.4187, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.93% (0.0998 => 0.0859, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -11.20% (1.2373 => 1.0987, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3783, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/mason/mason: -10.04% (0.2161 => 0.1944, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.34% (19.9488 => 18.2849, std.dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.70% (1.8329 => 1.7101, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.33% (1.6805 => 1.5910, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.79% (1.5835 => 1.5076, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168) MultiSource/Applications/siod/siod: -3.62% (3.2827 => 3.1640, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.23% (0.9957 => 0.9635, std.dev.: 0.0070) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5041, std.dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: -2.99% (12.4730 => 12.1004, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.16% (8.1563 => 7.9805, std.dev.: 0.0184) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.11% (8.6802 => 8.4971, std.dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: -1.91% (4.6441 => 4.5556, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6810, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -1.72% (10.2830 => 10.1062, std.dev.: 0.0170) SingleSource/UnitTests/Vector/multiplies: -1.51% (2.5528 => 2.5143, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4222, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.11% (6.2999 => 6.2297, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/hash: -1.08% (4.9088 => 4.8560, std.dev.: 0.0202) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 11.93% (0.5229 => 0.5853, std.dev.: 0.0048) MultiSource/Applications/SPASS/SPASS: 7.59% (14.9895 => 16.1278, std.dev.: 0.0106) MultiSource/Benchmarks/MallocBench/gs/gs: 6.28% (4.1105 => 4.3687, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.70% (1.1048 => 1.2451, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.34% (7.1582 => 7.6834, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.32% (0.6222 => 0.7362, std.dev.: 0.0017) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36300.00% (0.0001 => 0.0364) MultiSource/Applications/oggenc/oggenc: -3.43% (0.1485 => 0.1434, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.13% (0.2116 => 0.2140, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 08:35:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 10:35:36 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121004153536.275B42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4563?compare_to=4560&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4563, Order: 165226, Start Time: 2012-10-04 14:14:22, End Time: 2012-10-04 15:37:19 To: 4560, Order: 165220, Start Time: 2012-10-04 12:33:44, End Time: 2012-10-04 13:57:56 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (14 on baseline) Performance Regressions: 6 (74 on baseline) Performance Improvements: 6 (44 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 965 (773 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.22% (0.0968 => 0.1096, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 1.82% (0.5717 => 0.5821, std.dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: 1.16% (8.4753 => 8.5739, std.dev.: 0.0299) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 6.34% (21.5679 => 22.9360, std.dev.: 0.1034) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.98% (6.3271 => 6.4523, std.dev.: 0.0451) SingleSource/Benchmarks/McGill/chomp: 1.14% (1.0099 => 1.0214, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.34% (0.8666 => 0.8463, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.16% (0.8770 => 0.8668, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -5.48% (2.7134 => 2.5647, std.dev.: 0.0354) MultiSource/Benchmarks/Prolangs-C++/primes/primes: -4.43% (0.7945 => 0.7593, std.dev.: 0.0127) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.57% (39.7220 => 39.0983, std.dev.: 0.0773) SingleSource/Benchmarks/Shootout/ary3: -1.39% (2.0303 => 2.0020, std.dev.: 0.0037) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.17% (1.0138 => 1.0257, std.dev.: 0.0106) MultiSource/Applications/sqlite3/sqlite3: -1.19% (0.6221 => 0.6147, std.dev.: 0.0086) MultiSource/Benchmarks/McCat/08-main/main: 2.99% (0.1771 => 0.1824, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 6.95% (0.1482 => 0.1585, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.10% (0.3107 => 0.3110, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.25% (0.2384 => 0.2390, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.87% (0.3202 => 0.3230, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.22% (0.2307 => 0.2312, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel: 11.22% (0.0392 => 0.0436, std.dev.: 0.0013) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 46.67% (0.0165 => 0.0242, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 4.28% (0.0187 => 0.0195, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.25% (0.0394 => 0.0393, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 24.49% (0.0245 => 0.0305, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.69% (0.0289 => 0.0287, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 20.22% (0.0272 => 0.0327, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 71.70% (0.0106 => 0.0182, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -4.29% (0.0140 => 0.0134, std.dev.: 0.0029) SingleSource/UnitTests/Vector/multiplies: -1.17% (0.0257 => 0.0254, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -9.20% (0.0326 => 0.0296, std.dev.: 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -3.20% (0.1470 => 0.1423, std.dev.: 0.0034) MultiSource/Applications/lemon/lemon: 0.33% (1.4609 => 1.4657, std.dev.: 0.0551) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: 4.55% (0.1472 => 0.1539, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.37% (0.4080 => 0.4024, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.18% (0.1413 => 0.1368, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.99% (0.0607 => 0.0613, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 7.14% (0.0168 => 0.0180, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.41% (0.0610 => 0.0643, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.45% (1.1344 => 1.1293, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.57% (0.0028 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -80.00% (0.0005 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.63% (0.0636 => 0.0640, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.98% (0.0216 => 0.0175, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.13% (0.7665 => 0.7655, std.dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.35% (1.7009 => 1.7068, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 142.70% (0.0089 => 0.0216, std.dev.: 0.0003) SingleSource/UnitTests/2003-08-11-VaListArg: 175.56% (0.0090 => 0.0248, std.dev.: 0.0005) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -27.20% (4.1772 => 3.0408, std.dev.: 0.0772) SingleSource/Benchmarks/Shootout-C++/except: 82416.67% (0.0006 => 0.4951, std.dev.: 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.22% (0.0745 => 0.0918, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.84% (0.1159 => 0.1273, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: 9.64% (0.5309 => 0.5821, std.dev.: 0.0031) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.55% (0.1414 => 0.1549, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.38% (0.6410 => 0.7011, std.dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: 8.17% (2.1763 => 2.3541, std.dev.: 0.0176) MultiSource/Applications/minisat/minisat: 8.07% (0.6173 => 0.6671, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.92% (0.3582 => 0.3830, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.65% (1.5150 => 1.6157, std.dev.: 0.0037) MultiSource/Applications/lemon/lemon: 6.56% (1.0046 => 1.0705, std.dev.: 0.0085) MultiSource/Applications/SIBsim4/SIBsim4: 6.46% (1.1653 => 1.2406, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.39% (0.2552 => 0.2715, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 6.30% (15.3105 => 16.2756, std.dev.: 0.1974) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.01% (0.6069 => 0.6434, std.dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: 5.65% (0.6915 => 0.7306, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/18-imp/imp: 5.53% (0.3217 => 0.3395, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.43% (0.2797 => 0.2949, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.17% (0.7639 => 0.8034, std.dev.: 0.0134) MultiSource/Applications/d/make_dparser: 5.01% (3.0225 => 3.1740, std.dev.: 0.0164) MultiSource/Benchmarks/McCat/09-vor/vor: 4.99% (0.3026 => 0.3177, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.95% (0.3901 => 0.4094, std.dev.: 0.0053) MultiSource/Applications/hbd/hbd: 4.91% (1.3268 => 1.3919, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.51% (0.4880 => 0.5100, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.43% (1.1827 => 1.2351, std.dev.: 0.0190) MultiSource/Applications/SPASS/SPASS: 4.42% (13.3238 => 13.9133, std.dev.: 0.0656) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.40% (6.2546 => 6.5296, std.dev.: 0.0677) MultiSource/Benchmarks/Bullet/bullet: 4.35% (29.3170 => 30.5934, std.dev.: 0.1683) MultiSource/Applications/lua/lua: 4.34% (3.5980 => 3.7541, std.dev.: 0.0441) MultiSource/Benchmarks/mafft/pairlocalalign: 4.32% (8.2186 => 8.5739, std.dev.: 0.0299) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.30% (0.7226 => 0.7537, std.dev.: 0.0113) MultiSource/Applications/Burg/burg: 4.16% (1.1440 => 1.1916, std.dev.: 0.0112) MultiSource/Applications/siod/siod: 4.09% (2.0972 => 2.1830, std.dev.: 0.0194) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.08% (0.4562 => 0.4748, std.dev.: 0.0051) MultiSource/Applications/oggenc/oggenc: 3.88% (4.7455 => 4.9297, std.dev.: 0.0616) MultiSource/Applications/sgefa/sgefa: 3.86% (0.2877 => 0.2988, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 3.81% (1.8798 => 1.9515, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.56% (0.3062 => 0.3171, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.56% (12.6413 => 13.0911, std.dev.: 0.0681) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.45% (1.2021 => 1.2436, std.dev.: 0.0096) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.38% (0.7784 => 0.8047, std.dev.: 0.0072) MultiSource/Benchmarks/nbench/nbench: 3.37% (1.0821 => 1.1186, std.dev.: 0.0106) MultiSource/Applications/JM/lencod/lencod: 3.31% (14.7256 => 15.2123, std.dev.: 0.0371) MultiSource/Benchmarks/sim/sim: 3.27% (0.3084 => 0.3185, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.26% (1.0689 => 1.1037, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.22% (0.3418 => 0.3528, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.11% (2.0317 => 2.0949, std.dev.: 0.0224) MultiSource/Applications/JM/ldecod/ldecod: 2.84% (6.4908 => 6.6752, std.dev.: 0.0344) SingleSource/Benchmarks/Shootout-C++/hash2: 2.73% (0.3847 => 0.3952, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.77% (1.3935 => 1.4182, std.dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 1.72% (0.9425 => 0.9587, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 47.53% (0.0263 => 0.0388, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/pi: 41.41% (1.6538 => 2.3387, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2279, std.dev.: 0.0016) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 17.99% (0.0917 => 0.1082, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.71% (0.0766 => 0.0894, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/ary3: 14.89% (1.7426 => 2.0020, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.85% (4.0101 => 4.5654, std.dev.: 0.0349) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.66% (2.4042 => 2.7327, std.dev.: 0.0172) SingleSource/Benchmarks/Stanford/Puzzle: 12.70% (0.1433 => 0.1615, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/queens: 11.11% (1.6261 => 1.8068, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/mason/mason: 10.01% (0.5004 => 0.5505, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: 9.09% (7.0025 => 7.6391, std.dev.: 0.0064) MultiSource/Benchmarks/nbench/nbench: 8.33% (21.1721 => 22.9360, std.dev.: 0.1034) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.86% (1.0063 => 1.0854, std.dev.: 0.0182) SingleSource/Benchmarks/Misc/dt: 4.56% (0.9851 => 1.0300, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/fp-convert: 4.10% (15.2242 => 15.8479, std.dev.: 0.0219) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.88% (3.4080 => 3.5404, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.35% (0.5587 => 0.5774, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 3.18% (6.9722 => 7.1939, std.dev.: 0.0192) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.82% (6.6312 => 6.8185, std.dev.: 0.0276) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.29% (4.6127 => 4.7184, std.dev.: 0.0366) MultiSource/Applications/siod/siod: 2.27% (3.5520 => 3.6326, std.dev.: 0.0205) SingleSource/Benchmarks/Misc/ffbench: 1.32% (1.4117 => 1.4304, std.dev.: 0.0070) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.01% (2.4455 => 2.4701, std.dev.: 0.0073) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -44.36% (0.2996 => 0.1667, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.33% (0.0591 => 0.0329, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.06% (1.4113 => 1.1423, std.dev.: 0.0095) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.60% (1.4189 => 1.1550, std.dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.18% (0.3497 => 0.2127, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.43% (5.2665 => 4.0853, std.dev.: 0.0405) SingleSource/Benchmarks/Shootout-C++/ary3: -20.44% (1.7473 => 1.3901, std.dev.: 0.0436) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -14.71% (1.7361 => 1.4807, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1597, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/17-bintr/bintr: -11.12% (0.0917 => 0.0815, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.60% (1.1647 => 1.0529, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: -8.37% (9.5474 => 8.7484, std.dev.: 0.0184) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.31% (1.4034 => 1.2868, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.49% (3.2007 => 2.9610, std.dev.: 0.0133) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.92% (3.6254 => 3.3747, std.dev.: 0.0213) MultiSource/Applications/lambda-0_1_3/lambda: -6.64% (7.6833 => 7.1730, std.dev.: 0.0308) SingleSource/Benchmarks/Shootout-C++/fibo: -6.59% (4.6355 => 4.3301, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/richards_benchmark: -6.32% (1.4441 => 1.3529, std.dev.: 0.0178) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.00% (2.9728 => 2.7943, std.dev.: 0.0133) MultiSource/Applications/SIBsim4/SIBsim4: -5.76% (3.4230 => 3.2258, std.dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -5.60% (1.4021 => 1.3236, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.47% (3.9413 => 3.7259, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/fib2: -5.25% (4.4195 => 4.1875, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/bh/bh: -5.15% (2.5166 => 2.3871, std.dev.: 0.0346) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.78% (0.4564 => 0.4346, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -4.16% (62.4126 => 59.8164, std.dev.: 0.0106) MultiSource/Benchmarks/FreeBench/distray/distray: -3.94% (0.2664 => 0.2559, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.93% (61.1734 => 58.7696, std.dev.: 0.7200) SingleSource/Benchmarks/McGill/misr: -3.26% (0.4296 => 0.4156, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: -3.23% (9.2503 => 8.9512, std.dev.: 0.0260) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.06% (3.7496 => 3.6350, std.dev.: 0.0144) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.26% (1.1683 => 1.1419, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/dry: -2.21% (2.4013 => 2.3482, std.dev.: 0.0003) MultiSource/Applications/aha/aha: -2.04% (3.4286 => 3.3587, std.dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/hash2: -1.92% (3.4876 => 3.4206, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.84% (2.8964 => 2.8430, std.dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.70% (9.3855 => 9.2256, std.dev.: 0.0350) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.68% (1.0686 => 1.0506, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/neural/neural: -1.67% (1.0926 => 1.0744, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -1.63% (3.8907 => 3.8272, std.dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3077, std.dev.: 0.0085) SingleSource/Benchmarks/Dhrystone/fldry: -1.37% (2.4971 => 2.4628, std.dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.23% (27.1724 => 26.8378, std.dev.: 0.0645) MultiSource/Applications/JM/lencod/lencod: -1.13% (6.7458 => 6.6697, std.dev.: 0.0112) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.78% (0.9980 => 1.0257, std.dev.: 0.0106) MultiSource/Applications/sqlite3/sqlite3: 2.08% (0.6022 => 0.6147, std.dev.: 0.0086) MultiSource/Benchmarks/McCat/08-main/main: 9.48% (0.1666 => 0.1824, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.99% (0.1554 => 0.1585, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.88% (0.3083 => 0.3110, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.17% (0.2394 => 0.2390, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.73% (0.3175 => 0.3230, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.43% (0.2302 => 0.2312, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel: -2.90% (0.0449 => 0.0436, std.dev.: 0.0013) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.83% (0.0240 => 0.0242, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.56% (0.0192 => 0.0195, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.77% (0.0390 => 0.0393, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.33% (0.0301 => 0.0305, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.06% (0.0284 => 0.0287, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.93% (0.0324 => 0.0327, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 2.82% (0.0177 => 0.0182, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -29.10% (0.0189 => 0.0134, std.dev.: 0.0029) SingleSource/UnitTests/Vector/multiplies: 2.01% (0.0249 => 0.0254, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -8.92% (0.0325 => 0.0296, std.dev.: 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.42% (0.1429 => 0.1423, std.dev.: 0.0034) MultiSource/Applications/lemon/lemon: -2.41% (1.5019 => 1.4657, std.dev.: 0.0551) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 2.53% (0.1501 => 0.1539, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.63% (0.4264 => 0.4024, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.79% (0.1344 => 0.1368, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.07% (0.0589 => 0.0613, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -22.41% (0.0232 => 0.0180, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.63% (0.0639 => 0.0643, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.50% (1.1350 => 1.1293, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 350.00% (0.0006 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -95.83% (0.0024 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.47% (0.0637 => 0.0640, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.86% (0.0246 => 0.0175, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.51% (0.7541 => 0.7655, std.dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.10% (1.5363 => 1.7068, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 08:52:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 10:52:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121004155241.7ADB12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4564?compare_to=4561&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4564, Order: 165226, Start Time: 2012-10-04 14:28:49, End Time: 2012-10-04 15:54:22 To: 4561, Order: 165220, Start Time: 2012-10-04 12:34:51, End Time: 2012-10-04 13:59:58 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (5 on baseline) Performance Regressions: 8 (181 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 5 (0 on baseline) Unchanged Tests: 1029 (682 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.54% (1.5940 => 1.6185, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 1.39% (1.5212 => 1.5423, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.29% (0.9582 => 0.9706, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.16% (5.2629 => 5.3239, std.dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 1.12% (4.9855 => 5.0415, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.11% (0.9386 => 0.9490, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.07% (2.1965 => 2.2200, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/ffbench: 7.17% (0.8415 => 0.9018, std.dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.90% (33.2991 => 33.5998, std.dev.: 0.0070) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.00% (2.7525 => 2.7526, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.00% (2.1153 => 2.1154, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (4.9747 => 4.9747, std.dev.: 0.0003) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.92% (33.2944 => 33.5998, std.dev.: 0.0070) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: -100.00% (7.3305 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.42% (2.0176 => 2.4498, std.dev.: 0.0059) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.59% (0.1410 => 0.1658, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.38% (0.0819 => 0.0945, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 15.25% (0.0826 => 0.0952, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 14.22% (0.2243 => 0.2562, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 12.63% (1.3693 => 1.5423, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.59% (0.0834 => 0.0939, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 12.44% (0.1013 => 0.1139, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 12.06% (0.4328 => 0.4850, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.72% (0.2721 => 0.3040, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.68% (0.1413 => 0.1578, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 11.54% (0.2781 => 0.3102, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 11.45% (0.4062 => 0.4527, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.31% (0.3899 => 0.4340, std.dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.29% (0.1072 => 0.1193, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.29% (0.2782 => 0.3096, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 11.24% (0.7038 => 0.7829, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.21% (3.9660 => 4.4104, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.20% (0.0964 => 0.1072, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.15% (0.1588 => 0.1765, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.12% (0.3022 => 0.3358, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: 11.07% (0.5818 => 0.6462, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.00% (0.1327 => 0.1473, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.99% (0.3485 => 0.3868, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.98% (0.2596 => 0.2881, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 10.86% (0.2607 => 0.2890, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.85% (0.9199 => 1.0197, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 10.79% (0.2937 => 0.3254, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.79% (1.9828 => 2.1968, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.79% (0.2966 => 0.3286, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.78% (1.2193 => 1.3508, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 10.76% (0.2760 => 0.3057, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.73% (0.2655 => 0.2940, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.71% (0.7710 => 0.8536, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 10.71% (0.2726 => 0.3018, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 10.71% (0.2690 => 0.2978, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.70% (0.3580 => 0.3963, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 10.68% (0.5748 => 0.6362, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.66% (0.6283 => 0.6953, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.66% (0.3489 => 0.3861, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.65% (1.4563 => 1.6114, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 10.62% (0.2628 => 0.2907, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 10.60% (0.3293 => 0.3642, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 10.58% (0.2761 => 0.3053, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.52% (0.2765 => 0.3056, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.52% (0.5265 => 0.5819, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 10.51% (0.3149 => 0.3480, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.51% (0.4016 => 0.4438, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.49% (0.6959 => 0.7689, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 10.46% (0.3107 => 0.3432, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.44% (0.3756 => 0.4148, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.39% (0.2696 => 0.2976, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.38% (1.1364 => 1.2544, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 10.36% (0.1062 => 0.1172, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 10.34% (0.3868 => 0.4268, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 10.34% (0.3453 => 0.3810, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 10.34% (0.7061 => 0.7791, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.27% (0.4390 => 0.4841, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 10.18% (0.3192 => 0.3517, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 10.16% (13.8202 => 15.2237, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/matrix: 10.11% (0.2988 => 0.3290, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.07% (0.1986 => 0.2186, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.05% (0.1075 => 0.1183, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 9.99% (0.3534 => 0.3887, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.85% (0.1157 => 0.1271, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.80% (0.1276 => 0.1401, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 9.68% (0.2995 => 0.3285, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.52% (0.3130 => 0.3428, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.50% (0.5577 => 0.6107, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.48% (0.4791 => 0.5245, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 9.37% (0.2945 => 0.3221, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: 9.37% (1.0313 => 1.1279, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 9.31% (0.1589 => 0.1737, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.25% (0.4379 => 0.4784, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.06% (0.2914 => 0.3178, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.99% (0.1435 => 0.1564, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.97% (0.3755 => 0.4092, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 8.96% (16.6129 => 18.1008, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.92% (0.5637 => 0.6140, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 8.90% (1.1061 => 1.2045, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.89% (0.8698 => 0.9471, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.85% (0.7460 => 0.8120, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.84% (0.2127 => 0.2315, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 8.73% (0.3220 => 0.3501, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 8.72% (0.8310 => 0.9035, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.72% (0.3246 => 0.3529, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 8.68% (3.8646 => 4.2001, std.dev.: 0.0089) MultiSource/Applications/minisat/minisat: 8.66% (0.6744 => 0.7328, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.56% (7.2180 => 7.8356, std.dev.: 0.0036) MultiSource/Applications/spiff/spiff: 8.50% (0.7506 => 0.8144, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: 8.49% (3.1889 => 3.4596, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 8.34% (1.9270 => 2.0877, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.26% (0.2023 => 0.2190, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.18% (0.6576 => 0.7114, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 8.16% (1.0594 => 1.1458, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.15% (0.1865 => 0.2017, std.dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 8.12% (4.6629 => 5.0415, std.dev.: 0.0109) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.08% (0.1819 => 0.1966, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 8.08% (2.1791 => 2.3552, std.dev.: 0.0086) MultiSource/Benchmarks/McCat/09-vor/vor: 8.07% (0.2925 => 0.3161, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 7.92% (0.1478 => 0.1595, std.dev.: 0.0032) MultiSource/Benchmarks/sim/sim: 7.86% (0.3131 => 0.3377, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.84% (0.1569 => 0.1692, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.80% (0.3511 => 0.3785, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.76% (3.6692 => 3.9540, std.dev.: 0.0125) MultiSource/Benchmarks/Olden/em3d/em3d: 7.72% (0.1657 => 0.1785, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.68% (1.3245 => 1.4262, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.62% (0.8818 => 0.9490, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 7.60% (14.8535 => 15.9829, std.dev.: 0.0046) MultiSource/Applications/SIBsim4/SIBsim4: 7.60% (1.2749 => 1.3718, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.49% (0.1789 => 0.1923, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.49% (0.4113 => 0.4421, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.48% (0.2140 => 0.2300, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 7.48% (1.2292 => 1.3211, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.47% (4.3801 => 4.7075, std.dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: 7.43% (8.4961 => 9.1275, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.42% (0.6135 => 0.6590, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.40% (4.4433 => 4.7719, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/bigfib: 7.36% (0.6250 => 0.6710, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 6.87% (0.4003 => 0.4278, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.77% (4.9865 => 5.3239, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-4: 6.75% (0.3646 => 0.3892, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/for-in: 6.73% (0.3789 => 0.4044, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 6.69% (0.3914 => 0.4176, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 6.68% (0.3578 => 0.3817, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.66% (0.4805 => 0.5125, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.64% (1.1333 => 1.2085, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.63% (0.2504 => 0.2670, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.57% (0.9108 => 0.9706, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.56% (1.5188 => 1.6185, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.53% (0.3601 => 0.3836, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.52% (0.3940 => 0.4197, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.52% (0.3650 => 0.3888, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.50% (0.3663 => 0.3901, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.49% (3.2742 => 3.4867, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 6.40% (0.3623 => 0.3855, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 6.29% (6.5754 => 6.9891, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.01% (0.3245 => 0.3440, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 5.93% (0.2008 => 0.2127, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.86% (0.2321 => 0.2457, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 5.85% (3.7467 => 3.9660, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.68% (2.1007 => 2.2200, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.60% (6.2785 => 6.6303, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.12% (13.2842 => 13.9650, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.46% (0.2243 => 0.2343, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 3.64% (16.2614 => 16.8529, std.dev.: 0.0077) MultiSource/Applications/ClamAV/clamscan: 3.32% (14.5298 => 15.0117, std.dev.: 0.0111) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5168, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 24.57% (1.8175 => 2.2640, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/richards_benchmark: 11.06% (1.1560 => 1.2839, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4144, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.09% (1.2998 => 1.3790, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0044, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6760, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9857, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.30% (10.7476 => 11.1024, std.dev.: 0.0436) SingleSource/Regression/C/uint64_to_float: 3.03% (0.5449 => 0.5614) SingleSource/Benchmarks/Misc/salsa20: 2.26% (7.4271 => 7.5948, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 1.85% (1.4298 => 1.4563, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5137, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9697, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2123, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1868, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5786, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0274, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5873, std.dev.: 0.0073) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.23% (0.2670 => 0.1409, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.34% (0.4657 => 0.3896, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -15.56% (0.0707 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.90% (1.3813 => 1.1893, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.85% (1.3819 => 1.1905, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.87% (22.5627 => 21.6895, std.dev.: 0.0085) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.34% (0.0997 => 0.0864, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/mason/mason: -11.89% (0.2238 => 0.1972, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.20% (1.2308 => 1.0929, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.16% (20.3410 => 18.2738, std.dev.: 0.0307) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.08% (1.3780 => 1.2942, std.dev.: 0.0175) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.19% (2.6470 => 2.5096, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.68% (0.9996 => 0.9528, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.54% (3.2729 => 3.1569, std.dev.: 0.0028) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.36% (1.7688 => 1.7094, std.dev.: 0.0166) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.59% (26.5159 => 25.8293, std.dev.: 0.0248) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.40% (3.0263 => 2.9536, std.dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.35% (1.9762 => 1.9298, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.90% (0.6589 => 0.6464, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.69% (6.3560 => 6.2487, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: -1.66% (28.2225 => 27.7527, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511) MultiSource/Applications/sqlite3/sqlite3: -1.50% (4.5928 => 4.5240, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0074, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4947, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.19% (3.9173 => 3.8706, std.dev.: 0.0069) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2580, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 09:29:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 11:29:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121004162908.769222A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4565?compare_to=4562&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4565, Order: 165228, Start Time: 2012-10-04 15:11:19, End Time: 2012-10-04 16:30:50 To: 4562, Order: 165223, Start Time: 2012-10-04 13:22:48, End Time: 2012-10-04 14:42:19 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (157 on baseline) Performance Improvements: 0 (44 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 951 (686 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.10% (3.7473 => 3.8260, std.dev.: 0.0200) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.16% (79.3170 => 80.2348, std.dev.: 0.2525) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.14% (0.5853 => 0.5861, std.dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 0.41% (16.1278 => 16.1941, std.dev.: 0.0126) MultiSource/Benchmarks/Bullet/bullet: 0.40% (53.7464 => 53.9612, std.dev.: 0.0117) MultiSource/Benchmarks/MallocBench/gs/gs: 0.30% (4.3687 => 4.3819, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0465 => 0.0465, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0467 => 0.0467, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.23% (0.0435 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.23% (0.0437 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.24% (0.0424 => 0.0423, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0425 => 0.0425, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.24% (0.0417 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.24% (0.0419 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0435 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.23% (0.0436 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0429 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0430 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.24% (0.0420 => 0.0419, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.24% (0.0421 => 0.0420, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.23% (0.0427 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.23% (0.0428 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0438 => 0.0438, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0439 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0414 => 0.0414, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0415 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.23% (0.0426 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0427 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.24% (0.0418 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.24% (0.0419 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0409 => 0.0409, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.24% (0.0412 => 0.0411) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0409 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0410 => 0.0410, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.22% (0.0446 => 0.0447) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.22% (0.0448 => 0.0447) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0407 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.25% (0.0408 => 0.0409, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.24% (0.0410 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.24% (0.0411 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.24% (0.0416 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.24% (0.0418 => 0.0417, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.13% (1.2451 => 1.2467, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.49% (7.6834 => 7.7210, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.14% (0.7362 => 0.7372, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0364 => 0.0364, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -0.21% (0.1434 => 0.1431, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.2140 => 0.2140, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -14.68% (63.2438 => 53.9612, std.dev.: 0.0117) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.07% (14.1553 => 18.6946, std.dev.: 0.0151) SingleSource/Benchmarks/Misc-C++-EH/spirit: 60.78% (3.4629 => 5.5676, std.dev.: 0.0165) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14224.58% (0.0720 => 10.3137, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952400.00% (0.0001 => 9.9525, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 49.18% (10.3673 => 15.4661, std.dev.: 0.0085) MultiSource/Benchmarks/McCat/08-main/main: 48.86% (0.2554 => 0.3802, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/distray/distray: 31.16% (0.1056 => 0.1385) SingleSource/Benchmarks/Misc/richards_benchmark: 29.96% (0.1622 => 0.2108, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.54% (2.2022 => 2.5665, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 16.17% (7.0540 => 8.1943, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/flops: 15.08% (0.1432 => 0.1648, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.18% (0.1566 => 0.1788, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.95% (0.0834 => 0.0942, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.84% (1.7609 => 1.9870, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 12.34% (0.3282 => 0.3687, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.94% (0.0871 => 0.0975, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 11.36% (10.4361 => 11.6215, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/trivial-interface: 10.74% (0.3473 => 0.3846) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.73% (0.1584 => 0.1754, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.67% (0.3561 => 0.3941, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.61% (0.3543 => 0.3919, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.61% (0.3516 => 0.3889, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.53% (0.3543 => 0.3916, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.49% (0.3497 => 0.3864, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.42% (0.3694 => 0.4079, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.21% (0.3927 => 0.4328, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.16% (0.3828 => 0.4217, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.06% (0.3886 => 0.4277, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.90% (0.4879 => 0.5362, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/power/power: 9.79% (0.1440 => 0.1581, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.39% (0.1438 => 0.1573, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.32% (0.3177 => 0.3473, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 9.13% (9.4845 => 10.3507, std.dev.: 0.0055) MultiSource/Applications/oggenc/oggenc: 8.96% (5.7591 => 6.2751, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.79% (0.6675 => 0.7262, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 8.79% (0.7433 => 0.8086, std.dev.: 0.0065) SingleSource/Benchmarks/McGill/chomp: 8.76% (0.1655 => 0.1800, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 8.70% (0.7115 => 0.7734, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 8.51% (0.1175 => 0.1275, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.43% (0.4615 => 0.5004, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.38% (0.1337 => 0.1449, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.37% (0.1625 => 0.1761, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.37% (1.5415 => 1.6705, std.dev.: 0.0026) MultiSource/Applications/sgefa/sgefa: 8.33% (0.3109 => 0.3368, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 8.26% (0.1695 => 0.1835, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 8.18% (0.3423 => 0.3703, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.09% (0.5105 => 0.5518, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.09% (0.2065 => 0.2232, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.08% (0.1510 => 0.1632, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 8.02% (3.3354 => 3.6029, std.dev.: 0.0082) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.02% (0.8172 => 0.8827, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.01% (4.2646 => 4.6063, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.00% (0.2700 => 0.2916, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.97% (0.2271 => 0.2452, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 7.95% (0.3422 => 0.3694, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.92% (1.3050 => 1.4083, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.91% (0.3121 => 0.3368, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.73% (0.5860 => 0.6313, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.70% (0.5925 => 0.6381, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.69% (0.2107 => 0.2269, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.65% (1.5603 => 1.6797, std.dev.: 0.0074) SingleSource/UnitTests/ObjC++/property-reference-object: 7.65% (0.6030 => 0.6491, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.64% (0.3232 => 0.3479, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.62% (8.1363 => 8.7562, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.61% (5.0018 => 5.3822, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.58% (0.4103 => 0.4414, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 7.54% (0.6456 => 0.6943, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.54% (0.2891 => 0.3109, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.54% (4.9449 => 5.3175, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.53% (0.3307 => 0.3556, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.52% (0.5569 => 0.5988, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.52% (0.4203 => 0.4519, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.51% (0.4289 => 0.4611, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.41% (0.8067 => 0.8665, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.40% (0.3865 => 0.4151, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.40% (0.3650 => 0.3920, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.40% (0.2758 => 0.2962, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.37% (0.1940 => 0.2083, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.35% (0.9765 => 1.0483, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 7.35% (0.2831 => 0.3039, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.33% (0.2905 => 0.3118) SingleSource/Benchmarks/Shootout-C++/except: 7.24% (0.2871 => 0.3079, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 7.24% (0.3603 => 0.3864, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.24% (0.3136 => 0.3363, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 7.24% (0.7835 => 0.8402, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/wc: 7.21% (0.3052 => 0.3272, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/lists1: 7.19% (0.3684 => 0.3949, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.17% (0.5020 => 0.5380, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.16% (7.9617 => 8.5319, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.14% (0.4636 => 0.4967, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 7.14% (0.1555 => 0.1666, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.12% (0.3162 => 0.3387, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 7.12% (0.3387 => 0.3628, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 7.11% (0.4048 => 0.4336, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.11% (0.2756 => 0.2952, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.10% (0.2872 => 0.3076, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 7.10% (0.3098 => 0.3318, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.10% (1.1642 => 1.2468, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: 7.08% (0.2725 => 0.2918, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 7.07% (0.3283 => 0.3515, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.04% (0.7326 => 0.7842, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.03% (0.3826 => 0.4095, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.99% (2.0665 => 2.2110, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.99% (0.2877 => 0.3078, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.93% (0.4620 => 0.4940, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 6.92% (3.8723 => 4.1401, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/hello: 6.85% (0.2714 => 0.2900, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.78% (0.2802 => 0.2992, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.77% (0.2793 => 0.2982, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 6.69% (0.3379 => 0.3605, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 6.55% (1.0722 => 1.1424, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 6.42% (2.0273 => 2.1575, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/05-eks/eks: 6.37% (0.4299 => 0.4573, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.34% (0.3441 => 0.3659, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.30% (0.2603 => 0.2767, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.27% (1.1861 => 1.2605, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 6.26% (0.3180 => 0.3379, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.24% (1.5859 => 1.6848, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 6.14% (21.9371 => 23.2845, std.dev.: 0.0125) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.08% (0.1892 => 0.2007, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.99% (0.5981 => 0.6339, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 5.88% (0.8921 => 0.9446, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.84% (0.6450 => 0.6827, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 5.82% (2.2969 => 2.4306, std.dev.: 0.0101) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.61% (0.4064 => 0.4292, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.51% (0.1906 => 0.2011, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.35% (2.2024 => 2.3202, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.25% (0.2266 => 0.2385, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.24% (1.4186 => 1.4930, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 5.17% (1.1840 => 1.2452, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (0.3131 => 0.3292, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.89% (1.2842 => 1.3470, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.36% (0.8101 => 0.8454, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.44% (0.3427 => 0.3545, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.30% (14.3668 => 14.8413, std.dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.00% (1.1194 => 1.1530, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.96% (0.3817 => 0.3930, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 2.89% (17.1811 => 17.6774, std.dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.85% (3.8922 => 4.0031, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 10.17% (3.1595 => 3.4809, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 10.04% (1.1396 => 1.2540, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (3.1578 => 3.3677, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.52% (3.6395 => 3.7677, std.dev.: 0.0035) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.80% (4.2280 => 4.3463, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8132, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.33% (2.6546 => 2.6899, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.18% (6.5088 => 6.5854, std.dev.: 0.0063) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.06% (6.6874 => 0.1295, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.06% (0.8651 => 0.1725, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.86% (5.2763 => 3.2787, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.93% (5.3855 => 3.6657, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.55% (5.3526 => 3.6638, std.dev.: 0.0027) SingleSource/UnitTests/Vector/constpool: -14.51% (54.1659 => 46.3090, std.dev.: 0.0171) MultiSource/Benchmarks/FreeBench/mason/mason: -13.19% (0.0811 => 0.0704, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -11.21% (22.1758 => 19.6891, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.51% (2.9384 => 2.6295, std.dev.: 0.0053) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.34% (1.1492 => 0.7661, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -16.12% (1.6925 => 1.4197, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.73% (0.0998 => 0.0861, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.87% (1.2373 => 1.0904, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel-2: -10.48% (1.5373 => 1.3762, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/mason/mason: -10.09% (0.2161 => 0.1943, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.43% (19.9488 => 18.2675, std.dev.: 0.0310) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.70% (1.8329 => 1.7101, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.32% (1.6805 => 1.5911, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.64% (1.5835 => 1.5100, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1625, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.48% (0.9957 => 0.9610, std.dev.: 0.0047) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5076, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0991, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.10% (0.4808 => 0.4707, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.06% (8.6802 => 8.5015, std.dev.: 0.0155) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.05% (8.1563 => 7.9887, std.dev.: 0.0177) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0853, std.dev.: 0.0277) MultiSource/Applications/sqlite3/sqlite3: -1.87% (4.6441 => 4.5574, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6801, std.dev.: 0.0018) SingleSource/UnitTests/Vector/multiplies: -1.66% (2.5528 => 2.5105, std.dev.: 0.0019) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4215, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8573, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2347, std.dev.: 0.0070) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.09% (0.5229 => 0.5861, std.dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 8.04% (14.9895 => 16.1941, std.dev.: 0.0126) MultiSource/Benchmarks/MallocBench/gs/gs: 6.60% (4.1105 => 4.3819, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.84% (1.1048 => 1.2467, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.86% (7.1582 => 7.7210, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.48% (0.6222 => 0.7372, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36300.00% (0.0001 => 0.0364, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.13% (0.2116 => 0.2140, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 09:40:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 11:40:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121004164005.A6BC52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4566?compare_to=4559&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4566, Order: 165223, Start Time: 2012-10-04 13:31:32, End Time: 2012-10-04 16:41:48 To: 4559, Order: 165216, Start Time: 2012-10-04 09:52:08, End Time: 2012-10-04 13:02:21 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 1 (129 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (131 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1038 (762 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.37% (54.0707 => 54.8097, std.dev.: 0.0186) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.03% (9.8056 => 9.8085, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.02% (9.4128 => 9.4112, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.01% (16.9542 => 16.9554, std.dev.: 0.0032) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.14% (0.1063 => 0.1192, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 11.63% (1.5932 => 1.7785, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-4: 11.57% (0.3465 => 0.3866, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.53% (0.3496 => 0.3899, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.47% (0.3469 => 0.3867, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.46% (0.3446 => 0.3841, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.45% (0.3442 => 0.3836, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.45% (0.3460 => 0.3856, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.41% (0.3488 => 0.3886, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions: 11.09% (0.3643 => 0.4047, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.07% (0.3650 => 0.4054, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 10.96% (0.3724 => 0.4132, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.82% (0.5826 => 0.6340, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.69% (0.2738 => 0.2976, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 8.66% (0.5889 => 0.6399, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.56% (0.2875 => 0.3121, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 8.21% (0.1619 => 0.1752, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.17% (0.2729 => 0.2952, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.11% (0.3195 => 0.3454, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 8.09% (0.2780 => 0.3005, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 8.07% (0.2714 => 0.2933, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 8.06% (0.3004 => 0.3246, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 8.04% (0.2823 => 0.3050, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/fibo: 8.04% (0.2725 => 0.2944, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 8.03% (0.2813 => 0.3039, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 7.96% (0.2750 => 0.2969, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 7.96% (0.2803 => 0.3026, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.94% (0.3060 => 0.3303, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.92% (0.2792 => 0.3013, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.90% (0.2811 => 0.3033, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.88% (2.0673 => 2.2302, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.87% (0.2911 => 0.3140, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.81% (0.3267 => 0.3522, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.75% (0.3096 => 0.3336, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.73% (0.4994 => 0.5380, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.70% (1.3152 => 1.4165, std.dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 7.66% (0.9909 => 1.0668, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary: 7.52% (0.3258 => 0.3503, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.51% (1.6211 => 1.7428, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 7.50% (0.3348 => 0.3599, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.47% (0.1620 => 0.1741, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.43% (0.3282 => 0.3526, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 7.42% (0.3317 => 0.3563, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.38% (0.5000 => 0.5369, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 7.38% (0.7171 => 0.7700, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.36% (3.5627 => 3.8249, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 7.31% (0.3678 => 0.3947, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.31% (0.3625 => 0.3890, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.27% (0.4361 => 0.4678, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.27% (0.3124 => 0.3351, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.26% (0.3362 => 0.3606, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 7.23% (5.5417 => 5.9426, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/hash: 7.16% (0.4146 => 0.4443, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 7.06% (0.3726 => 0.3989, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 7.05% (0.3477 => 0.3722, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.94% (0.3690 => 0.3946, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.81% (0.5900 => 0.6302, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.80% (0.4251 => 0.4540, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.76% (0.3845 => 0.4105, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.74% (0.4139 => 0.4418, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 6.71% (23.5202 => 25.0974, std.dev.: 0.0140) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.70% (0.2014 => 0.2149, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 6.66% (1.0781 => 1.1499, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.65% (0.5026 => 0.5360, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.58% (0.2736 => 0.2916, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.54% (0.3930 => 0.4187, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.51% (0.3981 => 0.4240, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.36% (2.7292 => 2.9029, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.23% (0.3903 => 0.4146, std.dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 6.20% (4.2109 => 4.4721, std.dev.: 0.0062) MultiSource/Applications/hbd/hbd: 6.20% (0.9697 => 1.0298, std.dev.: 0.0081) MultiSource/Benchmarks/nbench/nbench: 6.16% (0.2566 => 0.2724, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.14% (0.2866 => 0.3042, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.12% (0.3890 => 0.4128, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 6.05% (0.5012 => 0.5315, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 6.01% (0.4029 => 0.4271, std.dev.: 0.0017) MultiSource/Applications/siod/siod: 5.95% (0.6634 => 0.7029, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.95% (0.6435 => 0.6818, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.90% (0.2068 => 0.2190, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 5.84% (0.5546 => 0.5870, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.76% (0.2969 => 0.3140, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.70% (4.4195 => 4.6712, std.dev.: 0.0114) MultiSource/Benchmarks/MallocBench/gs/gs: 5.69% (1.8794 => 1.9863, std.dev.: 0.0036) MultiSource/Applications/lua/lua: 5.61% (1.4269 => 1.5070, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.61% (0.3084 => 0.3257, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 5.56% (2.1013 => 2.2182, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.52% (0.2737 => 0.2888, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.49% (0.1968 => 0.2076, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.29% (0.3271 => 0.3444, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.28% (0.4658 => 0.4904, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 5.28% (4.6177 => 4.8614, std.dev.: 0.0165) MultiSource/Applications/minisat/minisat: 5.25% (0.3336 => 0.3511, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 5.13% (2.1653 => 2.2764, std.dev.: 0.0026) MultiSource/Applications/SIBsim4/SIBsim4: 5.09% (0.2691 => 0.2828, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.98% (1.9694 => 2.0674, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: 4.91% (0.7875 => 0.8262, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.90% (0.2103 => 0.2206, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.73% (1.9966 => 2.0911, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 4.39% (0.4847 => 0.5060, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 4.37% (2.0346 => 2.1235, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.03% (0.7426 => 0.7725, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.94% (0.5361 => 0.5572, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.77% (11.6398 => 12.0786, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.60% (0.5584 => 0.5785, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: 3.57% (0.3498 => 0.3623, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.32% (4.6926 => 4.8486, std.dev.: 0.0106) MultiSource/Applications/kimwitu++/kc: 2.29% (11.9555 => 12.2296, std.dev.: 0.0134) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.16% (0.2122 => 0.2274, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.45% (3.3903 => 3.6091, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6707, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-2: 5.04% (1.8057 => 1.8967, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1667, std.dev.: 0.0213) SingleSource/Benchmarks/Dhrystone/dry: 4.11% (14.0481 => 14.6250, std.dev.: 0.0122) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.40% (79.9355 => 82.6565, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary3: 2.15% (15.8721 => 16.2129, std.dev.: 0.0017) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5058, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.70% (3.1722 => 3.2262, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2861, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5136, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5912, std.dev.: 0.0105) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.83% (25.4195 => 16.5650, std.dev.: 0.0140) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9770, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7882, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/ary2: -7.62% (0.2402 => 0.2219, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: -7.22% (2.1113 => 1.9589, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -3.54% (11.2080 => 10.8116, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.93% (17.2379 => 16.7323, std.dev.: 0.0590) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8623, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5779, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4960, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.13% (105.3826 => 104.1964, std.dev.: 0.0469) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0437, std.dev.: 0.0042) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 10:14:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 12:14:34 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121004171434.2FD642A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4567?compare_to=4563&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4567, Order: 165231, Start Time: 2012-10-04 15:53:10, End Time: 2012-10-04 17:16:16 To: 4563, Order: 165226, Start Time: 2012-10-04 14:14:22, End Time: 2012-10-04 15:37:19 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (14 on baseline) Performance Regressions: 6 (83 on baseline) Performance Improvements: 3 (44 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 968 (764 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.50% (0.5704 => 0.6018, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.04% (0.6017 => 0.6140, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/gs/gs: 1.95% (3.9272 => 4.0037, std.dev.: 0.0258) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.07% (1.2351 => 1.2483, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.76% (0.3159 => 0.3499, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 2.75% (1.4160 => 1.4550, std.dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/SPASS/SPASS: -4.43% (8.5699 => 8.1903, std.dev.: 0.1448) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -2.72% (1.8581 => 1.8076, std.dev.: 0.0171) SingleSource/Benchmarks/Misc/ffbench: -1.73% (1.4304 => 1.4057, std.dev.: 0.0043) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.21% (1.0257 => 1.0235, std.dev.: 0.0096) MultiSource/Applications/sqlite3/sqlite3: 0.03% (0.6147 => 0.6149, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/08-main/main: -2.03% (0.1824 => 0.1787, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.01% (0.1585 => 0.1601, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.71% (0.3110 => 0.3132, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.38% (0.2390 => 0.2399, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.27% (0.3230 => 0.3189, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.69% (0.2312 => 0.2296, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel: 3.44% (0.0436 => 0.0451, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -18.18% (0.0242 => 0.0198, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0195 => 0.0195, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0393 => 0.0393, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0305 => 0.0305, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.35% (0.0287 => 0.0288, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.61% (0.0327 => 0.0329, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/casts: 0.55% (0.0182 => 0.0183, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 44.78% (0.0134 => 0.0194, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: 0.79% (0.0254 => 0.0256, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: 5.41% (0.0296 => 0.0312, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 20.00% (0.0005 => 0.0006, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1423 => 0.1422, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: -1.45% (1.4657 => 1.4444, std.dev.: 0.0509) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -4.35% (0.1539 => 0.1472, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.82% (0.4024 => 0.4057, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.51% (0.1368 => 0.1361, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.71% (0.0613 => 0.0578, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 20.56% (0.0180 => 0.0217, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.82% (0.0643 => 0.0612, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.24% (1.1293 => 1.1266, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -77.78% (0.0027 => 0.0006, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 500.00% (0.0001 => 0.0006, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.84% (0.0640 => 0.0609, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0175 => 0.0175, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.07% (0.7655 => 0.7650, std.dev.: 0.0081) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.03% (1.7068 => 1.7063, std.dev.: 0.0008) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 144.94% (0.0089 => 0.0218, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: 180.00% (0.0090 => 0.0252, std.dev.: 0.0002) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -27.02% (4.1772 => 3.0486, std.dev.: 0.0477) SingleSource/Benchmarks/Shootout-C++/except: 82250.00% (0.0006 => 0.4941, std.dev.: 0.0050) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: -66.67% (0.0006 => 0.0002, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.62% (0.0745 => 0.0921, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.11% (0.1414 => 0.1557, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.97% (0.6410 => 0.7049, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.40% (0.1159 => 0.1268, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 8.80% (0.5309 => 0.5776, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.74% (0.3582 => 0.3895, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 8.26% (2.1763 => 2.3561, std.dev.: 0.0068) MultiSource/Applications/minisat/minisat: 8.03% (0.6173 => 0.6669, std.dev.: 0.0074) MultiSource/Applications/SIBsim4/SIBsim4: 7.30% (1.1653 => 1.2504, std.dev.: 0.0072) MultiSource/Applications/lambda-0_1_3/lambda: 7.16% (0.6915 => 0.7410, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.96% (1.5150 => 1.6205, std.dev.: 0.0027) MultiSource/Applications/lemon/lemon: 6.88% (1.0046 => 1.0737, std.dev.: 0.0165) MultiSource/Applications/kimwitu++/kc: 6.56% (15.3105 => 16.3145, std.dev.: 0.2287) MultiSource/Benchmarks/McCat/18-imp/imp: 5.84% (0.3217 => 0.3405, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.76% (0.2552 => 0.2699, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.55% (1.1827 => 1.2483, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.49% (0.7639 => 0.8058, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.32% (0.6069 => 0.6392, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.20% (0.3901 => 0.4104, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.15% (0.2797 => 0.2941, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 5.02% (0.2771 => 0.2910, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 4.91% (3.0225 => 3.1709, std.dev.: 0.0363) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.91% (1.1672 => 1.2245, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.87% (0.3062 => 0.3211, std.dev.: 0.0029) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.77% (6.2546 => 6.5532, std.dev.: 0.0064) MultiSource/Applications/lua/lua: 4.71% (3.5980 => 3.7674, std.dev.: 0.0314) MultiSource/Applications/SPASS/SPASS: 4.70% (13.3238 => 13.9496, std.dev.: 0.1262) SingleSource/Benchmarks/Shootout-C++/lists: 4.52% (0.2347 => 0.2453, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 4.43% (1.1440 => 1.1947, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.37% (0.2654 => 0.2770, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 4.34% (0.3847 => 0.4014, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.24% (0.3418 => 0.3563, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 4.22% (2.0972 => 2.1856, std.dev.: 0.0221) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.21% (0.8569 => 0.8930, std.dev.: 0.0064) MultiSource/Benchmarks/Bullet/bullet: 4.15% (29.3170 => 30.5343, std.dev.: 0.2180) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.12% (1.2021 => 1.2516, std.dev.: 0.0060) MultiSource/Applications/hbd/hbd: 4.12% (1.3268 => 1.3814, std.dev.: 0.0128) MultiSource/Benchmarks/Olden/bh/bh: 3.79% (0.2820 => 0.2927, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 3.78% (8.2186 => 8.5291, std.dev.: 0.0468) MultiSource/Benchmarks/nbench/nbench: 3.74% (1.0821 => 1.1226, std.dev.: 0.0072) MultiSource/Applications/sgefa/sgefa: 3.72% (0.2877 => 0.2984, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.42% (0.5937 => 0.6140, std.dev.: 0.0034) MultiSource/Applications/JM/lencod/lencod: 3.37% (14.7256 => 15.2212, std.dev.: 0.1053) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.35% (12.6413 => 13.0646, std.dev.: 0.1231) MultiSource/Applications/JM/ldecod/ldecod: 3.30% (6.4908 => 6.7050, std.dev.: 0.0357) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.30% (4.3380 => 4.4811, std.dev.: 0.0237) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.30% (0.5520 => 0.5702, std.dev.: 0.0069) MultiSource/Benchmarks/sim/sim: 3.24% (0.3084 => 0.3184, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 3.20% (3.8796 => 4.0037, std.dev.: 0.0258) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.04% (4.2616 => 4.3911, std.dev.: 0.0200) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.92% (8.2559 => 8.4971, std.dev.: 0.0521) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.83% (1.0689 => 1.0992, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.83% (0.4562 => 0.4691, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.58% (4.2815 => 4.3919, std.dev.: 0.0186) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.38% (0.5963 => 0.6105, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.37% (4.0318 => 4.1273, std.dev.: 0.0135) MultiSource/Applications/hexxagon/hexxagon: 1.50% (0.9425 => 0.9566, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 47.53% (0.0263 => 0.0388, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/pi: 41.36% (1.6538 => 2.3378, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2284, std.dev.: 0.0123) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 15.81% (0.0917 => 0.1062, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/ary3: 14.60% (1.7426 => 1.9970, std.dev.: 0.0873) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.36% (4.0101 => 4.5458, std.dev.: 0.1108) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.02% (2.4042 => 2.7172, std.dev.: 0.0301) SingleSource/Benchmarks/McGill/queens: 11.06% (1.6261 => 1.8059, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/mason/mason: 10.03% (0.5004 => 0.5506, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.03% (0.2857 => 0.3115, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/lists: 8.53% (7.0025 => 7.5999, std.dev.: 0.0396) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.05% (1.0063 => 1.0772, std.dev.: 0.0242) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.00% (0.3301 => 0.3499, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.46% (40.4792 => 42.2847, std.dev.: 0.6108) SingleSource/Benchmarks/Misc/dt: 4.33% (0.9851 => 1.0278, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: 4.02% (15.2242 => 15.8356, std.dev.: 0.0267) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.90% (3.4080 => 3.5408, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 3.38% (6.9722 => 7.2077, std.dev.: 0.0133) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.02% (0.5587 => 0.5756, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.88% (6.6312 => 6.8222, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.77% (4.2129 => 4.3295, std.dev.: 0.0387) SingleSource/Benchmarks/Shootout-C++/hash: 2.74% (0.6308 => 0.6481, std.dev.: 0.0035) MultiSource/Applications/siod/siod: 2.66% (3.5520 => 3.6466, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.58% (4.6127 => 4.6858, std.dev.: 0.0282) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.58% (1.4324 => 1.4550, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/power/power: 1.42% (1.4184 => 1.4386, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -43.99% (0.2996 => 0.1678, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -43.49% (0.0591 => 0.0334, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.08% (1.4189 => 1.1482, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.61% (1.4113 => 1.1487, std.dev.: 0.0107) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.63% (0.3497 => 0.2076, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.28% (5.2665 => 4.0932, std.dev.: 0.0916) SingleSource/Benchmarks/Shootout-C++/ary3: -20.67% (1.7473 => 1.3861, std.dev.: 0.0511) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.39% (1.7361 => 1.4690, std.dev.: 0.0086) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -13.78% (15.8312 => 13.6493, std.dev.: 0.5611) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1598, std.dev.: 0.0195) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.53% (1.1647 => 1.0537, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.47% (1.4034 => 1.2845, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: -8.31% (9.5474 => 8.7542, std.dev.: 0.0136) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.12% (3.2007 => 2.9407, std.dev.: 0.0178) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.86% (3.6254 => 3.3768, std.dev.: 0.0065) MultiSource/Applications/lambda-0_1_3/lambda: -6.59% (7.6833 => 7.1767, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/fibo: -6.59% (4.6355 => 4.3300, std.dev.: 0.0338) SingleSource/Benchmarks/Misc/richards_benchmark: -6.26% (1.4441 => 1.3537, std.dev.: 0.0216) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.04% (2.9728 => 2.7933, std.dev.: 0.0199) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.47% (3.9413 => 3.7258, std.dev.: 0.0296) MultiSource/Applications/SIBsim4/SIBsim4: -5.36% (3.4230 => 3.2395, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout/fib2: -5.24% (4.4195 => 4.1877, std.dev.: 0.0249) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.82% (0.4564 => 0.4344, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -4.46% (2.5166 => 2.4044, std.dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: -4.18% (62.4126 => 59.8054, std.dev.: 0.0871) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.76% (45.4683 => 43.7586, std.dev.: 0.5379) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -3.54% (1.8739 => 1.8076, std.dev.: 0.0171) SingleSource/Benchmarks/McGill/misr: -3.40% (0.4296 => 0.4150, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/methcall: -2.97% (9.2503 => 8.9755, std.dev.: 0.0281) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.96% (1.2722 => 1.2346, std.dev.: 0.0096) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.84% (1.1683 => 1.1351, std.dev.: 0.0083) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.82% (2.4457 => 2.3767, std.dev.: 0.0227) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.73% (3.7496 => 3.6474, std.dev.: 0.0169) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.56% (0.4140 => 0.4034, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.48% (1.0686 => 1.0421, std.dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/dry: -2.21% (2.4013 => 2.3482, std.dev.: 0.0010) MultiSource/Applications/aha/aha: -1.95% (3.4286 => 3.3618, std.dev.: 0.0065) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.88% (2.3569 => 2.3126, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.80% (9.3855 => 9.2166, std.dev.: 0.0088) MultiSource/Benchmarks/sim/sim: -1.72% (3.8907 => 3.8237, std.dev.: 0.0138) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0755, std.dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: -1.39% (2.4971 => 2.4623, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3120, std.dev.: 0.0581) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.28% (27.1724 => 26.8254, std.dev.: 0.0175) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.56% (0.9980 => 1.0235, std.dev.: 0.0096) MultiSource/Applications/sqlite3/sqlite3: 2.11% (0.6022 => 0.6149, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/08-main/main: 7.26% (0.1666 => 0.1787, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.02% (0.1554 => 0.1601, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.59% (0.3083 => 0.3132, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.21% (0.2394 => 0.2399, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.44% (0.3175 => 0.3189, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.26% (0.2302 => 0.2296, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel: 0.45% (0.0449 => 0.0451, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -17.50% (0.0240 => 0.0198, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.56% (0.0192 => 0.0195, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.77% (0.0390 => 0.0393, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.33% (0.0301 => 0.0305, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.41% (0.0284 => 0.0288, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.54% (0.0324 => 0.0329, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/casts: 3.39% (0.0177 => 0.0183, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 2.65% (0.0189 => 0.0194, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: 2.81% (0.0249 => 0.0256, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -4.00% (0.0325 => 0.0312, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -40.00% (0.0010 => 0.0006, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.49% (0.1429 => 0.1422, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: -3.83% (1.5019 => 1.4444, std.dev.: 0.0509) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.93% (0.1501 => 0.1472, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.85% (0.4264 => 0.4057, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.26% (0.1344 => 0.1361, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.87% (0.0589 => 0.0578, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -6.47% (0.0232 => 0.0217, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.23% (0.0639 => 0.0612, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.74% (1.1350 => 1.1266, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0006 => 0.0006, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -75.00% (0.0024 => 0.0006, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.40% (0.0637 => 0.0609, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.86% (0.0246 => 0.0175, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.45% (0.7541 => 0.7650, std.dev.: 0.0081) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.07% (1.5363 => 1.7063, std.dev.: 0.0008) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 10:46:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 12:46:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121004174655.640512A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4568?compare_to=4564&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4568, Order: 165231, Start Time: 2012-10-04 16:23:19, End Time: 2012-10-04 17:48:37 To: 4564, Order: 165226, Start Time: 2012-10-04 14:28:49, End Time: 2012-10-04 15:54:22 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (5 on baseline) Performance Regressions: 1 (181 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 5 (0 on baseline) Unchanged Tests: 1036 (682 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.57% (0.9528 => 0.9678, std.dev.: 0.0049) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.14% (33.5998 => 33.6471, std.dev.: 0.0172) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.01% (2.7526 => 2.7523, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.00% (2.1154 => 2.1153, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.01% (4.9747 => 4.9750, std.dev.: 0.0010) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 1.06% (33.2944 => 33.6471, std.dev.: 0.0172) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: -100.00% (7.3305 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.72% (2.0176 => 2.4559, std.dev.: 0.0043) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.45% (0.1410 => 0.1656, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 15.62% (0.0826 => 0.0955, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.26% (0.0819 => 0.0944, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 14.18% (0.2243 => 0.2561, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.83% (0.0834 => 0.0941) MultiSource/Applications/hbd/hbd: 12.74% (1.3693 => 1.5437, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.46% (0.2721 => 0.3060, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.43% (0.1327 => 0.1492, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 12.24% (0.1013 => 0.1137, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 12.20% (0.4328 => 0.4856, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 12.16% (0.4062 => 0.4556, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.82% (0.1413 => 0.1580, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.78% (0.3022 => 0.3378, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 11.58% (0.2781 => 0.3103, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 11.38% (0.7038 => 0.7839, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.34% (0.3580 => 0.3986, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.31% (0.3899 => 0.4340, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.29% (0.2782 => 0.3096, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.28% (3.9660 => 4.4133, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.27% (0.1588 => 0.1767, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.05% (0.3485 => 0.3870, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.01% (0.1072 => 0.1190, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 10.98% (0.5818 => 0.6457, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.95% (1.2193 => 1.3528, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 10.93% (0.2607 => 0.2892, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.90% (0.2596 => 0.2879, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.89% (0.0964 => 0.1069, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.88% (1.9828 => 2.1986, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.86% (0.9199 => 1.0198, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.85% (0.2655 => 0.2943, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.84% (1.4563 => 1.6142, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.82% (0.2966 => 0.3287, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 10.81% (0.2628 => 0.2912, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/except: 10.76% (0.2760 => 0.3057, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 10.75% (0.2726 => 0.3019, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 10.74% (0.2690 => 0.2979, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 10.72% (0.3293 => 0.3646, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.72% (0.3489 => 0.3863, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wc: 10.69% (0.2937 => 0.3251, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 10.68% (0.2761 => 0.3056, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.63% (0.2765 => 0.3059, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.63% (0.4016 => 0.4443, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.62% (0.3756 => 0.4155, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 10.62% (0.3107 => 0.3437, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.62% (0.5265 => 0.5824, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 10.61% (0.5748 => 0.6358, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 10.61% (0.3149 => 0.3483, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.57% (0.6283 => 0.6947, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.52% (0.7710 => 0.8521, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 10.47% (0.3868 => 0.4273) MultiSource/Applications/aha/aha: 10.45% (0.1062 => 0.1173, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.43% (0.4390 => 0.4848, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.43% (0.6959 => 0.7685, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 10.40% (0.3453 => 0.3812, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.39% (0.2696 => 0.2976, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 10.31% (0.3192 => 0.3521, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.30% (1.1364 => 1.2534, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 10.24% (0.7061 => 0.7784, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 10.17% (0.2988 => 0.3292, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 10.17% (13.8202 => 15.2254, std.dev.: 0.0201) SingleSource/Benchmarks/Shootout-C++/lists1: 9.96% (0.3534 => 0.3886, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.87% (0.1276 => 0.1402, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.81% (0.2914 => 0.3200, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 9.78% (0.2995 => 0.3288, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.77% (0.1157 => 0.1270, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.65% (0.3130 => 0.3432, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.49% (0.1075 => 0.1177, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 9.44% (0.1589 => 0.1739, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.43% (0.4791 => 0.5243, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.39% (0.4379 => 0.4790, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 9.37% (0.2945 => 0.3221, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 9.37% (1.0313 => 1.1279, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.32% (0.5577 => 0.6097, std.dev.: 0.0062) MultiSource/Applications/minisat/minisat: 9.25% (0.6744 => 0.7368, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/football/football: 9.17% (0.8310 => 0.9072, std.dev.: 0.0025) MultiSource/Applications/Burg/burg: 9.14% (1.1061 => 1.2072, std.dev.: 0.0058) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.13% (0.1435 => 0.1566, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.07% (0.8698 => 0.9487, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 9.04% (16.6129 => 18.1146, std.dev.: 0.0164) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.01% (0.1986 => 0.2165, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.97% (0.7460 => 0.8129, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.96% (0.3246 => 0.3537, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.96% (0.5637 => 0.6142, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.89% (0.2127 => 0.2316, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.81% (0.3755 => 0.4086, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 8.79% (3.8646 => 4.2044, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/18-imp/imp: 8.60% (0.3220 => 0.3497, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.60% (7.2180 => 7.8387, std.dev.: 0.0060) MultiSource/Applications/d/make_dparser: 8.56% (3.1889 => 3.4620, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 8.49% (0.7506 => 0.8143, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.49% (0.6576 => 0.7134, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 8.45% (1.0594 => 1.1489, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 8.32% (0.1478 => 0.1601, std.dev.: 0.0016) MultiSource/Applications/treecc/treecc: 8.27% (1.9270 => 2.0864, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.20% (0.1865 => 0.2018, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 8.20% (4.6629 => 5.0451, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.16% (0.2023 => 0.2188, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.08% (0.1819 => 0.1966, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.06% (0.3511 => 0.3794, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.03% (0.1569 => 0.1695, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.01% (3.6692 => 3.9632, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/09-vor/vor: 8.00% (0.2925 => 0.3159, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.98% (1.3245 => 1.4302, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 7.98% (2.1791 => 2.3529, std.dev.: 0.0078) MultiSource/Benchmarks/sim/sim: 7.92% (0.3131 => 0.3379, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 7.90% (1.2749 => 1.3756, std.dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 7.81% (14.8535 => 16.0139, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 7.72% (0.1657 => 0.1785, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.60% (0.8818 => 0.9488, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.53% (4.3801 => 4.7099, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.52% (0.2140 => 0.2301, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 7.50% (8.4961 => 9.1330, std.dev.: 0.0060) MultiSource/Applications/hexxagon/hexxagon: 7.49% (1.2292 => 1.3213, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.48% (4.4433 => 4.7757, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.43% (0.1789 => 0.1922, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.38% (0.6135 => 0.6588, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/bigfib: 7.33% (0.6250 => 0.6708, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 7.25% (0.4113 => 0.4411, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.90% (4.9865 => 5.3304, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.80% (3.2742 => 3.4967, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.76% (0.9108 => 0.9724, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 6.72% (0.4003 => 0.4272, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.71% (0.2504 => 0.2672, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.70% (1.1333 => 1.2092, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 6.62% (0.3578 => 0.3815, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.62% (0.3914 => 0.4173, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.60% (1.5188 => 1.6191, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/for-in: 6.55% (0.3789 => 0.4037, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.53% (0.4805 => 0.5119, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.50% (0.3646 => 0.3883, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.50% (0.3940 => 0.4196, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 6.47% (0.3601 => 0.3834, std.dev.: 0.0074) MultiSource/Applications/JM/ldecod/ldecod: 6.47% (6.5754 => 7.0006, std.dev.: 0.0135) SingleSource/UnitTests/ObjC/synchronized: 6.44% (0.3663 => 0.3899, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.36% (0.3650 => 0.3882, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 6.27% (0.3623 => 0.3850, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/oourafft: 6.18% (0.2008 => 0.2132, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.10% (0.3245 => 0.3443, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.95% (0.2321 => 0.2459, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 5.80% (3.7467 => 3.9641, std.dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.66% (6.2785 => 6.6341, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.59% (2.1007 => 2.2182, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.27% (13.2842 => 13.9843, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.64% (0.2243 => 0.2347, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 3.73% (16.2614 => 16.8673, std.dev.: 0.0093) MultiSource/Applications/ClamAV/clamscan: 3.36% (14.5298 => 15.0183, std.dev.: 0.0089) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.49% (5.7573 => 7.5126, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 24.36% (1.8175 => 2.2602, std.dev.: 0.0166) SingleSource/Benchmarks/Misc/richards_benchmark: 11.15% (1.1560 => 1.2849, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.56% (3.1736 => 3.4135, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.08% (1.2998 => 1.3788, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0043, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7748, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6770, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.56% (10.7476 => 11.1307, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/flops-6: 3.47% (1.9199 => 1.9866, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 3.03% (0.5449 => 0.5614) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.19% (7.4271 => 7.5899, std.dev.: 0.0024) MultiSource/Applications/lemon/lemon: 1.75% (1.4298 => 1.4548, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5143, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1882, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5785, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0275, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5900, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.12% (0.2670 => 0.1412, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.41% (0.4657 => 0.3893, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -15.56% (0.0707 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.77% (1.3813 => 1.1911, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.76% (1.3819 => 1.1917, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.84% (22.5627 => 21.6963, std.dev.: 0.0090) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.93% (0.2238 => 0.1971, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.92% (1.2308 => 1.0964, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.05% (20.3410 => 18.2964, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0048) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5150, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.55% (3.2729 => 3.1567, std.dev.: 0.0167) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.48% (1.7688 => 1.7072, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.18% (0.9996 => 0.9678, std.dev.: 0.0049) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.92% (0.4867 => 0.4725, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -2.60% (26.5159 => 25.8276, std.dev.: 0.0304) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -2.50% (3.0263 => 2.9507, std.dev.: 0.0019) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.30% (1.9762 => 1.9307, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/lists: -1.87% (6.3560 => 6.2369, std.dev.: 0.0102) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.87% (0.6589 => 0.6466, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.66% (28.2225 => 27.7530, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0060, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -1.45% (4.5928 => 4.5260, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8637, std.dev.: 0.0023) MultiSource/Applications/minisat/minisat: -1.20% (9.3358 => 9.2234, std.dev.: 0.0373) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4950, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2588, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 11:18:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 13:18:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121004181847.54B6B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4569?compare_to=4565&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4569, Order: 165233, Start Time: 2012-10-04 17:00:56, End Time: 2012-10-04 18:20:29 To: 4565, Order: 165228, Start Time: 2012-10-04 15:11:19, End Time: 2012-10-04 16:30:50 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (157 on baseline) Performance Improvements: 1 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 952 (687 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.64% (15.4661 => 15.2121, std.dev.: 0.0132) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.09% (0.5861 => 0.5866, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 0.07% (16.1941 => 16.2048, std.dev.: 0.0136) MultiSource/Benchmarks/Bullet/bullet: 0.00% (53.9612 => 53.9617, std.dev.: 0.0106) MultiSource/Benchmarks/MallocBench/gs/gs: -0.06% (4.3819 => 4.3791, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0465 => 0.0465, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0467 => 0.0467) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0434 => 0.0434, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0436 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.47% (0.0423 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0425 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.24% (0.0416 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0418 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0435 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.23% (0.0437 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0429 => 0.0429, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.23% (0.0430 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0419 => 0.0419, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.24% (0.0420 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0426 => 0.0426) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.23% (0.0427 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0438 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.46% (0.0439 => 0.0441, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.24% (0.0414 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0415 => 0.0415, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.23% (0.0427 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0427 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.24% (0.0418 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0409 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.24% (0.0411 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0409 => 0.0409, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0410 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.22% (0.0447 => 0.0446, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0447 => 0.0447, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0407 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.24% (0.0409 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0409 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.24% (0.0410 => 0.0411, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.24% (0.0417 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.48% (0.0417 => 0.0419, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.06% (1.2467 => 1.2459, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.16% (7.7210 => 7.7086, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.19% (0.7372 => 0.7386, std.dev.: 0.0044) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.82% (0.0364 => 0.0361, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: - (0.1431 => 0.1431) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.59% (0.2140 => 0.2174, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -14.68% (63.2438 => 53.9617, std.dev.: 0.0106) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.03% (14.1553 => 18.6890, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++-EH/spirit: 60.33% (3.4629 => 5.5520, std.dev.: 0.0028) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14245.83% (0.0720 => 10.3290, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952200.00% (0.0001 => 9.9523, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 47.96% (0.2554 => 0.3779, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 46.73% (10.3673 => 15.2121, std.dev.: 0.0132) MultiSource/Benchmarks/FreeBench/distray/distray: 31.16% (0.1056 => 0.1385, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 28.36% (0.1622 => 0.2082, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.44% (2.2022 => 2.5642, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.75% (7.0540 => 8.1653, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 15.29% (0.1432 => 0.1651, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.37% (0.1566 => 0.1791, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.19% (0.0834 => 0.0944, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.86% (1.7609 => 1.9873, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/oourafft: 12.40% (0.3282 => 0.3689, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.17% (0.0871 => 0.0977) MultiSource/Applications/JM/ldecod/ldecod: 11.50% (10.4361 => 11.6360, std.dev.: 0.0088) SingleSource/UnitTests/ObjC/trivial-interface: 10.91% (0.3473 => 0.3852, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.86% (0.1584 => 0.1756, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-4: 10.75% (0.3543 => 0.3924, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.75% (0.3497 => 0.3873, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.61% (0.3543 => 0.3919, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.59% (0.3561 => 0.3938, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-3: 10.52% (0.3516 => 0.3886, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.21% (0.3927 => 0.4328, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.21% (0.3694 => 0.4071, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.16% (0.3828 => 0.4217, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 10.07% (0.1440 => 0.1585, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.96% (0.3886 => 0.4273, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.81% (0.1438 => 0.1579, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.76% (0.4879 => 0.5355, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.19% (0.3177 => 0.3469, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 9.11% (9.4845 => 10.3482, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.99% (0.6675 => 0.7275, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 8.85% (0.7433 => 0.8091, std.dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 8.83% (5.7591 => 6.2675, std.dev.: 0.0049) SingleSource/Benchmarks/McGill/chomp: 8.82% (0.1655 => 0.1801, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 8.78% (0.3109 => 0.3382, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 8.77% (0.7115 => 0.7739, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.67% (1.5415 => 1.6751, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.62% (0.4615 => 0.5013, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 8.51% (0.1175 => 0.1275, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 8.50% (0.1695 => 0.1839, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.38% (0.1337 => 0.1449, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.31% (0.1625 => 0.1760, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 8.27% (0.3423 => 0.3706, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.22% (0.8172 => 0.8844, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/lists: 8.12% (0.3422 => 0.3700, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.10% (0.2271 => 0.2455, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.09% (0.2065 => 0.2232, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.07% (0.2700 => 0.2918, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 8.06% (3.3354 => 3.6042, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.05% (0.5105 => 0.5516, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.05% (4.2646 => 4.6079, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.02% (1.3050 => 1.4096, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.82% (0.3121 => 0.3365, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.82% (0.5860 => 0.6318, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.81% (0.1510 => 0.1628, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.76% (0.5569 => 0.6001, std.dev.: 0.0028) MultiSource/Applications/hbd/hbd: 7.73% (1.5603 => 1.6809, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.72% (0.2758 => 0.2971, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.69% (0.2107 => 0.2269, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.69% (0.8067 => 0.8687, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.65% (8.1363 => 8.7590, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.65% (0.9765 => 1.0512, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.65% (5.0018 => 5.3842, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.64% (0.2891 => 0.3112, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.64% (0.2905 => 0.3127, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.63% (0.5925 => 0.6377, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.63% (0.4103 => 0.4416, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.54% (4.9449 => 5.3179, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.53% (0.4636 => 0.4985, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 7.48% (0.6456 => 0.6939, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.48% (0.6030 => 0.6481, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.45% (0.3865 => 0.4153, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.42% (0.1940 => 0.2084, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 7.42% (0.2831 => 0.3041, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 7.41% (0.4289 => 0.4607, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.40% (0.4203 => 0.4514, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.37% (0.3650 => 0.3919, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.34% (1.1642 => 1.2497, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/matrix: 7.33% (0.3098 => 0.3325, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.31% (0.5020 => 0.5387, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary: 7.30% (0.3232 => 0.3468, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 7.29% (0.3387 => 0.3634, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.24% (0.2871 => 0.3079, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 7.24% (0.3052 => 0.3273, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 7.24% (0.4048 => 0.4341, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 7.24% (0.7835 => 0.8402, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.21% (0.2872 => 0.3079, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 7.19% (0.3283 => 0.3519, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 7.19% (0.3603 => 0.3862, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.17% (0.3136 => 0.3361, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.17% (0.3307 => 0.3544, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.15% (0.3162 => 0.3388, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.13% (7.9617 => 8.5290, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.11% (0.2756 => 0.2952, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.06% (0.4620 => 0.4946, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.06% (2.0665 => 2.2123, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/fibo: 7.05% (0.2725 => 0.2917, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 7.01% (0.1555 => 0.1664, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.98% (0.3826 => 0.4093, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 6.96% (3.8723 => 4.1420, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/hello: 6.96% (0.2714 => 0.2903, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 6.96% (0.2802 => 0.2997, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.91% (0.2793 => 0.2986, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 6.89% (0.7326 => 0.7831, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 6.88% (0.2877 => 0.3075, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/lists1: 6.84% (0.3684 => 0.3936, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 6.72% (1.0722 => 1.1443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 6.66% (0.3379 => 0.3604, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.60% (0.3441 => 0.3668, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 6.51% (2.0273 => 2.1593, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 6.40% (0.4299 => 0.4574, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.38% (0.2603 => 0.2769, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.31% (1.1861 => 1.2610, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/09-vor/vor: 6.29% (0.3180 => 0.3380, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.24% (0.1892 => 0.2010, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.20% (1.5859 => 1.6842, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.19% (0.5981 => 0.6351, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 6.10% (0.8921 => 0.9465, std.dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.06% (0.6450 => 0.6841, std.dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 6.03% (21.9371 => 23.2598, std.dev.: 0.0122) MultiSource/Applications/siod/siod: 5.81% (2.2969 => 2.4304, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.56% (0.1906 => 0.2012, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.54% (0.4064 => 0.4289, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 5.33% (1.1840 => 1.2471, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 5.30% (0.3131 => 0.3297, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.25% (2.2024 => 2.3180, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.24% (1.4186 => 1.4929, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.16% (0.2266 => 0.2383, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 5.12% (1.2842 => 1.3500, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.54% (0.8101 => 0.8469, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.45% (14.3668 => 14.8619, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.33% (0.3427 => 0.3541, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.02% (1.1194 => 1.1532, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.87% (17.1811 => 17.6744, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.86% (0.3817 => 0.3926, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.79% (3.8922 => 4.0009, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 10.17% (3.1595 => 3.4807, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 9.80% (1.1396 => 1.2513, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3680, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0015) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.60% (3.6395 => 3.7704, std.dev.: 0.0064) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.67% (4.2280 => 4.3410, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.29% (1.7254 => 1.7649, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8138, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.16% (2.6546 => 2.6854, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/queens: 1.11% (2.1825 => 2.2068, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5750, std.dev.: 0.0061) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.03% (6.6874 => 0.1318, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.05% (0.8651 => 0.1726, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.06% (5.2763 => 3.2683, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.01% (5.3855 => 3.6616, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.56% (5.3526 => 3.6632, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -14.55% (54.1659 => 46.2858, std.dev.: 0.0101) MultiSource/Benchmarks/FreeBench/mason/mason: -12.95% (0.0811 => 0.0706) MultiSource/Applications/ClamAV/clamscan: -11.17% (22.1758 => 19.6997, std.dev.: 0.0185) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.60% (2.9384 => 2.6269, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.42% (1.1492 => 0.7651, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -15.96% (1.6925 => 1.4224, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.43% (0.0998 => 0.0864, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.31% (1.2373 => 1.0973, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -10.38% (1.5373 => 1.3777, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/mason/mason: -10.09% (0.2161 => 0.1943, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.36% (19.9488 => 18.2813, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.71% (1.8329 => 1.7100, std.dev.: 0.0194) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.28% (1.6805 => 1.5918, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5073, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.21% (0.9957 => 0.9538, std.dev.: 0.0094) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -3.62% (3.2827 => 3.1638, std.dev.: 0.0088) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5016, std.dev.: 0.0078) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0983, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.09% (8.6802 => 8.4991, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.97% (8.1563 => 7.9960, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6808, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -1.65% (10.2830 => 10.1135, std.dev.: 0.0109) SingleSource/UnitTests/Vector/multiplies: -1.53% (2.5528 => 2.5138, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4213, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -1.39% (4.6441 => 4.5797, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -1.31% (6.2999 => 6.2172, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0554 => 1.0445, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8593, std.dev.: 0.0075) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.18% (0.5229 => 0.5866, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 8.11% (14.9895 => 16.2048, std.dev.: 0.0136) MultiSource/Benchmarks/MallocBench/gs/gs: 6.53% (4.1105 => 4.3791, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.77% (1.1048 => 1.2459, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.69% (7.1582 => 7.7086, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.71% (0.6222 => 0.7386, std.dev.: 0.0044) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36000.00% (0.0001 => 0.0361, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.74% (0.2116 => 0.2174, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 11:54:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 13:54:51 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121004185451.EE3742A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4570?compare_to=4567&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4570, Order: 165234, Start Time: 2012-10-04 17:32:30, End Time: 2012-10-04 18:56:35 To: 4567, Order: 165231, Start Time: 2012-10-04 15:53:10, End Time: 2012-10-04 17:16:16 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (14 on baseline) Performance Regressions: 11 (92 on baseline) Performance Improvements: 2 (46 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 964 (753 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/SPASS/SPASS: 5.43% (8.1903 => 8.6353, std.dev.: 0.1312) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.43% (13.6493 => 14.2536, std.dev.: 0.1764) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 2.91% (0.7633 => 0.7855, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/ffbench: 2.63% (1.4057 => 1.4426, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 2.26% (4.4674 => 4.5683, std.dev.: 0.0297) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 2.18% (1.8076 => 1.8470, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout/ary3: 1.85% (1.9970 => 2.0340, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout/matrix: 1.49% (1.5607 => 1.5840, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 1.40% (4.5458 => 4.6096, std.dev.: 0.0185) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.05% (1.0421 => 1.0530, std.dev.: 0.0025) MultiSource/Applications/siod/siod: 1.04% (3.6466 => 3.6846, std.dev.: 0.0104) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.87% (0.6018 => 0.5785, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.49% (2.0226 => 1.9924, std.dev.: 0.0107) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.08% (1.0235 => 1.0227, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: 1.89% (0.6149 => 0.6265, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/08-main/main: 1.57% (0.1787 => 0.1815, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.12% (0.1601 => 0.1551, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.57% (0.3132 => 0.3114, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.13% (0.2399 => 0.2348, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.98% (0.3189 => 0.3126, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.35% (0.2296 => 0.2327, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/mandel: 2.22% (0.0451 => 0.0461, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -18.69% (0.0198 => 0.0161, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -11.28% (0.0195 => 0.0173, std.dev.: 0.0065) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0393 => 0.0393, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -11.48% (0.0305 => 0.0270, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0288 => 0.0288, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -20.06% (0.0329 => 0.0263, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/casts: -48.09% (0.0183 => 0.0095, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/test1: 0.52% (0.0194 => 0.0195, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -0.78% (0.0256 => 0.0254, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -10.26% (0.0312 => 0.0280, std.dev.: 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -16.67% (0.0006 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.14% (0.1422 => 0.1420, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 2.57% (1.4444 => 1.4815, std.dev.: 0.0315) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: 4.76% (0.1472 => 0.1542, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.07% (0.4057 => 0.4060, std.dev.: 0.0467) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.29% (0.1361 => 0.1433, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.60% (0.0578 => 0.0563, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -19.82% (0.0217 => 0.0174, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.41% (0.0612 => 0.0585, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.17% (1.1266 => 1.1285, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 350.00% (0.0006 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -16.67% (0.0006 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.48% (0.0609 => 0.0600, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.86% (0.0175 => 0.0170, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.07% (0.7650 => 0.7655, std.dev.: 0.0253) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 0.04% (1.7063 => 1.7070, std.dev.: 0.0070) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 55.06% (0.0089 => 0.0138, std.dev.: 0.0038) SingleSource/UnitTests/2003-08-11-VaListArg: 173.33% (0.0090 => 0.0246, std.dev.: 0.0037) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -26.52% (4.1772 => 3.0695, std.dev.: 0.0383) SingleSource/Benchmarks/Shootout-C++/except: 82183.33% (0.0006 => 0.4937, std.dev.: 0.0026) SingleSource/Regression/C++/EH/ctor_dtor_count: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.62% (0.0745 => 0.0921, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.89% (0.6410 => 0.7044, std.dev.: 0.0053) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.76% (0.1414 => 0.1552, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 9.07% (2.1763 => 2.3737, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.89% (0.1159 => 0.1262, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.60% (0.3582 => 0.3890, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 8.59% (0.5309 => 0.5765, std.dev.: 0.0064) MultiSource/Applications/minisat/minisat: 7.79% (0.6173 => 0.6654, std.dev.: 0.0054) MultiSource/Applications/lemon/lemon: 7.14% (1.0046 => 1.0763, std.dev.: 0.0086) MultiSource/Applications/SIBsim4/SIBsim4: 7.07% (1.1653 => 1.2477, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.58% (0.7639 => 0.8142, std.dev.: 0.0050) MultiSource/Applications/kimwitu++/kc: 6.52% (15.3105 => 16.3089, std.dev.: 0.1893) MultiSource/Applications/lambda-0_1_3/lambda: 5.94% (0.6915 => 0.7326, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.84% (0.2552 => 0.2701, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.83% (1.5150 => 1.6034, std.dev.: 0.0127) MultiSource/Benchmarks/McCat/18-imp/imp: 5.72% (0.3217 => 0.3401, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.51% (0.2797 => 0.2951, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.44% (0.6069 => 0.6399, std.dev.: 0.0025) MultiSource/Applications/d/make_dparser: 5.42% (3.0225 => 3.1864, std.dev.: 0.0148) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.30% (0.4248 => 0.4473, std.dev.: 0.0028) MultiSource/Applications/siod/siod: 4.93% (2.0972 => 2.2005, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.92% (0.3901 => 0.4093, std.dev.: 0.0035) MultiSource/Applications/hbd/hbd: 4.91% (1.3268 => 1.3920, std.dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 4.78% (4.7455 => 4.9724, std.dev.: 0.0404) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.77% (0.8569 => 0.8978, std.dev.: 0.0122) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.75% (0.4880 => 0.5112, std.dev.: 0.0056) MultiSource/Applications/SPASS/SPASS: 4.64% (13.3238 => 13.9422, std.dev.: 0.0565) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.62% (6.2546 => 6.5438, std.dev.: 0.0595) MultiSource/Applications/lua/lua: 4.42% (3.5980 => 3.7569, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.2886 => 0.3012, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.31% (1.1827 => 1.2337, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.06% (1.1672 => 1.2146, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.98% (1.4408 => 1.4981, std.dev.: 0.0145) MultiSource/Benchmarks/Bullet/bullet: 3.93% (29.3170 => 30.4702, std.dev.: 0.3649) MultiSource/Benchmarks/mafft/pairlocalalign: 3.93% (8.2186 => 8.5418, std.dev.: 0.0672) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.92% (0.2654 => 0.2758, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 3.82% (14.7256 => 15.2881, std.dev.: 0.0705) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.76% (1.2021 => 1.2473, std.dev.: 0.0117) MultiSource/Benchmarks/nbench/nbench: 3.69% (1.0821 => 1.1220, std.dev.: 0.0062) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.65% (0.7722 => 0.8004, std.dev.: 0.0100) MultiSource/Benchmarks/sim/sim: 3.60% (0.3084 => 0.3195, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.60% (0.3418 => 0.3541, std.dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.52% (0.3008 => 0.3114, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.50% (3.0758 => 3.1836, std.dev.: 0.0237) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.47% (4.2616 => 4.4094, std.dev.: 0.0179) MultiSource/Applications/Burg/burg: 3.31% (1.1440 => 1.1819, std.dev.: 0.0117) MultiSource/Applications/JM/ldecod/ldecod: 3.19% (6.4908 => 6.6978, std.dev.: 0.0420) MultiSource/Benchmarks/Prolangs-C/football/football: 3.14% (0.8405 => 0.8669, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/hash2: 3.09% (0.3847 => 0.3966, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.98% (0.4562 => 0.4698, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.91% (1.2742 => 1.3113, std.dev.: 0.0046) MultiSource/Applications/treecc/treecc: 2.75% (1.8798 => 1.9315, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.73% (12.6413 => 12.9859, std.dev.: 0.0995) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.63% (1.0689 => 1.0970, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.55% (0.5963 => 0.6115, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.50% (4.0318 => 4.1327, std.dev.: 0.0201) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.19% (8.2559 => 8.4370, std.dev.: 0.0536) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.10% (0.5520 => 0.5636, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.94% (4.3380 => 4.4220, std.dev.: 0.0326) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.92% (0.9029 => 0.9202, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.83% (4.2815 => 4.3600, std.dev.: 0.0264) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.77% (1.3935 => 1.4181, std.dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: 1.41% (0.9425 => 0.9558, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.46% (1.6538 => 2.3395, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/city/city: 39.08% (0.0261 => 0.0363, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/matrix: 22.54% (3.4629 => 4.2436, std.dev.: 0.0358) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.23% (0.0766 => 0.0898, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/ary3: 16.72% (1.7426 => 2.0340, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.95% (4.0101 => 4.6096, std.dev.: 0.0185) SingleSource/Benchmarks/Stanford/Puzzle: 14.52% (0.1433 => 0.1641, std.dev.: 0.0048) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.87% (2.4042 => 2.7136, std.dev.: 0.0322) SingleSource/Benchmarks/McGill/queens: 11.06% (1.6261 => 1.8060, std.dev.: 0.0118) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.03% (0.2857 => 0.3115, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: 8.69% (7.0025 => 7.6113, std.dev.: 0.0231) MultiSource/Benchmarks/FreeBench/mason/mason: 8.31% (0.5004 => 0.5420, std.dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 5.99% (1.0063 => 1.0666, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.66% (0.3301 => 0.3488, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.96% (40.4792 => 42.4888, std.dev.: 0.2039) SingleSource/Benchmarks/Misc/dt: 4.52% (0.9851 => 1.0296, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: 4.12% (15.2242 => 15.8521, std.dev.: 0.0196) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.87% (3.4080 => 3.5398, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 3.73% (3.5520 => 3.6846, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.23% (0.7609 => 0.7855, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/hash: 3.19% (0.6308 => 0.6509, std.dev.: 0.0049) MultiSource/Benchmarks/Bullet/bullet: 3.16% (6.9722 => 7.1923, std.dev.: 0.0722) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.15% (0.5587 => 0.5763, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.82% (6.6312 => 6.8185, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.71% (2.6656 => 2.7379, std.dev.: 0.0202) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.52% (0.5876 => 0.6024, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/ffbench: 2.19% (1.4117 => 1.4426, std.dev.: 0.0112) MultiSource/Benchmarks/Olden/power/power: 1.51% (1.4184 => 1.4398, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: 1.51% (1.5605 => 1.5840, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.16% (0.0591 => 0.0330, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -43.66% (0.2996 => 0.1688, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.46% (1.4189 => 1.1428, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.90% (1.4113 => 1.1445, std.dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.81% (0.3497 => 0.2105, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: -20.18% (1.7473 => 1.3947, std.dev.: 0.0611) SingleSource/Benchmarks/CoyoteBench/lpbench: -19.52% (5.2665 => 4.2385, std.dev.: 0.0778) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.22% (1.7361 => 1.4719, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/sieve: -12.14% (8.1594 => 7.1688, std.dev.: 0.0115) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.97% (15.8312 => 14.2536, std.dev.: 0.1764) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.67% (1.1647 => 1.0521, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/moments: -9.25% (0.1114 => 0.1011, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2863, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/flops: -8.34% (9.5474 => 8.7511, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.84% (3.6254 => 3.3776, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -6.73% (3.2007 => 2.9853, std.dev.: 0.0276) MultiSource/Applications/lambda-0_1_3/lambda: -6.61% (7.6833 => 7.1751, std.dev.: 0.0157) SingleSource/Benchmarks/Misc/richards_benchmark: -6.28% (1.4441 => 1.3534, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/fibo: -6.12% (4.6355 => 4.3518, std.dev.: 0.0108) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.00% (2.9728 => 2.7944, std.dev.: 0.0200) MultiSource/Benchmarks/FreeBench/distray/distray: -5.44% (0.2664 => 0.2519, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.43% (3.9413 => 3.7271, std.dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: -5.18% (3.4230 => 3.2456, std.dev.: 0.0242) SingleSource/Benchmarks/Shootout/fib2: -5.07% (4.4195 => 4.1953, std.dev.: 0.0339) MultiSource/Benchmarks/Olden/bh/bh: -5.06% (2.5166 => 2.3893, std.dev.: 0.0191) MultiSource/Applications/sgefa/sgefa: -4.35% (0.3746 => 0.3583, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.32% (0.4564 => 0.4367, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -4.26% (62.4126 => 59.7520, std.dev.: 0.1133) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.99% (3.7496 => 3.6373, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.95% (1.1683 => 1.1338, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/methcall: -2.94% (9.2503 => 8.9787, std.dev.: 0.0107) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.81% (1.2722 => 1.2365, std.dev.: 0.0115) SingleSource/Benchmarks/Dhrystone/dry: -2.03% (2.4013 => 2.3526, std.dev.: 0.0054) MultiSource/Benchmarks/PAQ8p/paq8p: -1.97% (92.7467 => 90.9154, std.dev.: 0.2833) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.83% (2.3569 => 2.3137, std.dev.: 0.0078) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.83% (2.8964 => 2.8434, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/hash2: -1.74% (3.4876 => 3.4269, std.dev.: 0.0123) MultiSource/Benchmarks/FreeBench/neural/neural: -1.70% (1.0926 => 1.0740, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: -1.69% (3.8907 => 3.8251, std.dev.: 0.0234) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.68% (2.4457 => 2.4046, std.dev.: 0.0138) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.60% (9.3855 => 9.2351, std.dev.: 0.0204) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.46% (1.0686 => 1.0530, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.44% (1.8739 => 1.8470, std.dev.: 0.0083) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.27% (27.1724 => 26.8268, std.dev.: 0.1288) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.13% (25.6658 => 25.3759, std.dev.: 0.0512) MultiSource/Applications/JM/lencod/lencod: -1.06% (6.7458 => 6.6745, std.dev.: 0.0102) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.47% (0.9980 => 1.0227, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: 4.04% (0.6022 => 0.6265, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/08-main/main: 8.94% (0.1666 => 0.1815, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.19% (0.1554 => 0.1551, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.01% (0.3083 => 0.3114, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.92% (0.2394 => 0.2348, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.54% (0.3175 => 0.3126, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.09% (0.2302 => 0.2327, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/mandel: 2.67% (0.0449 => 0.0461, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -32.92% (0.0240 => 0.0161, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -9.90% (0.0192 => 0.0173, std.dev.: 0.0065) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.77% (0.0390 => 0.0393, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.30% (0.0301 => 0.0270, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.41% (0.0284 => 0.0288, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -18.83% (0.0324 => 0.0263, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/casts: -46.33% (0.0177 => 0.0095, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/test1: 3.17% (0.0189 => 0.0195, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: 2.01% (0.0249 => 0.0254, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -13.85% (0.0325 => 0.0280, std.dev.: 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.63% (0.1429 => 0.1420, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: -1.36% (1.5019 => 1.4815, std.dev.: 0.0315) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 2.73% (0.1501 => 0.1542, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.78% (0.4264 => 0.4060, std.dev.: 0.0467) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.62% (0.1344 => 0.1433, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.41% (0.0589 => 0.0563, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -25.00% (0.0232 => 0.0174, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.45% (0.0639 => 0.0585, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.57% (1.1350 => 1.1285, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 350.00% (0.0006 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.81% (0.0637 => 0.0600, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.89% (0.0246 => 0.0170, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.51% (0.7541 => 0.7655, std.dev.: 0.0253) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 11.11% (1.5363 => 1.7070, std.dev.: 0.0070) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 12:41:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 14:41:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121004194115.7514B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4571?compare_to=4568&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4571, Order: 165236, Start Time: 2012-10-04 18:17:44, End Time: 2012-10-04 19:42:56 To: 4568, Order: 165231, Start Time: 2012-10-04 16:23:19, End Time: 2012-10-04 17:48:37 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (5 on baseline) Performance Regressions: 1 (180 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 5 (0 on baseline) Unchanged Tests: 1035 (682 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.03% (54.8205 => 56.4819, std.dev.: 0.1901) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.28% (0.9678 => 0.9554, std.dev.: 0.0040) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.25% (33.6471 => 33.5640, std.dev.: 0.0150) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.00% (2.7523 => 2.7522, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (2.1153 => 2.1153, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.01% (4.9750 => 4.9745, std.dev.: 0.0068) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.81% (33.2944 => 33.5640, std.dev.: 0.0150) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: -100.00% (7.3305 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.17% (2.0176 => 2.4447, std.dev.: 0.0026) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.16% (0.1410 => 0.1652, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 15.13% (0.0826 => 0.0951, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 14.13% (0.2243 => 0.2560, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.55% (0.0819 => 0.0930, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.59% (0.0834 => 0.0939, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 12.48% (0.4062 => 0.4569, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 12.44% (0.2781 => 0.3127, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 12.41% (0.4328 => 0.4865, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 12.39% (0.5818 => 0.6539, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 12.28% (1.3693 => 1.5374, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 12.24% (0.1013 => 0.1137, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 12.18% (0.5748 => 0.6448, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 12.01% (0.2782 => 0.3116, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.71% (0.3022 => 0.3376, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.65% (0.3485 => 0.3891, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.61% (0.1413 => 0.1577, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 11.60% (0.7061 => 0.7880, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.57% (0.3899 => 0.4350, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 11.51% (0.2607 => 0.2907, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.49% (0.2655 => 0.2960, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 11.44% (1.9828 => 2.2096, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 11.38% (0.2760 => 0.3074, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 11.37% (0.2726 => 0.3036, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.36% (0.2721 => 0.3030, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 11.34% (0.2690 => 0.2995, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 11.33% (0.2966 => 0.3302, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 11.30% (0.2628 => 0.2925, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 11.28% (0.2765 => 0.3077, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 11.27% (0.2937 => 0.3268, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 11.26% (0.2761 => 0.3072, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 11.21% (0.3489 => 0.3880, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.10% (3.9660 => 4.4061, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 11.08% (0.3293 => 0.3658, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.06% (0.3580 => 0.3976, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 11.04% (0.3107 => 0.3450, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 10.99% (0.3149 => 0.3495, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 10.99% (0.3868 => 0.4293, std.dev.: 0.0041) MultiSource/Applications/lambda-0_1_3/lambda: 10.98% (0.7038 => 0.7811, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.98% (0.4016 => 0.4457, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.98% (0.2696 => 0.2992, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.92% (0.3756 => 0.4166, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.91% (0.1072 => 0.1189) SingleSource/Benchmarks/Shootout-C++/sieve: 10.86% (0.3453 => 0.3828, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.83% (0.1588 => 0.1760, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.79% (0.7710 => 0.8542, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.79% (0.0964 => 0.1068, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.73% (0.4390 => 0.4861, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 10.71% (0.3192 => 0.3534, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 10.68% (0.2988 => 0.3307, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.66% (0.6959 => 0.7701, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.63% (0.2596 => 0.2872, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.63% (0.1327 => 0.1468, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.58% (1.2193 => 1.3483, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.52% (0.9199 => 1.0167, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.38% (1.4563 => 1.6075, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/lists1: 10.36% (0.3534 => 0.3900, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.35% (0.6283 => 0.6933, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.23% (1.1364 => 1.2526, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.22% (0.5265 => 0.5803, std.dev.: 0.0021) MultiSource/Applications/aha/aha: 10.17% (0.1062 => 0.1170, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.95% (0.1075 => 0.1182, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 9.95% (0.2945 => 0.3238, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 9.89% (13.8202 => 15.1865, std.dev.: 0.0199) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.71% (0.4379 => 0.4804, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.57% (0.1986 => 0.2176, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.56% (0.1276 => 0.1398, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.42% (0.1157 => 0.1266, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.32% (0.3755 => 0.4105, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.30% (0.3130 => 0.3421, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 9.22% (0.2995 => 0.3271, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.20% (0.5577 => 0.6090, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.10% (0.4791 => 0.5227, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 9.04% (1.0313 => 1.1245, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 9.00% (0.1589 => 0.1732, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.99% (0.8698 => 0.9480, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.93% (0.2127 => 0.2317, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 8.90% (16.6129 => 18.0907, std.dev.: 0.0200) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.89% (0.2914 => 0.3173, std.dev.: 0.0021) MultiSource/Applications/Burg/burg: 8.82% (1.1061 => 1.2037, std.dev.: 0.0027) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.71% (0.1435 => 0.1560, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.67% (0.5637 => 0.6126, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.65% (0.7460 => 0.8105, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.63% (0.3246 => 0.3526, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 8.55% (0.7506 => 0.8148, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 8.54% (0.3220 => 0.3495, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.51% (7.2180 => 7.8319, std.dev.: 0.0105) MultiSource/Applications/minisat/minisat: 8.48% (0.6744 => 0.7316, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 8.48% (3.8646 => 4.1922, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 8.38% (0.8310 => 0.9006, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 8.29% (3.1889 => 3.4534, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.26% (0.6576 => 0.7119, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.26% (0.2023 => 0.2190, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.15% (0.1865 => 0.2017, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 8.12% (0.1478 => 0.1598, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 7.97% (0.2925 => 0.3158, std.dev.: 0.0023) MultiSource/Applications/treecc/treecc: 7.96% (1.9270 => 2.0804, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 7.86% (1.0594 => 1.1427, std.dev.: 0.0130) MultiSource/Benchmarks/Olden/em3d/em3d: 7.79% (0.1657 => 0.1786, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 7.78% (1.2292 => 1.3248, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 7.75% (2.1791 => 2.3480, std.dev.: 0.0062) MultiSource/Applications/oggenc/oggenc: 7.73% (4.6629 => 5.0235, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.67% (3.6692 => 3.9507, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.62% (0.2140 => 0.2303, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.55% (0.1789 => 0.1924, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 7.54% (0.3131 => 0.3367, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.53% (1.3245 => 1.4243, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.46% (0.3511 => 0.3773, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.46% (0.1569 => 0.1686, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 7.39% (1.2749 => 1.3691, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 7.38% (0.6250 => 0.6711, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 7.37% (14.8535 => 15.9478, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.31% (4.3801 => 4.7003, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.26% (0.1819 => 0.1951, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.25% (4.4433 => 4.7656, std.dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 7.22% (8.4961 => 9.1097, std.dev.: 0.0102) MultiSource/Benchmarks/McCat/05-eks/eks: 7.22% (0.4113 => 0.4410, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/parameter-passing: 7.17% (0.4003 => 0.4290, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 7.13% (0.3914 => 0.4193, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/trivial-interface: 7.13% (0.3578 => 0.3833, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.11% (0.8818 => 0.9445, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.05% (0.3646 => 0.3903, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-2: 7.00% (0.3601 => 0.3853, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.99% (0.6135 => 0.6564, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.99% (0.3650 => 0.3905, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 6.97% (0.3789 => 0.4053, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.93% (0.3663 => 0.3917, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.85% (0.3940 => 0.4210, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-3: 6.82% (0.3623 => 0.3870) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.68% (4.9865 => 5.3194, std.dev.: 0.0214) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.55% (0.2504 => 0.2668, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.48% (1.1333 => 1.2067, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.29% (3.2742 => 3.4802, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.29% (0.9108 => 0.9681, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.26% (0.3245 => 0.3448, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.25% (1.5188 => 1.6137, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.16% (0.4805 => 0.5101, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 6.03% (6.5754 => 6.9722, std.dev.: 0.0171) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.90% (0.2321 => 0.2458, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 5.73% (0.2008 => 0.2123, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.59% (6.2785 => 6.6294, std.dev.: 0.0051) MultiSource/Applications/lua/lua: 5.49% (3.7467 => 3.9524, std.dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.46% (2.1007 => 2.2153, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.78% (13.2842 => 13.9187, std.dev.: 0.0202) MultiSource/Applications/sqlite3/sqlite3: 3.40% (16.2614 => 16.8147, std.dev.: 0.0193) MultiSource/Applications/ClamAV/clamscan: 3.16% (14.5298 => 14.9887, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5153, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.21% (1.8175 => 2.2576, std.dev.: 0.0453) SingleSource/Benchmarks/Misc/richards_benchmark: 11.12% (1.1560 => 1.2845, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.03% (0.8273 => 0.9020, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4140, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.22% (1.2998 => 1.3807, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.75% (0.3139 => 0.3288, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-5: 4.65% (1.9144 => 2.0034, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6762, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9860, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.31% (10.7476 => 11.1037, std.dev.: 0.0128) SingleSource/Regression/C/uint64_to_float: 2.97% (0.5449 => 0.5611, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.17% (7.4271 => 7.5885, std.dev.: 0.0077) MultiSource/Applications/lemon/lemon: 1.80% (1.4298 => 1.4556, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5122, std.dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.37% (1.9433 => 1.9700, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1872, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5781, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0265, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 1.03% (12.4560 => 12.5839, std.dev.: 0.0079) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.19% (0.2670 => 0.1410, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.00% (0.4657 => 0.3912, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -15.56% (0.0707 => 0.0597, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.98% (1.3819 => 1.1887, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.95% (1.3813 => 1.1886, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.02% (22.5627 => 21.6553, std.dev.: 0.0136) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.64% (0.0997 => 0.0861, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -11.89% (0.2238 => 0.1972, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.12% (1.2308 => 1.0939, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.08% (20.3410 => 18.2898, std.dev.: 0.0161) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0095) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.14% (1.3780 => 1.2934, std.dev.: 0.0134) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5144, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.42% (0.9996 => 0.9554, std.dev.: 0.0040) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8004, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.49% (1.7688 => 1.7070, std.dev.: 0.0062) MultiSource/Applications/siod/siod: -3.49% (3.2729 => 3.1586, std.dev.: 0.0247) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.21% (0.4867 => 0.4711, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4785, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -2.44% (3.0263 => 2.9524, std.dev.: 0.0014) MultiSource/Applications/lua/lua: -2.37% (26.5159 => 25.8862, std.dev.: 0.0120) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.35% (1.9762 => 1.9298, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.96% (0.6589 => 0.6460, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7153, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2548, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: -1.52% (4.5928 => 4.5232, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8598, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0061, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4954, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: -1.17% (9.3358 => 9.2267, std.dev.: 0.0105) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2576, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 13:07:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 15:07:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121004200736.846FC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4572?compare_to=4569&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4572, Order: 165236, Start Time: 2012-10-04 18:49:49, End Time: 2012-10-04 20:09:18 To: 4569, Order: 165233, Start Time: 2012-10-04 17:00:56, End Time: 2012-10-04 18:20:29 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (157 on baseline) Performance Improvements: 1 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 950 (688 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 3.00% (0.3936 => 0.4054, std.dev.: 0.0041) SingleSource/UnitTests/ObjC++/property-reference: 1.28% (0.7831 => 0.7931, std.dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.84% (15.2121 => 14.9317, std.dev.: 0.0057) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.02% (0.5866 => 0.5867, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: -0.35% (16.2048 => 16.1488, std.dev.: 0.0120) MultiSource/Benchmarks/Bullet/bullet: -0.36% (53.9617 => 53.7675, std.dev.: 0.0125) MultiSource/Benchmarks/MallocBench/gs/gs: 0.17% (4.3791 => 4.3865, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.65% (0.0465 => 0.0468, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.64% (0.0467 => 0.0470, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.69% (0.0434 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.46% (0.0436 => 0.0438, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.24% (0.0425 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.47% (0.0425 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.48% (0.0417 => 0.0419, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.48% (0.0418 => 0.0420, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.46% (0.0435 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.92% (0.0436 => 0.0440, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.70% (0.0429 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.23% (0.0431 => 0.0432, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.72% (0.0419 => 0.0422, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.48% (0.0421 => 0.0423) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.70% (0.0426 => 0.0429, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.47% (0.0428 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.46% (0.0438 => 0.0440, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0441 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.48% (0.0415 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.72% (0.0415 => 0.0418) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.47% (0.0426 => 0.0428, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.47% (0.0427 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.72% (0.0417 => 0.0420) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.48% (0.0419 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.49% (0.0409 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.49% (0.0410 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.49% (0.0409 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.49% (0.0410 => 0.0412) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.67% (0.0446 => 0.0449, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.67% (0.0447 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.49% (0.0407 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.49% (0.0408 => 0.0410, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.73% (0.0409 => 0.0412) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.24% (0.0411 => 0.0412, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.48% (0.0416 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.24% (0.0419 => 0.0420, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.03% (1.2459 => 1.2455, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.09% (7.7086 => 7.7154, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.7386 => 0.7386, std.dev.: 0.0038) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 1.11% (0.0361 => 0.0365, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 0.70% (0.1431 => 0.1441, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.66% (0.2174 => 0.2138, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -14.98% (63.2438 => 53.7675, std.dev.: 0.0125) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 31.94% (14.1553 => 18.6765, std.dev.: 0.0256) SingleSource/Benchmarks/Misc-C++-EH/spirit: 59.91% (3.4629 => 5.5376, std.dev.: 0.0162) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14228.06% (0.0720 => 10.3162, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952200.00% (0.0001 => 9.9523, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 48.12% (0.2554 => 0.3783, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 44.03% (10.3673 => 14.9317, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/distray/distray: 30.68% (0.1056 => 0.1380, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 29.35% (0.1622 => 0.2098, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.06% (2.2022 => 2.5558, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.43% (7.0540 => 8.1426, std.dev.: 0.0081) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.62% (0.1566 => 0.1795, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 14.39% (0.1432 => 0.1638, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.95% (0.0834 => 0.0942, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.49% (1.7609 => 1.9808, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.12% (0.3473 => 0.3894, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.06% (0.0871 => 0.0976, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.00% (0.3543 => 0.3968, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.90% (0.3497 => 0.3913, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 11.88% (0.3561 => 0.3984, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 11.86% (0.3516 => 0.3933, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.85% (0.3543 => 0.3963, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 11.52% (0.3282 => 0.3660, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.45% (0.3694 => 0.4117, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.36% (0.3927 => 0.4373, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.34% (0.3828 => 0.4262, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.12% (0.3886 => 0.4318, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.98% (0.1584 => 0.1758, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 10.72% (10.4361 => 11.5549, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/power/power: 9.51% (0.1440 => 0.1577, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.45% (0.4879 => 0.5340, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.39% (0.1438 => 0.1573, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.38% (0.3177 => 0.3475, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 9.00% (0.5925 => 0.6458, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 8.99% (0.6030 => 0.6572, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 8.67% (9.4845 => 10.3068, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.63% (0.6675 => 0.7251, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 8.62% (5.7591 => 6.2557, std.dev.: 0.0154) MultiSource/Applications/minisat/minisat: 8.62% (0.7115 => 0.7728, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 8.61% (0.7433 => 0.8073, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 8.60% (0.1175 => 0.1276, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 8.58% (0.1655 => 0.1797, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.57% (0.2065 => 0.2242, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.54% (0.4615 => 0.5009, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.43% (1.5415 => 1.6715, std.dev.: 0.0034) MultiSource/Applications/sgefa/sgefa: 8.43% (0.3109 => 0.3371, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 8.38% (0.1695 => 0.1837, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.26% (0.8172 => 0.8847, std.dev.: 0.0042) SingleSource/UnitTests/ObjC++/property-reference: 8.26% (0.7326 => 0.7931, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/18-imp/imp: 8.15% (0.3423 => 0.3702, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.15% (0.2271 => 0.2456, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.12% (0.1625 => 0.1757, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.08% (0.1337 => 0.1445, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.08% (1.3050 => 1.4104, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 7.98% (0.3422 => 0.3695) MultiSource/Applications/d/make_dparser: 7.92% (3.3354 => 3.5996, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.91% (0.3121 => 0.3368, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.90% (0.5569 => 0.6009, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.90% (0.4103 => 0.4427, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.88% (0.2107 => 0.2273, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.86% (4.2646 => 4.5999, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.85% (0.2700 => 0.2912, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.83% (0.5860 => 0.6319, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.81% (8.1363 => 8.7715, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.64% (0.2891 => 0.3112, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 7.62% (0.6456 => 0.6948, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.62% (0.1510 => 0.1625, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.61% (5.0018 => 5.3824, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash: 7.55% (0.4289 => 0.4613, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.55% (4.9449 => 5.3181, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.54% (0.2758 => 0.2966, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.53% (0.1940 => 0.2086, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.52% (0.5105 => 0.5489, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.51% (0.4636 => 0.4984, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 7.49% (0.2831 => 0.3043, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 7.47% (0.7835 => 0.8420, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.47% (0.9765 => 1.0494, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.43% (0.8067 => 0.8666, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.40% (0.2905 => 0.3120, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.35% (0.3865 => 0.4149, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.34% (0.3650 => 0.3918, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.32% (0.3307 => 0.3549, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.30% (0.4203 => 0.4510, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 7.30% (0.3232 => 0.3468, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.29% (0.5020 => 0.5386, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.24% (0.3162 => 0.3391, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.24% (0.3052 => 0.3273, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 7.24% (0.4048 => 0.4341, std.dev.: 0.0036) MultiSource/Applications/hbd/hbd: 7.22% (1.5603 => 1.6730, std.dev.: 0.0067) MultiSource/Applications/viterbi/viterbi: 7.20% (0.1555 => 0.1667, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.18% (7.9617 => 8.5337, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/except: 7.18% (0.2871 => 0.3077, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.14% (0.3136 => 0.3360, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.13% (2.0665 => 2.2139, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/fibo: 7.12% (0.2725 => 0.2919, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.11% (0.3826 => 0.4098, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: 7.10% (1.1642 => 1.2468, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 7.09% (0.3387 => 0.3627, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 7.08% (0.3603 => 0.3858, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.08% (0.2756 => 0.2951, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 7.07% (0.3098 => 0.3317, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.07% (0.2872 => 0.3075, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 7.01% (0.3283 => 0.3513, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 7.00% (0.3684 => 0.3942, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.95% (0.2877 => 0.3077, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.95% (0.4620 => 0.4941, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.92% (0.2802 => 0.2996, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.89% (0.2714 => 0.2901, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.84% (0.2793 => 0.2984, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 6.82% (3.8723 => 4.1364, std.dev.: 0.0014) MultiSource/Applications/treecc/treecc: 6.54% (2.0273 => 2.1599, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary2: 6.54% (0.3379 => 0.3600, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 6.50% (1.0722 => 1.1419, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.45% (0.3441 => 0.3663, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 6.45% (0.3180 => 0.3385, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.38% (0.2603 => 0.2769, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.37% (1.1861 => 1.2616, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.28% (0.4299 => 0.4569, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.11% (0.6450 => 0.6844, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.02% (1.5859 => 1.6814, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.00% (0.5981 => 0.6340, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.92% (0.1892 => 0.2004, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 5.91% (21.9371 => 23.2342, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/football/football: 5.87% (0.8921 => 0.9445, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 5.79% (2.2969 => 2.4299, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.77% (0.1906 => 0.2016, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.61% (0.4064 => 0.4292, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.25% (1.4186 => 1.4931, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 5.09% (1.2842 => 1.3496, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.09% (2.2024 => 2.3144, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 5.08% (0.3131 => 0.3290, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.93% (1.1840 => 1.2424, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.72% (0.2266 => 0.2373, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.47% (0.8101 => 0.8463, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.14% (0.3817 => 0.3975, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.29% (14.3668 => 14.8394, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.15% (0.3427 => 0.3535, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.82% (17.1811 => 17.6655, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.81% (1.1194 => 1.1509, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.57% (3.8922 => 3.9921, std.dev.: 0.0186) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.55% (0.2944 => 0.3284, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 10.15% (3.1595 => 3.4802, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 9.88% (1.1396 => 1.2522, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3691, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626) SingleSource/Regression/C/uint64_to_float: 3.68% (0.5413 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.52% (3.6395 => 3.7675, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.67% (4.2280 => 4.3409, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.34% (1.7254 => 1.7657, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8126, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.20% (2.6546 => 2.6864, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.18% (6.5088 => 6.5853, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.06% (6.6874 => 0.1296, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.04% (0.8651 => 0.1727, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.95% (5.2763 => 3.2738, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.20% (5.3855 => 3.6516, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.88% (5.3526 => 3.6462, std.dev.: 0.0024) SingleSource/UnitTests/Vector/constpool: -14.55% (54.1659 => 46.2828, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/mason/mason: -13.19% (0.0811 => 0.0704, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -11.20% (22.1758 => 19.6925, std.dev.: 0.0110) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.45% (2.9384 => 2.6312, std.dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7653, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: -15.72% (1.6925 => 1.4265, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.63% (0.0998 => 0.0862, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -11.53% (1.2373 => 1.0947, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel-2: -10.58% (1.5373 => 1.3747, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/mason/mason: -9.86% (0.2161 => 0.1948, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.32% (19.9488 => 18.2893, std.dev.: 0.0990) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.81% (1.8329 => 1.7080, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.35% (1.6805 => 1.5906, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.66% (1.5835 => 1.5097, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.72% (3.2827 => 3.1607, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.44% (0.9957 => 0.9614, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4985, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: -3.01% (12.4730 => 12.0980, std.dev.: 0.0019) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.10% (8.1563 => 7.9852, std.dev.: 0.0129) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.07% (8.6802 => 8.5003, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/salsa20: -1.87% (10.2830 => 10.0909, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/flops: -1.68% (8.8334 => 8.6846, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -1.51% (2.5528 => 2.5143, std.dev.: 0.0042) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4205, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: -1.44% (4.6441 => 4.5772, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8587, std.dev.: 0.0017) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.20% (0.5229 => 0.5867, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 7.73% (14.9895 => 16.1488, std.dev.: 0.0120) MultiSource/Benchmarks/MallocBench/gs/gs: 6.71% (4.1105 => 4.3865, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.74% (1.1048 => 1.2455, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.78% (7.1582 => 7.7154, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.71% (0.6222 => 0.7386, std.dev.: 0.0038) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36400.00% (0.0001 => 0.0365, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -2.96% (0.1485 => 0.1441, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.04% (0.2116 => 0.2138, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 13:19:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 15:19:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121004201923.6724D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4573?compare_to=4566&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4573, Order: 165233, Start Time: 2012-10-04 17:11:06, End Time: 2012-10-04 20:21:06 To: 4566, Order: 165223, Start Time: 2012-10-04 13:31:32, End Time: 2012-10-04 16:41:48 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 1 (131 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (131 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1038 (760 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.75% (2.0347 => 2.1111, std.dev.: 0.0121) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.04% (9.8085 => 9.8126, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.01% (9.4112 => 9.4103, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.01% (16.9554 => 16.9567, std.dev.: 0.0034) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 11.87% (0.3488 => 0.3902, std.dev.: 0.0090) SingleSource/UnitTests/ObjC/exceptions-4: 11.77% (0.3465 => 0.3873) SingleSource/UnitTests/ObjC/exceptions-2: 11.75% (0.3446 => 0.3851, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.73% (0.3460 => 0.3866, std.dev.: 0.0029) MultiSource/Applications/oggenc/oggenc: 11.73% (1.5932 => 1.7801, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/trivial-interface: 11.71% (0.3442 => 0.3845, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.70% (0.3496 => 0.3905, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.57% (0.1063 => 0.1186, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 11.56% (0.3469 => 0.3870, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.36% (0.3643 => 0.4057, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.32% (0.3650 => 0.4063, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.20% (0.3724 => 0.4141, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.28% (0.2738 => 0.2992, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.25% (0.2875 => 0.3141, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.13% (0.5826 => 0.6358, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 9.05% (0.3004 => 0.3276, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 8.99% (0.2725 => 0.2970, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.95% (0.3195 => 0.3481, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 8.89% (0.2823 => 0.3074, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 8.89% (0.2813 => 0.3063, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.88% (0.5889 => 0.6412, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 8.88% (0.2714 => 0.2955, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 8.87% (0.2750 => 0.2994, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.83% (0.2911 => 0.3168, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 8.81% (0.2780 => 0.3025, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.79% (0.2729 => 0.2969, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 8.74% (0.2803 => 0.3048, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 8.72% (0.3096 => 0.3366, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 8.72% (0.9909 => 1.0773, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.70% (0.2792 => 0.3035, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 8.68% (0.2811 => 0.3055, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.66% (2.0673 => 2.2463, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/ary3: 8.51% (0.3267 => 0.3545, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.50% (0.3060 => 0.3320, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 8.47% (0.3258 => 0.3534, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 8.44% (0.3317 => 0.3597, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.18% (0.3362 => 0.3637, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/05-eks/eks: 8.15% (0.1619 => 0.1751, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 8.12% (0.3348 => 0.3620, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.04% (0.3282 => 0.3546, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 8.03% (0.4146 => 0.4479, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.00% (0.3124 => 0.3374, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.00% (0.3625 => 0.3915, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 7.97% (0.3726 => 0.4023, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 7.97% (0.3678 => 0.3971, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.87% (0.4994 => 0.5387, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.85% (0.3845 => 0.4147, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 7.79% (0.3477 => 0.3748, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.78% (1.3152 => 1.4175, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.64% (1.6211 => 1.7449, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: 7.52% (0.7171 => 0.7710, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.50% (0.4361 => 0.4688, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash2: 7.48% (0.4251 => 0.4569, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.43% (0.3690 => 0.3964, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.38% (0.5000 => 0.5369, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.35% (0.1620 => 0.1739, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 7.29% (23.5202 => 25.2337, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.23% (3.5627 => 3.8203, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.21% (0.3981 => 0.4268, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.20% (0.9697 => 1.0395, std.dev.: 0.0052) MultiSource/Applications/SPASS/SPASS: 7.17% (5.5417 => 5.9390, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.95% (0.2014 => 0.2154, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.91% (0.2736 => 0.2925, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.89% (0.4139 => 0.4424, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 6.72% (0.5012 => 0.5349, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.72% (0.3930 => 0.4194, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.69% (1.0781 => 1.1502, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.63% (0.5026 => 0.5359, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.59% (2.7292 => 2.9091, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.40% (0.6435 => 0.6847, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 6.39% (4.2109 => 4.4801, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.28% (0.2866 => 0.3046, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.24% (0.2566 => 0.2726, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 6.20% (0.6634 => 0.7045, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.19% (0.5900 => 0.6265, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.17% (0.3903 => 0.4144, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.12% (0.3890 => 0.4128, std.dev.: 0.0019) MultiSource/Applications/spiff/spiff: 5.91% (0.4029 => 0.4267, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.90% (4.4195 => 4.6803, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.86% (0.2969 => 0.3143, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 5.82% (0.5546 => 0.5869, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 5.80% (1.8794 => 1.9884, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.79% (0.1968 => 0.2082, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 5.77% (2.1013 => 2.2225, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 5.75% (1.4269 => 1.5089, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.74% (0.3084 => 0.3261, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.66% (0.2737 => 0.2892, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 5.61% (4.6177 => 4.8767, std.dev.: 0.0055) MultiSource/Applications/minisat/minisat: 5.61% (0.3336 => 0.3523, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.56% (0.2068 => 0.2183, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.47% (0.4658 => 0.4913, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.44% (0.3271 => 0.3449, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 5.30% (2.1653 => 2.2801, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.09% (0.2103 => 0.2210, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 5.04% (0.7875 => 0.8272, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.01% (1.9694 => 2.0681, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.90% (1.9966 => 2.0945, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.90% (0.2040 => 0.2140, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 4.75% (2.0346 => 2.1313, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: 4.72% (0.4847 => 0.5076, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 4.38% (0.2691 => 0.2809, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 4.29% (0.3498 => 0.3648, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.12% (0.7426 => 0.7732, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.81% (0.5361 => 0.5565, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.75% (11.6398 => 12.0764, std.dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.55% (0.5584 => 0.5782, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.51% (4.6926 => 4.8571, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.39% (0.4253 => 0.4397, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 2.52% (11.9555 => 12.2572, std.dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6109, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 5.37% (0.2122 => 0.2236, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/objinst: 5.11% (12.0509 => 12.6664, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/flops-2: 4.89% (1.8057 => 1.8940, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1679, std.dev.: 0.0034) SingleSource/Benchmarks/Dhrystone/dry: 4.27% (14.0481 => 14.6485, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.42% (79.9355 => 82.6665, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1947, std.dev.: 0.0083) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5052, std.dev.: 0.0051) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.65% (3.1722 => 3.2246, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.37% (7.1849 => 7.2836, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5140, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5870, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.87% (25.4195 => 16.5563, std.dev.: 0.0172) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9765, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7975, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -7.16% (0.2402 => 0.2230, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8014, std.dev.: 0.0144) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.07% (0.6293 => 0.6100, std.dev.: 0.0046) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7738, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -2.71% (17.2379 => 16.7701, std.dev.: 0.0361) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8658, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5749, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4962, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.2036, std.dev.: 0.0793) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0461, std.dev.: 0.0033) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 13:34:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 15:34:58 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121004203458.187912A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4574?compare_to=4570&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4574, Order: 165237, Start Time: 2012-10-04 19:12:33, End Time: 2012-10-04 20:36:41 To: 4570, Order: 165234, Start Time: 2012-10-04 17:32:30, End Time: 2012-10-04 18:56:35 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (14 on baseline) Performance Regressions: 10 (70 on baseline) Performance Improvements: 4 (42 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 963 (779 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.73% (0.1797 => 0.1918, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.77% (0.7905 => 0.8124, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.44% (0.8978 => 0.9197, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.32% (0.8622 => 0.8822, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.91% (0.8570 => 0.8734, std.dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 6.30% (1.7345 => 1.8438, std.dev.: 0.0118) MultiSource/Benchmarks/Bullet/bullet: 2.52% (7.1923 => 7.3733, std.dev.: 0.0197) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 2.19% (1.4173 => 1.4484, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/whetstone: 1.81% (2.3624 => 2.4052, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/lists: 1.20% (16.3844 => 16.5805, std.dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -1.85% (2.0340 => 1.9964, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout/matrix: -1.62% (1.5840 => 1.5583, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.40% (2.9853 => 2.9435, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -1.37% (4.6096 => 4.5463, std.dev.: 0.0185) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -2.07% (1.0227 => 1.0015, std.dev.: 0.0150) MultiSource/Applications/sqlite3/sqlite3: -1.26% (0.6265 => 0.6186, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/08-main/main: 0.44% (0.1815 => 0.1823, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.19% (0.1551 => 0.1585, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.19% (0.3114 => 0.3120, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.83% (0.2348 => 0.2391, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.24% (0.3126 => 0.3196, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.09% (0.2327 => 0.2325, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: -0.65% (0.0461 => 0.0458, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 50.93% (0.0161 => 0.0243, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 12.72% (0.0173 => 0.0195, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.02% (0.0393 => 0.0389, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -6.67% (0.0270 => 0.0252, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.35% (0.0288 => 0.0287, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 6.46% (0.0263 => 0.0280, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/casts: 90.53% (0.0095 => 0.0181, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -18.97% (0.0195 => 0.0158, std.dev.: 0.0018) SingleSource/UnitTests/Vector/multiplies: -1.18% (0.0254 => 0.0251, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -2.50% (0.0280 => 0.0273, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.28% (0.1420 => 0.1424, std.dev.: 0.0028) MultiSource/Applications/lemon/lemon: -5.93% (1.4815 => 1.3937, std.dev.: 0.0715) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.91% (0.1542 => 0.1556, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.96% (0.4060 => 0.4180, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.70% (0.1433 => 0.1423, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.37% (0.0563 => 0.0544, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 13.22% (0.0174 => 0.0197, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 11.79% (0.0585 => 0.0654, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.36% (1.1285 => 1.1326, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0027 => 0.0027, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 60.00% (0.0005 => 0.0008, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.67% (0.0600 => 0.0560, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.59% (0.0170 => 0.0169, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.13% (0.7655 => 0.7645, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.01% (1.7070 => 1.7069, std.dev.: 0.0019) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -15.70% (0.0121 => 0.0102, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 140.45% (0.0089 => 0.0214, std.dev.: 0.0003) SingleSource/UnitTests/2003-08-11-VaListArg: 164.44% (0.0090 => 0.0238, std.dev.: 0.0006) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -27.40% (4.1772 => 3.0325, std.dev.: 0.0188) SingleSource/Benchmarks/Shootout-C++/except: 83933.33% (0.0006 => 0.5042, std.dev.: 0.0164) SingleSource/Regression/C++/EH/ctor_dtor_count: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_rethrow: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_throw: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/throw_rethrow_test: -75.00% (0.0004 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.42% (0.0745 => 0.0912, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.58% (0.6410 => 0.7024, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.32% (0.1159 => 0.1267, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 8.51% (0.5309 => 0.5761, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: 8.22% (2.1763 => 2.3552, std.dev.: 0.0235) MultiSource/Applications/minisat/minisat: 8.13% (0.6173 => 0.6675, std.dev.: 0.0122) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.37% (0.3582 => 0.3846, std.dev.: 0.0041) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.21% (0.1414 => 0.1516, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.84% (1.5150 => 1.6187, std.dev.: 0.0041) MultiSource/Applications/SIBsim4/SIBsim4: 6.66% (1.1653 => 1.2429, std.dev.: 0.0076) MultiSource/Applications/kimwitu++/kc: 6.45% (15.3105 => 16.2980, std.dev.: 0.2570) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.88% (0.2552 => 0.2702, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.68% (0.7639 => 0.8073, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/oourafft: 5.58% (0.1971 => 0.2081, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.58% (0.2797 => 0.2953, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.50% (0.6069 => 0.6403, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 5.50% (0.3217 => 0.3394, std.dev.: 0.0047) MultiSource/Applications/lambda-0_1_3/lambda: 5.47% (0.6915 => 0.7293, std.dev.: 0.0084) MultiSource/Applications/d/make_dparser: 5.06% (3.0225 => 3.1754, std.dev.: 0.0173) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.01% (1.1827 => 1.2419, std.dev.: 0.0199) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.00% (0.3901 => 0.4096, std.dev.: 0.0064) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.97% (6.2546 => 6.5654, std.dev.: 0.0414) MultiSource/Benchmarks/Bullet/bullet: 4.94% (29.3170 => 30.7638, std.dev.: 0.1815) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.83% (0.4248 => 0.4453, std.dev.: 0.0027) MultiSource/Applications/Burg/burg: 4.69% (1.1440 => 1.1976, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.55% (0.4880 => 0.5102, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 4.45% (8.2186 => 8.5840, std.dev.: 0.0555) MultiSource/Applications/hbd/hbd: 4.18% (1.3268 => 1.3823, std.dev.: 0.0148) MultiSource/Applications/SPASS/SPASS: 4.15% (13.3238 => 13.8762, std.dev.: 0.0749) MultiSource/Benchmarks/Prolangs-C/football/football: 4.05% (0.8405 => 0.8745, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.89% (0.3062 => 0.3181, std.dev.: 0.0015) MultiSource/Applications/siod/siod: 3.88% (2.0972 => 2.1785, std.dev.: 0.0203) MultiSource/Applications/oggenc/oggenc: 3.73% (4.7455 => 4.9226, std.dev.: 0.0625) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.47% (1.2021 => 1.2438, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.39% (1.4408 => 1.4896, std.dev.: 0.0066) MultiSource/Benchmarks/MallocBench/gs/gs: 3.36% (3.8796 => 4.0098, std.dev.: 0.0452) SingleSource/Benchmarks/Shootout-C++/hash: 3.21% (0.3520 => 0.3633, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.06% (2.0317 => 2.0938, std.dev.: 0.0139) MultiSource/Applications/JM/lencod/lencod: 3.02% (14.7256 => 15.1705, std.dev.: 0.0888) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.01% (3.0758 => 3.1684, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.98% (0.3418 => 0.3520, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.78% (4.2815 => 4.4007, std.dev.: 0.0335) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.75% (8.2559 => 8.4829, std.dev.: 0.0871) MultiSource/Applications/treecc/treecc: 2.63% (1.8798 => 1.9292, std.dev.: 0.0096) MultiSource/Applications/JM/ldecod/ldecod: 2.40% (6.4908 => 6.6464, std.dev.: 0.0410) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.35% (1.6538 => 2.3377, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2280, std.dev.: 0.0302) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.73% (2.4042 => 2.7584, std.dev.: 0.0487) SingleSource/Benchmarks/Shootout/ary3: 14.56% (1.7426 => 1.9964, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.37% (4.0101 => 4.5463, std.dev.: 0.0185) SingleSource/Benchmarks/McGill/queens: 11.09% (1.6261 => 1.8065, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.28% (0.2857 => 0.3122, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.60% (1.0063 => 1.0928, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout/lists: 8.50% (7.0025 => 7.5975, std.dev.: 0.0153) MultiSource/Benchmarks/FreeBench/mason/mason: 8.25% (0.5004 => 0.5417, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/tsp/tsp: 6.39% (1.7330 => 1.8438, std.dev.: 0.0118) MultiSource/Benchmarks/Bullet/bullet: 5.75% (6.9722 => 7.3733, std.dev.: 0.0197) SingleSource/Benchmarks/Shootout-C++/hash: 5.34% (0.6308 => 0.6645, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/dt: 4.12% (0.9851 => 1.0257, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.00% (40.4792 => 42.0985, std.dev.: 0.4559) SingleSource/Benchmarks/Misc/fp-convert: 3.91% (15.2242 => 15.8192, std.dev.: 0.0736) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.90% (3.4080 => 3.5408, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 3.61% (3.5520 => 3.6801, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.53% (4.2129 => 4.3615, std.dev.: 0.0444) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.97% (0.5587 => 0.5753, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.83% (6.6312 => 6.8187, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/whetstone: 2.55% (2.3453 => 2.4052, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.89% (4.6127 => 4.7000, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.80% (2.9152 => 2.9676, std.dev.: 0.0120) MultiSource/Benchmarks/Olden/power/power: 1.50% (1.4184 => 1.4397, std.dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -44.56% (0.2996 => 0.1661, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.33% (0.0591 => 0.0329, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.15% (1.4189 => 1.1614, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.10% (1.4113 => 1.1559, std.dev.: 0.0269) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.21% (0.3497 => 0.2056, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.50% (5.2665 => 4.0815, std.dev.: 0.2727) SingleSource/Benchmarks/Shootout-C++/ary3: -20.80% (1.7473 => 1.3838, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.62% (1.7361 => 1.4650, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1584, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.82% (1.1647 => 1.0503, std.dev.: 0.0404) SingleSource/Benchmarks/Misc/flops: -8.41% (9.5474 => 8.7447, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2860, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.04% (3.2007 => 2.9435, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.83% (3.6254 => 3.3777, std.dev.: 0.0127) MultiSource/Applications/lambda-0_1_3/lambda: -6.71% (7.6833 => 7.1680, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/fibo: -6.59% (4.6355 => 4.3298, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.01% (2.9728 => 2.7941, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -6.00% (1.4441 => 1.3575, std.dev.: 0.0082) MultiSource/Applications/SIBsim4/SIBsim4: -5.98% (3.4230 => 3.2182, std.dev.: 0.0275) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.47% (3.9413 => 3.7259, std.dev.: 0.0308) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.97% (0.4564 => 0.4337, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: -4.80% (2.5166 => 2.3959, std.dev.: 0.0290) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.66% (0.4140 => 0.3947, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: -4.17% (62.4126 => 59.8122, std.dev.: 0.2061) MultiSource/Applications/sgefa/sgefa: -4.11% (0.3746 => 0.3592, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.90% (3.7496 => 3.6410, std.dev.: 0.0210) SingleSource/Benchmarks/Shootout-C++/methcall: -2.66% (9.2503 => 9.0044, std.dev.: 0.0472) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.48% (2.4457 => 2.3851, std.dev.: 0.0201) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.45% (1.1683 => 1.1397, std.dev.: 0.0071) SingleSource/Benchmarks/Dhrystone/dry: -2.43% (2.4013 => 2.3430, std.dev.: 0.0103) MultiSource/Applications/aha/aha: -1.93% (3.4286 => 3.3624, std.dev.: 0.0025) MultiSource/Benchmarks/PAQ8p/paq8p: -1.88% (92.7467 => 90.9989, std.dev.: 0.4280) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.74% (2.3569 => 2.3160, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/neural/neural: -1.70% (1.0926 => 1.0740, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.65% (1.0686 => 1.0510, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.58% (9.3855 => 9.2376, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/hash2: -1.55% (3.4876 => 3.4336, std.dev.: 0.0107) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3081, std.dev.: 0.0042) MultiSource/Applications/JM/lencod/lencod: -1.39% (6.7458 => 6.6522, std.dev.: 0.0245) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.36% (27.1724 => 26.8018, std.dev.: 0.0689) SingleSource/Benchmarks/Dhrystone/fldry: -1.34% (2.4971 => 2.4636, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.28% (1.8739 => 1.8500, std.dev.: 0.0072) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.35% (0.9980 => 1.0015, std.dev.: 0.0150) MultiSource/Applications/sqlite3/sqlite3: 2.72% (0.6022 => 0.6186, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/08-main/main: 9.42% (0.1666 => 0.1823, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.99% (0.1554 => 0.1585, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.20% (0.3083 => 0.3120, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.13% (0.2394 => 0.2391, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.66% (0.3175 => 0.3196, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.00% (0.2302 => 0.2325, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: 2.00% (0.0449 => 0.0458, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.25% (0.0240 => 0.0243, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.56% (0.0192 => 0.0195, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.26% (0.0390 => 0.0389, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -16.28% (0.0301 => 0.0252, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.06% (0.0284 => 0.0287, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -13.58% (0.0324 => 0.0280, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/casts: 2.26% (0.0177 => 0.0181, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -16.40% (0.0189 => 0.0158, std.dev.: 0.0018) SingleSource/UnitTests/Vector/multiplies: 0.80% (0.0249 => 0.0251, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -16.00% (0.0325 => 0.0273, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.35% (0.1429 => 0.1424, std.dev.: 0.0028) MultiSource/Applications/lemon/lemon: -7.20% (1.5019 => 1.3937, std.dev.: 0.0715) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.66% (0.1501 => 0.1556, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.97% (0.4264 => 0.4180, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.88% (0.1344 => 0.1423, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.64% (0.0589 => 0.0544, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -15.09% (0.0232 => 0.0197, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.35% (0.0639 => 0.0654, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.21% (1.1350 => 1.1326, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 350.00% (0.0006 => 0.0027, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -66.67% (0.0024 => 0.0008, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.09% (0.0637 => 0.0560, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.30% (0.0246 => 0.0169, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.38% (0.7541 => 0.7645, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.10% (1.5363 => 1.7069, std.dev.: 0.0019) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 45.71% (0.0070 => 0.0102, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 14:35:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 16:35:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121004213530.BFC5B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4575?compare_to=4571&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4575, Order: 165239, Start Time: 2012-10-04 20:12:00, End Time: 2012-10-04 21:37:12 To: 4571, Order: 165236, Start Time: 2012-10-04 18:17:44, End Time: 2012-10-04 19:42:56 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (5 on baseline) Performance Regressions: 2 (183 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 5 (0 on baseline) Unchanged Tests: 1035 (680 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.54% (7.9296 => 8.0519, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.04% (79.8160 => 80.6473, std.dev.: 0.3218) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.31% (33.5640 => 33.6664, std.dev.: 0.0145) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.00% (2.7522 => 2.7523, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (2.1153 => 2.1153, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.01% (4.9745 => 4.9748, std.dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 1.12% (33.2944 => 33.6664, std.dev.: 0.0145) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: -100.00% (7.3305 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.86% (2.0176 => 2.4587, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.45% (0.1410 => 0.1656, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: 16.22% (0.0826 => 0.0960, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.77% (0.0819 => 0.0940, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 14.58% (0.2243 => 0.2570, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.83% (0.0834 => 0.0941, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 12.73% (0.1013 => 0.1142, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 12.44% (0.5818 => 0.6542, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 12.19% (0.4062 => 0.4557, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 12.14% (0.5748 => 0.6446, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash2: 12.13% (0.4328 => 0.4853, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.10% (0.1413 => 0.1584, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 12.00% (1.3693 => 1.5336, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.83% (0.2721 => 0.3043, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 11.79% (0.2781 => 0.3109, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 11.58% (0.7061 => 0.7879, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.55% (0.3022 => 0.3371, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.51% (0.3580 => 0.3992, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.51% (3.9660 => 4.4224, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.48% (0.2596 => 0.2894, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.47% (0.2782 => 0.3101, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.46% (0.1588 => 0.1770, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.43% (0.7710 => 0.8591, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.28% (0.3899 => 0.4339, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 11.20% (0.2607 => 0.2899, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.19% (0.1072 => 0.1192, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 11.11% (1.9828 => 2.2030, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.10% (0.3485 => 0.3872, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 11.08% (0.2690 => 0.2988, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.00% (0.2655 => 0.2947, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 11.00% (0.2937 => 0.3260, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 10.98% (0.2760 => 0.3063, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 10.96% (0.2628 => 0.2916, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 10.93% (0.2726 => 0.3024, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.92% (0.3489 => 0.3870, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 10.91% (0.7038 => 0.7806, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.90% (0.5265 => 0.5839, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.90% (1.2193 => 1.3522, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.89% (0.9199 => 1.0201, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.89% (0.0964 => 0.1069, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.86% (0.2966 => 0.3288, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.85% (0.1327 => 0.1471, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 10.83% (0.2761 => 0.3060, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.78% (0.4016 => 0.4449, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists: 10.78% (0.3293 => 0.3648, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.78% (0.2765 => 0.3063, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.68% (0.2696 => 0.2984, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.65% (0.3756 => 0.4156, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.65% (0.6959 => 0.7700, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.64% (1.4563 => 1.6113, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 10.64% (0.3149 => 0.3484, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 10.59% (0.3107 => 0.3436, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 10.57% (0.3868 => 0.4277, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 10.55% (0.1062 => 0.1174, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.52% (0.6283 => 0.6944, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.39% (0.4390 => 0.4846, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 10.37% (0.3453 => 0.3811, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 10.34% (13.8202 => 15.2492, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/ary2: 10.34% (0.3192 => 0.3522, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.33% (0.1075 => 0.1186, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 10.31% (0.2988 => 0.3296, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.20% (1.1364 => 1.2523, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.19% (0.1276 => 0.1406, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.12% (0.1986 => 0.2187, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 10.07% (0.1003 => 0.1104, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 10.02% (0.3534 => 0.3888, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.59% (0.1157 => 0.1268, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.58% (0.3130 => 0.3430, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 9.54% (0.2945 => 0.3226, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.54% (0.5577 => 0.6109, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.52% (0.4379 => 0.4796, std.dev.: 0.0038) MultiSource/Applications/sgefa/sgefa: 9.52% (0.2995 => 0.3280, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.40% (0.2127 => 0.2327, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.37% (0.2914 => 0.3187, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/mst/mst: 9.27% (0.1111 => 0.1214, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.21% (0.5637 => 0.6156, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.20% (0.7460 => 0.8146, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 9.19% (1.0313 => 1.1261, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.18% (0.4791 => 0.5231, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 9.14% (1.1061 => 1.2072, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 9.13% (0.1589 => 0.1734, std.dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 9.12% (16.6129 => 18.1287, std.dev.: 0.0301) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.06% (7.2180 => 7.8722, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.06% (0.1865 => 0.2034, std.dev.: 0.0027) MultiSource/Applications/spiff/spiff: 9.01% (0.7506 => 0.8182, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.00% (0.3755 => 0.4093, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.00% (0.3246 => 0.3538, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.99% (0.1435 => 0.1564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.85% (0.8698 => 0.9468, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 8.85% (0.3220 => 0.3505, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.77% (0.6576 => 0.7153, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 8.75% (0.8310 => 0.9037, std.dev.: 0.0096) MultiSource/Applications/viterbi/viterbi: 8.66% (0.1478 => 0.1606, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.65% (0.2023 => 0.2198, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 8.65% (3.8646 => 4.1988, std.dev.: 0.0131) MultiSource/Applications/minisat/minisat: 8.62% (0.6744 => 0.7325, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 8.55% (3.1889 => 3.4615, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 8.38% (0.2925 => 0.3170, std.dev.: 0.0020) MultiSource/Applications/treecc/treecc: 8.30% (1.9270 => 2.0870, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.27% (0.1789 => 0.1937, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 8.27% (0.3578 => 0.3874, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 8.27% (0.1657 => 0.1794, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 8.24% (0.4003 => 0.4333, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.23% (0.3914 => 0.4236, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 8.20% (1.0594 => 1.1463, std.dev.: 0.0053) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.18% (0.2140 => 0.2315, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 8.12% (0.3646 => 0.3942, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.11% (0.3663 => 0.3960, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.10% (0.3789 => 0.4096, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.08% (3.6692 => 3.9658, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.08% (0.3650 => 0.3945, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.08% (0.3601 => 0.3892, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.97% (0.3940 => 0.4254, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.95% (0.3623 => 0.3911, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 7.92% (0.3131 => 0.3379, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.92% (0.3511 => 0.3789, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 7.84% (2.1791 => 2.3500, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.81% (0.1819 => 0.1961, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.78% (0.1569 => 0.1691, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 7.73% (14.8535 => 16.0021, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.73% (1.3245 => 1.4269, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.68% (4.3801 => 4.7163, std.dev.: 0.0113) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.67% (4.4433 => 4.7839, std.dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: 7.66% (1.2749 => 1.3726, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 7.65% (4.6629 => 5.0197, std.dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 7.61% (1.2292 => 1.3227, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 7.54% (8.4961 => 9.1367, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/05-eks/eks: 7.54% (0.4113 => 0.4423, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.45% (0.8818 => 0.9475, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 7.31% (0.6250 => 0.6707, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.20% (0.6135 => 0.6577, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.78% (4.9865 => 5.3245, std.dev.: 0.0113) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.74% (1.1333 => 1.2097, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.67% (0.2504 => 0.2671) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.58% (0.4805 => 0.5121, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.52% (3.2742 => 3.4878, std.dev.: 0.0132) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.47% (0.9108 => 0.9697, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.41% (1.5188 => 1.6161, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 6.36% (6.5754 => 6.9935, std.dev.: 0.0078) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.26% (6.2785 => 6.6716, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.22% (0.3245 => 0.3447, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.20% (0.2321 => 0.2465, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 6.13% (0.2008 => 0.2131, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 5.92% (3.7467 => 3.9686, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.57% (2.1007 => 2.2177, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.23% (13.2842 => 13.9783, std.dev.: 0.0130) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.77% (0.2243 => 0.2350, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 3.53% (16.2614 => 16.8361, std.dev.: 0.0050) MultiSource/Applications/ClamAV/clamscan: 3.35% (14.5298 => 15.0161, std.dev.: 0.0156) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.62% (0.4846 => 0.6960, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.48% (5.7573 => 7.5123, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: 24.07% (1.8175 => 2.2549, std.dev.: 0.0500) SingleSource/Benchmarks/Misc/richards_benchmark: 11.11% (1.1560 => 1.2844, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.02% (0.8273 => 0.9019, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4146, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.19% (1.2998 => 1.3803, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0042, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.88% (1.7081 => 1.7743, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.66% (11.2619 => 11.6740, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9857, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.34% (10.7476 => 11.1069, std.dev.: 0.0688) SingleSource/Regression/C/uint64_to_float: 2.97% (0.5449 => 0.5611, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.14% (7.4271 => 7.5864, std.dev.: 0.0058) MultiSource/Applications/lemon/lemon: 1.86% (1.4298 => 1.4564, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0507, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5126, std.dev.: 0.0077) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1875, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.21% (5.5130 => 5.5796, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0266, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5873, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.15% (0.2670 => 0.1411, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -15.28% (0.0707 => 0.0599, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.07% (0.4657 => 0.3955, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.71% (1.3813 => 1.1919, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.60% (1.3819 => 1.1939, std.dev.: 0.0047) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.83% (22.5627 => 21.6980, std.dev.: 0.0180) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.33% (1.0460 => 0.8543, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.44% (0.0997 => 0.0863, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -12.11% (0.2238 => 0.1967, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -11.42% (1.2308 => 1.0902, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.99% (20.3410 => 18.3089, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.68% (1.3780 => 1.2997, std.dev.: 0.0055) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5144, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.41% (0.9996 => 0.9555, std.dev.: 0.0023) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8001, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.43% (1.7688 => 1.7082, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -2.52% (26.5159 => 25.8474, std.dev.: 0.0205) MultiSource/Applications/spiff/spiff: -2.48% (3.0263 => 2.9512, std.dev.: 0.0014) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.29% (1.9762 => 1.9309, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.89% (6.3560 => 6.2358, std.dev.: 0.0083) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7152, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: -1.53% (4.5928 => 4.5225, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0073, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.30% (9.3358 => 9.2141, std.dev.: 0.0382) SingleSource/Benchmarks/Shootout/heapsort: -1.19% (3.9173 => 3.8706, std.dev.: 0.0064) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.17% (2.5254 => 2.4958, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2585, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 14:56:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 16:56:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121004215618.791EC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4576?compare_to=4572&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4576, Order: 165241, Start Time: 2012-10-04 20:38:28, End Time: 2012-10-04 21:57:58 To: 4572, Order: 165236, Start Time: 2012-10-04 18:49:49, End Time: 2012-10-04 20:09:18 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (156 on baseline) Performance Improvements: 1 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 950 (688 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.81% (14.9317 => 15.2026, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.45% (3.8059 => 3.8990, std.dev.: 0.0359) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.07% (3.6516 => 3.6124, std.dev.: 0.0007) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.05% (0.5867 => 0.5870, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 0.28% (16.1488 => 16.1946, std.dev.: 0.0116) MultiSource/Benchmarks/Bullet/bullet: 0.11% (53.7675 => 53.8275, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/gs/gs: -0.18% (4.3865 => 4.3786, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.64% (0.0468 => 0.0465, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.43% (0.0470 => 0.0468, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.46% (0.0437 => 0.0435, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.46% (0.0438 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.47% (0.0426 => 0.0424) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.70% (0.0427 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.48% (0.0419 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0420 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.46% (0.0437 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.91% (0.0440 => 0.0436, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.69% (0.0432 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.23% (0.0432 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.47% (0.0422 => 0.0420) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.47% (0.0423 => 0.0421) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.70% (0.0429 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.47% (0.0430 => 0.0428) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.45% (0.0440 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.23% (0.0441 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.72% (0.0417 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.72% (0.0418 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.47% (0.0428 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.47% (0.0429 => 0.0427, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.48% (0.0420 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.24% (0.0421 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.24% (0.0411 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.24% (0.0412 => 0.0411, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.49% (0.0411 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.49% (0.0412 => 0.0410) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.67% (0.0449 => 0.0446, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.44% (0.0450 => 0.0448, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.49% (0.0409 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.24% (0.0410 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.73% (0.0412 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.24% (0.0412 => 0.0411, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.24% (0.0418 => 0.0417, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.48% (0.0420 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.04% (1.2455 => 1.2460, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.42% (7.7154 => 7.7480, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.19% (0.7386 => 0.7400, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -1.92% (0.0365 => 0.0358, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -0.69% (0.1441 => 0.1431, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.14% (0.2138 => 0.2141, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -14.89% (63.2438 => 53.8275, std.dev.: 0.0049) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.39% (14.1553 => 18.7395, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++-EH/spirit: 60.16% (3.4629 => 5.5462, std.dev.: 0.0028) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14237.92% (0.0720 => 10.3233, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952400.00% (0.0001 => 9.9525, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 48.98% (0.2554 => 0.3805, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 46.64% (10.3673 => 15.2026, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/richards_benchmark: 32.12% (0.1622 => 0.2143, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/distray/distray: 30.97% (0.1056 => 0.1383, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.92% (2.2022 => 2.5307, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 14.80% (0.1432 => 0.1644, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.36% (7.0540 => 8.0673, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.18% (0.1566 => 0.1788, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.79% (1.7609 => 1.9861, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.35% (0.0834 => 0.0937, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.06% (0.0871 => 0.0976, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 12.01% (0.3473 => 0.3890, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/synchronized: 11.77% (0.3561 => 0.3980, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.74% (0.3543 => 0.3959, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.69% (0.3516 => 0.3927, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.69% (0.3543 => 0.3957, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 11.67% (0.3497 => 0.3905, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.45% (0.3694 => 0.4117, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 11.20% (0.3927 => 0.4367, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.18% (0.3828 => 0.4256, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 11.12% (0.3282 => 0.3647, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.01% (0.3886 => 0.4314, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.67% (0.1584 => 0.1753, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 10.40% (10.4361 => 11.5217, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: 9.86% (0.1440 => 0.1582, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.45% (0.4879 => 0.5340, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 9.40% (0.5925 => 0.6482, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.39% (0.1438 => 0.1573, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.32% (0.3177 => 0.3473, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.24% (0.6030 => 0.6587, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 8.91% (9.4845 => 10.3293, std.dev.: 0.0068) MultiSource/Applications/lambda-0_1_3/lambda: 8.88% (0.7433 => 0.8093, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 8.85% (0.3109 => 0.3384, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 8.82% (0.1655 => 0.1801, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.75% (0.6675 => 0.7259, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 8.73% (0.7115 => 0.7736, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 8.62% (0.3422 => 0.3717, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.56% (0.4615 => 0.5010, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.51% (0.2891 => 0.3137, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 8.42% (0.7326 => 0.7943, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/em3d/em3d: 8.38% (0.1695 => 0.1837, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.34% (1.5415 => 1.6701, std.dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 8.32% (5.7591 => 6.2383, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.30% (0.4636 => 0.5021, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.28% (0.2065 => 0.2236, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 8.26% (0.2905 => 0.3145, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 8.26% (0.3052 => 0.3304, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.25% (0.1625 => 0.1759, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/strcat: 8.23% (0.2831 => 0.3064, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.21% (0.4103 => 0.4440, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 8.21% (0.6456 => 0.6986, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/except: 8.19% (0.2871 => 0.3106, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 8.18% (0.3423 => 0.3703, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.09% (1.3050 => 1.4106, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.09% (0.4203 => 0.4543, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 8.07% (0.4289 => 0.4635, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.04% (0.8172 => 0.8829, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.02% (0.3865 => 0.4175, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.01% (0.2271 => 0.2453, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 8.00% (0.2725 => 0.2943, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.99% (0.5860 => 0.6328, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary: 7.98% (0.3232 => 0.3490, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.98% (0.2756 => 0.2976, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.97% (0.3650 => 0.3941, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.97% (0.3136 => 0.3386, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.97% (0.3162 => 0.3414, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 7.97% (0.3603 => 0.3890, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 7.95% (0.4048 => 0.4370, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.94% (4.2646 => 4.6032, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 7.89% (0.2714 => 0.2928, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.88% (2.0665 => 2.2294, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.88% (0.1510 => 0.1629, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.85% (0.1337 => 0.1442, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.85% (0.3121 => 0.3366, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.83% (8.1363 => 8.7733, std.dev.: 0.0043) MultiSource/Applications/d/make_dparser: 7.80% (3.3354 => 3.5957, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.80% (0.2872 => 0.3096, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 7.80% (0.3283 => 0.3539, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.78% (0.2107 => 0.2271, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 7.78% (0.2802 => 0.3020, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 7.78% (0.3098 => 0.3339, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.78% (0.2700 => 0.2910, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.78% (0.5105 => 0.5502, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.77% (0.4620 => 0.4979, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.77% (0.2793 => 0.3010, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.72% (0.2877 => 0.3099, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.67% (0.5569 => 0.5996, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 7.65% (0.3684 => 0.3966, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.65% (0.2758 => 0.2969, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.63% (0.3826 => 0.4118, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.59% (0.3307 => 0.3558, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.58% (1.5603 => 1.6786, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.54% (0.8067 => 0.8675, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.53% (0.9765 => 1.0500, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 7.52% (0.7835 => 0.8424, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary2: 7.49% (0.3379 => 0.3632, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.48% (4.9449 => 5.3149, std.dev.: 0.0131) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.45% (5.0018 => 5.3744, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.42% (0.1940 => 0.2084, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.25% (0.5020 => 0.5384, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.21% (1.1642 => 1.2481, std.dev.: 0.0075) MultiSource/Applications/viterbi/viterbi: 7.20% (0.1555 => 0.1667, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.15% (7.9617 => 8.5310, std.dev.: 0.0057) MultiSource/Benchmarks/sim/sim: 7.06% (0.3387 => 0.3626, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 6.88% (3.8723 => 4.1386, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: 6.64% (2.0273 => 2.1619, std.dev.: 0.0056) MultiSource/Applications/lemon/lemon: 6.54% (1.0722 => 1.1423, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.51% (0.3441 => 0.3665, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 6.44% (0.4299 => 0.4576, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 6.42% (0.3180 => 0.3384, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.39% (1.1861 => 1.2619, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.32% (0.4064 => 0.4321, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.30% (0.2603 => 0.2767, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.20% (1.5859 => 1.6842, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.15% (0.5981 => 0.6349, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.14% (0.6450 => 0.6846, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.08% (0.1892 => 0.2007, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 6.06% (21.9371 => 23.2671, std.dev.: 0.0589) MultiSource/Benchmarks/Prolangs-C/football/football: 5.94% (0.8921 => 0.9451, std.dev.: 0.0024) MultiSource/Applications/siod/siod: 5.89% (2.2969 => 2.4323, std.dev.: 0.0169) SingleSource/Benchmarks/Shootout-C++/objinst: 5.88% (0.3131 => 0.3315, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.72% (0.1906 => 0.2015, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 5.58% (1.2842 => 1.3559, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.31% (2.2024 => 2.3193, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.24% (1.4186 => 1.4929, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 5.14% (1.1840 => 1.2448, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.03% (0.2266 => 0.2380, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.47% (0.8101 => 0.8463, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.93% (0.3817 => 0.3967, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.40% (14.3668 => 14.8556, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.36% (0.3427 => 0.3542, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.86% (1.1194 => 1.1514, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.67% (3.8922 => 3.9961, std.dev.: 0.0056) MultiSource/Applications/sqlite3/sqlite3: 2.65% (17.1811 => 17.6360, std.dev.: 0.0068) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 10.16% (3.1595 => 3.4804, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 9.85% (1.1396 => 1.2518, std.dev.: 0.0015) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3690, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 3.66% (0.5413 => 0.5611, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.49% (3.6395 => 3.7664, std.dev.: 0.0065) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 3.20% (3.7781 => 3.8990, std.dev.: 0.0359) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.70% (4.2280 => 4.3421, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7651, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (0.8275 => 0.8405, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8131, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.38% (0.9540 => 0.9672, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.27% (2.6546 => 2.6882, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1293, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.04% (0.8651 => 0.1727, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.85% (5.2763 => 3.2790, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.92% (5.3855 => 3.6124, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.52% (5.3526 => 3.6119, std.dev.: 0.0046) SingleSource/UnitTests/Vector/constpool: -14.48% (54.1659 => 46.3208, std.dev.: 0.0222) MultiSource/Benchmarks/FreeBench/mason/mason: -13.19% (0.0811 => 0.0704, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -11.24% (22.1758 => 19.6822, std.dev.: 0.0144) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.50% (2.9384 => 2.6299, std.dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.40% (1.1492 => 0.7654, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -16.12% (1.6925 => 1.4197, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.83% (0.0998 => 0.0860, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.23% (1.2373 => 1.0983, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -10.28% (1.5373 => 1.3793, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/mason/mason: -10.09% (0.2161 => 0.1943, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.35% (19.9488 => 18.2837, std.dev.: 0.0620) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.71% (1.8329 => 1.7100, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std.dev.: 0.0024) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.31% (1.6805 => 1.5913, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-5: -5.05% (1.5835 => 1.5036, std.dev.: 0.0034) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.34% (0.9957 => 0.9525, std.dev.: 0.0135) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.72% (3.2827 => 3.1607, std.dev.: 0.0233) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5056, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: -2.98% (12.4730 => 12.1007, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.15% (8.1563 => 7.9813, std.dev.: 0.0223) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.92% (8.6802 => 8.5138, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/salsa20: -1.73% (10.2830 => 10.1051, std.dev.: 0.0142) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6819, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -1.53% (2.5528 => 2.5137, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4234, std.dev.: 0.0069) MultiSource/Applications/sqlite3/sqlite3: -1.39% (4.6441 => 4.5795, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.07% (6.2999 => 6.2324, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8595, std.dev.: 0.0029) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.26% (0.5229 => 0.5870, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 8.04% (14.9895 => 16.1946, std.dev.: 0.0116) MultiSource/Benchmarks/MallocBench/gs/gs: 6.52% (4.1105 => 4.3786, std.dev.: 0.0127) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.78% (1.1048 => 1.2460, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.24% (7.1582 => 7.7480, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.93% (0.6222 => 0.7400, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35700.00% (0.0001 => 0.0358, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.18% (0.2116 => 0.2141, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 15:15:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 17:15:02 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121004221502.61CEC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4577?compare_to=4574&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4577, Order: 165245, Start Time: 2012-10-04 20:52:56, End Time: 2012-10-04 22:16:45 To: 4574, Order: 165237, Start Time: 2012-10-04 19:12:33, End Time: 2012-10-04 20:36:41 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (14 on baseline) Performance Regressions: 10 (83 on baseline) Performance Improvements: 13 (44 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 954 (764 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.76% (0.7941 => 0.8081, std.dev.: 0.0043) MultiSource/Applications/oggenc/oggenc: 1.71% (4.9226 => 5.0070, std.dev.: 0.0073) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.13% (0.8906 => 0.9007, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.65% (42.0985 => 43.6346, std.dev.: 0.1948) SingleSource/Benchmarks/Misc/mandel-2: 2.13% (3.0325 => 3.0970, std.dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 1.85% (8.2659 => 8.4188, std.dev.: 0.0468) SingleSource/Benchmarks/Shootout/hash: 1.72% (4.2858 => 4.3594, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.33% (3.4799 => 3.5262, std.dev.: 0.0151) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.13% (2.8572 => 2.8894, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.05% (3.6410 => 3.6794, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -4.71% (0.4689 => 0.4468, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.64% (0.5908 => 0.5693, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.33% (0.8922 => 0.8714, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -2.15% (0.8734 => 0.8546, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -1.72% (1.6187 => 1.5908, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.70% (0.7515 => 0.7387, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.62% (0.8822 => 0.8679, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.50% (1.2214 => 1.2031, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.49% (1.1559 => 1.1387, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -11.30% (24.3017 => 21.5568, std.dev.: 0.7936) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -2.73% (2.4246 => 2.3585, std.dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/hash: -2.33% (0.6645 => 0.6490, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/except: -1.98% (0.5042 => 0.4942, std.dev.: 0.0028) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.40% (1.0015 => 1.0155, std.dev.: 0.0111) MultiSource/Applications/sqlite3/sqlite3: 0.16% (0.6186 => 0.6196, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/08-main/main: -1.97% (0.1823 => 0.1787, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.73% (0.1585 => 0.1510, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.86% (0.3120 => 0.3178, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.38% (0.2391 => 0.2358, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.63% (0.3196 => 0.3248, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.39% (0.2325 => 0.2334, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -15.07% (0.0458 => 0.0389, std.dev.: 0.0032) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -3.29% (0.0243 => 0.0235, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -13.85% (0.0195 => 0.0168, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.03% (0.0389 => 0.0393, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.38% (0.0252 => 0.0246, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.39% (0.0287 => 0.0291, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 5.36% (0.0280 => 0.0295, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/casts: 1.66% (0.0181 => 0.0184, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -25.32% (0.0158 => 0.0118, std.dev.: 0.0033) SingleSource/UnitTests/Vector/multiplies: -5.58% (0.0251 => 0.0237, std.dev.: 0.0009) SingleSource/UnitTests/byval-alignment: -1.10% (0.0273 => 0.0270, std.dev.: 0.0028) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.14% (0.1424 => 0.1422, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 9.73% (1.3937 => 1.5293, std.dev.: 0.0199) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -2.96% (0.1556 => 0.1510, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.58% (0.4180 => 0.4072, std.dev.: 0.0277) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.49% (0.1423 => 0.1416, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.33% (0.0544 => 0.0573, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -7.61% (0.0197 => 0.0182, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.01% (0.0654 => 0.0582, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.25% (1.1326 => 1.1298, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -48.15% (0.0027 => 0.0014, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -37.50% (0.0008 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.32% (0.0560 => 0.0547, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.73% (0.0169 => 0.0177, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.38% (0.7645 => 0.7674, std.dev.: 0.0161) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.02% (1.7069 => 1.7066, std.dev.: 0.0028) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 18.63% (0.0102 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 146.07% (0.0089 => 0.0219, std.dev.: 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: 174.44% (0.0090 => 0.0247, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -25.86% (4.1772 => 3.0970, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/except: 82266.67% (0.0006 => 0.4942, std.dev.: 0.0028) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: -50.00% (0.0006 => 0.0003, std.dev.: 0.0001) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: 200.00% (0.0001 => 0.0003, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.95% (0.0745 => 0.0916, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 9.40% (2.1763 => 2.3808, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.20% (0.6410 => 0.7000, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.77% (0.1414 => 0.1538, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.21% (0.3582 => 0.3876, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/bigfib: 7.69% (0.5309 => 0.5717, std.dev.: 0.0097) MultiSource/Applications/minisat/minisat: 7.61% (0.6173 => 0.6643, std.dev.: 0.0036) MultiSource/Applications/lemon/lemon: 6.94% (1.0046 => 1.0743, std.dev.: 0.0173) MultiSource/Applications/SIBsim4/SIBsim4: 6.87% (1.1653 => 1.2453, std.dev.: 0.0061) MultiSource/Applications/kimwitu++/kc: 6.84% (15.3105 => 16.3585, std.dev.: 0.1433) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.84% (0.6069 => 0.6484, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.70% (0.7639 => 0.8151, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.64% (0.2552 => 0.2696, std.dev.: 0.0024) MultiSource/Applications/d/make_dparser: 5.58% (3.0225 => 3.1912, std.dev.: 0.0216) MultiSource/Applications/oggenc/oggenc: 5.51% (4.7455 => 5.0070, std.dev.: 0.0073) MultiSource/Applications/lambda-0_1_3/lambda: 5.35% (0.6915 => 0.7285, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.29% (0.2797 => 0.2945, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.11% (0.8569 => 0.9007, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/oourafft: 5.07% (0.1971 => 0.2071, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.00% (1.5150 => 1.5908, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.99% (0.4248 => 0.4460, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.88% (0.4880 => 0.5118, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 4.80% (13.3238 => 13.9640, std.dev.: 0.1192) MultiSource/Benchmarks/McCat/18-imp/imp: 4.72% (0.3217 => 0.3369, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.61% (0.3901 => 0.4081, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.51% (0.3062 => 0.3200, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.45% (6.2546 => 6.5331, std.dev.: 0.0109) MultiSource/Benchmarks/Bullet/bullet: 4.34% (29.3170 => 30.5892, std.dev.: 0.1746) MultiSource/Benchmarks/mafft/pairlocalalign: 4.20% (8.2186 => 8.5640, std.dev.: 0.0292) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.09% (1.1827 => 1.2311, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.03% (1.2021 => 1.2506, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.96% (0.2654 => 0.2759, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.86% (1.4408 => 1.4964, std.dev.: 0.0214) MultiSource/Benchmarks/Olden/bh/bh: 3.83% (0.2820 => 0.2928, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 3.72% (0.2877 => 0.2984, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.68% (1.8798 => 1.9489, std.dev.: 0.0084) MultiSource/Applications/siod/siod: 3.61% (2.0972 => 2.1730, std.dev.: 0.0168) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.60% (0.2886 => 0.2990, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.34% (0.3418 => 0.3532, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 3.13% (1.0821 => 1.1160, std.dev.: 0.0024) MultiSource/Applications/lua/lua: 3.11% (3.5980 => 3.7100, std.dev.: 0.0221) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.08% (1.1672 => 1.2031, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash2: 3.04% (0.3847 => 0.3964, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.02% (4.2616 => 4.3904, std.dev.: 0.0216) MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (0.8405 => 0.8653, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.91% (0.5636 => 0.5800, std.dev.: 0.0037) MultiSource/Applications/JM/lencod/lencod: 2.88% (14.7256 => 15.1499, std.dev.: 0.1530) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.67% (1.0689 => 1.0974, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.44% (12.6413 => 12.9501, std.dev.: 0.0640) MultiSource/Applications/JM/ldecod/ldecod: 2.42% (6.4908 => 6.6476, std.dev.: 0.0290) MultiSource/Benchmarks/MallocBench/gs/gs: 2.37% (3.8796 => 3.9716, std.dev.: 0.0217) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.31% (8.2559 => 8.4466, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.23% (0.7226 => 0.7387, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.22% (4.3380 => 4.4343, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.63% (4.0318 => 4.0977, std.dev.: 0.0253) MultiSource/Applications/hexxagon/hexxagon: 1.23% (0.9425 => 0.9541, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 42.53% (0.0261 => 0.0372, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/pi: 41.64% (1.6538 => 2.3425, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2286, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/ary3: 14.99% (1.7426 => 2.0038, std.dev.: 0.0347) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.56% (4.0101 => 4.5537, std.dev.: 0.0150) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.70% (2.4042 => 2.7095, std.dev.: 0.0315) SingleSource/Benchmarks/McGill/queens: 11.15% (1.6261 => 1.8074, std.dev.: 0.0089) SingleSource/Benchmarks/Stanford/Puzzle: 11.10% (0.1433 => 0.1592, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.17% (0.2857 => 0.3119, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: 9.03% (7.0025 => 7.6348, std.dev.: 0.0110) MultiSource/Benchmarks/FreeBench/mason/mason: 8.41% (0.5004 => 0.5425, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 7.80% (40.4792 => 43.6346, std.dev.: 0.1948) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.58% (1.0063 => 1.0826, std.dev.: 0.0124) SingleSource/Benchmarks/Misc/fp-convert: 4.44% (15.2242 => 15.9000, std.dev.: 0.0215) SingleSource/Benchmarks/Misc/dt: 4.34% (0.9851 => 1.0279, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.87% (3.4080 => 3.5399, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 3.31% (6.9722 => 7.2027, std.dev.: 0.0817) MultiSource/Applications/siod/siod: 3.22% (3.5520 => 3.6665, std.dev.: 0.0219) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.06% (0.5587 => 0.5758, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 2.89% (0.6308 => 0.6490, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.83% (6.6312 => 6.8189, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.23% (0.5876 => 0.6007, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.20% (2.6656 => 2.7243, std.dev.: 0.0221) MultiSource/Benchmarks/Olden/power/power: 1.52% (1.4184 => 1.4399, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/hash: 1.34% (4.3016 => 4.3594, std.dev.: 0.0142) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.14% (2.4455 => 2.4733, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/em3d/em3d: 1.01% (4.6414 => 4.6883, std.dev.: 0.0095) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.84% (0.0591 => 0.0326, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -43.56% (0.2996 => 0.1691, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.66% (1.4189 => 1.1399, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.32% (1.4113 => 1.1387, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.29% (0.3497 => 0.2088, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.68% (5.2665 => 4.1245, std.dev.: 0.1074) SingleSource/Benchmarks/Shootout-C++/ary3: -19.77% (1.7473 => 1.4019, std.dev.: 0.0466) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -14.79% (1.7361 => 1.4794, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1600, std.dev.: 0.0115) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -10.93% (15.8312 => 14.1010, std.dev.: 0.3536) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.61% (1.1647 => 1.0528, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/flops: -8.42% (9.5474 => 8.7439, std.dev.: 0.0348) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.36% (3.2007 => 2.9331, std.dev.: 0.0636) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2864, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.90% (3.6254 => 3.3752, std.dev.: 0.0115) MultiSource/Applications/lambda-0_1_3/lambda: -6.71% (7.6833 => 7.1674, std.dev.: 0.0510) SingleSource/Benchmarks/Shootout-C++/fibo: -6.50% (4.6355 => 4.3344, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/richards_benchmark: -6.07% (1.4441 => 1.3565, std.dev.: 0.0146) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.96% (2.9728 => 2.7957, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: -5.73% (3.4230 => 3.2267, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.42% (3.9413 => 3.7278, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/fib2: -5.00% (4.4195 => 4.1987, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.80% (0.4564 => 0.4345, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -4.58% (2.5166 => 2.4013, std.dev.: 0.0192) MultiSource/Applications/sgefa/sgefa: -4.19% (0.3746 => 0.3589, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: -4.17% (62.4126 => 59.8095, std.dev.: 0.0825) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.79% (2.4457 => 2.3531, std.dev.: 0.0268) MultiSource/Benchmarks/FreeBench/distray/distray: -3.75% (0.2664 => 0.2564, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: -3.52% (9.2503 => 8.9244, std.dev.: 0.0342) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.84% (1.1683 => 1.1351, std.dev.: 0.0051) SingleSource/Benchmarks/Dhrystone/dry: -2.21% (2.4013 => 2.3482, std.dev.: 0.0019) MultiSource/Applications/aha/aha: -1.99% (3.4286 => 3.3605, std.dev.: 0.0067) MultiSource/Benchmarks/PAQ8p/paq8p: -1.88% (92.7467 => 91.0035, std.dev.: 0.3169) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.87% (3.7496 => 3.6794, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.86% (2.3569 => 2.3131, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: -1.84% (3.4876 => 3.4234, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: -1.81% (3.8907 => 3.8204, std.dev.: 0.0095) MultiSource/Benchmarks/FreeBench/neural/neural: -1.67% (1.0926 => 1.0744, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.66% (9.3855 => 9.2294, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.36% (27.1724 => 26.8021, std.dev.: 0.0131) MultiSource/Applications/JM/lencod/lencod: -1.35% (6.7458 => 6.6546, std.dev.: 0.0168) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.32% (25.6658 => 25.3278, std.dev.: 0.0520) SingleSource/Benchmarks/Dhrystone/fldry: -1.18% (2.4971 => 2.4676, std.dev.: 0.0017) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.75% (0.9980 => 1.0155, std.dev.: 0.0111) MultiSource/Applications/sqlite3/sqlite3: 2.89% (0.6022 => 0.6196, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/08-main/main: 7.26% (0.1666 => 0.1787, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.83% (0.1554 => 0.1510, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.08% (0.3083 => 0.3178, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.50% (0.2394 => 0.2358, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.30% (0.3175 => 0.3248, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.39% (0.2302 => 0.2334, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -13.36% (0.0449 => 0.0389, std.dev.: 0.0032) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -2.08% (0.0240 => 0.0235, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -12.50% (0.0192 => 0.0168, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.77% (0.0390 => 0.0393, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -18.27% (0.0301 => 0.0246, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.46% (0.0284 => 0.0291, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -8.95% (0.0324 => 0.0295, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/casts: 3.95% (0.0177 => 0.0184, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -37.57% (0.0189 => 0.0118, std.dev.: 0.0033) SingleSource/UnitTests/Vector/multiplies: -4.82% (0.0249 => 0.0237, std.dev.: 0.0009) SingleSource/UnitTests/byval-alignment: -16.92% (0.0325 => 0.0270, std.dev.: 0.0028) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.49% (0.1429 => 0.1422, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.82% (1.5019 => 1.5293, std.dev.: 0.0199) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.60% (0.1501 => 0.1510, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.50% (0.4264 => 0.4072, std.dev.: 0.0277) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.36% (0.1344 => 0.1416, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.72% (0.0589 => 0.0573, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -21.55% (0.0232 => 0.0182, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.92% (0.0639 => 0.0582, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.46% (1.1350 => 1.1298, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 133.33% (0.0006 => 0.0014, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.13% (0.0637 => 0.0547, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.05% (0.0246 => 0.0177, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.76% (0.7541 => 0.7674, std.dev.: 0.0161) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.09% (1.5363 => 1.7066, std.dev.: 0.0028) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 16:29:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 18:29:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121004232955.C65DE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4578?compare_to=4575&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4578, Order: 165253, Start Time: 2012-10-04 22:06:24, End Time: 2012-10-04 23:31:36 To: 4575, Order: 165239, Start Time: 2012-10-04 20:12:00, End Time: 2012-10-04 21:37:12 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (5 on baseline) Performance Regressions: 1 (183 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 5 (0 on baseline) Unchanged Tests: 1036 (679 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.12% (1.5336 => 1.5507, std.dev.: 0.0050) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.22% (33.6664 => 33.7404, std.dev.: 0.0191) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.00% (2.7523 => 2.7524, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.00% (2.1153 => 2.1154, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.00% (4.9748 => 4.9749, std.dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 1.34% (33.2944 => 33.7404, std.dev.: 0.0191) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: -100.00% (7.3305 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.15% (2.0176 => 2.4444, std.dev.: 0.0058) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.45% (0.1410 => 0.1656, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 15.74% (0.0826 => 0.0956, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 14.76% (0.2243 => 0.2574, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.43% (0.0819 => 0.0929) SingleSource/Benchmarks/Shootout-C++/hash2: 13.42% (0.4328 => 0.4909, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 13.40% (0.3022 => 0.3427, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 13.27% (0.2781 => 0.3150, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 13.25% (1.3693 => 1.5507, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/sumcol: 12.90% (0.2782 => 0.3141, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 12.80% (0.4062 => 0.4582, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.74% (0.1327 => 0.1496, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 12.71% (0.1062 => 0.1197, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.71% (0.0834 => 0.0940, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 12.70% (0.5818 => 0.6557, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.64% (0.3899 => 0.4392, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 12.49% (0.5748 => 0.6466, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 12.49% (0.2690 => 0.3026, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 12.47% (0.2607 => 0.2932, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 12.44% (0.2966 => 0.3335, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 12.44% (0.1013 => 0.1139, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.42% (0.3485 => 0.3918, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 12.42% (1.9828 => 2.2290, std.dev.: 0.0118) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.41% (0.1072 => 0.1205, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.40% (0.3580 => 0.4024, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 12.40% (0.2726 => 0.3064, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.39% (0.2655 => 0.2984, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 12.36% (0.2937 => 0.3300, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 12.29% (0.2628 => 0.2951, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 12.28% (0.2760 => 0.3099, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 12.21% (0.2761 => 0.3098, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 12.19% (0.3149 => 0.3533, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 12.15% (0.2765 => 0.3101, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 12.10% (0.3489 => 0.3911, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 12.06% (0.3293 => 0.3690, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/ary: 12.01% (0.3107 => 0.3480, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.98% (0.4016 => 0.4497, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.96% (0.1413 => 0.1582, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 11.94% (0.3868 => 0.4330, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 11.94% (0.2696 => 0.3018, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 11.90% (0.7061 => 0.7901, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.87% (0.3756 => 0.4202, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 11.81% (0.3192 => 0.3569, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 11.73% (0.3453 => 0.3858, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 11.61% (0.7038 => 0.7855, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 11.51% (0.2988 => 0.3332, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.46% (0.4390 => 0.4893, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.45% (3.9660 => 4.4203, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/lists1: 11.43% (0.3534 => 0.3938, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.32% (0.2721 => 0.3029, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.17% (0.2596 => 0.2886, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.17% (0.7710 => 0.8571, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.10% (0.0964 => 0.1071, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.96% (0.1588 => 0.1762, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 10.93% (0.2945 => 0.3267, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.87% (0.9199 => 1.0199, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.83% (0.5265 => 0.5835, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.82% (1.4563 => 1.6139, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.73% (1.2193 => 1.3501, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.63% (0.6283 => 0.6951, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.49% (0.6959 => 0.7689, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.33% (0.1075 => 0.1186, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 10.32% (13.8202 => 15.2461, std.dev.: 0.0143) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.25% (1.1364 => 1.2529, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 10.17% (0.1003 => 0.1105, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.01% (0.3755 => 0.4131, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.97% (0.1986 => 0.2184, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.87% (0.1276 => 0.1402, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.61% (0.8698 => 0.9534, std.dev.: 0.0149) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.59% (0.1157 => 0.1268, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 9.59% (16.6129 => 18.2053, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.58% (0.5577 => 0.6111, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.57% (0.2914 => 0.3193, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.55% (0.3130 => 0.3429, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.55% (0.4379 => 0.4797, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.35% (0.4791 => 0.5239, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 9.35% (0.2995 => 0.3275, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 9.28% (1.0313 => 1.1270, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 9.20% (1.1061 => 1.2079, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/mst/mst: 9.18% (0.1111 => 0.1213, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.17% (0.2127 => 0.2322, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.12% (0.5637 => 0.6151, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 9.00% (0.1589 => 0.1732, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.99% (0.7460 => 0.8131, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.93% (7.2180 => 7.8629, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.93% (0.3246 => 0.3536, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 8.85% (0.3220 => 0.3505, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 8.82% (3.8646 => 4.2056, std.dev.: 0.0077) MultiSource/Applications/minisat/minisat: 8.81% (0.6744 => 0.7338, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.78% (0.1435 => 0.1561, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 8.78% (0.7506 => 0.8165, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.63% (0.1865 => 0.2026, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 8.63% (1.2292 => 1.3353, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 8.57% (0.8310 => 0.9022, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.55% (0.2023 => 0.2196, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 8.53% (0.1478 => 0.1604, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 8.44% (3.1889 => 3.4582, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 8.43% (1.0594 => 1.1487, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 8.41% (0.2925 => 0.3171, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 8.38% (0.3578 => 0.3878, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 8.32% (1.9270 => 2.0873, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 8.27% (0.4003 => 0.4334, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 8.27% (0.1657 => 0.1794, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 8.22% (0.6250 => 0.6764, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.17% (0.6576 => 0.7113, std.dev.: 0.0026) MultiSource/Applications/siod/siod: 8.14% (2.1791 => 2.3564, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/exceptions: 8.10% (0.3914 => 0.4231, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 8.08% (0.3601 => 0.3892, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 8.08% (0.3663 => 0.3959, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.08% (0.3789 => 0.4095, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.06% (0.3646 => 0.3940, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.05% (0.1789 => 0.1933, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.03% (0.3650 => 0.3943, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.99% (3.6692 => 3.9624, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.97% (0.1569 => 0.1694, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.94% (0.3940 => 0.4253, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 7.92% (0.3623 => 0.3910, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.81% (1.3245 => 1.4279, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.80% (0.2140 => 0.2307, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 7.76% (0.3131 => 0.3374, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.62% (4.3801 => 4.7138, std.dev.: 0.0056) MultiSource/Applications/JM/lencod/lencod: 7.61% (14.8535 => 15.9836, std.dev.: 0.0058) MultiSource/Applications/SIBsim4/SIBsim4: 7.59% (1.2749 => 1.3717, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.58% (4.4433 => 4.7802, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/05-eks/eks: 7.46% (0.4113 => 0.4420, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 7.44% (4.6629 => 5.0098, std.dev.: 0.0057) MultiSource/Benchmarks/mafft/pairlocalalign: 7.43% (8.4961 => 9.1273, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.35% (4.9865 => 5.3528, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.30% (0.6135 => 0.6583, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.15% (0.1819 => 0.1949, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.11% (0.8818 => 0.9445, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.95% (0.3511 => 0.3755, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.75% (0.3245 => 0.3464, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.64% (1.1333 => 1.2086, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.64% (0.4805 => 0.5124, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.59% (0.2504 => 0.2669, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.52% (0.9108 => 0.9702, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.43% (1.5188 => 1.6165, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.40% (3.2742 => 3.4836, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.25% (6.2785 => 6.6709, std.dev.: 0.0114) MultiSource/Applications/JM/ldecod/ldecod: 6.24% (6.5754 => 6.9856, std.dev.: 0.0132) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.20% (0.2321 => 0.2465, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 5.98% (0.2008 => 0.2128, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 5.90% (3.7467 => 3.9679, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.64% (2.1007 => 2.2191, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.21% (13.2842 => 13.9760, std.dev.: 0.0097) MultiSource/Applications/sqlite3/sqlite3: 3.49% (16.2614 => 16.8295, std.dev.: 0.0066) MultiSource/Applications/ClamAV/clamscan: 3.37% (14.5298 => 15.0191, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5175, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.62% (1.8175 => 2.2650, std.dev.: 0.0184) SingleSource/Benchmarks/Misc/richards_benchmark: 11.21% (1.1560 => 1.2856, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.62% (3.1736 => 3.4153, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.27% (1.2998 => 1.3813, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9998, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0046, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6758, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-6: 3.50% (1.9199 => 1.9871, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 3.27% (10.7476 => 11.0992, std.dev.: 0.0181) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.19% (7.4271 => 7.5896, std.dev.: 0.0030) MultiSource/Applications/lemon/lemon: 1.82% (1.4298 => 1.4558, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5128, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9695, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2126, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1885, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5779, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0274, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5876, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.02% (3.6469 => 3.6842, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.30% (0.2670 => 0.1407, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -15.56% (0.0707 => 0.0597, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.10% (0.4657 => 0.3954, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.79% (1.3819 => 1.1914, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.76% (1.3813 => 1.1913, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.64% (22.5627 => 21.7410, std.dev.: 0.0216) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.93% (0.2238 => 0.1971, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.91% (1.2308 => 1.0965, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.11% (20.3410 => 18.2852, std.dev.: 0.0104) SingleSource/Benchmarks/Misc/flops-3: -6.28% (2.4152 => 2.2636, std.dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.24% (1.3780 => 1.3058, std.dev.: 0.0038) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5148, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.71% (0.9996 => 0.9525, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8005, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.54% (3.2729 => 3.1571, std.dev.: 0.0254) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.35% (1.7688 => 1.7096, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.12% (0.4867 => 0.4715, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.51% (3.0263 => 2.9504, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -2.49% (26.5159 => 25.8550, std.dev.: 0.0059) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.35% (1.9762 => 1.9297, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.87% (0.6589 => 0.6466, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7154, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/lists: -1.78% (6.3560 => 6.2428, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.59% (0.6615 => 0.6510, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: -1.54% (4.5928 => 4.5219, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0067, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8626, std.dev.: 0.0054) MultiSource/Applications/minisat/minisat: -1.21% (9.3358 => 9.2230, std.dev.: 0.0393) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4954, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2567, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 16:45:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 18:45:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121004234508.1763D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4579?compare_to=4576&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4579, Order: 165259, Start Time: 2012-10-04 22:27:23, End Time: 2012-10-04 23:46:49 To: 4576, Order: 165241, Start Time: 2012-10-04 20:38:28, End Time: 2012-10-04 21:57:58 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (152 on baseline) Performance Improvements: 1 (44 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 951 (691 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.64% (2.5307 => 2.5723, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -6.12% (15.2026 => 14.2715, std.dev.: 0.0180) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.55% (0.5870 => 0.5838, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: -0.43% (16.1946 => 16.1256, std.dev.: 0.0065) MultiSource/Benchmarks/Bullet/bullet: 1.60% (53.8275 => 54.6893, std.dev.: 0.0185) MultiSource/Benchmarks/MallocBench/gs/gs: -0.34% (4.3786 => 4.3635, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.22% (0.0465 => 0.0464) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.64% (0.0468 => 0.0465, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.46% (0.0435 => 0.0433) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.46% (0.0436 => 0.0434, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.24% (0.0424 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.24% (0.0424 => 0.0423, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.48% (0.0417 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.71% (0.0420 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.23% (0.0435 => 0.0434, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.46% (0.0436 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.47% (0.0429 => 0.0427, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.70% (0.0431 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.48% (0.0420 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.48% (0.0421 => 0.0419) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.23% (0.0426 => 0.0425) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.47% (0.0428 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.46% (0.0438 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.45% (0.0440 => 0.0438, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.48% (0.0414 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.48% (0.0415 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.23% (0.0426 => 0.0425) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.47% (0.0427 => 0.0425, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.48% (0.0418 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.71% (0.0420 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.49% (0.0410 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.49% (0.0411 => 0.0409) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.24% (0.0409 => 0.0408, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.49% (0.0410 => 0.0408) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.45% (0.0446 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.67% (0.0448 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.25% (0.0407 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.49% (0.0409 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.24% (0.0409 => 0.0408) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.49% (0.0411 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.48% (0.0417 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.48% (0.0418 => 0.0416, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.27% (1.2460 => 1.2426, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.32% (7.7480 => 7.7229, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.22% (0.7400 => 0.7384, std.dev.: 0.0035) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.28% (0.0358 => 0.0359, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 0.14% (0.1431 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.05% (0.2141 => 0.2140, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -13.53% (63.2438 => 54.6893, std.dev.: 0.0185) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.03% (14.1553 => 18.6894, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: 60.35% (3.4629 => 5.5526, std.dev.: 0.0122) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14229.03% (0.0720 => 10.3169, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9951600.00% (0.0001 => 9.9517, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 48.04% (0.2554 => 0.3781, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 37.66% (10.3673 => 14.2715, std.dev.: 0.0180) MultiSource/Benchmarks/FreeBench/distray/distray: 30.78% (0.1056 => 0.1381, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 29.96% (0.1622 => 0.2108, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.81% (2.2022 => 2.5723, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.11% (7.0540 => 8.1199, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/flops: 14.46% (0.1432 => 0.1639, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.18% (0.1566 => 0.1788, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 12.49% (0.3282 => 0.3692, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.40% (1.7609 => 1.9793, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.83% (0.0871 => 0.0974, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.17% (0.1584 => 0.1761, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.09% (0.3543 => 0.3936, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.09% (0.3473 => 0.3858, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.87% (0.3543 => 0.3928, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 10.87% (0.3497 => 0.3877, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.81% (0.3561 => 0.3946, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.78% (0.3516 => 0.3895, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 10.70% (10.4361 => 11.5532, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/for-in: 10.58% (0.3694 => 0.4085, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.57% (0.3927 => 0.4342, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.48% (0.3828 => 0.4229, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.32% (0.3886 => 0.4287, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 9.79% (0.1440 => 0.1581, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.40% (0.5925 => 0.6482, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.24% (0.4879 => 0.5330, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 9.22% (0.6030 => 0.6586, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.04% (0.1438 => 0.1568, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.03% (0.3177 => 0.3464, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 8.94% (0.1655 => 0.1803, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.85% (0.7326 => 0.7974, std.dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: 8.77% (9.4845 => 10.3159, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.75% (0.6675 => 0.7259, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 8.57% (0.7433 => 0.8070, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 8.56% (0.7115 => 0.7724, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 8.56% (0.3109 => 0.3375, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 8.35% (5.7591 => 6.2397, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.32% (0.4615 => 0.4999, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.30% (0.3121 => 0.3380, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.12% (0.1625 => 0.1757, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 8.08% (0.1695 => 0.1832, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 7.95% (0.3423 => 0.3695, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.86% (1.5415 => 1.6626, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.85% (0.1337 => 0.1442, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.82% (0.5105 => 0.5504, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.81% (0.2700 => 0.2911, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.79% (1.3050 => 1.4066, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists: 7.77% (0.3422 => 0.3688, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 7.71% (3.3354 => 3.5925, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.70% (0.4103 => 0.4419, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.68% (0.1510 => 0.1626, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.67% (0.4289 => 0.4618, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.66% (0.2271 => 0.2445, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.66% (0.4636 => 0.4991, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 7.57% (0.2905 => 0.3125, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 7.51% (0.6456 => 0.6941, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.51% (0.5860 => 0.6300, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.51% (0.2065 => 0.2220, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.51% (0.2891 => 0.3108, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.49% (5.0018 => 5.3763, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.49% (0.8067 => 0.8671, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.46% (4.9449 => 5.3137, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.43% (0.8172 => 0.8779, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.41% (4.2646 => 4.5805, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.39% (8.1363 => 8.7374, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.38% (0.3307 => 0.3551, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.37% (0.9765 => 1.0485, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.35% (2.0665 => 2.2184, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 7.35% (0.2831 => 0.3039, std.dev.: 0.0038) MultiSource/Applications/hbd/hbd: 7.34% (1.5603 => 1.6749, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.29% (0.3650 => 0.3916, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.27% (0.3865 => 0.4146, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.26% (0.2107 => 0.2260, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 7.23% (0.2725 => 0.2922, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.22% (0.2758 => 0.2957, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.21% (0.2872 => 0.3079, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 7.19% (0.4048 => 0.4339, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.18% (0.3232 => 0.3464, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.18% (0.2871 => 0.3077, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.17% (0.5020 => 0.5380, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.14% (0.3136 => 0.3360, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 7.14% (0.3684 => 0.3947, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.13% (0.5569 => 0.5966, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.11% (0.2756 => 0.2952, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.08% (0.3826 => 0.4097, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.05% (0.3162 => 0.3385, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 7.05% (0.3603 => 0.3857, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.01% (0.1940 => 0.2076, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 7.00% (0.3098 => 0.3315, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.95% (0.3052 => 0.3264, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 6.93% (0.7835 => 0.8378, std.dev.: 0.0069) MultiSource/Benchmarks/sim/sim: 6.88% (0.3387 => 0.3620, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.86% (0.4620 => 0.4937, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.85% (0.3283 => 0.3508, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.81% (7.9617 => 8.5041, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 6.79% (1.1642 => 1.2433, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.78% (0.2802 => 0.2992, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.78% (0.2877 => 0.3072, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.74% (0.2714 => 0.2897, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.70% (0.2793 => 0.2980, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 6.69% (0.1555 => 0.1659, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 6.64% (3.8723 => 4.1295, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.53% (0.2603 => 0.2773, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 6.35% (0.4299 => 0.4572, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 6.34% (1.0722 => 1.1402, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.30% (0.3379 => 0.3592, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 6.13% (0.3180 => 0.3375, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 6.11% (2.0273 => 2.1511, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.07% (0.3441 => 0.3650, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.99% (1.1861 => 1.2572, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.99% (1.5859 => 1.6809, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 5.87% (21.9371 => 23.2245, std.dev.: 0.0148) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.78% (0.6450 => 0.6823, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 5.76% (0.8921 => 0.9435, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.73% (0.5981 => 0.6324, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 5.57% (2.2969 => 2.4248, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.54% (0.4064 => 0.4289, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.34% (0.1892 => 0.1993, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.30% (0.1906 => 0.2007, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.20% (2.2024 => 2.3170, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.11% (0.3131 => 0.3291, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.94% (1.2842 => 1.3477, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.94% (1.4186 => 1.4887, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.92% (1.1840 => 1.2422, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.63% (0.2266 => 0.2371, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.04% (0.8101 => 0.8428, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.35% (0.3817 => 0.3945, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.06% (1.1194 => 1.1537, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.94% (14.3668 => 14.7899, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: 2.60% (17.1811 => 17.6279, std.dev.: 0.0198) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.47% (3.8922 => 3.9883, std.dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 10.19% (3.1595 => 3.4813, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 9.88% (1.1396 => 1.2522, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3681, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.45% (3.6395 => 3.7652, std.dev.: 0.0050) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.85% (4.2280 => 4.3486, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8123, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.24% (2.6546 => 2.6875, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1289, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.14% (0.8651 => 0.1718, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.87% (5.2763 => 3.2783, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.37% (5.3855 => 3.6423, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.91% (5.3526 => 3.6444, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -14.45% (54.1659 => 46.3382, std.dev.: 0.0221) MultiSource/Benchmarks/FreeBench/mason/mason: -13.56% (0.0811 => 0.0701, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -11.48% (22.1758 => 19.6307, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.14% (2.9384 => 2.6403, std.dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -16.18% (1.6925 => 1.4186, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.83% (0.0998 => 0.0860, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.27% (1.2373 => 1.0979, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -10.28% (1.5373 => 1.3792, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/mason/mason: -9.86% (0.2161 => 0.1948, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.20% (19.9488 => 18.3131, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.78% (1.8329 => 1.7086, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.58% (1.9577 => 1.8484, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.33% (1.6805 => 1.5910, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: -4.95% (1.5835 => 1.5051, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.76% (0.9957 => 0.9583, std.dev.: 0.0100) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3170, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.69% (3.2827 => 3.1615, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4976, std.dev.: 0.0071) MultiSource/Applications/hexxagon/hexxagon: -2.99% (12.4730 => 12.1003, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.50% (0.4808 => 0.4688, std.dev.: 0.0018) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.13% (8.1563 => 7.9825, std.dev.: 0.0248) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.00% (8.6802 => 8.5068, std.dev.: 0.0136) SingleSource/Benchmarks/Misc/salsa20: -1.89% (10.2830 => 10.0884, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6809, std.dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -1.54% (2.5528 => 2.5135, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4208, std.dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: -1.37% (4.6441 => 4.5805, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8561, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -1.04% (6.2999 => 6.2341, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 11.65% (0.5229 => 0.5838, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 7.58% (14.9895 => 16.1256, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/gs/gs: 6.15% (4.1105 => 4.3635, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.47% (1.1048 => 1.2426, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.89% (7.1582 => 7.7229, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.68% (0.6222 => 0.7384, std.dev.: 0.0035) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35800.00% (0.0001 => 0.0359, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.13% (0.2116 => 0.2140, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 16:55:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 18:55:50 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121004235550.1DA922A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4580?compare_to=4577&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4580, Order: 165259, Start Time: 2012-10-04 22:33:44, End Time: 2012-10-04 23:57:34 To: 4577, Order: 165245, Start Time: 2012-10-04 20:52:56, End Time: 2012-10-04 22:16:45 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (14 on baseline) Performance Regressions: 13 (88 on baseline) Performance Improvements: 5 (44 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 959 (759 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.23% (0.4468 => 0.4657, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.96% (0.3154 => 0.3279, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.63% (0.5552 => 0.5698, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.51% (1.2924 => 1.3249, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.35% (0.5693 => 0.5827, std.dev.: 0.0021) MultiSource/Applications/minisat/minisat: 1.82% (0.6643 => 0.6764, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.60% (1.5908 => 1.6163, std.dev.: 0.0066) MultiSource/Applications/spiff/spiff: 1.55% (0.7683 => 0.7802, std.dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: 1.48% (1.1160 => 1.1325, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.0974 => 1.1089, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.00% (0.3284 => 0.3514, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.76% (2.3585 => 2.4471, std.dev.: 0.0072) MultiSource/Applications/SIBsim4/SIBsim4: 1.03% (3.2267 => 3.2599, std.dev.: 0.0089) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -2.62% (0.8346 => 0.8127, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -1.71% (0.8311 => 0.8169, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -1.62% (0.8191 => 0.8058, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.25% (0.8981 => 0.8869, std.dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.74% (3.6794 => 3.6155, std.dev.: 0.0152) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.41% (1.0155 => 1.0113, std.dev.: 0.0117) MultiSource/Applications/sqlite3/sqlite3: 1.37% (0.6196 => 0.6281, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/08-main/main: -1.34% (0.1787 => 0.1763, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.36% (0.1510 => 0.1591, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.88% (0.3178 => 0.3206, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.80% (0.2358 => 0.2424, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.37% (0.3248 => 0.3236, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.13% (0.2334 => 0.2331, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: 19.54% (0.0389 => 0.0465, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.55% (0.0235 => 0.0241, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 14.88% (0.0168 => 0.0193, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -7.63% (0.0393 => 0.0363, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 23.98% (0.0246 => 0.0305, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.03% (0.0291 => 0.0288, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 8.14% (0.0295 => 0.0319, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0184 => 0.0184, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 66.95% (0.0118 => 0.0197, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: 7.59% (0.0237 => 0.0255, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -1.85% (0.0270 => 0.0265, std.dev.: 0.0028) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1422 => 0.1421, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: -3.61% (1.5293 => 1.4741, std.dev.: 0.0280) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.60% (0.1510 => 0.1501, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.43% (0.4072 => 0.4293, std.dev.: 0.0184) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.77% (0.1416 => 0.1441, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.70% (0.0573 => 0.0569, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 10.44% (0.0182 => 0.0201, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.30% (0.0582 => 0.0607, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.01% (1.1298 => 1.1297, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -7.14% (0.0014 => 0.0013, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.37% (0.0547 => 0.0545, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.65% (0.0177 => 0.0187, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.27% (0.7674 => 0.7653, std.dev.: 0.0122) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: -0.01% (1.7066 => 1.7064, std.dev.: 0.0025) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 142.70% (0.0089 => 0.0216, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: 174.44% (0.0090 => 0.0247, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -27.48% (4.1772 => 3.0295, std.dev.: 0.0460) SingleSource/Benchmarks/Shootout-C++/except: 81733.33% (0.0006 => 0.4910, std.dev.: 0.0064) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_throw: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.95% (0.0745 => 0.0916, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.62% (0.1414 => 0.1550, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 9.57% (0.6173 => 0.6764, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.33% (0.6410 => 0.7008, std.dev.: 0.0040) MultiSource/Benchmarks/PAQ8p/paq8p: 9.13% (2.1763 => 2.3750, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.97% (0.1159 => 0.1263, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 8.85% (0.5309 => 0.5779, std.dev.: 0.0040) MultiSource/Applications/lemon/lemon: 8.19% (1.0046 => 1.0869, std.dev.: 0.0104) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.18% (0.3582 => 0.3875, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 8.06% (1.1653 => 1.2592, std.dev.: 0.0148) MultiSource/Applications/kimwitu++/kc: 7.01% (15.3105 => 16.3832, std.dev.: 0.1028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.69% (1.5150 => 1.6163, std.dev.: 0.0066) MultiSource/Applications/lambda-0_1_3/lambda: 6.58% (0.6915 => 0.7370, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.46% (0.3901 => 0.4153, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/18-imp/imp: 6.28% (0.3217 => 0.3419, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.27% (0.2552 => 0.2712, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.24% (0.7639 => 0.8116, std.dev.: 0.0025) MultiSource/Applications/d/make_dparser: 6.06% (3.0225 => 3.2057, std.dev.: 0.0257) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.72% (0.2797 => 0.2957, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 5.48% (0.1971 => 0.2079, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.45% (0.6069 => 0.6400, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.39% (0.4248 => 0.4477, std.dev.: 0.0071) MultiSource/Applications/SPASS/SPASS: 5.38% (13.3238 => 14.0406, std.dev.: 0.1293) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.99% (0.8569 => 0.8997, std.dev.: 0.0139) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.87% (6.2546 => 6.5592, std.dev.: 0.0563) MultiSource/Applications/oggenc/oggenc: 4.84% (4.7455 => 4.9751, std.dev.: 0.0500) MultiSource/Applications/Burg/burg: 4.76% (1.1440 => 1.1984, std.dev.: 0.0109) MultiSource/Applications/siod/siod: 4.75% (2.0972 => 2.1969, std.dev.: 0.0246) MultiSource/Benchmarks/nbench/nbench: 4.66% (1.0821 => 1.1325, std.dev.: 0.0059) MultiSource/Applications/sgefa/sgefa: 4.45% (0.2877 => 0.3005, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.45% (0.4880 => 0.5097, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.44% (1.4408 => 1.5048, std.dev.: 0.0097) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.44% (1.1672 => 1.2190, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/football/football: 4.39% (0.8405 => 0.8774, std.dev.: 0.0052) MultiSource/Benchmarks/sim/sim: 4.35% (0.3084 => 0.3218, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 4.29% (14.7256 => 15.3578, std.dev.: 0.1303) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.23% (1.2021 => 1.2529, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.22% (1.1827 => 1.2326, std.dev.: 0.0103) MultiSource/Benchmarks/mafft/pairlocalalign: 4.16% (8.2186 => 8.5604, std.dev.: 0.0566) MultiSource/Benchmarks/Bullet/bullet: 4.06% (29.3170 => 30.5083, std.dev.: 0.1850) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.05% (0.3062 => 0.3186, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: 4.01% (0.2820 => 0.2933, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.00% (0.7226 => 0.7515, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.98% (1.2742 => 1.3249, std.dev.: 0.0123) MultiSource/Applications/lua/lua: 3.84% (3.5980 => 3.7363, std.dev.: 0.0147) MultiSource/Applications/JM/ldecod/ldecod: 3.76% (6.4908 => 6.7351, std.dev.: 0.0758) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.74% (1.0689 => 1.1089, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.70% (3.0758 => 3.1896, std.dev.: 0.0306) MultiSource/Applications/hbd/hbd: 3.27% (1.3268 => 1.3702, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.22% (0.5520 => 0.5698, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.22% (0.3418 => 0.3528, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.17% (12.6413 => 13.0416, std.dev.: 0.1135) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.92% (4.0318 => 4.1495, std.dev.: 0.0291) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.92% (0.4562 => 0.4695, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.88% (4.3380 => 4.4631, std.dev.: 0.0334) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.66% (0.5937 => 0.6095, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.24% (8.2559 => 8.4405, std.dev.: 0.0594) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.08% (4.2815 => 4.3704, std.dev.: 0.0229) MultiSource/Applications/hexxagon/hexxagon: 1.85% (0.9425 => 0.9599, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.31% (1.3935 => 1.4118, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.16% (0.9029 => 0.9134, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 50.96% (0.0261 => 0.0394, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/pi: 41.40% (1.6538 => 2.3384, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 22.10% (3.4629 => 4.2281, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/ary3: 14.63% (1.7426 => 1.9975, std.dev.: 0.0365) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.63% (4.0101 => 4.5966, std.dev.: 0.0745) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.72% (2.4042 => 2.7101, std.dev.: 0.0371) SingleSource/Benchmarks/McGill/queens: 11.06% (1.6261 => 1.8060, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: 9.61% (0.5004 => 0.5485, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.07% (0.2857 => 0.3116, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/Puzzle: 8.44% (0.1433 => 0.1554, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/lists: 8.40% (7.0025 => 7.5905, std.dev.: 0.0302) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.21% (1.0063 => 1.0789, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.45% (0.3301 => 0.3514, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.51% (40.4792 => 42.7088, std.dev.: 0.5058) SingleSource/Benchmarks/Misc/dt: 4.23% (0.9851 => 1.0268, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.84% (3.4080 => 3.5389, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.78% (2.3580 => 2.4471, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.69% (0.5876 => 0.6093, std.dev.: 0.0021) MultiSource/Applications/siod/siod: 3.41% (3.5520 => 3.6732, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.24% (0.5587 => 0.5768, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 3.06% (6.9722 => 7.1855, std.dev.: 0.0566) MultiSource/Benchmarks/Olden/health/health: 3.01% (0.3420 => 0.3523, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.91% (2.6656 => 2.7431, std.dev.: 0.0291) SingleSource/Benchmarks/Misc/fp-convert: 2.87% (15.2242 => 15.6604, std.dev.: 0.1351) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.86% (6.6312 => 6.8207, std.dev.: 0.0179) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.30% (4.6127 => 4.7189, std.dev.: 0.0352) MultiSource/Benchmarks/Olden/power/power: 1.49% (1.4184 => 1.4395, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.16% (0.0591 => 0.0330, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -43.69% (0.2996 => 0.1687, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.66% (1.4113 => 1.1479, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.66% (1.4189 => 1.1542, std.dev.: 0.0228) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.89% (0.3497 => 0.2067, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.07% (5.2665 => 4.1568, std.dev.: 0.2285) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.90% (15.8312 => 13.3140, std.dev.: 0.6846) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.40% (1.7361 => 1.4688, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1597, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.60% (1.1647 => 1.0529, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.79% (1.4034 => 1.2801, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/flops: -8.32% (9.5474 => 8.7526, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.85% (3.6254 => 3.3771, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/fibo: -6.64% (4.6355 => 4.3275, std.dev.: 0.0043) MultiSource/Applications/lambda-0_1_3/lambda: -6.60% (7.6833 => 7.1759, std.dev.: 0.0339) SingleSource/Benchmarks/Misc/richards_benchmark: -6.34% (1.4441 => 1.3526, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -6.31% (3.2007 => 2.9988, std.dev.: 0.0261) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.02% (2.9728 => 2.7939, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.45% (3.9413 => 3.7265, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout/fib2: -5.33% (4.4195 => 4.1839, std.dev.: 0.0063) MultiSource/Applications/sgefa/sgefa: -4.81% (0.3746 => 0.3566, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.78% (0.4564 => 0.4346, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: -4.76% (3.4230 => 3.2599, std.dev.: 0.0089) MultiSource/Benchmarks/Olden/bh/bh: -4.49% (2.5166 => 2.4036, std.dev.: 0.0294) MultiSource/Benchmarks/mafft/pairlocalalign: -4.23% (62.4126 => 59.7755, std.dev.: 0.2301) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.13% (0.4140 => 0.3969, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: -3.70% (9.2503 => 8.9084, std.dev.: 0.0497) SingleSource/Benchmarks/McGill/misr: -3.68% (0.4296 => 0.4138, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.58% (3.7496 => 3.6155, std.dev.: 0.0152) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.87% (2.4457 => 2.3756, std.dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.62% (1.1683 => 1.1377, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/neural/neural: -2.44% (1.0926 => 1.0659, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.38% (61.1734 => 59.7145, std.dev.: 0.4892) MultiSource/Benchmarks/PAQ8p/paq8p: -2.22% (92.7467 => 90.6905, std.dev.: 0.4316) SingleSource/Benchmarks/Dhrystone/dry: -2.20% (2.4013 => 2.3485, std.dev.: 0.0002) MultiSource/Applications/aha/aha: -1.95% (3.4286 => 3.3617, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/hash2: -1.93% (3.4876 => 3.4203, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.60% (1.0686 => 1.0515, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.47% (1.8739 => 1.8463, std.dev.: 0.0097) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3095, std.dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/fldry: -1.32% (2.4971 => 2.4641, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.26% (9.3855 => 9.2675, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/lists: -1.24% (16.5617 => 16.3562, std.dev.: 0.0211) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.24% (27.1724 => 26.8353, std.dev.: 0.1147) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.33% (0.9980 => 1.0113, std.dev.: 0.0117) MultiSource/Applications/sqlite3/sqlite3: 4.30% (0.6022 => 0.6281, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/08-main/main: 5.82% (0.1666 => 0.1763, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.38% (0.1554 => 0.1591, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.99% (0.3083 => 0.3206, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (0.2394 => 0.2424, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.92% (0.3175 => 0.3236, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.26% (0.2302 => 0.2331, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: 3.56% (0.0449 => 0.0465, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.42% (0.0240 => 0.0241, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.52% (0.0192 => 0.0193, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -6.92% (0.0390 => 0.0363, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.33% (0.0301 => 0.0305, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.41% (0.0284 => 0.0288, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.54% (0.0324 => 0.0319, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: 3.95% (0.0177 => 0.0184, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 4.23% (0.0189 => 0.0197, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: 2.41% (0.0249 => 0.0255, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -18.46% (0.0325 => 0.0265, std.dev.: 0.0028) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005) MultiSource/Applications/ClamAV/clamscan: -0.56% (0.1429 => 0.1421, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: -1.85% (1.5019 => 1.4741, std.dev.: 0.0280) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: - (0.1501 => 0.1501, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.68% (0.4264 => 0.4293, std.dev.: 0.0184) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.22% (0.1344 => 0.1441, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.40% (0.0589 => 0.0569, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -13.36% (0.0232 => 0.0201, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.01% (0.0639 => 0.0607, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.47% (1.1350 => 1.1297, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 116.67% (0.0006 => 0.0013, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.44% (0.0637 => 0.0545, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -23.98% (0.0246 => 0.0187, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.49% (0.7541 => 0.7653, std.dev.: 0.0122) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 11.07% (1.5363 => 1.7064, std.dev.: 0.0025) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 16:58:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 18:58:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121004235851.E01702A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4581?compare_to=4573&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4581, Order: 165244, Start Time: 2012-10-04 20:50:37, End Time: 2012-10-05 00:00:30 To: 4573, Order: 165233, Start Time: 2012-10-04 17:11:06, End Time: 2012-10-04 20:21:06 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 0 (133 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (131 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1038 (758 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.62% (2.1111 => 2.0558, std.dev.: 0.0197) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.04% (9.8126 => 9.8091, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.02% (9.4103 => 9.4121, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.00% (16.9567 => 16.9564, std.dev.: 0.0055) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.67% (0.1063 => 0.1187, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 11.56% (1.5932 => 1.7773, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/for-in: 11.47% (0.3496 => 0.3897, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.47% (0.3488 => 0.3888, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.46% (0.3446 => 0.3841, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.43% (0.3465 => 0.3861, std.dev.: 0.0081) SingleSource/UnitTests/ObjC/exceptions-3: 11.39% (0.3460 => 0.3854, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.36% (0.3442 => 0.3833, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.27% (0.3469 => 0.3860, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.12% (0.3643 => 0.4048, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.10% (0.3650 => 0.4055, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.98% (0.3724 => 0.4133, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.23% (0.2875 => 0.3169, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.04% (0.2738 => 0.3013, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 9.84% (0.2714 => 0.2981, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 9.76% (0.2725 => 0.2991, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.72% (0.5826 => 0.6392, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 9.67% (0.2750 => 0.3016, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 9.63% (0.2803 => 0.3073, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.63% (0.5889 => 0.6456, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 9.60% (0.2823 => 0.3094, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.56% (0.2729 => 0.2990, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 9.55% (0.3004 => 0.3291, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 9.50% (0.3096 => 0.3390, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 9.49% (0.2813 => 0.3080, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.45% (0.3195 => 0.3497, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.38% (0.2911 => 0.3184, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.37% (2.0673 => 2.2611, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 9.37% (0.9909 => 1.0837, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/except: 9.36% (0.2811 => 0.3074, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 9.34% (0.3267 => 0.3572, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 9.32% (0.2780 => 0.3039, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.31% (0.2792 => 0.3052, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 9.18% (0.3258 => 0.3557, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.99% (0.3060 => 0.3335, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 8.98% (0.3317 => 0.3615, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.77% (0.3124 => 0.3398, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.72% (0.3362 => 0.3655, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 8.63% (0.3348 => 0.3637, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 8.51% (0.3678 => 0.3991, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.50% (0.3282 => 0.3561, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/sieve: 8.43% (0.3726 => 0.4040, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 8.40% (0.3477 => 0.3769, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 8.37% (0.4146 => 0.4493, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.33% (0.3625 => 0.3927, std.dev.: 0.0060) SingleSource/UnitTests/ObjC++/property-reference: 8.31% (0.7171 => 0.7767, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.16% (0.3690 => 0.3991, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 8.15% (0.1619 => 0.1751, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.06% (0.3845 => 0.4155, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 8.05% (0.4251 => 0.4593, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.71% (0.3981 => 0.4288, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.69% (0.4994 => 0.5378, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.67% (1.3152 => 1.4161, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.60% (0.5000 => 0.5380, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.60% (1.6211 => 1.7443, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.53% (0.1620 => 0.1742, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.43% (3.5627 => 3.8275, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.43% (0.4361 => 0.4685, std.dev.: 0.0020) MultiSource/Applications/hbd/hbd: 7.35% (0.9697 => 1.0410, std.dev.: 0.0024) MultiSource/Benchmarks/Bullet/bullet: 7.27% (23.5202 => 25.2312, std.dev.: 0.0141) MultiSource/Applications/SPASS/SPASS: 7.23% (5.5417 => 5.9426, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: 7.18% (0.5012 => 0.5372, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 7.16% (1.0781 => 1.1553, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.05% (0.4139 => 0.4431, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.00% (2.7292 => 2.9202, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.95% (0.2014 => 0.2154, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.78% (0.5900 => 0.6300, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.78% (0.6435 => 0.6871, std.dev.: 0.0163) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.62% (0.3930 => 0.4190, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.49% (0.5026 => 0.5352, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.47% (0.2736 => 0.2913, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.35% (0.3890 => 0.4137, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 6.34% (4.2109 => 4.4780, std.dev.: 0.0061) MultiSource/Applications/siod/siod: 6.26% (0.6634 => 0.7049, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.16% (0.2566 => 0.2724, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.12% (0.3903 => 0.4142, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.07% (0.2737 => 0.2903, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 5.99% (1.8794 => 1.9920, std.dev.: 0.0041) MultiSource/Applications/spiff/spiff: 5.96% (0.4029 => 0.4269, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.93% (0.3084 => 0.3267, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.93% (0.2866 => 0.3036, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.92% (4.4195 => 4.6812, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.90% (0.2068 => 0.2190, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.89% (0.1968 => 0.2084, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.83% (0.2969 => 0.3142, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 5.80% (2.1653 => 2.2908, std.dev.: 0.0038) MultiSource/Applications/Burg/burg: 5.77% (0.5546 => 0.5866, std.dev.: 0.0074) MultiSource/Applications/lua/lua: 5.72% (1.4269 => 1.5085, std.dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 5.72% (2.1013 => 2.2214, std.dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 5.68% (4.6177 => 4.8798, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.62% (0.4658 => 0.4920, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.61% (0.2103 => 0.2221) MultiSource/Applications/minisat/minisat: 5.49% (0.3336 => 0.3519, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.47% (0.3271 => 0.3450, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.15% (0.2040 => 0.2145, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.11% (1.9694 => 2.0701, std.dev.: 0.0039) MultiSource/Applications/treecc/treecc: 5.04% (0.7875 => 0.8272, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 5.01% (0.2075 => 0.2179, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.92% (1.9966 => 2.0949, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 4.73% (2.0346 => 2.1308, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 4.57% (0.3498 => 0.3658, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 4.52% (0.4847 => 0.5066, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 4.50% (0.2691 => 0.2812, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 4.48% (0.2391 => 0.2498, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.27% (0.7426 => 0.7743, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.10% (0.5361 => 0.5581, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.96% (11.6398 => 12.1009, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.81% (0.5584 => 0.5797, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.70% (4.6926 => 4.8663, std.dev.: 0.0053) MultiSource/Applications/kimwitu++/kc: 2.76% (11.9555 => 12.2859, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.66% (0.4253 => 0.4366, std.dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.45% (3.3903 => 3.6091, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 5.51% (0.2122 => 0.2239, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6720, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/flops-2: 4.96% (1.8057 => 1.8952, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1707, std.dev.: 0.0145) SingleSource/Benchmarks/Dhrystone/dry: 4.27% (14.0481 => 14.6479, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.42% (79.9355 => 82.6730, std.dev.: 0.0541) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1958, std.dev.: 0.0043) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5027, std.dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.55% (3.1722 => 3.2214, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2899, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5907, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.70% (25.4195 => 16.5988, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/ary2: -8.87% (0.2402 => 0.2189, std.dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9764, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7909, std.dev.: 0.0074) MultiSource/Benchmarks/Olden/tsp/tsp: -7.22% (2.1113 => 1.9589, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -3.74% (11.2080 => 10.7892, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.02% (0.6293 => 0.6103, std.dev.: 0.0045) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7741, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.61% (17.2379 => 16.7885, std.dev.: 0.0130) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8631, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5715, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4948, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.20% (105.3826 => 104.1178, std.dev.: 0.0232) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0447, std.dev.: 0.0010) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 18:24:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 20:24:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121005012414.8CF962A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4582?compare_to=4578&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4582, Order: 165270, Start Time: 2012-10-05 00:00:48, End Time: 2012-10-05 01:25:55 To: 4578, Order: 165253, Start Time: 2012-10-04 22:06:24, End Time: 2012-10-04 23:31:36 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (5 on baseline) Performance Regressions: 2 (180 on baseline) Performance Improvements: 5 (40 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 5 (0 on baseline) Unchanged Tests: 1030 (682 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.22% (55.2195 => 56.4452, std.dev.: 0.0651) MultiSource/Applications/sqlite3/sqlite3: 1.24% (4.5219 => 4.5779, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -2.20% (2.2290 => 2.1799, std.dev.: 0.0025) MultiSource/Applications/hbd/hbd: -1.76% (1.5507 => 1.5234, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: -1.73% (1.3353 => 1.3122, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: -1.60% (0.6764 => 0.6656, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.14% (0.9534 => 0.9425, std.dev.: 0.0016) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.93% (33.7404 => 33.4263, std.dev.: 0.0166) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.01% (2.7524 => 2.7522, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.00% (2.1154 => 2.1153, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (4.9749 => 4.9749, std.dev.: 0.0090) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.40% (33.2944 => 33.4263, std.dev.: 0.0166) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: -100.00% (7.3305 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.08% (2.0176 => 2.4429, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.30% (0.1410 => 0.1654, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 15.25% (0.0826 => 0.0952, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 13.95% (0.2243 => 0.2556, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.45% (0.0819 => 0.0921, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 12.44% (0.1013 => 0.1139, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.35% (0.0834 => 0.0937, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.98% (0.1327 => 0.1486, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.61% (0.1413 => 0.1577, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 11.57% (0.4062 => 0.4532, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 11.57% (0.5818 => 0.6491, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.38% (0.1072 => 0.1194, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 11.32% (0.4328 => 0.4818, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 11.29% (0.5748 => 0.6397, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 11.25% (1.3693 => 1.5234, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.25% (0.2721 => 0.3027, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.08% (3.9660 => 4.4056, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.98% (0.2596 => 0.2881, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.89% (0.1588 => 0.1761, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 10.83% (0.7038 => 0.7800, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.79% (0.3022 => 0.3348, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.73% (0.7710 => 0.8537, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.69% (1.2193 => 1.3497, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.68% (0.0964 => 0.1067, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 10.64% (0.2781 => 0.3077, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 10.59% (0.7061 => 0.7809, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.56% (0.9199 => 1.0170, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.51% (1.4563 => 1.6094, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.47% (0.3580 => 0.3955, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.46% (0.2782 => 0.3073, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.39% (0.3899 => 0.4304, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 10.26% (0.1062 => 0.1171, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.26% (0.5265 => 0.5805, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.17% (0.6283 => 0.6922, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.13% (0.3485 => 0.3838, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.12% (0.6959 => 0.7663, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 10.01% (0.2628 => 0.2891, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.95% (0.3489 => 0.3836, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.94% (1.9828 => 2.1799, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.92% (1.1364 => 1.2491, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hello: 9.90% (0.2607 => 0.2865, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.89% (0.4016 => 0.4413, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.87% (0.2655 => 0.2917, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 9.87% (0.2726 => 0.2995, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 9.86% (0.2760 => 0.3032, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/lists: 9.84% (0.3293 => 0.3617, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 9.82% (0.2761 => 0.3032, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 9.81% (0.2690 => 0.2954, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.81% (0.2966 => 0.3257, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 9.81% (0.2937 => 0.3225, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.80% (0.3756 => 0.4124, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 9.72% (13.8202 => 15.1639, std.dev.: 0.0099) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.66% (0.4390 => 0.4814, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.66% (0.2765 => 0.3032, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 9.64% (0.3453 => 0.3786, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 9.62% (0.3149 => 0.3452, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 9.59% (0.3107 => 0.3405, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.50% (0.2696 => 0.2952, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.49% (0.1075 => 0.1177, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 9.44% (0.3868 => 0.4233, std.dev.: 0.0129) MultiSource/Applications/sgefa/sgefa: 9.38% (0.2995 => 0.3276, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.33% (0.1276 => 0.1395, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.32% (0.1986 => 0.2171, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 9.31% (0.3534 => 0.3863, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 9.30% (0.3192 => 0.3489, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 9.30% (0.2988 => 0.3266, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.30% (0.3130 => 0.3421, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.23% (0.4379 => 0.4783, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.20% (0.5577 => 0.6090, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 9.15% (1.0313 => 1.1257, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.11% (0.6576 => 0.7175, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.02% (0.4791 => 0.5223, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 8.94% (0.1589 => 0.1731, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.93% (0.2127 => 0.2317, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.89% (0.2914 => 0.3173, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.89% (0.5637 => 0.6138, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.85% (0.1435 => 0.1562, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 8.77% (1.1061 => 1.2031, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 8.71% (0.7506 => 0.8160, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.66% (0.3246 => 0.3527, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 8.63% (0.3220 => 0.3498, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/objinst: 8.62% (0.2945 => 0.3199, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 8.59% (16.6129 => 18.0395, std.dev.: 0.0222) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.57% (0.7460 => 0.8099, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/football/football: 8.54% (0.8310 => 0.9020, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.47% (7.2180 => 7.8293, std.dev.: 0.0066) MultiSource/Benchmarks/MallocBench/gs/gs: 8.37% (3.8646 => 4.1882, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.36% (0.8698 => 0.9425, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.30% (0.2023 => 0.2191, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 8.26% (0.6744 => 0.7301, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.26% (0.1865 => 0.2019, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.07% (0.3755 => 0.4058, std.dev.: 0.0057) MultiSource/Applications/d/make_dparser: 8.02% (3.1889 => 3.4445, std.dev.: 0.0049) MultiSource/Applications/treecc/treecc: 7.99% (1.9270 => 2.0809, std.dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: 7.99% (1.0594 => 1.1440, std.dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: 7.98% (0.1478 => 0.1596) MultiSource/Benchmarks/sim/sim: 7.95% (0.3131 => 0.3380, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.95% (0.3511 => 0.3790, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.94% (0.1789 => 0.1931, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 7.85% (2.1791 => 2.3501, std.dev.: 0.0098) MultiSource/Benchmarks/McCat/09-vor/vor: 7.76% (0.2925 => 0.3152, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 7.72% (0.1657 => 0.1785, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: 7.69% (0.4003 => 0.4311, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.63% (3.6692 => 3.9493, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/trivial-interface: 7.55% (0.3578 => 0.3848, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.54% (1.3245 => 1.4244, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-4: 7.52% (0.3646 => 0.3920, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 7.45% (1.2749 => 1.3699, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 7.43% (0.3914 => 0.4205, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.43% (0.8818 => 0.9473, std.dev.: 0.0041) MultiSource/Applications/JM/lencod/lencod: 7.42% (14.8535 => 15.9561, std.dev.: 0.0142) SingleSource/UnitTests/ObjC/exceptions-2: 7.41% (0.3601 => 0.3868, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 7.40% (4.6629 => 5.0078, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.34% (4.3801 => 4.7015, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 7.34% (0.3789 => 0.4067, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 7.34% (0.3940 => 0.4229, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.33% (0.1569 => 0.1684, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.33% (4.4433 => 4.7689, std.dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: 7.32% (8.4961 => 9.1180, std.dev.: 0.0135) SingleSource/UnitTests/ObjC/synchronized: 7.29% (0.3663 => 0.3930, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.26% (0.3650 => 0.3915, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions-3: 7.23% (0.3623 => 0.3885, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.19% (0.6135 => 0.6576, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.15% (0.2140 => 0.2293, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.10% (0.4113 => 0.4405, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.76% (0.1819 => 0.1942, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 6.75% (1.2292 => 1.3122, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.75% (0.2504 => 0.2673, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.60% (0.9108 => 0.9709, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 6.50% (0.6250 => 0.6656, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.42% (4.9865 => 5.3067, std.dev.: 0.0107) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.41% (1.1333 => 1.2060, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.41% (3.2742 => 3.4842, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.33% (1.5188 => 1.6150, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 6.18% (0.2008 => 0.2132, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.16% (0.4805 => 0.5101, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 5.97% (6.5754 => 6.9677, std.dev.: 0.0110) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.90% (0.2321 => 0.2458, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.73% (0.3245 => 0.3431, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 5.55% (3.7467 => 3.9548, std.dev.: 0.0083) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.55% (6.2785 => 6.6271, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.40% (2.1007 => 2.2141, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.90% (13.2842 => 13.9356, std.dev.: 0.0122) MultiSource/Applications/sqlite3/sqlite3: 3.39% (16.2614 => 16.8133, std.dev.: 0.0104) MultiSource/Applications/ClamAV/clamscan: 3.07% (14.5298 => 14.9757, std.dev.: 0.0089) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5172, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 24.74% (1.8175 => 2.2671, std.dev.: 0.0441) SingleSource/Benchmarks/Misc/richards_benchmark: 11.12% (1.1560 => 1.2846, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.63% (3.1736 => 3.4158, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.15% (1.2998 => 1.3797, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9999, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0037, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7748, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.67% (11.2619 => 11.6752, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 3.41% (10.7476 => 11.1136, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/flops-6: 3.34% (1.9199 => 1.9840, std.dev.: 0.0015) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.21% (7.4271 => 7.5911, std.dev.: 0.0040) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4536, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5137, std.dev.: 0.0098) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1882, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.20% (5.5130 => 5.5791, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0266, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 1.02% (12.4560 => 12.5825, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.01% (3.6469 => 3.6838, std.dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.34% (0.2670 => 0.1406, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -15.70% (0.0707 => 0.0596, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.55% (0.4657 => 0.3933, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.97% (1.3819 => 1.1888, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.97% (1.3813 => 1.1883, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.29% (22.5627 => 21.5948, std.dev.: 0.0183) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.64% (0.0997 => 0.0861, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/mason/mason: -12.15% (0.2238 => 0.1966, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.51% (1.2308 => 1.0891, std.dev.: 0.0317) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.97% (20.3410 => 18.3132, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0095) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.96% (1.3780 => 1.2959, std.dev.: 0.0146) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5144, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8004, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.21% (0.9996 => 0.9575, std.dev.: 0.0033) MultiSource/Applications/siod/siod: -3.58% (3.2729 => 3.1558, std.dev.: 0.0261) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.42% (1.7688 => 1.7083, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.02% (0.4867 => 0.4720, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.56% (26.5159 => 25.8370, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4785, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.39% (3.0263 => 2.9541, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.33% (1.9762 => 1.9301, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7135, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/lists: -1.68% (6.3560 => 6.2493, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.59% (0.6615 => 0.6510, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0077, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8623, std.dev.: 0.0182) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4940, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2574, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: -1.10% (9.3358 => 9.2329, std.dev.: 0.0067) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.10% (6.6320 => 6.5590, std.dev.: 0.0130) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 18:33:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 20:33:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121005013351.1D5732A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4583?compare_to=4579&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4583, Order: 165270, Start Time: 2012-10-05 00:16:02, End Time: 2012-10-05 01:35:33 To: 4579, Order: 165259, Start Time: 2012-10-04 22:27:23, End Time: 2012-10-04 23:46:49 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (155 on baseline) Performance Improvements: 4 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 948 (690 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.99% (14.2715 => 14.5549, std.dev.: 0.0069) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.67% (2.5723 => 2.5294, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: -1.48% (0.7974 => 0.7856, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.05% (3.6444 => 3.6062, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.03% (3.6423 => 3.6049, std.dev.: 0.0026) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.17% (0.5838 => 0.5848, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 0.07% (16.1256 => 16.1373, std.dev.: 0.0076) MultiSource/Benchmarks/Bullet/bullet: -0.49% (54.6893 => 54.4210, std.dev.: 0.0131) MultiSource/Benchmarks/MallocBench/gs/gs: 0.09% (4.3635 => 4.3674, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.22% (0.0464 => 0.0463, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.22% (0.0465 => 0.0464, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.23% (0.0433 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.23% (0.0434 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.24% (0.0423 => 0.0422, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.24% (0.0423 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0415 => 0.0415, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.24% (0.0417 => 0.0416) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.23% (0.0434 => 0.0433) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0434 => 0.0434, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0427 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0428 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.24% (0.0418 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.24% (0.0419 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0425 => 0.0425) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.23% (0.0426 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0436 => 0.0436) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.51% (0.0438 => 0.0449, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0412 => 0.0412) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0413 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.24% (0.0425 => 0.0424, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0425 => 0.0425) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.24% (0.0416 => 0.0415) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0408 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.24% (0.0409 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.25% (0.0408 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.25% (0.0408 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0444 => 0.0444, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.22% (0.0445 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0406 => 0.0406) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.25% (0.0407 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.25% (0.0408 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.24% (0.0409 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0415 => 0.0415) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.24% (0.0416 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.09% (1.2426 => 1.2437, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.09% (7.7229 => 7.7299, std.dev.: 0.0126) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.53% (0.7384 => 0.7345, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0359 => 0.0359, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1433 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.05% (0.2140 => 0.2141, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -13.95% (63.2438 => 54.4210, std.dev.: 0.0131) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 31.92% (14.1553 => 18.6733, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 60.27% (3.4629 => 5.5499, std.dev.: 0.0040) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14238.89% (0.0720 => 10.3240, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952400.00% (0.0001 => 9.9525, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 48.59% (0.2554 => 0.3795, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 40.39% (10.3673 => 14.5549, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/richards_benchmark: 31.87% (0.1622 => 0.2139, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 30.49% (0.1056 => 0.1378, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.86% (2.2022 => 2.5294, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 14.59% (0.1432 => 0.1641, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.32% (7.0540 => 8.0640, std.dev.: 0.0066) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.05% (0.1566 => 0.1786, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.20% (1.7609 => 1.9757, std.dev.: 0.0094) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.83% (0.0871 => 0.0974, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 10.73% (0.3282 => 0.3634, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.67% (0.1584 => 0.1753, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/power/power: 10.56% (0.1440 => 0.1592, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.51% (0.3473 => 0.3838, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.39% (0.3543 => 0.3911, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.36% (0.3543 => 0.3910, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.35% (0.3497 => 0.3859, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.30% (0.3516 => 0.3878, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.25% (0.3561 => 0.3926, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 10.18% (10.4361 => 11.4989, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/for-in: 10.12% (0.3694 => 0.4068, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.01% (0.3828 => 0.4211, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.96% (0.3927 => 0.4318, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.86% (0.3886 => 0.4269, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.00% (0.3177 => 0.3463, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 8.88% (0.1655 => 0.1802, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.81% (0.4879 => 0.5309, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.76% (0.1438 => 0.1564, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 8.74% (9.4845 => 10.3137, std.dev.: 0.0042) MultiSource/Applications/lambda-0_1_3/lambda: 8.60% (0.7433 => 0.8072, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.58% (0.6675 => 0.7248, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 8.49% (0.3109 => 0.3373, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 8.48% (0.7115 => 0.7718, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.30% (0.4615 => 0.4998, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.19% (1.5415 => 1.6677, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 8.07% (5.7591 => 6.2241, std.dev.: 0.0051) SingleSource/UnitTests/ObjC++/Hello: 8.02% (0.5925 => 0.6400, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.00% (0.1625 => 0.1755, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 7.94% (0.6030 => 0.6509, std.dev.: 0.0079) MultiSource/Benchmarks/McCat/18-imp/imp: 7.92% (0.3423 => 0.3694, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 7.91% (0.1695 => 0.1829, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.90% (1.3050 => 1.4081, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.84% (0.2271 => 0.2449, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.72% (0.5105 => 0.5499, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.70% (0.1337 => 0.1440, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 7.69% (3.3354 => 3.5920, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.67% (0.2700 => 0.2907, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.56% (0.3121 => 0.3357, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.54% (4.2646 => 4.5860, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.51% (0.5860 => 0.6300, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.50% (0.8172 => 0.8785, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.45% (0.2107 => 0.2264, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.41% (0.2065 => 0.2218, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.40% (5.0018 => 5.3721, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.35% (4.9449 => 5.3084, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.35% (0.1510 => 0.1621, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.29% (0.9765 => 1.0477, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.29% (8.1363 => 8.7292, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.28% (0.8067 => 0.8654, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.27% (0.5569 => 0.5974, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 7.25% (0.6456 => 0.6924, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.23% (0.7326 => 0.7856, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.23% (0.4203 => 0.4507, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.18% (0.2758 => 0.2956, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: 7.14% (0.3387 => 0.3629, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.11% (0.5020 => 0.5377, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.11% (0.3307 => 0.3542, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.06% (0.1940 => 0.2077, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.02% (0.4103 => 0.4391, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: 6.98% (0.3422 => 0.3661, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 6.96% (0.7835 => 0.8380, std.dev.: 0.0040) MultiSource/Applications/Burg/burg: 6.93% (1.1642 => 1.2449, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: 6.90% (0.4289 => 0.4585, std.dev.: 0.0016) SingleSource/Regression/C++/ofstream_ctor: 6.88% (0.2905 => 0.3105, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.85% (7.9617 => 8.5074, std.dev.: 0.0039) MultiSource/Applications/hbd/hbd: 6.85% (1.5603 => 1.6672, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.82% (0.4636 => 0.4952, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.68% (0.3865 => 0.4123, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.64% (0.2891 => 0.3083, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 6.64% (3.8723 => 4.1294, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.63% (0.3650 => 0.3892, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 6.62% (0.1555 => 0.1658, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 6.60% (1.0722 => 1.1430, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/strcat: 6.57% (0.2831 => 0.3017, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 6.55% (0.4048 => 0.4313, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.44% (0.3136 => 0.3338, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.42% (0.2603 => 0.2770, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.36% (0.4620 => 0.4914, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.34% (0.3441 => 0.3659, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.33% (0.3826 => 0.4068, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 6.30% (0.3684 => 0.3916, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.29% (2.0665 => 2.1965, std.dev.: 0.0102) MultiSource/Applications/treecc/treecc: 6.28% (2.0273 => 2.1546, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.27% (0.2872 => 0.3052, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.26% (0.3098 => 0.3292, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.24% (0.3603 => 0.3828, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.23% (0.3162 => 0.3359, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.21% (1.5859 => 1.6844, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 6.20% (0.2871 => 0.3049, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary: 6.19% (0.3232 => 0.3432, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.13% (1.1861 => 1.2588, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.06% (0.3283 => 0.3482, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.06% (0.2756 => 0.2923, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.05% (0.2793 => 0.2962, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 6.05% (0.2877 => 0.3051, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.03% (0.3052 => 0.3236, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 6.00% (21.9371 => 23.2529, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/fibo: 5.98% (0.2725 => 0.2888, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 5.97% (0.3180 => 0.3370, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.97% (0.6450 => 0.6835, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.96% (0.2802 => 0.2969, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.89% (0.5981 => 0.6333, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 5.86% (0.2714 => 0.2873, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 5.83% (0.8921 => 0.9441, std.dev.: 0.0125) MultiSource/Benchmarks/McCat/05-eks/eks: 5.79% (0.4299 => 0.4548, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 5.79% (2.2969 => 2.4298, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary2: 5.62% (0.3379 => 0.3569, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.45% (2.2024 => 2.3224, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.34% (0.1892 => 0.1993, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.25% (0.1906 => 0.2006, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.17% (0.4064 => 0.4274, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.02% (1.4186 => 1.4898, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.97% (1.1840 => 1.2429, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.63% (0.2266 => 0.2371, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.31% (0.3131 => 0.3266, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.25% (1.2842 => 1.3388, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.10% (0.8101 => 0.8433, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.24% (14.3668 => 14.8320, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.06% (0.3427 => 0.3532, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.88% (0.3817 => 0.3927, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.71% (17.1811 => 17.6464, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.66% (3.8922 => 3.9957, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.54% (1.1194 => 1.1478, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2173, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 10.19% (3.1595 => 3.4813, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/Puzzle: 9.92% (0.1421 => 0.1562, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: 9.79% (1.1396 => 1.2512, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 6.64% (3.1578 => 3.3676, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.65% (0.3463 => 0.3624, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.35% (3.6395 => 3.7614, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.68% (4.2280 => 4.3414, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7651, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8138, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.33% (2.6546 => 2.6900, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.07% (6.5088 => 6.5786, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.08% (6.6874 => 0.1286, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.25% (0.8651 => 0.1709, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.02% (5.2763 => 3.2700, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.06% (5.3855 => 3.6049, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.63% (5.3526 => 3.6062, std.dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -14.38% (54.1659 => 46.3757, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/mason/mason: -13.56% (0.0811 => 0.0701, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -11.48% (22.1758 => 19.6308, std.dev.: 0.0133) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.74% (2.9384 => 2.6229, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.43% (1.1492 => 0.7650, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: -15.99% (1.6925 => 1.4218, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.93% (0.0998 => 0.0859, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -11.39% (1.2373 => 1.0964, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/mandel-2: -10.32% (1.5373 => 1.3787, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/mason/mason: -10.09% (0.2161 => 0.1943, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.59% (19.9488 => 18.2352, std.dev.: 0.0367) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.68% (1.8329 => 1.7104, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.30% (1.6805 => 1.5915, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7963, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.91% (1.5835 => 1.5058, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.00% (0.9957 => 0.9559, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0010) MultiSource/Applications/siod/siod: -3.65% (3.2827 => 3.1630, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5053, std.dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: -3.01% (12.4730 => 12.0976, std.dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.09% (8.1563 => 7.9859, std.dev.: 0.0126) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.06% (8.6802 => 8.5011, std.dev.: 0.0158) SingleSource/Benchmarks/Misc/salsa20: -1.85% (10.2830 => 10.0932, std.dev.: 0.0343) SingleSource/Benchmarks/Misc/flops: -1.69% (8.8334 => 8.6841, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5139, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4218, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/lists: -1.08% (6.2999 => 6.2316, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8574, std.dev.: 0.0056) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 11.84% (0.5229 => 0.5848, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 7.66% (14.9895 => 16.1373, std.dev.: 0.0076) MultiSource/Benchmarks/MallocBench/gs/gs: 6.25% (4.1105 => 4.3674, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.57% (1.1048 => 1.2437, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.99% (7.1582 => 7.7299, std.dev.: 0.0126) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.05% (0.6222 => 0.7345, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35800.00% (0.0001 => 0.0359, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.18% (0.2116 => 0.2141, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 18:34:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 20:34:54 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121005013454.E5BA02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4584?compare_to=4580&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4584, Order: 165270, Start Time: 2012-10-05 00:13:37, End Time: 2012-10-05 01:36:38 To: 4580, Order: 165259, Start Time: 2012-10-04 22:33:44, End Time: 2012-10-04 23:57:34 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (14 on baseline) Performance Regressions: 5 (75 on baseline) Performance Improvements: 12 (45 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 960 (771 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.69% (0.7814 => 0.7946, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.89% (1.4688 => 1.4966, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.65% (3.6155 => 3.6750, std.dev.: 0.0121) SingleSource/Benchmarks/Misc/fp-convert: 1.38% (15.6604 => 15.8768, std.dev.: 0.0337) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.06% (1.2764 => 1.2899, std.dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/lemon/lemon: -1.55% (1.0869 => 1.0701, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (1.1089 => 1.0942, std.dev.: 0.0018) MultiSource/Applications/d/make_dparser: -1.26% (3.2057 => 3.1653, std.dev.: 0.0156) MultiSource/Benchmarks/nbench/nbench: -1.22% (1.1325 => 1.1187, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.16% (6.5592 => 6.4831, std.dev.: 0.0179) MultiSource/Applications/JM/ldecod/ldecod: -1.14% (6.7351 => 6.6583, std.dev.: 0.0196) MultiSource/Applications/Burg/burg: -1.03% (1.1984 => 1.1860, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -4.20% (0.6739 => 0.6456, std.dev.: 0.0048) MultiSource/Applications/minisat/minisat: -2.66% (6.4139 => 6.2431, std.dev.: 0.0538) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -1.34% (5.3107 => 5.2398, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -1.15% (4.7327 => 4.6781, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.08% (4.7189 => 4.6680, std.dev.: 0.0188) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.18% (1.0113 => 1.0131, std.dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: -1.35% (0.6281 => 0.6196, std.dev.: 0.0103) MultiSource/Benchmarks/McCat/08-main/main: 2.50% (0.1763 => 0.1807, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.78% (0.1591 => 0.1499, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.40% (0.3206 => 0.3161, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.55% (0.2424 => 0.2338, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.77% (0.3236 => 0.3211, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.06% (0.2331 => 0.2283, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -0.86% (0.0465 => 0.0461, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -33.61% (0.0241 => 0.0160, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -21.24% (0.0193 => 0.0152, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 7.99% (0.0363 => 0.0392, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.33% (0.0305 => 0.0304, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.35% (0.0288 => 0.0287, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -12.54% (0.0319 => 0.0279, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/casts: -10.33% (0.0184 => 0.0165, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/test1: -16.75% (0.0197 => 0.0164, std.dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -1.96% (0.0255 => 0.0250, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: 23.02% (0.0265 => 0.0326, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.56% (0.1421 => 0.1429, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: 2.86% (1.4741 => 1.5162, std.dev.: 0.0314) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.60% (0.1501 => 0.1477, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.85% (0.4293 => 0.3999, std.dev.: 0.0172) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.47% (0.1441 => 0.1391, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.80% (0.0569 => 0.0602, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0201 => 0.0201, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.29% (0.0607 => 0.0587, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.07% (1.1297 => 1.1289, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -15.38% (0.0013 => 0.0011, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.83% (0.0545 => 0.0555, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.86% (0.0187 => 0.0148, std.dev.: 0.0048) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.16% (0.7653 => 0.7665, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.05% (1.7064 => 1.7056, std.dev.: 0.0048) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 142.70% (0.0089 => 0.0216, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: 178.89% (0.0090 => 0.0251, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -27.10% (4.1772 => 3.0453, std.dev.: 0.0700) SingleSource/Benchmarks/Shootout-C++/except: 81633.33% (0.0006 => 0.4904, std.dev.: 0.0064) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/exception_spec_test: - (0.0005 => 0.0005, std.dev.: 0.0001) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: -50.00% (0.0006 => 0.0003, std.dev.: 0.0001) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.49% (0.0745 => 0.0920, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.79% (0.1159 => 0.1284, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 9.30% (2.1763 => 2.3788, std.dev.: 0.0130) SingleSource/Benchmarks/Misc-C++/bigfib: 9.10% (0.5309 => 0.5792, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.71% (0.6410 => 0.6968, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.49% (0.1414 => 0.1534, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.82% (0.3582 => 0.3862, std.dev.: 0.0031) MultiSource/Applications/minisat/minisat: 7.71% (0.6173 => 0.6649, std.dev.: 0.0057) MultiSource/Applications/SIBsim4/SIBsim4: 7.01% (1.1653 => 1.2470, std.dev.: 0.0063) MultiSource/Applications/lemon/lemon: 6.52% (1.0046 => 1.0701, std.dev.: 0.0055) MultiSource/Applications/kimwitu++/kc: 5.95% (15.3105 => 16.2217, std.dev.: 0.0859) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.82% (1.5150 => 1.6031, std.dev.: 0.0149) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.62% (0.6069 => 0.6410, std.dev.: 0.0059) MultiSource/Applications/lambda-0_1_3/lambda: 5.48% (0.6915 => 0.7294, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.01% (0.2797 => 0.2937, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.92% (0.7639 => 0.8015, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.86% (0.2552 => 0.2676, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.80% (0.4248 => 0.4452, std.dev.: 0.0017) MultiSource/Applications/d/make_dparser: 4.72% (3.0225 => 3.1653, std.dev.: 0.0156) MultiSource/Benchmarks/Bullet/bullet: 4.69% (29.3170 => 30.6907, std.dev.: 0.0633) MultiSource/Applications/SPASS/SPASS: 4.36% (13.3238 => 13.9045, std.dev.: 0.0173) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.26% (0.2654 => 0.2767, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.13% (0.3901 => 0.4062, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.10% (0.4880 => 0.5080, std.dev.: 0.0022) MultiSource/Applications/lua/lua: 4.04% (3.5980 => 3.7435, std.dev.: 0.0129) MultiSource/Applications/oggenc/oggenc: 3.88% (4.7455 => 4.9295, std.dev.: 0.0176) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.80% (0.8569 => 0.8895, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.70% (1.2021 => 1.2466, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 3.67% (1.1440 => 1.1860, std.dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.65% (6.2546 => 6.4831, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.63% (0.3062 => 0.3173, std.dev.: 0.0028) MultiSource/Applications/siod/siod: 3.61% (2.0972 => 2.1730, std.dev.: 0.0106) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.56% (1.1672 => 1.2088, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.55% (1.1827 => 1.2247, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.50% (0.7226 => 0.7479, std.dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 3.38% (1.0821 => 1.1187, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 3.24% (0.8405 => 0.8677, std.dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: 3.23% (8.2186 => 8.4844, std.dev.: 0.0535) MultiSource/Applications/JM/lencod/lencod: 3.08% (14.7256 => 15.1794, std.dev.: 0.0885) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.07% (2.0317 => 2.0940, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.93% (0.3418 => 0.3518, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 2.89% (1.8798 => 1.9341, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.81% (12.6413 => 12.9967, std.dev.: 0.0601) MultiSource/Applications/JM/ldecod/ldecod: 2.58% (6.4908 => 6.6583, std.dev.: 0.0196) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.37% (1.0689 => 1.0942, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.22% (4.2616 => 4.3560, std.dev.: 0.0152) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.21% (0.5963 => 0.6095, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.08% (0.7784 => 0.7946, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.89% (4.3380 => 4.4199, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.73% (4.2815 => 4.3556, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.51% (1.3935 => 1.4146, std.dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 59.00% (0.0261 => 0.0415, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/pi: 41.53% (1.6538 => 2.3406, std.dev.: 0.0040) SingleSource/Benchmarks/Stanford/Bubblesort: 40.30% (0.0263 => 0.0369, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 22.12% (3.4629 => 4.2290, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout/ary3: 15.05% (1.7426 => 2.0048, std.dev.: 0.0226) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.56% (4.0101 => 4.5540, std.dev.: 0.0394) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.69% (2.4042 => 2.7093, std.dev.: 0.0151) SingleSource/Benchmarks/Stanford/Puzzle: 12.42% (0.1433 => 0.1611, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/queens: 10.67% (1.6261 => 1.7996, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout/lists: 9.04% (7.0025 => 7.6358, std.dev.: 0.0139) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.38% (1.0063 => 1.0906, std.dev.: 0.0189) MultiSource/Benchmarks/FreeBench/mason/mason: 8.13% (0.5004 => 0.5411, std.dev.: 0.0093) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.09% (0.2857 => 0.3088, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/fp-convert: 4.29% (15.2242 => 15.8768, std.dev.: 0.0337) SingleSource/Benchmarks/Misc/dt: 3.95% (0.9851 => 1.0240, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.81% (3.4080 => 3.5380, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 3.63% (3.5520 => 3.6811, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.33% (0.5587 => 0.5773, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.86% (0.5876 => 0.6044, std.dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 2.85% (6.9722 => 7.1707, std.dev.: 0.0628) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.84% (6.6312 => 6.8197, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/power/power: 1.37% (1.4184 => 1.4379, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.36% (1.2726 => 1.2899, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.20% (4.6127 => 4.6680, std.dev.: 0.0188) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.33% (0.0591 => 0.0329, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -44.33% (0.2996 => 0.1668, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.34% (1.4189 => 1.1303, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.71% (1.4113 => 1.1331, std.dev.: 0.0145) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.46% (0.3497 => 0.2047, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.79% (5.2665 => 4.1188, std.dev.: 0.0884) SingleSource/Benchmarks/Shootout-C++/ary3: -20.38% (1.7473 => 1.3912, std.dev.: 0.0449) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -13.80% (1.7361 => 1.4966, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/sieve: -12.18% (8.1594 => 7.1658, std.dev.: 0.0149) MultiSource/Benchmarks/McCat/17-bintr/bintr: -12.00% (0.0917 => 0.0807, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ackermann: -10.56% (3.6023 => 3.2219, std.dev.: 0.1363) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.37% (1.1647 => 1.0556, std.dev.: 0.0352) SingleSource/Benchmarks/Shootout-C++/moments: -9.25% (0.1114 => 0.1011, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.75% (3.2007 => 2.9206, std.dev.: 0.0409) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2859, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops: -8.33% (9.5474 => 8.7519, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.56% (3.6254 => 3.3875, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: -6.56% (4.6355 => 4.3315, std.dev.: 0.0338) MultiSource/Applications/lambda-0_1_3/lambda: -6.49% (7.6833 => 7.1848, std.dev.: 0.0119) SingleSource/Benchmarks/Misc/richards_benchmark: -6.47% (1.4441 => 1.3506, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7948, std.dev.: 0.0044) MultiSource/Applications/SIBsim4/SIBsim4: -5.73% (3.4230 => 3.2269, std.dev.: 0.0161) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.47% (3.9413 => 3.7258, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/fib2: -5.09% (4.4195 => 4.1944, std.dev.: 0.0516) MultiSource/Benchmarks/Olden/bh/bh: -4.75% (2.5166 => 2.3971, std.dev.: 0.0079) MultiSource/Applications/sgefa/sgefa: -4.70% (0.3746 => 0.3570, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/distray/distray: -4.47% (0.2664 => 0.2545, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.43% (0.4564 => 0.4362, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -4.21% (62.4126 => 59.7872, std.dev.: 0.0593) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -4.00% (1.1683 => 1.1216, std.dev.: 0.0087) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.46% (1.2722 => 1.2282, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/methcall: -3.31% (9.2503 => 8.9439, std.dev.: 0.0137) SingleSource/Benchmarks/McGill/misr: -3.00% (0.4296 => 0.4167, std.dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/dry: -2.20% (2.4013 => 2.3484, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.99% (3.7496 => 3.6750, std.dev.: 0.0121) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.86% (2.3569 => 2.3130, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash2: -1.84% (3.4876 => 3.4236, std.dev.: 0.0046) MultiSource/Benchmarks/PAQ8p/paq8p: -1.75% (92.7467 => 91.1260, std.dev.: 0.3839) MultiSource/Benchmarks/FreeBench/neural/neural: -1.71% (1.0926 => 1.0739, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.64% (9.3855 => 9.2320, std.dev.: 0.0229) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std.dev.: 0.0000) MultiSource/Applications/aha/aha: -1.61% (3.4286 => 3.3734, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: -1.29% (2.4971 => 2.4648, std.dev.: 0.0088) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.29% (27.1724 => 26.8220, std.dev.: 0.0200) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.22% (25.6658 => 25.3529, std.dev.: 0.0774) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.51% (0.9980 => 1.0131, std.dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: 2.89% (0.6022 => 0.6196, std.dev.: 0.0103) MultiSource/Benchmarks/McCat/08-main/main: 8.46% (0.1666 => 0.1807, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.54% (0.1554 => 0.1499, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.53% (0.3083 => 0.3161, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.34% (0.2394 => 0.2338, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.13% (0.3175 => 0.3211, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.83% (0.2302 => 0.2283, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: 2.67% (0.0449 => 0.0461, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -33.33% (0.0240 => 0.0160, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -20.83% (0.0192 => 0.0152, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.51% (0.0390 => 0.0392, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.00% (0.0301 => 0.0304, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.06% (0.0284 => 0.0287, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -13.89% (0.0324 => 0.0279, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/casts: -6.78% (0.0177 => 0.0165, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/test1: -13.23% (0.0189 => 0.0164, std.dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0249 => 0.0250, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: 0.31% (0.0325 => 0.0326, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: - (0.1429 => 0.1429, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: 0.95% (1.5019 => 1.5162, std.dev.: 0.0314) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.60% (0.1501 => 0.1477, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.21% (0.4264 => 0.3999, std.dev.: 0.0172) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.50% (0.1344 => 0.1391, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.21% (0.0589 => 0.0602, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -13.36% (0.0232 => 0.0201, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.14% (0.0639 => 0.0587, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.54% (1.1350 => 1.1289, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 83.33% (0.0006 => 0.0011, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.87% (0.0637 => 0.0555, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.84% (0.0246 => 0.0148, std.dev.: 0.0048) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.64% (0.7541 => 0.7665, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.02% (1.5363 => 1.7056, std.dev.: 0.0048) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 20:15:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 22:15:14 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121005031514.78AFD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4585?compare_to=4584&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4585, Order: 165283, Start Time: 2012-10-05 01:53:21, End Time: 2012-10-05 03:16:57 To: 4584, Order: 165270, Start Time: 2012-10-05 00:13:37, End Time: 2012-10-05 01:36:38 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (14 on baseline) Performance Regressions: 13 (89 on baseline) Performance Improvements: 1 (46 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 963 (756 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/04-bisect/bisect: 11.18% (0.1029 => 0.1144, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 1.96% (2.1730 => 2.2156, std.dev.: 0.0163) MultiSource/Applications/lemon/lemon: 1.91% (1.0701 => 1.0905, std.dev.: 0.0068) MultiSource/Applications/d/make_dparser: 1.83% (3.1653 => 3.2233, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.69% (0.8895 => 0.9045, std.dev.: 0.0053) MultiSource/Applications/JM/ldecod/ldecod: 1.51% (6.6583 => 6.7591, std.dev.: 0.0168) MultiSource/Applications/JM/lencod/lencod: 1.36% (15.1794 => 15.3865, std.dev.: 0.0183) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 9.20% (3.0587 => 3.3400, std.dev.: 0.0946) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.60% (1.2829 => 1.3932, std.dev.: 0.0212) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.43% (2.2650 => 2.3653, std.dev.: 0.0292) SingleSource/Benchmarks/Shootout-C++/ary3: 3.91% (1.3912 => 1.4456, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.85% (41.1462 => 42.7312, std.dev.: 0.5350) MultiSource/Applications/lua/lua: 1.04% (29.5318 => 29.8375, std.dev.: 0.1122) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.08% (1.4966 => 1.4804, std.dev.: 0.0049) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.69% (1.0131 => 1.0201, std.dev.: 0.0187) MultiSource/Applications/sqlite3/sqlite3: 0.32% (0.6196 => 0.6216, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/08-main/main: 1.33% (0.1807 => 0.1831, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 6.00% (0.1499 => 0.1589, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.75% (0.3161 => 0.3074, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.91% (0.2338 => 0.2406, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.25% (0.3211 => 0.3251, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.83% (0.2283 => 0.2264, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel: -12.15% (0.0461 => 0.0405, std.dev.: 0.0022) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 11.87% (0.0160 => 0.0179, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 26.32% (0.0152 => 0.0192, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.28% (0.0392 => 0.0387, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.47% (0.0304 => 0.0260, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.70% (0.0287 => 0.0285, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -10.39% (0.0279 => 0.0250, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/casts: -12.73% (0.0165 => 0.0144, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/test1: 17.07% (0.0164 => 0.0192, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 2.00% (0.0250 => 0.0255, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -19.33% (0.0326 => 0.0263, std.dev.: 0.0031) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.35% (0.1429 => 0.1424, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -2.55% (1.5162 => 1.4776, std.dev.: 0.0415) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 2.37% (0.1477 => 0.1512, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.83% (0.3999 => 0.4072, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.31% (0.1391 => 0.1437, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.30% (0.0602 => 0.0540, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 5.47% (0.0201 => 0.0212, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.95% (0.0587 => 0.0663, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.16% (1.1289 => 1.1307, std.dev.: 0.0092) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -45.45% (0.0011 => 0.0006, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.90% (0.0555 => 0.0560, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.35% (0.0148 => 0.0146, std.dev.: 0.0048) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.08% (0.7665 => 0.7659, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 0.13% (1.7056 => 1.7079, std.dev.: 0.0051) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 148.31% (0.0089 => 0.0221, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: 97.78% (0.0090 => 0.0178, std.dev.: 0.0031) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -27.27% (4.1772 => 3.0380, std.dev.: 0.0462) SingleSource/Benchmarks/Shootout-C++/except: 82700.00% (0.0006 => 0.4968, std.dev.: 0.0131) SingleSource/Regression/C++/EH/ctor_dtor_count: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.49% (0.0745 => 0.0920, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.03% (0.6410 => 0.7053, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.66% (0.1159 => 0.1271, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 9.60% (2.1763 => 2.3853, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.10% (0.3582 => 0.3908, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 8.93% (0.5309 => 0.5783, std.dev.: 0.0098) MultiSource/Applications/minisat/minisat: 8.62% (0.6173 => 0.6705, std.dev.: 0.0119) MultiSource/Applications/lemon/lemon: 8.55% (1.0046 => 1.0905, std.dev.: 0.0068) MultiSource/Applications/SIBsim4/SIBsim4: 7.64% (1.1653 => 1.2543, std.dev.: 0.0042) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.36% (0.1414 => 0.1518, std.dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: 7.26% (15.3105 => 16.4224, std.dev.: 0.1845) MultiSource/Applications/d/make_dparser: 6.64% (3.0225 => 3.2233, std.dev.: 0.0066) MultiSource/Applications/lambda-0_1_3/lambda: 6.44% (0.6915 => 0.7360, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.41% (1.5150 => 1.6121, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.03% (0.6069 => 0.6435, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.79% (0.2797 => 0.2959, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 5.65% (2.0972 => 2.2156, std.dev.: 0.0163) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.62% (0.7639 => 0.8068, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.55% (0.8569 => 0.9045, std.dev.: 0.0053) MultiSource/Applications/oggenc/oggenc: 5.49% (4.7455 => 5.0060, std.dev.: 0.0360) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.44% (0.4248 => 0.4479, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.37% (0.2552 => 0.2689, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.31% (0.3901 => 0.4108, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 5.28% (0.1971 => 0.2075, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 5.25% (0.3217 => 0.3386, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 5.09% (13.3238 => 14.0017, std.dev.: 0.0432) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.91% (1.4408 => 1.5115, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.78% (1.1827 => 1.2392, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.69% (0.4880 => 0.5109, std.dev.: 0.0080) MultiSource/Applications/sgefa/sgefa: 4.62% (0.2877 => 0.3010, std.dev.: 0.0034) MultiSource/Applications/hbd/hbd: 4.55% (1.3268 => 1.3872, std.dev.: 0.0198) MultiSource/Applications/lua/lua: 4.50% (3.5980 => 3.7600, std.dev.: 0.0340) MultiSource/Applications/JM/lencod/lencod: 4.49% (14.7256 => 15.3865, std.dev.: 0.0183) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.45% (6.2546 => 6.5328, std.dev.: 0.0160) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.45% (0.2654 => 0.2772, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 4.42% (1.8798 => 1.9628, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.41% (3.0758 => 3.2113, std.dev.: 0.0259) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.40% (0.2886 => 0.3013, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.25% (0.3062 => 0.3192, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.22% (1.1672 => 1.2165, std.dev.: 0.0052) MultiSource/Benchmarks/nbench/nbench: 4.20% (1.0821 => 1.1276, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: 4.18% (0.3084 => 0.3213, std.dev.: 0.0016) MultiSource/Applications/Burg/burg: 4.18% (1.1440 => 1.1918, std.dev.: 0.0049) MultiSource/Applications/JM/ldecod/ldecod: 4.13% (6.4908 => 6.7591, std.dev.: 0.0168) MultiSource/Benchmarks/Bullet/bullet: 4.07% (29.3170 => 30.5109, std.dev.: 0.1075) SingleSource/Benchmarks/Shootout-C++/hash2: 4.00% (0.3847 => 0.4001, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.98% (1.2021 => 1.2500, std.dev.: 0.0099) MultiSource/Benchmarks/mafft/pairlocalalign: 3.94% (8.2186 => 8.5424, std.dev.: 0.0241) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.93% (2.0317 => 2.1115, std.dev.: 0.0151) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.59% (12.6413 => 13.0950, std.dev.: 0.1600) MultiSource/Benchmarks/Prolangs-C/football/football: 3.21% (0.8405 => 0.8675, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/hash: 3.15% (0.3520 => 0.3631, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.78% (0.5937 => 0.6102, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.67% (0.5963 => 0.6122, std.dev.: 0.0056) MultiSource/Benchmarks/MallocBench/gs/gs: 2.67% (3.8796 => 3.9830, std.dev.: 0.0289) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.59% (0.4562 => 0.4680, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.58% (4.0318 => 4.1358, std.dev.: 0.0231) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.50% (4.2616 => 4.3683, std.dev.: 0.0256) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.45% (1.0689 => 1.0951, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.45% (4.3380 => 4.4443, std.dev.: 0.0347) MultiSource/Applications/hexxagon/hexxagon: 2.41% (0.9425 => 0.9652, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.19% (1.3935 => 1.4101, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 53.26% (0.0261 => 0.0400, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/pi: 41.43% (1.6538 => 2.3390, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 22.16% (3.4629 => 4.2303, std.dev.: 0.0362) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.84% (0.0766 => 0.0918, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/ary3: 15.10% (1.7426 => 2.0058, std.dev.: 0.0118) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.09% (4.0101 => 4.5750, std.dev.: 0.0123) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.86% (2.4042 => 2.7374, std.dev.: 0.0149) SingleSource/Benchmarks/McGill/queens: 11.09% (1.6261 => 1.8065, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 10.96% (0.1433 => 0.1590, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/mason/mason: 9.91% (0.5004 => 0.5500, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout/lists: 9.11% (7.0025 => 7.6401, std.dev.: 0.0437) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.65% (0.2857 => 0.3104, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.64% (1.0063 => 1.0932, std.dev.: 0.0165) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.56% (40.4792 => 42.7312, std.dev.: 0.5350) SingleSource/Benchmarks/Misc/fp-convert: 4.02% (15.2242 => 15.8359, std.dev.: 0.0229) SingleSource/Benchmarks/Misc/dt: 3.92% (0.9851 => 1.0237, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.88% (3.4080 => 3.5402, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 3.69% (0.6308 => 0.6541, std.dev.: 0.0040) MultiSource/Applications/siod/siod: 3.68% (3.5520 => 3.6826, std.dev.: 0.0105) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.63% (0.5587 => 0.5790, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 3.10% (6.9722 => 7.1880, std.dev.: 0.0318) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.82% (6.6312 => 6.8180, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.32% (2.6656 => 2.7274, std.dev.: 0.0159) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.90% (4.6127 => 4.7003, std.dev.: 0.0227) MultiSource/Benchmarks/Olden/power/power: 1.54% (1.4184 => 1.4403, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (4.6414 => 4.6920, std.dev.: 0.0092) MultiSource/Applications/lua/lua: 1.06% (29.5232 => 29.8375, std.dev.: 0.1122) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -44.16% (0.2996 => 0.1673, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -43.99% (0.0591 => 0.0331, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.31% (1.4189 => 1.1449, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.41% (1.4113 => 1.1515, std.dev.: 0.0171) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.46% (0.3497 => 0.2047, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.75% (5.2665 => 4.1735, std.dev.: 0.0496) SingleSource/Benchmarks/Shootout-C++/ary3: -17.27% (1.7473 => 1.4456, std.dev.: 0.0132) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -14.73% (1.7361 => 1.4804, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/17-bintr/bintr: -12.21% (0.0917 => 0.0805, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/sieve: -12.17% (8.1594 => 7.1665, std.dev.: 0.0597) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.64% (1.1647 => 1.0524, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.74% (1.4034 => 1.2808, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/flops: -8.41% (9.5474 => 8.7449, std.dev.: 0.0152) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.18% (3.2007 => 2.9710, std.dev.: 0.0355) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.82% (3.6254 => 3.3782, std.dev.: 0.0045) MultiSource/Applications/lambda-0_1_3/lambda: -6.52% (7.6833 => 7.1825, std.dev.: 0.0270) SingleSource/Benchmarks/Shootout-C++/fibo: -6.40% (4.6355 => 4.3388, std.dev.: 0.0387) SingleSource/Benchmarks/Misc/richards_benchmark: -6.38% (1.4441 => 1.3519, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.05% (2.9728 => 2.7930, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.52% (3.9413 => 3.7237, std.dev.: 0.0026) MultiSource/Applications/SIBsim4/SIBsim4: -5.26% (3.4230 => 3.2431, std.dev.: 0.0102) MultiSource/Benchmarks/Olden/bh/bh: -5.01% (2.5166 => 2.3904, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout/fib2: -4.92% (4.4195 => 4.2020, std.dev.: 0.0230) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.58% (0.4564 => 0.4355, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -4.20% (62.4126 => 59.7937, std.dev.: 0.3426) MultiSource/Applications/sgefa/sgefa: -4.03% (0.3746 => 0.3595, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.89% (0.4140 => 0.3979, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/distray/distray: -3.75% (0.2664 => 0.2564, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/misr: -3.68% (0.4296 => 0.4138, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.52% (1.2722 => 1.2274, std.dev.: 0.0139) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.19% (1.1683 => 1.1310, std.dev.: 0.0111) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.14% (1.2959 => 1.2552, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/methcall: -3.05% (9.2503 => 8.9685, std.dev.: 0.0339) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.72% (3.7496 => 3.6477, std.dev.: 0.0293) MultiSource/Benchmarks/PAQ8p/paq8p: -2.22% (92.7467 => 90.6894, std.dev.: 0.1019) MultiSource/Applications/SPASS/SPASS: -1.96% (8.5323 => 8.3648, std.dev.: 0.0572) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.87% (2.3569 => 2.3128, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/neural/neural: -1.87% (1.0926 => 1.0722, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: -1.86% (3.4876 => 3.4228, std.dev.: 0.0081) MultiSource/Applications/aha/aha: -1.79% (3.4286 => 3.3671, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.78% (9.3855 => 9.2181, std.dev.: 0.0512) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.69% (1.0686 => 1.0505, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: -1.68% (3.8907 => 3.8254, std.dev.: 0.0067) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.31% (27.1724 => 26.8152, std.dev.: 0.1219) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.09% (25.6658 => 25.3873, std.dev.: 0.0470) SingleSource/Benchmarks/Misc/oourafft: -1.01% (3.8200 => 3.7815, std.dev.: 0.0081) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.21% (0.9980 => 1.0201, std.dev.: 0.0187) MultiSource/Applications/sqlite3/sqlite3: 3.22% (0.6022 => 0.6216, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/08-main/main: 9.90% (0.1666 => 0.1831, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.25% (0.1554 => 0.1589, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.29% (0.3083 => 0.3074, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.50% (0.2394 => 0.2406, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.39% (0.3175 => 0.3251, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.65% (0.2302 => 0.2264, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel: -9.80% (0.0449 => 0.0405, std.dev.: 0.0022) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -25.42% (0.0240 => 0.0179, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0192 => 0.0192, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.77% (0.0390 => 0.0387, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.62% (0.0301 => 0.0260, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.35% (0.0284 => 0.0285, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -22.84% (0.0324 => 0.0250, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/casts: -18.64% (0.0177 => 0.0144, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/test1: 1.59% (0.0189 => 0.0192, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 2.41% (0.0249 => 0.0255, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -19.08% (0.0325 => 0.0263, std.dev.: 0.0031) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.35% (0.1429 => 0.1424, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -1.62% (1.5019 => 1.4776, std.dev.: 0.0415) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.73% (0.1501 => 0.1512, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.50% (0.4264 => 0.4072, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.92% (0.1344 => 0.1437, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.32% (0.0589 => 0.0540, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -8.62% (0.0232 => 0.0212, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.76% (0.0639 => 0.0663, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.38% (1.1350 => 1.1307, std.dev.: 0.0092) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0006 => 0.0006, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.09% (0.0637 => 0.0560, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.65% (0.0246 => 0.0146, std.dev.: 0.0048) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.56% (0.7541 => 0.7659, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 11.17% (1.5363 => 1.7079, std.dev.: 0.0051) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 20:18:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 22:18:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121005031837.59FF82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4586?compare_to=4582&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4586, Order: 165283, Start Time: 2012-10-05 01:54:55, End Time: 2012-10-05 03:20:17 To: 4582, Order: 165270, Start Time: 2012-10-05 00:00:48, End Time: 2012-10-05 01:25:55 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (5 on baseline) Performance Regressions: 0 (180 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 5 (0 on baseline) Unchanged Tests: 1037 (683 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.05% (33.4263 => 33.4427, std.dev.: 0.0144) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.01% (2.7522 => 2.7524, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (2.1153 => 2.1153, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.01% (4.9749 => 4.9745, std.dev.: 0.0008) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.45% (33.2944 => 33.4427, std.dev.: 0.0144) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/Bullet/bullet: -100.00% (7.3305 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.60% (2.0176 => 2.4534, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.16% (0.1410 => 0.1652, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 15.01% (0.0826 => 0.0950, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 14.09% (0.2243 => 0.2559) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.94% (0.0819 => 0.0925, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.23% (0.0834 => 0.0936) MultiSource/Applications/hbd/hbd: 12.14% (1.3693 => 1.5356, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/tsp/tsp: 12.04% (0.1013 => 0.1135, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.98% (0.1327 => 0.1486, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 11.91% (0.5818 => 0.6511, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 11.77% (0.4062 => 0.4540, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 11.74% (0.5748 => 0.6423, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 11.74% (0.4328 => 0.4836, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 11.56% (0.7061 => 0.7877, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.46% (0.1588 => 0.1770, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.39% (0.1413 => 0.1574, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.39% (0.2721 => 0.3031, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.18% (0.3022 => 0.3360, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 11.15% (0.2781 => 0.3091, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.11% (0.2782 => 0.3091, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.82% (0.1072 => 0.1188, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.81% (3.9660 => 4.3946, std.dev.: 0.0094) MultiSource/Applications/lambda-0_1_3/lambda: 10.77% (0.7038 => 0.7796, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.73% (0.7710 => 0.8537, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.68% (0.0964 => 0.1067, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.60% (1.2193 => 1.3485, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 10.59% (0.2690 => 0.2975, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 10.59% (0.2607 => 0.2883, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.56% (0.3580 => 0.3958, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.52% (0.3899 => 0.4309, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 10.50% (0.2628 => 0.2904, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.50% (0.3485 => 0.3851, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.48% (0.2596 => 0.2868, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 10.47% (0.2760 => 0.3049, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.47% (0.2655 => 0.2933, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 10.45% (0.2937 => 0.3244, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.35% (0.6283 => 0.6933, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.31% (0.2765 => 0.3050, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.28% (0.9199 => 1.0145, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.28% (0.3756 => 0.4142, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.28% (0.5265 => 0.5806, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.26% (1.9828 => 2.1862, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.25% (1.4563 => 1.6056, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.25% (0.2966 => 0.3270, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 10.23% (0.2726 => 0.3005, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 10.23% (0.3293 => 0.3630, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.23% (0.4390 => 0.4839, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.18% (0.4016 => 0.4425, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.15% (0.3489 => 0.3843, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 10.11% (0.2761 => 0.3040, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.10% (0.6959 => 0.7662, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.09% (0.2696 => 0.2968, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 10.08% (0.3453 => 0.3801, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 10.08% (0.1062 => 0.1169, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 10.03% (0.3149 => 0.3465, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 10.01% (0.3107 => 0.3418, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.97% (1.1364 => 1.2497, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: 9.90% (0.3868 => 0.4251, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 9.81% (0.2988 => 0.3281, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 9.81% (0.3192 => 0.3505, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 9.80% (13.8202 => 15.1745, std.dev.: 0.0050) MultiSource/Applications/sgefa/sgefa: 9.48% (0.2995 => 0.3279, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 9.42% (0.3534 => 0.3867, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.41% (0.5577 => 0.6102, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.41% (0.4791 => 0.5242, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.30% (0.3130 => 0.3421, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.17% (0.2127 => 0.2322, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 9.13% (0.1589 => 0.1734, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 9.09% (1.0313 => 1.1250, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.01% (0.1276 => 0.1391, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.99% (0.1157 => 0.1261, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.97% (0.4379 => 0.4772, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.96% (0.1986 => 0.2164, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.89% (0.2914 => 0.3173, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.87% (0.6576 => 0.7159, std.dev.: 0.0088) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.85% (0.1435 => 0.1562, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 8.83% (0.2945 => 0.3205, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.81% (0.3755 => 0.4086, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.75% (0.8698 => 0.9459, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 8.62% (1.1061 => 1.2015, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.61% (0.7460 => 0.8102, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.60% (0.5637 => 0.6122, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 8.55% (16.6129 => 18.0327, std.dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/football/football: 8.47% (0.8310 => 0.9014, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.44% (0.3246 => 0.3520, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 8.41% (0.6744 => 0.7311, std.dev.: 0.0108) MultiSource/Benchmarks/McCat/18-imp/imp: 8.39% (0.3220 => 0.3490, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.35% (7.2180 => 7.8206, std.dev.: 0.0038) MultiSource/Benchmarks/nbench/nbench: 8.30% (1.0594 => 1.1473, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.23% (0.3511 => 0.3800, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 8.21% (3.8646 => 4.1818, std.dev.: 0.0102) MultiSource/Applications/spiff/spiff: 8.21% (0.7506 => 0.8122, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.20% (0.8818 => 0.9541, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 8.18% (3.1889 => 3.4499, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 8.18% (0.3131 => 0.3387, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.11% (0.2023 => 0.2187, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.99% (0.1865 => 0.2014, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 7.85% (0.1478 => 0.1594, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 7.83% (1.9270 => 2.0778, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.77% (0.1789 => 0.1928, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 7.74% (14.8535 => 16.0027, std.dev.: 0.0116) MultiSource/Benchmarks/McCat/09-vor/vor: 7.66% (0.2925 => 0.3149, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 7.66% (1.2749 => 1.3725, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 7.59% (4.6629 => 5.0166, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.58% (3.6692 => 3.9474, std.dev.: 0.0141) MultiSource/Applications/siod/siod: 7.56% (2.1791 => 2.3439, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.49% (4.3801 => 4.7082, std.dev.: 0.0083) MultiSource/Benchmarks/mafft/pairlocalalign: 7.47% (8.4961 => 9.1305, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.39% (0.1569 => 0.1685, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.37% (1.3245 => 1.4221, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.37% (4.4433 => 4.7706, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/em3d/em3d: 7.36% (0.1657 => 0.1779, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.25% (0.6135 => 0.6580, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.22% (0.4113 => 0.4410, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.20% (4.9865 => 5.3457, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.20% (0.2140 => 0.2294, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 7.13% (1.2292 => 1.3168, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/parameter-passing: 7.04% (0.4003 => 0.4285, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1819 => 0.1946, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.97% (0.3646 => 0.3900, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 6.96% (0.3578 => 0.3827, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.94% (0.3789 => 0.4052, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.92% (0.3914 => 0.4185, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 6.91% (0.3663 => 0.3916, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 6.83% (0.6250 => 0.6677, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 6.75% (0.3601 => 0.3844, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 6.70% (0.3940 => 0.4204, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.66% (0.9108 => 0.9715, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.65% (0.3623 => 0.3864, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.63% (0.3650 => 0.3892, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.55% (3.2742 => 3.4886, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.43% (0.2504 => 0.2665, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.39% (1.5188 => 1.6159, std.dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 6.36% (6.5754 => 6.9936, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.35% (0.4805 => 0.5110, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.34% (1.1333 => 1.2052, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 6.18% (0.2008 => 0.2132, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.90% (6.2785 => 6.6487, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.79% (0.3245 => 0.3433, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.60% (0.2321 => 0.2451, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 5.49% (3.7467 => 3.9524, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.41% (2.1007 => 2.2144, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.79% (13.2842 => 13.9201, std.dev.: 0.0074) MultiSource/Applications/sqlite3/sqlite3: 3.44% (16.2614 => 16.8203, std.dev.: 0.0044) MultiSource/Applications/ClamAV/clamscan: 3.20% (14.5298 => 14.9945, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5137, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 24.12% (1.8175 => 2.2559, std.dev.: 0.0274) SingleSource/Benchmarks/Misc/richards_benchmark: 11.17% (1.1560 => 1.2851, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.47% (0.1322 => 0.1434, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.63% (3.1736 => 3.4156, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 5.97% (1.2998 => 1.3774, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.80% (0.3458 => 0.3624, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0047, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6769, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9851, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 3.26% (10.7476 => 11.0985, std.dev.: 0.0263) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.17% (7.4271 => 7.5879, std.dev.: 0.0049) MultiSource/Applications/lemon/lemon: 1.75% (1.4298 => 1.4548, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5143, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2068, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1868, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9670, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/oourafft: 1.20% (5.5130 => 5.5792, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0267, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5875, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.01% (3.6469 => 3.6839, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.42% (0.2670 => 0.1404, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.04% (0.4657 => 0.3910, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -15.56% (0.0707 => 0.0597) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.02% (1.3813 => 1.1877, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.94% (1.3819 => 1.1892, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.71% (22.5627 => 21.7262, std.dev.: 0.0155) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.33% (1.0460 => 0.8543, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.64% (0.0997 => 0.0861, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.11% (0.2238 => 0.1967, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.92% (1.2308 => 1.0964, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.12% (20.3410 => 18.2826, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.12% (1.3780 => 1.2937, std.dev.: 0.0059) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742) SingleSource/UnitTests/Vector/multiplies: -5.06% (2.6470 => 2.5130, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.70% (0.9996 => 0.9526, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.54% (3.2729 => 3.1570, std.dev.: 0.0250) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.43% (1.7688 => 1.7082, std.dev.: 0.0169) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -2.58% (26.5159 => 25.8308, std.dev.: 0.0258) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Applications/spiff/spiff: -2.34% (3.0263 => 2.9556, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.31% (1.9762 => 1.9305, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.09% (0.6589 => 0.6451, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.80% (6.3560 => 6.2415, std.dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7152, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0070, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8610, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: -1.20% (9.3358 => 9.2234, std.dev.: 0.0297) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4952, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2570, std.dev.: 0.0015) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 20:22:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 22:22:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121005032235.298E32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4587?compare_to=4583&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4587, Order: 165283, Start Time: 2012-10-05 02:04:49, End Time: 2012-10-05 03:24:16 To: 4583, Order: 165270, Start Time: 2012-10-05 00:16:02, End Time: 2012-10-05 01:35:33 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (153 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 951 (692 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.57% (14.5549 => 15.0742, std.dev.: 0.0129) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.44% (1.2887 => 1.3072, std.dev.: 0.0045) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.07% (0.5848 => 0.5852, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: -0.13% (16.1373 => 16.1156, std.dev.: 0.0203) MultiSource/Benchmarks/Bullet/bullet: -0.13% (54.4210 => 54.3494, std.dev.: 0.0133) MultiSource/Benchmarks/MallocBench/gs/gs: 0.13% (4.3674 => 4.3731, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.22% (0.0463 => 0.0464, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.22% (0.0464 => 0.0465, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.46% (0.0432 => 0.0434, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.46% (0.0433 => 0.0435, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.47% (0.0422 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.24% (0.0422 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.24% (0.0415 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.24% (0.0416 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.46% (0.0433 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.46% (0.0434 => 0.0436) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.47% (0.0427 => 0.0429) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.23% (0.0428 => 0.0429) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.48% (0.0417 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.24% (0.0418 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.24% (0.0425 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.47% (0.0425 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.23% (0.0436 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.67% (0.0449 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.24% (0.0412 => 0.0413) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.24% (0.0413 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.47% (0.0424 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.24% (0.0425 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.48% (0.0415 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0417 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.25% (0.0408 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.49% (0.0408 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.25% (0.0407 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.49% (0.0407 => 0.0409) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.45% (0.0444 => 0.0446, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.45% (0.0444 => 0.0446, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.25% (0.0406 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.49% (0.0406 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.49% (0.0407 => 0.0409) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.25% (0.0408 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.24% (0.0415 => 0.0416) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.48% (0.0415 => 0.0417, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.04% (1.2437 => 1.2432, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.13% (7.7299 => 7.7397, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.19% (0.7345 => 0.7359, std.dev.: 0.0034) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.84% (0.0359 => 0.0362, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.09% (0.2141 => 0.2139, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -14.06% (63.2438 => 54.3494, std.dev.: 0.0133) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.00% (14.1553 => 18.6857, std.dev.: 0.0188) SingleSource/Benchmarks/Misc-C++-EH/spirit: 60.48% (3.4629 => 5.5573, std.dev.: 0.0143) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14223.33% (0.0720 => 10.3128, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9951800.00% (0.0001 => 9.9519, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 47.81% (0.2554 => 0.3775, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 45.40% (10.3673 => 15.0742, std.dev.: 0.0129) SingleSource/Benchmarks/Misc/richards_benchmark: 30.58% (0.1622 => 0.2118, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 30.30% (0.1056 => 0.1376, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.63% (2.2022 => 2.5244, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 14.11% (0.1432 => 0.1634, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.05% (0.1566 => 0.1786, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.65% (7.0540 => 8.0167, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.90% (1.7609 => 1.9704, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.83% (0.0871 => 0.0974, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/oourafft: 10.97% (0.3282 => 0.3642, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.86% (0.1584 => 0.1756, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 10.54% (0.3473 => 0.3839, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.53% (0.3543 => 0.3916, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.41% (0.3497 => 0.3861, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 10.36% (0.3543 => 0.3910, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 10.28% (0.3561 => 0.3927, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.24% (0.3516 => 0.3876, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.08% (0.3927 => 0.4323, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.08% (0.3828 => 0.4214, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.04% (0.3694 => 0.4065, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.96% (0.3886 => 0.4273, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 9.74% (10.4361 => 11.4527, std.dev.: 0.0114) MultiSource/Benchmarks/Olden/power/power: 9.58% (0.1440 => 0.1578, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.10% (0.5925 => 0.6464, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.01% (0.1143 => 0.1246, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 9.00% (0.1655 => 0.1804, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 8.96% (0.6030 => 0.6570, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.70% (0.6675 => 0.7256, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.69% (0.4879 => 0.5303, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.53% (0.3177 => 0.3448, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 8.52% (0.3109 => 0.3374, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 8.52% (0.7115 => 0.7721, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 8.50% (9.4845 => 10.2908, std.dev.: 0.0134) MultiSource/Applications/lambda-0_1_3/lambda: 8.49% (0.7433 => 0.8064, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.28% (0.4615 => 0.4997, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.26% (1.5415 => 1.6688, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.25% (0.1625 => 0.1759, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.21% (0.1438 => 0.1556, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 8.20% (0.1695 => 0.1834, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.09% (0.7326 => 0.7919, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.99% (0.5105 => 0.5513, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 7.89% (5.7591 => 6.2136, std.dev.: 0.0137) MultiSource/Benchmarks/McCat/18-imp/imp: 7.86% (0.3423 => 0.3692, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.2065 => 0.2227, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.82% (1.3050 => 1.4070, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.79% (0.2271 => 0.2448, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.75% (0.3121 => 0.3363, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.74% (0.2700 => 0.2909, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 7.69% (3.3354 => 3.5918, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.66% (0.5860 => 0.6309, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.62% (0.8172 => 0.8795, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.60% (4.2646 => 4.5885, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.55% (0.1510 => 0.1624, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.55% (0.2107 => 0.2266, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.47% (0.3307 => 0.3554, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 7.36% (0.6456 => 0.6931, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.33% (0.9765 => 1.0481, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.30% (5.0018 => 5.3669, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.29% (0.2758 => 0.2959, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.27% (0.5569 => 0.5974, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.25% (8.1363 => 8.7264, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.25% (4.9449 => 5.3032, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.23% (0.8067 => 0.8650, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.19% (0.5020 => 0.5381, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.16% (0.1940 => 0.2079, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 7.15% (0.7835 => 0.8395, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.08% (0.4636 => 0.4964, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.07% (0.4103 => 0.4393, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.06% (0.3865 => 0.4138, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.03% (1.1642 => 1.2461, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.02% (0.4289 => 0.4590, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.95% (0.3422 => 0.3660, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 6.92% (0.2905 => 0.3106, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.88% (0.4203 => 0.4492, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.85% (0.2891 => 0.3089, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 6.79% (0.3387 => 0.3617, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.77% (0.3650 => 0.3897, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 6.75% (0.1555 => 0.1660, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/strcat: 6.71% (0.2831 => 0.3021, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 6.69% (3.8723 => 4.1313, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.63% (0.3136 => 0.3344, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 6.62% (0.4048 => 0.4316, std.dev.: 0.0041) MultiSource/Applications/lemon/lemon: 6.59% (1.0722 => 1.1429, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 6.59% (1.5603 => 1.6631, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.58% (7.9617 => 8.4855, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.46% (0.3826 => 0.4073, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 6.43% (0.4620 => 0.4917, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.42% (0.3098 => 0.3297, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3603 => 0.3834, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.37% (0.2871 => 0.3054, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.36% (0.3441 => 0.3660, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 6.36% (2.0273 => 2.1562, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.35% (1.5859 => 1.6866, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.35% (2.0665 => 2.1977, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.34% (0.2603 => 0.2768, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.26% (0.3162 => 0.3360, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.24% (0.2725 => 0.2895, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 6.22% (0.3232 => 0.3433, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.21% (0.3283 => 0.3487, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 6.21% (0.4299 => 0.4566, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.21% (1.1861 => 1.2597, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.20% (0.2756 => 0.2927, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.20% (0.2872 => 0.3050, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 6.19% (0.3180 => 0.3377, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.08% (0.2877 => 0.3052, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 6.06% (0.3052 => 0.3237, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.00% (0.2802 => 0.2970, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.98% (0.6450 => 0.6836, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 5.93% (0.2714 => 0.2875, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.91% (0.2793 => 0.2958, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 5.86% (0.8921 => 0.9444, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 5.84% (2.2969 => 2.4310, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.84% (0.5981 => 0.6330, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 5.72% (21.9371 => 23.1920, std.dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.54% (2.2024 => 2.3245, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 5.53% (0.3379 => 0.3566, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.46% (0.1906 => 0.2010, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.19% (0.4064 => 0.4275, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.08% (1.4186 => 1.4907, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.97% (1.1840 => 1.2428, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.63% (0.2266 => 0.2371, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.44% (0.3131 => 0.3270, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.42% (1.2842 => 1.3410, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.15% (0.8101 => 0.8437, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.03% (14.3668 => 14.8015, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.95% (0.3427 => 0.3528, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.80% (0.3817 => 0.3924, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.59% (3.8922 => 3.9930, std.dev.: 0.0052) MultiSource/Applications/sqlite3/sqlite3: 2.57% (17.1811 => 17.6222, std.dev.: 0.0091) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.39% (1.1194 => 1.1461, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 10.19% (3.1595 => 3.4814, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 9.98% (1.1396 => 1.2533, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (3.1578 => 3.3679, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 3.68% (0.5413 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.66% (3.6395 => 3.7727, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.78% (4.2280 => 4.3454, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7650, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.55% (0.8275 => 0.8403, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8127, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.36% (0.9540 => 0.9670, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.17% (2.6546 => 2.6857, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.06% (6.5088 => 6.5781, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1293, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.44% (5.2763 => 3.2483, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.34% (5.3855 => 3.5900, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.94% (5.3526 => 3.5895, std.dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -14.47% (54.1659 => 46.3307, std.dev.: 0.0456) MultiSource/Benchmarks/FreeBench/mason/mason: -13.56% (0.0811 => 0.0701, std.dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: -11.59% (22.1758 => 19.6058, std.dev.: 0.0217) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.80% (2.9384 => 2.6210, std.dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.43% (1.1492 => 0.7650, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.88% (1.6925 => 1.4238, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.83% (0.0998 => 0.0860, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.31% (1.2373 => 1.0973, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -10.35% (1.5373 => 1.3782, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/mason/mason: -10.00% (0.2161 => 0.1945, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.23% (19.9488 => 18.3066, std.dev.: 0.0658) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.74% (1.8329 => 1.7094, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5753, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.33% (1.6805 => 1.5909, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -5.02% (1.5835 => 1.5040, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.77% (3.2827 => 3.1591, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.26% (0.9957 => 0.9632, std.dev.: 0.0049) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5002, std.dev.: 0.0072) MultiSource/Applications/hexxagon/hexxagon: -2.99% (12.4730 => 12.1006, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.08% (8.1563 => 7.9870, std.dev.: 0.0198) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.05% (8.6802 => 8.5025, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/salsa20: -1.96% (10.2830 => 10.0810, std.dev.: 0.0190) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6821, std.dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4212, std.dev.: 0.0066) SingleSource/UnitTests/Vector/multiplies: -1.48% (2.5528 => 2.5150, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.06% (6.2999 => 6.2333, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8590, std.dev.: 0.0072) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 11.91% (0.5229 => 0.5852, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 7.51% (14.9895 => 16.1156, std.dev.: 0.0203) MultiSource/Benchmarks/MallocBench/gs/gs: 6.39% (4.1105 => 4.3731, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.53% (1.1048 => 1.2432, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.12% (7.1582 => 7.7397, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.27% (0.6222 => 0.7359, std.dev.: 0.0034) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36100.00% (0.0001 => 0.0362, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.09% (0.2116 => 0.2139, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 20:37:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 22:37:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121005033759.2737E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4588?compare_to=4581&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4588, Order: 165273, Start Time: 2012-10-05 00:29:47, End Time: 2012-10-05 03:39:41 To: 4581, Order: 165244, Start Time: 2012-10-04 20:50:37, End Time: 2012-10-05 00:00:30 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 3 (133 on baseline) Performance Improvements: 3 (17 on baseline) Added Tests: 0 (131 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1033 (758 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 5.39% (0.4231 => 0.4459, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.16% (54.2012 => 54.8309, std.dev.: 0.0997) SingleSource/Benchmarks/Misc-C++/bigfib: 1.00% (1.5035 => 1.5186, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.31% (2.2611 => 2.2315, std.dev.: 0.0017) MultiSource/Applications/hbd/hbd: -1.07% (1.0410 => 1.0299, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.69% (82.6730 => 80.4494, std.dev.: 0.0034) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.01% (9.8091 => 9.8105, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.00% (9.4121 => 9.4124, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.01% (16.9564 => 16.9553, std.dev.: 0.0041) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 11.64% (0.3488 => 0.3894, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/exceptions-4: 11.63% (0.3465 => 0.3868, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 11.52% (0.3446 => 0.3843, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 11.45% (0.3460 => 0.3856, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 11.36% (0.3442 => 0.3833, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.33% (0.3469 => 0.3862, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.24% (0.3496 => 0.3889, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.10% (0.1063 => 0.1181, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.06% (0.3643 => 0.4046, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.99% (0.3650 => 0.4051, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.66% (0.3724 => 0.4121, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 10.60% (1.5932 => 1.7621, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: 10.57% (0.5826 => 0.6442, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 10.44% (0.5889 => 0.6504, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.06% (0.7171 => 0.7821, std.dev.: 0.0032) SingleSource/Regression/C++/ofstream_ctor: 8.49% (0.3004 => 0.3259, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.45% (0.2875 => 0.3118, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.29% (0.3195 => 0.3460, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 8.22% (0.2725 => 0.2949, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.22% (0.2738 => 0.2963, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 8.11% (0.2714 => 0.2934, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.06% (0.2729 => 0.2949, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/matrix: 8.06% (0.2780 => 0.3004, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 8.02% (0.9909 => 1.0704, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.02% (0.2792 => 0.3016, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 7.99% (0.2803 => 0.3027, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 7.97% (0.2811 => 0.3035, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 7.96% (0.2750 => 0.2969, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.94% (2.0673 => 2.2315, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.94% (0.2911 => 0.3142, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.91% (0.4361 => 0.4706, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 7.91% (0.1619 => 0.1747, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 7.90% (0.2823 => 0.3046, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 7.89% (0.2813 => 0.3035, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.85% (0.3096 => 0.3339, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.75% (0.4994 => 0.5381, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.61% (0.3060 => 0.3293, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.59% (1.6211 => 1.7442, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 7.56% (0.3267 => 0.3514, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 7.55% (0.3258 => 0.3504, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.52% (0.3124 => 0.3359, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 7.51% (0.3317 => 0.3566, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 7.50% (0.4146 => 0.4457, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.50% (1.3152 => 1.4138, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.50% (0.3362 => 0.3614, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 7.48% (0.3678 => 0.3953, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 7.43% (0.3726 => 0.4003, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 7.36% (0.3477 => 0.3733, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.34% (0.3282 => 0.3523, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 7.23% (0.3348 => 0.3590, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.22% (0.1620 => 0.1737, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.17% (0.3625 => 0.3885, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.12% (0.5000 => 0.5356, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.06% (3.5627 => 3.8144, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.01% (0.2866 => 0.3067, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.99% (0.3690 => 0.3948, std.dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: 6.97% (23.5202 => 25.1597, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/hash2: 6.96% (0.4251 => 0.4547, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.92% (0.3845 => 0.4111, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 6.82% (5.5417 => 5.9197, std.dev.: 0.0075) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.80% (0.2014 => 0.2151, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 6.78% (1.0781 => 1.1512, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.76% (0.3981 => 0.4250, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.69% (0.2736 => 0.2919, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.69% (0.5026 => 0.5362, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.56% (0.3930 => 0.4188, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.52% (0.1549 => 0.1650, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.50% (0.4139 => 0.4408, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 6.42% (4.2109 => 4.4814, std.dev.: 0.0040) MultiSource/Applications/spiff/spiff: 6.38% (0.4029 => 0.4286, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.37% (0.5900 => 0.6276, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.36% (0.2737 => 0.2911, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.29% (0.6435 => 0.6840, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.28% (0.3903 => 0.4148, std.dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 6.24% (0.2566 => 0.2726, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 6.21% (0.9697 => 1.0299, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.19% (0.3084 => 0.3275, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.19% (2.7292 => 2.8981, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.17% (0.3890 => 0.4130, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 6.17% (0.5012 => 0.5321, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.15% (4.4195 => 4.6912, std.dev.: 0.0074) MultiSource/Applications/siod/siod: 6.14% (0.6634 => 0.7041, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/gs/gs: 6.10% (1.8794 => 1.9941, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.09% (0.2068 => 0.2194, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.05% (0.1968 => 0.2087, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.89% (0.2969 => 0.3144, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.85% (0.2103 => 0.2226, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 5.73% (0.5546 => 0.5864, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 5.68% (1.4269 => 1.5079, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.63% (0.3271 => 0.3455, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 5.59% (4.6177 => 4.8756, std.dev.: 0.0031) MultiSource/Applications/minisat/minisat: 5.58% (0.3336 => 0.3522, std.dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: 5.56% (2.1653 => 2.2857, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.56% (0.4658 => 0.4917, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 5.41% (2.1013 => 2.2150, std.dev.: 0.0056) MultiSource/Applications/treecc/treecc: 5.23% (0.7875 => 0.8287, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 5.19% (2.0346 => 2.1401, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 5.16% (0.2075 => 0.2182, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.00% (0.2040 => 0.2142, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.84% (1.9694 => 2.0647, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.76% (1.9966 => 2.0917, std.dev.: 0.0023) MultiSource/Benchmarks/PAQ8p/paq8p: 4.70% (0.4847 => 0.5075, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 4.68% (0.2391 => 0.2503, std.dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: 4.53% (0.2691 => 0.2813, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.50% (0.7426 => 0.7760, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.16% (0.5361 => 0.5584, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.14% (0.4253 => 0.4429, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (0.5584 => 0.5805, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 3.92% (0.3498 => 0.3635, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.88% (11.6398 => 12.0910, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.85% (4.6926 => 4.8731, std.dev.: 0.0179) MultiSource/Applications/kimwitu++/kc: 2.86% (11.9555 => 12.2976, std.dev.: 0.0052) SingleSource/UnitTests/Vector/constpool: 1.07% (2.4764 => 2.5030, std.dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6093, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6705, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-2: 4.97% (1.8057 => 1.8954, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 4.74% (15.4430 => 16.1748, std.dev.: 0.1373) SingleSource/Benchmarks/Dhrystone/dry: 4.16% (14.0481 => 14.6318, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2101, std.dev.: 0.0020) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5040, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.68% (3.1722 => 3.2256, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2862, std.dev.: 0.0020) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5144, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.02% (50.0626 => 50.5741, std.dev.: 0.0099) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.85% (25.4195 => 16.5610, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/ary2: -7.83% (0.2402 => 0.2214, std.dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9762, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7988, std.dev.: 0.0173) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9576, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8007, std.dev.: 0.0089) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std.dev.: 0.0022) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7734, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.26% (17.2379 => 16.8488, std.dev.: 0.0690) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.21% (41.7953 => 40.8734, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.80% (10.7630 => 10.5695, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4967, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.14% (105.3826 => 104.1860, std.dev.: 0.0670) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0458, std.dev.: 0.0037) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 21:57:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 4 Oct 2012 23:57:16 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121005045716.2E6002A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4589?compare_to=4585&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4589, Order: 165289, Start Time: 2012-10-05 03:33:07, End Time: 2012-10-05 04:56:18 To: 4585, Order: 165283, Start Time: 2012-10-05 01:53:21, End Time: 2012-10-05 03:16:57 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (14 on baseline) Performance Regressions: 11 (76 on baseline) Performance Improvements: 2 (47 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 964 (768 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.87% (0.4537 => 0.4758, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.67% (0.7602 => 0.7957, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.84% (0.5744 => 0.5907, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.10% (0.5568 => 0.5685, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.71% (0.9136 => 0.9292, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.69% (0.6102 => 0.6205, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 16.21% (21.7637 => 25.2924, std.dev.: 1.2650) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.89% (0.3225 => 0.3544, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/ffbench: 2.13% (1.3975 => 1.4273, std.dev.: 0.0100) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.89% (2.3596 => 2.4043, std.dev.: 0.0109) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.21% (1.1310 => 1.1447, std.dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/d/make_dparser: -1.75% (3.2233 => 3.1670, std.dev.: 0.0210) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/dry: -1.06% (2.3678 => 2.3428, std.dev.: 0.0023) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.62% (1.0201 => 1.0138, std.dev.: 0.0136) MultiSource/Applications/sqlite3/sqlite3: -0.35% (0.6216 => 0.6194, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/08-main/main: -0.44% (0.1831 => 0.1823, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.78% (0.1589 => 0.1529, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.39% (0.3074 => 0.3086, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.37% (0.2406 => 0.2325, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.22% (0.3251 => 0.3244, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.30% (0.2264 => 0.2316, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: -5.19% (0.0405 => 0.0384, std.dev.: 0.0038) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 35.75% (0.0179 => 0.0243, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.52% (0.0192 => 0.0193, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.26% (0.0387 => 0.0388, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 15.77% (0.0260 => 0.0301, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.35% (0.0285 => 0.0284, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 29.60% (0.0250 => 0.0324, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 25.00% (0.0144 => 0.0180, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -2.08% (0.0192 => 0.0188, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: - (0.0255 => 0.0255, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 6.84% (0.0263 => 0.0281, std.dev.: 0.0047) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.56% (0.1424 => 0.1416, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: -2.22% (1.4776 => 1.4448, std.dev.: 0.0402) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.19% (0.1512 => 0.1530, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 66.67% (0.0003 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.29% (0.4072 => 0.4060, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.28% (0.1437 => 0.1441, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.89% (0.0540 => 0.0561, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -12.26% (0.0212 => 0.0186, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.41% (0.0663 => 0.0594, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.40% (1.1307 => 1.1262, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.21% (0.0560 => 0.0606, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 58.90% (0.0146 => 0.0232, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.18% (0.7659 => 0.7645, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 25.00% (0.0004 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: -0.08% (1.7079 => 1.7065, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -40.50% (0.0121 => 0.0072, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 141.57% (0.0089 => 0.0215, std.dev.: 0.0003) SingleSource/UnitTests/2003-08-11-VaListArg: 173.33% (0.0090 => 0.0246, std.dev.: 0.0002) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -27.46% (4.1772 => 3.0300, std.dev.: 0.0361) SingleSource/Benchmarks/Shootout-C++/except: 81783.33% (0.0006 => 0.4913, std.dev.: 0.0084) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.95% (0.0745 => 0.0916, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.40% (0.1414 => 0.1561, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.49% (0.1159 => 0.1269, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 9.46% (2.1763 => 2.3822, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/bigfib: 8.66% (0.5309 => 0.5769, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.63% (0.6410 => 0.6963, std.dev.: 0.0045) MultiSource/Applications/minisat/minisat: 7.63% (0.6173 => 0.6644, std.dev.: 0.0046) MultiSource/Applications/SIBsim4/SIBsim4: 6.81% (1.1653 => 1.2446, std.dev.: 0.0052) MultiSource/Applications/lemon/lemon: 6.66% (1.0046 => 1.0715, std.dev.: 0.0099) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.62% (0.3582 => 0.3819, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.43% (0.2552 => 0.2716, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 6.32% (15.3105 => 16.2774, std.dev.: 0.3220) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.15% (1.5150 => 1.6081, std.dev.: 0.0080) MultiSource/Applications/lambda-0_1_3/lambda: 5.90% (0.6915 => 0.7323, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.79% (0.2797 => 0.2959, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.70% (0.6069 => 0.6415, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/18-imp/imp: 5.56% (0.3217 => 0.3396, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.50% (0.7639 => 0.8059, std.dev.: 0.0075) MultiSource/Applications/hbd/hbd: 4.91% (1.3268 => 1.3919, std.dev.: 0.0051) MultiSource/Applications/d/make_dparser: 4.78% (3.0225 => 3.1670, std.dev.: 0.0210) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.73% (0.4880 => 0.5111, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.68% (0.4248 => 0.4447, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.51% (0.5937 => 0.6205, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.41% (1.1827 => 1.2349, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.38% (1.1672 => 1.2183, std.dev.: 0.0055) MultiSource/Benchmarks/Bullet/bullet: 4.37% (29.3170 => 30.5993, std.dev.: 0.4433) MultiSource/Applications/SPASS/SPASS: 4.21% (13.3238 => 13.8844, std.dev.: 0.0839) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.18% (0.3901 => 0.4064, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.12% (1.4408 => 1.5002, std.dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.97% (6.2546 => 6.5029, std.dev.: 0.0475) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.82% (0.3062 => 0.3179, std.dev.: 0.0018) MultiSource/Applications/siod/siod: 3.78% (2.0972 => 2.1764, std.dev.: 0.0206) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.75% (1.2021 => 1.2472, std.dev.: 0.0151) MultiSource/Applications/Burg/burg: 3.67% (1.1440 => 1.1860, std.dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.61% (3.0758 => 3.1867, std.dev.: 0.0058) MultiSource/Benchmarks/mafft/pairlocalalign: 3.60% (8.2186 => 8.5142, std.dev.: 0.0901) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.52% (0.4596 => 0.4758, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.27% (2.0317 => 2.0982, std.dev.: 0.0168) MultiSource/Applications/treecc/treecc: 3.13% (1.8798 => 1.9386, std.dev.: 0.0172) MultiSource/Applications/JM/lencod/lencod: 3.08% (14.7256 => 15.1795, std.dev.: 0.1555) MultiSource/Applications/lua/lua: 3.05% (3.5980 => 3.7078, std.dev.: 0.0392) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.04% (0.7722 => 0.7957, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/football/football: 3.02% (0.8405 => 0.8659, std.dev.: 0.0087) MultiSource/Benchmarks/nbench/nbench: 3.01% (1.0821 => 1.1147, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.99% (0.5520 => 0.5685, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.95% (12.6413 => 13.0148, std.dev.: 0.1122) MultiSource/Applications/JM/ldecod/ldecod: 2.92% (6.4908 => 6.6802, std.dev.: 0.0525) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.91% (0.9029 => 0.9292, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.91% (0.5740 => 0.5907, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.81% (0.4562 => 0.4690, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 2.63% (0.3847 => 0.3948, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.48% (4.3380 => 4.4454, std.dev.: 0.0218) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.37% (4.2815 => 4.3831, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.13% (4.0318 => 4.1177, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.09% (0.5636 => 0.5754, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.44% (1.6538 => 2.3392, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2279, std.dev.: 0.0116) MultiSource/Benchmarks/nbench/nbench: 19.46% (21.1721 => 25.2924, std.dev.: 1.2650) SingleSource/Benchmarks/Shootout/ary3: 14.59% (1.7426 => 1.9968, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.64% (4.0101 => 4.5570, std.dev.: 0.0256) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.94% (2.4042 => 2.7152, std.dev.: 0.0338) SingleSource/Benchmarks/McGill/queens: 11.10% (1.6261 => 1.8066, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/mason/mason: 9.87% (0.5004 => 0.5498, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout/lists: 8.41% (7.0025 => 7.5913, std.dev.: 0.0118) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.33% (0.2857 => 0.3095, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.85% (1.0063 => 1.0853, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.36% (0.3301 => 0.3544, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: 4.50% (15.2242 => 15.9090, std.dev.: 0.0297) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.90% (3.4080 => 3.5409, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/dt: 3.87% (0.9851 => 1.0232, std.dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: 3.24% (6.9722 => 7.1978, std.dev.: 0.0727) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.86% (6.6312 => 6.8209, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 2.82% (3.5520 => 3.6521, std.dev.: 0.0228) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.24% (0.5587 => 0.5712, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.16% (0.5876 => 0.6003, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: 1.44% (1.4184 => 1.4388, std.dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.16% (0.0591 => 0.0330, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -43.79% (0.2996 => 0.1684, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.02% (1.4189 => 1.1490, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.36% (1.4113 => 1.1522, std.dev.: 0.0083) SingleSource/UnitTests/Vector/constpool: -2.63% (8.9977 => 8.7613, std.dev.: 0.0738) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.52% (0.3497 => 0.2045, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.44% (5.2665 => 4.0847, std.dev.: 0.2604) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.98% (15.8312 => 13.3015, std.dev.: 0.6487) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.13% (1.7361 => 1.4735, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1585, std.dev.: 0.0655) MultiSource/Benchmarks/McCat/17-bintr/bintr: -12.21% (0.0917 => 0.0805, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.42% (1.1647 => 1.0550, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.45% (3.2007 => 2.9302, std.dev.: 0.0442) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.38% (1.4034 => 1.2858, std.dev.: 0.0266) SingleSource/Benchmarks/Misc/flops: -8.37% (9.5474 => 8.7480, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.89% (3.6254 => 3.3755, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: -6.66% (7.6833 => 7.1715, std.dev.: 0.0357) SingleSource/Benchmarks/Shootout-C++/fibo: -6.58% (4.6355 => 4.3303, std.dev.: 0.0114) SingleSource/Benchmarks/Misc/richards_benchmark: -6.33% (1.4441 => 1.3527, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.30% (2.9728 => 2.7856, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.48% (3.9413 => 3.7254, std.dev.: 0.0352) SingleSource/Benchmarks/Shootout/fib2: -5.30% (4.4195 => 4.1853, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/bh/bh: -5.14% (2.5166 => 2.3872, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.78% (0.4564 => 0.4346, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: -4.21% (62.4126 => 59.7868, std.dev.: 0.2011) MultiSource/Benchmarks/FreeBench/distray/distray: -4.20% (0.2664 => 0.2552, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: -3.10% (9.2503 => 8.9633, std.dev.: 0.0215) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.67% (3.7496 => 3.6495, std.dev.: 0.0075) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.63% (1.2722 => 1.2388, std.dev.: 0.0063) SingleSource/Benchmarks/McGill/misr: -2.61% (0.4296 => 0.4184, std.dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/dry: -2.44% (2.4013 => 2.3428, std.dev.: 0.0023) MultiSource/Benchmarks/PAQ8p/paq8p: -2.10% (92.7467 => 90.7956, std.dev.: 0.4148) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.09% (61.1734 => 59.8968, std.dev.: 0.3159) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.02% (1.1683 => 1.1447, std.dev.: 0.0013) MultiSource/Applications/aha/aha: -1.90% (3.4286 => 3.3636, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.89% (2.3569 => 2.3124, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash2: -1.86% (3.4876 => 3.4228, std.dev.: 0.0089) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.69% (2.4457 => 2.4043, std.dev.: 0.0109) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.69% (9.3855 => 9.2271, std.dev.: 0.0125) MultiSource/Benchmarks/FreeBench/neural/neural: -1.66% (1.0926 => 1.0745, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std.dev.: 0.0032) MultiSource/Benchmarks/sim/sim: -1.62% (3.8907 => 3.8278, std.dev.: 0.0171) SingleSource/Benchmarks/Dhrystone/fldry: -1.45% (2.4971 => 2.4609, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3111, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.36% (27.1724 => 26.8029, std.dev.: 0.0612) MultiSource/Applications/JM/lencod/lencod: -1.24% (6.7458 => 6.6621, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/oourafft: -1.04% (3.8200 => 3.7801, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.58% (0.9980 => 1.0138, std.dev.: 0.0136) MultiSource/Applications/sqlite3/sqlite3: 2.86% (0.6022 => 0.6194, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/08-main/main: 9.42% (0.1666 => 0.1823, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.61% (0.1554 => 0.1529, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.10% (0.3083 => 0.3086, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.88% (0.2394 => 0.2325, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.17% (0.3175 => 0.3244, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.61% (0.2302 => 0.2316, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: -14.48% (0.0449 => 0.0384, std.dev.: 0.0038) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.25% (0.0240 => 0.0243, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.52% (0.0192 => 0.0193, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.51% (0.0390 => 0.0388, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0301 => 0.0301, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0284 => 0.0284, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0324 => 0.0324, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 1.69% (0.0177 => 0.0180, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -0.53% (0.0189 => 0.0188, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: 2.41% (0.0249 => 0.0255, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -13.54% (0.0325 => 0.0281, std.dev.: 0.0047) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.91% (0.1429 => 0.1416, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: -3.80% (1.5019 => 1.4448, std.dev.: 0.0402) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.93% (0.1501 => 0.1530, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.78% (0.4264 => 0.4060, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.22% (0.1344 => 0.1441, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.75% (0.0589 => 0.0561, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -19.83% (0.0232 => 0.0186, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.04% (0.0639 => 0.0594, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.78% (1.1350 => 1.1262, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.87% (0.0637 => 0.0606, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.69% (0.0246 => 0.0232, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.38% (0.7541 => 0.7645, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 11.08% (1.5363 => 1.7065, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-09-SignedArgs: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 2.86% (0.0070 => 0.0072, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 2.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 22:11:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 00:11:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121005051106.9FC8B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4590?compare_to=4587&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4590, Order: 165289, Start Time: 2012-10-05 03:53:25, End Time: 2012-10-05 05:12:48 To: 4587, Order: 165283, Start Time: 2012-10-05 02:04:49, End Time: 2012-10-05 03:24:16 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (155 on baseline) Performance Improvements: 2 (41 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 950 (691 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.06% (54.7950 => 56.4704, std.dev.: 0.0526) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.47% (15.0742 => 14.5504, std.dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: -1.85% (11.4527 => 11.2411, std.dev.: 0.0037) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.03% (0.5852 => 0.5854, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 0.18% (16.1156 => 16.1442, std.dev.: 0.0067) MultiSource/Benchmarks/Bullet/bullet: 0.38% (54.3494 => 54.5585, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/gs/gs: 0.25% (4.3731 => 4.3839, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0464 => 0.0464, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.22% (0.0465 => 0.0466, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0434 => 0.0434) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0435 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0424 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0423 => 0.0423, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.24% (0.0416 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0417 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0435 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.23% (0.0436 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.23% (0.0429 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0429 => 0.0429) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.24% (0.0419 => 0.0420) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.24% (0.0419 => 0.0420, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.23% (0.0426 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0427 => 0.0427, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.23% (0.0437 => 0.0438) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.23% (0.0437 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0413 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0414 => 0.0414) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0426 => 0.0426) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0426 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.24% (0.0417 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0409 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0410 => 0.0410, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0408 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0409 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.22% (0.0446 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.22% (0.0446 => 0.0447, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0407 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.25% (0.0408 => 0.0409, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0409 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0409 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0416 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.03% (1.2432 => 1.2436, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.03% (7.7397 => 7.7373, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.33% (0.7359 => 0.7383, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0362 => 0.0362, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.2139 => 0.2139, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -13.73% (63.2438 => 54.5585, std.dev.: 0.0059) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.25% (14.1553 => 18.7201, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++-EH/spirit: 60.53% (3.4629 => 5.5590, std.dev.: 0.0168) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14229.31% (0.0720 => 10.3171, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9951700.00% (0.0001 => 9.9518, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 47.81% (0.2554 => 0.3775, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 40.35% (10.3673 => 14.5504, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/distray/distray: 30.30% (0.1056 => 0.1376, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 29.35% (0.1622 => 0.2098, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.67% (2.2022 => 2.5252, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 14.32% (0.1432 => 0.1637, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.18% (0.1566 => 0.1788, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 13.86% (7.0540 => 8.0317, std.dev.: 0.0110) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.94% (0.0871 => 0.0975, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.90% (1.7609 => 1.9705, std.dev.: 0.0042) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.92% (0.1584 => 0.1757, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 10.76% (0.3282 => 0.3635, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: 10.45% (0.3473 => 0.3836, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.44% (0.3543 => 0.3913, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 10.32% (0.3497 => 0.3858, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.28% (0.3561 => 0.3927, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.27% (0.3543 => 0.3907, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.27% (0.3516 => 0.3877, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/parameter-passing: 10.08% (0.3927 => 0.4323, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 10.04% (0.3694 => 0.4065, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.01% (0.3828 => 0.4211, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 9.93% (0.1440 => 0.1583, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.86% (0.3886 => 0.4269, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.54% (0.1143 => 0.1252, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 9.18% (0.1655 => 0.1807, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 8.91% (0.7433 => 0.8095, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.73% (0.6675 => 0.7258, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.72% (0.3177 => 0.3454, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 8.71% (0.7115 => 0.7735, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.69% (0.4879 => 0.5303, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 8.65% (9.4845 => 10.3049, std.dev.: 0.0157) MultiSource/Applications/sgefa/sgefa: 8.62% (0.3109 => 0.3377, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 8.57% (0.5925 => 0.6433, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.49% (0.4615 => 0.5007, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.49% (0.1625 => 0.1763, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.49% (0.6030 => 0.6542, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.41% (0.1438 => 0.1559, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 8.32% (0.1695 => 0.1836, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 8.28% (5.7591 => 6.2362, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.25% (0.1236 => 0.1338, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.25% (1.5415 => 1.6687, std.dev.: 0.0091) MultiSource/Benchmarks/McCat/18-imp/imp: 8.12% (0.3423 => 0.3701, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.05% (1.3050 => 1.4100, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.03% (0.5105 => 0.5515, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.89% (0.2065 => 0.2228, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.84% (0.2271 => 0.2449, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.81% (0.2700 => 0.2911, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.78% (0.5860 => 0.6316, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 7.77% (3.3354 => 3.5945, std.dev.: 0.0064) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.76% (0.8172 => 0.8806, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.75% (0.3121 => 0.3363, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.73% (0.7326 => 0.7892, std.dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 7.71% (10.4361 => 11.2411, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.70% (0.1337 => 0.1440, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.70% (0.5569 => 0.5998, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.70% (0.4103 => 0.4419, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.69% (0.2107 => 0.2269, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.68% (4.2646 => 4.5922, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/bigfib: 7.67% (0.6456 => 0.6951, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.65% (0.3307 => 0.3560, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.62% (0.1510 => 0.1625, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.60% (0.8067 => 0.8680, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 7.60% (0.3422 => 0.3682, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.57% (0.5020 => 0.5400, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.55% (0.9765 => 1.0502, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.51% (0.2758 => 0.2965, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.42% (0.4636 => 0.4980, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 7.41% (0.4289 => 0.4607, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.37% (0.3865 => 0.4150, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.37% (0.1940 => 0.2083, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.35% (5.0018 => 5.3692, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.31% (4.9449 => 5.3062, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.30% (8.1363 => 8.7302, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.30% (0.2891 => 0.3102, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 7.27% (1.1642 => 1.2488, std.dev.: 0.0048) MultiSource/Applications/spiff/spiff: 7.25% (0.7835 => 0.8403, std.dev.: 0.0077) SingleSource/Regression/C++/ofstream_ctor: 7.23% (0.2905 => 0.3115, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.12% (0.3650 => 0.3910, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 7.10% (0.2831 => 0.3032, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.05% (0.3136 => 0.3357, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 7.04% (0.4048 => 0.4333, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 7.00% (0.3387 => 0.3624, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.97% (0.3603 => 0.3854, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.95% (0.3684 => 0.3940, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 6.94% (3.8723 => 4.1409, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.86% (0.2756 => 0.2945, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 6.84% (0.3232 => 0.3453, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/fibo: 6.83% (0.2725 => 0.2911, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.82% (2.0665 => 2.2075, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.80% (0.3826 => 0.4086, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 6.79% (0.2871 => 0.3066, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash2: 6.77% (0.4620 => 0.4933, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.77% (0.3162 => 0.3376, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.75% (0.2872 => 0.3066, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 6.75% (0.1555 => 0.1660, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 6.75% (1.5603 => 1.6656, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.72% (7.9617 => 8.4966, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/matrix: 6.71% (0.3098 => 0.3306, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.67% (0.3283 => 0.3502, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.65% (0.3052 => 0.3255, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.65% (0.2603 => 0.2776, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 6.64% (1.0722 => 1.1434, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.63% (0.3441 => 0.3669, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.60% (0.2802 => 0.2987) SingleSource/Benchmarks/Shootout-C++/hello: 6.56% (0.2714 => 0.2892, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 6.55% (2.0273 => 2.1600, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 6.50% (0.2877 => 0.3064, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.46% (1.5859 => 1.6884, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.44% (0.2793 => 0.2973, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 6.38% (0.3180 => 0.3383, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.38% (1.1861 => 1.2618, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 6.18% (2.2969 => 2.4389, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.12% (0.6450 => 0.6845, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.09% (0.5981 => 0.6345, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.07% (0.3379 => 0.3584, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 5.98% (0.4299 => 0.4556, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 5.97% (0.8921 => 0.9454, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.60% (0.1892 => 0.1998, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.60% (2.2024 => 2.3257, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.56% (0.4064 => 0.4290, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 5.52% (21.9371 => 23.1480, std.dev.: 0.0223) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.35% (0.1906 => 0.2008, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.29% (1.4186 => 1.4937, std.dev.: 0.0050) MultiSource/Benchmarks/nbench/nbench: 5.04% (1.1840 => 1.2437, std.dev.: 0.0046) MultiSource/Applications/hexxagon/hexxagon: 4.92% (1.2842 => 1.3474, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: 4.79% (0.3131 => 0.3281, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.52% (0.8101 => 0.8467, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.46% (0.2266 => 0.2367, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.16% (14.3668 => 14.8214, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.15% (0.3427 => 0.3535, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.72% (0.3817 => 0.3921, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.67% (3.8922 => 3.9960, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 2.60% (17.1811 => 17.6273, std.dev.: 0.0218) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.39% (1.1194 => 1.1462, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2172, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.95% (1.1396 => 1.2530, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0013) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4500, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3689, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625) SingleSource/Regression/C/uint64_to_float: 3.64% (0.5413 => 0.5610, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.50% (3.6395 => 3.7669, std.dev.: 0.0096) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.59% (4.2280 => 4.3376, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.34% (1.7254 => 1.7657, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (0.8275 => 0.8405, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8133, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.35% (0.9540 => 0.9669, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.10% (2.6546 => 2.6839, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1288, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.15% (0.8651 => 0.1717, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.33% (5.2763 => 3.2540, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.26% (5.3855 => 3.5943, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.83% (5.3526 => 3.5956, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -14.43% (54.1659 => 46.3488, std.dev.: 0.0502) MultiSource/Benchmarks/FreeBench/mason/mason: -13.44% (0.0811 => 0.0702, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -11.50% (22.1758 => 19.6246, std.dev.: 0.0248) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.86% (2.9384 => 2.6194, std.dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.34% (1.1492 => 0.7660, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4232, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.43% (0.0998 => 0.0864, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.38% (1.2373 => 1.0965, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -10.37% (1.5373 => 1.3779, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/mason/mason: -9.86% (0.2161 => 0.1948, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.62% (19.9488 => 18.2298, std.dev.: 0.0337) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.72% (1.8329 => 1.7097, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.34% (1.6805 => 1.5907, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.67% (1.5835 => 1.5095, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.63% (3.2827 => 3.1635, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.26% (0.9957 => 0.9632, std.dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.14% (32.5116 => 31.4921, std.dev.: 0.0064) MultiSource/Applications/hexxagon/hexxagon: -3.01% (12.4730 => 12.0972, std.dev.: 0.0018) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.07% (8.6802 => 8.5006, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/salsa20: -1.95% (10.2830 => 10.0820, std.dev.: 0.0214) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.78% (8.1563 => 8.0111, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6820, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.67% (2.5528 => 2.5102, std.dev.: 0.0020) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4208, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/whetstone: -1.08% (1.0554 => 1.0440, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.08% (4.9088 => 4.8560, std.dev.: 0.0019) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 11.95% (0.5229 => 0.5854, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 7.70% (14.9895 => 16.1442, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/gs/gs: 6.65% (4.1105 => 4.3839, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.56% (1.1048 => 1.2436, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.09% (7.1582 => 7.7373, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.66% (0.6222 => 0.7383, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36100.00% (0.0001 => 0.0362, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.09% (0.2116 => 0.2139, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 22:13:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 00:13:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121005051324.9E1A92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4591?compare_to=4586&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4591, Order: 165289, Start Time: 2012-10-05 03:49:33, End Time: 2012-10-05 05:15:07 To: 4586, Order: 165283, Start Time: 2012-10-05 01:54:55, End Time: 2012-10-05 03:20:17 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (3 on baseline) New Passes: 2 (0 on baseline) Performance Regressions: 3 (180 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1034 (683 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.74% (33.4427 => 33.6906, std.dev.: 0.0115) New Passes - Execution Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 7307700.00% (0.0001 => 7.3078, std.dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.59% (7.9404 => 8.0668, std.dev.: 0.0222) MultiSource/Applications/siod/siod: 1.42% (3.1570 => 3.2019, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.38% (1.2937 => 1.3115, std.dev.: 0.0032) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.01% (2.7524 => 2.7522, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.00% (2.1153 => 2.1154, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.00% (4.9745 => 4.9747, std.dev.: 0.0012) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 22.46% (2.0176 => 2.4707, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.59% (0.1410 => 0.1658, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 16.10% (0.0826 => 0.0959, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 14.36% (0.2243 => 0.2565, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.64% (0.0770 => 0.0875, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 12.81% (1.3693 => 1.5447, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 12.70% (0.4062 => 0.4578, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.59% (0.0834 => 0.0939, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 12.57% (0.4328 => 0.4872, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 12.44% (0.5818 => 0.6542, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 12.28% (0.7061 => 0.7928, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/sumcol: 12.26% (0.2782 => 0.3123, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 12.25% (0.5748 => 0.6452, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 12.24% (0.1013 => 0.1137, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 12.19% (0.2781 => 0.3120, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 12.18% (0.3022 => 0.3390, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.03% (0.1072 => 0.1201, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.96% (0.1413 => 0.1582, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 11.93% (0.2607 => 0.2918, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 11.86% (0.2690 => 0.3009, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 11.85% (0.2937 => 0.3285, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.84% (0.1588 => 0.1776, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.70% (0.3899 => 0.4355, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.69% (0.2721 => 0.3039, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 11.64% (0.2628 => 0.2934, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.64% (0.2655 => 0.2964, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.61% (0.1327 => 0.1481, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.36% (0.3485 => 0.3881, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 11.31% (0.7038 => 0.7834, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 11.30% (0.2760 => 0.3072, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 11.30% (0.2726 => 0.3034, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.27% (3.9660 => 4.4130, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/heapsort: 11.21% (0.2765 => 0.3075, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 11.18% (1.9828 => 2.2045, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.13% (1.2193 => 1.3550, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.10% (0.0964 => 0.1071, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 11.09% (0.2966 => 0.3295, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 11.09% (0.3453 => 0.3836, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 11.09% (0.2696 => 0.2995, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 11.08% (0.3293 => 0.3658, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 11.08% (0.2761 => 0.3067, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.07% (0.4390 => 0.4876, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.01% (0.4016 => 0.4458, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.01% (0.3580 => 0.3974, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.00% (0.6283 => 0.6974, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 10.98% (0.3107 => 0.3448, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.93% (0.7710 => 0.8553, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 10.92% (0.3149 => 0.3493, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.86% (0.3489 => 0.3868, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.86% (0.3756 => 0.4164, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.82% (0.2596 => 0.2877, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 10.78% (0.3868 => 0.4285, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.76% (1.4563 => 1.6130, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.74% (0.9199 => 1.0187, std.dev.: 0.0025) MultiSource/Applications/aha/aha: 10.73% (0.1062 => 0.1176) SingleSource/Benchmarks/Shootout-C++/ary2: 10.68% (0.3192 => 0.3533, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 10.68% (0.2988 => 0.3307, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.64% (0.5265 => 0.5825, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.44% (1.1364 => 1.2550, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.32% (0.6959 => 0.7677, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 10.27% (0.3534 => 0.3897, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 10.24% (13.8202 => 15.2356, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/objinst: 9.81% (0.2945 => 0.3234, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.77% (0.4791 => 0.5259, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 9.75% (0.2995 => 0.3287, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.68% (0.1157 => 0.1269, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 9.57% (0.1589 => 0.1741, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.56% (0.3755 => 0.4114, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.49% (0.3130 => 0.3427, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 9.48% (1.0313 => 1.1291, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.44% (0.8698 => 0.9519, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.39% (0.4379 => 0.4790, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.32% (0.5577 => 0.6097, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.27% (0.1435 => 0.1568, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 9.22% (16.6129 => 18.1448, std.dev.: 0.0197) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.18% (0.6576 => 0.7180, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.17% (0.1276 => 0.1393, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.17% (0.2127 => 0.2322, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.06% (0.2914 => 0.3178, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.96% (0.1986 => 0.2164, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.92% (0.5637 => 0.6140, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 8.90% (0.8310 => 0.9050, std.dev.: 0.0051) MultiSource/Benchmarks/nbench/nbench: 8.88% (1.0594 => 1.1535, std.dev.: 0.0038) MultiSource/Applications/Burg/burg: 8.86% (1.1061 => 1.2041, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.86% (0.3511 => 0.3822, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 8.85% (0.6744 => 0.7341, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: 8.72% (0.3131 => 0.3404, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.72% (0.3246 => 0.3529, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.70% (7.2180 => 7.8461, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.70% (0.7460 => 0.8109, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/gs/gs: 8.69% (3.8646 => 4.2005, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/18-imp/imp: 8.66% (0.3220 => 0.3499, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 8.45% (0.7506 => 0.8140, std.dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.42% (0.1865 => 0.2022, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: 8.40% (3.1889 => 3.4569, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.40% (0.2023 => 0.2193, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 8.28% (1.9270 => 2.0866, std.dev.: 0.0059) MultiSource/Applications/JM/lencod/lencod: 8.24% (14.8535 => 16.0767, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.17% (0.8818 => 0.9538, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 8.14% (2.1791 => 2.3564, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 8.09% (1.2292 => 1.3287, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 8.05% (0.1478 => 0.1597, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 8.03% (0.2925 => 0.3160, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.97% (0.1569 => 0.1694, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 7.96% (1.2749 => 1.3764, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 7.96% (8.4961 => 9.1721, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.93% (3.6692 => 3.9603, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/em3d/em3d: 7.79% (0.1657 => 0.1786, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.78% (1.3245 => 1.4276, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.77% (0.1789 => 0.1928, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.76% (4.3801 => 4.7202, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.73% (0.6135 => 0.6609, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.70% (4.4433 => 4.7853, std.dev.: 0.0074) SingleSource/UnitTests/ObjC/parameter-passing: 7.69% (0.4003 => 0.4311, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.62% (4.9865 => 5.3664, std.dev.: 0.0226) SingleSource/Benchmarks/Misc-C++/bigfib: 7.52% (0.6250 => 0.6720, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.48% (0.2140 => 0.2300, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 7.46% (0.4113 => 0.4420, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.46% (0.3914 => 0.4206, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.41% (0.3578 => 0.3843, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 7.37% (4.6629 => 5.0065, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/property: 7.34% (0.3940 => 0.4229, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.28% (0.3601 => 0.3863, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.26% (0.3789 => 0.4064, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.24% (0.3646 => 0.3910, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.23% (0.3650 => 0.3914, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.21% (0.3663 => 0.3927, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.07% (0.3623 => 0.3879, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.06% (0.9108 => 0.9751, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.88% (3.2742 => 3.4994, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.82% (1.5188 => 1.6224, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 6.79% (6.5754 => 7.0219, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.75% (0.2504 => 0.2673, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.64% (1.1333 => 1.2085, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.60% (0.4805 => 0.5122, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/oourafft: 6.52% (0.2008 => 0.2139, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.37% (6.2785 => 6.6786, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.35% (0.3245 => 0.3451, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.07% (0.2321 => 0.2462, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.99% (0.1819 => 0.1928, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 5.85% (3.7467 => 3.9658, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.69% (2.1007 => 2.2202, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.39% (13.2842 => 14.0003, std.dev.: 0.0069) MultiSource/Applications/sqlite3/sqlite3: 3.79% (16.2614 => 16.8782, std.dev.: 0.0127) MultiSource/Applications/ClamAV/clamscan: 3.38% (14.5298 => 15.0204, std.dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: 1.19% (33.2944 => 33.6906, std.dev.: 0.0115) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5171, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.25% (1.8175 => 2.2582, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/richards_benchmark: 10.98% (1.1560 => 1.2829, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 8.98% (0.8273 => 0.9016, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4137, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.31% (1.2998 => 1.3818, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.75% (1.9144 => 2.0054, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (1.7081 => 1.7749, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6765, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 3.35% (1.9199 => 1.9842, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 3.28% (10.7476 => 11.1002, std.dev.: 0.0614) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.22% (7.4271 => 7.5922, std.dev.: 0.0047) MultiSource/Applications/lemon/lemon: 1.67% (1.4298 => 1.4537, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5124, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1862, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.16% (5.5130 => 5.5771, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.09% (8.8259 => 8.9217, std.dev.: 0.0174) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0269, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5871, std.dev.: 0.0074) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.08% (0.2670 => 0.1413, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.59% (0.4657 => 0.3931, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -15.42% (0.0707 => 0.0598, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.95% (1.3813 => 1.1886, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.79% (1.3819 => 1.1914, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.32% (22.5627 => 21.8126, std.dev.: 0.0115) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.34% (0.0997 => 0.0864, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -12.20% (0.2238 => 0.1965, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.67% (1.2308 => 1.0872, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.15% (20.3410 => 18.2773, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.83% (1.3780 => 1.3115, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.69% (0.9996 => 0.9527, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.52% (1.7688 => 1.7065, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.48% (3.0263 => 2.9512, std.dev.: 0.0008) MultiSource/Applications/lua/lua: -2.43% (26.5159 => 25.8717, std.dev.: 0.0087) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.33% (1.9762 => 1.9302, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -2.17% (3.2729 => 3.2019, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.08% (0.6589 => 0.6452, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.81% (6.3560 => 6.2411, std.dev.: 0.0061) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7152, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0057, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: -1.26% (4.5928 => 4.5348, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8683, std.dev.: 0.0135) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4955, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: -1.13% (9.3358 => 9.2301, std.dev.: 0.0127) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2580, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.06% (6.6320 => 6.5617, std.dev.: 0.0060) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 4 23:36:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 01:36:41 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121005063641.471CA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4592?compare_to=4589&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4592, Order: 165298, Start Time: 2012-10-05 05:15:03, End Time: 2012-10-05 06:38:24 To: 4589, Order: 165289, Start Time: 2012-10-05 03:33:07, End Time: 2012-10-05 04:56:18 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (14 on baseline) Performance Regressions: 16 (97 on baseline) Performance Improvements: 2 (45 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 959 (749 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.76% (0.2687 => 0.2788, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.66% (0.7852 => 0.8061, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.67% (0.7957 => 0.8090, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.51% (1.1490 => 1.1663, std.dev.: 0.0064) MultiSource/Benchmarks/MallocBench/gs/gs: 1.50% (3.9365 => 3.9954, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.30% (13.0148 => 13.1835, std.dev.: 0.0200) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.27% (1.0911 => 1.1050, std.dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 21.03% (0.0485 => 0.0587, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.14% (4.2653 => 4.4845, std.dev.: 0.0254) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.25% (21.6869 => 22.3907, std.dev.: 0.2116) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.24% (1.0853 => 1.1205, std.dev.: 0.0102) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.66% (2.6878 => 2.7323, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.58% (1.4206 => 1.4430, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/whetstone: 1.56% (2.3584 => 2.3953, std.dev.: 0.0057) MultiSource/Benchmarks/BitBench/five11/five11: 1.36% (5.1839 => 5.2545, std.dev.: 0.0215) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.07% (4.4971 => 4.5450, std.dev.: 0.0156) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -12.48% (25.2924 => 22.1353, std.dev.: 0.9546) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.01% (1.8677 => 1.8489, std.dev.: 0.0057) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.34% (1.0138 => 1.0274, std.dev.: 0.0052) MultiSource/Applications/sqlite3/sqlite3: -0.32% (0.6194 => 0.6174, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/08-main/main: -0.55% (0.1823 => 0.1813, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.34% (0.1529 => 0.1580, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.82% (0.3086 => 0.3173, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.13% (0.2325 => 0.2421, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.3244 => 0.3244, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.04% (0.2316 => 0.2317, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: 20.31% (0.0384 => 0.0462, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.65% (0.0243 => 0.0247, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -27.98% (0.0193 => 0.0139, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -12.63% (0.0388 => 0.0339, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.33% (0.0301 => 0.0297, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.76% (0.0284 => 0.0289, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 2.16% (0.0324 => 0.0331, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 1.67% (0.0180 => 0.0183, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -1.60% (0.0188 => 0.0185, std.dev.: 0.0008) SingleSource/UnitTests/Vector/multiplies: -1.96% (0.0255 => 0.0250, std.dev.: 0.0010) SingleSource/UnitTests/byval-alignment: 19.22% (0.0281 => 0.0335, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -40.00% (0.0005 => 0.0003, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -1.13% (0.1416 => 0.1400, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 1.10% (1.4448 => 1.4607, std.dev.: 0.0349) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -2.22% (0.1530 => 0.1496, std.dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.32% (0.4060 => 0.4073, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.01% (0.1441 => 0.1412, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.63% (0.0561 => 0.0615, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 37.63% (0.0186 => 0.0256, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.19% (0.0594 => 0.0607, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.48% (1.1262 => 1.1316, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 58.33% (0.0012 => 0.0019, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 380.00% (0.0005 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.61% (0.0606 => 0.0640, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.60% (0.0232 => 0.0219, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.55% (0.7645 => 0.7687, std.dev.: 0.0136) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.01% (1.7065 => 1.7063, std.dev.: 0.0160) SingleSource/UnitTests/2003-07-09-SignedArgs: 25.00% (0.0004 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 68.06% (0.0072 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 134.83% (0.0089 => 0.0209, std.dev.: 0.0007) SingleSource/UnitTests/2003-08-11-VaListArg: 180.00% (0.0090 => 0.0252, std.dev.: 0.0006) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -27.08% (4.1772 => 3.0461, std.dev.: 0.0357) SingleSource/Benchmarks/Shootout-C++/except: 82483.33% (0.0006 => 0.4955, std.dev.: 0.0137) SingleSource/Regression/C++/EH/ctor_dtor_count: -33.33% (0.0006 => 0.0004, std.dev.: 0.0001) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.22% (0.0745 => 0.0918, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.25% (0.1414 => 0.1559, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.06% (0.1159 => 0.1264, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 8.99% (2.1763 => 2.3720, std.dev.: 0.0241) SingleSource/Benchmarks/Misc-C++/bigfib: 8.72% (0.5309 => 0.5772, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.53% (0.6410 => 0.6957, std.dev.: 0.0102) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.12% (0.3582 => 0.3873, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 7.82% (0.6173 => 0.6656, std.dev.: 0.0082) MultiSource/Applications/SIBsim4/SIBsim4: 7.34% (1.1653 => 1.2508, std.dev.: 0.0088) MultiSource/Applications/lemon/lemon: 7.14% (1.0046 => 1.0763, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.23% (0.2552 => 0.2711, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 6.19% (0.3217 => 0.3416, std.dev.: 0.0062) MultiSource/Applications/kimwitu++/kc: 6.12% (15.3105 => 16.2470, std.dev.: 0.2236) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.91% (1.5150 => 1.6045, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.72% (0.2797 => 0.2957, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 5.70% (0.6915 => 0.7309, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.68% (1.1672 => 1.2335, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.47% (0.7639 => 0.8057, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/oourafft: 5.43% (0.1971 => 0.2078, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.39% (0.6069 => 0.6396, std.dev.: 0.0074) MultiSource/Applications/d/make_dparser: 5.11% (3.0225 => 3.1770, std.dev.: 0.0184) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.11% (0.4248 => 0.4465, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.06% (0.4880 => 0.5127, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.05% (0.2654 => 0.2788, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.97% (0.3901 => 0.4095, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists1: 4.94% (0.2771 => 0.2908, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.92% (0.8569 => 0.8991, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.77% (0.7722 => 0.8090, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.73% (1.1827 => 1.2386, std.dev.: 0.0028) MultiSource/Applications/siod/siod: 4.65% (2.0972 => 2.1948, std.dev.: 0.0258) MultiSource/Applications/hbd/hbd: 4.63% (1.3268 => 1.3882, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.44% (0.3062 => 0.3198, std.dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 4.44% (13.3238 => 13.9148, std.dev.: 0.0558) MultiSource/Benchmarks/Bullet/bullet: 4.43% (29.3170 => 30.6157, std.dev.: 0.1321) MultiSource/Benchmarks/McCat/09-vor/vor: 4.43% (0.3026 => 0.3160, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.35% (6.2546 => 6.5269, std.dev.: 0.0299) MultiSource/Applications/Burg/burg: 4.30% (1.1440 => 1.1932, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.29% (12.6413 => 13.1835, std.dev.: 0.0200) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.13% (1.2021 => 1.2518, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.09% (0.2886 => 0.3004, std.dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 4.06% (8.2186 => 8.5525, std.dev.: 0.0155) MultiSource/Applications/oggenc/oggenc: 3.90% (4.7455 => 4.9306, std.dev.: 0.0614) SingleSource/Benchmarks/Shootout-C++/sieve: 3.90% (0.2593 => 0.2694, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.89% (1.0821 => 1.1242, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.85% (0.7226 => 0.7504, std.dev.: 0.0024) MultiSource/Applications/treecc/treecc: 3.78% (1.8798 => 1.9509, std.dev.: 0.0084) MultiSource/Applications/sgefa/sgefa: 3.72% (0.2877 => 0.2984, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 3.70% (3.5980 => 3.7312, std.dev.: 0.0191) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.60% (3.0758 => 3.1864, std.dev.: 0.0354) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.56% (0.7784 => 0.8061, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.54% (0.5740 => 0.5943, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.40% (2.0317 => 2.1008, std.dev.: 0.0197) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.39% (4.0318 => 4.1684, std.dev.: 0.0232) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.38% (1.0689 => 1.1050, std.dev.: 0.0053) MultiSource/Applications/JM/lencod/lencod: 3.31% (14.7256 => 15.2131, std.dev.: 0.0908) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.02% (0.4562 => 0.4700, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/gs/gs: 2.98% (3.8796 => 3.9954, std.dev.: 0.0121) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.97% (0.5963 => 0.6140, std.dev.: 0.0030) MultiSource/Applications/JM/ldecod/ldecod: 2.88% (6.4908 => 6.6777, std.dev.: 0.0342) SingleSource/Benchmarks/Shootout-C++/hash2: 2.70% (0.3847 => 0.3951, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.62% (4.2616 => 4.3732, std.dev.: 0.0215) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.56% (1.2742 => 1.3068, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.52% (8.2559 => 8.4641, std.dev.: 0.0218) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.51% (4.3380 => 4.4468, std.dev.: 0.0167) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.38% (4.2815 => 4.3834, std.dev.: 0.0192) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.03% (0.5520 => 0.5632, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.73% (0.9029 => 0.9185, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.39% (1.3935 => 1.4128, std.dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: 1.36% (0.9425 => 0.9553, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.46% (1.6538 => 2.3395, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/matrix: 22.14% (3.4629 => 4.2295, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/ary3: 16.72% (1.7426 => 2.0339, std.dev.: 0.0616) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.64% (2.4042 => 2.7562, std.dev.: 0.0181) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.66% (4.0101 => 4.5579, std.dev.: 0.0328) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 11.35% (1.0063 => 1.1205, std.dev.: 0.0102) SingleSource/Benchmarks/McGill/queens: 11.08% (1.6261 => 1.8063, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/mason/mason: 10.05% (0.5004 => 0.5507, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: 8.77% (7.0025 => 7.6164, std.dev.: 0.0171) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.54% (0.2857 => 0.3101, std.dev.: 0.0040) SingleSource/Benchmarks/Stanford/Puzzle: 8.16% (0.1433 => 0.1550, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.45% (4.2129 => 4.4845, std.dev.: 0.0254) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.91% (0.3301 => 0.3463, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/dt: 4.40% (0.9851 => 1.0284, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: 4.20% (15.2242 => 15.8640, std.dev.: 0.0453) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.87% (3.4080 => 3.5400, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 3.60% (6.9722 => 7.2234, std.dev.: 0.0632) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.83% (6.6312 => 6.8191, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 2.70% (3.5520 => 3.6478, std.dev.: 0.0216) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.50% (2.6656 => 2.7323, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/hash: 2.33% (0.6308 => 0.6455, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.26% (0.5876 => 0.6009, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/whetstone: 2.13% (2.3453 => 2.3953, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.71% (4.6127 => 4.6916, std.dev.: 0.0176) MultiSource/Benchmarks/Olden/power/power: 1.33% (1.4184 => 1.4373, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.22% (1.2726 => 1.2881, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.21% (2.4455 => 2.4750, std.dev.: 0.0070) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (5.1938 => 5.2545, std.dev.: 0.0215) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -43.93% (0.2996 => 0.1680, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -43.65% (0.0591 => 0.0333, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.13% (1.4113 => 1.1555, std.dev.: 0.0210) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.80% (1.4189 => 1.1663, std.dev.: 0.0064) SingleSource/UnitTests/Vector/constpool: -3.90% (8.9977 => 8.6465, std.dev.: 0.1349) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.18% (0.3497 => 0.2127, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: -19.64% (5.2665 => 4.2319, std.dev.: 0.0718) SingleSource/Benchmarks/Shootout-C++/ary3: -19.59% (1.7473 => 1.4050, std.dev.: 0.1072) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.09% (1.7361 => 1.4741, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1606, std.dev.: 0.0123) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -10.97% (15.8312 => 14.0943, std.dev.: 0.3306) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.43% (1.1647 => 1.0549, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: -8.45% (9.5474 => 8.7407, std.dev.: 0.0179) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.16% (1.4034 => 1.2889, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.55% (3.2007 => 2.9591, std.dev.: 0.0309) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.72% (3.6254 => 3.3818, std.dev.: 0.0444) MultiSource/Applications/lambda-0_1_3/lambda: -6.64% (7.6833 => 7.1729, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/fibo: -6.50% (4.6355 => 4.3342, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: -6.45% (1.4441 => 1.3509, std.dev.: 0.0107) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.97% (2.9728 => 2.7954, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.47% (3.9413 => 3.7257, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout/fib2: -5.24% (4.4195 => 4.1881, std.dev.: 0.0129) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.04% (0.4564 => 0.4334, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/bh/bh: -4.98% (2.5166 => 2.3913, std.dev.: 0.0108) MultiSource/Applications/sgefa/sgefa: -4.35% (0.3746 => 0.3583, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -4.15% (62.4126 => 59.8195, std.dev.: 0.0565) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.52% (1.1683 => 1.1272, std.dev.: 0.0097) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.49% (1.4021 => 1.3531, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/methcall: -3.32% (9.2503 => 8.9430, std.dev.: 0.0395) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.00% (1.2722 => 1.2340, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.54% (3.7496 => 3.6545, std.dev.: 0.0333) SingleSource/Benchmarks/Dhrystone/dry: -2.23% (2.4013 => 2.3477, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -2.21% (92.7467 => 90.6983, std.dev.: 0.3587) SingleSource/Benchmarks/Shootout-C++/hash2: -1.93% (3.4876 => 3.4202, std.dev.: 0.0090) MultiSource/Applications/aha/aha: -1.91% (3.4286 => 3.3631, std.dev.: 0.0045) MultiSource/Applications/SIBsim4/SIBsim4: -1.87% (3.4230 => 3.3590, std.dev.: 0.0224) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.70% (9.3855 => 9.2256, std.dev.: 0.0375) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.65% (2.3569 => 2.3180, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -1.52% (1.0926 => 1.0760, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: -1.41% (3.8907 => 3.8357, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.34% (25.6658 => 25.3213, std.dev.: 0.0474) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.33% (1.8739 => 1.8489, std.dev.: 0.0057) MultiSource/Applications/JM/lencod/lencod: -1.21% (6.7458 => 6.6639, std.dev.: 0.0190) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.05% (27.1724 => 26.8861, std.dev.: 0.0794) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.95% (0.9980 => 1.0274, std.dev.: 0.0052) MultiSource/Applications/sqlite3/sqlite3: 2.52% (0.6022 => 0.6174, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/08-main/main: 8.82% (0.1666 => 0.1813, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.67% (0.1554 => 0.1580, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.92% (0.3083 => 0.3173, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.13% (0.2394 => 0.2421, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.17% (0.3175 => 0.3244, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.65% (0.2302 => 0.2317, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: 2.90% (0.0449 => 0.0462, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.92% (0.0240 => 0.0247, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -27.60% (0.0192 => 0.0139, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -13.08% (0.0390 => 0.0339, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.33% (0.0301 => 0.0297, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.76% (0.0284 => 0.0289, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 2.16% (0.0324 => 0.0331, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 3.39% (0.0177 => 0.0183, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -2.12% (0.0189 => 0.0185, std.dev.: 0.0008) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0249 => 0.0250, std.dev.: 0.0010) SingleSource/UnitTests/byval-alignment: 3.08% (0.0325 => 0.0335, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -70.00% (0.0010 => 0.0003, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -2.03% (0.1429 => 0.1400, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: -2.74% (1.5019 => 1.4607, std.dev.: 0.0349) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.33% (0.1501 => 0.1496, std.dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.48% (0.4264 => 0.4073, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.06% (0.1344 => 0.1412, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.41% (0.0589 => 0.0615, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 10.34% (0.0232 => 0.0256, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.01% (0.0639 => 0.0607, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.30% (1.1350 => 1.1316, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 216.67% (0.0006 => 0.0019, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.47% (0.0637 => 0.0640, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.98% (0.0246 => 0.0219, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.94% (0.7541 => 0.7687, std.dev.: 0.0136) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.07% (1.5363 => 1.7063, std.dev.: 0.0160) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 5 00:00:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 02:00:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121005070023.CA3E32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4593?compare_to=4590&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4593, Order: 165298, Start Time: 2012-10-05 05:42:06, End Time: 2012-10-05 07:02:06 To: 4590, Order: 165289, Start Time: 2012-10-05 03:53:25, End Time: 2012-10-05 05:12:48 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (156 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 953 (688 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.02% (0.5854 => 0.5855, std.dev.: 0.0104) MultiSource/Applications/SPASS/SPASS: -0.04% (16.1442 => 16.1382, std.dev.: 0.0143) MultiSource/Benchmarks/Bullet/bullet: 0.27% (54.5585 => 54.7062, std.dev.: 0.9226) MultiSource/Benchmarks/MallocBench/gs/gs: -0.11% (4.3839 => 4.3791, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.22% (0.0464 => 0.0463, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.43% (0.0466 => 0.0468, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0434 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.23% (0.0435 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.47% (0.0424 => 0.0422, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.24% (0.0423 => 0.0424) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.48% (0.0417 => 0.0415, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.24% (0.0417 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.23% (0.0435 => 0.0434, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.23% (0.0435 => 0.0434, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0428 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0429 => 0.0429, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.48% (0.0420 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.24% (0.0420 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0425 => 0.0425) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.23% (0.0427 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.46% (0.0438 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0438 => 0.0438, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.24% (0.0413 => 0.0414, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0414 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.23% (0.0426 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0426 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.24% (0.0417 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.24% (0.0418 => 0.0417, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.24% (0.0409 => 0.0408, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0410 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0408 => 0.0408, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.24% (0.0409 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.22% (0.0445 => 0.0444, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.45% (0.0447 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.74% (0.0407 => 0.0410, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.49% (0.0409 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.24% (0.0409 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0409 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0416 => 0.0416, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0417 => 0.0417, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.06% (1.2436 => 1.2443, std.dev.: 0.0061) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.05% (7.7373 => 7.7411, std.dev.: 0.0184) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.16% (0.7383 => 0.7371, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0362 => 0.0362, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1432 => 0.1433, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.05% (0.2139 => 0.2138, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -13.50% (63.2438 => 54.7062, std.dev.: 0.9226) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.28% (14.1553 => 18.7248, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: 60.45% (3.4629 => 5.5561, std.dev.: 0.0012) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14229.44% (0.0720 => 10.3172, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952300.00% (0.0001 => 9.9524, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 47.69% (0.2554 => 0.3772, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 40.40% (10.3673 => 14.5559, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/distray/distray: 30.49% (0.1056 => 0.1378, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 29.41% (0.1622 => 0.2099, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.01% (2.2022 => 2.5328, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 14.53% (0.1432 => 0.1640, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.18% (0.1566 => 0.1788, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.13% (7.0540 => 8.0508, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.36% (1.7609 => 1.9786, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.11% (0.0834 => 0.0935, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.94% (0.0871 => 0.0975, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 10.97% (0.3282 => 0.3642, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.92% (0.1584 => 0.1757, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.54% (0.3473 => 0.3839, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.53% (0.3543 => 0.3916, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.47% (0.3543 => 0.3914, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/synchronized: 10.39% (0.3561 => 0.3931, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.38% (0.3516 => 0.3881, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 10.38% (0.3497 => 0.3860, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 10.14% (0.1440 => 0.1586, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.13% (0.3927 => 0.4325, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.12% (0.3694 => 0.4068, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.06% (0.3828 => 0.4213, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 9.98% (0.3886 => 0.4274, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.45% (0.1143 => 0.1251, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.06% (0.4879 => 0.5321, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 8.88% (0.1655 => 0.1802, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 8.87% (0.7433 => 0.8092, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 8.78% (0.7115 => 0.7740, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.78% (0.3177 => 0.3456, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.75% (0.6675 => 0.7259, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.71% (0.5925 => 0.6441, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 8.63% (9.4845 => 10.3030, std.dev.: 0.1647) SingleSource/UnitTests/ObjC++/property-reference-object: 8.57% (0.6030 => 0.6547, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 8.56% (0.3109 => 0.3375, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.50% (0.1236 => 0.1341, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.43% (0.1625 => 0.1762, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.41% (0.1438 => 0.1559, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.38% (1.5415 => 1.6707, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.32% (0.4615 => 0.4999, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 8.32% (0.1695 => 0.1836, std.dev.: 0.0045) MultiSource/Applications/oggenc/oggenc: 8.31% (5.7591 => 6.2377, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.08% (1.3050 => 1.4105, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/18-imp/imp: 8.00% (0.3423 => 0.3697, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.97% (0.5105 => 0.5512, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.94% (0.2065 => 0.2229, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.93% (0.2271 => 0.2451, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.85% (0.2700 => 0.2912, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 7.81% (0.7326 => 0.7898, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.78% (0.1337 => 0.1441) MultiSource/Applications/JM/ldecod/ldecod: 7.73% (10.4361 => 11.2432, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.73% (0.5860 => 0.6313, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 7.70% (3.3354 => 3.5923, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.68% (0.8172 => 0.8800, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.68% (0.1510 => 0.1626, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.67% (0.5569 => 0.5996, std.dev.: 0.0069) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.59% (4.2646 => 4.5884, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.56% (0.8067 => 0.8677, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 7.56% (0.6456 => 0.6944, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.53% (0.3121 => 0.3356, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 7.48% (0.3422 => 0.3678, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.47% (0.1940 => 0.2085, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.47% (0.2758 => 0.2964, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.45% (0.2107 => 0.2264, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.44% (0.3307 => 0.3553, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 7.44% (0.4289 => 0.4608, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.41% (0.4103 => 0.4407, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.39% (5.0018 => 5.3713, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.37% (4.9449 => 5.3092, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.35% (0.9765 => 1.0483, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.35% (0.5020 => 0.5389, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.30% (0.2905 => 0.3117, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.25% (0.4636 => 0.4972, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.22% (8.1363 => 8.7234, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.21% (0.4203 => 0.4506, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.21% (0.3650 => 0.3913, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 7.13% (1.1642 => 1.2472, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 7.12% (0.7835 => 0.8393, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.09% (0.3865 => 0.4139, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.06% (0.2891 => 0.3095, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 6.94% (0.3387 => 0.3622, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.92% (0.2831 => 0.3027, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.89% (0.4048 => 0.4327, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 6.87% (3.8723 => 4.1383, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/lists1: 6.84% (0.3684 => 0.3936, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.83% (0.3603 => 0.3849, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.80% (0.3162 => 0.3377, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.80% (0.4620 => 0.4934, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.80% (0.3826 => 0.4086, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 6.79% (1.5603 => 1.6663, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.79% (0.3136 => 0.3349, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.79% (7.9617 => 8.5024, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary: 6.71% (0.3232 => 0.3449, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.69% (2.0665 => 2.2048, std.dev.: 0.0041) MultiSource/Applications/viterbi/viterbi: 6.69% (0.1555 => 0.1659, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.65% (0.2871 => 0.3062, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.65% (0.2872 => 0.3063, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.64% (0.2725 => 0.2906, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 6.62% (0.3098 => 0.3303, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.60% (0.2756 => 0.2938, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.57% (0.2603 => 0.2774, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.57% (0.3441 => 0.3667, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.55% (0.3283 => 0.3498, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 6.49% (1.0722 => 1.1418, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 6.48% (2.0273 => 2.1586, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.43% (0.2877 => 0.3062, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.42% (0.3052 => 0.3248, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.39% (0.2802 => 0.2981, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.34% (1.5859 => 1.6865, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hello: 6.34% (0.2714 => 0.2886, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.30% (1.1861 => 1.2608, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.27% (0.2793 => 0.2968) MultiSource/Benchmarks/McCat/09-vor/vor: 6.13% (0.3180 => 0.3375, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.11% (0.6450 => 0.6844, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 6.05% (2.2969 => 2.4359, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.04% (0.5981 => 0.6342, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 5.95% (0.4299 => 0.4555, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.95% (0.3379 => 0.3580, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 5.88% (0.8921 => 0.9446, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.69% (2.2024 => 2.3277, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.55% (0.1892 => 0.1997, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 5.53% (21.9371 => 23.1498, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.49% (0.4064 => 0.4287, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.39% (1.4186 => 1.4951, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.35% (0.1906 => 0.2008, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 5.02% (1.1840 => 1.2434, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.82% (0.3131 => 0.3282, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.75% (1.2842 => 1.3452, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.55% (0.2266 => 0.2369, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.32% (0.8101 => 0.8451, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.21% (0.3427 => 0.3537, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.10% (14.3668 => 14.8118, std.dev.: 0.0209) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.80% (0.3817 => 0.3924, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.68% (3.8922 => 3.9967, std.dev.: 0.0076) MultiSource/Applications/sqlite3/sqlite3: 2.55% (17.1811 => 17.6192, std.dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.89% (1.1396 => 1.2523, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.22% (3.1595 => 3.4507, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 6.64% (3.1578 => 3.3676, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.71% (3.6395 => 3.7746, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.66% (4.2280 => 4.3405, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7655, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8127, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.36% (0.9540 => 0.9670, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.11% (2.6546 => 2.6841, std.dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1289, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.00% (0.8651 => 0.1730, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.23% (5.2763 => 3.2592, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.89% (5.3855 => 3.6141, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.55% (5.3526 => 3.6104, std.dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -14.40% (54.1659 => 46.3686, std.dev.: 0.0229) MultiSource/Benchmarks/FreeBench/mason/mason: -13.44% (0.0811 => 0.0702, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -11.39% (22.1758 => 19.6492, std.dev.: 0.0345) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.72% (2.9384 => 2.6234, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.39% (1.1492 => 0.7655, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.80% (1.6925 => 1.4251, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.63% (0.0998 => 0.0862, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.50% (1.2373 => 1.0950, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -10.99% (1.5373 => 1.3684, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/mason/mason: -9.81% (0.2161 => 0.1949, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.20% (19.9488 => 18.3132, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.75% (1.8329 => 1.7091, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8477, std.dev.: 0.0150) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.28% (1.6805 => 1.5917, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.79% (1.5835 => 1.5076, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.33% (0.9957 => 0.9526, std.dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.64% (3.2827 => 3.1631, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4971, std.dev.: 0.0069) MultiSource/Applications/hexxagon/hexxagon: -3.01% (12.4730 => 12.0980, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.01% (8.1563 => 7.9921, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0842, std.dev.: 0.0279) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.90% (8.6802 => 8.5154, std.dev.: 0.0035) SingleSource/UnitTests/Vector/multiplies: -1.74% (2.5528 => 2.5083, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6815, std.dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4202, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.10% (1.0313 => 1.0200, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/lists: -1.08% (6.2999 => 6.2316, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8595, std.dev.: 0.0184) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 11.97% (0.5229 => 0.5855, std.dev.: 0.0104) MultiSource/Applications/SPASS/SPASS: 7.66% (14.9895 => 16.1382, std.dev.: 0.0143) MultiSource/Benchmarks/MallocBench/gs/gs: 6.53% (4.1105 => 4.3791, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.63% (1.1048 => 1.2443, std.dev.: 0.0061) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.14% (7.1582 => 7.7411, std.dev.: 0.0184) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.47% (0.6222 => 0.7371, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36100.00% (0.0001 => 0.0362, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.04% (0.2116 => 0.2138, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 5 00:10:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 02:10:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121005071035.3C3B52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4594?compare_to=4591&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4594, Order: 165298, Start Time: 2012-10-05 05:44:16, End Time: 2012-10-05 07:12:17 To: 4591, Order: 165289, Start Time: 2012-10-05 03:49:33, End Time: 2012-10-05 05:15:07 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 1 (174 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1038 (689 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.77% (54.4039 => 56.4555, std.dev.: 0.0872) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.02% (2.7522 => 2.7527, std.dev.: 0.0405) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.00% (2.1154 => 2.1155, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.00% (4.9747 => 4.9749, std.dev.: 0.0450) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 22.26% (2.0176 => 2.4667, std.dev.: 0.0238) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.80% (0.1410 => 0.1661, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 15.86% (0.0826 => 0.0957, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 14.49% (0.2243 => 0.2568, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 12.79% (1.3693 => 1.5444, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash: 12.60% (0.4062 => 0.4574, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.59% (0.0834 => 0.0939, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 12.55% (0.4328 => 0.4871, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 12.32% (0.5818 => 0.6535, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: 12.28% (0.5748 => 0.6454, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 12.24% (0.1013 => 0.1137, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.13% (0.1072 => 0.1202, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sumcol: 12.11% (0.2782 => 0.3119, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 12.08% (0.3022 => 0.3387, std.dev.: 0.0106) SingleSource/Regression/C++/ofstream_ctor: 12.05% (0.2781 => 0.3116, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.96% (0.1413 => 0.1582, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 11.94% (0.7061 => 0.7904, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.78% (0.1588 => 0.1775, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 11.67% (0.2690 => 0.3004, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.64% (0.2655 => 0.2964, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 11.62% (0.2607 => 0.2910, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 11.58% (0.2937 => 0.3277, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.50% (0.2721 => 0.3034, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/fibo: 11.49% (0.2628 => 0.2930, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 11.48% (0.2726 => 0.3039, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.45% (0.1327 => 0.1479, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/except: 11.34% (0.2760 => 0.3073, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 11.34% (0.2761 => 0.3074, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.33% (0.3485 => 0.3880, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.26% (0.3899 => 0.4338, std.dev.: 0.0148) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.24% (3.9660 => 4.4119, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 11.18% (0.3489 => 0.3879, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C++/office/office: 11.16% (0.2966 => 0.3297, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 11.15% (0.7038 => 0.7823, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/city/city: 11.15% (1.9828 => 2.2038, std.dev.: 0.0734) SingleSource/Benchmarks/Shootout-C++/heapsort: 11.10% (0.2765 => 0.3072, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.10% (0.0964 => 0.1071, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 11.09% (0.2696 => 0.2995, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.09% (0.3580 => 0.3977, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists: 11.08% (0.3293 => 0.3658, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.03% (0.4016 => 0.4459, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.98% (0.6283 => 0.6973, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 10.98% (0.3453 => 0.3832, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.97% (0.3756 => 0.4168, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.96% (1.2193 => 1.3529, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.94% (0.2596 => 0.2880, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 10.92% (0.3149 => 0.3493, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 10.91% (0.3107 => 0.3446, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 10.81% (0.3192 => 0.3537, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.77% (0.4390 => 0.4863, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.76% (1.4563 => 1.6130, std.dev.: 0.0342) SingleSource/Benchmarks/Shootout-C++/moments: 10.73% (0.3868 => 0.4283, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.72% (0.9199 => 1.0185, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/matrix: 10.68% (0.2988 => 0.3307, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 10.64% (0.1062 => 0.1175, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.50% (0.5265 => 0.5818, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.40% (0.6959 => 0.7683, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.31% (1.1364 => 1.2536, std.dev.: 0.0305) SingleSource/Benchmarks/Shootout-C++/lists1: 10.24% (0.3534 => 0.3896, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 10.17% (13.8202 => 15.2259, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/objinst: 9.88% (0.2945 => 0.3236, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.87% (0.4791 => 0.5264, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.77% (0.5577 => 0.6122, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.77% (0.1157 => 0.1270, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 9.72% (0.2995 => 0.3286, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.59% (0.3755 => 0.4115, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.55% (0.3130 => 0.3429, std.dev.: 0.0059) MultiSource/Applications/lemon/lemon: 9.47% (1.0313 => 1.1290, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.38% (0.6576 => 0.7193, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.33% (0.1276 => 0.1395, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: 9.31% (0.1589 => 0.1737, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.30% (0.8698 => 0.9507, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.25% (0.4379 => 0.4784, std.dev.: 0.0145) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.23% (0.2914 => 0.3183, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.20% (0.1435 => 0.1567, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.12% (0.2127 => 0.2321, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 9.03% (16.6129 => 18.1136, std.dev.: 0.0067) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.03% (0.3511 => 0.3828, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.98% (0.5637 => 0.6143, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 8.94% (1.1061 => 1.2050, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/football/football: 8.83% (0.8310 => 0.9044, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 8.79% (1.0594 => 1.1525, std.dev.: 0.0254) MultiSource/Benchmarks/McCat/18-imp/imp: 8.76% (0.3220 => 0.3502, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: 8.75% (0.6744 => 0.7334, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.66% (7.2180 => 7.8431, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.66% (0.7460 => 0.8106, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.66% (0.3246 => 0.3527, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 8.60% (3.8646 => 4.1969, std.dev.: 0.0074) MultiSource/Applications/spiff/spiff: 8.59% (0.7506 => 0.8151, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: 8.56% (0.3131 => 0.3399, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 8.39% (3.1889 => 3.4566, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.35% (0.2023 => 0.2192, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 8.21% (1.9270 => 2.0853, std.dev.: 0.0115) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.20% (0.1865 => 0.2018, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.19% (0.8818 => 0.9540, std.dev.: 0.0143) MultiSource/Applications/JM/lencod/lencod: 8.14% (14.8535 => 16.0631, std.dev.: 0.0079) MultiSource/Applications/siod/siod: 8.09% (2.1791 => 2.3554, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.05% (3.6692 => 3.9647, std.dev.: 0.0790) MultiSource/Applications/viterbi/viterbi: 8.05% (0.1478 => 0.1597, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 8.03% (0.2925 => 0.3160, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 7.93% (1.2749 => 1.3760, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 7.85% (8.4961 => 9.1632, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.84% (4.3801 => 4.7235, std.dev.: 0.0993) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.84% (0.1569 => 0.1692, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.81% (1.3245 => 1.4280, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 7.80% (1.2292 => 1.3251, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.74% (4.4433 => 4.7872, std.dev.: 0.1275) MultiSource/Benchmarks/Olden/em3d/em3d: 7.60% (0.1657 => 0.1783, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/05-eks/eks: 7.59% (0.4113 => 0.4425, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 7.57% (0.4003 => 0.4306, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.53% (0.6135 => 0.6597, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 7.46% (0.3914 => 0.4206, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 7.46% (0.6250 => 0.6716, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.45% (4.9865 => 5.3580, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/trivial-interface: 7.41% (0.3578 => 0.3843, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 7.30% (4.6629 => 5.0035, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/for-in: 7.28% (0.3789 => 0.4065, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 7.24% (0.3646 => 0.3910, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/property: 7.21% (0.3940 => 0.4224, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.18% (0.3663 => 0.3926, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.16% (0.3601 => 0.3859, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.12% (0.3650 => 0.3910, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.12% (0.3623 => 0.3881, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.91% (0.4805 => 0.5137, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.87% (0.9108 => 0.9734, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.86% (3.2742 => 3.4987, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.79% (1.1333 => 1.2102, std.dev.: 0.0075) MultiSource/Applications/JM/ldecod/ldecod: 6.77% (6.5754 => 7.0206, std.dev.: 0.0102) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.71% (0.2504 => 0.2672, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.67% (1.5188 => 1.6201, std.dev.: 0.0183) SingleSource/Benchmarks/Misc/oourafft: 6.37% (0.2008 => 0.2136, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.32% (0.3245 => 0.3450, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.28% (6.2785 => 6.6727, std.dev.: 0.1527) MultiSource/Applications/lua/lua: 5.91% (3.7467 => 3.9680, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.86% (0.2321 => 0.2457, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.76% (2.1007 => 2.2217, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.21% (13.2842 => 13.9761, std.dev.: 0.2686) MultiSource/Applications/sqlite3/sqlite3: 3.67% (16.2614 => 16.8588, std.dev.: 0.0224) MultiSource/Applications/ClamAV/clamscan: 3.30% (14.5298 => 15.0090, std.dev.: 0.0167) MultiSource/Benchmarks/Bullet/bullet: 1.17% (33.2944 => 33.6846, std.dev.: 0.0320) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.47% (5.7573 => 7.5116, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fbench: 24.73% (1.8175 => 2.2669, std.dev.: 0.0505) SingleSource/Benchmarks/Misc/richards_benchmark: 11.13% (1.1560 => 1.2847, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4142, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.19% (1.2998 => 1.3803, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0004, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0042, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6762, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9851, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.20% (10.7476 => 11.0920, std.dev.: 0.0380) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.09% (7.4271 => 7.5821, std.dev.: 0.0055) MultiSource/Applications/lemon/lemon: 1.79% (1.4298 => 1.4554, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.44% (8.3908 => 8.5119, std.dev.: 0.0456) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2123, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1887, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5784, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0268, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5859, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.42% (0.2670 => 0.1404, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.65% (0.4657 => 0.3928, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/mason/mason: -15.56% (0.0707 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.01% (1.3819 => 1.1883, std.dev.: 0.0309) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.97% (1.3813 => 1.1883, std.dev.: 0.0334) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.41% (22.5627 => 21.7943, std.dev.: 0.0213) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.93% (0.2238 => 0.1971, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.95% (1.2308 => 1.0960, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.05% (20.3410 => 18.2971, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5135, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.53% (0.9996 => 0.9543, std.dev.: 0.0096) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.48% (1.3780 => 1.3162, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8001, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -3.55% (3.2729 => 3.1568, std.dev.: 0.0243) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.40% (1.7688 => 1.7087, std.dev.: 0.0050) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4781, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.49% (26.5159 => 25.8550, std.dev.: 0.0186) MultiSource/Applications/spiff/spiff: -2.48% (3.0263 => 2.9513, std.dev.: 0.0015) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.33% (1.9762 => 1.9302, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.93% (0.6589 => 0.6462, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7151, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.64% (6.3560 => 6.2515, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0073, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.33% (2.5254 => 2.4917, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: -1.32% (9.3358 => 9.2126, std.dev.: 0.0331) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8675, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: -1.23% (4.5928 => 4.5363, std.dev.: 0.0111) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2576, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.04% (1.0310 => 1.0203, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 5 00:21:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 02:21:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121005072134.64B462A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4595?compare_to=4588&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4595, Order: 165293, Start Time: 2012-10-05 04:10:34, End Time: 2012-10-05 07:23:16 To: 4588, Order: 165273, Start Time: 2012-10-05 00:29:47, End Time: 2012-10-05 03:39:41 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 0 (123 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (131 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1039 (768 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.03% (9.8105 => 9.8137, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.03% (9.4124 => 9.4095, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.03% (16.9553 => 16.9500, std.dev.: 0.0068) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 11.98% (0.3465 => 0.3880, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.96% (0.3446 => 0.3858, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.96% (0.3488 => 0.3905, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.93% (0.3469 => 0.3883, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 11.88% (0.3442 => 0.3851, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.87% (0.3496 => 0.3911, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 11.85% (0.3460 => 0.3870, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.51% (0.3650 => 0.4070, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.47% (0.3643 => 0.4061, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.20% (0.3724 => 0.4141, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 11.08% (1.5932 => 1.7698, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/Hello: 10.28% (0.5826 => 0.6425, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 10.17% (0.5889 => 0.6488, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.73% (0.2875 => 0.3126, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.59% (0.7171 => 0.7787, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/except: 8.40% (0.2811 => 0.3047, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.28% (0.2729 => 0.2955, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.25% (0.2738 => 0.2964, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 8.25% (0.2714 => 0.2938, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.24% (0.2792 => 0.3022, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 8.22% (0.2725 => 0.2949, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.22% (0.5000 => 0.5411, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 8.21% (0.1619 => 0.1752, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 8.17% (0.2780 => 0.3007, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 8.16% (0.3004 => 0.3249, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: 8.13% (0.2803 => 0.3031, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.11% (0.2911 => 0.3147, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.11% (0.3195 => 0.3454, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 8.07% (0.3096 => 0.3346, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 8.04% (0.2750 => 0.2971, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 8.03% (0.2813 => 0.3039, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 7.98% (0.9909 => 1.0700, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.95% (2.0673 => 2.2317, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/objinst: 7.93% (0.2823 => 0.3047, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.68% (0.4361 => 0.4696, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 7.66% (0.3317 => 0.3571, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 7.65% (0.3267 => 0.3517, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.64% (0.3258 => 0.3507, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 7.57% (0.4146 => 0.4460, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 7.56% (0.3678 => 0.3956, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.55% (0.3060 => 0.3291, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 7.46% (0.3726 => 0.4004, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/lists1: 7.45% (0.3477 => 0.3736, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 7.41% (0.3348 => 0.3596, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.33% (1.6211 => 1.7400, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.32% (0.3362 => 0.3608, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.28% (0.3845 => 0.4125, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.28% (0.3282 => 0.3521, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.23% (0.3124 => 0.3350, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.20% (0.3625 => 0.3886, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.19% (3.5627 => 3.8190, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.15% (0.4139 => 0.4435, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.97% (0.3930 => 0.4204, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.96% (0.3981 => 0.4258, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.88% (0.3690 => 0.3944, std.dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.88% (2.7292 => 2.9169, std.dev.: 0.0710) MultiSource/Applications/SPASS/SPASS: 6.86% (5.5417 => 5.9221, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/hash2: 6.85% (0.4251 => 0.4542, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 6.77% (1.0781 => 1.1511, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.77% (0.2866 => 0.3060, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 6.75% (23.5202 => 25.1088, std.dev.: 0.0241) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.69% (0.2736 => 0.2919, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 6.58% (0.4847 => 0.5166, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 6.57% (4.2109 => 4.4875, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.55% (0.1968 => 0.2097, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 6.30% (0.4029 => 0.4283, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.26% (0.6435 => 0.6838, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.23% (0.3903 => 0.4146, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.20% (0.3890 => 0.4131, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.18% (0.4658 => 0.4946, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 6.17% (0.5012 => 0.5321, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 6.04% (0.2566 => 0.2721, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 6.03% (1.8794 => 1.9928, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.03% (0.2969 => 0.3148, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.03% (0.2737 => 0.2902, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 5.93% (0.2075 => 0.2198, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.90% (0.3084 => 0.3266, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 5.86% (2.1013 => 2.2244, std.dev.: 0.0025) MultiSource/Applications/hbd/hbd: 5.86% (0.9697 => 1.0265, std.dev.: 0.0039) MultiSource/Applications/lua/lua: 5.81% (1.4269 => 1.5098, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.75% (0.2068 => 0.2187, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.72% (0.3271 => 0.3458, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 5.66% (0.5546 => 0.5860, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 5.57% (4.6177 => 4.8751, std.dev.: 0.0119) MultiSource/Applications/siod/siod: 5.55% (0.6634 => 0.7002, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.52% (0.2103 => 0.2219, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 5.39% (2.1653 => 2.2821, std.dev.: 0.0058) MultiSource/Applications/SIBsim4/SIBsim4: 5.28% (0.2691 => 0.2833, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 5.28% (0.3336 => 0.3512, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.25% (0.2040 => 0.2147, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 5.24% (0.7875 => 0.8288, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.10% (1.9966 => 2.0984, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 4.81% (2.0346 => 2.1324, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 4.31% (0.2391 => 0.2494, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.27% (0.7426 => 0.7743, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.90% (0.5361 => 0.5570, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.85% (11.6398 => 12.0874, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.68% (4.6926 => 4.8651, std.dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.65% (0.5584 => 0.5788, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 3.57% (0.3498 => 0.3623, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.66% (0.3792 => 0.3893, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 2.63% (11.9555 => 12.2694, std.dev.: 0.0142) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0148) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.12% (0.0734 => 0.0867, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout-C++/ary: 7.63% (0.2122 => 0.2284, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.45% (3.3903 => 3.6090, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6718, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-2: 5.00% (1.8057 => 1.8959, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1646, std.dev.: 0.1445) SingleSource/Benchmarks/Dhrystone/dry: 4.24% (14.0481 => 14.6440, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1964, std.dev.: 0.0070) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5009, std.dev.: 0.0063) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.52% (3.1722 => 3.2204, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2866, std.dev.: 0.0236) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std.dev.: 0.0111) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5850, std.dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.89% (25.4195 => 16.5495, std.dev.: 0.0201) SingleSource/Benchmarks/Shootout-C++/ary2: -8.74% (0.2402 => 0.2192, std.dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9764, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7962, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8020, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.13% (0.6293 => 0.6096, std.dev.: 0.0029) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7736, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -2.34% (17.2379 => 16.8345, std.dev.: 0.0450) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.25% (41.7953 => 40.8558, std.dev.: 0.0094) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5758, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4951, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0197) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.15% (105.3826 => 104.1656, std.dev.: 0.0176) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0439, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 5 01:16:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 03:16:36 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121005081636.039192A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4596?compare_to=4592&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4596, Order: 165304, Start Time: 2012-10-05 06:54:42, End Time: 2012-10-05 08:18:19 To: 4592, Order: 165298, Start Time: 2012-10-05 05:15:03, End Time: 2012-10-05 06:38:24 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (14 on baseline) Performance Regressions: 4 (78 on baseline) Performance Improvements: 5 (44 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 968 (769 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.94% (0.2752 => 0.2888, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.72% (0.8061 => 0.8200, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.36% (0.8883 => 0.9004, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.77% (1.3531 => 1.4176, std.dev.: 0.0176) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Olden/perimeter/perimeter: -19.23% (0.0728 => 0.0588, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/05-eks/eks: -2.78% (0.4346 => 0.4225, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.70% (1.1205 => 1.0902, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/whetstone: -1.16% (2.3953 => 2.3675, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.02% (1.2881 => 1.2750, std.dev.: 0.0034) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -1.13% (1.0274 => 1.0158, std.dev.: 0.0080) MultiSource/Applications/sqlite3/sqlite3: 0.65% (0.6174 => 0.6214, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/08-main/main: -0.39% (0.1813 => 0.1806, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.19% (0.1580 => 0.1583, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.14% (0.3173 => 0.3105, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.77% (0.2421 => 0.2354, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.15% (0.3244 => 0.3239, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.11% (0.2317 => 0.2268, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel: -5.41% (0.0462 => 0.0437, std.dev.: 0.0013) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.40% (0.0247 => 0.0248, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -19.42% (0.0139 => 0.0112, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 15.93% (0.0339 => 0.0393, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.35% (0.0297 => 0.0293, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -15.57% (0.0289 => 0.0244, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.91% (0.0331 => 0.0328, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -0.55% (0.0183 => 0.0182, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -37.30% (0.0185 => 0.0116, std.dev.: 0.0037) SingleSource/UnitTests/Vector/multiplies: 1.20% (0.0250 => 0.0253, std.dev.: 0.0012) SingleSource/UnitTests/byval-alignment: -10.45% (0.0335 => 0.0300, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 233.33% (0.0003 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.07% (0.1400 => 0.1415, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 4.11% (1.4607 => 1.5208, std.dev.: 0.0323) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.53% (0.1496 => 0.1488, std.dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.73% (0.4073 => 0.4184, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.63% (0.1412 => 0.1389, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -13.66% (0.0615 => 0.0531, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -17.97% (0.0256 => 0.0210, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.99% (0.0607 => 0.0601, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.61% (1.1316 => 1.1247, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -36.84% (0.0019 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.37% (0.0640 => 0.0548, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -26.48% (0.0219 => 0.0161, std.dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.07% (0.7687 => 0.7682, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.05% (1.7063 => 1.7054, std.dev.: 0.0011) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 141.57% (0.0089 => 0.0215, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: 167.78% (0.0090 => 0.0241, std.dev.: 0.0002) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -27.09% (4.1772 => 3.0458, std.dev.: 0.0297) SingleSource/Benchmarks/Shootout-C++/except: 82550.00% (0.0006 => 0.4959, std.dev.: 0.0046) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.95% (0.0745 => 0.0916, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 9.55% (2.1763 => 2.3841, std.dev.: 0.0233) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.56% (0.6410 => 0.6959, std.dev.: 0.0166) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.07% (0.3582 => 0.3871, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/bigfib: 7.97% (0.5309 => 0.5732, std.dev.: 0.0063) MultiSource/Applications/minisat/minisat: 7.73% (0.6173 => 0.6650, std.dev.: 0.0063) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.50% (0.1414 => 0.1520, std.dev.: 0.0031) MultiSource/Applications/SIBsim4/SIBsim4: 7.30% (1.1653 => 1.2504, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.10% (1.5150 => 1.6225, std.dev.: 0.0079) MultiSource/Applications/lemon/lemon: 6.79% (1.0046 => 1.0728, std.dev.: 0.0265) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.31% (0.2552 => 0.2713, std.dev.: 0.0038) MultiSource/Applications/kimwitu++/kc: 5.99% (15.3105 => 16.2282, std.dev.: 0.1553) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.47% (0.7639 => 0.8057, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: 5.47% (0.6915 => 0.7293, std.dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.42% (0.6069 => 0.6398, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.41% (0.2886 => 0.3042, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 5.38% (0.3217 => 0.3390, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.88% (1.1672 => 1.2242, std.dev.: 0.0139) MultiSource/Applications/d/make_dparser: 4.75% (3.0225 => 3.1660, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.71% (1.2021 => 1.2587, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.71% (0.4248 => 0.4448, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.63% (1.1827 => 1.2375, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.56% (0.3901 => 0.4079, std.dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: 4.47% (29.3170 => 30.6262, std.dev.: 0.1196) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.44% (6.2546 => 6.5322, std.dev.: 0.0542) MultiSource/Applications/SPASS/SPASS: 4.28% (13.3238 => 13.8941, std.dev.: 0.0138) MultiSource/Applications/lua/lua: 4.13% (3.5980 => 3.7466, std.dev.: 0.0137) MultiSource/Benchmarks/mafft/pairlocalalign: 4.11% (8.2186 => 8.5565, std.dev.: 0.0432) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.05% (0.8569 => 0.8916, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.04% (0.7226 => 0.7518, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.98% (0.5937 => 0.6173, std.dev.: 0.0064) MultiSource/Applications/oggenc/oggenc: 3.89% (4.7455 => 4.9303, std.dev.: 0.0519) MultiSource/Applications/hbd/hbd: 3.89% (1.3268 => 1.3784, std.dev.: 0.0078) MultiSource/Applications/siod/siod: 3.70% (2.0972 => 2.1749, std.dev.: 0.0108) MultiSource/Benchmarks/sim/sim: 3.44% (0.3084 => 0.3190, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 3.33% (0.8405 => 0.8685, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.30% (4.3380 => 4.4811, std.dev.: 0.0329) MultiSource/Applications/JM/lencod/lencod: 3.25% (14.7256 => 15.2043, std.dev.: 0.1280) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.09% (4.0318 => 4.1564, std.dev.: 0.0287) MultiSource/Applications/JM/ldecod/ldecod: 3.05% (6.4908 => 6.6888, std.dev.: 0.0141) MultiSource/Benchmarks/MallocBench/gs/gs: 2.97% (3.8796 => 3.9949, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.97% (0.5520 => 0.5684, std.dev.: 0.0023) MultiSource/Applications/treecc/treecc: 2.84% (1.8798 => 1.9331, std.dev.: 0.0103) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.74% (1.0689 => 1.0982, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.70% (4.2815 => 4.3972, std.dev.: 0.0321) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.67% (4.2616 => 4.3755, std.dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.59% (8.2559 => 8.4696, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.48% (0.7784 => 0.7977, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.28% (0.9029 => 0.9235, std.dev.: 0.0053) MultiSource/Applications/hexxagon/hexxagon: 1.60% (0.9425 => 0.9576, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.35% (1.6538 => 2.3377, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/city/city: 40.61% (0.0261 => 0.0367, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2286, std.dev.: 0.0077) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.58% (2.4042 => 2.7787, std.dev.: 0.0661) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.14% (0.0766 => 0.0882, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/ary3: 14.63% (1.7426 => 1.9976, std.dev.: 0.0275) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.89% (4.0101 => 4.5670, std.dev.: 0.0021) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.43% (0.0917 => 0.1031, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/queens: 11.08% (1.6261 => 1.8063, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/mason/mason: 9.03% (0.5004 => 0.5456, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout/lists: 8.81% (7.0025 => 7.6196, std.dev.: 0.0089) SingleSource/Benchmarks/Stanford/Puzzle: 8.65% (0.1433 => 0.1557, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.34% (1.0063 => 1.0902, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.26% (0.2857 => 0.3093, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 7.05% (40.4792 => 43.3326, std.dev.: 0.3401) SingleSource/Benchmarks/Misc/dt: 4.20% (0.9851 => 1.0265, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/fp-convert: 3.85% (15.2242 => 15.8109, std.dev.: 0.0683) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.80% (3.4080 => 3.5376, std.dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: 3.10% (6.9722 => 7.1883, std.dev.: 0.0782) MultiSource/Applications/siod/siod: 3.00% (3.5520 => 3.6587, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.95% (0.5587 => 0.5752, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.84% (6.6312 => 6.8192, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.45% (0.5876 => 0.6020, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.72% (4.6127 => 4.6922, std.dev.: 0.0216) SingleSource/Benchmarks/Shootout/hash: 1.27% (4.3016 => 4.3564, std.dev.: 0.0122) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.4184 => 1.4352, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.10% (2.4455 => 2.4724, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/em3d/em3d: 1.03% (4.6414 => 4.6894, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -44.23% (0.2996 => 0.1671, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -43.99% (0.0591 => 0.0331, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.55% (1.4189 => 1.1273, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.37% (1.4113 => 1.1521, std.dev.: 0.0049) SingleSource/UnitTests/Vector/constpool: -3.54% (8.9977 => 8.6789, std.dev.: 0.0645) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.06% (0.3497 => 0.2061, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.41% (5.2665 => 4.0865, std.dev.: 0.1439) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.66% (15.8312 => 13.1944, std.dev.: 0.6826) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -14.53% (1.7361 => 1.4838, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1588, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/17-bintr/bintr: -11.67% (0.0917 => 0.0810, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.63% (1.1647 => 1.0525) SingleSource/Benchmarks/Shootout-C++/moments: -9.07% (0.1114 => 0.1013, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: -8.39% (9.5474 => 8.7466, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.36% (1.4034 => 1.2861, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -8.27% (9.2503 => 8.4853, std.dev.: 0.2457) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.26% (3.2007 => 2.9362, std.dev.: 0.0461) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.86% (3.6254 => 3.3767, std.dev.: 0.0075) MultiSource/Applications/lambda-0_1_3/lambda: -6.58% (7.6833 => 7.1774, std.dev.: 0.0317) SingleSource/Benchmarks/Shootout-C++/fibo: -6.56% (4.6355 => 4.3313, std.dev.: 0.0138) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.13% (2.9728 => 2.7906, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/richards_benchmark: -6.04% (1.4441 => 1.3569, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.45% (3.9413 => 3.7266, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/fib2: -5.24% (4.4195 => 4.1878, std.dev.: 0.0131) SingleSource/Benchmarks/McGill/misr: -5.07% (0.4296 => 0.4078, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.06% (0.4564 => 0.4333, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: -5.05% (2.5166 => 2.3896, std.dev.: 0.0104) MultiSource/Benchmarks/mafft/pairlocalalign: -4.21% (62.4126 => 59.7857, std.dev.: 0.0548) MultiSource/Applications/sgefa/sgefa: -3.90% (0.3746 => 0.3600, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/distray/distray: -3.83% (0.2664 => 0.2562, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.39% (1.2722 => 1.2291, std.dev.: 0.0112) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.41% (1.1683 => 1.1402, std.dev.: 0.0061) SingleSource/Benchmarks/Dhrystone/dry: -2.26% (2.4013 => 2.3471, std.dev.: 0.0024) MultiSource/Benchmarks/sim/sim: -1.96% (3.8907 => 3.8145, std.dev.: 0.0054) MultiSource/Applications/SIBsim4/SIBsim4: -1.93% (3.4230 => 3.3571, std.dev.: 0.0159) MultiSource/Benchmarks/PAQ8p/paq8p: -1.86% (92.7467 => 91.0171, std.dev.: 0.2299) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.82% (2.3569 => 2.3139, std.dev.: 0.0071) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.71% (9.3855 => 9.2254, std.dev.: 0.0084) MultiSource/Applications/aha/aha: -1.69% (3.4286 => 3.3705, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/neural/neural: -1.59% (1.0926 => 1.0752, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3076, std.dev.: 0.0116) SingleSource/Benchmarks/Dhrystone/fldry: -1.28% (2.4971 => 2.4651, std.dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.20% (27.1724 => 26.8455, std.dev.: 0.0618) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.78% (0.9980 => 1.0158, std.dev.: 0.0080) MultiSource/Applications/sqlite3/sqlite3: 3.19% (0.6022 => 0.6214, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/08-main/main: 8.40% (0.1666 => 0.1806, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.87% (0.1554 => 0.1583, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.71% (0.3083 => 0.3105, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.67% (0.2394 => 0.2354, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.02% (0.3175 => 0.3239, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.48% (0.2302 => 0.2268, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel: -2.67% (0.0449 => 0.0437, std.dev.: 0.0013) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 3.33% (0.0240 => 0.0248, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -41.67% (0.0192 => 0.0112, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.77% (0.0390 => 0.0393, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.66% (0.0301 => 0.0293, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -14.08% (0.0284 => 0.0244, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.23% (0.0324 => 0.0328, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 2.82% (0.0177 => 0.0182, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -38.62% (0.0189 => 0.0116, std.dev.: 0.0037) SingleSource/UnitTests/Vector/multiplies: 1.61% (0.0249 => 0.0253, std.dev.: 0.0012) SingleSource/UnitTests/byval-alignment: -7.69% (0.0325 => 0.0300, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.98% (0.1429 => 0.1415, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 1.26% (1.5019 => 1.5208, std.dev.: 0.0323) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.87% (0.1501 => 0.1488, std.dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.88% (0.4264 => 0.4184, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.35% (0.1344 => 0.1389, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.85% (0.0589 => 0.0531, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -9.48% (0.0232 => 0.0210, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.95% (0.0639 => 0.0601, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.91% (1.1350 => 1.1247, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.97% (0.0637 => 0.0548, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -34.55% (0.0246 => 0.0161, std.dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.87% (0.7541 => 0.7682, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.01% (1.5363 => 1.7054, std.dev.: 0.0011) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 5 01:53:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 03:53:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121005085332.A57572A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4597?compare_to=4593&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4597, Order: 165305, Start Time: 2012-10-05 07:34:55, End Time: 2012-10-05 08:55:15 To: 4593, Order: 165298, Start Time: 2012-10-05 05:42:06, End Time: 2012-10-05 07:02:06 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 3 (153 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 950 (691 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 32.12% (0.3889 => 0.5138, std.dev.: 0.0274) MultiSource/Benchmarks/PAQ8p/paq8p: 1.91% (14.5559 => 14.8334, std.dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.70% (54.8144 => 56.2938, std.dev.: 0.1341) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.09% (0.5855 => 0.5850, std.dev.: 0.0052) MultiSource/Applications/SPASS/SPASS: 0.01% (16.1382 => 16.1397, std.dev.: 0.0306) MultiSource/Benchmarks/Bullet/bullet: 0.23% (54.7062 => 54.8299, std.dev.: 0.0594) MultiSource/Benchmarks/MallocBench/gs/gs: -0.12% (4.3791 => 4.3737, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.22% (0.0463 => 0.0464, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.64% (0.0468 => 0.0465, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.23% (0.0434 => 0.0433, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.23% (0.0434 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.24% (0.0422 => 0.0423) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.24% (0.0424 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.24% (0.0415 => 0.0416) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0416 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0434 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.23% (0.0434 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0428 => 0.0428, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0429 => 0.0429, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0418 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0419 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0425 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.23% (0.0426 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0436 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.02% (0.0438 => 0.0460, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.24% (0.0414 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0414 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0425 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0426 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0416 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0417 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0408 => 0.0408, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.24% (0.0410 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0408 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.25% (0.0408 => 0.0409) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.23% (0.0444 => 0.0445, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.22% (0.0445 => 0.0446, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.98% (0.0410 => 0.0406, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0407 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0408 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0409 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0416 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.24% (0.0417 => 0.0416, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.22% (1.2443 => 1.2470, std.dev.: 0.0048) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.12% (7.7411 => 7.7315, std.dev.: 0.0158) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.27% (0.7371 => 0.7391, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.28% (0.0362 => 0.0361, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1433 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.51% (0.2138 => 0.2213, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -13.30% (63.2438 => 54.8299, std.dev.: 0.0594) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 31.98% (14.1553 => 18.6816, std.dev.: 0.0149) SingleSource/Benchmarks/Misc-C++-EH/spirit: 60.31% (3.4629 => 5.5513, std.dev.: 0.0015) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14230.69% (0.0720 => 10.3181, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952400.00% (0.0001 => 9.9525, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 48.71% (0.2554 => 0.3798, std.dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: 43.08% (10.3673 => 14.8334, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/richards_benchmark: 30.52% (0.1622 => 0.2117, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: 30.40% (0.1056 => 0.1377, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.42% (2.2022 => 2.5198, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/flops: 14.25% (0.1432 => 0.1636, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.00% (7.0540 => 8.0414, std.dev.: 0.0206) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.86% (0.1566 => 0.1783, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.43% (0.0834 => 0.0946, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.03% (1.7609 => 1.9728, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.60% (0.0871 => 0.0972, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 10.73% (0.3282 => 0.3634, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.48% (0.1584 => 0.1750, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 10.45% (0.3473 => 0.3836, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.44% (0.3543 => 0.3913, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-4: 10.41% (0.3543 => 0.3912, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 10.27% (0.3516 => 0.3877, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.27% (0.3497 => 0.3856, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.22% (0.3561 => 0.3925, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.08% (0.3828 => 0.4214, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/for-in: 9.99% (0.3694 => 0.4063, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/parameter-passing: 9.98% (0.3927 => 0.4319, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.81% (0.1438 => 0.1579, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 9.80% (0.3886 => 0.4267, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 9.72% (0.1440 => 0.1580, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.12% (0.4879 => 0.5324, std.dev.: 0.0012) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.10% (0.1143 => 0.1247, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.07% (0.1125 => 0.1227, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.06% (0.8172 => 0.8912, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.97% (0.3177 => 0.3462, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 8.83% (0.7433 => 0.8089, std.dev.: 0.0025) MultiSource/Applications/minisat/minisat: 8.80% (0.7115 => 0.7741, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/chomp: 8.76% (0.1655 => 0.1800, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.57% (0.6675 => 0.7247, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 8.55% (9.4845 => 10.2956, std.dev.: 0.0081) MultiSource/Applications/sgefa/sgefa: 8.46% (0.3109 => 0.3372, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.42% (0.5569 => 0.6038, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.41% (1.5415 => 1.6711, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.31% (0.1625 => 0.1760, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.30% (0.4615 => 0.4998, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/em3d/em3d: 8.20% (0.1695 => 0.1834, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/Hello: 7.98% (0.5925 => 0.6398, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.95% (1.3050 => 1.4087, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.90% (0.5860 => 0.6323, std.dev.: 0.0042) SingleSource/UnitTests/ObjC++/property-reference-object: 7.89% (0.6030 => 0.6506, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 7.86% (0.3423 => 0.3692, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.82% (0.5105 => 0.5504, std.dev.: 0.0018) MultiSource/Applications/d/make_dparser: 7.69% (3.3354 => 3.5920, std.dev.: 0.0029) MultiSource/Applications/oggenc/oggenc: 7.69% (5.7591 => 6.2017, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 7.66% (10.4361 => 11.2359, std.dev.: 0.0200) MultiSource/Applications/spiff/spiff: 7.62% (0.7835 => 0.8432, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.62% (0.2271 => 0.2444, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.60% (0.2065 => 0.2222, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.52% (0.2700 => 0.2903, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.45% (0.2107 => 0.2264, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.45% (4.2646 => 4.5823, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.42% (0.1510 => 0.1622, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.38% (0.3307 => 0.3551, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.37% (0.1940 => 0.2083, std.dev.: 0.0040) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.37% (0.3121 => 0.3351, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.37% (8.1363 => 8.7356, std.dev.: 0.0259) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.36% (5.0018 => 5.3700, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.32% (4.9449 => 5.3071, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.28% (0.8067 => 0.8654, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.27% (0.9765 => 1.0475, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference: 7.23% (0.7326 => 0.7856, std.dev.: 0.0033) MultiSource/Benchmarks/sim/sim: 7.23% (0.3387 => 0.3632, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 7.22% (0.3422 => 0.3669, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.22% (0.2758 => 0.2957, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/bigfib: 7.16% (0.6456 => 0.6918, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.14% (0.4103 => 0.4396, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.13% (0.5020 => 0.5378, std.dev.: 0.0029) SingleSource/Regression/C++/ofstream_ctor: 7.13% (0.2905 => 0.3112, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash: 7.02% (0.4289 => 0.4590, std.dev.: 0.0027) MultiSource/Applications/Burg/burg: 7.01% (1.1642 => 1.2458, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.97% (0.4203 => 0.4496, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.93% (0.3650 => 0.3903, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.92% (7.9617 => 8.5129, std.dev.: 0.0108) MultiSource/Applications/hbd/hbd: 6.90% (1.5603 => 1.6679, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.78% (0.3865 => 0.4127, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.77% (0.3826 => 0.4085, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 6.75% (0.1555 => 0.1660, std.dev.: 0.0029) MultiSource/Applications/lua/lua: 6.75% (3.8723 => 4.1337, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout-C++/hash2: 6.73% (0.4620 => 0.4931, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.71% (0.2891 => 0.3085, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.63% (0.3136 => 0.3344, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 6.57% (0.3684 => 0.3926, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 6.55% (2.0273 => 2.1601, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/moments: 6.55% (0.4048 => 0.4313, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 6.53% (0.2831 => 0.3016, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 6.48% (1.0722 => 1.1417, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.47% (0.3603 => 0.3836, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.46% (2.0665 => 2.1999, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.45% (0.2603 => 0.2771, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 6.41% (0.2871 => 0.3055, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.39% (0.3441 => 0.3661, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.39% (0.3162 => 0.3364, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.37% (0.2872 => 0.3055, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.34% (0.3232 => 0.3437, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.30% (0.4636 => 0.4928, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.28% (0.2756 => 0.2929, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/fibo: 6.28% (0.2725 => 0.2896, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 6.26% (0.3098 => 0.3292, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.20% (1.1861 => 1.2596, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/wc: 6.19% (0.3052 => 0.3241, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.18% (0.3283 => 0.3486, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.10% (0.2802 => 0.2973, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 6.10% (0.3180 => 0.3374, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.08% (0.2877 => 0.3052, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 6.08% (2.2969 => 2.4365, std.dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.06% (1.5859 => 1.6820, std.dev.: 0.0075) MultiSource/Benchmarks/McCat/05-eks/eks: 6.02% (0.4299 => 0.4558, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.98% (0.2793 => 0.2960, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.89% (0.6450 => 0.6830, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 5.88% (0.8921 => 0.9446, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary2: 5.80% (0.3379 => 0.3575, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.75% (0.5981 => 0.6325, std.dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 5.70% (21.9371 => 23.1886, std.dev.: 0.0357) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.66% (0.1892 => 0.1999, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.30% (2.2024 => 2.3192, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.04% (0.4064 => 0.4269, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.03% (1.4186 => 1.4899, std.dev.: 0.0048) MultiSource/Benchmarks/nbench/nbench: 4.87% (1.1840 => 1.2417, std.dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: 4.45% (1.2842 => 1.3414, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.41% (0.2266 => 0.2366, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.41% (0.3131 => 0.3269, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.15% (0.8101 => 0.8437, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.44% (14.3668 => 14.8611, std.dev.: 0.0155) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.78% (3.8922 => 4.0004, std.dev.: 0.0064) MultiSource/Applications/sqlite3/sqlite3: 2.74% (17.1811 => 17.6527, std.dev.: 0.0160) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.72% (0.3817 => 0.3921, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.31% (1.1194 => 1.1453, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.93% (1.1396 => 1.2528, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Puzzle: 9.85% (0.1421 => 0.1561, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 9.21% (3.1595 => 3.4504, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.62% (3.1578 => 3.3669, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.4162 => 0.4322, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.72% (3.6395 => 3.7748, std.dev.: 0.0008) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.73% (4.2280 => 4.3436, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.33% (1.7254 => 1.7656, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (0.8275 => 0.8405, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8136, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.13% (2.6546 => 2.6846, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1311, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -80.04% (0.8651 => 0.1727, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.44% (5.2763 => 3.2483, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.89% (5.3855 => 3.6140, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.37% (5.3526 => 3.6198, std.dev.: 0.0046) SingleSource/UnitTests/Vector/constpool: -14.40% (54.1659 => 46.3668, std.dev.: 0.0099) MultiSource/Benchmarks/FreeBench/mason/mason: -13.56% (0.0811 => 0.0701, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -11.42% (22.1758 => 19.6430, std.dev.: 0.0428) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.00% (2.9384 => 2.6153, std.dev.: 0.0098) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -33.35% (1.1492 => 0.7659, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -16.30% (1.6925 => 1.4167, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.73% (0.0998 => 0.0861, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -11.81% (1.2373 => 1.0912, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: -10.38% (1.5373 => 1.3778, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/mason/mason: -9.90% (0.2161 => 0.1947, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.36% (19.9488 => 18.2815, std.dev.: 0.0157) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.67% (1.8329 => 1.7107, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.30% (1.6805 => 1.5914, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: -5.06% (1.5835 => 1.5034, std.dev.: 0.0047) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1625, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.36% (0.9957 => 0.9622, std.dev.: 0.0076) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.15% (32.5116 => 31.4870, std.dev.: 0.0086) MultiSource/Applications/hexxagon/hexxagon: -2.99% (12.4730 => 12.0995, std.dev.: 0.0013) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.14% (8.1563 => 7.9818, std.dev.: 0.0128) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.94% (8.6802 => 8.5117, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/salsa20: -1.83% (10.2830 => 10.0952, std.dev.: 0.0166) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6812, std.dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.69% (2.5528 => 2.5097, std.dev.: 0.0024) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4209, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.10% (6.2999 => 6.2305, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.09% (1.0313 => 1.0201, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8586, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 11.88% (0.5229 => 0.5850, std.dev.: 0.0052) MultiSource/Applications/SPASS/SPASS: 7.67% (14.9895 => 16.1397, std.dev.: 0.0306) MultiSource/Benchmarks/MallocBench/gs/gs: 6.40% (4.1105 => 4.3737, std.dev.: 0.0192) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.87% (1.1048 => 1.2470, std.dev.: 0.0048) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.01% (7.1582 => 7.7315, std.dev.: 0.0158) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.79% (0.6222 => 0.7391, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36000.00% (0.0001 => 0.0361, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.58% (0.2116 => 0.2213, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 5 02:05:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 04:05:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121005090552.BA4282A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4598?compare_to=4594&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4598, Order: 165305, Start Time: 2012-10-05 07:41:44, End Time: 2012-10-05 09:07:34 To: 4594, Order: 165298, Start Time: 2012-10-05 05:44:16, End Time: 2012-10-05 07:12:17 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 1 (182 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1037 (682 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.90% (78.7056 => 80.2015, std.dev.: 0.2815) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -1.21% (1.5444 => 1.5257, std.dev.: 0.0017) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.01% (2.7527 => 2.7525, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.01% (2.1155 => 2.1153, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.00% (4.9749 => 4.9748, std.dev.: 0.0012) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 22.39% (2.0176 => 2.4694, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.80% (0.1410 => 0.1661, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 15.74% (0.0826 => 0.0956, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 14.67% (0.2243 => 0.2572, std.dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.43% (0.1072 => 0.1216, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.71% (0.0834 => 0.0940, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 12.44% (0.1013 => 0.1139, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.10% (0.1413 => 0.1584, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 11.95% (0.4328 => 0.4845, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.76% (0.1327 => 0.1483, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 11.52% (0.4062 => 0.4530, std.dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: 11.49% (0.7038 => 0.7847, std.dev.: 0.0018) MultiSource/Applications/hbd/hbd: 11.42% (1.3693 => 1.5257, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.36% (0.2721 => 0.3030, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.35% (3.9660 => 4.4163, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference-object: 11.34% (0.5818 => 0.6478) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.34% (0.1588 => 0.1768, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.31% (0.0964 => 0.1073, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.25% (0.2596 => 0.2888, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.19% (0.7710 => 0.8573, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 11.08% (0.2781 => 0.3089, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.07% (0.5265 => 0.5848, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 11.06% (0.5748 => 0.6384, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.00% (0.9199 => 1.0211, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.99% (0.6959 => 0.7724, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.98% (1.4563 => 1.6162, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.95% (0.3022 => 0.3353, std.dev.: 0.0012) MultiSource/Applications/aha/aha: 10.92% (0.1062 => 0.1178, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.89% (1.2193 => 1.3521, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.82% (0.2782 => 0.3083, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.75% (0.3899 => 0.4318, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.74% (0.6283 => 0.6958, std.dev.: 0.0055) SingleSource/UnitTests/ObjC++/property-reference: 10.72% (0.7061 => 0.7818, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.50% (0.3485 => 0.3851, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.41% (0.4390 => 0.4847, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 10.35% (13.8202 => 15.2504, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.31% (0.4016 => 0.4430, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.29% (1.1364 => 1.2533, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 10.28% (0.2607 => 0.2875, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 10.26% (0.3293 => 0.3631, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/fibo: 10.24% (0.2628 => 0.2897, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.23% (0.3489 => 0.3846, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.22% (0.3756 => 0.4140, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 10.22% (0.2760 => 0.3042, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.20% (0.1157 => 0.1275, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 10.19% (0.2690 => 0.2964, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 10.18% (0.2937 => 0.3236, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 10.17% (0.1003 => 0.1105, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.11% (0.2966 => 0.3266, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.09% (0.2655 => 0.2923, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.09% (1.9828 => 2.1829, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 10.09% (0.2726 => 0.3001, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 10.06% (0.3868 => 0.4257, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.05% (0.1075 => 0.1183, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 10.03% (0.2761 => 0.3038, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.02% (0.5577 => 0.6136, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.97% (0.3580 => 0.3937, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 9.96% (0.3453 => 0.3797, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.95% (0.2765 => 0.3040, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 9.91% (0.3149 => 0.3461, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 9.82% (0.3107 => 0.3412, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 9.73% (1.0313 => 1.1316, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 9.71% (0.3192 => 0.3502, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 9.69% (0.1589 => 0.1743, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.68% (0.4791 => 0.5255, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 9.68% (0.3534 => 0.3876, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.64% (0.2696 => 0.2956, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.64% (0.2023 => 0.2218, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 9.62% (0.2995 => 0.3283, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 9.61% (0.2988 => 0.3275, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.57% (0.2914 => 0.3193, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.50% (0.4379 => 0.4795, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.49% (0.3130 => 0.3427, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 9.40% (16.6129 => 18.1745, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.32% (0.1986 => 0.2171, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 9.28% (1.1061 => 1.2088, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.27% (0.1435 => 0.1568, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.18% (0.3246 => 0.3544, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.14% (0.7460 => 0.8142, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.08% (0.5637 => 0.6149, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.07% (0.2127 => 0.2320, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.03% (0.8698 => 0.9483, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 9.00% (0.8310 => 0.9058, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 8.94% (0.6744 => 0.7347, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.93% (0.1276 => 0.1390, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/18-imp/imp: 8.91% (0.3220 => 0.3507, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 8.82% (3.8646 => 4.2054, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/objinst: 8.76% (0.2945 => 0.3203, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 8.75% (0.7506 => 0.8163, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 8.70% (1.0594 => 1.1516, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.63% (0.3755 => 0.4079, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 8.59% (1.9270 => 2.0926, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.52% (7.2180 => 7.8333, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 8.48% (2.1791 => 2.3638, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.47% (0.1865 => 0.2023, std.dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: 8.25% (0.1478 => 0.1600, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 8.20% (3.1889 => 3.4503, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/09-vor/vor: 8.10% (0.2925 => 0.3162, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.07% (1.3245 => 1.4314, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.03% (0.6576 => 0.7104, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.98% (3.6692 => 3.9620, std.dev.: 0.0106) MultiSource/Benchmarks/Olden/em3d/em3d: 7.91% (0.1657 => 0.1788, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 7.86% (0.3131 => 0.3377, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 7.82% (1.2749 => 1.3746, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.71% (0.6135 => 0.6608, std.dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 7.67% (14.8535 => 15.9932, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.63% (4.3801 => 4.7143, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.59% (0.8818 => 0.9487, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/05-eks/eks: 7.56% (0.4113 => 0.4424, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.55% (4.4433 => 4.7788, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.55% (0.1789 => 0.1924, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 7.46% (8.4961 => 9.1303, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.38% (4.9865 => 5.3546, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 7.38% (4.6629 => 5.0069, std.dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.32% (0.3511 => 0.3768, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 7.31% (1.2292 => 1.3191, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.29% (0.2140 => 0.2296, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.21% (1.5188 => 1.6283, std.dev.: 0.0088) SingleSource/UnitTests/ObjC/parameter-passing: 7.09% (0.4003 => 0.4287, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.03% (0.2504 => 0.2680, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 7.02% (0.6250 => 0.6689, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.98% (3.2742 => 3.5027, std.dev.: 0.0102) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.81% (0.9108 => 0.9728, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.81% (0.4805 => 0.5132, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.75% (0.3914 => 0.4178, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 6.71% (0.3578 => 0.3818, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.69% (1.1333 => 1.2091, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 6.65% (0.3940 => 0.4202, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 6.61% (0.3601 => 0.3839, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 6.60% (0.3789 => 0.4039, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.60% (0.1819 => 0.1939, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.58% (0.3646 => 0.3886, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.50% (0.3663 => 0.3901, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.38% (0.3245 => 0.3452, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 6.35% (0.3623 => 0.3853, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.33% (0.3650 => 0.3881, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 6.27% (0.2008 => 0.2134, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 6.22% (6.5754 => 6.9842, std.dev.: 0.0087) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.20% (0.2321 => 0.2465, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.13% (2.1007 => 2.2295, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 6.10% (3.7467 => 3.9754, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.87% (6.2785 => 6.6472, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.09% (13.2842 => 13.9607, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.46% (0.2243 => 0.2343, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 3.64% (16.2614 => 16.8541, std.dev.: 0.0063) MultiSource/Applications/ClamAV/clamscan: 3.38% (14.5298 => 15.0213, std.dev.: 0.0170) MultiSource/Benchmarks/Bullet/bullet: 1.02% (33.2944 => 33.6335, std.dev.: 0.0206) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5189, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fbench: 25.20% (1.8175 => 2.2755, std.dev.: 0.0416) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/richards_benchmark: 10.98% (1.1560 => 1.2829, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 9.02% (0.8273 => 0.9019, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4137, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.20% (1.2998 => 1.3804, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0048, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6763, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9855, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 3.35% (10.7476 => 11.1077, std.dev.: 0.0419) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.13% (7.4271 => 7.5856, std.dev.: 0.0033) MultiSource/Applications/lemon/lemon: 1.70% (1.4298 => 1.4541, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.46% (2.0200 => 2.0494, std.dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5112, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2123, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1870, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5783, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0270, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5860, std.dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.04% (8.8259 => 8.9177, std.dev.: 0.0200) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.45% (0.2670 => 0.1403, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.38% (0.4657 => 0.3894, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -15.56% (0.0707 => 0.0597) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.97% (1.3819 => 1.1888, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.95% (1.3813 => 1.1886, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.46% (22.5627 => 21.7814, std.dev.: 0.0098) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.34% (1.0460 => 0.8542, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.64% (0.0997 => 0.0861, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.97% (0.2238 => 0.1970, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.94% (1.2308 => 1.0961, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.02% (20.3410 => 18.3030, std.dev.: 0.0109) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.77% (1.3780 => 1.2985, std.dev.: 0.0102) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.05% (0.9996 => 0.9591, std.dev.: 0.0058) MultiSource/Applications/siod/siod: -3.50% (3.2729 => 3.1583, std.dev.: 0.0241) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.47% (1.7688 => 1.7074, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4867 => 0.4717, std.dev.: 0.0019) MultiSource/Applications/lua/lua: -2.56% (26.5159 => 25.8364, std.dev.: 0.0239) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.41% (3.0263 => 2.9534, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.35% (1.9762 => 1.9298, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.94% (6.3560 => 6.2325, std.dev.: 0.0081) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7136, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0073, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -1.32% (4.5928 => 4.5324, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8660, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4947, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -1.21% (9.3358 => 9.2230, std.dev.: 0.0386) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2569, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 5 02:55:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 04:55:00 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121005095500.0BC132A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4599?compare_to=4596&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4599, Order: 165306, Start Time: 2012-10-05 08:34:10, End Time: 2012-10-05 09:56:43 To: 4596, Order: 165304, Start Time: 2012-10-05 06:54:42, End Time: 2012-10-05 08:18:19 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (14 on baseline) Performance Regressions: 11 (91 on baseline) Performance Improvements: 3 (46 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 963 (754 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.45% (0.0588 => 0.0720, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.08% (0.7841 => 0.8239, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.46% (0.5634 => 0.5885, std.dev.: 0.0097) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.24% (1.1273 => 1.1526, std.dev.: 0.0089) MultiSource/Applications/Burg/burg: 1.90% (1.1778 => 1.2002, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.61% (0.6959 => 0.7071, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 5.68% (8.4853 => 8.9676, std.dev.: 0.0469) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 3.86% (1.7861 => 1.8551, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.93% (2.6884 => 2.7404, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/fbench: 1.15% (3.4044 => 3.4437, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.02% (1.4289 => 1.4435, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -1.44% (0.8211 => 0.8093, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -1.26% (0.8194 => 0.8091, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.07% (1.0029 => 0.9922, std.dev.: 0.0026) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.45% (1.0158 => 1.0305, std.dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: 0.35% (0.6214 => 0.6236, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 1.55% (0.1806 => 0.1834, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.01% (0.1583 => 0.1599, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.80% (0.3105 => 0.3161, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.59% (0.2354 => 0.2415, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.14% (0.3239 => 0.3202, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.72% (0.2268 => 0.2307, std.dev.: 0.0104) SingleSource/Benchmarks/Misc/mandel: 5.03% (0.0437 => 0.0459, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.61% (0.0248 => 0.0244, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 72.32% (0.0112 => 0.0193, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.60% (0.0393 => 0.0371, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 2.73% (0.0293 => 0.0301, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 16.39% (0.0244 => 0.0284, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.30% (0.0328 => 0.0327, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -49.45% (0.0182 => 0.0092, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/test1: 65.52% (0.0116 => 0.0192, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: - (0.0253 => 0.0253, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 9.00% (0.0300 => 0.0327, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.57% (0.1415 => 0.1423, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.10% (1.5208 => 1.5375, std.dev.: 0.0170) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: 4.70% (0.1488 => 0.1558, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.38% (0.4184 => 0.4168, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.14% (0.1389 => 0.1387, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.75% (0.0531 => 0.0535, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.71% (0.0210 => 0.0198, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.15% (0.0601 => 0.0662, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.32% (1.1247 => 1.1283, std.dev.: 0.0108) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -66.67% (0.0012 => 0.0004, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.73% (0.0548 => 0.0544, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 20.50% (0.0161 => 0.0194, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.25% (0.7682 => 0.7663, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 0.06% (1.7054 => 1.7065, std.dev.: 0.0088) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -33.88% (0.0121 => 0.0080, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 143.82% (0.0089 => 0.0217, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: 174.44% (0.0090 => 0.0247, std.dev.: 0.0002) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -27.42% (4.1772 => 3.0317, std.dev.: 0.0257) SingleSource/Benchmarks/Shootout-C++/except: 83083.33% (0.0006 => 0.4991, std.dev.: 0.0138) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.09% (0.0745 => 0.0917, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.31% (0.6410 => 0.7071, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 10.08% (0.3582 => 0.3943, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.92% (0.1159 => 0.1274, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: 9.63% (0.5309 => 0.5820, std.dev.: 0.0052) MultiSource/Benchmarks/PAQ8p/paq8p: 9.44% (2.1763 => 2.3818, std.dev.: 0.0111) MultiSource/Applications/minisat/minisat: 8.23% (0.6173 => 0.6681, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 7.47% (1.0046 => 1.0796, std.dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: 7.26% (1.1653 => 1.2499, std.dev.: 0.0144) MultiSource/Benchmarks/McCat/18-imp/imp: 6.93% (0.3217 => 0.3440, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.70% (0.2552 => 0.2723, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.70% (0.7722 => 0.8239, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.69% (0.7639 => 0.8150, std.dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 6.68% (0.6915 => 0.7377, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.61% (1.5150 => 1.6151, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.33% (0.2797 => 0.2974, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 6.18% (15.3105 => 16.2574, std.dev.: 0.0918) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.83% (0.6069 => 0.6423, std.dev.: 0.0025) MultiSource/Applications/d/make_dparser: 5.79% (3.0225 => 3.1975, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.72% (0.2886 => 0.3051, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.54% (0.3901 => 0.4117, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 5.38% (0.1971 => 0.2077, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.30% (0.4248 => 0.4473, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.98% (0.4880 => 0.5123, std.dev.: 0.0044) MultiSource/Applications/hbd/hbd: 4.94% (1.3268 => 1.3924, std.dev.: 0.0088) MultiSource/Applications/Burg/burg: 4.91% (1.1440 => 1.2002, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.79% (0.2654 => 0.2781, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 4.72% (13.3238 => 13.9530, std.dev.: 0.0632) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.71% (0.8569 => 0.8973, std.dev.: 0.0029) MultiSource/Applications/sgefa/sgefa: 4.69% (0.2877 => 0.3012, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.56% (0.2303 => 0.2408, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.51% (1.1672 => 1.2198, std.dev.: 0.0149) MultiSource/Applications/oggenc/oggenc: 4.49% (4.7455 => 4.9587, std.dev.: 0.0269) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.44% (6.2546 => 6.5323, std.dev.: 0.0267) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.42% (1.2021 => 1.2552, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.35% (0.7226 => 0.7540, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.34% (0.3062 => 0.3195, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 4.29% (29.3170 => 30.5747, std.dev.: 0.1917) MultiSource/Benchmarks/Prolangs-C/football/football: 4.26% (0.8405 => 0.8763, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 4.13% (0.3026 => 0.3151, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.06% (1.1827 => 1.2307, std.dev.: 0.0104) MultiSource/Applications/lua/lua: 4.06% (3.5980 => 3.7440, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.05% (3.0758 => 3.2004, std.dev.: 0.0284) MultiSource/Benchmarks/mafft/pairlocalalign: 4.02% (8.2186 => 8.5490, std.dev.: 0.0533) MultiSource/Applications/siod/siod: 3.98% (2.0972 => 2.1806, std.dev.: 0.0133) MultiSource/Benchmarks/nbench/nbench: 3.86% (1.0821 => 1.1239, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/lists1: 3.86% (0.2771 => 0.2878, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.80% (1.4408 => 1.4956, std.dev.: 0.0167) MultiSource/Benchmarks/sim/sim: 3.63% (0.3084 => 0.3196, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 3.62% (1.8798 => 1.9478, std.dev.: 0.0069) MultiSource/Applications/JM/lencod/lencod: 3.57% (14.7256 => 15.2520, std.dev.: 0.1359) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.56% (12.6413 => 13.0918, std.dev.: 0.0511) SingleSource/Benchmarks/Shootout-C++/hash2: 3.46% (0.3847 => 0.3980, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.38% (0.4562 => 0.4716, std.dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 3.17% (6.4908 => 6.6966, std.dev.: 0.0371) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.15% (0.5520 => 0.5694, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.14% (4.2815 => 4.4159, std.dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.09% (2.0317 => 2.0945, std.dev.: 0.0152) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.95% (4.3380 => 4.4658, std.dev.: 0.0156) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.92% (4.0318 => 4.1497, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.74% (0.9029 => 0.9276, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.50% (4.2616 => 4.3682, std.dev.: 0.0174) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.18% (1.3935 => 1.4239, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.86% (8.2559 => 8.4094, std.dev.: 0.0560) MultiSource/Applications/hexxagon/hexxagon: 1.85% (0.9425 => 0.9599, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.44% (1.6538 => 2.3392, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 41.00% (0.0261 => 0.0368, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/matrix: 22.29% (3.4629 => 4.2349, std.dev.: 0.0251) SingleSource/Benchmarks/Shootout/ary3: 15.32% (1.7426 => 2.0095, std.dev.: 0.0284) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 13.96% (0.0917 => 0.1045, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.71% (0.0766 => 0.0871, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.55% (4.0101 => 4.5534, std.dev.: 0.0171) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.84% (2.4042 => 2.7128, std.dev.: 0.0464) SingleSource/Benchmarks/McGill/queens: 11.11% (1.6261 => 1.8068, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: 8.93% (7.0025 => 7.6277, std.dev.: 0.0400) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.68% (0.2857 => 0.3105, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/mason/mason: 8.67% (0.5004 => 0.5438, std.dev.: 0.0042) SingleSource/Benchmarks/Stanford/Puzzle: 8.03% (0.1433 => 0.1548, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.30% (40.4792 => 42.6239, std.dev.: 0.4736) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.54% (0.3301 => 0.3451, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/dt: 4.20% (0.9851 => 1.0265, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/fp-convert: 4.07% (15.2242 => 15.8443, std.dev.: 0.0662) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.92% (3.4080 => 3.5416, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 3.46% (3.5520 => 3.6748, std.dev.: 0.0102) MultiSource/Benchmarks/Bullet/bullet: 3.35% (6.9722 => 7.2057, std.dev.: 0.0234) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.29% (0.5587 => 0.5771, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.83% (6.6312 => 6.8188, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.81% (2.6656 => 2.7404, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/whetstone: 1.46% (2.3453 => 2.3795, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/power/power: 1.37% (1.4184 => 1.4379, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.15% (2.4455 => 2.4736, std.dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -43.15% (0.0591 => 0.0336, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -42.79% (0.2996 => 0.1714, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.77% (1.4189 => 1.1526, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.03% (1.4113 => 1.1569, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.26% (0.3497 => 0.2124, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.98% (5.2665 => 4.1089, std.dev.: 0.0396) SingleSource/Benchmarks/Shootout-C++/ary3: -20.69% (1.7473 => 1.3858, std.dev.: 0.0243) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.18% (15.8312 => 13.1118, std.dev.: 0.0915) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -14.80% (1.7361 => 1.4791, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout/sieve: -12.15% (8.1594 => 7.1683, std.dev.: 0.0119) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.63% (1.1647 => 1.0525, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.43% (1.4034 => 1.2851, std.dev.: 0.0196) SingleSource/Benchmarks/Misc/flops: -8.37% (9.5474 => 8.7483, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.76% (3.2007 => 2.9523, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.89% (3.6254 => 3.3756, std.dev.: 0.0114) MultiSource/Applications/lambda-0_1_3/lambda: -6.74% (7.6833 => 7.1656, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/fibo: -6.50% (4.6355 => 4.3341, std.dev.: 0.0225) SingleSource/Benchmarks/Misc/richards_benchmark: -6.49% (1.4441 => 1.3504, std.dev.: 0.0094) MultiSource/Benchmarks/FreeBench/distray/distray: -6.42% (0.2664 => 0.2493, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.07% (2.9728 => 2.7924, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.47% (3.9413 => 3.7259, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -5.17% (45.4683 => 43.1178, std.dev.: 0.5608) SingleSource/Benchmarks/Shootout/fib2: -5.14% (4.4195 => 4.1922, std.dev.: 0.0138) MultiSource/Benchmarks/Olden/bh/bh: -5.03% (2.5166 => 2.3900, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.43% (0.4564 => 0.4362, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.27% (1.2959 => 1.2406, std.dev.: 0.0211) MultiSource/Benchmarks/mafft/pairlocalalign: -4.20% (62.4126 => 59.7927, std.dev.: 0.1171) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.44% (1.1683 => 1.1281, std.dev.: 0.0122) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.41% (1.2722 => 1.2288, std.dev.: 0.0089) SingleSource/Benchmarks/McGill/misr: -3.40% (0.4296 => 0.4150, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.22% (3.7496 => 3.6287, std.dev.: 0.0235) SingleSource/Benchmarks/Shootout-C++/methcall: -3.06% (9.2503 => 8.9676, std.dev.: 0.0469) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.71% (0.4140 => 0.4028, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/neural/neural: -2.35% (1.0926 => 1.0669, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.21% (2.3569 => 2.3049, std.dev.: 0.0090) MultiSource/Benchmarks/PAQ8p/paq8p: -2.07% (92.7467 => 90.8302, std.dev.: 0.3800) MultiSource/Benchmarks/sim/sim: -2.03% (3.8907 => 3.8117, std.dev.: 0.0083) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.02% (2.4457 => 2.3963, std.dev.: 0.0137) MultiSource/Applications/aha/aha: -1.85% (3.4286 => 3.3651, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/hash2: -1.84% (3.4876 => 3.4234, std.dev.: 0.0186) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.72% (9.3855 => 9.2242, std.dev.: 0.0202) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.31% (25.6658 => 25.3303, std.dev.: 0.0329) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.30% (27.1724 => 26.8187, std.dev.: 0.0142) SingleSource/Benchmarks/Dhrystone/fldry: -1.25% (2.4971 => 2.4659, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.00% (1.8739 => 1.8551, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 3.26% (0.9980 => 1.0305, std.dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: 3.55% (0.6022 => 0.6236, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 10.08% (0.1666 => 0.1834, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.90% (0.1554 => 0.1599, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.53% (0.3083 => 0.3161, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.88% (0.2394 => 0.2415, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.85% (0.3175 => 0.3202, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.22% (0.2302 => 0.2307, std.dev.: 0.0104) SingleSource/Benchmarks/Misc/mandel: 2.23% (0.0449 => 0.0459, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.67% (0.0240 => 0.0244, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.52% (0.0192 => 0.0193, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.87% (0.0390 => 0.0371, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0301 => 0.0301, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0284 => 0.0284, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.93% (0.0324 => 0.0327, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -48.02% (0.0177 => 0.0092, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/test1: 1.59% (0.0189 => 0.0192, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: 1.61% (0.0249 => 0.0253, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 0.62% (0.0325 => 0.0327, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.42% (0.1429 => 0.1423, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 2.37% (1.5019 => 1.5375, std.dev.: 0.0170) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 3.80% (0.1501 => 0.1558, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.25% (0.4264 => 0.4168, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.20% (0.1344 => 0.1387, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.17% (0.0589 => 0.0535, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -14.66% (0.0232 => 0.0198, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.60% (0.0639 => 0.0662, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.59% (1.1350 => 1.1283, std.dev.: 0.0108) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -33.33% (0.0006 => 0.0004, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.60% (0.0637 => 0.0544, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -21.14% (0.0246 => 0.0194, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.62% (0.7541 => 0.7663, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -20.00% (0.0005 => 0.0004, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 11.08% (1.5363 => 1.7065, std.dev.: 0.0088) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 14.29% (0.0070 => 0.0080, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 5 03:43:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 05:43:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121005104324.92F1F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4600?compare_to=4597&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4600, Order: 165306, Start Time: 2012-10-05 09:24:36, End Time: 2012-10-05 10:44:59 To: 4597, Order: 165305, Start Time: 2012-10-05 07:34:55, End Time: 2012-10-05 08:55:15 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (153 on baseline) Performance Improvements: 1 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 951 (691 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.46% (14.8334 => 15.0503, std.dev.: 0.0066) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -18.72% (0.5138 => 0.4176, std.dev.: 0.0318) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.17% (0.5850 => 0.5860, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 0.02% (16.1397 => 16.1434, std.dev.: 0.0324) MultiSource/Benchmarks/Bullet/bullet: 0.09% (54.8299 => 54.8819, std.dev.: 0.0338) MultiSource/Benchmarks/MallocBench/gs/gs: 0.12% (4.3737 => 4.3791, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0464 => 0.0464, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0465 => 0.0465, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0433 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.23% (0.0435 => 0.0436) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.24% (0.0423 => 0.0422, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0423 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.24% (0.0416 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.24% (0.0416 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.23% (0.0434 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.23% (0.0435 => 0.0436) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.23% (0.0428 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.23% (0.0429 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.48% (0.0418 => 0.0420, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0419 => 0.0419, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0425 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.24% (0.0425 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.23% (0.0436 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.57% (0.0460 => 0.0439, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0413 => 0.0413, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0414 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0425 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0426 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.24% (0.0416 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0417 => 0.0417, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0408 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.24% (0.0409 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.25% (0.0408 => 0.0409) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0409 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.22% (0.0445 => 0.0444, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0446 => 0.0446) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.25% (0.0406 => 0.0407, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.25% (0.0407 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0408 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.24% (0.0409 => 0.0410) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.24% (0.0416 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.24% (0.0416 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.38% (1.2470 => 1.2423, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.03% (7.7315 => 7.7336, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.26% (0.7391 => 0.7372, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0361 => 0.0361, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1432 => 0.1433, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.94% (0.2213 => 0.2170, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -13.22% (63.2438 => 54.8819, std.dev.: 0.0338) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.15% (14.1553 => 18.7067, std.dev.: 0.0407) SingleSource/Benchmarks/Misc-C++-EH/spirit: 60.67% (3.4629 => 5.5639, std.dev.: 0.0026) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14229.72% (0.0720 => 10.3174, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9951600.00% (0.0001 => 9.9517, std.dev.: 0.0006) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 48.63% (0.2554 => 0.3796, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 45.17% (10.3673 => 15.0503, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/richards_benchmark: 32.74% (0.1622 => 0.2153, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 30.49% (0.1056 => 0.1378, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.98% (2.2022 => 2.5320, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.78% (7.0540 => 8.0966, std.dev.: 0.0104) SingleSource/Benchmarks/Misc/flops: 14.11% (0.1432 => 0.1634, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.05% (0.1566 => 0.1786, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.27% (1.7609 => 1.9770, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.83% (0.0871 => 0.0974, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 11.24% (0.3282 => 0.3651, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.67% (0.1584 => 0.1753, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.67% (0.3543 => 0.3921, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 10.45% (0.3473 => 0.3836, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 10.36% (0.3543 => 0.3910, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.29% (0.3497 => 0.3857, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.27% (0.3516 => 0.3877, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 10.21% (0.1440 => 0.1587, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.19% (0.3561 => 0.3924, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 10.11% (0.3927 => 0.4324, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.02% (0.3694 => 0.4064, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.01% (0.1438 => 0.1582, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.98% (0.3828 => 0.4210, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.83% (0.3886 => 0.4268, std.dev.: 0.0061) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.27% (0.1143 => 0.1249, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.87% (0.4879 => 0.5312, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.87% (0.6675 => 0.7267, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.82% (0.4615 => 0.5022, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 8.81% (0.7115 => 0.7742, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 8.74% (0.7433 => 0.8083, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: 8.70% (0.1655 => 0.1799, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 8.56% (9.4845 => 10.2962, std.dev.: 0.0025) MultiSource/Applications/sgefa/sgefa: 8.56% (0.3109 => 0.3375, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.47% (0.3177 => 0.3446, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.46% (0.8172 => 0.8863, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.34% (0.5105 => 0.5531, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.31% (0.1625 => 0.1760, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.30% (1.5415 => 1.6695, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/em3d/em3d: 8.14% (0.1695 => 0.1833, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 8.05% (10.4361 => 11.2763, std.dev.: 0.0202) SingleSource/UnitTests/ObjC++/Hello: 7.98% (0.5925 => 0.6398, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 7.95% (0.3423 => 0.3695, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 7.91% (0.6030 => 0.6507, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 7.91% (5.7591 => 6.2145, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.85% (1.3050 => 1.4075, std.dev.: 0.0019) MultiSource/Applications/d/make_dparser: 7.82% (3.3354 => 3.5961, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.75% (0.2271 => 0.2447, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.75% (0.1510 => 0.1627, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.70% (0.2700 => 0.2908, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.68% (0.5860 => 0.6310, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.60% (0.2065 => 0.2222, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.58% (4.2646 => 4.5878, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.47% (0.2758 => 0.2964, std.dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.43% (0.3121 => 0.3353, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.42% (8.1363 => 8.7401, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.42% (0.5569 => 0.5982, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.40% (0.2107 => 0.2263, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/bigfib: 7.37% (0.6456 => 0.6932, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.35% (0.8067 => 0.8660, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.35% (5.0018 => 5.3694, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.34% (4.9449 => 5.3081, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.29% (0.3307 => 0.3548, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.27% (0.9765 => 1.0475, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.27% (0.1940 => 0.2081, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 7.26% (0.3387 => 0.3633, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.26% (0.4103 => 0.4401, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 7.26% (0.7326 => 0.7858, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 7.25% (0.4289 => 0.4600, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: 7.25% (0.3422 => 0.3670, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 7.17% (0.7835 => 0.8397, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.17% (0.5020 => 0.5380, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 7.08% (1.1642 => 1.2466, std.dev.: 0.0065) MultiSource/Applications/hbd/hbd: 6.99% (1.5603 => 1.6693, std.dev.: 0.0098) MultiSource/Applications/lua/lua: 6.91% (3.8723 => 4.1397, std.dev.: 0.0198) SingleSource/Benchmarks/Shootout-C++/strcat: 6.89% (0.2831 => 0.3026, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.88% (0.4203 => 0.4492, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.86% (7.9617 => 8.5075, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.83% (0.3865 => 0.4129, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.79% (0.3650 => 0.3898, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 6.75% (0.1555 => 0.1660, std.dev.: 0.0032) SingleSource/Regression/C++/ofstream_ctor: 6.61% (0.2905 => 0.3097, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.61% (0.2891 => 0.3082, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.60% (0.3136 => 0.3343, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 6.59% (1.0722 => 1.1429, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.58% (0.4636 => 0.4941, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 6.55% (0.4048 => 0.4313, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.54% (0.3684 => 0.3925, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.51% (0.3162 => 0.3368, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash2: 6.45% (0.4620 => 0.4918, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 6.43% (2.0273 => 2.1576, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.42% (0.2603 => 0.2770, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.38% (0.3603 => 0.3833, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.38% (2.0665 => 2.1983, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.38% (0.3826 => 0.4070, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.34% (0.3441 => 0.3659, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.28% (1.5859 => 1.6855, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.25% (1.1861 => 1.2602, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 6.23% (0.2871 => 0.3050, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 6.23% (0.3180 => 0.3378, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 6.21% (0.3283 => 0.3487, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.20% (0.2872 => 0.3050, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.20% (0.3098 => 0.3290, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 6.19% (0.3232 => 0.3432, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.19% (0.2877 => 0.3055, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.16% (0.2793 => 0.2965, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.09% (0.2725 => 0.2891, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 6.08% (2.2969 => 2.4366, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.06% (0.6450 => 0.6841, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/wc: 6.06% (0.3052 => 0.3237, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.99% (0.2756 => 0.2921, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 5.96% (0.2802 => 0.2969, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 5.89% (0.4299 => 0.4552, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 5.87% (0.8921 => 0.9445, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hello: 5.86% (0.2714 => 0.2873, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 5.80% (21.9371 => 23.2095, std.dev.: 0.0267) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.78% (0.5981 => 0.6327, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 5.65% (0.3379 => 0.3570, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.61% (2.2024 => 2.3259, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.29% (0.4064 => 0.4279) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.25% (0.1906 => 0.2006, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.20% (1.4186 => 1.4924, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.85% (0.2266 => 0.2376, std.dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 4.84% (1.1840 => 1.2413, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.52% (0.8101 => 0.8467, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 4.32% (1.2842 => 1.3397, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: 4.31% (0.3131 => 0.3266, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.39% (14.3668 => 14.8535, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 2.95% (17.1811 => 17.6881, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.87% (3.8922 => 4.0038, std.dev.: 0.0153) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.78% (0.3817 => 0.3923, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.43% (1.1194 => 1.1466, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8961, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.38% (0.2944 => 0.3279, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.88% (1.1396 => 1.2522, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Puzzle: 9.85% (0.1421 => 0.1561, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.18% (3.1595 => 3.4497, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3691, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.62% (0.3463 => 0.3623, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 3.71% (0.5413 => 0.5614, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.57% (3.6395 => 3.7695, std.dev.: 0.0062) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.88% (4.2280 => 4.3496, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.34% (1.7254 => 1.7657, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.47% (0.9540 => 0.9680, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8136, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.23% (2.6546 => 2.6872, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.00% (9.1159 => 9.2074, std.dev.: 0.0082) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1291, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.00% (0.8651 => 0.1730, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.39% (5.2763 => 3.2507, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.44% (5.3855 => 3.6386, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.04% (5.3526 => 3.6378, std.dev.: 0.0021) SingleSource/UnitTests/Vector/constpool: -14.43% (54.1659 => 46.3511, std.dev.: 0.0194) MultiSource/Benchmarks/FreeBench/mason/mason: -13.56% (0.0811 => 0.0701, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -11.36% (22.1758 => 19.6570, std.dev.: 0.0627) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.79% (2.9384 => 2.6213, std.dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.43% (1.1492 => 0.7650, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -16.05% (1.6925 => 1.4208, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.63% (0.0998 => 0.0862, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.31% (1.2373 => 1.0973, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: -10.39% (1.5373 => 1.3775, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/mason/mason: -9.86% (0.2161 => 0.1948, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.26% (19.9488 => 18.3004, std.dev.: 0.0964) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4787, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.71% (1.8329 => 1.7100, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.24% (1.6805 => 1.5924, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5072, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.32% (0.9957 => 0.9527, std.dev.: 0.0105) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.69% (3.2827 => 3.1615, std.dev.: 0.0077) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5002, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: -3.01% (12.4730 => 12.0976, std.dev.: 0.0024) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.05% (8.1563 => 7.9887, std.dev.: 0.0128) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.02% (8.6802 => 8.5051, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6820, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -1.68% (10.2830 => 10.1107, std.dev.: 0.0151) SingleSource/UnitTests/Vector/multiplies: -1.51% (2.5528 => 2.5142, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4219, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.10% (6.2999 => 6.2307, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.03% (12.5348 => 12.4054, std.dev.: 0.0187) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8586, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.07% (0.5229 => 0.5860, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 7.70% (14.9895 => 16.1434, std.dev.: 0.0324) MultiSource/Benchmarks/MallocBench/gs/gs: 6.53% (4.1105 => 4.3791, std.dev.: 0.0111) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.45% (1.1048 => 1.2423, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.04% (7.1582 => 7.7336, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.48% (0.6222 => 0.7372, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36000.00% (0.0001 => 0.0361, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.55% (0.2116 => 0.2170, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 5 04:00:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 06:00:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121005110055.3C6552A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4601?compare_to=4598&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4601, Order: 165306, Start Time: 2012-10-05 09:36:47, End Time: 2012-10-05 11:02:30 To: 4598, Order: 165305, Start Time: 2012-10-05 07:41:44, End Time: 2012-10-05 09:07:34 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 0 (181 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1039 (684 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.00% (2.7525 => 2.7524, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (2.1153 => 2.1153, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (4.9748 => 4.9748, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 22.67% (2.0176 => 2.4749, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.45% (0.1410 => 0.1656, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 15.98% (0.0826 => 0.0958, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 15.31% (0.0653 => 0.0753, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 14.40% (0.2243 => 0.2566, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.06% (0.1072 => 0.1212, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.59% (0.0834 => 0.0939, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 12.44% (0.1013 => 0.1139, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 12.13% (0.4328 => 0.4853, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.10% (0.1413 => 0.1584, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.06% (0.1327 => 0.1487, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 11.68% (1.3693 => 1.5293, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.62% (3.9660 => 4.4269, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.52% (0.3022 => 0.3370, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 11.50% (0.4062 => 0.4529, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 11.49% (0.7038 => 0.7847, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.47% (0.2721 => 0.3033, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.46% (0.1588 => 0.1770, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 11.36% (0.2781 => 0.3097, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 11.34% (0.5818 => 0.6478, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.31% (0.0964 => 0.1073, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.25% (0.2596 => 0.2888, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 11.10% (0.5748 => 0.6386, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.07% (0.2782 => 0.3090, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.04% (0.9199 => 1.0215, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.94% (1.4563 => 1.6156, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.91% (0.7710 => 0.8551, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.88% (1.2193 => 1.3520, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.87% (0.3899 => 0.4323, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.84% (0.6283 => 0.6964, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.83% (0.5265 => 0.5835, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 10.73% (0.1062 => 0.1176, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.73% (0.6959 => 0.7706, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.73% (0.3485 => 0.3859, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 10.68% (0.7061 => 0.7815, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.61% (0.4016 => 0.4442, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 10.59% (0.2607 => 0.2883, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.57% (0.4390 => 0.4854, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 10.57% (0.3293 => 0.3641, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.55% (0.2966 => 0.3279, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 10.54% (0.2760 => 0.3051, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 10.45% (0.2690 => 0.2971, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 10.42% (0.2726 => 0.3010, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.41% (0.3756 => 0.4147) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.40% (0.2655 => 0.2931, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 10.39% (0.2628 => 0.2901, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 10.38% (0.2937 => 0.3242, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.38% (1.9828 => 2.1887, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.38% (0.2765 => 0.3052, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.38% (0.3489 => 0.3851, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 10.30% (13.8202 => 15.2442, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/moments: 10.29% (0.3868 => 0.4266, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 10.28% (0.3453 => 0.3808, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary3: 10.26% (0.3149 => 0.3472, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 10.25% (0.2761 => 0.3044, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.23% (1.1364 => 1.2526, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.17% (0.1986 => 0.2188, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 10.14% (0.3107 => 0.3422, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.08% (0.3580 => 0.3941, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: 9.99% (0.3192 => 0.3511, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 9.99% (0.3534 => 0.3887, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.98% (0.2696 => 0.2965, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.94% (0.1157 => 0.1272, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 9.87% (0.2988 => 0.3283, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.85% (0.2914 => 0.3201, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.79% (0.4791 => 0.5260, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.77% (0.1075 => 0.1180, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 9.65% (0.2995 => 0.3284, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 9.63% (1.0313 => 1.1306, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.58% (0.3130 => 0.3430, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 9.57% (0.1589 => 0.1741, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.54% (0.5577 => 0.6109, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.51% (0.5637 => 0.6173, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.50% (0.4379 => 0.4795, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 9.41% (16.6129 => 18.1763, std.dev.: 0.0188) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.27% (0.1435 => 0.1568, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 9.20% (1.1061 => 1.2079, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/objinst: 9.20% (0.2945 => 0.3216, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.18% (0.3246 => 0.3544, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.16% (0.8698 => 0.9495, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.16% (0.7460 => 0.8143, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.12% (0.2127 => 0.2321) MultiSource/Benchmarks/Prolangs-C/football/football: 8.99% (0.8310 => 0.9057, std.dev.: 0.0017) MultiSource/Applications/minisat/minisat: 8.99% (0.6744 => 0.7350, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.93% (0.1276 => 0.1390, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 8.85% (3.8646 => 4.2067, std.dev.: 0.0093) MultiSource/Benchmarks/McCat/18-imp/imp: 8.79% (0.3220 => 0.3503, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.74% (0.3755 => 0.4083, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 8.71% (0.7506 => 0.8160, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.56% (7.2180 => 7.8356, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.55% (0.2023 => 0.2196, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 8.54% (1.0594 => 1.1499, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 8.51% (1.9270 => 2.0909, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.47% (0.1865 => 0.2023, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 8.38% (2.1791 => 2.3616, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.35% (0.1569 => 0.1700, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 8.28% (3.1889 => 3.4530, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 8.19% (0.1478 => 0.1599, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 8.17% (0.2925 => 0.3164, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.97% (3.6692 => 3.9617, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.97% (1.3245 => 1.4300, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.92% (0.6576 => 0.7097, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/em3d/em3d: 7.91% (0.1657 => 0.1788, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 7.86% (0.3131 => 0.3377, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.79% (0.6135 => 0.6613, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 7.76% (1.2749 => 1.3738, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.71% (0.1789 => 0.1927, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.69% (4.3801 => 4.7169, std.dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: 7.60% (14.8535 => 15.9829, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.60% (0.8818 => 0.9488, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.57% (4.4433 => 4.7795, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 7.53% (8.4961 => 9.1358, std.dev.: 0.0101) MultiSource/Applications/oggenc/oggenc: 7.49% (4.6629 => 5.0123, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 7.45% (1.2292 => 1.3208, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 7.44% (0.4113 => 0.4419, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.34% (0.2140 => 0.2297, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/bigfib: 7.28% (0.6250 => 0.6705, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.22% (1.5188 => 1.6284, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.21% (4.9865 => 5.3459, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: 6.99% (0.4003 => 0.4283, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.91% (0.2504 => 0.2677, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.86% (0.3511 => 0.3752, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.86% (0.9108 => 0.9733, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.84% (3.2742 => 3.4982, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.81% (0.4805 => 0.5132, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.78% (1.1333 => 1.2101, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.77% (0.3914 => 0.4179, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 6.62% (0.3789 => 0.4040, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 6.62% (0.3578 => 0.3815, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.60% (0.3940 => 0.4200, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.54% (0.1819 => 0.1938, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 6.53% (0.3601 => 0.3836, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.50% (0.3663 => 0.3901, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.47% (0.3646 => 0.3882, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 6.38% (0.3623 => 0.3854, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.36% (0.3650 => 0.3882, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.32% (0.3245 => 0.3450, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 6.29% (6.5754 => 6.9892, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/oourafft: 6.27% (0.2008 => 0.2134, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.07% (0.2321 => 0.2462, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 6.01% (3.7467 => 3.9717, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.96% (2.1007 => 2.2259, std.dev.: 0.0036) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.89% (6.2785 => 6.6486, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.15% (13.2842 => 13.9680, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 3.65% (16.2614 => 16.8544, std.dev.: 0.0043) MultiSource/Applications/ClamAV/clamscan: 3.43% (14.5298 => 15.0282, std.dev.: 0.0145) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5178, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.05% (1.0895 => 1.3624, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fbench: 24.26% (1.8175 => 2.2585, std.dev.: 0.0538) SingleSource/Benchmarks/Misc/richards_benchmark: 11.07% (1.1560 => 1.2840, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4143, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.14% (1.2998 => 1.3796, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0044, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.88% (1.7081 => 1.7744, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6772, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 3.35% (1.9199 => 1.9842, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 3.24% (10.7476 => 11.0963, std.dev.: 0.0697) SingleSource/Regression/C/uint64_to_float: 2.95% (0.5449 => 0.5610, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.07% (7.4271 => 7.5806, std.dev.: 0.0044) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4535, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5131, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9695, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2123, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1889, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5779, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0268, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.03% (8.8259 => 8.9171, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/lists: 1.03% (12.4560 => 12.5846, std.dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.34% (0.2670 => 0.1406, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.41% (0.4657 => 0.3893, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -15.84% (0.0707 => 0.0595, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.98% (1.3813 => 1.1882, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.73% (1.3819 => 1.1921, std.dev.: 0.0078) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.52% (22.5627 => 21.7690, std.dev.: 0.0115) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.06% (0.2238 => 0.1968, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -11.28% (1.2308 => 1.0920, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.08% (20.3410 => 18.2897, std.dev.: 0.0150) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.12% (1.3780 => 1.2937, std.dev.: 0.0097) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5147, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.14% (0.9996 => 0.9582, std.dev.: 0.0062) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.44% (1.7688 => 1.7080, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.57% (26.5159 => 25.8344, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -2.43% (3.0263 => 2.9529, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: -2.37% (1.9762 => 1.9294, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7137, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/lists: -1.75% (6.3560 => 6.2445, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.49% (3.9173 => 3.8590, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0079, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -1.19% (4.5928 => 4.5383, std.dev.: 0.0054) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2567, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: -1.13% (9.3358 => 9.2306, std.dev.: 0.0265) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 5 04:01:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 06:01:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121005110108.092BF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4602?compare_to=4595&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4602, Order: 165305, Start Time: 2012-10-05 07:52:51, End Time: 2012-10-05 11:02:42 To: 4595, Order: 165293, Start Time: 2012-10-05 04:10:34, End Time: 2012-10-05 07:23:16 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 2 (137 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (131 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1037 (755 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 16.45% (101.7757 => 118.5143, std.dev.: 0.0598) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.92% (122.0540 => 129.2811, std.dev.: 0.8281) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.08% (9.8137 => 9.8063, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.04% (9.4095 => 9.4128, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.03% (16.9500 => 16.9558, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.19% (0.3446 => 0.3866, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.13% (0.3488 => 0.3911, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 11.97% (0.3442 => 0.3854, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.95% (0.3465 => 0.3879, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 11.86% (1.5932 => 1.7821, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/for-in: 11.78% (0.3496 => 0.3908, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.73% (0.3460 => 0.3866, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.73% (0.3469 => 0.3876, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.42% (0.3650 => 0.4067, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.38% (0.1063 => 0.1184, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.36% (0.3643 => 0.4057, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 11.33% (0.3724 => 0.4146, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.61% (0.5826 => 0.6386, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.51% (0.5889 => 0.6449, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 8.96% (0.1619 => 0.1764, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: 8.37% (0.1218 => 0.1320, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.17% (0.2875 => 0.3110, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.07% (0.7171 => 0.7750, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.05% (0.4994 => 0.5396, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.00% (0.4361 => 0.4710, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.99% (0.2792 => 0.3015, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.96% (0.1620 => 0.1749, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.90% (1.6211 => 1.7492, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.86% (0.5000 => 0.5393, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.85% (1.3152 => 1.4184, std.dev.: 0.0032) SingleSource/Regression/C++/ofstream_ctor: 7.82% (0.3004 => 0.3239, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: 7.81% (0.2714 => 0.2926, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.79% (0.3195 => 0.3444, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 7.78% (0.2725 => 0.2937, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.78% (0.2738 => 0.2951, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 7.73% (0.2780 => 0.2995, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.70% (0.2729 => 0.2939, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 7.69% (0.2823 => 0.3040, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 7.67% (0.2750 => 0.2961, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.61% (0.2813 => 0.3027, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 7.58% (0.2811 => 0.3024, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/random: 7.56% (0.2803 => 0.3015, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 7.56% (0.9909 => 1.0658, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.55% (3.5627 => 3.8316, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.53% (2.0673 => 2.2229, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.52% (0.2911 => 0.3130, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 7.49% (0.3096 => 0.3328, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 7.43% (5.5417 => 5.9535, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/ary3: 7.38% (0.3267 => 0.3508, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.35% (0.3060 => 0.3285, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 7.33% (0.3726 => 0.3999, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.32% (0.3362 => 0.3608, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.30% (0.2014 => 0.2161, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.30% (2.7292 => 2.9284, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/ary2: 7.24% (0.3317 => 0.3557, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 7.23% (0.3678 => 0.3944, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.23% (0.3625 => 0.3887, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 7.22% (0.3477 => 0.3728, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.15% (0.3258 => 0.3491, std.dev.: 0.0053) MultiSource/Benchmarks/Bullet/bullet: 7.14% (23.5202 => 25.2001, std.dev.: 0.0167) MultiSource/Benchmarks/McCat/18-imp/imp: 7.11% (0.1421 => 0.1522, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 7.02% (0.3348 => 0.3583, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.01% (0.3124 => 0.3343, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.01% (0.3282 => 0.3512, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 6.98% (1.0781 => 1.1534, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.98% (0.2736 => 0.2927, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.92% (0.3930 => 0.4202, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.89% (0.4139 => 0.4424, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 6.85% (0.4847 => 0.5179, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 6.78% (0.1505 => 0.1607, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 6.75% (0.4146 => 0.4426, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.72% (0.3690 => 0.3938, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.70% (0.4251 => 0.4536, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.66% (0.3890 => 0.4149, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.66% (0.3981 => 0.4246, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 6.66% (4.2109 => 4.4912, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.59% (0.2866 => 0.3055, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.59% (0.5900 => 0.6289, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 6.59% (0.2566 => 0.2735, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.58% (0.1549 => 0.1651, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.56% (0.3903 => 0.4159, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.50% (0.3845 => 0.4095, std.dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 6.42% (2.1013 => 2.2361, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.41% (0.5026 => 0.5348, std.dev.: 0.0035) MultiSource/Applications/spiff/spiff: 6.38% (0.4029 => 0.4286, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 6.33% (0.6634 => 0.7054, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.30% (0.1968 => 0.2092, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.23% (0.2969 => 0.3154, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.22% (4.4195 => 4.6944, std.dev.: 0.0135) MultiSource/Benchmarks/MallocBench/gs/gs: 6.20% (1.8794 => 1.9960, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/bigfib: 6.15% (0.5012 => 0.5320, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.14% (0.2068 => 0.2195, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.12% (0.6435 => 0.6829, std.dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.06% (0.3084 => 0.3271, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.03% (0.4658 => 0.4939, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.03% (0.2040 => 0.2163, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.99% (0.2737 => 0.2901, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 5.94% (1.4269 => 1.5117, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 5.91% (0.5546 => 0.5874, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 5.89% (4.6177 => 4.8899, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.84% (0.3271 => 0.3462, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 5.83% (2.1653 => 2.2915, std.dev.: 0.0038) MultiSource/Applications/minisat/minisat: 5.70% (0.3336 => 0.3526, std.dev.: 0.0021) MultiSource/Applications/hbd/hbd: 5.66% (0.9697 => 1.0246, std.dev.: 0.0016) MultiSource/Applications/treecc/treecc: 5.60% (0.7875 => 0.8316, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/football/football: 5.59% (0.2075 => 0.2191, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.37% (0.2103 => 0.2216, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 5.35% (2.0346 => 2.1435, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.33% (1.9694 => 2.0744, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.23% (1.9966 => 2.1011, std.dev.: 0.0026) MultiSource/Applications/lemon/lemon: 4.85% (0.2391 => 0.2507, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.71% (0.7426 => 0.7776, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.63% (0.5361 => 0.5609, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.35% (0.5584 => 0.5827, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.96% (4.6926 => 4.8785, std.dev.: 0.0118) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.96% (11.6398 => 12.1003, std.dev.: 0.0137) MultiSource/Applications/lambda-0_1_3/lambda: 3.89% (0.3498 => 0.3634, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.79% (0.4253 => 0.4414, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 2.79% (11.9555 => 12.2891, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.69% (0.3792 => 0.3894, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: 1.07% (2.4764 => 2.5028, std.dev.: 0.0087) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0294, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6102, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 5.47% (0.2122 => 0.2238, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6743, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-2: 5.05% (1.8057 => 1.8969, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1710, std.dev.: 0.0055) SingleSource/Benchmarks/Dhrystone/dry: 4.19% (14.0481 => 14.6367, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1989, std.dev.: 0.0066) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5072, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.58% (3.1722 => 3.2222, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.47% (7.1849 => 7.2902, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5390, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5951, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.87% (25.4195 => 16.5564, std.dev.: 0.0221) SingleSource/Benchmarks/Shootout-C++/ary2: -7.87% (0.2402 => 0.2213, std.dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9756, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7967, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std.dev.: 0.0077) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8017, std.dev.: 0.0131) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7725, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -2.83% (17.2379 => 16.7493, std.dev.: 0.0808) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8604, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5719, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4963, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.11% (105.3826 => 104.2085, std.dev.: 0.0251) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0471, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 5 07:39:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 09:39:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121005143939.CBA972A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4603?compare_to=4602&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4603, Order: 165306, Start Time: 2012-10-05 11:31:55, End Time: 2012-10-05 14:41:23 To: 4602, Order: 165305, Start Time: 2012-10-05 07:52:51, End Time: 2012-10-05 11:02:42 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 1 (135 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (131 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1038 (756 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.84% (2.0816 => 2.1200, std.dev.: 0.0076) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.05% (9.8063 => 9.8116, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.03% (9.4128 => 9.4101, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.02% (16.9558 => 16.9596, std.dev.: 0.0077) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 12.18% (0.3465 => 0.3887, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.01% (0.3446 => 0.3860, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.96% (0.3488 => 0.3905, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 11.93% (0.3469 => 0.3883, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.91% (0.3442 => 0.3852, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.90% (0.3496 => 0.3912, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.85% (0.3460 => 0.3870, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 11.82% (1.5932 => 1.7815, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/property: 11.53% (0.3650 => 0.4071, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.50% (0.3643 => 0.4062, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.33% (0.3724 => 0.4146, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.29% (0.1063 => 0.1183, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: 9.65% (0.5826 => 0.6388, std.dev.: 0.0035) SingleSource/UnitTests/ObjC++/property-reference-object: 9.53% (0.5889 => 0.6450, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 8.77% (0.1619 => 0.1761, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 8.46% (0.1218 => 0.1321, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.14% (0.7171 => 0.7755, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.07% (0.2875 => 0.3107, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.05% (0.4994 => 0.5396, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.92% (0.2792 => 0.3013, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.85% (1.3152 => 1.4185, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.82% (0.4361 => 0.4702, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.78% (1.6211 => 1.7473, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.78% (0.1620 => 0.1746, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.76% (0.5000 => 0.5388, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/fibo: 7.74% (0.2725 => 0.2936, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 7.74% (0.2714 => 0.2924, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.71% (0.2738 => 0.2949, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.70% (0.3195 => 0.3441, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.61% (3.5627 => 3.8338, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/matrix: 7.59% (0.2780 => 0.2991, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.56% (0.2803 => 0.3015, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.56% (0.3004 => 0.3231, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.55% (0.2729 => 0.2935, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 7.55% (0.2823 => 0.3036, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.54% (0.2813 => 0.3025, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 7.49% (0.9909 => 1.0651, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/except: 7.47% (0.2811 => 0.3021, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.45% (0.2911 => 0.3128, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 7.43% (0.3096 => 0.3326, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.42% (2.0673 => 2.2207, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: 7.42% (0.2750 => 0.2954, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 7.34% (5.5417 => 5.9484, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.32% (0.3060 => 0.3284, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.30% (2.7292 => 2.9283, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary3: 7.25% (0.3267 => 0.3504, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 7.22% (0.3726 => 0.3995, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.20% (0.2014 => 0.2159, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.20% (0.3362 => 0.3604, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary: 7.15% (0.3258 => 0.3491, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 7.10% (0.3477 => 0.3724, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 7.07% (0.3678 => 0.3938, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 7.05% (0.3317 => 0.3551, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.05% (0.2736 => 0.2929, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 7.00% (23.5202 => 25.1675, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.95% (0.3625 => 0.3877, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.95% (0.3282 => 0.3510, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.94% (1.0781 => 1.1529, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 6.90% (0.3348 => 0.3579, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.90% (0.3930 => 0.4201, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.86% (0.4139 => 0.4423, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.82% (0.3124 => 0.3337, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 6.81% (4.2109 => 4.4978, std.dev.: 0.0077) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.78% (0.5900 => 0.6300, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.71% (0.1549 => 0.1653, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 6.71% (0.4847 => 0.5172, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 6.68% (0.4146 => 0.4423, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (0.4251 => 0.4535, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.61% (0.3690 => 0.3934, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.56% (0.2866 => 0.3054, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.56% (0.3890 => 0.4145, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.51% (0.3981 => 0.4240, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 6.50% (0.4029 => 0.4291, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.45% (0.3845 => 0.4093, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.43% (0.3903 => 0.4154, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 6.35% (0.2566 => 0.2729, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 6.35% (2.1013 => 2.2347, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.35% (0.5026 => 0.5345, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: 6.20% (1.8794 => 1.9960, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.20% (0.2969 => 0.3153, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 6.18% (0.6634 => 0.7044, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.15% (0.1968 => 0.2089, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.15% (4.4195 => 4.6911, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.01% (0.6435 => 0.6822, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.99% (0.2737 => 0.2901, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.95% (0.2068 => 0.2191, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.95% (0.4658 => 0.4935, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 5.94% (1.4269 => 1.5117, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.84% (0.3084 => 0.3264, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.83% (0.2040 => 0.2159, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 5.82% (4.6177 => 4.8864, std.dev.: 0.0034) MultiSource/Applications/JM/ldecod/ldecod: 5.78% (2.1653 => 2.2905, std.dev.: 0.0027) MultiSource/Applications/Burg/burg: 5.75% (0.5546 => 0.5865, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.69% (0.3271 => 0.3457, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 5.64% (0.3336 => 0.3524, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: 5.59% (0.9697 => 1.0239, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/football/football: 5.49% (0.2075 => 0.2189, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.40% (1.9694 => 2.0757, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: 5.28% (0.7875 => 0.8291, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.28% (0.2103 => 0.2214, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.27% (1.9966 => 2.1019, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 5.22% (2.0346 => 2.1409, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 5.20% (0.2691 => 0.2831, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 4.77% (0.2391 => 0.2505, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.65% (0.7426 => 0.7771, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.25% (0.5361 => 0.5589, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.24% (0.5584 => 0.5821, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.88% (11.6398 => 12.0917, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.81% (4.6926 => 4.8713, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.72% (0.4253 => 0.4411, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 3.63% (0.3498 => 0.3625, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 2.74% (11.9555 => 12.2825, std.dev.: 0.0140) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.69% (0.3792 => 0.3894, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.60% (0.5917 => 0.6722, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 8.15% (0.2122 => 0.2295, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6113, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.22% (12.0509 => 12.6805, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-2: 5.01% (1.8057 => 1.8962, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1666, std.dev.: 0.0093) SingleSource/Benchmarks/Dhrystone/dry: 4.30% (14.0481 => 14.6519, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1953, std.dev.: 0.0047) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4983, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.83% (2.0820 => 2.1200, std.dev.: 0.0076) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.70% (3.1722 => 3.2261, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2879, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5892, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5675, std.dev.: 0.0060) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9787, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7967, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -6.54% (0.2402 => 0.2245, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7975, std.dev.: 0.0091) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7733, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/fldry: -2.72% (17.2379 => 16.7691, std.dev.: 0.0581) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.51% (0.6293 => 0.6135, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.21% (41.7953 => 40.8701, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5784, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4960, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.28% (105.3826 => 104.0307, std.dev.: 0.0918) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0443, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 5 08:20:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 10:20:39 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121005152039.2455B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4604?compare_to=4599&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4604, Order: 165308, Start Time: 2012-10-05 13:58:08, End Time: 2012-10-05 15:22:23 To: 4599, Order: 165306, Start Time: 2012-10-05 08:34:10, End Time: 2012-10-05 09:56:43 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (14 on baseline) Performance Regressions: 6 (85 on baseline) Performance Improvements: 2 (43 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 969 (763 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.15% (0.8093 => 0.8429, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.74% (0.8405 => 0.8635, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.66% (0.8091 => 0.8306, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.54% (58.5368 => 61.1919, std.dev.: 0.7569) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.22% (4.2751 => 4.4129, std.dev.: 0.0283) MultiSource/Applications/SIBsim4/SIBsim4: 1.65% (3.3462 => 3.4015, std.dev.: 0.0075) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.87% (0.8239 => 0.7838, std.dev.: 0.0116) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.17% (4.5718 => 4.5183, std.dev.: 0.0205) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.11% (1.0305 => 1.0316, std.dev.: 0.0207) MultiSource/Applications/sqlite3/sqlite3: -0.14% (0.6236 => 0.6227, std.dev.: 0.0079) MultiSource/Benchmarks/McCat/08-main/main: -7.74% (0.1834 => 0.1692, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.75% (0.1599 => 0.1539, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.09% (0.3161 => 0.3158, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.82% (0.2415 => 0.2371, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.84% (0.3202 => 0.3229, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.56% (0.2307 => 0.2320, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/mandel: -7.84% (0.0459 => 0.0423, std.dev.: 0.0018) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.64% (0.0244 => 0.0248, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -26.94% (0.0193 => 0.0141, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.39% (0.0371 => 0.0391, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -24.92% (0.0301 => 0.0226, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -8.80% (0.0284 => 0.0259, std.dev.: 0.0050) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.61% (0.0327 => 0.0325, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 94.57% (0.0092 => 0.0179, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -23.44% (0.0192 => 0.0147, std.dev.: 0.0024) SingleSource/UnitTests/Vector/multiplies: - (0.0253 => 0.0253, std.dev.: 0.0026) SingleSource/UnitTests/byval-alignment: 0.31% (0.0327 => 0.0328, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005) MultiSource/Applications/ClamAV/clamscan: 0.35% (0.1423 => 0.1428, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: -1.01% (1.5375 => 1.5219, std.dev.: 0.0227) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -5.52% (0.1558 => 0.1472, std.dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.18% (0.4168 => 0.4259, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.17% (0.1387 => 0.1431, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.28% (0.0535 => 0.0590, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.54% (0.0198 => 0.0191, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.44% (0.0662 => 0.0626, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.29% (1.1283 => 1.1250, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 175.00% (0.0004 => 0.0011, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.93% (0.0544 => 0.0598, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -23.71% (0.0194 => 0.0148, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.21% (0.7663 => 0.7679, std.dev.: 0.0077) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: -75.00% (0.0004 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 0.10% (1.7065 => 1.7082, std.dev.: 0.0039) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 51.25% (0.0080 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 141.57% (0.0089 => 0.0215, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: 176.67% (0.0090 => 0.0249, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -26.64% (4.1772 => 3.0646, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/except: 80916.67% (0.0006 => 0.4861, std.dev.: 0.0064) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_throw: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.73% (0.6410 => 0.7098, std.dev.: 0.0047) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.33% (0.1414 => 0.1560, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 10.08% (0.3582 => 0.3943, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 9.88% (2.1763 => 2.3913, std.dev.: 0.0351) SingleSource/Benchmarks/Misc-C++/bigfib: 8.97% (0.5309 => 0.5785, std.dev.: 0.0031) MultiSource/Applications/minisat/minisat: 8.25% (0.6173 => 0.6682, std.dev.: 0.0105) MultiSource/Applications/SIBsim4/SIBsim4: 8.23% (1.1653 => 1.2612, std.dev.: 0.0087) MultiSource/Applications/lemon/lemon: 7.19% (1.0046 => 1.0768, std.dev.: 0.0277) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.90% (1.5150 => 1.6196, std.dev.: 0.0055) MultiSource/Applications/kimwitu++/kc: 6.48% (15.3105 => 16.3023, std.dev.: 0.3304) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.11% (0.2552 => 0.2708, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.93% (0.6069 => 0.6429, std.dev.: 0.0121) MultiSource/Benchmarks/McCat/18-imp/imp: 5.91% (0.3217 => 0.3407, std.dev.: 0.0066) MultiSource/Applications/lambda-0_1_3/lambda: 5.84% (0.6915 => 0.7319, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.83% (0.7639 => 0.8084, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.58% (0.2797 => 0.2953, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 5.49% (3.0225 => 3.1883, std.dev.: 0.0156) SingleSource/Benchmarks/Misc/oourafft: 5.33% (0.1971 => 0.2076, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.32% (0.4248 => 0.4474, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.23% (0.3901 => 0.4105, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.22% (0.2662 => 0.2801, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.98% (0.4880 => 0.5123, std.dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: 4.92% (29.3170 => 30.7589, std.dev.: 0.1329) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.2654 => 0.2783, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.86% (3.0758 => 3.2252, std.dev.: 0.0164) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.64% (1.1672 => 1.2213, std.dev.: 0.0089) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.62% (0.8569 => 0.8965, std.dev.: 0.0075) MultiSource/Applications/SPASS/SPASS: 4.62% (13.3238 => 13.9388, std.dev.: 0.0978) MultiSource/Applications/siod/siod: 4.54% (2.0972 => 2.1924, std.dev.: 0.0217) MultiSource/Benchmarks/mafft/pairlocalalign: 4.54% (8.2186 => 8.5916, std.dev.: 0.0604) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.43% (1.2021 => 1.2553, std.dev.: 0.0079) MultiSource/Applications/hbd/hbd: 4.42% (1.3268 => 1.3854, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.41% (1.1827 => 1.2349, std.dev.: 0.0029) MultiSource/Applications/Burg/burg: 4.37% (1.1440 => 1.1940, std.dev.: 0.0140) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.33% (1.4408 => 1.5032, std.dev.: 0.0053) MultiSource/Applications/JM/lencod/lencod: 4.09% (14.7256 => 15.3282, std.dev.: 0.1654) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.09% (6.2546 => 6.5104, std.dev.: 0.0247) MultiSource/Benchmarks/nbench/nbench: 4.08% (1.0821 => 1.1262, std.dev.: 0.0057) MultiSource/Applications/lua/lua: 4.05% (3.5980 => 3.7436, std.dev.: 0.0485) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.02% (0.3062 => 0.3185, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 4.01% (0.8405 => 0.8742, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash: 3.98% (0.3520 => 0.3660, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.89% (12.6413 => 13.1328, std.dev.: 0.0652) MultiSource/Benchmarks/sim/sim: 3.79% (0.3084 => 0.3201, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.79% (2.0317 => 2.1086, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.60% (0.3418 => 0.3541, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.40% (0.5963 => 0.6166, std.dev.: 0.0060) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.36% (0.3008 => 0.3109, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.32% (0.5937 => 0.6134, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.16% (4.2616 => 4.3964, std.dev.: 0.0041) MultiSource/Applications/treecc/treecc: 3.03% (1.8798 => 1.9367, std.dev.: 0.0188) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.94% (4.3380 => 4.4657, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.93% (0.7226 => 0.7438, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.57% (0.5520 => 0.5662, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.47% (4.0318 => 4.1312, std.dev.: 0.0166) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.44% (8.2559 => 8.4577, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/gs/gs: 2.37% (3.8796 => 3.9715, std.dev.: 0.0175) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.29% (4.2815 => 4.3795, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.25% (1.2742 => 1.3029, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.07% (1.3935 => 1.4223, std.dev.: 0.0104) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.40% (1.6538 => 2.3385, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2280, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.58% (0.0766 => 0.0916, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/ary3: 14.71% (1.7426 => 1.9990, std.dev.: 0.0709) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.58% (4.0101 => 4.5548, std.dev.: 0.0208) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.33% (2.4042 => 2.7248, std.dev.: 0.0148) SingleSource/Benchmarks/Stanford/Puzzle: 13.19% (0.1433 => 0.1622, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/queens: 11.08% (1.6261 => 1.8063, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.75% (0.2857 => 0.3107, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/lists: 8.63% (7.0025 => 7.6065, std.dev.: 0.0347) MultiSource/Benchmarks/FreeBench/mason/mason: 8.39% (0.5004 => 0.5424, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.88% (0.3301 => 0.3528, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.74% (40.4792 => 42.8043, std.dev.: 0.3288) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.75% (4.2129 => 4.4129, std.dev.: 0.0283) SingleSource/Benchmarks/Misc/dt: 4.44% (0.9851 => 1.0288, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: 3.98% (15.2242 => 15.8299, std.dev.: 0.0285) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.65% (3.4080 => 3.5324, std.dev.: 0.0043) MultiSource/Benchmarks/Bullet/bullet: 3.32% (6.9722 => 7.2034, std.dev.: 0.0620) MultiSource/Applications/siod/siod: 3.28% (3.5520 => 3.6684, std.dev.: 0.0122) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.19% (0.5587 => 0.5765, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.94% (2.6656 => 2.7439, std.dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.80% (6.6312 => 6.8171, std.dev.: 0.0159) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.57% (0.5876 => 0.6027, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/power/power: 1.24% (1.4184 => 1.4360, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.16% (2.4455 => 2.4738, std.dev.: 0.0052) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -42.98% (0.0591 => 0.0337, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -42.66% (0.2996 => 0.1718, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.97% (1.4189 => 1.1356, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.52% (1.4113 => 1.1499, std.dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.92% (0.3497 => 0.2066, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.45% (5.2665 => 4.0844, std.dev.: 0.1531) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.62% (1.7361 => 1.4649, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1592, std.dev.: 0.0814) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -11.40% (15.8312 => 14.0260, std.dev.: 0.5254) MultiSource/Benchmarks/McCat/17-bintr/bintr: -11.23% (0.0917 => 0.0814, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.59% (1.1647 => 1.0530, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/moments: -9.34% (0.1114 => 0.1010, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.54% (1.4034 => 1.2836, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.35% (3.2007 => 2.9333, std.dev.: 0.0156) SingleSource/Benchmarks/Misc/flops: -8.32% (9.5474 => 8.7533, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.62% (3.6254 => 3.3855, std.dev.: 0.0142) MultiSource/Applications/lambda-0_1_3/lambda: -6.57% (7.6833 => 7.1786, std.dev.: 0.0435) SingleSource/Benchmarks/Shootout-C++/fibo: -6.55% (4.6355 => 4.3320, std.dev.: 0.0147) SingleSource/Benchmarks/Misc/richards_benchmark: -6.25% (1.4441 => 1.3539, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.00% (2.9728 => 2.7943, std.dev.: 0.0102) MultiSource/Benchmarks/FreeBench/distray/distray: -5.97% (0.2664 => 0.2505, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.44% (3.9413 => 3.7267, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/fib2: -5.20% (4.4195 => 4.1895, std.dev.: 0.0165) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.04% (0.4564 => 0.4334, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: -4.97% (2.5166 => 2.3914, std.dev.: 0.0124) MultiSource/Benchmarks/mafft/pairlocalalign: -4.11% (62.4126 => 59.8482, std.dev.: 0.0928) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.98% (1.1683 => 1.1218, std.dev.: 0.0085) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.86% (0.4140 => 0.3980, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: -3.71% (9.2503 => 8.9075, std.dev.: 0.0321) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.69% (3.7496 => 3.6113, std.dev.: 0.0430) SingleSource/Benchmarks/McGill/misr: -3.10% (0.4296 => 0.4163, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/neural/neural: -2.22% (1.0926 => 1.0683, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/dry: -2.21% (2.4013 => 2.3483, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: -1.98% (3.4876 => 3.4186, std.dev.: 0.0038) MultiSource/Benchmarks/sim/sim: -1.96% (3.8907 => 3.8145, std.dev.: 0.0039) MultiSource/Applications/aha/aha: -1.89% (3.4286 => 3.3637, std.dev.: 0.0059) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.85% (2.3569 => 2.3134, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.59% (1.0686 => 1.0516, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.58% (9.3855 => 9.2374, std.dev.: 0.0150) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.50% (2.4457 => 2.4090, std.dev.: 0.0096) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3147, std.dev.: 0.0560) SingleSource/Benchmarks/Dhrystone/fldry: -1.26% (2.4971 => 2.4656, std.dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.24% (27.1724 => 26.8357, std.dev.: 0.0171) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 3.37% (0.9980 => 1.0316, std.dev.: 0.0207) MultiSource/Applications/sqlite3/sqlite3: 3.40% (0.6022 => 0.6227, std.dev.: 0.0079) MultiSource/Benchmarks/McCat/08-main/main: 1.56% (0.1666 => 0.1692, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.97% (0.1554 => 0.1539, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.43% (0.3083 => 0.3158, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.96% (0.2394 => 0.2371, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.70% (0.3175 => 0.3229, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.78% (0.2302 => 0.2320, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/mandel: -5.79% (0.0449 => 0.0423, std.dev.: 0.0018) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 3.33% (0.0240 => 0.0248, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -26.56% (0.0192 => 0.0141, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.26% (0.0390 => 0.0391, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -24.92% (0.0301 => 0.0226, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -8.80% (0.0284 => 0.0259, std.dev.: 0.0050) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.31% (0.0324 => 0.0325, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 1.13% (0.0177 => 0.0179, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -22.22% (0.0189 => 0.0147, std.dev.: 0.0024) SingleSource/UnitTests/Vector/multiplies: 1.61% (0.0249 => 0.0253, std.dev.: 0.0026) SingleSource/UnitTests/byval-alignment: 0.92% (0.0325 => 0.0328, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1429 => 0.1428, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.33% (1.5019 => 1.5219, std.dev.: 0.0227) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.93% (0.1501 => 0.1472, std.dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.12% (0.4264 => 0.4259, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.47% (0.1344 => 0.1431, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.17% (0.0589 => 0.0590, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -17.67% (0.0232 => 0.0191, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.03% (0.0639 => 0.0626, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.88% (1.1350 => 1.1250, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 83.33% (0.0006 => 0.0011, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.12% (0.0637 => 0.0598, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -39.84% (0.0246 => 0.0148, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.83% (0.7541 => 0.7679, std.dev.: 0.0077) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 11.19% (1.5363 => 1.7082, std.dev.: 0.0039) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 200.00% (0.0001 => 0.0003, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 5 08:28:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 10:28:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121005152839.A4ACD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4605?compare_to=4600&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4605, Order: 165308, Start Time: 2012-10-05 14:10:45, End Time: 2012-10-05 15:30:22 To: 4600, Order: 165306, Start Time: 2012-10-05 09:24:36, End Time: 2012-10-05 10:44:59 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (153 on baseline) Performance Improvements: 1 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 952 (692 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/lowercase: -1.22% (8.0714 => 7.9732, std.dev.: 0.0379) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.09% (0.5860 => 0.5855, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 0.12% (16.1434 => 16.1633, std.dev.: 0.0093) MultiSource/Benchmarks/Bullet/bullet: -0.05% (54.8819 => 54.8559, std.dev.: 0.0401) MultiSource/Benchmarks/MallocBench/gs/gs: 0.13% (4.3791 => 4.3847, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0464 => 0.0464, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0465 => 0.0465, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.23% (0.0433 => 0.0434) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0436 => 0.0436, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0422 => 0.0422, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0423 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.24% (0.0415 => 0.0416) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.24% (0.0417 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.23% (0.0435 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.23% (0.0436 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.23% (0.0429 => 0.0428) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.23% (0.0430 => 0.0429) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.48% (0.0420 => 0.0418, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.24% (0.0419 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0425 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0426 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.23% (0.0437 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.73% (0.0439 => 0.0451, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.24% (0.0413 => 0.0412, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0414 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0425 => 0.0425) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0426 => 0.0426) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.24% (0.0417 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0417 => 0.0417, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.25% (0.0408 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.24% (0.0410 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.24% (0.0409 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.24% (0.0409 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0444 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0446 => 0.0446, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.25% (0.0407 => 0.0406, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.25% (0.0408 => 0.0407, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0408 => 0.0408) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.24% (0.0410 => 0.0409) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0417 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.24% (0.0417 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.05% (1.2423 => 1.2417, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.05% (7.7336 => 7.7298, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.11% (0.7372 => 0.7364, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.28% (0.0361 => 0.0360, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.05% (0.2170 => 0.2169, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -13.26% (63.2438 => 54.8559, std.dev.: 0.0401) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 31.97% (14.1553 => 18.6810, std.dev.: 0.0238) SingleSource/Benchmarks/Misc-C++-EH/spirit: 60.61% (3.4629 => 5.5619, std.dev.: 0.0101) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14228.75% (0.0720 => 10.3167, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952400.00% (0.0001 => 9.9525, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 48.67% (0.2554 => 0.3797, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 45.13% (10.3673 => 15.0464, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 32.80% (0.1622 => 0.2154, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 30.59% (0.1056 => 0.1379, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.94% (2.2022 => 2.5313, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.67% (7.0540 => 8.0889, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 14.25% (0.1432 => 0.1636) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.05% (0.1566 => 0.1786, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.25% (1.7609 => 1.9766, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.83% (0.0871 => 0.0974, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 11.27% (0.3282 => 0.3652, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.21% (0.3543 => 0.3940, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.73% (0.1584 => 0.1754, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 10.48% (0.3473 => 0.3837, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.44% (0.3516 => 0.3883, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.36% (0.3543 => 0.3910, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 10.32% (0.3497 => 0.3858, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.25% (0.3561 => 0.3926, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.14% (0.3828 => 0.4216, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.09% (0.3886 => 0.4278) SingleSource/UnitTests/ObjC/parameter-passing: 10.08% (0.3927 => 0.4323, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.07% (0.3694 => 0.4066, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 10.00% (0.1440 => 0.1584, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.19% (0.1143 => 0.1248, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.09% (1.5415 => 1.6816, std.dev.: 0.0048) MultiSource/Applications/minisat/minisat: 8.90% (0.7115 => 0.7748, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 8.81% (0.7433 => 0.8088, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.71% (0.4879 => 0.5304, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 8.70% (0.1655 => 0.1799, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.69% (0.1438 => 0.1563, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.67% (0.6675 => 0.7254, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 8.55% (9.4845 => 10.2950, std.dev.: 0.0089) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.50% (0.3177 => 0.3447, std.dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: 8.46% (0.3109 => 0.3372, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.25% (0.1625 => 0.1759, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 8.20% (0.1695 => 0.1834, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.19% (0.4615 => 0.4993, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 8.11% (10.4361 => 11.2828, std.dev.: 0.0118) MultiSource/Benchmarks/McCat/18-imp/imp: 8.09% (0.3423 => 0.3700, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 8.05% (0.5925 => 0.6402, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.91% (0.5105 => 0.5509, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: 7.91% (0.6030 => 0.6507) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.86% (1.3050 => 1.4076, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.2065 => 0.2227, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.84% (0.2271 => 0.2449, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.83% (0.8172 => 0.8812, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.82% (0.9765 => 1.0529, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 7.76% (5.7591 => 6.2062, std.dev.: 0.0169) MultiSource/Applications/d/make_dparser: 7.76% (3.3354 => 3.5942, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.74% (0.2700 => 0.2909, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.68% (0.1510 => 0.1626, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.67% (4.2646 => 4.5916, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.63% (0.5860 => 0.6307, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.55% (4.9449 => 5.3180, std.dev.: 0.0039) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.43% (0.3121 => 0.3353, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.43% (0.8067 => 0.8666, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.42% (0.5569 => 0.5982, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.40% (0.2107 => 0.2263, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 7.39% (0.6456 => 0.6933, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.39% (8.1363 => 8.7374, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.38% (5.0018 => 5.3707, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.35% (0.3307 => 0.3550, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.32% (0.1940 => 0.2082, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.25% (0.2758 => 0.2958, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.25% (0.5020 => 0.5384, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 7.25% (0.7326 => 0.7857, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.17% (0.4103 => 0.4397, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 7.16% (0.3422 => 0.3667, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 7.12% (0.7835 => 0.8393, std.dev.: 0.0034) MultiSource/Benchmarks/sim/sim: 7.12% (0.3387 => 0.3628, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/hash: 7.11% (0.4289 => 0.4594, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.10% (0.4636 => 0.4965, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: 7.10% (1.1642 => 1.2468, std.dev.: 0.0030) MultiSource/Applications/lua/lua: 6.94% (3.8723 => 4.1409, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.90% (0.3650 => 0.3902, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.88% (0.4203 => 0.4492, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 6.83% (1.5603 => 1.6668, std.dev.: 0.0047) MultiSource/Applications/viterbi/viterbi: 6.82% (0.1555 => 0.1661, std.dev.: 0.0029) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.79% (7.9617 => 8.5026, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.75% (0.3865 => 0.4126, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.68% (0.2891 => 0.3084, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 6.62% (0.3684 => 0.3928, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 6.61% (1.0722 => 1.1431, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.61% (0.2905 => 0.3097, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 6.57% (0.4048 => 0.4314, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.57% (0.3136 => 0.3342, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.53% (0.3826 => 0.4076, std.dev.: 0.0045) MultiSource/Applications/treecc/treecc: 6.52% (2.0273 => 2.1594, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/strcat: 6.50% (0.2831 => 0.3015, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.49% (2.0665 => 2.2007, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 6.45% (0.4620 => 0.4918, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.42% (0.2603 => 0.2770, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3603 => 0.3834, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.34% (0.3441 => 0.3659, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/09-vor/vor: 6.32% (0.3180 => 0.3381, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.29% (1.5859 => 1.6856, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.27% (0.2872 => 0.3052, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 6.26% (0.3098 => 0.3292, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.26% (0.3162 => 0.3360, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.23% (0.2871 => 0.3050, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.23% (1.1861 => 1.2600, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary: 6.22% (0.3232 => 0.3433, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.17% (0.2725 => 0.2893, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 6.16% (0.3052 => 0.3240, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.13% (0.2756 => 0.2925, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 6.07% (2.2969 => 2.4363, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.05% (0.2793 => 0.2962, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 6.01% (0.2877 => 0.3050, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.00% (0.6450 => 0.6837, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/05-eks/eks: 5.98% (0.4299 => 0.4556, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hello: 5.90% (0.2714 => 0.2874, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 5.89% (0.2802 => 0.2967, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 5.86% (0.8921 => 0.9444, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.84% (0.5981 => 0.6330, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 5.82% (21.9371 => 23.2137, std.dev.: 0.0223) SingleSource/Benchmarks/Shootout-C++/ary2: 5.62% (0.3379 => 0.3569, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.54% (2.2024 => 2.3244, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.27% (1.4186 => 1.4934, std.dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.25% (0.1906 => 0.2006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.12% (0.4064 => 0.4272, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.91% (1.1840 => 1.2421, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.63% (0.2266 => 0.2371, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.63% (0.8101 => 0.8476, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.39% (1.2842 => 1.3406, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/objinst: 4.34% (0.3131 => 0.3267, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.36% (14.3668 => 14.8500, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.09% (0.3427 => 0.3533, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 2.85% (17.1811 => 17.6713, std.dev.: 0.0175) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.83% (0.3817 => 0.3925, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.72% (3.8922 => 3.9982, std.dev.: 0.0121) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.46% (1.1194 => 1.1469, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8953, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 10.01% (1.1396 => 1.2537, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560) MultiSource/Applications/aha/aha: 9.21% (3.1595 => 3.4505, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3692, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 3.71% (0.5413 => 0.5614, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.62% (3.6395 => 3.7714, std.dev.: 0.0106) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.82% (4.2280 => 4.3474, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7655, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (0.8275 => 0.8405, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8129, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.23% (2.6546 => 2.6873, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.10% (6.5088 => 6.5804, std.dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1289, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -80.03% (0.8651 => 0.1728, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.42% (5.2763 => 3.2490, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.48% (5.3855 => 3.6363, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.03% (5.3526 => 3.6379, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -14.41% (54.1659 => 46.3599, std.dev.: 0.0086) MultiSource/Benchmarks/FreeBench/mason/mason: -13.44% (0.0811 => 0.0702, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -11.44% (22.1758 => 19.6393, std.dev.: 0.0345) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.87% (2.9384 => 2.6191, std.dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.45% (1.1492 => 0.7648, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4233, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.73% (0.0998 => 0.0861, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.10% (1.2373 => 1.1000, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -10.25% (1.5373 => 1.3798, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -10.13% (0.2161 => 0.1942, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.62% (19.9488 => 18.2296, std.dev.: 0.0436) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.67% (1.8329 => 1.7106, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.32% (1.6805 => 1.5911, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -4.98% (5.0483 => 4.7967, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.63% (1.5835 => 1.5102, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.07% (0.9957 => 0.9552, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.63% (3.2827 => 3.1636, std.dev.: 0.0075) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4953, std.dev.: 0.0081) MultiSource/Applications/hexxagon/hexxagon: -3.01% (12.4730 => 12.0973, std.dev.: 0.0014) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.99% (8.6802 => 8.5077, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.94% (8.1563 => 7.9977, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0851, std.dev.: 0.0176) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6799, std.dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: -1.54% (2.5528 => 2.5135, std.dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4219, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8561, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/lists: -1.05% (6.2999 => 6.2336, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 11.97% (0.5229 => 0.5855, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 7.83% (14.9895 => 16.1633, std.dev.: 0.0093) MultiSource/Benchmarks/MallocBench/gs/gs: 6.67% (4.1105 => 4.3847, std.dev.: 0.0107) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.39% (1.1048 => 1.2417, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.99% (7.1582 => 7.7298, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.35% (0.6222 => 0.7364, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35900.00% (0.0001 => 0.0360, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.50% (0.2116 => 0.2169, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 5 08:34:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 10:34:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121005153434.A9AB82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4606?compare_to=4601&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4606, Order: 165308, Start Time: 2012-10-05 14:10:39, End Time: 2012-10-05 15:36:16 To: 4601, Order: 165306, Start Time: 2012-10-05 09:36:47, End Time: 2012-10-05 11:02:30 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 0 (183 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1039 (681 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.01% (2.7524 => 2.7521, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (2.1153 => 2.1153, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.01% (4.9748 => 4.9745, std.dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 22.68% (2.0176 => 2.4751, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.73% (0.1410 => 0.1660) SingleSource/Benchmarks/Misc/flops: 15.86% (0.0826 => 0.0957, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.90% (0.0819 => 0.0941, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 14.44% (0.2243 => 0.2567, std.dev.: 0.0008) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.06% (0.1072 => 0.1212, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.83% (0.0834 => 0.0941, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 12.44% (0.1013 => 0.1139, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.31% (0.1413 => 0.1587, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 12.14% (0.4062 => 0.4555, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 12.13% (0.4328 => 0.4853, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 11.68% (1.3693 => 1.5293, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.61% (0.1327 => 0.1481, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.55% (3.9660 => 4.4242, std.dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 11.54% (0.7038 => 0.7850, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.52% (0.3022 => 0.3370, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.47% (0.2721 => 0.3033, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.46% (0.1588 => 0.1770, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 11.43% (0.2781 => 0.3099, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 11.33% (0.5818 => 0.6477, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.31% (0.0964 => 0.1073, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.29% (0.2596 => 0.2889, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 11.15% (0.5748 => 0.6389, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.11% (0.2782 => 0.3091, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.03% (0.3899 => 0.4329, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.94% (0.9199 => 1.0205, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.92% (0.7710 => 0.8552, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.92% (1.4563 => 1.6153, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.92% (1.2193 => 1.3524, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 10.83% (0.1062 => 0.1177, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.82% (0.3485 => 0.3862, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.81% (0.5265 => 0.5834, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.79% (0.6283 => 0.6961, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.75% (0.6959 => 0.7707, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 10.74% (0.7061 => 0.7819, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 10.60% (0.2726 => 0.3015, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 10.57% (0.3293 => 0.3641, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.56% (0.4016 => 0.4440, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 10.56% (0.2690 => 0.2974, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 10.51% (0.2607 => 0.2881, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.51% (0.2655 => 0.2934, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 10.47% (0.2760 => 0.3049, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 10.46% (0.2628 => 0.2903, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 10.42% (0.2937 => 0.3243, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.42% (0.2966 => 0.3275, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.41% (1.9828 => 2.1893, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.38% (0.3756 => 0.4146, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.38% (0.2765 => 0.3052, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.35% (0.3489 => 0.3850, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 10.32% (0.2761 => 0.3046, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.32% (0.1986 => 0.2191, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.32% (0.4390 => 0.4843, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 10.31% (13.8202 => 15.2450, std.dev.: 0.0140) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.30% (1.1364 => 1.2535, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 10.28% (0.3453 => 0.3808, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.25% (0.3580 => 0.3947, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/moments: 10.24% (0.3868 => 0.4264, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 10.20% (0.3107 => 0.3424, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 10.19% (0.3149 => 0.3470, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 10.07% (0.1003 => 0.1104, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.05% (0.2696 => 0.2967, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 10.03% (0.3192 => 0.3512, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.95% (0.1075 => 0.1182, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.94% (0.1157 => 0.1272, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 9.84% (0.2988 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 9.82% (0.3534 => 0.3881, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.77% (0.4791 => 0.5259, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 9.75% (0.2995 => 0.3287, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.68% (0.4379 => 0.4803, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 9.67% (1.0313 => 1.1310, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.63% (0.5577 => 0.6114, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 9.57% (0.1589 => 0.1741, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.52% (0.3130 => 0.3428, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 9.43% (16.6129 => 18.1794, std.dev.: 0.0107) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.40% (0.2914 => 0.3188, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 9.33% (1.1061 => 1.2093, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.21% (0.3246 => 0.3545, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.20% (0.1435 => 0.1567, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.19% (0.8698 => 0.9497, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.14% (0.5637 => 0.6152, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 9.13% (0.2945 => 0.3214, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 9.09% (0.1111 => 0.1212, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 9.09% (0.7506 => 0.8188, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.07% (0.2127 => 0.2320, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.03% (0.7460 => 0.8134, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 8.97% (0.8310 => 0.9055, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.93% (0.1276 => 0.1390) MultiSource/Benchmarks/McCat/18-imp/imp: 8.85% (0.3220 => 0.3505, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 8.84% (0.6744 => 0.7340, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.79% (0.3755 => 0.4085, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 8.78% (3.8646 => 4.2039, std.dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 8.73% (1.0594 => 1.1519, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.70% (0.2023 => 0.2199, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.63% (7.2180 => 7.8412, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.58% (0.1865 => 0.2025, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 8.54% (1.9270 => 2.0916, std.dev.: 0.0062) MultiSource/Applications/siod/siod: 8.46% (2.1791 => 2.3635, std.dev.: 0.0121) MultiSource/Applications/d/make_dparser: 8.32% (3.1889 => 3.4541, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.29% (0.1569 => 0.1699, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 8.25% (0.1478 => 0.1600, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 8.24% (0.2925 => 0.3166, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 7.98% (0.3131 => 0.3381, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.97% (0.6576 => 0.7100, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.97% (3.6692 => 3.9615, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/em3d/em3d: 7.97% (0.1657 => 0.1789, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.97% (1.3245 => 1.4300, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.92% (0.1819 => 0.1963, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.88% (0.1789 => 0.1930, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 7.82% (1.2749 => 1.3746, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.66% (0.6135 => 0.6605, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.65% (4.3801 => 4.7150, std.dev.: 0.0055) MultiSource/Applications/JM/lencod/lencod: 7.60% (14.8535 => 15.9830, std.dev.: 0.0170) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.59% (0.8818 => 0.9487, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.58% (4.4433 => 4.7800, std.dev.: 0.0090) MultiSource/Applications/oggenc/oggenc: 7.48% (4.6629 => 5.0117, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 7.43% (8.4961 => 9.1275, std.dev.: 0.0065) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.43% (0.2140 => 0.2299, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 7.37% (0.4113 => 0.4416, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 7.36% (1.2292 => 1.3197, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.27% (4.9865 => 5.3488, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/bigfib: 7.23% (0.6250 => 0.6702, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.12% (1.5188 => 1.6269, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.95% (0.3511 => 0.3755, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.94% (0.4003 => 0.4281, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.90% (0.9108 => 0.9736, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.88% (3.2742 => 3.4994, std.dev.: 0.0091) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.87% (0.2504 => 0.2676, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.85% (0.4805 => 0.5134, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 6.80% (0.3914 => 0.4180, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.78% (1.1333 => 1.2101, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/trivial-interface: 6.68% (0.3578 => 0.3817, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/property: 6.62% (0.3940 => 0.4201, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.57% (0.3789 => 0.4038, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.55% (0.3650 => 0.3889, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 6.50% (0.3601 => 0.3835, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.50% (0.3663 => 0.3901, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-4: 6.47% (0.3646 => 0.3882, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/oourafft: 6.37% (0.2008 => 0.2136, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.32% (0.3245 => 0.3450, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 6.29% (0.3623 => 0.3851, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 6.25% (6.5754 => 6.9865, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.07% (0.2321 => 0.2462, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.07% (2.1007 => 2.2283, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 6.05% (3.7467 => 3.9732, std.dev.: 0.0113) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.92% (6.2785 => 6.6501, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.15% (13.2842 => 13.9678, std.dev.: 0.0125) MultiSource/Applications/sqlite3/sqlite3: 3.71% (16.2614 => 16.8645, std.dev.: 0.0216) MultiSource/Applications/ClamAV/clamscan: 3.40% (14.5298 => 15.0235, std.dev.: 0.0089) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.48% (5.7573 => 7.5120, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 23.92% (1.8175 => 2.2523, std.dev.: 0.0525) SingleSource/Benchmarks/Misc/richards_benchmark: 11.10% (1.1560 => 1.2843, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 9.03% (0.8273 => 0.9020, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/mst/mst: 8.47% (0.1322 => 0.1434, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (3.1736 => 3.4147, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.25% (1.2998 => 1.3810, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0040, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.85% (1.7081 => 1.7739, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6761, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.57% (10.7476 => 11.1318, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9850, std.dev.: 0.0007) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.12% (7.4271 => 7.5847, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.68% (1.4298 => 1.4538, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.44% (8.3908 => 8.5118, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9676, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1872, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5783, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0268, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5906, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.04% (8.8259 => 8.9174, std.dev.: 0.0077) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.30% (0.2670 => 0.1407, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.43% (0.4657 => 0.3892, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -15.70% (0.0707 => 0.0596, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.94% (1.3819 => 1.1893, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.74% (1.3813 => 1.1915, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.48% (22.5627 => 21.7769, std.dev.: 0.0155) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862) MultiSource/Benchmarks/FreeBench/mason/mason: -12.15% (0.2238 => 0.1966, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.86% (1.2308 => 1.0971, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.08% (20.3410 => 18.2901, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.49% (1.3780 => 1.3023, std.dev.: 0.0097) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.06% (2.6470 => 2.5131, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.84% (0.9996 => 0.9612, std.dev.: 0.0026) MultiSource/Applications/siod/siod: -3.53% (3.2729 => 3.1573, std.dev.: 0.0167) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.43% (1.7688 => 1.7081, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.59% (26.5159 => 25.8282, std.dev.: 0.0234) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -2.44% (3.0263 => 2.9526, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.30% (1.9762 => 1.9308, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7153, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -1.70% (6.3560 => 6.2481, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0068, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8638, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: -1.26% (4.5928 => 4.5348, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4942, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: -1.16% (9.3358 => 9.2273, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2586, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 5 10:00:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 12:00:15 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121005170015.1DD102A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4607?compare_to=4604&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4607, Order: 165314, Start Time: 2012-10-05 15:39:06, End Time: 2012-10-05 17:01:59 To: 4604, Order: 165308, Start Time: 2012-10-05 13:58:08, End Time: 2012-10-05 15:22:23 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (14 on baseline) Performance Regressions: 12 (99 on baseline) Performance Improvements: 8 (44 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 957 (748 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/flops: 12.13% (0.0841 => 0.0943, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.62% (0.8934 => 0.9257, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.59% (0.7695 => 0.7971, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.16% (0.5664 => 0.5843, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.93% (0.7838 => 0.8068, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.55% (1.1356 => 1.1646, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.99% (0.6027 => 0.6207, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.48% (21.8945 => 22.4372, std.dev.: 0.1500) SingleSource/Benchmarks/Shootout-C++/except: 2.24% (0.4861 => 0.4970, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.88% (4.5316 => 4.6169, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.33% (1.1218 => 1.1367, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.23% (5.1635 => 5.2271, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.57% (0.8429 => 0.8044, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.62% (0.8635 => 0.8409, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -2.44% (0.8306 => 0.8103, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.41% (0.8865 => 0.8740, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.31% (0.9168 => 0.9048, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.23% (0.8930 => 0.8820, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.84% (61.1919 => 59.4547, std.dev.: 0.6143) MultiSource/Benchmarks/PAQ8p/paq8p: -1.24% (91.6971 => 90.5629, std.dev.: 0.1775) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.49% (1.0316 => 1.0265, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: -0.13% (0.6227 => 0.6219, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/08-main/main: 7.74% (0.1692 => 0.1823, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.18% (0.1539 => 0.1588, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.11% (0.3158 => 0.3123, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.84% (0.2371 => 0.2391, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.37% (0.3229 => 0.3241, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.65% (0.2320 => 0.2335, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel: 8.98% (0.0423 => 0.0461, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -2.42% (0.0248 => 0.0242, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 39.01% (0.0141 => 0.0196, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0391 => 0.0391, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 34.07% (0.0226 => 0.0303, std.dev.: 0.0055) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 10.42% (0.0259 => 0.0286, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0325 => 0.0325, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 2.23% (0.0179 => 0.0183) SingleSource/UnitTests/Vector/Altivec/test1: 31.29% (0.0147 => 0.0193, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: - (0.0253 => 0.0253, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -2.13% (0.0328 => 0.0321, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.56% (0.1428 => 0.1420, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 2.16% (1.5219 => 1.5548, std.dev.: 0.0219) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 4.55% (0.1472 => 0.1539, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.80% (0.4259 => 0.4012, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.54% (0.1431 => 0.1453, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.90% (0.0590 => 0.0567, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -10.99% (0.0191 => 0.0170, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.51% (0.0626 => 0.0579, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.17% (1.1250 => 1.1269, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 9.09% (0.0011 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.20% (0.0598 => 0.0543, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 27.03% (0.0148 => 0.0188, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.36% (0.7679 => 0.7651, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: 66.67% (0.0003 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.06% (1.7082 => 1.7072, std.dev.: 0.0012) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 66.67% (0.0003 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 141.57% (0.0089 => 0.0215, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: 161.11% (0.0090 => 0.0235, std.dev.: 0.0011) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -27.67% (4.1772 => 3.0214, std.dev.: 0.0355) SingleSource/Benchmarks/Shootout-C++/except: 82733.33% (0.0006 => 0.4970, std.dev.: 0.0011) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: -25.00% (0.0004 => 0.0003, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.76% (0.0745 => 0.0922, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.17% (0.6410 => 0.7062, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 10.13% (0.5309 => 0.5847, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.83% (0.3582 => 0.3934, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.66% (0.1159 => 0.1271, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: 9.57% (2.1763 => 2.3846, std.dev.: 0.0033) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.49% (0.1414 => 0.1534, std.dev.: 0.0036) MultiSource/Applications/minisat/minisat: 7.82% (0.6173 => 0.6656, std.dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: 7.59% (1.1653 => 1.2537, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.14% (0.2886 => 0.3092, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.06% (1.5150 => 1.6220, std.dev.: 0.0104) MultiSource/Applications/lemon/lemon: 7.06% (1.0046 => 1.0755, std.dev.: 0.0119) MultiSource/Applications/lambda-0_1_3/lambda: 6.54% (0.6915 => 0.7367, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.50% (0.4880 => 0.5197, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.39% (0.2552 => 0.2715, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.11% (0.6069 => 0.6440, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 6.01% (15.3105 => 16.2312, std.dev.: 0.0417) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.97% (0.2797 => 0.2964, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.69% (0.7639 => 0.8074, std.dev.: 0.0040) MultiSource/Applications/d/make_dparser: 5.69% (3.0225 => 3.1945, std.dev.: 0.0447) MultiSource/Benchmarks/McCat/18-imp/imp: 5.53% (0.3217 => 0.3395, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.51% (1.1672 => 1.2315, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.34% (0.4248 => 0.4475, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.27% (1.2021 => 1.2655, std.dev.: 0.0076) MultiSource/Applications/Burg/burg: 4.95% (1.1440 => 1.2006, std.dev.: 0.0101) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.90% (0.8569 => 0.8989, std.dev.: 0.0067) MultiSource/Applications/hbd/hbd: 4.90% (1.3268 => 1.3918, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.79% (0.3901 => 0.4088, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.74% (0.3062 => 0.3207, std.dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: 4.66% (29.3170 => 30.6842, std.dev.: 0.1036) MultiSource/Applications/SPASS/SPASS: 4.61% (13.3238 => 13.9383, std.dev.: 0.1809) MultiSource/Benchmarks/mafft/pairlocalalign: 4.60% (8.2186 => 8.5968, std.dev.: 0.0486) MultiSource/Applications/sgefa/sgefa: 4.55% (0.2877 => 0.3008, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.52% (1.1827 => 1.2362, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/lists: 4.52% (0.2347 => 0.2453, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 4.50% (4.7455 => 4.9590, std.dev.: 0.0778) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.48% (0.7722 => 0.8068, std.dev.: 0.0064) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.45% (0.2654 => 0.2772, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.41% (6.2546 => 6.5304, std.dev.: 0.0416) MultiSource/Applications/treecc/treecc: 4.16% (1.8798 => 1.9580, std.dev.: 0.0250) MultiSource/Benchmarks/nbench/nbench: 4.02% (1.0821 => 1.1256, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.99% (2.0317 => 2.1127, std.dev.: 0.0115) MultiSource/Applications/siod/siod: 3.97% (2.0972 => 2.1805, std.dev.: 0.0323) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.94% (1.4408 => 1.4976, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.92% (0.7226 => 0.7509, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.83% (3.0758 => 3.1935, std.dev.: 0.0065) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.82% (0.3008 => 0.3123, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 3.79% (0.3084 => 0.3201, std.dev.: 0.0022) MultiSource/Applications/lua/lua: 3.70% (3.5980 => 3.7310, std.dev.: 0.0384) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.69% (0.2952 => 0.3061, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.67% (0.5636 => 0.5843, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.63% (0.3418 => 0.3542, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 3.61% (0.2771 => 0.2871, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 3.49% (14.7256 => 15.2393, std.dev.: 0.1461) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.45% (12.6413 => 13.0769, std.dev.: 0.1640) MultiSource/Benchmarks/Prolangs-C/football/football: 3.44% (0.8405 => 0.8694, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.23% (0.5937 => 0.6129, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: 3.22% (0.3847 => 0.3971, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.18% (0.4562 => 0.4707, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.95% (4.2616 => 4.3873, std.dev.: 0.0133) MultiSource/Benchmarks/MallocBench/gs/gs: 2.87% (3.8796 => 3.9910, std.dev.: 0.0187) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.86% (1.0689 => 1.0995, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.68% (4.0318 => 4.1399, std.dev.: 0.0401) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.64% (1.2742 => 1.3079, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.64% (4.2815 => 4.3944, std.dev.: 0.0348) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.59% (4.3380 => 4.4503, std.dev.: 0.0278) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.53% (0.9029 => 0.9257, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.43% (0.5520 => 0.5654, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.40% (0.7784 => 0.7971, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.26% (8.2559 => 8.4421, std.dev.: 0.0217) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.80% (1.3935 => 1.4186, std.dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: 1.46% (0.9425 => 0.9563, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 54.79% (0.0261 => 0.0404, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/pi: 41.22% (1.6538 => 2.3355, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2278, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.49% (0.0766 => 0.0900, std.dev.: 0.0022) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 15.16% (0.0917 => 0.1056, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/ary3: 14.62% (1.7426 => 1.9974, std.dev.: 0.0620) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.42% (4.0101 => 4.5482, std.dev.: 0.0460) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.87% (2.4042 => 2.7137, std.dev.: 0.0417) SingleSource/Benchmarks/McGill/queens: 11.08% (1.6261 => 1.8062, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 9.28% (0.1433 => 0.1566, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/lists: 8.79% (7.0025 => 7.6181, std.dev.: 0.0324) MultiSource/Benchmarks/FreeBench/mason/mason: 8.55% (0.5004 => 0.5432, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.33% (0.2857 => 0.3095, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.10% (1.0063 => 1.0777, std.dev.: 0.0202) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.03% (0.3301 => 0.3500, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 5.63% (0.5876 => 0.6207, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.58% (40.4792 => 42.3343, std.dev.: 0.5031) SingleSource/Benchmarks/Misc/dt: 4.58% (0.9851 => 1.0302, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: 4.04% (15.2242 => 15.8387, std.dev.: 0.0481) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.92% (3.4080 => 3.5417, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 3.21% (3.5520 => 3.6660, std.dev.: 0.0180) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.88% (0.5587 => 0.5748, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.83% (6.6312 => 6.8191, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 2.83% (6.9722 => 7.1694, std.dev.: 0.0571) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.43% (2.6656 => 2.7304, std.dev.: 0.0153) MultiSource/Benchmarks/Olden/power/power: 1.46% (1.4184 => 1.4391, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 1.44% (1.4117 => 1.4320, std.dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -43.15% (0.0591 => 0.0336, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -42.59% (0.2996 => 0.1720, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.92% (1.4189 => 1.1646, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.62% (1.4113 => 1.1626, std.dev.: 0.0104) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.63% (0.3497 => 0.2111, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.59% (5.2665 => 4.0769, std.dev.: 0.1167) SingleSource/Benchmarks/Shootout-C++/ary3: -20.32% (1.7473 => 1.3922, std.dev.: 0.0199) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.16% (1.7361 => 1.4729, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -13.26% (15.8312 => 13.7315, std.dev.: 0.4808) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1577, std.dev.: 0.0185) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.68% (1.1647 => 1.0520, std.dev.: 0.0395) SingleSource/Benchmarks/Shootout-C++/methcall: -9.67% (9.2503 => 8.3562, std.dev.: 0.2977) SingleSource/Benchmarks/Misc/flops: -8.44% (9.5474 => 8.7412, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.37% (1.4034 => 1.2859, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.16% (3.2007 => 2.9394, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/richards_benchmark: -7.00% (1.4441 => 1.3430, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.89% (3.6254 => 3.3756, std.dev.: 0.0040) MultiSource/Applications/lambda-0_1_3/lambda: -6.77% (7.6833 => 7.1629, std.dev.: 0.0215) SingleSource/Benchmarks/Shootout-C++/fibo: -6.60% (4.6355 => 4.3297, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.98% (2.9728 => 2.7951, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/fib2: -5.24% (4.4195 => 4.1878, std.dev.: 0.0180) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.19% (3.9413 => 3.7369, std.dev.: 0.0168) MultiSource/Benchmarks/Olden/bh/bh: -5.00% (2.5166 => 2.3908, std.dev.: 0.0345) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.89% (0.4564 => 0.4341, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: -4.23% (62.4126 => 59.7752, std.dev.: 0.1143) MultiSource/Applications/sgefa/sgefa: -4.14% (0.3746 => 0.3591, std.dev.: 0.0029) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.52% (1.2722 => 1.2274, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.81% (61.1734 => 59.4547, std.dev.: 0.6143) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.75% (3.7496 => 3.6466, std.dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.70% (1.1683 => 1.1367, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.44% (0.4140 => 0.4039, std.dev.: 0.0033) MultiSource/Benchmarks/PAQ8p/paq8p: -2.35% (92.7467 => 90.5629, std.dev.: 0.1775) SingleSource/Benchmarks/Dhrystone/dry: -2.25% (2.4013 => 2.3472, std.dev.: 0.0195) MultiSource/Applications/SIBsim4/SIBsim4: -2.17% (3.4230 => 3.3488, std.dev.: 0.0214) MultiSource/Benchmarks/sim/sim: -2.06% (3.8907 => 3.8106, std.dev.: 0.0074) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.04% (2.3569 => 2.3089, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: -1.88% (1.0926 => 1.0721, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: -1.87% (3.4876 => 3.4223, std.dev.: 0.0081) MultiSource/Applications/aha/aha: -1.87% (3.4286 => 3.3646, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.82% (2.4457 => 2.4012, std.dev.: 0.0121) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.68% (1.0686 => 1.0506, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.60% (9.3855 => 9.2351, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3102, std.dev.: 0.1293) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.36% (27.1724 => 26.8015, std.dev.: 0.0089) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.86% (0.9980 => 1.0265, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: 3.27% (0.6022 => 0.6219, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/08-main/main: 9.42% (0.1666 => 0.1823, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.19% (0.1554 => 0.1588, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.30% (0.3083 => 0.3123, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.13% (0.2394 => 0.2391, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.08% (0.3175 => 0.3241, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.43% (0.2302 => 0.2335, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel: 2.67% (0.0449 => 0.0461, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.83% (0.0240 => 0.0242, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 2.08% (0.0192 => 0.0196, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.26% (0.0390 => 0.0391, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.66% (0.0301 => 0.0303, std.dev.: 0.0055) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.70% (0.0284 => 0.0286, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.31% (0.0324 => 0.0325, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 3.39% (0.0177 => 0.0183) SingleSource/UnitTests/Vector/Altivec/test1: 2.12% (0.0189 => 0.0193, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: 1.61% (0.0249 => 0.0253, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -1.23% (0.0325 => 0.0321, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.63% (0.1429 => 0.1420, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 3.52% (1.5019 => 1.5548, std.dev.: 0.0219) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 2.53% (0.1501 => 0.1539, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.91% (0.4264 => 0.4012, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.11% (0.1344 => 0.1453, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.74% (0.0589 => 0.0567, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -26.72% (0.0232 => 0.0170, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.39% (0.0639 => 0.0579, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.71% (1.1350 => 1.1269, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.76% (0.0637 => 0.0543, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -23.58% (0.0246 => 0.0188, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.46% (0.7541 => 0.7651, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.12% (1.5363 => 1.7072, std.dev.: 0.0012) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 5 10:17:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 12:17:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121005171743.6F6132A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4608?compare_to=4605&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4608, Order: 165316, Start Time: 2012-10-05 15:59:44, End Time: 2012-10-05 17:19:25 To: 4605, Order: 165308, Start Time: 2012-10-05 14:10:45, End Time: 2012-10-05 15:30:22 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (153 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 951 (691 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 6.37% (0.4126 => 0.4389, std.dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.25% (7.9732 => 8.0730, std.dev.: 0.0079) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.10% (0.5855 => 0.5849, std.dev.: 0.0065) MultiSource/Applications/SPASS/SPASS: -0.03% (16.1633 => 16.1582, std.dev.: 0.0125) MultiSource/Benchmarks/Bullet/bullet: -0.02% (54.8559 => 54.8454, std.dev.: 0.0279) MultiSource/Benchmarks/MallocBench/gs/gs: -0.13% (4.3847 => 4.3789, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0464 => 0.0464, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.22% (0.0465 => 0.0464, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.46% (0.0434 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.46% (0.0436 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0422 => 0.0422, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0423 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0416 => 0.0416) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0416 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0434 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0435 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0428 => 0.0428, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0429 => 0.0429) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0418 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.24% (0.0418 => 0.0419, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0425 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0426 => 0.0426, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.23% (0.0436 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.88% (0.0451 => 0.0438, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0412 => 0.0412, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.24% (0.0414 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0425 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0426 => 0.0426) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0416 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0409 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0409 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0408 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0408 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0444 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.22% (0.0446 => 0.0445, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.49% (0.0406 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.25% (0.0407 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.25% (0.0408 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0409 => 0.0409, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.24% (0.0417 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.24% (0.0416 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.06% (1.2417 => 1.2409, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.01% (7.7298 => 7.7303, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.05% (0.7364 => 0.7368, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 1.11% (0.0360 => 0.0364, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.23% (0.2169 => 0.2164, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -13.28% (63.2438 => 54.8454, std.dev.: 0.0279) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 31.97% (14.1553 => 18.6802, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: 60.54% (3.4629 => 5.5593, std.dev.: 0.0016) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14225.56% (0.0720 => 10.3144, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952100.00% (0.0001 => 9.9522, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 48.63% (0.2554 => 0.3796, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 45.13% (10.3673 => 15.0459, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/richards_benchmark: 32.61% (0.1622 => 0.2151, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 30.59% (0.1056 => 0.1379, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.91% (2.2022 => 2.5305, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.76% (7.0540 => 8.0954, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/flops: 14.18% (0.1432 => 0.1635, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.98% (0.1566 => 0.1785, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.23% (1.7609 => 1.9762, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.83% (0.0871 => 0.0974) SingleSource/Benchmarks/Misc/oourafft: 11.30% (0.3282 => 0.3653, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.04% (0.3543 => 0.3934, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.67% (0.1584 => 0.1753, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 10.51% (0.3473 => 0.3838, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 10.41% (0.3543 => 0.3912, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.38% (0.3497 => 0.3860, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 10.31% (0.3561 => 0.3928, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 10.24% (0.3516 => 0.3876, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 10.15% (0.3694 => 0.4069, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 10.14% (0.1440 => 0.1586, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.08% (0.3828 => 0.4214, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 10.03% (0.3927 => 0.4321, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 9.93% (0.3886 => 0.4272, std.dev.: 0.0008) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.27% (0.1143 => 0.1249, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.75% (0.4615 => 0.5019, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 8.73% (0.7433 => 0.8082, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.71% (0.4879 => 0.5304, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.66% (0.6675 => 0.7253, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 8.64% (0.1655 => 0.1798, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 8.62% (0.7115 => 0.7728, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/em3d/em3d: 8.61% (0.1695 => 0.1841, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.56% (0.3177 => 0.3449, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 8.50% (9.4845 => 10.2904, std.dev.: 0.0107) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.48% (0.1438 => 0.1560, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 8.46% (0.3109 => 0.3372, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.37% (1.5415 => 1.6705, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.24% (0.5860 => 0.6343, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.18% (0.1625 => 0.1758, std.dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 8.06% (10.4361 => 11.2777, std.dev.: 0.0164) MultiSource/Benchmarks/McCat/18-imp/imp: 7.98% (0.3423 => 0.3696, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 7.97% (0.5925 => 0.6397, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.93% (0.8172 => 0.8820, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.80% (0.2065 => 0.2226, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.80% (0.5105 => 0.5503, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 7.79% (0.6030 => 0.6500, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.79% (1.3050 => 1.4067, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.78% (0.2700 => 0.2910, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.76% (0.8067 => 0.8693, std.dev.: 0.0021) MultiSource/Applications/d/make_dparser: 7.75% (3.3354 => 3.5940, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 7.75% (5.7591 => 6.2054, std.dev.: 0.0164) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.66% (0.2271 => 0.2445, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.62% (0.1510 => 0.1625, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.56% (0.3121 => 0.3357, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.53% (4.2646 => 4.5856, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.53% (0.1940 => 0.2086, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.52% (0.5569 => 0.5988, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.50% (0.2107 => 0.2265, std.dev.: 0.0020) MultiSource/Applications/spiff/spiff: 7.43% (0.7835 => 0.8417, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.39% (4.9449 => 5.3105, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.36% (8.1363 => 8.7353, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.36% (5.0018 => 5.3697, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.35% (0.3307 => 0.3550, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.29% (0.5020 => 0.5386, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 7.28% (3.8723 => 4.1541, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.26% (0.4103 => 0.4401, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.25% (0.2758 => 0.2958, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference: 7.25% (0.7326 => 0.7857, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.24% (0.9765 => 1.0472, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 7.20% (0.6456 => 0.6921, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.16% (0.4636 => 0.4968, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 7.10% (0.3422 => 0.3665, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.00% (0.4203 => 0.4497, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 6.97% (0.3387 => 0.3623, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 6.96% (1.1642 => 1.2452, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash: 6.95% (0.4289 => 0.4587, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.88% (0.3650 => 0.3901, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 6.84% (1.5603 => 1.6671, std.dev.: 0.0096) MultiSource/Applications/viterbi/viterbi: 6.82% (0.1555 => 0.1661, std.dev.: 0.0026) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.80% (7.9617 => 8.5031, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.75% (0.3865 => 0.4126, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (0.4620 => 0.4928, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.64% (0.2891 => 0.3083, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.63% (0.3136 => 0.3344, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 6.61% (0.2905 => 0.3097, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 6.57% (0.3684 => 0.3926, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 6.55% (0.4048 => 0.4313, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.53% (0.3826 => 0.4076, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 6.52% (1.0722 => 1.1421, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.50% (0.2831 => 0.3015, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 6.45% (2.0273 => 2.1580, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3603 => 0.3834, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.39% (0.3441 => 0.3661, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.34% (2.0665 => 2.1975, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.34% (0.2603 => 0.2768, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/except: 6.27% (0.2871 => 0.3051, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.24% (1.5859 => 1.6849, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.23% (0.2872 => 0.3051, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.23% (0.3162 => 0.3359, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 6.23% (0.3098 => 0.3291, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 6.23% (0.3180 => 0.3378, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.18% (1.1861 => 1.2594, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.17% (0.2756 => 0.2926, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 6.16% (2.2969 => 2.4383, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary3: 6.15% (0.3283 => 0.3485, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.13% (0.3232 => 0.3430, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 6.12% (0.2877 => 0.3053, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/fibo: 6.09% (0.2725 => 0.2891, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 6.02% (0.4299 => 0.4558, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/wc: 6.00% (0.3052 => 0.3235, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 6.00% (0.2802 => 0.2970, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.95% (0.6450 => 0.6834, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hello: 5.90% (0.2714 => 0.2874, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.87% (0.2793 => 0.2957, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 5.87% (21.9371 => 23.2252, std.dev.: 0.0225) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.85% (0.5981 => 0.6331, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 5.83% (0.8921 => 0.9441, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 5.62% (0.3379 => 0.3569, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.46% (2.2024 => 2.3226, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.32% (1.4186 => 1.4940, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.97% (0.4064 => 0.4266, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.84% (1.1840 => 1.2413, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.55% (0.2266 => 0.2369, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.31% (1.2842 => 1.3396, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/objinst: 4.25% (0.3131 => 0.3264, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.20% (0.8101 => 0.8441, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.33% (14.3668 => 14.8457, std.dev.: 0.0174) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.92% (0.3427 => 0.3527, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.87% (17.1811 => 17.6746, std.dev.: 0.0101) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.86% (0.3817 => 0.3926, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.83% (3.8922 => 4.0022, std.dev.: 0.0221) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.38% (1.1194 => 1.1460, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.93% (1.1396 => 1.2528, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 9.20% (3.1595 => 3.4502, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.1578 => 3.3686, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.48% (3.6395 => 3.7661, std.dev.: 0.0074) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.76% (4.2280 => 4.3446, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (0.8275 => 0.8405, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8129, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.36% (0.9540 => 0.9670, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.09% (6.5088 => 6.5798, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.04% (2.6546 => 2.6822, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1289, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.05% (0.8651 => 0.1726, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.42% (5.2763 => 3.2491, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.48% (5.3855 => 3.6362, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.03% (5.3526 => 3.6381, std.dev.: 0.0033) SingleSource/UnitTests/Vector/constpool: -14.46% (54.1659 => 46.3361, std.dev.: 0.0473) MultiSource/Benchmarks/FreeBench/mason/mason: -13.44% (0.0811 => 0.0702, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -11.46% (22.1758 => 19.6348, std.dev.: 0.0423) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.79% (2.9384 => 2.6212, std.dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7645, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4249, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.53% (0.0998 => 0.0863, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.92% (1.2373 => 1.0898, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3784, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/mason/mason: -9.86% (0.2161 => 0.1948, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.46% (19.9488 => 18.2613, std.dev.: 0.0239) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.78% (1.8329 => 1.7087, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.62% (2.7294 => 2.5759, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.30% (1.6805 => 1.5914, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7962, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.87% (1.5835 => 1.5064, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.98% (0.9957 => 0.9561, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.67% (3.2827 => 3.1621, std.dev.: 0.0042) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5030, std.dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: -3.04% (12.4730 => 12.0941, std.dev.: 0.0021) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.09% (8.6802 => 8.4985, std.dev.: 0.0084) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.08% (0.4808 => 0.4708, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.02% (8.1563 => 7.9916, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6808, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -1.69% (10.2830 => 10.1089, std.dev.: 0.0219) SingleSource/UnitTests/Vector/multiplies: -1.53% (2.5528 => 2.5138, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4218, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout/lists: -1.19% (6.2999 => 6.2251, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0554 => 1.0445, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8591, std.dev.: 0.0077) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 11.86% (0.5229 => 0.5849, std.dev.: 0.0065) MultiSource/Applications/SPASS/SPASS: 7.80% (14.9895 => 16.1582, std.dev.: 0.0125) MultiSource/Benchmarks/MallocBench/gs/gs: 6.53% (4.1105 => 4.3789, std.dev.: 0.0085) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.32% (1.1048 => 1.2409, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.99% (7.1582 => 7.7303, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.42% (0.6222 => 0.7368, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36300.00% (0.0001 => 0.0364, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.27% (0.2116 => 0.2164, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 5 10:29:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 12:29:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121005172919.3AB582A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4609?compare_to=4606&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4609, Order: 165316, Start Time: 2012-10-05 16:05:26, End Time: 2012-10-05 17:31:00 To: 4606, Order: 165308, Start Time: 2012-10-05 14:10:39, End Time: 2012-10-05 15:36:16 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 1 (182 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1038 (683 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.64% (54.4613 => 56.4432, std.dev.: 0.1013) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.01% (2.7521 => 2.7523, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.00% (2.1153 => 2.1154, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.00% (4.9745 => 4.9747, std.dev.: 0.0013) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 22.68% (2.0176 => 2.4752, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.80% (0.1410 => 0.1661, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 15.86% (0.0826 => 0.0957, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 14.44% (0.2243 => 0.2567, std.dev.: 0.0037) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.06% (0.1072 => 0.1212, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.59% (0.0834 => 0.0939, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.31% (0.1413 => 0.1587, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 12.24% (0.1013 => 0.1137, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 12.13% (0.4328 => 0.4853, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.06% (0.2596 => 0.2909, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 12.01% (0.4062 => 0.4550, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.91% (0.1327 => 0.1485, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.61% (0.3022 => 0.3373, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 11.61% (1.3693 => 1.5283, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.56% (3.9660 => 4.4244, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.52% (0.1588 => 0.1771, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.50% (0.2721 => 0.3034, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 11.37% (0.7038 => 0.7838, std.dev.: 0.0061) SingleSource/UnitTests/ObjC++/property-reference-object: 11.36% (0.5818 => 0.6479, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 11.33% (0.2781 => 0.3096, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.31% (0.0964 => 0.1073, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.26% (0.7710 => 0.8578, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/Hello: 11.17% (0.5748 => 0.6390, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.04% (0.9199 => 1.0215, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.99% (0.6959 => 0.7724, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.93% (0.2782 => 0.3086, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.91% (1.2193 => 1.3523, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.90% (0.6283 => 0.6968, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.87% (0.3899 => 0.4323, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.85% (0.3485 => 0.3863, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 10.83% (0.1062 => 0.1177, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.79% (0.5265 => 0.5833, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.77% (1.4563 => 1.6132, std.dev.: 0.0044) SingleSource/UnitTests/ObjC++/property-reference: 10.72% (0.7061 => 0.7818, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists: 10.57% (0.3293 => 0.3641, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.53% (0.4016 => 0.4439, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.52% (0.1986 => 0.2195, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.49% (0.2966 => 0.3277, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 10.48% (0.2690 => 0.2972, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 10.43% (0.2607 => 0.2879, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.43% (0.2655 => 0.2932, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.42% (0.2765 => 0.3053, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 10.39% (0.2761 => 0.3048, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.38% (0.3756 => 0.4146, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 10.38% (0.2726 => 0.3009, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.37% (1.9828 => 2.1885, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/except: 10.36% (0.2760 => 0.3046, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 10.35% (0.2937 => 0.3241, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.32% (1.1364 => 1.2537, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.32% (0.4390 => 0.4843, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.32% (0.3489 => 0.3849, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/fibo: 10.31% (0.2628 => 0.2899, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 10.31% (0.3453 => 0.3809, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 10.27% (13.8202 => 15.2401, std.dev.: 0.0202) SingleSource/Benchmarks/Shootout-C++/moments: 10.24% (0.3868 => 0.4264, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 10.23% (0.3149 => 0.3471, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 10.17% (0.3107 => 0.3423, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.14% (0.1075 => 0.1184, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.11% (0.3580 => 0.3942, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: 10.07% (0.1003 => 0.1104, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 9.99% (0.3192 => 0.3511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.94% (0.1157 => 0.1272, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 9.90% (0.3534 => 0.3884, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.87% (0.2696 => 0.2962, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 9.84% (0.2988 => 0.3282, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 9.82% (0.2995 => 0.3289, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.77% (0.4791 => 0.5259, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 9.67% (1.0313 => 1.1310, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.63% (0.5577 => 0.6114, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.59% (0.4379 => 0.4799, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.58% (0.3130 => 0.3430, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: 9.57% (0.1589 => 0.1741, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 9.45% (16.6129 => 18.1829, std.dev.: 0.0223) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.33% (0.2914 => 0.3186, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 9.28% (1.1061 => 1.2087, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.20% (0.1435 => 0.1567, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.19% (0.5637 => 0.6155, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.12% (0.2127 => 0.2321, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.11% (0.8698 => 0.9490, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.09% (0.1276 => 0.1392, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.09% (0.3246 => 0.3541, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 9.07% (0.2945 => 0.3212, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.06% (0.7460 => 0.8136, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 9.00% (0.6744 => 0.7351, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 8.93% (0.8310 => 0.9052, std.dev.: 0.0123) MultiSource/Benchmarks/McCat/18-imp/imp: 8.85% (0.3220 => 0.3505, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.84% (0.3755 => 0.4087, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 8.79% (1.0594 => 1.1525, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 8.71% (0.7506 => 0.8160, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 8.70% (3.8646 => 4.2007, std.dev.: 0.0071) MultiSource/Applications/treecc/treecc: 8.64% (1.9270 => 2.0935, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.51% (7.2180 => 7.8325, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.47% (0.1865 => 0.2023, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.45% (0.2023 => 0.2194, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 8.42% (2.1791 => 2.3625, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.41% (0.6576 => 0.7129, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.35% (0.1569 => 0.1700, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 8.27% (3.1889 => 3.4527, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 8.25% (0.1478 => 0.1600, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 8.14% (0.2925 => 0.3163, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 8.03% (0.1657 => 0.1790, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 7.98% (0.3131 => 0.3381, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.97% (1.3245 => 1.4300, std.dev.: 0.0093) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.94% (0.1789 => 0.1931, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.92% (3.6692 => 3.9598, std.dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: 7.81% (1.2749 => 1.3745, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.75% (0.3511 => 0.3783, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.67% (4.3801 => 4.7159, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.66% (0.6135 => 0.6605, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 7.66% (14.8535 => 15.9907, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.62% (0.8818 => 0.9490, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.57% (4.4433 => 4.7798, std.dev.: 0.0058) MultiSource/Benchmarks/mafft/pairlocalalign: 7.56% (8.4961 => 9.1383, std.dev.: 0.0081) MultiSource/Applications/oggenc/oggenc: 7.54% (4.6629 => 5.0145, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 7.49% (0.4113 => 0.4421, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.35% (1.5188 => 1.6305, std.dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: 7.34% (1.2292 => 1.3194, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.34% (0.2140 => 0.2297, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.25% (4.9865 => 5.3481, std.dev.: 0.0204) SingleSource/Benchmarks/Misc-C++/bigfib: 7.25% (0.6250 => 0.6703, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.02% (0.4003 => 0.4284, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.96% (3.2742 => 3.5020, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.95% (0.2504 => 0.2678, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.92% (0.9108 => 0.9738, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 6.87% (0.3914 => 0.4183, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.81% (0.4805 => 0.5132, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.73% (1.1333 => 1.2096, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 6.60% (0.3940 => 0.4200, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.60% (0.1819 => 0.1939, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 6.57% (0.3578 => 0.3813, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.55% (0.3789 => 0.4037, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 6.47% (0.3646 => 0.3882, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.47% (0.3601 => 0.3834, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.39% (0.3663 => 0.3897, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.38% (0.3245 => 0.3452, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 6.37% (0.2008 => 0.2136, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.36% (0.3650 => 0.3882, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 6.35% (0.3623 => 0.3853, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 6.16% (6.5754 => 6.9807, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.07% (2.1007 => 2.2282, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.03% (0.2321 => 0.2461, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 6.01% (3.7467 => 3.9717, std.dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.91% (6.2785 => 6.6495, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.14% (13.2842 => 13.9669, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.46% (0.2243 => 0.2343, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 3.63% (16.2614 => 16.8518, std.dev.: 0.0116) MultiSource/Applications/ClamAV/clamscan: 3.49% (14.5298 => 15.0362, std.dev.: 0.0120) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5130, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 23.87% (1.8175 => 2.2513, std.dev.: 0.0213) SingleSource/Benchmarks/Misc/richards_benchmark: 11.10% (1.1560 => 1.2843, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4140, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.12% (1.2998 => 1.3794, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9999, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0051, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6764, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-6: 3.34% (1.9199 => 1.9841, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 3.17% (10.7476 => 11.0881, std.dev.: 0.0693) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.25% (7.4271 => 7.5942, std.dev.: 0.0024) MultiSource/Applications/lemon/lemon: 1.70% (1.4298 => 1.4541, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5130, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9692, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2126, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1880, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5785, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 1.13% (12.4560 => 12.5966, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0271, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.02% (8.8259 => 8.9159, std.dev.: 0.0158) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.30% (0.2670 => 0.1407, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.41% (0.4657 => 0.3893, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -15.70% (0.0707 => 0.0596, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.97% (1.3813 => 1.1883, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.81% (1.3819 => 1.1911, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.53% (22.5627 => 21.7668, std.dev.: 0.0135) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.84% (0.0997 => 0.0859, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.02% (0.2238 => 0.1969, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.85% (1.2308 => 1.0972, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.12% (20.3410 => 18.2822, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.10% (2.6470 => 2.5119, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.58% (0.9996 => 0.9638, std.dev.: 0.0056) MultiSource/Applications/siod/siod: -3.56% (3.2729 => 3.1565, std.dev.: 0.0277) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.47% (1.7688 => 1.7074, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.14% (0.4867 => 0.4714, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784) MultiSource/Applications/spiff/spiff: -2.45% (3.0263 => 2.9522, std.dev.: 0.0008) MultiSource/Applications/lua/lua: -2.40% (26.5159 => 25.8787, std.dev.: 0.0134) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.28% (1.9762 => 1.9312, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.90% (0.6589 => 0.6464, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7141, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/lists: -1.67% (6.3560 => 6.2499, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0064, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8606, std.dev.: 0.0051) MultiSource/Applications/sqlite3/sqlite3: -1.25% (4.5928 => 4.5354, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4943, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2568, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: -1.05% (9.3358 => 9.2376, std.dev.: 0.0106) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 5 11:19:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 13:19:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121005181905.3DF182A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4610?compare_to=4603&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4610, Order: 165314, Start Time: 2012-10-05 15:10:51, End Time: 2012-10-05 18:20:48 To: 4603, Order: 165306, Start Time: 2012-10-05 11:31:55, End Time: 2012-10-05 14:41:23 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 3 (134 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (131 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1036 (757 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.36% (123.6563 => 130.2842, std.dev.: 0.7104) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.20% (115.9402 => 118.4860, std.dev.: 0.0638) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.57% (54.0606 => 54.9115, std.dev.: 0.0366) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.04% (9.8116 => 9.8076, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.03% (9.4101 => 9.4127, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.02% (16.9596 => 16.9561, std.dev.: 0.0050) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 12.10% (0.3488 => 0.3910, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.96% (0.3446 => 0.3858, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 11.94% (0.3442 => 0.3853, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.92% (0.3465 => 0.3878, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 11.89% (1.5932 => 1.7826, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-3: 11.88% (0.3460 => 0.3871, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.84% (0.3496 => 0.3910, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.76% (0.3469 => 0.3877, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.52% (0.3724 => 0.4153, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 11.50% (0.3643 => 0.4062, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.48% (0.3650 => 0.4069, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.48% (0.1063 => 0.1185, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.61% (0.5826 => 0.6386, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.56% (0.5889 => 0.6452, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/05-eks/eks: 8.65% (0.1619 => 0.1759, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 8.46% (0.1218 => 0.1321, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.17% (0.2875 => 0.3110, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.09% (0.4994 => 0.5398, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.06% (0.7171 => 0.7749, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.97% (1.3152 => 1.4200, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.92% (0.2792 => 0.3013, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.84% (0.2729 => 0.2943, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.83% (1.6211 => 1.7481, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.82% (0.4361 => 0.4702, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.80% (0.5000 => 0.5390, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.78% (0.1620 => 0.1746, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 7.66% (0.2714 => 0.2922, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.64% (0.3195 => 0.3439, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 7.62% (0.3004 => 0.3233, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 7.62% (0.2823 => 0.3038, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 7.60% (0.2803 => 0.3016, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.60% (0.2738 => 0.2946, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.60% (0.2725 => 0.2932, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 7.59% (0.2780 => 0.2991, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.54% (0.2811 => 0.3023, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.54% (0.2813 => 0.3025, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.52% (0.2911 => 0.3130, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.49% (2.0673 => 2.2221, std.dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 7.47% (0.9909 => 1.0649, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.46% (3.5627 => 3.8286, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/strcat: 7.45% (0.2750 => 0.2955, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 7.42% (0.3477 => 0.3735, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 7.41% (5.5417 => 5.9525, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/wc: 7.36% (0.3096 => 0.3324, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.31% (0.2736 => 0.2936, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.30% (0.2014 => 0.2161, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.29% (2.7292 => 2.9281, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 7.19% (0.4146 => 0.4444, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.16% (0.3060 => 0.3279, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.15% (0.3258 => 0.3491, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.13% (0.3267 => 0.3500, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 7.12% (0.3678 => 0.3940, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 7.09% (23.5202 => 25.1873, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/ary2: 7.08% (0.3317 => 0.3552, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.04% (0.3282 => 0.3513, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 7.04% (0.1421 => 0.1521, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 7.03% (0.3726 => 0.3988, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.02% (0.3362 => 0.3598, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 6.99% (0.3348 => 0.3582, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.98% (0.4139 => 0.4428, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.98% (0.3625 => 0.3878, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 6.98% (0.2566 => 0.2745, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 6.93% (1.0781 => 1.1528, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: 6.85% (0.4847 => 0.5179, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.82% (0.3930 => 0.4198, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.82% (0.3124 => 0.3337, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.81% (0.3981 => 0.4252, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.78% (0.3690 => 0.3940, std.dev.: 0.0023) MultiSource/Applications/ClamAV/clamscan: 6.77% (4.2109 => 4.4960, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.71% (0.1549 => 0.1653, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 6.64% (0.1505 => 0.1605, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (0.4251 => 0.4533, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.61% (0.3890 => 0.4147, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.58% (0.3903 => 0.4160, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.55% (0.5026 => 0.5355, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.52% (0.2866 => 0.3053, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.47% (0.5900 => 0.6282, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 6.42% (1.8794 => 2.0000, std.dev.: 0.0072) MultiSource/Applications/siod/siod: 6.39% (0.6634 => 0.7058, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 6.35% (2.1013 => 2.2347, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.35% (0.3845 => 0.4089, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 6.33% (0.4029 => 0.4284, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.20% (0.1968 => 0.2090, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.19% (4.4195 => 4.6932, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.13% (0.2969 => 0.3151, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.07% (0.2737 => 0.2903, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.06% (0.6435 => 0.6825, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 6.05% (0.5012 => 0.5315, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 6.01% (1.4269 => 1.5126, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.98% (0.2040 => 0.2162, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 5.93% (0.5546 => 0.5875, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.90% (0.3084 => 0.3266, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.88% (0.4658 => 0.4932, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 5.78% (4.6177 => 4.8846, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.72% (0.3271 => 0.3458, std.dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 5.68% (2.1653 => 2.2882, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: 5.56% (0.9697 => 1.0236, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 5.55% (0.3336 => 0.3521, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 5.40% (0.2075 => 0.2187, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 5.33% (2.0346 => 2.1430, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.33% (1.9694 => 2.0743, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.33% (0.2103 => 0.2215, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 5.31% (0.7875 => 0.8293, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.27% (1.9966 => 2.1019, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 4.91% (0.2691 => 0.2823, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: 4.89% (0.2391 => 0.2508, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.62% (0.7426 => 0.7769, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.48% (0.5361 => 0.5601, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.41% (0.5584 => 0.5830, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.00% (11.6398 => 12.1055, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.87% (4.6926 => 4.8742, std.dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: 3.80% (0.3498 => 0.3631, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 2.76% (11.9555 => 12.2859, std.dev.: 0.0109) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.74% (0.3792 => 0.3896, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.44% (3.3903 => 3.6088, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6676, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/flops-2: 4.78% (1.8057 => 1.8920, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1671, std.dev.: 0.1011) SingleSource/Benchmarks/Dhrystone/dry: 4.28% (14.0481 => 14.6493, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1926, std.dev.: 0.0031) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5038, std.dev.: 0.0289) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.61% (3.1722 => 3.2233, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2864, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5814, std.dev.: 0.0193) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.83% (25.4195 => 16.5661, std.dev.: 0.0186) SingleSource/Benchmarks/Shootout-C++/ary2: -9.83% (0.2402 => 0.2166, std.dev.: 0.0055) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9762, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7865, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -3.67% (11.2080 => 10.7970, std.dev.: 0.0024) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7742, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.97% (0.6293 => 0.6106, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.90% (17.2379 => 16.7384, std.dev.: 0.0546) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8659, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5776, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4953, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (105.3826 => 104.1647, std.dev.: 0.0174) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0474, std.dev.: 0.0010) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 5 11:40:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 13:40:34 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121005184034.280C42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4611?compare_to=4607&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4611, Order: 165316, Start Time: 2012-10-05 17:18:25, End Time: 2012-10-05 18:42:19 To: 4607, Order: 165314, Start Time: 2012-10-05 15:39:06, End Time: 2012-10-05 17:01:59 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (14 on baseline) Performance Regressions: 6 (74 on baseline) Performance Improvements: 3 (42 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 968 (775 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.22% (0.2186 => 0.2300, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 7.96% (21.5894 => 23.3080, std.dev.: 0.5026) SingleSource/Benchmarks/Shootout-C++/methcall: 7.10% (8.3562 => 8.9495, std.dev.: 0.0178) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 6.51% (1.7421 => 1.8555, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/whetstone: 1.95% (2.3547 => 2.4007, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.11% (4.0810 => 4.1265, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.37% (1.1646 => 1.1487, std.dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -3.30% (0.6207 => 0.6002, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.45% (4.6169 => 4.5036, std.dev.: 0.0143) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.38% (1.0265 => 1.0226, std.dev.: 0.0072) MultiSource/Applications/sqlite3/sqlite3: 0.02% (0.6219 => 0.6220, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/08-main/main: -2.63% (0.1823 => 0.1775, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.11% (0.1588 => 0.1491, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.41% (0.3123 => 0.3079, std.dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.59% (0.2391 => 0.2377, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.19% (0.3241 => 0.3170, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.04% (0.2335 => 0.2336, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel: -1.08% (0.0461 => 0.0456, std.dev.: 0.0009) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -31.40% (0.0242 => 0.0166, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.53% (0.0196 => 0.0193, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.51% (0.0391 => 0.0389, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -22.77% (0.0303 => 0.0234, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -20.28% (0.0286 => 0.0228, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -24.92% (0.0325 => 0.0244, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/casts: -2.19% (0.0183 => 0.0179, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0193 => 0.0193, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: 1.19% (0.0253 => 0.0256, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: 3.12% (0.0321 => 0.0331, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1420 => 0.1419, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -3.98% (1.5548 => 1.4929, std.dev.: 0.0284) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -5.13% (0.1539 => 0.1460, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.92% (0.4012 => 0.4089, std.dev.: 0.0234) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.06% (0.1453 => 0.1423, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.17% (0.0567 => 0.0602, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 28.24% (0.0170 => 0.0218, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.99% (0.0579 => 0.0660, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.55% (1.1269 => 1.1331, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -8.33% (0.0012 => 0.0011, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.31% (0.0543 => 0.0561, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.36% (0.0188 => 0.0161, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.03% (0.7651 => 0.7653, std.dev.: 0.0203) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.01% (1.7072 => 1.7070, std.dev.: 0.0015) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -17.36% (0.0121 => 0.0100, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 147.19% (0.0089 => 0.0220, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: 172.22% (0.0090 => 0.0245, std.dev.: 0.0003) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -27.36% (4.1772 => 3.0345, std.dev.: 0.0398) SingleSource/Benchmarks/Shootout-C++/except: 82900.00% (0.0006 => 0.4980, std.dev.: 0.0030) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.22% (0.0745 => 0.0918, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.60% (0.1414 => 0.1578, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.20% (0.6410 => 0.7064, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 10.19% (0.3582 => 0.3947, std.dev.: 0.0136) MultiSource/Benchmarks/PAQ8p/paq8p: 9.77% (2.1763 => 2.3889, std.dev.: 0.0277) SingleSource/Benchmarks/Misc-C++/bigfib: 9.46% (0.5309 => 0.5811, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.97% (0.1159 => 0.1263, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 7.66% (0.6173 => 0.6646, std.dev.: 0.0074) MultiSource/Applications/kimwitu++/kc: 7.42% (15.3105 => 16.4466, std.dev.: 0.2474) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.38% (0.2142 => 0.2300, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 7.33% (1.0046 => 1.0782, std.dev.: 0.0102) MultiSource/Applications/SIBsim4/SIBsim4: 7.20% (1.1653 => 1.2492, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.63% (1.5150 => 1.6154, std.dev.: 0.0165) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.44% (0.6069 => 0.6460, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.32% (0.7639 => 0.8122, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.03% (0.2552 => 0.2706, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.79% (0.3901 => 0.4127, std.dev.: 0.0063) MultiSource/Applications/lambda-0_1_3/lambda: 5.68% (0.6915 => 0.7308, std.dev.: 0.0046) MultiSource/Applications/oggenc/oggenc: 5.53% (4.7455 => 5.0080, std.dev.: 0.0450) MultiSource/Applications/d/make_dparser: 5.43% (3.0225 => 3.1867, std.dev.: 0.0371) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.41% (0.4248 => 0.4478, std.dev.: 0.0067) MultiSource/Benchmarks/mafft/pairlocalalign: 5.12% (8.2186 => 8.6395, std.dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.00% (0.4880 => 0.5124, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.96% (1.2021 => 1.2617, std.dev.: 0.0089) MultiSource/Benchmarks/Bullet/bullet: 4.93% (29.3170 => 30.7618, std.dev.: 0.1192) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.92% (0.8569 => 0.8991, std.dev.: 0.0038) MultiSource/Applications/siod/siod: 4.87% (2.0972 => 2.1994, std.dev.: 0.0272) MultiSource/Applications/SPASS/SPASS: 4.67% (13.3238 => 13.9463, std.dev.: 0.1310) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.67% (1.1672 => 1.2217, std.dev.: 0.0076) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.55% (6.2546 => 6.5392, std.dev.: 0.0433) MultiSource/Applications/lua/lua: 4.48% (3.5980 => 3.7593, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/football/football: 4.40% (0.8405 => 0.8775, std.dev.: 0.0036) MultiSource/Applications/hbd/hbd: 4.18% (1.3268 => 1.3822, std.dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 4.10% (1.0821 => 1.1265, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.02% (0.3062 => 0.3185, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.95% (12.6413 => 13.1408, std.dev.: 0.1916) MultiSource/Applications/Burg/burg: 3.91% (1.1440 => 1.1887, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.78% (1.1827 => 1.2274, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.58% (0.2797 => 0.2897, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.43% (0.7226 => 0.7474, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.41% (1.0689 => 1.1053, std.dev.: 0.0114) MultiSource/Applications/JM/ldecod/ldecod: 3.35% (6.4908 => 6.7084, std.dev.: 0.0739) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.25% (4.2616 => 4.4000, std.dev.: 0.0191) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.91% (4.3380 => 4.4642, std.dev.: 0.0214) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.78% (4.0318 => 4.1437, std.dev.: 0.0425) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.61% (8.2559 => 8.4714, std.dev.: 0.0209) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.24% (0.4562 => 0.4664, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.89% (0.5937 => 0.6049, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.57% (1.3935 => 1.4154, std.dev.: 0.0080) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 55.17% (0.0261 => 0.0405, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/pi: 41.46% (1.6538 => 2.3395, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 22.10% (3.4629 => 4.2281, std.dev.: 0.0058) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.79% (2.4042 => 2.7838, std.dev.: 0.0300) SingleSource/Benchmarks/Shootout/ary3: 14.81% (1.7426 => 2.0006, std.dev.: 0.0223) SingleSource/Benchmarks/Stanford/Puzzle: 13.26% (0.1433 => 0.1623, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.15% (4.0101 => 4.5373, std.dev.: 0.0589) SingleSource/Benchmarks/McGill/queens: 11.14% (1.6261 => 1.8072, std.dev.: 0.0072) MultiSource/Benchmarks/nbench/nbench: 10.09% (21.1721 => 23.3080, std.dev.: 0.5026) MultiSource/Benchmarks/FreeBench/mason/mason: 9.91% (0.5004 => 0.5500, std.dev.: 0.0103) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.31% (0.2857 => 0.3123, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/lists: 9.15% (7.0025 => 7.6433, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.91% (1.0063 => 1.0960, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.73% (0.3301 => 0.3523, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/dt: 4.55% (0.9851 => 1.0299, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: 4.49% (15.2242 => 15.9078, std.dev.: 0.0105) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.67% (3.4080 => 3.5331, std.dev.: 0.0041) MultiSource/Applications/siod/siod: 3.64% (3.5520 => 3.6813, std.dev.: 0.0182) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.15% (0.5587 => 0.5763, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.97% (2.6656 => 2.7449, std.dev.: 0.0181) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.89% (6.6312 => 6.8229, std.dev.: 0.0211) SingleSource/Benchmarks/Shootout-C++/hash: 2.47% (0.6308 => 0.6464, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/whetstone: 2.36% (2.3453 => 2.4007, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: 1.55% (1.4184 => 1.4404, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.49% (4.0659 => 4.1265, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -43.32% (0.0591 => 0.0335, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -42.69% (0.2996 => 0.1717, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.04% (1.4189 => 1.1487, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.04% (1.4113 => 1.1567, std.dev.: 0.0475) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.38% (0.3497 => 0.2120, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.47% (5.2665 => 4.0833, std.dev.: 0.0431) SingleSource/Benchmarks/Shootout-C++/ary3: -19.68% (1.7473 => 1.4034, std.dev.: 0.0147) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.80% (15.8312 => 12.8547, std.dev.: 0.8956) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.11% (1.7361 => 1.4738, std.dev.: 0.0509) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1581, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.43% (1.1647 => 1.0549, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/moments: -9.25% (0.1114 => 0.1011, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: -8.36% (9.5474 => 8.7495, std.dev.: 0.0181) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.32% (1.4034 => 1.2866, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.66% (3.2007 => 2.9554, std.dev.: 0.0297) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.83% (3.6254 => 3.3777, std.dev.: 0.0120) MultiSource/Applications/lambda-0_1_3/lambda: -6.70% (7.6833 => 7.1686, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/fibo: -6.52% (4.6355 => 4.3333, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/richards_benchmark: -6.31% (1.4441 => 1.3530, std.dev.: 0.0153) MultiSource/Benchmarks/FreeBench/distray/distray: -6.27% (0.2664 => 0.2497, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.96% (2.9728 => 2.7956, std.dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.46% (3.9413 => 3.7260, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.37% (0.4564 => 0.4319, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/fib2: -5.22% (4.4195 => 4.1886, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/bh/bh: -4.63% (2.5166 => 2.4002, std.dev.: 0.0088) MultiSource/Benchmarks/mafft/pairlocalalign: -4.24% (62.4126 => 59.7650, std.dev.: 0.1324) MultiSource/Applications/sgefa/sgefa: -4.16% (0.3746 => 0.3590, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.70% (0.4140 => 0.3987, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: -3.25% (9.2503 => 8.9495, std.dev.: 0.0178) SingleSource/Benchmarks/McGill/misr: -2.93% (0.4296 => 0.4170, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.85% (3.7496 => 3.6429, std.dev.: 0.0131) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.36% (1.1683 => 1.1407, std.dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/dry: -2.23% (2.4013 => 2.3477, std.dev.: 0.0073) MultiSource/Benchmarks/PAQ8p/paq8p: -1.90% (92.7467 => 90.9874, std.dev.: 0.3185) SingleSource/Benchmarks/Shootout-C++/hash2: -1.84% (3.4876 => 3.4235, std.dev.: 0.0073) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.74% (2.3569 => 2.3159, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/neural/neural: -1.67% (1.0926 => 1.0743, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.55% (9.3855 => 9.2403, std.dev.: 0.0097) SingleSource/Benchmarks/Dhrystone/fldry: -1.33% (2.4971 => 2.4640, std.dev.: 0.0113) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.31% (25.6658 => 25.3291, std.dev.: 0.0049) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.13% (27.1724 => 26.8641, std.dev.: 0.0483) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.46% (0.9980 => 1.0226, std.dev.: 0.0072) MultiSource/Applications/sqlite3/sqlite3: 3.29% (0.6022 => 0.6220, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/08-main/main: 6.54% (0.1666 => 0.1775, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.05% (0.1554 => 0.1491, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.13% (0.3083 => 0.3079, std.dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.71% (0.2394 => 0.2377, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.16% (0.3175 => 0.3170, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.48% (0.2302 => 0.2336, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel: 1.56% (0.0449 => 0.0456, std.dev.: 0.0009) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -30.83% (0.0240 => 0.0166, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.52% (0.0192 => 0.0193, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.26% (0.0390 => 0.0389, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -22.26% (0.0301 => 0.0234, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -19.72% (0.0284 => 0.0228, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -24.69% (0.0324 => 0.0244, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/casts: 1.13% (0.0177 => 0.0179, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 2.12% (0.0189 => 0.0193, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: 2.81% (0.0249 => 0.0256, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: 1.85% (0.0325 => 0.0331, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -0.70% (0.1429 => 0.1419, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -0.60% (1.5019 => 1.4929, std.dev.: 0.0284) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -2.73% (0.1501 => 0.1460, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.10% (0.4264 => 0.4089, std.dev.: 0.0234) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.88% (0.1344 => 0.1423, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.21% (0.0589 => 0.0602, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -6.03% (0.0232 => 0.0218, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.29% (0.0639 => 0.0660, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.17% (1.1350 => 1.1331, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 83.33% (0.0006 => 0.0011, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.93% (0.0637 => 0.0561, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -34.55% (0.0246 => 0.0161, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.49% (0.7541 => 0.7653, std.dev.: 0.0203) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.11% (1.5363 => 1.7070, std.dev.: 0.0015) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 42.86% (0.0070 => 0.0100, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 5 12:06:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 14:06:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121005190659.05ECD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4612?compare_to=4608&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4612, Order: 165318, Start Time: 2012-10-05 17:48:36, End Time: 2012-10-05 19:08:41 To: 4608, Order: 165316, Start Time: 2012-10-05 15:59:44, End Time: 2012-10-05 17:19:25 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (155 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 951 (690 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 14.15% (0.4389 => 0.5010, std.dev.: 0.0049) MultiSource/Benchmarks/PAQ8p/paq8p: 3.52% (15.0459 => 15.5762, std.dev.: 0.0026) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.17% (0.5849 => 0.5859, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: -0.34% (16.1582 => 16.1031, std.dev.: 0.0141) MultiSource/Benchmarks/Bullet/bullet: -0.14% (54.8454 => 54.7708, std.dev.: 0.0173) MultiSource/Benchmarks/MallocBench/gs/gs: -0.32% (4.3789 => 4.3647, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.22% (0.0464 => 0.0463, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0464 => 0.0464, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.23% (0.0432 => 0.0433, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0434 => 0.0434, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0422 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.24% (0.0423 => 0.0422, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.24% (0.0416 => 0.0415) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0416 => 0.0416, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.23% (0.0434 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.23% (0.0435 => 0.0434, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0428 => 0.0428, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0429 => 0.0429, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0418 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.24% (0.0419 => 0.0418, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0425 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.23% (0.0426 => 0.0427, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.23% (0.0437 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.23% (0.0438 => 0.0437, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0412 => 0.0412, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.48% (0.0415 => 0.0413) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.24% (0.0425 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.23% (0.0426 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0416 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0417 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.24% (0.0409 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0409 => 0.0409) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0408 => 0.0408, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.25% (0.0408 => 0.0407, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0444 => 0.0444, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0445 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.49% (0.0408 => 0.0406, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.25% (0.0408 => 0.0407, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.24% (0.0409 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0409 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.24% (0.0416 => 0.0415, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.24% (0.0417 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.14% (1.2409 => 1.2426, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.16% (7.7303 => 7.7423, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.34% (0.7368 => 0.7393, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0364 => 0.0364, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.55% (0.2164 => 0.2176, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -13.40% (63.2438 => 54.7708, std.dev.: 0.0173) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 31.87% (14.1553 => 18.6669, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++-EH/spirit: 60.60% (3.4629 => 5.5615, std.dev.: 0.0173) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14225.97% (0.0720 => 10.3147, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952300.00% (0.0001 => 9.9524, std.dev.: 0.0011) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 50.24% (10.3673 => 15.5762, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: 48.63% (0.2554 => 0.3796, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: 32.49% (0.1622 => 0.2149, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 31.44% (0.1056 => 0.1388, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.23% (7.0540 => 8.1282, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.80% (2.2022 => 2.5282, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 14.25% (0.1432 => 0.1636, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.98% (0.1566 => 0.1785, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.66% (0.0798 => 0.0907, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.35% (0.0834 => 0.0937, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.06% (1.7609 => 1.9732, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.60% (0.0871 => 0.0972, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 10.85% (0.3282 => 0.3638, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.35% (0.1584 => 0.1748, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 10.34% (0.3473 => 0.3832, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.19% (0.3543 => 0.3904, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 10.16% (0.3543 => 0.3903, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 10.15% (0.3516 => 0.3873, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 10.12% (0.3497 => 0.3851, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.05% (0.3561 => 0.3919, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.85% (0.3694 => 0.4058, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.82% (0.3828 => 0.4204, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 9.80% (0.3927 => 0.4312, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/power/power: 9.72% (0.1440 => 0.1580, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 9.68% (0.3886 => 0.4262, std.dev.: 0.0028) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.07% (0.1125 => 0.1227, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.84% (0.6675 => 0.7265, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 8.76% (10.4361 => 11.3498, std.dev.: 0.0286) MultiSource/Applications/lambda-0_1_3/lambda: 8.74% (0.7433 => 0.8083, std.dev.: 0.0021) MultiSource/Applications/minisat/minisat: 8.57% (0.7115 => 0.7725, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.57% (0.4879 => 0.5297, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 8.52% (0.1655 => 0.1796, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.49% (1.5415 => 1.6723, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 8.45% (9.4845 => 10.2859, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.44% (0.3177 => 0.3445, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.41% (0.1438 => 0.1559, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/Hello: 8.29% (0.5925 => 0.6416, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.19% (0.5105 => 0.5523, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 8.18% (0.6030 => 0.6523, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 8.14% (0.3109 => 0.3362, std.dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 8.13% (5.7591 => 6.2272, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/em3d/em3d: 8.08% (0.1695 => 0.1832, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.06% (0.4615 => 0.4987, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.94% (0.1625 => 0.1754, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 7.86% (0.3423 => 0.3692, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 7.82% (3.3354 => 3.5961, std.dev.: 0.0138) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.78% (0.8172 => 0.8808, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.75% (0.1510 => 0.1627, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.73% (1.3050 => 1.4059, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 7.63% (0.3422 => 0.3683, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.57% (0.2271 => 0.2443, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.57% (4.2646 => 4.5875, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.56% (0.2700 => 0.2904, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.51% (0.2065 => 0.2220, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.49% (0.5860 => 0.6299, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.47% (8.1363 => 8.7441, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.47% (0.5569 => 0.5985, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference: 7.44% (0.7326 => 0.7871, std.dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: 7.44% (0.2905 => 0.3121, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 7.43% (0.6456 => 0.6936, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.39% (1.5603 => 1.6756, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.38% (0.4103 => 0.4406, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.38% (0.4636 => 0.4978, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 7.37% (0.4289 => 0.4605, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.36% (0.2107 => 0.2262, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.35% (5.0018 => 5.3695, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.35% (0.3307 => 0.3550, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.32% (0.3650 => 0.3917, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.30% (0.4203 => 0.4510, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.30% (0.2891 => 0.3102, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 7.26% (0.4048 => 0.4342, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.24% (0.3121 => 0.3347, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.22% (0.2758 => 0.2957, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.21% (0.3136 => 0.3362, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 7.21% (0.2831 => 0.3035, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.19% (0.9765 => 1.0467, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 7.16% (0.2725 => 0.2920, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.15% (0.8067 => 0.8644, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.13% (7.9617 => 8.5290, std.dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.12% (0.3865 => 0.4140, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 7.11% (0.7835 => 0.8392, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.10% (4.9449 => 5.2959, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 7.09% (0.3232 => 0.3461, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 7.08% (0.3052 => 0.3268, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.04% (2.0665 => 2.2120, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.01% (0.1940 => 0.2076, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 7.00% (0.3387 => 0.3624, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 6.91% (1.1642 => 1.2447, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists1: 6.89% (0.3684 => 0.3938, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.88% (0.3603 => 0.3851, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.86% (0.4620 => 0.4937, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.83% (0.5020 => 0.5363, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.80% (0.3162 => 0.3377, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.79% (0.3283 => 0.3506, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.79% (0.2871 => 0.3066, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.79% (0.2872 => 0.3067, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.79% (0.2756 => 0.2943, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 6.76% (2.0273 => 2.1644, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.74% (0.3826 => 0.4084, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 6.73% (3.8723 => 4.1329, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/matrix: 6.71% (0.3098 => 0.3306, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 6.69% (0.1555 => 0.1659, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/methcall: 6.60% (0.2877 => 0.3067, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 6.60% (0.2802 => 0.2987, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.60% (0.2714 => 0.2893, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.59% (0.2793 => 0.2977, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 6.33% (1.0722 => 1.1401, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 6.27% (0.3379 => 0.3591, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.19% (0.3441 => 0.3654, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.13% (1.1861 => 1.2588, std.dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 6.08% (21.9371 => 23.2703, std.dev.: 0.0148) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.03% (0.2603 => 0.2760, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.94% (1.5859 => 1.6801, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 5.91% (0.3180 => 0.3368, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.84% (0.5981 => 0.6330, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.75% (0.6450 => 0.6821, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 5.71% (2.2969 => 2.4281, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/football/football: 5.71% (0.8921 => 0.9430, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 5.70% (0.4299 => 0.4544, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.66% (0.1892 => 0.1999, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.39% (0.4064 => 0.4283, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.19% (2.2024 => 2.3168, std.dev.: 0.0189) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.91% (1.4186 => 1.4883, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.89% (0.3131 => 0.3284, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 4.88% (1.2842 => 1.3469, std.dev.: 0.0045) MultiSource/Benchmarks/nbench/nbench: 4.84% (1.1840 => 1.2413, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.72% (0.2266 => 0.2373, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.60% (0.8101 => 0.8474, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.18% (0.3427 => 0.3536, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.12% (14.3668 => 14.8145, std.dev.: 0.0146) MultiSource/Applications/sqlite3/sqlite3: 2.90% (17.1811 => 17.6796, std.dev.: 0.0177) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.51% (3.8922 => 3.9898, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.37% (1.1194 => 1.1459, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3123, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9648, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.86% (1.1396 => 1.2520, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Puzzle: 9.85% (0.1421 => 0.1561, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 9.22% (3.1595 => 3.4507, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3690, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.70% (3.6395 => 3.7741, std.dev.: 0.0059) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.68% (4.2280 => 4.3412, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7655, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.55% (0.8275 => 0.8403, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8130, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.17% (2.6546 => 2.6857, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5751, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1308, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.04% (0.8651 => 0.1727, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.55% (5.2763 => 3.2425, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.82% (5.3855 => 3.6180, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.39% (5.3526 => 3.6191, std.dev.: 0.0029) SingleSource/UnitTests/Vector/constpool: -14.54% (54.1659 => 46.2876, std.dev.: 0.0474) MultiSource/Benchmarks/FreeBench/mason/mason: -13.44% (0.0811 => 0.0702, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -11.35% (22.1758 => 19.6597, std.dev.: 0.0337) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.90% (2.9384 => 2.6180, std.dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: -16.18% (1.6925 => 1.4187, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.53% (0.0998 => 0.0863, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.35% (1.2373 => 1.0969, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/mandel-2: -10.43% (1.5373 => 1.3769, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/mason/mason: -10.09% (0.2161 => 0.1943, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.36% (19.9488 => 18.2813, std.dev.: 0.0234) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.72% (1.8329 => 1.7097, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.33% (1.6805 => 1.5909, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5072, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.23% (0.9957 => 0.9536, std.dev.: 0.0122) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.67% (3.2827 => 3.1623, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5007, std.dev.: 0.0048) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0983, std.dev.: 0.0012) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.99% (8.6802 => 8.5077, std.dev.: 0.0096) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.87% (8.1563 => 8.0041, std.dev.: 0.0158) SingleSource/Benchmarks/Misc/salsa20: -1.76% (10.2830 => 10.1024, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6835, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.54% (2.5528 => 2.5134, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4224, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8587, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/lists: -1.01% (6.2999 => 6.2362, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.05% (0.5229 => 0.5859, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 7.43% (14.9895 => 16.1031, std.dev.: 0.0141) MultiSource/Benchmarks/MallocBench/gs/gs: 6.18% (4.1105 => 4.3647, std.dev.: 0.0109) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.47% (1.1048 => 1.2426, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.16% (7.1582 => 7.7423, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.82% (0.6222 => 0.7393, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36300.00% (0.0001 => 0.0364, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.84% (0.2116 => 0.2176, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 5 12:24:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 14:24:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121005192405.C9D482A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4613?compare_to=4609&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4613, Order: 165319, Start Time: 2012-10-05 18:00:08, End Time: 2012-10-05 19:25:46 To: 4609, Order: 165316, Start Time: 2012-10-05 16:05:26, End Time: 2012-10-05 17:31:00 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 0 (186 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1039 (678 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.01% (2.7523 => 2.7526, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (2.1154 => 2.1154, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.01% (4.9747 => 4.9750, std.dev.: 0.0017) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 22.42% (2.0176 => 2.4700, std.dev.: 0.0074) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.94% (0.1410 => 0.1663, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 15.93% (0.0653 => 0.0757, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 15.62% (0.0826 => 0.0955, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 14.98% (0.2243 => 0.2579, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.74% (0.1072 => 0.1230, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.95% (0.0834 => 0.0942, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 12.64% (0.1013 => 0.1141, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.51% (0.1327 => 0.1493, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.46% (0.1413 => 0.1589, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 12.15% (0.4328 => 0.4854, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash: 12.11% (0.4062 => 0.4554, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.93% (0.0964 => 0.1079, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 11.86% (0.5818 => 0.6508, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 11.82% (0.7038 => 0.7870, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 11.80% (1.3693 => 1.5309, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.76% (0.2721 => 0.3041, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 11.67% (0.5748 => 0.6419, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.67% (3.9660 => 4.4287, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.59% (0.2596 => 0.2897, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.58% (0.3022 => 0.3372, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 11.43% (0.7061 => 0.7868, std.dev.: 0.0036) SingleSource/Regression/C++/ofstream_ctor: 11.40% (0.2781 => 0.3098, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.40% (0.1588 => 0.1769, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.36% (0.7710 => 0.8586, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.33% (0.9199 => 1.0241, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.29% (1.2193 => 1.3570, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.21% (0.3899 => 0.4336, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 11.21% (0.1062 => 0.1181, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.16% (0.6283 => 0.6984, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.09% (0.5265 => 0.5849, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.07% (0.2782 => 0.3090, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.05% (1.4563 => 1.6172, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 11.03% (0.1986 => 0.2205, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.91% (0.6959 => 0.7718, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.89% (0.2966 => 0.3289, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: 10.86% (0.2607 => 0.2890, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.76% (0.3485 => 0.3860, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.68% (0.4016 => 0.4445, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 10.65% (13.8202 => 15.2925, std.dev.: 0.0186) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.57% (0.3756 => 0.4153, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 10.54% (0.3293 => 0.3640, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/random: 10.52% (0.2690 => 0.2973, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.46% (1.1364 => 1.2553, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.46% (0.4390 => 0.4849, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.45% (0.3580 => 0.3954, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.44% (1.9828 => 2.1898, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 10.43% (0.2628 => 0.2902, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 10.42% (0.2726 => 0.3010, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.40% (0.2655 => 0.2931, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.38% (0.3489 => 0.3851, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 10.37% (0.1003 => 0.1107, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 10.37% (0.3868 => 0.4269, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 10.35% (0.2937 => 0.3241, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.34% (0.2765 => 0.3051, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 10.33% (0.2760 => 0.3045, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 10.31% (0.3453 => 0.3809, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 10.25% (0.2761 => 0.3044, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.20% (0.1157 => 0.1275, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 10.16% (0.3149 => 0.3469, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 10.11% (0.3107 => 0.3421, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.05% (0.1075 => 0.1183, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.02% (0.4791 => 0.5271, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.98% (0.4379 => 0.4816, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.98% (0.2696 => 0.2965, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 9.95% (1.0313 => 1.1339, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.92% (0.5577 => 0.6130, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 9.90% (0.3534 => 0.3884, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 9.90% (0.3192 => 0.3508, std.dev.: 0.0053) MultiSource/Applications/sgefa/sgefa: 9.88% (0.2995 => 0.3291, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 9.88% (0.1589 => 0.1746, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 9.81% (0.2988 => 0.3281, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.78% (0.2914 => 0.3199, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.71% (0.3130 => 0.3434, std.dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 9.66% (16.6129 => 18.2181, std.dev.: 0.0186) MultiSource/Applications/Burg/burg: 9.51% (1.1061 => 1.2113, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.48% (0.1435 => 0.1571, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 9.45% (0.1111 => 0.1216, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.45% (0.2127 => 0.2328, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.44% (0.1865 => 0.2041, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.39% (0.8698 => 0.9515, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.37% (0.5637 => 0.6165, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.37% (0.3246 => 0.3550, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 9.31% (0.6744 => 0.7372, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.25% (0.1276 => 0.1394, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 9.18% (0.8310 => 0.9073, std.dev.: 0.0025) MultiSource/Applications/spiff/spiff: 9.18% (0.7506 => 0.8195, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 9.13% (0.3220 => 0.3514, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.10% (0.7460 => 0.8139, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 9.09% (3.8646 => 4.2160, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/objinst: 9.07% (0.2945 => 0.3212, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 9.03% (1.9270 => 2.1010, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.87% (0.3755 => 0.4088, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.84% (7.2180 => 7.8560, std.dev.: 0.0052) MultiSource/Applications/siod/siod: 8.84% (2.1791 => 2.3717, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.80% (0.2023 => 0.2201, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 8.73% (0.1478 => 0.1607, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 8.65% (0.2925 => 0.3178, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 8.59% (1.0594 => 1.1504, std.dev.: 0.0018) MultiSource/Applications/d/make_dparser: 8.58% (3.1889 => 3.4624, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/em3d/em3d: 8.51% (0.1657 => 0.1798, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.49% (0.6576 => 0.7134, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.35% (0.1569 => 0.1700, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.19% (1.3245 => 1.4330, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.14% (3.6692 => 3.9677, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.06% (4.4433 => 4.8015, std.dev.: 0.0067) MultiSource/Benchmarks/sim/sim: 8.05% (0.3131 => 0.3383, std.dev.: 0.0095) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.99% (0.1789 => 0.1932, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.97% (0.6135 => 0.6624, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 7.95% (1.2749 => 1.3763, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.93% (4.3801 => 4.7274, std.dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 7.87% (14.8535 => 16.0221, std.dev.: 0.0103) MultiSource/Applications/oggenc/oggenc: 7.83% (4.6629 => 5.0278, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.72% (0.4003 => 0.4312, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 7.67% (8.4961 => 9.1477, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.66% (0.2140 => 0.2304, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.62% (0.8818 => 0.9490, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.55% (0.3511 => 0.3776, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 7.54% (0.4113 => 0.4423, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.53% (4.9865 => 5.3621, std.dev.: 0.0060) SingleSource/UnitTests/ObjC/exceptions: 7.41% (0.3914 => 0.4204, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.39% (1.5188 => 1.6310, std.dev.: 0.0068) SingleSource/UnitTests/ObjC/trivial-interface: 7.38% (0.3578 => 0.3842, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.32% (1.2292 => 1.3192, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/exceptions-4: 7.30% (0.3646 => 0.3912, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 7.28% (0.6250 => 0.6705, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 7.26% (0.3940 => 0.4226, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.25% (0.3601 => 0.3862, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.23% (0.3789 => 0.4063, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.17% (3.2742 => 3.5088, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 7.15% (0.3663 => 0.3925, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.15% (0.3650 => 0.3911, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 7.07% (0.3623 => 0.3879, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.03% (0.2504 => 0.2680, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.03% (0.9108 => 0.9748, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.02% (1.1333 => 1.2129, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.01% (0.4805 => 0.5142, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.76% (0.1819 => 0.1942, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.68% (0.2321 => 0.2476, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.56% (0.3245 => 0.3458, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 6.52% (0.2008 => 0.2139, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 6.46% (6.5754 => 7.0003, std.dev.: 0.0070) MultiSource/Applications/lua/lua: 6.42% (3.7467 => 3.9873, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.27% (2.1007 => 2.2324, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.20% (6.2785 => 6.6675, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.44% (13.2842 => 14.0075, std.dev.: 0.0176) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.86% (0.2243 => 0.2352, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 3.93% (16.2614 => 16.9005, std.dev.: 0.0135) MultiSource/Applications/ClamAV/clamscan: 3.59% (14.5298 => 15.0508, std.dev.: 0.0037) MultiSource/Benchmarks/Bullet/bullet: 1.63% (33.2944 => 33.8359, std.dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5154, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.30% (1.8175 => 2.2591, std.dev.: 0.0137) SingleSource/Benchmarks/Misc/richards_benchmark: 11.13% (1.1560 => 1.2847, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4143, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.14% (1.2998 => 1.3796, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.92% (0.2093 => 0.2196, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0050, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6762, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-6: 3.46% (1.9199 => 1.9864, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.40% (10.7476 => 11.1128, std.dev.: 0.0276) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.20% (7.4271 => 7.5903, std.dev.: 0.0076) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4530, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2068, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5123, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2122, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1882, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5782, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 1.18% (3.1071 => 3.1437, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5907, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0266, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.02% (3.6469 => 3.6842, std.dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.15% (0.2670 => 0.1411, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.78% (0.4657 => 0.3922, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/mason/mason: -15.28% (0.0707 => 0.0599, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.81% (1.3819 => 1.1910, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.81% (1.3813 => 1.1906, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.13% (22.5627 => 21.8563, std.dev.: 0.0181) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.44% (0.0997 => 0.0863, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -12.02% (0.2238 => 0.1969, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.15% (1.2308 => 1.0936, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.12% (20.3410 => 18.2818, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0126) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.77% (1.3780 => 1.2985, std.dev.: 0.0262) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.22% (2.6470 => 2.5088, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8004, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.31% (0.9996 => 0.9565, std.dev.: 0.0075) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.45% (1.7688 => 1.7077, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -3.38% (3.2729 => 3.1624, std.dev.: 0.0108) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.27% (0.4867 => 0.4708, std.dev.: 0.0006) MultiSource/Applications/lua/lua: -2.59% (26.5159 => 25.8285, std.dev.: 0.0198) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.38% (3.0263 => 2.9543, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -2.37% (1.9762 => 1.9293, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.91% (0.6589 => 0.6463, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7153, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: -1.72% (6.3560 => 6.2465, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0066, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -1.28% (4.5928 => 4.5342, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4945, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: -1.22% (9.3358 => 9.2221, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout/heapsort: -1.21% (3.9173 => 3.8699, std.dev.: 0.0085) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2571, std.dev.: 0.0034) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 5 13:21:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 15:21:24 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121005202124.5ABD02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4614?compare_to=4611&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4614, Order: 165322, Start Time: 2012-10-05 18:59:08, End Time: 2012-10-05 20:23:08 To: 4611, Order: 165316, Start Time: 2012-10-05 17:18:25, End Time: 2012-10-05 18:42:19 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (14 on baseline) Performance Regressions: 8 (83 on baseline) Performance Improvements: 4 (46 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 965 (762 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 7.85% (0.1746 => 0.1883, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.54% (0.4496 => 0.4700, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.91% (0.7740 => 0.7965, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.22% (4.3738 => 4.4270, std.dev.: 0.0085) MultiSource/Applications/treecc/treecc: 1.02% (1.9323 => 1.9521, std.dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.57% (1.2678 => 1.3511, std.dev.: 0.0094) SingleSource/Benchmarks/CoyoteBench/lpbench: 3.21% (4.0833 => 4.2142, std.dev.: 0.0293) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.16% (4.4389 => 4.5350, std.dev.: 0.0248) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.96% (0.3947 => 0.3830, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.22% (3.2368 => 3.1974, std.dev.: 0.0042) MultiSource/Benchmarks/mafft/pairlocalalign: -1.03% (8.6395 => 8.5501, std.dev.: 0.0125) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -8.47% (6.7518 => 6.1796, std.dev.: 0.1653) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.67% (1.0226 => 1.0397, std.dev.: 0.0064) MultiSource/Applications/sqlite3/sqlite3: -0.80% (0.6220 => 0.6170, std.dev.: 0.0106) MultiSource/Benchmarks/McCat/08-main/main: 3.15% (0.1775 => 0.1831, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 6.44% (0.1491 => 0.1587, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.40% (0.3079 => 0.3153, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.64% (0.2377 => 0.2416, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.14% (0.3170 => 0.3206, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.30% (0.2336 => 0.2329, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/mandel: -8.33% (0.0456 => 0.0418, std.dev.: 0.0018) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 36.14% (0.0166 => 0.0226, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -22.28% (0.0193 => 0.0150, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.26% (0.0389 => 0.0390, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 15.81% (0.0234 => 0.0271, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 26.75% (0.0228 => 0.0289, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 23.36% (0.0244 => 0.0301, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/casts: 1.68% (0.0179 => 0.0182, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -23.83% (0.0193 => 0.0147, std.dev.: 0.0024) SingleSource/UnitTests/Vector/multiplies: -0.39% (0.0256 => 0.0255, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: 0.60% (0.0331 => 0.0333, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.49% (0.1419 => 0.1426, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -0.98% (1.4929 => 1.4783, std.dev.: 0.0408) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 3.08% (0.1460 => 0.1505, std.dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.10% (0.4089 => 0.4093, std.dev.: 0.0194) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.04% (0.1423 => 0.1394, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.66% (0.0602 => 0.0612, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 19.27% (0.0218 => 0.0260, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.33% (0.0660 => 0.0605, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.04% (1.1331 => 1.1326, std.dev.: 0.0367) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 9.09% (0.0011 => 0.0012, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 360.00% (0.0005 => 0.0023, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.31% (0.0561 => 0.0602, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 34.16% (0.0161 => 0.0216, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.12% (0.7653 => 0.7662, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: -0.04% (1.7070 => 1.7064, std.dev.: 0.0164) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -59.00% (0.0100 => 0.0041, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 142.70% (0.0089 => 0.0216, std.dev.: 0.0003) SingleSource/UnitTests/2003-08-11-VaListArg: 175.56% (0.0090 => 0.0248, std.dev.: 0.0006) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -27.55% (4.1772 => 3.0263, std.dev.: 0.0343) SingleSource/Benchmarks/Shootout-C++/except: 82633.33% (0.0006 => 0.4964, std.dev.: 0.0007) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: -20.00% (0.0005 => 0.0004, std.dev.: 0.0001) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 50.00% (0.0004 => 0.0006, std.dev.: 0.0000) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 24.30% (0.0745 => 0.0926, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.79% (0.1159 => 0.1284, std.dev.: 0.0031) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.33% (0.1414 => 0.1560, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 10.15% (2.1763 => 2.3972, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.16% (0.6410 => 0.6997, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 8.78% (0.5309 => 0.5775, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 8.21% (0.6173 => 0.6680, std.dev.: 0.0027) MultiSource/Applications/SIBsim4/SIBsim4: 7.18% (1.1653 => 1.2490, std.dev.: 0.0092) MultiSource/Applications/lambda-0_1_3/lambda: 7.10% (0.6915 => 0.7406, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.92% (0.3582 => 0.3830, std.dev.: 0.0035) MultiSource/Applications/lemon/lemon: 6.88% (1.0046 => 1.0737, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.48% (1.5150 => 1.6131, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.19% (0.2797 => 0.2970, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.18% (0.6069 => 0.6444, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 6.07% (15.3105 => 16.2394, std.dev.: 0.3016) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.03% (0.2552 => 0.2706, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.60% (0.7639 => 0.8067, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.51% (1.1672 => 1.2315, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: 5.07% (3.0225 => 3.1757, std.dev.: 0.0093) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.02% (6.2546 => 6.5683, std.dev.: 0.0424) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.87% (0.3062 => 0.3211, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.78% (0.2886 => 0.3024, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.73% (0.4248 => 0.4449, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.69% (0.4880 => 0.5109, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.54% (0.7226 => 0.7554, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.41% (1.4408 => 1.5044, std.dev.: 0.0062) MultiSource/Benchmarks/Bullet/bullet: 4.40% (29.3170 => 30.6063, std.dev.: 0.0492) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.38% (0.8569 => 0.8944, std.dev.: 0.0086) MultiSource/Applications/SPASS/SPASS: 4.36% (13.3238 => 13.9052, std.dev.: 0.0213) MultiSource/Applications/lua/lua: 4.22% (3.5980 => 3.7500, std.dev.: 0.0283) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.22% (0.2654 => 0.2766, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.15% (1.1827 => 1.2318, std.dev.: 0.0103) MultiSource/Applications/sgefa/sgefa: 4.07% (0.2877 => 0.2994, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 4.06% (2.0972 => 2.1823, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.04% (1.2021 => 1.2507, std.dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 4.03% (8.2186 => 8.5501, std.dev.: 0.0125) MultiSource/Applications/hbd/hbd: 3.98% (1.3268 => 1.3796, std.dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (3.0758 => 3.1974, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.92% (0.7722 => 0.8025, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/football/football: 3.88% (0.8405 => 0.8731, std.dev.: 0.0037) MultiSource/Applications/treecc/treecc: 3.85% (1.8798 => 1.9521, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.81% (0.4562 => 0.4736, std.dev.: 0.0050) MultiSource/Applications/oggenc/oggenc: 3.80% (4.7455 => 4.9257, std.dev.: 0.0442) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.71% (0.5636 => 0.5845, std.dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 3.68% (1.0821 => 1.1219, std.dev.: 0.0080) MultiSource/Benchmarks/sim/sim: 3.63% (0.3084 => 0.3196, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.54% (0.3418 => 0.3539, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 3.46% (0.3847 => 0.3980, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: 3.44% (0.3520 => 0.3641, std.dev.: 0.0028) MultiSource/Applications/JM/lencod/lencod: 3.40% (14.7256 => 15.2263, std.dev.: 0.1101) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.40% (4.2815 => 4.4270, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.35% (2.0317 => 2.0997, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.27% (1.0689 => 1.1039, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.27% (4.0318 => 4.1638, std.dev.: 0.0147) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.26% (12.6413 => 13.0539, std.dev.: 0.1098) MultiSource/Benchmarks/MallocBench/gs/gs: 2.94% (3.8796 => 3.9938, std.dev.: 0.0360) MultiSource/Applications/Burg/burg: 2.94% (1.1440 => 1.1776, std.dev.: 0.0106) MultiSource/Applications/JM/ldecod/ldecod: 2.73% (6.4908 => 6.6681, std.dev.: 0.0406) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.62% (4.3380 => 4.4515, std.dev.: 0.0209) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.55% (0.5963 => 0.6115, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.52% (8.2559 => 8.4639, std.dev.: 0.0678) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.50% (4.2616 => 4.3683, std.dev.: 0.0305) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.33% (0.7784 => 0.7965, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.36% (1.6538 => 2.3378, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/Bubblesort: 39.16% (0.0263 => 0.0366, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2276, std.dev.: 0.0190) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 17.99% (0.0917 => 0.1082, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/ary3: 15.76% (1.7426 => 2.0172, std.dev.: 0.0245) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.29% (2.4042 => 2.7477, std.dev.: 0.0794) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.87% (4.0101 => 4.5663, std.dev.: 0.0316) SingleSource/Benchmarks/McGill/queens: 11.13% (1.6261 => 1.8071, std.dev.: 0.0073) MultiSource/Benchmarks/FreeBench/mason/mason: 9.57% (0.5004 => 0.5483, std.dev.: 0.0017) SingleSource/Benchmarks/Stanford/Puzzle: 9.56% (0.1433 => 0.1570, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/lists: 9.04% (7.0025 => 7.6354, std.dev.: 0.0668) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.03% (0.2857 => 0.3115, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.54% (0.3301 => 0.3484, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.39% (40.4792 => 42.6601, std.dev.: 0.5731) SingleSource/Benchmarks/Misc/dt: 4.09% (0.9851 => 1.0254, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: 4.07% (15.2242 => 15.8439, std.dev.: 0.0283) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.85% (3.4080 => 3.5392, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 3.54% (6.9722 => 7.2189, std.dev.: 0.0124) MultiSource/Applications/siod/siod: 3.37% (3.5520 => 3.6717, std.dev.: 0.0176) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.88% (6.6312 => 6.8225, std.dev.: 0.0124) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.16% (0.0591 => 0.0330, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -43.32% (0.2996 => 0.1698, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.91% (1.4189 => 1.1506, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.83% (1.4113 => 1.1456, std.dev.: 0.0060) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.61% (0.3497 => 0.2077, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/lpbench: -19.98% (5.2665 => 4.2142, std.dev.: 0.0293) SingleSource/Benchmarks/Shootout-C++/ary3: -18.88% (1.7473 => 1.4174, std.dev.: 0.0523) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -14.51% (1.7361 => 1.4842, std.dev.: 0.0362) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1580, std.dev.: 0.0765) MultiSource/Benchmarks/McCat/17-bintr/bintr: -11.89% (0.0917 => 0.0808, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.65% (1.1647 => 1.0523, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: -9.07% (0.1114 => 0.1013, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: -8.29% (9.5474 => 8.7557, std.dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.29% (1.4034 => 1.2871, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.14% (3.2007 => 2.9402, std.dev.: 0.0456) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.87% (3.6254 => 3.3763, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -6.81% (7.6833 => 7.1599, std.dev.: 0.0333) SingleSource/Benchmarks/Shootout-C++/fibo: -6.64% (4.6355 => 4.3276, std.dev.: 0.0234) SingleSource/Benchmarks/Misc/richards_benchmark: -6.06% (1.4441 => 1.3566, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.00% (2.9728 => 2.7943, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.43% (3.9413 => 3.7271, std.dev.: 0.0316) SingleSource/Benchmarks/Shootout/fib2: -5.31% (4.4195 => 4.1847, std.dev.: 0.0257) MultiSource/Benchmarks/Olden/bh/bh: -5.02% (2.5166 => 2.3902, std.dev.: 0.0177) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.69% (0.4564 => 0.4350, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/distray/distray: -4.39% (0.2664 => 0.2547, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.27% (45.4683 => 43.5253, std.dev.: 0.5886) MultiSource/Applications/sgefa/sgefa: -4.24% (0.3746 => 0.3587, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: -4.24% (62.4126 => 59.7674, std.dev.: 0.0290) SingleSource/Benchmarks/McGill/misr: -4.19% (0.4296 => 0.4116, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.13% (0.4140 => 0.3969, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.64% (1.4021 => 1.3511, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/methcall: -3.52% (9.2503 => 8.9245, std.dev.: 0.0648) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.88% (1.1683 => 1.1347, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.87% (3.7496 => 3.6421, std.dev.: 0.0217) MultiSource/Benchmarks/FreeBench/neural/neural: -2.28% (1.0926 => 1.0677, std.dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: -2.10% (3.4230 => 3.3510, std.dev.: 0.0179) MultiSource/Applications/aha/aha: -1.98% (3.4286 => 3.3606, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/hash2: -1.96% (3.4876 => 3.4194, std.dev.: 0.0207) MultiSource/Benchmarks/PAQ8p/paq8p: -1.94% (92.7467 => 90.9480, std.dev.: 0.2297) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.88% (2.3569 => 2.3125, std.dev.: 0.0031) MultiSource/Benchmarks/sim/sim: -1.76% (3.8907 => 3.8222, std.dev.: 0.0190) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.64% (2.8964 => 2.8490, std.dev.: 0.0122) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std.dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.38% (27.1724 => 26.7986, std.dev.: 0.0137) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.30% (9.3855 => 9.2636, std.dev.: 0.0062) SingleSource/Benchmarks/Dhrystone/fldry: -1.20% (2.4971 => 2.4671, std.dev.: 0.0115) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 4.18% (0.9980 => 1.0397, std.dev.: 0.0064) MultiSource/Applications/sqlite3/sqlite3: 2.46% (0.6022 => 0.6170, std.dev.: 0.0106) MultiSource/Benchmarks/McCat/08-main/main: 9.90% (0.1666 => 0.1831, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.12% (0.1554 => 0.1587, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.27% (0.3083 => 0.3153, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.92% (0.2394 => 0.2416, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.98% (0.3175 => 0.3206, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.17% (0.2302 => 0.2329, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/mandel: -6.90% (0.0449 => 0.0418, std.dev.: 0.0018) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -5.83% (0.0240 => 0.0226, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -21.87% (0.0192 => 0.0150, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0390 => 0.0390, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -9.97% (0.0301 => 0.0271, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.76% (0.0284 => 0.0289, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -7.10% (0.0324 => 0.0301, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/casts: 2.82% (0.0177 => 0.0182, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -22.22% (0.0189 => 0.0147, std.dev.: 0.0024) SingleSource/UnitTests/Vector/multiplies: 2.41% (0.0249 => 0.0255, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: 2.46% (0.0325 => 0.0333, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.21% (0.1429 => 0.1426, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -1.57% (1.5019 => 1.4783, std.dev.: 0.0408) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.27% (0.1501 => 0.1505, std.dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.01% (0.4264 => 0.4093, std.dev.: 0.0194) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.72% (0.1344 => 0.1394, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.90% (0.0589 => 0.0612, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 12.07% (0.0232 => 0.0260, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.32% (0.0639 => 0.0605, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.21% (1.1350 => 1.1326, std.dev.: 0.0367) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -4.17% (0.0024 => 0.0023, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.49% (0.0637 => 0.0602, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.20% (0.0246 => 0.0216, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.60% (0.7541 => 0.7662, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 11.07% (1.5363 => 1.7064, std.dev.: 0.0164) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -41.43% (0.0070 => 0.0041, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 5 13:58:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 15:58:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121005205847.8EA032A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4615?compare_to=4612&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4615, Order: 165326, Start Time: 2012-10-05 19:40:53, End Time: 2012-10-05 21:00:30 To: 4612, Order: 165318, Start Time: 2012-10-05 17:48:36, End Time: 2012-10-05 19:08:41 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (153 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 952 (692 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.62% (54.7393 => 56.1758, std.dev.: 0.1364) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.12% (0.5859 => 0.5866, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 0.32% (16.1031 => 16.1549, std.dev.: 0.0216) MultiSource/Benchmarks/Bullet/bullet: -0.13% (54.7708 => 54.6975, std.dev.: 0.0279) MultiSource/Benchmarks/MallocBench/gs/gs: 0.31% (4.3647 => 4.3782, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.43% (0.0463 => 0.0465, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.43% (0.0464 => 0.0466, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.46% (0.0433 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.46% (0.0434 => 0.0436) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.24% (0.0422 => 0.0423, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.47% (0.0422 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.48% (0.0415 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.72% (0.0416 => 0.0419, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.46% (0.0433 => 0.0435, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.46% (0.0434 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.23% (0.0428 => 0.0429, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.23% (0.0429 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.48% (0.0418 => 0.0420, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.48% (0.0418 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.47% (0.0425 => 0.0427, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0427 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.23% (0.0436 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.81% (0.0437 => 0.0458, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.73% (0.0412 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.48% (0.0413 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.71% (0.0424 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.47% (0.0425 => 0.0427, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.24% (0.0416 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.24% (0.0417 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.49% (0.0408 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.24% (0.0409 => 0.0410, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.49% (0.0408 => 0.0410, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.49% (0.0407 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.45% (0.0444 => 0.0446, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.45% (0.0445 => 0.0447, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.49% (0.0406 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.25% (0.0407 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.49% (0.0408 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.24% (0.0409 => 0.0410, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.48% (0.0415 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.48% (0.0416 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.05% (1.2426 => 1.2420, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.05% (7.7423 => 7.7462, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.39% (0.7393 => 0.7364, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -1.10% (0.0364 => 0.0360, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1433 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.70% (0.2176 => 0.2139, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -13.51% (63.2438 => 54.6975, std.dev.: 0.0279) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 31.99% (14.1553 => 18.6829, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 60.40% (3.4629 => 5.5545, std.dev.: 0.0019) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14235.14% (0.0720 => 10.3213, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9951700.00% (0.0001 => 9.9518, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 50.22% (10.3673 => 15.5741, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: 49.37% (0.2554 => 0.3815, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 30.70% (0.1622 => 0.2120, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 30.68% (0.1056 => 0.1380, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 14.32% (0.1432 => 0.1637, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.27% (7.0540 => 8.0609, std.dev.: 0.0052) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.86% (0.1566 => 0.1783, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.73% (2.2022 => 2.5046, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.83% (0.0834 => 0.0941) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.15% (1.7609 => 1.9748, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.71% (0.0871 => 0.0973, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.61% (0.1584 => 0.1752, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/oourafft: 10.48% (0.3282 => 0.3626, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.14% (0.3473 => 0.3825, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.13% (0.3543 => 0.3902, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.98% (0.3497 => 0.3846, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.96% (0.3543 => 0.3896, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.95% (0.3516 => 0.3866, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.91% (0.3561 => 0.3914, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.73% (0.3927 => 0.4309, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.69% (0.3694 => 0.4052, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 9.64% (0.3828 => 0.4197, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.60% (0.3886 => 0.4259, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 9.51% (0.1440 => 0.1577, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 8.78% (0.7115 => 0.7740, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.76% (0.6675 => 0.7260, std.dev.: 0.0137) MultiSource/Applications/lambda-0_1_3/lambda: 8.76% (0.7433 => 0.8084, std.dev.: 0.0097) SingleSource/Benchmarks/McGill/chomp: 8.64% (0.1655 => 0.1798, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.55% (0.4879 => 0.5296, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.50% (0.3177 => 0.3447, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.49% (1.5415 => 1.6724, std.dev.: 0.0025) MultiSource/Applications/sgefa/sgefa: 8.43% (0.3109 => 0.3371, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.41% (0.1438 => 0.1559, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 8.40% (9.4845 => 10.2815, std.dev.: 0.0115) MultiSource/Benchmarks/McCat/18-imp/imp: 8.36% (0.3423 => 0.3709, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.30% (0.4615 => 0.4998, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 8.25% (10.4361 => 11.2972, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.25% (0.1625 => 0.1759, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.23% (0.2271 => 0.2458, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/Hello: 8.22% (0.5925 => 0.6412, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.00% (1.3050 => 1.4094, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.98% (0.8172 => 0.8824, std.dev.: 0.0079) MultiSource/Benchmarks/Olden/em3d/em3d: 7.96% (0.1695 => 0.1830, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: 7.96% (0.6030 => 0.6510, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.94% (0.5860 => 0.6325, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 7.83% (3.3354 => 3.5964, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.82% (0.5105 => 0.5504, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.81% (0.1510 => 0.1628, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.81% (4.2646 => 4.5977, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.74% (0.2107 => 0.2270, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.70% (0.2700 => 0.2908, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/bigfib: 7.62% (0.6456 => 0.6948, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.61% (0.8067 => 0.8681, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 7.61% (5.7591 => 6.1972, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.51% (0.4103 => 0.4411, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.51% (0.2065 => 0.2220, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.51% (0.2758 => 0.2965, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.49% (0.5020 => 0.5396, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.49% (0.5569 => 0.5986, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 7.47% (0.7326 => 0.7873, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: 7.45% (0.3422 => 0.3677, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.42% (8.1363 => 8.7404, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.41% (0.9765 => 1.0489, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.41% (0.3307 => 0.3552, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.40% (0.3121 => 0.3352, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.37% (0.3865 => 0.4150, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.34% (0.4289 => 0.4604, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.32% (5.0018 => 5.3681, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.30% (0.4203 => 0.4510, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.26% (0.2891 => 0.3101, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.24% (0.3136 => 0.3363, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.21% (4.9449 => 5.3016, std.dev.: 0.0065) SingleSource/Regression/C++/ofstream_ctor: 7.19% (0.2905 => 0.3114, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 7.17% (0.3387 => 0.3630, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 7.16% (0.7835 => 0.8396, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/strcat: 7.14% (0.2831 => 0.3033, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.12% (0.4636 => 0.4966, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.11% (0.1940 => 0.2078, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.10% (0.3650 => 0.3909, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.04% (1.1642 => 1.2462, std.dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.96% (7.9617 => 8.5155, std.dev.: 0.0040) MultiSource/Applications/hbd/hbd: 6.93% (1.5603 => 1.6685, std.dev.: 0.0036) MultiSource/Applications/viterbi/viterbi: 6.88% (0.1555 => 0.1662, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/moments: 6.87% (0.4048 => 0.4326, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 6.86% (0.3603 => 0.3850, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 6.85% (3.8723 => 4.1374, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.83% (0.3441 => 0.3676, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 6.79% (0.2725 => 0.2910, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.76% (0.2871 => 0.3065, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.75% (0.2802 => 0.2991, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.72% (2.0665 => 2.2054, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wc: 6.72% (0.3052 => 0.3257, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.71% (0.2756 => 0.2941, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists1: 6.68% (0.3684 => 0.3930, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (0.4620 => 0.4928, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.66% (0.3826 => 0.4081, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.62% (0.2872 => 0.3062, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.60% (0.2714 => 0.2893, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.59% (0.3232 => 0.3445, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.57% (0.2603 => 0.2774, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.55% (0.3098 => 0.3301, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 6.54% (0.3180 => 0.3388, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 6.53% (1.0722 => 1.1422, std.dev.: 0.0114) MultiSource/Applications/treecc/treecc: 6.52% (2.0273 => 2.1595, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/ary3: 6.52% (0.3283 => 0.3497, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.52% (0.2793 => 0.2975, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.47% (0.2877 => 0.3063, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.40% (1.1861 => 1.2620, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.34% (1.5859 => 1.6864, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.10% (0.5981 => 0.6346, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.05% (0.6450 => 0.6840, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 6.01% (0.8921 => 0.9457, std.dev.: 0.0083) MultiSource/Applications/siod/siod: 5.98% (2.2969 => 2.4342, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/ary2: 5.92% (0.3379 => 0.3579, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 5.91% (0.4299 => 0.4553, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.81% (0.1892 => 0.2002, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.63% (2.2024 => 2.3265, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 5.56% (21.9371 => 23.1577, std.dev.: 0.0129) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.29% (0.4064 => 0.4279, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.22% (1.4186 => 1.4926, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.97% (1.1840 => 1.2428, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.82% (0.3131 => 0.3282, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 4.69% (1.2842 => 1.3444, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.59% (0.2266 => 0.2370, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.38% (0.8101 => 0.8456, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.44% (14.3668 => 14.8605, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.15% (0.3427 => 0.3535, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.94% (17.1811 => 17.6857, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.80% (3.8922 => 4.0011, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.07% (1.1194 => 1.1426, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.86% (1.1396 => 1.2520, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4499, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3680, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.76% (3.6395 => 3.7764, std.dev.: 0.0011) SingleSource/Regression/C/uint64_to_float: 3.71% (0.5413 => 0.5614) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.75% (4.2280 => 4.3442, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.33% (1.7254 => 1.7656, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.55% (0.8275 => 0.8403, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.47% (11.6436 => 11.8144, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.36% (0.9540 => 0.9670, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.25% (2.6546 => 2.6879, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.20% (6.5088 => 6.5870, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.13% (9.1159 => 9.2193, std.dev.: 0.0193) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.06% (6.6874 => 0.1296, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -80.03% (0.8651 => 0.1728, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.53% (5.2763 => 3.2434, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.06% (5.3855 => 3.6050, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.76% (5.3526 => 3.5993, std.dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -14.46% (54.1659 => 46.3310, std.dev.: 0.0679) MultiSource/Benchmarks/FreeBench/mason/mason: -13.44% (0.0811 => 0.0702, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.35% (2.9384 => 2.6048, std.dev.: 0.0029) MultiSource/Applications/ClamAV/clamscan: -11.33% (22.1758 => 19.6633, std.dev.: 0.0116) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.35% (1.1492 => 0.7659, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.71% (1.6925 => 1.4266, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.53% (0.0998 => 0.0863, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.31% (1.2373 => 1.0973, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -10.32% (1.5373 => 1.3786, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/mason/mason: -10.09% (0.2161 => 0.1943, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.29% (19.9488 => 18.2941, std.dev.: 0.1250) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4787, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.73% (1.8329 => 1.7096, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5753, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8479, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.33% (1.6805 => 1.5909, std.dev.: 0.0027) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7966, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.97% (1.5835 => 1.5048, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.30% (0.9957 => 0.9529, std.dev.: 0.0106) MultiSource/Applications/siod/siod: -3.75% (3.2827 => 3.1596, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5036, std.dev.: 0.0071) MultiSource/Applications/hexxagon/hexxagon: -3.02% (12.4730 => 12.0957, std.dev.: 0.0027) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.91% (8.6802 => 8.5145, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -1.72% (10.2830 => 10.1065, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6820, std.dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.64% (2.5528 => 2.5110, std.dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4213, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.46% (8.1563 => 8.0374, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout/lists: -1.29% (6.2999 => 6.2187, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8580, std.dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.18% (0.5229 => 0.5866, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 7.77% (14.9895 => 16.1549, std.dev.: 0.0216) MultiSource/Benchmarks/MallocBench/gs/gs: 6.51% (4.1105 => 4.3782, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.42% (1.1048 => 1.2420, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.21% (7.1582 => 7.7462, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.35% (0.6222 => 0.7364, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35900.00% (0.0001 => 0.0360, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.09% (0.2116 => 0.2139, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 5 14:18:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 16:18:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121005211850.54A1F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4616?compare_to=4613&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4616, Order: 165326, Start Time: 2012-10-05 19:54:56, End Time: 2012-10-05 21:20:29 To: 4613, Order: 165319, Start Time: 2012-10-05 18:00:08, End Time: 2012-10-05 19:25:46 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 1 (183 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1038 (681 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.12% (78.2726 => 80.7174, std.dev.: 0.4411) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.01% (2.7526 => 2.7524, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (2.1154 => 2.1154, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.00% (4.9750 => 4.9749, std.dev.: 0.0006) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.54% (2.0176 => 2.4522, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.45% (0.1410 => 0.1656, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 15.13% (0.0826 => 0.0951, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/08-main/main: 14.27% (0.2243 => 0.2563, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.06% (0.1072 => 0.1212, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.94% (0.0819 => 0.0925, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.47% (0.0834 => 0.0938, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 12.24% (0.1013 => 0.1137, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.91% (0.1327 => 0.1485, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.68% (0.1413 => 0.1578, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 11.41% (0.4328 => 0.4822, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.28% (0.2721 => 0.3028, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 11.18% (0.4062 => 0.4516, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.15% (0.1588 => 0.1765, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 11.14% (1.3693 => 1.5218, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.09% (3.9660 => 4.4059, std.dev.: 0.0159) MultiSource/Applications/lambda-0_1_3/lambda: 11.05% (0.7038 => 0.7816, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.00% (0.0964 => 0.1070, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.82% (0.2596 => 0.2877, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 10.76% (0.5818 => 0.6444, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.75% (0.7710 => 0.8539, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.73% (0.9199 => 1.0186, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.69% (1.2193 => 1.3496, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 10.64% (0.1062 => 0.1175, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 10.59% (0.5748 => 0.6357, std.dev.: 0.0034) SingleSource/Regression/C++/ofstream_ctor: 10.57% (0.2781 => 0.3075, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.49% (1.4563 => 1.6090, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.46% (0.6959 => 0.7687, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.28% (1.1364 => 1.2532, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.26% (0.3899 => 0.4299, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.24% (0.5265 => 0.5804, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.20% (0.6283 => 0.6924, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 10.13% (0.7061 => 0.7776, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.06% (0.2782 => 0.3062, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.99% (0.3022 => 0.3324, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.99% (0.3485 => 0.3833, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 9.86% (13.8202 => 15.1823, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.76% (0.4016 => 0.4408, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists: 9.63% (0.3293 => 0.3610, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.61% (0.5577 => 0.6113, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.56% (0.3756 => 0.4115, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 9.53% (0.2760 => 0.3023, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.53% (1.9828 => 2.1717, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.52% (0.4390 => 0.4808, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.52% (0.3489 => 0.3821, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.51% (0.1157 => 0.1267, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.49% (0.1075 => 0.1177, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 9.48% (0.2995 => 0.3279, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 9.48% (0.2690 => 0.2945, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 9.47% (0.2607 => 0.2854, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.47% (0.3580 => 0.3919, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 9.44% (0.2628 => 0.2876, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 9.43% (0.2726 => 0.2983, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.41% (0.2966 => 0.3245, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 9.41% (1.0313 => 1.1283, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.38% (0.2655 => 0.2904, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.37% (0.2765 => 0.3024) SingleSource/Benchmarks/Shootout-C++/wc: 9.36% (0.2937 => 0.3212, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.36% (0.4379 => 0.4789, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 9.34% (0.2761 => 0.3019, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.33% (0.3130 => 0.3422, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/sieve: 9.24% (0.3453 => 0.3772, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 9.23% (0.3868 => 0.4225, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 9.21% (0.3107 => 0.3393, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.16% (0.4791 => 0.5230, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 9.15% (0.3149 => 0.3437, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 9.13% (0.1589 => 0.1734, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.06% (0.1986 => 0.2166, std.dev.: 0.0025) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.06% (0.1435 => 0.1565, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 9.04% (0.2988 => 0.3258, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.03% (0.2914 => 0.3177, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.98% (0.2696 => 0.2938, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 8.96% (0.3192 => 0.3478, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.93% (0.1276 => 0.1390, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 8.92% (1.1061 => 1.2048, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 8.91% (0.3534 => 0.3849, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.87% (0.3246 => 0.3534, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 8.80% (0.8310 => 0.9041, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 8.79% (16.6129 => 18.0735, std.dev.: 0.0158) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.79% (0.2127 => 0.2314, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.74% (0.7460 => 0.8112, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.73% (0.5637 => 0.6129, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 8.72% (3.8646 => 4.2014, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 8.63% (0.3220 => 0.3498, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 8.59% (0.6744 => 0.7323, std.dev.: 0.0021) MultiSource/Applications/spiff/spiff: 8.54% (0.7506 => 0.8147, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.47% (0.1865 => 0.2023, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.39% (0.8698 => 0.9428, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.30% (0.2023 => 0.2191, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.26% (0.6576 => 0.7119, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.24% (7.2180 => 7.8128, std.dev.: 0.0056) MultiSource/Applications/d/make_dparser: 8.21% (3.1889 => 3.4508, std.dev.: 0.0027) MultiSource/Applications/treecc/treecc: 8.16% (1.9270 => 2.0843, std.dev.: 0.0093) MultiSource/Applications/siod/siod: 8.12% (2.1791 => 2.3561, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 8.08% (0.2945 => 0.3183, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 8.03% (0.2925 => 0.3160, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 7.89% (1.0594 => 1.1430, std.dev.: 0.0023) MultiSource/Applications/viterbi/viterbi: 7.85% (0.1478 => 0.1594, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 7.81% (4.6629 => 5.0271, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.80% (0.3755 => 0.4048, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 7.72% (0.1657 => 0.1785, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.70% (0.8818 => 0.9497, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.69% (0.3511 => 0.3781, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 7.61% (1.2749 => 1.3719, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 7.60% (0.3131 => 0.3369, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.60% (3.6692 => 3.9479, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.57% (1.3245 => 1.4248, std.dev.: 0.0060) MultiSource/Applications/JM/lencod/lencod: 7.54% (14.8535 => 15.9734, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.52% (0.1569 => 0.1687, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.51% (0.6135 => 0.6596, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.48% (0.2140 => 0.2300, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.45% (4.4433 => 4.7743, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.44% (4.3801 => 4.7060, std.dev.: 0.0094) MultiSource/Benchmarks/mafft/pairlocalalign: 7.40% (8.4961 => 9.1248, std.dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.38% (0.1789 => 0.1921, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.12% (0.4113 => 0.4406, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.04% (0.1819 => 0.1947, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.83% (0.9108 => 0.9730, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/parameter-passing: 6.79% (0.4003 => 0.4275, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.79% (0.2504 => 0.2674, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 6.68% (1.2292 => 1.3113, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.68% (1.5188 => 1.6202, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.62% (4.9865 => 5.3164, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.60% (3.2742 => 3.4904, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/exceptions: 6.57% (0.3914 => 0.4171, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.55% (1.1333 => 1.2075, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/bigfib: 6.45% (0.6250 => 0.6653, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 6.37% (0.3578 => 0.3806, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.29% (0.4805 => 0.5107, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 6.24% (0.3940 => 0.4186, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 6.23% (0.2008 => 0.2133, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 6.22% (0.3601 => 0.3825, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.15% (0.3789 => 0.4022, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.14% (0.3646 => 0.3870, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.14% (0.3650 => 0.3874, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 6.12% (0.3663 => 0.3887, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 6.11% (6.5754 => 6.9774, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-3: 5.96% (0.3623 => 0.3839, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.86% (0.2321 => 0.2457, std.dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.82% (6.2785 => 6.6437, std.dev.: 0.0042) MultiSource/Applications/lua/lua: 5.77% (3.7467 => 3.9628, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.67% (0.3245 => 0.3429, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.63% (2.1007 => 2.2190, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.98% (13.2842 => 13.9462, std.dev.: 0.0083) MultiSource/Applications/sqlite3/sqlite3: 3.45% (16.2614 => 16.8231, std.dev.: 0.0113) MultiSource/Applications/ClamAV/clamscan: 3.22% (14.5298 => 14.9971, std.dev.: 0.0199) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5160, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.05% (1.0895 => 1.3624, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 23.86% (1.8175 => 2.2511, std.dev.: 0.0540) SingleSource/Benchmarks/Misc/richards_benchmark: 11.12% (1.1560 => 1.2845, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (3.1736 => 3.4147, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.29% (1.2998 => 1.3815, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.45% (0.2093 => 0.2207, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.77% (1.9144 => 2.0058, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.89% (1.7081 => 1.7746, std.dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 3.67% (11.2619 => 11.6750, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 3.48% (10.7476 => 11.1220, std.dev.: 0.0664) SingleSource/Benchmarks/Misc/flops-6: 3.37% (1.9199 => 1.9846, std.dev.: 0.0007) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.13% (7.4271 => 7.5851, std.dev.: 0.0156) MultiSource/Applications/lemon/lemon: 1.55% (1.4298 => 1.4520, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5121, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/queens: 1.43% (2.1753 => 2.2065, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.30% (8.8259 => 8.9410, std.dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2123, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1863, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5780, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0263, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.04% (3.6469 => 3.6849, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 1.01% (12.4560 => 12.5817, std.dev.: 0.0064) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.15% (0.2670 => 0.1411, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.53% (0.4657 => 0.3887, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -15.70% (0.0707 => 0.0596, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.05% (1.3819 => 1.1877, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.00% (1.3813 => 1.1879, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.80% (22.5627 => 21.7053, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.34% (0.0997 => 0.0864, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -11.93% (0.2238 => 0.1971, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.14% (1.2308 => 1.0937, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.07% (20.3410 => 18.2929, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.08% (1.3780 => 1.3080, std.dev.: 0.0083) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.58% (0.9996 => 0.9538, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.60% (3.2729 => 3.1551, std.dev.: 0.0250) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.40% (1.7688 => 1.7086, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.48% (26.5159 => 25.8595, std.dev.: 0.0074) MultiSource/Applications/spiff/spiff: -2.37% (3.0263 => 2.9546, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.33% (1.9762 => 1.9302, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.00% (0.6589 => 0.6457, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.82% (6.3560 => 6.2401, std.dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7149, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0058, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8636, std.dev.: 0.0062) MultiSource/Applications/sqlite3/sqlite3: -1.26% (4.5928 => 4.5351, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -1.24% (9.3358 => 9.2205, std.dev.: 0.0344) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4954, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2566, std.dev.: 0.0006) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 5 14:58:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 16:58:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121005215809.6DA0A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4617?compare_to=4610&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4617, Order: 165320, Start Time: 2012-10-05 18:49:40, End Time: 2012-10-05 21:59:52 To: 4610, Order: 165314, Start Time: 2012-10-05 15:10:51, End Time: 2012-10-05 18:20:48 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 2 (133 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (131 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1037 (758 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.07% (0.2132 => 0.2240, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 1.29% (9.8301 => 9.9572, std.dev.: 0.0268) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.00% (9.8076 => 9.8074, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.00% (9.4127 => 9.4131, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.04% (16.9561 => 16.9495, std.dev.: 0.0088) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 11.94% (1.5932 => 1.7835, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.67% (0.1063 => 0.1187, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.49% (0.3446 => 0.3842, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.49% (0.3465 => 0.3863, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.47% (0.3488 => 0.3888, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 11.45% (0.3442 => 0.3836, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.36% (0.3460 => 0.3853, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.33% (0.3469 => 0.3862, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.33% (0.3496 => 0.3892, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.14% (0.3643 => 0.4049, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 11.07% (0.3650 => 0.4054, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.98% (0.3724 => 0.4133, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: 9.56% (0.5826 => 0.6383, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.39% (0.5889 => 0.6442, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 8.46% (0.1619 => 0.1756, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 8.37% (0.1218 => 0.1320, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.07% (0.7171 => 0.7750, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.98% (0.5000 => 0.5399, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.97% (0.4994 => 0.5392, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.93% (0.2875 => 0.3103, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.87% (0.4361 => 0.4704, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.84% (1.3152 => 1.4183, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.76% (1.6211 => 1.7469, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.71% (0.2738 => 0.2949, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.66% (0.2792 => 0.3006, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.66% (0.2714 => 0.2922, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 7.63% (0.2725 => 0.2933, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.57% (0.3195 => 0.3437, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.53% (0.1620 => 0.1742, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.52% (0.3004 => 0.3230, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 7.49% (0.2803 => 0.3013, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 7.48% (0.2780 => 0.2988, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.44% (3.5627 => 3.8278, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.44% (0.2729 => 0.2932, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 7.44% (0.2811 => 0.3020, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 7.43% (0.2813 => 0.3022, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 7.42% (0.2750 => 0.2954, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 7.37% (0.2823 => 0.3031, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.35% (0.2911 => 0.3125, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 7.33% (0.3096 => 0.3323, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.33% (2.0673 => 2.2188, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 7.31% (0.9909 => 1.0633, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 7.30% (5.5417 => 5.9465, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/ary3: 7.16% (0.3267 => 0.3501, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.16% (0.3060 => 0.3279, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.12% (2.7292 => 2.9234, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash: 7.12% (0.4146 => 0.4441, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.10% (0.2014 => 0.2157, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 7.08% (0.3477 => 0.3723, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.05% (0.3362 => 0.3599, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.02% (0.3930 => 0.4206, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 7.01% (0.3678 => 0.3936, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.97% (0.3258 => 0.3485, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 6.97% (1.0781 => 1.1532, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary2: 6.96% (0.3317 => 0.3548, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 6.96% (0.3348 => 0.3581, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 6.95% (0.3726 => 0.3985, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.91% (0.4139 => 0.4425, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: 6.87% (0.4847 => 0.5180, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.84% (0.3625 => 0.3873, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.79% (0.3124 => 0.3336, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.76% (0.5026 => 0.5366, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.67% (0.3282 => 0.3501, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 6.65% (23.5202 => 25.0848, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.65% (0.1549 => 0.1652, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 6.56% (4.2109 => 4.4873, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/hash2: 6.56% (0.4251 => 0.4530, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.54% (0.2736 => 0.2915, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.50% (0.3890 => 0.4143, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.50% (0.3845 => 0.4095, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.43% (0.3981 => 0.4237, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 6.39% (0.2566 => 0.2730, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.39% (0.2866 => 0.3049, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.37% (0.5900 => 0.6276, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 6.36% (1.8794 => 1.9990, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.30% (0.3903 => 0.4149, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.30% (0.2969 => 0.3156, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.27% (0.2040 => 0.2168, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 6.21% (0.4029 => 0.4279, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.20% (0.1968 => 0.2090, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 6.20% (2.1013 => 2.2315, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.19% (4.4195 => 4.6930, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.12% (0.6435 => 0.6829, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.03% (0.2737 => 0.2902, std.dev.: 0.0028) MultiSource/Applications/Burg/burg: 6.02% (0.5546 => 0.5880, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 5.97% (0.5012 => 0.5311, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 5.96% (0.9697 => 1.0275, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.95% (0.2068 => 0.2191, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.93% (0.4658 => 0.4934, std.dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: 5.87% (4.6177 => 4.8886, std.dev.: 0.0023) MultiSource/Applications/siod/siod: 5.83% (0.6634 => 0.7021, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.81% (0.3271 => 0.3461, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.80% (0.3084 => 0.3263, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 5.78% (1.4269 => 1.5094, std.dev.: 0.0032) MultiSource/Applications/SIBsim4/SIBsim4: 5.72% (0.2691 => 0.2845, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 5.72% (2.1653 => 2.2892, std.dev.: 0.0109) MultiSource/Applications/minisat/minisat: 5.46% (0.3336 => 0.3518, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.41% (1.9694 => 2.0760, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.33% (0.2103 => 0.2215, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 5.30% (0.2075 => 0.2185, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.17% (1.9966 => 2.0999, std.dev.: 0.0037) MultiSource/Applications/treecc/treecc: 5.16% (0.7875 => 0.8281, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 5.08% (2.0346 => 2.1379, std.dev.: 0.0034) MultiSource/Applications/lemon/lemon: 4.68% (0.2391 => 0.2503, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.52% (0.7426 => 0.7762, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.35% (0.5361 => 0.5594, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.21% (0.5584 => 0.5819, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.93% (11.6398 => 12.0974, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.76% (4.6926 => 4.8692, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: 3.74% (0.3498 => 0.3629, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 2.72% (11.9555 => 12.2801, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.47% (0.4253 => 0.4358, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.55% (3.3903 => 3.6123, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 5.56% (0.2122 => 0.2240, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/objinst: 5.22% (12.0509 => 12.6796, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-2: 4.90% (1.8057 => 1.8942, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1696, std.dev.: 0.1483) SingleSource/Benchmarks/Dhrystone/dry: 4.25% (14.0481 => 14.6448, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1927, std.dev.: 0.0084) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5020, std.dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.58% (3.1722 => 3.2224, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2900, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5137, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5823, std.dev.: 0.0223) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.73% (25.4195 => 16.5922, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/ary2: -8.58% (0.2402 => 0.2196, std.dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9752, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7990, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -3.72% (11.2080 => 10.7916, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7731, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.99% (0.6293 => 0.6105, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (17.2379 => 16.7853, std.dev.: 0.0318) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8641, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5735, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4958, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (105.3826 => 104.1627, std.dev.: 0.0591) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0463, std.dev.: 0.0019) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 5 15:01:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 17:01:49 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121005220149.BFC7C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4618?compare_to=4614&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4618, Order: 165331, Start Time: 2012-10-05 20:39:37, End Time: 2012-10-05 22:03:34 To: 4614, Order: 165322, Start Time: 2012-10-05 18:59:08, End Time: 2012-10-05 20:23:08 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (14 on baseline) Performance Regressions: 5 (76 on baseline) Performance Improvements: 12 (46 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 960 (769 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/spiff/spiff: 1.40% (0.7691 => 0.7799, std.dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 7.08% (6.1796 => 6.6169, std.dev.: 0.0370) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.41% (2.4366 => 2.5683, std.dev.: 0.0225) SingleSource/Benchmarks/Shootout-C++/hash: 4.82% (0.6448 => 0.6759, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.01% (3.5020 => 3.5372, std.dev.: 0.0113) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -7.44% (0.1680 => 0.1555, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -3.38% (0.7965 => 0.7696, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -2.08% (4.4270 => 4.3349, std.dev.: 0.0179) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.92% (0.5845 => 0.5733, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.33% (1.3049 => 1.2876, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.17% (4.1638 => 4.1150, std.dev.: 0.0114) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.03% (6.5683 => 6.5009, std.dev.: 0.0098) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/minisat/minisat: -3.69% (6.3895 => 6.1537, std.dev.: 0.0223) MultiSource/Applications/SPASS/SPASS: -2.57% (8.3342 => 8.1197, std.dev.: 0.0697) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.58% (2.9763 => 2.9292, std.dev.: 0.0150) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.53% (1.2883 => 1.2686, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.26% (5.1843 => 5.1190, std.dev.: 0.0039) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -2.07% (1.0397 => 1.0182, std.dev.: 0.0087) MultiSource/Applications/sqlite3/sqlite3: 0.23% (0.6170 => 0.6184, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/08-main/main: -3.06% (0.1831 => 0.1775, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.51% (0.1587 => 0.1563, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.47% (0.3153 => 0.3075, std.dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.12% (0.2416 => 0.2443, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.16% (0.3206 => 0.3211, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.60% (0.2329 => 0.2343, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: 1.44% (0.0418 => 0.0424, std.dev.: 0.0017) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -11.95% (0.0226 => 0.0199, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 29.33% (0.0150 => 0.0194, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.26% (0.0390 => 0.0391, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 11.81% (0.0271 => 0.0303, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -10.38% (0.0289 => 0.0259, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 8.31% (0.0301 => 0.0326, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: -4.40% (0.0182 => 0.0174, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/test1: 31.29% (0.0147 => 0.0193, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -0.39% (0.0255 => 0.0254, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -17.12% (0.0333 => 0.0276, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005) MultiSource/Applications/ClamAV/clamscan: -0.91% (0.1426 => 0.1413, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 0.51% (1.4783 => 1.4859, std.dev.: 0.0297) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.73% (0.1505 => 0.1494, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.39% (0.4093 => 0.4077, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.72% (0.1394 => 0.1418, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.46% (0.0612 => 0.0548, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -10.77% (0.0260 => 0.0232, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.31% (0.0605 => 0.0585, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.58% (1.1326 => 1.1260, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 25.00% (0.0012 => 0.0015, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -78.26% (0.0023 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0602 => 0.0602, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.50% (0.0216 => 0.0189, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.10% (0.7662 => 0.7654, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: 150.00% (0.0002 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.18% (1.7064 => 1.7095, std.dev.: 0.0025) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 195.12% (0.0041 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 146.07% (0.0089 => 0.0219, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: 178.89% (0.0090 => 0.0251, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -27.41% (4.1772 => 3.0321, std.dev.: 0.0305) SingleSource/Benchmarks/Shootout-C++/except: 82350.00% (0.0006 => 0.4947, std.dev.: 0.0029) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 9.19% (2.1763 => 2.3764, std.dev.: 0.0243) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.19% (0.1414 => 0.1544, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.78% (0.6410 => 0.6973, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/bigfib: 8.66% (0.5309 => 0.5769, std.dev.: 0.0064) MultiSource/Applications/minisat/minisat: 7.81% (0.6173 => 0.6655, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.65% (0.3582 => 0.3856, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: 6.76% (1.0046 => 1.0725, std.dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: 6.74% (1.1653 => 1.2438, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 6.13% (15.3105 => 16.2483, std.dev.: 0.0921) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.09% (1.5150 => 1.6072, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.91% (1.4408 => 1.5260, std.dev.: 0.0218) MultiSource/Applications/lambda-0_1_3/lambda: 5.71% (0.6915 => 0.7310, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.62% (0.6069 => 0.6410, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.60% (0.2552 => 0.2695, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.60% (0.7639 => 0.8067, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.51% (0.2797 => 0.2951, std.dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: 5.25% (29.3170 => 30.8547, std.dev.: 0.0381) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.11% (0.4248 => 0.4465, std.dev.: 0.0041) MultiSource/Applications/d/make_dparser: 4.99% (3.0225 => 3.1734, std.dev.: 0.0065) MultiSource/Benchmarks/McCat/18-imp/imp: 4.88% (0.3217 => 0.3374, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.73% (0.4880 => 0.5111, std.dev.: 0.0053) MultiSource/Benchmarks/mafft/pairlocalalign: 4.37% (8.2186 => 8.5780, std.dev.: 0.0383) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.25% (1.1672 => 1.2168, std.dev.: 0.0089) MultiSource/Applications/SPASS/SPASS: 4.20% (13.3238 => 13.8832, std.dev.: 0.0296) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.19% (0.8569 => 0.8928, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.12% (0.2886 => 0.3005, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.08% (1.2021 => 1.2511, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.99% (0.2654 => 0.2760, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 3.96% (4.7455 => 4.9334, std.dev.: 0.0161) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.94% (6.2546 => 6.5009, std.dev.: 0.0098) MultiSource/Benchmarks/nbench/nbench: 3.94% (1.0821 => 1.1247, std.dev.: 0.0036) MultiSource/Applications/siod/siod: 3.85% (2.0972 => 2.1779, std.dev.: 0.0085) MultiSource/Applications/treecc/treecc: 3.84% (1.8798 => 1.9520, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.75% (1.1827 => 1.2271, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.69% (0.3062 => 0.3175, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 3.67% (1.1440 => 1.1860, std.dev.: 0.0067) MultiSource/Applications/hbd/hbd: 3.47% (1.3268 => 1.3729, std.dev.: 0.0126) MultiSource/Applications/lua/lua: 3.46% (3.5980 => 3.7225, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/hash: 3.32% (0.3520 => 0.3637, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.06% (0.7226 => 0.7447, std.dev.: 0.0051) MultiSource/Applications/JM/lencod/lencod: 2.99% (14.7256 => 15.1663, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/football/football: 2.94% (0.8405 => 0.8652, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.86% (12.6413 => 13.0032, std.dev.: 0.0200) MultiSource/Applications/JM/ldecod/ldecod: 2.83% (6.4908 => 6.6743, std.dev.: 0.0209) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.38% (0.7722 => 0.7906, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.30% (4.3380 => 4.4378, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.29% (1.0689 => 1.0934, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.06% (4.0318 => 4.1150, std.dev.: 0.0114) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.25% (4.2815 => 4.3349, std.dev.: 0.0179) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.05% (1.2742 => 1.2876, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.34% (1.6538 => 2.3374, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2285, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout/ary3: 14.91% (1.7426 => 2.0025, std.dev.: 0.0478) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.47% (4.0101 => 4.5503, std.dev.: 0.0318) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.43% (2.4042 => 2.7272, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.19% (0.0766 => 0.0867, std.dev.: 0.0020) SingleSource/Benchmarks/Stanford/Puzzle: 12.00% (0.1433 => 0.1605, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 11.10% (1.6261 => 1.8066, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/mason/mason: 9.89% (0.5004 => 0.5499, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: 8.64% (7.0025 => 7.6077, std.dev.: 0.0305) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.05% (0.2857 => 0.3087, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.50% (1.0063 => 1.0818, std.dev.: 0.0274) SingleSource/Benchmarks/Shootout-C++/hash: 7.15% (0.6308 => 0.6759, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.12% (0.3301 => 0.3536, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.44% (40.4792 => 42.6814, std.dev.: 0.8515) MultiSource/Benchmarks/Bullet/bullet: 4.53% (6.9722 => 7.2883, std.dev.: 0.0219) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.19% (4.2129 => 4.3893, std.dev.: 0.0569) SingleSource/Benchmarks/Misc/dt: 4.15% (0.9851 => 1.0260, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: 3.88% (15.2242 => 15.8150, std.dev.: 0.0479) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.82% (3.4080 => 3.5381, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 3.35% (3.5520 => 3.6709, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.31% (0.5587 => 0.5772, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.79% (6.6312 => 6.8160, std.dev.: 0.0095) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.72% (0.8498 => 0.8729, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.01% (4.6127 => 4.7055, std.dev.: 0.0151) MultiSource/Benchmarks/Olden/power/power: 1.37% (1.4184 => 1.4379, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -43.82% (0.0591 => 0.0332, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -43.72% (0.2996 => 0.1686, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.17% (1.4189 => 1.1327, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.66% (1.4113 => 1.1339, std.dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.06% (0.3497 => 0.2131, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.89% (5.2665 => 4.1663, std.dev.: 0.0881) SingleSource/Benchmarks/Shootout-C++/ary3: -20.15% (1.7473 => 1.3953, std.dev.: 0.0669) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.74% (15.8312 => 12.7065, std.dev.: 0.7566) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.19% (1.7361 => 1.4724, std.dev.: 0.0230) MultiSource/Benchmarks/McCat/17-bintr/bintr: -12.87% (0.0917 => 0.0799, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/sieve: -12.19% (8.1594 => 7.1644, std.dev.: 0.0581) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.72% (1.1647 => 1.0515, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.38% (1.4034 => 1.2858, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: -8.32% (9.5474 => 8.7529, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.10% (3.2007 => 2.9416, std.dev.: 0.0126) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.85% (3.6254 => 3.3771, std.dev.: 0.0183) MultiSource/Applications/lambda-0_1_3/lambda: -6.81% (7.6833 => 7.1601, std.dev.: 0.0279) SingleSource/Benchmarks/Shootout-C++/fibo: -6.54% (4.6355 => 4.3324, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/richards_benchmark: -6.05% (1.4441 => 1.3567, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.94% (2.9728 => 2.7962, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.47% (3.9413 => 3.7259, std.dev.: 0.0094) MultiSource/Benchmarks/Olden/bh/bh: -5.23% (2.5166 => 2.3851, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/fib2: -5.18% (4.4195 => 4.1905, std.dev.: 0.0131) MultiSource/Benchmarks/FreeBench/distray/distray: -5.07% (0.2664 => 0.2529, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: -4.84% (8.5323 => 8.1197, std.dev.: 0.0697) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.40% (0.4564 => 0.4363, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.40% (0.4140 => 0.3958, std.dev.: 0.0029) MultiSource/Applications/sgefa/sgefa: -4.27% (0.3746 => 0.3586, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -4.13% (62.4126 => 59.8352, std.dev.: 0.2236) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.65% (1.1683 => 1.1257, std.dev.: 0.0079) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.51% (1.2722 => 1.2276, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/methcall: -3.31% (9.2503 => 8.9441, std.dev.: 0.0471) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.85% (3.7496 => 3.6426, std.dev.: 0.0089) MultiSource/Benchmarks/FreeBench/neural/neural: -2.35% (1.0926 => 1.0669, std.dev.: 0.0035) MultiSource/Applications/SIBsim4/SIBsim4: -2.30% (3.4230 => 3.3443, std.dev.: 0.0093) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.12% (2.3569 => 2.3069, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/hash2: -2.08% (3.4876 => 3.4149, std.dev.: 0.0072) MultiSource/Benchmarks/sim/sim: -2.02% (3.8907 => 3.8120, std.dev.: 0.0088) MultiSource/Applications/aha/aha: -2.00% (3.4286 => 3.3600, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.81% (9.3855 => 9.2159, std.dev.: 0.0171) MultiSource/Benchmarks/PAQ8p/paq8p: -1.75% (92.7467 => 91.1197, std.dev.: 0.4329) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.43% (27.1724 => 26.7849, std.dev.: 0.0261) MultiSource/Applications/JM/lencod/lencod: -1.42% (6.7458 => 6.6499, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.35% (25.6658 => 25.3183, std.dev.: 0.0691) MultiSource/Applications/minisat/minisat: -1.14% (6.2244 => 6.1537, std.dev.: 0.0223) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.02% (0.9980 => 1.0182, std.dev.: 0.0087) MultiSource/Applications/sqlite3/sqlite3: 2.69% (0.6022 => 0.6184, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/08-main/main: 6.54% (0.1666 => 0.1775, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.58% (0.1554 => 0.1563, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.26% (0.3083 => 0.3075, std.dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.05% (0.2394 => 0.2443, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.13% (0.3175 => 0.3211, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.78% (0.2302 => 0.2343, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: -5.57% (0.0449 => 0.0424, std.dev.: 0.0017) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -17.08% (0.0240 => 0.0199, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.04% (0.0192 => 0.0194, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.26% (0.0390 => 0.0391, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.66% (0.0301 => 0.0303, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -8.80% (0.0284 => 0.0259, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.62% (0.0324 => 0.0326, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: -1.69% (0.0177 => 0.0174, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/test1: 2.12% (0.0189 => 0.0193, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: 2.01% (0.0249 => 0.0254, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -15.08% (0.0325 => 0.0276, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005) MultiSource/Applications/ClamAV/clamscan: -1.12% (0.1429 => 0.1413, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -1.07% (1.5019 => 1.4859, std.dev.: 0.0297) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.47% (0.1501 => 0.1494, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.39% (0.4264 => 0.4077, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.51% (0.1344 => 0.1418, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.96% (0.0589 => 0.0548, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0232 => 0.0232, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.45% (0.0639 => 0.0585, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.79% (1.1350 => 1.1260, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 150.00% (0.0006 => 0.0015, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.49% (0.0637 => 0.0602, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -23.17% (0.0246 => 0.0189, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.50% (0.7541 => 0.7654, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.27% (1.5363 => 1.7095, std.dev.: 0.0025) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 5 15:48:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 17:48:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121005224858.C97BC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4619?compare_to=4615&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4619, Order: 165335, Start Time: 2012-10-05 21:30:47, End Time: 2012-10-05 22:50:31 To: 4615, Order: 165326, Start Time: 2012-10-05 19:40:53, End Time: 2012-10-05 21:00:30 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (151 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 951 (693 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.35% (1.3084 => 1.3260, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.09% (1.3188 => 1.3332, std.dev.: 0.0014) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.02% (0.5866 => 0.5865, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 0.06% (16.1549 => 16.1638, std.dev.: 0.0076) MultiSource/Benchmarks/Bullet/bullet: 0.06% (54.6975 => 54.7302, std.dev.: 0.0089) MultiSource/Benchmarks/MallocBench/gs/gs: -0.06% (4.3782 => 4.3754, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0465 => 0.0465, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.21% (0.0466 => 0.0467, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.23% (0.0435 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.23% (0.0436 => 0.0435, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0423 => 0.0423, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0424 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.24% (0.0417 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.24% (0.0419 => 0.0418, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0435 => 0.0435, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.23% (0.0436 => 0.0437, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0429 => 0.0429, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0430 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0420 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0420 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.23% (0.0427 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0427 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0437 => 0.0437, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.37% (0.0458 => 0.0438, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.24% (0.0415 => 0.0414) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0415 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.23% (0.0427 => 0.0426, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0427 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0417 => 0.0417, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0418 => 0.0418, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0410 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.24% (0.0410 => 0.0411, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.24% (0.0410 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.24% (0.0409 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.22% (0.0446 => 0.0445, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.22% (0.0447 => 0.0446, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0408 => 0.0408, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.25% (0.0408 => 0.0409, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.24% (0.0410 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0410 => 0.0410, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.24% (0.0417 => 0.0416, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0418 => 0.0418, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.05% (1.2420 => 1.2426, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.00% (7.7462 => 7.7459, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.07% (0.7364 => 0.7369, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.28% (0.0360 => 0.0361, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1432 => 0.1433, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.05% (0.2139 => 0.2140, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -13.46% (63.2438 => 54.7302, std.dev.: 0.0089) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 31.93% (14.1553 => 18.6747, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++-EH/spirit: 60.52% (3.4629 => 5.5585, std.dev.: 0.0011) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14237.92% (0.0720 => 10.3233, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9951800.00% (0.0001 => 9.9519, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 50.24% (10.3673 => 15.5760, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/08-main/main: 49.26% (0.2554 => 0.3812, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/richards_benchmark: 30.64% (0.1622 => 0.2119, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/distray/distray: 30.59% (0.1056 => 0.1379, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 14.39% (0.1432 => 0.1638, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.31% (7.0540 => 8.0634, std.dev.: 0.0030) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.92% (0.1566 => 0.1784, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.75% (2.2022 => 2.5049, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.15% (1.7609 => 1.9749, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.60% (0.0871 => 0.0972, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.61% (0.1584 => 0.1752, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: 10.33% (0.3282 => 0.3621, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.19% (0.3473 => 0.3827, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.05% (0.3543 => 0.3899, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.02% (0.3543 => 0.3898, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.98% (0.3497 => 0.3846, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.94% (0.3561 => 0.3915, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.90% (0.3516 => 0.3864, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.83% (0.3694 => 0.4057, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 9.72% (0.1440 => 0.1580) SingleSource/UnitTests/ObjC/exceptions: 9.67% (0.3828 => 0.4198, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.65% (0.3927 => 0.4306, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.52% (0.3886 => 0.4256, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.82% (0.6675 => 0.7264, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 8.70% (0.1655 => 0.1799, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 8.70% (0.7115 => 0.7734, std.dev.: 0.0077) MultiSource/Applications/lambda-0_1_3/lambda: 8.68% (0.7433 => 0.8078, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.52% (1.5415 => 1.6728, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 8.46% (0.3109 => 0.3372, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.44% (0.3177 => 0.3445, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.38% (0.4879 => 0.5288, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 8.38% (9.4845 => 10.2793, std.dev.: 0.0106) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.36% (0.4615 => 0.5001, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.34% (0.1438 => 0.1558, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 8.29% (10.4361 => 11.3012, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/em3d/em3d: 8.26% (0.1695 => 0.1835, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.25% (0.1625 => 0.1759, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 8.21% (0.3423 => 0.3704, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 8.15% (0.5925 => 0.6408, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.09% (0.5105 => 0.5518, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 8.04% (0.6030 => 0.6515, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.97% (0.8172 => 0.8823, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.95% (0.1510 => 0.1630, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.90% (1.3050 => 1.4081, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.84% (0.2271 => 0.2449, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.78% (4.2646 => 4.5964, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.71% (0.5860 => 0.6312, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.70% (0.2065 => 0.2224, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 7.70% (0.6456 => 0.6953, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 7.70% (3.3354 => 3.5921, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.67% (0.8067 => 0.8686, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.63% (0.2700 => 0.2906, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.61% (0.3865 => 0.4159, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.60% (0.5569 => 0.5992, std.dev.: 0.0043) MultiSource/Applications/oggenc/oggenc: 7.53% (5.7591 => 6.1929, std.dev.: 0.0087) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.50% (0.3121 => 0.3355, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.47% (8.1363 => 8.7438, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 7.44% (0.7326 => 0.7871) SingleSource/Benchmarks/Shootout-C++/hash: 7.44% (0.4289 => 0.4608, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.43% (0.2758 => 0.2963, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists: 7.42% (0.3422 => 0.3676, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.40% (0.2107 => 0.2263, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.37% (0.9765 => 1.0485, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.37% (0.1940 => 0.2083, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.35% (0.3307 => 0.3550, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.31% (5.0018 => 5.3676, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.30% (0.2891 => 0.3102, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.27% (0.3136 => 0.3364, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.23% (0.2905 => 0.3115, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.23% (4.9449 => 5.3023, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.21% (0.4103 => 0.4399, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.19% (0.5020 => 0.5381, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 7.19% (1.1642 => 1.2479, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 7.17% (0.3387 => 0.3630, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 7.17% (0.7835 => 0.8397, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.16% (0.4203 => 0.4504, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.12% (0.4636 => 0.4966, std.dev.: 0.0033) MultiSource/Applications/hbd/hbd: 7.09% (1.5603 => 1.6709, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.04% (0.3650 => 0.3907, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.94% (7.9617 => 8.5145, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/moments: 6.94% (0.4048 => 0.4329, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 6.87% (3.8723 => 4.1382, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/strcat: 6.85% (0.2831 => 0.3025, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.83% (0.3441 => 0.3676, std.dev.: 0.0085) MultiSource/Applications/viterbi/viterbi: 6.82% (0.1555 => 0.1661, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.81% (2.0665 => 2.2072, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.80% (0.3826 => 0.4086, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.79% (0.2725 => 0.2910, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.79% (0.2756 => 0.2943, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.3283 => 0.3505, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.75% (0.4620 => 0.4932, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.74% (0.3603 => 0.3846, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.72% (0.3052 => 0.3257, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.70% (0.3684 => 0.3931, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.69% (0.2871 => 0.3063, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.69% (0.2872 => 0.3064, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 6.68% (2.0273 => 2.1627, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 6.62% (1.0722 => 1.1432, std.dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.61% (0.3162 => 0.3371, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.60% (0.2802 => 0.2987, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary: 6.59% (0.3232 => 0.3445, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.59% (0.2793 => 0.2977, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.56% (0.2714 => 0.2892, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.55% (0.3098 => 0.3301, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.49% (0.2603 => 0.2772, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.40% (0.2877 => 0.3061, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.28% (1.1861 => 1.2606, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 6.26% (2.2969 => 2.4408, std.dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.26% (1.5859 => 1.6851, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 6.23% (0.3180 => 0.3378, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary2: 6.10% (0.3379 => 0.3585, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.08% (0.6450 => 0.6842, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 6.02% (0.4299 => 0.4558, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.92% (0.5981 => 0.6335, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 5.85% (0.8921 => 0.9443, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 5.64% (21.9371 => 23.1743, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.55% (2.2024 => 2.3246, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.31% (0.4064 => 0.4280, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.22% (1.4186 => 1.4927, std.dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 4.96% (1.1840 => 1.2427, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.74% (1.2842 => 1.3451, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/objinst: 4.73% (0.3131 => 0.3279, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.68% (0.2266 => 0.2372, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.26% (0.8101 => 0.8446, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.32% (14.3668 => 14.8439, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.15% (0.3427 => 0.3535, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 2.91% (17.1811 => 17.6814, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.79% (3.8922 => 4.0006, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.01% (1.1194 => 1.1419, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.27% (1.1145 => 1.3850, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.85% (1.1396 => 1.2518, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.20% (3.1595 => 3.4501, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3690, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 3.73% (0.5413 => 0.5615) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.54% (3.6395 => 3.7683, std.dev.: 0.0023) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.80% (4.2280 => 4.3463, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7650, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.65% (1.3045 => 1.3260, std.dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8134, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.19% (2.6546 => 2.6863, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1288, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.05% (0.8651 => 0.1726, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.55% (5.2763 => 3.2425, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.12% (5.3855 => 3.6019, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.78% (5.3526 => 3.5979, std.dev.: 0.0051) SingleSource/UnitTests/Vector/constpool: -14.48% (54.1659 => 46.3205, std.dev.: 0.0372) MultiSource/Benchmarks/FreeBench/mason/mason: -13.44% (0.0811 => 0.0702, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -11.33% (22.1758 => 19.6629, std.dev.: 0.0202) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.30% (2.9384 => 2.6063, std.dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7645, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.84% (1.6925 => 1.4244, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.53% (0.0998 => 0.0863, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -12.50% (1.2373 => 1.0826, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/mandel-2: -10.28% (1.5373 => 1.3792, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/mason/mason: -10.04% (0.2161 => 0.1944, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.20% (19.9488 => 18.3133, std.dev.: 0.0216) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.66% (1.8329 => 1.7108, std.dev.: 0.0163) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.31% (1.6805 => 1.5912, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5065, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0018) MultiSource/Applications/siod/siod: -3.60% (3.2827 => 3.1645, std.dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.40% (0.9957 => 0.9618, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5076, std.dev.: 0.0048) MultiSource/Applications/hexxagon/hexxagon: -3.01% (12.4730 => 12.0975, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.17% (8.1563 => 7.9792, std.dev.: 0.0127) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.08% (0.4808 => 0.4708, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -1.99% (10.2830 => 10.0786, std.dev.: 0.0131) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.88% (8.6802 => 8.5171, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6807, std.dev.: 0.0024) SingleSource/UnitTests/Vector/multiplies: -1.49% (2.5528 => 2.5148, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4217, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8571, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.01% (6.2999 => 6.2363, std.dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.16% (0.5229 => 0.5865, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 7.83% (14.9895 => 16.1638, std.dev.: 0.0076) MultiSource/Benchmarks/MallocBench/gs/gs: 6.44% (4.1105 => 4.3754, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.47% (1.1048 => 1.2426, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.21% (7.1582 => 7.7459, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.43% (0.6222 => 0.7369, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36000.00% (0.0001 => 0.0361, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.13% (0.2116 => 0.2140, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 5 16:13:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 18:13:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121005231339.D561A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4620?compare_to=4616&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4620, Order: 165335, Start Time: 2012-10-05 21:49:39, End Time: 2012-10-05 23:15:16 To: 4616, Order: 165326, Start Time: 2012-10-05 19:54:56, End Time: 2012-10-05 21:20:29 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 0 (178 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (135 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1039 (686 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (2.7524 => 2.7524, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.00% (2.1154 => 2.1153, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.10% (4.9749 => 4.9697, std.dev.: 0.0025) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.53% (2.0176 => 2.4519, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.30% (0.1410 => 0.1654, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 15.13% (0.0826 => 0.0951, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 14.40% (0.2243 => 0.2566, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.06% (0.0819 => 0.0926, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.06% (0.1072 => 0.1212, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.58% (0.1327 => 0.1494, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.35% (0.0834 => 0.0937, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 12.24% (0.1013 => 0.1137, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.61% (0.1413 => 0.1577, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 11.37% (0.4328 => 0.4820, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 11.28% (0.4062 => 0.4520, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.25% (0.2721 => 0.3027, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 11.14% (1.3693 => 1.5218, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.10% (0.0964 => 0.1071, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.03% (3.9660 => 4.4036, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.02% (0.1588 => 0.1763, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 11.01% (0.7038 => 0.7813, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.98% (0.2596 => 0.2881, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 10.81% (0.5818 => 0.6447, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.77% (0.7710 => 0.8540, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.64% (0.9199 => 1.0178, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 10.64% (0.1062 => 0.1175, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.63% (1.2193 => 1.3489, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.56% (0.5265 => 0.5821, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 10.56% (0.5748 => 0.6355, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.54% (1.4563 => 1.6098, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.46% (0.3022 => 0.3338, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.38% (0.6283 => 0.6935, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.36% (0.6959 => 0.7680, std.dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 10.32% (0.2781 => 0.3068, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.18% (0.3899 => 0.4296, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 10.07% (0.7061 => 0.7772, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.05% (1.1364 => 1.2506, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.03% (0.3580 => 0.3939, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.99% (0.2782 => 0.3060, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 9.83% (13.8202 => 15.1781, std.dev.: 0.0152) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.81% (0.3485 => 0.3827, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 9.62% (0.2995 => 0.3283, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 9.59% (0.2690 => 0.2948, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.58% (0.3756 => 0.4116, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.57% (0.3489 => 0.3823, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 9.57% (0.3293 => 0.3608, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.52% (1.9828 => 2.1715, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.51% (0.1157 => 0.1267) SingleSource/Benchmarks/Shootout-C++/except: 9.49% (0.2760 => 0.3022, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.49% (0.4016 => 0.4397, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.48% (0.4390 => 0.4806, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 9.47% (0.2607 => 0.2854, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wc: 9.43% (0.2937 => 0.3214, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.42% (0.2655 => 0.2905, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.41% (0.2966 => 0.3245, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.37% (0.2914 => 0.3187, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 9.36% (0.2628 => 0.2874, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 9.35% (0.2726 => 0.2981, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 9.34% (1.0313 => 1.1276, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.33% (0.2765 => 0.3023, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.31% (0.5577 => 0.6096, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 9.30% (0.3149 => 0.3442, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 9.27% (0.2761 => 0.3017, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.20% (0.3130 => 0.3418, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 9.18% (0.1111 => 0.1213, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 9.18% (0.3453 => 0.3770, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.16% (0.4791 => 0.5230, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.16% (0.4379 => 0.4780, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 9.14% (0.3107 => 0.3391, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 9.13% (0.3868 => 0.4221, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 9.13% (0.1589 => 0.1734, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 9.07% (0.2988 => 0.3259, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.06% (0.1435 => 0.1565, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.01% (0.1986 => 0.2165, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.98% (0.2696 => 0.2938, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 8.94% (0.3534 => 0.3850, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 8.94% (1.1061 => 1.2050, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 8.90% (0.3192 => 0.3476, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.89% (0.2127 => 0.2316, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.87% (0.3246 => 0.3534, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.86% (0.1276 => 0.1389, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.85% (0.5637 => 0.6136, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 8.82% (16.6129 => 18.0783, std.dev.: 0.0149) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.75% (0.7460 => 0.8113, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 8.72% (0.8310 => 0.9035, std.dev.: 0.0021) MultiSource/Applications/minisat/minisat: 8.69% (0.6744 => 0.7330, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/gs/gs: 8.61% (3.8646 => 4.1975, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 8.57% (0.3220 => 0.3496, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 8.41% (1.0594 => 1.1485, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.40% (0.8698 => 0.9429, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.40% (7.2180 => 7.8243, std.dev.: 0.0057) MultiSource/Applications/spiff/spiff: 8.37% (0.7506 => 0.8134, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.36% (0.1865 => 0.2021, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.26% (0.2023 => 0.2190, std.dev.: 0.0014) MultiSource/Applications/treecc/treecc: 8.20% (1.9270 => 2.0851, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/objinst: 8.15% (0.2945 => 0.3185, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 8.11% (3.1889 => 3.4474, std.dev.: 0.0133) MultiSource/Applications/siod/siod: 8.08% (2.1791 => 2.3552, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 8.05% (0.1478 => 0.1597, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 7.97% (0.2925 => 0.3158, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.91% (0.6576 => 0.7096, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.88% (0.3755 => 0.4051, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 7.76% (4.6629 => 5.0248, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 7.73% (0.3131 => 0.3373, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.72% (0.8818 => 0.9499, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 7.69% (1.2749 => 1.3730, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.66% (0.3511 => 0.3780, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.56% (1.3245 => 1.4246, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.55% (3.6692 => 3.9464, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/em3d/em3d: 7.54% (0.1657 => 0.1782, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 7.52% (14.8535 => 15.9703, std.dev.: 0.0113) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.49% (0.1789 => 0.1923, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.48% (0.2140 => 0.2300, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.47% (4.4433 => 4.7752, std.dev.: 0.0100) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.37% (0.6135 => 0.6587, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.37% (4.3801 => 4.7027, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: 7.25% (8.4961 => 9.1123, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: 7.08% (0.4113 => 0.4404, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.82% (0.1819 => 0.1943, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.77% (0.9108 => 0.9725, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.75% (0.2504 => 0.2673, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 6.70% (1.2292 => 1.3115, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 6.69% (0.4003 => 0.4271, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.66% (3.2742 => 3.4922, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.53% (0.4805 => 0.5119, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.53% (1.5188 => 1.6180, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.49% (4.9865 => 5.3099, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.47% (1.1333 => 1.2066, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 6.39% (0.3914 => 0.4164, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/bigfib: 6.27% (0.6250 => 0.6642, std.dev.: 0.0063) SingleSource/UnitTests/ObjC/property: 6.27% (0.3940 => 0.4187, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 6.26% (0.3578 => 0.3802, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 6.23% (0.3646 => 0.3873, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.20% (0.3789 => 0.4024, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 6.18% (0.2008 => 0.2132, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 6.17% (0.3663 => 0.3889, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/exceptions-2: 6.14% (0.3601 => 0.3822, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 6.08% (6.5754 => 6.9754, std.dev.: 0.0092) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.05% (0.3650 => 0.3871, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 5.99% (0.3623 => 0.3840, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.90% (0.2321 => 0.2458, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.81% (6.2785 => 6.6434, std.dev.: 0.0069) MultiSource/Applications/lua/lua: 5.75% (3.7467 => 3.9623, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.67% (0.3245 => 0.3429, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.51% (2.1007 => 2.2165, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.03% (13.2842 => 13.9528, std.dev.: 0.0159) MultiSource/Applications/sqlite3/sqlite3: 3.54% (16.2614 => 16.8376, std.dev.: 0.0055) MultiSource/Applications/ClamAV/clamscan: 3.13% (14.5298 => 14.9853, std.dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5185, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.06% (1.0895 => 1.3625, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.39% (1.8175 => 2.2607, std.dev.: 0.0469) SingleSource/Benchmarks/Misc/richards_benchmark: 11.01% (1.1560 => 1.2833, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4143, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.23% (1.2998 => 1.3808, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0044, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.67% (11.2619 => 11.6757, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9853, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.31% (10.7476 => 11.1034, std.dev.: 0.0050) SingleSource/Regression/C/uint64_to_float: 3.03% (0.5449 => 0.5614) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.18% (7.4271 => 7.5893, std.dev.: 0.0028) MultiSource/Applications/lemon/lemon: 1.57% (1.4298 => 1.4523, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.50% (8.3908 => 8.5164, std.dev.: 0.0075) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2127, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1870, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5780, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0272, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1407, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.07% (12.4560 => 12.5893, std.dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.15% (0.2670 => 0.1411, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.56% (0.4657 => 0.3886, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/mason/mason: -15.70% (0.0707 => 0.0596, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.08% (1.3819 => 1.1873, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.02% (1.3813 => 1.1877, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.81% (22.5627 => 21.7029, std.dev.: 0.0075) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.34% (0.0997 => 0.0864, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.11% (0.2238 => 0.1967, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.45% (1.2308 => 1.0899, std.dev.: 0.0104) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.26% (20.3410 => 18.2532, std.dev.: 0.0221) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.51% (1.3780 => 1.3021, std.dev.: 0.0066) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.07% (2.6470 => 2.5128, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.59% (0.9996 => 0.9537, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.56% (3.2729 => 3.1565, std.dev.: 0.0226) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.45% (1.7688 => 1.7078, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -2.57% (26.5159 => 25.8349, std.dev.: 0.0044) MultiSource/Applications/spiff/spiff: -2.54% (3.0263 => 2.9495, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.31% (1.9762 => 1.9305, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7154, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/lists: -1.76% (6.3560 => 6.2441, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.59% (0.6615 => 0.6510, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0064, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8642, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: -1.27% (9.3358 => 9.2171, std.dev.: 0.0068) MultiSource/Applications/sqlite3/sqlite3: -1.24% (4.5928 => 4.5359, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4952, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.14% (5.3167 => 5.2560, std.dev.: 0.0017) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 5 16:40:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 18:40:48 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121005234048.A05CF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4621?compare_to=4618&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4621, Order: 165336, Start Time: 2012-10-05 22:19:31, End Time: 2012-10-05 23:42:32 To: 4618, Order: 165331, Start Time: 2012-10-05 20:39:37, End Time: 2012-10-05 22:03:34 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (14 on baseline) Performance Regressions: 16 (96 on baseline) Performance Improvements: 1 (47 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 960 (748 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.87% (0.1040 => 0.1153, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.87% (0.3013 => 0.3190, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.01% (1.2876 => 1.3263, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/bigfib: 3.00% (0.5769 => 0.5942, std.dev.: 0.0062) MultiSource/Applications/hbd/hbd: 2.65% (1.3729 => 1.4093, std.dev.: 0.0122) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.38% (1.1327 => 1.1597, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.72% (4.3349 => 4.4095, std.dev.: 0.0214) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.48% (0.8846 => 0.8977, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.42% (1.0934 => 1.1089, std.dev.: 0.0038) MultiSource/Applications/ClamAV/clamscan: 1.34% (14.5976 => 14.7925, std.dev.: 0.0339) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.15% (6.5009 => 6.5759, std.dev.: 0.0210) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.13% (0.8848 => 0.8948, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 8.47% (3.0198 => 3.2755, std.dev.: 0.0241) MultiSource/Applications/SPASS/SPASS: 4.47% (8.1197 => 8.4830, std.dev.: 0.0685) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.15% (2.6644 => 2.7482, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout/hash: 1.30% (4.2953 => 4.3512, std.dev.: 0.0107) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash: -4.62% (0.6759 => 0.6447, std.dev.: 0.0023) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.84% (1.0182 => 1.0268, std.dev.: 0.0084) MultiSource/Applications/sqlite3/sqlite3: 1.73% (0.6184 => 0.6291, std.dev.: 0.0080) MultiSource/Benchmarks/McCat/08-main/main: 4.00% (0.1775 => 0.1846, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.75% (0.1563 => 0.1606, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.90% (0.3075 => 0.3195, std.dev.: 0.0094) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.05% (0.2443 => 0.2393, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.02% (0.3211 => 0.3276, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.20% (0.2343 => 0.2315, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel: -3.07% (0.0424 => 0.0411, std.dev.: 0.0027) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -14.07% (0.0199 => 0.0171, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 2.58% (0.0194 => 0.0199, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.79% (0.0391 => 0.0398, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.99% (0.0303 => 0.0306, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.77% (0.0259 => 0.0261, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.23% (0.0326 => 0.0330, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0174 => 0.0185, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 3.11% (0.0193 => 0.0199, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 0.39% (0.0254 => 0.0255, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 19.57% (0.0276 => 0.0330, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.85% (0.1413 => 0.1425, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 4.15% (1.4859 => 1.5475, std.dev.: 0.0243) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: 4.02% (0.1494 => 0.1554, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.18% (0.4077 => 0.4029, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.55% (0.1418 => 0.1396, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 13.32% (0.0548 => 0.0621, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -24.57% (0.0232 => 0.0175, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.20% (0.0585 => 0.0578, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.41% (1.1260 => 1.1306, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -26.67% (0.0015 => 0.0011, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.83% (0.0602 => 0.0591, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -29.10% (0.0189 => 0.0134, std.dev.: 0.0061) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: - (0.7654 => 0.7654, std.dev.: 0.0250) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: -0.19% (1.7095 => 1.7062, std.dev.: 0.0013) SingleSource/UnitTests/2003-07-09-SignedArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -55.37% (0.0121 => 0.0054, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 148.31% (0.0089 => 0.0221, std.dev.: 0.0007) SingleSource/UnitTests/2003-08-11-VaListArg: 176.67% (0.0090 => 0.0249, std.dev.: 0.0003) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -26.51% (4.1772 => 3.0700, std.dev.: 0.0431) SingleSource/Benchmarks/Shootout-C++/except: 83150.00% (0.0006 => 0.4995, std.dev.: 0.0035) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 24.56% (0.0745 => 0.0928, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.44% (0.1414 => 0.1604, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 11.92% (0.5309 => 0.5942, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.53% (0.1159 => 0.1281, std.dev.: 0.0030) MultiSource/Benchmarks/PAQ8p/paq8p: 10.15% (2.1763 => 2.3972, std.dev.: 0.0157) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.66% (0.6410 => 0.7029, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.54% (0.3582 => 0.3888, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 8.49% (0.6173 => 0.6697, std.dev.: 0.0031) MultiSource/Applications/SIBsim4/SIBsim4: 8.17% (1.1653 => 1.2605, std.dev.: 0.0100) MultiSource/Applications/lemon/lemon: 7.09% (1.0046 => 1.0758, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.94% (0.2552 => 0.2729, std.dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: 6.76% (15.3105 => 16.3457, std.dev.: 0.1590) MultiSource/Applications/lambda-0_1_3/lambda: 6.41% (0.6915 => 0.7358, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.29% (0.6069 => 0.6451, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.26% (1.5150 => 1.6098, std.dev.: 0.0082) MultiSource/Applications/hbd/hbd: 6.22% (1.3268 => 1.4093, std.dev.: 0.0122) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.05% (0.3008 => 0.3190, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.92% (0.7639 => 0.8091, std.dev.: 0.0121) MultiSource/Benchmarks/McCat/18-imp/imp: 5.84% (0.3217 => 0.3405, std.dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: 5.77% (29.3170 => 31.0091, std.dev.: 0.0899) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.65% (0.4248 => 0.4488, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.61% (0.3901 => 0.4120, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.54% (0.2797 => 0.2952, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.33% (1.1827 => 1.2457, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.30% (0.2886 => 0.3039, std.dev.: 0.0023) MultiSource/Applications/d/make_dparser: 5.26% (3.0225 => 3.1816, std.dev.: 0.0199) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.14% (6.2546 => 6.5759, std.dev.: 0.0210) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.96% (0.3062 => 0.3214, std.dev.: 0.0050) MultiSource/Applications/SPASS/SPASS: 4.74% (13.3238 => 13.9548, std.dev.: 0.0429) MultiSource/Applications/lua/lua: 4.69% (3.5980 => 3.7668, std.dev.: 0.0629) MultiSource/Benchmarks/mafft/pairlocalalign: 4.67% (8.2186 => 8.6027, std.dev.: 0.0745) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.66% (0.8569 => 0.8968, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/lists: 4.64% (0.2347 => 0.2456, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.61% (1.2021 => 1.2575, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.56% (0.2303 => 0.2408, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 4.54% (4.7455 => 4.9610, std.dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.50% (1.4408 => 1.5056, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.36% (0.2662 => 0.2778, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.34% (1.1672 => 1.2178, std.dev.: 0.0126) MultiSource/Applications/siod/siod: 4.28% (2.0972 => 2.1870, std.dev.: 0.0030) MultiSource/Applications/treecc/treecc: 4.24% (1.8798 => 1.9595, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.20% (3.0758 => 3.2049, std.dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.17% (0.2952 => 0.3075, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.12% (2.0317 => 2.1154, std.dev.: 0.0057) MultiSource/Applications/Burg/burg: 4.11% (1.1440 => 1.1910, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.09% (1.2742 => 1.3263, std.dev.: 0.0080) MultiSource/Benchmarks/nbench/nbench: 3.97% (1.0821 => 1.1251, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.88% (0.2654 => 0.2757, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.74% (0.3418 => 0.3546, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.74% (1.0689 => 1.1089, std.dev.: 0.0038) MultiSource/Applications/JM/lencod/lencod: 3.71% (14.7256 => 15.2720, std.dev.: 0.0568) MultiSource/Benchmarks/sim/sim: 3.66% (0.3084 => 0.3197, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/lists1: 3.64% (0.2771 => 0.2872, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 3.55% (0.3520 => 0.3645, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 3.55% (0.2877 => 0.2979, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 3.54% (0.3847 => 0.3983, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.40% (12.6413 => 13.0717, std.dev.: 0.0146) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.34% (4.2616 => 4.4041, std.dev.: 0.0483) SingleSource/Benchmarks/Shootout-C++/moments: 3.34% (0.3412 => 0.3526, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 3.22% (6.4908 => 6.6996, std.dev.: 0.0102) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.18% (4.3380 => 4.4759, std.dev.: 0.0195) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.08% (4.0318 => 4.1559, std.dev.: 0.0114) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.99% (4.2815 => 4.4095, std.dev.: 0.0214) MultiSource/Benchmarks/Prolangs-C/football/football: 2.97% (0.8405 => 0.8655, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.95% (8.2559 => 8.4994, std.dev.: 0.0820) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.55% (1.3935 => 1.4290, std.dev.: 0.0129) MultiSource/Applications/ClamAV/clamscan: 1.26% (14.6079 => 14.7925, std.dev.: 0.0339) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 55.94% (0.0261 => 0.0407, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/pi: 41.43% (1.6538 => 2.3390, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/matrix: 22.42% (3.4629 => 4.2394, std.dev.: 0.0517) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.62% (0.0766 => 0.0901, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/ary3: 14.84% (1.7426 => 2.0012, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.49% (4.0101 => 4.5510, std.dev.: 0.0327) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.90% (2.4042 => 2.7143, std.dev.: 0.0215) SingleSource/Benchmarks/McGill/queens: 11.11% (1.6261 => 1.8068, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 10.26% (0.1433 => 0.1580, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/mason/mason: 9.95% (0.5004 => 0.5502, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout/lists: 8.71% (7.0025 => 7.6124, std.dev.: 0.0229) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.37% (0.2857 => 0.3096, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.11% (1.0063 => 1.0778, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.63% (0.3301 => 0.3487, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 4.32% (6.9722 => 7.2734, std.dev.: 0.0372) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.31% (40.4792 => 42.2227, std.dev.: 0.5577) SingleSource/Benchmarks/Misc/fp-convert: 4.29% (15.2242 => 15.8768, std.dev.: 0.0335) SingleSource/Benchmarks/Misc/dt: 3.98% (0.9851 => 1.0243, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.88% (3.4080 => 3.5401, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.17% (0.5587 => 0.5764, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.10% (2.6656 => 2.7482, std.dev.: 0.0130) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.85% (6.6312 => 6.8201, std.dev.: 0.0320) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.35% (0.5876 => 0.6014, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 2.20% (0.6308 => 0.6447, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.80% (4.6127 => 4.6958, std.dev.: 0.0294) MultiSource/Benchmarks/Olden/power/power: 1.45% (1.4184 => 1.4389, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/hash: 1.15% (4.3016 => 4.3512, std.dev.: 0.0107) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.14% (2.4455 => 2.4734, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.07% (1.6110 => 1.6282, std.dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -43.39% (0.2996 => 0.1696, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -43.32% (0.0591 => 0.0335, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.27% (1.4189 => 1.1597, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.10% (1.4113 => 1.1559, std.dev.: 0.0105) SingleSource/UnitTests/Vector/constpool: -4.74% (8.9977 => 8.5716, std.dev.: 0.1447) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.12% (0.3497 => 0.2129, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.39% (5.2665 => 4.0871, std.dev.: 0.0521) SingleSource/Benchmarks/Shootout-C++/ary3: -19.74% (1.7473 => 1.4024, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -14.81% (1.7361 => 1.4790, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/17-bintr/bintr: -13.85% (0.0917 => 0.0790, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/sieve: -12.23% (8.1594 => 7.1614, std.dev.: 0.0176) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.12% (1.1647 => 1.0468, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: -8.37% (9.5474 => 8.7481, std.dev.: 0.0120) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.35% (1.4034 => 1.2862, std.dev.: 0.0145) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.01% (3.2007 => 2.9442, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.89% (3.6254 => 3.3757, std.dev.: 0.0329) SingleSource/Benchmarks/Shootout-C++/fibo: -6.55% (4.6355 => 4.3320, std.dev.: 0.0076) MultiSource/Applications/lambda-0_1_3/lambda: -6.53% (7.6833 => 7.1814, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/richards_benchmark: -6.09% (1.4441 => 1.3562, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.92% (2.9728 => 2.7967, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/distray/distray: -5.52% (0.2664 => 0.2517, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.47% (3.9413 => 3.7259, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout/fib2: -5.35% (4.4195 => 4.1830, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/bh/bh: -5.09% (2.5166 => 2.3884, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.65% (0.4564 => 0.4352, std.dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: -4.48% (0.3746 => 0.3578, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: -4.12% (62.4126 => 59.8404, std.dev.: 0.1174) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.98% (1.1683 => 1.1218, std.dev.: 0.0080) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.48% (1.2959 => 1.2508, std.dev.: 0.0123) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.05% (3.7496 => 3.6353, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/methcall: -3.02% (9.2503 => 8.9707, std.dev.: 0.0222) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.49% (0.4140 => 0.4037, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.32% (2.8964 => 2.8292, std.dev.: 0.0256) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.15% (9.3855 => 9.1837, std.dev.: 0.0203) SingleSource/Benchmarks/Dhrystone/dry: -2.12% (2.4013 => 2.3503, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: -2.04% (3.4876 => 3.4163, std.dev.: 0.0034) MultiSource/Benchmarks/sim/sim: -1.93% (3.8907 => 3.8156, std.dev.: 0.0090) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.86% (2.3569 => 2.3131, std.dev.: 0.0015) MultiSource/Applications/aha/aha: -1.81% (3.4286 => 3.3667, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/neural/neural: -1.64% (1.0926 => 1.0747, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.60% (1.0686 => 1.0515, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -1.57% (1.0194 => 1.0034, std.dev.: 0.0035) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.39% (27.1724 => 26.7946, std.dev.: 0.0236) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3098, std.dev.: 0.0181) SingleSource/Benchmarks/Dhrystone/fldry: -1.31% (2.4971 => 2.4645, std.dev.: 0.0063) MultiSource/Applications/JM/lencod/lencod: -1.25% (6.7458 => 6.6615, std.dev.: 0.0171) SingleSource/Benchmarks/Shootout-C++/lists: -1.10% (16.5617 => 16.3790, std.dev.: 0.0548) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.89% (0.9980 => 1.0268, std.dev.: 0.0084) MultiSource/Applications/sqlite3/sqlite3: 4.47% (0.6022 => 0.6291, std.dev.: 0.0080) MultiSource/Benchmarks/McCat/08-main/main: 10.80% (0.1666 => 0.1846, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.35% (0.1554 => 0.1606, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.63% (0.3083 => 0.3195, std.dev.: 0.0094) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.04% (0.2394 => 0.2393, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.18% (0.3175 => 0.3276, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.56% (0.2302 => 0.2315, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel: -8.46% (0.0449 => 0.0411, std.dev.: 0.0027) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -28.75% (0.0240 => 0.0171, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 3.65% (0.0192 => 0.0199, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.05% (0.0390 => 0.0398, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.66% (0.0301 => 0.0306, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -8.10% (0.0284 => 0.0261, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.85% (0.0324 => 0.0330, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 4.52% (0.0177 => 0.0185, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 5.29% (0.0189 => 0.0199, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 2.41% (0.0249 => 0.0255, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 1.54% (0.0325 => 0.0330, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.28% (0.1429 => 0.1425, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 3.04% (1.5019 => 1.5475, std.dev.: 0.0243) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 3.53% (0.1501 => 0.1554, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.51% (0.4264 => 0.4029, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.87% (0.1344 => 0.1396, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.43% (0.0589 => 0.0621, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -24.57% (0.0232 => 0.0175, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.55% (0.0639 => 0.0578, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.39% (1.1350 => 1.1306, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 83.33% (0.0006 => 0.0011, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.22% (0.0637 => 0.0591, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -45.53% (0.0246 => 0.0134, std.dev.: 0.0061) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.50% (0.7541 => 0.7654, std.dev.: 0.0250) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 11.06% (1.5363 => 1.7062, std.dev.: 0.0013) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -22.86% (0.0070 => 0.0054, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 2.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 5 17:37:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 19:37:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121006003726.82F662A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4622?compare_to=4619&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4622, Order: 165339, Start Time: 2012-10-05 23:19:59, End Time: 2012-10-06 00:39:08 To: 4619, Order: 165335, Start Time: 2012-10-05 21:30:47, End Time: 2012-10-05 22:50:31 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 72 (4 on baseline) Performance Regressions: 4 (154 on baseline) Performance Improvements: 3 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 946 (763 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt New Passes - Execution Time --------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.31% (2.5049 => 2.5376, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 1.08% (1.6709 => 1.6889, std.dev.: 0.0060) MultiSource/Applications/JM/ldecod/ldecod: 1.05% (11.3012 => 11.4194, std.dev.: 0.0120) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.46% (1.0826 => 1.0984, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.27% (15.5760 => 15.0668, std.dev.: 0.0084) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.16% (56.1429 => 54.3684, std.dev.: 0.1469) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.16% (1.3260 => 1.2973, std.dev.: 0.0068) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.32% (0.5865 => 0.5884, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 0.24% (16.1638 => 16.2025, std.dev.: 0.0191) MultiSource/Benchmarks/Bullet/bullet: 0.39% (54.7302 => 54.9433, std.dev.: 0.0091) MultiSource/Benchmarks/MallocBench/gs/gs: 0.21% (4.3754 => 4.3845, std.dev.: 0.0108) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.45% (1.2426 => 1.2482, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.10% (7.7459 => 7.7535, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.52% (0.7369 => 0.7407, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.28% (0.0361 => 0.0360, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.09% (0.2140 => 0.2138, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -13.12% (63.2438 => 54.9433, std.dev.: 0.0091) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.46% (14.1553 => 18.7500, std.dev.: 0.0223) SingleSource/Benchmarks/Misc-C++-EH/spirit: 60.67% (3.4629 => 5.5640, std.dev.: 0.0047) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14225.56% (0.0720 => 10.3144, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952500.00% (0.0001 => 9.9526, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 49.41% (0.2554 => 0.3816, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 45.33% (10.3673 => 15.0668, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/richards_benchmark: 31.75% (0.1622 => 0.2137, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 30.87% (0.1056 => 0.1382, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 15.29% (0.1432 => 0.1651, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.23% (2.2022 => 2.5376, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.95% (7.0540 => 8.1088, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.30% (0.1566 => 0.1790, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.83% (1.7609 => 1.9868, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.28% (0.0871 => 0.0978, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: 11.55% (0.3282 => 0.3661, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 11.32% (0.3473 => 0.3866, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.30% (0.1584 => 0.1763, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.26% (0.3543 => 0.3942, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.15% (0.3497 => 0.3887, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.15% (0.3543 => 0.3938, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.12% (0.3516 => 0.3907, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.09% (0.3561 => 0.3956, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.89% (0.3828 => 0.4245, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.86% (0.3694 => 0.4095, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.77% (0.3927 => 0.4350, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/property: 10.73% (0.3886 => 0.4303, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 10.21% (0.1440 => 0.1587, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 9.42% (10.4361 => 11.4194, std.dev.: 0.0120) MultiSource/Applications/lambda-0_1_3/lambda: 9.36% (0.7433 => 0.8129, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.28% (0.4879 => 0.5332, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.23% (0.4615 => 0.5041, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.19% (0.3177 => 0.3469, std.dev.: 0.0049) MultiSource/Applications/minisat/minisat: 9.09% (0.7115 => 0.7762, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.08% (0.6675 => 0.7281, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 9.06% (0.1655 => 0.1805, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.04% (0.1438 => 0.1568, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 8.94% (9.4845 => 10.3326, std.dev.: 0.0130) MultiSource/Applications/sgefa/sgefa: 8.72% (0.3109 => 0.3380, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 8.69% (0.5925 => 0.6440, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.58% (1.5415 => 1.6737, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 8.57% (0.6030 => 0.6547, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 8.53% (0.3423 => 0.3715, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 8.50% (5.7591 => 6.2489, std.dev.: 0.0137) MultiSource/Benchmarks/Olden/em3d/em3d: 8.44% (0.1695 => 0.1838, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.43% (0.1625 => 0.1762, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.36% (1.3050 => 1.4141, std.dev.: 0.0090) MultiSource/Applications/hbd/hbd: 8.24% (1.5603 => 1.6889, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/lists: 8.24% (0.3422 => 0.3704, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.24% (0.8172 => 0.8845, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 8.18% (0.4289 => 0.4640, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.14% (0.4103 => 0.4437, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.13% (0.5105 => 0.5520, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.10% (0.2271 => 0.2455, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 8.10% (3.3354 => 3.6056, std.dev.: 0.0034) SingleSource/Regression/C++/ofstream_ctor: 8.06% (0.2905 => 0.3139, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 8.05% (0.6456 => 0.6976, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.04% (0.2065 => 0.2231, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.02% (0.4636 => 0.5008, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.02% (0.3865 => 0.4175, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.02% (0.8067 => 0.8714, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.99% (0.2891 => 0.3122, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.96% (0.2700 => 0.2915, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.96% (4.2646 => 4.6039, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.95% (0.5860 => 0.6326, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.92% (0.4203 => 0.4536, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.92% (0.3650 => 0.3939, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.88% (0.1510 => 0.1629, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.88% (0.7326 => 0.7903, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.86% (0.5569 => 0.6007, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.73% (8.1363 => 8.7655, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.73% (4.9449 => 5.3269, std.dev.: 0.0098) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.72% (5.0018 => 5.3881, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.72% (0.2758 => 0.2971, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.71% (0.3307 => 0.3562, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.70% (0.1337 => 0.1440, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.70% (0.9765 => 1.0517, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.69% (0.2107 => 0.2269, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.66% (0.3121 => 0.3360, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.65% (2.0665 => 2.2246, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.63% (0.3826 => 0.4118, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.63% (0.2831 => 0.3047, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.63% (0.2872 => 0.3091, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.62% (0.3136 => 0.3375, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.61% (0.3232 => 0.3478, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 7.61% (0.4048 => 0.4356, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 7.60% (0.2725 => 0.2932, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 7.55% (0.3603 => 0.3875, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 7.50% (0.7835 => 0.8423, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/except: 7.49% (0.2871 => 0.3086, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.47% (0.2756 => 0.2962, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.47% (0.5020 => 0.5395, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists1: 7.46% (0.3684 => 0.3959, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.46% (0.3162 => 0.3398, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 7.44% (0.3387 => 0.3639, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 7.44% (0.3052 => 0.3279, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 7.42% (0.3098 => 0.3328, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.42% (0.1940 => 0.2084, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 7.40% (0.3283 => 0.3526, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.40% (1.1642 => 1.2503, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: 7.38% (0.4620 => 0.4961, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.33% (0.2877 => 0.3088, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hello: 7.30% (0.2714 => 0.2912, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.28% (7.9617 => 8.5414, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/random: 7.24% (0.2802 => 0.3005, std.dev.: 0.0053) MultiSource/Applications/lua/lua: 7.16% (3.8723 => 4.1497, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.16% (0.2793 => 0.2993, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 7.07% (0.1555 => 0.1665, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.92% (0.2603 => 0.2783, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 6.87% (1.0722 => 1.1459, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 6.84% (0.3379 => 0.3610, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.71% (0.3441 => 0.3672, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 6.69% (2.0273 => 2.1630, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.64% (1.1861 => 1.2649, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 6.51% (0.3180 => 0.3387, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.48% (1.5859 => 1.6886, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.40% (0.6450 => 0.6863, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 6.35% (0.4299 => 0.4572, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 6.24% (2.2969 => 2.4402, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/football/football: 6.22% (0.8921 => 0.9476, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.17% (0.5981 => 0.6350, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 6.14% (21.9371 => 23.2847, std.dev.: 0.0212) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.03% (0.4064 => 0.4309, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.92% (0.1892 => 0.2004, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/objinst: 5.81% (0.3131 => 0.3313, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.66% (2.2024 => 2.3270, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.61% (0.1906 => 0.2013, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.52% (1.4186 => 1.4969, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 5.35% (1.2842 => 1.3529, std.dev.: 0.0078) MultiSource/Benchmarks/nbench/nbench: 5.25% (1.1840 => 1.2462, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.08% (0.2266 => 0.2381, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.58% (0.8101 => 0.8472, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.72% (0.3817 => 0.3959, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.68% (14.3668 => 14.8954, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.38% (0.3427 => 0.3543, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.11% (3.8922 => 4.0132, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 3.07% (17.1811 => 17.7089, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.61% (1.1194 => 1.1486, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.26% (1.1145 => 1.3849, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.98% (1.1396 => 1.2533, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4500, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (3.1578 => 3.3677, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 3.68% (0.5413 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.42% (3.6395 => 3.7639, std.dev.: 0.0044) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.83% (4.2280 => 4.3475, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.53% (0.8275 => 0.8402, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8128, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.38% (0.9540 => 0.9672, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.23% (2.6546 => 2.6873, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1293, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.01% (0.8651 => 0.1729, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.06% (5.2763 => 3.2680, std.dev.: 0.0134) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.68% (5.3855 => 3.6255, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.25% (5.3526 => 3.6263, std.dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -14.47% (54.1659 => 46.3259, std.dev.: 0.0413) MultiSource/Benchmarks/FreeBench/mason/mason: -13.07% (0.0811 => 0.0705, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -11.04% (22.1758 => 19.7287, std.dev.: 0.0187) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.58% (2.9384 => 2.6276, std.dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.34% (1.1492 => 0.7660, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4235, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.83% (0.0998 => 0.0860, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.23% (1.2373 => 1.0984, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: -10.59% (1.5373 => 1.3745, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/mason/mason: -9.72% (0.2161 => 0.1951, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.32% (19.9488 => 18.2884, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.80% (1.8329 => 1.7082, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.30% (1.6805 => 1.5915, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7966, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: -4.96% (1.5835 => 1.5050, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.22% (0.9957 => 0.9537, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.55% (3.2827 => 3.1663, std.dev.: 0.0056) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.4989, std.dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0989, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -2.11% (10.2830 => 10.0662, std.dev.: 0.0200) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.02% (8.6802 => 8.5052, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.98% (8.1563 => 7.9952, std.dev.: 0.0188) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6809, std.dev.: 0.0015) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5139, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4205, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/lists: -1.06% (6.2999 => 6.2331, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8583, std.dev.: 0.0102) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.53% (0.5229 => 0.5884, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 8.09% (14.9895 => 16.2025, std.dev.: 0.0191) MultiSource/Benchmarks/MallocBench/gs/gs: 6.67% (4.1105 => 4.3845, std.dev.: 0.0108) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.98% (1.1048 => 1.2482, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.32% (7.1582 => 7.7535, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.05% (0.6222 => 0.7407, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35900.00% (0.0001 => 0.0360, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.04% (0.2116 => 0.2138, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 5 17:57:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 19:57:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121006005730.CF99B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4623?compare_to=4620&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4623, Order: 165339, Start Time: 2012-10-05 23:44:38, End Time: 2012-10-06 00:59:14 To: 4620, Order: 165335, Start Time: 2012-10-05 21:49:39, End Time: 2012-10-05 23:15:16 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Passes: 3 (0 on baseline) Performance Regressions: 3 (186 on baseline) Performance Improvements: 0 (40 on baseline) Removed Tests: 69 (0 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 967 (750 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.12% (1.5218 => 1.5389, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.08% (2.1715 => 2.1950, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.76% (54.7723 => 56.2814, std.dev.: 0.1258) Removed Tests - Compile Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Removed Tests - Execution Time ------------------------------ MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 22.05% (2.0176 => 2.4624, std.dev.: 0.0044) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.73% (0.1410 => 0.1660, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 15.86% (0.0826 => 0.0957, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.14% (0.0819 => 0.0943, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 14.89% (0.2243 => 0.2577, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.53% (0.1072 => 0.1217, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.95% (0.0834 => 0.0942, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 12.41% (0.4328 => 0.4865, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 12.39% (1.3693 => 1.5389, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: 12.34% (0.1013 => 0.1138, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 12.24% (0.4062 => 0.4559, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.17% (0.1413 => 0.1585, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 11.85% (0.7038 => 0.7872, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 11.72% (0.5818 => 0.6500, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.65% (0.2721 => 0.3038, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 11.54% (0.2781 => 0.3102, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 11.50% (0.5748 => 0.6409, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.48% (3.9660 => 4.4213, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.46% (0.3899 => 0.4346, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.45% (0.1327 => 0.1479, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.41% (0.0964 => 0.1074, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.40% (0.1588 => 0.1769, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.36% (0.2782 => 0.3098, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.29% (0.2596 => 0.2889, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.25% (0.3022 => 0.3362, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.14% (0.7710 => 0.8569, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.06% (1.2193 => 1.3541, std.dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference: 11.02% (0.7061 => 0.7839, std.dev.: 0.0021) MultiSource/Applications/aha/aha: 11.02% (0.1062 => 0.1179, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.00% (0.9199 => 1.0211, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.99% (0.3485 => 0.3868, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.97% (1.4563 => 1.6160, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.95% (0.6283 => 0.6971, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.81% (0.6959 => 0.7711, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: 10.79% (0.2726 => 0.3020, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.78% (0.3756 => 0.4161, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 10.78% (0.2690 => 0.2980, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 10.78% (0.3293 => 0.3648, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 10.78% (0.2607 => 0.2888, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.77% (0.4390 => 0.4863, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.77% (0.2655 => 0.2941, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 10.73% (0.2937 => 0.3252, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.72% (0.3489 => 0.3863, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.70% (1.9828 => 2.1950, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.69% (0.5265 => 0.5828, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/except: 10.69% (0.2760 => 0.3055, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.69% (0.2966 => 0.3283) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.66% (0.4016 => 0.4444, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 10.62% (0.2628 => 0.2907, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.60% (0.2765 => 0.3058, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 10.58% (0.2761 => 0.3053, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 10.57% (0.3453 => 0.3818, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/moments: 10.52% (0.3868 => 0.4275, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 10.51% (0.3149 => 0.3480, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 10.49% (0.3107 => 0.3433, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.47% (0.3580 => 0.3955, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 10.40% (0.3192 => 0.3524, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.35% (0.2696 => 0.2975, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 10.32% (13.8202 => 15.2465, std.dev.: 0.0105) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.28% (1.1364 => 1.2532, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 10.17% (0.1003 => 0.1105, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 10.11% (0.2988 => 0.3290, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.00% (0.4791 => 0.5270, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 9.96% (0.3534 => 0.3886, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.85% (0.1157 => 0.1271, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 9.82% (1.0313 => 1.1326, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.77% (0.1075 => 0.1180, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 9.72% (0.2995 => 0.3286, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.68% (0.5577 => 0.6117, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.66% (0.4379 => 0.4802, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.62% (0.1986 => 0.2177, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 9.57% (0.1589 => 0.1741, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.49% (0.3130 => 0.3427, std.dev.: 0.0016) MultiSource/Applications/Burg/burg: 9.43% (1.1061 => 1.2104, std.dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: 9.42% (16.6129 => 18.1778, std.dev.: 0.0072) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.41% (0.1435 => 0.1570, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 9.41% (0.2945 => 0.3222, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.40% (0.2914 => 0.3188, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.33% (0.1276 => 0.1395, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.30% (0.3246 => 0.3548, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 9.27% (0.1111 => 0.1214, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.26% (0.2127 => 0.2324, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.21% (0.8698 => 0.9499, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.10% (0.7460 => 0.8139, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 9.10% (0.3220 => 0.3513, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 9.00% (0.8310 => 0.9058, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.99% (0.5637 => 0.6144, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/gs/gs: 8.98% (3.8646 => 4.2116, std.dev.: 0.0076) MultiSource/Applications/minisat/minisat: 8.97% (0.6744 => 0.7349, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.90% (0.1865 => 0.2031, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.85% (0.6576 => 0.7158, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.85% (0.2023 => 0.2202, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 8.85% (0.7506 => 0.8170, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.84% (0.3755 => 0.4087, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 8.73% (0.1478 => 0.1607, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 8.67% (1.9270 => 2.0940, std.dev.: 0.0017) MultiSource/Applications/siod/siod: 8.61% (2.1791 => 2.3667, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.60% (7.2180 => 7.8384, std.dev.: 0.0069) MultiSource/Applications/d/make_dparser: 8.55% (3.1889 => 3.4617, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 8.45% (1.0594 => 1.1489, std.dev.: 0.0134) MultiSource/Benchmarks/McCat/09-vor/vor: 8.41% (0.2925 => 0.3171, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 8.15% (0.1657 => 0.1792, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.12% (0.8818 => 0.9534, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.12% (0.3511 => 0.3796, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 8.08% (0.3131 => 0.3384, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.04% (0.4003 => 0.4325, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.03% (0.1569 => 0.1695, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 8.02% (1.2749 => 1.3772, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.00% (1.3245 => 1.4305, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.00% (3.6692 => 3.9627, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.97% (0.1819 => 0.1964, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.89% (4.3801 => 4.7259, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/property: 7.89% (0.3940 => 0.4251, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.88% (0.1789 => 0.1930, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 7.86% (14.8535 => 16.0212, std.dev.: 0.0082) SingleSource/UnitTests/ObjC/trivial-interface: 7.83% (0.3578 => 0.3858, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.82% (0.3914 => 0.4220, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.81% (0.6135 => 0.6614, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.80% (0.2140 => 0.2307, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 7.77% (4.6629 => 5.0250, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.73% (4.4433 => 4.7868, std.dev.: 0.0087) SingleSource/UnitTests/ObjC/for-in: 7.71% (0.3789 => 0.4081, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.68% (0.3646 => 0.3926, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 7.66% (8.4961 => 9.1467, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/synchronized: 7.64% (0.3663 => 0.3943, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.62% (0.3650 => 0.3928, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 7.61% (1.2292 => 1.3228, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 7.61% (0.3601 => 0.3875, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.48% (0.3623 => 0.3894, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 7.36% (0.6250 => 0.6710, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 7.34% (0.4113 => 0.4415, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.21% (4.9865 => 5.3460, std.dev.: 0.0088) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.09% (0.9108 => 0.9754, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.03% (0.2504 => 0.2680, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.01% (1.5188 => 1.6252, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.91% (0.4805 => 0.5137, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.89% (3.2742 => 3.4998, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.86% (1.1333 => 1.2111, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 6.42% (0.2008 => 0.2137, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 6.35% (6.5754 => 6.9932, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.26% (0.3245 => 0.3448, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.25% (0.2321 => 0.2466, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.17% (6.2785 => 6.6659, std.dev.: 0.0049) MultiSource/Applications/lua/lua: 6.14% (3.7467 => 3.9768, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.96% (2.1007 => 2.2258, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.33% (13.2842 => 13.9920, std.dev.: 0.0126) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.46% (0.2243 => 0.2343, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 3.88% (16.2614 => 16.8928, std.dev.: 0.0115) MultiSource/Applications/ClamAV/clamscan: 3.60% (14.5298 => 15.0527, std.dev.: 0.0064) MultiSource/Benchmarks/Bullet/bullet: 1.70% (33.2944 => 33.8605, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5171, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 23.78% (1.8175 => 2.2497, std.dev.: 0.0161) SingleSource/Benchmarks/Misc/richards_benchmark: 10.98% (1.1560 => 1.2829, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 9.04% (0.8273 => 0.9021, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.70% (0.1322 => 0.1437) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4138, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.29% (1.2998 => 1.3815, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626) SingleSource/Benchmarks/Misc/flops-5: 4.75% (1.9144 => 2.0054, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6771, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.36% (1.9199 => 1.9845, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 3.27% (10.7476 => 11.0991, std.dev.: 0.0179) SingleSource/Regression/C/uint64_to_float: 2.95% (0.5449 => 0.5610, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.23% (7.4271 => 7.5924, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.71% (1.4298 => 1.4543, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0507, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5125, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9678, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1886, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5788, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0274, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5907, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.02% (3.6469 => 3.6842, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.00% (8.8259 => 8.9143, std.dev.: 0.0077) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.04% (0.2670 => 0.1414, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.46% (0.4657 => 0.3937, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -15.42% (0.0707 => 0.0598, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.86% (1.3819 => 1.1904, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.81% (1.3813 => 1.1906, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.40% (22.5627 => 21.7961, std.dev.: 0.0082) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.84% (0.0997 => 0.0859, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -12.15% (0.2238 => 0.1966, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.94% (1.2308 => 1.0961, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.10% (20.3410 => 18.2862, std.dev.: 0.0146) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.97% (1.3780 => 1.2957, std.dev.: 0.0084) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.11% (2.6470 => 2.5117, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.17% (0.9996 => 0.9579, std.dev.: 0.0033) MultiSource/Applications/siod/siod: -3.58% (3.2729 => 3.1557, std.dev.: 0.0241) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.51% (1.7688 => 1.7068, std.dev.: 0.0062) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.02% (0.4867 => 0.4720, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.59% (26.5159 => 25.8282, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.38% (3.0263 => 2.9543, std.dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.35% (1.9762 => 1.9297, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.88% (0.6589 => 0.6465, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7154, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/lists: -1.74% (6.3560 => 6.2454, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0065, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8655, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: -1.29% (4.5928 => 4.5334, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: -1.26% (9.3358 => 9.2186, std.dev.: 0.0122) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4950, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2583, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 5 18:20:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 20:20:11 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121006012011.9A3962A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4624?compare_to=4621&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4624, Order: 165343, Start Time: 2012-10-05 23:58:38, End Time: 2012-10-06 01:21:56 To: 4621, Order: 165336, Start Time: 2012-10-05 22:19:31, End Time: 2012-10-05 23:42:32 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (14 on baseline) Performance Regressions: 14 (102 on baseline) Performance Improvements: 7 (47 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 956 (742 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/kimwitu++/kc: 2.69% (16.3457 => 16.7853, std.dev.: 0.0345) MultiSource/Applications/oggenc/oggenc: 2.43% (4.9610 => 5.0814, std.dev.: 0.0296) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: 13.55% (0.1432 => 0.1626, std.dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.30% (12.9579 => 14.6807, std.dev.: 0.2334) MultiSource/Benchmarks/nbench/nbench: 8.80% (20.5576 => 22.3669, std.dev.: 0.6085) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 5.98% (6.6118 => 7.0072, std.dev.: 0.1475) MultiSource/Applications/siod/siod: 2.52% (3.5779 => 3.6679, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (2.5629 => 2.6116, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/fbench: 1.72% (3.3863 => 3.4445, std.dev.: 0.0035) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.70% (1.2265 => 1.2473, std.dev.: 0.0043) MultiSource/Applications/SIBsim4/SIBsim4: 1.63% (3.3522 => 3.4067, std.dev.: 0.0138) MultiSource/Applications/lua/lua: 1.35% (29.5734 => 29.9716, std.dev.: 0.1019) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.18% (1.1218 => 1.1350, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.15% (2.8292 => 2.8617, std.dev.: 0.0064) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc-C++/bigfib: -2.41% (0.5942 => 0.5799, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.74% (0.8977 => 0.8821, std.dev.: 0.0042) MultiSource/Benchmarks/Bullet/bullet: -1.04% (31.0091 => 30.6861, std.dev.: 0.0481) MultiSource/Benchmarks/PAQ8p/paq8p: -1.02% (2.3972 => 2.3728, std.dev.: 0.0053) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -2.13% (2.7482 => 2.6896, std.dev.: 0.0203) SingleSource/Benchmarks/Misc/mandel-2: -1.48% (3.0700 => 3.0247, std.dev.: 0.0148) MultiSource/Benchmarks/Bullet/bullet: -1.29% (7.2734 => 7.1798, std.dev.: 0.0164) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.20% (1.0268 => 1.0289, std.dev.: 0.0106) MultiSource/Applications/sqlite3/sqlite3: -0.68% (0.6291 => 0.6248, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: -4.82% (0.1846 => 0.1757, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.56% (0.1606 => 0.1597, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.88% (0.3195 => 0.3167, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.38% (0.2393 => 0.2402, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.25% (0.3276 => 0.3235, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.73% (0.2315 => 0.2355, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel: 12.90% (0.0411 => 0.0464) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 42.69% (0.0171 => 0.0244, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -22.11% (0.0199 => 0.0155, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.76% (0.0398 => 0.0391, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.65% (0.0306 => 0.0304, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 9.58% (0.0261 => 0.0286, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.30% (0.0330 => 0.0329) SingleSource/UnitTests/Vector/Altivec/casts: -6.49% (0.0185 => 0.0173, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/test1: -1.51% (0.0199 => 0.0196, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 1.57% (0.0255 => 0.0259, std.dev.: 0.0016) SingleSource/UnitTests/byval-alignment: 0.30% (0.0330 => 0.0331, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.35% (0.1425 => 0.1430, std.dev.: 0.0030) MultiSource/Applications/lemon/lemon: -8.65% (1.5475 => 1.4136, std.dev.: 0.0686) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -5.79% (0.1554 => 0.1464, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.45% (0.4029 => 0.4047, std.dev.: 0.0145) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.50% (0.1396 => 0.1403, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.70% (0.0621 => 0.0567, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 5.71% (0.0175 => 0.0185, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.21% (0.0578 => 0.0585, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.10% (1.1306 => 1.1295, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 18.18% (0.0011 => 0.0013, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 140.00% (0.0005 => 0.0012, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.69% (0.0591 => 0.0581, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 82.84% (0.0134 => 0.0245, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.08% (0.7654 => 0.7648, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.02% (1.7062 => 1.7065, std.dev.: 0.0056) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 124.07% (0.0054 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 146.07% (0.0089 => 0.0219, std.dev.: 0.0004) SingleSource/UnitTests/2003-08-11-VaListArg: 177.78% (0.0090 => 0.0250, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -27.59% (4.1772 => 3.0247, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/except: 82700.00% (0.0006 => 0.4968, std.dev.: 0.0034) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: 300.00% (0.0001 => 0.0004, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 24.16% (0.0745 => 0.0925, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 9.63% (15.3105 => 16.7853, std.dev.: 0.0345) MultiSource/Applications/minisat/minisat: 9.35% (0.6173 => 0.6750, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/bigfib: 9.23% (0.5309 => 0.5799, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.20% (0.6410 => 0.7000, std.dev.: 0.0031) MultiSource/Benchmarks/PAQ8p/paq8p: 9.03% (2.1763 => 2.3728, std.dev.: 0.0053) MultiSource/Applications/SIBsim4/SIBsim4: 8.54% (1.1653 => 1.2648, std.dev.: 0.0181) MultiSource/Applications/lemon/lemon: 8.43% (1.0046 => 1.0893, std.dev.: 0.0090) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.42% (0.1414 => 0.1533, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.35% (0.3582 => 0.3881, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 7.68% (0.6915 => 0.7446, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.64% (0.2552 => 0.2747, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 7.08% (4.7455 => 5.0814, std.dev.: 0.0296) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.90% (1.5150 => 1.6195, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.86% (0.2886 => 0.3055, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.83% (0.7639 => 0.8084, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.80% (0.6069 => 0.6421, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.79% (0.2797 => 0.2959, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.64% (0.3901 => 0.4121, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists: 5.54% (0.2347 => 0.2477, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.51% (0.4248 => 0.4482, std.dev.: 0.0023) MultiSource/Applications/d/make_dparser: 5.42% (3.0225 => 3.1863, std.dev.: 0.0226) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.41% (0.2106 => 0.2220, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.24% (0.2654 => 0.2793, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.09% (0.3062 => 0.3218, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.98% (0.4880 => 0.5123, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/18-imp/imp: 4.97% (0.3217 => 0.3377, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.97% (1.1672 => 1.2252, std.dev.: 0.0089) MultiSource/Applications/hbd/hbd: 4.87% (1.3268 => 1.3914, std.dev.: 0.0085) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.85% (0.8569 => 0.8985, std.dev.: 0.0065) MultiSource/Applications/SPASS/SPASS: 4.72% (13.3238 => 13.9522, std.dev.: 0.0641) MultiSource/Benchmarks/Bullet/bullet: 4.67% (29.3170 => 30.6861, std.dev.: 0.0481) MultiSource/Applications/lua/lua: 4.67% (3.5980 => 3.7659, std.dev.: 0.0316) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.61% (6.2546 => 6.5427, std.dev.: 0.0342) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.50% (1.2021 => 1.2562, std.dev.: 0.0167) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.44% (0.7722 => 0.8065, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.43% (0.2662 => 0.2780, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 4.42% (0.3847 => 0.4017, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.41% (1.1827 => 1.2348, std.dev.: 0.0066) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.39% (0.2303 => 0.2404, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.36% (1.4408 => 1.5036, std.dev.: 0.0107) MultiSource/Benchmarks/mafft/pairlocalalign: 4.24% (8.2186 => 8.5668, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.21% (3.0758 => 3.2054, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/lists1: 4.11% (0.2771 => 0.2885, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.10% (0.2952 => 0.3073, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 4.08% (0.8405 => 0.8748, std.dev.: 0.0050) MultiSource/Applications/siod/siod: 4.07% (2.0972 => 2.1826, std.dev.: 0.0127) MultiSource/Applications/JM/lencod/lencod: 4.04% (14.7256 => 15.3208, std.dev.: 0.1858) MultiSource/Applications/treecc/treecc: 4.01% (1.8798 => 1.9551, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.88% (0.2806 => 0.2915, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 3.88% (6.4908 => 6.7426, std.dev.: 0.0734) MultiSource/Benchmarks/nbench/nbench: 3.84% (1.0821 => 1.1237, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/hash: 3.81% (0.3520 => 0.3654, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.74% (0.3418 => 0.3546, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.72% (0.7226 => 0.7495, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/moments: 3.49% (0.3412 => 0.3531, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.46% (0.5636 => 0.5831, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.44% (12.6413 => 13.0762, std.dev.: 0.0522) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.42% (1.0689 => 1.1055, std.dev.: 0.0094) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.27% (0.4562 => 0.4711, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: 3.24% (0.9425 => 0.9730, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.11% (2.0317 => 2.0949, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.95% (0.5937 => 0.6112, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.94% (1.3935 => 1.4345, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.93% (4.0318 => 4.1500, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.87% (4.3380 => 4.4625, std.dev.: 0.0311) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.53% (4.2616 => 4.3696, std.dev.: 0.0369) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.36% (0.5520 => 0.5650, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.30% (4.2815 => 4.3800, std.dev.: 0.0285) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.13% (8.2559 => 8.4318, std.dev.: 0.0313) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 53.64% (0.0261 => 0.0401, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/pi: 41.40% (1.6538 => 2.3385, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2278, std.dev.: 0.0187) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.71% (0.0766 => 0.0894, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/ary3: 15.25% (1.7426 => 2.0083, std.dev.: 0.0172) MultiSource/Benchmarks/Olden/mst/mst: 14.75% (0.1417 => 0.1626, std.dev.: 0.0050) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.90% (2.4042 => 2.7384, std.dev.: 0.0232) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.79% (4.0101 => 4.5632, std.dev.: 0.0161) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 11.23% (0.0917 => 0.1020, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/queens: 11.08% (1.6261 => 1.8062, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.31% (0.2857 => 0.3123, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/mason/mason: 8.71% (0.5004 => 0.5440, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/lists: 8.52% (7.0025 => 7.5994, std.dev.: 0.0599) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.01% (1.0063 => 1.0869, std.dev.: 0.0018) SingleSource/Benchmarks/Stanford/Puzzle: 7.82% (0.1433 => 0.1545, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.27% (0.3301 => 0.3475, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.53% (40.4792 => 42.3144, std.dev.: 0.3786) SingleSource/Benchmarks/Misc/dt: 4.33% (0.9851 => 1.0278, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: 3.95% (15.2242 => 15.8250, std.dev.: 0.0765) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.93% (3.4080 => 3.5418, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 3.26% (3.5520 => 3.6679, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/health/health: 2.98% (0.3420 => 0.3522, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 2.98% (6.9722 => 7.1798, std.dev.: 0.0164) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.83% (6.6312 => 6.8187, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.68% (0.5587 => 0.5737, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.61% (4.2129 => 4.3228, std.dev.: 0.0379) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.04% (0.5876 => 0.5996, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.67% (2.5687 => 2.6116, std.dev.: 0.0128) MultiSource/Applications/lua/lua: 1.52% (29.5232 => 29.9716, std.dev.: 0.1019) MultiSource/Benchmarks/Olden/power/power: 1.45% (1.4184 => 1.4389, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/five11/five11: 1.32% (5.1938 => 5.2626, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/em3d/em3d: 1.13% (4.6414 => 4.6937, std.dev.: 0.0145) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -43.99% (0.0591 => 0.0331, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -43.09% (0.2996 => 0.1705, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.97% (1.4189 => 1.1498, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.11% (1.4113 => 1.1557, std.dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.63% (0.3497 => 0.2076, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.79% (5.2665 => 4.1190, std.dev.: 0.0394) SingleSource/Benchmarks/Shootout-C++/ary3: -20.65% (1.7473 => 1.3864, std.dev.: 0.0284) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -14.81% (1.7361 => 1.4790, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1578, std.dev.: 0.0355) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.57% (1.1647 => 1.0532, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/moments: -9.25% (0.1114 => 0.1011, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.54% (1.4034 => 1.2836, std.dev.: 0.0083) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.40% (3.2007 => 2.9319, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/flops: -8.37% (9.5474 => 8.7481, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.27% (15.8312 => 14.6807, std.dev.: 0.2334) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.94% (3.6254 => 3.3739, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/fibo: -6.65% (4.6355 => 4.3271, std.dev.: 0.0073) MultiSource/Applications/lambda-0_1_3/lambda: -6.63% (7.6833 => 7.1738, std.dev.: 0.0417) SingleSource/Benchmarks/Misc/richards_benchmark: -6.32% (1.4441 => 1.3529, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.02% (2.9728 => 2.7937, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/distray/distray: -5.63% (0.2664 => 0.2514, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.47% (3.9413 => 3.7258, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/fib2: -5.31% (4.4195 => 4.1850, std.dev.: 0.0469) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.11% (0.4564 => 0.4331, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.73% (0.4140 => 0.3944, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/bh/bh: -4.38% (2.5166 => 2.4063, std.dev.: 0.0089) MultiSource/Benchmarks/mafft/pairlocalalign: -4.28% (62.4126 => 59.7431, std.dev.: 0.0391) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.67% (3.7496 => 3.6119, std.dev.: 0.0274) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -3.50% (1.8739 => 1.8083, std.dev.: 0.0242) SingleSource/Benchmarks/McGill/misr: -3.33% (0.4296 => 0.4153, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.21% (2.4457 => 2.3671, std.dev.: 0.0171) SingleSource/Benchmarks/Shootout-C++/methcall: -3.10% (9.2503 => 8.9633, std.dev.: 0.0282) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.85% (1.1683 => 1.1350, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -2.52% (2.3580 => 2.2986, std.dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/dry: -2.28% (2.4013 => 2.3466, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.26% (1.0686 => 1.0445, std.dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: -2.06% (92.7467 => 90.8376, std.dev.: 0.7128) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.96% (1.2722 => 1.2473, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hash2: -1.94% (3.4876 => 3.4200, std.dev.: 0.0085) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.88% (2.3569 => 2.3126, std.dev.: 0.0044) MultiSource/Applications/aha/aha: -1.87% (3.4286 => 3.3645, std.dev.: 0.0079) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.72% (9.3855 => 9.2244, std.dev.: 0.0324) MultiSource/Benchmarks/sim/sim: -1.62% (3.8907 => 3.8277, std.dev.: 0.0109) MultiSource/Benchmarks/FreeBench/neural/neural: -1.60% (1.0926 => 1.0751, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3067, std.dev.: 0.1086) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.39% (27.1724 => 26.7952, std.dev.: 0.0319) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.20% (2.8964 => 2.8617, std.dev.: 0.0064) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 3.10% (0.9980 => 1.0289, std.dev.: 0.0106) MultiSource/Applications/sqlite3/sqlite3: 3.75% (0.6022 => 0.6248, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: 5.46% (0.1666 => 0.1757, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.77% (0.1554 => 0.1597, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.72% (0.3083 => 0.3167, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.33% (0.2394 => 0.2402, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.89% (0.3175 => 0.3235, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.30% (0.2302 => 0.2355, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel: 3.34% (0.0449 => 0.0464) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.67% (0.0240 => 0.0244, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -19.27% (0.0192 => 0.0155, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.26% (0.0390 => 0.0391, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.00% (0.0301 => 0.0304, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.70% (0.0284 => 0.0286, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.54% (0.0324 => 0.0329) SingleSource/UnitTests/Vector/Altivec/casts: -2.26% (0.0177 => 0.0173, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/test1: 3.70% (0.0189 => 0.0196, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 4.02% (0.0249 => 0.0259, std.dev.: 0.0016) SingleSource/UnitTests/byval-alignment: 1.85% (0.0325 => 0.0331, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1429 => 0.1430, std.dev.: 0.0030) MultiSource/Applications/lemon/lemon: -5.88% (1.5019 => 1.4136, std.dev.: 0.0686) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -2.47% (0.1501 => 0.1464, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.09% (0.4264 => 0.4047, std.dev.: 0.0145) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.39% (0.1344 => 0.1403, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.74% (0.0589 => 0.0567, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -20.26% (0.0232 => 0.0185, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.45% (0.0639 => 0.0585, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.48% (1.1350 => 1.1295, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 116.67% (0.0006 => 0.0013, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -50.00% (0.0024 => 0.0012, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.79% (0.0637 => 0.0581, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.41% (0.0246 => 0.0245, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.42% (0.7541 => 0.7648, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.08% (1.5363 => 1.7065, std.dev.: 0.0056) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 5 18:37:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 20:37:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121006013724.9EDFF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4625?compare_to=4617&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4625, Order: 165336, Start Time: 2012-10-05 22:28:55, End Time: 2012-10-06 01:39:07 To: 4617, Order: 165320, Start Time: 2012-10-05 18:49:40, End Time: 2012-10-05 21:59:52 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 0 (3 on baseline) Performance Regressions: 3 (137 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (131 on baseline) Existing Failures: 3 (0 on baseline) Unchanged Tests: 1036 (754 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.01% (2.2188 => 2.2413, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.01% (124.2558 => 131.7185, std.dev.: 0.1605) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.54% (2.0752 => 2.1279, std.dev.: 0.0162) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.01% (9.8074 => 9.8069, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.02% (9.4131 => 9.4113, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.05% (16.9495 => 16.9576, std.dev.: 0.0065) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 12.31% (0.3460 => 0.3886, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.29% (0.3465 => 0.3891, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.27% (0.3488 => 0.3916, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 12.19% (0.3446 => 0.3866, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.19% (0.3496 => 0.3922, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.17% (0.3442 => 0.3861, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/synchronized: 12.14% (0.3469 => 0.3890, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.81% (0.3650 => 0.4081, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.75% (0.3643 => 0.4071, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.63% (0.3724 => 0.4157, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 11.07% (1.5932 => 1.7696, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.82% (0.1063 => 0.1178, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.84% (0.5826 => 0.6399, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.71% (0.5889 => 0.6461, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.01% (0.2875 => 0.3134, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.85% (0.2792 => 0.3039, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 8.78% (0.2780 => 0.3024, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 8.73% (0.2714 => 0.2951, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.73% (0.3195 => 0.3474, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 8.70% (0.2725 => 0.2962, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 8.66% (0.3096 => 0.3364, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.66% (0.2738 => 0.2975, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.61% (0.2729 => 0.2964, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 8.59% (0.3004 => 0.3262, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 8.57% (0.2811 => 0.3052, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.55% (0.2911 => 0.3160, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 8.55% (0.2750 => 0.2985, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 8.46% (0.1619 => 0.1756, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 8.46% (0.2803 => 0.3040, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.44% (0.7171 => 0.7776, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/objinst: 8.43% (0.2823 => 0.3061, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 8.43% (0.2813 => 0.3050, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.42% (2.0673 => 2.2413, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 8.37% (0.1218 => 0.1320, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 8.34% (0.9909 => 1.0735, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: 8.32% (0.3317 => 0.3593, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 8.22% (0.4146 => 0.4487, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary: 8.20% (0.3258 => 0.3525, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.19% (0.4994 => 0.5403, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 8.17% (0.3267 => 0.3534, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.17% (0.3060 => 0.3310, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.14% (0.3845 => 0.4158, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.11% (0.2736 => 0.2958, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.09% (1.3152 => 1.4216, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/moments: 8.05% (0.3678 => 0.3974, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 7.97% (0.3348 => 0.3615, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 7.97% (0.3477 => 0.3754, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.94% (0.3124 => 0.3372, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.87% (0.4361 => 0.4704, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/sieve: 7.86% (0.3726 => 0.4019, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.79% (0.3362 => 0.3624, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.74% (0.3282 => 0.3536, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.72% (0.1620 => 0.1745, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.67% (1.6211 => 1.7455, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.61% (0.3625 => 0.3901, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.60% (0.5000 => 0.5380, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.54% (0.5900 => 0.6345, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.51% (0.3690 => 0.3967, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 7.50% (0.4251 => 0.4570, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.45% (3.5627 => 3.8282, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 7.35% (5.5417 => 5.9489, std.dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.29% (2.7292 => 2.9281, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 7.24% (23.5202 => 25.2230, std.dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.23% (0.3981 => 0.4269, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.15% (0.2014 => 0.2158, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 7.13% (1.0781 => 1.1550, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.98% (0.5026 => 0.5377, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 6.95% (0.4847 => 0.5184, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.84% (0.3930 => 0.4199, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.82% (0.6435 => 0.6874, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 6.72% (0.5012 => 0.5349, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.71% (0.1549 => 0.1653, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 6.71% (4.2109 => 4.4936, std.dev.: 0.0115) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.67% (0.4139 => 0.4415, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/09-vor/vor: 6.64% (0.1505 => 0.1605, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 6.60% (0.6634 => 0.7072, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.60% (4.4195 => 4.7110, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.59% (0.2866 => 0.3055, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.56% (0.3890 => 0.4145, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 6.55% (0.2566 => 0.2734, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 6.49% (0.9697 => 1.0326, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.46% (0.3903 => 0.4155, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.43% (0.2737 => 0.2913, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 6.40% (0.4029 => 0.4287, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 6.34% (2.1013 => 2.2346, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/gs/gs: 6.31% (1.8794 => 1.9979, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.30% (0.3271 => 0.3477, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.29% (0.3084 => 0.3278, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.25% (0.1968 => 0.2091, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.24% (0.2068 => 0.2197, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.20% (0.2969 => 0.3153, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 6.05% (2.1653 => 2.2962, std.dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: 6.03% (4.6177 => 4.8962, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.03% (0.2040 => 0.2163, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.01% (0.4658 => 0.4938, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 6.00% (0.5546 => 0.5879, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 5.94% (1.4269 => 1.5116, std.dev.: 0.0039) MultiSource/Applications/minisat/minisat: 5.85% (0.3336 => 0.3531, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: 5.83% (0.7875 => 0.8334, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.71% (0.2103 => 0.2223, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 5.64% (0.2075 => 0.2192, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.53% (1.9694 => 2.0783, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 5.41% (2.0346 => 2.1446, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.37% (1.9966 => 2.1038, std.dev.: 0.0037) MultiSource/Applications/lemon/lemon: 4.98% (0.2391 => 0.2510, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 4.87% (0.2691 => 0.2822, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.67% (0.7426 => 0.7773, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.50% (0.5361 => 0.5602, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.39% (0.5584 => 0.5829, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.12% (4.6926 => 4.8860, std.dev.: 0.0084) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.10% (11.6398 => 12.1176, std.dev.: 0.0065) MultiSource/Applications/lambda-0_1_3/lambda: 3.97% (0.3498 => 0.3637, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.10% (0.4253 => 0.4385, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.95% (0.3792 => 0.3904, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 2.89% (11.9555 => 12.3013, std.dev.: 0.0120) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.44% (3.3903 => 3.6087, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.41% (0.2122 => 0.2258, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6714, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-2: 4.90% (1.8057 => 1.8942, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 4.66% (15.4430 => 16.1619, std.dev.: 0.1302) SingleSource/Benchmarks/Dhrystone/dry: 4.24% (14.0481 => 14.6432, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.20% (2.0820 => 2.1279, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2089, std.dev.: 0.0029) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5036, std.dev.: 0.0030) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.67% (3.1722 => 3.2253, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2880, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5134, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.13% (1.0927 => 1.1051, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5896, std.dev.: 0.0192) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.85% (25.4195 => 16.5605, std.dev.: 0.0176) SingleSource/Benchmarks/Shootout-C++/ary2: -7.79% (0.2402 => 0.2215, std.dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9757, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7993, std.dev.: 0.0090) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9586, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.60% (11.2080 => 10.8043, std.dev.: 0.0084) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7727, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.88% (0.6293 => 0.6112, std.dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/fldry: -2.84% (17.2379 => 16.7477, std.dev.: 0.0386) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.20% (41.7953 => 40.8752, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5707, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4962, std.dev.: 0.0050) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (105.3826 => 104.1560, std.dev.: 0.0680) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0440, std.dev.: 0.0038) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 5 19:25:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 21:25:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121006022554.7F48D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4626?compare_to=4622&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4626, Order: 165347, Start Time: 2012-10-06 01:08:23, End Time: 2012-10-06 02:27:38 To: 4622, Order: 165339, Start Time: 2012-10-05 23:19:59, End Time: 2012-10-06 00:39:08 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (158 on baseline) Performance Improvements: 2 (41 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1021 (760 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.65% (54.3684 => 56.3516, std.dev.: 0.0821) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.14% (1.2973 => 1.3250, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.57% (15.0668 => 14.8310, std.dev.: 0.0105) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.69% (79.7083 => 78.3601, std.dev.: 0.4307) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.29% (0.5884 => 0.5867, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: -0.11% (16.2025 => 16.1848, std.dev.: 0.0175) MultiSource/Benchmarks/Bullet/bullet: -0.46% (54.9433 => 54.6902, std.dev.: 0.0064) MultiSource/Benchmarks/MallocBench/gs/gs: -0.02% (4.3845 => 4.3838, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.28% (1.2482 => 1.2447, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.15% (7.7535 => 7.7422, std.dev.: 0.0153) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.42% (0.7407 => 0.7376, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.56% (0.0360 => 0.0362, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.2138 => 0.2138, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -13.52% (63.2438 => 54.6902, std.dev.: 0.0064) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.53% (14.1553 => 18.7605, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++-EH/spirit: 60.38% (3.4629 => 5.5537, std.dev.: 0.0266) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14227.08% (0.0720 => 10.3155, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952100.00% (0.0001 => 9.9522, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 49.53% (0.2554 => 0.3819, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 43.06% (10.3673 => 14.8310, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/richards_benchmark: 32.80% (0.1622 => 0.2154, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/distray/distray: 30.68% (0.1056 => 0.1380, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.94% (2.2022 => 2.5311, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 14.80% (0.1432 => 0.1644, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.55% (7.0540 => 8.0806, std.dev.: 0.0129) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.43% (0.1566 => 0.1792, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.47% (0.0834 => 0.0938, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.15% (1.7609 => 1.9749, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.06% (0.0871 => 0.0976, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/oourafft: 11.58% (0.3282 => 0.3662, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.37% (0.3473 => 0.3868, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.18% (0.3543 => 0.3939, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.09% (0.3543 => 0.3936, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 11.07% (0.3497 => 0.3884, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.05% (0.1584 => 0.1759, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 11.01% (0.3516 => 0.3903, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 10.95% (0.3561 => 0.3951, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/for-in: 10.77% (0.3694 => 0.4092, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.66% (0.3828 => 0.4236, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.64% (0.3927 => 0.4345, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.52% (0.3886 => 0.4295, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 10.42% (0.1440 => 0.1590, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 9.31% (0.1655 => 0.1809, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 9.27% (10.4361 => 11.4034, std.dev.: 0.0129) MultiSource/Applications/lambda-0_1_3/lambda: 9.26% (0.7433 => 0.8121, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.12% (0.4879 => 0.5324, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.11% (0.1438 => 0.1569, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.97% (0.3177 => 0.3462, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.88% (0.6675 => 0.7268, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.84% (0.5925 => 0.6449, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 8.81% (0.7115 => 0.7742, std.dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 8.78% (9.4845 => 10.3168, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference-object: 8.74% (0.6030 => 0.6557, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 8.72% (0.3109 => 0.3380, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.60% (1.5415 => 1.6741, std.dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.58% (0.4615 => 0.5011, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 8.55% (0.1695 => 0.1840, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.55% (0.1625 => 0.1764, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 8.51% (5.7591 => 6.2490, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/18-imp/imp: 8.36% (0.3423 => 0.3709, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.26% (0.8172 => 0.8847, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.14% (0.7326 => 0.7922, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.13% (1.3050 => 1.4111, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.01% (0.2271 => 0.2453, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.99% (0.2065 => 0.2230, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 7.97% (3.3354 => 3.6011, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.93% (0.5105 => 0.5510, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.93% (0.1337 => 0.1443, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.91% (4.2646 => 4.6020, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.88% (0.1510 => 0.1629, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.87% (0.5860 => 0.6321, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.85% (0.2700 => 0.2912, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.74% (0.5569 => 0.6000, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.72% (0.3121 => 0.3362, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.71% (0.8067 => 0.8689, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.66% (8.1363 => 8.7593, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.65% (5.0018 => 5.3846, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.64% (0.2107 => 0.2268, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.64% (4.9449 => 5.3226, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.63% (0.4103 => 0.4416, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.59% (0.9765 => 1.0506, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.58% (0.2758 => 0.2967, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.58% (0.1940 => 0.2087, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: 7.58% (1.5603 => 1.6785, std.dev.: 0.0060) MultiSource/Applications/spiff/spiff: 7.54% (0.7835 => 0.8426, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/lists: 7.54% (0.3422 => 0.3680, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.51% (0.5020 => 0.5397, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.48% (0.4636 => 0.4983, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 7.47% (0.6456 => 0.6938, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.41% (0.3307 => 0.3552, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.34% (0.3650 => 0.3918, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 7.34% (1.1642 => 1.2496, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.32% (0.3865 => 0.4148, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.30% (0.4289 => 0.4602, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.28% (0.4203 => 0.4509, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.26% (0.2905 => 0.3116, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 7.24% (0.2831 => 0.3036, std.dev.: 0.0037) MultiSource/Benchmarks/sim/sim: 7.23% (0.3387 => 0.3632, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.19% (0.2891 => 0.3099, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.16% (0.3826 => 0.4100, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 7.09% (0.4048 => 0.4335, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 7.07% (0.1555 => 0.1665, std.dev.: 0.0028) MultiSource/Applications/lua/lua: 7.02% (3.8723 => 4.1442, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/ary: 6.99% (0.3232 => 0.3458, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.96% (7.9617 => 8.5162, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.92% (0.3136 => 0.3353, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.89% (0.3441 => 0.3678, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.88% (2.0665 => 2.2087, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.84% (0.4620 => 0.4936, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.83% (0.3603 => 0.3849, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.78% (0.2802 => 0.2992, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.78% (0.2877 => 0.3072, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 6.77% (1.0722 => 1.1448, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.77% (0.3162 => 0.3376, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.75% (0.2872 => 0.3066, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.75% (0.3052 => 0.3258, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.72% (0.2871 => 0.3064, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.71% (0.3098 => 0.3306, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 6.70% (0.3684 => 0.3931, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.70% (0.3283 => 0.3503, std.dev.: 0.0079) MultiSource/Applications/treecc/treecc: 6.69% (2.0273 => 2.1629, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.68% (0.2756 => 0.2940, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.64% (0.2725 => 0.2906, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.62% (0.2793 => 0.2978, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.61% (0.2603 => 0.2775, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 6.51% (0.3180 => 0.3387, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.48% (1.1861 => 1.2630, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.41% (0.2714 => 0.2888, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.39% (1.5859 => 1.6873, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.22% (0.6450 => 0.6851, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 6.19% (2.2969 => 2.4391, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/05-eks/eks: 6.19% (0.4299 => 0.4565, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 6.13% (0.8921 => 0.9468, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.04% (0.5981 => 0.6342, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 6.01% (0.3379 => 0.3582, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 5.93% (21.9371 => 23.2376, std.dev.: 0.0232) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.92% (0.1892 => 0.2004, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.60% (2.2024 => 2.3257, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.51% (0.1906 => 0.2011, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.49% (0.4064 => 0.4287, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.32% (1.4186 => 1.4941, std.dev.: 0.0052) MultiSource/Benchmarks/nbench/nbench: 5.05% (1.1840 => 1.2438, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.92% (0.3131 => 0.3285, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 4.91% (1.2842 => 1.3473, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.72% (0.2266 => 0.2373, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.53% (0.8101 => 0.8468, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.45% (14.3668 => 14.8622, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.38% (0.3817 => 0.3946, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.36% (0.3427 => 0.3542) MultiSource/Applications/sqlite3/sqlite3: 2.89% (17.1811 => 17.6781, std.dev.: 0.0228) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.67% (3.8922 => 3.9963, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.42% (1.1194 => 1.1465, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.58% (0.2944 => 0.3285, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.83% (1.1396 => 1.2516, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0016) MultiSource/Applications/aha/aha: 9.20% (3.1595 => 3.4503, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (3.1578 => 3.3679, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 3.66% (0.5413 => 0.5611, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.38% (3.6395 => 3.7625, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.86% (4.2280 => 4.3490, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.29% (1.7254 => 1.7649, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.57% (1.3045 => 1.3250, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (0.8275 => 0.8405, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8131, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.35% (2.6546 => 2.6905, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071) MultiSource/Applications/minisat/minisat: 1.12% (9.1159 => 9.2180, std.dev.: 0.0339) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.08% (6.5088 => 6.5792, std.dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1291, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.15% (5.2763 => 3.2634, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.03% (5.3855 => 3.6067, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.68% (5.3526 => 3.6034, std.dev.: 0.0022) SingleSource/UnitTests/Vector/constpool: -14.43% (54.1659 => 46.3494, std.dev.: 0.0298) MultiSource/Benchmarks/FreeBench/mason/mason: -13.32% (0.0811 => 0.0703, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -11.36% (22.1758 => 19.6559, std.dev.: 0.0268) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.76% (2.9384 => 2.6223, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.44% (1.1492 => 0.7649, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: -16.02% (1.6925 => 1.4213, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.03% (0.0998 => 0.0858, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.42% (1.2373 => 1.0960, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel-2: -10.28% (1.5373 => 1.3792, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -10.04% (0.2161 => 0.1944, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.34% (19.9488 => 18.2845, std.dev.: 0.0191) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.73% (1.8329 => 1.7095, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5757, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.28% (1.6805 => 1.5917, std.dev.: 0.0040) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.96% (1.5835 => 1.5050, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.12% (0.9957 => 0.9547, std.dev.: 0.0124) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.73% (1.3677 => 1.3167, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.68% (3.2827 => 3.1619, std.dev.: 0.0073) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4959, std.dev.: 0.0071) MultiSource/Applications/hexxagon/hexxagon: -3.01% (12.4730 => 12.0975, std.dev.: 0.0013) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -2.08% (10.2830 => 10.0694, std.dev.: 0.0211) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.07% (8.1563 => 7.9876, std.dev.: 0.0169) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.01% (8.6802 => 8.5057, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6825, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5141, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4209, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8580, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.20% (0.5229 => 0.5867, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 7.97% (14.9895 => 16.1848, std.dev.: 0.0175) MultiSource/Benchmarks/MallocBench/gs/gs: 6.65% (4.1105 => 4.3838, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.66% (1.1048 => 1.2447, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.16% (7.1582 => 7.7422, std.dev.: 0.0153) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.55% (0.6222 => 0.7376, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36100.00% (0.0001 => 0.0362, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.04% (0.2116 => 0.2138, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 5 19:41:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 21:41:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121006024106.305512A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4627?compare_to=4623&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4627, Order: 165347, Start Time: 2012-10-06 01:28:14, End Time: 2012-10-06 02:42:49 To: 4623, Order: 165339, Start Time: 2012-10-05 23:44:38, End Time: 2012-10-06 00:59:14 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (181 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1041 (756 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.53% (1.2957 => 1.3155, std.dev.: 0.0059) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 22.31% (2.0176 => 2.4678, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.80% (0.1410 => 0.1661, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 16.22% (0.0826 => 0.0960, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.90% (0.0819 => 0.0941, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 14.76% (0.2243 => 0.2574, std.dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.43% (0.1072 => 0.1216, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.59% (0.0834 => 0.0939, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 12.39% (1.3693 => 1.5389, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: 12.26% (0.7061 => 0.7927, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 12.24% (0.1013 => 0.1137, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 12.19% (0.5818 => 0.6527, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 12.18% (0.4328 => 0.4855, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.10% (0.1413 => 0.1584, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 12.06% (0.5748 => 0.6441, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 11.89% (0.4062 => 0.4545, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.69% (0.2721 => 0.3039, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 11.68% (0.7038 => 0.7860, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 11.65% (0.2781 => 0.3105, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.59% (0.1588 => 0.1772, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.45% (3.9660 => 4.4203, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.38% (0.1327 => 0.1478, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.32% (0.2782 => 0.3097, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.31% (0.0964 => 0.1073, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.17% (0.2596 => 0.2886, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.13% (0.3899 => 0.4333, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.09% (0.3022 => 0.3357, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.04% (0.7710 => 0.8561, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.98% (1.2193 => 1.3532, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 10.97% (0.2607 => 0.2893, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.96% (0.3485 => 0.3867, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.93% (0.6283 => 0.6970, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 10.92% (0.1062 => 0.1178) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.90% (1.4563 => 1.6151, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.89% (0.9199 => 1.0201, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.86% (0.3489 => 0.3868, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/except: 10.80% (0.2760 => 0.3058, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 10.79% (0.2937 => 0.3254, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 10.78% (0.2690 => 0.2980, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.77% (0.4390 => 0.4863, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 10.73% (0.2628 => 0.2910, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.73% (0.3756 => 0.4159, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.71% (1.9828 => 2.1952, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.71% (0.4016 => 0.4446, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 10.67% (0.2726 => 0.3017, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 10.66% (0.3293 => 0.3644, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.63% (0.6959 => 0.7699, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.62% (0.2966 => 0.3281, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.58% (0.2655 => 0.2936, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.58% (0.5265 => 0.5822, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 10.58% (0.2761 => 0.3053, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.56% (0.2765 => 0.3057, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.47% (0.3580 => 0.3955, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.46% (1.1364 => 1.2553, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 10.46% (0.3107 => 0.3432, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 10.44% (0.3868 => 0.4272, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 10.43% (0.3453 => 0.3813, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 10.38% (0.3149 => 0.3476, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.35% (0.2696 => 0.2975, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 10.25% (13.8202 => 15.2363, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/ary2: 10.24% (0.3192 => 0.3519, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 10.14% (0.2988 => 0.3291, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/lists1: 10.02% (0.3534 => 0.3888, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.94% (0.1157 => 0.1272, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 9.82% (0.2995 => 0.3289, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 9.75% (1.0313 => 1.1319, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.75% (0.4791 => 0.5258, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.65% (0.3130 => 0.3432, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 9.57% (0.1589 => 0.1741, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.56% (0.1276 => 0.1398, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.52% (0.5577 => 0.6108, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 9.49% (16.6129 => 18.1898, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.49% (0.1075 => 0.1177, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.45% (0.4379 => 0.4793, std.dev.: 0.0021) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.41% (0.1435 => 0.1570, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 9.41% (0.2945 => 0.3222, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.33% (0.2914 => 0.3186, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.28% (0.6576 => 0.7186, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.26% (0.1986 => 0.2170, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.22% (0.8698 => 0.9500, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 9.20% (1.1061 => 1.2079, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.17% (0.2127 => 0.2322, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: 9.05% (0.8310 => 0.9062, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.05% (0.5637 => 0.6147, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 9.00% (0.6744 => 0.7351, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.00% (0.3246 => 0.3538, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 8.94% (0.7506 => 0.8177, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.93% (0.7460 => 0.8126, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.81% (0.3755 => 0.4086, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 8.80% (3.8646 => 4.2046, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: 8.79% (0.3220 => 0.3503, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.60% (0.3511 => 0.3813, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.60% (7.2180 => 7.8386, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 8.58% (1.9270 => 2.0924, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.53% (0.1865 => 0.2024, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 8.51% (3.1889 => 3.4603, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.50% (0.2023 => 0.2195, std.dev.: 0.0048) MultiSource/Benchmarks/nbench/nbench: 8.41% (1.0594 => 1.1485, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 8.34% (2.1791 => 2.3608, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 8.21% (0.3131 => 0.3388, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 8.14% (0.2925 => 0.3163, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 8.12% (0.1478 => 0.1598, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.09% (0.1569 => 0.1696, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 8.03% (0.1657 => 0.1790, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 8.02% (4.6629 => 5.0369, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.02% (0.8818 => 0.9525, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 8.01% (1.2749 => 1.3770, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.96% (3.6692 => 3.9614, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.92% (0.1819 => 0.1963, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.88% (0.1789 => 0.1930, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.85% (1.3245 => 1.4285, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 7.81% (14.8535 => 16.0143, std.dev.: 0.0050) MultiSource/Benchmarks/mafft/pairlocalalign: 7.68% (8.4961 => 9.1489, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.67% (4.4433 => 4.7841, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.66% (0.2140 => 0.2304, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.64% (0.6135 => 0.6604, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/parameter-passing: 7.62% (0.4003 => 0.4308, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.61% (4.3801 => 4.7135, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/property: 7.54% (0.3940 => 0.4237, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 7.53% (1.2292 => 1.3217, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 7.49% (0.4113 => 0.4421, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions: 7.46% (0.3914 => 0.4206, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.44% (4.9865 => 5.3577, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 7.36% (0.6250 => 0.6710, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 7.29% (0.3578 => 0.3839, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.21% (0.3789 => 0.4062, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.18% (0.3663 => 0.3926, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.18% (0.3650 => 0.3912, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 7.18% (0.3623 => 0.3883, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.16% (0.3601 => 0.3859, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.16% (0.3646 => 0.3907, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.14% (0.9108 => 0.9758, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.99% (1.5188 => 1.6250, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.98% (3.2742 => 3.5028, std.dev.: 0.0198) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.95% (0.2504 => 0.2678, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 6.72% (0.2008 => 0.2143, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.68% (0.4805 => 0.5126, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.68% (1.1333 => 1.2090, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 6.42% (6.5754 => 6.9973, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.16% (0.3245 => 0.3445, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.07% (0.2321 => 0.2462, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.05% (6.2785 => 6.6584, std.dev.: 0.0084) MultiSource/Applications/lua/lua: 6.00% (3.7467 => 3.9714, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.86% (2.1007 => 2.2238, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.27% (13.2842 => 13.9845, std.dev.: 0.0080) MultiSource/Applications/sqlite3/sqlite3: 3.73% (16.2614 => 16.8675, std.dev.: 0.0057) MultiSource/Applications/ClamAV/clamscan: 3.46% (14.5298 => 15.0328, std.dev.: 0.0252) MultiSource/Benchmarks/Bullet/bullet: 1.23% (33.2944 => 33.7025, std.dev.: 0.0221) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.48% (5.7573 => 7.5122, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fbench: 26.46% (1.8175 => 2.2985, std.dev.: 0.0304) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 10.98% (1.1560 => 1.2829, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.76% (2.8813 => 3.1914, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 8.99% (0.8273 => 0.9017, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4139, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.29% (1.2998 => 1.3816, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.63% (1.9144 => 2.0031, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.49% (0.3139 => 0.3280, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7758, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.66% (11.2619 => 11.6746, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 3.29% (10.7476 => 11.1017, std.dev.: 0.0351) SingleSource/Benchmarks/Misc/flops-6: 3.27% (1.9199 => 1.9826, std.dev.: 0.0020) SingleSource/Regression/C/uint64_to_float: 2.97% (0.5449 => 0.5611, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.22% (7.4271 => 7.5921, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: 1.65% (1.4298 => 1.4534, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.53% (2.0200 => 2.0509, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5136, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1873, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9670, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.16% (5.5130 => 5.5771, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0273, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5860, std.dev.: 0.0085) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.08% (0.2670 => 0.1413, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.78% (0.4657 => 0.3922, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -15.42% (0.0707 => 0.0598, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.92% (1.3819 => 1.1896, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.84% (1.3813 => 1.1901, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.29% (22.5627 => 21.8206, std.dev.: 0.0173) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.64% (0.0997 => 0.0861, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.15% (0.2238 => 0.1966, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.65% (1.2308 => 1.0874, std.dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.17% (20.3410 => 18.2719, std.dev.: 0.0433) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0124) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.11% (2.6470 => 2.5117, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.54% (1.3780 => 1.3155, std.dev.: 0.0059) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.26% (0.9996 => 0.9570, std.dev.: 0.0017) MultiSource/Applications/siod/siod: -3.50% (3.2729 => 3.1583, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.40% (1.7688 => 1.7086, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.49% (3.0263 => 2.9509, std.dev.: 0.0032) MultiSource/Applications/lua/lua: -2.44% (26.5159 => 25.8696, std.dev.: 0.0092) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.28% (1.9762 => 1.9312, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.02% (0.6589 => 0.6456, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7141, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/lists: -1.73% (6.3560 => 6.2460, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0082, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -1.31% (4.5928 => 4.5325, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/heapsort: -1.23% (3.9173 => 3.8693, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4949, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2579, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 5 19:59:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 21:59:52 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121006025952.4D0012A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4628?compare_to=4624&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4628, Order: 165350, Start Time: 2012-10-06 01:38:19, End Time: 2012-10-06 03:01:37 To: 4624, Order: 165343, Start Time: 2012-10-05 23:58:38, End Time: 2012-10-06 01:21:56 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (14 on baseline) Performance Regressions: 9 (92 on baseline) Performance Improvements: 16 (41 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 952 (758 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.81% (0.6093 => 0.6203, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 1.40% (3.9590 => 4.0143, std.dev.: 0.0120) MultiSource/Applications/Burg/burg: 1.27% (1.1846 => 1.1996, std.dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 10.16% (3.0505 => 3.3605, std.dev.: 0.0256) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 3.07% (1.8083 => 1.8639, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/tsp/tsp: 3.06% (1.7534 => 1.8070, std.dev.: 0.0090) SingleSource/Benchmarks/McGill/chomp: 1.29% (1.0066 => 1.0196, std.dev.: 0.0036) MultiSource/Benchmarks/Fhourstones/fhourstones: 1.16% (1.2708 => 1.2856, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 1.01% (2.9319 => 2.9615, std.dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -2.45% (16.7853 => 16.3737, std.dev.: 0.0477) MultiSource/Applications/oggenc/oggenc: -2.23% (5.0814 => 4.9679, std.dev.: 0.0356) MultiSource/Applications/lambda-0_1_3/lambda: -1.75% (0.7446 => 0.7316, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: -1.50% (0.6750 => 0.6649, std.dev.: 0.0024) MultiSource/Applications/lemon/lemon: -1.38% (1.0893 => 1.0743, std.dev.: 0.0046) MultiSource/Applications/SIBsim4/SIBsim4: -1.24% (1.2648 => 1.2491, std.dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: -1.12% (0.9730 => 0.9621, std.dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: -13.35% (0.1626 => 0.1409, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -7.30% (7.0072 => 6.4957, std.dev.: 0.1616) MultiSource/Applications/minisat/minisat: -5.08% (6.5082 => 6.1778, std.dev.: 0.0742) MultiSource/Benchmarks/Olden/bisort/bisort: -4.60% (0.6806 => 0.6493, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.84% (2.6116 => 2.5636, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -1.74% (4.9441 => 4.8579, std.dev.: 0.0110) MultiSource/Applications/lua/lua: -1.38% (29.9716 => 29.5569, std.dev.: 0.0802) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.37% (39.7623 => 39.2174, std.dev.: 0.1415) MultiSource/Benchmarks/llubenchmark/llu: -1.31% (2.0243 => 1.9977, std.dev.: 0.0098) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.12% (1.0289 => 1.0301, std.dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: -2.14% (0.6248 => 0.6114, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/08-main/main: 3.81% (0.1757 => 0.1824, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.00% (0.1597 => 0.1581, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.57% (0.3167 => 0.3149, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.96% (0.2402 => 0.2425, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.09% (0.3235 => 0.3232, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.38% (0.2355 => 0.2346, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel: -1.51% (0.0464 => 0.0457, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.41% (0.0244 => 0.0243, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 25.16% (0.0155 => 0.0194, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.51% (0.0391 => 0.0393, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.33% (0.0304 => 0.0305, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.35% (0.0286 => 0.0287, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.30% (0.0329 => 0.0328, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 2.31% (0.0173 => 0.0177, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0196 => 0.0196, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -1.54% (0.0259 => 0.0255, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 0.60% (0.0331 => 0.0333, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.56% (0.1430 => 0.1422, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 9.93% (1.4136 => 1.5540, std.dev.: 0.0214) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.34% (0.1464 => 0.1469, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.64% (0.4047 => 0.4073, std.dev.: 0.0237) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.71% (0.1403 => 0.1379, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.41% (0.0567 => 0.0559, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 14.59% (0.0185 => 0.0212, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.91% (0.0585 => 0.0643, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.29% (1.1295 => 1.1262, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 15.38% (0.0013 => 0.0015, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -58.33% (0.0012 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.23% (0.0581 => 0.0539, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.35% (0.0245 => 0.0178, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.04% (0.7648 => 0.7651, std.dev.: 0.0083) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.02% (1.7065 => 1.7069, std.dev.: 0.0057) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 142.70% (0.0089 => 0.0216, std.dev.: 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: 175.56% (0.0090 => 0.0248, std.dev.: 0.0003) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -27.11% (4.1772 => 3.0446, std.dev.: 0.0485) SingleSource/Benchmarks/Shootout-C++/except: 82316.67% (0.0006 => 0.4945, std.dev.: 0.0047) SingleSource/Regression/C++/EH/ctor_dtor_count: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.42% (0.0745 => 0.0912, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 9.62% (2.1763 => 2.3857, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.23% (0.1159 => 0.1266, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.20% (0.6410 => 0.7000, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 9.04% (0.5309 => 0.5789, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.71% (0.3582 => 0.3894, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 7.71% (0.6173 => 0.6649, std.dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 7.19% (1.1653 => 1.2491, std.dev.: 0.0031) MultiSource/Applications/kimwitu++/kc: 6.94% (15.3105 => 16.3737, std.dev.: 0.0477) MultiSource/Applications/lemon/lemon: 6.94% (1.0046 => 1.0743, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.94% (0.2552 => 0.2729, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.15% (0.6069 => 0.6442, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.97% (0.2797 => 0.2964, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.93% (0.7639 => 0.8092, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.81% (0.4248 => 0.4495, std.dev.: 0.0078) MultiSource/Applications/lambda-0_1_3/lambda: 5.80% (0.6915 => 0.7316, std.dev.: 0.0020) MultiSource/Applications/d/make_dparser: 5.47% (3.0225 => 3.1877, std.dev.: 0.0272) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.45% (0.3062 => 0.3229, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.37% (1.5150 => 1.5964, std.dev.: 0.0100) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.30% (1.1672 => 1.2291, std.dev.: 0.0032) MultiSource/Applications/sgefa/sgefa: 5.21% (0.2877 => 0.3027, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.15% (0.3901 => 0.4102, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 5.12% (0.1971 => 0.2072, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.08% (0.2106 => 0.2213, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.06% (0.8569 => 0.9003, std.dev.: 0.0131) MultiSource/Applications/Burg/burg: 4.86% (1.1440 => 1.1996, std.dev.: 0.0049) MultiSource/Benchmarks/Bullet/bullet: 4.75% (29.3170 => 30.7082, std.dev.: 0.2489) MultiSource/Applications/hbd/hbd: 4.73% (1.3268 => 1.3895, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.69% (1.2021 => 1.2585, std.dev.: 0.0056) MultiSource/Applications/oggenc/oggenc: 4.69% (4.7455 => 4.9679, std.dev.: 0.0356) MultiSource/Applications/SPASS/SPASS: 4.67% (13.3238 => 13.9461, std.dev.: 0.0812) MultiSource/Benchmarks/McCat/18-imp/imp: 4.66% (0.3217 => 0.3367, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.57% (0.4880 => 0.5103, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.46% (3.0758 => 3.2129, std.dev.: 0.0163) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.42% (6.2546 => 6.5310, std.dev.: 0.0247) MultiSource/Applications/siod/siod: 4.36% (2.0972 => 2.1886, std.dev.: 0.0228) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.30% (0.2654 => 0.2768, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 4.29% (1.8798 => 1.9605, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.22% (2.0317 => 2.1175, std.dev.: 0.0218) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.08% (1.4408 => 1.4996, std.dev.: 0.0124) MultiSource/Applications/lua/lua: 4.06% (3.5980 => 3.7442, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.02% (0.5963 => 0.6203, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 4.00% (8.2186 => 8.5477, std.dev.: 0.0841) MultiSource/Benchmarks/sim/sim: 3.86% (0.3084 => 0.3203, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists1: 3.83% (0.2771 => 0.2877, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.61% (1.0821 => 1.1212, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.61% (1.1827 => 1.2254, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/football/football: 3.53% (0.8405 => 0.8702, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash: 3.49% (0.3520 => 0.3643, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/gs/gs: 3.47% (3.8796 => 4.0143, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.30% (0.5636 => 0.5822, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.29% (12.6413 => 13.0574, std.dev.: 0.0751) MultiSource/Applications/JM/lencod/lencod: 3.17% (14.7256 => 15.1917, std.dev.: 0.1023) MultiSource/Applications/JM/ldecod/ldecod: 2.93% (6.4908 => 6.6812, std.dev.: 0.0379) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.66% (4.2616 => 4.3750, std.dev.: 0.0160) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.51% (1.0689 => 1.0957, std.dev.: 0.0071) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.48% (4.3380 => 4.4456, std.dev.: 0.0323) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.30% (0.4562 => 0.4667, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.21% (1.3935 => 1.4243, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.17% (1.2742 => 1.3018, std.dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: 2.08% (0.9425 => 0.9621, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.05% (4.0318 => 4.1146, std.dev.: 0.0311) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.70% (8.2559 => 8.3963, std.dev.: 0.0394) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 44.49% (0.0263 => 0.0380, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/pi: 41.38% (1.6538 => 2.3381, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 22.13% (3.4629 => 4.2292, std.dev.: 0.0159) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.41% (0.0766 => 0.0907, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/ary3: 14.87% (1.7426 => 2.0017, std.dev.: 0.0257) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.41% (4.0101 => 4.5479, std.dev.: 0.0489) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.03% (2.4042 => 2.7175, std.dev.: 0.0478) SingleSource/Benchmarks/McGill/queens: 11.11% (1.6261 => 1.8067, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.28% (0.2857 => 0.3122, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/mason/mason: 9.27% (0.5004 => 0.5468, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.71% (1.0063 => 1.0939, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout/lists: 8.61% (7.0025 => 7.6052, std.dev.: 0.0359) SingleSource/Benchmarks/Stanford/Puzzle: 8.58% (0.1433 => 0.1556, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.88% (0.3301 => 0.3495, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: 4.50% (3.2159 => 3.3605, std.dev.: 0.0256) MultiSource/Benchmarks/Olden/tsp/tsp: 4.27% (1.7330 => 1.8070, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/fp-convert: 3.96% (15.2242 => 15.8266, std.dev.: 0.0550) SingleSource/Benchmarks/Misc/dt: 3.95% (0.9851 => 1.0240, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.90% (3.4080 => 3.5410, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.75% (0.8498 => 0.8817, std.dev.: 0.0047) MultiSource/Benchmarks/Bullet/bullet: 3.56% (6.9722 => 7.2206, std.dev.: 0.0585) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.54% (0.5587 => 0.5785, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 3.22% (3.5520 => 3.6663, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.89% (6.6312 => 6.8227, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.59% (2.6656 => 2.7347, std.dev.: 0.0247) MultiSource/Benchmarks/Olden/power/power: 1.37% (1.4184 => 1.4378, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ffbench: 1.25% (1.4117 => 1.4294, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 1.13% (4.6414 => 4.6938, std.dev.: 0.0192) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.05% (2.4455 => 2.4712, std.dev.: 0.0088) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.33% (0.0591 => 0.0329, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -43.62% (0.2996 => 0.1689, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.66% (1.4113 => 1.1339, std.dev.: 0.0176) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.35% (1.4189 => 1.1443, std.dev.: 0.0085) SingleSource/UnitTests/Vector/constpool: -4.17% (8.9977 => 8.6225, std.dev.: 0.1044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.18% (0.3497 => 0.2127, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.34% (5.2665 => 4.1428, std.dev.: 0.0592) SingleSource/Benchmarks/Shootout-C++/ary3: -20.15% (1.7473 => 1.3952, std.dev.: 0.0412) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.14% (1.7361 => 1.4733, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1589, std.dev.: 0.0106) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.50% (1.1647 => 1.0541, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: -8.37% (9.5474 => 8.7485, std.dev.: 0.0279) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.32% (1.4034 => 1.2867, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.47% (3.2007 => 2.9615, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.91% (3.6254 => 3.3749, std.dev.: 0.0098) MultiSource/Applications/lambda-0_1_3/lambda: -6.72% (7.6833 => 7.1667, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/fibo: -6.51% (4.6355 => 4.3337, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: -6.24% (1.4441 => 1.3540, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.04% (2.9728 => 2.7931, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.45% (3.9413 => 3.7264, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/fib2: -5.32% (4.4195 => 4.1846, std.dev.: 0.0137) MultiSource/Benchmarks/Olden/bh/bh: -5.09% (2.5166 => 2.3884, std.dev.: 0.0105) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.84% (0.4564 => 0.4343, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -4.15% (62.4126 => 59.8240, std.dev.: 0.0963) MultiSource/Applications/sgefa/sgefa: -4.03% (0.3746 => 0.3595, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: -3.34% (9.2503 => 8.9417, std.dev.: 0.0752) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.26% (3.7496 => 3.6274, std.dev.: 0.0319) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.25% (1.2722 => 1.2309, std.dev.: 0.0114) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.12% (1.1683 => 1.1318, std.dev.: 0.0066) SingleSource/Benchmarks/McGill/misr: -2.84% (0.4296 => 0.4174, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.73% (0.4140 => 0.4027, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: -2.09% (92.7467 => 90.8042, std.dev.: 0.2558) SingleSource/Benchmarks/Shootout-C++/hash2: -1.96% (3.4876 => 3.4191, std.dev.: 0.0140) MultiSource/Applications/aha/aha: -1.90% (3.4286 => 3.3633, std.dev.: 0.0105) MultiSource/Benchmarks/FreeBench/neural/neural: -1.89% (1.0926 => 1.0719, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.73% (2.3569 => 2.3161, std.dev.: 0.0097) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.60% (9.3855 => 9.2351, std.dev.: 0.0341) MultiSource/Benchmarks/sim/sim: -1.59% (3.8907 => 3.8288, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3136, std.dev.: 0.1062) SingleSource/Benchmarks/Shootout-C++/lists: -1.26% (16.5617 => 16.3534, std.dev.: 0.0495) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 3.22% (0.9980 => 1.0301, std.dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: 1.53% (0.6022 => 0.6114, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/08-main/main: 9.48% (0.1666 => 0.1824, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.74% (0.1554 => 0.1581, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.14% (0.3083 => 0.3149, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (0.2394 => 0.2425, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.80% (0.3175 => 0.3232, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.91% (0.2302 => 0.2346, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel: 1.78% (0.0449 => 0.0457, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.25% (0.0240 => 0.0243, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.04% (0.0192 => 0.0194, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.77% (0.0390 => 0.0393, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.33% (0.0301 => 0.0305, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.06% (0.0284 => 0.0287, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.23% (0.0324 => 0.0328, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0177 => 0.0177, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 3.70% (0.0189 => 0.0196, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: 2.41% (0.0249 => 0.0255, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 2.46% (0.0325 => 0.0333, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.49% (0.1429 => 0.1422, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 3.47% (1.5019 => 1.5540, std.dev.: 0.0214) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -2.13% (0.1501 => 0.1469, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.48% (0.4264 => 0.4073, std.dev.: 0.0237) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.60% (0.1344 => 0.1379, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.09% (0.0589 => 0.0559, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -8.62% (0.0232 => 0.0212, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.63% (0.0639 => 0.0643, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.78% (1.1350 => 1.1262, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 150.00% (0.0006 => 0.0015, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -15.38% (0.0637 => 0.0539, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.64% (0.0246 => 0.0178, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.46% (0.7541 => 0.7651, std.dev.: 0.0083) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.10% (1.5363 => 1.7069, std.dev.: 0.0057) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: -40.00% (0.0005 => 0.0003, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 5 21:14:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 23:14:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121006041417.2B1482A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4629?compare_to=4626&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4629, Order: 165358, Start Time: 2012-10-06 02:56:45, End Time: 2012-10-06 04:16:00 To: 4626, Order: 165347, Start Time: 2012-10-06 01:08:23, End Time: 2012-10-06 02:27:38 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 3 (154 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1022 (763 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.40% (14.8310 => 15.1871, std.dev.: 0.0070) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.85% (78.3601 => 80.5909, std.dev.: 0.1762) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.01% (1.5015 => 1.5166, std.dev.: 0.0029) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.05% (0.5867 => 0.5870, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 0.16% (16.1848 => 16.2115, std.dev.: 0.0126) MultiSource/Benchmarks/Bullet/bullet: 0.45% (54.6902 => 54.9348, std.dev.: 0.0117) MultiSource/Benchmarks/MallocBench/gs/gs: 0.16% (4.3838 => 4.3907, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.12% (1.2447 => 1.2462, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.29% (7.7422 => 7.7644, std.dev.: 0.0145) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.27% (0.7376 => 0.7396, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0362 => 0.0362, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.42% (0.2138 => 0.2147, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -13.14% (63.2438 => 54.9348, std.dev.: 0.0117) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.64% (14.1553 => 18.7758, std.dev.: 0.0198) SingleSource/Benchmarks/Misc-C++-EH/spirit: 60.85% (3.4629 => 5.5701, std.dev.: 0.0055) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14225.28% (0.0720 => 10.3142, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9951700.00% (0.0001 => 9.9518, std.dev.: 0.0013) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 49.22% (0.2554 => 0.3811, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 46.49% (10.3673 => 15.1871, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/richards_benchmark: 31.32% (0.1622 => 0.2130, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 30.87% (0.1056 => 0.1382, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.07% (7.0540 => 8.1167, std.dev.: 0.0194) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.88% (2.2022 => 2.5299, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 14.53% (0.1432 => 0.1640, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.43% (0.1566 => 0.1792, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.38% (1.7609 => 1.9789, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.17% (0.0871 => 0.0977, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.04% (0.3543 => 0.3934, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.86% (0.1584 => 0.1756, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 10.79% (0.3282 => 0.3636, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.77% (0.3473 => 0.3847, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.61% (0.3543 => 0.3919, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-2: 10.44% (0.3497 => 0.3862, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.38% (0.3516 => 0.3881, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.36% (0.3561 => 0.3930, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.26% (0.3694 => 0.4073, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/power/power: 10.14% (0.1440 => 0.1586, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.13% (0.3927 => 0.4325, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.06% (0.3828 => 0.4213, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.96% (0.3886 => 0.4273, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 9.19% (0.7433 => 0.8116, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.12% (0.6675 => 0.7284, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.11% (0.5925 => 0.6465, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 9.06% (0.1655 => 0.1805, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 8.98% (0.7115 => 0.7754, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.94% (0.4879 => 0.5315, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.92% (0.1143 => 0.1245, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 8.91% (9.4845 => 10.3294, std.dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.83% (0.1438 => 0.1565, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.78% (0.3177 => 0.3456, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 8.78% (10.4361 => 11.3524, std.dev.: 0.0117) MultiSource/Applications/sgefa/sgefa: 8.75% (0.3109 => 0.3381, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.73% (0.4615 => 0.5018, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 8.72% (0.6030 => 0.6556, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.71% (1.5415 => 1.6758, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.62% (0.1625 => 0.1765, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 8.41% (0.3423 => 0.3711, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.29% (0.5105 => 0.5528, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 8.26% (0.1695 => 0.1835, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 8.23% (3.3354 => 3.6100, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.19% (0.2271 => 0.2457, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.19% (0.7326 => 0.7926, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.19% (0.8172 => 0.8841, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.13% (1.3050 => 1.4111, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.09% (0.5860 => 0.6334, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 8.07% (5.7591 => 6.2240, std.dev.: 0.0107) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.05% (4.2646 => 4.6078, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.04% (0.2700 => 0.2917, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.99% (0.2065 => 0.2230, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.95% (0.1510 => 0.1630, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.86% (0.3307 => 0.3567, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.83% (0.2107 => 0.2272, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.82% (0.4103 => 0.4424, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.81% (0.5569 => 0.6004, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.78% (0.9765 => 1.0525, std.dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.75% (0.5020 => 0.5409, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.75% (0.8067 => 0.8692, std.dev.: 0.0023) SingleSource/Regression/C++/ofstream_ctor: 7.75% (0.2905 => 0.3130, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 7.74% (0.6456 => 0.6956, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.72% (0.3121 => 0.3362, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/lists: 7.71% (0.3422 => 0.3686, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.71% (0.4203 => 0.4527, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.68% (1.1642 => 1.2536, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/hash: 7.67% (0.4289 => 0.4618, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.61% (5.0018 => 5.3826, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.61% (8.1363 => 8.7552, std.dev.: 0.0047) MultiSource/Applications/hbd/hbd: 7.59% (1.5603 => 1.6787, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.58% (0.1940 => 0.2087, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 7.56% (0.7835 => 0.8427, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.55% (0.3865 => 0.4157, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.54% (0.2758 => 0.2966, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.52% (4.9449 => 5.3170, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.42% (0.4636 => 0.4980, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 7.38% (0.3603 => 0.3869, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 7.38% (0.2831 => 0.3040, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.37% (0.2891 => 0.3104, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 7.36% (0.4048 => 0.4346, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 7.35% (0.3387 => 0.3636, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.34% (0.3650 => 0.3918, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 7.19% (3.8723 => 4.1508, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary3: 7.19% (0.3283 => 0.3519, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash2: 7.14% (0.4620 => 0.4950, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.13% (7.9617 => 8.5290, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.12% (0.3162 => 0.3387, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.11% (0.3136 => 0.3359, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 7.11% (0.3052 => 0.3269, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 7.07% (0.1555 => 0.1665, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.07% (0.2872 => 0.3075, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.07% (2.0665 => 2.2125, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists1: 7.03% (0.3684 => 0.3943, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.02% (0.3232 => 0.3459, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.00% (0.3826 => 0.4094, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 7.00% (1.0722 => 1.1473, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 7.00% (0.2871 => 0.3072, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.97% (0.3441 => 0.3681, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.97% (0.3098 => 0.3314, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 6.93% (2.0273 => 2.1678, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.93% (0.2756 => 0.2947, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.92% (0.2802 => 0.2996, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.86% (0.2725 => 0.2912, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.76% (1.5859 => 1.6931, std.dev.: 0.0071) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.72% (0.2603 => 0.2778, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.70% (0.2793 => 0.2980, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.67% (0.2877 => 0.3069, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.67% (0.2714 => 0.2895, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.64% (1.1861 => 1.2649, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/09-vor/vor: 6.64% (0.3180 => 0.3391, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.39% (0.6450 => 0.6862, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 6.34% (2.2969 => 2.4425, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary2: 6.27% (0.3379 => 0.3591) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.27% (0.5981 => 0.6356, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 6.25% (21.9371 => 23.3075, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/football/football: 6.10% (0.8921 => 0.9465, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/05-eks/eks: 6.07% (0.4299 => 0.4560, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.88% (2.2024 => 2.3318, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.68% (0.4064 => 0.4295, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.42% (1.4186 => 1.4955, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.40% (0.1906 => 0.2009, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 5.21% (1.1840 => 1.2457, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.98% (0.3131 => 0.3287) MultiSource/Applications/hexxagon/hexxagon: 4.91% (1.2842 => 1.3472, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.90% (0.2266 => 0.2377, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.49% (0.8101 => 0.8465, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.71% (14.3668 => 14.8994, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.38% (0.3427 => 0.3543, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 3.24% (17.1811 => 17.7376, std.dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.85% (3.8922 => 4.0031, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.83% (0.3817 => 0.3925, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.38% (1.1194 => 1.1460, std.dev.: 0.0100) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8962, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.26% (1.1145 => 1.3849, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.38% (0.2944 => 0.3279, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2173, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.84% (1.1396 => 1.2517, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4499, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3690, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 3.68% (0.5413 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.65% (3.6395 => 3.7725, std.dev.: 0.0059) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.66% (4.2280 => 4.3405, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.34% (1.7254 => 1.7657, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8132, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.36% (0.9540 => 0.9670, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.28% (2.6546 => 2.6886, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5767, std.dev.: 0.0102) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1290) SingleSource/Benchmarks/Misc/salsa20: -80.04% (0.8651 => 0.1727, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.31% (5.2763 => 3.2547, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.64% (5.3855 => 3.6276, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.19% (5.3526 => 3.6297, std.dev.: 0.0020) SingleSource/UnitTests/Vector/constpool: -14.48% (54.1659 => 46.3251, std.dev.: 0.0299) MultiSource/Benchmarks/FreeBench/mason/mason: -13.19% (0.0811 => 0.0704, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -11.06% (22.1758 => 19.7234, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.87% (2.9384 => 2.6189, std.dev.: 0.0136) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: -16.03% (1.6925 => 1.4212, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.63% (0.0998 => 0.0862, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.11% (1.2373 => 1.0998, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/mandel-2: -10.53% (1.5373 => 1.3754, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/mason/mason: -10.13% (0.2161 => 0.1942, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.34% (19.9488 => 18.2860, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.68% (1.8329 => 1.7105, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5753, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.34% (1.6805 => 1.5907, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-5: -5.06% (1.5835 => 1.5034, std.dev.: 0.0041) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.75% (0.9957 => 0.9584, std.dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.74% (1.3677 => 1.3166, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.68% (3.2827 => 3.1618, std.dev.: 0.0054) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5013, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: -2.99% (12.4730 => 12.1005, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.16% (8.6802 => 8.4931, std.dev.: 0.0265) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.04% (8.1563 => 7.9897, std.dev.: 0.0217) SingleSource/Benchmarks/Misc/salsa20: -1.84% (10.2830 => 10.0935, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6813, std.dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -1.54% (2.5528 => 2.5135, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4200, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout/lists: -1.07% (6.2999 => 6.2324, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8592, std.dev.: 0.0062) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.26% (0.5229 => 0.5870, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 8.15% (14.9895 => 16.2115, std.dev.: 0.0126) MultiSource/Benchmarks/MallocBench/gs/gs: 6.82% (4.1105 => 4.3907, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.80% (1.1048 => 1.2462, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.47% (7.1582 => 7.7644, std.dev.: 0.0145) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.87% (0.6222 => 0.7396, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36100.00% (0.0001 => 0.0362, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.47% (0.2116 => 0.2147, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 5 21:24:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 23:24:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121006042448.40A5E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4630?compare_to=4627&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4630, Order: 165358, Start Time: 2012-10-06 03:12:00, End Time: 2012-10-06 04:26:32 To: 4627, Order: 165347, Start Time: 2012-10-06 01:28:14, End Time: 2012-10-06 02:42:49 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (180 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1042 (757 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 22.17% (2.0176 => 2.4649, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.52% (0.1410 => 0.1657, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 15.50% (0.0826 => 0.0954, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 14.40% (0.2243 => 0.2566, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.71% (0.0834 => 0.0940, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 12.37% (1.3693 => 1.5387, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 12.14% (0.1013 => 0.1136, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 12.08% (0.4328 => 0.4851, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.96% (0.1413 => 0.1582, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.65% (0.1588 => 0.1773, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 11.64% (0.5818 => 0.6495, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.62% (0.0964 => 0.1076, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 11.61% (0.2781 => 0.3104, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 11.55% (0.4062 => 0.4531, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 11.53% (0.5748 => 0.6411, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 11.39% (0.7061 => 0.7865, std.dev.: 0.0023) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.38% (0.1072 => 0.1194, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.36% (0.2782 => 0.3098, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.36% (3.9660 => 4.4164, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.36% (0.2721 => 0.3030, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 11.34% (0.7038 => 0.7836, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.01% (1.2193 => 1.3536, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.01% (0.9199 => 1.0212, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.00% (0.1327 => 0.1473, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.94% (0.2596 => 0.2880, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.93% (0.6283 => 0.6970, std.dev.: 0.0129) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.93% (0.3485 => 0.3866, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.87% (0.3899 => 0.4323, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 10.83% (0.1062 => 0.1177, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/except: 10.80% (0.2760 => 0.3058, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 10.79% (0.2726 => 0.3020, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 10.78% (0.2690 => 0.2980, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 10.78% (0.2607 => 0.2888, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.72% (0.3022 => 0.3346, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.70% (1.4563 => 1.6121, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.63% (1.9828 => 2.1936, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.62% (0.2966 => 0.3281, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/fibo: 10.62% (0.2628 => 0.2907, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.61% (0.4016 => 0.4442, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.60% (0.2765 => 0.3058, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.58% (0.3489 => 0.3858, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 10.57% (0.3293 => 0.3641, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 10.55% (0.2937 => 0.3247, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.55% (0.2655 => 0.2935, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.54% (0.7710 => 0.8523, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/methcall: 10.47% (0.2761 => 0.3050, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 10.45% (0.3149 => 0.3478, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.44% (0.3756 => 0.4148, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 10.40% (0.3107 => 0.3430, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.35% (0.5265 => 0.5810, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 10.34% (0.3453 => 0.3810, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.34% (0.3580 => 0.3950, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 10.32% (0.3868 => 0.4267, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.24% (0.2696 => 0.2972, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.23% (0.6959 => 0.7671, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary2: 10.21% (0.3192 => 0.3518, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.21% (1.1364 => 1.2524, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 10.17% (0.2988 => 0.3292, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 10.05% (13.8202 => 15.2097, std.dev.: 0.0019) MultiSource/Applications/sgefa/sgefa: 9.98% (0.2995 => 0.3294, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/lists1: 9.96% (0.3534 => 0.3886, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.83% (0.4791 => 0.5262, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.82% (0.4390 => 0.4821, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: 9.63% (0.1589 => 0.1742, std.dev.: 0.0051) MultiSource/Applications/lemon/lemon: 9.60% (1.0313 => 1.1303, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.59% (0.1157 => 0.1268, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.55% (0.3130 => 0.3429, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.50% (0.4379 => 0.4795, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.49% (0.1075 => 0.1177, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.41% (0.5577 => 0.6102, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.40% (0.1276 => 0.1396, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.34% (0.1435 => 0.1569, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.32% (0.1986 => 0.2171, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.27% (0.2914 => 0.3184, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.20% (0.8698 => 0.9498, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/objinst: 9.17% (0.2945 => 0.3215, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.17% (0.2127 => 0.2322, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 9.11% (0.8310 => 0.9067, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 9.04% (1.1061 => 1.2061, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 9.04% (16.6129 => 18.1147, std.dev.: 0.0244) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.01% (0.5637 => 0.6145, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.93% (0.3246 => 0.3536, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 8.81% (0.6744 => 0.7338, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.81% (0.7460 => 0.8117, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 8.79% (0.3220 => 0.3503, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.71% (0.3755 => 0.4082, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 8.70% (3.8646 => 4.2010, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.53% (7.2180 => 7.8334, std.dev.: 0.0074) MultiSource/Applications/spiff/spiff: 8.51% (0.7506 => 0.8145, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.40% (0.2023 => 0.2193, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 8.36% (3.1889 => 3.4554, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 8.33% (1.0594 => 1.1476, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.31% (0.8818 => 0.9551, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 8.26% (1.9270 => 2.0861, std.dev.: 0.0036) MultiSource/Applications/siod/siod: 8.16% (2.1791 => 2.3569, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.15% (0.1865 => 0.2017, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/05-eks/eks: 8.12% (0.4113 => 0.4447, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 8.07% (0.2925 => 0.3161, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 8.05% (0.1478 => 0.1597, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.04% (3.6692 => 3.9642, std.dev.: 0.0043) MultiSource/Applications/SIBsim4/SIBsim4: 7.98% (1.2749 => 1.3767, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.97% (0.1569 => 0.1694, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.93% (1.3245 => 1.4295, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 7.92% (0.3131 => 0.3379, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 7.91% (0.1657 => 0.1788, std.dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 7.86% (14.8535 => 16.0205, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6576 => 0.7091, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.81% (4.3801 => 4.7223, std.dev.: 0.0095) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.79% (0.6135 => 0.6613, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 7.78% (4.6629 => 5.0256, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.75% (4.4433 => 4.7877, std.dev.: 0.0053) MultiSource/Benchmarks/mafft/pairlocalalign: 7.72% (8.4961 => 9.1523, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.71% (0.1789 => 0.1927, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.69% (0.3511 => 0.3781, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 7.39% (1.2292 => 1.3200, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.34% (0.2140 => 0.2297, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 7.14% (0.6250 => 0.6696, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.13% (0.9108 => 0.9757, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.10% (3.2742 => 3.5068, std.dev.: 0.0233) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.03% (0.2504 => 0.2680, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.92% (4.9865 => 5.3316, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.81% (0.4805 => 0.5132, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.76% (1.1333 => 1.2099, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.74% (1.5188 => 1.6212, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 6.57% (0.2008 => 0.2140, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 6.47% (0.4003 => 0.4262, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.43% (0.1819 => 0.1936, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 6.42% (6.5754 => 6.9973, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.32% (0.3245 => 0.3450, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 6.29% (0.3914 => 0.4160, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 6.27% (0.3940 => 0.4187, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.18% (0.3789 => 0.4023, std.dev.: 0.0073) SingleSource/UnitTests/ObjC/trivial-interface: 6.12% (0.3578 => 0.3797, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.01% (0.3646 => 0.3865, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 6.00% (0.3601 => 0.3817, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.00% (6.2785 => 6.6551, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/synchronized: 5.98% (0.3663 => 0.3882, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.95% (0.2321 => 0.2459, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.92% (0.3650 => 0.3866, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 5.88% (0.3623 => 0.3836, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 5.85% (3.7467 => 3.9659, std.dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.85% (2.1007 => 2.2235, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.23% (13.2842 => 13.9796, std.dev.: 0.0189) MultiSource/Applications/sqlite3/sqlite3: 3.69% (16.2614 => 16.8615, std.dev.: 0.0198) MultiSource/Applications/ClamAV/clamscan: 3.36% (14.5298 => 15.0185, std.dev.: 0.0134) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5162, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.74% (1.8175 => 2.2672, std.dev.: 0.0141) SingleSource/Benchmarks/Misc/richards_benchmark: 11.16% (1.1560 => 1.2850, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.03% (0.8273 => 0.9020, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4144, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.32% (1.2998 => 1.3820, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0039, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.67% (11.2619 => 11.6754, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.55% (10.7476 => 11.1290, std.dev.: 0.0353) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9850, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.09% (7.4271 => 7.5822, std.dev.: 0.0039) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4532, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5128, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2068, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1871, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.20% (5.5130 => 5.5790, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/em3d/em3d: 1.12% (3.1071 => 3.1418, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0274, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5868, std.dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.04% (8.8259 => 8.9175, std.dev.: 0.0166) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.23% (0.2670 => 0.1409, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.77% (0.4657 => 0.3876, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -15.70% (0.0707 => 0.0596, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.85% (1.3813 => 1.1900, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.66% (1.3819 => 1.1932, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.59% (22.5627 => 21.7523, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.04% (0.0997 => 0.0857, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -12.20% (0.2238 => 0.1965, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -11.64% (1.2308 => 1.0875, std.dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.10% (20.3410 => 18.2866, std.dev.: 0.0142) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2639, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.14% (1.3780 => 1.3072, std.dev.: 0.0075) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5149, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.29% (0.9996 => 0.9567, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1560, std.dev.: 0.0103) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.48% (1.7688 => 1.7073, std.dev.: 0.0163) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.02% (0.4867 => 0.4720, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.62% (26.5159 => 25.8216, std.dev.: 0.0351) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784) MultiSource/Applications/spiff/spiff: -2.43% (3.0263 => 2.9528, std.dev.: 0.0022) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.27% (1.9762 => 1.9313, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.99% (0.6589 => 0.6458, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.78% (28.2225 => 27.7191, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.77% (6.3560 => 6.2436, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0067, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.45% (3.9173 => 3.8606, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: -1.27% (4.5928 => 4.5347, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.16% (2.5254 => 2.4960, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2572, std.dev.: 0.0019) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 5 21:44:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 23:44:52 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121006044452.280662A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4631?compare_to=4628&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4631, Order: 165358, Start Time: 2012-10-06 03:17:35, End Time: 2012-10-06 04:40:26 To: 4628, Order: 165350, Start Time: 2012-10-06 01:38:19, End Time: 2012-10-06 03:01:37 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (14 on baseline) Performance Regressions: 13 (100 on baseline) Performance Improvements: 0 (44 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 964 (747 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.14% (0.7611 => 0.8078, std.dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.04% (0.3098 => 0.3285, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.74% (0.2997 => 0.3169, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.39% (0.5769 => 0.6022, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.49% (0.4618 => 0.4779, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.99% (0.7793 => 0.8026, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.77% (0.5560 => 0.5714, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.60% (0.9165 => 0.9403, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.38% (0.7356 => 0.7531, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.11% (4.3524 => 4.4007, std.dev.: 0.0165) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.28% (12.8788 => 14.5894, std.dev.: 0.3066) SingleSource/Benchmarks/Misc/whetstone: 2.67% (2.3516 => 2.4144, std.dev.: 0.0136) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.60% (1.6013 => 1.6269, std.dev.: 0.0026) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.67% (1.0301 => 1.0232, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: 1.29% (0.6114 => 0.6193, std.dev.: 0.0092) MultiSource/Benchmarks/McCat/08-main/main: -0.22% (0.1824 => 0.1820, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.42% (0.1581 => 0.1527, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.54% (0.3149 => 0.3132, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.45% (0.2425 => 0.2414, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.79% (0.3232 => 0.3174, std.dev.: 0.0170) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.34% (0.2346 => 0.2354, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: 0.66% (0.0457 => 0.0460, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.41% (0.0243 => 0.0244, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.03% (0.0194 => 0.0196, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.51% (0.0393 => 0.0391, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -18.36% (0.0305 => 0.0249, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0287 => 0.0287, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.91% (0.0328 => 0.0325, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 2.26% (0.0177 => 0.0181, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -0.51% (0.0196 => 0.0195, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: - (0.0255 => 0.0255, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -12.01% (0.0333 => 0.0293, std.dev.: 0.0018) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 100.00% (0.0005 => 0.0010) MultiSource/Applications/ClamAV/clamscan: 0.28% (0.1422 => 0.1426, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: -2.75% (1.5540 => 1.5112, std.dev.: 0.0418) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 6.19% (0.1469 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.76% (0.4073 => 0.4104, std.dev.: 0.0260) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.18% (0.1379 => 0.1349, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.59% (0.0559 => 0.0607, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.19% (0.0212 => 0.0201, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.11% (0.0643 => 0.0663, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.28% (1.1262 => 1.1294, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -66.67% (0.0015 => 0.0005, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 380.00% (0.0005 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.02% (0.0539 => 0.0593, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 11.24% (0.0178 => 0.0198, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.09% (0.7651 => 0.7658, std.dev.: 0.0077) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.33% (1.7069 => 1.7013, std.dev.: 0.0028) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: 66.67% (0.0003 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 147.19% (0.0089 => 0.0220, std.dev.: 0.0004) SingleSource/UnitTests/2003-08-11-VaListArg: 176.67% (0.0090 => 0.0249, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -27.64% (4.1772 => 3.0226, std.dev.: 0.0328) SingleSource/Benchmarks/Shootout-C++/except: 83366.67% (0.0006 => 0.5008, std.dev.: 0.0032) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: -50.00% (0.0004 => 0.0002, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 24.03% (0.0745 => 0.0924, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.35% (0.1159 => 0.1279, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.73% (0.6410 => 0.7034, std.dev.: 0.0124) SingleSource/Benchmarks/Misc-C++/bigfib: 8.83% (0.5309 => 0.5778, std.dev.: 0.0078) MultiSource/Benchmarks/PAQ8p/paq8p: 8.53% (2.1763 => 2.3619, std.dev.: 0.0202) MultiSource/Applications/minisat/minisat: 7.61% (0.6173 => 0.6643, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.48% (0.3582 => 0.3850, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.13% (0.2552 => 0.2734, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 6.62% (1.0046 => 1.0711, std.dev.: 0.0181) MultiSource/Applications/SIBsim4/SIBsim4: 6.58% (1.1653 => 1.2420, std.dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.43% (0.4248 => 0.4521, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.28% (1.5150 => 1.6101, std.dev.: 0.0052) MultiSource/Applications/kimwitu++/kc: 6.22% (15.3105 => 16.2630, std.dev.: 0.1154) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.83% (0.6069 => 0.6423, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.76% (0.7639 => 0.8079, std.dev.: 0.0043) MultiSource/Applications/lambda-0_1_3/lambda: 5.51% (0.6915 => 0.7296, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.41% (0.2106 => 0.2220, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.35% (0.3008 => 0.3169, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.13% (1.1672 => 1.2271, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.08% (0.3901 => 0.4099, std.dev.: 0.0023) MultiSource/Applications/Burg/burg: 5.00% (1.1440 => 1.2012, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 4.95% (3.0225 => 3.1720, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/lists: 4.94% (0.2347 => 0.2463, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.91% (0.5740 => 0.6022, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.64% (1.1827 => 1.2376, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 4.48% (29.3170 => 30.6310, std.dev.: 0.2169) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.47% (0.3062 => 0.3199, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.47% (0.2886 => 0.3015, std.dev.: 0.0023) MultiSource/Applications/sgefa/sgefa: 4.41% (0.2877 => 0.3004, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.41% (0.4880 => 0.5095, std.dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.36% (6.2546 => 6.5274, std.dev.: 0.0199) MultiSource/Applications/SPASS/SPASS: 4.31% (13.3238 => 13.8978, std.dev.: 0.0555) MultiSource/Benchmarks/McCat/09-vor/vor: 4.23% (0.3026 => 0.3154, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.22% (0.7226 => 0.7531, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.22% (0.2654 => 0.2766, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 4.17% (4.7455 => 4.9435, std.dev.: 0.0687) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.14% (0.9029 => 0.9403, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 4.10% (1.8798 => 1.9569, std.dev.: 0.0063) MultiSource/Applications/siod/siod: 4.04% (2.0972 => 2.1820, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.98% (0.4596 => 0.4779, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 3.97% (3.5980 => 3.7410, std.dev.: 0.0133) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.94% (0.8569 => 0.8907, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.83% (1.4408 => 1.4960, std.dev.: 0.0182) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.77% (3.0758 => 3.1917, std.dev.: 0.0077) MultiSource/Applications/hbd/hbd: 3.68% (1.3268 => 1.3756, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.68% (1.2021 => 1.2463, std.dev.: 0.0127) MultiSource/Benchmarks/mafft/pairlocalalign: 3.63% (8.2186 => 8.5168, std.dev.: 0.0588) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.53% (0.5636 => 0.5835, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.51% (0.5520 => 0.5714, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 3.47% (0.3084 => 0.3191, std.dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 3.39% (1.0821 => 1.1188, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash: 3.32% (0.3520 => 0.3637, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 3.32% (0.8405 => 0.8684, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.27% (2.0317 => 2.0982, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/moments: 3.19% (0.3412 => 0.3521, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.19% (0.5963 => 0.6153, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.11% (0.7784 => 0.8026, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/hash2: 3.09% (0.3847 => 0.3966, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.05% (0.4562 => 0.4701, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.98% (1.2742 => 1.3122, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.89% (4.3380 => 4.4632, std.dev.: 0.0134) MultiSource/Benchmarks/MallocBench/gs/gs: 2.82% (3.8796 => 3.9889, std.dev.: 0.0213) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.78% (4.2815 => 4.4007, std.dev.: 0.0165) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.78% (12.6413 => 12.9922, std.dev.: 0.0713) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.74% (4.0318 => 4.1421, std.dev.: 0.0322) MultiSource/Applications/JM/ldecod/ldecod: 2.65% (6.4908 => 6.6626, std.dev.: 0.0619) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.63% (4.2616 => 4.3738, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.54% (0.5937 => 0.6088, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.42% (8.2559 => 8.4554, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.27% (1.3935 => 1.4251, std.dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.25% (1.0689 => 1.0930, std.dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 55.94% (0.0261 => 0.0407, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Bubblesort: 49.05% (0.0263 => 0.0392, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/pi: 41.35% (1.6538 => 2.3377, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2278, std.dev.: 0.0290) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 16.36% (0.0917 => 0.1067, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.32% (0.0766 => 0.0891, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/ary3: 14.99% (1.7426 => 2.0039, std.dev.: 0.0173) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.48% (2.4042 => 2.7283, std.dev.: 0.0328) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.32% (4.0101 => 4.5441, std.dev.: 0.0330) SingleSource/Benchmarks/McGill/queens: 11.11% (1.6261 => 1.8068, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/mason/mason: 10.21% (0.5004 => 0.5515, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout/lists: 9.02% (7.0025 => 7.6341, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.68% (0.2857 => 0.3105, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Puzzle: 7.82% (0.1433 => 0.1545, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.94% (0.3301 => 0.3497, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/dt: 4.16% (0.9851 => 1.0261, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: 4.14% (15.2242 => 15.8550, std.dev.: 0.0307) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.83% (3.4080 => 3.5384, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 3.30% (3.5520 => 3.6693, std.dev.: 0.0110) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.17% (0.5587 => 0.5764, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 2.98% (6.9722 => 7.1802, std.dev.: 0.0127) SingleSource/Benchmarks/Misc/whetstone: 2.95% (2.3453 => 2.4144, std.dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.81% (6.6312 => 6.8177, std.dev.: 0.0199) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.42% (2.6656 => 2.7302, std.dev.: 0.0213) SingleSource/Benchmarks/Shootout-C++/hash: 2.19% (0.6308 => 0.6446, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.66% (4.6127 => 4.6893, std.dev.: 0.0295) MultiSource/Benchmarks/Olden/power/power: 1.42% (1.4184 => 1.4385, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: 1.04% (7.4740 => 7.5516, std.dev.: 0.0092) MultiSource/Benchmarks/Olden/em3d/em3d: 1.01% (4.6414 => 4.6885, std.dev.: 0.0110) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -43.49% (0.2996 => 0.1693, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -43.15% (0.0591 => 0.0336, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.66% (1.4189 => 1.1541, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.01% (1.4113 => 1.1571, std.dev.: 0.0112) SingleSource/UnitTests/Vector/constpool: -5.00% (8.9977 => 8.5479, std.dev.: 0.1618) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.21% (0.3497 => 0.2126, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.54% (5.2665 => 4.0795, std.dev.: 0.0510) SingleSource/Benchmarks/Shootout-C++/ary3: -19.90% (1.7473 => 1.3995, std.dev.: 0.0291) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.22% (1.7361 => 1.4719, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1582, std.dev.: 0.0168) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.60% (1.1647 => 1.0529, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: -8.32% (9.5474 => 8.7534, std.dev.: 0.0131) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.29% (1.4034 => 1.2871, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.03% (3.2007 => 2.9438, std.dev.: 0.0096) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.84% (15.8312 => 14.5894, std.dev.: 0.3066) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.92% (3.6254 => 3.3746, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/fibo: -6.67% (4.6355 => 4.3263, std.dev.: 0.0223) MultiSource/Applications/lambda-0_1_3/lambda: -6.67% (7.6833 => 7.1711, std.dev.: 0.0925) SingleSource/Benchmarks/Misc/richards_benchmark: -6.39% (1.4441 => 1.3518, std.dev.: 0.0102) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.00% (2.9728 => 2.7944, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.46% (3.9413 => 3.7263, std.dev.: 0.0353) SingleSource/Benchmarks/Shootout/fib2: -5.29% (4.4195 => 4.1859, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/bh/bh: -4.99% (2.5166 => 2.3911, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.69% (0.4564 => 0.4350, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -4.28% (62.4126 => 59.7416, std.dev.: 0.0264) SingleSource/Benchmarks/McGill/misr: -4.07% (0.4296 => 0.4121, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -4.02% (2.3580 => 2.2631, std.dev.: 0.0286) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.23% (1.1683 => 1.1306, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/methcall: -2.60% (9.2503 => 9.0097, std.dev.: 0.0142) SingleSource/Benchmarks/Dhrystone/dry: -2.55% (2.4013 => 2.3401, std.dev.: 0.0159) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.41% (2.4457 => 2.3867, std.dev.: 0.0194) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.39% (3.7496 => 3.6601, std.dev.: 0.0172) MultiSource/Benchmarks/PAQ8p/paq8p: -2.36% (92.7467 => 90.5580, std.dev.: 0.4316) MultiSource/Applications/aha/aha: -1.87% (3.4286 => 3.3645, std.dev.: 0.0139) MultiSource/Benchmarks/sim/sim: -1.74% (3.8907 => 3.8229, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.72% (2.3569 => 2.3163, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.71% (9.3855 => 9.2253, std.dev.: 0.0133) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -1.57% (1.0926 => 1.0754, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -1.45% (3.4876 => 3.4371, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.42% (1.8739 => 1.8472, std.dev.: 0.0077) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3089, std.dev.: 0.0123) SingleSource/Benchmarks/Dhrystone/fldry: -1.39% (2.4971 => 2.4625, std.dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.26% (27.1724 => 26.8293, std.dev.: 0.0290) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.53% (0.9980 => 1.0232, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: 2.84% (0.6022 => 0.6193, std.dev.: 0.0092) MultiSource/Benchmarks/McCat/08-main/main: 9.24% (0.1666 => 0.1820, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.74% (0.1554 => 0.1527, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.59% (0.3083 => 0.3132, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.84% (0.2394 => 0.2414, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.03% (0.3175 => 0.3174, std.dev.: 0.0170) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.26% (0.2302 => 0.2354, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: 2.45% (0.0449 => 0.0460, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.67% (0.0240 => 0.0244, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 2.08% (0.0192 => 0.0196, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.26% (0.0390 => 0.0391, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -17.28% (0.0301 => 0.0249, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.06% (0.0284 => 0.0287, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.31% (0.0324 => 0.0325, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 2.26% (0.0177 => 0.0181, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 3.17% (0.0189 => 0.0195, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: 2.41% (0.0249 => 0.0255, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -9.85% (0.0325 => 0.0293, std.dev.: 0.0018) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010) MultiSource/Applications/ClamAV/clamscan: -0.21% (0.1429 => 0.1426, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 0.62% (1.5019 => 1.5112, std.dev.: 0.0418) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 3.93% (0.1501 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.75% (0.4264 => 0.4104, std.dev.: 0.0260) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.37% (0.1344 => 0.1349, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.06% (0.0589 => 0.0607, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -13.36% (0.0232 => 0.0201, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.76% (0.0639 => 0.0663, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.49% (1.1350 => 1.1294, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -16.67% (0.0006 => 0.0005, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.91% (0.0637 => 0.0593, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.51% (0.0246 => 0.0198, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.55% (0.7541 => 0.7658, std.dev.: 0.0077) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 10.74% (1.5363 => 1.7013, std.dev.: 0.0028) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 5 21:49:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 5 Oct 2012 23:49:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121006044956.8EA5B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4632?compare_to=4625&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4632, Order: 165355, Start Time: 2012-10-06 02:08:09, End Time: 2012-10-06 04:51:40 To: 4625, Order: 165336, Start Time: 2012-10-05 22:28:55, End Time: 2012-10-06 01:39:07 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Passes: 3 (0 on baseline) Performance Regressions: 0 (134 on baseline) Performance Improvements: 1 (17 on baseline) Removed Tests: 69 (0 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 969 (829 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -4.88% (131.7185 => 125.2957, std.dev.: 1.4724) Removed Tests - Compile Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Removed Tests - Execution Time ------------------------------ MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 12.01% (0.3488 => 0.3907, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 11.98% (0.3465 => 0.3880, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 11.96% (0.3446 => 0.3858, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/trivial-interface: 11.94% (0.3442 => 0.3853, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.84% (0.3496 => 0.3910, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 11.79% (0.3460 => 0.3868, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.76% (0.3469 => 0.3877, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.58% (0.3643 => 0.4065, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/property: 11.51% (0.3650 => 0.4070, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.49% (0.3724 => 0.4152, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 10.86% (1.5932 => 1.7663, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.25% (0.1063 => 0.1172, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 10.09% (0.5826 => 0.6414, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference-object: 9.92% (0.5889 => 0.6473, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.77% (0.2875 => 0.3127, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.64% (0.3195 => 0.3471, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.52% (0.2792 => 0.3030, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 8.52% (0.3004 => 0.3260, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.52% (0.7171 => 0.7782, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 8.51% (0.2714 => 0.2945, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 8.40% (0.2725 => 0.2954, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.40% (0.2738 => 0.2968, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 8.35% (0.2780 => 0.3012, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 8.34% (0.1619 => 0.1754, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 8.29% (0.1218 => 0.1319, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 8.28% (0.2813 => 0.3046, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.28% (0.2729 => 0.2955, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.28% (0.2911 => 0.3152, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 8.28% (0.2803 => 0.3035, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 8.27% (0.3096 => 0.3352, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 8.25% (0.2811 => 0.3043, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 8.18% (0.2823 => 0.3054, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 8.18% (0.2750 => 0.2975, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 8.17% (0.9909 => 1.0719, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.17% (2.0673 => 2.2362, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.02% (1.3152 => 1.4207, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/moments: 7.99% (0.3678 => 0.3972, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.90% (0.3267 => 0.3525, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.88% (0.3060 => 0.3301, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ary: 7.86% (0.3258 => 0.3514, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 7.84% (0.3317 => 0.3577, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 7.79% (0.3477 => 0.3748, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 7.73% (0.3726 => 0.4014, std.dev.: 0.0081) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.68% (1.6211 => 1.7456, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 7.68% (0.3348 => 0.3605, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.65% (0.3845 => 0.4139, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.64% (0.3362 => 0.3619, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.61% (0.3625 => 0.3901, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.61% (0.4361 => 0.4693, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.53% (0.3282 => 0.3529, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.51% (0.4994 => 0.5369, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.49% (0.3124 => 0.3358, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.35% (0.1620 => 0.1739, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.32% (0.5000 => 0.5366, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.31% (3.5627 => 3.8231, std.dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 7.28% (5.5417 => 5.9454, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/hash2: 7.27% (0.4251 => 0.4560, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.24% (0.4146 => 0.4446, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.21% (0.3981 => 0.4268, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.21% (0.3690 => 0.3956, std.dev.: 0.0086) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.15% (0.2014 => 0.2158, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 7.01% (0.4847 => 0.5187, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: 6.98% (1.0781 => 1.1533, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 6.96% (23.5202 => 25.1574, std.dev.: 0.0154) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.85% (2.7292 => 2.9162, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.76% (0.2736 => 0.2921, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.68% (0.6435 => 0.6865, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.67% (0.4139 => 0.4415, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.61% (0.2737 => 0.2918, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.56% (0.3930 => 0.4188, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.51% (0.5900 => 0.6284, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.49% (0.5026 => 0.5352, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 6.46% (0.5012 => 0.5336, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.43% (0.3903 => 0.4154, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.42% (0.3084 => 0.3282, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 6.42% (1.8794 => 2.0000, std.dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 6.41% (4.2109 => 4.4810, std.dev.: 0.0019) MultiSource/Applications/siod/siod: 6.39% (0.6634 => 0.7058, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.34% (4.4195 => 4.6995, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.33% (0.2068 => 0.2199, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.32% (0.3890 => 0.4136, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.28% (0.2866 => 0.3046, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 6.27% (0.2566 => 0.2727, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.12% (0.4658 => 0.4943, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.10% (0.1968 => 0.2088, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 6.09% (2.1013 => 2.2292, std.dev.: 0.0070) MultiSource/Applications/spiff/spiff: 5.93% (0.4029 => 0.4268, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.86% (0.2969 => 0.3143, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 5.83% (4.6177 => 4.8867, std.dev.: 0.0019) MultiSource/Applications/lua/lua: 5.81% (1.4269 => 1.5098, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: 5.81% (0.5546 => 0.5868, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.71% (0.2103 => 0.2223, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 5.67% (0.9697 => 1.0247, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 5.67% (2.1653 => 2.2881, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.64% (0.2040 => 0.2155, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 5.64% (0.3336 => 0.3524, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.47% (0.3271 => 0.3450, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 5.36% (0.7875 => 0.8297, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 5.30% (2.0346 => 2.1425, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.29% (1.9694 => 2.0735, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.10% (1.9966 => 2.0985, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 5.06% (0.2075 => 0.2180, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 4.85% (0.2391 => 0.2507, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 4.68% (0.2691 => 0.2817, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.55% (0.7426 => 0.7764, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.55% (0.5361 => 0.5605, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.30% (0.5584 => 0.5824, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.15% (11.6398 => 12.1232, std.dev.: 0.0245) MultiSource/Applications/lambda-0_1_3/lambda: 4.06% (0.3498 => 0.3640, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.02% (4.6926 => 4.8812, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.48% (0.4253 => 0.4401, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 2.94% (11.9555 => 12.3067, std.dev.: 0.0087) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.82% (0.3792 => 0.3899, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 8.01% (0.2122 => 0.2292, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6115, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (12.0509 => 12.6784, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-2: 4.90% (1.8057 => 1.8942, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1663, std.dev.: 0.0578) SingleSource/Benchmarks/Dhrystone/dry: 4.29% (14.0481 => 14.6508, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/ary3: 2.10% (15.8721 => 16.2050, std.dev.: 0.0042) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5018, std.dev.: 0.0071) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.66% (3.1722 => 3.2247, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2837, std.dev.: 0.0038) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5137, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5840, std.dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.00% (25.4195 => 16.5233, std.dev.: 0.0347) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9772, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7973, std.dev.: 0.0111) MultiSource/Benchmarks/Olden/tsp/tsp: -7.32% (2.1113 => 1.9567, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -5.91% (0.2402 => 0.2260, std.dev.: 0.0013) SingleSource/UnitTests/Vector/build2: -3.75% (11.2080 => 10.7876, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7725, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5190, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -2.88% (17.2379 => 16.7420, std.dev.: 0.0465) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.25% (41.7953 => 40.8540, std.dev.: 0.0125) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.10% (0.6293 => 0.6161, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5727, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4997, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.17% (105.3826 => 104.1523, std.dev.: 0.0149) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0441, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 5 23:56:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 6 Oct 2012 01:56:03 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121006065603.A23E52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4633?compare_to=4631&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4633, Order: 165360, Start Time: 2012-10-06 05:35:10, End Time: 2012-10-06 06:57:47 To: 4631, Order: 165358, Start Time: 2012-10-06 03:17:35, End Time: 2012-10-06 04:40:26 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (14 on baseline) Performance Regressions: 4 (92 on baseline) Performance Improvements: 4 (42 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 969 (757 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 20.78% (0.0486 => 0.0587, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 6.98% (0.7562 => 0.8090, std.dev.: 0.0047) MultiSource/Applications/SPASS/SPASS: 3.39% (8.3734 => 8.6570, std.dev.: 0.1098) SingleSource/Benchmarks/Misc/mandel-2: 1.13% (3.0226 => 3.0569, std.dev.: 0.0129) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -8.66% (6.9954 => 6.3895, std.dev.: 0.2000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.12% (5.0439 => 4.8361, std.dev.: 0.0532) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.68% (1.4129 => 1.3609, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -1.08% (5.2098 => 5.1536, std.dev.: 0.0090) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.67% (1.0232 => 1.0301, std.dev.: 0.0106) MultiSource/Applications/sqlite3/sqlite3: -1.10% (0.6193 => 0.6125, std.dev.: 0.0111) MultiSource/Benchmarks/McCat/08-main/main: 0.77% (0.1820 => 0.1834, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.59% (0.1527 => 0.1518, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.70% (0.3132 => 0.3154, std.dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.12% (0.2414 => 0.2411, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.17% (0.3174 => 0.3243, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.10% (0.2354 => 0.2328, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: -0.65% (0.0460 => 0.0457, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.64% (0.0244 => 0.0248, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.53% (0.0196 => 0.0193, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.51% (0.0391 => 0.0389, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 20.88% (0.0249 => 0.0301, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.05% (0.0287 => 0.0284, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.77% (0.0325 => 0.0316, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: -0.55% (0.0181 => 0.0180, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -1.03% (0.0195 => 0.0193, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -1.96% (0.0255 => 0.0250, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: 12.63% (0.0293 => 0.0330, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.19% (0.1426 => 0.1443, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 0.24% (1.5112 => 1.5149, std.dev.: 0.0384) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1560 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.78% (0.4104 => 0.4259, std.dev.: 0.0234) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.37% (0.1349 => 0.1408, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.73% (0.0607 => 0.0554, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 27.36% (0.0201 => 0.0256, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.60% (0.0663 => 0.0659, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.04% (1.1294 => 1.1290, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 400.00% (0.0005 => 0.0025, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.38% (0.0593 => 0.0619, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -9.09% (0.0198 => 0.0180, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.08% (0.7658 => 0.7652, std.dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.31% (1.7013 => 1.7066, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 142.70% (0.0089 => 0.0216, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: 175.56% (0.0090 => 0.0248, std.dev.: 0.0002) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -26.82% (4.1772 => 3.0569, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/except: 82033.33% (0.0006 => 0.4928, std.dev.: 0.0109) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_throw: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/throw_rethrow_test: 50.00% (0.0004 => 0.0006, std.dev.: 0.0000) SingleSource/UnitTests/2003-05-07-VarArgs: 100.00% (0.0001 => 0.0002, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.82% (0.0745 => 0.0915, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.82% (0.1414 => 0.1567, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.84% (0.1159 => 0.1273, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.36% (0.6410 => 0.7010, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++/bigfib: 8.98% (0.5309 => 0.5786, std.dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: 8.91% (2.1763 => 2.3701, std.dev.: 0.0036) MultiSource/Applications/minisat/minisat: 8.28% (0.6173 => 0.6684, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.43% (0.3582 => 0.3848, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 7.03% (1.0046 => 1.0752, std.dev.: 0.0105) MultiSource/Applications/SIBsim4/SIBsim4: 6.59% (1.1653 => 1.2421, std.dev.: 0.0246) MultiSource/Applications/kimwitu++/kc: 6.39% (15.3105 => 16.2893, std.dev.: 0.2057) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.19% (0.7722 => 0.8200, std.dev.: 0.0093) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.02% (0.3008 => 0.3189, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.97% (1.5150 => 1.6055, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.90% (0.7639 => 0.8090, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/18-imp/imp: 5.75% (0.3217 => 0.3402, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.60% (0.6069 => 0.6409, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.16% (1.1672 => 1.2274, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.11% (0.2797 => 0.2940, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.04% (0.4248 => 0.4462, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.94% (0.2106 => 0.2210, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 4.79% (0.3026 => 0.3171, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (0.4880 => 0.5113, std.dev.: 0.0032) MultiSource/Applications/d/make_dparser: 4.72% (3.0225 => 3.1653, std.dev.: 0.0389) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.71% (0.2886 => 0.3022, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.66% (0.8569 => 0.8968, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.57% (0.3062 => 0.3202, std.dev.: 0.0029) MultiSource/Applications/lua/lua: 4.52% (3.5980 => 3.7606, std.dev.: 0.0181) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.31% (0.3901 => 0.4069, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/lists: 4.30% (0.2347 => 0.2448, std.dev.: 0.0034) MultiSource/Applications/oggenc/oggenc: 4.27% (4.7455 => 4.9479, std.dev.: 0.0290) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.21% (6.2546 => 6.5180, std.dev.: 0.0434) SingleSource/Benchmarks/Shootout-C++/hash2: 4.08% (0.3847 => 0.4004, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 4.03% (13.3238 => 13.8603, std.dev.: 0.1606) MultiSource/Applications/Burg/burg: 3.99% (1.1440 => 1.1896, std.dev.: 0.0119) MultiSource/Applications/siod/siod: 3.94% (2.0972 => 2.1799, std.dev.: 0.0225) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.92% (0.2806 => 0.2916, std.dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: 3.90% (29.3170 => 30.4599, std.dev.: 0.1589) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.89% (1.1827 => 1.2287, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.80% (0.3418 => 0.3548, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.79% (0.2952 => 0.3064, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.78% (1.4408 => 1.4952, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 3.76% (8.2186 => 8.5274, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.74% (1.2021 => 1.2470, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.70% (0.4596 => 0.4766, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.68% (0.5740 => 0.5951, std.dev.: 0.0076) MultiSource/Applications/treecc/treecc: 3.54% (1.8798 => 1.9464, std.dev.: 0.0178) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.46% (2.0317 => 2.1020, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash: 3.44% (0.3520 => 0.3641, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 3.37% (0.3084 => 0.3188, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.24% (4.2616 => 4.3995, std.dev.: 0.0226) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.22% (4.3380 => 4.4779, std.dev.: 0.0179) MultiSource/Benchmarks/nbench/nbench: 3.20% (1.0821 => 1.1167, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.15% (3.0758 => 3.1726, std.dev.: 0.0198) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.11% (0.5636 => 0.5811, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.04% (1.0689 => 1.1014, std.dev.: 0.0101) MultiSource/Benchmarks/MallocBench/gs/gs: 3.00% (3.8796 => 3.9961, std.dev.: 0.0392) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.94% (4.2815 => 4.4075, std.dev.: 0.0220) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.72% (0.5963 => 0.6125, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.66% (0.5937 => 0.6095, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.49% (4.0318 => 4.1321, std.dev.: 0.0308) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.33% (1.3935 => 1.4259, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 50.19% (0.0261 => 0.0392, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/pi: 41.43% (1.6538 => 2.3389, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2279, std.dev.: 0.0078) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 16.36% (0.0917 => 0.1067, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.27% (0.0766 => 0.0883, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/ary3: 14.54% (1.7426 => 1.9959, std.dev.: 0.0133) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.33% (2.4042 => 2.7248, std.dev.: 0.0631) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.14% (4.0101 => 4.5370, std.dev.: 0.0128) SingleSource/Benchmarks/McGill/queens: 11.11% (1.6261 => 1.8067, std.dev.: 0.0020) SingleSource/Benchmarks/Stanford/Puzzle: 10.47% (0.1433 => 0.1583, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/mason/mason: 10.19% (0.5004 => 0.5514, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.49% (0.2857 => 0.3128, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.78% (1.0063 => 1.0947, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/lists: 8.63% (7.0025 => 7.6071, std.dev.: 0.0570) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 6.32% (0.7609 => 0.8090, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.03% (0.3301 => 0.3500, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: 4.24% (15.2242 => 15.8698, std.dev.: 0.0360) SingleSource/Benchmarks/Misc/dt: 4.02% (0.9851 => 1.0247, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.88% (3.4080 => 3.5404, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 3.69% (3.5520 => 3.6830, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.55% (40.4792 => 41.9165, std.dev.: 0.4830) MultiSource/Benchmarks/Bullet/bullet: 3.21% (6.9722 => 7.1958, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/health/health: 2.98% (0.3420 => 0.3522, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.92% (0.5587 => 0.5750, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.79% (6.6312 => 6.8159, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.77% (0.5876 => 0.6039, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.12% (4.6127 => 4.7105, std.dev.: 0.0118) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.81% (2.6656 => 2.7138, std.dev.: 0.0160) MultiSource/Benchmarks/Olden/power/power: 1.50% (1.4184 => 1.4397, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.02% (2.4455 => 2.4705, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -43.79% (0.2996 => 0.1684, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -43.65% (0.0591 => 0.0333, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.48% (1.4113 => 1.1505, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.06% (1.4189 => 1.1627, std.dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.18% (0.3497 => 0.2127, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.11% (5.2665 => 4.1021, std.dev.: 0.0349) SingleSource/Benchmarks/Shootout-C++/ary3: -20.44% (1.7473 => 1.3902, std.dev.: 0.0235) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.10% (1.7361 => 1.4739, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1585, std.dev.: 0.0508) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -12.04% (15.8312 => 13.9246, std.dev.: 0.5176) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.47% (1.1647 => 1.0544, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.70% (3.2007 => 2.9221, std.dev.: 0.0151) SingleSource/Benchmarks/Misc/flops: -8.39% (9.5474 => 8.7460, std.dev.: 0.0092) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.28% (1.4034 => 1.2872, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.89% (3.6254 => 3.3756, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: -6.69% (7.6833 => 7.1694, std.dev.: 0.0338) SingleSource/Benchmarks/Shootout-C++/fibo: -6.51% (4.6355 => 4.3338, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/richards_benchmark: -6.33% (1.4441 => 1.3527, std.dev.: 0.0115) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.02% (2.9728 => 2.7938, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.42% (3.9413 => 3.7275, std.dev.: 0.0299) SingleSource/Benchmarks/Shootout/fib2: -5.28% (4.4195 => 4.1862, std.dev.: 0.0176) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.15% (0.4564 => 0.4329, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: -4.99% (2.5166 => 2.3911, std.dev.: 0.0074) MultiSource/Benchmarks/mafft/pairlocalalign: -4.25% (62.4126 => 59.7592, std.dev.: 0.0391) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.81% (1.1683 => 1.1238, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/methcall: -3.38% (9.2503 => 8.9374, std.dev.: 0.0447) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.14% (45.4683 => 44.0395, std.dev.: 0.4111) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.94% (1.4021 => 1.3609, std.dev.: 0.0102) SingleSource/Benchmarks/McGill/misr: -2.56% (0.4296 => 0.4186, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.45% (3.7496 => 3.6578, std.dev.: 0.0190) SingleSource/Benchmarks/Dhrystone/dry: -2.22% (2.4013 => 2.3480, std.dev.: 0.0084) MultiSource/Applications/SIBsim4/SIBsim4: -2.21% (3.4230 => 3.3474, std.dev.: 0.0130) MultiSource/Benchmarks/PAQ8p/paq8p: -1.87% (92.7467 => 91.0120, std.dev.: 0.2751) MultiSource/Benchmarks/sim/sim: -1.74% (3.8907 => 3.8229, std.dev.: 0.0254) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.63% (9.3855 => 9.2324, std.dev.: 0.0219) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.60% (1.0686 => 1.0515, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -1.59% (3.4876 => 3.4321, std.dev.: 0.0077) MultiSource/Benchmarks/FreeBench/neural/neural: -1.56% (1.0926 => 1.0756, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.50% (1.8739 => 1.8457, std.dev.: 0.0074) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.48% (2.4457 => 2.4096, std.dev.: 0.0130) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3068, std.dev.: 0.0617) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.34% (27.1724 => 26.8078, std.dev.: 0.0739) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 3.22% (0.9980 => 1.0301, std.dev.: 0.0106) MultiSource/Applications/sqlite3/sqlite3: 1.71% (0.6022 => 0.6125, std.dev.: 0.0111) MultiSource/Benchmarks/McCat/08-main/main: 10.08% (0.1666 => 0.1834, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.32% (0.1554 => 0.1518, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.30% (0.3083 => 0.3154, std.dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.71% (0.2394 => 0.2411, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.14% (0.3175 => 0.3243, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.13% (0.2302 => 0.2328, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: 1.78% (0.0449 => 0.0457, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 3.33% (0.0240 => 0.0248, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.52% (0.0192 => 0.0193, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.26% (0.0390 => 0.0389, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0301 => 0.0301, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0284 => 0.0284, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.47% (0.0324 => 0.0316, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 1.69% (0.0177 => 0.0180, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 2.12% (0.0189 => 0.0193, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0249 => 0.0250, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: 1.54% (0.0325 => 0.0330, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.98% (0.1429 => 0.1443, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 0.87% (1.5019 => 1.5149, std.dev.: 0.0384) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 3.93% (0.1501 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.12% (0.4264 => 0.4259, std.dev.: 0.0234) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.76% (0.1344 => 0.1408, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.94% (0.0589 => 0.0554, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 10.34% (0.0232 => 0.0256, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.13% (0.0639 => 0.0659, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.53% (1.1350 => 1.1290, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 316.67% (0.0006 => 0.0025, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.83% (0.0637 => 0.0619, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -26.83% (0.0246 => 0.0180, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.47% (0.7541 => 0.7652, std.dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.09% (1.5363 => 1.7066, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 6 00:03:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 6 Oct 2012 02:03:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121006070300.3C8E92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4634?compare_to=4630&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4634, Order: 165360, Start Time: 2012-10-06 05:48:22, End Time: 2012-10-06 07:04:43 To: 4630, Order: 165358, Start Time: 2012-10-06 03:12:00, End Time: 2012-10-06 04:26:32 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (178 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1041 (758 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.30% (1.3072 => 1.2902, std.dev.: 0.0056) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 22.15% (2.0176 => 2.4645, std.dev.: 0.0484) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.45% (0.1410 => 0.1656, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 15.50% (0.0826 => 0.0954, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 14.27% (0.2243 => 0.2563, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.59% (0.0834 => 0.0939, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 12.37% (1.3693 => 1.5387, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 12.27% (0.4328 => 0.4859, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 12.14% (0.1013 => 0.1136, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.96% (0.1413 => 0.1582, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 11.76% (0.2781 => 0.3108, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 11.69% (0.5748 => 0.6420, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 11.65% (0.5818 => 0.6496, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.52% (0.1588 => 0.1771, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 11.49% (0.7061 => 0.7872, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.43% (0.2721 => 0.3032, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 11.42% (0.4062 => 0.4526, std.dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.38% (0.1072 => 0.1194, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.32% (0.2782 => 0.3097, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.31% (3.9660 => 4.4146, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 11.31% (0.7038 => 0.7834, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.21% (0.7710 => 0.8574, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.10% (0.0964 => 0.1071, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.08% (0.1327 => 0.1474, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.05% (0.3485 => 0.3870, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.99% (1.4563 => 1.6164, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.99% (1.2193 => 1.3533, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.98% (0.2596 => 0.2881, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.89% (0.3022 => 0.3351, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.86% (0.9199 => 1.0198, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 10.83% (0.2760 => 0.3059, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 10.82% (0.2607 => 0.2889, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.81% (0.6283 => 0.6962, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/random: 10.78% (0.2690 => 0.2980, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 10.75% (0.2726 => 0.3019, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 10.69% (0.2628 => 0.2909, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.68% (0.3756 => 0.4157, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.67% (1.9828 => 2.1944, std.dev.: 0.0756) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.66% (0.4016 => 0.4444, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 10.66% (0.2937 => 0.3250, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 10.65% (0.2761 => 0.3055, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.62% (0.2655 => 0.2937, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.59% (0.2966 => 0.3280, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/ary3: 10.54% (0.3149 => 0.3481, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 10.54% (0.3293 => 0.3640, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.52% (0.2765 => 0.3056, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.49% (0.3489 => 0.3855, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/ary: 10.46% (0.3107 => 0.3432, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.46% (0.4390 => 0.4849, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 10.37% (0.3453 => 0.3811, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 10.36% (0.1062 => 0.1172, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.34% (0.3580 => 0.3950, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/moments: 10.32% (0.3868 => 0.4267, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.27% (0.6959 => 0.7674, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.26% (0.5265 => 0.5805, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.24% (1.1364 => 1.2528, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/matrix: 10.24% (0.2988 => 0.3294, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.16% (0.2696 => 0.2970, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 10.12% (0.3192 => 0.3515, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 10.01% (13.8202 => 15.2032, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/lists1: 9.90% (0.3534 => 0.3884, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 9.85% (0.2995 => 0.3290, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 9.82% (0.1589 => 0.1745, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.75% (0.4791 => 0.5258, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.59% (0.1157 => 0.1268, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.58% (0.1075 => 0.1178, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.56% (0.1276 => 0.1398, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 9.52% (1.0313 => 1.1295, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.45% (0.4379 => 0.4793, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.45% (0.5577 => 0.6104, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.39% (0.3130 => 0.3424, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.34% (0.1435 => 0.1569, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.30% (0.8698 => 0.9507, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.26% (0.1986 => 0.2170, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 9.20% (0.2945 => 0.3216, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.16% (0.2914 => 0.3181, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 9.00% (16.6129 => 18.1084, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.00% (0.3755 => 0.4093, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.98% (0.2127 => 0.2318, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.97% (0.7460 => 0.8129, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 8.97% (0.8310 => 0.9055, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 8.94% (0.7506 => 0.8177, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.91% (0.5637 => 0.6139, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 8.88% (0.3220 => 0.3506) MultiSource/Applications/minisat/minisat: 8.85% (0.6744 => 0.7341, std.dev.: 0.0028) MultiSource/Applications/Burg/burg: 8.84% (1.1061 => 1.2039, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.81% (0.3246 => 0.3532, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 8.62% (3.8646 => 4.1977, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.60% (7.2180 => 7.8386, std.dev.: 0.0084) MultiSource/Benchmarks/nbench/nbench: 8.38% (1.0594 => 1.1482, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.38% (0.8818 => 0.9557, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 8.35% (3.1889 => 3.4553, std.dev.: 0.0136) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.30% (0.2023 => 0.2191, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 8.26% (1.9270 => 2.0862, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.20% (0.1865 => 0.2018, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 8.14% (2.1791 => 2.3564, std.dev.: 0.0016) MultiSource/Applications/viterbi/viterbi: 8.12% (0.1478 => 0.1598, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 8.10% (0.2925 => 0.3162, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.04% (3.6692 => 3.9641, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.97% (0.6576 => 0.7100, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 7.93% (1.2749 => 1.3760, std.dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 7.92% (14.8535 => 16.0292, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.90% (0.1569 => 0.1693, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 7.89% (0.3131 => 0.3378, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.84% (4.3801 => 4.7236, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.83% (4.4433 => 4.7911, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/05-eks/eks: 7.80% (0.4113 => 0.4434, std.dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 7.79% (8.4961 => 9.1579, std.dev.: 0.2056) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.78% (1.3245 => 1.4275, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.76% (0.6135 => 0.6611, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 7.75% (4.6629 => 5.0245, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 7.66% (0.1657 => 0.1784, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.60% (0.3511 => 0.3778, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.60% (0.1789 => 0.1925, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.39% (1.2292 => 1.3200, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.38% (0.2140 => 0.2298, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 7.17% (0.6250 => 0.6698, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.15% (0.2504 => 0.2683, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.13% (0.9108 => 0.9757, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.94% (3.2742 => 3.5015, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.89% (4.9865 => 5.3302, std.dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.76% (0.4805 => 0.5130, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.68% (1.5188 => 1.6203, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.64% (1.1333 => 1.2086, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 6.57% (0.2008 => 0.2140, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.49% (0.1819 => 0.1937, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 6.42% (0.4003 => 0.4260, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 6.34% (6.5754 => 6.9921, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.32% (0.3245 => 0.3450, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 6.27% (0.3940 => 0.4187, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.26% (0.3914 => 0.4159, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 6.20% (0.3578 => 0.3800, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 6.12% (0.3789 => 0.4021, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.09% (0.3646 => 0.3868, std.dev.: 0.0033) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.05% (6.2785 => 6.6586, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-2: 6.00% (0.3601 => 0.3817, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 5.98% (0.3663 => 0.3882, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.95% (0.2321 => 0.2459, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.95% (0.3650 => 0.3867, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 5.88% (0.3623 => 0.3836, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 5.84% (3.7467 => 3.9656, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.72% (2.1007 => 2.2208, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.53% (13.2842 => 14.0183, std.dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: 3.88% (16.2614 => 16.8919, std.dev.: 0.0157) MultiSource/Applications/ClamAV/clamscan: 3.39% (14.5298 => 15.0224, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5193, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.09% (1.0895 => 1.3629, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 24.22% (1.8175 => 2.2577, std.dev.: 0.0507) SingleSource/Benchmarks/Misc/richards_benchmark: 11.16% (1.1560 => 1.2850, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.03% (0.8273 => 0.9020, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.70% (0.1322 => 0.1437, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4145, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.28% (1.2998 => 1.3814, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.65% (1.9144 => 2.0035, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6758, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 3.61% (10.7476 => 11.1360, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9853, std.dev.: 0.0023) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.22% (7.4271 => 7.5917, std.dev.: 0.0045) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4529, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5131, std.dev.: 0.0077) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.38% (1.9433 => 1.9701, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2123, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1859, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.17% (5.5130 => 5.5773, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0270, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 1.07% (12.4560 => 12.5889, std.dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.23% (0.2670 => 0.1409, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.77% (0.4657 => 0.3876, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -15.70% (0.0707 => 0.0596, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.85% (1.3819 => 1.1905, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.71% (1.3813 => 1.1919, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.59% (22.5627 => 21.7535, std.dev.: 0.2707) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.74% (0.0997 => 0.0860, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -12.15% (0.2238 => 0.1966, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.98% (1.2308 => 1.0957, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.12% (20.3410 => 18.2833, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.37% (1.3780 => 1.2902, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5147, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.33% (0.9996 => 0.9563, std.dev.: 0.0035) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1559, std.dev.: 0.0055) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.52% (1.7688 => 1.7066, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.96% (0.4867 => 0.4723, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.40% (26.5159 => 25.8801, std.dev.: 0.0112) MultiSource/Applications/spiff/spiff: -2.39% (3.0263 => 2.9540, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.28% (1.9762 => 1.9312, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.00% (0.6589 => 0.6457, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.79% (28.2225 => 27.7184, std.dev.: 0.1362) SingleSource/Benchmarks/Shootout/lists: -1.70% (6.3560 => 6.2482, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0063, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8626, std.dev.: 0.0062) MultiSource/Applications/sqlite3/sqlite3: -1.26% (4.5928 => 4.5348, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4951, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2576, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: -1.09% (9.3358 => 9.2344, std.dev.: 0.0165) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 6 00:08:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 6 Oct 2012 02:08:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121006070811.5EE6C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4635?compare_to=4629&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4635, Order: 165360, Start Time: 2012-10-06 05:48:29, End Time: 2012-10-06 07:09:54 To: 4629, Order: 165358, Start Time: 2012-10-06 02:56:45, End Time: 2012-10-06 04:16:00 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (129 on baseline) Performance Improvements: 1 (41 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1023 (789 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.62% (55.1455 => 56.5901, std.dev.: 0.0842) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -7.57% (0.4466 => 0.4128, std.dev.: 0.0129) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.20% (0.5870 => 0.5882, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: -0.09% (16.2115 => 16.1961, std.dev.: 0.0118) MultiSource/Benchmarks/Bullet/bullet: -0.05% (54.9348 => 54.9078, std.dev.: 0.2342) MultiSource/Benchmarks/MallocBench/gs/gs: -0.04% (4.3907 => 4.3888, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.04% (1.2462 => 1.2467, std.dev.: 0.0263) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.03% (7.7644 => 7.7624, std.dev.: 0.1917) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.08% (0.7396 => 0.7402, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.55% (0.0362 => 0.0360, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1433 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.86% (0.2147 => 0.2187, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -13.18% (63.2438 => 54.9078, std.dev.: 0.2342) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.63% (14.1553 => 18.7748, std.dev.: 0.0146) SingleSource/Benchmarks/Misc-C++-EH/spirit: 60.91% (3.4629 => 5.5722, std.dev.: 0.0235) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14226.11% (0.0720 => 10.3148, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952100.00% (0.0001 => 9.9522, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 49.10% (0.2554 => 0.3808, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 46.54% (10.3673 => 15.1927, std.dev.: 0.1595) SingleSource/Benchmarks/Misc/richards_benchmark: 31.32% (0.1622 => 0.2130, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 30.78% (0.1056 => 0.1381, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.03% (7.0540 => 8.1142, std.dev.: 0.1943) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.85% (2.2022 => 2.5292, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 14.59% (0.1432 => 0.1641, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.24% (0.1566 => 0.1789, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.39% (1.7609 => 1.9790, std.dev.: 0.0333) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.06% (0.0871 => 0.0976, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.86% (0.1584 => 0.1756, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 10.76% (0.3282 => 0.3635, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 10.54% (0.3473 => 0.3839, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.53% (0.3543 => 0.3916, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.50% (0.3543 => 0.3915, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.38% (0.3497 => 0.3860, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.32% (0.3516 => 0.3879, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.28% (0.3561 => 0.3927, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 10.15% (0.3694 => 0.4069, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.11% (0.3828 => 0.4215, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 10.08% (0.3927 => 0.4323, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 10.07% (0.1440 => 0.1585, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 9.93% (0.3886 => 0.4272, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 9.32% (0.7433 => 0.8126, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.21% (0.6675 => 0.7290, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 9.06% (0.1655 => 0.1805, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.02% (0.4879 => 0.5319, std.dev.: 0.0118) SingleSource/UnitTests/ObjC++/Hello: 9.00% (0.5925 => 0.6458, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 8.97% (0.7115 => 0.7753, std.dev.: 0.0011) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.92% (0.1143 => 0.1245, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 8.91% (9.4845 => 10.3299, std.dev.: 0.0086) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.91% (0.3177 => 0.3460, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.89% (1.5415 => 1.6786, std.dev.: 0.0480) MultiSource/Applications/JM/ldecod/ldecod: 8.78% (10.4361 => 11.3520, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.78% (0.4615 => 0.5020, std.dev.: 0.0126) SingleSource/UnitTests/ObjC++/property-reference-object: 8.71% (0.6030 => 0.6555, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 8.59% (0.3109 => 0.3376, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/tsp/tsp: 8.51% (0.1175 => 0.1275) MultiSource/Benchmarks/McCat/18-imp/imp: 8.44% (0.3423 => 0.3712, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 8.44% (0.1695 => 0.1838, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.33% (0.5105 => 0.5530, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.29% (1.3050 => 1.4132, std.dev.: 0.0413) SingleSource/UnitTests/ObjC++/property-reference: 8.22% (0.7326 => 0.7928, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.19% (0.2271 => 0.2457, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.15% (0.2700 => 0.2920, std.dev.: 0.0040) MultiSource/Applications/d/make_dparser: 8.13% (3.3354 => 3.6066, std.dev.: 0.0078) MultiSource/Applications/oggenc/oggenc: 8.06% (5.7591 => 6.2233, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.01% (0.1510 => 0.1631, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.94% (0.1940 => 0.2094, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.92% (4.2646 => 4.6022, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/bigfib: 7.88% (0.6456 => 0.6965, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.83% (0.3307 => 0.3566, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.81% (5.0018 => 5.3924, std.dev.: 0.1131) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.78% (0.2107 => 0.2271, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.73% (0.4203 => 0.4528, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 7.71% (0.3422 => 0.3686, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.66% (1.5603 => 1.6798, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 7.60% (0.4289 => 0.4615, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.59% (4.9449 => 5.3203, std.dev.: 0.1337) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.56% (8.1363 => 8.7510, std.dev.: 0.0258) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.51% (0.2891 => 0.3108, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.50% (0.3865 => 0.4155, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.48% (0.4636 => 0.4983, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.47% (0.5020 => 0.5395, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 7.41% (0.3387 => 0.3638, std.dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 7.40% (0.2905 => 0.3120, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 7.39% (0.7835 => 0.8414, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/moments: 7.36% (0.4048 => 0.4346, std.dev.: 0.0031) MultiSource/Applications/Burg/burg: 7.36% (1.1642 => 1.2499, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 7.35% (0.3603 => 0.3868, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.31% (0.2831 => 0.3038, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 7.26% (3.8723 => 4.1534, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.14% (0.2872 => 0.3077, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.12% (7.9617 => 8.5288, std.dev.: 0.1426) SingleSource/Benchmarks/Shootout-C++/ary: 7.12% (0.3232 => 0.3462, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.10% (0.4620 => 0.4948, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.08% (0.3136 => 0.3358, std.dev.: 0.0081) MultiSource/Applications/viterbi/viterbi: 7.07% (0.1555 => 0.1665, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 7.07% (0.3283 => 0.3515, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 7.06% (0.3684 => 0.3944, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.01% (0.2725 => 0.2916, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 7.00% (0.3098 => 0.3315, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 7.00% (0.2871 => 0.3072, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.97% (0.2756 => 0.2948, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 6.93% (1.0722 => 1.1465, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 6.90% (2.0273 => 2.1671, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.72% (0.2603 => 0.2778, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 6.71% (0.2802 => 0.2990, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.71% (0.2877 => 0.3070, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.67% (0.2714 => 0.2895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.66% (0.2793 => 0.2979, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.57% (1.1861 => 1.2640, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.56% (1.5859 => 1.6899, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 6.54% (0.3180 => 0.3388, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.40% (0.6450 => 0.6863, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 6.38% (2.2969 => 2.4435, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary2: 6.19% (0.3379 => 0.3588, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 6.18% (21.9371 => 23.2925, std.dev.: 0.0173) MultiSource/Benchmarks/McCat/05-eks/eks: 5.95% (0.4299 => 0.4555, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.86% (0.4064 => 0.4302, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.79% (2.2024 => 2.3300, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 4.95% (0.3131 => 0.3286, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.94% (1.2842 => 1.3477, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.90% (0.2266 => 0.2377, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.42% (0.8101 => 0.8459, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 3.25% (17.1811 => 17.7394, std.dev.: 0.0257) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.97% (3.8922 => 4.0078, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.83% (0.3817 => 0.3925, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 9.85% (1.1396 => 1.2519, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4499, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (3.1578 => 3.3678, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: 3.68% (0.5413 => 0.5612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.58% (3.6395 => 3.7698, std.dev.: 0.0023) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.63% (4.2280 => 4.3390, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7650, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8134, std.dev.: 0.0245) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.36% (0.9540 => 0.9670, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.25% (2.6546 => 2.6878, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1292, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/salsa20: -80.04% (0.8651 => 0.1727, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.24% (5.2763 => 3.2585, std.dev.: 0.0690) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.63% (5.3855 => 3.6280, std.dev.: 0.0522) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.11% (5.3526 => 3.6338, std.dev.: 0.0428) SingleSource/UnitTests/Vector/constpool: -14.47% (54.1659 => 46.3295, std.dev.: 0.0161) MultiSource/Benchmarks/FreeBench/mason/mason: -13.19% (0.0811 => 0.0704, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -11.13% (22.1758 => 19.7082, std.dev.: 0.0145) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.92% (2.9384 => 2.6174, std.dev.: 0.0771) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7637, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: -16.19% (1.6925 => 1.4185, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.73% (0.0998 => 0.0861, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.27% (1.2373 => 1.0979, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -10.35% (1.5373 => 1.3782, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/mason/mason: -9.86% (0.2161 => 0.1948, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.52% (19.9488 => 18.2493, std.dev.: 0.1255) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4787, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.66% (1.8329 => 1.7109, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.33% (1.6805 => 1.5910, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: -4.98% (5.0483 => 4.7967, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.67% (1.5835 => 1.5095, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.08% (0.9957 => 0.9551, std.dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.63% (3.2827 => 3.1636, std.dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.4995, std.dev.: 0.0061) MultiSource/Applications/hexxagon/hexxagon: -3.01% (12.4730 => 12.0980, std.dev.: 0.0014) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.12% (0.4808 => 0.4706, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -1.76% (10.2830 => 10.1023, std.dev.: 0.0215) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.76% (8.1563 => 8.0130, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6815, std.dev.: 0.0017) SingleSource/UnitTests/Vector/multiplies: -1.64% (2.5528 => 2.5110, std.dev.: 0.0020) MultiSource/Benchmarks/NPB-serial/is/is: -1.42% (9.5636 => 9.4274, std.dev.: 0.0308) SingleSource/Benchmarks/Shootout/lists: -1.18% (6.2999 => 6.2255, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8586, std.dev.: 0.0048) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.49% (0.5229 => 0.5882, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 8.05% (14.9895 => 16.1961, std.dev.: 0.0118) MultiSource/Benchmarks/MallocBench/gs/gs: 6.77% (4.1105 => 4.3888, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.84% (1.1048 => 1.2467, std.dev.: 0.0263) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.44% (7.1582 => 7.7624, std.dev.: 0.1917) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.96% (0.6222 => 0.7402, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35900.00% (0.0001 => 0.0360, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.36% (0.2116 => 0.2187, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 6 01:04:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 6 Oct 2012 03:04:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121006080459.903D62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4636?compare_to=4632&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4636, Order: 165358, Start Time: 2012-10-06 05:20:35, End Time: 2012-10-06 08:06:43 To: 4632, Order: 165355, Start Time: 2012-10-06 02:08:09, End Time: 2012-10-06 04:51:40 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (127 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 1041 (836 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.18% (54.2084 => 54.8462, std.dev.: 0.0661) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.16% (0.3446 => 0.3865, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.98% (0.3465 => 0.3880, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.96% (0.3488 => 0.3905, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 11.88% (0.3442 => 0.3851, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.88% (0.3460 => 0.3871, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.87% (0.3496 => 0.3911, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.85% (0.3469 => 0.3880, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/property: 11.51% (0.3650 => 0.4070, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions: 11.45% (0.3643 => 0.4060, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.33% (0.3724 => 0.4146, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 10.91% (1.5932 => 1.7670, std.dev.: 0.0283) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.44% (0.1063 => 0.1174, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.97% (0.5826 => 0.6407, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.85% (0.5889 => 0.6469, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.77% (0.2875 => 0.3127, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.66% (0.2738 => 0.2975, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 8.64% (0.2811 => 0.3054, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 8.49% (0.3004 => 0.3259, std.dev.: 0.0082) SingleSource/UnitTests/ObjC++/property-reference: 8.48% (0.7171 => 0.7779, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/fibo: 8.48% (0.2725 => 0.2956, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 8.47% (0.2714 => 0.2944, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.45% (0.2792 => 0.3028, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.42% (0.3195 => 0.3464, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.37% (0.4361 => 0.4726, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.35% (0.2729 => 0.2957, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 8.31% (0.2780 => 0.3011, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/08-main/main: 8.29% (0.1218 => 0.1319, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 8.29% (0.2823 => 0.3057, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 8.28% (0.2803 => 0.3035, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 8.28% (0.1619 => 0.1753, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 8.24% (0.3096 => 0.3351, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 8.22% (0.2750 => 0.2976, std.dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: 8.18% (0.9909 => 1.0720, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.11% (1.3152 => 1.4219, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 8.11% (0.2813 => 0.3041, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.06% (0.3362 => 0.3633, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/lists: 7.89% (0.3348 => 0.3612, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary3: 7.87% (0.3267 => 0.3524, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 7.86% (0.3678 => 0.3967, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 7.84% (0.3317 => 0.3577, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.83% (0.3258 => 0.3513, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 7.76% (0.3726 => 0.4015, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/lists1: 7.71% (0.3477 => 0.3745, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.67% (1.6211 => 1.7454, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.65% (3.5627 => 3.8354, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.59% (0.3282 => 0.3531, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.56% (0.3625 => 0.3899, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.55% (0.4994 => 0.5371, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.53% (0.1620 => 0.1742, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.45% (0.3690 => 0.3965, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash: 7.31% (0.4146 => 0.4449, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.31% (0.3845 => 0.4126, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/hash2: 7.27% (0.4251 => 0.4560, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.26% (0.5000 => 0.5363, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 7.21% (5.5417 => 5.9413, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.15% (0.2866 => 0.3071, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.11% (0.3981 => 0.4264, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 6.97% (23.5202 => 25.1592, std.dev.: 0.6232) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.93% (2.7292 => 2.9183, std.dev.: 0.0046) MultiSource/Applications/d/make_dparser: 6.86% (1.0781 => 1.1521, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.80% (0.5026 => 0.5368, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.73% (0.2736 => 0.2920, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 6.72% (4.2109 => 4.4940, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.70% (0.6435 => 0.6866, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.59% (0.3930 => 0.4189, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.58% (0.1549 => 0.1651, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.54% (0.2737 => 0.2916, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 6.52% (0.5012 => 0.5339, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.51% (4.4195 => 4.7074, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.50% (0.4139 => 0.4408, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.36% (0.5900 => 0.6275, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.36% (0.3084 => 0.3280, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 6.35% (0.2566 => 0.2729, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 6.32% (1.8794 => 1.9982, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.29% (0.2068 => 0.2198, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 6.18% (0.4029 => 0.4278, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.14% (0.3890 => 0.4129, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: 6.11% (0.5546 => 0.5885, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.10% (0.3903 => 0.4141, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.10% (0.1968 => 0.2088, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 6.09% (2.1653 => 2.2971, std.dev.: 0.0114) MultiSource/Applications/JM/lencod/lencod: 6.02% (4.6177 => 4.8957, std.dev.: 0.0025) MultiSource/Applications/siod/siod: 6.01% (0.6634 => 0.7033, std.dev.: 0.0075) MultiSource/Benchmarks/mafft/pairlocalalign: 5.95% (2.1013 => 2.2264, std.dev.: 0.0132) MultiSource/Applications/lua/lua: 5.94% (1.4269 => 1.5116, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.89% (0.2969 => 0.3144, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.78% (0.4658 => 0.4927, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 5.73% (0.9697 => 1.0253, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: 5.73% (0.3336 => 0.3527, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.61% (0.2103 => 0.2221, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.41% (0.3271 => 0.3448, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.38% (1.9694 => 2.0754, std.dev.: 0.0073) MultiSource/Applications/treecc/treecc: 5.36% (0.7875 => 0.8297, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.34% (0.2040 => 0.2149, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 5.25% (0.2075 => 0.2184, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.24% (1.9966 => 2.1012, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: 5.22% (2.0346 => 2.1409, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 4.81% (0.2391 => 0.2506, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 4.72% (0.2691 => 0.2818, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.48% (0.7426 => 0.7759, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.35% (0.5361 => 0.5594, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.05% (0.5584 => 0.5810, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.98% (4.6926 => 4.8794, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.69% (0.4253 => 0.4410, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 2.89% (11.9555 => 12.3009, std.dev.: 0.0133) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.74% (0.3792 => 0.3896, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-1: 22.63% (6.2401 => 7.6525, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6115, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 6.31% (0.2122 => 0.2256, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6738, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-2: 4.98% (1.8057 => 1.8957, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1660, std.dev.: 0.0739) SingleSource/Benchmarks/Dhrystone/dry: 4.29% (14.0481 => 14.6504, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1989, std.dev.: 0.0074) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5058, std.dev.: 0.0051) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.73% (3.1722 => 3.2272, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2896, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.39% (1.0142 => 1.0283, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std.dev.: 0.0104) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5814, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.79% (25.4195 => 16.5757, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/ary2: -7.79% (0.2402 => 0.2215, std.dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9751, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7934, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7975, std.dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/fldry: -3.07% (17.2379 => 16.7085, std.dev.: 0.0820) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7732, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.62% (0.6293 => 0.6128, std.dev.: 0.0056) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.25% (41.7953 => 40.8542, std.dev.: 0.3515) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5800, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4949, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.17% (105.3826 => 104.1513, std.dev.: 0.0392) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0405, std.dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 6 01:35:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 6 Oct 2012 03:35:10 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121006083510.0424B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4637?compare_to=4633&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4637, Order: 165361, Start Time: 2012-10-06 07:13:49, End Time: 2012-10-06 08:36:51 To: 4633, Order: 165360, Start Time: 2012-10-06 05:35:10, End Time: 2012-10-06 06:57:47 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (14 on baseline) Performance Regressions: 8 (100 on baseline) Performance Improvements: 4 (44 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 965 (747 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.86% (0.9234 => 0.9406, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.71% (0.6095 => 0.6199, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.29% (1.2287 => 1.2446, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.10% (1.1505 => 1.1632, std.dev.: 0.0024) MultiSource/Applications/treecc/treecc: 1.02% (1.9464 => 1.9663, std.dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.53% (41.9165 => 42.5577, std.dev.: 0.1137) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.38% (1.5986 => 1.6207, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.22% (4.7622 => 4.8202, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/SPASS/SPASS: -2.29% (8.6570 => 8.4588, std.dev.: 0.0477) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.20% (1.2913 => 1.2629, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/primes/primes: -1.61% (0.8090 => 0.7960, std.dev.: 0.0023) MultiSource/Applications/minisat/minisat: -1.46% (6.3422 => 6.2496, std.dev.: 0.0066) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.98% (1.0301 => 1.0200, std.dev.: 0.0089) MultiSource/Applications/sqlite3/sqlite3: 0.73% (0.6125 => 0.6170, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/08-main/main: 0.11% (0.1834 => 0.1836, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.34% (0.1518 => 0.1599, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.44% (0.3154 => 0.3140, std.dev.: 0.0077) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.04% (0.2411 => 0.2412, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.86% (0.3243 => 0.3215, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.13% (0.2328 => 0.2331, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: -8.32% (0.0457 => 0.0419, std.dev.: 0.0017) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.21% (0.0248 => 0.0245, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.55% (0.0193 => 0.0196, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0389 => 0.0389, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -16.28% (0.0301 => 0.0252, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.70% (0.0284 => 0.0286, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 3.80% (0.0316 => 0.0328, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 1.67% (0.0180 => 0.0183, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 1.04% (0.0193 => 0.0195, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: 2.80% (0.0250 => 0.0257, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 0.91% (0.0330 => 0.0333, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -1.73% (0.1443 => 0.1418, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.82% (1.5149 => 1.5425, std.dev.: 0.0154) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.19% (0.1560 => 0.1557, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.03% (0.4259 => 0.4002, std.dev.: 0.0197) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.36% (0.1408 => 0.1403, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.81% (0.0554 => 0.0564, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -29.30% (0.0256 => 0.0181, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.30% (0.0659 => 0.0661, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.24% (1.1290 => 1.1263, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 8.00% (0.0025 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.07% (0.0619 => 0.0638, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 46.11% (0.0180 => 0.0263, std.dev.: 0.0055) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.10% (0.7652 => 0.7660, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: -0.04% (1.7066 => 1.7060, std.dev.: 0.0026) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -23.97% (0.0121 => 0.0092, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 144.94% (0.0089 => 0.0218, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: 177.78% (0.0090 => 0.0250, std.dev.: 0.0002) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -26.81% (4.1772 => 3.0572, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/except: 82483.33% (0.0006 => 0.4955, std.dev.: 0.0024) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_throw: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.89% (0.0745 => 0.0923, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.75% (0.1414 => 0.1566, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.84% (0.1159 => 0.1273, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.63% (0.6410 => 0.7027, std.dev.: 0.0114) SingleSource/Benchmarks/Misc-C++/bigfib: 9.47% (0.5309 => 0.5812, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 8.45% (2.1763 => 2.3601, std.dev.: 0.0156) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.29% (0.3582 => 0.3879, std.dev.: 0.0051) MultiSource/Applications/minisat/minisat: 7.61% (0.6173 => 0.6643, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.25% (0.2552 => 0.2737, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 6.98% (1.0046 => 1.0747, std.dev.: 0.0038) MultiSource/Applications/kimwitu++/kc: 6.87% (15.3105 => 16.3619, std.dev.: 0.0484) MultiSource/Applications/SIBsim4/SIBsim4: 6.81% (1.1653 => 1.2446, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.33% (0.6069 => 0.6453, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.28% (1.5150 => 1.6102, std.dev.: 0.0187) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.03% (0.7639 => 0.8100, std.dev.: 0.0068) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.85% (0.7722 => 0.8174, std.dev.: 0.0117) MultiSource/Applications/lambda-0_1_3/lambda: 5.70% (0.6915 => 0.7309, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/18-imp/imp: 5.69% (0.3217 => 0.3400, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.54% (0.2886 => 0.3046, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.52% (1.1672 => 1.2316, std.dev.: 0.0136) MultiSource/Applications/d/make_dparser: 5.44% (3.0225 => 3.1870, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.32% (0.2106 => 0.2218, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.23% (1.1827 => 1.2446, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.21% (0.5740 => 0.6039, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.13% (0.4248 => 0.4466, std.dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.12% (0.3008 => 0.3162, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.04% (0.8569 => 0.9001, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.04% (0.4880 => 0.5126, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.93% (0.3062 => 0.3213, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.86% (6.2546 => 6.5587, std.dev.: 0.0759) MultiSource/Applications/hbd/hbd: 4.82% (1.3268 => 1.3907, std.dev.: 0.0050) MultiSource/Applications/SPASS/SPASS: 4.80% (13.3238 => 13.9637, std.dev.: 0.0203) MultiSource/Benchmarks/Bullet/bullet: 4.74% (29.3170 => 30.7063, std.dev.: 0.2651) MultiSource/Applications/oggenc/oggenc: 4.73% (4.7455 => 4.9700, std.dev.: 0.0022) MultiSource/Applications/Burg/burg: 4.71% (1.1440 => 1.1979, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.61% (1.4408 => 1.5072, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/lists: 4.60% (0.2347 => 0.2455, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 4.60% (1.8798 => 1.9663, std.dev.: 0.0046) MultiSource/Applications/siod/siod: 4.58% (2.0972 => 2.1933, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.57% (0.4596 => 0.4806, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.46% (0.3901 => 0.4075, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.41% (0.5937 => 0.6199, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.41% (0.2654 => 0.2771, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.40% (0.5636 => 0.5884, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.30% (0.7226 => 0.7537, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.18% (0.9029 => 0.9406, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.15% (3.0758 => 3.2034, std.dev.: 0.0222) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.13% (0.2662 => 0.2772, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 4.07% (0.2877 => 0.2994, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 4.06% (8.2186 => 8.5524, std.dev.: 0.0784) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.94% (0.3195 => 0.3321, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.86% (0.5963 => 0.6193, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/football/football: 3.84% (0.8405 => 0.8728, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.82% (0.5520 => 0.5731, std.dev.: 0.0055) MultiSource/Benchmarks/MallocBench/gs/gs: 3.72% (3.8796 => 4.0239, std.dev.: 0.0318) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.69% (0.2952 => 0.3061, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 3.64% (3.5980 => 3.7288, std.dev.: 0.0197) SingleSource/Benchmarks/Shootout-C++/hash: 3.44% (0.3520 => 0.3641, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.44% (4.2815 => 4.4286, std.dev.: 0.0282) MultiSource/Benchmarks/McCat/09-vor/vor: 3.30% (0.3026 => 0.3126, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.27% (2.0317 => 2.0981, std.dev.: 0.0084) MultiSource/Applications/JM/lencod/lencod: 3.27% (14.7256 => 15.2066, std.dev.: 0.0677) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.22% (1.2021 => 1.2408, std.dev.: 0.0138) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.17% (1.0689 => 1.1028, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.03% (4.0318 => 4.1538, std.dev.: 0.0453) MultiSource/Applications/JM/ldecod/ldecod: 2.99% (6.4908 => 6.6849, std.dev.: 0.0242) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.96% (12.6413 => 13.0151, std.dev.: 0.1399) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.79% (1.2742 => 1.3097, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.77% (1.3935 => 1.4321, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 2.68% (0.3847 => 0.3950, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.67% (0.4562 => 0.4684, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.62% (4.2616 => 4.3731, std.dev.: 0.0278) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.51% (8.2559 => 8.4633, std.dev.: 0.0344) MultiSource/Applications/hexxagon/hexxagon: 2.08% (0.9425 => 0.9621, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.55% (1.6538 => 2.3410, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2286, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout/ary3: 14.86% (1.7426 => 2.0016, std.dev.: 0.0189) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.43% (2.4042 => 2.7270, std.dev.: 0.0798) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.24% (4.0101 => 4.5409, std.dev.: 0.0542) SingleSource/Benchmarks/McGill/queens: 11.14% (1.6261 => 1.8073, std.dev.: 0.0167) MultiSource/Benchmarks/FreeBench/mason/mason: 10.03% (0.5004 => 0.5506, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Puzzle: 9.70% (0.1433 => 0.1572, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/lists: 8.83% (7.0025 => 7.6208, std.dev.: 0.0224) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.65% (0.2857 => 0.3104, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.04% (1.0063 => 1.0872, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.60% (0.3301 => 0.3486, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.13% (40.4792 => 42.5577, std.dev.: 0.1137) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.61% (0.7609 => 0.7960, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/dt: 4.23% (0.9851 => 1.0268, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: 3.97% (15.2242 => 15.8293, std.dev.: 0.0486) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.86% (3.4080 => 3.5394, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.35% (0.5876 => 0.6073, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.13% (0.5587 => 0.5762, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.81% (6.6312 => 6.8173, std.dev.: 0.0220) MultiSource/Applications/siod/siod: 2.75% (3.5520 => 3.6498, std.dev.: 0.0208) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.69% (2.6656 => 2.7373, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/hash: 2.62% (0.6308 => 0.6473, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.4184 => 1.4393, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ffbench: 1.38% (1.4117 => 1.4312, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.12% (4.0659 => 4.1113, std.dev.: 0.0063) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -43.99% (0.0591 => 0.0331, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -43.56% (0.2996 => 0.1691, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.99% (1.4189 => 1.1637, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.58% (1.4113 => 1.1632, std.dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.18% (0.3497 => 0.2127, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.26% (5.2665 => 4.1996, std.dev.: 0.0430) SingleSource/Benchmarks/Shootout-C++/ary3: -20.13% (1.7473 => 1.3955, std.dev.: 0.0497) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1584, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -10.66% (15.8312 => 14.1435, std.dev.: 0.6487) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.50% (1.1647 => 1.0540, std.dev.: 0.0388) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.67% (3.2007 => 2.9233, std.dev.: 0.0218) SingleSource/Benchmarks/Misc/flops: -8.32% (9.5474 => 8.7533, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.29% (1.4034 => 1.2871, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.74% (3.6254 => 3.3810, std.dev.: 0.0104) MultiSource/Applications/lambda-0_1_3/lambda: -6.59% (7.6833 => 7.1768, std.dev.: 0.0236) SingleSource/Benchmarks/Shootout-C++/fibo: -6.54% (4.6355 => 4.3322, std.dev.: 0.0285) SingleSource/Benchmarks/Misc/richards_benchmark: -6.27% (1.4441 => 1.3535, std.dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.96% (2.9728 => 2.7955, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.46% (3.9413 => 3.7262, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout/fib2: -5.23% (4.4195 => 4.1883, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.89% (0.4564 => 0.4341, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: -4.70% (2.5166 => 2.3982, std.dev.: 0.0027) MultiSource/Applications/sgefa/sgefa: -4.24% (0.3746 => 0.3587, std.dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: -4.23% (62.4126 => 59.7698, std.dev.: 0.1354) SingleSource/Benchmarks/McGill/misr: -3.75% (0.4296 => 0.4135, std.dev.: 0.0032) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.64% (1.2722 => 1.2259, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/methcall: -3.42% (9.2503 => 8.9337, std.dev.: 0.0202) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.27% (1.1683 => 1.1301, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.05% (3.7496 => 3.6351, std.dev.: 0.0301) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.55% (1.2959 => 1.2629, std.dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/dry: -2.22% (2.4013 => 2.3481, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: -2.14% (3.4230 => 3.3496, std.dev.: 0.0201) SingleSource/Benchmarks/Shootout-C++/hash2: -1.99% (3.4876 => 3.4181, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.90% (2.3569 => 2.3122, std.dev.: 0.0079) MultiSource/Applications/aha/aha: -1.88% (3.4286 => 3.3643, std.dev.: 0.0072) MultiSource/Benchmarks/sim/sim: -1.69% (3.8907 => 3.8251, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.68% (61.1734 => 60.1450, std.dev.: 0.2872) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.67% (9.3855 => 9.2285, std.dev.: 0.0509) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.66% (1.0686 => 1.0509, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/neural/neural: -1.64% (1.0926 => 1.0747, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -1.60% (92.7467 => 91.2605, std.dev.: 0.1377) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3144, std.dev.: 0.0094) SingleSource/Benchmarks/Dhrystone/fldry: -1.29% (2.4971 => 2.4650, std.dev.: 0.0115) MultiSource/Applications/JM/lencod/lencod: -1.20% (6.7458 => 6.6648, std.dev.: 0.0196) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.20% (0.9980 => 1.0200, std.dev.: 0.0089) MultiSource/Applications/sqlite3/sqlite3: 2.46% (0.6022 => 0.6170, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/08-main/main: 10.20% (0.1666 => 0.1836, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.90% (0.1554 => 0.1599, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.85% (0.3083 => 0.3140, std.dev.: 0.0077) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.75% (0.2394 => 0.2412, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.26% (0.3175 => 0.3215, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.26% (0.2302 => 0.2331, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: -6.68% (0.0449 => 0.0419, std.dev.: 0.0017) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.08% (0.0240 => 0.0245, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 2.08% (0.0192 => 0.0196, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.26% (0.0390 => 0.0389, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -16.28% (0.0301 => 0.0252, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.70% (0.0284 => 0.0286, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.23% (0.0324 => 0.0328, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 3.39% (0.0177 => 0.0183, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 3.17% (0.0189 => 0.0195, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: 3.21% (0.0249 => 0.0257, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 2.46% (0.0325 => 0.0333, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.77% (0.1429 => 0.1418, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 2.70% (1.5019 => 1.5425, std.dev.: 0.0154) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.73% (0.1501 => 0.1557, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.14% (0.4264 => 0.4002, std.dev.: 0.0197) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.39% (0.1344 => 0.1403, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.24% (0.0589 => 0.0564, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -21.98% (0.0232 => 0.0181, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.44% (0.0639 => 0.0661, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.77% (1.1350 => 1.1263, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 350.00% (0.0006 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.16% (0.0637 => 0.0638, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.91% (0.0246 => 0.0263, std.dev.: 0.0055) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.58% (0.7541 => 0.7660, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 11.05% (1.5363 => 1.7060, std.dev.: 0.0026) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 31.43% (0.0070 => 0.0092, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 6 01:49:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 6 Oct 2012 03:49:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121006084943.8303A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4638?compare_to=4634&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4638, Order: 165361, Start Time: 2012-10-06 07:36:48, End Time: 2012-10-06 08:51:27 To: 4634, Order: 165360, Start Time: 2012-10-06 05:48:22, End Time: 2012-10-06 07:04:43 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (181 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1042 (755 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 22.23% (2.0176 => 2.4661, std.dev.: 0.0152) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.59% (0.1410 => 0.1658, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 15.62% (0.0826 => 0.0955, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 14.62% (0.2243 => 0.2571, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.71% (0.0834 => 0.0940, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 12.34% (1.3693 => 1.5383, std.dev.: 0.0012) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.22% (0.1072 => 0.1203, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 12.13% (0.4328 => 0.4853, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 12.04% (0.1013 => 0.1135, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.03% (0.1413 => 0.1583, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.71% (0.1588 => 0.1774, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 11.71% (0.5818 => 0.6499, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 11.55% (0.7038 => 0.7851, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/hash: 11.55% (0.4062 => 0.4531, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 11.53% (0.5748 => 0.6411, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.53% (0.1327 => 0.1480, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 11.51% (0.2781 => 0.3101, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.47% (0.2721 => 0.3033, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.41% (3.9660 => 4.4184, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.32% (0.2782 => 0.3097, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.31% (0.0964 => 0.1073, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.10% (0.3485 => 0.3872, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.06% (1.2193 => 1.3541, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.05% (0.3899 => 0.4330, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 11.02% (0.7061 => 0.7839, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.94% (0.2596 => 0.2880, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.90% (0.6283 => 0.6968, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 10.86% (0.2607 => 0.2890, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.85% (0.9199 => 1.0197, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.76% (0.4016 => 0.4448, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.75% (0.3022 => 0.3347, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.73% (1.4563 => 1.6126, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/fibo: 10.73% (0.2628 => 0.2910, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 10.73% (0.2937 => 0.3252, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 10.71% (0.2726 => 0.3018, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 10.71% (0.2690 => 0.2978, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 10.69% (0.2760 => 0.3055, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.68% (0.3756 => 0.4157, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 10.64% (0.1062 => 0.1175, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.63% (1.9828 => 2.1936, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.62% (0.2655 => 0.2937, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.56% (0.2765 => 0.3057, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.55% (0.2966 => 0.3279, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 10.54% (0.3149 => 0.3481, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 10.54% (0.3293 => 0.3640, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.53% (0.7710 => 0.8522, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary: 10.49% (0.3107 => 0.3433, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 10.47% (0.2761 => 0.3050, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.46% (0.3489 => 0.3854, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.45% (0.6959 => 0.7686, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 10.43% (0.3453 => 0.3813, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.39% (0.5265 => 0.5812, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.34% (0.3580 => 0.3950, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 10.32% (0.3868 => 0.4267, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.26% (1.1364 => 1.2530, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: 10.21% (0.2988 => 0.3293, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.20% (0.2696 => 0.2971, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 10.19% (13.8202 => 15.2282, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/power/power: 10.17% (0.1003 => 0.1105, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 10.09% (0.3192 => 0.3514, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.07% (0.4390 => 0.4832, std.dev.: 0.0022) MultiSource/Applications/sgefa/sgefa: 10.05% (0.2995 => 0.3296, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 9.88% (0.3534 => 0.3883, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 9.82% (0.1589 => 0.1745, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.79% (0.4791 => 0.5260, std.dev.: 0.0049) MultiSource/Applications/lemon/lemon: 9.78% (1.0313 => 1.1322, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.77% (0.1157 => 0.1270, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.62% (0.1435 => 0.1573, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.49% (0.1075 => 0.1177, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.49% (0.5577 => 0.6106, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 9.47% (1.1061 => 1.2109, std.dev.: 0.0066) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.45% (0.4379 => 0.4793, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.36% (0.3130 => 0.3423, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.35% (0.8698 => 0.9511, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.25% (0.1276 => 0.1394, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 9.23% (16.6129 => 18.1466, std.dev.: 0.0219) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.23% (0.2914 => 0.3183, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 9.20% (0.2945 => 0.3216, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 9.13% (0.8310 => 0.9069, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.11% (0.1986 => 0.2167, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.09% (0.3246 => 0.3541, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.03% (0.2127 => 0.2319, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.95% (0.3755 => 0.4091, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 8.93% (3.8646 => 4.2098, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/18-imp/imp: 8.88% (0.3220 => 0.3506, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 8.85% (0.6744 => 0.7341, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.82% (0.5637 => 0.6134, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.79% (0.7460 => 0.8116, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.65% (7.2180 => 7.8420, std.dev.: 0.0061) MultiSource/Applications/spiff/spiff: 8.62% (0.7506 => 0.8153, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 8.46% (3.1889 => 3.4586, std.dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 8.43% (1.0594 => 1.1487, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.42% (0.1865 => 0.2022, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.38% (0.8818 => 0.9557, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.35% (0.2023 => 0.2192, std.dev.: 0.0024) MultiSource/Applications/treecc/treecc: 8.34% (1.9270 => 2.0877, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 8.32% (2.1791 => 2.3605, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/09-vor/vor: 8.17% (0.2925 => 0.3164, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 8.05% (0.1478 => 0.1597, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/05-eks/eks: 8.05% (0.4113 => 0.4444, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 8.03% (1.2749 => 1.3773, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.03% (0.1569 => 0.1695, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.02% (3.6692 => 3.9635, std.dev.: 0.0040) MultiSource/Benchmarks/sim/sim: 8.02% (0.3131 => 0.3382, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 7.88% (4.6629 => 5.0303, std.dev.: 0.0180) MultiSource/Applications/JM/lencod/lencod: 7.86% (14.8535 => 16.0206, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.85% (0.6576 => 0.7092, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.79% (4.3801 => 4.7215, std.dev.: 0.0110) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.79% (4.4433 => 4.7896, std.dev.: 0.0079) MultiSource/Benchmarks/mafft/pairlocalalign: 7.75% (8.4961 => 9.1548, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.75% (1.3245 => 1.4271, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/em3d/em3d: 7.72% (0.1657 => 0.1785, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.71% (0.1789 => 0.1927, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.69% (0.6135 => 0.6607, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.69% (0.3511 => 0.3781, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 7.41% (1.2292 => 1.3203, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.38% (0.2140 => 0.2298, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 7.36% (0.6250 => 0.6710, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.24% (0.9108 => 0.9767, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.11% (0.2504 => 0.2682, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.06% (3.2742 => 3.5054, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.02% (4.9865 => 5.3367, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.99% (1.5188 => 1.6249, std.dev.: 0.0130) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.80% (1.1333 => 1.2104, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.78% (0.4805 => 0.5131, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 6.72% (0.2008 => 0.2143, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 6.53% (6.5754 => 7.0050, std.dev.: 0.0060) SingleSource/UnitTests/ObjC/parameter-passing: 6.47% (0.4003 => 0.4262, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.40% (0.3940 => 0.4192, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.38% (0.1819 => 0.1935, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 6.34% (0.3914 => 0.4162, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.32% (0.3245 => 0.3450, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 6.20% (0.3789 => 0.4024, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 6.18% (0.3578 => 0.3799, std.dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.12% (6.2785 => 6.6627, std.dev.: 0.0033) MultiSource/Applications/lua/lua: 6.06% (3.7467 => 3.9739, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-4: 6.03% (0.3646 => 0.3866, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.00% (0.3601 => 0.3817, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.99% (0.2321 => 0.2460, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.97% (0.3650 => 0.3868, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 5.92% (0.3663 => 0.3880, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 5.88% (0.3623 => 0.3836, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.85% (2.1007 => 2.2235, std.dev.: 0.0188) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.33% (13.2842 => 13.9928, std.dev.: 0.0131) MultiSource/Applications/sqlite3/sqlite3: 3.79% (16.2614 => 16.8784, std.dev.: 0.0123) MultiSource/Applications/ClamAV/clamscan: 3.43% (14.5298 => 15.0282, std.dev.: 0.0227) MultiSource/Benchmarks/Bullet/bullet: 1.08% (33.2944 => 33.6544, std.dev.: 0.0280) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.64% (5.7573 => 7.5213, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: 24.23% (1.8175 => 2.2578, std.dev.: 0.0524) SingleSource/Benchmarks/Misc/richards_benchmark: 11.12% (1.1560 => 1.2845, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 8.98% (0.8273 => 0.9016, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4144, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.26% (1.2998 => 1.3812, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.62% (1.9144 => 2.0028, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.89% (1.7081 => 1.7746, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6762, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9849, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 3.25% (10.7476 => 11.0967, std.dev.: 0.0168) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.14% (7.4271 => 7.5864, std.dev.: 0.0034) MultiSource/Applications/lemon/lemon: 1.65% (1.4298 => 1.4534, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5130, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2123, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1872, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9667, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.16% (5.5130 => 5.5772, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0271, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5906, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.23% (0.2670 => 0.1409, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.75% (0.4657 => 0.3877, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -15.42% (0.0707 => 0.0598, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.87% (1.3819 => 1.1902, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.65% (1.3813 => 1.1928, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.51% (22.5627 => 21.7707, std.dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.11% (0.2238 => 0.1967, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -10.98% (1.2308 => 1.0956, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.13% (20.3410 => 18.2812, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.89% (1.3780 => 1.2968, std.dev.: 0.0092) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -4.97% (2.6470 => 2.5155, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.73% (0.9996 => 0.9523, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8004, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.60% (3.2729 => 3.1552, std.dev.: 0.0125) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.49% (1.7688 => 1.7071, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.51% (3.0263 => 2.9504, std.dev.: 0.0024) MultiSource/Applications/lua/lua: -2.47% (26.5159 => 25.8597, std.dev.: 0.0223) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.30% (1.9762 => 1.9308, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.91% (0.6589 => 0.6463, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.78% (28.2225 => 27.7196, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.66% (6.3560 => 6.2506, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.59% (0.6615 => 0.6510, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0076, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8614, std.dev.: 0.0084) MultiSource/Applications/sqlite3/sqlite3: -1.29% (4.5928 => 4.5336, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.16% (2.5254 => 2.4960, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2576, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.06% (6.6320 => 6.5617, std.dev.: 0.0067) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 6 01:57:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 6 Oct 2012 03:57:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121006085739.4DD642A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4639?compare_to=4635&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4639, Order: 165361, Start Time: 2012-10-06 07:39:15, End Time: 2012-10-06 08:59:23 To: 4635, Order: 165360, Start Time: 2012-10-06 05:48:29, End Time: 2012-10-06 07:09:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (154 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1024 (764 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.70% (77.9222 => 80.8057, std.dev.: 0.3411) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.19% (0.5882 => 0.5871, std.dev.: 0.0043) MultiSource/Applications/SPASS/SPASS: -0.11% (16.1961 => 16.1781, std.dev.: 0.0220) MultiSource/Benchmarks/Bullet/bullet: -0.02% (54.9078 => 54.8983, std.dev.: 0.0502) MultiSource/Benchmarks/MallocBench/gs/gs: 0.06% (4.3888 => 4.3916, std.dev.: 0.0156) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.01% (1.2467 => 1.2468, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.23% (7.7624 => 7.7445, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.03% (0.7402 => 0.7404, std.dev.: 0.0038) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0360 => 0.0360, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 0.14% (0.1432 => 0.1434, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.69% (0.2187 => 0.2202, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -13.20% (63.2438 => 54.8983, std.dev.: 0.0502) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.06% (14.1553 => 18.6936, std.dev.: 0.0193) SingleSource/Benchmarks/Misc-C++-EH/spirit: 60.43% (3.4629 => 5.5554, std.dev.: 0.0039) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14234.17% (0.0720 => 10.3206, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952400.00% (0.0001 => 9.9525, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 48.83% (0.2554 => 0.3801, std.dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: 46.51% (10.3673 => 15.1889, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/richards_benchmark: 31.44% (0.1622 => 0.2132, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/distray/distray: 30.78% (0.1056 => 0.1381, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.07% (7.0540 => 8.1167, std.dev.: 0.0088) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.78% (2.2022 => 2.5277, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 14.53% (0.1432 => 0.1640, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.37% (0.1566 => 0.1791, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.35% (1.7609 => 1.9784, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.83% (0.0871 => 0.0974, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.92% (0.1584 => 0.1757, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 10.85% (0.3282 => 0.3638, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 10.62% (0.3473 => 0.3842, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.44% (0.3543 => 0.3913, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 10.39% (0.3561 => 0.3931, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.39% (0.3543 => 0.3911, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 10.38% (0.3516 => 0.3881, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.32% (0.3497 => 0.3858, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.23% (0.3694 => 0.4072, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.03% (0.3828 => 0.4212, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.01% (0.3927 => 0.4320, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 10.00% (0.1440 => 0.1584, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 9.91% (0.1655 => 0.1819, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.88% (0.3886 => 0.4270, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 9.40% (0.7115 => 0.7784, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.25% (0.3177 => 0.3471, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.25% (0.1438 => 0.1571, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.24% (0.1125 => 0.1229, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.16% (0.3121 => 0.3407, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.14% (0.4615 => 0.5037, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference: 9.01% (0.7326 => 0.7986, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.98% (0.4879 => 0.5317, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.97% (0.2107 => 0.2296, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 8.93% (0.7433 => 0.8097, std.dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 8.91% (9.4845 => 10.3295, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.87% (0.6675 => 0.7267, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.84% (1.5415 => 1.6778, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/Hello: 8.74% (0.5925 => 0.6443, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 8.72% (0.6030 => 0.6556, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 8.72% (10.4361 => 11.3460, std.dev.: 0.0257) MultiSource/Applications/sgefa/sgefa: 8.56% (0.3109 => 0.3375, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.44% (0.8067 => 0.8748, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.42% (0.5105 => 0.5535, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.42% (0.8172 => 0.8860, std.dev.: 0.0109) MultiSource/Benchmarks/Olden/em3d/em3d: 8.38% (0.1695 => 0.1837, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 8.36% (0.3423 => 0.3709, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 8.26% (0.2905 => 0.3145, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.25% (0.1625 => 0.1759, std.dev.: 0.0021) MultiSource/Applications/spiff/spiff: 8.16% (0.7835 => 0.8474, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.15% (1.3050 => 1.4114, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.15% (0.2271 => 0.2456, std.dev.: 0.0021) MultiSource/Applications/d/make_dparser: 8.04% (3.3354 => 3.6034, std.dev.: 0.0112) MultiSource/Applications/oggenc/oggenc: 7.94% (5.7591 => 6.2163, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.88% (0.5860 => 0.6322, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.85% (0.4636 => 0.5000, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.83% (4.2646 => 4.5985, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.83% (0.5569 => 0.6005, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.82% (4.9449 => 5.3315, std.dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.75% (0.1510 => 0.1627, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.70% (0.4103 => 0.4419, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.70% (0.2065 => 0.2224, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.68% (0.1940 => 0.2089, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.68% (5.0018 => 5.3858, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/hash: 7.67% (0.4289 => 0.4618, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.67% (0.2700 => 0.2907, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.65% (0.2758 => 0.2969, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.64% (0.9765 => 1.0511, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/fibo: 7.63% (0.2725 => 0.2933, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.62% (0.2756 => 0.2966, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists: 7.57% (0.3422 => 0.3681, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.55% (0.2714 => 0.2919, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.54% (8.1363 => 8.7501, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/bigfib: 7.54% (0.6456 => 0.6943, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.53% (0.3307 => 0.3556, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 7.49% (1.5603 => 1.6772, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.47% (0.4203 => 0.4517, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.37% (0.3865 => 0.4150, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.37% (0.2891 => 0.3104, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.33% (0.5020 => 0.5388, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.26% (0.3650 => 0.3915, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 7.23% (0.3387 => 0.3632, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.23% (0.2793 => 0.2995, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 7.17% (1.1642 => 1.2477, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/strcat: 7.17% (0.2831 => 0.3034, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 7.11% (0.3603 => 0.3859, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 7.07% (0.4048 => 0.4334, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.05% (0.3232 => 0.3460, std.dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.05% (7.9617 => 8.5231, std.dev.: 0.0235) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.01% (2.0665 => 2.2113, std.dev.: 0.0046) MultiSource/Applications/lua/lua: 7.00% (3.8723 => 4.1433, std.dev.: 0.0187) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.98% (0.3136 => 0.3355, std.dev.: 0.0027) MultiSource/Applications/viterbi/viterbi: 6.95% (0.1555 => 0.1663, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary3: 6.94% (0.3283 => 0.3511, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.92% (0.3441 => 0.3679, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash2: 6.90% (0.4620 => 0.4939, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 6.90% (0.2871 => 0.3069, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.89% (0.2872 => 0.3070, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 6.88% (0.3098 => 0.3311, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.87% (0.3826 => 0.4089, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.86% (0.3162 => 0.3379, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.85% (0.3052 => 0.3261, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 6.84% (0.3684 => 0.3936) MultiSource/Applications/lemon/lemon: 6.82% (1.0722 => 1.1453, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 6.78% (0.3379 => 0.3608, std.dev.: 0.0074) MultiSource/Applications/treecc/treecc: 6.77% (2.0273 => 2.1646, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.75% (1.1861 => 1.2662, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: 6.64% (0.2877 => 0.3068, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.57% (0.2603 => 0.2774, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 6.53% (0.2802 => 0.2985, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 6.40% (2.2969 => 2.4440, std.dev.: 0.0114) MultiSource/Benchmarks/McCat/09-vor/vor: 6.38% (0.3180 => 0.3383, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.29% (0.6450 => 0.6856, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 6.21% (21.9371 => 23.2994, std.dev.: 0.0241) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.19% (1.5859 => 1.6840, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 6.00% (0.8921 => 0.9456, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/05-eks/eks: 5.91% (0.4299 => 0.4553, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.90% (0.5981 => 0.6334, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.55% (1.4186 => 1.4974, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.50% (2.2024 => 2.3235, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.49% (0.4064 => 0.4287, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.30% (0.1906 => 0.2007, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/ReedSolomon: 5.17% (0.2049 => 0.2155, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 5.10% (1.1840 => 1.2444, std.dev.: 0.0065) MultiSource/Applications/hexxagon/hexxagon: 5.02% (1.2842 => 1.3487, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/objinst: 4.92% (0.3131 => 0.3285, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.81% (0.2266 => 0.2375, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.80% (0.8101 => 0.8490, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.67% (14.3668 => 14.8947, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.33% (0.3427 => 0.3541, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 3.12% (17.1811 => 17.7170, std.dev.: 0.0092) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.80% (0.3817 => 0.3924, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.79% (3.8922 => 4.0006, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.49% (1.1194 => 1.1473, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.85% (1.1396 => 1.2518, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4500, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (3.1578 => 3.3671, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.72% (3.6395 => 3.7750, std.dev.: 0.0059) SingleSource/Regression/C/uint64_to_float: 3.68% (0.5413 => 0.5612, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.78% (4.2280 => 4.3455, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8141, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.36% (0.9540 => 0.9670, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.11% (2.6546 => 2.6840, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1313, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -80.03% (0.8651 => 0.1728, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.30% (5.2763 => 3.2555, std.dev.: 0.0106) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.57% (5.3855 => 3.6317, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.15% (5.3526 => 3.6317, std.dev.: 0.0028) SingleSource/UnitTests/Vector/constpool: -14.48% (54.1659 => 46.3234, std.dev.: 0.0123) MultiSource/Benchmarks/FreeBench/mason/mason: -13.32% (0.0811 => 0.0703, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -11.05% (22.1758 => 19.7246, std.dev.: 0.0471) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.04% (2.9384 => 2.6141, std.dev.: 0.0071) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -33.34% (1.1492 => 0.7660, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -16.11% (1.6925 => 1.4199, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.23% (0.0998 => 0.0856, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -11.44% (1.2373 => 1.0957, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -10.36% (1.5373 => 1.3781, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/mason/mason: -9.72% (0.2161 => 0.1951, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.41% (19.9488 => 18.2714, std.dev.: 0.1352) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.68% (1.8329 => 1.7104, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.27% (1.6805 => 1.5919, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5090, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.19% (0.9957 => 0.9540, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.62% (3.2827 => 3.1638, std.dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.4995, std.dev.: 0.0084) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0987, std.dev.: 0.0018) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.08% (8.1563 => 7.9868, std.dev.: 0.0121) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.02% (8.6802 => 8.5045, std.dev.: 0.0198) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6818, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -1.66% (10.2830 => 10.1124, std.dev.: 0.0162) SingleSource/UnitTests/Vector/multiplies: -1.65% (2.5528 => 2.5107, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4200, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8564, std.dev.: 0.0029) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.28% (0.5229 => 0.5871, std.dev.: 0.0043) MultiSource/Applications/SPASS/SPASS: 7.93% (14.9895 => 16.1781, std.dev.: 0.0220) MultiSource/Benchmarks/MallocBench/gs/gs: 6.84% (4.1105 => 4.3916, std.dev.: 0.0156) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.85% (1.1048 => 1.2468, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.19% (7.1582 => 7.7445, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.00% (0.6222 => 0.7404, std.dev.: 0.0038) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35900.00% (0.0001 => 0.0360, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -3.43% (0.1485 => 0.1434, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.06% (0.2116 => 0.2202, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 6 04:18:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 6 Oct 2012 06:18:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121006111833.5D7602A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4640?compare_to=4636&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4640, Order: 165361, Start Time: 2012-10-06 08:35:54, End Time: 2012-10-06 11:20:18 To: 4636, Order: 165358, Start Time: 2012-10-06 05:20:35, End Time: 2012-10-06 08:06:43 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (131 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 1041 (833 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.35% (2.0417 => 2.1100, std.dev.: 0.0123) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 11.98% (0.3488 => 0.3906, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 11.90% (0.3446 => 0.3856, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.86% (0.3465 => 0.3876, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 11.85% (0.3442 => 0.3850, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.82% (0.3460 => 0.3869, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.81% (0.3496 => 0.3909, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.70% (0.3469 => 0.3875, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 11.45% (0.3650 => 0.4068, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 11.45% (0.3643 => 0.4060, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.31% (0.3724 => 0.4145, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 10.71% (1.5932 => 1.7639, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.54% (0.1063 => 0.1175, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.02% (0.5826 => 0.6410, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.73% (0.5889 => 0.6462, std.dev.: 0.0064) SingleSource/Regression/C++/ofstream_ctor: 8.92% (0.3004 => 0.3272, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.70% (0.2875 => 0.3125, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.65% (0.7171 => 0.7791, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/matrix: 8.60% (0.2780 => 0.3019, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 8.48% (0.2725 => 0.2956, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 8.46% (0.1619 => 0.1756, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.44% (0.2738 => 0.2969, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 8.40% (0.2714 => 0.2942, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 8.37% (0.1218 => 0.1320, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.36% (0.3195 => 0.3462, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.35% (0.2792 => 0.3025, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.32% (0.2729 => 0.2956, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 8.29% (0.2811 => 0.3044, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 8.28% (0.2803 => 0.3035, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.26% (2.0673 => 2.2381, std.dev.: 0.0418) SingleSource/Benchmarks/Shootout-C++/objinst: 8.25% (0.2823 => 0.3056, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 8.25% (0.2813 => 0.3045, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.21% (0.2911 => 0.3150, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/strcat: 8.18% (0.2750 => 0.2975, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.16% (0.4361 => 0.4717, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wc: 8.14% (0.3096 => 0.3348, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 8.11% (0.9909 => 1.0713, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.07% (0.3060 => 0.3307, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.97% (0.3362 => 0.3630, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/ary2: 7.96% (0.3317 => 0.3581, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 7.92% (0.3258 => 0.3516, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 7.92% (0.3726 => 0.4021, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary3: 7.90% (0.3267 => 0.3525, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 7.78% (0.3678 => 0.3964, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.72% (0.3625 => 0.3905, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.72% (1.6211 => 1.7462, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.72% (0.1620 => 0.1745, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 7.65% (0.3477 => 0.3743, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.65% (0.3282 => 0.3533, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.63% (1.3152 => 1.4155, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.59% (0.4994 => 0.5373, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.59% (0.3124 => 0.3361, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/lists: 7.53% (0.3348 => 0.3600, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: 7.48% (0.4146 => 0.4456, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 7.41% (0.4251 => 0.4566, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.39% (0.3845 => 0.4129, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.36% (3.5627 => 3.8250, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.34% (0.5000 => 0.5367, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.32% (0.3690 => 0.3960, std.dev.: 0.0023) MultiSource/Benchmarks/PAQ8p/paq8p: 7.24% (0.4847 => 0.5198, std.dev.: 0.0105) MultiSource/Applications/SPASS/SPASS: 7.22% (5.5417 => 5.9416, std.dev.: 0.0081) MultiSource/Benchmarks/Bullet/bullet: 7.17% (23.5202 => 25.2068, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.08% (0.3981 => 0.4263, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.08% (2.7292 => 2.9224, std.dev.: 0.0019) MultiSource/Applications/d/make_dparser: 6.90% (1.0781 => 1.1525, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.87% (0.2736 => 0.2924, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 6.78% (0.2566 => 0.2740, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.76% (0.6435 => 0.6870, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.72% (0.4139 => 0.4417, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.71% (0.1549 => 0.1653, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.67% (0.3930 => 0.4192, std.dev.: 0.0083) MultiSource/Applications/ClamAV/clamscan: 6.62% (4.2109 => 4.4897, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.59% (0.2866 => 0.3055, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.47% (0.2737 => 0.2914, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.45% (0.3084 => 0.3283, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 6.44% (0.5012 => 0.5335, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.43% (0.3903 => 0.4154, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.43% (4.4195 => 4.7037, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.38% (0.2068 => 0.2200, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 6.24% (1.8794 => 1.9967, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.21% (0.5026 => 0.5338, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.20% (0.2969 => 0.3153, std.dev.: 0.0017) MultiSource/Applications/spiff/spiff: 6.16% (0.4029 => 0.4277, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 6.14% (2.1653 => 2.2982, std.dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.05% (0.1968 => 0.2087, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.04% (0.3890 => 0.4125, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 6.01% (0.6634 => 0.7033, std.dev.: 0.0079) MultiSource/Applications/lua/lua: 5.97% (1.4269 => 1.5121, std.dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 5.96% (2.1013 => 2.2265, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.95% (0.4658 => 0.4935, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.94% (0.2103 => 0.2228, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 5.93% (0.5546 => 0.5875, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 5.82% (4.6177 => 4.8863, std.dev.: 0.0095) MultiSource/Applications/minisat/minisat: 5.73% (0.3336 => 0.3527, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.72% (0.3271 => 0.3458, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 5.61% (0.9697 => 1.0241, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.49% (0.2040 => 0.2152, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.36% (1.9694 => 2.0750, std.dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: 5.29% (2.0346 => 2.1422, std.dev.: 0.0029) MultiSource/Applications/treecc/treecc: 5.23% (0.7875 => 0.8287, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.22% (1.9966 => 2.1008, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/football/football: 5.20% (0.2075 => 0.2183, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 5.13% (0.2691 => 0.2829, std.dev.: 0.0028) MultiSource/Applications/lemon/lemon: 4.77% (0.2391 => 0.2505, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.69% (0.7426 => 0.7774, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.42% (0.5361 => 0.5598, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.16% (11.6398 => 12.1240, std.dev.: 0.0363) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.14% (0.5584 => 0.5815, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.06% (4.6926 => 4.8830, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.02% (0.4253 => 0.4424, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 3.86% (0.3498 => 0.3633, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 2.89% (11.9555 => 12.3008, std.dev.: 0.0162) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6093, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 5.22% (12.0509 => 12.6801, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 5.13% (15.4430 => 16.2357, std.dev.: 0.1004) SingleSource/Benchmarks/Misc/flops-2: 4.73% (1.8057 => 1.8911, std.dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/dry: 4.28% (14.0481 => 14.6498, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2106, std.dev.: 0.0023) MultiSource/Applications/viterbi/viterbi: 1.90% (46.6247 => 47.5096, std.dev.: 0.0220) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.65% (3.1722 => 3.2245, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2838, std.dev.: 0.0029) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.35% (1.0142 => 1.0279, std.dev.: 0.0021) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5144, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.14% (1.0927 => 1.1052, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5845, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.80% (25.4195 => 16.5723, std.dev.: 0.0181) SingleSource/Benchmarks/Shootout-C++/ary2: -10.53% (0.2402 => 0.2149, std.dev.: 0.0063) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9764, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7941, std.dev.: 0.0083) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8036, std.dev.: 0.0020) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/mandel-2: -2.95% (3.6262 => 3.5191, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: -2.92% (17.2379 => 16.7341, std.dev.: 0.0705) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8598, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.05% (0.6293 => 0.6164, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5742, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4951, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.19% (105.3826 => 104.1328, std.dev.: 0.0651) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0409, std.dev.: 0.0017) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 6 09:27:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 6 Oct 2012 11:27:02 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121006162702.9EDB52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4641?compare_to=4637&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4641, Order: 165362, Start Time: 2012-10-06 15:05:36, End Time: 2012-10-06 16:28:46 To: 4637, Order: 165361, Start Time: 2012-10-06 07:13:49, End Time: 2012-10-06 08:36:51 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (14 on baseline) Performance Regressions: 11 (86 on baseline) Performance Improvements: 4 (45 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 962 (760 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.14% (0.8982 => 0.9174, std.dev.: 0.0070) MultiSource/Applications/kimwitu++/kc: 1.79% (16.3619 => 16.6554, std.dev.: 0.0491) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.45% (4.4773 => 4.5420, std.dev.: 0.0180) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.16% (3.2034 => 3.2404, std.dev.: 0.0092) MultiSource/Applications/lemon/lemon: 1.06% (1.0747 => 1.0861, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 3.43% (1.0047 => 1.0392, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.67% (1.3444 => 1.3803, std.dev.: 0.0111) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.60% (1.2259 => 1.2578, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.35% (1.1301 => 1.1454, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.25% (4.8314 => 4.8920, std.dev.: 0.0233) SingleSource/Benchmarks/Shootout-C++/methcall: 1.05% (8.9337 => 9.0274, std.dev.: 0.0189) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/ffbench: -1.83% (1.4312 => 1.4050, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -1.69% (4.7647 => 4.6841, std.dev.: 0.0209) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.33% (4.8202 => 4.7563, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.14% (1.6207 => 1.6022, std.dev.: 0.0068) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.89% (1.0200 => 1.0291, std.dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: 1.54% (0.6170 => 0.6265, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/08-main/main: -0.44% (0.1836 => 0.1828, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.50% (0.1599 => 0.1607, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.37% (0.3140 => 0.3183, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.08% (0.2412 => 0.2438, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.36% (0.3215 => 0.3291, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.97% (0.2331 => 0.2377, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: 3.82% (0.0419 => 0.0435, std.dev.: 0.0014) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -12.65% (0.0245 => 0.0214, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.51% (0.0196 => 0.0197, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.29% (0.0389 => 0.0394, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 21.03% (0.0252 => 0.0305, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -6.64% (0.0286 => 0.0267, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0328 => 0.0328, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0183 => 0.0183, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 1.03% (0.0195 => 0.0197, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -1.95% (0.0257 => 0.0252, std.dev.: 0.0011) SingleSource/UnitTests/byval-alignment: -0.90% (0.0333 => 0.0330, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.28% (0.1418 => 0.1422, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 0.50% (1.5425 => 1.5502, std.dev.: 0.0208) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -5.72% (0.1557 => 0.1468, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.10% (0.4002 => 0.4046, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.14% (0.1403 => 0.1433, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.71% (0.0564 => 0.0568, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.29% (0.0181 => 0.0196, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: - (0.0661 => 0.0661, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.03% (1.1263 => 1.1266, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -55.56% (0.0027 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -12.50% (0.0024 => 0.0021, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.63% (0.0638 => 0.0642, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -47.53% (0.0263 => 0.0138, std.dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.18% (0.7660 => 0.7674, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 0.04% (1.7060 => 1.7067, std.dev.: 0.0104) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 30.43% (0.0092 => 0.0120, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 144.94% (0.0089 => 0.0218, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: 175.56% (0.0090 => 0.0248, std.dev.: 0.0004) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -26.16% (4.1772 => 3.0843, std.dev.: 0.0334) SingleSource/Benchmarks/Shootout-C++/except: 83300.00% (0.0006 => 0.5004, std.dev.: 0.0004) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 24.70% (0.0745 => 0.0929, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 10.00% (2.1763 => 2.3940, std.dev.: 0.0410) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.75% (0.1159 => 0.1272, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.56% (0.6410 => 0.7023, std.dev.: 0.0187) SingleSource/Benchmarks/Misc-C++/bigfib: 9.49% (0.5309 => 0.5813, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: 8.80% (0.6173 => 0.6716, std.dev.: 0.0037) MultiSource/Applications/kimwitu++/kc: 8.78% (15.3105 => 16.6554, std.dev.: 0.0491) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.77% (0.3582 => 0.3896, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 8.11% (1.0046 => 1.0861, std.dev.: 0.0027) MultiSource/Applications/SIBsim4/SIBsim4: 7.40% (1.1653 => 1.2515, std.dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: 7.00% (0.6915 => 0.7399, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.92% (0.4248 => 0.4542, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.86% (0.2552 => 0.2727, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.71% (0.6069 => 0.6476, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.70% (0.7639 => 0.8151, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.53% (1.5150 => 1.6139, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.01% (0.2797 => 0.2965, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.96% (0.2886 => 0.3058, std.dev.: 0.0026) MultiSource/Applications/d/make_dparser: 5.93% (3.0225 => 3.2018, std.dev.: 0.0058) MultiSource/Applications/hbd/hbd: 5.85% (1.3268 => 1.4044, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/oourafft: 5.83% (0.1971 => 0.2086, std.dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.78% (6.2546 => 6.6160, std.dev.: 0.0471) MultiSource/Applications/oggenc/oggenc: 5.69% (4.7455 => 5.0154, std.dev.: 0.0115) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.58% (0.2654 => 0.2802, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.49% (0.4880 => 0.5148, std.dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 5.40% (29.3170 => 30.8989, std.dev.: 0.1500) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.35% (3.0758 => 3.2404, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.27% (1.4408 => 1.5168, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.26% (1.1827 => 1.2449, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.17% (1.1672 => 1.2275, std.dev.: 0.0190) MultiSource/Benchmarks/nbench/nbench: 5.11% (1.0821 => 1.1374, std.dev.: 0.0131) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.05% (0.3008 => 0.3160, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.01% (1.2021 => 1.2623, std.dev.: 0.0152) MultiSource/Applications/SPASS/SPASS: 4.99% (13.3238 => 13.9886, std.dev.: 0.0494) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.70% (4.3380 => 4.5420, std.dev.: 0.0180) MultiSource/Applications/Burg/burg: 4.56% (1.1440 => 1.1962, std.dev.: 0.0148) MultiSource/Benchmarks/mafft/pairlocalalign: 4.52% (8.2186 => 8.5898, std.dev.: 0.0286) MultiSource/Applications/siod/siod: 4.51% (2.0972 => 2.1917, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.44% (0.3062 => 0.3198, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.38% (2.0317 => 2.1207, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.36% (0.3418 => 0.3567, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 4.35% (1.8798 => 1.9616, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/hash: 4.32% (0.3520 => 0.3672, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 4.26% (0.3026 => 0.3155, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists1: 4.22% (0.2771 => 0.2888, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.12% (4.2815 => 4.4580, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 4.05% (3.5980 => 3.7437, std.dev.: 0.0263) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.00% (0.7226 => 0.7515, std.dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.81% (1.0689 => 1.1096, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.79% (12.6413 => 13.1210, std.dev.: 0.0515) MultiSource/Applications/JM/lencod/lencod: 3.68% (14.7256 => 15.2672, std.dev.: 0.0814) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.62% (0.2952 => 0.3059, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.59% (4.0318 => 4.1767, std.dev.: 0.0177) MultiSource/Applications/sgefa/sgefa: 3.58% (0.2877 => 0.2980, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.51% (8.2559 => 8.5453, std.dev.: 0.0313) MultiSource/Benchmarks/MallocBench/gs/gs: 3.46% (3.8796 => 4.0137, std.dev.: 0.0224) MultiSource/Applications/JM/ldecod/ldecod: 3.34% (6.4908 => 6.7074, std.dev.: 0.0199) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.25% (4.2616 => 4.4003, std.dev.: 0.0376) SingleSource/Benchmarks/Shootout-C++/hash2: 2.99% (0.3847 => 0.3962, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.74% (0.5520 => 0.5671, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.70% (1.3935 => 1.4311, std.dev.: 0.0091) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 43.73% (0.0263 => 0.0378, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/pi: 41.49% (1.6538 => 2.3399, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2280, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/ary3: 14.74% (1.7426 => 1.9994, std.dev.: 0.0151) SingleSource/Benchmarks/Stanford/Puzzle: 14.52% (0.1433 => 0.1641, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 14.07% (0.0917 => 0.1046, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.81% (2.4042 => 2.7363, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.37% (4.0101 => 4.5461, std.dev.: 0.0113) SingleSource/Benchmarks/McGill/queens: 11.11% (1.6261 => 1.8068, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.80% (1.0063 => 1.0949, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.79% (0.8498 => 0.9245, std.dev.: 0.0276) SingleSource/Benchmarks/Shootout/lists: 8.67% (7.0025 => 7.6093, std.dev.: 0.0126) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.54% (0.2857 => 0.3101, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.00% (0.3301 => 0.3499, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/dt: 4.64% (0.9851 => 1.0308, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: 4.39% (15.2242 => 15.8922, std.dev.: 0.0150) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.90% (3.4080 => 3.5408, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 3.71% (6.9722 => 7.2309, std.dev.: 0.0205) MultiSource/Applications/siod/siod: 3.29% (3.5520 => 3.6689, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.26% (0.5587 => 0.5769, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.86% (6.6312 => 6.8207, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.48% (2.6656 => 2.7318, std.dev.: 0.0139) SingleSource/Benchmarks/McGill/chomp: 1.94% (1.0194 => 1.0392, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.69% (4.6127 => 4.6906, std.dev.: 0.0179) MultiSource/Benchmarks/Olden/power/power: 1.51% (1.4184 => 1.4398, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -45.18% (0.0591 => 0.0324, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -43.36% (0.2996 => 0.1697, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.79% (1.4113 => 1.1602, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.67% (1.4189 => 1.1682, std.dev.: 0.0126) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.12% (0.3497 => 0.2129, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.17% (5.2665 => 4.0989, std.dev.: 0.0411) SingleSource/Benchmarks/Shootout-C++/ary3: -20.08% (1.7473 => 1.3964, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.06% (1.7361 => 1.4747, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1580, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -10.88% (15.8312 => 14.1090, std.dev.: 0.2923) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.81% (1.1647 => 1.0505, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/moments: -9.25% (0.1114 => 0.1011, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.33% (1.4034 => 1.2865, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/flops: -8.33% (9.5474 => 8.7523, std.dev.: 0.0250) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.25% (3.2007 => 2.9365, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.85% (3.6254 => 3.3770, std.dev.: 0.0110) MultiSource/Applications/lambda-0_1_3/lambda: -6.78% (7.6833 => 7.1620, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/fibo: -6.58% (4.6355 => 4.3307, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: -6.11% (1.4441 => 1.3559, std.dev.: 0.0143) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.03% (2.9728 => 2.7936, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.47% (3.9413 => 3.7259, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -5.10% (4.4195 => 4.1943, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/bh/bh: -4.81% (2.5166 => 2.3956, std.dev.: 0.0146) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.60% (0.4564 => 0.4354, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: -4.24% (0.3746 => 0.3587, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -4.14% (62.4126 => 59.8298, std.dev.: 0.0551) SingleSource/Benchmarks/McGill/misr: -2.82% (0.4296 => 0.4175, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.42% (2.4457 => 2.3864, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/methcall: -2.41% (9.2503 => 9.0274, std.dev.: 0.0189) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.35% (3.7496 => 3.6615, std.dev.: 0.0158) SingleSource/Benchmarks/Dhrystone/dry: -2.19% (2.4013 => 2.3486, std.dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: -2.03% (3.4230 => 3.3536, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.96% (1.1683 => 1.1454, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: -1.95% (3.4876 => 3.4195, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.86% (2.3569 => 2.3131, std.dev.: 0.0027) MultiSource/Applications/aha/aha: -1.82% (3.4286 => 3.3663, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.77% (1.8739 => 1.8407, std.dev.: 0.0097) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.76% (9.3855 => 9.2201, std.dev.: 0.0146) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/neural/neural: -1.53% (1.0926 => 1.0759, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3128, std.dev.: 0.0154) SingleSource/Benchmarks/Dhrystone/fldry: -1.29% (2.4971 => 2.4650, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: -1.26% (6.7458 => 6.6611, std.dev.: 0.0280) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.25% (27.1724 => 26.8315, std.dev.: 0.1028) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.13% (1.2722 => 1.2578, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 3.12% (0.9980 => 1.0291, std.dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: 4.04% (0.6022 => 0.6265, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/08-main/main: 9.72% (0.1666 => 0.1828, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.41% (0.1554 => 0.1607, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.24% (0.3083 => 0.3183, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.84% (0.2394 => 0.2438, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.65% (0.3175 => 0.3291, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.26% (0.2302 => 0.2377, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: -3.12% (0.0449 => 0.0435, std.dev.: 0.0014) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -10.83% (0.0240 => 0.0214, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 2.60% (0.0192 => 0.0197, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.03% (0.0390 => 0.0394, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.33% (0.0301 => 0.0305, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -5.99% (0.0284 => 0.0267, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.23% (0.0324 => 0.0328, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 3.39% (0.0177 => 0.0183, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 4.23% (0.0189 => 0.0197, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: 1.20% (0.0249 => 0.0252, std.dev.: 0.0011) SingleSource/UnitTests/byval-alignment: 1.54% (0.0325 => 0.0330, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.49% (0.1429 => 0.1422, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 3.22% (1.5019 => 1.5502, std.dev.: 0.0208) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -2.20% (0.1501 => 0.1468, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.11% (0.4264 => 0.4046, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.62% (0.1344 => 0.1433, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.57% (0.0589 => 0.0568, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -15.52% (0.0232 => 0.0196, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.44% (0.0639 => 0.0661, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.74% (1.1350 => 1.1266, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -12.50% (0.0024 => 0.0021, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.78% (0.0637 => 0.0642, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -43.90% (0.0246 => 0.0138, std.dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.76% (0.7541 => 0.7674, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 11.09% (1.5363 => 1.7067, std.dev.: 0.0104) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 71.43% (0.0070 => 0.0120, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 6 09:31:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 6 Oct 2012 11:31:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121006163153.1F9C72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4642?compare_to=4638&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4642, Order: 165362, Start Time: 2012-10-06 15:18:52, End Time: 2012-10-06 16:33:37 To: 4638, Order: 165361, Start Time: 2012-10-06 07:36:48, End Time: 2012-10-06 08:51:27 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (180 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1041 (756 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.54% (55.1344 => 56.5324, std.dev.: 0.0146) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 22.14% (2.0176 => 2.4642, std.dev.: 0.0141) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.52% (0.1410 => 0.1657, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 15.62% (0.0826 => 0.0955, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 14.27% (0.2243 => 0.2563, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.83% (0.0834 => 0.0941, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 12.34% (1.3693 => 1.5383, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 12.29% (0.4328 => 0.4860, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 12.24% (0.1013 => 0.1137, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.89% (0.1413 => 0.1581, std.dev.: 0.0036) SingleSource/UnitTests/ObjC++/property-reference-object: 11.74% (0.5818 => 0.6501, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.65% (0.1588 => 0.1773, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 11.59% (0.5748 => 0.6414, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 11.58% (0.2781 => 0.3103, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 11.52% (0.4062 => 0.4530, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.36% (0.2721 => 0.3030, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.29% (0.1072 => 0.1193, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.29% (0.2782 => 0.3096, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.28% (3.9660 => 4.4133, std.dev.: 0.0148) MultiSource/Applications/lambda-0_1_3/lambda: 11.17% (0.7038 => 0.7824, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.10% (0.0964 => 0.1071, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.08% (0.3485 => 0.3871, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 11.02% (0.7061 => 0.7839, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.00% (0.1327 => 0.1473, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.98% (1.2193 => 1.3532, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 10.90% (0.2726 => 0.3023, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.87% (0.6283 => 0.6966, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.79% (0.9199 => 1.0192, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 10.76% (0.2760 => 0.3057, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.75% (0.3022 => 0.3347, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.72% (0.3899 => 0.4317, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 10.71% (0.2690 => 0.2978, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 10.70% (0.2607 => 0.2886, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.67% (0.2596 => 0.2873, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.66% (0.2655 => 0.2938, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 10.66% (0.3293 => 0.3644, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 10.64% (0.3149 => 0.3484, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 10.62% (0.2628 => 0.2907, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 10.59% (0.2937 => 0.3248, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.57% (1.4563 => 1.6103, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.56% (0.4016 => 0.4440, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.53% (0.7710 => 0.8522, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary: 10.52% (0.3107 => 0.3434, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.52% (0.2765 => 0.3056, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.49% (1.9828 => 2.1908, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.49% (0.3756 => 0.4150, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.49% (0.2966 => 0.3277, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 10.46% (0.3192 => 0.3526, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 10.43% (0.2761 => 0.3049, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 10.43% (0.3453 => 0.3813, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.41% (0.5265 => 0.5813, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/moments: 10.39% (0.3868 => 0.4270, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.38% (0.3489 => 0.3851, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 10.26% (0.1062 => 0.1171, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.26% (0.6959 => 0.7673, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.25% (0.3580 => 0.3947, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.24% (0.2696 => 0.2972, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 10.17% (0.2988 => 0.3292, std.dev.: 0.0079) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.15% (1.1364 => 1.2518, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.05% (0.4390 => 0.4831, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 9.93% (13.8202 => 15.1932, std.dev.: 0.0101) MultiSource/Applications/sgefa/sgefa: 9.92% (0.2995 => 0.3292, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 9.90% (0.3534 => 0.3884, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.73% (0.4791 => 0.5257, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.68% (0.1157 => 0.1269, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.49% (0.1075 => 0.1177, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 9.45% (1.0313 => 1.1288, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/chomp: 9.44% (0.1589 => 0.1739, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.41% (0.5577 => 0.6102, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.27% (0.1435 => 0.1568, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.27% (0.3130 => 0.3420, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.25% (0.1276 => 0.1394, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.23% (0.8698 => 0.9501, std.dev.: 0.0130) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.23% (0.4379 => 0.4783, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 9.20% (0.2945 => 0.3216, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.03% (0.2127 => 0.2319, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.03% (0.2914 => 0.3177, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 8.99% (16.6129 => 18.1062, std.dev.: 0.0187) MultiSource/Benchmarks/Prolangs-C/football/football: 8.95% (0.8310 => 0.9054, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.94% (0.7460 => 0.8127, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.91% (0.1986 => 0.2163, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 8.87% (1.1061 => 1.2042, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.87% (0.3755 => 0.4088, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.85% (0.5637 => 0.6136, std.dev.: 0.0022) MultiSource/Applications/minisat/minisat: 8.81% (0.6744 => 0.7338, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.78% (0.3246 => 0.3531, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 8.73% (0.3220 => 0.3501, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.57% (7.2180 => 7.8363, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/gs/gs: 8.53% (3.8646 => 4.1944, std.dev.: 0.0075) MultiSource/Benchmarks/nbench/nbench: 8.38% (1.0594 => 1.1482, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 8.35% (0.7506 => 0.8133, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 8.33% (3.1889 => 3.4544, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.31% (0.8818 => 0.9551, std.dev.: 0.0117) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.30% (0.2023 => 0.2191, std.dev.: 0.0014) MultiSource/Applications/viterbi/viterbi: 8.25% (0.1478 => 0.1600, std.dev.: 0.0020) MultiSource/Applications/treecc/treecc: 8.20% (1.9270 => 2.0850, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.10% (0.1865 => 0.2016, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.03% (0.1569 => 0.1695, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 8.02% (1.2749 => 1.3772, std.dev.: 0.0027) MultiSource/Benchmarks/sim/sim: 7.95% (0.3131 => 0.3380, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 7.95% (2.1791 => 2.3523, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/05-eks/eks: 7.93% (0.4113 => 0.4439, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/09-vor/vor: 7.90% (0.2925 => 0.3156, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.87% (3.6692 => 3.9579, std.dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.83% (0.1789 => 0.1929, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.82% (0.6576 => 0.7090, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 7.78% (8.4961 => 9.1568, std.dev.: 0.0113) MultiSource/Applications/JM/lencod/lencod: 7.76% (14.8535 => 16.0066, std.dev.: 0.0067) MultiSource/Applications/oggenc/oggenc: 7.75% (4.6629 => 5.0242, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.73% (4.3801 => 4.7188, std.dev.: 0.0100) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.66% (4.4433 => 4.7835, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.60% (0.3511 => 0.3778, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 7.60% (0.1657 => 0.1783, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.60% (1.3245 => 1.4252, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.56% (0.6135 => 0.6599, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.34% (0.2140 => 0.2297, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.31% (1.2292 => 1.3191, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 7.26% (0.6250 => 0.6704, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.04% (0.9108 => 0.9749, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.99% (0.2504 => 0.2679, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.95% (4.9865 => 5.3330, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.86% (3.2742 => 3.4987, std.dev.: 0.0155) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.78% (1.1333 => 1.2101, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.70% (1.5188 => 1.6205, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.64% (0.4805 => 0.5124, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 6.62% (0.2008 => 0.2141, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.43% (0.1819 => 0.1936, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 6.36% (6.5754 => 6.9934, std.dev.: 0.0114) SingleSource/UnitTests/ObjC/exceptions: 6.31% (0.3914 => 0.4161, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.30% (0.4003 => 0.4255, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.29% (0.3245 => 0.3449, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 6.23% (0.3578 => 0.3801, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 6.02% (0.3789 => 0.4017, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.99% (6.2785 => 6.6545, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-4: 5.98% (0.3646 => 0.3864, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 5.98% (0.3663 => 0.3882, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 5.96% (0.3940 => 0.4175, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.95% (0.3650 => 0.3867, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 5.92% (0.3601 => 0.3814, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 5.91% (0.3623 => 0.3837, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 5.84% (3.7467 => 3.9654, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.78% (2.1007 => 2.2222, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.73% (0.2321 => 0.2454, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.27% (13.2842 => 13.9838, std.dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: 3.60% (16.2614 => 16.8468, std.dev.: 0.0053) MultiSource/Applications/ClamAV/clamscan: 3.44% (14.5298 => 15.0296, std.dev.: 0.0130) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5151, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.10% (1.0895 => 1.3630, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.12% (1.8175 => 2.2558, std.dev.: 0.0582) SingleSource/Benchmarks/Misc/richards_benchmark: 11.14% (1.1560 => 1.2848, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1923, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 8.99% (0.8273 => 0.9017, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (3.1736 => 3.4149, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 5.72% (1.2998 => 1.3742, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.64% (1.9144 => 2.0032, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.89% (1.7081 => 1.7746, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.67% (11.2619 => 11.6749, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.43% (10.7476 => 11.1164, std.dev.: 0.0496) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9857, std.dev.: 0.0006) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.19% (7.4271 => 7.5900, std.dev.: 0.0077) MultiSource/Applications/lemon/lemon: 1.73% (1.4298 => 1.4545, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5138, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9692, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1876, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.16% (5.5130 => 5.5768, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0270, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5885, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.01% (8.8259 => 8.9150, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.23% (0.2670 => 0.1409, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.77% (0.4657 => 0.3876, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -15.70% (0.0707 => 0.0596, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.92% (1.3819 => 1.1896, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.90% (1.3813 => 1.1893, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.58% (22.5627 => 21.7560, std.dev.: 0.0161) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.64% (0.0997 => 0.0861, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.93% (0.2238 => 0.1971, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -10.90% (1.2308 => 1.0967, std.dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.02% (20.3410 => 18.3031, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8099, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.60% (1.3780 => 1.3009, std.dev.: 0.0058) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.05% (2.6470 => 2.5132, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.18% (0.9996 => 0.9578, std.dev.: 0.0042) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1562, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.51% (1.7688 => 1.7068, std.dev.: 0.0048) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.94% (0.4867 => 0.4724, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.66% (26.5159 => 25.8113, std.dev.: 0.0276) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4785, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.43% (3.0263 => 2.9527, std.dev.: 0.0023) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.35% (1.9762 => 1.9297, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.87% (0.6589 => 0.6466, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.80% (6.3560 => 6.2414, std.dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7139, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0070, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -1.26% (4.5928 => 4.5351, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4943, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -1.19% (3.9173 => 3.8706, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2584, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.04% (6.6320 => 6.5627, std.dev.: 0.0075) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 6 09:36:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 6 Oct 2012 11:36:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121006163631.A65AE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4643?compare_to=4639&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4643, Order: 165362, Start Time: 2012-10-06 15:18:47, End Time: 2012-10-06 16:38:16 To: 4639, Order: 165361, Start Time: 2012-10-06 07:39:15, End Time: 2012-10-06 08:59:23 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (153 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1025 (764 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.07% (0.5871 => 0.5867, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 0.06% (16.1781 => 16.1873, std.dev.: 0.0142) MultiSource/Benchmarks/Bullet/bullet: -0.02% (54.8983 => 54.8867, std.dev.: 0.0200) MultiSource/Benchmarks/MallocBench/gs/gs: -0.17% (4.3916 => 4.3841, std.dev.: 0.0169) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.13% (1.2468 => 1.2452, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.06% (7.7445 => 7.7495, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.23% (0.7404 => 0.7387, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.28% (0.0360 => 0.0361, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -0.14% (0.1434 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.32% (0.2202 => 0.2173, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -13.21% (63.2438 => 54.8867, std.dev.: 0.0200) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.39% (14.1553 => 18.7400, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++-EH/spirit: 60.65% (3.4629 => 5.5631, std.dev.: 0.0020) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14221.94% (0.0720 => 10.3118, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952000.00% (0.0001 => 9.9521, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 48.90% (0.2554 => 0.3803, std.dev.: 0.0023) MultiSource/Benchmarks/PAQ8p/paq8p: 46.57% (10.3673 => 15.1954, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/richards_benchmark: 31.26% (0.1622 => 0.2129, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: 30.68% (0.1056 => 0.1380, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.01% (7.0540 => 8.1131, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.80% (2.2022 => 2.5281, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 14.59% (0.1432 => 0.1641, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.37% (0.1566 => 0.1791, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.38% (1.7609 => 1.9789, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.06% (0.0871 => 0.0976, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.04% (0.3543 => 0.3934, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.83% (0.1625 => 0.1801, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.73% (0.1584 => 0.1754, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 10.69% (0.3282 => 0.3633, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.60% (0.3473 => 0.3841, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 10.41% (0.3516 => 0.3882, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.39% (0.3561 => 0.3931, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.38% (0.3497 => 0.3860, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.36% (0.3543 => 0.3910, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 10.24% (0.3828 => 0.4220, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.20% (0.1029 => 0.1134, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 10.12% (0.3694 => 0.4068, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 10.06% (0.3886 => 0.4277, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.03% (0.3927 => 0.4321, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 10.00% (0.1440 => 0.1584, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.44% (0.3177 => 0.3477, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.05% (0.6675 => 0.7279, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 9.00% (0.7433 => 0.8102, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/Hello: 8.98% (0.5925 => 0.6457, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.94% (0.4879 => 0.5315, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 8.92% (0.7115 => 0.7750, std.dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 8.89% (9.4845 => 10.3281, std.dev.: 0.0170) SingleSource/Benchmarks/McGill/chomp: 8.88% (0.1655 => 0.1802, std.dev.: 0.0036) SingleSource/UnitTests/ObjC++/property-reference-object: 8.81% (0.6030 => 0.6561, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 8.78% (0.3109 => 0.3382, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.76% (0.1438 => 0.1564, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.71% (1.5415 => 1.6757, std.dev.: 0.0034) MultiSource/Applications/JM/ldecod/ldecod: 8.69% (10.4361 => 11.3425, std.dev.: 0.0097) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.54% (0.8172 => 0.8870, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.52% (0.4615 => 0.5008, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.46% (0.4103 => 0.4450, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 8.15% (0.3423 => 0.3702, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 8.14% (0.7326 => 0.7922, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.11% (1.3050 => 1.4109, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/em3d/em3d: 8.02% (0.1695 => 0.1831, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.01% (0.5105 => 0.5514, std.dev.: 0.0018) MultiSource/Applications/d/make_dparser: 8.00% (3.3354 => 3.6021, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.95% (0.5860 => 0.6326, std.dev.: 0.0069) MultiSource/Applications/oggenc/oggenc: 7.93% (5.7591 => 6.2158, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.93% (0.2107 => 0.2274, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.88% (0.2271 => 0.2450, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.88% (0.3136 => 0.3383, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.85% (0.2700 => 0.2912, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.83% (4.2646 => 4.5984, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists: 7.80% (0.3422 => 0.3689, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.78% (0.5569 => 0.6002, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.77% (0.3307 => 0.3564, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.76% (0.2758 => 0.2972, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.75% (0.1510 => 0.1627, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 7.75% (0.2905 => 0.3130, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.70% (0.2065 => 0.2224, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.63% (0.3121 => 0.3359, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 7.62% (0.6456 => 0.6948, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.62% (4.9449 => 5.3216, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.59% (0.3162 => 0.3402, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.57% (8.1363 => 8.7526, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.57% (0.9765 => 1.0504, std.dev.: 0.0023) MultiSource/Applications/hbd/hbd: 7.55% (1.5603 => 1.6781, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.54% (0.8067 => 0.8675, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/hash: 7.53% (0.4289 => 0.4612, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 7.53% (0.3387 => 0.3642, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.52% (0.4203 => 0.4519, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.50% (5.0018 => 5.3771, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.45% (0.5020 => 0.5394, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.40% (0.4636 => 0.4979, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 7.39% (0.7835 => 0.8414, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.37% (0.3826 => 0.4108, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.37% (0.2891 => 0.3104, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 7.35% (0.2831 => 0.3039, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.32% (0.1940 => 0.2082, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.32% (0.3650 => 0.3917, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 7.28% (1.1642 => 1.2489, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/moments: 7.19% (0.4048 => 0.4339, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 7.14% (3.8723 => 4.1489, std.dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.11% (7.9617 => 8.5280, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hash2: 7.08% (0.4620 => 0.4947, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 7.08% (0.3603 => 0.3858, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 7.07% (0.1555 => 0.1665, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists1: 7.00% (0.3684 => 0.3942, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.99% (0.3232 => 0.3458, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.97% (2.0665 => 2.2106, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary3: 6.94% (0.3283 => 0.3511, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.92% (0.3441 => 0.3679, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 6.91% (1.0722 => 1.1463, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.90% (0.2871 => 0.3069, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.86% (0.2872 => 0.3069, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.86% (0.2756 => 0.2945, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 6.84% (0.3098 => 0.3310, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.83% (0.2725 => 0.2911, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 6.78% (0.3052 => 0.3259, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 6.76% (2.0273 => 2.1644, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/random: 6.67% (0.2802 => 0.2989, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.60% (0.2877 => 0.3067, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/hello: 6.60% (0.2714 => 0.2893, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.59% (0.2793 => 0.2977, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.57% (0.2603 => 0.2774, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.54% (1.1861 => 1.2637, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 6.48% (0.3180 => 0.3386, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.36% (1.5859 => 1.6867, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 6.30% (0.3379 => 0.3592, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 6.26% (2.2969 => 2.4407, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 6.15% (0.8921 => 0.9470, std.dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 6.12% (21.9371 => 23.2803, std.dev.: 0.0120) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.09% (0.6450 => 0.6843, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.09% (0.5981 => 0.6345, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/05-eks/eks: 6.00% (0.4299 => 0.4557, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.57% (2.2024 => 2.3250, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.54% (0.4064 => 0.4289, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.38% (1.4186 => 1.4949, std.dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 5.10% (1.1840 => 1.2444, std.dev.: 0.0059) MultiSource/Applications/hexxagon/hexxagon: 4.87% (1.2842 => 1.3467, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 4.85% (0.3131 => 0.3283, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.85% (0.2266 => 0.2376, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.47% (0.8101 => 0.8463, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.67% (14.3668 => 14.8947, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.36% (0.3427 => 0.3542, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 3.24% (17.1811 => 17.7373, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.84% (3.8922 => 4.0028, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.80% (0.3817 => 0.3924, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.49% (1.1194 => 1.1473, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.86% (1.1396 => 1.2520, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4499, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.64% (3.1578 => 3.3676, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626) SingleSource/Regression/C/uint64_to_float: 3.68% (0.5413 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.63% (3.6395 => 3.7717, std.dev.: 0.0031) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.79% (4.2280 => 4.3458, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.28% (1.7254 => 1.7648, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (0.8275 => 0.8405, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.47% (11.6436 => 11.8143, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.38% (0.9540 => 0.9672, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.18% (2.6546 => 2.6858, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.07% (6.5088 => 6.5787, std.dev.: 0.0048) MultiSource/Applications/minisat/minisat: 1.05% (9.1159 => 9.2114, std.dev.: 0.0268) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1311, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.03% (0.8651 => 0.1728, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.27% (5.2763 => 3.2573, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.67% (5.3855 => 3.6261, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.20% (5.3526 => 3.6288, std.dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -14.48% (54.1659 => 46.3208, std.dev.: 0.0336) MultiSource/Benchmarks/FreeBench/mason/mason: -13.19% (0.0811 => 0.0704) MultiSource/Applications/ClamAV/clamscan: -11.23% (22.1758 => 19.6854, std.dev.: 0.0249) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.93% (2.9384 => 2.6172, std.dev.: 0.0068) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.42% (1.1492 => 0.7651, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4245, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.93% (0.0998 => 0.0859, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.41% (1.2373 => 1.0961, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: -10.55% (1.5373 => 1.3751, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/mason/mason: -10.09% (0.2161 => 0.1943, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.34% (19.9488 => 18.2851, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.72% (1.8329 => 1.7098, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.33% (1.6805 => 1.5909, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.92% (1.5835 => 1.5056, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.13% (0.9957 => 0.9546, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.58% (3.2827 => 3.1652, std.dev.: 0.0091) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4954, std.dev.: 0.0107) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0991, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.07% (8.1563 => 7.9877, std.dev.: 0.0176) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.03% (8.6802 => 8.5041, std.dev.: 0.0161) SingleSource/Benchmarks/Misc/salsa20: -1.81% (10.2830 => 10.0973, std.dev.: 0.0209) SingleSource/UnitTests/Vector/multiplies: -1.75% (2.5528 => 2.5080, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6822, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4223, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout/lists: -1.16% (6.2999 => 6.2271, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout/hash: -1.09% (4.9088 => 4.8554, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.20% (0.5229 => 0.5867, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 7.99% (14.9895 => 16.1873, std.dev.: 0.0142) MultiSource/Benchmarks/MallocBench/gs/gs: 6.66% (4.1105 => 4.3841, std.dev.: 0.0169) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.71% (1.1048 => 1.2452, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.26% (7.1582 => 7.7495, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.72% (0.6222 => 0.7387, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36000.00% (0.0001 => 0.0361, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.69% (0.2116 => 0.2173, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 6 11:01:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 6 Oct 2012 13:01:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121006180103.BCEF12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4644?compare_to=4640&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4644, Order: 165362, Start Time: 2012-10-06 15:18:48, End Time: 2012-10-06 18:02:48 To: 4640, Order: 165361, Start Time: 2012-10-06 08:35:54, End Time: 2012-10-06 11:20:18 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (129 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 1037 (834 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 17.44% (0.3859 => 0.4532, std.dev.: 0.0122) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.03% (0.2086 => 0.2191, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.57% (124.4014 => 128.8467, std.dev.: 1.2790) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.11% (54.1999 => 54.8035, std.dev.: 0.0827) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/whetstone: -1.10% (2.8185 => 2.7874, std.dev.: 0.0110) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 10.36% (0.3446 => 0.3803, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.35% (0.3488 => 0.3849, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 10.30% (0.3465 => 0.3822, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 10.29% (1.5932 => 1.7572, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 10.27% (0.3496 => 0.3855, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.26% (0.3442 => 0.3795, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.23% (0.3460 => 0.3814, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.20% (0.3469 => 0.3823, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.05% (0.3643 => 0.4009, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.97% (0.3650 => 0.4014, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.94% (0.3724 => 0.4094, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.72% (0.5826 => 0.6334, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.66% (0.5889 => 0.6399, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.04% (0.2738 => 0.2958, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.88% (0.3060 => 0.3301, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 7.86% (0.3004 => 0.3240, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 7.84% (0.1619 => 0.1746, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.83% (0.2875 => 0.3100, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.75% (0.7171 => 0.7727, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/fibo: 7.52% (0.2725 => 0.2930, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.52% (0.2714 => 0.2918, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.51% (0.4994 => 0.5369, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.50% (1.3152 => 1.4139, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 7.48% (0.9909 => 1.0650, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.42% (0.3195 => 0.3432, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 7.40% (0.2823 => 0.3032, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.40% (0.5000 => 0.5370, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.38% (2.0673 => 2.2199, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.38% (0.2792 => 0.2998, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.35% (0.2911 => 0.3125, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/random: 7.35% (0.2803 => 0.3009, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.35% (1.6211 => 1.7402, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/matrix: 7.34% (0.2780 => 0.2984, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.33% (0.2729 => 0.2929, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.32% (0.2813 => 0.3019, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.32% (0.3362 => 0.3608, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 7.29% (0.2811 => 0.3016, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.27% (0.2750 => 0.2950, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.27% (0.4361 => 0.4678, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 7.17% (0.3096 => 0.3318, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.00% (0.3930 => 0.4205, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 6.98% (5.5417 => 5.9283, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/ary: 6.97% (0.3258 => 0.3485, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.96% (0.3477 => 0.3719, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.92% (0.3267 => 0.3493, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.91% (0.1620 => 0.1732, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.91% (0.1968 => 0.2104, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.90% (0.3317 => 0.3546, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 6.90% (0.2566 => 0.2743, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.87% (0.3726 => 0.3982, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 6.87% (0.4847 => 0.5180, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.85% (3.5627 => 3.8069, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 6.84% (0.3348 => 0.3577, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 6.81% (23.5202 => 25.1229, std.dev.: 0.0191) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.78% (0.5026 => 0.5367, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/moments: 6.77% (0.3678 => 0.3927, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.76% (0.3625 => 0.3870) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.73% (0.5900 => 0.6297, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 6.71% (0.6634 => 0.7079, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.70% (0.3282 => 0.3502, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.66% (0.3124 => 0.3332, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.63% (0.2866 => 0.3056, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.58% (0.4146 => 0.4419, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.53% (0.3845 => 0.4096, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.51% (0.2736 => 0.2914, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.50% (0.2014 => 0.2145, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.42% (0.3690 => 0.3927, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: 6.37% (0.4251 => 0.4522, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.36% (0.3981 => 0.4234, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.35% (0.4139 => 0.4402, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 6.26% (1.8794 => 1.9970, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.24% (2.7292 => 2.8996, std.dev.: 0.0039) MultiSource/Applications/d/make_dparser: 6.24% (1.0781 => 1.1454, std.dev.: 0.0047) MultiSource/Applications/ClamAV/clamscan: 6.21% (4.2109 => 4.4723, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.01% (0.6435 => 0.6822, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 5.97% (0.5012 => 0.5311, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.94% (0.3903 => 0.4135, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.90% (0.3084 => 0.3266, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 5.89% (1.4269 => 1.5109, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.87% (0.3271 => 0.3463, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.84% (0.3890 => 0.4117, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.80% (0.4658 => 0.4928, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.76% (0.2969 => 0.3140, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.70% (0.2737 => 0.2893, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.68% (4.4195 => 4.6706, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.66% (0.2068 => 0.2185, std.dev.: 0.0039) MultiSource/Applications/spiff/spiff: 5.58% (0.4029 => 0.4254, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.49% (0.2040 => 0.2152, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 5.47% (2.1013 => 2.2162, std.dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 5.43% (0.2691 => 0.2837, std.dev.: 0.0017) MultiSource/Applications/Burg/burg: 5.41% (0.5546 => 0.5846, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 5.37% (4.6177 => 4.8658, std.dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.23% (0.2103 => 0.2213, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 5.14% (2.1653 => 2.2767, std.dev.: 0.0030) MultiSource/Applications/treecc/treecc: 5.13% (0.7875 => 0.8279, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 5.08% (2.0346 => 2.1379, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.96% (1.9694 => 2.0671, std.dev.: 0.0032) MultiSource/Applications/hbd/hbd: 4.93% (0.9697 => 1.0175, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.85% (1.9966 => 2.0934, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 4.82% (0.2075 => 0.2175, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 4.64% (0.2391 => 0.2502, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.46% (0.7426 => 0.7757, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 4.26% (0.3498 => 0.3647, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.23% (0.5361 => 0.5588, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.10% (0.5584 => 0.5813, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.94% (11.6398 => 12.0980, std.dev.: 0.0206) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.90% (4.6926 => 4.8758, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.01% (0.4253 => 0.4381, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 2.66% (11.9555 => 12.2738, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6099, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6742, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-2: 4.82% (1.8057 => 1.8927, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1707, std.dev.: 0.1153) SingleSource/Benchmarks/Dhrystone/dry: 4.16% (14.0481 => 14.6330, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2101, std.dev.: 0.0415) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5062, std.dev.: 0.0084) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.49% (3.1722 => 3.2196, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2890, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5125, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5942, std.dev.: 0.0096) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.76% (25.4195 => 16.5827, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ary2: -8.70% (0.2402 => 0.2193, std.dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9762, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7993, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9586, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8006, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.13% (0.6293 => 0.6096, std.dev.: 0.0048) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7723, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.70% (17.2379 => 16.7726, std.dev.: 0.0422) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8604, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5749, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4962, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.17% (105.3826 => 104.1469, std.dev.: 0.0163) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0429, std.dev.: 0.0017) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 6 11:46:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 6 Oct 2012 13:46:41 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121006184641.AB5DF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4645?compare_to=4641&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4645, Order: 165363, Start Time: 2012-10-06 17:25:39, End Time: 2012-10-06 18:48:25 To: 4641, Order: 165362, Start Time: 2012-10-06 15:05:36, End Time: 2012-10-06 16:28:46 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (14 on baseline) Performance Regressions: 4 (94 on baseline) Performance Improvements: 5 (44 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 968 (753 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 7.46% (0.1474 => 0.1584, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.64% (0.7882 => 0.8248, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.19% (1.1602 => 1.1740, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 6.49% (21.5956 => 22.9971, std.dev.: 0.0158) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/kimwitu++/kc: -1.97% (16.6554 => 16.3276, std.dev.: 0.0379) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.44% (0.9174 => 0.9042, std.dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.49% (1.2578 => 1.2265, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.89% (60.0702 => 58.9346, std.dev.: 0.4066) SingleSource/Benchmarks/Misc/himenobmtxpa: -1.85% (4.4004 => 4.3190, std.dev.: 0.0258) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.33% (1.0291 => 1.0257, std.dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: -0.35% (0.6265 => 0.6243, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: 1.37% (0.1828 => 0.1853, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.62% (0.1607 => 0.1597, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.88% (0.3183 => 0.3211, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.27% (0.2438 => 0.2407, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.73% (0.3291 => 0.3267, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.63% (0.2377 => 0.2362, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: 6.67% (0.0435 => 0.0464, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -3.27% (0.0214 => 0.0207, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.02% (0.0197 => 0.0199, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.51% (0.0394 => 0.0396, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.64% (0.0305 => 0.0310, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 8.99% (0.0267 => 0.0291, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.61% (0.0328 => 0.0330, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 2.19% (0.0183 => 0.0187, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 1.02% (0.0197 => 0.0199, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: 2.38% (0.0252 => 0.0258, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -7.58% (0.0330 => 0.0305, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 100.00% (0.0005 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.42% (0.1422 => 0.1428, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: -0.58% (1.5502 => 1.5412, std.dev.: 0.0090) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 2.18% (0.1468 => 0.1500, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.54% (0.4046 => 0.4068, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.30% (0.1433 => 0.1357, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.33% (0.0568 => 0.0621, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 25.51% (0.0196 => 0.0246, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.97% (0.0661 => 0.0648, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.03% (1.1266 => 1.1269, std.dev.: 0.0407) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 125.00% (0.0012 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 14.29% (0.0021 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.40% (0.0642 => 0.0556, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 10.14% (0.0138 => 0.0152, std.dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.09% (0.7674 => 0.7667, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.02% (1.7067 => 1.7063, std.dev.: 0.0013) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 0.83% (0.0120 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 129.21% (0.0089 => 0.0204, std.dev.: 0.0011) SingleSource/UnitTests/2003-08-11-VaListArg: 177.78% (0.0090 => 0.0250, std.dev.: 0.0006) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -27.41% (4.1772 => 3.0323, std.dev.: 0.0306) SingleSource/Benchmarks/Shootout-C++/except: 83266.67% (0.0006 => 0.5002, std.dev.: 0.0020) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 50.00% (0.0004 => 0.0006, std.dev.: 0.0000) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.62% (0.0745 => 0.0921, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 12.02% (0.1414 => 0.1584, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.92% (0.1159 => 0.1274, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 9.85% (0.5309 => 0.5832, std.dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: 9.46% (2.1763 => 2.3822, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.39% (0.6410 => 0.7012, std.dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.13% (0.3582 => 0.3909, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 8.28% (0.6173 => 0.6684, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: 7.16% (1.0046 => 1.0765, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.97% (0.2552 => 0.2730, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 6.96% (1.1653 => 1.2464, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.81% (0.7722 => 0.8248, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.74% (1.5150 => 1.6171, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.71% (0.4248 => 0.4533, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 6.65% (0.3217 => 0.3431, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 6.64% (15.3105 => 16.3276, std.dev.: 0.0379) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.47% (0.7639 => 0.8133, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.44% (0.2886 => 0.3072, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 6.33% (0.6915 => 0.7353, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.01% (0.6069 => 0.6434, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/oourafft: 5.58% (0.1971 => 0.2081, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.47% (0.8569 => 0.9038, std.dev.: 0.0060) MultiSource/Applications/d/make_dparser: 5.43% (3.0225 => 3.1865, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.26% (0.2797 => 0.2944, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.25% (0.4880 => 0.5136, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.04% (0.2303 => 0.2419, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.97% (1.4408 => 1.5124, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.93% (0.3062 => 0.3213, std.dev.: 0.0037) MultiSource/Applications/Burg/burg: 4.86% (1.1440 => 1.1996, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.84% (1.1827 => 1.2400, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.84% (0.2106 => 0.2208, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.82% (0.3901 => 0.4089, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.82% (3.0758 => 3.2239, std.dev.: 0.0123) MultiSource/Applications/SPASS/SPASS: 4.79% (13.3238 => 13.9617, std.dev.: 0.0237) MultiSource/Benchmarks/Bullet/bullet: 4.72% (29.3170 => 30.7002, std.dev.: 0.0513) MultiSource/Applications/oggenc/oggenc: 4.68% (4.7455 => 4.9676, std.dev.: 0.0103) MultiSource/Applications/siod/siod: 4.63% (2.0972 => 2.1943, std.dev.: 0.0034) MultiSource/Applications/hbd/hbd: 4.61% (1.3268 => 1.3880, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/lists: 4.60% (0.2347 => 0.2455, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.60% (1.1672 => 1.2209, std.dev.: 0.0164) MultiSource/Benchmarks/McCat/09-vor/vor: 4.59% (0.3026 => 0.3165, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.52% (0.2654 => 0.2774, std.dev.: 0.0029) MultiSource/Applications/sgefa/sgefa: 4.52% (0.2877 => 0.3007, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.50% (6.2546 => 6.5358, std.dev.: 0.0652) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.46% (2.0317 => 2.1223, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.27% (0.3418 => 0.3564, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 4.26% (1.8798 => 1.9599, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.17% (0.2952 => 0.3075, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.09% (0.2662 => 0.2771, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.00% (1.2021 => 1.2502, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/hash: 3.95% (0.3520 => 0.3659, std.dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 3.95% (8.2186 => 8.5429, std.dev.: 0.0256) MultiSource/Benchmarks/Prolangs-C/football/football: 3.90% (0.8405 => 0.8733, std.dev.: 0.0098) MultiSource/Applications/lua/lua: 3.90% (3.5980 => 3.7383, std.dev.: 0.0140) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.81% (4.2815 => 4.4446, std.dev.: 0.0210) MultiSource/Benchmarks/Olden/bh/bh: 3.76% (0.2820 => 0.2926, std.dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: 3.65% (14.7256 => 15.2637, std.dev.: 0.0239) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.61% (4.0318 => 4.1773, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.49% (12.6413 => 13.0819, std.dev.: 0.0752) SingleSource/Benchmarks/Shootout-C++/moments: 3.40% (0.3412 => 0.3528, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.35% (0.5937 => 0.6136, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.31% (1.0689 => 1.1043, std.dev.: 0.0041) MultiSource/Applications/JM/ldecod/ldecod: 2.95% (6.4908 => 6.6824, std.dev.: 0.0182) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.91% (4.2616 => 4.3858, std.dev.: 0.0380) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.79% (8.2559 => 8.4861, std.dev.: 0.0542) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.78% (0.5963 => 0.6129, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.33% (1.3935 => 1.4260, std.dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: 2.31% (0.9425 => 0.9643, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 54.41% (0.0261 => 0.0403, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/pi: 41.37% (1.6538 => 2.3380, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 23.24% (0.0766 => 0.0944, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2277, std.dev.: 0.0212) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 21.04% (0.0499 => 0.0604, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/ary3: 15.33% (1.7426 => 2.0098, std.dev.: 0.0344) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.82% (4.0101 => 4.5644, std.dev.: 0.0125) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.65% (2.4042 => 2.7323, std.dev.: 0.0151) SingleSource/Benchmarks/McGill/queens: 10.66% (1.6261 => 1.7994, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/mason/mason: 9.77% (0.5004 => 0.5493, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.82% (0.2857 => 0.3109, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 8.62% (21.1721 => 22.9971, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout/lists: 8.58% (7.0025 => 7.6032, std.dev.: 0.0410) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.09% (0.3301 => 0.3469, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: 4.08% (15.2242 => 15.8451, std.dev.: 0.0410) SingleSource/Benchmarks/Misc/dt: 3.99% (0.9851 => 1.0244, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.86% (3.4080 => 3.5397, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 3.78% (3.5520 => 3.6862, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.01% (0.5587 => 0.5755, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 2.80% (6.9722 => 7.1672, std.dev.: 0.0744) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.79% (6.6312 => 6.8160, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.52% (4.2129 => 4.3190, std.dev.: 0.0258) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.44% (2.6656 => 2.7306, std.dev.: 0.0172) SingleSource/Benchmarks/Misc/whetstone: 1.83% (2.3453 => 2.3882, std.dev.: 0.0143) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.48% (4.6127 => 4.6810, std.dev.: 0.0224) MultiSource/Benchmarks/Olden/power/power: 1.46% (1.4184 => 1.4391, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -43.06% (0.2996 => 0.1706, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -42.64% (0.0591 => 0.0339, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.42% (1.4189 => 1.1576, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.81% (1.4113 => 1.1740, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.09% (0.3497 => 0.2095, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.97% (5.2665 => 4.1619, std.dev.: 0.0601) SingleSource/Benchmarks/Shootout-C++/ary3: -20.40% (1.7473 => 1.3909, std.dev.: 0.1304) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.17% (1.7361 => 1.4728, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1578, std.dev.: 0.0240) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -10.07% (15.8312 => 14.2377, std.dev.: 0.5944) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.46% (1.1647 => 1.0545, std.dev.: 0.0391) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.50% (3.2007 => 2.9288, std.dev.: 0.0168) SingleSource/Benchmarks/Misc/flops: -8.36% (9.5474 => 8.7496, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.32% (1.4034 => 1.2866, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.85% (3.6254 => 3.3772, std.dev.: 0.0255) SingleSource/Benchmarks/Shootout-C++/fibo: -6.58% (4.6355 => 4.3305, std.dev.: 0.0437) MultiSource/Applications/lambda-0_1_3/lambda: -6.58% (7.6833 => 7.1779, std.dev.: 0.0330) SingleSource/Benchmarks/Misc/richards_benchmark: -6.52% (1.4441 => 1.3499, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.05% (2.9728 => 2.7929, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.41% (3.9413 => 3.7282, std.dev.: 0.0312) SingleSource/Benchmarks/Shootout/fib2: -5.22% (4.4195 => 4.1888, std.dev.: 0.0256) MultiSource/Benchmarks/Olden/bh/bh: -4.90% (2.5166 => 2.3932, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.65% (0.4564 => 0.4352, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.29% (1.2959 => 1.2403, std.dev.: 0.0124) MultiSource/Benchmarks/mafft/pairlocalalign: -4.27% (62.4126 => 59.7468, std.dev.: 0.0954) MultiSource/Applications/SPASS/SPASS: -4.15% (8.5323 => 8.1786, std.dev.: 0.0924) MultiSource/Applications/sgefa/sgefa: -4.11% (0.3746 => 0.3592, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.66% (61.1734 => 58.9346, std.dev.: 0.4066) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.59% (1.2722 => 1.2265, std.dev.: 0.0055) SingleSource/Benchmarks/McGill/misr: -3.40% (0.4296 => 0.4150, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/methcall: -3.18% (9.2503 => 8.9560, std.dev.: 0.0315) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.94% (3.7496 => 3.6393, std.dev.: 0.0246) MultiSource/Benchmarks/PAQ8p/paq8p: -2.47% (92.7467 => 90.4540, std.dev.: 0.4865) MultiSource/Applications/SIBsim4/SIBsim4: -2.28% (3.4230 => 3.3451, std.dev.: 0.0264) SingleSource/Benchmarks/Dhrystone/dry: -2.24% (2.4013 => 2.3474, std.dev.: 0.0023) MultiSource/Applications/aha/aha: -2.01% (3.4286 => 3.3597, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/hash2: -1.89% (3.4876 => 3.4218, std.dev.: 0.0178) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.88% (2.3569 => 2.3126, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: -1.88% (1.0926 => 1.0721, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.64% (9.3855 => 9.2315, std.dev.: 0.0102) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3054, std.dev.: 0.0636) SingleSource/Benchmarks/Dhrystone/fldry: -1.39% (2.4971 => 2.4624, std.dev.: 0.0030) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.33% (27.1724 => 26.8116, std.dev.: 0.0274) MultiSource/Applications/JM/lencod/lencod: -1.21% (6.7458 => 6.6642, std.dev.: 0.0295) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.78% (0.9980 => 1.0257, std.dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: 3.67% (0.6022 => 0.6243, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: 11.22% (0.1666 => 0.1853, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.77% (0.1554 => 0.1597, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.15% (0.3083 => 0.3211, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.54% (0.2394 => 0.2407, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.90% (0.3175 => 0.3267, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.61% (0.2302 => 0.2362, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: 3.34% (0.0449 => 0.0464, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -13.75% (0.0240 => 0.0207, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 3.65% (0.0192 => 0.0199, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.54% (0.0390 => 0.0396, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 2.99% (0.0301 => 0.0310, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.46% (0.0284 => 0.0291, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.85% (0.0324 => 0.0330, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 5.65% (0.0177 => 0.0187, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 5.29% (0.0189 => 0.0199, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: 3.61% (0.0249 => 0.0258, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -6.15% (0.0325 => 0.0305, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1429 => 0.1428, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 2.62% (1.5019 => 1.5412, std.dev.: 0.0090) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1501 => 0.1500, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.60% (0.4264 => 0.4068, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.97% (0.1344 => 0.1357, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.43% (0.0589 => 0.0621, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.03% (0.0232 => 0.0246, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.41% (0.0639 => 0.0648, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.71% (1.1350 => 1.1269, std.dev.: 0.0407) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 350.00% (0.0006 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.72% (0.0637 => 0.0556, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.21% (0.0246 => 0.0152, std.dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.67% (0.7541 => 0.7667, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.07% (1.5363 => 1.7063, std.dev.: 0.0013) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 2.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 6 11:51:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 6 Oct 2012 13:51:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121006185113.BF9942A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4646?compare_to=4642&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4646, Order: 165363, Start Time: 2012-10-06 17:38:35, End Time: 2012-10-06 18:52:58 To: 4642, Order: 165362, Start Time: 2012-10-06 15:18:52, End Time: 2012-10-06 16:33:37 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (178 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1042 (758 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 22.20% (2.0176 => 2.4656, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.52% (0.1410 => 0.1657, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 15.62% (0.0826 => 0.0955, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 14.31% (0.2243 => 0.2564, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.71% (0.0834 => 0.0940, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/tsp/tsp: 12.44% (0.1013 => 0.1139, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 12.30% (1.3693 => 1.5377, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 12.11% (0.4328 => 0.4852, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.82% (0.1413 => 0.1580, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 11.74% (0.5818 => 0.6501, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.52% (0.1588 => 0.1771, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 11.52% (0.4062 => 0.4530, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 11.51% (0.2781 => 0.3101, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 11.45% (0.5748 => 0.6406, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.39% (0.2721 => 0.3031, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.29% (0.1072 => 0.1193, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.25% (0.2782 => 0.3095, std.dev.: 0.0087) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.20% (3.9660 => 4.4100, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 11.18% (0.7038 => 0.7825, std.dev.: 0.0107) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.00% (0.0964 => 0.1070, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.99% (0.3485 => 0.3868, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.97% (1.2193 => 1.3530, std.dev.: 0.0041) SingleSource/UnitTests/ObjC++/property-reference: 10.96% (0.7061 => 0.7835, std.dev.: 0.0101) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.87% (0.7710 => 0.8548, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 10.84% (0.3293 => 0.3650, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.84% (0.6283 => 0.6964, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.79% (0.2596 => 0.2876, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.78% (0.1327 => 0.1470, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.75% (0.9199 => 1.0188, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/hello: 10.70% (0.2607 => 0.2886, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.67% (0.3899 => 0.4315, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.66% (0.4016 => 0.4444, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.66% (0.3022 => 0.3344, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 10.65% (0.2760 => 0.3054, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.65% (1.4563 => 1.6114, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/strcat: 10.64% (0.2726 => 0.3016, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 10.63% (0.2690 => 0.2976, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 10.61% (0.3149 => 0.3483, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.58% (0.2655 => 0.2936, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 10.55% (0.2937 => 0.3247, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 10.54% (0.2628 => 0.2905, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 10.52% (0.3107 => 0.3434, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 10.51% (0.3453 => 0.3816, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.49% (0.3489 => 0.3855, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.49% (0.3756 => 0.4150, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.49% (0.2765 => 0.3055, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 10.47% (0.3868 => 0.4273, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.46% (1.9828 => 2.1903, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.45% (0.2966 => 0.3276, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.41% (0.5265 => 0.5813, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 10.39% (0.2761 => 0.3048, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.27% (0.6959 => 0.7674, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 10.26% (0.1062 => 0.1171, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 10.24% (0.3192 => 0.3519, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.24% (0.2696 => 0.2972, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 10.21% (0.2988 => 0.3293, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.20% (0.3580 => 0.3945, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.16% (1.1364 => 1.2519, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.14% (0.4390 => 0.4835, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 9.97% (13.8202 => 15.1979, std.dev.: 0.0174) MultiSource/Applications/sgefa/sgefa: 9.95% (0.2995 => 0.3293, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 9.93% (0.3534 => 0.3885, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.75% (0.4791 => 0.5258, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 9.50% (0.1589 => 0.1740, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 9.47% (1.0313 => 1.1290, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.42% (0.1157 => 0.1266, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.40% (0.5577 => 0.6101, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.27% (0.4379 => 0.4785, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 9.27% (0.2945 => 0.3218, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.27% (0.3130 => 0.3420, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.17% (0.1276 => 0.1393, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.13% (0.1435 => 0.1566, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.09% (0.2914 => 0.3179, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.07% (0.8698 => 0.9487, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.03% (0.2127 => 0.2319, std.dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 9.01% (16.6129 => 18.1100, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/football/football: 9.00% (0.8310 => 0.9058, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.96% (0.1986 => 0.2164, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 8.91% (1.1061 => 1.2046, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.85% (0.7460 => 0.8120, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.84% (0.3755 => 0.4087, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 8.76% (0.6744 => 0.7335, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.75% (0.3246 => 0.3530, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.73% (0.5637 => 0.6129, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 8.73% (0.3220 => 0.3501, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 8.53% (3.8646 => 4.1943, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.48% (7.2180 => 7.8301, std.dev.: 0.0031) MultiSource/Applications/spiff/spiff: 8.43% (0.7506 => 0.8139, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.41% (0.2140 => 0.2320, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 8.41% (1.0594 => 1.1485, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.36% (0.1865 => 0.2021, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.35% (0.8818 => 0.9554, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 8.28% (3.1889 => 3.4531, std.dev.: 0.0047) MultiSource/Applications/treecc/treecc: 8.25% (1.9270 => 2.0860, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.21% (0.2023 => 0.2189, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 8.04% (1.2749 => 1.3774, std.dev.: 0.0108) MultiSource/Applications/siod/siod: 8.04% (2.1791 => 2.3542, std.dev.: 0.0069) MultiSource/Applications/viterbi/viterbi: 7.98% (0.1478 => 0.1596, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.90% (0.1569 => 0.1693, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 7.89% (0.3131 => 0.3378, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 7.86% (0.2925 => 0.3155, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.84% (3.6692 => 3.9568, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.83% (0.1789 => 0.1929, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 7.79% (14.8535 => 16.0109, std.dev.: 0.0153) MultiSource/Benchmarks/Olden/em3d/em3d: 7.79% (0.1657 => 0.1786, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.77% (0.6576 => 0.7087, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.70% (4.3801 => 4.7173, std.dev.: 0.0041) MultiSource/Applications/oggenc/oggenc: 7.69% (4.6629 => 5.0215, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/05-eks/eks: 7.68% (0.4113 => 0.4429, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 7.67% (8.4961 => 9.1481, std.dev.: 0.0141) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.66% (0.3511 => 0.3780, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.63% (0.6135 => 0.6603, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.62% (4.4433 => 4.7821, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.61% (1.3245 => 1.4253, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 7.35% (1.2292 => 1.3195, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/bigfib: 7.25% (0.6250 => 0.6703, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.15% (0.2504 => 0.2683, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.04% (3.2742 => 3.5047, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.02% (0.9108 => 0.9747, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.97% (4.9865 => 5.3342, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.68% (0.4805 => 0.5126, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.68% (1.1333 => 1.2090, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 6.67% (0.2008 => 0.2142, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.58% (1.5188 => 1.6188, std.dev.: 0.0065) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.38% (0.1819 => 0.1935, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.32% (0.4003 => 0.4256, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 6.30% (6.5754 => 6.9898, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.26% (0.3245 => 0.3448, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 6.23% (0.3914 => 0.4158, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 6.12% (0.3578 => 0.3797, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 6.10% (0.3789 => 0.4020, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 5.98% (0.3646 => 0.3864, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.98% (6.2785 => 6.6537, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/property: 5.96% (0.3940 => 0.4175, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 5.92% (0.3601 => 0.3814, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.89% (0.3650 => 0.3865, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 5.87% (0.3663 => 0.3878, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 5.85% (0.3623 => 0.3835, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 5.79% (3.7467 => 3.9637, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.69% (2.1007 => 2.2202, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.69% (0.2321 => 0.2453, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.25% (13.2842 => 13.9818, std.dev.: 0.0054) MultiSource/Applications/sqlite3/sqlite3: 3.59% (16.2614 => 16.8446, std.dev.: 0.0160) MultiSource/Applications/ClamAV/clamscan: 3.41% (14.5298 => 15.0246, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5176, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.33% (1.8175 => 2.2597, std.dev.: 0.0492) SingleSource/Benchmarks/Misc/richards_benchmark: 11.05% (1.1560 => 1.2837, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4140, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.25% (1.2998 => 1.3810, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0050, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (1.7081 => 1.7749, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6765, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9857, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 3.30% (10.7476 => 11.1028, std.dev.: 0.0103) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.14% (7.4271 => 7.5858, std.dev.: 0.0039) MultiSource/Applications/lemon/lemon: 1.57% (1.4298 => 1.4522, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5143, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9675, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1876, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.16% (5.5130 => 5.5767, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0271, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 1.03% (12.4560 => 12.5840, std.dev.: 0.0074) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.27% (0.2670 => 0.1408, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.83% (0.4657 => 0.3873, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -15.70% (0.0707 => 0.0596, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.95% (1.3813 => 1.1886, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.90% (1.3819 => 1.1898, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.61% (22.5627 => 21.7489, std.dev.: 0.0215) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.33% (1.0460 => 0.8543, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.64% (0.0997 => 0.0861, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.15% (0.2238 => 0.1966, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -11.57% (1.2308 => 1.0884, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.22% (20.3410 => 18.2627, std.dev.: 0.0088) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.53% (1.3780 => 1.2880, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0125) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5150, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8007, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.24% (0.9996 => 0.9572, std.dev.: 0.0089) MultiSource/Applications/siod/siod: -3.58% (3.2729 => 3.1557, std.dev.: 0.0210) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.52% (1.7688 => 1.7065, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.96% (0.4867 => 0.4723, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.41% (26.5159 => 25.8770, std.dev.: 0.0166) MultiSource/Applications/spiff/spiff: -2.40% (3.0263 => 2.9538, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.29% (1.9762 => 1.9310, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.03% (0.6589 => 0.6455, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.82% (6.3560 => 6.2403, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7139, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0075, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -1.29% (4.5928 => 4.5336, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/heapsort: -1.22% (3.9173 => 3.8696, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4950, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: -1.16% (9.3358 => 9.2277, std.dev.: 0.0141) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2575, std.dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 6 11:56:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 6 Oct 2012 13:56:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121006185618.5F5B52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4647?compare_to=4643&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4647, Order: 165363, Start Time: 2012-10-06 17:38:34, End Time: 2012-10-06 18:58:02 To: 4643, Order: 165362, Start Time: 2012-10-06 15:18:47, End Time: 2012-10-06 16:38:16 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (154 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1025 (764 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.03% (0.5867 => 0.5869, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: -0.08% (16.1873 => 16.1750, std.dev.: 0.0227) MultiSource/Benchmarks/Bullet/bullet: 0.03% (54.8867 => 54.9054, std.dev.: 0.0077) MultiSource/Benchmarks/MallocBench/gs/gs: 0.15% (4.3841 => 4.3905, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.02% (1.2452 => 1.2455, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.05% (7.7495 => 7.7536, std.dev.: 0.0101) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.01% (0.7387 => 0.7386, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 1.11% (0.0361 => 0.0365, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.95% (0.2173 => 0.2237, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -13.18% (63.2438 => 54.9054, std.dev.: 0.0077) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.29% (14.1553 => 18.7266, std.dev.: 0.0218) SingleSource/Benchmarks/Misc-C++-EH/spirit: 60.50% (3.4629 => 5.5581, std.dev.: 0.0033) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14223.19% (0.0720 => 10.3127, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952500.00% (0.0001 => 9.9526, std.dev.: 0.0010) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 48.90% (0.2554 => 0.3803, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: 46.57% (10.3673 => 15.1956, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/richards_benchmark: 31.26% (0.1622 => 0.2129, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 30.59% (0.1056 => 0.1379, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.06% (7.0540 => 8.1161, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.80% (2.2022 => 2.5282, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/flops: 14.59% (0.1432 => 0.1641) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.24% (0.1566 => 0.1789, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.41% (1.7609 => 1.9794, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.06% (0.0871 => 0.0976, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.09% (0.3543 => 0.3936, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.83% (0.1625 => 0.1801, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.80% (0.1584 => 0.1755, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 10.73% (0.3282 => 0.3634, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.60% (0.3473 => 0.3841, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.44% (0.3543 => 0.3913, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 10.44% (0.3497 => 0.3862, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.41% (0.3516 => 0.3882, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.36% (0.3561 => 0.3930, std.dev.: 0.0083) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.22% (0.1438 => 0.1585, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 10.18% (0.3694 => 0.4070, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.14% (0.3828 => 0.4216, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 10.07% (0.1440 => 0.1585, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.03% (0.3927 => 0.4321, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.98% (0.3177 => 0.3494, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/property: 9.91% (0.3886 => 0.4271, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.33% (0.1125 => 0.1230, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.98% (0.4879 => 0.5317, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 8.97% (0.7433 => 0.8100, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.97% (0.8172 => 0.8905, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: 8.96% (0.5925 => 0.6456, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 8.95% (0.7115 => 0.7752, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.91% (0.6675 => 0.7270, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 8.91% (9.4845 => 10.3298, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.89% (1.5415 => 1.6785, std.dev.: 0.0044) SingleSource/Benchmarks/McGill/chomp: 8.76% (0.1655 => 0.1800, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.74% (0.6030 => 0.6557, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 8.71% (10.4361 => 11.3455, std.dev.: 0.0161) MultiSource/Applications/sgefa/sgefa: 8.56% (0.3109 => 0.3375, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.41% (0.4615 => 0.5003, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.38% (0.4103 => 0.4447, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.19% (0.5105 => 0.5523, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 8.18% (0.3423 => 0.3703, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.16% (0.7326 => 0.7924, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.15% (1.3050 => 1.4113, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/em3d/em3d: 8.08% (0.1695 => 0.1832, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.06% (0.2271 => 0.2454, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 8.04% (3.3354 => 3.6037, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.96% (0.2700 => 0.2915, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.95% (0.3307 => 0.3570, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 7.93% (5.7591 => 6.2159, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.91% (0.3136 => 0.3384, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.90% (0.5860 => 0.6323, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.83% (4.2646 => 4.5984, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.81% (0.1510 => 0.1628, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 7.80% (0.3422 => 0.3689, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.78% (0.5569 => 0.6002, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 7.76% (0.6456 => 0.6957, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.75% (0.2065 => 0.2225, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.71% (0.4203 => 0.4527, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.67% (0.4289 => 0.4618, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.66% (0.9765 => 1.0513, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.65% (0.2758 => 0.2969, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.65% (0.8067 => 0.8684, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.64% (0.2107 => 0.2268, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.63% (0.3121 => 0.3359, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 7.61% (0.7835 => 0.8431, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.59% (4.9449 => 5.3202, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.58% (5.0018 => 5.3810, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.58% (0.2891 => 0.3110, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.57% (0.2905 => 0.3125, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.55% (8.1363 => 8.7505, std.dev.: 0.0039) MultiSource/Applications/hbd/hbd: 7.54% (1.5603 => 1.6779, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.53% (0.3826 => 0.4114, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.51% (0.5020 => 0.5397, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.51% (0.3650 => 0.3924, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.44% (0.4636 => 0.4981, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 7.36% (1.1642 => 1.2499, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 7.35% (0.3387 => 0.3636, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.35% (0.3865 => 0.4149, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 7.35% (0.2831 => 0.3039, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.22% (0.1940 => 0.2080, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 7.21% (0.3232 => 0.3465, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 7.19% (0.4048 => 0.4339, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.15% (7.9617 => 8.5308, std.dev.: 0.0092) MultiSource/Applications/lua/lua: 7.12% (3.8723 => 4.1482, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/fibo: 7.12% (0.2725 => 0.2919, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.11% (0.2756 => 0.2952, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 7.11% (0.3603 => 0.3859, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.07% (2.0665 => 2.2126, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/hash2: 6.99% (0.4620 => 0.4943, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 6.98% (0.3684 => 0.3941, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 6.98% (0.3283 => 0.3512, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 6.95% (0.1555 => 0.1663, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.93% (0.2872 => 0.3071, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.91% (0.3098 => 0.3312, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.90% (0.2871 => 0.3069, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.89% (0.3162 => 0.3380, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.83% (0.3441 => 0.3676, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 6.82% (0.3052 => 0.3260, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 6.80% (1.0722 => 1.1451, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 6.79% (2.0273 => 2.1650, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.65% (0.2603 => 0.2776, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 6.60% (0.2802 => 0.2987, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.57% (0.2877 => 0.3066, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.56% (1.1861 => 1.2639, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 6.56% (0.2714 => 0.2892, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.49% (1.5859 => 1.6888, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.48% (0.2793 => 0.2974, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 6.39% (0.3379 => 0.3595, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 6.38% (0.3180 => 0.3383, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 6.23% (2.2969 => 2.4399, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.22% (0.6450 => 0.6851, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.19% (0.5981 => 0.6351, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 6.14% (21.9371 => 23.2845, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/football/football: 6.10% (0.8921 => 0.9465, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 5.95% (0.4299 => 0.4555, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.76% (0.4064 => 0.4298, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.57% (2.2024 => 2.3250, std.dev.: 0.0239) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.39% (1.4186 => 1.4951, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.35% (0.1906 => 0.2008, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 5.08% (0.3131 => 0.3290, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 5.07% (1.1840 => 1.2440, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.84% (1.2842 => 1.3463, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.81% (0.2266 => 0.2375, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.46% (0.8101 => 0.8462, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.67% (14.3668 => 14.8946, std.dev.: 0.0185) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.41% (0.3427 => 0.3544, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 3.25% (17.1811 => 17.7388, std.dev.: 0.0119) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.86% (0.3817 => 0.3926, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.80% (3.8922 => 4.0012, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.49% (1.1194 => 1.1473, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.97% (1.1396 => 1.2532, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4500, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3683, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.65% (0.3463 => 0.3624, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.4162 => 0.4322, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 3.71% (0.5413 => 0.5614, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.58% (3.6395 => 3.7697, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.88% (4.2280 => 4.3497, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7655, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8126, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.35% (0.9540 => 0.9669, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.22% (2.6546 => 2.6869, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.18% (6.5088 => 6.5859, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1310, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.03% (0.8651 => 0.1728, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.31% (5.2763 => 3.2549, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.67% (5.3855 => 3.6261, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.18% (5.3526 => 3.6304, std.dev.: 0.0059) SingleSource/UnitTests/Vector/constpool: -14.46% (54.1659 => 46.3330, std.dev.: 0.0277) MultiSource/Benchmarks/FreeBench/mason/mason: -13.32% (0.0811 => 0.0703, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -11.19% (22.1758 => 19.6945, std.dev.: 0.0209) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.87% (2.9384 => 2.6189, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.37% (1.1492 => 0.7657, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.69% (1.6925 => 1.4269, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.73% (0.0998 => 0.0861, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.21% (1.2373 => 1.0986, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: -10.43% (1.5373 => 1.3769, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/mason/mason: -9.90% (0.2161 => 0.1947, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.26% (19.9488 => 18.3005, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.72% (1.8329 => 1.7097, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.29% (1.6805 => 1.5916, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5081, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.73% (1.3677 => 1.3167, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.63% (3.2827 => 3.1637, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.52% (0.9957 => 0.9607, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4929, std.dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0984, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.28% (8.6802 => 8.4824, std.dev.: 0.0354) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.14% (0.4808 => 0.4705, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.12% (8.1563 => 7.9832, std.dev.: 0.0195) SingleSource/Benchmarks/Misc/salsa20: -1.98% (10.2830 => 10.0793, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6834, std.dev.: 0.0014) SingleSource/UnitTests/Vector/multiplies: -1.64% (2.5528 => 2.5109, std.dev.: 0.0018) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.24% (0.5229 => 0.5869, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 7.91% (14.9895 => 16.1750, std.dev.: 0.0227) MultiSource/Benchmarks/MallocBench/gs/gs: 6.81% (4.1105 => 4.3905, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.74% (1.1048 => 1.2455, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.32% (7.1582 => 7.7536, std.dev.: 0.0101) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.71% (0.6222 => 0.7386, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36400.00% (0.0001 => 0.0365, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.72% (0.2116 => 0.2237, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 6 13:25:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 6 Oct 2012 15:25:25 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121006202525.226262A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4648?compare_to=4645&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4648, Order: 165365, Start Time: 2012-10-06 19:04:18, End Time: 2012-10-06 20:27:10 To: 4645, Order: 165363, Start Time: 2012-10-06 17:25:39, End Time: 2012-10-06 18:48:25 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (14 on baseline) Performance Regressions: 7 (103 on baseline) Performance Improvements: 3 (46 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 967 (742 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Bullet/bullet: 1.55% (30.7002 => 31.1754, std.dev.: 0.0971) MultiSource/Benchmarks/mafft/pairlocalalign: 1.14% (8.5429 => 8.6401, std.dev.: 0.0299) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.13% (0.9712 => 0.9822, std.dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.76% (1.3518 => 1.4162, std.dev.: 0.0102) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.80% (2.4619 => 2.5555, std.dev.: 0.0290) SingleSource/Benchmarks/BenchmarkGame/partialsums: 1.23% (1.0043 => 1.0167, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.13% (4.5105 => 4.5613, std.dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -5.47% (41.4866 => 39.2186, std.dev.: 0.1643) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.11% (1.1506 => 1.1263, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.30% (1.6355 => 1.6143, std.dev.: 0.0057) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.68% (1.0257 => 1.0187, std.dev.: 0.0110) MultiSource/Applications/sqlite3/sqlite3: 0.29% (0.6243 => 0.6261, std.dev.: 0.0093) MultiSource/Benchmarks/McCat/08-main/main: -1.30% (0.1853 => 0.1829, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.50% (0.1597 => 0.1605, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.97% (0.3211 => 0.3242, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.50% (0.2407 => 0.2419, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.03% (0.3267 => 0.3266, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.47% (0.2362 => 0.2351, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: 0.43% (0.0464 => 0.0466, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 21.26% (0.0207 => 0.0251, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -33.67% (0.0199 => 0.0132, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.51% (0.0396 => 0.0394, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -23.23% (0.0310 => 0.0238, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0291 => 0.0291, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0330 => 0.0330, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: -3.74% (0.0187 => 0.0180, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -1.51% (0.0199 => 0.0196, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -3.10% (0.0258 => 0.0250, std.dev.: 0.0009) SingleSource/UnitTests/byval-alignment: 9.84% (0.0305 => 0.0335, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.28% (0.1428 => 0.1432, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.60% (1.5412 => 1.5658, std.dev.: 0.0080) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 3.67% (0.1500 => 0.1555, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.50% (0.4068 => 0.4007, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.87% (0.1357 => 0.1396, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.97% (0.0621 => 0.0615, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -19.92% (0.0246 => 0.0197, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.08% (0.0648 => 0.0641, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.01% (1.1269 => 1.1270, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0027 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -4.17% (0.0024 => 0.0023, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 15.65% (0.0556 => 0.0643, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 67.11% (0.0152 => 0.0254, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.09% (0.7667 => 0.7660, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 0.03% (1.7063 => 1.7068, std.dev.: 0.0012) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 119.10% (0.0089 => 0.0195, std.dev.: 0.0013) SingleSource/UnitTests/2003-08-11-VaListArg: 178.89% (0.0090 => 0.0251, std.dev.: 0.0002) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -27.23% (4.1772 => 3.0398, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/except: 82516.67% (0.0006 => 0.4957, std.dev.: 0.0044) SingleSource/Regression/C++/EH/ctor_dtor_count: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 24.43% (0.0745 => 0.0927, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.22% (0.1159 => 0.1289, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.97% (0.1414 => 0.1555, std.dev.: 0.0024) MultiSource/Benchmarks/PAQ8p/paq8p: 9.88% (2.1763 => 2.3913, std.dev.: 0.0145) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.83% (0.6410 => 0.7040, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 9.42% (0.5309 => 0.5809, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.30% (0.3582 => 0.3915, std.dev.: 0.0069) MultiSource/Applications/minisat/minisat: 8.16% (0.6173 => 0.6677, std.dev.: 0.0077) MultiSource/Applications/SIBsim4/SIBsim4: 7.55% (1.1653 => 1.2533, std.dev.: 0.0038) MultiSource/Applications/lemon/lemon: 7.53% (1.0046 => 1.0802, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.52% (0.2552 => 0.2744, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.07% (1.5150 => 1.6221, std.dev.: 0.0073) MultiSource/Applications/kimwitu++/kc: 7.04% (15.3105 => 16.3887, std.dev.: 0.0473) MultiSource/Benchmarks/Bullet/bullet: 6.34% (29.3170 => 31.1754, std.dev.: 0.0971) MultiSource/Applications/lambda-0_1_3/lambda: 6.32% (0.6915 => 0.7352, std.dev.: 0.0084) MultiSource/Applications/d/make_dparser: 6.16% (3.0225 => 3.2088, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.99% (0.2886 => 0.3059, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.98% (0.6069 => 0.6432, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.93% (0.2797 => 0.2963, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.89% (0.7639 => 0.8089, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.69% (0.3901 => 0.4123, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.51% (0.4248 => 0.4482, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.45% (0.3062 => 0.3229, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.29% (0.8569 => 0.9022, std.dev.: 0.0087) MultiSource/Benchmarks/mafft/pairlocalalign: 5.13% (8.2186 => 8.6401, std.dev.: 0.0299) MultiSource/Applications/hbd/hbd: 5.08% (1.3268 => 1.3942, std.dev.: 0.0114) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.99% (1.1672 => 1.2255, std.dev.: 0.0074) MultiSource/Applications/oggenc/oggenc: 4.97% (4.7455 => 4.9815, std.dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.96% (0.4880 => 0.5122, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/18-imp/imp: 4.91% (0.3217 => 0.3375, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.89% (0.2106 => 0.2209, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.2654 => 0.2783, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 4.77% (13.3238 => 13.9592, std.dev.: 0.0235) MultiSource/Applications/Burg/burg: 4.76% (1.1440 => 1.1984, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.69% (0.7226 => 0.7565, std.dev.: 0.0061) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.63% (6.2546 => 6.5439, std.dev.: 0.0296) MultiSource/Applications/siod/siod: 4.58% (2.0972 => 2.1933, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/lists: 4.56% (0.2347 => 0.2454, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.44% (1.2021 => 1.2555, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.44% (1.1827 => 1.2352, std.dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.44% (1.4408 => 1.5047, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.43% (0.2303 => 0.2405, std.dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: 4.41% (0.2877 => 0.3004, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 4.38% (0.3520 => 0.3674, std.dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 4.31% (1.0821 => 1.1287, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.30% (0.2952 => 0.3079, std.dev.: 0.0029) MultiSource/Applications/treecc/treecc: 4.18% (1.8798 => 1.9584, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/lists1: 4.08% (0.2771 => 0.2884, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.06% (0.2662 => 0.2770, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.05% (0.9029 => 0.9395, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (3.0758 => 3.1983, std.dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.81% (2.0317 => 2.1091, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.74% (1.3935 => 1.4456, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.73% (12.6413 => 13.1126, std.dev.: 0.1518) MultiSource/Applications/lua/lua: 3.71% (3.5980 => 3.7315, std.dev.: 0.0320) MultiSource/Benchmarks/MallocBench/gs/gs: 3.70% (3.8796 => 4.0233, std.dev.: 0.0429) MultiSource/Benchmarks/McCat/09-vor/vor: 3.67% (0.3026 => 0.3137, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.66% (0.3418 => 0.3543, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.57% (0.4596 => 0.4760, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.57% (0.5636 => 0.5837, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.55% (0.4562 => 0.4724, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/football/football: 3.52% (0.8405 => 0.8701, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.44% (1.0689 => 1.1057, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/hash2: 3.43% (0.3847 => 0.3979, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.37% (0.5937 => 0.6137, std.dev.: 0.0073) MultiSource/Applications/JM/lencod/lencod: 3.35% (14.7256 => 15.2189, std.dev.: 0.1299) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.29% (4.2616 => 4.4019, std.dev.: 0.0280) MultiSource/Applications/JM/ldecod/ldecod: 3.25% (6.4908 => 6.7015, std.dev.: 0.0559) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.11% (4.0318 => 4.1571, std.dev.: 0.0272) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.08% (0.5740 => 0.5917, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.06% (4.3380 => 4.4709, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.68% (4.2815 => 4.3961, std.dev.: 0.0309) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.50% (8.2559 => 8.4619, std.dev.: 0.0752) MultiSource/Applications/hexxagon/hexxagon: 2.39% (0.9425 => 0.9650, std.dev.: 0.0084) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.39% (1.6538 => 2.3383, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 23.50% (0.0766 => 0.0946, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/matrix: 22.14% (3.4629 => 4.2296, std.dev.: 0.0208) SingleSource/Benchmarks/Shootout/ary3: 14.87% (1.7426 => 2.0018, std.dev.: 0.0102) SingleSource/Benchmarks/Stanford/Puzzle: 13.89% (0.1433 => 0.1632, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.85% (4.0101 => 4.5655, std.dev.: 0.0143) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.11% (2.4042 => 2.7195, std.dev.: 0.0159) SingleSource/Benchmarks/McGill/queens: 10.87% (1.6261 => 1.8028, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/mason/mason: 10.17% (0.5004 => 0.5513, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: 9.00% (7.0025 => 7.6325, std.dev.: 0.0099) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.79% (0.2857 => 0.3108, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.34% (1.0063 => 1.0902, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.78% (0.8498 => 0.9074, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/dt: 4.30% (0.9851 => 1.0275, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.21% (0.3301 => 0.3440, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.88% (3.4080 => 3.5402, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: 3.86% (15.2242 => 15.8121, std.dev.: 0.0531) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.82% (40.4792 => 42.0263, std.dev.: 0.5404) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.51% (0.5876 => 0.6082, std.dev.: 0.0015) MultiSource/Applications/siod/siod: 3.41% (3.5520 => 3.6730, std.dev.: 0.0162) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.28% (0.5587 => 0.5770, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.11% (2.6656 => 2.7484, std.dev.: 0.0153) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.78% (6.6312 => 6.8155, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash: 2.27% (0.6308 => 0.6451, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.07% (4.6127 => 4.7084, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/whetstone: 1.84% (2.3453 => 2.3884, std.dev.: 0.0079) MultiSource/Benchmarks/Olden/power/power: 1.43% (1.4184 => 1.4387, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/em3d/em3d: 1.14% (4.6414 => 4.6944, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.13% (2.9152 => 2.9481, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -43.49% (0.2996 => 0.1693, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -42.81% (0.0591 => 0.0338, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.24% (1.4189 => 1.1601, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.83% (1.4113 => 1.1596, std.dev.: 0.0077) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.55% (0.3497 => 0.2044, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.67% (5.2665 => 4.1777, std.dev.: 0.0470) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.18% (1.7361 => 1.4726, std.dev.: 0.0073) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -12.59% (15.8312 => 13.8376, std.dev.: 0.7070) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1588, std.dev.: 0.0232) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.52% (1.1647 => 1.0538, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: -9.16% (0.1114 => 0.1012, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: -8.35% (9.5474 => 8.7503, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.27% (1.4034 => 1.2873, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.08% (3.2007 => 2.9422, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.87% (3.6254 => 3.3763, std.dev.: 0.0211) MultiSource/Applications/lambda-0_1_3/lambda: -6.74% (7.6833 => 7.1653, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/fibo: -6.47% (4.6355 => 4.3354, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -6.16% (1.4441 => 1.3552, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.01% (2.9728 => 2.7941, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.47% (3.9413 => 3.7258, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/fib2: -5.17% (4.4195 => 4.1909, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: -4.82% (2.5166 => 2.3952, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.80% (0.4564 => 0.4345, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: -4.06% (0.3746 => 0.3594, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -4.02% (62.4126 => 59.9030, std.dev.: 0.1263) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.61% (1.2722 => 1.2263, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.59% (1.1683 => 1.1263, std.dev.: 0.0090) SingleSource/Benchmarks/McGill/misr: -3.35% (0.4296 => 0.4152, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/methcall: -3.32% (9.2503 => 8.9428, std.dev.: 0.0236) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.31% (3.7496 => 3.6254, std.dev.: 0.0244) SingleSource/Benchmarks/Dhrystone/dry: -2.21% (2.4013 => 2.3483, std.dev.: 0.0085) MultiSource/Applications/SIBsim4/SIBsim4: -2.00% (3.4230 => 3.3547, std.dev.: 0.0208) SingleSource/Benchmarks/Shootout-C++/hash2: -1.92% (3.4876 => 3.4207, std.dev.: 0.0009) MultiSource/Applications/aha/aha: -1.89% (3.4286 => 3.3637, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.88% (2.3569 => 2.3127, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -1.69% (3.8907 => 3.8248, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: -1.68% (92.7467 => 91.1870, std.dev.: 0.3567) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.64% (9.3855 => 9.2317, std.dev.: 0.0356) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.59% (1.0686 => 1.0516, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/neural/neural: -1.53% (1.0926 => 1.0759, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3149, std.dev.: 0.0108) MultiSource/Benchmarks/llubenchmark/llu: -1.35% (2.0192 => 1.9920, std.dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: -1.25% (2.4971 => 2.4658, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.25% (2.4457 => 2.4152, std.dev.: 0.0075) MultiSource/Applications/JM/lencod/lencod: -1.18% (6.7458 => 6.6662, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists: -1.02% (16.5617 => 16.3930, std.dev.: 0.0207) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.07% (0.9980 => 1.0187, std.dev.: 0.0110) MultiSource/Applications/sqlite3/sqlite3: 3.97% (0.6022 => 0.6261, std.dev.: 0.0093) MultiSource/Benchmarks/McCat/08-main/main: 9.78% (0.1666 => 0.1829, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.28% (0.1554 => 0.1605, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.16% (0.3083 => 0.3242, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.04% (0.2394 => 0.2419, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.87% (0.3175 => 0.3266, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.13% (0.2302 => 0.2351, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: 3.79% (0.0449 => 0.0466, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.58% (0.0240 => 0.0251, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -31.25% (0.0192 => 0.0132, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.03% (0.0390 => 0.0394, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -20.93% (0.0301 => 0.0238, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.46% (0.0284 => 0.0291, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.85% (0.0324 => 0.0330, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: 1.69% (0.0177 => 0.0180, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 3.70% (0.0189 => 0.0196, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: 0.40% (0.0249 => 0.0250, std.dev.: 0.0009) SingleSource/UnitTests/byval-alignment: 3.08% (0.0325 => 0.0335, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.21% (0.1429 => 0.1432, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 4.25% (1.5019 => 1.5658, std.dev.: 0.0080) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 3.60% (0.1501 => 0.1555, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.03% (0.4264 => 0.4007, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.87% (0.1344 => 0.1396, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.41% (0.0589 => 0.0615, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -15.09% (0.0232 => 0.0197, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.31% (0.0639 => 0.0641, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.70% (1.1350 => 1.1270, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 350.00% (0.0006 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -4.17% (0.0024 => 0.0023, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.94% (0.0637 => 0.0643, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.25% (0.0246 => 0.0254, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.58% (0.7541 => 0.7660, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 11.10% (1.5363 => 1.7068, std.dev.: 0.0012) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 6 13:34:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 6 Oct 2012 15:34:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121006203435.5A1952A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4649?compare_to=4646&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4649, Order: 165365, Start Time: 2012-10-06 19:21:51, End Time: 2012-10-06 20:36:20 To: 4646, Order: 165363, Start Time: 2012-10-06 17:38:35, End Time: 2012-10-06 18:52:58 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (180 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1039 (756 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.28% (78.8875 => 80.6845, std.dev.: 0.3321) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.34% (1.2880 => 1.3053, std.dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -1.01% (3.7244 => 3.6867, std.dev.: 0.0100) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 22.23% (2.0176 => 2.4661, std.dev.: 0.0035) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.45% (0.1410 => 0.1656, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 15.62% (0.0826 => 0.0955, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 14.27% (0.2243 => 0.2563, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.71% (0.0834 => 0.0940, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 12.34% (0.1013 => 0.1138, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 12.26% (1.3693 => 1.5372, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 12.20% (0.4328 => 0.4856, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.96% (0.1413 => 0.1582, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 11.79% (0.4062 => 0.4541, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 11.65% (0.5818 => 0.6496, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 11.61% (0.2781 => 0.3104, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 11.53% (0.5748 => 0.6411, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.52% (0.1588 => 0.1771, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.36% (0.2721 => 0.3030, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.32% (0.2782 => 0.3097, std.dev.: 0.0006) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.29% (0.1072 => 0.1193) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.25% (3.9660 => 4.4122, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 11.24% (0.7038 => 0.7829, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.05% (0.3485 => 0.3870, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.95% (0.6283 => 0.6971, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 10.93% (0.7061 => 0.7833, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.92% (1.2193 => 1.3525, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.89% (0.0964 => 0.1069, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 10.81% (0.3293 => 0.3649, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.79% (0.2596 => 0.2876, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 10.79% (0.2726 => 0.3020, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 10.78% (0.2607 => 0.2888, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.78% (0.1327 => 0.1470, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 10.76% (0.2760 => 0.3057, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 10.76% (0.2937 => 0.3253, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 10.74% (0.2690 => 0.2979, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 10.73% (0.2628 => 0.2910, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.70% (0.2655 => 0.2939, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.68% (1.4563 => 1.6119, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.68% (0.4016 => 0.4445, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 10.67% (0.3149 => 0.3485, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.66% (0.3022 => 0.3344, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ary: 10.62% (0.3107 => 0.3437, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.62% (0.9199 => 1.0176, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.56% (0.2765 => 0.3057, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.55% (1.9828 => 2.1920, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.54% (0.3899 => 0.4310, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.52% (0.2966 => 0.3278, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.47% (0.7710 => 0.8517, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 10.45% (0.3453 => 0.3814, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.44% (0.3756 => 0.4148, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 10.43% (0.3192 => 0.3525, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 10.42% (0.3868 => 0.4271, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.39% (0.5265 => 0.5812, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/methcall: 10.36% (0.2761 => 0.3047, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 10.36% (0.1062 => 0.1172, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.29% (0.3489 => 0.3848, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.29% (0.6959 => 0.7675, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 10.24% (0.2988 => 0.3294, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.24% (0.2696 => 0.2972, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.20% (0.3580 => 0.3945, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.17% (1.1364 => 1.2520, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.07% (0.4390 => 0.4832, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 10.00% (13.8202 => 15.2029, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists1: 9.93% (0.3534 => 0.3885, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 9.92% (0.2995 => 0.3292, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.73% (0.4791 => 0.5257, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 9.63% (0.1589 => 0.1742, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 9.52% (1.0313 => 1.1295, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.51% (0.1157 => 0.1267, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.40% (0.1075 => 0.1176, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.36% (0.4379 => 0.4789, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.36% (0.5577 => 0.6099, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.30% (0.3130 => 0.3421, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.27% (0.1435 => 0.1568, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.25% (0.1276 => 0.1394, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.24% (0.8698 => 0.9502, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 9.24% (0.2945 => 0.3217, std.dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.23% (0.2914 => 0.3183, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.07% (0.2127 => 0.2320, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 9.05% (0.8310 => 0.9062, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 9.00% (16.6129 => 18.1082, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.97% (0.3755 => 0.4092, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 8.97% (1.1061 => 1.2053, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.87% (0.3246 => 0.3534, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 8.84% (0.6744 => 0.7340, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 8.82% (0.3220 => 0.3504, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.81% (0.1986 => 0.2161, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.78% (0.5637 => 0.6132, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.66% (0.7460 => 0.8106, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 8.55% (3.8646 => 4.1952, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.55% (7.2180 => 7.8352, std.dev.: 0.0061) MultiSource/Applications/spiff/spiff: 8.53% (0.7506 => 0.8146, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 8.45% (1.0594 => 1.1489, std.dev.: 0.0041) MultiSource/Applications/d/make_dparser: 8.33% (3.1889 => 3.4545, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.27% (0.8818 => 0.9547, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.21% (0.2023 => 0.2189, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 8.19% (1.9270 => 2.0849, std.dev.: 0.0021) MultiSource/Applications/viterbi/viterbi: 8.19% (0.1478 => 0.1599, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.15% (0.1865 => 0.2017, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 8.04% (2.1791 => 2.3542, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.03% (0.1569 => 0.1695) MultiSource/Benchmarks/McCat/09-vor/vor: 8.00% (0.2925 => 0.3159, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 7.98% (1.2749 => 1.3766, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 7.95% (0.3131 => 0.3380, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.88% (0.1789 => 0.1930, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.84% (3.6692 => 3.9570, std.dev.: 0.0083) MultiSource/Applications/JM/lencod/lencod: 7.82% (14.8535 => 16.0156, std.dev.: 0.0116) MultiSource/Benchmarks/Olden/em3d/em3d: 7.79% (0.1657 => 0.1786, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 7.76% (0.4113 => 0.4432, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 7.75% (4.6629 => 5.0241, std.dev.: 0.0140) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.73% (0.6576 => 0.7084, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.71% (4.3801 => 4.7178, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.69% (0.3511 => 0.3781, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.68% (0.6135 => 0.6606, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 7.65% (8.4961 => 9.1457, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.60% (4.4433 => 4.7812, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.60% (1.3245 => 1.4252, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 7.40% (1.2292 => 1.3201, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 7.33% (0.6250 => 0.6708, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.29% (0.2140 => 0.2296, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.19% (0.2504 => 0.2684, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.10% (0.9108 => 0.9755, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.94% (3.2742 => 3.5014, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.89% (4.9865 => 5.3302, std.dev.: 0.0237) SingleSource/Benchmarks/Misc/oourafft: 6.72% (0.2008 => 0.2143, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.72% (0.4805 => 0.5128, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.69% (1.1333 => 1.2091, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.68% (1.5188 => 1.6202, std.dev.: 0.0193) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.49% (0.1819 => 0.1937, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.45% (0.4003 => 0.4261, std.dev.: 0.0060) MultiSource/Applications/JM/ldecod/ldecod: 6.34% (6.5754 => 6.9925, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions: 6.31% (0.3914 => 0.4161, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 6.23% (0.3578 => 0.3801, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.22% (0.3245 => 0.3447, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 6.14% (0.3940 => 0.4182, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/for-in: 6.07% (0.3789 => 0.4019, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.05% (0.3650 => 0.3871, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 6.01% (0.3646 => 0.3865, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.93% (6.2785 => 6.6508, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-2: 5.92% (0.3601 => 0.3814, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 5.90% (0.3663 => 0.3879, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 5.85% (0.3623 => 0.3835, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 5.76% (3.7467 => 3.9625, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.73% (0.2321 => 0.2454, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.72% (2.1007 => 2.2208, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.24% (13.2842 => 13.9800, std.dev.: 0.0130) MultiSource/Applications/sqlite3/sqlite3: 3.75% (16.2614 => 16.8713, std.dev.: 0.0124) MultiSource/Applications/ClamAV/clamscan: 3.36% (14.5298 => 15.0178, std.dev.: 0.0099) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5178, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.29% (1.8175 => 2.2589, std.dev.: 0.0453) SingleSource/Benchmarks/Misc/richards_benchmark: 11.16% (1.1560 => 1.2850, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4137, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.26% (1.2998 => 1.3812, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.76% (1.9144 => 2.0055, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (1.7081 => 1.7749, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6762, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.49% (10.7476 => 11.1231, std.dev.: 0.0202) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9858, std.dev.: 0.0008) SingleSource/Regression/C/uint64_to_float: 2.97% (0.5449 => 0.5611, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.14% (7.4271 => 7.5860, std.dev.: 0.0088) MultiSource/Applications/lemon/lemon: 1.61% (1.4298 => 1.4528, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0497, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5124, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9692, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1870, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5779, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 1.10% (12.4560 => 12.5929, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0270, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.01% (8.8259 => 8.9151, std.dev.: 0.0152) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.23% (0.2670 => 0.1409, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.79% (0.4657 => 0.3875, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -15.70% (0.0707 => 0.0596, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.02% (1.3819 => 1.1882, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.89% (1.3813 => 1.1895, std.dev.: 0.0061) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.55% (22.5627 => 21.7612, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.44% (0.0997 => 0.0863, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -12.15% (0.2238 => 0.1966, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.93% (1.2308 => 1.0840, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.19% (20.3410 => 18.2680, std.dev.: 0.0180) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.28% (1.3780 => 1.3053, std.dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5138, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.74% (0.9996 => 0.9522, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.54% (3.2729 => 3.1571, std.dev.: 0.0121) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.42% (1.7688 => 1.7083, std.dev.: 0.0113) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.94% (0.4867 => 0.4724, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.60% (26.5159 => 25.8271, std.dev.: 0.0194) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Applications/spiff/spiff: -2.35% (3.0263 => 2.9551, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: -2.32% (1.9762 => 1.9304, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.97% (0.6589 => 0.6459, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.79% (28.2225 => 27.7176, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.60% (6.3560 => 6.2541, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0075, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8656, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: -1.27% (4.5928 => 4.5344, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.26% (2.5254 => 2.4937, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: -1.21% (9.3358 => 9.2224, std.dev.: 0.0285) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2587, std.dev.: 0.0015) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 6 13:44:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 6 Oct 2012 15:44:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121006204447.AB93E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4650?compare_to=4647&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4650, Order: 165365, Start Time: 2012-10-06 19:27:13, End Time: 2012-10-06 20:46:32 To: 4647, Order: 165363, Start Time: 2012-10-06 17:38:34, End Time: 2012-10-06 18:58:02 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (152 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1023 (767 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.37% (55.2715 => 56.5815, std.dev.: 0.0123) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.41% (1.2953 => 1.3135, std.dev.: 0.0063) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.03% (0.5869 => 0.5867, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 0.09% (16.1750 => 16.1894, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: -0.05% (54.9054 => 54.8777, std.dev.: 0.0202) MultiSource/Benchmarks/MallocBench/gs/gs: -0.17% (4.3905 => 4.3832, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.02% (1.2455 => 1.2458, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.01% (7.7536 => 7.7541, std.dev.: 0.0162) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.14% (0.7386 => 0.7396, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -2.19% (0.0365 => 0.0357, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1432 => 0.1433, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.56% (0.2237 => 0.2202, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -13.23% (63.2438 => 54.8777, std.dev.: 0.0202) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.32% (14.1553 => 18.7302, std.dev.: 0.0234) SingleSource/Benchmarks/Misc-C++-EH/spirit: 60.74% (3.4629 => 5.5662, std.dev.: 0.0200) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14225.00% (0.0720 => 10.3140, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952100.00% (0.0001 => 9.9522, std.dev.: 0.0015) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 48.98% (0.2554 => 0.3805, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 46.66% (10.3673 => 15.2050, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 31.20% (0.1622 => 0.2128, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 30.68% (0.1056 => 0.1380) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.02% (7.0540 => 8.1135, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.75% (2.2022 => 2.5270, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 14.53% (0.1432 => 0.1640, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.11% (0.1566 => 0.1787, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.34% (1.7609 => 1.9782, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.94% (0.0871 => 0.0975, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.09% (0.3543 => 0.3936, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 10.82% (0.3282 => 0.3637, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.73% (0.1584 => 0.1754, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.62% (0.3473 => 0.3842, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.52% (0.3516 => 0.3886, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.47% (0.3543 => 0.3914, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 10.45% (0.3561 => 0.3933, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 10.44% (0.3497 => 0.3862, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 10.29% (0.3828 => 0.4222, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.15% (0.3694 => 0.4069, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 10.08% (0.3927 => 0.4323, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 10.06% (0.3886 => 0.4277, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 9.93% (0.1440 => 0.1583, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.18% (0.1438 => 0.1570, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.00% (0.4879 => 0.5318, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.97% (0.6675 => 0.7274, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 8.95% (0.7433 => 0.8098, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 8.92% (0.7115 => 0.7750, std.dev.: 0.0240) SingleSource/UnitTests/ObjC++/Hello: 8.91% (0.5925 => 0.6453, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 8.86% (9.4845 => 10.3244, std.dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference-object: 8.81% (0.6030 => 0.6561, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 8.76% (0.1655 => 0.1800, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 8.68% (10.4361 => 11.3423, std.dev.: 0.0083) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.62% (0.3177 => 0.3451, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.56% (1.5415 => 1.6734, std.dev.: 0.0033) MultiSource/Applications/sgefa/sgefa: 8.56% (0.3109 => 0.3375, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 8.55% (0.1695 => 0.1840, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.43% (0.1625 => 0.1762, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.36% (0.4615 => 0.5001, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: 8.21% (0.3423 => 0.3704, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.11% (0.5105 => 0.5519, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.11% (0.7326 => 0.7920, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.07% (0.3307 => 0.3574, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.06% (1.3050 => 1.4102, std.dev.: 0.0036) MultiSource/Applications/d/make_dparser: 8.03% (3.3354 => 3.6033, std.dev.: 0.0132) MultiSource/Applications/oggenc/oggenc: 7.99% (5.7591 => 6.2190, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.97% (0.2271 => 0.2452, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.95% (0.8172 => 0.8822, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.95% (0.1510 => 0.1630, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.89% (0.2065 => 0.2228, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 7.89% (0.3422 => 0.3692, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.87% (4.2646 => 4.6003, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.87% (0.5860 => 0.6321, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.85% (0.2700 => 0.2912, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.85% (0.4103 => 0.4425, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.85% (0.5569 => 0.6006, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: 7.82% (0.6456 => 0.6961, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.76% (0.2758 => 0.2972, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.74% (0.2107 => 0.2270, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.71% (0.4203 => 0.4527, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.67% (0.5020 => 0.5405, std.dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.66% (0.3121 => 0.3360, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash: 7.65% (0.4289 => 0.4617, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.64% (0.2891 => 0.3112, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.64% (0.8067 => 0.8683, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.63% (8.1363 => 8.7572, std.dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.63% (0.1940 => 0.2088, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.53% (0.9765 => 1.0500, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 7.52% (0.1555 => 0.1672, std.dev.: 0.0019) MultiSource/Applications/hbd/hbd: 7.51% (1.5603 => 1.6775, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.49% (5.0018 => 5.3762, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.48% (4.9449 => 5.3147, std.dev.: 0.0049) SingleSource/Regression/C++/ofstream_ctor: 7.47% (0.2905 => 0.3122, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.37% (0.3865 => 0.4150, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 7.35% (0.3603 => 0.3868, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 7.35% (0.3387 => 0.3636, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.31% (0.3162 => 0.3393, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.26% (0.3650 => 0.3915, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 7.24% (0.2831 => 0.3036, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.24% (1.1642 => 1.2485, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: 7.24% (0.4048 => 0.4341, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 7.22% (0.7835 => 0.8401, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.20% (0.4636 => 0.4970, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 7.12% (3.8723 => 4.1481, std.dev.: 0.0083) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.09% (7.9617 => 8.5261, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/ary: 7.09% (0.3232 => 0.3461, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.08% (0.4620 => 0.4947, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.05% (0.3136 => 0.3357, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.04% (2.0665 => 2.2119, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary3: 7.01% (0.3283 => 0.3513) SingleSource/Benchmarks/Shootout-C++/methcall: 6.95% (0.2877 => 0.3077, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/lists1: 6.95% (0.3684 => 0.3940, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.93% (0.2872 => 0.3071, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.89% (0.2756 => 0.2946, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 6.88% (1.0722 => 1.1460, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.87% (0.3826 => 0.4089, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/fibo: 6.86% (0.2725 => 0.2912, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.86% (0.3441 => 0.3677, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.85% (0.3052 => 0.3261, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/except: 6.83% (0.2871 => 0.3067, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.81% (0.3098 => 0.3309, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 6.72% (2.0273 => 2.1636, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 6.67% (0.2802 => 0.2989, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.65% (0.2603 => 0.2776, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 6.60% (0.2714 => 0.2893, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.59% (0.2793 => 0.2977, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.50% (1.1861 => 1.2632, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.49% (1.5859 => 1.6889, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.36% (0.3379 => 0.3594, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 6.35% (0.3180 => 0.3382, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.23% (0.6450 => 0.6852, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 6.22% (2.2969 => 2.4398, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.15% (0.5981 => 0.6349, std.dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 6.13% (21.9371 => 23.2827, std.dev.: 0.0242) MultiSource/Benchmarks/Prolangs-C/football/football: 6.09% (0.8921 => 0.9464, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 5.84% (0.4299 => 0.4550, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.59% (0.4064 => 0.4291, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.57% (2.2024 => 2.3251, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.33% (1.4186 => 1.4942, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.25% (0.1906 => 0.2006, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 5.18% (1.1840 => 1.2453, std.dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 4.98% (1.2842 => 1.3482, std.dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/objinst: 4.95% (0.3131 => 0.3286, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.90% (0.2266 => 0.2377, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.47% (0.8101 => 0.8463, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.63% (14.3668 => 14.8887, std.dev.: 0.0100) MultiSource/Applications/sqlite3/sqlite3: 3.25% (17.1811 => 17.7396, std.dev.: 0.0186) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.18% (0.3427 => 0.3536, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.93% (3.8922 => 4.0063, std.dev.: 0.0131) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.83% (0.3817 => 0.3925, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.36% (1.1194 => 1.1458, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.98% (1.1396 => 1.2533, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.20% (3.1595 => 3.4502, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.71% (3.1578 => 3.3697, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 3.66% (0.5413 => 0.5611, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.46% (3.6395 => 3.7656, std.dev.: 0.0039) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.76% (4.2280 => 4.3445, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8130, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.35% (2.6546 => 2.6905, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1289, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.01% (0.8651 => 0.1729, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.29% (5.2763 => 3.2560, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.66% (5.3855 => 3.6265, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.22% (5.3526 => 3.6278, std.dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -14.49% (54.1659 => 46.3177, std.dev.: 0.0281) MultiSource/Benchmarks/FreeBench/mason/mason: -12.95% (0.0811 => 0.0706, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -11.14% (22.1758 => 19.7049, std.dev.: 0.0176) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.88% (2.9384 => 2.6188, std.dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.51% (1.1492 => 0.7641, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4249, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.23% (0.0998 => 0.0856, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.23% (1.2373 => 1.0984, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel-2: -10.79% (1.5373 => 1.3714, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/mason/mason: -10.09% (0.2161 => 0.1943, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.24% (19.9488 => 18.3049, std.dev.: 0.1039) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.71% (1.8329 => 1.7100, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5752, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.31% (1.6805 => 1.5912, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.99% (1.5835 => 1.5045, std.dev.: 0.0033) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.79% (1.5660 => 1.4910, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.33% (0.9957 => 0.9526, std.dev.: 0.0113) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.74% (1.3677 => 1.3166, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.70% (3.2827 => 3.1613, std.dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4983, std.dev.: 0.0052) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0989, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.27% (8.6802 => 8.4835, std.dev.: 0.0112) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -2.01% (10.2830 => 10.0763, std.dev.: 0.0221) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.90% (8.1563 => 8.0014, std.dev.: 0.0198) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6824, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -1.53% (2.5528 => 2.5138, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4201, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.20% (0.5229 => 0.5867, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 8.00% (14.9895 => 16.1894, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 6.63% (4.1105 => 4.3832, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.76% (1.1048 => 1.2458, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.32% (7.1582 => 7.7541, std.dev.: 0.0162) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.87% (0.6222 => 0.7396, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35600.00% (0.0001 => 0.0357, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.06% (0.2116 => 0.2202, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 6 14:14:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 6 Oct 2012 16:14:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121006211414.BC03F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4651?compare_to=4644&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4651, Order: 165365, Start Time: 2012-10-06 18:32:00, End Time: 2012-10-06 21:16:00 To: 4644, Order: 165362, Start Time: 2012-10-06 15:18:48, End Time: 2012-10-06 18:02:48 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (130 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 1042 (833 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 10.49% (0.3488 => 0.3854, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 10.36% (0.3446 => 0.3803, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.35% (0.3460 => 0.3818, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.31% (0.3442 => 0.3797, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.30% (0.3465 => 0.3822, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.27% (0.3496 => 0.3855, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 10.21% (1.5932 => 1.7559, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/synchronized: 10.18% (0.3469 => 0.3822, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.02% (0.3643 => 0.4008, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.97% (0.3650 => 0.4014, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.88% (0.3724 => 0.4092, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.79% (0.5826 => 0.6338, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 8.59% (0.5889 => 0.6395, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 8.29% (0.1218 => 0.1319, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 8.03% (0.1619 => 0.1749, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.91% (0.7171 => 0.7738, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.83% (0.2875 => 0.3100, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 7.66% (0.9909 => 1.0668, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: 7.57% (0.2813 => 0.3026, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 7.52% (0.3004 => 0.3230, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 7.49% (0.2725 => 0.2929, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.48% (0.3195 => 0.3434, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 7.48% (0.2714 => 0.2917, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.45% (0.2911 => 0.3128, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.45% (0.2792 => 0.3000, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 7.44% (0.2823 => 0.3033, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.39% (0.4994 => 0.5363, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 7.38% (0.2803 => 0.3010, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 7.37% (0.2780 => 0.2985, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 7.36% (0.2811 => 0.3018, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.35% (1.3152 => 1.4119, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.34% (0.2738 => 0.2939, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.34% (2.0673 => 2.2190, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.33% (0.2729 => 0.2929, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.27% (1.6211 => 1.7390, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.27% (0.4361 => 0.4678, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 7.24% (0.2750 => 0.2949, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 7.14% (0.3096 => 0.3317, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.08% (0.5000 => 0.5354, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.06% (0.3060 => 0.3276, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.05% (0.3362 => 0.3599, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.05% (0.3845 => 0.4116, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 7.01% (0.2566 => 0.2746, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 6.97% (5.5417 => 5.9281, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary3: 6.95% (0.3267 => 0.3494, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 6.93% (0.6634 => 0.7094, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.90% (0.3317 => 0.3546, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 6.89% (23.5202 => 25.1402, std.dev.: 0.0210) SingleSource/Benchmarks/Shootout-C++/lists1: 6.87% (0.3477 => 0.3716, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.87% (0.3726 => 0.3982, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.85% (0.1620 => 0.1731, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.84% (0.3258 => 0.3481, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.84% (3.5627 => 3.8065, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/moments: 6.80% (0.3678 => 0.3928, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 6.78% (0.3348 => 0.3575, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.76% (0.3282 => 0.3504, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.76% (0.3625 => 0.3870, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.75% (0.3124 => 0.3335, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 6.71% (0.4847 => 0.5172, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.70% (0.2014 => 0.2149, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.66% (0.4146 => 0.4422, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 6.56% (1.0781 => 1.1488, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.54% (0.5900 => 0.6286, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.51% (0.2736 => 0.2914, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.45% (0.3690 => 0.3928, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.40% (0.4251 => 0.4523, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.33% (0.3981 => 0.4233, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.28% (2.7292 => 2.9005, std.dev.: 0.0043) MultiSource/Applications/ClamAV/clamscan: 6.26% (4.2109 => 4.4747, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.21% (0.3930 => 0.4174, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 6.21% (0.4029 => 0.4279, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.18% (0.6435 => 0.6833, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.09% (0.4139 => 0.4391, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.09% (0.5026 => 0.5332, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 6.01% (1.8794 => 1.9924, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.94% (0.3903 => 0.4135, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.94% (0.3890 => 0.4121, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 5.91% (0.5012 => 0.5308, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.90% (0.2866 => 0.3035, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.84% (0.4658 => 0.4930, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.77% (0.2737 => 0.2895, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.76% (0.2969 => 0.3140, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.75% (4.4195 => 4.6735, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.64% (0.1968 => 0.2079, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 5.63% (2.1013 => 2.2196, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.61% (0.2068 => 0.2184, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 5.61% (1.4269 => 1.5069, std.dev.: 0.0087) MultiSource/Applications/minisat/minisat: 5.61% (0.3336 => 0.3523, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 5.48% (0.5546 => 0.5850, std.dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: 5.45% (4.6177 => 4.8693, std.dev.: 0.0083) MultiSource/Applications/hbd/hbd: 5.37% (0.9697 => 1.0218, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.35% (0.3271 => 0.3446, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.34% (0.2040 => 0.2149, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 5.31% (0.2691 => 0.2834, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 5.31% (2.1653 => 2.2802, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.28% (0.2103 => 0.2214, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 5.05% (2.0346 => 2.1373, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 4.98% (0.2391 => 0.2510, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 4.96% (0.2075 => 0.2178, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 4.76% (0.7875 => 0.8250, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.71% (1.9694 => 2.0621, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.52% (1.9966 => 2.0868, std.dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: 4.52% (0.3498 => 0.3656, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.42% (0.7426 => 0.7754, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.16% (0.5361 => 0.5584, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.12% (0.5584 => 0.5814, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.03% (11.6398 => 12.1091, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.95% (4.6926 => 4.8779, std.dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 2.70% (11.9555 => 12.2784, std.dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.69% (0.2122 => 0.2264, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6095, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6770, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-2: 4.97% (1.8057 => 1.8955, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1720, std.dev.: 0.1439) SingleSource/Benchmarks/Dhrystone/dry: 4.18% (14.0481 => 14.6348, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1909, std.dev.: 0.0037) MultiSource/Applications/viterbi/viterbi: 1.90% (46.6247 => 47.5087, std.dev.: 0.0060) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.53% (3.1722 => 3.2206, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2880, std.dev.: 0.0037) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0015) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5845, std.dev.: 0.0330) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.75% (25.4195 => 16.5874, std.dev.: 0.0169) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9767, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7958, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/ary2: -7.45% (0.2402 => 0.2223, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7979, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.07% (0.6293 => 0.6100, std.dev.: 0.0019) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7728, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.36% (17.2379 => 16.8309, std.dev.: 0.0467) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.21% (41.7953 => 40.8708, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5773, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4964, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.13% (105.3826 => 104.1881, std.dev.: 0.0538) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0415, std.dev.: 0.0043) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 6 19:47:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 6 Oct 2012 21:47:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121007024720.698672A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4652?compare_to=4649&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4652, Order: 165366, Start Time: 2012-10-07 01:34:37, End Time: 2012-10-07 02:49:05 To: 4649, Order: 165365, Start Time: 2012-10-06 19:21:51, End Time: 2012-10-06 20:36:20 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (180 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1041 (756 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.28% (1.0840 => 1.0979, std.dev.: 0.0025) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 22.21% (2.0176 => 2.4658, std.dev.: 0.0036) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.52% (0.1410 => 0.1657, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 15.50% (0.0826 => 0.0954, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 14.18% (0.2243 => 0.2561, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.71% (0.0834 => 0.0940, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 12.34% (0.1013 => 0.1138) MultiSource/Applications/hbd/hbd: 12.29% (1.3693 => 1.5376, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 12.22% (0.4328 => 0.4857, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.96% (0.1413 => 0.1582, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference-object: 11.69% (0.5818 => 0.6498, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 11.61% (0.2781 => 0.3104, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 11.55% (0.5748 => 0.6412, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 11.55% (0.4062 => 0.4531, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.52% (0.1588 => 0.1771, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.39% (0.2721 => 0.3031, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.32% (0.2782 => 0.3097, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.25% (3.9660 => 4.4120, std.dev.: 0.0009) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.19% (0.1072 => 0.1192, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 11.17% (0.7038 => 0.7824, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.05% (0.3485 => 0.3870, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.98% (0.2596 => 0.2881, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.93% (0.6283 => 0.6970, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 10.93% (0.7061 => 0.7833, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.93% (0.1327 => 0.1472, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.89% (0.0964 => 0.1069, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.88% (1.2193 => 1.3520, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 10.83% (0.2760 => 0.3059, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 10.82% (0.2726 => 0.3021, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 10.81% (0.3293 => 0.3649, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.79% (0.9199 => 1.0192, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.79% (0.3022 => 0.3348, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 10.78% (0.2607 => 0.2888, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.74% (0.2765 => 0.3062, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ary3: 10.73% (0.3149 => 0.3487, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.71% (1.4563 => 1.6123, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.71% (0.4016 => 0.4446, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 10.71% (0.2690 => 0.2978, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.64% (0.7710 => 0.8530, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 10.62% (0.2937 => 0.3249, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.62% (0.3899 => 0.4313, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.58% (0.2655 => 0.2936, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 10.58% (0.2628 => 0.2906, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.58% (0.3489 => 0.3858, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.55% (1.9828 => 2.1920, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 10.55% (0.3868 => 0.4276, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.52% (0.3756 => 0.4151, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 10.49% (0.3107 => 0.3433, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 10.43% (0.2761 => 0.3049, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 10.43% (0.3453 => 0.3813, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.39% (0.6959 => 0.7682, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.38% (0.2966 => 0.3274, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 10.37% (0.2988 => 0.3298, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 10.36% (0.1062 => 0.1172, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 10.34% (0.3192 => 0.3522, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.31% (0.3580 => 0.3949, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.27% (0.4390 => 0.4841, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.26% (0.5265 => 0.5805, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.24% (0.2696 => 0.2972, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.15% (1.1364 => 1.2517, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 10.14% (13.8202 => 15.2209, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/lists1: 9.96% (0.3534 => 0.3886, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 9.82% (0.2995 => 0.3289, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.77% (0.1157 => 0.1270, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.75% (0.4791 => 0.5258, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 9.57% (1.0313 => 1.1300, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 9.57% (0.1589 => 0.1741, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.48% (0.4379 => 0.4794, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.40% (0.1075 => 0.1176, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.36% (0.5577 => 0.6099, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.27% (0.8698 => 0.9504, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 9.20% (0.2945 => 0.3216, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.17% (0.1276 => 0.1393, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.13% (0.1435 => 0.1566, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.11% (0.3130 => 0.3415, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.06% (0.2914 => 0.3178, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/football/football: 9.04% (0.8310 => 0.9061, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.00% (0.3755 => 0.4093, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 8.99% (16.6129 => 18.1069, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.98% (0.2127 => 0.2318, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.96% (0.1986 => 0.2164, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 8.93% (0.6744 => 0.7346, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.91% (0.5637 => 0.6139, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 8.88% (1.1061 => 1.2043, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.78% (0.3246 => 0.3531, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.65% (0.7460 => 0.8105, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 8.60% (0.3220 => 0.3497, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.54% (7.2180 => 7.8341, std.dev.: 0.0108) MultiSource/Applications/spiff/spiff: 8.53% (0.7506 => 0.8146, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 8.52% (3.8646 => 4.1940, std.dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 8.47% (1.0594 => 1.1491, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.36% (0.8818 => 0.9555, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 8.34% (3.1889 => 3.4550, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.21% (0.2023 => 0.2189, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 8.20% (1.9270 => 2.0851, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 8.19% (0.1478 => 0.1599, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.04% (0.1865 => 0.2015, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 8.04% (2.1791 => 2.3543, std.dev.: 0.0025) MultiSource/Applications/SIBsim4/SIBsim4: 8.01% (1.2749 => 1.3770, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 7.98% (0.3131 => 0.3381, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.97% (0.1569 => 0.1694, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 7.93% (0.2925 => 0.3157, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 7.88% (14.8535 => 16.0235, std.dev.: 0.0189) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.83% (3.6692 => 3.9566, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.6576 => 0.7091, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 7.80% (0.4113 => 0.4434, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 7.74% (4.6629 => 5.0239, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.73% (1.3245 => 1.4269, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.72% (4.4433 => 4.7864, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.72% (4.3801 => 4.7182, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.71% (0.1789 => 0.1927, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 7.69% (8.4961 => 9.1494, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.68% (0.6135 => 0.6606, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.60% (0.3511 => 0.3778, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 7.60% (0.1657 => 0.1783, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 7.46% (0.6250 => 0.6716, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.38% (0.2140 => 0.2298, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 7.37% (1.2292 => 1.3198, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.10% (0.9108 => 0.9755, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.03% (0.2504 => 0.2680, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.00% (4.9865 => 5.3357, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.91% (3.2742 => 3.5006, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.80% (1.5188 => 1.6221, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 6.72% (0.2008 => 0.2143, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.70% (0.4805 => 0.5127, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.69% (1.1333 => 1.2091, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 6.52% (0.4003 => 0.4264, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.41% (0.3245 => 0.3453, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 6.34% (6.5754 => 6.9920, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.32% (0.1819 => 0.1934, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 6.23% (0.3914 => 0.4158, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 6.20% (0.3578 => 0.3800, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.11% (0.3601 => 0.3821, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 6.09% (0.3646 => 0.3868, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 6.07% (0.3789 => 0.4019, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.97% (6.2785 => 6.6532, std.dev.: 0.0111) SingleSource/UnitTests/ObjC/property: 5.96% (0.3940 => 0.4175, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/synchronized: 5.95% (0.3663 => 0.3881, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.87% (2.1007 => 2.2240, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 5.84% (3.7467 => 3.9654, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.84% (0.3650 => 0.3863, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 5.82% (0.3623 => 0.3834, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.64% (0.2321 => 0.2452, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.25% (13.2842 => 13.9815, std.dev.: 0.0185) MultiSource/Applications/sqlite3/sqlite3: 3.59% (16.2614 => 16.8458, std.dev.: 0.0216) MultiSource/Applications/ClamAV/clamscan: 3.37% (14.5298 => 15.0190, std.dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5152, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fbench: 25.53% (1.8175 => 2.2815, std.dev.: 0.0406) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.06% (1.0895 => 1.3625, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 11.12% (1.1560 => 1.2846, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.47% (0.1322 => 0.1434, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4137, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.36% (1.2998 => 1.3825, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.75% (1.9144 => 2.0053, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.88% (1.7081 => 1.7744, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6762, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-6: 3.32% (1.9199 => 1.9836, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 3.26% (10.7476 => 11.0975, std.dev.: 0.0144) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.19% (7.4271 => 7.5898, std.dev.: 0.0087) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4540, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5132, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9684, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1869, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 1.20% (5.5130 => 5.5790, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/em3d/em3d: 1.15% (3.1071 => 3.1428, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0270, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5850, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.02% (3.6469 => 3.6840, std.dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.23% (0.2670 => 0.1409, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.75% (0.4657 => 0.3877, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -15.70% (0.0707 => 0.0596, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.89% (1.3819 => 1.1900, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.83% (1.3813 => 1.1902, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.49% (22.5627 => 21.7747, std.dev.: 0.0158) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.33% (1.0460 => 0.8543, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.44% (0.0997 => 0.0863, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -12.20% (0.2238 => 0.1965, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.80% (1.2308 => 1.0979, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.15% (20.3410 => 18.2755, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.20% (1.3780 => 1.2925, std.dev.: 0.0082) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.10% (2.6470 => 2.5119, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.60% (0.9996 => 0.9536, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.56% (3.2729 => 3.1564, std.dev.: 0.0101) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.41% (1.7688 => 1.7084, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.57% (26.5159 => 25.8355, std.dev.: 0.0241) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.43% (3.0263 => 2.9528, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.34% (1.9762 => 1.9299, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7152, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/lists: -1.76% (6.3560 => 6.2444, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0065, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8628, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: -1.29% (4.5928 => 4.5335, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.16% (2.5254 => 2.4962, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2588, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: -1.04% (9.3358 => 9.2388, std.dev.: 0.0075) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 6 19:52:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 6 Oct 2012 21:52:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121007025203.5D8822A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4653?compare_to=4650&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4653, Order: 165366, Start Time: 2012-10-07 01:34:31, End Time: 2012-10-07 02:53:48 To: 4650, Order: 165365, Start Time: 2012-10-06 19:27:13, End Time: 2012-10-06 20:46:32 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (151 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1025 (766 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.5867 => 0.5867, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: -0.11% (16.1894 => 16.1724, std.dev.: 0.0165) MultiSource/Benchmarks/Bullet/bullet: -0.01% (54.8777 => 54.8734, std.dev.: 0.0325) MultiSource/Benchmarks/MallocBench/gs/gs: 0.05% (4.3832 => 4.3854, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.10% (1.2458 => 1.2446, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.07% (7.7541 => 7.7488, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.09% (0.7396 => 0.7389, std.dev.: 0.0067) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 2.24% (0.0357 => 0.0365, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.82% (0.2202 => 0.2184, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -13.24% (63.2438 => 54.8734, std.dev.: 0.0325) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.25% (14.1553 => 18.7200, std.dev.: 0.0223) SingleSource/Benchmarks/Misc-C++-EH/spirit: 60.67% (3.4629 => 5.5640, std.dev.: 0.0097) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14222.08% (0.0720 => 10.3119, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952100.00% (0.0001 => 9.9522, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 48.86% (0.2554 => 0.3802, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 46.57% (10.3673 => 15.1955, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/richards_benchmark: 31.32% (0.1622 => 0.2130, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: 30.49% (0.1056 => 0.1378, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.92% (7.0540 => 8.1068, std.dev.: 0.0092) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.78% (2.2022 => 2.5277, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 14.46% (0.1432 => 0.1639, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.11% (0.1566 => 0.1787, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.34% (1.7609 => 1.9782, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.94% (0.0871 => 0.0975, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.09% (0.3543 => 0.3936, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 10.73% (0.3282 => 0.3634, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.67% (0.1584 => 0.1753, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.57% (0.3473 => 0.3840, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 10.56% (0.3561 => 0.3937, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 10.47% (0.3516 => 0.3884, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 10.39% (0.3543 => 0.3911, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 10.32% (0.3497 => 0.3858, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 10.19% (0.3828 => 0.4218, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 10.15% (0.3694 => 0.4069, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 10.04% (0.3886 => 0.4276, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 10.03% (0.3927 => 0.4321, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 9.93% (0.1440 => 0.1583, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.10% (0.4879 => 0.5323, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.06% (0.6675 => 0.7280, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 9.03% (0.7433 => 0.8104, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: 9.00% (0.1655 => 0.1804, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 8.95% (0.7115 => 0.7752, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 8.93% (0.5925 => 0.6454, std.dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: 8.89% (9.4845 => 10.3278, std.dev.: 0.0047) SingleSource/UnitTests/ObjC++/property-reference-object: 8.79% (0.6030 => 0.6560, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.78% (0.3177 => 0.3456, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.76% (0.1438 => 0.1564, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.76% (1.5415 => 1.6765, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 8.67% (10.4361 => 11.3412, std.dev.: 0.0277) MultiSource/Applications/sgefa/sgefa: 8.59% (0.3109 => 0.3376, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.54% (0.5105 => 0.5541, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.49% (0.1625 => 0.1763, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.39% (0.4615 => 0.5002, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/em3d/em3d: 8.20% (0.1695 => 0.1834, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.18% (1.3050 => 1.4118, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.10% (0.8172 => 0.8834, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 8.06% (0.3423 => 0.3699, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 8.05% (0.7326 => 0.7916, std.dev.: 0.0032) MultiSource/Applications/d/make_dparser: 8.00% (3.3354 => 3.6021, std.dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 7.95% (5.7591 => 6.2172, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.95% (0.1510 => 0.1630, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.93% (0.2271 => 0.2451, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.89% (4.2646 => 4.6012, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 7.89% (0.3422 => 0.3692, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.89% (0.2700 => 0.2913, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.83% (0.5569 => 0.6005, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.78% (0.5860 => 0.6316, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.70% (0.2065 => 0.2224, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 7.70% (0.6456 => 0.6953, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.68% (0.3307 => 0.3561, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.64% (0.2107 => 0.2268, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.61% (0.8067 => 0.8681, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.61% (5.0018 => 5.3823, std.dev.: 0.0059) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.59% (0.3121 => 0.3358, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.58% (0.4103 => 0.4414, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.58% (0.9765 => 1.0505, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.57% (4.9449 => 5.3191, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/hash: 7.55% (0.4289 => 0.4613, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.55% (0.5020 => 0.5399, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.55% (0.4636 => 0.4986, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.54% (0.4203 => 0.4520, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.53% (8.1363 => 8.7492, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.51% (0.2758 => 0.2965, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.49% (1.5603 => 1.6772, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/strcat: 7.45% (0.2831 => 0.3042, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 7.44% (0.2905 => 0.3121, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.37% (0.2891 => 0.3104, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.36% (1.1642 => 1.2499, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 7.35% (0.7835 => 0.8411, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.32% (0.3865 => 0.4148, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.32% (0.3650 => 0.3917, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.27% (0.1940 => 0.2081, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 7.23% (0.3387 => 0.3632, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 7.11% (0.4048 => 0.4336, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 7.08% (3.8723 => 4.1464, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: 7.08% (0.3603 => 0.3858, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 7.05% (0.3232 => 0.3460, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.05% (0.3136 => 0.3357, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.05% (7.9617 => 8.5227, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/hash2: 7.01% (0.4620 => 0.4944, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 7.01% (0.3283 => 0.3513, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 7.00% (0.3684 => 0.3942, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.96% (0.2872 => 0.3072, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.95% (0.3052 => 0.3264, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 6.95% (0.1555 => 0.1663, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.94% (2.0665 => 2.2100, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.89% (0.3162 => 0.3380, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.87% (0.3826 => 0.4089, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 6.86% (0.2725 => 0.2912, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.86% (0.3441 => 0.3677, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 6.85% (1.0722 => 1.1456, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.83% (0.2871 => 0.3067, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.82% (0.2756 => 0.2944, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.78% (0.3098 => 0.3308, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 6.72% (2.0273 => 2.1635, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/random: 6.67% (0.2802 => 0.2989, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 6.63% (0.2714 => 0.2894, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.61% (0.2603 => 0.2775, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.57% (0.2877 => 0.3066, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.57% (1.1861 => 1.2640, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.44% (1.5859 => 1.6880, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 6.36% (0.3379 => 0.3594, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.36% (0.6450 => 0.6860, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 6.32% (2.2969 => 2.4420, std.dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.24% (0.5981 => 0.6354, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 6.19% (0.3180 => 0.3377, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 6.14% (21.9371 => 23.2846, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/football/football: 6.09% (0.8921 => 0.9464, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 5.86% (0.4299 => 0.4551, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.56% (0.4064 => 0.4290, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.51% (2.2024 => 2.3238, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.31% (1.4186 => 1.4939, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.30% (0.1906 => 0.2007, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 5.05% (1.1840 => 1.2438, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.90% (0.2266 => 0.2377, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.89% (0.3131 => 0.3284, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 4.86% (1.2842 => 1.3466, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.55% (0.8101 => 0.8470, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.72% (14.3668 => 14.9017, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.30% (0.3427 => 0.3540, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 3.18% (17.1811 => 17.7276, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.86% (0.3817 => 0.3926, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.78% (3.8922 => 4.0005, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.43% (1.1194 => 1.1466, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.82% (1.1396 => 1.2515, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0020) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4499, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.70% (3.1578 => 3.3693, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.50% (3.6395 => 3.7669, std.dev.: 0.0036) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.66% (4.2280 => 4.3404, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (0.8275 => 0.8405, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8126, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.36% (0.9540 => 0.9670, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.21% (2.6546 => 2.6868, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1291, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -80.03% (0.8651 => 0.1728, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.25% (5.2763 => 3.2580, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.67% (5.3855 => 3.6262, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.22% (5.3526 => 3.6281, std.dev.: 0.0065) SingleSource/UnitTests/Vector/constpool: -14.44% (54.1659 => 46.3438, std.dev.: 0.0102) MultiSource/Benchmarks/FreeBench/mason/mason: -13.32% (0.0811 => 0.0703, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -11.22% (22.1758 => 19.6884, std.dev.: 0.0187) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.01% (2.9384 => 2.6148, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7636, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.79% (1.6925 => 1.4252, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.53% (0.0998 => 0.0863, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.77% (1.2373 => 1.0917, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel-2: -10.28% (1.5373 => 1.3793, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/mason/mason: -10.13% (0.2161 => 0.1942, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.25% (19.9488 => 18.3034, std.dev.: 0.0587) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.65% (1.8329 => 1.7111, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.25% (1.6805 => 1.5922, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.69% (1.5835 => 1.5092, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Applications/siod/siod: -3.70% (3.2827 => 3.1613, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.26% (0.9957 => 0.9632, std.dev.: 0.0091) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5014, std.dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0987, std.dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.27% (0.4808 => 0.4699, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.91% (8.6802 => 8.5141, std.dev.: 0.0140) SingleSource/Benchmarks/Misc/salsa20: -1.88% (10.2830 => 10.0898, std.dev.: 0.0204) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6812, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.65% (8.1563 => 8.0215, std.dev.: 0.0061) SingleSource/UnitTests/Vector/multiplies: -1.56% (2.5528 => 2.5131, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4206, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8577, std.dev.: 0.0029) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.20% (0.5229 => 0.5867, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 7.89% (14.9895 => 16.1724, std.dev.: 0.0165) MultiSource/Benchmarks/MallocBench/gs/gs: 6.69% (4.1105 => 4.3854, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.65% (1.1048 => 1.2446, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.25% (7.1582 => 7.7488, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.76% (0.6222 => 0.7389, std.dev.: 0.0067) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36400.00% (0.0001 => 0.0365, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.21% (0.2116 => 0.2184, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 6 20:06:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 6 Oct 2012 22:06:54 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121007030654.53CE32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4654?compare_to=4648&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4654, Order: 165366, Start Time: 2012-10-07 01:40:23, End Time: 2012-10-07 03:08:39 To: 4648, Order: 165365, Start Time: 2012-10-06 19:04:18, End Time: 2012-10-06 20:27:10 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (14 on baseline) Performance Regressions: 3 (92 on baseline) Performance Improvements: 6 (45 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 968 (754 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 5.40% (1.7304 => 1.8239, std.dev.: 0.0152) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.01% (4.3232 => 4.4967, std.dev.: 0.0167) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.09% (1.1263 => 1.1386, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -3.00% (0.9395 => 0.9113, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -2.84% (0.5736 => 0.5573, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -2.67% (0.4760 => 0.4633, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.51% (0.8437 => 0.8310, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: -4.07% (0.9074 => 0.8705, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.66% (1.4162 => 1.3644, std.dev.: 0.0191) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.44% (1.0187 => 1.0142, std.dev.: 0.0069) MultiSource/Applications/sqlite3/sqlite3: 0.13% (0.6261 => 0.6269, std.dev.: 0.0098) MultiSource/Benchmarks/McCat/08-main/main: -4.43% (0.1829 => 0.1748, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.49% (0.1605 => 0.1549, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.63% (0.3242 => 0.3189, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.45% (0.2419 => 0.2430, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.83% (0.3266 => 0.3293, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.21% (0.2351 => 0.2356, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel: -1.07% (0.0466 => 0.0461, std.dev.: 0.0010) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -34.66% (0.0251 => 0.0164, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 9.09% (0.0132 => 0.0144, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -19.29% (0.0394 => 0.0318, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -3.36% (0.0238 => 0.0230, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.03% (0.0291 => 0.0288, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -13.64% (0.0330 => 0.0285, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/casts: 2.22% (0.0180 => 0.0184, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -22.45% (0.0196 => 0.0152, std.dev.: 0.0022) SingleSource/UnitTests/Vector/multiplies: -2.00% (0.0250 => 0.0245, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -1.49% (0.0335 => 0.0330, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -3.63% (0.1432 => 0.1380, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: -1.76% (1.5658 => 1.5382, std.dev.: 0.0183) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.13% (0.1555 => 0.1557, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.05% (0.4007 => 0.4089, std.dev.: 0.0214) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.22% (0.1396 => 0.1413, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -12.20% (0.0615 => 0.0540, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -12.18% (0.0197 => 0.0173, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.52% (0.0641 => 0.0580, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.51% (1.1270 => 1.1212, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -44.44% (0.0027 => 0.0015, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -78.26% (0.0023 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.84% (0.0643 => 0.0554, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -47.64% (0.0254 => 0.0133, std.dev.: 0.0058) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.09% (0.7660 => 0.7653, std.dev.: 0.0175) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: -0.21% (1.7068 => 1.7032, std.dev.: 0.0019) SingleSource/UnitTests/2003-07-09-SignedArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 144.94% (0.0089 => 0.0218, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: 174.44% (0.0090 => 0.0247, std.dev.: 0.0002) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -27.52% (4.1772 => 3.0275, std.dev.: 0.0652) SingleSource/Benchmarks/Shootout-C++/except: 82633.33% (0.0006 => 0.4964, std.dev.: 0.0066) SingleSource/Regression/C++/EH/ctor_dtor_count: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 24.30% (0.0745 => 0.0926, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.04% (0.1159 => 0.1287, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.67% (0.6410 => 0.7030, std.dev.: 0.0050) MultiSource/Benchmarks/PAQ8p/paq8p: 9.65% (2.1763 => 2.3863, std.dev.: 0.0098) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.34% (0.1414 => 0.1546, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 8.95% (0.5309 => 0.5784, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.63% (0.3582 => 0.3891, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 8.05% (0.6173 => 0.6670, std.dev.: 0.0131) MultiSource/Applications/SIBsim4/SIBsim4: 7.89% (1.1653 => 1.2573, std.dev.: 0.0135) MultiSource/Applications/lemon/lemon: 7.47% (1.0046 => 1.0796, std.dev.: 0.0248) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.21% (0.2552 => 0.2736, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 6.77% (15.3105 => 16.3468, std.dev.: 0.1222) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.50% (1.5150 => 1.6135, std.dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: 6.25% (0.6915 => 0.7347, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.06% (0.7639 => 0.8102, std.dev.: 0.0108) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.96% (0.8569 => 0.9080, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.93% (0.6069 => 0.6429, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.79% (0.2797 => 0.2959, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/18-imp/imp: 5.78% (0.3217 => 0.3403, std.dev.: 0.0025) MultiSource/Applications/d/make_dparser: 5.62% (3.0225 => 3.1925, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.55% (0.3062 => 0.3232, std.dev.: 0.0042) MultiSource/Applications/Burg/burg: 5.47% (1.1440 => 1.2066, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 5.28% (0.1971 => 0.2075, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.15% (0.3901 => 0.4102, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.02% (0.4880 => 0.5125, std.dev.: 0.0060) MultiSource/Applications/SPASS/SPASS: 4.97% (13.3238 => 13.9858, std.dev.: 0.0429) MultiSource/Applications/oggenc/oggenc: 4.94% (4.7455 => 4.9800, std.dev.: 0.0330) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.91% (6.2546 => 6.5619, std.dev.: 0.0275) SingleSource/Benchmarks/Shootout-C++/hash: 4.89% (0.3520 => 0.3692, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.84% (0.7722 => 0.8096, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.82% (1.4408 => 1.5103, std.dev.: 0.0103) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.82% (0.2654 => 0.2782, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 4.76% (29.3170 => 30.7121, std.dev.: 0.4653) SingleSource/Benchmarks/Shootout-C++/lists: 4.60% (0.2347 => 0.2455, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 4.59% (2.0972 => 2.1934, std.dev.: 0.0137) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.47% (1.1672 => 1.2194, std.dev.: 0.0032) MultiSource/Applications/treecc/treecc: 4.42% (1.8798 => 1.9629, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.39% (1.2021 => 1.2549, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.39% (1.1827 => 1.2346, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.39% (2.0317 => 2.1208, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.2886 => 0.3012, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.23% (0.2952 => 0.3077, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.21% (0.2662 => 0.2774, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 4.02% (0.8405 => 0.8743, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.87% (1.0689 => 1.1103, std.dev.: 0.0045) MultiSource/Applications/lua/lua: 3.85% (3.5980 => 3.7365, std.dev.: 0.0484) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.79% (12.6413 => 13.1205, std.dev.: 0.1059) SingleSource/Benchmarks/Shootout-C++/hash2: 3.77% (0.3847 => 0.3992, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.76% (3.0758 => 3.1915, std.dev.: 0.0205) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.52% (0.7226 => 0.7480, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.49% (4.0318 => 4.1725, std.dev.: 0.0184) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.35% (4.2616 => 4.4042, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.17% (4.2815 => 4.4171, std.dev.: 0.0278) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.00% (0.4562 => 0.4699, std.dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 2.90% (6.4908 => 6.6791, std.dev.: 0.0444) MultiSource/Benchmarks/MallocBench/gs/gs: 2.83% (3.8796 => 3.9894, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.79% (1.3935 => 1.4324, std.dev.: 0.0126) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.68% (4.3380 => 4.4541, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.66% (0.5937 => 0.6095, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.46% (1.2742 => 1.3055, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.36% (0.7784 => 0.7968, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.18% (8.2559 => 8.4360, std.dev.: 0.0119) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.42% (1.6538 => 2.3388, std.dev.: 0.0026) SingleSource/Benchmarks/Stanford/Bubblesort: 38.78% (0.0263 => 0.0365, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2277, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout/ary3: 15.24% (1.7426 => 2.0081, std.dev.: 0.0594) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.75% (0.0766 => 0.0879, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.81% (4.0101 => 4.5637, std.dev.: 0.0527) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.76% (0.0917 => 0.1034, std.dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.57% (2.4042 => 2.7064, std.dev.: 0.0479) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 10.71% (1.0063 => 1.1141, std.dev.: 0.0317) SingleSource/Benchmarks/McGill/queens: 10.63% (1.6261 => 1.7989, std.dev.: 0.0032) SingleSource/Benchmarks/Stanford/Puzzle: 9.35% (0.1433 => 0.1567, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/mason/mason: 9.05% (0.5004 => 0.5457, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.75% (0.2857 => 0.3107, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/lists: 8.62% (7.0025 => 7.6060, std.dev.: 0.0324) MultiSource/Benchmarks/nbench/nbench: 8.45% (21.1721 => 22.9622, std.dev.: 0.5155) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.74% (4.2129 => 4.4967, std.dev.: 0.0167) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.92% (3.4080 => 3.5417, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/dt: 3.74% (0.9851 => 1.0219, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: 3.72% (15.2242 => 15.7912, std.dev.: 0.0688) MultiSource/Benchmarks/Bullet/bullet: 3.50% (6.9722 => 7.2160, std.dev.: 0.0751) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.29% (0.5587 => 0.5771, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 3.26% (3.5520 => 3.6678, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.86% (6.6312 => 6.8210, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash: 2.71% (0.6308 => 0.6479, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.44% (0.8498 => 0.8705, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/whetstone: 2.32% (2.3453 => 2.3996, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.27% (2.6656 => 2.7262, std.dev.: 0.0143) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.80% (4.6127 => 4.6957, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/ffbench: 1.62% (1.4117 => 1.4345, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/power/power: 1.44% (1.4184 => 1.4388, std.dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -54.65% (0.0591 => 0.0268, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -43.49% (0.2996 => 0.1693, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.49% (1.4113 => 1.1363, std.dev.: 0.0095) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.49% (1.4189 => 1.1565, std.dev.: 0.0191) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.15% (0.3497 => 0.2128, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -20.80% (1.7473 => 1.3839, std.dev.: 0.0373) SingleSource/Benchmarks/CoyoteBench/lpbench: -19.01% (5.2665 => 4.2655, std.dev.: 0.1869) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.15% (1.7361 => 1.4731, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1583, std.dev.: 0.0081) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -11.65% (15.8312 => 13.9874, std.dev.: 0.5474) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.66% (1.1647 => 1.0522, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.89% (1.4034 => 1.2787, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.50% (3.2007 => 2.9285, std.dev.: 0.0905) SingleSource/Benchmarks/Misc/flops: -8.34% (9.5474 => 8.7507, std.dev.: 0.0166) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.85% (3.6254 => 3.3772, std.dev.: 0.0145) MultiSource/Applications/lambda-0_1_3/lambda: -6.63% (7.6833 => 7.1738, std.dev.: 0.0205) SingleSource/Benchmarks/Shootout-C++/fibo: -6.40% (4.6355 => 4.3388, std.dev.: 0.0277) MultiSource/Benchmarks/FreeBench/distray/distray: -6.38% (0.2664 => 0.2494, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.26% (2.9728 => 2.7866, std.dev.: 0.0230) SingleSource/Benchmarks/Misc/richards_benchmark: -5.85% (1.4441 => 1.3596, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.45% (3.9413 => 3.7266, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout/fib2: -5.24% (4.4195 => 4.1877, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.15% (0.4564 => 0.4329, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: -5.15% (2.5166 => 2.3871, std.dev.: 0.0089) MultiSource/Benchmarks/mafft/pairlocalalign: -4.24% (62.4126 => 59.7671, std.dev.: 0.2543) SingleSource/Benchmarks/Shootout-C++/methcall: -4.20% (9.2503 => 8.8622, std.dev.: 0.0820) MultiSource/Applications/sgefa/sgefa: -3.76% (0.3746 => 0.3605, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/misr: -3.51% (0.4296 => 0.4145, std.dev.: 0.0041) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.40% (1.2722 => 1.2290, std.dev.: 0.0157) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.24% (3.7496 => 3.6280, std.dev.: 0.0194) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.80% (0.4140 => 0.4024, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -2.67% (1.8739 => 1.8239, std.dev.: 0.0152) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.54% (1.1683 => 1.1386, std.dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/dry: -2.25% (2.4013 => 2.3473, std.dev.: 0.0040) MultiSource/Benchmarks/PAQ8p/paq8p: -2.08% (92.7467 => 90.8184, std.dev.: 0.1984) MultiSource/Benchmarks/sim/sim: -2.02% (3.8907 => 3.8122, std.dev.: 0.0137) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.83% (2.3569 => 2.3138, std.dev.: 0.0040) MultiSource/Applications/aha/aha: -1.82% (3.4286 => 3.3661, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: -1.66% (1.0926 => 1.0745, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.59% (1.0686 => 1.0516, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.54% (9.3855 => 9.2408, std.dev.: 0.0133) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.52% (2.4457 => 2.4085, std.dev.: 0.0092) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3130, std.dev.: 0.0533) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.35% (27.1724 => 26.8060, std.dev.: 0.0725) SingleSource/Benchmarks/Dhrystone/fldry: -1.31% (2.4971 => 2.4645, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.62% (0.9980 => 1.0142, std.dev.: 0.0069) MultiSource/Applications/sqlite3/sqlite3: 4.10% (0.6022 => 0.6269, std.dev.: 0.0098) MultiSource/Benchmarks/McCat/08-main/main: 4.92% (0.1666 => 0.1748, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.32% (0.1554 => 0.1549, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.44% (0.3083 => 0.3189, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.50% (0.2394 => 0.2430, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.72% (0.3175 => 0.3293, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.35% (0.2302 => 0.2356, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel: 2.67% (0.0449 => 0.0461, std.dev.: 0.0010) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -31.67% (0.0240 => 0.0164, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -25.00% (0.0192 => 0.0144, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -18.46% (0.0390 => 0.0318, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -23.59% (0.0301 => 0.0230, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.41% (0.0284 => 0.0288, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -12.04% (0.0324 => 0.0285, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/casts: 3.95% (0.0177 => 0.0184, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -19.58% (0.0189 => 0.0152, std.dev.: 0.0022) SingleSource/UnitTests/Vector/multiplies: -1.61% (0.0249 => 0.0245, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: 1.54% (0.0325 => 0.0330, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -3.43% (0.1429 => 0.1380, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 2.42% (1.5019 => 1.5382, std.dev.: 0.0183) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 3.73% (0.1501 => 0.1557, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.10% (0.4264 => 0.4089, std.dev.: 0.0214) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.13% (0.1344 => 0.1413, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.32% (0.0589 => 0.0540, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -25.43% (0.0232 => 0.0173, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.23% (0.0639 => 0.0580, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.22% (1.1350 => 1.1212, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 150.00% (0.0006 => 0.0015, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.03% (0.0637 => 0.0554, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -45.93% (0.0246 => 0.0133, std.dev.: 0.0058) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.49% (0.7541 => 0.7653, std.dev.: 0.0175) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 10.86% (1.5363 => 1.7032, std.dev.: 0.0019) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 2.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 6 21:16:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 6 Oct 2012 23:16:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121007041645.DD6AD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4655?compare_to=4651&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4655, Order: 165366, Start Time: 2012-10-07 01:34:46, End Time: 2012-10-07 04:18:31 To: 4651, Order: 165365, Start Time: 2012-10-06 18:32:00, End Time: 2012-10-06 21:16:00 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (129 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 1040 (834 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.08% (2.0937 => 2.1164, std.dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -1.70% (55.0404 => 54.1037, std.dev.: 0.3471) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 10.51% (0.3465 => 0.3829, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.46% (0.3488 => 0.3853, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 10.45% (0.3446 => 0.3806, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 10.36% (1.5932 => 1.7582, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/trivial-interface: 10.34% (0.3442 => 0.3798, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.29% (0.3460 => 0.3816, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.26% (0.3469 => 0.3825) SingleSource/UnitTests/ObjC/for-in: 10.24% (0.3496 => 0.3854, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.05% (0.3643 => 0.4009, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 10.00% (0.3650 => 0.4015, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 9.85% (0.3724 => 0.4091, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.69% (0.5826 => 0.6332, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.56% (0.5889 => 0.6393, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.28% (0.2875 => 0.3113, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 8.09% (0.1619 => 0.1750, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 7.79% (0.2823 => 0.3043, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.72% (0.3004 => 0.3236, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 7.70% (0.7171 => 0.7723, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/random: 7.67% (0.2803 => 0.3018, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.63% (0.2738 => 0.2947, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.57% (0.3195 => 0.3437, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 7.55% (0.2714 => 0.2919, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.52% (0.2792 => 0.3002, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.52% (0.9909 => 1.0654, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 7.52% (0.2780 => 0.2989, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 7.49% (0.2725 => 0.2929, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.47% (0.2813 => 0.3023, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.44% (0.2729 => 0.2932, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.42% (0.2750 => 0.2954, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 7.40% (0.2811 => 0.3019, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.37% (2.0673 => 2.2197, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.35% (0.2911 => 0.3125, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 7.27% (0.3096 => 0.3321, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.26% (0.3362 => 0.3606, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.18% (0.4361 => 0.4674, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.16% (0.1620 => 0.1736, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.16% (0.3060 => 0.3279, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.14% (1.6211 => 1.7369, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 7.10% (0.3267 => 0.3499, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 7.10% (0.3678 => 0.3939, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 7.08% (0.3348 => 0.3585, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.03% (0.4994 => 0.5345, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.03% (1.3152 => 1.4076, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary: 7.00% (0.3258 => 0.3486, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 6.99% (0.3317 => 0.3549, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 6.95% (0.3726 => 0.3985, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.91% (0.1968 => 0.2104, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.90% (0.5000 => 0.5345, std.dev.: 0.0023) MultiSource/Benchmarks/PAQ8p/paq8p: 6.89% (0.4847 => 0.5181, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 6.87% (0.3477 => 0.3716, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 6.83% (5.5417 => 5.9203, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.81% (0.3625 => 0.3872, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 6.81% (23.5202 => 25.1215, std.dev.: 0.0173) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.79% (0.3845 => 0.4106, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.76% (0.4139 => 0.4419, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.76% (0.3282 => 0.3504, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.76% (3.5627 => 3.8034, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.72% (0.3124 => 0.3334, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.69% (0.3690 => 0.3937, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.54% (0.4146 => 0.4417, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.50% (0.2014 => 0.2145, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.48% (0.3981 => 0.4239, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.47% (0.4251 => 0.4526, std.dev.: 0.0050) MultiSource/Benchmarks/nbench/nbench: 6.43% (0.2566 => 0.2731, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.42% (0.5900 => 0.6279, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.29% (0.2736 => 0.2908, std.dev.: 0.0046) MultiSource/Applications/spiff/spiff: 6.28% (0.4029 => 0.4282, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.23% (0.3930 => 0.4175, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: 6.20% (1.0781 => 1.1449, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.17% (0.5026 => 0.5336, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.16% (2.7292 => 2.8974, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.14% (0.2866 => 0.3042, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 6.13% (1.8794 => 1.9946, std.dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 6.11% (4.2109 => 4.4681, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.11% (0.6435 => 0.6828, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.10% (0.2737 => 0.2904, std.dev.: 0.0037) MultiSource/Applications/siod/siod: 6.03% (0.6634 => 0.7034, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 5.93% (0.5012 => 0.5309, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.89% (0.3903 => 0.4133, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.89% (0.3890 => 0.4119, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.87% (0.3084 => 0.3265, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 5.86% (1.4269 => 1.5105, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.73% (0.2969 => 0.3139, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.72% (4.4195 => 4.6721, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.67% (0.4658 => 0.4922, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 5.51% (2.1013 => 2.2171, std.dev.: 0.0021) MultiSource/Applications/Burg/burg: 5.50% (0.5546 => 0.5851, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 5.42% (4.6177 => 4.8679, std.dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: 5.41% (2.1653 => 2.2824, std.dev.: 0.0022) MultiSource/Applications/minisat/minisat: 5.40% (0.3336 => 0.3516, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.38% (0.3271 => 0.3447, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 5.26% (0.9697 => 1.0207, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 5.20% (0.2691 => 0.2831, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.18% (0.2103 => 0.2212, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 5.01% (0.2075 => 0.2179, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 4.94% (0.7875 => 0.8264, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 4.85% (2.0346 => 2.1333, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.64% (1.9694 => 2.0607, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.49% (1.9966 => 2.0862, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.46% (0.7426 => 0.7757, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 4.39% (0.2391 => 0.2496, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.22% (0.5361 => 0.5587, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.15% (0.5584 => 0.5816, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.96% (11.6398 => 12.1012, std.dev.: 0.0122) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.85% (4.6926 => 4.8733, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 3.66% (0.3498 => 0.3626, std.dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 2.64% (11.9555 => 12.2716, std.dev.: 0.0096) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 6.69% (0.2122 => 0.2264, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6107, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6759, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-2: 4.97% (1.8057 => 1.8954, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 4.65% (15.4430 => 16.1604, std.dev.: 0.0328) SingleSource/Benchmarks/Dhrystone/dry: 4.22% (14.0481 => 14.6404, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1998, std.dev.: 0.0123) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5064, std.dev.: 0.0034) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.82% (3.1722 => 3.2298, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.65% (2.0820 => 2.1164, std.dev.: 0.0072) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2884, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5823, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.93% (25.4195 => 16.5409, std.dev.: 0.0281) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9740, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7954, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/ary2: -7.29% (0.2402 => 0.2227, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std.dev.: 0.0032) SingleSource/UnitTests/Vector/build2: -3.73% (11.2080 => 10.7898, std.dev.: 0.0108) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7740, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std.dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/fldry: -2.36% (17.2379 => 16.8312, std.dev.: 0.0230) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8669, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.15% (0.6293 => 0.6158, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5717, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4959, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.13% (105.3826 => 104.1900, std.dev.: 0.0339) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0463, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 6 21:30:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 6 Oct 2012 23:30:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121007043039.042F82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4656?compare_to=4652&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4656, Order: 165367, Start Time: 2012-10-07 03:18:01, End Time: 2012-10-07 04:32:23 To: 4652, Order: 165366, Start Time: 2012-10-07 01:34:37, End Time: 2012-10-07 02:49:05 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (180 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1042 (756 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 22.35% (2.0176 => 2.4686, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.45% (0.1410 => 0.1656, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 15.62% (0.0826 => 0.0955, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 14.22% (0.2243 => 0.2562, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.59% (0.0834 => 0.0939, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 12.40% (1.3693 => 1.5391, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 12.24% (0.1013 => 0.1137, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 12.06% (0.4328 => 0.4850, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.89% (0.1413 => 0.1581, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 11.74% (0.5818 => 0.6501, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.58% (0.2721 => 0.3036, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 11.50% (0.5748 => 0.6409, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.40% (0.1588 => 0.1769, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 11.33% (0.2781 => 0.3096, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 11.32% (0.4062 => 0.4522, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 11.25% (0.7038 => 0.7830, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.21% (3.9660 => 4.4104, std.dev.: 0.0077) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.19% (0.1072 => 0.1192, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.07% (0.2782 => 0.3090, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.00% (1.2193 => 1.3534, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.00% (0.0964 => 0.1070, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 10.96% (0.7061 => 0.7835, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.93% (0.1327 => 0.1472, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.89% (0.6283 => 0.6967, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.88% (0.3485 => 0.3864, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.81% (0.9199 => 1.0193, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.71% (0.2596 => 0.2874, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 10.66% (0.3293 => 0.3644, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 10.65% (0.2760 => 0.3054, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.65% (0.7710 => 0.8531, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hello: 10.63% (0.2607 => 0.2884, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.62% (1.4563 => 1.6109, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/strcat: 10.56% (0.2726 => 0.3014, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.56% (0.3022 => 0.3341, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.54% (0.3899 => 0.4310, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.53% (0.4016 => 0.4439, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 10.48% (0.2690 => 0.2972, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/wc: 10.45% (0.2937 => 0.3244, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 10.43% (0.2628 => 0.2902, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.41% (0.3756 => 0.4147, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.40% (0.2655 => 0.2931, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 10.38% (0.3149 => 0.3476, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 10.36% (0.1062 => 0.1172, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 10.33% (0.3107 => 0.3428, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.31% (0.2765 => 0.3050, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.30% (1.9828 => 2.1871, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.26% (0.3489 => 0.3847, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.26% (0.6959 => 0.7673, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sieve: 10.25% (0.3453 => 0.3807, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.24% (0.5265 => 0.5804, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.22% (0.2966 => 0.3269, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 10.21% (0.3868 => 0.4263, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 10.14% (0.2761 => 0.3041, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.14% (1.1364 => 1.2516, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.09% (0.4390 => 0.4833, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary2: 10.09% (0.3192 => 0.3514, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 10.07% (13.8202 => 15.2123, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.06% (0.3580 => 0.3940, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.90% (0.2696 => 0.2963, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 9.88% (0.2995 => 0.3291, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 9.84% (0.2988 => 0.3282, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 9.71% (0.3534 => 0.3877, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.71% (0.4791 => 0.5256, std.dev.: 0.0129) MultiSource/Applications/lemon/lemon: 9.61% (1.0313 => 1.1304, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 9.57% (0.1589 => 0.1741, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.43% (0.4379 => 0.4792, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.42% (0.1157 => 0.1266, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.36% (0.3130 => 0.3423, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.36% (0.5577 => 0.6099, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.17% (0.1276 => 0.1393, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.13% (0.1435 => 0.1566, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.12% (0.8698 => 0.9491, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 9.05% (16.6129 => 18.1160, std.dev.: 0.0089) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.98% (0.2127 => 0.2318, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 8.97% (0.6744 => 0.7349, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 8.96% (0.2945 => 0.3209, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.92% (0.2914 => 0.3174, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 8.90% (0.8310 => 0.9050, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.86% (0.1986 => 0.2162, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.86% (0.7460 => 0.8121, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.85% (0.5637 => 0.6136, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 8.81% (1.1061 => 1.2035, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.71% (0.3755 => 0.4082, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.69% (0.3246 => 0.3528, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 8.66% (0.3220 => 0.3499, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 8.52% (3.8646 => 4.1937, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.46% (7.2180 => 7.8286, std.dev.: 0.0076) MultiSource/Benchmarks/nbench/nbench: 8.38% (1.0594 => 1.1482, std.dev.: 0.0036) MultiSource/Applications/d/make_dparser: 8.37% (3.1889 => 3.4557, std.dev.: 0.0102) MultiSource/Applications/spiff/spiff: 8.33% (0.7506 => 0.8131, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.31% (0.8818 => 0.9551, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.26% (0.2023 => 0.2190, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 8.14% (1.9270 => 2.0839, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.10% (0.1865 => 0.2016, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 8.06% (1.2749 => 1.3777, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 8.05% (0.1478 => 0.1597, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 7.98% (2.1791 => 2.3529, std.dev.: 0.0079) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.97% (0.3511 => 0.3791, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.97% (0.1569 => 0.1694, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 7.97% (0.2925 => 0.3158, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.92% (0.6576 => 0.7097, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 7.92% (0.3131 => 0.3379, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.90% (3.6692 => 3.9591, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 7.85% (4.6629 => 5.0290, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 7.82% (14.8535 => 16.0148, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.68% (4.4433 => 4.7846, std.dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.66% (0.1789 => 0.1926, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.63% (4.3801 => 4.7145, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.63% (1.3245 => 1.4255, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 7.59% (8.4961 => 9.1411, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/em3d/em3d: 7.54% (0.1657 => 0.1782, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 7.54% (0.4113 => 0.4423, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.53% (0.6135 => 0.6597, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.48% (0.2140 => 0.2300, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 7.28% (0.6250 => 0.6705, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 7.24% (1.2292 => 1.3182, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.11% (0.9108 => 0.9756, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.99% (0.2504 => 0.2679, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.87% (4.9865 => 5.3293, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.86% (3.2742 => 3.4987, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.74% (1.5188 => 1.6212, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.70% (1.1333 => 1.2092, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.68% (0.4805 => 0.5126, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 6.57% (0.2008 => 0.2140, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.32% (0.1819 => 0.1934, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 6.30% (6.5754 => 6.9898, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.26% (0.3245 => 0.3448, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 6.25% (0.4003 => 0.4253, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 6.08% (0.3914 => 0.4152, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 6.01% (0.3578 => 0.3793, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 5.94% (0.3789 => 0.4014, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 5.84% (0.3646 => 0.3859, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 5.84% (0.3940 => 0.4170, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.83% (2.1007 => 2.2231, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.80% (6.2785 => 6.6429, std.dev.: 0.0056) MultiSource/Applications/lua/lua: 5.78% (3.7467 => 3.9634, std.dev.: 0.0079) SingleSource/UnitTests/ObjC/exceptions-2: 5.78% (0.3601 => 0.3809, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.77% (0.2321 => 0.2455, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 5.76% (0.3663 => 0.3874, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.75% (0.3650 => 0.3860, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 5.69% (0.3623 => 0.3829, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.26% (13.2842 => 13.9824, std.dev.: 0.0153) MultiSource/Applications/sqlite3/sqlite3: 3.76% (16.2614 => 16.8726, std.dev.: 0.0098) MultiSource/Applications/ClamAV/clamscan: 3.41% (14.5298 => 15.0254, std.dev.: 0.0071) MultiSource/Benchmarks/Bullet/bullet: 1.01% (33.2944 => 33.6317, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5193, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fbench: 25.50% (1.8175 => 2.2810, std.dev.: 0.0455) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628) SingleSource/Benchmarks/Misc/richards_benchmark: 11.02% (1.1560 => 1.2834, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.02% (0.8273 => 0.9019, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (3.1736 => 3.4147, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.31% (1.2998 => 1.3818, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0044, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.67% (11.2619 => 11.6755, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9855, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 3.29% (10.7476 => 11.1013, std.dev.: 0.0639) SingleSource/Regression/C/uint64_to_float: 2.95% (0.5449 => 0.5610, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309) SingleSource/Benchmarks/Misc/salsa20: 2.11% (7.4271 => 7.5841, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4540, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0497, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5126, std.dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9688, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1849, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.16% (5.5130 => 5.5772, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0268, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.03% (8.8259 => 8.9172, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/lists: 1.03% (12.4560 => 12.5838, std.dev.: 0.0091) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.19% (0.2670 => 0.1410, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.90% (0.4657 => 0.3870, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -15.56% (0.0707 => 0.0597) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.98% (1.3819 => 1.1887, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.78% (1.3813 => 1.1909, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.46% (22.5627 => 21.7817, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.15% (0.2238 => 0.1966, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.91% (1.2308 => 1.0965, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.03% (20.3410 => 18.3003, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.97% (1.3780 => 1.2958, std.dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.17% (2.6470 => 2.5101, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.17% (0.9996 => 0.9579, std.dev.: 0.0046) MultiSource/Applications/siod/siod: -3.58% (3.2729 => 3.1556, std.dev.: 0.0068) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.47% (1.7688 => 1.7075, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.62% (26.5159 => 25.8212, std.dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.39% (3.0263 => 2.9540, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: -2.36% (1.9762 => 1.9295, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -1.79% (28.2225 => 27.7161, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/lists: -1.77% (6.3560 => 6.2436, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0073, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -1.26% (4.5928 => 4.5349, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4951, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: -1.19% (9.3358 => 9.2247, std.dev.: 0.0240) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2577, std.dev.: 0.0015) MultiSource/Applications/viterbi/viterbi: -1.03% (4.4810 => 4.4347, std.dev.: 0.0056) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 6 21:40:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 6 Oct 2012 23:40:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121007044029.A723E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4657?compare_to=4653&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4657, Order: 165367, Start Time: 2012-10-07 03:22:51, End Time: 2012-10-07 04:42:15 To: 4653, Order: 165366, Start Time: 2012-10-07 01:34:31, End Time: 2012-10-07 02:53:48 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (151 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1023 (766 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.67% (54.6518 => 56.6579, std.dev.: 0.0481) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.11% (78.9676 => 79.8468, std.dev.: 0.2529) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.15% (0.5867 => 0.5876, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 0.12% (16.1724 => 16.1913, std.dev.: 0.0131) MultiSource/Benchmarks/Bullet/bullet: -0.04% (54.8734 => 54.8528, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/gs/gs: 0.04% (4.3854 => 4.3870, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (1.2446 => 1.2446, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.12% (7.7488 => 7.7581, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.14% (0.7389 => 0.7399, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -1.10% (0.0365 => 0.0361, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.79% (0.2184 => 0.2145, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -13.27% (63.2438 => 54.8528, std.dev.: 0.0051) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.42% (14.1553 => 18.7443, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++-EH/spirit: 61.20% (3.4629 => 5.5822, std.dev.: 0.0067) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14235.56% (0.0720 => 10.3216, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952200.00% (0.0001 => 9.9523, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 49.37% (0.2554 => 0.3815, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 45.58% (10.3673 => 15.0931, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/distray/distray: 30.59% (0.1056 => 0.1379, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 30.21% (0.1622 => 0.2112, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.13% (7.0540 => 8.1216, std.dev.: 0.0081) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.69% (2.2022 => 2.5258, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 14.59% (0.1432 => 0.1641, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.30% (0.1566 => 0.1790, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.30% (1.7609 => 1.9775, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.17% (0.0871 => 0.0977, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.15% (0.3543 => 0.3938, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/oourafft: 10.82% (0.3282 => 0.3637, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.80% (0.1584 => 0.1755, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 10.51% (0.3473 => 0.3838, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.39% (0.3543 => 0.3911, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.38% (0.3497 => 0.3860, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.33% (0.3561 => 0.3929, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.32% (0.3516 => 0.3879, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.14% (0.3828 => 0.4216, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.10% (0.3694 => 0.4067, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.06% (0.3927 => 0.4322, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.91% (0.3886 => 0.4271, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 9.72% (0.1440 => 0.1580, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.11% (0.1438 => 0.1569, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 9.09% (0.7433 => 0.8109, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.09% (0.6675 => 0.7282, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 9.00% (0.1655 => 0.1804, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 9.00% (0.7115 => 0.7755, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.98% (0.1625 => 0.1771, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 8.89% (9.4845 => 10.3274, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.80% (1.5415 => 1.6771, std.dev.: 0.0098) SingleSource/UnitTests/ObjC++/Hello: 8.79% (0.5925 => 0.6446, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.71% (0.4879 => 0.5304, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.67% (0.6030 => 0.6553, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 8.65% (10.4361 => 11.3388, std.dev.: 0.0031) MultiSource/Applications/sgefa/sgefa: 8.56% (0.3109 => 0.3375, std.dev.: 0.0070) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.50% (0.3177 => 0.3447, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.43% (0.4615 => 0.5004, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 8.36% (0.3423 => 0.3709, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 8.30% (3.3354 => 3.6124, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.25% (0.5105 => 0.5526, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.16% (1.3050 => 1.4115, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 8.14% (0.1695 => 0.1833, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.12% (0.5860 => 0.6336, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.04% (0.2700 => 0.2917, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 8.03% (5.7591 => 6.2217, std.dev.: 0.0091) SingleSource/UnitTests/ObjC++/property-reference: 7.97% (0.7326 => 0.7910, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.97% (4.2646 => 4.6045, std.dev.: 0.0147) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.97% (0.2271 => 0.2452, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.93% (0.8172 => 0.8820, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.92% (0.3307 => 0.3569, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.2065 => 0.2227, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.82% (0.3121 => 0.3365, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.81% (0.1510 => 0.1628, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 7.77% (0.3422 => 0.3688, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.76% (0.5569 => 0.6001, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: 7.71% (0.6456 => 0.6954, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.69% (0.2107 => 0.2269, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.66% (0.4203 => 0.4525, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.59% (0.5020 => 0.5401, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 7.59% (0.3387 => 0.3644, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.58% (0.4103 => 0.4414, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.58% (0.9765 => 1.0505, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: 7.58% (0.4289 => 0.4614, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.56% (8.1363 => 8.7518, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.54% (0.2758 => 0.2966, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.53% (5.0018 => 5.3784, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.45% (0.8067 => 0.8668, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.44% (4.9449 => 5.3130, std.dev.: 0.0054) SingleSource/Regression/C++/ofstream_ctor: 7.40% (0.2905 => 0.3120, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.40% (0.3865 => 0.4151, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.40% (0.4636 => 0.4979, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.37% (0.1940 => 0.2083, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 7.34% (0.7835 => 0.8410, std.dev.: 0.0025) MultiSource/Applications/hbd/hbd: 7.33% (1.5603 => 1.6747, std.dev.: 0.0023) MultiSource/Applications/Burg/burg: 7.30% (1.1642 => 1.2492, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.26% (0.2891 => 0.3101, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 7.26% (0.4048 => 0.4342, std.dev.: 0.0077) MultiSource/Applications/lua/lua: 7.25% (3.8723 => 4.1530, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/strcat: 7.24% (0.2831 => 0.3036, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.16% (0.4620 => 0.4951, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.14% (7.9617 => 8.5303, std.dev.: 0.0035) MultiSource/Applications/viterbi/viterbi: 7.14% (0.1555 => 0.1666, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 7.13% (0.3603 => 0.3860, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.05% (0.3136 => 0.3357, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 6.99% (0.3232 => 0.3458, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 6.95% (0.3684 => 0.3940, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.94% (0.3283 => 0.3511, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 6.91% (1.0722 => 1.1463, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/except: 6.90% (0.2871 => 0.3069, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.90% (2.0665 => 2.2090, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/matrix: 6.88% (0.3098 => 0.3311, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.86% (0.3162 => 0.3379, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.83% (0.3441 => 0.3676, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.82% (0.2872 => 0.3068, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.82% (0.3826 => 0.4087, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.78% (0.3052 => 0.3259, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.76% (0.2603 => 0.2779, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.75% (0.2756 => 0.2942, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 6.75% (2.0273 => 2.1641, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 6.72% (0.2725 => 0.2908, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.64% (0.2802 => 0.2988, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.60% (0.2877 => 0.3067, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.57% (1.1861 => 1.2640, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/hello: 6.56% (0.2714 => 0.2892, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.44% (0.2793 => 0.2973, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.43% (1.5859 => 1.6879, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 6.42% (0.3180 => 0.3384, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.31% (0.6450 => 0.6857, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.30% (0.3379 => 0.3592, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 6.24% (2.2969 => 2.4403, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.14% (0.5981 => 0.6348, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 6.12% (0.8921 => 0.9467, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 6.06% (21.9371 => 23.2659, std.dev.: 0.0096) MultiSource/Benchmarks/McCat/05-eks/eks: 5.93% (0.4299 => 0.4554, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.68% (2.2024 => 2.3274, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.63% (0.4064 => 0.4293, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.43% (1.4186 => 1.4956, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.25% (0.1906 => 0.2006, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 5.19% (1.1840 => 1.2455, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.94% (0.2266 => 0.2378, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.85% (0.3131 => 0.3283, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 4.82% (1.2842 => 1.3461, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.25% (0.8101 => 0.8445, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.72% (14.3668 => 14.9009, std.dev.: 0.0090) MultiSource/Applications/sqlite3/sqlite3: 3.36% (17.1811 => 17.7584, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.36% (0.3427 => 0.3542, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.86% (0.3817 => 0.3926, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.81% (3.8922 => 4.0017, std.dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.42% (1.1194 => 1.1465, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.91% (1.1396 => 1.2525, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 9.22% (3.1595 => 3.4508, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3691, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.63% (3.6395 => 3.7717, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.74% (4.2280 => 4.3437, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7650, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.48% (0.9540 => 0.9681, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8130, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.20% (2.6546 => 2.6864, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1288, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.04% (0.8651 => 0.1727, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.46% (5.2763 => 3.2470, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.72% (5.3855 => 3.6231, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.33% (5.3526 => 3.6223, std.dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -14.37% (54.1659 => 46.3837, std.dev.: 0.0111) MultiSource/Benchmarks/FreeBench/mason/mason: -13.32% (0.0811 => 0.0703, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -11.12% (22.1758 => 19.7100, std.dev.: 0.0238) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.03% (2.9384 => 2.6143, std.dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.46% (1.1492 => 0.7647, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.87% (1.6925 => 1.4239, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.43% (0.0998 => 0.0864, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.91% (1.2373 => 1.0899, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/mandel-2: -10.36% (1.5373 => 1.3781, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/mason/mason: -9.86% (0.2161 => 0.1948, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.43% (19.9488 => 18.2663, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.75% (1.8329 => 1.7091, std.dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.30% (1.6805 => 1.5915, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7966, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5066, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0008) MultiSource/Applications/siod/siod: -3.65% (3.2827 => 3.1630, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.48% (0.9957 => 0.9610, std.dev.: 0.0046) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5102, std.dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0987, std.dev.: 0.0016) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.03% (8.6802 => 8.5036, std.dev.: 0.0145) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.96% (8.1563 => 7.9968, std.dev.: 0.0155) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6783, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -1.73% (10.2830 => 10.1048, std.dev.: 0.0141) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5116, std.dev.: 0.0023) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4221, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout/lists: -1.09% (6.2999 => 6.2311, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8563, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.37% (0.5229 => 0.5876, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 8.02% (14.9895 => 16.1913, std.dev.: 0.0131) MultiSource/Benchmarks/MallocBench/gs/gs: 6.73% (4.1105 => 4.3870, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.65% (1.1048 => 1.2446, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.38% (7.1582 => 7.7581, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.92% (0.6222 => 0.7399, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36000.00% (0.0001 => 0.0361, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.37% (0.2116 => 0.2145, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 6 21:45:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 6 Oct 2012 23:45:36 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121007044536.DF52D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4658?compare_to=4654&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4658, Order: 165367, Start Time: 2012-10-07 03:24:40, End Time: 2012-10-07 04:47:23 To: 4654, Order: 165366, Start Time: 2012-10-07 01:40:23, End Time: 2012-10-07 03:08:39 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (14 on baseline) Performance Regressions: 16 (109 on baseline) Performance Improvements: 1 (50 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 960 (732 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 5.91% (0.3047 => 0.3227, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.20% (0.5816 => 0.6060, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.17% (0.4633 => 0.4780, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.05% (0.5573 => 0.5743, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.51% (0.9113 => 0.9342, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.94% (1.1363 => 1.1583, std.dev.: 0.0085) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.02% (0.3154 => 0.3470, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/heapsort: 8.79% (3.0395 => 3.3067, std.dev.: 0.0571) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 5.63% (6.3405 => 6.6975, std.dev.: 0.0657) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.64% (21.1765 => 22.1596, std.dev.: 0.1541) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.43% (3.3691 => 3.5183, std.dev.: 0.0299) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.27% (1.2708 => 1.2996, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.92% (1.8239 => 1.8589, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.52% (59.5703 => 60.4753, std.dev.: 0.3412) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.26% (4.4880 => 4.5446, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/methcall: 1.11% (8.8622 => 8.9602, std.dev.: 0.0192) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/lpbench: -3.60% (4.2655 => 4.1120, std.dev.: 0.0299) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 1.22% (1.0142 => 1.0266, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: -0.37% (0.6269 => 0.6246, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 4.29% (0.1748 => 0.1823, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.23% (0.1549 => 0.1599, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.29% (0.3189 => 0.3230, std.dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.62% (0.2430 => 0.2415, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.09% (0.3293 => 0.3257, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.04% (0.2356 => 0.2355, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: 0.43% (0.0461 => 0.0463, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 52.44% (0.0164 => 0.0250, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 39.58% (0.0144 => 0.0201) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 25.47% (0.0318 => 0.0399, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 33.48% (0.0230 => 0.0307, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.04% (0.0288 => 0.0291, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -11.23% (0.0285 => 0.0253, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/casts: 1.09% (0.0184 => 0.0186, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 29.61% (0.0152 => 0.0197, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: 5.71% (0.0245 => 0.0259, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -7.27% (0.0330 => 0.0306, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 100.00% (0.0005 => 0.0010) MultiSource/Applications/ClamAV/clamscan: 3.55% (0.1380 => 0.1429, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -3.17% (1.5382 => 1.4894, std.dev.: 0.0414) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.26% (0.1557 => 0.1561, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.32% (0.4089 => 0.4102, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.49% (0.1413 => 0.1434, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 12.41% (0.0540 => 0.0607, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 35.26% (0.0173 => 0.0234, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.34% (0.0580 => 0.0611, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.52% (1.1212 => 1.1270, std.dev.: 0.0200) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -66.67% (0.0015 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 380.00% (0.0005 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.36% (0.0554 => 0.0556, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 90.98% (0.0133 => 0.0254, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: - (0.7653 => 0.7653, std.dev.: 0.0095) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.22% (1.7032 => 1.7070, std.dev.: 0.0017) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 147.19% (0.0089 => 0.0220, std.dev.: 0.0007) SingleSource/UnitTests/2003-08-11-VaListArg: 177.78% (0.0090 => 0.0250, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -26.31% (4.1772 => 3.0782, std.dev.: 0.0246) SingleSource/Benchmarks/Shootout-C++/except: 82850.00% (0.0006 => 0.4977, std.dev.: 0.0055) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.76% (0.0745 => 0.0922, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.27% (0.1159 => 0.1278, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.25% (0.1414 => 0.1559, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.47% (0.6410 => 0.7017, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: 9.44% (2.1763 => 2.3817, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++/bigfib: 9.12% (0.5309 => 0.5793, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.88% (0.3582 => 0.3900, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 7.73% (1.0046 => 1.0823, std.dev.: 0.0042) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.28% (0.3008 => 0.3227, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.01% (0.2552 => 0.2731, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 6.92% (1.1653 => 1.2459, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 6.90% (0.6173 => 0.6599, std.dev.: 0.0074) MultiSource/Applications/kimwitu++/kc: 6.75% (15.3105 => 16.3446, std.dev.: 0.0625) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.36% (0.7639 => 0.8125, std.dev.: 0.0077) MultiSource/Applications/lambda-0_1_3/lambda: 6.19% (0.6915 => 0.7343, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.11% (1.5150 => 1.6075, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.88% (0.6069 => 0.6426, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.70% (0.4248 => 0.4490, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 5.63% (29.3170 => 30.9662, std.dev.: 0.1334) SingleSource/Benchmarks/Misc/oourafft: 5.58% (0.1971 => 0.2081, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.57% (0.5740 => 0.6060, std.dev.: 0.0038) MultiSource/Applications/d/make_dparser: 5.47% (3.0225 => 3.1879, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.45% (0.8569 => 0.9036, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.29% (1.1827 => 1.2453, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.29% (0.2797 => 0.2945, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/18-imp/imp: 5.16% (0.3217 => 0.3383, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.06% (0.2886 => 0.3032, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 4.93% (8.2186 => 8.6235, std.dev.: 0.0362) MultiSource/Applications/hbd/hbd: 4.88% (1.3268 => 1.3915, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.87% (0.3062 => 0.3211, std.dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 4.79% (4.7455 => 4.9729, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.78% (1.4408 => 1.5097, std.dev.: 0.0234) MultiSource/Applications/Burg/burg: 4.65% (1.1440 => 1.1972, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.58% (1.1672 => 1.2207, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.57% (0.4880 => 0.5103, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.56% (0.3901 => 0.4079, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 4.56% (0.2347 => 0.2454, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 4.48% (0.2877 => 0.3006, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.47% (0.7226 => 0.7549, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.45% (0.2654 => 0.2772, std.dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 4.44% (13.3238 => 13.9149, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.28% (0.2662 => 0.2776, std.dev.: 0.0039) MultiSource/Applications/treecc/treecc: 4.19% (1.8798 => 1.9586, std.dev.: 0.0046) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.18% (6.2546 => 6.5159, std.dev.: 0.0370) MultiSource/Benchmarks/Prolangs-C/football/football: 4.13% (0.8405 => 0.8752, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.10% (0.2952 => 0.3073, std.dev.: 0.0015) MultiSource/Applications/siod/siod: 4.07% (2.0972 => 2.1825, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.05% (0.5636 => 0.5864, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.04% (0.5520 => 0.5743, std.dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 4.02% (1.0821 => 1.1256, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.00% (0.4596 => 0.4780, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.94% (0.5937 => 0.6171, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.87% (4.2616 => 4.4264, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/lists1: 3.83% (0.2771 => 0.2877, std.dev.: 0.0017) MultiSource/Applications/lua/lua: 3.80% (3.5980 => 3.7349, std.dev.: 0.0203) MultiSource/Benchmarks/McCat/09-vor/vor: 3.77% (0.3026 => 0.3140, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.75% (1.2742 => 1.3220, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/gs/gs: 3.67% (3.8796 => 4.0219, std.dev.: 0.0100) MultiSource/Applications/JM/lencod/lencod: 3.61% (14.7256 => 15.2575, std.dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.60% (0.2806 => 0.2907, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.59% (3.0758 => 3.1861, std.dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.49% (2.0317 => 2.1026, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.48% (1.2021 => 1.2439, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.47% (0.9029 => 0.9342, std.dev.: 0.0055) MultiSource/Benchmarks/sim/sim: 3.44% (0.3084 => 0.3190, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.42% (0.4562 => 0.4718, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 3.35% (0.3520 => 0.3638, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.34% (0.3418 => 0.3532, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.30% (0.7784 => 0.8041, std.dev.: 0.0087) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.22% (1.0689 => 1.1033, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/hash2: 3.15% (0.3847 => 0.3968, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.01% (12.6413 => 13.0222, std.dev.: 0.0504) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.94% (1.3935 => 1.4344, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.89% (8.2559 => 8.4949, std.dev.: 0.0158) MultiSource/Applications/JM/ldecod/ldecod: 2.83% (6.4908 => 6.6744, std.dev.: 0.0192) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.47% (4.3380 => 4.4453, std.dev.: 0.0301) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.34% (4.0318 => 4.1260, std.dev.: 0.0238) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.20% (4.2815 => 4.3755, std.dev.: 0.0354) MultiSource/Applications/hexxagon/hexxagon: 1.93% (0.9425 => 0.9607, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 47.89% (0.0261 => 0.0386, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/pi: 41.38% (1.6538 => 2.3381, std.dev.: 0.0043) SingleSource/Benchmarks/Stanford/Bubblesort: 40.68% (0.0263 => 0.0370, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 23.24% (0.0766 => 0.0944, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 22.14% (3.4629 => 4.2295, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 17.01% (0.0917 => 0.1073, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: 14.78% (1.7426 => 2.0002, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/Puzzle: 13.61% (0.1433 => 0.1628, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.50% (4.0101 => 4.5515, std.dev.: 0.0162) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.43% (2.4042 => 2.7031, std.dev.: 0.0322) SingleSource/Benchmarks/McGill/queens: 11.14% (1.6261 => 1.8072, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/mason/mason: 10.17% (0.5004 => 0.5513, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: 9.08% (7.0025 => 7.6381, std.dev.: 0.0079) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.26% (0.2857 => 0.3093, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.85% (1.0063 => 1.0853, std.dev.: 0.0159) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.12% (0.3301 => 0.3470, std.dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: 4.85% (6.9722 => 7.3105, std.dev.: 0.0534) SingleSource/Benchmarks/Misc/fp-convert: 4.52% (15.2242 => 15.9120, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/dt: 4.26% (0.9851 => 1.0271, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5414, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 3.44% (3.5520 => 3.6741, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.11% (0.5587 => 0.5761, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.89% (2.6656 => 2.7426, std.dev.: 0.0176) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.86% (6.6312 => 6.8210, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.76% (0.5876 => 0.6038, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 2.69% (0.6308 => 0.6478, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.12% (1.2726 => 1.2996, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/whetstone: 2.07% (2.3453 => 2.3938, std.dev.: 0.0164) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.86% (4.6127 => 4.6986, std.dev.: 0.0207) MultiSource/Benchmarks/Olden/power/power: 1.45% (1.4184 => 1.4389, std.dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.33% (0.0591 => 0.0329, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -43.59% (0.2996 => 0.1690, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.50% (1.4189 => 1.1564, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.93% (1.4113 => 1.1583, std.dev.: 0.0085) SingleSource/UnitTests/Vector/constpool: -6.56% (8.9977 => 8.4077, std.dev.: 0.1190) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.21% (0.3497 => 0.2126, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.92% (5.2665 => 4.1120, std.dev.: 0.0299) SingleSource/Benchmarks/Shootout-C++/ary3: -20.06% (1.7473 => 1.3968, std.dev.: 0.0173) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.25% (1.7361 => 1.4714, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/sieve: -12.23% (8.1594 => 7.1618, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.42% (1.1647 => 1.0550, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -9.16% (0.1114 => 0.1012, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: -8.41% (9.5474 => 8.7449, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.28% (1.4034 => 1.2872, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.75% (3.2007 => 2.9527, std.dev.: 0.0174) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.38% (15.8312 => 14.6633, std.dev.: 0.3259) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.69% (3.6254 => 3.3830, std.dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: -6.67% (7.6833 => 7.1705, std.dev.: 0.0200) SingleSource/Benchmarks/Shootout-C++/fibo: -6.50% (4.6355 => 4.3344, std.dev.: 0.0164) SingleSource/Benchmarks/Misc/richards_benchmark: -6.30% (1.4441 => 1.3531, std.dev.: 0.0114) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.03% (2.9728 => 2.7935, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.44% (3.9413 => 3.7270, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/fib2: -5.31% (4.4195 => 4.1850, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/bh/bh: -5.03% (2.5166 => 2.3899, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.60% (0.4564 => 0.4354, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: -4.11% (62.4126 => 59.8463, std.dev.: 0.3251) MultiSource/Applications/sgefa/sgefa: -4.11% (0.3746 => 0.3592, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.73% (1.2959 => 1.2476, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/methcall: -3.14% (9.2503 => 8.9602, std.dev.: 0.0192) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.13% (1.2722 => 1.2324, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.06% (45.4683 => 44.0789, std.dev.: 0.3937) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.87% (2.4457 => 2.3756, std.dev.: 0.0181) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.82% (3.7496 => 3.6440, std.dev.: 0.0232) SingleSource/Benchmarks/McGill/misr: -2.61% (0.4296 => 0.4184, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ackermann: -2.33% (3.6023 => 3.5183, std.dev.: 0.0299) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.31% (1.1683 => 1.1413, std.dev.: 0.0024) MultiSource/Benchmarks/PAQ8p/paq8p: -2.13% (92.7467 => 90.7748, std.dev.: 0.4369) SingleSource/Benchmarks/Dhrystone/dry: -2.11% (2.4013 => 2.3506, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: -1.94% (3.4876 => 3.4198, std.dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: -1.91% (3.4230 => 3.3575, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.88% (2.3569 => 2.3126, std.dev.: 0.0012) MultiSource/Applications/aha/aha: -1.86% (3.4286 => 3.3648, std.dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.65% (9.3855 => 9.2305, std.dev.: 0.0101) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -1.54% (3.8907 => 3.8309, std.dev.: 0.0165) MultiSource/Benchmarks/FreeBench/neural/neural: -1.51% (1.0926 => 1.0761, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.35% (25.6658 => 25.3197, std.dev.: 0.0158) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.28% (27.1724 => 26.8252, std.dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/fldry: -1.25% (2.4971 => 2.4658, std.dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: -1.21% (6.7458 => 6.6643, std.dev.: 0.0161) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.87% (0.9980 => 1.0266, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 3.72% (0.6022 => 0.6246, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 9.42% (0.1666 => 0.1823, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.90% (0.1554 => 0.1599, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.77% (0.3083 => 0.3230, std.dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.88% (0.2394 => 0.2415, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.58% (0.3175 => 0.3257, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.30% (0.2302 => 0.2355, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: 3.12% (0.0449 => 0.0463, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.17% (0.0240 => 0.0250, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 4.69% (0.0192 => 0.0201) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.31% (0.0390 => 0.0399, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.99% (0.0301 => 0.0307, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.46% (0.0284 => 0.0291, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -21.91% (0.0324 => 0.0253, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/casts: 5.08% (0.0177 => 0.0186, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 4.23% (0.0189 => 0.0197, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: 4.02% (0.0249 => 0.0259, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -5.85% (0.0325 => 0.0306, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010) MultiSource/Applications/ClamAV/clamscan: - (0.1429 => 0.1429, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -0.83% (1.5019 => 1.4894, std.dev.: 0.0414) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 4.00% (0.1501 => 0.1561, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.80% (0.4264 => 0.4102, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.70% (0.1344 => 0.1434, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.06% (0.0589 => 0.0607, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.86% (0.0232 => 0.0234, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.38% (0.0639 => 0.0611, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.70% (1.1350 => 1.1270, std.dev.: 0.0200) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -16.67% (0.0006 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.72% (0.0637 => 0.0556, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.25% (0.0246 => 0.0254, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.49% (0.7541 => 0.7653, std.dev.: 0.0095) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.11% (1.5363 => 1.7070, std.dev.: 0.0017) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 6 23:14:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 01:14:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121007061403.426D62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4659?compare_to=4656&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4659, Order: 165368, Start Time: 2012-10-07 05:01:22, End Time: 2012-10-07 06:15:47 To: 4656, Order: 165367, Start Time: 2012-10-07 03:18:01, End Time: 2012-10-07 04:32:23 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (181 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1041 (756 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.44% (78.2311 => 80.1364, std.dev.: 0.6847) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 22.06% (2.0176 => 2.4627, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.52% (0.1410 => 0.1657, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 15.50% (0.0826 => 0.0954, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: 14.49% (0.2243 => 0.2568, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.83% (0.0834 => 0.0941) MultiSource/Applications/hbd/hbd: 12.40% (1.3693 => 1.5391, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.33% (0.0819 => 0.0920, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 12.24% (0.1013 => 0.1137, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 12.22% (0.4328 => 0.4857, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.89% (0.1413 => 0.1581, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.76% (0.2721 => 0.3041, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 11.64% (0.4062 => 0.4535, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 11.64% (0.5818 => 0.6495, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.44% (3.9660 => 4.4196, std.dev.: 0.0099) SingleSource/UnitTests/ObjC++/Hello: 11.41% (0.5748 => 0.6404, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 11.40% (0.2781 => 0.3098, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.40% (0.1588 => 0.1769, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.29% (0.2782 => 0.3096, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 11.21% (0.7038 => 0.7827, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.19% (0.1072 => 0.1192, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.12% (0.7710 => 0.8567, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.10% (0.0964 => 0.1071, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.09% (0.2596 => 0.2884) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.05% (1.2193 => 1.3540, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.05% (0.6283 => 0.6977, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.02% (0.3485 => 0.3869, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 10.93% (0.3293 => 0.3653, std.dev.: 0.0042) SingleSource/UnitTests/ObjC++/property-reference: 10.90% (0.7061 => 0.7831, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.87% (0.9199 => 1.0199, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.85% (0.1327 => 0.1471, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.82% (0.3022 => 0.3349, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hello: 10.82% (0.2607 => 0.2889, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 10.80% (0.2760 => 0.3058, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 10.79% (0.2726 => 0.3020, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.77% (1.4563 => 1.6132, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 10.73% (0.2937 => 0.3252, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 10.71% (0.2690 => 0.2978, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.63% (0.4016 => 0.4443, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.62% (0.2655 => 0.2937, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.62% (0.3899 => 0.4313, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 10.62% (0.2628 => 0.2907, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 10.61% (0.3149 => 0.3483, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 10.55% (0.3868 => 0.4276, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 10.52% (0.3107 => 0.3434, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.52% (0.2765 => 0.3056, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.52% (1.9828 => 2.1914, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.52% (0.3756 => 0.4151, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.48% (0.5265 => 0.5817, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 10.48% (0.3453 => 0.3815, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.48% (0.6959 => 0.7688, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 10.45% (0.1062 => 0.1173, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.45% (0.2966 => 0.3276, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 10.43% (0.2761 => 0.3049, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.40% (0.3489 => 0.3852, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 10.40% (0.3192 => 0.3524, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 10.38% (13.8202 => 15.2549, std.dev.: 0.0154) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.26% (1.1364 => 1.2530, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.20% (0.3580 => 0.3945, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 10.17% (0.2988 => 0.3292, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.16% (0.2696 => 0.2970, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.07% (0.4390 => 0.4832, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.96% (0.4791 => 0.5268, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 9.93% (0.3534 => 0.3885, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 9.88% (0.2995 => 0.3291, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.68% (0.1157 => 0.1269, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 9.68% (1.0313 => 1.1311, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.58% (0.1075 => 0.1178, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 9.57% (0.1589 => 0.1741, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.45% (0.5577 => 0.6104, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.43% (0.4379 => 0.4792, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.42% (0.3130 => 0.3425, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.37% (0.8698 => 0.9513, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.26% (0.1986 => 0.2170, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.25% (0.1276 => 0.1394, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.21% (0.2127 => 0.2323, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.20% (0.1435 => 0.1567, std.dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 9.16% (16.6129 => 18.1350, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/objinst: 9.13% (0.2945 => 0.3214, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.09% (0.2914 => 0.3179, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 9.07% (1.1061 => 1.2064, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 9.06% (0.6744 => 0.7355, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 8.99% (0.8310 => 0.9057, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.97% (0.7460 => 0.8129, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.95% (0.3755 => 0.4091, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 8.89% (0.7506 => 0.8173, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 8.88% (0.3220 => 0.3506, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.87% (0.3246 => 0.3534, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.87% (0.5637 => 0.6137, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.77% (0.6576 => 0.7153, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.74% (7.2180 => 7.8488, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/gs/gs: 8.63% (3.8646 => 4.1980, std.dev.: 0.0026) MultiSource/Applications/d/make_dparser: 8.61% (3.1889 => 3.4636, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.54% (0.1569 => 0.1703, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.50% (0.2023 => 0.2195, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 8.45% (1.0594 => 1.1489, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 8.32% (0.1478 => 0.1601, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.31% (0.1865 => 0.2020, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 8.28% (1.9270 => 2.0866, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.17% (0.3511 => 0.3798, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.17% (0.8818 => 0.9538, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 8.16% (1.2749 => 1.3789, std.dev.: 0.0112) MultiSource/Applications/siod/siod: 8.12% (2.1791 => 2.3560, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.03% (3.6692 => 3.9640, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/09-vor/vor: 8.03% (0.2925 => 0.3160, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 8.02% (0.3131 => 0.3382, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.94% (0.1789 => 0.1931, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 7.89% (14.8535 => 16.0253, std.dev.: 0.0119) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.86% (4.4433 => 4.7925, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 7.84% (8.4961 => 9.1624, std.dev.: 0.0165) MultiSource/Applications/oggenc/oggenc: 7.83% (4.6629 => 5.0281, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.81% (1.3245 => 1.4280, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.81% (4.3801 => 4.7223, std.dev.: 0.0098) MultiSource/Benchmarks/McCat/05-eks/eks: 7.71% (0.4113 => 0.4430, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 7.66% (0.1657 => 0.1784, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.66% (0.2140 => 0.2304, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.63% (0.6135 => 0.6603, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 7.34% (0.6250 => 0.6709, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 7.34% (1.2292 => 1.3194, std.dev.: 0.0111) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.18% (0.9108 => 0.9762, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.17% (0.4003 => 0.4290, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.11% (0.2504 => 0.2682, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.08% (0.3914 => 0.4191, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.06% (0.4805 => 0.5144, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 6.99% (0.3646 => 0.3901, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.99% (0.3789 => 0.4054, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 6.99% (0.3578 => 0.3828, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1819 => 0.1946, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.93% (4.9865 => 5.3321, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.90% (1.5188 => 1.6236, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/oourafft: 6.87% (0.2008 => 0.2146, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 6.86% (0.3601 => 0.3848, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.83% (0.3663 => 0.3913, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.82% (3.2742 => 3.4976, std.dev.: 0.0133) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.73% (1.1333 => 1.2096, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 6.73% (0.3940 => 0.4205, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.68% (0.3650 => 0.3894, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 6.62% (0.3623 => 0.3863, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.56% (0.3245 => 0.3458, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 6.44% (6.5754 => 6.9986, std.dev.: 0.0071) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.16% (6.2785 => 6.6655, std.dev.: 0.0046) MultiSource/Applications/lua/lua: 5.97% (3.7467 => 3.9704, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.86% (2.1007 => 2.2238, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.73% (0.2321 => 0.2454, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.44% (13.2842 => 14.0073, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: 3.75% (16.2614 => 16.8706, std.dev.: 0.0089) MultiSource/Applications/ClamAV/clamscan: 3.53% (14.5298 => 15.0420, std.dev.: 0.0155) MultiSource/Benchmarks/Bullet/bullet: 1.20% (33.2944 => 33.6932, std.dev.: 0.0124) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5179, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.06% (1.0895 => 1.3625, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: 24.18% (1.8175 => 2.2570, std.dev.: 0.0195) SingleSource/Benchmarks/Misc/richards_benchmark: 10.99% (1.1560 => 1.2831, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 8.99% (0.8273 => 0.9017, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.62% (3.1736 => 3.4153, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.02% (1.2998 => 1.3780, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0043, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6761, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.47% (1.9199 => 1.9866, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 3.36% (10.7476 => 11.1091, std.dev.: 0.0428) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.15% (7.4271 => 7.5870, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 1.67% (1.4298 => 1.4537, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5135, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2068, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1873, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5782, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 1.10% (12.4560 => 12.5927, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0266, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.15% (0.2670 => 0.1411, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.08% (0.4657 => 0.3908, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -15.56% (0.0707 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.87% (1.3813 => 1.1897, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.81% (1.3819 => 1.1910, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.30% (22.5627 => 21.8179, std.dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.33% (1.0460 => 0.8543, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.74% (0.0997 => 0.0860, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -11.93% (0.2238 => 0.1971, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.47% (1.2308 => 1.0896, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.14% (20.3410 => 18.2780, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2639, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.64% (1.3780 => 1.3003, std.dev.: 0.0106) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5147, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.71% (0.9996 => 0.9525, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.51% (1.7688 => 1.7067, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4867 => 0.4717, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -2.59% (26.5159 => 25.8281, std.dev.: 0.0296) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.41% (3.0263 => 2.9535, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: -2.40% (1.9762 => 1.9288, std.dev.: 0.0019) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.96% (0.6589 => 0.6460, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7158, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: -1.71% (6.3560 => 6.2472, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0069, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8641, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: -1.30% (4.5928 => 4.5330, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4948, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: -1.16% (9.3358 => 9.2277, std.dev.: 0.0054) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2580, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 6 23:25:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 01:25:28 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121007062528.936412A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4660?compare_to=4658&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4660, Order: 165369, Start Time: 2012-10-07 05:03:56, End Time: 2012-10-07 06:27:13 To: 4658, Order: 165367, Start Time: 2012-10-07 03:24:40, End Time: 2012-10-07 04:47:23 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (14 on baseline) Performance Regressions: 9 (94 on baseline) Performance Improvements: 5 (44 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 963 (753 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hexxagon/hexxagon: 1.10% (0.9607 => 0.9713, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 7.97% (21.5753 => 23.2949, std.dev.: 0.4832) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.55% (4.2989 => 4.4514, std.dev.: 0.0151) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.12% (41.5071 => 42.8015, std.dev.: 0.1289) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 2.94% (0.7651 => 0.7876, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.91% (1.3643 => 1.4040, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.78% (22.1596 => 22.5551, std.dev.: 0.1199) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.62% (1.4201 => 1.4431, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.20% (4.5076 => 4.5617, std.dev.: 0.0098) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -6.32% (0.3227 => 0.3023, std.dev.: 0.0078) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.83% (4.5618 => 4.4784, std.dev.: 0.0247) MultiSource/Benchmarks/Bullet/bullet: -1.59% (7.3105 => 7.1940, std.dev.: 0.0426) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.12% (1.2996 => 1.2850, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.07% (5.9303 => 5.8670, std.dev.: 0.0201) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.34% (1.0266 => 1.0231, std.dev.: 0.0084) MultiSource/Applications/sqlite3/sqlite3: -0.83% (0.6246 => 0.6194, std.dev.: 0.0083) MultiSource/Benchmarks/McCat/08-main/main: -2.25% (0.1823 => 0.1782, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.00% (0.1599 => 0.1567, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.94% (0.3230 => 0.3135, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.12% (0.2415 => 0.2388, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.26% (0.3257 => 0.3216, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.02% (0.2355 => 0.2331, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel: -3.24% (0.0463 => 0.0448, std.dev.: 0.0006) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -9.20% (0.0250 => 0.0227, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -2.99% (0.0201 => 0.0195, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -18.05% (0.0399 => 0.0327, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -23.78% (0.0307 => 0.0234, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -5.15% (0.0291 => 0.0276, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 29.64% (0.0253 => 0.0328, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -16.67% (0.0186 => 0.0155, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/test1: -33.50% (0.0197 => 0.0131, std.dev.: 0.0028) SingleSource/UnitTests/Vector/multiplies: -2.32% (0.0259 => 0.0253, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -12.75% (0.0306 => 0.0267, std.dev.: 0.0027) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.35% (0.1429 => 0.1424, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: -0.47% (1.4894 => 1.4824, std.dev.: 0.0460) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -4.36% (0.1561 => 0.1493, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.80% (0.4102 => 0.4176, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.42% (0.1434 => 0.1428, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.66% (0.0607 => 0.0611, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -24.36% (0.0234 => 0.0177, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.58% (0.0611 => 0.0583, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.04% (1.1270 => 1.1266, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 140.00% (0.0005 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.44% (0.0556 => 0.0564, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.93% (0.0254 => 0.0211, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.01% (0.7653 => 0.7652, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.05% (1.7070 => 1.7062, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 141.57% (0.0089 => 0.0215, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: 176.67% (0.0090 => 0.0249, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -27.35% (4.1772 => 3.0346, std.dev.: 0.0343) SingleSource/Benchmarks/Shootout-C++/except: 82083.33% (0.0006 => 0.4931, std.dev.: 0.0068) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -66.67% (0.0006 => 0.0002, std.dev.: 0.0002) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 24.30% (0.0745 => 0.0926, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.09% (0.1159 => 0.1276, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 9.72% (0.5309 => 0.5825, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.28% (0.6410 => 0.7005, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.13% (0.3582 => 0.3909, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 9.03% (2.1763 => 2.3728, std.dev.: 0.0160) MultiSource/Applications/lemon/lemon: 8.12% (1.0046 => 1.0862, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 7.79% (0.6173 => 0.6654, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.37% (0.2552 => 0.2740, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.21% (0.1414 => 0.1516, std.dev.: 0.0031) MultiSource/Applications/SIBsim4/SIBsim4: 7.20% (1.1653 => 1.2492, std.dev.: 0.0089) MultiSource/Applications/kimwitu++/kc: 6.63% (15.3105 => 16.3254, std.dev.: 0.2658) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.48% (1.5150 => 1.6131, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.44% (0.2886 => 0.3072, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 6.36% (0.6915 => 0.7355, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.01% (0.7639 => 0.8098, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.83% (0.6069 => 0.6423, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.41% (0.2106 => 0.2220, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.36% (0.2797 => 0.2947, std.dev.: 0.0017) MultiSource/Applications/d/make_dparser: 5.29% (3.0225 => 3.1824, std.dev.: 0.0248) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.21% (0.3418 => 0.3596, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 5.18% (0.1971 => 0.2073, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.17% (1.1672 => 1.2276, std.dev.: 0.0078) MultiSource/Applications/oggenc/oggenc: 5.14% (4.7455 => 4.9892, std.dev.: 0.0284) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.11% (0.2662 => 0.2798, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.08% (0.4248 => 0.4464, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.06% (0.3062 => 0.3217, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.02% (0.7226 => 0.7589, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.99% (1.1827 => 1.2417, std.dev.: 0.0173) SingleSource/Benchmarks/Shootout-C++/lists: 4.99% (0.2347 => 0.2464, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.77% (0.3901 => 0.4087, std.dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 4.72% (13.3238 => 13.9530, std.dev.: 0.0488) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.2654 => 0.2779, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 4.65% (29.3170 => 30.6805, std.dev.: 0.1051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.47% (6.2546 => 6.5342, std.dev.: 0.0233) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.43% (0.4880 => 0.5096, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.32% (0.8569 => 0.8939, std.dev.: 0.0098) MultiSource/Applications/lua/lua: 4.31% (3.5980 => 3.7531, std.dev.: 0.0285) MultiSource/Applications/hbd/hbd: 4.21% (1.3268 => 1.3826, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.12% (1.2021 => 1.2516, std.dev.: 0.0107) MultiSource/Applications/siod/siod: 4.11% (2.0972 => 2.1834, std.dev.: 0.0211) MultiSource/Benchmarks/mafft/pairlocalalign: 4.07% (8.2186 => 8.5535, std.dev.: 0.0348) MultiSource/Applications/Burg/burg: 4.05% (1.1440 => 1.1903, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.00% (0.2700 => 0.2808, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.91% (0.5937 => 0.6169, std.dev.: 0.0029) MultiSource/Benchmarks/sim/sim: 3.76% (0.3084 => 0.3200, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 3.75% (0.2877 => 0.2985, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: 3.69% (0.3520 => 0.3650, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: 3.64% (0.3847 => 0.3987, std.dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 3.48% (1.0821 => 1.1198, std.dev.: 0.0037) MultiSource/Applications/treecc/treecc: 3.43% (1.8798 => 1.9442, std.dev.: 0.0105) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.36% (4.3380 => 4.4837, std.dev.: 0.0126) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.35% (4.2616 => 4.4045, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.26% (0.5520 => 0.5700, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/football/football: 3.26% (0.8405 => 0.8679, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.25% (0.5963 => 0.6157, std.dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: 3.19% (14.7256 => 15.1951, std.dev.: 0.0618) MultiSource/Benchmarks/MallocBench/gs/gs: 3.11% (3.8796 => 4.0001, std.dev.: 0.0156) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.09% (0.4562 => 0.4703, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.09% (1.3935 => 1.4365, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.07% (12.6413 => 13.0293, std.dev.: 0.0443) MultiSource/Applications/hexxagon/hexxagon: 3.06% (0.9425 => 0.9713, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.00% (4.0318 => 4.1526, std.dev.: 0.0124) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.94% (1.0689 => 1.1003, std.dev.: 0.0077) MultiSource/Applications/JM/ldecod/ldecod: 2.92% (6.4908 => 6.6804, std.dev.: 0.0309) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.83% (8.2559 => 8.4892, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.30% (4.2815 => 4.3799, std.dev.: 0.0335) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.28% (1.2742 => 1.3032, std.dev.: 0.0083) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.44% (1.6538 => 2.3391, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2279, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout/ary3: 14.58% (1.7426 => 1.9967, std.dev.: 0.0520) SingleSource/Benchmarks/Stanford/Puzzle: 13.61% (0.1433 => 0.1628, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.58% (4.0101 => 4.5548, std.dev.: 0.0462) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.40% (2.4042 => 2.7264, std.dev.: 0.0183) SingleSource/Benchmarks/McGill/queens: 11.10% (1.6261 => 1.8066, std.dev.: 0.0167) MultiSource/Benchmarks/nbench/nbench: 10.03% (21.1721 => 23.2949, std.dev.: 0.4832) MultiSource/Benchmarks/FreeBench/mason/mason: 9.37% (0.5004 => 0.5473, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/lists: 8.72% (7.0025 => 7.6131, std.dev.: 0.0382) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.65% (0.2857 => 0.3104, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.63% (1.0063 => 1.0931, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.74% (40.4792 => 42.8015, std.dev.: 0.1289) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.66% (4.2129 => 4.4514, std.dev.: 0.0151) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.18% (0.3301 => 0.3472, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: 4.77% (15.2242 => 15.9505, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/dt: 4.56% (0.9851 => 1.0300, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5413, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 3.64% (3.5520 => 3.6812, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.51% (0.7609 => 0.7876, std.dev.: 0.0039) MultiSource/Benchmarks/Bullet/bullet: 3.18% (6.9722 => 7.1940, std.dev.: 0.0426) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.01% (0.5587 => 0.5755, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.79% (6.6312 => 6.8159, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.60% (0.5876 => 0.6029, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.82% (4.6127 => 4.6967, std.dev.: 0.0113) MultiSource/Benchmarks/Olden/power/power: 1.52% (1.4184 => 1.4399, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -43.99% (0.0591 => 0.0331, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -43.29% (0.2996 => 0.1699, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.28% (1.4189 => 1.1453, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.25% (1.4113 => 1.1538, std.dev.: 0.0093) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.21% (0.3497 => 0.2126, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.43% (5.2665 => 4.0852, std.dev.: 0.1104) SingleSource/Benchmarks/Shootout-C++/ary3: -20.75% (1.7473 => 1.3847, std.dev.: 0.0715) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.25% (1.7361 => 1.4714, std.dev.: 0.0239) MultiSource/Benchmarks/McCat/17-bintr/bintr: -13.96% (0.0917 => 0.0789, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1584, std.dev.: 0.0242) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.63% (1.1647 => 1.0525, std.dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.75% (1.4034 => 1.2806, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.45% (3.2007 => 2.9303, std.dev.: 0.0368) SingleSource/Benchmarks/Misc/flops: -8.36% (9.5474 => 8.7489, std.dev.: 0.0249) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.76% (3.6254 => 3.3803, std.dev.: 0.0263) MultiSource/Applications/lambda-0_1_3/lambda: -6.63% (7.6833 => 7.1737, std.dev.: 0.0263) MultiSource/Applications/sgefa/sgefa: -6.57% (0.3746 => 0.3500, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/fibo: -6.56% (4.6355 => 4.3313, std.dev.: 0.0127) SingleSource/Benchmarks/Misc/richards_benchmark: -6.18% (1.4441 => 1.3549, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.98% (2.9728 => 2.7950, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.46% (3.9413 => 3.7261, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout/fib2: -5.27% (4.4195 => 4.1866, std.dev.: 0.0211) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.84% (0.4564 => 0.4343, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -4.81% (2.5166 => 2.3956, std.dev.: 0.0084) MultiSource/Benchmarks/FreeBench/distray/distray: -4.69% (0.2664 => 0.2539, std.dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: -4.22% (62.4126 => 59.7777, std.dev.: 0.0227) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.54% (1.2722 => 1.2272, std.dev.: 0.0174) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.32% (61.1734 => 59.1441, std.dev.: 0.7850) SingleSource/Benchmarks/Shootout-C++/methcall: -3.19% (9.2503 => 8.9554, std.dev.: 0.0136) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.58% (1.1683 => 1.1382, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.42% (2.4457 => 2.3865, std.dev.: 0.0224) SingleSource/Benchmarks/Dhrystone/dry: -2.22% (2.4013 => 2.3480, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -2.14% (1.0926 => 1.0692, std.dev.: 0.0029) MultiSource/Applications/SIBsim4/SIBsim4: -2.14% (3.4230 => 3.3498, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.13% (3.7496 => 3.6697, std.dev.: 0.0225) MultiSource/Applications/aha/aha: -1.95% (3.4286 => 3.3616, std.dev.: 0.0094) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.89% (2.3569 => 2.3123, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: -1.77% (3.8907 => 3.8218, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/hash2: -1.69% (3.4876 => 3.4285, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.67% (1.0686 => 1.0508, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -1.58% (92.7467 => 91.2773, std.dev.: 0.1800) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3087, std.dev.: 0.0531) SingleSource/Benchmarks/Dhrystone/fldry: -1.34% (2.4971 => 2.4636, std.dev.: 0.0051) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.27% (27.1724 => 26.8261, std.dev.: 0.0697) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.52% (0.9980 => 1.0231, std.dev.: 0.0084) MultiSource/Applications/sqlite3/sqlite3: 2.86% (0.6022 => 0.6194, std.dev.: 0.0083) MultiSource/Benchmarks/McCat/08-main/main: 6.96% (0.1666 => 0.1782, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.84% (0.1554 => 0.1567, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.69% (0.3083 => 0.3135, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.25% (0.2394 => 0.2388, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.29% (0.3175 => 0.3216, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.26% (0.2302 => 0.2331, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel: -0.22% (0.0449 => 0.0448, std.dev.: 0.0006) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -5.42% (0.0240 => 0.0227, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.56% (0.0192 => 0.0195, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -16.15% (0.0390 => 0.0327, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -22.26% (0.0301 => 0.0234, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.82% (0.0284 => 0.0276, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.23% (0.0324 => 0.0328, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -12.43% (0.0177 => 0.0155, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/test1: -30.69% (0.0189 => 0.0131, std.dev.: 0.0028) SingleSource/UnitTests/Vector/multiplies: 1.61% (0.0249 => 0.0253, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -17.85% (0.0325 => 0.0267, std.dev.: 0.0027) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.35% (0.1429 => 0.1424, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: -1.30% (1.5019 => 1.4824, std.dev.: 0.0460) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.53% (0.1501 => 0.1493, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.06% (0.4264 => 0.4176, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.25% (0.1344 => 0.1428, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.74% (0.0589 => 0.0611, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -23.71% (0.0232 => 0.0177, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.76% (0.0639 => 0.0583, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.74% (1.1350 => 1.1266, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.46% (0.0637 => 0.0564, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.23% (0.0246 => 0.0211, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.47% (0.7541 => 0.7652, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.06% (1.5363 => 1.7062, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 2.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 6 23:28:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 01:28:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121007062831.846A62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4661?compare_to=4657&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4661, Order: 165368, Start Time: 2012-10-07 05:11:13, End Time: 2012-10-07 06:30:17 To: 4657, Order: 165367, Start Time: 2012-10-07 03:22:51, End Time: 2012-10-07 04:42:15 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (153 on baseline) Performance Improvements: 2 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1023 (763 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -15.37% (0.4703 => 0.3980, std.dev.: 0.0144) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.39% (56.6579 => 54.7370, std.dev.: 0.5755) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.5876 => 0.5876, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: -0.03% (16.1913 => 16.1864, std.dev.: 0.0228) MultiSource/Benchmarks/Bullet/bullet: 0.00% (54.8528 => 54.8554, std.dev.: 0.0172) MultiSource/Benchmarks/MallocBench/gs/gs: -0.02% (4.3870 => 4.3861, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.14% (1.2446 => 1.2463, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.09% (7.7581 => 7.7649, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.04% (0.7399 => 0.7402, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.55% (0.0361 => 0.0363, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.28% (0.2145 => 0.2139, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -13.26% (63.2438 => 54.8554, std.dev.: 0.0172) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.50% (14.1553 => 18.7560, std.dev.: 0.0114) SingleSource/Benchmarks/Misc-C++-EH/spirit: 61.11% (3.4629 => 5.5792, std.dev.: 0.0202) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14225.97% (0.0720 => 10.3147, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952000.00% (0.0001 => 9.9521, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 49.33% (0.2554 => 0.3814, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 46.95% (10.3673 => 15.2344, std.dev.: 0.0158) SingleSource/Benchmarks/Misc/richards_benchmark: 30.64% (0.1622 => 0.2119, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 30.59% (0.1056 => 0.1379, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.36% (7.0540 => 8.1374, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/flops: 15.08% (0.1432 => 0.1648, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.00% (2.2022 => 2.5325, std.dev.: 0.0048) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.37% (0.1566 => 0.1791, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.59% (1.7609 => 1.9826, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.17% (0.0871 => 0.0977, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 11.30% (0.3282 => 0.3653, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.09% (0.3473 => 0.3858, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.98% (0.3543 => 0.3932, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-2: 10.92% (0.3497 => 0.3879, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.92% (0.3543 => 0.3930, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.86% (0.1584 => 0.1756, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 10.84% (0.3516 => 0.3897, std.dev.: 0.0080) SingleSource/UnitTests/ObjC/synchronized: 10.81% (0.3561 => 0.3946, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.61% (0.3694 => 0.4086, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.50% (0.3828 => 0.4230, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.47% (0.3927 => 0.4338, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.34% (0.3886 => 0.4288, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 9.79% (0.1440 => 0.1581, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 9.55% (0.1655 => 0.1813, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 9.17% (10.4361 => 11.3927, std.dev.: 0.0091) MultiSource/Applications/lambda-0_1_3/lambda: 9.11% (0.7433 => 0.8110, std.dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.08% (0.6675 => 0.7281, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 9.05% (0.7115 => 0.7759, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.04% (0.1438 => 0.1568, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.04% (0.4879 => 0.5320, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 8.91% (9.4845 => 10.3296, std.dev.: 0.0073) MultiSource/Applications/sgefa/sgefa: 8.85% (0.3109 => 0.3384, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.84% (0.3177 => 0.3458, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.69% (0.5925 => 0.6440, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.65% (1.5415 => 1.6748, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.55% (0.1625 => 0.1764, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: 8.54% (0.6030 => 0.6545, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.52% (0.4615 => 0.5008, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 8.38% (0.1695 => 0.1837, std.dev.: 0.0034) MultiSource/Applications/oggenc/oggenc: 8.31% (5.7591 => 6.2377, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.28% (0.8172 => 0.8849, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 8.27% (0.3422 => 0.3705) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.27% (0.5105 => 0.5527, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 8.21% (3.3354 => 3.6093, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/18-imp/imp: 8.21% (0.3423 => 0.3704, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.20% (1.3050 => 1.4120, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.11% (0.5860 => 0.6335, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.10% (0.2271 => 0.2455, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.09% (0.2065 => 0.2232, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.03% (4.2646 => 4.6069, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.01% (0.1510 => 0.1631, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.00% (0.2700 => 0.2916, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 7.92% (0.7326 => 0.7906, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 7.90% (0.6456 => 0.6966, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.86% (0.4289 => 0.4626, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.79% (0.5569 => 0.6003, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.79% (0.3121 => 0.3364, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.78% (0.2107 => 0.2271, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.72% (0.2758 => 0.2971, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.72% (8.1363 => 8.7643, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/strcat: 7.70% (0.2831 => 0.3049, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.68% (0.3307 => 0.3561, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.67% (5.0018 => 5.3852, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.64% (4.9449 => 5.3229, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.63% (0.3865 => 0.4160, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.62% (0.9765 => 1.0509, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.61% (0.4203 => 0.4523, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 7.59% (0.7835 => 0.8430, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.58% (0.4103 => 0.4414, std.dev.: 0.0023) SingleSource/Regression/C++/ofstream_ctor: 7.57% (0.2905 => 0.3125, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.55% (0.4636 => 0.4986, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.49% (0.3136 => 0.3371, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.47% (0.2891 => 0.3107, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.44% (0.8067 => 0.8667, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.42% (0.1940 => 0.2084, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 7.41% (0.3387 => 0.3638, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.41% (0.5020 => 0.5392, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 7.38% (1.1642 => 1.2501, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.37% (0.3650 => 0.3919, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 7.33% (0.1555 => 0.1669, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 7.31% (3.8723 => 4.1555, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: 7.30% (0.2725 => 0.2924, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 7.29% (0.4048 => 0.4343, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.28% (0.2872 => 0.3081, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.25% (0.4620 => 0.4955, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 7.25% (0.3283 => 0.3521, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.20% (7.9617 => 8.5350, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/lists1: 7.19% (0.3684 => 0.3949, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 7.19% (0.3603 => 0.3862, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.16% (1.5603 => 1.6720, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 7.15% (0.3232 => 0.3463, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 7.13% (0.3098 => 0.3319, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.09% (2.0665 => 2.2130, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/wc: 7.01% (0.3052 => 0.3266, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.00% (0.3826 => 0.4094, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.00% (0.2756 => 0.2949, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.99% (0.3162 => 0.3383, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 6.93% (0.2871 => 0.3070, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.91% (0.2793 => 0.2986, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 6.86% (1.0722 => 1.1458, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.77% (0.3441 => 0.3674, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 6.75% (2.0273 => 2.1642, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/random: 6.71% (0.2802 => 0.2990, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.71% (0.2877 => 0.3070, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.71% (0.2714 => 0.2896, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 6.60% (0.3180 => 0.3390, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.59% (1.1861 => 1.2643, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.53% (0.2603 => 0.2773, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 6.48% (0.3379 => 0.3598, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.39% (1.5859 => 1.6873, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.33% (0.6450 => 0.6858, std.dev.: 0.0107) MultiSource/Applications/siod/siod: 6.22% (2.2969 => 2.4398, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/football/football: 6.19% (0.8921 => 0.9473, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.19% (0.5981 => 0.6351, std.dev.: 0.0035) MultiSource/Applications/JM/lencod/lencod: 6.10% (21.9371 => 23.2757, std.dev.: 0.0204) MultiSource/Benchmarks/McCat/05-eks/eks: 6.02% (0.4299 => 0.4558, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.88% (0.4064 => 0.4303, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.73% (2.2024 => 2.3287, std.dev.: 0.0165) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.51% (0.1906 => 0.2011, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.39% (1.4186 => 1.4950, std.dev.: 0.0038) MultiSource/Benchmarks/nbench/nbench: 5.24% (1.1840 => 1.2461, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.99% (0.2266 => 0.2379, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.95% (0.3131 => 0.3286, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.91% (1.2842 => 1.3472, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.41% (0.8101 => 0.8458, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.71% (14.3668 => 14.8998, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.44% (0.3427 => 0.3545, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 3.29% (17.1811 => 17.7459, std.dev.: 0.0232) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.27% (0.3817 => 0.3942, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.86% (3.8922 => 4.0036, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.55% (1.1194 => 1.1480, std.dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.92% (1.1396 => 1.2526, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0021) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4499, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3689, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.52% (3.6395 => 3.7675, std.dev.: 0.0034) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.78% (4.2280 => 4.3456, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.55% (0.8275 => 0.8403, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.49% (0.9540 => 0.9682, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8136, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.15% (2.6546 => 2.6851, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.05% (6.5088 => 6.5771, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1289, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.01% (0.8651 => 0.1729, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.28% (5.2763 => 3.2563, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.56% (5.3855 => 3.6318, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.16% (5.3526 => 3.6313, std.dev.: 0.0058) SingleSource/UnitTests/Vector/constpool: -14.59% (54.1659 => 46.2628, std.dev.: 0.0364) MultiSource/Benchmarks/FreeBench/mason/mason: -13.32% (0.0811 => 0.0703) MultiSource/Applications/ClamAV/clamscan: -11.13% (22.1758 => 19.7068, std.dev.: 0.0146) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.94% (2.9384 => 2.6170, std.dev.: 0.0169) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.44% (1.1492 => 0.7649, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: -15.90% (1.6925 => 1.4234, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.03% (0.0998 => 0.0858, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -11.32% (1.2373 => 1.0972, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/mandel-2: -10.31% (1.5373 => 1.3788, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -10.04% (0.2161 => 0.1944, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.19% (19.9488 => 18.3144, std.dev.: 0.1098) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.73% (1.8329 => 1.7096, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.30% (1.6805 => 1.5914, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.52% (1.5835 => 1.5120, std.dev.: 0.0008) MultiSource/Applications/siod/siod: -3.75% (3.2827 => 3.1596, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.39% (0.9957 => 0.9619, std.dev.: 0.0044) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.15% (32.5116 => 31.4872, std.dev.: 0.0107) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0987, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.45% (0.4808 => 0.4690, std.dev.: 0.0013) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.98% (8.6802 => 8.5083, std.dev.: 0.0126) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.94% (8.1563 => 7.9977, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/salsa20: -1.80% (10.2830 => 10.0978, std.dev.: 0.0184) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6810, std.dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5117, std.dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4222, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/lists: -1.10% (6.2999 => 6.2303, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8567, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.37% (0.5229 => 0.5876, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 7.98% (14.9895 => 16.1864, std.dev.: 0.0228) MultiSource/Benchmarks/MallocBench/gs/gs: 6.70% (4.1105 => 4.3861, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.81% (1.1048 => 1.2463, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.48% (7.1582 => 7.7649, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.96% (0.6222 => 0.7402, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36200.00% (0.0001 => 0.0363, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.09% (0.2116 => 0.2139, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 7 00:32:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 02:32:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121007073234.F04612A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/4662?compare_to=4655&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4662, Order: 165368, Start Time: 2012-10-07 04:47:35, End Time: 2012-10-07 07:34:20 To: 4655, Order: 165366, Start Time: 2012-10-07 01:34:46, End Time: 2012-10-07 04:18:31 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (131 on baseline) Performance Improvements: 1 (15 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 1039 (834 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.37% (125.6650 => 131.1548, std.dev.: 1.0093) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.32% (54.1037 => 54.8200, std.dev.: 0.1286) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.90% (2.1164 => 2.0761, std.dev.: 0.0123) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 11.16% (1.5932 => 1.7710, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-4: 11.02% (0.3465 => 0.3847, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.91% (0.3446 => 0.3822, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.89% (0.3442 => 0.3817, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.87% (0.3488 => 0.3867, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: 10.84% (0.3496 => 0.3875, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.81% (0.3460 => 0.3834, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.75% (0.3469 => 0.3842, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.63% (0.1063 => 0.1176, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.54% (0.3643 => 0.4027, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.47% (0.3650 => 0.4032, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.37% (0.3724 => 0.4110, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.44% (0.5826 => 0.6318, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.37% (0.5889 => 0.6382, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.15% (0.1620 => 0.1752, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.91% (0.1619 => 0.1747, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.85% (0.2738 => 0.2953, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 7.76% (0.3004 => 0.3237, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.71% (0.4994 => 0.5379, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.57% (1.3152 => 1.4148, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.56% (0.5000 => 0.5378, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.55% (0.2875 => 0.3092, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.41% (0.4361 => 0.4684, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 7.34% (0.9909 => 1.0636, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.26% (0.3195 => 0.3427, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 7.22% (0.2714 => 0.2910, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 7.21% (0.2566 => 0.2751, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.20% (0.3625 => 0.3886, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/objinst: 7.19% (0.2823 => 0.3026, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 7.17% (0.7171 => 0.7685, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.15% (0.2729 => 0.2924, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 7.15% (0.2813 => 0.3014, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.14% (0.2803 => 0.3003, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.13% (0.2792 => 0.2991, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/except: 7.11% (0.2811 => 0.3011, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.09% (1.6211 => 1.7361, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/matrix: 7.09% (0.2780 => 0.2977, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.08% (0.2725 => 0.2918, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.08% (2.0673 => 2.2136, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.04% (0.5026 => 0.5380, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 7.01% (5.5417 => 5.9304, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.01% (0.2911 => 0.3115, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.98% (0.2750 => 0.2942, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.94% (3.5627 => 3.8100, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/wc: 6.91% (0.3096 => 0.3310, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.90% (0.3362 => 0.3594, std.dev.: 0.0054) MultiSource/Applications/d/make_dparser: 6.86% (1.0781 => 1.1521, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.86% (0.3060 => 0.3270, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 6.74% (0.3678 => 0.3926, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.73% (0.5900 => 0.6297, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 6.73% (0.4847 => 0.5173, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.70% (0.3267 => 0.3486, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.65% (0.2736 => 0.2918, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists1: 6.64% (0.3477 => 0.3708, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.63% (0.3258 => 0.3474, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.62% (2.7292 => 2.9100, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.60% (0.2014 => 0.2147, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.60% (0.3317 => 0.3536, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 6.60% (0.3348 => 0.3569, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 6.58% (0.3726 => 0.3971, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.55% (0.3282 => 0.3497, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.53% (0.3124 => 0.3328, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.53% (0.2068 => 0.2203, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 6.45% (0.6634 => 0.7062, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.41% (4.4195 => 4.7029, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.39% (0.3930 => 0.4181, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.39% (0.2866 => 0.3049, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.38% (0.4139 => 0.4403, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: 6.30% (23.5202 => 25.0011, std.dev.: 0.0313) SingleSource/Benchmarks/Shootout-C++/hash: 6.30% (0.4146 => 0.4407, std.dev.: 0.0057) MultiSource/Applications/ClamAV/clamscan: 6.29% (4.2109 => 4.4756, std.dev.: 0.0109) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.24% (0.3845 => 0.4085, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 6.16% (0.4251 => 0.4513, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 6.15% (1.8794 => 1.9950, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.10% (0.3903 => 0.4141, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.07% (0.3690 => 0.3914, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.04% (0.3890 => 0.4125, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.00% (0.3981 => 0.4220, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 5.88% (0.4029 => 0.4266, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.87% (0.3084 => 0.3265, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 5.80% (1.4269 => 1.5097, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.80% (0.6435 => 0.6808, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.76% (0.2969 => 0.3140, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.74% (0.2737 => 0.2894, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 5.67% (4.6177 => 4.8796, std.dev.: 0.0075) MultiSource/Benchmarks/mafft/pairlocalalign: 5.63% (2.1013 => 2.2195, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.58% (0.4658 => 0.4918, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.54% (0.2040 => 0.2153, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 5.54% (0.5546 => 0.5853, std.dev.: 0.0056) MultiSource/Applications/JM/ldecod/ldecod: 5.49% (2.1653 => 2.2841, std.dev.: 0.0029) MultiSource/Applications/SIBsim4/SIBsim4: 5.43% (0.2691 => 0.2837, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 5.41% (2.0346 => 2.1447, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 5.41% (0.5012 => 0.5283, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.35% (0.3271 => 0.3446, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 5.16% (0.3336 => 0.3508, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.09% (0.2103 => 0.2210, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 5.07% (0.9697 => 1.0189, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 5.01% (0.2075 => 0.2179, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.91% (1.9694 => 2.0661, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.88% (1.9966 => 2.0941, std.dev.: 0.0022) MultiSource/Applications/treecc/treecc: 4.81% (0.7875 => 0.8254, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 4.73% (0.2391 => 0.2504, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.27% (0.7426 => 0.7743, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.22% (0.5361 => 0.5587, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (0.5584 => 0.5805, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.74% (11.6398 => 12.0754, std.dev.: 0.0168) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.60% (4.6926 => 4.8616, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 3.46% (0.3498 => 0.3619, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.08% (0.4253 => 0.4384, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 2.46% (11.9555 => 12.2492, std.dev.: 0.0136) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6109, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6770, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-2: 4.71% (1.8057 => 1.8908, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary: 4.71% (0.2122 => 0.2222, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1667, std.dev.: 0.1078) SingleSource/Benchmarks/Dhrystone/dry: 4.26% (14.0481 => 14.6465, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1945, std.dev.: 0.0081) MultiSource/Applications/viterbi/viterbi: 1.90% (46.6247 => 47.5089, std.dev.: 0.0029) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.64% (3.1722 => 3.2243, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2868, std.dev.: 0.0022) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.39% (1.0142 => 1.0283, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5130, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5773, std.dev.: 0.0053) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.87% (25.4195 => 16.5556, std.dev.: 0.0208) SingleSource/Benchmarks/Shootout-C++/ary2: -7.87% (0.2402 => 0.2213, std.dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9775, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7998, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9587, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8006, std.dev.: 0.0109) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7735, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.81% (17.2379 => 16.7528, std.dev.: 0.0742) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8688, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5793, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4949, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0442, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 7 01:00:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 03:00:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121007080025.007932A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/4663?compare_to=4659&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4663, Order: 165371, Start Time: 2012-10-07 06:44:43, End Time: 2012-10-07 08:02:09 To: 4659, Order: 165368, Start Time: 2012-10-07 05:01:22, End Time: 2012-10-07 06:15:47 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (158 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1042 (782 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.95% (2.0176 => 2.4604, std.dev.: 0.0068) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.45% (0.1410 => 0.1656, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops: 15.62% (0.0826 => 0.0955, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 14.44% (0.2243 => 0.2567, std.dev.: 0.0084) MultiSource/Applications/hbd/hbd: 12.73% (1.3693 => 1.5436, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.71% (0.0834 => 0.0940, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.58% (0.0819 => 0.0922, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash: 12.11% (0.4062 => 0.4554, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/hash2: 11.92% (0.4328 => 0.4844, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.89% (0.1413 => 0.1581, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.76% (0.2721 => 0.3041, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.63% (0.2596 => 0.2898, std.dev.: 0.0066) SingleSource/UnitTests/ObjC++/property-reference-object: 11.62% (0.5818 => 0.6494, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 11.41% (0.5748 => 0.6404, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.33% (3.9660 => 4.4154, std.dev.: 0.1194) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.19% (0.1072 => 0.1192, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.15% (0.1588 => 0.1765) MultiSource/Applications/lambda-0_1_3/lambda: 11.14% (0.7038 => 0.7822, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 11.11% (0.2781 => 0.3090, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.04% (0.2782 => 0.3089, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.02% (1.4563 => 1.6168, std.dev.: 0.0425) SingleSource/UnitTests/ObjC++/property-reference: 10.98% (0.7061 => 0.7836, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.92% (1.2193 => 1.3525, std.dev.: 0.0394) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.81% (0.9199 => 1.0193, std.dev.: 0.0305) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.78% (0.6283 => 0.6960, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 10.73% (0.1062 => 0.1176, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.73% (0.5265 => 0.5830, std.dev.: 0.0192) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.70% (0.3485 => 0.3858, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.60% (0.6959 => 0.7697, std.dev.: 0.0225) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.49% (0.3022 => 0.3339, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.48% (0.4016 => 0.4437, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 10.47% (0.2607 => 0.2880, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 10.45% (0.2726 => 0.3011, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 10.45% (0.3293 => 0.3637, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 10.43% (0.2760 => 0.3048, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 10.42% (0.3149 => 0.3477, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.41% (0.3899 => 0.4305, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/random: 10.41% (0.2690 => 0.2970, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 10.36% (0.3107 => 0.3429, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.36% (0.2655 => 0.2930, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.36% (0.3756 => 0.4145, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/fibo: 10.35% (0.2628 => 0.2900, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 10.32% (0.2937 => 0.3240, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 10.32% (0.3868 => 0.4267, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.29% (1.1364 => 1.2533, std.dev.: 0.0362) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.27% (0.2765 => 0.3049, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 10.22% (13.8202 => 15.2322, std.dev.: 0.0188) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.18% (1.9828 => 2.1847, std.dev.: 0.0707) SingleSource/Benchmarks/Shootout-C++/sieve: 10.14% (0.3453 => 0.3803, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.12% (0.3489 => 0.3842, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/methcall: 10.07% (0.2761 => 0.3039, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.05% (0.2966 => 0.3264, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/ary2: 10.03% (0.3192 => 0.3512, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.00% (0.3580 => 0.3938, std.dev.: 0.0096) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.98% (0.4390 => 0.4828, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 9.91% (0.2988 => 0.3284, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.90% (0.2696 => 0.2963, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.90% (0.5577 => 0.6129, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/lists1: 9.79% (0.3534 => 0.3880, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.68% (0.1157 => 0.1269, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 9.65% (0.2995 => 0.3284, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 9.62% (1.0313 => 1.1305, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.56% (0.4791 => 0.5249, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.54% (0.2127 => 0.2330, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/chomp: 9.38% (0.1589 => 0.1738, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.36% (0.3130 => 0.3423, std.dev.: 0.0092) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.32% (0.7460 => 0.8155, std.dev.: 0.0249) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.27% (0.4379 => 0.4785, std.dev.: 0.0155) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.27% (0.1435 => 0.1568, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/objinst: 9.13% (0.2945 => 0.3214, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.09% (0.1276 => 0.1392, std.dev.: 0.0042) MultiSource/Applications/kimwitu++/kc: 9.04% (16.6129 => 18.1142, std.dev.: 0.2971) MultiSource/Applications/Burg/burg: 9.03% (1.1061 => 1.2060, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.00% (0.8698 => 0.9481, std.dev.: 0.0066) MultiSource/Applications/minisat/minisat: 9.00% (0.6744 => 0.7351, std.dev.: 0.0201) MultiSource/Benchmarks/Prolangs-C/football/football: 8.97% (0.8310 => 0.9055, std.dev.: 0.0202) MultiSource/Benchmarks/McCat/18-imp/imp: 8.82% (0.3220 => 0.3504, std.dev.: 0.0078) MultiSource/Applications/spiff/spiff: 8.73% (0.7506 => 0.8161, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.68% (0.3755 => 0.4081, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.59% (7.2180 => 7.8380, std.dev.: 0.1852) MultiSource/Applications/d/make_dparser: 8.50% (3.1889 => 3.4601, std.dev.: 0.0025) MultiSource/Applications/treecc/treecc: 8.41% (1.9270 => 2.0890, std.dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 8.25% (1.0594 => 1.1468, std.dev.: 0.0315) MultiSource/Applications/SIBsim4/SIBsim4: 8.24% (1.2749 => 1.3799, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.22% (0.8818 => 0.9543, std.dev.: 0.0173) MultiSource/Applications/viterbi/viterbi: 8.12% (0.1478 => 0.1598, std.dev.: 0.0018) MultiSource/Benchmarks/sim/sim: 8.11% (0.3131 => 0.3385, std.dev.: 0.0075) MultiSource/Applications/siod/siod: 8.10% (2.1791 => 2.3557, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.08% (0.6135 => 0.6631, std.dev.: 0.0162) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.04% (3.6692 => 3.9643, std.dev.: 0.1053) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.00% (0.3511 => 0.3792, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.94% (0.6576 => 0.7098, std.dev.: 0.0152) MultiSource/Applications/JM/lencod/lencod: 7.83% (14.8535 => 16.0166, std.dev.: 0.0184) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.78% (0.1569 => 0.1691, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.73% (4.3801 => 4.7187, std.dev.: 0.1186) MultiSource/Applications/oggenc/oggenc: 7.71% (4.6629 => 5.0225, std.dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: 7.70% (8.4961 => 9.1501, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.68% (4.4433 => 4.7847, std.dev.: 0.1163) MultiSource/Benchmarks/McCat/05-eks/eks: 7.42% (0.4113 => 0.4418, std.dev.: 0.0118) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.15% (0.9108 => 0.9759, std.dev.: 0.0234) MultiSource/Applications/hexxagon/hexxagon: 7.12% (1.2292 => 1.3167, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: 7.04% (0.6250 => 0.6690, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.95% (0.2504 => 0.2678, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.88% (4.9865 => 5.3295, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.72% (1.1333 => 1.2095, std.dev.: 0.0275) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.71% (1.5188 => 1.6207, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.70% (0.4805 => 0.5127, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.69% (3.2742 => 3.4933, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/parameter-passing: 6.52% (0.4003 => 0.4264, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.47% (0.3245 => 0.3455, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 6.46% (0.3578 => 0.3809, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 6.42% (0.2008 => 0.2137, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 6.41% (0.3789 => 0.4032, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.41% (0.3914 => 0.4165, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 6.36% (6.5754 => 6.9938, std.dev.: 0.0103) SingleSource/UnitTests/ObjC/exceptions-4: 6.28% (0.3646 => 0.3875, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.22% (0.3663 => 0.3891, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.22% (0.3601 => 0.3825, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.22% (0.3650 => 0.3877, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 6.17% (0.3940 => 0.4183, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.13% (0.3623 => 0.3845, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.62% (2.1007 => 2.2187, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 3.66% (16.2614 => 16.8570, std.dev.: 0.0142) MultiSource/Applications/ClamAV/clamscan: 3.39% (14.5298 => 15.0228, std.dev.: 0.0083) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5188, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/fbench: 24.51% (1.8175 => 2.2630, std.dev.: 0.0446) SingleSource/Benchmarks/Misc/richards_benchmark: 11.02% (1.1560 => 1.2834, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 8.99% (0.8273 => 0.9017, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.70% (0.1322 => 0.1437, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4144, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.11% (1.2998 => 1.3792, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0051, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.72% (11.2619 => 11.6814, std.dev.: 0.0272) SingleSource/Benchmarks/Misc/flops-6: 3.35% (1.9199 => 1.9842, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 3.23% (10.7476 => 11.0945, std.dev.: 0.0104) SingleSource/Regression/C/uint64_to_float: 2.97% (0.5449 => 0.5611, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.14% (7.4271 => 7.5861, std.dev.: 0.0088) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4530, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5146, std.dev.: 0.0313) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2123, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops: 1.25% (9.0760 => 9.1892, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.16% (5.5130 => 5.5769, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0270, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 1.03% (12.4560 => 12.5847, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.97% (0.2670 => 0.1416, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.60% (0.4657 => 0.3884, std.dev.: 0.0073) MultiSource/Benchmarks/FreeBench/mason/mason: -15.56% (0.0707 => 0.0597, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.03% (1.3819 => 1.1880, std.dev.: 0.0335) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.97% (1.3813 => 1.1884, std.dev.: 0.0341) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.51% (22.5627 => 21.7713, std.dev.: 0.0239) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0184) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.74% (0.0997 => 0.0860, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -11.93% (0.2238 => 0.1971, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: -10.88% (1.2308 => 1.0969, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.11% (20.3410 => 18.2851, std.dev.: 0.0268) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.55% (1.3780 => 1.2877, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.06% (2.6470 => 2.5131, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.61% (0.9996 => 0.9535, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8004, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -3.54% (3.2729 => 3.1572, std.dev.: 0.0054) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -2.43% (3.0263 => 2.9529, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7149, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.73% (6.3560 => 6.2458, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.59% (0.6615 => 0.6510, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0075, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8684, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: -1.25% (4.5928 => 4.5356, std.dev.: 0.0055) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4944, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2571, std.dev.: 0.0015) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 7 01:04:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 03:04:23 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121007080423.710822A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4664?compare_to=4660&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4664, Order: 165371, Start Time: 2012-10-07 06:43:03, End Time: 2012-10-07 08:06:06 To: 4660, Order: 165369, Start Time: 2012-10-07 05:03:56, End Time: 2012-10-07 06:27:13 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (14 on baseline) Performance Regressions: 11 (95 on baseline) Performance Improvements: 3 (44 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 963 (752 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.41% (0.7242 => 0.8068, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.08% (0.5639 => 0.5869, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.16% (0.9013 => 0.9208, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.11% (0.9663 => 0.9867, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.16% (0.8632 => 0.8732, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/17-bintr/bintr: 12.80% (0.0789 => 0.0890, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 7.01% (6.2704 => 6.7098, std.dev.: 0.1589) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.10% (0.7876 => 0.8199, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.35% (2.6901 => 2.7532, std.dev.: 0.0160) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.55% (1.6033 => 1.6281, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.37% (42.8015 => 43.3886, std.dev.: 0.0138) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.32% (4.4837 => 4.4244, std.dev.: 0.0134) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -6.80% (23.2949 => 21.7111, std.dev.: 0.3699) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.10% (1.4040 => 1.3464, std.dev.: 0.0154) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.36% (1.0231 => 1.0194, std.dev.: 0.0138) MultiSource/Applications/sqlite3/sqlite3: 0.52% (0.6194 => 0.6226, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: 2.75% (0.1782 => 0.1831, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.47% (0.1567 => 0.1590, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.51% (0.3135 => 0.3151, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.05% (0.2388 => 0.2363, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.90% (0.3216 => 0.3187, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.43% (0.2331 => 0.2341, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: 2.90% (0.0448 => 0.0461, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.49% (0.0227 => 0.0244, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.03% (0.0195 => 0.0197, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 19.88% (0.0327 => 0.0392, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.34% (0.0234 => 0.0305, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.71% (0.0276 => 0.0289, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -14.02% (0.0328 => 0.0282, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/casts: 19.35% (0.0155 => 0.0185, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -3.82% (0.0131 => 0.0126, std.dev.: 0.0036) SingleSource/UnitTests/Vector/multiplies: -0.40% (0.0253 => 0.0252, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: 22.47% (0.0267 => 0.0327, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 120.00% (0.0005 => 0.0011) MultiSource/Applications/ClamAV/clamscan: 0.77% (0.1424 => 0.1435, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -1.81% (1.4824 => 1.4556, std.dev.: 0.0702) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -2.41% (0.1493 => 0.1457, std.dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.08% (0.4176 => 0.4089, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.10% (0.1428 => 0.1458, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.44% (0.0611 => 0.0590, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 28.81% (0.0177 => 0.0228, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.58% (0.0583 => 0.0668, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.53% (1.1266 => 1.1206, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -91.67% (0.0012 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.38% (0.0564 => 0.0600, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.18% (0.0211 => 0.0141, std.dev.: 0.0050) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.13% (0.7652 => 0.7662, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.06% (1.7062 => 1.7073, std.dev.: 0.0012) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -59.50% (0.0121 => 0.0049, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 143.82% (0.0089 => 0.0217, std.dev.: 0.0004) SingleSource/UnitTests/2003-08-11-VaListArg: 175.56% (0.0090 => 0.0248, std.dev.: 0.0007) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -27.26% (4.1772 => 3.0384, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/except: 82716.67% (0.0006 => 0.4969, std.dev.: 0.0031) SingleSource/Regression/C++/EH/ctor_dtor_count: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.36% (0.0745 => 0.0919, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.27% (0.6410 => 0.7068, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.01% (0.1159 => 0.1275, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 9.91% (0.5309 => 0.5835, std.dev.: 0.0107) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.19% (0.1414 => 0.1544, std.dev.: 0.0046) MultiSource/Benchmarks/PAQ8p/paq8p: 9.01% (2.1763 => 2.3724, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 8.07% (0.6173 => 0.6671, std.dev.: 0.0044) MultiSource/Applications/SIBsim4/SIBsim4: 7.18% (1.1653 => 1.2490, std.dev.: 0.0049) MultiSource/Applications/lemon/lemon: 7.14% (1.0046 => 1.0763, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.07% (1.5150 => 1.6221, std.dev.: 0.0191) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.54% (0.2552 => 0.2719, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 6.47% (15.3105 => 16.3016, std.dev.: 0.1577) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.02% (0.7639 => 0.8099, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.01% (0.2797 => 0.2965, std.dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 5.83% (0.6915 => 0.7318, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.42% (0.6069 => 0.6398, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.30% (0.4248 => 0.4473, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/18-imp/imp: 5.25% (0.3217 => 0.3386, std.dev.: 0.0028) MultiSource/Applications/d/make_dparser: 5.16% (3.0225 => 3.1784, std.dev.: 0.0220) SingleSource/Benchmarks/Misc/oourafft: 5.12% (0.1971 => 0.2072, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 4.94% (4.7455 => 4.9798, std.dev.: 0.0379) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.90% (0.3901 => 0.4092, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.70% (0.3062 => 0.3206, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 4.63% (2.0972 => 2.1944, std.dev.: 0.0149) MultiSource/Applications/SPASS/SPASS: 4.61% (13.3238 => 13.9382, std.dev.: 0.0639) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.57% (0.8569 => 0.8961, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.50% (1.1827 => 1.2359, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.48% (0.7722 => 0.8068, std.dev.: 0.0133) MultiSource/Applications/Burg/burg: 4.46% (1.1440 => 1.1950, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.45% (0.3418 => 0.3570, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/lists: 4.39% (0.2347 => 0.2450, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.36% (0.7226 => 0.7541, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.34% (1.1672 => 1.2178, std.dev.: 0.0087) MultiSource/Benchmarks/Bullet/bullet: 4.24% (29.3170 => 30.5610, std.dev.: 0.0578) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.21% (1.2021 => 1.2527, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.18% (0.2654 => 0.2765, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.02% (3.0758 => 3.1994, std.dev.: 0.0372) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.01% (6.2546 => 6.5056, std.dev.: 0.0609) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.00% (1.4408 => 1.4985, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/09-vor/vor: 3.97% (0.3026 => 0.3146, std.dev.: 0.0022) MultiSource/Applications/lua/lua: 3.85% (3.5980 => 3.7365, std.dev.: 0.0196) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.81% (2.0317 => 2.1092, std.dev.: 0.0134) MultiSource/Benchmarks/mafft/pairlocalalign: 3.80% (8.2186 => 8.5308, std.dev.: 0.0447) MultiSource/Applications/hbd/hbd: 3.80% (1.3268 => 1.3772, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/football/football: 3.65% (0.8405 => 0.8712, std.dev.: 0.0046) MultiSource/Benchmarks/sim/sim: 3.60% (0.3084 => 0.3195, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.59% (12.6413 => 13.0951, std.dev.: 0.1514) MultiSource/Applications/treecc/treecc: 3.51% (1.8798 => 1.9457, std.dev.: 0.0198) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.22% (0.5963 => 0.6155, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.15% (1.0821 => 1.1162, std.dev.: 0.0096) MultiSource/Applications/JM/lencod/lencod: 3.11% (14.7256 => 15.1841, std.dev.: 0.0861) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.04% (0.5520 => 0.5688, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.03% (4.0318 => 4.1541, std.dev.: 0.0254) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.82% (1.0689 => 1.0990, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.68% (4.2616 => 4.3757, std.dev.: 0.0102) MultiSource/Applications/JM/ldecod/ldecod: 2.60% (6.4908 => 6.6598, std.dev.: 0.0629) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.59% (0.5937 => 0.6091, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: 2.49% (0.9425 => 0.9660, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.36% (4.2815 => 4.3824, std.dev.: 0.0277) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.32% (1.2742 => 1.3038, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.31% (0.9029 => 0.9238, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.25% (0.5740 => 0.5869, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.12% (1.3935 => 1.4231, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.06% (8.2559 => 8.4262, std.dev.: 0.0582) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.99% (4.3380 => 4.4244, std.dev.: 0.0134) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.43% (1.6538 => 2.3389, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/matrix: 22.10% (3.4629 => 4.2281, std.dev.: 0.0208) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.67% (0.0766 => 0.0886, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/ary3: 14.67% (1.7426 => 1.9983, std.dev.: 0.0249) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.13% (2.4042 => 2.7440, std.dev.: 0.0313) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.68% (4.0101 => 4.5587, std.dev.: 0.0411) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 13.09% (0.0917 => 0.1037, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/queens: 11.12% (1.6261 => 1.8069, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/mason/mason: 10.13% (0.5004 => 0.5511, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.28% (0.2857 => 0.3122, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/Puzzle: 9.07% (0.1433 => 0.1563, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/lists: 8.90% (7.0025 => 7.6257, std.dev.: 0.0161) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.61% (1.0063 => 1.0929, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 7.75% (0.7609 => 0.8199, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 7.19% (40.4792 => 43.3886, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.30% (0.3301 => 0.3509, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.96% (4.2129 => 4.4219, std.dev.: 0.0163) MultiSource/Benchmarks/Ptrdist/ft/ft: 4.70% (0.8498 => 0.8897, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/dt: 4.55% (0.9851 => 1.0299, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: 3.98% (15.2242 => 15.8300, std.dev.: 0.0529) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.89% (3.4080 => 3.5407, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 3.50% (3.5520 => 3.6764, std.dev.: 0.0279) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.29% (2.6656 => 2.7532, std.dev.: 0.0160) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.11% (0.5587 => 0.5761, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.86% (6.6312 => 6.8211, std.dev.: 0.0341) MultiSource/Benchmarks/Bullet/bullet: 2.82% (6.9722 => 7.1691, std.dev.: 0.0379) SingleSource/Benchmarks/Shootout-C++/hash: 2.41% (0.6308 => 0.6460, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/power/power: 1.50% (1.4184 => 1.4397, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.29% (4.5056 => 4.5636, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.06% (1.6110 => 1.6281, std.dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.50% (0.0591 => 0.0328, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -44.19% (0.2996 => 0.1672, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.66% (1.4189 => 1.1399, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.55% (1.4113 => 1.1354, std.dev.: 0.0220) SingleSource/UnitTests/Vector/constpool: -6.83% (8.9977 => 8.3835, std.dev.: 0.2114) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -38.92% (0.3497 => 0.2136, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.28% (5.2665 => 4.0933, std.dev.: 0.0750) SingleSource/Benchmarks/Shootout-C++/ary3: -20.09% (1.7473 => 1.3962, std.dev.: 0.0380) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.95% (15.8312 => 13.3058, std.dev.: 0.7077) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.30% (1.7361 => 1.4704, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1578, std.dev.: 0.0284) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.42% (1.1647 => 1.0550, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: -8.38% (9.5474 => 8.7478, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.25% (1.4034 => 1.2876, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.80% (3.2007 => 2.9510, std.dev.: 0.0172) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.86% (3.6254 => 3.3766, std.dev.: 0.0099) MultiSource/Applications/lambda-0_1_3/lambda: -6.65% (7.6833 => 7.1723, std.dev.: 0.0386) SingleSource/Benchmarks/Shootout-C++/fibo: -6.64% (4.6355 => 4.3278, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/richards_benchmark: -6.47% (1.4441 => 1.3506, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.99% (2.9728 => 2.7946, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.46% (3.9413 => 3.7260, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout/fib2: -5.26% (4.4195 => 4.1872, std.dev.: 0.0228) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.86% (0.4564 => 0.4342, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -4.62% (2.5166 => 2.4003, std.dev.: 0.0154) MultiSource/Benchmarks/mafft/pairlocalalign: -4.15% (62.4126 => 59.8208, std.dev.: 0.0393) MultiSource/Applications/sgefa/sgefa: -4.14% (0.3746 => 0.3591, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.97% (1.4021 => 1.3464, std.dev.: 0.0154) SingleSource/Benchmarks/McGill/misr: -3.75% (0.4296 => 0.4135, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.62% (45.4683 => 43.8246, std.dev.: 0.5986) SingleSource/Benchmarks/Shootout-C++/methcall: -3.00% (9.2503 => 8.9732, std.dev.: 0.0130) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.68% (1.1683 => 1.1370, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.48% (3.7496 => 3.6566, std.dev.: 0.0096) SingleSource/Benchmarks/Dhrystone/dry: -2.25% (2.4013 => 2.3472, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -2.01% (92.7467 => 90.8786, std.dev.: 0.2347) SingleSource/Benchmarks/Shootout-C++/hash2: -1.94% (3.4876 => 3.4199, std.dev.: 0.0084) MultiSource/Applications/SIBsim4/SIBsim4: -1.74% (3.4230 => 3.3633, std.dev.: 0.0142) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.74% (2.3569 => 2.3160, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std.dev.: 0.0010) MultiSource/Applications/aha/aha: -1.56% (3.4286 => 3.3751, std.dev.: 0.0113) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.55% (9.3855 => 9.2396, std.dev.: 0.0154) MultiSource/Benchmarks/FreeBench/neural/neural: -1.55% (1.0926 => 1.0757, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3134, std.dev.: 0.0676) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.33% (27.1724 => 26.8118, std.dev.: 0.0475) SingleSource/Benchmarks/Dhrystone/fldry: -1.19% (2.4971 => 2.4674, std.dev.: 0.0008) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.14% (0.9980 => 1.0194, std.dev.: 0.0138) MultiSource/Applications/sqlite3/sqlite3: 3.39% (0.6022 => 0.6226, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: 9.90% (0.1666 => 0.1831, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.32% (0.1554 => 0.1590, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.21% (0.3083 => 0.3151, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.29% (0.2394 => 0.2363, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.38% (0.3175 => 0.3187, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.69% (0.2302 => 0.2341, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: 2.67% (0.0449 => 0.0461, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.67% (0.0240 => 0.0244, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 2.60% (0.0192 => 0.0197, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.51% (0.0390 => 0.0392, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.33% (0.0301 => 0.0305, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.76% (0.0284 => 0.0289, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -12.96% (0.0324 => 0.0282, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/casts: 4.52% (0.0177 => 0.0185, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -33.33% (0.0189 => 0.0126, std.dev.: 0.0036) SingleSource/UnitTests/Vector/multiplies: 1.20% (0.0249 => 0.0252, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: 0.62% (0.0325 => 0.0327, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 10.00% (0.0010 => 0.0011) MultiSource/Applications/ClamAV/clamscan: 0.42% (0.1429 => 0.1435, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -3.08% (1.5019 => 1.4556, std.dev.: 0.0702) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -2.93% (0.1501 => 0.1457, std.dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.10% (0.4264 => 0.4089, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.48% (0.1344 => 0.1458, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.17% (0.0589 => 0.0590, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.72% (0.0232 => 0.0228, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.54% (0.0639 => 0.0668, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.27% (1.1350 => 1.1206, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -83.33% (0.0006 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.81% (0.0637 => 0.0600, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -42.68% (0.0246 => 0.0141, std.dev.: 0.0050) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.60% (0.7541 => 0.7662, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.13% (1.5363 => 1.7073, std.dev.: 0.0012) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -30.00% (0.0070 => 0.0049, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 4.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 7 01:19:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 03:19:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121007081947.83F592A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4665?compare_to=4661&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4665, Order: 165371, Start Time: 2012-10-07 06:59:23, End Time: 2012-10-07 08:21:32 To: 4661, Order: 165368, Start Time: 2012-10-07 05:11:13, End Time: 2012-10-07 06:30:17 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 5 (139 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1020 (779 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.17% (2.5325 => 2.5621, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 1.01% (11.3927 => 11.5075, std.dev.: 0.0239) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.01% (8.1374 => 8.2192, std.dev.: 0.0151) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.24% (78.4160 => 80.9575, std.dev.: 0.2833) SingleSource/Benchmarks/Misc/lowercase: 1.43% (7.9425 => 8.0560, std.dev.: 0.0245) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.20% (0.5876 => 0.5888, std.dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 0.28% (16.1864 => 16.2320, std.dev.: 0.0219) MultiSource/Benchmarks/Bullet/bullet: 0.30% (54.8554 => 55.0179, std.dev.: 0.0726) MultiSource/Benchmarks/MallocBench/gs/gs: 0.16% (4.3861 => 4.3930, std.dev.: 0.0166) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.10% (1.2463 => 1.2476, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.04% (7.7649 => 7.7678, std.dev.: 0.0194) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.08% (0.7402 => 0.7396, std.dev.: 0.0163) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.55% (0.0363 => 0.0361, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.29% (0.2139 => 0.2188, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -13.01% (63.2438 => 55.0179, std.dev.: 0.0726) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.62% (14.1553 => 18.7727, std.dev.: 0.0175) SingleSource/Benchmarks/Misc-C++-EH/spirit: 61.54% (3.4629 => 5.5938, std.dev.: 0.0532) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14228.61% (0.0720 => 10.3166, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952400.00% (0.0001 => 9.9525, std.dev.: 0.0191) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 49.65% (0.2554 => 0.3822, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: 46.46% (10.3673 => 15.1835, std.dev.: 0.0144) SingleSource/Benchmarks/Misc/richards_benchmark: 31.69% (0.1622 => 0.2136, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/distray/distray: 31.06% (0.1056 => 0.1384, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 16.52% (7.0540 => 8.2192, std.dev.: 0.0151) SingleSource/Benchmarks/Misc/flops: 16.48% (0.1432 => 0.1668, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.34% (2.2022 => 2.5621, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.01% (0.1566 => 0.1801, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.06% (1.7609 => 1.9908, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/oourafft: 12.86% (0.3282 => 0.3704, std.dev.: 0.0094) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.28% (0.0871 => 0.0978, std.dev.: 0.0040) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.98% (0.1584 => 0.1758, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 10.31% (0.3473 => 0.3831, std.dev.: 0.0058) MultiSource/Applications/JM/ldecod/ldecod: 10.27% (10.4361 => 11.5075, std.dev.: 0.0239) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.22% (0.3543 => 0.3905, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/exceptions-3: 10.15% (0.3516 => 0.3873, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/exceptions-4: 10.10% (0.3543 => 0.3901, std.dev.: 0.0069) SingleSource/UnitTests/ObjC/exceptions-2: 10.07% (0.3497 => 0.3849, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/synchronized: 10.05% (0.3561 => 0.3919, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/power/power: 10.00% (0.1440 => 0.1584, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.85% (0.3828 => 0.4205, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.84% (0.4879 => 0.5359, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/for-in: 9.80% (0.3694 => 0.4056, std.dev.: 0.0067) SingleSource/UnitTests/ObjC/parameter-passing: 9.73% (0.3927 => 0.4309, std.dev.: 0.0062) SingleSource/UnitTests/ObjC/property: 9.73% (0.3886 => 0.4264, std.dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.46% (0.1438 => 0.1574, std.dev.: 0.0018) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.42% (0.1125 => 0.1231, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 9.31% (9.4845 => 10.3674, std.dev.: 0.0193) SingleSource/Benchmarks/McGill/chomp: 9.31% (0.1655 => 0.1809, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.30% (0.1236 => 0.1351, std.dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: 9.23% (0.7433 => 0.8119, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: 9.19% (0.7115 => 0.7769, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.14% (0.6675 => 0.7285, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.07% (0.3177 => 0.3465, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.99% (0.5105 => 0.5564, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.74% (1.5415 => 1.6762, std.dev.: 0.0045) MultiSource/Applications/sgefa/sgefa: 8.72% (0.3109 => 0.3380, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 8.51% (0.1175 => 0.1275, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.49% (0.4615 => 0.5007, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.49% (0.1625 => 0.1763, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 8.44% (0.5925 => 0.6425, std.dev.: 0.0101) MultiSource/Applications/oggenc/oggenc: 8.42% (5.7591 => 6.2439, std.dev.: 0.0189) MultiSource/Benchmarks/Olden/em3d/em3d: 8.38% (0.1695 => 0.1837, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 8.33% (0.3423 => 0.3708, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.29% (1.3050 => 1.4132, std.dev.: 0.0044) SingleSource/UnitTests/ObjC++/property-reference-object: 8.28% (0.6030 => 0.6529, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.27% (0.2758 => 0.2986, std.dev.: 0.0049) MultiSource/Applications/d/make_dparser: 8.24% (3.3354 => 3.6104, std.dev.: 0.0057) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.22% (0.8172 => 0.8844, std.dev.: 0.0074) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.22% (0.2700 => 0.2922, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.16% (0.5860 => 0.6338, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.15% (0.2271 => 0.2456, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.05% (4.2646 => 4.6080, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.96% (0.8067 => 0.8709, std.dev.: 0.0095) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.95% (0.1510 => 0.1630, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.94% (0.5569 => 0.6011, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.82% (4.9449 => 5.3315, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.81% (5.0018 => 5.3925, std.dev.: 0.0108) MultiSource/Applications/hbd/hbd: 7.81% (1.5603 => 1.6821, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.80% (8.1363 => 8.7713, std.dev.: 0.0098) MultiSource/Benchmarks/sim/sim: 7.79% (0.3387 => 0.3651, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 7.78% (0.6456 => 0.6958, std.dev.: 0.0194) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.70% (0.1337 => 0.1440, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.70% (0.2065 => 0.2224, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.69% (0.2107 => 0.2269, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: 7.68% (0.7326 => 0.7889, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.68% (0.3307 => 0.3561, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.68% (0.9765 => 1.0515, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.67% (0.5020 => 0.5405, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.65% (0.4103 => 0.4417, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.53% (0.1940 => 0.2086, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.50% (7.9617 => 8.5588, std.dev.: 0.0127) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.50% (0.3121 => 0.3355, std.dev.: 0.0049) MultiSource/Applications/lua/lua: 7.50% (3.8723 => 4.1626, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.40% (0.3650 => 0.3920, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 7.31% (0.7835 => 0.8408, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.30% (0.3865 => 0.4147, std.dev.: 0.0098) MultiSource/Applications/Burg/burg: 7.28% (1.1642 => 1.2490, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/strcat: 7.24% (0.2831 => 0.3036, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.14% (0.3826 => 0.4099, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.13% (0.2891 => 0.3097, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.11% (0.3136 => 0.3359, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 7.10% (21.9371 => 23.4946, std.dev.: 0.0310) SingleSource/Benchmarks/Shootout-C++/hash2: 7.01% (0.4620 => 0.4944, std.dev.: 0.0051) MultiSource/Applications/viterbi/viterbi: 7.01% (0.1555 => 0.1664, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary3: 7.01% (0.3283 => 0.3513, std.dev.: 0.0080) MultiSource/Applications/lemon/lemon: 6.93% (1.0722 => 1.1465, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 6.91% (0.3052 => 0.3263, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/sieve: 6.88% (0.3603 => 0.3851, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.82% (2.0665 => 2.2075, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 6.82% (2.0273 => 2.1656, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.77% (0.3162 => 0.3376, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.76% (0.2871 => 0.3065, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.72% (0.2603 => 0.2778, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.68% (0.3441 => 0.3671, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.66% (0.2793 => 0.2979, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/matrix: 6.65% (0.3098 => 0.3304, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.57% (1.1861 => 1.2640, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.49% (1.5859 => 1.6889, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/09-vor/vor: 6.45% (0.3180 => 0.3385, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.43% (0.6450 => 0.6865, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.27% (0.5981 => 0.6356, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/football/football: 6.24% (0.8921 => 0.9478, std.dev.: 0.0026) MultiSource/Applications/siod/siod: 6.23% (2.2969 => 2.4401, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/05-eks/eks: 6.09% (0.4299 => 0.4561, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary2: 6.04% (0.3379 => 0.3583, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.79% (2.2024 => 2.3300, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.65% (1.4186 => 1.4988, std.dev.: 0.0051) MultiSource/Benchmarks/nbench/nbench: 5.41% (1.1840 => 1.2480, std.dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.40% (0.1906 => 0.2009, std.dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 4.88% (1.2842 => 1.3469, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.27% (0.8101 => 0.8447, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.73% (14.3668 => 14.9020, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.53% (0.3427 => 0.3548, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 3.36% (17.1811 => 17.7577, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.07% (3.8922 => 4.0117, std.dev.: 0.0133) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.91% (1.1194 => 1.1520, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.65% (0.3817 => 0.3918, std.dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8962, std.dev.: 0.0500) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std.dev.: 0.0251) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.92% (0.1421 => 0.1562, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 9.84% (1.1396 => 1.2517, std.dev.: 0.0025) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4499, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3680, std.dev.: 0.0132) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.59% (3.6395 => 3.7703, std.dev.: 0.0142) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.05% (4.2280 => 4.3568, std.dev.: 0.0192) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7652, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8126, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.11% (2.6546 => 2.6841, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.06% (6.6874 => 0.1295, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -79.77% (0.8651 => 0.1750, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.09% (5.2763 => 3.2667, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.06% (5.3855 => 3.6588, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.65% (5.3526 => 3.6584, std.dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -14.49% (54.1659 => 46.3154, std.dev.: 0.7843) MultiSource/Benchmarks/FreeBench/mason/mason: -13.07% (0.0811 => 0.0705, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -11.10% (22.1758 => 19.7144, std.dev.: 0.0582) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.61% (2.9384 => 2.6266, std.dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7645, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -16.06% (1.6925 => 1.4207, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.63% (0.0998 => 0.0862, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.21% (1.2373 => 1.0986, std.dev.: 0.0340) SingleSource/Benchmarks/Misc/mandel-2: -10.35% (1.5373 => 1.3782, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/mason/mason: -9.90% (0.2161 => 0.1947, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.33% (19.9488 => 18.2866, std.dev.: 0.1243) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.73% (1.8329 => 1.7095, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0225) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.31% (1.6805 => 1.5913, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5081, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.23% (0.9957 => 0.9536, std.dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -3.59% (3.2827 => 3.1648, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5047, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout/lists: -3.07% (6.2999 => 6.1062, std.dev.: 0.0633) MultiSource/Applications/hexxagon/hexxagon: -3.01% (12.4730 => 12.0978, std.dev.: 0.0019) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.08% (0.4808 => 0.4708, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.84% (8.6802 => 8.5209, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.81% (1.0313 => 1.0126, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/salsa20: -1.81% (10.2830 => 10.0972, std.dev.: 0.0173) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.74% (8.1563 => 8.0141, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6812, std.dev.: 0.0022) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4208, std.dev.: 0.0037) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.60% (0.5229 => 0.5888, std.dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 8.29% (14.9895 => 16.2320, std.dev.: 0.0219) MultiSource/Benchmarks/MallocBench/gs/gs: 6.87% (4.1105 => 4.3930, std.dev.: 0.0166) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.93% (1.1048 => 1.2476, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.52% (7.1582 => 7.7678, std.dev.: 0.0194) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.87% (0.6222 => 0.7396, std.dev.: 0.0163) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36000.00% (0.0001 => 0.0361, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.40% (0.2116 => 0.2188, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 7 02:43:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 04:43:53 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121007094353.E44652A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4666?compare_to=4664&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4666, Order: 165372, Start Time: 2012-10-07 08:22:06, End Time: 2012-10-07 09:45:40 To: 4664, Order: 165371, Start Time: 2012-10-07 06:43:03, End Time: 2012-10-07 08:06:06 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (14 on baseline) Performance Regressions: 6 (78 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 971 (767 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.26% (0.8068 => 0.8331, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.54% (13.3058 => 14.7082, std.dev.: 0.0581) SingleSource/Benchmarks/Misc/whetstone: 2.64% (2.3459 => 2.4078, std.dev.: 0.0042) MultiSource/Benchmarks/BitBench/five11/five11: 1.71% (5.2065 => 5.2956, std.dev.: 0.0206) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.57% (2.4655 => 2.5041, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.15% (1.8429 => 1.8641, std.dev.: 0.0021) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.15% (1.0194 => 1.0209, std.dev.: 0.0102) MultiSource/Applications/sqlite3/sqlite3: -1.04% (0.6226 => 0.6161, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/08-main/main: 0.33% (0.1831 => 0.1837, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.63% (0.1590 => 0.1580, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.22% (0.3151 => 0.3144, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.17% (0.2363 => 0.2359, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.10% (0.3187 => 0.3254, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.62% (0.2341 => 0.2303, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel: 0.22% (0.0461 => 0.0462, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.23% (0.0244 => 0.0247, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -21.83% (0.0197 => 0.0154, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0392 => 0.0392, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -8.52% (0.0305 => 0.0279, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.69% (0.0289 => 0.0287, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 15.96% (0.0282 => 0.0327, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -1.62% (0.0185 => 0.0182, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -2.38% (0.0126 => 0.0123, std.dev.: 0.0036) SingleSource/UnitTests/Vector/multiplies: 1.19% (0.0252 => 0.0255, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: 1.22% (0.0327 => 0.0331, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -54.55% (0.0011 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -1.18% (0.1435 => 0.1418, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 2.88% (1.4556 => 1.4975, std.dev.: 0.0315) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.69% (0.1457 => 0.1467, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.32% (0.4089 => 0.4102, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.41% (0.1458 => 0.1452, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.58% (0.0590 => 0.0563, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -10.09% (0.0228 => 0.0205, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -12.57% (0.0668 => 0.0584, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.24% (1.1206 => 1.1345, std.dev.: 0.0362) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.83% (0.0600 => 0.0571, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 35.46% (0.0141 => 0.0191, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.27% (0.7662 => 0.7683, std.dev.: 0.0081) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.02% (1.7073 => 1.7069, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-09-SignedArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 8.16% (0.0049 => 0.0053, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 142.70% (0.0089 => 0.0216, std.dev.: 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: 173.33% (0.0090 => 0.0246, std.dev.: 0.0006) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -27.63% (4.1772 => 3.0232, std.dev.: 0.0439) SingleSource/Benchmarks/Shootout-C++/except: 82483.33% (0.0006 => 0.4955, std.dev.: 0.0046) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.55% (0.0745 => 0.0913, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.32% (0.1159 => 0.1267, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 9.08% (0.5309 => 0.5791, std.dev.: 0.0023) MultiSource/Benchmarks/PAQ8p/paq8p: 8.95% (2.1763 => 2.3711, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.88% (0.6410 => 0.6979, std.dev.: 0.0053) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.89% (0.7722 => 0.8331, std.dev.: 0.0050) MultiSource/Applications/minisat/minisat: 7.74% (0.6173 => 0.6651, std.dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.59% (0.3582 => 0.3854, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.08% (1.5150 => 1.6223, std.dev.: 0.0130) MultiSource/Applications/lemon/lemon: 6.79% (1.0046 => 1.0728, std.dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.70% (0.2552 => 0.2723, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 6.48% (1.1653 => 1.2408, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.27% (0.2886 => 0.3067, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 6.24% (15.3105 => 16.2657, std.dev.: 0.3336) MultiSource/Applications/lambda-0_1_3/lambda: 5.74% (0.6915 => 0.7312, std.dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.27% (0.4248 => 0.4472, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.98% (0.4880 => 0.5123, std.dev.: 0.0094) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.79% (6.2546 => 6.5543, std.dev.: 0.0667) MultiSource/Benchmarks/McCat/18-imp/imp: 4.79% (0.3217 => 0.3371, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.76% (0.2797 => 0.2930, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists1: 4.44% (0.2771 => 0.2894, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 4.39% (0.2347 => 0.2450, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 4.37% (3.0225 => 3.1546, std.dev.: 0.0172) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.34% (0.8569 => 0.8941, std.dev.: 0.0097) MultiSource/Benchmarks/Bullet/bullet: 4.32% (29.3170 => 30.5833, std.dev.: 0.1848) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.28% (0.3062 => 0.3193, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.15% (3.0758 => 3.2033, std.dev.: 0.0326) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.14% (0.2654 => 0.2764, std.dev.: 0.0018) MultiSource/Applications/siod/siod: 4.14% (2.0972 => 2.1840, std.dev.: 0.0049) MultiSource/Applications/SPASS/SPASS: 4.11% (13.3238 => 13.8714, std.dev.: 0.0358) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.10% (1.4408 => 1.4999, std.dev.: 0.0181) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.97% (1.1827 => 1.2296, std.dev.: 0.0095) MultiSource/Applications/oggenc/oggenc: 3.88% (4.7455 => 4.9298, std.dev.: 0.0306) MultiSource/Benchmarks/mafft/pairlocalalign: 3.87% (8.2186 => 8.5363, std.dev.: 0.0360) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.78% (1.1672 => 1.2113, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/hash2: 3.69% (0.3847 => 0.3989, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.65% (1.2021 => 1.2460, std.dev.: 0.0109) MultiSource/Applications/hbd/hbd: 3.63% (1.3268 => 1.3750, std.dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.60% (0.3195 => 0.3310, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.48% (0.3418 => 0.3537, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash: 3.47% (0.3520 => 0.3642, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.46% (0.4562 => 0.4720, std.dev.: 0.0043) MultiSource/Benchmarks/sim/sim: 3.34% (0.3084 => 0.3187, std.dev.: 0.0030) MultiSource/Applications/Burg/burg: 3.01% (1.1440 => 1.1784, std.dev.: 0.0096) MultiSource/Applications/treecc/treecc: 2.98% (1.8798 => 1.9359, std.dev.: 0.0071) MultiSource/Applications/JM/lencod/lencod: 2.92% (14.7256 => 15.1556, std.dev.: 0.0650) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.88% (4.3380 => 4.4629, std.dev.: 0.0263) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.70% (0.5963 => 0.6124, std.dev.: 0.0043) MultiSource/Applications/JM/ldecod/ldecod: 2.60% (6.4908 => 6.6598, std.dev.: 0.0234) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.19% (1.3935 => 1.4240, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.40% (1.6538 => 2.3384, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 22.58% (0.0766 => 0.0939, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2277, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/ary3: 14.86% (1.7426 => 2.0016, std.dev.: 0.0105) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.32% (4.0101 => 4.5442, std.dev.: 0.0049) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.74% (2.4042 => 2.7106, std.dev.: 0.0542) SingleSource/Benchmarks/McGill/queens: 10.47% (1.6261 => 1.7964, std.dev.: 0.0285) SingleSource/Benchmarks/Stanford/Puzzle: 9.98% (0.1433 => 0.1576, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.57% (1.0063 => 1.1026, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/lists: 8.83% (7.0025 => 7.6211, std.dev.: 0.0119) MultiSource/Benchmarks/FreeBench/mason/mason: 8.41% (0.5004 => 0.5425, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.91% (0.2857 => 0.3083, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.82% (0.3301 => 0.3526, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.36% (40.4792 => 42.6471, std.dev.: 0.3768) SingleSource/Benchmarks/Misc/fp-convert: 3.91% (15.2242 => 15.8188, std.dev.: 0.0540) SingleSource/Benchmarks/Misc/dt: 3.77% (0.9851 => 1.0222, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.74% (3.4080 => 3.5355, std.dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: 2.93% (6.9722 => 7.1764, std.dev.: 0.0470) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.90% (0.5587 => 0.5749, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.80% (6.6312 => 6.8167, std.dev.: 0.0188) SingleSource/Benchmarks/Misc/whetstone: 2.66% (2.3453 => 2.4078, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.40% (2.4455 => 2.5041, std.dev.: 0.0052) MultiSource/Applications/siod/siod: 2.20% (3.5520 => 3.6303, std.dev.: 0.0228) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.16% (2.6656 => 2.7232, std.dev.: 0.0140) MultiSource/Benchmarks/BitBench/five11/five11: 1.96% (5.1938 => 5.2956, std.dev.: 0.0206) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.45% (4.6127 => 4.6795, std.dev.: 0.0198) MultiSource/Benchmarks/Olden/power/power: 1.37% (1.4184 => 1.4379, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.34% (4.0659 => 4.1202, std.dev.: 0.0106) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.33% (0.0591 => 0.0329, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -43.93% (0.2996 => 0.1680, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.89% (1.4189 => 1.1508, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.68% (1.4113 => 1.1618, std.dev.: 0.0136) SingleSource/UnitTests/Vector/constpool: -7.70% (8.9977 => 8.3046, std.dev.: 0.2290) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.55% (0.3497 => 0.2044, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.59% (5.2665 => 4.1819, std.dev.: 0.1023) SingleSource/Benchmarks/Shootout-C++/ary3: -20.04% (1.7473 => 1.3971, std.dev.: 0.0432) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.14% (1.7361 => 1.4733, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1596, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.39% (1.1647 => 1.0553, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.30% (1.4034 => 1.2869, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/flops: -8.28% (9.5474 => 8.7566, std.dev.: 0.0169) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.76% (3.2007 => 2.9522, std.dev.: 0.0141) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.09% (15.8312 => 14.7082, std.dev.: 0.0581) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.98% (3.6254 => 3.3725, std.dev.: 0.0231) MultiSource/Applications/lambda-0_1_3/lambda: -6.74% (7.6833 => 7.1656, std.dev.: 0.0361) SingleSource/Benchmarks/Shootout-C++/fibo: -6.62% (4.6355 => 4.3285, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.95% (2.9728 => 2.7958, std.dev.: 0.0095) MultiSource/Benchmarks/FreeBench/distray/distray: -5.89% (0.2664 => 0.2507, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/richards_benchmark: -5.72% (1.4441 => 1.3615, std.dev.: 0.0165) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.47% (3.9413 => 3.7257, std.dev.: 0.0094) SingleSource/Benchmarks/McGill/misr: -5.42% (0.4296 => 0.4063, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout/fib2: -5.15% (4.4195 => 4.1918, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.12% (0.4140 => 0.3928, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/bh/bh: -4.98% (2.5166 => 2.3912, std.dev.: 0.0292) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.51% (0.4564 => 0.4358, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -4.27% (62.4126 => 59.7476, std.dev.: 0.0226) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.47% (45.4683 => 43.8893, std.dev.: 0.2171) SingleSource/Benchmarks/Shootout-C++/methcall: -3.33% (9.2503 => 8.9421, std.dev.: 0.0656) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.91% (3.7496 => 3.6405, std.dev.: 0.0240) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.75% (1.1683 => 1.1362, std.dev.: 0.0056) MultiSource/Benchmarks/PAQ8p/paq8p: -2.31% (92.7467 => 90.6029, std.dev.: 0.6104) SingleSource/Benchmarks/Dhrystone/dry: -2.19% (2.4013 => 2.3486, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: -2.17% (3.4230 => 3.3488, std.dev.: 0.0212) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.00% (1.0686 => 1.0472, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: -1.94% (3.4876 => 3.4201, std.dev.: 0.0209) MultiSource/Applications/aha/aha: -1.90% (3.4286 => 3.3633, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.88% (2.3569 => 2.3127, std.dev.: 0.0153) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.62% (9.3855 => 9.2330, std.dev.: 0.0553) MultiSource/Benchmarks/FreeBench/neural/neural: -1.46% (1.0926 => 1.0766, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.42% (27.1724 => 26.7869, std.dev.: 0.0593) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3114, std.dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/fldry: -1.20% (2.4971 => 2.4672, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/lists: -1.16% (16.5617 => 16.3691, std.dev.: 0.0277) MultiSource/Applications/JM/lencod/lencod: -1.15% (6.7458 => 6.6680, std.dev.: 0.0068) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.29% (0.9980 => 1.0209, std.dev.: 0.0102) MultiSource/Applications/sqlite3/sqlite3: 2.31% (0.6022 => 0.6161, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/08-main/main: 10.26% (0.1666 => 0.1837, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.67% (0.1554 => 0.1580, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.98% (0.3083 => 0.3144, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.46% (0.2394 => 0.2359, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.49% (0.3175 => 0.3254, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.04% (0.2302 => 0.2303, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel: 2.90% (0.0449 => 0.0462, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.92% (0.0240 => 0.0247, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -19.79% (0.0192 => 0.0154, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.51% (0.0390 => 0.0392, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -7.31% (0.0301 => 0.0279, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.06% (0.0284 => 0.0287, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.93% (0.0324 => 0.0327, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 2.82% (0.0177 => 0.0182, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -34.92% (0.0189 => 0.0123, std.dev.: 0.0036) SingleSource/UnitTests/Vector/multiplies: 2.41% (0.0249 => 0.0255, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: 1.85% (0.0325 => 0.0331, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.77% (0.1429 => 0.1418, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -0.29% (1.5019 => 1.4975, std.dev.: 0.0315) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -2.27% (0.1501 => 0.1467, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.80% (0.4264 => 0.4102, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.04% (0.1344 => 0.1452, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.41% (0.0589 => 0.0563, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -11.64% (0.0232 => 0.0205, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.61% (0.0639 => 0.0584, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.04% (1.1350 => 1.1345, std.dev.: 0.0362) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 116.67% (0.0006 => 0.0013, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.36% (0.0637 => 0.0571, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -22.36% (0.0246 => 0.0191, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.88% (0.7541 => 0.7683, std.dev.: 0.0081) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.10% (1.5363 => 1.7069, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -24.29% (0.0070 => 0.0053, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 7 02:44:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 04:44:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121007094423.1BC8A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4667?compare_to=4663&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4667, Order: 165372, Start Time: 2012-10-07 08:31:23, End Time: 2012-10-07 09:46:08 To: 4663, Order: 165371, Start Time: 2012-10-07 06:44:43, End Time: 2012-10-07 08:02:09 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (182 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1040 (753 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 18.50% (0.4059 => 0.4810, std.dev.: 0.0231) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.61% (54.5801 => 56.5487, std.dev.: 0.0368) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.94% (2.0176 => 2.4602, std.dev.: 0.0048) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.38% (0.1410 => 0.1655, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 15.62% (0.0826 => 0.0955, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.68% (0.0770 => 0.0883, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 14.40% (0.2243 => 0.2566, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 12.71% (1.3693 => 1.5434, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.59% (0.0834 => 0.0939, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.45% (0.0819 => 0.0921, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 12.24% (0.1013 => 0.1137, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 11.97% (0.4328 => 0.4846, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 11.95% (0.7061 => 0.7905, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 11.92% (0.4062 => 0.4546, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.82% (0.1413 => 0.1580, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.69% (0.2721 => 0.3039, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 11.64% (0.5818 => 0.6495, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 11.62% (0.7038 => 0.7856, std.dev.: 0.0083) SingleSource/UnitTests/ObjC++/Hello: 11.48% (0.5748 => 0.6408, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 11.25% (0.2781 => 0.3094, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.21% (0.1588 => 0.1766, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.19% (0.1072 => 0.1192, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.18% (3.9660 => 4.4094, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 11.16% (0.0977 => 0.1086, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.02% (0.7710 => 0.8560, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.01% (1.4563 => 1.6166, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.00% (0.1327 => 0.1473, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.96% (0.2782 => 0.3087, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.92% (1.2193 => 1.3524, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.89% (0.0964 => 0.1069, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.86% (0.2596 => 0.2878, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.82% (0.6283 => 0.6963, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.75% (0.3899 => 0.4318, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.67% (0.3485 => 0.3857, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 10.66% (0.2607 => 0.2885, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.65% (0.9199 => 1.0179, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/lists: 10.60% (0.3293 => 0.3642, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wc: 10.59% (0.2937 => 0.3248, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 10.56% (0.2726 => 0.3014, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.56% (0.3022 => 0.3341, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 10.48% (0.2690 => 0.2972, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 10.47% (0.2760 => 0.3049, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.45% (0.5265 => 0.5815, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.41% (0.4016 => 0.4434, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.40% (0.6959 => 0.7683, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.36% (0.2655 => 0.2930, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.32% (1.9828 => 2.1875, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 10.31% (0.2628 => 0.2899, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 10.29% (0.3149 => 0.3473, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.27% (0.2765 => 0.3049, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 10.27% (0.3107 => 0.3426, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 10.26% (0.1062 => 0.1171, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 10.25% (13.8202 => 15.2366, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.22% (0.3756 => 0.4140, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.22% (0.2966 => 0.3269, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.20% (0.2696 => 0.2971, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 10.19% (0.3453 => 0.3805, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 10.19% (0.3868 => 0.4262, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.15% (1.1364 => 1.2517, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: 10.14% (0.2761 => 0.3041, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.12% (0.3489 => 0.3842, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 10.09% (0.3192 => 0.3514, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.08% (0.3580 => 0.3941, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.00% (0.4390 => 0.4829, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/matrix: 9.94% (0.2988 => 0.3285, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 9.92% (0.2995 => 0.3292, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.88% (0.2914 => 0.3202, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 9.65% (0.3534 => 0.3875, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.65% (0.5577 => 0.6115, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.60% (0.4791 => 0.5251, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 9.56% (1.0313 => 1.1299, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.55% (0.3130 => 0.3429, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 9.38% (0.1589 => 0.1738, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.33% (0.1157 => 0.1265, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.27% (0.4379 => 0.4785, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.13% (0.1435 => 0.1566, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.12% (0.2127 => 0.2321, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.10% (0.5637 => 0.6150, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.09% (0.8698 => 0.9489, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.09% (0.1276 => 0.1392, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 8.96% (16.6129 => 18.1022, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.96% (0.1986 => 0.2164, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 8.93% (0.2945 => 0.3208, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 8.90% (0.8310 => 0.9050, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.90% (0.7460 => 0.8124, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 8.87% (0.6744 => 0.7342, std.dev.: 0.0021) MultiSource/Applications/Burg/burg: 8.85% (1.1061 => 1.2040, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.72% (0.3246 => 0.3529, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.68% (0.3755 => 0.4081, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 8.66% (0.3220 => 0.3499, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.65% (0.2023 => 0.2198, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 8.60% (3.8646 => 4.1970, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.57% (7.2180 => 7.8365, std.dev.: 0.0032) MultiSource/Applications/d/make_dparser: 8.54% (3.1889 => 3.4611, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.42% (0.6576 => 0.7130, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 8.42% (0.7506 => 0.8138, std.dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 8.33% (1.0594 => 1.1476, std.dev.: 0.0148) MultiSource/Applications/treecc/treecc: 8.24% (1.9270 => 2.0858, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.22% (0.8818 => 0.9543, std.dev.: 0.0038) MultiSource/Applications/viterbi/viterbi: 8.19% (0.1478 => 0.1599, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 8.17% (2.1791 => 2.3572, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.15% (0.1865 => 0.2017, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.06% (0.3511 => 0.3794, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 8.05% (0.3131 => 0.3383, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.96% (3.6692 => 3.9614, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 7.94% (1.2749 => 1.3761, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: 7.90% (0.2925 => 0.3156, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.86% (1.3245 => 1.4286, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 7.85% (14.8535 => 16.0190, std.dev.: 0.0139) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.84% (0.1569 => 0.1692, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.76% (4.3801 => 4.7200, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.74% (4.4433 => 4.7874, std.dev.: 0.0041) MultiSource/Applications/oggenc/oggenc: 7.71% (4.6629 => 5.0226, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.71% (0.1789 => 0.1927, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 7.69% (8.4961 => 9.1498, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.62% (0.2140 => 0.2303, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 7.60% (0.1657 => 0.1783, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.50% (0.6135 => 0.6595, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/05-eks/eks: 7.37% (0.4113 => 0.4416, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 7.18% (0.6250 => 0.6699, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.13% (1.2292 => 1.3169, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.98% (0.9108 => 0.9744, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.93% (0.1819 => 0.1945, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.87% (0.2504 => 0.2676, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.86% (4.9865 => 5.3288, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.76% (3.2742 => 3.4956, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.70% (1.1333 => 1.2092, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.61% (1.5188 => 1.6192, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.60% (0.4805 => 0.5122, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 6.60% (0.4003 => 0.4267, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.57% (0.3914 => 0.4171, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/trivial-interface: 6.43% (0.3578 => 0.3808, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 6.42% (0.2008 => 0.2137, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/for-in: 6.36% (0.3789 => 0.4030, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.31% (0.3646 => 0.3876, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 6.30% (6.5754 => 6.9895, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.25% (0.3650 => 0.3878, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 6.24% (0.3940 => 0.4186, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.22% (0.3245 => 0.3447, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 6.22% (0.3601 => 0.3825, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 6.17% (0.3663 => 0.3889, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.16% (0.3623 => 0.3846, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 5.87% (3.7467 => 3.9666, std.dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.85% (6.2785 => 6.6459, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.77% (0.2321 => 0.2455, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.58% (2.1007 => 2.2179, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.37% (13.2842 => 13.9980, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: 3.72% (16.2614 => 16.8659, std.dev.: 0.0224) MultiSource/Applications/ClamAV/clamscan: 3.48% (14.5298 => 15.0348, std.dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5155, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.09% (1.0895 => 1.3629, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/fbench: 24.41% (1.8175 => 2.2612, std.dev.: 0.0275) SingleSource/Benchmarks/Misc/richards_benchmark: 11.12% (1.1560 => 1.2845, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.02% (0.8273 => 0.9019, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4143, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.02% (1.2998 => 1.3781, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.26% (0.2093 => 0.2203, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0037, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.67% (11.2619 => 11.6751, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9854, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.27% (10.7476 => 11.0989, std.dev.: 0.0249) SingleSource/Regression/C/uint64_to_float: 2.97% (0.5449 => 0.5611, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.14% (7.4271 => 7.5861, std.dev.: 0.0036) MultiSource/Applications/lemon/lemon: 1.67% (1.4298 => 1.4537, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5125, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9677, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1872, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5781, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0270, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5904, std.dev.: 0.0060) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.00% (0.2670 => 0.1415, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.47% (0.4657 => 0.3890, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -15.56% (0.0707 => 0.0597) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.90% (1.3813 => 1.1893, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.63% (1.3819 => 1.1936, std.dev.: 0.0053) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.51% (22.5627 => 21.7702, std.dev.: 0.0225) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/mason/mason: -12.06% (0.2238 => 0.1968, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: -11.55% (1.2308 => 1.0887, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.21% (20.3410 => 18.2638, std.dev.: 0.0287) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5152, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.96% (1.3780 => 1.3096, std.dev.: 0.0090) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.62% (0.9996 => 0.9534, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.58% (3.2729 => 3.1556, std.dev.: 0.0046) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.43% (1.7688 => 1.7081, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.56% (26.5159 => 25.8370, std.dev.: 0.0240) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.42% (3.0263 => 2.9530, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.33% (1.9762 => 1.9301, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7148, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.69% (6.3560 => 6.2484, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0071, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8664, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: -1.25% (4.5928 => 4.5354, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4947, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: -1.18% (9.3358 => 9.2261, std.dev.: 0.0149) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2585, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.06% (1.0310 => 1.0201, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 7 03:08:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 05:08:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121007100840.A19D52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4668?compare_to=4665&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4668, Order: 165372, Start Time: 2012-10-07 08:51:01, End Time: 2012-10-07 10:10:25 To: 4665, Order: 165371, Start Time: 2012-10-07 06:59:23, End Time: 2012-10-07 08:21:32 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (153 on baseline) Performance Improvements: 1 (41 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1023 (765 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/lists: 2.19% (6.1062 => 6.2400, std.dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.12% (80.9575 => 79.2438, std.dev.: 0.3698) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.15% (0.5888 => 0.5879, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 0.04% (16.2320 => 16.2393, std.dev.: 0.0109) MultiSource/Benchmarks/Bullet/bullet: -0.10% (55.0179 => 54.9632, std.dev.: 0.0616) MultiSource/Benchmarks/MallocBench/gs/gs: -0.23% (4.3930 => 4.3827, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.02% (1.2476 => 1.2478, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.10% (7.7678 => 7.7599, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.04% (0.7396 => 0.7393, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 1.66% (0.0361 => 0.0367, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.18% (0.2188 => 0.2184, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -13.09% (63.2438 => 54.9632, std.dev.: 0.0616) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.44% (14.1553 => 18.7476, std.dev.: 0.0156) SingleSource/Benchmarks/Misc-C++-EH/spirit: 61.24% (3.4629 => 5.5837, std.dev.: 0.0021) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14228.33% (0.0720 => 10.3164, std.dev.: 0.0121) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9951900.00% (0.0001 => 9.9520, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 49.53% (0.2554 => 0.3819, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 46.41% (10.3673 => 15.1785, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/richards_benchmark: 31.57% (0.1622 => 0.2134, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/distray/distray: 30.87% (0.1056 => 0.1382, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 16.43% (7.0540 => 8.2130, std.dev.: 0.0109) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.34% (2.2022 => 2.5620, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/flops: 15.99% (0.1432 => 0.1661, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.50% (0.1566 => 0.1793, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.14% (1.7609 => 1.9922, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 12.43% (0.3282 => 0.3690, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.28% (0.0871 => 0.0978, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.05% (0.1584 => 0.1759, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 10.30% (10.4361 => 11.5111, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/trivial-interface: 10.25% (0.3473 => 0.3829, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.07% (0.3516 => 0.3870, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.05% (0.3561 => 0.3919, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.02% (0.3543 => 0.3898, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 10.00% (0.1440 => 0.1584, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 9.99% (0.3543 => 0.3897, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.95% (0.3497 => 0.3845, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 9.90% (0.3828 => 0.4207, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 9.85% (0.3927 => 0.4314, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.77% (0.3694 => 0.4055, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.63% (0.4879 => 0.5349, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.60% (0.1438 => 0.1576) SingleSource/UnitTests/ObjC/property: 9.57% (0.3886 => 0.4258, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 9.30% (9.4845 => 10.3665, std.dev.: 0.0132) MultiSource/Applications/minisat/minisat: 9.22% (0.7115 => 0.7771, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.19% (0.3177 => 0.3469, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: 9.12% (0.1655 => 0.1806, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.09% (0.6675 => 0.7282, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 9.00% (0.7433 => 0.8102, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.72% (1.5415 => 1.6759, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 8.72% (0.3109 => 0.3380, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.54% (0.4615 => 0.5009, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.49% (0.1625 => 0.1763, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 8.43% (5.7591 => 6.2446, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.42% (0.5105 => 0.5535, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 8.38% (0.3423 => 0.3710, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 8.38% (0.1695 => 0.1837, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/Hello: 8.35% (0.5925 => 0.6420, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 8.23% (3.3354 => 3.6100, std.dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference-object: 8.23% (0.6030 => 0.6526, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.17% (0.8172 => 0.8840, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.15% (0.2271 => 0.2456, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.11% (1.3050 => 1.4109, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.02% (0.5860 => 0.6330, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.00% (0.2700 => 0.2916, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.99% (4.2646 => 4.6055, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.88% (0.1510 => 0.1629, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.83% (5.0018 => 5.3934, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.78% (0.1337 => 0.1441, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.75% (0.2065 => 0.2225, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.74% (0.2107 => 0.2270, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.71% (0.3307 => 0.3562, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.70% (4.9449 => 5.3257, std.dev.: 0.0066) MultiSource/Applications/hbd/hbd: 7.70% (1.5603 => 1.6804, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.69% (8.1363 => 8.7617, std.dev.: 0.0015) MultiSource/Benchmarks/sim/sim: 7.68% (0.3387 => 0.3647, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.66% (0.9765 => 1.0513, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.66% (0.3121 => 0.3360, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 7.65% (0.6456 => 0.6950, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.65% (0.8067 => 0.8684, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.60% (0.5569 => 0.5992, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.59% (0.5020 => 0.5401, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 7.58% (0.4289 => 0.4614, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.56% (0.7326 => 0.7880, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.53% (0.1940 => 0.2086, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.48% (0.4103 => 0.4410, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.47% (0.2758 => 0.2964, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.43% (7.9617 => 8.5531, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/lists: 7.42% (0.3422 => 0.3676, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 7.35% (0.7835 => 0.8411, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.30% (0.3865 => 0.4147, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 7.28% (1.1642 => 1.2490, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.23% (0.4203 => 0.4507, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.21% (0.3650 => 0.3913, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 7.21% (3.8723 => 4.1513, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.12% (0.3441 => 0.3686, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 7.05% (21.9371 => 23.4829, std.dev.: 0.0088) MultiSource/Applications/viterbi/viterbi: 7.01% (0.1555 => 0.1664, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 6.98% (1.0722 => 1.1470, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 6.98% (0.3684 => 0.3941, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 6.97% (0.4048 => 0.4330, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.96% (0.2831 => 0.3028, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 6.95% (0.2905 => 0.3107, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.95% (0.2891 => 0.3092, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.92% (0.4636 => 0.4957, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.87% (0.3232 => 0.3454, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.86% (0.3136 => 0.3351, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.85% (0.3826 => 0.4088, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.80% (0.2603 => 0.2780, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.80% (0.4620 => 0.4934, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 6.78% (2.0273 => 2.1648, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 6.69% (0.3603 => 0.3844, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.67% (0.3162 => 0.3373, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.61% (2.0665 => 2.2031, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 6.55% (0.3098 => 0.3301, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.55% (0.3283 => 0.3498, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.54% (1.5859 => 1.6896, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.53% (0.2756 => 0.2936, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.52% (1.1861 => 1.2634, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/except: 6.51% (0.2871 => 0.3058, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.51% (0.2872 => 0.3059, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 6.45% (0.3180 => 0.3385, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.42% (0.2725 => 0.2900, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.40% (0.6450 => 0.6863, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wc: 6.32% (0.3052 => 0.3245, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.29% (0.2877 => 0.3058, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 6.29% (0.8921 => 0.9482, std.dev.: 0.0043) MultiSource/Applications/siod/siod: 6.28% (2.2969 => 2.4411, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hello: 6.23% (0.2714 => 0.2883, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.17% (0.2802 => 0.2975, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 6.16% (0.4299 => 0.4564, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.16% (0.2793 => 0.2965, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.10% (0.5981 => 0.6346, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 5.89% (0.3379 => 0.3578, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.71% (2.2024 => 2.3282, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.60% (1.4186 => 1.4980, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 5.43% (1.1840 => 1.2483, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.40% (0.1906 => 0.2009, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.29% (0.4064 => 0.4279, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.25% (0.2266 => 0.2385, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.98% (0.3131 => 0.3287, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 4.66% (1.2842 => 1.3440, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.38% (0.8101 => 0.8456, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.73% (14.3668 => 14.9026, std.dev.: 0.0191) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.56% (0.3427 => 0.3549, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 3.32% (17.1811 => 17.7519, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.08% (3.8922 => 4.0121, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.91% (1.1194 => 1.1520, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.26% (1.1145 => 1.3849, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.84% (1.1396 => 1.2517, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560) MultiSource/Applications/aha/aha: 9.20% (3.1595 => 3.4503, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.1578 => 3.3686, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.70% (3.6395 => 3.7741, std.dev.: 0.0044) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.64% (4.2280 => 4.3398, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.33% (1.7254 => 1.7656, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8139, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.24% (2.6546 => 2.6875, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.12% (6.5088 => 6.5814, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.06% (6.6874 => 0.1296, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.01% (0.8651 => 0.1729, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.05% (5.2763 => 3.2686, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.08% (5.3855 => 3.6581, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.79% (5.3526 => 3.6511, std.dev.: 0.0071) SingleSource/UnitTests/Vector/constpool: -14.53% (54.1659 => 46.2958, std.dev.: 0.0195) MultiSource/Benchmarks/FreeBench/mason/mason: -13.07% (0.0811 => 0.0705, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -11.10% (22.1758 => 19.7151, std.dev.: 0.0134) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.65% (2.9384 => 2.6256, std.dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.51% (1.1492 => 0.7641, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4230, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.53% (0.0998 => 0.0863, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -12.24% (1.2373 => 1.0858, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3783, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/mason/mason: -9.90% (0.2161 => 0.1947, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.28% (19.9488 => 18.2969, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.71% (1.8329 => 1.7099, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0148) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.30% (1.6805 => 1.5915, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7963, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.75% (1.5835 => 1.5083, std.dev.: 0.0017) MultiSource/Applications/siod/siod: -3.76% (3.2827 => 3.1592, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.23% (0.9957 => 0.9635, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5014, std.dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: -3.01% (12.4730 => 12.0981, std.dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.45% (0.4808 => 0.4690, std.dev.: 0.0014) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.04% (8.6802 => 8.5029, std.dev.: 0.0216) SingleSource/Benchmarks/Misc/salsa20: -1.95% (10.2830 => 10.0823, std.dev.: 0.0130) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.91% (8.1563 => 8.0003, std.dev.: 0.0166) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6826, std.dev.: 0.0008) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5117, std.dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.43% (0.5229 => 0.5879, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 8.34% (14.9895 => 16.2393, std.dev.: 0.0109) MultiSource/Benchmarks/MallocBench/gs/gs: 6.62% (4.1105 => 4.3827, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.94% (1.1048 => 1.2478, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.41% (7.1582 => 7.7599, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.82% (0.6222 => 0.7393, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36600.00% (0.0001 => 0.0367, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.21% (0.2116 => 0.2184, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 7 03:45:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 05:45:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121007104535.A8CCD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4669?compare_to=4662&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4669, Order: 165372, Start Time: 2012-10-07 08:03:28, End Time: 2012-10-07 10:47:21 To: 4662, Order: 165368, Start Time: 2012-10-07 04:47:35, End Time: 2012-10-07 07:34:20 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (132 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 1041 (831 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.32% (1.6009 => 1.6220, std.dev.: 0.0039) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 11.94% (1.5932 => 1.7834, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-4: 11.77% (0.3465 => 0.3873) SingleSource/UnitTests/ObjC/exceptions-2: 11.75% (0.3446 => 0.3851, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.55% (0.3488 => 0.3891, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 11.53% (0.3442 => 0.3839, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.50% (0.3460 => 0.3858, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.50% (0.3496 => 0.3898, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.44% (0.3469 => 0.3866, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.15% (0.3650 => 0.4057, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.12% (0.3643 => 0.4048, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.01% (0.1063 => 0.1180, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.93% (0.3724 => 0.4131, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.23% (0.5826 => 0.6364, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.07% (0.5889 => 0.6423, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 8.71% (0.1619 => 0.1760, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 8.62% (0.1218 => 0.1323, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.19% (0.4994 => 0.5403, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.17% (0.2875 => 0.3110, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 8.16% (0.3004 => 0.3249, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.01% (0.3195 => 0.3451, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.95% (0.2792 => 0.3014, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.93% (0.4361 => 0.4707, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.93% (0.2738 => 0.2955, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.92% (0.5000 => 0.5396, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 7.91% (0.2780 => 0.3000, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 7.84% (0.7171 => 0.7733, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.82% (1.3152 => 1.4181, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hello: 7.81% (0.2714 => 0.2926, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.79% (0.2813 => 0.3032, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 7.78% (0.2725 => 0.2937, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.76% (0.2911 => 0.3137, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 7.74% (0.2803 => 0.3020, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 7.72% (0.2823 => 0.3041, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.69% (1.6211 => 1.7458, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.68% (2.0673 => 2.2261, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.62% (0.2729 => 0.2937, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.61% (0.2811 => 0.3025, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 7.60% (0.2750 => 0.2959, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 7.60% (0.9909 => 1.0662, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/wc: 7.56% (0.3096 => 0.3330, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.53% (0.1620 => 0.1742, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 7.45% (0.3317 => 0.3564, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.44% (3.5627 => 3.8277, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 7.32% (5.5417 => 5.9476, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.32% (0.3060 => 0.3284, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.30% (0.2014 => 0.2161, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 7.27% (1.0781 => 1.1565, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 7.26% (0.3348 => 0.3591, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.26% (0.3362 => 0.3606, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.19% (0.3267 => 0.3502, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 7.19% (0.3477 => 0.3727, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.16% (2.7292 => 2.9245, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary: 7.15% (0.3258 => 0.3491, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 7.15% (0.3678 => 0.3941, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.14% (0.3124 => 0.3347, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.13% (0.3282 => 0.3516, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.06% (0.3625 => 0.3881, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 7.04% (0.1421 => 0.1521, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 7.03% (0.3726 => 0.3988, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.98% (0.4139 => 0.4428, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.92% (0.3930 => 0.4202, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.92% (0.3845 => 0.4111, std.dev.: 0.0026) MultiSource/Benchmarks/PAQ8p/paq8p: 6.91% (0.4847 => 0.5182, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.87% (0.2736 => 0.2924, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 6.78% (0.4146 => 0.4427, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 6.73% (0.4251 => 0.4537, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.72% (0.3690 => 0.3938, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.66% (0.3981 => 0.4246, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.63% (0.2566 => 0.2736, std.dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: 6.59% (4.2109 => 4.4883, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.58% (0.1549 => 0.1651, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.52% (0.2866 => 0.3053, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.48% (0.3890 => 0.4142, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 6.42% (23.5202 => 25.0301, std.dev.: 0.0378) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.40% (0.2969 => 0.3159, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.39% (0.5026 => 0.5347, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.37% (4.4195 => 4.7010, std.dev.: 0.0055) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.32% (0.5900 => 0.6273, std.dev.: 0.0036) MultiSource/Applications/spiff/spiff: 6.30% (0.4029 => 0.4283, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.30% (0.3903 => 0.4149, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.29% (0.6435 => 0.6840, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 6.22% (2.1013 => 2.2321, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/gs/gs: 6.22% (1.8794 => 1.9963, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.18% (0.2040 => 0.2166, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.15% (0.1968 => 0.2089, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.14% (0.2068 => 0.2195, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 6.14% (0.6634 => 0.7041, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/bigfib: 6.11% (0.5012 => 0.5318, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.10% (0.2737 => 0.2904, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.06% (0.3084 => 0.3271, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 6.00% (0.5546 => 0.5879, std.dev.: 0.0027) MultiSource/Applications/lua/lua: 5.94% (1.4269 => 1.5117, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.93% (0.4658 => 0.4934, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 5.91% (4.6177 => 4.8907, std.dev.: 0.0044) MultiSource/Applications/minisat/minisat: 5.91% (0.3336 => 0.3533, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 5.79% (2.1653 => 2.2907, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.66% (0.3271 => 0.3456, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 5.61% (0.9697 => 1.0241, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 5.44% (2.0346 => 2.1452, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.42% (0.2103 => 0.2217, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 5.37% (0.7875 => 0.8298, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.23% (1.9694 => 2.0724, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.16% (1.9966 => 2.0997, std.dev.: 0.0029) MultiSource/Applications/SIBsim4/SIBsim4: 5.05% (0.2691 => 0.2827, std.dev.: 0.0023) MultiSource/Applications/lemon/lemon: 4.98% (0.2391 => 0.2510, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.61% (0.7426 => 0.7768, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.35% (0.5361 => 0.5594, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.19% (0.5584 => 0.5818, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 3.92% (0.3498 => 0.3635, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.91% (11.6398 => 12.0947, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.78% (4.6926 => 4.8700, std.dev.: 0.0024) MultiSource/Applications/kimwitu++/kc: 2.71% (11.9555 => 12.2798, std.dev.: 0.0098) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6099, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.24% (12.0509 => 12.6821, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-2: 4.93% (1.8057 => 1.8947, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1697, std.dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/dry: 4.24% (14.0481 => 14.6443, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary3: 2.10% (15.8721 => 16.2059, std.dev.: 0.0446) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5050, std.dev.: 0.0023) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.65% (3.1722 => 3.2246, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2872, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5970, std.dev.: 0.0170) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.93% (25.4195 => 16.5408, std.dev.: 0.0260) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9777, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8013, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: -6.16% (0.2402 => 0.2254, std.dev.: 0.0012) SingleSource/UnitTests/Vector/build2: -3.74% (11.2080 => 10.7883, std.dev.: 0.0128) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: -3.17% (17.2379 => 16.6922, std.dev.: 0.0728) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7732, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.27% (0.6293 => 0.6150, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8654, std.dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5751, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4976, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.19% (105.3826 => 104.1307, std.dev.: 0.0577) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0436, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 7 04:27:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 06:27:07 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121007112707.2C8CC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4670?compare_to=4666&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4670, Order: 165373, Start Time: 2012-10-07 10:06:17, End Time: 2012-10-07 11:28:54 To: 4666, Order: 165372, Start Time: 2012-10-07 08:22:06, End Time: 2012-10-07 09:45:40 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (14 on baseline) Performance Regressions: 7 (92 on baseline) Performance Improvements: 7 (45 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 963 (754 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 6.05% (8.3046 => 8.8074, std.dev.: 0.1172) MultiSource/Applications/spiff/spiff: 3.11% (0.7556 => 0.7791, std.dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 14.28% (3.1160 => 3.5611, std.dev.: 0.1626) SingleSource/Benchmarks/Shootout/heapsort: 8.59% (3.0554 => 3.3178, std.dev.: 0.1003) MultiSource/Benchmarks/nbench/nbench: 6.88% (22.9069 => 24.4825, std.dev.: 0.4729) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.56% (4.2621 => 4.3714, std.dev.: 0.0370) MultiSource/Applications/siod/siod: 1.15% (3.6303 => 3.6721, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.48% (1.0047 => 0.9898, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.24% (2.1240 => 2.0976, std.dev.: 0.0081) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -13.54% (14.7082 => 12.7174, std.dev.: 0.3236) SingleSource/Benchmarks/Misc-C++/stepanov_container: -2.77% (4.6009 => 4.4736, std.dev.: 0.0471) MultiSource/Applications/minisat/minisat: -2.16% (6.2964 => 6.1603, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/whetstone: -1.96% (2.4078 => 2.3605, std.dev.: 0.0133) MultiSource/Benchmarks/BitBench/five11/five11: -1.73% (5.2956 => 5.2042, std.dev.: 0.0242) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.87% (1.0209 => 1.0298, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 1.51% (0.6161 => 0.6254, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 0.16% (0.1837 => 0.1840, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.71% (0.1580 => 0.1607, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.89% (0.3144 => 0.3235, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.13% (0.2359 => 0.2362, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.34% (0.3254 => 0.3265, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.09% (0.2303 => 0.2328, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -14.94% (0.0462 => 0.0393, std.dev.: 0.0037) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.81% (0.0247 => 0.0245, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 23.38% (0.0154 => 0.0190, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.26% (0.0392 => 0.0393, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -12.54% (0.0279 => 0.0244, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.39% (0.0287 => 0.0291, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.61% (0.0327 => 0.0329, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: 1.65% (0.0182 => 0.0185, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 61.79% (0.0123 => 0.0199, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -0.78% (0.0255 => 0.0253, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -0.60% (0.0331 => 0.0329, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: - (0.1418 => 0.1418, std.dev.: 0.0047) MultiSource/Applications/lemon/lemon: -1.61% (1.4975 => 1.4734, std.dev.: 0.0172) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 6.07% (0.1467 => 0.1556, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.37% (0.4102 => 0.4087, std.dev.: 0.0173) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.69% (0.1452 => 0.1413, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.86% (0.0563 => 0.0596, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 14.15% (0.0205 => 0.0234, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.34% (0.0584 => 0.0582, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.83% (1.1345 => 1.1251, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -15.38% (0.0013 => 0.0011, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.53% (0.0571 => 0.0568, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.33% (0.0191 => 0.0177, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.42% (0.7683 => 0.7651, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.02% (1.7069 => 1.7066, std.dev.: 0.0006) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 128.30% (0.0053 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 143.82% (0.0089 => 0.0217, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: 176.67% (0.0090 => 0.0249, std.dev.: 0.0004) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -27.48% (4.1772 => 3.0291, std.dev.: 0.0208) SingleSource/Benchmarks/Shootout-C++/except: 82716.67% (0.0006 => 0.4969, std.dev.: 0.0010) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.62% (0.0745 => 0.0921, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.32% (0.1414 => 0.1574, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.49% (0.1159 => 0.1269, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 9.47% (0.5309 => 0.5812, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.24% (0.6410 => 0.7002, std.dev.: 0.0053) MultiSource/Benchmarks/PAQ8p/paq8p: 9.08% (2.1763 => 2.3739, std.dev.: 0.0150) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.12% (0.3582 => 0.3873, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 7.65% (0.6173 => 0.6645, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 6.84% (1.0046 => 1.0733, std.dev.: 0.0046) MultiSource/Applications/SIBsim4/SIBsim4: 6.64% (1.1653 => 1.2427, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.51% (1.5150 => 1.6137, std.dev.: 0.0070) MultiSource/Applications/kimwitu++/kc: 6.20% (15.3105 => 16.2596, std.dev.: 0.0395) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.15% (0.2797 => 0.2969, std.dev.: 0.0043) MultiSource/Applications/lambda-0_1_3/lambda: 6.13% (0.6915 => 0.7339, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.11% (0.2552 => 0.2708, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.00% (0.6069 => 0.6433, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.96% (0.7639 => 0.8094, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/18-imp/imp: 5.32% (0.3217 => 0.3388, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.01% (0.4248 => 0.4461, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.00% (1.1672 => 1.2256, std.dev.: 0.0065) MultiSource/Benchmarks/Bullet/bullet: 4.94% (29.3170 => 30.7655, std.dev.: 0.1463) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.90% (1.1827 => 1.2406, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.87% (0.3901 => 0.4091, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.85% (0.2886 => 0.3026, std.dev.: 0.0019) MultiSource/Applications/d/make_dparser: 4.77% (3.0225 => 3.1667, std.dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.75% (0.4880 => 0.5112, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.65% (0.3418 => 0.3577, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.64% (0.3062 => 0.3204, std.dev.: 0.0023) MultiSource/Applications/hbd/hbd: 4.47% (1.3268 => 1.3861, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.36% (1.4408 => 1.5036, std.dev.: 0.0041) MultiSource/Applications/SPASS/SPASS: 4.28% (13.3238 => 13.8946, std.dev.: 0.0223) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.27% (6.2546 => 6.5217, std.dev.: 0.0434) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.21% (0.8569 => 0.8930, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 4.20% (4.7455 => 4.9447, std.dev.: 0.0134) MultiSource/Benchmarks/mafft/pairlocalalign: 4.06% (8.2186 => 8.5519, std.dev.: 0.0577) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.03% (1.2021 => 1.2506, std.dev.: 0.0095) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.03% (0.2654 => 0.2761, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 3.95% (1.8798 => 1.9540, std.dev.: 0.0080) MultiSource/Applications/siod/siod: 3.93% (2.0972 => 2.1796, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: 3.87% (1.1440 => 1.1883, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.82% (3.0758 => 3.1932, std.dev.: 0.0102) MultiSource/Applications/lua/lua: 3.79% (3.5980 => 3.7343, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/football/football: 3.78% (0.8405 => 0.8723, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 3.61% (0.3847 => 0.3986, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.57% (0.5937 => 0.6149, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.38% (0.4562 => 0.4716, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.32% (0.3008 => 0.3108, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.24% (2.0317 => 2.0976, std.dev.: 0.0081) MultiSource/Benchmarks/MallocBench/gs/gs: 3.23% (3.8796 => 4.0049, std.dev.: 0.0159) MultiSource/Applications/JM/lencod/lencod: 3.09% (14.7256 => 15.1812, std.dev.: 0.0370) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.01% (12.6413 => 13.0214, std.dev.: 0.0633) MultiSource/Applications/JM/ldecod/ldecod: 3.00% (6.4908 => 6.6852, std.dev.: 0.0079) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.98% (4.3380 => 4.4671, std.dev.: 0.0168) MultiSource/Benchmarks/nbench/nbench: 2.97% (1.0821 => 1.1142, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.89% (4.2815 => 4.4051, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.75% (0.5636 => 0.5791, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.74% (4.0318 => 4.1424, std.dev.: 0.0163) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (4.2616 => 4.3776, std.dev.: 0.0146) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.61% (1.0689 => 1.0968, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.60% (1.3935 => 1.4297, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.56% (8.2559 => 8.4674, std.dev.: 0.0234) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.36% (0.9029 => 0.9242, std.dev.: 0.0077) MultiSource/Applications/hexxagon/hexxagon: 1.46% (0.9425 => 0.9563, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.40% (1.6538 => 2.3384, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2279, std.dev.: 0.0057) MultiSource/Benchmarks/nbench/nbench: 15.64% (21.1721 => 24.4825, std.dev.: 0.4729) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.75% (0.0766 => 0.0879, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/ary3: 14.57% (1.7426 => 1.9965, std.dev.: 0.0463) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.83% (4.0101 => 4.5647, std.dev.: 0.0042) SingleSource/Benchmarks/Stanford/Puzzle: 13.82% (0.1433 => 0.1631, std.dev.: 0.0029) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.16% (2.4042 => 2.7206, std.dev.: 0.0188) SingleSource/Benchmarks/McGill/queens: 10.82% (1.6261 => 1.8021, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/mason/mason: 9.89% (0.5004 => 0.5499, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.89% (0.2857 => 0.3111, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: 8.88% (7.0025 => 7.6246, std.dev.: 0.0258) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.93% (1.0063 => 1.0861, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.36% (0.3301 => 0.3478, std.dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: 5.06% (6.9722 => 7.3247, std.dev.: 0.0595) SingleSource/Benchmarks/Misc/fp-convert: 4.36% (15.2242 => 15.8880, std.dev.: 0.0206) SingleSource/Benchmarks/Misc/dt: 4.29% (0.9851 => 1.0274, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.89% (3.4080 => 3.5407, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.87% (40.4792 => 42.0463, std.dev.: 0.4523) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.76% (4.2129 => 4.3714, std.dev.: 0.0370) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.61% (0.8498 => 0.8805, std.dev.: 0.0073) MultiSource/Applications/siod/siod: 3.38% (3.5520 => 3.6721, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.95% (0.5587 => 0.5752, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.80% (6.6312 => 6.8172, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.74% (0.5876 => 0.6037, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 2.54% (0.6308 => 0.6468, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.28% (1.6110 => 1.6316, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.21% (4.6127 => 4.6686, std.dev.: 0.0154) MultiSource/Benchmarks/Olden/power/power: 1.17% (1.4184 => 1.4350, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -43.59% (0.2996 => 0.1690, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -42.98% (0.0591 => 0.0337, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.19% (1.4189 => 1.1466, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.76% (1.4113 => 1.1465, std.dev.: 0.0104) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.69% (0.3497 => 0.2039, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.65% (5.2665 => 4.1788, std.dev.: 0.0204) SingleSource/Benchmarks/Shootout-C++/ary3: -20.64% (1.7473 => 1.3866, std.dev.: 0.0422) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.67% (15.8312 => 12.7174, std.dev.: 0.3236) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.38% (1.7361 => 1.4691, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1580, std.dev.: 0.0430) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.44% (1.1647 => 1.0548, std.dev.: 0.0305) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.56% (1.4034 => 1.2832, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.48% (3.2007 => 2.9292, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/flops: -8.31% (9.5474 => 8.7539, std.dev.: 0.0135) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.83% (3.6254 => 3.3778, std.dev.: 0.0133) MultiSource/Applications/lambda-0_1_3/lambda: -6.75% (7.6833 => 7.1645, std.dev.: 0.0344) SingleSource/Benchmarks/Shootout-C++/fibo: -6.65% (4.6355 => 4.3271, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.05% (2.9728 => 2.7929, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -5.93% (1.4441 => 1.3585, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.46% (3.9413 => 3.7261, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/fib2: -5.26% (4.4195 => 4.1870, std.dev.: 0.0413) MultiSource/Benchmarks/Olden/bh/bh: -4.94% (2.5166 => 2.3922, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.45% (45.4683 => 43.4470, std.dev.: 0.3980) MultiSource/Benchmarks/mafft/pairlocalalign: -4.25% (62.4126 => 59.7570, std.dev.: 0.1793) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.21% (0.4564 => 0.4372, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -3.98% (0.3746 => 0.3597, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/misr: -3.54% (0.4296 => 0.4144, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.51% (1.2722 => 1.2276, std.dev.: 0.0150) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.43% (1.1683 => 1.1282, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/methcall: -3.35% (9.2503 => 8.9400, std.dev.: 0.0372) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.78% (0.4140 => 0.4025, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.46% (3.7496 => 3.6575, std.dev.: 0.0112) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.30% (2.4457 => 2.3895, std.dev.: 0.0037) MultiSource/Applications/SIBsim4/SIBsim4: -2.28% (3.4230 => 3.3450, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.23% (2.3569 => 2.3043, std.dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/dry: -2.19% (2.4013 => 2.3486, std.dev.: 0.0141) MultiSource/Benchmarks/FreeBench/neural/neural: -2.04% (1.0926 => 1.0703, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash2: -1.89% (3.4876 => 3.4216, std.dev.: 0.0100) MultiSource/Applications/aha/aha: -1.88% (3.4286 => 3.3643, std.dev.: 0.0085) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.67% (9.3855 => 9.2290, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -1.42% (6.7458 => 6.6502, std.dev.: 0.0306) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3106, std.dev.: 0.0200) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.31% (27.1724 => 26.8163, std.dev.: 0.0086) MultiSource/Applications/minisat/minisat: -1.03% (6.2244 => 6.1603, std.dev.: 0.0042) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 3.19% (0.9980 => 1.0298, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 3.85% (0.6022 => 0.6254, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 10.44% (0.1666 => 0.1840, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.41% (0.1554 => 0.1607, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.93% (0.3083 => 0.3235, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.34% (0.2394 => 0.2362, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.83% (0.3175 => 0.3265, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.13% (0.2302 => 0.2328, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -12.47% (0.0449 => 0.0393, std.dev.: 0.0037) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.08% (0.0240 => 0.0245, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.04% (0.0192 => 0.0190, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.77% (0.0390 => 0.0393, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -18.94% (0.0301 => 0.0244, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.46% (0.0284 => 0.0291, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.54% (0.0324 => 0.0329, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: 4.52% (0.0177 => 0.0185, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 5.29% (0.0189 => 0.0199, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: 1.61% (0.0249 => 0.0253, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 1.23% (0.0325 => 0.0329, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.77% (0.1429 => 0.1418, std.dev.: 0.0047) MultiSource/Applications/lemon/lemon: -1.90% (1.5019 => 1.4734, std.dev.: 0.0172) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.66% (0.1501 => 0.1556, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.15% (0.4264 => 0.4087, std.dev.: 0.0173) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.13% (0.1344 => 0.1413, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.19% (0.0589 => 0.0596, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.86% (0.0232 => 0.0234, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.92% (0.0639 => 0.0582, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.87% (1.1350 => 1.1251, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 83.33% (0.0006 => 0.0011, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.83% (0.0637 => 0.0568, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.05% (0.0246 => 0.0177, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.46% (0.7541 => 0.7651, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.09% (1.5363 => 1.7066, std.dev.: 0.0006) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) Report Time: 1.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 7 04:28:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 06:28:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121007112807.4B7902A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4671?compare_to=4667&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4671, Order: 165373, Start Time: 2012-10-07 10:15:10, End Time: 2012-10-07 11:29:52 To: 4667, Order: 165372, Start Time: 2012-10-07 08:31:23, End Time: 2012-10-07 09:46:08 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (183 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1042 (754 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 22.07% (2.0176 => 2.4628, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.87% (0.1410 => 0.1662, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 15.98% (0.0826 => 0.0958, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 14.98% (0.2243 => 0.2579, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.15% (0.1072 => 0.1213, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.95% (0.0834 => 0.0942, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 12.64% (0.1013 => 0.1141, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 12.41% (0.4328 => 0.4865, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.24% (0.1413 => 0.1586, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.11% (0.7710 => 0.8644, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.77% (3.9660 => 4.4326, std.dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: 11.74% (0.7038 => 0.7864, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 11.71% (0.5818 => 0.6499, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.62% (0.0964 => 0.1076, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.61% (0.1327 => 0.1481, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.58% (0.2721 => 0.3036, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.52% (0.1588 => 0.1771, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 11.47% (0.4062 => 0.4528, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 11.47% (1.3693 => 1.5263, std.dev.: 0.0072) SingleSource/UnitTests/ObjC++/property-reference: 11.43% (0.7061 => 0.7868, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/Hello: 11.41% (0.5748 => 0.6404, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.33% (0.2596 => 0.2890, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.23% (1.4563 => 1.6199, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.22% (0.6283 => 0.6988, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.18% (1.2193 => 1.3556, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 11.15% (0.2781 => 0.3091, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.11% (0.9199 => 1.0221, std.dev.: 0.0032) MultiSource/Applications/aha/aha: 11.02% (0.1062 => 0.1179, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.00% (0.5265 => 0.5844, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.96% (0.6959 => 0.7722, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.96% (0.2782 => 0.3087, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.88% (0.3485 => 0.3864, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.82% (0.3899 => 0.4321, std.dev.: 0.0069) MultiSource/Applications/SPASS/SPASS: 10.60% (13.8202 => 15.2848, std.dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.56% (0.3022 => 0.3341, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.53% (0.4016 => 0.4439, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.52% (0.3756 => 0.4151, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 10.51% (0.2607 => 0.2881, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 10.51% (0.3293 => 0.3639, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.51% (1.1364 => 1.2558, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 10.49% (0.2726 => 0.3012, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 10.48% (0.2690 => 0.2972, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 10.43% (0.2760 => 0.3048, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 10.42% (0.2937 => 0.3243, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.42% (0.2966 => 0.3275, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.40% (0.3489 => 0.3852, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 10.36% (0.2761 => 0.3047, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.36% (0.2655 => 0.2930, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 10.35% (0.2628 => 0.2900, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 10.34% (0.3453 => 0.3810, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/moments: 10.32% (0.3868 => 0.4267, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.29% (1.9828 => 2.1869, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/power/power: 10.27% (0.1003 => 0.1106, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 10.23% (0.3149 => 0.3471, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.22% (0.3580 => 0.3946, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.20% (0.2765 => 0.3047, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 10.14% (0.3107 => 0.3422, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.11% (0.1157 => 0.1274, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 10.03% (0.3192 => 0.3512, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 10.01% (0.2988 => 0.3287, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.98% (0.4791 => 0.5269, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.95% (0.1075 => 0.1182, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 9.95% (0.2995 => 0.3293, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.89% (0.4379 => 0.4812, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.88% (0.5577 => 0.6128, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.84% (0.4390 => 0.4822, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.83% (0.2696 => 0.2961, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 9.81% (16.6129 => 18.2431, std.dev.: 0.0148) MultiSource/Applications/lemon/lemon: 9.79% (1.0313 => 1.1323, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.78% (0.3130 => 0.3436, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 9.76% (0.3534 => 0.3879, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.73% (0.1048 => 0.1150, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 9.63% (0.1589 => 0.1742, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.62% (0.1986 => 0.2177, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.55% (0.1435 => 0.1572, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 9.53% (1.1061 => 1.2115, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.47% (0.2914 => 0.3190, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.43% (0.3246 => 0.3552, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.40% (0.1276 => 0.1396, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.40% (0.2127 => 0.2327, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 9.27% (0.1111 => 0.1214, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.26% (0.8698 => 0.9503, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 9.20% (0.2945 => 0.3216, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.19% (0.5637 => 0.6155, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 9.18% (0.6744 => 0.7363, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 9.16% (0.3220 => 0.3515, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.14% (0.7460 => 0.8142, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/gs/gs: 9.12% (3.8646 => 4.2172, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.08% (0.6576 => 0.7173, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 9.07% (0.8310 => 0.9064, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 8.98% (0.7506 => 0.8180, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.97% (7.2180 => 7.8655, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.95% (0.1865 => 0.2032, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.89% (0.3755 => 0.4089, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.80% (0.2023 => 0.2201, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 8.77% (2.1791 => 2.3702, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 8.76% (1.9270 => 2.0958, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 8.65% (3.1889 => 3.4648, std.dev.: 0.0056) MultiSource/Benchmarks/nbench/nbench: 8.57% (1.0594 => 1.1502, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 8.53% (0.1478 => 0.1604, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 8.44% (0.2925 => 0.3172, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 8.39% (0.1657 => 0.1796, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.35% (0.1569 => 0.1700, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.31% (0.8818 => 0.9551, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 8.18% (0.3131 => 0.3387, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 8.16% (1.2749 => 1.3789, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.15% (1.3245 => 1.4325, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.13% (3.6692 => 3.9674, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 8.09% (14.8535 => 16.0545, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.05% (0.1789 => 0.1933, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 8.03% (8.4961 => 9.1787, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.02% (4.3801 => 4.7312, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.92% (4.4433 => 4.7954, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/05-eks/eks: 7.88% (0.4113 => 0.4437, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.86% (0.6135 => 0.6617, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.71% (0.2140 => 0.2305, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.69% (0.4003 => 0.4311, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions: 7.56% (0.3914 => 0.4210, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.49% (4.9865 => 5.3600, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/trivial-interface: 7.49% (0.3578 => 0.3846, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 7.44% (1.2292 => 1.3206, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 7.39% (4.6629 => 5.0075, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 7.36% (0.3789 => 0.4068, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.36% (0.3940 => 0.4230, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.36% (0.3601 => 0.3866, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 7.33% (0.6250 => 0.6708, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-4: 7.32% (0.3646 => 0.3913, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.29% (0.3511 => 0.3767, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.29% (0.3623 => 0.3887, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.27% (0.2504 => 0.2686, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/synchronized: 7.23% (0.3663 => 0.3928, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.23% (0.3650 => 0.3914, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.22% (0.4805 => 0.5152, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.20% (1.5188 => 1.6281, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.18% (0.9108 => 0.9762, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.02% (1.1333 => 1.2129, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.02% (3.2742 => 3.5039, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.84% (0.3245 => 0.3467) SingleSource/Benchmarks/Misc/oourafft: 6.77% (0.2008 => 0.2144, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 6.64% (6.5754 => 7.0118, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.39% (6.2785 => 6.6799, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.33% (0.2321 => 0.2468, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 6.32% (3.7467 => 3.9836, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.24% (2.1007 => 2.2317, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.16% (0.1819 => 0.1931, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.48% (13.2842 => 14.0126, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.73% (0.2243 => 0.2349, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 3.77% (16.2614 => 16.8742, std.dev.: 0.0067) MultiSource/Applications/ClamAV/clamscan: 3.70% (14.5298 => 15.0672, std.dev.: 0.0042) MultiSource/Benchmarks/Bullet/bullet: 1.34% (33.2944 => 33.7393, std.dev.: 0.0112) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5185, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 23.95% (1.8175 => 2.2528, std.dev.: 0.0371) SingleSource/Benchmarks/Misc/richards_benchmark: 11.19% (1.1560 => 1.2854, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 9.04% (0.8273 => 0.9021, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4144, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.15% (1.2998 => 1.3797, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0005, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0047, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.67% (11.2619 => 11.6753, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 3.51% (10.7476 => 11.1253, std.dev.: 0.0619) SingleSource/Benchmarks/Misc/flops-6: 3.46% (1.9199 => 1.9864, std.dev.: 0.0007) SingleSource/Regression/C/uint64_to_float: 2.97% (0.5449 => 0.5611, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.28% (7.4271 => 7.5963, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.61% (1.4298 => 1.4528, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5144, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2126, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1869, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 1.18% (12.4560 => 12.6026, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5778, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0265, std.dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.12% (0.2670 => 0.1412) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.78% (0.4657 => 0.3922, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -15.42% (0.0707 => 0.0598, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.84% (1.3819 => 1.1906, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.84% (1.3813 => 1.1901, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.98% (22.5627 => 21.8900, std.dev.: 0.0081) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.02% (0.2238 => 0.1969, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.86% (1.2308 => 1.0971, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.02% (20.3410 => 18.3019, std.dev.: 0.0197) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.38% (1.3780 => 1.3039, std.dev.: 0.0076) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0019) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.67% (0.9996 => 0.9529, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.56% (3.2729 => 3.1564, std.dev.: 0.0210) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.46% (1.7688 => 1.7076, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.94% (0.4867 => 0.4724, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.45% (26.5159 => 25.8672, std.dev.: 0.0153) MultiSource/Applications/spiff/spiff: -2.44% (3.0263 => 2.9524, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: -2.37% (1.9762 => 1.9293, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.79% (28.2225 => 27.7161, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.69% (6.3560 => 6.2483, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.56% (0.6615 => 0.6512, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0064, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -1.25% (4.5928 => 4.5353, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.15% (2.5254 => 2.4964, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2580, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: -1.07% (9.3358 => 9.2362, std.dev.: 0.0170) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 7 04:57:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 06:57:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121007115721.1ED2D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4672?compare_to=4668&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4672, Order: 165373, Start Time: 2012-10-07 10:39:46, End Time: 2012-10-07 11:59:07 To: 4668, Order: 165372, Start Time: 2012-10-07 08:51:01, End Time: 2012-10-07 10:10:25 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (153 on baseline) Performance Improvements: 3 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1020 (764 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.57% (15.1785 => 15.4171, std.dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.13% (1.0858 => 1.0981, std.dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.39% (8.2130 => 8.0987, std.dev.: 0.0052) MultiSource/Applications/JM/ldecod/ldecod: -1.30% (11.5111 => 11.3615, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.55% (1.3066 => 1.2864, std.dev.: 0.0072) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.09% (0.5879 => 0.5874, std.dev.: 0.0037) MultiSource/Applications/SPASS/SPASS: -0.10% (16.2393 => 16.2233, std.dev.: 0.0112) MultiSource/Benchmarks/Bullet/bullet: -0.15% (54.9632 => 54.8811, std.dev.: 0.0076) MultiSource/Benchmarks/MallocBench/gs/gs: 0.17% (4.3827 => 4.3901, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.04% (1.2478 => 1.2473, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.10% (7.7599 => 7.7675, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.03% (0.7393 => 0.7391, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -2.18% (0.0367 => 0.0359, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.23% (0.2184 => 0.2189, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -13.22% (63.2438 => 54.8811, std.dev.: 0.0076) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.40% (14.1553 => 18.7413, std.dev.: 0.0258) SingleSource/Benchmarks/Misc-C++-EH/spirit: 61.05% (3.4629 => 5.5771, std.dev.: 0.0102) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14224.86% (0.0720 => 10.3139, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9951900.00% (0.0001 => 9.9520, std.dev.: 0.0006) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 51.41% (0.2554 => 0.3867, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 48.71% (10.3673 => 15.4171, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/richards_benchmark: 30.95% (0.1622 => 0.2124, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/distray/distray: 30.78% (0.1056 => 0.1381, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.45% (2.2022 => 2.5424, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 15.36% (0.1432 => 0.1652, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.81% (7.0540 => 8.0987, std.dev.: 0.0052) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.50% (0.1566 => 0.1793, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.48% (1.7609 => 1.9807, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.17% (0.0871 => 0.0977, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 11.76% (0.3282 => 0.3668, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.86% (0.1584 => 0.1756, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.31% (0.3473 => 0.3831, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.19% (0.3561 => 0.3924, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.18% (0.3516 => 0.3874, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.16% (0.3543 => 0.3903, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.16% (0.3543 => 0.3903, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-2: 10.15% (0.3497 => 0.3852, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.95% (0.3828 => 0.4209, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 9.93% (0.1440 => 0.1583, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.91% (0.3694 => 0.4060, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.88% (0.3927 => 0.4315, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.73% (0.3886 => 0.4264, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.39% (0.1438 => 0.1573, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.39% (0.4879 => 0.5337, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.15% (0.6675 => 0.7286, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 9.10% (9.4845 => 10.3472, std.dev.: 0.0140) SingleSource/Benchmarks/McGill/chomp: 9.06% (0.1655 => 0.1805, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 9.01% (0.7433 => 0.8103, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 8.97% (0.7115 => 0.7753, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.88% (0.3177 => 0.3459, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 8.87% (10.4361 => 11.3615, std.dev.: 0.0057) MultiSource/Applications/sgefa/sgefa: 8.75% (0.3109 => 0.3381, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 8.73% (0.1695 => 0.1843, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.61% (1.5415 => 1.6743, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.56% (0.4615 => 0.5010, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 8.52% (0.5925 => 0.6430, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.44% (0.6030 => 0.6539, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.43% (0.1625 => 0.1762, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 8.33% (5.7591 => 6.2387, std.dev.: 0.0159) MultiSource/Benchmarks/McCat/18-imp/imp: 8.33% (0.3423 => 0.3708, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.31% (0.5105 => 0.5529, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.30% (0.8172 => 0.8850, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 8.23% (3.3354 => 3.6098, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.21% (1.3050 => 1.4122, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.07% (0.5860 => 0.6333, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.01% (0.1510 => 0.1631, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.97% (0.2271 => 0.2452, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.96% (4.2646 => 4.6041, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 7.79% (0.7326 => 0.7897, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.77% (0.8067 => 0.8694, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.75% (0.2065 => 0.2225, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.74% (0.2700 => 0.2909, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.74% (0.2107 => 0.2270, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.71% (0.9765 => 1.0518, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.70% (0.5569 => 0.5998, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.68% (0.3307 => 0.3561, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 7.63% (0.3422 => 0.3683, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.59% (0.3121 => 0.3358, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.58% (5.0018 => 5.3808, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.58% (8.1363 => 8.7527, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: 7.57% (0.6456 => 0.6945, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.57% (4.9449 => 5.3191, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.54% (0.2758 => 0.2966, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash: 7.48% (0.4289 => 0.4610, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.41% (0.5020 => 0.5392, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 7.40% (3.8723 => 4.1589, std.dev.: 0.0038) MultiSource/Applications/spiff/spiff: 7.39% (0.7835 => 0.8414, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.38% (0.4103 => 0.4406, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 7.32% (0.3387 => 0.3635, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 7.31% (1.1642 => 1.2493, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.30% (0.4203 => 0.4510) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.27% (0.1940 => 0.2081, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 7.19% (0.2905 => 0.3114, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.10% (0.3650 => 0.3909, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.09% (1.5603 => 1.6709, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 7.07% (0.1555 => 0.1665, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.04% (7.9617 => 8.5222, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.01% (0.3865 => 0.4136, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 6.99% (0.4048 => 0.4331, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.95% (0.2891 => 0.3092, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 6.95% (1.0722 => 1.1467, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.92% (0.2831 => 0.3027, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.83% (0.3441 => 0.3676, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.80% (0.4620 => 0.4934, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.80% (0.3826 => 0.4086, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.79% (0.3684 => 0.3934, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.76% (0.3136 => 0.3348, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 6.76% (2.0273 => 2.1643, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 6.74% (0.3603 => 0.3846, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.72% (0.2603 => 0.2778, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 6.70% (0.3283 => 0.3503, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.68% (0.3098 => 0.3305, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.68% (2.0665 => 2.2045, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.65% (0.3232 => 0.3447, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.61% (0.3162 => 0.3371, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.60% (0.4636 => 0.4942, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: 6.58% (0.2871 => 0.3060, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.55% (0.3052 => 0.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.53% (1.5859 => 1.6894, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.51% (0.2872 => 0.3059, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.42% (1.1861 => 1.2622, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/09-vor/vor: 6.42% (0.3180 => 0.3384, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.41% (0.2793 => 0.2972, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.39% (0.2725 => 0.2899, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.36% (0.2877 => 0.3060, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.35% (0.2756 => 0.2931, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.33% (0.6450 => 0.6858, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 6.26% (0.4299 => 0.4568, std.dev.: 0.0038) MultiSource/Applications/siod/siod: 6.26% (2.2969 => 2.4406, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 6.23% (0.8921 => 0.9477, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.21% (0.2802 => 0.2976, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.19% (0.2714 => 0.2882, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.14% (0.5981 => 0.6348, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 6.04% (0.3379 => 0.3583, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 6.00% (21.9371 => 23.2538, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.80% (2.2024 => 2.3301, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.71% (0.1892 => 0.2000, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.61% (0.4064 => 0.4292, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.51% (0.1906 => 0.2011, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.48% (1.4186 => 1.4963, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 5.30% (1.1840 => 1.2468, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.03% (0.2266 => 0.2380, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 4.69% (0.3131 => 0.3278, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.67% (1.2842 => 1.3442, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.35% (0.8101 => 0.8453, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.94% (0.3427 => 0.3562, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.70% (14.3668 => 14.8983, std.dev.: 0.0078) MultiSource/Applications/sqlite3/sqlite3: 3.36% (17.1811 => 17.7585, std.dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.87% (3.8922 => 4.0038, std.dev.: 0.0199) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.65% (0.3817 => 0.3918, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.62% (1.1194 => 1.1487, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.25% (1.1145 => 1.3848, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.80% (1.1396 => 1.2513, std.dev.: 0.0014) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4498, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.70% (3.1578 => 3.3693, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.55% (3.6395 => 3.7688, std.dev.: 0.0043) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.78% (4.2280 => 4.3456, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7650, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.55% (0.8275 => 0.8403, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8133, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.24% (2.6546 => 2.6875, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1293, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.93% (5.2763 => 3.2749, std.dev.: 0.0173) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.68% (5.3855 => 3.6257, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.23% (5.3526 => 3.6274, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -14.48% (54.1659 => 46.3238, std.dev.: 0.0181) MultiSource/Benchmarks/FreeBench/mason/mason: -13.19% (0.0811 => 0.0704, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -11.21% (22.1758 => 19.6896, std.dev.: 0.0155) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.54% (2.9384 => 2.6288, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.39% (1.1492 => 0.7655, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: -15.98% (1.6925 => 1.4221, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.53% (0.0998 => 0.0863, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.25% (1.2373 => 1.0981, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -10.23% (1.5373 => 1.3801, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -10.04% (0.2161 => 0.1944, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.48% (19.9488 => 18.2564, std.dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4787, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.63% (1.8329 => 1.7113, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.22% (1.6805 => 1.5927, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7962, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908) SingleSource/Benchmarks/Misc/flops-5: -4.45% (1.5835 => 1.5131, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.87% (0.9957 => 0.9572, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.58% (3.2827 => 3.1651, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5032, std.dev.: 0.0065) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0994, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.10% (0.4808 => 0.4707, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.97% (8.6802 => 8.5093, std.dev.: 0.0110) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.93% (8.1563 => 7.9985, std.dev.: 0.0178) SingleSource/Benchmarks/Misc/salsa20: -1.85% (10.2830 => 10.0924, std.dev.: 0.0230) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6819, std.dev.: 0.0014) SingleSource/UnitTests/Vector/multiplies: -1.50% (2.5528 => 2.5145, std.dev.: 0.0043) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4207, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8561, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.34% (0.5229 => 0.5874, std.dev.: 0.0037) MultiSource/Applications/SPASS/SPASS: 8.23% (14.9895 => 16.2233, std.dev.: 0.0112) MultiSource/Benchmarks/MallocBench/gs/gs: 6.80% (4.1105 => 4.3901, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.90% (1.1048 => 1.2473, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.51% (7.1582 => 7.7675, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.79% (0.6222 => 0.7391, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35800.00% (0.0001 => 0.0359, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.45% (0.2116 => 0.2189, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 7 06:30:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 08:30:17 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121007133017.214012A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4673?compare_to=4670&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4673, Order: 165374, Start Time: 2012-10-07 12:09:09, End Time: 2012-10-07 13:32:03 To: 4670, Order: 165373, Start Time: 2012-10-07 10:06:17, End Time: 2012-10-07 11:28:54 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (14 on baseline) Performance Regressions: 7 (91 on baseline) Performance Improvements: 1 (45 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 969 (755 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.53% (0.8694 => 0.8827, std.dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.51% (12.7174 => 14.3082, std.dev.: 0.1355) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.24% (3.0484 => 3.3607, std.dev.: 0.0910) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.65% (58.4467 => 60.5783, std.dev.: 0.5557) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 2.49% (0.7757 => 0.7950, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.53% (1.1282 => 1.1455, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/ary3: 1.14% (1.9965 => 2.0192, std.dev.: 0.0086) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -13.92% (24.4825 => 21.0752, std.dev.: 0.7127) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.46% (1.0298 => 1.0251, std.dev.: 0.0247) MultiSource/Applications/sqlite3/sqlite3: -0.61% (0.6254 => 0.6216, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/08-main/main: -0.65% (0.1840 => 0.1828, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.55% (0.1607 => 0.1566, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.25% (0.3235 => 0.3227, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.45% (0.2362 => 0.2467, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.44% (0.3265 => 0.3218, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.13% (0.2328 => 0.2325, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel: 18.58% (0.0393 => 0.0466, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.22% (0.0245 => 0.0248, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 4.21% (0.0190 => 0.0198, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.02% (0.0393 => 0.0397, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 25.82% (0.0244 => 0.0307, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.34% (0.0291 => 0.0292, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 2.13% (0.0329 => 0.0336, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 2.16% (0.0185 => 0.0189) SingleSource/UnitTests/Vector/Altivec/test1: 1.51% (0.0199 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 3.56% (0.0253 => 0.0262, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 0.91% (0.0329 => 0.0332, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 100.00% (0.0005 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: - (0.1418 => 0.1418, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 5.00% (1.4734 => 1.5470, std.dev.: 0.0200) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -4.69% (0.1556 => 0.1483, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.83% (0.4087 => 0.4053, std.dev.: 0.0234) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.41% (0.1413 => 0.1447, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.51% (0.0596 => 0.0605, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -17.95% (0.0234 => 0.0192, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.89% (0.0582 => 0.0657, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.21% (1.1251 => 1.1275, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 145.45% (0.0011 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 380.00% (0.0005 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.76% (0.0568 => 0.0578, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 37.85% (0.0177 => 0.0244, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.10% (0.7651 => 0.7659, std.dev.: 0.0117) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 0.11% (1.7066 => 1.7085, std.dev.: 0.0120) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 151.69% (0.0089 => 0.0224, std.dev.: 0.0003) SingleSource/UnitTests/2003-08-11-VaListArg: 167.78% (0.0090 => 0.0241, std.dev.: 0.0012) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -27.33% (4.1772 => 3.0356, std.dev.: 0.0525) SingleSource/Benchmarks/Shootout-C++/except: 82183.33% (0.0006 => 0.4937, std.dev.: 0.0018) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.76% (0.0745 => 0.0922, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.01% (0.1159 => 0.1275, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 9.25% (2.1763 => 2.3775, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.94% (0.6410 => 0.6983, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/bigfib: 8.85% (0.5309 => 0.5779, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.07% (0.3582 => 0.3871, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 7.84% (0.6173 => 0.6657, std.dev.: 0.0054) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.71% (0.1414 => 0.1523, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/18-imp/imp: 7.12% (0.3217 => 0.3446, std.dev.: 0.0076) MultiSource/Applications/SIBsim4/SIBsim4: 6.91% (1.1653 => 1.2458, std.dev.: 0.0042) MultiSource/Applications/lemon/lemon: 6.52% (1.0046 => 1.0701, std.dev.: 0.0037) MultiSource/Applications/kimwitu++/kc: 6.21% (15.3105 => 16.2610, std.dev.: 0.2910) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.17% (1.5150 => 1.6084, std.dev.: 0.0280) MultiSource/Applications/lambda-0_1_3/lambda: 5.77% (0.6915 => 0.7314, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.72% (0.7639 => 0.8076, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.67% (0.6069 => 0.6413, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.60% (0.2552 => 0.2695, std.dev.: 0.0025) MultiSource/Applications/d/make_dparser: 5.60% (3.0225 => 3.1917, std.dev.: 0.0194) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.40% (1.1672 => 1.2302, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/oourafft: 5.28% (0.1971 => 0.2075, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.16% (0.4248 => 0.4467, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 5.13% (1.1440 => 1.2027, std.dev.: 0.0078) MultiSource/Applications/sgefa/sgefa: 4.90% (0.2877 => 0.3018, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 4.87% (29.3170 => 30.7447, std.dev.: 0.2796) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.77% (0.7722 => 0.8090, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.71% (0.4880 => 0.5110, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.69% (0.3901 => 0.4084, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.68% (0.2797 => 0.2928, std.dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 4.68% (4.7455 => 4.9677, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.67% (0.3062 => 0.3205, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 4.62% (13.3238 => 13.9398, std.dev.: 0.0325) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.61% (1.1827 => 1.2372, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/hash: 4.60% (0.3520 => 0.3682, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.60% (0.8569 => 0.8963, std.dev.: 0.0120) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.55% (6.2546 => 6.5391, std.dev.: 0.0238) MultiSource/Benchmarks/Prolangs-C/football/football: 4.34% (0.8405 => 0.8770, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 4.23% (8.2186 => 8.5666, std.dev.: 0.1011) MultiSource/Applications/siod/siod: 4.19% (2.0972 => 2.1851, std.dev.: 0.0142) MultiSource/Applications/treecc/treecc: 4.06% (1.8798 => 1.9561, std.dev.: 0.0022) MultiSource/Applications/hbd/hbd: 4.03% (1.3268 => 1.3803, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.03% (0.2654 => 0.2761, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.01% (1.4408 => 1.4986, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.01% (1.2021 => 1.2503, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/09-vor/vor: 4.00% (0.3026 => 0.3147, std.dev.: 0.0037) MultiSource/Benchmarks/sim/sim: 3.89% (0.3084 => 0.3204, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.75% (3.0758 => 3.1910, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/hash2: 3.61% (0.3847 => 0.3986, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.60% (0.5636 => 0.5839, std.dev.: 0.0044) MultiSource/Applications/lua/lua: 3.56% (3.5980 => 3.7262, std.dev.: 0.0372) MultiSource/Applications/JM/lencod/lencod: 3.38% (14.7256 => 15.2240, std.dev.: 0.0196) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.36% (2.0317 => 2.1000, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.31% (0.3418 => 0.3531, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.12% (0.5937 => 0.6122, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.09% (0.7226 => 0.7449, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.98% (0.9029 => 0.9298, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.97% (12.6413 => 13.0170, std.dev.: 0.0794) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.94% (4.0318 => 4.1505, std.dev.: 0.0190) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.88% (0.5963 => 0.6135, std.dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: 2.81% (6.4908 => 6.6733, std.dev.: 0.0105) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.76% (4.3380 => 4.4576, std.dev.: 0.0210) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.74% (8.2559 => 8.4819, std.dev.: 0.0470) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.68% (4.2815 => 4.3962, std.dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.34% (1.2742 => 1.3040, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.95% (1.3935 => 1.4207, std.dev.: 0.0078) MultiSource/Applications/hexxagon/hexxagon: 1.43% (0.9425 => 0.9560, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 57.09% (0.0261 => 0.0410, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/pi: 41.43% (1.6538 => 2.3389, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 23.11% (0.0766 => 0.0943, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 22.12% (3.4629 => 4.2288, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout/ary3: 15.87% (1.7426 => 2.0192, std.dev.: 0.0086) SingleSource/Benchmarks/Stanford/Puzzle: 13.82% (0.1433 => 0.1631, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.78% (4.0101 => 4.5626, std.dev.: 0.0112) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.79% (2.4042 => 2.7116, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/heapsort: 11.08% (3.0256 => 3.3607, std.dev.: 0.0910) SingleSource/Benchmarks/McGill/queens: 10.61% (1.6261 => 1.7986, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout/lists: 9.24% (7.0025 => 7.6498, std.dev.: 0.0352) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.82% (0.2857 => 0.3109, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/mason/mason: 8.69% (0.5004 => 0.5439, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.63% (1.0063 => 1.0931, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.57% (0.3301 => 0.3485, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.48% (0.7609 => 0.7950, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/dt: 4.11% (0.9851 => 1.0256, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5414, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: 3.89% (15.2242 => 15.8167, std.dev.: 0.0554) MultiSource/Applications/siod/siod: 3.66% (3.5520 => 3.6819, std.dev.: 0.0212) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.91% (6.6312 => 6.8239, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.88% (0.5587 => 0.5748, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.51% (4.6127 => 4.7286, std.dev.: 0.0357) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.05% (2.6656 => 2.7202, std.dev.: 0.0172) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.31% (1.2726 => 1.2893, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: 1.31% (1.4184 => 1.4370, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -43.99% (0.0591 => 0.0331, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -43.76% (0.2996 => 0.1685, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.70% (1.4189 => 1.1535, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.01% (1.4113 => 1.1571, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.23% (0.3497 => 0.2125, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.24% (5.2665 => 4.1480, std.dev.: 0.1408) SingleSource/Benchmarks/Shootout-C++/ary3: -19.04% (1.7473 => 1.4147, std.dev.: 0.0109) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.07% (1.7361 => 1.4744, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1578, std.dev.: 0.0136) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.62% (15.8312 => 14.3082, std.dev.: 0.1355) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.56% (1.1647 => 1.0533, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/moments: -9.16% (0.1114 => 0.1012, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: -8.32% (9.5474 => 8.7526, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.27% (1.4034 => 1.2874, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.43% (3.2007 => 2.9628, std.dev.: 0.0734) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.77% (3.6254 => 3.3801, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: -6.74% (7.6833 => 7.1651, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/fibo: -6.56% (4.6355 => 4.3315, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/richards_benchmark: -6.23% (1.4441 => 1.3541, std.dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.07% (2.9728 => 2.7924, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.46% (3.9413 => 3.7262, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -5.36% (1.4021 => 1.3269, std.dev.: 0.0229) MultiSource/Benchmarks/Olden/bh/bh: -5.05% (2.5166 => 2.3895, std.dev.: 0.0163) SingleSource/Benchmarks/Shootout/fib2: -4.86% (4.4195 => 4.2045, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.78% (0.4564 => 0.4346, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: -4.23% (62.4126 => 59.7718, std.dev.: 0.1280) MultiSource/Applications/sgefa/sgefa: -3.98% (0.3746 => 0.3597, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: -3.59% (9.2503 => 8.9184, std.dev.: 0.0940) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.90% (3.7496 => 3.6407, std.dev.: 0.0111) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.71% (2.4457 => 2.3794, std.dev.: 0.0122) SingleSource/Benchmarks/McGill/misr: -2.42% (0.4296 => 0.4192, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -2.21% (92.7467 => 90.6953, std.dev.: 0.5884) SingleSource/Benchmarks/Dhrystone/dry: -2.18% (2.4013 => 2.3490, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/hash2: -1.97% (3.4876 => 3.4188, std.dev.: 0.0095) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.95% (1.1683 => 1.1455, std.dev.: 0.0015) MultiSource/Applications/aha/aha: -1.94% (3.4286 => 3.3622, std.dev.: 0.0064) MultiSource/Applications/SIBsim4/SIBsim4: -1.90% (3.4230 => 3.3578, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.87% (2.3569 => 2.3129, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.74% (1.8739 => 1.8413, std.dev.: 0.0091) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.65% (9.3855 => 9.2303, std.dev.: 0.0351) MultiSource/Benchmarks/FreeBench/neural/neural: -1.59% (1.0926 => 1.0752, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.56% (1.0686 => 1.0519, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.30% (27.1724 => 26.8194, std.dev.: 0.1090) SingleSource/Benchmarks/Shootout-C++/lists: -1.21% (16.5617 => 16.3618, std.dev.: 0.0554) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.17% (25.6658 => 25.3645, std.dev.: 0.0606) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.72% (0.9980 => 1.0251, std.dev.: 0.0247) MultiSource/Applications/sqlite3/sqlite3: 3.22% (0.6022 => 0.6216, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/08-main/main: 9.72% (0.1666 => 0.1828, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.77% (0.1554 => 0.1566, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.67% (0.3083 => 0.3227, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.05% (0.2394 => 0.2467, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.35% (0.3175 => 0.3218, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.00% (0.2302 => 0.2325, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel: 3.79% (0.0449 => 0.0466, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 3.33% (0.0240 => 0.0248, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 3.13% (0.0192 => 0.0198, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.79% (0.0390 => 0.0397, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.99% (0.0301 => 0.0307, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.82% (0.0284 => 0.0292, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 3.70% (0.0324 => 0.0336, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 6.78% (0.0177 => 0.0189) SingleSource/UnitTests/Vector/Altivec/test1: 6.88% (0.0189 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 5.22% (0.0249 => 0.0262, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 2.15% (0.0325 => 0.0332, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.77% (0.1429 => 0.1418, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 3.00% (1.5019 => 1.5470, std.dev.: 0.0200) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.20% (0.1501 => 0.1483, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.95% (0.4264 => 0.4053, std.dev.: 0.0234) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.66% (0.1344 => 0.1447, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.72% (0.0589 => 0.0605, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -17.24% (0.0232 => 0.0192, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.82% (0.0639 => 0.0657, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.66% (1.1350 => 1.1275, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 350.00% (0.0006 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.26% (0.0637 => 0.0578, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.81% (0.0246 => 0.0244, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.56% (0.7541 => 0.7659, std.dev.: 0.0117) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 11.21% (1.5363 => 1.7085, std.dev.: 0.0120) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 7 06:35:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 08:35:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121007133512.4151A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4674?compare_to=4671&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4674, Order: 165374, Start Time: 2012-10-07 12:22:20, End Time: 2012-10-07 13:36:57 To: 4671, Order: 165373, Start Time: 2012-10-07 10:15:10, End Time: 2012-10-07 11:29:52 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (185 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1042 (751 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 22.10% (2.0176 => 2.4635, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.73% (0.1410 => 0.1660, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 15.98% (0.0826 => 0.0958, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 15.07% (0.2243 => 0.2581, std.dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.25% (0.1072 => 0.1214, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.95% (0.0834 => 0.0942, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 12.54% (0.1013 => 0.1140, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 12.34% (0.4328 => 0.4862, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.24% (0.1413 => 0.1586, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.82% (3.9660 => 4.4346, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.67% (0.2596 => 0.2899, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.62% (0.0964 => 0.1076, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.61% (0.1327 => 0.1481, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 11.60% (0.4062 => 0.4533, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.59% (0.1588 => 0.1772) SingleSource/UnitTests/ObjC++/property-reference-object: 11.57% (0.5818 => 0.6491, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 11.54% (1.3693 => 1.5273, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.50% (0.7710 => 0.8597, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.50% (0.2721 => 0.3034, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 11.43% (0.7061 => 0.7868, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 11.40% (0.7038 => 0.7840, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 11.40% (0.5748 => 0.6403, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.35% (1.4563 => 1.6216, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.25% (0.9199 => 1.0234, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 11.18% (0.2781 => 0.3092, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.16% (0.6283 => 0.6984, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.15% (1.2193 => 1.3553, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.11% (0.5265 => 0.5850, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.08% (0.6959 => 0.7730, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 11.01% (0.1589 => 0.1764, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.96% (0.2782 => 0.3087, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 10.92% (0.1062 => 0.1178, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.82% (0.3899 => 0.4321, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.82% (0.3485 => 0.3862, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 10.71% (13.8202 => 15.3007, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/lists: 10.63% (0.3293 => 0.3643, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.62% (0.3022 => 0.3343, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.57% (0.3756 => 0.4153, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.56% (1.1364 => 1.2564, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 10.51% (0.2760 => 0.3050, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.48% (0.4016 => 0.4437, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 10.47% (0.2607 => 0.2880, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.47% (0.2655 => 0.2933, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 10.45% (0.2726 => 0.3011, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 10.39% (0.2761 => 0.3048, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 10.37% (0.2690 => 0.2969, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 10.35% (0.2937 => 0.3241, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.35% (0.3489 => 0.3850, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.32% (0.2966 => 0.3272, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 10.31% (0.2628 => 0.2899, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 10.30% (0.3107 => 0.3427, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 10.28% (0.3453 => 0.3808, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 10.27% (0.1003 => 0.1106, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 10.26% (0.3868 => 0.4265, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.26% (1.9828 => 2.1862, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 10.23% (0.3149 => 0.3471, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.20% (0.2765 => 0.3047, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.20% (0.3580 => 0.3945, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.14% (0.1075 => 0.1184, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 10.12% (0.2995 => 0.3298, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.11% (0.1157 => 0.1274, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 9.96% (0.3192 => 0.3510, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.94% (0.2696 => 0.2964, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 9.94% (0.2988 => 0.3285, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.89% (0.4791 => 0.5265, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 9.85% (0.3534 => 0.3882, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.84% (0.4379 => 0.4810, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.83% (0.5577 => 0.6125, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 9.81% (1.0313 => 1.1325, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.75% (0.4390 => 0.4818, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.74% (0.3130 => 0.3435, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 9.69% (16.6129 => 18.2224, std.dev.: 0.0301) MultiSource/Applications/Burg/burg: 9.61% (1.1061 => 1.2124, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.54% (0.2914 => 0.3192, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.52% (0.1986 => 0.2175, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.41% (0.1435 => 0.1570, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.40% (0.2127 => 0.2327, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.33% (0.1276 => 0.1395, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.29% (0.8698 => 0.9506, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.27% (0.3246 => 0.3547, std.dev.: 0.0032) MultiSource/Applications/spiff/spiff: 9.26% (0.7506 => 0.8201, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 9.25% (0.6744 => 0.7368, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 9.24% (0.2945 => 0.3217, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.20% (0.6576 => 0.7181, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 9.18% (0.1111 => 0.1213, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.17% (0.5637 => 0.6154, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.17% (0.7460 => 0.8144, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 9.13% (0.8310 => 0.9069, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 9.13% (0.3220 => 0.3514, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 9.11% (3.8646 => 4.2165, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.96% (7.2180 => 7.8646, std.dev.: 0.0016) MultiSource/Applications/treecc/treecc: 8.91% (1.9270 => 2.0987, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.81% (0.3755 => 0.4086, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 8.73% (0.1478 => 0.1607, std.dev.: 0.0030) MultiSource/Applications/siod/siod: 8.72% (2.1791 => 2.3692, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: 8.66% (3.1889 => 3.4651, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.65% (0.2023 => 0.2198, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.63% (0.1865 => 0.2026, std.dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 8.58% (1.0594 => 1.1503, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.34% (0.8818 => 0.9553, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 8.31% (0.2925 => 0.3168, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.29% (0.1569 => 0.1699, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.25% (0.6135 => 0.6641, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 8.20% (1.2749 => 1.3794, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 8.18% (0.3131 => 0.3387, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.16% (3.6692 => 3.9686, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.15% (1.3245 => 1.4325, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 8.15% (0.1657 => 0.1792, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 8.09% (14.8535 => 16.0552, std.dev.: 0.0191) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.03% (4.3801 => 4.7318, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.99% (0.1789 => 0.1932, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 7.98% (8.4961 => 9.1740, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.96% (4.4433 => 4.7972, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/parameter-passing: 7.82% (0.4003 => 0.4316, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/05-eks/eks: 7.78% (0.4113 => 0.4433, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 7.57% (0.3578 => 0.3849, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.52% (0.2140 => 0.2301, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.51% (0.3914 => 0.4208, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.40% (4.9865 => 5.3557, std.dev.: 0.0063) MultiSource/Applications/oggenc/oggenc: 7.39% (4.6629 => 5.0074, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 7.37% (1.2292 => 1.3198, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 7.36% (0.3789 => 0.4068, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.35% (0.3646 => 0.3914, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 7.33% (0.3601 => 0.3865, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.31% (0.3940 => 0.4228, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.29% (0.3663 => 0.3930, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 7.26% (0.6250 => 0.6704, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.26% (0.3511 => 0.3766, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.23% (0.3650 => 0.3914, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.20% (0.3623 => 0.3884, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.18% (1.1333 => 1.2147, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.15% (1.5188 => 1.6274, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.15% (0.2504 => 0.2683, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.15% (0.9108 => 0.9759, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.03% (0.4805 => 0.5143, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.95% (3.2742 => 3.5018, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.87% (0.3245 => 0.3468, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 6.77% (0.2008 => 0.2144, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 6.66% (6.5754 => 7.0136, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.42% (0.2321 => 0.2470, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.40% (6.2785 => 6.6803, std.dev.: 0.0111) MultiSource/Applications/lua/lua: 6.34% (3.7467 => 3.9844, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.18% (2.1007 => 2.2306, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.16% (0.1819 => 0.1931, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 6.13% (0.1777 => 0.1886, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.52% (13.2842 => 14.0177, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.86% (0.2243 => 0.2352, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 3.79% (16.2614 => 16.8785, std.dev.: 0.0067) MultiSource/Applications/ClamAV/clamscan: 3.69% (14.5298 => 15.0661, std.dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: 1.36% (33.2944 => 33.7481, std.dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.42% (5.7573 => 7.5084, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 24.94% (1.8175 => 2.2707, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/richards_benchmark: 11.05% (1.1560 => 1.2837, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 9.03% (0.8273 => 0.9020) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4141, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.31% (1.2998 => 1.3818, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0042, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7748, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6762, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 3.30% (1.9199 => 1.9833, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 3.28% (10.7476 => 11.1006, std.dev.: 0.0107) SingleSource/Regression/C/uint64_to_float: 2.97% (0.5449 => 0.5611, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 2.27% (7.4271 => 7.5955, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4530, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.44% (8.3908 => 8.5118, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9695, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1882, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5779, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 1.12% (12.4560 => 12.5956, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0271, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.04% (3.6469 => 3.6850, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.15% (0.2670 => 0.1411, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.76% (0.4657 => 0.3923, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -15.28% (0.0707 => 0.0599) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.70% (1.3813 => 1.1920, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.70% (1.3819 => 1.1926, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.04% (22.5627 => 21.8771, std.dev.: 0.0098) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.64% (0.0997 => 0.0861, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.97% (0.2238 => 0.1970, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -10.81% (1.2308 => 1.0977, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.02% (20.3410 => 18.3034, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std.dev.: 0.0126) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.39% (1.3780 => 1.3037, std.dev.: 0.0072) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8004, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.95% (0.9996 => 0.9601, std.dev.: 0.0121) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1561, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.51% (1.7688 => 1.7067, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.10% (0.4867 => 0.4716, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -2.56% (26.5159 => 25.8378, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.51% (3.0263 => 2.9502, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: -2.37% (1.9762 => 1.9294, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.85% (0.6589 => 0.6467, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7133, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -1.75% (6.3560 => 6.2450, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0065, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8621, std.dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: -1.26% (4.5928 => 4.5350, std.dev.: 0.0078) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4954, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2565, std.dev.: 0.0029) MultiSource/Applications/minisat/minisat: -1.10% (9.3358 => 9.2328, std.dev.: 0.0129) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 7 06:46:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 08:46:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121007134608.EE64D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4675?compare_to=4672&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4675, Order: 165375, Start Time: 2012-10-07 12:28:23, End Time: 2012-10-07 13:47:54 To: 4672, Order: 165373, Start Time: 2012-10-07 10:39:46, End Time: 2012-10-07 11:59:07 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (153 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1024 (763 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.37% (54.5136 => 56.3487, std.dev.: 0.1175) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.05% (0.5874 => 0.5877, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: -0.02% (16.2233 => 16.2201, std.dev.: 0.0108) MultiSource/Benchmarks/Bullet/bullet: -0.01% (54.8811 => 54.8765, std.dev.: 0.0098) MultiSource/Benchmarks/MallocBench/gs/gs: -0.25% (4.3901 => 4.3790, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (1.2473 => 1.2473, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.03% (7.7675 => 7.7654, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.07% (0.7391 => 0.7386, std.dev.: 0.0107) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 1.95% (0.0359 => 0.0366, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.24% (0.2189 => 0.2140, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -13.23% (63.2438 => 54.8765, std.dev.: 0.0098) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.38% (14.1553 => 18.7388, std.dev.: 0.0203) SingleSource/Benchmarks/Misc-C++-EH/spirit: 61.05% (3.4629 => 5.5771, std.dev.: 0.0037) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14230.83% (0.0720 => 10.3182, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952600.00% (0.0001 => 9.9527, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 51.25% (0.2554 => 0.3863, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 48.76% (10.3673 => 15.4219, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/richards_benchmark: 31.01% (0.1622 => 0.2125, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/distray/distray: 30.97% (0.1056 => 0.1383, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.48% (2.2022 => 2.5430, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops: 15.43% (0.1432 => 0.1653, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.80% (7.0540 => 8.0977, std.dev.: 0.0104) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.75% (0.1566 => 0.1797, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.50% (1.7609 => 1.9810, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.17% (0.0871 => 0.0977, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 12.00% (0.3282 => 0.3676, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.92% (0.1584 => 0.1757, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.70% (0.3543 => 0.3922, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/trivial-interface: 10.31% (0.3473 => 0.3831, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.21% (0.3516 => 0.3875, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.19% (0.3543 => 0.3904, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.17% (0.3561 => 0.3923, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.15% (0.3497 => 0.3852, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.94% (0.3694 => 0.4061, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/parameter-passing: 9.91% (0.3927 => 0.4316, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 9.86% (0.1440 => 0.1582, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 9.85% (0.3828 => 0.4205, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.70% (0.3886 => 0.4263, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.33% (0.4879 => 0.5334, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.32% (0.1438 => 0.1572, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 9.18% (0.1655 => 0.1807, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 9.13% (9.4845 => 10.3501, std.dev.: 0.0037) MultiSource/Applications/minisat/minisat: 9.08% (0.7115 => 0.7761, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.06% (0.6675 => 0.7280, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.03% (0.3177 => 0.3464, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 8.93% (0.7433 => 0.8097, std.dev.: 0.0117) MultiSource/Applications/JM/ldecod/ldecod: 8.85% (10.4361 => 11.3599, std.dev.: 0.0140) MultiSource/Applications/sgefa/sgefa: 8.85% (0.3109 => 0.3384, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 8.61% (0.5925 => 0.6435, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.55% (1.5415 => 1.6733, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.54% (0.4615 => 0.5009, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.39% (0.6030 => 0.6536, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.37% (0.1625 => 0.1761, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.34% (0.5105 => 0.5531, std.dev.: 0.0044) MultiSource/Applications/oggenc/oggenc: 8.34% (5.7591 => 6.2392, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/18-imp/imp: 8.27% (0.3423 => 0.3706, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.21% (1.3050 => 1.4122, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/em3d/em3d: 8.14% (0.1695 => 0.1833, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 8.14% (3.3354 => 3.6068, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.03% (0.8172 => 0.8828, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.99% (0.5860 => 0.6328, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.97% (0.2271 => 0.2452, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.95% (0.1510 => 0.1630, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.93% (0.2107 => 0.2274, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.93% (4.2646 => 4.6026, std.dev.: 0.0117) SingleSource/UnitTests/ObjC++/property-reference: 7.85% (0.7326 => 0.7901, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.2065 => 0.2227, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.79% (0.3121 => 0.3364, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.78% (0.5569 => 0.6002, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.74% (0.3307 => 0.3563, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.70% (0.8067 => 0.8688, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.67% (0.2700 => 0.2907, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 7.65% (0.6456 => 0.6950, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.64% (8.1363 => 8.7579, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists: 7.63% (0.3422 => 0.3683, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.62% (5.0018 => 5.3830, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.61% (4.9449 => 5.3210, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.60% (0.9765 => 1.0507, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 7.48% (0.7835 => 0.8421, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.47% (0.2758 => 0.2964, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.45% (0.5020 => 0.5394, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.43% (0.4103 => 0.4408, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.43% (1.1642 => 1.2507, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.42% (0.1940 => 0.2084, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 7.35% (0.3387 => 0.3636, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 7.34% (0.4289 => 0.4604, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 7.34% (3.8723 => 4.1566, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.26% (0.4203 => 0.4508, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.22% (0.3865 => 0.4144, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 7.16% (0.2905 => 0.3113, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 7.15% (1.5603 => 1.6718, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.13% (7.9617 => 8.5294, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.12% (0.3650 => 0.3910, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 6.99% (0.4048 => 0.4331, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.96% (0.2831 => 0.3028, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 6.95% (0.1555 => 0.1663, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 6.90% (1.0722 => 1.1462, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.88% (0.2891 => 0.3090, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.84% (0.4620 => 0.4936, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.80% (0.3603 => 0.3848, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.79% (0.3136 => 0.3349, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.77% (0.3441 => 0.3674, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.77% (0.3162 => 0.3376, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 6.77% (2.0273 => 2.1645, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/lists1: 6.76% (0.3684 => 0.3933, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.75% (0.3232 => 0.3450, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.69% (0.3826 => 0.4082, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.69% (0.2871 => 0.3063, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.67% (0.3283 => 0.3502, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.67% (2.0665 => 2.2043, std.dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.67% (0.4636 => 0.4945, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.65% (0.3098 => 0.3304, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.65% (0.2603 => 0.2776, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.60% (1.5859 => 1.6905, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.50% (1.1861 => 1.2632, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.50% (0.2725 => 0.2902, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.49% (0.2756 => 0.2935, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.48% (0.2872 => 0.3058, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.39% (0.3052 => 0.3247, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.33% (0.2877 => 0.3059, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.31% (0.6450 => 0.6857, std.dev.: 0.0055) MultiSource/Applications/siod/siod: 6.30% (2.2969 => 2.4416, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/09-vor/vor: 6.29% (0.3180 => 0.3380, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.26% (0.4299 => 0.4568, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.25% (0.2802 => 0.2977, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.19% (0.2793 => 0.2966, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 6.15% (0.8921 => 0.9470, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.12% (0.5981 => 0.6347, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/hello: 6.12% (0.2714 => 0.2880, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 6.07% (0.3379 => 0.3584, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 5.93% (21.9371 => 23.2376, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.74% (2.2024 => 2.3288, std.dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.51% (0.1906 => 0.2011, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.50% (0.1892 => 0.1996, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.41% (1.4186 => 1.4954, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.39% (0.4064 => 0.4283, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 5.36% (1.1840 => 1.2475, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.94% (0.2266 => 0.2378, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.65% (1.2842 => 1.3439, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.39% (0.8101 => 0.8457, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.70% (14.3668 => 14.8985, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.56% (0.3427 => 0.3549, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 3.35% (17.1811 => 17.7559, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.93% (3.8922 => 4.0064, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.64% (1.1194 => 1.1489, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8953, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.38% (0.2944 => 0.3279, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 10.06% (1.1396 => 1.2543, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Puzzle: 9.85% (0.1421 => 0.1561, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.20% (3.1595 => 3.4502, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 6.73% (3.1578 => 3.3702, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.65% (0.3463 => 0.3624, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 3.68% (0.5413 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.51% (3.6395 => 3.7671, std.dev.: 0.0033) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.78% (4.2280 => 4.3457, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.55% (0.8275 => 0.8403, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8129, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.36% (0.9540 => 0.9670, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.32% (2.6546 => 2.6896, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.03% (9.1159 => 9.2094, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.01% (6.5088 => 6.5745, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1293, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.95% (5.2763 => 3.2739, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.71% (5.3855 => 3.6239, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.26% (5.3526 => 3.6260, std.dev.: 0.0028) SingleSource/UnitTests/Vector/constpool: -14.47% (54.1659 => 46.3301, std.dev.: 0.0174) MultiSource/Benchmarks/FreeBench/mason/mason: -13.19% (0.0811 => 0.0704, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -11.21% (22.1758 => 19.6889, std.dev.: 0.0298) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.52% (2.9384 => 2.6293, std.dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.37% (1.1492 => 0.7657, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4250, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.63% (0.0998 => 0.0862, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.47% (1.2373 => 1.0954, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -10.28% (1.5373 => 1.3793, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/mason/mason: -9.90% (0.2161 => 0.1947, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.33% (19.9488 => 18.2871, std.dev.: 0.0937) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.78% (1.8329 => 1.7086, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8479, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.30% (1.6805 => 1.5914, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) SingleSource/Benchmarks/Misc/flops-5: -4.84% (1.5835 => 1.5068, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.85% (0.9957 => 0.9574, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168) MultiSource/Applications/siod/siod: -3.59% (3.2827 => 3.1648, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4937, std.dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: -2.99% (12.4730 => 12.1004, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.10% (0.4808 => 0.4707, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.04% (8.6802 => 8.5030, std.dev.: 0.0212) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.90% (8.1563 => 8.0016, std.dev.: 0.0156) SingleSource/Benchmarks/Misc/salsa20: -1.73% (10.2830 => 10.1047, std.dev.: 0.0104) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6824, std.dev.: 0.0014) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4201, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/lists: -1.20% (6.2999 => 6.2242, std.dev.: 0.0109) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8582, std.dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.39% (0.5229 => 0.5877, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 8.21% (14.9895 => 16.2201, std.dev.: 0.0108) MultiSource/Benchmarks/MallocBench/gs/gs: 6.53% (4.1105 => 4.3790, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.90% (1.1048 => 1.2473, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.48% (7.1582 => 7.7654, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.71% (0.6222 => 0.7386, std.dev.: 0.0107) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36500.00% (0.0001 => 0.0366, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.13% (0.2116 => 0.2140, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 7 06:58:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 08:58:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121007135808.1206A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4676?compare_to=4669&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4676, Order: 165373, Start Time: 2012-10-07 11:16:22, End Time: 2012-10-07 13:59:54 To: 4669, Order: 165372, Start Time: 2012-10-07 08:03:28, End Time: 2012-10-07 10:47:21 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (132 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 1041 (831 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.85% (126.3184 => 129.9168, std.dev.: 0.8295) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.14% (0.1063 => 0.1192, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 12.12% (0.3465 => 0.3885, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.08% (0.3469 => 0.3888, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/for-in: 12.01% (0.3496 => 0.3916, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.98% (0.3446 => 0.3859, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.94% (0.3460 => 0.3873, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.87% (0.3488 => 0.3902, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.82% (0.3442 => 0.3849, std.dev.: 0.0026) MultiSource/Applications/oggenc/oggenc: 11.66% (1.5932 => 1.7790, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 11.53% (0.3650 => 0.4071, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions: 11.47% (0.3643 => 0.4061, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.33% (0.3724 => 0.4146, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.65% (0.5826 => 0.6388, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference-object: 9.59% (0.5889 => 0.6454, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 8.34% (0.1619 => 0.1754, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.21% (0.7171 => 0.7760, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.97% (0.2875 => 0.3104, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.79% (0.4994 => 0.5383, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 7.72% (0.3004 => 0.3236, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.70% (0.4361 => 0.4697, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 7.66% (0.2714 => 0.2922, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.64% (0.3195 => 0.3439, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.63% (0.2911 => 0.3133, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.63% (1.3152 => 1.4155, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/methcall: 7.61% (0.2813 => 0.3027, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.59% (0.2792 => 0.3004, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.56% (0.2738 => 0.2945, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 7.56% (0.2725 => 0.2931, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 7.55% (0.2780 => 0.2990, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/objinst: 7.51% (0.2823 => 0.3035, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.50% (1.6211 => 1.7427, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.50% (0.5000 => 0.5375, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.44% (0.2729 => 0.2932, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/except: 7.44% (0.2811 => 0.3020, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.42% (2.0673 => 2.2206, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/random: 7.38% (0.2803 => 0.3010, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.35% (0.1620 => 0.1739, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 7.30% (0.3096 => 0.3322, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 7.29% (0.9909 => 1.0631, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.27% (3.5627 => 3.8218, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary3: 7.25% (0.3267 => 0.3504, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 7.21% (0.3317 => 0.3556, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 7.12% (5.5417 => 5.9362, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.11% (0.3362 => 0.3601, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.09% (0.3060 => 0.3277, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 7.04% (0.4847 => 0.5188, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 7.00% (1.0781 => 1.1536, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/lists1: 6.99% (0.3477 => 0.3720, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.98% (2.7292 => 2.9198, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary: 6.97% (0.3258 => 0.3485, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 6.96% (0.3678 => 0.3934, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 6.90% (0.3348 => 0.3579, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sieve: 6.90% (0.3726 => 0.3983, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.85% (0.3124 => 0.3338, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.84% (0.3625 => 0.3873, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.83% (0.3282 => 0.3506, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.75% (0.2014 => 0.2150, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 6.68% (0.4146 => 0.4423, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.67% (0.4139 => 0.4415, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.65% (0.2736 => 0.2918, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 6.65% (23.5202 => 25.0832, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.63% (0.3845 => 0.4100, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.62% (0.3930 => 0.4190, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.59% (0.5026 => 0.5357, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 6.56% (0.4251 => 0.4530, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.50% (0.3690 => 0.3930, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.46% (0.3981 => 0.4238, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 6.45% (4.2109 => 4.4824, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.43% (0.3890 => 0.4140, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.42% (4.4195 => 4.7032, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.25% (0.2866 => 0.3045, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.20% (0.5900 => 0.6266, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 6.20% (0.2566 => 0.2725, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.17% (0.3903 => 0.4144, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.10% (0.1968 => 0.2088, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 6.06% (0.6634 => 0.7036, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 6.02% (1.8794 => 1.9925, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.99% (0.2737 => 0.2901, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 5.96% (0.4029 => 0.4269, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.95% (0.6435 => 0.6818, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.93% (0.3084 => 0.3267, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 5.93% (0.5012 => 0.5309, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 5.91% (2.1013 => 2.2255, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.89% (0.2969 => 0.3144, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.85% (0.2068 => 0.2189, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.78% (0.3271 => 0.3460, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 5.78% (4.6177 => 4.8844, std.dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.75% (0.4658 => 0.4926, std.dev.: 0.0041) MultiSource/Applications/lua/lua: 5.74% (1.4269 => 1.5088, std.dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: 5.70% (2.1653 => 2.2888, std.dev.: 0.0029) MultiSource/Applications/Burg/burg: 5.66% (0.5546 => 0.5860, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 5.61% (0.3336 => 0.3523, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.59% (0.2040 => 0.2154, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 5.30% (0.2075 => 0.2185, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.23% (0.2103 => 0.2213, std.dev.: 0.0014) MultiSource/Applications/treecc/treecc: 5.09% (0.7875 => 0.8276, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 5.07% (0.9697 => 1.0189, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 5.04% (2.0346 => 2.1372, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.95% (1.9694 => 2.0669, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.88% (1.9966 => 2.0940, std.dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: 4.76% (0.2691 => 0.2819, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 4.64% (0.2391 => 0.2502, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.54% (0.7426 => 0.7763, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.33% (0.5361 => 0.5593, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.17% (0.5584 => 0.5817, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.89% (11.6398 => 12.0921, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.72% (4.6926 => 4.8671, std.dev.: 0.0043) MultiSource/Applications/lambda-0_1_3/lambda: 3.66% (0.3498 => 0.3626, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.17% (0.4253 => 0.4388, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.64% (0.3792 => 0.3892, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 2.61% (11.9555 => 12.2672, std.dev.: 0.0094) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6530, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6109, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6764, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: 5.04% (0.2122 => 0.2229, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1716, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/flops-2: 4.56% (1.8057 => 1.8881, std.dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/dry: 4.10% (14.0481 => 14.6241, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2088, std.dev.: 0.0030) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5071, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.86% (3.1722 => 3.2312, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.48% (7.1849 => 7.2913, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5140, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5390, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5773, std.dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.98% (25.4195 => 16.5286, std.dev.: 0.0270) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9742, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7883, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/ary2: -7.29% (0.2402 => 0.2227, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9575, std.dev.: 0.0015) SingleSource/UnitTests/Vector/build2: -3.80% (11.2080 => 10.7822, std.dev.: 0.0114) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -3.31% (17.2379 => 16.6665, std.dev.: 0.0763) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7739, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.97% (0.6293 => 0.6106, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8658, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5780, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4961, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.20% (105.3826 => 104.1209, std.dev.: 0.0366) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0478, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 7 08:08:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 10:08:26 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121007150826.3000B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4677?compare_to=4673&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4677, Order: 165375, Start Time: 2012-10-07 13:47:39, End Time: 2012-10-07 15:10:12 To: 4673, Order: 165374, Start Time: 2012-10-07 12:09:09, End Time: 2012-10-07 13:32:03 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (14 on baseline) Performance Regressions: 5 (102 on baseline) Performance Improvements: 2 (45 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 970 (744 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.85% (0.2910 => 0.3051, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.81% (0.5850 => 0.5956, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.70% (0.7449 => 0.7576, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.23% (1.3269 => 1.3830, std.dev.: 0.0155) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.16% (41.8394 => 42.7415, std.dev.: 0.2153) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.39% (60.5783 => 59.1290, std.dev.: 0.4623) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.51% (4.7286 => 4.6571, std.dev.: 0.0277) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.10% (1.0251 => 1.0241, std.dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: 0.93% (0.6216 => 0.6274, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: 0.11% (0.1828 => 0.1830, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.72% (0.1566 => 0.1593, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.28% (0.3227 => 0.3236, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.05% (0.2467 => 0.2441, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.86% (0.3218 => 0.3278, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.81% (0.2325 => 0.2367, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel: -6.01% (0.0466 => 0.0438, std.dev.: 0.0015) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -8.47% (0.0248 => 0.0227, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.52% (0.0198 => 0.0201, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.76% (0.0397 => 0.0394, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.30% (0.0307 => 0.0311, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.34% (0.0292 => 0.0293, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.89% (0.0336 => 0.0333, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: -1.06% (0.0189 => 0.0187, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -43.07% (0.0202 => 0.0115, std.dev.: 0.0042) SingleSource/UnitTests/Vector/multiplies: -1.15% (0.0262 => 0.0259, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: - (0.0332 => 0.0332, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.78% (0.1418 => 0.1429, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: -2.04% (1.5470 => 1.5154, std.dev.: 0.0158) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 4.11% (0.1483 => 0.1544, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.07% (0.4053 => 0.4056, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.39% (0.1447 => 0.1369, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.42% (0.0605 => 0.0548, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 29.69% (0.0192 => 0.0249, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.83% (0.0657 => 0.0645, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.07% (1.1275 => 1.1267, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0027 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -20.83% (0.0024 => 0.0019, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.29% (0.0578 => 0.0559, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.48% (0.0244 => 0.0216, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.14% (0.7659 => 0.7648, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.14% (1.7085 => 1.7061, std.dev.: 0.0158) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -32.23% (0.0121 => 0.0082, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 151.69% (0.0089 => 0.0224, std.dev.: 0.0020) SingleSource/UnitTests/2003-08-11-VaListArg: 180.00% (0.0090 => 0.0252, std.dev.: 0.0004) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -27.25% (4.1772 => 3.0389, std.dev.: 0.0284) SingleSource/Benchmarks/Shootout-C++/except: 83733.33% (0.0006 => 0.5030, std.dev.: 0.0009) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: -66.67% (0.0006 => 0.0002, std.dev.: 0.0002) SingleSource/Regression/C++/EH/exception_spec_test: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.36% (0.0745 => 0.0919, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 10.30% (0.5309 => 0.5856, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.01% (0.1159 => 0.1275, std.dev.: 0.0030) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.26% (0.1414 => 0.1545, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.97% (0.6410 => 0.6985, std.dev.: 0.0064) MultiSource/Benchmarks/PAQ8p/paq8p: 8.83% (2.1763 => 2.3684, std.dev.: 0.0293) MultiSource/Applications/minisat/minisat: 8.42% (0.6173 => 0.6693, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.18% (0.3582 => 0.3875, std.dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: 7.05% (1.1653 => 1.2475, std.dev.: 0.0060) MultiSource/Applications/lemon/lemon: 6.82% (1.0046 => 1.0731, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.81% (1.5150 => 1.6181, std.dev.: 0.0163) MultiSource/Applications/lambda-0_1_3/lambda: 6.32% (0.6915 => 0.7352, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 6.25% (15.3105 => 16.2681, std.dev.: 0.0506) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.24% (0.3062 => 0.3253, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.96% (0.2552 => 0.2704, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.96% (0.4248 => 0.4501, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.86% (0.7639 => 0.8087, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.80% (1.1672 => 1.2349, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.72% (0.2886 => 0.3051, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.65% (0.6069 => 0.6412, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.65% (0.2797 => 0.2955, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 5.25% (0.3217 => 0.3386, std.dev.: 0.0020) MultiSource/Applications/d/make_dparser: 5.23% (3.0225 => 3.1807, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.22% (0.7722 => 0.8125, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/oourafft: 5.18% (0.1971 => 0.2073, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: 5.06% (1.3268 => 1.3940, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.92% (0.4880 => 0.5120, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.89% (0.2106 => 0.2209, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.84% (0.7226 => 0.7576, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.75% (1.4408 => 1.5092, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.71% (0.3418 => 0.3579, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.53% (6.2546 => 6.5377, std.dev.: 0.0402) MultiSource/Applications/SPASS/SPASS: 4.52% (13.3238 => 13.9261, std.dev.: 0.0444) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.46% (0.3901 => 0.4075, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.45% (1.1827 => 1.2353, std.dev.: 0.0072) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.42% (0.3008 => 0.3141, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.39% (2.0317 => 2.1209, std.dev.: 0.0076) MultiSource/Applications/Burg/burg: 4.32% (1.1440 => 1.1934, std.dev.: 0.0077) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.29% (0.8569 => 0.8937, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/lists1: 4.29% (0.2771 => 0.2890, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 4.28% (0.2877 => 0.3000, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 4.23% (4.7455 => 4.9462, std.dev.: 0.0538) MultiSource/Benchmarks/Bullet/bullet: 4.19% (29.3170 => 30.5459, std.dev.: 0.2772) SingleSource/Benchmarks/Shootout-C++/hash2: 4.11% (0.3847 => 0.4005, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.03% (0.2654 => 0.2761, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.03% (0.2806 => 0.2919, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 3.98% (1.8798 => 1.9547, std.dev.: 0.0089) MultiSource/Applications/siod/siod: 3.96% (2.0972 => 2.1802, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.76% (0.5740 => 0.5956, std.dev.: 0.0035) MultiSource/Applications/lua/lua: 3.71% (3.5980 => 3.7316, std.dev.: 0.0171) MultiSource/Benchmarks/nbench/nbench: 3.68% (1.0821 => 1.1219, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.68% (0.4596 => 0.4765, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 3.57% (8.2186 => 8.5117, std.dev.: 0.0909) MultiSource/Benchmarks/Prolangs-C/football/football: 3.56% (0.8405 => 0.8704, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.43% (3.0758 => 3.1812, std.dev.: 0.0100) MultiSource/Benchmarks/sim/sim: 3.34% (0.3084 => 0.3187, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.34% (12.6413 => 13.0630, std.dev.: 0.1094) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.31% (0.9029 => 0.9328, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/hash: 3.30% (0.3520 => 0.3636, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.28% (0.5937 => 0.6132, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.22% (0.5520 => 0.5698, std.dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: 3.17% (14.7256 => 15.1919, std.dev.: 0.0602) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.16% (4.3380 => 4.4751, std.dev.: 0.0357) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.14% (0.5636 => 0.5813, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.10% (8.2559 => 8.5120, std.dev.: 0.0289) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.09% (0.4562 => 0.4703, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 3.02% (3.8796 => 3.9968, std.dev.: 0.0147) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.01% (1.0689 => 1.1011, std.dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 2.91% (6.4908 => 6.6796, std.dev.: 0.0158) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.86% (4.2616 => 4.3836, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.85% (4.2815 => 4.4034, std.dev.: 0.0322) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.65% (4.0318 => 4.1387, std.dev.: 0.0299) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.47% (0.5963 => 0.6110, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.17% (1.2742 => 1.3019, std.dev.: 0.0081) MultiSource/Applications/hexxagon/hexxagon: 2.16% (0.9425 => 0.9629, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 49.81% (0.0261 => 0.0391, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/pi: 41.41% (1.6538 => 2.3387, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2280, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.62% (0.0766 => 0.0901, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/ary3: 14.63% (1.7426 => 1.9976, std.dev.: 0.0131) MultiSource/Benchmarks/MallocBench/gs/gs: 14.27% (0.0743 => 0.0849, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.19% (2.4042 => 2.7212, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.14% (4.0101 => 4.5371, std.dev.: 0.0123) SingleSource/Benchmarks/McGill/queens: 11.09% (1.6261 => 1.8065, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 10.26% (0.1433 => 0.1580, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/mason/mason: 10.17% (0.5004 => 0.5513, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: 8.98% (7.0025 => 7.6316, std.dev.: 0.0119) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.82% (0.2857 => 0.3109, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.50% (1.0063 => 1.0818, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.79% (0.3301 => 0.3492, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.59% (40.4792 => 42.7415, std.dev.: 0.2153) SingleSource/Benchmarks/Misc/dt: 4.34% (0.9851 => 1.0279, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.90% (3.4080 => 3.5408, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: 3.72% (15.2242 => 15.7907, std.dev.: 0.0633) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.54% (0.5876 => 0.6084, std.dev.: 0.0045) MultiSource/Applications/siod/siod: 3.03% (3.5520 => 3.6596, std.dev.: 0.0083) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.01% (0.5587 => 0.5755, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.83% (6.6312 => 6.8191, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 2.30% (0.6308 => 0.6453, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.04% (2.6656 => 2.7200, std.dev.: 0.0099) MultiSource/Benchmarks/Olden/power/power: 1.18% (1.4184 => 1.4351, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.12% (1.2726 => 1.2869, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.16% (0.0591 => 0.0330, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -43.76% (0.2996 => 0.1685, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.44% (1.4189 => 1.1573, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.48% (1.4113 => 1.1646, std.dev.: 0.0049) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.55% (0.3497 => 0.2114, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.83% (5.2665 => 4.1170, std.dev.: 0.0415) SingleSource/Benchmarks/Shootout-C++/ary3: -19.92% (1.7473 => 1.3993, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -14.71% (1.7361 => 1.4807, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1581, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/17-bintr/bintr: -11.34% (0.0917 => 0.0813, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.94% (15.8312 => 14.2578, std.dev.: 0.3349) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.42% (1.1647 => 1.0550, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.44% (3.2007 => 2.9305, std.dev.: 0.0126) SingleSource/Benchmarks/Misc/flops: -8.35% (9.5474 => 8.7500, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.28% (1.4034 => 1.2872, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.92% (3.6254 => 3.3747, std.dev.: 0.0110) MultiSource/Applications/lambda-0_1_3/lambda: -6.77% (7.6833 => 7.1630, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/fibo: -6.55% (4.6355 => 4.3321, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -6.07% (1.4441 => 1.3564, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.01% (2.9728 => 2.7942, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.47% (3.9413 => 3.7258, std.dev.: 0.0238) SingleSource/Benchmarks/Shootout/fib2: -5.28% (4.4195 => 4.1862, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -5.13% (2.5166 => 2.3875, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.23% (0.4564 => 0.4371, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -4.17% (62.4126 => 59.8087, std.dev.: 0.1236) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.85% (1.2959 => 1.2460, std.dev.: 0.0095) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.57% (1.2722 => 1.2268, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.48% (2.4457 => 2.3605, std.dev.: 0.0175) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.34% (61.1734 => 59.1290, std.dev.: 0.4623) SingleSource/Benchmarks/Shootout-C++/methcall: -2.94% (9.2503 => 8.9788, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.49% (3.7496 => 3.6564, std.dev.: 0.0177) MultiSource/Benchmarks/PAQ8p/paq8p: -2.30% (92.7467 => 90.6141, std.dev.: 0.6260) MultiSource/Applications/SIBsim4/SIBsim4: -2.28% (3.4230 => 3.3449, std.dev.: 0.0186) SingleSource/Benchmarks/Dhrystone/dry: -2.26% (2.4013 => 2.3471, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.12% (1.1683 => 1.1435, std.dev.: 0.0023) MultiSource/Applications/aha/aha: -1.92% (3.4286 => 3.3626, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash2: -1.90% (3.4876 => 3.4212, std.dev.: 0.0230) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.88% (2.3569 => 2.3126, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.66% (1.0686 => 1.0509, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.62% (9.3855 => 9.2330, std.dev.: 0.0162) MultiSource/Benchmarks/FreeBench/neural/neural: -1.53% (1.0926 => 1.0759, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -1.53% (2.4971 => 2.4590, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.40% (25.6658 => 25.3072, std.dev.: 0.0034) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.38% (27.1724 => 26.7976, std.dev.: 0.0695) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.20% (1.8739 => 1.8515, std.dev.: 0.0074) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.62% (0.9980 => 1.0241, std.dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: 4.18% (0.6022 => 0.6274, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: 9.84% (0.1666 => 0.1830, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.51% (0.1554 => 0.1593, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.96% (0.3083 => 0.3236, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.96% (0.2394 => 0.2441, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.24% (0.3175 => 0.3278, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.82% (0.2302 => 0.2367, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel: -2.45% (0.0449 => 0.0438, std.dev.: 0.0015) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -5.42% (0.0240 => 0.0227, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 4.69% (0.0192 => 0.0201, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.03% (0.0390 => 0.0394, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 3.32% (0.0301 => 0.0311, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.17% (0.0284 => 0.0293, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 2.78% (0.0324 => 0.0333, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: 5.65% (0.0177 => 0.0187, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -39.15% (0.0189 => 0.0115, std.dev.: 0.0042) SingleSource/UnitTests/Vector/multiplies: 4.02% (0.0249 => 0.0259, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 2.15% (0.0325 => 0.0332, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: - (0.1429 => 0.1429, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 0.90% (1.5019 => 1.5154, std.dev.: 0.0158) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 2.86% (0.1501 => 0.1544, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.88% (0.4264 => 0.4056, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.86% (0.1344 => 0.1369, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.96% (0.0589 => 0.0548, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 7.33% (0.0232 => 0.0249, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.94% (0.0639 => 0.0645, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.73% (1.1350 => 1.1267, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 350.00% (0.0006 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -20.83% (0.0024 => 0.0019, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.24% (0.0637 => 0.0559, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.20% (0.0246 => 0.0216, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.42% (0.7541 => 0.7648, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.05% (1.5363 => 1.7061, std.dev.: 0.0158) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 17.14% (0.0070 => 0.0082, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 7 08:18:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 10:18:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121007151840.7F5962A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4678?compare_to=4674&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4678, Order: 165375, Start Time: 2012-10-07 14:05:52, End Time: 2012-10-07 15:20:25 To: 4674, Order: 165374, Start Time: 2012-10-07 12:22:20, End Time: 2012-10-07 13:36:57 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (183 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1042 (753 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 22.17% (2.0176 => 2.4649, std.dev.: 0.0139) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.87% (0.1410 => 0.1662, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 15.98% (0.0826 => 0.0958, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 15.07% (0.2243 => 0.2581, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.25% (0.1072 => 0.1214) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.95% (0.0834 => 0.0942) MultiSource/Benchmarks/Olden/tsp/tsp: 12.73% (0.1013 => 0.1142, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 12.38% (0.4328 => 0.4864, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.24% (0.1413 => 0.1586, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.71% (3.9660 => 4.4303, std.dev.: 0.0126) MultiSource/Applications/lambda-0_1_3/lambda: 11.69% (0.7038 => 0.7861, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.65% (0.1588 => 0.1773, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 11.64% (0.5818 => 0.6495, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.61% (0.1327 => 0.1481, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 11.52% (0.4062 => 0.4530, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.51% (0.0964 => 0.1075, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 11.50% (0.7061 => 0.7873, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: 11.49% (1.3693 => 1.5267, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.43% (0.2721 => 0.3032, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 11.41% (0.5748 => 0.6404, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.36% (0.2596 => 0.2891, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.25% (1.2193 => 1.3565, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.21% (0.9199 => 1.0230, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 11.18% (0.2781 => 0.3092, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 11.11% (0.1062 => 0.1180, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.09% (0.7710 => 0.8565, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.04% (0.2782 => 0.3089, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.02% (1.4563 => 1.6168, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.00% (0.6283 => 0.6974, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.00% (0.5265 => 0.5844, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.98% (0.6959 => 0.7723, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.93% (0.3899 => 0.4325, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.90% (0.3485 => 0.3865, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.61% (0.4016 => 0.4442, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 10.59% (13.8202 => 15.2843, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/strcat: 10.56% (0.2726 => 0.3014, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.56% (0.3022 => 0.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 10.54% (0.2760 => 0.3051, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 10.54% (0.3293 => 0.3640, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.52% (1.1364 => 1.2559, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.49% (0.3756 => 0.4150, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.48% (0.4390 => 0.4850, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.47% (0.2655 => 0.2933, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.46% (0.3489 => 0.3854, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 10.45% (0.2690 => 0.2971, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 10.42% (0.2937 => 0.3243, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 10.40% (0.2607 => 0.2878, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 10.39% (0.2761 => 0.3048, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: 10.37% (0.1003 => 0.1107, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.35% (0.2966 => 0.3273, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 10.35% (0.2628 => 0.2900, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 10.34% (0.3453 => 0.3810, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary: 10.33% (0.3107 => 0.3428, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 10.32% (0.3868 => 0.4267, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.31% (1.9828 => 2.1872, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 10.23% (0.3149 => 0.3471, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.22% (0.3580 => 0.3946, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.16% (0.2765 => 0.3046, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.11% (0.1157 => 0.1274, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 9.96% (0.3192 => 0.3510, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.95% (0.1075 => 0.1182, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 9.95% (0.2995 => 0.3293, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.94% (0.2696 => 0.2964, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.93% (0.5577 => 0.6131, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 9.87% (0.2988 => 0.3283, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.87% (0.3130 => 0.3439, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 9.85% (1.0313 => 1.1329, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 9.85% (0.3534 => 0.3882, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.83% (0.4791 => 0.5262, std.dev.: 0.0137) SingleSource/Benchmarks/McGill/chomp: 9.82% (0.1589 => 0.1745, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 9.80% (16.6129 => 18.2413, std.dev.: 0.0078) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.75% (0.4379 => 0.4806, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 9.55% (1.1061 => 1.2117, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.52% (0.1986 => 0.2175, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.48% (0.1435 => 0.1571, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.44% (0.2914 => 0.3189, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.31% (0.5637 => 0.6162, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 9.30% (0.2945 => 0.3219, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.30% (0.3246 => 0.3548, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 9.27% (0.1111 => 0.1214) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.26% (0.2127 => 0.2324, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.25% (0.1276 => 0.1394, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.24% (0.8698 => 0.9502, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 9.22% (0.6744 => 0.7366, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 9.21% (3.8646 => 4.2205, std.dev.: 0.0090) MultiSource/Benchmarks/McCat/18-imp/imp: 9.16% (0.3220 => 0.3515, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 9.16% (0.8310 => 0.9071, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 9.03% (0.7506 => 0.8184, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.02% (0.7460 => 0.8133, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.99% (0.6576 => 0.7167, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.93% (7.2180 => 7.8628, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.85% (0.1865 => 0.2030, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 8.84% (1.9270 => 2.0973, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 8.81% (2.1791 => 2.3711, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 8.80% (0.1478 => 0.1608, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.79% (0.3755 => 0.4085, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.75% (0.2023 => 0.2200, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 8.64% (3.1889 => 3.4643, std.dev.: 0.0160) MultiSource/Benchmarks/nbench/nbench: 8.55% (1.0594 => 1.1500, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/09-vor/vor: 8.48% (0.2925 => 0.3173, std.dev.: 0.0018) MultiSource/Benchmarks/sim/sim: 8.34% (0.3131 => 0.3392, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.32% (0.8818 => 0.9552, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 8.27% (0.1657 => 0.1794, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.24% (3.6692 => 3.9716, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.22% (0.1569 => 0.1698, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 8.20% (1.2749 => 1.3794, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.18% (1.3245 => 1.4328, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.16% (0.1789 => 0.1935, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 8.05% (14.8535 => 16.0491, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.99% (4.3801 => 4.7301, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.94% (4.4433 => 4.7960, std.dev.: 0.0070) MultiSource/Benchmarks/mafft/pairlocalalign: 7.90% (8.4961 => 9.1672, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.82% (0.6135 => 0.6615, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 7.80% (0.4113 => 0.4434, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.74% (0.3914 => 0.4217, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/parameter-passing: 7.67% (0.4003 => 0.4310, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.66% (0.2140 => 0.2304, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.55% (0.3578 => 0.3848, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.44% (4.9865 => 5.3575, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/for-in: 7.42% (0.3789 => 0.4070, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 7.40% (4.6629 => 5.0078, std.dev.: 0.0145) SingleSource/Benchmarks/Misc-C++/bigfib: 7.39% (0.6250 => 0.6712, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.39% (0.3601 => 0.3867, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.39% (0.3940 => 0.4231, std.dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: 7.36% (1.2292 => 1.3197, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-4: 7.35% (0.3646 => 0.3914, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.32% (0.3511 => 0.3768) SingleSource/UnitTests/ObjC/synchronized: 7.29% (0.3663 => 0.3930, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.26% (0.3650 => 0.3915, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.20% (0.3623 => 0.3884, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.20% (1.5188 => 1.6281, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.19% (0.9108 => 0.9763, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.19% (0.2504 => 0.2684, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.10% (1.1333 => 1.2138, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.01% (0.4805 => 0.5142, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.00% (3.2742 => 3.5033, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.87% (0.3245 => 0.3468, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 6.82% (0.2008 => 0.2145, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 6.69% (6.5754 => 7.0155, std.dev.: 0.0096) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.46% (0.2321 => 0.2471, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.43% (6.2785 => 6.6823, std.dev.: 0.0036) MultiSource/Applications/lua/lua: 6.33% (3.7467 => 3.9837, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.27% (0.1819 => 0.1933, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.16% (2.1007 => 2.2301, std.dev.: 0.0185) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.52% (13.2842 => 14.0170, std.dev.: 0.0161) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.59% (0.2243 => 0.2346, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 3.77% (16.2614 => 16.8751, std.dev.: 0.0283) MultiSource/Applications/ClamAV/clamscan: 3.63% (14.5298 => 15.0566, std.dev.: 0.0204) MultiSource/Benchmarks/Bullet/bullet: 1.43% (33.2944 => 33.7709, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.41% (5.7573 => 7.5083, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.09% (1.0895 => 1.3629, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/fbench: 24.95% (1.8175 => 2.2709, std.dev.: 0.0114) SingleSource/Benchmarks/Misc/richards_benchmark: 11.05% (1.1560 => 1.2837, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.03% (0.8273 => 0.9020, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.47% (0.1322 => 0.1434, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4142, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.17% (1.2998 => 1.3800, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.65% (1.9144 => 2.0035, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.87% (1.7081 => 1.7742, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.67% (11.2619 => 11.6751, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9851, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 3.37% (10.7476 => 11.1098, std.dev.: 0.0150) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.17% (7.4271 => 7.5879, std.dev.: 0.0060) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4529, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5122, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9696, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1875, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.20% (5.5130 => 5.5790, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists: 1.10% (12.4560 => 12.5926, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0274, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0073) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.12% (0.2670 => 0.1412, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.72% (0.4657 => 0.3925, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -15.28% (0.0707 => 0.0599, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.91% (1.3813 => 1.1892, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.86% (1.3819 => 1.1903, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.06% (22.5627 => 21.8731, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.34% (0.0997 => 0.0864, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -11.93% (0.2238 => 0.1971, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.27% (1.2308 => 1.0921, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.21% (20.3410 => 18.2638, std.dev.: 0.0162) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.20% (1.3780 => 1.2926, std.dev.: 0.0077) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5138, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8004, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.90% (0.9996 => 0.9606, std.dev.: 0.0035) MultiSource/Applications/siod/siod: -3.59% (3.2729 => 3.1554, std.dev.: 0.0048) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.39% (1.7688 => 1.7089, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.02% (0.4867 => 0.4720, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -2.66% (26.5159 => 25.8108, std.dev.: 0.0185) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.41% (3.0263 => 2.9535, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.34% (1.9762 => 1.9299, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.88% (0.6589 => 0.6465, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.81% (6.3560 => 6.2412, std.dev.: 0.0055) MultiSource/Benchmarks/mafft/pairlocalalign: -1.79% (28.2225 => 27.7184, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.56% (0.6615 => 0.6512, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0076, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8672, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: -1.25% (4.5928 => 4.5355, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4955, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2583, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.01% (6.6320 => 6.5649, std.dev.: 0.0101) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 7 10:10:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 12:10:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121007171035.EC3BF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4679?compare_to=4676&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4679, Order: 165375, Start Time: 2012-10-07 14:28:46, End Time: 2012-10-07 17:12:21 To: 4676, Order: 165373, Start Time: 2012-10-07 11:16:22, End Time: 2012-10-07 13:59:54 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (132 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 1041 (831 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.26% (2.7866 => 2.8218, std.dev.: 0.0057) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 11.96% (0.3446 => 0.3858, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 11.95% (0.3465 => 0.3879, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.95% (0.1063 => 0.1190, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.87% (0.3496 => 0.3911, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.85% (0.3460 => 0.3870, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.85% (0.3469 => 0.3880, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.84% (0.3488 => 0.3901, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 11.77% (0.3442 => 0.3847, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.67% (0.3650 => 0.4076, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 11.63% (1.5932 => 1.7785, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions: 11.50% (0.3643 => 0.4062, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.33% (0.3724 => 0.4146, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.73% (0.5826 => 0.6393, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.61% (0.5889 => 0.6455, std.dev.: 0.0047) SingleSource/UnitTests/ObjC++/property-reference: 8.21% (0.7171 => 0.7760, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/05-eks/eks: 7.97% (0.1619 => 0.1748, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.97% (0.2875 => 0.3104, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.74% (0.2725 => 0.2936, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.72% (0.3004 => 0.3236, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.70% (0.2714 => 0.2923, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.70% (0.2792 => 0.3007, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.59% (1.3152 => 1.4150, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.56% (0.2738 => 0.2945, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 7.55% (0.2780 => 0.2990, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.55% (0.2729 => 0.2935, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.51% (0.3195 => 0.3435, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.50% (0.2813 => 0.3024, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.50% (0.4361 => 0.4688, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 7.49% (0.2803 => 0.3013, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.49% (0.4994 => 0.5368, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.46% (1.6211 => 1.7420, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.44% (2.0673 => 2.2212, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 7.44% (0.2823 => 0.3033, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.44% (0.2811 => 0.3020, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.42% (0.2911 => 0.3127, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.42% (0.5000 => 0.5371, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 7.42% (0.2750 => 0.2954, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.32% (0.4139 => 0.4442, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 7.31% (0.9909 => 1.0633, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 7.30% (0.3096 => 0.3322, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.28% (0.1620 => 0.1738, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.21% (0.3258 => 0.3493, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 7.16% (0.3477 => 0.3726, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.14% (3.5627 => 3.8172, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: 7.13% (0.3267 => 0.3500, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.12% (0.4146 => 0.4441, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.09% (0.3060 => 0.3277, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 7.02% (5.5417 => 5.9309, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 7.00% (1.0781 => 1.1536, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary2: 6.99% (0.3317 => 0.3549, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.99% (0.3678 => 0.3935, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.96% (0.3362 => 0.3596, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.95% (0.3282 => 0.3510, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.92% (2.7292 => 2.9180, std.dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.90% (0.2014 => 0.2153, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 6.90% (0.3348 => 0.3579, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 6.87% (0.4847 => 0.5180, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.84% (0.3625 => 0.3873, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.82% (0.3726 => 0.3980, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.78% (0.5026 => 0.5367, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.75% (0.3124 => 0.3335, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.65% (0.2736 => 0.2918, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.62% (0.3930 => 0.4190, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.59% (0.3690 => 0.3933, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 6.56% (23.5202 => 25.0639, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/hash2: 6.56% (0.4251 => 0.4530, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.53% (0.3981 => 0.4241, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.45% (0.2866 => 0.3051, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.41% (4.4195 => 4.7028, std.dev.: 0.0028) MultiSource/Applications/ClamAV/clamscan: 6.35% (4.2109 => 4.4784, std.dev.: 0.0110) MultiSource/Benchmarks/nbench/nbench: 6.35% (0.2566 => 0.2729, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.32% (0.3845 => 0.4088, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.19% (0.5900 => 0.6265, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.17% (0.3890 => 0.4130, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.15% (0.1968 => 0.2089, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.12% (0.3903 => 0.4142, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.06% (0.2969 => 0.3149, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: 6.02% (1.8794 => 1.9925, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 6.00% (2.1013 => 2.2273, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.97% (0.6435 => 0.6819, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 5.95% (0.6634 => 0.7029, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: 5.95% (0.5012 => 0.5310, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.92% (0.2737 => 0.2899, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 5.88% (0.4029 => 0.4266, std.dev.: 0.0047) MultiSource/Applications/JM/lencod/lencod: 5.83% (4.6177 => 4.8870, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.80% (0.3084 => 0.3263, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.80% (0.2068 => 0.2188, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.75% (0.4658 => 0.4926, std.dev.: 0.0081) MultiSource/Applications/lua/lua: 5.70% (1.4269 => 1.5082, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 5.66% (2.1653 => 2.2879, std.dev.: 0.0025) MultiSource/Applications/Burg/burg: 5.64% (0.5546 => 0.5859, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.59% (0.2040 => 0.2154) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.47% (0.3271 => 0.3450, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 5.37% (0.3336 => 0.3515, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.33% (0.2103 => 0.2215, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 5.25% (0.2075 => 0.2184, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 5.20% (0.9697 => 1.0201, std.dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: 5.08% (2.0346 => 2.1380, std.dev.: 0.0060) MultiSource/Applications/treecc/treecc: 5.02% (0.7875 => 0.8270, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.94% (1.9694 => 2.0666, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.87% (1.9966 => 2.0939, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 4.64% (0.2391 => 0.2502, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 4.46% (0.2691 => 0.2811, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.46% (0.7426 => 0.7757, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.36% (0.5361 => 0.5595, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.01% (0.5584 => 0.5808, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.98% (11.6398 => 12.1031, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 3.60% (0.3498 => 0.3624, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.58% (4.6926 => 4.8606, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.17% (0.4253 => 0.4388, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.66% (0.3792 => 0.3893, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 2.59% (11.9555 => 12.2652, std.dev.: 0.0210) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.22% (0.5917 => 0.6699, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6108, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6758, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-2: 4.95% (1.8057 => 1.8950, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: 4.74% (15.4430 => 16.1749, std.dev.: 0.0128) SingleSource/Benchmarks/Dhrystone/dry: 4.18% (14.0481 => 14.6354, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1976, std.dev.: 0.0058) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5060, std.dev.: 0.0240) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.59% (3.1722 => 3.2226, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2852, std.dev.: 0.0044) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.13% (1.0927 => 1.1051, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5846, std.dev.: 0.0104) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.86% (25.4195 => 16.5587, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/ary2: -8.62% (0.2402 => 0.2195, std.dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9766, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7958, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9573, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8010, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.04% (0.6293 => 0.6102, std.dev.: 0.0059) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7727, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.66% (17.2379 => 16.7800, std.dev.: 0.0482) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8590, std.dev.: 0.0074) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5758, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4958, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.19% (105.3826 => 104.1305, std.dev.: 0.0937) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0431, std.dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 7 10:22:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 12:22:45 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121007172245.A59D62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4680?compare_to=4677&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4680, Order: 165377, Start Time: 2012-10-07 16:01:36, End Time: 2012-10-07 17:24:32 To: 4677, Order: 165375, Start Time: 2012-10-07 13:47:39, End Time: 2012-10-07 15:10:12 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (14 on baseline) Performance Regressions: 5 (90 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 972 (756 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 6.05% (8.3026 => 8.8048, std.dev.: 0.1113) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 13.65% (0.7743 => 0.8800, std.dev.: 0.0261) MultiSource/Benchmarks/Olden/mst/mst: 10.14% (0.1400 => 0.1542, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.12% (2.4671 => 2.5933, std.dev.: 0.0336) MultiSource/Benchmarks/Bullet/bullet: 2.31% (7.1604 => 7.3261, std.dev.: 0.0412) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.13% (1.0241 => 1.0254, std.dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: 0.13% (0.6274 => 0.6282, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/08-main/main: -10.38% (0.1830 => 0.1640, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.08% (0.1593 => 0.1528, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.16% (0.3236 => 0.3166, std.dev.: 0.0128) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.83% (0.2441 => 0.2372, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.55% (0.3278 => 0.3260, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.77% (0.2367 => 0.2325, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel: 5.48% (0.0438 => 0.0462, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.32% (0.0227 => 0.0230, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.50% (0.0201 => 0.0200, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.25% (0.0394 => 0.0395, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -25.40% (0.0311 => 0.0232, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.68% (0.0293 => 0.0291, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.60% (0.0333 => 0.0331, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -0.53% (0.0187 => 0.0186, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/test1: 26.09% (0.0115 => 0.0145, std.dev.: 0.0028) SingleSource/UnitTests/Vector/multiplies: -5.79% (0.0259 => 0.0244, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: 0.60% (0.0332 => 0.0334, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.35% (0.1429 => 0.1424, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -2.14% (1.5154 => 1.4830, std.dev.: 0.0464) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.43% (0.1544 => 0.1491, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.05% (0.4056 => 0.4058, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.68% (0.1369 => 0.1392, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.83% (0.0548 => 0.0527, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -32.13% (0.0249 => 0.0169, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.53% (0.0645 => 0.0590, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.58% (1.1267 => 1.1332, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0027 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -73.68% (0.0019 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.70% (0.0559 => 0.0630, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.85% (0.0216 => 0.0212, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.16% (0.7648 => 0.7660, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.03% (1.7061 => 1.7056, std.dev.: 0.0012) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 47.56% (0.0082 => 0.0121, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 146.07% (0.0089 => 0.0219, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: 171.11% (0.0090 => 0.0244, std.dev.: 0.0004) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -27.22% (4.1772 => 3.0400, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/except: 82566.67% (0.0006 => 0.4960, std.dev.: 0.0015) SingleSource/Regression/C++/EH/ctor_dtor_count: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.09% (0.0745 => 0.0917, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.35% (0.1159 => 0.1279, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 9.83% (0.1414 => 0.1553, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.72% (0.6410 => 0.7033, std.dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: 9.63% (2.1763 => 2.3859, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.93% (0.3582 => 0.3902, std.dev.: 0.0042) MultiSource/Applications/minisat/minisat: 8.93% (0.6173 => 0.6724, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 8.48% (0.5309 => 0.5759, std.dev.: 0.0088) MultiSource/Applications/SIBsim4/SIBsim4: 7.96% (1.1653 => 1.2581, std.dev.: 0.0065) MultiSource/Applications/lemon/lemon: 7.27% (1.0046 => 1.0776, std.dev.: 0.0155) MultiSource/Applications/kimwitu++/kc: 7.16% (15.3105 => 16.4067, std.dev.: 0.0450) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.79% (1.5150 => 1.6179, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.78% (0.2552 => 0.2725, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/18-imp/imp: 6.62% (0.3217 => 0.3430, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.55% (0.7639 => 0.8139, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.39% (0.4880 => 0.5192, std.dev.: 0.0070) MultiSource/Applications/lambda-0_1_3/lambda: 6.39% (0.6915 => 0.7357, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.18% (0.6069 => 0.6444, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.79% (0.2797 => 0.2959, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.58% (1.2021 => 1.2692, std.dev.: 0.0123) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.35% (6.2546 => 6.5891, std.dev.: 0.0427) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.32% (0.4248 => 0.4474, std.dev.: 0.0038) MultiSource/Applications/d/make_dparser: 5.19% (3.0225 => 3.1794, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.17% (1.1827 => 1.2438, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.08% (1.1672 => 1.2265, std.dev.: 0.0104) MultiSource/Applications/hbd/hbd: 5.01% (1.3268 => 1.3933, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.90% (12.6413 => 13.2603, std.dev.: 0.0778) MultiSource/Applications/lua/lua: 4.88% (3.5980 => 3.7737, std.dev.: 0.0231) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.85% (0.2886 => 0.3026, std.dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: 4.75% (29.3170 => 30.7096, std.dev.: 0.2668) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.53% (0.8569 => 0.8957, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.52% (0.2654 => 0.2774, std.dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 4.48% (8.2186 => 8.5864, std.dev.: 0.0793) MultiSource/Applications/oggenc/oggenc: 4.46% (4.7455 => 4.9572, std.dev.: 0.0287) MultiSource/Benchmarks/Prolangs-C/football/football: 4.44% (0.8405 => 0.8778, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.41% (0.3062 => 0.3197, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.32% (1.4408 => 1.5031, std.dev.: 0.0103) MultiSource/Applications/SPASS/SPASS: 4.30% (13.3238 => 13.8961, std.dev.: 0.0629) MultiSource/Benchmarks/nbench/nbench: 4.29% (1.0821 => 1.1285, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.17% (0.7226 => 0.7527, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/09-vor/vor: 4.10% (0.3026 => 0.3150, std.dev.: 0.0032) MultiSource/Applications/siod/siod: 4.04% (2.0972 => 2.1820, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (3.0758 => 3.1965, std.dev.: 0.0293) MultiSource/Applications/sgefa/sgefa: 3.89% (0.2877 => 0.2989, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.78% (4.0318 => 4.1843, std.dev.: 0.0307) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.75% (2.0317 => 2.1078, std.dev.: 0.0182) MultiSource/Benchmarks/Olden/bh/bh: 3.69% (0.2820 => 0.2924, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.62% (0.2952 => 0.3059, std.dev.: 0.0016) MultiSource/Applications/treecc/treecc: 3.53% (1.8798 => 1.9462, std.dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.50% (0.5937 => 0.6145, std.dev.: 0.0060) MultiSource/Applications/JM/lencod/lencod: 3.43% (14.7256 => 15.2305, std.dev.: 0.0576) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.35% (0.5963 => 0.6163, std.dev.: 0.0043) MultiSource/Benchmarks/sim/sim: 3.34% (0.3084 => 0.3187, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 3.21% (6.4908 => 6.6993, std.dev.: 0.0262) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.17% (4.2616 => 4.3966, std.dev.: 0.0486) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.16% (0.3418 => 0.3526, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.15% (4.3380 => 4.4745, std.dev.: 0.0135) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.13% (1.0689 => 1.1024, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.13% (1.2742 => 1.3141, std.dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.09% (0.4562 => 0.4703, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.09% (4.2815 => 4.4138, std.dev.: 0.0394) MultiSource/Applications/Burg/burg: 3.04% (1.1440 => 1.1788, std.dev.: 0.0105) MultiSource/Benchmarks/MallocBench/gs/gs: 3.01% (3.8796 => 3.9963, std.dev.: 0.0194) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.81% (0.4596 => 0.4725, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.52% (8.2559 => 8.4640, std.dev.: 0.0450) MultiSource/Applications/hexxagon/hexxagon: 2.27% (0.9425 => 0.9639, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.37% (1.6538 => 2.3380, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2284, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: 14.77% (1.7426 => 2.0000, std.dev.: 0.0140) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.26% (2.4042 => 2.7471, std.dev.: 0.0517) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.31% (4.0101 => 4.5439, std.dev.: 0.0184) SingleSource/Benchmarks/Stanford/Puzzle: 12.56% (0.1433 => 0.1613, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: 11.01% (1.6261 => 1.8051, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/mst/mst: 8.82% (0.1417 => 0.1542, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/lists: 8.76% (7.0025 => 7.6160, std.dev.: 0.0084) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.47% (0.2857 => 0.3099, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/mason/mason: 8.27% (0.5004 => 0.5418, std.dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.06% (1.0063 => 1.0874, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.27% (0.3301 => 0.3508, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.09% (4.2129 => 4.4693, std.dev.: 0.0583) MultiSource/Benchmarks/Bullet/bullet: 5.08% (6.9722 => 7.3261, std.dev.: 0.0412) SingleSource/Benchmarks/Misc/dt: 4.31% (0.9851 => 1.0276, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: 4.16% (15.2242 => 15.8573, std.dev.: 0.0570) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.88% (3.4080 => 3.5401, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.02% (0.5587 => 0.5756, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.84% (6.6312 => 6.8192, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash: 2.66% (0.6308 => 0.6476, std.dev.: 0.0045) MultiSource/Applications/siod/siod: 2.15% (3.5520 => 3.6284, std.dev.: 0.0187) MultiSource/Benchmarks/Olden/power/power: 1.45% (1.4184 => 1.4389, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 1.02% (4.6414 => 4.6889, std.dev.: 0.0181) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.16% (0.0591 => 0.0330, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -43.62% (0.2996 => 0.1689, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.72% (1.4189 => 1.1533, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.62% (1.4113 => 1.1485, std.dev.: 0.0231) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.38% (0.3497 => 0.2120, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.33% (5.2665 => 4.1429, std.dev.: 0.0374) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.10% (1.7361 => 1.4739, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/sieve: -12.25% (8.1594 => 7.1597, std.dev.: 0.1126) MultiSource/Benchmarks/McCat/17-bintr/bintr: -11.45% (0.0917 => 0.0812, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -11.42% (15.8312 => 14.0228, std.dev.: 0.3112) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.41% (1.1647 => 1.0551, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -9.01% (3.2007 => 2.9124, std.dev.: 0.0204) SingleSource/Benchmarks/Misc/flops: -8.39% (9.5474 => 8.7459, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.28% (1.4034 => 1.2872, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.82% (3.6254 => 3.3782, std.dev.: 0.0302) MultiSource/Applications/lambda-0_1_3/lambda: -6.75% (7.6833 => 7.1647, std.dev.: 0.0686) SingleSource/Benchmarks/Misc/richards_benchmark: -6.54% (1.4441 => 1.3497, std.dev.: 0.0230) SingleSource/Benchmarks/Shootout-C++/fibo: -6.51% (4.6355 => 4.3336, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.98% (2.9728 => 2.7950, std.dev.: 0.0036) MultiSource/Applications/sgefa/sgefa: -5.85% (0.3746 => 0.3527, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.47% (3.9413 => 3.7259, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -5.22% (4.4195 => 4.1887, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/bh/bh: -4.83% (2.5166 => 2.3950, std.dev.: 0.0173) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -4.47% (61.1734 => 58.4383, std.dev.: 0.7318) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.32% (0.4564 => 0.4367, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -4.15% (62.4126 => 59.8248, std.dev.: 0.3293) SingleSource/Benchmarks/Shootout-C++/methcall: -3.38% (9.2503 => 8.9379, std.dev.: 0.0132) SingleSource/Benchmarks/McGill/misr: -3.33% (0.4296 => 0.4153, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.85% (0.4140 => 0.4022, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.79% (3.7496 => 3.6449, std.dev.: 0.0203) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.58% (1.1683 => 1.1381, std.dev.: 0.0109) SingleSource/Benchmarks/Dhrystone/dry: -2.19% (2.4013 => 2.3486, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -2.17% (92.7467 => 90.7347, std.dev.: 0.6875) MultiSource/Applications/SIBsim4/SIBsim4: -2.16% (3.4230 => 3.3491, std.dev.: 0.0182) MultiSource/Applications/aha/aha: -2.00% (3.4286 => 3.3599, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/hash2: -1.95% (3.4876 => 3.4197, std.dev.: 0.0019) MultiSource/Benchmarks/sim/sim: -1.68% (3.8907 => 3.8252, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.63% (1.0686 => 1.0512, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -1.59% (1.0926 => 1.0752, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.53% (9.3855 => 9.2417, std.dev.: 0.0077) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3130, std.dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: -1.34% (6.7458 => 6.6555, std.dev.: 0.0233) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.19% (27.1724 => 26.8480, std.dev.: 0.0611) SingleSource/Benchmarks/Dhrystone/fldry: -1.12% (2.4971 => 2.4692, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fbench: -1.03% (3.4659 => 3.4302, std.dev.: 0.0051) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.75% (0.9980 => 1.0254, std.dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: 4.32% (0.6022 => 0.6282, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/08-main/main: -1.56% (0.1666 => 0.1640, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.67% (0.1554 => 0.1528, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.69% (0.3083 => 0.3166, std.dev.: 0.0128) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.92% (0.2394 => 0.2372, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.68% (0.3175 => 0.3260, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.00% (0.2302 => 0.2325, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel: 2.90% (0.0449 => 0.0462, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -4.17% (0.0240 => 0.0230, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 4.17% (0.0192 => 0.0200, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.28% (0.0390 => 0.0395, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -22.92% (0.0301 => 0.0232, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.46% (0.0284 => 0.0291, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 2.16% (0.0324 => 0.0331, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 5.08% (0.0177 => 0.0186, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/test1: -23.28% (0.0189 => 0.0145, std.dev.: 0.0028) SingleSource/UnitTests/Vector/multiplies: -2.01% (0.0249 => 0.0244, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: 2.77% (0.0325 => 0.0334, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.35% (0.1429 => 0.1424, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -1.26% (1.5019 => 1.4830, std.dev.: 0.0464) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.67% (0.1501 => 0.1491, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.83% (0.4264 => 0.4058, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.57% (0.1344 => 0.1392, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.53% (0.0589 => 0.0527, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -27.16% (0.0232 => 0.0169, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.67% (0.0639 => 0.0590, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.16% (1.1350 => 1.1332, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 350.00% (0.0006 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.10% (0.0637 => 0.0630, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.82% (0.0246 => 0.0212, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.58% (0.7541 => 0.7660, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.02% (1.5363 => 1.7056, std.dev.: 0.0012) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 7 10:27:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 12:27:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121007172702.4C9DF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4681?compare_to=4678&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4681, Order: 165377, Start Time: 2012-10-07 16:14:10, End Time: 2012-10-07 17:28:47 To: 4678, Order: 165375, Start Time: 2012-10-07 14:05:52, End Time: 2012-10-07 15:20:25 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (183 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1041 (753 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.22% (77.8768 => 80.3868, std.dev.: 0.2232) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 22.10% (2.0176 => 2.4635, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.87% (0.1410 => 0.1662, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 15.86% (0.0826 => 0.0957, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 15.02% (0.2243 => 0.2580, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.15% (0.1072 => 0.1213, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.83% (0.0834 => 0.0941, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 12.73% (0.1013 => 0.1142, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 12.32% (0.4328 => 0.4861, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.31% (0.1413 => 0.1587, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 12.24% (0.1062 => 0.1192, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.72% (3.9660 => 4.4308, std.dev.: 0.0107) SingleSource/UnitTests/ObjC++/property-reference-object: 11.69% (0.5818 => 0.6498, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.68% (0.1327 => 0.1482, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.62% (0.0964 => 0.1076, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.59% (0.1588 => 0.1772, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.58% (0.2721 => 0.3036, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 11.57% (0.4062 => 0.4532, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 11.52% (0.7038 => 0.7849, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 11.51% (0.7061 => 0.7874, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 11.50% (1.3693 => 1.5268, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.36% (0.2596 => 0.2891, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 11.34% (0.5748 => 0.6400, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.22% (0.6283 => 0.6988) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.22% (0.9199 => 1.0231, std.dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: 11.18% (0.2781 => 0.3092, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.17% (1.2193 => 1.3555, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.13% (0.5265 => 0.5851, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.04% (0.7710 => 0.8561, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.03% (1.4563 => 1.6170, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.89% (0.6959 => 0.7717, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.88% (0.3485 => 0.3864, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.86% (0.2782 => 0.3084, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.82% (0.3899 => 0.4321, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.69% (0.3022 => 0.3345, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.67% (1.1364 => 1.2576, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.63% (0.4016 => 0.4443, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 10.59% (13.8202 => 15.2835, std.dev.: 0.0191) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.54% (0.3756 => 0.4152, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 10.52% (0.2690 => 0.2973, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 10.51% (0.2607 => 0.2881, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 10.48% (0.3293 => 0.3638, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/strcat: 10.45% (0.2726 => 0.3011, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.40% (0.2655 => 0.2931, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 10.39% (0.2628 => 0.2901, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 10.38% (0.2937 => 0.3242, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 10.37% (0.3868 => 0.4269, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 10.36% (0.2761 => 0.3047, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.35% (0.3489 => 0.3850, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 10.33% (0.2760 => 0.3045, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.32% (0.2966 => 0.3272, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 10.31% (0.3453 => 0.3809, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.29% (0.1157 => 0.1276, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.28% (1.9828 => 2.1867, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.28% (0.3580 => 0.3948, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 10.27% (0.1003 => 0.1106, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 10.26% (0.3149 => 0.3472, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 10.23% (0.3107 => 0.3425, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.16% (0.2765 => 0.3046, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 10.09% (0.3192 => 0.3514, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.05% (0.1075 => 0.1183, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.98% (0.4390 => 0.4828, std.dev.: 0.0029) MultiSource/Applications/kimwitu++/kc: 9.88% (16.6129 => 18.2542, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.87% (0.2696 => 0.2962, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.85% (0.4791 => 0.5263, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 9.85% (1.0313 => 1.1329, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 9.85% (0.2995 => 0.3290, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 9.81% (0.2988 => 0.3281, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 9.79% (0.3534 => 0.3880, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.78% (0.3130 => 0.3436, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.77% (0.4379 => 0.4807, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.77% (0.1986 => 0.2180, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 9.75% (0.1589 => 0.1744, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.74% (0.5577 => 0.6120, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.48% (0.1435 => 0.1571, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.47% (0.2914 => 0.3190, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.45% (0.2127 => 0.2328, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 9.45% (1.1061 => 1.2106, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.40% (0.1276 => 0.1396, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.40% (0.3246 => 0.3551, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.30% (0.8698 => 0.9507, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 9.24% (0.2945 => 0.3217, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.22% (0.5637 => 0.6157, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 9.15% (0.6744 => 0.7361, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 9.13% (3.8646 => 4.2175, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: 9.12% (0.8310 => 0.9068, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/mst/mst: 9.09% (0.1111 => 0.1212, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 9.07% (0.3220 => 0.3512, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.06% (0.7460 => 0.8136, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.03% (0.6576 => 0.7170, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.95% (7.2180 => 7.8641, std.dev.: 0.0028) MultiSource/Applications/spiff/spiff: 8.94% (0.7506 => 0.8177, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.76% (0.3755 => 0.4084, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.75% (0.2023 => 0.2200, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 8.74% (3.1889 => 3.4676, std.dev.: 0.0049) MultiSource/Applications/siod/siod: 8.69% (2.1791 => 2.3684, std.dev.: 0.0023) MultiSource/Applications/treecc/treecc: 8.68% (1.9270 => 2.0943, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.63% (0.1865 => 0.2026, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 8.53% (0.1478 => 0.1604, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 8.48% (0.2925 => 0.3173, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 8.45% (1.0594 => 1.1489, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.29% (0.8818 => 0.9549, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/em3d/em3d: 8.27% (0.1657 => 0.1794, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 8.24% (0.3131 => 0.3389, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.22% (0.1569 => 0.1698, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.16% (3.6692 => 3.9686, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.15% (1.3245 => 1.4324, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 8.11% (14.8535 => 16.0588, std.dev.: 0.0047) MultiSource/Applications/SIBsim4/SIBsim4: 8.06% (1.2749 => 1.3776, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.05% (0.1789 => 0.1933, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.01% (4.3801 => 4.7309, std.dev.: 0.0112) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.92% (4.4433 => 4.7953, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 7.87% (8.4961 => 9.1644, std.dev.: 0.0113) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.86% (0.6135 => 0.6617, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 7.83% (0.4113 => 0.4435, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.66% (0.2140 => 0.2304, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/parameter-passing: 7.64% (0.4003 => 0.4309, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.59% (0.3914 => 0.4211, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.51% (4.9865 => 5.3610, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.46% (0.3511 => 0.3773, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 7.43% (0.3578 => 0.3844, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.37% (0.3663 => 0.3933, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.36% (0.3789 => 0.4068, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/property: 7.36% (0.3940 => 0.4230, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.35% (0.3646 => 0.3914) MultiSource/Applications/hexxagon/hexxagon: 7.35% (1.2292 => 1.3195, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 7.35% (4.6629 => 5.0054, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/exceptions-3: 7.34% (0.3623 => 0.3889, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.30% (0.3601 => 0.3864, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 7.26% (0.6250 => 0.6704, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.19% (0.9108 => 0.9763, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.18% (0.3650 => 0.3912, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.18% (1.5188 => 1.6278, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.07% (0.2504 => 0.2681, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.05% (1.1333 => 1.2132, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.93% (3.2742 => 3.5012, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.93% (0.4805 => 0.5138, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.81% (0.3245 => 0.3466, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 6.77% (0.2008 => 0.2144, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 6.59% (6.5754 => 7.0090, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.59% (0.2321 => 0.2474, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.42% (6.2785 => 6.6817, std.dev.: 0.0137) MultiSource/Applications/lua/lua: 6.39% (3.7467 => 3.9860, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.26% (2.1007 => 2.2321, std.dev.: 0.0158) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.94% (0.1819 => 0.1927, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.47% (13.2842 => 14.0111, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.59% (0.2243 => 0.2346, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 3.82% (16.2614 => 16.8825, std.dev.: 0.0034) MultiSource/Applications/ClamAV/clamscan: 3.72% (14.5298 => 15.0705, std.dev.: 0.0052) MultiSource/Benchmarks/Bullet/bullet: 1.32% (33.2944 => 33.7353, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5178, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.36% (1.8175 => 2.2603, std.dev.: 0.0262) SingleSource/Benchmarks/Misc/richards_benchmark: 10.98% (1.1560 => 1.2829, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 8.99% (0.8273 => 0.9017, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.62% (3.1736 => 3.4153, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.29% (1.2998 => 1.3815, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.68% (0.3139 => 0.3286, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.65% (1.9144 => 2.0035, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7748, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6759, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.44% (10.7476 => 11.1168, std.dev.: 0.0510) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9849, std.dev.: 0.0015) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.17% (7.4271 => 7.5882, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.56% (1.4298 => 1.4521, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5145, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1876, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5781, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0268, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1407, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 1.03% (12.4560 => 12.5849, std.dev.: 0.0055) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.12% (0.2670 => 0.1412, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.74% (0.4657 => 0.3924, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -15.28% (0.0707 => 0.0599) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.84% (1.3813 => 1.1901, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.84% (1.3819 => 1.1907, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.05% (22.5627 => 21.8747, std.dev.: 0.0095) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.11% (0.2238 => 0.1967, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.92% (1.2308 => 1.0964, std.dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.01% (20.3410 => 18.3052, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.70% (1.3780 => 1.2995, std.dev.: 0.0100) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -5.12% (2.6470 => 2.5116, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.49% (0.9996 => 0.9547, std.dev.: 0.0099) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8005, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.56% (3.2729 => 3.1563, std.dev.: 0.0240) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.41% (1.7688 => 1.7085, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.16% (0.4867 => 0.4713, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -2.58% (26.5159 => 25.8325, std.dev.: 0.0265) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4781, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.43% (3.0263 => 2.9528, std.dev.: 0.0012) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.34% (1.9762 => 1.9300, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.96% (0.6589 => 0.6460, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7154, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/lists: -1.69% (6.3560 => 6.2483, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.56% (0.6615 => 0.6512) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0063, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -1.27% (4.5928 => 4.5347, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8681, std.dev.: 0.0153) MultiSource/Applications/minisat/minisat: -1.24% (9.3358 => 9.2204, std.dev.: 0.0200) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4949, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -1.15% (5.3167 => 5.2558, std.dev.: 0.0029) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 7 10:31:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 12:31:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121007173155.8334C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4682?compare_to=4675&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4682, Order: 165377, Start Time: 2012-10-07 16:14:17, End Time: 2012-10-07 17:33:41 To: 4675, Order: 165375, Start Time: 2012-10-07 12:28:23, End Time: 2012-10-07 13:47:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (153 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1024 (764 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.73% (3.7561 => 3.8588, std.dev.: 0.0174) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.07% (0.5877 => 0.5881, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 0.03% (16.2201 => 16.2256, std.dev.: 0.0051) MultiSource/Benchmarks/Bullet/bullet: -0.00% (54.8765 => 54.8741, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/gs/gs: 0.00% (4.3790 => 4.3792, std.dev.: 0.0134) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.11% (1.2473 => 1.2459, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.03% (7.7654 => 7.7680, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.09% (0.7386 => 0.7393, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.55% (0.0366 => 0.0364, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.2140 => 0.2140, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -13.23% (63.2438 => 54.8741, std.dev.: 0.0045) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.37% (14.1553 => 18.7371, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++-EH/spirit: 61.08% (3.4629 => 5.5782, std.dev.: 0.0143) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14229.72% (0.0720 => 10.3174, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9951700.00% (0.0001 => 9.9518, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 51.25% (0.2554 => 0.3863, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 48.75% (10.3673 => 15.4213, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/richards_benchmark: 30.95% (0.1622 => 0.2124, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: 30.87% (0.1056 => 0.1382, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.49% (2.2022 => 2.5434, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 15.43% (0.1432 => 0.1653, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.81% (7.0540 => 8.0984, std.dev.: 0.0050) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.56% (0.1566 => 0.1794, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.49% (1.7609 => 1.9809, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.17% (0.0871 => 0.0977, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 11.88% (0.3282 => 0.3672, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.92% (0.1584 => 0.1757, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 10.34% (0.3473 => 0.3832, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.19% (0.3543 => 0.3904, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.13% (0.3516 => 0.3872, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.12% (0.3497 => 0.3851, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.11% (0.3561 => 0.3921, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.10% (0.3543 => 0.3901, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.96% (0.3694 => 0.4062, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 9.93% (0.1440 => 0.1583, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.85% (0.3927 => 0.4314, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.85% (0.3828 => 0.4205, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.68% (0.3886 => 0.4262, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.37% (0.4879 => 0.5336, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.32% (0.1438 => 0.1572, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 9.13% (9.4845 => 10.3508, std.dev.: 0.0081) SingleSource/Benchmarks/McGill/chomp: 9.12% (0.1655 => 0.1806, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.11% (0.6675 => 0.7283, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 9.07% (0.7433 => 0.8107, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 9.04% (0.7115 => 0.7758, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.97% (0.3177 => 0.3462, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.86% (0.4615 => 0.5024, std.dev.: 0.0054) MultiSource/Applications/JM/ldecod/ldecod: 8.86% (10.4361 => 11.3608, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 8.85% (0.3109 => 0.3384, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.69% (1.5415 => 1.6755, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 8.64% (0.5925 => 0.6437, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 8.59% (0.3423 => 0.3717, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.43% (0.1625 => 0.1762, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.42% (0.6030 => 0.6538, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.33% (0.5860 => 0.6348, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 8.32% (5.7591 => 6.2384, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.27% (0.5105 => 0.5527, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.25% (1.3050 => 1.4126, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 8.22% (3.3354 => 3.6096, std.dev.: 0.0112) MultiSource/Benchmarks/Olden/em3d/em3d: 8.20% (0.1695 => 0.1834, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.05% (0.8067 => 0.8716, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.97% (0.2271 => 0.2452, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.95% (0.1510 => 0.1630, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.94% (4.2646 => 4.6031, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.81% (0.8172 => 0.8810, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 7.79% (0.7326 => 0.7897, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.79% (0.5569 => 0.6003, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.78% (0.2107 => 0.2271, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.71% (0.3307 => 0.3562, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.70% (0.2700 => 0.2908, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.68% (4.9449 => 5.3249, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.66% (0.9765 => 1.0513, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.65% (0.2065 => 0.2223, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.63% (0.3121 => 0.3359, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 7.61% (0.6456 => 0.6947, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.57% (8.1363 => 8.7525, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.56% (5.0018 => 5.3798, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists: 7.54% (0.3422 => 0.3680, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.51% (0.5020 => 0.5397, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.51% (0.2758 => 0.2965, std.dev.: 0.0057) MultiSource/Applications/Burg/burg: 7.37% (1.1642 => 1.2500, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.36% (0.4103 => 0.4405, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 7.35% (0.3387 => 0.3636, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 7.30% (0.7835 => 0.8407, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.27% (0.1940 => 0.2081, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 7.25% (0.4289 => 0.4600, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.19% (0.4203 => 0.4505, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 7.13% (1.5603 => 1.6716, std.dev.: 0.0014) MultiSource/Applications/lua/lua: 7.13% (3.8723 => 4.1484, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.12% (0.3650 => 0.3910, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.09% (0.2891 => 0.3096, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.06% (0.3865 => 0.4138, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.05% (7.9617 => 8.5230, std.dev.: 0.0059) SingleSource/Regression/C++/ofstream_ctor: 7.02% (0.2905 => 0.3109, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 7.01% (0.1555 => 0.1664, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 6.92% (0.4048 => 0.4328, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.92% (0.3441 => 0.3679, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 6.90% (1.0722 => 1.1462, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 6.86% (2.0273 => 2.1663, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 6.85% (0.2831 => 0.3025, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.82% (0.3136 => 0.3350, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.80% (0.2603 => 0.2780, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.79% (0.4636 => 0.4951, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 6.77% (0.4620 => 0.4933, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 6.73% (0.3684 => 0.3932, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.69% (0.3826 => 0.4082, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 6.69% (0.3603 => 0.3844, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.65% (0.3098 => 0.3304, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.62% (0.3232 => 0.3446, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.62% (0.2871 => 0.3061, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.61% (0.3162 => 0.3371, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.58% (1.5859 => 1.6902, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.57% (2.0665 => 2.2023, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.52% (0.3283 => 0.3497, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.51% (0.2872 => 0.3059, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.51% (1.1861 => 1.2633, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.39% (0.2756 => 0.2932, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 6.35% (0.3180 => 0.3382, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/fibo: 6.35% (0.2725 => 0.2898, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.32% (0.3052 => 0.3245, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 6.28% (0.8921 => 0.9481, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 6.27% (2.2969 => 2.4410, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/methcall: 6.22% (0.2877 => 0.3056, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.22% (0.6450 => 0.6851, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 6.19% (0.4299 => 0.4565, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.14% (0.2802 => 0.2974, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 6.12% (0.2714 => 0.2880, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.09% (0.5981 => 0.6345, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.05% (0.2793 => 0.2962, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 6.04% (0.3379 => 0.3583, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 5.93% (21.9371 => 23.2386, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.78% (2.2024 => 2.3297, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.63% (1.4186 => 1.4985, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.56% (0.1906 => 0.2012, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.55% (0.1892 => 0.1997, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 5.30% (1.1840 => 1.2467, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.29% (0.4064 => 0.4279, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.94% (0.2266 => 0.2378, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.63% (0.3131 => 0.3276, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: 4.56% (1.2842 => 1.3428, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.44% (0.8101 => 0.8461, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.77% (14.3668 => 14.9084, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.59% (0.3427 => 0.3550, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 3.34% (17.1811 => 17.7552, std.dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.92% (3.8922 => 4.0058, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.60% (1.1194 => 1.1485, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.85% (1.1396 => 1.2518, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4498, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.53% (3.1578 => 3.3639, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.75% (3.6395 => 3.7759, std.dev.: 0.0044) SingleSource/Regression/C/uint64_to_float: 3.71% (0.5413 => 0.5614) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.71% (4.2280 => 4.3426, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7651, std.dev.: 0.0002) MultiSource/Benchmarks/llubenchmark/llu: 2.14% (3.7781 => 3.8588, std.dev.: 0.0174) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8131, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.27% (2.6546 => 2.6882, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1293, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.25% (0.8651 => 0.1709, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.97% (5.2763 => 3.2730, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.66% (5.3855 => 3.6268, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.21% (5.3526 => 3.6286, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -14.40% (54.1659 => 46.3662, std.dev.: 0.0114) MultiSource/Benchmarks/FreeBench/mason/mason: -13.19% (0.0811 => 0.0704, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -11.24% (22.1758 => 19.6842, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.54% (2.9384 => 2.6286, std.dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7653, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: -16.09% (1.6925 => 1.4201, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.43% (0.0998 => 0.0864, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.24% (1.2373 => 1.0982, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: -10.27% (1.5373 => 1.3794, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/mason/mason: -10.04% (0.2161 => 0.1944, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.33% (19.9488 => 18.2874, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.66% (1.8329 => 1.7108, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.34% (1.6805 => 1.5907, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: -5.15% (1.5835 => 1.5020, std.dev.: 0.0039) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.11% (0.9957 => 0.9548, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1627, std.dev.: 0.0030) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5032, std.dev.: 0.0065) MultiSource/Applications/hexxagon/hexxagon: -3.01% (12.4730 => 12.0978, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.34% (8.6802 => 8.4769, std.dev.: 0.0172) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.91% (8.1563 => 8.0005, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6822, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -1.62% (10.2830 => 10.1169, std.dev.: 0.0055) SingleSource/UnitTests/Vector/multiplies: -1.55% (2.5528 => 2.5133, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4206, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/lists: -1.31% (6.2999 => 6.2173, std.dev.: 0.0114) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8590, std.dev.: 0.0057) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.47% (0.5229 => 0.5881, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 8.25% (14.9895 => 16.2256, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/gs/gs: 6.54% (4.1105 => 4.3792, std.dev.: 0.0134) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.77% (1.1048 => 1.2459, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.52% (7.1582 => 7.7680, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.82% (0.6222 => 0.7393, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36300.00% (0.0001 => 0.0364, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.13% (0.2116 => 0.2140, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 7 13:23:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 15:23:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121007202303.A330D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4683?compare_to=4679&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4683, Order: 165377, Start Time: 2012-10-07 17:41:19, End Time: 2012-10-07 20:24:49 To: 4679, Order: 165375, Start Time: 2012-10-07 14:28:46, End Time: 2012-10-07 17:12:21 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (134 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 1040 (829 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.65% (2.0824 => 2.1375, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.14% (54.1589 => 54.7739, std.dev.: 0.0621) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.14% (0.1063 => 0.1192, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.97% (0.3460 => 0.3874, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.91% (0.3442 => 0.3852, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.89% (0.3465 => 0.3877, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.87% (0.3488 => 0.3902, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.84% (0.3496 => 0.3910, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.84% (0.3446 => 0.3854, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/synchronized: 11.76% (0.3469 => 0.3877, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 11.67% (1.5932 => 1.7791, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/property: 11.51% (0.3650 => 0.4070, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.50% (0.3643 => 0.4062, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.31% (0.3724 => 0.4145, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/Hello: 9.77% (0.5826 => 0.6395, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference-object: 9.54% (0.5889 => 0.6451, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 8.21% (0.1619 => 0.1752, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.14% (0.7171 => 0.7755, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.97% (0.2875 => 0.3104, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.71% (0.4994 => 0.5379, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.64% (0.3195 => 0.3439, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.63% (0.2725 => 0.2933, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 7.62% (0.3004 => 0.3233, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 7.59% (0.2714 => 0.2920, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.58% (0.2811 => 0.3024, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.57% (0.4361 => 0.4691, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.53% (1.3152 => 1.4142, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/objinst: 7.51% (0.2823 => 0.3035, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.50% (1.6211 => 1.7427, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: 7.50% (0.2813 => 0.3024, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.49% (0.2738 => 0.2943, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.49% (0.2792 => 0.3001, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 7.48% (0.2780 => 0.2988, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.45% (0.3060 => 0.3288, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.44% (0.2729 => 0.2932, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 7.42% (0.2803 => 0.3011, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.42% (0.5000 => 0.5371, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 7.42% (0.2750 => 0.2954, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.41% (2.0673 => 2.2205, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/wc: 7.40% (0.3096 => 0.3325, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.35% (0.2911 => 0.3125, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.35% (0.1620 => 0.1739, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 7.32% (0.1421 => 0.1525, std.dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 7.27% (0.9909 => 1.0629, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.21% (3.5627 => 3.8196, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.08% (0.3362 => 0.3600, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 7.06% (0.4847 => 0.5189, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.3267 => 0.3497, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 7.03% (5.5417 => 5.9312, std.dev.: 0.0053) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.02% (2.7292 => 2.9207, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary: 7.00% (0.3258 => 0.3486, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 6.97% (1.0781 => 1.1532, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 6.96% (0.3317 => 0.3548, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/moments: 6.96% (0.3678 => 0.3934, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 6.93% (0.3348 => 0.3580, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.90% (0.2014 => 0.2153, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.87% (0.3477 => 0.3716, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.84% (0.3726 => 0.3981, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.83% (0.3282 => 0.3506, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.82% (0.3124 => 0.3337, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.73% (0.2736 => 0.2920, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.70% (0.3625 => 0.3868, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.62% (0.3930 => 0.4190, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.60% (0.4139 => 0.4412, std.dev.: 0.0051) MultiSource/Benchmarks/Bullet/bullet: 6.56% (23.5202 => 25.0625, std.dev.: 0.0211) SingleSource/Benchmarks/Shootout-C++/hash: 6.54% (0.4146 => 0.4417, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.53% (0.3690 => 0.3931, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.53% (0.5026 => 0.5354, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.52% (0.4251 => 0.4528, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.41% (4.4195 => 4.7029, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.38% (0.3981 => 0.4235, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.37% (0.5900 => 0.6276, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 6.36% (4.2109 => 4.4786, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.35% (0.3903 => 0.4151, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.22% (0.3845 => 0.4084, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 6.21% (0.6634 => 0.7046, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.20% (0.3890 => 0.4131, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.18% (0.2866 => 0.3043, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.16% (0.3084 => 0.3274, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 6.12% (0.2566 => 0.2723, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 6.11% (1.8794 => 1.9943, std.dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: 6.01% (2.1013 => 2.2276, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.97% (0.6435 => 0.6819, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.95% (0.2068 => 0.2191) SingleSource/Benchmarks/Misc-C++/bigfib: 5.95% (0.5012 => 0.5310, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.88% (0.2737 => 0.2898, std.dev.: 0.0042) MultiSource/Applications/spiff/spiff: 5.88% (0.4029 => 0.4266, std.dev.: 0.0021) MultiSource/Applications/Burg/burg: 5.84% (0.5546 => 0.5870, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.83% (0.2969 => 0.3142, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 5.80% (4.6177 => 4.8855, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 5.68% (1.4269 => 1.5080, std.dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 5.67% (2.1653 => 2.2880, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.62% (0.4658 => 0.4920, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.49% (0.2040 => 0.2152, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.44% (0.3271 => 0.3449, std.dev.: 0.0017) MultiSource/Applications/minisat/minisat: 5.34% (0.3336 => 0.3514, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 5.25% (0.2075 => 0.2184, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.23% (0.2103 => 0.2213, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.10% (0.9697 => 1.0192, std.dev.: 0.0067) MultiSource/Applications/sqlite3/sqlite3: 5.09% (2.0346 => 2.1382, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.99% (1.9694 => 2.0677, std.dev.: 0.0039) MultiSource/Applications/treecc/treecc: 4.99% (0.7875 => 0.8268, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.81% (1.9966 => 2.0926, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 4.56% (0.2391 => 0.2500, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.54% (0.7426 => 0.7763, std.dev.: 0.0119) MultiSource/Applications/SIBsim4/SIBsim4: 4.53% (0.2691 => 0.2813, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.50% (0.5361 => 0.5602, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.10% (0.5584 => 0.5813, std.dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.93% (11.6398 => 12.0972, std.dev.: 0.0121) MultiSource/Applications/lambda-0_1_3/lambda: 3.63% (0.3498 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.57% (4.6926 => 4.8603, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.22% (0.4253 => 0.4390, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.69% (0.3792 => 0.3894, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 2.56% (11.9555 => 12.2618, std.dev.: 0.0082) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6530, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6104, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 5.66% (0.2122 => 0.2242, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6774, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-2: 4.84% (1.8057 => 1.8931, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1677, std.dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/dry: 4.21% (14.0481 => 14.6391, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.67% (2.0820 => 2.1375, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 2.16% (15.8721 => 16.2153, std.dev.: 0.0365) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5054, std.dev.: 0.0024) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2221, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2886, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5129, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5959, std.dev.: 0.0114) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.79% (25.4195 => 16.5768, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/ary2: -7.74% (0.2402 => 0.2216, std.dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9776, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7974, std.dev.: 0.0116) MultiSource/Benchmarks/Olden/tsp/tsp: -7.32% (2.1113 => 1.9568, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.58% (11.2080 => 10.8065, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0022) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7732, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -2.57% (17.2379 => 16.7954, std.dev.: 0.0473) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8648, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5722, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4953, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.2064, std.dev.: 0.0242) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0459, std.dev.: 0.0037) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 7 13:39:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 15:39:01 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121007203901.3F7D32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4684?compare_to=4680&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4684, Order: 165380, Start Time: 2012-10-07 19:17:32, End Time: 2012-10-07 20:40:46 To: 4680, Order: 165377, Start Time: 2012-10-07 16:01:36, End Time: 2012-10-07 17:24:32 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (14 on baseline) Performance Regressions: 11 (97 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 966 (749 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.96% (0.7648 => 0.8104, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.52% (0.8416 => 0.8628, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (1.1024 => 1.1197, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.52% (0.8624 => 0.8755, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: 16.29% (3.0747 => 3.5756, std.dev.: 0.0126) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.32% (21.6435 => 22.5778, std.dev.: 0.3402) MultiSource/Applications/SPASS/SPASS: 3.94% (8.2078 => 8.5310, std.dev.: 0.0441) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.57% (4.6423 => 4.7152, std.dev.: 0.0133) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 1.45% (2.9124 => 2.9545, std.dev.: 0.0100) MultiSource/Applications/siod/siod: 1.18% (3.6284 => 3.6713, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.08% (2.3779 => 2.4036, std.dev.: 0.0073) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.20% (1.0254 => 1.0234, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: 0.75% (0.6282 => 0.6329, std.dev.: 0.0084) MultiSource/Benchmarks/McCat/08-main/main: 11.52% (0.1640 => 0.1829, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.32% (0.1528 => 0.1594, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.63% (0.3166 => 0.3186, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.10% (0.2372 => 0.2398, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.18% (0.3260 => 0.3266, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.90% (0.2325 => 0.2346, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel: -14.50% (0.0462 => 0.0395, std.dev.: 0.0039) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.96% (0.0230 => 0.0246, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.50% (0.0200 => 0.0197, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0395 => 0.0395, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.47% (0.0232 => 0.0305, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.03% (0.0291 => 0.0288, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.60% (0.0331 => 0.0329, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -0.54% (0.0186 => 0.0185, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 35.17% (0.0145 => 0.0196, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: 3.69% (0.0244 => 0.0253, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -0.90% (0.0334 => 0.0331, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0005 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.28% (0.1424 => 0.1428, std.dev.: 0.0031) MultiSource/Applications/lemon/lemon: 3.36% (1.4830 => 1.5329, std.dev.: 0.0254) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 1.48% (0.1491 => 0.1513, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.94% (0.4058 => 0.4020, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.02% (0.1392 => 0.1448, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.59% (0.0527 => 0.0567, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 17.75% (0.0169 => 0.0199, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.08% (0.0590 => 0.0620, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.05% (1.1332 => 1.1326, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -85.19% (0.0027 => 0.0004, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 260.00% (0.0005 => 0.0018, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.65% (0.0630 => 0.0607, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.08% (0.0212 => 0.0197, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.07% (0.7660 => 0.7655, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.11% (1.7056 => 1.7075, std.dev.: 0.0167) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 103.37% (0.0089 => 0.0181, std.dev.: 0.0021) SingleSource/UnitTests/2003-08-11-VaListArg: 180.00% (0.0090 => 0.0252, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -27.32% (4.1772 => 3.0359, std.dev.: 0.0406) SingleSource/Benchmarks/Shootout-C++/except: 82050.00% (0.0006 => 0.4929, std.dev.: 0.0040) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: -80.00% (0.0005 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C++/EH/function_try_block: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: -75.00% (0.0004 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.95% (0.0745 => 0.0916, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.10% (0.1414 => 0.1571, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 10.30% (2.1763 => 2.4005, std.dev.: 0.0225) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.27% (0.1159 => 0.1278, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.66% (0.6410 => 0.7029, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 9.38% (0.5309 => 0.5807, std.dev.: 0.0111) MultiSource/Applications/minisat/minisat: 8.52% (0.6173 => 0.6699, std.dev.: 0.0024) MultiSource/Applications/kimwitu++/kc: 8.23% (15.3105 => 16.5702, std.dev.: 0.0535) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.18% (0.3582 => 0.3875, std.dev.: 0.0041) MultiSource/Applications/lemon/lemon: 8.09% (1.0046 => 1.0859, std.dev.: 0.0092) MultiSource/Applications/SIBsim4/SIBsim4: 7.38% (1.1653 => 1.2513, std.dev.: 0.0279) MultiSource/Benchmarks/McCat/18-imp/imp: 6.81% (0.3217 => 0.3436, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.78% (0.2552 => 0.2725, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 6.67% (4.7455 => 5.0618, std.dev.: 0.0481) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.65% (0.2797 => 0.2983, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.48% (1.5150 => 1.6131, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.28% (0.7639 => 0.8119, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.05% (0.6069 => 0.6436, std.dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 5.99% (0.6915 => 0.7329, std.dev.: 0.0045) MultiSource/Applications/d/make_dparser: 5.58% (3.0225 => 3.1912, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.54% (0.3901 => 0.4117, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 5.33% (0.1971 => 0.2076, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.23% (0.7226 => 0.7604, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.02% (0.2886 => 0.3031, std.dev.: 0.0026) MultiSource/Applications/siod/siod: 4.96% (2.0972 => 2.2013, std.dev.: 0.0161) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.95% (0.7722 => 0.8104, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.92% (0.4248 => 0.4457, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.91% (6.2546 => 6.5614, std.dev.: 0.0135) MultiSource/Applications/SPASS/SPASS: 4.89% (13.3238 => 13.9750, std.dev.: 0.0577) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.77% (0.4880 => 0.5113, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.75% (1.0689 => 1.1197, std.dev.: 0.0037) MultiSource/Benchmarks/Bullet/bullet: 4.74% (29.3170 => 30.7071, std.dev.: 0.1772) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.70% (1.2021 => 1.2586, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.66% (1.4408 => 1.5080, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.60% (0.3062 => 0.3203, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.59% (0.8569 => 0.8962, std.dev.: 0.0086) MultiSource/Applications/lua/lua: 4.59% (3.5980 => 3.7630, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.57% (1.1827 => 1.2368, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.51% (0.2952 => 0.3085, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 4.35% (8.2186 => 8.5758, std.dev.: 0.0345) SingleSource/Benchmarks/Shootout-C++/hash2: 4.19% (0.3847 => 0.4008, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.18% (0.2654 => 0.2765, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 4.05% (14.7256 => 15.3219, std.dev.: 0.0546) MultiSource/Applications/treecc/treecc: 4.05% (1.8798 => 1.9559, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/lists1: 4.04% (0.2771 => 0.2883, std.dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: 4.03% (1.0821 => 1.1257, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.02% (3.0758 => 3.1996, std.dev.: 0.0193) SingleSource/Benchmarks/Shootout-C++/hash: 4.01% (0.3520 => 0.3661, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 3.96% (1.3268 => 1.3794, std.dev.: 0.0165) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.90% (12.6413 => 13.1341, std.dev.: 0.0889) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.88% (2.0317 => 2.1105, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/bh/bh: 3.87% (0.2820 => 0.2929, std.dev.: 0.0025) MultiSource/Applications/Burg/burg: 3.86% (1.1440 => 1.1882, std.dev.: 0.0065) MultiSource/Applications/JM/ldecod/ldecod: 3.84% (6.4908 => 6.7401, std.dev.: 0.0365) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.74% (0.3418 => 0.3546, std.dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.72% (0.3008 => 0.3120, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 3.37% (0.3084 => 0.3188, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.36% (0.5740 => 0.5933, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.34% (0.5636 => 0.5824, std.dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.27% (0.4562 => 0.4711, std.dev.: 0.0053) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.12% (4.2616 => 4.3944, std.dev.: 0.0195) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.92% (0.5963 => 0.6137, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.89% (4.0318 => 4.1485, std.dev.: 0.0238) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.74% (4.2815 => 4.3990, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.54% (0.5520 => 0.5660, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.28% (1.2742 => 1.3032, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.94% (1.3935 => 1.4205, std.dev.: 0.0100) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.78% (1.6538 => 2.3448, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2286, std.dev.: 0.0232) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.41% (0.0766 => 0.0930, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/heapsort: 18.18% (3.0256 => 3.5756, std.dev.: 0.0126) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 17.01% (0.0917 => 0.1073, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: 14.82% (1.7426 => 2.0009, std.dev.: 0.0556) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.25% (2.4042 => 2.7469, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.83% (4.0101 => 4.5647, std.dev.: 0.0258) SingleSource/Benchmarks/McGill/queens: 11.13% (1.6261 => 1.8071, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/mason/mason: 9.55% (0.5004 => 0.5482, std.dev.: 0.0174) SingleSource/Benchmarks/Stanford/Puzzle: 9.35% (0.1433 => 0.1567, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 8.90% (1.0063 => 1.0959, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/lists: 8.69% (7.0025 => 7.6109, std.dev.: 0.0387) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.16% (0.2857 => 0.3090, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.24% (0.3301 => 0.3441, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/dt: 3.92% (0.9851 => 1.0237, std.dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: 3.87% (6.9722 => 7.2422, std.dev.: 0.0366) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.80% (3.4080 => 3.5376, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/fp-convert: 3.79% (15.2242 => 15.8019, std.dev.: 0.0656) MultiSource/Applications/siod/siod: 3.36% (3.5520 => 3.6713, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.11% (2.6656 => 2.7486, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.10% (0.5876 => 0.6058, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/health/health: 2.95% (0.3420 => 0.3521, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.87% (6.6312 => 6.8214, std.dev.: 0.0151) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.83% (0.5587 => 0.5745, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 2.82% (0.6308 => 0.6486, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.22% (4.6127 => 4.7152, std.dev.: 0.0133) MultiSource/Benchmarks/Olden/power/power: 1.49% (1.4184 => 1.4395, std.dev.: 0.0024) MultiSource/Applications/lua/lua: 1.15% (29.5232 => 29.8628, std.dev.: 0.1033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.11% (2.4455 => 2.4726, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -43.62% (0.2996 => 0.1689, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -43.32% (0.0591 => 0.0335, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.57% (1.4189 => 1.1554, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.40% (1.4113 => 1.1516, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -5.94% (8.9977 => 8.4629, std.dev.: 0.2076) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.15% (0.3497 => 0.2058, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.99% (5.2665 => 4.1611, std.dev.: 0.1789) SingleSource/Benchmarks/Shootout-C++/ary3: -20.27% (1.7473 => 1.3932, std.dev.: 0.0619) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.21% (1.7361 => 1.4721, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1589, std.dev.: 0.0553) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -12.17% (15.8312 => 13.9045, std.dev.: 0.2627) SingleSource/Benchmarks/Shootout-C++/moments: -9.69% (0.1114 => 0.1006, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.62% (1.1647 => 1.0526, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: -8.38% (9.5474 => 8.7476, std.dev.: 0.0274) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2863, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.69% (3.2007 => 2.9545, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.82% (3.6254 => 3.3782, std.dev.: 0.0223) SingleSource/Benchmarks/Shootout-C++/fibo: -6.52% (4.6355 => 4.3333, std.dev.: 0.0206) MultiSource/Applications/lambda-0_1_3/lambda: -6.51% (7.6833 => 7.1828, std.dev.: 0.0392) SingleSource/Benchmarks/Misc/richards_benchmark: -6.34% (1.4441 => 1.3525, std.dev.: 0.0104) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.08% (2.9728 => 2.7920, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.47% (3.9413 => 3.7258, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout/fib2: -5.21% (4.4195 => 4.1892, std.dev.: 0.0488) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.02% (0.4564 => 0.4335, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -4.74% (2.5166 => 2.3974, std.dev.: 0.0076) MultiSource/Applications/sgefa/sgefa: -4.43% (0.3746 => 0.3580, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: -4.20% (62.4126 => 59.7900, std.dev.: 0.0325) SingleSource/Benchmarks/McGill/misr: -4.10% (0.4296 => 0.4120, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: -3.33% (9.2503 => 8.9427, std.dev.: 0.0174) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.66% (0.4140 => 0.4030, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.57% (1.1683 => 1.1383, std.dev.: 0.0052) SingleSource/Benchmarks/Dhrystone/dry: -2.13% (2.4013 => 2.3502, std.dev.: 0.0105) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.11% (3.7496 => 3.6703, std.dev.: 0.0100) MultiSource/Benchmarks/sim/sim: -1.93% (3.8907 => 3.8155, std.dev.: 0.0200) MultiSource/Benchmarks/PAQ8p/paq8p: -1.90% (92.7467 => 90.9838, std.dev.: 0.3072) SingleSource/Benchmarks/Shootout-C++/hash2: -1.88% (3.4876 => 3.4221, std.dev.: 0.0021) MultiSource/Applications/aha/aha: -1.77% (3.4286 => 3.3678, std.dev.: 0.0234) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.74% (2.3569 => 2.3160, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.72% (2.4457 => 2.4036, std.dev.: 0.0073) MultiSource/Benchmarks/FreeBench/neural/neural: -1.66% (1.0926 => 1.0745, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.61% (9.3855 => 9.2348, std.dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/lists: -1.39% (16.5617 => 16.3308, std.dev.: 0.0467) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.37% (25.6658 => 25.3150, std.dev.: 0.1012) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.27% (27.1724 => 26.8277, std.dev.: 0.0272) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.55% (0.9980 => 1.0234, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: 5.10% (0.6022 => 0.6329, std.dev.: 0.0084) MultiSource/Benchmarks/McCat/08-main/main: 9.78% (0.1666 => 0.1829, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.57% (0.1554 => 0.1594, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.34% (0.3083 => 0.3186, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.17% (0.2394 => 0.2398, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.87% (0.3175 => 0.3266, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.91% (0.2302 => 0.2346, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel: -12.03% (0.0449 => 0.0395, std.dev.: 0.0039) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.50% (0.0240 => 0.0246, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 2.60% (0.0192 => 0.0197, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.28% (0.0390 => 0.0395, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.33% (0.0301 => 0.0305, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.41% (0.0284 => 0.0288, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.54% (0.0324 => 0.0329, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 4.52% (0.0177 => 0.0185, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 3.70% (0.0189 => 0.0196, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: 1.61% (0.0249 => 0.0253, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 1.85% (0.0325 => 0.0331, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1429 => 0.1428, std.dev.: 0.0031) MultiSource/Applications/lemon/lemon: 2.06% (1.5019 => 1.5329, std.dev.: 0.0254) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.80% (0.1501 => 0.1513, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.72% (0.4264 => 0.4020, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.74% (0.1344 => 0.1448, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.74% (0.0589 => 0.0567, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -14.22% (0.0232 => 0.0199, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.97% (0.0639 => 0.0620, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.21% (1.1350 => 1.1326, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -33.33% (0.0006 => 0.0004, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -25.00% (0.0024 => 0.0018, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.71% (0.0637 => 0.0607, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.92% (0.0246 => 0.0197, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.51% (0.7541 => 0.7655, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.14% (1.5363 => 1.7075, std.dev.: 0.0167) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 2.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 7 13:42:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 15:42:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121007204258.515C02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4685?compare_to=4681&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4685, Order: 165380, Start Time: 2012-10-07 19:30:14, End Time: 2012-10-07 20:44:43 To: 4681, Order: 165377, Start Time: 2012-10-07 16:14:10, End Time: 2012-10-07 17:28:47 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (183 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1042 (753 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 22.11% (2.0176 => 2.4637, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.87% (0.1410 => 0.1662, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 15.98% (0.0826 => 0.0958, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 14.85% (0.2243 => 0.2576, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.34% (0.1072 => 0.1215, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.95% (0.0834 => 0.0942, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 12.54% (0.1013 => 0.1140, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 12.43% (0.1062 => 0.1194, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 12.34% (0.4328 => 0.4862, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.31% (0.1413 => 0.1587, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 11.90% (0.7061 => 0.7901, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.72% (0.0964 => 0.1077, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.67% (3.9660 => 4.4288, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.65% (0.2721 => 0.3038, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.65% (0.1588 => 0.1773, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 11.57% (0.5818 => 0.6491, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 11.55% (0.4062 => 0.4531, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.53% (0.1327 => 0.1480, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 11.42% (0.7038 => 0.7842, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.40% (0.2596 => 0.2892, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 11.40% (1.3693 => 1.5254, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/Hello: 11.34% (0.5748 => 0.6400, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.26% (0.7710 => 0.8578, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.21% (1.2193 => 1.3560, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 11.18% (0.2781 => 0.3092, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.12% (0.9199 => 1.0222, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.11% (0.6283 => 0.6981, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.00% (1.4563 => 1.6165, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.92% (0.5265 => 0.5840, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.89% (0.2782 => 0.3085, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.88% (0.3485 => 0.3864, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.83% (0.6959 => 0.7713, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.80% (0.3899 => 0.4320, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.74% (1.1364 => 1.2585, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.59% (0.3022 => 0.3342, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 10.57% (0.3293 => 0.3641, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 10.57% (13.8202 => 15.2806, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.52% (0.3756 => 0.4151, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.48% (0.4390 => 0.4850, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hello: 10.47% (0.2607 => 0.2880, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.46% (0.1061 => 0.1172, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.46% (0.4016 => 0.4436, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 10.43% (0.2761 => 0.3049, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/wc: 10.42% (0.2937 => 0.3243, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: 10.36% (0.2760 => 0.3046, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 10.33% (0.2690 => 0.2968, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 10.32% (0.3149 => 0.3474, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.32% (0.3489 => 0.3849, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 10.31% (0.2726 => 0.3007, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.28% (0.2966 => 0.3271, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.28% (0.2655 => 0.2928, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 10.27% (0.2628 => 0.2898, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 10.27% (0.1003 => 0.1106, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.27% (1.9828 => 2.1864, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.25% (0.3580 => 0.3947, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 10.22% (0.3453 => 0.3806, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 10.21% (0.3868 => 0.4263, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 10.17% (0.3107 => 0.3423, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.16% (0.2765 => 0.3046, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.14% (0.1075 => 0.1184, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.03% (0.1157 => 0.1273, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 9.96% (0.3192 => 0.3510, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.90% (0.5577 => 0.6129, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.89% (0.4791 => 0.5265, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.87% (0.2696 => 0.2962, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 9.85% (1.0313 => 1.1329, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 9.85% (0.2995 => 0.3290, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 9.84% (0.2988 => 0.3282, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 9.83% (16.6129 => 18.2455, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.82% (0.1986 => 0.2181, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.81% (0.3130 => 0.3437, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 9.79% (0.3534 => 0.3880, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.71% (0.4379 => 0.4804, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 9.63% (0.1589 => 0.1742, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.57% (0.2914 => 0.3193, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.56% (0.1276 => 0.1398, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 9.56% (1.1061 => 1.2118, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.50% (0.2127 => 0.2329, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.34% (0.1435 => 0.1569, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.33% (0.3246 => 0.3549, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.33% (0.5637 => 0.6163, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.24% (0.8698 => 0.9502, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/objinst: 9.20% (0.2945 => 0.3216, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 9.18% (0.6744 => 0.7363, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.17% (0.7460 => 0.8144, std.dev.: 0.0075) MultiSource/Benchmarks/McCat/18-imp/imp: 9.13% (0.3220 => 0.3514, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 9.11% (0.8310 => 0.9067, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/mst/mst: 9.09% (0.1111 => 0.1212, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 9.09% (3.8646 => 4.2157, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.97% (7.2180 => 7.8656, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.96% (0.6576 => 0.7165, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 8.95% (0.7506 => 0.8178, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/09-vor/vor: 8.75% (0.2925 => 0.3181, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.74% (0.3755 => 0.4083, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.70% (0.2023 => 0.2199, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 8.69% (1.9270 => 2.0945, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 8.66% (2.1791 => 2.3678, std.dev.: 0.0074) MultiSource/Applications/d/make_dparser: 8.64% (3.1889 => 3.4643, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.53% (0.1865 => 0.2024, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 8.46% (0.1478 => 0.1603, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 8.44% (1.0594 => 1.1488, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.31% (0.8818 => 0.9551, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.29% (0.1569 => 0.1699, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 8.24% (0.3131 => 0.3389, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 8.21% (0.1657 => 0.1793, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 8.13% (1.2749 => 1.3785, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.11% (1.3245 => 1.4319, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.11% (3.6692 => 3.9667, std.dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 8.10% (14.8535 => 16.0560, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.99% (4.3801 => 4.7302, std.dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.94% (0.1789 => 0.1931, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 7.92% (8.4961 => 9.1690, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.92% (4.4433 => 4.7952, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.84% (0.6135 => 0.6616, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.83% (0.4113 => 0.4435, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 7.71% (0.3578 => 0.3854, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.67% (0.4003 => 0.4310, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.62% (0.2140 => 0.2303, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions: 7.61% (0.3914 => 0.4212, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 7.49% (0.3646 => 0.3919, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 7.47% (0.3601 => 0.3870, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 7.40% (4.6629 => 5.0081, std.dev.: 0.0146) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.40% (4.9865 => 5.3553, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/for-in: 7.39% (0.3789 => 0.4069, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.34% (0.3940 => 0.4229, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.32% (0.3663 => 0.3931, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 7.31% (1.2292 => 1.3190, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.26% (0.3650 => 0.3915, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.23% (0.3511 => 0.3765, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 7.23% (0.6250 => 0.6702, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.19% (0.9108 => 0.9763, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.19% (0.2504 => 0.2684, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 7.18% (0.3623 => 0.3883, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.07% (1.5188 => 1.6262, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.98% (1.1333 => 1.2124, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.95% (0.4805 => 0.5139, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.93% (3.2742 => 3.5010, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.81% (0.3245 => 0.3466, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 6.77% (0.2008 => 0.2144, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 6.66% (6.5754 => 7.0133, std.dev.: 0.0056) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.40% (6.2785 => 6.6801, std.dev.: 0.0054) MultiSource/Applications/lua/lua: 6.31% (3.7467 => 3.9833, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.29% (0.2321 => 0.2467, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.08% (2.1007 => 2.2285, std.dev.: 0.0199) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.05% (0.1819 => 0.1929, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.49% (13.2842 => 14.0132, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.64% (0.2243 => 0.2347, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 3.86% (16.2614 => 16.8894, std.dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: 3.67% (14.5298 => 15.0637, std.dev.: 0.0188) MultiSource/Benchmarks/Bullet/bullet: 1.30% (33.2944 => 33.7257, std.dev.: 0.0107) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.44% (5.7573 => 7.5098, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.06% (1.0895 => 1.3625, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.56% (1.8175 => 2.2638, std.dev.: 0.0433) SingleSource/Benchmarks/Misc/richards_benchmark: 10.97% (1.1560 => 1.2828, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 9.03% (0.8273 => 0.9020, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.61% (3.1736 => 3.4150, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.10% (1.2998 => 1.3791, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0004, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.65% (1.9144 => 2.0035, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.67% (11.2619 => 11.6749, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 3.45% (10.7476 => 11.1183, std.dev.: 0.0454) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9849, std.dev.: 0.0006) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.21% (7.4271 => 7.5915, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4533, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0508, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5144, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2122, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1874, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.14% (5.5130 => 5.5761, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0273, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.07% (12.4560 => 12.5894, std.dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.08% (0.2670 => 0.1413, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.72% (0.4657 => 0.3925, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/mason/mason: -15.42% (0.0707 => 0.0598, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.90% (1.3813 => 1.1893, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.76% (1.3819 => 1.1918, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.09% (22.5627 => 21.8650, std.dev.: 0.0169) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.64% (0.0997 => 0.0861, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.84% (0.2238 => 0.1973, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -10.83% (1.2308 => 1.0975, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.20% (20.3410 => 18.2663, std.dev.: 0.0125) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.26% (1.3780 => 1.2918, std.dev.: 0.0150) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.20% (1.9290 => 1.8094, std.dev.: 0.0128) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.67% (0.9996 => 0.9529, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1560, std.dev.: 0.0366) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.46% (1.7688 => 1.7076, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.96% (0.4867 => 0.4723, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -2.56% (26.5159 => 25.8374, std.dev.: 0.0268) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.39% (3.0263 => 2.9539, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.33% (1.9762 => 1.9301, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.96% (0.6589 => 0.6460, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7147, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/lists: -1.74% (6.3560 => 6.2457, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0067, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -1.33% (4.5928 => 4.5318, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: -1.23% (9.3358 => 9.2206, std.dev.: 0.0336) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.16% (2.5254 => 2.4960, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.09% (3.9173 => 3.8745, std.dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2589, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 7 13:47:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 15:47:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121007204758.C47FB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4686?compare_to=4682&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4686, Order: 165380, Start Time: 2012-10-07 19:30:19, End Time: 2012-10-07 20:49:43 To: 4682, Order: 165377, Start Time: 2012-10-07 16:14:17, End Time: 2012-10-07 17:33:41 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (154 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1024 (763 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.98% (54.6933 => 55.7777, std.dev.: 0.3513) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.09% (0.5881 => 0.5876, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -0.02% (16.2256 => 16.2216, std.dev.: 0.0107) MultiSource/Benchmarks/Bullet/bullet: 0.01% (54.8741 => 54.8819, std.dev.: 0.0241) MultiSource/Benchmarks/MallocBench/gs/gs: 0.11% (4.3792 => 4.3839, std.dev.: 0.0134) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.06% (1.2459 => 1.2466, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.03% (7.7680 => 7.7660, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.15% (0.7393 => 0.7404, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0364 => 0.0364, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.07% (0.2140 => 0.2163, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -13.22% (63.2438 => 54.8819, std.dev.: 0.0241) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.45% (14.1553 => 18.7493, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: 61.10% (3.4629 => 5.5788, std.dev.: 0.0274) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14228.75% (0.0720 => 10.3167, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952400.00% (0.0001 => 9.9525, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 51.41% (0.2554 => 0.3867, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 48.75% (10.3673 => 15.4213, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/richards_benchmark: 30.95% (0.1622 => 0.2124, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 30.87% (0.1056 => 0.1382, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 15.85% (0.1432 => 0.1659, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.41% (2.2022 => 2.5415, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.89% (7.0540 => 8.1042, std.dev.: 0.0069) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.43% (0.1566 => 0.1792, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.50% (1.7609 => 1.9811, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.28% (0.0871 => 0.0978, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 11.76% (0.3282 => 0.3668, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.05% (0.1584 => 0.1759, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.89% (0.1625 => 0.1802, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.81% (0.3543 => 0.3926, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 10.28% (0.3473 => 0.3830, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.15% (0.3516 => 0.3873, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-2: 10.15% (0.3497 => 0.3852, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.14% (0.3561 => 0.3922, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.13% (0.3543 => 0.3902, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 10.00% (0.1440 => 0.1584, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 9.91% (0.3694 => 0.4060, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.88% (0.3927 => 0.4315, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.82% (0.3828 => 0.4204, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.73% (0.3886 => 0.4264, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.39% (0.1438 => 0.1573, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.28% (0.4879 => 0.5332, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.24% (0.6675 => 0.7292, std.dev.: 0.0038) MultiSource/Applications/minisat/minisat: 9.21% (0.7115 => 0.7770, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 9.19% (9.4845 => 10.3561, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: 9.18% (0.1655 => 0.1807, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.16% (0.3177 => 0.3468, std.dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 9.07% (0.7433 => 0.8107, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 9.03% (0.1695 => 0.1848, std.dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 8.87% (10.4361 => 11.3614, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.77% (1.5415 => 1.6767, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 8.72% (0.3109 => 0.3380, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.65% (0.8067 => 0.8765, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 8.60% (0.1175 => 0.1276, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 8.56% (0.3423 => 0.3716, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: 8.54% (0.5925 => 0.6431, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.46% (0.6030 => 0.6540, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.43% (0.4615 => 0.5004, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 8.38% (5.7591 => 6.2420, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.33% (0.5860 => 0.6348, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.31% (0.5105 => 0.5529, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.27% (1.3050 => 1.4129, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 8.20% (3.3354 => 3.6088, std.dev.: 0.0134) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.19% (0.2271 => 0.2457, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.08% (0.1510 => 0.1632, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.04% (4.2646 => 4.6074, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.03% (0.5569 => 0.6016, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.02% (0.8172 => 0.8827, std.dev.: 0.0034) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.01% (0.3121 => 0.3371, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.95% (0.3307 => 0.3570, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.85% (0.2065 => 0.2227, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 7.82% (0.7326 => 0.7899, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.78% (0.2107 => 0.2271, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.78% (0.2700 => 0.2910, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 7.78% (0.6456 => 0.6958, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.72% (0.2758 => 0.2971, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.72% (5.0018 => 5.3877, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.68% (8.1363 => 8.7613, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.68% (4.9449 => 5.3247, std.dev.: 0.0093) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.68% (0.1940 => 0.2089, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 7.66% (0.3422 => 0.3684, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.65% (0.9765 => 1.0512, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.55% (0.1337 => 0.1438, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 7.54% (0.7835 => 0.8426, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: 7.52% (1.1642 => 1.2517, std.dev.: 0.0280) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.51% (0.5020 => 0.5397, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.48% (0.4103 => 0.4410, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 7.41% (0.3387 => 0.3638, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.40% (0.4203 => 0.4514, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 7.37% (0.4289 => 0.4605, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.32% (0.3650 => 0.3917, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 7.22% (3.8723 => 4.1517, std.dev.: 0.0129) SingleSource/Regression/C++/ofstream_ctor: 7.13% (0.2905 => 0.3112, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 7.11% (1.5603 => 1.6712, std.dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.04% (7.9617 => 8.5226, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.04% (0.3865 => 0.4137, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 7.01% (0.1555 => 0.1664, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.99% (0.2831 => 0.3029, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.95% (0.2891 => 0.3092, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 6.94% (1.0722 => 1.1466, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.93% (0.3826 => 0.4091, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 6.92% (0.4048 => 0.4328, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.91% (0.3603 => 0.3852, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 6.88% (0.4620 => 0.4938, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.86% (0.3136 => 0.3351, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.82% (0.4636 => 0.4952, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 6.80% (2.0273 => 2.1652, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 6.79% (0.3684 => 0.3934, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.76% (0.2603 => 0.2779, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.74% (0.3441 => 0.3673, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.71% (0.3232 => 0.3449, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.68% (2.0665 => 2.2046, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/matrix: 6.65% (0.3098 => 0.3304, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.64% (0.3283 => 0.3501, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.61% (0.3162 => 0.3371, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.57% (1.1861 => 1.2640, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.55% (1.5859 => 1.6897, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 6.51% (0.2871 => 0.3058, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.48% (0.2872 => 0.3058, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.42% (0.2756 => 0.2933, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 6.42% (0.2725 => 0.2900, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 6.40% (0.2877 => 0.3061, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 6.38% (0.3180 => 0.3383, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 6.38% (2.2969 => 2.4435, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/ary2: 6.33% (0.3379 => 0.3593, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.32% (0.3052 => 0.3245, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.31% (0.6450 => 0.6857, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 6.28% (0.8921 => 0.9481, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 6.23% (0.4299 => 0.4567, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/random: 6.21% (0.2802 => 0.2976, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.19% (0.2793 => 0.2966, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 6.15% (0.2714 => 0.2881, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.14% (0.5981 => 0.6348, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 5.95% (21.9371 => 23.2413, std.dev.: 0.0151) MultiSource/Benchmarks/nbench/nbench: 5.92% (1.1840 => 1.2541, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.87% (2.2024 => 2.3316, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.77% (0.1906 => 0.2016, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.52% (1.4186 => 1.4969, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.44% (0.1892 => 0.1995, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.39% (0.4064 => 0.4283, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.73% (0.3131 => 0.3279, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.68% (1.2842 => 1.3443, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.37% (0.8101 => 0.8455, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.69% (14.3668 => 14.8963, std.dev.: 0.0185) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.59% (0.3427 => 0.3550, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 3.34% (17.1811 => 17.7558, std.dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.91% (3.8922 => 4.0054, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.60% (1.1194 => 1.1485, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.79% (1.1396 => 1.2512, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 9.22% (3.1595 => 3.4507, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3692, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.4162 => 0.4322, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.52% (3.6395 => 3.7676, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.59% (4.2280 => 4.3374, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7652, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8127, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.25% (2.6546 => 2.6878, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5751, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.06% (6.6874 => 0.1298, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.89% (5.2763 => 3.2769, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.66% (5.3855 => 3.6265, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.21% (5.3526 => 3.6285, std.dev.: 0.0027) SingleSource/UnitTests/Vector/constpool: -14.44% (54.1659 => 46.3458, std.dev.: 0.0146) MultiSource/Benchmarks/FreeBench/mason/mason: -13.07% (0.0811 => 0.0705) MultiSource/Applications/ClamAV/clamscan: -11.20% (22.1758 => 19.6928, std.dev.: 0.0101) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.45% (2.9384 => 2.6313, std.dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.34% (1.1492 => 0.7660, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -15.79% (1.6925 => 1.4253, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.03% (0.0998 => 0.0858, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -12.33% (1.2373 => 1.0848, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/mandel-2: -10.43% (1.5373 => 1.3770, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/mason/mason: -9.90% (0.2161 => 0.1947, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.28% (19.9488 => 18.2962, std.dev.: 0.0181) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.68% (1.8329 => 1.7105, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.21% (1.6805 => 1.5930, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-5: -5.05% (1.5835 => 1.5036, std.dev.: 0.0043) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7966, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.75% (3.2827 => 3.1595, std.dev.: 0.0119) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.68% (0.9957 => 0.9591, std.dev.: 0.0057) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4949, std.dev.: 0.0077) MultiSource/Applications/hexxagon/hexxagon: -3.01% (12.4730 => 12.0970, std.dev.: 0.0020) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.13% (8.6802 => 8.4954, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/salsa20: -1.83% (10.2830 => 10.0952, std.dev.: 0.0235) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.73% (8.1563 => 8.0156, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6815, std.dev.: 0.0017) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4204, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout/lists: -1.17% (6.2999 => 6.2260, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout/hash: -1.08% (4.9088 => 4.8560, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.37% (0.5229 => 0.5876, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 8.22% (14.9895 => 16.2216, std.dev.: 0.0107) MultiSource/Benchmarks/MallocBench/gs/gs: 6.65% (4.1105 => 4.3839, std.dev.: 0.0134) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.83% (1.1048 => 1.2466, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.49% (7.1582 => 7.7660, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.00% (0.6222 => 0.7404, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36300.00% (0.0001 => 0.0364, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.22% (0.2116 => 0.2163, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 7 15:19:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 17:19:55 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121007221955.6BCAF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4687?compare_to=4684&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4687, Order: 165381, Start Time: 2012-10-07 20:57:41, End Time: 2012-10-07 22:21:42 To: 4684, Order: 165380, Start Time: 2012-10-07 19:17:32, End Time: 2012-10-07 20:40:46 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (14 on baseline) Performance Regressions: 2 (89 on baseline) Performance Improvements: 13 (48 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 962 (754 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.21% (0.8763 => 0.8869, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 7.00% (3.2359 => 3.4623, std.dev.: 0.0467) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.64% (0.8628 => 0.8400, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.93% (0.8509 => 0.8345, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.71% (0.8905 => 0.8753, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: -1.68% (16.5702 => 16.2916, std.dev.: 0.0533) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.49% (0.8916 => 0.8783, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.48% (0.9204 => 0.9068, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.13% (1.1197 => 1.1071, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: -1.04% (5.0618 => 5.0093, std.dev.: 0.0102) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: -14.56% (3.5756 => 3.0550, std.dev.: 0.1516) MultiSource/Benchmarks/Olden/bisort/bisort: -3.77% (0.6704 => 0.6451, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_container: -2.15% (4.6312 => 4.5316, std.dev.: 0.0159) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -1.23% (2.7486 => 2.7147, std.dev.: 0.0109) MultiSource/Applications/lua/lua: -1.04% (29.8628 => 29.5525, std.dev.: 0.0770) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.17% (1.0234 => 1.0217, std.dev.: 0.0077) MultiSource/Applications/sqlite3/sqlite3: -0.76% (0.6329 => 0.6281, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/08-main/main: -4.92% (0.1829 => 0.1739, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.13% (0.1594 => 0.1592, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.51% (0.3186 => 0.3234, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.50% (0.2398 => 0.2434, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.09% (0.3266 => 0.3269, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.04% (0.2346 => 0.2345, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: 9.11% (0.0395 => 0.0431, std.dev.: 0.0016) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -12.20% (0.0246 => 0.0216, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 2.03% (0.0197 => 0.0201, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0395 => 0.0395, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.98% (0.0305 => 0.0308, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -9.03% (0.0288 => 0.0262, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.22% (0.0329 => 0.0333, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0185 => 0.0185, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 1.53% (0.0196 => 0.0199, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 0.79% (0.0253 => 0.0255, std.dev.: 0.0009) SingleSource/UnitTests/byval-alignment: -0.30% (0.0331 => 0.0330, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 80.00% (0.0005 => 0.0009, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -0.28% (0.1428 => 0.1424, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: -1.26% (1.5329 => 1.5136, std.dev.: 0.0352) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.78% (0.1513 => 0.1540, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 6.49% (0.4020 => 0.4281, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.48% (0.1448 => 0.1441, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.29% (0.0567 => 0.0580, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.51% (0.0199 => 0.0196, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.42% (0.0620 => 0.0574, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.55% (1.1326 => 1.1264, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 275.00% (0.0004 => 0.0015, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -72.22% (0.0018 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.21% (0.0607 => 0.0545, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 30.46% (0.0197 => 0.0257, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.10% (0.7655 => 0.7647, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: -0.02% (1.7075 => 1.7071, std.dev.: 0.0180) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -56.20% (0.0121 => 0.0053, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 148.31% (0.0089 => 0.0221, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: 180.00% (0.0090 => 0.0252, std.dev.: 0.0002) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -27.42% (4.1772 => 3.0319, std.dev.: 0.0246) SingleSource/Benchmarks/Shootout-C++/except: 82116.67% (0.0006 => 0.4933, std.dev.: 0.0060) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: -80.00% (0.0005 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 25.00% (0.0004 => 0.0005, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.55% (0.0745 => 0.0913, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.01% (0.1159 => 0.1275, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 9.59% (0.5309 => 0.5818, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.50% (0.6410 => 0.7019, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: 9.10% (2.1763 => 2.3744, std.dev.: 0.0166) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.32% (0.3582 => 0.3880, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.00% (0.1375 => 0.1485, std.dev.: 0.0032) MultiSource/Applications/minisat/minisat: 7.92% (0.6173 => 0.6662, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.64% (0.1414 => 0.1522, std.dev.: 0.0026) MultiSource/Applications/SIBsim4/SIBsim4: 7.15% (1.1653 => 1.2486, std.dev.: 0.0192) MultiSource/Applications/lemon/lemon: 6.72% (1.0046 => 1.0721, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.63% (1.5150 => 1.6154, std.dev.: 0.0124) MultiSource/Applications/kimwitu++/kc: 6.41% (15.3105 => 16.2916, std.dev.: 0.0533) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.19% (0.2552 => 0.2710, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.96% (0.6069 => 0.6431, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.64% (0.7639 => 0.8070, std.dev.: 0.0051) MultiSource/Applications/oggenc/oggenc: 5.56% (4.7455 => 5.0093, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.43% (0.2797 => 0.2949, std.dev.: 0.0025) MultiSource/Applications/d/make_dparser: 5.21% (3.0225 => 3.1800, std.dev.: 0.0134) MultiSource/Benchmarks/McCat/18-imp/imp: 5.10% (0.3217 => 0.3381, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.06% (0.4248 => 0.4463, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 5.02% (13.3238 => 13.9931, std.dev.: 0.0715) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.84% (0.3901 => 0.4090, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 4.82% (1.8798 => 1.9704, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.75% (0.2886 => 0.3023, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.65% (0.4880 => 0.5107, std.dev.: 0.0040) MultiSource/Applications/sgefa/sgefa: 4.62% (0.2877 => 0.3010, std.dev.: 0.0033) MultiSource/Benchmarks/Bullet/bullet: 4.45% (29.3170 => 30.6230, std.dev.: 0.4635) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.45% (0.4562 => 0.4765, std.dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.31% (6.2546 => 6.5243, std.dev.: 0.0208) MultiSource/Benchmarks/nbench/nbench: 4.29% (1.0821 => 1.1285, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.12% (1.4408 => 1.5001, std.dev.: 0.0089) MultiSource/Applications/siod/siod: 4.09% (2.0972 => 2.1829, std.dev.: 0.0075) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.07% (0.2654 => 0.2762, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.89% (0.5636 => 0.5855, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/football/football: 3.85% (0.8405 => 0.8729, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.83% (1.1827 => 1.2280, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.81% (1.2021 => 1.2479, std.dev.: 0.0068) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.76% (0.7722 => 0.8012, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.70% (0.8569 => 0.8886, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.64% (3.0758 => 3.1877, std.dev.: 0.0205) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.63% (2.0317 => 2.1055, std.dev.: 0.0155) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.57% (1.0689 => 1.1071, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.57% (0.7226 => 0.7484, std.dev.: 0.0066) MultiSource/Benchmarks/sim/sim: 3.57% (0.3084 => 0.3194, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 3.50% (14.7256 => 15.2404, std.dev.: 0.1582) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.46% (12.6413 => 13.0793, std.dev.: 0.0837) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.45% (0.5937 => 0.6142, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/moments: 3.40% (0.3412 => 0.3528, std.dev.: 0.0019) MultiSource/Applications/Burg/burg: 3.34% (1.1440 => 1.1822, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/hash: 3.30% (0.3520 => 0.3636, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 3.30% (6.4908 => 6.7047, std.dev.: 0.0347) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.26% (1.1672 => 1.2052, std.dev.: 0.0138) MultiSource/Applications/hbd/hbd: 3.23% (1.3268 => 1.3697, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.22% (1.2742 => 1.3152, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.20% (4.2815 => 4.4185, std.dev.: 0.0202) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.17% (4.0318 => 4.1597, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/hash2: 3.04% (0.3847 => 0.3964, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.52% (4.2616 => 4.3690, std.dev.: 0.0187) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.34% (0.5520 => 0.5649, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.33% (0.5963 => 0.6102, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.26% (4.3380 => 4.4360, std.dev.: 0.0306) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.09% (8.2559 => 8.4286, std.dev.: 0.0488) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.76% (1.3935 => 1.4180, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 41.39% (1.6538 => 2.3383, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (3.4629 => 4.2276, std.dev.: 0.0188) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.54% (0.0766 => 0.0908, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 16.68% (0.0917 => 0.1070, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/ary3: 14.99% (1.7426 => 2.0039, std.dev.: 0.0504) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 14.33% (4.0101 => 4.5849, std.dev.: 0.0066) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.92% (2.4042 => 2.7149, std.dev.: 0.0833) SingleSource/Benchmarks/McGill/queens: 11.10% (1.6261 => 1.8066, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 10.54% (0.1433 => 0.1584, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/mason/mason: 9.77% (0.5004 => 0.5493, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.00% (1.0063 => 1.0969, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout/lists: 9.00% (7.0025 => 7.6327, std.dev.: 0.0190) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.61% (0.2857 => 0.3103, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.43% (40.4792 => 42.6791, std.dev.: 0.2147) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.42% (0.3301 => 0.3480, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/dt: 4.47% (0.9851 => 1.0291, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.89% (3.4080 => 3.5407, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: 3.89% (15.2242 => 15.8165, std.dev.: 0.0573) MultiSource/Benchmarks/Ptrdist/ft/ft: 3.55% (0.8498 => 0.8800, std.dev.: 0.0021) MultiSource/Applications/siod/siod: 3.55% (3.5520 => 3.6782, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.08% (0.5587 => 0.5759, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.83% (6.6312 => 6.8188, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.84% (2.6656 => 2.7147, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.69% (4.6127 => 4.6907, std.dev.: 0.0296) MultiSource/Benchmarks/Olden/power/power: 1.38% (1.4184 => 1.4380, std.dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.33% (0.0591 => 0.0329, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -43.59% (0.2996 => 0.1690, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.88% (1.4189 => 1.1510, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.00% (1.4113 => 1.1572, std.dev.: 0.0080) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.52% (0.3497 => 0.2045, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.25% (5.2665 => 4.0947, std.dev.: 0.1670) SingleSource/Benchmarks/Shootout-C++/ary3: -20.51% (1.7473 => 1.3889, std.dev.: 0.0719) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.05% (1.7361 => 1.4749, std.dev.: 0.0305) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1585, std.dev.: 0.0349) MultiSource/Benchmarks/McCat/17-bintr/bintr: -12.00% (0.0917 => 0.0807, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.66% (1.1647 => 1.0522, std.dev.: 0.0318) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2864, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: -8.34% (9.5474 => 8.7515, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.87% (3.2007 => 2.9487, std.dev.: 0.0324) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.85% (3.6254 => 3.3772, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/fibo: -6.77% (4.6355 => 4.3216, std.dev.: 0.0118) MultiSource/Applications/lambda-0_1_3/lambda: -6.68% (7.6833 => 7.1700, std.dev.: 0.0425) SingleSource/Benchmarks/Misc/richards_benchmark: -6.51% (1.4441 => 1.3501, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.07% (2.9728 => 2.7923, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.47% (3.9413 => 3.7257, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/distray/distray: -5.37% (0.2664 => 0.2521, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/fib2: -5.14% (4.4195 => 4.1922, std.dev.: 0.0369) MultiSource/Benchmarks/Olden/bh/bh: -5.09% (2.5166 => 2.3884, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.62% (0.4564 => 0.4353, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -4.22% (62.4126 => 59.7803, std.dev.: 0.3875) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.89% (3.6023 => 3.4623, std.dev.: 0.0467) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.40% (1.2722 => 1.2289, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.23% (1.1683 => 1.1306, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/methcall: -3.18% (9.2503 => 8.9566, std.dev.: 0.0654) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.00% (45.4683 => 44.1054, std.dev.: 0.3772) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.73% (3.7496 => 3.6472, std.dev.: 0.0217) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.68% (0.4140 => 0.4029, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.48% (1.2959 => 1.2638, std.dev.: 0.0060) MultiSource/Benchmarks/PAQ8p/paq8p: -2.37% (92.7467 => 90.5444, std.dev.: 0.4557) MultiSource/Applications/aha/aha: -1.91% (3.4286 => 3.3632, std.dev.: 0.0116) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.90% (2.3569 => 2.3121, std.dev.: 0.0128) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.83% (2.8964 => 2.8433, std.dev.: 0.0096) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.74% (9.3855 => 9.2225, std.dev.: 0.0163) MultiSource/Benchmarks/sim/sim: -1.70% (3.8907 => 3.8247, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: -1.69% (3.4876 => 3.4285, std.dev.: 0.0123) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.61% (1.0686 => 1.0514, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -1.60% (1.0926 => 1.0751, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.59% (2.4457 => 2.4069, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/lists: -1.52% (16.5617 => 16.3095, std.dev.: 0.0605) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.33% (27.1724 => 26.8113, std.dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: -1.21% (6.7458 => 6.6643, std.dev.: 0.0241) SingleSource/Benchmarks/McGill/chomp: -1.18% (1.0194 => 1.0074, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.04% (1.8739 => 1.8545, std.dev.: 0.0052) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.37% (0.9980 => 1.0217, std.dev.: 0.0077) MultiSource/Applications/sqlite3/sqlite3: 4.30% (0.6022 => 0.6281, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/08-main/main: 4.38% (0.1666 => 0.1739, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.45% (0.1554 => 0.1592, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.90% (0.3083 => 0.3234, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.67% (0.2394 => 0.2434, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.96% (0.3175 => 0.3269, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.87% (0.2302 => 0.2345, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: -4.01% (0.0449 => 0.0431, std.dev.: 0.0016) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -10.00% (0.0240 => 0.0216, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 4.69% (0.0192 => 0.0201, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.28% (0.0390 => 0.0395, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 2.33% (0.0301 => 0.0308, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -7.75% (0.0284 => 0.0262, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 2.78% (0.0324 => 0.0333, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 4.52% (0.0177 => 0.0185, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 5.29% (0.0189 => 0.0199, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 2.41% (0.0249 => 0.0255, std.dev.: 0.0009) SingleSource/UnitTests/byval-alignment: 1.54% (0.0325 => 0.0330, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -10.00% (0.0010 => 0.0009, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -0.35% (0.1429 => 0.1424, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 0.78% (1.5019 => 1.5136, std.dev.: 0.0352) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 2.60% (0.1501 => 0.1540, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.40% (0.4264 => 0.4281, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.22% (0.1344 => 0.1441, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.53% (0.0589 => 0.0580, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -15.52% (0.0232 => 0.0196, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.17% (0.0639 => 0.0574, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.76% (1.1350 => 1.1264, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 150.00% (0.0006 => 0.0015, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.44% (0.0637 => 0.0545, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.47% (0.0246 => 0.0257, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.41% (0.7541 => 0.7647, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 11.12% (1.5363 => 1.7071, std.dev.: 0.0180) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -60.00% (0.0005 => 0.0002, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 100.00% (0.0001 => 0.0002, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -24.29% (0.0070 => 0.0053, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 7 15:26:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 17:26:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121007222625.C4F542A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4688?compare_to=4685&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4688, Order: 165381, Start Time: 2012-10-07 21:13:42, End Time: 2012-10-07 22:28:11 To: 4685, Order: 165380, Start Time: 2012-10-07 19:30:14, End Time: 2012-10-07 20:44:43 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (183 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1039 (754 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.19% (55.2777 => 56.4856, std.dev.: 0.1286) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.72% (41.7944 => 42.5148, std.dev.: 0.1168) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.12% (1.2918 => 1.3063, std.dev.: 0.0012) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 22.03% (2.0176 => 2.4621, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.23% (0.1410 => 0.1667, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 15.86% (0.0826 => 0.0957, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 14.89% (0.2243 => 0.2577, std.dev.: 0.0006) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.15% (0.1072 => 0.1213, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.83% (0.0834 => 0.0941, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 12.64% (0.1013 => 0.1141, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 12.36% (0.4328 => 0.4863, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.31% (0.1413 => 0.1587, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.76% (0.1327 => 0.1483, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.68% (3.9660 => 4.4291, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.62% (0.0964 => 0.1076, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.59% (0.1588 => 0.1772, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 11.58% (0.5818 => 0.6492, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.54% (0.2721 => 0.3035, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 11.54% (0.7038 => 0.7850, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 11.50% (0.4062 => 0.4529, std.dev.: 0.0018) MultiSource/Applications/hbd/hbd: 11.49% (1.3693 => 1.5267, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference: 11.44% (0.7061 => 0.7869, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.44% (0.2596 => 0.2893, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 11.40% (0.5748 => 0.6403, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.19% (1.2193 => 1.3558, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 11.18% (0.2781 => 0.3092, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.17% (0.7710 => 0.8571, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.13% (0.9199 => 1.0223, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.11% (0.2782 => 0.3091, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.03% (1.4563 => 1.6169, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.01% (0.6283 => 0.6975, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.96% (0.6959 => 0.7722, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.96% (0.5265 => 0.5842, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 10.92% (0.1062 => 0.1178, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.90% (0.3485 => 0.3865, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.75% (0.3899 => 0.4318, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.62% (0.4390 => 0.4856, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.61% (1.1364 => 1.2570, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 10.58% (13.8202 => 15.2823, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.56% (0.3022 => 0.3341, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.52% (0.3756 => 0.4151, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 10.51% (0.3293 => 0.3639, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.48% (0.4016 => 0.4437, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 10.47% (0.2607 => 0.2880, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 10.47% (0.2760 => 0.3049, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 10.46% (0.2628 => 0.2903, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 10.45% (0.2726 => 0.3011, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 10.45% (0.2690 => 0.2971, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 10.39% (0.2761 => 0.3048, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.38% (0.3489 => 0.3851, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.37% (0.1157 => 0.1277, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 10.37% (0.3868 => 0.4269, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 10.36% (0.3107 => 0.3429, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/wc: 10.35% (0.2937 => 0.3241, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.35% (0.2966 => 0.3273, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 10.28% (0.3453 => 0.3808, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.28% (0.3580 => 0.3948, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 10.26% (0.3149 => 0.3472, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.25% (1.9828 => 2.1861, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.24% (0.2655 => 0.2927, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.24% (0.2765 => 0.3048, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 10.17% (0.1003 => 0.1105) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.05% (0.1075 => 0.1183, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.02% (0.2914 => 0.3206, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 9.99% (0.3192 => 0.3511, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 9.96% (0.3534 => 0.3886, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.96% (0.4791 => 0.5268, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.94% (0.2696 => 0.2964, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.92% (0.5577 => 0.6130, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 9.90% (1.0313 => 1.1334, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 9.87% (0.2988 => 0.3283, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 9.85% (0.2995 => 0.3290, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.74% (0.3130 => 0.3435, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.73% (0.4379 => 0.4805, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 9.73% (1.1061 => 1.2137, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 9.69% (0.1589 => 0.1743, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 9.68% (16.6129 => 18.2209, std.dev.: 0.0077) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.62% (0.1435 => 0.1573, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.52% (0.1986 => 0.2175, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.48% (0.1276 => 0.1397, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.40% (0.2127 => 0.2327, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 9.30% (0.2945 => 0.3219, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.29% (0.8698 => 0.9506, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 9.27% (0.1111 => 0.1214, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 9.25% (0.3220 => 0.3518, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.22% (0.5637 => 0.6157, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.21% (0.3246 => 0.3545, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 9.16% (0.6744 => 0.7362, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/football/football: 9.13% (0.8310 => 0.9069, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/gs/gs: 9.05% (3.8646 => 4.2145, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.98% (0.7460 => 0.8130, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 8.97% (0.7506 => 0.8179, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.94% (0.6576 => 0.7164, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.91% (7.2180 => 7.8613, std.dev.: 0.0040) MultiSource/Applications/siod/siod: 8.85% (2.1791 => 2.3719, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.79% (0.3755 => 0.4085, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.70% (0.2023 => 0.2199, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 8.67% (3.1889 => 3.4655, std.dev.: 0.0116) MultiSource/Applications/viterbi/viterbi: 8.66% (0.1478 => 0.1606, std.dev.: 0.0021) MultiSource/Applications/treecc/treecc: 8.62% (1.9270 => 2.0931, std.dev.: 0.0053) MultiSource/Benchmarks/nbench/nbench: 8.59% (1.0594 => 1.1504, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.53% (0.1865 => 0.2024, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 8.41% (0.2925 => 0.3171, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.32% (0.8818 => 0.9552, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 8.24% (0.3131 => 0.3389, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 8.21% (0.1657 => 0.1793, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.16% (0.1569 => 0.1697, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.13% (3.6692 => 3.9675, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.12% (1.3245 => 1.4320, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 8.08% (1.2749 => 1.3779, std.dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: 8.07% (14.8535 => 16.0528, std.dev.: 0.0091) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.99% (0.1789 => 0.1932, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.99% (4.3801 => 4.7299, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.91% (4.4433 => 4.7948, std.dev.: 0.0109) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.91% (0.6135 => 0.6620, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 7.86% (8.4961 => 9.1641, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/05-eks/eks: 7.78% (0.4113 => 0.4433, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 7.64% (0.4003 => 0.4309, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.62% (0.2140 => 0.2303, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 7.56% (0.3914 => 0.4210, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.49% (4.9865 => 5.3598, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/synchronized: 7.45% (0.3663 => 0.3936, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 7.43% (0.3578 => 0.3844, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 7.41% (1.2292 => 1.3203, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 7.38% (4.6629 => 5.0071, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.35% (0.3511 => 0.3769, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.34% (0.3789 => 0.4067, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.34% (0.3940 => 0.4229, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.30% (0.3646 => 0.3912, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.25% (0.3601 => 0.3862, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 7.23% (0.6250 => 0.6702, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.21% (0.3650 => 0.3913, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.20% (1.5188 => 1.6281, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.19% (0.2504 => 0.2684, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.18% (0.3623 => 0.3883, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.13% (0.9108 => 0.9757, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.09% (1.1333 => 1.2136, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.95% (0.4805 => 0.5139, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.93% (3.2742 => 3.5012, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/oourafft: 6.87% (0.2008 => 0.2146, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.81% (0.3245 => 0.3466, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 6.58% (6.5754 => 7.0083, std.dev.: 0.0175) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.46% (0.2321 => 0.2471, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.40% (6.2785 => 6.6803, std.dev.: 0.0026) MultiSource/Applications/lua/lua: 6.34% (3.7467 => 3.9842, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.15% (2.1007 => 2.2299, std.dev.: 0.0077) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.10% (0.1819 => 0.1930, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.48% (13.2842 => 14.0117, std.dev.: 0.0156) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.68% (0.2243 => 0.2348, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 3.81% (16.2614 => 16.8803, std.dev.: 0.0132) MultiSource/Applications/ClamAV/clamscan: 3.67% (14.5298 => 15.0627, std.dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: 1.38% (33.2944 => 33.7542, std.dev.: 0.0078) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.73% (0.4846 => 0.6965, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.48% (5.7573 => 7.5123, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.52% (1.8175 => 2.2631, std.dev.: 0.0500) SingleSource/Benchmarks/Misc/richards_benchmark: 10.97% (1.1560 => 1.2828, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 9.03% (0.8273 => 0.9020, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (3.1736 => 3.4147, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.18% (1.2998 => 1.3801, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0043, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.89% (1.7081 => 1.7746, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6760, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9858, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.30% (10.7476 => 11.1019, std.dev.: 0.0256) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.14% (7.4271 => 7.5860, std.dev.: 0.0048) MultiSource/Applications/lemon/lemon: 1.60% (1.4298 => 1.4527, std.dev.: 0.0018) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5150, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.37% (1.9433 => 1.9699, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2123, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1875, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5780, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.15% (12.4560 => 12.5988, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0265, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.15% (0.2670 => 0.1411, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.76% (0.4657 => 0.3923, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/mason/mason: -15.42% (0.0707 => 0.0598, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.86% (1.3813 => 1.1898, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.67% (1.3819 => 1.1930, std.dev.: 0.0062) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.06% (22.5627 => 21.8717, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.64% (0.0997 => 0.0861, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.11% (0.2238 => 0.1967, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.06% (1.2308 => 1.0947, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.03% (20.3410 => 18.3005, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.20% (1.3780 => 1.3063, std.dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8004, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.58% (3.2729 => 3.1556, std.dev.: 0.0263) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.56% (1.7688 => 1.7059, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.65% (26.5159 => 25.8122, std.dev.: 0.0340) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -2.46% (3.0263 => 2.9519, std.dev.: 0.0012) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.31% (1.9762 => 1.9306, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.02% (0.6589 => 0.6456, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7146, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/lists: -1.72% (6.3560 => 6.2469, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0079, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8641, std.dev.: 0.0069) MultiSource/Applications/sqlite3/sqlite3: -1.25% (4.5928 => 4.5352, std.dev.: 0.0073) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4945, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -1.14% (5.3167 => 5.2563, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: -1.06% (9.3358 => 9.2365, std.dev.: 0.0093) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 7 15:36:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 17:36:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121007223619.BC3AD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4689?compare_to=4686&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4689, Order: 165381, Start Time: 2012-10-07 21:18:52, End Time: 2012-10-07 22:38:05 To: 4686, Order: 165380, Start Time: 2012-10-07 19:30:19, End Time: 2012-10-07 20:49:43 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (153 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1024 (764 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.20% (1.0848 => 1.0978, std.dev.: 0.0011) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.03% (0.5876 => 0.5874, std.dev.: 0.0033) MultiSource/Applications/SPASS/SPASS: -0.05% (16.2216 => 16.2134, std.dev.: 0.0187) MultiSource/Benchmarks/Bullet/bullet: 0.01% (54.8819 => 54.8898, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/gs/gs: -0.05% (4.3839 => 4.3816, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.04% (1.2466 => 1.2471, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.05% (7.7660 => 7.7697, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.18% (0.7404 => 0.7391, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -1.10% (0.0364 => 0.0360, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.05% (0.2163 => 0.2162, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -13.21% (63.2438 => 54.8898, std.dev.: 0.0059) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.41% (14.1553 => 18.7432, std.dev.: 0.0200) SingleSource/Benchmarks/Misc-C++-EH/spirit: 61.11% (3.4629 => 5.5792, std.dev.: 0.0064) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14224.31% (0.0720 => 10.3135, std.dev.: 0.0144) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952100.00% (0.0001 => 9.9522, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 51.45% (0.2554 => 0.3868, std.dev.: 0.0072) MultiSource/Benchmarks/PAQ8p/paq8p: 48.73% (10.3673 => 15.4192, std.dev.: 0.0116) SingleSource/Benchmarks/Misc/richards_benchmark: 30.95% (0.1622 => 0.2124, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 30.87% (0.1056 => 0.1382, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.46% (2.2022 => 2.5426, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 15.43% (0.1432 => 0.1653, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.81% (7.0540 => 8.0989, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.37% (0.1566 => 0.1791, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.49% (1.7609 => 1.9808, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.17% (0.0871 => 0.0977) SingleSource/Benchmarks/Misc/oourafft: 11.82% (0.3282 => 0.3670, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.92% (0.1584 => 0.1757, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.87% (0.3543 => 0.3928, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.25% (0.3473 => 0.3829, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.22% (0.3561 => 0.3925, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.12% (0.3497 => 0.3851, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.10% (0.3516 => 0.3871, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.08% (0.3543 => 0.3900, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 9.93% (0.1440 => 0.1583, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.83% (0.3927 => 0.4313) SingleSource/UnitTests/ObjC/for-in: 9.80% (0.3694 => 0.4056, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 9.80% (0.3828 => 0.4203, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.68% (0.3886 => 0.4262, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.46% (0.1438 => 0.1574) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.45% (0.4879 => 0.5340, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.24% (0.6675 => 0.7292, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 9.11% (9.4845 => 10.3482, std.dev.: 0.0158) SingleSource/Benchmarks/McGill/chomp: 9.06% (0.1655 => 0.1805, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 9.04% (0.7115 => 0.7758, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 9.00% (0.7433 => 0.8102, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.94% (0.3177 => 0.3461, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 8.84% (10.4361 => 11.3588, std.dev.: 0.0063) MultiSource/Applications/sgefa/sgefa: 8.78% (0.3109 => 0.3382, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.60% (1.5415 => 1.6740, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/Hello: 8.57% (0.5925 => 0.6433, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.52% (0.4615 => 0.5008, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference-object: 8.46% (0.6030 => 0.6540, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.44% (0.5105 => 0.5536, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.43% (0.1625 => 0.1762, std.dev.: 0.0044) MultiSource/Applications/oggenc/oggenc: 8.34% (5.7591 => 6.2392, std.dev.: 0.0131) MultiSource/Benchmarks/McCat/18-imp/imp: 8.30% (0.3423 => 0.3707, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.30% (0.5569 => 0.6031, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.28% (1.3050 => 1.4130, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.19% (0.2758 => 0.2984, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 8.17% (3.3354 => 3.6078, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/em3d/em3d: 8.14% (0.1695 => 0.1833, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.07% (0.5860 => 0.6333, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.06% (0.2271 => 0.2454, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.95% (4.2646 => 4.6035, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.92% (0.8067 => 0.8706, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.88% (0.1510 => 0.1629, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.88% (0.8172 => 0.8816, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference: 7.85% (0.7326 => 0.7901, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 7.76% (0.6456 => 0.6957, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.75% (0.2065 => 0.2225, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.74% (0.2107 => 0.2270, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.70% (0.2700 => 0.2908, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.68% (0.3307 => 0.3561, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.65% (0.9765 => 1.0512, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 7.60% (0.3422 => 0.3682, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.59% (8.1363 => 8.7540, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.59% (0.5020 => 0.5401, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.58% (0.4103 => 0.4414, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.57% (5.0018 => 5.3803, std.dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.56% (0.3121 => 0.3357, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.54% (4.9449 => 5.3178, std.dev.: 0.0101) MultiSource/Applications/spiff/spiff: 7.47% (0.7835 => 0.8420, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 7.46% (0.4289 => 0.4609, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 7.44% (0.3387 => 0.3639, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.42% (1.1642 => 1.2506, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.22% (0.1940 => 0.2080, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.21% (0.4203 => 0.4506, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 7.21% (3.8723 => 4.1514, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.20% (0.4636 => 0.4970, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 7.13% (1.5603 => 1.6715, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.12% (0.3865 => 0.4140, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.09% (0.2905 => 0.3111, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.07% (0.3650 => 0.3908, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.07% (7.9617 => 8.5243, std.dev.: 0.0070) MultiSource/Applications/viterbi/viterbi: 7.01% (0.1555 => 0.1664, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.99% (0.2891 => 0.3093, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 6.97% (0.4048 => 0.4330, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.96% (0.2831 => 0.3028, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 6.90% (1.0722 => 1.1462, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.86% (0.3136 => 0.3351, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hash2: 6.84% (0.4620 => 0.4936, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.77% (0.3162 => 0.3376, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 6.76% (0.3684 => 0.3933, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 6.75% (2.0273 => 2.1641, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 6.74% (0.3603 => 0.3846, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.74% (0.3441 => 0.3673, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.69% (0.3826 => 0.4082, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 6.67% (0.3283 => 0.3502, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.65% (0.2603 => 0.2776, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.64% (2.0665 => 2.2038, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary: 6.62% (0.3232 => 0.3446, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.62% (0.2871 => 0.3061, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.62% (0.3098 => 0.3303, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.51% (0.2872 => 0.3059, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.50% (1.5859 => 1.6890, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.49% (0.2756 => 0.2935, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.46% (1.1861 => 1.2627, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 6.39% (0.2725 => 0.2899, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 6.35% (0.4299 => 0.4572, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 6.32% (0.3052 => 0.3245, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.29% (0.6450 => 0.6856, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 6.27% (0.8921 => 0.9480, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 6.26% (0.3180 => 0.3379, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 6.26% (0.2877 => 0.3057, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.25% (0.2802 => 0.2977, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 6.22% (2.2969 => 2.4398, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.15% (0.2714 => 0.2881, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.10% (0.3379 => 0.3585, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.09% (0.2793 => 0.2963, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.02% (0.5981 => 0.6341, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 5.97% (21.9371 => 23.2470, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.69% (2.2024 => 2.3277, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.49% (0.4064 => 0.4287, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.46% (0.1906 => 0.2010, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.44% (0.1892 => 0.1995, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.38% (1.4186 => 1.4949, std.dev.: 0.0038) MultiSource/Benchmarks/nbench/nbench: 5.32% (1.1840 => 1.2470, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.94% (0.2266 => 0.2378, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 4.69% (0.3131 => 0.3278, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.61% (1.2842 => 1.3434, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.36% (0.8101 => 0.8454, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.71% (14.3668 => 14.9004, std.dev.: 0.0152) MultiSource/Applications/sqlite3/sqlite3: 3.29% (17.1811 => 17.7459, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.87% (3.8922 => 4.0040, std.dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.58% (1.1194 => 1.1483, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: 146.51% (5.3999 => 13.3114, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.85% (1.1396 => 1.2519, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.20% (3.1595 => 3.4501, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.71% (3.1578 => 3.3697, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.65% (0.3463 => 0.3624, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.75% (3.6395 => 3.7758, std.dev.: 0.0029) SingleSource/Regression/C/uint64_to_float: 3.71% (0.5413 => 0.5614, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.88% (4.2280 => 4.3497, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.55% (0.8275 => 0.8403, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8132, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.14% (2.6546 => 2.6848, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.07% (6.5088 => 6.5787, std.dev.: 0.0056) MultiSource/Applications/minisat/minisat: 1.06% (9.1159 => 9.2129, std.dev.: 0.0235) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1293, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -80.25% (0.8651 => 0.1709, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.96% (5.2763 => 3.2736, std.dev.: 0.0171) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.68% (5.3855 => 3.6255, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.25% (5.3526 => 3.6264, std.dev.: 0.0021) SingleSource/UnitTests/Vector/constpool: -14.54% (54.1659 => 46.2919, std.dev.: 0.0263) MultiSource/Benchmarks/FreeBench/mason/mason: -13.19% (0.0811 => 0.0704, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -11.16% (22.1758 => 19.7016, std.dev.: 0.0123) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.53% (2.9384 => 2.6290, std.dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.34% (1.1492 => 0.7660, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.94% (1.6925 => 1.4227, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.83% (0.0998 => 0.0860, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.27% (1.2373 => 1.0978, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3784, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/mason/mason: -9.76% (0.2161 => 0.1950, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.46% (19.9488 => 18.2620, std.dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.63% (1.8329 => 1.7113, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.28% (1.6805 => 1.5918, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: -5.10% (1.5835 => 1.5028, std.dev.: 0.0018) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -3.70% (3.2827 => 3.1614, std.dev.: 0.0091) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.19% (0.9957 => 0.9639, std.dev.: 0.0110) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5015, std.dev.: 0.0084) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0987, std.dev.: 0.0014) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.11% (8.6802 => 8.4973, std.dev.: 0.0129) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.99% (8.1563 => 7.9942, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0837, std.dev.: 0.0049) SingleSource/UnitTests/Vector/multiplies: -1.74% (2.5528 => 2.5083, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6813, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4202, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -1.13% (6.2999 => 6.2290, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8564, std.dev.: 0.0165) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.34% (0.5229 => 0.5874, std.dev.: 0.0033) MultiSource/Applications/SPASS/SPASS: 8.17% (14.9895 => 16.2134, std.dev.: 0.0187) MultiSource/Benchmarks/MallocBench/gs/gs: 6.60% (4.1105 => 4.3816, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.88% (1.1048 => 1.2471, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.54% (7.1582 => 7.7697, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.79% (0.6222 => 0.7391, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35900.00% (0.0001 => 0.0360, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.17% (0.2116 => 0.2162, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 7 16:35:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 18:35:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121007233536.205712A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4690?compare_to=4683&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4690, Order: 165380, Start Time: 2012-10-07 20:53:46, End Time: 2012-10-07 23:37:22 To: 4683, Order: 165377, Start Time: 2012-10-07 17:41:19, End Time: 2012-10-07 20:24:49 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (131 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 1038 (832 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 4.41% (0.3880 => 0.4051, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.45% (124.4720 => 128.7623, std.dev.: 0.8884) SingleSource/Benchmarks/Shootout-C++/fibo: 1.13% (12.2445 => 12.3831, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.11% (2.1375 => 2.0282, std.dev.: 0.0352) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 12.10% (0.3488 => 0.3910, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.04% (0.1063 => 0.1191, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 12.02% (0.3460 => 0.3876, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.98% (0.3446 => 0.3859, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 11.96% (0.3469 => 0.3884, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-4: 11.92% (0.3465 => 0.3878, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.88% (0.3442 => 0.3851, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 11.87% (0.3496 => 0.3911, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 11.78% (1.5932 => 1.7809, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/property: 11.78% (0.3650 => 0.4080, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/exceptions: 11.53% (0.3643 => 0.4063, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.33% (0.3724 => 0.4146, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.73% (0.5826 => 0.6393, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 9.61% (0.5889 => 0.6455, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 8.21% (0.1619 => 0.1752, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 8.14% (0.7171 => 0.7755, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.93% (0.2875 => 0.3103, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.69% (0.4994 => 0.5378, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.66% (0.4361 => 0.4695, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 7.66% (0.3004 => 0.3234, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.63% (0.2725 => 0.2933, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.62% (0.2729 => 0.2937, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 7.55% (0.2714 => 0.2919, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.50% (1.3152 => 1.4138, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.49% (0.2738 => 0.2943, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.48% (0.3195 => 0.3434, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 7.47% (0.2823 => 0.3034, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.47% (0.2813 => 0.3023, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.45% (0.2792 => 0.3000, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.42% (1.6211 => 1.7414, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/random: 7.38% (0.2803 => 0.3010, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 7.37% (0.2780 => 0.2985, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.35% (0.1620 => 0.1739, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 7.35% (0.2750 => 0.2952, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.34% (0.5000 => 0.5367, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.32% (3.5627 => 3.8234, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.30% (2.0673 => 2.2182, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.28% (0.2911 => 0.3123, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 7.24% (0.3096 => 0.3320, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 7.21% (0.9909 => 1.0623, std.dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.13% (2.7292 => 2.9238, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.12% (0.3060 => 0.3278, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 7.07% (5.5417 => 5.9336, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.3267 => 0.3497, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 7.03% (0.3258 => 0.3487, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 6.99% (0.4847 => 0.5186, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.99% (0.3362 => 0.3597, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 6.99% (0.3477 => 0.3720, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 6.98% (1.0781 => 1.1534, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: 6.96% (0.3678 => 0.3934, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary2: 6.93% (0.3317 => 0.3547, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.92% (0.3625 => 0.3876, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.90% (0.2014 => 0.2153, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.86% (0.3282 => 0.3507, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 6.84% (0.3348 => 0.3577, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 6.82% (0.3726 => 0.3980, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.76% (0.4139 => 0.4419, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.76% (0.3845 => 0.4105, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.75% (0.3124 => 0.3335, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 6.73% (0.4146 => 0.4425, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.60% (4.4195 => 4.7111, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: 6.59% (0.4251 => 0.4531, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.58% (0.2736 => 0.2916, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.56% (0.3930 => 0.4188, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 6.51% (23.5202 => 25.0512, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.51% (0.5026 => 0.5353, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.50% (0.3690 => 0.3930, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.42% (0.2866 => 0.3050, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.36% (0.3981 => 0.4234, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 6.35% (0.4029 => 0.4285, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 6.30% (0.6634 => 0.7052, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.30% (0.3890 => 0.4135, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 6.27% (0.2566 => 0.2727, std.dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: 6.27% (4.2109 => 4.4751, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.26% (0.2969 => 0.3155, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.19% (0.5900 => 0.6265, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.17% (0.3903 => 0.4144, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 6.16% (1.8794 => 1.9951, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.05% (0.1968 => 0.2087, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 5.95% (1.4269 => 1.5118, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.94% (0.6435 => 0.6817, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 5.92% (2.1013 => 2.2257, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.92% (0.2737 => 0.2899, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.90% (0.3084 => 0.3266, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.85% (0.2068 => 0.2189, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 5.80% (4.6177 => 4.8857, std.dev.: 0.0094) MultiSource/Applications/JM/ldecod/ldecod: 5.67% (2.1653 => 2.2881, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.62% (0.4658 => 0.4920, std.dev.: 0.0032) MultiSource/Applications/Burg/burg: 5.61% (0.5546 => 0.5857, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.59% (0.2040 => 0.2154, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.44% (0.3271 => 0.3449, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.33% (0.2103 => 0.2215, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 5.31% (0.3336 => 0.3513, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 5.25% (0.2075 => 0.2184, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 5.22% (0.9697 => 1.0203, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: 5.10% (2.0346 => 2.1383, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 5.03% (0.7875 => 0.8271, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.90% (1.9694 => 2.0659, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.88% (1.9966 => 2.0940, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 4.61% (0.2691 => 0.2815, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 4.56% (0.2391 => 0.2500, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.48% (0.5361 => 0.5601, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.47% (0.7426 => 0.7758, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.42% (0.5584 => 0.5831, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.89% (11.6398 => 12.0927, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.67% (4.6926 => 4.8650, std.dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: 3.60% (0.3498 => 0.3624, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.19% (0.3792 => 0.3913, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.17% (0.4253 => 0.4388, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 2.71% (11.9555 => 12.2791, std.dev.: 0.0088) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 8.06% (0.2122 => 0.2293, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6101, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6751, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-2: 5.01% (1.8057 => 1.8961, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1654, std.dev.: 0.1182) SingleSource/Benchmarks/Dhrystone/dry: 4.25% (14.0481 => 14.6447, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1953, std.dev.: 0.0444) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5018, std.dev.: 0.0264) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.59% (3.1722 => 3.2225, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2900, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5130, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5786, std.dev.: 0.0111) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.88% (25.4195 => 16.5521, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/ary2: -8.95% (0.2402 => 0.2187, std.dev.: 0.0053) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9750, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7893, std.dev.: 0.0095) MultiSource/Benchmarks/Olden/tsp/tsp: -7.31% (2.1113 => 1.9570, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7982, std.dev.: 0.0054) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7733, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/fldry: -2.36% (17.2379 => 16.8319, std.dev.: 0.0607) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.34% (0.6293 => 0.6146, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.20% (41.7953 => 40.8758, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5780, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4959, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.22% (105.3826 => 104.0985, std.dev.: 0.0872) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0429, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 7 17:52:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 19:52:30 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121008005230.302412A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4691?compare_to=4687&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4691, Order: 165382, Start Time: 2012-10-07 23:31:22, End Time: 2012-10-08 00:54:17 To: 4687, Order: 165381, Start Time: 2012-10-07 20:57:41, End Time: 2012-10-07 22:21:42 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (14 on baseline) Performance Regressions: 5 (91 on baseline) Performance Improvements: 3 (47 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 969 (753 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/himenobmtxpa: 4.39% (4.2720 => 4.4597, std.dev.: 0.0346) SingleSource/Benchmarks/Shootout-C++/ary3: 3.56% (1.3889 => 1.4384, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/ffbench: 2.72% (1.4163 => 1.4548, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.55% (44.1054 => 44.7877, std.dev.: 0.2321) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.12% (2.7147 => 2.7452, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -6.87% (9.1315 => 8.5046, std.dev.: 0.2026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.23% (4.4185 => 4.3641, std.dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.83% (6.4949 => 6.1811, std.dev.: 0.0556) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.01% (1.0217 => 1.0216, std.dev.: 0.0130) MultiSource/Applications/sqlite3/sqlite3: -1.19% (0.6281 => 0.6206, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/08-main/main: 2.93% (0.1739 => 0.1790, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.44% (0.1592 => 0.1585, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.35% (0.3234 => 0.3158, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.08% (0.2434 => 0.2359, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.35% (0.3269 => 0.3225, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (0.2345 => 0.2320, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: 5.10% (0.0431 => 0.0453, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 12.04% (0.0216 => 0.0242, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -2.99% (0.0201 => 0.0195, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -13.42% (0.0395 => 0.0342, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -23.05% (0.0308 => 0.0237, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 8.78% (0.0262 => 0.0285, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.60% (0.0333 => 0.0321, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -1.62% (0.0185 => 0.0182, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -2.01% (0.0199 => 0.0195, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0255 => 0.0255, std.dev.: 0.0016) SingleSource/UnitTests/byval-alignment: -0.61% (0.0330 => 0.0328, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -44.44% (0.0009 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.21% (0.1424 => 0.1427, std.dev.: 0.0102) MultiSource/Applications/lemon/lemon: 1.33% (1.5136 => 1.5337, std.dev.: 0.0128) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -4.61% (0.1540 => 0.1469, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.84% (0.4281 => 0.4031, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.62% (0.1441 => 0.1360, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.45% (0.0580 => 0.0531, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.51% (0.0196 => 0.0195, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.52% (0.0574 => 0.0577, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.55% (1.1264 => 1.1326, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -20.00% (0.0015 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0005 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.92% (0.0545 => 0.0550, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.62% (0.0257 => 0.0204, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.17% (0.7647 => 0.7660, std.dev.: 0.0108) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.01% (1.7071 => 1.7069, std.dev.: 0.0073) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 150.00% (0.0002 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 150.00% (0.0002 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 18.87% (0.0053 => 0.0063, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 135.96% (0.0089 => 0.0210, std.dev.: 0.0003) SingleSource/UnitTests/2003-08-11-VaListArg: 175.56% (0.0090 => 0.0248, std.dev.: 0.0034) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -27.08% (4.1772 => 3.0462, std.dev.: 0.0546) SingleSource/Benchmarks/Shootout-C++/except: 82316.67% (0.0006 => 0.4945, std.dev.: 0.0038) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 24.16% (0.0745 => 0.0925, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.35% (0.1159 => 0.1279, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 10.00% (2.1763 => 2.3940, std.dev.: 0.0133) SingleSource/Benchmarks/Misc-C++/bigfib: 8.97% (0.5309 => 0.5785, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.88% (0.3582 => 0.3900, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.55% (0.6410 => 0.6958, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: 7.87% (0.6173 => 0.6659, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 7.86% (1.1653 => 1.2569, std.dev.: 0.0091) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.71% (0.1414 => 0.1523, std.dev.: 0.0031) MultiSource/Applications/lemon/lemon: 7.39% (1.0046 => 1.0788, std.dev.: 0.0193) MultiSource/Applications/kimwitu++/kc: 6.67% (15.3105 => 16.3315, std.dev.: 0.0442) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.61% (0.2797 => 0.2982, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.50% (0.2552 => 0.2718, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.15% (1.5150 => 1.6082, std.dev.: 0.0059) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.12% (0.2303 => 0.2444, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 5.97% (0.6915 => 0.7328, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.72% (0.7639 => 0.8076, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/oourafft: 5.53% (0.1971 => 0.2080, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.45% (0.6069 => 0.6400, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 5.41% (3.0225 => 3.1859, std.dev.: 0.0462) MultiSource/Benchmarks/McCat/18-imp/imp: 5.38% (0.3217 => 0.3390, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.27% (0.4248 => 0.4472, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.26% (0.3901 => 0.4106, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.10% (0.8569 => 0.9006, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.90% (0.2654 => 0.2784, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.75% (0.4880 => 0.5112, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.67% (0.3062 => 0.3205, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 4.66% (13.3238 => 13.9445, std.dev.: 0.1003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.64% (1.2021 => 1.2579, std.dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: 4.60% (29.3170 => 30.6657, std.dev.: 0.1329) MultiSource/Applications/siod/siod: 4.54% (2.0972 => 2.1925, std.dev.: 0.0133) MultiSource/Applications/sgefa/sgefa: 4.48% (0.2877 => 0.3006, std.dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 4.44% (4.7455 => 4.9564, std.dev.: 0.0547) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.30% (1.1827 => 1.2336, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.19% (0.7226 => 0.7529, std.dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 4.13% (8.2186 => 8.5579, std.dev.: 0.0334) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.00% (1.1672 => 1.2139, std.dev.: 0.0052) MultiSource/Applications/hbd/hbd: 3.99% (1.3268 => 1.3798, std.dev.: 0.0129) MultiSource/Applications/treecc/treecc: 3.95% (1.8798 => 1.9541, std.dev.: 0.0241) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.90% (6.2546 => 6.4986, std.dev.: 0.0222) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.85% (1.4408 => 1.4963, std.dev.: 0.0076) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.82% (0.3008 => 0.3123, std.dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 3.81% (14.7256 => 15.2872, std.dev.: 0.1011) MultiSource/Benchmarks/nbench/nbench: 3.78% (1.0821 => 1.1230, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.78% (0.2886 => 0.2995, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 3.75% (0.2771 => 0.2875, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.70% (3.0758 => 3.1897, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.67% (2.0317 => 2.1063, std.dev.: 0.0203) MultiSource/Applications/lua/lua: 3.63% (3.5980 => 3.7285, std.dev.: 0.0188) MultiSource/Applications/JM/ldecod/ldecod: 3.53% (6.4908 => 6.7201, std.dev.: 0.0512) MultiSource/Benchmarks/Prolangs-C/football/football: 3.50% (0.8405 => 0.8699, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.36% (0.3418 => 0.3533, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.05% (12.6413 => 13.0264, std.dev.: 0.0532) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.98% (0.4562 => 0.4698, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 2.86% (3.8796 => 3.9907, std.dev.: 0.0200) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.65% (0.5963 => 0.6121, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.59% (4.2616 => 4.3719, std.dev.: 0.0264) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.42% (4.0318 => 4.1293, std.dev.: 0.0166) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.38% (1.2742 => 1.3045, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.14% (8.2559 => 8.4326, std.dev.: 0.0502) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.93% (4.2815 => 4.3641, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.85% (4.3380 => 4.4181, std.dev.: 0.0170) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 48.66% (0.0261 => 0.0388, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/pi: 41.41% (1.6538 => 2.3386, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 22.16% (3.4629 => 4.2302, std.dev.: 0.0187) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.36% (0.0766 => 0.0899, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/ary3: 14.97% (1.7426 => 2.0035, std.dev.: 0.0196) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.57% (2.4042 => 2.7304, std.dev.: 0.0186) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.45% (4.0101 => 4.5496, std.dev.: 0.0237) SingleSource/Benchmarks/McGill/queens: 11.11% (1.6261 => 1.8067, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: 9.99% (0.5004 => 0.5504, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.84% (1.0063 => 1.1053, std.dev.: 0.0108) MultiSource/Benchmarks/Olden/perimeter/perimeter: 9.07% (0.2857 => 0.3116, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout/lists: 8.74% (7.0025 => 7.6145, std.dev.: 0.0470) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.86% (4.2129 => 4.4597, std.dev.: 0.0346) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.24% (0.3301 => 0.3474, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/dt: 4.55% (0.9851 => 1.0299, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: 4.16% (15.2242 => 15.8576, std.dev.: 0.0196) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5414, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 3.34% (6.9722 => 7.2054, std.dev.: 0.0301) SingleSource/Benchmarks/Misc/ffbench: 3.05% (1.4117 => 1.4548, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.99% (2.6656 => 2.7452, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.95% (0.5587 => 0.5752, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 2.93% (3.5520 => 3.6561, std.dev.: 0.0138) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.86% (0.5876 => 0.6044, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.84% (6.6312 => 6.8193, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash: 2.36% (0.6308 => 0.6457, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.27% (0.8498 => 0.8691, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/whetstone: 2.17% (2.3453 => 2.3962, std.dev.: 0.0128) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.07% (4.6127 => 4.7081, std.dev.: 0.0141) MultiSource/Benchmarks/Olden/power/power: 1.47% (1.4184 => 1.4393, std.dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -44.33% (0.0591 => 0.0329, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -43.39% (0.2996 => 0.1696, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.67% (1.4189 => 1.1398, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.49% (1.4113 => 1.1504, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -40.26% (0.3497 => 0.2089, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/lpbench: -21.34% (5.2665 => 4.1425, std.dev.: 0.0532) SingleSource/Benchmarks/Shootout-C++/ary3: -17.68% (1.7473 => 1.4384, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.15% (1.7361 => 1.4730, std.dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.13% (15.8312 => 13.4355, std.dev.: 0.5576) SingleSource/Benchmarks/Shootout/sieve: -12.24% (8.1594 => 7.1610, std.dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.60% (1.1647 => 1.0529, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: -8.37% (9.5474 => 8.7486, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.25% (1.4034 => 1.2876, std.dev.: 0.0138) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.88% (3.2007 => 2.9484, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.84% (3.6254 => 3.3774, std.dev.: 0.0134) MultiSource/Applications/lambda-0_1_3/lambda: -6.71% (7.6833 => 7.1680, std.dev.: 0.0268) SingleSource/Benchmarks/Shootout-C++/fibo: -6.49% (4.6355 => 4.3348, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/richards_benchmark: -6.41% (1.4441 => 1.3516, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.97% (2.9728 => 2.7952, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.47% (3.9413 => 3.7257, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/fib2: -5.17% (4.4195 => 4.1912, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.73% (0.4564 => 0.4348, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -4.54% (2.5166 => 2.4023, std.dev.: 0.0202) MultiSource/Benchmarks/mafft/pairlocalalign: -4.19% (62.4126 => 59.7984, std.dev.: 0.1283) MultiSource/Applications/sgefa/sgefa: -3.95% (0.3746 => 0.3598, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -3.49% (9.2503 => 8.9271, std.dev.: 0.0547) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.45% (1.2722 => 1.2283, std.dev.: 0.0139) SingleSource/Benchmarks/McGill/misr: -3.05% (0.4296 => 0.4165, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.85% (0.4140 => 0.4022, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.81% (3.7496 => 3.6441, std.dev.: 0.0171) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.65% (2.4457 => 2.3808, std.dev.: 0.0149) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.53% (1.1683 => 1.1387, std.dev.: 0.0052) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.50% (1.2959 => 1.2635, std.dev.: 0.0105) SingleSource/Benchmarks/Dhrystone/dry: -2.22% (2.4013 => 2.3479, std.dev.: 0.0026) MultiSource/Benchmarks/PAQ8p/paq8p: -2.00% (92.7467 => 90.8880, std.dev.: 0.4830) SingleSource/Benchmarks/Shootout-C++/hash2: -1.95% (3.4876 => 3.4197, std.dev.: 0.0005) MultiSource/Applications/aha/aha: -1.86% (3.4286 => 3.3648, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.83% (1.0686 => 1.0490, std.dev.: 0.0053) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.75% (2.3569 => 2.3156, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -1.74% (3.8907 => 3.8231, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: -1.67% (1.0926 => 1.0744, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.61% (61.1734 => 60.1892, std.dev.: 0.3479) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.60% (9.3855 => 9.2352, std.dev.: 0.0057) MultiSource/Applications/SIBsim4/SIBsim4: -1.59% (3.4230 => 3.3687, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -1.50% (45.4683 => 44.7877, std.dev.: 0.2321) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.33% (27.1724 => 26.8116, std.dev.: 0.0546) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.31% (25.6658 => 25.3305, std.dev.: 0.0303) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.36% (0.9980 => 1.0216, std.dev.: 0.0130) MultiSource/Applications/sqlite3/sqlite3: 3.06% (0.6022 => 0.6206, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/08-main/main: 7.44% (0.1666 => 0.1790, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.99% (0.1554 => 0.1585, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.43% (0.3083 => 0.3158, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.46% (0.2394 => 0.2359, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.57% (0.3175 => 0.3225, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.78% (0.2302 => 0.2320, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: 0.89% (0.0449 => 0.0453, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.83% (0.0240 => 0.0242, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.56% (0.0192 => 0.0195, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -12.31% (0.0390 => 0.0342, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -21.26% (0.0301 => 0.0237, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.35% (0.0284 => 0.0285, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0324 => 0.0321, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 2.82% (0.0177 => 0.0182, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 3.17% (0.0189 => 0.0195, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 2.41% (0.0249 => 0.0255, std.dev.: 0.0016) SingleSource/UnitTests/byval-alignment: 0.92% (0.0325 => 0.0328, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -50.00% (0.0010 => 0.0005, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.14% (0.1429 => 0.1427, std.dev.: 0.0102) MultiSource/Applications/lemon/lemon: 2.12% (1.5019 => 1.5337, std.dev.: 0.0128) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -2.13% (0.1501 => 0.1469, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.46% (0.4264 => 0.4031, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.19% (0.1344 => 0.1360, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.85% (0.0589 => 0.0531, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -15.95% (0.0232 => 0.0195, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.70% (0.0639 => 0.0577, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.21% (1.1350 => 1.1326, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0006 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.66% (0.0637 => 0.0550, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.07% (0.0246 => 0.0204, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.58% (0.7541 => 0.7660, std.dev.: 0.0108) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.10% (1.5363 => 1.7069, std.dev.: 0.0073) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -10.00% (0.0070 => 0.0063, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 7 17:56:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 19:56:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121008005657.9D5442A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4692?compare_to=4688&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4692, Order: 165382, Start Time: 2012-10-07 23:44:14, End Time: 2012-10-08 00:58:43 To: 4688, Order: 165381, Start Time: 2012-10-07 21:13:42, End Time: 2012-10-07 22:28:11 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (180 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1041 (756 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.13% (0.9737 => 0.9530, std.dev.: 0.0072) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 21.98% (2.0176 => 2.4610, std.dev.: 0.0057) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.38% (0.1410 => 0.1655, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 15.86% (0.0826 => 0.0957, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 14.62% (0.2243 => 0.2571, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.06% (0.1072 => 0.1212, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.59% (0.0834 => 0.0939, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 12.44% (0.1013 => 0.1139, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 12.20% (0.4328 => 0.4856, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 12.04% (0.4062 => 0.4551, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.03% (0.1413 => 0.1583, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 11.68% (0.1062 => 0.1186, std.dev.: 0.0039) SingleSource/UnitTests/ObjC++/property-reference-object: 11.62% (0.5818 => 0.6494, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.61% (0.2721 => 0.3037, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.61% (0.1327 => 0.1481) SingleSource/UnitTests/ObjC++/Hello: 11.45% (0.5748 => 0.6406, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 11.42% (0.7038 => 0.7842, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.38% (3.9660 => 4.4174, std.dev.: 0.0111) MultiSource/Applications/hbd/hbd: 11.37% (1.3693 => 1.5250, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.31% (0.0964 => 0.1073, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 11.26% (0.7061 => 0.7856, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.25% (0.2782 => 0.3095, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.21% (0.1588 => 0.1766, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 11.18% (0.2781 => 0.3092, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.13% (0.2596 => 0.2885, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.92% (1.2193 => 1.3524, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.85% (0.3899 => 0.4322, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.84% (0.6283 => 0.6964, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.79% (0.3485 => 0.3861, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.78% (0.9199 => 1.0191, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.77% (0.7710 => 0.8540, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/random: 10.74% (0.2690 => 0.2979, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.72% (1.4563 => 1.6124, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 10.70% (0.2607 => 0.2886, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.69% (0.6959 => 0.7703, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.67% (0.5265 => 0.5827, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.62% (0.3022 => 0.3343, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.62% (0.2655 => 0.2937, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 10.62% (0.2628 => 0.2907, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 10.59% (0.2937 => 0.3248, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 10.54% (0.2760 => 0.3051, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.51% (0.4016 => 0.4438, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 10.49% (0.2726 => 0.3012, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.49% (0.3756 => 0.4150, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 10.48% (0.3293 => 0.3638, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 10.39% (13.8202 => 15.2557, std.dev.: 0.0157) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.32% (0.4390 => 0.4843, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.31% (1.9828 => 2.1873, std.dev.: 0.0100) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.25% (1.1364 => 1.2529, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.24% (0.2765 => 0.3048, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 10.20% (0.3107 => 0.3424, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.18% (0.2966 => 0.3268, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.17% (0.3489 => 0.3844, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 10.17% (0.3453 => 0.3804, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 10.16% (0.3149 => 0.3469, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 10.14% (0.2761 => 0.3041, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.14% (0.3580 => 0.3943, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 10.13% (0.3868 => 0.4260, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.13% (0.2696 => 0.2969, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 9.90% (0.3534 => 0.3884, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 9.87% (0.3192 => 0.3507, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 9.77% (0.2988 => 0.3280, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.77% (0.1075 => 0.1180, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.77% (0.1157 => 0.1270, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.71% (0.3130 => 0.3434, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.60% (0.4791 => 0.5251, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 9.56% (1.0313 => 1.1299, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.50% (0.5577 => 0.6107, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.45% (0.4379 => 0.4793, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 9.45% (16.6129 => 18.1822, std.dev.: 0.0215) MultiSource/Applications/sgefa/sgefa: 9.42% (0.2995 => 0.3277, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.40% (0.1276 => 0.1396, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.37% (0.1986 => 0.2172, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 9.31% (0.1589 => 0.1737, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.17% (0.2127 => 0.2322, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.16% (0.2914 => 0.3181, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 9.15% (1.1061 => 1.2073, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.04% (0.8698 => 0.9484, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.01% (0.7460 => 0.8132, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.00% (0.3755 => 0.4093, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 9.00% (0.2945 => 0.3210, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.99% (0.1435 => 0.1564, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.92% (0.5637 => 0.6140, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.84% (0.3246 => 0.3533, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 8.82% (0.6744 => 0.7339, std.dev.: 0.0022) MultiSource/Applications/spiff/spiff: 8.82% (0.7506 => 0.8168, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 8.79% (3.8646 => 4.2043, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/football/football: 8.77% (0.8310 => 0.9039, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 8.76% (0.3220 => 0.3502, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.65% (7.2180 => 7.8425, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.58% (0.1865 => 0.2025, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.55% (0.6576 => 0.7138, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.50% (0.2023 => 0.2195, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 8.46% (1.9270 => 2.0901, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 8.39% (2.1791 => 2.3620, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: 8.39% (3.1889 => 3.4564, std.dev.: 0.0059) MultiSource/Benchmarks/nbench/nbench: 8.28% (1.0594 => 1.1471, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 8.25% (0.1478 => 0.1600, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/09-vor/vor: 8.03% (0.2925 => 0.3160, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.03% (0.1569 => 0.1695, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 8.02% (1.2749 => 1.3772, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 7.95% (0.3131 => 0.3380, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 7.90% (4.6629 => 5.0311, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.88% (3.6692 => 3.9582, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.86% (0.8818 => 0.9511, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/em3d/em3d: 7.79% (0.1657 => 0.1786, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.78% (1.3245 => 1.4276, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.69% (4.3801 => 4.7168, std.dev.: 0.0081) MultiSource/Applications/JM/lencod/lencod: 7.64% (14.8535 => 15.9882, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.62% (4.4433 => 4.7819, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.60% (0.1789 => 0.1925, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 7.53% (8.4961 => 9.1358, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.52% (0.2140 => 0.2301, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.47% (0.6135 => 0.6593, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 7.42% (0.4003 => 0.4300, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 7.35% (0.3578 => 0.3841, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.33% (0.3914 => 0.4201, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 7.32% (0.4113 => 0.4414, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.28% (4.9865 => 5.3496, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 7.28% (0.6250 => 0.6705, std.dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 7.22% (1.2292 => 1.3180, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.21% (0.3646 => 0.3909, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.15% (0.3789 => 0.4060, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.14% (0.3601 => 0.3858, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.08% (0.3940 => 0.4219, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.06% (0.3511 => 0.3759, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.04% (0.3650 => 0.3907, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.02% (0.3663 => 0.3920, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.99% (0.4805 => 0.5141, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 6.90% (0.3623 => 0.3873, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.83% (0.2504 => 0.2675, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.82% (1.5188 => 1.6224, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.77% (0.9108 => 0.9725, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.73% (1.1333 => 1.2096, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.68% (3.2742 => 3.4930, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.65% (0.1819 => 0.1940, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 6.62% (0.2008 => 0.2141, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.59% (0.3245 => 0.3459, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 6.30% (6.5754 => 6.9898, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.29% (0.2321 => 0.2467) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.12% (6.2785 => 6.6630, std.dev.: 0.0095) MultiSource/Applications/lua/lua: 6.01% (3.7467 => 3.9718, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.84% (2.1007 => 2.2233, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.26% (13.2842 => 13.9827, std.dev.: 0.0056) MultiSource/Applications/sqlite3/sqlite3: 3.60% (16.2614 => 16.8461, std.dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: 3.46% (14.5298 => 15.0324, std.dev.: 0.0087) MultiSource/Benchmarks/Bullet/bullet: 1.05% (33.2944 => 33.6450, std.dev.: 0.0184) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5145, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.59% (1.8175 => 2.2644, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 11.21% (1.1560 => 1.2856, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 9.02% (0.8273 => 0.9019, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.47% (0.1322 => 0.1434, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4141, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.31% (1.2998 => 1.3818, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.64% (1.9144 => 2.0032, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7747, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.66% (11.2619 => 11.6742, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 3.45% (10.7476 => 11.1184, std.dev.: 0.0342) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9861, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: 2.97% (0.5449 => 0.5611, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.20% (7.4271 => 7.5907, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4536, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5134, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2122, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1867, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.17% (5.5130 => 5.5774, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0275, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.07% (12.4560 => 12.5898, std.dev.: 0.0055) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.15% (0.2670 => 0.1411, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.93% (0.4657 => 0.3915, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -15.56% (0.0707 => 0.0597) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.01% (1.3819 => 1.1883, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.99% (1.3813 => 1.1880, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.37% (22.5627 => 21.8027, std.dev.: 0.0211) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.64% (0.0997 => 0.0861, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -11.97% (0.2238 => 0.1970, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.98% (1.2308 => 1.0956, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.12% (20.3410 => 18.2833, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -5.09% (2.6470 => 2.5124, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.99% (1.3780 => 1.3093, std.dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.66% (0.9996 => 0.9530, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.47% (1.7688 => 1.7075, std.dev.: 0.0067) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -2.86% (3.2729 => 3.1793, std.dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.51% (26.5159 => 25.8507, std.dev.: 0.0193) MultiSource/Applications/spiff/spiff: -2.43% (3.0263 => 2.9527, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.35% (1.9762 => 1.9297, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.97% (0.6589 => 0.6459, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7149, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/lists: -1.73% (6.3560 => 6.2463, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0063, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8660, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: -1.25% (4.5928 => 4.5352, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4952, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.08% (5.3167 => 5.2592, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: -1.04% (9.3358 => 9.2387, std.dev.: 0.0149) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 7 18:01:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 20:01:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121008010138.287CA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4693?compare_to=4689&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4693, Order: 165382, Start Time: 2012-10-07 23:44:15, End Time: 2012-10-08 01:03:23 To: 4689, Order: 165381, Start Time: 2012-10-07 21:18:52, End Time: 2012-10-07 22:38:05 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (151 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1024 (766 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.16% (80.1321 => 81.0628, std.dev.: 0.1768) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.03% (0.5874 => 0.5872, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: -0.27% (16.2134 => 16.1691, std.dev.: 0.0073) MultiSource/Benchmarks/Bullet/bullet: -0.27% (54.8898 => 54.7397, std.dev.: 0.0102) MultiSource/Benchmarks/MallocBench/gs/gs: 0.03% (4.3816 => 4.3830, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.21% (1.2471 => 1.2445, std.dev.: 0.0060) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.23% (7.7697 => 7.7520, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.7391 => 0.7391, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 1.11% (0.0360 => 0.0364, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1433 => 0.1432, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.02% (0.2162 => 0.2140, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -13.45% (63.2438 => 54.7397, std.dev.: 0.0102) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.35% (14.1553 => 18.7351, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 60.79% (3.4629 => 5.5681, std.dev.: 0.0043) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14225.97% (0.0720 => 10.3147, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952200.00% (0.0001 => 9.9523, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 50.98% (0.2554 => 0.3856, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 47.31% (10.3673 => 15.2720, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/distray/distray: 30.49% (0.1056 => 0.1378, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 30.46% (0.1622 => 0.2116, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.53% (2.2022 => 2.5443, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/flops: 15.22% (0.1432 => 0.1650, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.86% (7.0540 => 8.1024, std.dev.: 0.0042) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.37% (0.1566 => 0.1791, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.98% (1.7609 => 1.9718, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.94% (0.0871 => 0.0975, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 11.52% (0.3282 => 0.3660, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.67% (0.1584 => 0.1753, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 10.51% (0.3473 => 0.3838, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.44% (0.3543 => 0.3913, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-2: 10.44% (0.3497 => 0.3862, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 10.31% (0.3561 => 0.3928, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.30% (0.3516 => 0.3878, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.27% (0.3543 => 0.3907, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.03% (0.3927 => 0.4321, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.99% (0.3694 => 0.4063, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.95% (0.3828 => 0.4209, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.88% (0.3886 => 0.4270, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 9.58% (0.1440 => 0.1578, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.00% (0.6675 => 0.7276, std.dev.: 0.0060) MultiSource/Applications/minisat/minisat: 8.80% (0.7115 => 0.7741, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.75% (0.3177 => 0.3455, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.71% (0.4879 => 0.5304, std.dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 8.70% (9.4845 => 10.3100, std.dev.: 0.0125) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.69% (0.1438 => 0.1563, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: 8.66% (0.5925 => 0.6438, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 8.64% (0.1655 => 0.1798, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 8.62% (0.7433 => 0.8074, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 8.48% (5.7591 => 6.2475, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.37% (1.5415 => 1.6706, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 8.36% (0.3109 => 0.3369, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.34% (0.4615 => 0.5000, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 8.34% (0.6030 => 0.6533, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.05% (0.2758 => 0.2980, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.03% (0.5105 => 0.5515, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.00% (0.1625 => 0.1755, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.97% (0.2271 => 0.2452, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 7.96% (0.1695 => 0.1830, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 7.95% (0.3423 => 0.3695, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 7.94% (3.3354 => 3.6003, std.dev.: 0.0095) SingleSource/UnitTests/ObjC++/property-reference: 7.88% (0.7326 => 0.7903, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 7.85% (10.4361 => 11.2555, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.84% (1.3050 => 1.4073, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.78% (0.2700 => 0.2910, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.76% (0.5860 => 0.6315, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.75% (0.1510 => 0.1627, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.74% (4.2646 => 4.5945, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.71% (0.3307 => 0.3562, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.66% (0.8172 => 0.8798, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 7.65% (0.6456 => 0.6950, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.65% (0.2065 => 0.2223, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.65% (0.5569 => 0.5995, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/lists: 7.60% (0.3422 => 0.3682, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.45% (0.2107 => 0.2264, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.44% (0.4636 => 0.4981, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.40% (0.3121 => 0.3352, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.39% (0.5020 => 0.5391, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.36% (0.9765 => 1.0484, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.35% (0.4203 => 0.4512, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.32% (5.0018 => 5.3678, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.30% (8.1363 => 8.7303, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.30% (4.9449 => 5.3058, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/hash: 7.30% (0.4289 => 0.4602, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 7.29% (0.7835 => 0.8406, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.28% (0.8067 => 0.8654, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.24% (0.4103 => 0.4400, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 7.16% (0.2905 => 0.3113, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 7.15% (1.1642 => 1.2474, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 7.09% (0.3387 => 0.3627, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.06% (0.3865 => 0.4138, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.06% (0.1940 => 0.2077, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 7.03% (0.2831 => 0.3030, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.01% (0.3650 => 0.3906, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 7.00% (3.8723 => 4.1433, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/hash2: 6.97% (0.4620 => 0.4942, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 6.97% (0.4048 => 0.4330, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.92% (0.2891 => 0.3091, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 6.84% (1.5603 => 1.6670, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 6.84% (0.3232 => 0.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.83% (0.2871 => 0.3067, std.dev.: 0.0029) MultiSource/Applications/viterbi/viterbi: 6.82% (0.1555 => 0.1661, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.82% (7.9617 => 8.5044, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/sieve: 6.80% (0.3603 => 0.3848, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.78% (2.0665 => 2.2066, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.76% (0.3136 => 0.3348, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.71% (0.3098 => 0.3306, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.70% (0.3684 => 0.3931, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.70% (0.3283 => 0.3503, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.66% (0.3441 => 0.3670, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.65% (0.2872 => 0.3063, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.64% (0.3162 => 0.3372, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.64% (0.3826 => 0.4080, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 6.63% (2.0273 => 2.1618, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 6.63% (1.0722 => 1.1433, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.49% (0.2756 => 0.2935, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.45% (0.3052 => 0.3249, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.35% (0.2725 => 0.2898, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.33% (0.2877 => 0.3059, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.31% (1.1861 => 1.2609, std.dev.: 0.0064) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.30% (0.2603 => 0.2767, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.30% (1.5859 => 1.6858, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.27% (0.2793 => 0.2968, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.23% (0.2714 => 0.2883, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.21% (0.2802 => 0.2976, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 6.10% (0.3180 => 0.3374, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary2: 6.10% (0.3379 => 0.3585, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 6.05% (2.2969 => 2.4359, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.91% (0.6450 => 0.6831, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 5.90% (0.8921 => 0.9447, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.85% (0.5981 => 0.6331, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/05-eks/eks: 5.82% (0.4299 => 0.4549, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 5.71% (21.9371 => 23.1897, std.dev.: 0.0175) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.56% (0.4064 => 0.4290, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.49% (2.2024 => 2.3233, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.17% (1.4186 => 1.4920, std.dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: 5.05% (1.1840 => 1.2438, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.79% (0.3131 => 0.3281, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.59% (0.2266 => 0.2370, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.58% (1.2842 => 1.3430, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.33% (0.8101 => 0.8452, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.40% (14.3668 => 14.8552, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.30% (0.3427 => 0.3540, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 3.02% (17.1811 => 17.6997, std.dev.: 0.0249) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.70% (0.3817 => 0.3920, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.55% (1.1194 => 1.1479, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.52% (3.8922 => 3.9902, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.25% (1.1145 => 1.3848, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.62% (0.2944 => 0.3286, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9648, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.84% (1.1396 => 1.2517, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 9.20% (3.1595 => 3.4503, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (3.1578 => 3.3679, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.73% (3.6395 => 3.7753, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 3.71% (0.5413 => 0.5614) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.68% (4.2280 => 4.3412, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8126, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.38% (0.9540 => 0.9672, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.12% (2.6546 => 2.6842, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1288, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.22% (5.2763 => 3.2599, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.66% (5.3855 => 3.6264, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.20% (5.3526 => 3.6293, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -14.50% (54.1659 => 46.3139, std.dev.: 0.0171) MultiSource/Benchmarks/FreeBench/mason/mason: -13.44% (0.0811 => 0.0702, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -11.31% (22.1758 => 19.6674, std.dev.: 0.0134) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.51% (2.9384 => 2.6296, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.36% (1.1492 => 0.7658, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4246, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.83% (0.0998 => 0.0860, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -11.41% (1.2373 => 1.0961, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: -10.36% (1.5373 => 1.3781, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/mason/mason: -9.81% (0.2161 => 0.1949, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.52% (19.9488 => 18.2500, std.dev.: 0.0234) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.79% (1.8329 => 1.7085, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8478, std.dev.: 0.0152) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.33% (1.6805 => 1.5909, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: -5.09% (1.5835 => 1.5029, std.dev.: 0.0038) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.99% (0.9957 => 0.9560, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1624, std.dev.: 0.0087) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5010, std.dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0988, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.16% (8.1563 => 7.9798, std.dev.: 0.0094) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.16% (0.4808 => 0.4704, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.03% (8.6802 => 8.5042, std.dev.: 0.0223) SingleSource/Benchmarks/Misc/salsa20: -1.83% (10.2830 => 10.0946, std.dev.: 0.0209) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6815, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.65% (2.5528 => 2.5107, std.dev.: 0.0018) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4203, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8593, std.dev.: 0.0111) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.30% (0.5229 => 0.5872, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 7.87% (14.9895 => 16.1691, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/gs/gs: 6.63% (4.1105 => 4.3830, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.64% (1.1048 => 1.2445, std.dev.: 0.0060) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.30% (7.1582 => 7.7520, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.79% (0.6222 => 0.7391, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36300.00% (0.0001 => 0.0364, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.13% (0.2116 => 0.2140, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 7 19:48:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 21:48:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121008024841.2FD8F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4694?compare_to=4690&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4694, Order: 165382, Start Time: 2012-10-08 00:06:35, End Time: 2012-10-08 02:50:27 To: 4690, Order: 165380, Start Time: 2012-10-07 20:53:46, End Time: 2012-10-07 23:37:22 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (134 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 1040 (829 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.25% (2.0282 => 2.0942, std.dev.: 0.0169) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.24% (128.7623 => 130.3555, std.dev.: 0.4447) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 11.55% (0.3446 => 0.3844, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.52% (0.3465 => 0.3864, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 11.48% (0.3442 => 0.3837, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.47% (0.3488 => 0.3888, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.45% (0.3460 => 0.3856, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.44% (0.3496 => 0.3896, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 11.39% (0.3469 => 0.3864, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.09% (0.3643 => 0.4047, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.07% (0.3650 => 0.4054, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.93% (0.3724 => 0.4131, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.91% (0.1063 => 0.1179, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 10.73% (1.5932 => 1.7642, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.82% (0.5826 => 0.6398, std.dev.: 0.0047) SingleSource/UnitTests/ObjC++/property-reference-object: 9.56% (0.5889 => 0.6452, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 8.70% (0.1218 => 0.1324, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/05-eks/eks: 8.46% (0.1619 => 0.1756, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.21% (0.2875 => 0.3111, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 8.20% (0.7171 => 0.7759, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.97% (0.4994 => 0.5392, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 7.96% (0.3004 => 0.3243, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.95% (1.3152 => 1.4198, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.90% (1.6211 => 1.7491, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hello: 7.89% (0.2714 => 0.2928, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.86% (0.3195 => 0.3446, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.85% (0.2738 => 0.2953, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.82% (0.4361 => 0.4702, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 7.82% (0.2725 => 0.2938, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 7.81% (0.2803 => 0.3022, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.81% (0.2792 => 0.3010, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 7.79% (0.2823 => 0.3043, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.78% (0.9909 => 1.0680, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/matrix: 7.77% (0.2780 => 0.2996, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.71% (0.2813 => 0.3030, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.70% (0.2729 => 0.2939, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 7.67% (0.2750 => 0.2961, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/except: 7.65% (0.2811 => 0.3026, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.64% (2.0673 => 2.2253, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.59% (0.1620 => 0.1743, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.56% (0.2911 => 0.3131, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.55% (3.5627 => 3.8317, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/wc: 7.53% (0.3096 => 0.3329, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.52% (0.3060 => 0.3290, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.48% (0.5000 => 0.5374, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 7.36% (5.5417 => 5.9494, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: 7.36% (0.3317 => 0.3561, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.34% (0.4139 => 0.4443, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.32% (0.3362 => 0.3608, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 7.32% (0.3267 => 0.3506, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.30% (0.2014 => 0.2161, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 7.29% (23.5202 => 25.2358, std.dev.: 0.0146) MultiSource/Applications/d/make_dparser: 7.29% (1.0781 => 1.1567, std.dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.28% (2.7292 => 2.9278, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary: 7.27% (0.3258 => 0.3495, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 7.26% (0.3678 => 0.3945, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 7.23% (0.3348 => 0.3590, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 7.19% (0.3477 => 0.3727, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.15% (0.5900 => 0.6322, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 7.11% (0.3726 => 0.3991, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.11% (0.3124 => 0.3346, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.10% (0.3845 => 0.4118, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 7.08% (0.4847 => 0.5190, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.04% (0.3282 => 0.3513, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.03% (0.3625 => 0.3880, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.98% (0.5026 => 0.5377, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.94% (0.2736 => 0.2926, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.92% (0.3903 => 0.4173, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 6.87% (0.6634 => 0.7090, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash: 6.85% (0.4146 => 0.4430, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.83% (0.3690 => 0.3942, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.82% (0.3930 => 0.4198, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 6.75% (0.4029 => 0.4301, std.dev.: 0.0046) MultiSource/Benchmarks/nbench/nbench: 6.74% (0.2566 => 0.2739, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.71% (0.1549 => 0.1653, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (0.4251 => 0.4535, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 6.66% (1.8794 => 2.0046, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.63% (0.3981 => 0.4245, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 6.54% (4.2109 => 4.4865, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.53% (4.4195 => 4.7080, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.49% (0.2866 => 0.3052, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 6.42% (0.5546 => 0.5902, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.37% (0.6435 => 0.6845, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.37% (0.2969 => 0.3158, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.32% (0.3890 => 0.4136, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.30% (0.1968 => 0.2092, std.dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 6.30% (2.1013 => 2.2336, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.28% (0.2737 => 0.2909, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.24% (0.2068 => 0.2197, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.18% (0.2040 => 0.2166, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 6.13% (0.5012 => 0.5319, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 6.10% (1.4269 => 1.5139, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.03% (0.4658 => 0.4939, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.96% (0.3271 => 0.3466, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 5.92% (4.6177 => 4.8909, std.dev.: 0.0103) MultiSource/Applications/JM/ldecod/ldecod: 5.72% (2.1653 => 2.2892, std.dev.: 0.0053) MultiSource/Applications/minisat/minisat: 5.70% (0.3336 => 0.3526, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 5.61% (0.7875 => 0.8317, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.52% (0.2103 => 0.2219, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 5.45% (0.2075 => 0.2188, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 5.44% (2.0346 => 2.1452, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: 5.39% (0.9697 => 1.0220, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.35% (1.9694 => 2.0748, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.20% (1.9966 => 2.1005, std.dev.: 0.0027) MultiSource/Applications/lemon/lemon: 5.06% (0.2391 => 0.2512, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 4.98% (0.2691 => 0.2825, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.70% (0.5361 => 0.5613, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.69% (0.7426 => 0.7774, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.41% (0.5584 => 0.5830, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.03% (11.6398 => 12.1085, std.dev.: 0.0091) MultiSource/Applications/lambda-0_1_3/lambda: 3.95% (0.3498 => 0.3636, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.90% (4.6926 => 4.8758, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.62% (0.4253 => 0.4407, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.82% (0.3792 => 0.3899, std.dev.: 0.0027) MultiSource/Applications/kimwitu++/kc: 2.81% (11.9555 => 12.2917, std.dev.: 0.0209) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 6.69% (0.2122 => 0.2264, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6113, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6706, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-2: 4.89% (1.8057 => 1.8940, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1706, std.dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: 4.27% (14.0481 => 14.6486, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary3: 2.09% (15.8721 => 16.2035, std.dev.: 0.0032) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5024, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.55% (3.1722 => 3.2215, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2877, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5121, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 1.02% (50.0626 => 50.5749, std.dev.: 0.0180) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.92% (25.4195 => 16.5428, std.dev.: 0.0202) SingleSource/Benchmarks/Shootout-C++/ary2: -7.74% (0.2402 => 0.2216, std.dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9771, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7982, std.dev.: 0.0124) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9576, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.70% (11.2080 => 10.7937, std.dev.: 0.0198) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7731, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/fldry: -2.79% (17.2379 => 16.7578, std.dev.: 0.0511) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.29% (0.6293 => 0.6149, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.21% (41.7953 => 40.8726, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5769, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4955, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.13% (105.3826 => 104.1891, std.dev.: 0.0327) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0407, std.dev.: 0.0037) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 7 19:57:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 21:57:00 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121008025700.9C1D82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4695?compare_to=4691&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4695, Order: 165383, Start Time: 2012-10-08 01:35:11, End Time: 2012-10-08 02:58:48 To: 4691, Order: 165382, Start Time: 2012-10-07 23:31:22, End Time: 2012-10-08 00:54:17 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (14 on baseline) Performance Regressions: 12 (106 on baseline) Performance Improvements: 1 (45 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 964 (740 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.07% (0.5666 => 0.6010, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.72% (0.7774 => 0.8219, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.97% (0.5727 => 0.5897, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.30% (0.6076 => 0.6216, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.30% (4.3641 => 4.4643, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.48% (0.8803 => 0.8933, std.dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.36% (6.4986 => 6.5869, std.dev.: 0.0303) MultiSource/Applications/hbd/hbd: 1.17% (1.3798 => 1.3960, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.05% (8.4326 => 8.5213, std.dev.: 0.0270) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.22% (13.4355 => 14.5398, std.dev.: 0.3966) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.80% (2.8499 => 2.9297, std.dev.: 0.0205) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.55% (2.3808 => 2.4177, std.dev.: 0.0099) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/ffbench: -1.56% (1.4548 => 1.4321, std.dev.: 0.0074) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.16% (1.0216 => 1.0232, std.dev.: 0.0069) MultiSource/Applications/sqlite3/sqlite3: 0.68% (0.6206 => 0.6248, std.dev.: 0.0107) MultiSource/Benchmarks/McCat/08-main/main: 2.46% (0.1790 => 0.1834, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.14% (0.1585 => 0.1603, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.95% (0.3158 => 0.3188, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.52% (0.2359 => 0.2442, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.90% (0.3225 => 0.3254, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.50% (0.2320 => 0.2262, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/mandel: -8.39% (0.0453 => 0.0415, std.dev.: 0.0024) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.48% (0.0242 => 0.0248, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 2.05% (0.0195 => 0.0199) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 15.79% (0.0342 => 0.0396, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 10.97% (0.0237 => 0.0263, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.40% (0.0285 => 0.0289, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 2.80% (0.0321 => 0.0330, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 2.20% (0.0182 => 0.0186, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 1.54% (0.0195 => 0.0198, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: 3.53% (0.0255 => 0.0264, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 0.91% (0.0328 => 0.0331, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 100.00% (0.0005 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.35% (0.1427 => 0.1432, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: -2.76% (1.5337 => 1.4914, std.dev.: 0.0407) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 5.11% (0.1469 => 0.1544, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0001) MultiSource/Applications/viterbi/viterbi: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 6.52% (0.4031 => 0.4294, std.dev.: 0.0221) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.71% (0.1360 => 0.1424, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (0.0005 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.73% (0.0531 => 0.0588, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 17.95% (0.0195 => 0.0230, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 7.11% (0.0577 => 0.0618, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.41% (1.1326 => 1.1279, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -58.33% (0.0012 => 0.0005, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 380.00% (0.0005 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.00% (0.0550 => 0.0583, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 16.18% (0.0204 => 0.0237, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.21% (0.7660 => 0.7644, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: -0.08% (1.7069 => 1.7055, std.dev.: 0.0014) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 92.06% (0.0063 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 147.19% (0.0089 => 0.0220, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: 96.67% (0.0090 => 0.0177, std.dev.: 0.0036) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -27.14% (4.1772 => 3.0435, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/except: 82916.67% (0.0006 => 0.4981, std.dev.: 0.0011) SingleSource/Regression/C++/EH/ctor_dtor_count: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 24.97% (0.0745 => 0.0931, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.81% (0.1414 => 0.1581, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.61% (0.1159 => 0.1282, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.41% (0.6410 => 0.7013, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/bigfib: 9.36% (0.5309 => 0.5806, std.dev.: 0.0025) MultiSource/Benchmarks/PAQ8p/paq8p: 8.83% (2.1763 => 2.3685, std.dev.: 0.0106) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.63% (0.3582 => 0.3891, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 7.84% (0.6173 => 0.6657, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.33% (1.5150 => 1.6261, std.dev.: 0.0159) MultiSource/Applications/SIBsim4/SIBsim4: 6.99% (1.1653 => 1.2468, std.dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.97% (0.2552 => 0.2730, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 6.79% (1.0046 => 1.0728, std.dev.: 0.0102) MultiSource/Applications/kimwitu++/kc: 6.47% (15.3105 => 16.3004, std.dev.: 0.0253) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.44% (0.7722 => 0.8219, std.dev.: 0.0047) MultiSource/Applications/lambda-0_1_3/lambda: 6.25% (0.6915 => 0.7347, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.13% (0.7639 => 0.8107, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.96% (0.4248 => 0.4501, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.89% (0.2886 => 0.3056, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.57% (0.6069 => 0.6407, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.54% (0.2797 => 0.2952, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.33% (0.4880 => 0.5140, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.31% (6.2546 => 6.5869, std.dev.: 0.0303) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.28% (1.1827 => 1.2451, std.dev.: 0.0089) MultiSource/Benchmarks/McCat/18-imp/imp: 5.22% (0.3217 => 0.3385, std.dev.: 0.0028) MultiSource/Applications/hbd/hbd: 5.22% (1.3268 => 1.3960, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/oourafft: 5.12% (0.1971 => 0.2072, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 4.84% (3.0225 => 3.1687, std.dev.: 0.0205) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.75% (0.8569 => 0.8976, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.74% (0.3062 => 0.3207, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.73% (0.2303 => 0.2412, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.70% (0.5740 => 0.6010, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.70% (0.5937 => 0.6216, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.69% (0.3901 => 0.4084, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.63% (0.5636 => 0.5897, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 4.62% (0.2771 => 0.2899, std.dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: 4.61% (29.3170 => 30.6694, std.dev.: 0.1306) MultiSource/Applications/Burg/burg: 4.53% (1.1440 => 1.1958, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 4.52% (13.3238 => 13.9256, std.dev.: 0.0877) MultiSource/Applications/treecc/treecc: 4.52% (1.8798 => 1.9647, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/lists: 4.39% (0.2347 => 0.2450, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 4.32% (0.3847 => 0.4013, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.27% (4.2815 => 4.4643, std.dev.: 0.0179) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.22% (0.2654 => 0.2766, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 4.16% (0.3026 => 0.3152, std.dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 4.13% (1.0821 => 1.1268, std.dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 4.08% (4.7455 => 4.9390, std.dev.: 0.0519) MultiSource/Applications/sgefa/sgefa: 4.03% (0.2877 => 0.2993, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.91% (1.4408 => 1.4971, std.dev.: 0.0098) MultiSource/Applications/siod/siod: 3.88% (2.0972 => 2.1786, std.dev.: 0.0100) MultiSource/Applications/lua/lua: 3.87% (3.5980 => 3.7372, std.dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C/football/football: 3.84% (0.8405 => 0.8728, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/gs/gs: 3.84% (3.8796 => 4.0285, std.dev.: 0.0242) MultiSource/Benchmarks/mafft/pairlocalalign: 3.80% (8.2186 => 8.5311, std.dev.: 0.0577) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.73% (4.0318 => 4.1823, std.dev.: 0.0315) MultiSource/Benchmarks/Olden/bh/bh: 3.72% (0.2820 => 0.2925, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.66% (3.0758 => 3.1885, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.66% (0.3418 => 0.3543, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.56% (1.2021 => 1.2449, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.49% (0.2952 => 0.3055, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 3.44% (0.3520 => 0.3641, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.41% (12.6413 => 13.0723, std.dev.: 0.1515) MultiSource/Applications/JM/lencod/lencod: 3.40% (14.7256 => 15.2260, std.dev.: 0.0557) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.29% (4.2616 => 4.4019, std.dev.: 0.0186) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.28% (0.5520 => 0.5701, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.26% (1.2742 => 1.3157, std.dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.22% (0.4562 => 0.4709, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.21% (8.2559 => 8.5213, std.dev.: 0.0270) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.14% (0.7226 => 0.7453, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.12% (1.0689 => 1.1022, std.dev.: 0.0047) MultiSource/Applications/JM/ldecod/ldecod: 2.91% (6.4908 => 6.6798, std.dev.: 0.0427) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.72% (0.7784 => 0.7996, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.63% (0.5963 => 0.6120, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.36% (4.3380 => 4.4404, std.dev.: 0.0381) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.27% (1.3935 => 1.4251, std.dev.: 0.0068) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 55.56% (0.0261 => 0.0406, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Bubblesort: 47.91% (0.0263 => 0.0389, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/pi: 40.85% (1.6538 => 2.3293, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2284, std.dev.: 0.0357) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 17.23% (0.0917 => 0.1075, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.97% (0.0766 => 0.0896, std.dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.85% (2.4042 => 2.7613, std.dev.: 0.0292) SingleSource/Benchmarks/Shootout/ary3: 14.73% (1.7426 => 1.9992, std.dev.: 0.0654) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.32% (4.0101 => 4.5441, std.dev.: 0.0158) SingleSource/Benchmarks/McGill/queens: 10.61% (1.6261 => 1.7986, std.dev.: 0.0084) MultiSource/Benchmarks/FreeBench/mason/mason: 10.21% (0.5004 => 0.5515, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.89% (0.2857 => 0.3111, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/lists: 8.67% (7.0025 => 7.6097, std.dev.: 0.0436) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.68% (1.0063 => 1.0836, std.dev.: 0.0272) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.06% (0.3301 => 0.3468, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/dt: 4.34% (0.9851 => 1.0279, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: 4.09% (15.2242 => 15.8463, std.dev.: 0.0417) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.00% (40.4792 => 42.0983, std.dev.: 0.5500) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.89% (3.4080 => 3.5405, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 3.50% (3.5520 => 3.6763, std.dev.: 0.0176) MultiSource/Benchmarks/Bullet/bullet: 3.34% (6.9722 => 7.2048, std.dev.: 0.0216) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.94% (0.8498 => 0.8748, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.90% (0.5587 => 0.5749, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.88% (0.5876 => 0.6045, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.86% (6.6312 => 6.8208, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.60% (2.6656 => 2.7349, std.dev.: 0.0132) SingleSource/Benchmarks/Misc/whetstone: 2.09% (2.3453 => 2.3943, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.52% (4.6127 => 4.6829, std.dev.: 0.0161) MultiSource/Benchmarks/Olden/power/power: 1.46% (1.4184 => 1.4391, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 1.45% (1.4117 => 1.4321, std.dev.: 0.0074) MultiSource/Applications/spiff/spiff: 1.10% (2.8599 => 2.8913, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.01% (2.4455 => 2.4703, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -43.86% (0.2996 => 0.1682, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -43.49% (0.0591 => 0.0334, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.98% (1.4189 => 1.1496, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.16% (1.4113 => 1.1691, std.dev.: 0.0094) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -41.26% (0.3497 => 0.2054, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.19% (5.2665 => 4.2033, std.dev.: 0.0999) SingleSource/Benchmarks/Shootout-C++/ary3: -19.23% (1.7473 => 1.4113, std.dev.: 0.0972) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.15% (1.7361 => 1.4731, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/sieve: -12.28% (8.1594 => 7.1577, std.dev.: 0.0343) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.20% (1.1647 => 1.0459, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/ackermann: -8.94% (3.6023 => 3.2802, std.dev.: 0.0670) SingleSource/Benchmarks/Misc/flops: -8.40% (9.5474 => 8.7458, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.27% (1.4034 => 1.2873, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.22% (3.2007 => 2.9376, std.dev.: 0.0118) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.16% (15.8312 => 14.5398, std.dev.: 0.3966) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.77% (3.6254 => 3.3800, std.dev.: 0.0214) MultiSource/Applications/lambda-0_1_3/lambda: -6.64% (7.6833 => 7.1728, std.dev.: 0.0446) SingleSource/Benchmarks/Shootout-C++/fibo: -6.59% (4.6355 => 4.3299, std.dev.: 0.0211) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -5.94% (2.9728 => 2.7961, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: -5.90% (0.3746 => 0.3525, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.47% (3.9413 => 3.7256, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/fib2: -5.26% (4.4195 => 4.1870, std.dev.: 0.0200) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.86% (0.4564 => 0.4342, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -4.80% (2.5166 => 2.3958, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: -4.22% (62.4126 => 59.7812, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.82% (0.4140 => 0.3982, std.dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: -3.58% (8.5323 => 8.2272, std.dev.: 0.1036) SingleSource/Benchmarks/McGill/misr: -3.28% (0.4296 => 0.4155, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.12% (1.2959 => 1.2555, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/methcall: -3.08% (9.2503 => 8.9655, std.dev.: 0.0239) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.97% (1.2722 => 1.2344, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.75% (1.1683 => 1.1362, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -2.18% (1.8739 => 1.8330, std.dev.: 0.0134) MultiSource/Benchmarks/PAQ8p/paq8p: -2.02% (92.7467 => 90.8778, std.dev.: 0.2454) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.79% (2.3569 => 2.3146, std.dev.: 0.0143) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.72% (9.3855 => 9.2238, std.dev.: 0.0161) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -1.57% (3.4876 => 3.4327, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/neural/neural: -1.51% (1.0926 => 1.0761, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.48% (61.1734 => 60.2681, std.dev.: 0.2770) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.40% (27.1724 => 26.7914, std.dev.: 0.0129) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3089, std.dev.: 0.0290) SingleSource/Benchmarks/Dhrystone/fldry: -1.29% (2.4971 => 2.4648, std.dev.: 0.0100) MultiSource/Applications/aha/aha: -1.21% (3.4286 => 3.3871, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.14% (2.4457 => 2.4177, std.dev.: 0.0099) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.53% (0.9980 => 1.0232, std.dev.: 0.0069) MultiSource/Applications/sqlite3/sqlite3: 3.75% (0.6022 => 0.6248, std.dev.: 0.0107) MultiSource/Benchmarks/McCat/08-main/main: 10.08% (0.1666 => 0.1834, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.15% (0.1554 => 0.1603, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.41% (0.3083 => 0.3188, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.01% (0.2394 => 0.2442, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.49% (0.3175 => 0.3254, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.74% (0.2302 => 0.2262, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/mandel: -7.57% (0.0449 => 0.0415, std.dev.: 0.0024) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 3.33% (0.0240 => 0.0248, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 3.65% (0.0192 => 0.0199) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.54% (0.0390 => 0.0396, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -12.62% (0.0301 => 0.0263, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.76% (0.0284 => 0.0289, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.85% (0.0324 => 0.0330, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 5.08% (0.0177 => 0.0186, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 4.76% (0.0189 => 0.0198, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: 6.02% (0.0249 => 0.0264, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 1.85% (0.0325 => 0.0331, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.21% (0.1429 => 0.1432, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: -0.70% (1.5019 => 1.4914, std.dev.: 0.0407) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 2.86% (0.1501 => 0.1544, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.70% (0.4264 => 0.4294, std.dev.: 0.0221) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.95% (0.1344 => 0.1424, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: - (0.0006 => 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.17% (0.0589 => 0.0588, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.86% (0.0232 => 0.0230, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.29% (0.0639 => 0.0618, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.63% (1.1350 => 1.1279, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -16.67% (0.0006 => 0.0005, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.48% (0.0637 => 0.0583, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.66% (0.0246 => 0.0237, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.37% (0.7541 => 0.7644, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.01% (1.5363 => 1.7055, std.dev.: 0.0014) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 7 20:01:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 22:01:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121008030115.21BBA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4696?compare_to=4692&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4696, Order: 165383, Start Time: 2012-10-08 01:48:23, End Time: 2012-10-08 03:03:00 To: 4692, Order: 165382, Start Time: 2012-10-07 23:44:14, End Time: 2012-10-08 00:58:43 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (183 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1041 (754 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 4.33% (2.2644 => 2.3625, std.dev.: 0.0042) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 22.02% (2.0176 => 2.4619, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.59% (0.1410 => 0.1658, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 15.98% (0.0826 => 0.0958, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 14.89% (0.2243 => 0.2577, std.dev.: 0.0006) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.62% (0.1072 => 0.1218, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.83% (0.0834 => 0.0941) MultiSource/Benchmarks/Olden/tsp/tsp: 12.64% (0.1013 => 0.1141, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.45% (0.0819 => 0.0921, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 12.19% (0.5818 => 0.6527, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.03% (0.1413 => 0.1583, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 12.00% (0.5748 => 0.6438, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 11.70% (0.7061 => 0.7887, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 11.69% (0.4328 => 0.4834, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.61% (0.1327 => 0.1481, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.58% (0.2721 => 0.3036, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.50% (3.9660 => 4.4221, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.41% (0.0964 => 0.1074, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 11.37% (0.7038 => 0.7838, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.34% (0.7710 => 0.8584, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.29% (0.2596 => 0.2889, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.27% (0.1588 => 0.1767, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 11.27% (1.3693 => 1.5236, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: 11.03% (0.4062 => 0.4510, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.99% (0.6959 => 0.7724, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.95% (1.2193 => 1.3528, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.87% (1.4563 => 1.6146, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.85% (0.9199 => 1.0197, std.dev.: 0.0034) MultiSource/Applications/aha/aha: 10.83% (0.1062 => 0.1177, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.83% (0.5265 => 0.5835, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.78% (0.2782 => 0.3082, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 10.75% (0.2781 => 0.3080, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.65% (0.6283 => 0.6952, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.57% (0.3899 => 0.4311, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.53% (0.3485 => 0.3852, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 10.46% (13.8202 => 15.2660, std.dev.: 0.0160) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.36% (1.1364 => 1.2541, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 10.33% (0.2690 => 0.2968, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hello: 10.32% (0.2607 => 0.2876, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 10.25% (0.2937 => 0.3238, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.20% (0.3756 => 0.4139, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.16% (0.3022 => 0.3329, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.13% (0.2655 => 0.2924, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.08% (0.4016 => 0.4421, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 10.05% (0.2628 => 0.2892, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 9.99% (0.3293 => 0.3622, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.97% (0.3489 => 0.3837, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.95% (0.1075 => 0.1182, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 9.94% (0.2726 => 0.2997, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.94% (0.1157 => 0.1272, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.86% (0.3580 => 0.3933, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.85% (1.9828 => 2.1781, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 9.82% (0.2760 => 0.3031, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.74% (0.2966 => 0.3255, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.73% (0.2765 => 0.3034, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 9.72% (0.3868 => 0.4244, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 9.71% (0.2761 => 0.3029, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.66% (0.4379 => 0.4802, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.65% (0.3130 => 0.3432, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.65% (0.5577 => 0.6115, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.64% (0.2696 => 0.2956, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 9.64% (0.3453 => 0.3786, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 9.63% (1.0313 => 1.1306, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.62% (0.1986 => 0.2177, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 9.62% (0.2995 => 0.3283, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 9.59% (0.3149 => 0.3451, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.54% (0.4791 => 0.5248, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 9.53% (0.3107 => 0.3403, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 9.49% (16.6129 => 18.1892, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.48% (0.1276 => 0.1397, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 9.45% (0.3534 => 0.3868, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 9.44% (0.1589 => 0.1739, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 9.43% (0.3192 => 0.3493, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 9.40% (0.2988 => 0.3269, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.40% (0.2914 => 0.3188, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.38% (0.4390 => 0.4802, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.31% (0.2127 => 0.2325, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.27% (0.1435 => 0.1568, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 9.26% (1.1061 => 1.2085, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.15% (0.5637 => 0.6153, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.15% (0.3246 => 0.3543, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.13% (0.7460 => 0.8141, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 9.09% (0.1111 => 0.1212, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 8.92% (3.8646 => 4.2094, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/18-imp/imp: 8.91% (0.3220 => 0.3507, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 8.91% (0.7506 => 0.8175, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 8.90% (0.6744 => 0.7344, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 8.86% (0.8310 => 0.9046, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.83% (0.8698 => 0.9466, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.72% (7.2180 => 7.8477, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.63% (0.1865 => 0.2026, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 8.62% (0.2945 => 0.3199, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 8.60% (2.1791 => 2.3666, std.dev.: 0.0055) MultiSource/Applications/d/make_dparser: 8.59% (3.1889 => 3.4628, std.dev.: 0.0026) MultiSource/Applications/treecc/treecc: 8.56% (1.9270 => 2.0919, std.dev.: 0.0115) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.55% (0.2023 => 0.2196, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.55% (0.3755 => 0.4076, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 8.48% (0.2925 => 0.3173, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 8.39% (0.1478 => 0.1602, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.26% (0.6576 => 0.7119, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 8.23% (1.0594 => 1.1466, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: 8.17% (0.4003 => 0.4330, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.11% (0.1789 => 0.1934, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.11% (0.3578 => 0.3868, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.09% (0.1569 => 0.1696, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 8.07% (0.3914 => 0.4230, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.06% (0.3646 => 0.3940, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 8.03% (0.1657 => 0.1790, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 7.95% (4.6629 => 5.0338, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.95% (3.6692 => 3.9609, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 7.89% (0.3789 => 0.4088, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 7.89% (0.3131 => 0.3378, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.86% (0.3650 => 0.3937, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.86% (0.3601 => 0.3884, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.84% (0.3940 => 0.4249, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 7.83% (1.2749 => 1.3747, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.81% (4.4433 => 4.7904, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 7.81% (0.3663 => 0.3949, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.80% (0.2140 => 0.2307, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.80% (1.3245 => 1.4278, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.80% (4.3801 => 4.7217, std.dev.: 0.0037) MultiSource/Applications/JM/lencod/lencod: 7.79% (14.8535 => 16.0109, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.79% (0.8818 => 0.9505, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.76% (0.3623 => 0.3904, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.71% (0.6135 => 0.6608, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 7.61% (8.4961 => 9.1423, std.dev.: 0.0081) MultiSource/Benchmarks/McCat/05-eks/eks: 7.49% (0.4113 => 0.4421, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.20% (0.1819 => 0.1950, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.03% (4.9865 => 5.3369, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.01% (0.3511 => 0.3757, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 6.94% (0.6250 => 0.6684, std.dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: 6.94% (1.2292 => 1.3145, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.90% (1.5188 => 1.6236, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.87% (0.2504 => 0.2676, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.79% (1.1333 => 1.2102, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.74% (0.4805 => 0.5129, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.69% (0.9108 => 0.9717, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.62% (3.2742 => 3.4909, std.dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 6.38% (6.5754 => 6.9947, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.33% (0.2321 => 0.2468, std.dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.29% (6.2785 => 6.6734, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/oourafft: 6.27% (0.2008 => 0.2134, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.26% (0.3245 => 0.3448, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 6.21% (3.7467 => 3.9794, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.91% (2.1007 => 2.2248, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.33% (13.2842 => 13.9923, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.55% (0.2243 => 0.2345, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 3.63% (16.2614 => 16.8520, std.dev.: 0.0262) MultiSource/Applications/ClamAV/clamscan: 3.47% (14.5298 => 15.0337, std.dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: 1.05% (33.2944 => 33.6437, std.dev.: 0.0169) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.62% (5.7573 => 7.5200, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: 29.99% (1.8175 => 2.3625, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 11.15% (1.1560 => 1.2849, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 8.99% (0.8273 => 0.9017, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4144, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.26% (1.2998 => 1.3812, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0043, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7758, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.67% (11.2619 => 11.6752, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-6: 3.48% (1.9199 => 1.9868, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 3.42% (10.7476 => 11.1151, std.dev.: 0.0050) SingleSource/Regression/C/uint64_to_float: 2.97% (0.5449 => 0.5611, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.12% (7.4271 => 7.5849, std.dev.: 0.0036) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4533, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5139, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9698, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1881, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.16% (5.5130 => 5.5771, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 1.10% (12.4560 => 12.5924, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0276, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.08% (0.2670 => 0.1413, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -15.70% (0.0707 => 0.0596, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.31% (0.4657 => 0.3944, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.78% (1.3819 => 1.1915, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.73% (1.3813 => 1.1916, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.50% (22.5627 => 21.7727, std.dev.: 0.0185) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.64% (0.0997 => 0.0861, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.15% (0.2238 => 0.1966, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.85% (1.2308 => 1.0972, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.09% (20.3410 => 18.2885, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0050) SingleSource/UnitTests/Vector/multiplies: -5.20% (2.6470 => 2.5094, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.60% (0.9996 => 0.9536, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8006, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.59% (1.7688 => 1.7053, std.dev.: 0.0008) MultiSource/Applications/siod/siod: -3.56% (3.2729 => 3.1563, std.dev.: 0.0075) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.02% (0.4867 => 0.4720, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -2.63% (26.5159 => 25.8191, std.dev.: 0.0269) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4785, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.41% (3.0263 => 2.9535, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.32% (1.9762 => 1.9303, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.12% (0.6589 => 0.6449, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7141, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.80% (6.3560 => 6.2417, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.59% (0.6615 => 0.6510, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0064, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8673, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: -1.27% (4.5928 => 4.5343, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4954, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2573, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: -1.12% (9.3358 => 9.2316, std.dev.: 0.0108) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 7 20:05:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 22:05:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121008030555.364322A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4697?compare_to=4693&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4697, Order: 165383, Start Time: 2012-10-08 01:48:14, End Time: 2012-10-08 03:07:40 To: 4693, Order: 165382, Start Time: 2012-10-07 23:44:15, End Time: 2012-10-08 01:03:23 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 3 (154 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1022 (762 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 10.87% (0.3901 => 0.4325, std.dev.: 0.0087) MultiSource/Benchmarks/PAQ8p/paq8p: 2.37% (15.2720 => 15.6341, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.27% (54.4824 => 56.2636, std.dev.: 0.1147) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.07% (0.5872 => 0.5876, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 0.30% (16.1691 => 16.2171, std.dev.: 0.0096) MultiSource/Benchmarks/Bullet/bullet: 0.06% (54.7397 => 54.7750, std.dev.: 0.0242) MultiSource/Benchmarks/MallocBench/gs/gs: -0.12% (4.3830 => 4.3776, std.dev.: 0.0183) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.01% (1.2445 => 1.2446, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.32% (7.7520 => 7.7269, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.31% (0.7391 => 0.7368, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -1.10% (0.0364 => 0.0360, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1432 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.50% (0.2140 => 0.2172, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -13.39% (63.2438 => 54.7750, std.dev.: 0.0242) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.28% (14.1553 => 18.7244, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: 60.61% (3.4629 => 5.5617, std.dev.: 0.0131) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14221.53% (0.0720 => 10.3115, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952300.00% (0.0001 => 9.9524, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 51.29% (0.2554 => 0.3864, std.dev.: 0.0068) MultiSource/Benchmarks/PAQ8p/paq8p: 50.80% (10.3673 => 15.6341, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/richards_benchmark: 31.01% (0.1622 => 0.2125, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 30.68% (0.1056 => 0.1380, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 15.64% (0.1432 => 0.1656, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.24% (2.2022 => 2.5379, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.13% (7.0540 => 8.1213, std.dev.: 0.0080) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.05% (0.1566 => 0.1786, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.07% (0.0834 => 0.0943, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.19% (1.7609 => 1.9756, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.94% (0.0871 => 0.0975, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 11.73% (0.3282 => 0.3667, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 11.40% (0.3473 => 0.3869, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.32% (0.3543 => 0.3944, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.29% (0.3516 => 0.3913, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.21% (0.3543 => 0.3940, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 11.20% (0.3561 => 0.3960, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.18% (0.3497 => 0.3888, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 10.88% (0.3694 => 0.4096, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.87% (0.3927 => 0.4354, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.76% (0.3828 => 0.4240, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.67% (0.1584 => 0.1753, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 10.60% (0.3886 => 0.4298, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 9.86% (0.1440 => 0.1582, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.61% (0.3121 => 0.3421, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.16% (0.3177 => 0.3468, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.11% (0.1438 => 0.1569, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.04% (0.4879 => 0.5320, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 8.99% (9.4845 => 10.3375, std.dev.: 0.0081) SingleSource/UnitTests/ObjC++/Hello: 8.96% (0.5925 => 0.6456, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.96% (0.6030 => 0.6570, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 8.95% (0.7115 => 0.7752, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 8.91% (0.7433 => 0.8095, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.88% (0.6675 => 0.7268, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.84% (1.5415 => 1.6778, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 8.80% (5.7591 => 6.2657, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/chomp: 8.76% (0.1655 => 0.1800, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.48% (0.5569 => 0.6041, std.dev.: 0.0028) MultiSource/Applications/sgefa/sgefa: 8.39% (0.3109 => 0.3370, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.36% (0.4615 => 0.5001, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/18-imp/imp: 8.36% (0.3423 => 0.3709, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.32% (0.8067 => 0.8738, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 8.32% (10.4361 => 11.3040, std.dev.: 0.0027) MultiSource/Applications/d/make_dparser: 8.20% (3.3354 => 3.6090, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/em3d/em3d: 8.20% (0.1695 => 0.1834, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.19% (0.2758 => 0.2984, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.19% (4.2646 => 4.6137, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.12% (0.1625 => 0.1757, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.07% (0.5105 => 0.5517, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.07% (0.7326 => 0.7917, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.05% (0.8172 => 0.8830, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.99% (1.3050 => 1.4093, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.90% (0.5860 => 0.6323, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.88% (0.2271 => 0.2450, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.88% (0.1510 => 0.1629, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.80% (0.2065 => 0.2226, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.78% (0.2107 => 0.2271, std.dev.: 0.0017) MultiSource/Applications/spiff/spiff: 7.72% (0.7835 => 0.8440, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.66% (5.0018 => 5.3850, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.60% (4.9449 => 5.3206, std.dev.: 0.0083) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.59% (0.2700 => 0.2905, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.56% (8.1363 => 8.7510, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.50% (0.3307 => 0.3555, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.50% (0.9765 => 1.0497, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 7.42% (0.6456 => 0.6935, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.31% (0.5020 => 0.5387, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 7.28% (0.3422 => 0.3671, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.28% (1.1642 => 1.2489, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.27% (0.1940 => 0.2081, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 7.25% (0.4289 => 0.4600, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 7.24% (3.8723 => 4.1527, std.dev.: 0.0076) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.20% (0.4636 => 0.4970, std.dev.: 0.0015) MultiSource/Benchmarks/sim/sim: 7.20% (0.3387 => 0.3631, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.14% (0.4103 => 0.4396, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 7.07% (0.1555 => 0.1665, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.03% (7.9617 => 8.5211, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.01% (0.3865 => 0.4136, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.00% (0.4203 => 0.4497, std.dev.: 0.0054) MultiSource/Applications/hbd/hbd: 6.99% (1.5603 => 1.6693, std.dev.: 0.0023) SingleSource/Regression/C++/ofstream_ctor: 6.88% (0.2905 => 0.3105, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.81% (0.3232 => 0.3452, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 6.80% (1.0722 => 1.1451, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 6.76% (2.0273 => 2.1643, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.74% (0.3650 => 0.3896, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.68% (0.2831 => 0.3020, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.68% (0.2891 => 0.3084, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.64% (1.1861 => 1.2649, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.63% (0.3136 => 0.3344, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.62% (0.4048 => 0.4316, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.56% (0.4620 => 0.4923, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.55% (0.1892 => 0.2016, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.54% (0.3441 => 0.3666, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.53% (0.2603 => 0.2773, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 6.49% (0.3684 => 0.3923, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.47% (0.3603 => 0.3836, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.46% (0.3826 => 0.4073, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.42% (0.3162 => 0.3365, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.37% (2.0665 => 2.1982, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 6.34% (0.3283 => 0.3491, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 6.31% (0.8921 => 0.9484, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.28% (1.5859 => 1.6855, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.27% (0.2872 => 0.3052, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.24% (0.2725 => 0.2895, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.23% (0.3098 => 0.3291, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 6.23% (0.3180 => 0.3378, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.20% (0.2756 => 0.2927, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.12% (0.6450 => 0.6845, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 6.12% (0.4299 => 0.4562, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 6.10% (2.2969 => 2.4369, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wc: 6.09% (0.3052 => 0.3238, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.05% (0.2877 => 0.3051, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.00% (0.5981 => 0.6340, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/random: 5.96% (0.2802 => 0.2969, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.94% (0.2793 => 0.2959, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.90% (0.2714 => 0.2874, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 5.85% (21.9371 => 23.2215, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/ary2: 5.71% (0.3379 => 0.3572, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.44% (1.4186 => 1.4958, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.36% (2.2024 => 2.3205, std.dev.: 0.0078) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.35% (0.1906 => 0.2008, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 5.24% (1.1840 => 1.2460, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.19% (0.4064 => 0.4275, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.81% (0.2266 => 0.2375, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.54% (0.3131 => 0.3273, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.52% (1.2842 => 1.3423, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.47% (0.8101 => 0.8463, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.75% (0.3817 => 0.3960, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.54% (14.3668 => 14.8753, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.44% (0.3427 => 0.3545, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 3.20% (17.1811 => 17.7317, std.dev.: 0.0171) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.64% (3.8922 => 3.9951, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.47% (1.1194 => 1.1471, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.79% (1.1396 => 1.2512, std.dev.: 0.0020) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4499, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3689, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626) SingleSource/Regression/C/uint64_to_float: 3.71% (0.5413 => 0.5614) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.60% (3.6395 => 3.7704, std.dev.: 0.0016) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.64% (4.2280 => 4.3397, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.33% (1.7254 => 1.7656, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.55% (0.8275 => 0.8403, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8128, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.15% (2.6546 => 2.6851, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5764, std.dev.: 0.0051) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.03% (6.6874 => 0.1316, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: -80.25% (0.8651 => 0.1709, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.99% (5.2763 => 3.2720, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.78% (5.3855 => 3.6199, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.18% (5.3526 => 3.6302, std.dev.: 0.0025) SingleSource/UnitTests/Vector/constpool: -14.46% (54.1659 => 46.3357, std.dev.: 0.0194) MultiSource/Benchmarks/FreeBench/mason/mason: -13.32% (0.0811 => 0.0703, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -11.22% (22.1758 => 19.6871, std.dev.: 0.0101) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.49% (2.9384 => 2.6302, std.dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7653, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: -15.93% (1.6925 => 1.4229, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.83% (0.0998 => 0.0860, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -12.39% (1.2373 => 1.0840, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/mandel-2: -10.18% (1.5373 => 1.3808, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -10.09% (0.2161 => 0.1943, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.35% (19.9488 => 18.2835, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.67% (1.8329 => 1.7107, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5753, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.31% (1.6805 => 1.5913, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5082, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.21% (0.9957 => 0.9538, std.dev.: 0.0071) MultiSource/Applications/siod/siod: -3.74% (3.2827 => 3.1598, std.dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5018, std.dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0986, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.10% (8.6802 => 8.4977, std.dev.: 0.0054) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.10% (0.4808 => 0.4707, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.95% (8.1563 => 7.9973, std.dev.: 0.0182) SingleSource/Benchmarks/Misc/salsa20: -1.81% (10.2830 => 10.0971, std.dev.: 0.0140) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6808, std.dev.: 0.0018) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5093, std.dev.: 0.0025) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4204, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -1.20% (6.2999 => 6.2243, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8573, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.37% (0.5229 => 0.5876, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 8.19% (14.9895 => 16.2171, std.dev.: 0.0096) MultiSource/Benchmarks/MallocBench/gs/gs: 6.50% (4.1105 => 4.3776, std.dev.: 0.0183) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.65% (1.1048 => 1.2446, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.94% (7.1582 => 7.7269, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.42% (0.6222 => 0.7368, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35900.00% (0.0001 => 0.0360, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.65% (0.2116 => 0.2172, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 7 21:35:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 23:35:24 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121008043524.8E0C52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4698?compare_to=4695&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4698, Order: 165384, Start Time: 2012-10-08 03:14:32, End Time: 2012-10-08 04:37:11 To: 4695, Order: 165383, Start Time: 2012-10-08 01:35:11, End Time: 2012-10-08 02:58:48 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (14 on baseline) Performance Regressions: 3 (101 on baseline) Performance Improvements: 7 (49 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 967 (741 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.27% (0.8241 => 0.8346, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.72% (2.4482 => 2.5637, std.dev.: 0.0232) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.05% (1.3680 => 1.3961, std.dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.34% (0.9037 => 0.8916, std.dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.01% (5.4002 => 5.0215, std.dev.: 0.0247) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.89% (5.0030 => 4.7585, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.20% (4.9992 => 4.8391, std.dev.: 0.0209) MultiSource/Applications/JM/lencod/lencod: -2.09% (6.7911 => 6.6493, std.dev.: 0.0143) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.46% (2.9297 => 2.8868, std.dev.: 0.0141) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.43% (1.6329 => 1.6096, std.dev.: 0.0059) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 0.31% (1.0232 => 1.0264, std.dev.: 0.0075) MultiSource/Applications/sqlite3/sqlite3: -0.48% (0.6248 => 0.6218, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 0.16% (0.1834 => 0.1837, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.62% (0.1603 => 0.1593, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.66% (0.3188 => 0.3167, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.82% (0.2442 => 0.2422, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.46% (0.3254 => 0.3239, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.14% (0.2262 => 0.2333, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/mandel: 10.84% (0.0415 => 0.0460, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.40% (0.0248 => 0.0249, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -31.66% (0.0199 => 0.0136, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.52% (0.0396 => 0.0390, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 14.83% (0.0263 => 0.0302, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.04% (0.0289 => 0.0286, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.91% (0.0330 => 0.0327, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/casts: -2.69% (0.0186 => 0.0181, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: -1.52% (0.0198 => 0.0195, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: - (0.0264 => 0.0264, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 1.81% (0.0331 => 0.0337, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -1.05% (0.1432 => 0.1417, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 0.53% (1.4914 => 1.4993, std.dev.: 0.0149) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.39% (0.1544 => 0.1538, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.12% (0.4294 => 0.4160, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.97% (0.1424 => 0.1396, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -33.33% (0.0006 => 0.0004, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.86% (0.0588 => 0.0646, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -23.91% (0.0230 => 0.0175, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 7.12% (0.0618 => 0.0662, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.02% (1.1279 => 1.1277, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 20.00% (0.0005 => 0.0006, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.86% (0.0583 => 0.0578, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 10.97% (0.0237 => 0.0263, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.08% (0.7644 => 0.7650, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: 400.00% (0.0001 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 0.08% (1.7055 => 1.7068, std.dev.: 0.0144) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0001 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 149.44% (0.0089 => 0.0222, std.dev.: 0.0006) SingleSource/UnitTests/2003-08-11-VaListArg: 184.44% (0.0090 => 0.0256, std.dev.: 0.0037) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -27.26% (4.1772 => 3.0383, std.dev.: 0.0350) SingleSource/Benchmarks/Shootout-C++/except: 82783.33% (0.0006 => 0.4973, std.dev.: 0.0034) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: 75.00% (0.0004 => 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0001, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.39% (0.0745 => 0.0882, std.dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: 10.40% (0.1414 => 0.1561, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 9.89% (2.1763 => 2.3916, std.dev.: 0.0180) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.89% (0.6410 => 0.7044, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.75% (0.1159 => 0.1272, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.21% (0.3582 => 0.3912, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/bigfib: 9.12% (0.5309 => 0.5793, std.dev.: 0.0034) MultiSource/Applications/minisat/minisat: 8.29% (0.6173 => 0.6685, std.dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 7.34% (1.1653 => 1.2508, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 7.09% (1.0046 => 1.0758, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 6.48% (15.3105 => 16.3023, std.dev.: 0.0555) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.27% (1.5150 => 1.6100, std.dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.11% (0.2552 => 0.2708, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.08% (0.2797 => 0.2967, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 6.03% (0.6915 => 0.7332, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.99% (0.2886 => 0.3059, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.95% (0.6069 => 0.6430, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.83% (0.8569 => 0.9069, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.68% (0.7639 => 0.8073, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.48% (0.4248 => 0.4481, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.35% (0.7722 => 0.8135, std.dev.: 0.0077) MultiSource/Applications/hbd/hbd: 5.28% (1.3268 => 1.3969, std.dev.: 0.0023) MultiSource/Applications/d/make_dparser: 5.27% (3.0225 => 3.1817, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.27% (0.4880 => 0.5137, std.dev.: 0.0032) MultiSource/Applications/Burg/burg: 5.15% (1.1440 => 1.2029, std.dev.: 0.0094) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.11% (1.1672 => 1.2269, std.dev.: 0.0107) MultiSource/Benchmarks/Bullet/bullet: 5.04% (29.3170 => 30.7956, std.dev.: 0.0685) MultiSource/Applications/sgefa/sgefa: 5.01% (0.2877 => 0.3021, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 5.00% (0.3217 => 0.3378, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.79% (0.3901 => 0.4088, std.dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 4.71% (4.7455 => 4.9689, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.67% (0.3062 => 0.3205, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.65% (1.1827 => 1.2377, std.dev.: 0.0062) MultiSource/Applications/SPASS/SPASS: 4.62% (13.3238 => 13.9400, std.dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.41% (1.4408 => 1.5043, std.dev.: 0.0177) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.33% (0.2654 => 0.2769, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.28% (1.2021 => 1.2536, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.27% (3.0758 => 3.2072, std.dev.: 0.0219) MultiSource/Benchmarks/nbench/nbench: 4.20% (1.0821 => 1.1276, std.dev.: 0.0093) MultiSource/Benchmarks/mafft/pairlocalalign: 4.17% (8.2186 => 8.5613, std.dev.: 0.0334) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.16% (6.2546 => 6.5151, std.dev.: 0.0632) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.07% (0.3418 => 0.3557, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 3.95% (2.0972 => 2.1800, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/lists1: 3.83% (0.2771 => 0.2877, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.82% (2.0317 => 2.1093, std.dev.: 0.0094) MultiSource/Applications/treecc/treecc: 3.80% (1.8798 => 1.9513, std.dev.: 0.0099) MultiSource/Applications/lua/lua: 3.78% (3.5980 => 3.7341, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/hash2: 3.67% (0.3847 => 0.3988, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/football/football: 3.65% (0.8405 => 0.8712, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.61% (0.7226 => 0.7487, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash: 3.55% (0.3520 => 0.3645, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 3.50% (14.7256 => 15.2412, std.dev.: 0.0429) MultiSource/Benchmarks/sim/sim: 3.37% (0.3084 => 0.3188, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 3.28% (6.4908 => 6.7035, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.23% (0.5636 => 0.5818, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.18% (4.2616 => 4.3970, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.11% (12.6413 => 13.0344, std.dev.: 0.1275) SingleSource/Benchmarks/Shootout-C++/moments: 3.02% (0.3412 => 0.3515, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.00% (1.0689 => 1.1010, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.93% (4.3380 => 4.4653, std.dev.: 0.0207) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.65% (4.0318 => 4.1388, std.dev.: 0.0217) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.65% (0.5963 => 0.6121, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.62% (4.2815 => 4.3935, std.dev.: 0.0298) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.58% (0.5937 => 0.6090, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.53% (1.2742 => 1.3065, std.dev.: 0.0093) MultiSource/Benchmarks/MallocBench/gs/gs: 2.45% (3.8796 => 3.9746, std.dev.: 0.0242) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.26% (0.4562 => 0.4665, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.23% (0.5520 => 0.5643, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.14% (8.2559 => 8.4328, std.dev.: 0.0461) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.13% (1.3935 => 1.4232, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.92% (0.9029 => 0.9202, std.dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: 1.50% (0.9425 => 0.9566, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 47.13% (0.0261 => 0.0384, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/pi: 41.35% (1.6538 => 2.3377, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 22.11% (3.4629 => 4.2284, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout/ary3: 14.63% (1.7426 => 1.9976, std.dev.: 0.0160) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.56% (4.0101 => 4.5537, std.dev.: 0.0403) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.32% (0.0766 => 0.0868, std.dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.21% (2.4042 => 2.7218, std.dev.: 0.0228) SingleSource/Benchmarks/McGill/queens: 11.06% (1.6261 => 1.8060, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/Puzzle: 10.54% (0.1433 => 0.1584, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/mason/mason: 10.29% (0.5004 => 0.5519, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 9.36% (1.0063 => 1.1005, std.dev.: 0.0114) MultiSource/Benchmarks/nbench/nbench: 8.96% (21.1721 => 23.0696, std.dev.: 0.6985) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.65% (0.2857 => 0.3104, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: 8.44% (7.0025 => 7.5934, std.dev.: 0.0419) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.37% (40.4792 => 42.6518, std.dev.: 0.3127) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.36% (0.3301 => 0.3478, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/dt: 4.33% (0.9851 => 1.0278, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: 4.20% (15.2242 => 15.8629, std.dev.: 0.0178) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.88% (3.4080 => 3.5404, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 3.53% (3.5520 => 3.6773, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.35% (0.5587 => 0.5774, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 2.96% (6.9722 => 7.1783, std.dev.: 0.0695) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.80% (6.6312 => 6.8166, std.dev.: 0.0327) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.31% (2.6656 => 2.7271, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.20% (4.6127 => 4.7140, std.dev.: 0.0208) SingleSource/Benchmarks/Shootout-C++/hash: 2.14% (0.6308 => 0.6443, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/power/power: 1.36% (1.4184 => 1.4377, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/ffbench: 1.35% (1.4117 => 1.4307, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.05% (2.4455 => 2.4711, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -43.65% (0.0591 => 0.0333, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -42.96% (0.2996 => 0.1709, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.35% (1.4189 => 1.1585, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.11% (1.4113 => 1.1557, std.dev.: 0.0063) SingleSource/UnitTests/Vector/constpool: -3.67% (8.9977 => 8.6676, std.dev.: 0.1004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.21% (0.3497 => 0.2126, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/lpbench: -22.27% (5.2665 => 4.0938, std.dev.: 0.0498) SingleSource/Benchmarks/Shootout-C++/ary3: -20.44% (1.7473 => 1.3901, std.dev.: 0.0136) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.39% (15.8312 => 13.3942, std.dev.: 0.5697) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -14.46% (1.7361 => 1.4850, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/sieve: -12.26% (8.1594 => 7.1590, std.dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.50% (1.1647 => 1.0541, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: -9.16% (0.1114 => 0.1012, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: -8.35% (9.5474 => 8.7500, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.22% (1.4034 => 1.2881, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.77% (3.2007 => 2.9519, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.90% (3.6254 => 3.3752, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/fibo: -6.73% (4.6355 => 4.3236, std.dev.: 0.0064) MultiSource/Applications/lambda-0_1_3/lambda: -6.60% (7.6833 => 7.1759, std.dev.: 0.0359) SingleSource/Benchmarks/Misc/richards_benchmark: -6.13% (1.4441 => 1.3556, std.dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.07% (2.9728 => 2.7924, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout/fib2: -5.29% (4.4195 => 4.1855, std.dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.19% (3.9413 => 3.7369, std.dev.: 0.0102) MultiSource/Benchmarks/Olden/bh/bh: -4.96% (2.5166 => 2.3918, std.dev.: 0.0048) MultiSource/Applications/sgefa/sgefa: -4.89% (0.3746 => 0.3563, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.73% (0.4564 => 0.4348, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: -4.22% (62.4126 => 59.7764, std.dev.: 0.1242) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.77% (0.4140 => 0.3984, std.dev.: 0.0036) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.33% (1.2722 => 1.2298, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/methcall: -3.08% (9.2503 => 8.9651, std.dev.: 0.0330) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.79% (1.2959 => 1.2597, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.75% (3.7496 => 3.6464, std.dev.: 0.0187) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.66% (1.1683 => 1.1372, std.dev.: 0.0034) SingleSource/Benchmarks/McGill/misr: -2.51% (0.4296 => 0.4188, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/dry: -2.20% (2.4013 => 2.3485, std.dev.: 0.0071) MultiSource/Benchmarks/PAQ8p/paq8p: -1.99% (92.7467 => 90.9015, std.dev.: 0.6520) MultiSource/Applications/SIBsim4/SIBsim4: -1.91% (3.4230 => 3.3577, std.dev.: 0.0249) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.88% (2.3569 => 2.3127, std.dev.: 0.0003) MultiSource/Applications/aha/aha: -1.86% (3.4286 => 3.3648, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/hash2: -1.84% (3.4876 => 3.4233, std.dev.: 0.0036) MultiSource/Benchmarks/sim/sim: -1.72% (3.8907 => 3.8236, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.63% (9.3855 => 9.2325, std.dev.: 0.0172) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.62% (1.0686 => 1.0513, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -1.56% (1.0926 => 1.0756, std.dev.: 0.0006) MultiSource/Benchmarks/llubenchmark/llu: -1.45% (2.0192 => 1.9900, std.dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: -1.43% (6.7458 => 6.6493, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/lists: -1.42% (16.5617 => 16.3266, std.dev.: 0.0534) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.38% (25.6658 => 25.3121, std.dev.: 0.0366) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.36% (27.1724 => 26.8021, std.dev.: 0.0317) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.85% (0.9980 => 1.0264, std.dev.: 0.0075) MultiSource/Applications/sqlite3/sqlite3: 3.25% (0.6022 => 0.6218, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 10.26% (0.1666 => 0.1837, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.51% (0.1554 => 0.1593, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.72% (0.3083 => 0.3167, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.17% (0.2394 => 0.2422, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.02% (0.3175 => 0.3239, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.35% (0.2302 => 0.2333, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/mandel: 2.45% (0.0449 => 0.0460, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 3.75% (0.0240 => 0.0249, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -29.17% (0.0192 => 0.0136, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0390 => 0.0390, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.33% (0.0301 => 0.0302, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.70% (0.0284 => 0.0286, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.93% (0.0324 => 0.0327, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/casts: 2.26% (0.0177 => 0.0181, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 3.17% (0.0189 => 0.0195, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: 6.02% (0.0249 => 0.0264, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 3.69% (0.0325 => 0.0337, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.84% (0.1429 => 0.1417, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: -0.17% (1.5019 => 1.4993, std.dev.: 0.0149) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 2.47% (0.1501 => 0.1538, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.44% (0.4264 => 0.4160, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.87% (0.1344 => 0.1396, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -33.33% (0.0006 => 0.0004, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.68% (0.0589 => 0.0646, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -24.57% (0.0232 => 0.0175, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.60% (0.0639 => 0.0662, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.64% (1.1350 => 1.1277, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0006 => 0.0006, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0024 => 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.26% (0.0637 => 0.0578, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.91% (0.0246 => 0.0263, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.45% (0.7541 => 0.7650, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0005 => 0.0005) SingleSource/Regression/C/uint64_to_float: 11.10% (1.5363 => 1.7068, std.dev.: 0.0144) SingleSource/UnitTests/2003-07-09-SignedArgs: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: - (0.0001 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 7 21:44:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 23:44:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121008044446.634752A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4699?compare_to=4696&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4699, Order: 165384, Start Time: 2012-10-08 03:31:55, End Time: 2012-10-08 04:46:31 To: 4696, Order: 165383, Start Time: 2012-10-08 01:48:23, End Time: 2012-10-08 03:03:00 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (182 on baseline) Performance Improvements: 2 (40 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1039 (754 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.08% (79.9143 => 80.7799, std.dev.: 0.3137) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -4.56% (2.3625 => 2.2547, std.dev.: 0.0393) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.52% (1.3123 => 1.2924, std.dev.: 0.0040) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 22.29% (2.0176 => 2.4674, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.66% (0.1410 => 0.1659, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 15.62% (0.0826 => 0.0955, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 14.85% (0.2243 => 0.2576, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.83% (0.0834 => 0.0941, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 12.44% (0.1013 => 0.1139, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 12.34% (0.5818 => 0.6536, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 12.16% (0.5748 => 0.6447, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.10% (0.1413 => 0.1584, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 12.04% (0.4328 => 0.4849, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.03% (0.1072 => 0.1201, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 11.88% (0.7061 => 0.7900, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 11.78% (1.3693 => 1.5306, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.51% (3.9660 => 4.4224, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.41% (0.0964 => 0.1074, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 11.40% (0.4062 => 0.4525, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.39% (0.2721 => 0.3031, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 11.33% (0.2781 => 0.3096, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.30% (0.1327 => 0.1477, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 11.25% (0.7038 => 0.7830, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.25% (0.2782 => 0.3095, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.25% (0.2596 => 0.2888, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.15% (0.1588 => 0.1765, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.03% (0.3899 => 0.4329, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.99% (1.4563 => 1.6164, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.98% (0.9199 => 1.0209, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.96% (0.3485 => 0.3867, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.94% (1.2193 => 1.3527, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.88% (0.5265 => 0.5838, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.85% (0.2655 => 0.2943, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.84% (0.7710 => 0.8546, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.82% (0.3022 => 0.3349, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/random: 10.82% (0.2690 => 0.2981, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hello: 10.74% (0.2607 => 0.2887, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 10.73% (0.2628 => 0.2910, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 10.69% (0.2937 => 0.3251, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.68% (0.6959 => 0.7702, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.65% (0.6283 => 0.6952, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 10.64% (0.1062 => 0.1175, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 10.47% (0.2760 => 0.3049, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.46% (0.3756 => 0.4149, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 10.45% (13.8202 => 15.2651, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/strcat: 10.42% (0.2726 => 0.3010, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 10.42% (0.3293 => 0.3636, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.41% (0.4016 => 0.4434, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.38% (1.9828 => 2.1886, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/methcall: 10.36% (0.2761 => 0.3047, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.31% (0.2696 => 0.2974, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.29% (0.3489 => 0.3848, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 10.29% (0.3149 => 0.3473, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.27% (0.2765 => 0.3049, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 10.24% (0.2988 => 0.3294, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/moments: 10.24% (0.3868 => 0.4264, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 10.23% (0.3107 => 0.3425, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.22% (1.1364 => 1.2525, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.22% (0.2966 => 0.3269, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.17% (0.3580 => 0.3944, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.14% (0.1075 => 0.1184, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 10.11% (0.3453 => 0.3802, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 9.99% (0.3192 => 0.3511, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.87% (0.1986 => 0.2182, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.77% (0.1157 => 0.1270, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 9.71% (0.3534 => 0.3877, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.70% (0.4390 => 0.4816, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.64% (0.4379 => 0.4801, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.54% (0.5577 => 0.6109, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 9.49% (1.0313 => 1.1292, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.49% (0.3130 => 0.3427, std.dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: 9.45% (0.2995 => 0.3278, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.41% (0.4791 => 0.5242, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 9.33% (16.6129 => 18.1633, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.33% (0.1276 => 0.1395, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 9.31% (0.1589 => 0.1737, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.31% (0.2127 => 0.2325, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.23% (0.2914 => 0.3183, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 9.18% (0.1111 => 0.1213, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 9.16% (1.1061 => 1.2074, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 9.13% (0.2945 => 0.3214, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.12% (0.3246 => 0.3542, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.06% (0.1435 => 0.1565, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.05% (0.5637 => 0.6147, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.01% (0.8698 => 0.9482, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.01% (0.7460 => 0.8132, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 8.96% (3.8646 => 4.2110, std.dev.: 0.0021) MultiSource/Applications/minisat/minisat: 8.90% (0.6744 => 0.7344, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.89% (0.3755 => 0.4089, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 8.85% (0.3220 => 0.3505, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 8.79% (0.7506 => 0.8166, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.77% (7.2180 => 7.8510, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/football/football: 8.76% (0.8310 => 0.9038, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.60% (0.2023 => 0.2197, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.53% (0.1865 => 0.2024, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 8.45% (3.1889 => 3.4585, std.dev.: 0.0018) MultiSource/Applications/treecc/treecc: 8.42% (1.9270 => 2.0892, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.41% (0.6576 => 0.7129, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 8.39% (0.1478 => 0.1602, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 8.39% (2.1791 => 2.3619, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/trivial-interface: 8.30% (0.3578 => 0.3875, std.dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 8.29% (1.0594 => 1.1472, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.24% (0.4003 => 0.4333, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 8.20% (0.3914 => 0.4235, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 8.17% (0.2925 => 0.3164, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/em3d/em3d: 8.15% (0.1657 => 0.1792, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 8.11% (0.3663 => 0.3960, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.10% (0.3789 => 0.4096, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.06% (0.3623 => 0.3915, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.04% (0.3646 => 0.3939, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 8.02% (0.3940 => 0.4256, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.02% (0.8818 => 0.9525, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.00% (3.6692 => 3.9628, std.dev.: 0.0135) SingleSource/UnitTests/ObjC/exceptions-2: 8.00% (0.3601 => 0.3889, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.97% (0.3650 => 0.3941, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.97% (0.1569 => 0.1694, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 7.87% (14.8535 => 16.0219, std.dev.: 0.0073) MultiSource/Benchmarks/sim/sim: 7.86% (0.3131 => 0.3377, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 7.83% (4.6629 => 5.0282, std.dev.: 0.0154) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.83% (4.4433 => 4.7911, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.83% (0.1789 => 0.1929, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 7.82% (1.2749 => 1.3746, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.76% (0.2140 => 0.2306, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.75% (1.3245 => 1.4271, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.71% (4.3801 => 4.7176, std.dev.: 0.0088) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.60% (0.3511 => 0.3778, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 7.59% (8.4961 => 9.1412, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.56% (0.6135 => 0.6599, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 7.37% (0.4113 => 0.4416, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 7.33% (1.2292 => 1.3193, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 7.15% (0.6250 => 0.6697, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.02% (4.9865 => 5.3365, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.83% (0.2504 => 0.2675, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.82% (1.5188 => 1.6224, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.72% (1.1333 => 1.2095, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.70% (0.9108 => 0.9718, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.63% (3.2742 => 3.4912, std.dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.56% (0.4805 => 0.5120, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 6.43% (6.5754 => 6.9985, std.dev.: 0.0119) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.43% (0.1819 => 0.1936, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.38% (0.2321 => 0.2469, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.36% (6.2785 => 6.6779, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.19% (0.3245 => 0.3446, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 6.18% (0.2008 => 0.2132, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 6.14% (3.7467 => 3.9768, std.dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.75% (2.1007 => 2.2215, std.dev.: 0.0199) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.38% (13.2842 => 13.9983, std.dev.: 0.0138) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.55% (0.2243 => 0.2345, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 3.66% (16.2614 => 16.8558, std.dev.: 0.0131) MultiSource/Applications/ClamAV/clamscan: 3.53% (14.5298 => 15.0423, std.dev.: 0.0080) MultiSource/Benchmarks/Bullet/bullet: 1.13% (33.2944 => 33.6690, std.dev.: 0.0080) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5169, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 24.06% (1.8175 => 2.2547, std.dev.: 0.0393) SingleSource/Benchmarks/Misc/richards_benchmark: 11.05% (1.1560 => 1.2837, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.56% (3.1736 => 3.4136, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.33% (1.2998 => 1.3821, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0040, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6770, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.49% (10.7476 => 11.1227, std.dev.: 0.0388) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9853, std.dev.: 0.0010) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.14% (7.4271 => 7.5863, std.dev.: 0.0051) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4529, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5133, std.dev.: 0.0082) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2123, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9679, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1880, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.17% (5.5130 => 5.5777, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0272, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5874, std.dev.: 0.0051) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.12% (0.2670 => 0.1412) MultiSource/Benchmarks/FreeBench/mason/mason: -15.56% (0.0707 => 0.0597, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.18% (0.4657 => 0.3950, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.74% (1.3813 => 1.1915, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.68% (1.3819 => 1.1929, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.61% (22.5627 => 21.7473, std.dev.: 0.0183) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.64% (0.0997 => 0.0861, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.02% (0.2238 => 0.1969, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.90% (1.2308 => 1.0966, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.09% (20.3410 => 18.2878, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.21% (1.3780 => 1.2924, std.dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5149, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/perlin: -4.54% (6.2497 => 5.9657, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.50% (0.9996 => 0.9546, std.dev.: 0.0041) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8005, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.45% (1.7688 => 1.7077, std.dev.: 0.0060) MultiSource/Applications/siod/siod: -3.35% (3.2729 => 3.1633, std.dev.: 0.0211) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.56% (26.5159 => 25.8366, std.dev.: 0.0164) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4785, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.42% (3.0263 => 2.9532, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.30% (1.9762 => 1.9308, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.93% (0.6589 => 0.6462, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.78% (28.2225 => 27.7195, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -1.76% (6.3560 => 6.2440, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0074, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8645, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.29% (2.5254 => 2.4928, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: -1.27% (4.5928 => 4.5346, std.dev.: 0.0036) MultiSource/Applications/minisat/minisat: -1.22% (9.3358 => 9.2223, std.dev.: 0.0394) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2578, std.dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 7 21:54:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 7 Oct 2012 23:54:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121008045416.9B8C72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4700?compare_to=4697&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4700, Order: 165384, Start Time: 2012-10-08 03:36:52, End Time: 2012-10-08 04:56:02 To: 4697, Order: 165383, Start Time: 2012-10-08 01:48:14, End Time: 2012-10-08 03:07:40 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 3 (158 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1022 (759 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.87% (15.6341 => 15.9257, std.dev.: 0.0173) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.51% (1.2884 => 1.3078, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: 1.09% (1.0840 => 1.0958, std.dev.: 0.0015) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.26% (0.5876 => 0.5891, std.dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 0.20% (16.2171 => 16.2489, std.dev.: 0.0101) MultiSource/Benchmarks/Bullet/bullet: 0.07% (54.7750 => 54.8150, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/gs/gs: 0.48% (4.3776 => 4.3987, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.15% (1.2446 => 1.2465, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.24% (7.7269 => 7.7453, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.24% (0.7368 => 0.7386, std.dev.: 0.0040) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.28% (0.0360 => 0.0359, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.52% (0.2172 => 0.2139, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -13.33% (63.2438 => 54.8150, std.dev.: 0.0024) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.77% (14.1553 => 18.7937, std.dev.: 0.0171) SingleSource/Benchmarks/Misc-C++-EH/spirit: 61.37% (3.4629 => 5.5882, std.dev.: 0.0169) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14228.19% (0.0720 => 10.3163, std.dev.: 0.0143) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952100.00% (0.0001 => 9.9522, std.dev.: 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 53.61% (10.3673 => 15.9257, std.dev.: 0.0173) MultiSource/Benchmarks/McCat/08-main/main: 51.57% (0.2554 => 0.3871, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 30.87% (0.1056 => 0.1382, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 30.52% (0.1622 => 0.2117, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 15.43% (0.1432 => 0.1653, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.91% (7.0540 => 8.1057, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.90% (2.2022 => 2.5304, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.43% (0.1566 => 0.1792, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.29% (1.7609 => 1.9774, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.28% (0.0871 => 0.0978, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.40% (0.3473 => 0.3869, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.37% (0.3543 => 0.3946, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 11.30% (0.3497 => 0.3892, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.29% (0.3543 => 0.3943, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 11.29% (0.3561 => 0.3963, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.26% (0.3516 => 0.3912, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.21% (0.3694 => 0.4108, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.10% (0.3828 => 0.4253, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 10.97% (0.3282 => 0.3642, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.95% (0.3927 => 0.4357, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.86% (0.1584 => 0.1756, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.81% (0.3886 => 0.4306, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 10.21% (0.1440 => 0.1587) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.39% (0.4879 => 0.5337, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.32% (0.6675 => 0.7297, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 9.24% (0.1655 => 0.1808, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 9.22% (0.7433 => 0.8118, std.dev.: 0.0162) MultiSource/Applications/minisat/minisat: 9.19% (0.7115 => 0.7769, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.08% (0.5925 => 0.6463, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.92% (0.1143 => 0.1245, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 8.91% (9.4845 => 10.3298, std.dev.: 0.0112) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.91% (0.3177 => 0.3460, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.89% (1.5415 => 1.6786, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.80% (0.1625 => 0.1768, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 8.71% (0.6030 => 0.6555, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.69% (0.1438 => 0.1563, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 8.68% (0.1175 => 0.1277, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.65% (0.4615 => 0.5014, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 8.62% (0.3109 => 0.3377, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 8.57% (10.4361 => 11.3301, std.dev.: 0.0077) MultiSource/Benchmarks/McCat/18-imp/imp: 8.56% (0.3423 => 0.3716, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/em3d/em3d: 8.55% (0.1695 => 0.1840, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 8.55% (5.7591 => 6.2513, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.42% (0.5105 => 0.5535, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.41% (0.1236 => 0.1340, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 8.36% (3.3354 => 3.6143, std.dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.32% (1.3050 => 1.4136, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.28% (0.2271 => 0.2459, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.28% (0.1510 => 0.1635, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.24% (4.2646 => 4.6158, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 8.19% (0.7326 => 0.7926, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.11% (0.8172 => 0.8835, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.11% (0.5860 => 0.6335, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.04% (0.2065 => 0.2231, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.03% (0.5569 => 0.6016, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.00% (0.2700 => 0.2916, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.88% (0.2107 => 0.2273, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.86% (0.8067 => 0.8701, std.dev.: 0.0035) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.85% (0.3121 => 0.3366, std.dev.: 0.0032) MultiSource/Applications/spiff/spiff: 7.81% (0.7835 => 0.8447, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.79% (0.9765 => 1.0526, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.78% (0.1940 => 0.2091, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.76% (0.2758 => 0.2972, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.73% (8.1363 => 8.7650, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.67% (5.0018 => 5.3855, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/bigfib: 7.67% (0.6456 => 0.6951, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.66% (4.9449 => 5.3237, std.dev.: 0.0029) MultiSource/Applications/Burg/burg: 7.65% (1.1642 => 1.2533, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.65% (0.3307 => 0.3560, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 7.65% (0.3387 => 0.3646, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.63% (0.5020 => 0.5403, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.55% (0.1337 => 0.1438, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.53% (0.4289 => 0.4612, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 7.50% (3.8723 => 4.1626, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/lists: 7.48% (0.3422 => 0.3678, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.46% (0.4103 => 0.4409, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.25% (1.5603 => 1.6734, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.20% (0.4636 => 0.4970, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 7.19% (1.0722 => 1.1493, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.16% (0.4203 => 0.4504, std.dev.: 0.0048) MultiSource/Applications/viterbi/viterbi: 7.14% (0.1555 => 0.1666, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 7.14% (2.0273 => 2.1720, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.10% (7.9617 => 8.5268, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.01% (0.3865 => 0.4136, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.99% (0.3650 => 0.3905, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.92% (0.2603 => 0.2783, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/strcat: 6.89% (0.2831 => 0.3026, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.86% (0.3441 => 0.3677, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.85% (0.2905 => 0.3104, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.78% (1.5859 => 1.6934, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 6.77% (0.4048 => 0.4322, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.73% (0.4620 => 0.4931, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 6.73% (0.3180 => 0.3394, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.70% (0.3136 => 0.3346, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.68% (0.2891 => 0.3084, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.66% (0.3826 => 0.4081, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.65% (0.3232 => 0.3447, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.64% (1.1861 => 1.2649, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 6.64% (2.2969 => 2.4494, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/sieve: 6.61% (0.3603 => 0.3841, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.60% (2.0665 => 2.2028, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 6.58% (0.3283 => 0.3499, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 6.57% (0.3684 => 0.3926, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.49% (0.3052 => 0.3250, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.48% (0.3162 => 0.3367, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.40% (0.6450 => 0.6863, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/except: 6.37% (0.2871 => 0.3054, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.37% (0.2872 => 0.3055, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.33% (0.3098 => 0.3294, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.28% (0.2725 => 0.2896, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 6.27% (0.8921 => 0.9480, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.22% (0.5981 => 0.6353, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.20% (0.2756 => 0.2927, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.08% (0.2877 => 0.3052, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 6.07% (0.4299 => 0.4560, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.01% (2.2024 => 2.3348, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 6.01% (0.2714 => 0.2877, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.98% (0.2793 => 0.2960, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.96% (0.2802 => 0.2969, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.92% (0.3379 => 0.3579, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 5.91% (21.9371 => 23.2346, std.dev.: 0.0072) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.66% (0.1892 => 0.1999, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.55% (1.4186 => 1.4974, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.49% (0.4064 => 0.4287, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.46% (0.1906 => 0.2010, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 5.38% (1.1840 => 1.2477, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.12% (0.2266 => 0.2382, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.69% (0.8101 => 0.8481, std.dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 4.65% (1.2842 => 1.3439, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/objinst: 4.47% (0.3131 => 0.3271, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.87% (14.3668 => 14.9232, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.68% (0.3427 => 0.3553, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.64% (0.3817 => 0.3956) MultiSource/Applications/sqlite3/sqlite3: 3.47% (17.1811 => 17.7771, std.dev.: 0.0198) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.89% (3.8922 => 4.0048, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.49% (1.1194 => 1.1473, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2172, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.98% (1.1396 => 1.2533, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4500, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.1578 => 3.3687, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.32% (3.6395 => 3.7604, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.84% (4.2280 => 4.3480, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.35% (1.7254 => 1.7660, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.55% (0.8275 => 0.8403, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.46% (0.9540 => 0.9679, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8126, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.18% (2.6546 => 2.6859, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.07% (9.1159 => 9.2137, std.dev.: 0.0104) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.06% (6.6874 => 0.1297, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: -80.00% (0.8651 => 0.1730, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.16% (5.2763 => 3.2631, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.77% (5.3855 => 3.6208, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.28% (5.3526 => 3.6250, std.dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -14.43% (54.1659 => 46.3472, std.dev.: 0.0187) MultiSource/Benchmarks/FreeBench/mason/mason: -13.07% (0.0811 => 0.0705, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -10.96% (22.1758 => 19.7450, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.69% (2.9384 => 2.6242, std.dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.28% (1.1492 => 0.7667, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4231, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.73% (0.0998 => 0.0861, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.44% (1.2373 => 1.0958, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -10.38% (1.5373 => 1.3777, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/mason/mason: -9.86% (0.2161 => 0.1948, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.38% (19.9488 => 18.2774, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.73% (1.8329 => 1.7096, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.30% (1.6805 => 1.5914, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.71% (1.5835 => 1.5089, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.67% (3.2827 => 3.1622, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.52% (0.9957 => 0.9607, std.dev.: 0.0056) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4980, std.dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0994, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.91% (8.6802 => 8.5143, std.dev.: 0.0102) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.90% (8.1563 => 8.0010, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/salsa20: -1.78% (10.2830 => 10.0998, std.dev.: 0.0168) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6820, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.65% (2.5528 => 2.5106, std.dev.: 0.0019) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4207, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/lists: -1.11% (6.2999 => 6.2298, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8591, std.dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.66% (0.5229 => 0.5891, std.dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 8.40% (14.9895 => 16.2489, std.dev.: 0.0101) MultiSource/Benchmarks/MallocBench/gs/gs: 7.01% (4.1105 => 4.3987, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.83% (1.1048 => 1.2465, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.20% (7.1582 => 7.7453, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.71% (0.6222 => 0.7386, std.dev.: 0.0040) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35800.00% (0.0001 => 0.0359, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.09% (0.2116 => 0.2139, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 7 23:01:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 8 Oct 2012 01:01:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121008060126.292682A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4701?compare_to=4694&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4701, Order: 165384, Start Time: 2012-10-08 03:19:28, End Time: 2012-10-08 06:03:13 To: 4694, Order: 165382, Start Time: 2012-10-08 00:06:35, End Time: 2012-10-08 02:50:27 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (136 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 1041 (827 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.22% (54.1461 => 54.8055, std.dev.: 0.0656) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.33% (0.3446 => 0.3871, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.33% (0.3488 => 0.3918, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 12.32% (0.3465 => 0.3892, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.27% (0.3496 => 0.3925, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.23% (0.3460 => 0.3883, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.22% (0.3469 => 0.3893, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.20% (0.3442 => 0.3862, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.92% (0.3650 => 0.4085, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.83% (0.3643 => 0.4074, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.65% (0.3724 => 0.4158, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.91% (0.1063 => 0.1179, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 10.19% (1.5932 => 1.7555, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 9.78% (0.5826 => 0.6396, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.61% (0.5889 => 0.6455, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 9.08% (0.1619 => 0.1766, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 8.87% (0.1218 => 0.1326, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.39% (0.7171 => 0.7773, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.08% (1.6211 => 1.7521, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.07% (0.2875 => 0.3107, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.01% (1.3152 => 1.4206, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.00% (0.4361 => 0.4710, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.98% (0.3195 => 0.3450, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.98% (0.5000 => 0.5399, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.89% (0.2738 => 0.2954, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 7.86% (0.3004 => 0.3240, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 7.77% (0.2714 => 0.2925, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.77% (0.4994 => 0.5382, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/fibo: 7.74% (0.2725 => 0.2936, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.72% (0.1620 => 0.1745, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 7.70% (0.9909 => 1.0672, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.69% (3.5627 => 3.8367, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.69% (2.7292 => 2.9390, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.66% (0.2792 => 0.3006, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/random: 7.60% (0.2803 => 0.3016, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.59% (0.2729 => 0.2936, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 7.58% (0.2823 => 0.3037, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 7.56% (5.5417 => 5.9608, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/methcall: 7.54% (0.2813 => 0.3025, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.52% (2.0673 => 2.2228, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 7.52% (0.2780 => 0.2989, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 7.51% (0.2811 => 0.3022, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.50% (0.2014 => 0.2165, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.49% (0.2911 => 0.3129, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 7.45% (0.2750 => 0.2955, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 7.40% (0.3096 => 0.3325, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.36% (0.2866 => 0.3077, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 7.34% (23.5202 => 25.2461, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/18-imp/imp: 7.32% (0.1421 => 0.1525, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 7.22% (0.4847 => 0.5197, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.19% (0.3060 => 0.3280, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.19% (0.4146 => 0.4444, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary: 7.18% (0.3258 => 0.3492, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 7.18% (0.3317 => 0.3555, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.16% (0.3267 => 0.3501, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.08% (0.5026 => 0.5382, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.07% (0.3124 => 0.3345, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 7.06% (1.0781 => 1.1542, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.05% (0.3362 => 0.3599, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 7.04% (0.3678 => 0.3937, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.01% (0.4139 => 0.4429, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.00% (0.3930 => 0.4205, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.98% (0.2736 => 0.2927, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.98% (0.3282 => 0.3511, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.97% (0.3845 => 0.4113, std.dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: 6.96% (4.2109 => 4.5039, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists1: 6.93% (0.3477 => 0.3718, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 6.90% (0.3348 => 0.3579, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sieve: 6.90% (0.3726 => 0.3983, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.90% (0.3625 => 0.3875, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.84% (0.1549 => 0.1655, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.78% (0.5900 => 0.6300, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 6.78% (0.1505 => 0.1607, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 6.75% (2.1013 => 2.2431, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.75% (4.4195 => 4.7176, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 6.74% (0.6634 => 0.7081, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.72% (0.3690 => 0.3938, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 6.70% (0.2566 => 0.2738, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.59% (0.4251 => 0.4531, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.56% (0.3890 => 0.4145, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.51% (0.3981 => 0.4240, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.40% (0.1968 => 0.2094, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.36% (0.6435 => 0.6844, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.35% (0.3903 => 0.4151, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 6.35% (0.4029 => 0.4285, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 6.33% (4.6177 => 4.9100, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/gs/gs: 6.29% (1.8794 => 1.9977, std.dev.: 0.0015) MultiSource/Applications/lua/lua: 6.28% (1.4269 => 1.5165, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.23% (0.2969 => 0.3154, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.19% (0.3084 => 0.3275, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.18% (0.2040 => 0.2166, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 6.08% (0.5546 => 0.5883, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 6.06% (2.1653 => 2.2965, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.00% (0.2068 => 0.2192, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.99% (0.2737 => 0.2901, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.97% (0.4658 => 0.4936, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 5.97% (0.5012 => 0.5311, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.87% (0.3271 => 0.3463, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 5.77% (0.9697 => 1.0257, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: 5.61% (0.3336 => 0.3523, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.55% (1.9694 => 2.0788, std.dev.: 0.0052) MultiSource/Applications/sqlite3/sqlite3: 5.51% (2.0346 => 2.1468, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.44% (1.9966 => 2.1053, std.dev.: 0.0062) MultiSource/Applications/treecc/treecc: 5.42% (0.7875 => 0.8302, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.42% (0.2103 => 0.2217, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 5.35% (0.2075 => 0.2186, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 5.13% (0.2691 => 0.2829, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.62% (0.5584 => 0.5842, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.46% (0.7426 => 0.7757, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.44% (0.5361 => 0.5599, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 3.89% (0.3498 => 0.3634, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.88% (0.4253 => 0.4418, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.77% (4.6926 => 4.8694, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.72% (11.6398 => 12.0724, std.dev.: 0.0098) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.98% (0.3792 => 0.3905, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 2.65% (11.9555 => 12.2722, std.dev.: 0.0077) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6095, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary: 5.94% (0.2122 => 0.2248, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (12.0509 => 12.6792, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/flops-2: 5.02% (1.8057 => 1.8964, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 4.66% (15.4430 => 16.1626, std.dev.: 0.0049) SingleSource/Benchmarks/Dhrystone/dry: 4.22% (14.0481 => 14.6403, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2067, std.dev.: 0.0024) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5069, std.dev.: 0.0050) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.73% (3.1722 => 3.2270, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2841, std.dev.: 0.0026) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5843, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.83% (25.4195 => 16.5647, std.dev.: 0.0182) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9757, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8016, std.dev.: 0.0089) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9573, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary2: -5.66% (0.2402 => 0.2266, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.59% (11.2080 => 10.8056, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std.dev.: 0.0049) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7724, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.53% (17.2379 => 16.8021, std.dev.: 0.0906) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8622, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5798, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4959, std.dev.: 0.0057) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.13% (105.3826 => 104.1946, std.dev.: 0.0430) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0419, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 8 07:53:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 8 Oct 2012 09:53:18 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121008145318.B30F92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4702?compare_to=4698&baseline=3242 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:5 Comparing: Run: 4702, Order: 165390, Start Time: 2012-10-08 13:31:57, End Time: 2012-10-08 14:55:05 To: 4698, Order: 165384, Start Time: 2012-10-08 03:14:32, End Time: 2012-10-08 04:37:11 Baseline: 3242, Order: 162678, Start Time: 2012-08-27 17:42:28, End Time: 2012-08-27 18:53:03 =============== Tests Summary =============== New Passes: 0 (14 on baseline) Performance Regressions: 8 (102 on baseline) Performance Improvements: 3 (48 on baseline) Added Tests: 0 (72 on baseline) Existing Failures: 65 (65 on baseline) Unchanged Tests: 966 (741 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.79% (0.6090 => 0.6199, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.24% (1.4232 => 1.4408, std.dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.89% (13.3942 => 14.5855, std.dev.: 0.4431) SingleSource/Benchmarks/CoyoteBench/lpbench: 2.02% (4.0938 => 4.1766, std.dev.: 0.0191) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 1.81% (0.5904 => 0.6011, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.34% (4.4853 => 4.5453, std.dev.: 0.0137) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.30% (1.6096 => 1.6306, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/whetstone: 1.20% (2.3470 => 2.3751, std.dev.: 0.0099) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.22% (0.9069 => 0.8958, std.dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.50% (1.1005 => 1.0730, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.02% (4.7140 => 4.6658, std.dev.: 0.0156) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: -0.21% (1.0264 => 1.0242, std.dev.: 0.0120) MultiSource/Applications/sqlite3/sqlite3: -0.27% (0.6218 => 0.6201, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/08-main/main: -1.74% (0.1837 => 0.1805, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.75% (0.1593 => 0.1581, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.13% (0.3167 => 0.3163, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.11% (0.2422 => 0.2449, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.20% (0.3239 => 0.3200, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.71% (0.2333 => 0.2293, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel: -0.65% (0.0460 => 0.0457, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -10.04% (0.0249 => 0.0224, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 42.65% (0.0136 => 0.0194, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.77% (0.0390 => 0.0393, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -15.89% (0.0302 => 0.0254, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.15% (0.0286 => 0.0277, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.61% (0.0327 => 0.0325, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0181 => 0.0181, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -1.03% (0.0195 => 0.0193, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -1.89% (0.0264 => 0.0259, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0337 => 0.0337, std.dev.: 0.0044) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.64% (0.1417 => 0.1426, std.dev.: 0.0036) MultiSource/Applications/lemon/lemon: 0.17% (1.4993 => 1.5019, std.dev.: 0.0307) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.56% (0.1538 => 0.1514, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.50% (0.4160 => 0.4056, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.79% (0.1396 => 0.1421, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 25.00% (0.0004 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0005 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -11.61% (0.0646 => 0.0571, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.71% (0.0175 => 0.0248, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.15% (0.0662 => 0.0663, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.15% (1.1277 => 1.1260, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 83.33% (0.0006 => 0.0011, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.98% (0.0578 => 0.0555, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -25.86% (0.0263 => 0.0195, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.01% (0.7650 => 0.7649, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: -0.04% (1.7068 => 1.7061, std.dev.: 0.0092) SingleSource/UnitTests/2003-07-09-SignedArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0005 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0121 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-05-07-VarArgs: 156.18% (0.0089 => 0.0228, std.dev.: 0.0015) SingleSource/UnitTests/2003-08-11-VaListArg: 176.67% (0.0090 => 0.0249, std.dev.: 0.0035) New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/Benchmarks/Misc/mandel-2: -27.26% (4.1772 => 3.0387, std.dev.: 0.0477) SingleSource/Benchmarks/Shootout-C++/except: 82050.00% (0.0006 => 0.4929, std.dev.: 0.0042) SingleSource/Regression/C++/EH/ctor_dtor_count: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/ctor_dtor_count-2: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/exception_spec_test: 20.00% (0.0005 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: - (0.0006 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C++/EH/inlined_cleanup: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_rethrow: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/simple_throw: - (0.0006 => 0.0006) SingleSource/Regression/C++/EH/throw_rethrow_test: -75.00% (0.0004 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-07-VarArgs: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0000 => 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 23.62% (0.0745 => 0.0921, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 10.78% (2.1763 => 2.4110, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.09% (0.1159 => 0.1276, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 9.87% (0.5309 => 0.5833, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.66% (0.3582 => 0.3928, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.63% (0.6410 => 0.7027, std.dev.: 0.0068) MultiSource/Applications/minisat/minisat: 8.52% (0.6173 => 0.6699, std.dev.: 0.0082) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.99% (0.1414 => 0.1527, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.60% (0.2552 => 0.2746, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 7.36% (1.1653 => 1.2511, std.dev.: 0.0062) MultiSource/Applications/lemon/lemon: 7.26% (1.0046 => 1.0775, std.dev.: 0.0227) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.51% (1.5150 => 1.6136, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.40% (0.2797 => 0.2976, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.17% (0.4248 => 0.4510, std.dev.: 0.0024) MultiSource/Applications/kimwitu++/kc: 6.16% (15.3105 => 16.2542, std.dev.: 0.0763) MultiSource/Applications/lambda-0_1_3/lambda: 5.96% (0.6915 => 0.7327, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.94% (0.7639 => 0.8093, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.78% (0.6069 => 0.6420, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 5.60% (0.3217 => 0.3397, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.53% (0.4880 => 0.5150, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.31% (3.0758 => 3.2391, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.09% (0.3062 => 0.3218, std.dev.: 0.0054) MultiSource/Applications/d/make_dparser: 5.06% (3.0225 => 3.1754, std.dev.: 0.0101) MultiSource/Benchmarks/Bullet/bullet: 4.99% (29.3170 => 30.7805, std.dev.: 0.1982) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.95% (1.1672 => 1.2250, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.92% (1.1827 => 1.2409, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.89% (0.2106 => 0.2209, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: 4.77% (0.2347 => 0.2459, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.64% (0.3901 => 0.4082, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/lists1: 4.55% (0.2771 => 0.2897, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.54% (0.8569 => 0.8958, std.dev.: 0.0026) MultiSource/Applications/oggenc/oggenc: 4.50% (4.7455 => 4.9591, std.dev.: 0.0401) MultiSource/Applications/SPASS/SPASS: 4.49% (13.3238 => 13.9217, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.41% (0.5937 => 0.6199, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.40% (0.2952 => 0.3082, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.38% (1.2021 => 1.2547, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.35% (1.4408 => 1.5035, std.dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: 4.34% (8.2186 => 8.5750, std.dev.: 0.1198) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.32% (0.3008 => 0.3138, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 4.26% (0.3520 => 0.3670, std.dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.25% (6.2546 => 6.5206, std.dev.: 0.0176) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.25% (2.0317 => 2.1181, std.dev.: 0.0115) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.22% (0.2654 => 0.2766, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.21% (0.2662 => 0.2774, std.dev.: 0.0033) MultiSource/Benchmarks/sim/sim: 4.18% (0.3084 => 0.3213, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.10% (0.7226 => 0.7522, std.dev.: 0.0066) MultiSource/Applications/siod/siod: 4.05% (2.0972 => 2.1822, std.dev.: 0.0050) MultiSource/Applications/lua/lua: 4.01% (3.5980 => 3.7423, std.dev.: 0.0212) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.96% (0.5636 => 0.5859, std.dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 3.96% (1.0821 => 1.1249, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 3.85% (0.3847 => 0.3995, std.dev.: 0.0043) MultiSource/Applications/hbd/hbd: 3.81% (1.3268 => 1.3774, std.dev.: 0.0132) MultiSource/Applications/JM/lencod/lencod: 3.58% (14.7256 => 15.2535, std.dev.: 0.1139) MultiSource/Applications/sgefa/sgefa: 3.58% (0.2877 => 0.2980, std.dev.: 0.0022) MultiSource/Applications/treecc/treecc: 3.48% (1.8798 => 1.9452, std.dev.: 0.0045) MultiSource/Applications/Burg/burg: 3.44% (1.1440 => 1.1834, std.dev.: 0.0128) MultiSource/Benchmarks/McCat/09-vor/vor: 3.40% (0.3026 => 0.3129, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.40% (12.6413 => 13.0708, std.dev.: 0.1029) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.39% (1.3935 => 1.4408, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.34% (4.2815 => 4.4245, std.dev.: 0.0193) MultiSource/Benchmarks/Prolangs-C/football/football: 3.30% (0.8405 => 0.8682, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/moments: 3.25% (0.3412 => 0.3523, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.25% (0.7784 => 0.8037, std.dev.: 0.0069) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.07% (4.2616 => 4.3923, std.dev.: 0.0175) MultiSource/Applications/JM/ldecod/ldecod: 2.99% (6.4908 => 6.6850, std.dev.: 0.0348) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.92% (0.5520 => 0.5681, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.84% (4.0318 => 4.1462, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.82% (0.9029 => 0.9284, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.72% (0.5963 => 0.6125, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 2.66% (3.8796 => 3.9828, std.dev.: 0.0328) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.62% (4.3380 => 4.4518, std.dev.: 0.0190) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.61% (1.0689 => 1.0968, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.44% (8.2559 => 8.4575, std.dev.: 0.0255) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.42% (1.2742 => 1.3050, std.dev.: 0.0103) MultiSource/Applications/hexxagon/hexxagon: 2.02% (0.9425 => 0.9615, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 41.38% (0.0261 => 0.0369, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/pi: 41.36% (1.6538 => 2.3378, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/matrix: 22.09% (3.4629 => 4.2277, std.dev.: 0.0478) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.71% (0.0766 => 0.0894, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/ary3: 14.86% (1.7426 => 2.0016, std.dev.: 0.0248) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.37% (2.4042 => 2.7257, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.37% (4.0101 => 4.5462, std.dev.: 0.0386) SingleSource/Benchmarks/McGill/queens: 10.95% (1.6261 => 1.8041, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/Puzzle: 10.61% (0.1433 => 0.1585, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/mason/mason: 9.99% (0.5004 => 0.5504, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: 8.93% (7.0025 => 7.6280, std.dev.: 0.0419) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.54% (0.2857 => 0.3101, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.63% (1.0063 => 1.0730, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.79% (0.3301 => 0.3492, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.07% (40.4792 => 42.5324, std.dev.: 0.3057) SingleSource/Benchmarks/Misc/fp-convert: 4.17% (15.2242 => 15.8585, std.dev.: 0.0229) SingleSource/Benchmarks/Misc/dt: 3.92% (0.9851 => 1.0237, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.91% (3.4080 => 3.5412, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 3.32% (3.5520 => 3.6698, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/hash: 3.31% (0.6308 => 0.6517, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.97% (0.5587 => 0.5753, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.80% (6.6312 => 6.8168, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.30% (0.5876 => 0.6011, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/power/power: 1.38% (1.4184 => 1.4380, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/whetstone: 1.27% (2.3453 => 2.3751, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.22% (1.6110 => 1.6306, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.15% (4.6127 => 4.6658, std.dev.: 0.0156) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -46.19% (0.0591 => 0.0318, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -42.52% (0.2996 => 0.1722, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.69% (1.4113 => 1.1475, std.dev.: 0.0112) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.82% (1.4189 => 1.1660, std.dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -39.78% (0.3497 => 0.2106, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/lpbench: -20.69% (5.2665 => 4.1766, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout-C++/ary3: -20.56% (1.7473 => 1.3881, std.dev.: 0.0346) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -15.13% (1.7361 => 1.4735, std.dev.: 0.0301) SingleSource/Benchmarks/Shootout/sieve: -12.27% (8.1594 => 7.1584, std.dev.: 0.0541) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.87% (1.1647 => 1.0497, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ks/ks: -8.34% (1.4034 => 1.2864, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: -8.30% (9.5474 => 8.7547, std.dev.: 0.0121) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.02% (3.2007 => 2.9440, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.87% (15.8312 => 14.5855, std.dev.: 0.4431) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.78% (3.6254 => 3.3796, std.dev.: 0.0251) MultiSource/Applications/lambda-0_1_3/lambda: -6.65% (7.6833 => 7.1725, std.dev.: 0.0319) SingleSource/Benchmarks/Shootout-C++/fibo: -6.55% (4.6355 => 4.3318, std.dev.: 0.0284) SingleSource/Benchmarks/Misc/richards_benchmark: -6.27% (1.4441 => 1.3536, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -6.06% (2.9728 => 2.7925, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/distray/distray: -5.93% (0.2664 => 0.2506, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.48% (3.9413 => 3.7254, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/fib2: -5.23% (4.4195 => 4.1885, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: -5.17% (2.5166 => 2.3864, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.67% (0.4564 => 0.4351, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -4.23% (62.4126 => 59.7723, std.dev.: 0.2908) MultiSource/Applications/sgefa/sgefa: -4.16% (0.3746 => 0.3590, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.60% (1.2959 => 1.2493, std.dev.: 0.0126) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -3.58% (1.2722 => 1.2267, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/methcall: -3.46% (9.2503 => 8.9300, std.dev.: 0.0678) MultiSource/Applications/SPASS/SPASS: -2.80% (8.5323 => 8.2934, std.dev.: 0.0896) SingleSource/Benchmarks/McGill/misr: -2.51% (0.4296 => 0.4188, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: -2.26% (92.7467 => 90.6529, std.dev.: 0.1374) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.24% (61.1734 => 59.8012, std.dev.: 0.5067) SingleSource/Benchmarks/Dhrystone/dry: -2.22% (2.4013 => 2.3479, std.dev.: 0.0166) MultiSource/Benchmarks/llubenchmark/llu: -2.13% (2.0192 => 1.9761, std.dev.: 0.0142) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.99% (2.8964 => 2.8387, std.dev.: 0.0189) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.93% (1.1683 => 1.1458, std.dev.: 0.0033) MultiSource/Applications/aha/aha: -1.90% (3.4286 => 3.3634, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: -1.86% (3.4876 => 3.4227, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.80% (1.8739 => 1.8401, std.dev.: 0.0112) MultiSource/Benchmarks/FreeBench/neural/neural: -1.71% (1.0926 => 1.0739, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.64% (1.0686 => 1.0511, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.63% (9.3855 => 9.2322, std.dev.: 0.0495) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.39% (25.6658 => 25.3099, std.dev.: 0.0295) SingleSource/Benchmarks/Shootout-C++/lists: -1.37% (16.5617 => 16.3349, std.dev.: 0.0516) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.32% (27.1724 => 26.8126, std.dev.: 0.0144) SingleSource/Benchmarks/Dhrystone/fldry: -1.28% (2.4971 => 2.4652, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/oourafft: -1.06% (3.8200 => 3.7794, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/obsequi/Obsequi: 2.63% (0.9980 => 1.0242, std.dev.: 0.0120) MultiSource/Applications/sqlite3/sqlite3: 2.97% (0.6022 => 0.6201, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/08-main/main: 8.34% (0.1666 => 0.1805, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.74% (0.1554 => 0.1581, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.59% (0.3083 => 0.3163, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.30% (0.2394 => 0.2449, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.79% (0.3175 => 0.3200, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.39% (0.2302 => 0.2293, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel: 1.78% (0.0449 => 0.0457, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -6.67% (0.0240 => 0.0224, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.04% (0.0192 => 0.0194, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.77% (0.0390 => 0.0393, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -15.61% (0.0301 => 0.0254, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.46% (0.0284 => 0.0277, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.31% (0.0324 => 0.0325, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 2.26% (0.0177 => 0.0181, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 2.12% (0.0189 => 0.0193, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 4.02% (0.0249 => 0.0259, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 3.69% (0.0325 => 0.0337, std.dev.: 0.0044) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0010 => 0.0010, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.21% (0.1429 => 0.1426, std.dev.: 0.0036) MultiSource/Applications/lemon/lemon: - (1.5019 => 1.5019, std.dev.: 0.0307) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.87% (0.1501 => 0.1514, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: - (0.0001 => 0.0001) MultiSource/Applications/viterbi/viterbi: - (0.0005 => 0.0005) MultiSource/Benchmarks/McCat/08-main/main: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.88% (0.4264 => 0.4056, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.73% (0.1344 => 0.1421, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -16.67% (0.0006 => 0.0005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.06% (0.0589 => 0.0571, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.90% (0.0232 => 0.0248, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.76% (0.0639 => 0.0663, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.79% (1.1350 => 1.1260, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 83.33% (0.0006 => 0.0011, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -79.17% (0.0024 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.87% (0.0637 => 0.0555, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.73% (0.0246 => 0.0195, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.43% (0.7541 => 0.7649, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 11.05% (1.5363 => 1.7061, std.dev.: 0.0092) SingleSource/UnitTests/2003-07-09-SignedArgs: - (0.0005 => 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0005 => 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0005 => 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.86% (0.0070 => 0.0121) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0001 => 0.0001) Report Time: 2.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 8 07:57:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 8 Oct 2012 09:57:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121008145745.311092A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4703?compare_to=4699&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4703, Order: 165390, Start Time: 2012-10-08 13:44:56, End Time: 2012-10-08 14:59:32 To: 4699, Order: 165384, Start Time: 2012-10-08 03:31:55, End Time: 2012-10-08 04:46:31 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (182 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1042 (754 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 22.26% (2.0176 => 2.4667, std.dev.: 0.0057) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.59% (0.1410 => 0.1658, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 15.74% (0.0826 => 0.0956, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 15.20% (0.2243 => 0.2584, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.71% (0.0834 => 0.0940, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 12.64% (0.1013 => 0.1141, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 12.34% (0.5818 => 0.6536, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.17% (0.1413 => 0.1585, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.13% (0.1072 => 0.1202, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 12.04% (0.5748 => 0.6440, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 11.95% (0.4328 => 0.4845, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 11.73% (1.3693 => 1.5299, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.56% (3.9660 => 4.4243, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 11.55% (0.7038 => 0.7851, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.54% (0.2721 => 0.3035, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 11.46% (0.7061 => 0.7870, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.44% (0.2596 => 0.2893, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.41% (0.0964 => 0.1074, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.34% (0.1588 => 0.1768, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 11.32% (0.4062 => 0.4522, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.30% (0.1327 => 0.1477, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.25% (0.2782 => 0.3095, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 11.22% (0.2781 => 0.3093, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.15% (0.7710 => 0.8570, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.04% (1.2193 => 1.3539, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.97% (0.9199 => 1.0208, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.96% (0.5265 => 0.5842, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.90% (0.3899 => 0.4324, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.86% (1.4563 => 1.6145, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.82% (0.3485 => 0.3862, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.75% (0.6959 => 0.7707, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 10.74% (0.2607 => 0.2887, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 10.73% (0.2628 => 0.2910, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.70% (0.6283 => 0.6955, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 10.67% (0.2690 => 0.2977, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.66% (0.2655 => 0.2938, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.66% (0.3022 => 0.3344, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 10.64% (0.1062 => 0.1175, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 10.62% (0.2937 => 0.3249, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 10.51% (13.8202 => 15.2723, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.41% (0.3756 => 0.4147, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.40% (0.3489 => 0.3852, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.39% (0.3580 => 0.3952, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 10.38% (0.2726 => 0.3009, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.37% (1.9828 => 2.1884, std.dev.: 0.0109) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.37% (1.1364 => 1.2542, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: 10.36% (0.2760 => 0.3046, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 10.32% (0.3293 => 0.3633, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.31% (0.4016 => 0.4430, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 10.29% (0.2761 => 0.3045, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.28% (0.2966 => 0.3271, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.27% (0.2765 => 0.3049, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.23% (0.1075 => 0.1185, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 10.17% (0.1003 => 0.1105, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.16% (0.2696 => 0.2970, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 10.13% (0.3149 => 0.3468, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 10.11% (0.3868 => 0.4259, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 10.02% (0.3453 => 0.3799, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.02% (0.1986 => 0.2185, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 10.01% (0.3107 => 0.3418, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.85% (0.1157 => 0.1271, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 9.81% (0.3192 => 0.3505, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.77% (0.4379 => 0.4807, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 9.74% (0.2988 => 0.3279, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.72% (0.5577 => 0.6119, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.66% (0.4390 => 0.4814, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists1: 9.65% (0.3534 => 0.3875, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.65% (0.3130 => 0.3432, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 9.60% (1.0313 => 1.1303, std.dev.: 0.0049) MultiSource/Applications/sgefa/sgefa: 9.52% (0.2995 => 0.3280, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.48% (0.4791 => 0.5245, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.47% (0.2914 => 0.3190, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 9.44% (0.1589 => 0.1739, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.40% (0.1276 => 0.1396) MultiSource/Applications/Burg/burg: 9.40% (1.1061 => 1.2101, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.36% (0.2127 => 0.2326, std.dev.: 0.0041) MultiSource/Applications/kimwitu++/kc: 9.28% (16.6129 => 18.1540, std.dev.: 0.0319) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.20% (0.1435 => 0.1567, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.17% (0.7460 => 0.8144, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 9.14% (3.8646 => 4.2179, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.08% (0.5637 => 0.6149, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 9.07% (0.2945 => 0.3212, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.06% (0.3246 => 0.3540, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.05% (0.3755 => 0.4095, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/18-imp/imp: 8.91% (0.3220 => 0.3507, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.89% (0.8698 => 0.9471, std.dev.: 0.0139) MultiSource/Applications/spiff/spiff: 8.89% (0.7506 => 0.8173, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.86% (7.2180 => 7.8576, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.85% (0.1865 => 0.2030, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 8.78% (0.6744 => 0.7336, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/football/football: 8.75% (0.8310 => 0.9037, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.70% (0.2023 => 0.2199, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/em3d/em3d: 8.57% (0.1657 => 0.1799, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 8.54% (3.1889 => 3.4613, std.dev.: 0.0078) MultiSource/Applications/treecc/treecc: 8.54% (1.9270 => 2.0916, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 8.46% (2.1791 => 2.3635, std.dev.: 0.0037) MultiSource/Applications/viterbi/viterbi: 8.46% (0.1478 => 0.1603, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.45% (0.6576 => 0.7132, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 8.34% (0.2925 => 0.3169, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.32% (0.4003 => 0.4336, std.dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 8.28% (1.0594 => 1.1471, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 8.25% (0.3914 => 0.4237, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.24% (0.3578 => 0.3873, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.08% (0.3601 => 0.3892, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.04% (0.3646 => 0.3939, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.03% (0.3663 => 0.3957, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.02% (0.3789 => 0.4093, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.99% (0.1789 => 0.1932, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/property: 7.97% (0.3940 => 0.4254, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.97% (0.1569 => 0.1694, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.97% (1.3245 => 1.4300, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.96% (3.6692 => 3.9611, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.95% (0.3650 => 0.3940, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 7.92% (0.3623 => 0.3910, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 7.91% (4.6629 => 5.0319, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.90% (0.2140 => 0.2309, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 7.87% (1.2749 => 1.3752, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.85% (4.4433 => 4.7920, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.84% (0.8818 => 0.9509, std.dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 7.82% (14.8535 => 16.0152, std.dev.: 0.0147) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.82% (4.3801 => 4.7226, std.dev.: 0.0090) MultiSource/Benchmarks/sim/sim: 7.79% (0.3131 => 0.3375, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.61% (0.6135 => 0.6602, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 7.60% (8.4961 => 9.1418, std.dev.: 0.0093) MultiSource/Benchmarks/McCat/05-eks/eks: 7.56% (0.4113 => 0.4424, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.35% (0.3511 => 0.3769, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 7.25% (1.2292 => 1.3183, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.98% (4.9865 => 5.3344, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 6.98% (0.6250 => 0.6686, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.87% (1.5188 => 1.6232, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.87% (0.2504 => 0.2676, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.80% (0.9108 => 0.9727, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.75% (1.1333 => 1.2098, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.69% (3.2742 => 3.4934, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.68% (0.4805 => 0.5126, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 6.55% (6.5754 => 7.0059, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.54% (0.1819 => 0.1938, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.40% (6.2785 => 6.6803, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.38% (0.2321 => 0.2469, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 6.23% (0.2008 => 0.2133, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.22% (0.3245 => 0.3447, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 6.22% (3.7467 => 3.9798, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.78% (2.1007 => 2.2221, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.51% (13.2842 => 14.0158, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.86% (0.2243 => 0.2352, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 3.63% (14.5298 => 15.0577, std.dev.: 0.0081) MultiSource/Applications/sqlite3/sqlite3: 3.62% (16.2614 => 16.8503, std.dev.: 0.0123) MultiSource/Benchmarks/Bullet/bullet: 1.11% (33.2944 => 33.6637, std.dev.: 0.0170) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5138, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.43% (1.8175 => 2.2616, std.dev.: 0.0168) SingleSource/Benchmarks/Misc/richards_benchmark: 11.08% (1.1560 => 1.2841, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 8.98% (0.8273 => 0.9016, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4144, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.12% (1.2998 => 1.3794, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9998, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.80% (0.3458 => 0.3624, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.75% (1.9144 => 2.0053, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.87% (1.7081 => 1.7742, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6764, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.35% (10.7476 => 11.1076, std.dev.: 0.0565) SingleSource/Benchmarks/Misc/flops-6: 3.32% (1.9199 => 1.9837, std.dev.: 0.0020) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613) SingleSource/Benchmarks/Misc/salsa20: 2.34% (7.4271 => 7.6008, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.70% (1.4298 => 1.4541, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 1.49% (8.3908 => 8.5161, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9697, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124) SingleSource/Benchmarks/Misc/flops: 1.25% (9.0760 => 9.1894, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5780, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 1.14% (12.4560 => 12.5982, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0272, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.12% (0.2670 => 0.1412, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -15.42% (0.0707 => 0.0598, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.16% (0.4657 => 0.3951, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.72% (1.3819 => 1.1923, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.65% (1.3813 => 1.1927, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.60% (22.5627 => 21.7498, std.dev.: 0.0143) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.64% (0.0997 => 0.0861, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -12.15% (0.2238 => 0.1966, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.55% (1.2308 => 1.0886, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.12% (20.3410 => 18.2817, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.36% (1.3780 => 1.3041, std.dev.: 0.0068) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5150, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.63% (0.9996 => 0.9533, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.54% (3.2729 => 3.1571, std.dev.: 0.0072) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.49% (1.7688 => 1.7071, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.49% (26.5159 => 25.8544, std.dev.: 0.0195) MultiSource/Applications/spiff/spiff: -2.40% (3.0263 => 2.9537, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.35% (1.9762 => 1.9298, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7158, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/lists: -1.74% (6.3560 => 6.2454, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.56% (0.6615 => 0.6512, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0071, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8668, std.dev.: 0.0152) MultiSource/Applications/sqlite3/sqlite3: -1.26% (4.5928 => 4.5349, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.17% (2.5254 => 2.4958, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: -1.17% (9.3358 => 9.2267, std.dev.: 0.0361) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2565, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 8 08:02:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 8 Oct 2012 10:02:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121008150258.09D0C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4704?compare_to=4700&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4704, Order: 165390, Start Time: 2012-10-08 13:45:01, End Time: 2012-10-08 15:04:45 To: 4700, Order: 165384, Start Time: 2012-10-08 03:36:52, End Time: 2012-10-08 04:56:02 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (155 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1025 (763 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.02% (0.5891 => 0.5892, std.dev.: 0.0041) MultiSource/Applications/SPASS/SPASS: -0.03% (16.2489 => 16.2436, std.dev.: 0.0228) MultiSource/Benchmarks/Bullet/bullet: -0.07% (54.8150 => 54.7779, std.dev.: 0.1073) MultiSource/Benchmarks/MallocBench/gs/gs: -0.02% (4.3987 => 4.3980, std.dev.: 0.0168) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.11% (1.2465 => 1.2479, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.04% (7.7453 => 7.7421, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.26% (0.7386 => 0.7367, std.dev.: 0.0029) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.84% (0.0359 => 0.0362, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.09% (0.2139 => 0.2141, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -13.39% (63.2438 => 54.7779, std.dev.: 0.1073) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.65% (14.1553 => 18.7766, std.dev.: 0.0160) SingleSource/Benchmarks/Misc-C++-EH/spirit: 61.15% (3.4629 => 5.5803, std.dev.: 0.0128) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14239.03% (0.0720 => 10.3241, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952200.00% (0.0001 => 9.9523, std.dev.: 0.0012) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 53.68% (10.3673 => 15.9328, std.dev.: 0.0109) MultiSource/Benchmarks/McCat/08-main/main: 51.57% (0.2554 => 0.3871, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/distray/distray: 30.97% (0.1056 => 0.1383, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 30.46% (0.1622 => 0.2116, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 15.43% (0.1432 => 0.1653, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.85% (2.2022 => 2.5293, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.81% (7.0540 => 8.0988, std.dev.: 0.0159) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.37% (0.1566 => 0.1791, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.36% (1.7609 => 1.9785, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.28% (0.0871 => 0.0978, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 11.43% (0.3473 => 0.3870, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.37% (0.3543 => 0.3946, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 11.35% (0.3516 => 0.3915, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.29% (0.3543 => 0.3943, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 11.26% (0.3561 => 0.3962, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.21% (0.3497 => 0.3889, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 11.00% (0.3282 => 0.3643, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 11.00% (0.3828 => 0.4249, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.94% (0.3886 => 0.4311, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.94% (0.3694 => 0.4098, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.86% (0.1584 => 0.1756, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 10.85% (0.3927 => 0.4353, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 10.14% (0.1440 => 0.1586, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 9.19% (0.7433 => 0.8116, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.14% (0.6675 => 0.7285, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.13% (0.5925 => 0.6466, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: 9.12% (0.1655 => 0.1806, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.00% (0.4879 => 0.5318, std.dev.: 0.0019) MultiSource/Applications/minisat/minisat: 9.00% (0.7115 => 0.7755, std.dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: 8.97% (9.4845 => 10.3350, std.dev.: 0.0068) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.92% (0.1143 => 0.1245, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.90% (0.1438 => 0.1566, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.88% (0.3177 => 0.3459, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.85% (1.5415 => 1.6779, std.dev.: 0.0052) SingleSource/UnitTests/ObjC++/property-reference-object: 8.77% (0.6030 => 0.6559, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.75% (0.4615 => 0.5019, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.68% (0.1625 => 0.1766, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/tsp/tsp: 8.60% (0.1175 => 0.1276, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 8.59% (0.3423 => 0.3717, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 8.59% (0.3109 => 0.3376, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 8.46% (10.4361 => 11.3185, std.dev.: 0.0245) MultiSource/Applications/oggenc/oggenc: 8.45% (5.7591 => 6.2457, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/em3d/em3d: 8.38% (0.1695 => 0.1837, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.34% (0.5105 => 0.5531, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.34% (0.1510 => 0.1636, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 8.33% (3.3354 => 3.6132, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.28% (0.2271 => 0.2459, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.23% (1.3050 => 1.4124, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference: 8.22% (0.7326 => 0.7928, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.18% (4.2646 => 4.6135, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.16% (0.5860 => 0.6338, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.14% (0.2065 => 0.2233, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.11% (0.2700 => 0.2919, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.08% (0.5569 => 0.6019, std.dev.: 0.0077) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.02% (0.2107 => 0.2276, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.90% (0.8067 => 0.8704, std.dev.: 0.0117) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.87% (0.8172 => 0.8815, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.76% (0.2758 => 0.2972, std.dev.: 0.0076) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.75% (0.3121 => 0.3363, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.72% (0.9765 => 1.0519, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.66% (8.1363 => 8.7597, std.dev.: 0.0148) MultiSource/Applications/spiff/spiff: 7.66% (0.7835 => 0.8435, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.65% (5.0018 => 5.3844, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.63% (0.1337 => 0.1439, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.63% (4.9449 => 5.3221, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.62% (0.3307 => 0.3559, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/bigfib: 7.61% (0.6456 => 0.6947, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 7.59% (0.3387 => 0.3644, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.58% (0.1940 => 0.2087, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: 7.52% (1.1642 => 1.2518, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.48% (0.4103 => 0.4410, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.46% (0.4289 => 0.4609, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.41% (0.5020 => 0.5392, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists: 7.39% (0.3422 => 0.3675, std.dev.: 0.0022) MultiSource/Applications/lua/lua: 7.37% (3.8723 => 4.1578, std.dev.: 0.0174) MultiSource/Applications/hbd/hbd: 7.22% (1.5603 => 1.6729, std.dev.: 0.0106) MultiSource/Applications/lemon/lemon: 7.18% (1.0722 => 1.1492, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.12% (0.3865 => 0.4140, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.09% (0.4203 => 0.4501, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 7.07% (0.1555 => 0.1665, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.07% (0.2603 => 0.2787, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.05% (7.9617 => 8.5233, std.dev.: 0.0234) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.01% (0.3650 => 0.3906, std.dev.: 0.0038) MultiSource/Applications/treecc/treecc: 6.99% (2.0273 => 2.1690, std.dev.: 0.0057) SingleSource/Regression/C++/ofstream_ctor: 6.95% (0.2905 => 0.3107, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 6.85% (0.2831 => 0.3025, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.80% (0.3441 => 0.3675, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/moments: 6.77% (0.4048 => 0.4322, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.73% (0.4620 => 0.4931, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.73% (0.4636 => 0.4948, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.71% (0.2891 => 0.3085, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.70% (0.3136 => 0.3346, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.68% (0.3232 => 0.3448, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 6.67% (0.3180 => 0.3392, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.65% (1.1861 => 1.2650, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.64% (0.3826 => 0.4080, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.62% (1.5859 => 1.6909, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 6.61% (0.3283 => 0.3500, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.57% (0.3684 => 0.3926, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.56% (2.0665 => 2.2020, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 6.52% (0.3603 => 0.3838, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 6.50% (2.2969 => 2.4462, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.49% (0.2756 => 0.2935, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.48% (0.3162 => 0.3367, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/matrix: 6.42% (0.3098 => 0.3297, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 6.41% (0.2871 => 0.3055, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.36% (0.6450 => 0.6860, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/wc: 6.29% (0.3052 => 0.3244, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/football/football: 6.27% (0.8921 => 0.9480, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/fibo: 6.24% (0.2725 => 0.2895, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 6.23% (0.4299 => 0.4567, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 6.15% (0.2877 => 0.3054, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.12% (0.2714 => 0.2880, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.10% (0.5981 => 0.6346, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.02% (0.2793 => 0.2961, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: 6.00% (0.2802 => 0.2970, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 5.96% (21.9371 => 23.2444, std.dev.: 0.0283) SingleSource/Benchmarks/Shootout-C++/ary2: 5.89% (0.3379 => 0.3578, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.88% (2.2024 => 2.3319, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.60% (0.1892 => 0.1998, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.50% (1.4186 => 1.4966, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.46% (0.1906 => 0.2010, std.dev.: 0.0038) MultiSource/Benchmarks/nbench/nbench: 5.37% (1.1840 => 1.2476, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.27% (0.4064 => 0.4278, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.08% (0.2266 => 0.2381, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 4.63% (1.2842 => 1.3437, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.58% (0.8101 => 0.8472, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.01% (14.3668 => 14.9426, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.80% (0.3817 => 0.3962, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.65% (0.3427 => 0.3552, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 3.52% (17.1811 => 17.7852, std.dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.91% (3.8922 => 4.0056, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.47% (1.1194 => 1.1471, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2172, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.85% (1.1396 => 1.2518, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0022) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4499, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3691, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0013) SingleSource/Regression/C/uint64_to_float: 3.71% (0.5413 => 0.5614, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.66% (3.6395 => 3.7728, std.dev.: 0.0077) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.67% (4.2280 => 4.3410, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (0.8275 => 0.8405, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8131, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.35% (9.1159 => 9.2388, std.dev.: 0.0246) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.25% (2.6546 => 2.6877, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1293, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -79.99% (0.8651 => 0.1731, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.15% (5.2763 => 3.2636, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.78% (5.3855 => 3.6200, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.32% (5.3526 => 3.6226, std.dev.: 0.0183) SingleSource/UnitTests/Vector/constpool: -14.44% (54.1659 => 46.3430, std.dev.: 0.0081) MultiSource/Benchmarks/FreeBench/mason/mason: -13.19% (0.0811 => 0.0704, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -11.01% (22.1758 => 19.7345, std.dev.: 0.0601) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.74% (2.9384 => 2.6229, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -33.47% (1.1492 => 0.7646, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4236, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.83% (0.0998 => 0.0860, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.30% (1.2373 => 1.0975, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -10.32% (1.5373 => 1.3787, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -9.90% (0.2161 => 0.1947, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.35% (19.9488 => 18.2833, std.dev.: 0.0402) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4787, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.71% (1.8329 => 1.7099, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5753, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.56% (1.9577 => 1.8489, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.30% (1.6805 => 1.5914, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-5: -4.94% (1.5835 => 1.5053, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.23% (0.9957 => 0.9536, std.dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.73% (1.3677 => 1.3167, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.61% (3.2827 => 3.1643, std.dev.: 0.0098) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5000, std.dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: -2.99% (12.4730 => 12.0998, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.07% (8.6802 => 8.5002, std.dev.: 0.0212) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.03% (8.1563 => 7.9906, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/salsa20: -1.80% (10.2830 => 10.0974, std.dev.: 0.0298) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6817, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.63% (2.5528 => 2.5112, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4206, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/whetstone: -1.08% (1.0554 => 1.0440, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2349, std.dev.: 0.0074) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.68% (0.5229 => 0.5892, std.dev.: 0.0041) MultiSource/Applications/SPASS/SPASS: 8.37% (14.9895 => 16.2436, std.dev.: 0.0228) MultiSource/Benchmarks/MallocBench/gs/gs: 6.99% (4.1105 => 4.3980, std.dev.: 0.0168) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.95% (1.1048 => 1.2479, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.16% (7.1582 => 7.7421, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.40% (0.6222 => 0.7367, std.dev.: 0.0029) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36100.00% (0.0001 => 0.0362, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.18% (0.2116 => 0.2141, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 8 09:26:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 8 Oct 2012 11:26:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121008162646.DAC022A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4705?compare_to=4701&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4705, Order: 165390, Start Time: 2012-10-08 13:44:48, End Time: 2012-10-08 16:28:33 To: 4701, Order: 165384, Start Time: 2012-10-08 03:19:28, End Time: 2012-10-08 06:03:13 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (136 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 1042 (827 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 12.41% (0.3488 => 0.3921, std.dev.: 0.0063) SingleSource/UnitTests/ObjC/exceptions-2: 12.33% (0.3446 => 0.3871, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.29% (0.3442 => 0.3865, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.27% (0.3465 => 0.3890, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.25% (0.3460 => 0.3884, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.16% (0.3496 => 0.3921, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.14% (0.3469 => 0.3890, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 12.02% (0.3643 => 0.4081, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.89% (0.3650 => 0.4084, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.79% (0.3724 => 0.4163, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.72% (0.1063 => 0.1177, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 10.14% (1.5932 => 1.7548, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/Hello: 9.92% (0.5826 => 0.6404) SingleSource/UnitTests/ObjC++/property-reference-object: 9.63% (0.5889 => 0.6456, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 8.83% (0.1619 => 0.1762, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 8.78% (0.1218 => 0.1325, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.37% (0.7171 => 0.7771, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.03% (1.6211 => 1.7513, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.00% (0.4361 => 0.4710, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.00% (0.2875 => 0.3105, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.96% (0.2738 => 0.2956, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 7.86% (0.3004 => 0.3240, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.84% (0.1620 => 0.1747, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.84% (2.7292 => 2.9431, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.80% (3.5627 => 3.8406, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.78% (1.3152 => 1.4175, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.77% (0.4994 => 0.5382, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.70% (0.3195 => 0.3441, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 7.66% (0.2714 => 0.2922, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 7.63% (0.2725 => 0.2933, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.60% (0.2014 => 0.2167, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 7.59% (5.5417 => 5.9624, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.58% (2.0673 => 2.2241, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/objinst: 7.58% (0.2823 => 0.3037, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.56% (0.2803 => 0.3015, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.56% (0.2792 => 0.3003, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.52% (0.2911 => 0.3130, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 7.52% (0.2780 => 0.2989, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.51% (0.2729 => 0.2934, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 7.50% (0.2813 => 0.3024, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.50% (0.5000 => 0.5375, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 7.42% (0.2750 => 0.2954, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 7.40% (0.2811 => 0.3019, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.40% (0.3096 => 0.3325, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.35% (0.9909 => 1.0637, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: 7.24% (23.5202 => 25.2224, std.dev.: 0.0277) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.19% (0.3060 => 0.3280, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 7.18% (0.1421 => 0.1523, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 7.13% (0.3267 => 0.3500, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.10% (0.1549 => 0.1659, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.08% (0.3362 => 0.3600, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 7.05% (0.3317 => 0.3551, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 7.01% (0.3678 => 0.3936, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 7.01% (0.4847 => 0.5187, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 7.00% (0.3258 => 0.3486, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 6.98% (1.0781 => 1.1534, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.95% (0.3282 => 0.3510, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.94% (0.2736 => 0.2926, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 6.90% (0.3348 => 0.3579, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.90% (0.3930 => 0.4201, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/lists1: 6.87% (0.3477 => 0.3716, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 6.86% (0.2566 => 0.2742, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.85% (0.3124 => 0.3338, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.84% (0.3726 => 0.3981, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.84% (0.3625 => 0.3873, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.84% (0.1462 => 0.1562, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.74% (0.4139 => 0.4418, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 6.73% (4.2109 => 4.4945, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.73% (0.2866 => 0.3059, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.73% (0.5900 => 0.6297, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.71% (0.3890 => 0.4151, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.70% (4.4195 => 4.7157, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/gs/gs: 6.61% (1.8794 => 2.0037, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/hash: 6.61% (0.4146 => 0.4420, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 6.61% (2.1013 => 2.2401, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.56% (0.3690 => 0.3932, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.51% (0.3903 => 0.4157, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.48% (0.3981 => 0.4239, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 6.45% (0.4029 => 0.4289, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.43% (0.5026 => 0.5349, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.32% (0.3845 => 0.4088, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.30% (0.1968 => 0.2092, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 6.27% (4.6177 => 4.9072, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.26% (0.6435 => 0.6838, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.19% (0.3084 => 0.3275, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 6.18% (0.5546 => 0.5889, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.18% (0.2040 => 0.2166, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.17% (0.2737 => 0.2906, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 6.17% (0.6634 => 0.7043, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.13% (0.2969 => 0.3151, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 6.10% (1.4269 => 1.5139, std.dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 5.98% (2.1653 => 2.2948, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.95% (0.2068 => 0.2191, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 5.89% (0.5012 => 0.5307, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.88% (0.4658 => 0.4932, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.75% (0.3271 => 0.3459, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.71% (0.9697 => 1.0251, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 5.55% (0.7875 => 0.8312, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 5.53% (2.0346 => 2.1472, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 5.49% (0.2075 => 0.2189, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.47% (1.9694 => 2.0771, std.dev.: 0.0071) MultiSource/Applications/minisat/minisat: 5.46% (0.3336 => 0.3518, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.42% (0.2103 => 0.2217, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.30% (1.9966 => 2.1025, std.dev.: 0.0038) MultiSource/Applications/lemon/lemon: 5.23% (0.2391 => 0.2516, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 4.98% (0.2691 => 0.2825, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.63% (0.5361 => 0.5609, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.58% (0.4253 => 0.4448, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.50% (0.7426 => 0.7760, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.17% (0.5584 => 0.5817, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 3.80% (0.3498 => 0.3631, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.79% (11.6398 => 12.0804, std.dev.: 0.0170) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.67% (4.6926 => 4.8650, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.16% (0.3792 => 0.3912, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 2.63% (11.9555 => 12.2704, std.dev.: 0.0139) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6096, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 5.89% (0.2122 => 0.2247, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6762, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/flops-2: 4.88% (1.8057 => 1.8939, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1693, std.dev.: 0.0574) SingleSource/Benchmarks/Dhrystone/dry: 4.30% (14.0481 => 14.6518, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1953, std.dev.: 0.0083) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5059, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.56% (3.1722 => 3.2217, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2849, std.dev.: 0.0033) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5136, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 1.08% (50.0626 => 50.6030, std.dev.: 0.0176) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.79% (25.4195 => 16.5749, std.dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9760, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8069, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: -7.37% (0.2402 => 0.2225, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8007, std.dev.: 0.0105) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.07% (0.6293 => 0.6100, std.dev.: 0.0064) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7735, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.28% (17.2379 => 16.8449, std.dev.: 0.0664) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.26% (41.7953 => 40.8495, std.dev.: 0.0129) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5774, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4957, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.18% (105.3826 => 104.1418, std.dev.: 0.0851) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0454, std.dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 8 11:01:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 8 Oct 2012 13:01:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121008180120.D1D552A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/4706?compare_to=4703&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4706, Order: 165392, Start Time: 2012-10-08 16:48:40, End Time: 2012-10-08 18:03:06 To: 4703, Order: 165390, Start Time: 2012-10-08 13:44:56, End Time: 2012-10-08 14:59:32 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (183 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1042 (753 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 22.25% (2.0176 => 2.4665, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.59% (0.1410 => 0.1658, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 15.86% (0.0826 => 0.0957, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 14.76% (0.2243 => 0.2574, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.83% (0.0834 => 0.0941, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 12.54% (0.1013 => 0.1140, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 12.39% (0.5818 => 0.6539, std.dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.17% (0.1413 => 0.1585, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 12.14% (0.5748 => 0.6446, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.03% (0.1072 => 0.1201, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 12.01% (0.4328 => 0.4848, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 11.81% (1.3693 => 1.5310, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.55% (3.9660 => 4.4239, std.dev.: 0.0036) SingleSource/UnitTests/ObjC++/property-reference: 11.53% (0.7061 => 0.7875, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.50% (0.2721 => 0.3034, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 11.50% (0.4062 => 0.4529, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.45% (0.1327 => 0.1479, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 11.34% (0.7038 => 0.7836, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.34% (0.1588 => 0.1768, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.31% (0.0964 => 0.1073, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 11.29% (0.2781 => 0.3095, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.25% (0.2596 => 0.2888, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.18% (0.2782 => 0.3093, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.13% (0.3485 => 0.3873, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.13% (0.7710 => 0.8568, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.05% (1.2193 => 1.3540, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.04% (0.9199 => 1.0215, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.04% (0.2655 => 0.2948, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.04% (0.5265 => 0.5846, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.03% (0.3899 => 0.4329, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 10.97% (0.2690 => 0.2985, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.92% (1.4563 => 1.6154, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 10.92% (0.1062 => 0.1178, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.89% (0.6959 => 0.7717, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.82% (0.3022 => 0.3349, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 10.76% (0.2937 => 0.3253, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.71% (0.6283 => 0.6956, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 10.70% (0.2607 => 0.2886, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 10.65% (0.2628 => 0.2908, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 10.54% (0.2760 => 0.3051, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 10.51% (0.3293 => 0.3639, std.dev.: 0.0041) MultiSource/Applications/SPASS/SPASS: 10.50% (13.8202 => 15.2719, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.43% (0.4016 => 0.4435, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/methcall: 10.43% (0.2761 => 0.3049, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 10.42% (0.2726 => 0.3010, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.42% (0.2765 => 0.3053) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.41% (0.3756 => 0.4147, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.39% (1.9828 => 2.1888, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/moments: 10.37% (0.3868 => 0.4269, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.35% (0.2966 => 0.3273, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.35% (0.3489 => 0.3850, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.33% (1.1364 => 1.2538, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.31% (0.2696 => 0.2974, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.20% (0.3580 => 0.3945, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 10.19% (0.3453 => 0.3805, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 10.19% (0.3149 => 0.3470, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.14% (0.1075 => 0.1184, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 10.07% (0.3107 => 0.3420, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 10.07% (0.1003 => 0.1104, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 10.03% (0.3192 => 0.3512, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.92% (0.1986 => 0.2183, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.91% (0.4390 => 0.4825, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.85% (0.1157 => 0.1271, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 9.77% (0.2988 => 0.3280, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 9.73% (0.3534 => 0.3878, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.68% (0.4379 => 0.4803, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.62% (0.3130 => 0.3431, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 9.61% (1.0313 => 1.1304, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.54% (0.5577 => 0.6109, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.54% (0.4791 => 0.5248, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 9.52% (0.2995 => 0.3280, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.44% (0.2914 => 0.3189, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.40% (0.2127 => 0.2327, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 9.38% (0.1589 => 0.1738, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 9.33% (16.6129 => 18.1623, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.33% (0.1276 => 0.1395, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.27% (0.1435 => 0.1568, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 9.25% (1.1061 => 1.2084, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.18% (0.7460 => 0.8145, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 9.17% (0.2945 => 0.3215, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.15% (0.3246 => 0.3543, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 9.09% (0.1111 => 0.1212, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 9.01% (0.3220 => 0.3510, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.99% (0.5637 => 0.6144, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.99% (0.8698 => 0.9480, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 8.96% (3.8646 => 4.2108, std.dev.: 0.0105) MultiSource/Applications/minisat/minisat: 8.96% (0.6744 => 0.7348, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.92% (0.3755 => 0.4090, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 8.89% (0.7506 => 0.8173, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/football/football: 8.86% (0.8310 => 0.9046, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.84% (7.2180 => 7.8561, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.79% (0.1865 => 0.2029, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.74% (0.2140 => 0.2327, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.60% (0.2023 => 0.2197, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: 8.58% (1.9270 => 2.0923, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 8.53% (3.1889 => 3.4608, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.47% (0.6576 => 0.7133, std.dev.: 0.0030) MultiSource/Applications/siod/siod: 8.46% (2.1791 => 2.3635, std.dev.: 0.0040) MultiSource/Applications/viterbi/viterbi: 8.46% (0.1478 => 0.1603, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 8.37% (1.0594 => 1.1481, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/parameter-passing: 8.27% (0.4003 => 0.4334, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.24% (0.3578 => 0.3873, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 8.24% (0.2925 => 0.3166, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.16% (0.3663 => 0.3962, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.15% (0.3914 => 0.4233, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 8.11% (0.3623 => 0.3917, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/em3d/em3d: 8.09% (0.1657 => 0.1791, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 8.08% (0.3789 => 0.4095, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.06% (0.3646 => 0.3940, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.03% (0.1569 => 0.1695, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.03% (1.3245 => 1.4308, std.dev.: 0.0062) SingleSource/UnitTests/ObjC/exceptions-2: 8.03% (0.3601 => 0.3890, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.02% (0.3940 => 0.4256, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.97% (0.3650 => 0.3941, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.97% (3.6692 => 3.9615, std.dev.: 0.0041) MultiSource/Applications/JM/lencod/lencod: 7.93% (14.8535 => 16.0315, std.dev.: 0.0096) MultiSource/Applications/SIBsim4/SIBsim4: 7.91% (1.2749 => 1.3758, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 7.90% (4.6629 => 5.0314, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 7.89% (0.3131 => 0.3378, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.88% (0.1789 => 0.1930, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.86% (4.3801 => 4.7243, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.84% (0.8818 => 0.9509, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.80% (4.4433 => 4.7900, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.76% (0.6135 => 0.6611, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 7.61% (8.4961 => 9.1426, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/05-eks/eks: 7.54% (0.4113 => 0.4423, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.35% (0.3511 => 0.3769, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 7.35% (1.2292 => 1.3195, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 7.20% (0.6250 => 0.6700, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.00% (4.9865 => 5.3354, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.91% (0.2504 => 0.2677, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.87% (1.5188 => 1.6231, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.84% (0.9108 => 0.9731, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.83% (1.1333 => 1.2107, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.76% (3.2742 => 3.4956, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.62% (0.4805 => 0.5123, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.49% (0.1819 => 0.1937, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 6.48% (6.5754 => 7.0014, std.dev.: 0.0185) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.46% (0.2321 => 0.2471, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.35% (6.2785 => 6.6771, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/oourafft: 6.32% (0.2008 => 0.2135, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.29% (0.3245 => 0.3449, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 6.24% (3.7467 => 3.9806, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.81% (2.1007 => 2.2228, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.48% (13.2842 => 14.0117, std.dev.: 0.0117) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.73% (0.2243 => 0.2349, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 3.69% (16.2614 => 16.8616, std.dev.: 0.0140) MultiSource/Applications/ClamAV/clamscan: 3.51% (14.5298 => 15.0400, std.dev.: 0.0052) MultiSource/Benchmarks/Bullet/bullet: 1.17% (33.2944 => 33.6830, std.dev.: 0.0105) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974) SingleSource/Benchmarks/Shootout-C++/methcall: 30.44% (5.7573 => 7.5098, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.69% (1.8175 => 2.2662, std.dev.: 0.0187) SingleSource/Benchmarks/Misc/richards_benchmark: 11.06% (1.1560 => 1.2839, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 8.99% (0.8273 => 0.9017, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 8.70% (0.1322 => 0.1437, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4142, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.29% (1.2998 => 1.3816, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0047, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.46% (0.3139 => 0.3279, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.88% (1.7081 => 1.7743, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6782, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9861, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.22% (10.7476 => 11.0938, std.dev.: 0.0319) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.11% (7.4271 => 7.5840, std.dev.: 0.0079) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4530, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5127, std.dev.: 0.0083) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1880, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5786, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0263, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5874, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.12% (0.2670 => 0.1412, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/mason/mason: -15.56% (0.0707 => 0.0597, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.16% (0.4657 => 0.3951, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.75% (1.3819 => 1.1919, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.62% (1.3813 => 1.1931, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.59% (22.5627 => 21.7530, std.dev.: 0.0217) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.15% (0.2238 => 0.1966, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: -11.01% (1.2308 => 1.0953, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.04% (20.3410 => 18.2985, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.46% (1.3780 => 1.3027, std.dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5135, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.60% (0.9996 => 0.9536, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.59% (3.2729 => 3.1555, std.dev.: 0.0036) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.45% (1.7688 => 1.7078, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.49% (26.5159 => 25.8548, std.dev.: 0.0416) MultiSource/Applications/spiff/spiff: -2.40% (3.0263 => 2.9538, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.30% (1.9762 => 1.9307, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.96% (0.6589 => 0.6460, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7135, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/lists: -1.74% (6.3560 => 6.2456, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0076, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8645, std.dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: -1.29% (4.5928 => 4.5337, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4949, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: -1.20% (9.3358 => 9.2235, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2573, std.dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 8 11:05:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 8 Oct 2012 13:05:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121008180536.A6C162A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4707?compare_to=4704&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4707, Order: 165392, Start Time: 2012-10-08 16:48:20, End Time: 2012-10-08 18:07:19 To: 4704, Order: 165390, Start Time: 2012-10-08 13:45:01, End Time: 2012-10-08 15:04:45 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (156 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1025 (760 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.5892 => 0.5892, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: -0.06% (16.2436 => 16.2332, std.dev.: 0.0100) MultiSource/Benchmarks/Bullet/bullet: -0.01% (54.7779 => 54.7725, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/gs/gs: -0.09% (4.3980 => 4.3939, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.12% (1.2479 => 1.2464, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.04% (7.7421 => 7.7391, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.05% (0.7367 => 0.7371, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.28% (0.0362 => 0.0361, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.14% (0.2141 => 0.2138, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -13.39% (63.2438 => 54.7725, std.dev.: 0.0032) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.66% (14.1553 => 18.7784, std.dev.: 0.0115) SingleSource/Benchmarks/Misc-C++-EH/spirit: 61.17% (3.4629 => 5.5813, std.dev.: 0.0029) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14223.33% (0.0720 => 10.3128, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9951900.00% (0.0001 => 9.9520, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 53.64% (10.3673 => 15.9281, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/08-main/main: 51.41% (0.2554 => 0.3867, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/distray/distray: 30.87% (0.1056 => 0.1382, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 30.33% (0.1622 => 0.2114, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 15.36% (0.1432 => 0.1652, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.87% (2.2022 => 2.5297, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.82% (7.0540 => 8.0997, std.dev.: 0.0100) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.30% (0.1566 => 0.1790, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.31% (1.7609 => 1.9777, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.28% (0.0871 => 0.0978, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.40% (0.3473 => 0.3869, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.35% (0.3543 => 0.3945, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.26% (0.3543 => 0.3942, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.21% (0.3497 => 0.3889, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-3: 11.15% (0.3516 => 0.3908, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/synchronized: 11.15% (0.3561 => 0.3958, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 10.97% (0.3282 => 0.3642, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.91% (0.3694 => 0.4097, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.89% (0.3828 => 0.4245, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.87% (0.3927 => 0.4354, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.80% (0.1584 => 0.1755, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/property: 10.76% (0.3886 => 0.4304, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 10.07% (0.1440 => 0.1585, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.14% (0.6675 => 0.7285, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: 9.09% (0.7115 => 0.7762, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 9.04% (0.7433 => 0.8105, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.03% (0.5925 => 0.6460, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 9.00% (0.1655 => 0.1804, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.97% (0.3177 => 0.3462, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.92% (0.1143 => 0.1245) MultiSource/Benchmarks/mafft/pairlocalalign: 8.88% (9.4845 => 10.3266, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.85% (0.4879 => 0.5311, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.83% (0.1438 => 0.1565, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.81% (1.5415 => 1.6773, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 8.78% (0.3109 => 0.3382, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 8.72% (0.6030 => 0.6556, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.67% (0.4615 => 0.5015, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.55% (0.1625 => 0.1764, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 8.51% (0.1175 => 0.1275, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 8.48% (10.4361 => 11.3209, std.dev.: 0.0147) MultiSource/Benchmarks/McCat/18-imp/imp: 8.47% (0.3423 => 0.3713, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 8.45% (5.7591 => 6.2456, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 8.38% (0.1695 => 0.1837, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 8.37% (3.3354 => 3.6145, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.33% (0.5105 => 0.5530, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.24% (1.3050 => 1.4125, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.23% (0.2271 => 0.2458, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.21% (0.1510 => 0.1634, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.17% (4.2646 => 4.6131, std.dev.: 0.0049) SingleSource/UnitTests/ObjC++/property-reference: 8.09% (0.7326 => 0.7919, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.05% (0.5860 => 0.6332, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.93% (0.2700 => 0.2914, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.90% (0.5569 => 0.6009, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.89% (0.2065 => 0.2228, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.83% (0.2107 => 0.2272, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.82% (0.8172 => 0.8811, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.76% (0.2758 => 0.2972, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.75% (0.8067 => 0.8692, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 7.74% (0.3387 => 0.3649, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.65% (8.1363 => 8.7588, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.64% (0.9765 => 1.0511, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: 7.64% (0.6456 => 0.6949, std.dev.: 0.0046) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.59% (0.3121 => 0.3358, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.59% (0.3307 => 0.3558, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.56% (4.9449 => 5.3188, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.56% (5.0018 => 5.3800, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.55% (0.1337 => 0.1438, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 7.53% (0.7835 => 0.8425, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.48% (0.4103 => 0.4410, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.47% (0.1940 => 0.2085, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 7.46% (1.1642 => 1.2511, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.39% (0.5020 => 0.5391, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 7.36% (3.8723 => 4.1573, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/lists: 7.33% (0.3422 => 0.3673, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 7.14% (0.1555 => 0.1666, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 7.13% (1.0722 => 1.1486, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/hash: 7.11% (0.4289 => 0.4594, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.09% (0.4203 => 0.4501, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.08% (1.5603 => 1.6707, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.07% (7.9617 => 8.5245, std.dev.: 0.0029) MultiSource/Applications/treecc/treecc: 7.02% (2.0273 => 2.1696, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.91% (0.3865 => 0.4132, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.88% (0.2905 => 0.3105, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.88% (0.3650 => 0.3901, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.83% (0.3441 => 0.3676, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.76% (0.2603 => 0.2779, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 6.74% (0.4048 => 0.4321, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.72% (1.1861 => 1.2658, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.71% (0.2831 => 0.3021, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.71% (1.5859 => 1.6923, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (0.4620 => 0.4927, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.63% (0.3136 => 0.3344, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary: 6.62% (0.3232 => 0.3446, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.61% (0.2891 => 0.3082, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 6.57% (0.3180 => 0.3389, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.53% (0.3826 => 0.4076, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 6.52% (0.3603 => 0.3838, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.51% (0.3684 => 0.3924, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.51% (0.4636 => 0.4938, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.49% (0.3283 => 0.3496, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 6.47% (2.2969 => 2.4455, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.45% (2.0665 => 2.1998, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.42% (0.3162 => 0.3365, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.33% (0.6450 => 0.6858, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/except: 6.30% (0.2871 => 0.3052, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.29% (0.3098 => 0.3293, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 6.25% (0.8921 => 0.9479, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.20% (0.2872 => 0.3050, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 6.13% (0.2725 => 0.2892, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.13% (0.3052 => 0.3239, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.10% (0.2756 => 0.2924, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.07% (0.5981 => 0.6344, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 6.02% (0.4299 => 0.4558, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.01% (0.2877 => 0.3050, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.93% (0.2714 => 0.2875, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.89% (0.2802 => 0.2967, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.87% (0.2793 => 0.2957, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 5.87% (21.9371 => 23.2240, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.86% (2.2024 => 2.3315, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/ary2: 5.80% (0.3379 => 0.3575, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.55% (0.1892 => 0.1997, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.48% (1.4186 => 1.4963, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.46% (0.1906 => 0.2010, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.36% (0.4064 => 0.4282, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 5.34% (1.1840 => 1.2472, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.08% (0.2266 => 0.2381, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 4.53% (1.2842 => 1.3424, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.52% (0.8101 => 0.8467, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/objinst: 4.47% (0.3131 => 0.3271, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.84% (14.3668 => 14.9183, std.dev.: 0.0204) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.54% (0.3817 => 0.3952, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 3.44% (17.1811 => 17.7728, std.dev.: 0.0212) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.97% (3.8922 => 4.0077, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.54% (1.1194 => 1.1478, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.92% (1.1396 => 1.2526, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 9.23% (3.1595 => 3.4510, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3690, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.65% (0.3463 => 0.3624, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.60% (3.6395 => 3.7706, std.dev.: 0.0025) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.92% (4.2280 => 4.3515, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7655, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8134, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.19% (2.6546 => 2.6863, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.05% (6.5088 => 6.5773, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1290, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.00% (0.8651 => 0.1730, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.15% (5.2763 => 3.2636, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.75% (5.3855 => 3.6217, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.27% (5.3526 => 3.6252, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -14.50% (54.1659 => 46.3139, std.dev.: 0.0170) MultiSource/Benchmarks/FreeBench/mason/mason: -13.19% (0.0811 => 0.0704, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -11.04% (22.1758 => 19.7284, std.dev.: 0.0142) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.60% (2.9384 => 2.6268, std.dev.: 0.0152) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.43% (1.1492 => 0.7650, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.80% (1.6925 => 1.4251, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.83% (0.0998 => 0.0860, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -12.20% (1.2373 => 1.0864, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/mandel-2: -10.35% (1.5373 => 1.3782, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/mason/mason: -10.13% (0.2161 => 0.1942, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.32% (19.9488 => 18.2884, std.dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.71% (1.8329 => 1.7099, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.28% (1.6805 => 1.5918, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5073, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.29% (0.9957 => 0.9530, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0008) MultiSource/Applications/siod/siod: -3.63% (3.2827 => 3.1634, std.dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.15% (32.5116 => 31.4869, std.dev.: 0.0108) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0990, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.14% (0.4808 => 0.4705, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -1.88% (10.2830 => 10.0900, std.dev.: 0.0164) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.84% (8.1563 => 8.0061, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.76% (8.6802 => 8.5276, std.dev.: 0.0159) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6825, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5117, std.dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4215, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.05% (6.2999 => 6.2337, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8596, std.dev.: 0.0064) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.68% (0.5229 => 0.5892, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 8.30% (14.9895 => 16.2332, std.dev.: 0.0100) MultiSource/Benchmarks/MallocBench/gs/gs: 6.89% (4.1105 => 4.3939, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.82% (1.1048 => 1.2464, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.12% (7.1582 => 7.7391, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.47% (0.6222 => 0.7371, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36000.00% (0.0001 => 0.0361, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.04% (0.2116 => 0.2138, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 8 12:39:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 8 Oct 2012 14:39:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121008193942.95F8A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4708?compare_to=4705&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4708, Order: 165392, Start Time: 2012-10-08 16:57:36, End Time: 2012-10-08 19:41:30 To: 4705, Order: 165390, Start Time: 2012-10-08 13:44:48, End Time: 2012-10-08 16:28:33 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (138 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 1041 (825 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.02% (125.6363 => 130.6924, std.dev.: 0.2682) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.33% (0.3446 => 0.3871, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.32% (0.3465 => 0.3892, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.24% (0.3488 => 0.3915, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.20% (0.3442 => 0.3862, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.20% (0.3460 => 0.3882, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 12.16% (0.3496 => 0.3921, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.11% (0.3469 => 0.3889, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.86% (0.3650 => 0.4083, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions: 11.80% (0.3643 => 0.4073, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.68% (0.3724 => 0.4159, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.82% (0.1063 => 0.1178, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 10.13% (1.5932 => 1.7546, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 9.82% (0.5826 => 0.6398, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.58% (0.5889 => 0.6453, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 8.89% (0.1619 => 0.1763, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 8.78% (0.1218 => 0.1325) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.33% (1.3152 => 1.4247, std.dev.: 0.0039) SingleSource/UnitTests/ObjC++/property-reference: 8.27% (0.7171 => 0.7764, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.15% (0.4994 => 0.5401, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.14% (1.6211 => 1.7531, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.05% (0.4361 => 0.4712, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.03% (0.2875 => 0.3106, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.84% (0.1620 => 0.1747, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.77% (3.5627 => 3.8395, std.dev.: 0.0097) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.76% (2.7292 => 2.9411, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.73% (0.3195 => 0.3442, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.72% (0.3004 => 0.3236, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 7.71% (0.2725 => 0.2935, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.70% (0.2714 => 0.2923, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.67% (0.2738 => 0.2948, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.66% (2.0673 => 2.2257, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.66% (0.2729 => 0.2938, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/18-imp/imp: 7.60% (0.1421 => 0.1529, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 7.58% (5.5417 => 5.9620, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/random: 7.56% (0.2803 => 0.3015, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.56% (0.5000 => 0.5378, std.dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: 7.55% (0.9909 => 1.0657, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/strcat: 7.53% (0.2750 => 0.2957, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.52% (0.2911 => 0.3130, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.52% (0.2792 => 0.3002, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 7.51% (0.2823 => 0.3035, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.50% (0.2813 => 0.3024, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 7.48% (0.2780 => 0.2988, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.45% (0.2014 => 0.2164, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.43% (0.3096 => 0.3326, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 7.38% (23.5202 => 25.2562, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/except: 7.33% (0.2811 => 0.3017, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.16% (0.3060 => 0.3279, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.14% (0.5026 => 0.5385, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary: 7.12% (0.3258 => 0.3490, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.11% (0.3362 => 0.3601, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 7.10% (0.3267 => 0.3499, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 7.08% (0.3317 => 0.3552, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 7.08% (1.0781 => 1.1544, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 7.07% (0.3678 => 0.3938, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.05% (0.4139 => 0.4431, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.05% (0.2736 => 0.2929, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 7.01% (0.4847 => 0.5187, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.00% (0.3930 => 0.4205, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 6.99% (0.3348 => 0.3582, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.98% (0.3124 => 0.3342, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.98% (0.3726 => 0.3986, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.97% (0.1549 => 0.1657, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 6.95% (4.2109 => 4.5036, std.dev.: 0.0040) MultiSource/Applications/spiff/spiff: 6.90% (0.4029 => 0.4307, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.89% (0.3282 => 0.3508, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.87% (0.2866 => 0.3063, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.87% (0.3845 => 0.4109, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.86% (0.5900 => 0.6305, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists1: 6.84% (0.3477 => 0.3715, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.84% (0.3625 => 0.3873, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.84% (0.1462 => 0.1562, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 6.84% (2.1013 => 2.2450, std.dev.: 0.0055) MultiSource/Benchmarks/nbench/nbench: 6.78% (0.2566 => 0.2740, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 6.78% (0.1505 => 0.1607, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.70% (4.4195 => 4.7155, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash: 6.68% (0.4146 => 0.4423, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 6.65% (1.8794 => 2.0044, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.61% (0.3690 => 0.3934, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.61% (0.3903 => 0.4161, std.dev.: 0.0029) MultiSource/Applications/siod/siod: 6.59% (0.6634 => 0.7071, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.52% (0.4251 => 0.4528, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.50% (0.1968 => 0.2096, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.48% (0.3890 => 0.4142, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.41% (0.3981 => 0.4236, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.39% (0.6435 => 0.6846, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.36% (0.3271 => 0.3479, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 6.32% (1.4269 => 1.5171, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.30% (0.2969 => 0.3156, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 6.25% (4.6177 => 4.9061, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.18% (0.2040 => 0.2166, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.16% (0.3084 => 0.3274, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 6.16% (2.1653 => 2.2987, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.08% (0.4658 => 0.4941, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 6.03% (0.5012 => 0.5314, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 6.00% (0.5546 => 0.5879, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.00% (0.2068 => 0.2192, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.99% (0.2737 => 0.2901, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 5.89% (0.9697 => 1.0268, std.dev.: 0.0046) MultiSource/Applications/treecc/treecc: 5.77% (0.7875 => 0.8329, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 5.59% (0.2075 => 0.2191, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 5.57% (2.0346 => 2.1480, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.55% (1.9694 => 2.0787, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.52% (1.9966 => 2.1069, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 5.49% (0.3336 => 0.3519, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 5.48% (0.2391 => 0.2522, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.33% (0.2103 => 0.2215, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 5.13% (0.2691 => 0.2829, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.66% (0.5361 => 0.5611, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.65% (0.7426 => 0.7771, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.42% (0.5584 => 0.5831, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.02% (0.4253 => 0.4424, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 4.00% (0.3498 => 0.3638, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.76% (4.6926 => 4.8692, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.71% (11.6398 => 12.0716, std.dev.: 0.0082) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.14% (0.3792 => 0.3911, std.dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 2.66% (11.9555 => 12.2739, std.dev.: 0.0171) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.55% (3.3903 => 3.6122, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.13% (0.2122 => 0.2252, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6751, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-2: 5.05% (1.8057 => 1.8968, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1671, std.dev.: 0.1436) SingleSource/Benchmarks/Dhrystone/dry: 4.24% (14.0481 => 14.6444, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1947, std.dev.: 0.0046) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5031, std.dev.: 0.0066) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.56% (3.1722 => 3.2217, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2864, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5128, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5865, std.dev.: 0.0191) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.86% (25.4195 => 16.5581, std.dev.: 0.0186) SingleSource/Benchmarks/Shootout-C++/ary2: -8.28% (0.2402 => 0.2203, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9736, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7919, std.dev.: 0.0111) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9583, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7985, std.dev.: 0.0125) SingleSource/Benchmarks/Dhrystone/fldry: -3.07% (17.2379 => 16.7080, std.dev.: 0.0822) MultiSource/Applications/siod/siod: -3.04% (6.9842 => 6.7722, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -2.95% (3.6262 => 3.5191, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.61% (0.6293 => 0.6129, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8596, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5770, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: -1.55% (5.5810 => 5.4946, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (105.3826 => 104.1559, std.dev.: 0.0944) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0442, std.dev.: 0.0039) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 8 12:44:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 8 Oct 2012 14:44:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121008194459.3089F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4709?compare_to=4706&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4709, Order: 165409, Start Time: 2012-10-08 18:32:15, End Time: 2012-10-08 19:46:44 To: 4706, Order: 165392, Start Time: 2012-10-08 16:48:40, End Time: 2012-10-08 18:03:06 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (185 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1040 (751 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 6.21% (39.9540 => 42.4352, std.dev.: 0.0203) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.43% (55.2054 => 56.5480, std.dev.: 0.1064) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.21% (2.0176 => 2.4859, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.80% (0.1410 => 0.1661, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 16.46% (0.0826 => 0.0962, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 15.62% (0.0653 => 0.0755) MultiSource/Benchmarks/McCat/08-main/main: 15.38% (0.2243 => 0.2588, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.18% (0.1072 => 0.1224, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 13.56% (0.5818 => 0.6607, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 13.26% (0.5748 => 0.6510, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.94% (0.0819 => 0.0925, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.83% (0.0834 => 0.0941) MultiSource/Benchmarks/Olden/tsp/tsp: 12.64% (0.1013 => 0.1141, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 12.62% (0.4328 => 0.4874, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.60% (0.1413 => 0.1591, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 12.55% (0.7061 => 0.7947, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 12.38% (1.3693 => 1.5388, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 12.22% (0.2782 => 0.3122, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 12.19% (0.2781 => 0.3120, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 12.14% (0.4062 => 0.4555, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.98% (0.3899 => 0.4366, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.94% (0.2721 => 0.3046, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.91% (0.1327 => 0.1485) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.90% (3.9660 => 4.4381, std.dev.: 0.0113) MultiSource/Applications/lambda-0_1_3/lambda: 11.79% (0.7038 => 0.7868, std.dev.: 0.0156) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.71% (0.3485 => 0.3893, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.65% (0.1588 => 0.1773, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 11.62% (0.2607 => 0.2910, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.58% (0.3022 => 0.3372, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/wc: 11.58% (0.2937 => 0.3277, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.56% (0.2655 => 0.2962, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 11.53% (0.2628 => 0.2931, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 11.52% (0.2690 => 0.3000, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.51% (0.0964 => 0.1075, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.36% (0.2596 => 0.2891, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 11.34% (0.2760 => 0.3073, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 11.34% (1.9828 => 2.2076, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.30% (0.4016 => 0.4470, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 11.30% (0.2726 => 0.3034, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/lists: 11.27% (0.3293 => 0.3664, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.24% (0.3756 => 0.4178, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.22% (0.6283 => 0.6988, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 11.21% (0.3149 => 0.3502, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 11.21% (0.1062 => 0.1181, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 11.19% (0.2761 => 0.3070, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.17% (0.7710 => 0.8571, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/office/office: 11.16% (0.2966 => 0.3297, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 11.14% (0.2765 => 0.3073, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 11.10% (0.3107 => 0.3452, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.09% (0.6959 => 0.7731, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 11.09% (0.2696 => 0.2995, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 11.06% (0.3489 => 0.3875, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.06% (0.3580 => 0.3976, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.03% (1.4563 => 1.6170, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.03% (0.9199 => 1.0214, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/moments: 10.96% (0.3868 => 0.4292, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.96% (1.2193 => 1.3529, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.94% (0.5265 => 0.5841, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 10.92% (0.3453 => 0.3830, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 10.81% (0.2988 => 0.3311, std.dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 10.80% (13.8202 => 15.3127, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/ary2: 10.78% (0.3192 => 0.3536, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 10.55% (0.3534 => 0.3907, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.54% (1.1364 => 1.2562, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.46% (0.1157 => 0.1278, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 10.37% (0.1003 => 0.1107, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.36% (0.4390 => 0.4845, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.14% (0.1075 => 0.1184, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 10.08% (0.2945 => 0.3242, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.98% (0.4791 => 0.5269, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 9.95% (16.6129 => 18.2667, std.dev.: 0.0170) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.89% (0.4379 => 0.4812, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.88% (0.5577 => 0.6128, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.81% (0.3130 => 0.3437, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 9.77% (1.0313 => 1.1321, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 9.75% (0.1589 => 0.1744, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 9.65% (0.2995 => 0.3284, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.64% (0.2914 => 0.3195, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.64% (0.1276 => 0.1399, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.62% (0.1986 => 0.2177, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.61% (0.3755 => 0.4116, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.55% (0.8698 => 0.9529, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 9.55% (1.1061 => 1.2117, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.50% (0.2127 => 0.2329, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 9.27% (0.1111 => 0.1214, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.20% (0.1435 => 0.1567, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.18% (0.7460 => 0.8145, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.18% (0.3246 => 0.3544, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 9.16% (0.3220 => 0.3515, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.14% (0.5637 => 0.6152, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 9.06% (3.8646 => 4.2148, std.dev.: 0.0046) MultiSource/Applications/spiff/spiff: 9.06% (0.7506 => 0.8186, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/parameter-passing: 9.04% (0.4003 => 0.4365, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 9.02% (0.6744 => 0.7352, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.01% (7.2180 => 7.8684, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 9.00% (0.3578 => 0.3900, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 8.93% (0.8310 => 0.9052, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.90% (0.1865 => 0.2031, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.89% (0.3914 => 0.4262, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 8.83% (0.3646 => 0.3968, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 8.82% (1.9270 => 2.0969, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-2: 8.80% (0.3601 => 0.3918, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.80% (0.2023 => 0.2201, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 8.80% (0.1478 => 0.1608, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.78% (0.3940 => 0.4286, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.76% (0.3663 => 0.3984, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 8.75% (3.1889 => 3.4680, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 8.75% (0.3623 => 0.3940, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 8.74% (2.1791 => 2.3695, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.74% (0.3789 => 0.4120, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.68% (0.3650 => 0.3967, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 8.68% (0.2925 => 0.3179, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 8.55% (1.0594 => 1.1500, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.49% (0.6576 => 0.7134, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.48% (0.1569 => 0.1702, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 8.33% (0.1657 => 0.1795, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.25% (3.6692 => 3.9719, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.16% (0.1789 => 0.1935, std.dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 8.12% (4.6629 => 5.0417, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 8.08% (0.3131 => 0.3384, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.03% (1.3245 => 1.4309, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 8.01% (1.2292 => 1.3276, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 8.00% (14.8535 => 16.0413, std.dev.: 0.0084) MultiSource/Applications/SIBsim4/SIBsim4: 7.98% (1.2749 => 1.3766, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.97% (0.3511 => 0.3791, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.97% (4.4433 => 4.7976, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.95% (4.3801 => 4.7282, std.dev.: 0.0121) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.92% (0.6135 => 0.6621, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.90% (0.2140 => 0.2309, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 7.85% (8.4961 => 9.1630, std.dev.: 0.0138) MultiSource/Benchmarks/McCat/05-eks/eks: 7.73% (0.4113 => 0.4431, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.65% (0.8818 => 0.9493, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 7.63% (0.6250 => 0.6727, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.45% (4.9865 => 5.3578, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.31% (0.1819 => 0.1952, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.98% (1.5188 => 1.6248, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.95% (0.4805 => 0.5139, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.95% (0.2504 => 0.2678, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.93% (0.9108 => 0.9739, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.93% (1.1333 => 1.2118, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.86% (3.2742 => 3.4988, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.75% (0.3245 => 0.3464, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 6.71% (6.5754 => 7.0168, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.71% (6.2785 => 6.6998, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.55% (0.2321 => 0.2473, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 6.52% (0.2008 => 0.2139, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 6.32% (3.7467 => 3.9834, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.06% (2.1007 => 2.2280, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.44% (13.2842 => 14.0066, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.55% (0.2243 => 0.2345, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 3.64% (16.2614 => 16.8536, std.dev.: 0.0070) MultiSource/Applications/ClamAV/clamscan: 3.56% (14.5298 => 15.0477, std.dev.: 0.0095) MultiSource/Benchmarks/Bullet/bullet: 1.69% (33.2944 => 33.8579, std.dev.: 0.0098) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5179, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.61% (1.8175 => 2.2647, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/richards_benchmark: 10.98% (1.1560 => 1.2829, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4143, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.31% (1.2998 => 1.3818, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.65% (1.9144 => 2.0035, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (1.7081 => 1.7749, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6766, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9850, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.38% (10.7476 => 11.1106, std.dev.: 0.0685) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.09% (7.4271 => 7.5825, std.dev.: 0.0049) MultiSource/Applications/lemon/lemon: 1.68% (1.4298 => 1.4538, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5129, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.45% (2.0200 => 2.0492, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2122, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1860, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5787, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0274, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1406, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5879, std.dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.04% (8.8259 => 8.9174, std.dev.: 0.0071) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.34% (0.2670 => 0.1406, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -15.42% (0.0707 => 0.0598, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -14.62% (0.4657 => 0.3976, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.76% (1.3819 => 1.1918, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.71% (1.3813 => 1.1919, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.26% (22.5627 => 21.8263, std.dev.: 0.0195) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.11% (0.2238 => 0.1967, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -11.07% (1.2308 => 1.0945, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.02% (20.3410 => 18.3021, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0055) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.20% (1.3780 => 1.3064, std.dev.: 0.0028) SingleSource/UnitTests/Vector/multiplies: -5.07% (2.6470 => 2.5127, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.85% (0.9996 => 0.9611, std.dev.: 0.0023) MultiSource/Applications/siod/siod: -3.55% (3.2729 => 3.1566, std.dev.: 0.0223) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.49% (1.7688 => 1.7071, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.51% (26.5159 => 25.8501, std.dev.: 0.0276) MultiSource/Applications/spiff/spiff: -2.47% (3.0263 => 2.9515, std.dev.: 0.0015) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.32% (1.9762 => 1.9304, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.02% (0.6589 => 0.6456, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7143, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/lists: -1.75% (6.3560 => 6.2448, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0075, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -1.24% (4.5928 => 4.5359, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.22% (9.3358 => 9.2222, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout/heapsort: -1.21% (3.9173 => 3.8700, std.dev.: 0.0178) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2578, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 8 12:53:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 8 Oct 2012 14:53:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121008195359.399482A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4710?compare_to=4707&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4710, Order: 165409, Start Time: 2012-10-08 18:36:38, End Time: 2012-10-08 19:55:45 To: 4707, Order: 165392, Start Time: 2012-10-08 16:48:20, End Time: 2012-10-08 18:07:19 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (156 on baseline) Performance Improvements: 1 (41 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1023 (762 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.56% (3.7680 => 3.8268, std.dev.: 0.0202) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.78% (15.9281 => 15.4857, std.dev.: 0.0153) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.03% (0.5892 => 0.5890, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 0.16% (16.2332 => 16.2598, std.dev.: 0.0188) MultiSource/Benchmarks/Bullet/bullet: 0.49% (54.7725 => 55.0392, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/gs/gs: 0.33% (4.3939 => 4.4082, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.11% (1.2464 => 1.2478, std.dev.: 0.0061) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.71% (7.7391 => 7.7938, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.58% (0.7371 => 0.7414, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0361 => 0.0361, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.19% (0.2138 => 0.2142, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -12.97% (63.2438 => 55.0392, std.dev.: 0.0058) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.84% (14.1553 => 18.8034, std.dev.: 0.0160) SingleSource/Benchmarks/Misc-C++-EH/spirit: 61.47% (3.4629 => 5.5917, std.dev.: 0.0015) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14224.44% (0.0720 => 10.3136, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952300.00% (0.0001 => 9.9524, std.dev.: 0.0012) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 51.76% (0.2554 => 0.3876, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 49.37% (10.3673 => 15.4857, std.dev.: 0.0153) SingleSource/Benchmarks/Misc/richards_benchmark: 32.18% (0.1622 => 0.2144, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/distray/distray: 31.16% (0.1056 => 0.1385, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 15.78% (0.1432 => 0.1658, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.13% (2.2022 => 2.5353, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.80% (7.0540 => 8.0979, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.37% (0.1566 => 0.1791, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.56% (1.7609 => 1.9820, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.50% (0.3543 => 0.3986, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 12.41% (0.3473 => 0.3904, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.29% (0.3516 => 0.3948, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.22% (0.3543 => 0.3976) SingleSource/UnitTests/ObjC/synchronized: 12.22% (0.3561 => 0.3996, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.17% (0.0871 => 0.0977, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.15% (0.3497 => 0.3922, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.83% (0.3828 => 0.4281, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.83% (0.3694 => 0.4131, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.74% (0.3927 => 0.4388, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.68% (0.3886 => 0.4340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 11.18% (0.3282 => 0.3649, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.92% (0.1584 => 0.1757, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 10.42% (0.1440 => 0.1590, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.54% (0.5925 => 0.6490, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.49% (0.4879 => 0.5342, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference-object: 9.44% (0.6030 => 0.6599, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 9.26% (0.7115 => 0.7774, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.25% (0.3177 => 0.3471, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.25% (0.1438 => 0.1571, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.18% (0.6675 => 0.7288, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 9.15% (0.7433 => 0.8113, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 9.09% (9.4845 => 10.3468, std.dev.: 0.0111) SingleSource/Benchmarks/McGill/chomp: 9.00% (0.1655 => 0.1804, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.96% (1.5415 => 1.6796, std.dev.: 0.0012) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.92% (0.1143 => 0.1245, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.78% (0.4615 => 0.5020, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 8.77% (0.1175 => 0.1278, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 8.73% (0.1695 => 0.1843, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 8.72% (0.3109 => 0.3380, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference: 8.67% (0.7326 => 0.7961, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 8.62% (0.3423 => 0.3718, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.62% (0.1625 => 0.1765, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.47% (0.2065 => 0.2240, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.42% (0.5105 => 0.5535, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 8.39% (3.3354 => 3.6152, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.33% (1.3050 => 1.4137, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.32% (0.2271 => 0.2460, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.31% (4.2646 => 4.6190, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.24% (0.5860 => 0.6343, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.24% (0.8172 => 0.8845, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.22% (0.2700 => 0.2922, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.21% (0.1510 => 0.1634, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.16% (0.3307 => 0.3577, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.13% (0.5569 => 0.6022, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/hash: 8.09% (0.4289 => 0.4636, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 8.09% (10.4361 => 11.2803, std.dev.: 0.0168) MultiSource/Applications/oggenc/oggenc: 8.08% (5.7591 => 6.2243, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.00% (0.8067 => 0.8712, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 7.98% (0.6456 => 0.6971, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.98% (0.2758 => 0.2978, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.97% (0.2107 => 0.2275, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.95% (0.3121 => 0.3369, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 7.91% (0.7835 => 0.8455, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.91% (8.1363 => 8.7798, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.89% (5.0018 => 5.3966, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists: 7.86% (0.3422 => 0.3691, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.84% (0.1940 => 0.2092, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.83% (4.9449 => 5.3320, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.80% (0.4103 => 0.4423, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.77% (0.9765 => 1.0524, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 7.74% (0.3387 => 0.3649, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.71% (0.4203 => 0.4527, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.69% (0.5020 => 0.5406, std.dev.: 0.0024) MultiSource/Applications/Burg/burg: 7.69% (1.1642 => 1.2537, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.64% (0.2891 => 0.3112, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.63% (0.3865 => 0.4160, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.55% (0.1337 => 0.1438, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.51% (0.3650 => 0.3924, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 7.50% (0.2905 => 0.3123, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 7.49% (3.8723 => 4.1623, std.dev.: 0.0056) MultiSource/Applications/hbd/hbd: 7.39% (1.5603 => 1.6756, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 7.33% (0.1555 => 0.1669, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.31% (7.9617 => 8.5434, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.30% (0.3136 => 0.3365, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 7.29% (0.4048 => 0.4343, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.28% (0.2831 => 0.3037, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.27% (0.4620 => 0.4956, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.24% (0.3826 => 0.4103, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 7.21% (2.0273 => 2.1734, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.18% (0.3162 => 0.3389, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 7.18% (0.3232 => 0.3464, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 7.17% (0.3684 => 0.3948, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 7.16% (0.3603 => 0.3861, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.11% (0.2756 => 0.2952, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.10% (0.4636 => 0.4965, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.08% (0.2725 => 0.2918, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 7.08% (1.0722 => 1.1481, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wc: 7.08% (0.3052 => 0.3268, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.07% (2.0665 => 2.2127, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.06% (0.3441 => 0.3684, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.00% (0.2871 => 0.3072, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 6.99% (0.2877 => 0.3078, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.98% (0.3283 => 0.3512, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.96% (0.2872 => 0.3072, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 6.94% (0.3098 => 0.3313, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 6.89% (0.3180 => 0.3399, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.84% (0.2793 => 0.2984, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.82% (0.2802 => 0.2993, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.82% (0.2714 => 0.2899, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 6.74% (2.2969 => 2.4516, std.dev.: 0.0149) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.71% (1.1861 => 1.2657, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.71% (1.5859 => 1.6923, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 6.44% (21.9371 => 23.3505, std.dev.: 0.0110) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.42% (0.6450 => 0.6864, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.39% (0.3379 => 0.3595, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.35% (0.5981 => 0.6361, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 6.24% (0.8921 => 0.9478, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 6.23% (0.4299 => 0.4567, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.89% (2.2024 => 2.3321, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.83% (0.4064 => 0.4301, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.67% (0.1906 => 0.2014, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.59% (1.4186 => 1.4979, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 5.41% (1.1840 => 1.2480, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.27% (0.3131 => 0.3296, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 5.07% (1.2842 => 1.3493, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.99% (0.2266 => 0.2379, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.72% (0.8101 => 0.8483, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.58% (0.3817 => 0.3992, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.84% (14.3668 => 14.9182, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.65% (0.3427 => 0.3552, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 3.36% (17.1811 => 17.7589, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.88% (3.8922 => 4.0043, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.87% (1.1194 => 1.1515, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.88% (1.1396 => 1.2522, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 9.20% (3.1595 => 3.4503, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (3.1578 => 3.3677, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.65% (0.3463 => 0.3624, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.70% (3.6395 => 3.7743, std.dev.: 0.0021) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.89% (4.2280 => 4.3504, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7651, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8127, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.20% (6.5088 => 6.5871, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.04% (9.1159 => 9.2107, std.dev.: 0.0338) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.04% (2.6546 => 2.6822, std.dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.06% (6.6874 => 0.1298, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.01% (0.8651 => 0.1729, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.97% (5.2763 => 3.2729, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.47% (5.3855 => 3.6370, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.13% (5.3526 => 3.6328, std.dev.: 0.0025) SingleSource/UnitTests/Vector/constpool: -14.49% (54.1659 => 46.3189, std.dev.: 0.0355) MultiSource/Benchmarks/FreeBench/mason/mason: -13.07% (0.0811 => 0.0705, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -10.98% (22.1758 => 19.7399, std.dev.: 0.0193) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.37% (2.9384 => 2.6338, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.39% (1.1492 => 0.7655, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.95% (1.6925 => 1.4226, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.43% (0.0998 => 0.0864, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -11.41% (1.2373 => 1.0961, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel-2: -10.75% (1.5373 => 1.3720, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/mason/mason: -10.09% (0.2161 => 0.1943, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.34% (19.9488 => 18.2860, std.dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.74% (1.8329 => 1.7093, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.31% (1.6805 => 1.5913, std.dev.: 0.0036) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7963, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.87% (1.5835 => 1.5064, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.31% (0.9957 => 0.9528, std.dev.: 0.0120) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.67% (3.2827 => 3.1621, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4984, std.dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: -3.04% (12.4730 => 12.0936, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.15% (8.6802 => 8.4932, std.dev.: 0.0110) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -2.05% (10.2830 => 10.0725, std.dev.: 0.0258) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6816, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.67% (8.1563 => 8.0204, std.dev.: 0.0084) SingleSource/UnitTests/Vector/multiplies: -1.63% (2.5528 => 2.5113, std.dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4207, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.09% (6.2999 => 6.2312, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/whetstone: -1.08% (1.0554 => 1.0440, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.64% (0.5229 => 0.5890, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 8.47% (14.9895 => 16.2598, std.dev.: 0.0188) MultiSource/Benchmarks/MallocBench/gs/gs: 7.24% (4.1105 => 4.4082, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.94% (1.1048 => 1.2478, std.dev.: 0.0061) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.88% (7.1582 => 7.7938, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.16% (0.6222 => 0.7414, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36000.00% (0.0001 => 0.0361, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.23% (0.2116 => 0.2142, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 8 14:28:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 8 Oct 2012 16:28:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121008212827.ED2D02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4711?compare_to=4709&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4711, Order: 165419, Start Time: 2012-10-08 20:15:40, End Time: 2012-10-08 21:30:14 To: 4709, Order: 165409, Start Time: 2012-10-08 18:32:15, End Time: 2012-10-08 19:46:44 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (181 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1042 (754 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 22.63% (2.0176 => 2.4742, std.dev.: 0.0062) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.30% (0.1410 => 0.1654, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 15.86% (0.0826 => 0.0957, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 14.89% (0.2243 => 0.2577, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 13.58% (0.5818 => 0.6608, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/Hello: 13.43% (0.5748 => 0.6520, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.31% (0.0819 => 0.0928, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.71% (0.0834 => 0.0940, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 12.68% (0.4328 => 0.4877, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 12.68% (0.7061 => 0.7956, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: 12.54% (0.1013 => 0.1140, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 12.34% (1.3693 => 1.5383, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 12.29% (0.2782 => 0.3124, std.dev.: 0.0073) SingleSource/Regression/C++/ofstream_ctor: 12.19% (0.2781 => 0.3120, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.17% (0.1413 => 0.1585, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 12.14% (0.4062 => 0.4555, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.82% (0.3899 => 0.4360, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.79% (0.2655 => 0.2968, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.75% (0.1072 => 0.1198, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 11.71% (0.2937 => 0.3281, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 11.66% (0.2607 => 0.2911, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 11.61% (0.2628 => 0.2933, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.59% (0.3485 => 0.3889, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.58% (0.2721 => 0.3036, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.57% (3.9660 => 4.4249, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 11.52% (0.2690 => 0.3000, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.48% (0.3022 => 0.3369, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.40% (0.1588 => 0.1769, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 11.30% (0.7038 => 0.7833, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 11.27% (0.2760 => 0.3071, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 11.26% (0.2966 => 0.3300, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.25% (0.2596 => 0.2888, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.23% (0.1327 => 0.1476, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 11.21% (1.9828 => 2.2051) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.21% (0.4016 => 0.4466, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 11.19% (0.2726 => 0.3031, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.16% (0.4390 => 0.4880, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.15% (0.7710 => 0.8570, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 11.15% (0.3489 => 0.3878, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/heapsort: 11.14% (0.2765 => 0.3073, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 11.08% (0.3293 => 0.3658, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.02% (0.3756 => 0.4170, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 11.02% (0.2696 => 0.2993, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 11.01% (0.2761 => 0.3065, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 11.01% (0.3107 => 0.3449, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.97% (0.6283 => 0.6972, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.95% (0.3580 => 0.3972, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 10.92% (0.3149 => 0.3493, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 10.89% (0.3453 => 0.3829, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.88% (1.2193 => 1.3519, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 10.86% (0.3868 => 0.4288, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 10.81% (0.3192 => 0.3537, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.81% (0.5265 => 0.5834, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.79% (1.4563 => 1.6135, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.77% (0.9199 => 1.0190, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.60% (0.6959 => 0.7697, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 10.58% (0.2988 => 0.3304, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 10.55% (0.1062 => 0.1174, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 10.54% (13.8202 => 15.2773, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/lists1: 10.44% (0.3534 => 0.3903, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.32% (1.1364 => 1.2537, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.14% (0.1075 => 0.1184, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.94% (0.1157 => 0.1272, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 9.81% (0.2945 => 0.3234, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.77% (0.5577 => 0.6122, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.77% (0.1986 => 0.2180, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.64% (0.4791 => 0.5253, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.61% (0.3755 => 0.4116, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.58% (0.3130 => 0.3430, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.55% (0.4379 => 0.4797, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 9.52% (1.0313 => 1.1295, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 9.51% (16.6129 => 18.1930, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.36% (0.8698 => 0.9512, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.36% (0.2127 => 0.2326, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 9.35% (0.2995 => 0.3275, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 9.31% (0.1589 => 0.1737, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.25% (0.1276 => 0.1394, std.dev.: 0.0029) MultiSource/Applications/Burg/burg: 9.20% (1.1061 => 1.2079, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.20% (0.2914 => 0.3182, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/mst/mst: 9.09% (0.1111 => 0.1212, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.05% (0.5637 => 0.6147, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 9.02% (0.3914 => 0.4267, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.00% (0.3246 => 0.3538, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.99% (0.1435 => 0.1564, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.98% (0.7460 => 0.8130, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 8.94% (0.3578 => 0.3898, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.94% (0.4003 => 0.4361, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 8.93% (0.7506 => 0.8176, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/18-imp/imp: 8.91% (0.3220 => 0.3507, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.86% (7.2180 => 7.8576, std.dev.: 0.0066) SingleSource/UnitTests/ObjC/exceptions-4: 8.86% (0.3646 => 0.3969, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 8.80% (0.3601 => 0.3918, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 8.77% (0.8310 => 0.9039, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.77% (0.3650 => 0.3970, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 8.76% (3.8646 => 4.2033, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: 8.76% (0.6744 => 0.7335, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 8.71% (0.3789 => 0.4119, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.71% (0.3663 => 0.3982, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 8.65% (0.3940 => 0.4281, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.63% (0.1865 => 0.2026, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.61% (0.3623 => 0.3935, std.dev.: 0.0055) MultiSource/Applications/d/make_dparser: 8.56% (3.1889 => 3.4620, std.dev.: 0.0129) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.55% (0.2023 => 0.2196, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 8.50% (1.9270 => 2.0908, std.dev.: 0.0059) MultiSource/Applications/siod/siod: 8.47% (2.1791 => 2.3637, std.dev.: 0.0163) MultiSource/Applications/viterbi/viterbi: 8.46% (0.1478 => 0.1603, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.39% (0.6576 => 0.7128, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 8.38% (0.2925 => 0.3170, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 8.23% (1.0594 => 1.1466, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.22% (0.1569 => 0.1698, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 8.05% (0.3131 => 0.3383, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 8.03% (0.1657 => 0.1790, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.00% (3.6692 => 3.9628, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.00% (0.8818 => 0.9523, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 7.91% (4.6629 => 5.0319, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.90% (0.2140 => 0.2309, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 7.86% (14.8535 => 16.0209, std.dev.: 0.0151) MultiSource/Applications/hexxagon/hexxagon: 7.86% (1.2292 => 1.3258, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.83% (1.3245 => 1.4282, std.dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.83% (0.1789 => 0.1929, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 7.78% (1.2749 => 1.3741, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.77% (4.4433 => 4.7887, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.76% (4.3801 => 4.7198, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/bigfib: 7.60% (0.6250 => 0.6725, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 7.57% (8.4961 => 9.1389, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.45% (0.6135 => 0.6592, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 7.44% (0.4113 => 0.4419, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.32% (0.3511 => 0.3768, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.29% (4.9865 => 5.3502, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.15% (0.1819 => 0.1949, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.83% (1.1333 => 1.2107, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.81% (0.3245 => 0.3466, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.81% (0.4805 => 0.5132, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.79% (0.2504 => 0.2674, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.78% (1.5188 => 1.6217, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.76% (0.9108 => 0.9724, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.58% (3.2742 => 3.4897, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 6.47% (0.2008 => 0.2138, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.47% (6.2785 => 6.6849, std.dev.: 0.0062) MultiSource/Applications/JM/ldecod/ldecod: 6.47% (6.5754 => 7.0010, std.dev.: 0.0141) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.16% (0.2321 => 0.2464, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 6.06% (3.7467 => 3.9736, std.dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.60% (2.1007 => 2.2184, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.53% (13.2842 => 14.0190, std.dev.: 0.0111) MultiSource/Applications/sqlite3/sqlite3: 3.63% (16.2614 => 16.8516, std.dev.: 0.0155) MultiSource/Applications/ClamAV/clamscan: 3.47% (14.5298 => 15.0346, std.dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: 1.61% (33.2944 => 33.8303, std.dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.75% (0.4846 => 0.6966, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 30.48% (5.7573 => 7.5123, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 24.14% (1.8175 => 2.2563, std.dev.: 0.0221) SingleSource/Benchmarks/Misc/richards_benchmark: 11.08% (1.1560 => 1.2841, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4139, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.24% (1.2998 => 1.3809, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9999, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0047, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.89% (1.7081 => 1.7746, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6762, std.dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 3.42% (10.7476 => 11.1150, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/flops-6: 3.35% (1.9199 => 1.9843, std.dev.: 0.0020) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.09% (7.4271 => 7.5825, std.dev.: 0.0045) MultiSource/Applications/lemon/lemon: 1.65% (1.4298 => 1.4534, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5128, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1873, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/oourafft: 1.17% (5.5130 => 5.5777, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0272, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/lists: 1.02% (12.4560 => 12.5832, std.dev.: 0.0074) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.38% (0.2670 => 0.1405, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -15.56% (0.0707 => 0.0597, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -14.56% (0.4657 => 0.3979, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.84% (1.3819 => 1.1906, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.78% (1.3813 => 1.1910, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.42% (22.5627 => 21.7903, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.94% (0.0997 => 0.0858, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -12.15% (0.2238 => 0.1966, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.53% (1.2308 => 1.0889, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.14% (20.3410 => 18.2792, std.dev.: 0.0190) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.40% (1.3780 => 1.2898, std.dev.: 0.0145) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8099, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.07% (2.6470 => 2.5127, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.75% (0.9996 => 0.9621, std.dev.: 0.0036) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.52% (1.7688 => 1.7066, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.35% (0.4867 => 0.4704, std.dev.: 0.0008) MultiSource/Applications/siod/siod: -2.84% (3.2729 => 3.1798, std.dev.: 0.0113) MultiSource/Applications/lua/lua: -2.62% (26.5159 => 25.8208, std.dev.: 0.0257) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -2.52% (3.0263 => 2.9501, std.dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.28% (1.9762 => 1.9311, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.96% (0.6589 => 0.6460, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7149, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/lists: -1.78% (6.3560 => 6.2429, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0067, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: -1.25% (4.5928 => 4.5353, std.dev.: 0.0089) MultiSource/Applications/minisat/minisat: -1.21% (9.3358 => 9.2228, std.dev.: 0.0147) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.17% (2.5254 => 2.4958, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.13% (3.9173 => 3.8731, std.dev.: 0.0060) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2584, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.03% (6.6320 => 6.5634, std.dev.: 0.0073) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 8 14:42:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 8 Oct 2012 16:42:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121008214227.73DD22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4712?compare_to=4710&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4712, Order: 165419, Start Time: 2012-10-08 20:24:49, End Time: 2012-10-08 21:44:14 To: 4710, Order: 165409, Start Time: 2012-10-08 18:36:38, End Time: 2012-10-08 19:55:45 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (152 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1023 (765 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.41% (15.4857 => 15.8595, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.40% (78.6395 => 80.5274, std.dev.: 0.2639) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.08% (0.5890 => 0.5885, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: -0.33% (16.2598 => 16.2059, std.dev.: 0.0086) MultiSource/Benchmarks/Bullet/bullet: -0.40% (55.0392 => 54.8192, std.dev.: 0.0098) MultiSource/Benchmarks/MallocBench/gs/gs: -0.76% (4.4082 => 4.3749, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.10% (1.2478 => 1.2466, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.51% (7.7938 => 7.7540, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.46% (0.7414 => 0.7380, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.83% (0.0361 => 0.0364, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.2142 => 0.2142, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -13.32% (63.2438 => 54.8192, std.dev.: 0.0098) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.30% (14.1553 => 18.7268, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++-EH/spirit: 60.72% (3.4629 => 5.5656, std.dev.: 0.0101) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14233.75% (0.0720 => 10.3203, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952000.00% (0.0001 => 9.9521, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 52.98% (10.3673 => 15.8595, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/08-main/main: 50.63% (0.2554 => 0.3847, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/distray/distray: 30.97% (0.1056 => 0.1383, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 30.95% (0.1622 => 0.2124, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.19% (2.2022 => 2.5367, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 15.08% (0.1432 => 0.1648) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.89% (7.0540 => 8.1046, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.18% (0.1566 => 0.1788, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.62% (0.3543 => 0.3990, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.47% (0.0834 => 0.0938, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.42% (1.7609 => 1.9796, std.dev.: 0.0104) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.17% (0.0871 => 0.0977, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.09% (0.3473 => 0.3893, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.98% (0.3497 => 0.3916) SingleSource/UnitTests/ObjC/exceptions-3: 11.83% (0.3516 => 0.3932, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 11.77% (0.3543 => 0.3960, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.77% (0.3561 => 0.3980, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.46% (0.3927 => 0.4377, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 11.45% (0.3694 => 0.4117, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.31% (0.3828 => 0.4261, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 11.14% (0.3886 => 0.4319, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 10.76% (0.3282 => 0.3635, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.61% (0.1584 => 0.1752, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/power/power: 10.14% (0.1440 => 0.1586, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.72% (0.5925 => 0.6501, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 9.32% (0.6030 => 0.6592, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.10% (0.4879 => 0.5323, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 9.07% (0.7115 => 0.7760, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.99% (0.6675 => 0.7275, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.97% (0.1438 => 0.1567, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.97% (0.3177 => 0.3462, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 8.80% (9.4845 => 10.3187, std.dev.: 0.0131) MultiSource/Applications/lambda-0_1_3/lambda: 8.79% (0.7433 => 0.8086, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 8.70% (0.1655 => 0.1799, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.67% (1.5415 => 1.6752, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 8.65% (0.3109 => 0.3378, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 8.63% (0.7326 => 0.7958, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.58% (0.4615 => 0.5011, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 8.40% (5.7591 => 6.2428, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 8.38% (0.1695 => 0.1837, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 8.30% (10.4361 => 11.3026, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/18-imp/imp: 8.21% (0.3423 => 0.3704, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 8.12% (3.3354 => 3.6064, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.12% (0.1625 => 0.1757, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.12% (1.3050 => 1.4110, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.11% (0.5105 => 0.5519, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.10% (0.2271 => 0.2455, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.09% (0.2065 => 0.2232, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.02% (4.2646 => 4.6068, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.01% (0.1510 => 0.1631, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.97% (0.5860 => 0.6327, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.87% (0.8172 => 0.8815, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.81% (0.5569 => 0.6004, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 7.77% (0.3422 => 0.3688, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.77% (0.3307 => 0.3564, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 7.74% (0.6456 => 0.6956, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.74% (0.2700 => 0.2909, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.74% (0.2107 => 0.2270, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.64% (0.8067 => 0.8683, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.63% (8.1363 => 8.7573, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.61% (4.9449 => 5.3213, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.60% (5.0018 => 5.3819, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.58% (0.2758 => 0.2967, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.51% (0.9765 => 1.0498, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.50% (0.3121 => 0.3355, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 7.46% (0.4289 => 0.4609, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.46% (0.4103 => 0.4409, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 7.44% (0.2905 => 0.3121, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.42% (0.4203 => 0.4515, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 7.38% (0.7835 => 0.8413, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: 7.35% (0.3387 => 0.3636, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 7.34% (1.1642 => 1.2497, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.32% (0.1940 => 0.2082, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.32% (0.3650 => 0.3917, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 7.28% (0.2831 => 0.3037, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.27% (0.5020 => 0.5385, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 7.24% (0.3232 => 0.3466, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 7.19% (0.4048 => 0.4339, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.17% (0.3865 => 0.4142, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.15% (7.9617 => 8.5312, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.14% (0.3136 => 0.3360, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 7.14% (0.1555 => 0.1666, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 7.02% (3.8723 => 4.1443, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 6.99% (1.5603 => 1.6694, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.98% (2.0665 => 2.2108, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash2: 6.97% (0.4620 => 0.4942, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.94% (0.3603 => 0.3853, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 6.89% (0.3684 => 0.3938, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.89% (0.3162 => 0.3380, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 6.88% (0.3283 => 0.3509, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.83% (0.2871 => 0.3067, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.82% (0.3826 => 0.4087, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.82% (0.2756 => 0.2944, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.82% (0.4636 => 0.4952, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.81% (0.3098 => 0.3309, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 6.78% (1.0722 => 1.1449, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.72% (0.3052 => 0.3257, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.68% (0.3441 => 0.3671, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.65% (0.2872 => 0.3063, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 6.65% (2.0273 => 2.1621, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hello: 6.52% (0.2714 => 0.2891, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.52% (1.1861 => 1.2634, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.50% (0.2877 => 0.3064, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.48% (0.2793 => 0.2974, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.39% (0.2802 => 0.2981, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.38% (0.2603 => 0.2769, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.36% (0.3379 => 0.3594, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 6.35% (0.3180 => 0.3382, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.32% (1.5859 => 1.6861, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.17% (0.6450 => 0.6848, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 6.09% (21.9371 => 23.2736, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/football/football: 6.01% (0.8921 => 0.9457, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 6.00% (2.2969 => 2.4348, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 5.93% (0.4299 => 0.4554, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.92% (0.1892 => 0.2004, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.84% (0.5981 => 0.6330, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.54% (0.4064 => 0.4289, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.51% (0.1906 => 0.2011, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.41% (2.2024 => 2.3215, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.33% (1.4186 => 1.4942, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 5.07% (1.1840 => 1.2440, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 4.95% (0.3131 => 0.3286, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.85% (1.2842 => 1.3465, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.81% (0.2266 => 0.2375, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.57% (0.8101 => 0.8471, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.06% (0.3817 => 0.3972, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.64% (14.3668 => 14.8904, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.30% (0.3427 => 0.3540, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: 3.02% (17.1811 => 17.6999, std.dev.: 0.0132) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.72% (1.1194 => 1.1498, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.60% (3.8922 => 3.9934, std.dev.: 0.0070) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.99% (1.1396 => 1.2535, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 9.92% (0.1421 => 0.1562) MultiSource/Applications/aha/aha: 9.22% (3.1595 => 3.4508, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3680, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 3.68% (0.5413 => 0.5612, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.37% (3.6395 => 3.7620, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.75% (4.2280 => 4.3442, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.34% (1.7254 => 1.7657, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.55% (0.8275 => 0.8403, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8134, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.15% (2.6546 => 2.6851, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1293, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.05% (0.8651 => 0.1726, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.14% (5.2763 => 3.2637, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.49% (5.3855 => 3.6356, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.05% (5.3526 => 3.6371, std.dev.: 0.0023) SingleSource/UnitTests/Vector/constpool: -14.38% (54.1659 => 46.3764, std.dev.: 0.0315) MultiSource/Benchmarks/FreeBench/mason/mason: -13.19% (0.0811 => 0.0704, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -11.19% (22.1758 => 19.6936, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.55% (2.9384 => 2.6284, std.dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.34% (1.1492 => 0.7660, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.70% (1.6925 => 1.4268, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.83% (0.0998 => 0.0860, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.24% (1.2373 => 1.0982, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel-2: -10.39% (1.5373 => 1.3776, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/mason/mason: -9.95% (0.2161 => 0.1946, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.38% (19.9488 => 18.2764, std.dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.67% (1.8329 => 1.7107, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.30% (1.6805 => 1.5915, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5081, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.96% (0.9957 => 0.9563, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.73% (1.3677 => 1.3167, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1627, std.dev.: 0.0091) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4979, std.dev.: 0.0076) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0984, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.21% (8.6802 => 8.4884, std.dev.: 0.0199) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.95% (8.1563 => 7.9970, std.dev.: 0.0156) SingleSource/UnitTests/Vector/multiplies: -1.72% (2.5528 => 2.5089, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6829, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -1.60% (10.2830 => 10.1189, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4232, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/lists: -1.15% (6.2999 => 6.2276, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8562, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.55% (0.5229 => 0.5885, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 8.12% (14.9895 => 16.2059, std.dev.: 0.0086) MultiSource/Benchmarks/MallocBench/gs/gs: 6.43% (4.1105 => 4.3749, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.83% (1.1048 => 1.2466, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.32% (7.1582 => 7.7540, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.61% (0.6222 => 0.7380, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36300.00% (0.0001 => 0.0364, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.23% (0.2116 => 0.2142, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 8 15:52:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 8 Oct 2012 17:52:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121008225248.BB7622A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4713?compare_to=4708&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4713, Order: 165419, Start Time: 2012-10-08 20:10:47, End Time: 2012-10-08 22:54:35 To: 4708, Order: 165392, Start Time: 2012-10-08 16:57:36, End Time: 2012-10-08 19:41:30 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (135 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 1040 (829 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 2.12% (2.4340 => 2.4856, std.dev.: 0.0104) MultiSource/Applications/oggenc/oggenc: 1.20% (1.7546 => 1.7757, std.dev.: 0.0041) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.14% (0.1063 => 0.1192, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 12.11% (0.3460 => 0.3879, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 12.04% (0.3496 => 0.3917, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.01% (0.3465 => 0.3881, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.00% (0.3442 => 0.3855, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/exceptions-2: 11.98% (0.3446 => 0.3859, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.93% (0.3469 => 0.3883, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.93% (0.3488 => 0.3904, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.75% (0.3650 => 0.4079, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.56% (0.3643 => 0.4064, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 11.45% (1.5932 => 1.7757, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/parameter-passing: 11.44% (0.3724 => 0.4150, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.48% (0.1107 => 0.1223, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.68% (0.5826 => 0.6390, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.49% (0.5889 => 0.6448, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 8.89% (0.1619 => 0.1763, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 8.87% (0.1218 => 0.1326, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.45% (1.3152 => 1.4264, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 8.38% (0.7171 => 0.7772, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.36% (0.2738 => 0.2967, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.19% (0.4361 => 0.4718, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.10% (0.2875 => 0.3108, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.08% (1.6211 => 1.7521, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.07% (0.4994 => 0.5397, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.96% (0.1620 => 0.1749, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.94% (0.5000 => 0.5397, std.dev.: 0.0017) SingleSource/Regression/C++/ofstream_ctor: 7.92% (0.3004 => 0.3242, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 7.89% (5.5417 => 5.9792, std.dev.: 0.0114) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.76% (0.3195 => 0.3443, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.74% (0.2725 => 0.2936, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 7.72% (0.2823 => 0.3041, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.71% (3.5627 => 3.8375, std.dev.: 0.0070) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.71% (2.7292 => 2.9396, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.70% (0.2792 => 0.3007, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.68% (0.2813 => 0.3029, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.66% (0.2714 => 0.2922, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.63% (0.2911 => 0.3133, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 7.63% (0.2780 => 0.2992, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.62% (0.2729 => 0.2937, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.57% (2.0673 => 2.2237, std.dev.: 0.0048) MultiSource/Applications/d/make_dparser: 7.54% (1.0781 => 1.1594, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 7.54% (0.9909 => 1.0656, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/random: 7.53% (0.2803 => 0.3014, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 7.51% (0.2811 => 0.3022, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.50% (0.3625 => 0.3897, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.50% (0.2014 => 0.2165, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.42% (0.3060 => 0.3287, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wc: 7.40% (0.3096 => 0.3325, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 7.39% (0.4847 => 0.5205, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 7.30% (0.3317 => 0.3559, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.27% (0.2736 => 0.2935, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 7.25% (0.1421 => 0.1524, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 7.23% (0.3348 => 0.3590, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 7.21% (0.3678 => 0.3943, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.20% (0.3362 => 0.3604, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 7.19% (0.3267 => 0.3502, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 7.19% (23.5202 => 25.2107, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.17% (0.3903 => 0.4183, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.17% (0.3124 => 0.3348, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 7.15% (0.3258 => 0.3491, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.15% (0.4139 => 0.4435, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.15% (0.3930 => 0.4211, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 7.14% (4.2109 => 4.5115, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.10% (0.5026 => 0.5383, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sieve: 7.09% (0.3726 => 0.3990, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.06% (0.2068 => 0.2214, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 7.05% (0.3477 => 0.3722, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.01% (0.3282 => 0.3512, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.98% (0.5900 => 0.6312, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.97% (0.3845 => 0.4113, std.dev.: 0.0026) MultiSource/Applications/siod/siod: 6.93% (0.6634 => 0.7094, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.91% (0.1549 => 0.1656, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.87% (0.2866 => 0.3063, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 6.86% (0.2566 => 0.2742, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.85% (0.4146 => 0.4430, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/09-vor/vor: 6.84% (0.1505 => 0.1608, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.83% (0.3690 => 0.3942, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 6.83% (2.1013 => 2.2448, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.81% (0.3890 => 0.4155, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.79% (0.3271 => 0.3493, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 6.75% (0.4251 => 0.4538, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 6.70% (0.4029 => 0.4299, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 6.69% (1.8794 => 2.0052, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.68% (4.4195 => 4.7148, std.dev.: 0.0119) MultiSource/Applications/lua/lua: 6.67% (1.4269 => 1.5221, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.63% (0.3981 => 0.4245, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.56% (0.6435 => 0.6857, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.50% (0.1968 => 0.2096, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.45% (0.3084 => 0.3283, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 6.43% (0.9697 => 1.0321, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.37% (0.2040 => 0.2170, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 6.31% (4.6177 => 4.9090, std.dev.: 0.0017) MultiSource/Applications/Burg/burg: 6.29% (0.5546 => 0.5895, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.28% (0.2737 => 0.2909, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 6.26% (0.5012 => 0.5326, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.26% (0.2969 => 0.3155, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.23% (0.4658 => 0.4948, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 6.10% (2.1653 => 2.2973, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.90% (0.2103 => 0.2227, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.73% (1.9694 => 2.0822, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.72% (1.9966 => 2.1109, std.dev.: 0.0053) MultiSource/Applications/minisat/minisat: 5.70% (0.3336 => 0.3526, std.dev.: 0.0021) MultiSource/Applications/treecc/treecc: 5.66% (0.7875 => 0.8321, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 5.64% (2.0346 => 2.1493, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/football/football: 5.54% (0.2075 => 0.2190, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.22% (0.7426 => 0.7814, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.83% (0.5361 => 0.5620, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 4.80% (0.3498 => 0.3666, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.76% (0.5584 => 0.5850, std.dev.: 0.0073) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.35% (11.6398 => 12.1464, std.dev.: 0.0149) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.35% (4.6926 => 4.8968, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.43% (0.4253 => 0.4399, std.dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: 2.91% (11.9555 => 12.3029, std.dev.: 0.0159) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.74% (0.3792 => 0.3896, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 6.50% (0.2122 => 0.2260, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.44% (3.3903 => 3.6088, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/objinst: 5.10% (12.0509 => 12.6657, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1657, std.dev.: 0.0861) SingleSource/Benchmarks/Misc/flops-2: 4.47% (1.8057 => 1.8865, std.dev.: 0.0057) SingleSource/Benchmarks/Dhrystone/dry: 4.13% (14.0481 => 14.6283, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2065, std.dev.: 0.0021) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5021, std.dev.: 0.0138) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.63% (3.1722 => 3.2240, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2837, std.dev.: 0.0039) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5141, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5869, std.dev.: 0.0097) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.83% (25.4195 => 16.5659, std.dev.: 0.0144) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9775, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8045, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary2: -7.37% (0.2402 => 0.2225, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9583, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -3.75% (11.2080 => 10.7874, std.dev.: 0.0170) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7733, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8639, std.dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/fldry: -2.17% (17.2379 => 16.8639, std.dev.: 0.0226) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5787, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4960, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.08% (105.3826 => 104.2427, std.dev.: 0.0196) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0457, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 8 16:11:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 8 Oct 2012 18:11:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121008231151.05D4B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4714?compare_to=4711&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4714, Order: 165429, Start Time: 2012-10-08 21:59:11, End Time: 2012-10-08 23:13:38 To: 4711, Order: 165419, Start Time: 2012-10-08 20:15:40, End Time: 2012-10-08 21:30:14 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (182 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1042 (754 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 22.69% (2.0176 => 2.4753, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.59% (0.1410 => 0.1658, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: 15.86% (0.0826 => 0.0957, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 14.98% (0.2243 => 0.2579, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 13.29% (0.5818 => 0.6591, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 13.08% (0.5748 => 0.6500, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.71% (0.0834 => 0.0940, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.58% (0.0819 => 0.0922, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 12.57% (0.4328 => 0.4872, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 12.54% (0.1013 => 0.1140, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.41% (0.1072 => 0.1205, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 12.36% (0.7061 => 0.7934, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.24% (0.1413 => 0.1586, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 12.21% (1.3693 => 1.5365, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sumcol: 12.11% (0.2782 => 0.3119, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 11.94% (0.2781 => 0.3113, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 11.84% (0.4062 => 0.4543, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.66% (3.9660 => 4.4286, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.61% (0.2721 => 0.3037, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.53% (0.1327 => 0.1480, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.51% (0.3485 => 0.3886, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 11.47% (0.2607 => 0.2906, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.46% (0.1588 => 0.1770, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 11.45% (0.2690 => 0.2998, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.41% (0.3899 => 0.4344, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 11.38% (0.7038 => 0.7839, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 11.38% (0.2628 => 0.2927, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.37% (0.2655 => 0.2957, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 11.37% (0.2937 => 0.3271, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.35% (0.3022 => 0.3365, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.31% (0.0964 => 0.1073, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.29% (0.2596 => 0.2889, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 11.26% (0.2726 => 0.3033, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 11.16% (0.2760 => 0.3068, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.11% (0.4016 => 0.4462, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 11.09% (1.9828 => 2.2027, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.09% (0.7710 => 0.8565, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.05% (0.6283 => 0.6977, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.03% (1.2193 => 1.3538, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.99% (0.2765 => 0.3069, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 10.99% (0.3293 => 0.3655, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 10.99% (0.3149 => 0.3495, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 10.98% (0.3107 => 0.3448, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.96% (0.2966 => 0.3291, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.94% (0.3756 => 0.4167, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 10.94% (0.2761 => 0.3063, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.89% (0.3489 => 0.3869, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.87% (0.2696 => 0.2989, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.86% (0.5265 => 0.5837, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.84% (1.4563 => 1.6141, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.82% (0.9199 => 1.0194, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sieve: 10.74% (0.3453 => 0.3824, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 10.73% (0.3868 => 0.4283, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.73% (0.3580 => 0.3964, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 10.69% (13.8202 => 15.2971, std.dev.: 0.0096) MultiSource/Applications/aha/aha: 10.64% (0.1062 => 0.1175, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 10.53% (0.3192 => 0.3528, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.52% (1.1364 => 1.2559, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists1: 10.47% (0.3534 => 0.3904, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.46% (0.6959 => 0.7687, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 10.44% (0.2988 => 0.3300, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.18% (0.4390 => 0.4837, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: 10.07% (0.1003 => 0.1104, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.05% (0.1075 => 0.1183, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.94% (0.1157 => 0.1272, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.77% (0.1986 => 0.2180, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.77% (0.4791 => 0.5259, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/objinst: 9.75% (0.2945 => 0.3232, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.68% (0.5577 => 0.6117, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.68% (0.3130 => 0.3433, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 9.65% (1.0313 => 1.1308, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 9.57% (16.6129 => 18.2021, std.dev.: 0.0151) MultiSource/Applications/sgefa/sgefa: 9.52% (0.2995 => 0.3280, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.48% (0.4379 => 0.4794, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.46% (0.7460 => 0.8166, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.45% (0.3755 => 0.4110, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 9.38% (0.1589 => 0.1738, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.36% (0.2127 => 0.2326, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.32% (0.8698 => 0.9509, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.30% (0.3246 => 0.3548, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.27% (0.2914 => 0.3184, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 9.24% (1.1061 => 1.2083, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.17% (0.1276 => 0.1393, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 9.05% (0.6744 => 0.7354, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.01% (0.5637 => 0.6145, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.95% (0.1865 => 0.2032, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 8.94% (0.3220 => 0.3508, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.92% (0.1435 => 0.1563, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.90% (7.2180 => 7.8605, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/football/football: 8.86% (0.8310 => 0.9046, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 8.83% (0.7506 => 0.8169, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 8.82% (3.8646 => 4.2053, std.dev.: 0.0095) SingleSource/UnitTests/ObjC/parameter-passing: 8.77% (0.4003 => 0.4354, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.75% (0.2023 => 0.2200, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 8.69% (0.3578 => 0.3889, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 8.66% (3.1889 => 3.4652, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/exceptions-4: 8.64% (0.3646 => 0.3961, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.64% (0.6576 => 0.7144, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.60% (0.3650 => 0.3964, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.58% (0.3914 => 0.4250, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.58% (0.3601 => 0.3910, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 8.57% (1.9270 => 2.0922, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/for-in: 8.55% (0.3789 => 0.4113, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 8.53% (0.1478 => 0.1604, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.49% (0.3663 => 0.3974, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.45% (0.3940 => 0.4273, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.42% (0.3623 => 0.3928, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 8.41% (0.2925 => 0.3171, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 8.38% (2.1791 => 2.3617, std.dev.: 0.0058) MultiSource/Benchmarks/nbench/nbench: 8.37% (1.0594 => 1.1481, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.09% (0.1569 => 0.1696, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.09% (3.6692 => 3.9660, std.dev.: 0.0113) MultiSource/Benchmarks/sim/sim: 8.05% (0.3131 => 0.3383, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 7.98% (4.6629 => 5.0352, std.dev.: 0.0156) MultiSource/Benchmarks/Olden/em3d/em3d: 7.97% (0.1657 => 0.1789, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 7.95% (14.8535 => 16.0349, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.94% (0.1789 => 0.1931, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 7.91% (1.2749 => 1.3758, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.88% (0.8818 => 0.9513, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.86% (1.3245 => 1.4286, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.85% (4.3801 => 4.7239, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.84% (4.4433 => 4.7917, std.dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 7.83% (1.2292 => 1.3254, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.80% (0.3511 => 0.3785, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 7.77% (8.4961 => 9.1559, std.dev.: 0.0110) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.71% (0.2140 => 0.2305, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.66% (0.6135 => 0.6605, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 7.49% (0.6250 => 0.6718, std.dev.: 0.0140) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.45% (4.9865 => 5.3579, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 7.42% (0.4113 => 0.4418, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.09% (0.1819 => 0.1948, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.85% (1.1333 => 1.2109, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.83% (0.4805 => 0.5133, std.dev.: 0.0081) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.81% (0.9108 => 0.9728, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.79% (0.2504 => 0.2674, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.69% (0.3245 => 0.3462, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 6.64% (6.5754 => 7.0123, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.64% (6.2785 => 6.6953, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.63% (1.5188 => 1.6195, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.60% (3.2742 => 3.4903, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 6.52% (0.2008 => 0.2139, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.29% (0.2321 => 0.2467, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 6.26% (3.7467 => 3.9813, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.76% (2.1007 => 2.2217, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.58% (13.2842 => 14.0251, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.46% (0.2243 => 0.2343, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 3.69% (16.2614 => 16.8614, std.dev.: 0.0062) MultiSource/Applications/ClamAV/clamscan: 3.61% (14.5298 => 15.0540, std.dev.: 0.0071) MultiSource/Benchmarks/Bullet/bullet: 1.50% (33.2944 => 33.7928, std.dev.: 0.0143) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5187, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.83% (1.8175 => 2.2688, std.dev.: 0.0165) SingleSource/Benchmarks/Misc/richards_benchmark: 11.08% (1.1560 => 1.2841, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 9.03% (0.8273 => 0.9020, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4142, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.32% (1.2998 => 1.3820, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626) SingleSource/Benchmarks/Misc/flops-5: 4.80% (1.9144 => 2.0062, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.49% (0.3139 => 0.3280, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7748, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6761, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.56% (10.7476 => 11.1299, std.dev.: 0.0336) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9851, std.dev.: 0.0014) SingleSource/Regression/C/uint64_to_float: 3.03% (0.5449 => 0.5614, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.12% (7.4271 => 7.5844, std.dev.: 0.0031) MultiSource/Applications/lemon/lemon: 1.59% (1.4298 => 1.4526, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5139, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1858, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.17% (5.5130 => 5.5777, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1413, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0271, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5874, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.38% (0.2670 => 0.1405, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -15.42% (0.0707 => 0.0598, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -14.79% (0.4657 => 0.3968, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.73% (1.3819 => 1.1922, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.70% (1.3813 => 1.1920, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.24% (22.5627 => 21.8316, std.dev.: 0.0095) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.74% (0.0997 => 0.0860, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.11% (0.2238 => 0.1967, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.90% (1.2308 => 1.0967, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.17% (20.3410 => 18.2727, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.43% (1.3780 => 1.3032, std.dev.: 0.0132) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5149, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8004, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1561, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.39% (1.7688 => 1.7089, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.26% (0.9996 => 0.9670, std.dev.: 0.0048) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.50% (26.5159 => 25.8521, std.dev.: 0.0076) MultiSource/Applications/spiff/spiff: -2.43% (3.0263 => 2.9527, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.30% (1.9762 => 1.9307, std.dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.97% (0.6589 => 0.6459, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7152, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -1.74% (6.3560 => 6.2452, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.56% (0.6615 => 0.6512, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0060, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: -1.26% (4.5928 => 4.5349, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4953, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: -1.13% (9.3358 => 9.2305, std.dev.: 0.0390) MultiSource/Applications/lambda-0_1_3/lambda: -1.08% (5.3167 => 5.2592, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/heapsort: -1.07% (3.9173 => 3.8753, std.dev.: 0.0156) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 8 16:30:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 8 Oct 2012 18:30:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121008233044.E7A102A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4715?compare_to=4712&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4715, Order: 165430, Start Time: 2012-10-08 22:13:19, End Time: 2012-10-08 23:32:31 To: 4712, Order: 165419, Start Time: 2012-10-08 20:24:49, End Time: 2012-10-08 21:44:14 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 3 (156 on baseline) Performance Improvements: 2 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1020 (761 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.04% (2.5367 => 2.5630, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.36% (54.6291 => 56.4635, std.dev.: 0.0568) SingleSource/Benchmarks/Misc/lowercase: 1.19% (7.9604 => 8.0551, std.dev.: 0.0062) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -14.59% (0.4662 => 0.3982, std.dev.: 0.0196) MultiSource/Benchmarks/PAQ8p/paq8p: -2.17% (15.8595 => 15.5148, std.dev.: 0.0083) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.14% (0.5885 => 0.5877, std.dev.: 0.0069) MultiSource/Applications/SPASS/SPASS: 0.04% (16.2059 => 16.2119, std.dev.: 0.0089) MultiSource/Benchmarks/Bullet/bullet: 0.41% (54.8192 => 55.0437, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/gs/gs: 0.02% (4.3749 => 4.3758, std.dev.: 0.0098) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.10% (1.2466 => 1.2478, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.10% (7.7540 => 7.7614, std.dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.12% (0.7380 => 0.7389, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.55% (0.0364 => 0.0362, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1433 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.14% (0.2142 => 0.2145, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -12.97% (63.2438 => 55.0437, std.dev.: 0.0057) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.36% (14.1553 => 18.7366, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: 60.87% (3.4629 => 5.5709, std.dev.: 0.0064) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14223.19% (0.0720 => 10.3127, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952000.00% (0.0001 => 9.9521, std.dev.: 0.0015) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 51.21% (0.2554 => 0.3862, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 49.65% (10.3673 => 15.5148, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/richards_benchmark: 33.29% (0.1622 => 0.2162, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/distray/distray: 30.97% (0.1056 => 0.1383, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.38% (2.2022 => 2.5630, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.76% (7.0540 => 8.1657, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/flops: 15.57% (0.1432 => 0.1655, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.24% (0.1566 => 0.1789, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.07% (0.0834 => 0.0943, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.86% (1.7609 => 1.9873, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.06% (0.0871 => 0.0976, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/oourafft: 11.64% (0.3282 => 0.3664, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.98% (0.1584 => 0.1758, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.70% (0.3543 => 0.3922, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 10.51% (0.3473 => 0.3838, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.41% (0.3497 => 0.3861, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 10.27% (0.3516 => 0.3877, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.25% (0.3561 => 0.3926, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.25% (0.3543 => 0.3906, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.08% (0.3927 => 0.4323, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 10.07% (0.1440 => 0.1585, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 9.99% (0.3694 => 0.4063, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.95% (0.3828 => 0.4209, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.80% (0.3886 => 0.4267, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.67% (0.4879 => 0.5351, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.53% (0.1438 => 0.1575, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.26% (0.6675 => 0.7293, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.22% (0.3177 => 0.3470, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 9.21% (5.7591 => 6.2893, std.dev.: 0.0081) MultiSource/Benchmarks/mafft/pairlocalalign: 9.19% (9.4845 => 10.3562, std.dev.: 0.0060) MultiSource/Applications/minisat/minisat: 9.09% (0.7115 => 0.7762, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 9.06% (0.1655 => 0.1805, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 8.96% (0.7433 => 0.8099, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 8.89% (10.4361 => 11.3635, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.77% (1.5415 => 1.6767, std.dev.: 0.0039) MultiSource/Applications/sgefa/sgefa: 8.75% (0.3109 => 0.3381, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.62% (0.5925 => 0.6436, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.52% (0.4615 => 0.5008, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 8.42% (0.6030 => 0.6538, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.31% (0.5105 => 0.5529, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 8.26% (0.1695 => 0.1835, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 8.21% (0.3423 => 0.3704, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 8.18% (3.3354 => 3.6084, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.18% (1.3050 => 1.4117, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.12% (0.1625 => 0.1757, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.97% (0.2271 => 0.2452, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.88% (0.1510 => 0.1629, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.86% (0.8067 => 0.8701, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.86% (4.2646 => 4.5997, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.85% (0.2700 => 0.2912, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.83% (0.5860 => 0.6319, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 7.81% (0.6456 => 0.6960, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.79% (0.7326 => 0.7897, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.78% (0.1337 => 0.1441, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.75% (0.2065 => 0.2225, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 7.72% (1.5603 => 1.6808, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.71% (5.0018 => 5.3875, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.70% (0.5569 => 0.5998, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.70% (0.4103 => 0.4419, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.66% (4.9449 => 5.3239, std.dev.: 0.0082) MultiSource/Benchmarks/sim/sim: 7.65% (0.3387 => 0.3646, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 7.63% (0.3422 => 0.3683, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.63% (0.3121 => 0.3359, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.59% (0.2107 => 0.2267, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.59% (0.3307 => 0.3558, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.58% (8.1363 => 8.7532, std.dev.: 0.0059) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.57% (0.8172 => 0.8791, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hash: 7.53% (0.4289 => 0.4612, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.48% (0.9765 => 1.0495, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.45% (0.5020 => 0.5394, std.dev.: 0.0030) SingleSource/Regression/C++/ofstream_ctor: 7.40% (0.2905 => 0.3120, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.38% (0.4203 => 0.4513, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.29% (0.2758 => 0.2959, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 7.26% (0.7835 => 0.8404, std.dev.: 0.0021) MultiSource/Applications/Burg/burg: 7.25% (1.1642 => 1.2486, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.17% (0.3865 => 0.4142, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 7.16% (0.4620 => 0.4951, std.dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.15% (7.9617 => 8.5312, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.11% (0.1940 => 0.2078, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.10% (0.3650 => 0.3909, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 7.03% (0.2831 => 0.3030, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 7.02% (0.3232 => 0.3459, std.dev.: 0.0072) MultiSource/Applications/lua/lua: 7.01% (3.8723 => 4.1439, std.dev.: 0.0086) MultiSource/Applications/viterbi/viterbi: 7.01% (0.1555 => 0.1664, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 6.99% (0.4048 => 0.4331, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.99% (0.2891 => 0.3093, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 6.96% (1.0722 => 1.1468, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 6.89% (0.3684 => 0.3938, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.89% (0.3136 => 0.3352, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.86% (0.3603 => 0.3850, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.85% (0.3283 => 0.3508, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.83% (2.0665 => 2.2077, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.82% (0.4636 => 0.4952, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 6.78% (2.0273 => 2.1648, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 6.75% (0.3098 => 0.3307, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.74% (0.3162 => 0.3375, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 6.72% (0.2871 => 0.3064, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.69% (0.3826 => 0.4082, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.69% (0.2872 => 0.3064, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.68% (0.2756 => 0.2940, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 6.62% (0.3052 => 0.3254, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.61% (0.2725 => 0.2905, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.58% (1.1861 => 1.2642, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.57% (0.2603 => 0.2774, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 6.56% (21.9371 => 23.3770, std.dev.: 0.0180) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.54% (0.3441 => 0.3666, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.44% (1.5859 => 1.6881, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 6.43% (0.2877 => 0.3062, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.34% (0.1892 => 0.2012, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 6.34% (0.2714 => 0.2886, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.34% (0.2793 => 0.2970, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 6.28% (0.2802 => 0.2978, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 6.28% (0.8921 => 0.9481, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 6.23% (2.2969 => 2.4399, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 6.19% (0.4299 => 0.4565, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 6.19% (0.3379 => 0.3588, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.16% (0.6450 => 0.6847, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 6.10% (0.3180 => 0.3374, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.02% (0.5981 => 0.6341, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.62% (2.2024 => 2.3262, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 5.50% (1.1840 => 1.2491, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.49% (0.4064 => 0.4287, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.40% (0.1906 => 0.2009, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.34% (1.4186 => 1.4944, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.21% (0.2266 => 0.2384, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.89% (0.3131 => 0.3284, std.dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: 4.79% (1.2842 => 1.3457, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.46% (0.8101 => 0.8462, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.67% (14.3668 => 14.8944, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.38% (0.3427 => 0.3543, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 3.35% (17.1811 => 17.7562, std.dev.: 0.0115) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.13% (1.1194 => 1.1544, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.08% (3.8922 => 4.0121, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.72% (0.3817 => 0.3921, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8964, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.85% (1.1396 => 1.2519, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4500, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3681, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.60% (3.6395 => 3.7707, std.dev.: 0.0026) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.72% (4.2280 => 4.3432, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7651, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.58% (0.8275 => 0.8406, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8129, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.38% (0.9540 => 0.9672, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.29% (2.6546 => 2.6888, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.06% (6.5088 => 6.5775, std.dev.: 0.0071) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.06% (6.6874 => 0.1299, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.01% (0.8651 => 0.1729, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.90% (5.2763 => 3.2765, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.82% (5.3855 => 3.6719, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.48% (5.3526 => 3.6678, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -14.38% (54.1659 => 46.3790, std.dev.: 0.0383) MultiSource/Benchmarks/FreeBench/mason/mason: -12.95% (0.0811 => 0.0706, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -11.04% (22.1758 => 19.7265, std.dev.: 0.0354) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.26% (2.9384 => 2.6369, std.dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7652, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.98% (1.6925 => 1.4221, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.63% (0.0998 => 0.0862, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.43% (1.2373 => 1.0959, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel-2: -10.45% (1.5373 => 1.3767, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/mason/mason: -10.04% (0.2161 => 0.1944, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.32% (19.9488 => 18.2899, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4787) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.59% (1.8329 => 1.7121, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.62% (2.7294 => 2.5759, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.31% (1.6805 => 1.5912, std.dev.: 0.0044) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.85% (1.5835 => 1.5067, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.34% (0.9957 => 0.9525, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.69% (3.2827 => 3.1617, std.dev.: 0.0079) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5049, std.dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: -3.03% (12.4730 => 12.0955, std.dev.: 0.0021) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.89% (8.6802 => 8.5160, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/salsa20: -1.88% (10.2830 => 10.0893, std.dev.: 0.0246) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.74% (8.1563 => 8.0143, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6801, std.dev.: 0.0018) SingleSource/UnitTests/Vector/multiplies: -1.65% (2.5528 => 2.5107, std.dev.: 0.0021) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4209, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/lists: -1.15% (6.2999 => 6.2272, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8582, std.dev.: 0.0060) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.39% (0.5229 => 0.5877, std.dev.: 0.0069) MultiSource/Applications/SPASS/SPASS: 8.16% (14.9895 => 16.2119, std.dev.: 0.0089) MultiSource/Benchmarks/MallocBench/gs/gs: 6.45% (4.1105 => 4.3758, std.dev.: 0.0098) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.94% (1.1048 => 1.2478, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.43% (7.1582 => 7.7614, std.dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.76% (0.6222 => 0.7389, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36100.00% (0.0001 => 0.0362, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.37% (0.2116 => 0.2145, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 8 17:57:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 8 Oct 2012 19:57:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121009005731.480832A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4716?compare_to=4714&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4716, Order: 165455, Start Time: 2012-10-08 23:44:48, End Time: 2012-10-09 00:59:18 To: 4714, Order: 165429, Start Time: 2012-10-08 21:59:11, End Time: 2012-10-08 23:13:38 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (183 on baseline) Performance Improvements: 5 (40 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1037 (753 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/Hello: -1.66% (0.6500 => 0.6392, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -1.55% (0.6591 => 0.6489, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -1.39% (0.7934 => 0.7824, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.35% (2.2027 => 2.1729, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: -1.02% (1.3254 => 1.3119, std.dev.: 0.0011) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 22.56% (2.0176 => 2.4727, std.dev.: 0.0069) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.59% (0.1410 => 0.1658, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 16.46% (0.0826 => 0.0962) MultiSource/Benchmarks/McCat/08-main/main: 14.98% (0.2243 => 0.2579, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.16% (0.0819 => 0.0935, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.59% (0.0834 => 0.0939) MultiSource/Benchmarks/Olden/tsp/tsp: 12.54% (0.1013 => 0.1140, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.31% (0.1413 => 0.1587, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.22% (0.1072 => 0.1203, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 11.75% (1.3693 => 1.5302, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.64% (3.9660 => 4.4278, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference-object: 11.53% (0.5818 => 0.6489, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.51% (0.0964 => 0.1075, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 11.39% (0.4328 => 0.4821, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 11.37% (0.4062 => 0.4524, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.36% (1.4563 => 1.6217, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.36% (0.2721 => 0.3030, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.34% (0.1588 => 0.1768, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 11.32% (0.7038 => 0.7835, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.30% (0.1327 => 0.1477, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 11.20% (0.5748 => 0.6392, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.18% (0.7710 => 0.8572, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.09% (0.2596 => 0.2884, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.01% (1.2193 => 1.3536, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.98% (0.9199 => 1.0209, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.88% (0.5265 => 0.5838, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/property-reference: 10.81% (0.7061 => 0.7824, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.76% (0.3485 => 0.3860, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.73% (0.6959 => 0.7706, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.65% (0.6283 => 0.6952, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 10.64% (0.1062 => 0.1175) MultiSource/Applications/SPASS/SPASS: 10.47% (13.8202 => 15.2671, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.43% (1.1364 => 1.2549, std.dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: 10.39% (0.2781 => 0.3070, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.28% (0.2782 => 0.3068, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.21% (0.3899 => 0.4297, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.05% (0.1075 => 0.1183, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.00% (0.3489 => 0.3838, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.98% (0.4379 => 0.4816, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.96% (0.3022 => 0.3323, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.94% (0.4016 => 0.4415, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.92% (0.1986 => 0.2183, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.90% (0.3130 => 0.3440, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.87% (0.2655 => 0.2917, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.85% (0.3756 => 0.4126, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.74% (0.5577 => 0.6120, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 9.71% (0.2761 => 0.3029, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 9.67% (0.2690 => 0.2950, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 9.66% (0.3293 => 0.3611, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 9.64% (0.2760 => 0.3026, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 9.63% (0.2607 => 0.2858, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.59% (1.9828 => 2.1729, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.58% (0.3580 => 0.3923, std.dev.: 0.0084) MultiSource/Applications/lemon/lemon: 9.58% (1.0313 => 1.1301, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 9.55% (0.2628 => 0.2879, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.54% (0.2966 => 0.3249, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 9.54% (0.2726 => 0.2986, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.51% (0.1157 => 0.1267, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.48% (0.1276 => 0.1397, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.48% (0.2765 => 0.3027, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 9.47% (0.2937 => 0.3215, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.45% (0.4390 => 0.4805, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 9.44% (0.3453 => 0.3779, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 9.43% (0.3107 => 0.3400, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 9.42% (1.1061 => 1.2103, std.dev.: 0.0100) MultiSource/Applications/sgefa/sgefa: 9.42% (0.2995 => 0.3277, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.41% (0.4791 => 0.5242, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 9.41% (0.3868 => 0.4232, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.40% (0.2127 => 0.2327) SingleSource/Benchmarks/Shootout-C++/ary3: 9.40% (0.3149 => 0.3445, std.dev.: 0.0052) SingleSource/Benchmarks/McGill/chomp: 9.31% (0.1589 => 0.1737, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 9.30% (16.6129 => 18.1573, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/mst/mst: 9.27% (0.1111 => 0.1214, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.24% (0.5637 => 0.6158, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.21% (0.7460 => 0.8147, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.16% (0.2696 => 0.2943, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.15% (0.3246 => 0.3543, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.13% (0.2914 => 0.3180, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 9.08% (0.3534 => 0.3855, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 9.05% (0.3192 => 0.3481, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 9.04% (0.2988 => 0.3258, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.99% (0.1435 => 0.1564, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 8.94% (0.3220 => 0.3508, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 8.93% (0.6744 => 0.7346, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.86% (7.2180 => 7.8575, std.dev.: 0.0042) MultiSource/Applications/spiff/spiff: 8.85% (0.7506 => 0.8170, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/football/football: 8.81% (0.8310 => 0.9042, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.80% (0.2023 => 0.2201, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 8.77% (3.8646 => 4.2034, std.dev.: 0.0157) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.74% (0.1865 => 0.2028, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.70% (0.8698 => 0.9455, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 8.66% (1.9270 => 2.0938, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 8.59% (3.1889 => 3.4629, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/objinst: 8.59% (0.2945 => 0.3198, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 8.58% (1.0594 => 1.1503, std.dev.: 0.0043) MultiSource/Applications/siod/siod: 8.58% (2.1791 => 2.3660, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.47% (0.6576 => 0.7133, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 8.41% (0.2925 => 0.3171, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 8.25% (0.1478 => 0.1600, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 8.21% (0.1657 => 0.1793, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.07% (0.3755 => 0.4058, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.03% (3.6692 => 3.9639, std.dev.: 0.0107) MultiSource/Benchmarks/sim/sim: 8.02% (0.3131 => 0.3382, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.01% (1.3245 => 1.4306, std.dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 7.98% (4.6629 => 5.0352, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.84% (4.3801 => 4.7235, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.84% (0.1569 => 0.1692, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.83% (0.1789 => 0.1929, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.80% (0.8818 => 0.9506, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 7.79% (1.2749 => 1.3742, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 7.78% (14.8535 => 16.0093, std.dev.: 0.0136) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.71% (0.2140 => 0.2305, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.69% (0.3511 => 0.3781, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.64% (0.1819 => 0.1958, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.62% (4.4433 => 4.7820, std.dev.: 0.0084) SingleSource/UnitTests/ObjC/parameter-passing: 7.62% (0.4003 => 0.4308, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.56% (0.3914 => 0.4210, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 7.54% (8.4961 => 9.1368, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.50% (0.6135 => 0.6595, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/trivial-interface: 7.41% (0.3578 => 0.3843, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.34% (0.3940 => 0.4229, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.33% (4.9865 => 5.3520, std.dev.: 0.0122) SingleSource/UnitTests/ObjC/for-in: 7.31% (0.3789 => 0.4066, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.27% (0.3646 => 0.3911, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.26% (0.3650 => 0.3915, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-2: 7.25% (0.3601 => 0.3862, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.23% (0.3663 => 0.3928, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 7.20% (0.4113 => 0.4409, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.18% (0.3623 => 0.3883, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.98% (1.1333 => 1.2124, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.89% (1.5188 => 1.6234, std.dev.: 0.0191) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.84% (3.2742 => 3.4980, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 6.73% (1.2292 => 1.3119, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 6.70% (0.6250 => 0.6669, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.67% (0.2504 => 0.2671, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.64% (0.4805 => 0.5124, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.54% (0.9108 => 0.9704, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 6.36% (6.5754 => 6.9936, std.dev.: 0.0143) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.29% (0.2321 => 0.2467, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 6.18% (0.2008 => 0.2132, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 6.14% (3.7467 => 3.9769, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.13% (0.3245 => 0.3444, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.11% (6.2785 => 6.6620, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.80% (2.1007 => 2.2225, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.46% (13.2842 => 14.0098, std.dev.: 0.0201) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.55% (0.2243 => 0.2345, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 3.67% (16.2614 => 16.8577, std.dev.: 0.0191) MultiSource/Applications/ClamAV/clamscan: 3.53% (14.5298 => 15.0433, std.dev.: 0.0086) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5183, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.06% (1.0895 => 1.3625, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.32% (1.8175 => 2.2595, std.dev.: 0.0537) SingleSource/Benchmarks/Misc/richards_benchmark: 10.97% (1.1560 => 1.2828, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 9.02% (0.8273 => 0.9019, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 8.70% (0.1322 => 0.1437, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4146, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.22% (1.2998 => 1.3806, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.12% (0.2093 => 0.2221, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0049, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.67% (11.2619 => 11.6750, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 3.38% (1.9199 => 1.9848, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 3.14% (10.7476 => 11.0849, std.dev.: 0.0295) SingleSource/Regression/C/uint64_to_float: 2.97% (0.5449 => 0.5611, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.12% (7.4271 => 7.5847, std.dev.: 0.0092) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4529, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5147, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.44% (2.1753 => 2.2066, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.42% (1.9433 => 1.9708, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2126, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1879, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5779, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists: 1.10% (12.4560 => 12.5929, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0267, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.15% (0.2670 => 0.1411, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.68% (0.4657 => 0.3927, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -15.28% (0.0707 => 0.0599, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.76% (1.3813 => 1.1913, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.58% (1.3819 => 1.1942, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.43% (22.5627 => 21.7898, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.84% (0.0997 => 0.0859, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -12.15% (0.2238 => 0.1966, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.93% (1.2308 => 1.0963, std.dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.13% (20.3410 => 18.2809, std.dev.: 0.0247) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.10% (1.3780 => 1.2940, std.dev.: 0.0087) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.06% (2.6470 => 2.5131, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.54% (0.9996 => 0.9542, std.dev.: 0.0062) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0011) MultiSource/Applications/siod/siod: -3.50% (3.2729 => 3.1584, std.dev.: 0.0120) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.41% (1.7688 => 1.7085, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.31% (0.4867 => 0.4706, std.dev.: 0.0007) MultiSource/Applications/lua/lua: -2.63% (26.5159 => 25.8185, std.dev.: 0.0390) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4786) MultiSource/Applications/spiff/spiff: -2.40% (3.0263 => 2.9536, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.32% (1.9762 => 1.9303, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.93% (0.6589 => 0.6462, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7137, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/lists: -1.72% (6.3560 => 6.2468, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.56% (0.6615 => 0.6512) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0056, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -1.28% (4.5928 => 4.5341, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: -1.23% (9.3358 => 9.2213, std.dev.: 0.0306) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4949, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.19% (3.9173 => 3.8708, std.dev.: 0.0050) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2574, std.dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 8 18:18:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 8 Oct 2012 20:18:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121009011857.192DE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4717?compare_to=4715&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4717, Order: 165457, Start Time: 2012-10-09 00:01:35, End Time: 2012-10-09 01:20:43 To: 4715, Order: 165430, Start Time: 2012-10-08 22:13:19, End Time: 2012-10-08 23:32:31 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 3 (155 on baseline) Performance Improvements: 1 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1021 (762 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 3.18% (0.3862 => 0.3985, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 2.98% (11.3635 => 11.7020, std.dev.: 0.0142) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.59% (0.9525 => 0.9676, std.dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.91% (15.5148 => 14.9083, std.dev.: 0.0226) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.27% (0.5877 => 0.5893, std.dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 0.26% (16.2119 => 16.2548, std.dev.: 0.0083) MultiSource/Benchmarks/Bullet/bullet: -0.87% (55.0437 => 54.5626, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/gs/gs: 0.37% (4.3758 => 4.3918, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.11% (1.2478 => 1.2492, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.76% (7.7614 => 7.8202, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.50% (0.7389 => 0.7426, std.dev.: 0.0113) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -1.93% (0.0362 => 0.0355, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1432 => 0.1431) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.74% (0.2145 => 0.0649, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -13.73% (63.2438 => 54.5626, std.dev.: 0.0026) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.78% (14.1553 => 18.7949, std.dev.: 0.0227) SingleSource/Benchmarks/Misc-C++-EH/spirit: 62.12% (3.4629 => 5.6139, std.dev.: 0.0008) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14221.81% (0.0720 => 10.3117, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952100.00% (0.0001 => 9.9522, std.dev.: 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 56.03% (0.2554 => 0.3985, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 43.80% (10.3673 => 14.9083, std.dev.: 0.0226) SingleSource/Benchmarks/Misc/richards_benchmark: 34.40% (0.1622 => 0.2180, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 32.01% (0.1056 => 0.1394, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 16.34% (0.1432 => 0.1666, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 16.19% (7.0540 => 8.1960, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.07% (2.2022 => 2.5561, std.dev.: 0.0058) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.30% (0.1566 => 0.1790, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.79% (1.7609 => 1.9861, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.59% (0.0834 => 0.0939, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.28% (0.0871 => 0.0978, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 12.24% (0.3473 => 0.3898, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 12.13% (10.4361 => 11.7020, std.dev.: 0.0142) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.02% (0.3543 => 0.3969, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-4: 12.00% (0.3543 => 0.3968, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.86% (0.3516 => 0.3933, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.84% (0.3497 => 0.3911, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.79% (0.3561 => 0.3981, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 11.76% (0.3282 => 0.3668, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.61% (0.3694 => 0.4123, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.44% (0.3828 => 0.4266, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 11.41% (0.3927 => 0.4375, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.30% (0.3886 => 0.4325, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 11.18% (0.1440 => 0.1601, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.11% (0.1584 => 0.1760, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.13% (0.4879 => 0.5373, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.57% (0.3177 => 0.3481, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 9.54% (0.7115 => 0.7794, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 9.53% (9.4845 => 10.3885, std.dev.: 0.0115) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.53% (0.1438 => 0.1575) SingleSource/UnitTests/ObjC++/property-reference-object: 9.44% (0.6030 => 0.6599, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.39% (0.6675 => 0.7302, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.27% (0.5925 => 0.6474, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 9.13% (0.7433 => 0.8112, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 8.94% (0.1655 => 0.1803, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.94% (1.5415 => 1.6793, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.91% (0.4615 => 0.5026, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 8.86% (5.7591 => 6.2696, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 8.85% (0.1175 => 0.1279, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 8.82% (0.3423 => 0.3725, std.dev.: 0.0044) MultiSource/Applications/sgefa/sgefa: 8.81% (0.3109 => 0.3383, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 8.79% (0.1695 => 0.1844, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.72% (0.7326 => 0.7965, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.68% (0.1625 => 0.1766, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.44% (0.2700 => 0.2928, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.39% (1.3050 => 1.4145, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.38% (0.1337 => 0.1449, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 8.37% (3.3354 => 3.6145, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.37% (0.2271 => 0.2461, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.29% (0.3307 => 0.3581, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.28% (0.2065 => 0.2236, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.27% (0.5105 => 0.5527, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.26% (0.8172 => 0.8847, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.21% (0.1510 => 0.1634, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.21% (4.2646 => 4.6148, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.19% (0.5860 => 0.6340, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 8.18% (0.3422 => 0.3702, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 8.16% (0.6456 => 0.6983, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.08% (8.1363 => 8.7937, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.02% (0.2107 => 0.2276, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.01% (0.5569 => 0.6015, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.95% (0.8067 => 0.8708, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.93% (4.9449 => 5.3368, std.dev.: 0.0106) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.91% (0.3121 => 0.3368, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.90% (0.2758 => 0.2976, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.90% (5.0018 => 5.3971, std.dev.: 0.0065) MultiSource/Applications/hbd/hbd: 7.87% (1.5603 => 1.6831, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.85% (0.4203 => 0.4533, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 7.85% (0.2905 => 0.3133, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.85% (0.4103 => 0.4425, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.84% (0.3650 => 0.3936, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 7.83% (0.4289 => 0.4625, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.81% (0.3865 => 0.4167, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.81% (7.9617 => 8.5838, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.77% (0.9765 => 1.0524, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.77% (0.5020 => 0.5410, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 7.76% (0.3387 => 0.3650, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.73% (0.1940 => 0.2090, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 7.72% (0.1555 => 0.1675, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.70% (1.1642 => 1.2539, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 7.67% (0.2831 => 0.3048, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 7.65% (0.7835 => 0.8434, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 7.61% (0.4048 => 0.4356, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.58% (0.2891 => 0.3110, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 7.48% (3.8723 => 4.1618, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/hash2: 7.42% (0.4620 => 0.4963, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.40% (0.3136 => 0.3368, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.40% (0.3826 => 0.4109, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.39% (0.3232 => 0.3471, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 7.35% (0.3603 => 0.3868, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.28% (2.0665 => 2.2169, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 7.25% (0.3283 => 0.3521, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.24% (0.3162 => 0.3391, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/lists1: 7.22% (0.3684 => 0.3950, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.21% (0.2872 => 0.3079, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.16% (0.4636 => 0.4968, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 7.14% (0.3052 => 0.3270, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.14% (0.2871 => 0.3076, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 7.13% (0.3098 => 0.3319, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.11% (0.2756 => 0.2952, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 7.01% (0.2725 => 0.2916, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 7.00% (1.0722 => 1.1473, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 6.99% (0.2877 => 0.3078, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 6.95% (21.9371 => 23.4625, std.dev.: 0.0126) MultiSource/Applications/treecc/treecc: 6.94% (2.0273 => 2.1679, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.93% (1.5859 => 1.6958, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.92% (0.3441 => 0.3679, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 6.86% (0.3180 => 0.3398, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.85% (0.2714 => 0.2900, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/random: 6.82% (0.2802 => 0.2993, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 6.82% (0.4299 => 0.4592, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.75% (0.3379 => 0.3607, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.68% (1.1861 => 1.2653, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.61% (0.2603 => 0.2775, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.53% (0.6450 => 0.6871, std.dev.: 0.0042) MultiSource/Applications/siod/siod: 6.37% (2.2969 => 2.4431, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.30% (0.5981 => 0.6358, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 6.20% (0.8921 => 0.9474, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.13% (0.1892 => 0.2008, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.13% (0.4064 => 0.4313, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.93% (0.1906 => 0.2019, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.86% (2.2024 => 2.3315, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.57% (1.4186 => 1.4976, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 5.46% (1.1840 => 1.2486, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.30% (0.3131 => 0.3297, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.16% (0.2266 => 0.2383, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 5.12% (1.2842 => 1.3499, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.75% (0.8101 => 0.8486, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.17% (0.3817 => 0.3976, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.05% (14.3668 => 14.9493, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.59% (0.3427 => 0.3550, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 3.36% (17.1811 => 17.7580, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.02% (3.8922 => 4.0098, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.86% (1.1194 => 1.1514, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.38% (0.2944 => 0.3279, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652) SingleSource/Benchmarks/Misc/richards_benchmark: 9.78% (1.1396 => 1.2511, std.dev.: 0.0014) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.21% (3.1595 => 3.4506, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3684, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 3.66% (0.5413 => 0.5611, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.39% (3.6395 => 3.7630, std.dev.: 0.0062) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.92% (4.2280 => 4.3514, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.33% (1.7254 => 1.7656, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.55% (0.8275 => 0.8403, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8132, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.36% (0.9540 => 0.9670, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.10% (2.6546 => 2.6839, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.05% (6.6874 => 0.1303, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -79.96% (0.8651 => 0.1734, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.05% (5.2763 => 3.2685, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.72% (5.3855 => 3.6773, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.32% (5.3526 => 3.6759, std.dev.: 0.0026) SingleSource/UnitTests/Vector/constpool: -14.54% (54.1659 => 46.2887, std.dev.: 0.0204) MultiSource/Benchmarks/FreeBench/mason/mason: -12.70% (0.0811 => 0.0708) MultiSource/Applications/ClamAV/clamscan: -10.82% (22.1758 => 19.7770, std.dev.: 0.0149) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.55% (2.9384 => 2.6283, std.dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7653, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -16.09% (1.6925 => 1.4202, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.63% (0.0998 => 0.0862, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.32% (1.2373 => 1.0972, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/mandel-2: -10.39% (1.5373 => 1.3775, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/mason/mason: -10.00% (0.2161 => 0.1945, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.20% (19.9488 => 18.3128, std.dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4787, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.67% (1.8329 => 1.7107, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.34% (1.6805 => 1.5907, std.dev.: 0.0055) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.88% (1.5835 => 1.5063, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.74% (3.2827 => 3.1598, std.dev.: 0.0132) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.4991, std.dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: -3.02% (12.4730 => 12.0960, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.82% (0.9957 => 0.9676, std.dev.: 0.0035) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.05% (8.6802 => 8.5019, std.dev.: 0.0085) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.05% (8.1563 => 7.9894, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/salsa20: -1.73% (10.2830 => 10.1046, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6815, std.dev.: 0.0017) SingleSource/UnitTests/Vector/multiplies: -1.51% (2.5528 => 2.5142, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4209, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/lists: -1.05% (6.2999 => 6.2339, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8575, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.70% (0.5229 => 0.5893, std.dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 8.44% (14.9895 => 16.2548, std.dev.: 0.0083) MultiSource/Benchmarks/MallocBench/gs/gs: 6.84% (4.1105 => 4.3918, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.07% (1.1048 => 1.2492, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.25% (7.1582 => 7.8202, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.35% (0.6222 => 0.7426, std.dev.: 0.0113) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35400.00% (0.0001 => 0.0355, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 8 19:05:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 8 Oct 2012 21:05:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121009020553.A8E9D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4718?compare_to=4713&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4718, Order: 165440, Start Time: 2012-10-08 23:23:39, End Time: 2012-10-09 02:07:40 To: 4713, Order: 165419, Start Time: 2012-10-08 20:10:47, End Time: 2012-10-08 22:54:35 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (138 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 1042 (825 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.07% (0.3446 => 0.3862, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 12.03% (0.3442 => 0.3856, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 12.01% (0.3465 => 0.3881, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.93% (0.3488 => 0.3904, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 11.85% (0.3460 => 0.3870, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.84% (0.3496 => 0.3910, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 11.83% (1.5932 => 1.7817, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 11.79% (0.3469 => 0.3878, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.61% (0.3643 => 0.4066, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.53% (0.3650 => 0.4071, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.29% (0.1063 => 0.1183, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.22% (0.3724 => 0.4142, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 9.03% (0.1218 => 0.1328, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 9.02% (0.1619 => 0.1765, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.99% (0.5826 => 0.6350, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.88% (0.5889 => 0.6412, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.21% (0.4994 => 0.5404, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.18% (0.5000 => 0.5409, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.17% (1.6211 => 1.7536, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.15% (0.1620 => 0.1752, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 8.09% (5.5417 => 5.9899, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.00% (0.4361 => 0.4710, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.99% (1.3152 => 1.4203, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.97% (0.2875 => 0.3104, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.93% (0.2750 => 0.2968, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 7.92% (0.2714 => 0.2929, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.88% (0.7171 => 0.7736, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.84% (0.2792 => 0.3011, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 7.82% (0.3004 => 0.3239, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.82% (0.2738 => 0.2952, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.79% (0.3195 => 0.3444, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.76% (3.5627 => 3.8392, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 7.74% (0.2725 => 0.2936, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 7.72% (0.3096 => 0.3335, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.71% (2.7292 => 2.9397, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 7.69% (0.2823 => 0.3040, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.66% (0.2911 => 0.3134, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/methcall: 7.64% (0.2813 => 0.3028, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.62% (0.2729 => 0.2937, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.60% (0.2014 => 0.2167, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 7.59% (0.2780 => 0.2991, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 7.58% (0.2811 => 0.3024, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 7.56% (0.2803 => 0.3015, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.52% (2.0673 => 2.2227, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 7.50% (0.9909 => 1.0652, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 7.43% (0.3726 => 0.4003, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.38% (0.3267 => 0.3508, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 7.32% (0.1421 => 0.1525, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists1: 7.31% (0.3477 => 0.3731, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 7.27% (0.3317 => 0.3558, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.25% (0.1462 => 0.1568, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.24% (0.3258 => 0.3494, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.22% (0.4139 => 0.4438, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.22% (0.3060 => 0.3281, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.20% (0.3930 => 0.4213, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 7.20% (0.4847 => 0.5196, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 7.20% (1.0781 => 1.1557, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/moments: 7.18% (0.3678 => 0.3942, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.17% (0.1549 => 0.1660, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.16% (0.5026 => 0.5386, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.14% (0.3362 => 0.3602, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.13% (0.2736 => 0.2931, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 7.11% (0.3348 => 0.3586, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 7.05% (23.5202 => 25.1787, std.dev.: 0.0176) MultiSource/Applications/ClamAV/clamscan: 7.04% (4.2109 => 4.5075, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/hash2: 7.03% (0.4251 => 0.4550, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 7.01% (0.2566 => 0.2746, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.99% (0.4146 => 0.4436, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.98% (0.3124 => 0.3342, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 6.98% (0.1505 => 0.1610, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.95% (0.3625 => 0.3877, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.95% (0.3282 => 0.3510, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.87% (0.2866 => 0.3063, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.86% (0.3690 => 0.3943, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.85% (0.5900 => 0.6304, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 6.75% (0.4029 => 0.4301, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 6.75% (1.8794 => 2.0062, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.63% (0.3845 => 0.4100, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.61% (0.3903 => 0.4161, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.56% (0.3981 => 0.4242, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 6.52% (2.1013 => 2.2382, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.48% (4.4195 => 4.7057, std.dev.: 0.0077) MultiSource/Applications/lua/lua: 6.47% (1.4269 => 1.5192, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.46% (0.6435 => 0.6851, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.45% (0.3890 => 0.4141, std.dev.: 0.0017) MultiSource/Applications/hbd/hbd: 6.42% (0.9697 => 1.0320, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 6.42% (0.5546 => 0.5902, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.40% (0.1968 => 0.2094, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 6.38% (0.6634 => 0.7057, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.32% (0.3084 => 0.3279, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.21% (0.2737 => 0.2907, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.19% (0.2068 => 0.2196, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 6.17% (4.6177 => 4.9024, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 6.17% (0.5012 => 0.5321, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.16% (0.2969 => 0.3152, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 6.15% (0.3336 => 0.3541, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.10% (0.4658 => 0.4942, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.08% (0.3271 => 0.3470, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 5.89% (2.1653 => 2.2928, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.85% (0.2103 => 0.2226, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 5.79% (0.7875 => 0.8331, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.77% (1.9694 => 2.0830, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.74% (0.2040 => 0.2157, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.64% (1.9966 => 2.1092, std.dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 5.39% (0.2691 => 0.2836, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 5.39% (2.0346 => 2.1442, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.28% (0.7426 => 0.7818, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.98% (0.5361 => 0.5628, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 4.98% (0.2391 => 0.2510, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.84% (0.5584 => 0.5854, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.43% (11.6398 => 12.1554, std.dev.: 0.0158) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.28% (4.6926 => 4.8934, std.dev.: 0.0087) MultiSource/Applications/lambda-0_1_3/lambda: 4.26% (0.3498 => 0.3647, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 2.92% (11.9555 => 12.3043, std.dev.: 0.0143) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.82% (0.4253 => 0.4373, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.69% (0.3792 => 0.3894, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.26% (0.2122 => 0.2276, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6108, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6771, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-2: 4.83% (1.8057 => 1.8930, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1649, std.dev.: 0.0125) SingleSource/Benchmarks/Dhrystone/dry: 4.10% (14.0481 => 14.6235, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1951, std.dev.: 0.0066) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5044, std.dev.: 0.0229) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.73% (3.1722 => 3.2270, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.45% (2.0820 => 2.1122, std.dev.: 0.0111) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.27% (7.1849 => 7.2762, std.dev.: 0.0069) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5134, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5978, std.dev.: 0.0138) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.71% (25.4195 => 16.5969, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/ary2: -7.95% (0.2402 => 0.2211, std.dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9780, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7979, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/tsp/tsp: -7.17% (2.1113 => 1.9599, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.60% (11.2080 => 10.8042, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std.dev.: 0.0045) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7723, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8637, std.dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/fldry: -2.23% (17.2379 => 16.8542, std.dev.: 0.0357) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5777, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4966, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (105.3826 => 104.1636, std.dev.: 0.0219) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0427, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 8 19:43:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 8 Oct 2012 21:43:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121009024356.245E32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4719?compare_to=4716&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4719, Order: 165469, Start Time: 2012-10-09 01:31:04, End Time: 2012-10-09 02:45:42 To: 4716, Order: 165455, Start Time: 2012-10-08 23:44:48, End Time: 2012-10-09 00:59:18 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 5 (183 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1037 (753 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/Hello: 1.60% (0.6392 => 0.6494, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 1.37% (0.7824 => 0.7931, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 1.01% (1.3119 => 1.3251, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.82% (54.3964 => 56.4754, std.dev.: 0.1820) SingleSource/Benchmarks/Misc/fbench: 1.08% (2.2595 => 2.2838, std.dev.: 0.0065) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.08% (2.0176 => 2.4832, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.01% (0.1410 => 0.1664, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 16.59% (0.0826 => 0.0963, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 15.20% (0.2243 => 0.2584, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.31% (0.0834 => 0.0945, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 13.10% (0.5818 => 0.6580, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 13.03% (0.1013 => 0.1145) SingleSource/UnitTests/ObjC++/Hello: 12.98% (0.5748 => 0.6494, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.67% (0.1413 => 0.1592, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.50% (0.1072 => 0.1206, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 12.38% (0.4328 => 0.4864, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 12.32% (0.7061 => 0.7931, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 12.31% (1.3693 => 1.5379, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.24% (0.2721 => 0.3054, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.15% (3.9660 => 4.4479, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.09% (0.1588 => 0.1780, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 11.87% (0.4062 => 0.4544, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.83% (0.1327 => 0.1484) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.75% (0.2596 => 0.2901, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.72% (0.0964 => 0.1077, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 11.69% (0.7038 => 0.7861, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.60% (1.4563 => 1.6253, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 11.58% (0.2781 => 0.3103, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.56% (0.3485 => 0.3888, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.56% (0.7710 => 0.8601, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.51% (0.5265 => 0.5871, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.43% (1.2193 => 1.3587, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.43% (0.2782 => 0.3100, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.34% (0.9199 => 1.0242, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.33% (0.6283 => 0.6995, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.31% (0.6959 => 0.7746, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.28% (0.3899 => 0.4339, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.09% (0.3022 => 0.3357, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 11.06% (13.8202 => 15.3491, std.dev.: 0.0119) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.00% (0.4390 => 0.4873, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 10.97% (0.2761 => 0.3064, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 10.96% (0.3868 => 0.4292, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 10.92% (0.1062 => 0.1178, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.92% (0.3756 => 0.4166, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 10.90% (0.3293 => 0.3652, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hello: 10.89% (0.2607 => 0.2891, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 10.89% (0.2690 => 0.2983, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.88% (0.4016 => 0.4453, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 10.83% (0.2760 => 0.3059, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 10.83% (0.2937 => 0.3255, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.81% (1.1364 => 1.2593, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.81% (0.2655 => 0.2942, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.81% (0.3489 => 0.3866, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 10.79% (0.2726 => 0.3020, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 10.77% (0.2628 => 0.2911, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.71% (1.9828 => 2.1951, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.71% (0.2765 => 0.3061, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.67% (0.3580 => 0.3962, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 10.57% (0.1003 => 0.1109, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 10.56% (0.3107 => 0.3435, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.55% (0.2966 => 0.3279, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 10.51% (0.3453 => 0.3816, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 10.48% (0.3149 => 0.3479, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.42% (0.2696 => 0.2977, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.42% (0.1075 => 0.1187, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 10.31% (1.0313 => 1.1376, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 10.31% (0.3192 => 0.3521, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 10.22% (0.3534 => 0.3895, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 10.14% (0.2988 => 0.3291, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.13% (0.3130 => 0.3447, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.11% (0.1157 => 0.1274, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.10% (0.5577 => 0.6140, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.08% (0.4791 => 0.5274, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.07% (0.1986 => 0.2186, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 10.02% (0.2995 => 0.3295, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 9.96% (16.6129 => 18.2674, std.dev.: 0.0179) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.96% (0.4379 => 0.4815, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 9.84% (1.1061 => 1.2149, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.83% (0.2127 => 0.2336, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.80% (0.1276 => 0.1401, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.75% (0.2914 => 0.3198, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 9.71% (0.6744 => 0.7399, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 9.69% (0.1589 => 0.1743, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.69% (0.1435 => 0.1574, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 9.61% (0.2945 => 0.3228, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.57% (0.8698 => 0.9530, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.52% (0.3246 => 0.3555, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 9.50% (0.3220 => 0.3526, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.47% (0.6576 => 0.7199, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/mst/mst: 9.45% (0.1111 => 0.1216, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.42% (0.7460 => 0.8163, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.40% (0.5637 => 0.6167, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 9.39% (0.7506 => 0.8211, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.36% (7.2180 => 7.8934, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/gs/gs: 9.32% (3.8646 => 4.2248, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/football/football: 9.29% (0.8310 => 0.9082, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.21% (0.3755 => 0.4101, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.19% (0.2023 => 0.2209, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.17% (0.3578 => 0.3906, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 9.15% (3.1889 => 3.4807, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/parameter-passing: 9.12% (0.4003 => 0.4368, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.09% (0.3511 => 0.3830, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.06% (0.1865 => 0.2034, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 9.04% (0.3914 => 0.4268, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 9.03% (1.9270 => 2.1011, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.01% (0.3650 => 0.3979, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 9.00% (0.3601 => 0.3925, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.00% (0.3646 => 0.3974, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 8.93% (0.1478 => 0.1610, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 8.93% (1.0594 => 1.1540, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.92% (0.3789 => 0.4127, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 8.88% (2.1791 => 2.3727, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/property: 8.88% (0.3940 => 0.4290, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.87% (0.3663 => 0.3988, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.86% (0.3623 => 0.3944, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 8.82% (0.2925 => 0.3183, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 8.69% (0.3131 => 0.3403, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 8.67% (1.2749 => 1.3854, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.60% (0.1569 => 0.1704, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.56% (3.6692 => 3.9834, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.47% (0.8818 => 0.9565, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.45% (4.3801 => 4.7503, std.dev.: 0.0087) MultiSource/Benchmarks/Olden/em3d/em3d: 8.45% (0.1657 => 0.1797, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 8.43% (14.8535 => 16.1057, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.40% (1.3245 => 1.4358, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.36% (0.2140 => 0.2319, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.32% (4.4433 => 4.8131, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.27% (0.1789 => 0.1937, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: 8.15% (8.4961 => 9.1887, std.dev.: 0.0104) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.13% (0.6135 => 0.6634, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 7.89% (4.6629 => 5.0310, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/05-eks/eks: 7.83% (0.4113 => 0.4435, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.82% (4.9865 => 5.3765, std.dev.: 0.0093) MultiSource/Applications/hexxagon/hexxagon: 7.80% (1.2292 => 1.3251, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/bigfib: 7.58% (0.6250 => 0.6724, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.48% (1.5188 => 1.6324, std.dev.: 0.0064) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.43% (0.2504 => 0.2690, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.39% (1.1333 => 1.2171, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.37% (0.4805 => 0.5159, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.35% (3.2742 => 3.5147, std.dev.: 0.0171) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.29% (0.9108 => 0.9772, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 7.05% (6.5754 => 7.0391, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1819 => 0.1946, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.93% (0.3245 => 0.3470, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 6.92% (0.2008 => 0.2147, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.81% (0.2321 => 0.2479, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.71% (6.2785 => 6.7000, std.dev.: 0.0155) MultiSource/Applications/lua/lua: 6.62% (3.7467 => 3.9946, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.40% (2.1007 => 2.2351, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.87% (13.2842 => 14.0638, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.95% (0.2243 => 0.2354, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 4.27% (16.2614 => 16.9564, std.dev.: 0.0063) MultiSource/Applications/ClamAV/clamscan: 4.17% (14.5298 => 15.1361, std.dev.: 0.0081) MultiSource/Benchmarks/Bullet/bullet: 1.45% (33.2944 => 33.7757, std.dev.: 0.0117) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5187, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/fbench: 25.66% (1.8175 => 2.2838, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.10% (1.0895 => 1.3630, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 11.24% (1.1560 => 1.2859, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 9.02% (0.8273 => 0.9019, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4138, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.18% (1.2998 => 1.3801, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0004, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0041, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6766, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 3.46% (1.9199 => 1.9864, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.32% (10.7476 => 11.1049, std.dev.: 0.0535) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613) SingleSource/Benchmarks/Misc/salsa20: 2.26% (7.4271 => 7.5951, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.67% (1.4298 => 1.4537, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5148, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.23% (1.9433 => 1.9672, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1859, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.15% (5.5130 => 5.5766, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1413, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 1.10% (12.4560 => 12.5925, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0267, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.78% (0.2670 => 0.1421, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -14.85% (0.0707 => 0.0602, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -14.47% (0.4657 => 0.3983, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.40% (1.3813 => 1.1962, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.33% (1.3819 => 1.1977, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.85% (22.5627 => 21.9196, std.dev.: 0.0190) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.33% (1.0460 => 0.8543, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.44% (0.0997 => 0.0863, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -12.02% (0.2238 => 0.1969, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -11.66% (1.2308 => 1.0873, std.dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.10% (20.3410 => 18.2856, std.dev.: 0.0250) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.34% (1.3780 => 1.2906, std.dev.: 0.0170) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0051) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.71% (0.9996 => 0.9625, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.45% (1.7688 => 1.7077, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.41% (3.2729 => 3.1613, std.dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.04% (0.4867 => 0.4719, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -2.56% (26.5159 => 25.8366, std.dev.: 0.0387) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.49% (3.0263 => 2.9510, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: -2.41% (1.9762 => 1.9286, std.dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.94% (0.6589 => 0.6461, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.91% (6.3560 => 6.2348, std.dev.: 0.0113) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7151, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0074, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -1.27% (4.5928 => 4.5346, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/heapsort: -1.24% (3.9173 => 3.8688, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4957, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2572, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: -1.12% (9.3358 => 9.2317, std.dev.: 0.0097) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 8 20:07:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 8 Oct 2012 22:07:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121009030708.B3B8E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4720?compare_to=4717&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4720, Order: 165470, Start Time: 2012-10-09 01:49:45, End Time: 2012-10-09 03:08:55 To: 4717, Order: 165457, Start Time: 2012-10-09 00:01:35, End Time: 2012-10-09 01:20:43 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (158 on baseline) Performance Improvements: 1 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1023 (759 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.64% (14.9083 => 15.4505, std.dev.: 0.0159) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.12% (0.9676 => 0.9568, std.dev.: 0.0041) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.42% (0.5893 => 0.5918, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 0.22% (16.2548 => 16.2911, std.dev.: 0.0173) MultiSource/Benchmarks/Bullet/bullet: -0.11% (54.5626 => 54.5006, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/gs/gs: 0.29% (4.3918 => 4.4044, std.dev.: 0.0092) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.40% (1.2492 => 1.2542, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.10% (7.8202 => 7.8122, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.01% (0.7426 => 0.7427, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 2.25% (0.0355 => 0.0363, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1431 => 0.1431, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0649 => 0.0648, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -13.82% (63.2438 => 54.5006, std.dev.: 0.0026) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 33.08% (14.1553 => 18.8372, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++-EH/spirit: 61.77% (3.4629 => 5.6021, std.dev.: 0.0155) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14219.17% (0.0720 => 10.3098, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9951700.00% (0.0001 => 9.9518, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 54.62% (0.2554 => 0.3949, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 49.03% (10.3673 => 15.4505, std.dev.: 0.0159) SingleSource/Benchmarks/Misc/richards_benchmark: 32.80% (0.1622 => 0.2154, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 32.20% (0.1056 => 0.1396, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.11% (7.0540 => 8.2606, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.63% (2.2022 => 2.5684, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 16.62% (0.1432 => 0.1670, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.88% (0.1566 => 0.1799, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.32% (0.3543 => 0.4015, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.04% (1.7609 => 1.9905, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 12.96% (10.4361 => 11.7884, std.dev.: 0.0079) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.86% (0.0871 => 0.0983, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 12.70% (0.3473 => 0.3914, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.58% (0.3497 => 0.3937, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.56% (0.3543 => 0.3988, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 12.47% (0.3561 => 0.4005, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 12.40% (0.3516 => 0.3952, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 12.16% (0.3282 => 0.3681, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.15% (0.3694 => 0.4143, std.dev.: 0.0083) SingleSource/UnitTests/ObjC/parameter-passing: 12.12% (0.3927 => 0.4403, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.04% (0.3828 => 0.4289, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.86% (0.3886 => 0.4347, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.62% (0.1584 => 0.1768, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 11.11% (0.1440 => 0.1600, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 10.27% (0.6030 => 0.6649, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 10.23% (0.5925 => 0.6531, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.21% (0.4879 => 0.5377, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.94% (0.1438 => 0.1581, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 9.92% (0.7115 => 0.7821, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 9.91% (9.4845 => 10.4240, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.69% (0.3177 => 0.3485, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.66% (0.6675 => 0.7320, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 9.38% (0.1695 => 0.1854, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.32% (1.5415 => 1.6851, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 9.31% (0.7433 => 0.8125, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 9.31% (0.1655 => 0.1809, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 9.23% (0.3423 => 0.3739, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 9.23% (0.3109 => 0.3396, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 9.23% (0.7326 => 0.8002, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.21% (0.4615 => 0.5040, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/tsp/tsp: 9.11% (0.1175 => 0.1282, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.05% (0.1625 => 0.1772, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.89% (0.2271 => 0.2473, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.87% (0.5105 => 0.5558, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 8.87% (5.7591 => 6.2697, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.86% (1.3050 => 1.4206, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 8.79% (3.3354 => 3.6286, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.72% (0.2065 => 0.2245, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.70% (0.2700 => 0.2935, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.66% (0.1236 => 0.1343, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.63% (4.2646 => 4.6325, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.48% (0.8172 => 0.8865, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.46% (0.5860 => 0.6356, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.45% (0.2107 => 0.2285, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.44% (0.5569 => 0.6039, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.41% (0.1510 => 0.1637, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.41% (0.3307 => 0.3585, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.39% (8.1363 => 8.8193, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.36% (5.0018 => 5.4202, std.dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.36% (0.3121 => 0.3382, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.35% (4.9449 => 5.3578, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/bigfib: 8.27% (0.6456 => 0.6990, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 8.27% (0.3387 => 0.3667, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.24% (0.8067 => 0.8732, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: 8.24% (0.3422 => 0.3704, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.23% (0.5020 => 0.5433, std.dev.: 0.0115) MultiSource/Applications/Burg/burg: 8.21% (1.1642 => 1.2598, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.20% (0.1940 => 0.2099, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.16% (0.2758 => 0.2983, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 8.11% (0.4289 => 0.4637, std.dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: 8.10% (0.1555 => 0.1681, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.07% (7.9617 => 8.6043, std.dev.: 0.0060) MultiSource/Applications/spiff/spiff: 8.04% (0.7835 => 0.8465, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.03% (0.9765 => 1.0549, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.00% (0.1337 => 0.1444, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.95% (0.4103 => 0.4429, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.95% (0.3650 => 0.3940, std.dev.: 0.0046) MultiSource/Applications/hbd/hbd: 7.94% (1.5603 => 1.6842, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 7.92% (3.8723 => 4.1789, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.90% (0.4203 => 0.4535, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.89% (0.3865 => 0.4170, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.88% (0.2905 => 0.3134, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 7.68% (0.4620 => 0.4975, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.68% (0.2891 => 0.3113, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 7.63% (0.4048 => 0.4357, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 7.56% (0.2831 => 0.3045, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 7.49% (0.3603 => 0.3873, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.48% (0.3826 => 0.4112, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 7.46% (0.3684 => 0.3959, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.46% (0.3136 => 0.3370, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 7.45% (1.0722 => 1.1521, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.43% (2.0665 => 2.2201, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.42% (0.2872 => 0.3085, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 7.41% (2.0273 => 2.1776, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 7.39% (0.3232 => 0.3471, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.37% (0.3162 => 0.3395, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 7.33% (0.3098 => 0.3325, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 7.31% (0.2871 => 0.3081, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 7.31% (0.3283 => 0.3523, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.27% (1.5859 => 1.7012, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.27% (0.4636 => 0.4973, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/fibo: 7.27% (0.2725 => 0.2923, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.21% (0.3052 => 0.3272, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.21% (0.3441 => 0.3689, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.15% (0.2756 => 0.2953, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 7.14% (0.3180 => 0.3407, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.14% (0.2802 => 0.3002, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 7.12% (0.4299 => 0.4605, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.06% (1.1861 => 1.2698, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 7.02% (0.2877 => 0.3079, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.00% (0.2714 => 0.2904, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.95% (0.2793 => 0.2987, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.92% (0.2603 => 0.2783, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 6.88% (21.9371 => 23.4455, std.dev.: 0.0105) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.84% (0.6450 => 0.6891, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.78% (0.3379 => 0.3608, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/football/football: 6.74% (0.8921 => 0.9522, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 6.69% (2.2969 => 2.4506, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.57% (0.5981 => 0.6374, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.40% (0.1906 => 0.2028, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.18% (2.2024 => 2.3386, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.15% (0.4064 => 0.4314, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.00% (1.4186 => 1.5037, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 5.92% (1.1840 => 1.2541, std.dev.: 0.0122) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.81% (0.1892 => 0.2002, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.52% (0.2266 => 0.2391, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 5.42% (1.2842 => 1.3538, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.37% (0.3131 => 0.3299, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.99% (0.8101 => 0.8505, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/ReedSolomon: 4.98% (0.2049 => 0.2151, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.69% (0.3817 => 0.3996, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.26% (14.3668 => 14.9783, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.85% (0.3427 => 0.3559, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 3.61% (17.1811 => 17.8020, std.dev.: 0.0255) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.51% (3.8922 => 4.0289, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.04% (1.1194 => 1.1534, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.25% (1.1145 => 1.3848, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.85% (1.1396 => 1.2518, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0021) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4499, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.1578 => 3.3687, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 3.68% (0.5413 => 0.5612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.50% (3.6395 => 3.7669, std.dev.: 0.0052) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.58% (4.2280 => 4.3369, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7652, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8128, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.37% (2.6546 => 2.6910, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5754, std.dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.05% (6.6874 => 0.1307, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -79.96% (0.8651 => 0.1734, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.05% (5.2763 => 3.2687, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.79% (5.3855 => 3.6734, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.34% (5.3526 => 3.6753, std.dev.: 0.0021) SingleSource/UnitTests/Vector/constpool: -14.60% (54.1659 => 46.2558, std.dev.: 0.0487) MultiSource/Benchmarks/FreeBench/mason/mason: -12.45% (0.0811 => 0.0710, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.72% (2.9384 => 2.6235, std.dev.: 0.0137) MultiSource/Applications/ClamAV/clamscan: -10.59% (22.1758 => 19.8271, std.dev.: 0.0108) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.44% (1.1492 => 0.7649, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: -15.93% (1.6925 => 1.4229, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.93% (0.0998 => 0.0859, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.45% (1.2373 => 1.0956, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -10.50% (1.5373 => 1.3759, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/mason/mason: -10.09% (0.2161 => 0.1943, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.35% (19.9488 => 18.2837, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.71% (1.8329 => 1.7099, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.28% (1.6805 => 1.5918, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: -5.15% (1.5835 => 1.5019, std.dev.: 0.0046) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.91% (0.9957 => 0.9568, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.70% (3.2827 => 3.1614, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5054, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: -2.99% (12.4730 => 12.1004, std.dev.: 0.0014) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.05% (8.6802 => 8.5019, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/salsa20: -2.01% (10.2830 => 10.0765, std.dev.: 0.0142) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.96% (8.1563 => 7.9961, std.dev.: 0.0187) SingleSource/UnitTests/Vector/multiplies: -1.82% (2.5528 => 2.5063, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6813, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4199, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.04% (6.2999 => 6.2341, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8596, std.dev.: 0.0058) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.18% (0.5229 => 0.5918, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 8.68% (14.9895 => 16.2911, std.dev.: 0.0173) MultiSource/Benchmarks/MallocBench/gs/gs: 7.15% (4.1105 => 4.4044, std.dev.: 0.0092) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.52% (1.1048 => 1.2542, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.14% (7.1582 => 7.8122, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.37% (0.6222 => 0.7427, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36200.00% (0.0001 => 0.0363, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 8 21:27:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 8 Oct 2012 23:27:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121009042743.303CE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4721?compare_to=4719&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4721, Order: 165476, Start Time: 2012-10-09 03:14:45, End Time: 2012-10-09 04:29:29 To: 4719, Order: 165469, Start Time: 2012-10-09 01:31:04, End Time: 2012-10-09 02:45:42 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (186 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1041 (751 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.61% (1.2906 => 1.3114, std.dev.: 0.0044) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.11% (2.0176 => 2.5041, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.09% (0.1410 => 0.1665, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 17.07% (0.0826 => 0.0967, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 15.51% (0.2243 => 0.2591, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.43% (0.0834 => 0.0946) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.15% (0.1072 => 0.1213, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.06% (0.0819 => 0.0926, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 13.03% (0.1013 => 0.1145, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.88% (0.1413 => 0.1595, std.dev.: 0.0041) SingleSource/UnitTests/ObjC++/property-reference-object: 12.68% (0.5818 => 0.6556, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 12.58% (0.5748 => 0.6471, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 12.57% (0.4328 => 0.4872, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 12.43% (1.3693 => 1.5395, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.30% (3.9660 => 4.4540, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/hash: 12.26% (0.4062 => 0.4560, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.20% (0.2721 => 0.3053, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 12.17% (0.7061 => 0.7920, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.06% (0.1327 => 0.1487, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 11.90% (0.2781 => 0.3112, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.85% (0.7710 => 0.8624, std.dev.: 0.0046) MultiSource/Applications/lambda-0_1_3/lambda: 11.85% (0.7038 => 0.7872, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.84% (0.1588 => 0.1776, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.83% (0.0964 => 0.1078, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.67% (0.2596 => 0.2899, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.57% (0.2782 => 0.3104, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.48% (0.3485 => 0.3885, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.43% (0.9199 => 1.0250, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.42% (1.4563 => 1.6226, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.38% (1.2193 => 1.3581, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.36% (0.3899 => 0.4342, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.35% (0.6283 => 0.6996, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.32% (0.3022 => 0.3364, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.27% (0.6959 => 0.7743, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.24% (0.5265 => 0.5857, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 11.23% (13.8202 => 15.3724, std.dev.: 0.0062) MultiSource/Applications/aha/aha: 11.21% (0.1062 => 0.1181, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 11.19% (0.2690 => 0.2991, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.08% (0.4016 => 0.4461, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 11.06% (0.2966 => 0.3294, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.00% (0.2655 => 0.2947, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 11.00% (0.2937 => 0.3260, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.00% (0.3756 => 0.4169, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 10.99% (0.3293 => 0.3655, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 10.97% (0.2761 => 0.3064, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 10.97% (0.2607 => 0.2893, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 10.96% (0.2628 => 0.2916, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 10.94% (0.2760 => 0.3062, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.94% (1.1364 => 1.2607, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.92% (0.3489 => 0.3870, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 10.90% (0.2726 => 0.3023, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.85% (0.2765 => 0.3065, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.84% (1.9828 => 2.1977, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.81% (0.3580 => 0.3967, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.79% (0.1075 => 0.1191, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 10.78% (0.3868 => 0.4285, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 10.73% (0.3149 => 0.3487, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 10.72% (0.3453 => 0.3823, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 10.69% (0.3107 => 0.3439, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 10.57% (0.1003 => 0.1109, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.55% (0.4390 => 0.4853, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.50% (0.2696 => 0.2979, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 10.49% (0.3192 => 0.3527, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.34% (0.0977 => 0.1078, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 10.33% (0.3534 => 0.3899, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 10.31% (0.2988 => 0.3296, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.29% (0.1157 => 0.1276, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.26% (0.3130 => 0.3451, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.21% (0.4791 => 0.5280, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 10.16% (1.0313 => 1.1361, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.12% (0.1986 => 0.2187, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.09% (0.4379 => 0.4821, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.06% (0.1014 => 0.1116, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 10.02% (16.6129 => 18.2772, std.dev.: 0.0160) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.95% (0.2914 => 0.3204, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 9.94% (1.1061 => 1.2160, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.93% (0.5577 => 0.6131, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.87% (0.2127 => 0.2337, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 9.85% (0.2945 => 0.3235, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.80% (0.1276 => 0.1401, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 9.78% (0.2995 => 0.3288, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 9.73% (0.6744 => 0.7400, std.dev.: 0.0083) SingleSource/Benchmarks/McGill/chomp: 9.69% (0.1589 => 0.1743, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.69% (0.1435 => 0.1574, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.63% (0.8698 => 0.9536, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.52% (0.3246 => 0.3555, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.51% (0.5637 => 0.6173, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.50% (0.7460 => 0.8169, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.49% (0.2140 => 0.2343, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 9.45% (0.1111 => 0.1216, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 9.44% (0.3220 => 0.3524, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.42% (7.2180 => 7.8980, std.dev.: 0.0075) MultiSource/Applications/spiff/spiff: 9.38% (0.7506 => 0.8210, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 9.34% (3.8646 => 4.2255, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.29% (0.3755 => 0.4104, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.24% (0.2023 => 0.2210, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.22% (0.1865 => 0.2037, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 9.18% (0.8310 => 0.9073, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 9.17% (3.1889 => 3.4812, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 9.12% (2.1791 => 2.3778, std.dev.: 0.0060) MultiSource/Applications/treecc/treecc: 9.10% (1.9270 => 2.1023, std.dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: 9.07% (0.1478 => 0.1612, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 9.06% (0.2925 => 0.3190, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 8.84% (0.3914 => 0.4260, std.dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 8.81% (1.0594 => 1.1527, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.80% (0.1569 => 0.1707, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.79% (0.4003 => 0.4355, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.72% (0.3578 => 0.3890, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.69% (0.3511 => 0.3816, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.66% (3.6692 => 3.9869, std.dev.: 0.0062) MultiSource/Benchmarks/sim/sim: 8.66% (0.3131 => 0.3402, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.65% (0.6576 => 0.7145, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 8.63% (0.1657 => 0.1800, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 8.61% (0.3623 => 0.3935, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/property: 8.60% (0.3940 => 0.4279, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.58% (0.3646 => 0.3959, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-2: 8.58% (0.3601 => 0.3910, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.55% (0.3650 => 0.3962, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 8.54% (0.3663 => 0.3976, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.52% (0.3789 => 0.4112, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.46% (1.3245 => 1.4366, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 8.41% (14.8535 => 16.1023, std.dev.: 0.0154) MultiSource/Applications/SIBsim4/SIBsim4: 8.37% (1.2749 => 1.3816, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.36% (0.8818 => 0.9555, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.33% (0.1789 => 0.1938, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.23% (4.3801 => 4.7407, std.dev.: 0.0099) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.21% (4.4433 => 4.8083, std.dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 8.16% (4.6629 => 5.0435, std.dev.: 0.0085) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.95% (0.6135 => 0.6623, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 7.95% (8.4961 => 9.1714, std.dev.: 0.0048) MultiSource/Applications/hexxagon/hexxagon: 7.92% (1.2292 => 1.3266, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.88% (4.9865 => 5.3795, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: 7.80% (0.4113 => 0.4434, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 7.66% (0.6250 => 0.6729, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.59% (0.1819 => 0.1957, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.39% (1.1333 => 1.2170, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.31% (1.5188 => 1.6299, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.28% (0.9108 => 0.9771, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.23% (0.2504 => 0.2685, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.23% (3.2742 => 3.5108, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.20% (0.4805 => 0.5151, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 7.04% (6.5754 => 7.0385, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.03% (0.3245 => 0.3473, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 7.02% (0.2008 => 0.2149, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.94% (0.2321 => 0.2482, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.67% (6.2785 => 6.6973, std.dev.: 0.0049) MultiSource/Applications/lua/lua: 6.66% (3.7467 => 3.9961, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.23% (2.1007 => 2.2316, std.dev.: 0.0191) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.05% (13.2842 => 14.0875, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.17% (0.2243 => 0.2359, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 4.10% (16.2614 => 16.9287, std.dev.: 0.0232) MultiSource/Applications/ClamAV/clamscan: 3.99% (14.5298 => 15.1093, std.dev.: 0.0135) MultiSource/Benchmarks/Bullet/bullet: 1.99% (33.2944 => 33.9566, std.dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5191, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.05% (1.0895 => 1.3624, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: 23.88% (1.8175 => 2.2516, std.dev.: 0.0240) SingleSource/Benchmarks/Misc/richards_benchmark: 11.12% (1.1560 => 1.2845, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.03% (0.8273 => 0.9020, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4146, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.29% (1.2998 => 1.3815, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0037, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7748, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.67% (11.2619 => 11.6757, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.41% (10.7476 => 11.1138, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/flops-6: 3.37% (1.9199 => 1.9846, std.dev.: 0.0011) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.14% (7.4271 => 7.5861, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.72% (1.4298 => 1.4544, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5130, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.43% (2.0200 => 2.0489, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2122, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1875, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9670, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/oourafft: 1.17% (5.5130 => 5.5777, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0274, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 1.07% (12.4560 => 12.5890, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.40% (0.2670 => 0.1431, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -14.85% (0.0707 => 0.0602, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -14.69% (0.4657 => 0.3973) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.32% (1.3819 => 1.1978, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.31% (1.3813 => 1.1974, std.dev.: 0.0082) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.58% (22.5627 => 21.9804, std.dev.: 0.0083) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.89% (0.2238 => 0.1972, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.43% (1.2308 => 1.0901, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.17% (20.3410 => 18.2727, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5138, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.83% (1.3780 => 1.3114, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.46% (0.9996 => 0.9550, std.dev.: 0.0092) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8005) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0010) MultiSource/Applications/siod/siod: -3.58% (3.2729 => 3.1558, std.dev.: 0.0137) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.40% (1.7688 => 1.7087, std.dev.: 0.0042) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.62% (26.5159 => 25.8206, std.dev.: 0.0208) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4786, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.40% (3.0263 => 2.9536, std.dev.: 0.0018) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.19% (1.9762 => 1.9329, std.dev.: 0.0088) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.99% (0.6589 => 0.6458, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.78% (28.2225 => 27.7189, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -1.65% (6.3560 => 6.2514, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0066, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8618, std.dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: -1.21% (4.5928 => 4.5372, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.16% (2.5254 => 2.4960, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.14% (5.3167 => 5.2562, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 8 21:55:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 8 Oct 2012 23:55:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121009045524.1994F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4722?compare_to=4720&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4722, Order: 165476, Start Time: 2012-10-09 03:37:57, End Time: 2012-10-09 04:57:11 To: 4720, Order: 165470, Start Time: 2012-10-09 01:49:45, End Time: 2012-10-09 03:08:55 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (154 on baseline) Performance Improvements: 2 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1023 (763 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -5.16% (0.4208 => 0.3991, std.dev.: 0.0042) MultiSource/Benchmarks/PAQ8p/paq8p: -1.60% (15.4505 => 15.2037, std.dev.: 0.0051) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.46% (0.5918 => 0.5891, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: -0.24% (16.2911 => 16.2525, std.dev.: 0.0056) MultiSource/Benchmarks/Bullet/bullet: -0.12% (54.5006 => 54.4365, std.dev.: 0.0070) MultiSource/Benchmarks/MallocBench/gs/gs: -0.52% (4.4044 => 4.3814, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.19% (1.2542 => 1.2518, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.01% (7.8122 => 7.8113, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.07% (0.7427 => 0.7422, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.83% (0.0363 => 0.0360, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: - (0.1431 => 0.1431, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0648 => 0.0648, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -13.93% (63.2438 => 54.4365, std.dev.: 0.0070) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.63% (14.1553 => 18.7741, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++-EH/spirit: 61.98% (3.4629 => 5.6092, std.dev.: 0.0023) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14219.72% (0.0720 => 10.3102, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9951900.00% (0.0001 => 9.9520, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 54.78% (0.2554 => 0.3953, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 46.65% (10.3673 => 15.2037, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/richards_benchmark: 36.93% (0.1622 => 0.2221, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/distray/distray: 31.63% (0.1056 => 0.1390, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 17.32% (0.1432 => 0.1680, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.12% (7.0540 => 8.2616, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.10% (2.2022 => 2.5787, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.50% (0.1566 => 0.1793, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.27% (1.7609 => 1.9946, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.19% (0.0834 => 0.0944, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.28% (0.0871 => 0.0978, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 12.28% (10.4361 => 11.7179, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: 12.22% (0.3282 => 0.3683, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 11.92% (0.3473 => 0.3887, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.86% (0.3516 => 0.3933, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.77% (0.3543 => 0.3960, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 11.72% (0.3497 => 0.3907, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.69% (0.3543 => 0.3957, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.63% (0.3561 => 0.3975, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.44% (0.3828 => 0.4266, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.34% (0.3694 => 0.4113, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.31% (0.3927 => 0.4371, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.25% (0.3886 => 0.4323, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 11.18% (0.1440 => 0.1601, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.05% (0.1584 => 0.1759, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.43% (0.4879 => 0.5388, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.29% (0.1438 => 0.1586, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.74% (0.5925 => 0.6502, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.69% (0.3177 => 0.3485, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.64% (0.6030 => 0.6611, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 9.57% (9.4845 => 10.3926, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.48% (0.6675 => 0.7308, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 9.47% (0.7115 => 0.7789, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 9.33% (5.7591 => 6.2966, std.dev.: 0.0059) SingleSource/Benchmarks/McGill/chomp: 9.00% (0.1655 => 0.1804, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 8.84% (0.7433 => 0.8090, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.78% (0.7326 => 0.7969, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 8.77% (0.1175 => 0.1278, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.71% (0.4615 => 0.5017, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.68% (1.5415 => 1.6753, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 8.68% (0.3423 => 0.3720, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 8.67% (0.1695 => 0.1842, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 8.62% (0.3109 => 0.3377, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.50% (0.3307 => 0.3588, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.45% (0.2271 => 0.2463, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.43% (0.1625 => 0.1762, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.43% (0.2065 => 0.2239, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.38% (0.5105 => 0.5533, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.34% (1.3050 => 1.4138, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.33% (0.2700 => 0.2925, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 8.27% (0.3422 => 0.3705, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 8.25% (3.3354 => 3.6107, std.dev.: 0.0207) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.25% (0.8172 => 0.8846, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 8.15% (1.5603 => 1.6874, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.14% (4.2646 => 4.6118, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++/bigfib: 8.05% (0.6456 => 0.6976, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.02% (0.5860 => 0.6330, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.95% (8.1363 => 8.7830, std.dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.95% (0.3121 => 0.3369, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.93% (0.8067 => 0.8707, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.93% (0.1337 => 0.1443, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.93% (4.9449 => 5.3369, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.93% (0.2107 => 0.2274, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.89% (5.0018 => 5.3964, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.88% (0.1510 => 0.1629, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 7.88% (0.4289 => 0.4627, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 7.85% (0.2905 => 0.3133, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.85% (0.4103 => 0.4425, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.84% (0.3650 => 0.3936, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.80% (0.4203 => 0.4531, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.79% (0.5569 => 0.6003, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.70% (0.9765 => 1.0517, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.66% (0.3865 => 0.4161, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 7.66% (0.7835 => 0.8435, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.65% (0.2758 => 0.2969, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 7.62% (0.3387 => 0.3645, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.61% (1.1642 => 1.2528, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 7.59% (0.1555 => 0.1673, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 7.58% (0.4048 => 0.4355, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.57% (0.5020 => 0.5400, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.56% (7.9617 => 8.5640, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.56% (0.3136 => 0.3373, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.54% (0.2891 => 0.3109, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 7.52% (0.2831 => 0.3044, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.47% (0.1940 => 0.2085, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.46% (0.4636 => 0.4982, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.43% (0.3232 => 0.3472, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 7.41% (0.3603 => 0.3870, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 7.41% (0.3684 => 0.3957, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.38% (2.0665 => 2.2191, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.38% (0.4620 => 0.4961, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 7.32% (3.8723 => 4.1559, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.29% (0.3826 => 0.4105, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 7.28% (0.3283 => 0.3522, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 7.27% (0.3052 => 0.3274, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 7.24% (0.2871 => 0.3079, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.21% (0.2872 => 0.3079, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 7.19% (0.2725 => 0.2921, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.18% (0.3162 => 0.3389, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.15% (0.2756 => 0.2953, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 7.13% (0.3098 => 0.3319, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.02% (0.2877 => 0.3079, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.95% (0.3441 => 0.3680, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 6.93% (0.2714 => 0.2902, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 6.91% (1.0722 => 1.1463, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.91% (0.2793 => 0.2986, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary2: 6.90% (0.3379 => 0.3612, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 6.87% (2.0273 => 2.1666, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 6.86% (21.9371 => 23.4417, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/random: 6.82% (0.2802 => 0.2993, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.77% (1.5859 => 1.6932, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 6.63% (0.4299 => 0.4584, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.60% (1.1861 => 1.2644, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.53% (0.2603 => 0.2773, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.50% (0.6450 => 0.6869, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/09-vor/vor: 6.48% (0.3180 => 0.3386, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.24% (0.1892 => 0.2010, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 6.20% (0.8921 => 0.9474, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.14% (0.5981 => 0.6348, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 6.11% (2.2969 => 2.4373, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.03% (0.4064 => 0.4309, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.80% (2.2024 => 2.3301, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.77% (0.1906 => 0.2016, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.65% (1.4186 => 1.4987, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 5.51% (1.1840 => 1.2492, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/objinst: 5.43% (0.3131 => 0.3301, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.25% (0.2266 => 0.2385, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 5.20% (1.2842 => 1.3510, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.86% (0.8101 => 0.8495, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.14% (0.3817 => 0.3975, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.82% (14.3668 => 14.9156, std.dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: 3.36% (17.1811 => 17.7589, std.dev.: 0.0207) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.10% (3.8922 => 4.0128, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 10.00% (1.1396 => 1.2536, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.22% (3.1595 => 3.4508, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3690, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.65% (0.3463 => 0.3624, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.62% (3.6395 => 3.7713, std.dev.: 0.0082) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.71% (4.2280 => 4.3427, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.34% (1.7254 => 1.7657, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8126, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.20% (2.6546 => 2.6865, std.dev.: 0.0054) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.05% (6.6874 => 0.1303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -79.97% (0.8651 => 0.1733, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.83% (5.2763 => 3.2804, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.17% (5.3855 => 3.7071, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.72% (5.3526 => 3.7081, std.dev.: 0.0020) SingleSource/UnitTests/Vector/constpool: -14.56% (54.1659 => 46.2818, std.dev.: 0.0399) MultiSource/Benchmarks/FreeBench/mason/mason: -12.82% (0.0811 => 0.0707, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -10.82% (22.1758 => 19.7771, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.30% (2.9384 => 2.6358, std.dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.50% (1.1492 => 0.7642, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: -15.88% (1.6925 => 1.4237, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.83% (0.0998 => 0.0860, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.28% (1.2373 => 1.0977, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel-2: -10.35% (1.5373 => 1.3782, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/mason/mason: -9.81% (0.2161 => 0.1949, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.37% (19.9488 => 18.2795, std.dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.66% (1.8329 => 1.7108, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.27% (1.6805 => 1.5920, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: -4.50% (1.5835 => 1.5122, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.21% (0.9957 => 0.9538, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.65% (3.2827 => 3.1628, std.dev.: 0.0088) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.4993, std.dev.: 0.0072) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0987, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.02% (8.6802 => 8.5052, std.dev.: 0.0083) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.85% (8.1563 => 8.0052, std.dev.: 0.0102) SingleSource/UnitTests/Vector/multiplies: -1.81% (2.5528 => 2.5065, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: -1.75% (10.2830 => 10.1029, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6830, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: -1.51% (9.5636 => 9.4196, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout/hash: -1.10% (4.9088 => 4.8549, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2348, std.dev.: 0.0055) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.66% (0.5229 => 0.5891, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 8.43% (14.9895 => 16.2525, std.dev.: 0.0056) MultiSource/Benchmarks/MallocBench/gs/gs: 6.59% (4.1105 => 4.3814, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.31% (1.1048 => 1.2518, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.12% (7.1582 => 7.8113, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.29% (0.6222 => 0.7422, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35900.00% (0.0001 => 0.0360, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 8 22:19:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 9 Oct 2012 00:19:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121009051913.18A5A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4723?compare_to=4718&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4723, Order: 165475, Start Time: 2012-10-09 02:36:43, End Time: 2012-10-09 05:21:00 To: 4718, Order: 165440, Start Time: 2012-10-08 23:23:39, End Time: 2012-10-09 02:07:40 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (137 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 1041 (826 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.03% (1.7817 => 1.7633, std.dev.: 0.0015) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 12.41% (0.3465 => 0.3895, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.27% (0.3488 => 0.3916, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/synchronized: 12.25% (0.3469 => 0.3894, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.25% (0.3446 => 0.3868, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.21% (0.3496 => 0.3923, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.17% (0.3442 => 0.3861, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.14% (0.3460 => 0.3880, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.91% (0.3643 => 0.4077, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.86% (0.3650 => 0.4083, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.47% (0.3724 => 0.4151, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.29% (0.1063 => 0.1183, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 10.68% (1.5932 => 1.7633, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 10.23% (0.5826 => 0.6422, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 10.09% (0.5889 => 0.6483, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.42% (0.2738 => 0.2996, std.dev.: 0.0070) SingleSource/Regression/C++/ofstream_ctor: 9.22% (0.3004 => 0.3281, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.15% (0.2875 => 0.3138, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/08-main/main: 9.03% (0.1218 => 0.1328, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 9.02% (0.1619 => 0.1765, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 8.94% (0.7171 => 0.7812, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/18-imp/imp: 8.73% (0.1421 => 0.1545, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/random: 8.63% (0.2803 => 0.3045, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.58% (0.3195 => 0.3469, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 8.51% (0.2725 => 0.2957, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 8.47% (0.2714 => 0.2944, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 8.47% (0.2750 => 0.2983, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.45% (0.2792 => 0.3028, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.43% (0.2729 => 0.2959, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 8.43% (0.2813 => 0.3050, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 8.36% (0.2823 => 0.3059, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.35% (0.2911 => 0.3154, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 8.35% (0.2780 => 0.3012, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.30% (1.3152 => 1.4244, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.30% (2.0673 => 2.2388, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 8.25% (5.5417 => 5.9991, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.23% (0.4361 => 0.4720, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/except: 8.22% (0.2811 => 0.3042, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 8.20% (0.9909 => 1.0722, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/wc: 8.20% (0.3096 => 0.3350, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 8.05% (0.3267 => 0.3530, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 8.04% (0.3258 => 0.3520, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.04% (1.6211 => 1.7514, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 8.03% (0.3348 => 0.3617, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.02% (0.1620 => 0.1750, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.02% (0.5000 => 0.5401, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.97% (0.4994 => 0.5392, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.94% (0.3060 => 0.3303, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 7.94% (0.3678 => 0.3970, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.91% (0.3362 => 0.3628, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 7.90% (0.3317 => 0.3579, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 7.85% (0.3477 => 0.3750, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.82% (3.5627 => 3.8412, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/sieve: 7.81% (0.3726 => 0.4017, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.81% (0.3625 => 0.3908, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.75% (0.3124 => 0.3366, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.69% (2.7292 => 2.9392, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.68% (0.3282 => 0.3534, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.67% (0.3845 => 0.4140, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.60% (0.2014 => 0.2167, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 7.48% (0.4251 => 0.4569, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.46% (0.5026 => 0.5401, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 7.43% (0.4146 => 0.4454, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.40% (0.3690 => 0.3963, std.dev.: 0.0024) MultiSource/Benchmarks/PAQ8p/paq8p: 7.37% (0.4847 => 0.5204, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 7.33% (0.2566 => 0.2754, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 7.31% (0.1505 => 0.1615, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.15% (0.2866 => 0.3071, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.11% (0.1462 => 0.1566, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.11% (0.3981 => 0.4264, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 7.10% (0.4029 => 0.4315, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 7.10% (23.5202 => 25.1892, std.dev.: 0.0156) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.05% (0.3930 => 0.4207, std.dev.: 0.0029) MultiSource/Applications/minisat/minisat: 7.01% (0.3336 => 0.3570, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.97% (0.5900 => 0.6311, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.96% (0.6435 => 0.6883, std.dev.: 0.0050) MultiSource/Applications/siod/siod: 6.95% (0.6634 => 0.7095, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.94% (0.2736 => 0.2926, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 6.93% (1.0781 => 1.1528, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.91% (0.1549 => 0.1656, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 6.88% (4.2109 => 4.5008, std.dev.: 0.0110) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.76% (0.4139 => 0.4419, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.74% (0.3084 => 0.3292, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 6.74% (0.5012 => 0.5350, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.72% (0.2068 => 0.2207, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.71% (0.3903 => 0.4165, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.68% (0.3890 => 0.4150, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 6.66% (1.8794 => 2.0046, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.54% (4.4195 => 4.7087, std.dev.: 0.0030) MultiSource/Applications/hbd/hbd: 6.53% (0.9697 => 1.0330, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 6.51% (1.4269 => 1.5198, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 6.36% (2.1013 => 2.2349, std.dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 6.32% (0.2691 => 0.2861, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.30% (0.1968 => 0.2092, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.30% (0.2969 => 0.3156, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 6.27% (4.6177 => 4.9073, std.dev.: 0.0045) MultiSource/Applications/Burg/burg: 6.13% (0.5546 => 0.5886, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.13% (0.2040 => 0.2165, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.09% (0.2103 => 0.2231, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 6.08% (2.1653 => 2.2970, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.05% (0.4658 => 0.4940, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.02% (0.3271 => 0.3468, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 5.84% (0.7875 => 0.8335, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 5.51% (2.0346 => 2.1468, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.48% (1.9966 => 2.1060, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.47% (1.9694 => 2.0772, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 5.45% (0.2075 => 0.2188, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.25% (0.7426 => 0.7816, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 5.06% (0.2391 => 0.2512, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.92% (0.5361 => 0.5625, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.80% (0.5584 => 0.5852, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.48% (11.6398 => 12.1613, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.34% (4.6926 => 4.8962, std.dev.: 0.0049) MultiSource/Applications/lambda-0_1_3/lambda: 4.23% (0.3498 => 0.3646, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.90% (0.4253 => 0.4419, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 3.38% (11.9555 => 12.3594, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.95% (0.3792 => 0.3904, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.45% (3.3903 => 3.6089, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary: 5.75% (0.2122 => 0.2244, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6699, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1645, std.dev.: 0.1486) SingleSource/Benchmarks/Misc/flops-2: 4.50% (1.8057 => 1.8870, std.dev.: 0.0068) SingleSource/Benchmarks/Dhrystone/dry: 4.19% (14.0481 => 14.6372, std.dev.: 0.0276) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1906, std.dev.: 0.0134) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5043, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.59% (3.1722 => 3.2226, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2886, std.dev.: 0.0023) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5139, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.13% (1.0927 => 1.1050, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5809, std.dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.89% (25.4195 => 16.5503, std.dev.: 0.0269) SingleSource/Benchmarks/Shootout-C++/ary2: -7.79% (0.2402 => 0.2215, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9750, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7960, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.59% (11.2080 => 10.8054, std.dev.: 0.0095) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7723, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: -2.69% (17.2379 => 16.7743, std.dev.: 0.0399) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.24% (0.6293 => 0.6152, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.21% (41.7953 => 40.8696, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5731, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4965, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.18% (105.3826 => 104.1385, std.dev.: 0.0380) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0456, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 8 23:11:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 9 Oct 2012 01:11:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121009061123.7B7172A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4724?compare_to=4721&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4724, Order: 165478, Start Time: 2012-10-09 04:58:30, End Time: 2012-10-09 06:13:10 To: 4721, Order: 165476, Start Time: 2012-10-09 03:14:45, End Time: 2012-10-09 04:29:29 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (183 on baseline) Performance Improvements: 1 (41 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1040 (752 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.29% (3.7546 => 3.8407, std.dev.: 0.0303) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.03% (2.5041 => 2.4783, std.dev.: 0.0013) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 22.83% (2.0176 => 2.4783, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.73% (0.1410 => 0.1660, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 16.34% (0.0826 => 0.0961, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 15.29% (0.2243 => 0.2586, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.16% (0.0819 => 0.0935, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.07% (0.0834 => 0.0943, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 12.83% (0.1013 => 0.1143, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 12.68% (0.5818 => 0.6556, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 12.57% (0.4328 => 0.4872, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 12.49% (0.5748 => 0.6466, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 12.26% (0.4062 => 0.4560, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.24% (0.1413 => 0.1586, std.dev.: 0.0028) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.22% (0.1072 => 0.1203, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 12.21% (0.7061 => 0.7923, std.dev.: 0.0073) MultiSource/Applications/hbd/hbd: 12.09% (1.3693 => 1.5348, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.87% (0.2721 => 0.3044, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.82% (0.3485 => 0.3897, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 11.79% (0.2781 => 0.3109, std.dev.: 0.0081) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.77% (3.9660 => 4.4328, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.59% (0.1588 => 0.1772, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.54% (0.2782 => 0.3103, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.53% (0.1327 => 0.1480, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.41% (0.0964 => 0.1074, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.36% (0.2596 => 0.2891, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.31% (0.3899 => 0.4340, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.30% (0.2655 => 0.2955, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 11.30% (0.7038 => 0.7833, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.28% (0.7710 => 0.8580, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.23% (1.2193 => 1.3562, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 11.16% (0.2761 => 0.3069, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 11.14% (0.3293 => 0.3660, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.14% (0.4390 => 0.4879, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.13% (0.4016 => 0.4463, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.12% (0.3022 => 0.3358, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.08% (1.4563 => 1.6176, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.08% (0.3756 => 0.4172, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.07% (0.9199 => 1.0217, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 11.05% (0.2607 => 0.2895, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.05% (0.6283 => 0.6977, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 11.00% (0.2690 => 0.2986, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.00% (0.5265 => 0.5844, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 10.94% (0.2760 => 0.3062, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 10.93% (0.2726 => 0.3024, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.90% (1.9828 => 2.1989, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 10.90% (0.2937 => 0.3257, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.89% (0.3489 => 0.3869, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 10.89% (0.3453 => 0.3829, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/fibo: 10.88% (0.2628 => 0.2914, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.87% (0.3580 => 0.3969, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 10.86% (13.8202 => 15.3210, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/moments: 10.86% (0.3868 => 0.4288, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.85% (0.6959 => 0.7714, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 10.81% (0.3107 => 0.3443, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.76% (0.2966 => 0.3285, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.74% (0.2765 => 0.3062, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 10.73% (0.1062 => 0.1176, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 10.73% (0.3149 => 0.3487, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.66% (1.1364 => 1.2575, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 10.47% (0.1003 => 0.1108, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.46% (0.2696 => 0.2978, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 10.43% (0.3192 => 0.3525, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.33% (0.1075 => 0.1186, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists1: 10.30% (0.3534 => 0.3898, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 10.27% (0.2988 => 0.3295, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.00% (0.3130 => 0.3443, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 9.98% (0.2945 => 0.3239, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 9.96% (1.0313 => 1.1340, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.92% (0.1986 => 0.2183, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.82% (0.4379 => 0.4809, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.77% (0.4791 => 0.5259, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.77% (0.1157 => 0.1270, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.72% (0.5577 => 0.6119, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 9.72% (0.2995 => 0.3286, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.56% (0.1276 => 0.1398, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 9.52% (1.1061 => 1.2114, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 9.51% (16.6129 => 18.1927, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.50% (0.8698 => 0.9524, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.46% (0.3246 => 0.3553, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.45% (0.2127 => 0.2328, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.44% (0.2914 => 0.3189, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 9.38% (0.1589 => 0.1738, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.34% (0.1435 => 0.1569, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 9.27% (0.1111 => 0.1214, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 9.27% (0.6744 => 0.7369, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.21% (0.7460 => 0.8147, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.19% (0.5637 => 0.6155, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/18-imp/imp: 9.16% (0.3220 => 0.3515, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.13% (0.3755 => 0.4098, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.12% (7.2180 => 7.8760, std.dev.: 0.0073) MultiSource/Applications/spiff/spiff: 9.03% (0.7506 => 0.8184, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 9.00% (0.8310 => 0.9058, std.dev.: 0.0026) MultiSource/Applications/d/make_dparser: 8.98% (3.1889 => 3.4754, std.dev.: 0.0199) MultiSource/Benchmarks/MallocBench/gs/gs: 8.90% (3.8646 => 4.2087, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 8.90% (1.9270 => 2.0985, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.85% (0.2023 => 0.2202, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.83% (0.3511 => 0.3821, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/parameter-passing: 8.82% (0.4003 => 0.4356, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.79% (0.1865 => 0.2029, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 8.75% (0.3578 => 0.3891, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.74% (0.3914 => 0.4256, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 8.66% (0.1478 => 0.1606, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.65% (0.6576 => 0.7145, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 8.65% (0.2925 => 0.3178, std.dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 8.62% (1.0594 => 1.1507, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 8.61% (0.3646 => 0.3960, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.61% (0.3601 => 0.3911, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.58% (0.3940 => 0.4278, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.55% (0.3789 => 0.4113, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.54% (0.3663 => 0.3976, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 8.54% (2.1791 => 2.3653, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.52% (0.3650 => 0.3961, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 8.46% (4.6629 => 5.0572, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 8.39% (0.3623 => 0.3927, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.35% (3.6692 => 3.9757, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.35% (0.1569 => 0.1700, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.31% (0.8818 => 0.9551, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 8.27% (0.3131 => 0.3390, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 8.27% (0.1657 => 0.1794, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 8.16% (1.2749 => 1.3789, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 8.12% (14.8535 => 16.0601, std.dev.: 0.0174) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.08% (0.2140 => 0.2313, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.06% (1.3245 => 1.4313, std.dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.99% (0.1789 => 0.1932, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.99% (4.3801 => 4.7300, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 7.94% (1.2292 => 1.3268, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.87% (4.4433 => 4.7931, std.dev.: 0.0107) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.81% (0.1819 => 0.1961, std.dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: 7.72% (8.4961 => 9.1516, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.71% (0.6135 => 0.6608, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.70% (4.9865 => 5.3704, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/bigfib: 7.58% (0.6250 => 0.6724, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.46% (0.4113 => 0.4420, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.19% (0.2504 => 0.2684, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.09% (3.2742 => 3.5063, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.08% (0.4805 => 0.5145, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.07% (1.1333 => 1.2134, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.00% (0.9108 => 0.9746, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.00% (1.5188 => 1.6251, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.00% (0.3245 => 0.3472, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 6.77% (6.5754 => 7.0205, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/oourafft: 6.67% (0.2008 => 0.2142, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.59% (0.2321 => 0.2474, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.42% (6.2785 => 6.6814, std.dev.: 0.0029) MultiSource/Applications/lua/lua: 6.37% (3.7467 => 3.9855, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.01% (2.1007 => 2.2270, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.53% (13.2842 => 14.0183, std.dev.: 0.0125) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.86% (0.2243 => 0.2352, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 4.00% (16.2614 => 16.9121, std.dev.: 0.0215) MultiSource/Applications/ClamAV/clamscan: 3.85% (14.5298 => 15.0896, std.dev.: 0.0055) MultiSource/Benchmarks/Bullet/bullet: 1.44% (33.2944 => 33.7734, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5159, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: 24.37% (1.8175 => 2.2605, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: 11.10% (1.1560 => 1.2843, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922) SingleSource/Benchmarks/Misc/ffbench: 9.02% (0.8273 => 0.9019, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4144, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.17% (1.2998 => 1.3800, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9999, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.76% (1.9144 => 2.0055, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.67% (11.2619 => 11.6753, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-6: 3.35% (1.9199 => 1.9843, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 3.34% (10.7476 => 11.1061, std.dev.: 0.0171) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.11% (7.4271 => 7.5836, std.dev.: 0.0040) MultiSource/Applications/lemon/lemon: 1.65% (1.4298 => 1.4534, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5136, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9696, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1872, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5785, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0272, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 1.07% (12.4560 => 12.5892, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.63% (0.2670 => 0.1425, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -15.13% (0.0707 => 0.0600, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -14.71% (0.4657 => 0.3972, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.51% (1.3813 => 1.1947, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.49% (1.3819 => 1.1955, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.92% (22.5627 => 21.9028, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.04% (0.0997 => 0.0857, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -11.93% (0.2238 => 0.1971, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.93% (1.2308 => 1.0840, std.dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.18% (20.3410 => 18.2699, std.dev.: 0.0130) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.36% (1.3780 => 1.2903, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.24% (2.6470 => 2.5082, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.69% (0.9996 => 0.9527, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8001, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1562, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.45% (1.7688 => 1.7078, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.04% (0.4867 => 0.4719, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.54% (26.5159 => 25.8430, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4785, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.41% (1.9762 => 1.9286, std.dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Applications/spiff/spiff: -2.35% (3.0263 => 2.9553, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.97% (0.6589 => 0.6459, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.83% (6.3560 => 6.2400, std.dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7149, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0060, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: -1.27% (4.5928 => 4.5345, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8681, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: -1.23% (9.3358 => 9.2214, std.dev.: 0.0102) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.12% (6.6320 => 6.5579, std.dev.: 0.0110) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2573, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 8 23:43:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 9 Oct 2012 01:43:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121009064339.BC62E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4725?compare_to=4722&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4725, Order: 165479, Start Time: 2012-10-09 05:26:08, End Time: 2012-10-09 06:45:26 To: 4722, Order: 165476, Start Time: 2012-10-09 03:37:57, End Time: 2012-10-09 04:57:11 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (160 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1023 (758 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.11% (15.2037 => 15.5238, std.dev.: 0.0149) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.25% (55.3509 => 56.5975, std.dev.: 0.0684) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.68% (0.5891 => 0.5931, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 0.24% (16.2525 => 16.2911, std.dev.: 0.0132) MultiSource/Benchmarks/Bullet/bullet: -0.03% (54.4365 => 54.4200, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/gs/gs: 0.56% (4.3814 => 4.4059, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.31% (1.2518 => 1.2557, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.31% (7.8113 => 7.8355, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.70% (0.7422 => 0.7474, std.dev.: 0.0052) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.83% (0.0360 => 0.0363, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: - (0.1431 => 0.1431) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.31% (0.0648 => 0.0650, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -13.95% (63.2438 => 54.4200, std.dev.: 0.0062) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 33.18% (14.1553 => 18.8519, std.dev.: 0.0135) SingleSource/Benchmarks/Misc-C++-EH/spirit: 62.10% (3.4629 => 5.6135, std.dev.: 0.0230) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14217.08% (0.0720 => 10.3083, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952300.00% (0.0001 => 9.9524, std.dev.: 0.0011) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 55.13% (0.2554 => 0.3962, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 49.74% (10.3673 => 15.5238, std.dev.: 0.0149) SingleSource/Benchmarks/Misc/richards_benchmark: 33.79% (0.1622 => 0.2170, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 32.20% (0.1056 => 0.1396, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.59% (7.0540 => 8.2946, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.08% (2.2022 => 2.5784, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 16.76% (0.1432 => 0.1672, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.69% (0.1566 => 0.1796, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.97% (0.0871 => 0.0984, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.95% (1.7609 => 1.9890, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 12.90% (10.4361 => 11.7819, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/oourafft: 12.74% (0.3282 => 0.3700, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/trivial-interface: 12.61% (0.3473 => 0.3911, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.50% (0.3543 => 0.3986, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.41% (0.3561 => 0.4003, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.38% (0.3497 => 0.3930, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.37% (0.3516 => 0.3951, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.35% (0.0834 => 0.0937, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.31% (0.3543 => 0.3979, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.02% (0.3694 => 0.4138, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.94% (0.3828 => 0.4285, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.89% (0.3927 => 0.4394, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.76% (0.3886 => 0.4343, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.62% (0.1584 => 0.1768, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 11.25% (0.1440 => 0.1602, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.31% (0.1125 => 0.1241, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.28% (0.5925 => 0.6534, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.23% (0.4879 => 0.5378, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 10.20% (0.6030 => 0.6645, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.99% (0.6675 => 0.7342, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.88% (0.3177 => 0.3491, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 9.86% (9.4845 => 10.4195, std.dev.: 0.0047) MultiSource/Applications/minisat/minisat: 9.80% (0.7115 => 0.7812, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.67% (0.1438 => 0.1577, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 9.52% (5.7591 => 6.3075, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 9.49% (0.7326 => 0.8021, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/chomp: 9.43% (0.1655 => 0.1811, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.36% (0.4615 => 0.5047, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.30% (1.5415 => 1.6848, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/18-imp/imp: 9.23% (0.3423 => 0.3739, std.dev.: 0.0053) MultiSource/Applications/lambda-0_1_3/lambda: 9.11% (0.7433 => 0.8110, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 9.09% (0.1695 => 0.1849, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 9.02% (0.1175 => 0.1281, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 9.01% (0.3109 => 0.3389, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.98% (0.2271 => 0.2475, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.93% (0.2700 => 0.2941, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.91% (0.2065 => 0.2249, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.86% (0.1625 => 0.1769, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.84% (1.3050 => 1.4204, std.dev.: 0.0022) MultiSource/Applications/d/make_dparser: 8.84% (3.3354 => 3.6303, std.dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.81% (0.5105 => 0.5555, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.81% (0.5860 => 0.6376, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.70% (4.2646 => 4.6358, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.65% (0.8172 => 0.8879, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.62% (0.3307 => 0.3592, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.60% (8.1363 => 8.8357, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.54% (0.1510 => 0.1639, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.50% (0.2107 => 0.2286, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.48% (0.5569 => 0.6041, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.41% (0.1236 => 0.1340, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.40% (4.9449 => 5.3602, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.34% (7.9617 => 8.6257, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/bigfib: 8.33% (0.6456 => 0.6994, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.29% (5.0018 => 5.4163, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/lists: 8.27% (0.3422 => 0.3705, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.27% (0.5020 => 0.5435, std.dev.: 0.0033) MultiSource/Benchmarks/sim/sim: 8.27% (0.3387 => 0.3667, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.27% (0.3121 => 0.3379, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.26% (0.8067 => 0.8733, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 8.18% (0.4289 => 0.4640, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 8.15% (1.5603 => 1.6875, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: 8.14% (0.7835 => 0.8473, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.12% (0.2758 => 0.2982, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.12% (0.4103 => 0.4436, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 8.11% (1.1642 => 1.2586, std.dev.: 0.0015) MultiSource/Applications/viterbi/viterbi: 8.10% (0.1555 => 0.1681, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.08% (0.1337 => 0.1445, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.07% (0.4203 => 0.4542, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.02% (0.4636 => 0.5008, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.02% (0.9765 => 1.0548, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.94% (0.1940 => 0.2094, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.89% (0.3865 => 0.4170, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 7.84% (3.8723 => 4.1760, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/moments: 7.81% (0.4048 => 0.4364, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.75% (0.3136 => 0.3379, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.75% (0.2891 => 0.3115, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.73% (0.3650 => 0.3932, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.64% (0.4620 => 0.4973, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/strcat: 7.63% (0.2831 => 0.3047, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 7.58% (0.3603 => 0.3876, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 7.49% (0.3684 => 0.3960, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 7.49% (0.3098 => 0.3330, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.48% (0.3826 => 0.4112, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.43% (2.0665 => 2.2200, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/ary: 7.43% (0.3232 => 0.3472, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 7.42% (1.0722 => 1.1518, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 7.42% (0.2871 => 0.3084, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.40% (0.3162 => 0.3396, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 7.35% (2.0273 => 2.1763, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/wc: 7.34% (0.3052 => 0.3276, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.33% (1.5859 => 1.7022, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.32% (0.3441 => 0.3693, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.31% (0.2872 => 0.3082, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.30% (0.2603 => 0.2793, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.29% (0.2756 => 0.2957, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 7.28% (0.3283 => 0.3522, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 7.28% (21.9371 => 23.5339, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/fibo: 7.27% (0.2725 => 0.2923, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 7.20% (0.3180 => 0.3409, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 7.19% (0.4299 => 0.4608, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 7.09% (0.2877 => 0.3081, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.07% (0.2714 => 0.2906, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 7.07% (0.2802 => 0.3000, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.06% (1.1861 => 1.2698, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.02% (0.2793 => 0.2989, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.93% (0.6450 => 0.6897, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 6.81% (0.3379 => 0.3609, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 6.73% (0.8921 => 0.9521, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 6.66% (2.2969 => 2.4499, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.60% (0.5981 => 0.6376, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.44% (2.2024 => 2.3443, std.dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.35% (0.1906 => 0.2027, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.25% (0.4064 => 0.4318, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.24% (0.1892 => 0.2010, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.08% (0.1695 => 0.1798, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.06% (1.4186 => 1.5045, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 5.98% (1.1840 => 1.2548, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/objinst: 5.49% (0.3131 => 0.3303, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 5.41% (1.2842 => 1.3537, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.38% (0.2266 => 0.2388, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.16% (0.8101 => 0.8519, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: 4.88% (0.2049 => 0.2149, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.66% (0.3817 => 0.3995, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.21% (14.3668 => 14.9717, std.dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.91% (0.3427 => 0.3561, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 3.74% (17.1811 => 17.8240, std.dev.: 0.0210) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.55% (3.8922 => 4.0304, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.07% (1.1194 => 1.1538, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.99% (1.1396 => 1.2535, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4500, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3689, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 3.66% (0.5413 => 0.5611, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.33% (3.6395 => 3.7607, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.87% (4.2280 => 4.3494, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.37% (1.7254 => 1.7663, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.55% (0.8275 => 0.8403, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8131, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.38% (0.9540 => 0.9672, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.10% (2.6546 => 2.6838, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.07% (6.5088 => 6.5782, std.dev.: 0.0072) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.05% (6.6874 => 0.1305, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -79.94% (0.8651 => 0.1735, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.17% (5.2763 => 3.2625, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.40% (5.3855 => 3.6944, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.98% (5.3526 => 3.6944, std.dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -14.58% (54.1659 => 46.2690, std.dev.: 0.0283) MultiSource/Benchmarks/FreeBench/mason/mason: -12.45% (0.0811 => 0.0710, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.62% (2.9384 => 2.6263, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -10.45% (22.1758 => 19.8591, std.dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.26% (1.1492 => 0.7670, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -16.03% (1.6925 => 1.4212, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.63% (0.0998 => 0.0862, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -11.19% (1.2373 => 1.0988, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/mandel-2: -10.39% (1.5373 => 1.3776, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/mason/mason: -10.09% (0.2161 => 0.1943, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.41% (19.9488 => 18.2710, std.dev.: 0.0279) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4787, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.73% (1.8329 => 1.7096, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.34% (1.6805 => 1.5908, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-5: -4.75% (1.5835 => 1.5083, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.25% (0.9957 => 0.9534, std.dev.: 0.0101) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.64% (3.2827 => 3.1631, std.dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5010, std.dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0985, std.dev.: 0.0016) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.94% (8.1563 => 7.9983, std.dev.: 0.0111) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.92% (8.6802 => 8.5132, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/salsa20: -1.82% (10.2830 => 10.0963, std.dev.: 0.0212) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6825, std.dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -1.64% (2.5528 => 2.5110, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4223, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/whetstone: -1.08% (1.0554 => 1.0440, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8579, std.dev.: 0.0159) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.43% (0.5229 => 0.5931, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 8.68% (14.9895 => 16.2911, std.dev.: 0.0132) MultiSource/Benchmarks/MallocBench/gs/gs: 7.19% (4.1105 => 4.4059, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.66% (1.1048 => 1.2557, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.46% (7.1582 => 7.8355, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/stepanov_container: 20.12% (0.6222 => 0.7474, std.dev.: 0.0052) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36200.00% (0.0001 => 0.0363, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.28% (0.2116 => 0.0650, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 9 00:57:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 9 Oct 2012 02:57:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121009075746.1CA012A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/4726?compare_to=4724&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4726, Order: 165485, Start Time: 2012-10-09 06:42:10, End Time: 2012-10-09 07:59:32 To: 4724, Order: 165478, Start Time: 2012-10-09 04:58:30, End Time: 2012-10-09 06:13:10 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (173 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1040 (764 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.31% (55.6904 => 56.4188, std.dev.: 0.0404) SingleSource/Benchmarks/McGill/chomp: 1.06% (1.0840 => 1.0955, std.dev.: 0.0018) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.17% (2.0176 => 2.4851, std.dev.: 0.0628) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.01% (0.1410 => 0.1664, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 16.59% (0.0826 => 0.0963, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 15.43% (0.2243 => 0.2589, std.dev.: 0.0093) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.29% (0.0819 => 0.0936, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.19% (0.0834 => 0.0944, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 13.13% (0.1013 => 0.1146, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.96% (0.1327 => 0.1499, std.dev.: 0.0055) SingleSource/UnitTests/ObjC++/property-reference-object: 12.96% (0.5818 => 0.6572, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.74% (0.1413 => 0.1593, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 12.73% (0.5748 => 0.6480, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 12.56% (0.1075 => 0.1210, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/hash2: 12.55% (0.4328 => 0.4871, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 12.46% (0.7061 => 0.7941, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/hash: 12.41% (0.4062 => 0.4566, std.dev.: 0.0019) MultiSource/Applications/hbd/hbd: 12.27% (1.3693 => 1.5373, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.25% (3.9660 => 4.4517, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.13% (0.2721 => 0.3051, std.dev.: 0.0081) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.03% (0.1072 => 0.1201, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.86% (0.2596 => 0.2904, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.85% (1.4563 => 1.6288, std.dev.: 0.0322) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.59% (0.3899 => 0.4351, std.dev.: 0.0131) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.56% (0.3485 => 0.3888, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.52% (0.1588 => 0.1771, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.47% (0.6959 => 0.7757, std.dev.: 0.0295) MultiSource/Applications/lambda-0_1_3/lambda: 11.45% (0.7038 => 0.7844, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.40% (0.5265 => 0.5865, std.dev.: 0.0190) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.39% (0.9199 => 1.0247, std.dev.: 0.0260) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.36% (1.2193 => 1.3578, std.dev.: 0.0322) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.34% (0.3580 => 0.3986, std.dev.: 0.0135) SingleSource/Regression/C++/ofstream_ctor: 11.29% (0.2781 => 0.3095, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.27% (0.6283 => 0.6991, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.22% (0.3022 => 0.3361, std.dev.: 0.0085) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.21% (0.4390 => 0.4882, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.18% (0.2782 => 0.3093, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 11.02% (0.1062 => 0.1179, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 11.00% (13.8202 => 15.3408, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.86% (0.3489 => 0.3868, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.84% (1.1364 => 1.2596, std.dev.: 0.0269) SingleSource/Benchmarks/Shootout-C++/lists: 10.84% (0.3293 => 0.3650, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.81% (0.4016 => 0.4450, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.78% (1.9828 => 2.1965, std.dev.: 0.0697) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.76% (0.2966 => 0.3285, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/strcat: 10.75% (0.2726 => 0.3019, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 10.74% (0.2607 => 0.2887, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 10.71% (0.2690 => 0.2978, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 10.69% (0.2628 => 0.2909, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 10.69% (0.2760 => 0.3055, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 10.69% (0.3453 => 0.3822, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 10.68% (0.2761 => 0.3056, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.67% (0.2765 => 0.3060, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 10.66% (0.2937 => 0.3250, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.65% (0.3756 => 0.4156, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 10.63% (0.3868 => 0.4279, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.58% (0.2655 => 0.2936, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 10.57% (0.3149 => 0.3482, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 10.49% (0.3107 => 0.3433, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/power/power: 10.47% (0.1003 => 0.1108, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 10.31% (0.3192 => 0.3521, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.29% (0.3130 => 0.3452, std.dev.: 0.0112) MultiSource/Applications/lemon/lemon: 10.25% (1.0313 => 1.1370, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.24% (0.2696 => 0.2972, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 10.22% (0.3534 => 0.3895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.20% (0.1157 => 0.1275, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 10.07% (0.2988 => 0.3289, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.06% (0.5577 => 0.6138, std.dev.: 0.0169) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.00% (0.4379 => 0.4817, std.dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.98% (0.4791 => 0.5269, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.96% (0.1014 => 0.1115, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 9.94% (1.1061 => 1.2160, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 9.85% (0.2995 => 0.3290, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.78% (0.2127 => 0.2335, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.67% (0.3246 => 0.3560, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/objinst: 9.58% (0.2945 => 0.3227, std.dev.: 0.0077) MultiSource/Applications/kimwitu++/kc: 9.53% (16.6129 => 18.1964, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.51% (0.5637 => 0.6173, std.dev.: 0.0112) SingleSource/UnitTests/ObjC/trivial-interface: 9.50% (0.3578 => 0.3918, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.49% (0.7460 => 0.8168, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.49% (7.2180 => 7.9029, std.dev.: 0.0234) SingleSource/UnitTests/ObjC/parameter-passing: 9.47% (0.4003 => 0.4382, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 9.46% (0.7506 => 0.8216, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 9.44% (0.1589 => 0.1739, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.42% (0.3650 => 0.3994, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 9.42% (0.6744 => 0.7379, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 9.38% (0.3646 => 0.3988, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 9.38% (0.3220 => 0.3522, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 9.38% (0.3914 => 0.4281, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 9.36% (0.1111 => 0.1215, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.36% (0.3601 => 0.3938, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.36% (0.3623 => 0.3962, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/football/football: 9.34% (0.8310 => 0.9086, std.dev.: 0.0242) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.34% (0.1435 => 0.1569, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.34% (0.3663 => 0.4005, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.32% (0.8698 => 0.9509, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/for-in: 9.32% (0.3789 => 0.4142, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.29% (0.3940 => 0.4306, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.24% (0.2023 => 0.2210, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 9.23% (3.8646 => 4.2213, std.dev.: 0.0088) MultiSource/Applications/d/make_dparser: 9.19% (3.1889 => 3.4819, std.dev.: 0.0026) MultiSource/Applications/treecc/treecc: 9.11% (1.9270 => 2.1025, std.dev.: 0.0065) MultiSource/Benchmarks/nbench/nbench: 9.01% (1.0594 => 1.1549, std.dev.: 0.0290) MultiSource/Applications/viterbi/viterbi: 9.00% (0.1478 => 0.1611, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.95% (0.3755 => 0.4091, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.90% (0.1865 => 0.2031, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 8.85% (0.2925 => 0.3184, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 8.85% (2.1791 => 2.3719, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.60% (3.6692 => 3.9847, std.dev.: 0.0993) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.54% (0.1569 => 0.1703, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 8.53% (0.3131 => 0.3398, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.46% (1.3245 => 1.4365, std.dev.: 0.0363) MultiSource/Benchmarks/Olden/em3d/em3d: 8.45% (0.1657 => 0.1797, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.41% (0.6576 => 0.7129, std.dev.: 0.0108) MultiSource/Applications/JM/lencod/lencod: 8.34% (14.8535 => 16.0930, std.dev.: 0.0100) MultiSource/Applications/oggenc/oggenc: 8.32% (4.6629 => 5.0510, std.dev.: 0.0027) MultiSource/Applications/SIBsim4/SIBsim4: 8.26% (1.2749 => 1.3802, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.24% (4.3801 => 4.7412, std.dev.: 0.1126) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.08% (4.4433 => 4.8025, std.dev.: 0.1026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.04% (0.6135 => 0.6628, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.97% (0.3511 => 0.3791, std.dev.: 0.0066) MultiSource/Benchmarks/mafft/pairlocalalign: 7.95% (8.4961 => 9.1713, std.dev.: 0.0714) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.86% (0.8818 => 0.9511, std.dev.: 0.0155) MultiSource/Applications/hexxagon/hexxagon: 7.73% (1.2292 => 1.3242, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 7.61% (0.4113 => 0.4426, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/bigfib: 7.58% (0.6250 => 0.6724, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.57% (4.9865 => 5.3640, std.dev.: 0.0089) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.51% (0.2504 => 0.2692, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.41% (1.1333 => 1.2173, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.26% (0.4805 => 0.5154, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.26% (1.5188 => 1.6291, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.24% (3.2742 => 3.5113, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.17% (0.9108 => 0.9761, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 6.95% (6.5754 => 7.0325, std.dev.: 0.0169) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.87% (0.3245 => 0.3468, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.85% (0.2321 => 0.2480, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.68% (6.2785 => 6.6978, std.dev.: 0.1217) SingleSource/Benchmarks/Misc/oourafft: 6.67% (0.2008 => 0.2142, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 6.61% (3.7467 => 3.9943, std.dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.36% (2.1007 => 2.2342, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 3.96% (16.2614 => 16.9056, std.dev.: 0.0122) MultiSource/Applications/ClamAV/clamscan: 3.94% (14.5298 => 15.1023, std.dev.: 0.0145) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.49% (5.7573 => 7.5129, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 23.88% (1.8175 => 2.2516, std.dev.: 0.0453) SingleSource/Benchmarks/Misc/richards_benchmark: 11.02% (1.1560 => 1.2834, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 8.99% (0.8273 => 0.9017, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4138, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.29% (1.2998 => 1.3815, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.80% (0.3458 => 0.3624, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0044, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.89% (1.7081 => 1.7746, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6764, std.dev.: 0.0193) MultiSource/Applications/SPASS/SPASS: 3.33% (10.7476 => 11.1055, std.dev.: 0.0174) SingleSource/Benchmarks/Misc/flops-6: 3.29% (1.9199 => 1.9831, std.dev.: 0.0017) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.14% (7.4271 => 7.5857, std.dev.: 0.0073) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4532, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 1.49% (8.3908 => 8.5155, std.dev.: 0.0360) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1863, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5783, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0272, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists: 1.01% (12.4560 => 12.5822, std.dev.: 0.0078) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.85% (0.2670 => 0.1419, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/mason/mason: -14.85% (0.0707 => 0.0602) SingleSource/UnitTests/ObjC/block-byref-aggr: -14.19% (0.4657 => 0.3996, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.30% (1.3819 => 1.1981, std.dev.: 0.0338) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.20% (1.3813 => 1.1990, std.dev.: 0.0320) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.44% (0.0997 => 0.0863, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -12.11% (0.2238 => 0.1967, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.99% (1.2308 => 1.0955, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.25% (20.3410 => 18.2565, std.dev.: 0.0146) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.55% (1.3780 => 1.3015, std.dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.16% (2.6470 => 2.5103, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.05% (0.9996 => 0.9591, std.dev.: 0.0064) MultiSource/Applications/siod/siod: -3.58% (3.2729 => 3.1558, std.dev.: 0.0187) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.49% (1.7688 => 1.7070, std.dev.: 0.0054) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.96% (0.4867 => 0.4723, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -2.55% (26.5159 => 25.8387, std.dev.: 0.0243) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.41% (3.0263 => 2.9533, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.33% (1.9762 => 1.9301, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.00% (0.6589 => 0.6457, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.82% (6.3560 => 6.2403, std.dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: -1.79% (28.2225 => 27.7171, std.dev.: 0.0159) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.56% (0.6615 => 0.6512, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0071, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8635, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: -1.28% (4.5928 => 4.5341, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.17% (2.5254 => 2.4958, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2580, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: -1.01% (9.3358 => 9.2419, std.dev.: 0.0297) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 9 01:34:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 9 Oct 2012 03:34:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121009083413.7A4AF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4727?compare_to=4723&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4727, Order: 165482, Start Time: 2012-10-09 05:49:55, End Time: 2012-10-09 08:36:00 To: 4723, Order: 165475, Start Time: 2012-10-09 02:36:43, End Time: 2012-10-09 05:21:00 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (132 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 1041 (832 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.38% (2.7824 => 2.8208, std.dev.: 0.0043) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 13.35% (0.3446 => 0.3906, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-4: 13.33% (0.3465 => 0.3927, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 13.22% (0.3442 => 0.3897, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.14% (0.3469 => 0.3925, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 13.10% (0.3496 => 0.3954, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.09% (0.3460 => 0.3913, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.07% (0.3488 => 0.3944, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 12.76% (0.3643 => 0.4108, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.74% (0.3650 => 0.4115, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.42% (0.1063 => 0.1195, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.38% (0.3724 => 0.4185, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 11.40% (1.5932 => 1.7748, std.dev.: 0.0064) SingleSource/UnitTests/ObjC++/Hello: 9.96% (0.5826 => 0.6406, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.76% (0.5889 => 0.6464, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 9.64% (0.1619 => 0.1775, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 9.61% (0.1218 => 0.1335, std.dev.: 0.0031) SingleSource/Regression/C++/ofstream_ctor: 9.29% (0.3004 => 0.3283, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.21% (0.1107 => 0.1209, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.20% (0.2738 => 0.2990, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.97% (0.2875 => 0.3133, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.95% (0.1620 => 0.1765, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 8.90% (0.7171 => 0.7809, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.78% (1.6211 => 1.7634, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.70% (0.3195 => 0.3473, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 8.70% (0.2725 => 0.2962, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 8.70% (0.2714 => 0.2950, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.67% (0.2792 => 0.3034, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 8.65% (5.5417 => 6.0213, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.65% (1.3152 => 1.4290, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.63% (0.4994 => 0.5425, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.61% (0.2729 => 0.2964, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 8.57% (0.2823 => 0.3065, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 8.57% (0.2813 => 0.3054, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.53% (2.0673 => 2.2437, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 8.53% (0.2803 => 0.3042, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 8.52% (0.9909 => 1.0753, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.50% (0.5000 => 0.5425, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.49% (0.2911 => 0.3158, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.46% (3.5627 => 3.8640, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/matrix: 8.45% (0.2780 => 0.3015, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 8.40% (0.2750 => 0.2981, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.37% (0.4361 => 0.4726, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wc: 8.37% (0.3096 => 0.3355, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.33% (0.3362 => 0.3642, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.29% (2.7292 => 2.9555, std.dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.22% (0.3845 => 0.4161, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.20% (0.5026 => 0.5438, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/except: 8.18% (0.2811 => 0.3041, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 8.17% (0.3267 => 0.3534, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.17% (0.3060 => 0.3310, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: 8.16% (0.3678 => 0.3978, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 8.10% (0.3258 => 0.3522, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 8.08% (0.3317 => 0.3585, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 8.07% (0.2566 => 0.2773, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.02% (0.5900 => 0.6373, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.94% (0.3625 => 0.3913, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.94% (0.2014 => 0.2174, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 7.92% (0.3726 => 0.4021, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 7.91% (0.3477 => 0.3752, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 7.89% (0.3348 => 0.3612, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.85% (0.2866 => 0.3091, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.81% (0.4146 => 0.4470, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.80% (0.3282 => 0.3538, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.78% (0.3124 => 0.3367, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 7.74% (1.0781 => 1.1615, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.66% (0.4139 => 0.4456, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.65% (0.4251 => 0.4576, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 7.64% (0.3336 => 0.3591, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.64% (0.2736 => 0.2945, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 7.63% (0.4847 => 0.5217, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/18-imp/imp: 7.60% (0.1421 => 0.1529, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.55% (0.1549 => 0.1666, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.53% (0.3690 => 0.3968, std.dev.: 0.0101) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.46% (0.3930 => 0.4223, std.dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: 7.43% (23.5202 => 25.2682, std.dev.: 0.0259) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.39% (0.3981 => 0.4275, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 7.35% (4.2109 => 4.5202, std.dev.: 0.0066) MultiSource/Applications/spiff/spiff: 7.30% (0.4029 => 0.4323, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 7.24% (0.1505 => 0.1614, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.18% (0.1462 => 0.1567, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 7.18% (0.6634 => 0.7110, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.17% (0.3903 => 0.4183, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 7.07% (1.8794 => 2.0123, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/bigfib: 7.06% (0.5012 => 0.5366) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.01% (0.6435 => 0.6886, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.94% (0.3890 => 0.4160, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.87% (0.2737 => 0.2925, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.86% (0.1968 => 0.2103, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 6.86% (0.9697 => 1.0362, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 6.83% (2.1013 => 2.2449, std.dev.: 0.0023) MultiSource/Applications/lua/lua: 6.76% (1.4269 => 1.5233, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 6.69% (2.1653 => 2.3102, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.59% (4.4195 => 4.7108, std.dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: 6.59% (4.6177 => 4.9219, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.57% (0.4658 => 0.4964, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 6.56% (0.5546 => 0.5910, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.45% (0.3271 => 0.3482, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 6.24% (0.2691 => 0.2859, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.20% (0.2969 => 0.3153, std.dev.: 0.0026) MultiSource/Applications/treecc/treecc: 6.03% (0.7875 => 0.8350, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.94% (1.9694 => 2.0863, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.92% (1.9966 => 2.1148, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.78% (0.2040 => 0.2158, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 5.54% (0.2075 => 0.2190, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 5.46% (2.0346 => 2.1456, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.18% (0.5584 => 0.5873, std.dev.: 0.0087) MultiSource/Applications/lemon/lemon: 5.14% (0.2391 => 0.2514, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.85% (11.6398 => 12.2040, std.dev.: 0.0083) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.80% (0.3792 => 0.3936, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.60% (0.4253 => 0.4406, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 3.25% (11.9555 => 12.3445, std.dev.: 0.0199) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 8.15% (0.2122 => 0.2295, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6101, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6770, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-2: 5.01% (1.8057 => 1.8961, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1663, std.dev.: 0.1475) SingleSource/Benchmarks/Dhrystone/dry: 4.21% (14.0481 => 14.6400, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1956, std.dev.: 0.0068) MultiSource/Applications/viterbi/viterbi: 1.90% (46.6247 => 47.5100, std.dev.: 0.0206) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.61% (3.1722 => 3.2233, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2849, std.dev.: 0.0022) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5144, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5835, std.dev.: 0.0294) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.80% (25.4195 => 16.5731, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/ary2: -8.45% (0.2402 => 0.2199, std.dev.: 0.0048) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9754, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7999, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9585, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8016, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0044) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.48% (17.2379 => 16.8104, std.dev.: 0.0273) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8674, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5778, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4957, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0454, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 9 01:36:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 9 Oct 2012 03:36:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121009083643.0F5622A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4728?compare_to=4725&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4728, Order: 165485, Start Time: 2012-10-09 07:18:34, End Time: 2012-10-09 08:38:30 To: 4725, Order: 165479, Start Time: 2012-10-09 05:26:08, End Time: 2012-10-09 06:45:26 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (156 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1024 (761 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.19% (8.2946 => 8.3937, std.dev.: 0.0187) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.56% (0.5931 => 0.5898, std.dev.: 0.0043) MultiSource/Applications/SPASS/SPASS: -0.02% (16.2911 => 16.2871, std.dev.: 0.0313) MultiSource/Benchmarks/Bullet/bullet: 0.12% (54.4200 => 54.4846, std.dev.: 0.0980) MultiSource/Benchmarks/MallocBench/gs/gs: -0.25% (4.4059 => 4.3949, std.dev.: 0.0220) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.07% (1.2557 => 1.2548, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.20% (7.8355 => 7.8196, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.80% (0.7474 => 0.7414, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.83% (0.0363 => 0.0366, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: - (0.1431 => 0.1431, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.31% (0.0650 => 0.0648, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -13.85% (63.2438 => 54.4846, std.dev.: 0.0980) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.81% (14.1553 => 18.8002, std.dev.: 0.0164) SingleSource/Benchmarks/Misc-C++-EH/spirit: 61.80% (3.4629 => 5.6031, std.dev.: 0.0015) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14216.81% (0.0720 => 10.3081, std.dev.: 0.0126) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9951600.00% (0.0001 => 9.9517, std.dev.: 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 54.19% (0.2554 => 0.3938, std.dev.: 0.0023) MultiSource/Benchmarks/PAQ8p/paq8p: 51.04% (10.3673 => 15.6587, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/richards_benchmark: 34.09% (0.1622 => 0.2175, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/distray/distray: 32.10% (0.1056 => 0.1395, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.99% (7.0540 => 8.3937, std.dev.: 0.0187) MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.11% (2.2022 => 2.6011, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 17.32% (0.1432 => 0.1680, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.62% (0.1566 => 0.1795, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 13.96% (10.4361 => 11.8930, std.dev.: 0.0267) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.27% (1.7609 => 1.9946, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/oourafft: 12.83% (0.3282 => 0.3703, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.59% (0.0834 => 0.0939, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.51% (0.0871 => 0.0980, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 11.83% (0.3473 => 0.3884, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.80% (0.3516 => 0.3931, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.77% (0.3543 => 0.3960, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 11.69% (0.3543 => 0.3957, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 11.64% (0.3497 => 0.3904, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 11.57% (0.3561 => 0.3973, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.55% (0.1584 => 0.1767, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 11.42% (0.3828 => 0.4265, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 11.32% (0.1440 => 0.1603, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.32% (0.3694 => 0.4112, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.19% (0.3886 => 0.4321, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/parameter-passing: 11.15% (0.3927 => 0.4365, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.06% (0.4879 => 0.5370, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.01% (0.1438 => 0.1582, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 9.96% (9.4845 => 10.4288, std.dev.: 0.0049) MultiSource/Applications/oggenc/oggenc: 9.74% (5.7591 => 6.3199, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.69% (0.3177 => 0.3485, std.dev.: 0.0023) MultiSource/Applications/minisat/minisat: 9.52% (0.7115 => 0.7792, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.51% (0.6675 => 0.7310, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 9.34% (0.7433 => 0.8127, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/Hello: 9.33% (0.5925 => 0.6478, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.29% (0.6030 => 0.6590, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 9.18% (0.1655 => 0.1807, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 8.94% (0.3109 => 0.3387, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 8.94% (0.1175 => 0.1280, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.93% (1.5415 => 1.6791, std.dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.88% (0.4615 => 0.5025, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/18-imp/imp: 8.88% (0.3423 => 0.3727, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.80% (0.1625 => 0.1768, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.67% (0.2700 => 0.2934, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.62% (0.5105 => 0.5545, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 8.61% (0.1695 => 0.1841, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference: 8.60% (0.7326 => 0.7956, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.53% (1.3050 => 1.4163, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: 8.50% (0.3387 => 0.3675, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.50% (0.2271 => 0.2464, std.dev.: 0.0041) MultiSource/Applications/d/make_dparser: 8.47% (3.3354 => 3.6180, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.38% (0.2065 => 0.2238, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.31% (0.5860 => 0.6347, std.dev.: 0.0055) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.30% (0.3121 => 0.3380, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.29% (4.2646 => 4.6183, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.26% (8.1363 => 8.8084, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/lists: 8.24% (0.3422 => 0.3704, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.22% (0.8067 => 0.8730, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/bigfib: 8.18% (0.6456 => 0.6984, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.17% (5.0018 => 5.4105, std.dev.: 0.0148) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.16% (0.2107 => 0.2279, std.dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.15% (7.9617 => 8.6105, std.dev.: 0.0128) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.15% (0.1510 => 0.1633, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 8.14% (1.5603 => 1.6873, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.09% (4.9449 => 5.3450, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.06% (0.5569 => 0.6018, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/hash: 8.02% (0.4289 => 0.4633, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.01% (0.3307 => 0.3572, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.98% (0.8172 => 0.8824, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.94% (0.2758 => 0.2977, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.92% (0.4103 => 0.4428, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.91% (0.9765 => 1.0537, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.89% (0.1940 => 0.2093, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.85% (0.1337 => 0.1442, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: 7.84% (1.1642 => 1.2555, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.83% (0.4203 => 0.4532, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.68% (0.2905 => 0.3128, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 7.66% (0.7835 => 0.8435, std.dev.: 0.0084) MultiSource/Applications/viterbi/viterbi: 7.65% (0.1555 => 0.1674, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.64% (0.3650 => 0.3929, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.63% (0.3865 => 0.4160, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 7.62% (3.8723 => 4.1672, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.61% (0.2891 => 0.3111, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 7.59% (0.2831 => 0.3046, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.57% (0.5020 => 0.5400, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.53% (0.3136 => 0.3372, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 7.52% (21.9371 => 23.5865, std.dev.: 0.0260) SingleSource/Benchmarks/Shootout-C++/moments: 7.49% (0.4048 => 0.4351, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.48% (0.3826 => 0.4112, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 7.44% (0.3684 => 0.3958, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/sieve: 7.41% (0.3603 => 0.3870, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.38% (0.4620 => 0.4961, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.36% (0.4636 => 0.4977, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.36% (2.0665 => 2.2185, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/fibo: 7.34% (0.2725 => 0.2925, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 7.33% (0.3232 => 0.3469, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 7.33% (0.3098 => 0.3325, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 7.28% (0.3283 => 0.3522, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 7.28% (0.2871 => 0.3080, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 7.27% (0.3052 => 0.3274, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.24% (0.2872 => 0.3080, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 7.21% (1.0722 => 1.1495, std.dev.: 0.0014) MultiSource/Applications/treecc/treecc: 7.16% (2.0273 => 2.1725, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.15% (0.3441 => 0.3687, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.15% (0.2756 => 0.2953, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.15% (0.3162 => 0.3388, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.09% (0.2793 => 0.2991, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.99% (1.1861 => 1.2690, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.96% (1.5859 => 1.6963, std.dev.: 0.0177) SingleSource/Benchmarks/Shootout-C++/methcall: 6.92% (0.2877 => 0.3076, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.89% (0.2714 => 0.2901, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 6.89% (0.2802 => 0.2995, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.88% (0.2603 => 0.2782, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 6.86% (0.3180 => 0.3398, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 6.79% (0.4299 => 0.4591, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: 6.66% (0.3379 => 0.3604, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.65% (0.6450 => 0.6879, std.dev.: 0.0017) MultiSource/Applications/siod/siod: 6.55% (2.2969 => 2.4473, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/football/football: 6.46% (0.8921 => 0.9497, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.29% (0.1892 => 0.2011, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.25% (0.5981 => 0.6355, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.03% (0.1906 => 0.2021, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.01% (2.2024 => 2.3348, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.98% (0.4064 => 0.4307, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.92% (1.4186 => 1.5026, std.dev.: 0.0066) MultiSource/Benchmarks/nbench/nbench: 5.72% (1.1840 => 1.2517, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.47% (0.2266 => 0.2390, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 5.30% (1.2842 => 1.3523, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/objinst: 5.30% (0.3131 => 0.3297, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.76% (0.8101 => 0.8487, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.09% (0.3817 => 0.3973, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.04% (14.3668 => 14.9473, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.88% (0.3427 => 0.3560, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 3.65% (17.1811 => 17.8085, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.43% (1.1194 => 1.1578, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.28% (3.8922 => 4.0198, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.89% (1.1396 => 1.2523, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 9.21% (3.1595 => 3.4505, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.62% (3.1578 => 3.3670, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.65% (0.3463 => 0.3624, std.dev.: 0.0013) SingleSource/Regression/C/uint64_to_float: 3.71% (0.5413 => 0.5614) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.42% (3.6395 => 3.7639, std.dev.: 0.0055) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.79% (4.2280 => 4.3459, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.29% (1.7254 => 1.7649, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8129, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.28% (2.6546 => 2.6885, std.dev.: 0.0029) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1308, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/salsa20: -79.97% (0.8651 => 0.1733, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.88% (5.2763 => 3.2778, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.96% (5.3855 => 3.7181, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.57% (5.3526 => 3.7161, std.dev.: 0.0092) SingleSource/UnitTests/Vector/constpool: -14.57% (54.1659 => 46.2754, std.dev.: 0.0257) MultiSource/Benchmarks/FreeBench/mason/mason: -12.70% (0.0811 => 0.0708, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -10.57% (22.1758 => 19.8322, std.dev.: 0.0544) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.02% (2.9384 => 2.6440, std.dev.: 0.0101) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -33.34% (1.1492 => 0.7660, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.94% (1.6925 => 1.4227, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.93% (0.0998 => 0.0859, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -11.88% (1.2373 => 1.0903, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3783, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -9.67% (0.2161 => 0.1952, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.35% (19.9488 => 18.2827, std.dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.67% (1.8329 => 1.7107, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.30% (1.6805 => 1.5915, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: -5.10% (1.5835 => 1.5028, std.dev.: 0.0024) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.79% (1.5660 => 1.4910, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.34% (0.9957 => 0.9525, std.dev.: 0.0107) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169, std.dev.: 0.0008) MultiSource/Applications/siod/siod: -3.63% (3.2827 => 3.1636, std.dev.: 0.0111) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.4999, std.dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: -3.03% (12.4730 => 12.0956, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.22% (8.1563 => 7.9754, std.dev.: 0.0109) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.15% (8.6802 => 8.4938, std.dev.: 0.0219) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.86% (10.2830 => 10.0913, std.dev.: 0.0176) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6824, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -1.55% (2.5528 => 2.5133, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4219, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/hash: -1.09% (4.9088 => 4.8554, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.05% (6.2999 => 6.2338, std.dev.: 0.0061) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.79% (0.5229 => 0.5898, std.dev.: 0.0043) MultiSource/Applications/SPASS/SPASS: 8.66% (14.9895 => 16.2871, std.dev.: 0.0313) MultiSource/Benchmarks/MallocBench/gs/gs: 6.92% (4.1105 => 4.3949, std.dev.: 0.0220) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.58% (1.1048 => 1.2548, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.24% (7.1582 => 7.8196, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.16% (0.6222 => 0.7414, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36500.00% (0.0001 => 0.0366, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 9 02:41:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 9 Oct 2012 04:41:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121009094150.C91C12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4729?compare_to=4726&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4729, Order: 165489, Start Time: 2012-10-09 08:28:56, End Time: 2012-10-09 09:43:38 To: 4726, Order: 165485, Start Time: 2012-10-09 06:42:10, End Time: 2012-10-09 07:59:32 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (189 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1040 (747 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 2.27% (2.2516 => 2.3026, std.dev.: 0.0154) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.73% (80.6235 => 79.2296, std.dev.: 0.4264) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.80% (2.0176 => 2.4978, std.dev.: 0.0060) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.09% (0.1410 => 0.1665, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 17.07% (0.0826 => 0.0967, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 16.67% (0.2243 => 0.2617, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.71% (0.1072 => 0.1219, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.64% (0.0770 => 0.0875, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 13.62% (0.1013 => 0.1151, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.31% (0.0834 => 0.0945, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.31% (0.0819 => 0.0928, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 12.94% (0.4328 => 0.4888, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 12.88% (1.3693 => 1.5457, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.81% (0.1413 => 0.1594, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 12.70% (0.4062 => 0.4578, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 12.68% (0.5818 => 0.6556, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.61% (0.2721 => 0.3064, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 12.47% (0.5748 => 0.6465, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.42% (3.9660 => 4.4585, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.22% (0.1588 => 0.1782, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 12.16% (0.7038 => 0.7894, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.14% (0.7710 => 0.8646, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.13% (0.2596 => 0.2911, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.13% (0.1327 => 0.1488, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.03% (0.0964 => 0.1080) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.98% (0.5265 => 0.5896, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 11.95% (0.7061 => 0.7905, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.83% (1.4563 => 1.6286, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 11.69% (0.2781 => 0.3106, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.68% (0.6959 => 0.7772, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.62% (0.6283 => 0.7013, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.61% (0.2782 => 0.3105, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.60% (0.9199 => 1.0266, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.52% (0.3899 => 0.4348, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.50% (1.2193 => 1.3595, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 11.43% (13.8202 => 15.4003, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.42% (0.3485 => 0.3883, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/wc: 11.20% (0.2937 => 0.3266, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 11.20% (0.2607 => 0.2899, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.15% (0.2655 => 0.2951, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 11.13% (0.2966 => 0.3296, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.12% (0.3022 => 0.3358, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 11.12% (0.2690 => 0.2989, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 11.11% (0.1062 => 0.1180, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 11.09% (0.3489 => 0.3876, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.09% (1.1364 => 1.2624, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 11.04% (0.2628 => 0.2918, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.03% (0.4016 => 0.4459, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 11.02% (0.3293 => 0.3656, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 11.01% (1.9828 => 2.2012, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.97% (0.3756 => 0.4168, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.88% (0.1075 => 0.1192, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 10.83% (0.2760 => 0.3059, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 10.83% (0.3453 => 0.3827, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 10.82% (0.2726 => 0.3021, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.78% (0.3580 => 0.3966, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 10.77% (0.1003 => 0.1111, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 10.76% (0.2761 => 0.3058, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 10.75% (0.3868 => 0.4284, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 10.69% (0.3107 => 0.3439, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.67% (0.3130 => 0.3464, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.63% (0.2765 => 0.3059, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.61% (0.2696 => 0.2982, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 10.61% (0.3149 => 0.3483, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.59% (0.1048 => 0.1159, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.54% (0.0977 => 0.1080, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 10.51% (1.0313 => 1.1397, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.50% (0.4390 => 0.4851, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary2: 10.49% (0.3192 => 0.3527, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.33% (0.5577 => 0.6153, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.32% (0.4379 => 0.4831, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.31% (0.1435 => 0.1583, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.31% (0.4791 => 0.5285, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.29% (0.1157 => 0.1276, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 10.27% (0.3534 => 0.3897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 10.17% (0.2988 => 0.3292, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 10.15% (16.6129 => 18.2987, std.dev.: 0.0162) MultiSource/Applications/Burg/burg: 10.13% (1.1061 => 1.2181, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.12% (0.1986 => 0.2187, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 10.12% (0.2995 => 0.3298, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.09% (0.2914 => 0.3208, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/mst/mst: 10.08% (0.1111 => 0.1223, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.06% (0.1014 => 0.1116, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 10.03% (0.3220 => 0.3543, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.92% (0.2127 => 0.2338, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 9.88% (0.1589 => 0.1746, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.87% (0.1276 => 0.1402, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.83% (0.7460 => 0.8193, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.80% (0.8698 => 0.9550, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.76% (0.5637 => 0.6187, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.74% (0.3246 => 0.3562, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 9.73% (0.7506 => 0.8236, std.dev.: 0.0017) MultiSource/Applications/minisat/minisat: 9.71% (0.6744 => 0.7399, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/football/football: 9.66% (0.8310 => 0.9113, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 9.61% (0.2945 => 0.3228, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 9.57% (0.2925 => 0.3205, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.56% (0.3755 => 0.4114, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 9.51% (3.8646 => 4.2321, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.43% (7.2180 => 7.8983, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.39% (0.2023 => 0.2213, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 9.39% (1.9270 => 2.1079, std.dev.: 0.0019) MultiSource/Applications/d/make_dparser: 9.36% (3.1889 => 3.4873, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.28% (0.1865 => 0.2038, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.26% (0.6576 => 0.7185, std.dev.: 0.0017) MultiSource/Applications/siod/siod: 9.24% (2.1791 => 2.3804, std.dev.: 0.0041) MultiSource/Applications/viterbi/viterbi: 9.20% (0.1478 => 0.1614, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 9.12% (0.4003 => 0.4368, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 9.11% (0.3578 => 0.3904, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.09% (0.3511 => 0.3830, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 9.07% (1.0594 => 1.1555, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/exceptions: 9.07% (0.3914 => 0.4269, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 9.00% (0.3601 => 0.3925, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-4: 9.00% (0.3646 => 0.3974, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.99% (0.1569 => 0.1710, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.93% (0.3940 => 0.4292, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.92% (0.3789 => 0.4127, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.90% (3.6692 => 3.9956, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.89% (0.8818 => 0.9602, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.88% (0.3650 => 0.3974, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/synchronized: 8.87% (0.3663 => 0.3988, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.83% (0.3623 => 0.3943, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 8.75% (0.1657 => 0.1802, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.69% (0.2140 => 0.2326, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.69% (1.3245 => 1.4396, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.66% (0.1789 => 0.1944, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.58% (4.3801 => 4.7559, std.dev.: 0.0030) MultiSource/Applications/SIBsim4/SIBsim4: 8.55% (1.2749 => 1.3839, std.dev.: 0.0023) MultiSource/Benchmarks/sim/sim: 8.53% (0.3131 => 0.3398, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.41% (4.4433 => 4.8169, std.dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: 8.39% (14.8535 => 16.1002, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.35% (4.9865 => 5.4031, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 8.19% (0.4113 => 0.4450, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 8.16% (4.6629 => 5.0432, std.dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: 8.12% (8.4961 => 9.1859, std.dev.: 0.0224) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.00% (0.6135 => 0.6626, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.85% (1.5188 => 1.6381, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.85% (3.2742 => 3.5312, std.dev.: 0.0125) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.75% (0.1819 => 0.1960, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 7.73% (0.6250 => 0.6733, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 7.71% (1.2292 => 1.3240, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.65% (1.1333 => 1.2200, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.50% (0.9108 => 0.9791, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.37% (0.4805 => 0.5159, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.32% (0.2321 => 0.2491, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.27% (0.2504 => 0.2686, std.dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 7.15% (6.5754 => 7.0453, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/oourafft: 7.12% (0.2008 => 0.2151, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.12% (0.3245 => 0.3476, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 6.89% (3.7467 => 4.0050, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.81% (2.1007 => 2.2437, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.61% (6.2785 => 6.6938, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.79% (13.2842 => 14.0537, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.31% (0.2243 => 0.2362, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 4.33% (14.5298 => 15.1585, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: 4.31% (16.2614 => 16.9615, std.dev.: 0.0093) MultiSource/Benchmarks/Bullet/bullet: 1.85% (33.2944 => 33.9101, std.dev.: 0.0223) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5188, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/fbench: 26.69% (1.8175 => 2.3026, std.dev.: 0.0154) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.10% (1.0895 => 1.3630, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 11.02% (1.1560 => 1.2834, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.70% (0.1322 => 0.1437, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4143, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.09% (1.2998 => 1.3790, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.76% (1.9144 => 2.0056, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.88% (1.7081 => 1.7744, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.78% (10.7476 => 11.1537, std.dev.: 0.0299) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6763, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 3.24% (1.9199 => 1.9822, std.dev.: 0.0020) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.24% (7.4271 => 7.5938, std.dev.: 0.0025) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4533, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5135, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1883, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.20% (5.5130 => 5.5792, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.20% (1.9433 => 1.9666, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0269, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5905, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.00% (8.8259 => 8.9144, std.dev.: 0.0103) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.85% (0.2670 => 0.1419, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -14.71% (0.0707 => 0.0603, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -14.45% (0.4657 => 0.3984, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.34% (1.3813 => 1.1971, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.32% (1.3819 => 1.1979, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.28% (22.5627 => 22.0486, std.dev.: 0.0138) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.44% (0.0997 => 0.0863, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/mason/mason: -11.89% (0.2238 => 0.1972, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -10.94% (1.2308 => 1.0961, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.17% (20.3410 => 18.2718, std.dev.: 0.0162) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.29% (1.3780 => 1.2913, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.07% (2.6470 => 2.5129, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.59% (0.9996 => 0.9537, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8004, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1559, std.dev.: 0.0247) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.46% (1.7688 => 1.7076, std.dev.: 0.0050) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.21% (0.4867 => 0.4711, std.dev.: 0.0007) MultiSource/Applications/lua/lua: -2.68% (26.5159 => 25.8040, std.dev.: 0.0367) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4785, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -2.39% (3.0263 => 2.9539, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -2.37% (1.9762 => 1.9293, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.93% (0.6589 => 0.6462, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.83% (6.3560 => 6.2394, std.dev.: 0.0113) MultiSource/Benchmarks/mafft/pairlocalalign: -1.79% (28.2225 => 27.7176, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0064, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8656, std.dev.: 0.0133) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -1.20% (4.5928 => 4.5378, std.dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2571, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: -1.10% (9.3358 => 9.2327, std.dev.: 0.0216) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 9 03:25:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 9 Oct 2012 05:25:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121009102557.6A9A02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4730?compare_to=4728&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4730, Order: 165490, Start Time: 2012-10-09 09:07:49, End Time: 2012-10-09 10:27:44 To: 4728, Order: 165485, Start Time: 2012-10-09 07:18:34, End Time: 2012-10-09 08:38:30 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 3 (159 on baseline) Performance Improvements: 7 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1015 (757 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 23.43% (0.3913 => 0.4830, std.dev.: 0.0170) MultiSource/Benchmarks/McCat/08-main/main: 4.47% (0.3938 => 0.4114, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.45% (54.5930 => 56.4751, std.dev.: 0.0874) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -4.76% (15.6587 => 14.9137, std.dev.: 0.0113) MultiSource/Applications/JM/ldecod/ldecod: -4.42% (11.8930 => 11.3674, std.dev.: 0.0175) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.60% (2.6011 => 2.5594, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.37% (8.3937 => 8.2790, std.dev.: 0.0148) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.28% (3.7181 => 3.6706, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.24% (3.7161 => 3.6699, std.dev.: 0.0038) MultiSource/Applications/JM/lencod/lencod: -1.17% (23.5865 => 23.3105, std.dev.: 0.0278) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.05% (0.5898 => 0.5895, std.dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 0.05% (16.2871 => 16.2948, std.dev.: 0.0115) MultiSource/Benchmarks/Bullet/bullet: -0.25% (54.4846 => 54.3491, std.dev.: 0.0238) MultiSource/Benchmarks/MallocBench/gs/gs: 0.05% (4.3949 => 4.3969, std.dev.: 0.0144) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.09% (1.2548 => 1.2537, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.04% (7.8196 => 7.8225, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.38% (0.7414 => 0.7442, std.dev.: 0.0029) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.82% (0.0366 => 0.0363, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1431 => 0.1431, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.24% (0.0648 => 0.0669, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -14.06% (63.2438 => 54.3491, std.dev.: 0.0238) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.58% (14.1553 => 18.7666, std.dev.: 0.0176) SingleSource/Benchmarks/Misc-C++-EH/spirit: 62.11% (3.4629 => 5.6136, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14224.72% (0.0720 => 10.3138, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952000.00% (0.0001 => 9.9521, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 61.08% (0.2554 => 0.4114, std.dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: 43.85% (10.3673 => 14.9137, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/richards_benchmark: 35.76% (0.1622 => 0.2202, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: 32.20% (0.1056 => 0.1396, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.37% (7.0540 => 8.2790, std.dev.: 0.0148) SingleSource/Benchmarks/Misc/flops: 17.04% (0.1432 => 0.1676, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.22% (2.2022 => 2.5594, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.43% (0.1566 => 0.1792, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.29% (0.0798 => 0.0912, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.83% (1.7609 => 1.9868, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.63% (0.0871 => 0.0981, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.59% (0.0834 => 0.0939, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.39% (0.3543 => 0.3982, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 12.28% (0.3543 => 0.3978, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.92% (0.3473 => 0.3887, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.70% (0.3497 => 0.3906, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.65% (0.3561 => 0.3976, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 11.64% (0.3282 => 0.3664, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.63% (0.3516 => 0.3925, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.42% (0.3694 => 0.4116, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.26% (0.3828 => 0.4259, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 11.23% (0.3927 => 0.4368, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.17% (0.3886 => 0.4320, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.05% (0.1584 => 0.1759, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 10.49% (0.1440 => 0.1591, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: 10.39% (0.1655 => 0.1827, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.06% (0.3121 => 0.3435, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.04% (0.4879 => 0.5369, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.87% (0.1125 => 0.1236, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: 9.75% (0.7115 => 0.7809, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.69% (0.3177 => 0.3485, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.67% (0.1438 => 0.1577, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.62% (0.6675 => 0.7317, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 9.54% (9.4845 => 10.3890, std.dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: 9.27% (0.7433 => 0.8122, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.26% (1.5415 => 1.6842, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.25% (0.5860 => 0.6402, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/Hello: 9.15% (0.5925 => 0.6467, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference-object: 9.07% (0.6030 => 0.6577, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 9.02% (0.1175 => 0.1281, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.93% (0.4615 => 0.5027, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 8.92% (10.4361 => 11.3674, std.dev.: 0.0175) MultiSource/Applications/oggenc/oggenc: 8.91% (5.7591 => 6.2720, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 8.82% (0.3423 => 0.3725, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 8.81% (0.3109 => 0.3383, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.72% (0.8172 => 0.8885, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.70% (0.2758 => 0.2998, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/em3d/em3d: 8.67% (0.1695 => 0.1842, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 8.64% (3.3354 => 3.6235, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.62% (0.1625 => 0.1765, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.62% (0.8067 => 0.8762, std.dev.: 0.0077) MultiSource/Applications/hbd/hbd: 8.54% (1.5603 => 1.6936, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.50% (0.5105 => 0.5539, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.50% (0.2271 => 0.2464, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.50% (1.3050 => 1.4159, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.44% (0.2700 => 0.2928, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 8.44% (0.7835 => 0.8496, std.dev.: 0.0031) SingleSource/Regression/C++/ofstream_ctor: 8.33% (0.2905 => 0.3147, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 8.32% (0.6456 => 0.6993, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.28% (0.2065 => 0.2236, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.28% (4.2646 => 4.6176, std.dev.: 0.0044) SingleSource/UnitTests/ObjC++/property-reference: 8.27% (0.7326 => 0.7932, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.24% (0.5569 => 0.6028, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists: 8.15% (0.3422 => 0.3701, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.12% (0.2107 => 0.2278, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash: 8.11% (0.4289 => 0.4637, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.10% (8.1363 => 8.7952, std.dev.: 0.0173) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.07% (0.3307 => 0.3574, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.03% (4.9449 => 5.3421, std.dev.: 0.0134) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.03% (5.0018 => 5.4035, std.dev.: 0.0109) MultiSource/Applications/Burg/burg: 8.02% (1.1642 => 1.2576, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/fibo: 7.89% (0.2725 => 0.2940, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.88% (0.1510 => 0.1629, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.87% (0.4103 => 0.4426, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.85% (0.9765 => 1.0532, std.dev.: 0.0039) MultiSource/Applications/viterbi/viterbi: 7.85% (0.1555 => 0.1677, std.dev.: 0.0029) MultiSource/Benchmarks/sim/sim: 7.82% (0.3387 => 0.3652, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 7.81% (0.4048 => 0.4364, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.74% (0.3865 => 0.4164, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.73% (0.4203 => 0.4528, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.73% (0.2756 => 0.2969, std.dev.: 0.0050) MultiSource/Applications/lua/lua: 7.71% (3.8723 => 4.1707, std.dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.67% (0.5020 => 0.5405, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hello: 7.63% (0.2714 => 0.2921, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.59% (0.2793 => 0.3005, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.59% (7.9617 => 8.5657, std.dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.56% (0.3650 => 0.3926, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.55% (0.1337 => 0.1438, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.55% (0.4620 => 0.4969, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.53% (0.1940 => 0.2086, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.49% (0.3136 => 0.3371, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.47% (0.2891 => 0.3107, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.46% (0.4636 => 0.4982, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/strcat: 7.42% (0.2831 => 0.3041, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 7.41% (0.3603 => 0.3870, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.39% (2.0665 => 2.2193, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.37% (0.3826 => 0.4108, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 7.36% (0.3684 => 0.3955, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 7.30% (0.3232 => 0.3468, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 7.26% (1.0722 => 1.1500, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.25% (0.3283 => 0.3521, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary2: 7.22% (0.3379 => 0.3623, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 7.21% (0.3052 => 0.3272, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.19% (0.2877 => 0.3084, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.15% (0.3162 => 0.3388, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 7.13% (2.0273 => 2.1718, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/except: 7.11% (0.2871 => 0.3075, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.10% (0.2872 => 0.3076, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 7.10% (0.3098 => 0.3318, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.99% (1.5859 => 1.6967, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 6.95% (0.3180 => 0.3401, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.90% (1.1861 => 1.2680, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/random: 6.89% (0.2802 => 0.2995, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.86% (0.3441 => 0.3677, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.72% (0.2603 => 0.2778, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 6.64% (0.8921 => 0.9513, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/05-eks/eks: 6.63% (0.4299 => 0.4584, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.62% (0.6450 => 0.6877, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 6.57% (2.2969 => 2.4478, std.dev.: 0.0130) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.55% (0.1892 => 0.2016, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.44% (0.5981 => 0.6366, std.dev.: 0.0041) MultiSource/Applications/JM/lencod/lencod: 6.26% (21.9371 => 23.3105, std.dev.: 0.0278) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.05% (0.4064 => 0.4310, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.92% (2.2024 => 2.3328, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.82% (0.1906 => 0.2017, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.68% (1.4186 => 1.4992, std.dev.: 0.0046) MultiSource/Benchmarks/nbench/nbench: 5.57% (1.1840 => 1.2499, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 5.40% (0.3131 => 0.3300, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 5.39% (1.2842 => 1.3534, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/ReedSolomon: 5.32% (0.2049 => 0.2158, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.12% (0.2266 => 0.2382, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.72% (0.8101 => 0.8483, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.01% (0.3817 => 0.3970, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.88% (0.3427 => 0.3560, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.84% (14.3668 => 14.9186, std.dev.: 0.0147) MultiSource/Applications/sqlite3/sqlite3: 3.63% (17.1811 => 17.8056, std.dev.: 0.0189) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.06% (3.8922 => 4.0112, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.93% (1.1194 => 1.1522, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.22% (1.1145 => 1.3844, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.96% (1.1396 => 1.2531, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.18% (3.1595 => 3.4496, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3685, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 3.68% (0.5413 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.59% (3.6395 => 3.7701, std.dev.: 0.0019) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.60% (4.2280 => 4.3381, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.33% (1.7254 => 1.7656, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.46% (0.9540 => 0.9679, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8127, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.18% (2.6546 => 2.6859, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.02% (6.6874 => 0.1325, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.09% (5.2763 => 3.2664, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.84% (5.3855 => 3.6706, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.44% (5.3526 => 3.6699, std.dev.: 0.0038) SingleSource/UnitTests/Vector/constpool: -14.44% (54.1659 => 46.3442, std.dev.: 0.0115) MultiSource/Benchmarks/FreeBench/mason/mason: -12.70% (0.0811 => 0.0708, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -10.64% (22.1758 => 19.8167, std.dev.: 0.0419) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.51% (2.9384 => 2.6296, std.dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4243, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.83% (0.0998 => 0.0860, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -11.86% (1.2373 => 1.0905, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3783, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/mason/mason: -9.90% (0.2161 => 0.1947, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.26% (19.9488 => 18.3020, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.74% (1.8329 => 1.7094, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.30% (1.6805 => 1.5915, std.dev.: 0.0041) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7963, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.60% (1.5835 => 1.5107, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.10% (0.9957 => 0.9549, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.74% (1.3677 => 1.3166, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1627, std.dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5006, std.dev.: 0.0092) MultiSource/Applications/hexxagon/hexxagon: -3.02% (12.4730 => 12.0963, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.19% (8.1563 => 7.9777, std.dev.: 0.0284) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.86% (10.2830 => 10.0914, std.dev.: 0.0085) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.85% (8.6802 => 8.5200, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6832, std.dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.66% (2.5528 => 2.5104, std.dev.: 0.0022) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4221, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout/lists: -1.14% (6.2999 => 6.2281, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.03% (1.0313 => 1.0207, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8586, std.dev.: 0.0090) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.74% (0.5229 => 0.5895, std.dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 8.71% (14.9895 => 16.2948, std.dev.: 0.0115) MultiSource/Benchmarks/MallocBench/gs/gs: 6.97% (4.1105 => 4.3969, std.dev.: 0.0144) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.48% (1.1048 => 1.2537, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.28% (7.1582 => 7.8225, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.61% (0.6222 => 0.7442, std.dev.: 0.0029) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36200.00% (0.0001 => 0.0363, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.38% (0.2116 => 0.0669, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 9 04:26:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 9 Oct 2012 06:26:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121009112600.EDC832A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4731?compare_to=4729&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4731, Order: 165496, Start Time: 2012-10-09 10:12:43, End Time: 2012-10-09 11:27:48 To: 4729, Order: 165489, Start Time: 2012-10-09 08:28:56, End Time: 2012-10-09 09:43:38 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (189 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1038 (747 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 21.76% (0.3925 => 0.4779, std.dev.: 0.0079) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.84% (53.5896 => 55.6482, std.dev.: 0.5054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.32% (79.2296 => 80.2790, std.dev.: 0.3675) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -1.72% (2.3026 => 2.2629, std.dev.: 0.0090) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.85% (2.0176 => 2.4987, std.dev.: 0.0053) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.09% (0.1410 => 0.1665, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 16.95% (0.0826 => 0.0966, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 15.83% (0.2243 => 0.2598, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.43% (0.1072 => 0.1216, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 13.34% (0.5818 => 0.6594, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 13.23% (0.1013 => 0.1147, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 13.20% (0.5748 => 0.6507, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.12% (0.0770 => 0.0871, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.07% (0.0834 => 0.0943, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.82% (0.0819 => 0.0924, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.74% (0.1413 => 0.1593, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 12.71% (0.4328 => 0.4878, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 12.53% (0.7061 => 0.7946, std.dev.: 0.0025) MultiSource/Applications/hbd/hbd: 12.41% (1.3693 => 1.5392, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 12.28% (0.7038 => 0.7902, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.27% (0.2721 => 0.3055, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 12.21% (0.4062 => 0.4558, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.21% (0.1327 => 0.1489, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.15% (3.9660 => 4.4478, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.96% (0.1588 => 0.1778, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 11.87% (0.2781 => 0.3111, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.86% (0.2596 => 0.2904, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.83% (0.0964 => 0.1078, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.75% (0.3899 => 0.4357, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.68% (0.2782 => 0.3107, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.65% (0.7710 => 0.8608, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.56% (0.3485 => 0.3888, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.55% (1.4563 => 1.6245, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.48% (0.6959 => 0.7758, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.36% (0.6283 => 0.6997, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.34% (1.2193 => 1.3576, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.32% (0.3022 => 0.3364, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.30% (0.5265 => 0.5860, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.26% (0.9199 => 1.0235, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 11.26% (0.2726 => 0.3033, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.21% (0.4016 => 0.4466, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 11.19% (0.2690 => 0.2991, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 11.17% (0.2937 => 0.3265, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 11.16% (13.8202 => 15.3630, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hello: 11.16% (0.2607 => 0.2898, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 11.14% (0.3293 => 0.3660, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 11.14% (1.9828 => 2.2037, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 11.13% (0.2966 => 0.3296, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 11.09% (0.2760 => 0.3066, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 11.07% (0.2628 => 0.2919, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 11.06% (0.3489 => 0.3875, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 11.05% (0.2761 => 0.3066, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 11.04% (0.3107 => 0.3450, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.04% (0.2655 => 0.2948, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 11.03% (0.2765 => 0.3070, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 11.02% (0.3149 => 0.3496, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 11.02% (0.1062 => 0.1179, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.94% (0.3756 => 0.4167, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 10.92% (0.3453 => 0.3830, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.87% (1.1364 => 1.2599, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.87% (0.3580 => 0.3969, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 10.83% (0.3868 => 0.4287, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.61% (0.2696 => 0.2982, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.60% (0.1075 => 0.1189, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 10.59% (0.3192 => 0.3530, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.57% (0.4390 => 0.4854, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 10.57% (0.1003 => 0.1109, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 10.50% (0.3534 => 0.3905, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 10.44% (0.2988 => 0.3300, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.34% (0.0977 => 0.1078, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.22% (0.3130 => 0.3450, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.20% (0.1157 => 0.1275, std.dev.: 0.0046) MultiSource/Applications/lemon/lemon: 10.17% (1.0313 => 1.1362, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 10.14% (16.6129 => 18.2974, std.dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.12% (0.4379 => 0.4822, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.07% (0.1986 => 0.2186, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.04% (0.4791 => 0.5272, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.99% (0.5577 => 0.6134, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 9.98% (1.1061 => 1.2165, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/objinst: 9.95% (0.2945 => 0.3238, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 9.88% (0.2995 => 0.3291, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.81% (0.2914 => 0.3200, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.77% (0.3246 => 0.3563, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.73% (0.7460 => 0.8186, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: 9.69% (0.1589 => 0.1743, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 9.63% (0.1111 => 0.1218, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.63% (0.6576 => 0.7209, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.59% (0.2127 => 0.2331, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 9.56% (0.6744 => 0.7389, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.55% (0.8698 => 0.9529, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.43% (0.3755 => 0.4109, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.41% (0.1435 => 0.1570, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.37% (0.5637 => 0.6165, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 9.35% (0.3220 => 0.3521, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 9.30% (3.8646 => 4.2241, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.29% (7.2180 => 7.8884, std.dev.: 0.0033) MultiSource/Applications/spiff/spiff: 9.27% (0.7506 => 0.8202, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 9.25% (0.8310 => 0.9079, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 9.21% (1.9270 => 2.1044, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 9.18% (3.1889 => 3.4815, std.dev.: 0.0058) MultiSource/Applications/siod/siod: 9.12% (2.1791 => 2.3778, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.09% (0.1276 => 0.1392, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.06% (0.3511 => 0.3829, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.05% (0.2023 => 0.2206, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.95% (0.1865 => 0.2032, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 8.93% (0.1478 => 0.1610, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 8.79% (1.0594 => 1.1525, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 8.79% (0.2925 => 0.3182, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.64% (0.4003 => 0.4349, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.60% (0.1569 => 0.1704, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.52% (0.3578 => 0.3883, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/em3d/em3d: 8.51% (0.1657 => 0.1798, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.51% (3.6692 => 3.9814, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/exceptions: 8.51% (0.3914 => 0.4247, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 8.43% (1.2749 => 1.3824, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.40% (1.3245 => 1.4357, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 8.39% (0.3601 => 0.3903, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.38% (0.3940 => 0.4270, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.34% (0.3789 => 0.4105, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.34% (0.3646 => 0.3950, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 8.34% (0.3131 => 0.3392, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.32% (0.8818 => 0.9552, std.dev.: 0.0085) SingleSource/UnitTests/ObjC/synchronized: 8.30% (0.3663 => 0.3967, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.28% (0.3623 => 0.3923, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.22% (0.3650 => 0.3950, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.18% (0.2140 => 0.2315, std.dev.: 0.0043) MultiSource/Applications/JM/lencod/lencod: 8.16% (14.8535 => 16.0654, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.10% (4.3801 => 4.7350, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.07% (4.4433 => 4.8019, std.dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: 8.05% (1.2292 => 1.3281, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.05% (4.9865 => 5.3877, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.99% (0.1789 => 0.1932, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 7.93% (8.4961 => 9.1696, std.dev.: 0.0070) MultiSource/Applications/oggenc/oggenc: 7.90% (4.6629 => 5.0313, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/bigfib: 7.86% (0.6250 => 0.6741, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.84% (0.6135 => 0.6616, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.58% (1.5188 => 1.6339, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.48% (0.1819 => 0.1955, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 7.46% (0.4113 => 0.4420, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.45% (3.2742 => 3.5182, std.dev.: 0.0182) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.39% (1.1333 => 1.2171, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.35% (0.4805 => 0.5158, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.18% (0.9108 => 0.9762, std.dev.: 0.0111) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.11% (0.2504 => 0.2682, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.09% (0.3245 => 0.3475, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.98% (0.2321 => 0.2483, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 6.85% (6.5754 => 7.0258, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/oourafft: 6.72% (0.2008 => 0.2143, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 6.71% (3.7467 => 3.9982, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.60% (2.1007 => 2.2393, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.54% (6.2785 => 6.6891, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.89% (13.2842 => 14.0672, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/ReedSolomon: 5.85% (0.1777 => 0.1881, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.26% (0.2243 => 0.2361, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 4.36% (16.2614 => 16.9701, std.dev.: 0.0040) MultiSource/Applications/ClamAV/clamscan: 4.17% (14.5298 => 15.1357, std.dev.: 0.0061) MultiSource/Benchmarks/Bullet/bullet: 1.91% (33.2944 => 33.9305, std.dev.: 0.0152) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5167, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.51% (1.8175 => 2.2629, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/richards_benchmark: 11.10% (1.1560 => 1.2843, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 9.02% (0.8273 => 0.9019, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4138, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 5.96% (1.2998 => 1.3773, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.92% (0.2093 => 0.2196, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0047, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.68% (0.3139 => 0.3286, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.80% (10.7476 => 11.1565, std.dev.: 0.0532) MultiSource/Benchmarks/nbench/nbench: 3.67% (11.2619 => 11.6756, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.34% (1.9199 => 1.9841, std.dev.: 0.0021) SingleSource/Regression/C/uint64_to_float: 2.97% (0.5449 => 0.5611, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.22% (7.4271 => 7.5919, std.dev.: 0.0047) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4539, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5124, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1889, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9668, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5784, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 1.12% (12.4560 => 12.5957, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.10% (8.8259 => 8.9232, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0270, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1407, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.89% (0.2670 => 0.1418, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -14.92% (0.4657 => 0.3962, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -14.85% (0.0707 => 0.0602) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.47% (1.3813 => 1.1953, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.46% (1.3819 => 1.1959, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.43% (22.5627 => 22.0133, std.dev.: 0.0104) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.44% (0.0997 => 0.0863, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.11% (0.2238 => 0.1967, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.68% (1.2308 => 1.0870, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.23% (20.3410 => 18.2597, std.dev.: 0.0222) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.99% (1.3780 => 1.2955, std.dev.: 0.0067) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5150, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.12% (0.9996 => 0.9584, std.dev.: 0.0110) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.60% (0.4867 => 0.4692, std.dev.: 0.0015) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1562, std.dev.: 0.0160) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.51% (1.7688 => 1.7068, std.dev.: 0.0188) MultiSource/Applications/lua/lua: -2.59% (26.5159 => 25.8289, std.dev.: 0.0336) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4785, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.42% (3.0263 => 2.9531, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.33% (1.9762 => 1.9302, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.94% (0.6589 => 0.6461, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.83% (6.3560 => 6.2395, std.dev.: 0.0103) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7133, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.54% (0.6615 => 0.6513, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0075, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -1.25% (4.5928 => 4.5355, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4944, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/heapsort: -1.21% (3.9173 => 3.8698, std.dev.: 0.0151) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2578, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: -1.06% (9.3358 => 9.2369, std.dev.: 0.0151) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 9 04:47:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 9 Oct 2012 06:47:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121009114734.AC92C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4732?compare_to=4727&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4732, Order: 165490, Start Time: 2012-10-09 09:05:18, End Time: 2012-10-09 11:49:23 To: 4727, Order: 165482, Start Time: 2012-10-09 05:49:55, End Time: 2012-10-09 08:36:00 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (138 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 1042 (825 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.54% (0.3446 => 0.3878, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.41% (0.3488 => 0.3921, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 12.38% (0.3465 => 0.3894, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.38% (0.3442 => 0.3868, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.36% (0.3496 => 0.3928, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.25% (0.3469 => 0.3894, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 12.23% (0.3460 => 0.3883, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 12.05% (0.3643 => 0.4082, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.97% (0.3650 => 0.4087, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.76% (0.1063 => 0.1188, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.68% (0.3724 => 0.4159, std.dev.: 0.0036) MultiSource/Applications/oggenc/oggenc: 11.66% (1.5932 => 1.7789, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 10.35% (0.5826 => 0.6429, std.dev.: 0.0058) SingleSource/UnitTests/ObjC++/property-reference-object: 10.22% (0.5889 => 0.6491, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 9.39% (0.1619 => 0.1771, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.22% (0.2875 => 0.3140, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.18% (0.7171 => 0.7829, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/08-main/main: 9.11% (0.1218 => 0.1329, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 9.08% (0.1421 => 0.1550, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.01% (0.3195 => 0.3483, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.95% (0.2738 => 0.2983, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 8.88% (0.2725 => 0.2967, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 8.85% (0.2803 => 0.3051, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 8.84% (0.2714 => 0.2954, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.81% (0.4994 => 0.5434, std.dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 8.75% (0.3004 => 0.3267, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.72% (0.2729 => 0.2967, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 8.71% (0.2813 => 0.3058, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 8.69% (0.3096 => 0.3365, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 8.68% (0.2823 => 0.3068, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.67% (0.2792 => 0.3034, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.60% (2.0673 => 2.2450, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 8.56% (0.2780 => 0.3018, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 8.56% (0.9909 => 1.0757, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/strcat: 8.55% (0.2750 => 0.2985, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.53% (1.6211 => 1.7594, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.53% (0.3060 => 0.3321, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.52% (0.2911 => 0.3159, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 8.51% (5.5417 => 6.0132, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.48% (1.3152 => 1.4267, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 8.43% (0.2811 => 0.3048, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.36% (0.3362 => 0.3643, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary3: 8.33% (0.3267 => 0.3539, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.27% (0.1620 => 0.1754, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 8.24% (0.3678 => 0.3981, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 8.20% (0.3317 => 0.3589, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.15% (3.5627 => 3.8529, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.14% (0.4361 => 0.4716, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 8.13% (0.3726 => 0.4029, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 8.10% (0.3258 => 0.3522, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 8.09% (0.4847 => 0.5239, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 8.00% (0.3477 => 0.3755, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 7.97% (0.3348 => 0.3615, std.dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.96% (2.7292 => 2.9465, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.96% (0.3845 => 0.4151, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.95% (0.3282 => 0.3543, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.90% (0.5000 => 0.5395, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.89% (0.3625 => 0.3911, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hash: 7.89% (0.4146 => 0.4473, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.85% (0.2014 => 0.2172, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.81% (0.3124 => 0.3368, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.72% (0.3690 => 0.3975, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (0.4251 => 0.4574, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 7.58% (23.5202 => 25.3028, std.dev.: 0.0102) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.58% (0.5900 => 0.6347, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 7.54% (1.0781 => 1.1594, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.36% (0.5026 => 0.5396, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.36% (0.3981 => 0.4274, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 7.36% (4.2109 => 4.5208, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.28% (0.3930 => 0.4216, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.27% (0.2736 => 0.2935, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 7.26% (0.9697 => 1.0401, std.dev.: 0.0021) MultiSource/Applications/siod/siod: 7.25% (0.6634 => 0.7115, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.23% (0.3084 => 0.3307, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 7.22% (0.3336 => 0.3577, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.22% (0.2866 => 0.3073, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.20% (0.4139 => 0.4437, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.20% (0.6435 => 0.6898, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.18% (0.1462 => 0.1567, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 7.18% (0.1505 => 0.1613, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 7.16% (0.5012 => 0.5371, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.15% (0.3903 => 0.4182, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 7.13% (0.2566 => 0.2749, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.10% (0.1549 => 0.1659, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 7.05% (0.4029 => 0.4313, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.01% (0.2737 => 0.2929, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.89% (0.3890 => 0.4158, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.87% (0.2068 => 0.2210, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.86% (0.1968 => 0.2103, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 6.81% (2.1013 => 2.2443, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.70% (4.4195 => 4.7154, std.dev.: 0.0040) MultiSource/Applications/lua/lua: 6.69% (1.4269 => 1.5223, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/gs/gs: 6.56% (1.8794 => 2.0027, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.50% (0.2969 => 0.3162, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 6.47% (0.5546 => 0.5905, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.47% (0.2103 => 0.2239, std.dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 6.46% (4.6177 => 4.9159, std.dev.: 0.0022) MultiSource/Applications/treecc/treecc: 6.30% (0.7875 => 0.8371, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.29% (0.4658 => 0.4951, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.27% (0.3271 => 0.3476, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 6.13% (2.1653 => 2.2980, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.08% (0.2040 => 0.2164, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 5.98% (0.2691 => 0.2852, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 5.78% (2.0346 => 2.1523, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/football/football: 5.78% (0.2075 => 0.2195, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.64% (0.7426 => 0.7845, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.61% (1.9966 => 2.1086, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.55% (1.9694 => 2.0788, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.32% (0.5361 => 0.5646, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 5.27% (0.2391 => 0.2517, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.14% (0.5584 => 0.5871, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.92% (11.6398 => 12.2125, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.68% (4.6926 => 4.9121, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 4.66% (0.3498 => 0.3661, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 3.58% (11.9555 => 12.3835, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.39% (0.4253 => 0.4397, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.14% (0.3792 => 0.3911, std.dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.02% (0.2122 => 0.2271, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6116, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (12.0509 => 12.6789, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-2: 5.03% (1.8057 => 1.8966, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1663, std.dev.: 0.0831) SingleSource/Benchmarks/Dhrystone/dry: 4.16% (14.0481 => 14.6329, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2022, std.dev.: 0.0441) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5020, std.dev.: 0.0243) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.61% (3.1722 => 3.2234, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2864, std.dev.: 0.0046) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5922, std.dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.96% (25.4195 => 16.5335, std.dev.: 0.0236) SingleSource/Benchmarks/Shootout-C++/ary2: -8.24% (0.2402 => 0.2204, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9789, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8080, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.76% (11.2080 => 10.7861, std.dev.: 0.0156) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7728, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.02% (0.6293 => 0.6103, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8571, std.dev.: 0.0055) SingleSource/Benchmarks/Dhrystone/fldry: -2.19% (17.2379 => 16.8598, std.dev.: 0.0094) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5756, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4955, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (105.3826 => 104.1587, std.dev.: 0.0581) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0455, std.dev.: 0.0041) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 9 05:14:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 9 Oct 2012 07:14:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121009121451.9A37E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4733?compare_to=4730&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4733, Order: 165497, Start Time: 2012-10-09 10:57:07, End Time: 2012-10-09 12:16:39 To: 4730, Order: 165490, Start Time: 2012-10-09 09:07:49, End Time: 2012-10-09 10:27:44 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 3 (158 on baseline) Performance Improvements: 1 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1021 (759 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.17% (14.9137 => 15.2372, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.07% (2.5594 => 2.5869, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.02% (3.6706 => 3.7079, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.20% (3.8663 => 3.7812, std.dev.: 0.0191) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.15% (0.5895 => 0.5904, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 0.08% (16.2948 => 16.3081, std.dev.: 0.0052) MultiSource/Benchmarks/Bullet/bullet: 0.48% (54.3491 => 54.6075, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/gs/gs: 0.04% (4.3969 => 4.3986, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.05% (1.2537 => 1.2531, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.16% (7.8225 => 7.8100, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.17% (0.7442 => 0.7429, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.55% (0.0363 => 0.0361, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1431 => 0.1430, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.30% (0.0669 => 0.0671, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -13.66% (63.2438 => 54.6075, std.dev.: 0.0031) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.78% (14.1553 => 18.7957, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++-EH/spirit: 62.18% (3.4629 => 5.6163, std.dev.: 0.0037) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14227.36% (0.0720 => 10.3157, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9951900.00% (0.0001 => 9.9520, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 61.35% (0.2554 => 0.4121, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 46.97% (10.3673 => 15.2372, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/richards_benchmark: 37.48% (0.1622 => 0.2230, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 32.39% (0.1056 => 0.1398, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.13% (7.0540 => 8.3328, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.47% (2.2022 => 2.5869, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 17.46% (0.1432 => 0.1682, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.91% (0.0834 => 0.0975, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.69% (0.1566 => 0.1796, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.04% (1.7609 => 1.9905, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/oourafft: 12.71% (0.3282 => 0.3699, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.63% (0.0871 => 0.0981) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.00% (0.3543 => 0.3968, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 11.66% (0.3473 => 0.3878, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.63% (0.3561 => 0.3975, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-4: 11.60% (0.3543 => 0.3954, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 11.50% (0.3497 => 0.3899, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.46% (0.3516 => 0.3919, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.43% (0.1584 => 0.1765, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.32% (0.3694 => 0.4112, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.07% (0.3886 => 0.4316, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 11.05% (0.3828 => 0.4251, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.00% (0.3927 => 0.4359, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.80% (0.4879 => 0.5406, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: 10.69% (0.1440 => 0.1594, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.43% (0.1438 => 0.1588, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.98% (0.3177 => 0.3494, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 9.94% (10.4361 => 11.4737, std.dev.: 0.0092) MultiSource/Benchmarks/mafft/pairlocalalign: 9.93% (9.4845 => 10.4267, std.dev.: 0.0110) MultiSource/Applications/oggenc/oggenc: 9.74% (5.7591 => 6.3202, std.dev.: 0.0056) MultiSource/Applications/minisat/minisat: 9.74% (0.7115 => 0.7808, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.69% (0.6675 => 0.7322, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 9.55% (0.1655 => 0.1813, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 9.39% (0.3109 => 0.3401, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 9.30% (0.5925 => 0.6476, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.24% (0.6030 => 0.6587, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.18% (1.5415 => 1.6830, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 9.16% (0.7433 => 0.8114, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.93% (0.4615 => 0.5027, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.93% (0.2700 => 0.2941) MultiSource/Benchmarks/McCat/18-imp/imp: 8.85% (0.3423 => 0.3726, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 8.85% (0.1175 => 0.1279, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 8.73% (0.1695 => 0.1843, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.68% (0.1625 => 0.1766, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 8.64% (3.3354 => 3.6235, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.62% (0.5105 => 0.5545, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.54% (1.3050 => 1.4165, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.50% (0.8172 => 0.8867, std.dev.: 0.0049) SingleSource/UnitTests/ObjC++/property-reference: 8.48% (0.7326 => 0.7947, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.47% (4.2646 => 4.6260, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.45% (0.2271 => 0.2463, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.38% (0.2065 => 0.2238, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.33% (0.5860 => 0.6348, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 8.31% (1.5603 => 1.6899, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.30% (0.5569 => 0.6031, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.25% (0.1236 => 0.1338, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.24% (4.9449 => 5.3524, std.dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.23% (0.3121 => 0.3378, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.22% (0.3307 => 0.3579, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.21% (0.1510 => 0.1634, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.19% (0.8067 => 0.8728, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.17% (5.0018 => 5.4105, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 8.15% (0.6456 => 0.6982, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.14% (0.1892 => 0.2046, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.13% (8.1363 => 8.7980, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/lists: 8.12% (0.3422 => 0.3700, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.12% (0.2107 => 0.2278, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.02% (0.3865 => 0.4175, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash: 8.02% (0.4289 => 0.4633, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.00% (0.1337 => 0.1444, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.99% (0.4103 => 0.4431, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.98% (0.2831 => 0.3057, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.94% (0.2758 => 0.2977, std.dev.: 0.0049) MultiSource/Applications/Burg/burg: 7.91% (1.1642 => 1.2563, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.90% (0.9765 => 1.0536, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 7.88% (0.3387 => 0.3654, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.87% (7.9617 => 8.5882, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.85% (0.4636 => 0.5000, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.83% (0.4203 => 0.4532, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.82% (0.2891 => 0.3117, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.81% (0.2905 => 0.3132, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.78% (0.3136 => 0.3380, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.77% (0.5020 => 0.5410, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 7.75% (0.7835 => 0.8442, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.73% (0.1940 => 0.2090, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.73% (0.3650 => 0.3932, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 7.66% (3.8723 => 4.1690, std.dev.: 0.0075) MultiSource/Applications/viterbi/viterbi: 7.65% (0.1555 => 0.1674, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.62% (0.3162 => 0.3403, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 7.56% (0.4048 => 0.4354, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/wc: 7.54% (0.3052 => 0.3282, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.49% (0.4620 => 0.4966, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 7.47% (0.3603 => 0.3872, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary: 7.46% (0.3232 => 0.3473, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.40% (0.2756 => 0.2960, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.40% (0.3826 => 0.4109, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.37% (2.0665 => 2.2189, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 7.37% (0.3283 => 0.3525, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.37% (0.2714 => 0.2914, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 7.34% (0.2725 => 0.2925, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 7.33% (0.3684 => 0.3954, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 7.30% (0.3098 => 0.3324, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.28% (0.2871 => 0.3080, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.28% (0.2872 => 0.3081, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 7.23% (1.0722 => 1.1497, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 7.17% (0.2802 => 0.3003, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 7.17% (2.0273 => 2.1726, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.16% (1.5859 => 1.6995, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.16% (0.2793 => 0.2993, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 7.13% (0.2877 => 0.3082, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 7.07% (0.4299 => 0.4603, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.00% (0.3441 => 0.3682, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.93% (1.1861 => 1.2683, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.76% (0.2603 => 0.2779, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 6.76% (0.3180 => 0.3395, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.74% (0.6450 => 0.6885, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 6.72% (2.2969 => 2.4513, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/ary2: 6.69% (0.3379 => 0.3605, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 6.66% (21.9371 => 23.3972, std.dev.: 0.0243) MultiSource/Benchmarks/Prolangs-C/football/football: 6.47% (0.8921 => 0.9498, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.30% (0.5981 => 0.6358, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.23% (2.2024 => 2.3396, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.14% (0.1906 => 0.2023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.10% (0.4064 => 0.4312, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.82% (1.4186 => 1.5012, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 5.80% (1.1840 => 1.2527, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.65% (0.3131 => 0.3308, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.60% (0.2266 => 0.2393, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 5.30% (1.2842 => 1.3522, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.95% (0.8101 => 0.8502, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.04% (14.3668 => 14.9478, std.dev.: 0.0064) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.80% (0.3817 => 0.3962, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.74% (0.3427 => 0.3555, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 3.68% (17.1811 => 17.8134, std.dev.: 0.0180) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.43% (1.1194 => 1.1578, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.43% (3.8922 => 4.0256, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.26% (1.1145 => 1.3849, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.78% (1.1396 => 1.2510, std.dev.: 0.0021) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4498, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.73% (3.1578 => 3.3703, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.65% (0.3463 => 0.3624, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.4162 => 0.4322, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.54% (3.6395 => 3.7684, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.86% (4.2280 => 4.3489, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7655, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8132, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.36% (2.6546 => 2.6906, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.08% (6.5088 => 6.5792, std.dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1310, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -80.12% (0.8651 => 0.1720, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.76% (5.2763 => 3.2838, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.15% (5.3855 => 3.7079, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.81% (5.3526 => 3.7033, std.dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -14.49% (54.1659 => 46.3199, std.dev.: 0.0163) MultiSource/Benchmarks/FreeBench/mason/mason: -12.58% (0.0811 => 0.0709) MultiSource/Applications/ClamAV/clamscan: -10.65% (22.1758 => 19.8142, std.dev.: 0.0123) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.23% (2.9384 => 2.6378, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.53% (1.1492 => 0.7639, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: -15.78% (1.6925 => 1.4255, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.63% (0.0998 => 0.0862, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.23% (1.2373 => 1.0984, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -10.36% (1.5373 => 1.3780, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/mason/mason: -10.04% (0.2161 => 0.1944, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.34% (19.9488 => 18.2849, std.dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.73% (1.8329 => 1.7095, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.31% (1.6805 => 1.5913, std.dev.: 0.0040) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7963, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.91% (1.5835 => 1.5058, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.31% (0.9957 => 0.9528, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1625, std.dev.: 0.0060) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5034, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: -2.99% (12.4730 => 12.1005, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.15% (8.6802 => 8.4939, std.dev.: 0.0077) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.94% (8.1563 => 7.9981, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/salsa20: -1.86% (10.2830 => 10.0918, std.dev.: 0.0136) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6790, std.dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.64% (2.5528 => 2.5110, std.dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4208, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/lists: -1.14% (6.2999 => 6.2279, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout/hash: -1.09% (4.9088 => 4.8554, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/whetstone: -1.08% (1.0554 => 1.0440, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.91% (0.5229 => 0.5904, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 8.80% (14.9895 => 16.3081, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/gs/gs: 7.01% (4.1105 => 4.3986, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.42% (1.1048 => 1.2531, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.11% (7.1582 => 7.8100, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.40% (0.6222 => 0.7429, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36000.00% (0.0001 => 0.0361, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.70% (0.1485 => 0.1430, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.29% (0.2116 => 0.0671, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 9 06:09:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 9 Oct 2012 08:09:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121009130939.9259A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4734?compare_to=4731&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4734, Order: 165498, Start Time: 2012-10-09 11:56:45, End Time: 2012-10-09 13:11:27 To: 4731, Order: 165496, Start Time: 2012-10-09 10:12:43, End Time: 2012-10-09 11:27:48 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (189 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1041 (747 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.22% (80.2790 => 81.2582, std.dev.: 0.2146) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.58% (2.0176 => 2.4933, std.dev.: 0.0172) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.01% (0.1410 => 0.1664, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 17.31% (0.0826 => 0.0969) MultiSource/Benchmarks/McCat/08-main/main: 16.01% (0.2243 => 0.2602, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.53% (0.0819 => 0.0938, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.51% (0.0770 => 0.0874, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.31% (0.0834 => 0.0945, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/tsp/tsp: 13.23% (0.1013 => 0.1147, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 12.94% (0.4328 => 0.4888, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.81% (0.1413 => 0.1594, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 12.67% (1.3693 => 1.5428, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.59% (0.1588 => 0.1788, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.49% (3.9660 => 4.4614, std.dev.: 0.0060) SingleSource/UnitTests/ObjC++/property-reference-object: 12.48% (0.5818 => 0.6544, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 12.42% (0.5748 => 0.6462, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 12.39% (0.7061 => 0.7936, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 12.38% (0.4062 => 0.4565, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.27% (0.2721 => 0.3055, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.21% (0.1327 => 0.1489, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.13% (0.1072 => 0.1202, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 11.98% (0.7038 => 0.7881, std.dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: 11.94% (0.2781 => 0.3113, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.89% (1.4563 => 1.6294, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.86% (0.2782 => 0.3112, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.83% (0.0964 => 0.1078, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.82% (0.3485 => 0.3897, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.79% (0.2596 => 0.2902, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.74% (0.6959 => 0.7776, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.71% (0.3756 => 0.4196, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.71% (0.6283 => 0.7019, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.68% (1.2193 => 1.3617, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.62% (0.7710 => 0.8606, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.55% (0.4016 => 0.4480, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.54% (0.9199 => 1.0261, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.49% (0.5265 => 0.5870, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.46% (0.3899 => 0.4346, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 11.38% (0.3453 => 0.3846, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.32% (0.3022 => 0.3364, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hello: 11.32% (0.2607 => 0.2902, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 11.28% (13.8202 => 15.3786, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/wc: 11.27% (0.2937 => 0.3268, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 11.26% (0.2690 => 0.2993, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.25% (0.4390 => 0.4884, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 11.23% (0.2761 => 0.3071, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.22% (0.2655 => 0.2953, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.20% (1.1364 => 1.2637, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 11.19% (0.2628 => 0.2922, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 11.18% (0.2765 => 0.3074, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 11.18% (0.3293 => 0.3661, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 11.15% (0.2726 => 0.3030, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.15% (0.3580 => 0.3979, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 11.13% (0.2966 => 0.3296, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 11.12% (0.2760 => 0.3067, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 11.11% (1.9828 => 2.2030, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 11.09% (0.3489 => 0.3876, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 11.07% (0.3868 => 0.4296, std.dev.: 0.0107) MultiSource/Applications/aha/aha: 11.02% (0.1062 => 0.1179, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.99% (0.3130 => 0.3474, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 10.99% (0.3149 => 0.3495, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 10.91% (0.3107 => 0.3446, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.91% (0.2696 => 0.2990, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.79% (0.1075 => 0.1191, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 10.77% (0.1003 => 0.1111, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 10.67% (0.3534 => 0.3911, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.64% (0.0977 => 0.1081, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 10.59% (0.3192 => 0.3530, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 10.58% (0.2988 => 0.3304, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.56% (0.4791 => 0.5297, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.40% (0.1048 => 0.1157, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.38% (0.5577 => 0.6156, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 10.35% (1.0313 => 1.1380, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.25% (0.4379 => 0.4828, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 10.22% (0.2945 => 0.3246, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.20% (0.1157 => 0.1275, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 10.20% (1.1061 => 1.2189, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.17% (0.1986 => 0.2188, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 10.14% (16.6129 => 18.2969, std.dev.: 0.0141) MultiSource/Applications/sgefa/sgefa: 10.12% (0.2995 => 0.3298, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 10.02% (0.6744 => 0.7420, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/chomp: 10.01% (0.1589 => 0.1748, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.94% (0.8698 => 0.9563, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.92% (0.2127 => 0.2338, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.87% (0.1276 => 0.1402, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.83% (0.3246 => 0.3565, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.81% (0.2914 => 0.3200, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 9.81% (0.1111 => 0.1220, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 9.72% (0.3220 => 0.3533, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.71% (0.7460 => 0.8184, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.69% (0.3755 => 0.4119, std.dev.: 0.0119) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.69% (0.1435 => 0.1574, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.65% (0.5637 => 0.6181, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.57% (7.2180 => 7.9088, std.dev.: 0.0084) MultiSource/Applications/d/make_dparser: 9.51% (3.1889 => 3.4921, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 9.51% (0.8310 => 0.9100, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 9.49% (0.7506 => 0.8218, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 9.40% (3.8646 => 4.2278, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.38% (0.6576 => 0.7193, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.34% (0.2023 => 0.2212, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 9.27% (1.9270 => 2.1057, std.dev.: 0.0017) MultiSource/Applications/viterbi/viterbi: 9.27% (0.1478 => 0.1615, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 9.15% (1.0594 => 1.1563, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.12% (0.1865 => 0.2035) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.11% (0.1569 => 0.1712, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.11% (0.3578 => 0.3904, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.07% (0.4003 => 0.4366, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.02% (0.3914 => 0.4267, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 9.01% (2.1791 => 2.3755, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.94% (0.3511 => 0.3825, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.94% (0.3601 => 0.3923, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 8.92% (0.3789 => 0.4127, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 8.91% (0.3646 => 0.3971, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.91% (0.3940 => 0.4291, std.dev.: 0.0071) SingleSource/UnitTests/ObjC/synchronized: 8.87% (0.3663 => 0.3988, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.86% (0.3623 => 0.3944, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.83% (0.8818 => 0.9597, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.82% (0.3650 => 0.3972, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 8.82% (0.2925 => 0.3183, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.81% (3.6692 => 3.9924, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 8.75% (1.2749 => 1.3864, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.65% (1.3245 => 1.4391, std.dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: 8.64% (14.8535 => 16.1369, std.dev.: 0.0174) MultiSource/Benchmarks/sim/sim: 8.59% (0.3131 => 0.3400, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 8.57% (0.1657 => 0.1799, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.53% (4.9865 => 5.4116, std.dev.: 0.0046) MultiSource/Applications/oggenc/oggenc: 8.51% (4.6629 => 5.0598, std.dev.: 0.0144) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.48% (4.4433 => 4.8199, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.44% (4.3801 => 4.7499, std.dev.: 0.0112) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.44% (0.1789 => 0.1940, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.41% (0.2140 => 0.2320, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.20% (0.6135 => 0.6638, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 8.15% (8.4961 => 9.1887, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 8.06% (0.6250 => 0.6754, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 8.02% (0.4113 => 0.4443, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.92% (0.1819 => 0.1963, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 7.83% (1.2292 => 1.3254, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.62% (3.2742 => 3.5237, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.60% (1.1333 => 1.2194, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.55% (0.3245 => 0.3490, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.54% (1.5188 => 1.6333, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.45% (0.4805 => 0.5163, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.43% (0.2504 => 0.2690, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.39% (0.9108 => 0.9781, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 7.27% (6.5754 => 7.0535, std.dev.: 0.0114) SingleSource/Benchmarks/Misc/oourafft: 7.22% (0.2008 => 0.2153, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.07% (0.2321 => 0.2485, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.80% (6.2785 => 6.7055, std.dev.: 0.0021) MultiSource/Applications/lua/lua: 6.79% (3.7467 => 4.0010, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.74% (2.1007 => 2.2423, std.dev.: 0.0162) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.29% (13.2842 => 14.1196, std.dev.: 0.0110) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.86% (0.2243 => 0.2352, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 4.49% (16.2614 => 16.9910, std.dev.: 0.0182) MultiSource/Applications/ClamAV/clamscan: 4.23% (14.5298 => 15.1450, std.dev.: 0.0128) MultiSource/Benchmarks/Bullet/bullet: 2.38% (33.2944 => 34.0860, std.dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.61% (5.7573 => 7.5194, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.10% (1.0895 => 1.3630, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/fbench: 24.74% (1.8175 => 2.2671, std.dev.: 0.0126) SingleSource/Benchmarks/Misc/richards_benchmark: 11.15% (1.1560 => 1.2849, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4139, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.28% (1.2998 => 1.3814, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.21% (0.2093 => 0.2202, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6760, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 3.33% (1.9199 => 1.9839, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 3.32% (10.7476 => 11.1048, std.dev.: 0.0328) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.23% (7.4271 => 7.5928, std.dev.: 0.0032) MultiSource/Applications/lemon/lemon: 1.73% (1.4298 => 1.4546, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5134, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.46% (2.0200 => 2.0495, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9689, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2126, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1868, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5780, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0270, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.07% (8.8259 => 8.9200, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5852, std.dev.: 0.0073) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.93% (0.2670 => 0.1417, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -14.71% (0.0707 => 0.0603, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -14.49% (0.4657 => 0.3982, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.35% (1.3813 => 1.1969, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.16% (1.3819 => 1.2001, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.10% (22.5627 => 22.0888, std.dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.97% (0.2238 => 0.1970, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.91% (1.2308 => 1.0965, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.10% (20.3410 => 18.2860, std.dev.: 0.0226) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.65% (1.3780 => 1.3002, std.dev.: 0.0113) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.05% (2.6470 => 2.5133, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8004, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.60% (0.9996 => 0.9636, std.dev.: 0.0034) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.54% (1.7688 => 1.7061, std.dev.: 0.0011) MultiSource/Applications/siod/siod: -3.33% (3.2729 => 3.1640, std.dev.: 0.0084) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.58% (26.5159 => 25.8316, std.dev.: 0.0283) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.42% (3.0263 => 2.9532, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: -2.40% (1.9762 => 1.9288, std.dev.: 0.0106) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.03% (0.6589 => 0.6455, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -1.79% (28.2225 => 27.7184, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.66% (6.3560 => 6.2503, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0075, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -1.29% (4.5928 => 4.5337, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: -1.20% (9.3358 => 9.2236, std.dev.: 0.0366) SingleSource/Benchmarks/Shootout/heapsort: -1.18% (3.9173 => 3.8709, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.16% (2.5254 => 2.4961, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2570, std.dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 9 07:03:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 9 Oct 2012 09:03:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121009140344.25E402A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4735?compare_to=4733&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4735, Order: 165498, Start Time: 2012-10-09 12:45:53, End Time: 2012-10-09 14:05:32 To: 4733, Order: 165497, Start Time: 2012-10-09 10:57:07, End Time: 2012-10-09 12:16:39 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 4 (156 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1021 (762 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: 5.02% (0.2230 => 0.2342, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 2.22% (15.2372 => 15.5761, std.dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 2.14% (11.4737 => 11.7194, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.04% (3.7033 => 3.7417, std.dev.: 0.0012) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.14% (0.5904 => 0.5896, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: -0.16% (16.3081 => 16.2812, std.dev.: 0.0255) MultiSource/Benchmarks/Bullet/bullet: 1.05% (54.6075 => 55.1800, std.dev.: 0.0213) MultiSource/Benchmarks/MallocBench/gs/gs: -0.21% (4.3986 => 4.3895, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.06% (1.2531 => 1.2538, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.12% (7.8100 => 7.8197, std.dev.: 0.0162) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.20% (0.7429 => 0.7414, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.83% (0.0361 => 0.0358, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1430 => 0.1431, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.30% (0.0671 => 0.0669, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -12.75% (63.2438 => 55.1800, std.dev.: 0.0213) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.69% (14.1553 => 18.7831, std.dev.: 0.0229) SingleSource/Benchmarks/Misc-C++-EH/spirit: 62.49% (3.4629 => 5.6269, std.dev.: 0.0075) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14221.81% (0.0720 => 10.3117, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952800.00% (0.0001 => 9.9529, std.dev.: 0.0010) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 61.16% (0.2554 => 0.4116, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 50.24% (10.3673 => 15.5761, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: 44.39% (0.1622 => 0.2342, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 32.86% (0.1056 => 0.1403) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.45% (7.0540 => 8.3552, std.dev.: 0.0135) MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.44% (2.2022 => 2.6082, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 18.16% (0.1432 => 0.1692) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.69% (0.1566 => 0.1796, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 13.22% (0.3282 => 0.3716, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.19% (1.7609 => 1.9931, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.51% (0.0871 => 0.0980, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 12.30% (10.4361 => 11.7194, std.dev.: 0.0110) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.11% (0.0834 => 0.0935, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 11.81% (0.1440 => 0.1610, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.69% (0.1625 => 0.1815, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.55% (0.1584 => 0.1767, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.54% (0.3543 => 0.3952, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.06% (0.3473 => 0.3857, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.97% (0.4879 => 0.5414, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/exceptions-2: 10.84% (0.3497 => 0.3876, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.81% (0.3543 => 0.3926, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/synchronized: 10.78% (0.3561 => 0.3945, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.75% (0.3516 => 0.3894, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.57% (0.1438 => 0.1590, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.56% (0.3694 => 0.4084, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.50% (0.3828 => 0.4230, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.47% (0.3927 => 0.4338, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.45% (0.3886 => 0.4292, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.39% (0.3177 => 0.3507, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 10.05% (9.4845 => 10.4377, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 9.73% (0.7115 => 0.7807, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.69% (0.6675 => 0.7322, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 9.56% (5.7591 => 6.3094, std.dev.: 0.0080) SingleSource/Benchmarks/McGill/chomp: 9.43% (0.1655 => 0.1811, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.08% (1.5415 => 1.6814, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 9.04% (0.3109 => 0.3390, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.01% (0.4615 => 0.5031, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 9.01% (0.7433 => 0.8103, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.85% (0.2700 => 0.2939, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.83% (0.5925 => 0.6448, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 8.77% (0.1175 => 0.1278, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.72% (0.6030 => 0.6556, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 8.71% (0.3423 => 0.3721, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.70% (0.4103 => 0.4460, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 8.61% (0.1695 => 0.1841, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.61% (1.3050 => 1.4173, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.60% (0.8067 => 0.8761, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.56% (0.5105 => 0.5542, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 8.55% (3.3354 => 3.6207, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.48% (0.8172 => 0.8865, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.45% (4.2646 => 4.6250, std.dev.: 0.0034) MultiSource/Applications/hbd/hbd: 8.38% (1.5603 => 1.6911, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.37% (0.2271 => 0.2461, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.29% (0.3136 => 0.3396, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.27% (5.0018 => 5.4154, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.27% (8.1363 => 8.8089, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.15% (4.9449 => 5.3477, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.12% (0.5860 => 0.6336, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.12% (0.5569 => 0.6021, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.10% (0.3307 => 0.3575, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 8.07% (0.6456 => 0.6977, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 8.05% (0.7326 => 0.7916, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.04% (0.2065 => 0.2231, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 8.03% (0.3387 => 0.3659, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.01% (0.1510 => 0.1631, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.98% (0.3121 => 0.3370, std.dev.: 0.0047) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.93% (7.9617 => 8.5927, std.dev.: 0.0112) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.88% (0.2107 => 0.2273, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.85% (0.1337 => 0.1442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 7.83% (0.3422 => 0.3690, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.82% (0.9765 => 1.0529, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.80% (0.2758 => 0.2973) MultiSource/Applications/Burg/burg: 7.77% (1.1642 => 1.2547, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 7.76% (0.4289 => 0.4622, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.76% (0.3865 => 0.4165, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.71% (0.5020 => 0.5407, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 7.64% (3.8723 => 4.1683, std.dev.: 0.0035) MultiSource/Applications/spiff/spiff: 7.63% (0.7835 => 0.8433, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.63% (0.3826 => 0.4118, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.57% (0.4203 => 0.4521, std.dev.: 0.0058) MultiSource/Applications/viterbi/viterbi: 7.52% (0.1555 => 0.1672, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.51% (0.2891 => 0.3108, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.48% (0.4636 => 0.4983, std.dev.: 0.0103) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.47% (0.1940 => 0.2085, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.37% (0.3162 => 0.3395, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 7.35% (1.0722 => 1.1510, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.34% (0.3650 => 0.3918, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 7.34% (0.4048 => 0.4345, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.33% (0.2905 => 0.3118, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.27% (1.5859 => 1.7012, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.25% (0.4620 => 0.4955, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/strcat: 7.17% (0.2831 => 0.3034, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 7.14% (2.0273 => 2.1721, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sieve: 7.11% (0.3603 => 0.3859, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 7.04% (0.3052 => 0.3267, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.04% (0.2756 => 0.2950, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 7.03% (21.9371 => 23.4790, std.dev.: 0.0206) SingleSource/Benchmarks/Shootout-C++/ary: 6.99% (0.3232 => 0.3458, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.99% (1.1861 => 1.2690, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.94% (2.0665 => 2.2100, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/05-eks/eks: 6.91% (0.4299 => 0.4596, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 6.90% (0.2725 => 0.2913, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 6.89% (0.3684 => 0.3938, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.86% (0.3441 => 0.3677, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.85% (0.3283 => 0.3508, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.85% (0.2714 => 0.2900, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 6.83% (0.2871 => 0.3067, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.81% (0.3098 => 0.3309, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.77% (0.2793 => 0.2982, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.75% (0.2872 => 0.3066, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.75% (0.2802 => 0.2991, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.68% (0.6450 => 0.6881, std.dev.: 0.0040) MultiSource/Applications/siod/siod: 6.58% (2.2969 => 2.4480, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/09-vor/vor: 6.57% (0.3180 => 0.3389, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 6.57% (0.2877 => 0.3066, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 6.46% (0.8921 => 0.9497, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.33% (0.3379 => 0.3593, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.27% (0.5981 => 0.6356, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.26% (2.2024 => 2.3403, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.89% (1.4186 => 1.5021, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.83% (0.4064 => 0.4301, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 5.83% (1.1840 => 1.2530, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.81% (0.1892 => 0.2002, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.74% (0.2266 => 0.2396, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.67% (0.1906 => 0.2014, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (0.3131 => 0.3293, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 5.12% (1.2842 => 1.3500, std.dev.: 0.0056) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.89% (0.8101 => 0.8497, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: 4.88% (0.2049 => 0.2149, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.06% (14.3668 => 14.9507, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 3.82% (17.1811 => 17.8380, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.68% (0.3427 => 0.3553, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.54% (3.8922 => 4.0298, std.dev.: 0.0182) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.50% (1.1194 => 1.1586, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.25% (0.3817 => 0.3941, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.20% (1.1145 => 1.3842, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.81% (1.1396 => 1.2514, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 9.21% (3.1595 => 3.4506, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3690, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0016) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.43% (3.6395 => 3.7644, std.dev.: 0.0090) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.69% (4.2280 => 4.3418, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8133, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.20% (2.6546 => 2.6864, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1310, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -79.99% (0.8651 => 0.1731, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.80% (5.2763 => 3.2819, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.52% (5.3855 => 3.7418, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.10% (5.3526 => 3.7417, std.dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -14.42% (54.1659 => 46.3528, std.dev.: 0.0136) MultiSource/Benchmarks/FreeBench/mason/mason: -12.33% (0.0811 => 0.0711, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -10.62% (22.1758 => 19.8198, std.dev.: 0.0269) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.07% (2.9384 => 2.6426, std.dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.47% (1.1492 => 0.7646, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: -15.86% (1.6925 => 1.4241, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.93% (0.0998 => 0.0859, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -11.27% (1.2373 => 1.0978, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: -10.28% (1.5373 => 1.3792, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/mason/mason: -10.09% (0.2161 => 0.1943, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.20% (19.9488 => 18.3125, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.66% (1.8329 => 1.7108, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.33% (1.6805 => 1.5909, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: -5.03% (1.5835 => 1.5039, std.dev.: 0.0027) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Applications/siod/siod: -3.68% (3.2827 => 3.1620, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.35% (0.9957 => 0.9623, std.dev.: 0.0030) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5096, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: -3.01% (12.4730 => 12.0970, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.32% (8.6802 => 8.4786, std.dev.: 0.0221) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -1.85% (10.2830 => 10.0929, std.dev.: 0.0101) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.82% (8.1563 => 8.0075, std.dev.: 0.0155) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6829, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -1.68% (2.5528 => 2.5099, std.dev.: 0.0023) MultiSource/Benchmarks/NPB-serial/is/is: -1.51% (9.5636 => 9.4190, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/lists: -1.12% (6.2999 => 6.2296, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.76% (0.5229 => 0.5896, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 8.62% (14.9895 => 16.2812, std.dev.: 0.0255) MultiSource/Benchmarks/MallocBench/gs/gs: 6.79% (4.1105 => 4.3895, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.49% (1.1048 => 1.2538, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.24% (7.1582 => 7.8197, std.dev.: 0.0162) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.16% (0.6222 => 0.7414, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35700.00% (0.0001 => 0.0358, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.38% (0.2116 => 0.0669, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 9 08:00:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 9 Oct 2012 10:00:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121009150056.445542A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4736?compare_to=4732&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4736, Order: 165498, Start Time: 2012-10-09 12:18:36, End Time: 2012-10-09 15:02:44 To: 4732, Order: 165490, Start Time: 2012-10-09 09:05:18, End Time: 2012-10-09 11:49:23 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (137 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 1041 (826 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.21% (125.8490 => 129.8835, std.dev.: 0.8973) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 12.48% (0.3446 => 0.3876, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.47% (0.3488 => 0.3923, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 12.43% (0.3442 => 0.3870, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.43% (0.3460 => 0.3890, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.41% (0.3465 => 0.3895, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.37% (0.3469 => 0.3898) SingleSource/UnitTests/ObjC/for-in: 12.36% (0.3496 => 0.3928, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.16% (0.3643 => 0.4086, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.11% (0.3650 => 0.4092, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.82% (0.3724 => 0.4164, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 11.09% (0.0947 => 0.1052, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 11.03% (1.5932 => 1.7689, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.91% (0.1063 => 0.1179, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.49% (0.5826 => 0.6379, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.32% (0.5889 => 0.6438, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/05-eks/eks: 9.02% (0.1619 => 0.1765, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 8.87% (0.1218 => 0.1326, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 8.66% (0.3004 => 0.3264, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.47% (0.2738 => 0.2970, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.33% (0.1620 => 0.1755, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.28% (0.4361 => 0.4722, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.27% (0.4994 => 0.5407, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: 8.17% (0.1505 => 0.1628, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 8.14% (0.9909 => 1.0716, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.14% (0.2875 => 0.3109, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.13% (0.7171 => 0.7754, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.07% (1.6211 => 1.7520, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.96% (0.5000 => 0.5398, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.95% (0.3195 => 0.3449, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 7.89% (0.2750 => 0.2967, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.86% (3.5627 => 3.8427, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.85% (1.3152 => 1.4185, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/fibo: 7.82% (0.2725 => 0.2938, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 7.78% (5.5417 => 5.9727, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/hello: 7.74% (0.2714 => 0.2924, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.74% (0.2792 => 0.3008, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.73% (0.2729 => 0.2940, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 7.71% (0.2803 => 0.3019, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.70% (0.5026 => 0.5413, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: 7.70% (0.2780 => 0.2994, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.68% (0.2813 => 0.3029, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.66% (2.0673 => 2.2257, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 7.65% (0.2823 => 0.3039, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.63% (0.2911 => 0.3133, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.62% (0.1968 => 0.2118, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.54% (0.2811 => 0.3023, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 7.53% (0.3096 => 0.3329, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.50% (0.2866 => 0.3081, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.49% (0.3845 => 0.4133, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.45% (0.3060 => 0.3288, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 7.41% (0.3726 => 0.4002, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 7.41% (0.3267 => 0.3509, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 7.40% (0.2566 => 0.2756, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.37% (0.4139 => 0.4444, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.35% (0.2014 => 0.2162, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 7.31% (0.3678 => 0.3947, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.31% (0.3258 => 0.3496, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.26% (0.3362 => 0.3606, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 7.25% (1.0781 => 1.1563, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary2: 7.24% (0.3317 => 0.3557, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.21% (2.7292 => 2.9261, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/lists: 7.20% (0.3348 => 0.3589, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.17% (0.5900 => 0.6323, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 7.16% (0.3477 => 0.3726, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.11% (0.3124 => 0.3346, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 7.09% (23.5202 => 25.1887, std.dev.: 0.0218) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.09% (0.2736 => 0.2930, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.09% (0.3625 => 0.3882, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.07% (0.3282 => 0.3514, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.07% (0.4146 => 0.4439, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 7.04% (0.1421 => 0.1521, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 6.97% (0.4847 => 0.5185, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.97% (0.1549 => 0.1657, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.95% (0.3930 => 0.4203, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 6.86% (4.2109 => 4.4999, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/hash2: 6.82% (0.4251 => 0.4541, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.75% (0.3690 => 0.3939, std.dev.: 0.0023) MultiSource/Applications/siod/siod: 6.65% (0.6634 => 0.7075, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 6.61% (0.2691 => 0.2869, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.61% (0.3981 => 0.4244, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 6.60% (1.8794 => 2.0035, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.56% (0.3903 => 0.4159, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: 6.53% (0.4029 => 0.4292, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.50% (0.3890 => 0.4143, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 6.44% (0.3336 => 0.3551, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 6.37% (1.4269 => 1.5178, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 6.35% (0.9697 => 1.0313, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.29% (0.6435 => 0.6840, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.26% (0.3084 => 0.3277, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.25% (0.2737 => 0.2908, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.23% (0.2969 => 0.3154, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 6.19% (0.5012 => 0.5322, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.12% (0.4658 => 0.4943, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.05% (0.3271 => 0.3469, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.04% (0.2068 => 0.2193, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 6.03% (2.1013 => 2.2280, std.dev.: 0.0038) MultiSource/Applications/Burg/burg: 6.02% (0.5546 => 0.5880, std.dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 5.96% (4.6177 => 4.8930, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.88% (4.4195 => 4.6793, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.66% (0.2103 => 0.2222, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 5.57% (2.1653 => 2.2860, std.dev.: 0.0020) MultiSource/Applications/treecc/treecc: 5.41% (0.7875 => 0.8301, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.36% (1.9694 => 2.0749, std.dev.: 0.0023) MultiSource/Applications/lemon/lemon: 5.19% (0.2391 => 0.2515, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.18% (1.9966 => 2.1001, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/football/football: 5.16% (0.2075 => 0.2182, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 5.11% (2.0346 => 2.1385, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.00% (0.2040 => 0.2142, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.82% (0.7426 => 0.7784, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 4.60% (0.3498 => 0.3659, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.33% (11.6398 => 12.1436, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.28% (0.5584 => 0.5823, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.16% (0.4253 => 0.4430, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.12% (4.6926 => 4.8858, std.dev.: 0.0086) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.22% (0.3792 => 0.3914, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 2.93% (11.9555 => 12.3059, std.dev.: 0.0135) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 65.40% (0.2162 => 0.3576, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6096, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6724, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-2: 5.05% (1.8057 => 1.8969, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1694, std.dev.: 0.1124) SingleSource/Benchmarks/Dhrystone/dry: 4.21% (14.0481 => 14.6395, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1931, std.dev.: 0.0080) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5065, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.67% (2.0820 => 2.1168, std.dev.: 0.0081) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.66% (3.1722 => 3.2247, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2857, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1063, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5139, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5897, std.dev.: 0.0110) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.88% (25.4195 => 16.5532, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/ary2: -10.16% (0.2402 => 0.2158, std.dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9755, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7941, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9574, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -3.76% (11.2080 => 10.7867, std.dev.: 0.0146) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std.dev.: 0.0052) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7735, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.89% (17.2379 => 16.7391, std.dev.: 0.1160) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8661, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5789, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4949, std.dev.: 0.0075) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.19% (105.3826 => 104.1269, std.dev.: 0.0858) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0441, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 9 10:41:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 9 Oct 2012 12:41:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121009174120.A92882A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4737?compare_to=4734&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4737, Order: 165501, Start Time: 2012-10-09 16:28:29, End Time: 2012-10-09 17:43:07 To: 4734, Order: 165498, Start Time: 2012-10-09 11:56:45, End Time: 2012-10-09 13:11:27 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (183 on baseline) Performance Improvements: 2 (39 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1039 (754 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.97% (54.8906 => 56.5187, std.dev.: 0.0832) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.31% (2.2030 => 2.1741, std.dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: -1.14% (34.0860 => 33.6991, std.dev.: 0.0057) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.08% (2.0176 => 2.4832, std.dev.: 0.0050) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.09% (0.1410 => 0.1665, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 16.83% (0.0826 => 0.0965, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 15.69% (0.2243 => 0.2595, std.dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.43% (0.1072 => 0.1216, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.95% (0.0834 => 0.0942, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 12.93% (0.1013 => 0.1144, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.46% (0.1413 => 0.1589, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.13% (0.2721 => 0.3051, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 12.11% (1.3693 => 1.5351, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.09% (3.9660 => 4.4454, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.03% (0.1588 => 0.1779, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 11.91% (0.5818 => 0.6511, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.91% (0.1327 => 0.1485, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.86% (1.4563 => 1.6290, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.72% (0.0964 => 0.1077, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 11.69% (0.7038 => 0.7861, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 11.67% (0.5748 => 0.6419, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 11.65% (0.4328 => 0.4832, std.dev.: 0.0096) SingleSource/UnitTests/ObjC++/property-reference: 11.60% (0.7061 => 0.7880, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.56% (0.2596 => 0.2896, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.53% (0.5265 => 0.5872, std.dev.: 0.0058) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.52% (0.7710 => 0.8598, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.42% (1.2193 => 1.3586, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.34% (0.6959 => 0.7748, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.33% (0.9199 => 1.0241, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.14% (0.6283 => 0.6983, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.08% (1.1364 => 1.2623, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 11.02% (0.1062 => 0.1179, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 10.98% (13.8202 => 15.3379, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash: 10.86% (0.4062 => 0.4503, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: 10.57% (0.1003 => 0.1109, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 10.54% (0.2781 => 0.3074, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.44% (0.3899 => 0.4306, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.42% (0.3485 => 0.3848, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.39% (0.2782 => 0.3071, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.33% (0.4016 => 0.4431, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.33% (0.1075 => 0.1186, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.22% (0.3130 => 0.3450, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 10.20% (0.2726 => 0.3004, std.dev.: 0.0045) MultiSource/Applications/lemon/lemon: 10.14% (1.0313 => 1.1359, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/except: 10.11% (0.2760 => 0.3039, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.10% (0.5577 => 0.6140, std.dev.: 0.0023) MultiSource/Applications/sgefa/sgefa: 10.08% (0.2995 => 0.3297, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.03% (0.1157 => 0.1273, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.01% (0.3756 => 0.4132, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.00% (0.3489 => 0.3838, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 10.00% (0.2690 => 0.2959, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.96% (0.4379 => 0.4815, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.96% (0.4791 => 0.5268, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 9.93% (0.3293 => 0.3620, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.93% (0.3022 => 0.3322, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.90% (0.6576 => 0.7227, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 9.88% (1.1061 => 1.2154, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.76% (0.2765 => 0.3035, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 9.76% (0.3453 => 0.3790, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.76% (0.2655 => 0.2914, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.75% (0.3580 => 0.3929, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 9.74% (0.2607 => 0.2861, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.72% (0.1986 => 0.2179, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.71% (0.2914 => 0.3197, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 9.70% (0.2937 => 0.3222, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 9.70% (0.2628 => 0.2883, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 9.69% (0.1589 => 0.1743, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 9.67% (0.3868 => 0.4242, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.65% (1.9828 => 2.1741, std.dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 9.64% (16.6129 => 18.2137, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 9.60% (0.2761 => 0.3026, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.59% (0.2127 => 0.2331, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.59% (0.4390 => 0.4811, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.58% (0.3246 => 0.3557, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.58% (0.2966 => 0.3250, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/mst/mst: 9.54% (0.1111 => 0.1217, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.53% (0.5637 => 0.6174, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 9.50% (0.6744 => 0.7385, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 9.50% (0.3149 => 0.3448, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 9.49% (0.3107 => 0.3402, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.48% (0.1276 => 0.1397, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.48% (0.1435 => 0.1571, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.43% (0.3511 => 0.3842, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.42% (0.2696 => 0.2950, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 9.38% (0.3220 => 0.3522, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 9.37% (0.2988 => 0.3268, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 9.34% (0.8310 => 0.9086, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 9.30% (0.7506 => 0.8204, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 9.28% (0.3534 => 0.3862, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.26% (0.7460 => 0.8151, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.24% (0.2023 => 0.2210, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.21% (7.2180 => 7.8827, std.dev.: 0.0098) MultiSource/Benchmarks/MallocBench/gs/gs: 9.16% (3.8646 => 4.2186, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: 9.15% (0.3192 => 0.3484, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 9.11% (1.9270 => 2.1025, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.06% (0.8698 => 0.9486, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 9.05% (3.1889 => 3.4775, std.dev.: 0.0128) MultiSource/Applications/siod/siod: 8.98% (2.1791 => 2.3747, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 8.86% (0.1478 => 0.1609, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.79% (0.1865 => 0.2029, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 8.78% (1.0594 => 1.1524, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: 8.74% (0.4003 => 0.4353, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.74% (0.3914 => 0.4256, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 8.72% (0.3578 => 0.3890, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 8.68% (0.2925 => 0.3179, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 8.66% (0.2945 => 0.3200, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 8.62% (1.2749 => 1.3848, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/em3d/em3d: 8.57% (0.1657 => 0.1799, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.55% (0.8818 => 0.9572, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.55% (0.3755 => 0.4076, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.54% (3.6692 => 3.9826, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-4: 8.53% (0.3646 => 0.3957, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 8.49% (0.3663 => 0.3974, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.48% (0.3940 => 0.4274, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.48% (0.1569 => 0.1702, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.47% (0.3789 => 0.4110, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.47% (0.3601 => 0.3906, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 8.43% (0.3131 => 0.3395, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.42% (0.3623 => 0.3928, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.41% (0.3650 => 0.3957, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.29% (1.3245 => 1.4343, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 8.28% (14.8535 => 16.0827, std.dev.: 0.0127) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.27% (0.1789 => 0.1937, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.19% (4.3801 => 4.7389, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.14% (4.4433 => 4.8050, std.dev.: 0.0085) MultiSource/Applications/oggenc/oggenc: 8.13% (4.6629 => 5.0422, std.dev.: 0.0071) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.13% (0.2140 => 0.2314, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.97% (4.9865 => 5.3841, std.dev.: 0.0147) MultiSource/Benchmarks/mafft/pairlocalalign: 7.94% (8.4961 => 9.1704, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.89% (0.6135 => 0.6619, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 7.83% (0.4113 => 0.4435, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.53% (3.2742 => 3.5207, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.35% (1.5188 => 1.6304, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.34% (1.1333 => 1.2165, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.29% (0.9108 => 0.9772, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.27% (0.2504 => 0.2686, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 7.06% (0.6250 => 0.6691, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 6.99% (6.5754 => 7.0351, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1819 => 0.1946, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.95% (0.4805 => 0.5139, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/oourafft: 6.92% (0.2008 => 0.2147, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 6.92% (1.2292 => 1.3142, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.81% (0.2321 => 0.2479, std.dev.: 0.0028) MultiSource/Applications/lua/lua: 6.64% (3.7467 => 3.9953, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.63% (0.3245 => 0.3460, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.56% (6.2785 => 6.6904, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.43% (2.1007 => 2.2358, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.87% (13.2842 => 14.0646, std.dev.: 0.0209) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.86% (0.2243 => 0.2352, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 4.42% (16.2614 => 16.9808, std.dev.: 0.0143) MultiSource/Applications/ClamAV/clamscan: 4.05% (14.5298 => 15.1184, std.dev.: 0.0075) MultiSource/Benchmarks/Bullet/bullet: 1.22% (33.2944 => 33.6991, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.49% (5.7573 => 7.5126, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/fbench: 27.25% (1.8175 => 2.3128, std.dev.: 0.0248) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628) SingleSource/Benchmarks/Misc/richards_benchmark: 11.09% (1.1560 => 1.2842, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.04% (0.8273 => 0.9021, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4145, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.23% (1.2998 => 1.3808, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.02% (0.2093 => 0.2198, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0041, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6769, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.51% (1.9199 => 1.9872, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.22% (10.7476 => 11.0939, std.dev.: 0.0239) SingleSource/Regression/C/uint64_to_float: 2.97% (0.5449 => 0.5611, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.24% (7.4271 => 7.5933, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 1.67% (1.4298 => 1.4537, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5127, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9696, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1884, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.17% (5.5130 => 5.5776, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1413, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 1.09% (12.4560 => 12.5922, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0273, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.93% (0.2670 => 0.1417) MultiSource/Benchmarks/FreeBench/mason/mason: -14.99% (0.0707 => 0.0601, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -14.82% (0.4657 => 0.3967, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.55% (1.3819 => 1.1946, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.52% (1.3813 => 1.1946, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.50% (22.5627 => 21.9983, std.dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.84% (0.0997 => 0.0859, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -12.11% (0.2238 => 0.1967, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.85% (1.2308 => 1.0972, std.dev.: 0.0251) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.17% (20.3410 => 18.2731, std.dev.: 0.0228) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.08% (1.3780 => 1.3080, std.dev.: 0.0019) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5141, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8004, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.31% (0.9996 => 0.9565, std.dev.: 0.0010) MultiSource/Applications/siod/siod: -3.58% (3.2729 => 3.1558, std.dev.: 0.0144) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.52% (1.7688 => 1.7065, std.dev.: 0.0053) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.62% (26.5159 => 25.8204, std.dev.: 0.0195) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.51% (3.0263 => 2.9503, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: -2.39% (1.9762 => 1.9290, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.23% (0.6589 => 0.6442, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -1.80% (6.3560 => 6.2414, std.dev.: 0.0074) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7148, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.56% (3.9173 => 3.8560, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0074, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -1.23% (4.5928 => 4.5361, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4943, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: -1.14% (9.3358 => 9.2290, std.dev.: 0.0114) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2571, std.dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 9 10:46:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 9 Oct 2012 12:46:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121009174609.073E82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4738?compare_to=4735&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4738, Order: 165501, Start Time: 2012-10-09 16:28:30, End Time: 2012-10-09 17:47:57 To: 4735, Order: 165498, Start Time: 2012-10-09 12:45:53, End Time: 2012-10-09 14:05:32 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (159 on baseline) Performance Improvements: 1 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1023 (758 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.38% (78.8102 => 79.9009, std.dev.: 0.3949) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -4.53% (0.2342 => 0.2236, std.dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.20% (0.5896 => 0.5908, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 0.14% (16.2812 => 16.3032, std.dev.: 0.0081) MultiSource/Benchmarks/Bullet/bullet: -0.53% (55.1800 => 54.8889, std.dev.: 0.0222) MultiSource/Benchmarks/MallocBench/gs/gs: 0.32% (4.3895 => 4.4035, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.11% (1.2538 => 1.2552, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.16% (7.8197 => 7.8326, std.dev.: 0.0137) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.11% (0.7414 => 0.7406, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 1.12% (0.0358 => 0.0362, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: - (0.1431 => 0.1431, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.99% (0.0669 => 0.0649, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -13.21% (63.2438 => 54.8889, std.dev.: 0.0222) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 33.06% (14.1553 => 18.8352, std.dev.: 0.0210) SingleSource/Benchmarks/Misc-C++-EH/spirit: 62.45% (3.4629 => 5.6256, std.dev.: 0.0021) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14224.17% (0.0720 => 10.3134, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952300.00% (0.0001 => 9.9524, std.dev.: 0.0014) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 60.85% (0.2554 => 0.4108, std.dev.: 0.0060) MultiSource/Benchmarks/PAQ8p/paq8p: 49.45% (10.3673 => 15.4935, std.dev.: 0.0122) SingleSource/Benchmarks/Misc/richards_benchmark: 37.85% (0.1622 => 0.2236, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 32.77% (0.1056 => 0.1402, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.35% (7.0540 => 8.3484, std.dev.: 0.0073) MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.21% (2.2022 => 2.6032, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: 17.60% (0.1432 => 0.1684, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.56% (0.1566 => 0.1794, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 13.28% (0.3282 => 0.3718, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.90% (1.7609 => 1.9881, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.51% (0.0871 => 0.0980, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 12.50% (10.4361 => 11.7407, std.dev.: 0.0115) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.00% (0.3543 => 0.3968, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.55% (0.1584 => 0.1767, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 11.49% (0.3473 => 0.3872, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.35% (0.3497 => 0.3894, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.35% (0.3516 => 0.3915, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 11.32% (0.1440 => 0.1603, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 11.32% (0.3561 => 0.3964, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.29% (0.3543 => 0.3943, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.13% (0.3694 => 0.4105, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.03% (0.3927 => 0.4360, std.dev.: 0.0087) SingleSource/UnitTests/ObjC/exceptions: 10.97% (0.3828 => 0.4248, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.86% (0.3886 => 0.4308, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.84% (0.4879 => 0.5408, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.22% (0.1438 => 0.1585, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 10.00% (9.4845 => 10.4327, std.dev.: 0.0057) MultiSource/Applications/minisat/minisat: 9.81% (0.7115 => 0.7813, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.73% (0.3177 => 0.3486, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.62% (0.6675 => 0.7317, std.dev.: 0.0049) SingleSource/UnitTests/ObjC++/Hello: 9.35% (0.5925 => 0.6479, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 9.30% (0.3109 => 0.3398, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 9.25% (0.6030 => 0.6588, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 9.24% (0.1655 => 0.1808, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 9.21% (5.7591 => 6.2898, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.21% (1.5415 => 1.6835, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 9.19% (0.7433 => 0.8116, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.14% (0.4615 => 0.5037, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.07% (0.2700 => 0.2945, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 9.00% (0.3423 => 0.3731, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.86% (0.1625 => 0.1769, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: 8.85% (0.1175 => 0.1279, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/em3d/em3d: 8.79% (0.1695 => 0.1844, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.79% (1.3050 => 1.4197, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 8.79% (3.3354 => 3.6285, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.70% (0.8067 => 0.8769, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.69% (0.5569 => 0.6053, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference: 8.60% (0.7326 => 0.7956, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.60% (0.5105 => 0.5544, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.59% (4.2646 => 4.6311, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.54% (0.2271 => 0.2465, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.43% (5.0018 => 5.4235, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash: 8.42% (0.4289 => 0.4650, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.36% (4.9449 => 5.3584, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.34% (0.5860 => 0.6349, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.33% (0.1236 => 0.1339, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 8.33% (0.3387 => 0.3669, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.31% (0.8172 => 0.8851, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.30% (8.1363 => 8.8120, std.dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.21% (0.1510 => 0.1634, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.21% (0.2107 => 0.2280, std.dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.19% (7.9617 => 8.6134, std.dev.: 0.0068) MultiSource/Applications/Burg/burg: 8.18% (1.1642 => 1.2594, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.13% (0.3307 => 0.3576, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 8.05% (0.7835 => 0.8466, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: 7.99% (0.6456 => 0.6972, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.99% (0.2065 => 0.2230, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.97% (0.9765 => 1.0543, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.97% (1.5603 => 1.6846, std.dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.95% (0.3121 => 0.3369, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.85% (0.5020 => 0.5414, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.84% (0.1940 => 0.2092, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.83% (0.2758 => 0.2974, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists: 7.80% (0.3422 => 0.3689, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.79% (0.3865 => 0.4166, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 7.73% (3.8723 => 4.1715, std.dev.: 0.0024) MultiSource/Applications/viterbi/viterbi: 7.72% (0.1555 => 0.1675, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.64% (0.4203 => 0.4524, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.63% (0.4103 => 0.4416, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.56% (0.3650 => 0.3926, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.56% (0.3136 => 0.3373, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.55% (0.1337 => 0.1438, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.53% (0.4636 => 0.4985, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 7.50% (0.2905 => 0.3123, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 7.48% (1.0722 => 1.1524, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 7.37% (21.9371 => 23.5545, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.37% (0.3826 => 0.4108, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.37% (0.2891 => 0.3104, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.33% (1.5859 => 1.7022, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 7.33% (2.0273 => 2.1759, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/moments: 7.24% (0.4048 => 0.4341, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 7.19% (0.4299 => 0.4608, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 7.17% (0.2831 => 0.3034, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.16% (0.4620 => 0.4951, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.15% (0.3162 => 0.3388, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.04% (0.2756 => 0.2950, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.03% (2.0665 => 2.2118, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/fibo: 7.01% (0.2725 => 0.2916, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.00% (0.3441 => 0.3682, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.99% (0.3603 => 0.3855, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.96% (1.1861 => 1.2686, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists1: 6.92% (0.3684 => 0.3939, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 6.92% (0.3180 => 0.3400, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 6.92% (0.8921 => 0.9538, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.90% (0.3232 => 0.3455, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.88% (0.6450 => 0.6894, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wc: 6.88% (0.3052 => 0.3262, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.82% (0.2872 => 0.3068, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.81% (0.3098 => 0.3309, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.80% (0.2603 => 0.2780, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.76% (0.2871 => 0.3065, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.75% (0.2802 => 0.2991, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hello: 6.74% (0.2714 => 0.2897, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.73% (0.2793 => 0.2981, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 6.67% (0.3283 => 0.3502, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 6.65% (2.2969 => 2.4496, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/methcall: 6.60% (0.2877 => 0.3067, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.37% (0.5981 => 0.6362, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.30% (2.2024 => 2.3411, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.18% (1.4186 => 1.5063, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 6.13% (0.3379 => 0.3586, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.93% (0.1906 => 0.2019, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.91% (0.4064 => 0.4304, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 5.85% (1.1840 => 1.2533, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.74% (0.2266 => 0.2396, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.50% (0.1892 => 0.1996, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.37% (0.8101 => 0.8536, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (0.3131 => 0.3294, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 5.15% (1.2842 => 1.3503, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: 4.98% (0.2049 => 0.2151, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.41% (14.3668 => 15.0004, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 3.92% (17.1811 => 17.8543, std.dev.: 0.0158) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.88% (0.3427 => 0.3560, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.67% (0.3817 => 0.3957, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.48% (3.8922 => 4.0278, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.13% (1.1194 => 1.1544, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560) SingleSource/Benchmarks/Misc/richards_benchmark: 9.77% (1.1396 => 1.2509, std.dev.: 0.0015) MultiSource/Applications/aha/aha: 9.18% (3.1595 => 3.4497, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.64% (3.1578 => 3.3675, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: 3.68% (0.5413 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.52% (3.6395 => 3.7675, std.dev.: 0.0047) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.81% (4.2280 => 4.3469, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8126, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.17% (2.6546 => 2.6856, std.dev.: 0.0036) MultiSource/Applications/minisat/minisat: 1.15% (9.1159 => 9.2206, std.dev.: 0.0077) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.12% (6.5088 => 6.5820, std.dev.: 0.0065) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1308, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.77% (5.2763 => 3.2834, std.dev.: 0.0156) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.08% (5.3855 => 3.7118, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.62% (5.3526 => 3.7138, std.dev.: 0.0088) SingleSource/UnitTests/Vector/constpool: -14.56% (54.1659 => 46.2769, std.dev.: 0.0252) MultiSource/Benchmarks/FreeBench/mason/mason: -12.45% (0.0811 => 0.0710, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -10.57% (22.1758 => 19.8312, std.dev.: 0.0211) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.26% (2.9384 => 2.6368, std.dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.51% (1.1492 => 0.7641, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: -15.94% (1.6925 => 1.4228, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.83% (0.0998 => 0.0860, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.27% (1.2373 => 1.0978, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -10.36% (1.5373 => 1.3780, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/mason/mason: -9.86% (0.2161 => 0.1948, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.24% (19.9488 => 18.3041, std.dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.64% (1.8329 => 1.7112, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.31% (1.6805 => 1.5913, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7963, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5079, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.56% (3.2827 => 3.1658, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.39% (0.9957 => 0.9619, std.dev.: 0.0051) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5001, std.dev.: 0.0059) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0994, std.dev.: 0.0012) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.79% (10.2830 => 10.0989, std.dev.: 0.0228) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.74% (8.6802 => 8.5295, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6827, std.dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -1.68% (2.5528 => 2.5099, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.66% (8.1563 => 8.0209, std.dev.: 0.0052) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4203, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/lists: -1.12% (6.2999 => 6.2294, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/hash: -1.08% (4.9088 => 4.8557, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.99% (0.5229 => 0.5908, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 8.76% (14.9895 => 16.3032, std.dev.: 0.0081) MultiSource/Benchmarks/MallocBench/gs/gs: 7.13% (4.1105 => 4.4035, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.61% (1.1048 => 1.2552, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.42% (7.1582 => 7.8326, std.dev.: 0.0137) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.03% (0.6222 => 0.7406, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36100.00% (0.0001 => 0.0362, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 9 12:10:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 9 Oct 2012 14:10:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121009191034.2E9E02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4739?compare_to=4736&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4739, Order: 165501, Start Time: 2012-10-09 16:28:31, End Time: 2012-10-09 19:12:23 To: 4736, Order: 165498, Start Time: 2012-10-09 12:18:36, End Time: 2012-10-09 15:02:44 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (134 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 1042 (830 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: 12.35% (0.3442 => 0.3867, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-4: 12.21% (0.3465 => 0.3888, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.19% (0.3496 => 0.3922, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/exceptions-2: 12.16% (0.3446 => 0.3865, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.14% (0.3460 => 0.3880, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.13% (0.3488 => 0.3911, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 12.08% (0.3469 => 0.3888, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 11.81% (0.3650 => 0.4081, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.80% (0.3643 => 0.4073, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 11.47% (0.3724 => 0.4151, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 10.91% (1.5932 => 1.7670, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.44% (0.1063 => 0.1174, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.58% (0.5826 => 0.6384, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.32% (0.5889 => 0.6438, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 8.83% (0.1619 => 0.1762, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 8.54% (0.1218 => 0.1322, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 8.53% (0.7171 => 0.7783, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.49% (0.2875 => 0.3119, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 8.29% (0.3004 => 0.3253, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.25% (0.2738 => 0.2964, std.dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: 8.25% (0.9909 => 1.0726, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.20% (0.2792 => 0.3021, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 8.18% (0.2725 => 0.2948, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.16% (1.3152 => 1.4225, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 8.15% (0.2823 => 0.3053, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 8.14% (0.2714 => 0.2935, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.14% (0.3195 => 0.3455, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.09% (0.4994 => 0.5398, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/strcat: 8.07% (0.2750 => 0.2972, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 8.07% (0.2813 => 0.3040, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.02% (0.2729 => 0.2948, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 8.02% (0.2780 => 0.3003, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 7.96% (0.2803 => 0.3026, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.94% (0.2911 => 0.3142, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.93% (2.0673 => 2.2313, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.90% (0.1620 => 0.1748, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.85% (0.3845 => 0.4147, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.80% (0.4361 => 0.4701, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.77% (0.3267 => 0.3521, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/wc: 7.75% (0.3096 => 0.3336, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.72% (1.6211 => 1.7463, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.61% (0.3060 => 0.3293, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 7.57% (5.5417 => 5.9610, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.53% (3.5627 => 3.8311, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.52% (0.5000 => 0.5376, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 7.51% (0.3726 => 0.4006, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 7.51% (0.3317 => 0.3566, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 7.50% (0.3678 => 0.3954, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.49% (0.3258 => 0.3502, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 7.41% (0.3348 => 0.3596, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.37% (0.3282 => 0.3524, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/lists1: 7.36% (0.3477 => 0.3733, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.33% (0.3124 => 0.3353, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.32% (0.4139 => 0.4442, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.32% (0.3362 => 0.3608, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.30% (0.2014 => 0.2161, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.23% (0.3625 => 0.3887, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.07% (0.3690 => 0.3951, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 7.04% (0.4847 => 0.5188, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 7.02% (0.4146 => 0.4437, std.dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.02% (2.7292 => 2.9207, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.97% (0.5900 => 0.6311, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 6.94% (0.4251 => 0.4546, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 6.86% (0.2566 => 0.2742, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.84% (0.1462 => 0.1562, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.83% (0.3981 => 0.4253, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 6.83% (0.4029 => 0.4304, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.80% (0.2736 => 0.2922, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.73% (0.2866 => 0.3059, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.71% (0.1549 => 0.1653, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.69% (0.3930 => 0.4193, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.56% (0.3903 => 0.4159, std.dev.: 0.0019) MultiSource/Applications/siod/siod: 6.54% (0.6634 => 0.7068, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 6.52% (4.2109 => 4.4853, std.dev.: 0.0033) MultiSource/Applications/d/make_dparser: 6.46% (1.0781 => 1.1477, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 6.45% (1.8794 => 2.0007, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.45% (0.3890 => 0.4141, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.41% (0.5026 => 0.5348, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.35% (0.1968 => 0.2093, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.29% (0.6435 => 0.6840, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.26% (0.3084 => 0.3277, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 6.25% (0.5012 => 0.5325, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 6.24% (1.4269 => 1.5160, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.23% (0.2969 => 0.3154, std.dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 6.18% (23.5202 => 24.9738, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.10% (0.2737 => 0.2904, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.07% (4.4195 => 4.6877, std.dev.: 0.0059) MultiSource/Benchmarks/mafft/pairlocalalign: 6.02% (2.1013 => 2.2278, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.00% (0.2068 => 0.2192, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.95% (0.4658 => 0.4935, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 5.94% (0.9697 => 1.0273, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 5.86% (0.5546 => 0.5871, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.84% (0.3271 => 0.3462, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 5.76% (4.6177 => 4.8838, std.dev.: 0.0121) MultiSource/Applications/minisat/minisat: 5.52% (0.3336 => 0.3520, std.dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 5.43% (2.1653 => 2.2829, std.dev.: 0.0026) MultiSource/Applications/treecc/treecc: 5.41% (0.7875 => 0.8301, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.37% (0.2103 => 0.2216, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 5.05% (0.2691 => 0.2827, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.05% (0.2040 => 0.2143, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.95% (1.9966 => 2.0955, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.94% (1.9694 => 2.0667, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/football/football: 4.92% (0.2075 => 0.2177, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.89% (0.7426 => 0.7789, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 4.81% (2.0346 => 2.1325, std.dev.: 0.0184) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.55% (0.5361 => 0.5605, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 4.48% (0.2391 => 0.2498, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.33% (0.5584 => 0.5826, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.29% (11.6398 => 12.1389, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.16% (0.4253 => 0.4430, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.96% (4.6926 => 4.8782, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 3.95% (0.3498 => 0.3636, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.87% (0.3792 => 0.3901, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 2.85% (11.9555 => 12.2966, std.dev.: 0.0146) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.57% (3.3903 => 3.6129, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6708, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/flops: 4.73% (15.4430 => 16.1728, std.dev.: 0.0691) SingleSource/Benchmarks/Misc/flops-2: 4.66% (1.8057 => 1.8898, std.dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/dry: 4.32% (14.0481 => 14.6549, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1943, std.dev.: 0.0089) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5029, std.dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2220, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2856, std.dev.: 0.0054) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5137, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0014) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5799, std.dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.87% (25.4195 => 16.5555, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/ary2: -9.41% (0.2402 => 0.2176, std.dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9757, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7964, std.dev.: 0.0111) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9585, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7974, std.dev.: 0.0049) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.96% (17.2379 => 16.7284, std.dev.: 0.1141) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8600, std.dev.: 0.0089) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5706, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4957, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.13% (105.3826 => 104.1869, std.dev.: 0.0369) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0471, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 9 12:25:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 9 Oct 2012 14:25:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121009192508.7C9302A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4740?compare_to=4737&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4740, Order: 165513, Start Time: 2012-10-09 18:12:09, End Time: 2012-10-09 19:26:56 To: 4737, Order: 165501, Start Time: 2012-10-09 16:28:29, End Time: 2012-10-09 17:43:07 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 13 (190 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1028 (747 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.60% (1.5351 => 1.5597, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.50% (21.9983 => 22.3273, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.42% (5.3841 => 5.4607, std.dev.: 0.0094) MultiSource/Benchmarks/Bullet/bullet: 1.33% (33.6991 => 34.1470, std.dev.: 0.0065) MultiSource/Applications/SPASS/SPASS: 1.23% (15.3379 => 15.5271, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.17% (0.9486 => 0.9597, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 1.11% (3.4775 => 3.5162, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.09% (2.2358 => 2.2602, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.08% (0.9772 => 0.9878, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.07% (1.6304 => 1.6478, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 1.07% (2.4832 => 2.5097, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.03% (3.9953 => 4.0365, std.dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 1.02% (1.1524 => 1.1641, std.dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -2.26% (2.3128 => 2.2605, std.dev.: 0.0089) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.39% (2.0176 => 2.5097, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.79% (0.1410 => 0.1675, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 17.80% (0.0826 => 0.0973, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 16.76% (0.2243 => 0.2619, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.39% (0.0653 => 0.0760) MultiSource/Benchmarks/Olden/tsp/tsp: 14.22% (0.1013 => 0.1157, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.03% (0.0834 => 0.0951, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 13.90% (1.3693 => 1.5597, std.dev.: 0.0016) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.81% (0.1072 => 0.1220, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.52% (0.1413 => 0.1604, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 13.45% (0.2721 => 0.3087, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.34% (0.1327 => 0.1504, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 13.10% (0.7038 => 0.7960, std.dev.: 0.0145) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.06% (3.9660 => 4.4840, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.86% (0.0964 => 0.1088, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 12.66% (0.4328 => 0.4876, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.59% (0.1588 => 0.1788, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 12.59% (0.7061 => 0.7950, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.53% (0.6283 => 0.7070, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 12.51% (0.5818 => 0.6546, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.40% (0.2596 => 0.2918, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 12.35% (13.8202 => 15.5271, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/distray/distray: 12.35% (0.0818 => 0.0919) SingleSource/Benchmarks/Shootout-C++/hash: 12.31% (0.4062 => 0.4562, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.29% (1.4563 => 1.6353, std.dev.: 0.0035) SingleSource/UnitTests/ObjC++/Hello: 12.27% (0.5748 => 0.6453, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.26% (0.7710 => 0.8655, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.23% (1.2193 => 1.3684, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.18% (0.9199 => 1.0319, std.dev.: 0.0050) MultiSource/Applications/aha/aha: 12.05% (0.1062 => 0.1190, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.00% (0.5265 => 0.5897, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.00% (0.6959 => 0.7794, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.84% (1.1364 => 1.2710, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 11.67% (0.1003 => 0.1120, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.62% (0.3899 => 0.4352, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.61% (0.4791 => 0.5347, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.58% (0.1157 => 0.1291) SingleSource/Regression/C++/ofstream_ctor: 11.43% (0.2781 => 0.3099, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.25% (0.4016 => 0.4468, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.25% (0.3485 => 0.3877, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 11.14% (1.0313 => 1.1462, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 11.09% (0.2995 => 0.3327, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.08% (0.3756 => 0.4172, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.05% (0.3130 => 0.3476, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 11.03% (0.3489 => 0.3874, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.98% (0.1075 => 0.1193, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.96% (0.5577 => 0.6188, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.95% (0.0977 => 0.1084, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.93% (0.2782 => 0.3086, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 10.88% (1.1061 => 1.2264, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 10.84% (0.3293 => 0.3650, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.84% (0.3580 => 0.3968, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.82% (0.4379 => 0.4853, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.82% (0.4390 => 0.4865, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.76% (0.2966 => 0.3285, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.75% (0.3022 => 0.3347, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 10.72% (0.3453 => 0.3823, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 10.70% (0.3868 => 0.4282, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 10.70% (16.6129 => 18.3905, std.dev.: 0.0128) MultiSource/Applications/minisat/minisat: 10.63% (0.6744 => 0.7461, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.62% (0.2655 => 0.2937, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 10.51% (0.1589 => 0.1756, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 10.51% (0.2760 => 0.3050, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 10.49% (0.3107 => 0.3433, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.47% (0.3246 => 0.3586, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.47% (0.1986 => 0.2194, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 10.44% (0.1111 => 0.1227, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.44% (0.2127 => 0.2349, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 10.43% (0.2607 => 0.2879, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.43% (0.2914 => 0.3218, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 10.42% (0.2726 => 0.3010, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.40% (1.9828 => 2.1890, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/methcall: 10.39% (0.2761 => 0.3048, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 10.38% (0.2937 => 0.3242, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 10.37% (0.2690 => 0.2969, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.34% (0.8698 => 0.9597, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 10.33% (0.7506 => 0.8281, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 10.29% (0.3149 => 0.3473, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 10.27% (0.2628 => 0.2898, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.27% (0.2765 => 0.3049, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: 10.26% (3.1889 => 3.5162, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.26% (0.1014 => 0.1118, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 10.24% (0.3534 => 0.3896, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 10.20% (0.8310 => 0.9158, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 10.19% (1.9270 => 2.1233, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.16% (0.7460 => 0.8218, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 10.16% (0.3220 => 0.3547, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 10.12% (3.8646 => 4.2557, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.10% (0.1435 => 0.1580, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 10.09% (0.3192 => 0.3514, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 10.08% (0.1478 => 0.1627, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.07% (0.1569 => 0.1727, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.01% (0.5637 => 0.6201, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 9.97% (0.2988 => 0.3286, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.97% (0.1865 => 0.2051, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 9.97% (2.1791 => 2.3964, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.95% (0.1276 => 0.1403, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.95% (7.2180 => 7.9361, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.89% (0.2023 => 0.2223, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 9.88% (1.0594 => 1.1641, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.83% (0.2696 => 0.2961, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.76% (0.6576 => 0.7218, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.71% (0.3511 => 0.3852, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 9.64% (0.2925 => 0.3207, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.51% (4.9865 => 5.4607, std.dev.: 0.0094) MultiSource/Benchmarks/Olden/em3d/em3d: 9.35% (0.1657 => 0.1812, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.35% (3.6692 => 4.0122, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.32% (1.3245 => 1.4479, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.29% (0.3755 => 0.4104, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 9.28% (1.2749 => 1.3932, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/objinst: 9.20% (0.2945 => 0.3216, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 9.17% (0.3131 => 0.3418, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 9.15% (14.8535 => 16.2124, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.07% (4.4433 => 4.8463, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.05% (4.3801 => 4.7765, std.dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 9.00% (0.1789 => 0.1950, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 8.93% (8.4961 => 9.2549, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.88% (0.8818 => 0.9601, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.88% (0.2140 => 0.2330, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.64% (0.6135 => 0.6665, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 8.58% (4.6629 => 5.0630, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.49% (1.5188 => 1.6478, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 8.46% (0.4113 => 0.4461, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.45% (0.9108 => 0.9878, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.32% (0.4805 => 0.5205, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/bigfib: 8.32% (0.6250 => 0.6770, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.32% (0.4003 => 0.4336, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.26% (3.2742 => 3.5447, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.14% (1.1333 => 1.2255, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.10% (0.3914 => 0.4231, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 8.09% (0.1385 => 0.1497, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 8.03% (6.5754 => 7.1036, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/property: 7.99% (0.3940 => 0.4255, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.99% (0.3578 => 0.3864, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.93% (0.2321 => 0.2505, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 7.92% (0.2008 => 0.2167, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.86% (0.3789 => 0.4087, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.86% (0.3650 => 0.3937, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 7.83% (0.3601 => 0.3883, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.81% (0.3663 => 0.3949, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.80% (0.3245 => 0.3498, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 7.79% (0.3646 => 0.3930, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 7.73% (3.7467 => 4.0365, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-3: 7.70% (0.3623 => 0.3902, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.70% (1.2292 => 1.3238, std.dev.: 0.0107) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.63% (0.2504 => 0.2695, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.59% (2.1007 => 2.2602, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.59% (0.1819 => 0.1957, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.31% (6.2785 => 6.7372, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.72% (13.2842 => 14.1767, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/ReedSolomon: 6.13% (0.1777 => 0.1886, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.53% (0.2243 => 0.2367, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 5.21% (16.2614 => 17.1082, std.dev.: 0.0038) MultiSource/Applications/ClamAV/clamscan: 4.70% (14.5298 => 15.2133, std.dev.: 0.0123) MultiSource/Benchmarks/Bullet/bullet: 2.56% (33.2944 => 34.1470, std.dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5142, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.06% (1.0895 => 1.3625, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.37% (1.8175 => 2.2605, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/richards_benchmark: 11.04% (1.1560 => 1.2836, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.70% (0.1322 => 0.1437) SingleSource/Benchmarks/Shootout-C++/hash2: 7.61% (3.1736 => 3.4151, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 5.98% (1.2998 => 1.3775, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.63% (1.9144 => 2.0031, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.67% (11.2619 => 11.6750, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-6: 3.50% (1.9199 => 1.9871, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.27% (10.7476 => 11.0987, std.dev.: 0.0169) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.06% (7.4271 => 7.5802, std.dev.: 0.0092) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4529, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0497, std.dev.: 0.0023) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5136, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9696, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2126, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1873, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.20% (8.8259 => 8.9317, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.17% (5.5130 => 5.5773, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 1.10% (12.4560 => 12.5933, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0264, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.63% (0.2670 => 0.1425, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.22% (0.4657 => 0.3948, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.82% (1.3819 => 1.2048, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.80% (1.3813 => 1.2045, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.04% (22.5627 => 22.3273, std.dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.64% (0.0997 => 0.0861, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.93% (0.2238 => 0.1971, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.97% (1.2308 => 1.0958, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.10% (20.3410 => 18.2865, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0121) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.80% (1.3780 => 1.2981, std.dev.: 0.0104) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5148, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.77% (0.9996 => 0.9619, std.dev.: 0.0062) MultiSource/Applications/siod/siod: -3.55% (3.2729 => 3.1566, std.dev.: 0.0228) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.48% (1.7688 => 1.7073, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.96% (0.4867 => 0.4723, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.45% (26.5159 => 25.8668, std.dev.: 0.0373) MultiSource/Applications/spiff/spiff: -2.40% (3.0263 => 2.9538, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -2.37% (1.9762 => 1.9294, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.99% (0.6589 => 0.6458, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7149, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.65% (6.3560 => 6.2510, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0073, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -1.43% (4.5928 => 4.5269, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8684, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4944, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.16% (9.3358 => 9.2279, std.dev.: 0.0058) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2570, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 9 14:08:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 9 Oct 2012 16:08:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121009210850.664A42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4741?compare_to=4740&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4741, Order: 165530, Start Time: 2012-10-09 19:55:56, End Time: 2012-10-09 21:10:38 To: 4740, Order: 165513, Start Time: 2012-10-09 18:12:09, End Time: 2012-10-09 19:26:56 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (184 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1042 (752 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.04% (2.0176 => 2.5027, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.16% (0.1410 => 0.1666, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 17.80% (0.0826 => 0.0973, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 16.05% (0.2243 => 0.2603, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 13.62% (0.1013 => 0.1151, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.34% (0.1072 => 0.1215) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.19% (0.0834 => 0.0944, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 13.07% (1.3693 => 1.5482, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.88% (0.1413 => 0.1595, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 12.69% (0.7038 => 0.7931, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.42% (0.2721 => 0.3059, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.42% (3.9660 => 4.4585, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/hash2: 12.36% (0.4328 => 0.4863, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.22% (0.1588 => 0.1782, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.14% (0.0964 => 0.1081, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.79% (1.4563 => 1.6280, std.dev.: 0.0055) MultiSource/Applications/SPASS/SPASS: 11.76% (13.8202 => 15.4457, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.75% (0.2596 => 0.2901, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash: 11.74% (0.4062 => 0.4539, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 11.62% (0.5818 => 0.6494, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.57% (0.6283 => 0.7010, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.56% (0.9199 => 1.0262, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.55% (0.5265 => 0.5873, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.54% (1.2193 => 1.3600, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.48% (0.6959 => 0.7758, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.41% (0.7710 => 0.8590, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.38% (1.1364 => 1.2657, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.36% (0.3899 => 0.4342, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 11.31% (0.5748 => 0.6398, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 11.30% (0.7061 => 0.7859, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 11.30% (0.1062 => 0.1182, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 11.08% (0.2781 => 0.3089, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/power/power: 10.97% (0.1003 => 0.1113, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.96% (0.3485 => 0.3867, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.91% (0.4016 => 0.4454, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.86% (0.3130 => 0.3470, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 10.80% (1.0313 => 1.1427, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.78% (0.2782 => 0.3082, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.69% (0.1048 => 0.1160, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.65% (0.3756 => 0.4156, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.59% (0.3022 => 0.3342, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.52% (0.3489 => 0.3856, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 10.51% (0.3293 => 0.3639, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.50% (0.4390 => 0.4851, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.50% (0.4791 => 0.5294, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.37% (0.1157 => 0.1277, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.35% (0.5577 => 0.6154, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.34% (0.3580 => 0.3950, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/except: 10.25% (0.2760 => 0.3043, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 10.25% (0.3453 => 0.3807, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.23% (1.9828 => 2.1856, std.dev.: 0.0087) MultiSource/Applications/Burg/burg: 10.23% (1.1061 => 1.2192, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.22% (0.2966 => 0.3269, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 10.19% (0.2690 => 0.2964, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 10.17% (16.6129 => 18.3021, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/hello: 10.16% (0.2607 => 0.2872, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.16% (0.2765 => 0.3046, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 10.16% (0.3868 => 0.4261, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.14% (0.1075 => 0.1184, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 10.12% (0.2726 => 0.3002, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 10.11% (0.2937 => 0.3234, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 10.10% (0.6744 => 0.7425, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.09% (0.2655 => 0.2923, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 10.08% (0.2628 => 0.2893, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 10.08% (0.2995 => 0.3297, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 10.07% (0.2761 => 0.3039, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 10.03% (0.3149 => 0.3465, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 9.98% (0.3107 => 0.3417, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.96% (0.4379 => 0.4815, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 9.94% (0.2988 => 0.3285, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/lists1: 9.93% (0.3534 => 0.3885, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.89% (0.3246 => 0.3567, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.83% (0.8698 => 0.9553, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.83% (0.2127 => 0.2336, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.79% (0.7460 => 0.8190, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 9.74% (3.1889 => 3.4994, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.71% (0.3511 => 0.3852, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 9.71% (0.3192 => 0.3502, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 9.66% (0.3220 => 0.3531, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.64% (0.2696 => 0.2956, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 9.63% (0.1589 => 0.1742, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 9.62% (1.9270 => 2.1124, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.62% (0.5637 => 0.6179, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.61% (0.2914 => 0.3194, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 9.59% (3.8646 => 4.2351, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/football/football: 9.54% (0.8310 => 0.9103, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 9.54% (0.1111 => 0.1217, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.48% (0.1435 => 0.1571, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 9.46% (2.1791 => 2.3853, std.dev.: 0.0057) MultiSource/Applications/spiff/spiff: 9.42% (0.7506 => 0.8213, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.37% (7.2180 => 7.8942, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.37% (0.1986 => 0.2172, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 9.34% (1.0594 => 1.1584, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.23% (4.9865 => 5.4468, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.22% (0.6576 => 0.7182, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 9.20% (0.2945 => 0.3216, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.17% (0.1276 => 0.1393, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 9.16% (0.2925 => 0.3193, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.14% (0.2023 => 0.2208, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.11% (0.1569 => 0.1712, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.01% (0.1865 => 0.2033, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 9.00% (0.1478 => 0.1611, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.95% (0.3755 => 0.4091, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 8.88% (0.3131 => 0.3409, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.87% (3.6692 => 3.9948, std.dev.: 0.0150) MultiSource/Applications/JM/lencod/lencod: 8.73% (14.8535 => 16.1503, std.dev.: 0.0105) MultiSource/Applications/SIBsim4/SIBsim4: 8.70% (1.2749 => 1.3858, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.61% (4.3801 => 4.7572, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/em3d/em3d: 8.57% (0.1657 => 0.1799, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.56% (1.3245 => 1.4379, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.53% (0.8818 => 0.9570, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.35% (4.4433 => 4.8141, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 8.34% (8.4961 => 9.2043, std.dev.: 0.0069) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.13% (0.2140 => 0.2314, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.05% (0.1789 => 0.1933, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.04% (0.6135 => 0.6628, std.dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 8.04% (4.6629 => 5.0376, std.dev.: 0.0190) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.01% (0.4805 => 0.5190, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 7.94% (0.6250 => 0.6746, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.92% (0.9108 => 0.9829, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.88% (1.5188 => 1.6385, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.71% (3.2742 => 3.5267, std.dev.: 0.0112) MultiSource/Applications/JM/ldecod/ldecod: 7.67% (6.5754 => 7.0800, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.66% (1.1333 => 1.2201, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: 7.66% (0.4113 => 0.4428, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 7.62% (0.4003 => 0.4308, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.58% (0.2321 => 0.2497, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/neural/neural: 7.51% (0.1385 => 0.1489, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.43% (0.3914 => 0.4205, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.28% (0.3940 => 0.4227, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 7.28% (1.2292 => 1.3187, std.dev.: 0.0017) MultiSource/Applications/lua/lua: 7.28% (3.7467 => 4.0193, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.27% (0.3245 => 0.3481, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 7.18% (0.3578 => 0.3835, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.13% (0.3646 => 0.3906, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.13% (0.3789 => 0.4059, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 7.12% (0.2008 => 0.2151, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.10% (0.3650 => 0.3909, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.07% (0.3663 => 0.3922, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.07% (0.2504 => 0.2681, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 7.05% (0.3601 => 0.3855, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.02% (2.1007 => 2.2481, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.98% (0.3623 => 0.3876, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.74% (6.2785 => 6.7017, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.48% (13.2842 => 14.1448, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.43% (0.1819 => 0.1936, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.99% (0.2243 => 0.2355, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 4.98% (16.2614 => 17.0711, std.dev.: 0.0056) MultiSource/Applications/ClamAV/clamscan: 4.53% (14.5298 => 15.1875, std.dev.: 0.0082) MultiSource/Benchmarks/Bullet/bullet: 1.66% (33.2944 => 33.8476, std.dev.: 0.0107) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5154, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.05% (1.0895 => 1.3624, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.41% (1.8175 => 2.2611, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/richards_benchmark: 11.17% (1.1560 => 1.2851, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.02% (0.8273 => 0.9019, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4138, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.09% (1.2998 => 1.3789, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9999, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626) SingleSource/Benchmarks/Misc/flops-5: 4.67% (1.9144 => 2.0038, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6765, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.51% (1.9199 => 1.9873, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.36% (10.7476 => 11.1086, std.dev.: 0.0623) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.23% (7.4271 => 7.5928, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4540, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5132, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9689, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1865, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.16% (5.5130 => 5.5772, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0272, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5877, std.dev.: 0.0081) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.85% (0.2670 => 0.1419) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.85% (0.4657 => 0.3919, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -14.43% (0.0707 => 0.0605, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.26% (1.3813 => 1.1981, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.21% (1.3819 => 1.1993, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.51% (22.5627 => 22.2225, std.dev.: 0.0127) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.74% (0.0997 => 0.0860, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -11.93% (0.2238 => 0.1971, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.90% (1.2308 => 1.0967, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.04% (20.3410 => 18.2984, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.13% (2.6470 => 2.5111, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.75% (1.3780 => 1.3126, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.40% (0.9996 => 0.9556, std.dev.: 0.0122) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8004, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1559, std.dev.: 0.0204) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.52% (1.7688 => 1.7065, std.dev.: 0.0238) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.04% (0.4867 => 0.4719, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.49% (26.5159 => 25.8556, std.dev.: 0.0092) MultiSource/Applications/spiff/spiff: -2.42% (3.0263 => 2.9532, std.dev.: 0.0028) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.27% (1.9762 => 1.9314, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/lists: -2.00% (6.3560 => 6.2291, std.dev.: 0.0101) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.97% (0.6589 => 0.6459, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7154, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0062, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8625, std.dev.: 0.0094) MultiSource/Applications/sqlite3/sqlite3: -1.35% (4.5928 => 4.5306, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: -1.22% (9.3358 => 9.2221, std.dev.: 0.0440) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.16% (2.5254 => 2.4962, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2590, std.dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 9 14:28:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 9 Oct 2012 16:28:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121009212823.E4FB82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4742?compare_to=4738&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4742, Order: 165532, Start Time: 2012-10-09 20:10:41, End Time: 2012-10-09 21:30:12 To: 4738, Order: 165501, Start Time: 2012-10-09 16:28:30, End Time: 2012-10-09 17:47:57 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (161 on baseline) Performance Improvements: 1 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1023 (756 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.72% (54.4624 => 56.4899, std.dev.: 0.0242) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -1.50% (11.7407 => 11.5641, std.dev.: 0.0040) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.49% (0.5908 => 0.5937, std.dev.: 0.0060) MultiSource/Applications/SPASS/SPASS: 0.54% (16.3032 => 16.3906, std.dev.: 0.0128) MultiSource/Benchmarks/Bullet/bullet: 0.39% (54.8889 => 55.1016, std.dev.: 0.3198) MultiSource/Benchmarks/MallocBench/gs/gs: 0.42% (4.4035 => 4.4219, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.25% (1.2552 => 1.2583, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.02% (7.8326 => 7.8340, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.01% (0.7406 => 0.7405, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.28% (0.0362 => 0.0363, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: - (0.1431 => 0.1431, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.85% (0.0649 => 0.0661, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -12.87% (63.2438 => 55.1016, std.dev.: 0.3198) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 33.05% (14.1553 => 18.8334, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.08% (3.4629 => 5.6472, std.dev.: 0.0020) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14235.28% (0.0720 => 10.3214, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952000.00% (0.0001 => 9.9521, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.27% (0.2554 => 0.4170, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 48.61% (10.3673 => 15.4066, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/richards_benchmark: 38.59% (0.1622 => 0.2248, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 33.24% (0.1056 => 0.1407, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 18.72% (0.1432 => 0.1700, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.79% (7.0540 => 8.3086, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.36% (2.2022 => 2.5845, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.94% (0.1566 => 0.1800, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 12.89% (0.3282 => 0.3705, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.87% (1.7609 => 1.9875, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.74% (0.0871 => 0.0982, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.47% (0.0834 => 0.0938, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 12.08% (0.1440 => 0.1614, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.49% (0.1584 => 0.1766, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 10.81% (10.4361 => 11.5641, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.74% (0.4879 => 0.5403, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.50% (0.3543 => 0.3915, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 10.30% (0.1175 => 0.1296, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 10.25% (0.7115 => 0.7844, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 10.11% (9.4845 => 10.4434, std.dev.: 0.0147) MultiSource/Applications/lambda-0_1_3/lambda: 10.09% (0.7433 => 0.8183, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.08% (0.1438 => 0.1583, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.96% (1.5415 => 1.6950, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/trivial-interface: 9.88% (0.3473 => 0.3816, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.82% (0.3177 => 0.3489, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.77% (0.6675 => 0.7327, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: 9.76% (0.3516 => 0.3859, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.74% (0.3543 => 0.3888, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.72% (0.3497 => 0.3837, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 9.72% (0.3561 => 0.3907, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.70% (0.3927 => 0.4308, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.63% (0.2700 => 0.2960, std.dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: 9.62% (5.7591 => 6.3131, std.dev.: 0.0164) SingleSource/Benchmarks/McGill/chomp: 9.61% (0.1655 => 0.1814, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 9.59% (0.3828 => 0.4195, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.49% (0.5860 => 0.6416, std.dev.: 0.0085) MultiSource/Applications/d/make_dparser: 9.45% (3.3354 => 3.6506, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/18-imp/imp: 9.44% (0.3423 => 0.3746, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 9.42% (0.3694 => 0.4042, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.42% (0.3886 => 0.4252, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.42% (0.1625 => 0.1778, std.dev.: 0.0025) MultiSource/Applications/sgefa/sgefa: 9.39% (0.3109 => 0.3401, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.04% (0.4615 => 0.5032, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 8.97% (0.1695 => 0.1847, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.89% (0.5105 => 0.5559, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.84% (4.2646 => 4.6414, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.84% (0.8172 => 0.8894, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.82% (1.3050 => 1.4201, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.79% (0.8067 => 0.8776, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.72% (0.2271 => 0.2469, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.71% (4.9449 => 5.3758, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/mst/mst: 8.68% (0.1163 => 0.1264, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.50% (0.2107 => 0.2286, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.49% (0.5569 => 0.6042, std.dev.: 0.0028) MultiSource/Applications/Burg/burg: 8.48% (1.1642 => 1.2629, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.46% (5.0018 => 5.4248, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.45% (8.1363 => 8.8242, std.dev.: 0.0029) MultiSource/Benchmarks/sim/sim: 8.44% (0.3387 => 0.3673, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.41% (0.1510 => 0.1637, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.25% (0.1236 => 0.1338, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 8.25% (1.5603 => 1.6890, std.dev.: 0.0073) MultiSource/Applications/lua/lua: 8.23% (3.8723 => 4.1911, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.21% (0.9765 => 1.0567, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.20% (0.1940 => 0.2099, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.18% (7.9617 => 8.6129, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.09% (0.5020 => 0.5426, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.07% (0.3307 => 0.3574, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.05% (0.2758 => 0.2980, std.dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.04% (0.3121 => 0.3372, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/bigfib: 8.04% (0.6456 => 0.6975, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 8.03% (0.7835 => 0.8464, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 8.02% (1.0722 => 1.1582, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.93% (0.1337 => 0.1443) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.89% (0.2065 => 0.2228, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: 7.80% (2.0273 => 2.1855, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.79% (1.5859 => 1.7094, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference-object: 7.74% (0.6030 => 0.6497, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.71% (0.5925 => 0.6382, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 7.65% (0.1555 => 0.1674, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.61% (0.3441 => 0.3703, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.40% (0.4299 => 0.4617, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 7.39% (0.3180 => 0.3415, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.36% (0.7326 => 0.7865, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 7.34% (2.2969 => 2.4656, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.34% (1.1861 => 1.2732, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.29% (0.4103 => 0.4402, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.23% (0.4636 => 0.4971, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.11% (0.4203 => 0.4502, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 7.11% (0.1463 => 0.1567, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.07% (0.2603 => 0.2787, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 7.02% (0.4289 => 0.4590, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.01% (0.3865 => 0.4136, std.dev.: 0.0035) MultiSource/Applications/JM/lencod/lencod: 6.98% (21.9371 => 23.4685, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/hash2: 6.95% (0.4620 => 0.4941, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.91% (0.6450 => 0.6896, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/football/football: 6.91% (0.8921 => 0.9537, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists: 6.90% (0.3422 => 0.3658, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.82% (2.2024 => 2.3525, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.69% (0.5981 => 0.6381, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.68% (0.3650 => 0.3894, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 6.60% (0.4048 => 0.4315, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.59% (0.3826 => 0.4078, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 6.57% (0.2725 => 0.2904, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.49% (0.2756 => 0.2935, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.44% (0.2905 => 0.3092, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.38% (0.3603 => 0.3833, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.34% (0.1892 => 0.2012, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.34% (1.4186 => 1.5085, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hello: 6.30% (0.2714 => 0.2885, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.25% (0.3136 => 0.3332, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.23% (0.2891 => 0.3071, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.22% (1.1840 => 1.2577, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.17% (0.3162 => 0.3357, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 6.11% (0.3684 => 0.3909, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.03% (0.2871 => 0.3044, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.02% (0.1695 => 0.1797, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.99% (2.0665 => 2.1903, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/strcat: 5.93% (0.2831 => 0.2999, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/matrix: 5.91% (0.3098 => 0.3281, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 5.83% (0.3379 => 0.3576, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.81% (0.2872 => 0.3039, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.79% (0.3283 => 0.3473, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.72% (0.3232 => 0.3417, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.70% (0.8101 => 0.8563, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.67% (0.3052 => 0.3225, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 5.60% (0.2802 => 0.2959, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.59% (0.2793 => 0.2949, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 5.56% (0.2877 => 0.3037, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.52% (0.2266 => 0.2391, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.51% (0.1906 => 0.2011, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.34% (0.4064 => 0.4281, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 5.22% (0.2049 => 0.2156, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.80% (14.3668 => 15.0558, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.67% (0.3427 => 0.3587, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.54% (0.3131 => 0.3273, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 4.40% (17.1811 => 17.9377, std.dev.: 0.0172) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.40% (0.2430 => 0.2537, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.35% (1.2842 => 1.3400, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.01% (3.8922 => 4.0483, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.84% (1.1194 => 1.1512, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.22% (1.1145 => 1.3844, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.84% (1.1396 => 1.2517, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 9.18% (3.1595 => 3.4496, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.62% (3.1578 => 3.3670, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.4162 => 0.4322, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.55% (3.6395 => 3.7688, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.70% (4.2280 => 4.3423, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (0.8275 => 0.8405, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8135, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.31% (2.6546 => 2.6895, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.02% (6.6874 => 0.1326, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.01% (5.2763 => 3.2709, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.69% (5.3855 => 3.6786, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.26% (5.3526 => 3.6796, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -14.83% (54.1659 => 46.1336, std.dev.: 0.0586) MultiSource/Applications/ClamAV/clamscan: -10.72% (22.1758 => 19.7994, std.dev.: 0.0096) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.42% (2.9384 => 2.6321, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.50% (1.1492 => 0.7642, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: -15.72% (1.6925 => 1.4264, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.03% (0.0998 => 0.0858, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -12.24% (1.2373 => 1.0859, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3784, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/mason/mason: -9.86% (0.2161 => 0.1948, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.26% (19.9488 => 18.3018, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4787, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.69% (1.8329 => 1.7103, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.31% (1.6805 => 1.5912, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.93% (1.5835 => 1.5055, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.91% (0.9957 => 0.9568, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.57% (3.2827 => 3.1654, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4964, std.dev.: 0.0080) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0992, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.92% (8.6802 => 8.5137, std.dev.: 0.0137) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.86% (8.1563 => 8.0046, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/salsa20: -1.82% (10.2830 => 10.0960, std.dev.: 0.0193) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6811, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: -1.64% (1.1277 => 1.1092) SingleSource/UnitTests/Vector/multiplies: -1.63% (2.5528 => 2.5112, std.dev.: 0.0053) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4218, std.dev.: 0.0092) MultiSource/Applications/sqlite3/sqlite3: -1.13% (4.6441 => 4.5916, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8582, std.dev.: 0.0006) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.54% (0.5229 => 0.5937, std.dev.: 0.0060) MultiSource/Applications/SPASS/SPASS: 9.35% (14.9895 => 16.3906, std.dev.: 0.0128) MultiSource/Benchmarks/MallocBench/gs/gs: 7.58% (4.1105 => 4.4219, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.89% (1.1048 => 1.2583, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.44% (7.1582 => 7.8340, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.01% (0.6222 => 0.7405, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36200.00% (0.0001 => 0.0363, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.76% (0.2116 => 0.0661, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 9 15:23:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 9 Oct 2012 17:23:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121009222345.7F31F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4743?compare_to=4739&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4743, Order: 165530, Start Time: 2012-10-09 19:41:41, End Time: 2012-10-09 22:25:34 To: 4739, Order: 165501, Start Time: 2012-10-09 16:28:31, End Time: 2012-10-09 19:12:23 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (135 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 1040 (828 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.48% (1.0273 => 1.0425, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.00% (54.2016 => 54.7438, std.dev.: 0.1157) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 11.24% (0.3496 => 0.3889, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.17% (0.3465 => 0.3852, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 11.14% (0.3446 => 0.3830, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 11.10% (0.3442 => 0.3824, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.10% (0.3488 => 0.3875, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 11.07% (0.3460 => 0.3843, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.04% (0.3469 => 0.3852, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.91% (0.1063 => 0.1179, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.90% (0.3650 => 0.4048, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/exceptions: 10.84% (0.3643 => 0.4038, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.63% (0.3724 => 0.4120, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 10.33% (1.5932 => 1.7577, std.dev.: 0.0084) SingleSource/UnitTests/ObjC++/Hello: 9.11% (0.5826 => 0.6357, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.95% (0.5889 => 0.6416, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 8.70% (0.1218 => 0.1324, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 8.52% (0.1619 => 0.1757, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 8.37% (0.7171 => 0.7771, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 8.32% (0.3004 => 0.3254, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.11% (0.4994 => 0.5399, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 7.91% (0.9909 => 1.0693, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.90% (0.2875 => 0.3102, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.89% (0.4361 => 0.4705, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.86% (1.6211 => 1.7485, std.dev.: 0.0081) MultiSource/Applications/SPASS/SPASS: 7.81% (5.5417 => 5.9747, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.76% (1.3152 => 1.4173, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.73% (0.3195 => 0.3442, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.71% (0.2813 => 0.3030, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.70% (0.5000 => 0.5385, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.67% (0.2725 => 0.2934, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.66% (0.2792 => 0.3006, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 7.64% (0.2750 => 0.2960, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.60% (0.2738 => 0.2946, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 7.59% (0.4847 => 0.5215, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.59% (0.2911 => 0.3132, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.58% (0.3258 => 0.3505, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: 7.58% (0.2823 => 0.3037, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.53% (0.1620 => 0.1742, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 7.52% (0.2714 => 0.2918, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.51% (0.2729 => 0.2934, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 7.51% (0.9697 => 1.0425, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 7.49% (0.2803 => 0.3013, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 7.48% (0.2780 => 0.2988, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 7.47% (0.2811 => 0.3021, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.45% (0.3060 => 0.3288, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 7.41% (0.3267 => 0.3509, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.40% (0.2866 => 0.3078, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 7.40% (0.3678 => 0.3950, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.39% (0.4139 => 0.4445, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.39% (2.0673 => 2.2201, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.37% (3.5627 => 3.8252, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/wc: 7.33% (0.3096 => 0.3323, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.25% (0.2014 => 0.2160, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 7.24% (0.3317 => 0.3557, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.17% (0.3625 => 0.3885, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 7.17% (0.3726 => 0.3993, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 7.16% (0.6634 => 0.7109, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 7.13% (1.0781 => 1.1550, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.12% (0.5026 => 0.5384, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/lists: 7.11% (0.3348 => 0.3586, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.10% (0.1549 => 0.1659, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.09% (0.2736 => 0.2930, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.08% (0.3362 => 0.3600, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.01% (0.3124 => 0.3343, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.98% (0.3282 => 0.3511, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.95% (0.3930 => 0.4203, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 6.93% (0.3477 => 0.3718, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 6.93% (4.2109 => 4.5026, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.83% (0.3690 => 0.3942, std.dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 6.78% (0.2566 => 0.2740, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.76% (2.7292 => 2.9137, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.73% (0.3981 => 0.4249, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash2: 6.73% (0.4251 => 0.4537, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 6.72% (23.5202 => 25.1003, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.71% (0.3903 => 0.4165, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 6.71% (0.1505 => 0.1606, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.71% (0.4146 => 0.4424, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.68% (0.3845 => 0.4102, std.dev.: 0.0021) MultiSource/Applications/Burg/burg: 6.62% (0.5546 => 0.5913, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.58% (0.3890 => 0.4146, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.56% (0.5900 => 0.6287, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/gs/gs: 6.56% (1.8794 => 2.0026, std.dev.: 0.0029) MultiSource/Applications/minisat/minisat: 6.53% (0.3336 => 0.3554, std.dev.: 0.0055) MultiSource/Applications/spiff/spiff: 6.45% (0.4029 => 0.4289, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.38% (4.4195 => 4.7013, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.37% (0.6435 => 0.6845, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 6.34% (1.4269 => 1.5173, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.32% (0.3084 => 0.3279, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 6.25% (0.5012 => 0.5325, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.24% (0.2068 => 0.2197, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.23% (0.2969 => 0.3154, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.20% (0.1968 => 0.2090, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 6.19% (2.1013 => 2.2313, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.17% (0.2737 => 0.2906, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 6.13% (0.2691 => 0.2856, std.dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 6.01% (4.6177 => 4.8952, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.99% (0.4658 => 0.4937, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.96% (0.3271 => 0.3466, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.85% (0.2103 => 0.2226, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 5.79% (2.1653 => 2.2906, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 5.65% (0.7875 => 0.8320, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 5.55% (2.0346 => 2.1476, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.54% (0.2040 => 0.2153, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.48% (0.7426 => 0.7833, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 5.30% (0.2075 => 0.2185, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.28% (1.9694 => 2.0734, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.25% (1.9966 => 2.1015, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.20% (0.5361 => 0.5640, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 5.02% (0.2391 => 0.2511, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.55% (11.6398 => 12.1696, std.dev.: 0.0101) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.45% (4.6926 => 4.9014, std.dev.: 0.0112) MultiSource/Applications/lambda-0_1_3/lambda: 4.32% (0.3498 => 0.3649, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.29% (0.4253 => 0.4393, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 2.85% (11.9555 => 12.2966, std.dev.: 0.0112) SingleSource/UnitTests/Vector/constpool: 2.50% (2.4764 => 2.5383, std.dev.: 0.0219) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6108, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 5.56% (0.2122 => 0.2240, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 5.10% (12.0509 => 12.6656, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1677, std.dev.: 0.1317) SingleSource/Benchmarks/Misc/flops-2: 4.60% (1.8057 => 1.8887, std.dev.: 0.0059) SingleSource/Benchmarks/Dhrystone/dry: 4.17% (14.0481 => 14.6333, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1929, std.dev.: 0.0072) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5041, std.dev.: 0.0024) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.59% (3.1722 => 3.2227, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2866, std.dev.: 0.0026) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5123, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5885, std.dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.93% (25.4195 => 16.5393, std.dev.: 0.0250) SingleSource/Benchmarks/Shootout-C++/ary2: -9.16% (0.2402 => 0.2182, std.dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9745, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7987, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -3.74% (11.2080 => 10.7891, std.dev.: 0.0152) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.07% (0.6293 => 0.6100, std.dev.: 0.0051) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7726, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: -2.57% (17.2379 => 16.7951, std.dev.: 0.0418) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8636, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5732, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4965, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.15% (105.3826 => 104.1702, std.dev.: 0.0412) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0466, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 9 15:52:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 9 Oct 2012 17:52:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121009225252.413372A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4744?compare_to=4741&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4744, Order: 165548, Start Time: 2012-10-09 21:39:48, End Time: 2012-10-09 22:54:38 To: 4741, Order: 165530, Start Time: 2012-10-09 19:55:56, End Time: 2012-10-09 21:10:38 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (185 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1042 (751 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.93% (2.0176 => 2.5005, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.65% (0.1410 => 0.1673, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 17.80% (0.0826 => 0.0973, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 15.87% (0.2243 => 0.2599, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 13.62% (0.1013 => 0.1151, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.31% (0.0834 => 0.0945, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.94% (0.2721 => 0.3073, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.88% (0.1413 => 0.1595, std.dev.: 0.0009) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.69% (0.1072 => 0.1208, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.58% (0.1327 => 0.1494, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 12.48% (0.7038 => 0.7916, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.40% (3.9660 => 4.4579, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.34% (0.1588 => 0.1784, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 12.33% (1.3693 => 1.5382, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.24% (0.0964 => 0.1082, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.85% (1.4563 => 1.6289, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.85% (0.9199 => 1.0289, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.83% (0.2596 => 0.2903, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.70% (0.6959 => 0.7773, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.60% (1.2193 => 1.3607, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 11.57% (13.8202 => 15.4197, std.dev.: 0.0185) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.57% (0.7710 => 0.8602, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.55% (0.6283 => 0.7009, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.51% (1.1364 => 1.2672, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.49% (0.5265 => 0.5870, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 11.44% (0.4328 => 0.4823, std.dev.: 0.0037) MultiSource/Applications/aha/aha: 11.30% (0.1062 => 0.1182, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.02% (0.3130 => 0.3475, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 11.00% (0.7061 => 0.7838, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 10.90% (1.0313 => 1.1437, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 10.87% (0.1003 => 0.1112, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 10.86% (0.4062 => 0.4503, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: 10.73% (0.5818 => 0.6442, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.69% (0.1048 => 0.1160, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.54% (0.3899 => 0.4310, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.53% (0.5577 => 0.6164, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 10.42% (0.5748 => 0.6347, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 10.42% (0.2995 => 0.3307, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.39% (0.4791 => 0.5289, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 10.35% (1.1061 => 1.2206, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.33% (0.1075 => 0.1186, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.29% (0.1157 => 0.1276, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.26% (0.3246 => 0.3579, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/chomp: 10.13% (0.1589 => 0.1750, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.13% (0.3485 => 0.3838, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.09% (0.4379 => 0.4821, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.08% (0.6576 => 0.7239, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 10.07% (0.2781 => 0.3061, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 10.05% (16.6129 => 18.2820, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.01% (0.4016 => 0.4418, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 9.96% (0.6744 => 0.7416, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 9.94% (0.8310 => 0.9136, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.85% (0.2914 => 0.3201, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.80% (0.3489 => 0.3831, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.79% (0.4390 => 0.4820, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.76% (0.1435 => 0.1575, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 9.72% (0.1111 => 0.1219, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.70% (0.5637 => 0.6184, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.69% (0.7460 => 0.8183, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.69% (0.3756 => 0.4120, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.69% (0.2127 => 0.2333, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 9.66% (0.3220 => 0.3531, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.64% (0.3580 => 0.3925, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 9.63% (1.9270 => 2.1126, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/gs/gs: 9.62% (3.8646 => 4.2364, std.dev.: 0.0020) MultiSource/Applications/d/make_dparser: 9.62% (3.1889 => 3.4956, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.60% (0.2782 => 0.3049, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.56% (0.3022 => 0.3311, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.56% (0.1276 => 0.1398, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 9.55% (2.1791 => 2.3872, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 9.54% (0.3293 => 0.3607, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 9.51% (1.0594 => 1.1601, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 9.39% (0.7506 => 0.8211, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.34% (0.8698 => 0.9510, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 9.33% (0.3868 => 0.4229, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.31% (0.3511 => 0.3838, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.31% (0.2966 => 0.3242, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 9.24% (0.2760 => 0.3015, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.23% (1.9828 => 2.1659, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.21% (0.1986 => 0.2169, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.19% (0.2023 => 0.2209, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.18% (7.2180 => 7.8806, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/sieve: 9.12% (0.3453 => 0.3768, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.11% (0.2655 => 0.2897, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 9.09% (0.2925 => 0.3191, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.06% (0.1865 => 0.2034, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 9.06% (0.2726 => 0.2973, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 9.03% (0.2690 => 0.2933, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 9.01% (0.2607 => 0.2842, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 9.00% (0.1478 => 0.1611, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 9.00% (0.3534 => 0.3852, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.99% (0.1569 => 0.1710, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 8.98% (0.2761 => 0.3009, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.97% (0.2765 => 0.3013, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 8.95% (0.2937 => 0.3200) SingleSource/Benchmarks/Shootout-C++/fibo: 8.90% (0.2628 => 0.2862, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.90% (4.9865 => 5.4302, std.dev.: 0.0073) MultiSource/Applications/SIBsim4/SIBsim4: 8.87% (1.2749 => 1.3880, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 8.85% (0.3107 => 0.3382, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 8.83% (0.3149 => 0.3427, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 8.80% (0.2988 => 0.3251, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.73% (1.3245 => 1.4401, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.71% (0.8818 => 0.9586, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary2: 8.71% (0.3192 => 0.3470, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.67% (3.6692 => 3.9874, std.dev.: 0.0102) MultiSource/Benchmarks/sim/sim: 8.66% (0.3131 => 0.3402, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 8.65% (14.8535 => 16.1384, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.61% (0.2696 => 0.2928, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.43% (4.3801 => 4.7495, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 8.39% (0.1657 => 0.1796, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.38% (4.4433 => 4.8158, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 8.27% (8.4961 => 9.1989, std.dev.: 0.0141) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.26% (0.6135 => 0.6642, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.18% (0.3755 => 0.4062, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.13% (1.5188 => 1.6423, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 8.13% (4.6629 => 5.0420, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/objinst: 8.08% (0.2945 => 0.3183, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.04% (0.2140 => 0.2312, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.99% (0.1789 => 0.1932, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.94% (0.9108 => 0.9831, std.dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.83% (3.2742 => 3.5307, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.75% (1.1333 => 1.2211, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/05-eks/eks: 7.66% (0.4113 => 0.4428, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/neural/neural: 7.65% (0.1385 => 0.1491, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 7.39% (6.5754 => 7.0613, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/bigfib: 7.33% (0.6250 => 0.6708, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.33% (0.4805 => 0.5157, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.32% (0.2321 => 0.2491, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 7.27% (0.2008 => 0.2154, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.26% (2.1007 => 2.2532, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.23% (0.2504 => 0.2685, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 7.18% (3.7467 => 4.0157, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.65% (0.1819 => 0.1940, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.63% (0.3245 => 0.3460, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 6.60% (1.2292 => 1.3103, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.51% (13.2842 => 14.1492, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/parameter-passing: 6.27% (0.4003 => 0.4254, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.26% (6.2785 => 6.6715, std.dev.: 0.0101) SingleSource/UnitTests/ObjC/exceptions: 6.21% (0.3914 => 0.4157, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 5.99% (0.3940 => 0.4176, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 5.87% (0.3578 => 0.3788, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 5.86% (0.3789 => 0.4011, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 5.76% (0.3646 => 0.3856, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 5.71% (0.3663 => 0.3872, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 5.64% (0.3601 => 0.3804, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.59% (0.3650 => 0.3854, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 5.52% (0.3623 => 0.3823, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.17% (0.2243 => 0.2359, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 4.89% (16.2614 => 17.0567, std.dev.: 0.0056) MultiSource/Applications/ClamAV/clamscan: 4.45% (14.5298 => 15.1769, std.dev.: 0.0124) MultiSource/Benchmarks/Bullet/bullet: 1.66% (33.2944 => 33.8461, std.dev.: 0.0078) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5135, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/fbench: 26.55% (1.8175 => 2.3001, std.dev.: 0.0336) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 11.13% (1.1560 => 1.2847, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 9.04% (0.8273 => 0.9021, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.70% (0.1322 => 0.1437, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4142, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 5.96% (1.2998 => 1.3773, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0048, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (1.7081 => 1.7749, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6765, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-6: 3.58% (1.9199 => 1.9887, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.45% (10.7476 => 11.1185, std.dev.: 0.0502) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.10% (7.4271 => 7.5832, std.dev.: 0.0079) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4540, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0507, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5153, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/queens: 1.43% (2.1753 => 2.2064, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2123, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1872, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 1.17% (5.5130 => 5.5776, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 1.14% (12.4560 => 12.5974, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0267, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.78% (0.2670 => 0.1421, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.92% (0.4657 => 0.3869, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -14.43% (0.0707 => 0.0605, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.30% (1.3819 => 1.1981, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.18% (1.3813 => 1.1993, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.63% (22.5627 => 22.1939, std.dev.: 0.0117) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.74% (0.0997 => 0.0860, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -12.06% (0.2238 => 0.1968, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.90% (1.2308 => 1.0966, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.98% (20.3410 => 18.3118, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.02% (1.3780 => 1.3088, std.dev.: 0.0045) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.58% (0.9996 => 0.9538, std.dev.: 0.0132) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.58% (3.2729 => 3.1558, std.dev.: 0.0183) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.46% (1.7688 => 1.7076, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.02% (0.4867 => 0.4720, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.57% (26.5159 => 25.8341, std.dev.: 0.0264) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.44% (3.0263 => 2.9524, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: -2.41% (1.9762 => 1.9286, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.00% (0.6589 => 0.6457, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7153, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/lists: -1.79% (6.3560 => 6.2424, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/heapsort: -1.46% (3.9173 => 3.8602, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0066, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -1.40% (4.5928 => 4.5287, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4956, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.13% (9.3358 => 9.2305, std.dev.: 0.0231) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2571, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 9 17:36:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 9 Oct 2012 19:36:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121010003641.8A81E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4745?compare_to=4744&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4745, Order: 165558, Start Time: 2012-10-09 23:23:47, End Time: 2012-10-10 00:38:29 To: 4744, Order: 165548, Start Time: 2012-10-09 21:39:48, End Time: 2012-10-09 22:54:38 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (186 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1041 (751 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.37% (54.7509 => 56.5954, std.dev.: 0.0297) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.17% (2.0176 => 2.5052, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.23% (0.1410 => 0.1667, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 17.68% (0.0826 => 0.0972, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.08% (0.0653 => 0.0758, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 16.05% (0.2243 => 0.2603, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.99% (0.1072 => 0.1222, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 13.62% (0.1013 => 0.1151, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.19% (0.0834 => 0.0944, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.09% (0.1413 => 0.1598, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 12.89% (0.7038 => 0.7945, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.66% (0.1327 => 0.1495, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 12.62% (0.1062 => 0.1196, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.52% (3.9660 => 4.4625, std.dev.: 0.0078) MultiSource/Applications/hbd/hbd: 12.50% (1.3693 => 1.5405, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.50% (0.2721 => 0.3061, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.41% (0.1588 => 0.1785, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.19% (0.1157 => 0.1298, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.14% (0.0964 => 0.1081, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.91% (0.9199 => 1.0295, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.86% (0.6959 => 0.7784, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 11.83% (0.4328 => 0.4840, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.82% (1.4563 => 1.6285, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.75% (0.2596 => 0.2901, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 11.70% (0.7061 => 0.7887, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.66% (0.7710 => 0.8609, std.dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 11.64% (13.8202 => 15.4294, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.64% (0.5265 => 0.5878, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 11.60% (0.5818 => 0.6493, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.58% (1.2193 => 1.3605, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.44% (0.6283 => 0.7002, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.39% (1.1364 => 1.2658, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 11.34% (0.5748 => 0.6400, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 11.15% (0.4062 => 0.4515, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.13% (0.3899 => 0.4333, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.02% (0.3130 => 0.3475, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 10.97% (0.1003 => 0.1113, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 10.75% (1.0313 => 1.1422, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 10.74% (1.1061 => 1.2249, std.dev.: 0.0036) SingleSource/Regression/C++/ofstream_ctor: 10.64% (0.2781 => 0.3077, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.59% (0.3485 => 0.3854, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.53% (0.4016 => 0.4439, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.50% (0.1048 => 0.1158, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.49% (0.3489 => 0.3855, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.44% (0.5577 => 0.6159, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.36% (0.3580 => 0.3951, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 10.35% (16.6129 => 18.3322, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.32% (0.2782 => 0.3069, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.31% (0.4791 => 0.5285, std.dev.: 0.0043) MultiSource/Applications/sgefa/sgefa: 10.22% (0.2995 => 0.3301, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.18% (0.4390 => 0.4837, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.14% (0.3756 => 0.4137, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.11% (0.2966 => 0.3266, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/lists: 10.11% (0.3293 => 0.3626, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.09% (0.3022 => 0.3327, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.07% (0.3246 => 0.3573, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 10.01% (0.1589 => 0.1748, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.98% (0.4379 => 0.4816, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.95% (0.1276 => 0.1403, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.95% (0.2914 => 0.3204, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.87% (0.2655 => 0.2917, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 9.86% (0.6744 => 0.7409, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 9.78% (0.2760 => 0.3030, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 9.77% (0.3868 => 0.4246, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.77% (0.1075 => 0.1180, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 9.74% (0.2607 => 0.2861, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 9.74% (0.8310 => 0.9119, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.73% (0.2127 => 0.2334, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 9.73% (0.3453 => 0.3789, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.72% (1.9828 => 2.1755, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 9.71% (3.8646 => 4.2397, std.dev.: 0.0118) MultiSource/Applications/d/make_dparser: 9.69% (3.1889 => 3.4978, std.dev.: 0.0061) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.69% (0.1435 => 0.1574, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 9.65% (2.1791 => 2.3893, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.63% (0.5637 => 0.6180, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 9.63% (1.9270 => 2.1126, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 9.63% (0.1111 => 0.1218, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 9.63% (0.2690 => 0.2949, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 9.63% (0.3220 => 0.3530, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.62% (0.7460 => 0.8178, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 9.61% (0.2726 => 0.2988, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.57% (0.8698 => 0.9530, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.55% (0.2765 => 0.3029, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 9.53% (0.2937 => 0.3217, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 9.53% (0.2761 => 0.3024, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 9.51% (0.2628 => 0.2878, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.49% (0.2023 => 0.2215, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists1: 9.45% (0.3534 => 0.3868, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 9.43% (1.0594 => 1.1593, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 9.37% (0.3149 => 0.3444, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 9.37% (0.3107 => 0.3398, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 9.34% (0.3192 => 0.3490, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.32% (0.1986 => 0.2171, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 9.31% (0.7506 => 0.8205, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.28% (0.1865 => 0.2038, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.27% (0.2696 => 0.2946, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 9.27% (0.2988 => 0.3265, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 9.26% (0.2925 => 0.3196, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.25% (0.6576 => 0.7184, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.17% (7.2180 => 7.8800, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.92% (0.1569 => 0.1709, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 8.86% (0.1478 => 0.1609, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.79% (1.3245 => 1.4409, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.72% (4.9865 => 5.4214, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: 8.72% (0.3131 => 0.3404, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 8.71% (1.2749 => 1.3860, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.68% (0.3755 => 0.4081, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.67% (3.6692 => 3.9874, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/objinst: 8.66% (0.2945 => 0.3200, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 8.64% (14.8535 => 16.1369, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/em3d/em3d: 8.63% (0.1657 => 0.1800, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.44% (0.8818 => 0.9562, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.41% (0.2140 => 0.2320, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.40% (0.3511 => 0.3806, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.32% (4.3801 => 4.7445, std.dev.: 0.0088) MultiSource/Benchmarks/mafft/pairlocalalign: 8.32% (8.4961 => 9.2026, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.31% (4.4433 => 4.8126, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.15% (0.6135 => 0.6635, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 8.14% (4.6629 => 5.0425, std.dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.94% (0.1789 => 0.1931, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.88% (1.5188 => 1.6385, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.82% (0.9108 => 0.9820, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.76% (1.1333 => 1.2213, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.67% (0.2321 => 0.2499, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.65% (3.2742 => 3.5247, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/05-eks/eks: 7.59% (0.4113 => 0.4425, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 7.58% (6.5754 => 7.0740, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/bigfib: 7.55% (0.6250 => 0.6722, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.41% (0.4805 => 0.5161, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 7.36% (0.1385 => 0.1487, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 7.32% (0.2008 => 0.2155, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.24% (0.4003 => 0.4293, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 7.20% (3.7467 => 4.0163, std.dev.: 0.0091) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.11% (0.2504 => 0.2682, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.00% (0.3914 => 0.4188, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 6.99% (1.2292 => 1.3151, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 6.98% (0.3940 => 0.4215, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.97% (2.1007 => 2.2472, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-4: 6.94% (0.3646 => 0.3899, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.93% (0.3245 => 0.3470, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 6.93% (0.3578 => 0.3826, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.89% (0.3789 => 0.4050, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.87% (0.1819 => 0.1944, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.83% (0.3601 => 0.3847, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 6.66% (0.3663 => 0.3907, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.63% (0.3650 => 0.3892, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 6.62% (0.3623 => 0.3863, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.50% (13.2842 => 14.1472, std.dev.: 0.0175) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.25% (6.2785 => 6.6708, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.35% (0.2243 => 0.2363, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 4.72% (16.2614 => 17.0293, std.dev.: 0.0213) MultiSource/Applications/ClamAV/clamscan: 4.28% (14.5298 => 15.1521, std.dev.: 0.0176) MultiSource/Benchmarks/Bullet/bullet: 1.78% (33.2944 => 33.8859, std.dev.: 0.0136) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5147, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.24% (1.8175 => 2.2580, std.dev.: 0.0380) SingleSource/Benchmarks/Misc/richards_benchmark: 11.12% (1.1560 => 1.2846, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4137, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.27% (1.2998 => 1.3813, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.49% (0.3139 => 0.3280, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (1.7081 => 1.7749, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6758, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9861, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 3.20% (10.7476 => 11.0918, std.dev.: 0.0420) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.24% (7.4271 => 7.5937, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4536, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5127, std.dev.: 0.0066) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2068, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2122, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1871, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5778, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0271, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 1.01% (12.4560 => 12.5822, std.dev.: 0.0062) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.59% (0.2670 => 0.1426, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.13% (0.4657 => 0.3906, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -14.57% (0.0707 => 0.0604, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.27% (1.3819 => 1.1985, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.18% (1.3813 => 1.1993, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.80% (22.5627 => 22.1570, std.dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.34% (0.0997 => 0.0864, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -12.02% (0.2238 => 0.1969, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.20% (1.2308 => 1.0930, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.00% (20.3410 => 18.3074, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.79% (1.3780 => 1.2982, std.dev.: 0.0147) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5137, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.70% (0.9996 => 0.9526, std.dev.: 0.0129) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8001, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.45% (1.7688 => 1.7077, std.dev.: 0.0057) MultiSource/Applications/siod/siod: -3.13% (3.2729 => 3.1706, std.dev.: 0.0182) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.94% (0.4867 => 0.4724, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -2.58% (26.5159 => 25.8320, std.dev.: 0.0174) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.45% (3.0263 => 2.9522, std.dev.: 0.0017) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.33% (1.9762 => 1.9301, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.90% (0.6589 => 0.6464, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.82% (6.3560 => 6.2402, std.dev.: 0.0083) MultiSource/Benchmarks/mafft/pairlocalalign: -1.79% (28.2225 => 27.7177, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0078, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -1.40% (4.5928 => 4.5283, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8677, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4953, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2583, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 9 18:14:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 9 Oct 2012 20:14:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121010011452.1B7B52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4746?compare_to=4742&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4746, Order: 165560, Start Time: 2012-10-09 23:57:02, End Time: 2012-10-10 01:16:39 To: 4742, Order: 165532, Start Time: 2012-10-09 20:10:41, End Time: 2012-10-09 21:30:12 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (159 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1024 (757 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 10.26% (0.4309 => 0.4751, std.dev.: 0.0154) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.03% (0.5937 => 0.5939, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: -0.11% (16.3906 => 16.3718, std.dev.: 0.0063) MultiSource/Benchmarks/Bullet/bullet: 0.36% (55.1016 => 55.3016, std.dev.: 0.0223) MultiSource/Benchmarks/MallocBench/gs/gs: -0.19% (4.4219 => 4.4137, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.14% (1.2583 => 1.2565, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.24% (7.8340 => 7.8526, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.15% (0.7405 => 0.7394, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.28% (0.0363 => 0.0362, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: - (0.1431 => 0.1431, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.27% (0.0661 => 0.0646, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -12.56% (63.2438 => 55.3016, std.dev.: 0.0223) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 33.32% (14.1553 => 18.8713, std.dev.: 0.0131) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.75% (3.4629 => 5.6705, std.dev.: 0.0207) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14221.94% (0.0720 => 10.3118, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952000.00% (0.0001 => 9.9521, std.dev.: 0.0012) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 62.37% (0.2554 => 0.4147, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 48.45% (10.3673 => 15.3905, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/richards_benchmark: 38.78% (0.1622 => 0.2251, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 32.95% (0.1056 => 0.1404, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.71% (2.2022 => 2.5921, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.53% (7.0540 => 8.2903, std.dev.: 0.0146) SingleSource/Benchmarks/Misc/flops: 17.39% (0.1432 => 0.1681, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.81% (0.1566 => 0.1798, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.74% (0.0871 => 0.0982, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 12.71% (0.3282 => 0.3699, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.54% (1.7609 => 1.9818, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.74% (0.1584 => 0.1770, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 11.58% (10.4361 => 11.6451, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.40% (0.1438 => 0.1602) MultiSource/Benchmarks/Olden/power/power: 11.25% (0.1440 => 0.1602, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 10.44% (0.7115 => 0.7858, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.35% (0.4879 => 0.5384, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 10.13% (0.7433 => 0.8186, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 10.05% (9.4845 => 10.4375, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.85% (0.1625 => 0.1785, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.83% (0.6675 => 0.7331, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.82% (0.3177 => 0.3489, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/chomp: 9.79% (0.1655 => 0.1817, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.78% (0.2700 => 0.2964, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 9.70% (0.1175 => 0.1289, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 9.61% (3.3354 => 3.6559, std.dev.: 0.0184) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.59% (1.5415 => 1.6893, std.dev.: 0.0042) MultiSource/Applications/sgefa/sgefa: 9.49% (0.3109 => 0.3404, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.48% (0.3543 => 0.3879, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 9.29% (0.3423 => 0.3741, std.dev.: 0.0034) MultiSource/Applications/oggenc/oggenc: 9.25% (5.7591 => 6.2919, std.dev.: 0.0118) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.10% (0.4615 => 0.5035, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.07% (0.5105 => 0.5568, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 9.01% (0.3473 => 0.3786, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.96% (0.3927 => 0.4279, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.94% (0.5860 => 0.6384, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 8.91% (0.1695 => 0.1846, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.89% (1.3050 => 1.4210, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.85% (0.5569 => 0.6062, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.84% (4.2646 => 4.6416, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-2: 8.78% (0.3497 => 0.3804, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.76% (0.2271 => 0.2470, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 8.76% (0.3561 => 0.3873, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.75% (0.3543 => 0.3853, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.73% (0.3516 => 0.3823, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.73% (0.3828 => 0.4162, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.66% (0.8172 => 0.8880, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.61% (0.1510 => 0.1640, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.57% (0.3886 => 0.4219, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 8.56% (0.3387 => 0.3677, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.55% (0.3694 => 0.4010, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 8.51% (1.1642 => 1.2633, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.49% (5.0018 => 5.4264, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.47% (0.8067 => 0.8750, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.45% (4.9449 => 5.3629, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.45% (0.2107 => 0.2285, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 8.39% (3.8723 => 4.1972, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.36% (8.1363 => 8.8169, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.33% (0.1236 => 0.1339, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.27% (0.9765 => 1.0573, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.17% (0.3121 => 0.3376, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.17% (0.5020 => 0.5430, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.12% (0.2758 => 0.2982, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.04% (0.1940 => 0.2096, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 8.04% (1.0722 => 1.1584, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.95% (0.3307 => 0.3570, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 7.95% (0.6456 => 0.6969, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 7.89% (0.7835 => 0.8453, std.dev.: 0.0054) MultiSource/Applications/hbd/hbd: 7.86% (1.5603 => 1.6829, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.80% (1.5859 => 1.7096, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.80% (0.2065 => 0.2226, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.78% (0.1337 => 0.1441, std.dev.: 0.0024) MultiSource/Applications/treecc/treecc: 7.73% (2.0273 => 2.1841, std.dev.: 0.0099) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.72% (7.9617 => 8.5765, std.dev.: 0.0049) MultiSource/Applications/viterbi/viterbi: 7.72% (0.1555 => 0.1675, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.46% (0.5925 => 0.6367, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 7.40% (21.9371 => 23.5605, std.dev.: 0.0271) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.38% (0.3441 => 0.3695, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 7.30% (2.2969 => 2.4645, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 7.28% (0.6030 => 0.6469, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.27% (1.1861 => 1.2723, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/09-vor/vor: 7.23% (0.3180 => 0.3410, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.11% (0.2603 => 0.2788, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 6.97% (0.1463 => 0.1565, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.97% (0.4103 => 0.4389, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.96% (0.6450 => 0.6899, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference: 6.92% (0.7326 => 0.7833, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.90% (2.2024 => 2.3543, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 6.87% (0.8921 => 0.9534, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 6.84% (0.4299 => 0.4593, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.77% (0.4636 => 0.4950, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.76% (0.4289 => 0.4579, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.76% (0.4203 => 0.4487, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.75% (0.4620 => 0.4932, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.75% (0.3865 => 0.4126, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 6.63% (0.3422 => 0.3649, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.54% (0.5981 => 0.6372, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 6.39% (1.1840 => 1.2596, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.37% (0.1695 => 0.1803, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.33% (0.3650 => 0.3881, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.33% (0.3826 => 0.4068, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.26% (1.4186 => 1.5074, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 6.23% (0.4048 => 0.4300, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 6.20% (0.2905 => 0.3085, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.08% (0.1892 => 0.2007, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.99% (0.3136 => 0.3324, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: 5.94% (0.3603 => 0.3817, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 5.92% (0.3684 => 0.3902, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.82% (0.1906 => 0.2017, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 5.75% (0.2871 => 0.3036, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.72% (0.3162 => 0.3343, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.67% (0.2891 => 0.3055, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.65% (0.2266 => 0.2394, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.61% (2.0665 => 2.1825, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/matrix: 5.58% (0.3098 => 0.3271, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.55% (0.2831 => 0.2988, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.35% (0.2877 => 0.3031, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 5.35% (0.3232 => 0.3405, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.31% (0.8101 => 0.8531, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.29% (0.2872 => 0.3024, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.27% (0.3283 => 0.3456, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.22% (0.2756 => 0.2900, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.14% (0.3052 => 0.3209, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.14% (0.2725 => 0.2865, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 5.08% (0.2049 => 0.2153, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.01% (0.2793 => 0.2933, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.01% (0.2714 => 0.2850, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 5.00% (0.2802 => 0.2942, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.88% (0.3379 => 0.3544, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.82% (0.4064 => 0.4260, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.71% (14.3668 => 15.0439, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: 4.54% (17.1811 => 17.9617, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.44% (0.3427 => 0.3579, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.18% (0.3131 => 0.3262, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 4.06% (1.2842 => 1.3363, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.03% (3.8922 => 4.0492, std.dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.50% (1.1194 => 1.1474, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.74% (1.1396 => 1.2506, std.dev.: 0.0015) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4498, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3682, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.4162 => 0.4322, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.62% (3.6395 => 3.7714, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.89% (4.2280 => 4.3502, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8131, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.33% (0.9540 => 0.9667, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.16% (6.5088 => 6.5843, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.02% (2.6546 => 2.6816, std.dev.: 0.0052) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.05% (6.6874 => 0.1301, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.25% (5.2763 => 3.2579, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.60% (5.3855 => 3.6835, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.24% (5.3526 => 3.6806, std.dev.: 0.0019) SingleSource/UnitTests/Vector/constpool: -14.70% (54.1659 => 46.2013, std.dev.: 0.0323) MultiSource/Benchmarks/FreeBench/mason/mason: -12.58% (0.0811 => 0.0709, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.76% (2.9384 => 2.6223, std.dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: -10.70% (22.1758 => 19.8023, std.dev.: 0.0159) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.36% (1.1492 => 0.7658, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.77% (1.6925 => 1.4256, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.73% (0.0998 => 0.0861, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -11.86% (1.2373 => 1.0906, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/mandel-2: -10.25% (1.5373 => 1.3797, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -10.13% (0.2161 => 0.1942, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.41% (19.9488 => 18.2718, std.dev.: 0.0140) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.64% (1.8329 => 1.7112, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.29% (1.6805 => 1.5916, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -5.01% (1.5835 => 1.5042, std.dev.: 0.0059) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7963, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.58% (3.2827 => 3.1651, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4952, std.dev.: 0.0089) MultiSource/Applications/hexxagon/hexxagon: -3.01% (12.4730 => 12.0980, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.67% (0.9957 => 0.9691, std.dev.: 0.0061) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.04% (8.1563 => 7.9903, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.89% (8.6802 => 8.5162, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -1.86% (10.2830 => 10.0914, std.dev.: 0.0139) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6829, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -1.54% (2.5528 => 2.5135, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4219, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: -1.18% (4.6441 => 4.5895, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8579, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2350, std.dev.: 0.0050) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.58% (0.5229 => 0.5939, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 9.22% (14.9895 => 16.3718, std.dev.: 0.0063) MultiSource/Benchmarks/MallocBench/gs/gs: 7.38% (4.1105 => 4.4137, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.73% (1.1048 => 1.2565, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.70% (7.1582 => 7.8526, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.84% (0.6222 => 0.7394, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36100.00% (0.0001 => 0.0362, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.47% (0.2116 => 0.0646, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 9 18:37:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 9 Oct 2012 20:37:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121010013714.661952A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4747?compare_to=4743&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4747, Order: 165551, Start Time: 2012-10-09 22:55:04, End Time: 2012-10-10 01:39:02 To: 4743, Order: 165530, Start Time: 2012-10-09 19:41:41, End Time: 2012-10-09 22:25:34 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (135 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 1038 (828 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 5.48% (0.4035 => 0.4256, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.73% (124.8380 => 129.4975, std.dev.: 0.6094) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.50% (2.0914 => 2.1227, std.dev.: 0.0061) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -1.48% (1.0425 => 1.0271, std.dev.: 0.0011) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.38% (0.1063 => 0.1184, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 11.10% (1.5932 => 1.7701, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-4: 10.88% (0.3465 => 0.3842, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.87% (0.3488 => 0.3867, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 10.84% (0.3496 => 0.3875, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.84% (0.3460 => 0.3835, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.84% (0.3442 => 0.3815, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.82% (0.3446 => 0.3819, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.77% (0.3650 => 0.4043, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/synchronized: 10.72% (0.3469 => 0.3841, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.51% (0.3643 => 0.4026, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.39% (0.3724 => 0.4111, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.84% (0.5826 => 0.6341) MultiSource/Benchmarks/McCat/08-main/main: 8.78% (0.1218 => 0.1325, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference-object: 8.78% (0.5889 => 0.6406, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 8.40% (0.1619 => 0.1755, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.13% (0.4994 => 0.5400, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.10% (1.3152 => 1.4217, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.94% (0.1549 => 0.1672, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.86% (1.6211 => 1.7485, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.82% (0.4361 => 0.4702, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.71% (0.2738 => 0.2949, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.54% (0.5000 => 0.5377, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.53% (0.1620 => 0.1742, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.48% (0.2875 => 0.3090, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 7.46% (5.5417 => 5.9549, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.44% (3.5627 => 3.8276, std.dev.: 0.0059) SingleSource/Regression/C++/ofstream_ctor: 7.42% (0.3004 => 0.3227, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 7.36% (0.7171 => 0.7699, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.35% (0.2014 => 0.2162, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: 7.31% (0.2750 => 0.2951, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 7.28% (0.4847 => 0.5200, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.20% (0.3845 => 0.4122, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.20% (0.5026 => 0.5388, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.19% (0.5900 => 0.6324, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/fibo: 7.12% (0.2725 => 0.2919, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.12% (0.2866 => 0.3070, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.10% (0.3195 => 0.3422, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 7.10% (1.0781 => 1.1546, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.09% (0.2792 => 0.2990, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 7.08% (0.9909 => 1.0611, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hello: 7.07% (0.2714 => 0.2906, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/random: 7.06% (0.2803 => 0.3001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 7.05% (0.2780 => 0.2976, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.98% (0.3267 => 0.3495, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.97% (0.3930 => 0.4204, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.96% (0.2729 => 0.2919, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.94% (0.2736 => 0.2926, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 6.94% (0.2566 => 0.2744, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.89% (0.4139 => 0.4424, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.88% (2.7292 => 2.9171, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.88% (2.0673 => 2.2095, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/ary: 6.88% (0.3258 => 0.3482, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.87% (0.2811 => 0.3004, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 6.86% (4.2109 => 4.4996, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/objinst: 6.84% (0.2823 => 0.3016, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.79% (0.3625 => 0.3871, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 6.78% (0.3348 => 0.3575, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 6.75% (0.2813 => 0.3003, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.72% (0.3096 => 0.3304, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.70% (0.2911 => 0.3106, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.69% (0.3362 => 0.3587, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 6.64% (0.1505 => 0.1605, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.64% (4.4195 => 4.7131, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.63% (0.3060 => 0.3263, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.63% (0.3726 => 0.3973, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.56% (0.3890 => 0.4145, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.55% (0.3282 => 0.3497, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.51% (0.3317 => 0.3533, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 6.51% (0.5546 => 0.5907, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.51% (0.3903 => 0.4157, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.50% (0.1968 => 0.2096, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 6.50% (0.3678 => 0.3917, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 6.42% (0.6634 => 0.7060, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists1: 6.41% (0.3477 => 0.3700, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 6.40% (1.8794 => 1.9997, std.dev.: 0.0037) MultiSource/Benchmarks/Bullet/bullet: 6.31% (23.5202 => 25.0038, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.31% (0.3124 => 0.3321, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.30% (0.4146 => 0.4407, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 6.28% (1.4269 => 1.5165, std.dev.: 0.0059) MultiSource/Applications/spiff/spiff: 6.25% (0.4029 => 0.4281, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.24% (0.2068 => 0.2197, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.23% (0.3690 => 0.3920, std.dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 6.21% (2.1013 => 2.2317, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.13% (0.2969 => 0.3151, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.10% (0.3981 => 0.4224, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.08% (0.2040 => 0.2164, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.07% (0.4251 => 0.4509, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.05% (0.4658 => 0.4940, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.02% (0.3271 => 0.3468, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 6.02% (4.6177 => 4.8956, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.99% (0.2737 => 0.2901, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 5.99% (2.1653 => 2.2949, std.dev.: 0.0022) MultiSource/Applications/hbd/hbd: 5.92% (0.9697 => 1.0271, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.86% (0.6435 => 0.6812, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.84% (0.3084 => 0.3264, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 5.83% (0.5012 => 0.5304, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 5.74% (0.7875 => 0.8327, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 5.58% (0.3336 => 0.3522, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.55% (1.9694 => 2.0788, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.52% (1.9966 => 2.1068, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.52% (0.2103 => 0.2219, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 5.50% (2.0346 => 2.1466, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/football/football: 5.35% (0.2075 => 0.2186, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.33% (0.7426 => 0.7822, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.26% (0.5361 => 0.5643, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 5.06% (0.2391 => 0.2512, std.dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 4.98% (0.2691 => 0.2825, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.44% (0.5584 => 0.5832, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.28% (11.6398 => 12.1378, std.dev.: 0.0145) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.22% (4.6926 => 4.8904, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.04% (0.4253 => 0.4425, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 4.03% (0.3498 => 0.3639, std.dev.: 0.0025) MultiSource/Applications/kimwitu++/kc: 2.61% (11.9555 => 12.2673, std.dev.: 0.0179) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6109, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6756, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-2: 4.80% (1.8057 => 1.8924, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1667, std.dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/dry: 4.26% (14.0481 => 14.6463, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1957, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.95% (2.0820 => 2.1227, std.dev.: 0.0061) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5031, std.dev.: 0.0031) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.82% (3.1722 => 3.2300, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2861, std.dev.: 0.0064) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5390, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5789, std.dev.: 0.0196) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.90% (25.4195 => 16.5473, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/ary2: -8.03% (0.2402 => 0.2209, std.dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9772, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8026, std.dev.: 0.0074) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.58% (11.2080 => 10.8067, std.dev.: 0.0111) SingleSource/Benchmarks/Dhrystone/fldry: -3.07% (17.2379 => 16.7080, std.dev.: 0.0864) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7730, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5186, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.24% (0.6293 => 0.6152, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8606, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5805, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4955, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.15% (105.3826 => 104.1690, std.dev.: 0.0575) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0453, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 9 19:20:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 9 Oct 2012 21:20:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121010022040.DD3DB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4748?compare_to=4745&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4748, Order: 165574, Start Time: 2012-10-10 01:07:44, End Time: 2012-10-10 02:22:28 To: 4745, Order: 165558, Start Time: 2012-10-09 23:23:47, End Time: 2012-10-10 00:38:29 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (188 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1041 (748 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.17% (7.9631 => 8.0563, std.dev.: 0.0120) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.60% (2.0176 => 2.5140, std.dev.: 0.0047) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.72% (0.1410 => 0.1674, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 18.04% (0.0826 => 0.0975, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 16.14% (0.2243 => 0.2605, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 15.77% (0.0653 => 0.0756, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.91% (0.0834 => 0.0950, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 13.82% (0.1013 => 0.1153, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.45% (0.1413 => 0.1603, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 13.16% (0.7038 => 0.7964, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 13.16% (0.2721 => 0.3079, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.15% (0.1072 => 0.1213, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.04% (0.1327 => 0.1500, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.04% (0.1588 => 0.1795, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.91% (3.9660 => 4.4780, std.dev.: 0.0075) MultiSource/Applications/hbd/hbd: 12.46% (1.3693 => 1.5399, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.45% (0.0964 => 0.1084, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.42% (1.4563 => 1.6372, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.25% (0.2596 => 0.2914, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.18% (0.9199 => 1.0319, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.07% (1.2193 => 1.3665, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 12.00% (13.8202 => 15.4787, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash2: 11.90% (0.4328 => 0.4843, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.89% (0.6283 => 0.7030, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.86% (0.6959 => 0.7784, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.85% (0.5265 => 0.5889, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.78% (1.1364 => 1.2703, std.dev.: 0.0029) MultiSource/Applications/aha/aha: 11.68% (0.1062 => 0.1186, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.43% (0.7710 => 0.8591, std.dev.: 0.0039) MultiSource/Applications/lemon/lemon: 11.41% (1.0313 => 1.1490, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.31% (0.3130 => 0.3484, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 11.27% (0.1003 => 0.1116, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 11.23% (0.4062 => 0.4518, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 11.14% (0.5818 => 0.6466, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 11.03% (0.7061 => 0.7840, std.dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: 10.85% (0.2995 => 0.3320, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.85% (0.3899 => 0.4322, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.80% (0.1157 => 0.1282, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 10.80% (1.1061 => 1.2256, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.79% (0.4791 => 0.5308, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.78% (0.1048 => 0.1161, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.75% (0.5748 => 0.6366, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.65% (0.5577 => 0.6171, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 10.57% (0.1589 => 0.1757, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.54% (0.3246 => 0.3588, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.53% (0.4016 => 0.4439, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.53% (0.3485 => 0.3852, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 10.49% (16.6129 => 18.3551, std.dev.: 0.0104) MultiSource/Benchmarks/Olden/mst/mst: 10.44% (0.1111 => 0.1227, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 10.43% (0.2781 => 0.3071, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 10.37% (0.8310 => 0.9172, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 10.35% (0.6744 => 0.7442, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.34% (0.4379 => 0.4832, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 10.31% (0.3220 => 0.3552, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/lists: 10.14% (0.3293 => 0.3627, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.14% (0.1075 => 0.1184, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.12% (0.3489 => 0.3842, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.11% (0.3580 => 0.3942, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 10.08% (1.9270 => 2.1212, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.04% (0.3756 => 0.4133, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.03% (0.1435 => 0.1579, std.dev.: 0.0043) MultiSource/Applications/siod/siod: 10.02% (2.1791 => 2.3975, std.dev.: 0.0174) MultiSource/Applications/d/make_dparser: 10.02% (3.1889 => 3.5085, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.01% (0.2127 => 0.2340, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.99% (0.2782 => 0.3060, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.96% (0.3022 => 0.3323, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.95% (0.2914 => 0.3204, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.90% (0.8698 => 0.9559, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.88% (0.5637 => 0.6194, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 9.87% (3.8646 => 4.2462, std.dev.: 0.0055) MultiSource/Benchmarks/nbench/nbench: 9.87% (1.0594 => 1.1640, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.79% (0.7460 => 0.8190, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 9.75% (0.3868 => 0.4245, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.71% (0.2966 => 0.3254, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.70% (0.4390 => 0.4816, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 9.69% (0.7506 => 0.8233, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.63% (0.6576 => 0.7209, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.61% (7.2180 => 7.9119, std.dev.: 0.0081) MultiSource/Benchmarks/McCat/09-vor/vor: 9.61% (0.2925 => 0.3206, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 9.60% (0.2760 => 0.3025, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 9.59% (0.2607 => 0.2857, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 9.59% (0.3453 => 0.3784, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.56% (0.1276 => 0.1398, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.54% (0.2023 => 0.2216, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.53% (0.2655 => 0.2908, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.51% (1.9828 => 2.1713, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.49% (0.2140 => 0.2343, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 9.46% (0.2726 => 0.2984, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 9.45% (0.3534 => 0.3868, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 9.44% (0.2690 => 0.2944) SingleSource/Benchmarks/Shootout-C++/methcall: 9.42% (0.2761 => 0.3021, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.42% (0.1986 => 0.2173, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.40% (0.2765 => 0.3025, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.33% (0.1865 => 0.2039, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 9.30% (0.2937 => 0.3210, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 9.29% (0.3131 => 0.3422, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 9.27% (0.1478 => 0.1615, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 9.26% (1.2749 => 1.3929, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/fibo: 9.25% (0.2628 => 0.2871, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.24% (0.1569 => 0.1714, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 9.21% (0.3149 => 0.3439, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 9.20% (14.8535 => 16.2207, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.19% (0.8818 => 0.9628, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary: 9.17% (0.3107 => 0.3392, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.15% (3.6692 => 4.0051, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.15% (1.3245 => 1.4457, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.15% (4.9865 => 5.4426, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.14% (0.3511 => 0.3832, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 9.12% (0.3192 => 0.3483, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.09% (0.2696 => 0.2941, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 9.07% (0.2988 => 0.3259, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 8.84% (8.4961 => 9.2470, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/em3d/em3d: 8.75% (0.1657 => 0.1802, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.70% (4.4433 => 4.8297, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.68% (4.3801 => 4.7603, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.58% (0.3755 => 0.4077, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.54% (0.6135 => 0.6659, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 8.52% (0.2945 => 0.3196, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 8.49% (4.6629 => 5.0586, std.dev.: 0.0165) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.48% (1.5188 => 1.6476, std.dev.: 0.0177) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.37% (0.9108 => 0.9870, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.33% (0.1789 => 0.1938, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.32% (3.2742 => 3.5466, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: 8.24% (0.4113 => 0.4452, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.12% (1.1333 => 1.2253, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: 7.94% (0.1385 => 0.1495, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 7.94% (6.5754 => 7.0973, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/oourafft: 7.87% (0.2008 => 0.2166, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.83% (0.2504 => 0.2700, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.80% (0.4805 => 0.5180, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.76% (0.2321 => 0.2501, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 7.68% (0.6250 => 0.6730, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.55% (2.1007 => 2.2594, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 7.50% (3.7467 => 4.0276, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.12% (0.3245 => 0.3476, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 7.07% (1.2292 => 1.3161, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.88% (13.2842 => 14.1977, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.87% (0.1819 => 0.1944, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.84% (6.2785 => 6.7081, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/parameter-passing: 6.57% (0.4003 => 0.4266, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.41% (0.3914 => 0.4165, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.32% (0.3940 => 0.4189, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.20% (0.3789 => 0.4024, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 6.19% (0.1777 => 0.1887, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 6.12% (0.3578 => 0.3797, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.12% (0.3646 => 0.3869, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 6.01% (0.3663 => 0.3883, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-2: 5.94% (0.3601 => 0.3815, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.92% (0.3650 => 0.3866, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 5.91% (0.3623 => 0.3837, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.62% (0.2243 => 0.2369, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 5.26% (16.2614 => 17.1170, std.dev.: 0.0116) MultiSource/Applications/ClamAV/clamscan: 4.75% (14.5298 => 15.2193, std.dev.: 0.0147) MultiSource/Benchmarks/Bullet/bullet: 1.69% (33.2944 => 33.8585, std.dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.63% (5.7573 => 7.5209, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.06% (1.0895 => 1.3625, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.41% (1.8175 => 2.2611, std.dev.: 0.0225) SingleSource/Benchmarks/Misc/richards_benchmark: 10.99% (1.1560 => 1.2830, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921) SingleSource/Benchmarks/Misc/ffbench: 9.02% (0.8273 => 0.9019, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4144, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.31% (1.2998 => 1.3818, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0048, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.67% (11.2619 => 11.6756, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9851, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 3.23% (10.7476 => 11.0944, std.dev.: 0.0339) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.23% (7.4271 => 7.5924, std.dev.: 0.0037) MultiSource/Applications/lemon/lemon: 1.58% (1.4298 => 1.4524, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5141, std.dev.: 0.0085) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.40% (1.9433 => 1.9705, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2126, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1877, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 1.20% (5.5130 => 5.5790, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0270, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 1.03% (12.4560 => 12.5848, std.dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.02% (8.8259 => 8.9160, std.dev.: 0.0165) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.55% (0.2670 => 0.1427, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.77% (0.4657 => 0.3876, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -14.14% (0.0707 => 0.0607, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.95% (1.3819 => 1.2029, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.92% (1.3813 => 1.2029, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.38% (22.5627 => 22.2504, std.dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.64% (0.0997 => 0.0861, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -11.97% (0.2238 => 0.1970, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.04% (1.2308 => 1.0949, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.17% (20.3410 => 18.2724, std.dev.: 0.0155) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.20% (1.9290 => 1.8094, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.15% (1.3780 => 1.2933, std.dev.: 0.0049) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.03% (0.9996 => 0.9593, std.dev.: 0.0082) MultiSource/Applications/siod/siod: -3.53% (3.2729 => 3.1573, std.dev.: 0.0303) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.45% (1.7688 => 1.7077, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.61% (26.5159 => 25.8239, std.dev.: 0.0350) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -2.51% (3.0263 => 2.9502, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: -2.37% (1.9762 => 1.9293, std.dev.: 0.0067) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.03% (0.6589 => 0.6455, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.79% (28.2225 => 27.7184, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.71% (6.3560 => 6.2476, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.59% (0.6615 => 0.6510, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0068, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -1.40% (4.5928 => 4.5283, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8639, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4949, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: -1.20% (9.3358 => 9.2236, std.dev.: 0.0407) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2576, std.dev.: 0.0019) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 9 20:03:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 9 Oct 2012 22:03:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121010030339.C85FE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4749?compare_to=4746&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4749, Order: 165581, Start Time: 2012-10-10 01:45:51, End Time: 2012-10-10 03:05:26 To: 4746, Order: 165560, Start Time: 2012-10-09 23:57:02, End Time: 2012-10-10 01:16:39 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (158 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1024 (758 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.49% (15.3905 => 15.6191, std.dev.: 0.0087) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.24% (0.5939 => 0.5925, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -0.17% (16.3718 => 16.3437, std.dev.: 0.0162) MultiSource/Benchmarks/Bullet/bullet: -0.11% (55.3016 => 55.2390, std.dev.: 0.0306) MultiSource/Benchmarks/MallocBench/gs/gs: -0.17% (4.4137 => 4.4060, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.06% (1.2565 => 1.2557, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.29% (7.8526 => 7.8295, std.dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.28% (0.7394 => 0.7373, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -1.38% (0.0362 => 0.0357, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: - (0.1431 => 0.1431, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.56% (0.0646 => 0.0669, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -12.66% (63.2438 => 55.2390, std.dev.: 0.0306) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.94% (14.1553 => 18.8184, std.dev.: 0.0217) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.04% (3.4629 => 5.6460, std.dev.: 0.0055) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14237.92% (0.0720 => 10.3233, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9951800.00% (0.0001 => 9.9519, std.dev.: 0.0011) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.12% (0.2554 => 0.4166, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 50.66% (10.3673 => 15.6191, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/richards_benchmark: 37.98% (0.1622 => 0.2238) MultiSource/Benchmarks/FreeBench/distray/distray: 33.05% (0.1056 => 0.1405, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 17.74% (0.1432 => 0.1686, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.69% (7.0540 => 8.3016, std.dev.: 0.0075) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.44% (2.2022 => 2.5862, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.94% (0.1566 => 0.1800, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.77% (1.7609 => 1.9858, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 12.52% (0.3282 => 0.3693, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.51% (0.0871 => 0.0980, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 11.29% (10.4361 => 11.6141, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/power/power: 11.25% (0.1440 => 0.1602, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.24% (0.1584 => 0.1762, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.43% (0.4879 => 0.5388, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.15% (0.1625 => 0.1790, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.10% (0.3543 => 0.3901, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 10.06% (0.7115 => 0.7831, std.dev.: 0.0054) MultiSource/Applications/lambda-0_1_3/lambda: 9.93% (0.7433 => 0.8171, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 9.93% (9.4845 => 10.4261, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.87% (0.1438 => 0.1580, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.85% (0.3177 => 0.3490, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 9.70% (0.1175 => 0.1289, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.60% (0.6675 => 0.7316, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.56% (0.2700 => 0.2958, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.47% (0.3473 => 0.3802, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.40% (0.3927 => 0.4296, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 9.37% (0.1655 => 0.1810, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.30% (1.5415 => 1.6849, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/synchronized: 9.30% (0.3561 => 0.3892, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 9.28% (3.3354 => 3.6449, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 9.27% (0.3516 => 0.3842, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.27% (0.3497 => 0.3821, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 9.26% (0.3109 => 0.3397, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 9.26% (0.3423 => 0.3740, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 9.26% (0.3543 => 0.3871, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.25% (0.3828 => 0.4182, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 9.22% (5.7591 => 6.2899, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/for-in: 9.07% (0.3694 => 0.4029, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.06% (0.3886 => 0.4238, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.06% (0.2065 => 0.2252, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.99% (0.4615 => 0.5030, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/em3d/em3d: 8.91% (0.1695 => 0.1846, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.81% (0.1510 => 0.1643, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.79% (4.2646 => 4.6393, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.78% (0.5105 => 0.5553, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.66% (1.3050 => 1.4180, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.52% (0.5860 => 0.6359, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.50% (0.2271 => 0.2464, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.42% (0.8172 => 0.8860, std.dev.: 0.0046) MultiSource/Applications/Burg/burg: 8.40% (1.1642 => 1.2620, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.35% (0.2107 => 0.2283, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.32% (4.9449 => 5.3564, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.30% (5.0018 => 5.4171, std.dev.: 0.0065) MultiSource/Benchmarks/sim/sim: 8.27% (0.3387 => 0.3667, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.24% (8.1363 => 8.8069, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.24% (0.5569 => 0.6028, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.21% (0.8067 => 0.8729, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.17% (0.1236 => 0.1337, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.09% (0.2758 => 0.2981, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.02% (0.9765 => 1.0548, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 7.99% (3.8723 => 4.1817, std.dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.98% (0.3121 => 0.3370, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.94% (0.1940 => 0.2094, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.87% (0.5020 => 0.5415, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 7.86% (0.7835 => 0.8451, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: 7.83% (1.0722 => 1.1561, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.73% (7.9617 => 8.5775, std.dev.: 0.0050) MultiSource/Applications/hbd/hbd: 7.70% (1.5603 => 1.6805, std.dev.: 0.0026) MultiSource/Applications/treecc/treecc: 7.66% (2.0273 => 2.1825, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.65% (0.3307 => 0.3560, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.61% (1.5859 => 1.7066, std.dev.: 0.0183) MultiSource/Applications/viterbi/viterbi: 7.52% (0.1555 => 0.1672, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 7.48% (0.6456 => 0.6939, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 7.31% (0.5925 => 0.6358, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.26% (0.6030 => 0.6468, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.24% (1.1861 => 1.2720, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.15% (0.3441 => 0.3687, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 7.15% (21.9371 => 23.5053, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/09-vor/vor: 7.14% (0.3180 => 0.3407, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.11% (0.2603 => 0.2788, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 7.04% (2.2969 => 2.4587, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.82% (0.4103 => 0.4383, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: 6.79% (0.8921 => 0.9527, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.73% (0.6450 => 0.6884, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: 6.70% (0.4299 => 0.4587, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.66% (0.4203 => 0.4483, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.66% (2.2024 => 2.3490, std.dev.: 0.0073) SingleSource/UnitTests/ObjC++/property-reference: 6.65% (0.7326 => 0.7813, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.57% (0.3865 => 0.4119, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.51% (0.4636 => 0.4938, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.49% (0.5981 => 0.6369, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.46% (0.4289 => 0.4566, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 6.43% (0.3422 => 0.3642, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.17% (0.4620 => 0.4905, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.16% (0.3650 => 0.3875, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.15% (1.4186 => 1.5058, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.14% (0.1695 => 0.1799, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.11% (1.1840 => 1.2564, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/moments: 6.10% (0.4048 => 0.4295, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.93% (0.3826 => 0.4053, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.87% (0.1892 => 0.2003, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 5.73% (0.3684 => 0.3895, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 5.68% (0.2905 => 0.3070, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.61% (0.3603 => 0.3805, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.60% (0.2266 => 0.2393, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.57% (0.2891 => 0.3052, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.56% (0.1906 => 0.2012, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.52% (0.3136 => 0.3309, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.50% (0.3162 => 0.3336, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.44% (2.0665 => 2.1790, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/strcat: 5.40% (0.2831 => 0.2984, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 5.29% (0.3098 => 0.3262, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 5.29% (0.3232 => 0.3403, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.20% (0.2714 => 0.2855, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 5.15% (0.3283 => 0.3452, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.14% (0.2725 => 0.2865, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 5.12% (0.2871 => 0.3018, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.08% (0.2756 => 0.2896, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 5.05% (0.3052 => 0.3206, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 4.98% (0.2049 => 0.2151, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.94% (0.2872 => 0.3014, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.94% (0.2793 => 0.2931, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.93% (0.8101 => 0.8500, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 4.93% (0.2802 => 0.2940, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 4.87% (0.2877 => 0.3017, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 4.79% (0.3379 => 0.3541, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.66% (14.3668 => 15.0358, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.50% (0.4064 => 0.4247, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.41% (0.3427 => 0.3578, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 4.20% (17.1811 => 17.9028, std.dev.: 0.0179) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.20% (0.2430 => 0.2532, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 3.90% (0.3131 => 0.3253, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.83% (3.8922 => 4.0412, std.dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 3.78% (1.2842 => 1.3328, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.82% (1.1194 => 1.1510, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.91% (1.1396 => 1.2525, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.18% (3.1595 => 3.4497, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3684, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.65% (0.3463 => 0.3624, std.dev.: 0.0013) SingleSource/Regression/C/uint64_to_float: 3.66% (0.5413 => 0.5611, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.47% (3.6395 => 3.7658, std.dev.: 0.0044) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.81% (4.2280 => 4.3466, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (0.8275 => 0.8405) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8127, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.36% (0.9540 => 0.9670, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.26% (2.6546 => 2.6880, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.12% (6.5088 => 6.5817, std.dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.05% (6.6874 => 0.1301, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -79.99% (0.8651 => 0.1731, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.20% (5.2763 => 3.2610, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.35% (5.3855 => 3.6971, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.96% (5.3526 => 3.6957, std.dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: -14.61% (54.1659 => 46.2505, std.dev.: 0.0128) MultiSource/Benchmarks/FreeBench/mason/mason: -12.58% (0.0811 => 0.0709, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -10.76% (22.1758 => 19.7902, std.dev.: 0.0158) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.41% (2.9384 => 2.6325, std.dev.: 0.0179) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -37.25% (0.0400 => 0.0251, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.47% (1.1492 => 0.7646, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: -15.97% (1.6925 => 1.4222, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.93% (0.0998 => 0.0859, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.75% (1.2373 => 1.0919, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: -10.37% (1.5373 => 1.3779, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/mason/mason: -10.09% (0.2161 => 0.1943, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.33% (19.9488 => 18.2867, std.dev.: 0.0306) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.83% (1.8329 => 1.7078, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.32% (1.6805 => 1.5911, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.83% (1.5835 => 1.5070, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.63% (3.2827 => 3.1636, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5031, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.08% (0.9957 => 0.9650, std.dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0989, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.03% (8.1563 => 7.9909, std.dev.: 0.0106) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.00% (8.6802 => 8.5069, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0846, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6822, std.dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: -1.66% (2.5528 => 2.5103, std.dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4200, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: -1.13% (4.6441 => 4.5914, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout/lists: -1.13% (6.2999 => 6.2287, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8589, std.dev.: 0.0126) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.31% (0.5229 => 0.5925, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 9.03% (14.9895 => 16.3437, std.dev.: 0.0162) MultiSource/Benchmarks/MallocBench/gs/gs: 7.19% (4.1105 => 4.4060, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.66% (1.1048 => 1.2557, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.38% (7.1582 => 7.8295, std.dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.50% (0.6222 => 0.7373, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35600.00% (0.0001 => 0.0357, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.38% (0.2116 => 0.0669, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 9 21:04:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 9 Oct 2012 23:04:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121010040419.E25D22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4750?compare_to=4748&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4750, Order: 165593, Start Time: 2012-10-10 02:51:30, End Time: 2012-10-10 04:06:05 To: 4748, Order: 165574, Start Time: 2012-10-10 01:07:44, End Time: 2012-10-10 02:22:28 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (186 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1041 (751 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.15% (78.2973 => 79.9823, std.dev.: 0.2119) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.48% (2.0176 => 2.5116, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.51% (0.1410 => 0.1671, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 17.68% (0.0826 => 0.0972, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 16.01% (0.2243 => 0.2602, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 15.77% (0.0653 => 0.0756) MultiSource/Benchmarks/Olden/tsp/tsp: 13.72% (0.1013 => 0.1152, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.71% (0.1072 => 0.1219, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.43% (0.0834 => 0.0946, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.23% (0.1413 => 0.1600, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.72% (0.2721 => 0.3067, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.69% (3.9660 => 4.4691, std.dev.: 0.0046) MultiSource/Applications/lambda-0_1_3/lambda: 12.53% (0.7038 => 0.7920, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.53% (0.1588 => 0.1787, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.51% (0.1327 => 0.1493, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 12.36% (1.3693 => 1.5386, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.24% (0.0964 => 0.1082, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.03% (1.4563 => 1.6315, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.90% (0.2596 => 0.2905, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.81% (0.9199 => 1.0285, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.79% (0.5265 => 0.5886, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference-object: 11.77% (0.5818 => 0.6503, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 11.76% (0.4328 => 0.4837, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.72% (1.2193 => 1.3622, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference: 11.70% (0.7061 => 0.7887, std.dev.: 0.0023) MultiSource/Applications/aha/aha: 11.68% (0.1062 => 0.1186, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 11.63% (13.8202 => 15.4276, std.dev.: 0.0117) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.58% (0.7710 => 0.8603, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.57% (0.6283 => 0.7010, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.51% (0.6959 => 0.7760, std.dev.: 0.0126) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.40% (1.1364 => 1.2659, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 11.36% (0.5748 => 0.6401, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hash: 11.10% (0.4062 => 0.4513, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 11.07% (0.1003 => 0.1114, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.02% (0.3130 => 0.3475, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.87% (0.3899 => 0.4323, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 10.79% (1.0313 => 1.1426, std.dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.69% (0.1048 => 0.1160, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 10.64% (0.2781 => 0.3077, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.53% (0.3485 => 0.3852, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.51% (0.4016 => 0.4438, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 10.48% (1.1061 => 1.2220, std.dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 10.42% (0.2995 => 0.3307, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.42% (0.4791 => 0.5290, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.40% (0.5577 => 0.6157, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.37% (0.1157 => 0.1277, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.33% (0.1075 => 0.1186, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.24% (0.2782 => 0.3067, std.dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 10.22% (16.6129 => 18.3103, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.17% (0.3756 => 0.4138, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.15% (0.3489 => 0.3843, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.13% (0.3022 => 0.3328, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 10.07% (0.1589 => 0.1749, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 10.05% (0.6744 => 0.7422, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.05% (0.4379 => 0.4819, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 10.02% (0.3293 => 0.3623, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.01% (0.2127 => 0.2340, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.01% (0.3246 => 0.3571, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.00% (0.3580 => 0.3938, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 9.97% (0.3220 => 0.3541, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.97% (0.1435 => 0.1578, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.88% (0.2966 => 0.3259, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 9.80% (0.8310 => 0.9124, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.79% (0.4390 => 0.4820, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.78% (0.2914 => 0.3199, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.76% (0.5637 => 0.6187, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.76% (0.2655 => 0.2914, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/sieve: 9.73% (0.3453 => 0.3789, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.72% (1.9828 => 2.1755, std.dev.: 0.0032) MultiSource/Applications/d/make_dparser: 9.70% (3.1889 => 3.4983, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.69% (0.7460 => 0.8183, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 9.68% (0.2726 => 0.2990, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 9.67% (0.7506 => 0.8232, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 9.67% (3.8646 => 4.2383, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/random: 9.67% (0.2690 => 0.2950, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 9.63% (0.1111 => 0.1218, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.62% (0.2765 => 0.3031, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 9.61% (0.2925 => 0.3206, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 9.60% (0.2760 => 0.3025, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/fibo: 9.59% (0.2628 => 0.2880, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 9.57% (0.2937 => 0.3218, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.57% (0.1986 => 0.2176, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 9.54% (0.3868 => 0.4237, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 9.52% (2.1791 => 2.3866, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hello: 9.51% (0.2607 => 0.2855, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.50% (0.8698 => 0.9524, std.dev.: 0.0043) MultiSource/Applications/treecc/treecc: 9.49% (1.9270 => 2.1099, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.49% (0.1865 => 0.2042, std.dev.: 0.0018) MultiSource/Applications/viterbi/viterbi: 9.47% (0.1478 => 0.1618, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 9.46% (0.3149 => 0.3447, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 9.46% (1.0594 => 1.1596, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/methcall: 9.45% (0.2761 => 0.3022, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.43% (7.2180 => 7.8985, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/lists1: 9.39% (0.3534 => 0.3866, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 9.37% (0.3107 => 0.3398, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.34% (0.2023 => 0.2212, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.27% (0.2696 => 0.2946, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.25% (0.1276 => 0.1394, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 9.17% (0.2988 => 0.3262, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 9.15% (0.3192 => 0.3484, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.08% (0.6576 => 0.7173, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.05% (0.1569 => 0.1711, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.83% (1.3245 => 1.4415, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 8.82% (14.8535 => 16.1638, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.81% (4.9865 => 5.4260, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.78% (3.6692 => 3.9914, std.dev.: 0.0051) MultiSource/Benchmarks/sim/sim: 8.75% (0.3131 => 0.3405, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 8.73% (1.2749 => 1.3862, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 8.69% (0.1657 => 0.1801, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.63% (0.3755 => 0.4079, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.54% (4.4433 => 4.8226, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/objinst: 8.49% (0.2945 => 0.3195, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.47% (0.8818 => 0.9565, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.46% (4.3801 => 4.7506, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.41% (0.2140 => 0.2320, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.37% (0.3511 => 0.3805, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 8.35% (8.4961 => 9.2058, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.28% (0.6135 => 0.6643, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 8.22% (4.6629 => 5.0463, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.22% (0.1789 => 0.1936, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 8.05% (0.4113 => 0.4444, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.95% (1.5188 => 1.6395, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.88% (1.1333 => 1.2226, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.85% (0.9108 => 0.9823, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.60% (3.2742 => 3.5231, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.54% (0.2321 => 0.2496, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: 7.51% (0.1385 => 0.1489, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 7.48% (6.5754 => 7.0671, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.47% (0.4805 => 0.5164, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 7.44% (0.6250 => 0.6715, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 7.42% (0.2008 => 0.2157, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.39% (0.2504 => 0.2689, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 7.17% (3.7467 => 4.0153, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.08% (2.1007 => 2.2495, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 6.99% (0.4003 => 0.4283, std.dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: 6.99% (1.2292 => 1.3151, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.87% (0.3245 => 0.3468, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.87% (0.1819 => 0.1944, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.85% (0.3914 => 0.4182, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 6.75% (0.3940 => 0.4206, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.68% (0.3789 => 0.4042, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 6.62% (0.3578 => 0.3815, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 6.61% (0.3663 => 0.3905, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.53% (0.3646 => 0.3884, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.51% (0.3623 => 0.3859, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.51% (13.2842 => 14.1493, std.dev.: 0.0293) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.44% (6.2785 => 6.6828, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-2: 6.39% (0.3601 => 0.3831, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.36% (0.3650 => 0.3882, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.13% (0.2243 => 0.2358, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 4.86% (16.2614 => 17.0521, std.dev.: 0.0146) MultiSource/Applications/ClamAV/clamscan: 4.38% (14.5298 => 15.1657, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 1.76% (33.2944 => 33.8795, std.dev.: 0.0102) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5176, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.75% (1.8175 => 2.2673, std.dev.: 0.0453) SingleSource/Benchmarks/Misc/richards_benchmark: 11.11% (1.1560 => 1.2844, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4138, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.25% (1.2998 => 1.3811, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0041, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.67% (11.2619 => 11.6748, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 3.48% (1.9199 => 1.9867, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 3.27% (10.7476 => 11.0986, std.dev.: 0.0188) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.12% (7.4271 => 7.5842, std.dev.: 0.0067) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4536, std.dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5138, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2068, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9697, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1859, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5782, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0268, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5864, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.85% (0.2670 => 0.1419, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.41% (0.4657 => 0.3893, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -14.43% (0.0707 => 0.0605, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.10% (1.3813 => 1.2004, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.08% (1.3819 => 1.2012, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.79% (22.5627 => 22.1596, std.dev.: 0.0120) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.44% (0.0997 => 0.0863, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.11% (0.2238 => 0.1967, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.34% (1.2308 => 1.0912, std.dev.: 0.0109) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.15% (20.3410 => 18.2761, std.dev.: 0.0128) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.51% (1.3780 => 1.2883, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.47% (1.7688 => 1.7075, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -3.46% (3.2729 => 3.1598, std.dev.: 0.0219) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.02% (0.4867 => 0.4720, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.51% (26.5159 => 25.8494, std.dev.: 0.0075) MultiSource/Applications/spiff/spiff: -2.48% (3.0263 => 2.9512, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: -2.37% (1.9762 => 1.9294, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.99% (0.6589 => 0.6458, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7147, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/lists: -1.69% (6.3560 => 6.2486, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0073, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -1.42% (4.5928 => 4.5278, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8672, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: -1.27% (9.3358 => 9.2171, std.dev.: 0.0108) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4953, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.14% (5.3167 => 5.2562, std.dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 9 21:50:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 9 Oct 2012 23:50:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121010045024.3589E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4751?compare_to=4747&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4751, Order: 165585, Start Time: 2012-10-10 02:08:08, End Time: 2012-10-10 04:52:12 To: 4747, Order: 165551, Start Time: 2012-10-09 22:55:04, End Time: 2012-10-10 01:39:02 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (137 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 1041 (826 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.26% (54.1510 => 54.8346, std.dev.: 0.0250) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.67% (0.1063 => 0.1187, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 11.46% (0.3446 => 0.3841, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.43% (0.3465 => 0.3861, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.41% (0.3488 => 0.3886, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.39% (0.3442 => 0.3834, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.38% (0.3496 => 0.3894, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.36% (0.3460 => 0.3853, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.30% (0.3469 => 0.3861, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.18% (0.3650 => 0.4058, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.09% (0.3643 => 0.4047, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.93% (0.3724 => 0.4131, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 10.90% (1.5932 => 1.7669, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference-object: 9.20% (0.5889 => 0.6431, std.dev.: 0.0081) MultiSource/Benchmarks/McCat/08-main/main: 9.11% (0.1218 => 0.1329, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 9.03% (0.5826 => 0.6352, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 8.83% (0.1619 => 0.1762, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.44% (1.6211 => 1.7579, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.31% (0.4994 => 0.5409, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.30% (0.4361 => 0.4723, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.26% (1.3152 => 1.4238, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.25% (0.2738 => 0.2964, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 8.18% (0.2566 => 0.2776, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.09% (0.1620 => 0.1751, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.00% (0.2875 => 0.3105, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 7.96% (5.5417 => 5.9827, std.dev.: 0.0042) MultiSource/Benchmarks/PAQ8p/paq8p: 7.88% (0.4847 => 0.5229, std.dev.: 0.0058) SingleSource/UnitTests/ObjC++/property-reference: 7.82% (0.7171 => 0.7732, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.79% (0.2736 => 0.2949, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.76% (3.5627 => 3.8393, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.76% (0.5000 => 0.5388, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.76% (0.3004 => 0.3237, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/fibo: 7.74% (0.2725 => 0.2936, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.74% (0.5026 => 0.5415, std.dev.: 0.0065) MultiSource/Applications/hexxagon/hexxagon: 7.73% (0.9909 => 1.0675, std.dev.: 0.0019) MultiSource/Applications/d/make_dparser: 7.67% (1.0781 => 1.1608, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.66% (0.2792 => 0.3006, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.64% (0.3195 => 0.3439, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 7.64% (0.2750 => 0.2960, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.59% (0.2729 => 0.2936, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 7.55% (0.2780 => 0.2990, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 7.50% (0.2813 => 0.3024, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.50% (0.2014 => 0.2165, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 7.48% (0.2714 => 0.2917, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 7.47% (0.2823 => 0.3034, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/18-imp/imp: 7.46% (0.1421 => 0.1527, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.46% (2.0673 => 2.2215, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/random: 7.46% (0.2803 => 0.3012, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 7.41% (0.3267 => 0.3509, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 7.35% (4.2109 => 4.5205, std.dev.: 0.0331) SingleSource/Benchmarks/Shootout-C++/except: 7.33% (0.2811 => 0.3017, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.33% (0.3930 => 0.4218, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.33% (4.4195 => 4.7433, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/wc: 7.30% (0.3096 => 0.3322, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.28% (0.2911 => 0.3123, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.27% (2.7292 => 2.9277, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.27% (0.4139 => 0.4440, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 7.24% (0.1505 => 0.1614, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.20% (0.3625 => 0.3886, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 7.19% (0.3726 => 0.3994, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.17% (0.1549 => 0.1660, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.16% (0.3282 => 0.3517, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.15% (0.2866 => 0.3071, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 7.15% (0.3258 => 0.3491, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 7.15% (0.3678 => 0.3941, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 7.14% (0.3348 => 0.3587, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.12% (0.3060 => 0.3278, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.11% (0.1462 => 0.1566, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 7.08% (0.3317 => 0.3552, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.07% (0.3903 => 0.4179, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.05% (0.3362 => 0.3599, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.02% (0.5900 => 0.6314, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.00% (0.3845 => 0.4114, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.94% (0.3890 => 0.4160, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 6.88% (0.4029 => 0.4306, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 6.87% (0.3477 => 0.3716, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.86% (0.3690 => 0.3943, std.dev.: 0.0017) MultiSource/Applications/siod/siod: 6.84% (0.6634 => 0.7088, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.79% (0.3124 => 0.3336, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 6.78% (1.8794 => 2.0068, std.dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: 6.77% (23.5202 => 25.1116, std.dev.: 0.0143) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.76% (0.1968 => 0.2101, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 6.76% (2.1013 => 2.2433, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.74% (0.3084 => 0.3292, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.73% (0.4251 => 0.4537, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.71% (0.3981 => 0.4248, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.67% (0.2040 => 0.2176, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 6.63% (0.4146 => 0.4421, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 6.60% (1.4269 => 1.5211, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 6.60% (4.6177 => 4.9224, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.57% (0.6435 => 0.6858, std.dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 6.57% (2.1653 => 2.3076, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.50% (0.2969 => 0.3162, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: 6.47% (0.5546 => 0.5905, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.46% (0.4658 => 0.4959, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.38% (0.2068 => 0.2200, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.36% (0.2737 => 0.2911, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 6.27% (0.2075 => 0.2205, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 6.23% (0.9697 => 1.0301, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.21% (0.3271 => 0.3474, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.18% (0.2103 => 0.2233, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 6.17% (0.5012 => 0.5321, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 6.12% (0.7875 => 0.8357, std.dev.: 0.0067) MultiSource/Applications/sqlite3/sqlite3: 6.06% (2.0346 => 2.1578, std.dev.: 0.0104) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.80% (1.9966 => 2.1124, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.76% (1.9694 => 2.0828, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.71% (0.5361 => 0.5667, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.66% (0.7426 => 0.7846, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 5.65% (0.2391 => 0.2526, std.dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 5.54% (0.2691 => 0.2840, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.91% (0.5584 => 0.5858, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.70% (0.4253 => 0.4453, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.61% (11.6398 => 12.1768, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.29% (4.6926 => 4.8941, std.dev.: 0.0094) MultiSource/Applications/lambda-0_1_3/lambda: 4.29% (0.3498 => 0.3648, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 2.99% (11.9555 => 12.3126, std.dev.: 0.0083) SingleSource/UnitTests/Vector/constpool: 1.81% (2.4764 => 2.5212, std.dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 64.25% (0.2162 => 0.3551, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6099, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/objinst: 5.23% (12.0509 => 12.6808, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary: 5.18% (0.2122 => 0.2232, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-2: 4.95% (1.8057 => 1.8950, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1688, std.dev.: 0.1162) SingleSource/Benchmarks/Dhrystone/dry: 4.15% (14.0481 => 14.6312, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2083, std.dev.: 0.0420) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5006, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.55% (3.1722 => 3.2215, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2882, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5134, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5390, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5894, std.dev.: 0.0326) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.85% (25.4195 => 16.5620, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/ary2: -9.70% (0.2402 => 0.2169, std.dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9756, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7992, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7980, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.13% (0.6293 => 0.6096, std.dev.: 0.0051) MultiSource/Applications/siod/siod: -3.04% (6.9842 => 6.7722, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8633, std.dev.: 0.0064) SingleSource/Benchmarks/Dhrystone/fldry: -2.22% (17.2379 => 16.8549, std.dev.: 0.0246) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.80% (10.7630 => 10.5697, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4963, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.08% (105.3826 => 104.2470, std.dev.: 0.0181) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0451, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 9 21:52:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 9 Oct 2012 23:52:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121010045238.C1FBC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4752?compare_to=4749&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4752, Order: 165594, Start Time: 2012-10-10 03:34:58, End Time: 2012-10-10 04:54:26 To: 4749, Order: 165581, Start Time: 2012-10-10 01:45:51, End Time: 2012-10-10 03:05:26 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (159 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1024 (759 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.36% (54.8475 => 56.6902, std.dev.: 0.0062) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.29% (0.5925 => 0.5942, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 0.31% (16.3437 => 16.3937, std.dev.: 0.0193) MultiSource/Benchmarks/Bullet/bullet: 0.25% (55.2390 => 55.3794, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 0.30% (4.4060 => 4.4194, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.15% (1.2557 => 1.2576, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.37% (7.8295 => 7.8582, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.35% (0.7373 => 0.7399, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.84% (0.0357 => 0.0360, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: - (0.1431 => 0.1431, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.59% (0.0669 => 0.0645, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -12.44% (63.2438 => 55.3794, std.dev.: 0.0013) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 33.36% (14.1553 => 18.8779, std.dev.: 0.0268) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.57% (3.4629 => 5.6641, std.dev.: 0.0033) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14226.39% (0.0720 => 10.3150, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952100.00% (0.0001 => 9.9522, std.dev.: 0.0010) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.19% (0.2554 => 0.4168, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 51.52% (10.3673 => 15.7082, std.dev.: 0.0234) SingleSource/Benchmarks/Misc/richards_benchmark: 38.90% (0.1622 => 0.2253, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 33.33% (0.1056 => 0.1408, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 18.23% (0.1432 => 0.1693, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.85% (7.0540 => 8.3132, std.dev.: 0.0123) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.74% (2.2022 => 2.5928, std.dev.: 0.0039) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.20% (0.1566 => 0.1804, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.74% (0.0871 => 0.0982, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.70% (1.7609 => 1.9845, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 12.40% (0.3282 => 0.3689, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.62% (0.1584 => 0.1768, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 11.53% (0.1440 => 0.1606, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 11.29% (10.4361 => 11.6147, std.dev.: 0.0130) MultiSource/Applications/minisat/minisat: 10.47% (0.7115 => 0.7860, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.45% (0.4879 => 0.5389, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 10.26% (9.4845 => 10.4574, std.dev.: 0.0051) MultiSource/Applications/lambda-0_1_3/lambda: 10.22% (0.7433 => 0.8193, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.22% (0.1438 => 0.1585, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.10% (0.3543 => 0.3901, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.07% (0.3177 => 0.3497, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.89% (0.2700 => 0.2967, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.89% (0.6675 => 0.7335, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.66% (0.1625 => 0.1782, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 9.62% (0.1175 => 0.1288, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 9.61% (0.1655 => 0.1814, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 9.60% (3.3354 => 3.6557, std.dev.: 0.0037) MultiSource/Applications/oggenc/oggenc: 9.56% (5.7591 => 6.3099, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/trivial-interface: 9.53% (0.3473 => 0.3804, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.46% (1.5415 => 1.6874, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 9.42% (0.3109 => 0.3402, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-3: 9.41% (0.3516 => 0.3847, std.dev.: 0.0064) SingleSource/UnitTests/ObjC/synchronized: 9.41% (0.3561 => 0.3896, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.40% (0.3543 => 0.3876, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 9.40% (0.3927 => 0.4296, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.35% (0.3497 => 0.3824, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 9.32% (0.1695 => 0.1853, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.32% (0.3886 => 0.4248, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.22% (0.3828 => 0.4181, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.19% (0.5105 => 0.5574, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.15% (0.3694 => 0.4032, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 9.14% (0.3423 => 0.3736, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.08% (0.4615 => 0.5034, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.02% (4.2646 => 4.6491, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.94% (0.1510 => 0.1645, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.81% (0.5860 => 0.6376, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.74% (1.3050 => 1.4190, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.57% (0.8067 => 0.8758, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.54% (0.2271 => 0.2465, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 8.52% (1.1642 => 1.2634, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.51% (5.0018 => 5.4277, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.51% (4.9449 => 5.3658, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.45% (8.1363 => 8.8235, std.dev.: 0.0048) MultiSource/Benchmarks/sim/sim: 8.44% (0.3387 => 0.3673, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.44% (0.8172 => 0.8862, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.41% (0.1236 => 0.1340, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.40% (0.2107 => 0.2284, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 8.39% (3.8723 => 4.1973, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.31% (0.5569 => 0.6032, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.15% (0.9765 => 1.0561, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.15% (0.5020 => 0.5429, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.09% (0.1940 => 0.2097, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.09% (0.2758 => 0.2981, std.dev.: 0.0020) MultiSource/Applications/lemon/lemon: 8.08% (1.0722 => 1.1588, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/bigfib: 8.05% (0.6456 => 0.6976, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.01% (0.3307 => 0.3572, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.00% (0.1337 => 0.1444, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.98% (0.3121 => 0.3370, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 7.97% (1.5603 => 1.6847, std.dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.90% (7.9617 => 8.5903, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.89% (0.2065 => 0.2228, std.dev.: 0.0022) MultiSource/Applications/spiff/spiff: 7.84% (0.7835 => 0.8449, std.dev.: 0.0047) MultiSource/Applications/treecc/treecc: 7.79% (2.0273 => 2.1852, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.76% (1.5859 => 1.7089, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 7.65% (0.1555 => 0.1674, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.44% (1.1861 => 1.2743, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 7.41% (21.9371 => 23.5629, std.dev.: 0.0278) SingleSource/UnitTests/ObjC++/Hello: 7.39% (0.5925 => 0.6363, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.35% (0.3441 => 0.3694, std.dev.: 0.0041) MultiSource/Applications/siod/siod: 7.34% (2.2969 => 2.4655, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference-object: 7.33% (0.6030 => 0.6472, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 7.33% (0.3180 => 0.3413, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.09% (0.4103 => 0.4394, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 7.04% (0.8921 => 0.9549, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.99% (0.2603 => 0.2785, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.97% (0.4636 => 0.4959, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 6.93% (0.3422 => 0.3659, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.92% (0.4203 => 0.4494, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.86% (0.3865 => 0.4130, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.85% (0.6450 => 0.6892, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.83% (0.4289 => 0.4582, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 6.83% (0.7326 => 0.7826, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.81% (2.2024 => 2.3523, std.dev.: 0.0189) SingleSource/Benchmarks/Shootout-C++/hash2: 6.62% (0.4620 => 0.4926, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.62% (0.5981 => 0.6377, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 6.61% (0.4299 => 0.4583, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.60% (0.3650 => 0.3891, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.45% (1.1840 => 1.2604, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.38% (0.3826 => 0.4070, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 6.37% (0.4048 => 0.4306, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.23% (0.2905 => 0.3086, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.19% (0.1695 => 0.1800, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.17% (1.4186 => 1.5061, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.09% (0.3136 => 0.3327, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.08% (0.1892 => 0.2007, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 6.05% (0.3603 => 0.3821, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.03% (2.0665 => 2.1912, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.98% (0.2891 => 0.3064, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.98% (0.3162 => 0.3351, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 5.86% (0.2831 => 0.2997) SingleSource/Benchmarks/Shootout-C++/lists1: 5.86% (0.3684 => 0.3900, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.76% (0.3283 => 0.3472, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.71% (0.3098 => 0.3275, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.69% (0.2266 => 0.2395, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.69% (0.2793 => 0.2952, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.67% (0.1906 => 0.2014, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 5.60% (0.3232 => 0.3413, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.57% (0.2871 => 0.3031, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.57% (0.2802 => 0.2958, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.54% (0.2872 => 0.3031, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.50% (0.3052 => 0.3220, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.48% (0.2756 => 0.2907, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/fibo: 5.39% (0.2725 => 0.2872, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 5.39% (0.2877 => 0.3032, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 5.37% (0.2049 => 0.2159, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 5.23% (0.2714 => 0.2856, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 5.18% (0.3379 => 0.3554, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.17% (0.4064 => 0.4274, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.12% (0.8101 => 0.8516, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.91% (14.3668 => 15.0720, std.dev.: 0.0173) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.64% (0.3427 => 0.3586, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 4.55% (17.1811 => 17.9631, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/objinst: 4.38% (0.3131 => 0.3268, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.32% (0.2430 => 0.2535, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 4.15% (1.2842 => 1.3375, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (3.8922 => 4.0459, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.78% (1.1194 => 1.1505, std.dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.26% (1.1145 => 1.3849, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.92% (1.1396 => 1.2526, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 9.21% (3.1595 => 3.4505, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.1578 => 3.3687, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 3.66% (0.5413 => 0.5611, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.54% (3.6395 => 3.7684, std.dev.: 0.0038) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.74% (4.2280 => 4.3440, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8124, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.15% (2.6546 => 2.6850, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.10% (6.5088 => 6.5802, std.dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.05% (6.6874 => 0.1303, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.12% (5.2763 => 3.2652, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.38% (5.3855 => 3.6955, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.00% (5.3526 => 3.6931, std.dev.: 0.0055) SingleSource/UnitTests/Vector/constpool: -14.67% (54.1659 => 46.2201, std.dev.: 0.0258) MultiSource/Benchmarks/FreeBench/mason/mason: -12.33% (0.0811 => 0.0711, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -10.66% (22.1758 => 19.8111, std.dev.: 0.0176) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.55% (2.9384 => 2.6283, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.87% (1.6925 => 1.4239, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.43% (0.0998 => 0.0864, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: -12.20% (1.2373 => 1.0863, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/mandel-2: -10.32% (1.5373 => 1.3786, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/mason/mason: -10.09% (0.2161 => 0.1943, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.45% (19.9488 => 18.2639, std.dev.: 0.1166) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.65% (1.8329 => 1.7111, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0139) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.27% (1.6805 => 1.5920, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: -4.67% (1.5835 => 1.5096, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.74% (0.9957 => 0.9585, std.dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.69% (3.2827 => 3.1616, std.dev.: 0.0174) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.4990, std.dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: -2.99% (12.4730 => 12.1000, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.16% (8.1563 => 7.9801, std.dev.: 0.0187) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.99% (10.2830 => 10.0786, std.dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.82% (8.6802 => 8.5223, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6819, std.dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.62% (2.5528 => 2.5115, std.dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4201, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -1.09% (4.6441 => 4.5935, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.64% (0.5229 => 0.5942, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 9.37% (14.9895 => 16.3937, std.dev.: 0.0193) MultiSource/Benchmarks/MallocBench/gs/gs: 7.51% (4.1105 => 4.4194, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.83% (1.1048 => 1.2576, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.78% (7.1582 => 7.8582, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.92% (0.6222 => 0.7399, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35900.00% (0.0001 => 0.0360, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.52% (0.2116 => 0.0645, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 9 22:48:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 10 Oct 2012 00:48:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121010054810.694342A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4753?compare_to=4750&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4753, Order: 165596, Start Time: 2012-10-10 04:35:23, End Time: 2012-10-10 05:49:58 To: 4750, Order: 165593, Start Time: 2012-10-10 02:51:30, End Time: 2012-10-10 04:06:05 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (187 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1042 (749 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.95% (2.0176 => 2.5009, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.37% (0.1410 => 0.1669, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 17.68% (0.0826 => 0.0972, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 16.27% (0.2243 => 0.2608, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.08% (0.0653 => 0.0758, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 13.72% (0.1013 => 0.1152, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.62% (0.1072 => 0.1218, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.43% (0.0834 => 0.0946, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.31% (0.1413 => 0.1601, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 12.92% (0.7038 => 0.7947, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.89% (0.1327 => 0.1498, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.67% (3.9660 => 4.4684, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.66% (0.1588 => 0.1789, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.66% (0.0964 => 0.1086, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.53% (0.2721 => 0.3062, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 12.36% (1.3693 => 1.5386, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.25% (0.2596 => 0.2914, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.14% (1.4563 => 1.6331, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash2: 12.11% (0.4328 => 0.4852, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.06% (0.9199 => 1.0308, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 11.93% (13.8202 => 15.4684, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.87% (0.5265 => 0.5890, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.86% (0.6959 => 0.7784, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.79% (1.2193 => 1.3631, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.75% (0.6283 => 0.7021, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 11.68% (0.1062 => 0.1186, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.57% (0.7710 => 0.8602, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 11.57% (0.5818 => 0.6491, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.51% (1.1364 => 1.2672, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 11.47% (0.4062 => 0.4528, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference: 11.27% (0.7061 => 0.7857, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 11.27% (0.1003 => 0.1116, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 11.24% (0.5748 => 0.6394, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.05% (0.3899 => 0.4330, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 11.04% (1.0313 => 1.1452, std.dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.89% (0.3130 => 0.3471, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 10.82% (0.2781 => 0.3082, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.73% (0.4016 => 0.4447, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.72% (0.1157 => 0.1281, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 10.70% (1.1061 => 1.2244, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.69% (0.1048 => 0.1160, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.65% (0.5577 => 0.6171, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.64% (0.4791 => 0.5301, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.53% (0.3485 => 0.3852, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 10.52% (0.2995 => 0.3310, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 10.51% (0.1589 => 0.1756, std.dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.48% (0.4379 => 0.4838, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.46% (0.4390 => 0.4849, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 10.45% (16.6129 => 18.3484, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/lists: 10.39% (0.3293 => 0.3635, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.35% (0.3489 => 0.3850, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.32% (0.3246 => 0.3581, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.32% (0.2782 => 0.3069, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.29% (0.3022 => 0.3333, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.28% (0.3756 => 0.4142, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.23% (0.1075 => 0.1185, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 10.19% (0.6744 => 0.7431, std.dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.12% (0.2914 => 0.3209, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.11% (0.3580 => 0.3942, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 10.06% (1.9270 => 2.1209, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.03% (0.1276 => 0.1404, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.01% (0.2127 => 0.2340, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 10.01% (0.2607 => 0.2868, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/mst/mst: 9.99% (0.1111 => 0.1222, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 9.97% (0.3220 => 0.3541, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 9.94% (0.8310 => 0.9136, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/moments: 9.93% (0.3868 => 0.4252, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.90% (0.5637 => 0.6195, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.90% (0.1435 => 0.1577, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 9.88% (2.1791 => 2.3944, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.88% (0.2966 => 0.3259, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 9.87% (3.8646 => 4.2461, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/except: 9.86% (0.2760 => 0.3032, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 9.85% (0.2690 => 0.2955, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 9.85% (3.1889 => 3.5030, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/sieve: 9.85% (0.3453 => 0.3793, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.84% (0.7460 => 0.8194, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.81% (1.9828 => 2.1774, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.80% (0.2765 => 0.3036, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 9.79% (0.2726 => 0.2993, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.68% (0.2655 => 0.2912, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.63% (0.8698 => 0.9536, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.62% (0.1986 => 0.2177, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.59% (0.2023 => 0.2217, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 9.58% (0.7506 => 0.8225, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 9.56% (0.2761 => 0.3025, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 9.55% (0.2628 => 0.2879, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 9.54% (0.3534 => 0.3871, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 9.53% (0.2937 => 0.3217, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 9.53% (0.3107 => 0.3403, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 9.53% (0.3149 => 0.3449, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.50% (7.2180 => 7.9036, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 9.50% (1.0594 => 1.1600, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.49% (0.1865 => 0.2042, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 9.47% (0.2925 => 0.3202, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 9.43% (0.3192 => 0.3493, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.35% (0.6576 => 0.7191, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.31% (0.2696 => 0.2947, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 9.30% (0.2988 => 0.3266, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 9.20% (0.1478 => 0.1614, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.18% (0.1569 => 0.1713, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.01% (1.3245 => 1.4439, std.dev.: 0.0079) MultiSource/Applications/SIBsim4/SIBsim4: 8.95% (1.2749 => 1.3890, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 8.90% (14.8535 => 16.1757, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.86% (3.6692 => 3.9944, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.85% (4.9865 => 5.4278, std.dev.: 0.0274) MultiSource/Benchmarks/sim/sim: 8.85% (0.3131 => 0.3408, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.80% (0.8818 => 0.9594, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.79% (0.3755 => 0.4085, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 8.75% (0.1657 => 0.1802, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.68% (4.4433 => 4.8289, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: 8.66% (0.2945 => 0.3200, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.64% (0.2140 => 0.2325, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.63% (4.3801 => 4.7579, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 8.49% (8.4961 => 9.2174, std.dev.: 0.0044) MultiSource/Applications/oggenc/oggenc: 8.41% (4.6629 => 5.0549, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.38% (0.6135 => 0.6649, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.35% (0.3511 => 0.3804, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.31% (1.5188 => 1.6450, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.11% (0.1789 => 0.1934, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 8.07% (0.4113 => 0.4445, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.05% (0.9108 => 0.9841, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.95% (0.4805 => 0.5187, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.93% (3.2742 => 3.5337, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.86% (1.1333 => 1.2224, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 7.68% (0.6250 => 0.6730, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.67% (0.2321 => 0.2499, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 7.65% (0.1385 => 0.1491, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 7.62% (0.2008 => 0.2161, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 7.62% (6.5754 => 7.0762, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.51% (0.2504 => 0.2692, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 7.43% (3.7467 => 4.0250, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.35% (2.1007 => 2.2551, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.30% (0.3245 => 0.3482, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.24% (0.4003 => 0.4293, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.03% (0.3914 => 0.4189, std.dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 6.99% (1.2292 => 1.3151, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1819 => 0.1946, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/property: 6.88% (0.3940 => 0.4211, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 6.82% (0.3578 => 0.3822, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.78% (0.3789 => 0.4046, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.77% (0.3646 => 0.3893, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.76% (13.2842 => 14.1821, std.dev.: 0.0063) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.73% (6.2785 => 6.7013, std.dev.: 0.0121) SingleSource/UnitTests/ObjC/exceptions-2: 6.72% (0.3601 => 0.3843, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.66% (0.3663 => 0.3907, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.51% (0.3623 => 0.3859, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.49% (0.3650 => 0.3887, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: 5.74% (0.1777 => 0.1879, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.44% (0.2243 => 0.2365, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 4.97% (16.2614 => 17.0689, std.dev.: 0.0039) MultiSource/Applications/ClamAV/clamscan: 4.42% (14.5298 => 15.1720, std.dev.: 0.0045) MultiSource/Benchmarks/Bullet/bullet: 1.70% (33.2944 => 33.8613, std.dev.: 0.0079) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.39% (5.7573 => 7.5067, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/fbench: 26.28% (1.8175 => 2.2952, std.dev.: 0.0377) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 11.12% (1.1560 => 1.2845, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 9.02% (0.8273 => 0.9019, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4142, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.21% (1.2998 => 1.3805, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9998, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.75% (1.9144 => 2.0053, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7748, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6777, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.53% (10.7476 => 11.1270, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9856, std.dev.: 0.0009) SingleSource/Regression/C/uint64_to_float: 2.97% (0.5449 => 0.5611, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.16% (7.4271 => 7.5878, std.dev.: 0.0053) MultiSource/Applications/lemon/lemon: 1.59% (1.4298 => 1.4526, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5131, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9689, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1885, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5780, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0275, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5855, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.78% (0.2670 => 0.1421, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.19% (0.4657 => 0.3903, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -14.43% (0.0707 => 0.0605, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.97% (1.3813 => 1.2021, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.88% (1.3819 => 1.2039, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.56% (22.5627 => 22.2108, std.dev.: 0.0160) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.74% (0.0997 => 0.0860, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -12.06% (0.2238 => 0.1968, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -11.00% (1.2308 => 1.0954, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.02% (20.3410 => 18.3021, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.55% (1.3780 => 1.2878, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.15% (2.6470 => 2.5107, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.96% (0.9996 => 0.9600, std.dev.: 0.0070) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1560, std.dev.: 0.0149) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.47% (1.7688 => 1.7074, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.02% (0.4867 => 0.4720, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.47% (26.5159 => 25.8605, std.dev.: 0.0119) MultiSource/Applications/spiff/spiff: -2.47% (3.0263 => 2.9517, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.33% (1.9762 => 1.9302, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.12% (0.6589 => 0.6449, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.82% (6.3560 => 6.2406, std.dev.: 0.0052) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7140, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0058, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: -1.44% (4.5928 => 4.5265, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8630, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: -1.21% (9.3358 => 9.2225, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4955, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2566, std.dev.: 0.0007) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 9 23:41:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 10 Oct 2012 01:41:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121010064123.777A72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4754?compare_to=4752&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4754, Order: 165596, Start Time: 2012-10-10 05:23:39, End Time: 2012-10-10 06:43:12 To: 4752, Order: 165594, Start Time: 2012-10-10 03:34:58, End Time: 2012-10-10 04:54:26 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (165 on baseline) Performance Improvements: 1 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1022 (752 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 11.67% (0.3900 => 0.4355, std.dev.: 0.0175) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.21% (1.2952 => 1.3109, std.dev.: 0.0058) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.14% (15.7082 => 15.3719, std.dev.: 0.0105) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.22% (0.5942 => 0.5955, std.dev.: 0.0061) MultiSource/Applications/SPASS/SPASS: 0.48% (16.3937 => 16.4719, std.dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: 0.18% (55.3794 => 55.4796, std.dev.: 0.0167) MultiSource/Benchmarks/MallocBench/gs/gs: 0.44% (4.4194 => 4.4388, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.26% (1.2576 => 1.2609, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.18% (7.8582 => 7.8722, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.41% (0.7399 => 0.7429, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0360 => 0.0360, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: - (0.1431 => 0.1431, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0645 => 0.0645, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -12.28% (63.2438 => 55.4796, std.dev.: 0.0167) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 33.82% (14.1553 => 18.9427, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.87% (3.4629 => 5.6747, std.dev.: 0.0140) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14220.56% (0.0720 => 10.3108, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952000.00% (0.0001 => 9.9521, std.dev.: 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.04% (0.2554 => 0.4164, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 48.27% (10.3673 => 15.3719, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/richards_benchmark: 38.04% (0.1622 => 0.2239, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 33.52% (0.1056 => 0.1410, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 18.16% (0.1432 => 0.1692, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.50% (7.0540 => 8.2888, std.dev.: 0.0064) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.42% (2.2022 => 2.5859, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.52% (0.1566 => 0.1809, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.38% (1.7609 => 1.9965, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.32% (0.0871 => 0.0987, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 12.89% (0.3282 => 0.3705, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.47% (0.0834 => 0.0938) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 12.18% (0.1584 => 0.1777, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 12.06% (10.4361 => 11.6946, std.dev.: 0.0083) MultiSource/Benchmarks/Olden/power/power: 11.67% (0.1440 => 0.1608, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.82% (0.4879 => 0.5407, std.dev.: 0.0035) MultiSource/Applications/minisat/minisat: 10.71% (0.7115 => 0.7877, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.61% (0.3543 => 0.3919, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.57% (0.1438 => 0.1590, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 10.50% (9.4845 => 10.4807, std.dev.: 0.0128) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.48% (0.3177 => 0.3510, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 10.39% (0.7433 => 0.8205, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.22% (0.1625 => 0.1791, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.17% (0.6675 => 0.7354, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.07% (0.2700 => 0.2972, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.05% (0.3473 => 0.3822, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 10.04% (0.1175 => 0.1293, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 10.03% (0.1655 => 0.1821, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 9.94% (3.3354 => 3.6668, std.dev.: 0.0147) SingleSource/UnitTests/ObjC/parameter-passing: 9.91% (0.3927 => 0.4316, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.89% (0.1143 => 0.1256, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 9.87% (0.3516 => 0.3863, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.85% (0.3543 => 0.3892, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.85% (0.3828 => 0.4205, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.85% (1.5415 => 1.6933, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 9.84% (0.3497 => 0.3841, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 9.80% (0.3561 => 0.3910, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 9.75% (0.3109 => 0.3412, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/property: 9.73% (0.3886 => 0.4264, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.69% (0.3694 => 0.4052, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.66% (0.4615 => 0.5061, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 9.63% (5.7591 => 6.3139, std.dev.: 0.0095) MultiSource/Benchmarks/McCat/18-imp/imp: 9.44% (0.3423 => 0.3746, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.36% (0.5105 => 0.5583, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 9.26% (0.1695 => 0.1852, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.24% (1.3050 => 1.4256, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.22% (4.2646 => 4.6576, std.dev.: 0.0015) MultiSource/Applications/aha/aha: 9.12% (0.1151 => 0.1256, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.11% (0.5860 => 0.6394, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.07% (0.1125 => 0.1227, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.00% (0.8067 => 0.8793, std.dev.: 0.0110) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.98% (0.2271 => 0.2475, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.98% (0.1236 => 0.1347, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.94% (4.9449 => 5.3868, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.92% (5.0018 => 5.4482, std.dev.: 0.0051) MultiSource/Applications/Burg/burg: 8.89% (1.1642 => 1.2677, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.87% (0.1510 => 0.1644, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 8.87% (3.8723 => 4.2158, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.80% (0.5569 => 0.6059, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.78% (0.2107 => 0.2292, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.77% (0.3307 => 0.3597, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.73% (8.1363 => 8.8464, std.dev.: 0.0126) MultiSource/Benchmarks/sim/sim: 8.71% (0.3387 => 0.3682, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 8.68% (0.1163 => 0.1264, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 8.62% (0.7835 => 0.8510, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.61% (0.9765 => 1.0606, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.59% (0.8172 => 0.8874, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.56% (0.2758 => 0.2994, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.55% (0.3121 => 0.3388, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.53% (0.5020 => 0.5448, std.dev.: 0.0021) MultiSource/Applications/viterbi/viterbi: 8.49% (0.1555 => 0.1687, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.45% (0.1940 => 0.2104, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.38% (0.2065 => 0.2238, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 8.35% (1.5603 => 1.6906, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/bigfib: 8.32% (0.6456 => 0.6993, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 8.31% (1.0722 => 1.1613, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.30% (0.1337 => 0.1448, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.20% (1.5859 => 1.7160, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 8.15% (2.0273 => 2.1925, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.11% (7.9617 => 8.6074, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.85% (0.3441 => 0.3711, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 7.83% (2.2969 => 2.4767, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.75% (1.1861 => 1.2780, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 7.74% (0.3180 => 0.3426, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.72% (0.4289 => 0.4620, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.70% (0.4103 => 0.4419, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.68% (0.4636 => 0.4992, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.55% (0.3865 => 0.4157, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 7.55% (21.9371 => 23.5933, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.47% (0.4203 => 0.4517, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.45% (0.2603 => 0.2797, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 7.45% (0.3422 => 0.3677, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.45% (0.6030 => 0.6479, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.38% (0.5925 => 0.6362, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 7.35% (0.8921 => 0.9577, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.27% (0.6450 => 0.6919, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.21% (0.4620 => 0.4953, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.17% (2.2024 => 2.3604, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.07% (0.3650 => 0.3908, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.06% (0.2891 => 0.3095, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.05% (0.4299 => 0.4602, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.03% (0.3826 => 0.4095, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 7.02% (0.7326 => 0.7840, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.99% (0.5981 => 0.6399, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 6.97% (0.1463 => 0.1565, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.97% (0.4048 => 0.4330) SingleSource/Regression/C++/ofstream_ctor: 6.92% (0.2905 => 0.3106, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 6.73% (1.1840 => 1.2637, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.61% (0.1695 => 0.1807, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.61% (0.3603 => 0.3841, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.60% (0.2756 => 0.2938, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.60% (0.3136 => 0.3343, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.59% (2.0665 => 2.2027, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.56% (1.4186 => 1.5117, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.51% (0.3162 => 0.3368, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.51% (0.3684 => 0.3924, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/strcat: 6.46% (0.2831 => 0.3014, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/fibo: 6.39% (0.2725 => 0.2899, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 6.31% (0.3232 => 0.3436, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.26% (0.3098 => 0.3292, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.23% (0.3052 => 0.3242, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.19% (0.1906 => 0.2024, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 6.15% (0.3283 => 0.3485, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.12% (0.2877 => 0.3053, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.10% (0.2802 => 0.2973, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.10% (0.2871 => 0.3046, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.09% (0.2793 => 0.2963, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.06% (0.2872 => 0.3046, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.04% (0.2714 => 0.2878, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.00% (0.2266 => 0.2402, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.74% (0.3379 => 0.3573, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 5.71% (0.2049 => 0.2166, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.49% (0.4064 => 0.4287, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.38% (0.8101 => 0.8537, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.08% (0.3131 => 0.3290, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.07% (14.3668 => 15.0956, std.dev.: 0.0122) MultiSource/Applications/hexxagon/hexxagon: 4.75% (1.2842 => 1.3452, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.70% (0.3427 => 0.3588, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 4.64% (17.1811 => 17.9775, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.53% (0.2430 => 0.2540, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.34% (3.8922 => 4.0611, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 3.40% (0.3092 => 0.3197, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.99% (1.1194 => 1.1529, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.58% (0.2944 => 0.3285, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 10.02% (1.1396 => 1.2538, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4498, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3690, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.65% (0.3463 => 0.3624, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 3.68% (0.5413 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.43% (3.6395 => 3.7642, std.dev.: 0.0033) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.76% (4.2280 => 4.3449, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8127, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.26% (2.6546 => 2.6880, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.01% (6.5088 => 6.5746, std.dev.: 0.0080) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1312, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -79.94% (0.8651 => 0.1735, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.98% (5.2763 => 3.2724, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.42% (5.3855 => 3.6933, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.01% (5.3526 => 3.6925, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -14.64% (54.1659 => 46.2379, std.dev.: 0.0290) MultiSource/Applications/ClamAV/clamscan: -10.48% (22.1758 => 19.8523, std.dev.: 0.0260) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.37% (2.9384 => 2.6337, std.dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.34% (1.1492 => 0.7661, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.68% (1.6925 => 1.4271, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.53% (0.0998 => 0.0863, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.57% (1.2373 => 1.0941, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/mandel-2: -10.41% (1.5373 => 1.3773, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/mason/mason: -10.04% (0.2161 => 0.1944, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.35% (19.9488 => 18.2823, std.dev.: 0.0245) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.70% (1.8329 => 1.7101, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.33% (1.6805 => 1.5910, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7963, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.85% (1.5835 => 1.5067, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.09% (0.9957 => 0.9550, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.68% (3.2827 => 3.1620, std.dev.: 0.0094) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.4997, std.dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0987, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.01% (8.6802 => 8.5054, std.dev.: 0.0083) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.82% (8.1563 => 8.0081, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/salsa20: -1.81% (10.2830 => 10.0968, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6815, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5140, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4213, std.dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: -1.10% (4.6441 => 4.5930, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8582, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2359, std.dev.: 0.0019) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.88% (0.5229 => 0.5955, std.dev.: 0.0061) MultiSource/Applications/SPASS/SPASS: 9.89% (14.9895 => 16.4719, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 7.99% (4.1105 => 4.4388, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.13% (1.1048 => 1.2609, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.97% (7.1582 => 7.8722, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.40% (0.6222 => 0.7429, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35900.00% (0.0001 => 0.0360, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.52% (0.2116 => 0.0645, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 10 00:36:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 10 Oct 2012 02:36:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121010073637.5113B2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/4755?compare_to=4753&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4755, Order: 165602, Start Time: 2012-10-10 06:20:20, End Time: 2012-10-10 07:38:25 To: 4753, Order: 165596, Start Time: 2012-10-10 04:35:23, End Time: 2012-10-10 05:49:58 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (169 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1041 (772 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.85% (1.2878 => 1.3116, std.dev.: 0.0069) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.26% (2.0176 => 2.5070, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.51% (0.1410 => 0.1671, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/flops: 17.55% (0.0826 => 0.0971, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.39% (0.0653 => 0.0760, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 16.27% (0.2243 => 0.2608, std.dev.: 0.0114) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.65% (0.1072 => 0.1229, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 13.82% (0.1013 => 0.1153, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.38% (0.1413 => 0.1602, std.dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.31% (0.0834 => 0.0945, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 13.24% (0.7038 => 0.7970, std.dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.81% (0.1327 => 0.1497, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.65% (3.9660 => 4.4676, std.dev.: 0.1215) MultiSource/Applications/hbd/hbd: 12.62% (1.3693 => 1.5421, std.dev.: 0.0384) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.53% (0.1588 => 0.1787, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.46% (0.2721 => 0.3060, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.23% (1.4563 => 1.6344, std.dev.: 0.0375) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.17% (0.2596 => 0.2912, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.02% (0.9199 => 1.0305, std.dev.: 0.0285) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.91% (0.5265 => 0.5892, std.dev.: 0.0151) MultiSource/Applications/aha/aha: 11.86% (0.1062 => 0.1188, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 11.85% (0.4328 => 0.4841, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 11.74% (0.5818 => 0.6501, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 11.72% (13.8202 => 15.4398, std.dev.: 0.0167) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.70% (1.2193 => 1.3619, std.dev.: 0.0380) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.60% (0.6959 => 0.7766, std.dev.: 0.0270) SingleSource/Benchmarks/Shootout-C++/hash: 11.55% (0.4062 => 0.4531, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.54% (0.6283 => 0.7008, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 11.44% (0.7061 => 0.7869, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.41% (1.1364 => 1.2661, std.dev.: 0.0378) SingleSource/UnitTests/ObjC++/Hello: 11.36% (0.5748 => 0.6401, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.21% (0.3899 => 0.4336, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 10.89% (1.0313 => 1.1436, std.dev.: 0.0201) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.80% (0.3130 => 0.3468, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.72% (0.1157 => 0.1281, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.71% (0.4016 => 0.4446, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 10.65% (0.6744 => 0.7462, std.dev.: 0.0211) MultiSource/Applications/Burg/burg: 10.63% (1.1061 => 1.2237, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.62% (0.3485 => 0.3855, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.62% (0.5577 => 0.6169, std.dev.: 0.0227) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.60% (0.4791 => 0.5299, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 10.54% (0.2781 => 0.3074, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 10.49% (16.6129 => 18.3557, std.dev.: 0.2994) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.41% (0.3246 => 0.3584, std.dev.: 0.0101) MultiSource/Applications/sgefa/sgefa: 10.32% (0.2995 => 0.3304, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.30% (0.2914 => 0.3214, std.dev.: 0.0102) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.25% (0.4379 => 0.4828, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists: 10.23% (0.3293 => 0.3630, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.19% (0.3022 => 0.3330, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.17% (0.3489 => 0.3844, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.17% (0.2782 => 0.3065, std.dev.: 0.0076) SingleSource/Benchmarks/McGill/chomp: 10.13% (0.1589 => 0.1750, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.08% (0.3580 => 0.3941, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.04% (0.3756 => 0.4133, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.01% (0.2966 => 0.3263, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.99% (0.5637 => 0.6200, std.dev.: 0.0159) MultiSource/Benchmarks/McCat/18-imp/imp: 9.97% (0.3220 => 0.3541, std.dev.: 0.0074) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.97% (0.1435 => 0.1578, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.93% (0.7460 => 0.8201, std.dev.: 0.0228) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.92% (0.2127 => 0.2338, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/moments: 9.88% (0.3868 => 0.4250, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.86% (0.4390 => 0.4823, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 9.85% (0.3453 => 0.3793, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.84% (0.2023 => 0.2222, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.80% (1.9828 => 2.1771, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/football/football: 9.80% (0.8310 => 0.9124, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.79% (0.2655 => 0.2915, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 9.78% (0.2628 => 0.2885, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/09-vor/vor: 9.78% (0.2925 => 0.3211, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/except: 9.75% (0.2760 => 0.3029, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 9.73% (0.7506 => 0.8236, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 9.70% (0.2607 => 0.2860, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 9.69% (1.9270 => 2.1137, std.dev.: 0.0171) SingleSource/Benchmarks/Shootout-C++/strcat: 9.68% (0.2726 => 0.2990, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 9.68% (1.0594 => 1.1619, std.dev.: 0.0300) SingleSource/Benchmarks/Shootout-C++/methcall: 9.67% (0.2761 => 0.3028, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.66% (0.8698 => 0.9538, std.dev.: 0.0085) MultiSource/Applications/d/make_dparser: 9.65% (3.1889 => 3.4967, std.dev.: 0.0077) MultiSource/Applications/siod/siod: 9.65% (2.1791 => 2.3894, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.62% (0.2765 => 0.3031, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 9.52% (0.2690 => 0.2946, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 9.46% (0.3149 => 0.3447, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 9.43% (0.2937 => 0.3214, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 9.43% (0.3192 => 0.3493, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists1: 9.42% (0.3534 => 0.3867, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary: 9.37% (0.3107 => 0.3398, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.36% (7.2180 => 7.8936, std.dev.: 0.1834) MultiSource/Applications/viterbi/viterbi: 9.27% (0.1478 => 0.1615, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 9.24% (0.2988 => 0.3264, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.24% (0.2696 => 0.2945, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.18% (0.1569 => 0.1713, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.05% (1.3245 => 1.4444, std.dev.: 0.0372) MultiSource/Benchmarks/Olden/em3d/em3d: 8.93% (0.1657 => 0.1805, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.90% (0.6576 => 0.7161, std.dev.: 0.0140) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.82% (3.6692 => 3.9927, std.dev.: 0.1126) MultiSource/Benchmarks/sim/sim: 8.82% (0.3131 => 0.3407, std.dev.: 0.0049) MultiSource/Applications/JM/lencod/lencod: 8.75% (14.8535 => 16.1529, std.dev.: 0.0131) MultiSource/Applications/SIBsim4/SIBsim4: 8.75% (1.2749 => 1.3864, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.74% (4.9865 => 5.4225, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/objinst: 8.59% (0.2945 => 0.3198, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.58% (4.3801 => 4.7561, std.dev.: 0.1254) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.54% (4.4433 => 4.8228, std.dev.: 0.1087) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.54% (0.8818 => 0.9571, std.dev.: 0.0194) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.52% (0.3755 => 0.4075, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.38% (0.1789 => 0.1939, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.30% (0.6135 => 0.6644, std.dev.: 0.0198) MultiSource/Benchmarks/mafft/pairlocalalign: 8.22% (8.4961 => 9.1941, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.20% (0.3511 => 0.3799, std.dev.: 0.0078) MultiSource/Applications/oggenc/oggenc: 8.09% (4.6629 => 5.0400, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.95% (1.1333 => 1.2234, std.dev.: 0.0334) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.83% (1.5188 => 1.6377, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.74% (3.2742 => 3.5276, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.73% (0.9108 => 0.9812, std.dev.: 0.0204) MultiSource/Benchmarks/FreeBench/neural/neural: 7.58% (0.1385 => 0.1490, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.55% (0.4805 => 0.5168, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 7.55% (0.6250 => 0.6722, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 7.49% (6.5754 => 7.0677, std.dev.: 0.0017) MultiSource/Applications/lua/lua: 7.35% (3.7467 => 4.0220, std.dev.: 0.0773) SingleSource/Benchmarks/Misc/oourafft: 7.32% (0.2008 => 0.2155, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: 7.32% (0.4003 => 0.4296, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.27% (0.2504 => 0.2686, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/exceptions: 7.26% (0.3914 => 0.4198, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.12% (0.3245 => 0.3476, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.10% (2.1007 => 2.2498, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/property: 7.01% (0.3940 => 0.4216, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 6.96% (0.3578 => 0.3827, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.86% (0.3789 => 0.4049, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 6.80% (0.3601 => 0.3846, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.80% (0.3646 => 0.3894, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 6.77% (0.3663 => 0.3911, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.77% (0.3650 => 0.3897, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 6.62% (0.3623 => 0.3863, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.51% (6.2785 => 6.6875, std.dev.: 0.1359) MultiSource/Applications/sqlite3/sqlite3: 4.68% (16.2614 => 17.0224, std.dev.: 0.1969) MultiSource/Applications/ClamAV/clamscan: 4.22% (14.5298 => 15.1425, std.dev.: 0.0097) MultiSource/Benchmarks/Bullet/bullet: 1.94% (33.2944 => 33.9404, std.dev.: 0.0115) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5177, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/fbench: 25.13% (1.8175 => 2.2743, std.dev.: 0.0429) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/richards_benchmark: 11.19% (1.1560 => 1.2854, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.02% (0.8273 => 0.9019, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 7.61% (3.1736 => 3.4152, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.00% (1.2998 => 1.3778, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: 4.67% (1.9144 => 2.0038, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6770, std.dev.: 0.0271) SingleSource/Benchmarks/Misc/flops-6: 3.36% (1.9199 => 1.9844, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 3.18% (10.7476 => 11.0896, std.dev.: 0.0058) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.19% (7.4271 => 7.5895, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5133, std.dev.: 0.0321) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9696, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1877, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5781, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0271, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.05% (3.6469 => 3.6852, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5862, std.dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.00% (0.2670 => 0.1415, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.04% (0.4657 => 0.3910, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -14.43% (0.0707 => 0.0605, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.22% (1.3813 => 1.1987, std.dev.: 0.0354) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.12% (1.3819 => 1.2006, std.dev.: 0.0329) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.73% (22.5627 => 22.1719, std.dev.: 0.0173) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0101) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.44% (0.0997 => 0.0863, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.89% (0.2238 => 0.1972, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: -10.92% (1.2308 => 1.0964, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.25% (20.3410 => 18.2560, std.dev.: 0.0190) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5137, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.82% (1.3780 => 1.3116, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.16% (0.9996 => 0.9580, std.dev.: 0.0031) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1562, std.dev.: 0.0127) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.41% (3.0263 => 2.9534, std.dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.96% (0.6589 => 0.6460, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7151, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/lists: -1.68% (6.3560 => 6.2490, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.56% (0.6615 => 0.6512, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0064, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8645, std.dev.: 0.0053) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4953, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2586, std.dev.: 0.0068) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 10 01:06:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 10 Oct 2012 03:06:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121010080600.A17D42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4756?compare_to=4751&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4756, Order: 165596, Start Time: 2012-10-10 05:21:17, End Time: 2012-10-10 08:07:49 To: 4751, Order: 165585, Start Time: 2012-10-10 02:08:08, End Time: 2012-10-10 04:52:12 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (126 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 1041 (838 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.16% (124.2238 => 130.6291, std.dev.: 0.5228) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 11.05% (0.3465 => 0.3848, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.01% (0.3488 => 0.3872, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 10.98% (0.3496 => 0.3880, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.91% (0.3446 => 0.3822, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.89% (0.3442 => 0.3817, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 10.86% (1.5932 => 1.7662, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/synchronized: 10.84% (0.3469 => 0.3845, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.84% (0.3460 => 0.3835, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.68% (0.3650 => 0.4040, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.57% (0.3643 => 0.4028, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.53% (0.3724 => 0.4116, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 8.95% (0.1218 => 0.1327, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.70% (0.5826 => 0.6333, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 8.66% (0.5889 => 0.6399, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 8.65% (0.1619 => 0.1759, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 8.59% (0.3004 => 0.3262, std.dev.: 0.0063) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.37% (1.6211 => 1.7568, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.25% (0.4361 => 0.4721, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 8.24% (5.5417 => 5.9983, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.17% (0.2875 => 0.3110, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.14% (0.5026 => 0.5435, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 8.11% (0.2566 => 0.2774, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.09% (1.3152 => 1.4216, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.98% (0.5000 => 0.5399, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.86% (0.3930 => 0.4239, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 7.82% (0.7171 => 0.7732, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/fibo: 7.82% (0.2725 => 0.2938, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.77% (0.2714 => 0.2925, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.74% (0.2738 => 0.2950, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.68% (3.5627 => 3.8363, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.66% (0.4139 => 0.4456, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.66% (0.2729 => 0.2938, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.63% (0.2803 => 0.3017, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.61% (0.3195 => 0.3438, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 7.60% (0.6634 => 0.7138, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.59% (0.1620 => 0.1743, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.59% (0.1383 => 0.1488, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 7.59% (1.0781 => 1.1599, std.dev.: 0.0127) MultiSource/Applications/hexxagon/hexxagon: 7.53% (0.9909 => 1.0655, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.49% (0.2792 => 0.3001, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.40% (4.4195 => 4.7464, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/wc: 7.40% (0.3096 => 0.3325, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 7.38% (0.2750 => 0.2953, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.36% (0.4146 => 0.4451, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.35% (0.2736 => 0.2937, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 7.34% (0.2780 => 0.2984, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 7.33% (0.2811 => 0.3017, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.32% (0.2813 => 0.3019, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 7.26% (0.2823 => 0.3028, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 7.25% (0.1421 => 0.1524, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: 7.22% (0.3267 => 0.3503, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 7.22% (4.2109 => 4.5148, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary: 7.18% (0.3258 => 0.3492, std.dev.: 0.0030) MultiSource/Applications/spiff/spiff: 7.17% (0.4029 => 0.4318, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 7.14% (1.8794 => 2.0136, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 7.12% (0.3678 => 0.3940, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.11% (0.1462 => 0.1566, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.06% (0.2040 => 0.2184, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.05% (0.2866 => 0.3068, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.05% (2.7292 => 2.9215, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/09-vor/vor: 7.04% (0.1505 => 0.1611, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists: 7.02% (0.3348 => 0.3583, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary2: 6.99% (0.3317 => 0.3549, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.99% (0.3690 => 0.3948, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.98% (0.3625 => 0.3878, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.97% (0.3845 => 0.4113, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash2: 6.96% (0.4251 => 0.4547, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.96% (0.3477 => 0.3719, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.92% (0.3726 => 0.3984, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.92% (0.3282 => 0.3509, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.91% (0.1549 => 0.1656, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 6.91% (0.5546 => 0.5929, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.89% (0.3903 => 0.4172, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 6.89% (0.2075 => 0.2218, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 6.89% (23.5202 => 25.1400, std.dev.: 0.1672) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.86% (0.3890 => 0.4157, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.82% (0.2068 => 0.2209, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.71% (0.1968 => 0.2100, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.63% (0.4658 => 0.4967, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.62% (0.6435 => 0.6861, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.61% (0.3084 => 0.3288, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.61% (0.2737 => 0.2918, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 6.61% (2.1013 => 2.2401, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.56% (0.3981 => 0.4242, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 6.50% (0.3336 => 0.3553, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 6.48% (1.4269 => 1.5193, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.45% (0.3271 => 0.3482, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 6.45% (2.1653 => 2.3049, std.dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: 6.45% (4.6177 => 4.9154, std.dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.33% (0.2969 => 0.3157, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.32% (0.2103 => 0.2236, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 6.25% (0.5012 => 0.5325, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 6.19% (0.9697 => 1.0297, std.dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 6.17% (0.2691 => 0.2857, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.17% (0.7426 => 0.7884, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 6.12% (0.7875 => 0.8357, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 6.11% (2.0346 => 2.1589, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.97% (0.5361 => 0.5681, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 5.77% (0.2391 => 0.2529, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.67% (1.9966 => 2.1099, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.65% (1.9694 => 2.0806, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.46% (0.5584 => 0.5889, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.68% (0.4253 => 0.4452, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.66% (4.6926 => 4.9113, std.dev.: 0.0050) MultiSource/Applications/lambda-0_1_3/lambda: 4.57% (0.3498 => 0.3658, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 3.31% (11.9555 => 12.3512, std.dev.: 0.0110) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 8.34% (0.2122 => 0.2299, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.55% (3.3903 => 3.6123, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-2: 5.13% (1.8057 => 1.8984, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (12.0509 => 12.6689, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/flops: 4.75% (15.4430 => 16.1766, std.dev.: 0.0818) SingleSource/Benchmarks/Dhrystone/dry: 4.23% (14.0481 => 14.6430, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2093, std.dev.: 0.0022) MultiSource/Applications/viterbi/viterbi: 1.87% (46.6247 => 47.4983, std.dev.: 0.0037) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.67% (3.1722 => 3.2253, std.dev.: 0.0035) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.40% (1.0142 => 1.0284, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1062, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5145, std.dev.: 0.0086) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5852, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.76% (25.4195 => 16.5833, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ary2: -8.33% (0.2402 => 0.2202, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9765, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7998, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -3.74% (11.2080 => 10.7884, std.dev.: 0.0161) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -3.13% (17.2379 => 16.6990, std.dev.: 0.0495) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7724, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8632, std.dev.: 0.1904) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.19% (0.6293 => 0.6155, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.80% (10.7630 => 10.5698, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4960, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0462, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.00% (105.3826 => 104.3246, std.dev.: 0.0155) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 10 02:20:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 10 Oct 2012 04:20:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121010092035.11BA72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4757?compare_to=4755&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4757, Order: 165609, Start Time: 2012-10-10 08:07:47, End Time: 2012-10-10 09:22:23 To: 4755, Order: 165602, Start Time: 2012-10-10 06:20:20, End Time: 2012-10-10 07:38:25 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (187 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1040 (750 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.13% (1.3128 => 1.3277, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -3.16% (3.8938 => 3.7707, std.dev.: 0.0387) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.26% (2.0176 => 2.4868, std.dev.: 0.0138) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.01% (0.1410 => 0.1664, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 16.59% (0.0826 => 0.0963, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 16.18% (0.2243 => 0.2606, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 15.31% (0.0653 => 0.0753, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 13.82% (0.1013 => 0.1153, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.25% (0.1072 => 0.1214, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.19% (0.0834 => 0.0944, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.02% (0.1413 => 0.1597, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 12.70% (1.3693 => 1.5432, std.dev.: 0.0043) MultiSource/Applications/lambda-0_1_3/lambda: 12.67% (0.7038 => 0.7930, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.58% (0.1327 => 0.1494, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.42% (0.2721 => 0.3059, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.32% (3.9660 => 4.4548, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.14% (0.0964 => 0.1081, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.09% (0.1588 => 0.1780, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.86% (0.2596 => 0.2904, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.76% (1.4563 => 1.6276, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 11.76% (0.4328 => 0.4837, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.72% (0.9199 => 1.0277, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.71% (0.7710 => 0.8613, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 11.58% (13.8202 => 15.4210, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.55% (0.5265 => 0.5873, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.49% (1.2193 => 1.3594, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 11.48% (0.5818 => 0.6486, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.37% (0.6959 => 0.7750, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.35% (0.6283 => 0.6996, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 11.28% (0.4062 => 0.4520, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 11.22% (0.5748 => 0.6393, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.21% (1.1364 => 1.2638, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 11.21% (0.1062 => 0.1181, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 11.07% (0.1003 => 0.1114, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 10.86% (0.7061 => 0.7828, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.83% (0.3130 => 0.3469, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.75% (0.3899 => 0.4318, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 10.70% (1.0313 => 1.1416, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 10.51% (1.1061 => 1.2224, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.51% (0.1075 => 0.1188, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.51% (0.4016 => 0.4438, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 10.46% (0.2781 => 0.3072, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.42% (0.5577 => 0.6158, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.36% (0.3485 => 0.3846, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.28% (0.3756 => 0.4142, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.24% (0.0977 => 0.1077, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.20% (0.1157 => 0.1275, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.16% (0.4791 => 0.5278, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.16% (0.4379 => 0.4824, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.14% (0.2782 => 0.3064, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.09% (0.3489 => 0.3841, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 10.02% (0.2995 => 0.3295, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.01% (0.3246 => 0.3571, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 10.00% (16.6129 => 18.2734, std.dev.: 0.0193) SingleSource/Benchmarks/Shootout-C++/lists: 9.99% (0.3293 => 0.3622, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.96% (0.3022 => 0.3323, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.94% (0.3580 => 0.3936, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 9.88% (0.6744 => 0.7410, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.83% (0.2127 => 0.2336) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.78% (0.2914 => 0.3199, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 9.75% (0.1589 => 0.1744, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/moments: 9.75% (0.3868 => 0.4245, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.74% (0.2966 => 0.3255, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 9.72% (0.1111 => 0.1219, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.72% (0.1986 => 0.2179, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 9.70% (0.3453 => 0.3788, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 9.69% (0.3220 => 0.3532, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.68% (0.2655 => 0.2912, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 9.64% (0.2760 => 0.3026, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 9.64% (3.8646 => 4.2370, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/hello: 9.63% (0.2607 => 0.2858, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 9.62% (3.1889 => 3.4956, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.60% (1.9828 => 2.1732, std.dev.: 0.0123) MultiSource/Applications/treecc/treecc: 9.60% (1.9270 => 2.1119, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/lists1: 9.56% (0.3534 => 0.3872, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.56% (0.5637 => 0.6176, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 9.55% (0.2690 => 0.2947, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.54% (0.4390 => 0.4809, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/strcat: 9.54% (0.2726 => 0.2986, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 9.51% (2.1791 => 2.3864, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 9.50% (0.2925 => 0.3203, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.50% (0.7460 => 0.8169, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 9.49% (0.8310 => 0.9099, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.49% (0.1865 => 0.2042, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.48% (0.2765 => 0.3027, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.46% (0.8698 => 0.9521, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 9.46% (0.7506 => 0.8216, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.44% (7.2180 => 7.8995, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/fibo: 9.44% (0.2628 => 0.2876, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 9.42% (0.2761 => 0.3021, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.40% (0.1276 => 0.1396, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 9.40% (0.2937 => 0.3213, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.34% (0.1435 => 0.1569, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 9.34% (0.3149 => 0.3443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 9.30% (0.3107 => 0.3396, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.20% (0.2696 => 0.2944, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.19% (0.2023 => 0.2209, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 9.15% (0.3192 => 0.3484, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 9.13% (0.1478 => 0.1613, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 9.07% (0.2988 => 0.3259, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 8.97% (1.0594 => 1.1544, std.dev.: 0.0015) MultiSource/Benchmarks/sim/sim: 8.88% (0.3131 => 0.3409, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 8.81% (0.1657 => 0.1803, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.80% (0.1569 => 0.1707, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.75% (4.9865 => 5.4230, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.74% (1.3245 => 1.4402, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.63% (0.3511 => 0.3814, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.61% (0.6576 => 0.7142, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.60% (0.3755 => 0.4078, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 8.56% (0.2945 => 0.3197, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 8.55% (1.2749 => 1.3839, std.dev.: 0.0050) MultiSource/Applications/JM/lencod/lencod: 8.51% (14.8535 => 16.1176, std.dev.: 0.0150) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.49% (4.4433 => 4.8205, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.48% (3.6692 => 3.9802, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.39% (4.3801 => 4.7475, std.dev.: 0.0102) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.20% (0.6135 => 0.6638, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.08% (0.2140 => 0.2313, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 8.08% (8.4961 => 9.1822, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.88% (0.1789 => 0.1930, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.77% (0.8818 => 0.9503, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 7.75% (4.6629 => 5.0241, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.70% (1.5188 => 1.6358, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.67% (3.2742 => 3.5252, std.dev.: 0.0105) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.65% (1.1333 => 1.2200, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/parameter-passing: 7.47% (0.4003 => 0.4302, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.45% (0.2321 => 0.2494, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.40% (0.9108 => 0.9782, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 7.40% (6.5754 => 7.0618, std.dev.: 0.0128) SingleSource/UnitTests/ObjC/exceptions: 7.38% (0.3914 => 0.4203, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.37% (0.4113 => 0.4416, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 7.36% (0.6250 => 0.6710, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.33% (0.4805 => 0.5157, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.31% (0.3940 => 0.4228, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 7.29% (0.1385 => 0.1486, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 7.29% (0.3663 => 0.3930, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/trivial-interface: 7.27% (0.3578 => 0.3838, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.24% (0.3646 => 0.3910, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 7.23% (3.7467 => 4.0177, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/for-in: 7.23% (0.3789 => 0.4063, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.16% (0.3601 => 0.3859, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.09% (0.3245 => 0.3475, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.04% (0.3650 => 0.3907, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.99% (0.2504 => 0.2679, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.98% (0.3623 => 0.3876, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.90% (2.1007 => 2.2457, std.dev.: 0.0066) MultiSource/Applications/hexxagon/hexxagon: 6.89% (1.2292 => 1.3139, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 6.77% (0.2008 => 0.2144, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.59% (13.2842 => 14.1591, std.dev.: 0.0075) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.43% (0.1819 => 0.1936, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.38% (6.2785 => 6.6790, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.22% (0.2243 => 0.2360, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 4.81% (16.2614 => 17.0434, std.dev.: 0.0234) MultiSource/Applications/ClamAV/clamscan: 4.31% (14.5298 => 15.1563, std.dev.: 0.0112) MultiSource/Benchmarks/Bullet/bullet: 1.19% (33.2944 => 33.6916, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5183, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fbench: 27.28% (1.8175 => 2.3134, std.dev.: 0.0182) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: 10.98% (1.1560 => 1.2829, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4140, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.16% (1.2998 => 1.3799, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.71% (0.3139 => 0.3287, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.65% (1.9144 => 2.0035, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.67% (11.2619 => 11.6756, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.60% (10.7476 => 11.1350, std.dev.: 0.0246) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9854, std.dev.: 0.0011) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.22% (7.4271 => 7.5917, std.dev.: 0.0047) MultiSource/Applications/lemon/lemon: 1.70% (1.4298 => 1.4541, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5139, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1888, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5782, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 1.11% (12.4560 => 12.5938, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0268, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.01% (3.6469 => 3.6836, std.dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.74% (0.2670 => 0.1422, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.85% (0.4657 => 0.3919, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/mason/mason: -14.29% (0.0707 => 0.0606, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.30% (1.3819 => 1.1981, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.28% (1.3813 => 1.1979, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.58% (22.5627 => 22.2070, std.dev.: 0.0106) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.33% (1.0460 => 0.8543, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.44% (0.0997 => 0.0863) MultiSource/Benchmarks/FreeBench/mason/mason: -11.93% (0.2238 => 0.1971, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.07% (1.2308 => 1.0946, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.17% (20.3410 => 18.2715, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.38% (2.5089 => 2.3740, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5148, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8005, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.10% (1.3780 => 1.3215, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.78% (0.9996 => 0.9618, std.dev.: 0.0077) MultiSource/Applications/siod/siod: -3.58% (3.2729 => 3.1556, std.dev.: 0.0248) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.48% (1.7688 => 1.7072, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.54% (26.5159 => 25.8420, std.dev.: 0.0229) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.38% (3.0263 => 2.9543, std.dev.: 0.0012) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.28% (1.9762 => 1.9311, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.00% (0.6589 => 0.6457, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -1.78% (28.2225 => 27.7189, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: -1.78% (6.3560 => 6.2428, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.56% (0.6615 => 0.6512, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0066, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -1.43% (4.5928 => 4.5273, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4947, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.22% (3.9173 => 3.8697, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2574, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 10 03:31:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 10 Oct 2012 05:31:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121010103138.E677C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4758?compare_to=4754&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4758, Order: 165613, Start Time: 2012-10-10 09:13:43, End Time: 2012-10-10 10:33:23 To: 4754, Order: 165596, Start Time: 2012-10-10 05:23:39, End Time: 2012-10-10 06:43:12 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (155 on baseline) Performance Improvements: 2 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1022 (762 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.08% (54.4162 => 56.0944, std.dev.: 0.2677) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.14% (15.3719 => 15.1959, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.10% (2.2027 => 2.1785, std.dev.: 0.0047) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.71% (0.5955 => 0.5913, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: -0.75% (16.4719 => 16.3489, std.dev.: 0.0173) MultiSource/Benchmarks/Bullet/bullet: -0.21% (55.4796 => 55.3643, std.dev.: 0.0378) MultiSource/Benchmarks/MallocBench/gs/gs: -0.64% (4.4388 => 4.4104, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.40% (1.2609 => 1.2559, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.29% (7.8722 => 7.8494, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.50% (0.7429 => 0.7392, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 1.11% (0.0360 => 0.0364, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: - (0.1431 => 0.1431, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.26% (0.0645 => 0.0666, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -12.46% (63.2438 => 55.3643, std.dev.: 0.0378) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.81% (14.1553 => 18.7990, std.dev.: 0.0130) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.26% (3.4629 => 5.6536, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14230.00% (0.0720 => 10.3176, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952100.00% (0.0001 => 9.9522, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 62.84% (0.2554 => 0.4159, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 46.58% (10.3673 => 15.1959, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/richards_benchmark: 37.79% (0.1622 => 0.2235, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 33.24% (0.1056 => 0.1407, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.23% (7.0540 => 8.3400, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.85% (2.2022 => 2.5953, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 17.53% (0.1432 => 0.1683, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.69% (0.1566 => 0.1796, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.12% (1.7609 => 1.9919, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/oourafft: 12.40% (0.3282 => 0.3689, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.40% (0.0871 => 0.0979, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 11.46% (0.1440 => 0.1605, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.17% (0.1584 => 0.1761, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.12% (0.3543 => 0.3937, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 11.10% (10.4361 => 11.5946, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/trivial-interface: 10.71% (0.3473 => 0.3845, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.66% (0.4879 => 0.5399, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/synchronized: 10.53% (0.3561 => 0.3936, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.52% (0.3497 => 0.3865, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.50% (0.3543 => 0.3915, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.44% (0.3516 => 0.3883, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.29% (0.3927 => 0.4331, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 10.23% (0.3694 => 0.4072, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.22% (0.1438 => 0.1585, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 10.21% (0.3828 => 0.4219, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.11% (0.3886 => 0.4279, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.10% (0.3177 => 0.3498, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 10.01% (0.7115 => 0.7827, std.dev.: 0.0123) MultiSource/Benchmarks/mafft/pairlocalalign: 9.88% (9.4845 => 10.4218, std.dev.: 0.0121) MultiSource/Benchmarks/Olden/tsp/tsp: 9.79% (0.1175 => 0.1290, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 9.69% (0.7433 => 0.8153, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.67% (0.2700 => 0.2961, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.63% (0.6675 => 0.7318, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 9.55% (0.1655 => 0.1813, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.49% (1.5415 => 1.6878, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.35% (0.1625 => 0.1777, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 9.21% (3.3354 => 3.6425, std.dev.: 0.0026) MultiSource/Applications/sgefa/sgefa: 8.94% (0.3109 => 0.3387, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 8.94% (0.3423 => 0.3729, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.91% (0.4615 => 0.5026, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.74% (0.8172 => 0.8886, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/em3d/em3d: 8.73% (0.1695 => 0.1843, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 8.71% (5.7591 => 6.2606, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.70% (1.3050 => 1.4185, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.67% (0.2271 => 0.2468, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.67% (4.2646 => 4.6344, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.62% (0.5105 => 0.5545, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.61% (0.1510 => 0.1640, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.60% (0.5860 => 0.6364, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.51% (8.1363 => 8.8288, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.45% (0.2107 => 0.2285, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.39% (0.5569 => 0.6036, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.38% (5.0018 => 5.4210, std.dev.: 0.0138) MultiSource/Benchmarks/sim/sim: 8.36% (0.3387 => 0.3670, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.34% (4.9449 => 5.3572, std.dev.: 0.0032) MultiSource/Applications/Burg/burg: 8.28% (1.1642 => 1.2606, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.23% (0.2065 => 0.2235, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.22% (0.9765 => 1.0568, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.19% (0.8067 => 0.8728, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 8.17% (3.8723 => 4.1886, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.14% (0.1940 => 0.2098, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.05% (0.2758 => 0.2980, std.dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.01% (0.3121 => 0.3371, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 7.98% (0.7835 => 0.8460, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.95% (0.3307 => 0.3570, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 7.90% (1.5603 => 1.6835, std.dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.89% (7.9617 => 8.5895, std.dev.: 0.0039) MultiSource/Applications/viterbi/viterbi: 7.85% (0.1555 => 0.1677, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 7.67% (1.0722 => 1.1544, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/bigfib: 7.64% (0.6456 => 0.6949, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.63% (0.1337 => 0.1439, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 7.60% (2.0273 => 2.1813, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.59% (0.5020 => 0.5401, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 7.39% (0.5925 => 0.6363, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 7.39% (0.3180 => 0.3415, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.32% (0.3441 => 0.3693, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.32% (1.5859 => 1.7020, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 7.21% (0.6030 => 0.6465, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 7.16% (21.9371 => 23.5076, std.dev.: 0.0138) MultiSource/Applications/siod/siod: 7.13% (2.2969 => 2.4606, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.12% (1.1861 => 1.2705, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.03% (0.2603 => 0.2786, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.84% (0.6450 => 0.6891, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.78% (0.4203 => 0.4488, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.73% (0.4103 => 0.4379, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: 6.69% (0.3422 => 0.3651, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.68% (0.3865 => 0.4123, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 6.65% (0.7326 => 0.7813, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.62% (0.4289 => 0.4573, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 6.61% (0.4299 => 0.4583, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 6.55% (0.8921 => 0.9505, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 6.52% (0.4620 => 0.4921, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.48% (2.2024 => 2.3451, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.47% (0.5981 => 0.6368, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.41% (0.3650 => 0.3884, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.35% (0.3826 => 0.4069, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.33% (0.2905 => 0.3089, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.17% (0.4636 => 0.4922, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 6.13% (0.4048 => 0.4296, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.03% (1.4186 => 1.5042, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 6.02% (1.1840 => 1.2553, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.93% (0.3136 => 0.3322, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.88% (0.3603 => 0.3815, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.82% (0.1906 => 0.2017, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 5.81% (0.3684 => 0.3898, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.71% (0.2891 => 0.3056, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.65% (0.2266 => 0.2394, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.60% (0.3162 => 0.3339, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 5.58% (0.2831 => 0.2989, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.42% (0.3098 => 0.3266, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.42% (2.0665 => 2.1785, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/except: 5.36% (0.2871 => 0.3025, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 5.35% (0.3232 => 0.3405, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.30% (0.3283 => 0.3457, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.26% (0.2756 => 0.2901, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.26% (0.2872 => 0.3023, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.21% (0.2877 => 0.3027, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/fibo: 5.21% (0.2725 => 0.2867, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.21% (0.3052 => 0.3211, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.00% (0.2802 => 0.2942, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.98% (0.2793 => 0.2932, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 4.94% (0.2714 => 0.2848, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 4.91% (0.3379 => 0.3545, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.81% (0.8101 => 0.8491, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.80% (0.4064 => 0.4259, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.69% (14.3668 => 15.0402, std.dev.: 0.0217) MultiSource/Applications/sqlite3/sqlite3: 4.21% (17.1811 => 17.9049, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/objinst: 4.12% (0.3131 => 0.3260, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.80% (1.2842 => 1.3330, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.68% (3.8922 => 4.0355, std.dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.03% (1.1194 => 1.1533, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.88% (0.3817 => 0.3927, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.26% (1.1145 => 1.3849, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9648, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 9.77% (1.1396 => 1.2509, std.dev.: 0.0017) MultiSource/Applications/aha/aha: 9.21% (3.1595 => 3.4505, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.70% (3.1578 => 3.3693, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.56% (3.6395 => 3.7691, std.dev.: 0.0033) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.74% (4.2280 => 4.3437, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8130, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.17% (2.6546 => 2.6857, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.06% (6.5088 => 6.5780, std.dev.: 0.0050) MultiSource/Applications/minisat/minisat: 1.01% (9.1159 => 9.2077, std.dev.: 0.0285) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1308, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -79.97% (0.8651 => 0.1733, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.08% (5.2763 => 3.2672, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.01% (5.3855 => 3.7152, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.64% (5.3526 => 3.7124, std.dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -14.59% (54.1659 => 46.2642, std.dev.: 0.0238) MultiSource/Applications/ClamAV/clamscan: -10.65% (22.1758 => 19.8141, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.44% (2.9384 => 2.6317, std.dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel: -33.44% (1.1492 => 0.7649, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -16.10% (1.6925 => 1.4200, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.93% (0.0998 => 0.0859, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.23% (1.2373 => 1.0983, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3783, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/mason/mason: -10.09% (0.2161 => 0.1943, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.39% (19.9488 => 18.2753, std.dev.: 0.0839) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.78% (1.8329 => 1.7086, std.dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/fldry: -5.64% (1.9577 => 1.8473, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.33% (1.6805 => 1.5909, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7963, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5066, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909) MultiSource/Applications/siod/siod: -3.74% (3.2827 => 3.1598, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.13% (0.9957 => 0.9645, std.dev.: 0.0100) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.4991, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: -3.01% (12.4730 => 12.0974, std.dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.90% (8.6802 => 8.5155, std.dev.: 0.0023) SingleSource/UnitTests/Vector/multiplies: -1.86% (2.5528 => 2.5052, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/salsa20: -1.79% (10.2830 => 10.0985, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6825, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.69% (8.1563 => 8.0185, std.dev.: 0.0033) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4198, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -1.22% (6.2999 => 6.2229, std.dev.: 0.0083) MultiSource/Applications/sqlite3/sqlite3: -1.13% (4.6441 => 4.5916, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8583, std.dev.: 0.0055) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.08% (0.5229 => 0.5913, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 9.07% (14.9895 => 16.3489, std.dev.: 0.0173) MultiSource/Benchmarks/MallocBench/gs/gs: 7.30% (4.1105 => 4.4104, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.68% (1.1048 => 1.2559, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.66% (7.1582 => 7.8494, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.80% (0.6222 => 0.7392, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36300.00% (0.0001 => 0.0364, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.53% (0.2116 => 0.0666, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 10 04:04:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 10 Oct 2012 06:04:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121010110405.790352A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4759?compare_to=4757&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4759, Order: 165613, Start Time: 2012-10-10 09:51:18, End Time: 2012-10-10 11:05:53 To: 4757, Order: 165609, Start Time: 2012-10-10 08:07:47, End Time: 2012-10-10 09:22:23 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (187 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1041 (750 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -2.40% (2.3134 => 2.2579, std.dev.: 0.0156) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.98% (2.0176 => 2.5014, std.dev.: 0.0048) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.58% (0.1410 => 0.1672, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 17.31% (0.0826 => 0.0969, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 16.23% (0.2243 => 0.2607, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 13.72% (0.1013 => 0.1152, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 13.38% (0.2721 => 0.3085, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.31% (0.0834 => 0.0945, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.25% (0.1072 => 0.1214, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 13.17% (1.3693 => 1.5496, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.09% (0.1413 => 0.1598, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.68% (3.9660 => 4.4690, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.66% (0.1327 => 0.1495, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 12.66% (0.7038 => 0.7929, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.24% (0.0964 => 0.1082, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.22% (0.1588 => 0.1782, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.19% (1.4563 => 1.6338, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.90% (0.2596 => 0.2905, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.87% (0.9199 => 1.0291, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/hash2: 11.83% (0.4328 => 0.4840, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 11.83% (13.8202 => 15.4546, std.dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.78% (1.2193 => 1.3629, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.78% (0.7710 => 0.8618, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.68% (0.5265 => 0.5880, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.64% (0.6959 => 0.7769, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.51% (1.1364 => 1.2672, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.49% (0.6283 => 0.7005, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 11.49% (0.1062 => 0.1184, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 11.47% (0.4062 => 0.4528, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 11.14% (0.5818 => 0.6466, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 11.07% (0.1003 => 0.1114, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 10.86% (0.5748 => 0.6372, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 10.84% (1.0313 => 1.1431, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.78% (0.4016 => 0.4449, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.77% (0.3130 => 0.3467, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.64% (0.3899 => 0.4314, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.62% (0.5577 => 0.6169, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.60% (0.1075 => 0.1189, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 10.54% (0.7061 => 0.7805, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 10.50% (0.2781 => 0.3073, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.44% (0.3485 => 0.3849, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 10.44% (1.1061 => 1.2216, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.37% (0.1157 => 0.1277, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.25% (0.4791 => 0.5282, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.24% (0.0977 => 0.1077, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.20% (0.3489 => 0.3845, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists: 10.20% (0.3293 => 0.3629, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.14% (0.2782 => 0.3064, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 10.12% (0.2995 => 0.3298, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.12% (0.4379 => 0.4822, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 10.10% (0.6744 => 0.7425, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.04% (0.3246 => 0.3572, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.04% (0.3756 => 0.4133, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 10.02% (0.3453 => 0.3799, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.01% (0.2127 => 0.2340, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 10.00% (16.6129 => 18.2742, std.dev.: 0.0150) MultiSource/Benchmarks/Olden/mst/mst: 9.99% (0.1111 => 0.1222, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.96% (0.3022 => 0.3323, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 9.95% (0.3868 => 0.4253, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.92% (0.3580 => 0.3935, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 9.88% (0.1589 => 0.1746, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.87% (0.1986 => 0.2182, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 9.84% (0.3220 => 0.3537, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.80% (0.3511 => 0.3855, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 9.80% (0.8310 => 0.9124, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.78% (0.2914 => 0.3199, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 9.78% (3.1889 => 3.5007, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.78% (0.2966 => 0.3256, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.76% (0.1435 => 0.1575, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 9.71% (0.2760 => 0.3028, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.70% (0.5637 => 0.6184, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.66% (7.2180 => 7.9152, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.64% (0.7460 => 0.8179, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 9.63% (3.8646 => 4.2366, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.62% (0.2765 => 0.3031, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 9.62% (0.7506 => 0.8228, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 9.61% (0.2726 => 0.2988, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 9.61% (1.9270 => 2.1121, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary3: 9.56% (0.3149 => 0.3450, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 9.55% (0.2690 => 0.2947, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 9.53% (0.2761 => 0.3024, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.50% (0.8698 => 0.9524, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 9.49% (0.3107 => 0.3402, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.49% (1.9828 => 2.1710, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.49% (0.2655 => 0.2907, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 9.45% (2.1791 => 2.3851, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.44% (0.1865 => 0.2041, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 9.44% (0.2607 => 0.2853, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 9.42% (0.3534 => 0.3867, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 9.40% (0.2937 => 0.3213, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 9.37% (0.2925 => 0.3199, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 9.36% (0.2628 => 0.2874, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.34% (0.2023 => 0.2212, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.34% (0.4390 => 0.4800, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 9.33% (1.0594 => 1.1582, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.25% (0.1276 => 0.1394, std.dev.: 0.0030) MultiSource/Applications/viterbi/viterbi: 9.13% (0.1478 => 0.1613, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.12% (0.6576 => 0.7176, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 9.10% (0.2988 => 0.3260, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.09% (0.2696 => 0.2941, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 9.09% (0.3192 => 0.3482, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.92% (0.1569 => 0.1709, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 8.88% (0.3131 => 0.3409, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.86% (1.3245 => 1.4418, std.dev.: 0.0074) MultiSource/Applications/JM/lencod/lencod: 8.82% (14.8535 => 16.1638, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/em3d/em3d: 8.81% (0.1657 => 0.1803, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.75% (4.9865 => 5.4230, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.75% (3.6692 => 3.9903, std.dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 8.71% (1.2749 => 1.3859, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.60% (0.2140 => 0.2324, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.57% (4.4433 => 4.8239, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.54% (4.3801 => 4.7543, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.44% (0.3755 => 0.4072, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 8.42% (0.2945 => 0.3193, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 8.36% (8.4961 => 9.2064, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.36% (0.8818 => 0.9555, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.22% (0.1789 => 0.1936, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.22% (0.6135 => 0.6639, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.94% (0.9108 => 0.9831, std.dev.: 0.0064) MultiSource/Applications/oggenc/oggenc: 7.89% (4.6629 => 5.0309, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.89% (1.5188 => 1.6386, std.dev.: 0.0063) SingleSource/UnitTests/ObjC/parameter-passing: 7.84% (0.4003 => 0.4317, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.84% (0.3914 => 0.4221, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.83% (1.1333 => 1.2220, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.81% (3.2742 => 3.5298, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 7.76% (0.4113 => 0.4432, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 7.60% (6.5754 => 7.0752, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/neural/neural: 7.58% (0.1385 => 0.1490, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.57% (0.3578 => 0.3849, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.50% (0.2321 => 0.2495, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.47% (0.3789 => 0.4072) SingleSource/UnitTests/ObjC/property: 7.46% (0.3940 => 0.4234, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 7.43% (0.3646 => 0.3917, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 7.41% (0.3601 => 0.3868, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 7.41% (0.6250 => 0.6713, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 7.40% (0.3663 => 0.3934, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.34% (0.3623 => 0.3889, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.33% (0.4805 => 0.5157, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.29% (0.3650 => 0.3916, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 7.22% (0.2008 => 0.2153, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 7.20% (3.7467 => 4.0163, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.15% (0.2504 => 0.2683, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.09% (2.1007 => 2.2497, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 6.87% (1.2292 => 1.3137, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.87% (0.3245 => 0.3468, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.73% (13.2842 => 14.1787, std.dev.: 0.0064) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.65% (6.2785 => 6.6961, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.27% (0.1819 => 0.1933, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 5.68% (0.1777 => 0.1878, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.53% (0.2243 => 0.2367, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 4.96% (16.2614 => 17.0687, std.dev.: 0.0053) MultiSource/Applications/ClamAV/clamscan: 4.46% (14.5298 => 15.1781, std.dev.: 0.0049) MultiSource/Benchmarks/Bullet/bullet: 1.48% (33.2944 => 33.7871, std.dev.: 0.0213) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.85% (0.4846 => 0.6971, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5178, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: 24.23% (1.8175 => 2.2579, std.dev.: 0.0156) SingleSource/Benchmarks/Misc/richards_benchmark: 11.07% (1.1560 => 1.2840, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4138, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.12% (1.2998 => 1.3793, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.80% (0.3458 => 0.3624, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0042, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7748, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6763, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9858, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.39% (10.7476 => 11.1122, std.dev.: 0.0183) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.08% (7.4271 => 7.5819, std.dev.: 0.0088) MultiSource/Applications/lemon/lemon: 1.73% (1.4298 => 1.4545, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5130, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1883, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5780, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 1.10% (12.4560 => 12.5925, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0275, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.09% (8.8259 => 8.9219, std.dev.: 0.0104) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.70% (0.2670 => 0.1423, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.59% (0.4657 => 0.3931, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -14.14% (0.0707 => 0.0607, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.13% (1.3819 => 1.2004, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.08% (1.3813 => 1.2006, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.58% (22.5627 => 22.2072, std.dev.: 0.0127) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.64% (0.0997 => 0.0861, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -12.20% (0.2238 => 0.1965, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: -10.95% (1.2308 => 1.0960, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.28% (20.3410 => 18.2492, std.dev.: 0.0237) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.38% (2.5089 => 2.3740, std.dev.: 0.0051) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.28% (0.9996 => 0.9568, std.dev.: 0.0063) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1560, std.dev.: 0.0075) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.48% (1.7688 => 1.7073, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -2.55% (26.5159 => 25.8403, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -2.38% (3.0263 => 2.9544, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -2.37% (1.9762 => 1.9293, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.93% (0.6589 => 0.6462, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7142, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.74% (6.3560 => 6.2456, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0068, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -1.39% (4.5928 => 4.5288, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8650, std.dev.: 0.0060) MultiSource/Applications/minisat/minisat: -1.28% (9.3358 => 9.2165, std.dev.: 0.0195) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4951, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2573, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 10 04:19:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 10 Oct 2012 06:19:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121010111906.CA2AA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4760?compare_to=4756&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4760, Order: 165611, Start Time: 2012-10-10 08:37:14, End Time: 2012-10-10 11:20:55 To: 4756, Order: 165596, Start Time: 2012-10-10 05:21:17, End Time: 2012-10-10 08:07:49 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (134 on baseline) Performance Improvements: 5 (17 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 1037 (829 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.28% (0.7884 => 0.7783, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -1.25% (5.9983 => 5.9234, std.dev.: 0.0080) MultiSource/Applications/kimwitu++/kc: -1.07% (12.3512 => 12.2196, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.02% (4.9113 => 4.8610, std.dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.39% (130.6291 => 126.1980, std.dev.: 1.5338) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 10.87% (0.3496 => 0.3876, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.82% (0.3446 => 0.3819, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.82% (0.3465 => 0.3840, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.81% (0.3469 => 0.3844, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.78% (0.3488 => 0.3864, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.72% (0.3442 => 0.3811, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.66% (0.3460 => 0.3829, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.55% (0.3650 => 0.4035, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.51% (0.3643 => 0.4026, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.37% (0.3724 => 0.4110, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.35% (0.1063 => 0.1173, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 10.19% (1.5932 => 1.7556, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/08-main/main: 8.46% (0.1218 => 0.1321, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/05-eks/eks: 8.28% (0.1619 => 0.1753, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 8.03% (0.5826 => 0.6294, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.93% (0.5889 => 0.6356, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.79% (1.6211 => 1.7474, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.76% (1.3152 => 1.4172, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.61% (0.4361 => 0.4693, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.55% (0.4994 => 0.5371, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.30% (3.5627 => 3.8226, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.28% (0.1620 => 0.1738, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.17% (0.2875 => 0.3081, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.12% (0.2866 => 0.3070, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.10% (0.5000 => 0.5355, std.dev.: 0.0023) MultiSource/Benchmarks/PAQ8p/paq8p: 7.04% (0.4847 => 0.5188, std.dev.: 0.0110) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.00% (0.2014 => 0.2155, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.99% (0.3004 => 0.3214, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.98% (0.2792 => 0.2987, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.96% (0.4139 => 0.4427, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 6.89% (5.5417 => 5.9234, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.89% (0.3195 => 0.3415, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 6.87% (1.0781 => 1.1522, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.87% (0.2736 => 0.2924, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.86% (0.5026 => 0.5371, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hello: 6.85% (0.2714 => 0.2900, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.82% (0.2729 => 0.2915, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.79% (0.2725 => 0.2910, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 6.78% (0.1505 => 0.1607, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 6.76% (0.2750 => 0.2936, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 6.68% (4.2109 => 4.4923, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/matrix: 6.65% (0.2780 => 0.2965, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.65% (0.2738 => 0.2920, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 6.62% (0.2823 => 0.3010, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.59% (0.3930 => 0.4189, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.58% (0.1549 => 0.1651, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference: 6.58% (0.7171 => 0.7643, std.dev.: 0.0036) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.58% (2.7292 => 2.9087, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/random: 6.56% (0.2803 => 0.2987, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 6.55% (0.9909 => 1.0558, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 6.54% (0.2813 => 0.2997, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.53% (0.5900 => 0.6285, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/except: 6.51% (0.2811 => 0.2994, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 6.47% (0.2566 => 0.2732, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: 6.47% (0.3726 => 0.3967, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.47% (4.4195 => 4.7053, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/wc: 6.43% (0.3096 => 0.3295, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.39% (0.2911 => 0.3097, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/moments: 6.39% (0.3678 => 0.3913, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.37% (0.3267 => 0.3475, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 6.35% (0.6634 => 0.7055, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.34% (0.3625 => 0.3855, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.34% (0.3282 => 0.3490, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/gs/gs: 6.34% (1.8794 => 1.9985, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 6.32% (0.3258 => 0.3464, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 6.30% (0.3317 => 0.3526, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.28% (0.3903 => 0.4148, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.27% (0.3060 => 0.3252, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.27% (0.3890 => 0.4134, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 6.21% (0.3348 => 0.3556, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.21% (0.3124 => 0.3318, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.21% (0.3271 => 0.3474, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.20% (0.2969 => 0.3153, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.19% (0.3362 => 0.3570, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.18% (0.3981 => 0.4227, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.15% (0.3690 => 0.3917, std.dev.: 0.0017) MultiSource/Applications/spiff/spiff: 6.13% (0.4029 => 0.4276, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.12% (0.4658 => 0.4943, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.10% (0.1968 => 0.2088, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: 6.07% (0.3477 => 0.3688, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 6.06% (4.6177 => 4.8977, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/hash2: 5.98% (0.4251 => 0.4505, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 5.97% (0.5546 => 0.5877, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 5.94% (23.5202 => 24.9183, std.dev.: 0.0260) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.77% (0.3845 => 0.4067, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 5.76% (0.4146 => 0.4385, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 5.76% (2.1653 => 2.2900, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 5.76% (2.1013 => 2.2223, std.dev.: 0.0022) MultiSource/Applications/lua/lua: 5.75% (1.4269 => 1.5089, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.70% (0.6435 => 0.6802, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.69% (0.2040 => 0.2156, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.67% (0.3084 => 0.3259, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 5.66% (0.9697 => 1.0246, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.66% (0.2068 => 0.2185, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.48% (0.2737 => 0.2887, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 5.43% (0.3336 => 0.3517, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: 5.42% (0.7875 => 0.8302, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 5.37% (0.5012 => 0.5281, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.30% (1.9694 => 2.0738, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.28% (1.9966 => 2.1020, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/football/football: 5.25% (0.2075 => 0.2184, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 5.23% (2.0346 => 2.1410, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.09% (0.2103 => 0.2210, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 4.85% (0.2391 => 0.2507, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.81% (0.7426 => 0.7783, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.66% (0.5361 => 0.5611, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 4.57% (0.2691 => 0.2814, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.16% (0.4253 => 0.4430, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.12% (0.5584 => 0.5814, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.91% (11.6398 => 12.0950, std.dev.: 0.0082) MultiSource/Applications/lambda-0_1_3/lambda: 3.69% (0.3498 => 0.3627, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.59% (4.6926 => 4.8610, std.dev.: 0.0024) MultiSource/Applications/kimwitu++/kc: 2.21% (11.9555 => 12.2196, std.dev.: 0.0111) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6095, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary: 5.37% (0.2122 => 0.2236, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6776, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-2: 4.91% (1.8057 => 1.8944, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1702, std.dev.: 0.0477) SingleSource/Benchmarks/Dhrystone/dry: 4.32% (14.0481 => 14.6548, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2075, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5045, std.dev.: 0.0074) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.64% (3.1722 => 3.2243, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2838, std.dev.: 0.0031) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5138, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5971, std.dev.: 0.0188) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.77% (25.4195 => 16.5801, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ary2: -9.16% (0.2402 => 0.2182, std.dev.: 0.0053) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9739, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7988, std.dev.: 0.0099) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9585) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.8003, std.dev.: 0.0040) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7744, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.93% (17.2379 => 16.7323, std.dev.: 0.0554) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.25% (41.7953 => 40.8544, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.76% (0.6293 => 0.6182, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5776, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4955, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0434, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.05% (105.3826 => 104.2739, std.dev.: 0.0207) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 10 06:21:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 10 Oct 2012 08:21:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121010132145.737152A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4761?compare_to=4759&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4761, Order: 165615, Start Time: 2012-10-10 12:08:53, End Time: 2012-10-10 13:23:33 To: 4759, Order: 165613, Start Time: 2012-10-10 09:51:18, End Time: 2012-10-10 11:05:53 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (185 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1041 (751 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.65% (54.5161 => 56.5080, std.dev.: 0.0516) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.44% (2.0176 => 2.5107, std.dev.: 0.0138) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.37% (0.1410 => 0.1669, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 17.55% (0.0826 => 0.0971, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 16.58% (0.2243 => 0.2615, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/tsp/tsp: 13.72% (0.1013 => 0.1152, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.43% (0.0834 => 0.0946, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.31% (0.1413 => 0.1601) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.15% (0.1072 => 0.1213, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 13.12% (1.3693 => 1.5490, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 13.12% (0.2721 => 0.3078, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.65% (3.9660 => 4.4676, std.dev.: 0.0081) MultiSource/Applications/lambda-0_1_3/lambda: 12.60% (0.7038 => 0.7925, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.51% (0.1327 => 0.1493, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.28% (0.1588 => 0.1783, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.24% (1.4563 => 1.6346, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.24% (0.0964 => 0.1082, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 12.01% (0.4328 => 0.4848, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.98% (0.2596 => 0.2907, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.88% (0.9199 => 1.0292, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.81% (0.5265 => 0.5887, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 11.80% (13.8202 => 15.4516, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.78% (1.2193 => 1.3629, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 11.76% (0.5818 => 0.6502, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.73% (0.6283 => 0.7020, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.69% (0.7710 => 0.8611, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.61% (0.6959 => 0.7767, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 11.55% (0.5748 => 0.6412, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.52% (1.1364 => 1.2673, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 11.30% (0.4062 => 0.4521, std.dev.: 0.0052) SingleSource/UnitTests/ObjC++/property-reference: 11.19% (0.7061 => 0.7851, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.96% (0.3130 => 0.3473, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 10.96% (1.0313 => 1.1443, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.87% (0.3899 => 0.4323, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 10.87% (0.1003 => 0.1112, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.78% (0.4016 => 0.4449, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.70% (0.5577 => 0.6174, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 10.61% (0.2781 => 0.3076, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.56% (0.3485 => 0.3853, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 10.55% (1.1061 => 1.2228, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.48% (0.4791 => 0.5293, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.43% (0.3489 => 0.3853, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.42% (0.1075 => 0.1187, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.34% (0.0977 => 0.1078, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.29% (0.1157 => 0.1276, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.28% (0.2782 => 0.3068, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.28% (0.3580 => 0.3948, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.22% (0.3756 => 0.4140) SingleSource/Benchmarks/Shootout-C++/lists: 10.17% (0.3293 => 0.3628, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 10.17% (0.6744 => 0.7430, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.16% (0.4379 => 0.4824, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.15% (0.2966 => 0.3267, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 10.14% (16.6129 => 18.2976, std.dev.: 0.0177) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.14% (0.3246 => 0.3575, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.13% (0.3022 => 0.3328, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 10.12% (0.2995 => 0.3298, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 10.07% (0.2760 => 0.3038, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 10.05% (0.3453 => 0.3800, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 9.99% (0.1111 => 0.1222, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.97% (0.2127 => 0.2339, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 9.95% (0.3868 => 0.4253, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 9.94% (0.2726 => 0.2997, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 9.92% (0.8310 => 0.9134, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.91% (0.2765 => 0.3039, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 9.88% (0.3220 => 0.3538, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.84% (1.9828 => 2.1780, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 9.83% (3.1889 => 3.5023, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/hello: 9.82% (0.2607 => 0.2863, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.82% (0.1986 => 0.2181, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 9.82% (0.1589 => 0.1745, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.81% (0.2914 => 0.3200, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.79% (0.2655 => 0.2915, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.76% (0.5637 => 0.6187, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 9.74% (0.2690 => 0.2952, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 9.73% (0.3534 => 0.3878, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 9.73% (3.8646 => 4.2406, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ary: 9.72% (0.3107 => 0.3409, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 9.70% (1.9270 => 2.1139, std.dev.: 0.0060) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.69% (0.1435 => 0.1574, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.68% (0.7460 => 0.8182, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.68% (7.2180 => 7.9165, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 9.67% (0.2761 => 0.3028, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.63% (0.8698 => 0.9536, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 9.63% (0.2628 => 0.2881, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 9.62% (0.3149 => 0.3452, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 9.62% (0.7506 => 0.8228, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.61% (0.4390 => 0.4812, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 9.60% (0.2937 => 0.3219, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 9.59% (2.1791 => 2.3881, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.49% (0.2023 => 0.2215, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 9.44% (1.0594 => 1.1594, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 9.40% (0.2925 => 0.3200, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 9.40% (0.3192 => 0.3492, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.38% (0.2696 => 0.2949, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 9.34% (0.2988 => 0.3267, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 9.34% (0.1478 => 0.1616, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.33% (0.1865 => 0.2039, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.20% (0.3511 => 0.3834, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.17% (0.1276 => 0.1393, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.05% (0.1569 => 0.1711, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.97% (0.3755 => 0.4092, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.97% (1.3245 => 1.4433, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 8.88% (0.3131 => 0.3409, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 8.84% (1.2749 => 1.3876, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 8.80% (14.8535 => 16.1613, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.74% (3.6692 => 3.9900, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 8.73% (0.2945 => 0.3202, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.71% (4.9865 => 5.4206, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/em3d/em3d: 8.69% (0.1657 => 0.1801, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.64% (4.3801 => 4.7585, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.62% (4.4433 => 4.8263, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.55% (0.2140 => 0.2323, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.55% (0.6576 => 0.7138, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.39% (0.6135 => 0.6650, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 8.38% (8.4961 => 9.2081, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.30% (0.8818 => 0.9550, std.dev.: 0.0134) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.27% (0.1789 => 0.1937, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.01% (1.5188 => 1.6404, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.99% (1.1333 => 1.2238, std.dev.: 0.0047) MultiSource/Applications/oggenc/oggenc: 7.94% (4.6629 => 5.0333, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.75% (3.2742 => 3.5279, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.71% (0.2321 => 0.2500, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.69% (0.9108 => 0.9808, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 7.68% (6.5754 => 7.0805, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/bigfib: 7.62% (0.6250 => 0.6726, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 7.61% (0.4113 => 0.4426, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.53% (0.4805 => 0.5167, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 7.44% (0.1385 => 0.1488, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.37% (0.4003 => 0.4298, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 7.29% (3.7467 => 4.0197, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.26% (0.3914 => 0.4198, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.24% (2.1007 => 2.2527, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.23% (0.2504 => 0.2685, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 7.12% (1.2292 => 1.3167, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.08% (0.3940 => 0.4219, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.06% (0.3245 => 0.3474, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.05% (0.3789 => 0.4056, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.04% (0.3578 => 0.3830, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/oourafft: 7.02% (0.2008 => 0.2149, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.00% (13.2842 => 14.2146, std.dev.: 0.0088) SingleSource/UnitTests/ObjC/exceptions-2: 7.00% (0.3601 => 0.3853, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.99% (0.3646 => 0.3901, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.96% (0.3663 => 0.3918, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.90% (0.3650 => 0.3902, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.87% (0.3623 => 0.3872, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.59% (6.2785 => 6.6922, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.38% (0.1819 => 0.1935, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 5.63% (0.1777 => 0.1877, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.53% (0.2243 => 0.2367, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 5.09% (16.2614 => 17.0885, std.dev.: 0.0098) MultiSource/Applications/ClamAV/clamscan: 4.67% (14.5298 => 15.2085, std.dev.: 0.0074) MultiSource/Benchmarks/Bullet/bullet: 1.71% (33.2944 => 33.8633, std.dev.: 0.0184) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5142, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.83% (1.8175 => 2.2687, std.dev.: 0.0345) SingleSource/Benchmarks/Misc/richards_benchmark: 11.05% (1.1560 => 1.2837, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.03% (0.8273 => 0.9020, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4139, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.09% (1.2998 => 1.3790, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.67% (1.9144 => 2.0038, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6764, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.59% (10.7476 => 11.1334, std.dev.: 0.0431) SingleSource/Benchmarks/Misc/flops-6: 3.49% (1.9199 => 1.9870, std.dev.: 0.0010) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.07% (7.4271 => 7.5809, std.dev.: 0.0082) MultiSource/Applications/lemon/lemon: 1.70% (1.4298 => 1.4541, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5151, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1867, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5785, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.12% (12.4560 => 12.5957, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0263, std.dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.59% (0.2670 => 0.1426, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.04% (0.4657 => 0.3910, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -14.14% (0.0707 => 0.0607, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.02% (1.3813 => 1.2015, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.00% (1.3819 => 1.2022, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.58% (22.5627 => 22.2057, std.dev.: 0.0191) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.44% (0.0997 => 0.0863, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -11.89% (0.2238 => 0.1972, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.90% (1.2308 => 1.0967, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.16% (20.3410 => 18.2742, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.04% (1.3780 => 1.2948, std.dev.: 0.0145) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5147, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.96% (0.9996 => 0.9600, std.dev.: 0.0032) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1559, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.49% (1.7688 => 1.7070, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.51% (26.5159 => 25.8491, std.dev.: 0.0255) MultiSource/Applications/spiff/spiff: -2.37% (3.0263 => 2.9546, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.34% (1.9762 => 1.9300, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.97% (0.6589 => 0.6459, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7143, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/lists: -1.73% (6.3560 => 6.2459, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -1.49% (4.5928 => 4.5243, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0069, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4950, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: -1.19% (9.3358 => 9.2250, std.dev.: 0.0361) SingleSource/Benchmarks/Shootout/heapsort: -1.16% (3.9173 => 3.8717, std.dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2580, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 10 06:26:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 10 Oct 2012 08:26:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121010132637.5A88E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4762?compare_to=4758&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4762, Order: 165615, Start Time: 2012-10-10 12:08:40, End Time: 2012-10-10 13:28:26 To: 4758, Order: 165613, Start Time: 2012-10-10 09:13:43, End Time: 2012-10-10 10:33:23 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (158 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1024 (760 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.10% (2.1785 => 2.2024, std.dev.: 0.0018) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.03% (0.5913 => 0.5911, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 0.05% (16.3489 => 16.3574, std.dev.: 0.0239) MultiSource/Benchmarks/Bullet/bullet: -0.08% (55.3643 => 55.3190, std.dev.: 0.0491) MultiSource/Benchmarks/MallocBench/gs/gs: 0.16% (4.4104 => 4.4173, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.07% (1.2559 => 1.2550, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.27% (7.8494 => 7.8709, std.dev.: 0.0184) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.55% (0.7392 => 0.7433, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.55% (0.0364 => 0.0366, std.dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: - (0.1431 => 0.1431, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.30% (0.0666 => 0.0644, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -12.53% (63.2438 => 55.3190, std.dev.: 0.0491) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.84% (14.1553 => 18.8041, std.dev.: 0.0180) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.37% (3.4629 => 5.6573, std.dev.: 0.0051) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14226.81% (0.0720 => 10.3153, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952600.00% (0.0001 => 9.9527, std.dev.: 0.0013) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 62.49% (0.2554 => 0.4150, std.dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: 45.15% (10.3673 => 15.0480, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/richards_benchmark: 37.36% (0.1622 => 0.2228, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/distray/distray: 33.05% (0.1056 => 0.1405, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 17.53% (0.1432 => 0.1683, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.49% (7.0540 => 8.2876, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.48% (2.2022 => 2.5872, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.81% (0.1566 => 0.1798, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.47% (1.7609 => 1.9805, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.40% (0.0871 => 0.0979, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 11.85% (0.3282 => 0.3671, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.55% (0.1584 => 0.1767, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 11.32% (0.1440 => 0.1603, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 11.18% (10.4361 => 11.6031, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.01% (0.3543 => 0.3933, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.48% (0.3473 => 0.3837) SingleSource/UnitTests/ObjC/exceptions-3: 10.32% (0.3516 => 0.3879, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.22% (0.3561 => 0.3925, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.22% (0.3543 => 0.3905, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.18% (0.3497 => 0.3853, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 10.15% (0.7115 => 0.7837, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.08% (0.1438 => 0.1583, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.06% (0.4879 => 0.5370, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 10.03% (0.3927 => 0.4321, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.03% (0.3828 => 0.4212, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.96% (0.3694 => 0.4062, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 9.96% (0.7433 => 0.8173, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.94% (0.1117 => 0.1228, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/property: 9.86% (0.3886 => 0.4269, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.85% (0.3177 => 0.3490, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.80% (0.6675 => 0.7329, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 9.79% (0.1175 => 0.1290, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 9.72% (9.4845 => 10.4067, std.dev.: 0.0196) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.58% (1.5415 => 1.6891, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.37% (0.2700 => 0.2953, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.35% (0.1625 => 0.1777, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 9.24% (0.1655 => 0.1808, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.20% (0.2065 => 0.2255, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.12% (0.4615 => 0.5036, std.dev.: 0.0026) MultiSource/Applications/d/make_dparser: 9.10% (3.3354 => 3.6390, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 8.97% (0.3423 => 0.3730, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 8.97% (0.1695 => 0.1847, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 8.91% (0.3109 => 0.3386, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.76% (1.3050 => 1.4193, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.72% (0.5105 => 0.5550, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.71% (0.8067 => 0.8770, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.63% (0.2271 => 0.2467, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.60% (4.2646 => 4.6313, std.dev.: 0.0042) MultiSource/Applications/oggenc/oggenc: 8.57% (5.7591 => 6.2525, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.56% (5.0018 => 5.4300, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.53% (0.5860 => 0.6360, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.52% (8.1363 => 8.8295, std.dev.: 0.0017) MultiSource/Applications/hbd/hbd: 8.49% (1.5603 => 1.6928, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.46% (4.9449 => 5.3630, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/bigfib: 8.44% (0.6456 => 0.7001, std.dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.34% (0.1510 => 0.1636, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.33% (0.5569 => 0.6033, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.32% (0.3307 => 0.3582, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.25% (0.1236 => 0.1338, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.25% (0.8172 => 0.8846, std.dev.: 0.0066) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.23% (0.3121 => 0.3378, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.21% (0.2107 => 0.2280, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 8.15% (0.3387 => 0.3663, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 8.13% (1.1642 => 1.2588, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.11% (0.9765 => 1.0557, std.dev.: 0.0059) MultiSource/Applications/lua/lua: 8.07% (3.8723 => 4.1848, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.04% (0.1940 => 0.2096, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.03% (0.5020 => 0.5423, std.dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.02% (7.9617 => 8.6004, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.01% (0.2758 => 0.2979, std.dev.: 0.0046) SingleSource/UnitTests/ObjC++/Hello: 7.97% (0.5925 => 0.6397, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 7.91% (0.1555 => 0.1678, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference-object: 7.83% (0.6030 => 0.6502, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 7.82% (0.7835 => 0.8448, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.68% (0.4203 => 0.4526, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 7.66% (1.0722 => 1.1543, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.58% (0.4103 => 0.4414, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 7.58% (0.4289 => 0.4614, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 7.57% (0.3422 => 0.3681, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.55% (0.1337 => 0.1438, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 7.54% (0.2905 => 0.3124, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 7.49% (2.0273 => 2.1792, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.49% (1.5859 => 1.7047, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.48% (0.3865 => 0.4154, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.40% (0.4620 => 0.4962, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.28% (0.7326 => 0.7859, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 7.26% (0.3180 => 0.3411, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.21% (0.3441 => 0.3689, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.09% (1.1861 => 1.2702, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.07% (0.3650 => 0.3908, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 7.07% (0.4048 => 0.4334, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 7.01% (2.2969 => 2.4580, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.00% (0.3826 => 0.4094, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.99% (0.3603 => 0.3855, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 6.96% (21.9371 => 23.4637, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/lists1: 6.92% (0.3684 => 0.3939, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.92% (0.2603 => 0.2783, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.90% (0.4636 => 0.4956, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.85% (0.2891 => 0.3089, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.83% (0.3162 => 0.3378, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.73% (0.6450 => 0.6884, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.73% (0.3136 => 0.3347, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.71% (0.2831 => 0.3021, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/football/football: 6.66% (0.8921 => 0.9515, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.62% (0.2872 => 0.3062, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/matrix: 6.58% (0.3098 => 0.3302, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.58% (2.0665 => 2.2024, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: 6.53% (0.2877 => 0.3065, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.53% (0.2725 => 0.2903, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.51% (0.2871 => 0.3058, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.49% (0.2756 => 0.2935, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.47% (2.2024 => 2.3449, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 6.47% (0.4299 => 0.4577, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary: 6.47% (0.3232 => 0.3441, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.46% (0.3283 => 0.3495, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.45% (0.3052 => 0.3249, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.37% (0.5981 => 0.6362, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.22% (1.4186 => 1.5069, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/random: 6.21% (0.2802 => 0.2976, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 6.19% (0.2714 => 0.2882, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.12% (0.2793 => 0.2964, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 6.06% (1.1840 => 1.2557, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.02% (0.1695 => 0.1797, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.95% (0.3379 => 0.3580, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.61% (0.1906 => 0.2013, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.54% (0.4064 => 0.4289, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.43% (0.2266 => 0.2389, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (0.3131 => 0.3292, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.01% (0.8101 => 0.8507, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.73% (14.3668 => 15.0460, std.dev.: 0.0144) MultiSource/Applications/hexxagon/hexxagon: 4.57% (1.2842 => 1.3429, std.dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: 4.19% (17.1811 => 17.9005, std.dev.: 0.0191) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.00% (0.3427 => 0.3564, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.56% (3.8922 => 4.0306, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.16% (1.1194 => 1.1548, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.70% (0.3817 => 0.3920, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.22% (1.1145 => 1.3844, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.82% (1.1396 => 1.2515, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 9.20% (3.1595 => 3.4503, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.64% (3.1578 => 3.3676, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 3.68% (0.5413 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.57% (3.6395 => 3.7693, std.dev.: 0.0032) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.74% (4.2280 => 4.3437, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7650, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8125, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.16% (2.6546 => 2.6854, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.07% (6.5088 => 6.5784, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.98% (6.6874 => 0.1349, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: -80.09% (0.8651 => 0.1722, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.21% (5.2763 => 3.2602, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.45% (5.3855 => 3.6915, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.02% (5.3526 => 3.6924, std.dev.: 0.0021) SingleSource/UnitTests/Vector/constpool: -14.65% (54.1659 => 46.2287, std.dev.: 0.0310) MultiSource/Applications/ClamAV/clamscan: -10.75% (22.1758 => 19.7912, std.dev.: 0.0106) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.70% (2.9384 => 2.6241, std.dev.: 0.0183) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: -33.38% (1.1492 => 0.7656, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4247, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.83% (0.0998 => 0.0860, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.44% (1.2373 => 1.0957, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel-2: -10.32% (1.5373 => 1.3787, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/mason/mason: -9.90% (0.2161 => 0.1947, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.38% (19.9488 => 18.2764, std.dev.: 0.0313) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.75% (1.8329 => 1.7091, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.33% (1.6805 => 1.5910, std.dev.: 0.0048) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5085, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.01% (0.9957 => 0.9558, std.dev.: 0.0126) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.64% (3.2827 => 3.1633, std.dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4933, std.dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: -2.98% (12.4730 => 12.1008, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.13% (8.6802 => 8.4954, std.dev.: 0.0226) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.01% (8.1563 => 7.9923, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/salsa20: -1.90% (10.2830 => 10.0877, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6832, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5141, std.dev.: 0.0043) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4215, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: -1.13% (4.6441 => 4.5917, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8572, std.dev.: 0.0177) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.04% (0.5229 => 0.5911, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 9.13% (14.9895 => 16.3574, std.dev.: 0.0239) MultiSource/Benchmarks/MallocBench/gs/gs: 7.46% (4.1105 => 4.4173, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.60% (1.1048 => 1.2550, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.96% (7.1582 => 7.8709, std.dev.: 0.0184) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.46% (0.6222 => 0.7433, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36500.00% (0.0001 => 0.0366, std.dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.57% (0.2116 => 0.0644, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 10 07:32:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 10 Oct 2012 09:32:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121010143205.058662A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4763?compare_to=4760&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4763, Order: 165613, Start Time: 2012-10-10 11:49:59, End Time: 2012-10-10 14:33:54 To: 4760, Order: 165611, Start Time: 2012-10-10 08:37:14, End Time: 2012-10-10 11:20:55 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (135 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 1040 (828 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.30% (1.0246 => 1.0379, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.18% (54.1378 => 54.7753, std.dev.: 0.0864) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 11.34% (0.3465 => 0.3858, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 11.33% (0.3460 => 0.3852, std.dev.: 0.0081) SingleSource/UnitTests/ObjC/exceptions-2: 11.32% (0.3446 => 0.3836, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.30% (0.3488 => 0.3882, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 11.24% (0.3496 => 0.3889, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 11.21% (0.3442 => 0.3828, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 11.18% (0.3469 => 0.3857, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 11.12% (0.3650 => 0.4056, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions: 10.93% (0.3643 => 0.4041, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 10.82% (0.3724 => 0.4127, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.35% (0.1063 => 0.1173, std.dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 9.78% (1.5932 => 1.7490, std.dev.: 0.0084) MultiSource/Benchmarks/McCat/08-main/main: 8.95% (0.1218 => 0.1327, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 8.71% (0.1619 => 0.1760, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.26% (1.3152 => 1.4238, std.dev.: 0.0059) SingleSource/UnitTests/ObjC++/Hello: 8.24% (0.5826 => 0.6306, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.21% (0.4361 => 0.4719, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 8.20% (0.5889 => 0.6372, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.14% (1.6211 => 1.7530, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 7.77% (5.5417 => 5.9721, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.72% (0.1620 => 0.1745, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.58% (3.5627 => 3.8327, std.dev.: 0.0068) MultiSource/Benchmarks/PAQ8p/paq8p: 7.53% (0.4847 => 0.5212, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.50% (0.2014 => 0.2165, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.47% (0.4994 => 0.5367, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.42% (0.5000 => 0.5371, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.28% (0.5026 => 0.5392, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 7.25% (0.1421 => 0.1524, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 7.22% (0.3004 => 0.3221, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.20% (0.2875 => 0.3082, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 7.19% (0.2725 => 0.2921, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.16% (0.2792 => 0.2992, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 7.12% (1.0781 => 1.1549, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hello: 7.11% (0.2714 => 0.2907, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.10% (0.3195 => 0.3422, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.05% (0.2736 => 0.2929, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 7.03% (0.9697 => 1.0379, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 7.02% (0.6634 => 0.7100, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.02% (0.3930 => 0.4206, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.97% (0.1549 => 0.1657, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 6.96% (4.2109 => 4.5039, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/methcall: 6.93% (0.2813 => 0.3008, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.93% (0.2729 => 0.2918, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 6.91% (0.1505 => 0.1609, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 6.91% (0.2750 => 0.2940, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 6.89% (0.2803 => 0.2996, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 6.87% (0.7171 => 0.7664, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 6.86% (0.2566 => 0.2742, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.84% (0.3258 => 0.3481, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 6.84% (0.9909 => 1.0587, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.84% (0.1462 => 0.1562, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.84% (0.4139 => 0.4422, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.83% (0.2738 => 0.2925, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.80% (0.2780 => 0.2969, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.79% (0.2811 => 0.3002, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 6.77% (0.3678 => 0.3927, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.77% (0.2866 => 0.3060, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.76% (2.0673 => 2.2071, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/wc: 6.75% (0.3096 => 0.3305, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.74% (0.3903 => 0.4166, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 6.73% (0.2823 => 0.3013, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.73% (0.5900 => 0.6297, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.73% (0.3271 => 0.3491, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 6.70% (0.3477 => 0.3710, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 6.68% (0.3726 => 0.3975, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.66% (0.3124 => 0.3332, std.dev.: 0.0040) MultiSource/Applications/spiff/spiff: 6.65% (0.4029 => 0.4297, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 6.64% (0.3267 => 0.3484, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.63% (0.3890 => 0.4148, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 6.62% (1.8794 => 2.0039, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.60% (2.7292 => 2.9093, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.58% (0.3282 => 0.3498, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.57% (0.3625 => 0.3863, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.54% (0.3362 => 0.3582, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.54% (0.3317 => 0.3534, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.51% (0.3348 => 0.3566, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.50% (0.1968 => 0.2096, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.49% (0.2911 => 0.3100, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.41% (0.3981 => 0.4236, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 6.40% (1.4269 => 1.5182, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.39% (0.3084 => 0.3281, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.38% (4.4195 => 4.7015, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.37% (0.2969 => 0.3158, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.35% (0.4658 => 0.4954, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 6.32% (0.3336 => 0.3547, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.31% (0.3690 => 0.3923, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 6.30% (0.4251 => 0.4519, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.21% (0.2737 => 0.2907, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.20% (0.4146 => 0.4403, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.19% (0.2068 => 0.2196, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.18% (0.2103 => 0.2233, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 6.15% (0.5546 => 0.5887, std.dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 6.15% (4.6177 => 4.9016, std.dev.: 0.0115) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.13% (0.2040 => 0.2165, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.09% (0.6435 => 0.6827, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 6.07% (2.1013 => 2.2289, std.dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: 6.03% (23.5202 => 24.9393, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.01% (0.3845 => 0.4076, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.93% (0.7426 => 0.7866, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 5.92% (2.1653 => 2.2935, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 5.91% (0.5012 => 0.5308, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.75% (0.5361 => 0.5669, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 5.63% (0.7875 => 0.8318, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.51% (1.9694 => 2.0779, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: 5.50% (2.0346 => 2.1466, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 5.49% (0.2075 => 0.2189, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.41% (1.9966 => 2.1046, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 5.27% (0.2391 => 0.2517, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 5.02% (0.2691 => 0.2826, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.01% (0.5584 => 0.5864, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.71% (11.6398 => 12.1876, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.46% (4.6926 => 4.9020, std.dev.: 0.0101) MultiSource/Applications/lambda-0_1_3/lambda: 4.20% (0.3498 => 0.3645, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.43% (0.4253 => 0.4399, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 2.88% (11.9555 => 12.3004, std.dev.: 0.0111) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-1: 22.63% (6.2401 => 7.6525, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6113, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6765, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-2: 4.73% (1.8057 => 1.8911, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1647, std.dev.: 0.0652) SingleSource/Benchmarks/Dhrystone/dry: 4.20% (14.0481 => 14.6377, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/ary3: 2.09% (15.8721 => 16.2043, std.dev.: 0.0036) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5033, std.dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.69% (3.1722 => 3.2259, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2861, std.dev.: 0.0038) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5140, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.13% (1.0927 => 1.1051, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5791, std.dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.86% (25.4195 => 16.5576, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/ary2: -9.66% (0.2402 => 0.2170, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9740, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7943, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: -7.30% (2.1113 => 1.9571, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.7995, std.dev.: 0.0108) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.07% (0.6293 => 0.6100, std.dev.: 0.0019) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7732, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.53% (17.2379 => 16.8015, std.dev.: 0.0316) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8622, std.dev.: 0.0099) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5753, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -1.55% (5.5810 => 5.4943, std.dev.: 0.0075) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.15% (105.3826 => 104.1668, std.dev.: 0.0262) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0458, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 10 08:05:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 10 Oct 2012 10:05:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121010150520.241A32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4764?compare_to=4761&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4764, Order: 165617, Start Time: 2012-10-10 13:52:34, End Time: 2012-10-10 15:07:08 To: 4761, Order: 165615, Start Time: 2012-10-10 12:08:53, End Time: 2012-10-10 13:23:33 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (183 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1041 (753 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.23% (3.7980 => 3.7513, std.dev.: 0.0046) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.55% (2.0176 => 2.5130, std.dev.: 0.0062) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.37% (0.1410 => 0.1669, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 17.92% (0.0826 => 0.0974, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 16.23% (0.2243 => 0.2607, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 13.82% (0.1013 => 0.1153, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.52% (0.1413 => 0.1604, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.43% (0.0834 => 0.0946, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.94% (0.2721 => 0.3073, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 12.93% (0.7038 => 0.7948, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 12.92% (1.3693 => 1.5462, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.73% (3.9660 => 4.4709, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.51% (0.1327 => 0.1493, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.47% (0.1588 => 0.1786, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.34% (0.0964 => 0.1083, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.20% (1.4563 => 1.6339, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/hash2: 12.06% (0.4328 => 0.4850, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.03% (0.1072 => 0.1201) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.02% (0.2596 => 0.2908, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 11.91% (13.8202 => 15.4655, std.dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.84% (0.6283 => 0.7027, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.83% (0.9199 => 1.0287, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 11.69% (0.5818 => 0.6498, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.68% (1.2193 => 1.3617, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.67% (0.6959 => 0.7771, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.64% (0.5265 => 0.5878, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.57% (1.1364 => 1.2679, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 11.46% (0.5748 => 0.6407, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 11.40% (0.4062 => 0.4525, std.dev.: 0.0014) MultiSource/Applications/aha/aha: 11.39% (0.1062 => 0.1183) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.37% (0.7710 => 0.8587, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.15% (0.3130 => 0.3479, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 11.02% (0.7061 => 0.7839, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 10.99% (1.0313 => 1.1446, std.dev.: 0.0116) MultiSource/Benchmarks/Olden/power/power: 10.97% (0.1003 => 0.1113, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.95% (0.3899 => 0.4326, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.72% (0.1157 => 0.1281, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.67% (0.4791 => 0.5302, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.65% (0.5577 => 0.6171, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.65% (0.3485 => 0.3856, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 10.56% (1.1061 => 1.2229, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.56% (0.4016 => 0.4440, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 10.54% (0.2781 => 0.3074, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.42% (0.1075 => 0.1187, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 10.32% (0.2995 => 0.3304, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.26% (0.3489 => 0.3847, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.25% (0.3756 => 0.4141, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.17% (0.3246 => 0.3576, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.16% (0.4379 => 0.4824, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.16% (0.3022 => 0.3329, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 10.15% (16.6129 => 18.2998, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.14% (0.2782 => 0.3064, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 10.10% (0.6744 => 0.7425, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 10.08% (0.3293 => 0.3625, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.97% (0.2127 => 0.2339, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.95% (0.2914 => 0.3204, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 9.95% (0.8310 => 0.9137, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.94% (0.3580 => 0.3936, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 9.94% (0.1589 => 0.1747, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 9.88% (0.3220 => 0.3538, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 9.87% (1.9270 => 2.1172, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 9.80% (0.3868 => 0.4247, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 9.78% (0.2760 => 0.3030, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.78% (0.2966 => 0.3256, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.77% (0.5637 => 0.6188, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 9.76% (3.1889 => 3.5001, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.76% (0.1435 => 0.1575, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.75% (0.7460 => 0.8187, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 9.74% (0.2690 => 0.2952, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sieve: 9.73% (0.3453 => 0.3789, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 9.72% (0.1111 => 0.1219, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.72% (0.1276 => 0.1400) MultiSource/Applications/siod/siod: 9.71% (2.1791 => 2.3907, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 9.70% (0.2607 => 0.2860, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.70% (1.9828 => 2.1752, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.70% (0.8698 => 0.9542, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 9.69% (3.8646 => 4.2389, std.dev.: 0.0028) MultiSource/Applications/spiff/spiff: 9.65% (0.7506 => 0.8230, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 9.64% (0.2937 => 0.3220, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.62% (0.1986 => 0.2177, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.61% (0.4390 => 0.4812, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 9.61% (0.2726 => 0.2988, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.60% (0.2655 => 0.2910, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 9.60% (0.2761 => 0.3026, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 9.56% (1.0594 => 1.1607, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.55% (0.2765 => 0.3029, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 9.54% (0.3534 => 0.3871, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.50% (7.2180 => 7.9035, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.49% (0.1865 => 0.2042, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 9.47% (0.2628 => 0.2877, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 9.47% (0.2925 => 0.3202, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 9.46% (0.3149 => 0.3447, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 9.46% (0.3192 => 0.3494, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.37% (0.1569 => 0.1716, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 9.33% (0.3107 => 0.3397, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.29% (0.2023 => 0.2211, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.27% (0.2696 => 0.2946, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 9.24% (0.2988 => 0.3264, std.dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: 9.13% (0.1478 => 0.1613, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.96% (1.3245 => 1.4432, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.94% (4.9865 => 5.4324, std.dev.: 0.0138) MultiSource/Applications/SIBsim4/SIBsim4: 8.87% (1.2749 => 1.3880, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 8.87% (14.8535 => 16.1710, std.dev.: 0.0086) MultiSource/Benchmarks/sim/sim: 8.85% (0.3131 => 0.3408, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.84% (3.6692 => 3.9936, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/em3d/em3d: 8.81% (0.1657 => 0.1803, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.79% (0.6576 => 0.7154, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 8.76% (0.2945 => 0.3203) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.71% (0.3755 => 0.4082, std.dev.: 0.0122) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.66% (4.4433 => 4.8280, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.62% (4.3801 => 4.7577, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 8.47% (8.4961 => 9.2160, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.46% (0.3511 => 0.3808, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.32% (0.8818 => 0.9552, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.32% (0.2140 => 0.2318, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.28% (0.6135 => 0.6643, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.27% (0.1789 => 0.1937, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.18% (1.5188 => 1.6430, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 7.97% (4.6629 => 5.0345, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.91% (1.1333 => 1.2230, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/05-eks/eks: 7.88% (0.4113 => 0.4437, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.82% (3.2742 => 3.5303, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/neural/neural: 7.73% (0.1385 => 0.1492, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.72% (0.4805 => 0.5176, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.67% (0.9108 => 0.9807, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 7.62% (0.6250 => 0.6726, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 7.58% (6.5754 => 7.0738, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 7.52% (0.4003 => 0.4304, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.47% (0.2504 => 0.2691, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.38% (0.3914 => 0.4203, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 7.37% (0.2008 => 0.2156, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.34% (0.3940 => 0.4229, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.32% (2.1007 => 2.2544, std.dev.: 0.0023) MultiSource/Applications/lua/lua: 7.28% (3.7467 => 4.0193, std.dev.: 0.0092) SingleSource/UnitTests/ObjC/trivial-interface: 7.27% (0.3578 => 0.3838, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.18% (0.3789 => 0.4061, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.15% (0.3245 => 0.3477, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.13% (0.3646 => 0.3906, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 7.11% (0.3601 => 0.3857, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.07% (0.3663 => 0.3922, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.99% (0.3650 => 0.3905, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: 6.98% (0.3623 => 0.3876, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 6.96% (1.2292 => 1.3147, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.84% (13.2842 => 14.1930, std.dev.: 0.0149) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.54% (0.1819 => 0.1938, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.51% (6.2785 => 6.6870, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/ReedSolomon: 5.74% (0.1777 => 0.1879, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.35% (0.2243 => 0.2363, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 5.21% (16.2614 => 17.1093, std.dev.: 0.0111) MultiSource/Applications/ClamAV/clamscan: 4.49% (14.5298 => 15.1823, std.dev.: 0.0051) MultiSource/Benchmarks/Bullet/bullet: 1.51% (33.2944 => 33.7956, std.dev.: 0.0083) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5148, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/fbench: 24.28% (1.8175 => 2.2588, std.dev.: 0.0347) SingleSource/Benchmarks/Misc/richards_benchmark: 11.13% (1.1560 => 1.2847, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 9.03% (0.8273 => 0.9020, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 8.70% (0.1322 => 0.1437, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4141, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.21% (1.2998 => 1.3805, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0050, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6764, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9861, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.29% (10.7476 => 11.1013, std.dev.: 0.0202) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.21% (7.4271 => 7.5914, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.63% (1.4298 => 1.4531, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5125, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1870, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5780, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists: 1.11% (12.4560 => 12.5941, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0272, std.dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.85% (0.2670 => 0.1419, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.87% (0.4657 => 0.3918, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/mason/mason: -14.29% (0.0707 => 0.0606, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.11% (1.3819 => 1.2008, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.07% (1.3813 => 1.2008, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.57% (22.5627 => 22.2094, std.dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.33% (1.0460 => 0.8543, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.64% (0.0997 => 0.0861, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -12.24% (0.2238 => 0.1964, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.93% (1.2308 => 1.0963, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.06% (20.3410 => 18.2955, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.00% (1.3780 => 1.2953, std.dev.: 0.0079) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.07% (2.6470 => 2.5129, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.32% (0.9996 => 0.9564, std.dev.: 0.0075) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8001, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.41% (3.2729 => 3.1613, std.dev.: 0.0183) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.41% (1.7688 => 1.7085, std.dev.: 0.0042) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.96% (0.4867 => 0.4723, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -2.70% (26.5159 => 25.7999, std.dev.: 0.0453) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.36% (3.0263 => 2.9549, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.29% (1.9762 => 1.9309, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.94% (0.6589 => 0.6461, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7140, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/lists: -1.76% (6.3560 => 6.2440, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.56% (0.6615 => 0.6512) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0068, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8610, std.dev.: 0.0097) MultiSource/Applications/sqlite3/sqlite3: -1.43% (4.5928 => 4.5273, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: -1.20% (9.3358 => 9.2239, std.dev.: 0.0122) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.17% (2.5254 => 2.4959, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2565, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 10 08:15:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 10 Oct 2012 10:15:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121010151533.2633E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4765?compare_to=4762&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4765, Order: 165617, Start Time: 2012-10-10 13:57:40, End Time: 2012-10-10 15:17:22 To: 4762, Order: 165615, Start Time: 2012-10-10 12:08:40, End Time: 2012-10-10 13:28:26 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 4 (155 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1021 (763 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.93% (15.0480 => 15.3385, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.31% (3.6915 => 3.7398, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.20% (2.5872 => 2.6183, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.10% (3.6924 => 3.7329, std.dev.: 0.0049) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.37% (0.5911 => 0.5933, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: -0.14% (16.3574 => 16.3343, std.dev.: 0.0207) MultiSource/Benchmarks/Bullet/bullet: 0.06% (55.3190 => 55.3530, std.dev.: 0.0207) MultiSource/Benchmarks/MallocBench/gs/gs: -0.05% (4.4173 => 4.4151, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.31% (1.2550 => 1.2589, std.dev.: 0.0070) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.15% (7.8709 => 7.8592, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.17% (0.7433 => 0.7420, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.55% (0.0366 => 0.0364, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: - (0.1431 => 0.1431) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.16% (0.0644 => 0.0645, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -12.48% (63.2438 => 55.3530, std.dev.: 0.0207) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.97% (14.1553 => 18.8224, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.52% (3.4629 => 5.6625, std.dev.: 0.0050) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14235.83% (0.0720 => 10.3218, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9951800.00% (0.0001 => 9.9519, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.35% (0.2554 => 0.4172, std.dev.: 0.0024) MultiSource/Benchmarks/PAQ8p/paq8p: 47.95% (10.3673 => 15.3385, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/richards_benchmark: 39.83% (0.1622 => 0.2268, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/distray/distray: 33.33% (0.1056 => 0.1408, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.89% (2.2022 => 2.6183, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 18.72% (0.1432 => 0.1700, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.39% (7.0540 => 8.3509, std.dev.: 0.0074) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.01% (0.1566 => 0.1801, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 12.89% (0.3282 => 0.3705, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.28% (0.0871 => 0.0978, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.26% (1.7609 => 1.9767, std.dev.: 0.0030) MultiSource/Applications/JM/ldecod/ldecod: 11.95% (10.4361 => 11.6835, std.dev.: 0.0111) MultiSource/Benchmarks/Olden/power/power: 11.46% (0.1440 => 0.1605, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.36% (0.1584 => 0.1764, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.47% (0.3543 => 0.3914, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.31% (0.4879 => 0.5382, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 10.25% (0.7115 => 0.7844, std.dev.: 0.0127) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.10% (0.3177 => 0.3498, std.dev.: 0.0048) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.03% (0.3121 => 0.3434, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.94% (0.1438 => 0.1581, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 9.90% (0.3473 => 0.3817, std.dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: 9.89% (0.7433 => 0.8168, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-3: 9.81% (0.3516 => 0.3861, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 9.79% (9.4845 => 10.4126, std.dev.: 0.0107) SingleSource/UnitTests/ObjC/synchronized: 9.74% (0.3561 => 0.3908, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.74% (0.3543 => 0.3888, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.69% (0.3497 => 0.3836, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.67% (0.2700 => 0.2961, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.64% (0.3828 => 0.4197, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.63% (0.6675 => 0.7318, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.63% (0.3927 => 0.4305, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.60% (0.4615 => 0.5058, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 9.55% (0.3886 => 0.4257, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.47% (0.3694 => 0.4044, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.46% (1.5415 => 1.6874, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 9.39% (5.7591 => 6.3000, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/tsp/tsp: 9.36% (0.1175 => 0.1285, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.35% (0.1625 => 0.1777, std.dev.: 0.0022) MultiSource/Applications/d/make_dparser: 9.35% (3.3354 => 3.6472, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.23% (0.5105 => 0.5576, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/18-imp/imp: 9.14% (0.3423 => 0.3736, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 9.12% (0.1655 => 0.1806, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 8.78% (0.3109 => 0.3382, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.71% (0.5569 => 0.6054, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.70% (0.8172 => 0.8883, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.67% (0.5860 => 0.6368, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/em3d/em3d: 8.61% (0.1695 => 0.1841, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.59% (4.2646 => 4.6310, std.dev.: 0.0196) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.59% (0.8067 => 0.8760, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.59% (1.3050 => 1.4171, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.54% (0.2271 => 0.2465, std.dev.: 0.0029) MultiSource/Applications/hbd/hbd: 8.52% (1.5603 => 1.6932, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.51% (8.1363 => 8.8284, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.41% (4.9449 => 5.3610, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.41% (0.1510 => 0.1637, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 8.39% (0.3387 => 0.3671, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.38% (5.0018 => 5.4209, std.dev.: 0.0056) MultiSource/Applications/spiff/spiff: 8.32% (0.7835 => 0.8487, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.20% (0.1940 => 0.2099, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.18% (0.2065 => 0.2234, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.16% (0.2107 => 0.2279, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: 8.11% (1.1642 => 1.2586, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.10% (0.3307 => 0.3575, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.08% (0.1337 => 0.1445, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 8.06% (3.8723 => 4.1843, std.dev.: 0.0136) SingleSource/Benchmarks/Misc-C++/bigfib: 8.02% (0.6456 => 0.6974, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.02% (0.9765 => 1.0548, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.95% (0.5020 => 0.5419, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.90% (0.2758 => 0.2976, std.dev.: 0.0034) MultiSource/Applications/viterbi/viterbi: 7.72% (0.1555 => 0.1675, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: 7.67% (1.0722 => 1.1544, std.dev.: 0.0051) SingleSource/UnitTests/ObjC++/Hello: 7.61% (0.5925 => 0.6376, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.58% (7.9617 => 8.5653, std.dev.: 0.0111) SingleSource/UnitTests/ObjC++/property-reference-object: 7.58% (0.6030 => 0.6487, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 7.50% (2.0273 => 2.1793, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.48% (1.5859 => 1.7045, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.38% (0.4203 => 0.4513, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.32% (0.4289 => 0.4603, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 7.29% (21.9371 => 23.5371, std.dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.24% (0.4103 => 0.4400, std.dev.: 0.0090) MultiSource/Benchmarks/McCat/09-vor/vor: 7.20% (0.3180 => 0.3409, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.16% (0.4636 => 0.4968, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.16% (1.1861 => 1.2710, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.12% (0.3441 => 0.3686, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.12% (0.3865 => 0.4140, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 7.04% (0.3422 => 0.3663, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: 6.99% (0.4620 => 0.4943, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 6.99% (0.7326 => 0.7838, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 6.93% (2.2969 => 2.4561, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.82% (0.3650 => 0.3899, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.79% (0.4048 => 0.4323, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.78% (0.2905 => 0.3102, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.76% (0.2603 => 0.2779, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 6.72% (0.3603 => 0.3845, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 6.67% (0.8921 => 0.9516, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.66% (0.3826 => 0.4081, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.65% (0.6450 => 0.6879, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.57% (0.3136 => 0.3342, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.49% (2.2024 => 2.3454, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.45% (0.5981 => 0.6367, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.42% (0.3162 => 0.3365, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 6.35% (0.3684 => 0.3918, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.30% (0.2891 => 0.3073, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.26% (1.1840 => 1.2581, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/strcat: 6.22% (0.2831 => 0.3007, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.19% (2.0665 => 2.1945, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 6.19% (0.4299 => 0.4565, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.14% (0.1695 => 0.1799, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.13% (0.2871 => 0.3047, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.02% (0.2872 => 0.3045, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.00% (0.3232 => 0.3426, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 5.97% (0.3283 => 0.3479, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.94% (0.2725 => 0.2887, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 5.94% (0.3098 => 0.3282, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.94% (1.4186 => 1.5028, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.91% (0.2756 => 0.2919, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 5.91% (0.2877 => 0.3047, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.90% (0.2714 => 0.2874, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/wc: 5.83% (0.3052 => 0.3230, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.80% (0.2793 => 0.2955, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 5.64% (0.2802 => 0.2960, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.51% (0.1906 => 0.2011, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary2: 5.42% (0.3379 => 0.3562, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.25% (14.3668 => 15.1215, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.25% (0.2266 => 0.2385, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.22% (0.4064 => 0.4276, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.95% (0.8101 => 0.8502, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/objinst: 4.69% (0.3131 => 0.3278, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 4.31% (17.1811 => 17.9223, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.26% (0.3427 => 0.3573, std.dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 4.24% (1.2842 => 1.3386, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.57% (3.8922 => 4.0312, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.89% (1.1194 => 1.1518, std.dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.74% (2.6778 => 2.9653, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.84% (1.1396 => 1.2517, std.dev.: 0.0014) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560) MultiSource/Applications/aha/aha: 9.23% (3.1595 => 3.4510, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.1578 => 3.3686, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 3.68% (0.5413 => 0.5612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.63% (3.6395 => 3.7716, std.dev.: 0.0019) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.76% (4.2280 => 4.3445, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7652, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8133, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.46% (0.9540 => 0.9679, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.10% (2.6546 => 2.6838, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.09% (6.5088 => 6.5796, std.dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1310, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -80.11% (0.8651 => 0.1721, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.20% (5.2763 => 3.2606, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.56% (5.3855 => 3.7398, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.26% (5.3526 => 3.7329, std.dev.: 0.0049) SingleSource/UnitTests/Vector/constpool: -14.61% (54.1659 => 46.2528, std.dev.: 0.0315) MultiSource/Applications/ClamAV/clamscan: -10.68% (22.1758 => 19.8081, std.dev.: 0.0159) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.29% (2.9384 => 2.6359, std.dev.: 0.0155) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.34% (1.1492 => 0.7661, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.90% (1.6925 => 1.4234, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.63% (0.0998 => 0.0862, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.23% (1.2373 => 1.0983, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel-2: -10.31% (1.5373 => 1.3788, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/mason/mason: -10.18% (0.2161 => 0.1941, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.42% (19.9488 => 18.2695, std.dev.: 0.0162) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.66% (1.8329 => 1.7108, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.27% (1.6805 => 1.5920, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.91% (1.5835 => 1.5058, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.35% (0.9957 => 0.9524, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.70% (3.2827 => 3.1611, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.4990, std.dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: -3.02% (12.4730 => 12.0966, std.dev.: 0.0024) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.92% (8.1563 => 7.9995, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.87% (8.6802 => 8.5179, std.dev.: 0.0104) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6836, std.dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.65% (2.5528 => 2.5106, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/salsa20: -1.62% (10.2830 => 10.1169, std.dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4202, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -1.15% (4.6441 => 4.5909, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8574, std.dev.: 0.0005) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.46% (0.5229 => 0.5933, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 8.97% (14.9895 => 16.3343, std.dev.: 0.0207) MultiSource/Benchmarks/MallocBench/gs/gs: 7.41% (4.1105 => 4.4151, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.95% (1.1048 => 1.2589, std.dev.: 0.0070) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.79% (7.1582 => 7.8592, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.25% (0.6222 => 0.7420, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36300.00% (0.0001 => 0.0364, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.52% (0.2116 => 0.0645, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 10 09:49:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 10 Oct 2012 11:49:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121010164911.15DC32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4766?compare_to=4764&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4766, Order: 165620, Start Time: 2012-10-10 15:36:12, End Time: 2012-10-10 16:50:55 To: 4764, Order: 165617, Start Time: 2012-10-10 13:52:34, End Time: 2012-10-10 15:07:08 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (186 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1041 (750 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.35% (80.1673 => 81.2505, std.dev.: 0.3969) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.54% (2.0176 => 2.5127, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.30% (0.1410 => 0.1668, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 17.92% (0.0826 => 0.0974) MultiSource/Benchmarks/McCat/08-main/main: 16.05% (0.2243 => 0.2603, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 13.82% (0.1013 => 0.1153, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.59% (0.1413 => 0.1605, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.43% (0.0834 => 0.0946, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 12.94% (0.7038 => 0.7949, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 12.93% (1.3693 => 1.5464, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.83% (0.2721 => 0.3070, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.68% (3.9660 => 4.4687, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.66% (0.1327 => 0.1495, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.34% (0.1588 => 0.1784, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.24% (0.0964 => 0.1082, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.20% (1.4563 => 1.6340, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 12.11% (0.4328 => 0.4852, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 12.05% (13.8202 => 15.4851, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.95% (0.9199 => 1.0298, std.dev.: 0.0067) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.94% (0.1072 => 0.1200, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.90% (0.2596 => 0.2905, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.79% (0.6283 => 0.7024, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.78% (0.5265 => 0.5885, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 11.72% (0.5818 => 0.6500, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.71% (0.6959 => 0.7774, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.66% (1.2193 => 1.3615, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.63% (0.7710 => 0.8607, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.56% (1.1364 => 1.2678, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 11.49% (0.1062 => 0.1184, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 11.41% (0.5748 => 0.6404, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 11.40% (0.4062 => 0.4525, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.02% (0.3130 => 0.3475, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 10.97% (0.1003 => 0.1113) MultiSource/Applications/lemon/lemon: 10.97% (1.0313 => 1.1444, std.dev.: 0.0140) SingleSource/UnitTests/ObjC++/property-reference: 10.96% (0.7061 => 0.7835, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.93% (0.3899 => 0.4325, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.69% (0.4791 => 0.5303, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.65% (0.5577 => 0.6171, std.dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: 10.64% (0.2781 => 0.3077, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.59% (0.3485 => 0.3854, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 10.57% (1.1061 => 1.2230, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.55% (0.4379 => 0.4841, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.54% (0.1157 => 0.1279, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.51% (0.4016 => 0.4438, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.34% (0.0977 => 0.1078) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.33% (0.1075 => 0.1186, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 10.28% (0.2995 => 0.3303, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.25% (0.4390 => 0.4840, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.25% (0.3756 => 0.4141, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 10.23% (0.6744 => 0.7434, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 10.22% (16.6129 => 18.3110, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.21% (0.2782 => 0.3066, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.20% (0.3489 => 0.3845, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 10.17% (0.3293 => 0.3628, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.14% (0.3246 => 0.3575, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.03% (0.3022 => 0.3325, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 10.01% (0.1589 => 0.1748, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.94% (0.3580 => 0.3936, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 9.91% (2.1791 => 2.3951, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/mst/mst: 9.90% (0.1111 => 0.1221, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.87% (0.2127 => 0.2337, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 9.85% (1.9270 => 2.1169, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/18-imp/imp: 9.84% (0.3220 => 0.3537, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.83% (0.5637 => 0.6191, std.dev.: 0.0031) MultiSource/Applications/d/make_dparser: 9.83% (3.1889 => 3.5023, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 9.81% (0.8310 => 0.9125, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/except: 9.78% (0.2760 => 0.3030, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.78% (0.2914 => 0.3199, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.78% (0.2966 => 0.3256, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.77% (0.1986 => 0.2180, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.73% (0.7460 => 0.8186, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.73% (0.2765 => 0.3034, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 9.72% (0.3868 => 0.4244, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.72% (0.1276 => 0.1400, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.72% (0.2655 => 0.2913, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 9.70% (0.2690 => 0.2951, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.69% (0.8698 => 0.9541, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 9.68% (0.2726 => 0.2990, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.67% (1.9828 => 2.1746, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: 9.67% (0.3453 => 0.3787, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 9.67% (0.2607 => 0.2859, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/gs/gs: 9.65% (3.8646 => 4.2376, std.dev.: 0.0039) MultiSource/Applications/spiff/spiff: 9.63% (0.7506 => 0.8229, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.62% (0.1435 => 0.1573, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 9.55% (1.0594 => 1.1606, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/fibo: 9.55% (0.2628 => 0.2879, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 9.54% (0.3534 => 0.3871, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 9.53% (0.2937 => 0.3217, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 9.53% (0.2761 => 0.3024, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 9.50% (0.3149 => 0.3448, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.48% (7.2180 => 7.9026, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/matrix: 9.47% (0.2988 => 0.3271, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 9.44% (0.2925 => 0.3201, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.39% (0.2023 => 0.2213, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 9.33% (0.3107 => 0.3397, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.31% (0.1569 => 0.1715, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.28% (0.1865 => 0.2038, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary2: 9.24% (0.3192 => 0.3487, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 9.20% (0.1478 => 0.1614, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.17% (0.6576 => 0.7179, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.12% (0.2696 => 0.2942, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.95% (1.3245 => 1.4430, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.90% (4.9865 => 5.4301, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.89% (0.3755 => 0.4089, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 8.88% (0.3131 => 0.3409, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 8.83% (1.2749 => 1.3875, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.81% (3.6692 => 3.9924, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 8.77% (14.8535 => 16.1555, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/objinst: 8.73% (0.2945 => 0.3202, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 8.63% (0.1657 => 0.1800, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.60% (4.3801 => 4.7566, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.59% (4.4433 => 4.8252, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.49% (0.3511 => 0.3809, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 8.44% (8.4961 => 9.2130, std.dev.: 0.0127) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.36% (0.2140 => 0.2319, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.29% (0.8818 => 0.9549, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.26% (0.6135 => 0.6642, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.16% (0.1789 => 0.1935, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.14% (1.5188 => 1.6424, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 7.96% (4.6629 => 5.0340, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.89% (1.1333 => 1.2227, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.85% (3.2742 => 3.5313, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.85% (0.4805 => 0.5182, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 7.80% (0.4113 => 0.4434, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.65% (0.9108 => 0.9805, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 7.65% (0.6250 => 0.6728, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.63% (0.2321 => 0.2498, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: 7.58% (0.1385 => 0.1490, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 7.55% (6.5754 => 7.0717, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/parameter-passing: 7.52% (0.4003 => 0.4304, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.41% (0.3914 => 0.4204, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.35% (0.2504 => 0.2688, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.34% (2.1007 => 2.2549, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 7.32% (3.7467 => 4.0211, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/property: 7.31% (0.3940 => 0.4228, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 7.30% (0.3646 => 0.3912, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.29% (0.3578 => 0.3839, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.28% (0.3601 => 0.3863, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 7.27% (0.2008 => 0.2154, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.18% (0.3245 => 0.3478, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 7.18% (0.3789 => 0.4061, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.07% (0.3663 => 0.3922, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 7.05% (1.2292 => 1.3159, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.99% (0.3650 => 0.3905, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.98% (0.3623 => 0.3876, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.82% (13.2842 => 14.1905, std.dev.: 0.0095) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.68% (6.2785 => 6.6978, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.54% (0.1819 => 0.1938, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: 5.68% (0.1777 => 0.1878, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.39% (0.2243 => 0.2364, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 5.10% (16.2614 => 17.0901, std.dev.: 0.0056) MultiSource/Applications/ClamAV/clamscan: 4.52% (14.5298 => 15.1868, std.dev.: 0.0041) MultiSource/Benchmarks/Bullet/bullet: 1.41% (33.2944 => 33.7653, std.dev.: 0.0177) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/methcall: 30.32% (5.7573 => 7.5031, std.dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.11% (1.8175 => 2.2557, std.dev.: 0.0495) SingleSource/Benchmarks/Misc/richards_benchmark: 10.98% (1.1560 => 1.2829, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.03% (0.8273 => 0.9020, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4139, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.25% (1.2998 => 1.3811, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0037, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6759, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9849, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 3.31% (10.7476 => 11.1030, std.dev.: 0.0111) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.17% (7.4271 => 7.5886, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4540, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5132, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1866, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.20% (5.5130 => 5.5789, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0276, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 1.02% (12.4560 => 12.5833, std.dev.: 0.0090) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.89% (0.2670 => 0.1418, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.89% (0.4657 => 0.3917, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -14.14% (0.0707 => 0.0607, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.15% (1.3813 => 1.1996, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.11% (1.3819 => 1.2007, std.dev.: 0.0070) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.53% (22.5627 => 22.2165, std.dev.: 0.0088) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.11% (0.2238 => 0.1967, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.86% (1.2308 => 1.0971, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.18% (20.3410 => 18.2705, std.dev.: 0.0129) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.20% (1.3780 => 1.3064, std.dev.: 0.0103) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5149, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.71% (0.9996 => 0.9525, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0011) MultiSource/Applications/siod/siod: -3.55% (3.2729 => 3.1567, std.dev.: 0.0072) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.43% (1.7688 => 1.7081, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.18% (0.4867 => 0.4712, std.dev.: 0.0006) MultiSource/Applications/lua/lua: -2.57% (26.5159 => 25.8333, std.dev.: 0.0350) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.43% (3.0263 => 2.9529, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: -2.36% (1.9762 => 1.9296, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.96% (0.6589 => 0.6460, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.82% (6.3560 => 6.2406, std.dev.: 0.0056) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7152, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: -1.44% (4.5928 => 4.5265, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0080) SingleSource/Benchmarks/Shootout/heapsort: -1.23% (3.9173 => 3.8691, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4953, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.16% (9.3358 => 9.2272, std.dev.: 0.0186) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2582, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 10 10:04:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 10 Oct 2012 12:04:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121010170420.8054C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4767?compare_to=4765&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4767, Order: 165620, Start Time: 2012-10-10 15:46:36, End Time: 2012-10-10 17:06:05 To: 4765, Order: 165617, Start Time: 2012-10-10 13:57:40, End Time: 2012-10-10 15:17:22 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (159 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1024 (758 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.25% (55.8043 => 56.5025, std.dev.: 0.0789) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.15% (0.5933 => 0.5924, std.dev.: 0.0106) MultiSource/Applications/SPASS/SPASS: 0.07% (16.3343 => 16.3457, std.dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: 0.02% (55.3530 => 55.3641, std.dev.: 0.0116) MultiSource/Benchmarks/MallocBench/gs/gs: -0.04% (4.4151 => 4.4135, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.19% (1.2589 => 1.2565, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.05% (7.8592 => 7.8630, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.04% (0.7420 => 0.7423, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.27% (0.0364 => 0.0363, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: - (0.1431 => 0.1431) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0645 => 0.0645, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -12.46% (63.2438 => 55.3641, std.dev.: 0.0116) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 33.03% (14.1553 => 18.8314, std.dev.: 0.0184) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.63% (3.4629 => 5.6664, std.dev.: 0.0135) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14221.94% (0.0720 => 10.3118, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952100.00% (0.0001 => 9.9522, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.55% (0.2554 => 0.4177, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 48.04% (10.3673 => 15.3482, std.dev.: 0.0173) SingleSource/Benchmarks/Misc/richards_benchmark: 39.95% (0.1622 => 0.2270) MultiSource/Benchmarks/FreeBench/distray/distray: 33.43% (0.1056 => 0.1409, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.89% (2.2022 => 2.6182, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 18.72% (0.1432 => 0.1700, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.40% (7.0540 => 8.3518, std.dev.: 0.0064) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.88% (0.1566 => 0.1799, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 13.04% (0.3282 => 0.3710, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.40% (0.0871 => 0.0979, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.27% (1.7609 => 1.9770, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.06% (0.1625 => 0.1821, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 11.88% (10.4361 => 11.6760, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/power/power: 11.60% (0.1440 => 0.1607, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.43% (0.1584 => 0.1765, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.61% (0.3543 => 0.3919, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.33% (0.4879 => 0.5383, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 10.20% (0.7433 => 0.8191, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 10.16% (0.7115 => 0.7838, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.02% (0.3473 => 0.3821, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.95% (0.3177 => 0.3493, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-4: 9.88% (0.3543 => 0.3893, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.81% (0.1438 => 0.1579, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.80% (0.3561 => 0.3910, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.78% (0.3516 => 0.3860, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.78% (0.3497 => 0.3839, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.78% (0.2700 => 0.2964, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.75% (0.3927 => 0.4310, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.72% (1.5415 => 1.6913, std.dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: 9.66% (9.4845 => 10.4011, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.65% (0.6675 => 0.7319, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.64% (0.3828 => 0.4197, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.58% (0.3694 => 0.4048, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 9.53% (0.1175 => 0.1287, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 9.50% (5.7591 => 6.3064, std.dev.: 0.0063) SingleSource/UnitTests/ObjC/property: 9.50% (0.3886 => 0.4255, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 9.43% (3.3354 => 3.6498, std.dev.: 0.0192) SingleSource/Benchmarks/McGill/chomp: 9.18% (0.1655 => 0.1807, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 9.11% (0.3423 => 0.3735, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 9.09% (0.1695 => 0.1849, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 8.91% (0.3109 => 0.3386, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.85% (0.5105 => 0.5557, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.84% (0.4615 => 0.5023, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.75% (1.3050 => 1.4192, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.74% (4.2646 => 4.6373, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.72% (0.2271 => 0.2469, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.58% (0.8172 => 0.8873, std.dev.: 0.0028) MultiSource/Applications/hbd/hbd: 8.56% (1.5603 => 1.6939, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.56% (5.0018 => 5.4299, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.55% (0.5860 => 0.6361, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.54% (0.1510 => 0.1639, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.50% (8.1363 => 8.8278, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.44% (4.9449 => 5.3624, std.dev.: 0.0041) MultiSource/Benchmarks/sim/sim: 8.41% (0.3387 => 0.3672, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.40% (0.2107 => 0.2284, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.37% (0.5569 => 0.6035, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.34% (0.8067 => 0.8740, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: 8.33% (1.1642 => 1.2612, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.26% (0.3307 => 0.3580, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.25% (0.1236 => 0.1338, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 8.20% (3.8723 => 4.1897, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.18% (0.9765 => 1.0564, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.14% (0.1940 => 0.2098, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.09% (0.2065 => 0.2232, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.08% (0.1337 => 0.1445, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/bigfib: 8.04% (0.6456 => 0.6975, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 8.02% (0.7835 => 0.8463, std.dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.01% (0.3121 => 0.3371, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.98% (0.2758 => 0.2978, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.95% (0.4103 => 0.4429, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 7.82% (1.0722 => 1.1560, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 7.78% (0.1555 => 0.1676, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.73% (0.5020 => 0.5408, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 7.68% (0.6030 => 0.6493, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 7.64% (2.0273 => 2.1822, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.61% (7.9617 => 8.5673, std.dev.: 0.0072) SingleSource/UnitTests/ObjC++/Hello: 7.58% (0.5925 => 0.6374, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.56% (1.5859 => 1.7058, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.52% (0.4203 => 0.4519, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.38% (0.3441 => 0.3695, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 7.35% (21.9371 => 23.5492, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.34% (0.3826 => 0.4107, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 7.34% (0.4289 => 0.4604, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 7.26% (0.3180 => 0.3411, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.23% (0.4636 => 0.4971, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.22% (1.1861 => 1.2717, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.21% (0.3136 => 0.3362, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 7.16% (0.3422 => 0.3667, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.14% (0.3865 => 0.4141, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 7.09% (2.2969 => 2.4597, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 7.00% (0.7326 => 0.7839, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 6.97% (0.4620 => 0.4942, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.87% (0.4048 => 0.4326, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.82% (0.3650 => 0.3899, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.82% (0.2905 => 0.3103, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.81% (0.6450 => 0.6889, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.80% (0.2603 => 0.2780, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 6.75% (0.8921 => 0.9523, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.69% (0.3603 => 0.3844, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.60% (2.2024 => 2.3478, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.55% (0.3162 => 0.3369, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.50% (0.2891 => 0.3079, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 6.49% (0.4299 => 0.4578, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.45% (0.5981 => 0.6367, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.41% (0.3684 => 0.3920, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.26% (2.0665 => 2.1959, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.22% (0.2831 => 0.3007, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.19% (0.1695 => 0.1800, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.16% (0.2872 => 0.3049, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary: 6.10% (0.3232 => 0.3429, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.07% (1.4186 => 1.5047, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.07% (0.3098 => 0.3286, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.05% (0.2877 => 0.3051, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.03% (0.3283 => 0.3481, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.03% (1.1840 => 1.2554, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/except: 6.03% (0.2871 => 0.3044, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.97% (0.2714 => 0.2876, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.95% (0.2756 => 0.2920, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wc: 5.93% (0.3052 => 0.3233, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.83% (0.2725 => 0.2884, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.73% (0.2793 => 0.2953, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.67% (0.2802 => 0.2961, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.61% (0.1906 => 0.2013, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.47% (0.3379 => 0.3564, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.39% (0.1892 => 0.1994, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.38% (0.2266 => 0.2388, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.24% (0.4064 => 0.4277, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.10% (14.3668 => 15.0997, std.dev.: 0.0130) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.96% (0.8101 => 0.8503, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: 4.88% (0.2049 => 0.2149, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.79% (0.3131 => 0.3281, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.38% (1.2842 => 1.3405, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 4.36% (17.1811 => 17.9304, std.dev.: 0.0310) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.26% (0.3427 => 0.3573, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.24% (0.2430 => 0.2533, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.66% (3.8922 => 4.0346, std.dev.: 0.0143) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.85% (1.1194 => 1.1513, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 10.04% (1.1396 => 1.2540, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.92% (0.1421 => 0.1562, std.dev.: 0.0019) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4498, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3690, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 3.71% (0.5413 => 0.5614, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.57% (3.6395 => 3.7693, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.64% (4.2280 => 4.3397, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7651, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.47% (0.9540 => 0.9680, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8136, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.20% (2.6546 => 2.6865, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.12% (6.5088 => 6.5817, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1311, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.11% (0.8651 => 0.1721, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.22% (5.2763 => 3.2598, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.57% (5.3855 => 3.7391, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.18% (5.3526 => 3.7372, std.dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -14.68% (54.1659 => 46.2125, std.dev.: 0.0187) MultiSource/Applications/ClamAV/clamscan: -10.67% (22.1758 => 19.8107, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.30% (2.9384 => 2.6357, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.50% (1.1492 => 0.7642, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: -15.98% (1.6925 => 1.4221, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.73% (0.0998 => 0.0861, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -12.32% (1.2373 => 1.0849, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/mandel-2: -10.30% (1.5373 => 1.3789, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/mason/mason: -10.00% (0.2161 => 0.1945, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.21% (19.9488 => 18.3117, std.dev.: 0.0697) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.72% (1.8329 => 1.7097, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.28% (1.6805 => 1.5918, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7962, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5082, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.32% (0.9957 => 0.9527, std.dev.: 0.0118) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.71% (3.2827 => 3.1610, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4953, std.dev.: 0.0083) MultiSource/Applications/hexxagon/hexxagon: -2.99% (12.4730 => 12.1002, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.95% (10.2830 => 10.0829, std.dev.: 0.0227) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.94% (8.6802 => 8.5121, std.dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.74% (8.1563 => 8.0147, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6817, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.56% (2.5528 => 2.5130, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4206, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout/lists: -1.13% (6.2999 => 6.2288, std.dev.: 0.0071) MultiSource/Applications/sqlite3/sqlite3: -1.10% (4.6441 => 4.5932, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8571, std.dev.: 0.0122) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.29% (0.5229 => 0.5924, std.dev.: 0.0106) MultiSource/Applications/SPASS/SPASS: 9.05% (14.9895 => 16.3457, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 7.37% (4.1105 => 4.4135, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.73% (1.1048 => 1.2565, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.85% (7.1582 => 7.8630, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.30% (0.6222 => 0.7423, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36200.00% (0.0001 => 0.0363, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.52% (0.2116 => 0.0645, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 10 10:44:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 10 Oct 2012 12:44:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121010174451.E65BB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4768?compare_to=4763&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4768, Order: 165620, Start Time: 2012-10-10 15:03:00, End Time: 2012-10-10 17:46:41 To: 4763, Order: 165613, Start Time: 2012-10-10 11:49:59, End Time: 2012-10-10 14:33:54 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (136 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 1041 (827 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.28% (2.0426 => 2.1096, std.dev.: 0.0117) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 11.26% (0.3446 => 0.3834, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.23% (0.3465 => 0.3854, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.21% (0.3496 => 0.3888, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.21% (0.3488 => 0.3879, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 11.13% (0.3442 => 0.3825, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.13% (0.3469 => 0.3855, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.10% (0.3460 => 0.3844, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.99% (0.3650 => 0.4051, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.87% (0.3643 => 0.4039, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.77% (0.3724 => 0.4125, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.16% (0.1063 => 0.1171, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 9.03% (0.1218 => 0.1328, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 8.99% (1.5932 => 1.7365, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 8.88% (0.5889 => 0.6412, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.82% (0.5826 => 0.6340, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 8.65% (0.1619 => 0.1759, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.26% (1.3152 => 1.4239, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.21% (1.6211 => 1.7542, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.18% (0.2738 => 0.2962, std.dev.: 0.0060) SingleSource/Regression/C++/ofstream_ctor: 8.12% (0.3004 => 0.3248, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.00% (0.4361 => 0.4710, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.90% (0.2875 => 0.3102, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 7.87% (0.9909 => 1.0689, std.dev.: 0.0085) MultiSource/Applications/SPASS/SPASS: 7.78% (5.5417 => 5.9728, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.77% (0.4994 => 0.5382, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: 7.74% (0.4847 => 0.5222, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.72% (0.1620 => 0.1745, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.70% (0.5000 => 0.5385, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.67% (0.3195 => 0.3440, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 7.60% (0.7171 => 0.7716, std.dev.: 0.0075) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.60% (0.2014 => 0.2167, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.59% (0.3625 => 0.3900, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.56% (3.5627 => 3.8320, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.45% (0.2792 => 0.3000, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 7.41% (0.2780 => 0.2986, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 7.36% (0.2811 => 0.3018, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.32% (0.5026 => 0.5394, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 7.31% (0.2750 => 0.2951, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 7.30% (0.2714 => 0.2912, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.27% (0.2725 => 0.2923, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.26% (0.2729 => 0.2927, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.25% (0.2813 => 0.3017, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 7.24% (0.1505 => 0.1614, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 7.24% (0.2803 => 0.3006, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.24% (0.5900 => 0.6327, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.23% (0.3362 => 0.3605, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.22% (2.0673 => 2.2165, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/objinst: 7.19% (0.2823 => 0.3026, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 7.18% (0.1421 => 0.1523, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 7.15% (0.3678 => 0.3941, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.15% (0.3930 => 0.4211, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.15% (0.3903 => 0.4182, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.15% (0.2911 => 0.3119, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.09% (0.3060 => 0.3277, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.09% (0.4146 => 0.4440, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.07% (0.3267 => 0.3498, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.07% (0.3282 => 0.3514, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.06% (0.3258 => 0.3488, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 7.04% (0.3336 => 0.3571, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 7.04% (4.2109 => 4.5072, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.02% (0.2736 => 0.2928, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 7.01% (0.3096 => 0.3313, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists: 6.99% (0.3348 => 0.3582, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.99% (0.3477 => 0.3720, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 6.98% (0.3726 => 0.3986, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.97% (0.1549 => 0.1657, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.97% (2.7292 => 2.9193, std.dev.: 0.0061) MultiSource/Applications/spiff/spiff: 6.95% (0.4029 => 0.4309, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 6.92% (0.6634 => 0.7093, std.dev.: 0.0017) MultiSource/Applications/d/make_dparser: 6.90% (1.0781 => 1.1525, std.dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 6.90% (0.2566 => 0.2743, std.dev.: 0.0020) MultiSource/Applications/hbd/hbd: 6.89% (0.9697 => 1.0365, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.86% (0.3690 => 0.3943, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.84% (0.2866 => 0.3062, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.82% (0.3124 => 0.3337, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.81% (0.3317 => 0.3543, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.81% (0.4139 => 0.4421, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.81% (0.3890 => 0.4155, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.79% (0.3845 => 0.4106, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.72% (0.2068 => 0.2207, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.70% (0.6435 => 0.6866, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 6.68% (23.5202 => 25.0925, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.66% (0.3271 => 0.3489, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.65% (4.4195 => 4.7135, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.65% (0.2737 => 0.2919, std.dev.: 0.0025) MultiSource/Applications/lua/lua: 6.64% (1.4269 => 1.5216, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.61% (0.3084 => 0.3288, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 6.61% (1.8794 => 2.0037, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash2: 6.59% (0.4251 => 0.4531, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.53% (0.3981 => 0.4241, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.45% (0.1968 => 0.2095, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.43% (0.2969 => 0.3160, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.31% (0.4658 => 0.4952, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 6.29% (0.5546 => 0.5895, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 6.23% (0.5012 => 0.5324, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.11% (0.7426 => 0.7880, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 6.04% (4.6177 => 4.8966, std.dev.: 0.0084) MultiSource/Benchmarks/mafft/pairlocalalign: 5.98% (2.1013 => 2.2269, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 5.82% (2.1653 => 2.2913, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.76% (0.5361 => 0.5670, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 5.69% (0.7875 => 0.8323, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.69% (0.2040 => 0.2156, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.68% (1.9694 => 2.0812, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/football/football: 5.59% (0.2075 => 0.2191, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.52% (1.9966 => 2.1068, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 5.36% (2.0346 => 2.1436, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.16% (0.5584 => 0.5872, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 5.10% (0.2391 => 0.2513, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.09% (11.6398 => 12.2319, std.dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: 4.87% (0.2691 => 0.2822, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.67% (4.6926 => 4.9119, std.dev.: 0.0126) MultiSource/Applications/lambda-0_1_3/lambda: 4.40% (0.3498 => 0.3652, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.39% (0.4253 => 0.4397, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 3.06% (11.9555 => 12.3218, std.dev.: 0.0118) SingleSource/UnitTests/Vector/constpool: 2.09% (2.4764 => 2.5282, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6098, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.46% (0.2122 => 0.2259, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6701, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-2: 5.00% (1.8057 => 1.8959, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1678, std.dev.: 0.0116) SingleSource/Benchmarks/Dhrystone/dry: 4.14% (14.0481 => 14.6297, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1988, std.dev.: 0.0458) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5009, std.dev.: 0.0037) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.54% (3.1722 => 3.2211, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2875, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.09% (50.0626 => 50.6091, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.93% (25.4195 => 16.5398, std.dev.: 0.0275) SingleSource/Benchmarks/Shootout-C++/ary2: -8.37% (0.2402 => 0.2201, std.dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9748, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7858, std.dev.: 0.0091) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9586, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -3.58% (11.2080 => 10.8071, std.dev.: 0.0124) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0061) MultiSource/Applications/siod/siod: -3.05% (6.9842 => 6.7714, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: -2.61% (17.2379 => 16.7878, std.dev.: 0.0682) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8602, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5793, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4960, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.24% (105.3826 => 104.0771, std.dev.: 0.1184) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0454, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 10 11:32:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 10 Oct 2012 13:32:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121010183250.CAEE92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4769?compare_to=4766&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4769, Order: 165629, Start Time: 2012-10-10 17:19:59, End Time: 2012-10-10 18:34:37 To: 4766, Order: 165620, Start Time: 2012-10-10 15:36:12, End Time: 2012-10-10 16:50:55 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (186 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1041 (750 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.36% (55.6528 => 56.4122, std.dev.: 0.1253) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.32% (2.0176 => 2.4881, std.dev.: 0.0056) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.16% (0.1410 => 0.1666, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 17.31% (0.0826 => 0.0969) MultiSource/Benchmarks/McCat/08-main/main: 16.14% (0.2243 => 0.2605, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 13.52% (0.1013 => 0.1150, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.19% (0.0834 => 0.0944, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 13.05% (0.2721 => 0.3076, std.dev.: 0.0013) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.97% (0.1072 => 0.1211, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.95% (0.1413 => 0.1596, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 12.85% (1.3693 => 1.5452, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.51% (0.1327 => 0.1493, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 12.49% (0.7038 => 0.7917, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.46% (3.9660 => 4.4600, std.dev.: 0.0107) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.14% (0.0964 => 0.1081, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.03% (0.1588 => 0.1779, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 12.01% (0.4328 => 0.4848, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.91% (1.4563 => 1.6297, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.79% (0.2596 => 0.2902, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.74% (0.5265 => 0.5883, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 11.69% (0.5818 => 0.6498, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.68% (1.2193 => 1.3617, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.65% (0.9199 => 1.0271, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 11.54% (13.8202 => 15.4157, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.54% (0.6959 => 0.7762, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.48% (0.7710 => 0.8595, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 11.41% (0.5748 => 0.6404, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.36% (0.6283 => 0.6997, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 11.35% (0.4062 => 0.4523, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.24% (1.1364 => 1.2641, std.dev.: 0.0019) MultiSource/Applications/aha/aha: 11.21% (0.1062 => 0.1181) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.08% (0.3899 => 0.4331, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 11.07% (0.7061 => 0.7843, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 11.07% (0.1003 => 0.1114, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 10.79% (0.2781 => 0.3081, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.73% (0.3130 => 0.3466, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 10.66% (1.0313 => 1.1412, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.61% (0.4016 => 0.4442, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.51% (0.1075 => 0.1188, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.50% (0.3485 => 0.3851, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.45% (0.5577 => 0.6160, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.44% (0.3756 => 0.4148, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.42% (0.4791 => 0.5290, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 10.39% (1.1061 => 1.2210, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.28% (0.3580 => 0.3948, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.24% (0.2782 => 0.3067, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.24% (0.0977 => 0.1077, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.23% (0.3489 => 0.3846, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.20% (0.1157 => 0.1275, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 10.12% (16.6129 => 18.2948, std.dev.: 0.0188) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.12% (0.4379 => 0.4822, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.11% (0.2966 => 0.3266, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 10.11% (0.3293 => 0.3626, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.09% (0.3022 => 0.3327, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 10.08% (0.2995 => 0.3297, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 10.08% (0.6744 => 0.7424, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.04% (0.3246 => 0.3572, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.95% (0.6576 => 0.7230, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 9.89% (0.2690 => 0.2956, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.88% (1.9828 => 2.1787, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/except: 9.86% (0.2760 => 0.3032, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.83% (0.2127 => 0.2336, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 9.82% (0.3868 => 0.4248, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 9.82% (0.3453 => 0.3792, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 9.78% (0.2607 => 0.2862, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.77% (0.1986 => 0.2180, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 9.75% (0.1589 => 0.1744, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 9.72% (0.2726 => 0.2991, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/mst/mst: 9.72% (0.1111 => 0.1219) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.72% (0.2655 => 0.2913, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 9.70% (0.2937 => 0.3222, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.69% (0.2765 => 0.3033, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 9.69% (0.3220 => 0.3532, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 9.69% (0.8310 => 0.9115, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 9.68% (0.3534 => 0.3876, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.68% (0.2914 => 0.3196, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 9.67% (0.2761 => 0.3028, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 9.66% (3.1889 => 3.4968, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 9.63% (0.2628 => 0.2881, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.62% (0.7460 => 0.8178, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.57% (0.8698 => 0.9530, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 9.56% (0.3107 => 0.3404, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 9.56% (0.3149 => 0.3450, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 9.55% (3.8646 => 4.2337, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.53% (0.5637 => 0.6174, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.52% (0.4390 => 0.4808, std.dev.: 0.0075) MultiSource/Applications/siod/siod: 9.49% (2.1791 => 2.3860, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.49% (7.2180 => 7.9030, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.48% (0.1276 => 0.1397, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.48% (0.1435 => 0.1571, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 9.47% (1.9270 => 2.1094, std.dev.: 0.0023) MultiSource/Applications/spiff/spiff: 9.43% (0.7506 => 0.8214, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.38% (0.2696 => 0.2949, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 9.34% (0.2988 => 0.3267, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.33% (0.1865 => 0.2039, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 9.27% (0.3192 => 0.3488, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 9.26% (0.2925 => 0.3196, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.19% (0.2023 => 0.2209, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 9.19% (1.0594 => 1.1568, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.14% (0.3511 => 0.3832, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.05% (0.1569 => 0.1711, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 9.00% (0.1478 => 0.1611, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 8.76% (0.2945 => 0.3203, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.73% (4.9865 => 5.4217, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.67% (1.3245 => 1.4394, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.63% (0.3755 => 0.4079, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.60% (3.6692 => 3.9846, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 8.57% (0.1657 => 0.1799, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 8.56% (0.3131 => 0.3399, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 8.49% (14.8535 => 16.1149, std.dev.: 0.0066) MultiSource/Applications/SIBsim4/SIBsim4: 8.49% (1.2749 => 1.3831, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.37% (4.4433 => 4.8151, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.36% (0.2140 => 0.2319, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.32% (4.3801 => 4.7446, std.dev.: 0.0097) MultiSource/Benchmarks/mafft/pairlocalalign: 8.25% (8.4961 => 9.1968, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.09% (0.8818 => 0.9531, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.07% (0.6135 => 0.6630, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.05% (0.1789 => 0.1933, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 7.95% (4.6629 => 5.0335, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.84% (1.5188 => 1.6378, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.69% (3.2742 => 3.5259, std.dev.: 0.0139) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.68% (1.1333 => 1.2203, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 7.59% (0.4113 => 0.4425, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.52% (0.9108 => 0.9793, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.47% (0.4805 => 0.5164, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 7.44% (0.6250 => 0.6715, std.dev.: 0.0092) MultiSource/Applications/JM/ldecod/ldecod: 7.39% (6.5754 => 7.0611, std.dev.: 0.0074) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.37% (0.2321 => 0.2492, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: 7.29% (0.1385 => 0.1486, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 7.18% (3.7467 => 4.0158, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.18% (0.3245 => 0.3478, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.15% (0.2504 => 0.2683, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 7.13% (1.2292 => 1.3169, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.13% (2.1007 => 2.2505, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/parameter-passing: 7.12% (0.4003 => 0.4288, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 6.92% (0.3914 => 0.4185, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.85% (0.3940 => 0.4210, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 6.82% (0.2008 => 0.2145) SingleSource/UnitTests/ObjC/trivial-interface: 6.76% (0.3578 => 0.3820, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.73% (0.3789 => 0.4044, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.71% (0.1819 => 0.1941, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 6.69% (0.3646 => 0.3890, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.64% (0.3601 => 0.3840, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.64% (6.2785 => 6.6951, std.dev.: 0.0067) SingleSource/UnitTests/ObjC/synchronized: 6.63% (0.3663 => 0.3906, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 6.57% (0.3623 => 0.3861, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.53% (13.2842 => 14.1517, std.dev.: 0.0106) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.52% (0.3650 => 0.3888, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.13% (0.2243 => 0.2358, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 4.82% (16.2614 => 17.0451, std.dev.: 0.0065) MultiSource/Applications/ClamAV/clamscan: 4.32% (14.5298 => 15.1574, std.dev.: 0.0153) MultiSource/Benchmarks/Bullet/bullet: 1.37% (33.2944 => 33.7507, std.dev.: 0.0167) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.49% (5.7573 => 7.5125, std.dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.55% (1.8175 => 2.2637, std.dev.: 0.0493) SingleSource/Benchmarks/Misc/richards_benchmark: 11.16% (1.1560 => 1.2850, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (3.1736 => 3.4148, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 5.69% (1.2998 => 1.3738, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.62% (1.9144 => 2.0029, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.75% (10.7476 => 11.1508, std.dev.: 0.0214) MultiSource/Benchmarks/nbench/nbench: 3.67% (11.2619 => 11.6756, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9858, std.dev.: 0.0007) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.20% (7.4271 => 7.5908, std.dev.: 0.0067) MultiSource/Applications/lemon/lemon: 1.73% (1.4298 => 1.4546, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5127, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2123, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9678, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1867, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5778, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0267, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.07% (8.8259 => 8.9203, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5881, std.dev.: 0.0072) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.82% (0.2670 => 0.1420, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.26% (0.4657 => 0.3900, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -14.43% (0.0707 => 0.0605, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.33% (1.3819 => 1.1977, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.20% (1.3813 => 1.1989, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.76% (22.5627 => 22.1653, std.dev.: 0.0231) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.44% (0.0997 => 0.0863, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -11.89% (0.2238 => 0.1972, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -11.34% (1.2308 => 1.0912, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.03% (20.3410 => 18.3004, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.57% (1.3780 => 1.3013, std.dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5137, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.11% (0.9996 => 0.9585, std.dev.: 0.0099) MultiSource/Applications/siod/siod: -3.48% (3.2729 => 3.1590, std.dev.: 0.0176) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.43% (1.7688 => 1.7081, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.96% (0.4867 => 0.4723, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.68% (26.5159 => 25.8058, std.dev.: 0.0339) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.44% (3.0263 => 2.9525, std.dev.: 0.0020) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.27% (1.9762 => 1.9314, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.88% (0.6589 => 0.6465, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7148, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/lists: -1.79% (6.3560 => 6.2425, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511) MultiSource/Applications/sqlite3/sqlite3: -1.48% (4.5928 => 4.5249, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (7.1097 => 7.0055, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.20% (3.9173 => 3.8703, std.dev.: 0.0109) MultiSource/Applications/minisat/minisat: -1.19% (9.3358 => 9.2244, std.dev.: 0.0293) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2570, std.dev.: 0.0015) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 10 11:53:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 10 Oct 2012 13:53:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121010185308.E4CC82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4770?compare_to=4767&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4770, Order: 165631, Start Time: 2012-10-10 17:35:23, End Time: 2012-10-10 18:54:56 To: 4767, Order: 165620, Start Time: 2012-10-10 15:46:36, End Time: 2012-10-10 17:06:05 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 4 (161 on baseline) Performance Improvements: 1 (41 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1020 (757 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.68% (79.3368 => 80.6720, std.dev.: 0.4074) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.24% (0.9527 => 0.9645, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/lowercase: 1.19% (7.9607 => 8.0555, std.dev.: 0.0125) SingleSource/Benchmarks/McGill/chomp: 1.00% (1.0849 => 1.0958, std.dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.10% (15.3482 => 14.8718, std.dev.: 0.0094) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.14% (0.5924 => 0.5932, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 0.42% (16.3457 => 16.4146, std.dev.: 0.0152) MultiSource/Benchmarks/Bullet/bullet: 0.09% (55.3641 => 55.4145, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/gs/gs: 0.13% (4.4135 => 4.4193, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.21% (1.2565 => 1.2592, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.11% (7.8630 => 7.8718, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.07% (0.7423 => 0.7418, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -1.10% (0.0363 => 0.0359, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1431 => 0.1430, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.16% (0.0645 => 0.0646, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -12.38% (63.2438 => 55.4145, std.dev.: 0.0059) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 33.39% (14.1553 => 18.8822, std.dev.: 0.0148) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.85% (3.4629 => 5.6738, std.dev.: 0.0005) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14219.86% (0.0720 => 10.3103, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952200.00% (0.0001 => 9.9523, std.dev.: 0.0013) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.23% (0.2554 => 0.4169, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 43.45% (10.3673 => 14.8718, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/richards_benchmark: 38.22% (0.1622 => 0.2242, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/distray/distray: 33.33% (0.1056 => 0.1408, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.45% (7.0540 => 8.3558, std.dev.: 0.0154) SingleSource/Benchmarks/Misc/flops: 18.09% (0.1432 => 0.1691, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.09% (2.2022 => 2.6005, std.dev.: 0.0106) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.81% (0.1566 => 0.1798, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 13.16% (0.3282 => 0.3714, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.86% (0.0871 => 0.0983, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 12.67% (10.4361 => 11.7580, std.dev.: 0.0211) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.45% (1.7609 => 1.9801, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.23% (0.0834 => 0.0936, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 11.67% (0.1440 => 0.1608, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.55% (0.1584 => 0.1767, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 10.51% (0.7115 => 0.7863, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.45% (0.3177 => 0.3509, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.43% (0.4879 => 0.5388, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.22% (0.1438 => 0.1585, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.19% (0.3543 => 0.3904, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.19% (0.2700 => 0.2975, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 10.16% (0.7433 => 0.8188, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/tsp/tsp: 10.04% (0.1175 => 0.1293, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 10.03% (9.4845 => 10.4354, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.96% (0.6675 => 0.7340, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.81% (1.5415 => 1.6927, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.78% (0.1625 => 0.1784, std.dev.: 0.0020) MultiSource/Applications/d/make_dparser: 9.74% (3.3354 => 3.6603, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/exceptions-3: 9.70% (0.3516 => 0.3857, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 9.69% (0.3561 => 0.3906, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 9.67% (0.3473 => 0.3809, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 9.62% (5.7591 => 6.3129, std.dev.: 0.0071) SingleSource/Benchmarks/McGill/chomp: 9.55% (0.1655 => 0.1813, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 9.54% (0.3543 => 0.3881, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.49% (0.3497 => 0.3829, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 9.47% (0.3927 => 0.4299) SingleSource/UnitTests/ObjC/for-in: 9.42% (0.3694 => 0.4042, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 9.35% (0.3423 => 0.3743, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 9.29% (0.3886 => 0.4247, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions: 9.27% (0.3828 => 0.4183, std.dev.: 0.0040) MultiSource/Applications/sgefa/sgefa: 9.23% (0.3109 => 0.3396, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.04% (0.4615 => 0.5032, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/em3d/em3d: 9.03% (0.1695 => 0.1848, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.98% (0.5860 => 0.6386, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.97% (0.5105 => 0.5563, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.94% (0.2271 => 0.2474, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.88% (1.3050 => 1.4209, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/mst/mst: 8.86% (0.1163 => 0.1266, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.81% (0.1510 => 0.1643, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.77% (4.2646 => 4.6386, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.67% (5.0018 => 5.4353, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.63% (8.1363 => 8.8387, std.dev.: 0.0069) MultiSource/Benchmarks/sim/sim: 8.62% (0.3387 => 0.3679, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.62% (0.5569 => 0.6049, std.dev.: 0.0034) MultiSource/Applications/Burg/burg: 8.61% (1.1642 => 1.2644, std.dev.: 0.0064) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.55% (0.8172 => 0.8871, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.54% (0.2107 => 0.2287, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.51% (4.9449 => 5.3656, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.48% (0.8067 => 0.8751, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.42% (0.9765 => 1.0587, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 8.41% (3.8723 => 4.1979, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.41% (0.3307 => 0.3585, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 8.31% (1.5603 => 1.6899, std.dev.: 0.0042) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.27% (0.3121 => 0.3379, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.25% (0.1236 => 0.1338, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.25% (0.1940 => 0.2100, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.19% (0.2758 => 0.2984, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.18% (0.2065 => 0.2234, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.16% (7.9617 => 8.6110, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.15% (0.1337 => 0.1446, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 8.15% (1.0722 => 1.1596, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 8.10% (0.7835 => 0.8470, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/bigfib: 8.02% (0.6456 => 0.6974, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.99% (0.5020 => 0.5421, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 7.86% (2.0273 => 2.1866, std.dev.: 0.0032) MultiSource/Applications/viterbi/viterbi: 7.78% (0.1555 => 0.1676, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.77% (1.5859 => 1.7092, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.70% (0.3441 => 0.3706, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.60% (1.1861 => 1.2762, std.dev.: 0.0039) SingleSource/UnitTests/ObjC++/property-reference-object: 7.50% (0.6030 => 0.6482, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 7.48% (0.3180 => 0.3418, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 7.46% (0.5925 => 0.6367, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.45% (0.2603 => 0.2797, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 7.37% (2.2969 => 2.4662, std.dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 7.27% (21.9371 => 23.5326, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/hash: 7.23% (0.4289 => 0.4599, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.16% (0.4203 => 0.4504, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.14% (0.4103 => 0.4396, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.12% (0.6450 => 0.6909, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.09% (0.3865 => 0.4139, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 7.01% (0.3422 => 0.3662, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 6.98% (0.7326 => 0.7837, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 6.97% (0.8921 => 0.9543, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.93% (2.2024 => 2.3551, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 6.88% (0.4620 => 0.4938, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.75% (0.5981 => 0.6385, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.68% (0.4299 => 0.4586, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.66% (0.3650 => 0.3893, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.60% (0.4636 => 0.4942, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.59% (0.3826 => 0.4078, std.dev.: 0.0017) SingleSource/Regression/C++/ofstream_ctor: 6.54% (0.2905 => 0.3095, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 6.52% (0.4048 => 0.4312, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.37% (0.1695 => 0.1803, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.33% (1.4186 => 1.5084, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 6.33% (1.1840 => 1.2589, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.29% (0.3162 => 0.3361, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.29% (0.1892 => 0.2011, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 6.22% (0.3603 => 0.3827, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 6.16% (0.3684 => 0.3911, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.15% (0.3136 => 0.3329, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.09% (0.2891 => 0.3067, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.00% (0.2831 => 0.3001, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.94% (2.0665 => 2.1893, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 5.85% (0.3232 => 0.3421, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.82% (0.3283 => 0.3474, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.78% (0.3098 => 0.3277, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.71% (0.2872 => 0.3036, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.70% (0.2877 => 0.3041, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.68% (0.2871 => 0.3034, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.67% (0.1906 => 0.2014, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.55% (0.2756 => 0.2909, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 5.54% (0.2725 => 0.2876, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.52% (0.2266 => 0.2391, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.44% (0.3052 => 0.3218, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.41% (0.2793 => 0.2944, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 5.31% (0.2714 => 0.2858, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.25% (14.3668 => 15.1212, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/random: 5.25% (0.2802 => 0.2949, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.23% (0.8101 => 0.8525, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 5.21% (0.3379 => 0.3555, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.17% (0.4064 => 0.4274, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: 4.93% (0.2049 => 0.2150, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 4.69% (17.1811 => 17.9865, std.dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.67% (0.3427 => 0.3587, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.63% (0.3131 => 0.3276, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.36% (0.2430 => 0.2536, std.dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 4.17% (1.2842 => 1.3377, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.00% (3.8922 => 4.0479, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.00% (1.1194 => 1.1530, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.38% (0.2944 => 0.3279, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652) SingleSource/Benchmarks/Misc/richards_benchmark: 9.83% (1.1396 => 1.2516, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.22% (3.1595 => 3.4508, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3685, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.65% (0.3463 => 0.3624, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 3.71% (0.5413 => 0.5614, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.46% (3.6395 => 3.7655, std.dev.: 0.0041) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.69% (4.2280 => 4.3416, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.33% (1.7254 => 1.7656, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8132, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.20% (2.6546 => 2.6865, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.07% (6.5088 => 6.5787, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1311, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -80.11% (0.8651 => 0.1721, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.99% (5.2763 => 3.2718, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.05% (5.3855 => 3.7134, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.59% (5.3526 => 3.7154, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -14.59% (54.1659 => 46.2649, std.dev.: 0.0101) MultiSource/Applications/ClamAV/clamscan: -10.52% (22.1758 => 19.8425, std.dev.: 0.0311) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.39% (2.9384 => 2.6332, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7653, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: -16.27% (1.6925 => 1.4172, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.53% (0.0998 => 0.0863, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.44% (1.2373 => 1.0958, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3783, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/mason/mason: -10.04% (0.2161 => 0.1944, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.21% (19.9488 => 18.3108, std.dev.: 0.1885) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.73% (1.8329 => 1.7095, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.35% (1.6805 => 1.5906, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.91% (1.5835 => 1.5058, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.71% (3.2827 => 3.1608, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.13% (0.9957 => 0.9645, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5034, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0982, std.dev.: 0.0023) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.00% (8.1563 => 7.9928, std.dev.: 0.0124) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.81% (8.6802 => 8.5227, std.dev.: 0.0139) SingleSource/Benchmarks/Misc/salsa20: -1.75% (10.2830 => 10.1030, std.dev.: 0.0155) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6814, std.dev.: 0.0019) SingleSource/UnitTests/Vector/multiplies: -1.53% (2.5528 => 2.5138, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.51% (9.5636 => 9.4196, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -1.04% (4.6441 => 4.5956, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8582, std.dev.: 0.0077) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.44% (0.5229 => 0.5932, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 9.51% (14.9895 => 16.4146, std.dev.: 0.0152) MultiSource/Benchmarks/MallocBench/gs/gs: 7.51% (4.1105 => 4.4193, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.98% (1.1048 => 1.2592, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.97% (7.1582 => 7.8718, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.22% (0.6222 => 0.7418, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35800.00% (0.0001 => 0.0359, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.70% (0.1485 => 0.1430, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.47% (0.2116 => 0.0646, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 10 13:16:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 10 Oct 2012 15:16:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121010201624.053202A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4771?compare_to=4769&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4771, Order: 165639, Start Time: 2012-10-10 19:03:38, End Time: 2012-10-10 20:18:10 To: 4769, Order: 165629, Start Time: 2012-10-10 17:19:59, End Time: 2012-10-10 18:34:37 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (186 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1042 (749 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.85% (2.0176 => 2.4988, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.30% (0.1410 => 0.1668, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 17.31% (0.0826 => 0.0969) MultiSource/Benchmarks/McCat/08-main/main: 16.05% (0.2243 => 0.2603, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 13.72% (0.1013 => 0.1152, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.31% (0.0834 => 0.0945, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.16% (0.1413 => 0.1599, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 13.08% (0.2721 => 0.3077, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.04% (0.1327 => 0.1500, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.82% (0.0819 => 0.0924, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 12.79% (1.3693 => 1.5445, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 12.63% (0.7038 => 0.7927, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.47% (3.9660 => 4.4604, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.34% (0.0964 => 0.1083, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.28% (0.1588 => 0.1783, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.03% (0.1072 => 0.1201, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.94% (0.2596 => 0.2906) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.87% (1.4563 => 1.6291, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.86% (0.9199 => 1.0290, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 11.83% (13.8202 => 15.4551, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/hash2: 11.78% (0.4328 => 0.4838, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.78% (1.2193 => 1.3629, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.78% (0.5265 => 0.5885, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.63% (0.7710 => 0.8607, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.60% (0.6959 => 0.7766, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.59% (0.6283 => 0.7011, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.42% (1.1364 => 1.2662, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 11.30% (0.4062 => 0.4521, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 11.30% (0.1062 => 0.1182, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 11.24% (0.5818 => 0.6472, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.05% (0.3130 => 0.3476, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.98% (0.3899 => 0.4327, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: 10.97% (0.1003 => 0.1113, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/Hello: 10.87% (0.5748 => 0.6373, std.dev.: 0.0038) MultiSource/Applications/lemon/lemon: 10.78% (1.0313 => 1.1425, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.65% (0.5577 => 0.6171, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.58% (0.4791 => 0.5298, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 10.55% (0.7061 => 0.7806, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.54% (0.1157 => 0.1279, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 10.51% (1.1061 => 1.2224, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.47% (0.3485 => 0.3850, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.38% (0.4016 => 0.4433, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 10.32% (0.2781 => 0.3068, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.23% (0.1075 => 0.1185, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 10.18% (0.2995 => 0.3300, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 10.13% (0.6744 => 0.7427, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.07% (0.3246 => 0.3573, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.07% (0.4379 => 0.4820, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.06% (0.2782 => 0.3062, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.06% (0.3756 => 0.4134, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.00% (0.3489 => 0.3838, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 9.99% (0.3293 => 0.3622, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 9.97% (16.6129 => 18.2699, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.96% (0.3022 => 0.3323, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 9.91% (0.3220 => 0.3539, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 9.88% (0.1589 => 0.1746, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.87% (0.2127 => 0.2337, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.82% (0.1986 => 0.2181, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.80% (0.3580 => 0.3931, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 9.79% (3.1889 => 3.5012, std.dev.: 0.0160) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.75% (0.2914 => 0.3198, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.75% (0.7460 => 0.8187, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 9.72% (0.8310 => 0.9118, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 9.72% (0.1111 => 0.1219, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.71% (0.2966 => 0.3254, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.69% (0.1435 => 0.1574, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.66% (0.4390 => 0.4814, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.65% (0.5637 => 0.6181, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 9.65% (3.8646 => 4.2375, std.dev.: 0.0123) MultiSource/Applications/treecc/treecc: 9.63% (1.9270 => 2.1126, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/moments: 9.59% (0.3868 => 0.4239, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 9.59% (0.3453 => 0.3784, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.55% (0.8698 => 0.9529, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.55% (1.9828 => 2.1722, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.53% (0.2655 => 0.2908, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 9.53% (0.2760 => 0.3023, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.52% (7.2180 => 7.9055, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/random: 9.52% (0.2690 => 0.2946, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 9.50% (2.1791 => 2.3861, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 9.47% (0.2628 => 0.2877, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 9.47% (0.2607 => 0.2854, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 9.45% (0.7506 => 0.8215, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 9.42% (0.2761 => 0.3021, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.40% (0.1276 => 0.1396, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 9.39% (0.2726 => 0.2982, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 9.36% (0.2937 => 0.3212, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.34% (0.2023 => 0.2212, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 9.33% (0.2925 => 0.3198, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.33% (0.2765 => 0.3023, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.33% (0.1865 => 0.2039, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 9.30% (0.3149 => 0.3442, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.26% (0.6576 => 0.7185, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/lists1: 9.25% (0.3534 => 0.3861, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 9.24% (0.3192 => 0.3487, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 9.24% (1.0594 => 1.1573, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 9.21% (0.3107 => 0.3393, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 9.13% (0.1478 => 0.1613, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.12% (0.2696 => 0.2942, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.11% (0.1569 => 0.1712, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 8.97% (0.2988 => 0.3256, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.93% (1.3245 => 1.4428, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.78% (4.9865 => 5.4241, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.76% (3.6692 => 3.9907, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 8.75% (0.3131 => 0.3405, std.dev.: 0.0048) MultiSource/Applications/oggenc/oggenc: 8.75% (4.6629 => 5.0707, std.dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 8.71% (14.8535 => 16.1479, std.dev.: 0.0127) MultiSource/Applications/SIBsim4/SIBsim4: 8.64% (1.2749 => 1.3850, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 8.63% (0.1657 => 0.1800, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.55% (0.2140 => 0.2323, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.50% (0.3755 => 0.4074, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.49% (4.3801 => 4.7520, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.48% (4.4433 => 4.8202, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/objinst: 8.42% (0.2945 => 0.3193, std.dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.35% (0.3511 => 0.3804, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.32% (0.8818 => 0.9552, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 8.31% (8.4961 => 9.2018, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.20% (0.6135 => 0.6638, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.05% (0.1789 => 0.1933, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.89% (1.5188 => 1.6386, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.82% (1.1333 => 1.2219, std.dev.: 0.0100) MultiSource/Benchmarks/McCat/05-eks/eks: 7.78% (0.4113 => 0.4433, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.75% (0.9108 => 0.9814, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.68% (3.2742 => 3.5256, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 7.63% (0.6250 => 0.6727, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.60% (0.4805 => 0.5170, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.53% (0.1819 => 0.1956, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 7.49% (6.5754 => 7.0676, std.dev.: 0.0144) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.45% (0.2321 => 0.2494, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.44% (0.4003 => 0.4301, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: 7.44% (0.1385 => 0.1488, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.38% (0.3914 => 0.4203, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.35% (0.2504 => 0.2688, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.32% (0.3578 => 0.3840, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.28% (0.3789 => 0.4065, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 7.25% (3.7467 => 4.0184, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/property: 7.23% (0.3940 => 0.4225, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 7.16% (0.3646 => 0.3907, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/synchronized: 7.10% (0.3663 => 0.3923, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.09% (0.3245 => 0.3475, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.08% (0.3601 => 0.3856, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 7.07% (0.2008 => 0.2150, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.04% (0.3623 => 0.3878, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.01% (0.3650 => 0.3906, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.98% (2.1007 => 2.2473, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 6.91% (1.2292 => 1.3141, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.73% (13.2842 => 14.1780, std.dev.: 0.0094) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.61% (6.2785 => 6.6935, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.39% (0.2243 => 0.2364, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 5.05% (16.2614 => 17.0823, std.dev.: 0.0133) MultiSource/Applications/ClamAV/clamscan: 4.39% (14.5298 => 15.1678, std.dev.: 0.0120) MultiSource/Benchmarks/Bullet/bullet: 1.35% (33.2944 => 33.7430, std.dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5153, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.09% (1.0895 => 1.3629, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fbench: 24.44% (1.8175 => 2.2617, std.dev.: 0.0514) SingleSource/Benchmarks/Misc/richards_benchmark: 10.99% (1.1560 => 1.2831, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.02% (0.8273 => 0.9019, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.77% (0.1322 => 0.1438, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4145, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.31% (1.2998 => 1.3818, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.71% (0.3139 => 0.3287, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0044, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6758, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9853, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 3.28% (10.7476 => 11.0999, std.dev.: 0.0186) SingleSource/Regression/C/uint64_to_float: 2.95% (0.5449 => 0.5610, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.16% (7.4271 => 7.5878, std.dev.: 0.0038) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4532, std.dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5147, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9689, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1871, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.15% (5.5130 => 5.5763, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.09% (8.8259 => 8.9223, std.dev.: 0.0115) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0275, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1407, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5880, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.78% (0.2670 => 0.1421, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.87% (0.4657 => 0.3918, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/mason/mason: -14.29% (0.0707 => 0.0606, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.96% (1.3819 => 1.2028, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.94% (1.3813 => 1.2026, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.69% (22.5627 => 22.1815, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.34% (0.0997 => 0.0864, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -12.06% (0.2238 => 0.1968, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.85% (1.2308 => 1.0973, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.16% (20.3410 => 18.2749, std.dev.: 0.0153) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.72% (1.3780 => 1.2992, std.dev.: 0.0090) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5148, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.68% (0.9996 => 0.9628, std.dev.: 0.0048) MultiSource/Applications/siod/siod: -3.55% (3.2729 => 3.1567, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.52% (1.7688 => 1.7065, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -2.46% (26.5159 => 25.8629, std.dev.: 0.0033) MultiSource/Applications/spiff/spiff: -2.45% (3.0263 => 2.9522, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -2.37% (1.9762 => 1.9294, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.99% (0.6589 => 0.6458, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.88% (6.3560 => 6.2367, std.dev.: 0.0087) MultiSource/Benchmarks/mafft/pairlocalalign: -1.79% (28.2225 => 27.7162, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511) MultiSource/Applications/sqlite3/sqlite3: -1.45% (4.5928 => 4.5263, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0070, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8640, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4945, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2584, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.08% (6.6320 => 6.5607, std.dev.: 0.0087) MultiSource/Applications/minisat/minisat: -1.06% (9.3358 => 9.2371, std.dev.: 0.0297) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 10 13:41:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 10 Oct 2012 15:41:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121010204149.339192A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4772?compare_to=4770&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4772, Order: 165644, Start Time: 2012-10-10 19:24:17, End Time: 2012-10-10 20:43:36 To: 4770, Order: 165631, Start Time: 2012-10-10 17:35:23, End Time: 2012-10-10 18:54:56 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (157 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1024 (760 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.50% (14.8718 => 15.0945, std.dev.: 0.0086) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.05% (0.5932 => 0.5935, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 0.00% (16.4146 => 16.4152, std.dev.: 0.0073) MultiSource/Benchmarks/Bullet/bullet: 0.05% (55.4145 => 55.4448, std.dev.: 0.0068) MultiSource/Benchmarks/MallocBench/gs/gs: 0.09% (4.4193 => 4.4231, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.14% (1.2592 => 1.2575, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.03% (7.8718 => 7.8740, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.01% (0.7418 => 0.7419, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.56% (0.0359 => 0.0361, std.dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1430 => 0.1431) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0646 => 0.0645, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -12.33% (63.2438 => 55.4448, std.dev.: 0.0068) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 33.29% (14.1553 => 18.8671, std.dev.: 0.0149) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.96% (3.4629 => 5.6776, std.dev.: 0.0100) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14222.78% (0.0720 => 10.3124, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9951700.00% (0.0001 => 9.9518, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.08% (0.2554 => 0.4165, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 45.60% (10.3673 => 15.0945, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/richards_benchmark: 38.59% (0.1622 => 0.2248, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/distray/distray: 33.43% (0.1056 => 0.1409, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.38% (7.0540 => 8.3508, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.30% (2.2022 => 2.6053, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 18.16% (0.1432 => 0.1692, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.01% (0.1566 => 0.1801, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 13.44% (0.3282 => 0.3723, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.74% (0.0871 => 0.0982, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.47% (1.7609 => 1.9804, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 12.31% (10.4361 => 11.7206, std.dev.: 0.0083) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.62% (0.1584 => 0.1768, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 11.60% (0.1440 => 0.1607, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.50% (0.1438 => 0.1589, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 10.47% (0.7115 => 0.7860, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.43% (0.4879 => 0.5388, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 10.33% (0.7433 => 0.8201, std.dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 10.31% (9.4845 => 10.4626, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.30% (0.3543 => 0.3908, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.10% (0.3177 => 0.3498, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.00% (0.2700 => 0.2970, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 9.96% (0.1175 => 0.1292, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 9.93% (0.3473 => 0.3818, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.89% (0.6675 => 0.7335, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.72% (0.1625 => 0.1783, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 9.72% (0.3561 => 0.3907, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.71% (0.3543 => 0.3887, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.69% (0.3497 => 0.3836, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 9.63% (3.3354 => 3.6567, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.61% (0.3516 => 0.3854, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.55% (0.3927 => 0.4302, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 9.55% (0.1655 => 0.1813, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.50% (1.5415 => 1.6880, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/for-in: 9.50% (0.3694 => 0.4045, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 9.46% (5.7591 => 6.3040, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions: 9.46% (0.3828 => 0.4190, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.39% (0.3886 => 0.4251, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 9.38% (0.3423 => 0.3744, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.34% (0.4615 => 0.5046, std.dev.: 0.0036) MultiSource/Applications/sgefa/sgefa: 9.26% (0.3109 => 0.3397, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.07% (0.5105 => 0.5568, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/em3d/em3d: 8.97% (0.1695 => 0.1847, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.92% (1.3050 => 1.4214, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.89% (0.2271 => 0.2473, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.81% (0.5860 => 0.6376, std.dev.: 0.0074) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.72% (4.2646 => 4.6365, std.dev.: 0.0082) MultiSource/Benchmarks/sim/sim: 8.68% (0.3387 => 0.3681, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.61% (0.8172 => 0.8876, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 8.61% (1.5603 => 1.6947, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.61% (0.1510 => 0.1640, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.60% (4.9449 => 5.3701, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.60% (5.0018 => 5.4318, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.58% (0.5569 => 0.6047, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.55% (8.1363 => 8.8323, std.dev.: 0.0024) MultiSource/Applications/Burg/burg: 8.54% (1.1642 => 1.2636, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.50% (0.2107 => 0.2286, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.45% (0.9765 => 1.0590, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.41% (0.1236 => 0.1340, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 8.41% (3.8723 => 4.1979, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.40% (0.1940 => 0.2103, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.32% (0.3307 => 0.3582, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.30% (0.2758 => 0.2987, std.dev.: 0.0083) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.30% (0.3121 => 0.3380, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.28% (0.2065 => 0.2236, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/bigfib: 8.24% (0.6456 => 0.6988, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.22% (7.9617 => 8.6159, std.dev.: 0.0085) MultiSource/Applications/spiff/spiff: 8.08% (0.7835 => 0.8468, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.03% (0.5020 => 0.5423, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 8.00% (1.0722 => 1.1580, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.93% (0.1337 => 0.1443, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 7.92% (2.0273 => 2.1879, std.dev.: 0.0025) MultiSource/Applications/viterbi/viterbi: 7.85% (0.1555 => 0.1677, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.77% (1.5859 => 1.7092, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 7.70% (0.3180 => 0.3425, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.70% (0.3441 => 0.3706, std.dev.: 0.0045) SingleSource/UnitTests/ObjC++/Hello: 7.68% (0.5925 => 0.6380, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.60% (0.6030 => 0.6488, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.50% (1.1861 => 1.2751, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.46% (0.4103 => 0.4409, std.dev.: 0.0022) MultiSource/Applications/siod/siod: 7.39% (2.2969 => 2.4666, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.38% (0.4203 => 0.4513, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 7.36% (21.9371 => 23.5508, std.dev.: 0.0232) SingleSource/Benchmarks/Shootout-C++/hash: 7.30% (0.4289 => 0.4602, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.24% (0.3865 => 0.4145, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.23% (0.4636 => 0.4971, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 7.13% (0.3422 => 0.3666, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.11% (0.7326 => 0.7847, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.10% (0.6450 => 0.6908, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hash2: 7.08% (0.4620 => 0.4947, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.07% (0.2603 => 0.2787, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 7.02% (0.2905 => 0.3109, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.00% (2.2024 => 2.3566, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 6.91% (0.4299 => 0.4596, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/football/football: 6.83% (0.8921 => 0.9530, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.74% (0.3826 => 0.4084, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.74% (0.3650 => 0.3896, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.74% (0.5981 => 0.6384, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/moments: 6.67% (0.4048 => 0.4318, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.55% (0.1695 => 0.1806, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 6.52% (0.3603 => 0.3838, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.50% (0.2891 => 0.3079, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.49% (1.4186 => 1.5106, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/lists1: 6.38% (0.3684 => 0.3919, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.35% (0.3136 => 0.3335, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 6.28% (1.1840 => 1.2584, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.26% (0.3162 => 0.3360, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.11% (2.0665 => 2.1927, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: 6.07% (0.3098 => 0.3286, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.04% (0.2831 => 0.3002, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.03% (0.1892 => 0.2006, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.02% (0.2872 => 0.3045, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.97% (0.3283 => 0.3479, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.94% (0.2877 => 0.3048, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 5.94% (0.3232 => 0.3424, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.92% (0.2871 => 0.3041, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 5.83% (0.2725 => 0.2884, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.77% (0.2756 => 0.2915, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/wc: 5.77% (0.3052 => 0.3228, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.72% (0.1906 => 0.2015, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.67% (0.2802 => 0.2961, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.66% (0.2793 => 0.2951, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 5.60% (0.2714 => 0.2866, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.52% (0.2266 => 0.2391, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.47% (0.3379 => 0.3564, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.31% (0.4064 => 0.4280, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.14% (0.8101 => 0.8517, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 5.12% (0.2049 => 0.2154, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.08% (14.3668 => 15.0968, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/objinst: 4.76% (0.3131 => 0.3280, std.dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: 4.59% (17.1811 => 17.9690, std.dev.: 0.0200) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.44% (0.3427 => 0.3579, std.dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: 4.32% (1.2842 => 1.3397, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.16% (0.2430 => 0.2531, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (3.8922 => 4.0444, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.08% (1.1194 => 1.1539, std.dev.: 0.0124) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.22% (1.1145 => 1.3844, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.99% (1.1396 => 1.2534, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/Puzzle: 9.92% (0.1421 => 0.1562, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 9.18% (3.1595 => 3.4497, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.1578 => 3.3686, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.67% (3.6395 => 3.7731, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.67% (4.2280 => 4.3408, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7652, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.47% (0.9540 => 0.9680, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8133, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.22% (2.6546 => 2.6869, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.05% (6.6874 => 0.1307, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.01% (5.2763 => 3.2706, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.22% (5.3855 => 3.7042, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.88% (5.3526 => 3.6999, std.dev.: 0.0052) SingleSource/UnitTests/Vector/constpool: -14.57% (54.1659 => 46.2713, std.dev.: 0.0064) MultiSource/Applications/ClamAV/clamscan: -10.63% (22.1758 => 19.8193, std.dev.: 0.0226) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.45% (2.9384 => 2.6313, std.dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.52% (1.1492 => 0.7640, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: -16.01% (1.6925 => 1.4215, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.63% (0.0998 => 0.0862, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.21% (1.2373 => 1.0986, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -10.55% (1.5373 => 1.3751, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/mason/mason: -10.13% (0.2161 => 0.1942, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.47% (19.9488 => 18.2593, std.dev.: 0.0213) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.76% (1.8329 => 1.7090, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5753, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.31% (1.6805 => 1.5913, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-5: -5.10% (1.5835 => 1.5028, std.dev.: 0.0057) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.15% (0.9957 => 0.9544, std.dev.: 0.0042) MultiSource/Applications/siod/siod: -3.73% (3.2827 => 3.1603, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.14% (32.5116 => 31.4918, std.dev.: 0.0133) MultiSource/Applications/hexxagon/hexxagon: -3.05% (12.4730 => 12.0930, std.dev.: 0.0021) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.05% (8.6802 => 8.5024, std.dev.: 0.0097) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.78% (8.1563 => 8.0115, std.dev.: 0.0121) SingleSource/Benchmarks/Misc/salsa20: -1.73% (10.2830 => 10.1047, std.dev.: 0.0172) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6821, std.dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: -1.57% (2.5528 => 2.5126, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4229, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/lists: -1.18% (6.2999 => 6.2258, std.dev.: 0.0064) MultiSource/Applications/sqlite3/sqlite3: -1.13% (4.6441 => 4.5917, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8576, std.dev.: 0.0084) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.50% (0.5229 => 0.5935, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 9.51% (14.9895 => 16.4152, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/gs/gs: 7.60% (4.1105 => 4.4231, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.82% (1.1048 => 1.2575, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.00% (7.1582 => 7.8740, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.24% (0.6222 => 0.7419, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36000.00% (0.0001 => 0.0361, std.dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.52% (0.2116 => 0.0645, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 10 13:57:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 10 Oct 2012 15:57:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121010205751.0FD642A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4773?compare_to=4768&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4773, Order: 165633, Start Time: 2012-10-10 18:15:46, End Time: 2012-10-10 20:59:39 To: 4768, Order: 165620, Start Time: 2012-10-10 15:03:00, End Time: 2012-10-10 17:46:41 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (135 on baseline) Performance Improvements: 0 (16 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 1040 (829 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.54% (1.7365 => 1.7633, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.94% (122.2408 => 129.5072, std.dev.: 1.0407) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.19% (0.1063 => 0.1182, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 10.68% (1.5932 => 1.7633, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.67% (0.3488 => 0.3860, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 10.53% (0.3496 => 0.3864, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.48% (0.3465 => 0.3828, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.46% (0.3460 => 0.3822, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.45% (0.3446 => 0.3806, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.41% (0.3650 => 0.4030, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 10.35% (0.3469 => 0.3828, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.31% (0.3442 => 0.3797, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.16% (0.3643 => 0.4013, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.04% (0.3724 => 0.4098, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 9.11% (0.1218 => 0.1329, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 8.83% (0.1619 => 0.1762, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.67% (0.4994 => 0.5427, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.57% (0.5826 => 0.6325, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.54% (0.5889 => 0.6392, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.45% (1.3152 => 1.4263, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.33% (0.2738 => 0.2966, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 8.29% (0.3004 => 0.3253, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.23% (0.4361 => 0.4720, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 8.16% (5.5417 => 5.9938, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.04% (0.3195 => 0.3452, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.02% (1.6211 => 1.7511, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.95% (0.2792 => 0.3014, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.93% (0.2875 => 0.3103, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 7.82% (0.2750 => 0.2965, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 7.80% (0.4847 => 0.5225, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.79% (0.2813 => 0.3032, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.76% (0.5000 => 0.5388, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.72% (3.5627 => 3.8376, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/matrix: 7.70% (0.2780 => 0.2994, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 7.69% (0.6634 => 0.7144, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 7.68% (0.9909 => 1.0670, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 7.68% (0.2566 => 0.2763, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.68% (0.2866 => 0.3086, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 7.66% (0.2714 => 0.2922, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 7.61% (0.2811 => 0.3025, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.60% (0.2014 => 0.2167, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.59% (0.1620 => 0.1743, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.57% (2.7292 => 2.9358, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/fibo: 7.56% (0.2725 => 0.2931, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.53% (0.2803 => 0.3014, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.52% (2.0673 => 2.2228, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 7.51% (0.3726 => 0.4006, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 7.49% (1.0781 => 1.1589, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.48% (0.2729 => 0.2933, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 7.47% (0.2823 => 0.3034, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.46% (0.7171 => 0.7706, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 7.42% (0.3477 => 0.3735, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.39% (0.2911 => 0.3126, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.38% (0.3890 => 0.4177, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/wc: 7.36% (0.3096 => 0.3324, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.34% (0.4139 => 0.4443, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.31% (0.2736 => 0.2936, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.29% (0.3060 => 0.3283, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 7.28% (0.3267 => 0.3505, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.28% (0.3625 => 0.3889, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 7.26% (0.3678 => 0.3945, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 7.25% (0.1421 => 0.1524, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.24% (0.3258 => 0.3494, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 7.24% (0.3317 => 0.3557, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.20% (0.3124 => 0.3349, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.20% (0.3362 => 0.3604, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.18% (0.3930 => 0.4212, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.15% (0.4251 => 0.4555, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.14% (0.5026 => 0.5385, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.14% (0.5900 => 0.6321, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.13% (0.3282 => 0.3516, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 7.11% (0.3348 => 0.3586, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.10% (0.1549 => 0.1659, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 7.06% (4.2109 => 4.5083, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.98% (0.1462 => 0.1564, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 6.98% (0.1505 => 0.1610, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.97% (0.4146 => 0.4435, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.94% (0.3845 => 0.4112, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.88% (0.3690 => 0.3944, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.88% (0.3271 => 0.3496, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 6.86% (1.8794 => 2.0084, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.84% (0.6435 => 0.6875, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.83% (0.3981 => 0.4253, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.78% (0.4658 => 0.4974, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.76% (0.3903 => 0.4167, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.76% (4.4195 => 4.7181, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.72% (0.2737 => 0.2921, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 6.63% (1.4269 => 1.5215, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.62% (0.2068 => 0.2205, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 6.58% (0.4029 => 0.4294, std.dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 6.57% (2.1013 => 2.2393, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.52% (0.2040 => 0.2173, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.50% (0.1968 => 0.2096, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.50% (0.2969 => 0.3162, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 6.42% (0.5546 => 0.5902, std.dev.: 0.0024) MultiSource/Benchmarks/Bullet/bullet: 6.31% (23.5202 => 25.0054, std.dev.: 0.0075) MultiSource/Applications/minisat/minisat: 6.29% (0.3336 => 0.3546, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 6.28% (0.5012 => 0.5327, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 6.26% (4.6177 => 4.9069, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.18% (0.2103 => 0.2233, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.07% (0.7426 => 0.7877, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 6.07% (2.1653 => 2.2967, std.dev.: 0.0020) MultiSource/Applications/hbd/hbd: 6.06% (0.9697 => 1.0285, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.83% (1.9694 => 2.0842, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/football/football: 5.78% (0.2075 => 0.2195, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 5.78% (0.7875 => 0.8330, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 5.73% (2.0346 => 2.1512, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.69% (0.5361 => 0.5666, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.57% (1.9966 => 2.1078, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 5.48% (0.2391 => 0.2522, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.28% (0.5584 => 0.5879, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 5.17% (0.2691 => 0.2830, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.00% (11.6398 => 12.2216, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.68% (4.6926 => 4.9123, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.54% (0.4253 => 0.4446, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 4.35% (0.3498 => 0.3650, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 3.19% (11.9555 => 12.3366, std.dev.: 0.0128) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6094, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6732, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-2: 4.76% (1.8057 => 1.8916, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1672, std.dev.: 0.0091) SingleSource/Benchmarks/Dhrystone/dry: 4.22% (14.0481 => 14.6415, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1990, std.dev.: 0.0073) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5040, std.dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.80% (3.1722 => 3.2293, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2863, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5142, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5822, std.dev.: 0.0185) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.78% (25.4195 => 16.5796, std.dev.: 0.0100) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9752, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7872, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/tsp/tsp: -7.30% (2.1113 => 1.9571, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7951, std.dev.: 0.0113) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7732, std.dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: -2.97% (17.2379 => 16.7267, std.dev.: 0.0752) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.73% (0.6293 => 0.6121, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.21% (41.7953 => 40.8708, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5713, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4956, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (105.3826 => 104.1610, std.dev.: 0.0367) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.03% (16.2163 => 16.0490, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 10 15:00:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 10 Oct 2012 17:00:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121010220004.0C0B02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4774?compare_to=4771&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4774, Order: 165644, Start Time: 2012-10-10 20:47:14, End Time: 2012-10-10 22:01:52 To: 4771, Order: 165639, Start Time: 2012-10-10 19:03:38, End Time: 2012-10-10 20:18:10 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (185 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1042 (751 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.73% (2.0176 => 2.4963, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.30% (0.1410 => 0.1668, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 17.31% (0.0826 => 0.0969, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 15.87% (0.2243 => 0.2599, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 13.52% (0.1013 => 0.1150, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.19% (0.0834 => 0.0944) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.02% (0.1413 => 0.1597, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 12.79% (1.3693 => 1.5444, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 12.66% (0.7038 => 0.7929, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.64% (0.2721 => 0.3065, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.37% (3.9660 => 4.4567, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.36% (0.1327 => 0.1491, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.24% (0.0964 => 0.1082, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.22% (0.1588 => 0.1782, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.13% (0.1072 => 0.1202, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.91% (1.4563 => 1.6298, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.83% (0.2596 => 0.2903, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 11.81% (0.4328 => 0.4839, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.77% (0.9199 => 1.0282, std.dev.: 0.0062) MultiSource/Applications/SPASS/SPASS: 11.75% (13.8202 => 15.4439, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.61% (1.2193 => 1.3609, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.60% (0.5265 => 0.5876, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.60% (0.6959 => 0.7766, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash: 11.47% (0.4062 => 0.4528, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.43% (0.6283 => 0.7001, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.34% (1.1364 => 1.2653, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.34% (0.7710 => 0.8584, std.dev.: 0.0040) MultiSource/Applications/aha/aha: 11.11% (0.1062 => 0.1180, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.09% (0.3130 => 0.3477, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 11.07% (0.5818 => 0.6462, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 10.97% (0.1003 => 0.1113) MultiSource/Applications/lemon/lemon: 10.85% (1.0313 => 1.1432, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.85% (0.3899 => 0.4322, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.77% (0.5748 => 0.6367, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.58% (0.5577 => 0.6167, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.47% (0.3485 => 0.3850, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.46% (0.1157 => 0.1278, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.43% (0.4016 => 0.4435, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 10.38% (0.7061 => 0.7794, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 10.37% (1.1061 => 1.2208, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 10.36% (0.2781 => 0.3069, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.35% (0.4791 => 0.5287, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.25% (0.3756 => 0.4141, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.23% (0.1075 => 0.1185) SingleSource/Benchmarks/Shootout-C++/lists: 10.20% (0.3293 => 0.3629, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.20% (0.3246 => 0.3577, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 10.14% (0.6744 => 0.7428, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.14% (0.2782 => 0.3064, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 10.12% (0.2995 => 0.3298, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.03% (0.3022 => 0.3325, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.00% (0.3489 => 0.3838, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 9.99% (16.6129 => 18.2719, std.dev.: 0.0280) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.97% (0.2127 => 0.2339, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.93% (0.4379 => 0.4814, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/chomp: 9.88% (0.1589 => 0.1746, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.83% (0.3580 => 0.3932, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 9.83% (0.8310 => 0.9127, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.80% (0.1276 => 0.1401, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 9.75% (0.3868 => 0.4245, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 9.68% (3.1889 => 3.4975, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.68% (0.2966 => 0.3253, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 9.66% (0.3220 => 0.3531, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.64% (0.2914 => 0.3195, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: 9.64% (1.9270 => 2.1128, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.64% (0.7460 => 0.8179, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/mst/mst: 9.63% (0.1111 => 0.1218, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 9.59% (0.3534 => 0.3873, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 9.59% (0.3453 => 0.3784, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.57% (1.9828 => 2.1726, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 9.57% (0.2760 => 0.3024, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 9.55% (0.2690 => 0.2947, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 9.55% (0.2607 => 0.2856, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.54% (0.4390 => 0.4809, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.54% (0.5637 => 0.6175, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.54% (0.8698 => 0.9528, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 9.53% (0.3107 => 0.3403, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 9.50% (3.8646 => 4.2318, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/strcat: 9.50% (0.2726 => 0.2985, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.49% (0.2655 => 0.2907, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 9.49% (0.2761 => 0.3023, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.48% (0.2765 => 0.3027, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 9.47% (2.1791 => 2.3855, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 9.44% (0.2628 => 0.2876, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.42% (0.1986 => 0.2173, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.41% (0.1435 => 0.1570, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 9.40% (0.2937 => 0.3213, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 9.37% (0.3149 => 0.3444, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 9.37% (0.7506 => 0.8209, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.35% (7.2180 => 7.8927, std.dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 9.28% (1.0594 => 1.1577, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.20% (0.2696 => 0.2944, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 9.20% (0.2925 => 0.3194, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.19% (0.2023 => 0.2209, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.18% (0.1569 => 0.1713, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.12% (0.1865 => 0.2035, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 9.10% (0.3131 => 0.3416, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 9.09% (0.3192 => 0.3482, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 9.07% (0.2988 => 0.3259, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 9.07% (0.1478 => 0.1612, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.91% (0.6576 => 0.7162, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.83% (1.3245 => 1.4414, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 8.63% (1.2749 => 1.3849, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.61% (4.9865 => 5.4158, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 8.59% (0.2945 => 0.3198, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.59% (3.6692 => 3.9844, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 8.53% (14.8535 => 16.1200, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/em3d/em3d: 8.51% (0.1657 => 0.1798, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.50% (0.3755 => 0.4074, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.37% (4.3801 => 4.7468, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.34% (4.4433 => 4.8137, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 8.26% (8.4961 => 9.1979, std.dev.: 0.0109) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.12% (0.3511 => 0.3796, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.08% (0.2140 => 0.2313, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 8.06% (4.6629 => 5.0385, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.03% (0.8818 => 0.9526, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.02% (0.6135 => 0.6627, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.92% (1.5188 => 1.6391, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.88% (0.1789 => 0.1930, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.80% (3.2742 => 3.5296, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.75% (1.1333 => 1.2211, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.63% (0.9108 => 0.9803, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.58% (0.4805 => 0.5169, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 7.56% (0.4113 => 0.4424, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: 7.47% (0.6250 => 0.6717, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 7.38% (6.5754 => 7.0604, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/neural/neural: 7.36% (0.1385 => 0.1487, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.32% (0.2321 => 0.2491, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.27% (0.2504 => 0.2686, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 7.14% (3.7467 => 4.0141, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.07% (2.1007 => 2.2493, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 6.92% (0.2008 => 0.2147, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 6.92% (1.2292 => 1.3142, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.81% (0.3245 => 0.3466, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 6.75% (0.3914 => 0.4178, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 6.72% (0.4003 => 0.4272, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.71% (0.1819 => 0.1941, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.65% (13.2842 => 14.1672, std.dev.: 0.0070) SingleSource/UnitTests/ObjC/property: 6.57% (0.3940 => 0.4199, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.47% (0.3789 => 0.4034, std.dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.46% (6.2785 => 6.6844, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/trivial-interface: 6.43% (0.3578 => 0.3808, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 6.29% (0.3623 => 0.3851, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 6.28% (0.3646 => 0.3875, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 6.22% (0.3663 => 0.3891, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 6.19% (0.3601 => 0.3824, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.14% (0.3650 => 0.3874, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.17% (0.2243 => 0.2359, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 4.93% (16.2614 => 17.0629, std.dev.: 0.0089) MultiSource/Applications/ClamAV/clamscan: 4.32% (14.5298 => 15.1582, std.dev.: 0.0087) MultiSource/Benchmarks/Bullet/bullet: 1.42% (33.2944 => 33.7658, std.dev.: 0.0081) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.48% (5.7573 => 7.5119, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.06% (1.0895 => 1.3625, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.02% (1.8175 => 2.2540, std.dev.: 0.0223) SingleSource/Benchmarks/Misc/richards_benchmark: 11.19% (1.1560 => 1.2854, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 9.03% (0.8273 => 0.9020, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.47% (0.1322 => 0.1434, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (3.1736 => 3.4147, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.18% (1.2998 => 1.3801, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.64% (1.9144 => 2.0033, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7747, std.dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6763, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9856, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.34% (10.7476 => 11.1064, std.dev.: 0.0328) SingleSource/Regression/C/uint64_to_float: 2.97% (0.5449 => 0.5611, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.09% (7.4271 => 7.5826, std.dev.: 0.0044) MultiSource/Applications/lemon/lemon: 1.73% (1.4298 => 1.4545, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5146, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2126, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1880, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5787, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.13% (8.8259 => 8.9256, std.dev.: 0.0134) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0271, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1407, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5863, std.dev.: 0.0061) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.93% (0.2670 => 0.1417, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.51% (0.4657 => 0.3888, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -14.43% (0.0707 => 0.0605) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.28% (1.3813 => 1.1978, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.18% (1.3819 => 1.1998, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.74% (22.5627 => 22.1705, std.dev.: 0.0125) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.94% (0.0997 => 0.0858, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -12.06% (0.2238 => 0.1968, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -10.86% (1.2308 => 1.0971, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.03% (20.3410 => 18.3004, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0126) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.45% (1.3780 => 1.3029, std.dev.: 0.0080) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5150, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.50% (0.9996 => 0.9546, std.dev.: 0.0018) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1559, std.dev.: 0.0257) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.49% (1.7688 => 1.7070, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4785, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.48% (3.0263 => 2.9511, std.dev.: 0.0010) MultiSource/Applications/lua/lua: -2.43% (26.5159 => 25.8703, std.dev.: 0.0075) MultiSource/Benchmarks/Olden/bh/bh: -2.37% (1.9762 => 1.9293, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7141, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.74% (6.3560 => 6.2457, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.56% (0.6615 => 0.6512) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0064, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -1.45% (4.5928 => 4.5264, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/heapsort: -1.24% (3.9173 => 3.8686, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4945, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: -1.15% (9.3358 => 9.2283, std.dev.: 0.0147) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2590, std.dev.: 0.0015) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 10 15:48:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 10 Oct 2012 17:48:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121010224819.2452E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4775?compare_to=4772&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4775, Order: 165655, Start Time: 2012-10-10 21:30:38, End Time: 2012-10-10 22:50:06 To: 4772, Order: 165644, Start Time: 2012-10-10 19:24:17, End Time: 2012-10-10 20:43:36 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (158 on baseline) Performance Improvements: 2 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1023 (759 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -1.37% (11.7206 => 11.5600, std.dev.: 0.0046) MultiSource/Benchmarks/PAQ8p/paq8p: -1.33% (15.0945 => 14.8936, std.dev.: 0.0073) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.20% (0.5935 => 0.5923, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: -0.34% (16.4152 => 16.3597, std.dev.: 0.0229) MultiSource/Benchmarks/Bullet/bullet: -0.39% (55.4448 => 55.2280, std.dev.: 0.0175) MultiSource/Benchmarks/MallocBench/gs/gs: 0.09% (4.4231 => 4.4272, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.25% (1.2575 => 1.2543, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.47% (7.8740 => 7.8366, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.03% (0.7419 => 0.7417, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.83% (0.0361 => 0.0364, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1431 => 0.1431, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0645 => 0.0645, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -12.67% (63.2438 => 55.2280, std.dev.: 0.0175) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 33.06% (14.1553 => 18.8352, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.22% (3.4629 => 5.6523, std.dev.: 0.0045) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14231.25% (0.0720 => 10.3185, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952200.00% (0.0001 => 9.9523, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.12% (0.2554 => 0.4166, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: 43.66% (10.3673 => 14.8936, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/richards_benchmark: 37.61% (0.1622 => 0.2232, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 33.05% (0.1056 => 0.1405, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 17.60% (0.1432 => 0.1684, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.43% (2.2022 => 2.5861, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.22% (7.0540 => 8.2688, std.dev.: 0.0033) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.75% (0.1566 => 0.1797, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.49% (1.7609 => 1.9808, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.40% (0.0871 => 0.0979, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/oourafft: 12.16% (0.3282 => 0.3681, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 11.53% (0.1440 => 0.1606, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.24% (0.1584 => 0.1762, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 10.77% (10.4361 => 11.5600, std.dev.: 0.0046) MultiSource/Applications/minisat/minisat: 10.22% (0.7115 => 0.7842, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.10% (0.4879 => 0.5372, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.08% (0.1438 => 0.1583, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.95% (0.3177 => 0.3493, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.89% (0.6675 => 0.7335, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.87% (1.5415 => 1.6937, std.dev.: 0.0070) MultiSource/Applications/lambda-0_1_3/lambda: 9.85% (0.7433 => 0.8165, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 9.81% (9.4845 => 10.4150, std.dev.: 0.0168) MultiSource/Benchmarks/Olden/tsp/tsp: 9.70% (0.1175 => 0.1289, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.60% (0.1625 => 0.1781, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.57% (0.3543 => 0.3882, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 9.50% (0.3473 => 0.3803, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 9.43% (0.1655 => 0.1811, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.41% (0.2700 => 0.2954, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.33% (0.3516 => 0.3844, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.32% (0.3927 => 0.4293, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 9.31% (3.3354 => 3.6458, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/synchronized: 9.30% (0.3561 => 0.3892, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 9.29% (0.3497 => 0.3822, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.26% (0.3543 => 0.3871, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.17% (0.3828 => 0.4179, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 9.10% (0.3109 => 0.3392, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.10% (0.3694 => 0.4030, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 9.09% (0.3423 => 0.3734, std.dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 9.06% (5.7591 => 6.2809, std.dev.: 0.0096) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.01% (0.4615 => 0.5031, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 8.98% (0.3886 => 0.4235, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.92% (0.5860 => 0.6383, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/em3d/em3d: 8.85% (0.1695 => 0.1845, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.83% (0.5105 => 0.5556, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.72% (0.2271 => 0.2469, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.70% (4.2646 => 4.6356, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.68% (1.3050 => 1.4183, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.48% (0.1510 => 0.1638, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 8.47% (1.1642 => 1.2628, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.41% (5.0018 => 5.4224, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.40% (0.2107 => 0.2284, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.38% (8.1363 => 8.8185, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.37% (0.8067 => 0.8742, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.36% (0.8172 => 0.8855, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.35% (4.9449 => 5.3580, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.35% (0.5569 => 0.6034, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.33% (0.1236 => 0.1339, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 8.27% (0.3387 => 0.3667, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 8.25% (3.8723 => 4.1919, std.dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.23% (0.3121 => 0.3378, std.dev.: 0.0021) MultiSource/Applications/spiff/spiff: 8.19% (0.7835 => 0.8477, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.18% (0.9765 => 1.0564, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.16% (0.3307 => 0.3577, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.14% (0.2065 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.12% (0.2758 => 0.2982, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.09% (0.1940 => 0.2097, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: 8.09% (1.5603 => 1.6865, std.dev.: 0.0047) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.05% (7.9617 => 8.6025, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.05% (0.5020 => 0.5424, std.dev.: 0.0040) MultiSource/Applications/lemon/lemon: 7.83% (1.0722 => 1.1562, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 7.81% (0.6456 => 0.6960, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 7.80% (2.0273 => 2.1855, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.80% (1.5859 => 1.7096, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 7.78% (0.1555 => 0.1676) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.78% (0.1337 => 0.1441, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.44% (0.3441 => 0.3697, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/Hello: 7.29% (0.5925 => 0.6357) MultiSource/Benchmarks/McCat/09-vor/vor: 7.26% (0.3180 => 0.3411, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.25% (1.1861 => 1.2721, std.dev.: 0.0018) MultiSource/Applications/siod/siod: 7.19% (2.2969 => 2.4621, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 7.16% (0.6030 => 0.6462, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.11% (0.4203 => 0.4502, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 7.04% (21.9371 => 23.4812, std.dev.: 0.0109) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.03% (0.2603 => 0.2786, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.02% (0.4103 => 0.4391, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 6.97% (0.4289 => 0.4588, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.88% (0.6450 => 0.6894, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.88% (0.3865 => 0.4131, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.84% (2.2024 => 2.3531, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 6.81% (0.3422 => 0.3655, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.79% (0.4636 => 0.4951, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 6.71% (0.8921 => 0.9520, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (0.4620 => 0.4929, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.68% (0.2905 => 0.3099, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.66% (0.3650 => 0.3893, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 6.62% (0.7326 => 0.7811, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/05-eks/eks: 6.58% (0.4299 => 0.4582, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.57% (0.5981 => 0.6374, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.55% (0.4048 => 0.4313, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.51% (0.3826 => 0.4075, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.38% (0.3136 => 0.3336, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/sieve: 6.36% (0.3603 => 0.3832, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.20% (1.4186 => 1.5065, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.19% (0.1695 => 0.1800, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.11% (0.3684 => 0.3909, std.dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 6.05% (1.1840 => 1.2556, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.95% (0.2891 => 0.3063, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.91% (0.3162 => 0.3349, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 5.86% (0.2831 => 0.2997, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.81% (2.0665 => 2.1865, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 5.72% (0.3232 => 0.3417, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.67% (0.2877 => 0.3040, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.67% (0.3283 => 0.3469, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.66% (0.1892 => 0.1999, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.65% (0.3098 => 0.3273, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.61% (0.1906 => 0.2013, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 5.61% (0.2871 => 0.3032, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.50% (0.2872 => 0.3030, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.48% (0.2756 => 0.2907, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: 5.43% (0.2725 => 0.2873, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 5.41% (0.3052 => 0.3217, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.33% (0.2793 => 0.2942, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.25% (0.2266 => 0.2385, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.23% (0.2714 => 0.2856, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary2: 5.18% (0.3379 => 0.3554, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.11% (0.8101 => 0.8515, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.02% (0.4064 => 0.4268, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.74% (14.3668 => 15.0473, std.dev.: 0.0181) SingleSource/Benchmarks/Shootout-C++/objinst: 4.57% (0.3131 => 0.3274, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.23% (0.3427 => 0.3572, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 4.23% (17.1811 => 17.9074, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.16% (0.2430 => 0.2531, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.06% (1.2842 => 1.3364, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.85% (3.8922 => 4.0422, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.64% (1.1194 => 1.1490, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.83% (1.1396 => 1.2516, std.dev.: 0.0015) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4499, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3681, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: 3.66% (0.5413 => 0.5611, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.54% (3.6395 => 3.7683, std.dev.: 0.0059) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.79% (4.2280 => 4.3459, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.55% (0.8275 => 0.8403, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8129, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.38% (0.9540 => 0.9672, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.29% (9.1159 => 9.2339, std.dev.: 0.0234) SingleSource/Benchmarks/McGill/queens: 1.11% (2.1825 => 2.2068, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.07% (2.6546 => 2.6831, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5755, std.dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1310, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.11% (5.2763 => 3.2655, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.57% (5.3855 => 3.6853, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.18% (5.3526 => 3.6834, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -14.52% (54.1659 => 46.3013, std.dev.: 0.0197) MultiSource/Applications/ClamAV/clamscan: -10.78% (22.1758 => 19.7858, std.dev.: 0.0167) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.59% (2.9384 => 2.6272, std.dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.54% (1.1492 => 0.7638, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.96% (1.6925 => 1.4224, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.53% (0.0998 => 0.0863, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -12.04% (1.2373 => 1.0883, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/mandel-2: -10.30% (1.5373 => 1.3789, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/mason/mason: -9.81% (0.2161 => 0.1949, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.39% (19.9488 => 18.2751, std.dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.67% (1.8329 => 1.7107, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.30% (1.6805 => 1.5914, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -5.00% (1.5835 => 1.5043, std.dev.: 0.0040) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.88% (0.9957 => 0.9571, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1625, std.dev.: 0.0071) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4968, std.dev.: 0.0069) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0989, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.37% (8.1563 => 7.9634, std.dev.: 0.0267) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.88% (8.6802 => 8.5172, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/salsa20: -1.80% (10.2830 => 10.0975, std.dev.: 0.0186) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6835, std.dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -1.69% (2.5528 => 2.5097, std.dev.: 0.0022) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4207, std.dev.: 0.0117) MultiSource/Applications/sqlite3/sqlite3: -1.10% (4.6441 => 4.5928, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8579, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout/lists: -1.01% (6.2999 => 6.2363, std.dev.: 0.0041) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.27% (0.5229 => 0.5923, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 9.14% (14.9895 => 16.3597, std.dev.: 0.0229) MultiSource/Benchmarks/MallocBench/gs/gs: 7.70% (4.1105 => 4.4272, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.53% (1.1048 => 1.2543, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.48% (7.1582 => 7.8366, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.21% (0.6222 => 0.7417, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36300.00% (0.0001 => 0.0364, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.52% (0.2116 => 0.0645, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 10 17:12:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 10 Oct 2012 19:12:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121011001248.D3FA72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4776?compare_to=4773&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4776, Order: 165655, Start Time: 2012-10-10 21:30:42, End Time: 2012-10-11 00:14:37 To: 4773, Order: 165633, Start Time: 2012-10-10 18:15:46, End Time: 2012-10-10 20:59:39 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (135 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 1039 (828 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.44% (2.0436 => 2.0935, std.dev.: 0.0171) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.03% (54.2284 => 54.7869, std.dev.: 0.0401) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.00% (2.9358 => 2.9063, std.dev.: 0.0061) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.91% (0.1063 => 0.1179, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 10.80% (1.5932 => 1.7653, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-2: 10.19% (0.3446 => 0.3797, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.15% (0.3488 => 0.3842, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.13% (0.3465 => 0.3816, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/for-in: 10.13% (0.3496 => 0.3850, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.11% (0.3442 => 0.3790, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.06% (0.3469 => 0.3818, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.03% (0.3460 => 0.3807, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.02% (0.3643 => 0.4008, std.dev.: 0.0069) SingleSource/UnitTests/ObjC/property: 9.97% (0.3650 => 0.4014, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 9.72% (0.3724 => 0.4086, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 8.78% (0.1218 => 0.1325, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.58% (0.1620 => 0.1759, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 8.28% (0.1619 => 0.1753, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.05% (0.4994 => 0.5396, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: 7.90% (0.5826 => 0.6286, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.88% (0.5889 => 0.6353, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.82% (0.4361 => 0.4702, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.77% (1.3152 => 1.4174, std.dev.: 0.0056) SingleSource/Regression/C++/ofstream_ctor: 7.62% (0.3004 => 0.3233, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 7.61% (0.4847 => 0.5216, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 7.60% (0.2566 => 0.2761, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.57% (1.6211 => 1.7438, std.dev.: 0.0074) MultiSource/Applications/SPASS/SPASS: 7.47% (5.5417 => 5.9556, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.45% (0.2738 => 0.2942, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 7.26% (1.0781 => 1.1564, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.20% (0.2875 => 0.3082, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 7.18% (0.1421 => 0.1523, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 7.16% (0.2750 => 0.2947, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.16% (0.5026 => 0.5386, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.16% (0.5000 => 0.5358, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.15% (0.2014 => 0.2158, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: 7.09% (0.2780 => 0.2977, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.08% (3.5627 => 3.8150, std.dev.: 0.0111) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.07% (0.3930 => 0.4208, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.06% (0.3625 => 0.3881, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.04% (0.3195 => 0.3420, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 7.04% (0.2813 => 0.3011, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.96% (0.2068 => 0.2212, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.93% (0.2729 => 0.2918, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.89% (0.4139 => 0.4424, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 6.87% (0.2823 => 0.3017, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 6.86% (0.2725 => 0.2912, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.85% (0.5900 => 0.6304, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 6.83% (0.9909 => 1.0586, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 6.83% (0.6634 => 0.7087, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 6.83% (0.3267 => 0.3490, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.81% (0.2792 => 0.2982, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 6.80% (4.2109 => 4.4974, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.80% (2.0673 => 2.2078, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 6.79% (0.2811 => 0.3002, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.76% (0.2736 => 0.2921, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 6.72% (0.3258 => 0.3477, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 6.72% (0.3678 => 0.3925, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 6.71% (0.1505 => 0.1606, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 6.71% (0.2803 => 0.2991, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.71% (0.2714 => 0.2896, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: 6.70% (0.3477 => 0.3710, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 6.67% (0.9697 => 1.0344, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 6.67% (0.7171 => 0.7649, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 6.66% (1.8794 => 2.0046, std.dev.: 0.0080) MultiSource/Applications/spiff/spiff: 6.65% (0.4029 => 0.4297, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.65% (0.1549 => 0.1652, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.60% (0.3060 => 0.3262, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.59% (0.2866 => 0.3055, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 6.55% (1.4269 => 1.5203, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.53% (4.4195 => 4.7081, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/sieve: 6.49% (0.3726 => 0.3968, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.49% (2.7292 => 2.9063, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ary2: 6.48% (0.3317 => 0.3532) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.45% (0.3271 => 0.3482, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.43% (0.3282 => 0.3493, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.43% (0.3096 => 0.3295, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.42% (0.3362 => 0.3578, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.42% (0.2911 => 0.3098, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 6.39% (0.3348 => 0.3562, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.31% (0.3124 => 0.3321, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 6.28% (0.2691 => 0.2860, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.20% (0.3903 => 0.4145, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.20% (0.2969 => 0.3153, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.16% (0.3084 => 0.3274, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 6.15% (0.3336 => 0.3541, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.14% (0.3890 => 0.4129, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.14% (0.4251 => 0.4512, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.10% (0.1968 => 0.2088, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.10% (0.3690 => 0.3915, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 6.09% (23.5202 => 24.9519, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.07% (0.2737 => 0.2903, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.05% (0.4146 => 0.4397, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.05% (0.3981 => 0.4222, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.03% (0.2040 => 0.2163, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/football/football: 6.02% (0.2075 => 0.2200, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.98% (0.6435 => 0.6820, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 5.96% (2.1653 => 2.2943, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 5.95% (4.6177 => 4.8923, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.88% (0.4658 => 0.4932, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: 5.88% (0.5546 => 0.5872, std.dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 5.81% (2.1013 => 2.2233, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.80% (0.2103 => 0.2225, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 5.79% (2.0346 => 2.1525, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.75% (0.3845 => 0.4066, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.66% (0.7426 => 0.7846, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 5.65% (0.2391 => 0.2526, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 5.63% (0.5012 => 0.5294, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.55% (1.9694 => 2.0788, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.43% (0.5361 => 0.5652, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 5.42% (0.7875 => 0.8302, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.13% (1.9966 => 2.0990, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.80% (0.5584 => 0.5852, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.76% (11.6398 => 12.1938, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.32% (4.6926 => 4.8954, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 4.03% (0.3498 => 0.3639, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.01% (0.4253 => 0.4381, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 2.85% (11.9555 => 12.2965, std.dev.: 0.0129) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 65.40% (0.2162 => 0.3576, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6092, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6734, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-2: 4.98% (1.8057 => 1.8957, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1646, std.dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/dry: 4.19% (14.0481 => 14.6373, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/ary3: 2.09% (15.8721 => 16.2042, std.dev.: 0.0031) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5044, std.dev.: 0.0253) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.66% (3.1722 => 3.2248, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2883, std.dev.: 0.0037) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5843, std.dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.80% (25.4195 => 16.5725, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ary2: -10.74% (0.2402 => 0.2144, std.dev.: 0.0065) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9740, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7956, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.7998, std.dev.: 0.0092) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7727, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.81% (0.6293 => 0.6116, std.dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/fldry: -2.52% (17.2379 => 16.8037, std.dev.: 0.0126) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8625, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5761, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4962, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.15% (105.3826 => 104.1735, std.dev.: 0.0505) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0469, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 10 17:39:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 10 Oct 2012 19:39:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121011003930.5B06C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4777?compare_to=4775&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4777, Order: 165669, Start Time: 2012-10-10 23:21:10, End Time: 2012-10-11 00:41:19 To: 4775, Order: 165655, Start Time: 2012-10-10 21:30:38, End Time: 2012-10-10 22:50:06 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 1 (3 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 44 (164 on baseline) Performance Improvements: 18 (44 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 962 (750 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.32% (0.0529 => 0.0522, std.dev.: 0.0015) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.35% (1.9808 => 2.1859, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 4.71% (14.8936 => 15.5948, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.40% (0.7335 => 0.7511, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.32% (0.5424 => 0.5550, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.25% (0.6894 => 0.7049, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.03% (0.5556 => 0.5669, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.86% (8.2688 => 8.4227, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 1.25% (6.2809 => 6.3597, std.dev.: 0.0092) MultiSource/Applications/JM/ldecod/ldecod: 1.02% (11.5600 => 11.6781, std.dev.: 0.0048) MultiSource/Benchmarks/nbench/nbench: 1.02% (1.2556 => 1.2684, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 23.30% (0.9571 => 1.1801, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 14.60% (0.4712 => 0.5400, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 12.10% (5.4095 => 6.0643, std.dev.: 0.0150) SingleSource/Benchmarks/Misc/fp-convert: 9.79% (3.3454 => 3.6730, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.70% (3.7683 => 4.0584, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 5.06% (27.7194 => 29.1229, std.dev.: 0.0019) MultiSource/Applications/aha/aha: 4.94% (3.4499 => 3.6202, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 4.71% (7.9634 => 8.3387, std.dev.: 0.0084) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 4.14% (6.5755 => 6.8480, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: 4.05% (18.2751 => 19.0153, std.dev.: 0.2477) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.01% (78.8059 => 81.9640, std.dev.: 0.8980) SingleSource/Benchmarks/Misc/flops-8: 3.92% (1.7613 => 1.8304, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.82% (2.5754 => 2.6738, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.64% (4.4070 => 4.5673, std.dev.: 0.0117) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 3.41% (1.4908 => 1.5416) MultiSource/Applications/hexxagon/hexxagon: 3.04% (12.0989 => 12.4666, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 2.90% (2.9506 => 3.0363, std.dev.: 0.0095) MultiSource/Applications/minisat/minisat: 2.90% (9.2339 => 9.5018, std.dev.: 0.0158) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.79% (13.4452 => 13.8197, std.dev.: 0.0200) MultiSource/Applications/lemon/lemon: 2.76% (1.4359 => 1.4755, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 2.69% (31.4968 => 32.3443, std.dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: 2.63% (85.3911 => 87.6364, std.dev.: 0.0065) MultiSource/Applications/JM/lencod/lencod: 2.33% (10.3185 => 10.5588, std.dev.: 0.0108) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.32% (55.0530 => 56.3299, std.dev.: 0.0223) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.23% (1.3169 => 1.3463, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.13% (0.6470 => 0.6608) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.05% (1.7107 => 1.7458, std.dev.: 0.0046) SingleSource/Benchmarks/McGill/queens: 1.79% (2.2068 => 2.2464, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.54% (1.3845 => 1.4058) SingleSource/Benchmarks/Misc/salsa20: 1.36% (10.0975 => 10.2349, std.dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.31% (0.9672 => 0.9799, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.16% (6.6688 => 6.7459, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.12% (9.9523 => 10.0636, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.02% (1.5429 => 1.5587, std.dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/05-eks/eks: -6.53% (0.4582 => 0.4283, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: -5.63% (0.3392 => 0.3201) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -2.43% (5.3580 => 5.2280, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -2.33% (5.4224 => 5.2961, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: -1.81% (10.4150 => 10.2261, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.45% (2.3531 => 2.3190, std.dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: -25.58% (0.6963 => 0.5182, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: -13.37% (1.0883 => 0.9428, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -10.10% (0.3625 => 0.3259, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -6.24% (1.2871 => 1.2068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.72% (29.6120 => 28.2136, std.dev.: 0.0625) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.07% (0.8547 => 0.8199, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -4.03% (2.2900 => 2.1978, std.dev.: 0.0009) MultiSource/Applications/lua/lua: -3.62% (26.0692 => 25.1262, std.dev.: 0.0218) SingleSource/UnitTests/Vector/multiplies: -2.92% (2.5097 => 2.4365, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-5: -2.01% (1.5043 => 1.4740, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.49% (3.4587 => 3.4072, std.dev.: 0.0105) MultiSource/Benchmarks/sim/sim: -1.34% (4.7964 => 4.7322, std.dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.56% (0.5923 => 0.5890, std.dev.: 0.0055) MultiSource/Applications/SPASS/SPASS: -0.16% (16.3597 => 16.3328, std.dev.: 0.0064) MultiSource/Benchmarks/Bullet/bullet: 0.16% (55.2280 => 55.3150, std.dev.: 0.0221) MultiSource/Benchmarks/MallocBench/gs/gs: -0.29% (4.4272 => 4.4143, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.06% (1.2543 => 1.2801, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.07% (7.8366 => 7.8418, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.18% (0.7417 => 0.7404, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -1.37% (0.0364 => 0.0359, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 2.38% (0.1431 => 0.1465, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.24% (0.0645 => 0.0653, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -12.54% (63.2438 => 55.3150, std.dev.: 0.0221) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.57% (0.0611 => 0.0522, std.dev.: 0.0015) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 33.15% (14.1553 => 18.8472, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.11% (3.4629 => 5.6482, std.dev.: 0.0025) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14565.00% (0.0720 => 10.5588, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10063500.00% (0.0001 => 10.0636, std.dev.: 0.0013) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 62.76% (0.2554 => 0.4157, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 50.42% (10.3673 => 15.5948, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: 38.22% (0.1622 => 0.2242, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: 33.71% (0.1056 => 0.1412, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 24.14% (1.7609 => 2.1859, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.40% (7.0540 => 8.4227, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 17.81% (0.1432 => 0.1687, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.28% (2.2022 => 2.5827, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 15.01% (0.0746 => 0.0858, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.35% (0.0871 => 0.0996, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.79% (0.1566 => 0.1782, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.52% (0.6675 => 0.7511, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 11.90% (10.4361 => 11.6781, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/power/power: 11.74% (0.1440 => 0.1609, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 11.43% (0.3282 => 0.3657, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.05% (0.5105 => 0.5669, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.83% (0.3177 => 0.3521, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.78% (0.3543 => 0.3925, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 10.63% (0.1655 => 0.1831, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.56% (0.5020 => 0.5550, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 10.43% (5.7591 => 6.3597, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.37% (0.4879 => 0.5385, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 10.28% (0.7433 => 0.8197, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.19% (0.3473 => 0.3827, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.15% (1.5415 => 1.6980, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 10.08% (0.3423 => 0.3768, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.04% (0.3497 => 0.3848, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.03% (0.3561 => 0.3918, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.02% (0.3543 => 0.3898, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.98% (0.3516 => 0.3867, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.93% (0.3927 => 0.4317, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.89% (0.2700 => 0.2967, std.dev.: 0.0026) MultiSource/Applications/d/make_dparser: 9.88% (3.3354 => 3.6651, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 9.87% (0.7115 => 0.7817, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.82% (0.2271 => 0.2494, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 9.80% (0.3828 => 0.4203, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 9.79% (0.1175 => 0.1290, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.78% (0.3886 => 0.4266, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.72% (0.1625 => 0.1783, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.66% (0.3694 => 0.4051, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.66% (0.1584 => 0.1737, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.47% (0.1236 => 0.1353, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.29% (0.6450 => 0.7049, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.21% (0.1510 => 0.1649, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.16% (0.2107 => 0.2300, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 9.12% (0.1151 => 0.1256, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.04% (0.3307 => 0.3606, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.93% (8.1363 => 8.8631, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.88% (0.8067 => 0.8783, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 8.82% (1.1642 => 1.2669, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.81% (0.2758 => 0.3001, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.80% (0.5569 => 0.6059, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 8.76% (3.8723 => 4.2116, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.74% (0.5860 => 0.6372, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 8.67% (0.1695 => 0.1842, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.53% (4.2646 => 4.6285, std.dev.: 0.0076) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.46% (0.8172 => 0.8863, std.dev.: 0.0065) MultiSource/Applications/hbd/hbd: 8.45% (1.5603 => 1.6922, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.35% (0.1940 => 0.2102, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.34% (0.1438 => 0.1558, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 8.34% (1.0722 => 1.1616, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.26% (0.2603 => 0.2818, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.15% (0.9765 => 1.0561, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/bigfib: 8.15% (0.6456 => 0.6982, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 8.05% (2.0273 => 2.1904, std.dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: 8.04% (0.1555 => 0.1680, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.95% (1.3050 => 1.4088, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.89% (0.2065 => 0.2228, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 7.88% (0.3387 => 0.3654, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 7.82% (9.4845 => 10.2261, std.dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.74% (0.4615 => 0.4972, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 7.72% (0.7835 => 0.8440, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.64% (0.3441 => 0.3704, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 7.61% (0.8921 => 0.9600, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 7.50% (2.2969 => 2.4692, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 7.48% (0.3180 => 0.3418, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.33% (0.4636 => 0.4976, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.25% (7.9617 => 8.5387, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 7.24% (0.5925 => 0.6354, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference-object: 7.23% (0.6030 => 0.6466, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.20% (0.1695 => 0.1817, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.14% (0.5981 => 0.6408, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 7.13% (1.1840 => 1.2684, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.11% (0.3121 => 0.3343, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 7.06% (21.9371 => 23.4855, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.97% (0.4103 => 0.4389, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.93% (0.3865 => 0.4133, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 6.88% (0.4289 => 0.4584, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.82% (0.3826 => 0.4087, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.80% (0.4203 => 0.4489, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 6.72% (0.3422 => 0.3652, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.71% (1.1861 => 1.2657, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.71% (0.2266 => 0.2418, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 6.70% (0.7326 => 0.7817, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: 6.56% (0.4620 => 0.4923, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.51% (0.1906 => 0.2030, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 6.47% (0.4048 => 0.4310, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.33% (0.3650 => 0.3881, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.10% (1.4186 => 1.5051, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.03% (0.3136 => 0.3325) SingleSource/Regression/C++/ofstream_ctor: 5.96% (0.2905 => 0.3078, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 5.94% (0.3684 => 0.3903, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.93% (1.5859 => 1.6799, std.dev.: 0.0170) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.91% (0.8101 => 0.8580, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 5.91% (0.3603 => 0.3816, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.88% (5.0018 => 5.2961, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.85% (0.2891 => 0.3060, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.73% (4.9449 => 5.2280, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.70% (0.2756 => 0.2913, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.56% (2.0665 => 2.1813, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/strcat: 5.55% (0.2831 => 0.2988, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 5.51% (0.2049 => 0.2162, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 5.50% (0.2871 => 0.3029, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.42% (0.2877 => 0.3033, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 5.41% (0.3232 => 0.3407, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.29% (2.2024 => 2.3190, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 5.28% (0.2725 => 0.2869, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.26% (0.2872 => 0.3023, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 5.24% (0.3052 => 0.3212, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 5.24% (0.3283 => 0.3455, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.16% (0.3098 => 0.3258, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.16% (0.2793 => 0.2937, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.14% (14.3668 => 15.1057, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hello: 5.08% (0.2714 => 0.2852, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: 5.03% (0.2802 => 0.2943, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.92% (0.4064 => 0.4264, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.79% (0.3427 => 0.3591, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 4.57% (17.1811 => 17.9664, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 4.41% (0.3131 => 0.3269, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.20% (1.2842 => 1.3382, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.20% (0.2430 => 0.2532, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.13% (3.8922 => 4.0141, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.00% (1.1194 => 1.1530, std.dev.: 0.0114) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 26.14% (1.1145 => 1.4058) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 18.52% (0.9957 => 1.1801, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 14.58% (3.1595 => 3.6202, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 12.31% (0.4808 => 0.5400, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.51% (3.6395 => 4.0584, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8904 => 3.2024, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: 9.80% (3.3453 => 3.6730, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.78% (1.1396 => 1.2510, std.dev.: 0.0017) SingleSource/Benchmarks/Stanford/Puzzle: 7.95% (0.1421 => 0.1534, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.80% (3.1578 => 3.3725, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 5.21% (6.5088 => 6.8480, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 4.59% (27.8444 => 29.1229, std.dev.: 0.0019) MultiSource/Benchmarks/BitBench/drop3/drop3: 4.30% (0.4162 => 0.4341, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 4.23% (9.1159 => 9.5018, std.dev.: 0.0158) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.08% (4.3882 => 4.5673, std.dev.: 0.0117) MultiSource/Applications/spiff/spiff: 3.47% (2.9346 => 3.0363, std.dev.: 0.0095) MultiSource/Benchmarks/PAQ8p/paq8p: 3.02% (85.0658 => 87.6364, std.dev.: 0.0065) SingleSource/Benchmarks/McGill/queens: 2.93% (2.1825 => 2.2464, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.84% (13.4384 => 13.8197, std.dev.: 0.0200) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.84% (4.2280 => 4.3479, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.71% (0.9540 => 0.9799, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: 2.33% (0.5413 => 0.5539, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.24% (8.1563 => 8.3387, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.23% (1.7254 => 1.7639, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 2.04% (1.4460 => 1.4755, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 1.50% (6.6465 => 6.7459, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.40% (2.6546 => 2.6918, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.05% (6.6874 => 0.1304, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.07% (0.8651 => 0.1724, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.29% (5.2763 => 3.2562, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.24% (5.3855 => 3.7032, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.82% (5.3526 => 3.7027, std.dev.: 0.0046) SingleSource/UnitTests/Vector/constpool: -14.69% (54.1659 => 46.2084, std.dev.: 0.0164) MultiSource/Benchmarks/FreeBench/mason/mason: -12.33% (0.0811 => 0.0711, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -10.43% (22.1758 => 19.8626, std.dev.: 0.0102) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.32% (2.9384 => 2.6352, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -44.25% (0.0400 => 0.0223) SingleSource/Benchmarks/Misc/mandel: -33.44% (1.1492 => 0.7649, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/puzzle: -25.57% (0.6962 => 0.5182, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: -23.80% (1.2373 => 0.9428, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: -16.72% (1.6925 => 1.4095, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.53% (0.0998 => 0.0863, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -11.01% (1.5373 => 1.3680) MultiSource/Benchmarks/FreeBench/mason/mason: -10.09% (0.2161 => 0.1943, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -6.92% (1.5835 => 1.4740, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4833, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -6.26% (5.0483 => 4.7322, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -6.23% (1.2870 => 1.2068) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.89% (0.3463 => 0.3259, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.16% (1.6805 => 1.5938, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.82% (0.8614 => 0.8199, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.75% (1.8329 => 1.7458, std.dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/huffbench: -4.68% (19.9488 => 19.0153, std.dev.: 0.2477) SingleSource/UnitTests/Vector/multiplies: -4.56% (2.5528 => 2.4365, std.dev.: 0.0058) MultiSource/Applications/siod/siod: -3.80% (3.2827 => 3.1581, std.dev.: 0.0022) MultiSource/Applications/lua/lua: -3.70% (26.0924 => 25.1262, std.dev.: 0.0218) SingleSource/Benchmarks/Misc/fbench: -3.48% (2.2771 => 2.1978, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.04% (2.7294 => 2.6738, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.89% (8.6802 => 8.5162, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6809, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.56% (1.3677 => 1.3463, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.56% (1.5660 => 1.5416) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4172, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: -1.19% (1.8525 => 1.8304, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/hash: -1.11% (4.9088 => 4.8542, std.dev.: 0.0052) MultiSource/Applications/lambda-0_1_3/lambda: -1.08% (5.2636 => 5.2065, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: -1.00% (1.1277 => 1.1164, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.64% (0.5229 => 0.5890, std.dev.: 0.0055) MultiSource/Applications/SPASS/SPASS: 8.96% (14.9895 => 16.3328, std.dev.: 0.0064) MultiSource/Benchmarks/MallocBench/gs/gs: 7.39% (4.1105 => 4.4143, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 15.87% (1.1048 => 1.2801, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.55% (7.1582 => 7.8418, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.00% (0.6222 => 0.7404, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35800.00% (0.0001 => 0.0359, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -1.35% (0.1485 => 0.1465, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.14% (0.2116 => 0.0653, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 10 17:42:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 10 Oct 2012 19:42:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121011004220.62DB82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4778?compare_to=4774&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4778, Order: 165671, Start Time: 2012-10-10 23:28:59, End Time: 2012-10-11 00:44:08 To: 4774, Order: 165644, Start Time: 2012-10-10 20:47:14, End Time: 2012-10-10 22:01:52 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 1 (1 on baseline) Performance Regressions: 43 (200 on baseline) Performance Improvements: 23 (35 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 975 (740 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.58% (0.0519 => 0.0522, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 33.62% (0.9526 => 1.2729, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/BoolLiteralTest: 10.31% (0.3879 => 0.4279, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.93% (3.9844 => 4.1011, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.53% (0.7001 => 0.7178, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.41% (0.6627 => 0.6787, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.12% (0.5287 => 0.5399, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.93% (0.5169 => 0.5269, std.dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 1.83% (7.0604 => 7.1896, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.78% (1.2653 => 1.2878, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 1.22% (5.0385 => 5.1000, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 23.60% (0.9546 => 1.1799, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 13.98% (0.4721 => 0.5381, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 11.60% (5.4111 => 6.0387, std.dev.: 0.0221) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.88% (3.6749 => 4.0380, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: 9.81% (3.3453 => 3.6734, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.31% (79.8517 => 84.0954, std.dev.: 0.1869) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.93% (0.2375 => 0.2492, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 4.63% (7.9771 => 8.3468, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 4.60% (27.7141 => 28.9877, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: 4.22% (18.3004 => 19.0718, std.dev.: 0.0523) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 4.10% (6.5813 => 6.8512, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.80% (2.5760 => 2.6738, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.67% (4.3967 => 4.5579, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 3.35% (2.9511 => 3.0500, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.27% (1.7747 => 1.8327, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.24% (12.0756 => 12.4665, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.22% (13.4489 => 13.8819, std.dev.: 0.0307) MultiSource/Applications/sqlite3/sqlite3: 2.94% (4.5264 => 4.6594, std.dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: 2.76% (31.3767 => 32.2418, std.dev.: 0.0142) MultiSource/Applications/JM/lencod/lencod: 2.72% (7.5633 => 7.7693, std.dev.: 0.0111) MultiSource/Applications/minisat/minisat: 2.64% (9.2283 => 9.4723, std.dev.: 0.0133) MultiSource/Benchmarks/nbench/nbench: 2.34% (11.6763 => 11.9494, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 2.23% (84.1984 => 86.0784, std.dev.: 0.0068) MultiSource/Applications/lemon/lemon: 2.01% (1.4545 => 1.4837, std.dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: 1.90% (3.8403 => 3.9132, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.86% (2.4945 => 2.5408, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.80% (0.6512 => 0.6629, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/queens: 1.79% (2.2070 => 2.2464, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.57% (0.9752 => 0.9905, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 1.53% (7.5826 => 7.6988, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-6: 1.49% (1.9856 => 2.0152, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: 1.31% (1.7070 => 1.7294, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.20% (1.3625 => 1.3789, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/05-eks/eks: -7.01% (0.4424 => 0.4114, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -6.03% (0.3298 => 0.3099, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -2.55% (4.7468 => 4.6259, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -2.45% (4.8137 => 4.6958, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: -2.31% (1.3849 => 1.3529, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -2.03% (1.6391 => 1.6058, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: -2.02% (9.1979 => 9.0125, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.27% (2.2493 => 2.2208, std.dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: -25.70% (0.6973 => 0.5181, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -14.15% (1.0971 => 0.9419, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -10.04% (0.3625 => 0.3261, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -6.24% (1.2871 => 1.2068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.58% (29.7045 => 28.3449, std.dev.: 0.0465) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.89% (0.8545 => 0.8213, std.dev.: 0.0008) MultiSource/Applications/lua/lua: -3.67% (25.8703 => 24.9200, std.dev.: 0.0156) SingleSource/UnitTests/Vector/multiplies: -3.16% (2.5150 => 2.4355, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/fbench: -3.11% (2.2540 => 2.1840, std.dev.: 0.0009) MultiSource/Applications/aha/aha: -2.23% (3.1488 => 3.0786, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.40% (1.4296 => 1.4096, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -1.32% (9.0597 => 8.9401, std.dev.: 0.0104) MultiSource/Applications/SPASS/SPASS: -1.22% (11.1064 => 10.9704, std.dev.: 0.0121) MultiSource/Benchmarks/sim/sim: -1.14% (4.8002 => 4.7456, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: -1.06% (3.4860 => 3.4489, std.dev.: 0.0002) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.86% (0.0606 => 0.0522, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 44.35% (0.8818 => 1.2729, std.dev.: 0.0043) MultiSource/Benchmarks/PAQ8p/paq8p: 24.24% (2.0176 => 2.5067, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 17.43% (0.0826 => 0.0970, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.95% (0.1410 => 0.1649, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 16.85% (0.2243 => 0.2621, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 15.11% (0.0834 => 0.0960, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 14.24% (0.6283 => 0.7178, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 13.92% (0.1013 => 0.1154, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.52% (0.1413 => 0.1604, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.35% (0.1588 => 0.1800, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 13.34% (0.2721 => 0.3084, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.32% (1.1364 => 1.2878, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 13.10% (1.3693 => 1.5487, std.dev.: 0.0039) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.97% (0.1072 => 0.1211, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.74% (0.1327 => 0.1496, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 12.72% (0.7038 => 0.7933, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.69% (0.4791 => 0.5399, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.66% (0.0964 => 0.1086, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.33% (0.2596 => 0.2916, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.24% (1.4563 => 1.6345, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/distray/distray: 12.22% (0.0818 => 0.0918, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.90% (3.9660 => 4.4379, std.dev.: 0.0020) MultiSource/Applications/aha/aha: 11.86% (0.1062 => 0.1188, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.82% (0.7710 => 0.8621, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 11.77% (3.6692 => 4.1011, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash2: 11.76% (0.4328 => 0.4837, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.67% (0.6959 => 0.7771, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.50% (0.1157 => 0.1290, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.45% (0.5265 => 0.5868, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.44% (0.9199 => 1.0251, std.dev.: 0.0058) SingleSource/Benchmarks/McGill/chomp: 11.26% (0.1589 => 0.1768, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 11.26% (13.8202 => 15.3769, std.dev.: 0.0125) MultiSource/Applications/lemon/lemon: 11.20% (1.0313 => 1.1468, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 11.15% (0.4062 => 0.4515, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 11.00% (0.3192 => 0.3543, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 10.97% (0.1003 => 0.1113, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.96% (0.3130 => 0.3473, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 10.91% (0.5818 => 0.6453, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.88% (0.1075 => 0.1192, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 10.88% (0.7061 => 0.7829, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.86% (0.2127 => 0.2358, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 10.85% (0.3511 => 0.3892, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 10.84% (0.3220 => 0.3569, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 10.77% (1.1061 => 1.2252, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.70% (0.7460 => 0.8258, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.70% (0.3899 => 0.4316, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 10.69% (0.3293 => 0.3645, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.65% (1.2193 => 1.3492, std.dev.: 0.0018) SingleSource/Benchmarks/Stanford/Puzzle: 10.64% (0.0977 => 0.1081, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.63% (0.6135 => 0.6787, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.47% (0.3485 => 0.3850, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.45% (0.0995 => 0.1099, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 10.44% (0.5748 => 0.6348, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.41% (0.4016 => 0.4434, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.39% (0.3580 => 0.3952, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 10.32% (1.0594 => 1.1687, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/football/football: 10.28% (0.8310 => 0.9164, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.27% (0.4390 => 0.4841, std.dev.: 0.0115) MultiSource/Applications/d/make_dparser: 10.25% (3.1889 => 3.5158, std.dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 10.25% (0.2781 => 0.3066, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.21% (0.8698 => 0.9586, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.13% (0.1569 => 0.1728, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.06% (0.2782 => 0.3062, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.04% (0.3246 => 0.3572, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.01% (0.5577 => 0.6135, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.99% (0.2023 => 0.2225, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.96% (0.3756 => 0.4130, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.95% (7.2180 => 7.9360, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.92% (0.3489 => 0.3835, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.90% (0.5637 => 0.6195, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 9.88% (0.3868 => 0.4250, std.dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 9.87% (16.6129 => 18.2532, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.76% (0.3022 => 0.3317, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 9.74% (0.2937 => 0.3223, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 9.71% (2.1791 => 2.3907, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.67% (0.1986 => 0.2178, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.66% (0.4805 => 0.5269, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/mst/mst: 9.63% (0.1111 => 0.1218, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 9.63% (0.2690 => 0.2949, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 9.62% (1.9270 => 2.1124, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.61% (0.6576 => 0.7208, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 9.61% (0.6744 => 0.7392, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 9.61% (0.1478 => 0.1620, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.60% (0.2655 => 0.2910, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 9.56% (0.2761 => 0.3025, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 9.56% (0.3453 => 0.3783, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 9.55% (3.8646 => 4.2337, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.54% (0.2966 => 0.3249, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 9.53% (0.2760 => 0.3023, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.53% (1.9828 => 2.1717, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: 9.47% (0.2628 => 0.2877, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 9.47% (0.2607 => 0.2854, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 9.47% (0.2925 => 0.3202, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 9.39% (0.2726 => 0.2982, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.38% (0.1865 => 0.2040, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 9.37% (4.6629 => 5.1000, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.37% (0.2765 => 0.3024, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 9.34% (6.5754 => 7.1896, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.31% (0.2696 => 0.2947, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 9.25% (0.3534 => 0.3861, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 9.23% (0.7506 => 0.8199, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary3: 9.18% (0.3149 => 0.3438, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 9.11% (0.3107 => 0.3390, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 9.00% (0.1789 => 0.1950, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 8.98% (14.8535 => 16.1878, std.dev.: 0.0077) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.88% (0.2140 => 0.2330, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.79% (4.9865 => 5.4247, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.58% (0.3755 => 0.4077, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.57% (1.3245 => 1.4380, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.54% (0.2914 => 0.3163, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 8.52% (0.2945 => 0.3196, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.50% (0.4379 => 0.4751, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/matrix: 8.47% (0.2988 => 0.3241, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.46% (0.1276 => 0.1384, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.31% (0.2504 => 0.2712, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 8.27% (0.1657 => 0.1794, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.02% (3.2742 => 3.5367, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 8.02% (0.3131 => 0.3382, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.01% (0.3245 => 0.3505, std.dev.: 0.0041) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.94% (0.1435 => 0.1549, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.84% (0.2321 => 0.2503, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 7.76% (0.6250 => 0.6735, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 7.68% (3.7467 => 4.0344, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/parameter-passing: 7.27% (0.4003 => 0.4294, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.13% (0.3914 => 0.4193, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.04% (0.3578 => 0.3830, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.01% (1.1333 => 1.2127, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.01% (0.3940 => 0.4216, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.99% (0.3650 => 0.3905, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 6.91% (0.3646 => 0.3898, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 6.91% (1.2292 => 1.3141, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 6.91% (0.3663 => 0.3916, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.90% (13.2842 => 14.2004, std.dev.: 0.0065) SingleSource/UnitTests/ObjC/for-in: 6.89% (0.3789 => 0.4050, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 6.86% (0.3601 => 0.3848, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.82% (0.3623 => 0.3870, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.76% (0.9108 => 0.9724, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 6.12% (1.2749 => 1.3529, std.dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 6.08% (8.4961 => 9.0125, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/ReedSolomon: 6.02% (0.1777 => 0.1884, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.73% (1.5188 => 1.6058, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.72% (2.1007 => 2.2208, std.dev.: 0.0064) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.70% (6.2785 => 6.6364, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.68% (4.4433 => 4.6958, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.61% (4.3801 => 4.6259, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 5.05% (16.2614 => 17.0821, std.dev.: 0.0115) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.90% (0.2243 => 0.2353, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 4.57% (14.5298 => 15.1944, std.dev.: 0.0063) MultiSource/Applications/sgefa/sgefa: 3.47% (0.2995 => 0.3099, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 1.76% (33.2944 => 33.8799, std.dev.: 0.0152) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 30.62% (5.7573 => 7.5204, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 26.56% (1.0895 => 1.3789, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 20.17% (1.8175 => 2.1840, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 18.04% (0.9996 => 1.1799, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 11.04% (1.1560 => 1.2836, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.72% (3.6469 => 4.0380, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 10.56% (0.4867 => 0.5381, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 9.95% (2.8813 => 3.1680, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 8.59% (0.8273 => 0.8984, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/mst/mst: 8.47% (0.1322 => 0.1434, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 8.10% (3.1736 => 3.4307, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: 7.99% (3.4016 => 3.6734, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-4: 7.55% (1.0640 => 1.1443, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.29% (1.7081 => 1.8327, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/puzzle: 6.91% (0.4846 => 0.5181, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 6.10% (11.2619 => 11.9494, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.29% (7.9275 => 8.3468, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: 5.24% (1.2998 => 1.3679, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: 4.96% (1.9199 => 2.0152, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.33% (2.5629 => 2.6738, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.31% (0.2389 => 0.2492, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: 4.01% (1.9144 => 1.9912, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.85% (13.3668 => 13.8819, std.dev.: 0.0307) MultiSource/Applications/lemon/lemon: 3.77% (1.4298 => 1.4837, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: 3.66% (7.4271 => 7.6988, std.dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.44% (4.4062 => 4.5579, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 3.31% (6.6320 => 6.8512, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 3.27% (2.1753 => 2.2464, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.10% (12.0921 => 12.4665, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-8: 2.99% (1.9863 => 2.0456, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 2.71% (28.2225 => 28.9877, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 2.50% (3.8177 => 3.9132, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 2.46% (31.4682 => 32.2418, std.dev.: 0.0142) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.20% (0.9692 => 0.9905, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 2.11% (7.6086 => 7.7693, std.dev.: 0.0111) MultiSource/Applications/SPASS/SPASS: 2.07% (10.7476 => 10.9704, std.dev.: 0.0121) MultiSource/Benchmarks/PAQ8p/paq8p: 1.95% (84.4286 => 86.0784, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/oourafft: 1.80% (5.5130 => 5.6125, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.46% (9.3358 => 9.4723, std.dev.: 0.0133) MultiSource/Applications/sqlite3/sqlite3: 1.45% (4.5928 => 4.6594, std.dev.: 0.0023) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5089, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9675, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1865, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 1.15% (12.4560 => 12.5997, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/em3d/em3d: 1.04% (3.1071 => 3.1394, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.00% (3.1720 => 3.2038, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.67% (0.2670 => 0.1424) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.02% (0.4657 => 0.3911, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -14.29% (0.0707 => 0.0606, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.69% (1.3819 => 1.2065, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.66% (1.3813 => 1.2064, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) SingleSource/Benchmarks/McGill/chomp: -23.47% (1.2308 => 0.9419, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -21.48% (1.0460 => 0.8213, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.64% (0.0997 => 0.0861, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.02% (0.2238 => 0.1969, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -7.99% (2.6470 => 2.4355, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.24% (20.3410 => 19.0718, std.dev.: 0.0523) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -6.23% (1.2870 => 1.2068) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -6.02% (26.5159 => 24.9200, std.dev.: 0.0156) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.70% (0.3458 => 0.3261, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.65% (1.3780 => 1.3001, std.dev.: 0.0086) MultiSource/Benchmarks/sim/sim: -5.41% (5.0168 => 4.7456, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0011) MultiSource/Applications/siod/siod: -3.79% (3.2729 => 3.1487, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: -2.69% (1.9762 => 1.9230, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4834, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.23% (1.7688 => 1.7294, std.dev.: 0.0055) MultiSource/Applications/aha/aha: -2.19% (3.1476 => 3.0786, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.14% (6.3560 => 6.2202, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.99% (0.6589 => 0.6458, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.61% (1.4326 => 1.4096, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8656, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/ReedSolomon: -1.14% (7.1097 => 7.0286, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2571, std.dev.: 0.0016) MultiSource/Applications/viterbi/viterbi: -1.04% (4.4810 => 4.4345, std.dev.: 0.0042) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 10 19:26:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 10 Oct 2012 21:26:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121011022625.680732A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4779?compare_to=4778&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4779, Order: 165679, Start Time: 2012-10-11 01:13:08, End Time: 2012-10-11 02:28:14 To: 4778, Order: 165671, Start Time: 2012-10-10 23:28:59, End Time: 2012-10-11 00:44:08 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 0 (199 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (66 on baseline) Existing Failures: 1 (0 on baseline) Unchanged Tests: 1041 (741 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0522 => 0.0522, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.86% (0.0606 => 0.0522, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 44.35% (0.8818 => 1.2729, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 24.48% (2.0176 => 2.5115, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 17.68% (0.0826 => 0.0972, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.95% (0.1410 => 0.1649, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 16.63% (0.2243 => 0.2616, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.87% (0.0834 => 0.0958, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 14.26% (0.6283 => 0.7179, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 13.62% (0.1013 => 0.1151, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 13.52% (0.2721 => 0.3089, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.45% (0.1413 => 0.1603, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.29% (0.1588 => 0.1799, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.20% (1.1364 => 1.2864, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.89% (0.1327 => 0.1498, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.88% (0.4791 => 0.5408, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.87% (0.1072 => 0.1210) MultiSource/Applications/hbd/hbd: 12.74% (1.3693 => 1.5437, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 12.63% (0.7038 => 0.7927, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.55% (0.0964 => 0.1085, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 12.22% (0.0818 => 0.0918) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.17% (1.4563 => 1.6336, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.13% (0.2596 => 0.2911, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 11.96% (0.1062 => 0.1189, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.93% (3.9660 => 4.4390, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 11.77% (3.6692 => 4.1012, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 11.69% (0.4328 => 0.4834, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.57% (0.6959 => 0.7764, std.dev.: 0.0089) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.53% (0.7710 => 0.8599, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 11.43% (13.8202 => 15.3997, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.36% (0.5265 => 0.5863, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.32% (0.1157 => 0.1288, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.32% (0.9199 => 1.0240, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference-object: 11.28% (0.5818 => 0.6474, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 11.25% (0.4062 => 0.4519, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 11.25% (1.0313 => 1.1473, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 11.14% (0.1589 => 0.1766, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.12% (0.3130 => 0.3478, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/Hello: 11.12% (0.5748 => 0.6387, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 11.07% (0.1003 => 0.1114, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 11.03% (0.7061 => 0.7840, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.91% (0.7460 => 0.8274, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 10.88% (0.3511 => 0.3893, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 10.80% (1.1061 => 1.2256, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.72% (0.2127 => 0.2355, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 10.71% (0.3192 => 0.3534, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 10.62% (0.3220 => 0.3562, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.57% (0.3899 => 0.4311, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Puzzle: 10.54% (0.0977 => 0.1080, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.47% (0.3580 => 0.3955, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.46% (0.6135 => 0.6777, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.46% (0.4016 => 0.4436, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.45% (0.0995 => 0.1099, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.45% (1.2193 => 1.3467, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 10.42% (3.1889 => 3.5213, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.33% (0.1075 => 0.1186, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.27% (0.3485 => 0.3843, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 10.25% (0.8310 => 0.9162, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.24% (0.4805 => 0.5297, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.21% (0.8698 => 0.9586, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.18% (0.4390 => 0.4837, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 10.18% (0.2781 => 0.3064, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.16% (0.6576 => 0.7244, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.10% (0.3246 => 0.3574, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 10.09% (1.0594 => 1.1663, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.06% (0.5637 => 0.6204, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/lists: 10.05% (0.3293 => 0.3624, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.03% (0.2782 => 0.3061, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.01% (0.1569 => 0.1726, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.00% (0.3489 => 0.3838, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 9.91% (4.6629 => 5.1252, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 9.91% (16.6129 => 18.2592, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.85% (0.3756 => 0.4126, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.83% (0.5577 => 0.6125, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.79% (0.3022 => 0.3318, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.77% (7.2180 => 7.9229, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.76% (0.2655 => 0.2914, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 9.75% (0.3868 => 0.4245, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.74% (0.2023 => 0.2220, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 9.70% (2.1791 => 2.3905, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 9.61% (0.3453 => 0.3785, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 9.61% (1.9270 => 2.1121, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 9.59% (0.2690 => 0.2948, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 9.59% (0.2607 => 0.2857, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.58% (0.2966 => 0.3250, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 9.53% (0.6744 => 0.7387, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 9.52% (3.8646 => 4.2327, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wc: 9.50% (0.2937 => 0.3216, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.49% (0.1865 => 0.2042, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 9.45% (0.1111 => 0.1216, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.43% (1.9828 => 2.1697, std.dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 9.40% (6.5754 => 7.1937, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/fibo: 9.40% (0.2628 => 0.2875, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 9.38% (0.2760 => 0.3019, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 9.37% (0.2925 => 0.3199, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 9.34% (0.2761 => 0.3019, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 9.34% (0.1478 => 0.1616, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.33% (0.2765 => 0.3023, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 9.28% (0.2726 => 0.2979, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 9.14% (0.3534 => 0.3857, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.12% (0.2696 => 0.2942, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 9.07% (14.8535 => 16.2007, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.06% (0.1986 => 0.2166, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 8.99% (0.3149 => 0.3432, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 8.95% (0.3107 => 0.3385, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 8.82% (0.7506 => 0.8168, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.77% (4.9865 => 5.4239, std.dev.: 0.0081) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.74% (0.2140 => 0.2327, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.58% (0.3755 => 0.4077) SingleSource/Benchmarks/Shootout-C++/objinst: 8.52% (0.2945 => 0.3196, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.50% (0.1789 => 0.1941, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.41% (0.2914 => 0.3159, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.40% (1.3245 => 1.4357, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.36% (0.4379 => 0.4745, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.31% (0.1276 => 0.1382, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 8.27% (0.2988 => 0.3235, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.23% (0.2504 => 0.2710, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 8.14% (0.3131 => 0.3386, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 8.03% (0.1657 => 0.1790, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.95% (3.2742 => 3.5346, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.95% (0.3245 => 0.3503, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.87% (0.1435 => 0.1548, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 7.72% (3.7467 => 4.0360, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.63% (0.2321 => 0.2498, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 7.54% (0.6250 => 0.6721, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.00% (13.2842 => 14.2137, std.dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.94% (1.1333 => 1.2119, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 6.83% (1.2292 => 1.3132, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.75% (0.9108 => 0.9723, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 6.65% (0.4003 => 0.4269, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.54% (0.3914 => 0.4170, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.35% (0.3940 => 0.4190, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 6.32% (0.3578 => 0.3804, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.17% (0.3663 => 0.3889, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.16% (0.3650 => 0.3875, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 6.15% (0.3789 => 0.4022, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 6.15% (8.4961 => 9.0182, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/exceptions-4: 6.14% (0.3646 => 0.3870, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 6.13% (0.1777 => 0.1886, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 6.13% (1.2749 => 1.3530, std.dev.: 0.0081) SingleSource/UnitTests/ObjC/exceptions-2: 6.11% (0.3601 => 0.3821, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 6.02% (0.3623 => 0.3841, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.64% (1.5188 => 1.6045, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.61% (4.4433 => 4.6926, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.55% (4.3801 => 4.6231, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.49% (2.1007 => 2.2161, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.42% (6.2785 => 6.6186, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 5.18% (16.2614 => 17.1045, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.95% (0.2243 => 0.2354, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 4.55% (14.5298 => 15.1903, std.dev.: 0.0043) MultiSource/Benchmarks/Bullet/bullet: 1.87% (33.2944 => 33.9176, std.dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5163, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 26.55% (1.0895 => 1.3788, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: 20.34% (1.8175 => 2.1871, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 18.08% (0.9996 => 1.1803, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: 11.03% (1.1560 => 1.2835, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.68% (3.6469 => 4.0364, std.dev.: 0.0046) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 10.54% (0.4867 => 0.5380, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 9.88% (2.8813 => 3.1659, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 8.61% (0.8273 => 0.8985, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 8.10% (3.1736 => 3.4308, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/fp-convert: 7.99% (3.4016 => 3.6734, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-4: 7.53% (1.0640 => 1.1441, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.32% (1.7081 => 1.8331, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: 6.93% (0.4846 => 0.5182, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 6.11% (11.2619 => 11.9497, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.32% (7.9275 => 8.3490, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/mandel-2: 5.24% (1.2998 => 1.3679, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 5.08% (1.9199 => 2.0175, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9998, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.40% (0.2389 => 0.2494, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.32% (2.5629 => 2.6736, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.01% (1.9144 => 1.9912, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 3.93% (1.4298 => 1.4860, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/salsa20: 3.61% (7.4271 => 7.6952, std.dev.: 0.0069) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.47% (4.4062 => 4.5593, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.37% (13.3668 => 13.8167, std.dev.: 0.0399) SingleSource/Benchmarks/McGill/queens: 3.28% (2.1753 => 2.2467, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 3.26% (6.6320 => 6.8483, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 3.11% (12.0921 => 12.4679, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-8: 2.99% (1.9863 => 2.0456, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 2.71% (28.2225 => 28.9877, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 2.49% (3.8177 => 3.9127, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 2.44% (31.4682 => 32.2373, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.19% (0.9692 => 0.9904, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 2.05% (7.6086 => 7.7647, std.dev.: 0.0128) MultiSource/Benchmarks/PAQ8p/paq8p: 1.96% (84.4286 => 86.0861, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 1.94% (10.7476 => 10.9562, std.dev.: 0.0230) SingleSource/Benchmarks/Misc/oourafft: 1.82% (5.5130 => 5.6133, std.dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: 1.53% (4.5928 => 4.6630, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5102, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.41% (9.3358 => 9.4678, std.dev.: 0.0196) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.22% (8.8259 => 8.9336, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1865, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 1.12% (12.4560 => 12.5954, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.59% (0.2670 => 0.1426, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.58% (0.4657 => 0.3885, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/mason/mason: -14.14% (0.0707 => 0.0607, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.58% (1.3813 => 1.2075, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.37% (1.3819 => 1.2110, std.dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) SingleSource/Benchmarks/McGill/chomp: -23.55% (1.2308 => 0.9410, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -21.49% (1.0460 => 0.8212, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.44% (0.0997 => 0.0863, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -11.97% (0.2238 => 0.1970, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -7.84% (2.6470 => 2.4394, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.87% (20.3410 => 18.9436, std.dev.: 0.1500) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -6.23% (1.2870 => 1.2068) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -6.14% (26.5159 => 24.8869, std.dev.: 0.0102) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.75% (0.3458 => 0.3259, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -5.41% (5.0168 => 4.7456) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.93% (1.3780 => 1.3101, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.78% (3.2729 => 3.1491, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: -2.72% (1.9762 => 1.9225, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.25% (1.7688 => 1.7290, std.dev.: 0.0007) MultiSource/Applications/aha/aha: -2.19% (3.1476 => 3.0787, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.06% (6.3560 => 6.2249, std.dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.93% (0.6589 => 0.6462, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.61% (1.4326 => 1.4096) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8638, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/ReedSolomon: -1.13% (7.1097 => 7.0292, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2577, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: -1.04% (4.4810 => 4.4346, std.dev.: 0.0029) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 10 19:28:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 10 Oct 2012 21:28:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121011022829.A17DB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4780?compare_to=4777&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4780, Order: 165678, Start Time: 2012-10-11 01:10:26, End Time: 2012-10-11 02:30:18 To: 4777, Order: 165669, Start Time: 2012-10-10 23:21:10, End Time: 2012-10-11 00:41:19 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (3 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (168 on baseline) Performance Improvements: 1 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 18 (15 on baseline) Unchanged Tests: 1021 (748 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 1.02% (11.6781 => 11.7976, std.dev.: 0.0140) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.46% (81.9640 => 83.9797, std.dev.: 0.3006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.29% (56.3299 => 54.4740, std.dev.: 0.3196) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.07% (0.5890 => 0.5886) MultiSource/Applications/SPASS/SPASS: -0.08% (16.3328 => 16.3203, std.dev.: 0.0143) MultiSource/Benchmarks/Bullet/bullet: 0.06% (55.3150 => 55.3474, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/gs/gs: 0.10% (4.4143 => 4.4187, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (1.2801 => 1.2801, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.26% (7.8418 => 7.8621, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.05% (0.7404 => 0.7408, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -1.11% (0.0359 => 0.0355, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1465 => 0.1464) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0653 => 0.0653, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0522 => 0.0522, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -12.49% (63.2438 => 55.3474, std.dev.: 0.0033) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.57% (0.0611 => 0.0522, std.dev.: 0.0011) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 33.55% (14.1553 => 18.9037, std.dev.: 0.0174) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.21% (3.4629 => 5.6517, std.dev.: 0.0236) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14565.97% (0.0720 => 10.5595, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10063800.00% (0.0001 => 10.0639, std.dev.: 0.0014) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.04% (0.2554 => 0.4164, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 50.79% (10.3673 => 15.6325, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/richards_benchmark: 38.59% (0.1622 => 0.2248, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: 33.90% (0.1056 => 0.1414, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 23.86% (1.7609 => 2.1811, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.81% (7.0540 => 8.4513, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/flops: 17.74% (0.1432 => 0.1686, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.40% (2.2022 => 2.5854, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/n-body: 15.15% (0.0746 => 0.0859, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.35% (0.0871 => 0.0996, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.60% (0.1566 => 0.1779, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 13.05% (10.4361 => 11.7976, std.dev.: 0.0140) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.42% (0.6675 => 0.7504, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 11.82% (0.3282 => 0.3670, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 11.60% (0.1440 => 0.1607, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.13% (0.5105 => 0.5673, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 10.94% (0.1655 => 0.1836, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 10.82% (5.7591 => 6.3823, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.67% (0.3543 => 0.3921, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.61% (0.3177 => 0.3514, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.53% (0.4879 => 0.5393, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 10.41% (0.7433 => 0.8207, std.dev.: 0.0149) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.40% (0.5020 => 0.5542, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.14% (0.3473 => 0.3825, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 10.11% (0.3423 => 0.3769, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 10.03% (0.3561 => 0.3918, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 10.01% (3.3354 => 3.6692, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-4: 9.99% (0.3543 => 0.3897, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.99% (1.5415 => 1.6955, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 9.95% (0.3497 => 0.3845, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.91% (0.3927 => 0.4316, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.85% (0.1584 => 0.1740, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.84% (0.3516 => 0.3862, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 9.79% (0.1175 => 0.1290, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.78% (0.1625 => 0.1784, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.78% (0.2271 => 0.2493, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 9.77% (0.7115 => 0.7810, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.75% (0.2758 => 0.3027, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.69% (0.3828 => 0.4199, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.67% (0.2700 => 0.2961, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 9.64% (0.3694 => 0.4050, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 9.62% (0.3886 => 0.4260, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.55% (0.1236 => 0.1354, std.dev.: 0.0007) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.36% (0.1143 => 0.1250, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.30% (0.2107 => 0.2303, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.25% (0.3307 => 0.3613, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.22% (0.6450 => 0.7045, std.dev.: 0.0097) MultiSource/Applications/aha/aha: 9.21% (0.1151 => 0.1257, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.99% (0.8067 => 0.8792, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 8.94% (1.1642 => 1.2683, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.94% (0.1510 => 0.1645, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 8.92% (3.8723 => 4.2177, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.85% (8.1363 => 8.8564, std.dev.: 0.0111) MultiSource/Benchmarks/Olden/em3d/em3d: 8.85% (0.1695 => 0.1845, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.80% (0.5569 => 0.6059, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.67% (0.5860 => 0.6368, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.54% (0.8172 => 0.8870, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.53% (4.2646 => 4.6283, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 8.42% (0.7835 => 0.8495, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/bigfib: 8.38% (0.6456 => 0.6997, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.30% (0.1940 => 0.2101, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.30% (0.2603 => 0.2819, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 8.25% (1.0722 => 1.1607, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 8.25% (1.5603 => 1.6890, std.dev.: 0.0019) MultiSource/Applications/treecc/treecc: 8.17% (2.0273 => 2.1929, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.14% (0.3441 => 0.3721, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.14% (0.2065 => 0.2233, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.10% (0.9765 => 1.0556, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.97% (1.3050 => 1.4090, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 7.91% (0.1555 => 0.1678, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.86% (0.1438 => 0.1551, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.78% (0.4615 => 0.4974, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 7.76% (0.3387 => 0.3650, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 7.73% (0.5925 => 0.6383, std.dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 7.71% (9.4845 => 10.2153, std.dev.: 0.0071) MultiSource/Applications/siod/siod: 7.66% (2.2969 => 2.4729, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: 7.65% (0.6030 => 0.6491, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 7.58% (0.3180 => 0.3421, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 7.56% (0.8921 => 0.9595, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.43% (0.1695 => 0.1821, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.34% (0.5981 => 0.6420, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.31% (0.4103 => 0.4403, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.20% (0.4289 => 0.4598, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.17% (0.3865 => 0.4142, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 7.13% (0.3422 => 0.3666, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.11% (0.3121 => 0.3343, std.dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: 7.11% (21.9371 => 23.4975, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/property-reference: 7.11% (0.7326 => 0.7847, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.07% (0.4203 => 0.4500, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 7.01% (1.1840 => 1.2670, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.00% (0.3826 => 0.4094, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.99% (0.4620 => 0.4943, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.98% (7.9617 => 8.5173, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/moments: 6.74% (0.4048 => 0.4321, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.72% (1.1861 => 1.2658, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.69% (0.4636 => 0.4946, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.55% (0.3650 => 0.3889, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.51% (0.1906 => 0.2030, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.49% (0.2266 => 0.2413, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.33% (0.2905 => 0.3089, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.22% (0.3603 => 0.3827, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.16% (0.3684 => 0.3911, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.16% (0.2891 => 0.3069, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.15% (0.3136 => 0.3329, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.15% (1.4186 => 1.5059, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.15% (0.2831 => 0.3005, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.12% (0.8101 => 0.8597, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.98% (0.3162 => 0.3351, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.95% (0.3379 => 0.3580, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.90% (2.0665 => 2.1885, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.90% (1.5859 => 1.6795, std.dev.: 0.0203) SingleSource/Benchmarks/Shootout-C++/fibo: 5.87% (0.2725 => 0.2885) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.84% (5.0018 => 5.2939, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.81% (0.2872 => 0.3039, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.79% (0.3283 => 0.3473, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 5.78% (0.2871 => 0.3037, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.73% (4.9449 => 5.2284, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/methcall: 5.63% (0.2877 => 0.3039, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/matrix: 5.62% (0.3098 => 0.3272, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.59% (0.2756 => 0.2910, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 5.57% (0.3232 => 0.3412, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.54% (0.3052 => 0.3221, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.47% (2.2024 => 2.3228, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/ReedSolomon: 5.47% (0.2049 => 0.2161, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.41% (0.2793 => 0.2944, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.35% (0.2802 => 0.2952, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.34% (0.2714 => 0.2859, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.09% (0.4064 => 0.4271, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.93% (14.3668 => 15.0750, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.87% (0.3427 => 0.3594, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 4.63% (0.3131 => 0.3276, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 4.55% (17.1811 => 17.9635, std.dev.: 0.0268) MultiSource/Applications/hexxagon/hexxagon: 4.42% (1.2842 => 1.3409, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.20% (0.2430 => 0.2532, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.16% (3.8922 => 4.0150, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.76% (1.1194 => 1.1503, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 26.13% (1.1145 => 1.4057, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 18.49% (0.9957 => 1.1798, std.dev.: 0.0014) MultiSource/Applications/aha/aha: 14.55% (3.1595 => 3.6193, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 12.33% (0.4808 => 0.5401, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.57% (3.6395 => 4.0605, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.75% (2.8904 => 3.2011, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649) SingleSource/Benchmarks/Misc/richards_benchmark: 9.99% (1.1396 => 1.2535, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: 9.81% (3.3453 => 3.6734, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 7.95% (0.1421 => 0.1534) SingleSource/Benchmarks/Shootout-C++/hash2: 6.78% (3.1578 => 3.3720, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 5.91% (11.6436 => 12.3322, std.dev.: 0.2390) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 5.17% (6.5088 => 6.8455, std.dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 4.59% (27.8444 => 29.1225, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 4.32% (0.4162 => 0.4342) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.14% (4.3882 => 4.5698, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 4.09% (9.1159 => 9.4888, std.dev.: 0.0097) MultiSource/Applications/spiff/spiff: 3.38% (2.9346 => 3.0337, std.dev.: 0.0024) MultiSource/Benchmarks/PAQ8p/paq8p: 3.02% (85.0658 => 87.6379, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.99% (13.4384 => 13.8398, std.dev.: 0.0323) SingleSource/Benchmarks/McGill/queens: 2.93% (2.1825 => 2.2464, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.73% (0.9540 => 0.9800, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.59% (4.2280 => 4.3374, std.dev.: 0.0042) SingleSource/Regression/C/uint64_to_float: 2.35% (0.5413 => 0.5540, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.34% (8.1563 => 8.3472, std.dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.24% (1.7254 => 1.7640, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.98% (1.4460 => 1.4747, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.53% (2.6546 => 2.6951, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.46% (6.6465 => 6.7434, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1308, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -80.08% (0.8651 => 0.1723, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.29% (5.2763 => 3.2562, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.03% (5.3855 => 3.7144, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.60% (5.3526 => 3.7149, std.dev.: 0.0035) SingleSource/UnitTests/Vector/constpool: -14.65% (54.1659 => 46.2322, std.dev.: 0.0459) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.46% (2.9384 => 2.6311, std.dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -10.40% (22.1758 => 19.8699, std.dev.: 0.0110) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -44.25% (0.0400 => 0.0223) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7645, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/puzzle: -25.52% (0.6962 => 0.5185, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -23.87% (1.2373 => 0.9420, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-6: -16.73% (1.6925 => 1.4093, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.53% (0.0998 => 0.0863, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -11.02% (1.5373 => 1.3679, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -10.13% (0.2161 => 0.1942, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.88% (4.8142 => 4.4831, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -6.86% (1.5835 => 1.4749, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -6.26% (5.0483 => 4.7321, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -6.23% (1.2870 => 1.2068) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.86% (0.3463 => 0.3260, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.18% (1.6805 => 1.5934, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.82% (0.8614 => 0.8199, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.80% (1.8329 => 1.7449, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.31% (2.5528 => 2.4429, std.dev.: 0.0028) MultiSource/Applications/siod/siod: -3.80% (3.2827 => 3.1581, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.75% (19.9488 => 19.2010, std.dev.: 0.1442) MultiSource/Applications/lua/lua: -3.71% (26.0924 => 25.1253, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/fbench: -3.64% (2.2771 => 2.1943, std.dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.15% (8.6802 => 8.4936, std.dev.: 0.0209) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.04% (2.7294 => 2.6737, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6794, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.56% (1.5660 => 1.5415, std.dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: -1.55% (9.5636 => 9.4155, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-8: -1.35% (1.8525 => 1.8274, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.24% (1.3677 => 1.3507, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8576, std.dev.: 0.0050) MultiSource/Applications/lambda-0_1_3/lambda: -1.04% (5.2636 => 5.2089, std.dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.56% (0.5229 => 0.5886) MultiSource/Applications/SPASS/SPASS: 8.88% (14.9895 => 16.3203, std.dev.: 0.0143) MultiSource/Benchmarks/MallocBench/gs/gs: 7.50% (4.1105 => 4.4187, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 15.87% (1.1048 => 1.2801, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.83% (7.1582 => 7.8621, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.06% (0.6222 => 0.7408, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35400.00% (0.0001 => 0.0355, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -1.41% (0.1485 => 0.1464) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.14% (0.2116 => 0.0653, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 10 20:26:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 10 Oct 2012 22:26:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121011032632.A42C82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4781?compare_to=4776&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4781, Order: 165676, Start Time: 2012-10-11 00:43:53, End Time: 2012-10-11 03:27:54 To: 4776, Order: 165655, Start Time: 2012-10-10 21:30:42, End Time: 2012-10-11 00:14:37 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (135 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 1040 (828 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 7.53% (0.2085 => 0.2242, std.dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.43% (1.7653 => 1.7400, std.dev.: 0.0006) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 11.08% (0.3465 => 0.3849, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.00% (0.3446 => 0.3825, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.95% (0.3488 => 0.3870, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.90% (0.3496 => 0.3877, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.84% (0.3442 => 0.3815, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.81% (0.3460 => 0.3834, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.72% (0.3469 => 0.3841, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.66% (0.3650 => 0.4039, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.62% (0.3643 => 0.4030, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.50% (0.3724 => 0.4115, std.dev.: 0.0084) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.16% (0.1063 => 0.1171, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 9.21% (1.5932 => 1.7400, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 8.87% (0.1218 => 0.1326, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 8.59% (0.1619 => 0.1758, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 8.41% (0.5826 => 0.6316, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.41% (0.5889 => 0.6384, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.23% (0.4994 => 0.5405, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.05% (0.4361 => 0.4712, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.82% (1.3152 => 1.4181, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.82% (1.6211 => 1.7479, std.dev.: 0.0051) MultiSource/Benchmarks/nbench/nbench: 7.76% (0.2566 => 0.2765, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.72% (0.1620 => 0.1745, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 7.63% (0.4847 => 0.5217, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 7.59% (5.5417 => 5.9623, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.40% (3.5627 => 3.8265, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.34% (0.5000 => 0.5367, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.30% (0.2014 => 0.2161, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.29% (0.3004 => 0.3223, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.27% (0.2875 => 0.3084, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.24% (0.5900 => 0.6327, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 7.11% (0.1421 => 0.1522, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 7.10% (1.0781 => 1.1546, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.09% (0.2736 => 0.2930, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.04% (0.1549 => 0.1658, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 7.03% (0.7171 => 0.7675, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.01% (0.3195 => 0.3419, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 6.98% (4.2109 => 4.5047, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.94% (0.5026 => 0.5375, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.92% (0.3930 => 0.4202, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.91% (0.2750 => 0.2940, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 6.90% (0.4029 => 0.4307, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.90% (0.2725 => 0.2913, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.89% (0.2714 => 0.2901, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.87% (0.3625 => 0.3874, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.86% (2.7292 => 2.9165, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/09-vor/vor: 6.84% (0.1505 => 0.1608, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: 6.83% (0.2780 => 0.2970, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.81% (0.2792 => 0.2982, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 6.80% (0.9909 => 1.0583, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.79% (0.2738 => 0.2924, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.79% (0.4139 => 0.4420, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.78% (0.2729 => 0.2914, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.77% (2.0673 => 2.2073, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.77% (0.2866 => 0.3060, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 6.77% (0.2823 => 0.3014, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.75% (0.2813 => 0.3003, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.74% (0.2803 => 0.2992, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.69% (0.2811 => 0.2999, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 6.68% (1.8794 => 2.0050, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.59% (4.4195 => 4.7106, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.57% (0.3060 => 0.3261, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.56% (0.2911 => 0.3102, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.56% (0.3096 => 0.3299, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.53% (0.3903 => 0.4158, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 6.52% (0.3267 => 0.3480, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.51% (0.3258 => 0.3470, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.50% (0.1968 => 0.2096, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists: 6.48% (0.3348 => 0.3565, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.47% (0.3678 => 0.3916, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.46% (0.3282 => 0.3494, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 6.45% (1.4269 => 1.5189, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 6.41% (0.3477 => 0.3700, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 6.39% (0.3726 => 0.3964, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 6.35% (0.6634 => 0.7055, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.34% (0.3362 => 0.3575, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.33% (0.2969 => 0.3157, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 6.33% (0.3317 => 0.3527, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.32% (0.3890 => 0.4136, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.24% (0.3124 => 0.3319, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.18% (0.4658 => 0.4946, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 6.17% (0.4146 => 0.4402, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.13% (0.3084 => 0.3273, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3690 => 0.3916, std.dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: 6.12% (23.5202 => 24.9602, std.dev.: 0.0158) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.08% (0.3271 => 0.3470, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.07% (0.2737 => 0.2903, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 6.05% (2.1013 => 2.2285, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 6.04% (0.5546 => 0.5881, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.00% (0.2068 => 0.2192, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 5.98% (0.2691 => 0.2852, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: 5.97% (0.9697 => 1.0276, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.95% (0.3981 => 0.4218, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.93% (0.2040 => 0.2161, std.dev.: 0.0040) MultiSource/Applications/JM/ldecod/ldecod: 5.93% (2.1653 => 2.2937, std.dev.: 0.0068) MultiSource/Applications/minisat/minisat: 5.91% (0.3336 => 0.3533, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.91% (0.6435 => 0.6815, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 5.84% (4.6177 => 4.8872, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.80% (0.2103 => 0.2225, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 5.75% (0.7875 => 0.8328, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.70% (0.3845 => 0.4064, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 5.69% (0.5012 => 0.5297, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.64% (0.7426 => 0.7845, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 5.60% (2.0346 => 2.1486, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 5.54% (0.2075 => 0.2190, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.41% (1.9966 => 2.1047, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.35% (0.5361 => 0.5648, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.26% (1.9694 => 2.0730, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 4.98% (0.2391 => 0.2510, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.84% (0.5584 => 0.5854, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.50% (11.6398 => 12.1636, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.26% (4.6926 => 4.8923, std.dev.: 0.0121) MultiSource/Applications/lambda-0_1_3/lambda: 4.17% (0.3498 => 0.3644, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.04% (0.4253 => 0.4425, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 2.82% (11.9555 => 12.2931, std.dev.: 0.0102) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 64.29% (0.2162 => 0.3552, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-1: 22.63% (6.2401 => 7.6525, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6097, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 5.66% (0.2122 => 0.2242, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6746, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-2: 4.96% (1.8057 => 1.8953, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1688, std.dev.: 0.0518) SingleSource/Benchmarks/Dhrystone/dry: 4.26% (14.0481 => 14.6462, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1984, std.dev.: 0.0018) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5022, std.dev.: 0.0035) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.56% (3.1722 => 3.2217, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2865, std.dev.: 0.0039) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5139, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 1.02% (50.0626 => 50.5730, std.dev.: 0.0099) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.87% (25.4195 => 16.5553, std.dev.: 0.0239) SingleSource/Benchmarks/Shootout-C++/ary2: -8.66% (0.2402 => 0.2194, std.dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9773, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7867, std.dev.: 0.0137) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9587, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7977, std.dev.: 0.0050) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7728, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.59% (17.2379 => 16.7916, std.dev.: 0.0527) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8598, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.99% (0.6293 => 0.6168, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5771, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4962, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.19% (105.3826 => 104.1264, std.dev.: 0.0696) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0422, std.dev.: 0.0055) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 10 21:10:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 10 Oct 2012 23:10:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121011041045.F29942A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4782?compare_to=4779&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4782, Order: 165693, Start Time: 2012-10-11 02:57:32, End Time: 2012-10-11 04:12:35 To: 4779, Order: 165679, Start Time: 2012-10-11 01:13:08, End Time: 2012-10-11 02:28:14 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Passes: 1 (0 on baseline) Performance Regressions: 0 (200 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 0 (66 on baseline) Unchanged Tests: 1041 (744 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.19% (0.0522 => 0.0521, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 44.72% (0.8818 => 1.2761, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 24.72% (2.0176 => 2.5164, std.dev.: 0.0141) SingleSource/Benchmarks/Misc/flops: 18.28% (0.0826 => 0.0977, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.23% (0.1410 => 0.1653, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 16.76% (0.2243 => 0.2619, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 15.11% (0.0834 => 0.0960, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 14.50% (0.6283 => 0.7194, std.dev.: 0.0137) MultiSource/Benchmarks/Olden/tsp/tsp: 13.82% (0.1013 => 0.1153, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 13.82% (0.2721 => 0.3097, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.60% (1.1364 => 1.2910, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.54% (0.1588 => 0.1803, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.52% (0.1413 => 0.1604, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 13.03% (1.3693 => 1.5477, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.97% (0.0964 => 0.1089, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 12.90% (0.7038 => 0.7946, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.81% (0.1327 => 0.1497, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.77% (0.4791 => 0.5403, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.58% (0.0819 => 0.0922, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.50% (0.1072 => 0.1206, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.49% (1.4563 => 1.6382, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 12.38% (0.4328 => 0.4864, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.37% (0.2596 => 0.2917, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/distray/distray: 12.35% (0.0818 => 0.0919, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.08% (3.9660 => 4.4451, std.dev.: 0.0034) MultiSource/Applications/aha/aha: 12.05% (0.1062 => 0.1190, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 11.98% (3.6692 => 4.1086, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.96% (0.6959 => 0.7791, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.95% (0.7710 => 0.8631, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.76% (0.3130 => 0.3498, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.72% (0.5265 => 0.5882, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 11.72% (0.4062 => 0.4538, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.65% (0.9199 => 1.0271, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 11.62% (0.5818 => 0.6494, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 11.54% (0.3511 => 0.3916, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 11.52% (1.0313 => 1.1501, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 11.50% (0.5748 => 0.6409, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 11.40% (0.7061 => 0.7866, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 11.38% (13.8202 => 15.3935, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/power/power: 11.27% (0.1003 => 0.1116, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/chomp: 11.14% (0.1589 => 0.1766, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 11.09% (0.3220 => 0.3577, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.06% (0.7460 => 0.8285, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.05% (0.2127 => 0.2362, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.99% (0.6576 => 0.7299, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary2: 10.96% (0.3192 => 0.3542, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.90% (0.3899 => 0.4324, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: 10.88% (1.1061 => 1.2264, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Puzzle: 10.85% (0.0977 => 0.1083, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.80% (1.2193 => 1.3510, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.79% (0.1075 => 0.1191, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.78% (0.4016 => 0.4449, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.73% (0.3485 => 0.3859, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 10.72% (0.2781 => 0.3079, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.69% (0.3246 => 0.3593, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 10.67% (0.8310 => 0.9197, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.61% (0.3580 => 0.3960, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.59% (0.4390 => 0.4855, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.56% (0.6135 => 0.6783, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.49% (0.3022 => 0.3339, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 10.47% (3.1889 => 3.5228, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.45% (0.1569 => 0.1733, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.40% (0.8698 => 0.9603, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.40% (0.3489 => 0.3852, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.39% (0.2782 => 0.3071, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 10.37% (4.6629 => 5.1466, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.35% (0.0995 => 0.1098, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.33% (0.3756 => 0.4144, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.31% (0.5577 => 0.6152, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 10.27% (1.0594 => 1.1682, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 10.26% (0.3293 => 0.3631, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 10.24% (0.3868 => 0.4264, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.23% (0.2023 => 0.2230) MultiSource/Applications/kimwitu++/kc: 10.22% (16.6129 => 18.3102, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.18% (0.5637 => 0.6211, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.99% (1.9828 => 2.1808, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.97% (7.2180 => 7.9373, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.95% (0.2966 => 0.3261, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.91% (0.4805 => 0.5281, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sieve: 9.90% (0.3453 => 0.3795, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 9.89% (1.9270 => 2.1176, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/methcall: 9.89% (0.2761 => 0.3034, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 9.88% (2.1791 => 2.3945, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/lists1: 9.88% (0.3534 => 0.3883, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 9.87% (0.2726 => 0.2995, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 9.80% (0.6744 => 0.7405, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.79% (0.2655 => 0.2915, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 9.78% (0.2760 => 0.3030, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 9.78% (0.2607 => 0.2862, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 9.75% (6.5754 => 7.2163, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/random: 9.74% (0.2690 => 0.2952, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 9.70% (0.2628 => 0.2883, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 9.67% (0.2937 => 0.3221, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.66% (0.2765 => 0.3032, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 9.65% (0.3149 => 0.3453, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 9.64% (3.8646 => 4.2371, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary: 9.59% (0.3107 => 0.3405, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 9.57% (0.2925 => 0.3205, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.47% (0.1986 => 0.2174, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 9.45% (0.1111 => 0.1216, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 9.40% (0.1478 => 0.1617, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.31% (0.2696 => 0.2947, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.22% (0.1865 => 0.2037) MultiSource/Applications/spiff/spiff: 9.18% (0.7506 => 0.8195, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 9.17% (0.2945 => 0.3215, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.11% (0.2140 => 0.2335, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 9.06% (14.8535 => 16.1999, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.00% (0.3755 => 0.4093, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.86% (0.1276 => 0.1389, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 8.80% (0.2988 => 0.3251, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.76% (1.3245 => 1.4405, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.67% (0.2504 => 0.2721, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.66% (4.9865 => 5.4181, std.dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.61% (0.1789 => 0.1943, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.57% (0.3245 => 0.3523, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.50% (0.4379 => 0.4751, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.48% (0.2914 => 0.3161, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 8.30% (0.3131 => 0.3391, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 8.27% (0.1657 => 0.1794, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.22% (0.1435 => 0.1553, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 8.03% (0.6250 => 0.6752, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.02% (3.2742 => 3.5369, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.84% (0.2321 => 0.2503, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 7.79% (3.7467 => 4.0387, std.dev.: 0.0106) SingleSource/UnitTests/ObjC/parameter-passing: 7.32% (0.4003 => 0.4296, std.dev.: 0.0064) MultiSource/Applications/hexxagon/hexxagon: 7.27% (1.2292 => 1.3186, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.22% (13.2842 => 14.2436, std.dev.: 0.0121) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.16% (0.9108 => 0.9760, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.10% (1.1333 => 1.2138, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions: 7.08% (0.3914 => 0.4191, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.80% (0.3940 => 0.4208, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 6.75% (0.3601 => 0.3844, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 6.74% (0.3578 => 0.3819, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.69% (0.3646 => 0.3890, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/for-in: 6.65% (0.3789 => 0.4041, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.61% (0.3663 => 0.3905, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.55% (0.3650 => 0.3889, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/exceptions-3: 6.51% (0.3623 => 0.3859, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 6.22% (1.2749 => 1.3542, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/ReedSolomon: 6.13% (0.1777 => 0.1886, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 6.12% (8.4961 => 9.0162, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.02% (1.5188 => 1.6102, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.73% (2.1007 => 2.2210, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.62% (4.4433 => 4.6930, std.dev.: 0.0043) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.59% (6.2785 => 6.6297, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.57% (0.2243 => 0.2368) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.55% (4.3801 => 4.6232, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: 5.43% (16.2614 => 17.1446, std.dev.: 0.0137) SingleSource/Benchmarks/Misc/oourafft: 5.03% (0.2008 => 0.2109, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 4.88% (14.5298 => 15.2390, std.dev.: 0.0064) MultiSource/Applications/sgefa/sgefa: 3.61% (0.2995 => 0.3103, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 2.60% (33.2944 => 34.1587, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5137, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 26.59% (1.0895 => 1.3792, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 20.21% (1.8175 => 2.1848, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 18.10% (0.9996 => 1.1805, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 11.19% (1.1560 => 1.2854, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 10.52% (0.4867 => 0.5379, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.51% (3.6469 => 4.0302, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 9.92% (2.8813 => 3.1671, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 8.58% (0.8273 => 0.8983, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 8.08% (3.1736 => 3.4299, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/fp-convert: 7.98% (3.4016 => 3.6732, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 7.46% (1.0640 => 1.1434, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.29% (1.7081 => 1.8326, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/puzzle: 6.93% (0.4846 => 0.5182, std.dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: 6.10% (11.2619 => 11.9492, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: 5.24% (1.2998 => 1.3679, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.22% (7.9275 => 8.3417, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-6: 5.07% (1.9199 => 2.0173, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.48% (0.2389 => 0.2496, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.33% (2.5629 => 2.6739, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.02% (1.9144 => 1.9913, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 3.80% (1.4298 => 1.4842, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.54% (13.3668 => 13.8402, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/salsa20: 3.47% (7.4271 => 7.6847, std.dev.: 0.0100) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.43% (4.4062 => 4.5574, std.dev.: 0.0092) SingleSource/Benchmarks/McGill/queens: 3.28% (2.1753 => 2.2466, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 3.25% (6.6320 => 6.8475, std.dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 3.15% (12.0921 => 12.4735, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.99% (1.9863 => 2.0456, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 2.72% (28.2225 => 28.9906, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 2.48% (3.8177 => 3.9122, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 2.43% (31.4682 => 32.2334, std.dev.: 0.0119) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.19% (0.9692 => 0.9904, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.17% (10.7476 => 10.9812, std.dev.: 0.0117) MultiSource/Applications/JM/lencod/lencod: 2.06% (7.6086 => 7.7653, std.dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: 2.02% (84.4286 => 86.1335, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/oourafft: 1.84% (5.5130 => 5.6147, std.dev.: 0.0031) MultiSource/Applications/minisat/minisat: 1.63% (9.3358 => 9.4879, std.dev.: 0.0275) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5121, std.dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1878, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.19% (5.1531 => 5.2146, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists: 1.16% (12.4560 => 12.6010, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0265, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 1.04% (3.1071 => 3.1393, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.25% (0.2670 => 0.1435, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.19% (0.4657 => 0.3903, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.32% (1.3813 => 1.2111, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.19% (1.3819 => 1.2135, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) SingleSource/Benchmarks/McGill/chomp: -23.37% (1.2308 => 0.9432, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -21.47% (1.0460 => 0.8214, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -12.11% (0.2238 => 0.1967, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -7.98% (2.6470 => 2.4358, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -6.23% (1.2870 => 1.2068) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2653, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -6.15% (26.5159 => 24.8849, std.dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/huffbench: -5.95% (20.3410 => 19.1314, std.dev.: 0.0241) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.73% (0.3458 => 0.3260, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -5.41% (5.0168 => 4.7454, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.18% (1.3780 => 1.3066, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.82% (3.2729 => 3.1478, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -2.80% (1.9762 => 1.9209, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4834, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.38% (1.7688 => 1.7267, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/Shootout/lists: -2.23% (6.3560 => 6.2140, std.dev.: 0.0047) MultiSource/Applications/aha/aha: -2.19% (3.1476 => 3.0787, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.61% (1.4326 => 1.4096, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8674, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/ReedSolomon: -1.13% (7.1097 => 7.0295, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2582, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 10 21:17:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 10 Oct 2012 23:17:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121011041742.080532A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4783?compare_to=4780&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4783, Order: 165693, Start Time: 2012-10-11 02:59:38, End Time: 2012-10-11 04:19:31 To: 4780, Order: 165678, Start Time: 2012-10-11 01:10:26, End Time: 2012-10-11 02:30:18 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 1 (4 on baseline) Performance Regressions: 2 (173 on baseline) Performance Improvements: 4 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 1018 (744 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.19% (0.0522 => 0.0521, std.dev.: 0.0012) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/JM/lencod/lencod: 1.42% (23.4975 => 23.8320, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.88% (54.4740 => 56.0439, std.dev.: 0.1127) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.16% (15.6325 => 15.1382, std.dev.: 0.0048) MultiSource/Applications/ClamAV/clamscan: -1.69% (19.8699 => 19.5338, std.dev.: 0.0094) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.51% (83.9797 => 81.8730, std.dev.: 0.7413) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.11% (10.0639 => 9.9526, std.dev.: 0.0011) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.24% (0.5886 => 0.5900, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 0.52% (16.3203 => 16.4057, std.dev.: 0.0086) MultiSource/Benchmarks/Bullet/bullet: 0.82% (55.3474 => 55.8013, std.dev.: 0.0353) MultiSource/Benchmarks/MallocBench/gs/gs: 0.30% (4.4187 => 4.4321, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.40% (1.2801 => 1.2852, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.19% (7.8621 => 7.8771, std.dev.: 0.0129) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.40% (0.7408 => 0.7438, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.28% (0.0355 => 0.0354, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 0.14% (0.1464 => 0.1466, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.46% (0.0653 => 0.0656, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -11.77% (63.2438 => 55.8013, std.dev.: 0.0353) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 33.94% (14.1553 => 18.9600, std.dev.: 0.0194) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.90% (3.4629 => 5.6758, std.dev.: 0.0030) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14559.31% (0.0720 => 10.5547, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952500.00% (0.0001 => 9.9526, std.dev.: 0.0011) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.55% (0.2554 => 0.4177, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 46.02% (10.3673 => 15.1382, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/richards_benchmark: 39.09% (0.1622 => 0.2256, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 34.09% (0.1056 => 0.1416, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 24.98% (1.7609 => 2.2008, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.47% (7.0540 => 8.4276, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/flops: 18.58% (0.1432 => 0.1698, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.49% (2.2022 => 2.5874, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: 15.28% (0.0746 => 0.0860, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.81% (0.0871 => 0.1000, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.24% (0.1566 => 0.1789, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.78% (0.6675 => 0.7528, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 12.15% (10.4361 => 11.7045, std.dev.: 0.0116) MultiSource/Benchmarks/Olden/power/power: 11.94% (0.1440 => 0.1612, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 11.73% (0.3282 => 0.3667, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.50% (0.5105 => 0.5692, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.44% (0.4879 => 0.5437, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 11.33% (5.7591 => 6.4114, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 11.12% (0.1655 => 0.1839, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.02% (0.5020 => 0.5573, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.95% (0.3177 => 0.3525, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 10.87% (0.7433 => 0.8241, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.87% (0.3543 => 0.3928, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.52% (0.1625 => 0.1796, std.dev.: 0.0021) MultiSource/Applications/d/make_dparser: 10.46% (3.3354 => 3.6844, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 10.46% (0.3423 => 0.3781, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.42% (0.3473 => 0.3835, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.35% (0.1584 => 0.1748, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.33% (0.3561 => 0.3929, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.32% (1.5415 => 1.7006, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 10.30% (0.1175 => 0.1296, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 10.27% (0.7115 => 0.7846, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.27% (0.3543 => 0.3907, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.26% (0.2700 => 0.2977, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.22% (0.2271 => 0.2503, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.21% (0.3497 => 0.3854, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.15% (0.3516 => 0.3873, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.13% (0.3927 => 0.4325, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.06% (0.3828 => 0.4213, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/property: 9.98% (0.3886 => 0.4274, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.97% (0.1143 => 0.1257, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 9.91% (0.3694 => 0.4060, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.79% (0.1236 => 0.1357, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.77% (0.3307 => 0.3630, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 9.73% (0.1151 => 0.1263, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.73% (0.2107 => 0.2312, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.63% (0.6450 => 0.7071, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.54% (0.1510 => 0.1654, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 9.50% (1.1642 => 1.2748, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.39% (8.1363 => 8.9006, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.33% (0.8067 => 0.8820, std.dev.: 0.0082) MultiSource/Applications/lua/lua: 9.30% (3.8723 => 4.2326, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.06% (0.2758 => 0.3008, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.04% (0.1438 => 0.1568, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 9.03% (0.1695 => 0.1848, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.01% (0.8172 => 0.8908, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.00% (0.5569 => 0.6070, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.87% (0.1940 => 0.2112, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.86% (0.5860 => 0.6379, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 8.85% (1.0722 => 1.1671, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.82% (4.2646 => 4.6409, std.dev.: 0.0082) MultiSource/Applications/viterbi/viterbi: 8.68% (0.1555 => 0.1690, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 8.64% (21.9371 => 23.8320, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/bigfib: 8.61% (0.6456 => 0.7012, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 8.61% (1.5603 => 1.6946, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.57% (0.5925 => 0.6433, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.57% (0.2603 => 0.2826, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.55% (0.9765 => 1.0600, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 8.51% (0.6030 => 0.6543, std.dev.: 0.0028) MultiSource/Applications/treecc/treecc: 8.44% (2.0273 => 2.1985, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.33% (0.2065 => 0.2237, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 8.30% (0.3387 => 0.3668, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 8.28% (0.1268 => 0.1373, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 8.25% (9.4845 => 10.2673, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.25% (1.3050 => 1.4127, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.22% (0.3441 => 0.3724, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 8.09% (2.2969 => 2.4827, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: 8.03% (0.7835 => 0.8464, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/09-vor/vor: 7.99% (0.3180 => 0.3434, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.97% (0.4615 => 0.4983, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 7.90% (0.8921 => 0.9626, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: 7.89% (0.1268 => 0.1368, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.79% (0.7326 => 0.7897, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.70% (0.4636 => 0.4993, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.65% (0.4103 => 0.4417, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.63% (0.1337 => 0.1439, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.61% (0.1695 => 0.1824, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 7.59% (0.1330 => 0.1431, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.49% (7.9617 => 8.5582, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.48% (0.3865 => 0.4154, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.45% (0.4203 => 0.4516, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.44% (0.5981 => 0.6426, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.43% (0.3121 => 0.3353, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.37% (0.3826 => 0.4108, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 7.36% (1.1840 => 1.2711, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.32% (0.4289 => 0.4603, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 7.28% (0.3422 => 0.3671, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.23% (0.4620 => 0.4954, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.18% (1.1861 => 1.2713, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.11% (0.2266 => 0.2427, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 7.09% (0.4048 => 0.4335, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.96% (0.3650 => 0.3904, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.75% (0.2905 => 0.3101, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.61% (0.1906 => 0.2032, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.58% (0.3603 => 0.3840, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.54% (1.4186 => 1.5114, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.51% (0.3162 => 0.3368, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.51% (0.3136 => 0.3340, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.47% (0.2891 => 0.3078, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.43% (0.3684 => 0.3921, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.38% (5.0018 => 5.3208, std.dev.: 0.0056) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.34% (0.8101 => 0.8615, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.31% (4.9449 => 5.2568, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.31% (2.0665 => 2.1968, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.22% (1.5859 => 1.6846, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.22% (0.2831 => 0.3007, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 6.13% (0.2725 => 0.2892, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.06% (0.2756 => 0.2923, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 6.00% (0.3232 => 0.3426) SingleSource/Benchmarks/Shootout-C++/except: 5.99% (0.2871 => 0.3043, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.96% (0.3052 => 0.3234, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.91% (0.2877 => 0.3047, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.90% (2.2024 => 2.3324, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 5.85% (0.2802 => 0.2966, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.85% (0.2872 => 0.3040, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 5.85% (0.3283 => 0.3475, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.84% (0.2793 => 0.2956, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 5.82% (0.2714 => 0.2872, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: 5.81% (0.2049 => 0.2168, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.71% (0.3379 => 0.3572, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.71% (14.3668 => 15.1867, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/matrix: 5.58% (0.3098 => 0.3271, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.44% (0.4064 => 0.4285, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.28% (0.3427 => 0.3608, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 5.04% (17.1811 => 18.0471, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/objinst: 4.85% (0.3131 => 0.3283, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 4.73% (1.2842 => 1.3449, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.69% (0.2430 => 0.2544, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.36% (1.1194 => 1.1570, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.35% (3.8922 => 4.0226, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/bh/bh: 3.33% (0.3092 => 0.3195, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.65% (0.3817 => 0.3918, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 26.11% (1.1145 => 1.4055, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 18.49% (0.9957 => 1.1798, std.dev.: 0.0019) MultiSource/Applications/aha/aha: 14.53% (3.1595 => 3.6186, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 12.29% (0.4808 => 0.5399, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.39% (3.6395 => 4.0540, std.dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.75% (2.8904 => 3.2010, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.97% (1.1396 => 1.2532, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: 9.80% (3.3453 => 3.6731, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 7.95% (0.1421 => 0.1534, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.83% (3.1578 => 3.3735, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 5.20% (6.5088 => 6.8473, std.dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 4.59% (27.8444 => 29.1230, std.dev.: 0.0016) MultiSource/Benchmarks/BitBench/drop3/drop3: 4.30% (0.4162 => 0.4341, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 4.08% (9.1159 => 9.4882, std.dev.: 0.0362) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.00% (4.3882 => 4.5639, std.dev.: 0.0314) MultiSource/Applications/spiff/spiff: 3.39% (2.9346 => 3.0341, std.dev.: 0.0025) MultiSource/Benchmarks/PAQ8p/paq8p: 2.95% (85.0658 => 87.5782, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/queens: 2.93% (2.1825 => 2.2464, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.78% (4.2280 => 4.3455, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.76% (0.9540 => 0.9803, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.74% (13.4384 => 13.8061, std.dev.: 0.0217) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.35% (8.1563 => 8.3479, std.dev.: 0.0018) SingleSource/Regression/C/uint64_to_float: 2.31% (0.5413 => 0.5538, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.21% (1.7254 => 1.7635, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.96% (1.4460 => 1.4743, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.49% (6.6465 => 6.7457, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.47% (2.6546 => 2.6935, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1314, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: -79.93% (0.8651 => 0.1736, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.92% (5.2763 => 3.2753, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.06% (5.3855 => 3.7129, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.54% (5.3526 => 3.7181, std.dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -14.61% (54.1659 => 46.2522, std.dev.: 0.0214) MultiSource/Applications/ClamAV/clamscan: -11.91% (22.1758 => 19.5338, std.dev.: 0.0094) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -9.92% (2.9384 => 2.6470, std.dev.: 0.0138) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -44.25% (0.0400 => 0.0223) SingleSource/Benchmarks/Misc/mandel: -33.44% (1.1492 => 0.7649, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/puzzle: -25.55% (0.6962 => 0.5183, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -23.91% (1.2373 => 0.9414, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/flops-6: -16.66% (1.6925 => 1.4106, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.83% (0.0998 => 0.0860, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -11.01% (1.5373 => 1.3680) MultiSource/Benchmarks/FreeBench/mason/mason: -10.00% (0.2161 => 0.1945, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.88% (4.8142 => 4.4832, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: -6.80% (1.5835 => 1.4758, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -6.27% (5.0483 => 4.7320, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -6.23% (1.2870 => 1.2068, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.89% (0.3463 => 0.3259, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.15% (1.6805 => 1.5939, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.82% (0.8614 => 0.8199) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.77% (1.8329 => 1.7454, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/huffbench: -4.57% (19.9488 => 19.0370, std.dev.: 0.2806) SingleSource/UnitTests/Vector/multiplies: -4.12% (2.5528 => 2.4475, std.dev.: 0.0008) MultiSource/Applications/siod/siod: -3.80% (3.2827 => 3.1580, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -3.72% (26.0924 => 25.1229, std.dev.: 0.0119) SingleSource/Benchmarks/Misc/fbench: -3.57% (2.2771 => 2.1957, std.dev.: 0.0030) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.10% (8.6802 => 8.4982, std.dev.: 0.0250) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.04% (2.7294 => 2.6738, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6830, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.56% (1.5660 => 1.5416, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4175, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.53% (1.1277 => 1.1105, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.50% (1.3677 => 1.3472, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-8: -1.37% (1.8525 => 1.8271, std.dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: -1.08% (5.2636 => 5.2069, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.83% (0.5229 => 0.5900, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 9.45% (14.9895 => 16.4057, std.dev.: 0.0086) MultiSource/Benchmarks/MallocBench/gs/gs: 7.82% (4.1105 => 4.4321, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 16.33% (1.1048 => 1.2852, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.04% (7.1582 => 7.8771, std.dev.: 0.0129) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.54% (0.6222 => 0.7438, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35300.00% (0.0001 => 0.0354, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -1.28% (0.1485 => 0.1466, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.00% (0.2116 => 0.0656, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 10 23:39:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 11 Oct 2012 01:39:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121011063943.1F6382A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4784?compare_to=4781&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4784, Order: 165693, Start Time: 2012-10-11 03:57:32, End Time: 2012-10-11 06:41:32 To: 4781, Order: 165676, Start Time: 2012-10-11 00:43:53, End Time: 2012-10-11 03:27:54 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (133 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (62 on baseline) Unchanged Tests: 1041 (830 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.24% (1.7400 => 1.7616, std.dev.: 0.0022) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.19% (0.1063 => 0.1182, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 11.16% (0.3496 => 0.3886, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 11.00% (0.3465 => 0.3846, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.98% (0.3488 => 0.3871, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 10.94% (0.3446 => 0.3823, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.92% (0.3460 => 0.3838, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/trivial-interface: 10.92% (0.3442 => 0.3818, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 10.84% (0.3469 => 0.3845, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.74% (0.3650 => 0.4042, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.62% (0.3643 => 0.4030, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 10.57% (1.5932 => 1.7616, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/parameter-passing: 10.34% (0.3724 => 0.4109, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.08% (0.5826 => 0.6355, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.05% (0.5889 => 0.6422, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/05-eks/eks: 8.59% (0.1619 => 0.1758, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 8.54% (0.1218 => 0.1322, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.14% (0.5000 => 0.5407, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.06% (1.3152 => 1.4212, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.98% (0.4361 => 0.4709, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.77% (0.4994 => 0.5382, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.72% (0.2875 => 0.3097, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.72% (1.6211 => 1.7462, std.dev.: 0.0033) MultiSource/Benchmarks/PAQ8p/paq8p: 7.67% (0.4847 => 0.5219, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.64% (0.7171 => 0.7719, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.64% (0.3195 => 0.3439, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 7.61% (5.5417 => 5.9633, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/matrix: 7.45% (0.2780 => 0.2987, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 7.42% (0.3004 => 0.3227, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 7.37% (0.6634 => 0.7123, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.35% (0.1620 => 0.1739, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.32% (3.5627 => 3.8236, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.31% (0.2792 => 0.2996, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.30% (0.4139 => 0.4441, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 7.30% (0.9909 => 1.0632, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/hello: 7.30% (0.2714 => 0.2912, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.26% (0.2729 => 0.2927, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.23% (0.2725 => 0.2922, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 7.23% (0.2823 => 0.3027, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.22% (0.2811 => 0.3014, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.20% (0.2750 => 0.2948, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 7.18% (0.2813 => 0.3015, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 7.15% (1.0781 => 1.1552, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/random: 7.10% (0.2803 => 0.3002, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.09% (0.2738 => 0.2932, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.08% (2.0673 => 2.2136, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 7.04% (0.3096 => 0.3314, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.00% (0.2014 => 0.2155, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 6.92% (0.3267 => 0.3493, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.88% (0.5026 => 0.5372, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.87% (0.2911 => 0.3111, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 6.86% (4.2109 => 4.4997, std.dev.: 0.0072) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.85% (2.7292 => 2.9161, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.84% (0.3930 => 0.4199, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.83% (0.2736 => 0.2923, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.75% (0.3258 => 0.3478, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.75% (0.3362 => 0.3589, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 6.74% (0.2566 => 0.2739, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.73% (0.3625 => 0.3869, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 6.73% (0.4029 => 0.4300, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 6.72% (0.3317 => 0.3540, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.72% (0.3124 => 0.3334, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.70% (0.3060 => 0.3265, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/sieve: 6.68% (0.3726 => 0.3975, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.67% (0.3477 => 0.3709, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.65% (0.1549 => 0.1652, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.64% (0.5900 => 0.6292, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: 6.63% (0.3348 => 0.3570, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 6.61% (0.4251 => 0.4532, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 6.61% (0.3678 => 0.3921, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.58% (0.3282 => 0.3498, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.56% (0.2866 => 0.3054, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.52% (4.4195 => 4.7077, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/hash: 6.44% (0.4146 => 0.4413, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 6.42% (1.8794 => 2.0001, std.dev.: 0.0022) MultiSource/Applications/hbd/hbd: 6.36% (0.9697 => 1.0314, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.35% (0.3903 => 0.4151, std.dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: 6.35% (23.5202 => 25.0142, std.dev.: 0.0157) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.32% (0.3890 => 0.4136, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.31% (0.3690 => 0.3923, std.dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 6.30% (2.1013 => 2.2337, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 6.24% (0.2691 => 0.2859, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.23% (0.2040 => 0.2167, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.20% (0.1968 => 0.2090, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.20% (0.2969 => 0.3153, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.18% (0.3981 => 0.4227, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.11% (0.3845 => 0.4080, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.08% (0.3271 => 0.3470, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.00% (0.6435 => 0.6821, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 5.95% (4.6177 => 4.8926, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.95% (0.2068 => 0.2191, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.93% (0.3084 => 0.3267, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 5.89% (1.4269 => 1.5110, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/bigfib: 5.85% (0.5012 => 0.5305, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 5.85% (0.3336 => 0.3531, std.dev.: 0.0029) MultiSource/Applications/Burg/burg: 5.82% (0.5546 => 0.5869, std.dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 5.79% (2.1653 => 2.2906, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.78% (0.4658 => 0.4927, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 5.73% (0.7875 => 0.8326, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.70% (0.2737 => 0.2893, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 5.60% (2.0346 => 2.1486, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/football/football: 5.40% (0.2075 => 0.2187, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.33% (1.9694 => 2.0743, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.33% (0.2103 => 0.2215, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.29% (0.4253 => 0.4478, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.25% (1.9966 => 2.1014, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.08% (0.7426 => 0.7803, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.92% (0.5361 => 0.5625, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 4.85% (0.2391 => 0.2507, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.39% (0.5584 => 0.5829, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.04% (11.6398 => 12.1104, std.dev.: 0.0095) MultiSource/Applications/lambda-0_1_3/lambda: 4.03% (0.3498 => 0.3639, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.93% (4.6926 => 4.8768, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 2.56% (11.9555 => 12.2616, std.dev.: 0.0153) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 65.59% (0.2162 => 0.3580, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6107, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6735, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-2: 4.96% (1.8057 => 1.8952, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1637, std.dev.: 0.0145) SingleSource/Benchmarks/Dhrystone/dry: 4.18% (14.0481 => 14.6348, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1965, std.dev.: 0.0049) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5051, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2221, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2862, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5150, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5822, std.dev.: 0.0176) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5639, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/ary2: -10.07% (0.2402 => 0.2160, std.dev.: 0.0055) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9747, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7930, std.dev.: 0.0103) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9576, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8022, std.dev.: 0.0113) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std.dev.: 0.0037) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7730, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -2.76% (17.2379 => 16.7617, std.dev.: 0.0647) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8572, std.dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5763, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4952, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.17% (105.3826 => 104.1510, std.dev.: 0.0226) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0440, std.dev.: 0.0019) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 11 00:36:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 11 Oct 2012 02:36:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121011073614.ECFBD2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/4785?compare_to=4783&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4785, Order: 165701, Start Time: 2012-10-11 06:14:36, End Time: 2012-10-11 07:38:03 To: 4783, Order: 165693, Start Time: 2012-10-11 02:59:38, End Time: 2012-10-11 04:19:31 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 72 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (156 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 17 (15 on baseline) Unchanged Tests: 953 (690 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.44% (0.5900 => 0.5926, std.dev.: 0.0037) MultiSource/Applications/SPASS/SPASS: 0.11% (16.4057 => 16.4242, std.dev.: 0.0424) MultiSource/Benchmarks/Bullet/bullet: 0.38% (55.8013 => 56.0114, std.dev.: 0.0919) MultiSource/Benchmarks/MallocBench/gs/gs: -0.10% (4.4321 => 4.4275, std.dev.: 0.0245) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.27% (1.2852 => 1.2887, std.dev.: 0.0273) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.02% (7.8771 => 7.8757, std.dev.: 0.0790) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.05% (0.7438 => 0.7434, std.dev.: 0.0030) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0354 => 0.0354, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1466 => 0.1465, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.46% (0.0656 => 0.0659, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.44% (63.2438 => 56.0114, std.dev.: 0.0919) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.08% (14.1553 => 18.9799, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.94% (3.4629 => 5.6770, std.dev.: 0.0051) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14559.44% (0.0720 => 10.5548, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952000.00% (0.0001 => 9.9521, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 64.13% (0.2554 => 0.4192, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: 49.84% (10.3673 => 15.5346, std.dev.: 0.1597) SingleSource/Benchmarks/Misc/richards_benchmark: 44.08% (0.1622 => 0.2337, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 34.47% (0.1056 => 0.1420, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 25.42% (1.7609 => 2.2086, std.dev.: 0.0258) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.36% (7.0540 => 8.4901, std.dev.: 0.1665) SingleSource/Benchmarks/Misc/flops: 19.06% (0.1432 => 0.1705, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.42% (2.2022 => 2.6079, std.dev.: 0.0094) SingleSource/Benchmarks/BenchmarkGame/n-body: 15.68% (0.0746 => 0.0863, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.93% (0.0871 => 0.1001, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.18% (0.1566 => 0.1788, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.19% (0.0834 => 0.0944, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.88% (0.6675 => 0.7535, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 12.84% (10.4361 => 11.7756, std.dev.: 0.0224) SingleSource/Benchmarks/Misc/oourafft: 12.64% (0.3282 => 0.3697, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.43% (0.1625 => 0.1827, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.26% (0.4879 => 0.5477, std.dev.: 0.0109) MultiSource/Benchmarks/Olden/power/power: 12.15% (0.1440 => 0.1615, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 12.00% (5.7591 => 6.4503, std.dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.69% (0.5105 => 0.5702, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 11.42% (0.1655 => 0.1844, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.92% (0.3177 => 0.3524, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.92% (1.5415 => 1.7098, std.dev.: 0.0325) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.88% (0.5020 => 0.5566, std.dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: 10.78% (0.7433 => 0.8234, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/18-imp/imp: 10.66% (0.3423 => 0.3788, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.64% (0.3543 => 0.3920, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.59% (0.2700 => 0.2986, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 10.58% (3.3354 => 3.6884, std.dev.: 0.0052) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.42% (0.1584 => 0.1749, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.24% (0.8067 => 0.8893, std.dev.: 0.0264) MultiSource/Applications/minisat/minisat: 10.23% (0.7115 => 0.7843, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.08% (0.2758 => 0.3036, std.dev.: 0.0102) MultiSource/Benchmarks/Olden/tsp/tsp: 10.04% (0.1175 => 0.1293, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.04% (0.2271 => 0.2499, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/trivial-interface: 9.99% (0.3473 => 0.3820, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 9.98% (0.3927 => 0.4319, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.95% (0.1236 => 0.1359, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.91% (0.3561 => 0.3914, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.91% (0.3543 => 0.3894, std.dev.: 0.0008) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.89% (0.1143 => 0.1256, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 9.87% (0.3516 => 0.3863, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.84% (0.3497 => 0.3841, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 9.77% (0.1044 => 0.1146, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/exceptions: 9.74% (0.3828 => 0.4201, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.74% (0.6450 => 0.7078, std.dev.: 0.0015) MultiSource/Applications/aha/aha: 9.73% (0.1151 => 0.1263, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/property: 9.73% (0.3886 => 0.4264, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.71% (0.3307 => 0.3628, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.58% (0.3694 => 0.4048, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.55% (0.5569 => 0.6101, std.dev.: 0.0150) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.49% (0.2107 => 0.2307, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.47% (0.1510 => 0.1653, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.46% (8.1363 => 8.9058, std.dev.: 0.1272) MultiSource/Applications/Burg/burg: 9.42% (1.1642 => 1.2739, std.dev.: 0.0082) MultiSource/Applications/lua/lua: 9.31% (3.8723 => 4.2330, std.dev.: 0.0173) MultiSource/Applications/JM/lencod/lencod: 9.24% (21.9371 => 23.9648, std.dev.: 0.0307) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.18% (0.1438 => 0.1570, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/em3d/em3d: 9.09% (0.1695 => 0.1849, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.90% (4.2646 => 4.6443, std.dev.: 0.0041) MultiSource/Applications/hbd/hbd: 8.89% (1.5603 => 1.6990, std.dev.: 0.0080) MultiSource/Applications/lemon/lemon: 8.88% (1.0722 => 1.1674, std.dev.: 0.0054) MultiSource/Benchmarks/mafft/pairlocalalign: 8.81% (9.4845 => 10.3202, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.81% (0.3441 => 0.3744, std.dev.: 0.0100) SingleSource/Benchmarks/Stanford/Puzzle: 8.68% (0.1268 => 0.1378, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 8.67% (0.6456 => 0.7016, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.61% (0.1940 => 0.2107, std.dev.: 0.0020) MultiSource/Applications/viterbi/viterbi: 8.49% (0.1555 => 0.1687, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.45% (0.2603 => 0.2823, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.42% (0.9765 => 1.0587, std.dev.: 0.0275) SingleSource/UnitTests/ObjC++/Hello: 8.41% (0.5925 => 0.6423, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 8.33% (2.0273 => 2.1962, std.dev.: 0.0074) MultiSource/Benchmarks/sim/sim: 8.30% (0.3387 => 0.3668, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 8.29% (0.6030 => 0.6530, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.28% (1.3050 => 1.4131, std.dev.: 0.0281) MultiSource/Benchmarks/Prolangs-C/football/football: 8.27% (0.8921 => 0.9659, std.dev.: 0.0198) MultiSource/Applications/siod/siod: 8.12% (2.2969 => 2.4833, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/09-vor/vor: 8.11% (0.3180 => 0.3438, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 7.94% (0.7835 => 0.8457, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.89% (0.3826 => 0.4128, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.85% (0.1337 => 0.1442, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.80% (0.4103 => 0.4423, std.dev.: 0.0076) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.78% (7.9617 => 8.5808, std.dev.: 0.1710) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.67% (0.1695 => 0.1825, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 7.59% (0.7326 => 0.7882, std.dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 7.49% (1.1840 => 1.2727, std.dev.: 0.0222) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.45% (0.3865 => 0.4153, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 7.38% (0.4620 => 0.4961, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.30% (0.4203 => 0.4510, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 7.30% (0.4289 => 0.4602, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.24% (0.2266 => 0.2430, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.14% (1.1861 => 1.2708, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 7.13% (0.3422 => 0.3666, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 7.11% (0.4048 => 0.4336, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.05% (0.4636 => 0.4963, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.86% (1.4186 => 1.5159, std.dev.: 0.0309) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.58% (4.9449 => 5.2703, std.dev.: 0.1237) SingleSource/Benchmarks/Shootout-C++/sieve: 6.49% (0.3603 => 0.3837, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.48% (0.3162 => 0.3367, std.dev.: 0.0068) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.41% (0.8101 => 0.8620, std.dev.: 0.0027) SingleSource/Regression/C++/ofstream_ctor: 6.40% (0.2905 => 0.3091, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 6.35% (0.3684 => 0.3918, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.26% (0.2891 => 0.3072, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 6.20% (0.2049 => 0.2176, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 6.04% (0.2831 => 0.3002, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.99% (1.5859 => 1.6809, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: 5.94% (0.2877 => 0.3048, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.91% (0.2756 => 0.2919, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 5.83% (0.3052 => 0.3230, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 5.82% (0.3232 => 0.3420, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 5.82% (0.2871 => 0.3038, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.80% (0.2725 => 0.2883, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.79% (2.2024 => 2.3299, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.78% (0.2872 => 0.3038, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.70% (0.3283 => 0.3470, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: 5.68% (0.3379 => 0.3571, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hello: 5.67% (0.2714 => 0.2868, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.59% (0.2793 => 0.2949, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 5.53% (0.2802 => 0.2957, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.44% (0.4064 => 0.4285, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 5.42% (0.3098 => 0.3266, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 5.07% (17.1811 => 18.0524, std.dev.: 0.0244) SingleSource/Benchmarks/Shootout-C++/objinst: 4.89% (0.3131 => 0.3284, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 4.63% (1.2842 => 1.3436, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/bh/bh: 3.40% (0.3092 => 0.3197, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.30% (3.8922 => 4.0207, std.dev.: 0.0172) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 26.14% (1.1145 => 1.4058, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 18.48% (0.9957 => 1.1797, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 14.56% (3.1595 => 3.6196, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 12.29% (0.4808 => 0.5399, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.68% (3.6395 => 4.0647, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.82% (2.8904 => 3.2031, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.92% (1.1396 => 1.2527, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: 9.78% (3.3453 => 3.6726, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 7.95% (0.1421 => 0.1534, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.82% (3.1578 => 3.3731, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 5.20% (6.5088 => 6.8474, std.dev.: 0.0085) MultiSource/Benchmarks/mafft/pairlocalalign: 4.59% (27.8444 => 29.1228, std.dev.: 0.0026) MultiSource/Benchmarks/BitBench/drop3/drop3: 4.30% (0.4162 => 0.4341, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 4.09% (9.1159 => 9.4886, std.dev.: 0.0113) MultiSource/Benchmarks/nbench/nbench: 3.63% (11.6436 => 12.0664, std.dev.: 0.0083) MultiSource/Applications/spiff/spiff: 3.40% (2.9346 => 3.0343, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 2.96% (85.0658 => 87.5819, std.dev.: 0.5472) SingleSource/Benchmarks/McGill/queens: 2.93% (2.1825 => 2.2464, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.80% (0.9540 => 0.9807, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.71% (4.2280 => 4.3424, std.dev.: 0.0048) SingleSource/Regression/C/uint64_to_float: 2.35% (0.5413 => 0.5540, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.29% (8.1563 => 8.3431, std.dev.: 0.0498) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.23% (1.7254 => 1.7638, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.98% (1.4460 => 1.4746, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/oourafft: 1.51% (6.6465 => 6.7468, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.46% (2.6546 => 2.6934, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.03% (6.6874 => 0.1318, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: -79.94% (0.8651 => 0.1735, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.77% (5.2763 => 3.2834, std.dev.: 0.0353) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.28% (5.3855 => 3.7547, std.dev.: 0.0584) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -29.75% (5.3526 => 3.7603, std.dev.: 0.0591) SingleSource/UnitTests/Vector/constpool: -14.65% (54.1659 => 46.2318, std.dev.: 0.0296) MultiSource/Applications/ClamAV/clamscan: -11.80% (22.1758 => 19.5600, std.dev.: 0.0411) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -9.63% (2.9384 => 2.6555, std.dev.: 0.0518) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -44.25% (0.0400 => 0.0223, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/puzzle: -25.58% (0.6962 => 0.5181, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -23.98% (1.2373 => 0.9406, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-6: -16.69% (1.6925 => 1.4101, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.83% (0.0998 => 0.0860, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -11.01% (1.5373 => 1.3680) MultiSource/Benchmarks/FreeBench/mason/mason: -9.72% (0.2161 => 0.1951, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4833, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -6.81% (1.5835 => 1.4757, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -6.27% (5.0483 => 4.7320, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -6.23% (1.2870 => 1.2068) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.86% (0.3463 => 0.3260, std.dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.19% (1.6805 => 1.5933, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -4.90% (19.9488 => 18.9714, std.dev.: 0.1869) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.86% (1.8329 => 1.7438, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.81% (0.8614 => 0.8200, std.dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -4.08% (2.5528 => 2.4487, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.80% (3.2827 => 3.1579, std.dev.: 0.0037) MultiSource/Applications/lua/lua: -3.75% (26.0924 => 25.1144, std.dev.: 0.0166) SingleSource/Benchmarks/Misc/fbench: -3.55% (2.2771 => 2.1963, std.dev.: 0.0033) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.04% (2.7294 => 2.6738, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6829, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -1.53% (1.1277 => 1.1105) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4223, std.dev.: 0.0393) SingleSource/Benchmarks/Misc/flops-8: -1.40% (1.8525 => 1.8265, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.37% (1.3677 => 1.3490, std.dev.: 0.0057) MultiSource/Applications/lambda-0_1_3/lambda: -1.17% (5.2636 => 5.2020, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8579, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.33% (0.5229 => 0.5926, std.dev.: 0.0037) MultiSource/Applications/SPASS/SPASS: 9.57% (14.9895 => 16.4242, std.dev.: 0.0424) MultiSource/Benchmarks/MallocBench/gs/gs: 7.71% (4.1105 => 4.4275, std.dev.: 0.0245) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 16.65% (1.1048 => 1.2887, std.dev.: 0.0273) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.02% (7.1582 => 7.8757, std.dev.: 0.0790) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.48% (0.6222 => 0.7434, std.dev.: 0.0030) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35300.00% (0.0001 => 0.0354, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -1.35% (0.1485 => 0.1465, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.86% (0.2116 => 0.0659, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 11 00:42:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 11 Oct 2012 02:42:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121011074217.235972A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/4786?compare_to=4782&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4786, Order: 165701, Start Time: 2012-10-11 06:14:33, End Time: 2012-10-11 07:44:04 To: 4782, Order: 165693, Start Time: 2012-10-11 02:57:32, End Time: 2012-10-11 04:12:35 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (180 on baseline) Performance Improvements: 0 (32 on baseline) Added Tests: 72 (138 on baseline) Unchanged Tests: 969 (692 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.23% (53.8803 => 56.1571, std.dev.: 0.0579) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 45.48% (0.8818 => 1.2828, std.dev.: 0.0154) MultiSource/Benchmarks/PAQ8p/paq8p: 24.56% (2.0176 => 2.5131, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 18.16% (0.0826 => 0.0976) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.45% (0.1410 => 0.1656, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 17.25% (0.2243 => 0.2630, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 15.77% (0.0653 => 0.0756, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 15.35% (0.0834 => 0.0962) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 14.56% (0.6283 => 0.7198, std.dev.: 0.0158) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 14.15% (0.2721 => 0.3106, std.dev.: 0.0083) MultiSource/Benchmarks/Olden/tsp/tsp: 14.12% (0.1013 => 0.1156, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.08% (0.1413 => 0.1612, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.66% (0.1588 => 0.1805, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.62% (0.1072 => 0.1218) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.55% (1.1364 => 1.2904, std.dev.: 0.0364) MultiSource/Applications/hbd/hbd: 13.46% (1.3693 => 1.5536, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.04% (0.1327 => 0.1500, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.88% (0.4791 => 0.5408, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.86% (0.0964 => 0.1088, std.dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 12.84% (0.7038 => 0.7942, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.71% (0.2596 => 0.2926, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.68% (1.4563 => 1.6409, std.dev.: 0.0412) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.40% (0.6959 => 0.7822, std.dev.: 0.0226) MultiSource/Applications/aha/aha: 12.34% (0.1062 => 0.1193, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 12.29% (0.4328 => 0.4860, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/distray/distray: 12.22% (0.0818 => 0.0918, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 12.20% (3.6692 => 4.1168, std.dev.: 0.0929) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.14% (3.9660 => 4.4474, std.dev.: 0.0925) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.98% (0.5265 => 0.5896, std.dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.86% (0.9199 => 1.0290, std.dev.: 0.0311) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.84% (0.1157 => 0.1294, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 11.83% (0.5818 => 0.6506, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 11.74% (0.4062 => 0.4539, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/18-imp/imp: 11.74% (0.3220 => 0.3598, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.60% (0.3130 => 0.3493, std.dev.: 0.0082) SingleSource/UnitTests/ObjC++/Hello: 11.50% (0.5748 => 0.6409, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 11.49% (13.8202 => 15.4081, std.dev.: 0.0169) MultiSource/Applications/lemon/lemon: 11.46% (1.0313 => 1.1495, std.dev.: 0.0177) SingleSource/Benchmarks/McGill/chomp: 11.45% (0.1589 => 0.1771, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 11.31% (0.3511 => 0.3908, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/power/power: 11.27% (0.1003 => 0.1116, std.dev.: 0.0040) MultiSource/Applications/Burg/burg: 11.26% (1.1061 => 1.2306, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.24% (0.2127 => 0.2366, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.23% (0.3899 => 0.4337, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: 11.18% (0.3192 => 0.3549, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.05% (1.2193 => 1.3540, std.dev.: 0.0293) SingleSource/UnitTests/ObjC++/property-reference: 10.98% (0.7061 => 0.7836, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.90% (0.3485 => 0.3865, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.86% (0.4016 => 0.4452, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 10.85% (0.0977 => 0.1083, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 10.79% (0.8310 => 0.9207, std.dev.: 0.0184) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.79% (0.6135 => 0.6797, std.dev.: 0.0155) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.78% (0.2023 => 0.2241, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.75% (0.3580 => 0.3965, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.66% (0.4390 => 0.4858, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 10.64% (0.2781 => 0.3077, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.59% (0.8698 => 0.9619, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.58% (0.1569 => 0.1735, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.56% (1.9828 => 2.1922, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.55% (0.3489 => 0.3857, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.52% (0.3756 => 0.4151, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.51% (0.5577 => 0.6163, std.dev.: 0.0175) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.50% (0.5637 => 0.6229, std.dev.: 0.0206) MultiSource/Benchmarks/nbench/nbench: 10.50% (1.0594 => 1.1706, std.dev.: 0.0332) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.49% (0.3022 => 0.3339, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 10.48% (0.3293 => 0.3638, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 10.44% (0.3868 => 0.4272, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.41% (0.3246 => 0.3584, std.dev.: 0.0107) MultiSource/Applications/d/make_dparser: 10.38% (3.1889 => 3.5199, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.32% (0.2782 => 0.3069, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 10.30% (16.6129 => 18.3234, std.dev.: 0.0140) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.30% (0.6576 => 0.7253, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/sieve: 10.14% (0.3453 => 0.3803, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.12% (7.2180 => 7.9487, std.dev.: 0.1718) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.08% (0.2966 => 0.3265, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 10.01% (0.2726 => 0.2999, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 9.99% (4.6629 => 5.1288, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 9.94% (2.1791 => 2.3957, std.dev.: 0.0205) MultiSource/Applications/treecc/treecc: 9.93% (1.9270 => 2.1184, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: 9.86% (3.8646 => 4.2458, std.dev.: 0.1337) SingleSource/Benchmarks/Shootout-C++/hello: 9.86% (0.2607 => 0.2864, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 9.85% (0.3107 => 0.3413, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.84% (0.4805 => 0.5278, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary3: 9.81% (0.3149 => 0.3458, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.79% (0.2655 => 0.2915, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 9.78% (0.2760 => 0.3030, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 9.77% (0.2937 => 0.3224, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.76% (0.2765 => 0.3035, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 9.74% (0.1478 => 0.1622, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 9.74% (0.2690 => 0.2952, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 9.73% (0.3534 => 0.3878, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 9.73% (0.6744 => 0.7400, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 9.71% (0.2761 => 0.3029, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 9.70% (0.2628 => 0.2883, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 9.43% (0.7506 => 0.8214, std.dev.: 0.0033) MultiSource/Applications/JM/ldecod/ldecod: 9.42% (6.5754 => 7.1948, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.38% (0.2696 => 0.2949, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 9.02% (14.8535 => 16.1938, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.01% (0.1276 => 0.1391, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.00% (0.3755 => 0.4093, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.85% (4.9865 => 5.4276, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.82% (1.3245 => 1.4413, std.dev.: 0.0378) SingleSource/Benchmarks/Shootout-C++/matrix: 8.73% (0.2988 => 0.3249, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 8.73% (0.2945 => 0.3202, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.67% (0.2504 => 0.2721, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.47% (0.3245 => 0.3520, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.40% (0.2321 => 0.2516, std.dev.: 0.0065) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.22% (0.1435 => 0.1553, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 8.21% (0.3131 => 0.3388, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/bigfib: 8.11% (0.6250 => 0.6757, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.11% (3.2742 => 3.5396, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 7.77% (3.7467 => 4.0380, std.dev.: 0.0118) SingleSource/UnitTests/ObjC/parameter-passing: 7.74% (0.4003 => 0.4313, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.51% (0.3914 => 0.4208, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 7.35% (1.2292 => 1.3196, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/for-in: 7.34% (0.3789 => 0.4067, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/exceptions-4: 7.32% (0.3646 => 0.3913, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.32% (0.3578 => 0.3840, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.31% (0.3940 => 0.4228, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.22% (0.3601 => 0.3861, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.18% (0.3663 => 0.3926) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.14% (0.9108 => 0.9758, std.dev.: 0.0137) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.10% (0.3650 => 0.3909, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: 7.07% (0.3623 => 0.3879, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 6.30% (0.1777 => 0.1889, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 6.28% (1.2749 => 1.3550, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 6.19% (8.4961 => 9.0216, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.98% (1.5188 => 1.6097, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.83% (2.1007 => 2.2232, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 5.34% (16.2614 => 17.1296, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/oourafft: 5.13% (0.2008 => 0.2111, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 4.82% (14.5298 => 15.2297, std.dev.: 0.0063) MultiSource/Applications/sgefa/sgefa: 3.84% (0.2995 => 0.3110, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 2.29% (33.2944 => 34.0554, std.dev.: 0.0118) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 30.49% (5.7573 => 7.5125, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 26.57% (1.0895 => 1.3790, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/fbench: 20.16% (1.8175 => 2.1839, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 18.04% (0.9996 => 1.1799, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 11.15% (1.1560 => 1.2849, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 10.56% (0.4867 => 0.5381) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.54% (3.6469 => 4.0312, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 9.92% (2.8813 => 3.1670, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 8.61% (0.8273 => 0.8985, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 8.10% (3.1736 => 3.4307, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: 7.98% (3.4016 => 3.6732, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 7.48% (1.0640 => 1.1436, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.27% (1.7081 => 1.8323, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/puzzle: 6.95% (0.4846 => 0.5183, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 6.09% (11.2619 => 11.9475, std.dev.: 0.0258) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.38% (7.9275 => 8.3537, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: 5.24% (1.2998 => 1.3679, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: 5.03% (1.9199 => 2.0164, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.32% (2.5629 => 2.6736, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: 4.00% (1.9144 => 1.9909, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 3.81% (1.4298 => 1.4843, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: 3.60% (7.4271 => 7.6945, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/queens: 3.27% (2.1753 => 2.2465, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 3.22% (6.6320 => 6.8455, std.dev.: 0.0067) MultiSource/Applications/hexxagon/hexxagon: 3.10% (12.0921 => 12.4671, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-8: 2.99% (1.9863 => 2.0457) MultiSource/Benchmarks/mafft/pairlocalalign: 2.71% (28.2225 => 28.9863, std.dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: 2.50% (3.8177 => 3.9132, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 2.43% (31.4682 => 32.2322, std.dev.: 0.0541) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.19% (0.9692 => 0.9904, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 2.17% (7.6086 => 7.7736, std.dev.: 0.0089) MultiSource/Applications/SPASS/SPASS: 2.11% (10.7476 => 10.9743, std.dev.: 0.0193) MultiSource/Benchmarks/PAQ8p/paq8p: 2.02% (84.4286 => 86.1308, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/oourafft: 1.78% (5.5130 => 5.6114, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.44% (9.3358 => 9.4699, std.dev.: 0.0116) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5101, std.dev.: 0.0406) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9684, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1882, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists: 1.15% (12.4560 => 12.5993, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0272, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (3.1071 => 3.1396, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.01% (3.1720 => 3.2039, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.14% (0.2670 => 0.1438, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.80% (0.4657 => 0.3921, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.27% (1.3819 => 1.2124, std.dev.: 0.0280) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.07% (1.3813 => 1.2146, std.dev.: 0.0381) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) SingleSource/Benchmarks/McGill/chomp: -24.45% (1.2308 => 0.9299, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -21.46% (1.0460 => 0.8215, std.dev.: 0.0165) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/mason/mason: -11.97% (0.2238 => 0.1970, std.dev.: 0.0021) SingleSource/UnitTests/Vector/multiplies: -7.76% (2.6470 => 2.4415, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -6.23% (1.2870 => 1.2068) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -6.15% (26.5159 => 24.8856, std.dev.: 0.0119) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.14% (1.3780 => 1.2934, std.dev.: 0.0259) SingleSource/Benchmarks/CoyoteBench/huffbench: -5.84% (20.3410 => 19.1536, std.dev.: 0.0932) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.75% (0.3458 => 0.3259, std.dev.: 0.0015) MultiSource/Benchmarks/sim/sim: -5.41% (5.0168 => 4.7456, std.dev.: 0.0069) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0013) MultiSource/Applications/siod/siod: -3.80% (3.2729 => 3.1484, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4834, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.24% (1.7688 => 1.7292, std.dev.: 0.0001) MultiSource/Applications/aha/aha: -2.19% (3.1476 => 3.0786, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.08% (0.6589 => 0.6452, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.93% (6.3560 => 6.2336, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/heapsort: -1.23% (3.9173 => 3.8690, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2564, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.13% (7.1097 => 7.0291, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: -1.03% (4.4810 => 4.4350, std.dev.: 0.0043) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 11 02:26:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 11 Oct 2012 04:26:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121011092627.680D62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4787?compare_to=4785&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4787, Order: 165707, Start Time: 2012-10-11 08:07:33, End Time: 2012-10-11 09:28:15 To: 4785, Order: 165701, Start Time: 2012-10-11 06:14:36, End Time: 2012-10-11 07:38:03 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (171 on baseline) Performance Improvements: 2 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 951 (673 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -2.95% (0.3455 => 0.3353, std.dev.: 0.0032) MultiSource/Benchmarks/PAQ8p/paq8p: -1.29% (15.5346 => 15.3340, std.dev.: 0.0059) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.08% (0.5926 => 0.5931, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: -0.28% (16.4242 => 16.3780, std.dev.: 0.0241) MultiSource/Benchmarks/Bullet/bullet: -0.42% (56.0114 => 55.7737, std.dev.: 0.0575) MultiSource/Benchmarks/MallocBench/gs/gs: -0.08% (4.4275 => 4.4240, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.43% (0.0465 => 0.0463, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.21% (0.0466 => 0.0465, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.23% (0.0434 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.23% (0.0435 => 0.0434, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.47% (0.0423 => 0.0421, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.24% (0.0425 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.48% (0.0418 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0419 => 0.0419, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.23% (0.0435 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.23% (0.0437 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.47% (0.0430 => 0.0428, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.23% (0.0431 => 0.0430, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0419 => 0.0419) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.24% (0.0421 => 0.0420, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.23% (0.0427 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.47% (0.0429 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.23% (0.0439 => 0.0438, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.57% (0.0460 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.24% (0.0415 => 0.0414) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.24% (0.0416 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.23% (0.0427 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.23% (0.0429 => 0.0428, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.48% (0.0418 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0419 => 0.0419, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.24% (0.0410 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0411 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0408 => 0.0408) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.24% (0.0410 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.22% (0.0446 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.22% (0.0448 => 0.0447) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0408 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0409 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.73% (0.0410 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0410 => 0.0410) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.24% (0.0417 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.24% (0.0418 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.40% (1.2887 => 1.2836, std.dev.: 0.0067) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.09% (7.8757 => 7.8690, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.03% (0.7434 => 0.7432, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.85% (0.0354 => 0.0357, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1465 => 0.1466, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.30% (0.0659 => 0.0657, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.81% (63.2438 => 55.7737, std.dev.: 0.0575) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 33.81% (14.1553 => 18.9417, std.dev.: 0.0281) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.62% (3.4629 => 5.6659, std.dev.: 0.0065) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14562.36% (0.0720 => 10.5569, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952500.00% (0.0001 => 9.9526, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.63% (0.2554 => 0.4179, std.dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: 47.91% (10.3673 => 15.3340, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/richards_benchmark: 39.95% (0.1622 => 0.2270, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/distray/distray: 34.28% (0.1056 => 0.1418, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 25.24% (1.7609 => 2.2054, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.87% (7.0540 => 8.4559, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/flops: 18.51% (0.1432 => 0.1697) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.64% (2.2022 => 2.5907, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 15.28% (0.0746 => 0.0860, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.70% (0.0871 => 0.0999, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.05% (0.1566 => 0.1786, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.83% (0.0834 => 0.0941, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.76% (0.6675 => 0.7527, std.dev.: 0.0039) MultiSource/Applications/JM/ldecod/ldecod: 12.14% (10.4361 => 11.7034, std.dev.: 0.0171) SingleSource/Benchmarks/Misc/oourafft: 12.04% (0.3282 => 0.3677, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 11.81% (0.1440 => 0.1610, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.68% (0.3177 => 0.3548, std.dev.: 0.0049) MultiSource/Applications/oggenc/oggenc: 11.63% (5.7591 => 6.4286, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.46% (0.4879 => 0.5438, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.44% (0.5105 => 0.5689, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 11.00% (0.1655 => 0.1837, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.89% (0.3543 => 0.3929, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.72% (0.5020 => 0.5558, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 10.57% (0.7433 => 0.8219, std.dev.: 0.0033) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.42% (0.1584 => 0.1749, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 10.40% (0.3423 => 0.3779, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 10.36% (3.3354 => 3.6808, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/trivial-interface: 10.25% (0.3473 => 0.3829, std.dev.: 0.0025) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.24% (0.1143 => 0.1260, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/parameter-passing: 10.21% (0.3927 => 0.4328, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.19% (0.2700 => 0.2975, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.13% (1.5415 => 1.6977, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-2: 10.09% (0.3497 => 0.3850, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 10.09% (0.7115 => 0.7833, std.dev.: 0.0071) SingleSource/UnitTests/ObjC/synchronized: 10.08% (0.3561 => 0.3920, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-3: 10.07% (0.3516 => 0.3870, std.dev.: 0.0066) SingleSource/UnitTests/ObjC/exceptions-4: 10.05% (0.3543 => 0.3899, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/tsp/tsp: 10.04% (0.1175 => 0.1293, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.04% (0.2271 => 0.2499, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions: 9.98% (0.3828 => 0.4210, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.97% (0.1625 => 0.1787, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/property: 9.91% (0.3886 => 0.4271, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/for-in: 9.72% (0.3694 => 0.4053, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.65% (0.3307 => 0.3626, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 9.64% (0.1151 => 0.1262, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.63% (0.1236 => 0.1355, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.47% (0.6450 => 0.7061, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.34% (8.1363 => 8.8966, std.dev.: 0.0089) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.27% (0.1510 => 0.1650, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.25% (0.2107 => 0.2302, std.dev.: 0.0041) MultiSource/Applications/lua/lua: 9.19% (3.8723 => 4.2280, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.15% (0.8067 => 0.8805, std.dev.: 0.0056) MultiSource/Applications/Burg/burg: 9.09% (1.1642 => 1.2700, std.dev.: 0.0081) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.90% (0.1438 => 0.1566, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 8.87% (0.1555 => 0.1693, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/em3d/em3d: 8.85% (0.1695 => 0.1845, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.85% (0.2758 => 0.3002, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.78% (0.5569 => 0.6058, std.dev.: 0.0028) MultiSource/Applications/hbd/hbd: 8.75% (1.5603 => 1.6968, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.71% (4.2646 => 4.6359, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.70% (0.5860 => 0.6370, std.dev.: 0.0026) MultiSource/Applications/lemon/lemon: 8.59% (1.0722 => 1.1643, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.57% (0.2065 => 0.2242, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.55% (0.8172 => 0.8871, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.53% (0.2603 => 0.2825, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.45% (0.1940 => 0.2104, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 8.44% (0.6456 => 0.7001, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 8.39% (0.5925 => 0.6422, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.35% (0.9765 => 1.0580, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/property-reference-object: 8.28% (0.6030 => 0.6529, std.dev.: 0.0037) SingleSource/UnitTests/ObjC++/property-reference: 8.23% (0.7326 => 0.7929, std.dev.: 0.0154) MultiSource/Applications/JM/lencod/lencod: 8.19% (21.9371 => 23.7340, std.dev.: 0.0158) MultiSource/Applications/treecc/treecc: 8.18% (2.0273 => 2.1931, std.dev.: 0.0035) SingleSource/Benchmarks/Stanford/Puzzle: 8.12% (0.1268 => 0.1371, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.12% (1.3050 => 1.4110, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 8.12% (9.4845 => 10.2542, std.dev.: 0.0125) MultiSource/Benchmarks/sim/sim: 8.00% (0.3387 => 0.3658, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.95% (0.4615 => 0.4982, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 7.89% (0.3180 => 0.3431, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 7.89% (0.7835 => 0.8453, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.88% (0.3441 => 0.3712, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 7.86% (2.2969 => 2.4774, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/football/football: 7.80% (0.8921 => 0.9617, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 7.74% (0.1330 => 0.1433, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.48% (0.4103 => 0.4410, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.46% (7.9617 => 8.5553, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/hash: 7.44% (0.4289 => 0.4608, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.43% (0.1695 => 0.1821, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.43% (0.3121 => 0.3353, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.38% (0.4203 => 0.4513, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.37% (0.3865 => 0.4150, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.34% (0.5981 => 0.6420, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.32% (0.3826 => 0.4106, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 7.27% (1.1840 => 1.2701, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/lists: 7.25% (0.3422 => 0.3670, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.16% (0.4636 => 0.4968, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.11% (0.2266 => 0.2427, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.03% (0.4620 => 0.4945, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.97% (1.1861 => 1.2688, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/moments: 6.97% (0.4048 => 0.4330, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.88% (0.3650 => 0.3901, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 6.57% (0.3684 => 0.3926, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.54% (0.2891 => 0.3080, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.52% (0.3603 => 0.3838, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.51% (0.1906 => 0.2030, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.47% (0.3136 => 0.3339, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.42% (1.4186 => 1.5097, std.dev.: 0.0065) SingleSource/Regression/C++/ofstream_ctor: 6.33% (0.2905 => 0.3089, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.29% (0.3162 => 0.3361, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.25% (5.0018 => 5.3143, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.20% (0.2756 => 0.2927, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.20% (0.8101 => 0.8603, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.19% (4.9449 => 5.2508, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.14% (2.0665 => 2.1934, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 6.11% (0.2831 => 0.3004, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.98% (0.2725 => 0.2888, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 5.91% (0.2877 => 0.3047, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.90% (1.5859 => 1.6795, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.90% (0.3052 => 0.3232, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 5.89% (0.2871 => 0.3040, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.88% (0.3232 => 0.3422, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.79% (0.3283 => 0.3473, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.78% (0.2872 => 0.3038, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.71% (0.2714 => 0.2869, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.69% (0.2793 => 0.2952, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.68% (2.2024 => 2.3274, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.65% (0.3379 => 0.3570, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 5.64% (0.2802 => 0.2960, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 5.61% (0.2049 => 0.2164, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 5.49% (0.3098 => 0.3268, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.45% (14.3668 => 15.1499, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/objinst: 5.11% (0.3131 => 0.3291, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.99% (0.3427 => 0.3598, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 4.91% (17.1811 => 18.0249, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.90% (0.2430 => 0.2549, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 4.63% (1.2842 => 1.3437, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.40% (1.1194 => 1.1575, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 3.25% (0.3109 => 0.3210, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.20% (3.8922 => 4.0166, std.dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 26.13% (1.1145 => 1.4057, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 18.49% (0.9957 => 1.1798, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 14.56% (3.1595 => 3.6196, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 12.40% (0.4808 => 0.5404, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.61% (3.6395 => 4.0619, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.80% (2.8904 => 3.2026, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: 9.81% (3.3453 => 3.6734, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.80% (1.1396 => 1.2513, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/Puzzle: 8.02% (0.1421 => 0.1535) SingleSource/Benchmarks/Shootout-C++/hash2: 6.83% (3.1578 => 3.3734, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 5.25% (6.5088 => 6.8504, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 4.59% (27.8444 => 29.1236, std.dev.: 0.0021) MultiSource/Benchmarks/BitBench/drop3/drop3: 4.30% (0.4162 => 0.4341, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 4.07% (9.1159 => 9.4870, std.dev.: 0.0076) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.04% (4.3882 => 4.5657, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 3.76% (11.6436 => 12.0811, std.dev.: 0.1160) MultiSource/Applications/spiff/spiff: 3.46% (2.9346 => 3.0361, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: 2.95% (85.0658 => 87.5751, std.dev.: 0.0068) SingleSource/Benchmarks/McGill/queens: 2.94% (2.1825 => 2.2466, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.83% (13.4384 => 13.8186, std.dev.: 0.0326) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.80% (0.9540 => 0.9807, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.71% (4.2280 => 4.3424, std.dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.35% (8.1563 => 8.3476, std.dev.: 0.0221) SingleSource/Regression/C/uint64_to_float: 2.29% (0.5413 => 0.5537, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.26% (1.7254 => 1.7644, std.dev.: 0.0025) MultiSource/Applications/lemon/lemon: 1.97% (1.4460 => 1.4745, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/oourafft: 1.48% (6.6465 => 6.7449, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.42% (2.6546 => 2.6922, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.03% (6.6874 => 0.1316, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: -79.93% (0.8651 => 0.1736, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.85% (5.2763 => 3.2790, std.dev.: 0.0162) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.68% (5.3855 => 3.7330, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.27% (5.3526 => 3.7325, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -14.53% (54.1659 => 46.2968, std.dev.: 0.0182) MultiSource/Applications/ClamAV/clamscan: -11.96% (22.1758 => 19.5227, std.dev.: 0.0443) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -9.89% (2.9384 => 2.6478, std.dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -44.25% (0.0400 => 0.0223) SingleSource/Benchmarks/Misc/mandel: -33.50% (1.1492 => 0.7642, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/puzzle: -25.34% (0.6962 => 0.5198, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -24.25% (1.2373 => 0.9373, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-6: -16.66% (1.6925 => 1.4105, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.43% (0.0998 => 0.0864, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -11.01% (1.5373 => 1.3680) MultiSource/Benchmarks/FreeBench/mason/mason: -10.09% (0.2161 => 0.1943, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: -6.93% (1.5835 => 1.4738, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.88% (4.8142 => 4.4829, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -6.26% (5.0483 => 4.7323, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -6.23% (1.2870 => 1.2068, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.86% (0.3463 => 0.3260, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.18% (1.6805 => 1.5934, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.86% (1.8329 => 1.7438, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.82% (0.8614 => 0.8199, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -4.31% (2.5528 => 2.4429, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: -4.24% (19.9488 => 19.1023, std.dev.: 0.0667) MultiSource/Applications/siod/siod: -3.77% (3.2827 => 3.1588, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.75% (2.2771 => 2.1918, std.dev.: 0.0036) MultiSource/Applications/lua/lua: -3.73% (26.0924 => 25.1193, std.dev.: 0.0102) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.04% (2.7294 => 2.6737, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.00% (8.6802 => 8.5070, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.73% (1.3677 => 1.3440, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6821, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.56% (1.5660 => 1.5415, std.dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4168, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -1.53% (1.1277 => 1.1104, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -1.24% (1.8525 => 1.8295, std.dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.2636 => 5.2016, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/hash: -1.10% (4.9088 => 4.8546, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.43% (0.5229 => 0.5931, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 9.26% (14.9895 => 16.3780, std.dev.: 0.0241) MultiSource/Benchmarks/MallocBench/gs/gs: 7.63% (4.1105 => 4.4240, std.dev.: 0.0098) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 16.18% (1.1048 => 1.2836, std.dev.: 0.0067) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.93% (7.1582 => 7.8690, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.45% (0.6222 => 0.7432, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35600.00% (0.0001 => 0.0357, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -1.28% (0.1485 => 0.1466, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.95% (0.2116 => 0.0657, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 11 02:38:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 11 Oct 2012 04:38:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121011093841.D89FF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4788?compare_to=4786&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4788, Order: 165708, Start Time: 2012-10-11 08:13:50, End Time: 2012-10-11 09:40:31 To: 4786, Order: 165701, Start Time: 2012-10-11 06:14:33, End Time: 2012-10-11 07:44:04 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (194 on baseline) Performance Improvements: 2 (34 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1038 (676 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.56% (81.5211 => 83.6069, std.dev.: 0.3618) SingleSource/Benchmarks/McGill/chomp: 1.42% (0.9299 => 0.9431, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.75% (0.6454 => 0.6341, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.11% (1.2146 => 1.2011, std.dev.: 0.0016) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 43.48% (0.8818 => 1.2652, std.dev.: 0.0114) MultiSource/Benchmarks/PAQ8p/paq8p: 23.33% (2.0176 => 2.4884, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: 17.43% (0.0826 => 0.0970, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.67% (0.1410 => 0.1645, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 16.58% (0.2243 => 0.2615, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 15.93% (0.0653 => 0.0757, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.63% (0.0834 => 0.0956, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.32% (0.1327 => 0.1517, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 14.12% (0.6283 => 0.7170, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.90% (0.1072 => 0.1221, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 13.43% (0.1013 => 0.1149, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.29% (0.1588 => 0.1799, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.16% (0.1413 => 0.1599, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.07% (1.1364 => 1.2849, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.97% (0.0964 => 0.1089, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 12.73% (0.7038 => 0.7934, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.64% (0.2721 => 0.3065, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 12.52% (1.3693 => 1.5408, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.46% (0.4791 => 0.5388, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.21% (0.2596 => 0.2913, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.99% (1.4563 => 1.6309, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 11.96% (0.1062 => 0.1189, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 11.83% (0.4328 => 0.4840, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.68% (0.6959 => 0.7772, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.59% (3.9660 => 4.4256, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.59% (0.5265 => 0.5875, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.54% (0.7710 => 0.8600, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 11.45% (3.6692 => 4.0894, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/hash: 11.45% (0.4062 => 0.4527, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.44% (0.9199 => 1.0251, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.41% (0.1157 => 0.1289, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 11.27% (0.1003 => 0.1116, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 11.19% (1.0313 => 1.1467, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.18% (0.3130 => 0.3480, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.08% (0.3899 => 0.4331, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 11.03% (13.8202 => 15.3451, std.dev.: 0.0164) SingleSource/Benchmarks/McGill/chomp: 10.95% (0.1589 => 0.1763, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.87% (0.3580 => 0.3969, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.82% (0.3022 => 0.3349, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.75% (0.7460 => 0.8262, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 10.72% (1.1061 => 1.2247, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.53% (0.2127 => 0.2351, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 10.49% (0.3192 => 0.3527, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 10.43% (0.3220 => 0.3556, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 10.38% (0.5818 => 0.6422, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.36% (0.3485 => 0.3846, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Puzzle: 10.34% (0.0977 => 0.1078, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.33% (0.4016 => 0.4431, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.30% (0.6135 => 0.6767, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.26% (1.2193 => 1.3444, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 10.24% (0.8310 => 0.9161, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.22% (0.3756 => 0.4140, std.dev.: 0.0039) MultiSource/Applications/kimwitu++/kc: 10.22% (16.6129 => 18.3101, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.14% (0.1075 => 0.1184, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.08% (0.8698 => 0.9575, std.dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.07% (0.3246 => 0.3573, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 10.07% (0.2781 => 0.3061, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 10.06% (3.1889 => 3.5097, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.05% (0.2966 => 0.3264, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.02% (0.5577 => 0.6136, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: 10.02% (0.5748 => 0.6324, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.99% (0.5637 => 0.6200, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 9.96% (0.3293 => 0.3621, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.95% (0.3489 => 0.3836, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 9.89% (1.0594 => 1.1642, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 9.84% (0.7061 => 0.7756, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.84% (0.4390 => 0.4822, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 9.82% (0.3868 => 0.4248, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.82% (0.1569 => 0.1723, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.78% (0.2782 => 0.3054, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.74% (0.2023 => 0.2220, std.dev.: 0.0026) MultiSource/Applications/siod/siod: 9.73% (2.1791 => 2.3911, std.dev.: 0.0046) MultiSource/Applications/treecc/treecc: 9.63% (1.9270 => 2.1126, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/mst/mst: 9.63% (0.1111 => 0.1218, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.61% (0.4805 => 0.5267, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 9.61% (0.3453 => 0.3785, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.60% (1.9828 => 2.1731, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 9.55% (4.6629 => 5.1081, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/strcat: 9.50% (0.2726 => 0.2985, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 9.49% (0.3107 => 0.3402, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 9.46% (3.8646 => 4.2300, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/methcall: 9.45% (0.2761 => 0.3022, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.42% (7.2180 => 7.8977, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.38% (0.2655 => 0.2904, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 9.36% (0.2607 => 0.2851, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 9.33% (0.2690 => 0.2941, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.32% (0.6576 => 0.7189, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 9.31% (0.2760 => 0.3017, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 9.28% (0.3534 => 0.3862, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 9.26% (0.2925 => 0.3196, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 9.25% (0.2628 => 0.2871, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 9.24% (0.6744 => 0.7367, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.21% (0.1986 => 0.2169, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 9.20% (0.1478 => 0.1614, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.20% (0.3511 => 0.3834, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.17% (0.1865 => 0.2036, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.15% (0.2765 => 0.3018, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 9.15% (0.3149 => 0.3437, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 9.09% (0.2937 => 0.3204, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.03% (0.2914 => 0.3177, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.86% (0.1276 => 0.1389, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.85% (4.9865 => 5.4277, std.dev.: 0.0117) MultiSource/Applications/spiff/spiff: 8.85% (0.7506 => 0.8170, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.79% (0.2696 => 0.2933, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 8.76% (6.5754 => 7.1513, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/objinst: 8.49% (0.2945 => 0.3195, std.dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 8.45% (14.8535 => 16.1083, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/matrix: 8.33% (0.2988 => 0.3237, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.28% (0.3755 => 0.4066, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.27% (1.3245 => 1.4341, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.27% (0.1789 => 0.1937, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.24% (0.4379 => 0.4740, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.15% (0.2504 => 0.2708, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.13% (0.2140 => 0.2314, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.10% (0.3245 => 0.3508, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 8.03% (0.1657 => 0.1790, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 7.76% (0.3131 => 0.3374, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.75% (3.2742 => 3.5278, std.dev.: 0.0129) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.67% (0.1435 => 0.1545, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.58% (0.2321 => 0.2497, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 7.55% (0.6250 => 0.6722, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 7.50% (3.7467 => 4.0278, std.dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 6.86% (1.2292 => 1.3135, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.62% (1.1333 => 1.2083, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.55% (13.2842 => 14.1543, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.50% (0.9108 => 0.9700, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 6.40% (0.4003 => 0.4259, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 6.03% (0.3914 => 0.4150, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 5.99% (0.3940 => 0.4176, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 5.90% (1.2749 => 1.3501, std.dev.: 0.0165) SingleSource/UnitTests/ObjC/for-in: 5.83% (0.3789 => 0.4010, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.80% (1.5188 => 1.6069, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 5.79% (0.3663 => 0.3875, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 5.79% (0.3578 => 0.3785, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 5.65% (0.3646 => 0.3852, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.61% (2.1007 => 2.2185, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 5.58% (8.4961 => 8.9701, std.dev.: 0.0110) SingleSource/UnitTests/ObjC/exceptions-3: 5.58% (0.3623 => 0.3825, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.56% (0.3650 => 0.3853, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-2: 5.55% (0.3601 => 0.3801, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.26% (0.2243 => 0.2361, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.24% (6.2785 => 6.6078, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.16% (4.3801 => 4.6059, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.13% (4.4433 => 4.6712, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 4.81% (16.2614 => 17.0437, std.dev.: 0.0082) MultiSource/Applications/ClamAV/clamscan: 4.49% (14.5298 => 15.1817, std.dev.: 0.0066) MultiSource/Benchmarks/Bullet/bullet: 1.94% (33.2944 => 33.9419, std.dev.: 0.0106) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5175, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 26.56% (1.0895 => 1.3789, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 20.37% (1.8175 => 2.1877, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 18.04% (0.9996 => 1.1799, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 11.17% (1.1560 => 1.2851, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 10.54% (0.4867 => 0.5380, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.51% (3.6469 => 4.0302, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 9.92% (2.8813 => 3.1670, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 8.62% (0.8273 => 0.8986, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 8.13% (3.1736 => 3.4316, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/fp-convert: 7.99% (3.4016 => 3.6734, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-4: 7.53% (1.0640 => 1.1441, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/puzzle: 7.30% (0.4846 => 0.5200, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.29% (1.7081 => 1.8327, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.09% (11.2619 => 11.9473, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.25% (7.9275 => 8.3439, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel-2: 5.24% (1.2998 => 1.3679, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 5.11% (1.9199 => 2.0181, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9999, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.40% (0.2389 => 0.2494, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.33% (2.5629 => 2.6738, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 3.98% (1.9144 => 1.9906, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 3.78% (1.4298 => 1.4838, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: 3.58% (7.4271 => 7.6932, std.dev.: 0.0061) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.47% (4.4062 => 4.5592, std.dev.: 0.0102) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.41% (13.3668 => 13.8232, std.dev.: 0.0238) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 3.28% (6.6320 => 6.8497, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: 3.27% (2.1753 => 2.2465, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.14% (12.0921 => 12.4719, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.99% (1.9863 => 2.0457) MultiSource/Benchmarks/mafft/pairlocalalign: 2.72% (28.2225 => 28.9899, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 2.49% (3.8177 => 3.9127, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 2.42% (31.4682 => 32.2293, std.dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.20% (0.9692 => 0.9905) MultiSource/Applications/SPASS/SPASS: 2.10% (10.7476 => 10.9735, std.dev.: 0.0504) MultiSource/Applications/JM/lencod/lencod: 2.10% (7.6086 => 7.7684, std.dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: 2.00% (84.4286 => 86.1199, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/oourafft: 1.83% (5.5130 => 5.6140, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.53% (2.0200 => 2.0509, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5093, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1853, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 1.13% (12.4560 => 12.5973, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0268, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (3.1071 => 3.1398, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.97% (0.2670 => 0.1416, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -17.07% (0.4657 => 0.3862, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -14.43% (0.0707 => 0.0605, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.08% (1.3819 => 1.2011, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.05% (1.3813 => 1.2011, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.07% (22.5627 => 22.3223, std.dev.: 0.0174) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) SingleSource/Benchmarks/McGill/chomp: -23.38% (1.2308 => 0.9431, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -21.48% (1.0460 => 0.8213, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.64% (0.0997 => 0.0861, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.11% (0.2238 => 0.1967, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -7.81% (2.6470 => 2.4403, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -6.23% (1.2870 => 1.2068, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -6.20% (26.5159 => 24.8717, std.dev.: 0.0129) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.01% (1.3780 => 1.2952, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -5.80% (20.3410 => 19.1610, std.dev.: 0.0749) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.75% (0.3458 => 0.3259, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -5.41% (5.0168 => 4.7453, std.dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.77% (3.2729 => 3.1495, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/bh/bh: -2.70% (1.9762 => 1.9228, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4833, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Applications/aha/aha: -2.18% (3.1476 => 3.0789, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.15% (6.3560 => 6.2196, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.94% (0.6589 => 0.6461, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.61% (1.4326 => 1.4095, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8626, std.dev.: 0.0183) SingleSource/Benchmarks/Misc/ReedSolomon: -1.14% (7.1097 => 7.0290, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2569, std.dev.: 0.0005) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 11 03:25:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 11 Oct 2012 05:25:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121011102522.705642A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4789?compare_to=4784&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4789, Order: 165705, Start Time: 2012-10-11 07:17:25, End Time: 2012-10-11 10:27:12 To: 4784, Order: 165693, Start Time: 2012-10-11 03:57:32, End Time: 2012-10-11 06:41:32 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (137 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 72 (134 on baseline) Unchanged Tests: 967 (754 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.86% (2.4783 => 2.5243, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.00% (120.6308 => 127.8731, std.dev.: 1.1301) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.15% (54.1955 => 54.8184, std.dev.: 0.0581) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.51% (0.1063 => 0.1196, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.78% (0.3496 => 0.3908, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 11.77% (0.3465 => 0.3873, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.65% (0.3469 => 0.3873, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.56% (0.3442 => 0.3840, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.55% (0.3488 => 0.3891, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 11.55% (0.3446 => 0.3844, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.50% (0.3460 => 0.3858, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 11.45% (1.5932 => 1.7757, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/property: 11.32% (0.3650 => 0.4063, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 11.20% (0.3643 => 0.4051, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 11.04% (0.3724 => 0.4135, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/Hello: 9.49% (0.5826 => 0.6379, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.36% (0.5889 => 0.6440, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 9.11% (0.1218 => 0.1329, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.93% (0.4994 => 0.5440, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 8.77% (0.1619 => 0.1761, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.46% (0.4361 => 0.4730, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.18% (1.6211 => 1.7537, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.10% (0.2875 => 0.3108, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.10% (1.3152 => 1.4217, std.dev.: 0.0026) SingleSource/Regression/C++/ofstream_ctor: 8.09% (0.3004 => 0.3247, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference: 8.05% (0.7171 => 0.7748, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.96% (0.5000 => 0.5398, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.89% (0.3195 => 0.3447, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 7.88% (0.2780 => 0.2999, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 7.79% (5.5417 => 5.9733, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/fibo: 7.78% (0.2725 => 0.2937, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.77% (0.2792 => 0.3009, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.74% (3.5627 => 3.8384, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.72% (0.1620 => 0.1745, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 7.70% (0.2714 => 0.2923, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 7.68% (1.0781 => 1.1609, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/18-imp/imp: 7.67% (0.1421 => 0.1530, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.67% (0.2738 => 0.2948, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.62% (0.5026 => 0.5409, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 7.62% (0.2823 => 0.3038, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 7.61% (0.2811 => 0.3025, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.59% (0.2729 => 0.2936, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 7.56% (0.2750 => 0.2958, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 7.56% (0.2566 => 0.2760, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.56% (0.3362 => 0.3616, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.55% (0.2014 => 0.2166, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 7.53% (0.2803 => 0.3014, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.48% (0.9909 => 1.0650, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.47% (2.0673 => 2.2218, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.45% (0.2911 => 0.3128, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 7.45% (0.4847 => 0.5208, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.42% (2.7292 => 2.9316, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wc: 7.36% (0.3096 => 0.3324, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.36% (0.2813 => 0.3020, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.33% (0.3124 => 0.3353, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 7.31% (0.3258 => 0.3496, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.29% (0.3060 => 0.3283, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.27% (0.2736 => 0.2935, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary3: 7.22% (0.3267 => 0.3503, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.20% (0.3930 => 0.4213, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sieve: 7.19% (0.3726 => 0.3994, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 7.18% (0.3317 => 0.3555, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.17% (0.3625 => 0.3885, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 7.16% (4.2109 => 4.5124, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.13% (0.4139 => 0.4434, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 7.11% (0.3348 => 0.3586, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 7.09% (0.4146 => 0.4440, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.05% (4.4195 => 4.7311, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/09-vor/vor: 7.04% (0.1505 => 0.1611, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.02% (0.3903 => 0.4177, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/moments: 7.01% (0.3678 => 0.3936, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.98% (0.2866 => 0.3066, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.95% (0.3282 => 0.3510, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 6.93% (0.3477 => 0.3718, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.91% (0.1549 => 0.1656, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.88% (0.5900 => 0.6306, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.84% (0.1462 => 0.1562, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.83% (0.3690 => 0.3942, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.79% (0.3890 => 0.4154, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 6.77% (0.4251 => 0.4539, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.76% (0.3981 => 0.4250, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 6.69% (2.1013 => 2.2418, std.dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: 6.65% (23.5202 => 25.0845, std.dev.: 0.0184) MultiSource/Benchmarks/MallocBench/gs/gs: 6.64% (1.8794 => 2.0042, std.dev.: 0.0095) MultiSource/Applications/siod/siod: 6.59% (0.6634 => 0.7071, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.55% (0.1968 => 0.2097, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 6.50% (0.4029 => 0.4291, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.50% (0.3845 => 0.4095, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.50% (0.2969 => 0.3162, std.dev.: 0.0014) MultiSource/Applications/lua/lua: 6.44% (1.4269 => 1.5188, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.39% (0.6435 => 0.6846, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 6.34% (0.5012 => 0.5330, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.33% (0.3271 => 0.3478, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.32% (0.2040 => 0.2169, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 6.31% (4.6177 => 4.9090, std.dev.: 0.0065) MultiSource/Applications/Burg/burg: 6.26% (0.5546 => 0.5893, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.25% (0.4658 => 0.4949, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.24% (0.2068 => 0.2197, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 6.18% (2.1653 => 2.2992, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.16% (0.3084 => 0.3274, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 6.07% (0.2075 => 0.2201, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.03% (0.2737 => 0.2902, std.dev.: 0.0046) MultiSource/Applications/hbd/hbd: 5.99% (0.9697 => 1.0278, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 5.85% (0.3336 => 0.3531, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: 5.82% (2.0346 => 2.1530, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.75% (0.2103 => 0.2224, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.75% (1.9694 => 2.0826, std.dev.: 0.0035) MultiSource/Applications/treecc/treecc: 5.70% (0.7875 => 0.8324, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.58% (1.9966 => 2.1080, std.dev.: 0.0087) MultiSource/Applications/lemon/lemon: 5.40% (0.2391 => 0.2520, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.31% (0.7426 => 0.7820, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.27% (0.4253 => 0.4477, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.24% (0.5361 => 0.5642, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 5.24% (0.2691 => 0.2832, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.58% (0.5584 => 0.5840, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 4.35% (0.3498 => 0.3650, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.25% (11.6398 => 12.1347, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.00% (4.6926 => 4.8804, std.dev.: 0.0024) MultiSource/Applications/kimwitu++/kc: 2.90% (11.9555 => 12.3028, std.dev.: 0.0059) SingleSource/UnitTests/Vector/constpool: 1.93% (2.4764 => 2.5243, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6095, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6719, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-2: 4.80% (1.8057 => 1.8924, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1674, std.dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/dry: 4.18% (14.0481 => 14.6347, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1941, std.dev.: 0.0086) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5082, std.dev.: 0.0088) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.66% (3.1722 => 3.2248, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2879, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5134, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5848, std.dev.: 0.0212) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std.dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.73% (25.4195 => 16.5904, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: -10.49% (0.2402 => 0.2150, std.dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9741, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7896, std.dev.: 0.0074) MultiSource/Benchmarks/Olden/tsp/tsp: -7.31% (2.1113 => 1.9569, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: -3.72% (3.3665 => 3.2414, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.58% (11.2080 => 10.8071, std.dev.: 0.0187) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7738, std.dev.: 0.0034) SingleSource/Benchmarks/Dhrystone/fldry: -2.98% (17.2379 => 16.7242, std.dev.: 0.1159) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8657, std.dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5773, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.70% (0.6293 => 0.6186, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4970, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.20% (105.3826 => 104.1216, std.dev.: 0.0681) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0443, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 11 04:16:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 11 Oct 2012 06:16:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121011111601.B90252A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4790?compare_to=4787&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4790, Order: 165709, Start Time: 2012-10-11 09:57:26, End Time: 2012-10-11 11:17:51 To: 4787, Order: 165707, Start Time: 2012-10-11 08:07:33, End Time: 2012-10-11 09:28:15 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (164 on baseline) Performance Improvements: 4 (44 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 948 (679 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.85% (82.0243 => 83.5418, std.dev.: 0.3321) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.52% (15.3340 => 14.9476, std.dev.: 0.0078) SingleSource/UnitTests/ObjC++/property-reference: -1.59% (0.7929 => 0.7803, std.dev.: 0.0037) MultiSource/Applications/JM/lencod/lencod: -1.40% (23.7340 => 23.4009, std.dev.: 0.0100) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.26% (2.5907 => 2.5580, std.dev.: 0.0125) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -1.05% (0.5931 => 0.5869, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -0.61% (16.3780 => 16.2786, std.dev.: 0.0045) MultiSource/Benchmarks/Bullet/bullet: -0.53% (55.7737 => 55.4801, std.dev.: 0.0151) MultiSource/Benchmarks/MallocBench/gs/gs: -0.44% (4.4240 => 4.4045, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0463 => 0.0463, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.22% (0.0465 => 0.0464, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.23% (0.0433 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0434 => 0.0434) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.24% (0.0421 => 0.0422, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0424 => 0.0424) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.24% (0.0416 => 0.0415, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.48% (0.0419 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0434 => 0.0434) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.23% (0.0436 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0428 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.23% (0.0430 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.24% (0.0419 => 0.0418) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0420 => 0.0420) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.47% (0.0426 => 0.0424, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0427 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.68% (0.0438 => 0.0435, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.23% (0.0439 => 0.0438) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.24% (0.0414 => 0.0413) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.24% (0.0415 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0426 => 0.0426) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.23% (0.0428 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0416 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.24% (0.0419 => 0.0418, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0409 => 0.0409) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.49% (0.0411 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.49% (0.0408 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.24% (0.0409 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.22% (0.0445 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.67% (0.0447 => 0.0444, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.25% (0.0408 => 0.0407, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.49% (0.0409 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0407 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.49% (0.0410 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.24% (0.0416 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.48% (1.2836 => 1.2774, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.24% (7.8690 => 7.8505, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.51% (0.7432 => 0.7394, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.84% (0.0357 => 0.0354, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: - (0.1466 => 0.1466, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0657 => 0.0656, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.28% (63.2438 => 55.4801, std.dev.: 0.0151) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 33.09% (14.1553 => 18.8390, std.dev.: 0.0231) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.44% (3.4629 => 5.6599, std.dev.: 0.0107) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14563.47% (0.0720 => 10.5577, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952200.00% (0.0001 => 9.9523, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.16% (0.2554 => 0.4167, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 44.18% (10.3673 => 14.9476, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/richards_benchmark: 38.53% (0.1622 => 0.2247, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 33.90% (0.1056 => 0.1414, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 24.58% (1.7609 => 2.1937, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.41% (7.0540 => 8.4230, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops: 18.30% (0.1432 => 0.1694, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.16% (2.2022 => 2.5580, std.dev.: 0.0125) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.88% (0.0746 => 0.0857, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.24% (0.0871 => 0.0995, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.79% (0.1566 => 0.1782, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.30% (0.6675 => 0.7496, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 11.60% (0.1440 => 0.1607, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 11.53% (10.4361 => 11.6398, std.dev.: 0.0182) SingleSource/Benchmarks/Misc/oourafft: 11.27% (0.3282 => 0.3652, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.01% (0.5105 => 0.5667, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.70% (0.4879 => 0.5401, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 10.60% (5.7591 => 6.3698, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: 10.57% (0.1655 => 0.1830, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.46% (0.5020 => 0.5545, std.dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 10.06% (0.7433 => 0.8181, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.85% (0.3177 => 0.3490, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 9.73% (0.3423 => 0.3756, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 9.71% (3.3354 => 3.6594, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 9.62% (0.1175 => 0.1288, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.59% (0.2700 => 0.2959, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.57% (1.5415 => 1.6890, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.54% (0.1625 => 0.1780, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: 9.47% (0.7115 => 0.7789, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.41% (0.1584 => 0.1733, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.29% (0.2271 => 0.2482, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.22% (0.3307 => 0.3612, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 9.10% (0.3473 => 0.3789, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/parameter-passing: 9.09% (0.3927 => 0.4284, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.06% (0.3543 => 0.3864, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.02% (0.6450 => 0.7032, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.98% (0.1236 => 0.1347, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 8.86% (0.1151 => 0.1253, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.85% (0.3516 => 0.3827, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 8.83% (0.3543 => 0.3856, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 8.82% (0.3561 => 0.3875, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.78% (0.3497 => 0.3804, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 8.75% (0.3828 => 0.4163, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.73% (0.2107 => 0.2291, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 8.62% (0.3886 => 0.4221, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.61% (0.1510 => 0.1640, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.61% (0.3694 => 0.4012, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 8.60% (1.1642 => 1.2643, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.59% (8.1363 => 8.8350, std.dev.: 0.0087) MultiSource/Applications/lua/lua: 8.55% (3.8723 => 4.2032, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.53% (0.8067 => 0.8755, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.48% (0.2758 => 0.2992, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.46% (0.5569 => 0.6040, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.36% (0.5860 => 0.6350, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 8.26% (0.1695 => 0.1835, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.17% (0.8172 => 0.8840, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 8.09% (0.6456 => 0.6978, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.07% (4.2646 => 4.6088, std.dev.: 0.0053) MultiSource/Applications/lemon/lemon: 8.07% (1.0722 => 1.1587, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.03% (0.2603 => 0.2812, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.00% (0.1438 => 0.1553, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.94% (0.9765 => 1.0540, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 7.91% (0.1555 => 0.1678, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.87% (1.5603 => 1.6831, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.84% (0.1940 => 0.2092, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.80% (0.2065 => 0.2226, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.75% (1.3050 => 1.4062, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 7.71% (2.0273 => 2.1837, std.dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 7.58% (9.4845 => 10.2033, std.dev.: 0.0182) MultiSource/Benchmarks/sim/sim: 7.47% (0.3387 => 0.3640, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.45% (0.4203 => 0.4516, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 7.44% (2.2969 => 2.4679, std.dev.: 0.0023) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.39% (7.9617 => 8.5500, std.dev.: 0.0129) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.37% (0.4615 => 0.4955, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 7.36% (0.7835 => 0.8412, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/football/football: 7.34% (0.8921 => 0.9576, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.27% (0.3441 => 0.3691, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.26% (0.4103 => 0.4401, std.dev.: 0.0055) SingleSource/UnitTests/ObjC++/Hello: 7.22% (0.5925 => 0.6353, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 7.14% (0.3180 => 0.3407, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.11% (0.3826 => 0.4098, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 7.05% (0.6030 => 0.6455, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash: 7.02% (0.4289 => 0.4590, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 6.98% (0.3422 => 0.3661, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.92% (0.3121 => 0.3337, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.91% (0.3865 => 0.4132, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.91% (0.5981 => 0.6394, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.90% (0.1695 => 0.1812, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 6.74% (1.1840 => 1.2638, std.dev.: 0.0052) MultiSource/Applications/JM/lencod/lencod: 6.67% (21.9371 => 23.4009, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (0.4620 => 0.4927, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 6.63% (0.3603 => 0.3842, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.62% (0.4636 => 0.4943, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 6.62% (0.4048 => 0.4316, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.53% (1.1861 => 1.2636, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.53% (0.2266 => 0.2414, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.52% (0.3650 => 0.3888, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 6.51% (0.7326 => 0.7803, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.26% (0.8101 => 0.8608, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.25% (0.3136 => 0.3332, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.05% (0.2891 => 0.3066, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.03% (0.1906 => 0.2021, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 6.03% (0.3684 => 0.3906, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.99% (0.2872 => 0.3044, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.88% (0.3162 => 0.3348, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.78% (1.4186 => 1.5006, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.75% (2.0665 => 2.1854, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 5.69% (0.2831 => 0.2992, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.68% (0.2871 => 0.3034, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 5.63% (0.2877 => 0.3039, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.57% (0.3232 => 0.3412, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.52% (0.2756 => 0.2908, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.50% (0.2725 => 0.2875, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.50% (4.9449 => 5.2169, std.dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.49% (1.5859 => 1.6729, std.dev.: 0.0177) SingleSource/Benchmarks/Shootout-C++/wc: 5.47% (0.3052 => 0.3219, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.44% (5.0018 => 5.2740, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.33% (0.2793 => 0.2942) SingleSource/Benchmarks/Shootout-C++/ary3: 5.33% (0.3283 => 0.3458, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.29% (2.2024 => 2.3188, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 5.27% (0.3379 => 0.3557, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 5.23% (0.3098 => 0.3260, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.21% (0.2802 => 0.2948, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.20% (0.2714 => 0.2855, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.09% (0.4064 => 0.4271, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 5.08% (0.2049 => 0.2153, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.70% (14.3668 => 15.0415, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.55% (0.3427 => 0.3583, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 4.40% (17.1811 => 17.9377, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/objinst: 4.34% (0.3131 => 0.3267, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.24% (1.2842 => 1.3387, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.03% (1.1194 => 1.1533, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.95% (3.8922 => 4.0072, std.dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 26.13% (1.1145 => 1.4057, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 18.49% (0.9957 => 1.1798, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 14.57% (3.1595 => 3.6198, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 12.29% (0.4808 => 0.5399, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.43% (3.6395 => 4.0554, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8904 => 3.2023, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9648, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.85% (1.1396 => 1.2519, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/fp-convert: 9.80% (3.3453 => 3.6731, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 8.02% (0.1421 => 0.1535) SingleSource/Benchmarks/Shootout-C++/hash2: 6.79% (3.1578 => 3.3721, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 5.19% (6.5088 => 6.8466, std.dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 4.59% (27.8444 => 29.1227, std.dev.: 0.0021) MultiSource/Benchmarks/BitBench/drop3/drop3: 4.30% (0.4162 => 0.4341, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.06% (4.3882 => 4.5663, std.dev.: 0.0331) MultiSource/Applications/minisat/minisat: 4.05% (9.1159 => 9.4849, std.dev.: 0.0364) MultiSource/Applications/spiff/spiff: 3.37% (2.9346 => 3.0334, std.dev.: 0.0128) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.05% (13.4384 => 13.8487, std.dev.: 0.0356) MultiSource/Benchmarks/PAQ8p/paq8p: 2.96% (85.0658 => 87.5800, std.dev.: 0.0074) SingleSource/Benchmarks/McGill/queens: 2.93% (2.1825 => 2.2465, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.76% (0.9540 => 0.9803, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.68% (4.2280 => 4.3411, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.37% (8.1563 => 8.3498, std.dev.: 0.0040) SingleSource/Regression/C/uint64_to_float: 2.33% (0.5413 => 0.5539, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.23% (1.7254 => 1.7638, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 2.10% (1.4460 => 1.4764, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.46% (6.6465 => 6.7438, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.41% (2.6546 => 2.6920, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.05% (6.6874 => 0.1302, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: -79.98% (0.8651 => 0.1732, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.30% (5.2763 => 3.2553, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.94% (5.3855 => 3.7193, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.69% (5.3526 => 3.7097, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -14.61% (54.1659 => 46.2538, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/mason/mason: -12.58% (0.0811 => 0.0709) MultiSource/Applications/ClamAV/clamscan: -12.20% (22.1758 => 19.4697, std.dev.: 0.0167) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.32% (2.9384 => 2.6351, std.dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -44.25% (0.0400 => 0.0223) SingleSource/Benchmarks/Misc/mandel: -33.56% (1.1492 => 0.7635, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/puzzle: -25.31% (0.6962 => 0.5200, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -23.79% (1.2373 => 0.9429, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-6: -16.70% (1.6925 => 1.4099, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.03% (0.0998 => 0.0858, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -11.02% (1.5373 => 1.3679, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -10.04% (0.2161 => 0.1944, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.88% (4.8142 => 4.4831, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -6.76% (1.5835 => 1.4765, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -6.27% (5.0483 => 4.7320, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -6.23% (1.2870 => 1.2068) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.86% (0.3463 => 0.3260, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.18% (1.6805 => 1.5935, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.82% (0.8614 => 0.8199, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.75% (1.8329 => 1.7458, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/huffbench: -4.36% (19.9488 => 19.0795, std.dev.: 0.0795) SingleSource/UnitTests/Vector/multiplies: -4.25% (2.5528 => 2.4444, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/fbench: -3.85% (2.2771 => 2.1894, std.dev.: 0.0062) MultiSource/Applications/siod/siod: -3.79% (3.2827 => 3.1584, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -3.72% (26.0924 => 25.1225, std.dev.: 0.0054) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.04% (2.7294 => 2.6736, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.98% (8.6802 => 8.5079, std.dev.: 0.0157) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.71% (1.3677 => 1.3443, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6834, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.56% (1.5660 => 1.5415, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4174, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -1.53% (1.1277 => 1.1105) SingleSource/Benchmarks/Misc/flops-8: -1.34% (1.8525 => 1.8276, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.2636 => 5.2026, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8563, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.24% (0.5229 => 0.5869, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 8.60% (14.9895 => 16.2786, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/gs/gs: 7.15% (4.1105 => 4.4045, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 15.62% (1.1048 => 1.2774, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.67% (7.1582 => 7.8505, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.84% (0.6222 => 0.7394, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35300.00% (0.0001 => 0.0354, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: -1.28% (0.1485 => 0.1466, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.00% (0.2116 => 0.0656, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 11 04:34:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 11 Oct 2012 06:34:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121011113413.E0D032A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4791?compare_to=4788&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4791, Order: 165709, Start Time: 2012-10-11 10:09:33, End Time: 2012-10-11 11:36:04 To: 4788, Order: 165708, Start Time: 2012-10-11 08:13:50, End Time: 2012-10-11 09:40:31 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (199 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1042 (669 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 43.48% (0.8818 => 1.2652, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 23.29% (2.0176 => 2.4875, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 17.55% (0.0826 => 0.0971, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.81% (0.1410 => 0.1647, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 16.45% (0.2243 => 0.2612, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 15.93% (0.0653 => 0.0757, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.63% (0.0834 => 0.0956, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 14.12% (0.6283 => 0.7170, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.81% (0.1072 => 0.1220, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 13.72% (0.1013 => 0.1152, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.41% (0.1588 => 0.1801, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.11% (0.1327 => 0.1501, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.09% (0.1413 => 0.1598, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.08% (1.1364 => 1.2850, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 12.72% (0.7038 => 0.7933, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.64% (0.2721 => 0.3065, std.dev.: 0.0032) MultiSource/Applications/hbd/hbd: 12.60% (1.3693 => 1.5418, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.55% (0.0964 => 0.1085, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.40% (0.4791 => 0.5385, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.29% (0.2596 => 0.2915, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.93% (1.4563 => 1.6300, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 11.92% (0.4328 => 0.4844, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.85% (0.7710 => 0.8624, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 11.77% (0.1062 => 0.1187, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.73% (0.6959 => 0.7775, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.53% (3.9660 => 4.4231, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 11.43% (3.6692 => 4.0885, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.43% (0.9199 => 1.0250, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 11.42% (0.4062 => 0.4526, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.42% (0.5265 => 0.5866, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.41% (0.1157 => 0.1289, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 11.22% (1.0313 => 1.1470, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.18% (0.3899 => 0.4335, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 11.07% (0.1003 => 0.1114, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.05% (0.3130 => 0.3476, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 10.99% (13.8202 => 15.3387, std.dev.: 0.0111) SingleSource/Benchmarks/McGill/chomp: 10.95% (0.1589 => 0.1763, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.70% (0.3580 => 0.3963, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.60% (0.7460 => 0.8251, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.58% (0.2127 => 0.2352, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 10.53% (0.3192 => 0.3528, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.52% (0.3022 => 0.3340, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.51% (0.4016 => 0.4438, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.50% (0.3485 => 0.3851, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 10.48% (0.5818 => 0.6428, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 10.46% (1.1061 => 1.2218, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 10.43% (0.3220 => 0.3556, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.42% (0.1075 => 0.1187, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.42% (0.6135 => 0.6774, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.30% (1.2193 => 1.3449, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 10.24% (0.0977 => 0.1077, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.23% (0.3246 => 0.3578, std.dev.: 0.0026) SingleSource/Regression/C++/ofstream_ctor: 10.21% (0.2781 => 0.3065, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 10.20% (0.8310 => 0.9158, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.16% (0.5637 => 0.6210, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.15% (0.0995 => 0.1096, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.09% (0.3756 => 0.4135, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 10.09% (0.5748 => 0.6328, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.09% (0.3489 => 0.3841, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.08% (0.8698 => 0.9575, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 10.08% (0.3868 => 0.4258, std.dev.: 0.0035) MultiSource/Applications/kimwitu++/kc: 10.03% (16.6129 => 18.2789, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/lists: 10.02% (0.3293 => 0.3623, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: 10.01% (3.1889 => 3.5081, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.99% (0.2782 => 0.3060, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 9.94% (0.7061 => 0.7763, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.93% (0.5577 => 0.6131, std.dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 9.88% (1.0594 => 1.1641, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.79% (0.2023 => 0.2221, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.75% (0.1569 => 0.1722, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.68% (0.2966 => 0.3253, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 9.67% (0.2761 => 0.3028, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.66% (0.4390 => 0.4814, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.66% (0.4805 => 0.5269, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.62% (1.9828 => 2.1735, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 9.59% (0.3453 => 0.3784, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 9.57% (0.2726 => 0.2987, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 9.55% (0.2607 => 0.2856, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 9.54% (2.1791 => 2.3870, std.dev.: 0.0164) MultiSource/Applications/treecc/treecc: 9.53% (1.9270 => 2.1106, std.dev.: 0.0108) MultiSource/Applications/oggenc/oggenc: 9.52% (4.6629 => 5.1069, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/random: 9.52% (0.2690 => 0.2946, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 9.45% (0.1111 => 0.1216, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 9.42% (0.3534 => 0.3867, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.42% (7.2180 => 7.8979, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.42% (0.2655 => 0.2905, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 9.38% (3.8646 => 4.2270, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/wc: 9.36% (0.2937 => 0.3212, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 9.34% (0.1478 => 0.1616, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 9.32% (0.2628 => 0.2873, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 9.30% (0.3107 => 0.3396, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 9.28% (0.2760 => 0.3016, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.26% (0.2765 => 0.3021, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 9.24% (0.3149 => 0.3440, std.dev.: 0.0111) MultiSource/Benchmarks/McCat/09-vor/vor: 9.16% (0.2925 => 0.3193, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 9.15% (0.6744 => 0.7361, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.14% (0.3511 => 0.3832, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.12% (0.6576 => 0.7176, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.12% (0.1865 => 0.2035, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.06% (0.1986 => 0.2166, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.94% (0.2696 => 0.2937, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.89% (0.2914 => 0.3173, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.78% (0.1276 => 0.1388, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.77% (4.9865 => 5.4236, std.dev.: 0.0102) MultiSource/Applications/spiff/spiff: 8.75% (0.7506 => 0.8163, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 8.72% (6.5754 => 7.1491, std.dev.: 0.0241) SingleSource/Benchmarks/Shootout-C++/objinst: 8.52% (0.2945 => 0.3196, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 8.46% (14.8535 => 16.1104, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.39% (0.3755 => 0.4070, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.35% (0.3245 => 0.3516, std.dev.: 0.0078) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.33% (0.1789 => 0.1938, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.27% (0.4379 => 0.4741, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.21% (1.3245 => 1.4332, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 8.20% (0.2988 => 0.3233, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.15% (0.2504 => 0.2708, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.13% (0.2140 => 0.2314, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 7.97% (0.1657 => 0.1789, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.78% (3.2742 => 3.5289, std.dev.: 0.0052) MultiSource/Benchmarks/sim/sim: 7.70% (0.3131 => 0.3372, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 7.63% (0.6250 => 0.6727, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.60% (0.1435 => 0.1544, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.58% (0.2321 => 0.2497, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 7.47% (3.7467 => 4.0265, std.dev.: 0.0147) MultiSource/Applications/hexxagon/hexxagon: 6.92% (1.2292 => 1.3143, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.70% (1.1333 => 1.2092, std.dev.: 0.0123) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.54% (0.9108 => 0.9704, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.53% (13.2842 => 14.1510, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/parameter-passing: 6.25% (0.4003 => 0.4253, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 6.23% (0.3914 => 0.4158, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/property: 5.96% (0.3940 => 0.4175, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 5.89% (1.2749 => 1.3500, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 5.73% (0.3578 => 0.3783, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 5.70% (0.3646 => 0.3854, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 5.68% (0.3663 => 0.3871, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 5.67% (0.3789 => 0.4004, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 5.66% (0.3623 => 0.3828, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.64% (1.5188 => 1.6045, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 5.62% (8.4961 => 8.9733, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/exceptions-2: 5.61% (0.3601 => 0.3803, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.58% (2.1007 => 2.2180, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.51% (0.3650 => 0.3851, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.30% (6.2785 => 6.6115, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.22% (4.4433 => 4.6751, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.17% (4.3801 => 4.6065, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.04% (0.2243 => 0.2356, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 4.82% (16.2614 => 17.0452, std.dev.: 0.0204) MultiSource/Applications/ClamAV/clamscan: 4.37% (14.5298 => 15.1652, std.dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: 1.94% (33.2944 => 33.9392, std.dev.: 0.0134) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5133, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 26.57% (1.0895 => 1.3790, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 20.19% (1.8175 => 2.1844, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 18.17% (0.9996 => 1.1812, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 11.03% (1.1560 => 1.2835, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.69% (3.6469 => 4.0368, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 10.56% (0.4867 => 0.5381, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 9.95% (2.8813 => 3.1679, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 8.61% (0.8273 => 0.8985, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 8.13% (3.1736 => 3.4316, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: 7.98% (3.4016 => 3.6731, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 7.58% (1.0640 => 1.1446, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.29% (1.7081 => 1.8327, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: 6.93% (0.4846 => 0.5182, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 6.09% (11.2619 => 11.9479, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/mandel-2: 5.25% (1.2998 => 1.3680) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.20% (7.9275 => 8.3394, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-6: 5.09% (1.9199 => 2.0177, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.06% (0.2093 => 0.2199, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.33% (2.5629 => 2.6739, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.31% (0.2389 => 0.2492, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 3.96% (1.9144 => 1.9903, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 3.86% (1.4298 => 1.4850, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 3.59% (7.4271 => 7.6940, std.dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.56% (13.3668 => 13.8427, std.dev.: 0.0172) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.42% (4.4062 => 4.5570, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/queens: 3.31% (2.1753 => 2.2473, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 3.25% (6.6320 => 6.8477, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 3.13% (12.0921 => 12.4708, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-8: 2.99% (1.9863 => 2.0457) MultiSource/Benchmarks/mafft/pairlocalalign: 2.71% (28.2225 => 28.9871, std.dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: 2.49% (3.8177 => 3.9127, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 2.44% (31.4682 => 32.2364, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.19% (0.9692 => 0.9904, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 2.08% (7.6086 => 7.7667, std.dev.: 0.0045) MultiSource/Applications/SPASS/SPASS: 2.05% (10.7476 => 10.9684, std.dev.: 0.0163) MultiSource/Benchmarks/PAQ8p/paq8p: 2.01% (84.4286 => 86.1292, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/oourafft: 1.88% (5.5130 => 5.6165, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.54% (9.3358 => 9.4797, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0497, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.41% (8.3908 => 8.5091, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1872, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists: 1.11% (12.4560 => 12.5942, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.10% (8.8259 => 8.9228, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0277, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 1.04% (3.1071 => 3.1395, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.01% (3.1720 => 3.2039, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.97% (0.2670 => 0.1416, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.96% (0.4657 => 0.3867, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -14.43% (0.0707 => 0.0605, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.07% (1.3813 => 1.2007, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.06% (1.3819 => 1.2014, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.07% (22.5627 => 22.3217, std.dev.: 0.0188) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) SingleSource/Benchmarks/McGill/chomp: -24.04% (1.2308 => 0.9349, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -21.49% (1.0460 => 0.8212, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.44% (0.0997 => 0.0863) MultiSource/Benchmarks/FreeBench/mason/mason: -12.15% (0.2238 => 0.1966, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -8.16% (2.6470 => 2.4311, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -6.23% (1.2870 => 1.2068) MultiSource/Applications/lua/lua: -6.17% (26.5159 => 24.8787, std.dev.: 0.0092) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.07% (1.3780 => 1.2943, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.73% (0.3458 => 0.3260, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -5.41% (5.0168 => 4.7454, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -5.29% (20.3410 => 19.2640, std.dev.: 0.1281) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.80% (3.2729 => 3.1486, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -2.72% (1.9762 => 1.9225, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4833, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.28% (1.7688 => 1.7284, std.dev.: 0.0005) MultiSource/Applications/aha/aha: -2.19% (3.1476 => 3.0787, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -2.17% (6.3560 => 6.2180, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.61% (1.4326 => 1.4095, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8666, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/ReedSolomon: -1.13% (7.1097 => 7.0296, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2588, std.dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: -1.04% (4.4810 => 4.4344, std.dev.: 0.0045) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 11 06:05:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 11 Oct 2012 08:05:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121011130528.59CF22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4792?compare_to=4790&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4792, Order: 165711, Start Time: 2012-10-11 11:47:08, End Time: 2012-10-11 13:07:16 To: 4790, Order: 165709, Start Time: 2012-10-11 09:57:26, End Time: 2012-10-11 11:17:51 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (166 on baseline) Performance Improvements: 2 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 949 (678 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.41% (14.9476 => 15.1579, std.dev.: 0.0047) MultiSource/Applications/hbd/hbd: 1.16% (1.6831 => 1.7027, std.dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.28% (3.7193 => 3.6718, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.19% (3.7097 => 3.6656, std.dev.: 0.0004) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.07% (0.5869 => 0.5873, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 0.19% (16.2786 => 16.3092, std.dev.: 0.0058) MultiSource/Benchmarks/Bullet/bullet: -0.12% (55.4801 => 55.4114, std.dev.: 0.0109) MultiSource/Benchmarks/MallocBench/gs/gs: -0.22% (4.4045 => 4.3948, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.86% (0.0463 => 0.0459, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.43% (0.0464 => 0.0462, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.69% (0.0432 => 0.0429, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.69% (0.0434 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.71% (0.0422 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.47% (0.0424 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.48% (0.0415 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.48% (0.0417 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.69% (0.0434 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.23% (0.0435 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.47% (0.0428 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.23% (0.0429 => 0.0428, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.72% (0.0418 => 0.0415, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.48% (0.0420 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.24% (0.0424 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.70% (0.0427 => 0.0424, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.23% (0.0435 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.23% (0.0438 => 0.0437, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.73% (0.0413 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.24% (0.0414 => 0.0413) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.94% (0.0426 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.70% (0.0427 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.48% (0.0416 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.48% (0.0418 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.73% (0.0409 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.49% (0.0409 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.25% (0.0406 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.25% (0.0408 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.68% (0.0444 => 0.0441, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0444 => 0.0444) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.74% (0.0407 => 0.0404, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.25% (0.0407 => 0.0406) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.49% (0.0407 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.25% (0.0408 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.72% (0.0415 => 0.0412, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.72% (0.0417 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.03% (1.2774 => 1.2770, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.08% (7.8505 => 7.8568, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.53% (0.7394 => 0.7433, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.28% (0.0354 => 0.0353, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: - (0.1466 => 0.1466) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0656 => 0.0656, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.38% (63.2438 => 55.4114, std.dev.: 0.0109) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.98% (14.1553 => 18.8233, std.dev.: 0.0140) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.23% (3.4629 => 5.6524, std.dev.: 0.0087) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14555.42% (0.0720 => 10.5519, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952300.00% (0.0001 => 9.9524, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 62.57% (0.2554 => 0.4152, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 46.21% (10.3673 => 15.1579, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/richards_benchmark: 37.48% (0.1622 => 0.2230, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 33.33% (0.1056 => 0.1408, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 24.43% (1.7609 => 2.1911, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.36% (7.0540 => 8.3489, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops: 18.16% (0.1432 => 0.1692, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.56% (2.2022 => 2.5448, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.88% (0.0746 => 0.0857, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.12% (0.0871 => 0.0994, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.47% (0.1566 => 0.1777, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.52% (0.6675 => 0.7511, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 11.79% (10.4361 => 11.6665, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 11.24% (0.1655 => 0.1841, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 11.18% (0.1440 => 0.1601, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 11.15% (0.3282 => 0.3648, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.97% (0.5105 => 0.5665, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.60% (0.4879 => 0.5396, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.52% (0.5020 => 0.5548, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 10.44% (5.7591 => 6.3606, std.dev.: 0.0154) MultiSource/Applications/lambda-0_1_3/lambda: 10.02% (0.7433 => 0.8178, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.88% (0.3177 => 0.3491, std.dev.: 0.0029) MultiSource/Applications/d/make_dparser: 9.75% (3.3354 => 3.6606, std.dev.: 0.0126) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.74% (0.3543 => 0.3888, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 9.73% (0.3473 => 0.3811, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 9.73% (0.3423 => 0.3756, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.61% (1.5415 => 1.6897, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.55% (0.3497 => 0.3831, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.54% (0.3543 => 0.3881, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 9.53% (0.1175 => 0.1287, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 9.52% (0.3561 => 0.3900, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 9.50% (0.7115 => 0.7791, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.50% (0.3516 => 0.3850, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.47% (0.3927 => 0.4299, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.42% (0.2271 => 0.2485, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 9.39% (0.3886 => 0.4251, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.35% (0.3828 => 0.4186, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.29% (0.1625 => 0.1776, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.23% (0.3694 => 0.4035, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.19% (0.3307 => 0.3611, std.dev.: 0.0076) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.15% (0.1584 => 0.1729, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 9.13% (1.5603 => 1.7027, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.07% (0.2700 => 0.2945, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.02% (0.6450 => 0.7032, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.90% (0.1236 => 0.1346, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.78% (0.2107 => 0.2292, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.76% (0.5569 => 0.6057, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.68% (0.1510 => 0.1641, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 8.55% (0.6456 => 0.7008, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 8.53% (3.8723 => 4.2025, std.dev.: 0.0125) MultiSource/Applications/Burg/burg: 8.50% (1.1642 => 1.2632, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.46% (8.1363 => 8.8243, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.30% (0.2758 => 0.2987, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.28% (0.8067 => 0.8735, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.28% (4.2646 => 4.6175, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.24% (0.5860 => 0.6343, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/Puzzle: 8.20% (0.1268 => 0.1372, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 8.17% (1.0722 => 1.1598, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 8.14% (0.1695 => 0.1833, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.11% (0.2603 => 0.2814, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.09% (0.8172 => 0.8833, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.07% (0.1438 => 0.1554, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 7.85% (0.1555 => 0.1677, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 7.79% (2.0273 => 2.1852, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.78% (0.9765 => 1.0525, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 7.77% (0.3422 => 0.3688, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.75% (1.3050 => 1.4062, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.73% (0.1940 => 0.2090, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.73% (0.5925 => 0.6383, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.69% (0.6030 => 0.6494, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 7.60% (9.4845 => 10.2057, std.dev.: 0.0096) MultiSource/Benchmarks/sim/sim: 7.50% (0.3387 => 0.3641, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.46% (0.2065 => 0.2219, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.45% (0.3826 => 0.4111, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.37% (0.4615 => 0.4955, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.35% (0.3865 => 0.4149, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.34% (0.4103 => 0.4404, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.32% (0.3441 => 0.3693, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.32% (0.4289 => 0.4603, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 7.31% (0.4048 => 0.4344, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.30% (0.4203 => 0.4510, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 7.29% (0.8921 => 0.9571, std.dev.: 0.0022) MultiSource/Applications/spiff/spiff: 7.28% (0.7835 => 0.8405, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference: 7.21% (0.7326 => 0.7854, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.20% (0.1695 => 0.1817, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 7.19% (2.2969 => 2.4621, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 7.19% (0.4620 => 0.4952, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 7.04% (0.3180 => 0.3404, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.01% (0.3650 => 0.3906, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 6.91% (21.9371 => 23.4537, std.dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.88% (0.4636 => 0.4955, std.dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.86% (7.9617 => 8.5078, std.dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 6.85% (1.1840 => 1.2651, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 6.75% (0.2831 => 0.3022, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.72% (0.5981 => 0.6383, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.70% (0.3121 => 0.3330, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.60% (0.3136 => 0.3343, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.58% (0.3603 => 0.3840, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.57% (0.2905 => 0.3096, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.50% (0.2891 => 0.3079, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.46% (0.3684 => 0.3922, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.44% (0.2266 => 0.2412, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.37% (0.3283 => 0.3492, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.36% (1.1861 => 1.2615, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.30% (2.0665 => 2.1967, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.29% (0.3162 => 0.3361, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.27% (0.2872 => 0.3052, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 6.26% (0.3052 => 0.3243, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.22% (0.3232 => 0.3433, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.17% (0.2871 => 0.3048, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.06% (0.2756 => 0.2923, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.05% (0.2793 => 0.2962, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.04% (0.3379 => 0.3583) SingleSource/Benchmarks/Shootout-C++/fibo: 6.02% (0.2725 => 0.2889, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.98% (0.2877 => 0.3049, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.94% (0.3098 => 0.3282, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.93% (0.1906 => 0.2019, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.82% (0.2714 => 0.2872, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.75% (0.2802 => 0.2963, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.69% (1.5859 => 1.6761, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.67% (1.4186 => 1.4991, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.67% (0.8101 => 0.8560, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.61% (0.4064 => 0.4292, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.60% (5.0018 => 5.2821, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.45% (4.9449 => 5.2144, std.dev.: 0.0161) SingleSource/Benchmarks/Misc/ReedSolomon: 5.27% (0.2049 => 0.2157, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.17% (2.2024 => 2.3163, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.02% (14.3668 => 15.0886, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/objinst: 4.82% (0.3131 => 0.3282, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 4.61% (1.2842 => 1.3434, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.52% (0.3427 => 0.3582, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 4.37% (17.1811 => 17.9317, std.dev.: 0.0176) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.96% (3.8922 => 4.0074, std.dev.: 0.0161) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.51% (1.1194 => 1.1475, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3123, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 26.15% (1.1145 => 1.4059, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 18.49% (0.9957 => 1.1798, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 14.49% (3.1595 => 3.6174, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 12.27% (0.4808 => 0.5398, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.64% (3.6395 => 4.0633, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.75% (2.8904 => 3.2011, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.71% (2.6778 => 2.9647, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: 9.81% (3.3453 => 3.6735) SingleSource/Benchmarks/Misc/richards_benchmark: 9.77% (1.1396 => 1.2509, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/Puzzle: 7.95% (0.1421 => 0.1534, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.84% (3.1578 => 3.3738, std.dev.: 0.0049) MultiSource/Benchmarks/nbench/nbench: 5.88% (11.6436 => 12.3284, std.dev.: 0.2432) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 5.23% (6.5088 => 6.8494, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.60% (4.3882 => 4.5899, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 4.59% (27.8444 => 29.1227, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/drop3/drop3: 4.30% (0.4162 => 0.4341, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 4.07% (9.1159 => 9.4866, std.dev.: 0.0042) MultiSource/Applications/spiff/spiff: 3.43% (2.9346 => 3.0354, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 2.95% (85.0658 => 87.5759, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/queens: 2.93% (2.1825 => 2.2465, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.91% (13.4384 => 13.8291, std.dev.: 0.0241) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.79% (0.9540 => 0.9806) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.63% (4.2280 => 4.3392, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.40% (8.1563 => 8.3522, std.dev.: 0.0020) SingleSource/Regression/C/uint64_to_float: 2.35% (0.5413 => 0.5540, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.25% (1.7254 => 1.7643, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 1.96% (1.4460 => 1.4743, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.52% (6.6465 => 6.7476, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.48% (2.6546 => 2.6939, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.05% (6.6874 => 0.1301, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.20% (5.2763 => 3.2609, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.82% (5.3855 => 3.6718, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.52% (5.3526 => 3.6656, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -14.71% (54.1659 => 46.1986, std.dev.: 0.0119) MultiSource/Benchmarks/FreeBench/mason/mason: -12.45% (0.0811 => 0.0710, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -12.40% (22.1758 => 19.4268, std.dev.: 0.0085) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.42% (2.9384 => 2.6322, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -44.25% (0.0400 => 0.0223) SingleSource/Benchmarks/Misc/mandel: -33.46% (1.1492 => 0.7647, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/puzzle: -25.57% (0.6962 => 0.5182, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -24.06% (1.2373 => 0.9396, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-6: -16.69% (1.6925 => 1.4101, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.83% (0.0998 => 0.0860, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -11.02% (1.5373 => 1.3679, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -10.04% (0.2161 => 0.1944, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.88% (4.8142 => 4.4830, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -6.88% (1.5835 => 1.4746, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: -6.26% (5.0483 => 4.7322, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -6.23% (1.2870 => 1.2068) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.86% (0.3463 => 0.3260, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.20% (1.6805 => 1.5931, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.83% (0.8614 => 0.8198, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.78% (1.8329 => 1.7452, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -4.66% (19.9488 => 19.0197, std.dev.: 0.0605) SingleSource/UnitTests/Vector/multiplies: -4.07% (2.5528 => 2.4488, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.80% (3.2827 => 3.1581, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/fbench: -3.75% (2.2771 => 2.1917, std.dev.: 0.0042) MultiSource/Applications/lua/lua: -3.71% (26.0924 => 25.1255, std.dev.: 0.0094) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.04% (2.7294 => 2.6736, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.86% (8.6802 => 8.5191, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6828, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.56% (1.5660 => 1.5415, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: -1.53% (1.1277 => 1.1104) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4179, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.49% (1.3677 => 1.3473, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-8: -1.27% (1.8525 => 1.8289, std.dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.2636 => 5.2009, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/whetstone: -1.08% (1.0554 => 1.0440, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.32% (0.5229 => 0.5873, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 8.80% (14.9895 => 16.3092, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/gs/gs: 6.92% (4.1105 => 4.3948, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 15.59% (1.1048 => 1.2770, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.76% (7.1582 => 7.8568, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.46% (0.6222 => 0.7433, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35200.00% (0.0001 => 0.0353, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -1.28% (0.1485 => 0.1466) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.00% (0.2116 => 0.0656, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 11 06:29:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 11 Oct 2012 08:29:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121011132957.102372A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4793?compare_to=4791&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4793, Order: 165712, Start Time: 2012-10-11 12:05:10, End Time: 2012-10-11 13:31:46 To: 4791, Order: 165709, Start Time: 2012-10-11 10:09:33, End Time: 2012-10-11 11:36:04 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (197 on baseline) Performance Improvements: 0 (35 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1039 (672 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.29% (1.2652 => 1.2815, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 1.01% (2.4875 => 2.5126, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.58% (54.3532 => 56.3009, std.dev.: 0.0768) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 45.33% (0.8818 => 1.2815, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 24.53% (2.0176 => 2.5126, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 18.04% (0.0826 => 0.0975, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.81% (0.1410 => 0.1647, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 16.54% (0.2243 => 0.2614, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.87% (0.0834 => 0.0958, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 14.59% (0.6283 => 0.7200, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.09% (0.1327 => 0.1514, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 13.62% (0.1013 => 0.1151, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.58% (1.1364 => 1.2907, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.54% (0.1588 => 0.1803, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.45% (0.1413 => 0.1603, std.dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.25% (0.1072 => 0.1214, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 13.12% (1.3693 => 1.5489, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.96% (0.4791 => 0.5412, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.86% (0.2721 => 0.3071, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 12.79% (0.7038 => 0.7938, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.55% (0.0964 => 0.1085, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.33% (1.4563 => 1.6359, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.13% (0.2596 => 0.2911, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 12.13% (0.4328 => 0.4853, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.91% (3.9660 => 4.4385, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 11.85% (3.6692 => 4.1041, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.84% (0.1157 => 0.1294, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 11.77% (0.1062 => 0.1187, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.74% (0.6959 => 0.7776, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.70% (0.5265 => 0.5881, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.58% (0.9199 => 1.0264, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.57% (0.3130 => 0.3492, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 11.45% (0.1589 => 0.1771, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 11.42% (0.4062 => 0.4526, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 11.42% (1.0313 => 1.1491, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 11.41% (13.8202 => 15.3973, std.dev.: 0.0121) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.40% (0.7710 => 0.8589, std.dev.: 0.0037) SingleSource/Benchmarks/Stanford/Puzzle: 11.36% (0.0977 => 0.1088, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.17% (0.3580 => 0.3980, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.09% (0.7460 => 0.8287, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.08% (0.3899 => 0.4331, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: 10.97% (0.1003 => 0.1113, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.95% (0.3022 => 0.3353, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 10.95% (0.5818 => 0.6455, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 10.87% (0.3192 => 0.3539, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 10.85% (1.1061 => 1.2261, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 10.83% (0.1478 => 0.1638, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.77% (0.2127 => 0.2356, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 10.76% (0.7061 => 0.7821, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 10.69% (0.8310 => 0.9198, std.dev.: 0.0099) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.66% (0.6135 => 0.6789, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.63% (0.4016 => 0.4443, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.59% (0.3485 => 0.3854, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.57% (0.8698 => 0.9617, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 10.56% (0.3220 => 0.3560, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 10.53% (0.5748 => 0.6353, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.49% (1.2193 => 1.3472, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.45% (0.1569 => 0.1733, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.41% (0.3246 => 0.3584, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 10.40% (16.6129 => 18.3413, std.dev.: 0.0149) SingleSource/Regression/C++/ofstream_ctor: 10.39% (0.2781 => 0.3070, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 10.37% (1.0594 => 1.1693, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 10.34% (3.1889 => 3.5186, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/moments: 10.32% (0.3868 => 0.4267, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.25% (0.0995 => 0.1097, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.25% (0.3756 => 0.4141, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 10.23% (0.3293 => 0.3630, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.23% (0.1075 => 0.1185, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.20% (0.3489 => 0.3845, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.17% (0.5577 => 0.6144, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.11% (0.5637 => 0.6207, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.07% (0.4390 => 0.4832, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.94% (0.2023 => 0.2224, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.92% (0.2782 => 0.3058, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.84% (0.2966 => 0.3258, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 9.82% (4.6629 => 5.1209, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.80% (0.4805 => 0.5276, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.77% (0.3511 => 0.3854, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 9.77% (1.9270 => 2.1152, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/strcat: 9.76% (0.2726 => 0.2992, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.75% (1.9828 => 2.1762, std.dev.: 0.0123) MultiSource/Applications/siod/siod: 9.75% (2.1791 => 2.3915, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: 9.73% (0.3453 => 0.3789, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 9.64% (0.2760 => 0.3026, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 9.62% (0.3107 => 0.3406, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.62% (4.9865 => 5.4660, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 9.61% (0.6744 => 0.7392, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.59% (7.2180 => 7.9101, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary3: 9.56% (0.3149 => 0.3450, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.49% (0.2655 => 0.2907, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 9.45% (0.1111 => 0.1216, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 9.44% (0.2690 => 0.2944, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 9.44% (0.2607 => 0.2853, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 9.39% (0.3534 => 0.3866, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 9.39% (3.8646 => 4.2273, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/methcall: 9.38% (0.2761 => 0.3020, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.33% (0.2765 => 0.3023, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 9.33% (0.2937 => 0.3211, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 9.32% (0.2628 => 0.2873, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 9.13% (0.2925 => 0.3192, std.dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 9.12% (6.5754 => 7.1748, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.06% (0.1865 => 0.2034, std.dev.: 0.0062) MultiSource/Applications/spiff/spiff: 8.98% (0.7506 => 0.8180, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.98% (0.2696 => 0.2938, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.93% (0.6576 => 0.7163, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 8.82% (14.8535 => 16.1637, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.81% (0.1986 => 0.2161, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.62% (0.1276 => 0.1386, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.61% (0.2914 => 0.3165, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.60% (0.3755 => 0.4078, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 8.59% (0.2945 => 0.3198, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 8.57% (0.2988 => 0.3244, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.55% (0.1789 => 0.1942, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.47% (0.3245 => 0.3520, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.43% (0.4379 => 0.4748, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.42% (1.3245 => 1.4360, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.27% (0.2504 => 0.2711, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.13% (0.2140 => 0.2314, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 8.13% (0.6250 => 0.6758, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.11% (3.2742 => 3.5399, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 7.95% (0.3131 => 0.3380, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 7.91% (0.1657 => 0.1788, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.80% (0.1435 => 0.1547, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 7.74% (3.7467 => 4.0368, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.45% (0.2321 => 0.2494, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 6.99% (1.2292 => 1.3151, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.92% (0.9108 => 0.9738, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.90% (13.2842 => 14.2014, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.86% (1.1333 => 1.2110, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/parameter-passing: 6.72% (0.4003 => 0.4272, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.59% (0.3914 => 0.4172, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.45% (0.3940 => 0.4194, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.39% (0.3789 => 0.4031, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 6.31% (0.3663 => 0.3894, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.28% (0.3646 => 0.3875, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 6.26% (0.3578 => 0.3802, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 6.23% (1.2749 => 1.3543, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.18% (1.5188 => 1.6126, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 6.14% (0.3601 => 0.3822, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.13% (0.3623 => 0.3845, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.05% (0.3650 => 0.3871, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.92% (2.1007 => 2.2250, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 5.91% (0.1777 => 0.1882, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 5.85% (8.4961 => 8.9930, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.46% (4.3801 => 4.6193, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.44% (4.4433 => 4.6849, std.dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.33% (6.2785 => 6.6134, std.dev.: 0.0092) MultiSource/Applications/sqlite3/sqlite3: 5.11% (16.2614 => 17.0918, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.99% (0.2243 => 0.2355, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 4.61% (14.5298 => 15.1996, std.dev.: 0.0084) MultiSource/Applications/sgefa/sgefa: 3.44% (0.2995 => 0.3098, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 2.02% (33.2944 => 33.9658, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5162, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 26.57% (1.0895 => 1.3790, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 20.17% (1.8175 => 2.1841, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 18.02% (0.9996 => 1.1797, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: 11.07% (1.1560 => 1.2840, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.78% (3.6469 => 4.0401, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 10.58% (0.4867 => 0.5382, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 9.92% (2.8813 => 3.1670, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 8.62% (0.8273 => 0.8986) MultiSource/Benchmarks/Olden/mst/mst: 8.47% (0.1322 => 0.1434, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 8.11% (3.1736 => 3.4310, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/fp-convert: 7.99% (3.4016 => 3.6734, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-4: 7.57% (1.0640 => 1.1445, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.28% (1.7081 => 1.8325, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/puzzle: 6.95% (0.4846 => 0.5183, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 6.09% (11.2619 => 11.9479, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.27% (7.9275 => 8.3451, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/mandel-2: 5.24% (1.2998 => 1.3679, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 5.08% (1.9199 => 2.0174, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.49% (0.3139 => 0.3280, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.40% (0.2389 => 0.2494, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.32% (2.5629 => 2.6735, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.01% (1.9144 => 1.9912, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 3.80% (1.4298 => 1.4842, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 3.62% (7.4271 => 7.6958, std.dev.: 0.0068) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.45% (4.4062 => 4.5583, std.dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.43% (13.3668 => 13.8254, std.dev.: 0.0432) SingleSource/Benchmarks/McGill/queens: 3.28% (2.1753 => 2.2466) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 3.24% (6.6320 => 6.8466, std.dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 3.17% (12.0921 => 12.4751, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: 2.99% (1.9863 => 2.0457) MultiSource/Benchmarks/mafft/pairlocalalign: 2.71% (28.2225 => 28.9866, std.dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 2.48% (3.8177 => 3.9124, std.dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: 2.42% (31.4682 => 32.2312, std.dev.: 0.0127) MultiSource/Applications/SPASS/SPASS: 2.29% (10.7476 => 10.9940, std.dev.: 0.0189) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.20% (0.9692 => 0.9905, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 2.12% (7.6086 => 7.7698, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 2.02% (84.4286 => 86.1321, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 1.85% (5.5130 => 5.6150, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 1.51% (9.3358 => 9.4766, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.40% (8.3908 => 8.5082, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1875, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 1.16% (12.4560 => 12.6004, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0268, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/em3d/em3d: 1.04% (3.1071 => 3.1395, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.97% (0.2670 => 0.1416, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.64% (0.4657 => 0.3882, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -14.29% (0.0707 => 0.0606, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.02% (1.3819 => 1.2020, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.96% (1.3813 => 1.2023, std.dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) SingleSource/Benchmarks/McGill/chomp: -23.83% (1.2308 => 0.9375, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -21.48% (1.0460 => 0.8213, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.93% (0.2238 => 0.1971, std.dev.: 0.0017) SingleSource/UnitTests/Vector/multiplies: -7.65% (2.6470 => 2.4444, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.47% (20.3410 => 19.0249, std.dev.: 0.1637) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -6.23% (1.2870 => 1.2068) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -6.12% (26.5159 => 24.8935, std.dev.: 0.0106) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.73% (0.3458 => 0.3260, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.63% (1.3780 => 1.3004, std.dev.: 0.0050) MultiSource/Benchmarks/sim/sim: -5.41% (5.0168 => 4.7455, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.81% (3.2729 => 3.1482, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.66% (1.9762 => 1.9237, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.29% (1.7688 => 1.7283, std.dev.: 0.0007) MultiSource/Applications/aha/aha: -2.20% (3.1476 => 3.0785, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.00% (0.6589 => 0.6457, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.88% (6.3560 => 6.2363, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.61% (1.4326 => 1.4096) SingleSource/Benchmarks/Misc/ReedSolomon: -1.13% (7.1097 => 7.0293, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2576, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/heapsort: -1.08% (3.9173 => 3.8749, std.dev.: 0.0117) MultiSource/Applications/viterbi/viterbi: -1.02% (4.4810 => 4.4353, std.dev.: 0.0042) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 11 07:04:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 11 Oct 2012 09:04:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121011140437.34EE22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4794?compare_to=4789&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4794, Order: 165710, Start Time: 2012-10-11 10:56:32, End Time: 2012-10-11 14:06:26 To: 4789, Order: 165705, Start Time: 2012-10-11 07:17:25, End Time: 2012-10-11 10:27:12 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (135 on baseline) Performance Improvements: 2 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1037 (755 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.15% (1.0278 => 1.0396, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 31.23% (57.0765 => 74.9043, std.dev.: 0.0276) SingleSource/Benchmarks/Shootout-C++/ary: 5.75% (0.2139 => 0.2262, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.36% (2.5243 => 2.4143, std.dev.: 0.0075) MultiSource/Applications/oggenc/oggenc: -1.73% (1.7757 => 1.7450, std.dev.: 0.0012) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 10.81% (0.3496 => 0.3874, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.75% (0.3469 => 0.3842, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.69% (0.3460 => 0.3830, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.65% (0.3465 => 0.3834, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.64% (0.3488 => 0.3859, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 10.62% (0.3446 => 0.3812, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 10.60% (0.3650 => 0.4037, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.58% (0.3442 => 0.3806, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 10.32% (0.3643 => 0.4019, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.25% (0.1063 => 0.1172, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.18% (0.3724 => 0.4103, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 9.53% (1.5932 => 1.7450, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 9.08% (0.5889 => 0.6424, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.03% (0.5826 => 0.6352, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.70% (0.2875 => 0.3125, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 8.37% (0.1218 => 0.1320, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.33% (0.2738 => 0.2966, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 8.18% (0.2725 => 0.2948, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 8.18% (0.2714 => 0.2936, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 8.17% (0.2803 => 0.3032, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 8.16% (0.3004 => 0.3249, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.13% (0.2729 => 0.2951, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 8.09% (0.2780 => 0.3005, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.06% (0.2792 => 0.3017) SingleSource/Benchmarks/Shootout-C++/except: 8.04% (0.2811 => 0.3037, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.01% (0.3195 => 0.3451, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 8.01% (0.2823 => 0.3049, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 7.97% (0.1505 => 0.1625, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 7.97% (0.1619 => 0.1748, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.92% (0.9909 => 1.0694, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 7.91% (0.3096 => 0.3341, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 7.89% (0.2750 => 0.2967, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.87% (1.6211 => 1.7486, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/methcall: 7.86% (0.2813 => 0.3034, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.78% (2.0673 => 2.2281, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.72% (0.4146 => 0.4466, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.64% (0.7171 => 0.7719, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.59% (0.2911 => 0.3132, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.59% (1.3152 => 1.4150, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 7.56% (0.3267 => 0.3514, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 7.53% (0.3678 => 0.3955, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 7.53% (0.3348 => 0.3600, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 7.52% (0.2566 => 0.2759, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.52% (0.3258 => 0.3503, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.52% (0.3060 => 0.3290, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.50% (0.4361 => 0.4688, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 7.49% (0.4847 => 0.5210, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.47% (0.4994 => 0.5367, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.47% (0.3362 => 0.3613, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 7.46% (0.3726 => 0.4004, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 7.45% (5.5417 => 5.9545, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/ary2: 7.45% (0.3317 => 0.3564, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.39% (0.3124 => 0.3355, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 7.31% (0.3477 => 0.3731, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.28% (0.3282 => 0.3521, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.26% (0.3625 => 0.3888, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.22% (0.4251 => 0.4558, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.21% (0.9697 => 1.0396, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.16% (0.5026 => 0.5386, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.15% (0.4139 => 0.4435, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.05% (0.3690 => 0.3950, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.02% (3.5627 => 3.8128, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.96% (0.3981 => 0.4258, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.90% (0.2014 => 0.2153, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.88% (0.5000 => 0.5344, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.85% (0.1620 => 0.1731, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 6.85% (1.0781 => 1.1519, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.78% (4.4195 => 4.7193, std.dev.: 0.0148) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.76% (0.3845 => 0.4105, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.71% (0.1549 => 0.1653, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.69% (0.2736 => 0.2919, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 6.67% (4.2109 => 4.4916, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.59% (0.3930 => 0.4189, std.dev.: 0.0019) MultiSource/Applications/siod/siod: 6.53% (0.6634 => 0.7067, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.45% (0.6435 => 0.6850, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.43% (2.7292 => 2.9047, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 6.42% (0.5012 => 0.5334, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 6.38% (23.5202 => 25.0215, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.32% (0.2866 => 0.3047, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.30% (0.3903 => 0.4149, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.30% (0.3890 => 0.4135, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 6.23% (1.8794 => 1.9965, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.23% (0.3084 => 0.3276, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.22% (0.5900 => 0.6267, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.19% (0.2068 => 0.2196, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 6.18% (2.1013 => 2.2311, std.dev.: 0.0057) MultiSource/Applications/spiff/spiff: 6.11% (0.4029 => 0.4275, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.10% (0.1968 => 0.2088, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 6.08% (0.5546 => 0.5883, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 6.06% (1.4269 => 1.5133, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.03% (0.2040 => 0.2163, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.03% (0.2969 => 0.3148, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.03% (0.2737 => 0.2902, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 5.94% (4.6177 => 4.8922, std.dev.: 0.0071) MultiSource/Applications/JM/ldecod/ldecod: 5.83% (2.1653 => 2.2915, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 5.80% (0.2691 => 0.2847, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.80% (0.4658 => 0.4928, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 5.73% (0.3336 => 0.3527, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.69% (0.3271 => 0.3457, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 5.64% (0.2075 => 0.2192, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.61% (0.2103 => 0.2221, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 5.53% (2.0346 => 2.1472, std.dev.: 0.0035) MultiSource/Applications/treecc/treecc: 5.35% (0.7875 => 0.8296, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.24% (1.9694 => 2.0726, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.17% (0.7426 => 0.7810, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 5.14% (0.2391 => 0.2514, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.13% (1.9966 => 2.0991, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.07% (0.5361 => 0.5633, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 4.57% (0.3498 => 0.3658, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.57% (11.6398 => 12.1713, std.dev.: 0.0222) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.44% (0.5584 => 0.5832, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.83% (4.6926 => 4.8721, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.06% (0.4253 => 0.4383, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 2.79% (11.9555 => 12.2895, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.60% (0.2122 => 0.2262, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6104, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6714, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-2: 4.79% (1.8057 => 1.8922, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1695, std.dev.: 0.0234) SingleSource/Benchmarks/Dhrystone/dry: 4.18% (14.0481 => 14.6350, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1955, std.dev.: 0.0073) MultiSource/Applications/viterbi/viterbi: 1.89% (46.6247 => 47.5072, std.dev.: 0.0244) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.59% (3.1722 => 3.2227, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2850, std.dev.: 0.0036) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5139, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.14% (1.0927 => 1.1052, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5847, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.51% (2.4764 => 2.4143, std.dev.: 0.0075) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5690, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/ary2: -8.66% (0.2402 => 0.2194, std.dev.: 0.0046) MultiSource/Applications/hexxagon/hexxagon: -7.70% (28.1477 => 25.9793, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7931, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/tsp/tsp: -7.33% (2.1113 => 1.9565, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7991, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7743, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.99% (0.6293 => 0.6105, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.81% (17.2379 => 16.7528, std.dev.: 0.0409) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8596, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5728, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4956, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.10% (105.3826 => 104.2190, std.dev.: 0.0667) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0433, std.dev.: 0.0034) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 11 07:54:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 11 Oct 2012 09:54:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121011145454.3B96E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4795?compare_to=4792&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4795, Order: 165713, Start Time: 2012-10-11 13:36:39, End Time: 2012-10-11 14:56:43 To: 4792, Order: 165711, Start Time: 2012-10-11 11:47:08, End Time: 2012-10-11 13:07:16 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (166 on baseline) Performance Improvements: 1 (44 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 951 (677 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 4.23% (12.3284 => 12.8500, std.dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/multiplies: -1.43% (2.4488 => 2.4138, std.dev.: 0.0132) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.09% (0.5873 => 0.5878, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -0.08% (16.3092 => 16.2958, std.dev.: 0.0056) MultiSource/Benchmarks/Bullet/bullet: 0.07% (55.4114 => 55.4491, std.dev.: 0.0075) MultiSource/Benchmarks/MallocBench/gs/gs: 0.05% (4.3948 => 4.3971, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0459 => 0.0459, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.22% (0.0462 => 0.0461, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.23% (0.0429 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.23% (0.0431 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.24% (0.0419 => 0.0418, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0422 => 0.0422, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.24% (0.0413 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.24% (0.0415 => 0.0414, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0431 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.23% (0.0434 => 0.0433, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.23% (0.0426 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0428 => 0.0428) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.24% (0.0415 => 0.0416) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0418 => 0.0418) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0423 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0424 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.23% (0.0434 => 0.0433, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.46% (0.0437 => 0.0435, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.24% (0.0410 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0413 => 0.0413) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.47% (0.0422 => 0.0424, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.24% (0.0424 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0414 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0416 => 0.0416, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.25% (0.0406 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.25% (0.0407 => 0.0408) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.25% (0.0405 => 0.0404, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.25% (0.0407 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.23% (0.0441 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0444 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.25% (0.0404 => 0.0405, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.25% (0.0406 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0405 => 0.0405, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0407 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.49% (0.0412 => 0.0414) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0414 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.02% (1.2770 => 1.2768, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.08% (7.8568 => 7.8508, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.01% (0.7433 => 0.7432, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.28% (0.0353 => 0.0354, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: - (0.1466 => 0.1466) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.61% (0.0656 => 0.0660, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.32% (63.2438 => 55.4491, std.dev.: 0.0075) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.92% (14.1553 => 18.8154, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.19% (3.4629 => 5.6512, std.dev.: 0.0031) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14560.28% (0.0720 => 10.5554, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952500.00% (0.0001 => 9.9526, std.dev.: 0.0012) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 62.41% (0.2554 => 0.4148, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 46.17% (10.3673 => 15.1537, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/richards_benchmark: 37.48% (0.1622 => 0.2230, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 33.43% (0.1056 => 0.1409) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 24.44% (1.7609 => 2.1913, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.37% (7.0540 => 8.3495, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/flops: 18.09% (0.1432 => 0.1691, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.58% (2.2022 => 2.5452, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.88% (0.0746 => 0.0857) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.12% (0.0871 => 0.0994, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.41% (0.1566 => 0.1776, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.40% (0.6675 => 0.7503, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 11.83% (10.4361 => 11.6703, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.24% (0.5105 => 0.5679, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: 11.11% (0.1440 => 0.1600, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/oourafft: 10.97% (0.3282 => 0.3642, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 10.82% (0.1655 => 0.1834, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.49% (0.4879 => 0.5391, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 10.42% (5.7591 => 6.3594, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.38% (0.5020 => 0.5541, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.36% (0.1236 => 0.1364, std.dev.: 0.0045) MultiSource/Applications/lambda-0_1_3/lambda: 10.05% (0.7433 => 0.8180, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.77% (0.3543 => 0.3889, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 9.73% (0.3473 => 0.3811, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 9.73% (0.3423 => 0.3756, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.73% (0.3177 => 0.3486, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 9.71% (3.3354 => 3.6592, std.dev.: 0.0034) MultiSource/Applications/minisat/minisat: 9.63% (0.7115 => 0.7800, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 9.62% (0.3543 => 0.3884, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.59% (1.5415 => 1.6893, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 9.58% (0.3497 => 0.3832, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.55% (0.3927 => 0.4302, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.47% (0.3516 => 0.3849, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/tsp/tsp: 9.45% (0.1175 => 0.1286, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.41% (0.3561 => 0.3896, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.34% (0.3307 => 0.3616, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.34% (0.2271 => 0.2483, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.33% (0.3828 => 0.4185, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.23% (0.3694 => 0.4035, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.22% (0.1584 => 0.1730, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.17% (0.1625 => 0.1774, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 9.16% (0.3886 => 0.4242, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 9.15% (1.5603 => 1.7030, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.11% (0.2700 => 0.2946, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.01% (0.6450 => 0.7031, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.83% (0.2107 => 0.2293, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.68% (0.1510 => 0.1641, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 8.60% (1.1642 => 1.2643, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.51% (8.1363 => 8.8290, std.dev.: 0.0055) MultiSource/Applications/lua/lua: 8.51% (3.8723 => 4.2018, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 8.49% (0.6456 => 0.7004, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.43% (0.8067 => 0.8747, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.30% (0.2758 => 0.2987, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.29% (0.5860 => 0.6346, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.28% (0.5569 => 0.6030, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 8.20% (0.1695 => 0.1834, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 8.12% (1.0722 => 1.1593, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 8.12% (0.1268 => 0.1371, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.08% (4.2646 => 4.6090, std.dev.: 0.0094) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.07% (0.2603 => 0.2813, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.04% (0.8172 => 0.8829, std.dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.00% (0.1438 => 0.1553, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 7.91% (0.1555 => 0.1678, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.89% (0.9765 => 1.0535, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.78% (0.1940 => 0.2091, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.78% (0.5925 => 0.6386, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 7.75% (2.0273 => 2.1844, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.74% (1.3050 => 1.4060, std.dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.69% (0.4615 => 0.4970, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 7.68% (9.4845 => 10.2125, std.dev.: 0.0103) SingleSource/UnitTests/ObjC++/property-reference-object: 7.65% (0.6030 => 0.6491, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.60% (0.4289 => 0.4615, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.48% (0.3865 => 0.4154, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 7.42% (0.3422 => 0.3676, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 7.41% (0.3387 => 0.3638, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.41% (0.4103 => 0.4407, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.40% (0.3826 => 0.4109, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.35% (0.4203 => 0.4512, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 7.34% (0.4048 => 0.4345, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 7.32% (0.8921 => 0.9574, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.29% (0.3441 => 0.3692, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.20% (0.1695 => 0.1817, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 7.20% (2.2969 => 2.4622, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.19% (0.7326 => 0.7853, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.17% (0.2065 => 0.2213, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 7.13% (0.7835 => 0.8394, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.12% (0.4636 => 0.4966, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.06% (0.4620 => 0.4946, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.04% (0.3650 => 0.3907, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 6.98% (0.3180 => 0.3402, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.86% (7.9617 => 8.5081, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.86% (0.5981 => 0.6391, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 6.85% (21.9371 => 23.4406, std.dev.: 0.0100) MultiSource/Benchmarks/nbench/nbench: 6.80% (1.1840 => 1.2645, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 6.76% (0.3684 => 0.3933, std.dev.: 0.0058) SingleSource/Regression/C++/ofstream_ctor: 6.71% (0.2905 => 0.3100, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.71% (0.2266 => 0.2418, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.69% (0.3603 => 0.3844, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.66% (0.3121 => 0.3329, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.63% (0.3136 => 0.3344, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.61% (0.2891 => 0.3082, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.59% (0.3232 => 0.3445, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.57% (0.2831 => 0.3017, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.37% (2.0665 => 2.1981, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.36% (0.3162 => 0.3363, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.35% (1.1861 => 1.2614, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.28% (0.2756 => 0.2929, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 6.24% (0.3283 => 0.3488, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.13% (0.2725 => 0.2892, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.13% (0.3379 => 0.3586, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.10% (0.2871 => 0.3046, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.09% (0.3052 => 0.3238, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.06% (0.2872 => 0.3046, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.98% (0.2877 => 0.3049, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.94% (0.2793 => 0.2959, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hello: 5.90% (0.2714 => 0.2874, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.88% (0.1906 => 0.2018, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 5.85% (0.2802 => 0.2966, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.83% (0.8101 => 0.8573, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.78% (0.3098 => 0.3277, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.72% (1.4186 => 1.4997, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.61% (5.0018 => 5.2822, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.51% (0.4064 => 0.4288, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.51% (4.9449 => 5.2172, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.48% (1.5859 => 1.6728, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: 5.37% (0.2049 => 0.2159, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.36% (2.2024 => 2.3204, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (0.3131 => 0.3294, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.94% (14.3668 => 15.0761, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 4.69% (1.2842 => 1.3444, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.55% (0.3427 => 0.3583, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 4.43% (17.1811 => 17.9418, std.dev.: 0.0171) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.93% (3.8922 => 4.0062, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.62% (1.1194 => 1.1487, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 26.10% (1.1145 => 1.4054, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 18.51% (0.9957 => 1.1800, std.dev.: 0.0034) MultiSource/Applications/aha/aha: 14.57% (3.1595 => 3.6198, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 12.38% (0.4808 => 0.5403, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.64% (3.6395 => 4.0633, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.75% (2.8904 => 3.2011, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 10.36% (11.6436 => 12.8500, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: 9.80% (3.3453 => 3.6731, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.75% (1.1396 => 1.2507, std.dev.: 0.0016) SingleSource/Benchmarks/Stanford/Puzzle: 7.95% (0.1421 => 0.1534) SingleSource/Benchmarks/Shootout-C++/hash2: 6.81% (3.1578 => 3.3730, std.dev.: 0.0092) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 5.21% (6.5088 => 6.8482, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 4.60% (27.8444 => 29.1265, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 4.30% (0.4162 => 0.4341, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.12% (4.3882 => 4.5688, std.dev.: 0.0095) MultiSource/Applications/minisat/minisat: 4.06% (9.1159 => 9.4863, std.dev.: 0.0272) MultiSource/Applications/spiff/spiff: 3.47% (2.9346 => 3.0364, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 2.94% (85.0658 => 87.5667, std.dev.: 0.0137) SingleSource/Benchmarks/McGill/queens: 2.93% (2.1825 => 2.2465, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.82% (4.2280 => 4.3473, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.76% (0.9540 => 0.9803, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.68% (13.4384 => 13.7983, std.dev.: 0.0373) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.47% (8.1563 => 8.3577, std.dev.: 0.0121) SingleSource/Regression/C/uint64_to_float: 2.33% (0.5413 => 0.5539, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.23% (1.7254 => 1.7638, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 2.10% (1.4460 => 1.4763, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.53% (2.6546 => 2.6953, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: 1.46% (6.6465 => 6.7438, std.dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.06% (6.6874 => 0.1300, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.24% (5.2763 => 3.2588, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.81% (5.3855 => 3.6725, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.52% (5.3526 => 3.6656, std.dev.: 0.0054) SingleSource/UnitTests/Vector/constpool: -14.71% (54.1659 => 46.1997, std.dev.: 0.0247) MultiSource/Benchmarks/FreeBench/mason/mason: -12.45% (0.0811 => 0.0710, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -12.40% (22.1758 => 19.4250, std.dev.: 0.0099) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.35% (2.9384 => 2.6342, std.dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -44.25% (0.0400 => 0.0223) SingleSource/Benchmarks/Misc/mandel: -33.53% (1.1492 => 0.7639, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/puzzle: -25.55% (0.6962 => 0.5183, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -23.63% (1.2373 => 0.9449, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: -16.67% (1.6925 => 1.4104, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.63% (0.0998 => 0.0862, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -11.01% (1.5373 => 1.3680) MultiSource/Benchmarks/FreeBench/mason/mason: -9.81% (0.2161 => 0.1949, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.88% (4.8142 => 4.4831, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -6.79% (1.5835 => 1.4760, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -6.26% (5.0483 => 4.7321, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -6.23% (1.2870 => 1.2068) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.86% (0.3463 => 0.3260, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.45% (2.5528 => 2.4138, std.dev.: 0.0132) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.17% (1.6805 => 1.5936, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -4.97% (19.9488 => 18.9564, std.dev.: 0.1442) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.83% (0.8614 => 0.8198, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.82% (1.8329 => 1.7446, std.dev.: 0.0016) MultiSource/Applications/siod/siod: -3.79% (3.2827 => 3.1583, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -3.68% (26.0924 => 25.1309, std.dev.: 0.0357) SingleSource/Benchmarks/Misc/fbench: -3.43% (2.2771 => 2.1991, std.dev.: 0.0032) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.04% (2.7294 => 2.6737, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.76% (8.6802 => 8.5274, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6806, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.57% (1.5660 => 1.5414, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: -1.53% (1.1277 => 1.1105, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.52% (9.5636 => 9.4186, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.31% (1.3677 => 1.3498, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-8: -1.19% (1.8525 => 1.8304, std.dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.2636 => 5.2062, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8569, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.41% (0.5229 => 0.5878, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 8.71% (14.9895 => 16.2958, std.dev.: 0.0056) MultiSource/Benchmarks/MallocBench/gs/gs: 6.97% (4.1105 => 4.3971, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 15.57% (1.1048 => 1.2768, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.68% (7.1582 => 7.8508, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.45% (0.6222 => 0.7432, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35300.00% (0.0001 => 0.0354, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -1.28% (0.1485 => 0.1466) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.81% (0.2116 => 0.0660, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 11 08:25:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 11 Oct 2012 10:25:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121011152553.8E4A12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4796?compare_to=4793&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4796, Order: 165713, Start Time: 2012-10-11 14:01:06, End Time: 2012-10-11 15:27:43 To: 4793, Order: 165712, Start Time: 2012-10-11 12:05:10, End Time: 2012-10-11 13:31:46 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (197 on baseline) Performance Improvements: 1 (34 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1041 (673 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -3.32% (3.8806 => 3.7519, std.dev.: 0.0408) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 45.28% (0.8818 => 1.2811, std.dev.: 0.0047) MultiSource/Benchmarks/PAQ8p/paq8p: 24.50% (2.0176 => 2.5119, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 18.04% (0.0826 => 0.0975, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.74% (0.1410 => 0.1646, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 16.58% (0.2243 => 0.2615, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.87% (0.0834 => 0.0958, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 14.61% (0.6283 => 0.7201, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.24% (0.1327 => 0.1516, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.54% (0.1588 => 0.1803, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 13.52% (0.1013 => 0.1150, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.45% (0.1413 => 0.1603, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.45% (1.1364 => 1.2892, std.dev.: 0.0050) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.34% (0.1072 => 0.1215, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 13.17% (1.3693 => 1.5496, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.97% (0.2721 => 0.3074, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.92% (0.4791 => 0.5410, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 12.62% (0.7038 => 0.7926, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.55% (0.0964 => 0.1085, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.31% (1.4563 => 1.6355, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.29% (0.2596 => 0.2915, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 12.15% (0.4328 => 0.4854, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.90% (3.9660 => 4.4381, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 11.83% (3.6692 => 4.1032, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.83% (0.6959 => 0.7782, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 11.77% (0.1062 => 0.1187, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.67% (0.1157 => 0.1292, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.60% (0.5265 => 0.5876, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 11.57% (0.4062 => 0.4532, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.57% (0.3130 => 0.3492, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.44% (0.9199 => 1.0251, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 11.43% (1.0313 => 1.1492, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.39% (0.3899 => 0.4343, std.dev.: 0.0099) MultiSource/Applications/SPASS/SPASS: 11.39% (13.8202 => 15.3938, std.dev.: 0.0149) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.34% (0.7710 => 0.8584, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 11.33% (0.1589 => 0.1769, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.12% (0.3580 => 0.3978, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/power/power: 11.07% (0.1003 => 0.1114, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.05% (0.3022 => 0.3356, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 11.00% (0.3192 => 0.3543, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.94% (0.7460 => 0.8276, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 10.88% (1.1061 => 1.2264, std.dev.: 0.0020) SingleSource/Benchmarks/Stanford/Puzzle: 10.85% (0.0977 => 0.1083, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 10.81% (0.5818 => 0.6447, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.76% (0.4016 => 0.4448, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.72% (0.2127 => 0.2355, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.62% (0.3485 => 0.3855, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.59% (0.6135 => 0.6785, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/football/football: 10.59% (0.8310 => 0.9190, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.59% (0.8698 => 0.9619, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.58% (1.2193 => 1.3483, std.dev.: 0.0037) SingleSource/UnitTests/ObjC++/Hello: 10.54% (0.5748 => 0.6354, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 10.53% (0.3220 => 0.3559, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 10.46% (16.6129 => 18.3510, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.45% (0.1569 => 0.1733, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 10.40% (0.7061 => 0.7795, std.dev.: 0.0024) SingleSource/Regression/C++/ofstream_ctor: 10.39% (0.2781 => 0.3070, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.35% (0.0995 => 0.1098, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.33% (0.1075 => 0.1186, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 10.31% (1.0594 => 1.1686, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 10.28% (3.1889 => 3.5167, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.20% (0.3756 => 0.4139, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.18% (0.2023 => 0.2229, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.17% (0.3489 => 0.3844, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.17% (0.3246 => 0.3576, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.16% (0.4390 => 0.4836, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 10.14% (0.3293 => 0.3627, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 10.13% (0.3868 => 0.4260, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.09% (0.5637 => 0.6206, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.08% (0.5577 => 0.6139, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.03% (0.2782 => 0.3061, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.98% (0.2966 => 0.3262, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 9.87% (0.2726 => 0.2995, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 9.83% (1.9270 => 2.1164, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 9.81% (4.6629 => 5.1204, std.dev.: 0.0034) MultiSource/Applications/siod/siod: 9.80% (2.1791 => 2.3926, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.78% (1.9828 => 2.1768, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.78% (0.4805 => 0.5275, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 9.76% (0.3453 => 0.3790, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.71% (0.3511 => 0.3852, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 9.66% (0.3107 => 0.3407, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 9.64% (0.2760 => 0.3026, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 9.62% (0.6744 => 0.7393, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.60% (0.2655 => 0.2910, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.60% (7.2180 => 7.9108, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary3: 9.59% (0.3149 => 0.3451, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.57% (4.9865 => 5.4636, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/fibo: 9.55% (0.2628 => 0.2879, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 9.52% (0.2690 => 0.2946, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 9.51% (0.3534 => 0.3870, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 9.45% (0.1111 => 0.1216, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.44% (0.2765 => 0.3026, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 9.43% (3.8646 => 4.2289, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hello: 9.40% (0.2607 => 0.2852, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 9.38% (0.2761 => 0.3020, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 9.36% (0.2937 => 0.3212, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 9.27% (0.1478 => 0.1615, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 9.14% (6.5754 => 7.1763, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 9.13% (0.2925 => 0.3192, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.06% (0.1865 => 0.2034, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 9.06% (0.7506 => 0.8186, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.05% (0.2696 => 0.2940, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.96% (0.1986 => 0.2164, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.96% (0.6576 => 0.7165, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.86% (0.1276 => 0.1389, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 8.80% (14.8535 => 16.1605, std.dev.: 0.0081) MultiSource/Benchmarks/Olden/em3d/em3d: 8.69% (0.1657 => 0.1801, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: 8.67% (0.2988 => 0.3247, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.60% (0.3755 => 0.4078, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 8.56% (0.2945 => 0.3197, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.55% (0.1789 => 0.1942, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.54% (0.3245 => 0.3522, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.44% (0.2914 => 0.3160, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.43% (1.3245 => 1.4362, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.36% (0.4379 => 0.4745, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.35% (0.2504 => 0.2713, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.19% (3.2742 => 3.5422, std.dev.: 0.0131) SingleSource/Benchmarks/Misc-C++/bigfib: 8.11% (0.6250 => 0.6757, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.04% (0.2140 => 0.2312, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 7.95% (0.3131 => 0.3380, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 7.82% (3.7467 => 4.0398, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.80% (0.1435 => 0.1547, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.41% (0.2321 => 0.2493, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 7.00% (1.2292 => 1.3153, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.86% (13.2842 => 14.1958, std.dev.: 0.0094) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.85% (0.9108 => 0.9732, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.85% (1.1333 => 1.2109, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/parameter-passing: 6.74% (0.4003 => 0.4273, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.57% (0.3914 => 0.4171, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.47% (0.3789 => 0.4034, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 6.42% (0.3940 => 0.4193, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 6.36% (0.3663 => 0.3896, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 6.34% (0.3578 => 0.3805, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 6.30% (1.2749 => 1.3552, std.dev.: 0.0183) SingleSource/UnitTests/ObjC/exceptions-4: 6.25% (0.3646 => 0.3874, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.16% (0.3601 => 0.3823, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.11% (0.3650 => 0.3873, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.08% (1.5188 => 1.6112, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 6.07% (0.3623 => 0.3843, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 5.97% (0.1777 => 0.1883, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.91% (2.1007 => 2.2248, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 5.84% (8.4961 => 8.9922, std.dev.: 0.0135) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.48% (4.4433 => 4.6868, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.41% (4.3801 => 4.6169, std.dev.: 0.0046) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.27% (6.2785 => 6.6096, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.26% (0.2243 => 0.2361, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 5.07% (16.2614 => 17.0859, std.dev.: 0.0055) MultiSource/Applications/ClamAV/clamscan: 4.68% (14.5298 => 15.2099, std.dev.: 0.0037) MultiSource/Applications/sgefa/sgefa: 3.47% (0.2995 => 0.3099, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 2.02% (33.2944 => 33.9654, std.dev.: 0.0156) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5164, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 26.57% (1.0895 => 1.3790, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 20.26% (1.8175 => 2.1858, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 18.04% (0.9996 => 1.1799, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: 11.05% (1.1560 => 1.2837, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.69% (3.6469 => 4.0368, std.dev.: 0.0024) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 10.56% (0.4867 => 0.5381, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 9.91% (2.8813 => 3.1667, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/ffbench: 8.63% (0.8273 => 0.8987, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 8.11% (3.1736 => 3.4311, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: 7.98% (3.4016 => 3.6730, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 7.53% (1.0640 => 1.1441, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.32% (1.7081 => 1.8331, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: 6.91% (0.4846 => 0.5181, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 6.10% (11.2619 => 11.9486, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.24% (7.9275 => 8.3429, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/mandel-2: 5.24% (1.2998 => 1.3679, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: 4.94% (1.9199 => 2.0147, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.65% (0.3139 => 0.3285, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.44% (0.2389 => 0.2495, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.32% (2.5629 => 2.6737, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.00% (1.9144 => 1.9910, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 3.83% (1.4298 => 1.4846, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.66% (13.3668 => 13.8565, std.dev.: 0.0259) SingleSource/Benchmarks/Misc/salsa20: 3.57% (7.4271 => 7.6919, std.dev.: 0.0065) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.52% (4.4062 => 4.5614, std.dev.: 0.0282) SingleSource/Benchmarks/McGill/queens: 3.27% (2.1753 => 2.2465, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 3.25% (6.6320 => 6.8477, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 3.15% (12.0921 => 12.4725, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-8: 2.99% (1.9863 => 2.0457) MultiSource/Benchmarks/mafft/pairlocalalign: 2.71% (28.2225 => 28.9879, std.dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: 2.49% (3.8177 => 3.9127, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: 2.42% (31.4682 => 32.2303, std.dev.: 0.0126) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.19% (0.9692 => 0.9904, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 2.08% (7.6086 => 7.7671, std.dev.: 0.0110) MultiSource/Applications/SPASS/SPASS: 2.05% (10.7476 => 10.9683, std.dev.: 0.0324) MultiSource/Benchmarks/PAQ8p/paq8p: 2.01% (84.4286 => 86.1264, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/oourafft: 1.82% (5.5130 => 5.6131, std.dev.: 0.0025) MultiSource/Applications/minisat/minisat: 1.59% (9.3358 => 9.4844, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0507, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5105, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1879, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 1.17% (12.4560 => 12.6019, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0273, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.04% (3.1071 => 3.1395, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.93% (0.2670 => 0.1417, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.62% (0.4657 => 0.3883, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -14.29% (0.0707 => 0.0606, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.98% (1.3819 => 1.2025, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.97% (1.3813 => 1.2022, std.dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) SingleSource/Benchmarks/McGill/chomp: -23.37% (1.2308 => 0.9432, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -21.47% (1.0460 => 0.8214, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.89% (0.2238 => 0.1972, std.dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -7.99% (2.6470 => 2.4356, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.65% (20.3410 => 18.9879, std.dev.: 0.2324) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -6.23% (1.2870 => 1.2068) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -6.17% (26.5159 => 24.8803, std.dev.: 0.0192) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.73% (0.3458 => 0.3260, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -5.41% (5.0168 => 4.7456, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.07% (1.3780 => 1.3081, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0015) MultiSource/Applications/siod/siod: -3.80% (3.2729 => 3.1485, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.69% (1.9762 => 1.9231, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4834, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.27% (1.7688 => 1.7287, std.dev.: 0.0011) MultiSource/Applications/aha/aha: -2.20% (3.1476 => 3.0785, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.09% (6.3560 => 6.2231, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.97% (0.6589 => 0.6459, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.61% (1.4326 => 1.4095, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/ReedSolomon: -1.13% (7.1097 => 7.0292, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2566, std.dev.: 0.0019) MultiSource/Applications/viterbi/viterbi: -1.06% (4.4810 => 4.4334, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 11 10:39:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 11 Oct 2012 12:39:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121011173905.809452A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4797?compare_to=4795&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4797, Order: 165714, Start Time: 2012-10-11 16:20:38, End Time: 2012-10-11 17:40:54 To: 4795, Order: 165713, Start Time: 2012-10-11 13:36:39, End Time: 2012-10-11 14:56:43 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 3 (166 on baseline) Performance Improvements: 1 (44 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 949 (677 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.23% (3.6725 => 3.7177, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.21% (3.6656 => 3.7098, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/UnitTests/Vector/multiplies: 1.30% (2.4138 => 2.4453, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -6.14% (12.8500 => 12.0611, std.dev.: 0.0097) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.31% (0.5878 => 0.5860, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: -0.11% (16.2958 => 16.2776, std.dev.: 0.0082) MultiSource/Benchmarks/Bullet/bullet: -0.17% (55.4491 => 55.3566, std.dev.: 0.0230) MultiSource/Benchmarks/MallocBench/gs/gs: -0.08% (4.3971 => 4.3936, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.22% (0.0459 => 0.0458) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.22% (0.0461 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.47% (0.0430 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.46% (0.0432 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0418 => 0.0418, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.47% (0.0422 => 0.0420) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.48% (0.0414 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0414 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.46% (0.0431 => 0.0429, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.46% (0.0433 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0425 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.70% (0.0428 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.72% (0.0416 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.48% (0.0418 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.47% (0.0423 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.47% (0.0424 => 0.0422, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0433 => 0.0433, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.23% (0.0435 => 0.0434, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.49% (0.0411 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.73% (0.0413 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.71% (0.0424 => 0.0421) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.71% (0.0425 => 0.0422, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.24% (0.0414 => 0.0413, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.48% (0.0416 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.74% (0.0407 => 0.0404, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.25% (0.0408 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.25% (0.0404 => 0.0403, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.25% (0.0406 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.45% (0.0442 => 0.0440, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.45% (0.0444 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.49% (0.0405 => 0.0403, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0405 => 0.0405, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.25% (0.0405 => 0.0404, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.49% (0.0407 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.72% (0.0414 => 0.0411, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.24% (0.0414 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.14% (1.2768 => 1.2750, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.07% (7.8508 => 7.8562, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.08% (0.7432 => 0.7438, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.28% (0.0354 => 0.0355, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: - (0.1466 => 0.1466, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.58% (0.0660 => 0.0677, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.47% (63.2438 => 55.3566, std.dev.: 0.0230) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 32.77% (14.1553 => 18.7936, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.03% (3.4629 => 5.6455, std.dev.: 0.0036) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14562.78% (0.0720 => 10.5572, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952000.00% (0.0001 => 9.9521, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 62.41% (0.2554 => 0.4148, std.dev.: 0.0025) MultiSource/Benchmarks/PAQ8p/paq8p: 46.91% (10.3673 => 15.2311, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/richards_benchmark: 38.84% (0.1622 => 0.2252, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/distray/distray: 33.24% (0.1056 => 0.1407, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 24.26% (1.7609 => 2.1881, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.16% (7.0540 => 8.4055, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops: 18.23% (0.1432 => 0.1693, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.22% (2.2022 => 2.5594, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.48% (0.0746 => 0.0854, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.12% (0.0871 => 0.0994) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.47% (0.1566 => 0.1777, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.16% (0.6675 => 0.7487, std.dev.: 0.0046) MultiSource/Applications/JM/ldecod/ldecod: 11.70% (10.4361 => 11.6575, std.dev.: 0.0100) MultiSource/Benchmarks/Olden/power/power: 11.11% (0.1440 => 0.1600, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.83% (0.5105 => 0.5658, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 10.50% (5.7591 => 6.3640, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.47% (0.4879 => 0.5390, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 10.45% (0.3282 => 0.3625, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.45% (0.3177 => 0.3509, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: 10.39% (0.1655 => 0.1827, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.34% (0.5020 => 0.5539, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 10.12% (0.7433 => 0.8185, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 9.79% (0.3473 => 0.3813, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.69% (1.5415 => 1.6908, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.65% (0.3543 => 0.3885, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.64% (0.3516 => 0.3855, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.64% (0.3497 => 0.3834, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.62% (0.3543 => 0.3884, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 9.61% (0.3423 => 0.3752, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 9.55% (3.3354 => 3.6540, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/synchronized: 9.55% (0.3561 => 0.3901, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 9.47% (0.3927 => 0.4299, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 9.42% (0.7115 => 0.7785, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 9.35% (0.3828 => 0.4186, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.34% (0.3694 => 0.4039, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.31% (0.3307 => 0.3615, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.29% (0.2271 => 0.2482, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 9.28% (0.1175 => 0.1284, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.26% (0.3886 => 0.4246, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 9.18% (1.5603 => 1.7035, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.11% (0.1625 => 0.1773, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.04% (0.2700 => 0.2944, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.03% (0.1584 => 0.1727, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.78% (0.6450 => 0.7016, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 8.77% (0.6456 => 0.7022, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.68% (0.1510 => 0.1641, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.66% (0.1236 => 0.1343, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.59% (0.2107 => 0.2288, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.50% (8.1363 => 8.8281, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.43% (0.8172 => 0.8861, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.38% (0.5860 => 0.6351, std.dev.: 0.0035) MultiSource/Applications/lua/lua: 8.37% (3.8723 => 4.1964, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.36% (0.8067 => 0.8741, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: 8.33% (1.1642 => 1.2612, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.23% (0.2758 => 0.2985, std.dev.: 0.0032) SingleSource/Benchmarks/Stanford/Puzzle: 8.20% (0.1268 => 0.1372, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.19% (0.5569 => 0.6025, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 8.15% (0.3422 => 0.3701, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.05% (0.3826 => 0.4134, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.00% (0.1438 => 0.1553, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.99% (0.2603 => 0.2811, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 7.98% (1.0722 => 1.1578) SingleSource/Benchmarks/Shootout-C++/moments: 7.98% (0.4048 => 0.4371, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 7.96% (0.1695 => 0.1830, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.92% (0.4103 => 0.4428, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.90% (4.2646 => 4.6016, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 7.88% (0.4289 => 0.4627, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.85% (0.4203 => 0.4533, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.84% (0.3865 => 0.4168, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 7.78% (0.1555 => 0.1676, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.77% (0.9765 => 1.0524, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 7.73% (9.4845 => 10.2179, std.dev.: 0.0102) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.68% (0.1940 => 0.2089, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.68% (0.5925 => 0.6380, std.dev.: 0.0086) SingleSource/UnitTests/ObjC++/property-reference-object: 7.58% (0.6030 => 0.6487, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.56% (1.3050 => 1.4037, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.56% (0.3650 => 0.3926, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 7.52% (0.3603 => 0.3874, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 7.51% (2.0273 => 2.1795, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.49% (0.4620 => 0.4966, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.41% (0.2065 => 0.2218, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 7.40% (0.2905 => 0.3120, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 7.38% (0.3387 => 0.3637, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.36% (0.4636 => 0.4977, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 7.31% (0.2831 => 0.3038, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 7.31% (21.9371 => 23.5397, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.30% (0.2891 => 0.3102, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.27% (0.3136 => 0.3364, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 7.22% (0.7835 => 0.8401, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 7.18% (0.7326 => 0.7852, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.17% (0.4615 => 0.4946, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 7.15% (0.8921 => 0.9559, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.15% (0.3441 => 0.3687, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 7.11% (0.3684 => 0.3946, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.09% (0.3232 => 0.3461, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.05% (0.3162 => 0.3385, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.05% (2.0665 => 2.2122, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.02% (0.1695 => 0.1814, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 6.98% (2.2969 => 2.4572, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary3: 6.94% (0.3283 => 0.3511, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.94% (7.9617 => 8.5141, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/except: 6.93% (0.2871 => 0.3070, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.86% (0.2756 => 0.2945, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.84% (0.5981 => 0.6390, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 6.83% (0.2725 => 0.2911, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 6.82% (0.3180 => 0.3397, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.82% (0.3052 => 0.3260, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.78% (0.2877 => 0.3072, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.78% (0.3379 => 0.3608, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.75% (0.2872 => 0.3066, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.71% (1.1840 => 1.2635, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.67% (0.2802 => 0.2989, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.66% (0.3121 => 0.3329, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hello: 6.63% (0.2714 => 0.2894, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.55% (0.2793 => 0.2976, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.40% (0.2266 => 0.2411, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/matrix: 6.33% (0.3098 => 0.3294, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.17% (1.1861 => 1.2593, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.95% (0.4064 => 0.4306, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.88% (0.1906 => 0.2018, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.70% (1.4186 => 1.4994, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.67% (0.8101 => 0.8560, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.53% (0.3131 => 0.3304, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 5.51% (0.2049 => 0.2162, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.38% (4.9449 => 5.2111, std.dev.: 0.0105) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.38% (5.0018 => 5.2709, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.32% (1.5859 => 1.6703, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 5.19% (1.2842 => 1.3508, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.09% (2.2024 => 2.3146, std.dev.: 0.0187) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.81% (14.3668 => 15.0578, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.49% (0.3427 => 0.3581, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 4.30% (17.1811 => 17.9206, std.dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.71% (1.1194 => 1.1497, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.60% (3.8922 => 3.9934, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 26.13% (1.1145 => 1.4057, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 18.48% (0.9957 => 1.1797, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 14.54% (3.1595 => 3.6188, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 12.33% (0.4808 => 0.5401, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.43% (3.6395 => 4.0554, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.75% (2.8904 => 3.2012, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: 9.81% (3.3453 => 3.6734, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.72% (1.1396 => 1.2504, std.dev.: 0.0018) SingleSource/Benchmarks/Stanford/Puzzle: 7.95% (0.1421 => 0.1534, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.81% (3.1578 => 3.3730, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 5.23% (6.5088 => 6.8491, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 4.60% (27.8444 => 29.1239, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 4.30% (0.4162 => 0.4341, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.10% (4.3882 => 4.5682, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 4.06% (9.1159 => 9.4861, std.dev.: 0.0297) MultiSource/Benchmarks/nbench/nbench: 3.59% (11.6436 => 12.0611, std.dev.: 0.0097) MultiSource/Applications/spiff/spiff: 3.45% (2.9346 => 3.0359, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.04% (13.4384 => 13.8469, std.dev.: 0.0482) MultiSource/Benchmarks/PAQ8p/paq8p: 2.96% (85.0658 => 87.5801, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/queens: 2.93% (2.1825 => 2.2465, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.79% (0.9540 => 0.9806, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.70% (4.2280 => 4.3421, std.dev.: 0.0073) SingleSource/Regression/C/uint64_to_float: 2.35% (0.5413 => 0.5540, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.33% (8.1563 => 8.3466, std.dev.: 0.0195) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.24% (1.7254 => 1.7640, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 2.01% (1.4460 => 1.4751, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.51% (6.6465 => 6.7469, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.46% (2.6546 => 2.6933, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.05% (6.6874 => 0.1303, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.25% (0.8651 => 0.1709, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.23% (5.2763 => 3.2590, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.97% (5.3855 => 3.7177, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.69% (5.3526 => 3.7098, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -14.66% (54.1659 => 46.2225, std.dev.: 0.0064) MultiSource/Benchmarks/FreeBench/mason/mason: -12.45% (0.0811 => 0.0710, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -12.45% (22.1758 => 19.4156, std.dev.: 0.0176) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.22% (2.9384 => 2.6382, std.dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -44.25% (0.0400 => 0.0223) SingleSource/Benchmarks/Misc/mandel: -33.37% (1.1492 => 0.7657, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: -25.57% (0.6962 => 0.5182, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -23.96% (1.2373 => 0.9408, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: -16.64% (1.6925 => 1.4109) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.93% (0.0998 => 0.0859, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -11.01% (1.5373 => 1.3680) MultiSource/Benchmarks/FreeBench/mason/mason: -10.09% (0.2161 => 0.1943, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.88% (4.8142 => 4.4832, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -6.72% (1.5835 => 1.4771, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -6.26% (5.0483 => 4.7323, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -6.23% (1.2870 => 1.2068) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.86% (0.3463 => 0.3260, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.19% (1.6805 => 1.5932, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -4.85% (19.9488 => 18.9811, std.dev.: 0.0785) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.82% (0.8614 => 0.8199, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.78% (1.8329 => 1.7452, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -4.21% (2.5528 => 2.4453, std.dev.: 0.0031) MultiSource/Applications/siod/siod: -3.79% (3.2827 => 3.1583, std.dev.: 0.0103) MultiSource/Applications/lua/lua: -3.70% (26.0924 => 25.1271, std.dev.: 0.0168) SingleSource/Benchmarks/Misc/fbench: -3.66% (2.2771 => 2.1938, std.dev.: 0.0036) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.10% (8.6802 => 8.4980, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.05% (2.7294 => 2.6735, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6813, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.57% (1.5660 => 1.5414, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.55% (1.3677 => 1.3465, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/power/power: -1.53% (1.1277 => 1.1105) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4211, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-8: -1.20% (1.8525 => 1.8303, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8561, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -1.01% (5.2636 => 5.2105, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.07% (0.5229 => 0.5860, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 8.59% (14.9895 => 16.2776, std.dev.: 0.0082) MultiSource/Benchmarks/MallocBench/gs/gs: 6.89% (4.1105 => 4.3936, std.dev.: 0.0097) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 15.41% (1.1048 => 1.2750, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.75% (7.1582 => 7.8562, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.54% (0.6222 => 0.7438, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35400.00% (0.0001 => 0.0355, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -1.28% (0.1485 => 0.1466, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.01% (0.2116 => 0.0677, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 11 10:43:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 11 Oct 2012 12:43:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121011174350.64F942A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4798?compare_to=4794&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4798, Order: 165713, Start Time: 2012-10-11 14:35:39, End Time: 2012-10-11 17:45:41 To: 4794, Order: 165710, Start Time: 2012-10-11 10:56:32, End Time: 2012-10-11 14:06:26 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (133 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1042 (757 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.63% (0.1063 => 0.1176, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.58% (0.3442 => 0.3806, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.56% (0.3465 => 0.3831, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.53% (0.3496 => 0.3864, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.48% (0.3446 => 0.3807, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.46% (0.3469 => 0.3832, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.44% (0.3488 => 0.3852, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/exceptions-3: 10.40% (0.3460 => 0.3820, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 10.36% (0.3650 => 0.4028, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.29% (0.3643 => 0.4018, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.07% (0.3724 => 0.4099, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 9.99% (1.5932 => 1.7524, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference-object: 9.02% (0.5889 => 0.6420, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/Hello: 8.91% (0.5826 => 0.6345, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.80% (0.2875 => 0.3128, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 8.62% (0.3004 => 0.3263, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.56% (0.2792 => 0.3031, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 8.55% (0.2750 => 0.2985, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 8.40% (0.2725 => 0.2954, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 8.36% (0.2714 => 0.2941, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.36% (0.2738 => 0.2967, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 8.32% (0.2823 => 0.3058, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.29% (0.3195 => 0.3460, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 8.29% (0.1218 => 0.1319, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 8.25% (0.2813 => 0.3045, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.24% (0.2729 => 0.2954, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.21% (0.2911 => 0.3150, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 8.20% (0.2780 => 0.3008, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 8.18% (0.4146 => 0.4485, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 8.17% (0.2803 => 0.3032, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 8.08% (0.3726 => 0.4027, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.08% (2.0673 => 2.2343, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/except: 8.08% (0.2811 => 0.3038, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 8.01% (0.3096 => 0.3344, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 7.97% (0.9909 => 1.0699, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary3: 7.93% (0.3267 => 0.3526, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.91% (0.3845 => 0.4149, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.83% (0.3258 => 0.3513, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.76% (0.3362 => 0.3623, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.75% (0.3060 => 0.3297, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 7.72% (0.1619 => 0.1744, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 7.71% (5.5417 => 5.9689, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.70% (0.4361 => 0.4697, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 7.69% (0.3678 => 0.3961, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 7.69% (0.3317 => 0.3572, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.69% (1.6211 => 1.7457, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: 7.65% (0.3348 => 0.3604, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.63% (0.7171 => 0.7718, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.62% (0.3124 => 0.3362, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.59% (0.3282 => 0.3531, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.59% (0.3625 => 0.3900, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 7.57% (0.4847 => 0.5214, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 7.53% (0.4251 => 0.4571, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 7.48% (0.3477 => 0.3737, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.36% (0.3981 => 0.4274, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.34% (0.3690 => 0.3961, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.31% (0.4994 => 0.5359, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.30% (0.4139 => 0.4441, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.28% (1.3152 => 1.4110, std.dev.: 0.0066) MultiSource/Applications/hbd/hbd: 7.27% (0.9697 => 1.0402, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.10% (0.5000 => 0.5355, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.98% (3.5627 => 3.8114, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.94% (0.2736 => 0.2926, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 6.82% (1.0781 => 1.1516, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.73% (0.1620 => 0.1729, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.73% (0.5026 => 0.5364, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.71% (0.6435 => 0.6867, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 6.70% (0.5012 => 0.5348, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.70% (0.2866 => 0.3058, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 6.68% (0.6634 => 0.7077, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.65% (0.2014 => 0.2148, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.59% (0.2566 => 0.2735, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.51% (0.3930 => 0.4186, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.50% (4.4195 => 4.7068, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.49% (0.5900 => 0.6283, std.dev.: 0.0043) MultiSource/Benchmarks/Bullet/bullet: 6.46% (23.5202 => 25.0397, std.dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.43% (0.2068 => 0.2201, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.43% (0.3903 => 0.4154, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.36% (0.3084 => 0.3280, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.35% (0.3890 => 0.4137, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.32% (0.2737 => 0.2910, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 6.32% (4.2109 => 4.4769, std.dev.: 0.0140) MultiSource/Benchmarks/MallocBench/gs/gs: 6.25% (1.8794 => 1.9969, std.dev.: 0.0047) MultiSource/Applications/minisat/minisat: 6.24% (0.3336 => 0.3544, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.17% (2.7292 => 2.8977, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.08% (0.3271 => 0.3470, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.03% (0.2969 => 0.3148, std.dev.: 0.0019) MultiSource/Applications/lua/lua: 5.96% (1.4269 => 1.5119, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: 5.91% (0.5546 => 0.5874, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 5.91% (0.4029 => 0.4267, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.89% (0.1968 => 0.2084, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.88% (0.2040 => 0.2160, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.85% (0.2103 => 0.2226, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.84% (0.4658 => 0.4930, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.83% (0.7426 => 0.7859, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 5.63% (2.1013 => 2.2195, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 5.62% (2.0346 => 2.1489, std.dev.: 0.0043) MultiSource/Applications/JM/lencod/lencod: 5.59% (4.6177 => 4.8757, std.dev.: 0.0045) MultiSource/Applications/JM/ldecod/ldecod: 5.45% (2.1653 => 2.2834, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.41% (0.5361 => 0.5651, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 5.40% (0.2075 => 0.2187, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 5.40% (0.2391 => 0.2520, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 5.17% (0.7875 => 0.8282, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.04% (11.6398 => 12.2268, std.dev.: 0.0205) MultiSource/Applications/lambda-0_1_3/lambda: 4.97% (0.3498 => 0.3672, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.94% (1.9694 => 2.0666, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.89% (1.9966 => 2.0943, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.87% (0.5584 => 0.5856, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 4.65% (0.2691 => 0.2816, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.30% (4.6926 => 4.8944, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.13% (0.4253 => 0.4386, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 2.98% (11.9555 => 12.3123, std.dev.: 0.0134) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6094, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6682, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary: 5.04% (0.2122 => 0.2229, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1683, std.dev.: 0.0817) SingleSource/Benchmarks/Misc/flops-2: 4.50% (1.8057 => 1.8870, std.dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/dry: 4.10% (14.0481 => 14.6242, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1907, std.dev.: 0.0095) MultiSource/Applications/viterbi/viterbi: 1.88% (46.6247 => 47.5015, std.dev.: 0.0034) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.80% (3.1722 => 3.2292, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2881, std.dev.: 0.0022) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5123, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5839, std.dev.: 0.0087) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.87% (2.4764 => 2.4300, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5687, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/ary2: -9.20% (0.2402 => 0.2181, std.dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9744, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8021, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8021, std.dev.: 0.0058) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7725, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.78% (0.6293 => 0.6118, std.dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/fldry: -2.54% (17.2379 => 16.8001, std.dev.: 0.0411) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.26% (41.7953 => 40.8505, std.dev.: 0.0107) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5715, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4957, std.dev.: 0.0060) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.13% (105.3826 => 104.1907, std.dev.: 0.0745) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0456, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 11 10:45:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 11 Oct 2012 12:45:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121011174528.754D82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4799?compare_to=4796&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4799, Order: 165714, Start Time: 2012-10-11 16:20:37, End Time: 2012-10-11 17:47:18 To: 4796, Order: 165713, Start Time: 2012-10-11 14:01:06, End Time: 2012-10-11 15:27:43 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (198 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1042 (672 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 45.43% (0.8818 => 1.2824, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 24.44% (2.0176 => 2.5108, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 18.04% (0.0826 => 0.0975, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.23% (0.1410 => 0.1653, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 16.54% (0.2243 => 0.2614, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.99% (0.0834 => 0.0959, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 14.75% (0.6283 => 0.7210, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.02% (0.1327 => 0.1513, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 13.75% (1.3693 => 1.5576, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.66% (0.1588 => 0.1805, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.63% (1.1364 => 1.2913, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/tsp/tsp: 13.62% (0.1013 => 0.1151, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.59% (0.1413 => 0.1605, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.34% (0.1072 => 0.1215, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 12.93% (0.7038 => 0.7948, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.92% (0.4791 => 0.5410, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.86% (0.0964 => 0.1088, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.83% (0.2721 => 0.3070, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.49% (1.4563 => 1.6382, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.29% (0.2596 => 0.2915, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash2: 12.25% (0.4328 => 0.4858, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 12.15% (0.1062 => 0.1191, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.97% (0.6959 => 0.7792, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 11.95% (3.6692 => 4.1078, std.dev.: 0.0158) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.93% (3.9660 => 4.4390, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.76% (0.9199 => 1.0281, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.73% (0.3130 => 0.3497, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 11.72% (1.0313 => 1.1522, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.70% (0.7710 => 0.8612, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.68% (0.5265 => 0.5880, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.58% (0.1157 => 0.1291, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 11.50% (13.8202 => 15.4102, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/hash: 11.50% (0.4062 => 0.4529, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 11.45% (0.1589 => 0.1771, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.39% (0.7460 => 0.8310, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.16% (0.3899 => 0.4334, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.15% (0.3580 => 0.3979, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.10% (0.2127 => 0.2363, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.99% (0.3022 => 0.3354, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 10.97% (0.1003 => 0.1113, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 10.87% (0.3192 => 0.3539, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.86% (0.6135 => 0.6801, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 10.78% (0.8310 => 0.9206, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.78% (0.4016 => 0.4449, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 10.78% (0.3220 => 0.3567, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 10.76% (0.7061 => 0.7821, std.dev.: 0.0028) MultiSource/Applications/Burg/burg: 10.75% (1.1061 => 1.2250, std.dev.: 0.0083) SingleSource/Benchmarks/Stanford/Puzzle: 10.75% (0.0977 => 0.1082, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.73% (0.8698 => 0.9631, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 10.73% (0.5818 => 0.6442, std.dev.: 0.0086) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.68% (0.4390 => 0.4859, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.64% (0.1569 => 0.1736, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.62% (1.2193 => 1.3488, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.62% (0.3485 => 0.3855, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.51% (0.5577 => 0.6163, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 10.46% (0.2781 => 0.3072, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.45% (0.0995 => 0.1099, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 10.44% (1.0594 => 1.1700, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 10.39% (16.6129 => 18.3394, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.38% (0.3756 => 0.4146, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 10.38% (3.1889 => 3.5200, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 10.37% (0.5748 => 0.6344, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.33% (0.1075 => 0.1186, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: 10.29% (0.3868 => 0.4266, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/lists: 10.26% (0.3293 => 0.3631, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.23% (0.3246 => 0.3578, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.21% (0.2782 => 0.3066, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.20% (0.3489 => 0.3845, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.15% (0.5637 => 0.6209, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.99% (0.4805 => 0.5285, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.99% (0.2023 => 0.2225, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 9.98% (0.2726 => 0.2998, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 9.89% (4.6629 => 5.1242, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/sieve: 9.88% (0.3453 => 0.3794, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 9.84% (2.1791 => 2.3936, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.81% (0.2966 => 0.3257, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.79% (1.9828 => 2.1769, std.dev.: 0.0036) MultiSource/Applications/treecc/treecc: 9.78% (1.9270 => 2.1155, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.69% (4.9865 => 5.4698, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.69% (7.2180 => 7.9173, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/ary: 9.69% (0.3107 => 0.3408, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.66% (0.3511 => 0.3850, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/lists1: 9.65% (0.3534 => 0.3875, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 9.64% (0.6744 => 0.7394, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 9.64% (0.2760 => 0.3026, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 9.59% (0.3149 => 0.3451, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 9.54% (0.1111 => 0.1217, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.53% (0.2655 => 0.2908, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 9.52% (3.8646 => 4.2327, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.51% (0.2765 => 0.3028, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 9.48% (0.2690 => 0.2945, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 9.47% (0.2937 => 0.3215, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 9.42% (0.2761 => 0.3021, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/fibo: 9.36% (0.2628 => 0.2874, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 9.36% (0.2607 => 0.2851, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 9.34% (0.1478 => 0.1616, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 9.24% (6.5754 => 7.1827, std.dev.: 0.0117) MultiSource/Benchmarks/McCat/09-vor/vor: 9.23% (0.2925 => 0.3195, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.16% (0.2696 => 0.2943, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.06% (0.1986 => 0.2166, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.06% (0.1865 => 0.2034, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.03% (0.6576 => 0.7170, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 8.98% (0.7506 => 0.8180, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 8.95% (14.8535 => 16.1832, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.78% (0.3245 => 0.3530, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 8.69% (0.2945 => 0.3201, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 8.67% (0.2988 => 0.3247, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.66% (0.3755 => 0.4080, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.62% (0.1276 => 0.1386, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.61% (0.1789 => 0.1943, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.55% (1.3245 => 1.4378, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.48% (0.2914 => 0.3161, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.43% (0.2504 => 0.2715, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.39% (3.2742 => 3.5488, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.31% (0.4379 => 0.4743, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/em3d/em3d: 8.21% (0.1657 => 0.1793, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.18% (0.2140 => 0.2315, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 8.13% (0.6250 => 0.6758, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 8.11% (0.3131 => 0.3385, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.87% (0.1435 => 0.1548, std.dev.: 0.0014) MultiSource/Applications/lua/lua: 7.83% (3.7467 => 4.0400, std.dev.: 0.0103) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.54% (0.2321 => 0.2496, std.dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 7.03% (1.2292 => 1.3156, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.02% (0.9108 => 0.9747, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.01% (1.1333 => 1.2128, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/parameter-passing: 6.99% (0.4003 => 0.4283, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.88% (13.2842 => 14.1986, std.dev.: 0.0242) SingleSource/UnitTests/ObjC/exceptions: 6.75% (0.3914 => 0.4178, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.55% (0.3940 => 0.4198, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 6.43% (0.3578 => 0.3808, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 6.41% (0.3601 => 0.3832, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.41% (0.3789 => 0.4032, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 6.37% (1.2749 => 1.3561, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-4: 6.36% (0.3646 => 0.3878, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.33% (0.3663 => 0.3895, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.30% (1.5188 => 1.6145, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.25% (0.3650 => 0.3878, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 6.18% (0.3623 => 0.3847, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 6.13% (0.1777 => 0.1886) MultiSource/Benchmarks/mafft/pairlocalalign: 5.99% (8.4961 => 9.0048, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.97% (2.1007 => 2.2262, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.64% (4.4433 => 4.6939, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.59% (4.3801 => 4.6251, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.29% (6.2785 => 6.6104, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.22% (0.2243 => 0.2360, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 5.20% (16.2614 => 17.1073, std.dev.: 0.0192) SingleSource/Benchmarks/Misc/oourafft: 5.03% (0.2008 => 0.2109, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 4.74% (14.5298 => 15.2184, std.dev.: 0.0120) MultiSource/Applications/sgefa/sgefa: 3.57% (0.2995 => 0.3102, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 2.08% (33.2944 => 33.9885, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 30.62% (5.7573 => 7.5203, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 26.57% (1.0895 => 1.3790, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 20.65% (1.8175 => 2.1928, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 18.02% (0.9996 => 1.1797, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/richards_benchmark: 11.05% (1.1560 => 1.2837, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.68% (3.6469 => 4.0364, std.dev.: 0.0060) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 10.56% (0.4867 => 0.5381, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 9.93% (2.8813 => 3.1675, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 8.62% (0.8273 => 0.8986, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 8.11% (3.1736 => 3.4310, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: 7.98% (3.4016 => 3.6730, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 7.62% (1.0640 => 1.1451, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.30% (1.7081 => 1.8328, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/puzzle: 6.97% (0.4846 => 0.5184, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 6.09% (11.2619 => 11.9483, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: 5.24% (1.2998 => 1.3679, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.23% (7.9275 => 8.3419, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-6: 5.10% (1.9199 => 2.0178, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.35% (0.2389 => 0.2493, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.32% (2.5629 => 2.6736, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.03% (1.9144 => 1.9915, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 3.74% (1.4298 => 1.4833, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.61% (13.3668 => 13.8496, std.dev.: 0.0248) SingleSource/Benchmarks/Misc/salsa20: 3.55% (7.4271 => 7.6904, std.dev.: 0.0029) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.42% (4.4062 => 4.5570, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/queens: 3.28% (2.1753 => 2.2466, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 3.24% (6.6320 => 6.8472, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.09% (12.0921 => 12.4656, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-8: 2.99% (1.9863 => 2.0457) MultiSource/Benchmarks/mafft/pairlocalalign: 2.72% (28.2225 => 28.9906, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 2.48% (3.8177 => 3.9125, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 2.45% (31.4682 => 32.2389, std.dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.20% (0.9692 => 0.9905) MultiSource/Applications/SPASS/SPASS: 2.09% (10.7476 => 10.9723, std.dev.: 0.0163) MultiSource/Applications/JM/lencod/lencod: 2.09% (7.6086 => 7.7675, std.dev.: 0.0035) MultiSource/Benchmarks/PAQ8p/paq8p: 2.03% (84.4286 => 86.1394, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/oourafft: 1.79% (5.5130 => 5.6118, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5110, std.dev.: 0.0082) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1870, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists: 1.13% (12.4560 => 12.5971, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0270, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.04% (3.1071 => 3.1393, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.97% (0.2670 => 0.1416, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.36% (0.4657 => 0.3895, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/mason/mason: -14.29% (0.0707 => 0.0606, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.96% (1.3813 => 1.2023, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.89% (1.3819 => 1.2038, std.dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) SingleSource/Benchmarks/McGill/chomp: -23.47% (1.2308 => 0.9419, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -21.48% (1.0460 => 0.8213, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.44% (0.0997 => 0.0863, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -12.02% (0.2238 => 0.1969, std.dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: -7.49% (2.6470 => 2.4488, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.43% (20.3410 => 19.0334, std.dev.: 0.0935) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -6.23% (1.2870 => 1.2068) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -6.18% (26.5159 => 24.8772, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.73% (0.3458 => 0.3260) MultiSource/Benchmarks/sim/sim: -5.41% (5.0168 => 4.7454, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.30% (1.3780 => 1.3050, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.80% (3.2729 => 3.1485, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/bh/bh: -2.72% (1.9762 => 1.9225, std.dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4835, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.30% (1.7688 => 1.7282, std.dev.: 0.0057) MultiSource/Applications/aha/aha: -2.18% (3.1476 => 3.0790, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.01% (6.3560 => 6.2280, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.61% (1.4326 => 1.4095, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8674, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/ReedSolomon: -1.13% (7.1097 => 7.0293, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2580, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 11 13:17:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 11 Oct 2012 15:17:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121011201712.AFA422A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4800?compare_to=4797&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4800, Order: 165731, Start Time: 2012-10-11 18:58:47, End Time: 2012-10-11 20:19:02 To: 4797, Order: 165714, Start Time: 2012-10-11 16:20:38, End Time: 2012-10-11 17:40:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (166 on baseline) Performance Improvements: 2 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 950 (678 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 10.35% (0.3970 => 0.4381, std.dev.: 0.0127) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.10% (2.2122 => 2.1879, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.10% (3.8560 => 3.7751, std.dev.: 0.0121) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.20% (0.5860 => 0.5872, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 0.17% (16.2776 => 16.3055, std.dev.: 0.0207) MultiSource/Benchmarks/Bullet/bullet: 0.15% (55.3566 => 55.4370, std.dev.: 0.0184) MultiSource/Benchmarks/MallocBench/gs/gs: 0.31% (4.3936 => 4.4074, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.31% (0.0458 => 0.0464, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.30% (0.0460 => 0.0466, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.17% (0.0428 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.40% (0.0430 => 0.0436) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.20% (0.0418 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.43% (0.0420 => 0.0426, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.21% (0.0412 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.97% (0.0414 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.40% (0.0429 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.39% (0.0431 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.18% (0.0425 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.41% (0.0425 => 0.0431) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.45% (0.0413 => 0.0419) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.20% (0.0416 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.43% (0.0421 => 0.0427, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.42% (0.0422 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.15% (0.0433 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.15% (0.0434 => 0.0439, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.22% (0.0409 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.46% (0.0410 => 0.0416) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.43% (0.0421 => 0.0427, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.42% (0.0422 => 0.0428, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.21% (0.0413 => 0.0418) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.21% (0.0414 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.49% (0.0404 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.98% (0.0407 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.49% (0.0403 => 0.0409) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.23% (0.0405 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.36% (0.0440 => 0.0446, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.13% (0.0442 => 0.0447) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.24% (0.0403 => 0.0408) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.99% (0.0405 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.24% (0.0404 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.48% (0.0405 => 0.0411, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.22% (0.0411 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.21% (0.0413 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.09% (1.2750 => 1.2762, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.03% (7.8562 => 7.8588, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.36% (0.7438 => 0.7411, std.dev.: 0.0042) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0355 => 0.0355, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: - (0.1466 => 0.1466, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.25% (0.0677 => 0.0655, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.34% (63.2438 => 55.4370, std.dev.: 0.0184) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 33.16% (14.1553 => 18.8493, std.dev.: 0.0137) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.31% (3.4629 => 5.6552, std.dev.: 0.0063) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14557.64% (0.0720 => 10.5535, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952400.00% (0.0001 => 9.9525, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.59% (0.2554 => 0.4178, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 46.08% (10.3673 => 15.1445, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/richards_benchmark: 38.35% (0.1622 => 0.2244, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 33.33% (0.1056 => 0.1408, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 23.82% (1.7609 => 2.1803, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.82% (7.0540 => 8.3815, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops: 18.09% (0.1432 => 0.1691, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.21% (2.2022 => 2.5592, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.61% (0.0746 => 0.0855, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.24% (0.0871 => 0.0995, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.35% (0.1566 => 0.1775, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.10% (0.6675 => 0.7483, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 11.32% (0.1440 => 0.1603) SingleSource/UnitTests/ObjC/trivial-interface: 11.32% (0.3473 => 0.3866, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.18% (0.3543 => 0.3939, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.15% (0.3543 => 0.3938, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.12% (0.3516 => 0.3907, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.12% (0.3561 => 0.3957, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.10% (0.3497 => 0.3885, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 11.00% (10.4361 => 11.5836, std.dev.: 0.0170) SingleSource/UnitTests/ObjC/parameter-passing: 10.95% (0.3927 => 0.4357, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 10.85% (0.3282 => 0.3638, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions: 10.84% (0.3828 => 0.4243, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.83% (0.5105 => 0.5658, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/for-in: 10.75% (0.3694 => 0.4091, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 10.73% (5.7591 => 6.3768, std.dev.: 0.0097) SingleSource/UnitTests/ObjC/property: 10.71% (0.3886 => 0.4302, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 10.45% (0.1655 => 0.1828, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.43% (0.4879 => 0.5388, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.22% (0.5020 => 0.5533, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.10% (0.3177 => 0.3498, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 10.02% (0.7433 => 0.8178, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 10.02% (0.3423 => 0.3766, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.83% (1.5415 => 1.6930, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 9.79% (0.1175 => 0.1290, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 9.70% (3.3354 => 3.6590, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.69% (0.2271 => 0.2491, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.42% (0.1625 => 0.1778, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 9.36% (0.7115 => 0.7781, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.22% (0.1236 => 0.1350, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.22% (0.2700 => 0.2949, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.22% (0.1584 => 0.1730, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.19% (0.3307 => 0.3611, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.11% (0.2107 => 0.2299, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.94% (0.1510 => 0.1645, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 8.94% (0.1555 => 0.1694, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.91% (8.1363 => 8.8612, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.90% (0.6450 => 0.7024, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.84% (0.8172 => 0.8894, std.dev.: 0.0054) MultiSource/Applications/Burg/burg: 8.80% (1.1642 => 1.2667, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.77% (0.2758 => 0.3000, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/em3d/em3d: 8.73% (0.1695 => 0.1843, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.69% (0.8067 => 0.8768, std.dev.: 0.0057) MultiSource/Applications/hbd/hbd: 8.67% (1.5603 => 1.6955, std.dev.: 0.0022) MultiSource/Applications/lua/lua: 8.66% (3.8723 => 4.2076, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.66% (0.5569 => 0.6051, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.62% (0.5860 => 0.6365, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.38% (0.2065 => 0.2238, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.34% (0.1438 => 0.1558) SingleSource/Benchmarks/Stanford/Puzzle: 8.28% (0.1268 => 0.1373, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.23% (0.6030 => 0.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 8.19% (0.6456 => 0.6985, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.18% (0.2603 => 0.2816, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.14% (4.2646 => 4.6117, std.dev.: 0.0107) SingleSource/UnitTests/ObjC++/Hello: 8.14% (0.5925 => 0.6407, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.04% (0.1940 => 0.2096, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.03% (0.9765 => 1.0549, std.dev.: 0.0058) MultiSource/Applications/lemon/lemon: 7.92% (1.0722 => 1.1571, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 7.84% (2.0273 => 2.1863, std.dev.: 0.0023) MultiSource/Applications/spiff/spiff: 7.80% (0.7835 => 0.8446, std.dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 7.76% (9.4845 => 10.2209, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.67% (1.3050 => 1.4051, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.65% (0.4615 => 0.4968, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 7.50% (0.3387 => 0.3641, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.50% (0.3441 => 0.3699, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.48% (0.7326 => 0.7874, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.32% (0.1695 => 0.1819, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.29% (0.4103 => 0.4402, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 7.26% (0.3180 => 0.3411, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 7.22% (0.8921 => 0.9565, std.dev.: 0.0025) MultiSource/Applications/siod/siod: 7.21% (2.2969 => 2.4626, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.19% (0.5981 => 0.6411, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.18% (7.9617 => 8.5332, std.dev.: 0.0048) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.08% (0.3121 => 0.3342, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.07% (0.4203 => 0.4500, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.99% (0.4289 => 0.4589, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.98% (0.3826 => 0.4093, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 6.94% (0.4048 => 0.4329, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.91% (0.3865 => 0.4132, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 6.90% (0.3422 => 0.3658, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.73% (0.4636 => 0.4948, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 6.71% (1.1840 => 1.2635, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (0.4620 => 0.4927, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.55% (0.3650 => 0.3889, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 6.45% (21.9371 => 23.3528, std.dev.: 0.0102) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.43% (1.1861 => 1.2624, std.dev.: 0.0094) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.35% (0.1906 => 0.2027, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 6.27% (0.3603 => 0.3829, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.22% (0.2266 => 0.2407, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.22% (0.3136 => 0.3331, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.16% (0.2905 => 0.3084, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.12% (0.2891 => 0.3068, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.10% (0.3162 => 0.3355, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.10% (0.8101 => 0.8595, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 6.05% (0.3684 => 0.3907, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.87% (2.0665 => 2.1879, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.84% (1.4186 => 1.5014, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 5.79% (0.2831 => 0.2995, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.73% (0.3052 => 0.3227, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.67% (5.0018 => 5.2854, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.64% (4.9449 => 5.2237, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 5.63% (0.3232 => 0.3414, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.60% (0.3283 => 0.3467, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.59% (0.2756 => 0.2910, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 5.58% (0.2725 => 0.2877, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.53% (0.2877 => 0.3036, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.50% (0.2871 => 0.3029, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 5.50% (0.2802 => 0.2956, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.47% (1.5859 => 1.6726, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.47% (0.2872 => 0.3029, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.44% (0.2793 => 0.2945, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.33% (0.3379 => 0.3559, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 5.31% (0.2714 => 0.2858, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.20% (0.3098 => 0.3259, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.19% (2.2024 => 2.3167, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.17% (0.4064 => 0.4274, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 5.08% (0.2049 => 0.2153, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.62% (14.3668 => 15.0312, std.dev.: 0.0177) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.55% (0.3427 => 0.3583, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.42% (1.2842 => 1.3409, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 4.38% (0.3131 => 0.3268, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 4.22% (17.1811 => 17.9061, std.dev.: 0.0060) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.54% (0.3817 => 0.3952, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.83% (1.1194 => 1.1511, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.67% (3.8922 => 3.9963, std.dev.: 0.0230) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 26.13% (1.1145 => 1.4057, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 18.48% (0.9957 => 1.1797, std.dev.: 0.0014) MultiSource/Applications/aha/aha: 14.58% (3.1595 => 3.6202, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 12.31% (0.4808 => 0.5400, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.42% (3.6395 => 4.0552, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8904 => 3.2024, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9648, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.91% (1.1396 => 1.2525, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: 9.80% (3.3453 => 3.6731, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 7.95% (0.1421 => 0.1534) SingleSource/Benchmarks/Shootout-C++/hash2: 6.82% (3.1578 => 3.3733, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 5.20% (6.5088 => 6.8471, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 4.59% (27.8444 => 29.1229, std.dev.: 0.0024) MultiSource/Benchmarks/BitBench/drop3/drop3: 4.30% (0.4162 => 0.4341, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.13% (4.3882 => 4.5696, std.dev.: 0.0280) MultiSource/Applications/minisat/minisat: 4.11% (9.1159 => 9.4909, std.dev.: 0.0056) MultiSource/Applications/spiff/spiff: 3.33% (2.9346 => 3.0323, std.dev.: 0.0027) MultiSource/Benchmarks/PAQ8p/paq8p: 2.95% (85.0658 => 87.5719, std.dev.: 0.0063) SingleSource/Benchmarks/McGill/queens: 2.93% (2.1825 => 2.2465, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.92% (13.4384 => 13.8307, std.dev.: 0.0121) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.80% (0.9540 => 0.9807, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.67% (4.2280 => 4.3410, std.dev.: 0.0025) SingleSource/Regression/C/uint64_to_float: 2.35% (0.5413 => 0.5540, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.28% (8.1563 => 8.3420, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.23% (1.7254 => 1.7639, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.98% (1.4460 => 1.4746, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 1.50% (6.6465 => 6.7461, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.45% (2.6546 => 2.6930, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.05% (6.6874 => 0.1305, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.12% (0.8651 => 0.1720, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.34% (5.2763 => 3.2532, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.11% (5.3855 => 3.7100, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.85% (5.3526 => 3.7013, std.dev.: 0.0028) SingleSource/UnitTests/Vector/constpool: -14.68% (54.1659 => 46.2130, std.dev.: 0.0281) MultiSource/Applications/ClamAV/clamscan: -12.34% (22.1758 => 19.4392, std.dev.: 0.0165) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.41% (2.9384 => 2.6325, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -44.25% (0.0400 => 0.0223) SingleSource/Benchmarks/Misc/mandel: -33.36% (1.1492 => 0.7658, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/puzzle: -25.55% (0.6962 => 0.5183, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -23.88% (1.2373 => 0.9418, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-6: -16.71% (1.6925 => 1.4096, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.13% (0.0998 => 0.0857, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -11.02% (1.5373 => 1.3679, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -10.04% (0.2161 => 0.1944, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -6.93% (1.5835 => 1.4737, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.88% (4.8142 => 4.4832, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -6.26% (5.0483 => 4.7323) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -6.23% (1.2870 => 1.2068) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.89% (0.3463 => 0.3259, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.18% (1.6805 => 1.5935, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.89% (1.8329 => 1.7432, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.82% (0.8614 => 0.8199, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -4.65% (19.9488 => 19.0216, std.dev.: 0.0864) SingleSource/UnitTests/Vector/multiplies: -4.08% (2.5528 => 2.4487, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.80% (3.2827 => 3.1581, std.dev.: 0.0006) MultiSource/Applications/lua/lua: -3.71% (26.0924 => 25.1234, std.dev.: 0.0251) SingleSource/Benchmarks/Misc/fbench: -3.62% (2.2771 => 2.1946, std.dev.: 0.0015) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.04% (2.7294 => 2.6738, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.00% (8.6802 => 8.5068, std.dev.: 0.0140) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6827, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.57% (1.5660 => 1.5414, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: -1.53% (1.1277 => 1.1104, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4177, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.30% (1.3677 => 1.3499, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-8: -1.21% (1.8525 => 1.8301, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: -1.08% (5.2636 => 5.2067, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8584, std.dev.: 0.0098) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.30% (0.5229 => 0.5872, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 8.78% (14.9895 => 16.3055, std.dev.: 0.0207) MultiSource/Benchmarks/MallocBench/gs/gs: 7.22% (4.1105 => 4.4074, std.dev.: 0.0071) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 15.51% (1.1048 => 1.2762, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.79% (7.1582 => 7.8588, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.11% (0.6222 => 0.7411, std.dev.: 0.0042) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35400.00% (0.0001 => 0.0355, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -1.28% (0.1485 => 0.1466, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.05% (0.2116 => 0.0655, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 11 13:23:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 11 Oct 2012 15:23:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121011202344.25CF42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4801?compare_to=4799&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4801, Order: 165731, Start Time: 2012-10-11 18:58:47, End Time: 2012-10-11 20:25:34 To: 4799, Order: 165714, Start Time: 2012-10-11 16:20:37, End Time: 2012-10-11 17:47:18 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (201 on baseline) Performance Improvements: 0 (34 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1041 (669 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.26% (53.9715 => 56.2697, std.dev.: 0.0658) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 44.91% (0.8818 => 1.2778, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 23.62% (2.0176 => 2.4941, std.dev.: 0.0129) SingleSource/Benchmarks/Misc/flops: 17.68% (0.0826 => 0.0972, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 17.16% (0.2243 => 0.2628, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.88% (0.1410 => 0.1648, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 15.77% (0.0653 => 0.0756, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.87% (0.0834 => 0.0958) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 14.20% (0.6283 => 0.7175, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 14.02% (0.1013 => 0.1155, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.71% (0.1072 => 0.1219, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 13.42% (1.3693 => 1.5530, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.41% (0.1588 => 0.1801, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.32% (1.1364 => 1.2878, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.31% (0.1413 => 0.1601, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.19% (0.1327 => 0.1502, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 13.02% (0.7038 => 0.7954, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.97% (0.0964 => 0.1089, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.90% (0.2721 => 0.3072, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.56% (0.2596 => 0.2922, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.54% (0.4791 => 0.5392, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.35% (0.7710 => 0.8662, std.dev.: 0.0038) MultiSource/Applications/aha/aha: 12.34% (0.1062 => 0.1193, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.26% (1.4563 => 1.6349, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash2: 12.06% (0.4328 => 0.4850, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 11.95% (3.6692 => 4.1075, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.94% (3.9660 => 4.4394, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.90% (0.3899 => 0.4363, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.86% (0.6959 => 0.7784, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.74% (0.5265 => 0.5883, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash: 11.64% (0.4062 => 0.4535, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.58% (0.1157 => 0.1291, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.47% (0.9199 => 1.0254, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/property-reference-object: 11.45% (0.5818 => 0.6484, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.40% (0.3580 => 0.3988, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 11.33% (0.1589 => 0.1769, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 11.27% (0.1003 => 0.1116, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.25% (0.3130 => 0.3482, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 11.16% (1.0313 => 1.1464, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 11.15% (0.7061 => 0.7848, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 11.10% (13.8202 => 15.3536, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 11.08% (0.3511 => 0.3900, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 11.06% (0.3192 => 0.3545, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.05% (0.2127 => 0.2362, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.02% (0.3022 => 0.3355, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 11.00% (0.5748 => 0.6380, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.99% (0.7460 => 0.8280, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.96% (0.3485 => 0.3867, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 10.94% (1.1061 => 1.2271, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.88% (0.1075 => 0.1192, std.dev.: 0.0017) SingleSource/Regression/C++/ofstream_ctor: 10.75% (0.2781 => 0.3080, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.66% (0.4390 => 0.4858, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.65% (0.0995 => 0.1101, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 10.65% (0.3220 => 0.3563, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.56% (0.6135 => 0.6783, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.55% (0.3489 => 0.3857, std.dev.: 0.0015) SingleSource/Benchmarks/Stanford/Puzzle: 10.54% (0.0977 => 0.1080, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.51% (0.4016 => 0.4438, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 10.50% (0.3868 => 0.4274, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.47% (1.2193 => 1.3470, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 10.42% (0.3293 => 0.3636, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 10.38% (16.6129 => 18.3381, std.dev.: 0.0129) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.36% (0.3756 => 0.4145, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 10.35% (0.1478 => 0.1631, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.34% (0.5637 => 0.6220, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.28% (0.2023 => 0.2231, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 10.25% (0.8310 => 0.9162, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.22% (0.8698 => 0.9587, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.21% (0.2782 => 0.3066, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 10.20% (3.1889 => 3.5141, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.18% (0.2966 => 0.3268, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.17% (0.5577 => 0.6144, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 10.16% (0.2726 => 0.3003, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.08% (1.9828 => 2.1826, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.02% (0.1986 => 0.2185, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.01% (0.3246 => 0.3571, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 10.01% (1.0594 => 1.1654, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/sieve: 9.99% (0.3453 => 0.3798, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.96% (7.2180 => 7.9367, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.94% (0.1569 => 0.1725, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 9.92% (4.6629 => 5.1253, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/methcall: 9.89% (0.2761 => 0.3034, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.83% (0.2655 => 0.2916, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 9.82% (0.2607 => 0.2863, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 9.82% (0.2760 => 0.3031, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 9.81% (0.2690 => 0.2954, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 9.75% (0.3107 => 0.3410, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/mst/mst: 9.72% (0.1111 => 0.1219, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 9.70% (0.2937 => 0.3222, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 9.69% (0.3149 => 0.3454, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 9.67% (0.2628 => 0.2882, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 9.66% (2.1791 => 2.3896, std.dev.: 0.0052) MultiSource/Applications/treecc/treecc: 9.60% (1.9270 => 2.1119, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: 9.57% (3.8646 => 4.2345, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.54% (0.1865 => 0.2043, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.51% (0.2765 => 0.3028, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.51% (0.4805 => 0.5262, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 9.48% (0.3534 => 0.3869, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 9.47% (0.2925 => 0.3202, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.42% (0.2696 => 0.2950, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 9.39% (0.6744 => 0.7377, std.dev.: 0.0090) MultiSource/Applications/spiff/spiff: 9.30% (0.7506 => 0.8204, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 9.28% (0.1789 => 0.1955, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.25% (0.1276 => 0.1394, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.20% (0.6576 => 0.7181, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 9.16% (6.5754 => 7.1775, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/objinst: 9.07% (0.2945 => 0.3212, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.00% (4.9865 => 5.4355, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 8.98% (14.8535 => 16.1873, std.dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.79% (0.2914 => 0.3170, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.79% (0.2140 => 0.2328, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.68% (0.3755 => 0.4081, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.65% (0.4379 => 0.4758, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.64% (1.3245 => 1.4389, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: 8.63% (0.2988 => 0.3246, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.42% (0.4003 => 0.4340, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.41% (0.3245 => 0.3518, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 8.39% (0.1657 => 0.1796, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 8.23% (0.3914 => 0.4236, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.16% (0.3578 => 0.3870, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.15% (0.2504 => 0.2708, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 8.10% (0.3940 => 0.4259, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 8.08% (0.3601 => 0.3892, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-4: 8.06% (0.3646 => 0.3940, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.03% (3.2742 => 3.5371, std.dev.: 0.0130) SingleSource/UnitTests/ObjC/synchronized: 7.97% (0.3663 => 0.3955, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.97% (0.3789 => 0.4091, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 7.97% (0.6250 => 0.6748, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 7.95% (0.3131 => 0.3380, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.95% (0.3650 => 0.3940, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.87% (0.3623 => 0.3908, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.71% (0.2321 => 0.2500, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.67% (0.1435 => 0.1545, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 7.62% (3.7467 => 4.0323, std.dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: 7.29% (1.2292 => 1.3188, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.92% (1.1333 => 1.2117, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.87% (0.9108 => 0.9734, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.73% (13.2842 => 14.1776, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 6.17% (8.4961 => 9.0199, std.dev.: 0.0151) MultiSource/Applications/SIBsim4/SIBsim4: 6.13% (1.2749 => 1.3530, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.90% (6.2785 => 6.6491, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.68% (4.3801 => 4.6290, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.67% (4.4433 => 4.6952, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.66% (1.5188 => 1.6047, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/ReedSolomon: 5.63% (0.1777 => 0.1877, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.54% (2.1007 => 2.2170, std.dev.: 0.0185) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.17% (0.2243 => 0.2359, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 4.74% (16.2614 => 17.0316, std.dev.: 0.0081) MultiSource/Applications/ClamAV/clamscan: 4.57% (14.5298 => 15.1943, std.dev.: 0.0066) MultiSource/Applications/sgefa/sgefa: 3.37% (0.2995 => 0.3096, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 2.23% (33.2944 => 34.0356, std.dev.: 0.0201) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5160, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 26.54% (1.0895 => 1.3787, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 20.59% (1.8175 => 2.1918, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 18.03% (0.9996 => 1.1798, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/richards_benchmark: 11.03% (1.1560 => 1.2835, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.64% (3.6469 => 4.0348, std.dev.: 0.0041) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 10.54% (0.4867 => 0.5380, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 9.91% (2.8813 => 3.1669, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 8.59% (0.8273 => 0.8984, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 8.13% (3.1736 => 3.4317, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/fp-convert: 7.98% (3.4016 => 3.6730, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 7.55% (1.0640 => 1.1443, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.29% (1.7081 => 1.8326, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/puzzle: 6.93% (0.4846 => 0.5182, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 6.10% (11.2619 => 11.9484, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.24% (7.9275 => 8.3432, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/mandel-2: 5.24% (1.2998 => 1.3679, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: 5.11% (1.9199 => 2.0180, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9999, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.83% (0.2093 => 0.2194, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.48% (0.2389 => 0.2496, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.32% (2.5629 => 2.6736, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.00% (1.9144 => 1.9909, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 3.90% (1.4298 => 1.4855, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.57% (13.3668 => 13.8434, std.dev.: 0.0314) SingleSource/Benchmarks/Misc/salsa20: 3.50% (7.4271 => 7.6874, std.dev.: 0.0048) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.46% (4.4062 => 4.5587, std.dev.: 0.0321) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 3.29% (6.6320 => 6.8499, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 3.27% (2.1753 => 2.2465, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.16% (12.0921 => 12.4741, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: 2.99% (1.9863 => 2.0456, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 2.71% (28.2225 => 28.9874, std.dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: 2.49% (3.8177 => 3.9126, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 2.47% (31.4682 => 32.2454, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.19% (0.9692 => 0.9904, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 2.10% (10.7476 => 10.9737, std.dev.: 0.0686) MultiSource/Applications/JM/lencod/lencod: 2.05% (7.6086 => 7.7642, std.dev.: 0.0031) MultiSource/Benchmarks/PAQ8p/paq8p: 2.01% (84.4286 => 86.1230, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/oourafft: 1.84% (5.5130 => 5.6144, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.51% (9.3358 => 9.4771, std.dev.: 0.0199) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5098, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1879, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.23% (1.9433 => 1.9672, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.11% (12.4560 => 12.5944, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.10% (8.8259 => 8.9226, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0263, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (3.1071 => 3.1397, std.dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.74% (0.2670 => 0.1422, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.18% (0.4657 => 0.3950, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -14.29% (0.0707 => 0.0606, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.62% (1.3819 => 1.2075, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.50% (1.3813 => 1.2086, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) SingleSource/Benchmarks/McGill/chomp: -24.00% (1.2308 => 0.9354, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -21.49% (1.0460 => 0.8212, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.44% (0.0997 => 0.0863, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.89% (0.2238 => 0.1972, std.dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -7.61% (2.6470 => 2.4455, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -6.23% (1.2870 => 1.2068) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -6.12% (26.5159 => 24.8933, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.73% (0.3458 => 0.3260, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -5.49% (20.3410 => 19.2247, std.dev.: 0.0901) MultiSource/Benchmarks/sim/sim: -5.41% (5.0168 => 4.7455, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.64% (1.3780 => 1.3141, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0011) MultiSource/Applications/siod/siod: -3.82% (3.2729 => 3.1480, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.74% (1.9762 => 1.9220, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.42% (4.5947 => 4.4834, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.28% (1.7688 => 1.7284, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.20% (6.3560 => 6.2162, std.dev.: 0.0061) MultiSource/Applications/aha/aha: -2.18% (3.1476 => 3.0789, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.61% (1.4326 => 1.4096, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8655, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/ReedSolomon: -1.13% (7.1097 => 7.0293, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2574, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 11 15:06:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 11 Oct 2012 17:06:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121011220650.0E8662A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4802?compare_to=4800&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4802, Order: 165736, Start Time: 2012-10-11 20:48:19, End Time: 2012-10-11 22:08:39 To: 4800, Order: 165731, Start Time: 2012-10-11 18:58:47, End Time: 2012-10-11 20:19:02 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (165 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 952 (679 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.94% (82.1513 => 83.7446, std.dev.: 0.3899) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.19% (0.5872 => 0.5883, std.dev.: 0.0039) MultiSource/Applications/SPASS/SPASS: 0.07% (16.3055 => 16.3177, std.dev.: 0.0126) MultiSource/Benchmarks/Bullet/bullet: -0.04% (55.4370 => 55.4159, std.dev.: 0.0195) MultiSource/Benchmarks/MallocBench/gs/gs: 0.21% (4.4074 => 4.4167, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0464 => 0.0464, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0466 => 0.0466, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0433 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.23% (0.0436 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0423 => 0.0423, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.23% (0.0426 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0418 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0435 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0437 => 0.0437, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.23% (0.0430 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0431 => 0.0431) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0419 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0421 => 0.0421) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0427 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0428 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0438 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0439 => 0.0439, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0414 => 0.0414, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0416 => 0.0416, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.23% (0.0427 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0428 => 0.0428) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0418 => 0.0418) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0419 => 0.0419) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0410 => 0.0410) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.24% (0.0411 => 0.0412) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.24% (0.0409 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0410 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0446 => 0.0446) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0447 => 0.0447) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0408 => 0.0408) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0409 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.24% (0.0409 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.24% (0.0411 => 0.0410) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0416 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0418 => 0.0418) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.05% (1.2762 => 1.2755, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.08% (7.8588 => 7.8652, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.13% (0.7411 => 0.7401, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.56% (0.0355 => 0.0353, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: - (0.1466 => 0.1466) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.61% (0.0655 => 0.0659, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.38% (63.2438 => 55.4159, std.dev.: 0.0195) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 33.04% (14.1553 => 18.8328, std.dev.: 0.0204) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.38% (3.4629 => 5.6577, std.dev.: 0.0157) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14555.14% (0.0720 => 10.5517, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952300.00% (0.0001 => 9.9524, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.51% (0.2554 => 0.4176, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 46.08% (10.3673 => 15.1443, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/richards_benchmark: 38.35% (0.1622 => 0.2244, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/distray/distray: 33.33% (0.1056 => 0.1408, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 23.85% (1.7609 => 2.1808, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.77% (7.0540 => 8.3779, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: 18.09% (0.1432 => 0.1691, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.17% (2.2022 => 2.5583, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.61% (0.0746 => 0.0855, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.24% (0.0871 => 0.0995, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.47% (0.1566 => 0.1777, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.27% (0.6675 => 0.7494, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 11.39% (0.1440 => 0.1604, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.34% (0.3473 => 0.3867, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.18% (0.3497 => 0.3888, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.12% (0.3543 => 0.3937, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.12% (0.3543 => 0.3937, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.09% (0.3516 => 0.3906, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 11.05% (10.4361 => 11.5888, std.dev.: 0.0092) SingleSource/UnitTests/ObjC/synchronized: 11.04% (0.3561 => 0.3954, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.00% (0.3927 => 0.4359, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.93% (0.5105 => 0.5663, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 10.85% (0.3282 => 0.3638, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 10.74% (0.3828 => 0.4239, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 10.73% (5.7591 => 6.3768, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/for-in: 10.69% (0.3694 => 0.4089, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.60% (0.3886 => 0.4298, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 10.45% (0.1655 => 0.1828, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.39% (0.4879 => 0.5386, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.26% (0.5020 => 0.5535, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.10% (0.3177 => 0.3498, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 10.08% (0.7433 => 0.8182, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 9.93% (0.3423 => 0.3763, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.91% (1.5415 => 1.6942, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 9.72% (3.3354 => 3.6597, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/tsp/tsp: 9.70% (0.1175 => 0.1289, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.69% (0.2271 => 0.2491, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.60% (0.1625 => 0.1781, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 9.49% (0.7115 => 0.7790, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.31% (0.3307 => 0.3615, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.22% (0.2700 => 0.2949, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.22% (0.1584 => 0.1730, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.21% (0.2107 => 0.2301, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.14% (0.8172 => 0.8919, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.06% (0.1236 => 0.1348, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.01% (0.5860 => 0.6388, std.dev.: 0.0024) MultiSource/Applications/viterbi/viterbi: 8.94% (0.1555 => 0.1694, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.91% (0.6450 => 0.7025, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.87% (0.1510 => 0.1644, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.85% (8.1363 => 8.8562, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.77% (0.2758 => 0.3000, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.74% (0.5569 => 0.6056, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: 8.72% (1.1642 => 1.2657, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 8.63% (1.5603 => 1.6950, std.dev.: 0.0022) MultiSource/Applications/lua/lua: 8.62% (3.8723 => 4.2060, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.59% (0.8067 => 0.8760, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/em3d/em3d: 8.55% (0.1695 => 0.1840, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.40% (0.1940 => 0.2103, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 8.35% (0.6456 => 0.6995, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.28% (0.2065 => 0.2236, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 8.28% (0.1268 => 0.1373, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.28% (0.1438 => 0.1557, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.22% (0.2603 => 0.2817, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.22% (4.2646 => 4.6151, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: 8.14% (0.5925 => 0.6407, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.09% (0.6030 => 0.6518, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 7.99% (1.0722 => 1.1579, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.99% (0.9765 => 1.0545, std.dev.: 0.0026) MultiSource/Applications/treecc/treecc: 7.92% (2.0273 => 2.1878, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: 7.82% (0.7835 => 0.8448, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 7.81% (9.4845 => 10.2252, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.71% (0.4615 => 0.4971, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.67% (1.3050 => 1.4051, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.56% (0.3441 => 0.3701, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 7.44% (0.3387 => 0.3639, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 7.34% (0.7326 => 0.7864, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 7.26% (0.3180 => 0.3411, std.dev.: 0.0071) MultiSource/Applications/siod/siod: 7.24% (2.2969 => 2.4632, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.22% (0.5981 => 0.6413, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.18% (0.3121 => 0.3345, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 7.17% (0.8921 => 0.9561, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.07% (7.9617 => 8.5245, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.07% (0.4203 => 0.4500, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.04% (0.4103 => 0.4392, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.02% (0.4289 => 0.4590, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 7.02% (0.4048 => 0.4332, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.96% (0.3865 => 0.4134, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.90% (0.3826 => 0.4090, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.90% (0.3422 => 0.3658, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 6.77% (1.1840 => 1.2642, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.67% (0.4636 => 0.4945, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (0.4620 => 0.4927, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.55% (0.3650 => 0.3889, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 6.55% (21.9371 => 23.3735, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.40% (1.1861 => 1.2620, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.35% (0.1906 => 0.2027, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 6.30% (0.3603 => 0.3830, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 6.27% (0.2905 => 0.3087, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.22% (0.2266 => 0.2407, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.19% (0.3136 => 0.3330, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.12% (0.8101 => 0.8597, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.12% (0.2891 => 0.3068, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.08% (0.3684 => 0.3908, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.07% (0.3162 => 0.3354, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.94% (2.0665 => 2.1893, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.91% (1.4186 => 1.5024, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/strcat: 5.76% (0.2831 => 0.2994, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.75% (4.9449 => 5.2291, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.70% (5.0018 => 5.2868, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/except: 5.64% (0.2871 => 0.3033, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.56% (0.3379 => 0.3567, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.55% (0.2756 => 0.2909, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.54% (1.5859 => 1.6738, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 5.54% (0.3052 => 0.3221, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.54% (0.2872 => 0.3031, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 5.53% (0.2714 => 0.2864, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 5.51% (0.3232 => 0.3410, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.50% (0.2725 => 0.2875, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 5.46% (0.2877 => 0.3034, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.45% (0.3283 => 0.3462, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 5.32% (0.2802 => 0.2951, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.30% (0.2793 => 0.2941, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.30% (2.2024 => 2.3191, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: 5.17% (0.2049 => 0.2155, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.14% (0.4064 => 0.4273, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.10% (0.3098 => 0.3256, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.68% (14.3668 => 15.0395, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.61% (0.3427 => 0.3585, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 4.42% (1.2842 => 1.3409, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 4.38% (0.3131 => 0.3268, std.dev.: 0.0046) MultiSource/Applications/sqlite3/sqlite3: 4.27% (17.1811 => 17.9144, std.dev.: 0.0135) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.51% (0.3817 => 0.3951, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.92% (1.1194 => 1.1521, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.75% (3.8922 => 3.9993, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8953, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 26.14% (1.1145 => 1.4058, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 18.47% (0.9957 => 1.1796, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 14.57% (3.1595 => 3.6197, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 12.33% (0.4808 => 0.5401, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.44% (3.6395 => 4.0560, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.75% (2.8904 => 3.2012, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9648, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 10.00% (1.1396 => 1.2536, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: 9.80% (3.3453 => 3.6731, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 7.95% (0.1421 => 0.1534) SingleSource/Benchmarks/Shootout-C++/hash2: 6.81% (3.1578 => 3.3728, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 5.18% (6.5088 => 6.8461, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 4.59% (27.8444 => 29.1233, std.dev.: 0.0017) MultiSource/Benchmarks/BitBench/drop3/drop3: 4.30% (0.4162 => 0.4341, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 4.20% (9.1159 => 9.4988, std.dev.: 0.0082) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.99% (4.3882 => 4.5634, std.dev.: 0.0032) MultiSource/Applications/spiff/spiff: 3.35% (2.9346 => 3.0330, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.23% (13.4384 => 13.8729, std.dev.: 0.0202) MultiSource/Benchmarks/PAQ8p/paq8p: 2.96% (85.0658 => 87.5817, std.dev.: 0.0110) SingleSource/Benchmarks/McGill/queens: 2.93% (2.1825 => 2.2465, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.81% (4.2280 => 4.3469, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.76% (0.9540 => 0.9803, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.36% (8.1563 => 8.3484, std.dev.: 0.0059) SingleSource/Regression/C/uint64_to_float: 2.33% (0.5413 => 0.5539, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.22% (1.7254 => 1.7637, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 2.11% (1.4460 => 1.4765, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 1.48% (6.6465 => 6.7448, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.31% (2.6546 => 2.6894, std.dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.05% (6.6874 => 0.1305, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.12% (0.8651 => 0.1720, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.41% (5.2763 => 3.2497, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.19% (5.3855 => 3.7060, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.83% (5.3526 => 3.7022, std.dev.: 0.0080) SingleSource/UnitTests/Vector/constpool: -14.62% (54.1659 => 46.2463, std.dev.: 0.0143) MultiSource/Applications/ClamAV/clamscan: -12.40% (22.1758 => 19.4254, std.dev.: 0.0217) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.45% (2.9384 => 2.6312, std.dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -44.25% (0.0400 => 0.0223) SingleSource/Benchmarks/Misc/mandel: -33.44% (1.1492 => 0.7649, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: -25.57% (0.6962 => 0.5182, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -23.96% (1.2373 => 0.9408, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: -16.67% (1.6925 => 1.4104, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.53% (0.0998 => 0.0863, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -11.02% (1.5373 => 1.3679, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -10.00% (0.2161 => 0.1945, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -6.95% (1.5835 => 1.4735, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.87% (4.8142 => 4.4835) MultiSource/Benchmarks/sim/sim: -6.26% (5.0483 => 4.7322, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -6.23% (1.2870 => 1.2068) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.86% (0.3463 => 0.3260) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.21% (1.6805 => 1.5930, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.82% (0.8614 => 0.8199, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.80% (1.8329 => 1.7449, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -4.79% (19.9488 => 18.9924, std.dev.: 0.1616) SingleSource/UnitTests/Vector/multiplies: -4.08% (2.5528 => 2.4487, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.79% (3.2827 => 3.1584, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fbench: -3.74% (2.2771 => 2.1920, std.dev.: 0.0032) MultiSource/Applications/lua/lua: -3.70% (26.0924 => 25.1277, std.dev.: 0.0119) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.04% (8.6802 => 8.5028, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.04% (2.7294 => 2.6737, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6818, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.59% (1.3677 => 1.3459, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.56% (1.5660 => 1.5415, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: -1.53% (1.1277 => 1.1104, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -1.53% (9.5636 => 9.4177, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-8: -1.36% (1.8525 => 1.8273, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.17% (1.0313 => 1.0192, std.dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: -1.06% (5.2636 => 5.2076, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 12.51% (0.5229 => 0.5883, std.dev.: 0.0039) MultiSource/Applications/SPASS/SPASS: 8.86% (14.9895 => 16.3177, std.dev.: 0.0126) MultiSource/Benchmarks/MallocBench/gs/gs: 7.45% (4.1105 => 4.4167, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 15.45% (1.1048 => 1.2755, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.88% (7.1582 => 7.8652, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.95% (0.6222 => 0.7401, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35200.00% (0.0001 => 0.0353, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -1.28% (0.1485 => 0.1466) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.86% (0.2116 => 0.0659, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 11 16:55:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 11 Oct 2012 18:55:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121011235556.82B6E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4803?compare_to=4802&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4803, Order: 165753, Start Time: 2012-10-11 22:37:53, End Time: 2012-10-11 23:57:43 To: 4802, Order: 165736, Start Time: 2012-10-11 20:48:19, End Time: 2012-10-11 22:08:39 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 28 (166 on baseline) Performance Improvements: 36 (41 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 889 (680 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/05-eks/eks: 7.93% (0.4277 => 0.4616, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 6.73% (0.3195 => 0.3410, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.24% (5.2868 => 5.4583, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.17% (5.2291 => 5.3947, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.50% (1.6738 => 1.7156, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 2.45% (10.2252 => 10.4754, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.05% (0.4971 => 0.5073, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.95% (2.3191 => 2.3643, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.75% (8.5245 => 8.6734, std.dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference: 1.49% (0.7864 => 0.7981, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.44% (1.4051 => 1.4254, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.44% (3.9993 => 4.0567, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.43% (1.2620 => 1.2801, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.12% (4.6151 => 4.6669, std.dev.: 0.0047) MultiSource/Applications/kimwitu++/kc: 1.08% (18.8328 => 19.0357, std.dev.: 0.0107) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 34.39% (0.5182 => 0.6964, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 15.65% (0.9408 => 1.0880, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.20% (0.3260 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 6.65% (1.2068 => 1.2871) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.60% (28.3063 => 29.6075, std.dev.: 0.0575) SingleSource/Benchmarks/Misc/fbench: 4.37% (2.1920 => 2.2879, std.dev.: 0.0364) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.26% (0.8199 => 0.8548) MultiSource/Applications/lua/lua: 3.94% (25.1277 => 26.1172, std.dev.: 0.0115) SingleSource/UnitTests/Vector/multiplies: 2.69% (2.4487 => 2.5145, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 2.51% (1.4735 => 1.5105, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: 1.35% (4.7322 => 4.7963, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 1.30% (8.9783 => 9.0950, std.dev.: 0.0129) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.28% (3.4167 => 3.4605, std.dev.: 0.0055) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.75% (2.1808 => 1.9899, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.72% (0.7494 => 0.7365, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -1.49% (15.1443 => 14.9184, std.dev.: 0.0049) MultiSource/Applications/oggenc/oggenc: -1.09% (6.3768 => 6.3076, std.dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -19.01% (1.1796 => 0.9553, std.dev.: 0.0031) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -12.70% (0.5401 => 0.4715, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -10.35% (6.0616 => 5.4342, std.dev.: 0.0418) SingleSource/Benchmarks/Misc/fp-convert: -8.92% (3.6731 => 3.3454, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: -7.23% (4.0560 => 3.7627, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -5.75% (83.7446 => 78.9312, std.dev.: 1.0741) MultiSource/Benchmarks/mafft/pairlocalalign: -4.82% (29.1233 => 27.7185, std.dev.: 0.0018) MultiSource/Applications/aha/aha: -4.70% (3.6197 => 3.4496, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.41% (8.3484 => 7.9800, std.dev.: 0.0147) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -4.04% (6.8461 => 6.5692, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.68% (2.6737 => 2.5753, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.65% (18.9924 => 18.2994, std.dev.: 0.0119) SingleSource/Benchmarks/Misc/flops-8: -3.61% (1.8273 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.34% (4.5634 => 4.4111, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -3.30% (13.8729 => 13.4155, std.dev.: 0.0272) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -3.29% (1.5415 => 1.4908, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: -3.14% (9.4988 => 9.2001, std.dev.: 0.0122) MultiSource/Applications/hexxagon/hexxagon: -2.96% (12.4663 => 12.0975, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: -2.78% (1.4765 => 1.4355, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.71% (3.0330 => 2.9509, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.58% (32.3370 => 31.5022, std.dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: -2.50% (87.5817 => 85.3954, std.dev.: 0.0062) MultiSource/Applications/JM/lencod/lencod: -2.16% (10.5517 => 10.3237, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.15% (1.3459 => 1.3169, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: -2.11% (12.0675 => 11.8124, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.09% (1.7449 => 1.7084, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.07% (0.6607 => 0.6470, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/queens: -1.75% (2.2465 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.50% (1.4058 => 1.3847, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -1.37% (10.2344 => 10.0937, std.dev.: 0.0103) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.24% (0.9803 => 0.9681, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -1.11% (6.7448 => 6.6698, std.dev.: 0.0015) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 1.27% (0.5883 => 0.5958, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 0.91% (16.3177 => 16.4654, std.dev.: 0.0195) MultiSource/Benchmarks/Bullet/bullet: 0.18% (55.4159 => 55.5151, std.dev.: 0.0101) MultiSource/Benchmarks/MallocBench/gs/gs: 0.82% (4.4167 => 4.4528, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.65% (0.0464 => 0.0467, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.43% (0.0466 => 0.0468, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.92% (0.0433 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.69% (0.0435 => 0.0438) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.71% (0.0423 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.71% (0.0425 => 0.0428, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.72% (0.0417 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.72% (0.0418 => 0.0421, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.92% (0.0435 => 0.0439, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.46% (0.0437 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.70% (0.0429 => 0.0432, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.70% (0.0431 => 0.0434, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.72% (0.0419 => 0.0422, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.71% (0.0421 => 0.0424, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.70% (0.0427 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.70% (0.0428 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.68% (0.0438 => 0.0441, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.91% (0.0439 => 0.0443, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.72% (0.0414 => 0.0417, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.48% (0.0416 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.94% (0.0426 => 0.0430, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.47% (0.0428 => 0.0430, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.48% (0.0418 => 0.0420, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.48% (0.0419 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.73% (0.0410 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.49% (0.0412 => 0.0414) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.74% (0.0408 => 0.0411, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.73% (0.0410 => 0.0413, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.67% (0.0446 => 0.0449, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.67% (0.0447 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.74% (0.0408 => 0.0411, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.49% (0.0409 => 0.0411, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.74% (0.0408 => 0.0411, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.73% (0.0410 => 0.0413) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.72% (0.0416 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.72% (0.0418 => 0.0421) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.82% (1.2755 => 1.2650, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.07% (7.8652 => 7.8709, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.74% (0.7401 => 0.7456) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 2.83% (0.0353 => 0.0363, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -2.25% (0.1466 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.67% (0.0659 => 0.0670, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.22% (63.2438 => 55.5151, std.dev.: 0.0101) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.48% (14.1553 => 19.0357, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++-EH/spirit: 64.10% (3.4629 => 5.6825, std.dev.: 0.0167) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14238.47% (0.0720 => 10.3237, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952100.00% (0.0001 => 9.9522, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 64.10% (0.2554 => 0.4191, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 43.90% (10.3673 => 14.9184, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/richards_benchmark: 38.96% (0.1622 => 0.2254, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 34.00% (0.1056 => 0.1415, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 18.58% (0.1432 => 0.1698, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.15% (7.0540 => 8.3345, std.dev.: 0.0179) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.32% (2.2022 => 2.5837, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.52% (0.1566 => 0.1809, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.20% (0.0871 => 0.0986, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 13.01% (0.3282 => 0.3709, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.00% (1.7609 => 1.9899, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: 12.99% (0.1440 => 0.1627, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.11% (0.0834 => 0.0935, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 12.06% (0.1584 => 0.1775, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.04% (0.3473 => 0.3891, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.97% (0.3543 => 0.3967, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.89% (0.3927 => 0.4394, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.85% (0.3543 => 0.3963, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.81% (0.3497 => 0.3910, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.77% (0.3516 => 0.3930, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.77% (0.3561 => 0.3980, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.64% (0.1143 => 0.1276, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 11.55% (0.3886 => 0.4335, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 11.55% (10.4361 => 11.6415, std.dev.: 0.0085) SingleSource/UnitTests/ObjC/exceptions: 11.55% (0.3828 => 0.4270, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.53% (0.3694 => 0.4120, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 11.21% (0.7433 => 0.8266, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 10.79% (0.7115 => 0.7883, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.76% (0.4879 => 0.5404, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.65% (0.1625 => 0.1798, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.59% (0.2700 => 0.2986, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.50% (0.1438 => 0.1589, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 10.47% (0.1175 => 0.1298, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 10.45% (9.4845 => 10.4754, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.34% (0.6675 => 0.7365, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.26% (0.3177 => 0.3503, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 10.21% (0.1655 => 0.1824, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 10.09% (0.1695 => 0.1866, std.dev.: 0.0029) MultiSource/Applications/d/make_dparser: 9.99% (3.3354 => 3.6687, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.92% (0.4615 => 0.5073, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.85% (1.5415 => 1.6933, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/18-imp/imp: 9.79% (0.3423 => 0.3758, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 9.76% (0.5925 => 0.6503, std.dev.: 0.0027) MultiSource/Applications/sgefa/sgefa: 9.68% (0.3109 => 0.3410, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 9.55% (0.6030 => 0.6606, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.55% (0.1236 => 0.1354, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 9.52% (5.7591 => 6.3076, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.48% (0.5105 => 0.5589, std.dev.: 0.0038) MultiSource/Applications/aha/aha: 9.47% (0.1151 => 0.1260, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.45% (0.5860 => 0.6414, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.43% (4.2646 => 4.6669, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.37% (0.8172 => 0.8938, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/mst/mst: 9.37% (0.1163 => 0.1272, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.35% (0.2065 => 0.2258, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.34% (0.1510 => 0.1651, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.34% (0.2271 => 0.2483, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 9.31% (1.1642 => 1.2726, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.28% (0.1940 => 0.2120, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 9.26% (0.1555 => 0.1699, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 9.25% (1.5603 => 1.7046, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.25% (0.2758 => 0.3013, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.23% (1.3050 => 1.4254, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.16% (0.5569 => 0.6079, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.14% (8.1363 => 8.8796, std.dev.: 0.0114) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.13% (5.0018 => 5.4583, std.dev.: 0.0091) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.11% (0.2107 => 0.2299, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.10% (4.9449 => 5.3947, std.dev.: 0.0019) MultiSource/Applications/lua/lua: 9.09% (3.8723 => 4.2244, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.09% (0.8067 => 0.8800, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.07% (0.3121 => 0.3404, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.04% (0.1117 => 0.1218, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.97% (0.9765 => 1.0641, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 8.94% (0.7326 => 0.7981, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.94% (7.9617 => 8.6734, std.dev.: 0.0033) MultiSource/Applications/spiff/spiff: 8.86% (0.7835 => 0.8529, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.80% (0.3307 => 0.3598, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.75% (0.5020 => 0.5459, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 8.74% (0.6456 => 0.7020, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 8.57% (2.0273 => 2.2011, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 8.49% (1.0722 => 1.1632, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 8.47% (0.3387 => 0.3674, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.45% (0.1337 => 0.1450, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/health/health: 8.44% (0.1268 => 0.1375, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.34% (0.4103 => 0.4445, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 8.21% (0.3180 => 0.3441, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.18% (1.5859 => 1.7156, std.dev.: 0.0019) MultiSource/Applications/siod/siod: 8.08% (2.2969 => 2.4825, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.05% (0.3441 => 0.3718, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.99% (0.4203 => 0.4539, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.97% (0.3865 => 0.4173, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.93% (1.1861 => 1.2801, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.88% (0.4289 => 0.4627, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.83% (0.4636 => 0.4999, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 7.80% (0.3422 => 0.3689, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.73% (0.3650 => 0.3932, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.58% (0.3826 => 0.4116, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.57% (0.6450 => 0.6938, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 7.51% (21.9371 => 23.5835, std.dev.: 0.0089) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.49% (0.2603 => 0.2798, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/hash2: 7.42% (0.4620 => 0.4963, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 7.37% (0.4299 => 0.4616, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.35% (2.2024 => 2.3643, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 7.34% (0.4048 => 0.4345, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.33% (0.3136 => 0.3366, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 7.30% (0.2905 => 0.3117, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.29% (0.5981 => 0.6417, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 7.19% (0.8921 => 0.9562, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 7.13% (0.3603 => 0.3860, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.09% (0.2891 => 0.3096, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 7.08% (0.3684 => 0.3945, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.05% (0.3162 => 0.3385, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.98% (2.0665 => 2.2107, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/neural/neural: 6.97% (0.1463 => 0.1565, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.90% (0.1695 => 0.1812, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.83% (1.4186 => 1.5155, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/strcat: 6.75% (0.2831 => 0.3022, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.71% (0.3098 => 0.3306, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.71% (0.2756 => 0.2941, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.69% (0.2872 => 0.3064, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.65% (0.2871 => 0.3062, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 6.59% (1.1840 => 1.2620, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 6.53% (0.3232 => 0.3443, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.50% (0.1892 => 0.2015, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 6.50% (0.2877 => 0.3064, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.50% (0.2725 => 0.2902, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.49% (0.3283 => 0.3496, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.45% (0.3052 => 0.3249, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.45% (0.1906 => 0.2029, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.34% (0.2714 => 0.2886, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.34% (0.2793 => 0.2970, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/random: 6.32% (0.2802 => 0.2979, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.20% (0.4064 => 0.4316, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.05% (0.2266 => 0.2403, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.04% (0.3379 => 0.3583, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.86% (0.8101 => 0.8576, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.43% (0.3131 => 0.3301, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.35% (14.3668 => 15.1350, std.dev.: 0.0076) MultiSource/Applications/hexxagon/hexxagon: 5.11% (1.2842 => 1.3498, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 4.98% (0.2049 => 0.2151, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.61% (0.3427 => 0.3585, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 4.57% (17.1811 => 17.9664, std.dev.: 0.0228) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.44% (0.2430 => 0.2538, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.23% (3.8922 => 4.0567, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.14% (0.3817 => 0.3975, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/bh/bh: 3.36% (0.3092 => 0.3196, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.13% (1.1194 => 1.1544, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.81% (1.1396 => 1.2514, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 9.18% (3.1595 => 3.4496, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (3.1578 => 3.3678, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.39% (3.6395 => 3.7627, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.77% (4.2280 => 4.3451, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.34% (1.7254 => 1.7657, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (0.8275 => 0.8405, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.48% (0.9540 => 0.9681, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8124, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1314, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: -79.91% (0.8651 => 0.1738, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.99% (5.2763 => 3.2720, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.11% (5.3855 => 3.7101, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.85% (5.3526 => 3.7012, std.dev.: 0.0023) SingleSource/UnitTests/Vector/constpool: -14.67% (54.1659 => 46.2194, std.dev.: 0.0117) MultiSource/Applications/ClamAV/clamscan: -12.08% (22.1758 => 19.4969, std.dev.: 0.0164) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.30% (2.9384 => 2.6358, std.dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.42% (1.1492 => 0.7651, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.99% (1.6925 => 1.4219, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.73% (0.0998 => 0.0861, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -12.07% (1.2373 => 1.0880, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/mandel-2: -10.39% (1.5373 => 1.3776, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/mason/mason: -9.90% (0.2161 => 0.1947, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.27% (19.9488 => 18.2994, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.79% (1.8329 => 1.7084, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5753, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0167) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.31% (1.6805 => 1.5912, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7963, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.61% (1.5835 => 1.5105, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.06% (0.9957 => 0.9553, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.57% (3.2827 => 3.1654, std.dev.: 0.0136) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5022, std.dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: -3.01% (12.4730 => 12.0975, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.16% (8.1563 => 7.9800, std.dev.: 0.0147) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.14% (8.6802 => 8.4948, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/salsa20: -1.84% (10.2830 => 10.0937, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/flops: -1.69% (8.8334 => 8.6838, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091) SingleSource/UnitTests/Vector/multiplies: -1.50% (2.5528 => 2.5145, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4202, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: -1.09% (4.6441 => 4.5936, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.94% (0.5229 => 0.5958, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 9.85% (14.9895 => 16.4654, std.dev.: 0.0195) MultiSource/Benchmarks/MallocBench/gs/gs: 8.33% (4.1105 => 4.4528, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.50% (1.1048 => 1.2650, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.96% (7.1582 => 7.8709, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.83% (0.6222 => 0.7456) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36200.00% (0.0001 => 0.0363, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.34% (0.2116 => 0.0670, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 4.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 11 18:45:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 11 Oct 2012 20:45:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121012014501.4D09E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4804?compare_to=4803&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4804, Order: 165770, Start Time: 2012-10-12 00:27:09, End Time: 2012-10-12 01:46:51 To: 4803, Order: 165753, Start Time: 2012-10-11 22:37:53, End Time: 2012-10-11 23:57:43 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 3 (163 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 950 (681 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.38% (14.9184 => 15.1238, std.dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.65% (54.5501 => 56.5396, std.dev.: 0.0756) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.95% (1.2884 => 1.3135, std.dev.: 0.0038) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.17% (0.5958 => 0.5948, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: -0.07% (16.4654 => 16.4535, std.dev.: 0.0136) MultiSource/Benchmarks/Bullet/bullet: -0.46% (55.5151 => 55.2581, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/gs/gs: -0.26% (4.4528 => 4.4411, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.07% (0.0467 => 0.0462, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.85% (0.0468 => 0.0464) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.14% (0.0437 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.14% (0.0438 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.17% (0.0426 => 0.0421) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.17% (0.0428 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.19% (0.0420 => 0.0415) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.19% (0.0421 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.37% (0.0439 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.91% (0.0439 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.93% (0.0432 => 0.0428) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.15% (0.0434 => 0.0429, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -1.18% (0.0422 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.18% (0.0424 => 0.0419, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.16% (0.0430 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.16% (0.0431 => 0.0426) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.13% (0.0441 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.13% (0.0443 => 0.0438, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.96% (0.0417 => 0.0413) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.96% (0.0418 => 0.0414) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.40% (0.0430 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.93% (0.0430 => 0.0426) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.95% (0.0420 => 0.0416, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.95% (0.0421 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.97% (0.0413 => 0.0409) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -1.21% (0.0414 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -1.22% (0.0411 => 0.0406, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.97% (0.0413 => 0.0409) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.11% (0.0449 => 0.0444, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.11% (0.0450 => 0.0445, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -1.22% (0.0411 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.97% (0.0411 => 0.0407) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.97% (0.0411 => 0.0407) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.97% (0.0413 => 0.0409) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.95% (0.0419 => 0.0415) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.19% (0.0421 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.39% (1.2650 => 1.2601, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.09% (7.8709 => 7.8641, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.46% (0.7456 => 0.7422, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0363 => 0.0363, std.dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.28% (0.0670 => 0.0648, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.63% (63.2438 => 55.2581, std.dev.: 0.0028) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.11% (14.1553 => 18.9839, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.64% (3.4629 => 5.6666, std.dev.: 0.0172) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14226.94% (0.0720 => 10.3154, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952300.00% (0.0001 => 9.9524, std.dev.: 0.0021) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.27% (0.2554 => 0.4170, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 45.88% (10.3673 => 15.1238, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/richards_benchmark: 38.72% (0.1622 => 0.2250, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/distray/distray: 33.24% (0.1056 => 0.1407, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 18.09% (0.1432 => 0.1691, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.95% (7.0540 => 8.3205, std.dev.: 0.0174) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.82% (2.2022 => 2.5725, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.58% (0.1566 => 0.1810, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.09% (0.0871 => 0.0985, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.02% (1.7609 => 1.9902, std.dev.: 0.0091) MultiSource/Benchmarks/Olden/power/power: 12.57% (0.1440 => 0.1621, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 12.37% (0.3282 => 0.3688, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.87% (0.1584 => 0.1772, std.dev.: 0.0006) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.20% (0.1143 => 0.1271, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 11.05% (0.7433 => 0.8254, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 10.67% (10.4361 => 11.5497, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.57% (0.1438 => 0.1590, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 10.56% (0.7115 => 0.7866, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.39% (0.4879 => 0.5386, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.28% (0.6675 => 0.7361, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.28% (0.1625 => 0.1792, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.22% (0.3473 => 0.3828, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.19% (0.2700 => 0.2975, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.16% (0.3927 => 0.4326, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 10.14% (9.4845 => 10.4462, std.dev.: 0.0072) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.10% (0.3543 => 0.3901, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-4: 10.08% (0.3543 => 0.3900, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.07% (0.3497 => 0.3849, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 10.05% (0.3561 => 0.3919, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 10.01% (0.3516 => 0.3868, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.96% (0.3886 => 0.4273, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 9.93% (0.3828 => 0.4208, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 9.91% (0.1655 => 0.1819, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 9.87% (0.1175 => 0.1291, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.85% (0.3177 => 0.3490, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.83% (0.3694 => 0.4057, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 9.81% (0.3109 => 0.3414, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 9.77% (3.3354 => 3.6612, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.69% (1.5415 => 1.6909, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 9.58% (0.3423 => 0.3751, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 9.56% (0.1695 => 0.1857, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.43% (0.4615 => 0.5050, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.32% (0.5105 => 0.5581, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 9.30% (5.7591 => 6.2947, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.22% (0.1236 => 0.1350, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.21% (0.1151 => 0.1257, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.18% (0.5860 => 0.6398, std.dev.: 0.0070) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.13% (4.2646 => 4.6541, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.10% (1.3050 => 1.4237, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.01% (0.1510 => 0.1646, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.98% (0.2271 => 0.2475, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.98% (0.5569 => 0.6069, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.93% (0.8172 => 0.8902, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.92% (0.1940 => 0.2113, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 8.88% (1.1642 => 1.2676, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 8.86% (3.8723 => 4.2153, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.81% (0.8067 => 0.8778, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.79% (0.5925 => 0.6446, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.78% (5.0018 => 5.4410, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.78% (0.2107 => 0.2292, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 8.77% (0.1163 => 0.1265) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.70% (0.2758 => 0.2998, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.69% (0.6030 => 0.6554, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.68% (4.9449 => 5.3743, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 8.68% (0.1555 => 0.1690, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.66% (8.1363 => 8.8413, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.66% (0.9765 => 1.0611, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.62% (0.2065 => 0.2243, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 8.59% (1.5603 => 1.6943, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.55% (0.5020 => 0.5449, std.dev.: 0.0083) MultiSource/Applications/spiff/spiff: 8.50% (0.7835 => 0.8501, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.50% (0.3307 => 0.3588, std.dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.46% (0.3121 => 0.3385, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.45% (7.9617 => 8.6347, std.dev.: 0.0050) MultiSource/Applications/lemon/lemon: 8.43% (1.0722 => 1.1626, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 8.30% (0.6456 => 0.6992, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.30% (0.1337 => 0.1448, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 8.30% (2.0273 => 2.1955, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 8.21% (0.3387 => 0.3665, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.18% (0.7326 => 0.7925, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.03% (1.5859 => 1.7133, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 7.92% (0.3180 => 0.3432, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 7.87% (2.2969 => 2.4776, std.dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.75% (0.4103 => 0.4421, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.67% (1.1861 => 1.2771, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.67% (0.3441 => 0.3705, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.44% (0.4289 => 0.4608, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.41% (0.2603 => 0.2796, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.40% (0.3865 => 0.4151, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.38% (0.4203 => 0.4513, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 7.31% (0.3422 => 0.3672, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.29% (0.6450 => 0.6920, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 7.24% (21.9371 => 23.5252, std.dev.: 0.0136) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.18% (0.4636 => 0.4969, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 7.18% (0.1463 => 0.1568, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 7.14% (0.8921 => 0.9558, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.03% (0.3826 => 0.4095, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.96% (2.2024 => 2.3557, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.96% (0.3650 => 0.3904, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.96% (0.5981 => 0.6397, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.95% (0.4620 => 0.4941, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.84% (0.4299 => 0.4593, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 6.72% (0.4048 => 0.4320, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.67% (0.1695 => 0.1808, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 6.65% (0.3684 => 0.3929, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 6.52% (0.3603 => 0.3838, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.47% (0.3136 => 0.3339, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.47% (1.4186 => 1.5104, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.40% (0.2905 => 0.3091, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.39% (1.1840 => 1.2597, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.36% (0.3162 => 0.3363, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.33% (0.2891 => 0.3074, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.20% (2.0665 => 2.1947, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 6.18% (0.2831 => 0.3006, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.16% (0.3232 => 0.3431, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.02% (0.2756 => 0.2922, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.00% (0.3098 => 0.3284, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.96% (0.2266 => 0.2401, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.94% (0.2877 => 0.3048, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.91% (0.3283 => 0.3477, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.87% (0.3052 => 0.3231, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.85% (0.2872 => 0.3040, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.82% (0.1906 => 0.2017, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.82% (0.2871 => 0.3038, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.80% (0.2725 => 0.2883, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.66% (0.2793 => 0.2951, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.66% (0.1892 => 0.1999, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 5.57% (0.2802 => 0.2958, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.56% (0.3379 => 0.3567, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.54% (0.4064 => 0.4289, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.53% (0.2714 => 0.2864, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.49% (0.8101 => 0.8546, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.17% (14.3668 => 15.1099, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/ReedSolomon: 5.03% (0.2049 => 0.2152, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.76% (0.3131 => 0.3280, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 4.67% (17.1811 => 17.9837, std.dev.: 0.0230) MultiSource/Applications/hexxagon/hexxagon: 4.58% (1.2842 => 1.3430, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.52% (0.3427 => 0.3582, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.16% (0.2430 => 0.2531, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.10% (3.8922 => 4.0516, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.06% (1.1194 => 1.1537, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.86% (1.1396 => 1.2520, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0018) MultiSource/Applications/aha/aha: 9.22% (3.1595 => 3.4507, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.1578 => 3.3686, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.72% (3.6395 => 3.7749, std.dev.: 0.0036) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.77% (4.2280 => 4.3451, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7651, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.55% (0.8275 => 0.8403, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8130, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.19% (2.6546 => 2.6861, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.03% (6.5088 => 6.5757, std.dev.: 0.0077) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1309, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -79.99% (0.8651 => 0.1731, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.05% (5.2763 => 3.2688, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.12% (5.3855 => 3.7093, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.68% (5.3526 => 3.7102, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -14.70% (54.1659 => 46.2033, std.dev.: 0.0741) MultiSource/Applications/ClamAV/clamscan: -12.10% (22.1758 => 19.4918, std.dev.: 0.0129) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.53% (2.9384 => 2.6291, std.dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7653, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -16.17% (1.6925 => 1.4189, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.53% (0.0998 => 0.0863, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.19% (1.2373 => 1.0988, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -10.47% (1.5373 => 1.3764, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/mason/mason: -9.90% (0.2161 => 0.1947, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.32% (19.9488 => 18.2888, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.65% (1.8329 => 1.7110, std.dev.: 0.0163) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.30% (1.6805 => 1.5915, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.90% (1.5835 => 1.5059, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.15% (0.9957 => 0.9544, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Applications/siod/siod: -3.63% (3.2827 => 3.1637, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.4993, std.dev.: 0.0078) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0982, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.18% (8.1563 => 7.9785, std.dev.: 0.0257) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.11% (8.6802 => 8.4974, std.dev.: 0.0168) SingleSource/Benchmarks/Misc/salsa20: -1.88% (10.2830 => 10.0894, std.dev.: 0.0177) SingleSource/UnitTests/Vector/multiplies: -1.86% (2.5528 => 2.5052, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6789, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4206, std.dev.: 0.0068) MultiSource/Applications/sqlite3/sqlite3: -1.14% (4.6441 => 4.5910, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/hash: -1.11% (4.9088 => 4.8544, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.01% (6.2999 => 6.2364, std.dev.: 0.0046) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.75% (0.5229 => 0.5948, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 9.77% (14.9895 => 16.4535, std.dev.: 0.0136) MultiSource/Benchmarks/MallocBench/gs/gs: 8.04% (4.1105 => 4.4411, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.06% (1.1048 => 1.2601, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.86% (7.1582 => 7.8641, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.29% (0.6222 => 0.7422, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36200.00% (0.0001 => 0.0363, std.dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 11 18:54:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 11 Oct 2012 20:54:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121012015423.4AE562A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4805?compare_to=4798&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4805, Order: 165753, Start Time: 2012-10-11 22:46:13, End Time: 2012-10-12 01:56:13 To: 4798, Order: 165713, Start Time: 2012-10-11 14:35:39, End Time: 2012-10-11 17:45:41 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 6 (136 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1036 (755 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 23.71% (0.3863 => 0.4779, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.16% (2.8977 => 2.9314, std.dev.: 0.0036) MultiSource/Applications/JM/ldecod/ldecod: 1.16% (2.2834 => 2.3098, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.11% (1.4110 => 1.4267, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 1.03% (1.9969 => 2.0174, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.17% (54.2194 => 54.8513, std.dev.: 0.2057) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/for-in: 11.70% (0.3496 => 0.3905, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.56% (0.3442 => 0.3840, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 11.56% (0.3469 => 0.3870, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.55% (0.3446 => 0.3844, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.52% (0.3465 => 0.3864, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.50% (0.3488 => 0.3889, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.45% (0.3460 => 0.3856, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.40% (0.3650 => 0.4066, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.17% (0.3643 => 0.4050, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.04% (0.3724 => 0.4135, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.07% (0.1063 => 0.1170, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 9.35% (1.5932 => 1.7421, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: 9.28% (0.1218 => 0.1331, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 9.22% (0.1421 => 0.1552, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.16% (0.1103 => 0.1204, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.87% (0.5826 => 0.6343, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/05-eks/eks: 8.83% (0.1619 => 0.1762, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 8.80% (0.5889 => 0.6407, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.65% (0.4994 => 0.5426, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.48% (1.3152 => 1.4267, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.41% (1.6211 => 1.7575, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.30% (0.2736 => 0.2963, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.21% (0.4361 => 0.4719, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.06% (0.5000 => 0.5403, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.03% (0.2875 => 0.3106, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 7.99% (5.5417 => 5.9846, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.96% (0.1620 => 0.1749, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.96% (0.2738 => 0.2956, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 7.86% (0.3004 => 0.3240, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.83% (3.5627 => 3.8416, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.83% (0.4139 => 0.4463, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 7.72% (0.4847 => 0.5221, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.70% (0.3195 => 0.3441, std.dev.: 0.0086) SingleSource/UnitTests/ObjC++/property-reference: 7.67% (0.7171 => 0.7721, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.67% (0.3625 => 0.3903, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 7.64% (0.6634 => 0.7141, std.dev.: 0.0103) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.60% (0.2014 => 0.2167, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 7.60% (0.2725 => 0.2932, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.49% (0.2792 => 0.3001, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 7.45% (0.2780 => 0.2987, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.43% (0.3930 => 0.4222, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/random: 7.42% (0.2803 => 0.3011, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.41% (2.7292 => 2.9314, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: 7.41% (0.9909 => 1.0643, std.dev.: 0.0027) MultiSource/Applications/spiff/spiff: 7.40% (0.4029 => 0.4327, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.39% (0.2911 => 0.3126, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.37% (0.5900 => 0.6335, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hello: 7.37% (0.2714 => 0.2914, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.37% (0.2729 => 0.2930, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.36% (0.1549 => 0.1663, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 7.36% (0.2813 => 0.3020, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.35% (0.2068 => 0.2220, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.35% (2.0673 => 2.2192, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/strcat: 7.35% (0.2750 => 0.2952, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 7.34% (1.8794 => 2.0174, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.32% (0.1462 => 0.1569, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/09-vor/vor: 7.31% (0.1505 => 0.1615, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 7.31% (0.4146 => 0.4449, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.30% (0.5026 => 0.5393, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 7.29% (0.2811 => 0.3016, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 7.26% (0.2823 => 0.3028, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 7.25% (0.2566 => 0.2752, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.19% (0.3060 => 0.3280, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 7.17% (4.2109 => 4.5129, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/sieve: 7.14% (0.3726 => 0.3992, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 7.13% (1.0781 => 1.1550, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.12% (0.3903 => 0.4181, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.11% (0.3362 => 0.3601, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 7.09% (23.5202 => 25.1888, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/ary: 7.09% (0.3258 => 0.3489, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.03% (4.4195 => 4.7301, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/moments: 7.01% (0.3678 => 0.3936, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.01% (0.2866 => 0.3067, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.01% (0.3124 => 0.3343, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 7.01% (0.3267 => 0.3496, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.98% (0.3096 => 0.3312, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.96% (0.1968 => 0.2105, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 6.96% (0.3348 => 0.3581, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.92% (0.3890 => 0.4159, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.90% (0.3477 => 0.3717, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.89% (0.3282 => 0.3508, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.87% (0.3317 => 0.3545, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.84% (0.3845 => 0.4108, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.82% (0.6435 => 0.6874, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 6.76% (0.5546 => 0.5921, std.dev.: 0.0022) MultiSource/Applications/lua/lua: 6.75% (1.4269 => 1.5232, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 6.73% (0.9697 => 1.0350, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash2: 6.73% (0.4251 => 0.4537, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.69% (0.3690 => 0.3937, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 6.68% (0.3336 => 0.3559, std.dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 6.67% (2.1653 => 2.3098, std.dev.: 0.0100) MultiSource/Applications/JM/lencod/lencod: 6.64% (4.6177 => 4.9243, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.64% (0.2969 => 0.3166, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.58% (0.3084 => 0.3287, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.55% (0.4658 => 0.4963, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 6.50% (2.1013 => 2.2378, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.43% (0.2737 => 0.2913, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.42% (0.3271 => 0.3481, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.37% (0.2103 => 0.2237, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.32% (0.7426 => 0.7895, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 6.26% (0.5012 => 0.5326, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 6.07% (0.2075 => 0.2201, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 6.07% (0.7875 => 0.8353, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.93% (0.2040 => 0.2161, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.89% (0.5361 => 0.5677, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.87% (1.9694 => 2.0850, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: 5.80% (2.0346 => 2.1527, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.80% (1.9966 => 2.1124, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: 5.60% (0.2391 => 0.2525, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 5.43% (0.2691 => 0.2837, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.37% (11.6398 => 12.2654, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.37% (0.5584 => 0.5884, std.dev.: 0.0049) MultiSource/Applications/lambda-0_1_3/lambda: 5.03% (0.3498 => 0.3674, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.46% (4.6926 => 4.9019, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.86% (0.4253 => 0.4417, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 3.36% (11.9555 => 12.3570, std.dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6108, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6762, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-2: 4.83% (1.8057 => 1.8929, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1658, std.dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/dry: 4.31% (14.0481 => 14.6540, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary3: 2.14% (15.8721 => 16.2111, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.66% (3.1722 => 3.2247, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3113, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.46% (1.0927 => 1.1086, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2852, std.dev.: 0.0022) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5136, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5766, std.dev.: 0.0192) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.91% (25.4195 => 16.5460, std.dev.: 0.0197) SingleSource/Benchmarks/Shootout-C++/ary2: -8.74% (0.2402 => 0.2192, std.dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9753, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7958, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9573, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8036, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.05% (0.6293 => 0.6101, std.dev.: 0.0035) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7732, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5190, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/fldry: -2.62% (17.2379 => 16.7864, std.dev.: 0.0541) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8583, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5705, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4963, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.26% (105.3826 => 104.0505, std.dev.: 0.1046) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0417, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 11 21:30:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 11 Oct 2012 23:30:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121012043057.1EEE82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4806?compare_to=4801&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4806, Order: 165785, Start Time: 2012-10-12 03:07:07, End Time: 2012-10-12 04:32:46 To: 4801, Order: 165731, Start Time: 2012-10-11 18:58:47, End Time: 2012-10-11 20:25:34 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 41 (188 on baseline) Performance Improvements: 62 (40 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 939 (676 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/05-eks/eks: 7.46% (0.4131 => 0.4439, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 6.65% (0.3096 => 0.3302, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/BoolLiteralTest: 4.68% (0.3934 => 0.4118, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.81% (4.6290 => 4.7591, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.75% (4.6952 => 4.8243, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.53% (0.5416 => 0.5553, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 2.48% (1.3530 => 1.3865, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.46% (1.6047 => 1.6441, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.22% (0.5323 => 0.5441, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.11% (0.5441 => 0.5556, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.09% (0.5450 => 0.5564, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.01% (0.5314 => 0.5421, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.98% (0.6108 => 0.6229, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.97% (0.5572 => 0.5682, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 1.96% (9.0199 => 9.1966, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.92% (0.5789 => 0.5900, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.89% (0.5658 => 0.5765, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.87% (0.5444 => 0.5546, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.87% (0.6517 => 0.6639, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.85% (0.5667 => 0.5772, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.80% (0.6261 => 0.6374, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.72% (0.6261 => 0.6369, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.69% (0.6517 => 0.6627, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.65% (0.6066 => 0.6166, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.57% (2.2170 => 2.2517, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.06% (1.3470 => 1.3613, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 34.35% (0.5182 => 0.6962, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 16.83% (0.9354 => 1.0928, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.20% (0.3260 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 6.65% (1.2068 => 1.2871) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.66% (28.2966 => 29.6140, std.dev.: 0.1206) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.04% (0.8212 => 0.8544, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 3.85% (24.8933 => 25.8514, std.dev.: 0.0165) SingleSource/UnitTests/Vector/multiplies: 2.80% (2.4455 => 2.5140, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 2.26% (3.0789 => 3.1485, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 1.55% (10.9737 => 11.1443, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 1.55% (8.9397 => 9.0786, std.dev.: 0.0131) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.42% (1.4096 => 1.4296, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.29% (5.2730 => 5.3408, std.dev.: 0.0033) MultiSource/Benchmarks/sim/sim: 1.15% (4.7455 => 4.8002, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.06% (3.4491 => 3.4858, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -25.32% (1.2778 => 0.9542, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -2.91% (4.1075 => 3.9881, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.13% (0.7175 => 0.7022, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.93% (0.6783 => 0.6652, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.64% (1.2878 => 1.2667, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: -1.59% (5.1253 => 5.0436, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: -1.50% (7.1775 => 7.0701, std.dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -24.03% (4.6949 => 3.5667, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -18.39% (1.1798 => 0.9628, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -15.81% (4.9471 => 4.1650, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -15.62% (6.5575 => 5.5331, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -14.50% (4.7164 => 4.0327, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -14.07% (2.4619 => 2.1156, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -12.56% (4.6919 => 4.1028, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -12.25% (0.5380 => 0.4721, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -10.33% (6.0309 => 5.4080, std.dev.: 0.0177) SingleSource/Benchmarks/Misc/himenobmtxpa: -9.15% (4.0348 => 3.6655, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/fp-convert: -8.92% (3.6730 => 3.3454) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -8.36% (5.1494 => 4.7187, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -7.91% (5.3101 => 4.8900, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.59% (4.6571 => 4.3501, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.32% (9.1258 => 8.5493, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.13% (5.2239 => 4.9038, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.07% (4.4219 => 4.1537, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.94% (4.6547 => 4.3782, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/huffbench: -4.98% (19.2247 => 18.2667, std.dev.: 0.0205) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.85% (0.2496 => 0.2375, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.77% (8.3432 => 7.9456, std.dev.: 0.0273) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.74% (6.2506 => 5.9546, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -4.39% (28.9874 => 27.7144, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.31% (5.4467 => 5.2117, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.21% (4.9459 => 4.7375, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.05% (7.9754 => 7.6520, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -4.01% (6.8499 => 6.5752, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.85% (5.5986 => 5.3830, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -3.67% (2.8569 => 2.7521, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.66% (2.6736 => 2.5758, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.50% (4.5587 => 4.3991, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.43% (82.2242 => 79.4052, std.dev.: 0.7012) MultiSource/Applications/hexxagon/hexxagon: -3.19% (12.4741 => 12.0762, std.dev.: 0.0034) MultiSource/Applications/spiff/spiff: -3.15% (3.0491 => 2.9530, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.14% (1.8326 => 1.7750, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -2.88% (13.8434 => 13.4449, std.dev.: 0.0266) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.71% (32.2454 => 31.3707, std.dev.: 0.0086) MultiSource/Applications/minisat/minisat: -2.71% (9.4771 => 9.2202, std.dev.: 0.0292) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -2.61% (4.3636 => 4.2496, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: -2.58% (7.7642 => 7.5637, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.52% (4.5139 => 4.4003, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: -2.29% (11.9484 => 11.6744, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -2.23% (86.1230 => 84.2006, std.dev.: 0.0047) MultiSource/Applications/lemon/lemon: -2.11% (1.4855 => 1.4542, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.10% (5.3083 => 5.1967, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: -1.91% (4.6181 => 4.5297, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.90% (2.5417 => 2.4933, std.dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: -1.85% (3.9126 => 3.8403, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.78% (0.6629 => 0.6511, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: -1.75% (2.2465 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.55% (0.9904 => 0.9750, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: -1.55% (2.0180 => 1.9868, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -1.39% (7.6874 => 7.5806, std.dev.: 0.0076) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.18% (1.7284 => 1.7080, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.15% (1.3787 => 1.3628, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.66% (2.0176 => 2.4950, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.44% (0.1410 => 0.1670, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.92% (0.0653 => 0.0770, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 17.35% (0.1072 => 0.1258, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 17.31% (0.0826 => 0.0969, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 16.63% (0.2243 => 0.2616, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.65% (0.0819 => 0.0939, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.62% (0.1327 => 0.1521, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 14.12% (0.1013 => 0.1156, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.80% (0.1413 => 0.1608, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 13.50% (0.7038 => 0.7988, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.43% (0.0834 => 0.0946, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 12.67% (1.3693 => 1.5428, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.66% (0.0964 => 0.1086, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.65% (3.9660 => 4.4678, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.64% (0.2721 => 0.3065, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.41% (0.1588 => 0.1785, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.33% (0.2596 => 0.2916, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.18% (0.7710 => 0.8649, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 12.15% (0.1062 => 0.1191, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.13% (1.4563 => 1.6330, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: 12.13% (0.4328 => 0.4853, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 12.01% (0.4062 => 0.4550, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.00% (0.9199 => 1.0303, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.00% (0.6959 => 0.7794, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.89% (0.5265 => 0.5891, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 11.85% (13.8202 => 15.4584, std.dev.: 0.0121) MultiSource/Benchmarks/Olden/power/power: 11.76% (0.1003 => 0.1121, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.76% (0.6283 => 0.7022, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.65% (1.2193 => 1.3613, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.62% (0.3899 => 0.4352, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 11.50% (0.5818 => 0.6487, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.48% (0.3022 => 0.3369, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.47% (1.1364 => 1.2667, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.28% (0.3580 => 0.3984, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 11.26% (0.5748 => 0.6395, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.24% (0.1157 => 0.1287, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.10% (0.3485 => 0.3872, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 11.01% (1.0313 => 1.1448, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 10.99% (0.7061 => 0.7837, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.96% (0.3130 => 0.3473, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 10.92% (1.1061 => 1.2269, std.dev.: 0.0068) MultiSource/Applications/kimwitu++/kc: 10.89% (16.6129 => 18.4225, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.83% (0.5577 => 0.6181, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 10.82% (0.2781 => 0.3082, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.81% (0.3489 => 0.3866, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.71% (0.4016 => 0.4446, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.60% (0.1075 => 0.1189, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.60% (0.3756 => 0.4154, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.59% (0.4390 => 0.4855, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.48% (0.4791 => 0.5293, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 10.48% (0.3293 => 0.3638, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.44% (0.0977 => 0.1079, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 10.36% (0.6744 => 0.7443, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.34% (0.4379 => 0.4832, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/gs/gs: 10.34% (3.8646 => 4.2643, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.32% (0.2966 => 0.3272, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.32% (0.2782 => 0.3069, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.27% (0.7460 => 0.8226, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/mst/mst: 10.26% (0.1111 => 0.1225, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.26% (0.3246 => 0.3579, std.dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 10.25% (0.2995 => 0.3302, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 10.20% (0.1589 => 0.1751, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 10.19% (0.3868 => 0.4262, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.16% (1.9828 => 2.1842, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.13% (0.1865 => 0.2054, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/18-imp/imp: 10.12% (0.3220 => 0.3546, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.09% (0.2914 => 0.3208, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 10.09% (0.7506 => 0.8263, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/strcat: 10.05% (0.2726 => 0.3000, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 9.99% (0.3453 => 0.3798, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 9.99% (2.1791 => 2.3967, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.97% (0.2127 => 0.2339, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.96% (0.1014 => 0.1115, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 9.93% (0.2607 => 0.2866, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 9.93% (0.2760 => 0.3034, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.90% (0.1435 => 0.1577, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 9.89% (1.9270 => 2.1176, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.89% (0.8698 => 0.9558, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 9.88% (0.8310 => 0.9131, std.dev.: 0.0055) MultiSource/Applications/viterbi/viterbi: 9.88% (0.1478 => 0.1624, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.87% (0.1986 => 0.2182, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.85% (0.5637 => 0.6192, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary3: 9.84% (0.3149 => 0.3459, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.83% (0.2655 => 0.2916, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 9.82% (3.1889 => 3.5020, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/random: 9.78% (0.2690 => 0.2953, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 9.77% (0.2937 => 0.3224, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.76% (0.2765 => 0.3035, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 9.74% (0.2925 => 0.3210, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 9.74% (0.2761 => 0.3030, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.74% (0.2023 => 0.2220, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 9.73% (0.3534 => 0.3878, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 9.72% (0.3107 => 0.3409, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 9.70% (0.2628 => 0.2883, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 9.68% (0.3192 => 0.3501, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.43% (7.2180 => 7.8989, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.38% (0.2696 => 0.2949, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 9.37% (0.2988 => 0.3268, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 9.35% (0.1657 => 0.1812, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.31% (0.1569 => 0.1715, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.25% (0.1276 => 0.1394, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 9.22% (1.0594 => 1.1571, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.21% (4.9865 => 5.4457, std.dev.: 0.0080) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.16% (0.2140 => 0.2336, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.98% (1.3245 => 1.4435, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.97% (0.3511 => 0.3826, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.84% (0.6576 => 0.7157, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 8.79% (0.2945 => 0.3204, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.79% (0.3755 => 0.4085, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 8.75% (1.2749 => 1.3865, std.dev.: 0.0019) MultiSource/Benchmarks/sim/sim: 8.72% (0.3131 => 0.3404, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.69% (3.6692 => 3.9881, std.dev.: 0.0120) MultiSource/Applications/JM/lencod/lencod: 8.67% (14.8535 => 16.1408, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.65% (4.3801 => 4.7591, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.57% (4.4433 => 4.8243, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.43% (0.6135 => 0.6652, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.38% (0.1789 => 0.1939, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.25% (1.5188 => 1.6441, std.dev.: 0.0072) MultiSource/Benchmarks/mafft/pairlocalalign: 8.24% (8.4961 => 9.1966, std.dev.: 0.0114) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.21% (0.8818 => 0.9542, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 8.16% (4.6629 => 5.0436, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.01% (0.2321 => 0.2507, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/05-eks/eks: 7.93% (0.4113 => 0.4439, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.87% (1.1333 => 1.2225, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.86% (0.9108 => 0.9824, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.86% (3.2742 => 3.5314, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 7.70% (0.6250 => 0.6731, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 7.67% (0.4003 => 0.4310, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.60% (0.4805 => 0.5170, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 7.56% (3.7467 => 4.0300, std.dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 7.52% (6.5754 => 7.0701, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/neural/neural: 7.44% (0.1385 => 0.1488, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 7.37% (0.2008 => 0.2156, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.37% (0.3245 => 0.3484, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.35% (0.2504 => 0.2688, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.33% (0.3914 => 0.4201, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.31% (0.3940 => 0.4228, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 7.27% (1.2292 => 1.3186, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.26% (0.1819 => 0.1951, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.19% (2.1007 => 2.2517, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 7.10% (0.3789 => 0.4058, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.10% (0.3578 => 0.3832, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.97% (0.3646 => 0.3900, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/synchronized: 6.93% (0.3663 => 0.3917, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.93% (0.3650 => 0.3903, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 6.86% (0.3601 => 0.3848, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 6.85% (0.3623 => 0.3871, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.72% (6.2785 => 6.7005, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.55% (13.2842 => 14.1545, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.53% (0.2243 => 0.2367, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 4.90% (16.2614 => 17.0589, std.dev.: 0.0043) MultiSource/Applications/ClamAV/clamscan: 4.46% (14.5298 => 15.1779, std.dev.: 0.0063) MultiSource/Benchmarks/Bullet/bullet: 2.15% (33.2944 => 34.0107, std.dev.: 0.0118) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5157, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.37% (1.8175 => 2.2604, std.dev.: 0.0395) SingleSource/Benchmarks/Misc/richards_benchmark: 11.06% (1.1560 => 1.2839, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4137, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.17% (1.2998 => 1.3800, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.75% (1.9144 => 2.0054, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.69% (10.7476 => 11.1443, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 3.66% (11.2619 => 11.6744, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 3.48% (1.9199 => 1.9868, std.dev.: 0.0006) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.07% (7.4271 => 7.5806, std.dev.: 0.0076) MultiSource/Applications/lemon/lemon: 1.71% (1.4298 => 1.4542, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0508, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5135, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9684, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2123, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1878, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5782, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0265, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5901, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.74% (0.2670 => 0.1422, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.02% (0.4657 => 0.3911, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -14.14% (0.0707 => 0.0607, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.21% (1.3813 => 1.1988, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.13% (1.3819 => 1.2005, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.36% (22.5627 => 22.2556, std.dev.: 0.0098) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.93% (0.2238 => 0.1971, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.21% (1.2308 => 1.0928, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.20% (20.3410 => 18.2667, std.dev.: 0.0205) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.81% (1.3780 => 1.2979, std.dev.: 0.0091) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5140, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.68% (0.9996 => 0.9628, std.dev.: 0.0095) MultiSource/Applications/siod/siod: -3.54% (3.2729 => 3.1571, std.dev.: 0.0174) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.44% (1.7688 => 1.7080, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.51% (26.5159 => 25.8514, std.dev.: 0.0165) MultiSource/Applications/spiff/spiff: -2.42% (3.0263 => 2.9530, std.dev.: 0.0013) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.34% (1.9762 => 1.9299, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.93% (0.6589 => 0.6462, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7144, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/lists: -1.70% (6.3560 => 6.2482, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0066, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: -1.37% (4.5928 => 4.5297, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.27% (2.5254 => 2.4933, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: -1.24% (9.3358 => 9.2202, std.dev.: 0.0292) SingleSource/Benchmarks/Shootout/heapsort: -1.20% (3.9173 => 3.8701, std.dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2580, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 11 22:31:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 12 Oct 2012 00:31:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121012053130.CE9D62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4807?compare_to=4804&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4807, Order: 165785, Start Time: 2012-10-12 04:13:25, End Time: 2012-10-12 05:33:21 To: 4804, Order: 165770, Start Time: 2012-10-12 00:27:09, End Time: 2012-10-12 01:46:51 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (165 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 953 (679 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.10% (0.5948 => 0.5942, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: -0.14% (16.4535 => 16.4311, std.dev.: 0.0072) MultiSource/Benchmarks/Bullet/bullet: -0.10% (55.2581 => 55.2037, std.dev.: 0.0090) MultiSource/Benchmarks/MallocBench/gs/gs: 0.00% (4.4411 => 4.4412, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.87% (0.0462 => 0.0458) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.29% (0.0464 => 0.0458, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.16% (0.0432 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.92% (0.0433 => 0.0429, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.95% (0.0421 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.18% (0.0423 => 0.0418, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.72% (0.0415 => 0.0412) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.72% (0.0416 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.92% (0.0433 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.92% (0.0435 => 0.0431, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.17% (0.0428 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.93% (0.0429 => 0.0425, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.72% (0.0417 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.95% (0.0419 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.18% (0.0425 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.94% (0.0426 => 0.0422, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.15% (0.0436 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.14% (0.0438 => 0.0433, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.21% (0.0413 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.97% (0.0414 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.71% (0.0424 => 0.0421) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.94% (0.0426 => 0.0422, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.20% (0.0416 => 0.0411, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.96% (0.0417 => 0.0413, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.98% (0.0409 => 0.0405) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.73% (0.0409 => 0.0406) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.99% (0.0406 => 0.0402, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.98% (0.0409 => 0.0405, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.90% (0.0444 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.90% (0.0445 => 0.0441, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.74% (0.0406 => 0.0403) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.98% (0.0407 => 0.0403, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.98% (0.0407 => 0.0403, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -1.22% (0.0409 => 0.0404, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.20% (0.0415 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.72% (0.0416 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.04% (1.2601 => 1.2606, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.39% (7.8641 => 7.8332, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.40% (0.7422 => 0.7392, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -1.10% (0.0363 => 0.0359, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1433 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0648 => 0.0647, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.71% (63.2438 => 55.2037, std.dev.: 0.0090) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 33.95% (14.1553 => 18.9613, std.dev.: 0.0235) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.18% (3.4629 => 5.6508, std.dev.: 0.0163) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14232.78% (0.0720 => 10.3196, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952000.00% (0.0001 => 9.9521, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 62.96% (0.2554 => 0.4162, std.dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: 46.27% (10.3673 => 15.1640, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/richards_benchmark: 38.16% (0.1622 => 0.2241) MultiSource/Benchmarks/FreeBench/distray/distray: 32.95% (0.1056 => 0.1404, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 17.60% (0.1432 => 0.1684, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.46% (7.0540 => 8.2856, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.83% (2.2022 => 2.5729, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.58% (0.1566 => 0.1810, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.14% (1.7609 => 1.9923, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.97% (0.0871 => 0.0984, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 12.50% (0.1440 => 0.1620, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.34% (0.1143 => 0.1284, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 12.06% (0.1584 => 0.1775, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 12.00% (0.3282 => 0.3676, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 10.91% (0.7433 => 0.8244, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.58% (0.4879 => 0.5395, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 10.43% (0.7115 => 0.7857, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 10.39% (0.3473 => 0.3834, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.34% (0.1625 => 0.1793, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.33% (0.3543 => 0.3909, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 10.31% (10.4361 => 11.5124, std.dev.: 0.0121) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.29% (0.1438 => 0.1586, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.29% (0.3927 => 0.4331, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 10.19% (9.4845 => 10.4513, std.dev.: 0.0195) SingleSource/UnitTests/ObjC/synchronized: 10.17% (0.3561 => 0.3923, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.16% (0.3543 => 0.3903, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 10.15% (0.1655 => 0.1823, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 10.12% (0.3497 => 0.3851, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.10% (0.3516 => 0.3871, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.98% (0.3886 => 0.4274, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.98% (0.3828 => 0.4210, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.96% (0.2700 => 0.2969, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.94% (0.3694 => 0.4061, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.90% (0.6675 => 0.7336, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 9.87% (0.1175 => 0.1291, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.82% (0.3177 => 0.3489, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 9.73% (0.1695 => 0.1860, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.65% (1.5415 => 1.6902, std.dev.: 0.0043) MultiSource/Applications/d/make_dparser: 9.63% (3.3354 => 3.6566, std.dev.: 0.0059) MultiSource/Applications/sgefa/sgefa: 9.59% (0.3109 => 0.3407, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.47% (0.4615 => 0.5052, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 9.41% (0.3423 => 0.3745, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 9.38% (0.1151 => 0.1259, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.15% (0.5860 => 0.6396, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.11% (0.5105 => 0.5570, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.07% (0.1510 => 0.1647, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.07% (4.2646 => 4.6515, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.06% (0.1236 => 0.1348, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 9.05% (5.7591 => 6.2803, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.00% (1.3050 => 1.4224, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.98% (0.2271 => 0.2475, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.97% (0.8067 => 0.8791, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: 8.94% (1.1642 => 1.2683, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.81% (0.1940 => 0.2111, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.78% (0.2107 => 0.2292, std.dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.75% (0.3121 => 0.3394, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.72% (5.0018 => 5.4382, std.dev.: 0.0033) MultiSource/Applications/lua/lua: 8.72% (3.8723 => 4.2098, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.70% (0.2758 => 0.2998, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/mst/mst: 8.68% (0.1163 => 0.1264, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.67% (0.5569 => 0.6052, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.67% (4.9449 => 5.3736, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.62% (8.1363 => 8.8379, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.60% (0.9765 => 1.0605, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.57% (0.2065 => 0.2242, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 8.55% (0.1555 => 0.1688, std.dev.: 0.0028) MultiSource/Applications/hbd/hbd: 8.49% (1.5603 => 1.6927, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.47% (0.8172 => 0.8864, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.46% (0.3441 => 0.3732, std.dev.: 0.0031) MultiSource/Applications/spiff/spiff: 8.45% (0.7835 => 0.8497, std.dev.: 0.0023) MultiSource/Applications/lemon/lemon: 8.36% (1.0722 => 1.1618, std.dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.28% (7.9617 => 8.6213, std.dev.: 0.0204) MultiSource/Benchmarks/sim/sim: 8.24% (0.3387 => 0.3666, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.19% (0.5020 => 0.5431, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 8.10% (2.0273 => 2.1915, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 8.07% (0.6456 => 0.6977, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.06% (1.5859 => 1.7138, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 7.92% (0.3180 => 0.3432, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.92% (0.3307 => 0.3569, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.85% (0.1337 => 0.1442, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 7.83% (2.2969 => 2.4768, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/Hello: 7.83% (0.5925 => 0.6389, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.73% (0.6030 => 0.6496, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.65% (0.4103 => 0.4417, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.59% (1.1861 => 1.2761, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.45% (0.2603 => 0.2797, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.33% (0.6450 => 0.6923, std.dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 7.27% (21.9371 => 23.5318, std.dev.: 0.0136) SingleSource/UnitTests/ObjC++/property-reference: 7.26% (0.7326 => 0.7858, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/05-eks/eks: 7.21% (0.4299 => 0.4609, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.13% (2.2024 => 2.3595, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/football/football: 7.12% (0.8921 => 0.9556, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: 7.04% (0.1463 => 0.1566, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.99% (0.5981 => 0.6399, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.96% (0.3650 => 0.3904, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.91% (0.3865 => 0.4132, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 6.88% (0.4289 => 0.4584, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.88% (0.4203 => 0.4492, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.69% (0.3826 => 0.4082, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 6.66% (0.3422 => 0.3650, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 6.62% (0.4048 => 0.4316, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.52% (0.4620 => 0.4921, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.49% (1.4186 => 1.5107, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.43% (0.1695 => 0.1804, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 6.39% (1.1840 => 1.2596, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.31% (0.3136 => 0.3334, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.30% (0.4636 => 0.4928, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists1: 6.11% (0.3684 => 0.3909, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.05% (0.2266 => 0.2403, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 6.00% (0.3603 => 0.3819, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 5.96% (0.2905 => 0.3078, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.93% (0.1906 => 0.2019, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.91% (0.2891 => 0.3062, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.91% (0.3162 => 0.3349, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.84% (2.0665 => 2.1872, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/strcat: 5.72% (0.2831 => 0.2993, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.58% (0.3098 => 0.3271, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 5.58% (0.2725 => 0.2877, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.57% (0.3052 => 0.3222, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.54% (0.3232 => 0.3411, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.52% (0.2756 => 0.2908, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.48% (0.3283 => 0.3463, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.43% (0.2872 => 0.3028, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.37% (0.2793 => 0.2943, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.36% (0.2871 => 0.3025, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.35% (0.8101 => 0.8534, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.31% (0.4064 => 0.4280, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.28% (0.2877 => 0.3029, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 5.28% (0.2802 => 0.2950, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 5.27% (0.2049 => 0.2157, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 5.20% (0.2714 => 0.2855, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 4.97% (0.3379 => 0.3547, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.92% (14.3668 => 15.0737, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.41% (0.3427 => 0.3578, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 4.39% (17.1811 => 17.9346, std.dev.: 0.0146) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.36% (0.2430 => 0.2536, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 4.31% (0.3131 => 0.3266, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.28% (1.2842 => 1.3392, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.13% (3.8922 => 4.0528, std.dev.: 0.0081) MultiSource/Benchmarks/Olden/bh/bh: 3.36% (0.3092 => 0.3196, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.22% (1.1194 => 1.1555, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.62% (0.3817 => 0.3917, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 10.04% (1.1396 => 1.2540, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.21% (3.1595 => 3.4506, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3681, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.52% (3.6395 => 3.7675, std.dev.: 0.0028) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.88% (4.2280 => 4.3498, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (0.8275 => 0.8405, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8131, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.21% (2.6546 => 2.6868, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.12% (9.1159 => 9.2176, std.dev.: 0.0158) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5753, std.dev.: 0.0066) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.05% (6.6874 => 0.1307, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: -79.92% (0.8651 => 0.1737, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.04% (5.2763 => 3.2690, std.dev.: 0.0144) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.30% (5.3855 => 3.7001, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.99% (5.3526 => 3.6936, std.dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -14.65% (54.1659 => 46.2314, std.dev.: 0.0261) MultiSource/Applications/ClamAV/clamscan: -12.31% (22.1758 => 19.4458, std.dev.: 0.0159) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.46% (2.9384 => 2.6311, std.dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.43% (1.1492 => 0.7650, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -16.08% (1.6925 => 1.4203, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.63% (0.0998 => 0.0862, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.11% (1.2373 => 1.0998, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -10.26% (1.5373 => 1.3796, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -9.86% (0.2161 => 0.1948, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.38% (19.9488 => 18.2768, std.dev.: 0.0298) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.73% (1.8329 => 1.7095, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.31% (1.6805 => 1.5912, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: -4.67% (1.5835 => 1.5095, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.22% (0.9957 => 0.9537, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Applications/siod/siod: -3.52% (3.2827 => 3.1671, std.dev.: 0.0053) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5043, std.dev.: 0.0053) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0984, std.dev.: 0.0019) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.05% (8.6802 => 8.5024, std.dev.: 0.0261) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.98% (8.1563 => 7.9949, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/salsa20: -1.90% (10.2830 => 10.0876, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/flops: -1.68% (8.8334 => 8.6849, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -1.56% (2.5528 => 2.5131, std.dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: -1.46% (9.5636 => 9.4243, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.15% (6.2999 => 6.2275, std.dev.: 0.0078) MultiSource/Applications/sqlite3/sqlite3: -1.14% (4.6441 => 4.5913, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/whetstone: -1.08% (1.0554 => 1.0440, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8576, std.dev.: 0.0080) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.64% (0.5229 => 0.5942, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 9.62% (14.9895 => 16.4311, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/gs/gs: 8.05% (4.1105 => 4.4412, std.dev.: 0.0095) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.10% (1.1048 => 1.2606, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.43% (7.1582 => 7.8332, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.80% (0.6222 => 0.7392, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35800.00% (0.0001 => 0.0359, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.42% (0.2116 => 0.0647, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 11 22:33:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 12 Oct 2012 00:33:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121012053340.E7EA92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4808?compare_to=4805&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4808, Order: 165781, Start Time: 2012-10-12 02:25:34, End Time: 2012-10-12 05:35:29 To: 4805, Order: 165753, Start Time: 2012-10-11 22:46:13, End Time: 2012-10-12 01:56:13 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (133 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1042 (757 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 11.28% (0.3465 => 0.3856, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.19% (0.3442 => 0.3827, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.18% (0.3460 => 0.3847, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.18% (0.3496 => 0.3887, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.18% (0.3488 => 0.3878, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.17% (0.3446 => 0.3831, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 11.13% (0.3469 => 0.3855, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.01% (0.3650 => 0.4052, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/exceptions: 10.87% (0.3643 => 0.4039, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.69% (0.3724 => 0.4122, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 8.87% (0.1218 => 0.1326, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 8.71% (0.1619 => 0.1760, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.59% (0.4994 => 0.5423, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: 8.46% (0.5826 => 0.6319, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.29% (0.5889 => 0.6377, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 8.18% (1.5932 => 1.7236, std.dev.: 0.0134) MultiSource/Benchmarks/McCat/09-vor/vor: 8.11% (0.1505 => 0.1627, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.97% (1.6211 => 1.7503, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.97% (0.2736 => 0.2954, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.82% (1.3152 => 1.4181, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.82% (0.4361 => 0.4702, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.78% (0.1620 => 0.1746, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 7.71% (5.5417 => 5.9690, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.70% (0.5000 => 0.5385, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.65% (0.2875 => 0.3095, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 7.50% (0.9909 => 1.0652, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.48% (3.5627 => 3.8291, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.45% (0.3195 => 0.3433, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 7.39% (0.6634 => 0.7124, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: 7.38% (0.2725 => 0.2926, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 7.36% (0.3004 => 0.3225, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.34% (0.2738 => 0.2939, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.30% (0.2014 => 0.2161, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 7.30% (0.2714 => 0.2912, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 7.28% (0.4847 => 0.5200, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 7.24% (0.4146 => 0.4446, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 7.22% (0.4029 => 0.4320, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.18% (0.2729 => 0.2925, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 7.14% (0.7171 => 0.7683, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/random: 7.14% (0.2803 => 0.3003, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 7.12% (0.2823 => 0.3024, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.12% (2.0673 => 2.2144, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 7.11% (0.3096 => 0.3316, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.10% (0.4139 => 0.4433, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.10% (0.1549 => 0.1659, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 7.09% (0.2750 => 0.2945, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 7.09% (0.2780 => 0.2977, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.07% (0.5900 => 0.6317, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.06% (0.2792 => 0.2989, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 7.05% (0.3317 => 0.3551, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.04% (0.2811 => 0.3009, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.3267 => 0.3497, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 7.02% (23.5202 => 25.1716, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/methcall: 7.00% (0.2813 => 0.3010, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 7.00% (0.3258 => 0.3486, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.98% (0.1462 => 0.1564, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 6.96% (0.3678 => 0.3934, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.96% (0.3362 => 0.3596, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.95% (0.3930 => 0.4203, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 6.94% (1.8794 => 2.0098, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.93% (0.3060 => 0.3272, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.92% (0.5026 => 0.5374, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.90% (0.2911 => 0.3112, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 6.90% (0.2566 => 0.2743, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 6.90% (0.3726 => 0.3983, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.90% (0.3625 => 0.3875, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.87% (0.3348 => 0.3578, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.86% (4.4195 => 4.7227, std.dev.: 0.0057) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.83% (2.7292 => 2.9157, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.79% (0.3282 => 0.3505, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.79% (0.3124 => 0.3336, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.74% (0.3903 => 0.4166, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 6.72% (4.2109 => 4.4940, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: 6.70% (0.4251 => 0.4536, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.70% (0.2866 => 0.3058, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.67% (0.3477 => 0.3709, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 6.59% (1.0781 => 1.1492, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.48% (0.3690 => 0.3929, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.46% (0.6435 => 0.6851, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.45% (0.3084 => 0.3283, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.42% (0.3845 => 0.4092, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.40% (0.1968 => 0.2094, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 6.39% (1.4269 => 1.5181, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.33% (0.2969 => 0.3157, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.30% (0.3890 => 0.4135, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 6.27% (0.5546 => 0.5894, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.25% (0.2737 => 0.2908, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 6.24% (0.3336 => 0.3544, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 6.23% (0.5012 => 0.5324, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.20% (0.3981 => 0.4228, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 6.20% (0.9697 => 1.0298, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 6.12% (2.1013 => 2.2298, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.11% (0.3271 => 0.3471, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.09% (0.2103 => 0.2231, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.03% (0.4658 => 0.4939, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.00% (0.2068 => 0.2192, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 5.94% (4.6177 => 4.8920, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.90% (0.7426 => 0.7864, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 5.69% (0.2075 => 0.2193, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 5.62% (2.1653 => 2.2870, std.dev.: 0.0025) MultiSource/Applications/treecc/treecc: 5.60% (0.7875 => 0.8316, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.47% (0.5361 => 0.5654, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.43% (1.9966 => 2.1051, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.39% (1.9694 => 2.0756, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.29% (0.2040 => 0.2148, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 5.21% (2.0346 => 2.1406, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.12% (11.6398 => 12.2357, std.dev.: 0.0053) MultiSource/Applications/lemon/lemon: 4.94% (0.2391 => 0.2509, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.92% (0.5584 => 0.5859, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 4.79% (0.2691 => 0.2820, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.26% (4.6926 => 4.8924, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.93% (0.4253 => 0.4420, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 2.94% (11.9555 => 12.3071, std.dev.: 0.0142) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6530, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6118, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (12.0509 => 12.6793, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-2: 5.02% (1.8057 => 1.8964, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1681, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/dry: 4.24% (14.0481 => 14.6434, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1925, std.dev.: 0.0103) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.48% (3.1722 => 3.2192, std.dev.: 0.0029) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3063, std.dev.: 0.0122) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.41% (1.0927 => 1.1081, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.35% (7.1849 => 7.2821, std.dev.: 0.0029) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5138, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.02% (50.0626 => 50.5743, std.dev.: 0.0304) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.00% (2.4764 => 2.4268, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5694, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/ary2: -10.45% (0.2402 => 0.2151, std.dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9782, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7950, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7981, std.dev.: 0.0146) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7725, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.86% (0.6293 => 0.6113, std.dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/fldry: -2.75% (17.2379 => 16.7640, std.dev.: 0.0341) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8654, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5759, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4956, std.dev.: 0.0058) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.2023, std.dev.: 0.0372) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0478, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 11 23:26:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 12 Oct 2012 01:26:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121012062603.B9BF22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4809?compare_to=4806&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4809, Order: 165786, Start Time: 2012-10-12 05:02:06, End Time: 2012-10-12 06:27:53 To: 4806, Order: 165785, Start Time: 2012-10-12 03:07:07, End Time: 2012-10-12 04:32:46 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (189 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1040 (675 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.59% (54.4978 => 56.4540, std.dev.: 0.1445) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.39% (3.8540 => 3.7619, std.dev.: 0.0275) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.00% (2.0176 => 2.5019, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.58% (0.1410 => 0.1672, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.92% (0.0653 => 0.0770, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 17.55% (0.0826 => 0.0971, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 17.26% (0.1072 => 0.1257, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 16.90% (0.2243 => 0.2622, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.15% (0.1327 => 0.1528, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 13.92% (0.1013 => 0.1154, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 13.60% (0.7038 => 0.7995, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.59% (0.1413 => 0.1605) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.55% (0.0834 => 0.0947, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.83% (3.9660 => 4.4749, std.dev.: 0.0085) MultiSource/Applications/hbd/hbd: 12.82% (1.3693 => 1.5449, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.76% (0.0964 => 0.1087, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.72% (0.2721 => 0.3067, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 12.57% (0.4328 => 0.4872, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.53% (0.1588 => 0.1787, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 12.51% (0.4062 => 0.4570, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 12.34% (0.1062 => 0.1193, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.26% (0.9199 => 1.0327, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.25% (0.2596 => 0.2914, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.19% (0.6959 => 0.7807, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.14% (1.4563 => 1.6331, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 12.02% (13.8202 => 15.4819, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.97% (1.2193 => 1.3653, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.95% (0.3899 => 0.4365, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.95% (0.5265 => 0.5894, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.91% (0.6283 => 0.7031, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.85% (0.7710 => 0.8624, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 11.76% (0.1003 => 0.1121, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 11.76% (0.5818 => 0.6502, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.71% (0.3022 => 0.3376, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.56% (1.1364 => 1.2678, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.42% (0.3580 => 0.3989, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 11.34% (0.5748 => 0.6400, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.25% (0.3485 => 0.3877, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 11.19% (1.1061 => 1.2299, std.dev.: 0.0051) MultiSource/Applications/lemon/lemon: 11.19% (1.0313 => 1.1467, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.18% (0.3130 => 0.3480, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.15% (0.1157 => 0.1286, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 11.08% (16.6129 => 18.4543, std.dev.: 0.0093) SingleSource/Regression/C++/ofstream_ctor: 11.08% (0.2781 => 0.3089, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.03% (0.4016 => 0.4459, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.97% (0.3756 => 0.4168, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 10.96% (0.7061 => 0.7835, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.94% (0.5577 => 0.6187, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.89% (0.3489 => 0.3869, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 10.84% (0.3293 => 0.3650, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.80% (0.4390 => 0.4864, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.79% (0.1075 => 0.1191, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.73% (0.4791 => 0.5305, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.72% (0.2966 => 0.3284, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.64% (0.2782 => 0.3078, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 10.64% (0.2726 => 0.3016, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 10.57% (0.1589 => 0.1757, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.54% (0.0977 => 0.1080, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.54% (0.3246 => 0.3588, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.53% (0.4379 => 0.4840, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.51% (1.9828 => 2.1911, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/moments: 10.50% (0.3868 => 0.4274, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 10.45% (0.3149 => 0.3478, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 10.43% (0.3107 => 0.3431, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 10.39% (0.6744 => 0.7445, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 10.38% (0.2995 => 0.3306, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 10.36% (0.2761 => 0.3047, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 10.34% (0.3220 => 0.3553, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 10.31% (2.1791 => 2.4038, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.27% (0.1986 => 0.2190) MultiSource/Benchmarks/MallocBench/gs/gs: 10.25% (3.8646 => 4.2608, std.dev.: 0.0135) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.25% (0.2127 => 0.2345, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 10.22% (0.3453 => 0.3806, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/except: 10.22% (0.2760 => 0.3042, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 10.17% (0.1111 => 0.1224, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.17% (0.2655 => 0.2925, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 10.16% (0.2607 => 0.2872, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 10.15% (0.2690 => 0.2963, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.14% (0.8698 => 0.9580, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.13% (0.1865 => 0.2054, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.12% (0.2914 => 0.3209, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 10.10% (0.3534 => 0.3891, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 10.09% (0.3192 => 0.3514, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 10.08% (0.2937 => 0.3233, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.06% (0.1014 => 0.1116, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 10.03% (0.7506 => 0.8259, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.02% (0.2765 => 0.3042, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 10.00% (0.8310 => 0.9141, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 9.99% (3.1889 => 3.5076, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 9.97% (0.2628 => 0.2890, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.97% (0.1435 => 0.1578, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 9.94% (1.9270 => 2.1185, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.92% (0.7460 => 0.8200, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.90% (0.5637 => 0.6195, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.89% (0.2023 => 0.2223, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 9.81% (0.2925 => 0.3212, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 9.81% (0.1478 => 0.1623, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.72% (0.2696 => 0.2958, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.66% (7.2180 => 7.9156, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 9.61% (0.2988 => 0.3275, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.48% (0.1276 => 0.1397, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 9.48% (1.0594 => 1.1598, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/objinst: 9.44% (0.2945 => 0.3223, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.43% (0.1569 => 0.1717, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.42% (4.9865 => 5.4562, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/em3d/em3d: 9.29% (0.1657 => 0.1811, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.25% (1.3245 => 1.4470, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.11% (0.3755 => 0.4097, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 9.07% (0.3131 => 0.3415, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.87% (4.3801 => 4.7688, std.dev.: 0.0028) MultiSource/Applications/JM/lencod/lencod: 8.83% (14.8535 => 16.1654, std.dev.: 0.0137) MultiSource/Applications/SIBsim4/SIBsim4: 8.82% (1.2749 => 1.3874, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.82% (0.6576 => 0.7156, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.82% (3.6692 => 3.9927, std.dev.: 0.0107) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.75% (4.4433 => 4.8323, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.70% (0.6135 => 0.6669, std.dev.: 0.0058) MultiSource/Benchmarks/mafft/pairlocalalign: 8.70% (8.4961 => 9.2356, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.63% (1.5188 => 1.6498, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.44% (0.1789 => 0.1940, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.31% (0.8818 => 0.9551, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.27% (0.2140 => 0.2317, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.19% (0.2321 => 0.2511, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 8.07% (0.4113 => 0.4445, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.07% (3.2742 => 3.5384, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.06% (1.1333 => 1.2246, std.dev.: 0.0050) MultiSource/Applications/oggenc/oggenc: 8.02% (4.6629 => 5.0367, std.dev.: 0.0135) SingleSource/UnitTests/ObjC/parameter-passing: 7.97% (0.4003 => 0.4322, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 7.92% (0.6250 => 0.6745, std.dev.: 0.0119) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.92% (0.9108 => 0.9829, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.86% (0.3511 => 0.3787, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 7.80% (0.1385 => 0.1493, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.74% (0.3940 => 0.4245, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.70% (0.4805 => 0.5175, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 7.67% (3.7467 => 4.0342, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/exceptions: 7.64% (0.3914 => 0.4213, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 7.61% (6.5754 => 7.0756, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 7.59% (1.2292 => 1.3225, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.51% (0.2504 => 0.2692, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.40% (2.1007 => 2.2562, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.40% (0.3650 => 0.3920, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.40% (0.3245 => 0.3485, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 7.36% (0.3789 => 0.4068, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.35% (0.3578 => 0.3841, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.30% (0.3646 => 0.3912, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.25% (0.3601 => 0.3862, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.21% (0.3663 => 0.3927, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 7.12% (0.2008 => 0.2151, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.09% (0.3623 => 0.3880, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.86% (6.2785 => 6.7093, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.73% (13.2842 => 14.1777, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.54% (0.1819 => 0.1938, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 5.63% (0.1777 => 0.1877, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.39% (0.2243 => 0.2364, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 5.02% (16.2614 => 17.0781, std.dev.: 0.0131) MultiSource/Applications/ClamAV/clamscan: 4.53% (14.5298 => 15.1876, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/bh/bh: 3.50% (0.2859 => 0.2959, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 2.12% (33.2944 => 33.9997, std.dev.: 0.0090) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5143, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: 24.26% (1.8175 => 2.2584, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/richards_benchmark: 10.97% (1.1560 => 1.2828, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 8.99% (0.8273 => 0.9017, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4142, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.09% (1.2998 => 1.3789, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.21% (0.2093 => 0.2202, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0046, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.88% (1.7081 => 1.7743, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6765, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9856, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 3.24% (10.7476 => 11.0955, std.dev.: 0.0218) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.27% (7.4271 => 7.5954, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) MultiSource/Applications/lemon/lemon: 1.83% (1.4298 => 1.4559, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5129, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1880, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5787, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0271, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.03% (12.4560 => 12.5838, std.dev.: 0.0070) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.85% (0.2670 => 0.1419, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.76% (0.4657 => 0.3923, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -14.43% (0.0707 => 0.0605, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.27% (1.3813 => 1.1980, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.24% (1.3819 => 1.1990, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.14% (22.5627 => 22.3060, std.dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.20% (0.2238 => 0.1965, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -11.10% (1.2308 => 1.0942, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.16% (20.3410 => 18.2739, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.21% (1.3780 => 1.2924, std.dev.: 0.0063) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -5.07% (2.6470 => 2.5129, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.52% (0.9996 => 0.9544, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8001, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.50% (3.2729 => 3.1584, std.dev.: 0.0120) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.39% (1.7688 => 1.7088, std.dev.: 0.0170) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.04% (0.4867 => 0.4719, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -2.49% (26.5159 => 25.8553, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/bh/bh: -2.39% (1.9762 => 1.9289, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: -2.39% (3.0263 => 2.9541, std.dev.: 0.0012) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.90% (0.6589 => 0.6464, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.81% (28.2225 => 27.7129, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/lists: -1.74% (6.3560 => 6.2455, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: -1.47% (4.5928 => 4.5252, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0067, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8637, std.dev.: 0.0032) MultiSource/Applications/minisat/minisat: -1.30% (9.3358 => 9.2148, std.dev.: 0.0393) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4952, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.06% (5.3167 => 5.2602, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 12 00:22:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 12 Oct 2012 02:22:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121012072223.B2E1E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4810?compare_to=4807&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4810, Order: 165787, Start Time: 2012-10-12 06:02:40, End Time: 2012-10-12 07:24:13 To: 4807, Order: 165785, Start Time: 2012-10-12 04:13:25, End Time: 2012-10-12 05:33:21 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (153 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 952 (692 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.59% (15.1640 => 15.4051, std.dev.: 0.0102) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.40% (0.5942 => 0.5966, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 0.08% (16.4311 => 16.4438, std.dev.: 0.0284) MultiSource/Benchmarks/Bullet/bullet: 0.18% (55.2037 => 55.3043, std.dev.: 0.0937) MultiSource/Benchmarks/MallocBench/gs/gs: 0.05% (4.4412 => 4.4436, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.87% (0.0458 => 0.0462, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.31% (0.0458 => 0.0464, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.41% (0.0427 => 0.0433, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.93% (0.0429 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.96% (0.0417 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.44% (0.0418 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.97% (0.0412 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.97% (0.0413 => 0.0417, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.17% (0.0429 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.93% (0.0431 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.18% (0.0423 => 0.0428, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.18% (0.0425 => 0.0430, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.97% (0.0414 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.96% (0.0415 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.19% (0.0420 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.18% (0.0422 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.16% (0.0431 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.39% (0.0433 => 0.0439, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.23% (0.0408 => 0.0413, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.98% (0.0410 => 0.0414) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.95% (0.0421 => 0.0425) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.95% (0.0422 => 0.0426, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.46% (0.0411 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.21% (0.0413 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.99% (0.0405 => 0.0409) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.99% (0.0406 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.24% (0.0402 => 0.0407, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.99% (0.0405 => 0.0409) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.91% (0.0440 => 0.0444, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.13% (0.0441 => 0.0446) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.99% (0.0403 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.24% (0.0403 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.99% (0.0403 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.24% (0.0404 => 0.0409, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.46% (0.0410 => 0.0416, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.97% (0.0413 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.06% (1.2606 => 1.2598, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.49% (7.8332 => 7.8717, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.72% (0.7392 => 0.7445, std.dev.: 0.0177) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.28% (0.0359 => 0.0360, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1432 => 0.1433, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0647 => 0.0646, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.55% (63.2438 => 55.3043, std.dev.: 0.0937) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.53% (14.1553 => 19.0432, std.dev.: 0.0294) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.76% (3.4629 => 5.6708, std.dev.: 0.1430) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14230.69% (0.0720 => 10.3181, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952500.00% (0.0001 => 9.9526, std.dev.: 0.0109) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.94% (0.2554 => 0.4187, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: 48.59% (10.3673 => 15.4051, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/richards_benchmark: 39.70% (0.1622 => 0.2266, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/distray/distray: 33.24% (0.1056 => 0.1407, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 17.88% (0.1432 => 0.1688, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.34% (7.0540 => 8.2773, std.dev.: 0.0186) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.39% (2.2022 => 2.5632, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.39% (0.1566 => 0.1807, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.00% (1.7609 => 1.9898, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: 12.92% (0.1440 => 0.1626, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.86% (0.0871 => 0.0983, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.69% (0.1143 => 0.1288, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 12.04% (0.3282 => 0.3677, std.dev.: 0.0083) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.99% (0.1584 => 0.1774, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 11.15% (0.7433 => 0.8262, std.dev.: 0.0029) MultiSource/Applications/JM/ldecod/ldecod: 10.90% (10.4361 => 11.5737, std.dev.: 0.0199) SingleSource/UnitTests/ObjC/parameter-passing: 10.62% (0.3927 => 0.4344, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.57% (0.3473 => 0.3840, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 10.56% (0.7115 => 0.7866, std.dev.: 0.0086) SingleSource/UnitTests/ObjC/synchronized: 10.47% (0.3561 => 0.3934, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.47% (0.3543 => 0.3914, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.47% (0.3543 => 0.3914, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.46% (0.1625 => 0.1795, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-3: 10.41% (0.3516 => 0.3882, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.38% (0.3497 => 0.3860, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 10.34% (0.3886 => 0.4288, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.31% (0.4879 => 0.5382, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions: 10.29% (0.3828 => 0.4222, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.29% (0.1438 => 0.1586, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/for-in: 10.26% (0.3694 => 0.4073, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.26% (0.2700 => 0.2977, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.25% (0.6675 => 0.7359, std.dev.: 0.0153) MultiSource/Benchmarks/mafft/pairlocalalign: 10.14% (9.4845 => 10.4466, std.dev.: 0.0095) SingleSource/Benchmarks/McGill/chomp: 10.03% (0.1655 => 0.1821, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/tsp/tsp: 9.96% (0.1175 => 0.1292, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.76% (0.3177 => 0.3487, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/em3d/em3d: 9.68% (0.1695 => 0.1859, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.67% (1.5415 => 1.6906, std.dev.: 0.0063) MultiSource/Applications/d/make_dparser: 9.65% (3.3354 => 3.6571, std.dev.: 0.0105) MultiSource/Applications/aha/aha: 9.56% (0.1151 => 0.1261, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.56% (0.4615 => 0.5056, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/18-imp/imp: 9.47% (0.3423 => 0.3747, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 9.42% (0.3109 => 0.3402, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.30% (0.5105 => 0.5580, std.dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.20% (0.5860 => 0.6399, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.16% (4.2646 => 4.6553, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.14% (0.1510 => 0.1648, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 9.04% (1.1642 => 1.2694, std.dev.: 0.0104) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.02% (0.1940 => 0.2115, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 9.00% (5.7591 => 6.2773, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.98% (0.2271 => 0.2475, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.94% (0.8067 => 0.8788, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.93% (1.3050 => 1.4215, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.88% (0.2107 => 0.2294, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.87% (0.5569 => 0.6063, std.dev.: 0.0049) SingleSource/UnitTests/ObjC++/property-reference-object: 8.77% (0.6030 => 0.6559, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 8.77% (0.1163 => 0.1265, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 8.75% (0.1555 => 0.1691, std.dev.: 0.0041) MultiSource/Applications/lua/lua: 8.73% (3.8723 => 4.2104, std.dev.: 0.0184) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.72% (0.3121 => 0.3393, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.71% (0.8172 => 0.8884, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.68% (0.9765 => 1.0613, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.67% (0.2065 => 0.2244, std.dev.: 0.0034) SingleSource/UnitTests/ObjC++/Hello: 8.66% (0.5925 => 0.6438, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.66% (5.0018 => 5.4348, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.65% (0.3307 => 0.3593, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.60% (8.1363 => 8.8360, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.56% (0.2758 => 0.2994, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.55% (4.9449 => 5.3679, std.dev.: 0.0119) MultiSource/Benchmarks/sim/sim: 8.53% (0.3387 => 0.3676, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.53% (0.4103 => 0.4453, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: 8.53% (0.7835 => 0.8503, std.dev.: 0.0091) MultiSource/Applications/hbd/hbd: 8.50% (1.5603 => 1.6929, std.dev.: 0.0098) MultiSource/Applications/lemon/lemon: 8.40% (1.0722 => 1.1623) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.38% (0.1337 => 0.1449, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 8.30% (2.0273 => 2.1956, std.dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.19% (7.9617 => 8.6138, std.dev.: 0.0234) MultiSource/Applications/siod/siod: 8.16% (2.2969 => 2.4843, std.dev.: 0.0269) MultiSource/Benchmarks/McCat/09-vor/vor: 8.08% (0.3180 => 0.3437, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.99% (0.3441 => 0.3716, std.dev.: 0.0038) SingleSource/UnitTests/ObjC++/property-reference: 7.94% (0.7326 => 0.7908, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.80% (0.4203 => 0.4531, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.79% (0.3826 => 0.4124, std.dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.72% (0.4636 => 0.4994, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 7.72% (0.4289 => 0.4620, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.71% (0.3865 => 0.4163, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/lists: 7.63% (0.3422 => 0.3683, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.61% (1.1861 => 1.2764, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.45% (0.3650 => 0.3922, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.30% (0.6450 => 0.6921, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/hash2: 7.29% (0.4620 => 0.4957, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.26% (0.2905 => 0.3116, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.26% (0.2603 => 0.2792, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.15% (0.3162 => 0.3388, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 7.12% (0.4299 => 0.4605, std.dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 7.10% (21.9371 => 23.4938, std.dev.: 0.0333) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.09% (2.2024 => 2.3585, std.dev.: 0.0574) SingleSource/Benchmarks/Shootout-C++/sieve: 7.08% (0.3603 => 0.3858, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.05% (0.3136 => 0.3357, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.02% (0.2891 => 0.3094, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/football/football: 7.02% (0.8921 => 0.9547, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.97% (0.5981 => 0.6398, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: 6.90% (0.1463 => 0.1564, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 6.89% (0.3684 => 0.3938, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.86% (2.0665 => 2.2082, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 6.71% (0.2831 => 0.3021, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.68% (0.2756 => 0.2940, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.62% (0.2872 => 0.3062, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.61% (0.1695 => 0.1807, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.53% (1.4186 => 1.5112, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/matrix: 6.52% (0.3098 => 0.3300, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 6.51% (0.2871 => 0.3058, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.50% (0.2877 => 0.3064, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.50% (0.3232 => 0.3442, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.50% (0.2725 => 0.2902, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.49% (0.3283 => 0.3496, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.39% (0.3052 => 0.3247, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.34% (0.2793 => 0.2970, std.dev.: 0.0056) MultiSource/Benchmarks/nbench/nbench: 6.33% (1.1840 => 1.2590, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hello: 6.26% (0.2714 => 0.2884, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.98% (0.3379 => 0.3581, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.82% (0.1906 => 0.2017, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.81% (0.1892 => 0.2002, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.43% (0.8101 => 0.8541, std.dev.: 0.0088) MultiSource/Applications/hexxagon/hexxagon: 5.08% (1.2842 => 1.3495, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.91% (14.3668 => 15.0719, std.dev.: 0.0494) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.49% (0.3427 => 0.3581, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 4.34% (17.1811 => 17.9274, std.dev.: 0.0198) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.32% (0.2430 => 0.2535, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.01% (3.8922 => 4.0482, std.dev.: 0.0548) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.13% (1.1194 => 1.1544, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.86% (0.3817 => 0.3926, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.51% (5.3999 => 13.3115, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.25% (1.1145 => 1.3848, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.79% (1.1396 => 1.2512, std.dev.: 0.0037) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 9.21% (3.1595 => 3.4506, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.62% (3.1578 => 3.3669, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0013) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.42% (3.6395 => 3.7641, std.dev.: 0.0191) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.72% (4.2280 => 4.3428, std.dev.: 0.0302) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.33% (1.7254 => 1.7656, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (0.8275 => 0.8405, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.46% (0.9540 => 0.9679, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8131, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.25% (2.6546 => 2.6879, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.05% (6.6874 => 0.1307, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: -79.93% (0.8651 => 0.1736, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.06% (5.2763 => 3.2680, std.dev.: 0.0142) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.48% (5.3855 => 3.6904, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.12% (5.3526 => 3.6867, std.dev.: 0.0051) SingleSource/UnitTests/Vector/constpool: -14.68% (54.1659 => 46.2125, std.dev.: 0.0367) MultiSource/Applications/ClamAV/clamscan: -12.34% (22.1758 => 19.4395, std.dev.: 0.0600) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.46% (2.9384 => 2.6309, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -33.44% (1.1492 => 0.7649, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: -15.95% (1.6925 => 1.4225, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.23% (0.0998 => 0.0856, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -11.24% (1.2373 => 1.0982, std.dev.: 0.0286) SingleSource/Benchmarks/Misc/mandel-2: -10.46% (1.5373 => 1.3765, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/mason/mason: -10.09% (0.2161 => 0.1943, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.35% (19.9488 => 18.2839, std.dev.: 0.0294) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.73% (1.8329 => 1.7095, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.32% (1.6805 => 1.5911, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: -5.03% (1.5835 => 1.5039, std.dev.: 0.0057) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0029) MultiSource/Applications/siod/siod: -3.61% (3.2827 => 3.1641, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.39% (0.9957 => 0.9619, std.dev.: 0.0048) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4957, std.dev.: 0.0077) MultiSource/Applications/hexxagon/hexxagon: -2.99% (12.4730 => 12.0995, std.dev.: 0.0016) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.12% (8.1563 => 7.9834, std.dev.: 0.0189) SingleSource/Benchmarks/Misc/salsa20: -1.95% (10.2830 => 10.0821, std.dev.: 0.0231) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.88% (8.6802 => 8.5170, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6796, std.dev.: 0.0023) SingleSource/UnitTests/Vector/multiplies: -1.67% (2.5528 => 2.5102, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4207, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout/lists: -1.33% (6.2999 => 6.2158, std.dev.: 0.0108) MultiSource/Applications/sqlite3/sqlite3: -1.13% (4.6441 => 4.5918, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8575, std.dev.: 0.0044) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 14.09% (0.5229 => 0.5966, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 9.70% (14.9895 => 16.4438, std.dev.: 0.0284) MultiSource/Benchmarks/MallocBench/gs/gs: 8.10% (4.1105 => 4.4436, std.dev.: 0.0183) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.03% (1.1048 => 1.2598, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.97% (7.1582 => 7.8717, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.66% (0.6222 => 0.7445, std.dev.: 0.0177) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35900.00% (0.0001 => 0.0360, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.47% (0.2116 => 0.0646, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 12 01:23:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 12 Oct 2012 03:23:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121012082314.6BF232A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4811?compare_to=4809&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4811, Order: 165788, Start Time: 2012-10-12 06:57:03, End Time: 2012-10-12 08:24:49 To: 4809, Order: 165786, Start Time: 2012-10-12 05:02:06, End Time: 2012-10-12 06:27:53 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (176 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1042 (689 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.47% (2.0176 => 2.4912, std.dev.: 0.0058) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.01% (0.1410 => 0.1664, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 17.07% (0.0826 => 0.0967, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.85% (0.0653 => 0.0763, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 16.41% (0.2243 => 0.2611, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.11% (0.1072 => 0.1234, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 13.82% (0.1013 => 0.1153, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.72% (0.1327 => 0.1509, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 13.37% (0.7038 => 0.7979, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.31% (0.0834 => 0.0945, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.25% (0.0770 => 0.0872, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.09% (0.1413 => 0.1598, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 12.75% (1.3693 => 1.5439, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.45% (3.9660 => 4.4599, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.34% (0.0964 => 0.1083, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.28% (0.1588 => 0.1783, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.24% (0.2721 => 0.3054, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.17% (0.2596 => 0.2912, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.13% (1.4563 => 1.6329, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 12.08% (0.4328 => 0.4851, std.dev.: 0.0065) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.96% (0.7710 => 0.8632, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.87% (0.9199 => 1.0291, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.87% (0.5265 => 0.5890, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 11.86% (0.1062 => 0.1188, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.86% (0.6959 => 0.7784, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 11.69% (0.4062 => 0.4537, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.68% (0.6283 => 0.7017, std.dev.: 0.0206) MultiSource/Applications/SPASS/SPASS: 11.65% (13.8202 => 15.4308, std.dev.: 0.0110) MultiSource/Benchmarks/Olden/power/power: 11.47% (0.1003 => 0.1118, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.46% (1.2193 => 1.3590, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 11.44% (0.7061 => 0.7869, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.39% (0.3899 => 0.4343, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference-object: 11.36% (0.5818 => 0.6479, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.32% (1.1364 => 1.2650, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 11.10% (0.5748 => 0.6386, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.96% (0.5577 => 0.6188, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.86% (0.2127 => 0.2358, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 10.85% (1.0313 => 1.1432, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.83% (0.4016 => 0.4451, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.82% (0.3485 => 0.3862, std.dev.: 0.0080) MultiSource/Applications/Burg/burg: 10.78% (1.1061 => 1.2253, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.71% (0.4791 => 0.5304, std.dev.: 0.0192) SingleSource/Regression/C++/ofstream_ctor: 10.68% (0.2781 => 0.3078, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.66% (0.3022 => 0.3344, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.64% (0.3130 => 0.3463, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 10.62% (16.6129 => 18.3771, std.dev.: 0.0240) SingleSource/Benchmarks/Shootout-C++/lists: 10.42% (0.3293 => 0.3636, std.dev.: 0.0068) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.34% (0.4390 => 0.4844, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.34% (0.3580 => 0.3950, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.29% (0.3489 => 0.3848, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.24% (0.0977 => 0.1077, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.21% (0.2782 => 0.3066, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/18-imp/imp: 10.19% (0.3220 => 0.3548, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 10.18% (0.2995 => 0.3300, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.16% (0.4379 => 0.4824, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.14% (0.1075 => 0.1184, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 10.13% (0.1589 => 0.1750, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.08% (0.2966 => 0.3265, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 10.05% (0.2726 => 0.3000, std.dev.: 0.0064) MultiSource/Applications/minisat/minisat: 10.04% (0.6744 => 0.7421, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary3: 10.00% (0.3149 => 0.3464, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.99% (0.2914 => 0.3205, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 9.98% (0.3107 => 0.3417, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.97% (0.7460 => 0.8204, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 9.96% (3.8646 => 4.2497, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.96% (1.9828 => 2.1802, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.92% (0.3246 => 0.3568, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 9.85% (3.1889 => 3.5029, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/sieve: 9.85% (0.3453 => 0.3793, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.81% (0.1865 => 0.2048, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/mst/mst: 9.81% (0.1111 => 0.1220, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.81% (0.8698 => 0.9551, std.dev.: 0.0224) MultiSource/Applications/siod/siod: 9.80% (2.1791 => 2.3927, std.dev.: 0.0071) MultiSource/Applications/spiff/spiff: 9.75% (0.7506 => 0.8238, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 9.75% (0.8310 => 0.9120, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/except: 9.75% (0.2760 => 0.3029, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 9.74% (0.1478 => 0.1622, std.dev.: 0.0016) MultiSource/Applications/treecc/treecc: 9.70% (1.9270 => 2.1140, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.68% (0.2655 => 0.2912, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 9.67% (0.2690 => 0.2950, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hello: 9.63% (0.2607 => 0.2858, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary2: 9.62% (0.3192 => 0.3499, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.62% (0.1986 => 0.2177, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.62% (0.1435 => 0.1573, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.59% (0.2023 => 0.2217, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 9.57% (0.2937 => 0.3218, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.54% (0.5637 => 0.6175, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 9.51% (0.2628 => 0.2878, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.51% (0.2765 => 0.3028, std.dev.: 0.0082) MultiSource/Benchmarks/McCat/09-vor/vor: 9.50% (0.2925 => 0.3203, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 9.39% (1.0594 => 1.1589, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.35% (7.2180 => 7.8928, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/matrix: 9.17% (0.2988 => 0.3262, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.12% (0.2696 => 0.2942, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.02% (1.3245 => 1.4440, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.02% (4.9865 => 5.4362, std.dev.: 0.1460) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.01% (0.1276 => 0.1391, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 9.00% (0.2945 => 0.3210, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/em3d/em3d: 8.99% (0.1657 => 0.1806, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.68% (0.3755 => 0.4081, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.63% (3.6692 => 3.9858, std.dev.: 0.0057) MultiSource/Applications/SIBsim4/SIBsim4: 8.61% (1.2749 => 1.3847, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.57% (0.6135 => 0.6661, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.56% (0.6576 => 0.7139, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 8.51% (14.8535 => 16.1174, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.50% (4.4433 => 4.8208, std.dev.: 0.0028) MultiSource/Benchmarks/sim/sim: 8.50% (0.3131 => 0.3397, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.50% (4.3801 => 4.7522, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.45% (0.8818 => 0.9563, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 8.23% (8.4961 => 9.1950, std.dev.: 0.0127) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.04% (0.2140 => 0.2312, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.94% (0.1789 => 0.1931, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.82% (3.2742 => 3.5303, std.dev.: 0.0960) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.80% (0.3511 => 0.3785, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 7.80% (4.6629 => 5.0266, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.80% (0.2321 => 0.2502, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.76% (1.1333 => 1.2212, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.70% (0.9108 => 0.9809, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 7.68% (0.4113 => 0.4429, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.64% (0.4003 => 0.4309, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 7.51% (0.1385 => 0.1489, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 7.41% (0.3914 => 0.4204, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.36% (0.3940 => 0.4230, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 7.32% (3.7467 => 4.0208, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.31% (0.2504 => 0.2687, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 7.29% (6.5754 => 7.0548, std.dev.: 0.0154) MultiSource/Applications/hexxagon/hexxagon: 7.28% (1.2292 => 1.3187, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.27% (0.3245 => 0.3481, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.14% (2.1007 => 2.2506, std.dev.: 0.0450) SingleSource/UnitTests/ObjC/for-in: 7.05% (0.3789 => 0.4056, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 7.04% (0.3578 => 0.3830, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.04% (0.3650 => 0.3907, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 6.97% (0.3601 => 0.3852, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.93% (0.3663 => 0.3917, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.91% (0.3646 => 0.3898, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.85% (0.3623 => 0.3871, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.60% (6.2785 => 6.6929, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.53% (13.2842 => 14.1512, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.43% (0.1819 => 0.1936, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.22% (0.2243 => 0.2360, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 4.83% (16.2614 => 17.0474, std.dev.: 0.0040) MultiSource/Applications/ClamAV/clamscan: 4.39% (14.5298 => 15.1675, std.dev.: 0.0069) MultiSource/Benchmarks/Bullet/bullet: 2.04% (33.2944 => 33.9727, std.dev.: 0.0256) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5158, std.dev.: 0.0278) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 24.58% (1.8175 => 2.2642, std.dev.: 0.0467) SingleSource/Benchmarks/Misc/richards_benchmark: 11.22% (1.1560 => 1.2857, std.dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/ffbench: 9.04% (0.8273 => 0.9021, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.65% (3.1736 => 3.4163, std.dev.: 0.0152) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 6.19% (1.2998 => 1.3802, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.83% (0.2093 => 0.2194, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.80% (0.3458 => 0.3624, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.78% (1.9144 => 2.0059, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std.dev.: 0.0059) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6771, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9858, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 3.26% (10.7476 => 11.0977, std.dev.: 0.0434) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 2.15% (7.4271 => 7.5865, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4540, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0075) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5121, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9688, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1872, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5779, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0266, std.dev.: 0.0143) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.93% (0.2670 => 0.1417, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.95% (0.4657 => 0.3914, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -14.57% (0.0707 => 0.0604, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.26% (1.3813 => 1.1982, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.19% (1.3819 => 1.1996, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.46% (22.5627 => 22.2334, std.dev.: 0.0126) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.34% (0.0997 => 0.0864, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -11.89% (0.2238 => 0.1972, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -11.13% (1.2308 => 1.0938, std.dev.: 0.0111) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.09% (20.3410 => 18.2881, std.dev.: 0.0116) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std.dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.67% (1.3780 => 1.2999, std.dev.: 0.0297) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5149, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.68% (0.9996 => 0.9528, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0019) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8005, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.56% (3.2729 => 3.1564, std.dev.: 0.0251) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.46% (1.7688 => 1.7076, std.dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.92% (0.4867 => 0.4725, std.dev.: 0.0018) MultiSource/Applications/lua/lua: -2.62% (26.5159 => 25.8210, std.dev.: 0.0230) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: -2.53% (3.0263 => 2.9497, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: -2.39% (1.9762 => 1.9289, std.dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std.dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7138, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/lists: -1.68% (6.3560 => 6.2493, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: -1.44% (4.5928 => 4.5266, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0078, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8645, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2568, std.dev.: 0.0005) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 12 02:12:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 12 Oct 2012 04:12:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121012091207.6A1902A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4812?compare_to=4810&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4812, Order: 165788, Start Time: 2012-10-12 07:53:48, End Time: 2012-10-12 09:13:58 To: 4810, Order: 165787, Start Time: 2012-10-12 06:02:40, End Time: 2012-10-12 07:24:13 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (164 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 952 (680 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.22% (15.4051 => 15.5928, std.dev.: 0.0070) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.17% (0.5966 => 0.5956, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 0.35% (16.4438 => 16.5021, std.dev.: 0.0056) MultiSource/Benchmarks/Bullet/bullet: 0.16% (55.3043 => 55.3940, std.dev.: 0.0642) MultiSource/Benchmarks/MallocBench/gs/gs: 0.11% (4.4436 => 4.4484, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.43% (0.0462 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.22% (0.0464 => 0.0463, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.46% (0.0433 => 0.0431) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.23% (0.0433 => 0.0432, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.24% (0.0421 => 0.0420, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.47% (0.0424 => 0.0422, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0416 => 0.0416, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.24% (0.0417 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.46% (0.0434 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.46% (0.0435 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.23% (0.0428 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.47% (0.0430 => 0.0428) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.24% (0.0418 => 0.0417, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0419 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.24% (0.0425 => 0.0424) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.47% (0.0427 => 0.0425) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.23% (0.0436 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.23% (0.0439 => 0.0440, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.24% (0.0413 => 0.0412, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.24% (0.0414 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.24% (0.0425 => 0.0424) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.23% (0.0426 => 0.0425) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.48% (0.0417 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.24% (0.0418 => 0.0417, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.24% (0.0409 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.24% (0.0410 => 0.0409) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.49% (0.0407 => 0.0405, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.49% (0.0409 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.45% (0.0444 => 0.0442, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.45% (0.0446 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.49% (0.0407 => 0.0405, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.49% (0.0408 => 0.0406) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.25% (0.0407 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.49% (0.0409 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.24% (0.0416 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.48% (0.0417 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.17% (1.2598 => 1.2619, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.01% (7.8717 => 7.8711, std.dev.: 0.0184) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.20% (0.7445 => 0.7430, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.28% (0.0360 => 0.0361, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1433 => 0.1432, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0646 => 0.0645, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.41% (63.2438 => 55.3940, std.dev.: 0.0642) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.69% (14.1553 => 19.0657, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.83% (3.4629 => 5.6734, std.dev.: 0.0014) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14235.14% (0.0720 => 10.3213, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952500.00% (0.0001 => 9.9526, std.dev.: 0.0011) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 64.17% (0.2554 => 0.4193, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 50.40% (10.3673 => 15.5928, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/richards_benchmark: 38.59% (0.1622 => 0.2248, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/distray/distray: 33.71% (0.1056 => 0.1412, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 18.58% (0.1432 => 0.1698, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.59% (7.0540 => 8.2947, std.dev.: 0.0144) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.62% (2.2022 => 2.5682, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.96% (0.1566 => 0.1816, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.44% (1.7609 => 1.9975, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.09% (0.0871 => 0.0985, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.69% (0.1143 => 0.1288, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 12.57% (0.1440 => 0.1621) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 12.18% (0.1584 => 0.1777, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 12.13% (0.3282 => 0.3680, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 11.35% (0.7433 => 0.8277, std.dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 10.92% (10.4361 => 11.5760, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.71% (0.1625 => 0.1799, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.70% (0.4879 => 0.5401, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: 10.68% (0.7115 => 0.7875, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.57% (0.1438 => 0.1590, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.52% (0.3927 => 0.4340, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.48% (0.2700 => 0.2983, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 10.48% (0.3473 => 0.3837, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.39% (0.3543 => 0.3911, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.37% (0.6675 => 0.7367, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.36% (0.3561 => 0.3930, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.36% (0.3543 => 0.3910, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 10.35% (0.3516 => 0.3880, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-2: 10.29% (0.3497 => 0.3857, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.24% (0.3828 => 0.4220, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 10.22% (9.4845 => 10.4541, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/tsp/tsp: 10.21% (0.1175 => 0.1295, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.19% (0.3886 => 0.4282, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 10.15% (0.1655 => 0.1823, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/for-in: 10.12% (0.3694 => 0.4068, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 10.08% (0.1151 => 0.1267, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.07% (0.3177 => 0.3497, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.04% (1.5415 => 1.6962, std.dev.: 0.0056) MultiSource/Applications/d/make_dparser: 9.85% (3.3354 => 3.6638, std.dev.: 0.0045) MultiSource/Applications/sgefa/sgefa: 9.81% (0.3109 => 0.3414, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.71% (0.1236 => 0.1356, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.69% (0.4615 => 0.5062, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/em3d/em3d: 9.68% (0.1695 => 0.1859, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/18-imp/imp: 9.67% (0.3423 => 0.3754, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.46% (0.5105 => 0.5588, std.dev.: 0.0034) MultiSource/Applications/oggenc/oggenc: 9.43% (5.7591 => 6.3023, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.38% (4.2646 => 4.6647, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.33% (0.5860 => 0.6407, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.28% (0.1940 => 0.2120, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.27% (0.1510 => 0.1650, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.21% (1.3050 => 1.4252, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.20% (0.2271 => 0.2480, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 9.13% (1.1642 => 1.2705, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.12% (0.5569 => 0.6077, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.04% (0.8067 => 0.8796, std.dev.: 0.0091) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.97% (0.2107 => 0.2296, std.dev.: 0.0021) MultiSource/Applications/lua/lua: 8.97% (3.8723 => 4.2195, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.90% (0.9765 => 1.0634, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.89% (5.0018 => 5.4466, std.dev.: 0.0124) MultiSource/Benchmarks/Olden/mst/mst: 8.86% (0.1163 => 0.1266, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.82% (4.9449 => 5.3810, std.dev.: 0.0065) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.81% (0.3121 => 0.3396, std.dev.: 0.0039) MultiSource/Applications/hbd/hbd: 8.78% (1.5603 => 1.6973, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.75% (0.5020 => 0.5459, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.74% (0.2758 => 0.2999, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.73% (8.1363 => 8.8467, std.dev.: 0.0120) MultiSource/Applications/spiff/spiff: 8.68% (0.7835 => 0.8515, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.66% (0.8172 => 0.8880, std.dev.: 0.0049) MultiSource/Applications/viterbi/viterbi: 8.62% (0.1555 => 0.1689, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.57% (0.2065 => 0.2242, std.dev.: 0.0034) MultiSource/Applications/lemon/lemon: 8.57% (1.0722 => 1.1641, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 8.57% (0.6456 => 0.7009, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.56% (0.3307 => 0.3590, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.53% (0.1337 => 0.1451, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 8.49% (2.0273 => 2.1995, std.dev.: 0.0153) MultiSource/Benchmarks/sim/sim: 8.39% (0.3387 => 0.3671, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 8.33% (0.6030 => 0.6532, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/Hello: 8.32% (0.5925 => 0.6418, std.dev.: 0.0048) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.32% (7.9617 => 8.6241, std.dev.: 0.0194) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.21% (0.4103 => 0.4440, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.21% (1.5859 => 1.7161, std.dev.: 0.0015) MultiSource/Applications/siod/siod: 8.18% (2.2969 => 2.4848, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.14% (0.3441 => 0.3721, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 8.05% (0.3180 => 0.3436, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.85% (0.4203 => 0.4533, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.81% (1.1861 => 1.2787, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 7.62% (0.4289 => 0.4616, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 7.56% (0.7326 => 0.7880, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.53% (0.6450 => 0.6936, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.50% (0.3865 => 0.4155, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.41% (0.2603 => 0.2796, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 7.36% (0.3422 => 0.3674, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.34% (2.2024 => 2.3640, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 7.32% (0.8921 => 0.9574, std.dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 7.27% (21.9371 => 23.5324, std.dev.: 0.0196) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.24% (0.3826 => 0.4103, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.23% (0.3650 => 0.3914, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 7.19% (0.4299 => 0.4608, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 7.08% (0.4620 => 0.4947, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.02% (0.5981 => 0.6401, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 7.02% (0.4048 => 0.4332, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 6.97% (0.1463 => 0.1565, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.88% (0.4636 => 0.4955, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.84% (0.1695 => 0.1811, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.83% (0.3162 => 0.3378, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.79% (1.4186 => 1.5149, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/sieve: 6.77% (0.3603 => 0.3847, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.73% (0.3136 => 0.3347, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 6.65% (0.3684 => 0.3929, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 6.61% (1.1840 => 1.2623, std.dev.: 0.0053) SingleSource/Regression/C++/ofstream_ctor: 6.61% (0.2905 => 0.3097, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.61% (0.2891 => 0.3082, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.38% (2.0665 => 2.1983, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/strcat: 6.32% (0.2831 => 0.3010, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.31% (0.2266 => 0.2409, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.29% (0.2877 => 0.3058, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.20% (0.3098 => 0.3290, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.17% (0.2756 => 0.2926, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.16% (0.2872 => 0.3049, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.15% (0.3283 => 0.3485, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.13% (0.2871 => 0.3047, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.09% (0.1906 => 0.2022, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.08% (0.1892 => 0.2007, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.06% (0.3232 => 0.3428, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.03% (0.3052 => 0.3236, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 5.94% (0.2725 => 0.2887, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.91% (0.2793 => 0.2958, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 5.82% (0.2802 => 0.2965, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.75% (0.2714 => 0.2870, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 5.74% (0.3379 => 0.3573, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.63% (0.4064 => 0.4293, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.51% (0.8101 => 0.8547, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/ReedSolomon: 5.22% (0.2049 => 0.2156, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.22% (14.3668 => 15.1164, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/objinst: 5.01% (0.3131 => 0.3288, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.93% (0.3427 => 0.3596, std.dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 4.84% (1.2842 => 1.3463, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 4.46% (17.1811 => 17.9472, std.dev.: 0.1390) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.44% (0.2430 => 0.2538, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.25% (3.8922 => 4.0577, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/bh/bh: 3.43% (0.3092 => 0.3198, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.35% (1.1194 => 1.1569, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.75% (0.3817 => 0.3922, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3124, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.99% (0.1421 => 0.1563, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: 9.82% (1.1396 => 1.2515, std.dev.: 0.0019) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4498, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3691, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.46% (3.6395 => 3.7653, std.dev.: 0.0043) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.78% (4.2280 => 4.3455, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (0.8275 => 0.8405, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8128, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.33% (0.9540 => 0.9667, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.18% (2.6546 => 2.6858, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/queens: 1.11% (2.1825 => 2.2068, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1312, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -79.91% (0.8651 => 0.1738, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.01% (5.2763 => 3.2709, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.37% (5.3855 => 3.6960, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.04% (5.3526 => 3.6910, std.dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: -14.65% (54.1659 => 46.2316, std.dev.: 0.0067) MultiSource/Applications/ClamAV/clamscan: -11.97% (22.1758 => 19.5213, std.dev.: 0.2123) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.44% (2.9384 => 2.6316, std.dev.: 0.0165) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.43% (1.1492 => 0.7650, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -15.86% (1.6925 => 1.4241, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.53% (0.0998 => 0.0863, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.43% (1.2373 => 1.0959, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -10.38% (1.5373 => 1.3778, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/mason/mason: -10.27% (0.2161 => 0.1939, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.23% (19.9488 => 18.3064, std.dev.: 0.0641) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.67% (1.8329 => 1.7106, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.33% (1.6805 => 1.5910, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.69% (1.5835 => 1.5093, std.dev.: 0.0039) MultiSource/Applications/siod/siod: -3.76% (3.2827 => 3.1594, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.53% (0.9957 => 0.9606, std.dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5014, std.dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0993, std.dev.: 0.0015) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.08% (0.4808 => 0.4708, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -2.01% (10.2830 => 10.0761, std.dev.: 0.0114) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.94% (8.6802 => 8.5115, std.dev.: 0.0122) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.77% (8.1563 => 8.0117, std.dev.: 0.0117) SingleSource/UnitTests/Vector/multiplies: -1.76% (2.5528 => 2.5079, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6829, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.51% (9.5636 => 9.4195, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -1.17% (6.2999 => 6.2259, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8568, std.dev.: 0.0174) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.90% (0.5229 => 0.5956, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 10.09% (14.9895 => 16.5021, std.dev.: 0.0056) MultiSource/Benchmarks/MallocBench/gs/gs: 8.22% (4.1105 => 4.4484, std.dev.: 0.0166) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.22% (1.1048 => 1.2619, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.96% (7.1582 => 7.8711, std.dev.: 0.0184) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.41% (0.6222 => 0.7430, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36000.00% (0.0001 => 0.0361, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.52% (0.2116 => 0.0645, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 12 02:15:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 12 Oct 2012 04:15:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121012091538.6AA882A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4813?compare_to=4808&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4813, Order: 165787, Start Time: 2012-10-12 06:04:42, End Time: 2012-10-12 09:17:25 To: 4808, Order: 165781, Start Time: 2012-10-12 02:25:34, End Time: 2012-10-12 05:35:29 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (127 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1041 (763 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 7.05% (0.2142 => 0.2293, std.dev.: 0.0011) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 11.81% (0.3488 => 0.3900, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/exceptions-2: 11.17% (0.3446 => 0.3831, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.16% (0.3496 => 0.3886, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 11.14% (0.3465 => 0.3851, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 11.10% (0.3442 => 0.3824, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.07% (0.3460 => 0.3843, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.04% (0.3469 => 0.3852, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.93% (0.3650 => 0.4049, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 10.82% (0.3643 => 0.4037, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.74% (0.3724 => 0.4124, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.93% (0.5826 => 0.6346, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 8.87% (0.1218 => 0.1326, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.80% (0.5889 => 0.6407, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 8.71% (0.1619 => 0.1760, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.25% (0.4994 => 0.5406, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.14% (0.2875 => 0.3109, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 8.08% (1.5932 => 1.7220, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.01% (1.6211 => 1.7509, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.84% (0.4361 => 0.4703, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 7.83% (0.2566 => 0.2767, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.76% (0.3195 => 0.3443, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 7.73% (5.5417 => 5.9700, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.72% (1.3152 => 1.4167, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/hash: 7.69% (0.4146 => 0.4465, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.67% (0.2738 => 0.2948, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.65% (0.1620 => 0.1744, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.63% (3.5627 => 3.8347, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 7.62% (0.3004 => 0.3233, std.dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: 7.59% (0.9909 => 1.0661, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/strcat: 7.56% (0.2750 => 0.2958, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.56% (0.5026 => 0.5406, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/fibo: 7.56% (0.2725 => 0.2931, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.56% (0.3930 => 0.4227, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hello: 7.55% (0.2714 => 0.2919, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 7.55% (0.2823 => 0.3036, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 7.54% (1.0781 => 1.1594, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 7.54% (0.2813 => 0.3025, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 7.53% (0.1421 => 0.1528, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.51% (0.5900 => 0.6343, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.48% (0.5000 => 0.5374, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.48% (2.0673 => 2.2219, std.dev.: 0.0532) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.48% (0.2729 => 0.2933, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 7.46% (0.2803 => 0.3012, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.45% (0.2792 => 0.3000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 7.44% (0.3348 => 0.3597, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference: 7.43% (0.7171 => 0.7704, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/except: 7.33% (0.2811 => 0.3017, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 7.32% (0.4847 => 0.5202, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/matrix: 7.30% (0.2780 => 0.2983, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.30% (0.2014 => 0.2161, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.28% (2.7292 => 2.9279, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/wc: 7.27% (0.3096 => 0.3321, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 7.24% (0.6634 => 0.7114, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 7.22% (0.3267 => 0.3503, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 7.18% (0.3258 => 0.3492, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 7.15% (0.4029 => 0.4317, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.13% (0.3845 => 0.4119, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/moments: 7.10% (0.3678 => 0.3939, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 7.09% (0.3726 => 0.3990, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.05% (0.2736 => 0.2929, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 6.96% (0.3317 => 0.3548, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 6.96% (0.9697 => 1.0372, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.94% (4.4195 => 4.7261, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.93% (0.4139 => 0.4426, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 6.93% (1.8794 => 2.0096, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.92% (0.3625 => 0.3876, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 6.87% (0.3477 => 0.3716, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 6.85% (0.4251 => 0.4542, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 6.84% (4.2109 => 4.4989, std.dev.: 0.0209) MultiSource/Benchmarks/McCat/09-vor/vor: 6.78% (0.1505 => 0.1607, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.76% (0.3903 => 0.4167, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.75% (0.3690 => 0.3939, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.71% (0.1549 => 0.1653, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.66% (0.2866 => 0.3057, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.51% (0.3981 => 0.4240, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.40% (0.2969 => 0.3159, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.39% (0.3084 => 0.3281, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 6.38% (0.5012 => 0.5332, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 6.38% (1.4269 => 1.5179, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.37% (0.6435 => 0.6845, std.dev.: 0.0023) MultiSource/Applications/Burg/burg: 6.36% (0.5546 => 0.5899, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.35% (0.1968 => 0.2093, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.35% (0.3890 => 0.4137, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.31% (0.4658 => 0.4952, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.24% (0.3271 => 0.3475, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 6.16% (2.1653 => 2.2986, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.14% (0.2737 => 0.2905, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 6.12% (0.3336 => 0.3540, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.09% (0.2068 => 0.2194) MultiSource/Applications/JM/lencod/lencod: 6.02% (4.6177 => 4.8957, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.94% (0.2103 => 0.2228, std.dev.: 0.0041) MultiSource/Applications/SIBsim4/SIBsim4: 5.87% (0.2691 => 0.2849, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.71% (0.7426 => 0.7850, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 5.65% (0.7875 => 0.8320, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.60% (1.9694 => 2.0796, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 5.54% (0.2075 => 0.2190, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.48% (1.9966 => 2.1061, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.34% (0.2040 => 0.2149, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 5.26% (2.0346 => 2.1416, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.15% (0.5361 => 0.5637, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 5.03% (0.3498 => 0.3674, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 4.81% (0.2391 => 0.2506, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.69% (0.5584 => 0.5846, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.06% (4.6926 => 4.8833, std.dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: 2.87% (11.9555 => 12.2981, std.dev.: 0.0183) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.56% (0.4253 => 0.4362, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-1: 22.63% (6.2401 => 7.6525, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 8.06% (0.2122 => 0.2293, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6096, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (12.0509 => 12.6782, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-2: 4.85% (1.8057 => 1.8933, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 4.85% (15.4430 => 16.1916, std.dev.: 0.1288) SingleSource/Benchmarks/Dhrystone/dry: 4.19% (14.0481 => 14.6374, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1940, std.dev.: 0.0093) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.71% (3.1722 => 3.2265, std.dev.: 0.0026) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3099, std.dev.: 0.0113) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2875, std.dev.: 0.0023) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.39% (1.0142 => 1.0283, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.31% (1.0927 => 1.1070, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5140, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5946, std.dev.: 0.0152) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.57% (2.4764 => 2.4127, std.dev.: 0.0053) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.89% (25.4195 => 16.5503, std.dev.: 0.0192) SingleSource/Benchmarks/Shootout-C++/ary2: -8.16% (0.2402 => 0.2206, std.dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9749, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7935, std.dev.: 0.0081) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7986, std.dev.: 0.0120) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0025) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7734, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.31% (17.2379 => 16.8389, std.dev.: 0.0407) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8631, std.dev.: 0.3307) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5780, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4954, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.11% (105.3826 => 104.2161, std.dev.: 0.0659) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0466, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 12 03:18:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 12 Oct 2012 05:18:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121012101837.DDF9A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4814?compare_to=4811&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4814, Order: 165790, Start Time: 2012-10-12 08:54:29, End Time: 2012-10-12 10:20:28 To: 4811, Order: 165788, Start Time: 2012-10-12 06:57:03, End Time: 2012-10-12 08:24:49 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (188 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1040 (675 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 14.27% (0.4303 => 0.4917, std.dev.: 0.0157) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.74% (78.0229 => 80.1577, std.dev.: 0.4028) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.41% (2.0176 => 2.4900, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.09% (0.1410 => 0.1665, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 17.07% (0.0826 => 0.0967, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.85% (0.0653 => 0.0763, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 16.41% (0.2243 => 0.2611, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.11% (0.1072 => 0.1234, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 13.72% (0.1013 => 0.1152, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.72% (0.1327 => 0.1509, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 13.34% (0.7038 => 0.7977, std.dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.31% (0.0834 => 0.0945, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.12% (0.0770 => 0.0871, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.09% (0.1413 => 0.1598, std.dev.: 0.0028) MultiSource/Applications/hbd/hbd: 12.85% (1.3693 => 1.5452, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.37% (3.9660 => 4.4565, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.34% (0.0964 => 0.1083, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.28% (0.1588 => 0.1783, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.27% (0.2721 => 0.3055, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.10% (0.2596 => 0.2910, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.06% (0.7710 => 0.8640, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.04% (1.4563 => 1.6317, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 12.01% (0.4328 => 0.4848, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 11.92% (0.4062 => 0.4546, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.88% (0.6959 => 0.7786, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.79% (0.5265 => 0.5886, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.73% (0.9199 => 1.0278, std.dev.: 0.0024) MultiSource/Applications/aha/aha: 11.68% (0.1062 => 0.1186, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 11.67% (13.8202 => 15.4330, std.dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.58% (1.2193 => 1.3605, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.55% (0.6283 => 0.7009, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.46% (0.3899 => 0.4346, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: 11.37% (0.1003 => 0.1117, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 11.33% (0.7061 => 0.7861, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 11.24% (0.5818 => 0.6472, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.21% (1.1364 => 1.2638, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 11.07% (0.1111 => 0.1234, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 10.94% (0.5748 => 0.6377, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.85% (0.5577 => 0.6182, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 10.82% (1.0313 => 1.1429, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 10.75% (0.2781 => 0.3080, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.73% (0.3130 => 0.3466, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.73% (0.4016 => 0.4447, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.73% (0.3485 => 0.3859, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.72% (0.1157 => 0.1281, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 10.70% (1.1061 => 1.2244, std.dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 10.63% (16.6129 => 18.3795, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.55% (0.3489 => 0.3857, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.53% (0.3580 => 0.3957, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.52% (0.4390 => 0.4852, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.49% (0.3022 => 0.3339, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.49% (0.2966 => 0.3277, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 10.45% (0.3293 => 0.3637, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.39% (0.4791 => 0.5289, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 10.39% (0.6744 => 0.7445, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.28% (0.3756 => 0.4142, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 10.26% (0.3868 => 0.4265, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.23% (0.1075 => 0.1185, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.17% (0.3246 => 0.3576, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.14% (0.2782 => 0.3064, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 10.12% (3.8646 => 4.2558, std.dev.: 0.0037) MultiSource/Applications/sgefa/sgefa: 10.12% (0.2995 => 0.3298, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 10.10% (0.3149 => 0.3467) SingleSource/Benchmarks/Shootout-C++/strcat: 10.09% (0.2726 => 0.3001, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 10.07% (0.3107 => 0.3420, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.07% (0.4379 => 0.4820, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 10.07% (0.1589 => 0.1749, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 10.07% (0.2761 => 0.3039, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.03% (1.9828 => 2.1817, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.02% (0.2655 => 0.2921, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 9.99% (0.3453 => 0.3798, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 9.91% (0.7506 => 0.8250, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.88% (0.2914 => 0.3202, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.83% (0.8698 => 0.9553, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 9.83% (3.1889 => 3.5023, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.83% (0.2127 => 0.2336, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 9.78% (0.3220 => 0.3535, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 9.76% (1.9270 => 2.1150, std.dev.: 0.0062) MultiSource/Applications/viterbi/viterbi: 9.74% (0.1478 => 0.1622, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary2: 9.71% (0.3192 => 0.3502, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 9.71% (0.2760 => 0.3028, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.68% (0.7460 => 0.8182, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 9.67% (2.1791 => 2.3899, std.dev.: 0.0177) MultiSource/Benchmarks/Prolangs-C/football/football: 9.66% (0.8310 => 0.9113, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.64% (0.2023 => 0.2218, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 9.63% (0.2690 => 0.2949, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.62% (0.1435 => 0.1573, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.60% (0.1865 => 0.2044, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.60% (0.5637 => 0.6178, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.57% (0.1986 => 0.2176, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 9.56% (0.3534 => 0.3872, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 9.53% (0.2937 => 0.3217, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 9.51% (0.2607 => 0.2855, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.48% (0.2765 => 0.3027, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 9.47% (0.2628 => 0.2877, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 9.47% (0.2925 => 0.3202, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.43% (0.1569 => 0.1717, std.dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: 9.42% (1.0594 => 1.1592, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.31% (7.2180 => 7.8900, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 9.17% (0.2988 => 0.3262, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.12% (4.9865 => 5.4415, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.12% (0.2696 => 0.2942, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.09% (0.1276 => 0.1392, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 8.87% (0.1657 => 0.1804, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 8.83% (0.2945 => 0.3205, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.77% (1.3245 => 1.4406, std.dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 8.67% (1.2749 => 1.3854, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: 8.62% (0.3131 => 0.3401, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.55% (0.3755 => 0.4076, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 8.54% (14.8535 => 16.1216, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.54% (3.6692 => 3.9824, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.49% (0.6576 => 0.7134, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.47% (4.3801 => 4.7512, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.41% (0.8818 => 0.9560, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.41% (4.4433 => 4.8169, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.33% (0.6135 => 0.6646, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 8.20% (8.4961 => 9.1929, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.16% (1.5188 => 1.6427, std.dev.: 0.0079) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.99% (0.2140 => 0.2311, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.88% (0.1789 => 0.1930, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.84% (3.2742 => 3.5310, std.dev.: 0.0059) MultiSource/Applications/oggenc/oggenc: 7.79% (4.6629 => 5.0262, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.77% (1.1333 => 1.2214, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.67% (0.2321 => 0.2499, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.66% (0.3511 => 0.3780, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: 7.65% (0.1385 => 0.1491, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/05-eks/eks: 7.63% (0.4113 => 0.4427, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 7.63% (0.6250 => 0.6727, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.59% (0.9108 => 0.9799, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 7.54% (0.4003 => 0.4305, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 7.45% (3.7467 => 4.0259, std.dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.43% (0.4805 => 0.5162, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 7.38% (6.5754 => 7.0608, std.dev.: 0.0075) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.27% (0.2504 => 0.2686, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 7.22% (1.2292 => 1.3180, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 7.20% (0.3914 => 0.4196, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.13% (0.3578 => 0.3833, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.09% (0.3245 => 0.3475, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.08% (0.3940 => 0.4219, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.05% (2.1007 => 2.2489, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-4: 7.02% (0.3646 => 0.3902, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.97% (0.3789 => 0.4053, std.dev.: 0.0090) SingleSource/UnitTests/ObjC/exceptions-2: 6.94% (0.3601 => 0.3851, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 6.92% (0.2008 => 0.2147, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 6.91% (0.3663 => 0.3916, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.88% (0.3650 => 0.3901, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 6.73% (0.3623 => 0.3867, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.58% (6.2785 => 6.6914, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.47% (13.2842 => 14.1439, std.dev.: 0.0154) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.43% (0.1819 => 0.1936, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.26% (0.2243 => 0.2361, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 4.83% (16.2614 => 17.0466, std.dev.: 0.0119) MultiSource/Applications/ClamAV/clamscan: 4.32% (14.5298 => 15.1581, std.dev.: 0.0110) MultiSource/Benchmarks/Bullet/bullet: 2.02% (33.2944 => 33.9676, std.dev.: 0.0216) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5137, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fbench: 24.45% (1.8175 => 2.2618, std.dev.: 0.0471) SingleSource/Benchmarks/Misc/richards_benchmark: 11.17% (1.1560 => 1.2851, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4139, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.26% (1.2998 => 1.3812, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.35% (0.2093 => 0.2205, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.80% (0.3458 => 0.3624, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0051, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.49% (0.3139 => 0.3280, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7748, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6773, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9855, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 3.31% (10.7476 => 11.1037, std.dev.: 0.0402) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.12% (7.4271 => 7.5843, std.dev.: 0.0037) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4540, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5143, std.dev.: 0.0029) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1877, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5781, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.14% (8.8259 => 8.9265, std.dev.: 0.0113) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0267, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5852, std.dev.: 0.0080) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.93% (0.2670 => 0.1417, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.06% (0.4657 => 0.3909, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -14.57% (0.0707 => 0.0604, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.41% (1.3819 => 1.1966, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.40% (1.3813 => 1.1962, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.48% (22.5627 => 22.2281, std.dev.: 0.0139) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.34% (0.0997 => 0.0864, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -11.97% (0.2238 => 0.1970, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -11.76% (1.2308 => 1.0861, std.dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.18% (20.3410 => 18.2712, std.dev.: 0.0264) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.96% (1.3780 => 1.2959, std.dev.: 0.0096) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5144, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.22% (0.9996 => 0.9574, std.dev.: 0.0031) MultiSource/Applications/siod/siod: -3.58% (3.2729 => 3.1556, std.dev.: 0.0260) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.38% (1.7688 => 1.7091, std.dev.: 0.0052) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.04% (0.4867 => 0.4719, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.58% (26.5159 => 25.8307, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4786, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -2.43% (3.0263 => 2.9528, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.32% (1.9762 => 1.9303, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.94% (0.6589 => 0.6461, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7144, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/lists: -1.80% (6.3560 => 6.2416, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0078, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -1.37% (4.5928 => 4.5301, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8666, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4957, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2564, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.11% (6.6320 => 6.5586, std.dev.: 0.0099) MultiSource/Applications/minisat/minisat: -1.04% (9.3358 => 9.2389, std.dev.: 0.0097) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 12 04:01:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 12 Oct 2012 06:01:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121012110112.E89DB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4815?compare_to=4812&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4815, Order: 165790, Start Time: 2012-10-12 09:43:09, End Time: 2012-10-12 11:03:04 To: 4812, Order: 165788, Start Time: 2012-10-12 07:53:48, End Time: 2012-10-12 09:13:58 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (165 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 953 (679 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.44% (0.5956 => 0.5982, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: -0.13% (16.5021 => 16.4803, std.dev.: 0.0123) MultiSource/Benchmarks/Bullet/bullet: 0.02% (55.3940 => 55.4071, std.dev.: 0.0126) MultiSource/Benchmarks/MallocBench/gs/gs: 0.02% (4.4484 => 4.4495, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0460 => 0.0460, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.22% (0.0463 => 0.0462, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0431 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.23% (0.0432 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0420 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0422 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.48% (0.0416 => 0.0414) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0416 => 0.0416) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0432 => 0.0432, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0433 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0427 => 0.0427, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0428 => 0.0428) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0417 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.24% (0.0419 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0424 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0425 => 0.0425) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0435 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.68% (0.0440 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0412 => 0.0412) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0413 => 0.0413) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.24% (0.0424 => 0.0423, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0425 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0415 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0408 => 0.0408, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.24% (0.0409 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.25% (0.0405 => 0.0406, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.25% (0.0407 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.23% (0.0442 => 0.0443, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0444 => 0.0444, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0405 => 0.0405, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.25% (0.0406 => 0.0407) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.25% (0.0406 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0407 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.24% (0.0415 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0415 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.04% (1.2619 => 1.2624, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.01% (7.8711 => 7.8707, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.03% (0.7430 => 0.7432, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.83% (0.0361 => 0.0364, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.65% (0.0645 => 0.0675, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.39% (63.2438 => 55.4071, std.dev.: 0.0126) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.74% (14.1553 => 19.0723, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++-EH/spirit: 64.11% (3.4629 => 5.6829, std.dev.: 0.0029) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14228.19% (0.0720 => 10.3163, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9951600.00% (0.0001 => 9.9517, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.94% (0.2554 => 0.4187, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 50.46% (10.3673 => 15.5984, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 38.47% (0.1622 => 0.2246, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 33.62% (0.1056 => 0.1411, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 18.65% (0.1432 => 0.1699, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.63% (7.0540 => 8.2979, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.60% (2.2022 => 2.5677, std.dev.: 0.0069) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.71% (0.1566 => 0.1812, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.40% (1.7609 => 1.9969, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.97% (0.0871 => 0.0984, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 12.64% (0.1440 => 0.1622, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.60% (0.1143 => 0.1287, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 12.10% (0.3282 => 0.3679, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.99% (0.1584 => 0.1774, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 11.26% (0.7433 => 0.8270, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 10.89% (10.4361 => 11.5724, std.dev.: 0.0144) SingleSource/UnitTests/ObjC/parameter-passing: 10.70% (0.3927 => 0.4347, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.64% (0.1438 => 0.1591, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.64% (0.4879 => 0.5398, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.58% (0.1625 => 0.1797, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/trivial-interface: 10.54% (0.3473 => 0.3839, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.50% (0.3543 => 0.3915, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 10.48% (0.7115 => 0.7861, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.38% (0.6675 => 0.7368, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.37% (0.2700 => 0.2980, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 10.36% (0.3543 => 0.3910, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 10.32% (0.3497 => 0.3858, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 10.31% (0.3561 => 0.3928, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.27% (0.3516 => 0.3877, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 10.22% (0.3886 => 0.4283, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 10.21% (0.3828 => 0.4219, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 10.21% (0.1655 => 0.1824, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 10.19% (9.4845 => 10.4510, std.dev.: 0.0208) SingleSource/UnitTests/ObjC/for-in: 10.12% (0.3694 => 0.4068, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.03% (1.5415 => 1.6961, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.95% (0.3177 => 0.3493, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 9.87% (0.3109 => 0.3416, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 9.87% (0.1175 => 0.1291, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 9.82% (3.3354 => 3.6629, std.dev.: 0.0202) MultiSource/Applications/aha/aha: 9.73% (0.1151 => 0.1263, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.71% (0.4615 => 0.5063, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 9.68% (0.1695 => 0.1859, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 9.61% (0.3423 => 0.3752, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.55% (0.1236 => 0.1354, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 9.44% (5.7591 => 6.3025, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.40% (0.5105 => 0.5585, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.36% (4.2646 => 4.6637, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.34% (0.1510 => 0.1651, std.dev.: 0.0049) MultiSource/Applications/Burg/burg: 9.24% (1.1642 => 1.2718, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.15% (0.5860 => 0.6396, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.13% (1.3050 => 1.4241, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.04% (0.8067 => 0.8796, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.03% (0.2271 => 0.2476, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.98% (0.5569 => 0.6069, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.97% (0.1940 => 0.2114, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 8.89% (3.8723 => 4.2165, std.dev.: 0.0125) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.88% (0.2107 => 0.2294, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.86% (0.1163 => 0.1266) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.82% (5.0018 => 5.4430, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.79% (0.9765 => 1.0623, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.78% (0.3121 => 0.3395, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.76% (4.9449 => 5.3781, std.dev.: 0.0092) MultiSource/Applications/hbd/hbd: 8.72% (1.5603 => 1.6963, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.71% (8.1363 => 8.8448, std.dev.: 0.0043) MultiSource/Applications/lemon/lemon: 8.65% (1.0722 => 1.1649, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/bigfib: 8.64% (0.6456 => 0.7014, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 8.63% (0.7835 => 0.8511, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.63% (0.5020 => 0.5453, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 8.62% (0.1555 => 0.1689, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.59% (0.2758 => 0.2995, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.59% (0.8172 => 0.8874, std.dev.: 0.0047) MultiSource/Benchmarks/sim/sim: 8.53% (0.3387 => 0.3676, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.53% (0.3307 => 0.3589, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.45% (0.1337 => 0.1450, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.43% (0.2065 => 0.2239, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 8.36% (2.0273 => 2.1968, std.dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.34% (7.9617 => 8.6255, std.dev.: 0.0192) SingleSource/UnitTests/ObjC++/Hello: 8.30% (0.5925 => 0.6417) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.27% (1.5859 => 1.7170, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.26% (0.4103 => 0.4442, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 8.24% (0.6030 => 0.6527, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 8.13% (2.2969 => 2.4837, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/09-vor/vor: 8.05% (0.3180 => 0.3436, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.05% (0.3441 => 0.3718, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.84% (1.1861 => 1.2791, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.59% (0.4203 => 0.4522, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.53% (0.3865 => 0.4156, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.52% (0.7326 => 0.7877, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 7.51% (0.4289 => 0.4611, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.38% (0.2603 => 0.2795, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/lists: 7.36% (0.3422 => 0.3674, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.36% (0.4620 => 0.4960, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.35% (0.6450 => 0.6924, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.34% (0.3826 => 0.4107, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 7.30% (21.9371 => 23.5391, std.dev.: 0.0200) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.26% (0.3650 => 0.3915, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 7.25% (0.8921 => 0.9568, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.21% (2.2024 => 2.3611, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 7.07% (0.4299 => 0.4603, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 7.04% (0.4048 => 0.4333, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 6.97% (0.1463 => 0.1565) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.97% (0.4636 => 0.4959, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.91% (0.5981 => 0.6394, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 6.86% (0.3603 => 0.3850, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.74% (0.3162 => 0.3375, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.73% (0.3136 => 0.3347, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.73% (0.1695 => 0.1809, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.72% (1.4186 => 1.5140, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.71% (0.2905 => 0.3100, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 6.60% (0.3684 => 0.3927, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.57% (0.2891 => 0.3081, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.55% (0.2872 => 0.3060, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.49% (1.1840 => 1.2609, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 6.43% (0.3283 => 0.3494, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.38% (2.0665 => 2.1984, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 6.36% (0.2831 => 0.3011, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.27% (0.2266 => 0.2408, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.26% (0.3098 => 0.3292, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 6.20% (0.2871 => 0.3049, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.10% (0.3232 => 0.3429, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.06% (0.2756 => 0.2923, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 6.00% (0.3052 => 0.3235, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 5.98% (0.2725 => 0.2888, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 5.98% (0.2877 => 0.3049, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.96% (0.2802 => 0.2969, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.86% (0.2714 => 0.2873, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.84% (0.2793 => 0.2956, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.82% (0.1906 => 0.2017, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.60% (0.1892 => 0.1998, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: 5.59% (0.3379 => 0.3568, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.59% (0.4064 => 0.4291, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.44% (0.8101 => 0.8542, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: 5.17% (0.2049 => 0.2155, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.17% (14.3668 => 15.1098, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/objinst: 4.98% (0.3131 => 0.3287, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.81% (0.3427 => 0.3592, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.80% (1.2842 => 1.3459, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.73% (0.2430 => 0.2545, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 4.58% (17.1811 => 17.9673, std.dev.: 0.0158) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.16% (3.8922 => 4.0542, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/bh/bh: 3.30% (0.3092 => 0.3194, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.27% (1.1194 => 1.1560, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.75% (0.3817 => 0.3922, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.83% (1.1396 => 1.2516, std.dev.: 0.0018) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4499, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (3.1578 => 3.3679, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626) SingleSource/Regression/C/uint64_to_float: 3.71% (0.5413 => 0.5614, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.59% (3.6395 => 3.7700, std.dev.: 0.0028) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.65% (4.2280 => 4.3399, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.33% (1.7254 => 1.7656, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8136, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.21% (2.6546 => 2.6868, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.08% (6.5088 => 6.5791, std.dev.: 0.0058) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1311, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -79.91% (0.8651 => 0.1738, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.95% (5.2763 => 3.2737, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.32% (5.3855 => 3.6988, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.02% (5.3526 => 3.6921, std.dev.: 0.0047) SingleSource/UnitTests/Vector/constpool: -14.74% (54.1659 => 46.1809, std.dev.: 0.0438) MultiSource/Applications/ClamAV/clamscan: -12.12% (22.1758 => 19.4889, std.dev.: 0.0099) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.44% (2.9384 => 2.6315, std.dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: -16.06% (1.6925 => 1.4206, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.63% (0.0998 => 0.0862, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -12.45% (1.2373 => 1.0832, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/mandel-2: -10.36% (1.5373 => 1.3781, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/mason/mason: -9.90% (0.2161 => 0.1947, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.46% (19.9488 => 18.2615, std.dev.: 0.0252) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.68% (1.8329 => 1.7105, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5757, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.27% (1.6805 => 1.5920, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5071, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0014) MultiSource/Applications/siod/siod: -3.72% (3.2827 => 3.1605, std.dev.: 0.0160) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.4995, std.dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: -3.01% (12.4730 => 12.0979, std.dev.: 0.0015) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.10% (0.4808 => 0.4707, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.09% (8.6802 => 8.4992, std.dev.: 0.0119) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.98% (8.1563 => 7.9946, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/salsa20: -1.83% (10.2830 => 10.0953, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6815, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091) SingleSource/UnitTests/Vector/multiplies: -1.62% (2.5528 => 2.5115, std.dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4200, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.16% (6.2999 => 6.2270, std.dev.: 0.0081) MultiSource/Applications/sqlite3/sqlite3: -1.13% (4.6441 => 4.5915, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8583, std.dev.: 0.0095) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 14.40% (0.5229 => 0.5982, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 9.95% (14.9895 => 16.4803, std.dev.: 0.0123) MultiSource/Benchmarks/MallocBench/gs/gs: 8.25% (4.1105 => 4.4495, std.dev.: 0.0100) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.27% (1.1048 => 1.2624, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.95% (7.1582 => 7.8707, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.45% (0.6222 => 0.7432, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36300.00% (0.0001 => 0.0364, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.10% (0.2116 => 0.0675, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 12 05:14:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 12 Oct 2012 07:14:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121012121400.BA6F32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4816?compare_to=4814&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4816, Order: 165791, Start Time: 2012-10-12 10:49:50, End Time: 2012-10-12 12:15:51 To: 4814, Order: 165790, Start Time: 2012-10-12 08:54:29, End Time: 2012-10-12 10:20:28 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (189 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1041 (676 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.95% (3.7617 => 3.8352, std.dev.: 0.0277) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.51% (2.0176 => 2.4919, std.dev.: 0.0049) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.37% (0.1410 => 0.1669, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 16.95% (0.0826 => 0.0966, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.69% (0.0653 => 0.0762, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 16.50% (0.2243 => 0.2613, std.dev.: 0.0061) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.21% (0.1072 => 0.1235, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.62% (0.1327 => 0.1521, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 13.72% (0.1013 => 0.1152, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.43% (0.0834 => 0.0946, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 13.24% (0.7038 => 0.7970, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.09% (0.1413 => 0.1598, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.75% (0.2596 => 0.2927, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 12.71% (1.3693 => 1.5434, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.48% (3.9660 => 4.4611, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.34% (0.0964 => 0.1083, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.34% (0.1588 => 0.1784, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.31% (0.2721 => 0.3056, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 12.19% (0.4062 => 0.4557, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.05% (1.4563 => 1.6318, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.01% (0.6959 => 0.7795, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 11.97% (0.4328 => 0.4846, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.85% (0.7710 => 0.8624, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.81% (0.9199 => 1.0285, std.dev.: 0.0041) MultiSource/Applications/aha/aha: 11.77% (0.1062 => 0.1187, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.74% (0.5265 => 0.5883, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 11.69% (13.8202 => 15.4360, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.68% (0.6283 => 0.7017, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.68% (1.2193 => 1.3617, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 11.47% (0.1003 => 0.1118, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 11.34% (0.5818 => 0.6478, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.33% (1.1364 => 1.2651, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.31% (0.3899 => 0.4340, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 11.12% (0.5748 => 0.6387, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 11.00% (1.0313 => 1.1447, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.99% (0.3485 => 0.3868, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 10.97% (0.2781 => 0.3086, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 10.96% (1.1061 => 1.2273, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.81% (0.3580 => 0.3967, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.72% (0.1157 => 0.1281, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.67% (0.3130 => 0.3464, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 10.66% (0.7061 => 0.7814, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.63% (0.4016 => 0.4443, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 10.59% (16.6129 => 18.3717, std.dev.: 0.0168) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.56% (0.4791 => 0.5297, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.54% (0.5577 => 0.6165, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.52% (0.3022 => 0.3340, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 10.42% (0.3293 => 0.3636, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.38% (0.3756 => 0.4146, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.34% (0.0977 => 0.1078, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.33% (0.1075 => 0.1186, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.32% (0.3489 => 0.3849, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.23% (0.3246 => 0.3578, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 10.22% (0.2995 => 0.3301, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 10.19% (0.3868 => 0.4262, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 10.17% (0.6744 => 0.7430, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.16% (0.7460 => 0.8218, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.14% (0.2782 => 0.3064, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 10.13% (0.1589 => 0.1750, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 10.12% (0.2726 => 0.3002, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.12% (0.4379 => 0.4822, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.11% (0.2127 => 0.2342, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/18-imp/imp: 10.09% (0.3220 => 0.3545, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.09% (0.4390 => 0.4833, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.09% (0.2914 => 0.3208, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 10.07% (0.3107 => 0.3420, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 10.05% (3.8646 => 4.2530, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.02% (1.9828 => 2.1815, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.01% (0.2966 => 0.3263, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 9.99% (0.1111 => 0.1222, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 9.94% (0.3149 => 0.3462, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 9.94% (0.7506 => 0.8252, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.94% (0.2023 => 0.2224, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.85% (0.8698 => 0.9555, std.dev.: 0.0040) MultiSource/Applications/siod/siod: 9.84% (2.1791 => 2.3936, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 9.82% (0.2761 => 0.3032, std.dev.: 0.0049) MultiSource/Applications/d/make_dparser: 9.79% (3.1889 => 3.5012, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.79% (0.2655 => 0.2915, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 9.79% (0.3453 => 0.3791, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.76% (0.1865 => 0.2047, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 9.74% (0.1478 => 0.1622, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/random: 9.74% (0.2690 => 0.2952, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 9.70% (0.8310 => 0.9116, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.69% (0.1435 => 0.1574, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.69% (0.5637 => 0.6183, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/except: 9.67% (0.2760 => 0.3027, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 9.67% (0.2937 => 0.3221, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.67% (0.1986 => 0.2178, std.dev.: 0.0017) MultiSource/Applications/treecc/treecc: 9.66% (1.9270 => 2.1131, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/ary2: 9.65% (0.3192 => 0.3500, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 9.62% (0.3534 => 0.3874, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 9.59% (0.2607 => 0.2857, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 9.51% (1.0594 => 1.1602, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 9.47% (0.2628 => 0.2877, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 9.47% (0.2925 => 0.3202, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.44% (0.2765 => 0.3026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.43% (0.1569 => 0.1717, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.31% (7.2180 => 7.8898, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/matrix: 9.20% (0.2988 => 0.3263, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.17% (0.1276 => 0.1393, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.16% (0.2696 => 0.2943, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.11% (4.9865 => 5.4406, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/em3d/em3d: 8.87% (0.1657 => 0.1804, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 8.83% (0.2945 => 0.3205, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.81% (1.3245 => 1.4412, std.dev.: 0.0059) MultiSource/Applications/SIBsim4/SIBsim4: 8.69% (1.2749 => 1.3857, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 8.66% (0.3131 => 0.3402, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.66% (0.3755 => 0.4080, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.58% (3.6692 => 3.9840, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.54% (4.3801 => 4.7542, std.dev.: 0.0138) MultiSource/Applications/JM/lencod/lencod: 8.53% (14.8535 => 16.1201, std.dev.: 0.0161) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.51% (4.4433 => 4.8213, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.47% (0.8818 => 0.9565, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.43% (0.6135 => 0.6652, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 8.30% (8.4961 => 9.2015, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.24% (1.5188 => 1.6440, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.15% (0.6576 => 0.7112, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.05% (0.1789 => 0.1933, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.90% (3.2742 => 3.5330, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.90% (0.2140 => 0.2309, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.84% (0.2321 => 0.2503, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 7.80% (4.6629 => 5.0264, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.73% (1.1333 => 1.2209, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.71% (0.9108 => 0.9810, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 7.68% (0.4113 => 0.4429, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/parameter-passing: 7.67% (0.4003 => 0.4310, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 7.66% (0.6250 => 0.6729, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.66% (0.3511 => 0.3780, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: 7.58% (0.1385 => 0.1490, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.43% (0.2504 => 0.2690, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.41% (0.4805 => 0.5161, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 7.38% (6.5754 => 7.0607, std.dev.: 0.0128) MultiSource/Applications/lua/lua: 7.36% (3.7467 => 4.0226, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions: 7.28% (0.3914 => 0.4199, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.25% (2.1007 => 2.2529, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.24% (0.3245 => 0.3480, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 7.20% (1.2292 => 1.3177, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 7.18% (0.3940 => 0.4223, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 7.02% (0.2008 => 0.2149, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 7.02% (0.3578 => 0.3829, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.99% (0.3646 => 0.3901, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 6.99% (0.3789 => 0.4054, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.89% (0.3601 => 0.3849, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.88% (0.3650 => 0.3901, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 6.85% (0.3663 => 0.3914, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.85% (0.3623 => 0.3871, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.69% (6.2785 => 6.6983, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.65% (0.1819 => 0.1940, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.54% (13.2842 => 14.1526, std.dev.: 0.0140) SingleSource/Benchmarks/Misc/ReedSolomon: 6.36% (0.1777 => 0.1890, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.13% (0.2243 => 0.2358, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 4.83% (16.2614 => 17.0475, std.dev.: 0.0067) MultiSource/Applications/ClamAV/clamscan: 4.44% (14.5298 => 15.1752, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/bh/bh: 3.53% (0.2859 => 0.2960, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 2.15% (33.2944 => 34.0088, std.dev.: 0.0102) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5174, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fbench: 24.72% (1.8175 => 2.2668, std.dev.: 0.0433) SingleSource/Benchmarks/Misc/richards_benchmark: 11.10% (1.1560 => 1.2843, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 8.98% (0.8273 => 0.9016, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4146, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.32% (1.2998 => 1.3819, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0051, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6761, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9854, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 3.19% (10.7476 => 11.0902, std.dev.: 0.0654) SingleSource/Regression/C/uint64_to_float: 2.97% (0.5449 => 0.5611, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.14% (7.4271 => 7.5861, std.dev.: 0.0070) MultiSource/Applications/lemon/lemon: 1.78% (1.4298 => 1.4553, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5137, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.29% (3.1720 => 3.2129, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1864, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 1.20% (5.5130 => 5.5791, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.17% (8.8259 => 8.9294, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0276, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 1.02% (12.4560 => 12.5829, std.dev.: 0.0086) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.89% (0.2670 => 0.1418, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.02% (0.4657 => 0.3911, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -14.43% (0.0707 => 0.0605, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.38% (1.3813 => 1.1965, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.18% (1.3819 => 1.1998, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.48% (22.5627 => 22.2290, std.dev.: 0.0133) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.34% (0.0997 => 0.0864, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -11.97% (0.2238 => 0.1970, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -10.94% (1.2308 => 1.0962, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.13% (20.3410 => 18.2813, std.dev.: 0.0148) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.59% (1.3780 => 1.2872, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5140, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.20% (0.9996 => 0.9576, std.dev.: 0.0050) MultiSource/Applications/siod/siod: -3.54% (3.2729 => 3.1572, std.dev.: 0.0204) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.49% (1.7688 => 1.7070, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.18% (0.4867 => 0.4712, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -2.62% (26.5159 => 25.8204, std.dev.: 0.0182) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.53% (3.0263 => 2.9496, std.dev.: 0.0029) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.35% (1.9762 => 1.9298, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.94% (0.6589 => 0.6461, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7149, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/lists: -1.74% (6.3560 => 6.2453, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.56% (0.6615 => 0.6512, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0075, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -1.43% (4.5928 => 4.5273, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8636, std.dev.: 0.0115) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.16% (2.5254 => 2.4960, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2573, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 12 05:50:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 12 Oct 2012 07:50:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121012125017.174AA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4817?compare_to=4815&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4817, Order: 165791, Start Time: 2012-10-12 11:32:21, End Time: 2012-10-12 12:52:08 To: 4815, Order: 165790, Start Time: 2012-10-12 09:43:09, End Time: 2012-10-12 11:03:04 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (164 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 952 (680 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.34% (1.0832 => 1.0977, std.dev.: 0.0006) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.30% (0.5982 => 0.5964, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 0.08% (16.4803 => 16.4943, std.dev.: 0.0060) MultiSource/Benchmarks/Bullet/bullet: -0.00% (55.4071 => 55.4053, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/gs/gs: 0.11% (4.4495 => 4.4543, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0460 => 0.0460, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0462 => 0.0462, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0431 => 0.0431) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0433 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0420 => 0.0420, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.24% (0.0422 => 0.0423, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0414 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0416 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0432 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.23% (0.0433 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0427 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.23% (0.0428 => 0.0429, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.24% (0.0417 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0418 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0424 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0425 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0435 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0437 => 0.0437, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.24% (0.0412 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0413 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.24% (0.0423 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0425 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0415 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0417 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.25% (0.0408 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.25% (0.0408 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.25% (0.0406 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0408 => 0.0408, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0443 => 0.0443) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0444 => 0.0444, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0405 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.25% (0.0407 => 0.0406, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.25% (0.0407 => 0.0406, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.25% (0.0407 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0414 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0415 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.04% (1.2624 => 1.2619, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.00% (7.8707 => 7.8706, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.7432 => 0.7432, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0364 => 0.0364, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.30% (0.0675 => 0.0646, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.39% (63.2438 => 55.4053, std.dev.: 0.0054) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.67% (14.1553 => 19.0634, std.dev.: 0.0166) SingleSource/Benchmarks/Misc-C++-EH/spirit: 64.04% (3.4629 => 5.6805, std.dev.: 0.0024) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14227.50% (0.0720 => 10.3158, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952500.00% (0.0001 => 9.9526, std.dev.: 0.0015) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.98% (0.2554 => 0.4188, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: 50.44% (10.3673 => 15.5962, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/richards_benchmark: 38.53% (0.1622 => 0.2247, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/distray/distray: 33.62% (0.1056 => 0.1411, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 18.58% (0.1432 => 0.1698, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.61% (7.0540 => 8.2961, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.58% (2.2022 => 2.5673, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.64% (0.1566 => 0.1811, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.39% (1.7609 => 1.9967, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.09% (0.0871 => 0.0985, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.69% (0.1143 => 0.1288, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 12.64% (0.1440 => 0.1622, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 12.34% (0.3282 => 0.3687, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 12.12% (0.1584 => 0.1776, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 11.33% (0.7433 => 0.8275, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 10.91% (10.4361 => 11.5748, std.dev.: 0.0196) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.71% (0.1438 => 0.1592, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 10.70% (0.7115 => 0.7876, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.65% (0.1625 => 0.1798, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.64% (0.4879 => 0.5398, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.51% (0.3473 => 0.3838, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.49% (0.3927 => 0.4339, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.44% (0.2700 => 0.2982, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.39% (0.3561 => 0.3931, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.39% (0.3543 => 0.3911, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.37% (0.3886 => 0.4289, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.37% (0.6675 => 0.7367, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.35% (0.3497 => 0.3859, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.33% (0.3543 => 0.3909, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 10.30% (0.1175 => 0.1296, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.30% (0.3516 => 0.3878, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 10.27% (0.1655 => 0.1825, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 10.22% (9.4845 => 10.4537, std.dev.: 0.0135) SingleSource/UnitTests/ObjC/for-in: 10.21% (0.3694 => 0.4071, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.16% (0.3828 => 0.4217, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.95% (0.3177 => 0.3493, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.91% (1.5415 => 1.6943, std.dev.: 0.0019) MultiSource/Applications/d/make_dparser: 9.91% (3.3354 => 3.6659, std.dev.: 0.0031) MultiSource/Applications/sgefa/sgefa: 9.87% (0.3109 => 0.3416, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 9.82% (0.1151 => 0.1264, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 9.68% (0.1695 => 0.1859, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 9.58% (0.3423 => 0.3751, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.58% (0.4615 => 0.5057, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.55% (0.1236 => 0.1354, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 9.50% (5.7591 => 6.3064, std.dev.: 0.0147) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.44% (0.5105 => 0.5587, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.41% (4.2646 => 4.6658, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.34% (0.1510 => 0.1651, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.28% (0.5860 => 0.6404, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 9.22% (1.1642 => 1.2715, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.18% (1.3050 => 1.4248, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.12% (0.1940 => 0.2117, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.11% (0.2271 => 0.2478, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.10% (0.8067 => 0.8801, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.02% (0.2107 => 0.2297, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.01% (0.5569 => 0.6071, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.92% (5.0018 => 5.4480, std.dev.: 0.0017) MultiSource/Applications/lua/lua: 8.92% (3.8723 => 4.2177, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.86% (4.9449 => 5.3830, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.81% (0.2758 => 0.3001, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 8.77% (0.1163 => 0.1265, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 8.77% (1.5603 => 1.6971, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.77% (0.9765 => 1.0621, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.75% (0.3121 => 0.3394, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.74% (8.1363 => 8.8472, std.dev.: 0.0059) MultiSource/Applications/lemon/lemon: 8.73% (1.0722 => 1.1658, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.69% (0.5020 => 0.5456, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 8.68% (0.1555 => 0.1690, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.66% (0.8172 => 0.8880, std.dev.: 0.0040) MultiSource/Applications/spiff/spiff: 8.63% (0.7835 => 0.8511, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.59% (0.3307 => 0.3591, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.57% (0.2065 => 0.2242, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 8.49% (0.6456 => 0.7004, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 8.48% (2.0273 => 2.1992, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.45% (0.1337 => 0.1450, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.43% (1.5859 => 1.7196, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 8.41% (0.3387 => 0.3672, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.36% (7.9617 => 8.6270, std.dev.: 0.0108) SingleSource/UnitTests/ObjC++/Hello: 8.27% (0.5925 => 0.6415, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference-object: 8.26% (0.6030 => 0.6528, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 8.18% (2.2969 => 2.4848, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.12% (0.4103 => 0.4436, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 8.11% (0.3180 => 0.3438, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.11% (0.3441 => 0.3720, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.83% (1.1861 => 1.2790, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.68% (0.4636 => 0.4992, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 7.65% (0.4289 => 0.4617, std.dev.: 0.0123) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.55% (0.6450 => 0.6937, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference: 7.55% (0.7326 => 0.7879, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.54% (0.4203 => 0.4520, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.45% (0.2603 => 0.2797, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.41% (2.2024 => 2.3657, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/football/football: 7.38% (0.8921 => 0.9579, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.37% (0.3865 => 0.4150, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 7.31% (0.3422 => 0.3672, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 7.30% (21.9371 => 23.5387, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.27% (0.3826 => 0.4104, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.21% (0.3650 => 0.3913, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 7.16% (0.4299 => 0.4607, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.12% (0.4620 => 0.4949, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 7.11% (0.1463 => 0.1567, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.01% (0.5981 => 0.6400, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 6.99% (0.4048 => 0.4331, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 6.80% (0.3603 => 0.3848, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.78% (0.1695 => 0.1810, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.77% (0.3162 => 0.3376, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.74% (1.4186 => 1.5142, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.73% (0.3136 => 0.3347, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 6.64% (0.2905 => 0.3098, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.62% (0.3684 => 0.3928, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.61% (1.1840 => 1.2623, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.61% (0.2891 => 0.3082, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.32% (0.2831 => 0.3010, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.31% (2.0665 => 2.1969, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.27% (0.2266 => 0.2408, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.17% (0.3098 => 0.3289, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.16% (0.3232 => 0.3431, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.10% (0.2756 => 0.2924, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.09% (0.3283 => 0.3483, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.09% (0.1906 => 0.2022, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.06% (0.2872 => 0.3046, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.03% (0.3052 => 0.3236, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.03% (0.2871 => 0.3044, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.01% (0.2877 => 0.3050, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.91% (0.2725 => 0.2886, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.87% (0.1892 => 0.2003, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.76% (0.2793 => 0.2954, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.75% (0.2714 => 0.2870, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 5.71% (0.2802 => 0.2962, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.59% (0.3379 => 0.3568, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.56% (0.4064 => 0.4290, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.55% (0.8101 => 0.8551, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/ReedSolomon: 5.22% (0.2049 => 0.2156, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.14% (14.3668 => 15.1051, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/objinst: 4.95% (0.3131 => 0.3286, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.85% (1.2842 => 1.3465, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.79% (0.3427 => 0.3591, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 4.55% (17.1811 => 17.9627, std.dev.: 0.0218) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.49% (0.2430 => 0.2539, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.46% (3.8922 => 4.0658, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/bh/bh: 3.43% (0.3092 => 0.3198, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.23% (1.1194 => 1.1556, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.78% (0.3817 => 0.3923, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.77% (1.1396 => 1.2509, std.dev.: 0.0015) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.20% (3.1595 => 3.4501, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.1578 => 3.3688, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.57% (3.6395 => 3.7693, std.dev.: 0.0030) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.70% (4.2280 => 4.3422, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7652, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (0.8275 => 0.8405, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8128, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.21% (2.6546 => 2.6868, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1312, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: -79.92% (0.8651 => 0.1737, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.98% (5.2763 => 3.2722, std.dev.: 0.0113) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.39% (5.3855 => 3.6950, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.04% (5.3526 => 3.6910, std.dev.: 0.0086) SingleSource/UnitTests/Vector/constpool: -14.70% (54.1659 => 46.2062, std.dev.: 0.0163) MultiSource/Applications/ClamAV/clamscan: -12.13% (22.1758 => 19.4848, std.dev.: 0.0294) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.53% (2.9384 => 2.6291, std.dev.: 0.0111) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.46% (1.1492 => 0.7647, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.99% (1.6925 => 1.4218, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.63% (0.0998 => 0.0862, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.28% (1.2373 => 1.0977, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -10.39% (1.5373 => 1.3776, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -10.09% (0.2161 => 0.1943, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.43% (19.9488 => 18.2673, std.dev.: 0.1295) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.79% (1.8329 => 1.7085, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.30% (1.6805 => 1.5915, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: -5.02% (1.5835 => 1.5040, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.21% (0.9957 => 0.9538, std.dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.73% (1.3677 => 1.3167, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.64% (3.2827 => 3.1633, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5031, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: -3.01% (12.4730 => 12.0974, std.dev.: 0.0018) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.14% (0.4808 => 0.4705, std.dev.: 0.0008) SingleSource/UnitTests/Vector/multiplies: -1.84% (2.5528 => 2.5059, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -1.80% (10.2830 => 10.0983, std.dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.78% (8.6802 => 8.5261, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6819, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.57% (8.1563 => 8.0286, std.dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4216, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -1.17% (4.6441 => 4.5899, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8594, std.dev.: 0.0099) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 14.06% (0.5229 => 0.5964, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 10.04% (14.9895 => 16.4943, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/gs/gs: 8.36% (4.1105 => 4.4543, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.22% (1.1048 => 1.2619, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.95% (7.1582 => 7.8706, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.45% (0.6222 => 0.7432, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36300.00% (0.0001 => 0.0364, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.47% (0.2116 => 0.0646, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 12 05:55:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 12 Oct 2012 07:55:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121012125505.115E72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4818?compare_to=4813&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4818, Order: 165790, Start Time: 2012-10-12 09:47:00, End Time: 2012-10-12 12:56:55 To: 4813, Order: 165787, Start Time: 2012-10-12 06:04:42, End Time: 2012-10-12 09:17:25 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (134 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1042 (756 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 12.90% (0.0822 => 0.0928, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.07% (0.3488 => 0.3874, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 10.93% (0.3496 => 0.3878, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.91% (0.3446 => 0.3822, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.88% (0.3465 => 0.3842, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.84% (0.3460 => 0.3835, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.81% (0.3442 => 0.3814, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.75% (0.3469 => 0.3842, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.63% (0.3650 => 0.4038, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.57% (0.3643 => 0.4028, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.47% (0.3724 => 0.4114, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 8.70% (0.1218 => 0.1324, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 8.52% (0.1421 => 0.1542, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 8.50% (1.5932 => 1.7287, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 8.40% (0.1619 => 0.1755, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 8.08% (0.5826 => 0.6297, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.08% (0.5889 => 0.6365, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.91% (0.4361 => 0.4706, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.87% (1.3152 => 1.4187, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.73% (0.5900 => 0.6356, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.72% (1.6211 => 1.7462, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.63% (0.4994 => 0.5375, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 7.61% (5.5417 => 5.9633, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.53% (0.1620 => 0.1742, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.34% (0.5000 => 0.5367, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.33% (0.2866 => 0.3076, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.27% (3.5627 => 3.8216, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.23% (0.2875 => 0.3083, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.18% (0.5026 => 0.5387, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 7.12% (0.4847 => 0.5192, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.05% (0.2014 => 0.2156, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.01% (0.3195 => 0.3419, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 7.00% (0.9909 => 1.0603, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 6.99% (0.4146 => 0.4436, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 6.96% (0.2714 => 0.2903, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.93% (4.4195 => 4.7259, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.91% (0.2736 => 0.2925, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.91% (0.1549 => 0.1656, std.dev.: 0.0017) SingleSource/Regression/C++/ofstream_ctor: 6.89% (0.3004 => 0.3211, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 6.83% (0.2813 => 0.3005, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 6.81% (1.0781 => 1.1515, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 6.80% (0.2823 => 0.3015, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.80% (2.0673 => 2.2078, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.79% (0.2738 => 0.2924, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.79% (2.7292 => 2.9144, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/09-vor/vor: 6.78% (0.1505 => 0.1607, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 6.78% (0.7171 => 0.7657, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.76% (0.4139 => 0.4419, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.75% (0.2725 => 0.2909, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.73% (0.2780 => 0.2967, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.73% (0.3271 => 0.3491, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 6.72% (0.6634 => 0.7080, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.72% (0.3930 => 0.4194, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/random: 6.71% (0.2803 => 0.2991, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 6.70% (0.4029 => 0.4299, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.70% (0.2911 => 0.3106, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.70% (0.2792 => 0.2979, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.67% (0.2729 => 0.2911, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 6.66% (4.2109 => 4.4913, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/strcat: 6.65% (0.2750 => 0.2933, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.65% (0.2811 => 0.2998, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 6.65% (23.5202 => 25.0848, std.dev.: 0.0173) MultiSource/Benchmarks/nbench/nbench: 6.59% (0.2566 => 0.2735, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary3: 6.58% (0.3267 => 0.3482, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 6.58% (1.8794 => 2.0030, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.56% (0.3124 => 0.3329, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 6.56% (0.3096 => 0.3299, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 6.48% (0.9697 => 1.0325, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.42% (0.3362 => 0.3578, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 6.42% (0.4251 => 0.4524, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.3726 => 0.3965, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 6.41% (0.3477 => 0.3700, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.41% (0.3903 => 0.4153, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.40% (0.3625 => 0.3857, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.37% (0.3282 => 0.3491, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 6.36% (0.3678 => 0.3912, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.33% (0.3317 => 0.3527, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 6.32% (0.3336 => 0.3547, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.31% (0.3060 => 0.3253, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.27% (0.3890 => 0.4134, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 6.24% (0.3348 => 0.3557, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.23% (0.4658 => 0.4948, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 6.20% (1.4269 => 1.5153, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.19% (0.3084 => 0.3275, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.13% (0.2969 => 0.3151, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3690 => 0.3916, std.dev.: 0.0027) MultiSource/Applications/Burg/burg: 6.09% (0.5546 => 0.5884, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 6.01% (2.1653 => 2.2955, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.00% (0.1968 => 0.2086, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.95% (0.6435 => 0.6818, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 5.95% (0.5012 => 0.5310, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.94% (0.2103 => 0.2228, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.93% (0.3981 => 0.4217, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.92% (0.2737 => 0.2899, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 5.91% (2.1013 => 2.2255, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.85% (0.2068 => 0.2189, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 5.81% (4.6177 => 4.8860, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.78% (0.7426 => 0.7855, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 5.76% (0.2691 => 0.2846, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.72% (0.3845 => 0.4065, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.59% (1.9966 => 2.1083, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.58% (1.9694 => 2.0792, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 5.49% (0.7875 => 0.8307, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.44% (0.2040 => 0.2151, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 5.40% (0.2075 => 0.2187, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.32% (0.5361 => 0.5646, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 5.18% (2.0346 => 2.1399, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 4.94% (0.2391 => 0.2509, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.86% (11.6398 => 12.2054, std.dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.80% (0.5584 => 0.5852, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 4.26% (0.3498 => 0.3647, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.10% (4.6926 => 4.8852, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.10% (0.4253 => 0.4385, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 2.74% (11.9555 => 12.2829, std.dev.: 0.0099) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-1: 22.63% (6.2401 => 7.6525, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6093, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6757, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-2: 4.90% (1.8057 => 1.8942, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1653, std.dev.: 0.0230) SingleSource/Benchmarks/Dhrystone/dry: 4.22% (14.0481 => 14.6415, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1933, std.dev.: 0.0503) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.80% (3.1722 => 3.2294, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.47% (7.1849 => 7.2904, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3040, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5127, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.02% (50.0626 => 50.5743, std.dev.: 0.0083) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.96% (2.4764 => 2.4279, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.72% (25.4195 => 16.5935, std.dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9757, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8033, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: -7.49% (0.2402 => 0.2222, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9583, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.67% (11.2080 => 10.7970, std.dev.: 0.0057) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7734, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.75% (0.6293 => 0.6120, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.21% (41.7953 => 40.8708, std.dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/fldry: -2.06% (17.2379 => 16.8825, std.dev.: 0.0801) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5775, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4950, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.33% (105.3826 => 103.9850, std.dev.: 0.1286) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0454, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 12 07:09:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 12 Oct 2012 09:09:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121012140914.775B82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4819?compare_to=4816&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4819, Order: 165792, Start Time: 2012-10-12 12:45:09, End Time: 2012-10-12 14:11:05 To: 4816, Order: 165791, Start Time: 2012-10-12 10:49:50, End Time: 2012-10-12 12:15:51 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (191 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1042 (673 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.84% (2.0176 => 2.4985, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 19.65% (0.1410 => 0.1687, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 18.22% (0.0653 => 0.0772, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 17.68% (0.0826 => 0.0972, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.88% (0.1072 => 0.1253, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 16.81% (0.2243 => 0.2620, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.47% (0.1327 => 0.1519, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 14.12% (0.1013 => 0.1156, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 13.84% (0.1062 => 0.1209, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.56% (0.0811 => 0.0921, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 13.47% (0.7038 => 0.7986, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.46% (0.0847 => 0.0961, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 13.43% (1.3693 => 1.5532, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.31% (0.0834 => 0.0945, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.31% (0.1413 => 0.1601, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.67% (3.9660 => 4.4684, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.66% (0.0964 => 0.1086, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.42% (0.2721 => 0.3059, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.41% (0.1588 => 0.1785, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 12.32% (0.4328 => 0.4861, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.28% (1.4563 => 1.6352, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.25% (0.2596 => 0.2914, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.22% (0.7710 => 0.8652, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 12.19% (0.4062 => 0.4557, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.13% (0.6959 => 0.7803, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.02% (0.5265 => 0.5898, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.00% (0.9199 => 1.0303, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 11.96% (0.1003 => 0.1123, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.93% (0.3899 => 0.4364, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 11.89% (13.8202 => 15.4640, std.dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.76% (0.6283 => 0.7022, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 11.74% (0.5818 => 0.6501, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.68% (1.2193 => 1.3617, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 11.52% (0.1589 => 0.1772, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 11.48% (0.5748 => 0.6408, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.46% (1.1364 => 1.2666, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.32% (0.1157 => 0.1288, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.28% (0.3580 => 0.3984, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 11.26% (16.6129 => 18.4835, std.dev.: 0.0130) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.18% (0.3756 => 0.4176, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.16% (0.3485 => 0.3874, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 11.15% (0.7061 => 0.7848, std.dev.: 0.0020) MultiSource/Applications/lemon/lemon: 11.06% (1.0313 => 1.1454, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.02% (0.3130 => 0.3475, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 11.00% (0.2781 => 0.3087, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.98% (0.4390 => 0.4872, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.91% (0.4016 => 0.4454, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.89% (0.3022 => 0.3351, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 10.89% (1.1061 => 1.2265, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.75% (0.3489 => 0.3864, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 10.72% (0.3293 => 0.3646, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.66% (0.2655 => 0.2938, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.62% (0.4791 => 0.5300, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.62% (0.5577 => 0.6169, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.52% (0.2966 => 0.3278, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 10.47% (0.3868 => 0.4273, std.dev.: 0.0066) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.47% (0.2914 => 0.3219, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.46% (0.2782 => 0.3073, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.44% (0.0977 => 0.1079, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 10.42% (0.6744 => 0.7447, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 10.42% (0.2726 => 0.3010, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.37% (0.8698 => 0.9600, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.36% (1.9828 => 2.1882, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.33% (0.1075 => 0.1186, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 10.30% (3.8646 => 4.2628, std.dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.30% (0.4379 => 0.4830, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.26% (0.3246 => 0.3579, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 10.26% (0.3149 => 0.3472, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 10.26% (2.1791 => 2.4026, std.dev.: 0.0086) MultiSource/Applications/sgefa/sgefa: 10.25% (0.2995 => 0.3302, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 10.23% (0.3107 => 0.3425, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 10.16% (0.3220 => 0.3547, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 10.14% (0.2761 => 0.3041, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 10.14% (0.3453 => 0.3803, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 10.08% (0.1111 => 0.1223, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 10.07% (0.2760 => 0.3038, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 10.05% (0.3534 => 0.3889, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.02% (0.2765 => 0.3042, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 9.99% (1.9270 => 2.1196, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.97% (0.1986 => 0.2184, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.97% (0.1435 => 0.1578, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 9.93% (0.2690 => 0.2957, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.92% (0.2127 => 0.2338, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.92% (0.1865 => 0.2050, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 9.92% (3.1889 => 3.5052, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/hello: 9.90% (0.2607 => 0.2865, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 9.89% (0.7506 => 0.8248, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.87% (0.7460 => 0.8196, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 9.84% (0.2937 => 0.3226, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 9.84% (0.3192 => 0.3506, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 9.82% (0.2628 => 0.2886, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 9.81% (0.2925 => 0.3212, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 9.81% (0.8310 => 0.9125, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.79% (0.5637 => 0.6189, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 9.74% (0.1478 => 0.1622, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.69% (0.2023 => 0.2219, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.57% (0.2696 => 0.2954, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.56% (0.1276 => 0.1398, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 9.54% (1.0594 => 1.1605, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.50% (0.1569 => 0.1718, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 9.47% (0.2988 => 0.3271, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.45% (7.2180 => 7.9001, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.32% (4.9865 => 5.4510, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 9.17% (0.1657 => 0.1809, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 9.17% (0.2945 => 0.3215, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.08% (1.3245 => 1.4448, std.dev.: 0.0058) MultiSource/Benchmarks/sim/sim: 9.04% (0.3131 => 0.3414, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.95% (0.3755 => 0.4091, std.dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: 8.87% (1.2749 => 1.3880, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.69% (3.6692 => 3.9882, std.dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 8.65% (14.8535 => 16.1388, std.dev.: 0.0151) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.61% (4.3801 => 4.7571, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.61% (0.6576 => 0.7142, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.54% (0.3511 => 0.3811, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.53% (4.4433 => 4.8223, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.52% (0.6135 => 0.6658, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.43% (0.8818 => 0.9561, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.37% (1.5188 => 1.6459, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.36% (0.2321 => 0.2515, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 8.26% (8.4961 => 9.1983, std.dev.: 0.0101) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.18% (0.2140 => 0.2315, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.04% (0.9108 => 0.9840, std.dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.99% (0.1789 => 0.1932) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.95% (1.1333 => 1.2234, std.dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.89% (3.2742 => 3.5325, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 7.87% (0.6250 => 0.6742, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 7.81% (4.6629 => 5.0269, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/parameter-passing: 7.79% (0.4003 => 0.4315, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 7.79% (3.7467 => 4.0384, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.68% (0.4805 => 0.5174, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 7.66% (1.2292 => 1.3234, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.63% (0.4113 => 0.4427, std.dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 7.53% (6.5754 => 7.0702, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.52% (0.3245 => 0.3489, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: 7.51% (0.1385 => 0.1489, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 7.41% (0.3914 => 0.4204, std.dev.: 0.0062) SingleSource/UnitTests/ObjC/property: 7.36% (0.3940 => 0.4230, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 7.32% (0.2008 => 0.2155, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.28% (2.1007 => 2.2537, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.27% (0.2504 => 0.2686, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 7.15% (0.3578 => 0.3834, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.07% (0.3789 => 0.4057, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.07% (0.3650 => 0.3908, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 6.99% (0.3646 => 0.3901, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.97% (0.3601 => 0.3852, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/synchronized: 6.93% (0.3663 => 0.3917, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.87% (0.3623 => 0.3872, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.76% (6.2785 => 6.7030, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.65% (13.2842 => 14.1680, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.32% (0.1819 => 0.1934, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: 6.13% (0.1777 => 0.1886, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.31% (0.2243 => 0.2362, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 4.93% (16.2614 => 17.0638, std.dev.: 0.0154) MultiSource/Applications/ClamAV/clamscan: 4.42% (14.5298 => 15.1716, std.dev.: 0.0168) MultiSource/Benchmarks/Olden/bh/bh: 3.88% (0.2859 => 0.2970, std.dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 2.26% (33.2944 => 34.0480, std.dev.: 0.0131) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 30.48% (5.7573 => 7.5119, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.06% (1.8175 => 2.2548, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/richards_benchmark: 11.03% (1.1560 => 1.2835, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.77% (0.1322 => 0.1438, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.56% (3.1736 => 3.4136, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.12% (1.2998 => 1.3794, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.92% (0.2093 => 0.2217, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0043, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6760, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9852, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 3.21% (10.7476 => 11.0929, std.dev.: 0.0543) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.22% (7.4271 => 7.5921, std.dev.: 0.0051) MultiSource/Applications/lemon/lemon: 1.59% (1.4298 => 1.4525, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5137, std.dev.: 0.0061) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2122, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.23% (1.9433 => 1.9672, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1867, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5788, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0271, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 1.07% (12.4560 => 12.5890, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.82% (0.2670 => 0.1420, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.98% (0.4657 => 0.3913, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -14.43% (0.0707 => 0.0605, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.31% (1.3813 => 1.1974, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.23% (1.3819 => 1.1991, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.31% (22.5627 => 22.2668, std.dev.: 0.0101) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.44% (0.0997 => 0.0863, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.93% (0.2238 => 0.1971, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.43% (1.2308 => 1.0901, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.17% (20.3410 => 18.2724, std.dev.: 0.0149) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.58% (1.3780 => 1.2873, std.dev.: 0.0215) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8001, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.76% (0.9996 => 0.9620, std.dev.: 0.0047) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1561, std.dev.: 0.0084) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.45% (1.7688 => 1.7078, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.96% (0.4867 => 0.4723, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.59% (26.5159 => 25.8293, std.dev.: 0.0251) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: -2.50% (3.0263 => 2.9507, std.dev.: 0.0012) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.32% (1.9762 => 1.9304, std.dev.: 0.0099) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.99% (0.6589 => 0.6458, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7146, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/lists: -1.71% (6.3560 => 6.2474, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0065, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -1.45% (4.5928 => 4.5264, std.dev.: 0.0041) MultiSource/Applications/minisat/minisat: -1.29% (9.3358 => 9.2151, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout/heapsort: -1.22% (3.9173 => 3.8694, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4956, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2572, std.dev.: 0.0010) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 12 07:39:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 12 Oct 2012 09:39:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121012143940.006C52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4820?compare_to=4817&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4820, Order: 165792, Start Time: 2012-10-12 13:21:28, End Time: 2012-10-12 14:41:30 To: 4817, Order: 165791, Start Time: 2012-10-12 11:32:21, End Time: 2012-10-12 12:52:08 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (163 on baseline) Performance Improvements: 1 (44 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 951 (680 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.15% (80.7246 => 81.6523, std.dev.: 0.2131) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.38% (15.5962 => 15.3808, std.dev.: 0.0125) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.5964 => 0.5964, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: -0.37% (16.4943 => 16.4325, std.dev.: 0.0163) MultiSource/Benchmarks/Bullet/bullet: 0.11% (55.4053 => 55.4680, std.dev.: 0.0088) MultiSource/Benchmarks/MallocBench/gs/gs: -0.39% (4.4543 => 4.4368, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.22% (0.0460 => 0.0459, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.22% (0.0462 => 0.0461, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.46% (0.0431 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.46% (0.0433 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.24% (0.0420 => 0.0419) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.47% (0.0423 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.24% (0.0414 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.24% (0.0416 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.23% (0.0432 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.23% (0.0434 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.23% (0.0427 => 0.0426, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.47% (0.0429 => 0.0427, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.48% (0.0416 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.48% (0.0418 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.47% (0.0424 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0425 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.23% (0.0435 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.23% (0.0437 => 0.0436) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0411 => 0.0411) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.24% (0.0413 => 0.0412) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.47% (0.0424 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.24% (0.0425 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.24% (0.0415 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.24% (0.0417 => 0.0416) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.25% (0.0407 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.24% (0.0409 => 0.0408) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.25% (0.0405 => 0.0404, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.49% (0.0408 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.23% (0.0443 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.23% (0.0444 => 0.0443, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.49% (0.0405 => 0.0403, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.25% (0.0406 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.49% (0.0406 => 0.0404, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.49% (0.0408 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.24% (0.0414 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.24% (0.0415 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.14% (1.2619 => 1.2601, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.11% (7.8706 => 7.8789, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.05% (0.7432 => 0.7428, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -1.92% (0.0364 => 0.0357, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1432 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0646 => 0.0645, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.29% (63.2438 => 55.4680, std.dev.: 0.0088) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.34% (14.1553 => 19.0163, std.dev.: 0.0209) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.77% (3.4629 => 5.6711, std.dev.: 0.0011) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14239.17% (0.0720 => 10.3242, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9951800.00% (0.0001 => 9.9519, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.27% (0.2554 => 0.4170, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 48.36% (10.3673 => 15.3808, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/richards_benchmark: 39.15% (0.1622 => 0.2257, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/distray/distray: 33.52% (0.1056 => 0.1410, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 17.95% (0.1432 => 0.1689, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.63% (7.0540 => 8.2978, std.dev.: 0.0177) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.14% (2.2022 => 2.5797, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.13% (0.1566 => 0.1803, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.40% (1.7609 => 1.9969, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 12.95% (0.3282 => 0.3707, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.86% (0.0871 => 0.0983, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 12.71% (0.1440 => 0.1623, std.dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.60% (0.1143 => 0.1287, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 11.91% (10.4361 => 11.6787, std.dev.: 0.0151) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.81% (0.1584 => 0.1771, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 11.02% (0.7433 => 0.8252, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.85% (0.1438 => 0.1594, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.84% (0.3543 => 0.3927, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/trivial-interface: 10.65% (0.3473 => 0.3843, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.64% (0.3927 => 0.4345, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.58% (0.4879 => 0.5395, std.dev.: 0.0038) MultiSource/Applications/minisat/minisat: 10.56% (0.7115 => 0.7866, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 10.53% (0.3561 => 0.3936, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.53% (0.3543 => 0.3916, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 10.49% (0.3516 => 0.3885, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.49% (0.3497 => 0.3864, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.42% (0.3828 => 0.4227, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.32% (0.3886 => 0.4287, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.31% (0.3694 => 0.4075, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.28% (0.1625 => 0.1792, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.26% (0.6675 => 0.7360, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.22% (0.2700 => 0.2976, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.20% (0.3177 => 0.3501, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 10.17% (9.4845 => 10.4488, std.dev.: 0.0166) SingleSource/Benchmarks/McGill/chomp: 10.09% (0.1655 => 0.1822, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 9.87% (0.1175 => 0.1291, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.71% (0.4615 => 0.5063, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 9.70% (3.3354 => 3.6589, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.66% (1.5415 => 1.6904, std.dev.: 0.0037) MultiSource/Applications/sgefa/sgefa: 9.52% (0.3109 => 0.3405, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 9.50% (0.1695 => 0.1856, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 9.49% (0.3423 => 0.3748, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 9.41% (5.7591 => 6.3011, std.dev.: 0.0014) MultiSource/Applications/aha/aha: 9.38% (0.1151 => 0.1259, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.17% (0.5105 => 0.5573, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.14% (0.1236 => 0.1349, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.05% (0.8067 => 0.8797, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.02% (4.2646 => 4.6494, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.97% (1.3050 => 1.4221, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.94% (0.5860 => 0.6384, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.92% (0.2107 => 0.2295, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 8.87% (1.1642 => 1.2675, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.87% (0.1940 => 0.2112, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.85% (4.9449 => 5.3826, std.dev.: 0.0079) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.81% (0.1510 => 0.1643, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.81% (0.2271 => 0.2471, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.78% (5.0018 => 5.4411, std.dev.: 0.0092) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.72% (0.3121 => 0.3393, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.71% (0.5569 => 0.6054, std.dev.: 0.0028) MultiSource/Applications/lua/lua: 8.70% (3.8723 => 4.2093, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.70% (8.1363 => 8.8442, std.dev.: 0.0035) MultiSource/Applications/viterbi/viterbi: 8.68% (0.1555 => 0.1690, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.56% (0.3307 => 0.3590, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.54% (0.8172 => 0.8870, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.47% (0.2065 => 0.2240, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 8.47% (0.3387 => 0.3674, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 8.44% (0.7835 => 0.8496, std.dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference-object: 8.42% (0.6030 => 0.6538, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.42% (0.5925 => 0.6424, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.42% (0.9765 => 1.0587, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.41% (0.2758 => 0.2990, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.41% (0.5020 => 0.5442, std.dev.: 0.0049) MultiSource/Applications/hbd/hbd: 8.34% (1.5603 => 1.6904, std.dev.: 0.0037) MultiSource/Applications/lemon/lemon: 8.34% (1.0722 => 1.1616, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 8.30% (0.6456 => 0.6992, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.20% (7.9617 => 8.6143, std.dev.: 0.0037) MultiSource/Applications/treecc/treecc: 8.09% (2.0273 => 2.1913, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.99% (0.4103 => 0.4431, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/09-vor/vor: 7.96% (0.3180 => 0.3433, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.95% (1.5859 => 1.7120, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.93% (0.1337 => 0.1443, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 7.89% (0.7326 => 0.7904, std.dev.: 0.0019) MultiSource/Applications/siod/siod: 7.89% (2.2969 => 2.4781, std.dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: 7.74% (21.9371 => 23.6360, std.dev.: 0.0114) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.62% (1.1861 => 1.2765, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.59% (0.3441 => 0.3702, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.41% (0.4289 => 0.4607, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.40% (0.3865 => 0.4151, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.40% (0.4203 => 0.4514, std.dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.29% (0.6450 => 0.6920, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 7.25% (0.3422 => 0.3670, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.18% (0.2603 => 0.2790, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.12% (0.3650 => 0.3910, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.06% (0.3826 => 0.4096, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 7.04% (0.4048 => 0.4333, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.01% (0.4620 => 0.4944, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 7.01% (0.8921 => 0.9546, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 7.00% (0.4299 => 0.4600, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.91% (2.2024 => 2.3546, std.dev.: 0.0182) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.90% (0.4636 => 0.4956, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.82% (0.3136 => 0.3350, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.71% (0.1892 => 0.2019, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.59% (0.5981 => 0.6375, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.57% (0.2891 => 0.3081, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.52% (0.3603 => 0.3838, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.47% (0.2905 => 0.3093, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 6.46% (0.3684 => 0.3922, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.43% (0.1695 => 0.1804, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.42% (0.3162 => 0.3365, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.38% (1.4186 => 1.5091, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.31% (0.2756 => 0.2930, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 6.30% (1.1840 => 1.2586, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.30% (2.0665 => 2.1966, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: 6.22% (0.2831 => 0.3007, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.13% (0.2871 => 0.3047, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.09% (0.2266 => 0.2404, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.04% (0.3098 => 0.3285, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.03% (0.3283 => 0.3481, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.99% (0.2872 => 0.3044, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.98% (0.2725 => 0.2888, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 5.97% (0.3232 => 0.3425, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 5.94% (0.2877 => 0.3048, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.90% (0.3052 => 0.3232, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.88% (0.1906 => 0.2018, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 5.85% (0.2802 => 0.2966, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.82% (0.2714 => 0.2872, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.73% (0.2793 => 0.2953, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 5.71% (0.3379 => 0.3572, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.66% (0.4064 => 0.4294, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.30% (0.8101 => 0.8530, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.08% (0.3131 => 0.3290, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: 5.03% (0.2049 => 0.2152, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.96% (14.3668 => 15.0792, std.dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 4.65% (1.2842 => 1.3439, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 4.44% (17.1811 => 17.9445, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.35% (0.3427 => 0.3576, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.20% (0.2430 => 0.2532, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.05% (3.8922 => 4.0498, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.14% (1.1194 => 1.1546, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.12% (0.3817 => 0.3936, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8953, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.38% (0.2944 => 0.3279, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9648, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.92% (1.1396 => 1.2526, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4498, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (3.1578 => 3.3673, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.48% (3.6395 => 3.7661, std.dev.: 0.0035) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.76% (4.2280 => 4.3448, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7651, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.55% (0.8275 => 0.8403, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8124, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.22% (2.6546 => 2.6870, std.dev.: 0.0034) MultiSource/Applications/minisat/minisat: 1.13% (9.1159 => 9.2193, std.dev.: 0.0222) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5749, std.dev.: 0.0103) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1309, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -79.93% (0.8651 => 0.1736, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.02% (5.2763 => 3.2704, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.19% (5.3855 => 3.7057, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.84% (5.3526 => 3.7017, std.dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: -14.70% (54.1659 => 46.2022, std.dev.: 0.0247) MultiSource/Applications/ClamAV/clamscan: -12.19% (22.1758 => 19.4722, std.dev.: 0.0209) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.52% (2.9384 => 2.6292, std.dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.42% (1.1492 => 0.7651, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -16.33% (1.6925 => 1.4161, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.93% (0.0998 => 0.0859, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.65% (1.2373 => 1.0932, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/mandel-2: -10.38% (1.5373 => 1.3778, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -9.95% (0.2161 => 0.1946, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.36% (19.9488 => 18.2802, std.dev.: 0.0187) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.71% (1.8329 => 1.7100, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.30% (1.6805 => 1.5914, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-5: -5.00% (1.5835 => 1.5043, std.dev.: 0.0031) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7966, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.16% (0.9957 => 0.9543, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Applications/siod/siod: -3.65% (3.2827 => 3.1630, std.dev.: 0.0080) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5026, std.dev.: 0.0066) MultiSource/Applications/hexxagon/hexxagon: -3.03% (12.4730 => 12.0946, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.20% (8.6802 => 8.4891, std.dev.: 0.0134) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.08% (0.4808 => 0.4708, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.00% (8.1563 => 7.9930, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0833, std.dev.: 0.0276) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6813, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: -1.46% (9.5636 => 9.4241, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.38% (1.3045 => 1.2865, std.dev.: 0.0054) MultiSource/Applications/sqlite3/sqlite3: -1.14% (4.6441 => 4.5911, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8576, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 14.06% (0.5229 => 0.5964, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 9.63% (14.9895 => 16.4325, std.dev.: 0.0163) MultiSource/Benchmarks/MallocBench/gs/gs: 7.94% (4.1105 => 4.4368, std.dev.: 0.0105) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.06% (1.1048 => 1.2601, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.07% (7.1582 => 7.8789, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.38% (0.6222 => 0.7428, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35600.00% (0.0001 => 0.0357, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.52% (0.2116 => 0.0645, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 12 09:04:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 12 Oct 2012 11:04:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121012160459.7F18E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4821?compare_to=4819&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4821, Order: 165793, Start Time: 2012-10-12 14:40:30, End Time: 2012-10-12 16:06:49 To: 4819, Order: 165792, Start Time: 2012-10-12 12:45:09, End Time: 2012-10-12 14:11:05 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (191 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1039 (674 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 3.05% (3.7690 => 3.8841, std.dev.: 0.0235) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.18% (1.2873 => 1.3025, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.04% (1.5126 => 1.4968, std.dev.: 0.0025) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.81% (2.0176 => 2.4980, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.51% (0.1410 => 0.1671, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.76% (0.0653 => 0.0769, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 17.55% (0.0826 => 0.0971, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 16.94% (0.2243 => 0.2623, std.dev.: 0.0068) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.88% (0.1072 => 0.1253, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.32% (0.1327 => 0.1517, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 14.02% (0.1013 => 0.1155, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 13.51% (0.7038 => 0.7989, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.43% (0.0834 => 0.0946, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.38% (0.0770 => 0.0873, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 13.37% (1.3693 => 1.5524, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.31% (0.1413 => 0.1601, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.66% (0.0964 => 0.1086, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.64% (3.9660 => 4.4672, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.37% (0.2596 => 0.2917, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.34% (0.1588 => 0.1784, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.31% (1.4563 => 1.6356, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.27% (0.2721 => 0.3055, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.27% (0.6959 => 0.7813, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/hash: 12.26% (0.4062 => 0.4560, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.25% (0.5265 => 0.5910, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 12.25% (0.4328 => 0.4858, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.09% (0.7710 => 0.8642, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.08% (0.9199 => 1.0310, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 11.98% (0.5818 => 0.6515, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 11.96% (0.1062 => 0.1189, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 11.91% (13.8202 => 15.4666, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.83% (0.6283 => 0.7026, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.81% (1.2193 => 1.3633, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/power/power: 11.76% (0.1003 => 0.1121, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.72% (0.3899 => 0.4356, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.62% (0.4390 => 0.4900, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: 11.60% (0.5748 => 0.6415, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 11.52% (0.1589 => 0.1772) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.42% (1.1364 => 1.2662, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 11.23% (0.7061 => 0.7854, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.16% (0.3485 => 0.3874, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.15% (0.1157 => 0.1286, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.13% (0.3756 => 0.4174, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 11.07% (1.0313 => 1.1455, std.dev.: 0.0067) MultiSource/Applications/kimwitu++/kc: 11.06% (16.6129 => 18.4510, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.02% (0.3130 => 0.3475, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.01% (0.1435 => 0.1593, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 11.00% (0.2781 => 0.3087, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 10.93% (1.1061 => 1.2270, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.91% (0.4016 => 0.4454, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.79% (0.5577 => 0.6179, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.75% (0.3580 => 0.3965, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.72% (0.3489 => 0.3863, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.69% (0.3022 => 0.3345, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.65% (0.2966 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 10.64% (0.2726 => 0.3016, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 10.63% (0.3293 => 0.3643, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.60% (0.4791 => 0.5299, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.51% (0.1075 => 0.1188, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.50% (0.2782 => 0.3074, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.46% (0.4379 => 0.4837, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.44% (0.0977 => 0.1079, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 10.39% (0.3868 => 0.4270, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.39% (1.9828 => 2.1888, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 10.31% (3.8646 => 4.2631, std.dev.: 0.0081) MultiSource/Applications/minisat/minisat: 10.31% (0.6744 => 0.7439, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.29% (0.3246 => 0.3580, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 10.27% (0.7506 => 0.8277, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.26% (0.2914 => 0.3213, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 10.23% (0.3107 => 0.3425, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 10.23% (0.3149 => 0.3471, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 10.22% (2.1791 => 2.4018, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/except: 10.22% (0.2760 => 0.3042, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 10.22% (0.2995 => 0.3301, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/sieve: 10.19% (0.3453 => 0.3805, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 10.18% (0.2761 => 0.3042, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.16% (0.2127 => 0.2343, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.13% (0.2655 => 0.2924, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: 10.11% (0.2690 => 0.2962, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 10.07% (0.3534 => 0.3890, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 10.06% (0.3220 => 0.3544, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 10.02% (1.9270 => 2.1201, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.02% (0.2765 => 0.3042, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 9.99% (0.1111 => 0.1222, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 9.98% (0.2925 => 0.3217, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.98% (0.8698 => 0.9566, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.97% (0.7460 => 0.8204, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 9.96% (0.8310 => 0.9138, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.92% (0.1865 => 0.2050, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 9.91% (0.2937 => 0.3228, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.89% (0.2023 => 0.2223, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 9.88% (0.1478 => 0.1624, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 9.87% (0.3192 => 0.3507, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 9.86% (0.2607 => 0.2864, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.85% (0.5637 => 0.6192, std.dev.: 0.0039) MultiSource/Applications/d/make_dparser: 9.84% (3.1889 => 3.5027, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: 9.82% (0.2628 => 0.2886, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.77% (0.1986 => 0.2180, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.64% (0.1276 => 0.1399, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.57% (0.2696 => 0.2954, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 9.54% (0.1657 => 0.1815, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 9.52% (1.0594 => 1.1603, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/matrix: 9.50% (0.2988 => 0.3272, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.43% (7.2180 => 7.8990, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.37% (0.1569 => 0.1716, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.26% (4.9865 => 5.4484, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/objinst: 9.24% (0.2945 => 0.3217, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.10% (1.3245 => 1.4450, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.95% (0.3755 => 0.4091, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.83% (0.6135 => 0.6677, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.82% (3.6692 => 3.9930, std.dev.: 0.0092) MultiSource/Applications/SIBsim4/SIBsim4: 8.79% (1.2749 => 1.3870, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.73% (0.6576 => 0.7150, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.66% (4.3801 => 4.7592, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.63% (4.4433 => 4.8268, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 8.63% (14.8535 => 16.1347, std.dev.: 0.0157) MultiSource/Benchmarks/sim/sim: 8.62% (0.3131 => 0.3401, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.43% (0.8818 => 0.9561, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 8.29% (8.4961 => 9.2005, std.dev.: 0.0150) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.28% (1.5188 => 1.6446, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.14% (0.2321 => 0.2510, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.08% (0.2140 => 0.2313, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.05% (0.1789 => 0.1933, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 7.95% (0.6250 => 0.6747, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.94% (1.1333 => 1.2233, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.94% (0.9108 => 0.9831, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.92% (0.3511 => 0.3789, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.92% (3.2742 => 3.5334, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/05-eks/eks: 7.85% (0.4113 => 0.4436, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.85% (0.4805 => 0.5182, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 7.81% (4.6629 => 5.0271, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: 7.77% (0.4003 => 0.4314, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.70% (0.3245 => 0.3495, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 7.63% (6.5754 => 7.0769, std.dev.: 0.0128) MultiSource/Applications/lua/lua: 7.60% (3.7467 => 4.0313, std.dev.: 0.0087) MultiSource/Applications/hexxagon/hexxagon: 7.57% (1.2292 => 1.3223, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 7.51% (0.3940 => 0.4236, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.46% (0.3914 => 0.4206, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 7.44% (0.1385 => 0.1488, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.35% (0.2504 => 0.2688, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.28% (2.1007 => 2.2537, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.23% (0.3650 => 0.3914, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 7.18% (0.3578 => 0.3835, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 7.17% (0.2008 => 0.2152, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 7.16% (0.3646 => 0.3907, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/for-in: 7.15% (0.3789 => 0.4060, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 7.09% (0.3623 => 0.3880, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/synchronized: 7.07% (0.3663 => 0.3922, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.00% (0.3601 => 0.3853, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.86% (6.2785 => 6.7091, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.52% (13.2842 => 14.1500, std.dev.: 0.0083) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.43% (0.1819 => 0.1936, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/ReedSolomon: 5.68% (0.1777 => 0.1878, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.35% (0.2243 => 0.2363, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 4.86% (16.2614 => 17.0512, std.dev.: 0.0203) MultiSource/Applications/ClamAV/clamscan: 4.50% (14.5298 => 15.1838, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/bh/bh: 4.02% (0.2859 => 0.2974, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 2.25% (33.2944 => 34.0436, std.dev.: 0.0121) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5158, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/fbench: 25.25% (1.8175 => 2.2765, std.dev.: 0.0284) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 11.08% (1.1560 => 1.2841, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.70% (0.1322 => 0.1437) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (3.1736 => 3.4148, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.17% (1.2998 => 1.3800, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.87% (0.2093 => 0.2195, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9998, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0044, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6763, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9853, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 3.22% (10.7476 => 11.0941, std.dev.: 0.0022) SingleSource/Regression/C/uint64_to_float: 3.03% (0.5449 => 0.5614, std.dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 2.94% (3.7731 => 3.8841, std.dev.: 0.0235) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.21% (7.4271 => 7.5911, std.dev.: 0.0037) MultiSource/Applications/lemon/lemon: 1.85% (1.4298 => 1.4563, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5129, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1886, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.20% (5.5130 => 5.5793, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0269, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 1.07% (12.4560 => 12.5888, std.dev.: 0.0064) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.85% (0.2670 => 0.1419, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.89% (0.4657 => 0.3917, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -14.29% (0.0707 => 0.0606, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.33% (1.3819 => 1.1977, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.23% (1.3813 => 1.1986, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.26% (22.5627 => 22.2776, std.dev.: 0.0154) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.94% (1.2308 => 1.0838, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/mason/mason: -11.93% (0.2238 => 0.1971, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.06% (20.3410 => 18.2938, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2653, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.48% (1.3780 => 1.3025, std.dev.: 0.0045) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.26% (2.6470 => 2.5078, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.66% (0.9996 => 0.9530, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8005, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.60% (3.2729 => 3.1551, std.dev.: 0.0054) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.48% (1.7688 => 1.7073, std.dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.02% (0.4867 => 0.4720, std.dev.: 0.0007) MultiSource/Applications/lua/lua: -2.59% (26.5159 => 25.8287, std.dev.: 0.0366) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.39% (3.0263 => 2.9540, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -2.37% (1.9762 => 1.9293, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.00% (0.6589 => 0.6457, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7132, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/lists: -1.72% (6.3560 => 6.2466, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0060, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -1.44% (4.5928 => 4.5266, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4949, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2582, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: -1.07% (9.3358 => 9.2356, std.dev.: 0.0202) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 12 09:28:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 12 Oct 2012 11:28:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121012162850.E75162A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4822?compare_to=4820&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4822, Order: 165797, Start Time: 2012-10-12 15:10:53, End Time: 2012-10-12 16:30:41 To: 4820, Order: 165792, Start Time: 2012-10-12 13:21:28, End Time: 2012-10-12 14:41:30 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (161 on baseline) Performance Improvements: 1 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 950 (684 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 3.04% (2.2926 => 2.3624, std.dev.: 0.0148) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.39% (1.2865 => 1.3172, std.dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.01% (81.6523 => 80.0135, std.dev.: 0.3302) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.45% (0.5964 => 0.5937, std.dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: -0.01% (16.4325 => 16.4301, std.dev.: 0.0221) MultiSource/Benchmarks/Bullet/bullet: -0.02% (55.4680 => 55.4588, std.dev.: 0.0307) MultiSource/Benchmarks/MallocBench/gs/gs: 0.06% (4.4368 => 4.4393, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.22% (0.0459 => 0.0460, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.22% (0.0461 => 0.0462, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.23% (0.0429 => 0.0430, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0431 => 0.0431, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0419 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.24% (0.0421 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0413 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.24% (0.0415 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0431 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0433 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.23% (0.0426 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.23% (0.0427 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.48% (0.0414 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.24% (0.0416 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.24% (0.0422 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.24% (0.0425 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.23% (0.0434 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0436 => 0.0436) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.24% (0.0411 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0412 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.24% (0.0422 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0424 => 0.0424) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.24% (0.0414 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0416 => 0.0416) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.25% (0.0406 => 0.0407) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.25% (0.0408 => 0.0407, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.25% (0.0404 => 0.0405) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0406 => 0.0406, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0442 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0443 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.50% (0.0403 => 0.0405) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.25% (0.0405 => 0.0406) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.25% (0.0404 => 0.0405) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.25% (0.0406 => 0.0405, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.24% (0.0413 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.24% (0.0414 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.03% (1.2601 => 1.2605, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.03% (7.8789 => 7.8812, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.05% (0.7428 => 0.7424, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.28% (0.0357 => 0.0358, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.16% (0.0645 => 0.0646, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.31% (63.2438 => 55.4588, std.dev.: 0.0307) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.39% (14.1553 => 19.0237, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.77% (3.4629 => 5.6713, std.dev.: 0.0125) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14231.67% (0.0720 => 10.3188, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952400.00% (0.0001 => 9.9525, std.dev.: 0.0012) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.47% (0.2554 => 0.4175, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 48.33% (10.3673 => 15.3774, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/richards_benchmark: 39.27% (0.1622 => 0.2259, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/distray/distray: 33.52% (0.1056 => 0.1410, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 17.95% (0.1432 => 0.1689, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.71% (7.0540 => 8.3035, std.dev.: 0.0158) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.16% (2.2022 => 2.5801, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.13% (0.1566 => 0.1803, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.25% (0.0730 => 0.0834, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.40% (1.7609 => 1.9969, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.97% (0.0871 => 0.0984, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 12.80% (0.3282 => 0.3702, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 12.78% (0.1440 => 0.1624, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.74% (0.1625 => 0.1832, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.60% (0.1143 => 0.1287, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 11.91% (10.4361 => 11.6788, std.dev.: 0.0153) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.87% (0.1584 => 0.1772, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 11.17% (0.7433 => 0.8263, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 10.71% (0.3473 => 0.3845, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.68% (0.4879 => 0.5400, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 10.67% (0.3927 => 0.4346, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.58% (0.3543 => 0.3918, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 10.58% (0.3497 => 0.3867, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.50% (0.3543 => 0.3915, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 10.48% (0.7115 => 0.7861, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.47% (0.3561 => 0.3934, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.45% (0.3828 => 0.4228, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.44% (0.3516 => 0.3883, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.43% (0.1438 => 0.1588, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 10.27% (0.3886 => 0.4285, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 10.26% (0.3694 => 0.4073, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 10.19% (9.4845 => 10.4509, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.15% (0.2700 => 0.2974, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.07% (0.6675 => 0.7347, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 10.03% (0.1655 => 0.1821, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.95% (0.3177 => 0.3493, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 9.87% (0.1175 => 0.1291, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.81% (1.5415 => 1.6927, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: 9.68% (3.3354 => 3.6583, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: 9.56% (0.7835 => 0.8584, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.56% (0.4615 => 0.5056, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 9.47% (0.3423 => 0.3747, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 9.39% (0.3109 => 0.3401, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 9.38% (0.1151 => 0.1259, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/em3d/em3d: 9.38% (0.1695 => 0.1854, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 9.35% (5.7591 => 6.2975, std.dev.: 0.0195) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.21% (0.5105 => 0.5575, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.14% (0.1236 => 0.1349, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.07% (4.2646 => 4.6515, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.01% (0.5860 => 0.6388, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.92% (1.3050 => 1.4214, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.90% (0.8067 => 0.8785, std.dev.: 0.0034) MultiSource/Applications/Burg/burg: 8.90% (1.1642 => 1.2678, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.87% (5.0018 => 5.4456, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.87% (0.1940 => 0.2112, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.81% (0.1510 => 0.1643, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.77% (4.9449 => 5.3785, std.dev.: 0.0087) MultiSource/Applications/lua/lua: 8.76% (3.8723 => 4.2117, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.76% (0.2271 => 0.2470, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.71% (8.1363 => 8.8453, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.69% (0.5569 => 0.6053, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.63% (0.2758 => 0.2996, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.59% (0.2107 => 0.2288, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.55% (0.3121 => 0.3388, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 8.55% (0.1555 => 0.1688, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.50% (0.3307 => 0.3588, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.47% (0.2065 => 0.2240, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.46% (0.9765 => 1.0591, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 8.44% (1.0722 => 1.1627) SingleSource/UnitTests/ObjC++/property-reference-object: 8.42% (0.6030 => 0.6538, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.42% (0.8172 => 0.8860, std.dev.: 0.0047) SingleSource/UnitTests/ObjC++/Hello: 8.41% (0.5925 => 0.6423, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 8.40% (1.5603 => 1.6914, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.33% (0.5020 => 0.5438, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/bigfib: 8.32% (0.6456 => 0.6993, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.26% (0.4103 => 0.4442, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 8.18% (2.0273 => 2.1932, std.dev.: 0.0023) MultiSource/Benchmarks/sim/sim: 8.18% (0.3387 => 0.3664, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.17% (7.9617 => 8.6118, std.dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.96% (1.5859 => 1.7122, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 7.96% (0.3180 => 0.3433, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 7.85% (2.2969 => 2.4771, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.79% (0.3441 => 0.3709, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 7.78% (0.7326 => 0.7896, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.78% (0.1337 => 0.1441, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.74% (0.3826 => 0.4122, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 7.69% (21.9371 => 23.6249, std.dev.: 0.0236) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.60% (1.1861 => 1.2763, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.49% (0.3136 => 0.3371, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.43% (0.3865 => 0.4152, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.40% (0.4203 => 0.4514, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 7.39% (0.3422 => 0.3675, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.33% (0.6450 => 0.6923, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 7.32% (0.4289 => 0.4603, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.22% (0.2603 => 0.2791, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.10% (0.3650 => 0.3909, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 7.06% (0.8921 => 0.9551, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 7.04% (0.4048 => 0.4333, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 7.00% (0.4299 => 0.4600, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 6.95% (0.4620 => 0.4941, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.88% (2.2024 => 2.3539, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.75% (0.4636 => 0.4949, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.70% (0.5981 => 0.6382, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.63% (0.3603 => 0.3842, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.57% (0.2905 => 0.3096, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.50% (0.2891 => 0.3079, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.49% (0.1695 => 0.1805, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 6.49% (0.3684 => 0.3923, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.45% (0.3162 => 0.3366, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.44% (1.4186 => 1.5100, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 6.32% (1.1840 => 1.2588, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.25% (2.0665 => 2.1957, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/matrix: 6.13% (0.3098 => 0.3288, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.13% (0.2725 => 0.2892, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.09% (0.2266 => 0.2404, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 6.03% (0.3283 => 0.3481, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.99% (0.2872 => 0.3044, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.99% (0.2756 => 0.2921, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 5.97% (0.3232 => 0.3425, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 5.96% (0.3052 => 0.3234, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 5.91% (0.2877 => 0.3047, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.84% (0.2793 => 0.2956, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.82% (0.1906 => 0.2017, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.71% (0.2714 => 0.2869, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/random: 5.71% (0.2802 => 0.2962, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.71% (0.4064 => 0.4296, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.60% (0.1892 => 0.1998, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.59% (0.3379 => 0.3568, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.28% (0.8101 => 0.8529, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/ReedSolomon: 5.17% (0.2049 => 0.2155, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.98% (14.3668 => 15.0825, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/objinst: 4.79% (0.3131 => 0.3281, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 4.70% (1.2842 => 1.3446, std.dev.: 0.0111) MultiSource/Applications/sqlite3/sqlite3: 4.55% (17.1811 => 17.9624, std.dev.: 0.0122) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.36% (0.2430 => 0.2536, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.35% (0.3427 => 0.3576, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.20% (3.8922 => 4.0557, std.dev.: 0.0132) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.23% (1.1194 => 1.1556, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.12% (0.3817 => 0.3936, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.35% (0.2944 => 0.3278, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.93% (1.1396 => 1.2528, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4499, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (3.1578 => 3.3678, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 3.75% (2.2771 => 2.3624, std.dev.: 0.0148) SingleSource/Regression/C/uint64_to_float: 3.68% (0.5413 => 0.5612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.51% (3.6395 => 3.7672, std.dev.: 0.0037) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.86% (4.2280 => 4.3489, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (0.8275 => 0.8405, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8125, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.18% (2.6546 => 2.6858, std.dev.: 0.0034) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1309, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -79.93% (0.8651 => 0.1736, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.00% (5.2763 => 3.2715, std.dev.: 0.0245) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.17% (5.3855 => 3.7069, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.78% (5.3526 => 3.7050, std.dev.: 0.0021) SingleSource/UnitTests/Vector/constpool: -14.69% (54.1659 => 46.2068, std.dev.: 0.0394) MultiSource/Applications/ClamAV/clamscan: -12.22% (22.1758 => 19.4655, std.dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.46% (2.9384 => 2.6311, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7652, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.79% (1.6925 => 1.4253, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.73% (0.0998 => 0.0861, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.27% (1.2373 => 1.0979, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: -10.42% (1.5373 => 1.3771, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/mason/mason: -10.13% (0.2161 => 0.1942, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.28% (19.9488 => 18.2975, std.dev.: 0.0122) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.77% (1.8329 => 1.7089, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0152) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.28% (1.6805 => 1.5917, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5090, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.90% (0.9957 => 0.9569, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1627, std.dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.4995, std.dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: -3.01% (12.4730 => 12.0978, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.19% (8.1563 => 7.9780, std.dev.: 0.0235) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.86% (8.6802 => 8.5188, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/salsa20: -1.83% (10.2830 => 10.0949, std.dev.: 0.0158) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6813, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.51% (2.5528 => 2.5142, std.dev.: 0.0048) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4218, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -1.13% (4.6441 => 4.5918, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.05% (6.2999 => 6.2335, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.54% (0.5229 => 0.5937, std.dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: 9.61% (14.9895 => 16.4301, std.dev.: 0.0221) MultiSource/Benchmarks/MallocBench/gs/gs: 8.00% (4.1105 => 4.4393, std.dev.: 0.0108) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.09% (1.1048 => 1.2605, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.10% (7.1582 => 7.8812, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.32% (0.6222 => 0.7424, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35700.00% (0.0001 => 0.0358, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.47% (0.2116 => 0.0646, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 12 09:34:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 12 Oct 2012 11:34:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121012163401.0B5D42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4823?compare_to=4818&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4823, Order: 165792, Start Time: 2012-10-12 13:26:07, End Time: 2012-10-12 16:35:51 To: 4818, Order: 165790, Start Time: 2012-10-12 09:47:00, End Time: 2012-10-12 12:56:55 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (135 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1042 (755 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-4: 11.11% (0.3465 => 0.3850, std.dev.: 0.0086) SingleSource/UnitTests/ObjC/for-in: 11.10% (0.3496 => 0.3884, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.10% (0.3488 => 0.3875, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.06% (0.3446 => 0.3827, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.01% (0.3469 => 0.3851, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 11.01% (0.3460 => 0.3841, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.01% (0.3442 => 0.3821, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.93% (0.3643 => 0.4041, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 10.90% (0.3650 => 0.4048, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.61% (0.3724 => 0.4119, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.69% (0.1063 => 0.1166, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.42% (0.5826 => 0.6375, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.36% (0.5889 => 0.6440, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 9.03% (1.5932 => 1.7371, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 8.78% (0.1218 => 0.1325, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 8.52% (0.1619 => 0.1757, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.17% (0.2875 => 0.3110, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.10% (1.6211 => 1.7524, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 7.96% (0.7171 => 0.7742, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.93% (0.4361 => 0.4707, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.92% (0.3195 => 0.3448, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 7.90% (0.2823 => 0.3046, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/fibo: 7.89% (0.2725 => 0.2940, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.89% (0.2714 => 0.2928, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 7.84% (5.5417 => 5.9763, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash: 7.81% (0.4146 => 0.4470, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.79% (0.3004 => 0.3238, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 7.77% (0.2780 => 0.2996, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.77% (0.2729 => 0.2941, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.76% (1.3152 => 1.4173, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/random: 7.74% (0.2803 => 0.3020, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.71% (0.2813 => 0.3030, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.71% (0.2738 => 0.2949, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 7.68% (0.2811 => 0.3027, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.67% (0.2750 => 0.2961, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.67% (2.0673 => 2.2258, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.66% (0.2792 => 0.3006, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.65% (0.4994 => 0.5376, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.59% (0.1620 => 0.1743, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 7.59% (0.3267 => 0.3515, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 7.59% (0.3096 => 0.3331, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 7.59% (0.9909 => 1.0661, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.54% (0.5000 => 0.5377, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.52% (0.2911 => 0.3130, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 7.45% (0.4847 => 0.5208, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.44% (3.5627 => 3.8279, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.44% (0.3362 => 0.3612, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.43% (0.3258 => 0.3500, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.43% (0.3124 => 0.3356, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.42% (0.3625 => 0.3894, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.36% (0.3845 => 0.4128, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 7.34% (0.3678 => 0.3948, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.32% (0.3060 => 0.3284, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 7.27% (23.5202 => 25.2304, std.dev.: 0.0170) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.25% (0.2014 => 0.2160, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.24% (0.2736 => 0.2934, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 7.24% (0.3317 => 0.3557, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 7.23% (0.3348 => 0.3590, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 7.22% (0.3726 => 0.3995, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.15% (0.4251 => 0.4555, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.13% (0.3282 => 0.3516, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 7.11% (0.6634 => 0.7106, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 7.10% (0.3477 => 0.3724, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.10% (0.3690 => 0.3952, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 7.04% (0.1421 => 0.1521, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.02% (0.5900 => 0.6314, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.01% (0.4139 => 0.4429, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.97% (0.1549 => 0.1657) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.94% (0.5026 => 0.5375, std.dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 6.90% (0.2566 => 0.2743, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.84% (0.3930 => 0.4199, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 6.84% (0.1505 => 0.1608, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 6.82% (1.0781 => 1.1516, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.77% (0.2866 => 0.3060, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 6.76% (4.2109 => 4.4957, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/bigfib: 6.74% (0.5012 => 0.5350, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.74% (0.3903 => 0.4166, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.73% (0.3981 => 0.4249, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.62% (2.7292 => 2.9099, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 6.61% (1.8794 => 2.0037, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.58% (0.3890 => 0.4146, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.55% (0.3084 => 0.3286, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 6.50% (0.4029 => 0.4291, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.48% (4.4195 => 4.7061, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.47% (0.2737 => 0.2914, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.45% (0.6435 => 0.6850, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 6.41% (0.3336 => 0.3550, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.37% (0.2969 => 0.3158, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 6.36% (1.4269 => 1.5176, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 6.35% (0.5546 => 0.5898, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.29% (0.2068 => 0.2198, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.18% (0.3271 => 0.3473, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.10% (0.1968 => 0.2088, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.04% (0.2103 => 0.2230, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 5.96% (4.6177 => 4.8929, std.dev.: 0.0094) MultiSource/Benchmarks/mafft/pairlocalalign: 5.94% (2.1013 => 2.2262, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.93% (0.4658 => 0.4934, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: 5.89% (0.9697 => 1.0268, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.88% (0.7426 => 0.7863, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 5.75% (2.1653 => 2.2899, std.dev.: 0.0031) MultiSource/Applications/treecc/treecc: 5.54% (0.7875 => 0.8311, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.44% (0.2040 => 0.2151, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 5.40% (2.0346 => 2.1445, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.35% (0.5361 => 0.5648, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 5.35% (0.2075 => 0.2186, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.29% (1.9694 => 2.0736, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.26% (1.9966 => 2.1016, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 5.23% (0.2391 => 0.2516, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.11% (11.6398 => 12.2342, std.dev.: 0.0128) MultiSource/Applications/SIBsim4/SIBsim4: 4.87% (0.2691 => 0.2822, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.69% (0.5584 => 0.5846, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 4.63% (0.3498 => 0.3660, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.37% (4.6926 => 4.8975, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.27% (0.4253 => 0.4392, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 3.15% (11.9555 => 12.3321, std.dev.: 0.0121) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.63% (6.2401 => 7.6525, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.45% (3.3903 => 3.6089, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-2: 5.30% (1.8057 => 1.9014, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6737, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1674, std.dev.: 0.1177) SingleSource/Benchmarks/Dhrystone/dry: 4.29% (14.0481 => 14.6511, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2083, std.dev.: 0.0026) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.52% (3.1722 => 3.2205, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.47% (7.1849 => 7.2905, std.dev.: 0.0016) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3030, std.dev.: 0.0162) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5139, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.15% (1.0927 => 1.1053, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5389, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5892, std.dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.53% (2.4764 => 2.4137, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.80% (25.4195 => 16.5724, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/ary2: -10.62% (0.2402 => 0.2147, std.dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9775, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7962, std.dev.: 0.0116) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -3.78% (11.2080 => 10.7840, std.dev.: 0.0104) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7749, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.99% (0.6293 => 0.6105, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -2.74% (17.2379 => 16.7657, std.dev.: 0.0307) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8683, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5741, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4965, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.22% (105.3826 => 104.0943, std.dev.: 0.1026) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0411, std.dev.: 0.0019) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 12 11:00:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 12 Oct 2012 13:00:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121012180037.AFB7D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4824?compare_to=4821&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4824, Order: 165802, Start Time: 2012-10-12 16:36:28, End Time: 2012-10-12 18:02:28 To: 4821, Order: 165793, Start Time: 2012-10-12 14:40:30, End Time: 2012-10-12 16:06:49 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 4 (187 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1037 (677 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.81% (55.0016 => 56.5476, std.dev.: 0.1548) SingleSource/Benchmarks/Misc/fbench: 2.60% (2.2765 => 2.3357, std.dev.: 0.0211) MultiSource/Applications/siod/siod: 1.46% (3.1551 => 3.2011, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.25% (79.5216 => 80.5169, std.dev.: 0.2589) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -3.39% (3.8841 => 3.7525, std.dev.: 0.0473) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.47% (2.0176 => 2.4912, std.dev.: 0.0050) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.30% (0.1410 => 0.1668, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 16.95% (0.0826 => 0.0966, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.85% (0.0653 => 0.0763, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 16.67% (0.2243 => 0.2617, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.30% (0.1072 => 0.1236, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 13.92% (0.1013 => 0.1154, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.34% (0.1327 => 0.1504, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.31% (0.0834 => 0.0945, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 13.30% (1.3693 => 1.5514, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.09% (0.1413 => 0.1598, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 13.09% (0.7038 => 0.7959, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.40% (3.9660 => 4.4578, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.35% (0.2721 => 0.3057, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.34% (0.0964 => 0.1083, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 12.34% (0.4328 => 0.4862, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.17% (0.7710 => 0.8648, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.15% (0.1588 => 0.1781, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.13% (0.2596 => 0.2911, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 12.11% (0.4062 => 0.4554, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.10% (0.5265 => 0.5902, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.91% (1.4563 => 1.6298, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.90% (0.6959 => 0.7787, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.85% (0.9199 => 1.0289, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 11.81% (0.5818 => 0.6505, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 11.80% (0.7061 => 0.7894, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 11.68% (0.1062 => 0.1186, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.62% (0.6283 => 0.7013, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.62% (0.3899 => 0.4352, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.61% (1.2193 => 1.3608, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 11.59% (13.8202 => 15.4224, std.dev.: 0.0041) SingleSource/UnitTests/ObjC++/Hello: 11.43% (0.5748 => 0.6405, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 11.39% (0.1589 => 0.1770, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 11.37% (0.1003 => 0.1117, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.15% (0.1157 => 0.1286, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.15% (1.1364 => 1.2631, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.02% (0.3485 => 0.3869, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 10.97% (0.2781 => 0.3086, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.94% (0.3756 => 0.4167, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 10.91% (1.0313 => 1.1438, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.83% (0.3130 => 0.3469, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.72% (0.3022 => 0.3346, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 10.71% (16.6129 => 18.3918, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.71% (0.4016 => 0.4446, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 10.70% (1.1061 => 1.2244, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.60% (0.5577 => 0.6168, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.54% (0.4791 => 0.5296, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 10.54% (0.3293 => 0.3640, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.53% (0.3580 => 0.3957, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.52% (0.4390 => 0.4852, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.52% (0.3489 => 0.3856, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.51% (0.2655 => 0.2934, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.42% (0.2782 => 0.3072, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.42% (0.1075 => 0.1187, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.32% (0.1986 => 0.2191, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 10.27% (0.2726 => 0.3006, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 10.26% (0.3868 => 0.4265, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.24% (0.0977 => 0.1077, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 10.23% (0.6744 => 0.7434, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 10.22% (0.2995 => 0.3301, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/except: 10.14% (0.2760 => 0.3040, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 10.12% (0.3220 => 0.3546, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.12% (0.2914 => 0.3209, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.12% (0.4379 => 0.4822, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.11% (0.2966 => 0.3266, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.10% (0.3246 => 0.3574, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 10.10% (0.3149 => 0.3467, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.10% (1.9828 => 2.1830, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 10.07% (0.3107 => 0.3420, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 10.07% (0.2761 => 0.3039, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.02% (0.2765 => 0.3042, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 9.99% (0.3453 => 0.3798, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 9.99% (0.1111 => 0.1222, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 9.97% (0.7506 => 0.8254, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 9.90% (0.2607 => 0.2865, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.87% (0.2127 => 0.2337, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 9.87% (1.9270 => 2.1172, std.dev.: 0.0064) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.87% (0.7460 => 0.8196, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/gs/gs: 9.86% (3.8646 => 4.2457, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/random: 9.85% (0.2690 => 0.2955, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.82% (0.8698 => 0.9552, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 9.79% (0.3534 => 0.3880, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 9.79% (2.1791 => 2.3924, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.76% (0.5637 => 0.6187, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 9.74% (0.2925 => 0.3210, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 9.74% (0.1478 => 0.1622, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 9.74% (3.1889 => 3.4995, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/fibo: 9.70% (0.2628 => 0.2883, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 9.68% (0.3192 => 0.3501, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 9.61% (0.8310 => 0.9109, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 9.60% (0.2937 => 0.3219, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.60% (0.1865 => 0.2044, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.49% (0.2023 => 0.2215, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.48% (0.1435 => 0.1571, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 9.47% (0.1657 => 0.1814, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 9.44% (0.2988 => 0.3270, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.42% (0.2696 => 0.2950, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.35% (7.2180 => 7.8931, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.25% (0.1276 => 0.1394, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.24% (0.1569 => 0.1714, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.21% (0.3755 => 0.4101, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 9.14% (1.0594 => 1.1562, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.13% (4.9865 => 5.4417, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/objinst: 9.03% (0.2945 => 0.3211, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.90% (0.6576 => 0.7161, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.89% (1.3245 => 1.4423, std.dev.: 0.0105) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.72% (0.6135 => 0.6670, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.58% (3.6692 => 3.9842, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 8.53% (0.3131 => 0.3398, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 8.51% (1.2749 => 1.3834, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.46% (4.3801 => 4.7508, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.45% (4.4433 => 4.8189, std.dev.: 0.0058) MultiSource/Applications/JM/lencod/lencod: 8.42% (14.8535 => 16.1042, std.dev.: 0.0201) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.22% (0.1789 => 0.1936, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.18% (0.8818 => 0.9539, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 8.17% (8.4961 => 9.1905, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.16% (1.5188 => 1.6428, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.04% (0.2140 => 0.2312, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.95% (0.3511 => 0.3790, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.93% (0.2321 => 0.2505, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 7.78% (0.4113 => 0.4433, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.73% (1.1333 => 1.2209, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.73% (3.2742 => 3.5272, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 7.66% (0.6250 => 0.6729, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.65% (0.9108 => 0.9805, std.dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.64% (0.4805 => 0.5172, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 7.54% (0.4003 => 0.4305, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 7.47% (3.7467 => 4.0265, std.dev.: 0.0066) MultiSource/Applications/oggenc/oggenc: 7.45% (4.6629 => 5.0101, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: 7.44% (0.1385 => 0.1488, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.40% (0.3245 => 0.3485, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.37% (0.3650 => 0.3919, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 7.30% (6.5754 => 7.0553, std.dev.: 0.0168) MultiSource/Applications/hexxagon/hexxagon: 7.26% (1.2292 => 1.3185, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/exceptions: 7.23% (0.3914 => 0.4197, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.21% (0.3940 => 0.4224, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.15% (0.3789 => 0.4060, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.11% (0.2504 => 0.2682, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 7.04% (0.3578 => 0.3830, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.03% (2.1007 => 2.2483, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 6.99% (0.3646 => 0.3901, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 6.92% (0.2008 => 0.2147, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 6.91% (0.3663 => 0.3916, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-2: 6.89% (0.3601 => 0.3849, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-3: 6.79% (0.3623 => 0.3869, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.59% (6.2785 => 6.6924, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.49% (13.2842 => 14.1459, std.dev.: 0.0116) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.16% (0.1819 => 0.1931, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.80% (0.2243 => 0.2373, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 4.77% (16.2614 => 17.0372, std.dev.: 0.0097) MultiSource/Applications/ClamAV/clamscan: 4.25% (14.5298 => 15.1469, std.dev.: 0.0083) MultiSource/Benchmarks/Bullet/bullet: 2.06% (33.2944 => 33.9801, std.dev.: 0.0132) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5162, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/fbench: 28.51% (1.8175 => 2.3357, std.dev.: 0.0211) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 11.19% (1.1560 => 1.2853, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 9.03% (0.8273 => 0.9020, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.47% (0.1322 => 0.1434, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.56% (3.1736 => 3.4134, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.33% (1.2998 => 1.3821, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.16% (0.2093 => 0.2201, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0047, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.88% (1.7081 => 1.7744, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6762, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9861, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.33% (10.7476 => 11.1054, std.dev.: 0.0635) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.17% (7.4271 => 7.5884, std.dev.: 0.0073) MultiSource/Applications/lemon/lemon: 1.65% (1.4298 => 1.4534, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5133, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/queens: 1.44% (2.1753 => 2.2067, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2123, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1867, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5788, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0273, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 1.03% (12.4560 => 12.5845, std.dev.: 0.0121) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.97% (0.2670 => 0.1416) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.08% (0.4657 => 0.3908, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -14.57% (0.0707 => 0.0604, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.36% (1.3813 => 1.1968, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.34% (1.3819 => 1.1976, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.51% (22.5627 => 22.2219, std.dev.: 0.0101) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.11% (0.2238 => 0.1967, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -11.51% (1.2308 => 1.0891, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.16% (20.3410 => 18.2745, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.12% (2.6470 => 2.5114, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.50% (1.3780 => 1.3160, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.48% (0.9996 => 0.9548, std.dev.: 0.0060) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.52% (1.7688 => 1.7065, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.12% (0.4867 => 0.4715, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -2.51% (26.5159 => 25.8500, std.dev.: 0.0167) MultiSource/Applications/spiff/spiff: -2.44% (3.0263 => 2.9525, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.32% (1.9762 => 1.9304, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -2.19% (3.2729 => 3.2011, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout/lists: -1.92% (6.3560 => 6.2342, std.dev.: 0.0102) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.91% (0.6589 => 0.6463, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7152, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.59% (0.6615 => 0.6510, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0059, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: -1.42% (4.5928 => 4.5276, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout/heapsort: -1.33% (3.9173 => 3.8652, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: -1.25% (9.3358 => 9.2189, std.dev.: 0.0069) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.17% (2.5254 => 2.4959, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2576, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 12 11:18:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 12 Oct 2012 13:18:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121012181806.ED7A32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4825?compare_to=4822&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4825, Order: 165803, Start Time: 2012-10-12 16:59:58, End Time: 2012-10-12 18:19:57 To: 4822, Order: 165797, Start Time: 2012-10-12 15:10:53, End Time: 2012-10-12 16:30:41 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (164 on baseline) Performance Improvements: 2 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 949 (680 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.86% (54.4573 => 56.5575, std.dev.: 0.0960) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.58% (80.0135 => 81.2817, std.dev.: 0.0670) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.24% (15.3774 => 15.0330, std.dev.: 0.0101) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -3.37% (2.3624 => 2.2829, std.dev.: 0.0086) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.22% (0.5937 => 0.5950, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 0.13% (16.4301 => 16.4519, std.dev.: 0.0120) MultiSource/Benchmarks/Bullet/bullet: 0.04% (55.4588 => 55.4816, std.dev.: 0.0068) MultiSource/Benchmarks/MallocBench/gs/gs: 0.17% (4.4393 => 4.4469, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0460 => 0.0460, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0462 => 0.0462, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0430 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.23% (0.0431 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0419 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0422 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.24% (0.0413 => 0.0414) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.48% (0.0414 => 0.0416, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.23% (0.0431 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0433 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.24% (0.0425 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.47% (0.0426 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.48% (0.0416 => 0.0414, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.24% (0.0417 => 0.0418, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0423 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.24% (0.0424 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0435 => 0.0435, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0436 => 0.0436, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.24% (0.0410 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0412 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0423 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0424 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.24% (0.0415 => 0.0414, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0416 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0407 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.25% (0.0407 => 0.0408) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.25% (0.0405 => 0.0406) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.25% (0.0406 => 0.0407) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0442 => 0.0442, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.23% (0.0443 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0405 => 0.0405) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0406 => 0.0406, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0405 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.49% (0.0405 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0414 => 0.0414) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.24% (0.0413 => 0.0414, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.05% (1.2605 => 1.2599, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.04% (7.8812 => 7.8840, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.15% (0.7424 => 0.7435, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.84% (0.0358 => 0.0361, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.94% (0.0646 => 0.0665, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.27% (63.2438 => 55.4816, std.dev.: 0.0068) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.54% (14.1553 => 19.0452, std.dev.: 0.0168) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.89% (3.4629 => 5.6755, std.dev.: 0.0009) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14237.78% (0.0720 => 10.3232, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9951900.00% (0.0001 => 9.9520, std.dev.: 0.0013) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.74% (0.2554 => 0.4182, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 45.00% (10.3673 => 15.0330, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/richards_benchmark: 39.27% (0.1622 => 0.2259, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 33.62% (0.1056 => 0.1411, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 17.88% (0.1432 => 0.1688, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.17% (7.0540 => 8.2651, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.84% (2.2022 => 2.5730, std.dev.: 0.0026) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.26% (0.1566 => 0.1805, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.30% (1.7609 => 1.9951, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.09% (0.0871 => 0.0985, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 12.78% (0.1440 => 0.1624, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 12.74% (0.3282 => 0.3700, std.dev.: 0.0006) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.69% (0.1143 => 0.1288) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.24% (0.1438 => 0.1614, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.93% (0.1584 => 0.1773, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 11.63% (10.4361 => 11.6501, std.dev.: 0.0105) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.35% (0.3543 => 0.3945, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 11.23% (0.7433 => 0.8268, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.91% (0.3473 => 0.3852, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.71% (0.1625 => 0.1799, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/parameter-passing: 10.67% (0.3927 => 0.4346, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.64% (0.3516 => 0.3890, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.61% (0.3497 => 0.3868, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.59% (0.3561 => 0.3938, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.58% (0.3543 => 0.3918, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 10.56% (0.7115 => 0.7866, std.dev.: 0.0142) SingleSource/UnitTests/ObjC/property: 10.50% (0.3886 => 0.4294, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.43% (0.4879 => 0.5388, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.40% (0.3694 => 0.4078, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.37% (0.3828 => 0.4225, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.23% (0.6675 => 0.7358, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.22% (0.2700 => 0.2976, std.dev.: 0.0048) SingleSource/Benchmarks/McGill/chomp: 10.09% (0.1655 => 0.1822, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 10.07% (9.4845 => 10.4396, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/tsp/tsp: 10.04% (0.1175 => 0.1293, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.82% (0.3177 => 0.3489, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 9.77% (3.3354 => 3.6613, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.77% (1.5415 => 1.6921, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 9.70% (0.3423 => 0.3755, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 9.64% (0.1151 => 0.1262, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.64% (0.5105 => 0.5597, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 9.62% (0.1695 => 0.1858, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.47% (0.4615 => 0.5052, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 9.42% (0.3109 => 0.3402, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.40% (0.5860 => 0.6411, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 9.35% (5.7591 => 6.2978, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.23% (1.3050 => 1.4254, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.20% (4.2646 => 4.6569, std.dev.: 0.0114) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.14% (0.1236 => 0.1349, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.04% (0.8067 => 0.8796, std.dev.: 0.0048) MultiSource/Applications/Burg/burg: 9.02% (1.1642 => 1.2692, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.02% (0.8172 => 0.8909, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.01% (0.1510 => 0.1646, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.00% (0.5569 => 0.6070, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.92% (0.1940 => 0.2113, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 8.88% (3.8723 => 4.2161, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.85% (5.0018 => 5.4443, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/mst/mst: 8.77% (0.1163 => 0.1265, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.77% (0.2065 => 0.2246, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.76% (0.2271 => 0.2470, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.76% (8.1363 => 8.8487, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.75% (4.9449 => 5.3777, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.74% (0.9765 => 1.0618, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.73% (0.2107 => 0.2291, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.69% (0.5925 => 0.6440, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.65% (0.3121 => 0.3391, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.63% (0.2758 => 0.2996, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 8.62% (0.1555 => 0.1689, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 8.59% (1.0722 => 1.1643, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 8.55% (0.6456 => 0.7008, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 8.53% (0.7835 => 0.8503, std.dev.: 0.0021) MultiSource/Applications/treecc/treecc: 8.50% (2.0273 => 2.1996, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.47% (0.3307 => 0.3587, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 8.45% (1.5603 => 1.6922, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.45% (0.5020 => 0.5444, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.44% (0.6030 => 0.6539, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 8.30% (0.3387 => 0.3668, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.18% (1.5859 => 1.7157, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.16% (0.4103 => 0.4438, std.dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.13% (7.9617 => 8.6090, std.dev.: 0.0055) MultiSource/Applications/siod/siod: 8.13% (2.2969 => 2.4836, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference: 8.09% (0.7326 => 0.7919, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 7.99% (0.3180 => 0.3434, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.79% (0.3441 => 0.3709, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.71% (1.1861 => 1.2775, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.68% (0.3865 => 0.4162, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.65% (0.4289 => 0.4617, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.63% (0.1337 => 0.1439, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.61% (0.4203 => 0.4523, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 7.48% (0.3422 => 0.3678, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.43% (0.6450 => 0.6929, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/moments: 7.39% (0.4048 => 0.4347, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.34% (0.2603 => 0.2794, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.32% (0.3826 => 0.4106, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.29% (0.3650 => 0.3916, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.26% (2.2024 => 2.3624, std.dev.: 0.0055) MultiSource/Applications/JM/lencod/lencod: 7.16% (21.9371 => 23.5070, std.dev.: 0.0250) MultiSource/Benchmarks/Prolangs-C/football/football: 7.14% (0.8921 => 0.9558, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/hash2: 7.10% (0.4620 => 0.4948, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 6.91% (0.4299 => 0.4596, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/neural/neural: 6.90% (0.1463 => 0.1564, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.86% (0.4636 => 0.4954, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 6.83% (0.3603 => 0.3849, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.79% (0.5981 => 0.6387, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.78% (0.1695 => 0.1810, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 6.73% (0.3684 => 0.3932, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.73% (0.3136 => 0.3347, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 6.68% (0.2905 => 0.3099, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.64% (2.0665 => 2.2038, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.64% (0.2891 => 0.3083, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.52% (1.4186 => 1.5111, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.51% (0.3162 => 0.3368, std.dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 6.41% (1.1840 => 1.2599, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/strcat: 6.39% (0.2831 => 0.3012, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.39% (0.2725 => 0.2899, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.30% (0.2872 => 0.3053, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.28% (0.3232 => 0.3435, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.20% (0.2756 => 0.2927, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.20% (0.3098 => 0.3290, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.16% (0.3052 => 0.3240, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.15% (0.3283 => 0.3485, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.05% (0.2877 => 0.3051, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.03% (0.2871 => 0.3044, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.02% (0.2793 => 0.2961, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.00% (0.2266 => 0.2402, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.89% (0.2802 => 0.2967, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.88% (0.1906 => 0.2018, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.83% (0.4064 => 0.4301, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.82% (0.2714 => 0.2872, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.71% (0.3379 => 0.3572, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.71% (0.1892 => 0.2000, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.49% (0.8101 => 0.8546, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.96% (14.3668 => 15.0796, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/objinst: 4.95% (0.3131 => 0.3286, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 4.93% (0.2049 => 0.2150, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 4.80% (1.2842 => 1.3458, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.52% (0.3427 => 0.3582, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 4.46% (17.1811 => 17.9476, std.dev.: 0.0243) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.28% (0.2430 => 0.2534, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.12% (3.8922 => 4.0527, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.24% (1.1194 => 1.1557, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.09% (0.3817 => 0.3935, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3123, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.38% (0.2944 => 0.3279, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.92% (0.1421 => 0.1562, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.80% (1.1396 => 1.2513, std.dev.: 0.0013) MultiSource/Applications/aha/aha: 9.20% (3.1595 => 3.4501, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3680, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.71% (3.6395 => 3.7746, std.dev.: 0.0011) SingleSource/Regression/C/uint64_to_float: 3.66% (0.5413 => 0.5611, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.68% (4.2280 => 4.3414, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7655, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.55% (0.8275 => 0.8403, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8125, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.36% (0.9540 => 0.9670, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.19% (2.6546 => 2.6862, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.05% (6.5088 => 6.5769, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1310, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -79.93% (0.8651 => 0.1736, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.99% (5.2763 => 3.2720, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.52% (5.3855 => 3.6878, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.15% (5.3526 => 3.6851, std.dev.: 0.0023) SingleSource/UnitTests/Vector/constpool: -14.59% (54.1659 => 46.2618, std.dev.: 0.0141) MultiSource/Applications/ClamAV/clamscan: -12.17% (22.1758 => 19.4759, std.dev.: 0.0145) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.60% (2.9384 => 2.6268, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.34% (1.1492 => 0.7660, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -16.05% (1.6925 => 1.4209, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.73% (0.0998 => 0.0861, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.95% (1.2373 => 1.0895, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/mandel-2: -10.24% (1.5373 => 1.3799, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -9.86% (0.2161 => 0.1948, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.42% (19.9488 => 18.2684, std.dev.: 0.0209) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.69% (1.8329 => 1.7102, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.32% (1.6805 => 1.5911, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7963, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5082, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.34% (0.9957 => 0.9525, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.73% (1.3677 => 1.3167, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.65% (3.2827 => 3.1630, std.dev.: 0.0066) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.4999, std.dev.: 0.0094) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0990, std.dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.11% (8.6802 => 8.4970, std.dev.: 0.0219) SingleSource/Benchmarks/Misc/salsa20: -2.06% (10.2830 => 10.0708, std.dev.: 0.0157) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.88% (8.1563 => 8.0029, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6790, std.dev.: 0.0021) SingleSource/UnitTests/Vector/multiplies: -1.74% (2.5528 => 2.5085, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4204, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -1.10% (4.6441 => 4.5931, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/lists: -1.10% (6.2999 => 6.2309, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8576, std.dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.79% (0.5229 => 0.5950, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 9.76% (14.9895 => 16.4519, std.dev.: 0.0120) MultiSource/Benchmarks/MallocBench/gs/gs: 8.18% (4.1105 => 4.4469, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.04% (1.1048 => 1.2599, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.14% (7.1582 => 7.8840, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.50% (0.6222 => 0.7435, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36000.00% (0.0001 => 0.0361, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.57% (0.2116 => 0.0665, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 12 12:55:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 12 Oct 2012 14:55:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121012195549.5FD512A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4826?compare_to=4824&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4826, Order: 165811, Start Time: 2012-10-12 18:31:46, End Time: 2012-10-12 19:57:39 To: 4824, Order: 165802, Start Time: 2012-10-12 16:36:28, End Time: 2012-10-12 18:02:28 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (188 on baseline) Performance Improvements: 2 (40 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1040 (676 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -3.08% (2.3357 => 2.2638, std.dev.: 0.0144) MultiSource/Applications/siod/siod: -1.42% (3.2011 => 3.1558, std.dev.: 0.0009) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.38% (2.0176 => 2.4893, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.44% (0.1410 => 0.1670, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 16.83% (0.0826 => 0.0965, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.69% (0.0653 => 0.0762, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 16.32% (0.2243 => 0.2609, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.30% (0.1072 => 0.1236, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.85% (0.1327 => 0.1524, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 13.92% (0.1013 => 0.1154, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 13.24% (0.7038 => 0.7970, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.19% (0.0834 => 0.0944, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.02% (0.1413 => 0.1597, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 12.88% (1.3693 => 1.5456, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.48% (3.9660 => 4.4611, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.27% (0.2721 => 0.3055, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.24% (0.0964 => 0.1082, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.20% (1.4563 => 1.6339, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 12.11% (0.4062 => 0.4554, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.10% (0.2596 => 0.2910, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 12.06% (0.4328 => 0.4850, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.06% (0.6959 => 0.7798, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.03% (0.1588 => 0.1779, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.81% (0.9199 => 1.0285, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.79% (0.5265 => 0.5886, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.79% (0.7710 => 0.8619, std.dev.: 0.0031) MultiSource/Applications/aha/aha: 11.77% (0.1062 => 0.1187, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.61% (1.2193 => 1.3608, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: 11.57% (0.1003 => 0.1119, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 11.52% (13.8202 => 15.4124, std.dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.51% (0.6283 => 0.7006, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 11.50% (0.5818 => 0.6487, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 11.32% (0.7061 => 0.7860, std.dev.: 0.0044) SingleSource/UnitTests/ObjC++/Hello: 11.29% (0.5748 => 0.6397, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.18% (0.3899 => 0.4335, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.16% (1.1364 => 1.2632, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: 11.01% (0.1589 => 0.1764, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.00% (0.3756 => 0.4169, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.89% (0.3580 => 0.3970, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.83% (0.4016 => 0.4451, std.dev.: 0.0032) SingleSource/Regression/C++/ofstream_ctor: 10.82% (0.2781 => 0.3082, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.80% (0.1157 => 0.1282, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 10.79% (1.1061 => 1.2255, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.76% (0.3485 => 0.3860, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 10.73% (1.0313 => 1.1420, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.64% (0.3130 => 0.3463, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 10.62% (16.6129 => 18.3769, std.dev.: 0.0193) SingleSource/Benchmarks/Shootout-C++/lists: 10.60% (0.3293 => 0.3642, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.53% (0.2782 => 0.3075, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.52% (0.3022 => 0.3340, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.47% (0.5577 => 0.6161, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.43% (0.2914 => 0.3218, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.42% (0.1075 => 0.1187, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.39% (0.4791 => 0.5289, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.38% (0.3489 => 0.3851, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.34% (0.4390 => 0.4844, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.29% (0.3246 => 0.3580, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.24% (0.0977 => 0.1077, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.18% (0.4379 => 0.4825, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 10.14% (0.6744 => 0.7428, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary: 10.14% (0.3107 => 0.3422, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: 10.12% (0.2726 => 0.3002, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 10.11% (0.3868 => 0.4259, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.08% (0.2966 => 0.3265, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 10.02% (0.2995 => 0.3295, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 9.99% (0.3453 => 0.3798, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/mst/mst: 9.99% (0.1111 => 0.1222, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary3: 9.97% (0.3149 => 0.3463, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.97% (0.1986 => 0.2184, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 9.94% (3.8646 => 4.2487, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 9.94% (0.3220 => 0.3540, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.92% (0.2127 => 0.2338, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 9.89% (0.2628 => 0.2888, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.84% (1.9828 => 2.1779, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.83% (0.2655 => 0.2916, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 9.82% (0.2760 => 0.3031, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.80% (0.7460 => 0.8191, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 9.79% (0.7506 => 0.8241, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.76% (0.1865 => 0.2047, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.76% (0.5637 => 0.6187, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/09-vor/vor: 9.74% (0.2925 => 0.3210, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 9.74% (0.1478 => 0.1622, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 9.74% (0.2761 => 0.3030, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 9.72% (1.9270 => 2.1143, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: 9.70% (0.2690 => 0.2951, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 9.69% (2.1791 => 2.3902, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists1: 9.68% (0.3534 => 0.3876, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 9.68% (0.8310 => 0.9114, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.65% (0.8698 => 0.9537, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 9.60% (0.2937 => 0.3219, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 9.60% (3.1889 => 3.4949, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/hello: 9.59% (0.2607 => 0.2857, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.58% (0.2765 => 0.3030, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.55% (0.1435 => 0.1572, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 9.49% (0.3192 => 0.3495, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.49% (0.2023 => 0.2215, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.40% (0.1276 => 0.1396) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.34% (7.2180 => 7.8923, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/matrix: 9.24% (0.2988 => 0.3264, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.24% (0.2696 => 0.2945, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 9.15% (1.0594 => 1.1563, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.12% (4.9865 => 5.4412, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.11% (0.1569 => 0.1712, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 8.99% (0.1657 => 0.1806, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 8.86% (0.2945 => 0.3206, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.73% (1.3245 => 1.4401, std.dev.: 0.0062) MultiSource/Benchmarks/sim/sim: 8.69% (0.3131 => 0.3403, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.68% (0.3755 => 0.4081, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.54% (3.6692 => 3.9827, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.54% (4.3801 => 4.7542, std.dev.: 0.0066) MultiSource/Applications/SIBsim4/SIBsim4: 8.52% (1.2749 => 1.3835, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.50% (0.6576 => 0.7135, std.dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 8.43% (14.8535 => 16.1062, std.dev.: 0.0117) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.42% (4.4433 => 4.8175, std.dev.: 0.0073) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.22% (0.1789 => 0.1936, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.18% (0.6135 => 0.6637, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 8.13% (8.4961 => 9.1870, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.09% (1.5188 => 1.6417, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.04% (0.2140 => 0.2312, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.80% (0.3511 => 0.3785, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.80% (0.2321 => 0.2502, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.75% (0.8818 => 0.9501, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.72% (1.1333 => 1.2208, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 7.69% (0.4003 => 0.4311, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.69% (3.2742 => 3.5259, std.dev.: 0.0142) MultiSource/Benchmarks/McCat/05-eks/eks: 7.66% (0.4113 => 0.4428, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.58% (0.4805 => 0.5169, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.55% (0.9108 => 0.9796, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 7.52% (0.6250 => 0.6720, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.43% (0.3245 => 0.3486, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 7.41% (4.6629 => 5.0083, std.dev.: 0.0021) MultiSource/Applications/lua/lua: 7.32% (3.7467 => 4.0209, std.dev.: 0.0062) SingleSource/UnitTests/ObjC/property: 7.31% (0.3940 => 0.4228, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: 7.29% (0.1385 => 0.1486, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.28% (0.3914 => 0.4199, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 7.26% (6.5754 => 7.0525, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/trivial-interface: 7.21% (0.3578 => 0.3836, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 7.15% (0.3789 => 0.4060, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 7.14% (1.2292 => 1.3170, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-2: 7.11% (0.3601 => 0.3857, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.07% (0.2504 => 0.2681, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.05% (0.3646 => 0.3903, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.99% (2.1007 => 2.2475, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 6.96% (0.3663 => 0.3918, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.90% (0.3650 => 0.3902, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 6.87% (0.2008 => 0.2146, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 6.82% (0.3623 => 0.3870, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.79% (6.2785 => 6.7050, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.38% (13.2842 => 14.1317, std.dev.: 0.0095) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.27% (0.1819 => 0.1933, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 6.08% (0.1777 => 0.1885, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.04% (0.2243 => 0.2356, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 4.60% (16.2614 => 17.0101, std.dev.: 0.0196) MultiSource/Applications/ClamAV/clamscan: 4.26% (14.5298 => 15.1483, std.dev.: 0.0155) MultiSource/Benchmarks/Bullet/bullet: 1.75% (33.2944 => 33.8762, std.dev.: 0.0116) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.83% (0.4846 => 0.6970, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5137, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.09% (1.0895 => 1.3629, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fbench: 24.56% (1.8175 => 2.2638, std.dev.: 0.0144) SingleSource/Benchmarks/Misc/richards_benchmark: 10.99% (1.1560 => 1.2830, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 8.70% (0.1322 => 0.1437, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4140, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.29% (1.2998 => 1.3815, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.16% (0.2093 => 0.2201, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0037, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6765, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 3.64% (10.7476 => 11.1388, std.dev.: 0.0497) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9856, std.dev.: 0.0005) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.17% (7.4271 => 7.5885, std.dev.: 0.0039) MultiSource/Applications/lemon/lemon: 1.63% (1.4298 => 1.4531, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5134, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9698, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1882, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.17% (5.5130 => 5.5777, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0272, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5910, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.93% (0.2670 => 0.1417, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.93% (0.4657 => 0.3915, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -14.43% (0.0707 => 0.0605, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.43% (1.3813 => 1.1958, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.24% (1.3819 => 1.1990, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.56% (22.5627 => 22.2105, std.dev.: 0.0080) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.34% (0.0997 => 0.0864, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -11.93% (0.2238 => 0.1971, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.09% (1.2308 => 1.0943, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.01% (20.3410 => 18.3057, std.dev.: 0.0144) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.31% (1.3780 => 1.3048, std.dev.: 0.0048) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.37% (0.9996 => 0.9559, std.dev.: 0.0108) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8004, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.58% (3.2729 => 3.1558, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.48% (1.7688 => 1.7073, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4786) MultiSource/Applications/lua/lua: -2.41% (26.5159 => 25.8775, std.dev.: 0.0217) MultiSource/Applications/spiff/spiff: -2.39% (3.0263 => 2.9540, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.34% (1.9762 => 1.9299, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7150, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/lists: -1.75% (6.3560 => 6.2449, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.56% (0.6615 => 0.6512) MultiSource/Applications/sqlite3/sqlite3: -1.48% (4.5928 => 4.5248, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0069, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8677, std.dev.: 0.0101) MultiSource/Applications/minisat/minisat: -1.22% (9.3358 => 9.2219, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4947, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2583, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 12 13:07:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 12 Oct 2012 15:07:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121012200737.30B3E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4827?compare_to=4825&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4827, Order: 165813, Start Time: 2012-10-12 18:49:23, End Time: 2012-10-12 20:09:27 To: 4825, Order: 165803, Start Time: 2012-10-12 16:59:58, End Time: 2012-10-12 18:19:57 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (161 on baseline) Performance Improvements: 1 (44 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 951 (682 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.87% (15.0330 => 15.3145, std.dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.52% (81.2817 => 80.0443, std.dev.: 0.1597) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.10% (0.5950 => 0.5956, std.dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: -0.01% (16.4519 => 16.4505, std.dev.: 0.0145) MultiSource/Benchmarks/Bullet/bullet: 0.05% (55.4816 => 55.5079, std.dev.: 0.0255) MultiSource/Benchmarks/MallocBench/gs/gs: -0.09% (4.4469 => 4.4427, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.43% (0.0460 => 0.0462, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.22% (0.0462 => 0.0463, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.47% (0.0430 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.23% (0.0432 => 0.0433) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.48% (0.0419 => 0.0421, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.24% (0.0422 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.24% (0.0414 => 0.0415) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0416 => 0.0416, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.23% (0.0432 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.23% (0.0433 => 0.0434, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.47% (0.0426 => 0.0428, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.23% (0.0428 => 0.0429, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.72% (0.0414 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.24% (0.0418 => 0.0419, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.47% (0.0423 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.24% (0.0425 => 0.0426, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.23% (0.0435 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.82% (0.0436 => 0.0457, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.24% (0.0411 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.49% (0.0412 => 0.0414, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.24% (0.0423 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.47% (0.0424 => 0.0426) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.48% (0.0414 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.24% (0.0416 => 0.0417, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.25% (0.0407 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.25% (0.0408 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.25% (0.0406 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.49% (0.0407 => 0.0409) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.45% (0.0442 => 0.0444) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.23% (0.0444 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.25% (0.0405 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.25% (0.0406 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.49% (0.0405 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.25% (0.0407 => 0.0408) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.24% (0.0414 => 0.0415) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.48% (0.0414 => 0.0416) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.01% (1.2599 => 1.2598, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.16% (7.8840 => 7.8966, std.dev.: 0.0225) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.20% (0.7435 => 0.7450, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0361 => 0.0361, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1433 => 0.1434, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.30% (0.0665 => 0.0667, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.23% (63.2438 => 55.5079, std.dev.: 0.0255) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.66% (14.1553 => 19.0612, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 64.03% (3.4629 => 5.6802, std.dev.: 0.0066) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14236.11% (0.0720 => 10.3220, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952200.00% (0.0001 => 9.9523, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.51% (0.2554 => 0.4176, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 47.72% (10.3673 => 15.3145, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: 38.66% (0.1622 => 0.2249, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: 33.90% (0.1056 => 0.1414, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 18.30% (0.1432 => 0.1694, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.79% (7.0540 => 8.3089, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.32% (2.2022 => 2.5837, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.26% (0.1566 => 0.1805, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 13.16% (0.3282 => 0.3714, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.02% (1.7609 => 1.9901, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.86% (0.0871 => 0.0983, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: 12.71% (0.1440 => 0.1623, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.69% (0.1143 => 0.1288, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 12.31% (10.4361 => 11.7213, std.dev.: 0.0111) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.89% (0.1438 => 0.1609, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.87% (0.1584 => 0.1772, std.dev.: 0.0041) MultiSource/Applications/lambda-0_1_3/lambda: 11.18% (0.7433 => 0.8264, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.64% (0.3177 => 0.3515, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.58% (0.3543 => 0.3918, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 10.58% (0.7115 => 0.7868, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.58% (0.4879 => 0.5395, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.52% (0.1625 => 0.1796, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.37% (0.2700 => 0.2980, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.26% (0.6675 => 0.7360, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 10.19% (9.4845 => 10.4513, std.dev.: 0.0140) SingleSource/UnitTests/ObjC/parameter-passing: 10.11% (0.3927 => 0.4324, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/trivial-interface: 10.05% (0.3473 => 0.3822, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.05% (0.3543 => 0.3899, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 10.03% (0.1655 => 0.1821, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 10.03% (0.3561 => 0.3918, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.93% (1.5415 => 1.6946, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-2: 9.92% (0.3497 => 0.3844, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.90% (0.3516 => 0.3864, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.88% (0.3694 => 0.4059, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 9.87% (0.1175 => 0.1291, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 9.86% (3.3354 => 3.6643, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 9.78% (0.3886 => 0.4266, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 9.73% (0.3423 => 0.3756, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.71% (0.5860 => 0.6429, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 9.69% (0.3828 => 0.4199, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 9.59% (0.3109 => 0.3407, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 9.56% (0.1695 => 0.1857, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 9.52% (5.7591 => 6.3076, std.dev.: 0.0152) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.51% (0.4615 => 0.5054, std.dev.: 0.0031) MultiSource/Applications/aha/aha: 9.47% (0.1151 => 0.1260, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.45% (0.5569 => 0.6095, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.38% (0.5105 => 0.5584, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.28% (0.8067 => 0.8816, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.17% (4.2646 => 4.6556, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.14% (0.1236 => 0.1349, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.13% (1.3050 => 1.4242, std.dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.10% (0.3121 => 0.3405, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.07% (0.1510 => 0.1647, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.95% (0.8172 => 0.8903, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.89% (4.9449 => 5.3847, std.dev.: 0.0068) MultiSource/Applications/lua/lua: 8.89% (3.8723 => 4.2165, std.dev.: 0.0050) MultiSource/Applications/Burg/burg: 8.88% (1.1642 => 1.2676, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.81% (0.1940 => 0.2111, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.81% (0.2271 => 0.2471, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.80% (8.1363 => 8.8526, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.80% (5.0018 => 5.4421, std.dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.70% (0.2758 => 0.2998, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.69% (0.2107 => 0.2290, std.dev.: 0.0015) MultiSource/Applications/viterbi/viterbi: 8.68% (0.1555 => 0.1690, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.63% (0.9765 => 1.0608, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/bigfib: 8.63% (0.6456 => 0.7013, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 8.60% (1.0722 => 1.1644, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.53% (0.3307 => 0.3589, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 8.50% (1.5603 => 1.6929, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.47% (0.2065 => 0.2240, std.dev.: 0.0027) MultiSource/Benchmarks/sim/sim: 8.47% (0.3387 => 0.3674, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 8.46% (0.7835 => 0.8498, std.dev.: 0.0039) MultiSource/Applications/treecc/treecc: 8.42% (2.0273 => 2.1979, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 8.37% (0.5925 => 0.6421, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.33% (0.5020 => 0.5438, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 8.23% (0.6030 => 0.6526, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.21% (0.4103 => 0.4440, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 8.14% (0.3180 => 0.3439, std.dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.14% (7.9617 => 8.6100, std.dev.: 0.0065) MultiSource/Applications/siod/siod: 8.08% (2.2969 => 2.4826, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.99% (1.5859 => 1.7126, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 7.92% (0.7326 => 0.7906, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.88% (0.3441 => 0.3712, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.80% (0.4203 => 0.4531, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.78% (0.1337 => 0.1441, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 7.76% (0.4289 => 0.4622, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.66% (0.3865 => 0.4161, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.62% (1.1861 => 1.2765, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/lists: 7.60% (0.3422 => 0.3682, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.59% (0.3650 => 0.3927, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 7.52% (21.9371 => 23.5862, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/moments: 7.46% (0.4048 => 0.4350, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.43% (0.6450 => 0.6929, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.38% (0.2603 => 0.2795, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 7.31% (0.8921 => 0.9573, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.29% (0.3826 => 0.4105, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.19% (0.4620 => 0.4952, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.03% (0.4636 => 0.4962, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 7.02% (0.4299 => 0.4601, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.00% (2.2024 => 2.3565, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: 6.94% (0.3603 => 0.3853, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.92% (0.3136 => 0.3353, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.92% (0.2905 => 0.3106, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.92% (0.2891 => 0.3091, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.82% (0.5981 => 0.6389, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists1: 6.70% (0.3684 => 0.3931, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.62% (1.4186 => 1.5125, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.62% (2.0665 => 2.2032, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.61% (0.3162 => 0.3371, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 6.50% (0.2831 => 0.3015, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.43% (0.1695 => 0.1804, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 6.39% (1.1840 => 1.2597, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ary: 6.37% (0.3232 => 0.3438, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.37% (0.2872 => 0.3055, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.35% (0.2756 => 0.2931, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 6.33% (0.2877 => 0.3059, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.31% (0.3283 => 0.3490, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.26% (0.3052 => 0.3243, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.24% (0.2725 => 0.2895, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/matrix: 6.23% (0.3098 => 0.3291, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.20% (0.2871 => 0.3049, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.15% (0.2714 => 0.2881, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.09% (0.2793 => 0.2963, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 6.03% (0.2802 => 0.2971, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.98% (0.1906 => 0.2020, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.98% (0.4064 => 0.4307, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.92% (0.1892 => 0.2004, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.89% (0.3379 => 0.3578, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.78% (0.2266 => 0.2397, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.59% (0.8101 => 0.8554, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/ReedSolomon: 5.22% (0.2049 => 0.2156, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.09% (14.3668 => 15.0985, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/objinst: 5.08% (0.3131 => 0.3290, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.89% (1.2842 => 1.3470, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 4.71% (17.1811 => 17.9903, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.70% (0.3427 => 0.3588, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.44% (0.2430 => 0.2538, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.12% (3.8922 => 4.0525, std.dev.: 0.0143) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.26% (1.1194 => 1.1559, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.74% (2.6778 => 2.9653, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 10.06% (1.1396 => 1.2543, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4498, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3680, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.40% (3.6395 => 3.7633, std.dev.: 0.0111) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.72% (4.2280 => 4.3432, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7652, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.55% (0.8275 => 0.8403, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.47% (0.9540 => 0.9680, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8135, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.24% (2.6546 => 2.6875, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.09% (6.5088 => 6.5797, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1312, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: -80.07% (0.8651 => 0.1724, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.02% (5.2763 => 3.2702, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.24% (5.3855 => 3.7033, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.82% (5.3526 => 3.7028, std.dev.: 0.0021) SingleSource/UnitTests/Vector/constpool: -14.65% (54.1659 => 46.2292, std.dev.: 0.0247) MultiSource/Applications/ClamAV/clamscan: -12.07% (22.1758 => 19.4981, std.dev.: 0.0142) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.30% (2.9384 => 2.6356, std.dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.45% (1.1492 => 0.7648, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4249, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.13% (0.0998 => 0.0857, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.13% (1.2373 => 1.0996, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -10.69% (1.5373 => 1.3730, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/mason/mason: -10.13% (0.2161 => 0.1942, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.38% (19.9488 => 18.2779, std.dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.69% (1.8329 => 1.7103, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.26% (1.6805 => 1.5921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -5.11% (1.5835 => 1.5026, std.dev.: 0.0048) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.03% (0.9957 => 0.9556, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.65% (3.2827 => 3.1629, std.dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5077, std.dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: -3.01% (12.4730 => 12.0981, std.dev.: 0.0019) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.12% (0.4808 => 0.4706, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.07% (8.6802 => 8.5005, std.dev.: 0.0126) SingleSource/Benchmarks/Misc/salsa20: -1.98% (10.2830 => 10.0789, std.dev.: 0.0258) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.79% (8.1563 => 8.0103, std.dev.: 0.0228) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6836, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.57% (2.5528 => 2.5127, std.dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std.dev.: 0.0091) MultiSource/Applications/sqlite3/sqlite3: -1.09% (4.6441 => 4.5934, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout/lists: -1.09% (6.2999 => 6.2315, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/hash: -1.08% (4.9088 => 4.8560, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.90% (0.5229 => 0.5956, std.dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 9.75% (14.9895 => 16.4505, std.dev.: 0.0145) MultiSource/Benchmarks/MallocBench/gs/gs: 8.08% (4.1105 => 4.4427, std.dev.: 0.0112) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.03% (1.1048 => 1.2598, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.32% (7.1582 => 7.8966, std.dev.: 0.0225) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.74% (0.6222 => 0.7450, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36000.00% (0.0001 => 0.0361, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.43% (0.1485 => 0.1434, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.48% (0.2116 => 0.0667, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 12 13:13:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 12 Oct 2012 15:13:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121012201332.DC3552A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/4828?compare_to=4823&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4828, Order: 165803, Start Time: 2012-10-12 17:05:16, End Time: 2012-10-12 20:15:24 To: 4823, Order: 165792, Start Time: 2012-10-12 13:26:07, End Time: 2012-10-12 16:35:51 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (137 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1041 (753 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.90% (0.2152 => 0.2279, std.dev.: 0.0017) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 11.12% (0.3488 => 0.3876, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 11.05% (0.3465 => 0.3848, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 11.01% (0.3442 => 0.3821, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.00% (0.3446 => 0.3825, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.98% (0.3496 => 0.3880, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.92% (0.3460 => 0.3838, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.87% (0.3469 => 0.3846, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.71% (0.3650 => 0.4041, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.68% (0.3643 => 0.4032, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.61% (0.3724 => 0.4119, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.50% (0.1063 => 0.1164, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.41% (0.5826 => 0.6374, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.32% (0.5889 => 0.6438, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 8.95% (0.1218 => 0.1327) MultiSource/Applications/oggenc/oggenc: 8.75% (1.5932 => 1.7326, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 8.40% (0.1619 => 0.1755, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.24% (0.2875 => 0.3112, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 8.10% (0.1284 => 0.1388, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash: 8.03% (0.4146 => 0.4479, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.03% (0.4361 => 0.4711, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.98% (1.6211 => 1.7504, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.95% (0.3195 => 0.3449, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.95% (0.4994 => 0.5391, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 7.92% (0.7171 => 0.7739, std.dev.: 0.0024) SingleSource/Regression/C++/ofstream_ctor: 7.86% (0.3004 => 0.3240, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/fibo: 7.85% (0.2725 => 0.2939, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.85% (0.2738 => 0.2953, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 7.85% (0.2714 => 0.2927, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.79% (1.3152 => 1.4176, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/methcall: 7.79% (0.2813 => 0.3032, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 7.78% (5.5417 => 5.9730, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/random: 7.78% (0.2803 => 0.3021, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.77% (0.2729 => 0.2941, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 7.76% (0.2823 => 0.3042, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.74% (0.5000 => 0.5387, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.70% (0.2792 => 0.3007, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 7.66% (0.2780 => 0.2993, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 7.64% (0.2750 => 0.2960, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.62% (2.0673 => 2.2249, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.59% (0.2911 => 0.3132, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 7.56% (0.3267 => 0.3514, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 7.56% (0.9909 => 1.0658, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 7.56% (0.3096 => 0.3330, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.54% (0.2811 => 0.3023, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.53% (0.1620 => 0.1742, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.49% (0.3258 => 0.3502, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 7.49% (0.4847 => 0.5210, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.46% (0.3930 => 0.4223, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.42% (3.5627 => 3.8271, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.41% (0.3362 => 0.3611, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.39% (0.3124 => 0.3355, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.35% (0.3060 => 0.3285, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 7.33% (0.3317 => 0.3560, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 7.32% (0.3348 => 0.3593, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 7.30% (0.3726 => 0.3998, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 7.28% (0.3477 => 0.3730, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.25% (0.2014 => 0.2160, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.25% (0.4139 => 0.4439, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/moments: 7.23% (0.3678 => 0.3944, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.23% (0.3625 => 0.3887, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 7.22% (23.5202 => 25.2195, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.22% (0.3282 => 0.3519, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.20% (0.4251 => 0.4557, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 7.18% (0.1421 => 0.1523, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 7.10% (0.6634 => 0.7105, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.05% (0.3690 => 0.3950, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.02% (0.5026 => 0.5379, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.02% (0.2736 => 0.2928, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.84% (0.1549 => 0.1655, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.83% (0.3981 => 0.4253, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.80% (0.2866 => 0.3061, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/09-vor/vor: 6.78% (0.1505 => 0.1607, std.dev.: 0.0033) MultiSource/Applications/d/make_dparser: 6.77% (1.0781 => 1.1511, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.76% (2.7292 => 2.9137, std.dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 6.74% (0.2566 => 0.2739, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 6.73% (1.8794 => 2.0058, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.70% (0.6435 => 0.6866, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.69% (0.3903 => 0.4164, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.66% (0.3845 => 0.4101, std.dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: 6.57% (4.2109 => 4.4877, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.54% (0.2737 => 0.2916, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 6.52% (0.5012 => 0.5339, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 6.50% (0.3336 => 0.3553, std.dev.: 0.0014) MultiSource/Applications/lua/lua: 6.50% (1.4269 => 1.5196, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.49% (0.5900 => 0.6283, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.48% (0.3890 => 0.4142, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.46% (4.4195 => 4.7050, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.43% (0.2969 => 0.3160, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.38% (0.2068 => 0.2200, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 6.38% (0.4029 => 0.4286, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.28% (0.2103 => 0.2235, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 6.25% (0.9697 => 1.0303, std.dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.23% (0.1604 => 0.1704, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.15% (0.1968 => 0.2089, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 6.13% (0.5546 => 0.5886, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.99% (0.3271 => 0.3467, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.97% (0.4658 => 0.4936, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.93% (0.7426 => 0.7866, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 5.79% (2.1013 => 2.2230, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 5.78% (4.6177 => 4.8844, std.dev.: 0.0059) MultiSource/Applications/JM/ldecod/ldecod: 5.64% (2.1653 => 2.2875, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/football/football: 5.45% (0.2075 => 0.2188, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 5.43% (0.7875 => 0.8303, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.41% (1.9694 => 2.0760, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.37% (0.5361 => 0.5649, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.34% (0.2040 => 0.2149, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.30% (11.6398 => 12.2570, std.dev.: 0.0059) MultiSource/Applications/sqlite3/sqlite3: 5.25% (2.0346 => 2.1414, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.15% (1.9966 => 2.0994, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 4.94% (0.2391 => 0.2509, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 4.76% (0.2691 => 0.2819, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.67% (0.5584 => 0.5845, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 4.52% (0.3498 => 0.3656, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.50% (4.6926 => 4.9038, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.50% (0.4253 => 0.4402, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 3.36% (11.9555 => 12.3575, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.40% (0.2122 => 0.2279, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6107, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.22% (12.0509 => 12.6795, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-2: 4.88% (1.8057 => 1.8938, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1700, std.dev.: 0.1566) SingleSource/Benchmarks/Dhrystone/dry: 4.24% (14.0481 => 14.6442, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1921, std.dev.: 0.0098) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.61% (3.1722 => 3.2234, std.dev.: 0.0023) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3045, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2864, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5136, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5880, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.29% (2.4764 => 2.3949, std.dev.: 0.0132) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.86% (25.4195 => 16.5584, std.dev.: 0.0198) SingleSource/Benchmarks/Shootout-C++/ary2: -8.49% (0.2402 => 0.2198, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9750, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7900, std.dev.: 0.0146) MultiSource/Benchmarks/Olden/tsp/tsp: -7.32% (2.1113 => 1.9568, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7988, std.dev.: 0.0127) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.15% (0.6293 => 0.6095, std.dev.: 0.0026) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7731, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.25% (41.7953 => 40.8561, std.dev.: 0.0072) SingleSource/Benchmarks/Dhrystone/fldry: -2.16% (17.2379 => 16.8650, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5774, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4957, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.31% (105.3826 => 103.9981, std.dev.: 0.1157) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0436, std.dev.: 0.0040) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 12 14:51:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 12 Oct 2012 16:51:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121012215116.B2AE42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4829?compare_to=4826&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4829, Order: 165816, Start Time: 2012-10-12 20:27:03, End Time: 2012-10-12 21:53:02 To: 4826, Order: 165811, Start Time: 2012-10-12 18:31:46, End Time: 2012-10-12 19:57:39 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (189 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1040 (676 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.65% (0.9501 => 0.9658, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 1.17% (2.4893 => 2.5184, std.dev.: 0.0005) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.82% (2.0176 => 2.5184, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.72% (0.1410 => 0.1674, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 17.80% (0.0826 => 0.0973) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.46% (0.0653 => 0.0767, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 16.81% (0.2243 => 0.2620, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.67% (0.1072 => 0.1240, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.03% (0.0834 => 0.0951, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 14.02% (0.1013 => 0.1155, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.94% (0.1327 => 0.1512, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 13.71% (0.7038 => 0.8003, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 13.63% (0.2721 => 0.3092, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.59% (0.1413 => 0.1605, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.16% (0.1588 => 0.1797, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 13.16% (1.3693 => 1.5495, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.00% (3.9660 => 4.4816, std.dev.: 0.0079) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.86% (0.0964 => 0.1088, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.55% (1.4563 => 1.6391, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 12.52% (0.1062 => 0.1195, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.40% (0.2596 => 0.2918, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.30% (0.6959 => 0.7815, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.24% (0.9199 => 1.0325, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.23% (0.7710 => 0.8653, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.16% (0.5265 => 0.5905, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.14% (1.2193 => 1.3673, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.13% (0.6283 => 0.7045, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 12.01% (13.8202 => 15.4802, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/hash2: 11.95% (0.4328 => 0.4845, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 11.77% (0.4062 => 0.4540, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.76% (1.1364 => 1.2700, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.67% (0.3899 => 0.4354, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: 11.67% (0.1003 => 0.1120, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 11.64% (0.5818 => 0.6495, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.58% (0.1157 => 0.1291, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 11.38% (1.0313 => 1.1487, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 11.31% (0.5748 => 0.6398, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.25% (0.3130 => 0.3482, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.24% (0.5577 => 0.6204, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.08% (0.4791 => 0.5322, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 11.02% (0.7061 => 0.7839, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 10.98% (1.1061 => 1.2275, std.dev.: 0.0024) MultiSource/Applications/kimwitu++/kc: 10.87% (16.6129 => 18.4184, std.dev.: 0.0085) MultiSource/Applications/minisat/minisat: 10.85% (0.6744 => 0.7476, std.dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: 10.65% (0.2995 => 0.3314, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.64% (0.0977 => 0.1081, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 10.64% (0.1589 => 0.1758, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.62% (0.3485 => 0.3855, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.60% (0.1075 => 0.1189, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.57% (0.3246 => 0.3589, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.53% (0.4016 => 0.4439, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.50% (0.4379 => 0.4839, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.46% (0.3756 => 0.4149, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 10.40% (0.3220 => 0.3555, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 10.39% (2.1791 => 2.4056, std.dev.: 0.0028) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.38% (0.1435 => 0.1584, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.38% (0.3489 => 0.3851, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 10.35% (0.8310 => 0.9170, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.33% (0.2914 => 0.3215, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 10.31% (3.8646 => 4.2629, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.30% (0.2127 => 0.2346, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 10.21% (0.2781 => 0.3065, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 10.21% (0.7506 => 0.8272, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.21% (0.4390 => 0.4838, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.18% (0.5637 => 0.6211, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 10.17% (3.1889 => 3.5133, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/mst/mst: 10.17% (0.1111 => 0.1224, std.dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 10.17% (1.0594 => 1.1671, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.16% (0.3022 => 0.3329, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.14% (0.3580 => 0.3943, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.13% (0.2655 => 0.2924, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.09% (0.8698 => 0.9576, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 10.08% (0.3293 => 0.3625, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.08% (0.1865 => 0.2053, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.06% (0.1014 => 0.1116, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.03% (0.1276 => 0.1404, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.02% (0.1986 => 0.2185, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 10.02% (0.2925 => 0.3218, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 10.01% (1.9270 => 2.1198, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.99% (0.2023 => 0.2225, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.96% (0.7460 => 0.8203, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.85% (0.2782 => 0.3056, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 9.82% (0.3868 => 0.4248, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 9.81% (0.1478 => 0.1623, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/strcat: 9.76% (0.2726 => 0.2992, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.74% (0.3511 => 0.3853, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.71% (0.2966 => 0.3254, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 9.67% (0.3453 => 0.3787, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.67% (7.2180 => 7.9161, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/ary3: 9.65% (0.3149 => 0.3453, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.62% (0.1569 => 0.1720, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 9.62% (0.3107 => 0.3406, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.62% (1.9828 => 2.1735, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.53% (0.8818 => 0.9658, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 9.46% (0.2760 => 0.3021, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 9.41% (0.2690 => 0.2943, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.40% (4.9865 => 5.4550, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/lists1: 9.39% (0.3534 => 0.3866, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 9.36% (0.2607 => 0.2851, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.33% (0.2765 => 0.3023, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 9.30% (0.3192 => 0.3489, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 9.30% (0.2937 => 0.3210, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 9.27% (0.2761 => 0.3017, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 9.26% (0.3131 => 0.3421, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 9.26% (1.2749 => 1.3929, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.25% (1.3245 => 1.4470, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.24% (3.6692 => 4.0084, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/em3d/em3d: 9.23% (0.1657 => 0.1810, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 9.21% (0.2628 => 0.2870, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 9.17% (0.2988 => 0.3262, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 9.15% (14.8535 => 16.2128, std.dev.: 0.0119) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.05% (4.4433 => 4.8453, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.01% (0.2696 => 0.2939, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.98% (4.3801 => 4.7735, std.dev.: 0.0068) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.97% (0.2140 => 0.2332, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 8.83% (8.4961 => 9.2460, std.dev.: 0.0169) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.63% (0.3755 => 0.4079, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.62% (0.6135 => 0.6664, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.59% (0.6576 => 0.7141, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.55% (1.5188 => 1.6487, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 8.49% (0.2945 => 0.3195, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.44% (0.1789 => 0.1940, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.32% (3.2742 => 3.5467, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.31% (0.9108 => 0.9865, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.13% (1.1333 => 1.2254, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.10% (0.2321 => 0.2509, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 8.10% (0.4113 => 0.4446, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 8.07% (6.5754 => 7.1062, std.dev.: 0.0063) MultiSource/Applications/oggenc/oggenc: 7.98% (4.6629 => 5.0350, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/neural/neural: 7.94% (0.1385 => 0.1495, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.85% (0.4805 => 0.5182, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 7.82% (0.2008 => 0.2165, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 7.81% (3.7467 => 4.0393, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/parameter-passing: 7.74% (0.4003 => 0.4313, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 7.70% (0.6250 => 0.6731, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.67% (0.2504 => 0.2696, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.45% (2.1007 => 2.2573, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions: 7.41% (0.3914 => 0.4204, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.39% (0.3940 => 0.4231, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 7.32% (0.1777 => 0.1907, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.30% (0.3245 => 0.3482, std.dev.: 0.0069) SingleSource/UnitTests/ObjC/trivial-interface: 7.21% (0.3578 => 0.3836, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.21% (6.2785 => 6.7309, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/for-in: 7.21% (0.3789 => 0.4062, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.10% (0.3646 => 0.3905, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.07% (0.3663 => 0.3922, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.05% (0.3601 => 0.3855, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.04% (0.3623 => 0.3878, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.02% (13.2842 => 14.2162, std.dev.: 0.0171) MultiSource/Applications/hexxagon/hexxagon: 7.00% (1.2292 => 1.3152, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.99% (0.3650 => 0.3905, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.16% (0.1819 => 0.1931, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.93% (0.2243 => 0.2376, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 5.19% (16.2614 => 17.1061, std.dev.: 0.0193) MultiSource/Applications/ClamAV/clamscan: 4.73% (14.5298 => 15.2166, std.dev.: 0.0144) MultiSource/Benchmarks/Olden/bh/bh: 3.57% (0.2859 => 0.2961, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 2.12% (33.2944 => 34.0002, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5146, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fbench: 26.08% (1.8175 => 2.2915, std.dev.: 0.0398) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 11.10% (1.1560 => 1.2843, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 9.02% (0.8273 => 0.9019, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4145, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 5.97% (1.2998 => 1.3774, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0041, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.89% (1.7081 => 1.7746, std.dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6765, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.39% (10.7476 => 11.1116, std.dev.: 0.0515) SingleSource/Benchmarks/Misc/flops-6: 3.24% (1.9199 => 1.9821, std.dev.: 0.0029) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.15% (7.4271 => 7.5865, std.dev.: 0.0041) MultiSource/Applications/lemon/lemon: 1.65% (1.4298 => 1.4534, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0496, std.dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5133, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9678, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1871, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.17% (5.5130 => 5.5774, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0273, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5871, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.37% (0.2670 => 0.1432, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.93% (0.4657 => 0.3915, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -14.14% (0.0707 => 0.0607, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.81% (1.3813 => 1.2044, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.79% (1.3819 => 1.2051, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.93% (0.2238 => 0.1971, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.88% (1.2308 => 1.0969, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.13% (20.3410 => 18.2796, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.36% (1.3780 => 1.3041, std.dev.: 0.0183) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.68% (0.9996 => 0.9528, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.59% (3.2729 => 3.1554, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.53% (1.7688 => 1.7064, std.dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.94% (0.4867 => 0.4724, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4785, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -2.50% (26.5159 => 25.8524, std.dev.: 0.0194) MultiSource/Applications/spiff/spiff: -2.42% (3.0263 => 2.9532, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -2.36% (1.9762 => 1.9296, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.99% (0.6589 => 0.6458, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -1.81% (28.2225 => 27.7130, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/lists: -1.70% (6.3560 => 6.2478, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: -1.45% (4.5928 => 4.5263, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0077, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.21% (3.9173 => 3.8699, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.16% (2.5254 => 2.4961, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2582, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: -1.07% (9.3358 => 9.2356, std.dev.: 0.0101) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 12 14:57:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 12 Oct 2012 16:57:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121012215708.E41142A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4830?compare_to=4827&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4830, Order: 165817, Start Time: 2012-10-12 20:39:03, End Time: 2012-10-12 21:58:57 To: 4827, Order: 165813, Start Time: 2012-10-12 18:49:23, End Time: 2012-10-12 20:09:27 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (158 on baseline) Performance Improvements: 1 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 951 (686 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.23% (15.3145 => 15.8098, std.dev.: 0.0156) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -1.45% (11.7213 => 11.5512, std.dev.: 0.0120) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.12% (0.5956 => 0.5949, std.dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: -0.07% (16.4505 => 16.4393, std.dev.: 0.0041) MultiSource/Benchmarks/Bullet/bullet: -0.23% (55.5079 => 55.3820, std.dev.: 0.0141) MultiSource/Benchmarks/MallocBench/gs/gs: -0.06% (4.4427 => 4.4401, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0462 => 0.0462, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.22% (0.0463 => 0.0464, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0432 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0433 => 0.0433, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0421 => 0.0421) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0423 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0415 => 0.0415) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0416 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0433 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0434 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.23% (0.0428 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.23% (0.0429 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0419 => 0.0419) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0425 => 0.0425, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0426 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0436 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.53% (0.0457 => 0.0450, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0412 => 0.0412, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.24% (0.0414 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0424 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0426 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0416 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0408 => 0.0408, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0409 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.25% (0.0407 => 0.0406, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0409 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0444 => 0.0444) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0445 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0406 => 0.0406) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0407 => 0.0407) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.25% (0.0407 => 0.0406, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0408 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0415 => 0.0415, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0416 => 0.0416, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.06% (1.2598 => 1.2605, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.36% (7.8966 => 7.8681, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.43% (0.7450 => 0.7418, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 1.11% (0.0361 => 0.0365, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -0.14% (0.1434 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0667 => 0.0667, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.43% (63.2438 => 55.3820, std.dev.: 0.0141) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.47% (14.1553 => 19.0350, std.dev.: 0.0199) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.47% (3.4629 => 5.6609, std.dev.: 0.0118) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14235.28% (0.0720 => 10.3214, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952100.00% (0.0001 => 9.9522, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 62.73% (0.2554 => 0.4156, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 52.50% (10.3673 => 15.8098, std.dev.: 0.0156) SingleSource/Benchmarks/Misc/richards_benchmark: 38.90% (0.1622 => 0.2253, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/distray/distray: 33.62% (0.1056 => 0.1411, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 18.16% (0.1432 => 0.1692, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.45% (7.0540 => 8.2850, std.dev.: 0.0113) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.72% (2.2022 => 2.5704, std.dev.: 0.0032) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.26% (0.1566 => 0.1805, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.10% (1.7609 => 1.9916, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.09% (0.0871 => 0.0985, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 12.46% (0.3282 => 0.3691, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 12.29% (0.1440 => 0.1617, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.81% (0.1584 => 0.1771, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.64% (0.1143 => 0.1276, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.40% (0.1438 => 0.1602, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 11.02% (0.7433 => 0.8252, std.dev.: 0.0072) MultiSource/Applications/JM/ldecod/ldecod: 10.69% (10.4361 => 11.5512, std.dev.: 0.0120) MultiSource/Applications/minisat/minisat: 10.48% (0.7115 => 0.7861, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.29% (0.4879 => 0.5381, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.28% (0.1625 => 0.1792, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 10.05% (9.4845 => 10.4376, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.04% (0.6675 => 0.7345, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.00% (0.2700 => 0.2970, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.94% (1.5415 => 1.6948, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: 9.85% (0.1655 => 0.1818, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.77% (0.3543 => 0.3889, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 9.73% (0.3473 => 0.3811, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 9.71% (3.3354 => 3.6592, std.dev.: 0.0140) MultiSource/Benchmarks/Olden/tsp/tsp: 9.70% (0.1175 => 0.1289, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.69% (0.3177 => 0.3485, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.65% (0.3927 => 0.4306, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.62% (0.3543 => 0.3884, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 9.46% (0.3561 => 0.3898, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 9.46% (0.3109 => 0.3403, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 9.44% (0.1695 => 0.1855, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.44% (0.3497 => 0.3827, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.39% (0.3516 => 0.3846, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.38% (0.1151 => 0.1259, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 9.35% (0.3423 => 0.3743, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.32% (0.4615 => 0.5045, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/property: 9.29% (0.3886 => 0.4247, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.26% (0.3694 => 0.4036, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.25% (0.3828 => 0.4182, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.21% (4.2646 => 4.6574, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.19% (0.5105 => 0.5574, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.07% (0.1510 => 0.1647, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.06% (1.3050 => 1.4232, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.03% (0.5860 => 0.6389, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.00% (0.8067 => 0.8793, std.dev.: 0.0031) MultiSource/Applications/oggenc/oggenc: 8.99% (5.7591 => 6.2766, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.98% (0.1236 => 0.1347, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.92% (0.2107 => 0.2295, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 8.88% (0.5925 => 0.6451, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 8.85% (1.1642 => 1.2672, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.82% (0.5569 => 0.6060, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.72% (0.8172 => 0.8885, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.72% (0.2271 => 0.2469, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.69% (0.6030 => 0.6554, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 8.69% (3.8723 => 4.2087, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.68% (0.9765 => 1.0613, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.62% (8.1363 => 8.8380, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.61% (0.1940 => 0.2107, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.59% (0.2758 => 0.2995, std.dev.: 0.0020) MultiSource/Applications/lemon/lemon: 8.55% (1.0722 => 1.1639, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.52% (0.3121 => 0.3387, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.51% (5.0018 => 5.4275, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.50% (0.3307 => 0.3588, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 8.49% (0.1555 => 0.1687, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.49% (4.9449 => 5.3646, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/bigfib: 8.46% (0.6456 => 0.7002, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 8.39% (0.3387 => 0.3671, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 8.35% (0.7835 => 0.8489, std.dev.: 0.0031) MultiSource/Applications/hbd/hbd: 8.31% (1.5603 => 1.6900, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.29% (0.5020 => 0.5436, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: 8.28% (2.0273 => 2.1951, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.26% (0.4103 => 0.4442, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.09% (0.2065 => 0.2232, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 8.00% (0.7326 => 0.7912, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.97% (1.5859 => 1.7123, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 7.92% (2.2969 => 2.4788, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.84% (7.9617 => 8.5862, std.dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.82% (0.3441 => 0.3710, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 7.74% (0.3180 => 0.3426, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.73% (0.4203 => 0.4528, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.59% (1.1861 => 1.2761, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.58% (0.3865 => 0.4158, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.57% (0.6450 => 0.6938, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.55% (0.1337 => 0.1438, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 7.42% (0.3422 => 0.3676, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 7.39% (0.4289 => 0.4606, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.34% (0.2603 => 0.2794, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.26% (0.3650 => 0.3915, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.24% (0.3826 => 0.4103, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.23% (0.4620 => 0.4954, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 7.19% (0.8921 => 0.9562, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 7.10% (21.9371 => 23.4953, std.dev.: 0.0262) SingleSource/Regression/C++/ofstream_ctor: 7.06% (0.2905 => 0.3110, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.05% (2.2024 => 2.3576, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 7.04% (0.4048 => 0.4333, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.99% (0.3162 => 0.3383, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.94% (0.5981 => 0.6396, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.89% (0.3136 => 0.3352, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.88% (0.2891 => 0.3090, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.83% (0.3603 => 0.3849, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.82% (0.4636 => 0.4952, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 6.75% (0.4299 => 0.4589, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.66% (2.0665 => 2.2041, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/lists1: 6.62% (0.3684 => 0.3928, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.57% (0.2831 => 0.3017, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.56% (1.4186 => 1.5116, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.55% (0.1695 => 0.1806, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.48% (0.2872 => 0.3058, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 6.44% (1.1840 => 1.2602, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.39% (0.2756 => 0.2932, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary3: 6.34% (0.3283 => 0.3491, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.33% (0.3098 => 0.3294, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.31% (0.3232 => 0.3436, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 6.27% (0.2871 => 0.3051, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.27% (0.2793 => 0.2968, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 6.24% (0.2725 => 0.2895, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 6.08% (0.2877 => 0.3052, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.05% (0.2266 => 0.2403, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.03% (0.2802 => 0.2971, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 5.97% (0.2714 => 0.2876, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 5.68% (0.3379 => 0.3571, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.67% (0.1906 => 0.2014, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.59% (0.4064 => 0.4291, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.32% (0.8101 => 0.8532, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.09% (14.3668 => 15.0987, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/objinst: 4.98% (0.3131 => 0.3287, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 4.98% (0.2049 => 0.2151, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 4.88% (1.2842 => 1.3469, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 4.67% (17.1811 => 17.9843, std.dev.: 0.0126) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.61% (0.2430 => 0.2542, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.58% (0.3427 => 0.3584, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.13% (3.8922 => 4.0529, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.34% (1.1194 => 1.1568, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9648, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 10.00% (1.1396 => 1.2536, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 9.22% (3.1595 => 3.4509, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3684, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.49% (3.6395 => 3.7665, std.dev.: 0.0043) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.85% (4.2280 => 4.3487, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.27% (1.7254 => 1.7645, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (0.8275 => 0.8405, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.48% (0.9540 => 0.9681, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8133, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.17% (2.6546 => 2.6857, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1309, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -79.93% (0.8651 => 0.1736, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.26% (5.2763 => 3.2577, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.32% (5.3855 => 3.6988, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.86% (5.3526 => 3.7006, std.dev.: 0.0027) SingleSource/UnitTests/Vector/constpool: -14.65% (54.1659 => 46.2320, std.dev.: 0.0204) MultiSource/Applications/ClamAV/clamscan: -12.18% (22.1758 => 19.4742, std.dev.: 0.0105) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.57% (2.9384 => 2.6279, std.dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7652, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: -15.74% (1.6925 => 1.4261, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.83% (0.0998 => 0.0860, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.99% (1.2373 => 1.0889, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/mandel-2: -10.30% (1.5373 => 1.3790, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -9.95% (0.2161 => 0.1946, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.29% (19.9488 => 18.2943, std.dev.: 0.0947) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.74% (1.8329 => 1.7093, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.25% (1.6805 => 1.5922, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.55% (1.5835 => 1.5114, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.12% (0.9957 => 0.9547, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169, std.dev.: 0.0008) MultiSource/Applications/siod/siod: -3.65% (3.2827 => 3.1628, std.dev.: 0.0038) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5076, std.dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: -3.01% (12.4730 => 12.0980, std.dev.: 0.0012) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.00% (8.6802 => 8.5067, std.dev.: 0.0186) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.91% (8.1563 => 8.0007, std.dev.: 0.0069) SingleSource/UnitTests/Vector/multiplies: -1.73% (2.5528 => 2.5086, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6816, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -1.54% (10.2830 => 10.1246, std.dev.: 0.0143) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -1.13% (4.6441 => 4.5918, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8567, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.05% (6.2999 => 6.2337, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.77% (0.5229 => 0.5949, std.dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 9.67% (14.9895 => 16.4393, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/gs/gs: 8.02% (4.1105 => 4.4401, std.dev.: 0.0155) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.09% (1.1048 => 1.2605, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.92% (7.1582 => 7.8681, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.22% (0.6222 => 0.7418, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36400.00% (0.0001 => 0.0365, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.48% (0.2116 => 0.0667, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 12 18:46:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 12 Oct 2012 20:46:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121013014625.979BE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4835?compare_to=4831&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4835, Order: 165853, Start Time: 2012-10-13 00:21:10, End Time: 2012-10-13 01:47:03 To: 4831, Order: 165827, Start Time: 2012-10-12 22:24:58, End Time: 2012-10-12 23:50:48 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (187 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1040 (677 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.62% (78.0266 => 80.8493, std.dev.: 0.4484) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.83% (0.7204 => 0.7072, std.dev.: 0.0005) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.38% (2.0176 => 2.4894, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.37% (0.1410 => 0.1669, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 17.43% (0.0826 => 0.0970, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.85% (0.0653 => 0.0763, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 16.45% (0.2243 => 0.2612, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.49% (0.1072 => 0.1238, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 13.92% (0.1013 => 0.1154, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.51% (0.0770 => 0.0874, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.43% (0.0834 => 0.0946, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.41% (0.1327 => 0.1505, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.38% (0.1413 => 0.1602, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 13.09% (0.7038 => 0.7959, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.67% (3.9660 => 4.4686, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.66% (0.0964 => 0.1086, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.53% (0.1588 => 0.1787, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.50% (0.2721 => 0.3061, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.37% (1.4563 => 1.6364, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 12.27% (1.3693 => 1.5373, std.dev.: 0.0021) MultiSource/Applications/aha/aha: 12.15% (0.1062 => 0.1191, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.10% (0.2596 => 0.2910, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 12.01% (0.4062 => 0.4550, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.96% (0.7710 => 0.8632, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.96% (0.9199 => 1.0299, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 11.95% (0.4328 => 0.4845, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.93% (0.5265 => 0.5893, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.90% (0.6959 => 0.7787, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 11.87% (13.8202 => 15.4604, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.73% (0.6283 => 0.7020, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.71% (1.2193 => 1.3621, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.54% (1.1364 => 1.2675, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: 11.37% (0.1003 => 0.1117, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 11.17% (1.0313 => 1.1465, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.11% (0.3899 => 0.4332, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.09% (0.3130 => 0.3477, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 11.08% (0.1986 => 0.2206, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.06% (0.1157 => 0.1285, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 10.89% (0.7061 => 0.7830, std.dev.: 0.0016) MultiSource/Applications/Burg/burg: 10.87% (1.1061 => 1.2263, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 10.85% (0.5818 => 0.6449, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.73% (0.4791 => 0.5305, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 10.65% (16.6129 => 18.3827, std.dev.: 0.0184) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.65% (0.3485 => 0.3856, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.63% (0.5748 => 0.6359, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.60% (0.5577 => 0.6168, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.56% (0.4016 => 0.4440, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.55% (0.4390 => 0.4853, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.51% (0.3246 => 0.3587, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 10.45% (0.1589 => 0.1755, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.44% (0.0977 => 0.1079, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.36% (0.3022 => 0.3335, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.36% (0.3756 => 0.4145, std.dev.: 0.0090) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.32% (0.4379 => 0.4831, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 10.32% (0.2781 => 0.3068, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 10.29% (0.3293 => 0.3632, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 10.28% (0.2995 => 0.3303, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/mst/mst: 10.26% (0.1111 => 0.1225, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.23% (0.1075 => 0.1185, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 10.23% (0.6744 => 0.7434, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 10.20% (3.8646 => 4.2589, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.15% (0.3489 => 0.3843, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.14% (0.3580 => 0.3943, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.11% (0.7460 => 0.8214, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 10.05% (2.1791 => 2.3982, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/18-imp/imp: 10.03% (0.3220 => 0.3543, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 10.03% (1.9270 => 2.1202, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 9.98% (0.3868 => 0.4254, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 9.98% (0.8310 => 0.9139, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.96% (0.2782 => 0.3059, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.95% (0.2914 => 0.3204, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 9.94% (0.7506 => 0.8252, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.93% (0.5637 => 0.6197, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.92% (0.2127 => 0.2338, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.88% (0.2966 => 0.3259, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 9.88% (0.1478 => 0.1624, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 9.87% (3.1889 => 3.5037, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.87% (0.1865 => 0.2049, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 9.81% (0.2925 => 0.3212, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.74% (0.2023 => 0.2220, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.74% (0.8698 => 0.9545, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.73% (1.9828 => 2.1757, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 9.65% (0.2726 => 0.2989, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 9.64% (0.3453 => 0.3786, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 9.62% (0.3534 => 0.3874, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.62% (0.1435 => 0.1573, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.60% (0.2655 => 0.2910, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.56% (7.2180 => 7.9084, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/methcall: 9.56% (0.2761 => 0.3025, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 9.56% (0.3149 => 0.3450, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 9.53% (0.2760 => 0.3023, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 9.53% (0.3107 => 0.3403, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.50% (0.1569 => 0.1718, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.48% (0.1276 => 0.1397, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 9.46% (0.3192 => 0.3494, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 9.44% (0.2690 => 0.2944, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 9.44% (0.2607 => 0.2853, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 9.40% (1.0594 => 1.1590, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wc: 9.40% (0.2937 => 0.3213, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.33% (0.2765 => 0.3023, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 9.29% (0.1657 => 0.1811, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 9.28% (0.2628 => 0.2872, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.25% (1.3245 => 1.4470, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.19% (4.9865 => 5.4450, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 9.10% (0.2988 => 0.3260, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.05% (0.2696 => 0.2940, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 9.03% (1.2749 => 1.3900, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.82% (3.6692 => 3.9929, std.dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 8.77% (14.8535 => 16.1560, std.dev.: 0.0084) MultiSource/Benchmarks/sim/sim: 8.75% (0.3131 => 0.3405, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: 8.73% (0.2945 => 0.3202, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.69% (0.3511 => 0.3816, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.61% (4.3801 => 4.7574, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.58% (0.3755 => 0.4077, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.57% (4.4433 => 4.8242, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.52% (0.6135 => 0.6658, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 8.41% (8.4961 => 9.2106, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.39% (1.5188 => 1.6462, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.22% (0.1789 => 0.1936, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.04% (0.8818 => 0.9527, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.04% (0.2140 => 0.2312, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.97% (0.2321 => 0.2506, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.95% (1.1333 => 1.2234, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.91% (3.2742 => 3.5332, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/parameter-passing: 7.87% (0.4003 => 0.4318, std.dev.: 0.0024) MultiSource/Applications/oggenc/oggenc: 7.82% (4.6629 => 5.0277, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/05-eks/eks: 7.80% (0.4113 => 0.4434, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.78% (0.9108 => 0.9817, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.68% (0.4805 => 0.5174, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/neural/neural: 7.65% (0.1385 => 0.1491, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 7.60% (0.6250 => 0.6725, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 7.55% (6.5754 => 7.0720, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.54% (0.6576 => 0.7072, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 7.54% (0.3940 => 0.4237, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.54% (0.3914 => 0.4209, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.47% (0.2504 => 0.2691, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 7.45% (3.7467 => 4.0259, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.37% (0.3245 => 0.3484, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.36% (2.1007 => 2.2554, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 7.35% (0.3578 => 0.3841, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.31% (0.3789 => 0.4066, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.30% (0.3646 => 0.3912, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.29% (0.3650 => 0.3916, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 7.23% (0.3663 => 0.3928, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 7.14% (0.3601 => 0.3858, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 7.13% (1.2292 => 1.3168, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/exceptions-3: 7.07% (0.3623 => 0.3879, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 7.02% (0.2008 => 0.2149, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.76% (6.2785 => 6.7030, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.61% (13.2842 => 14.1625, std.dev.: 0.0152) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.43% (0.1819 => 0.1936, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.39% (0.2243 => 0.2364, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 4.99% (16.2614 => 17.0735, std.dev.: 0.0114) MultiSource/Applications/ClamAV/clamscan: 4.44% (14.5298 => 15.1746, std.dev.: 0.0069) MultiSource/Benchmarks/Bullet/bullet: 2.05% (33.2944 => 33.9773, std.dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.38% (5.7573 => 7.5066, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.09% (1.0895 => 1.3629, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 23.96% (1.8175 => 2.2530, std.dev.: 0.0126) SingleSource/Benchmarks/Misc/richards_benchmark: 10.98% (1.1560 => 1.2829, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921) SingleSource/Benchmarks/Misc/ffbench: 9.02% (0.8273 => 0.9019, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4143, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.01% (1.2998 => 1.3779, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0047, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.98% (1.7081 => 1.7760, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.67% (11.2619 => 11.6754, std.dev.: 0.0044) MultiSource/Applications/SPASS/SPASS: 3.45% (10.7476 => 11.1189, std.dev.: 0.0306) SingleSource/Benchmarks/Misc/flops-6: 3.32% (1.9199 => 1.9836, std.dev.: 0.0018) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.14% (7.4271 => 7.5864, std.dev.: 0.0066) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4532, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5151, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0497, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9698, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1866, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5784, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0271, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 1.07% (12.4560 => 12.5888, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.85% (0.2670 => 0.1419, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.80% (0.4657 => 0.3921, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -14.29% (0.0707 => 0.0606, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.42% (1.3819 => 1.1965, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.34% (1.3813 => 1.1970, std.dev.: 0.0070) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.44% (22.5627 => 22.2374, std.dev.: 0.0104) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.64% (0.0997 => 0.0861, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/mason/mason: -12.11% (0.2238 => 0.1967, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.15% (1.2308 => 1.0936, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.27% (20.3410 => 18.2527, std.dev.: 0.0258) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.69% (1.3780 => 1.2996, std.dev.: 0.0082) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.29% (0.9996 => 0.9567, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1559, std.dev.: 0.0088) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.48% (1.7688 => 1.7072, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.96% (0.4867 => 0.4723, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4785, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.52% (26.5159 => 25.8473, std.dev.: 0.0117) MultiSource/Applications/spiff/spiff: -2.48% (3.0263 => 2.9511, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: -2.36% (1.9762 => 1.9296, std.dev.: 0.0112) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.00% (0.6589 => 0.6457, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.94% (6.3560 => 6.2326, std.dev.: 0.0070) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7151, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0062, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -1.43% (4.5928 => 4.5270, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8632, std.dev.: 0.0025) MultiSource/Applications/minisat/minisat: -1.29% (9.3358 => 9.2157, std.dev.: 0.0104) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.16% (2.5254 => 2.4962, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2567, std.dev.: 0.0013) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 12 18:40:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 12 Oct 2012 20:40:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121013014039.5D2FD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4834?compare_to=4832&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4834, Order: 165853, Start Time: 2012-10-13 00:21:15, End Time: 2012-10-13 01:41:23 To: 4832, Order: 165829, Start Time: 2012-10-12 22:31:48, End Time: 2012-10-12 23:51:49 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 4 (168 on baseline) Performance Improvements: 1 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 948 (676 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.94% (2.1788 => 2.2210, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 1.48% (1.3345 => 1.3542, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.09% (78.8575 => 81.2927, std.dev.: 0.3517) MultiSource/Benchmarks/llubenchmark/llu: 3.01% (3.7559 => 3.8688, std.dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.62% (15.5543 => 15.3025, std.dev.: 0.0074) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.17% (0.5960 => 0.5950, std.dev.: 0.0033) MultiSource/Applications/SPASS/SPASS: -0.02% (16.4240 => 16.4201, std.dev.: 0.0084) MultiSource/Benchmarks/Bullet/bullet: 0.04% (55.4402 => 55.4647, std.dev.: 0.0086) MultiSource/Benchmarks/MallocBench/gs/gs: 0.13% (4.4463 => 4.4520, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.30% (0.0460 => 0.0466) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.30% (0.0461 => 0.0467, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.93% (0.0430 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.93% (0.0432 => 0.0436, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.19% (0.0420 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.19% (0.0421 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.21% (0.0414 => 0.0419, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.20% (0.0415 => 0.0420, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.39% (0.0431 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.15% (0.0433 => 0.0438) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.17% (0.0426 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.17% (0.0427 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.20% (0.0416 => 0.0421, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.96% (0.0418 => 0.0422, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.18% (0.0423 => 0.0428, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.18% (0.0424 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.38% (0.0434 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.46% (0.0439 => 0.0441, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.22% (0.0411 => 0.0416) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.21% (0.0412 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.71% (0.0425 => 0.0428, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.18% (0.0424 => 0.0429, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.21% (0.0414 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.20% (0.0415 => 0.0420, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.98% (0.0407 => 0.0411) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.98% (0.0408 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.99% (0.0406 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.23% (0.0407 => 0.0412) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.13% (0.0442 => 0.0447, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.13% (0.0443 => 0.0448, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.24% (0.0404 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.48% (0.0405 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.48% (0.0405 => 0.0411) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.23% (0.0406 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.21% (0.0413 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.21% (0.0414 => 0.0419, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.16% (1.2605 => 1.2625, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.38% (7.8490 => 7.8792, std.dev.: 0.0157) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.04% (0.7384 => 0.7461, std.dev.: 0.0037) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.28% (0.0362 => 0.0363, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1433 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.86% (0.0646 => 0.0658, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.30% (63.2438 => 55.4647, std.dev.: 0.0086) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.46% (14.1553 => 19.0334, std.dev.: 0.0151) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.72% (3.4629 => 5.6695, std.dev.: 0.0019) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14240.14% (0.0720 => 10.3249, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9951900.00% (0.0001 => 9.9520, std.dev.: 0.0012) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.78% (0.2554 => 0.4183, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 47.60% (10.3673 => 15.3025, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/richards_benchmark: 38.72% (0.1622 => 0.2250, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/distray/distray: 33.81% (0.1056 => 0.1413, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.29% (7.0540 => 8.3445, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/flops: 18.09% (0.1432 => 0.1691, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.70% (2.2022 => 2.5919, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.26% (0.1566 => 0.1805, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.66% (0.0798 => 0.0907, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.97% (0.0871 => 0.0984, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.94% (1.7609 => 1.9887, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 12.77% (0.3282 => 0.3701, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 12.61% (0.3473 => 0.3911, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 12.57% (0.1440 => 0.1621, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.54% (0.3516 => 0.3957, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.50% (0.3543 => 0.3986, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.42% (0.1143 => 0.1285, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions-4: 12.42% (0.3543 => 0.3983, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.41% (0.3561 => 0.4003, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.41% (0.3497 => 0.3931, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.35% (0.3927 => 0.4412, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 12.10% (0.3828 => 0.4291, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.05% (0.3694 => 0.4139, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.02% (0.3886 => 0.4353, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.93% (0.1584 => 0.1773, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 10.91% (0.7433 => 0.8244, std.dev.: 0.0102) MultiSource/Applications/JM/ldecod/ldecod: 10.76% (10.4361 => 11.5590, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.52% (0.1625 => 0.1796, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.50% (0.1438 => 0.1589, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 10.50% (0.7115 => 0.7862, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.45% (0.4879 => 0.5389, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 10.27% (0.1695 => 0.1869, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 10.22% (9.4845 => 10.4536, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.19% (0.2700 => 0.2975, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.17% (1.5415 => 1.6982, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/tsp/tsp: 10.13% (0.1175 => 0.1294, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.13% (0.6675 => 0.7351, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 10.09% (3.3354 => 3.6718, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.04% (0.3177 => 0.3496, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/chomp: 9.97% (0.1655 => 0.1820, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.75% (0.4615 => 0.5065, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.70% (0.8172 => 0.8965, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/18-imp/imp: 9.67% (0.3423 => 0.3754, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.49% (0.2065 => 0.2261, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 9.49% (0.3109 => 0.3404, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.39% (0.5860 => 0.6410, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.36% (0.9765 => 1.0679, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.34% (4.2646 => 4.6631, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.34% (0.1510 => 0.1651, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.30% (0.1236 => 0.1351, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.30% (0.1151 => 0.1258, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 9.26% (0.1555 => 0.1699, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.25% (0.2271 => 0.2481, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.25% (0.5105 => 0.5577, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.23% (0.1940 => 0.2119, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.13% (0.1117 => 0.1219, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.12% (0.5569 => 0.6077, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.11% (1.3050 => 1.4239, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 9.10% (0.6030 => 0.6579, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.07% (0.2107 => 0.2298, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 9.06% (1.1642 => 1.2697, std.dev.: 0.0091) SingleSource/UnitTests/ObjC++/Hello: 9.05% (0.5925 => 0.6461, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.04% (0.8067 => 0.8796, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.00% (8.1363 => 8.8689, std.dev.: 0.0087) MultiSource/Applications/oggenc/oggenc: 9.00% (5.7591 => 6.2773, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.99% (0.2758 => 0.3006, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.97% (5.0018 => 5.4506, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.96% (4.9449 => 5.3879, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/mst/mst: 8.94% (0.1163 => 0.1267, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.94% (0.3121 => 0.3400, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 8.87% (3.8723 => 4.2159, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.87% (0.4103 => 0.4467, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 8.84% (0.6456 => 0.7027, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.80% (0.3307 => 0.3598, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 8.79% (1.5603 => 1.6975, std.dev.: 0.0024) MultiSource/Applications/spiff/spiff: 8.78% (0.7835 => 0.8523, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 8.45% (2.0273 => 2.1987, std.dev.: 0.0028) MultiSource/Applications/lemon/lemon: 8.45% (1.0722 => 1.1628, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.43% (7.9617 => 8.6331, std.dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.41% (0.5020 => 0.5442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.33% (0.4203 => 0.4553, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 8.31% (0.7326 => 0.7935, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/09-vor/vor: 8.30% (0.3180 => 0.3444, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/health/health: 8.28% (0.1268 => 0.1373, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 8.27% (0.3387 => 0.3667, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 8.15% (0.3422 => 0.3701, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.12% (0.3865 => 0.4179, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 8.09% (0.4289 => 0.4636, std.dev.: 0.0121) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.07% (0.4636 => 0.5010, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.95% (0.3826 => 0.4130, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.95% (0.3650 => 0.3940, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.93% (0.3441 => 0.3714, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.93% (0.1337 => 0.1443, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 7.92% (2.2969 => 2.4788, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.78% (1.5859 => 1.7093, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.73% (1.1861 => 1.2778, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.73% (0.4620 => 0.4977, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.68% (0.2905 => 0.3128, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 7.63% (0.4048 => 0.4357, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.56% (0.3162 => 0.3401, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.56% (0.3136 => 0.3373, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.54% (0.2891 => 0.3109, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 7.52% (0.3603 => 0.3874, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.48% (2.0665 => 2.2210, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 7.41% (0.3684 => 0.3957, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.40% (0.6450 => 0.6927, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 7.35% (0.2831 => 0.3039, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.30% (0.2603 => 0.2793, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.28% (0.2871 => 0.3080, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.26% (0.2756 => 0.2956, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.24% (0.5981 => 0.6414, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/05-eks/eks: 7.23% (0.4299 => 0.4610, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: 7.23% (0.3098 => 0.3322, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 7.17% (0.8921 => 0.9561, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 7.15% (21.9371 => 23.5059, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.10% (0.2872 => 0.3076, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.09% (0.2877 => 0.3081, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 7.09% (0.3232 => 0.3461, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.01% (0.2725 => 0.2916, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 6.98% (0.3283 => 0.3512, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.95% (0.3052 => 0.3264, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 6.90% (0.1463 => 0.1564, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.89% (0.2714 => 0.2901, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.89% (2.2024 => 2.3541, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.87% (0.2793 => 0.2985, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/random: 6.85% (0.2802 => 0.2994, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.62% (1.4186 => 1.5125, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.61% (0.1906 => 0.2032, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 6.45% (0.3379 => 0.3597, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.43% (0.1695 => 0.1804, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 6.40% (1.1840 => 1.2598, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.32% (0.4064 => 0.4321, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.09% (0.2266 => 0.2404, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.88% (0.3131 => 0.3315, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.57% (0.8101 => 0.8552, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.55% (0.1892 => 0.1997, std.dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 5.45% (1.2842 => 1.3542, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.16% (14.3668 => 15.1080, std.dev.: 0.0114) SingleSource/Benchmarks/Misc/ReedSolomon: 4.93% (0.2049 => 0.2150, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.74% (0.3817 => 0.3998, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 4.42% (17.1811 => 17.9399, std.dev.: 0.0189) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.36% (0.2430 => 0.2536, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.01% (3.8922 => 4.0483, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/bh/bh: 3.30% (0.3092 => 0.3194, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.24% (1.1194 => 1.1557, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.80% (1.1396 => 1.2513, std.dev.: 0.0014) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4499, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 6.70% (3.1578 => 3.3693, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 3.68% (0.5413 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.65% (3.6395 => 3.7722, std.dev.: 0.0023) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.80% (4.2280 => 4.3462, std.dev.: 0.0021) MultiSource/Benchmarks/llubenchmark/llu: 2.40% (3.7781 => 3.8688, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7652, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.57% (0.8275 => 0.8405, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8126, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.22% (2.6546 => 2.6869, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.15% (6.5088 => 6.5834, std.dev.: 0.0042) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1313, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -79.93% (0.8651 => 0.1736, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.17% (5.2763 => 3.2622, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.96% (5.3855 => 3.7179, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.62% (5.3526 => 3.7139, std.dev.: 0.0089) SingleSource/UnitTests/Vector/constpool: -14.60% (54.1659 => 46.2559, std.dev.: 0.0382) MultiSource/Applications/ClamAV/clamscan: -12.16% (22.1758 => 19.4789, std.dev.: 0.0219) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.19% (2.9384 => 2.6390, std.dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.31% (1.1492 => 0.7664, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4232, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.83% (0.0998 => 0.0860, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.52% (1.2373 => 1.0948, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/mandel-2: -10.45% (1.5373 => 1.3767, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/mason/mason: -10.13% (0.2161 => 0.1942, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.24% (19.9488 => 18.3059, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4788, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.74% (1.8329 => 1.7094, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.64% (1.9577 => 1.8473, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.31% (1.6805 => 1.5912, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7966) SingleSource/Benchmarks/Misc/flops-5: -4.94% (1.5835 => 1.5052, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.15% (0.9957 => 0.9544, std.dev.: 0.0120) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.61% (3.2827 => 3.1643, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5054, std.dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: -3.03% (12.4730 => 12.0949, std.dev.: 0.0025) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.98% (8.6802 => 8.5080, std.dev.: 0.0145) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.82% (8.1563 => 8.0082, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/salsa20: -1.77% (10.2830 => 10.1009, std.dev.: 0.0081) SingleSource/UnitTests/Vector/multiplies: -1.72% (2.5528 => 2.5088, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6812, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.45% (9.5636 => 9.4249, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: -1.11% (4.6441 => 4.5925, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8562, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout/lists: -1.06% (6.2999 => 6.2332, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.79% (0.5229 => 0.5950, std.dev.: 0.0033) MultiSource/Applications/SPASS/SPASS: 9.54% (14.9895 => 16.4201, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/gs/gs: 8.31% (4.1105 => 4.4520, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.27% (1.1048 => 1.2625, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.07% (7.1582 => 7.8792, std.dev.: 0.0157) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.91% (0.6222 => 0.7461, std.dev.: 0.0037) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36200.00% (0.0001 => 0.0363, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.90% (0.2116 => 0.0658, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 12 16:53:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 12 Oct 2012 18:53:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121012235308.D38EC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4833?compare_to=4828&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4833, Order: 165818, Start Time: 2012-10-12 20:44:50, End Time: 2012-10-12 23:55:00 To: 4828, Order: 165803, Start Time: 2012-10-12 17:05:16, End Time: 2012-10-12 20:15:24 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (136 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1040 (755 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 3.78% (2.3949 => 2.4855, std.dev.: 0.0219) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.48% (126.3691 => 129.4993, std.dev.: 0.8027) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 11.59% (0.3460 => 0.3861, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.49% (0.3446 => 0.3842, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.49% (0.3465 => 0.3863, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.44% (0.3496 => 0.3896, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.44% (0.3488 => 0.3887, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.42% (0.3650 => 0.4067, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.42% (0.3442 => 0.3835, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.39% (0.3469 => 0.3864, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 11.34% (0.3643 => 0.4056, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.06% (0.3724 => 0.4136, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 9.78% (0.5826 => 0.6396, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.66% (0.5889 => 0.6458, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.60% (0.1063 => 0.1165, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.20% (0.1620 => 0.1769, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 9.11% (0.1218 => 0.1329, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 9.04% (1.5932 => 1.7373, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/05-eks/eks: 8.89% (0.1619 => 0.1763, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 8.48% (0.7171 => 0.7779, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.31% (1.6211 => 1.7558, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.30% (0.4361 => 0.4723, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.21% (0.2875 => 0.3111, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 8.17% (5.5417 => 5.9947, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.14% (1.3152 => 1.4223, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.06% (0.5000 => 0.5403, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 7.96% (0.4847 => 0.5233, std.dev.: 0.0101) MultiSource/Benchmarks/McCat/18-imp/imp: 7.95% (0.1421 => 0.1534, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.92% (0.5026 => 0.5424, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.92% (0.3195 => 0.3448, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.85% (0.2714 => 0.2927, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.82% (0.3004 => 0.3239, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.78% (0.2725 => 0.2937, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.77% (0.4994 => 0.5382, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/except: 7.76% (0.2811 => 0.3029, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.74% (0.2738 => 0.2950, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 7.72% (0.2823 => 0.3041, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 7.72% (0.4146 => 0.4466, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 7.71% (0.2750 => 0.2962, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.67% (3.5627 => 3.8358, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 7.64% (0.2813 => 0.3028, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.62% (0.2729 => 0.2937, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.61% (2.0673 => 2.2247, std.dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 7.61% (0.9909 => 1.0663, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.59% (0.2792 => 0.3004, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.56% (0.2911 => 0.3131, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 7.55% (0.2780 => 0.2990, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.55% (0.2014 => 0.2166, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 7.51% (0.1505 => 0.1618, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 7.49% (0.3258 => 0.3502, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 7.48% (0.6634 => 0.7130, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/random: 7.46% (0.2803 => 0.3012, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.46% (0.2736 => 0.2940, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 7.45% (0.3678 => 0.3952, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 7.41% (0.3726 => 0.4002, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 7.40% (0.2566 => 0.2756, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 7.40% (0.3096 => 0.3325, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.38% (0.3362 => 0.3610, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.37% (0.3625 => 0.3892, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.35% (0.3060 => 0.3285, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 7.32% (0.3267 => 0.3506, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.31% (0.3845 => 0.4126, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.28% (0.3930 => 0.4216, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 7.27% (1.0781 => 1.1565, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary2: 7.27% (0.3317 => 0.3558, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.26% (0.2866 => 0.3074, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.25% (0.3282 => 0.3520, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.20% (0.3124 => 0.3349, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 7.19% (0.3477 => 0.3727, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 7.17% (4.2109 => 4.5129, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash2: 7.15% (0.4251 => 0.4555, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 7.14% (0.3348 => 0.3587, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.10% (0.1549 => 0.1659, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.10% (4.4195 => 4.7333, std.dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: 7.09% (23.5202 => 25.1886, std.dev.: 0.0086) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.08% (2.7292 => 2.9224, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.05% (0.5900 => 0.6316, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.02% (0.3903 => 0.4177, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.01% (0.4139 => 0.4429, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.98% (0.1462 => 0.1564, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 6.92% (0.4029 => 0.4308, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 6.91% (1.8794 => 2.0093, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.91% (0.3690 => 0.3945, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.87% (0.3084 => 0.3296, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.87% (0.2737 => 0.2925, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.84% (0.3890 => 0.4156, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 6.77% (0.3336 => 0.3562, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.77% (0.2068 => 0.2208, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.76% (0.6435 => 0.6870, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.76% (0.3981 => 0.4250, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 6.64% (0.5012 => 0.5345, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 6.64% (0.5546 => 0.5914, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 6.63% (1.4269 => 1.5215, std.dev.: 0.0227) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.60% (0.2969 => 0.3165, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.55% (0.1968 => 0.2097, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.51% (0.2103 => 0.2240, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 6.49% (2.1013 => 2.2376, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.46% (0.4658 => 0.4959, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.42% (0.3271 => 0.3481, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 6.35% (0.9697 => 1.0313, std.dev.: 0.0026) MultiSource/Applications/SIBsim4/SIBsim4: 6.32% (0.2691 => 0.2861, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.26% (0.7426 => 0.7891, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 6.14% (4.6177 => 4.9014, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.08% (0.2040 => 0.2164, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 6.02% (0.2075 => 0.2200, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 5.99% (2.1653 => 2.2951, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.97% (0.5361 => 0.5681, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 5.93% (2.0346 => 2.1552, std.dev.: 0.0030) MultiSource/Applications/treecc/treecc: 5.90% (0.7875 => 0.8340, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.85% (1.9694 => 2.0846, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 5.65% (0.2391 => 0.2526, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.54% (1.9966 => 2.1073, std.dev.: 0.0059) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.54% (11.6398 => 12.2848, std.dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.39% (0.5584 => 0.5885, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 4.77% (0.3498 => 0.3665, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.63% (4.6926 => 4.9098, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.88% (0.4253 => 0.4418, std.dev.: 0.0038) MultiSource/Applications/kimwitu++/kc: 3.40% (11.9555 => 12.3624, std.dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6114, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (12.0509 => 12.6695, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/flops-2: 4.85% (1.8057 => 1.8932, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1675, std.dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/dry: 4.22% (14.0481 => 14.6414, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1959, std.dev.: 0.0038) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.65% (3.1722 => 3.2246, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.48% (7.1849 => 7.2915, std.dev.: 0.0024) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3046, std.dev.: 0.0138) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5147, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5814, std.dev.: 0.0690) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.75% (25.4195 => 16.5864, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/ary2: -7.95% (0.2402 => 0.2211, std.dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9754, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8018, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9575, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.59% (11.2080 => 10.8054, std.dev.: 0.0133) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7735, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -2.97% (17.2379 => 16.7263, std.dev.: 0.0621) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5189, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8615, std.dev.: 0.0144) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.05% (0.6293 => 0.6164, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5729, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4958, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.08% (105.3826 => 104.2430, std.dev.: 0.0238) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0430, std.dev.: 0.0039) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 12 16:49:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 12 Oct 2012 18:49:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121012234900.070FB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4831?compare_to=4829&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4831, Order: 165827, Start Time: 2012-10-12 22:24:58, End Time: 2012-10-12 23:50:48 To: 4829, Order: 165816, Start Time: 2012-10-12 20:27:03, End Time: 2012-10-12 21:53:02 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (188 on baseline) Performance Improvements: 3 (38 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1039 (678 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.26% (2.5184 => 2.4867, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.19% (0.9658 => 0.9543, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.54% (80.8926 => 78.0266, std.dev.: 1.0152) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.25% (2.0176 => 2.4867, std.dev.: 0.0060) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.58% (0.1410 => 0.1672, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 17.07% (0.0826 => 0.0967, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 16.99% (0.2243 => 0.2624, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.85% (0.0653 => 0.0763, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.21% (0.1072 => 0.1235, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 14.31% (0.1062 => 0.1214, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/tsp/tsp: 14.12% (0.1013 => 0.1156, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.64% (0.0770 => 0.0875, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.56% (0.1327 => 0.1507, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.55% (0.0834 => 0.0947, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 13.28% (1.3693 => 1.5511, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.16% (0.1413 => 0.1599, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 13.07% (0.7038 => 0.7958, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 13.05% (0.2721 => 0.3076, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.76% (3.9660 => 4.4722, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.75% (0.7710 => 0.8693, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.66% (0.1588 => 0.1789, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.66% (0.0964 => 0.1086, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.48% (0.2596 => 0.2920, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.29% (0.9199 => 1.0330, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 12.25% (0.4328 => 0.4858, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 12.14% (0.4062 => 0.4555, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.09% (1.4563 => 1.6323, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.90% (0.6959 => 0.7787, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 11.87% (13.8202 => 15.4609, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.87% (1.2193 => 1.3640, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.84% (0.6283 => 0.7027, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.83% (0.5265 => 0.5888, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 11.67% (0.1003 => 0.1120, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 11.64% (0.1589 => 0.1774, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 11.58% (0.5818 => 0.6492, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.47% (1.1364 => 1.2668, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 11.46% (0.5748 => 0.6407, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.28% (0.3899 => 0.4339, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.22% (0.3022 => 0.3361, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 11.10% (0.7061 => 0.7845, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 11.02% (1.0313 => 1.1450, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.02% (0.3130 => 0.3475, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 11.00% (1.1061 => 1.2278, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.98% (0.1157 => 0.1284, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.88% (0.1075 => 0.1192, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.81% (0.5577 => 0.6180, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.81% (0.3756 => 0.4162, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 10.80% (0.2925 => 0.3241, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.75% (0.4791 => 0.5306, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 10.67% (16.6129 => 18.3849, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.64% (0.0977 => 0.1081, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 10.61% (0.2781 => 0.3076, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.61% (0.4016 => 0.4442, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.60% (0.2914 => 0.3223, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.59% (0.3485 => 0.3854, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.48% (0.4379 => 0.4838, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.47% (0.1986 => 0.2194, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 10.42% (0.6744 => 0.7447, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.40% (0.2655 => 0.2931, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.39% (0.3580 => 0.3952, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 10.38% (3.8646 => 4.2659, std.dev.: 0.0096) MultiSource/Applications/sgefa/sgefa: 10.38% (0.2995 => 0.3306, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.36% (0.1014 => 0.1119, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 10.35% (0.1111 => 0.1226, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.35% (0.3489 => 0.3850, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 10.34% (0.3220 => 0.3553, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.32% (0.4390 => 0.4843, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 10.23% (0.3293 => 0.3630, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.23% (0.3246 => 0.3578, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.16% (0.7460 => 0.8218, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.16% (0.2127 => 0.2343, std.dev.: 0.0019) MultiSource/Applications/spiff/spiff: 10.10% (0.7506 => 0.8264, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.08% (0.5637 => 0.6205, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.06% (0.2782 => 0.3062, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.05% (0.2966 => 0.3264, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 10.04% (3.1889 => 3.5091, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.03% (0.1865 => 0.2052, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 10.01% (0.3868 => 0.4255, std.dev.: 0.0040) MultiSource/Applications/treecc/treecc: 9.96% (1.9270 => 2.1190, std.dev.: 0.0041) MultiSource/Applications/viterbi/viterbi: 9.95% (0.1478 => 0.1625, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.92% (0.8698 => 0.9561, std.dev.: 0.0067) MultiSource/Applications/siod/siod: 9.90% (2.1791 => 2.3948, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 9.88% (0.8310 => 0.9131, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sieve: 9.88% (0.3453 => 0.3794, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.87% (1.9828 => 2.1786, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/strcat: 9.83% (0.2726 => 0.2994, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.79% (0.2023 => 0.2221, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 9.73% (1.0594 => 1.1625, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 9.69% (0.3107 => 0.3408) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.69% (0.1435 => 0.1574, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 9.65% (0.3149 => 0.3453, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.65% (7.2180 => 7.9142, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/except: 9.60% (0.2760 => 0.3025, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 9.59% (0.2690 => 0.2948, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 9.57% (0.2937 => 0.3218, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 9.56% (0.2761 => 0.3025, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.56% (0.1276 => 0.1398, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.55% (0.6576 => 0.7204, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.55% (0.2765 => 0.3029, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 9.51% (0.2607 => 0.2855, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 9.51% (0.3534 => 0.3870, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.43% (0.1569 => 0.1717, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.42% (4.9865 => 5.4560, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/em3d/em3d: 9.41% (0.1657 => 0.1813, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/fibo: 9.40% (0.2628 => 0.2875, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.34% (0.3511 => 0.3839, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 9.34% (0.3192 => 0.3490, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 9.27% (0.2988 => 0.3265, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.20% (0.2696 => 0.2944, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.00% (3.6692 => 3.9995, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.96% (1.3245 => 1.4432, std.dev.: 0.0099) MultiSource/Benchmarks/sim/sim: 8.91% (0.3131 => 0.3410, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.87% (4.3801 => 4.7685, std.dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 8.86% (1.2749 => 1.3879, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.79% (4.4433 => 4.8339, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.74% (0.6135 => 0.6671, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 8.70% (14.8535 => 16.1453, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.63% (0.3755 => 0.4079, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 8.59% (0.2945 => 0.3198, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.55% (0.2140 => 0.2323, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 8.51% (8.4961 => 9.2191, std.dev.: 0.0116) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.44% (0.1789 => 0.1940, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.33% (1.5188 => 1.6453, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.22% (0.8818 => 0.9543, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 8.07% (4.6629 => 5.0394, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.06% (0.2321 => 0.2508, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.99% (1.1333 => 1.2238, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/05-eks/eks: 7.95% (0.4113 => 0.4440, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.91% (3.2742 => 3.5333, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.85% (0.9108 => 0.9823, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 7.77% (0.4003 => 0.4314, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 7.73% (0.1385 => 0.1492, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.72% (0.4805 => 0.5176, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 7.71% (0.6250 => 0.6732, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 7.69% (6.5754 => 7.0811, std.dev.: 0.0107) MultiSource/Applications/lua/lua: 7.60% (3.7467 => 4.0316, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/exceptions: 7.49% (0.3914 => 0.4207, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.44% (0.3940 => 0.4233, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.43% (0.2504 => 0.2690, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.33% (0.3245 => 0.3483, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.27% (0.3578 => 0.3838, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.18% (0.3650 => 0.3912, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 7.17% (0.2008 => 0.2152, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 7.15% (0.3789 => 0.4060, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.13% (0.3646 => 0.3906, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 7.12% (1.2292 => 1.3167, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.11% (2.1007 => 2.2501, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-2: 7.11% (0.3601 => 0.3857, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.07% (6.2785 => 6.7226, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/synchronized: 7.07% (0.3663 => 0.3922, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.01% (0.3623 => 0.3877, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.82% (0.1819 => 0.1943, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.70% (13.2842 => 14.1743, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/ReedSolomon: 6.64% (0.1777 => 0.1895, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.57% (0.2243 => 0.2368, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 4.98% (16.2614 => 17.0715, std.dev.: 0.0081) MultiSource/Applications/ClamAV/clamscan: 4.50% (14.5298 => 15.1832, std.dev.: 0.0090) MultiSource/Benchmarks/Bullet/bullet: 2.18% (33.2944 => 34.0206, std.dev.: 0.0127) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.63% (5.7573 => 7.5208, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/fbench: 25.09% (1.8175 => 2.2736, std.dev.: 0.0377) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.05% (1.0895 => 1.3624, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 11.21% (1.1560 => 1.2856, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4142, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.22% (1.2998 => 1.3806, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.81% (0.3139 => 0.3290, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0044, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.86% (1.7081 => 1.7741, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6774, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9853, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 3.35% (10.7476 => 11.1072, std.dev.: 0.0014) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.10% (7.4271 => 7.5834, std.dev.: 0.0035) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4530, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5137, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2126, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1873, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5787, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0270, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 1.07% (12.4560 => 12.5893, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.82% (0.2670 => 0.1420, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.85% (0.4657 => 0.3919, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.08% (1.3819 => 1.2011, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.05% (1.3813 => 1.2011, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.33% (22.5627 => 22.2633, std.dev.: 0.0114) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.44% (0.0997 => 0.0863, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -12.11% (0.2238 => 0.1967, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: -10.87% (1.2308 => 1.0970, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.06% (20.3410 => 18.2950, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.46% (1.3780 => 1.3028, std.dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0051) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5147, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8005, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.76% (0.9996 => 0.9620, std.dev.: 0.0053) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1561, std.dev.: 0.0246) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.47% (1.7688 => 1.7075, std.dev.: 0.0032) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.96% (0.4867 => 0.4723, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.51% (26.5159 => 25.8502, std.dev.: 0.0084) MultiSource/Applications/spiff/spiff: -2.41% (3.0263 => 2.9533, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -2.39% (1.9762 => 1.9290, std.dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.88% (0.6589 => 0.6465, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7144, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/lists: -1.74% (6.3560 => 6.2453, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: -1.45% (4.5928 => 4.5264, std.dev.: 0.0126) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0070, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8655, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4955, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2569, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 12 16:50:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 12 Oct 2012 18:50:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121012235002.7304A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4832?compare_to=4830&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4832, Order: 165829, Start Time: 2012-10-12 22:31:48, End Time: 2012-10-12 23:51:49 To: 4830, Order: 165817, Start Time: 2012-10-12 20:39:03, End Time: 2012-10-12 21:58:57 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (163 on baseline) Performance Improvements: 2 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 950 (682 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 3.45% (0.4027 => 0.4166, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.62% (15.8098 => 15.5543, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.15% (2.2041 => 2.1788, std.dev.: 0.0025) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.18% (0.5949 => 0.5960, std.dev.: 0.0074) MultiSource/Applications/SPASS/SPASS: -0.09% (16.4393 => 16.4240, std.dev.: 0.0240) MultiSource/Benchmarks/Bullet/bullet: 0.11% (55.3820 => 55.4402, std.dev.: 0.0306) MultiSource/Benchmarks/MallocBench/gs/gs: 0.14% (4.4401 => 4.4463, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.43% (0.0462 => 0.0460, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.65% (0.0464 => 0.0461, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.46% (0.0432 => 0.0430, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.23% (0.0433 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.24% (0.0421 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.47% (0.0423 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.24% (0.0415 => 0.0414, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.24% (0.0416 => 0.0415, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.46% (0.0433 => 0.0431, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.23% (0.0434 => 0.0433, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.23% (0.0427 => 0.0426) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.23% (0.0428 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.24% (0.0417 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.24% (0.0419 => 0.0418) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.47% (0.0425 => 0.0423, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.47% (0.0426 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.46% (0.0436 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.44% (0.0450 => 0.0439, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.24% (0.0412 => 0.0411, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.24% (0.0413 => 0.0412, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.24% (0.0424 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.47% (0.0426 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.48% (0.0416 => 0.0414, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.48% (0.0417 => 0.0415, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.25% (0.0408 => 0.0407, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.24% (0.0409 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0406 => 0.0406, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.49% (0.0409 => 0.0407) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.45% (0.0444 => 0.0442, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.45% (0.0445 => 0.0443, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.49% (0.0406 => 0.0404, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.49% (0.0407 => 0.0405, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.25% (0.0406 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.49% (0.0408 => 0.0406, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.48% (0.0415 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.48% (0.0416 => 0.0414, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (1.2605 => 1.2605, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.24% (7.8681 => 7.8490, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.46% (0.7418 => 0.7384, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.82% (0.0365 => 0.0362, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1432 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.15% (0.0667 => 0.0646, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.34% (63.2438 => 55.4402, std.dev.: 0.0306) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.17% (14.1553 => 18.9928, std.dev.: 0.0159) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.48% (3.4629 => 5.6611, std.dev.: 0.0060) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14232.50% (0.0720 => 10.3194, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9951900.00% (0.0001 => 9.9520, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.63% (0.2554 => 0.4179, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 50.03% (10.3673 => 15.5543, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/richards_benchmark: 40.14% (0.1622 => 0.2273, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 34.00% (0.1056 => 0.1415, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 18.44% (0.1432 => 0.1696, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.68% (7.0540 => 8.3009, std.dev.: 0.0182) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.00% (2.2022 => 2.5766, std.dev.: 0.0049) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.33% (0.1566 => 0.1806, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.24% (1.7609 => 1.9940, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 12.99% (0.1440 => 0.1627, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.86% (0.0871 => 0.0983, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 12.74% (0.3282 => 0.3700, std.dev.: 0.0014) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.34% (0.1143 => 0.1284, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.99% (0.1584 => 0.1774, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 11.73% (10.4361 => 11.6598, std.dev.: 0.0094) MultiSource/Applications/lambda-0_1_3/lambda: 10.83% (0.7433 => 0.8238, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.58% (0.4879 => 0.5395, std.dev.: 0.0037) MultiSource/Applications/minisat/minisat: 10.51% (0.7115 => 0.7863, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/trivial-interface: 10.48% (0.3473 => 0.3837, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.47% (0.3927 => 0.4338, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.44% (0.3543 => 0.3913, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.36% (0.1438 => 0.1587, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 10.31% (0.3561 => 0.3928, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.30% (0.3516 => 0.3878, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.29% (0.3497 => 0.3857, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.28% (0.1625 => 0.1792, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-4: 10.27% (0.3543 => 0.3907, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.26% (0.2700 => 0.2977, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 10.23% (9.4845 => 10.4551, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/property: 10.22% (0.3886 => 0.4283, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 10.19% (0.3828 => 0.4218, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.17% (0.3177 => 0.3500, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.09% (1.5415 => 1.6971, std.dev.: 0.0044) SingleSource/Benchmarks/McGill/chomp: 10.09% (0.1655 => 0.1822, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 10.07% (0.3694 => 0.4066, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 10.04% (0.1175 => 0.1293, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.98% (0.6675 => 0.7341, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 9.87% (3.3354 => 3.6646, std.dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: 9.59% (0.3109 => 0.3407, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 9.56% (0.1695 => 0.1857, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 9.52% (0.3423 => 0.3749, std.dev.: 0.0018) MultiSource/Applications/aha/aha: 9.47% (0.1151 => 0.1260, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.47% (0.4615 => 0.5052, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.42% (0.5105 => 0.5586, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.33% (0.1940 => 0.2121, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.30% (0.1236 => 0.1351, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 9.23% (5.7591 => 6.2909, std.dev.: 0.0142) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.23% (4.2646 => 4.6583, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.16% (0.5860 => 0.6397, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.15% (1.3050 => 1.4244, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.07% (0.1510 => 0.1647, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 9.07% (1.1642 => 1.2698, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.98% (0.2271 => 0.2475, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.94% (0.8067 => 0.8788, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.92% (8.1363 => 8.8619, std.dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.91% (0.5569 => 0.6065, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.88% (0.8172 => 0.8898, std.dev.: 0.0035) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.84% (0.3121 => 0.3397, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.83% (0.2107 => 0.2293, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.83% (5.0018 => 5.4433, std.dev.: 0.0070) MultiSource/Applications/lua/lua: 8.78% (3.8723 => 4.2122, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.77% (4.9449 => 5.3785, std.dev.: 0.0091) MultiSource/Applications/viterbi/viterbi: 8.75% (0.1555 => 0.1691, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.74% (0.2758 => 0.2999, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 8.69% (0.7835 => 0.8516, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/mst/mst: 8.68% (0.1163 => 0.1264, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.67% (0.2065 => 0.2244, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.65% (0.9765 => 1.0610, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 8.55% (1.0722 => 1.1639, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.42% (7.9617 => 8.6323, std.dev.: 0.0053) MultiSource/Applications/hbd/hbd: 8.39% (1.5603 => 1.6912, std.dev.: 0.0060) MultiSource/Applications/treecc/treecc: 8.35% (2.0273 => 2.1965, std.dev.: 0.0038) MultiSource/Benchmarks/sim/sim: 8.33% (0.3387 => 0.3669, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.09% (0.5020 => 0.5426, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.08% (0.1337 => 0.1445, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.96% (1.5859 => 1.7121, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 7.96% (0.3180 => 0.3433, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.93% (0.3441 => 0.3714, std.dev.: 0.0022) MultiSource/Applications/siod/siod: 7.93% (2.2969 => 2.4791, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.89% (0.3307 => 0.3568, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 7.79% (0.6456 => 0.6959, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.76% (1.1861 => 1.2782, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.68% (0.5925 => 0.6380, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.66% (0.6030 => 0.6492, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 7.49% (21.9371 => 23.5811, std.dev.: 0.0158) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.45% (0.2603 => 0.2797, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.32% (0.6450 => 0.6922, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.31% (0.4103 => 0.4403, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/05-eks/eks: 7.21% (0.4299 => 0.4609, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 7.14% (0.8921 => 0.9558, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.03% (0.4636 => 0.4962, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 6.96% (0.7326 => 0.7836, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.94% (2.2024 => 2.3553, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.86% (0.5981 => 0.6391, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.70% (0.3865 => 0.4124, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.56% (1.4186 => 1.5116, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.52% (0.4203 => 0.4477, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.49% (0.3650 => 0.3887, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.48% (0.3826 => 0.4074, std.dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 6.44% (1.1840 => 1.2602, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 6.41% (0.4289 => 0.4564, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.37% (0.1695 => 0.1803, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.35% (0.2266 => 0.2410, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.34% (0.3422 => 0.3639, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.08% (0.4620 => 0.4901, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.03% (0.1906 => 0.2021, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 5.90% (0.4048 => 0.4287, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.74% (0.3136 => 0.3316, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.66% (0.1892 => 0.1999, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.62% (0.3684 => 0.3891, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 5.61% (0.3603 => 0.3805, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.57% (0.2891 => 0.3052, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.57% (0.3162 => 0.3338, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.55% (0.8101 => 0.8551, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 5.47% (0.2905 => 0.3064, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.43% (2.0665 => 2.1788, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/matrix: 5.39% (0.3098 => 0.3265, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/strcat: 5.33% (0.2831 => 0.2982, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.33% (14.3668 => 15.1321, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/ReedSolomon: 5.12% (0.2049 => 0.2154, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.12% (0.2756 => 0.2897, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.08% (0.3052 => 0.3207, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.06% (0.2725 => 0.2863, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.00% (0.3283 => 0.3447, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: 4.98% (0.2871 => 0.3014, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.94% (0.2872 => 0.3014, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 4.94% (0.2793 => 0.2931, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 4.94% (0.2877 => 0.3019, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 4.90% (0.2714 => 0.2847, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 4.89% (0.2802 => 0.2939, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.82% (0.4064 => 0.4260, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.73% (0.3427 => 0.3589, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 4.63% (17.1811 => 17.9769, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/ary2: 4.56% (0.3379 => 0.3533, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.28% (0.2430 => 0.2534, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.26% (3.8922 => 4.0582, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/objinst: 3.96% (0.3131 => 0.3255, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.92% (1.2842 => 1.3345, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.37% (1.1194 => 1.1571, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 3.23% (0.3092 => 0.3192, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.78% (0.3817 => 0.3923, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8962, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.94% (1.1396 => 1.2529, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560) MultiSource/Applications/aha/aha: 9.20% (3.1595 => 3.4501, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.71% (3.1578 => 3.3697, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.65% (0.3463 => 0.3624, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.53% (3.6395 => 3.7680, std.dev.: 0.0032) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.67% (4.2280 => 4.3408, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.33% (1.7254 => 1.7656, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8126, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.34% (2.6546 => 2.6902, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.11% (6.5088 => 6.5810, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.03% (6.6874 => 0.1316, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -79.92% (0.8651 => 0.1737, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.09% (5.2763 => 3.2663, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.37% (5.3855 => 3.6962, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.97% (5.3526 => 3.6950, std.dev.: 0.0051) SingleSource/UnitTests/Vector/constpool: -14.42% (54.1659 => 46.3542, std.dev.: 0.0280) MultiSource/Applications/ClamAV/clamscan: -12.11% (22.1758 => 19.4906, std.dev.: 0.0317) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.23% (2.9384 => 2.6379, std.dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.36% (1.1492 => 0.7658, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: -15.84% (1.6925 => 1.4244, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.73% (0.0998 => 0.0861, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.20% (1.2373 => 1.0987, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: -10.61% (1.5373 => 1.3742, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/mason/mason: -10.00% (0.2161 => 0.1945, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.37% (19.9488 => 18.2782, std.dev.: 0.0157) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.75% (1.8329 => 1.7092, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.29% (1.6805 => 1.5916, std.dev.: 0.0038) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7963, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.88% (1.5835 => 1.5062, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Applications/siod/siod: -3.63% (3.2827 => 3.1636, std.dev.: 0.0076) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5023, std.dev.: 0.0096) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0992, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.12% (8.6802 => 8.4966, std.dev.: 0.0132) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.02% (8.1563 => 7.9915, std.dev.: 0.0244) SingleSource/Benchmarks/Misc/salsa20: -1.98% (10.2830 => 10.0799, std.dev.: 0.0115) SingleSource/UnitTests/Vector/multiplies: -1.81% (2.5528 => 2.5066, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6812, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4212, std.dev.: 0.0082) MultiSource/Applications/sqlite3/sqlite3: -1.09% (4.6441 => 4.5937, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8566, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.00% (6.2999 => 6.2369, std.dev.: 0.0041) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.98% (0.5229 => 0.5960, std.dev.: 0.0074) MultiSource/Applications/SPASS/SPASS: 9.57% (14.9895 => 16.4240, std.dev.: 0.0240) MultiSource/Benchmarks/MallocBench/gs/gs: 8.17% (4.1105 => 4.4463, std.dev.: 0.0104) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.09% (1.1048 => 1.2605, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.65% (7.1582 => 7.8490, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.68% (0.6222 => 0.7384, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36100.00% (0.0001 => 0.0362, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.47% (0.2116 => 0.0646, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 12 22:59:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 13 Oct 2012 00:59:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121013055902.889D82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4836?compare_to=4835&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4836, Order: 165859, Start Time: 2012-10-13 04:36:20, End Time: 2012-10-13 06:01:52 To: 4835, Order: 165853, Start Time: 2012-10-13 00:21:10, End Time: 2012-10-13 01:47:03 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (186 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1041 (679 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.21% (7.9612 => 8.0574, std.dev.: 0.0019) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.54% (2.0176 => 2.4925, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.44% (0.1410 => 0.1670, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.61% (0.0653 => 0.0768, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 17.19% (0.0826 => 0.0968, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 16.99% (0.2243 => 0.2624, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.70% (0.1072 => 0.1251, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 14.31% (0.1013 => 0.1158, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.67% (0.0834 => 0.0948, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.64% (0.1327 => 0.1508, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.45% (0.1413 => 0.1603, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 13.27% (0.7038 => 0.7972, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.97% (0.0964 => 0.1089, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.85% (3.9660 => 4.4756, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.85% (0.1588 => 0.1792, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 12.74% (1.3693 => 1.5437, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.72% (0.2721 => 0.3067, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.21% (0.2596 => 0.2913, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.21% (0.9199 => 1.0322, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 12.15% (0.1062 => 0.1191, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 12.11% (0.4328 => 0.4852, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.11% (1.4563 => 1.6326, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.10% (0.6959 => 0.7801, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 12.07% (13.8202 => 15.4889, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.97% (1.2193 => 1.3652, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.88% (0.7710 => 0.8626, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/power/power: 11.86% (0.1003 => 0.1122, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.84% (0.6283 => 0.7027, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.79% (0.5265 => 0.5886, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 11.67% (0.4062 => 0.4536, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.54% (1.1364 => 1.2675, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.46% (0.3899 => 0.4346, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 11.33% (1.0313 => 1.1481, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.25% (0.3130 => 0.3482, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.15% (0.1157 => 0.1286, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 11.05% (1.1061 => 1.2283, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: 11.00% (0.5818 => 0.6458, std.dev.: 0.0069) MultiSource/Applications/kimwitu++/kc: 10.96% (16.6129 => 18.4345, std.dev.: 0.0249) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.93% (0.3485 => 0.3866, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.93% (0.4016 => 0.4455, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 10.82% (0.2781 => 0.3082, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 10.81% (0.3293 => 0.3649, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.79% (0.1075 => 0.1191, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.78% (0.3756 => 0.4161, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.78% (0.5577 => 0.6178, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.77% (0.4791 => 0.5307, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.72% (0.3022 => 0.3346, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 10.68% (0.5748 => 0.6362, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.64% (0.2782 => 0.3078, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.54% (0.0977 => 0.1080, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.53% (0.3580 => 0.3957, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 10.53% (0.6744 => 0.7454, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.53% (0.4379 => 0.4840, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.47% (0.3246 => 0.3586, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 10.47% (0.7061 => 0.7800, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.43% (0.3489 => 0.3853, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 10.39% (3.8646 => 4.2661, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/moments: 10.37% (0.3868 => 0.4269, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.35% (0.2966 => 0.3273, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 10.33% (0.3107 => 0.3428, std.dev.: 0.0032) MultiSource/Applications/sgefa/sgefa: 10.32% (0.2995 => 0.3304, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 10.31% (0.3220 => 0.3552, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.28% (0.2655 => 0.2928, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 10.27% (3.1889 => 3.5164, std.dev.: 0.0079) MultiSource/Applications/siod/siod: 10.26% (2.1791 => 2.4027, std.dev.: 0.0035) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.26% (0.2914 => 0.3213, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 10.26% (0.1589 => 0.1752, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 10.19% (1.9270 => 2.1233, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 10.17% (0.1111 => 0.1224, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 10.16% (0.2726 => 0.3003, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.16% (0.2127 => 0.2343, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 10.09% (0.2925 => 0.3220, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.08% (0.1865 => 0.2053, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 10.07% (0.8310 => 0.9147, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.07% (0.4390 => 0.4832, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/ary3: 10.07% (0.3149 => 0.3466, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.02% (0.1986 => 0.2185, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.01% (0.5637 => 0.6201, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 10.00% (0.2690 => 0.2959, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.00% (1.9828 => 2.1810, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 9.99% (0.3453 => 0.3798, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 9.95% (0.1478 => 0.1625, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.94% (0.8698 => 0.9563, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 9.93% (0.2607 => 0.2866, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 9.93% (0.7506 => 0.8251, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/methcall: 9.92% (0.2761 => 0.3035, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 9.90% (0.3192 => 0.3508, std.dev.: 0.0032) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.90% (0.1435 => 0.1577, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.89% (0.2023 => 0.2223, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.88% (0.7460 => 0.8197, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists1: 9.85% (0.3534 => 0.3882, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 9.84% (0.2937 => 0.3226, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.80% (0.2765 => 0.3036, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.79% (7.2180 => 7.9248, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/fibo: 9.78% (0.2628 => 0.2885, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 9.75% (0.2760 => 0.3029, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.57% (0.2696 => 0.2954, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 9.48% (1.0594 => 1.1598, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.40% (0.1276 => 0.1396, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.37% (0.1569 => 0.1716, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 9.35% (0.1657 => 0.1812, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.34% (4.9865 => 5.4524, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/matrix: 9.27% (0.2988 => 0.3265, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.10% (1.3245 => 1.4450, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 9.07% (0.2945 => 0.3212, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 8.98% (1.2749 => 1.3894, std.dev.: 0.0024) MultiSource/Benchmarks/sim/sim: 8.94% (0.3131 => 0.3411, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.92% (0.3755 => 0.4090, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 8.85% (14.8535 => 16.1687, std.dev.: 0.0171) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.84% (4.3801 => 4.7671, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.82% (3.6692 => 3.9929, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.81% (4.4433 => 4.8349, std.dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.60% (0.3511 => 0.3813, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 8.47% (0.4003 => 0.4342, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 8.45% (8.4961 => 9.2136, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.44% (0.2321 => 0.2517, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.44% (0.6135 => 0.6653, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.36% (0.2140 => 0.2319, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.33% (0.1789 => 0.1938, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.26% (1.5188 => 1.6442, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 8.14% (4.6629 => 5.0425, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/exceptions: 8.12% (0.3914 => 0.4232, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.12% (0.3940 => 0.4260, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.09% (0.8818 => 0.9531, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/for-in: 8.08% (0.3789 => 0.4095, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.05% (1.1333 => 1.2245, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/synchronized: 7.97% (0.3663 => 0.3955, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.97% (0.9108 => 0.9834, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 7.97% (0.3578 => 0.3863, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.95% (3.2742 => 3.5344, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-4: 7.90% (0.3646 => 0.3934, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.83% (0.3601 => 0.3883, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 7.81% (6.5754 => 7.0892, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/05-eks/eks: 7.78% (0.4113 => 0.4433, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.77% (0.3245 => 0.3497, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.76% (0.3623 => 0.3904, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.76% (0.6576 => 0.7086, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.73% (0.3650 => 0.3932, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: 7.73% (0.1385 => 0.1492, std.dev.: 0.0037) MultiSource/Applications/lua/lua: 7.71% (3.7467 => 4.0354, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.68% (0.4805 => 0.5174, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 7.66% (0.6250 => 0.6729, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.43% (0.2504 => 0.2690, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.26% (2.1007 => 2.2533, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 7.26% (1.2292 => 1.3184, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 7.12% (0.2008 => 0.2151, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.00% (6.2785 => 6.7178, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.96% (13.2842 => 14.2090, std.dev.: 0.0139) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.38% (0.1819 => 0.1935, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.62% (0.2243 => 0.2369, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 5.24% (16.2614 => 17.1135, std.dev.: 0.0174) MultiSource/Applications/ClamAV/clamscan: 4.54% (14.5298 => 15.1899, std.dev.: 0.0143) MultiSource/Benchmarks/Bullet/bullet: 1.93% (33.2944 => 33.9370, std.dev.: 0.0242) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.65% (5.7573 => 7.5220, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.14% (1.8175 => 2.2563, std.dev.: 0.0280) SingleSource/Benchmarks/Misc/richards_benchmark: 11.06% (1.1560 => 1.2838, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.47% (0.1322 => 0.1434, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.48% (3.1736 => 3.4110, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 6.22% (1.2998 => 1.3807, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0039, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.88% (1.7081 => 1.7744, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6759, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.56% (10.7476 => 11.1302, std.dev.: 0.0292) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9854, std.dev.: 0.0007) SingleSource/Regression/C/uint64_to_float: 2.99% (0.5449 => 0.5612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.16% (7.4271 => 7.5874, std.dev.: 0.0045) MultiSource/Applications/lemon/lemon: 1.57% (1.4298 => 1.4523, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5134, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9673, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1879, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5780, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1413, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0267, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5900, std.dev.: 0.0074) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.74% (0.2670 => 0.1422, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.29% (0.4657 => 0.3945, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.33% (1.3819 => 1.1977, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.32% (1.3813 => 1.1973, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.26% (22.5627 => 22.2779, std.dev.: 0.0199) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.74% (0.0997 => 0.0860, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -12.15% (0.2238 => 0.1966, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.98% (1.2308 => 1.0956, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.09% (20.3410 => 18.2888, std.dev.: 0.0318) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.42% (1.3780 => 1.2895, std.dev.: 0.0151) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -5.10% (2.6470 => 2.5120, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8001, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.61% (0.9996 => 0.9635, std.dev.: 0.0074) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1560, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.47% (1.7688 => 1.7074, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.94% (0.4867 => 0.4724, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.64% (26.5159 => 25.8167, std.dev.: 0.0129) MultiSource/Applications/spiff/spiff: -2.54% (3.0263 => 2.9493, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.32% (1.9762 => 1.9303, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.97% (0.6589 => 0.6459, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7141, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.64% (6.3560 => 6.2520, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0064, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -1.42% (4.5928 => 4.5276, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8647, std.dev.: 0.0153) MultiSource/Applications/minisat/minisat: -1.22% (9.3358 => 9.2217, std.dev.: 0.0063) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.17% (2.5254 => 2.4959, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.08% (5.3167 => 5.2592, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 12 23:08:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 13 Oct 2012 01:08:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121013060841.140BD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4837?compare_to=4834&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4837, Order: 165859, Start Time: 2012-10-13 04:50:42, End Time: 2012-10-13 06:10:32 To: 4834, Order: 165853, Start Time: 2012-10-13 00:21:15, End Time: 2012-10-13 01:41:23 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (163 on baseline) Performance Improvements: 1 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 952 (682 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.36% (15.3025 => 15.0944, std.dev.: 0.0111) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.12% (0.5950 => 0.5943, std.dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: -0.29% (16.4201 => 16.3719, std.dev.: 0.0263) MultiSource/Benchmarks/Bullet/bullet: -0.14% (55.4647 => 55.3843, std.dev.: 0.0974) MultiSource/Benchmarks/MallocBench/gs/gs: -0.46% (4.4520 => 4.4316, std.dev.: 0.0294) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.64% (0.0466 => 0.0463, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.64% (0.0467 => 0.0464, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.23% (0.0434 => 0.0433) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.46% (0.0436 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.71% (0.0425 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.23% (0.0426 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.72% (0.0419 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.48% (0.0420 => 0.0418) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.69% (0.0437 => 0.0434, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.46% (0.0438 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.70% (0.0431 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.46% (0.0432 => 0.0430, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.71% (0.0421 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.47% (0.0422 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.47% (0.0428 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.47% (0.0429 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.68% (0.0440 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.45% (0.0441 => 0.0439, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.48% (0.0416 => 0.0414) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.48% (0.0417 => 0.0415) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.70% (0.0428 => 0.0425) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.47% (0.0429 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.48% (0.0419 => 0.0417, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.48% (0.0420 => 0.0418, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.49% (0.0411 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.49% (0.0412 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.49% (0.0410 => 0.0408) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.73% (0.0412 => 0.0409, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.45% (0.0447 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.45% (0.0448 => 0.0446, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.49% (0.0409 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.73% (0.0411 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.73% (0.0411 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.49% (0.0411 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.48% (0.0418 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.48% (0.0419 => 0.0417, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.38% (1.2625 => 1.2577, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.20% (7.8792 => 7.8632, std.dev.: 0.0177) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.08% (0.7461 => 0.7455, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.55% (0.0363 => 0.0365, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1432 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.82% (0.0658 => 0.0646, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.43% (63.2438 => 55.3843, std.dev.: 0.0974) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 33.77% (14.1553 => 18.9361, std.dev.: 0.0134) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.26% (3.4629 => 5.6535, std.dev.: 0.0055) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14231.39% (0.0720 => 10.3186, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9951800.00% (0.0001 => 9.9519, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 62.96% (0.2554 => 0.4162, std.dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: 45.60% (10.3673 => 15.0944, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/richards_benchmark: 39.27% (0.1622 => 0.2259, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 33.62% (0.1056 => 0.1411, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 17.81% (0.1432 => 0.1687, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.78% (7.0540 => 8.3081, std.dev.: 0.0142) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.28% (2.2022 => 2.5828, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.88% (0.1566 => 0.1799, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.86% (0.0871 => 0.0983, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.62% (1.7609 => 1.9832, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/oourafft: 12.61% (0.3282 => 0.3696, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: 12.36% (0.1440 => 0.1618, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.62% (0.1584 => 0.1768, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 11.30% (10.4361 => 11.6149, std.dev.: 0.0244) SingleSource/UnitTests/ObjC/trivial-interface: 11.26% (0.3473 => 0.3864, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.18% (0.3543 => 0.3939, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: 11.13% (0.3927 => 0.4364, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 11.12% (0.3497 => 0.3886, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.06% (0.3543 => 0.3935, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 11.01% (0.3561 => 0.3953, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.01% (0.3516 => 0.3903, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.85% (0.1143 => 0.1267, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.80% (0.3694 => 0.4093, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.76% (0.3828 => 0.4240, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.76% (0.3886 => 0.4304, std.dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: 10.59% (0.7433 => 0.8220, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.53% (0.4879 => 0.5393, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 10.25% (0.7115 => 0.7844, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.15% (0.1625 => 0.1790, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.15% (0.1438 => 0.1584, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.07% (0.6675 => 0.7347, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 9.91% (9.4845 => 10.4240, std.dev.: 0.0112) MultiSource/Benchmarks/Olden/tsp/tsp: 9.79% (0.1175 => 0.1290, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.78% (0.2700 => 0.2964, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.66% (0.3177 => 0.3484, std.dev.: 0.0026) MultiSource/Applications/d/make_dparser: 9.54% (3.3354 => 3.6537, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/em3d/em3d: 9.50% (0.1695 => 0.1856, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: 9.49% (0.1655 => 0.1812, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.48% (1.5415 => 1.6876, std.dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.47% (0.4615 => 0.5052, std.dev.: 0.0029) MultiSource/Applications/sgefa/sgefa: 9.39% (0.3109 => 0.3401, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 9.35% (0.3423 => 0.3743, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.11% (0.5105 => 0.5570, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.03% (0.5860 => 0.6389, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.97% (4.2646 => 4.6471, std.dev.: 0.0066) MultiSource/Applications/aha/aha: 8.95% (0.1151 => 0.1254, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.94% (0.1510 => 0.1645, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.94% (0.2271 => 0.2474, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.87% (1.3050 => 1.4207, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.86% (0.2065 => 0.2248, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/mst/mst: 8.86% (0.1163 => 0.1266, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.84% (0.8172 => 0.8894, std.dev.: 0.0126) MultiSource/Applications/viterbi/viterbi: 8.81% (0.1555 => 0.1692, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.78% (0.5569 => 0.6058, std.dev.: 0.0066) MultiSource/Applications/hbd/hbd: 8.77% (1.5603 => 1.6972, std.dev.: 0.0165) MultiSource/Applications/Burg/burg: 8.75% (1.1642 => 1.2661, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.74% (0.1236 => 0.1344, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.73% (0.2107 => 0.2291, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 8.72% (5.7591 => 6.2614, std.dev.: 0.0165) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.71% (0.1940 => 0.2109, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.69% (5.0018 => 5.4365, std.dev.: 0.0171) SingleSource/UnitTests/ObjC++/Hello: 8.66% (0.5925 => 0.6438, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.66% (8.1363 => 8.8407, std.dev.: 0.0106) SingleSource/UnitTests/ObjC++/property-reference-object: 8.64% (0.6030 => 0.6551, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.64% (4.9449 => 5.3719, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.55% (0.8067 => 0.8757, std.dev.: 0.0094) MultiSource/Applications/lua/lua: 8.55% (3.8723 => 4.2033, std.dev.: 0.0183) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.45% (0.2758 => 0.2991, std.dev.: 0.0042) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.43% (0.3121 => 0.3384, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.41% (0.3307 => 0.3585, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 8.40% (0.7835 => 0.8493, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.38% (0.9765 => 1.0583, std.dev.: 0.0042) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.27% (7.9617 => 8.6203, std.dev.: 0.0150) SingleSource/Benchmarks/Misc-C++/bigfib: 8.27% (0.6456 => 0.6990, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.23% (0.5020 => 0.5433, std.dev.: 0.0033) MultiSource/Applications/lemon/lemon: 8.17% (1.0722 => 1.1598, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 8.12% (0.3387 => 0.3662, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 8.08% (2.0273 => 2.1911, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.02% (0.4103 => 0.4432, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 7.97% (0.1268 => 0.1369, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.86% (0.7326 => 0.7902, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.85% (0.1337 => 0.1442, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.80% (0.4203 => 0.4531, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 7.70% (0.3180 => 0.3425, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.66% (0.3865 => 0.4161, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.62% (1.5859 => 1.7068, std.dev.: 0.0028) MultiSource/Applications/siod/siod: 7.54% (2.2969 => 2.4700, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/hash: 7.53% (0.4289 => 0.4612, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.47% (0.3441 => 0.3698, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.46% (1.1861 => 1.2746, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists: 7.45% (0.3422 => 0.3677, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 7.36% (0.4620 => 0.4960, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.32% (0.3650 => 0.3917, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.24% (0.3826 => 0.4103, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.11% (0.2603 => 0.2788, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 7.06% (21.9371 => 23.4853, std.dev.: 0.0297) SingleSource/Benchmarks/Shootout-C++/moments: 7.04% (0.4048 => 0.4333, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.02% (0.2891 => 0.3094, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.01% (0.4636 => 0.4961, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/sieve: 6.97% (0.3603 => 0.3854, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.89% (0.3136 => 0.3352, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.88% (0.2905 => 0.3105, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.87% (0.6450 => 0.6893, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.86% (0.5981 => 0.6391, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/strcat: 6.85% (0.2831 => 0.3025, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 6.84% (0.8921 => 0.9531, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.83% (0.3162 => 0.3378, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 6.82% (0.4299 => 0.4592, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.71% (2.2024 => 2.3501, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 6.70% (0.3684 => 0.3931, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.61% (0.2725 => 0.2905, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 6.58% (0.2871 => 0.3060, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.56% (2.0665 => 2.2020, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.55% (0.2872 => 0.3060, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.53% (0.2756 => 0.2936, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 6.53% (0.2802 => 0.2985, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 6.50% (0.3232 => 0.3442, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.48% (0.2793 => 0.2974, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 6.42% (0.3098 => 0.3297, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.39% (0.3052 => 0.3247, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 6.37% (0.2714 => 0.2887, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 6.31% (0.3283 => 0.3490, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.27% (1.4186 => 1.5075, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/methcall: 6.26% (0.2877 => 0.3057, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.19% (0.1695 => 0.1800, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 6.08% (1.1840 => 1.2560, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.03% (0.1906 => 0.2021, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.96% (0.2266 => 0.2401, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.83% (0.3379 => 0.3576, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.59% (0.4064 => 0.4291, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.39% (0.8101 => 0.8538, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (0.3131 => 0.3292, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.98% (14.3668 => 15.0821, std.dev.: 0.0117) MultiSource/Applications/hexxagon/hexxagon: 4.80% (1.2842 => 1.3459, std.dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: 4.39% (17.1811 => 17.9346, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.29% (0.3427 => 0.3574, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.12% (0.2430 => 0.2530, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.77% (3.8922 => 4.0391, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.48% (0.3817 => 0.3950, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.29% (1.1194 => 1.1562, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.83% (1.1396 => 1.2516, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.18% (3.1595 => 3.4496, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3682, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0013) SingleSource/Regression/C/uint64_to_float: 3.66% (0.5413 => 0.5611, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.35% (3.6395 => 3.7614, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.88% (4.2280 => 4.3498, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.56% (0.8275 => 0.8404, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8133, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.38% (0.9540 => 0.9672, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.15% (2.6546 => 2.6850, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.02% (9.1159 => 9.2088, std.dev.: 0.0300) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.00% (6.5088 => 6.5742, std.dev.: 0.0084) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1314, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: -79.97% (0.8651 => 0.1733, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.26% (5.2763 => 3.2576, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.17% (5.3855 => 3.7069, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.77% (5.3526 => 3.7056, std.dev.: 0.0069) SingleSource/UnitTests/Vector/constpool: -14.68% (54.1659 => 46.2132, std.dev.: 0.0262) MultiSource/Applications/ClamAV/clamscan: -12.27% (22.1758 => 19.4538, std.dev.: 0.0540) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.38% (2.9384 => 2.6335, std.dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7653, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4248, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.83% (0.0998 => 0.0860, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.46% (1.2373 => 1.0955, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/mandel-2: -10.28% (1.5373 => 1.3792, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -10.09% (0.2161 => 0.1943, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.34% (19.9488 => 18.2852, std.dev.: 0.0593) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.65% (1.8329 => 1.7110, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.29% (1.6805 => 1.5916, std.dev.: 0.0015) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5084, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.33% (0.9957 => 0.9526, std.dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.67% (3.2827 => 3.1623, std.dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.14% (32.5116 => 31.4904, std.dev.: 0.0104) MultiSource/Applications/hexxagon/hexxagon: -3.01% (12.4730 => 12.0977, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.00% (8.6802 => 8.5063, std.dev.: 0.0154) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.97% (8.1563 => 7.9954, std.dev.: 0.0169) SingleSource/Benchmarks/Misc/salsa20: -1.88% (10.2830 => 10.0896, std.dev.: 0.0162) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6801, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -1.62% (2.5528 => 2.5115, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4215, std.dev.: 0.0074) MultiSource/Applications/sqlite3/sqlite3: -1.15% (4.6441 => 4.5905, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443) SingleSource/Benchmarks/Shootout/lists: -1.04% (6.2999 => 6.2346, std.dev.: 0.0078) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.65% (0.5229 => 0.5943, std.dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: 9.22% (14.9895 => 16.3719, std.dev.: 0.0263) MultiSource/Benchmarks/MallocBench/gs/gs: 7.81% (4.1105 => 4.4316, std.dev.: 0.0294) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.84% (1.1048 => 1.2577, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.85% (7.1582 => 7.8632, std.dev.: 0.0177) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.82% (0.6222 => 0.7455, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36400.00% (0.0001 => 0.0365, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.47% (0.2116 => 0.0646, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 13 00:55:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 13 Oct 2012 02:55:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121013075525.8AAB92A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/4838?compare_to=4836&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4838, Order: 165867, Start Time: 2012-10-13 06:30:42, End Time: 2012-10-13 07:58:16 To: 4836, Order: 165859, Start Time: 2012-10-13 04:36:20, End Time: 2012-10-13 06:01:52 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (169 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1039 (697 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.90% (28.5174 => 29.6304, std.dev.: 0.0636) MultiSource/Applications/sqlite3/sqlite3: 2.18% (4.5276 => 4.6262, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/lists: -1.17% (6.2520 => 6.1790, std.dev.: 0.0274) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.44% (2.0176 => 2.4906, std.dev.: 0.0061) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.30% (0.1410 => 0.1668, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 17.43% (0.0826 => 0.0970, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.15% (0.0653 => 0.0765, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 16.58% (0.2243 => 0.2615, std.dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.04% (0.1072 => 0.1244, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/tsp/tsp: 14.22% (0.1013 => 0.1157, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.43% (0.0834 => 0.0946, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.38% (0.1413 => 0.1602, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 13.17% (0.7038 => 0.7965, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.11% (0.1327 => 0.1501, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 12.87% (1.3693 => 1.5455, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.82% (3.9660 => 4.4746, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.78% (0.1588 => 0.1791, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.55% (0.0964 => 0.1085, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.29% (0.2596 => 0.2915, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.20% (0.2721 => 0.3053, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.06% (1.4563 => 1.6320, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.06% (0.5265 => 0.5900, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 12.05% (13.8202 => 15.4856, std.dev.: 0.0176) MultiSource/Applications/aha/aha: 11.96% (0.1062 => 0.1189, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.96% (0.6959 => 0.7791, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.95% (0.9199 => 1.0298, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.89% (1.2193 => 1.3643, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.84% (0.7710 => 0.8623, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hash2: 11.74% (0.4328 => 0.4836, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.54% (1.1364 => 1.2675, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: 11.47% (0.1003 => 0.1118, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 11.30% (0.4062 => 0.4521, std.dev.: 0.0092) MultiSource/Applications/lemon/lemon: 11.23% (1.0313 => 1.1471, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.15% (0.3130 => 0.3479, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 11.09% (0.5818 => 0.6463, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.08% (0.3899 => 0.4331, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: 10.89% (1.1061 => 1.2266, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.83% (0.5577 => 0.6181, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 10.82% (0.5748 => 0.6370, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 10.80% (16.6129 => 18.4063, std.dev.: 0.0228) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.70% (0.1075 => 0.1190, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.67% (0.3485 => 0.3857, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.56% (0.4791 => 0.5297, std.dev.: 0.0122) SingleSource/UnitTests/ObjC++/property-reference: 10.49% (0.7061 => 0.7802, std.dev.: 0.0043) MultiSource/Applications/minisat/minisat: 10.39% (0.6744 => 0.7445, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.33% (0.4016 => 0.4431, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.32% (0.3246 => 0.3581, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 10.28% (0.2995 => 0.3303, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 10.27% (2.1791 => 2.4029, std.dev.: 0.0091) SingleSource/Benchmarks/McGill/chomp: 10.26% (0.1589 => 0.1752, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.24% (0.0977 => 0.1077, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.23% (0.4379 => 0.4827, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 10.23% (3.8646 => 4.2598, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.23% (0.3022 => 0.3331, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.20% (0.3489 => 0.3845, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 10.18% (1.9270 => 2.1232, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.16% (0.2127 => 0.2343, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 10.14% (0.3293 => 0.3627, std.dev.: 0.0080) MultiSource/Applications/d/make_dparser: 10.13% (3.1889 => 3.5118, std.dev.: 0.0060) MultiSource/Applications/spiff/spiff: 10.13% (0.7506 => 0.8266, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.11% (0.3580 => 0.3942, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 10.10% (0.2781 => 0.3062, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/18-imp/imp: 10.09% (0.3220 => 0.3545, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.09% (0.2914 => 0.3208, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.07% (0.1986 => 0.2186, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.06% (0.1014 => 0.1116, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 10.03% (0.3868 => 0.4256, std.dev.: 0.0138) MultiSource/Benchmarks/Olden/mst/mst: 9.99% (0.1111 => 0.1222, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.97% (0.7460 => 0.8204, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 9.89% (0.8310 => 0.9132, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.86% (0.5637 => 0.6193, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.82% (0.8698 => 0.9552, std.dev.: 0.0269) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.81% (0.1865 => 0.2048, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 9.81% (0.1478 => 0.1623, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.78% (0.2966 => 0.3256, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.76% (0.1435 => 0.1575, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 9.74% (0.2925 => 0.3210, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.74% (0.2782 => 0.3053, std.dev.: 0.0077) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.74% (0.2023 => 0.2220, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.72% (0.1276 => 0.1400, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 9.70% (0.2607 => 0.2860, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/random: 9.67% (0.2690 => 0.2950, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/except: 9.64% (0.2760 => 0.3026, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.55% (7.2180 => 7.9073, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.55% (1.9828 => 2.1721, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/sieve: 9.50% (0.3453 => 0.3781, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/ary2: 9.49% (0.3192 => 0.3495, std.dev.: 0.0061) MultiSource/Benchmarks/nbench/nbench: 9.43% (1.0594 => 1.1593, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 9.43% (0.2726 => 0.2983, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ary3: 9.40% (0.3149 => 0.3445, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ary: 9.37% (0.3107 => 0.3398, std.dev.: 0.0099) MultiSource/Benchmarks/Olden/em3d/em3d: 9.23% (0.1657 => 0.1810, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.22% (0.2765 => 0.3020, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.20% (0.2696 => 0.2944, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/fibo: 9.13% (0.2628 => 0.2868, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/wc: 9.12% (0.2937 => 0.3205, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.03% (1.3245 => 1.4441, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 9.03% (1.2749 => 1.3900, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.01% (3.6692 => 3.9998, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/matrix: 8.97% (0.2988 => 0.3256, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.78% (4.3801 => 4.7645, std.dev.: 0.0414) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.69% (4.4433 => 4.8295, std.dev.: 0.0059) MultiSource/Applications/JM/lencod/lencod: 8.69% (14.8535 => 16.1438, std.dev.: 0.0116) MultiSource/Benchmarks/sim/sim: 8.66% (0.3131 => 0.3402, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.58% (0.6576 => 0.7140, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.57% (0.6135 => 0.6661, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: 8.52% (0.2945 => 0.3196, std.dev.: 0.0069) MultiSource/Benchmarks/mafft/pairlocalalign: 8.38% (8.4961 => 9.2081, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.36% (0.3755 => 0.4069, std.dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.34% (1.5188 => 1.6454, std.dev.: 0.0105) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.33% (0.1789 => 0.1938, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 8.19% (4.6629 => 5.0448, std.dev.: 0.0114) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.19% (0.8818 => 0.9540, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.15% (3.2742 => 3.5411, std.dev.: 0.0638) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.13% (0.2140 => 0.2314, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.09% (0.9108 => 0.9845, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.01% (0.2321 => 0.2507, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.99% (1.1333 => 1.2238, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.92% (0.3511 => 0.3789, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 7.71% (0.4113 => 0.4430, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 7.68% (6.5754 => 7.0801, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/neural/neural: 7.65% (0.1385 => 0.1491) SingleSource/UnitTests/ObjC/parameter-passing: 7.64% (0.4003 => 0.4309, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 7.60% (3.7467 => 4.0316, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/exceptions: 7.38% (0.3914 => 0.4203, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.23% (0.2504 => 0.2685, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.21% (0.3940 => 0.4224, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 7.05% (1.2292 => 1.3159, std.dev.: 0.0148) SingleSource/UnitTests/ObjC/trivial-interface: 7.02% (0.3578 => 0.3829, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 6.97% (0.3789 => 0.4053, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.94% (0.3646 => 0.3899, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.93% (0.3650 => 0.3903, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 6.88% (0.3663 => 0.3915, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.87% (6.2785 => 6.7097, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/exceptions-3: 6.79% (0.3623 => 0.3869, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.78% (0.3601 => 0.3845, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.65% (13.2842 => 14.1681, std.dev.: 0.0078) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.43% (0.1819 => 0.1936, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.35% (0.2243 => 0.2363, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 5.12% (16.2614 => 17.0940, std.dev.: 0.0044) MultiSource/Applications/ClamAV/clamscan: 4.71% (14.5298 => 15.2145, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 2.02% (33.2944 => 33.9659, std.dev.: 0.0167) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/methcall: 30.68% (5.7573 => 7.5239, std.dev.: 0.0358) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.05% (1.0895 => 1.3624, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: 24.36% (1.8175 => 2.2602, std.dev.: 0.0241) SingleSource/Benchmarks/Misc/richards_benchmark: 11.24% (1.1560 => 1.2859, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/ffbench: 9.02% (0.8273 => 0.9019, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.56% (3.1736 => 3.4135, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 6.30% (1.2998 => 1.3817, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0004, std.dev.: 0.0500) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.80% (1.9144 => 2.0063, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7747, std.dev.: 0.0068) MultiSource/Benchmarks/nbench/nbench: 3.67% (11.2619 => 11.6756, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.39% (10.7476 => 11.1122, std.dev.: 0.0418) SingleSource/Benchmarks/Misc/flops-6: 3.38% (1.9199 => 1.9848, std.dev.: 0.0013) SingleSource/Regression/C/uint64_to_float: 3.03% (0.5449 => 0.5614, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 2.03% (7.4271 => 7.5777, std.dev.: 0.0062) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4532, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0076) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5131, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5788, std.dev.: 0.0130) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0272, std.dev.: 0.0115) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.00% (0.2670 => 0.1415, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.91% (0.4657 => 0.3916, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -14.43% (0.0707 => 0.0605, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.37% (1.3819 => 1.1972, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.28% (1.3813 => 1.1979, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.39% (22.5627 => 22.2495, std.dev.: 0.0194) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.89% (0.2238 => 0.1972, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.49% (1.2308 => 1.0894, std.dev.: 0.0246) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.04% (20.3410 => 18.2984, std.dev.: 0.0193) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2652, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.15% (1.9290 => 1.8103, std.dev.: 0.0400) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0216) SingleSource/UnitTests/Vector/multiplies: -5.09% (2.6470 => 2.5123, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.25% (0.9996 => 0.9571, std.dev.: 0.0080) MultiSource/Applications/siod/siod: -3.56% (3.2729 => 3.1565, std.dev.: 0.0109) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.49% (1.7688 => 1.7071, std.dev.: 0.0167) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.02% (0.4867 => 0.4720, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.78% (6.3560 => 6.1790, std.dev.: 0.0274) MultiSource/Applications/lua/lua: -2.56% (26.5159 => 25.8380, std.dev.: 0.0336) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: -2.53% (3.0263 => 2.9497, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.32% (1.9762 => 1.9303, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.96% (0.6589 => 0.6460, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7144, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0077) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.59% (0.6615 => 0.6510, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0065, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: -1.31% (9.3358 => 9.2136, std.dev.: 0.0323) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.25% (0.8342 => 0.8238, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4956, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -1.08% (5.3167 => 5.2592, std.dev.: 0.0017) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 13 00:59:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 13 Oct 2012 02:59:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121013075933.C53AC2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/4839?compare_to=4837&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4839, Order: 165867, Start Time: 2012-10-13 06:39:33, End Time: 2012-10-13 08:01:25 To: 4837, Order: 165859, Start Time: 2012-10-13 04:50:42, End Time: 2012-10-13 06:10:32 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (157 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 952 (691 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.16% (54.7291 => 56.4579, std.dev.: 0.0787) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.52% (0.5943 => 0.5974, std.dev.: 0.0039) MultiSource/Applications/SPASS/SPASS: 0.50% (16.3719 => 16.4538, std.dev.: 0.0279) MultiSource/Benchmarks/Bullet/bullet: 0.48% (55.3843 => 55.6505, std.dev.: 0.6524) MultiSource/Benchmarks/MallocBench/gs/gs: 0.66% (4.4316 => 4.4609, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0463 => 0.0463, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0464 => 0.0464, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.23% (0.0433 => 0.0432, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.23% (0.0434 => 0.0433, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.24% (0.0422 => 0.0421, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0425 => 0.0425, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.24% (0.0416 => 0.0417, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.24% (0.0418 => 0.0419, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0434 => 0.0434, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0436 => 0.0436, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.47% (0.0428 => 0.0430, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.23% (0.0430 => 0.0429, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.24% (0.0418 => 0.0419, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.24% (0.0420 => 0.0421, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.23% (0.0426 => 0.0425, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0427 => 0.0427, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.23% (0.0437 => 0.0438, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.14% (0.0439 => 0.0444, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.24% (0.0414 => 0.0413, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.24% (0.0415 => 0.0414, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.24% (0.0425 => 0.0426, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0427 => 0.0427, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.24% (0.0417 => 0.0418, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.24% (0.0418 => 0.0419, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.24% (0.0409 => 0.0410, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.24% (0.0410 => 0.0411, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0408 => 0.0408, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0409 => 0.0409, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.22% (0.0445 => 0.0446, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.22% (0.0446 => 0.0447, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0407 => 0.0407, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0408 => 0.0408, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.25% (0.0408 => 0.0407, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.24% (0.0409 => 0.0410, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0416 => 0.0416, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0417 => 0.0417, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.33% (1.2577 => 1.2618, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.30% (7.8632 => 7.8868, std.dev.: 0.1891) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.47% (0.7455 => 0.7420, std.dev.: 0.0026) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.55% (0.0365 => 0.0363, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.25% (0.0646 => 0.0667, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.01% (63.2438 => 55.6505, std.dev.: 0.6524) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.20% (14.1553 => 18.9964, std.dev.: 0.0281) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.97% (3.4629 => 5.6781, std.dev.: 0.0036) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14235.14% (0.0720 => 10.3213, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952200.00% (0.0001 => 9.9523, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 64.17% (0.2554 => 0.4193, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: 48.70% (10.3673 => 15.4166, std.dev.: 0.1432) SingleSource/Benchmarks/Misc/richards_benchmark: 39.52% (0.1622 => 0.2263, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/distray/distray: 33.81% (0.1056 => 0.1413, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: 18.44% (0.1432 => 0.1696, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.01% (7.0540 => 8.3244, std.dev.: 0.0968) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.28% (2.2022 => 2.5828, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.20% (0.1566 => 0.1804, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.32% (1.7609 => 1.9954, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.20% (0.0871 => 0.0986, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 13.16% (0.3282 => 0.3714, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.62% (0.1625 => 0.1830, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: 12.29% (0.1440 => 0.1617, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.24% (0.1438 => 0.1614, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.74% (0.1584 => 0.1770, std.dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 11.48% (10.4361 => 11.6341, std.dev.: 0.0268) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.46% (0.1143 => 0.1274, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.39% (0.3177 => 0.3539, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 11.37% (0.1029 => 0.1146, std.dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: 10.91% (0.7433 => 0.8244, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/trivial-interface: 10.86% (0.3473 => 0.3850, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.81% (0.3543 => 0.3926, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 10.78% (0.3561 => 0.3945, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.70% (0.3543 => 0.3922, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 10.65% (0.7115 => 0.7873, std.dev.: 0.0165) SingleSource/UnitTests/ObjC/exceptions-3: 10.61% (0.3516 => 0.3889, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 10.59% (0.3927 => 0.4343, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.58% (0.3497 => 0.3867, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.56% (0.4879 => 0.5394, std.dev.: 0.0130) MultiSource/Benchmarks/mafft/pairlocalalign: 10.48% (9.4845 => 10.4789, std.dev.: 0.0115) SingleSource/UnitTests/ObjC/for-in: 10.48% (0.3694 => 0.4081, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.40% (0.3828 => 0.4226, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.32% (0.3886 => 0.4287, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 10.21% (0.1175 => 0.1295, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.16% (0.6675 => 0.7353, std.dev.: 0.0052) MultiSource/Applications/d/make_dparser: 10.12% (3.3354 => 3.6728, std.dev.: 0.0058) SingleSource/Benchmarks/McGill/chomp: 10.09% (0.1655 => 0.1822, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.07% (0.2700 => 0.2972, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.06% (1.5415 => 1.6965, std.dev.: 0.0322) MultiSource/Benchmarks/McCat/18-imp/imp: 10.05% (0.3423 => 0.3767, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 9.87% (0.3109 => 0.3416, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 9.79% (0.1695 => 0.1861, std.dev.: 0.0018) MultiSource/Applications/viterbi/viterbi: 9.52% (0.1555 => 0.1703, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.49% (0.2107 => 0.2307, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.47% (0.5860 => 0.6415, std.dev.: 0.0042) MultiSource/Applications/aha/aha: 9.47% (0.1151 => 0.1260, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.44% (0.5105 => 0.5587, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.40% (4.2646 => 4.6654, std.dev.: 0.0049) MultiSource/Applications/oggenc/oggenc: 9.25% (5.7591 => 6.2917, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.21% (1.3050 => 1.4252, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.21% (0.1510 => 0.1649, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 9.17% (3.8723 => 4.2273, std.dev.: 0.0097) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.16% (0.2271 => 0.2479, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.14% (0.1236 => 0.1349, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.07% (0.1940 => 0.2116, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: 9.06% (1.1642 => 1.2697, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.03% (0.5569 => 0.6072, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.01% (0.2065 => 0.2251, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.99% (0.8067 => 0.8792, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.98% (8.1363 => 8.8673, std.dev.: 0.0155) MultiSource/Benchmarks/Olden/mst/mst: 8.94% (0.1163 => 0.1267, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.90% (5.0018 => 5.4472, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.90% (4.9449 => 5.3848, std.dev.: 0.0094) MultiSource/Applications/spiff/spiff: 8.88% (0.7835 => 0.8531, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.85% (0.2758 => 0.3002, std.dev.: 0.0060) MultiSource/Applications/hbd/hbd: 8.80% (1.5603 => 1.6976, std.dev.: 0.0096) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.75% (0.3121 => 0.3394, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.73% (0.5020 => 0.5458, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.61% (0.9765 => 1.0606, std.dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.60% (7.9617 => 8.6461, std.dev.: 0.0220) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.58% (0.4103 => 0.4455, std.dev.: 0.0113) MultiSource/Applications/lemon/lemon: 8.57% (1.0722 => 1.1641, std.dev.: 0.0056) MultiSource/Benchmarks/sim/sim: 8.56% (0.3387 => 0.3677, std.dev.: 0.0014) MultiSource/Applications/treecc/treecc: 8.49% (2.0273 => 2.1994, std.dev.: 0.0059) SingleSource/UnitTests/ObjC++/property-reference-object: 8.47% (0.6030 => 0.6541, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 8.41% (0.5925 => 0.6423, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.29% (0.3307 => 0.3581, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 8.19% (0.6456 => 0.6985, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/health/health: 8.04% (0.1268 => 0.1370, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 8.02% (0.3180 => 0.3435, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.93% (1.1861 => 1.2802, std.dev.: 0.0021) MultiSource/Applications/siod/siod: 7.83% (2.2969 => 2.4768, std.dev.: 0.0221) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.83% (1.5859 => 1.7100, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.79% (0.3441 => 0.3709, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference: 7.73% (0.7326 => 0.7892, std.dev.: 0.0085) MultiSource/Benchmarks/McCat/05-eks/eks: 7.70% (0.4299 => 0.4630, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.64% (0.4203 => 0.4524, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.42% (0.3826 => 0.4110, std.dev.: 0.0047) MultiSource/Applications/JM/lencod/lencod: 7.39% (21.9371 => 23.5593, std.dev.: 0.0357) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.34% (0.2603 => 0.2794, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 7.30% (0.8921 => 0.9572, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.22% (0.6450 => 0.6916, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.22% (0.3865 => 0.4144, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 7.20% (0.4289 => 0.4598, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists: 7.07% (0.3422 => 0.3664, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/neural/neural: 7.04% (0.1463 => 0.1566, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.97% (0.5981 => 0.6398, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash2: 6.97% (0.4620 => 0.4942, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.94% (0.4048 => 0.4329, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.80% (2.2024 => 2.3521, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.78% (0.1695 => 0.1810, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 6.71% (0.2905 => 0.3100, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.63% (0.3136 => 0.3344, std.dev.: 0.0076) MultiSource/Benchmarks/nbench/nbench: 6.61% (1.1840 => 1.2623, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/sieve: 6.58% (0.3603 => 0.3840, std.dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.56% (0.4636 => 0.4940, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.54% (1.4186 => 1.5114, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.51% (0.3162 => 0.3368, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.40% (0.2891 => 0.3076, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 6.30% (0.3684 => 0.3916, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.05% (0.2266 => 0.2403, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.00% (0.3098 => 0.3284, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.99% (0.2872 => 0.3044, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 5.96% (0.2871 => 0.3042, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.93% (0.2831 => 0.2999, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.91% (0.2756 => 0.2919, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 5.84% (0.2877 => 0.3045, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.75% (0.2714 => 0.2870, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 5.72% (0.3232 => 0.3417, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 5.70% (0.3052 => 0.3226, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 5.65% (0.2725 => 0.2879, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 5.53% (0.3379 => 0.3566, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 5.53% (0.2802 => 0.2957, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.51% (0.2793 => 0.2947, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.48% (0.8101 => 0.8545, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.39% (0.4064 => 0.4283, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 5.27% (0.2049 => 0.2157, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.79% (0.3427 => 0.3591, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 4.70% (1.2842 => 1.3445, std.dev.: 0.0054) MultiSource/Applications/sqlite3/sqlite3: 4.65% (17.1811 => 17.9792, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/objinst: 4.63% (0.3131 => 0.3276, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.24% (0.2430 => 0.2533, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.01% (3.8922 => 4.0482, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/bh/bh: 3.30% (0.3092 => 0.3194, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.04% (0.3817 => 0.3933, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 9.97% (1.1396 => 1.2532, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4500, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3681, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0014) SingleSource/Regression/C/uint64_to_float: 3.69% (0.5413 => 0.5613, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.34% (3.6395 => 3.7612, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.71% (4.2280 => 4.3425, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.73% (0.8275 => 0.8418, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.46% (11.6436 => 11.8131, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.16% (6.5088 => 6.5846, std.dev.: 0.0238) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (2.6546 => 2.6824, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.03% (6.6874 => 0.1316, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: -80.08% (0.8651 => 0.1723, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.29% (5.2763 => 3.2558, std.dev.: 0.0459) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.39% (5.3855 => 3.6948, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.86% (5.3526 => 3.7010, std.dev.: 0.0392) SingleSource/UnitTests/Vector/constpool: -14.63% (54.1659 => 46.2401, std.dev.: 0.0065) MultiSource/Applications/ClamAV/clamscan: -12.15% (22.1758 => 19.4823, std.dev.: 0.0523) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.39% (2.9384 => 2.6330, std.dev.: 0.0292) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7652, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4242, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.63% (0.0998 => 0.0862, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.65% (1.2373 => 1.0932, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3783, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/mason/mason: -9.63% (0.2161 => 0.1953, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.46% (19.9488 => 18.2607, std.dev.: 0.0280) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.60% (1.8329 => 1.7119, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.64% (1.9577 => 1.8473, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.28% (1.6805 => 1.5917, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5079, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.32% (0.9957 => 0.9527, std.dev.: 0.0077) MultiSource/Applications/siod/siod: -3.72% (3.2827 => 3.1605, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.4990, std.dev.: 0.0077) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0994, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.87% (10.2830 => 10.0907, std.dev.: 0.0247) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.84% (8.1563 => 8.0063, std.dev.: 0.0112) SingleSource/UnitTests/Vector/multiplies: -1.80% (2.5528 => 2.5068, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6796, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4216, std.dev.: 0.0534) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8566, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 14.25% (0.5229 => 0.5974, std.dev.: 0.0039) MultiSource/Applications/SPASS/SPASS: 9.77% (14.9895 => 16.4538, std.dev.: 0.0279) MultiSource/Benchmarks/MallocBench/gs/gs: 8.52% (4.1105 => 4.4609, std.dev.: 0.0176) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.21% (1.1048 => 1.2618, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.18% (7.1582 => 7.8868, std.dev.: 0.1891) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.25% (0.6222 => 0.7420, std.dev.: 0.0026) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36200.00% (0.0001 => 0.0363, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.48% (0.2116 => 0.0667, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 13 05:38:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 13 Oct 2012 07:38:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121013123824.BD83B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4840?compare_to=4839&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4840, Order: 165868, Start Time: 2012-10-13 11:20:12, End Time: 2012-10-13 12:40:16 To: 4839, Order: 165867, Start Time: 2012-10-13 06:39:33, End Time: 2012-10-13 08:01:25 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 1 (75 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (166 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 952 (678 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.17% (0.3269 => 0.3198, std.dev.: 0.0010) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.32% (0.5974 => 0.5993, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 0.09% (16.4538 => 16.4691, std.dev.: 0.0133) MultiSource/Benchmarks/Bullet/bullet: 0.26% (55.6505 => 55.7941, std.dev.: 0.0453) MultiSource/Benchmarks/MallocBench/gs/gs: -0.42% (4.4609 => 4.4423, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.43% (0.0463 => 0.0461, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.43% (0.0464 => 0.0462, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0432 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.46% (0.0433 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0421 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.71% (0.0425 => 0.0422, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.48% (0.0417 => 0.0415) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.95% (0.0419 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.23% (0.0434 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.46% (0.0436 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.70% (0.0430 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.23% (0.0429 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.48% (0.0419 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.71% (0.0421 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.24% (0.0425 => 0.0424) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.70% (0.0427 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.68% (0.0438 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.35% (0.0444 => 0.0438, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.24% (0.0413 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.48% (0.0414 => 0.0412, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.47% (0.0426 => 0.0424) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.47% (0.0427 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.72% (0.0418 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.72% (0.0419 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.49% (0.0410 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.49% (0.0411 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.49% (0.0408 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.49% (0.0409 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.67% (0.0446 => 0.0443) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.67% (0.0447 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.25% (0.0407 => 0.0406) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.25% (0.0408 => 0.0407, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.25% (0.0407 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.73% (0.0410 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.48% (0.0416 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.24% (0.0417 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.11% (1.2618 => 1.2604, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.02% (7.8868 => 7.8852, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.12% (0.7420 => 0.7429, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 1.38% (0.0363 => 0.0368, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.10% (0.0667 => 0.0681, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.78% (63.2438 => 55.7941, std.dev.: 0.0453) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.78% (0.3256 => 0.3198, std.dev.: 0.0010) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.07% (14.1553 => 18.9780, std.dev.: 0.0162) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.80% (3.4629 => 5.6724, std.dev.: 0.0074) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14231.39% (0.0720 => 10.3186, std.dev.: 0.0125) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9951600.00% (0.0001 => 9.9517, std.dev.: 0.0013) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 64.92% (0.2554 => 0.4212, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 49.88% (10.3673 => 15.5389, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/richards_benchmark: 41.49% (0.1622 => 0.2295, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/distray/distray: 34.19% (0.1056 => 0.1417, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 18.99% (0.1432 => 0.1704, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.49% (7.0540 => 8.3583, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.99% (2.2022 => 2.5983, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.52% (0.1566 => 0.1809, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 13.50% (0.3282 => 0.3725, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.44% (1.7609 => 1.9976, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.20% (0.0871 => 0.0986, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 12.43% (0.1440 => 0.1619, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 12.20% (10.4361 => 11.7095, std.dev.: 0.0105) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.93% (0.1584 => 0.1773, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.46% (0.1143 => 0.1274, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.99% (0.1438 => 0.1596, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.97% (0.3473 => 0.3854, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.89% (0.3543 => 0.3929, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: 10.87% (0.3497 => 0.3877, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.84% (0.4879 => 0.5408, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 10.78% (0.3561 => 0.3945, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.78% (0.3543 => 0.3925, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.78% (0.3516 => 0.3895, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.75% (0.3927 => 0.4349, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 10.74% (0.7433 => 0.8231, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 10.62% (9.4845 => 10.4917, std.dev.: 0.0109) SingleSource/UnitTests/ObjC/for-in: 10.56% (0.3694 => 0.4084, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.55% (0.3886 => 0.4296) MultiSource/Applications/minisat/minisat: 10.54% (0.7115 => 0.7865, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions: 10.53% (0.3828 => 0.4231, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.48% (0.3177 => 0.3510, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.34% (0.1625 => 0.1793, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.30% (0.2700 => 0.2978, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.28% (0.6675 => 0.7361, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 10.21% (0.1175 => 0.1295, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 10.03% (0.1655 => 0.1821, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.00% (1.5415 => 1.6957, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: 9.91% (3.3354 => 3.6658, std.dev.: 0.0087) MultiSource/Benchmarks/McCat/18-imp/imp: 9.76% (0.3423 => 0.3757, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 9.73% (0.1695 => 0.1860, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 9.68% (0.3109 => 0.3410, std.dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.68% (0.3121 => 0.3423, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.62% (0.4615 => 0.5059, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.51% (0.5860 => 0.6417, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.48% (0.8067 => 0.8832, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.44% (0.5105 => 0.5587, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.39% (4.2646 => 4.6650, std.dev.: 0.0082) MultiSource/Applications/oggenc/oggenc: 9.32% (5.7591 => 6.2961, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.31% (0.8172 => 0.8933, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.27% (0.1510 => 0.1650, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.24% (1.3050 => 1.4256, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.21% (0.2107 => 0.2301, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.19% (5.0018 => 5.4617, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.18% (0.1940 => 0.2118, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.14% (0.1236 => 0.1349, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.12% (4.9449 => 5.3958, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.12% (8.1363 => 8.8781, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.11% (0.2271 => 0.2478, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 9.07% (0.1555 => 0.1696, std.dev.: 0.0037) MultiSource/Applications/hbd/hbd: 9.06% (1.5603 => 1.7016, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.05% (0.5569 => 0.6073, std.dev.: 0.0032) MultiSource/Applications/aha/aha: 9.04% (0.1151 => 0.1255, std.dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.01% (7.9617 => 8.6793, std.dev.: 0.0061) MultiSource/Applications/Burg/burg: 8.99% (1.1642 => 1.2689, std.dev.: 0.0023) MultiSource/Applications/lua/lua: 8.91% (3.8723 => 4.2175, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.91% (0.2065 => 0.2249, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/mst/mst: 8.86% (0.1163 => 0.1266, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.85% (0.2758 => 0.3002, std.dev.: 0.0027) MultiSource/Benchmarks/sim/sim: 8.80% (0.3387 => 0.3685, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 8.55% (0.7835 => 0.8505, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.52% (0.9765 => 1.0597, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 8.51% (1.0722 => 1.1634, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.50% (0.3307 => 0.3588, std.dev.: 0.0052) MultiSource/Applications/treecc/treecc: 8.49% (2.0273 => 2.1994, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.35% (0.5020 => 0.5439, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 8.26% (0.6030 => 0.6528, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 8.18% (0.6456 => 0.6984, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.15% (0.5925 => 0.6408, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 8.08% (0.3180 => 0.3437, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.08% (0.1337 => 0.1445, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 8.04% (0.1268 => 0.1370, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 7.89% (0.1268 => 0.1368, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 7.85% (2.2969 => 2.4771, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.77% (0.4103 => 0.4422, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.72% (1.5859 => 1.7084, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.71% (1.1861 => 1.2775, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.70% (0.3441 => 0.3706, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 7.68% (21.9371 => 23.6209, std.dev.: 0.0202) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.49% (0.4203 => 0.4518, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.43% (0.7326 => 0.7870, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.39% (0.4289 => 0.4606, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.33% (0.6450 => 0.6923, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 7.26% (0.8921 => 0.9569, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.26% (0.2603 => 0.2792, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.20% (0.4636 => 0.4970, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.19% (0.3865 => 0.4143, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 7.12% (0.4299 => 0.4605, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 7.10% (0.3422 => 0.3665, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.06% (0.5981 => 0.6403, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.90% (0.4620 => 0.4939, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: 6.90% (0.1463 => 0.1564, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.79% (0.3650 => 0.3898, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 6.79% (0.4048 => 0.4323, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.77% (0.3826 => 0.4085, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.76% (2.2024 => 2.3513, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.61% (0.1695 => 0.1807, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 6.58% (1.1840 => 1.2619, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.57% (1.4186 => 1.5118, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sieve: 6.55% (0.3603 => 0.3839, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 6.47% (0.2905 => 0.3093, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 6.38% (0.3684 => 0.3919, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.30% (0.1906 => 0.2026, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.26% (0.3162 => 0.3360, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.26% (0.2891 => 0.3072, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.25% (0.3136 => 0.3332, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.20% (0.2756 => 0.2927, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.09% (0.2266 => 0.2404, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.01% (2.0665 => 2.1906, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/matrix: 5.97% (0.3098 => 0.3283, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.97% (0.2831 => 0.3000, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.85% (0.2872 => 0.3040, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.82% (0.3232 => 0.3420, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.82% (0.2871 => 0.3038, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.76% (0.3283 => 0.3472, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.73% (0.3052 => 0.3227, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 5.70% (0.2877 => 0.3041, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.69% (0.8101 => 0.8562, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 5.69% (0.2725 => 0.2880, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 5.56% (0.2714 => 0.2865, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: 5.56% (0.2049 => 0.2163, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.51% (0.2793 => 0.2947, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 5.50% (0.2802 => 0.2956, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.44% (0.1892 => 0.1995, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.34% (14.3668 => 15.1343, std.dev.: 0.0123) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.31% (0.4064 => 0.4280, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 5.24% (0.3379 => 0.3556, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 4.72% (17.1811 => 17.9912, std.dev.: 0.0246) SingleSource/Benchmarks/Shootout-C++/objinst: 4.57% (0.3131 => 0.3274, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.54% (1.2842 => 1.3425, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.52% (0.3427 => 0.3582, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.32% (0.2430 => 0.2535, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.03% (3.8922 => 4.0492, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.31% (1.1194 => 1.1565, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.27% (0.3817 => 0.3942, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.22% (1.1145 => 1.3844, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 9.77% (1.1396 => 1.2509, std.dev.: 0.0015) MultiSource/Applications/aha/aha: 9.20% (3.1595 => 3.4501, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 6.64% (3.1578 => 3.3676, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.66% (3.6395 => 3.7727, std.dev.: 0.0024) SingleSource/Regression/C/uint64_to_float: 3.66% (0.5413 => 0.5611, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.73% (4.2280 => 4.3435, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.73% (0.8275 => 0.8418, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.45% (11.6436 => 11.8119, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.36% (0.9540 => 0.9670, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.21% (6.5088 => 6.5875, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.14% (2.6546 => 2.6848, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.03% (6.6874 => 0.1317, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -80.09% (0.8651 => 0.1722, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.12% (5.2763 => 3.2652, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.88% (5.3855 => 3.7224, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.55% (5.3526 => 3.7172, std.dev.: 0.0033) SingleSource/UnitTests/Vector/constpool: -14.65% (54.1659 => 46.2279, std.dev.: 0.0089) MultiSource/Applications/ClamAV/clamscan: -12.11% (22.1758 => 19.4914, std.dev.: 0.0132) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.19% (2.9384 => 2.6391, std.dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.38% (1.1492 => 0.7656, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.93% (1.6925 => 1.4229, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.83% (0.0998 => 0.0860, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -12.02% (1.2373 => 1.0886, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/mandel-2: -10.43% (1.5373 => 1.3769, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/mason/mason: -10.13% (0.2161 => 0.1942, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.27% (19.9488 => 18.2992, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.63% (1.8329 => 1.7114, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.28% (1.6805 => 1.5917, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7614) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5066, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.92% (0.9957 => 0.9567, std.dev.: 0.0089) MultiSource/Applications/siod/siod: -3.77% (3.2827 => 3.1590, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4952, std.dev.: 0.0060) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0993, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.05% (8.6802 => 8.5024, std.dev.: 0.0152) SingleSource/Benchmarks/Misc/salsa20: -1.89% (10.2830 => 10.0887, std.dev.: 0.0138) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6809, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.69% (8.1563 => 8.0181, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/power/power: -1.64% (1.1277 => 1.1092, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5141, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/lists: -1.07% (6.2999 => 6.2322, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8589, std.dev.: 0.0038) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 14.61% (0.5229 => 0.5993, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 9.87% (14.9895 => 16.4691, std.dev.: 0.0133) MultiSource/Benchmarks/MallocBench/gs/gs: 8.07% (4.1105 => 4.4423, std.dev.: 0.0108) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.08% (1.1048 => 1.2604, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.16% (7.1582 => 7.8852, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.40% (0.6222 => 0.7429, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36700.00% (0.0001 => 0.0368, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.82% (0.2116 => 0.0681, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 13 05:44:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 13 Oct 2012 07:44:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121013124412.6A6042A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4841?compare_to=4838&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4841, Order: 165868, Start Time: 2012-10-13 11:21:21, End Time: 2012-10-13 12:47:05 To: 4838, Order: 165867, Start Time: 2012-10-13 06:30:42, End Time: 2012-10-13 07:58:16 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 1 (1 on baseline) Performance Regressions: 2 (189 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1038 (675 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.86% (0.3271 => 0.3210, std.dev.: 0.0348) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/flops: 26.44% (7.2642 => 9.1849, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.61% (54.8817 => 56.3150, std.dev.: 0.1885) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.09% (1.3278 => 1.3001, std.dev.: 0.0065) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.23% (0.3250 => 0.3210, std.dev.: 0.0348) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.40% (2.0176 => 2.5098, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.65% (0.1410 => 0.1673, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 17.68% (0.0826 => 0.0972, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.30% (0.0653 => 0.0766, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 17.12% (0.2243 => 0.2627, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.23% (0.1072 => 0.1246, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 14.51% (0.1013 => 0.1160, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.91% (0.0834 => 0.0950, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.73% (0.1413 => 0.1607, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.64% (0.1327 => 0.1508, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 13.57% (0.7038 => 0.7993, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.22% (0.1588 => 0.1798, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.11% (3.9660 => 4.4859, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 13.11% (1.3693 => 1.5488, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.97% (0.0964 => 0.1089, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.64% (0.2721 => 0.3065, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.52% (0.2596 => 0.2921, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.51% (0.9199 => 1.0350, std.dev.: 0.0066) MultiSource/Applications/SPASS/SPASS: 12.46% (13.8202 => 15.5428, std.dev.: 0.0074) MultiSource/Applications/aha/aha: 12.43% (0.1062 => 0.1194, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.37% (0.6959 => 0.7820, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.37% (1.4563 => 1.6364, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.29% (0.5265 => 0.5912, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/distray/distray: 12.22% (0.0818 => 0.0918, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.16% (1.2193 => 1.3676, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.16% (0.6283 => 0.7047, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 12.08% (0.4328 => 0.4851, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.05% (1.1364 => 1.2733, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.98% (0.7710 => 0.8634, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/power/power: 11.96% (0.1003 => 0.1123, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.76% (0.3130 => 0.3498, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 11.59% (1.0313 => 1.1508, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.57% (0.3899 => 0.4350, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.50% (0.1157 => 0.1290, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 11.47% (0.4062 => 0.4528, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 11.21% (1.1061 => 1.2301, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.06% (0.5577 => 0.6194, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.06% (0.4791 => 0.5321, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 11.06% (16.6129 => 18.4495, std.dev.: 0.0109) MultiSource/Applications/sgefa/sgefa: 10.88% (0.2995 => 0.3321, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.79% (0.1075 => 0.1191, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 10.76% (0.1589 => 0.1760, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.76% (0.3485 => 0.3860, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.75% (0.0977 => 0.1082, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.64% (0.4379 => 0.4845, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 10.63% (2.1791 => 2.4108, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.63% (0.3246 => 0.3591, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 10.62% (0.5818 => 0.6436, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 10.62% (0.6744 => 0.7460, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.61% (0.4016 => 0.4442, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.57% (0.2914 => 0.3222, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 10.56% (1.9270 => 2.1305, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 10.52% (3.8646 => 4.2710, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/lists: 10.51% (0.3293 => 0.3639, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 10.50% (0.3220 => 0.3558, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 10.48% (0.8310 => 0.9181, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.44% (0.2127 => 0.2349, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.42% (0.1276 => 0.1409, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 10.38% (3.1889 => 3.5200, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.37% (0.1986 => 0.2192, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 10.35% (0.1111 => 0.1226, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.33% (0.3756 => 0.4144, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.32% (0.3022 => 0.3334, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.29% (0.3489 => 0.3848, std.dev.: 0.0035) SingleSource/Regression/C++/ofstream_ctor: 10.28% (0.2781 => 0.3067, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 10.28% (0.5748 => 0.6339, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.27% (0.7460 => 0.8226, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.26% (0.1014 => 0.1118, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.24% (0.1435 => 0.1582, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 10.21% (0.7506 => 0.8272, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.20% (0.3580 => 0.3945, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 10.15% (0.2925 => 0.3222, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 10.15% (0.1478 => 0.1628, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.15% (0.5637 => 0.6209, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.11% (0.8698 => 0.9577, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.08% (0.1865 => 0.2053, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 10.06% (0.3868 => 0.4257, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 10.04% (0.7061 => 0.7770, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.03% (0.2782 => 0.3061, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.98% (0.2966 => 0.3262, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 9.90% (1.0594 => 1.1643, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.89% (0.2023 => 0.2223, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.86% (7.2180 => 7.9296, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.75% (0.1569 => 0.1722, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 9.72% (0.3149 => 0.3455, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.70% (1.9828 => 2.1752, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 9.68% (0.2726 => 0.2990, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 9.64% (0.3453 => 0.3786, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.59% (0.4390 => 0.4811, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists1: 9.56% (0.3534 => 0.3872, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 9.56% (0.2761 => 0.3025, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 9.49% (0.3192 => 0.3495, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.48% (0.2765 => 0.3027, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 9.46% (1.2749 => 1.3955, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/except: 9.46% (0.2760 => 0.3021, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.45% (0.2655 => 0.2906, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 9.43% (0.3107 => 0.3400, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 9.41% (0.2690 => 0.2943, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 9.40% (0.2607 => 0.2852, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.40% (4.9865 => 5.4551, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/em3d/em3d: 9.35% (0.1657 => 0.1812, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 9.33% (0.2937 => 0.3211, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 9.28% (0.2628 => 0.2872, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.26% (1.3245 => 1.4471, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.24% (3.6692 => 4.0082, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.10% (4.4433 => 4.8475, std.dev.: 0.0037) MultiSource/Applications/JM/lencod/lencod: 9.09% (14.8535 => 16.2044, std.dev.: 0.0184) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.05% (0.2696 => 0.2940, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.03% (0.8818 => 0.9614, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: 9.01% (0.3131 => 0.3413, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.00% (4.3801 => 4.7742, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 8.97% (0.2988 => 0.3256, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.90% (0.6135 => 0.6681, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.87% (0.6576 => 0.7159, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 8.83% (0.2945 => 0.3205, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 8.78% (8.4961 => 9.2422, std.dev.: 0.0052) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.74% (0.2140 => 0.2327, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.66% (0.1789 => 0.1944, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.66% (0.3755 => 0.4080, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.56% (0.9108 => 0.9888, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.56% (3.2742 => 3.5544, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.52% (1.5188 => 1.6482, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 8.42% (4.6629 => 5.0554, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/05-eks/eks: 8.34% (0.4113 => 0.4456, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.32% (1.1333 => 1.2276, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.32% (0.3511 => 0.3803, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.32% (0.2321 => 0.2514, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 8.09% (0.1385 => 0.1497, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 8.00% (6.5754 => 7.1015, std.dev.: 0.0145) SingleSource/Benchmarks/Misc/oourafft: 7.97% (0.2008 => 0.2168, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.93% (0.4805 => 0.5186, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 7.89% (3.7467 => 4.0425, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/bigfib: 7.74% (0.6250 => 0.6734, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.67% (0.2504 => 0.2696, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.55% (2.1007 => 2.2592, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.46% (0.3245 => 0.3487, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 7.19% (0.4003 => 0.4291, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.14% (6.2785 => 6.7267, std.dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: 7.13% (1.2292 => 1.3169, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.13% (13.2842 => 14.2309, std.dev.: 0.0099) SingleSource/UnitTests/ObjC/exceptions: 6.92% (0.3914 => 0.4185, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 6.85% (0.3940 => 0.4210, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/for-in: 6.70% (0.3789 => 0.4043, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.66% (0.3646 => 0.3889, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 6.65% (0.3578 => 0.3816, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.58% (0.3663 => 0.3904, std.dev.: 0.0079) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.54% (0.1819 => 0.1938, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.52% (0.3650 => 0.3888, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 6.50% (0.3601 => 0.3835, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 6.46% (0.3623 => 0.3857, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.02% (0.2243 => 0.2378, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 5.85% (0.1777 => 0.1881, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 5.34% (16.2614 => 17.1290, std.dev.: 0.0242) MultiSource/Applications/ClamAV/clamscan: 4.84% (14.5298 => 15.2329, std.dev.: 0.0109) MultiSource/Benchmarks/Bullet/bullet: 2.24% (33.2944 => 34.0387, std.dev.: 0.0406) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5161, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.01% (1.8175 => 2.2538, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/richards_benchmark: 11.19% (1.1560 => 1.2853, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 9.03% (0.8273 => 0.9020, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4145, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.22% (1.2998 => 1.3807, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0039, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.68% (11.2619 => 11.6760, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 3.42% (10.7476 => 11.1150, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/flops-6: 3.36% (1.9199 => 1.9844, std.dev.: 0.0016) SingleSource/Regression/C/uint64_to_float: 3.01% (0.5449 => 0.5613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.29% (7.4271 => 7.5969, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) MultiSource/Applications/lemon/lemon: 1.72% (1.4298 => 1.4544, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5135, std.dev.: 0.0070) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1849, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5784, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0266, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5874, std.dev.: 0.0055) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.82% (0.2670 => 0.1420, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.30% (0.4657 => 0.3898, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.09% (1.3813 => 1.2005, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.08% (1.3819 => 1.2012, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.18% (22.5627 => 22.2975, std.dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.64% (0.0997 => 0.0861, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.97% (0.2238 => 0.1970, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.78% (1.2308 => 1.0981, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.09% (20.3410 => 18.2884, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.65% (1.3780 => 1.3001, std.dev.: 0.0065) SingleSource/Benchmarks/Dhrystone/dry: -5.38% (2.5089 => 2.3740, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -5.10% (2.6470 => 2.5121, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.77% (0.9996 => 0.9619, std.dev.: 0.0032) MultiSource/Applications/siod/siod: -3.56% (3.2729 => 3.1564, std.dev.: 0.0205) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.43% (1.7688 => 1.7081, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.56% (3.0263 => 2.9489, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -2.46% (26.5159 => 25.8636, std.dev.: 0.0094) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.34% (1.9762 => 1.9299, std.dev.: 0.0089) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.99% (0.6589 => 0.6458, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.88% (6.3560 => 6.2368, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7151, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0062, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8673, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.23% (0.8342 => 0.8239, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4950, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -1.16% (9.3358 => 9.2271, std.dev.: 0.0399) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2575, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 13 07:27:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 13 Oct 2012 09:27:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121013142729.6F3402A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4842?compare_to=4840&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4842, Order: 165870, Start Time: 2012-10-13 13:09:40, End Time: 2012-10-13 14:29:20 To: 4840, Order: 165868, Start Time: 2012-10-13 11:20:12, End Time: 2012-10-13 12:40:16 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (75 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (160 on baseline) Performance Improvements: 2 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 90 (15 on baseline) Unchanged Tests: 950 (684 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.94% (15.5389 => 15.0824, std.dev.: 0.0078) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Regression/C/uint64_to_float: -5.35% (0.5611 => 0.5311) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.63% (0.5993 => 0.5955, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: -0.23% (16.4691 => 16.4316, std.dev.: 0.0155) MultiSource/Benchmarks/Bullet/bullet: -0.46% (55.7941 => 55.5369, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/gs/gs: -0.18% (4.4423 => 4.4345, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.43% (0.0461 => 0.0459, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.43% (0.0462 => 0.0460, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.69% (0.0432 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0431 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.71% (0.0421 => 0.0418, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.47% (0.0422 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.72% (0.0415 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.24% (0.0415 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.69% (0.0433 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.46% (0.0434 => 0.0432, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.47% (0.0427 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.23% (0.0428 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.48% (0.0417 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.24% (0.0418 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.47% (0.0424 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0424 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.46% (0.0435 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0438 => 0.0438, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.49% (0.0412 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.24% (0.0412 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.47% (0.0424 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.24% (0.0425 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0415 => 0.0415, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.24% (0.0416 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.74% (0.0408 => 0.0405, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.49% (0.0409 => 0.0407, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.25% (0.0406 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.25% (0.0407 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.45% (0.0443 => 0.0441, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0444 => 0.0444) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.49% (0.0406 => 0.0404, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.49% (0.0407 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.25% (0.0406 => 0.0405, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.25% (0.0407 => 0.0406, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.48% (0.0414 => 0.0412, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.48% (0.0416 => 0.0414, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.17% (1.2604 => 1.2582, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.17% (7.8852 => 7.8717, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.04% (0.7429 => 0.7426, std.dev.: 0.0030) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -2.45% (0.0368 => 0.0359, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1433 => 0.1434) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.13% (0.3198 => 0.3202, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.29% (0.0681 => 0.0645, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.19% (63.2438 => 55.5369, std.dev.: 0.0049) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.66% (0.3256 => 0.3202, std.dev.: 0.0009) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 33.56% (14.1553 => 18.9063, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.44% (3.4629 => 5.6599, std.dev.: 0.0052) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14230.56% (0.0720 => 10.3180, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952000.00% (0.0001 => 9.9521, std.dev.: 0.0014) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.59% (0.2554 => 0.4178, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 45.48% (10.3673 => 15.0824, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/richards_benchmark: 39.89% (0.1622 => 0.2269, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 33.52% (0.1056 => 0.1410, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 18.44% (0.1432 => 0.1696, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.03% (7.0540 => 8.3260, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.62% (2.2022 => 2.5903, std.dev.: 0.0042) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.07% (0.1566 => 0.1802, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 13.59% (0.3282 => 0.3728, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.41% (1.7609 => 1.9971, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.97% (0.0871 => 0.0984) MultiSource/Benchmarks/Olden/power/power: 12.15% (0.1440 => 0.1615, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 11.96% (10.4361 => 11.6839, std.dev.: 0.0067) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.81% (0.1584 => 0.1771, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.46% (0.1143 => 0.1274, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 10.78% (0.7433 => 0.8234, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.70% (0.4879 => 0.5401, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.61% (0.3543 => 0.3919, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 10.60% (0.3473 => 0.3841, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.57% (0.1438 => 0.1590, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.41% (0.3543 => 0.3912, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 10.39% (0.7115 => 0.7854, std.dev.: 0.0121) SingleSource/UnitTests/ObjC/parameter-passing: 10.36% (0.3927 => 0.4334, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.35% (0.3497 => 0.3859, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.33% (0.3561 => 0.3929, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 10.29% (9.4845 => 10.4602, std.dev.: 0.0080) SingleSource/UnitTests/ObjC/exceptions-3: 10.27% (0.3516 => 0.3877, std.dev.: 0.0074) MultiSource/Benchmarks/Olden/tsp/tsp: 10.13% (0.1175 => 0.1294, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.07% (0.3177 => 0.3497, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.05% (0.6675 => 0.7346, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 10.04% (0.3694 => 0.4065, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.04% (0.2700 => 0.2971, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 10.04% (0.3886 => 0.4276, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions: 10.03% (0.3828 => 0.4212, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.03% (0.1625 => 0.1788, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 9.79% (0.1655 => 0.1817, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.76% (1.5415 => 1.6920, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 9.75% (3.3354 => 3.6605, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 9.73% (0.1695 => 0.1860, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 9.73% (0.3423 => 0.3756, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 9.62% (0.3109 => 0.3408, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.45% (0.4615 => 0.5051, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 9.26% (5.7591 => 6.2922, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.20% (0.5860 => 0.6399, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.14% (0.1510 => 0.1648, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.09% (0.5105 => 0.5569, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.07% (4.2646 => 4.6512, std.dev.: 0.0118) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.02% (0.1940 => 0.2115, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.95% (1.3050 => 1.4218, std.dev.: 0.0035) MultiSource/Applications/aha/aha: 8.95% (0.1151 => 0.1254, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.89% (0.2271 => 0.2473, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.88% (0.8172 => 0.8898, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.83% (0.2107 => 0.2293, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 8.81% (1.1642 => 1.2668, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.78% (0.8067 => 0.8775, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.77% (0.2065 => 0.2246, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 8.76% (0.7835 => 0.8521, std.dev.: 0.0041) MultiSource/Applications/viterbi/viterbi: 8.75% (0.1555 => 0.1691, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.74% (0.5569 => 0.6056, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.74% (0.1236 => 0.1344) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.69% (5.0018 => 5.4366, std.dev.: 0.0087) MultiSource/Applications/lua/lua: 8.69% (3.8723 => 4.2088, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.69% (8.1363 => 8.8431, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/mst/mst: 8.68% (0.1163 => 0.1264, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.66% (4.9449 => 5.3732, std.dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.57% (7.9617 => 8.6437, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.56% (0.2758 => 0.2994, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.49% (0.3121 => 0.3386, std.dev.: 0.0019) MultiSource/Applications/hbd/hbd: 8.45% (1.5603 => 1.6921, std.dev.: 0.0056) MultiSource/Benchmarks/sim/sim: 8.44% (0.3387 => 0.3673, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.42% (0.9765 => 1.0587, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 8.30% (1.0722 => 1.1612, std.dev.: 0.0047) MultiSource/Applications/treecc/treecc: 8.25% (2.0273 => 2.1946, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.25% (0.5020 => 0.5434, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 8.16% (0.6456 => 0.6983, std.dev.: 0.0034) SingleSource/UnitTests/ObjC++/Hello: 8.02% (0.5925 => 0.6400, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.93% (0.6030 => 0.6508, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 7.89% (0.3180 => 0.3431, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.86% (0.3307 => 0.3567, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.85% (0.1337 => 0.1442, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 7.68% (2.2969 => 2.4732, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.64% (0.3441 => 0.3704, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.64% (1.5859 => 1.7070, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.61% (1.1861 => 1.2764, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.38% (0.4103 => 0.4406, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.32% (0.3865 => 0.4148, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 7.18% (21.9371 => 23.5125, std.dev.: 0.0096) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.16% (0.6450 => 0.6912, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.15% (0.2603 => 0.2789, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 7.13% (0.7326 => 0.7848, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 7.08% (0.8921 => 0.9553, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.08% (0.4636 => 0.4964, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 7.05% (0.4299 => 0.4602, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash: 7.04% (0.4289 => 0.4591, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.92% (0.4203 => 0.4494, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.90% (0.3422 => 0.3658, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.82% (0.5981 => 0.6389, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 6.62% (0.4620 => 0.4926, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.62% (2.2024 => 2.3481, std.dev.: 0.0179) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.61% (0.3826 => 0.4079, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.60% (0.3650 => 0.3891, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 6.55% (0.4048 => 0.4313, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.40% (1.4186 => 1.5094, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/sieve: 6.30% (0.3603 => 0.3830, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.26% (0.2891 => 0.3072, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.25% (0.1695 => 0.1801, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.20% (0.3162 => 0.3358, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.19% (0.3136 => 0.3330, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.16% (0.2905 => 0.3084, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.13% (0.3684 => 0.3910, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 6.11% (1.1840 => 1.2563, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.09% (0.1906 => 0.2022, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.87% (0.2266 => 0.2399, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.81% (0.2756 => 0.2916, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.77% (2.0665 => 2.1858, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/strcat: 5.76% (0.2831 => 0.2994, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 5.75% (0.3098 => 0.3276, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.73% (0.3052 => 0.3227, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 5.70% (0.3283 => 0.3470, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.66% (0.3232 => 0.3415, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.66% (0.2793 => 0.2951, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 5.65% (0.2725 => 0.2879, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.64% (0.2872 => 0.3034, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.61% (0.2871 => 0.3032, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.56% (0.2877 => 0.3037, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.42% (0.2802 => 0.2954, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.39% (0.1892 => 0.1994, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.38% (0.2714 => 0.2860, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.35% (0.8101 => 0.8534, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 5.15% (0.3379 => 0.3553, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 5.12% (0.2049 => 0.2154, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.04% (0.4064 => 0.4269, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.82% (14.3668 => 15.0591, std.dev.: 0.0239) MultiSource/Applications/sqlite3/sqlite3: 4.45% (17.1811 => 17.9449, std.dev.: 0.0300) SingleSource/Benchmarks/Shootout-C++/objinst: 4.41% (0.3131 => 0.3269, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.40% (1.2842 => 1.3407, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.38% (0.3427 => 0.3577, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (3.8922 => 4.0443, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.12% (1.1194 => 1.1543, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.83% (0.3817 => 0.3925, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.97% (1.1396 => 1.2532, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.22% (3.1595 => 3.4508, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3690, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.73% (3.6395 => 3.7752, std.dev.: 0.0038) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.68% (4.2280 => 4.3415, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.68% (0.8275 => 0.8414, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.35% (11.6436 => 11.8007, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.18% (2.6546 => 2.6860, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1311, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.12% (0.8651 => 0.1720, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.22% (5.2763 => 3.2597, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.28% (5.3855 => 3.7011, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.90% (5.3526 => 3.6986, std.dev.: 0.0075) SingleSource/UnitTests/Vector/constpool: -14.73% (54.1659 => 46.1887, std.dev.: 0.0244) MultiSource/Applications/ClamAV/clamscan: -12.23% (22.1758 => 19.4639, std.dev.: 0.0120) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.32% (2.9384 => 2.6353, std.dev.: 0.0163) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.51% (1.1492 => 0.7641, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: -15.72% (1.6925 => 1.4265, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.43% (0.0998 => 0.0864, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.20% (1.2373 => 1.0987, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -10.73% (1.5373 => 1.3724, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/mason/mason: -10.13% (0.2161 => 0.1942, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.29% (19.9488 => 18.2954, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.74% (1.8329 => 1.7093, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5753, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.28% (1.6805 => 1.5918, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: -5.10% (1.5835 => 1.5028, std.dev.: 0.0049) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.33% (0.9957 => 0.9526, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.59% (3.2827 => 3.1649, std.dev.: 0.0084) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5060, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -3.01% (12.4730 => 12.0977, std.dev.: 0.0018) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.90% (8.6802 => 8.5151, std.dev.: 0.0089) SingleSource/Regression/C/uint64_to_float: -1.88% (0.5413 => 0.5311) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6781, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.65% (8.1563 => 8.0215, std.dev.: 0.0089) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -1.64% (10.2830 => 10.1148, std.dev.: 0.0161) SingleSource/UnitTests/Vector/multiplies: -1.54% (2.5528 => 2.5135, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4209, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.06% (6.2999 => 6.2332, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.88% (0.5229 => 0.5955, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 9.62% (14.9895 => 16.4316, std.dev.: 0.0155) MultiSource/Benchmarks/MallocBench/gs/gs: 7.88% (4.1105 => 4.4345, std.dev.: 0.0124) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.88% (1.1048 => 1.2582, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.97% (7.1582 => 7.8717, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.35% (0.6222 => 0.7426, std.dev.: 0.0030) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35800.00% (0.0001 => 0.0359, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.43% (0.1485 => 0.1434) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.52% (0.2116 => 0.0645, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 13 07:39:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 13 Oct 2012 09:39:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121013143901.D73762A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4843?compare_to=4841&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4843, Order: 165870, Start Time: 2012-10-13 13:16:06, End Time: 2012-10-13 14:41:54 To: 4841, Order: 165868, Start Time: 2012-10-13 11:21:21, End Time: 2012-10-13 12:47:05 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 1 (189 on baseline) Performance Improvements: 1 (41 on baseline) Added Tests: 0 (138 on baseline) Existing Failures: 1 (0 on baseline) Unchanged Tests: 1039 (673 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.51% (78.0536 => 80.0147, std.dev.: 0.5628) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Regression/C/uint64_to_float: -5.38% (0.5613 => 0.5311, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.31% (0.3210 => 0.3200, std.dev.: 0.0012) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.54% (0.3250 => 0.3200, std.dev.: 0.0012) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.55% (2.0176 => 2.4927, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.51% (0.1410 => 0.1671, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 17.31% (0.0826 => 0.0969, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.30% (0.0653 => 0.0766) MultiSource/Benchmarks/McCat/08-main/main: 16.81% (0.2243 => 0.2620) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.32% (0.1072 => 0.1247, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 14.31% (0.1013 => 0.1158, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.79% (0.0834 => 0.0949, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.38% (0.1413 => 0.1602, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.26% (0.1327 => 0.1503, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 13.16% (0.7038 => 0.7964, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.04% (0.1588 => 0.1795, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 13.03% (1.3693 => 1.5477, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.01% (3.9660 => 4.4820, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.97% (0.0964 => 0.1089) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.48% (0.2596 => 0.2920, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.42% (0.2721 => 0.3059, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.28% (0.9199 => 1.0329, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 12.27% (13.8202 => 15.5161, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.27% (0.5265 => 0.5911, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.24% (1.4563 => 1.6346, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 12.24% (0.1062 => 0.1192, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.18% (0.7710 => 0.8649, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 12.15% (0.4328 => 0.4854, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.13% (0.6959 => 0.7803, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.11% (1.2193 => 1.3670, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.02% (0.6283 => 0.7038, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 11.95% (0.5818 => 0.6513, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 11.86% (0.1003 => 0.1122, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 11.81% (0.0847 => 0.0947, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.77% (1.1364 => 1.2702, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 11.62% (0.5748 => 0.6416, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 11.47% (0.4062 => 0.4528, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.39% (0.3899 => 0.4343, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 11.25% (1.0313 => 1.1473, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 11.19% (0.7061 => 0.7851, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 11.16% (0.1075 => 0.1195, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.15% (0.1157 => 0.1286, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.12% (0.3130 => 0.3478, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 11.03% (1.1061 => 1.2281, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.97% (0.5577 => 0.6189, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.96% (0.3485 => 0.3867, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 10.90% (0.2781 => 0.3084, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.85% (0.0977 => 0.1083, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.83% (0.4791 => 0.5310, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.71% (0.4379 => 0.4848, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 10.68% (0.2995 => 0.3315, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 10.66% (0.3293 => 0.3644, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 10.65% (0.6744 => 0.7462, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: 10.64% (0.1589 => 0.1758, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.63% (0.4016 => 0.4443, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 10.61% (16.6129 => 18.3747, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.57% (0.1986 => 0.2196, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.52% (0.3022 => 0.3340, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.52% (0.3756 => 0.4151, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.47% (0.3246 => 0.3586, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 10.43% (0.3220 => 0.3556, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.43% (0.3489 => 0.3853, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.42% (0.2782 => 0.3072, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.42% (0.3580 => 0.3953, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 10.42% (0.2726 => 0.3010, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 10.42% (3.8646 => 4.2672, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.39% (0.2127 => 0.2348, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.36% (0.1014 => 0.1119, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 10.35% (0.1111 => 0.1226, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.35% (0.1865 => 0.2058, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 10.34% (0.3868 => 0.4268, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 10.34% (2.1791 => 2.4044, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.33% (0.2914 => 0.3215, std.dev.: 0.0023) MultiSource/Applications/treecc/treecc: 10.25% (1.9270 => 2.1245, std.dev.: 0.0025) MultiSource/Applications/d/make_dparser: 10.23% (3.1889 => 3.5152, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.19% (0.1276 => 0.1406, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 10.16% (0.8310 => 0.9154, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 10.15% (0.1478 => 0.1628, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.15% (0.2966 => 0.3267, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.15% (0.7460 => 0.8217, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 10.14% (0.3107 => 0.3422, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.09% (0.5637 => 0.6206, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 10.07% (0.3149 => 0.3466, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.07% (1.9828 => 2.1824, std.dev.: 0.0102) MultiSource/Applications/spiff/spiff: 10.06% (0.7506 => 0.8261, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.05% (0.4390 => 0.4831, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 10.04% (0.2690 => 0.2960, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 10.02% (0.3453 => 0.3799, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 10.02% (0.2925 => 0.3218) SingleSource/Benchmarks/Shootout-C++/except: 10.00% (0.2760 => 0.3036, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.99% (0.2023 => 0.2225, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 9.98% (0.2937 => 0.3230, std.dev.: 0.0076) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.97% (0.1435 => 0.1578, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary2: 9.93% (0.3192 => 0.3509, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.93% (7.2180 => 7.9344, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 9.92% (0.2761 => 0.3035, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 9.90% (0.2607 => 0.2865, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.89% (0.8698 => 0.9558, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.80% (0.2765 => 0.3036, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.79% (0.2655 => 0.2915, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 9.79% (0.3534 => 0.3880, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 9.78% (0.2628 => 0.2885, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.57% (0.2696 => 0.2954, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 9.43% (1.0594 => 1.1593, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 9.37% (0.2988 => 0.3268, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.31% (0.1569 => 0.1715, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 9.29% (0.1657 => 0.1811, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.22% (4.9865 => 5.4465, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.22% (0.6576 => 0.7182, std.dev.: 0.0028) MultiSource/Applications/SIBsim4/SIBsim4: 9.20% (1.2749 => 1.3922, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.08% (3.6692 => 4.0023, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.06% (1.3245 => 1.4445, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.06% (4.3801 => 4.7769, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.02% (4.4433 => 4.8443, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/objinst: 8.93% (0.2945 => 0.3208, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.92% (0.3755 => 0.4090, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 8.88% (0.3131 => 0.3409, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 8.85% (14.8535 => 16.1674, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.75% (0.8818 => 0.9590, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.72% (0.6135 => 0.6670, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.72% (0.1789 => 0.1945, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 8.65% (8.4961 => 9.2307, std.dev.: 0.0053) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.32% (0.2140 => 0.2318, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.28% (0.9108 => 0.9862, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.27% (0.2321 => 0.2513, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 8.27% (0.4113 => 0.4453, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.19% (1.5188 => 1.6432, std.dev.: 0.0168) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.18% (3.2742 => 3.5420, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.13% (1.1333 => 1.2254, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 8.07% (4.6629 => 5.0394, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 8.07% (0.4003 => 0.4326, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 7.92% (0.2008 => 0.2167, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.92% (0.3511 => 0.3789, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.89% (0.4805 => 0.5184, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 7.87% (0.6250 => 0.6742, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 7.87% (0.1385 => 0.1494, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 7.85% (3.7467 => 4.0409, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 7.85% (6.5754 => 7.0913, std.dev.: 0.0136) SingleSource/UnitTests/ObjC/exceptions: 7.79% (0.3914 => 0.4219, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.72% (0.3940 => 0.4244, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 7.69% (0.3578 => 0.3853) SingleSource/UnitTests/ObjC/for-in: 7.63% (0.3789 => 0.4078, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.53% (0.3663 => 0.3939, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.51% (0.2504 => 0.2692, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.47% (0.3601 => 0.3870, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 7.46% (0.3646 => 0.3918, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.42% (0.3650 => 0.3921, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.40% (1.2292 => 1.3201, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 7.34% (0.3623 => 0.3889, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.33% (0.3245 => 0.3483, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.22% (2.1007 => 2.2524, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.15% (6.2785 => 6.7275, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.73% (13.2842 => 14.1781, std.dev.: 0.0127) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.38% (0.1819 => 0.1935, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 5.68% (0.1777 => 0.1878, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.57% (0.2243 => 0.2368, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 5.11% (16.2614 => 17.0916, std.dev.: 0.0297) MultiSource/Applications/ClamAV/clamscan: 4.77% (14.5298 => 15.2226, std.dev.: 0.0057) MultiSource/Benchmarks/Bullet/bullet: 2.02% (33.2944 => 33.9678, std.dev.: 0.0133) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.64% (5.7573 => 7.5216, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/fbench: 23.80% (1.8175 => 2.2500, std.dev.: 0.0326) SingleSource/Benchmarks/Misc/richards_benchmark: 10.99% (1.1560 => 1.2830, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (3.1736 => 3.4147, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.35% (1.2998 => 1.3823, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0036, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.96% (11.2619 => 11.7075, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7748, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9852, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 3.34% (10.7476 => 11.1065, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.24% (7.4271 => 7.5933, std.dev.: 0.0052) MultiSource/Applications/lemon/lemon: 1.68% (1.4298 => 1.4538, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5131, std.dev.: 0.0034) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2123, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1880, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.20% (8.8259 => 8.9317, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5788, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0271, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 1.03% (12.4560 => 12.5848, std.dev.: 0.0064) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.89% (0.2670 => 0.1418, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.48% (0.4657 => 0.3936, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/mason/mason: -14.14% (0.0707 => 0.0607) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.16% (1.3813 => 1.1995, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.08% (1.3819 => 1.2011, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.30% (22.5627 => 22.2703, std.dev.: 0.0115) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.34% (0.0997 => 0.0864, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -12.11% (0.2238 => 0.1967, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.44% (1.2308 => 1.0900, std.dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.03% (20.3410 => 18.3001, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.72% (1.3780 => 1.2992, std.dev.: 0.0085) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742) SingleSource/UnitTests/Vector/multiplies: -5.12% (2.6470 => 2.5115, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.61% (0.9996 => 0.9535, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.54% (3.2729 => 3.1571, std.dev.: 0.0087) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.36% (1.7688 => 1.7093, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.59% (26.5159 => 25.8284, std.dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: -2.53% (0.5449 => 0.5311, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.42% (3.0263 => 2.9531, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -2.36% (1.9762 => 1.9295, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.00% (0.6589 => 0.6457, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7135, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/lists: -1.71% (6.3560 => 6.2472, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0075, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8644, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.25% (0.8342 => 0.8238, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4957, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2589, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.07% (6.6320 => 6.5612, std.dev.: 0.0115) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 13 09:16:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 13 Oct 2012 11:16:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121013161642.F20ED2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4844?compare_to=4842&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4844, Order: 165871, Start Time: 2012-10-13 14:58:46, End Time: 2012-10-13 16:18:35 To: 4842, Order: 165870, Start Time: 2012-10-13 13:09:40, End Time: 2012-10-13 14:29:20 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 1 (4 on baseline) Performance Regressions: 0 (162 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 952 (684 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.03% (0.3202 => 0.3201, std.dev.: 0.0004) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.12% (0.5955 => 0.5962, std.dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 0.01% (16.4316 => 16.4326, std.dev.: 0.0143) MultiSource/Benchmarks/Bullet/bullet: -0.04% (55.5369 => 55.5157, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/gs/gs: 0.04% (4.4345 => 4.4362, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0459 => 0.0459, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.22% (0.0460 => 0.0461) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.23% (0.0429 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.23% (0.0431 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0418 => 0.0418, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0420 => 0.0420, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.24% (0.0412 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.24% (0.0414 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.47% (0.0430 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0432 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0425 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.23% (0.0427 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.24% (0.0415 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0422 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.24% (0.0424 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0433 => 0.0433, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.68% (0.0438 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.24% (0.0410 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.24% (0.0411 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0422 => 0.0422, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.24% (0.0424 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.48% (0.0415 => 0.0413, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0415 => 0.0415, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.25% (0.0405 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0407 => 0.0407, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0405 => 0.0405, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.25% (0.0406 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.23% (0.0441 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.45% (0.0444 => 0.0442, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.25% (0.0404 => 0.0405, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0405 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.25% (0.0405 => 0.0406, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.25% (0.0406 => 0.0405, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0412 => 0.0412, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0414 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.06% (1.2582 => 1.2590, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.02% (7.8717 => 7.8699, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.24% (0.7426 => 0.7408, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.28% (0.0359 => 0.0360, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1434 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.16% (0.0645 => 0.0644, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.22% (63.2438 => 55.5157, std.dev.: 0.0024) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 33.47% (14.1553 => 18.8925, std.dev.: 0.0135) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.53% (3.4629 => 5.6628, std.dev.: 0.0008) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14227.64% (0.0720 => 10.3159, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952100.00% (0.0001 => 9.9522, std.dev.: 0.0010) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.55% (0.2554 => 0.4177, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 45.38% (10.3673 => 15.0718, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/richards_benchmark: 40.01% (0.1622 => 0.2271, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/distray/distray: 33.52% (0.1056 => 0.1410, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 18.44% (0.1432 => 0.1696, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.08% (7.0540 => 8.3292, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.67% (2.2022 => 2.5913, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.13% (0.1566 => 0.1803, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 13.56% (0.3282 => 0.3727, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.44% (1.7609 => 1.9975, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.09% (0.0871 => 0.0985, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 12.15% (0.1440 => 0.1615, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 11.81% (10.4361 => 11.6683, std.dev.: 0.0221) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.74% (0.1584 => 0.1770, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.46% (0.1143 => 0.1274, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.78% (0.3543 => 0.3925, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 10.71% (0.7433 => 0.8229, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 10.69% (0.1655 => 0.1832, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.68% (0.4879 => 0.5400, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.64% (0.1438 => 0.1591, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 10.60% (0.3473 => 0.3841, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.53% (0.3561 => 0.3936, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 10.33% (0.3543 => 0.3909, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 10.32% (0.3516 => 0.3879, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.32% (0.3497 => 0.3858, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/parameter-passing: 10.31% (0.3927 => 0.4332, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 10.27% (9.4845 => 10.4584, std.dev.: 0.0124) MultiSource/Applications/minisat/minisat: 10.18% (0.7115 => 0.7839, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/for-in: 10.15% (0.3694 => 0.4069, std.dev.: 0.0071) SingleSource/UnitTests/ObjC/property: 10.14% (0.3886 => 0.4280, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.09% (0.1625 => 0.1789, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 10.08% (0.3828 => 0.4214, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.04% (0.3177 => 0.3496, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.96% (0.6675 => 0.7340, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 9.96% (0.1175 => 0.1292, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.93% (0.2700 => 0.2968, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.91% (1.5415 => 1.6942, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 9.75% (0.3109 => 0.3412, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 9.73% (0.3423 => 0.3756, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 9.71% (3.3354 => 3.6593, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/em3d/em3d: 9.50% (0.1695 => 0.1856, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.43% (0.4615 => 0.5050, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 9.28% (5.7591 => 6.2935, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.15% (0.5105 => 0.5572, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.11% (0.5860 => 0.6394, std.dev.: 0.0108) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.09% (4.2646 => 4.6523, std.dev.: 0.0052) MultiSource/Applications/aha/aha: 9.04% (0.1151 => 0.1255, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.96% (0.5569 => 0.6068, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.94% (0.1510 => 0.1645, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.89% (0.2271 => 0.2473, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.87% (1.3050 => 1.4208, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.84% (5.0018 => 5.4438, std.dev.: 0.0036) MultiSource/Applications/viterbi/viterbi: 8.81% (0.1555 => 0.1692, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 8.80% (3.8723 => 4.2129, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.78% (0.2107 => 0.2292, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.77% (0.1163 => 0.1265, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 8.77% (1.1642 => 1.2663, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.76% (0.1940 => 0.2110, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.74% (0.1236 => 0.1344, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.73% (0.8067 => 0.8771, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.69% (0.8172 => 0.8882, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.68% (8.1363 => 8.8429, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.66% (4.9449 => 5.3730, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.57% (0.2065 => 0.2242, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.57% (7.9617 => 8.6438, std.dev.: 0.0155) MultiSource/Benchmarks/sim/sim: 8.50% (0.3387 => 0.3675, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.49% (0.3121 => 0.3386, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.48% (0.2758 => 0.2992, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 8.48% (1.5603 => 1.6926, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.40% (0.9765 => 1.0585, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 8.33% (0.7835 => 0.8488, std.dev.: 0.0060) MultiSource/Applications/lemon/lemon: 8.29% (1.0722 => 1.1611, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.29% (0.5020 => 0.5436, std.dev.: 0.0136) MultiSource/Applications/treecc/treecc: 8.22% (2.0273 => 2.1939, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/bigfib: 8.12% (0.6456 => 0.6980, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.04% (0.3307 => 0.3573, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.00% (0.5925 => 0.6399, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.91% (0.6030 => 0.6507, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.85% (0.1337 => 0.1442, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 7.83% (0.3180 => 0.3429, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 7.69% (2.2969 => 2.4735, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.65% (1.5859 => 1.7073, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.61% (0.3441 => 0.3703, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.56% (1.1861 => 1.2758, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.38% (0.4103 => 0.4406, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.26% (0.6450 => 0.6918, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 7.19% (0.7326 => 0.7853, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.19% (0.3865 => 0.4143, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.16% (0.4636 => 0.4968, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 7.16% (21.9371 => 23.5069, std.dev.: 0.0095) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.15% (0.2603 => 0.2789, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 7.14% (0.4299 => 0.4606, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 7.02% (0.4289 => 0.4590, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: 7.01% (0.8921 => 0.9546, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.97% (0.4203 => 0.4496, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 6.87% (0.3422 => 0.3657, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.86% (0.5981 => 0.6391, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.69% (0.3826 => 0.4082, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (0.4620 => 0.4927, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.63% (0.3650 => 0.3892, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.62% (2.2024 => 2.3483, std.dev.: 0.0218) SingleSource/Benchmarks/Shootout-C++/moments: 6.57% (0.4048 => 0.4314, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.56% (1.4186 => 1.5116, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.37% (0.1695 => 0.1803, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.33% (0.2891 => 0.3074, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.24% (0.3603 => 0.3828, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.20% (0.3162 => 0.3358, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.19% (0.3136 => 0.3330, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 6.16% (0.2905 => 0.3084, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/lists1: 6.11% (0.3684 => 0.3909, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 6.07% (1.1840 => 1.2559, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.06% (2.0665 => 2.1918, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.98% (0.1906 => 0.2020, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.87% (0.2266 => 0.2399, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: 5.78% (0.3098 => 0.3277, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.77% (0.3052 => 0.3228, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 5.76% (0.2831 => 0.2994, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.70% (0.2756 => 0.2913, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/except: 5.68% (0.2871 => 0.3034, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.66% (0.3232 => 0.3415, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 5.65% (0.2725 => 0.2879, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.64% (0.2872 => 0.3034, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.57% (0.3283 => 0.3466, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.48% (0.2793 => 0.2946, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 5.46% (0.2877 => 0.3034, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.42% (0.8101 => 0.8540, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hello: 5.42% (0.2714 => 0.2861, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.39% (0.1892 => 0.1994, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.39% (0.2802 => 0.2953, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 5.17% (0.2049 => 0.2155, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 5.15% (0.3379 => 0.3553, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.12% (0.4064 => 0.4272, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.92% (14.3668 => 15.0737, std.dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: 4.48% (17.1811 => 17.9515, std.dev.: 0.0149) MultiSource/Applications/hexxagon/hexxagon: 4.37% (1.2842 => 1.3403, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 4.34% (0.3131 => 0.3267, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.32% (0.3427 => 0.3575, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.12% (0.2430 => 0.2530, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (3.8922 => 4.0440, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.21% (1.1194 => 1.1553, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.75% (0.3817 => 0.3922, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8953, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.55% (0.2944 => 0.3284, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.84% (1.1396 => 1.2517, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 9.22% (3.1595 => 3.4508, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (3.1578 => 3.3679, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.60% (3.6395 => 3.7706, std.dev.: 0.0025) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.73% (4.2280 => 4.3433, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.28% (1.7254 => 1.7648, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.72% (0.8275 => 0.8417, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.35% (11.6436 => 11.8013, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.18% (2.6546 => 2.6858, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.15% (6.5088 => 6.5836, std.dev.: 0.0044) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1313, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.13% (0.8651 => 0.1719, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.27% (5.2763 => 3.2572, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.31% (5.3855 => 3.6993, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.93% (5.3526 => 3.6973, std.dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -14.68% (54.1659 => 46.2134, std.dev.: 0.0559) MultiSource/Applications/ClamAV/clamscan: -12.30% (22.1758 => 19.4484, std.dev.: 0.0210) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.28% (2.9384 => 2.6362, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.45% (1.1492 => 0.7648, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.86% (1.6925 => 1.4241, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.83% (0.0998 => 0.0860, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.95% (1.2373 => 1.0895, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/mandel-2: -10.32% (1.5373 => 1.3787, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/mason/mason: -9.90% (0.2161 => 0.1947, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.23% (19.9488 => 18.3077, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.78% (1.8329 => 1.7087, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.32% (1.6805 => 1.5911, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7962, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7614, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.83% (1.5835 => 1.5070, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.74% (3.2827 => 3.1599, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.63% (0.9957 => 0.9596, std.dev.: 0.0071) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5047, std.dev.: 0.0037) MultiSource/Applications/hexxagon/hexxagon: -2.99% (12.4730 => 12.1001, std.dev.: 0.0013) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.06% (8.1563 => 7.9879, std.dev.: 0.0140) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.05% (8.6802 => 8.5026, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0849, std.dev.: 0.0140) SingleSource/Regression/C/uint64_to_float: -1.88% (0.5413 => 0.5311) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6820, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.58% (2.5528 => 2.5125, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4229, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 14.02% (0.5229 => 0.5962, std.dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 9.63% (14.9895 => 16.4326, std.dev.: 0.0143) MultiSource/Benchmarks/MallocBench/gs/gs: 7.92% (4.1105 => 4.4362, std.dev.: 0.0084) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.96% (1.1048 => 1.2590, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.94% (7.1582 => 7.8699, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.06% (0.6222 => 0.7408, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35900.00% (0.0001 => 0.0360, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.57% (0.2116 => 0.0644, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 13 09:33:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 13 Oct 2012 11:33:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121013163332.5E04C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4845?compare_to=4843&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4845, Order: 165871, Start Time: 2012-10-13 15:10:52, End Time: 2012-10-13 16:36:24 To: 4843, Order: 165870, Start Time: 2012-10-13 13:16:06, End Time: 2012-10-13 14:41:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Passes: 1 (0 on baseline) Performance Regressions: 0 (186 on baseline) Performance Improvements: 1 (41 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1040 (677 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.03% (0.3200 => 0.3201, std.dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.34% (56.4455 => 54.5627, std.dev.: 0.2210) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.54% (2.0176 => 2.4925, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.51% (0.1410 => 0.1671, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 17.43% (0.0826 => 0.0970, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.15% (0.0653 => 0.0765, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 16.85% (0.2243 => 0.2621, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.42% (0.1072 => 0.1248, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 14.22% (0.1013 => 0.1157, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.79% (0.0834 => 0.0949, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.45% (0.1413 => 0.1603, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.26% (0.1327 => 0.1503, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 13.23% (0.7038 => 0.7969, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 13.08% (1.3693 => 1.5484, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.97% (0.1588 => 0.1794, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.96% (3.9660 => 4.4799, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.76% (0.0964 => 0.1087, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.48% (0.2596 => 0.2920, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 12.34% (0.1062 => 0.1193, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.27% (0.2721 => 0.3055, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.27% (0.5265 => 0.5911, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.26% (0.9199 => 1.0327, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.23% (0.6959 => 0.7810, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.22% (1.4563 => 1.6342, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 12.22% (13.8202 => 15.5084, std.dev.: 0.0081) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.19% (0.7710 => 0.8650, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.08% (1.2193 => 1.3666, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 12.04% (0.4328 => 0.4849, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.98% (0.6283 => 0.7036, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 11.96% (0.1003 => 0.1123, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 11.88% (0.5818 => 0.6509, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.71% (1.1364 => 1.2695, std.dev.: 0.0082) SingleSource/UnitTests/ObjC++/Hello: 11.50% (0.5748 => 0.6409, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.39% (0.3899 => 0.4343, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 11.37% (0.4062 => 0.4524, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 11.27% (1.0313 => 1.1475, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.18% (0.3130 => 0.3480, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 11.09% (0.7061 => 0.7844, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 11.07% (0.1075 => 0.1194, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.06% (0.5577 => 0.6194, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.06% (0.1157 => 0.1285, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 10.98% (1.1061 => 1.2275, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.90% (0.3485 => 0.3865, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 10.86% (0.2781 => 0.3083, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.79% (0.4791 => 0.5308, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.73% (0.1986 => 0.2199, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 10.72% (0.2995 => 0.3316, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.69% (0.4379 => 0.4847, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.64% (0.0977 => 0.1081, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 10.64% (16.6129 => 18.3801, std.dev.: 0.0283) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.58% (0.4016 => 0.4441, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 10.57% (0.1589 => 0.1757, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 10.57% (0.3293 => 0.3641, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 10.56% (0.2726 => 0.3014, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.49% (0.3022 => 0.3339, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 10.48% (0.6744 => 0.7451, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.47% (0.3246 => 0.3586, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.46% (0.3756 => 0.4149, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 10.44% (0.1111 => 0.1227, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.40% (0.3489 => 0.3852, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 10.39% (3.8646 => 4.2662, std.dev.: 0.0040) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.36% (0.2914 => 0.3216, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.34% (0.3580 => 0.3950, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 10.31% (0.3220 => 0.3552, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.30% (0.2127 => 0.2346, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 10.29% (2.1791 => 2.4034, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.28% (0.2782 => 0.3068, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 10.28% (1.9270 => 2.1251, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.26% (0.1014 => 0.1118, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 10.24% (0.3868 => 0.4264, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.20% (0.7460 => 0.8221, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.19% (0.1276 => 0.1406, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.19% (0.1865 => 0.2055, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.18% (0.5637 => 0.6211, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 10.16% (3.1889 => 3.5130, std.dev.: 0.0052) MultiSource/Applications/viterbi/viterbi: 10.15% (0.1478 => 0.1628, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 10.14% (0.8310 => 0.9153, std.dev.: 0.0043) MultiSource/Applications/spiff/spiff: 10.14% (0.7506 => 0.8267, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.08% (0.2966 => 0.3265, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 10.07% (0.3107 => 0.3420, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/ary3: 10.07% (0.3149 => 0.3466, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.03% (0.1435 => 0.1579, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.96% (1.9828 => 2.1803, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 9.95% (0.2925 => 0.3216, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 9.93% (0.2760 => 0.3034, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.91% (7.2180 => 7.9334, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.91% (0.4390 => 0.4825, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.87% (0.2655 => 0.2917, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.84% (0.2023 => 0.2222, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.82% (0.8698 => 0.9552, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 9.82% (0.3453 => 0.3792, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 9.79% (0.3534 => 0.3880, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary2: 9.74% (0.3192 => 0.3503, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 9.74% (0.2761 => 0.3030, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 9.74% (0.2690 => 0.2952, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.69% (0.2765 => 0.3033, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 9.67% (0.2607 => 0.2859, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 9.59% (0.2628 => 0.2880, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/wc: 9.57% (0.2937 => 0.3218, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 9.41% (0.1657 => 0.1813, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 9.37% (1.0594 => 1.1587, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 9.34% (0.2988 => 0.3267, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.31% (0.2696 => 0.2947, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.31% (0.1569 => 0.1715, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 9.19% (1.2749 => 1.3920, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.13% (1.3245 => 1.4454, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.12% (0.6576 => 0.7176, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.07% (4.9865 => 5.4388, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.05% (3.6692 => 4.0012, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.01% (4.3801 => 4.7748, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.99% (4.4433 => 4.8429, std.dev.: 0.0057) MultiSource/Applications/JM/lencod/lencod: 8.88% (14.8535 => 16.1726, std.dev.: 0.0129) MultiSource/Benchmarks/sim/sim: 8.82% (0.3131 => 0.3407, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.79% (0.3755 => 0.4085, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.78% (0.8818 => 0.9592, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 8.76% (0.2945 => 0.3203, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 8.68% (8.4961 => 9.2334, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.66% (0.1789 => 0.1944, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.64% (0.6135 => 0.6665, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.36% (0.2140 => 0.2319) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.27% (0.2321 => 0.2513, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.26% (0.9108 => 0.9860, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.22% (1.5188 => 1.6437, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.15% (3.2742 => 3.5409, std.dev.: 0.0037) MultiSource/Applications/oggenc/oggenc: 8.15% (4.6629 => 5.0427, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 8.14% (0.4113 => 0.4448, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.12% (0.4003 => 0.4328, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.06% (1.1333 => 1.2246, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.86% (0.3511 => 0.3787, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.85% (0.4805 => 0.5182, std.dev.: 0.0129) SingleSource/UnitTests/ObjC/exceptions: 7.79% (0.3914 => 0.4219, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 7.79% (3.7467 => 4.0386, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 7.76% (0.6250 => 0.6735, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 7.74% (6.5754 => 7.0843, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/neural/neural: 7.73% (0.1385 => 0.1492, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.72% (0.3940 => 0.4244, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 7.62% (0.2008 => 0.2161, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.57% (0.3789 => 0.4076, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.57% (0.3578 => 0.3849, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 7.52% (0.3646 => 0.3920, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.47% (0.2504 => 0.2691, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/exceptions-2: 7.44% (0.3601 => 0.3869, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.43% (0.3663 => 0.3935, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.34% (0.3650 => 0.3918, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.34% (0.3623 => 0.3889, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.27% (1.2292 => 1.3186, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.24% (2.1007 => 2.2528, std.dev.: 0.0048) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.14% (6.2785 => 6.7270, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.12% (0.3245 => 0.3476, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.72% (13.2842 => 14.1774, std.dev.: 0.0092) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.32% (0.1819 => 0.1934, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.66% (0.2243 => 0.2370, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 5.63% (0.1777 => 0.1877, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 5.17% (16.2614 => 17.1029, std.dev.: 0.0214) MultiSource/Applications/ClamAV/clamscan: 4.71% (14.5298 => 15.2141, std.dev.: 0.0142) MultiSource/Benchmarks/Bullet/bullet: 1.98% (33.2944 => 33.9547, std.dev.: 0.0160) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5143, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.06% (1.0895 => 1.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.07% (1.8175 => 2.2550, std.dev.: 0.0381) SingleSource/Benchmarks/Misc/richards_benchmark: 11.04% (1.1560 => 1.2836, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4140, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 6.26% (1.2998 => 1.3812, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626) SingleSource/Benchmarks/Misc/flops-5: 4.64% (1.9144 => 2.0032, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.49% (0.3139 => 0.3280, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.92% (11.2619 => 11.7032, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7747, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.66% (10.7476 => 11.1406, std.dev.: 0.0400) SingleSource/Benchmarks/Misc/flops-6: 3.52% (1.9199 => 1.9874, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.13% (7.4271 => 7.5853, std.dev.: 0.0020) MultiSource/Applications/lemon/lemon: 1.61% (1.4298 => 1.4528, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0508, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5123, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2123, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1875, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5783, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 1.15% (12.4560 => 12.5990, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0274, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.89% (0.2670 => 0.1418, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.59% (0.4657 => 0.3931, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/mason/mason: -14.14% (0.0707 => 0.0607) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.17% (1.3813 => 1.1994, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.15% (1.3819 => 1.2002, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.44% (22.5627 => 22.2381, std.dev.: 0.0205) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.44% (0.0997 => 0.0863, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -12.11% (0.2238 => 0.1967, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -11.37% (1.2308 => 1.0908, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.04% (20.3410 => 18.2992, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.28% (1.3780 => 1.3052, std.dev.: 0.0102) SingleSource/UnitTests/Vector/multiplies: -5.10% (2.6470 => 2.5121, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.42% (0.9996 => 0.9554, std.dev.: 0.0064) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0009) MultiSource/Applications/siod/siod: -3.51% (3.2729 => 3.1579, std.dev.: 0.0097) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.45% (1.7688 => 1.7078, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: -2.55% (0.5449 => 0.5310, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.48% (26.5159 => 25.8579, std.dev.: 0.0261) MultiSource/Applications/spiff/spiff: -2.44% (3.0263 => 2.9524, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.32% (1.9762 => 1.9303, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: -1.87% (6.3560 => 6.2374, std.dev.: 0.0085) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7139, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0068, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.26% (0.8342 => 0.8237, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: -1.25% (9.3358 => 9.2195, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout/heapsort: -1.22% (3.9173 => 3.8696, std.dev.: 0.0155) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4956, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2581, std.dev.: 0.0006) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 13 11:12:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 13 Oct 2012 13:12:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121013181202.A64212A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4846?compare_to=4844&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4846, Order: 165872, Start Time: 2012-10-13 16:54:05, End Time: 2012-10-13 18:13:54 To: 4844, Order: 165871, Start Time: 2012-10-13 14:58:46, End Time: 2012-10-13 16:18:35 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (158 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 953 (687 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.22% (0.5962 => 0.5949, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: -0.42% (16.4326 => 16.3637, std.dev.: 0.0216) MultiSource/Benchmarks/Bullet/bullet: -0.32% (55.5157 => 55.3404, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/gs/gs: -0.11% (4.4362 => 4.4312, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.22% (0.0459 => 0.0458, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.22% (0.0461 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.23% (0.0430 => 0.0429) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.23% (0.0430 => 0.0429, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0418 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0420 => 0.0420, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0413 => 0.0413, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.24% (0.0415 => 0.0414) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.46% (0.0432 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0432 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.24% (0.0425 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0426 => 0.0426) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.24% (0.0414 => 0.0413, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.24% (0.0417 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.24% (0.0422 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0423 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0433 => 0.0433) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0435 => 0.0435, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.49% (0.0411 => 0.0409, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.49% (0.0412 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.24% (0.0422 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0423 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0413 => 0.0413) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0415 => 0.0415) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.25% (0.0406 => 0.0405, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0407 => 0.0407, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.25% (0.0405 => 0.0404) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.49% (0.0407 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.23% (0.0442 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0442 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.49% (0.0405 => 0.0403, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.25% (0.0405 => 0.0404, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.74% (0.0406 => 0.0403, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.25% (0.0405 => 0.0406) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0412 => 0.0412, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0414 => 0.0414, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.20% (1.2590 => 1.2565, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.22% (7.8699 => 7.8525, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.03% (0.7408 => 0.7410, std.dev.: 0.0029) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0360 => 0.0360, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1433 => 0.1434, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.31% (0.0644 => 0.0646, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.50% (63.2438 => 55.3404, std.dev.: 0.0034) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 33.08% (14.1553 => 18.8372, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.39% (3.4629 => 5.6580, std.dev.: 0.0027) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14231.94% (0.0720 => 10.3190, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9951800.00% (0.0001 => 9.9519, std.dev.: 0.0016) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 62.92% (0.2554 => 0.4161, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 45.89% (10.3673 => 15.1247, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/richards_benchmark: 38.16% (0.1622 => 0.2241, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 33.43% (0.1056 => 0.1409) SingleSource/Benchmarks/Misc/flops: 18.02% (0.1432 => 0.1690, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.10% (7.0540 => 8.2604, std.dev.: 0.0108) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.87% (2.2022 => 2.5737, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.94% (0.1566 => 0.1800, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 12.98% (0.3282 => 0.3708, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.86% (0.0871 => 0.0983, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.65% (1.7609 => 1.9837, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/power/power: 12.01% (0.1440 => 0.1613, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.68% (0.1584 => 0.1769, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 11.29% (10.4361 => 11.6145, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.23% (0.3543 => 0.3941, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.14% (0.1625 => 0.1806, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.74% (0.3473 => 0.3846, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.47% (0.3561 => 0.3934, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/exceptions-4: 10.47% (0.3543 => 0.3914, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.47% (0.3516 => 0.3884, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.47% (0.3497 => 0.3863, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 10.39% (0.7433 => 0.8205, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/parameter-passing: 10.34% (0.3927 => 0.4333, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.29% (0.3694 => 0.4074, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 10.25% (0.7115 => 0.7844, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions: 10.21% (0.3828 => 0.4219, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.17% (0.4879 => 0.5375, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 10.14% (0.3886 => 0.4280, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 10.04% (0.1175 => 0.1293, std.dev.: 0.0031) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.97% (0.1143 => 0.1257, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.94% (0.1438 => 0.1581, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 9.89% (9.4845 => 10.4226, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.76% (0.3177 => 0.3487, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.72% (1.5415 => 1.6913, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.68% (0.6675 => 0.7321, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 9.56% (3.3354 => 3.6542, std.dev.: 0.0034) SingleSource/Benchmarks/McGill/chomp: 9.55% (0.1655 => 0.1813, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.52% (0.2700 => 0.2957, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 9.49% (0.3423 => 0.3748, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 9.39% (0.3109 => 0.3401, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.30% (0.4615 => 0.5044, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 9.26% (0.1695 => 0.1852, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.06% (0.5860 => 0.6391, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.00% (4.2646 => 4.6484, std.dev.: 0.0039) MultiSource/Applications/oggenc/oggenc: 8.98% (5.7591 => 6.2764, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.90% (1.3050 => 1.4211, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.89% (0.5105 => 0.5559, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.89% (0.5569 => 0.6064, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.87% (0.1510 => 0.1644, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.82% (0.1236 => 0.1345, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.81% (0.2271 => 0.2471, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 8.80% (1.1642 => 1.2667, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.78% (0.2107 => 0.2292, std.dev.: 0.0016) MultiSource/Applications/aha/aha: 8.77% (0.1151 => 0.1252, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.75% (0.8172 => 0.8887, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.69% (0.8067 => 0.8768, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 8.68% (0.1555 => 0.1690, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.67% (0.2758 => 0.2997, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.61% (0.1940 => 0.2107, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.55% (5.0018 => 5.4297, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 8.55% (1.5603 => 1.6937, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 8.52% (3.8723 => 4.2023, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.52% (0.9765 => 1.0597, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.42% (8.1363 => 8.8212, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.38% (4.9449 => 5.3595, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.36% (0.3121 => 0.3382, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 8.30% (0.3387 => 0.3668, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 8.28% (2.0273 => 2.1952, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.28% (0.2065 => 0.2236, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.23% (0.1337 => 0.1447, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 8.23% (1.0722 => 1.1604, std.dev.: 0.0133) MultiSource/Applications/spiff/spiff: 8.22% (0.7835 => 0.8479, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.07% (0.5020 => 0.5425, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 8.01% (0.6456 => 0.6973, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.81% (7.9617 => 8.5836, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.68% (0.3307 => 0.3561, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 7.64% (0.3180 => 0.3423, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.59% (0.3441 => 0.3702, std.dev.: 0.0028) MultiSource/Applications/siod/siod: 7.58% (2.2969 => 2.4710, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.56% (1.5859 => 1.7058, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.39% (1.1861 => 1.2737, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.34% (0.5925 => 0.6360, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.34% (0.2603 => 0.2794, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.26% (0.6030 => 0.6468, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.12% (0.4103 => 0.4395, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 7.01% (0.8921 => 0.9546, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.99% (0.6450 => 0.6901, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.97% (0.4289 => 0.4588, std.dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 6.91% (21.9371 => 23.4534, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.86% (0.3865 => 0.4130, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.82% (0.5981 => 0.6389, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 6.82% (0.4299 => 0.4592, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 6.81% (0.3422 => 0.3655, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.71% (0.4203 => 0.4485, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.70% (2.2024 => 2.3500, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (0.4620 => 0.4928, std.dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference: 6.66% (0.7326 => 0.7814, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.66% (0.3650 => 0.3893, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.52% (0.4048 => 0.4312, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.38% (0.3826 => 0.4070, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.34% (1.4186 => 1.5086, std.dev.: 0.0084) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.23% (0.4636 => 0.4925, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.14% (0.1695 => 0.1799, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.05% (0.3603 => 0.3821, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 6.05% (1.1840 => 1.2556, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.99% (0.3136 => 0.3324, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 5.99% (0.2905 => 0.3079, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.91% (0.3162 => 0.3349, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 5.89% (0.3684 => 0.3901, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.83% (2.0665 => 2.1869, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.78% (0.2891 => 0.3058, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.77% (0.1906 => 0.2016, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 5.65% (0.2831 => 0.2991, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.65% (0.3098 => 0.3273, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.60% (0.8101 => 0.8555, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 5.48% (0.3232 => 0.3409, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.47% (0.2872 => 0.3029, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.43% (0.2266 => 0.2389, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.42% (0.3283 => 0.3461, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.41% (0.2756 => 0.2905, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.40% (0.2871 => 0.3026, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.34% (0.3052 => 0.3215, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.32% (0.2725 => 0.2870, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.32% (0.2877 => 0.3030, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.32% (0.2802 => 0.2951, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.23% (0.2793 => 0.2939, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.19% (0.4064 => 0.4275, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.16% (0.2714 => 0.2854, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.12% (0.3379 => 0.3552, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.75% (14.3668 => 15.0491, std.dev.: 0.0256) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.46% (0.3427 => 0.3580, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 4.44% (17.1811 => 17.9441, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/objinst: 4.28% (0.3131 => 0.3265, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.20% (0.2430 => 0.2532, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.17% (1.2842 => 1.3377, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.81% (3.8922 => 4.0406, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.92% (1.1194 => 1.1521, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.91% (0.3817 => 0.3928, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.22% (1.1145 => 1.3844, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.95% (1.1396 => 1.2530, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 9.21% (3.1595 => 3.4506, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.70% (3.1578 => 3.3695, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.42% (3.6395 => 3.7638, std.dev.: 0.0047) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.67% (4.2280 => 4.3408, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7652, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.73% (0.8275 => 0.8418, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.35% (11.6436 => 11.8008, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.23% (2.6546 => 2.6873, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.05% (6.6874 => 0.1307, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.11% (0.8651 => 0.1721, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.50% (5.2763 => 3.2449, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.64% (5.3855 => 3.6813, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.30% (5.3526 => 3.6773, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -14.61% (54.1659 => 46.2516, std.dev.: 0.0187) MultiSource/Applications/ClamAV/clamscan: -12.30% (22.1758 => 19.4485, std.dev.: 0.0123) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.41% (2.9384 => 2.6325, std.dev.: 0.0168) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -16.00% (1.6925 => 1.4217, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.73% (0.0998 => 0.0861, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.20% (1.2373 => 1.0987, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -10.28% (1.5373 => 1.3792, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/mason/mason: -10.09% (0.2161 => 0.1943, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.29% (19.9488 => 18.2948, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.64% (1.8329 => 1.7112, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5753, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.31% (1.6805 => 1.5912, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5072, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.35% (0.9957 => 0.9524, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.59% (3.2827 => 3.1650, std.dev.: 0.0088) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5020, std.dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: -2.99% (12.4730 => 12.1002, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.12% (8.6802 => 8.4965, std.dev.: 0.0145) SingleSource/Regression/C/uint64_to_float: -1.88% (0.5413 => 0.5311) SingleSource/Benchmarks/Misc/salsa20: -1.82% (10.2830 => 10.0962, std.dev.: 0.0136) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.81% (8.1563 => 8.0085, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6807, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.65% (2.5528 => 2.5107, std.dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4234, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.19% (6.2999 => 6.2248, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.77% (0.5229 => 0.5949, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 9.17% (14.9895 => 16.3637, std.dev.: 0.0216) MultiSource/Benchmarks/MallocBench/gs/gs: 7.80% (4.1105 => 4.4312, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.73% (1.1048 => 1.2565, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.70% (7.1582 => 7.8525, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.09% (0.6222 => 0.7410, std.dev.: 0.0029) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35900.00% (0.0001 => 0.0360, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.43% (0.1485 => 0.1434, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.47% (0.2116 => 0.0646, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 13 11:28:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 13 Oct 2012 13:28:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121013182810.85E782A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4847?compare_to=4845&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4847, Order: 165872, Start Time: 2012-10-13 17:05:24, End Time: 2012-10-13 18:31:02 To: 4845, Order: 165871, Start Time: 2012-10-13 15:10:52, End Time: 2012-10-13 16:36:24 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (186 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1040 (677 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.58% (54.5627 => 56.5140, std.dev.: 0.1012) SingleSource/Benchmarks/Misc/lowercase: 1.28% (7.9397 => 8.0412, std.dev.: 0.0060) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.65% (2.0176 => 2.4947, std.dev.: 0.0040) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.44% (0.1410 => 0.1670, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.76% (0.0653 => 0.0769, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 17.19% (0.0826 => 0.0968, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 16.81% (0.2243 => 0.2620, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.70% (0.1072 => 0.1251, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 14.22% (0.1013 => 0.1157, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.67% (0.0834 => 0.0948, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.56% (0.1327 => 0.1507, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.52% (0.1413 => 0.1604, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 13.30% (0.7038 => 0.7974, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 12.99% (1.3693 => 1.5472, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.88% (3.9660 => 4.4767, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.85% (0.1588 => 0.1792, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.76% (0.0964 => 0.1087, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.68% (0.2721 => 0.3066, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.52% (0.2596 => 0.2921, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 12.24% (0.1062 => 0.1192, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.13% (0.9199 => 1.0315, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.13% (0.6959 => 0.7803, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.12% (0.5265 => 0.5903, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 12.06% (0.1003 => 0.1124, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.06% (1.4563 => 1.6319, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 12.05% (13.8202 => 15.4849, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/hash2: 11.97% (0.4328 => 0.4846, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.97% (1.2193 => 1.3652, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.88% (0.7710 => 0.8626, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.76% (0.6283 => 0.7022, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash: 11.74% (0.4062 => 0.4539, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 11.71% (0.5818 => 0.6499, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.49% (0.3899 => 0.4347, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 11.45% (0.5748 => 0.6406, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.40% (1.1364 => 1.2659, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.24% (0.1157 => 0.1287, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 11.18% (1.0313 => 1.1466, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.12% (0.3130 => 0.3478, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 11.07% (0.7061 => 0.7843, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.99% (0.5577 => 0.6190, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 10.93% (1.1061 => 1.2270, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.88% (0.3485 => 0.3864, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.79% (0.1075 => 0.1191, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 10.79% (0.2781 => 0.3081, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 10.69% (16.6129 => 18.3885, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.60% (0.4791 => 0.5299, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 10.60% (0.3293 => 0.3642) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.57% (0.1986 => 0.2196, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.56% (0.4016 => 0.4440, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.54% (0.0977 => 0.1080, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.52% (0.3022 => 0.3340, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.52% (0.3756 => 0.4151, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 10.51% (0.1589 => 0.1756, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.48% (0.4379 => 0.4838, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 10.44% (0.3868 => 0.4272, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.43% (0.3489 => 0.3853, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.42% (0.3580 => 0.3953, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 10.39% (3.8646 => 4.2663, std.dev.: 0.0032) MultiSource/Applications/sgefa/sgefa: 10.38% (0.2995 => 0.3306, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.32% (0.3246 => 0.3581, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.32% (0.2782 => 0.3069, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 10.31% (0.6744 => 0.7439, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.28% (0.2966 => 0.3271, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 10.28% (0.3220 => 0.3551, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 10.27% (2.1791 => 2.4029, std.dev.: 0.0166) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.23% (0.2914 => 0.3212, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 10.21% (1.9270 => 2.1238, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 10.20% (0.2726 => 0.3004, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 10.17% (0.1111 => 0.1224, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.16% (0.1014 => 0.1117, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 10.15% (3.1889 => 3.5126, std.dev.: 0.0152) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.11% (0.2127 => 0.2342, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 10.08% (0.8310 => 0.9148, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.03% (0.1276 => 0.1404, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.03% (0.7460 => 0.8208, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.03% (0.1865 => 0.2052, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.02% (0.5637 => 0.6202, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/09-vor/vor: 10.02% (0.2925 => 0.3218, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary3: 10.00% (0.3149 => 0.3464, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 9.99% (0.7506 => 0.8256, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.98% (1.9828 => 2.1806, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/sieve: 9.93% (0.3453 => 0.3796, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.90% (0.1435 => 0.1577, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 9.89% (0.2761 => 0.3034, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 9.88% (0.3107 => 0.3414, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 9.88% (0.1478 => 0.1624, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.86% (0.4390 => 0.4823, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.84% (0.8698 => 0.9554, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/random: 9.81% (0.2690 => 0.2954, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.80% (0.2765 => 0.3036, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.79% (0.2023 => 0.2221, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 9.78% (0.2760 => 0.3030, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 9.78% (0.2607 => 0.2862, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.76% (0.2655 => 0.2914, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.74% (7.2180 => 7.9209, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/lists1: 9.73% (0.3534 => 0.3878, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 9.71% (0.3192 => 0.3502, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 9.67% (0.2937 => 0.3221, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 9.55% (0.2628 => 0.2879, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.37% (0.1569 => 0.1716, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.35% (0.2696 => 0.2948, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 9.30% (0.2988 => 0.3266, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/em3d/em3d: 9.23% (0.1657 => 0.1810, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 9.18% (1.0594 => 1.1566, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.14% (1.3245 => 1.4455, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.09% (4.9865 => 5.4397, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 9.03% (1.2749 => 1.3900, std.dev.: 0.0164) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.94% (0.6576 => 0.7164, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.90% (3.6692 => 3.9959, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/objinst: 8.90% (0.2945 => 0.3207, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 8.85% (0.3131 => 0.3408, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.81% (4.4433 => 4.8346, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.79% (4.3801 => 4.7649, std.dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 8.75% (14.8535 => 16.1536, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.71% (0.3755 => 0.4082, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.52% (0.6135 => 0.6658, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.45% (0.8818 => 0.9563, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 8.41% (8.4961 => 9.2109, std.dev.: 0.0068) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.41% (0.2140 => 0.2320, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.33% (0.1789 => 0.1938, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.32% (0.2321 => 0.2514, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.20% (0.3511 => 0.3799, std.dev.: 0.0032) MultiSource/Applications/oggenc/oggenc: 8.11% (4.6629 => 5.0412, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/05-eks/eks: 8.10% (0.4113 => 0.4446, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.08% (0.9108 => 0.9844, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.96% (1.5188 => 1.6397, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.96% (1.1333 => 1.2235, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.79% (3.2742 => 3.5293, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 7.78% (6.5754 => 7.0868, std.dev.: 0.0144) MultiSource/Applications/lua/lua: 7.75% (3.7467 => 4.0371, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/neural/neural: 7.73% (0.1385 => 0.1492, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 7.71% (0.6250 => 0.6732, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.70% (0.4805 => 0.5175, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 7.62% (0.4003 => 0.4308, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.39% (0.2504 => 0.2689, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 7.37% (0.2008 => 0.2156, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.36% (0.3914 => 0.4202, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 7.32% (0.3578 => 0.3840, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 7.31% (1.2292 => 1.3190, std.dev.: 0.0075) SingleSource/UnitTests/ObjC/property: 7.26% (0.3940 => 0.4226, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/for-in: 7.23% (0.3789 => 0.4063, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.16% (0.3646 => 0.3907, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.14% (6.2785 => 6.7268, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.12% (0.3245 => 0.3476, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.08% (0.3601 => 0.3856, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.07% (2.1007 => 2.2492, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 7.04% (0.3663 => 0.3921, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.92% (13.2842 => 14.2034, std.dev.: 0.0212) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.90% (0.3650 => 0.3902, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/exceptions-3: 6.87% (0.3623 => 0.3872, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.38% (0.1819 => 0.1935, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.66% (0.2243 => 0.2370, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 5.01% (16.2614 => 17.0768, std.dev.: 0.0128) MultiSource/Applications/ClamAV/clamscan: 4.57% (14.5298 => 15.1938, std.dev.: 0.0084) MultiSource/Benchmarks/Bullet/bullet: 1.92% (33.2944 => 33.9351, std.dev.: 0.0142) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/methcall: 30.49% (5.7573 => 7.5127, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fbench: 26.15% (1.8175 => 2.2928, std.dev.: 0.0184) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 10.98% (1.1560 => 1.2829, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.03% (0.8273 => 0.9020, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4143, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.12% (1.2998 => 1.3794, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0047, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.92% (11.2619 => 11.7031, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9860, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.22% (10.7476 => 11.0934, std.dev.: 0.0296) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.19% (7.4271 => 7.5899, std.dev.: 0.0046) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4533, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5131, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2123, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1872, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5779, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0269, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5861, std.dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.03% (8.8259 => 8.9170, std.dev.: 0.0070) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.67% (0.2670 => 0.1424) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.91% (0.4657 => 0.3916, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -14.14% (0.0707 => 0.0607, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.21% (1.3813 => 1.1988, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.16% (1.3819 => 1.2001, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.53% (22.5627 => 22.2166, std.dev.: 0.0147) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.84% (0.0997 => 0.0859, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -11.89% (0.2238 => 0.1972, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.90% (1.2308 => 1.0967, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.13% (20.3410 => 18.2812, std.dev.: 0.0114) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.61% (1.3780 => 1.3007, std.dev.: 0.0101) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0047) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5147, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.68% (0.9996 => 0.9528, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1561, std.dev.: 0.0256) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.47% (1.7688 => 1.7074, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.96% (0.4867 => 0.4723, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.62% (26.5159 => 25.8216, std.dev.: 0.0512) SingleSource/Regression/C/uint64_to_float: -2.55% (0.5449 => 0.5310, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.47% (3.0263 => 2.9514, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.31% (1.9762 => 1.9305, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.91% (0.6589 => 0.6463, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7142, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/lists: -1.79% (6.3560 => 6.2420, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.56% (0.6615 => 0.6512, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0065, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8667, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.25% (0.8342 => 0.8238, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4945, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: -1.16% (9.3358 => 9.2275, std.dev.: 0.0124) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2583, std.dev.: 0.0006) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 13 13:02:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 13 Oct 2012 15:02:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121013200204.41DF12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4848?compare_to=4846&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4848, Order: 165881, Start Time: 2012-10-13 18:43:59, End Time: 2012-10-13 20:03:55 To: 4846, Order: 165872, Start Time: 2012-10-13 16:54:05, End Time: 2012-10-13 18:13:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (166 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 951 (679 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.17% (15.1247 => 15.3017, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.99% (1.2866 => 1.3122, std.dev.: 0.0090) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.39% (0.5949 => 0.5972, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 0.72% (16.3637 => 16.4812, std.dev.: 0.0249) MultiSource/Benchmarks/Bullet/bullet: 0.20% (55.3404 => 55.4531, std.dev.: 0.0107) MultiSource/Benchmarks/MallocBench/gs/gs: 0.74% (4.4312 => 4.4638, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.66% (0.0458 => 0.0461, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.65% (0.0460 => 0.0463, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.70% (0.0429 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.70% (0.0429 => 0.0432, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.48% (0.0418 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.48% (0.0420 => 0.0422, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.48% (0.0413 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.72% (0.0414 => 0.0417, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.93% (0.0430 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.69% (0.0432 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.71% (0.0424 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.70% (0.0426 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.73% (0.0413 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.48% (0.0416 => 0.0418, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.71% (0.0421 => 0.0424, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.47% (0.0423 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.46% (0.0433 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.45% (0.0435 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.98% (0.0409 => 0.0413) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.98% (0.0410 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.95% (0.0421 => 0.0425) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.71% (0.0423 => 0.0426) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.48% (0.0413 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.48% (0.0415 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.74% (0.0405 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.49% (0.0407 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.50% (0.0404 => 0.0406, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.99% (0.0405 => 0.0409) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.68% (0.0441 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.68% (0.0442 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.74% (0.0403 => 0.0406) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.74% (0.0404 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.74% (0.0403 => 0.0406, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.25% (0.0406 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.73% (0.0412 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.48% (0.0414 => 0.0416, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.51% (1.2565 => 1.2629, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.04% (7.8525 => 7.9338, std.dev.: 0.0176) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.49% (0.7410 => 0.7446, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.28% (0.0360 => 0.0361, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1434 => 0.1433) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0646 => 0.0645, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.32% (63.2438 => 55.4531, std.dev.: 0.0107) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.21% (14.1553 => 18.9980, std.dev.: 0.0136) SingleSource/Benchmarks/Misc-C++-EH/spirit: 64.97% (3.4629 => 5.7127, std.dev.: 0.0042) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14224.58% (0.0720 => 10.3137, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952600.00% (0.0001 => 9.9527, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 64.37% (0.2554 => 0.4198, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 47.60% (10.3673 => 15.3017, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/richards_benchmark: 39.58% (0.1622 => 0.2264, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 33.81% (0.1056 => 0.1413, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 18.44% (0.1432 => 0.1696, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.92% (7.0540 => 8.3179, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.75% (2.2022 => 2.5931, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.52% (0.1566 => 0.1809, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: 13.38% (0.3282 => 0.3721, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.32% (0.0871 => 0.0987, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.06% (1.7609 => 1.9909, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/power/power: 12.78% (0.1440 => 0.1624, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.93% (0.1584 => 0.1773, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.90% (0.1143 => 0.1279, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 11.62% (10.4361 => 11.6489, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.49% (0.3543 => 0.3950, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.41% (0.1236 => 0.1377, std.dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: 11.23% (0.7433 => 0.8268, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: 10.98% (0.3927 => 0.4358, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.97% (0.3473 => 0.3854, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 10.92% (0.7115 => 0.7892, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 10.87% (0.3497 => 0.3877, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.78% (0.2700 => 0.2991, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.73% (0.3543 => 0.3923, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.69% (0.3516 => 0.3892, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.67% (0.3561 => 0.3941, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.58% (0.1625 => 0.1797, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions: 10.58% (0.3828 => 0.4233, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.55% (0.3886 => 0.4296, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.53% (0.6675 => 0.7378, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/for-in: 10.48% (0.3694 => 0.4081, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 10.47% (0.1175 => 0.1298, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.43% (0.4879 => 0.5388, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 10.39% (9.4845 => 10.4701, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.36% (0.1438 => 0.1587, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 10.15% (0.1655 => 0.1823, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 10.14% (3.3354 => 3.6737, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.11% (1.5415 => 1.6973, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/em3d/em3d: 10.09% (0.1695 => 0.1866, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.07% (0.3177 => 0.3497, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.99% (0.4615 => 0.5076, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 9.96% (0.3423 => 0.3764, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 9.75% (0.3109 => 0.3412, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.68% (0.5105 => 0.5599, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.67% (0.8067 => 0.8847, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.66% (0.5860 => 0.6426, std.dev.: 0.0040) MultiSource/Applications/oggenc/oggenc: 9.62% (5.7591 => 6.3129, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.53% (4.2646 => 4.6711, std.dev.: 0.0108) MultiSource/Applications/Burg/burg: 9.48% (1.1642 => 1.2746, std.dev.: 0.0065) MultiSource/Applications/aha/aha: 9.47% (0.1151 => 0.1260, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.43% (0.1940 => 0.2123, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 9.41% (3.8723 => 4.2365, std.dev.: 0.0116) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.40% (0.1510 => 0.1652, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 9.39% (0.1555 => 0.1701, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.37% (0.8172 => 0.8938, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.36% (1.3050 => 1.4271, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.28% (0.5569 => 0.6086, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.25% (0.2271 => 0.2481, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.21% (0.2107 => 0.2301, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 9.20% (0.1163 => 0.1270, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.10% (0.2065 => 0.2253, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.10% (0.2758 => 0.3009, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.07% (5.0018 => 5.4557, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.01% (8.1363 => 8.8695, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.00% (0.3121 => 0.3402, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.00% (4.9449 => 5.3900, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 8.95% (0.1117 => 0.1217, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 8.94% (2.0273 => 2.2085, std.dev.: 0.0019) MultiSource/Applications/hbd/hbd: 8.93% (1.5603 => 1.6996, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.90% (0.9765 => 1.0634, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 8.88% (0.7835 => 0.8531, std.dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.81% (7.9617 => 8.6632, std.dev.: 0.0049) MultiSource/Applications/lemon/lemon: 8.80% (1.0722 => 1.1666, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/bigfib: 8.74% (0.6456 => 0.7020, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.68% (0.3307 => 0.3594, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.65% (0.5020 => 0.5454, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 8.55% (2.2969 => 2.4933, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.54% (1.5859 => 1.7214, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 8.53% (0.3387 => 0.3676, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.45% (0.1337 => 0.1450, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.36% (0.6030 => 0.6534, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 8.27% (0.3180 => 0.3443, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.27% (0.5925 => 0.6415, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.22% (0.3441 => 0.3724, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/health/health: 8.20% (0.1268 => 0.1372, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.02% (0.3865 => 0.4175, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.00% (1.1861 => 1.2810, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.92% (0.4103 => 0.4428, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 7.66% (0.7326 => 0.7887, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.64% (0.6450 => 0.6943, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.59% (2.2024 => 2.3695, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 7.51% (0.4289 => 0.4611, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 7.49% (21.9371 => 23.5809, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/05-eks/eks: 7.49% (0.4299 => 0.4621, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.42% (0.4203 => 0.4515, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 7.41% (0.8921 => 0.9582, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.38% (0.2603 => 0.2795, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 7.33% (0.3422 => 0.3673, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.29% (0.5981 => 0.6417, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: 7.18% (0.1463 => 0.1568, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.08% (0.4620 => 0.4947, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.99% (0.3650 => 0.3905, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.98% (0.3826 => 0.4093, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.90% (0.1695 => 0.1812, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.83% (1.4186 => 1.5155, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.78% (0.2891 => 0.3087, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.71% (0.4636 => 0.4947, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/lists1: 6.65% (0.3684 => 0.3929, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.61% (0.3603 => 0.3841, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.60% (0.3136 => 0.3343, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 6.57% (1.1840 => 1.2618, std.dev.: 0.0082) SingleSource/Regression/C++/ofstream_ctor: 6.33% (0.2905 => 0.3089, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.28% (0.2756 => 0.2929, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.24% (0.1906 => 0.2025, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.24% (2.0665 => 2.1954, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/fibo: 6.20% (0.2725 => 0.2894, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.20% (0.3162 => 0.3358, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.13% (0.2266 => 0.2405, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.09% (0.3052 => 0.3238, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.08% (0.2831 => 0.3003, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.04% (0.3098 => 0.3285, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.99% (0.2872 => 0.3044, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.92% (0.2802 => 0.2968, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 5.91% (0.3232 => 0.3423, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.87% (0.2793 => 0.2957, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.86% (0.2714 => 0.2873, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: 5.85% (0.2871 => 0.3039, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary3: 5.85% (0.3283 => 0.3475, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.80% (0.8101 => 0.8571, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 5.77% (0.2877 => 0.3043, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.76% (0.4064 => 0.4298, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.66% (0.1892 => 0.1999, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 5.50% (0.3379 => 0.3565, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.07% (14.3668 => 15.0945, std.dev.: 0.0192) SingleSource/Benchmarks/Misc/ReedSolomon: 4.98% (0.2049 => 0.2151, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.96% (0.3427 => 0.3597, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 4.77% (17.1811 => 17.9998, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 4.66% (0.3131 => 0.3277, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 4.65% (1.2842 => 1.3439, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.53% (0.2430 => 0.2540, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.21% (3.8922 => 4.0559, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: 3.53% (0.3092 => 0.3201, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.41% (1.1194 => 1.1576, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.25% (0.3817 => 0.3941, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.51% (5.3999 => 13.3115, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.99% (1.1396 => 1.2535, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0020) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4500, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (3.1578 => 3.3672, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.49% (3.6395 => 3.7665, std.dev.: 0.0028) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.82% (4.2280 => 4.3472, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7652, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.70% (0.8275 => 0.8416, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 1.36% (11.6436 => 11.8015, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.12% (2.6546 => 2.6842, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.08% (6.5088 => 6.5788, std.dev.: 0.0044) MultiSource/Applications/minisat/minisat: 1.06% (9.1159 => 9.2125, std.dev.: 0.0283) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1314, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.23% (0.8651 => 0.1710, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.36% (5.2763 => 3.2523, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.27% (5.3855 => 3.7012, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.85% (5.3526 => 3.7013, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -14.60% (54.1659 => 46.2567, std.dev.: 0.0278) MultiSource/Applications/ClamAV/clamscan: -12.06% (22.1758 => 19.5020, std.dev.: 0.0133) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.29% (2.9384 => 2.6359, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7652, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: -15.96% (1.6925 => 1.4224, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.03% (0.0998 => 0.0858, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.55% (1.2373 => 1.0944, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel-2: -10.36% (1.5373 => 1.3780, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/mason/mason: -10.18% (0.2161 => 0.1941, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.37% (19.9488 => 18.2795, std.dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.71% (1.8329 => 1.7100, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.29% (1.6805 => 1.5916, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.95% (1.5835 => 1.5051, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.92% (0.9957 => 0.9567, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Applications/siod/siod: -3.62% (3.2827 => 3.1639, std.dev.: 0.0227) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5114, std.dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0991, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.31% (8.6802 => 8.4793, std.dev.: 0.0209) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Regression/C/uint64_to_float: -1.90% (0.5413 => 0.5310, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.86% (8.1563 => 8.0043, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: -1.82% (10.2830 => 10.0956, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6816, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.57% (2.5528 => 2.5126, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4225, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8582, std.dev.: 0.0079) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 14.21% (0.5229 => 0.5972, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 9.95% (14.9895 => 16.4812, std.dev.: 0.0249) MultiSource/Benchmarks/MallocBench/gs/gs: 8.60% (4.1105 => 4.4638, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.31% (1.1048 => 1.2629, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.84% (7.1582 => 7.9338, std.dev.: 0.0176) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.67% (0.6222 => 0.7446, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36000.00% (0.0001 => 0.0361, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.52% (0.2116 => 0.0645, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 13 13:22:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 13 Oct 2012 15:22:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121013202252.C88EB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4849?compare_to=4847&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4849, Order: 165881, Start Time: 2012-10-13 19:00:07, End Time: 2012-10-13 20:25:44 To: 4847, Order: 165872, Start Time: 2012-10-13 17:05:24, End Time: 2012-10-13 18:31:02 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (186 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1040 (678 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.64% (79.2000 => 80.4952, std.dev.: 0.4022) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -1.34% (2.2928 => 2.2621, std.dev.: 0.0061) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.31% (2.0176 => 2.4879, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.37% (0.1410 => 0.1669, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 17.43% (0.0826 => 0.0970, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.85% (0.0653 => 0.0763, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 16.54% (0.2243 => 0.2614, std.dev.: 0.0030) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.55% (0.1072 => 0.1228, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 14.22% (0.1013 => 0.1157, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.55% (0.0834 => 0.0947, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.23% (0.1413 => 0.1600, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: 13.23% (0.7038 => 0.7969, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.89% (0.1327 => 0.1498, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.60% (3.9660 => 4.4659, std.dev.: 0.0149) MultiSource/Applications/hbd/hbd: 12.55% (1.3693 => 1.5412, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.55% (0.0964 => 0.1085, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.50% (0.2721 => 0.3061, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.29% (0.2596 => 0.2915, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.22% (0.1588 => 0.1782, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 12.06% (0.4328 => 0.4850, std.dev.: 0.0103) MultiSource/Applications/SPASS/SPASS: 12.04% (13.8202 => 15.4839, std.dev.: 0.0084) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.96% (0.7710 => 0.8632, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.93% (0.5265 => 0.5893, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.93% (0.6959 => 0.7789, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.87% (0.9199 => 1.0291, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.86% (0.6283 => 0.7028, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.84% (1.4563 => 1.6287, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 11.68% (0.1062 => 0.1186, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.66% (1.2193 => 1.3615, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 11.57% (0.1003 => 0.1119, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.41% (1.1364 => 1.2661, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 11.20% (0.4062 => 0.4517, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 11.07% (0.5818 => 0.6462, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.05% (0.3130 => 0.3476, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.03% (0.3899 => 0.4329, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 11.00% (1.0313 => 1.1447, std.dev.: 0.0146) MultiSource/Applications/Burg/burg: 10.88% (1.1061 => 1.2264, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.80% (0.1157 => 0.1282, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.76% (0.5577 => 0.6177, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.65% (0.5748 => 0.6360, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.58% (0.4016 => 0.4441, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.56% (0.3485 => 0.3853, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.51% (0.1075 => 0.1188, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.46% (0.4791 => 0.5292, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 10.44% (16.6129 => 18.3470, std.dev.: 0.0182) SingleSource/UnitTests/ObjC++/property-reference: 10.38% (0.7061 => 0.7794) MultiSource/Applications/minisat/minisat: 10.36% (0.6744 => 0.7443, std.dev.: 0.0023) SingleSource/Regression/C++/ofstream_ctor: 10.32% (0.2781 => 0.3068, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 10.31% (3.8646 => 4.2631, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.30% (0.3756 => 0.4143, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/mst/mst: 10.26% (0.1111 => 0.1225, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.26% (0.3246 => 0.3579, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.25% (0.4379 => 0.4828, std.dev.: 0.0046) MultiSource/Applications/siod/siod: 10.24% (2.1791 => 2.4023, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.24% (0.0977 => 0.1077, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.23% (0.3022 => 0.3331, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.11% (0.1276 => 0.1405, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 10.10% (1.9270 => 2.1216, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists: 10.08% (0.3293 => 0.3625, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/18-imp/imp: 10.06% (0.3220 => 0.3544, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 10.05% (0.2995 => 0.3296, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.03% (0.1865 => 0.2052, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.02% (0.2914 => 0.3206, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.02% (0.1986 => 0.2185, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 10.01% (0.1589 => 0.1748, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.00% (0.4390 => 0.4829, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 9.99% (0.3453 => 0.3798, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.99% (0.5637 => 0.6200, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.97% (0.3489 => 0.3837, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.97% (0.2127 => 0.2339, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 9.97% (3.1889 => 3.5067, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.88% (0.7460 => 0.8197, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 9.88% (0.1478 => 0.1624, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 9.86% (0.7506 => 0.8246, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.83% (0.8698 => 0.9553, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.81% (0.2782 => 0.3055, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.80% (0.3580 => 0.3931, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 9.75% (0.3868 => 0.4245, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 9.68% (0.8310 => 0.9114, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/except: 9.67% (0.2760 => 0.3027, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 9.65% (0.2726 => 0.2989, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 9.64% (0.2925 => 0.3207, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.61% (0.2966 => 0.3251, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 9.59% (0.3149 => 0.3451, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.59% (0.2023 => 0.2217, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.57% (4.9865 => 5.4636, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.56% (0.1569 => 0.1719, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.55% (0.1435 => 0.1572, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.48% (1.9828 => 2.1707, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 9.43% (0.3107 => 0.3400, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.40% (7.2180 => 7.8968, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.40% (0.2765 => 0.3025, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.38% (0.2655 => 0.2904, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 9.37% (0.3534 => 0.3865, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 9.28% (0.2607 => 0.2849, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 9.26% (0.2690 => 0.2939, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 9.24% (0.3192 => 0.3487, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 9.24% (0.2761 => 0.3016, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 9.13% (0.2628 => 0.2868, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 9.12% (0.2937 => 0.3205, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 9.05% (0.1657 => 0.1807, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 9.04% (0.2988 => 0.3258, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 9.00% (1.0594 => 1.1547, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.98% (0.2696 => 0.2938, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.93% (0.6576 => 0.7163, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.91% (1.3245 => 1.4425, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 8.67% (1.2749 => 1.3854, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.63% (0.3755 => 0.4079, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 8.62% (0.3131 => 0.3401, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.62% (3.6692 => 3.9855, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.56% (4.4433 => 4.8238, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.53% (4.3801 => 4.7539, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.52% (1.5188 => 1.6482, std.dev.: 0.0044) MultiSource/Applications/JM/lencod/lencod: 8.41% (14.8535 => 16.1030, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/objinst: 8.25% (0.2945 => 0.3188, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 8.24% (8.4961 => 9.1958, std.dev.: 0.0119) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.18% (0.6135 => 0.6637) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.16% (0.1789 => 0.1935, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.09% (0.3511 => 0.3795, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.08% (0.2140 => 0.2313, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.03% (0.8818 => 0.9526, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 7.98% (4.6629 => 5.0351, std.dev.: 0.0128) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.97% (0.2321 => 0.2506, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.81% (3.2742 => 3.5299, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 7.81% (0.6250 => 0.6738, std.dev.: 0.0138) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.75% (0.9108 => 0.9814, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.75% (1.1333 => 1.2211, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 7.68% (3.7467 => 4.0344, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 7.61% (0.4113 => 0.4426, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.49% (0.4805 => 0.5165, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.44% (0.4003 => 0.4301, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.40% (2.1007 => 2.2562, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/neural/neural: 7.36% (0.1385 => 0.1487, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 7.34% (6.5754 => 7.0579, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.31% (0.2504 => 0.2687, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 7.31% (0.3914 => 0.4200, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.21% (0.3245 => 0.3479, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.16% (0.3940 => 0.4222, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 7.07% (0.2008 => 0.2150, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 7.02% (0.3578 => 0.3829, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.97% (0.3789 => 0.4053, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.91% (0.3663 => 0.3916, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 6.83% (1.2292 => 1.3132, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 6.83% (0.3601 => 0.3847, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.83% (0.3646 => 0.3895, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.77% (0.3650 => 0.3897, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.73% (0.3623 => 0.3867, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.65% (13.2842 => 14.1678, std.dev.: 0.0083) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.62% (6.2785 => 6.6943, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.21% (0.1819 => 0.1932, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.31% (0.2243 => 0.2362, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 4.90% (16.2614 => 17.0578, std.dev.: 0.0038) MultiSource/Applications/ClamAV/clamscan: 4.40% (14.5298 => 15.1687, std.dev.: 0.0182) MultiSource/Benchmarks/Bullet/bullet: 2.00% (33.2944 => 33.9610, std.dev.: 0.0122) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5174, std.dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.05% (1.0895 => 1.3624, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.46% (1.8175 => 2.2621, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/richards_benchmark: 11.00% (1.1560 => 1.2832, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.56% (3.1736 => 3.4136, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.30% (1.2998 => 1.3817, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9999, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0050, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.92% (11.2619 => 11.7037, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.85% (1.7081 => 1.7738, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9858, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 3.41% (10.7476 => 11.1138, std.dev.: 0.0170) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.22% (7.4271 => 7.5917, std.dev.: 0.0051) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4539, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5136, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2123, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1883, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 1.21% (5.5130 => 5.5798, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0273, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.09% (8.8259 => 8.9217, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/lists: 1.03% (12.4560 => 12.5849, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.82% (0.2670 => 0.1420) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.06% (0.4657 => 0.3909, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -14.29% (0.0707 => 0.0606, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.20% (1.3813 => 1.1990, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.13% (1.3819 => 1.2004, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.15% (22.5627 => 22.3023, std.dev.: 0.0260) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.33% (1.0460 => 0.8543, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.44% (0.0997 => 0.0863, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -11.93% (0.2238 => 0.1971, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.89% (1.2308 => 1.0968, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.05% (20.3410 => 18.2968, std.dev.: 0.0167) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8099, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.15% (2.6470 => 2.5108, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.98% (1.3780 => 1.3094, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.06% (0.9996 => 0.9590, std.dev.: 0.0039) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1559, std.dev.: 0.0261) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.44% (1.7688 => 1.7080, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4867 => 0.4717, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -2.55% (26.5159 => 25.8409, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4781, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: -2.53% (0.5449 => 0.5311) MultiSource/Applications/spiff/spiff: -2.52% (3.0263 => 2.9500, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: -2.36% (1.9762 => 1.9296, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.99% (0.6589 => 0.6458, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7132, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -1.67% (6.3560 => 6.2501, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0079, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8674, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.23% (0.8342 => 0.8239, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4947, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2575, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 13 16:50:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 13 Oct 2012 18:50:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121013235012.7CEDA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4850?compare_to=4848&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4850, Order: 165885, Start Time: 2012-10-13 22:32:16, End Time: 2012-10-13 23:52:04 To: 4848, Order: 165881, Start Time: 2012-10-13 18:43:59, End Time: 2012-10-13 20:03:55 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (164 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 951 (681 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.77% (55.0567 => 56.5827, std.dev.: 0.0131) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.37% (78.5883 => 79.6672, std.dev.: 0.4108) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.5972 => 0.5972, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: -0.10% (16.4812 => 16.4642, std.dev.: 0.0120) MultiSource/Benchmarks/Bullet/bullet: -0.05% (55.4531 => 55.4253, std.dev.: 0.0142) MultiSource/Benchmarks/MallocBench/gs/gs: -0.04% (4.4638 => 4.4622, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.22% (0.0461 => 0.0462) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.22% (0.0463 => 0.0464, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0432 => 0.0432, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.46% (0.0432 => 0.0434, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0420 => 0.0420, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0422 => 0.0422, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0415 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.24% (0.0417 => 0.0416, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0434 => 0.0434) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0435 => 0.0435, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.23% (0.0427 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0429 => 0.0429, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.24% (0.0416 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0418 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.24% (0.0424 => 0.0425) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.24% (0.0425 => 0.0426, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.23% (0.0435 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.89% (0.0450 => 0.0437, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.48% (0.0413 => 0.0411, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0414 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0425 => 0.0425, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.47% (0.0426 => 0.0424, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.24% (0.0415 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0408 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0409 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.25% (0.0406 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.49% (0.0409 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0444 => 0.0444) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.22% (0.0445 => 0.0446) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0406 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.25% (0.0407 => 0.0406, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.25% (0.0406 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.25% (0.0407 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0415 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0416 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.03% (1.2629 => 1.2625, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.01% (7.9338 => 7.9327, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.04% (0.7446 => 0.7449, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.83% (0.0361 => 0.0358, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.16% (0.0645 => 0.0644, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.36% (63.2438 => 55.4253, std.dev.: 0.0142) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.14% (14.1553 => 18.9884, std.dev.: 0.0125) SingleSource/Benchmarks/Misc-C++-EH/spirit: 65.05% (3.4629 => 5.7155, std.dev.: 0.0030) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14224.72% (0.0720 => 10.3138, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952800.00% (0.0001 => 9.9529, std.dev.: 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 64.13% (0.2554 => 0.4192, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 48.01% (10.3673 => 15.3442, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/richards_benchmark: 39.27% (0.1622 => 0.2259, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 33.81% (0.1056 => 0.1413, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.99% (7.0540 => 8.3230, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/flops: 17.95% (0.1432 => 0.1689, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.62% (2.2022 => 2.5902, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.33% (0.1566 => 0.1806, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 13.97% (0.0730 => 0.0832, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 13.22% (0.3282 => 0.3716, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.20% (0.0871 => 0.0986, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.04% (1.7609 => 1.9905, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.80% (0.1625 => 0.1833, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 12.71% (0.1440 => 0.1623, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.87% (0.1584 => 0.1772, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.72% (0.1143 => 0.1277, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 11.59% (10.4361 => 11.6460, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.57% (0.3543 => 0.3953, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.14% (0.3473 => 0.3860, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 11.10% (0.7433 => 0.8258, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.09% (0.3561 => 0.3956, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 11.08% (0.1029 => 0.1143, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.05% (0.3927 => 0.4361, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.92% (0.3543 => 0.3930, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.92% (0.3516 => 0.3900, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.90% (0.3497 => 0.3878, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.80% (0.3694 => 0.4093, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 10.78% (0.7115 => 0.7882, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 10.76% (0.3828 => 0.4240, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.76% (0.3886 => 0.4304, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.56% (0.2700 => 0.2985, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.51% (0.4879 => 0.5392, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.46% (0.6675 => 0.7373, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.43% (0.1438 => 0.1588, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.39% (0.3177 => 0.3507, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 10.38% (0.1175 => 0.1297, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 10.32% (9.4845 => 10.4635, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.31% (0.2065 => 0.2278, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 10.21% (0.1655 => 0.1824, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.11% (1.5415 => 1.6973, std.dev.: 0.0061) MultiSource/Applications/d/make_dparser: 10.10% (3.3354 => 3.6722, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/em3d/em3d: 9.97% (0.1695 => 0.1864, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.92% (0.4615 => 0.5073, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 9.90% (0.3423 => 0.3762, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 9.68% (0.3109 => 0.3410, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.63% (0.1236 => 0.1355, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.61% (0.5860 => 0.6423, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.60% (0.5105 => 0.5595, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 9.50% (5.7591 => 6.3065, std.dev.: 0.0101) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.50% (4.2646 => 4.6697, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 9.43% (1.1642 => 1.2740, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.40% (0.1510 => 0.1652, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.40% (0.8067 => 0.8825, std.dev.: 0.0027) MultiSource/Applications/aha/aha: 9.38% (0.1151 => 0.1259, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.38% (0.1940 => 0.2122, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.36% (0.5569 => 0.6090, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.33% (1.3050 => 1.4267, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 9.33% (3.8723 => 4.2334, std.dev.: 0.0119) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.30% (0.2107 => 0.2303, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.20% (0.2271 => 0.2480, std.dev.: 0.0029) MultiSource/Applications/viterbi/viterbi: 9.20% (0.1555 => 0.1698, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.14% (0.2758 => 0.3010, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/mst/mst: 9.11% (0.1163 => 0.1269, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.10% (0.8172 => 0.8916, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.07% (4.9449 => 5.3932, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.04% (0.1117 => 0.1218, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.97% (5.0018 => 5.4506, std.dev.: 0.0046) MultiSource/Applications/spiff/spiff: 8.96% (0.7835 => 0.8537, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.95% (8.1363 => 8.8646, std.dev.: 0.0119) MultiSource/Applications/treecc/treecc: 8.94% (2.0273 => 2.2085, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 8.91% (1.5603 => 1.6993, std.dev.: 0.0046) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.91% (0.3121 => 0.3399, std.dev.: 0.0055) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.86% (7.9617 => 8.6674, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.80% (0.9765 => 1.0624, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.75% (0.5020 => 0.5459, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/bigfib: 8.64% (0.6456 => 0.7014, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 8.62% (0.3387 => 0.3679, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.60% (1.5859 => 1.7223, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 8.60% (1.0722 => 1.1644, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.53% (0.3307 => 0.3589, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 8.50% (2.2969 => 2.4921, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.45% (0.1337 => 0.1450, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 8.44% (0.6030 => 0.6539, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.41% (0.4103 => 0.4448, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 8.32% (0.5925 => 0.6418, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.25% (0.3441 => 0.3725, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 8.21% (0.3180 => 0.3441, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 8.20% (0.1268 => 0.1372, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.96% (1.1861 => 1.2805, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.71% (0.3865 => 0.4163, std.dev.: 0.0044) SingleSource/UnitTests/ObjC++/property-reference: 7.63% (0.7326 => 0.7885, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.53% (0.6450 => 0.6936, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 7.51% (0.4299 => 0.4622, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.46% (2.2024 => 2.3668, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.45% (0.2603 => 0.2797, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.42% (0.3826 => 0.4110, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 7.41% (21.9371 => 23.5618, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.38% (0.4203 => 0.4513, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash: 7.34% (0.4289 => 0.4604, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 7.34% (0.8921 => 0.9576, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.32% (0.5981 => 0.6419, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists: 7.22% (0.3422 => 0.3669, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/neural/neural: 7.18% (0.1463 => 0.1568, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 7.09% (0.4048 => 0.4335, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.08% (0.3162 => 0.3386, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.02% (0.1695 => 0.1814, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.01% (0.3650 => 0.3906, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.01% (0.4620 => 0.4944, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.84% (1.4186 => 1.5156, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/sieve: 6.74% (0.3603 => 0.3846, std.dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.69% (0.4636 => 0.4946, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.64% (0.2891 => 0.3083, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.63% (0.3136 => 0.3344, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 6.51% (1.1840 => 1.2611, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.45% (0.1906 => 0.2029, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists1: 6.41% (0.3684 => 0.3920, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.23% (0.2905 => 0.3086, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.10% (0.2756 => 0.2924, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.09% (0.2725 => 0.2891, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.09% (0.2266 => 0.2404, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.06% (2.0665 => 2.1918, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 6.00% (0.2831 => 0.3001, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.93% (0.3052 => 0.3233, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 5.90% (0.2714 => 0.2874) SingleSource/Benchmarks/Shootout-C++/ary: 5.88% (0.3232 => 0.3422, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.87% (0.2877 => 0.3046, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.85% (0.2802 => 0.2966, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 5.85% (0.3283 => 0.3475, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.84% (0.2793 => 0.2956, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.78% (0.2871 => 0.3037, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.71% (0.4064 => 0.4296, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.69% (0.8101 => 0.8562, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary2: 5.42% (0.3379 => 0.3562, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.98% (14.3668 => 15.0825, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/ReedSolomon: 4.93% (0.2049 => 0.2150) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.87% (0.3427 => 0.3594, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 4.70% (17.1811 => 17.9894, std.dev.: 0.0171) SingleSource/Benchmarks/Shootout-C++/objinst: 4.60% (0.3131 => 0.3275, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.56% (1.2842 => 1.3427, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.40% (0.2430 => 0.2537, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.28% (3.8922 => 4.0587, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.35% (0.3817 => 0.3945, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.17% (1.1194 => 1.1549, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.80% (1.1396 => 1.2513, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 9.21% (3.1595 => 3.4505, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.73% (3.1578 => 3.3702, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.72% (3.6395 => 3.7749, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.65% (4.2280 => 4.3399, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.34% (1.7254 => 1.7657, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.69% (0.8275 => 0.8415, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 1.35% (11.6436 => 11.8013, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/queens: 1.11% (2.1825 => 2.2068, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.10% (2.6546 => 2.6838, std.dev.: 0.0037) MultiSource/Applications/minisat/minisat: 1.09% (9.1159 => 9.2151, std.dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.03% (6.6874 => 0.1315, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.28% (5.2763 => 3.2567, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.28% (5.3855 => 3.7009, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.84% (5.3526 => 3.7019, std.dev.: 0.0029) SingleSource/UnitTests/Vector/constpool: -14.63% (54.1659 => 46.2413, std.dev.: 0.0243) MultiSource/Applications/ClamAV/clamscan: -12.08% (22.1758 => 19.4968, std.dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.23% (2.9384 => 2.6379, std.dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7637, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: -15.87% (1.6925 => 1.4239, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.73% (0.0998 => 0.0861, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.27% (1.2373 => 1.0979, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -10.27% (1.5373 => 1.3794, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/mason/mason: -9.76% (0.2161 => 0.1950, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.12% (19.9488 => 18.3296, std.dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.65% (1.8329 => 1.7111, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.29% (1.6805 => 1.5916, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5085, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.76% (0.9957 => 0.9583, std.dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.69% (3.2827 => 3.1616, std.dev.: 0.0042) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.4998, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0982, std.dev.: 0.0012) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.11% (8.1563 => 7.9838, std.dev.: 0.0284) SingleSource/Regression/C/uint64_to_float: -1.90% (0.5413 => 0.5310, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.89% (8.6802 => 8.5163, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/salsa20: -1.78% (10.2830 => 10.1004, std.dev.: 0.0237) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6814, std.dev.: 0.0019) SingleSource/UnitTests/Vector/multiplies: -1.67% (2.5528 => 2.5102, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: -1.64% (1.1277 => 1.1092) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4211, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/lists: -1.07% (6.2999 => 6.2326, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 14.21% (0.5229 => 0.5972, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 9.84% (14.9895 => 16.4642, std.dev.: 0.0120) MultiSource/Benchmarks/MallocBench/gs/gs: 8.56% (4.1105 => 4.4622, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.27% (1.1048 => 1.2625, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.82% (7.1582 => 7.9327, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.72% (0.6222 => 0.7449, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35700.00% (0.0001 => 0.0358, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.57% (0.2116 => 0.0644, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 13 16:55:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 13 Oct 2012 18:55:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121013235547.A62CA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4851?compare_to=4849&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4851, Order: 165885, Start Time: 2012-10-13 22:32:51, End Time: 2012-10-13 23:58:40 To: 4849, Order: 165881, Start Time: 2012-10-13 19:00:07, End Time: 2012-10-13 20:25:44 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (184 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1041 (680 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.54% (7.9352 => 8.0571, std.dev.: 0.0090) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.16% (2.0176 => 2.4848, std.dev.: 0.0149) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.16% (0.1410 => 0.1666, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 16.95% (0.0826 => 0.0966, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.69% (0.0653 => 0.0762, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 16.36% (0.2243 => 0.2610, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.65% (0.1072 => 0.1229, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 14.22% (0.1013 => 0.1157, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.43% (0.0834 => 0.0946, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.23% (0.1413 => 0.1600, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.02% (0.2596 => 0.2934, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 12.83% (0.7038 => 0.7941, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.74% (0.1327 => 0.1496, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 12.62% (1.3693 => 1.5421, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.55% (0.0964 => 0.1085, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.54% (3.9660 => 4.4633, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.42% (0.2721 => 0.3059, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.36% (0.5265 => 0.5916, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.10% (0.6959 => 0.7801, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.09% (0.1588 => 0.1780, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.87% (0.6283 => 0.7029, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.86% (1.4563 => 1.6290, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash2: 11.85% (0.4328 => 0.4841, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 11.82% (13.8202 => 15.4543, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.81% (1.2193 => 1.3633, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.79% (0.9199 => 1.0284, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 11.77% (0.1062 => 0.1187, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.69% (0.7710 => 0.8611, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: 11.57% (0.1003 => 0.1119, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.23% (1.1364 => 1.2640, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 11.23% (0.4062 => 0.4518, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 11.02% (1.0313 => 1.1449, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.95% (0.3899 => 0.4326, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: 10.86% (0.5818 => 0.6450, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.86% (0.3130 => 0.3470, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.83% (0.1986 => 0.2201, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.80% (0.1157 => 0.1282, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.79% (0.3022 => 0.3348, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 10.78% (1.1061 => 1.2253, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.74% (0.5577 => 0.6176, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.65% (0.3485 => 0.3856, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.61% (0.5748 => 0.6358, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.44% (0.4791 => 0.5291) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.43% (0.4016 => 0.4435, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.42% (0.1075 => 0.1187, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 10.36% (16.6129 => 18.3345, std.dev.: 0.0303) MultiSource/Applications/minisat/minisat: 10.32% (0.6744 => 0.7440, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference: 10.24% (0.7061 => 0.7784, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.22% (0.3756 => 0.4140, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 10.17% (2.1791 => 2.4008, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 10.11% (3.8646 => 4.2554, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.10% (0.3246 => 0.3574, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 10.10% (0.2781 => 0.3062, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.05% (0.4379 => 0.4819, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 10.03% (0.3220 => 0.3543, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 10.02% (1.9270 => 2.1201, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.00% (0.3489 => 0.3838, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/mst/mst: 9.99% (0.1111 => 0.1222, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 9.99% (0.3293 => 0.3622, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 9.98% (0.2995 => 0.3294, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.95% (0.1276 => 0.1403, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 9.94% (0.1589 => 0.1747, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.93% (0.4390 => 0.4826, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/sieve: 9.88% (0.3453 => 0.3794, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.87% (0.1865 => 0.2049, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 9.83% (3.1889 => 3.5024, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.83% (0.8698 => 0.9553, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.83% (0.2127 => 0.2336, std.dev.: 0.0033) MultiSource/Applications/viterbi/viterbi: 9.81% (0.1478 => 0.1623, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.78% (0.2914 => 0.3199, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.78% (0.3580 => 0.3930, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.75% (0.7460 => 0.8187, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.74% (0.2782 => 0.3053, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.74% (0.5637 => 0.6186, std.dev.: 0.0038) MultiSource/Applications/spiff/spiff: 9.73% (0.7506 => 0.8236, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 9.72% (0.2726 => 0.2991, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 9.70% (0.8310 => 0.9116, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.68% (0.2966 => 0.3253, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 9.68% (0.2925 => 0.3208, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 9.64% (0.3868 => 0.4241, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.61% (4.9865 => 5.4657, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary3: 9.56% (0.3149 => 0.3450, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 9.53% (0.2760 => 0.3023, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.50% (0.1569 => 0.1718, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.49% (0.2023 => 0.2215, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.43% (1.9828 => 2.1698, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.41% (0.1435 => 0.1570, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 9.40% (0.3107 => 0.3399, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.37% (0.2765 => 0.3024, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 9.31% (0.3534 => 0.3863, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.30% (0.2655 => 0.2902, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 9.28% (0.2607 => 0.2849, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.26% (7.2180 => 7.8865, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/random: 9.26% (0.2690 => 0.2939, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 9.13% (0.2761 => 0.3013, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 9.12% (0.2937 => 0.3205, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 9.09% (0.3192 => 0.3482, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: 9.06% (0.2628 => 0.2866, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 8.99% (0.1657 => 0.1806, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 8.94% (1.0594 => 1.1541, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/matrix: 8.94% (0.2988 => 0.3255, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.90% (0.6576 => 0.7161, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.86% (0.2696 => 0.2935, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.86% (1.3245 => 1.4418, std.dev.: 0.0048) MultiSource/Benchmarks/sim/sim: 8.72% (0.3131 => 0.3404, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 8.70% (1.2749 => 1.3858, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.70% (3.6692 => 3.9883, std.dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.54% (0.3511 => 0.3811, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.50% (0.3755 => 0.4074, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.47% (4.3801 => 4.7509, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.39% (4.4433 => 4.8162, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 8.37% (14.8535 => 16.0962, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.35% (1.5188 => 1.6456, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 8.24% (8.4961 => 9.1959, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/objinst: 8.15% (0.2945 => 0.3185, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.99% (0.6135 => 0.6625, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.97% (0.2321 => 0.2506, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.92% (0.8818 => 0.9516, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 7.89% (4.6629 => 5.0307, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.83% (0.1789 => 0.1929, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.72% (3.2742 => 3.5271, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.71% (0.2140 => 0.2305, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.69% (1.1333 => 1.2205, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 7.68% (0.4113 => 0.4429, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 7.68% (0.6250 => 0.6730, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.63% (0.9108 => 0.9803, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 7.60% (3.7467 => 4.0315, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.50% (2.1007 => 2.2582, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.43% (0.4805 => 0.5162, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.42% (0.4003 => 0.4300, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 7.31% (6.5754 => 7.0561, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.23% (0.2504 => 0.2685, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.08% (0.3914 => 0.4191, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.06% (0.3245 => 0.3474, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 7.02% (0.3789 => 0.4055, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.01% (0.3940 => 0.4216, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 6.99% (0.3663 => 0.3919, std.dev.: 0.0067) SingleSource/UnitTests/ObjC/trivial-interface: 6.88% (0.3578 => 0.3824, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 6.87% (0.2008 => 0.2146, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.77% (0.3646 => 0.3893, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 6.77% (1.2292 => 1.3124, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 6.75% (0.3601 => 0.3844, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.71% (0.3623 => 0.3866, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.63% (0.3650 => 0.3892, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.63% (13.2842 => 14.1646, std.dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.61% (6.2785 => 6.6938, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.94% (0.1819 => 0.1927, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.26% (0.2243 => 0.2361, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 4.88% (16.2614 => 17.0554, std.dev.: 0.0074) MultiSource/Applications/ClamAV/clamscan: 4.38% (14.5298 => 15.1663, std.dev.: 0.0071) MultiSource/Benchmarks/Bullet/bullet: 2.04% (33.2944 => 33.9748, std.dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5162, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.09% (1.0895 => 1.3629, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fbench: 24.84% (1.8175 => 2.2690, std.dev.: 0.0452) SingleSource/Benchmarks/Misc/richards_benchmark: 11.10% (1.1560 => 1.2843, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.47% (0.1322 => 0.1434, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4139, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 6.32% (1.2998 => 1.3819, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9999, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.65% (1.9144 => 2.0035, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.92% (11.2619 => 11.7033, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9858, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 3.25% (10.7476 => 11.0970, std.dev.: 0.0469) SingleSource/Benchmarks/Misc/salsa20: 2.27% (7.4271 => 7.5955, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4530, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5136, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (1.9433 => 1.9678, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1872, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5783, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists: 1.10% (12.4560 => 12.5936, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.10% (8.8259 => 8.9227, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0274, std.dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.93% (0.2670 => 0.1417, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.13% (0.4657 => 0.3906, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -14.57% (0.0707 => 0.0604, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.31% (1.3819 => 1.1980, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.26% (1.3813 => 1.1981, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.11% (22.5627 => 22.3131, std.dev.: 0.0141) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.64% (0.0997 => 0.0861, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.97% (0.2238 => 0.1970, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -11.58% (1.2308 => 1.0883, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.07% (20.3410 => 18.2933, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.75% (1.3780 => 1.2987, std.dev.: 0.0120) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.06% (2.6470 => 2.5131, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.47% (0.9996 => 0.9549, std.dev.: 0.0093) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.59% (3.2729 => 3.1555, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.51% (1.7688 => 1.7068, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.96% (0.4867 => 0.4723, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: -2.55% (0.5449 => 0.5310, std.dev.: 0.0048) MultiSource/Applications/lua/lua: -2.54% (26.5159 => 25.8411, std.dev.: 0.0193) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.44% (3.0263 => 2.9526, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -2.37% (1.9762 => 1.9293, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.09% (0.6589 => 0.6451, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7135, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/lists: -1.69% (6.3560 => 6.2486, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.56% (0.6615 => 0.6512) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0068, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.26% (0.8342 => 0.8237, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4951, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2583, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: -1.09% (9.3358 => 9.2342, std.dev.: 0.0233) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 13 18:39:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 13 Oct 2012 20:39:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121014013926.D15FF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4852?compare_to=4850&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4852, Order: 165886, Start Time: 2012-10-14 00:21:25, End Time: 2012-10-14 01:41:18 To: 4850, Order: 165885, Start Time: 2012-10-13 22:32:16, End Time: 2012-10-13 23:52:04 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (166 on baseline) Performance Improvements: 1 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 951 (679 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 17.63% (0.4056 => 0.4771, std.dev.: 0.0232) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.34% (15.3442 => 14.9849, std.dev.: 0.0065) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.12% (0.5972 => 0.5965, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 0.11% (16.4642 => 16.4816, std.dev.: 0.0075) MultiSource/Benchmarks/Bullet/bullet: -0.05% (55.4253 => 55.3994, std.dev.: 0.0074) MultiSource/Benchmarks/MallocBench/gs/gs: -0.19% (4.4622 => 4.4537, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.22% (0.0462 => 0.0463, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.22% (0.0464 => 0.0465, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.23% (0.0432 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0434 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.48% (0.0420 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.47% (0.0422 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.48% (0.0415 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.48% (0.0416 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.23% (0.0434 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.23% (0.0435 => 0.0436) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.23% (0.0428 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.23% (0.0429 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.48% (0.0418 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.24% (0.0425 => 0.0426, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.23% (0.0426 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.23% (0.0436 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.46% (0.0437 => 0.0439, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.73% (0.0411 => 0.0414, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.24% (0.0414 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.24% (0.0425 => 0.0426) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.71% (0.0424 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.24% (0.0416 => 0.0417, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.24% (0.0417 => 0.0418, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.72% (0.0408 => 0.0415, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.24% (0.0409 => 0.0410, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0407 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.74% (0.0407 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.23% (0.0444 => 0.0445, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.22% (0.0446 => 0.0447, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.25% (0.0406 => 0.0407, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.74% (0.0406 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.25% (0.0407 => 0.0408) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.25% (0.0408 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.24% (0.0415 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.24% (0.0416 => 0.0417, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.04% (1.2625 => 1.2620, std.dev.: 0.0082) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.06% (7.9327 => 7.9373, std.dev.: 0.0125) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.08% (0.7449 => 0.7455, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.84% (0.0358 => 0.0361, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1433 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0644 => 0.0644, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.40% (63.2438 => 55.3994, std.dev.: 0.0074) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.06% (14.1553 => 18.9766, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++-EH/spirit: 64.87% (3.4629 => 5.7092, std.dev.: 0.0150) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14226.53% (0.0720 => 10.3151, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952100.00% (0.0001 => 9.9522, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.63% (0.2554 => 0.4179, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 44.54% (10.3673 => 14.9849, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/richards_benchmark: 39.15% (0.1622 => 0.2257, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 33.71% (0.1056 => 0.1412, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.88% (7.0540 => 8.3150, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.80% (2.2022 => 2.5943, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: 17.67% (0.1432 => 0.1685, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.39% (0.1566 => 0.1807, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.43% (0.0871 => 0.0988) SingleSource/Benchmarks/Misc/oourafft: 13.35% (0.3282 => 0.3720, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.99% (1.7609 => 1.9897, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.78% (0.0798 => 0.0900, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 12.78% (0.1440 => 0.1624) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.87% (0.1584 => 0.1772, std.dev.: 0.0006) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.81% (0.1143 => 0.1278, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 11.59% (10.4361 => 11.6457, std.dev.: 0.0104) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.57% (0.3543 => 0.3953, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.17% (0.3473 => 0.3861, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.12% (0.3561 => 0.3957, std.dev.: 0.0084) SingleSource/UnitTests/ObjC/parameter-passing: 11.05% (0.3927 => 0.4361, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.01% (0.3497 => 0.3882, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.98% (0.3543 => 0.3932, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 10.93% (0.7115 => 0.7893, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 10.91% (0.7433 => 0.8244, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.89% (0.3516 => 0.3899, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.76% (0.3886 => 0.4304, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.74% (0.2700 => 0.2990, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.74% (0.3828 => 0.4239, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 10.67% (0.3694 => 0.4088, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.43% (0.4879 => 0.5388, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.40% (0.6675 => 0.7369, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.34% (0.1625 => 0.1793, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/tsp/tsp: 10.30% (0.1175 => 0.1296, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 10.25% (9.4845 => 10.4563, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.08% (0.1438 => 0.1583, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 10.08% (3.3354 => 3.6717, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.06% (1.5415 => 1.6965, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 10.05% (0.3423 => 0.3767, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 10.03% (0.1655 => 0.1821, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.95% (0.3177 => 0.3493, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 9.91% (0.1695 => 0.1863, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 9.88% (0.1032 => 0.1134, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.69% (0.4615 => 0.5062, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 9.65% (0.3109 => 0.3409, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.63% (0.1236 => 0.1355, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.60% (0.5105 => 0.5595, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.57% (0.5860 => 0.6421, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 9.47% (0.1151 => 0.1260, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 9.44% (1.1642 => 1.2741, std.dev.: 0.0070) MultiSource/Applications/oggenc/oggenc: 9.44% (5.7591 => 6.3027, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.41% (4.2646 => 4.6660, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.39% (0.5569 => 0.6092, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.38% (0.2271 => 0.2484, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.27% (0.1510 => 0.1650, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 9.26% (0.1555 => 0.1699, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.26% (1.3050 => 1.4258, std.dev.: 0.0025) MultiSource/Applications/lua/lua: 9.26% (3.8723 => 4.2307, std.dev.: 0.0158) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.23% (0.1940 => 0.2119, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.22% (0.8067 => 0.8811, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 9.11% (0.1163 => 0.1269, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.11% (0.2107 => 0.2299, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.02% (5.0018 => 5.4532, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.01% (0.2065 => 0.2251, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.99% (0.2758 => 0.3006, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.97% (0.3121 => 0.3401, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.95% (4.9449 => 5.3876, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 8.95% (0.1117 => 0.1217, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.94% (0.5020 => 0.5469, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.90% (0.8172 => 0.8899, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 8.86% (0.6456 => 0.7028, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 8.86% (0.7835 => 0.8529, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.84% (0.9765 => 1.0628, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.84% (8.1363 => 8.8552, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.83% (0.3307 => 0.3599, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.76% (0.6030 => 0.6558, std.dev.: 0.0020) MultiSource/Applications/treecc/treecc: 8.75% (2.0273 => 2.2046, std.dev.: 0.0042) MultiSource/Applications/lemon/lemon: 8.68% (1.0722 => 1.1653, std.dev.: 0.0053) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.62% (7.9617 => 8.6480, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.62% (1.5859 => 1.7226, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 8.57% (0.5925 => 0.6433, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 8.49% (1.5603 => 1.6928, std.dev.: 0.0026) MultiSource/Benchmarks/sim/sim: 8.47% (0.3387 => 0.3674, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 8.40% (0.3180 => 0.3447, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 8.32% (2.2969 => 2.4881, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.15% (0.1337 => 0.1446, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.11% (0.3441 => 0.3720, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/health/health: 8.04% (0.1268 => 0.1370, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.02% (0.4103 => 0.4432, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.94% (0.3865 => 0.4172, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 7.92% (0.7326 => 0.7906, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.88% (1.1861 => 1.2796, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.69% (0.4289 => 0.4619, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.60% (2.2024 => 2.3698, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.54% (0.4203 => 0.4520, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.43% (0.6450 => 0.6929, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 7.42% (0.3422 => 0.3676, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 7.33% (0.4299 => 0.4614, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.32% (0.4620 => 0.4958, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/moments: 7.31% (0.4048 => 0.4344, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.30% (0.2603 => 0.2793, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 7.29% (21.9371 => 23.5372, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.18% (0.3650 => 0.3912, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 7.17% (0.8921 => 0.9561, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: 7.11% (0.1463 => 0.1567, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.06% (0.3826 => 0.4096, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.04% (0.5981 => 0.6402, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.02% (0.1695 => 0.1814, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.99% (0.2891 => 0.3093, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.86% (0.4636 => 0.4954, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/sieve: 6.83% (0.3603 => 0.3849, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.77% (1.4186 => 1.5147, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/lists1: 6.70% (0.3684 => 0.3931, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.70% (0.3136 => 0.3346, std.dev.: 0.0016) SingleSource/Regression/C++/ofstream_ctor: 6.64% (0.2905 => 0.3098, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.58% (0.3162 => 0.3370, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.57% (0.2756 => 0.2937, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.44% (1.1840 => 1.2602, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 6.39% (0.2725 => 0.2899, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.36% (0.3052 => 0.3246, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.35% (2.0665 => 2.1977, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/random: 6.21% (0.2802 => 0.2976, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.20% (0.3098 => 0.3290, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.19% (0.2793 => 0.2966, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 6.19% (0.2714 => 0.2882, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.10% (0.3232 => 0.3429, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.09% (0.1906 => 0.2022, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.08% (0.2877 => 0.3052, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.06% (0.3283 => 0.3482, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.06% (0.2872 => 0.3046, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.83% (0.4064 => 0.4301, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.78% (0.2266 => 0.2397, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.74% (0.8101 => 0.8566, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary2: 5.71% (0.3379 => 0.3572, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.34% (0.1892 => 0.1993, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.03% (14.3668 => 15.0900, std.dev.: 0.0136) SingleSource/Benchmarks/Misc/ReedSolomon: 5.03% (0.2049 => 0.2152, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/objinst: 4.85% (0.3131 => 0.3283, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.74% (1.2842 => 1.3451, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.70% (0.3427 => 0.3588, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 4.69% (17.1811 => 17.9873, std.dev.: 0.0141) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.49% (0.2430 => 0.2539, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.29% (3.8922 => 4.0592, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.43% (0.3817 => 0.3948, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.41% (1.1194 => 1.1576, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 3.27% (0.3092 => 0.3193, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.26% (1.1145 => 1.3849, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.55% (0.2944 => 0.3284, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 10.05% (1.1396 => 1.2541, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0015) MultiSource/Applications/aha/aha: 9.20% (3.1595 => 3.4502, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3682, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.49% (3.6395 => 3.7664, std.dev.: 0.0038) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.91% (4.2280 => 4.3509, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7651, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.73% (0.8275 => 0.8418, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 1.35% (11.6436 => 11.8013, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.14% (2.6546 => 2.6849, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5763, std.dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1313, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.15% (0.8651 => 0.1717) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.27% (5.2763 => 3.2572, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.12% (5.3855 => 3.7098, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.68% (5.3526 => 3.7102, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -14.68% (54.1659 => 46.2162, std.dev.: 0.0156) MultiSource/Applications/ClamAV/clamscan: -12.09% (22.1758 => 19.4941, std.dev.: 0.0122) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.16% (2.9384 => 2.6400, std.dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7645, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.90% (1.6925 => 1.4234, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.63% (0.0998 => 0.0862, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -11.97% (1.2373 => 1.0892, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3784, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/mason/mason: -10.09% (0.2161 => 0.1943, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.46% (19.9488 => 18.2614, std.dev.: 0.0809) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.72% (1.8329 => 1.7098, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.27% (1.6805 => 1.5919, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.88% (1.5835 => 1.5063, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.89% (0.9957 => 0.9570, std.dev.: 0.0031) MultiSource/Applications/siod/siod: -3.72% (3.2827 => 3.1607, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4954, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: -3.01% (12.4730 => 12.0976, std.dev.: 0.0020) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.05% (8.6802 => 8.5026, std.dev.: 0.0228) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.01% (8.1563 => 7.9922, std.dev.: 0.0287) SingleSource/Benchmarks/Misc/salsa20: -1.96% (10.2830 => 10.0813, std.dev.: 0.0185) SingleSource/Regression/C/uint64_to_float: -1.88% (0.5413 => 0.5311, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6811, std.dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: -1.72% (2.5528 => 2.5088, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4204, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0554 => 1.0445, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8594, std.dev.: 0.0087) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 14.08% (0.5229 => 0.5965, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 9.95% (14.9895 => 16.4816, std.dev.: 0.0075) MultiSource/Benchmarks/MallocBench/gs/gs: 8.35% (4.1105 => 4.4537, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.23% (1.1048 => 1.2620, std.dev.: 0.0082) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.88% (7.1582 => 7.9373, std.dev.: 0.0125) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.82% (0.6222 => 0.7455, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36000.00% (0.0001 => 0.0361, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.57% (0.2116 => 0.0644, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 13 18:50:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 13 Oct 2012 20:50:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121014015031.CC1F42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4853?compare_to=4851&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4853, Order: 165886, Start Time: 2012-10-14 00:27:43, End Time: 2012-10-14 01:53:24 To: 4851, Order: 165885, Start Time: 2012-10-13 22:32:51, End Time: 2012-10-13 23:58:40 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (185 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1042 (678 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.87% (2.0176 => 2.4992, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.65% (0.1410 => 0.1673, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 17.68% (0.0826 => 0.0972, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.00% (0.0653 => 0.0764, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 16.58% (0.2243 => 0.2615, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.65% (0.1072 => 0.1229, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 14.31% (0.1013 => 0.1158, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.55% (0.0834 => 0.0947, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.45% (0.1413 => 0.1603, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 13.17% (0.7038 => 0.7965, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.04% (0.1327 => 0.1500, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 12.90% (1.3693 => 1.5460, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.76% (0.0964 => 0.1087, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.68% (3.9660 => 4.4689, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.61% (0.2721 => 0.3064, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.41% (0.1588 => 0.1785, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.40% (0.2596 => 0.2918, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.38% (0.5265 => 0.5917, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.34% (0.6959 => 0.7818, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.12% (1.4563 => 1.6328, std.dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 12.09% (13.8202 => 15.4908, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.03% (0.6283 => 0.7039, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.96% (0.7710 => 0.8632, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.96% (0.9199 => 1.0299, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 11.90% (0.4328 => 0.4843, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 11.86% (0.1062 => 0.1188, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.79% (1.2193 => 1.3630, std.dev.: 0.0083) MultiSource/Benchmarks/Olden/power/power: 11.76% (0.1003 => 0.1121, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.50% (1.1364 => 1.2671, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.36% (0.3899 => 0.4342, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 11.33% (1.0313 => 1.1481, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 11.30% (0.4062 => 0.4521, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.15% (0.5577 => 0.6199, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.15% (0.3130 => 0.3479, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.15% (0.1157 => 0.1286, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.87% (0.4791 => 0.5312, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 10.87% (1.1061 => 1.2263, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 10.81% (0.5818 => 0.6447, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.56% (0.3485 => 0.3853, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 10.56% (16.6129 => 18.3665, std.dev.: 0.0269) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.50% (0.1276 => 0.1410, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.48% (0.4016 => 0.4437, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 10.47% (2.1791 => 2.4073, std.dev.: 0.0041) MultiSource/Applications/minisat/minisat: 10.47% (0.6744 => 0.7450, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 10.45% (0.2995 => 0.3308, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 10.44% (0.5748 => 0.6348, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.38% (0.3246 => 0.3583, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 10.36% (3.8646 => 4.2651, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 10.32% (0.1589 => 0.1753, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.25% (0.3756 => 0.4141, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 10.24% (1.9270 => 2.1243, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.23% (0.1075 => 0.1185, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.21% (0.4379 => 0.4826, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 10.20% (0.7061 => 0.7781, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/mst/mst: 10.17% (0.1111 => 0.1224, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.16% (0.3022 => 0.3329, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: 10.15% (0.7506 => 0.8268, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 10.14% (0.2781 => 0.3063, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.09% (0.4390 => 0.4833, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.09% (0.3489 => 0.3841, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 10.06% (0.3220 => 0.3544, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 10.05% (0.3293 => 0.3624, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.05% (0.8698 => 0.9572, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 10.05% (0.8310 => 0.9145, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.04% (0.5637 => 0.6203, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.03% (0.7460 => 0.8208, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.02% (0.2914 => 0.3206, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.01% (0.2127 => 0.2340, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 10.01% (0.1478 => 0.1626, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 10.01% (3.1889 => 3.5082, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.94% (0.1569 => 0.1725, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.92% (0.1865 => 0.2050, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 9.90% (0.3453 => 0.3795, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.87% (0.1986 => 0.2182, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.86% (0.3580 => 0.3933, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 9.81% (0.2925 => 0.3212, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.79% (0.2023 => 0.2221, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.78% (0.2966 => 0.3256, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.78% (0.2782 => 0.3054, std.dev.: 0.0029) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.76% (0.1435 => 0.1575, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.75% (4.9865 => 5.4729, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/moments: 9.75% (0.3868 => 0.4245, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 9.65% (0.2726 => 0.2989, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.53% (1.9828 => 2.1717, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary3: 9.50% (0.3149 => 0.3448, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 9.46% (0.2760 => 0.3021, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 9.45% (0.3534 => 0.3868, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.43% (7.2180 => 7.8989, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary: 9.43% (0.3107 => 0.3400, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.30% (0.2655 => 0.2902, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 9.30% (1.0594 => 1.1579, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/random: 9.29% (0.2690 => 0.2940, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.26% (0.2765 => 0.3021, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 9.24% (0.3192 => 0.3487, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.23% (0.6576 => 0.7183, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 9.17% (0.1657 => 0.1809, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 9.17% (0.2607 => 0.2846, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 9.16% (0.2761 => 0.3014, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.12% (1.3245 => 1.4453, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wc: 9.09% (0.2937 => 0.3204, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 9.06% (0.2628 => 0.2866, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 8.90% (0.2988 => 0.3254, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 8.89% (1.2749 => 1.3883, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.86% (0.2696 => 0.2935, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.85% (3.6692 => 3.9941, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: 8.82% (0.3131 => 0.3407, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.67% (4.4433 => 4.8287, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.67% (1.5188 => 1.6505, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 8.65% (14.8535 => 16.1385, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.60% (4.3801 => 4.7568, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.58% (0.3755 => 0.4077, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.43% (0.6135 => 0.6652, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.39% (0.8818 => 0.9558, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 8.35% (8.4961 => 9.2054, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/objinst: 8.22% (0.2945 => 0.3187, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.22% (0.1789 => 0.1936, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.15% (3.2742 => 3.5412, std.dev.: 0.0145) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.15% (0.3511 => 0.3797, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.09% (0.9108 => 0.9845, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 8.05% (0.4113 => 0.4444, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.01% (0.2321 => 0.2507, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.94% (0.2140 => 0.2310, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.92% (1.1333 => 1.2231, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 7.92% (4.6629 => 5.0322, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/bigfib: 7.89% (0.6250 => 0.6743, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.89% (0.4805 => 0.5184, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 7.77% (3.7467 => 4.0377, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.74% (2.1007 => 2.2632, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.63% (0.2504 => 0.2695, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/neural/neural: 7.58% (0.1385 => 0.1490, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 7.45% (6.5754 => 7.0655, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.37% (0.3245 => 0.3484, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 7.27% (0.2008 => 0.2154, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.17% (0.4003 => 0.4290, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 6.95% (0.3940 => 0.4214, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 6.85% (0.3914 => 0.4182, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.84% (13.2842 => 14.1926, std.dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 6.82% (1.2292 => 1.3130, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.74% (6.2785 => 6.7016, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/for-in: 6.60% (0.3789 => 0.4039, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 6.57% (0.3578 => 0.3813, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.51% (0.3623 => 0.3859, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.50% (0.3663 => 0.3901, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.45% (0.3646 => 0.3881, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 6.36% (0.3601 => 0.3830, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.30% (0.3650 => 0.3880, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.94% (0.1819 => 0.1927, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.31% (0.2243 => 0.2362, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 5.15% (16.2614 => 17.0993, std.dev.: 0.0104) MultiSource/Applications/ClamAV/clamscan: 4.54% (14.5298 => 15.1888, std.dev.: 0.0146) MultiSource/Benchmarks/Bullet/bullet: 1.99% (33.2944 => 33.9557, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5190, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.42% (1.8175 => 2.2613, std.dev.: 0.0295) SingleSource/Benchmarks/Misc/richards_benchmark: 11.06% (1.1560 => 1.2838, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 8.96% (0.8273 => 0.9014, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4146, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.31% (1.2998 => 1.3818, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.80% (0.3458 => 0.3624, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0041, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 3.93% (10.7476 => 11.1696, std.dev.: 0.0243) MultiSource/Benchmarks/nbench/nbench: 3.92% (11.2619 => 11.7029, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9856, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.17% (7.4271 => 7.5884, std.dev.: 0.0046) MultiSource/Applications/lemon/lemon: 1.57% (1.4298 => 1.4523, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std.dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5125, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/queens: 1.44% (2.1753 => 2.2067, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2123, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1886, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5783, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0268, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.07% (12.4560 => 12.5894, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.03% (8.8259 => 8.9170, std.dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.85% (0.2670 => 0.1419, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.36% (0.4657 => 0.3895, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -14.43% (0.0707 => 0.0605, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.26% (1.3813 => 1.1982, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.21% (1.3819 => 1.1993, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.34% (0.0997 => 0.0864, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -12.20% (0.2238 => 0.1965, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.94% (1.2308 => 1.0961, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.09% (20.3410 => 18.2887, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0052) SingleSource/Benchmarks/Dhrystone/dry: -5.38% (2.5089 => 2.3740, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.30% (1.3780 => 1.3049, std.dev.: 0.0033) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5144, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.54% (1.7688 => 1.7061, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.53% (0.9996 => 0.9643, std.dev.: 0.0020) MultiSource/Applications/siod/siod: -3.51% (3.2729 => 3.1580, std.dev.: 0.0069) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4867 => 0.4717, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -2.56% (26.5159 => 25.8359, std.dev.: 0.0236) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4781, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: -2.53% (0.5449 => 0.5311) MultiSource/Applications/spiff/spiff: -2.44% (3.0263 => 2.9526, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/bh/bh: -2.36% (1.9762 => 1.9296, std.dev.: 0.0038) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.87% (6.3560 => 6.2374, std.dev.: 0.0075) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7147, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.56% (0.6615 => 0.6512) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0073, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -1.31% (9.3358 => 9.2131, std.dev.: 0.0157) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.25% (0.8342 => 0.8238, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4948, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.13% (6.6320 => 6.5573, std.dev.: 0.0136) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2578, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.09% (3.9173 => 3.8747, std.dev.: 0.0163) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 13 22:22:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 14 Oct 2012 00:22:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121014052200.F1DD72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4854?compare_to=4852&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4854, Order: 165887, Start Time: 2012-10-14 04:03:58, End Time: 2012-10-14 05:23:53 To: 4852, Order: 165886, Start Time: 2012-10-14 00:21:25, End Time: 2012-10-14 01:41:18 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (163 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 952 (682 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.44% (1.2914 => 1.3100, std.dev.: 0.0014) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.02% (0.5965 => 0.5966, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: -0.08% (16.4816 => 16.4691, std.dev.: 0.0132) MultiSource/Benchmarks/Bullet/bullet: 0.04% (55.3994 => 55.4208, std.dev.: 0.0137) MultiSource/Benchmarks/MallocBench/gs/gs: 0.05% (4.4537 => 4.4559, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.22% (0.0463 => 0.0464, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0465 => 0.0465, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0433 => 0.0433) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.23% (0.0434 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.24% (0.0422 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0424 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0418 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.23% (0.0435 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0436 => 0.0436) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0429 => 0.0429) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.23% (0.0430 => 0.0431) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.24% (0.0417 => 0.0418, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0420 => 0.0420, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0426 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0427 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0437 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.23% (0.0439 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0414 => 0.0414) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.24% (0.0415 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0426 => 0.0426, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0427 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0418 => 0.0418) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -1.45% (0.0415 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0410 => 0.0410) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0407 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0410 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0445 => 0.0445, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.22% (0.0447 => 0.0446) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0407 => 0.0407, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.24% (0.0409 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0408 => 0.0408) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0409 => 0.0409) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0416 => 0.0416) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.10% (1.2620 => 1.2632, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.05% (7.9373 => 7.9333, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.05% (0.7455 => 0.7459, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -1.11% (0.0361 => 0.0357, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1432 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.47% (0.0644 => 0.0647, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.37% (63.2438 => 55.4208, std.dev.: 0.0137) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.21% (14.1553 => 18.9983, std.dev.: 0.2050) SingleSource/Benchmarks/Misc-C++-EH/spirit: 64.69% (3.4629 => 5.7029, std.dev.: 0.0034) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14230.00% (0.0720 => 10.3176, std.dev.: 0.0166) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952200.00% (0.0001 => 9.9523, std.dev.: 0.0011) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.74% (0.2554 => 0.4182, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: 44.61% (10.3673 => 14.9918, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/richards_benchmark: 39.21% (0.1622 => 0.2258, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 33.52% (0.1056 => 0.1410, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.88% (7.0540 => 8.3151, std.dev.: 0.0102) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.84% (2.2022 => 2.5951, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 17.67% (0.1432 => 0.1685, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.33% (0.1566 => 0.1806, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.32% (0.0871 => 0.0987, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 13.28% (0.3282 => 0.3718, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.00% (1.7609 => 1.9898, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/power/power: 12.78% (0.1440 => 0.1624, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.90% (0.1143 => 0.1279, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.74% (0.1584 => 0.1770, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.60% (0.3543 => 0.3954, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 11.50% (10.4361 => 11.6360, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/trivial-interface: 11.14% (0.3473 => 0.3860, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.10% (0.3927 => 0.4363, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 11.10% (0.7433 => 0.8258, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-3: 11.09% (0.3516 => 0.3906, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.04% (0.3543 => 0.3934, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.01% (0.3561 => 0.3953, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.98% (0.3497 => 0.3881, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 10.87% (0.3828 => 0.4244, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.83% (0.3886 => 0.4307, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 10.78% (0.7115 => 0.7882, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.72% (0.3694 => 0.4090, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.65% (0.1625 => 0.1798, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.59% (0.2700 => 0.2986, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.43% (0.4879 => 0.5388, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.43% (0.6675 => 0.7371, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 10.37% (9.4845 => 10.4681, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/tsp/tsp: 10.21% (0.1175 => 0.1295, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 10.09% (0.1655 => 0.1822, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.08% (0.1438 => 0.1583, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.08% (1.5415 => 1.6969, std.dev.: 0.0018) MultiSource/Applications/d/make_dparser: 10.03% (3.3354 => 3.6700, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 10.03% (0.1695 => 0.1865, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.01% (0.3177 => 0.3495, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/18-imp/imp: 9.79% (0.3423 => 0.3758, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.66% (0.4615 => 0.5061, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.61% (0.8067 => 0.8842, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 9.55% (0.3109 => 0.3406, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.55% (0.1236 => 0.1354, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.49% (0.5860 => 0.6416, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.48% (0.5105 => 0.5589, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 9.43% (5.7591 => 6.3022, std.dev.: 0.0031) MultiSource/Applications/aha/aha: 9.38% (0.1151 => 0.1259, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.34% (4.2646 => 4.6631, std.dev.: 0.0038) MultiSource/Applications/lua/lua: 9.33% (3.8723 => 4.2334, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.28% (0.1940 => 0.2120, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.26% (0.8172 => 0.8929, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.25% (0.2065 => 0.2256, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.23% (0.5569 => 0.6083, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.23% (1.3050 => 1.4254, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.21% (0.1510 => 0.1649, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 9.20% (0.7835 => 0.8556, std.dev.: 0.0022) MultiSource/Applications/Burg/burg: 9.20% (1.1642 => 1.2713, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.16% (0.2107 => 0.2300, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 9.13% (0.1555 => 0.1697, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.11% (0.2271 => 0.2478, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 9.03% (0.1163 => 0.1268, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.03% (0.2758 => 0.3007, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.02% (5.0018 => 5.4532, std.dev.: 0.0092) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.94% (0.3121 => 0.3400, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.91% (4.9449 => 5.3854, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.81% (8.1363 => 8.8531, std.dev.: 0.0121) MultiSource/Applications/treecc/treecc: 8.81% (2.0273 => 2.2059, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 8.77% (0.6456 => 0.7022, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.76% (0.9765 => 1.0620, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.75% (0.5020 => 0.5459, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 8.74% (0.6030 => 0.6557, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.74% (0.3307 => 0.3596, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.65% (7.9617 => 8.6503, std.dev.: 0.0050) MultiSource/Applications/siod/siod: 8.62% (2.2969 => 2.4949, std.dev.: 0.0063) MultiSource/Applications/lemon/lemon: 8.62% (1.0722 => 1.1646, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 8.59% (0.5925 => 0.6434, std.dev.: 0.0061) MultiSource/Applications/hbd/hbd: 8.51% (1.5603 => 1.6931, std.dev.: 0.0021) MultiSource/Benchmarks/sim/sim: 8.47% (0.3387 => 0.3674, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.46% (1.5859 => 1.7201, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 8.24% (0.3180 => 0.3442, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/health/health: 8.20% (0.1268 => 0.1372, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.20% (0.3441 => 0.3723, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.15% (0.1337 => 0.1446, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.99% (0.3865 => 0.4174, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.97% (0.4103 => 0.4430, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 7.92% (0.7326 => 0.7906, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.91% (1.1861 => 1.2799, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.61% (0.4203 => 0.4523, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.53% (0.4289 => 0.4612, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.49% (0.6450 => 0.6933, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.40% (2.2024 => 2.3654, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/05-eks/eks: 7.35% (0.4299 => 0.4615, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.34% (0.3826 => 0.4107, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.34% (0.2603 => 0.2794, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 7.33% (0.3422 => 0.3673, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.32% (0.4620 => 0.4958, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 7.29% (21.9371 => 23.5357, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/football/football: 7.27% (0.8921 => 0.9570, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/moments: 7.24% (0.4048 => 0.4341, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: 7.11% (0.1463 => 0.1567, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.07% (0.3650 => 0.3908, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.03% (0.4636 => 0.4962, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.01% (0.5981 => 0.6400, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 6.91% (0.3603 => 0.3852, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.90% (0.1695 => 0.1812, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.89% (0.3136 => 0.3352, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.71% (0.2891 => 0.3085, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.70% (0.3684 => 0.3931, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.69% (1.4186 => 1.5135, std.dev.: 0.0019) SingleSource/Regression/C++/ofstream_ctor: 6.68% (0.2905 => 0.3099, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.51% (0.3162 => 0.3368, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.42% (0.2725 => 0.2900, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.41% (2.0665 => 2.1989, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/strcat: 6.36% (0.2831 => 0.3011, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.35% (0.2756 => 0.2931, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.32% (0.3052 => 0.3245, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 6.32% (1.1840 => 1.2588, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.23% (0.2793 => 0.2967, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.21% (0.2802 => 0.2976, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.19% (0.2714 => 0.2882, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.17% (0.3098 => 0.3289, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.13% (0.2871 => 0.3047, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 6.06% (0.3232 => 0.3428, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.06% (0.2872 => 0.3046, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 6.05% (0.2877 => 0.3051, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.03% (0.1906 => 0.2021, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 6.03% (0.3283 => 0.3481, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.83% (0.2266 => 0.2398, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.76% (0.4064 => 0.4298, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.70% (0.8101 => 0.8563, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.60% (0.1892 => 0.1998, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 5.53% (0.3379 => 0.3566, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.10% (14.3668 => 15.0998, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/ReedSolomon: 4.93% (0.2049 => 0.2150, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.84% (0.3427 => 0.3593, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.79% (0.3131 => 0.3281, std.dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 4.76% (1.2842 => 1.3453, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 4.63% (17.1811 => 17.9760, std.dev.: 0.0216) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.44% (0.2430 => 0.2538, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.09% (3.8922 => 4.0514, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.41% (0.3817 => 0.3947, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.24% (1.1194 => 1.1557, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2173, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.86% (1.1396 => 1.2520, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0021) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4498, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3682, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.62% (3.6395 => 3.7712, std.dev.: 0.0024) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.75% (4.2280 => 4.3444, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7655, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.69% (0.8275 => 0.8415, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.35% (11.6436 => 11.8012, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.08% (2.6546 => 2.6834, std.dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1314, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.15% (0.8651 => 0.1717, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.27% (5.2763 => 3.2569, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.13% (5.3855 => 3.7091, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.64% (5.3526 => 3.7123, std.dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -14.59% (54.1659 => 46.2648, std.dev.: 0.0120) MultiSource/Applications/ClamAV/clamscan: -12.09% (22.1758 => 19.4937, std.dev.: 0.0153) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.14% (2.9384 => 2.6405, std.dev.: 0.0172) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: -33.44% (1.1492 => 0.7649, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: -16.03% (1.6925 => 1.4212, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.83% (0.0998 => 0.0860, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.23% (1.2373 => 1.0983, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3783, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/mason/mason: -10.13% (0.2161 => 0.1942, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.28% (19.9488 => 18.2978, std.dev.: 0.0312) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.62% (1.8329 => 1.7115, std.dev.: 0.0384) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.31% (1.6805 => 1.5913, std.dev.: 0.0129) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: -4.71% (1.5835 => 1.5089, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.68% (3.2827 => 3.1620, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.29% (0.9957 => 0.9629, std.dev.: 0.0072) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5005, std.dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: -3.01% (12.4730 => 12.0981, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.17% (8.6802 => 8.4919, std.dev.: 0.0152) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.96% (8.1563 => 7.9962, std.dev.: 0.0059) SingleSource/Regression/C/uint64_to_float: -1.88% (0.5413 => 0.5311, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -1.83% (10.2830 => 10.0948, std.dev.: 0.0216) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6780, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.64% (2.5528 => 2.5110, std.dev.: 0.0018) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4218, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -1.09% (6.2999 => 6.2310, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 14.09% (0.5229 => 0.5966, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 9.87% (14.9895 => 16.4691, std.dev.: 0.0132) MultiSource/Benchmarks/MallocBench/gs/gs: 8.40% (4.1105 => 4.4559, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.34% (1.1048 => 1.2632, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.83% (7.1582 => 7.9333, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.88% (0.6222 => 0.7459, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35600.00% (0.0001 => 0.0357, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.42% (0.2116 => 0.0647, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 13 22:27:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 14 Oct 2012 00:27:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121014052735.277782A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4855?compare_to=4853&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4855, Order: 165887, Start Time: 2012-10-14 04:04:54, End Time: 2012-10-14 05:30:28 To: 4853, Order: 165886, Start Time: 2012-10-14 00:27:43, End Time: 2012-10-14 01:53:24 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (185 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1042 (677 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.36% (2.0176 => 2.4889, std.dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 19.30% (0.0653 => 0.0779, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.51% (0.1410 => 0.1671, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 17.19% (0.0826 => 0.0968, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 16.41% (0.2243 => 0.2611, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.46% (0.1072 => 0.1227, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 13.92% (0.1013 => 0.1154, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.43% (0.0834 => 0.0946) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.38% (0.0770 => 0.0873, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.09% (0.1413 => 0.1598, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 13.03% (0.7038 => 0.7955, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.81% (0.1327 => 0.1497, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 12.63% (1.3693 => 1.5422, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.50% (0.2721 => 0.3061, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.45% (0.0964 => 0.1084, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.43% (3.9660 => 4.4590, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.10% (0.2596 => 0.2910, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.09% (0.1588 => 0.1780, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.95% (1.4563 => 1.6303, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.94% (0.6959 => 0.7790, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 11.88% (13.8202 => 15.4615, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.81% (0.5265 => 0.5887, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.76% (0.6283 => 0.7022, std.dev.: 0.0050) MultiSource/Applications/aha/aha: 11.68% (0.1062 => 0.1186, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.61% (0.9199 => 1.0267, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 11.60% (0.4328 => 0.4830, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.56% (0.7710 => 0.8601, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.51% (1.2193 => 1.3597, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 11.37% (0.1003 => 0.1117, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.26% (1.1364 => 1.2644, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.09% (0.3130 => 0.3477, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 11.00% (0.5818 => 0.6458, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 11.00% (1.0313 => 1.1447, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 10.93% (0.4062 => 0.4506, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.88% (0.1986 => 0.2202, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 10.75% (1.1061 => 1.2250, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.75% (0.3899 => 0.4318, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.70% (0.5577 => 0.6174, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 10.68% (0.5748 => 0.6362, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.63% (0.1157 => 0.1280, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.44% (0.4791 => 0.5291, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.42% (0.1276 => 0.1409, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.38% (0.2966 => 0.3274, std.dev.: 0.0034) MultiSource/Applications/kimwitu++/kc: 10.29% (16.6129 => 18.3216, std.dev.: 0.0205) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.24% (0.3485 => 0.3842, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 10.23% (0.7061 => 0.7783, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.18% (0.4016 => 0.4425, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 10.17% (2.1791 => 2.4008, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 10.15% (0.1478 => 0.1628, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 10.14% (0.6744 => 0.7428, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.14% (0.1075 => 0.1184, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.09% (0.4379 => 0.4821, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: 10.06% (3.8646 => 4.2535, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.01% (0.3246 => 0.3571, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.99% (0.2914 => 0.3205, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.98% (0.3756 => 0.4131, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 9.97% (0.3220 => 0.3541, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 9.94% (0.1589 => 0.1747, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 9.94% (1.9270 => 2.1186, std.dev.: 0.0048) MultiSource/Applications/d/make_dparser: 9.92% (3.1889 => 3.5052, std.dev.: 0.0047) MultiSource/Applications/sgefa/sgefa: 9.92% (0.2995 => 0.3292, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.87% (0.1865 => 0.2049, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.83% (0.3022 => 0.3319, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 9.82% (0.2781 => 0.3054, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/mst/mst: 9.81% (0.1111 => 0.1220, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 9.81% (0.3293 => 0.3616, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.77% (0.8698 => 0.9548, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.77% (0.4390 => 0.4819, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 9.75% (0.7506 => 0.8238, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.74% (0.5637 => 0.6186, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.72% (0.7460 => 0.8185, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.72% (0.3489 => 0.3828, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.69% (0.2127 => 0.2333, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 9.64% (0.8310 => 0.9111, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 9.61% (0.2925 => 0.3206, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.58% (0.3580 => 0.3923, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/moments: 9.54% (0.3868 => 0.4237, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.49% (0.2782 => 0.3046, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 9.47% (0.3453 => 0.3780, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.46% (4.9865 => 5.4584, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/strcat: 9.43% (0.2726 => 0.2983, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.41% (0.1435 => 0.1570, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.31% (0.1569 => 0.1715, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 9.30% (0.3149 => 0.3442, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 9.30% (0.3107 => 0.3396, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.29% (0.2023 => 0.2211, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.24% (7.2180 => 7.8850, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/except: 9.20% (0.2760 => 0.3014, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.20% (0.6576 => 0.7181, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.19% (1.9828 => 2.1651, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 9.17% (0.3534 => 0.3858, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.11% (0.2655 => 0.2897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 9.01% (0.2607 => 0.2842, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/random: 9.00% (0.2690 => 0.2932, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.97% (0.2765 => 0.3013, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 8.87% (0.2761 => 0.3006, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 8.87% (1.0594 => 1.1534, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 8.87% (0.1657 => 0.1804, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 8.85% (0.2937 => 0.3197, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 8.83% (0.3192 => 0.3474, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 8.79% (0.2628 => 0.2859, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.75% (1.3245 => 1.4404, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 8.73% (0.2988 => 0.3249, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 8.69% (1.2749 => 1.3857, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.66% (3.6692 => 3.9869, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 8.66% (0.3131 => 0.3402, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.61% (0.2696 => 0.2928, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.47% (4.3801 => 4.7511, std.dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 8.45% (14.8535 => 16.1090, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.41% (4.4433 => 4.8168, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.40% (0.3511 => 0.3806, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.34% (0.3755 => 0.4068, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.27% (0.2140 => 0.2317, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.25% (1.5188 => 1.6441, std.dev.: 0.0057) MultiSource/Benchmarks/mafft/pairlocalalign: 8.14% (8.4961 => 9.1875, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.01% (0.8818 => 0.9524, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.99% (0.6135 => 0.6625, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 7.95% (0.2945 => 0.3179, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 7.90% (4.6629 => 5.0311, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 7.84% (0.4003 => 0.4317, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.84% (3.2742 => 3.5310, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.84% (0.2321 => 0.2503, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.77% (0.1789 => 0.1928, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.69% (1.1333 => 1.2205, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/05-eks/eks: 7.68% (0.4113 => 0.4429, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 7.68% (0.6250 => 0.6730, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.62% (0.9108 => 0.9802, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 7.59% (0.3914 => 0.4211, std.dev.: 0.0026) MultiSource/Applications/lua/lua: 7.58% (3.7467 => 4.0306, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/property: 7.41% (0.3940 => 0.4232, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.41% (0.3578 => 0.3843, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.37% (0.4805 => 0.5159, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 7.34% (6.5754 => 7.0580, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.34% (2.1007 => 2.2548, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-4: 7.32% (0.3646 => 0.3913, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 7.29% (0.1385 => 0.1486, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 7.26% (0.3789 => 0.4064, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.19% (0.3601 => 0.3860, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.18% (0.3663 => 0.3926, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.12% (0.3623 => 0.3881, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.11% (0.2504 => 0.2682, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.04% (0.3650 => 0.3907, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.00% (0.3245 => 0.3472, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 6.97% (0.2008 => 0.2148, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.64% (13.2842 => 14.1660, std.dev.: 0.0128) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.64% (6.2785 => 6.6951, std.dev.: 0.0082) MultiSource/Applications/hexxagon/hexxagon: 6.52% (1.2292 => 1.3093, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.21% (0.1819 => 0.1932, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.31% (0.2243 => 0.2362, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 4.87% (16.2614 => 17.0533, std.dev.: 0.0193) MultiSource/Applications/ClamAV/clamscan: 4.34% (14.5298 => 15.1601, std.dev.: 0.0055) MultiSource/Benchmarks/Bullet/bullet: 2.07% (33.2944 => 33.9848, std.dev.: 0.0079) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 30.61% (5.7573 => 7.5198, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.75% (1.8175 => 2.2674, std.dev.: 0.0488) SingleSource/Benchmarks/Misc/richards_benchmark: 10.97% (1.1560 => 1.2828, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (3.1736 => 3.4147, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.26% (1.2998 => 1.3812, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.86% (2.8606 => 2.9997, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625) SingleSource/Benchmarks/Misc/flops-5: 4.81% (1.9144 => 2.0064, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.94% (11.2619 => 11.7053, std.dev.: 0.0048) MultiSource/Applications/SPASS/SPASS: 3.51% (10.7476 => 11.1251, std.dev.: 0.0116) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9859, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.23% (7.4271 => 7.5926, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4533, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5136, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2122, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1867, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5786, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0269, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5901, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.89% (0.2670 => 0.1418, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.76% (0.4657 => 0.3923, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -14.43% (0.0707 => 0.0605, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.37% (1.3813 => 1.1966, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.28% (1.3819 => 1.1984, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.12% (22.5627 => 22.3090, std.dev.: 0.0086) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.33% (1.0460 => 0.8543, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.64% (0.0997 => 0.0861, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.06% (0.2238 => 0.1968, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.47% (1.2308 => 1.0896, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.06% (20.3410 => 18.2945, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0124) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.49% (1.3780 => 1.3024, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5141, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8004, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.72% (0.9996 => 0.9624, std.dev.: 0.0032) MultiSource/Applications/siod/siod: -3.58% (3.2729 => 3.1558, std.dev.: 0.0079) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.43% (1.7688 => 1.7081, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.12% (0.4867 => 0.4715, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: -2.55% (0.5449 => 0.5310, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -2.54% (26.5159 => 25.8412, std.dev.: 0.0185) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.46% (3.0263 => 2.9520, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.28% (1.9762 => 1.9311, std.dev.: 0.0088) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7153, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: -1.76% (6.3560 => 6.2440, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0073, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8645, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.25% (0.8342 => 0.8238, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4957, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -1.13% (9.3358 => 9.2302, std.dev.: 0.0090) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2586, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.00% (6.6320 => 6.5655, std.dev.: 0.0103) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 14 00:14:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 14 Oct 2012 02:14:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121014071407.EE8192A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4856?compare_to=4854&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4856, Order: 165891, Start Time: 2012-10-14 05:53:09, End Time: 2012-10-14 07:16:00 To: 4854, Order: 165887, Start Time: 2012-10-14 04:03:58, End Time: 2012-10-14 05:23:53 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (139 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 951 (707 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.64% (14.9918 => 15.2384, std.dev.: 0.0100) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.10% (7.9558 => 8.0436, std.dev.: 0.0068) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.03% (0.5966 => 0.5968, std.dev.: 0.0186) MultiSource/Applications/SPASS/SPASS: -0.13% (16.4691 => 16.4476, std.dev.: 0.3396) MultiSource/Benchmarks/Bullet/bullet: 0.10% (55.4208 => 55.4765, std.dev.: 0.0837) MultiSource/Benchmarks/MallocBench/gs/gs: 0.07% (4.4559 => 4.4589, std.dev.: 0.1791) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.86% (0.0464 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.65% (0.0465 => 0.0462, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.69% (0.0433 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.69% (0.0435 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.48% (0.0421 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.71% (0.0424 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.96% (0.0417 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.48% (0.0418 => 0.0416) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.46% (0.0434 => 0.0432, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.69% (0.0436 => 0.0433, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.70% (0.0429 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.16% (0.0431 => 0.0426, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.48% (0.0418 => 0.0416) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.71% (0.0420 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.70% (0.0426 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.47% (0.0427 => 0.0425) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.46% (0.0437 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.46% (0.0438 => 0.0436, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.72% (0.0414 => 0.0411) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.48% (0.0414 => 0.0412, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.70% (0.0426 => 0.0423, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.70% (0.0427 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.72% (0.0417 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.48% (0.0418 => 0.0416) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.49% (0.0409 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.49% (0.0410 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.49% (0.0407 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.73% (0.0410 => 0.0407) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.45% (0.0445 => 0.0443) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.45% (0.0446 => 0.0444) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.49% (0.0407 => 0.0405) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.49% (0.0408 => 0.0406) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.49% (0.0408 => 0.0406) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.49% (0.0409 => 0.0407) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.72% (0.0416 => 0.0413, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.48% (0.0417 => 0.0415) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.12% (1.2632 => 1.2617, std.dev.: 0.0131) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.02% (7.9333 => 7.9315, std.dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.39% (0.7459 => 0.7430, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.28% (0.0357 => 0.0358, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1433 => 0.1434, std.dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0647 => 0.0647, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.28% (63.2438 => 55.4765, std.dev.: 0.0837) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.38% (14.1553 => 19.0216, std.dev.: 0.4494) SingleSource/Benchmarks/Misc-C++-EH/spirit: 64.99% (3.4629 => 5.7133, std.dev.: 0.0146) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14227.64% (0.0720 => 10.3159, std.dev.: 0.1523) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952600.00% (0.0001 => 9.9527, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 64.37% (0.2554 => 0.4198, std.dev.: 0.0125) MultiSource/Benchmarks/PAQ8p/paq8p: 46.99% (10.3673 => 15.2384, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/richards_benchmark: 39.70% (0.1622 => 0.2266, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 33.71% (0.1056 => 0.1412, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: 18.02% (0.1432 => 0.1690, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.82% (7.0540 => 8.3109, std.dev.: 0.0215) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.09% (2.2022 => 2.5786, std.dev.: 0.0380) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.52% (0.1566 => 0.1809, std.dev.: 0.0050) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.21% (0.1143 => 0.1294, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.20% (0.0871 => 0.0986, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.06% (1.7609 => 1.9909, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/oourafft: 12.95% (0.3282 => 0.3707, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 12.85% (0.1440 => 0.1625, std.dev.: 0.0050) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 12.06% (0.1584 => 0.1775, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.94% (0.1625 => 0.1819, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 11.35% (10.4361 => 11.6204, std.dev.: 0.1986) MultiSource/Applications/lambda-0_1_3/lambda: 11.19% (0.7433 => 0.8265, std.dev.: 0.0216) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.95% (0.3543 => 0.3931, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 10.81% (0.7115 => 0.7884, std.dev.: 0.0241) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.78% (0.2700 => 0.2991, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.56% (0.4879 => 0.5394, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/parameter-passing: 10.52% (0.3927 => 0.4340, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 10.46% (9.4845 => 10.4766, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/trivial-interface: 10.42% (0.3473 => 0.3835, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.29% (0.1438 => 0.1586, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.27% (0.4615 => 0.5089, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-2: 10.27% (0.3497 => 0.3856, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.25% (0.3561 => 0.3926, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.25% (0.3543 => 0.3906, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.24% (0.3516 => 0.3876, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.20% (0.6675 => 0.7356, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 10.16% (0.3886 => 0.4281, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 10.09% (0.1655 => 0.1822, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.08% (0.3828 => 0.4214, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.05% (1.5415 => 1.6964, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/for-in: 10.04% (0.3694 => 0.4065, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 9.99% (3.3354 => 3.6687, std.dev.: 0.0129) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.92% (0.3177 => 0.3492, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 9.75% (0.3109 => 0.3412, std.dev.: 0.0012) MultiSource/Applications/aha/aha: 9.64% (0.1151 => 0.1262, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.56% (0.5105 => 0.5593, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.55% (0.1236 => 0.1354, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.45% (0.5569 => 0.6095, std.dev.: 0.0204) MultiSource/Applications/oggenc/oggenc: 9.43% (5.7591 => 6.3024, std.dev.: 0.0956) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.35% (4.2646 => 4.6634, std.dev.: 0.1319) MultiSource/Applications/lua/lua: 9.30% (3.8723 => 4.2325, std.dev.: 0.1137) MultiSource/Applications/Burg/burg: 9.29% (1.1642 => 1.2723, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.28% (1.3050 => 1.4261, std.dev.: 0.0442) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.14% (0.1510 => 0.1648, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.07% (0.8172 => 0.8913, std.dev.: 0.0071) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.88% (0.2107 => 0.2294, std.dev.: 0.0071) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.87% (5.0018 => 5.4454, std.dev.: 0.0162) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.80% (4.9449 => 5.3801, std.dev.: 0.0086) MultiSource/Applications/hbd/hbd: 8.79% (1.5603 => 1.6975, std.dev.: 0.0430) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.77% (0.2065 => 0.2246, std.dev.: 0.0042) MultiSource/Applications/spiff/spiff: 8.76% (0.7835 => 0.8521, std.dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.75% (7.9617 => 8.6586, std.dev.: 0.0129) MultiSource/Applications/lemon/lemon: 8.74% (1.0722 => 1.1659, std.dev.: 0.0345) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.73% (8.1363 => 8.8470, std.dev.: 0.1955) SingleSource/Benchmarks/Misc-C++/bigfib: 8.72% (0.6456 => 0.7019, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.64% (1.5859 => 1.7230, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 8.60% (2.2969 => 2.4945, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.57% (0.5020 => 0.5450, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.53% (0.3307 => 0.3589, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 8.47% (0.3387 => 0.3674, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.38% (0.1337 => 0.1449, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 8.08% (0.6030 => 0.6517, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 8.05% (0.5925 => 0.6402, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.99% (0.4103 => 0.4431, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.80% (0.2603 => 0.2806, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.67% (2.2024 => 2.3714, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.43% (0.3865 => 0.4152, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.42% (0.4203 => 0.4515, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/football/football: 7.41% (0.8921 => 0.9582, std.dev.: 0.0153) MultiSource/Applications/JM/lencod/lencod: 7.36% (21.9371 => 23.5523, std.dev.: 0.3310) SingleSource/UnitTests/ObjC++/property-reference: 7.34% (0.7326 => 0.7864, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.33% (0.4636 => 0.4976, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 7.30% (0.4289 => 0.4602, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/moments: 7.19% (0.4048 => 0.4339, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 7.07% (0.3422 => 0.3664, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: 7.04% (0.1463 => 0.1566, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.93% (0.3650 => 0.3903, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.93% (0.3826 => 0.4091, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 6.90% (0.4620 => 0.4939, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/sieve: 6.72% (0.3603 => 0.3845, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.55% (0.1695 => 0.1806, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.47% (0.3136 => 0.3339, std.dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 6.44% (1.1840 => 1.2602, std.dev.: 0.0102) SingleSource/Regression/C++/ofstream_ctor: 6.37% (0.2905 => 0.3090, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.35% (0.3684 => 0.3918, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.20% (0.3162 => 0.3358, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.16% (0.2891 => 0.3069, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.16% (2.0665 => 2.1937, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/strcat: 6.08% (0.2831 => 0.3003, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.05% (0.2266 => 0.2403, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.98% (0.1906 => 0.2020, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/matrix: 5.94% (0.3098 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.85% (0.2871 => 0.3039, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary: 5.82% (0.3232 => 0.3420, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.77% (0.2756 => 0.2915, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.76% (0.3283 => 0.3472, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.74% (0.2877 => 0.3042, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.70% (0.3052 => 0.3226, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.68% (0.2872 => 0.3035, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.63% (0.4064 => 0.4293, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 5.61% (0.2725 => 0.2878, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.53% (0.2714 => 0.2864, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.50% (0.2802 => 0.2956, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.44% (0.1892 => 0.1995, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.44% (0.2793 => 0.2945, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.42% (0.3379 => 0.3562, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 5.08% (0.2049 => 0.2153, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.99% (0.3427 => 0.3598, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.96% (14.3668 => 15.0798, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/objinst: 4.69% (0.3131 => 0.3278, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.53% (0.2430 => 0.2540, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.47% (3.8922 => 4.0661, std.dev.: 0.0125) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.20% (1.1194 => 1.1552, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.78% (0.3817 => 0.3923, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.22% (1.1145 => 1.3844, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2173, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.99% (1.1396 => 1.2534, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560) MultiSource/Applications/aha/aha: 9.20% (3.1595 => 3.4502, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.71% (3.1578 => 3.3697, std.dev.: 0.0132) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.65% (0.3463 => 0.3624, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.4162 => 0.4322, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.36% (3.6395 => 3.7619, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.72% (4.2280 => 4.3428, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7655, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.35% (11.6436 => 11.8011, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.19% (6.5088 => 6.5864, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.16% (2.6546 => 2.6854, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1314, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: -80.25% (0.8651 => 0.1709, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.29% (5.2763 => 3.2560, std.dev.: 0.0098) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.23% (5.3855 => 3.7035, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.91% (5.3526 => 3.6981, std.dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -14.67% (54.1659 => 46.2217, std.dev.: 0.0577) MultiSource/Applications/ClamAV/clamscan: -12.16% (22.1758 => 19.4789, std.dev.: 0.4947) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.24% (2.9384 => 2.6376, std.dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -33.36% (1.1492 => 0.7658, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: -16.15% (1.6925 => 1.4192, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.73% (0.0998 => 0.0861, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -12.03% (1.2373 => 1.0884, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/mandel-2: -10.32% (1.5373 => 1.3787, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/mason/mason: -9.90% (0.2161 => 0.1947, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.33% (19.9488 => 18.2873, std.dev.: 0.0181) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5753, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.58% (1.9577 => 1.8484, std.dev.: 0.0143) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.30% (1.6805 => 1.5914, std.dev.: 0.0111) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7966, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.85% (1.5835 => 1.5067, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.31% (0.9957 => 0.9528, std.dev.: 0.0121) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1627, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4955, std.dev.: 0.0118) MultiSource/Applications/hexxagon/hexxagon: -3.01% (12.4730 => 12.0979, std.dev.: 0.0158) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.10% (8.6802 => 8.4983, std.dev.: 0.0129) SingleSource/Regression/C/uint64_to_float: -1.90% (0.5413 => 0.5310, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -1.79% (10.2830 => 10.0990, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6828, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.65% (8.1563 => 8.0220, std.dev.: 0.0075) SingleSource/UnitTests/Vector/multiplies: -1.63% (2.5528 => 2.5113, std.dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4206, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8567, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 14.13% (0.5229 => 0.5968, std.dev.: 0.0186) MultiSource/Applications/SPASS/SPASS: 9.73% (14.9895 => 16.4476, std.dev.: 0.3396) MultiSource/Benchmarks/MallocBench/gs/gs: 8.48% (4.1105 => 4.4589, std.dev.: 0.1791) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.20% (1.1048 => 1.2617, std.dev.: 0.0131) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.80% (7.1582 => 7.9315, std.dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.41% (0.6222 => 0.7430, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35700.00% (0.0001 => 0.0358, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: -3.43% (0.1485 => 0.1434, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.42% (0.2116 => 0.0647, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 14 00:24:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 14 Oct 2012 02:24:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121014072408.4C0652A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4857?compare_to=4855&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4857, Order: 165891, Start Time: 2012-10-14 05:59:31, End Time: 2012-10-14 07:27:00 To: 4855, Order: 165887, Start Time: 2012-10-14 04:04:54, End Time: 2012-10-14 05:30:28 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (179 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1041 (686 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.98% (3.7499 => 3.8243, std.dev.: 0.0177) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.69% (2.0176 => 2.4956, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.58% (0.1410 => 0.1672, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 16.94% (0.2243 => 0.2623, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.54% (0.0653 => 0.0761, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 14.31% (0.1013 => 0.1158, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.09% (0.1072 => 0.1223, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.79% (0.0834 => 0.0949, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.38% (0.1413 => 0.1602, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 13.20% (0.7038 => 0.7967, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.19% (0.1327 => 0.1502, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 13.01% (1.3693 => 1.5475, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.77% (3.9660 => 4.4723, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.76% (0.0964 => 0.1087, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.60% (0.2596 => 0.2923, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.57% (0.2721 => 0.3063, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.34% (0.1588 => 0.1784, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.23% (0.6959 => 0.7810, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 12.22% (13.8202 => 15.5085, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.20% (1.4563 => 1.6340, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.16% (0.6283 => 0.7047, std.dev.: 0.0296) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.15% (0.7710 => 0.8647, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.14% (0.5265 => 0.5904, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 12.13% (0.4328 => 0.4853, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.09% (0.9199 => 1.0311, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 11.96% (0.1062 => 0.1189, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.87% (1.2193 => 1.3640, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: 11.76% (0.1003 => 0.1121, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 11.67% (0.5818 => 0.6497, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.64% (1.1364 => 1.2687, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 11.47% (0.4062 => 0.4528, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 11.34% (1.0313 => 1.1483, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 11.27% (0.5748 => 0.6396, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.21% (0.3130 => 0.3481, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.13% (0.3899 => 0.4333, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.98% (0.4791 => 0.5317, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.96% (0.5577 => 0.6188, std.dev.: 0.0025) MultiSource/Applications/Burg/burg: 10.95% (1.1061 => 1.2272, std.dev.: 0.0037) SingleSource/UnitTests/ObjC++/property-reference: 10.95% (0.7061 => 0.7834, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.88% (0.4016 => 0.4453, std.dev.: 0.0136) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.70% (0.3485 => 0.3858, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.70% (0.1075 => 0.1190, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.63% (0.3246 => 0.3591, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 10.45% (16.6129 => 18.3490, std.dev.: 0.0151) MultiSource/Applications/minisat/minisat: 10.41% (0.6744 => 0.7446, std.dev.: 0.0025) SingleSource/Regression/C++/ofstream_ctor: 10.39% (0.2781 => 0.3070, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.39% (0.4379 => 0.4834, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 10.36% (3.8646 => 4.2648, std.dev.: 0.0082) MultiSource/Applications/siod/siod: 10.34% (2.1791 => 2.4044, std.dev.: 0.0078) MultiSource/Applications/treecc/treecc: 10.34% (1.9270 => 2.1262, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.30% (0.2127 => 0.2346, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 10.28% (0.2995 => 0.3303, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.27% (0.4390 => 0.4841, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.26% (0.2914 => 0.3213, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 10.26% (0.1589 => 0.1752, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: 10.24% (0.3868 => 0.4264, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.24% (0.0977 => 0.1077, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 10.20% (3.1889 => 3.5141, std.dev.: 0.0120) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.19% (0.1865 => 0.2055, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 10.17% (0.3293 => 0.3628, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 10.17% (0.1111 => 0.1224, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 10.15% (0.1478 => 0.1628, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sieve: 10.14% (0.3453 => 0.3803, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.13% (0.3022 => 0.3328, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 10.13% (0.7506 => 0.8266, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.12% (0.1986 => 0.2187, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.12% (0.3489 => 0.3842, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.09% (0.7460 => 0.8213, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 10.09% (0.3220 => 0.3545, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.06% (0.2782 => 0.3062, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.05% (0.8698 => 0.9572, std.dev.: 0.0201) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.00% (0.3580 => 0.3938, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.98% (0.2966 => 0.3262, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.96% (0.1014 => 0.1115, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.92% (0.5637 => 0.6196, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 9.92% (0.8310 => 0.9134, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/09-vor/vor: 9.91% (0.2925 => 0.3215, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.90% (0.1435 => 0.1577, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.79% (0.2655 => 0.2915, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.79% (0.2023 => 0.2221, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.76% (1.9828 => 2.1764, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 9.76% (0.2726 => 0.2992, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.75% (0.1569 => 0.1722, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.70% (7.2180 => 7.9184, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary3: 9.62% (0.3149 => 0.3452, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 9.60% (0.2760 => 0.3025, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.59% (4.9865 => 5.4649, std.dev.: 0.1602) SingleSource/Benchmarks/Shootout-C++/random: 9.59% (0.2690 => 0.2948, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hello: 9.59% (0.2607 => 0.2857, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.55% (0.2765 => 0.3029, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 9.51% (0.3534 => 0.3870, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/fibo: 9.44% (0.2628 => 0.2876, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 9.43% (0.2937 => 0.3214, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.40% (0.1276 => 0.1396, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 9.40% (0.3107 => 0.3399, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 9.38% (0.2761 => 0.3020, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.24% (0.2696 => 0.2945, std.dev.: 0.0050) MultiSource/Benchmarks/nbench/nbench: 9.21% (1.0594 => 1.1570, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: 9.18% (0.3192 => 0.3485, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 9.11% (0.1657 => 0.1808, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.11% (1.3245 => 1.4451, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 9.07% (0.2988 => 0.3259, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.03% (0.3755 => 0.4094, std.dev.: 0.0109) MultiSource/Applications/SIBsim4/SIBsim4: 8.97% (1.2749 => 1.3892, std.dev.: 0.0029) MultiSource/Benchmarks/sim/sim: 8.94% (0.3131 => 0.3411, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.85% (0.6576 => 0.7158, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.85% (4.4433 => 4.8365, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.84% (3.6692 => 3.9934, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.79% (4.3801 => 4.7651, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 8.76% (14.8535 => 16.1546, std.dev.: 0.0217) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.69% (0.6135 => 0.6668, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 8.56% (0.2945 => 0.3197, std.dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: 8.43% (8.4961 => 9.2127, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.38% (1.5188 => 1.6460, std.dev.: 0.0443) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.35% (0.3511 => 0.3804, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.13% (0.2140 => 0.2314, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.12% (0.9108 => 0.9848, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.11% (0.8818 => 0.9533, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.11% (0.1789 => 0.1934, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.10% (0.2321 => 0.2509, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.10% (3.2742 => 3.5394, std.dev.: 0.0498) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.03% (1.1333 => 1.2243, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 7.89% (3.7467 => 4.0424, std.dev.: 0.0103) MultiSource/Applications/oggenc/oggenc: 7.78% (4.6629 => 5.0259, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/05-eks/eks: 7.78% (0.4113 => 0.4433, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 7.62% (6.5754 => 7.0763, std.dev.: 0.0170) MultiSource/Benchmarks/FreeBench/neural/neural: 7.58% (0.1385 => 0.1490, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.52% (0.3245 => 0.3489, std.dev.: 0.0082) SingleSource/UnitTests/ObjC/parameter-passing: 7.47% (0.4003 => 0.4302, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.35% (0.2504 => 0.2688, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.15% (0.3914 => 0.4194, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.12% (1.2292 => 1.3167, std.dev.: 0.0110) SingleSource/UnitTests/ObjC/property: 7.11% (0.3940 => 0.4220, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 6.99% (0.3789 => 0.4054, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.97% (6.2785 => 6.7159, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/synchronized: 6.96% (0.3663 => 0.3918, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.94% (13.2842 => 14.2061, std.dev.: 0.0190) SingleSource/UnitTests/ObjC/trivial-interface: 6.90% (0.3578 => 0.3825, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.80% (0.3646 => 0.3894, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 6.72% (0.3601 => 0.3843, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.68% (0.3623 => 0.3865, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.63% (0.3650 => 0.3892, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.38% (0.1819 => 0.1935, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.57% (0.2243 => 0.2368, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 5.23% (16.2614 => 17.1123, std.dev.: 0.0179) MultiSource/Applications/ClamAV/clamscan: 4.63% (14.5298 => 15.2024, std.dev.: 0.0110) MultiSource/Benchmarks/Bullet/bullet: 1.95% (33.2944 => 33.9451, std.dev.: 0.0293) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5185, std.dev.: 0.0493) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.06% (1.8175 => 2.2547, std.dev.: 0.0136) SingleSource/Benchmarks/Misc/richards_benchmark: 11.13% (1.1560 => 1.2847, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/ffbench: 9.03% (0.8273 => 0.9020, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (3.1736 => 3.4148, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: 6.15% (1.2998 => 1.3797, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0039, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std.dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: 3.91% (11.2619 => 11.7021, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-6: 3.49% (1.9199 => 1.9869, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 3.17% (10.7476 => 11.0879, std.dev.: 0.0416) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 2.11% (7.4271 => 7.5835, std.dev.: 0.0058) MultiSource/Applications/lemon/lemon: 1.70% (1.4298 => 1.4541, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std.dev.: 0.0055) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2073, std.dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5139, std.dev.: 0.0026) MultiSource/Benchmarks/llubenchmark/llu: 1.36% (3.7731 => 3.8243, std.dev.: 0.0177) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.25% (9.0760 => 9.1893, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/oourafft: 1.20% (5.5130 => 5.5790, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0270, std.dev.: 0.0181) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5900, std.dev.: 0.0189) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.85% (0.2670 => 0.1419, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.08% (0.4657 => 0.3908, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -14.14% (0.0707 => 0.0607, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.21% (1.3819 => 1.1994, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.09% (1.3813 => 1.2005, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.97% (0.2238 => 0.1970, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.37% (1.2308 => 1.0908, std.dev.: 0.0164) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.18% (20.3410 => 18.2702, std.dev.: 0.0201) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -5.10% (2.6470 => 2.5120, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.07% (1.3780 => 1.3081, std.dev.: 0.0193) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.61% (0.9996 => 0.9535, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1561, std.dev.: 0.0044) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.49% (1.7688 => 1.7070, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -2.48% (26.5159 => 25.8575, std.dev.: 0.0240) MultiSource/Applications/spiff/spiff: -2.42% (3.0263 => 2.9531, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.32% (1.9762 => 1.9304, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7144, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.73% (6.3560 => 6.2462, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0066, std.dev.: 0.0039) MultiSource/Applications/minisat/minisat: -1.36% (9.3358 => 9.2089, std.dev.: 0.0424) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.25% (0.8342 => 0.8238, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.24% (3.9173 => 3.8688, std.dev.: 0.0114) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2574, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 14 02:04:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 14 Oct 2012 04:04:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121014090438.C711A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4858?compare_to=4856&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4858, Order: 165893, Start Time: 2012-10-14 07:45:36, End Time: 2012-10-14 09:06:31 To: 4856, Order: 165891, Start Time: 2012-10-14 05:53:09, End Time: 2012-10-14 07:16:00 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (165 on baseline) Performance Improvements: 1 (44 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 951 (678 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 24.02% (0.4043 => 0.5014, std.dev.: 0.0289) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.88% (15.2384 => 14.9516, std.dev.: 0.0074) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.13% (0.5968 => 0.5960, std.dev.: 0.0119) MultiSource/Applications/SPASS/SPASS: 0.31% (16.4476 => 16.4992, std.dev.: 0.0228) MultiSource/Benchmarks/Bullet/bullet: 0.23% (55.4765 => 55.6056, std.dev.: 0.0711) MultiSource/Benchmarks/MallocBench/gs/gs: 0.12% (4.4589 => 4.4643, std.dev.: 0.0235) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0460 => 0.0460, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0462 => 0.0462, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.23% (0.0430 => 0.0431, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0432 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.24% (0.0419 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.24% (0.0421 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.24% (0.0413 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.24% (0.0416 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0432 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0433 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0426 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.47% (0.0426 => 0.0428) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0416 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.24% (0.0417 => 0.0418) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0423 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0425 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0435 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.82% (0.0436 => 0.0457, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0411 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0412 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0423 => 0.0423, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.24% (0.0424 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.24% (0.0414 => 0.0415) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.24% (0.0416 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0407 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.49% (0.0408 => 0.0410, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0405 => 0.0405, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0407 => 0.0407) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0443 => 0.0443) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0444 => 0.0444) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0405 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0406 => 0.0406, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0406 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0407 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.24% (0.0413 => 0.0414) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0415 => 0.0415) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.09% (1.2617 => 1.2628, std.dev.: 0.0073) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.39% (7.9315 => 7.9621, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.62% (0.7430 => 0.7476, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -1.40% (0.0358 => 0.0353, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1434 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.40% (0.0647 => 0.0669, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.08% (63.2438 => 55.6056, std.dev.: 0.0711) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.51% (14.1553 => 19.0406, std.dev.: 0.0120) SingleSource/Benchmarks/Misc-C++-EH/spirit: 65.21% (3.4629 => 5.7212, std.dev.: 0.0022) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14233.75% (0.0720 => 10.3203, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952000.00% (0.0001 => 9.9521, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 64.21% (0.2554 => 0.4194, std.dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: 44.22% (10.3673 => 14.9516, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/richards_benchmark: 40.01% (0.1622 => 0.2271, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/distray/distray: 34.00% (0.1056 => 0.1415, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 18.16% (0.1432 => 0.1692, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.00% (7.0540 => 8.3235, std.dev.: 0.0130) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.10% (2.2022 => 2.5787, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.58% (0.1566 => 0.1810, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.32% (0.0871 => 0.0987, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.30% (0.1143 => 0.1295, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 13.16% (0.3282 => 0.3714, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.09% (1.7609 => 1.9914, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 12.64% (0.1440 => 0.1622, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 12.06% (0.1584 => 0.1775, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 11.57% (0.7433 => 0.8293, std.dev.: 0.0030) MultiSource/Applications/JM/ldecod/ldecod: 11.19% (10.4361 => 11.6039, std.dev.: 0.0219) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.07% (0.4879 => 0.5419, std.dev.: 0.0061) MultiSource/Applications/minisat/minisat: 11.00% (0.7115 => 0.7898, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/trivial-interface: 10.83% (0.3473 => 0.3849, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.82% (0.3927 => 0.4352, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.81% (0.3543 => 0.3926, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.74% (0.2700 => 0.2990, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.73% (0.3543 => 0.3923, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.71% (0.6675 => 0.7390, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.71% (0.1625 => 0.1799, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/synchronized: 10.67% (0.3561 => 0.3941, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.64% (0.4615 => 0.5106, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 10.64% (0.3497 => 0.3869, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.61% (0.3516 => 0.3889, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.61% (0.3177 => 0.3514, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/property: 10.52% (0.3886 => 0.4295, std.dev.: 0.0078) SingleSource/UnitTests/ObjC/for-in: 10.50% (0.3694 => 0.4082, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.45% (0.3828 => 0.4228, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 10.43% (9.4845 => 10.4737, std.dev.: 0.0098) MultiSource/Benchmarks/Olden/tsp/tsp: 10.38% (0.1175 => 0.1297, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.22% (1.5415 => 1.6990, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: 10.21% (0.1655 => 0.1824, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 10.17% (0.3423 => 0.3771, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.15% (0.1438 => 0.1584, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 10.07% (3.3354 => 3.6714, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.95% (0.5105 => 0.5613, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.93% (0.5860 => 0.6442, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/em3d/em3d: 9.91% (0.1695 => 0.1863, std.dev.: 0.0021) MultiSource/Applications/sgefa/sgefa: 9.91% (0.3109 => 0.3417, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.90% (0.1940 => 0.2132, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.79% (0.1236 => 0.1357, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 9.74% (1.1642 => 1.2776, std.dev.: 0.0084) MultiSource/Applications/aha/aha: 9.73% (0.1151 => 0.1263, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.66% (0.8067 => 0.8846, std.dev.: 0.0096) MultiSource/Applications/spiff/spiff: 9.61% (0.7835 => 0.8588, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.54% (0.1510 => 0.1654, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.53% (4.2646 => 4.6709, std.dev.: 0.0060) MultiSource/Applications/lua/lua: 9.45% (3.8723 => 4.2381, std.dev.: 0.0140) MultiSource/Applications/oggenc/oggenc: 9.40% (5.7591 => 6.3006, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.36% (0.5569 => 0.6090, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.30% (0.2107 => 0.2303, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.30% (1.3050 => 1.4263, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/mst/mst: 9.29% (0.1163 => 0.1271, std.dev.: 0.0015) MultiSource/Applications/viterbi/viterbi: 9.26% (0.1555 => 0.1699, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.23% (0.8172 => 0.8926, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.17% (0.2758 => 0.3011, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.16% (0.2271 => 0.2479, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.12% (0.5020 => 0.5478, std.dev.: 0.0038) MultiSource/Applications/treecc/treecc: 9.09% (2.0273 => 2.2115, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.06% (4.9449 => 5.3931, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.96% (5.0018 => 5.4498, std.dev.: 0.0054) MultiSource/Applications/hbd/hbd: 8.95% (1.5603 => 1.7000, std.dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.91% (0.9765 => 1.0635, std.dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.88% (0.3121 => 0.3398, std.dev.: 0.0065) MultiSource/Applications/lemon/lemon: 8.87% (1.0722 => 1.1673, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 8.87% (2.2969 => 2.5006, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.86% (0.2065 => 0.2248, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.85% (8.1363 => 8.8567, std.dev.: 0.0158) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.82% (1.5859 => 1.7257, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.80% (0.3307 => 0.3598, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 8.78% (0.6456 => 0.7023, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 8.62% (0.3180 => 0.3454, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.56% (7.9617 => 8.6429, std.dev.: 0.0190) MultiSource/Benchmarks/sim/sim: 8.53% (0.3387 => 0.3676, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.31% (0.4103 => 0.4444, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.23% (0.1337 => 0.1447, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 8.23% (0.6030 => 0.6526, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.22% (0.5925 => 0.6412, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.17% (0.3441 => 0.3722, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.12% (0.3865 => 0.4179, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/health/health: 8.12% (0.1268 => 0.1371, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.95% (1.1861 => 1.2804, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.79% (2.2024 => 2.3739, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 7.72% (0.4289 => 0.4620, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.63% (0.6450 => 0.6942, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 7.55% (0.7326 => 0.7879, std.dev.: 0.0038) MultiSource/Applications/JM/lencod/lencod: 7.51% (21.9371 => 23.5851, std.dev.: 0.0314) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.49% (0.4203 => 0.4518, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.49% (0.2603 => 0.2798, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 7.48% (0.3422 => 0.3678, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 7.47% (0.8921 => 0.9587, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/moments: 7.44% (0.4048 => 0.4349, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.42% (0.3826 => 0.4110, std.dev.: 0.0090) MultiSource/Benchmarks/McCat/05-eks/eks: 7.35% (0.4299 => 0.4615, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.27% (0.4636 => 0.4973, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 7.23% (0.4620 => 0.4954, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.21% (0.3650 => 0.3913, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.20% (0.1695 => 0.1817, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: 7.18% (0.1463 => 0.1568, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.16% (1.4186 => 1.5202, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/sieve: 7.05% (0.3603 => 0.3857, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.99% (0.5981 => 0.6399, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.88% (0.2891 => 0.3090, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.74% (1.1840 => 1.2638, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/fibo: 6.72% (0.2725 => 0.2908, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 6.70% (0.3684 => 0.3931, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.64% (0.2905 => 0.3098, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.63% (0.3136 => 0.3344, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.58% (0.2872 => 0.3061, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.48% (0.3162 => 0.3367, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.42% (0.2756 => 0.2933, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.36% (2.0665 => 2.1979, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/wc: 6.32% (0.3052 => 0.3245, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.32% (0.2831 => 0.3010, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.19% (0.2793 => 0.2966, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 6.19% (0.2714 => 0.2882, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 6.17% (0.2871 => 0.3048, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.16% (0.3232 => 0.3431, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.09% (0.1906 => 0.2022, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.05% (0.2266 => 0.2403, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.04% (0.3098 => 0.3285, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.00% (0.2802 => 0.2970, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.97% (0.3283 => 0.3479, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.94% (0.2877 => 0.3048, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.88% (0.4064 => 0.4303, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.68% (0.8101 => 0.8561, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/ary2: 5.65% (0.3379 => 0.3570, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.60% (0.1892 => 0.1998, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.15% (14.3668 => 15.1074, std.dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.14% (0.3427 => 0.3603, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: 5.08% (0.2049 => 0.2153, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 5.05% (1.2842 => 1.3491, std.dev.: 0.0090) MultiSource/Applications/sqlite3/sqlite3: 4.79% (17.1811 => 18.0042, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/objinst: 4.76% (0.3131 => 0.3280, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.69% (0.2430 => 0.2544, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.60% (3.8922 => 4.0711, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/bh/bh: 3.65% (0.3092 => 0.3205, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.35% (1.1194 => 1.1569, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.09% (0.3817 => 0.3935, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8963, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.92% (1.1396 => 1.2526, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 9.21% (3.1595 => 3.4506, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.1578 => 3.3686, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.4162 => 0.4322, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.61% (3.6395 => 3.7709, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.75% (4.2280 => 4.3444, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.72% (0.8275 => 0.8417, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 1.35% (11.6436 => 11.8010, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.20% (6.5088 => 6.5871, std.dev.: 0.0049) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.10% (2.6546 => 2.6837, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1314, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.15% (0.8651 => 0.1717, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.21% (5.2763 => 3.2602, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.32% (5.3855 => 3.6985, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.94% (5.3526 => 3.6967, std.dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: -14.68% (54.1659 => 46.2150, std.dev.: 0.0258) MultiSource/Applications/ClamAV/clamscan: -12.04% (22.1758 => 19.5069, std.dev.: 0.0500) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.26% (2.9384 => 2.6368, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: -33.36% (1.1492 => 0.7658, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: -15.77% (1.6925 => 1.4256, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.83% (0.0998 => 0.0860, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.23% (1.2373 => 1.0984, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -10.39% (1.5373 => 1.3776, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/mason/mason: -9.72% (0.2161 => 0.1951, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.48% (19.9488 => 18.2570, std.dev.: 0.0565) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.71% (1.8329 => 1.7100, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.35% (1.6805 => 1.5906, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -4.96% (5.0483 => 4.7979, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5065, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.62% (3.2827 => 3.1640, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.53% (0.9957 => 0.9606, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5066, std.dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: -3.01% (12.4730 => 12.0980, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.21% (8.1563 => 7.9764, std.dev.: 0.0246) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.08% (0.4808 => 0.4708, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.97% (8.6802 => 8.5096, std.dev.: 0.0165) SingleSource/Benchmarks/Misc/salsa20: -1.89% (10.2830 => 10.0886, std.dev.: 0.0100) SingleSource/Regression/C/uint64_to_float: -1.88% (0.5413 => 0.5311) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6816, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.50% (2.5528 => 2.5145, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4208, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: -1.09% (4.9088 => 4.8554, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.07% (6.2999 => 6.2327, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.98% (0.5229 => 0.5960, std.dev.: 0.0119) MultiSource/Applications/SPASS/SPASS: 10.07% (14.9895 => 16.4992, std.dev.: 0.0228) MultiSource/Benchmarks/MallocBench/gs/gs: 8.61% (4.1105 => 4.4643, std.dev.: 0.0235) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.30% (1.1048 => 1.2628, std.dev.: 0.0073) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.23% (7.1582 => 7.9621, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/stepanov_container: 20.15% (0.6222 => 0.7476, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35200.00% (0.0001 => 0.0353, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.38% (0.2116 => 0.0669, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 14 02:19:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 14 Oct 2012 04:19:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121014091929.B11862A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4859?compare_to=4857&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4859, Order: 165894, Start Time: 2012-10-14 07:56:32, End Time: 2012-10-14 09:22:21 To: 4857, Order: 165891, Start Time: 2012-10-14 05:59:31, End Time: 2012-10-14 07:27:00 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (186 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1040 (678 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.02% (7.9660 => 8.0474, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.75% (3.8243 => 3.7573, std.dev.: 0.0120) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.55% (2.0176 => 2.4927, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.65% (0.1410 => 0.1673, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 17.80% (0.0826 => 0.0973, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.30% (0.0653 => 0.0766, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 16.99% (0.2243 => 0.2624, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.02% (0.1072 => 0.1233, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 14.51% (0.1013 => 0.1160, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.91% (0.0834 => 0.0950, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.72% (0.1327 => 0.1509, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.64% (0.2596 => 0.2950, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.59% (0.1413 => 0.1605, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 13.34% (0.7038 => 0.7977, std.dev.: 0.0068) MultiSource/Applications/hbd/hbd: 12.94% (1.3693 => 1.5465, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.92% (3.9660 => 4.4786, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.86% (0.0964 => 0.1088, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.69% (0.0977 => 0.1101, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.62% (0.6959 => 0.7837, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.61% (0.2721 => 0.3064, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.59% (0.1588 => 0.1788, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 12.41% (0.4328 => 0.4865, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.36% (0.5265 => 0.5916, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 12.30% (13.8202 => 15.5200, std.dev.: 0.0089) MultiSource/Applications/aha/aha: 12.24% (0.1062 => 0.1192, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.24% (0.6283 => 0.7052, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/distray/distray: 12.22% (0.0818 => 0.0918, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.19% (0.9199 => 1.0320, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.16% (1.4563 => 1.6334, std.dev.: 0.0090) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.15% (0.7710 => 0.8647, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.10% (1.2193 => 1.3668, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 12.06% (0.1003 => 0.1124, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.80% (0.3899 => 0.4359, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 11.67% (0.4062 => 0.4536, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.58% (1.1364 => 1.2680, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.50% (0.3130 => 0.3490, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.45% (0.3022 => 0.3368, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.41% (0.1157 => 0.1289, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 11.40% (1.0313 => 1.1489, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 11.18% (1.1061 => 1.2298, std.dev.: 0.0061) SingleSource/UnitTests/ObjC++/property-reference-object: 11.14% (0.5818 => 0.6466, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.08% (0.4791 => 0.5322, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.05% (0.5577 => 0.6193, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.98% (0.1075 => 0.1193, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.91% (0.2914 => 0.3232, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.86% (0.4016 => 0.4452, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.86% (0.5748 => 0.6372, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 10.83% (16.6129 => 18.4124, std.dev.: 0.0269) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.82% (0.3485 => 0.3862, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 10.72% (2.1791 => 2.4127, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.65% (0.3756 => 0.4156, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 10.63% (0.6744 => 0.7461, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 10.61% (0.2781 => 0.3076, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.58% (0.1276 => 0.1411) SingleSource/Benchmarks/Shootout-C++/lists: 10.57% (0.3293 => 0.3641, std.dev.: 0.0024) MultiSource/Applications/sgefa/sgefa: 10.55% (0.2995 => 0.3311, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.54% (0.3246 => 0.3588, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 10.52% (1.9270 => 2.1298, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.52% (0.3489 => 0.3856, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.48% (0.2127 => 0.2350, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 10.47% (0.7061 => 0.7800, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.46% (0.4379 => 0.4837, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 10.45% (3.8646 => 4.2686, std.dev.: 0.0156) MultiSource/Benchmarks/Olden/mst/mst: 10.44% (0.1111 => 0.1227, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 10.40% (0.3220 => 0.3555, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 10.38% (0.1589 => 0.1754, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.36% (0.7460 => 0.8233, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.36% (0.8698 => 0.9599, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.31% (0.3580 => 0.3949, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 10.28% (0.3453 => 0.3808, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 10.25% (0.8310 => 0.9162, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 10.21% (0.3868 => 0.4263, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.17% (0.1986 => 0.2188, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 10.16% (3.1889 => 3.5130, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.16% (0.1014 => 0.1117, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 10.15% (0.1478 => 0.1628, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.14% (0.2782 => 0.3064, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.13% (0.1865 => 0.2054, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.13% (0.1569 => 0.1728, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.11% (0.2966 => 0.3266, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 10.11% (0.7506 => 0.8265, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.08% (0.5637 => 0.6205, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 10.05% (0.2925 => 0.3219, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 10.03% (0.3149 => 0.3465, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.03% (4.9865 => 5.4866, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/strcat: 9.98% (0.2726 => 0.2998, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 9.89% (0.2760 => 0.3033, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 9.88% (0.3107 => 0.3414, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.85% (1.9828 => 2.1782, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.83% (0.1435 => 0.1576, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.80% (0.2765 => 0.3036, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.77% (0.4390 => 0.4819, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists1: 9.76% (0.3534 => 0.3879, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.74% (0.2023 => 0.2220, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.68% (0.2655 => 0.2912, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.65% (7.2180 => 7.9145, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 9.63% (0.2607 => 0.2858, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 9.61% (1.0594 => 1.1612, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wc: 9.50% (0.2937 => 0.3216, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 9.49% (0.3192 => 0.3495, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 9.48% (0.2690 => 0.2945, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 9.45% (0.2761 => 0.3022, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 9.44% (0.2628 => 0.2876, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.36% (1.3245 => 1.4485, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/em3d/em3d: 9.35% (0.1657 => 0.1812, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 9.34% (0.2988 => 0.3267, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.22% (0.6576 => 0.7182, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.16% (0.2696 => 0.2943, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.11% (3.6692 => 4.0035, std.dev.: 0.0052) MultiSource/Applications/SIBsim4/SIBsim4: 9.04% (1.2749 => 1.3901, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.00% (0.3755 => 0.4093, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 8.91% (0.3131 => 0.3410, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.84% (4.3801 => 4.7675, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.80% (4.4433 => 4.8343, std.dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: 8.77% (14.8535 => 16.1561, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.76% (1.5188 => 1.6518, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.69% (0.3511 => 0.3816, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 8.66% (0.2945 => 0.3200, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.59% (0.6135 => 0.6662, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 8.51% (8.4961 => 9.2189, std.dev.: 0.0120) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.40% (0.2321 => 0.2516, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.36% (3.2742 => 3.5480) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.33% (0.1789 => 0.1938, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.32% (0.9108 => 0.9866, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.22% (0.8818 => 0.9543, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 8.22% (0.4113 => 0.4451, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 8.21% (0.6250 => 0.6763, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.18% (0.2140 => 0.2315, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 8.18% (4.6629 => 5.0441, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.13% (1.1333 => 1.2254, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.05% (0.4805 => 0.5192, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.01% (2.1007 => 2.2689, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 7.99% (3.7467 => 4.0459, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.71% (0.2504 => 0.2697, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.64% (0.4003 => 0.4309, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.61% (0.3245 => 0.3492, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 7.59% (6.5754 => 7.0744, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/oourafft: 7.47% (0.2008 => 0.2158, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.36% (0.3914 => 0.4202, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/property: 7.28% (0.3940 => 0.4227, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 7.12% (1.2292 => 1.3167, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 7.07% (0.3578 => 0.3831, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.05% (0.3789 => 0.4056, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.99% (0.3646 => 0.3901, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.96% (0.3663 => 0.3918, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.96% (13.2842 => 14.2087, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.93% (6.2785 => 6.7133, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-2: 6.86% (0.3601 => 0.3848, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.79% (0.3650 => 0.3898, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 6.79% (0.3623 => 0.3869, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.32% (0.1819 => 0.1934, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.53% (0.2243 => 0.2367, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 5.12% (16.2614 => 17.0937, std.dev.: 0.0089) MultiSource/Applications/ClamAV/clamscan: 4.63% (14.5298 => 15.2031, std.dev.: 0.0113) MultiSource/Benchmarks/Bullet/bullet: 2.27% (33.2944 => 34.0504, std.dev.: 0.0155) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.64% (5.7573 => 7.5215, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.10% (1.0895 => 1.3630, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 25.08% (1.8175 => 2.2734, std.dev.: 0.0415) SingleSource/Benchmarks/Misc/richards_benchmark: 10.99% (1.1560 => 1.2831, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.03% (0.8273 => 0.9020, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.47% (0.1322 => 0.1434, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4142, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.11% (1.2998 => 1.3792, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0042, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (1.7081 => 1.7749, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.91% (11.2619 => 11.7019, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-6: 3.33% (1.9199 => 1.9839, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 3.19% (10.7476 => 11.0905, std.dev.: 0.0757) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.17% (7.4271 => 7.5886, std.dev.: 0.0025) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4532, std.dev.: 0.0021) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5143, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.46% (2.0200 => 2.0494, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1884, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9669, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.16% (5.5130 => 5.5770, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0273, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5850, std.dev.: 0.0056) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.85% (0.2670 => 0.1419, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.95% (0.4657 => 0.3914, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -14.14% (0.0707 => 0.0607, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.22% (1.3819 => 1.1992, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.15% (1.3813 => 1.1997, std.dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.34% (0.0997 => 0.0864, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -11.93% (0.2238 => 0.1971, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: -11.12% (1.2308 => 1.0939, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.09% (20.3410 => 18.2896, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.01% (1.3780 => 1.2952, std.dev.: 0.0100) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.60% (0.9996 => 0.9536, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8004, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.55% (3.2729 => 3.1568, std.dev.: 0.0242) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.41% (1.7688 => 1.7085, std.dev.: 0.0185) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: -2.53% (0.5449 => 0.5311) MultiSource/Applications/spiff/spiff: -2.49% (3.0263 => 2.9510, std.dev.: 0.0010) MultiSource/Applications/lua/lua: -2.47% (26.5159 => 25.8606, std.dev.: 0.0111) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.34% (1.9762 => 1.9300, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7157, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.64% (6.3560 => 6.2520, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0061, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8659, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: -1.26% (9.3358 => 9.2182, std.dev.: 0.0440) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.25% (0.8342 => 0.8238, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4944, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2566, std.dev.: 0.0019) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 14 03:54:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 14 Oct 2012 05:54:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121014105434.8061E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4860?compare_to=4858&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4860, Order: 165900, Start Time: 2012-10-14 09:36:04, End Time: 2012-10-14 10:56:26 To: 4858, Order: 165893, Start Time: 2012-10-14 07:45:36, End Time: 2012-10-14 09:06:31 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 7 (167 on baseline) Performance Improvements: 1 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 945 (677 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.04% (14.9516 => 15.2569, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.44% (8.3235 => 8.4434, std.dev.: 0.0177) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.40% (3.6967 => 3.7484, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.39% (3.6985 => 3.7498, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.27% (2.5787 => 2.6114, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.14% (0.8926 => 0.9028, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.16% (54.6657 => 56.3907, std.dev.: 0.1805) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -7.56% (0.5014 => 0.4635, std.dev.: 0.0135) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.5960 => 0.5960, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: -0.16% (16.4992 => 16.4728, std.dev.: 0.0197) MultiSource/Benchmarks/Bullet/bullet: -0.06% (55.6056 => 55.5742, std.dev.: 0.0243) MultiSource/Benchmarks/MallocBench/gs/gs: -0.18% (4.4643 => 4.4564, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.43% (0.0460 => 0.0462) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.22% (0.0462 => 0.0463, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0431 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.23% (0.0432 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.48% (0.0418 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.24% (0.0422 => 0.0423) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.48% (0.0414 => 0.0416, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.24% (0.0415 => 0.0416, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.23% (0.0432 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.23% (0.0433 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.47% (0.0426 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0428 => 0.0428, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.24% (0.0416 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.24% (0.0418 => 0.0419, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.47% (0.0423 => 0.0425, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.24% (0.0425 => 0.0426, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.23% (0.0435 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.94% (0.0457 => 0.0439, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.49% (0.0411 => 0.0413, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.49% (0.0412 => 0.0414) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.47% (0.0423 => 0.0425, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.24% (0.0425 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.24% (0.0415 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.48% (0.0415 => 0.0417, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.25% (0.0407 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.24% (0.0410 => 0.0409) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.25% (0.0405 => 0.0406, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.25% (0.0407 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0443 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.23% (0.0444 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.25% (0.0405 => 0.0406) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.25% (0.0406 => 0.0407) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.25% (0.0406 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0407 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.24% (0.0414 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.24% (0.0415 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.03% (1.2628 => 1.2624, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.17% (7.9621 => 7.9484, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.03% (0.7476 => 0.7478, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 1.13% (0.0353 => 0.0357, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1433 => 0.1432, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.54% (0.0669 => 0.0686, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.13% (63.2438 => 55.5742, std.dev.: 0.0243) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.52% (14.1553 => 19.0422, std.dev.: 0.0237) SingleSource/Benchmarks/Misc-C++-EH/spirit: 65.52% (3.4629 => 5.7318, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14221.11% (0.0720 => 10.3112, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952400.00% (0.0001 => 9.9525, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.70% (0.2554 => 0.4181, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 47.16% (10.3673 => 15.2569, std.dev.: 0.0139) SingleSource/Benchmarks/Misc/richards_benchmark: 39.15% (0.1622 => 0.2257, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/distray/distray: 33.81% (0.1056 => 0.1413, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.70% (7.0540 => 8.4434, std.dev.: 0.0177) MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.58% (2.2022 => 2.6114, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 18.58% (0.1432 => 0.1698, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.33% (0.1566 => 0.1806, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.52% (0.0730 => 0.0836, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 13.41% (0.3282 => 0.3722, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.19% (1.7609 => 1.9931, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.16% (0.0798 => 0.0903, std.dev.: 0.0012) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.04% (0.1143 => 0.1292, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.97% (0.0871 => 0.0984, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 12.78% (0.1440 => 0.1624, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.87% (0.1584 => 0.1772, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 11.72% (0.3473 => 0.3880, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.51% (0.3927 => 0.4379, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.49% (0.3543 => 0.3950, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.46% (0.3543 => 0.3949, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.46% (0.3561 => 0.3969, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 11.40% (10.4361 => 11.6256, std.dev.: 0.0121) SingleSource/UnitTests/ObjC/exceptions-2: 11.38% (0.3497 => 0.3895, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.32% (0.3516 => 0.3914, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 11.23% (0.7433 => 0.8268, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 11.21% (0.3828 => 0.4257, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.19% (0.3886 => 0.4321, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.18% (0.3694 => 0.4107, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 10.67% (0.7115 => 0.7874, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.65% (0.1625 => 0.1798, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.58% (0.4879 => 0.5395, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.56% (0.2700 => 0.2985, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.47% (0.8172 => 0.9028, std.dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.32% (0.3121 => 0.3443, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: 10.30% (0.1175 => 0.1296, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.29% (0.1438 => 0.1586, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 10.23% (9.4845 => 10.4546, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.22% (0.6675 => 0.7357, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 10.15% (0.1655 => 0.1823, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.14% (0.3177 => 0.3499, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.11% (1.5415 => 1.6973, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 10.03% (0.1695 => 0.1865, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.98% (0.8067 => 0.8872, std.dev.: 0.0047) MultiSource/Applications/d/make_dparser: 9.90% (3.3354 => 3.6656, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.89% (0.5105 => 0.5610, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.83% (0.5860 => 0.6436, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 9.82% (0.3423 => 0.3759, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.79% (0.2758 => 0.3028, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.64% (0.4615 => 0.5060, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 9.61% (1.1642 => 1.2761, std.dev.: 0.0057) MultiSource/Applications/sgefa/sgefa: 9.55% (0.3109 => 0.3406, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 9.47% (0.1151 => 0.1260, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.47% (0.1236 => 0.1353, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.28% (4.2646 => 4.6605, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.23% (0.1940 => 0.2119, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.21% (0.1510 => 0.1649, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.17% (1.3050 => 1.4247, std.dev.: 0.0022) MultiSource/Applications/lua/lua: 9.17% (3.8723 => 4.2273, std.dev.: 0.0031) MultiSource/Applications/spiff/spiff: 9.16% (0.7835 => 0.8553, std.dev.: 0.0036) MultiSource/Applications/oggenc/oggenc: 9.14% (5.7591 => 6.2856, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.14% (0.5569 => 0.6078, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.10% (5.0018 => 5.4571, std.dev.: 0.0032) SingleSource/UnitTests/ObjC++/Hello: 9.10% (0.5925 => 0.6464, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 9.07% (0.1555 => 0.1696, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.07% (0.2107 => 0.2298, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.03% (4.9449 => 5.3913, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.03% (0.2271 => 0.2476, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference-object: 8.99% (0.6030 => 0.6572, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.96% (0.2065 => 0.2250, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.95% (0.3307 => 0.3603, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.94% (0.1163 => 0.1267, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 8.92% (0.6456 => 0.7032, std.dev.: 0.0014) MultiSource/Applications/treecc/treecc: 8.85% (2.0273 => 2.2068, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.76% (0.5020 => 0.5460, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.73% (0.9765 => 1.0617, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 8.67% (1.5603 => 1.6956, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.66% (8.1363 => 8.8410, std.dev.: 0.0130) MultiSource/Applications/lemon/lemon: 8.62% (1.0722 => 1.1646, std.dev.: 0.0107) MultiSource/Applications/siod/siod: 8.53% (2.2969 => 2.4928, std.dev.: 0.0029) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.48% (7.9617 => 8.6367, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.39% (1.5859 => 1.7189, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.34% (0.4103 => 0.4445, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 8.33% (0.3387 => 0.3669, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 8.30% (0.3180 => 0.3444, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.28% (0.3865 => 0.4185, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.26% (0.7326 => 0.7931, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.15% (0.1337 => 0.1446, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.02% (0.3826 => 0.4133) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.99% (0.4203 => 0.4539, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.99% (0.3441 => 0.3716, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/health/health: 7.97% (0.1268 => 0.1369, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.81% (0.4289 => 0.4624, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.75% (0.3136 => 0.3379, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.73% (1.1861 => 1.2778, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 7.53% (0.4048 => 0.4353, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 7.48% (21.9371 => 23.5774, std.dev.: 0.0244) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.47% (0.2891 => 0.3107, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.42% (0.4636 => 0.4980, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: 7.40% (0.4620 => 0.4962, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.40% (2.2024 => 2.3653, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/05-eks/eks: 7.35% (0.4299 => 0.4615, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.30% (0.6450 => 0.6921, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 7.30% (0.3603 => 0.3866, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.29% (0.3650 => 0.3916, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.22% (0.2603 => 0.2791, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 7.16% (0.8921 => 0.9560, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.14% (0.1695 => 0.1816, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 7.02% (0.2905 => 0.3109, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.00% (0.2756 => 0.2949, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: 6.90% (0.1463 => 0.1564, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 6.89% (0.3684 => 0.3938, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.86% (0.2725 => 0.2912, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.80% (0.5981 => 0.6388, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.80% (1.4186 => 1.5151, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.80% (0.3162 => 0.3377, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.75% (0.3052 => 0.3258, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.74% (2.0665 => 2.2057, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: 6.67% (0.2714 => 0.2895, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 6.64% (0.2831 => 0.3019, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.64% (0.2802 => 0.2988, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.62% (0.2793 => 0.2978, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 6.47% (0.3232 => 0.3441, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.44% (0.2871 => 0.3056, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.43% (0.2877 => 0.3062, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 6.43% (0.3283 => 0.3494, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.42% (0.3098 => 0.3297, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.37% (0.2872 => 0.3055, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 6.30% (1.1840 => 1.2586, std.dev.: 0.0114) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.13% (0.4064 => 0.4313, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.09% (0.1906 => 0.2022, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary2: 6.07% (0.3379 => 0.3584, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.03% (0.1892 => 0.2006, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.96% (0.2266 => 0.2401, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.62% (0.8101 => 0.8556, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: 5.24% (0.3131 => 0.3295, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 5.02% (1.2842 => 1.3487, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: 4.98% (0.2049 => 0.2151, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.96% (14.3668 => 15.0796, std.dev.: 0.0201) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.93% (0.3427 => 0.3596, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: 4.58% (17.1811 => 17.9677, std.dev.: 0.0161) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.28% (0.2430 => 0.2534, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.23% (3.8922 => 4.0568, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.77% (0.3817 => 0.3961, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.67% (1.1194 => 1.1605, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/bh/bh: 3.30% (0.3092 => 0.3194, std.dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 10.06% (1.1396 => 1.2542, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 9.21% (3.1595 => 3.4505, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (3.1578 => 3.3671, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.51% (3.6395 => 3.7672, std.dev.: 0.0046) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.81% (4.2280 => 4.3470, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.35% (1.7254 => 1.7659, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.70% (0.8275 => 0.8416, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.35% (11.6436 => 11.8012, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.15% (2.6546 => 2.6850, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.12% (6.5088 => 6.5814, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.01% (9.1159 => 9.2079, std.dev.: 0.0140) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.00% (6.6874 => 0.1335, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.15% (0.8651 => 0.1717, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.14% (5.2763 => 3.2637, std.dev.: 0.0141) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.37% (5.3855 => 3.7498, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -29.97% (5.3526 => 3.7484, std.dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -14.66% (54.1659 => 46.2234, std.dev.: 0.0328) MultiSource/Applications/ClamAV/clamscan: -12.03% (22.1758 => 19.5080, std.dev.: 0.0128) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.08% (2.9384 => 2.6423, std.dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.50% (1.1492 => 0.7642, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4230, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.43% (0.0998 => 0.0864, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -11.32% (1.2373 => 1.0972, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: -10.61% (1.5373 => 1.3742, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/mason/mason: -9.90% (0.2161 => 0.1947, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.25% (19.9488 => 18.3040, std.dev.: 0.0308) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.62% (1.8329 => 1.7115, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.32% (1.6805 => 1.5911, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.95% (1.5835 => 1.5051, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.73% (1.3677 => 1.3167, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.63% (3.2827 => 3.1634, std.dev.: 0.0049) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5064, std.dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: -3.01% (12.4730 => 12.0978, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.93% (0.9957 => 0.9665, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.20% (0.4808 => 0.4702, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.01% (8.1563 => 7.9921, std.dev.: 0.0140) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.98% (8.6802 => 8.5087, std.dev.: 0.0118) SingleSource/Regression/C/uint64_to_float: -1.88% (0.5413 => 0.5311) SingleSource/Benchmarks/Misc/salsa20: -1.88% (10.2830 => 10.0901, std.dev.: 0.0109) SingleSource/UnitTests/Vector/multiplies: -1.74% (2.5528 => 2.5083, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6806, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.12% (6.2999 => 6.2291, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.98% (0.5229 => 0.5960, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 9.90% (14.9895 => 16.4728, std.dev.: 0.0197) MultiSource/Benchmarks/MallocBench/gs/gs: 8.42% (4.1105 => 4.4564, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.27% (1.1048 => 1.2624, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.04% (7.1582 => 7.9484, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/stepanov_container: 20.19% (0.6222 => 0.7478, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35600.00% (0.0001 => 0.0357, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.58% (0.2116 => 0.0686, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 14 04:14:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 14 Oct 2012 06:14:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121014111437.738E82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4861?compare_to=4859&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4861, Order: 165900, Start Time: 2012-10-14 09:51:30, End Time: 2012-10-14 11:17:29 To: 4859, Order: 165894, Start Time: 2012-10-14 07:56:32, End Time: 2012-10-14 09:22:21 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (187 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1041 (677 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.76% (77.6914 => 79.8328, std.dev.: 0.7150) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.53% (2.0176 => 2.4923, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.79% (0.1410 => 0.1675, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 17.55% (0.0826 => 0.0971) MultiSource/Benchmarks/McCat/08-main/main: 16.72% (0.2243 => 0.2618, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.69% (0.0653 => 0.0762, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.69% (0.1327 => 0.1522, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/tsp/tsp: 14.41% (0.1013 => 0.1159, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.37% (0.1072 => 0.1226, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.91% (0.0834 => 0.0950, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.90% (0.0770 => 0.0877, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.59% (0.1413 => 0.1605, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 13.50% (0.7038 => 0.7988, std.dev.: 0.0021) MultiSource/Applications/hbd/hbd: 13.21% (1.3693 => 1.5502, std.dev.: 0.0063) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.96% (3.9660 => 4.4800, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.79% (0.2721 => 0.3069, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.78% (0.1588 => 0.1791, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.48% (0.2596 => 0.2920, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.38% (0.6283 => 0.7061, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.35% (1.4563 => 1.6362, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 12.24% (13.8202 => 15.5122, std.dev.: 0.0138) MultiSource/Benchmarks/FreeBench/distray/distray: 12.22% (0.0818 => 0.0918) SingleSource/Benchmarks/Shootout-C++/hash2: 12.22% (0.4328 => 0.4857, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.21% (0.9199 => 1.0322, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.19% (0.5265 => 0.5907, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.15% (1.2193 => 1.3674, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.14% (0.6959 => 0.7804, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.02% (0.7710 => 0.8637, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/power/power: 11.96% (0.1003 => 0.1123, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 11.96% (0.1062 => 0.1189, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.77% (0.3899 => 0.4358, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.60% (1.1364 => 1.2682, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 11.52% (0.4062 => 0.4530, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 11.52% (0.5818 => 0.6488, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 11.47% (1.0313 => 1.1496, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.31% (0.4791 => 0.5333, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.25% (0.3130 => 0.3482, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.24% (0.1157 => 0.1287, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 11.19% (0.5748 => 0.6391, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 11.18% (1.1061 => 1.2298, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.14% (0.5577 => 0.6198, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.09% (0.3022 => 0.3357, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.82% (0.3485 => 0.3862, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.81% (0.4016 => 0.4450, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 10.79% (0.6744 => 0.7472, std.dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: 10.75% (0.2995 => 0.3317, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 10.72% (16.6129 => 18.3941, std.dev.: 0.0158) SingleSource/Benchmarks/McGill/chomp: 10.70% (0.1589 => 0.1759, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 10.66% (0.7061 => 0.7814, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.63% (0.3246 => 0.3591, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.61% (0.3580 => 0.3960, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.60% (0.1075 => 0.1189, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.60% (0.3756 => 0.4154, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.60% (0.4379 => 0.4843, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 10.47% (2.1791 => 2.4072, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.47% (0.2914 => 0.3219, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 10.44% (0.1111 => 0.1227, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.44% (0.0977 => 0.1079, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.43% (0.3489 => 0.3853, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 10.40% (1.9270 => 2.1274, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 10.39% (0.2781 => 0.3070, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 10.39% (0.3293 => 0.3635, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 10.38% (3.8646 => 4.2658, std.dev.: 0.0029) MultiSource/Applications/viterbi/viterbi: 10.35% (0.1478 => 0.1631, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.34% (0.1276 => 0.1408, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 10.31% (0.3220 => 0.3552, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.30% (0.2127 => 0.2346, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 10.29% (3.1889 => 3.5170, std.dev.: 0.0140) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.26% (0.8698 => 0.9590, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 10.25% (0.8310 => 0.9162, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.22% (0.2966 => 0.3269, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.21% (0.7460 => 0.8222, std.dev.: 0.0034) MultiSource/Applications/spiff/spiff: 10.19% (0.7506 => 0.8271, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 10.17% (0.3453 => 0.3804, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.16% (4.9865 => 5.4931, std.dev.: 0.0107) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.16% (0.1014 => 0.1117, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.13% (0.1865 => 0.2054, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.08% (0.5637 => 0.6205, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.07% (0.1986 => 0.2186, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.07% (0.1569 => 0.1727, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 10.03% (0.3868 => 0.4256, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.03% (0.2782 => 0.3061, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 9.97% (1.0594 => 1.1650, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.90% (0.1435 => 0.1577, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.89% (0.4390 => 0.4824, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 9.87% (0.2726 => 0.2995, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/09-vor/vor: 9.85% (0.2925 => 0.3213, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.84% (0.2023 => 0.2222, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 9.81% (0.3149 => 0.3458, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 9.78% (0.3107 => 0.3411, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/hello: 9.78% (0.2607 => 0.2862, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 9.78% (0.2690 => 0.2953, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 9.75% (0.2760 => 0.3029, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.71% (1.9828 => 2.1753, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.69% (7.2180 => 7.9176, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary2: 9.68% (0.3192 => 0.3501, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 9.65% (0.3534 => 0.3875, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.64% (0.2655 => 0.2911, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.55% (0.2765 => 0.3029, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 9.50% (0.2937 => 0.3216, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.44% (0.6576 => 0.7197, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 9.42% (0.2761 => 0.3021, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/em3d/em3d: 9.41% (0.1657 => 0.1813, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.38% (0.2696 => 0.2949, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/fibo: 9.32% (0.2628 => 0.2873, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.29% (1.3245 => 1.4475, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/matrix: 9.17% (0.2988 => 0.3262, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.13% (3.6692 => 4.0043, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 9.05% (1.2749 => 1.3903, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.04% (4.3801 => 4.7761, std.dev.: 0.0044) MultiSource/Benchmarks/sim/sim: 9.04% (0.3131 => 0.3414, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.98% (4.4433 => 4.8421, std.dev.: 0.0069) MultiSource/Applications/JM/lencod/lencod: 8.94% (14.8535 => 16.1809, std.dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.89% (0.3755 => 0.4089, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.75% (0.8818 => 0.9590, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.74% (0.6135 => 0.6671, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 8.72% (8.4961 => 9.2372, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.62% (1.5188 => 1.6497, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.61% (0.1789 => 0.1943, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.52% (3.2742 => 3.5533, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 8.52% (0.2945 => 0.3196, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.50% (0.9108 => 0.9882, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.36% (0.2321 => 0.2515, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.35% (0.3511 => 0.3804, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 8.29% (4.6629 => 5.0493, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/05-eks/eks: 8.27% (0.4113 => 0.4453, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.24% (0.4805 => 0.5201, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.22% (0.2140 => 0.2316, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 8.22% (0.6250 => 0.6764, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.20% (1.1333 => 1.2262, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 8.06% (3.7467 => 4.0486, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/neural/neural: 7.87% (0.1385 => 0.1494, std.dev.: 0.0038) MultiSource/Applications/JM/ldecod/ldecod: 7.86% (6.5754 => 7.0925, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.85% (2.1007 => 2.2655, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/oourafft: 7.72% (0.2008 => 0.2163, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.69% (0.4003 => 0.4311, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.67% (0.2504 => 0.2696, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.58% (0.3245 => 0.3491, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 7.41% (0.3914 => 0.4204, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.36% (0.3940 => 0.4230, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 7.31% (0.3789 => 0.4066, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 7.19% (0.3646 => 0.3908, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.18% (0.3578 => 0.3835, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.04% (0.3663 => 0.3921, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.04% (13.2842 => 14.2192, std.dev.: 0.0086) MultiSource/Applications/hexxagon/hexxagon: 7.03% (1.2292 => 1.3156, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 7.03% (0.3601 => 0.3854, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.02% (6.2785 => 6.7191, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-3: 6.93% (0.3623 => 0.3874, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.90% (0.3650 => 0.3902, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.54% (0.1819 => 0.1938, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.66% (0.2243 => 0.2370, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 5.25% (16.2614 => 17.1149, std.dev.: 0.0285) MultiSource/Applications/ClamAV/clamscan: 4.68% (14.5298 => 15.2101, std.dev.: 0.0184) MultiSource/Benchmarks/Bullet/bullet: 2.35% (33.2944 => 34.0768, std.dev.: 0.0140) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5156, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 23.89% (1.8175 => 2.2517, std.dev.: 0.0277) SingleSource/Benchmarks/Misc/richards_benchmark: 11.04% (1.1560 => 1.2836, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 8.98% (0.8273 => 0.9016, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4137, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.34% (1.2998 => 1.3822, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0050, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.92% (11.2619 => 11.7039, std.dev.: 0.0079) MultiSource/Applications/SPASS/SPASS: 3.47% (10.7476 => 11.1202, std.dev.: 0.0223) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9856, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.05% (7.4271 => 7.5794, std.dev.: 0.0111) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4540, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0496, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5136, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1874, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5788, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 1.14% (12.4560 => 12.5975, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0269, std.dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.85% (0.2670 => 0.1419, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.87% (0.4657 => 0.3918, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/mason/mason: -14.14% (0.0707 => 0.0607, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.00% (1.3819 => 1.2023, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.98% (1.3813 => 1.2020, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -12.06% (0.2238 => 0.1968, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.53% (1.2308 => 1.0889, std.dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.26% (20.3410 => 18.2542, std.dev.: 0.0272) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.52% (1.3780 => 1.3019, std.dev.: 0.0218) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0050) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.69% (0.9996 => 0.9527, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.55% (3.2729 => 3.1566, std.dev.: 0.0231) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.47% (1.7688 => 1.7075, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.21% (0.4867 => 0.4711, std.dev.: 0.0007) SingleSource/Regression/C/uint64_to_float: -2.53% (0.5449 => 0.5311, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4785, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.51% (3.0263 => 2.9503, std.dev.: 0.0013) MultiSource/Applications/lua/lua: -2.45% (26.5159 => 25.8654, std.dev.: 0.0140) MultiSource/Benchmarks/Olden/bh/bh: -2.36% (1.9762 => 1.9296, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.00% (0.6589 => 0.6457, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7151, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/lists: -1.71% (6.3560 => 6.2475, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0078, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8628, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.25% (0.8342 => 0.8238, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4943, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: -1.19% (9.3358 => 9.2248, std.dev.: 0.0114) MultiSource/Applications/lambda-0_1_3/lambda: -1.14% (5.3167 => 5.2561, std.dev.: 0.0005) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 14 05:44:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 14 Oct 2012 07:44:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121014124428.687832A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4862?compare_to=4860&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4862, Order: 165903, Start Time: 2012-10-14 11:25:54, End Time: 2012-10-14 12:46:20 To: 4860, Order: 165900, Start Time: 2012-10-14 09:36:04, End Time: 2012-10-14 10:56:26 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (165 on baseline) Performance Improvements: 3 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 950 (679 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.77% (15.2569 => 14.9867, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.46% (0.9028 => 0.8896, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.10% (8.4434 => 8.3506, std.dev.: 0.0045) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.5960 => 0.5960, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 0.06% (16.4728 => 16.4831, std.dev.: 0.0280) MultiSource/Benchmarks/Bullet/bullet: 0.00% (55.5742 => 55.5754, std.dev.: 0.0399) MultiSource/Benchmarks/MallocBench/gs/gs: 0.22% (4.4564 => 4.4662, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.43% (0.0462 => 0.0460, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.22% (0.0463 => 0.0462, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.46% (0.0431 => 0.0429, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.69% (0.0433 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.48% (0.0420 => 0.0418, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.71% (0.0423 => 0.0420, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.72% (0.0416 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.48% (0.0416 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.46% (0.0433 => 0.0431, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.23% (0.0434 => 0.0433) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.47% (0.0428 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.23% (0.0428 => 0.0427, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.48% (0.0417 => 0.0415, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.72% (0.0419 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.47% (0.0425 => 0.0423, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.70% (0.0426 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.46% (0.0436 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.68% (0.0439 => 0.0436, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.73% (0.0413 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.72% (0.0414 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.47% (0.0425 => 0.0423, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.47% (0.0426 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.48% (0.0416 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.48% (0.0417 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.49% (0.0408 => 0.0406) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.49% (0.0409 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.25% (0.0406 => 0.0405) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.49% (0.0408 => 0.0406, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.23% (0.0443 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.67% (0.0445 => 0.0442, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.49% (0.0406 => 0.0404, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.49% (0.0407 => 0.0405, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.74% (0.0407 => 0.0404, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.25% (0.0407 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.48% (0.0415 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.48% (0.0416 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.01% (1.2624 => 1.2623, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.06% (7.9484 => 7.9534, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.03% (0.7478 => 0.7476, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.56% (0.0357 => 0.0359, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.08% (0.0686 => 0.0658, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.13% (63.2438 => 55.5754, std.dev.: 0.0399) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.44% (14.1553 => 19.0298, std.dev.: 0.0221) SingleSource/Benchmarks/Misc-C++-EH/spirit: 65.19% (3.4629 => 5.7203, std.dev.: 0.0023) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14224.44% (0.0720 => 10.3136, std.dev.: 0.0134) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952100.00% (0.0001 => 9.9522, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.74% (0.2554 => 0.4182, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: 44.56% (10.3673 => 14.9867, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/richards_benchmark: 40.57% (0.1622 => 0.2280, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: 33.52% (0.1056 => 0.1410, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 18.72% (0.1432 => 0.1700, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.38% (7.0540 => 8.3506, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.10% (2.2022 => 2.6008, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.52% (0.1566 => 0.1809, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 13.68% (0.3282 => 0.3731, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.53% (1.7609 => 1.9991, std.dev.: 0.0045) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.30% (0.1143 => 0.1295, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.20% (0.0871 => 0.0986, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 12.78% (0.1440 => 0.1624, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 12.06% (0.1584 => 0.1775, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 11.93% (10.4361 => 11.6813, std.dev.: 0.0165) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.54% (0.3543 => 0.3952, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 11.27% (0.7433 => 0.8271, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/trivial-interface: 11.11% (0.3473 => 0.3859, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/parameter-passing: 11.05% (0.3927 => 0.4361, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 11.01% (0.3497 => 0.3882, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.01% (0.3543 => 0.3933, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 10.92% (0.3561 => 0.3950, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 10.92% (0.3516 => 0.3900, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 10.89% (0.7115 => 0.7890, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.81% (0.2700 => 0.2992, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 10.78% (0.3886 => 0.4305, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/for-in: 10.77% (0.3694 => 0.4092, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.76% (0.3828 => 0.4240, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.68% (0.4879 => 0.5400, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.58% (0.1625 => 0.1797, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.57% (0.1438 => 0.1590, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 10.47% (0.1175 => 0.1298, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.40% (0.6675 => 0.7369, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 10.32% (9.4845 => 10.4636, std.dev.: 0.0085) SingleSource/Benchmarks/McGill/chomp: 10.27% (0.1655 => 0.1825, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.20% (0.3177 => 0.3501, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.94% (1.5415 => 1.6948, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.90% (0.5860 => 0.6440, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/em3d/em3d: 9.85% (0.1695 => 0.1862, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 9.82% (3.3354 => 3.6628, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.71% (0.4615 => 0.5063, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 9.67% (0.3423 => 0.3754, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.64% (0.2758 => 0.3024, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.63% (0.8067 => 0.8844, std.dev.: 0.0091) MultiSource/Applications/sgefa/sgefa: 9.62% (0.3109 => 0.3408, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 9.56% (0.1151 => 0.1261, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.55% (0.1236 => 0.1354, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.50% (0.5569 => 0.6098, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 9.47% (1.1642 => 1.2744, std.dev.: 0.0069) MultiSource/Applications/oggenc/oggenc: 9.44% (5.7591 => 6.3027, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.42% (0.5105 => 0.5586, std.dev.: 0.0015) MultiSource/Applications/lua/lua: 9.37% (3.8723 => 4.2351, std.dev.: 0.0115) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.31% (5.0018 => 5.4673, std.dev.: 0.0055) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.30% (4.2646 => 4.6610, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.28% (0.1940 => 0.2120, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.27% (0.1510 => 0.1650, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.21% (1.3050 => 1.4252, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.11% (0.2271 => 0.2478, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 9.00% (0.1555 => 0.1695, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/mst/mst: 8.94% (0.1163 => 0.1267, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 8.94% (0.6456 => 0.7033, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.89% (4.9449 => 5.3845, std.dev.: 0.0066) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.88% (0.3121 => 0.3398, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.88% (0.2107 => 0.2294, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.86% (0.8172 => 0.8896, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.82% (0.5020 => 0.5463, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.81% (7.9617 => 8.6634, std.dev.: 0.0108) MultiSource/Applications/spiff/spiff: 8.81% (0.7835 => 0.8525, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.79% (8.1363 => 8.8514, std.dev.: 0.0067) MultiSource/Applications/treecc/treecc: 8.75% (2.0273 => 2.2046, std.dev.: 0.0034) MultiSource/Applications/hbd/hbd: 8.74% (1.5603 => 1.6966, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.73% (0.9765 => 1.0617, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.71% (0.3307 => 0.3595, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.62% (0.2065 => 0.2243, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 8.61% (1.0722 => 1.1645, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 8.56% (2.2969 => 2.4934, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.52% (1.5859 => 1.7210, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 8.50% (0.3387 => 0.3675, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.34% (0.5925 => 0.6419, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 8.24% (0.6030 => 0.6527, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 8.21% (0.3180 => 0.3441, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.09% (0.4103 => 0.4435, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.05% (0.3441 => 0.3718, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/health/health: 7.97% (0.1268 => 0.1369, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.95% (0.6450 => 0.6963, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.93% (0.1337 => 0.1443, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.87% (1.1861 => 1.2794, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 7.83% (0.3422 => 0.3690, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.81% (0.3865 => 0.4167, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.76% (0.4203 => 0.4529, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.62% (2.2024 => 2.3702, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/hash: 7.60% (0.4289 => 0.4615, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference: 7.55% (0.7326 => 0.7879, std.dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 7.43% (21.9371 => 23.5664, std.dev.: 0.0263) SingleSource/Benchmarks/Shootout-C++/hash2: 7.38% (0.4620 => 0.4961, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.34% (0.3650 => 0.3918, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 7.34% (0.4048 => 0.4345, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.30% (0.2603 => 0.2793, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.27% (0.4636 => 0.4973, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.27% (0.3826 => 0.4104, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 7.20% (0.8921 => 0.9563, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/sieve: 7.19% (0.3603 => 0.3862, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 7.08% (0.2725 => 0.2918, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 7.07% (0.4299 => 0.4603, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.96% (1.4186 => 1.5173, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.96% (0.5981 => 0.6397, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/neural/neural: 6.90% (0.1463 => 0.1564, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.86% (0.2756 => 0.2945, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.84% (0.1695 => 0.1811, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 6.81% (0.3684 => 0.3935, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.70% (0.3136 => 0.3346, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.64% (0.2905 => 0.3098, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.61% (0.2891 => 0.3082, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.58% (0.3162 => 0.3370, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 6.57% (0.2831 => 0.3017, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.46% (2.0665 => 2.2000, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary: 6.37% (0.3232 => 0.3438, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.34% (0.3283 => 0.3491, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 6.33% (0.3379 => 0.3593, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.28% (1.1840 => 1.2584, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/matrix: 6.26% (0.3098 => 0.3292, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/except: 6.20% (0.2871 => 0.3049, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.19% (0.2877 => 0.3055, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.16% (0.2872 => 0.3049, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 6.09% (0.3052 => 0.3238, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.00% (0.2266 => 0.2402, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.91% (0.2793 => 0.2958, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 5.89% (0.2802 => 0.2967, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.82% (0.2714 => 0.2872, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.79% (0.8101 => 0.8570, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.73% (0.4064 => 0.4297, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.72% (0.1906 => 0.2015, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.34% (0.1892 => 0.1993, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.03% (14.3668 => 15.0889, std.dev.: 0.0150) SingleSource/Benchmarks/Misc/ReedSolomon: 4.93% (0.2049 => 0.2150, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.92% (0.3131 => 0.3285) MultiSource/Applications/hexxagon/hexxagon: 4.87% (1.2842 => 1.3468, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.76% (0.3427 => 0.3590, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 4.60% (17.1811 => 17.9711, std.dev.: 0.0121) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.28% (0.2430 => 0.2534, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.25% (3.8922 => 4.0575, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.96% (1.1194 => 1.1637, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.43% (0.3817 => 0.3948) MultiSource/Benchmarks/Olden/bh/bh: 3.30% (0.3092 => 0.3194, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.35% (0.2944 => 0.3278, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.79% (1.1396 => 1.2512, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0012) MultiSource/Applications/aha/aha: 9.18% (3.1595 => 3.4497, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.1578 => 3.3688, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.4162 => 0.4322, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.60% (3.6395 => 3.7706, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.71% (4.2280 => 4.3427, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.72% (0.8275 => 0.8417, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.36% (11.6436 => 11.8014, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.16% (2.6546 => 2.6855, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5765, std.dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1313, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -79.85% (0.8651 => 0.1743, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.02% (5.2763 => 3.2702, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.90% (5.3855 => 3.7213, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.42% (5.3526 => 3.7241, std.dev.: 0.0074) SingleSource/UnitTests/Vector/constpool: -14.64% (54.1659 => 46.2344, std.dev.: 0.0113) MultiSource/Applications/ClamAV/clamscan: -12.05% (22.1758 => 19.5045, std.dev.: 0.0224) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -9.96% (2.9384 => 2.6457, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel: -33.37% (1.1492 => 0.7657, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -15.86% (1.6925 => 1.4241, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.53% (0.0998 => 0.0863, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -11.40% (1.2373 => 1.0963, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -10.29% (1.5373 => 1.3791, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -10.04% (0.2161 => 0.1944, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.28% (19.9488 => 18.2963, std.dev.: 0.0829) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.70% (1.8329 => 1.7101, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5753, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.31% (1.6805 => 1.5912, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5091, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.18% (0.9957 => 0.9541, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.70% (3.2827 => 3.1613, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5033, std.dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: -2.99% (12.4730 => 12.1001, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.23% (0.4808 => 0.4701, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.09% (8.1563 => 7.9859, std.dev.: 0.0126) SingleSource/Regression/C/uint64_to_float: -1.88% (0.5413 => 0.5311, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -1.88% (10.2830 => 10.0895, std.dev.: 0.0119) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6797, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.70% (8.6802 => 8.5323, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.58% (2.5528 => 2.5125, std.dev.: 0.0039) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/hash: -1.10% (4.9088 => 4.8548, std.dev.: 0.0192) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.98% (0.5229 => 0.5960, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 9.96% (14.9895 => 16.4831, std.dev.: 0.0280) MultiSource/Benchmarks/MallocBench/gs/gs: 8.65% (4.1105 => 4.4662, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.26% (1.1048 => 1.2623, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.11% (7.1582 => 7.9534, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 20.15% (0.6222 => 0.7476, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35800.00% (0.0001 => 0.0359, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.90% (0.2116 => 0.0658, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 14 06:09:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 14 Oct 2012 08:09:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121014130929.DA42A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4863?compare_to=4861&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4863, Order: 165903, Start Time: 2012-10-14 11:46:44, End Time: 2012-10-14 13:12:23 To: 4861, Order: 165900, Start Time: 2012-10-14 09:51:30, End Time: 2012-10-14 11:17:29 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (186 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1042 (678 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.36% (2.0176 => 2.4889, std.dev.: 0.0057) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.44% (0.1410 => 0.1670, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 16.95% (0.0826 => 0.0966, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 16.58% (0.2243 => 0.2615, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.23% (0.0653 => 0.0759, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.24% (0.1327 => 0.1516, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 14.12% (0.1013 => 0.1156, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.79% (0.0834 => 0.0949, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.71% (0.1072 => 0.1219, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.31% (0.1413 => 0.1601, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 13.26% (0.7038 => 0.7971, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 13.15% (1.3693 => 1.5494, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.74% (3.9660 => 4.4711, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/hash2: 12.66% (0.4328 => 0.4876, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.66% (0.0964 => 0.1086, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 12.44% (0.5818 => 0.6542, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.28% (0.1588 => 0.1783, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.25% (0.2596 => 0.2914, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 12.20% (13.8202 => 15.5069, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.16% (0.2721 => 0.3052, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.16% (1.4563 => 1.6334, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.13% (0.6283 => 0.7045, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 12.06% (0.5748 => 0.6441, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.99% (0.9199 => 1.0302, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.98% (0.5265 => 0.5896, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.96% (0.6959 => 0.7791) SingleSource/Benchmarks/Shootout-C++/hash: 11.92% (0.4062 => 0.4546, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.87% (1.2193 => 1.3640, std.dev.: 0.0119) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.83% (0.7710 => 0.8622, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/power/power: 11.76% (0.1003 => 0.1121, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 11.67% (0.7061 => 0.7885, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 11.58% (0.1062 => 0.1185, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.47% (1.1364 => 1.2668, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.45% (0.3022 => 0.3368, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.44% (0.3899 => 0.4345, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.33% (0.3485 => 0.3880, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 11.24% (1.0313 => 1.1472, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.13% (0.4016 => 0.4463, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.06% (0.1157 => 0.1285, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.06% (0.3580 => 0.3976, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.02% (0.3756 => 0.4170, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 11.00% (0.2781 => 0.3087, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.99% (0.2966 => 0.3292, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.99% (0.3130 => 0.3474, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 10.96% (0.3293 => 0.3654, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.94% (0.4791 => 0.5315, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.92% (0.5577 => 0.6186, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 10.85% (1.1061 => 1.2261, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.81% (0.3489 => 0.3866, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.75% (0.2782 => 0.3081, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 10.70% (16.6129 => 18.3904, std.dev.: 0.0122) MultiSource/Applications/minisat/minisat: 10.69% (0.6744 => 0.7465, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.60% (0.1075 => 0.1189, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 10.60% (0.2726 => 0.3015, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 10.54% (0.3453 => 0.3817, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 10.52% (0.3868 => 0.4275, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.44% (0.0977 => 0.1079, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 10.40% (0.3220 => 0.3555, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 10.38% (0.1589 => 0.1754, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.38% (0.8698 => 0.9601, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.37% (1.9828 => 2.1884, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.34% (0.4379 => 0.4832, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 10.33% (0.3534 => 0.3899, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.32% (0.1986 => 0.2191, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 10.32% (0.2995 => 0.3304, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 10.29% (0.2760 => 0.3044, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 10.29% (0.3149 => 0.3473, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 10.26% (0.2690 => 0.2966, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.24% (0.2655 => 0.2927, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 10.24% (0.2607 => 0.2874, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 10.22% (0.1478 => 0.1629, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 10.19% (3.8646 => 4.2585, std.dev.: 0.0025) MultiSource/Applications/siod/siod: 10.19% (2.1791 => 2.4011, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 10.17% (0.1111 => 0.1224, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 10.17% (0.3107 => 0.3423, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.17% (0.3246 => 0.3576, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 10.17% (1.9270 => 2.1229, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 10.16% (3.1889 => 3.5129, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.16% (0.1014 => 0.1117, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.09% (0.2914 => 0.3208, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 10.08% (0.2628 => 0.2893, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.07% (0.4390 => 0.4832, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.05% (0.2765 => 0.3043, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 10.03% (0.2761 => 0.3038, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.03% (0.1865 => 0.2052, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.01% (0.2127 => 0.2340, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 9.99% (0.7506 => 0.8256, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 9.98% (0.2937 => 0.3230, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 9.96% (0.3192 => 0.3510, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.93% (0.7460 => 0.8201, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.90% (4.9865 => 5.4804, std.dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.88% (0.5637 => 0.6194, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 9.87% (0.8310 => 0.9130, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.82% (0.1569 => 0.1723, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 9.81% (0.2925 => 0.3212, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 9.74% (1.0594 => 1.1626, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.68% (0.2696 => 0.2957, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.67% (7.2180 => 7.9157, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.64% (0.1276 => 0.1399, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.62% (0.1435 => 0.1573, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 9.61% (0.2988 => 0.3275, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.54% (0.2023 => 0.2216, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.37% (0.3755 => 0.4107, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 9.23% (0.1657 => 0.1810, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 9.13% (0.2945 => 0.3214, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.06% (1.3245 => 1.4445, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 8.97% (1.2749 => 1.3892, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.96% (4.4433 => 4.8416, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.88% (4.3801 => 4.7692, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.88% (0.6576 => 0.7160, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.85% (3.6692 => 3.9939, std.dev.: 0.0024) MultiSource/Benchmarks/sim/sim: 8.85% (0.3131 => 0.3408, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 8.79% (14.8535 => 16.1596, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.58% (0.8818 => 0.9575, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 8.47% (8.4961 => 9.2157, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/parameter-passing: 8.42% (0.4003 => 0.4340, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.36% (0.6135 => 0.6648, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.33% (0.1789 => 0.1938, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 8.21% (0.6250 => 0.6763, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.17% (0.3940 => 0.4262, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.17% (1.5188 => 1.6429, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 8.12% (0.3914 => 0.4232, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.10% (0.9108 => 0.9846, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 8.10% (4.6629 => 5.0407, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.08% (0.2140 => 0.2313, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.05% (0.4805 => 0.5192, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 8.05% (0.4113 => 0.4444, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.02% (0.3578 => 0.3865, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 8.00% (0.3789 => 0.4092, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.99% (1.1333 => 1.2238, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.97% (3.2742 => 3.5353, std.dev.: 0.0155) SingleSource/UnitTests/ObjC/synchronized: 7.92% (0.3663 => 0.3953, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-4: 7.90% (0.3646 => 0.3934, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 7.89% (3.7467 => 4.0423, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.88% (0.2321 => 0.2504, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.86% (0.3650 => 0.3937, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.83% (0.3601 => 0.3883, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.81% (0.3623 => 0.3906, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.77% (0.3245 => 0.3497, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: 7.65% (0.1385 => 0.1491, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.63% (0.3511 => 0.3779, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.61% (2.1007 => 2.2606, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 7.61% (6.5754 => 7.0756, std.dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 7.47% (1.2292 => 1.3210, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.35% (0.2504 => 0.2688, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 7.32% (0.2008 => 0.2155, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.06% (6.2785 => 6.7219, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.94% (13.2842 => 14.2056, std.dev.: 0.0114) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.27% (0.1819 => 0.1933, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.35% (0.2243 => 0.2363, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 5.23% (16.2614 => 17.1123, std.dev.: 0.0210) MultiSource/Applications/ClamAV/clamscan: 4.65% (14.5298 => 15.2055, std.dev.: 0.0170) MultiSource/Benchmarks/Bullet/bullet: 2.27% (33.2944 => 34.0488, std.dev.: 0.0169) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.87% (0.4846 => 0.6972, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5152, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.26% (1.8175 => 2.2584, std.dev.: 0.0564) SingleSource/Benchmarks/Misc/richards_benchmark: 11.09% (1.1560 => 1.2842, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 9.03% (0.8273 => 0.9020) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (3.1736 => 3.4148, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.35% (1.2998 => 1.3823, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.80% (0.3458 => 0.3624, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0041, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.91% (11.2619 => 11.7026, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.58% (10.7476 => 11.1320, std.dev.: 0.0405) SingleSource/Benchmarks/Misc/flops-6: 3.33% (1.9199 => 1.9838, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.20% (7.4271 => 7.5903, std.dev.: 0.0059) MultiSource/Applications/lemon/lemon: 1.55% (1.4298 => 1.4520, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: 1.44% (8.3908 => 8.5120, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1882, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.17% (5.5130 => 5.5775, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5907, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0263, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.03% (3.6469 => 3.6843, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.97% (0.2670 => 0.1416, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.22% (0.4657 => 0.3948, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -14.14% (0.0707 => 0.0607, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.14% (1.3813 => 1.1998, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.04% (1.3819 => 1.2017, std.dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.64% (0.0997 => 0.0861, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.20% (0.2238 => 0.1965, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -11.12% (1.2308 => 1.0939, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.15% (20.3410 => 18.2765, std.dev.: 0.0196) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.61% (1.3780 => 1.3007, std.dev.: 0.0062) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.10% (2.6470 => 2.5121, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.70% (0.9996 => 0.9526, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.53% (1.7688 => 1.7064, std.dev.: 0.0012) MultiSource/Applications/siod/siod: -3.34% (3.2729 => 3.1635, std.dev.: 0.0062) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.60% (26.5159 => 25.8261, std.dev.: 0.0169) SingleSource/Regression/C/uint64_to_float: -2.55% (0.5449 => 0.5310, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4781, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.53% (3.0263 => 2.9497, std.dev.: 0.0023) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.32% (1.9762 => 1.9304, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.00% (0.6589 => 0.6457, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7143, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/lists: -1.72% (6.3560 => 6.2466, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0060, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.25% (0.8342 => 0.8238) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4940, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/heapsort: -1.24% (3.9173 => 3.8688, std.dev.: 0.0115) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2568, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: -1.08% (9.3358 => 9.2348, std.dev.: 0.0070) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 14 07:34:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 14 Oct 2012 09:34:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121014143417.174B42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4864?compare_to=4862&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4864, Order: 165905, Start Time: 2012-10-14 13:15:47, End Time: 2012-10-14 14:36:09 To: 4862, Order: 165903, Start Time: 2012-10-14 11:25:54, End Time: 2012-10-14 12:46:20 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (169 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 951 (676 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.58% (0.8896 => 0.9037, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.01% (1.5000 => 1.5151, std.dev.: 0.0010) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.5960 => 0.5960, std.dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 0.14% (16.4831 => 16.5059, std.dev.: 0.0174) MultiSource/Benchmarks/Bullet/bullet: 0.24% (55.5754 => 55.7080, std.dev.: 0.0087) MultiSource/Benchmarks/MallocBench/gs/gs: -0.11% (4.4662 => 4.4614, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.43% (0.0460 => 0.0462) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.43% (0.0462 => 0.0464) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.47% (0.0429 => 0.0431, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.70% (0.0430 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.72% (0.0418 => 0.0421) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.71% (0.0420 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.48% (0.0413 => 0.0415, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.72% (0.0414 => 0.0417, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.23% (0.0431 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.23% (0.0433 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.23% (0.0426 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 4.92% (0.0427 => 0.0448, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.48% (0.0415 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.72% (0.0416 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.47% (0.0423 => 0.0425) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.71% (0.0423 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.46% (0.0434 => 0.0436) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.28% (0.0436 => 0.0459, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.49% (0.0410 => 0.0412) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.73% (0.0411 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.47% (0.0423 => 0.0425, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.47% (0.0424 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.48% (0.0414 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.48% (0.0415 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.49% (0.0406 => 0.0408, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.49% (0.0407 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.25% (0.0405 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.49% (0.0406 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.23% (0.0442 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.68% (0.0442 => 0.0445, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.25% (0.0404 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.49% (0.0405 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.50% (0.0404 => 0.0406, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.49% (0.0406 => 0.0408) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.24% (0.0413 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.48% (0.0414 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.07% (1.2623 => 1.2632, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.10% (7.9534 => 7.9616, std.dev.: 0.0162) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.20% (0.7476 => 0.7461, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.56% (0.0359 => 0.0357, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1432 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.06% (0.0658 => 0.0665, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.92% (63.2438 => 55.7080, std.dev.: 0.0087) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.50% (14.1553 => 19.0385, std.dev.: 0.0219) SingleSource/Benchmarks/Misc-C++-EH/spirit: 65.45% (3.4629 => 5.7294, std.dev.: 0.0029) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14224.03% (0.0720 => 10.3133, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952400.00% (0.0001 => 9.9525, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 64.68% (0.2554 => 0.4206, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 44.76% (10.3673 => 15.0075, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/richards_benchmark: 40.69% (0.1622 => 0.2282, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/distray/distray: 34.00% (0.1056 => 0.1415, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 18.58% (0.1432 => 0.1698, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.52% (7.0540 => 8.3606, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 17.92% (0.0798 => 0.0941, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.66% (2.2022 => 2.5911, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.77% (0.1566 => 0.1813, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.09% (0.1143 => 0.1304, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.78% (1.7609 => 2.0035, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/matrix: 13.69% (0.0818 => 0.0930, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.43% (0.0871 => 0.0988, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 13.41% (0.3282 => 0.3722, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 12.99% (0.1440 => 0.1627) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 12.25% (0.1584 => 0.1778, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 11.87% (10.4361 => 11.6753, std.dev.: 0.0090) MultiSource/Applications/lambda-0_1_3/lambda: 11.50% (0.7433 => 0.8288, std.dev.: 0.0034) SingleSource/Benchmarks/McGill/chomp: 11.42% (0.1655 => 0.1844, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 10.99% (0.7115 => 0.7897, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.89% (0.2700 => 0.2994, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.86% (0.4879 => 0.5409, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.86% (0.3177 => 0.3522, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.83% (0.1625 => 0.1801, std.dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 10.73% (9.4845 => 10.5020, std.dev.: 0.0096) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.71% (0.1438 => 0.1592, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.67% (0.3543 => 0.3921, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.58% (0.8172 => 0.9037, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.55% (1.5415 => 1.7042, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 10.50% (0.3543 => 0.3915, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.49% (0.6675 => 0.7375, std.dev.: 0.0137) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.47% (0.4615 => 0.5098, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/parameter-passing: 10.39% (0.3927 => 0.4335, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/tsp/tsp: 10.30% (0.1175 => 0.1296, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.19% (0.3473 => 0.3827, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 10.14% (0.3886 => 0.4280) MultiSource/Applications/d/make_dparser: 10.10% (3.3354 => 3.6722, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.07% (0.5105 => 0.5619, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 10.07% (0.3497 => 0.3849, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.04% (0.1125 => 0.1238, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 10.01% (0.3828 => 0.4211, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 10.00% (0.3109 => 0.3420, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 10.00% (0.3561 => 0.3917, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-3: 9.98% (0.3516 => 0.3867, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.94% (0.3694 => 0.4061, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 9.93% (5.7591 => 6.3310, std.dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.86% (0.5860 => 0.6438, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 9.85% (0.1695 => 0.1862, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 9.82% (0.3423 => 0.3759, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 9.73% (0.1151 => 0.1263, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.63% (0.1236 => 0.1355, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.51% (0.8067 => 0.8834, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: 9.50% (1.1642 => 1.2748, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.43% (4.2646 => 4.6668, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.42% (0.1337 => 0.1463, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 9.37% (3.8723 => 4.2351, std.dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 9.34% (0.1906 => 0.2084, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.34% (0.1510 => 0.1651, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.33% (0.1940 => 0.2121, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.27% (1.3050 => 1.4260, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.21% (0.5569 => 0.6082, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.17% (0.2758 => 0.3011, std.dev.: 0.0020) MultiSource/Applications/spiff/spiff: 9.16% (0.7835 => 0.8553, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.11% (0.2107 => 0.2299, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.10% (5.0018 => 5.4571, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.07% (0.2271 => 0.2477, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.07% (0.3121 => 0.3404, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 9.07% (0.1555 => 0.1696, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/mst/mst: 9.03% (0.1163 => 0.1268, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.99% (4.9449 => 5.3894, std.dev.: 0.0088) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.98% (7.9617 => 8.6766, std.dev.: 0.0048) MultiSource/Applications/treecc/treecc: 8.94% (2.0273 => 2.2086, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.92% (8.1363 => 8.8621, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.90% (0.9765 => 1.0634, std.dev.: 0.0017) MultiSource/Applications/hbd/hbd: 8.83% (1.5603 => 1.6981, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: 8.77% (0.6456 => 0.7022, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.76% (0.5020 => 0.5460, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 8.76% (1.0722 => 1.1661, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 8.75% (2.2969 => 2.4978, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.72% (1.5859 => 1.7242, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 8.71% (0.3387 => 0.3682, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.67% (0.2065 => 0.2244, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.65% (0.3307 => 0.3593, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 8.33% (0.3180 => 0.3445, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.28% (0.3441 => 0.3726, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.16% (0.4103 => 0.4438, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/health/health: 8.12% (0.1268 => 0.1371, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.04% (1.1861 => 1.2815, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 7.91% (21.9371 => 23.6733, std.dev.: 0.0331) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.78% (2.2024 => 2.3738, std.dev.: 0.0070) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 7.74% (0.1330 => 0.1433, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.68% (0.4299 => 0.4629, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.61% (0.2603 => 0.2801, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.57% (0.6450 => 0.6938, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 7.41% (0.8921 => 0.9582, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.37% (0.1695 => 0.1820, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.37% (0.3865 => 0.4150, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.21% (0.4203 => 0.4506, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 7.18% (0.4289 => 0.4597, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/neural/neural: 7.18% (0.1463 => 0.1568, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.12% (0.4620 => 0.4949, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 7.04% (0.3422 => 0.3663, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.03% (0.6030 => 0.6454, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.97% (0.5925 => 0.6338, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.92% (1.4186 => 1.5168, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.92% (0.5981 => 0.6395, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/moments: 6.92% (0.4048 => 0.4328, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.74% (0.3826 => 0.4084, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.68% (0.2905 => 0.3099, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.66% (0.1892 => 0.2018, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.63% (0.3650 => 0.3892, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.49% (1.1840 => 1.2608, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.47% (0.4636 => 0.4936, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/sieve: 6.47% (0.3603 => 0.3836, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 6.44% (0.7326 => 0.7798, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/lists1: 6.24% (0.3684 => 0.3914, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.22% (0.2266 => 0.2407, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.15% (0.3136 => 0.3329, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.13% (0.2756 => 0.2925, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 6.09% (0.2725 => 0.2891, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.01% (0.3162 => 0.3352, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 5.90% (0.2831 => 0.2998, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.87% (2.0665 => 2.1879, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.84% (0.8101 => 0.8574, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.81% (0.2891 => 0.3059, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 5.80% (0.3379 => 0.3575, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 5.69% (0.3232 => 0.3416, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/ReedSolomon: 5.61% (0.2049 => 0.2164, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 5.60% (0.3283 => 0.3467, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.56% (0.4064 => 0.4290, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.55% (0.3098 => 0.3270, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.50% (0.2871 => 0.3029, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.43% (0.2872 => 0.3028, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.41% (0.2793 => 0.2944, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 5.41% (0.3052 => 0.3217, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: 5.39% (0.2877 => 0.3032, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 5.21% (0.2802 => 0.2948, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.12% (0.2714 => 0.2853, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.10% (14.3668 => 15.0997, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.08% (0.3427 => 0.3601, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 4.83% (17.1811 => 18.0116, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.60% (3.8922 => 4.0711, std.dev.: 0.0200) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.49% (0.2430 => 0.2539, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 4.41% (1.2842 => 1.3408, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 4.28% (0.3131 => 0.3265, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.85% (1.1194 => 1.1625, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/bh/bh: 3.53% (0.3092 => 0.3201, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.91% (1.1396 => 1.2525, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4498, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.70% (3.1578 => 3.3694, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.45% (3.6395 => 3.7652, std.dev.: 0.0074) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.89% (4.2280 => 4.3502, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.34% (1.7254 => 1.7658, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.69% (0.8275 => 0.8415, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.36% (11.6436 => 11.8014, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.16% (2.6546 => 2.6854, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5767, std.dev.: 0.0042) MultiSource/Applications/minisat/minisat: 1.03% (9.1159 => 9.2097, std.dev.: 0.0267) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.00% (6.6874 => 0.1336, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -79.93% (0.8651 => 0.1736, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.89% (5.2763 => 3.2769, std.dev.: 0.0128) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.04% (5.3855 => 3.7140, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.66% (5.3526 => 3.7117, std.dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -14.67% (54.1659 => 46.2179, std.dev.: 0.0127) MultiSource/Applications/ClamAV/clamscan: -11.78% (22.1758 => 19.5634, std.dev.: 0.0155) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -9.90% (2.9384 => 2.6476, std.dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.43% (1.1492 => 0.7650, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: -15.75% (1.6925 => 1.4259, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.63% (0.0998 => 0.0862, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -11.61% (1.2373 => 1.0937, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: -10.30% (1.5373 => 1.3790, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/mason/mason: -9.63% (0.2161 => 0.1953, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.46% (19.9488 => 18.2604, std.dev.: 0.0180) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.73% (1.8329 => 1.7095, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5758, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.31% (1.6805 => 1.5913, std.dev.: 0.0039) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.73% (1.5835 => 1.5086, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.31% (0.9957 => 0.9528, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1624, std.dev.: 0.0063) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5014, std.dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0989, std.dev.: 0.0014) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -2.07% (10.2830 => 10.0700, std.dev.: 0.0460) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.98% (8.6802 => 8.5084, std.dev.: 0.0150) SingleSource/Regression/C/uint64_to_float: -1.88% (0.5413 => 0.5311, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.82% (8.1563 => 8.0078, std.dev.: 0.0132) SingleSource/UnitTests/Vector/multiplies: -1.79% (2.5528 => 2.5072, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6830, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4208, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.05% (6.2999 => 6.2335, std.dev.: 0.0029) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.98% (0.5229 => 0.5960, std.dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 10.12% (14.9895 => 16.5059, std.dev.: 0.0174) MultiSource/Benchmarks/MallocBench/gs/gs: 8.54% (4.1105 => 4.4614, std.dev.: 0.0101) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.34% (1.1048 => 1.2632, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.22% (7.1582 => 7.9616, std.dev.: 0.0162) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.91% (0.6222 => 0.7461, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35600.00% (0.0001 => 0.0357, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.57% (0.2116 => 0.0665, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 14 08:04:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 14 Oct 2012 10:04:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121014150417.90B032A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4865?compare_to=4863&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4865, Order: 165905, Start Time: 2012-10-14 13:41:27, End Time: 2012-10-14 15:07:10 To: 4863, Order: 165903, Start Time: 2012-10-14 11:46:44, End Time: 2012-10-14 13:12:23 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (185 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1041 (679 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.39% (3.7477 => 3.7997, std.dev.: 0.0180) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.60% (2.0176 => 2.4938, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.58% (0.1410 => 0.1672, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.30% (0.0653 => 0.0766, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 17.08% (0.2243 => 0.2626, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 16.83% (0.0826 => 0.0965, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.11% (0.1072 => 0.1234, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.92% (0.1327 => 0.1525, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 14.31% (0.1013 => 0.1158, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.79% (0.0834 => 0.0949, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 13.44% (0.7038 => 0.7984, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.38% (0.1413 => 0.1602, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 12.83% (1.3693 => 1.5450, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.76% (0.0964 => 0.1087, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.70% (3.9660 => 4.4695, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.53% (0.1588 => 0.1787, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.48% (0.2596 => 0.2920, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.35% (0.2721 => 0.3057, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 12.21% (13.8202 => 15.5072, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.17% (0.6959 => 0.7806, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.15% (1.4563 => 1.6333, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 12.05% (0.1062 => 0.1190, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.04% (0.5265 => 0.5899, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.04% (0.7710 => 0.8638, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.03% (0.9199 => 1.0306, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.03% (0.6283 => 0.7039, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.98% (1.2193 => 1.3654, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 11.97% (0.4328 => 0.4846, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 11.86% (0.1003 => 0.1122, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.44% (1.1364 => 1.2664, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.41% (0.1157 => 0.1289, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 11.36% (0.5818 => 0.6479, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 11.33% (1.0313 => 1.1481, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.21% (0.3130 => 0.3481, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 11.13% (0.4062 => 0.4514, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.01% (0.5577 => 0.6191, std.dev.: 0.0048) MultiSource/Applications/Burg/burg: 11.00% (1.1061 => 1.2278, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.95% (0.3899 => 0.4326, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.94% (0.4791 => 0.5315, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.88% (0.1075 => 0.1192, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 10.86% (0.5748 => 0.6372, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.75% (0.3022 => 0.3347, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 10.62% (16.6129 => 18.3775, std.dev.: 0.0125) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.57% (0.2914 => 0.3222, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.55% (0.4379 => 0.4841, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.54% (0.0977 => 0.1080, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 10.52% (2.1791 => 2.4083, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: 10.51% (0.1589 => 0.1756, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.45% (0.3580 => 0.3954, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 10.44% (0.6744 => 0.7448, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 10.44% (0.7061 => 0.7798, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 10.40% (3.8646 => 4.2667, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.39% (0.3485 => 0.3847, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 10.35% (0.2995 => 0.3305, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.32% (0.3246 => 0.3581, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 10.31% (0.3220 => 0.3552, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.31% (0.4016 => 0.4430, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 10.26% (1.9270 => 2.1248, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/mst/mst: 10.26% (0.1111 => 0.1225, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.22% (0.1986 => 0.2189, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 10.21% (0.7506 => 0.8272, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.20% (0.2127 => 0.2344, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.20% (0.3756 => 0.4139, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 10.17% (3.1889 => 3.5132, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.16% (0.1014 => 0.1117, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 10.15% (0.1478 => 0.1628, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.12% (4.9865 => 5.4909, std.dev.: 0.0059) SingleSource/Regression/C++/ofstream_ctor: 10.10% (0.2781 => 0.3062, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.03% (0.1865 => 0.2052, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.00% (0.7460 => 0.8206, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 9.98% (0.2925 => 0.3217, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 9.95% (0.8310 => 0.9137, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.92% (0.3489 => 0.3835, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.90% (0.5637 => 0.6195, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.90% (0.8698 => 0.9559, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 9.87% (0.3293 => 0.3618, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.83% (0.1435 => 0.1576, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.82% (0.1569 => 0.1723, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 9.80% (0.3868 => 0.4247, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.80% (0.1276 => 0.1401, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.78% (0.2782 => 0.3054, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 9.69% (1.0594 => 1.1621, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.69% (0.2023 => 0.2219, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 9.61% (0.2726 => 0.2988, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.54% (0.2966 => 0.3249, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 9.53% (0.3453 => 0.3782, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.49% (7.2180 => 7.9028, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary: 9.46% (0.3107 => 0.3401, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 9.41% (0.1657 => 0.1813, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.38% (0.4390 => 0.4802, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.37% (1.9828 => 2.1685, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/lists1: 9.34% (0.3534 => 0.3864, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 9.34% (0.3149 => 0.3443, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 9.31% (0.2760 => 0.3017, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.23% (0.2655 => 0.2900, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 9.22% (0.2690 => 0.2938) SingleSource/Benchmarks/Shootout-C++/methcall: 9.20% (0.2761 => 0.3015, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/fibo: 9.09% (0.2628 => 0.2867, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 9.09% (0.2607 => 0.2844, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.08% (1.3245 => 1.4448, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.08% (0.2765 => 0.3016, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 9.02% (0.2937 => 0.3202, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 8.96% (1.2749 => 1.3891, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 8.93% (0.3192 => 0.3477, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 8.91% (0.3131 => 0.3410, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.84% (0.3755 => 0.4087, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.83% (0.2696 => 0.2934, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.81% (4.3801 => 4.7662, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.81% (3.6692 => 3.9924, std.dev.: 0.0109) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.75% (4.4433 => 4.8323, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.73% (0.6576 => 0.7150, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 8.70% (0.2988 => 0.3248, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 8.65% (14.8535 => 16.1390, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.56% (0.6135 => 0.6660, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 8.49% (8.4961 => 9.2172, std.dev.: 0.0109) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.43% (0.3511 => 0.3807, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.43% (0.8818 => 0.9561, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.34% (1.5188 => 1.6454, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.32% (0.2321 => 0.2514, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 8.25% (0.2945 => 0.3188, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.22% (0.1789 => 0.1936, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.13% (0.2140 => 0.2314, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 8.12% (0.4113 => 0.4447, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.04% (1.1333 => 1.2244, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.00% (0.9108 => 0.9837, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.97% (3.2742 => 3.5353, std.dev.: 0.0024) MultiSource/Applications/lua/lua: 7.93% (3.7467 => 4.0439, std.dev.: 0.0186) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.89% (0.4805 => 0.5184, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 7.85% (4.6629 => 5.0289, std.dev.: 0.0134) SingleSource/UnitTests/ObjC/parameter-passing: 7.84% (0.4003 => 0.4317, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 7.84% (0.6250 => 0.6740, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 7.68% (6.5754 => 7.0804, std.dev.: 0.0122) MultiSource/Benchmarks/FreeBench/neural/neural: 7.65% (0.1385 => 0.1491, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.59% (2.1007 => 2.2602, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/property: 7.56% (0.3940 => 0.4238, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.56% (0.3914 => 0.4210, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.47% (0.2504 => 0.2691, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 7.32% (0.3578 => 0.3840, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.31% (0.3789 => 0.4066, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.30% (0.3245 => 0.3482, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/synchronized: 7.23% (0.3663 => 0.3928, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.19% (0.3601 => 0.3860, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.19% (0.3646 => 0.3908, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.18% (0.3650 => 0.3912, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: 7.12% (0.2008 => 0.2151, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.11% (6.2785 => 6.7247, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/exceptions-3: 7.09% (0.3623 => 0.3880, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 6.72% (1.2292 => 1.3118, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.71% (13.2842 => 14.1762, std.dev.: 0.0201) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.10% (0.1819 => 0.1930, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.48% (0.2243 => 0.2366, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 5.17% (16.2614 => 17.1022, std.dev.: 0.0151) MultiSource/Applications/ClamAV/clamscan: 4.64% (14.5298 => 15.2040, std.dev.: 0.0058) MultiSource/Benchmarks/Bullet/bullet: 1.81% (33.2944 => 33.8973, std.dev.: 0.0147) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5175, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.17% (1.8175 => 2.2567, std.dev.: 0.0312) SingleSource/Benchmarks/Misc/richards_benchmark: 11.06% (1.1560 => 1.2839, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1916, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4144, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.25% (1.2998 => 1.3811, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0052, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.92% (11.2619 => 11.7036, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7747, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9861, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.19% (10.7476 => 11.0905, std.dev.: 0.0340) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.21% (7.4271 => 7.5909, std.dev.: 0.0049) MultiSource/Applications/lemon/lemon: 1.71% (1.4298 => 1.4542, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5142, std.dev.: 0.0063) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2126) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1885, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5788, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0270, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.07% (12.4560 => 12.5896, std.dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.97% (0.2670 => 0.1416, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.78% (0.4657 => 0.3922, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -14.14% (0.0707 => 0.0607, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.18% (1.3813 => 1.1993, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.15% (1.3819 => 1.2002, std.dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.44% (0.0997 => 0.0863) MultiSource/Benchmarks/FreeBench/mason/mason: -12.15% (0.2238 => 0.1966, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -10.94% (1.2308 => 1.0961, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.16% (20.3410 => 18.2736, std.dev.: 0.0149) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.65% (1.3780 => 1.3001, std.dev.: 0.0099) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5138, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.01% (0.9996 => 0.9595, std.dev.: 0.0075) MultiSource/Applications/siod/siod: -3.59% (3.2729 => 3.1555, std.dev.: 0.0049) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.44% (1.7688 => 1.7079, std.dev.: 0.0162) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: -2.53% (0.5449 => 0.5311) MultiSource/Applications/lua/lua: -2.46% (26.5159 => 25.8645, std.dev.: 0.0119) MultiSource/Benchmarks/Olden/bh/bh: -2.39% (1.9762 => 1.9290, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.37% (3.0263 => 2.9546, std.dev.: 0.0016) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.90% (0.6589 => 0.6464, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7140, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/lists: -1.78% (6.3560 => 6.2430, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0069, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8639, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.26% (0.8342 => 0.8237, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4947, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: -1.16% (9.3358 => 9.2276, std.dev.: 0.0386) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2579, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 14 10:53:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 14 Oct 2012 12:53:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121014175307.9ED7E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4866?compare_to=4864&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4866, Order: 165907, Start Time: 2012-10-14 16:34:33, End Time: 2012-10-14 17:55:00 To: 4864, Order: 165905, Start Time: 2012-10-14 13:15:47, End Time: 2012-10-14 14:36:09 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (166 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 952 (678 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.17% (3.7877 => 3.8322, std.dev.: 0.0164) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.15% (0.5960 => 0.5969, std.dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 0.12% (16.5059 => 16.5250, std.dev.: 0.0175) MultiSource/Benchmarks/Bullet/bullet: 0.01% (55.7080 => 55.7143, std.dev.: 0.0338) MultiSource/Benchmarks/MallocBench/gs/gs: 0.49% (4.4614 => 4.4833, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0462 => 0.0462) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.22% (0.0464 => 0.0463, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0431 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0433 => 0.0433) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0421 => 0.0421) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0423 => 0.0423) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0415 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.23% (0.0432 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0434 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0427 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.24% (0.0448 => 0.0429, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.24% (0.0417 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0419 => 0.0419) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0425 => 0.0425) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0426 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.23% (0.0436 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.22% (0.0459 => 0.0458, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0412 => 0.0412, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0414 => 0.0414, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.24% (0.0425 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0426 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0416 => 0.0416) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.25% (0.0408 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0409 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0406 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0408 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.23% (0.0443 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0445 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.25% (0.0405 => 0.0406) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0407 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.25% (0.0406 => 0.0407) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0408 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0414 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0416 => 0.0416) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (1.2632 => 1.2632, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.18% (7.9616 => 7.9469, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.24% (0.7461 => 0.7443, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.84% (0.0357 => 0.0360, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.30% (0.0665 => 0.0667, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.91% (63.2438 => 55.7143, std.dev.: 0.0338) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.65% (14.1553 => 19.0606, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++-EH/spirit: 65.57% (3.4629 => 5.7335, std.dev.: 0.0194) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14224.17% (0.0720 => 10.3134, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9951900.00% (0.0001 => 9.9520, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 64.92% (0.2554 => 0.4212, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: 44.68% (10.3673 => 14.9991, std.dev.: 0.0119) SingleSource/Benchmarks/Misc/richards_benchmark: 40.75% (0.1622 => 0.2283, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: 33.81% (0.1056 => 0.1413, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.67% (7.0540 => 8.3710, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/flops: 18.51% (0.1432 => 0.1697, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.66% (2.2022 => 2.5911, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.96% (0.1566 => 0.1816, std.dev.: 0.0007) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.09% (0.1143 => 0.1304, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.81% (1.7609 => 2.0040, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.32% (0.0871 => 0.0987, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 13.28% (0.3282 => 0.3718, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 12.99% (0.1440 => 0.1627, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 12.37% (0.1584 => 0.1780, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 11.77% (10.4361 => 11.6644, std.dev.: 0.0273) MultiSource/Applications/lambda-0_1_3/lambda: 11.61% (0.7433 => 0.8296, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 11.06% (0.7115 => 0.7902, std.dev.: 0.0107) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.93% (0.2700 => 0.2995, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.80% (0.4879 => 0.5406, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 10.76% (9.4845 => 10.5051, std.dev.: 0.0202) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.73% (0.3543 => 0.3923, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.71% (0.1625 => 0.1799, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.64% (0.1438 => 0.1591, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 10.57% (0.1655 => 0.1830, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.49% (0.6675 => 0.7375, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 10.47% (0.1175 => 0.1298, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.45% (0.3177 => 0.3509, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/parameter-passing: 10.44% (0.3927 => 0.4337, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 10.32% (0.1695 => 0.1870, std.dev.: 0.0017) MultiSource/Applications/d/make_dparser: 10.29% (3.3354 => 3.6785, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.26% (1.5415 => 1.6997, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/trivial-interface: 10.14% (0.3473 => 0.3825, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.12% (0.2758 => 0.3037, std.dev.: 0.0025) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3109 => 0.3423, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 10.08% (0.1151 => 0.1267, std.dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.04% (0.1125 => 0.1238, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.03% (0.5860 => 0.6448, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions: 10.03% (0.3828 => 0.4212) SingleSource/UnitTests/ObjC/property: 10.01% (0.3886 => 0.4275, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.99% (0.4615 => 0.5076, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/synchronized: 9.97% (0.3561 => 0.3916, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-3: 9.95% (0.3516 => 0.3866, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.95% (0.3497 => 0.3845, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 9.93% (5.7591 => 6.3311, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions-4: 9.91% (0.3543 => 0.3894, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 9.90% (0.3423 => 0.3762, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.88% (0.8067 => 0.8864, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/for-in: 9.85% (0.3694 => 0.4058, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.83% (0.5105 => 0.5607, std.dev.: 0.0122) MultiSource/Applications/lua/lua: 9.81% (3.8723 => 4.2520, std.dev.: 0.0124) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.80% (0.3121 => 0.3427, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.79% (0.1236 => 0.1357, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 9.74% (1.1642 => 1.2776, std.dev.: 0.0185) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.69% (0.1940 => 0.2128, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.61% (0.8172 => 0.8957, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.60% (4.2646 => 4.6742, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.40% (0.1510 => 0.1652, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.39% (0.5569 => 0.6092, std.dev.: 0.0029) MultiSource/Applications/spiff/spiff: 9.34% (0.7835 => 0.8567, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.33% (1.3050 => 1.4267, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/mst/mst: 9.20% (0.1163 => 0.1270, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 9.20% (0.1555 => 0.1698, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.16% (0.2271 => 0.2479, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.16% (4.9449 => 5.3977, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.13% (0.1117 => 0.1219, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.11% (0.2107 => 0.2299, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.11% (5.0018 => 5.4573, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.03% (7.9617 => 8.6805, std.dev.: 0.0207) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.93% (0.9765 => 1.0637, std.dev.: 0.0053) MultiSource/Applications/siod/siod: 8.90% (2.2969 => 2.5014, std.dev.: 0.0035) MultiSource/Applications/treecc/treecc: 8.90% (2.0273 => 2.2077, std.dev.: 0.0037) MultiSource/Applications/lemon/lemon: 8.90% (1.0722 => 1.1676, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.88% (0.5020 => 0.5466, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.86% (0.2065 => 0.2248, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.85% (8.1363 => 8.8565, std.dev.: 0.0133) MultiSource/Benchmarks/sim/sim: 8.83% (0.3387 => 0.3686, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.83% (0.1337 => 0.1455, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.79% (1.5859 => 1.7253, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 8.74% (0.6456 => 0.7020, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 8.72% (1.5603 => 1.6964, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.71% (0.3307 => 0.3595, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.46% (0.3441 => 0.3732, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 8.40% (0.3180 => 0.3447, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.09% (1.1861 => 1.2821, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.99% (0.4103 => 0.4431, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 7.98% (21.9371 => 23.6866, std.dev.: 0.0108) MultiSource/Benchmarks/Olden/health/health: 7.97% (0.1268 => 0.1369, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 7.80% (0.8921 => 0.9617, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.80% (2.2024 => 2.3742, std.dev.: 0.0095) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.77% (0.6450 => 0.6951, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.68% (0.2603 => 0.2803, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.67% (0.1695 => 0.1825, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 7.63% (0.4299 => 0.4627, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.57% (0.4636 => 0.4987, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 7.39% (0.4289 => 0.4606, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.30% (0.3865 => 0.4147, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: 7.25% (0.1463 => 0.1569, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.23% (0.4203 => 0.4507, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.11% (0.5981 => 0.6406, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists: 7.10% (0.3422 => 0.3665, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.09% (1.4186 => 1.5192, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.08% (0.3826 => 0.4097, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.06% (0.4620 => 0.4946, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.95% (0.5925 => 0.6337, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 6.95% (0.6030 => 0.6449, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/moments: 6.84% (0.4048 => 0.4325, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 6.63% (0.3603 => 0.3842, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.60% (0.3650 => 0.3891, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 6.55% (1.1840 => 1.2616, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference: 6.44% (0.7326 => 0.7798, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.25% (0.3136 => 0.3332, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 6.24% (0.3684 => 0.3914, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.19% (0.1906 => 0.2024, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.18% (0.2266 => 0.2406, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.01% (0.8101 => 0.8588, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.95% (0.3162 => 0.3350, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.92% (2.0665 => 2.1889, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/fibo: 5.83% (0.2725 => 0.2884, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 5.83% (0.2831 => 0.2996, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.81% (0.2891 => 0.3059, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 5.81% (0.3098 => 0.3278, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 5.76% (0.3283 => 0.3472, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.66% (0.3232 => 0.3415, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.66% (0.1892 => 0.1999, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 5.64% (0.2871 => 0.3033, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 5.56% (0.2049 => 0.2163, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.50% (0.2872 => 0.3030, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.44% (0.2756 => 0.2906, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.34% (0.4064 => 0.4281, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 5.31% (0.3052 => 0.3214, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 5.28% (0.2877 => 0.3029, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.23% (0.2714 => 0.2856, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 5.18% (0.3379 => 0.3554, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.16% (0.2793 => 0.2937, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.11% (0.3427 => 0.3602, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 5.10% (0.2802 => 0.2945, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.09% (14.3668 => 15.0974, std.dev.: 0.0087) MultiSource/Applications/sqlite3/sqlite3: 4.86% (17.1811 => 18.0164, std.dev.: 0.0196) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.58% (3.8922 => 4.0705, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.57% (0.2430 => 0.2541, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 4.49% (1.2842 => 1.3419, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/objinst: 4.28% (0.3131 => 0.3265, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.74% (1.1194 => 1.1613, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: 3.53% (0.3092 => 0.3201, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.62% (0.3817 => 0.3917, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2173, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.83% (1.1396 => 1.2516, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 9.21% (3.1595 => 3.4506, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3685, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.51% (3.6395 => 3.7671, std.dev.: 0.0081) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.89% (4.2280 => 4.3503, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.35% (1.7254 => 1.7659) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.73% (0.8275 => 0.8418, std.dev.: 0.0012) MultiSource/Benchmarks/llubenchmark/llu: 1.43% (3.7781 => 3.8322, std.dev.: 0.0164) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.35% (11.6436 => 11.8012, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.27% (2.6546 => 2.6884, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.00% (6.6874 => 0.1339, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.15% (0.8651 => 0.1717, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.92% (5.2763 => 3.2754, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.08% (5.3855 => 3.7116, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.62% (5.3526 => 3.7138, std.dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -14.61% (54.1659 => 46.2527, std.dev.: 0.0100) MultiSource/Applications/ClamAV/clamscan: -11.98% (22.1758 => 19.5185, std.dev.: 0.0494) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.01% (2.9384 => 2.6443, std.dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.38% (1.1492 => 0.7656, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.98% (1.6925 => 1.4221, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.73% (0.0998 => 0.0861, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -11.28% (1.2373 => 1.0977, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -10.34% (1.5373 => 1.3783, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -10.00% (0.2161 => 0.1945, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.32% (19.9488 => 18.2892, std.dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.69% (1.8329 => 1.7102, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.27% (1.6805 => 1.5919, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.80% (1.5835 => 1.5075, std.dev.: 0.0025) MultiSource/Applications/siod/siod: -3.74% (3.2827 => 3.1600, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.73% (1.3677 => 1.3167, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.60% (0.9957 => 0.9599, std.dev.: 0.0072) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4980, std.dev.: 0.0063) MultiSource/Applications/hexxagon/hexxagon: -3.02% (12.4730 => 12.0958, std.dev.: 0.0014) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.97% (8.6802 => 8.5091, std.dev.: 0.0159) SingleSource/Regression/C/uint64_to_float: -1.88% (0.5413 => 0.5311) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.81% (8.1563 => 8.0088, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -1.78% (10.2830 => 10.0996, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6806, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4211, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout/lists: -1.10% (6.2999 => 6.2306, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8581, std.dev.: 0.0059) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 14.15% (0.5229 => 0.5969, std.dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 10.24% (14.9895 => 16.5250, std.dev.: 0.0175) MultiSource/Benchmarks/MallocBench/gs/gs: 9.07% (4.1105 => 4.4833, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.34% (1.1048 => 1.2632, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.02% (7.1582 => 7.9469, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.62% (0.6222 => 0.7443, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35900.00% (0.0001 => 0.0360, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.48% (0.2116 => 0.0667, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 14 10:57:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 14 Oct 2012 12:57:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121014175756.C6E692A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4867?compare_to=4865&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4867, Order: 165907, Start Time: 2012-10-14 16:35:09, End Time: 2012-10-14 18:00:50 To: 4865, Order: 165905, Start Time: 2012-10-14 13:41:27, End Time: 2012-10-14 15:07:10 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (187 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1040 (676 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.30% (78.4219 => 80.2245, std.dev.: 0.5546) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.67% (55.4483 => 56.3743, std.dev.: 0.1382) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.56% (2.0176 => 2.4930, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.58% (0.1410 => 0.1672, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 17.07% (0.0826 => 0.0967, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.00% (0.0653 => 0.0764, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 16.76% (0.2243 => 0.2619, std.dev.: 0.0038) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.11% (0.1072 => 0.1234, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.62% (0.1327 => 0.1521, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 14.31% (0.1013 => 0.1158, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.91% (0.0834 => 0.0950, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.90% (0.0770 => 0.0877, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.45% (0.1413 => 0.1603, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 13.20% (0.7038 => 0.7967, std.dev.: 0.0062) MultiSource/Applications/hbd/hbd: 12.94% (1.3693 => 1.5465, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.83% (0.2596 => 0.2929, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.76% (0.0964 => 0.1087, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.68% (3.9660 => 4.4687, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.59% (0.1588 => 0.1788, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.35% (0.2721 => 0.3057, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.33% (0.7710 => 0.8661, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.25% (1.4563 => 1.6347, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.19% (0.5265 => 0.5907, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 12.19% (13.8202 => 15.5045, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.16% (0.6959 => 0.7805, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.03% (0.9199 => 1.0306, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.98% (0.6283 => 0.7036, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.92% (1.2193 => 1.3646, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 11.90% (0.4328 => 0.4843, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 11.87% (0.4062 => 0.4544, std.dev.: 0.0030) MultiSource/Applications/aha/aha: 11.86% (0.1062 => 0.1188, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: 11.76% (0.1003 => 0.1121, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.48% (1.1364 => 1.2669, std.dev.: 0.0063) SingleSource/UnitTests/ObjC++/property-reference-object: 11.33% (0.5818 => 0.6477, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 11.25% (1.0313 => 1.1473, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.24% (0.1157 => 0.1287, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.12% (0.3130 => 0.3478, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.08% (0.3899 => 0.4331, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 10.92% (1.1061 => 1.2269, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.90% (0.5577 => 0.6185, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.90% (0.4791 => 0.5313, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 10.84% (0.5748 => 0.6371, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.82% (0.3022 => 0.3349, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.79% (0.1075 => 0.1191, std.dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 10.64% (16.6129 => 18.3797, std.dev.: 0.0042) MultiSource/Applications/minisat/minisat: 10.57% (0.6744 => 0.7457, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.53% (0.4379 => 0.4840, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.50% (0.3485 => 0.3851, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.47% (0.2914 => 0.3219, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 10.47% (0.7061 => 0.7800, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.45% (0.3580 => 0.3954, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.44% (0.0977 => 0.1079, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.44% (0.2127 => 0.2349, std.dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: 10.42% (0.2995 => 0.3307, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 10.42% (2.1791 => 2.4061, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 10.42% (3.8646 => 4.2671, std.dev.: 0.0066) MultiSource/Applications/spiff/spiff: 10.41% (0.7506 => 0.8287, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/chomp: 10.38% (0.1589 => 0.1754, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.36% (0.4016 => 0.4432, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 10.34% (1.9270 => 2.1262, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.30% (0.3756 => 0.4143, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 10.26% (0.1111 => 0.1225, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.26% (0.3246 => 0.3579, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.17% (0.1986 => 0.2188, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 10.16% (0.3220 => 0.3547, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 10.15% (0.1478 => 0.1628, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.15% (4.9865 => 5.4925, std.dev.: 0.0089) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.13% (0.1865 => 0.2054, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 10.13% (3.1889 => 3.5118, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.11% (0.7460 => 0.8214, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.06% (0.1014 => 0.1116, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 10.05% (0.3293 => 0.3624, std.dev.: 0.0038) SingleSource/Regression/C++/ofstream_ctor: 10.00% (0.2781 => 0.3059, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.99% (0.2023 => 0.2225, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.98% (0.8698 => 0.9566, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.95% (0.5637 => 0.6198, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 9.95% (0.8310 => 0.9137, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.95% (0.3489 => 0.3836, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.88% (0.1569 => 0.1724, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 9.82% (0.3868 => 0.4248, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 9.81% (0.2925 => 0.3212, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.80% (0.1276 => 0.1401, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.78% (0.2782 => 0.3054, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 9.73% (0.3453 => 0.3789, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.69% (0.1435 => 0.1574, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 9.65% (0.2726 => 0.2989, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.60% (7.2180 => 7.9109, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.58% (0.2966 => 0.3250, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 9.53% (0.3149 => 0.3449, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 9.46% (0.3107 => 0.3401, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 9.41% (0.1657 => 0.1813, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.38% (0.4390 => 0.4802, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.37% (1.9828 => 2.1686, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: 9.34% (0.3534 => 0.3864, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.30% (0.2655 => 0.2902, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 9.28% (1.0594 => 1.1577, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 9.28% (0.2760 => 0.3016, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.26% (1.3245 => 1.4472, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/random: 9.26% (0.2690 => 0.2939, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 9.24% (0.2607 => 0.2848, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 9.12% (0.2937 => 0.3205, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 9.09% (0.2628 => 0.2867, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 9.09% (0.2761 => 0.3012, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 9.09% (0.3192 => 0.3482, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.08% (0.2765 => 0.3016, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.94% (0.2696 => 0.2937, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 8.91% (0.3131 => 0.3410, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 8.89% (1.2749 => 1.3882, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.84% (3.6692 => 3.9934, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.76% (4.4433 => 4.8326, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.76% (4.3801 => 4.7638, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/matrix: 8.73% (0.2988 => 0.3249, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.71% (0.3755 => 0.4082, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 8.68% (14.8535 => 16.1422, std.dev.: 0.0195) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.62% (0.6576 => 0.7143, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.50% (1.5188 => 1.6479, std.dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: 8.46% (8.4961 => 9.2149, std.dev.: 0.0177) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.43% (0.6135 => 0.6652, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.40% (0.3511 => 0.3806, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.33% (0.1789 => 0.1938, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 8.18% (0.2945 => 0.3186, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.15% (3.2742 => 3.5409, std.dev.: 0.0185) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.13% (0.8818 => 0.9535, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.06% (0.2321 => 0.2508, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.04% (0.2140 => 0.2312, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.02% (1.1333 => 1.2242, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/05-eks/eks: 8.00% (0.4113 => 0.4442, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.95% (0.4805 => 0.5187, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.94% (0.9108 => 0.9831, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 7.87% (4.6629 => 5.0298, std.dev.: 0.0041) MultiSource/Applications/lua/lua: 7.86% (3.7467 => 4.0411, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/parameter-passing: 7.82% (0.4003 => 0.4316, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 7.76% (0.6250 => 0.6735, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/neural/neural: 7.73% (0.1385 => 0.1492, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.66% (2.1007 => 2.2617, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 7.65% (6.5754 => 7.0784, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions: 7.54% (0.3914 => 0.4209, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.44% (0.3940 => 0.4233, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.36% (0.3789 => 0.4068, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.35% (0.2504 => 0.2688, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.30% (0.3245 => 0.3482, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 7.29% (0.3578 => 0.3839, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.29% (0.3650 => 0.3916, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 7.24% (0.3646 => 0.3910, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-2: 7.22% (0.3601 => 0.3861, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.21% (0.3663 => 0.3927, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 7.12% (0.2008 => 0.2151, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.09% (0.3623 => 0.3880, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.08% (6.2785 => 6.7232, std.dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: 6.76% (1.2292 => 1.3123, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.75% (13.2842 => 14.1811, std.dev.: 0.0161) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.16% (0.1819 => 0.1931, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.39% (0.2243 => 0.2364, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 5.18% (16.2614 => 17.1033, std.dev.: 0.0257) MultiSource/Applications/ClamAV/clamscan: 4.59% (14.5298 => 15.1973, std.dev.: 0.0082) MultiSource/Benchmarks/Bullet/bullet: 1.80% (33.2944 => 33.8945, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.43% (5.7573 => 7.5090, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 24.04% (1.8175 => 2.2544, std.dev.: 0.0138) SingleSource/Benchmarks/Misc/richards_benchmark: 11.17% (1.1560 => 1.2851, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.48% (3.1736 => 3.4109, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.32% (1.2998 => 1.3819, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0036, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.94% (11.2619 => 11.7056, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9850, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 3.31% (10.7476 => 11.1038, std.dev.: 0.0415) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.10% (7.4271 => 7.5827, std.dev.: 0.0086) MultiSource/Applications/lemon/lemon: 1.59% (1.4298 => 1.4525, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5128, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9676, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1870, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.15% (5.5130 => 5.5766, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0266, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5901, std.dev.: 0.0074) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.97% (0.2670 => 0.1416, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.80% (0.4657 => 0.3921, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -14.14% (0.0707 => 0.0607, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.14% (1.3813 => 1.1998, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.11% (1.3819 => 1.2007, std.dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.15% (0.2238 => 0.1966, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.93% (1.2308 => 1.0963, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.32% (20.3410 => 18.2424, std.dev.: 0.0279) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.57% (1.3780 => 1.2875, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.96% (0.9996 => 0.9600, std.dev.: 0.0057) MultiSource/Applications/siod/siod: -3.56% (3.2729 => 3.1565, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.48% (1.7688 => 1.7072, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.94% (0.4867 => 0.4724, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -2.63% (26.5159 => 25.8193, std.dev.: 0.0455) SingleSource/Regression/C/uint64_to_float: -2.55% (0.5449 => 0.5310, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.47% (3.0263 => 2.9514, std.dev.: 0.0015) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.29% (1.9762 => 1.9310, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.00% (0.6589 => 0.6457, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.91% (6.3560 => 6.2346, std.dev.: 0.0082) MultiSource/Benchmarks/mafft/pairlocalalign: -1.81% (28.2225 => 27.7130, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0070, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8622, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.25% (0.8342 => 0.8238, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.23% (6.6320 => 6.5504, std.dev.: 0.0181) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4948, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2566, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.09% (9.3358 => 9.2339, std.dev.: 0.0121) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 14 12:42:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 14 Oct 2012 14:42:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121014194256.8C8F02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4868?compare_to=4866&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4868, Order: 165908, Start Time: 2012-10-14 18:24:17, End Time: 2012-10-14 19:44:32 To: 4866, Order: 165907, Start Time: 2012-10-14 16:34:33, End Time: 2012-10-14 17:55:00 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (166 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 952 (679 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 6.02% (0.4285 => 0.4543, std.dev.: 0.0097) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.03% (0.5969 => 0.5971, std.dev.: 0.0062) MultiSource/Applications/SPASS/SPASS: -0.11% (16.5250 => 16.5073, std.dev.: 0.0134) MultiSource/Benchmarks/Bullet/bullet: 0.08% (55.7143 => 55.7603, std.dev.: 0.0296) MultiSource/Benchmarks/MallocBench/gs/gs: -0.40% (4.4833 => 4.4653, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0462 => 0.0462) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0463 => 0.0463) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0431 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0433 => 0.0433) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0421 => 0.0421) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.24% (0.0423 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.24% (0.0415 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0433 => 0.0433) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.23% (0.0434 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0427 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0429 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0416 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0419 => 0.0419) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.24% (0.0425 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0426 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.23% (0.0435 => 0.0436) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.37% (0.0458 => 0.0438, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.24% (0.0412 => 0.0413) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.24% (0.0414 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0424 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.23% (0.0426 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0416 => 0.0416, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.24% (0.0417 => 0.0418) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0407 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0409 => 0.0409, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0406 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0408 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.23% (0.0444 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0445 => 0.0445, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0406 => 0.0406) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0407 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0407 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.25% (0.0408 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0414 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0416 => 0.0416) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.04% (1.2632 => 1.2627, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.13% (7.9469 => 7.9574, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.12% (0.7443 => 0.7452, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0360 => 0.0360, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.30% (0.0667 => 0.0645, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.83% (63.2438 => 55.7603, std.dev.: 0.0296) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.55% (14.1553 => 19.0458, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++-EH/spirit: 65.57% (3.4629 => 5.7334, std.dev.: 0.0012) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14228.47% (0.0720 => 10.3165, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952600.00% (0.0001 => 9.9527, std.dev.: 0.0009) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 64.96% (0.2554 => 0.4213, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 44.71% (10.3673 => 15.0021, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/richards_benchmark: 40.75% (0.1622 => 0.2283, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 33.81% (0.1056 => 0.1413, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 18.51% (0.1432 => 0.1697, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.46% (7.0540 => 8.3565, std.dev.: 0.0106) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.69% (2.2022 => 2.5918, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.71% (0.1566 => 0.1812, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.93% (0.0730 => 0.0839, std.dev.: 0.0006) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.00% (0.1143 => 0.1303, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.79% (1.7609 => 2.0037, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.32% (0.0871 => 0.0987, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 13.22% (0.3282 => 0.3716, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/power/power: 12.78% (0.1440 => 0.1624, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 12.50% (0.1584 => 0.1782, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 11.85% (10.4361 => 11.6723, std.dev.: 0.0153) MultiSource/Applications/lambda-0_1_3/lambda: 11.33% (0.7433 => 0.8275, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.00% (0.2700 => 0.2997, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 10.91% (0.7115 => 0.7891, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.78% (0.4879 => 0.5405, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 10.78% (9.4845 => 10.5065, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.71% (0.1625 => 0.1799, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.70% (0.3543 => 0.3922, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.64% (0.1438 => 0.1591, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 10.55% (0.1175 => 0.1299, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.47% (0.6675 => 0.7374, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 10.39% (0.1655 => 0.1827, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 10.34% (0.3927 => 0.4333, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.23% (0.3177 => 0.3502, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: 10.19% (0.3473 => 0.3827, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.17% (1.5415 => 1.6982, std.dev.: 0.0084) MultiSource/Applications/d/make_dparser: 10.09% (3.3354 => 3.6719, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-4: 10.02% (0.3543 => 0.3898, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.01% (0.3516 => 0.3868, std.dev.: 0.0028) MultiSource/Applications/sgefa/sgefa: 9.97% (0.3109 => 0.3419, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 9.97% (0.1695 => 0.1864, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 9.96% (0.3423 => 0.3764, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-2: 9.95% (0.3497 => 0.3845, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.93% (0.3886 => 0.4272, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 9.92% (5.7591 => 6.3304, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/synchronized: 9.91% (0.3561 => 0.3914, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.87% (0.3828 => 0.4206, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.86% (0.4615 => 0.5070, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.79% (0.5105 => 0.5605, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.79% (0.1236 => 0.1357, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.77% (0.3694 => 0.4055, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 9.73% (0.1151 => 0.1263, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.59% (0.8067 => 0.8841, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.53% (4.2646 => 4.6712, std.dev.: 0.0068) MultiSource/Applications/Burg/burg: 9.51% (1.1642 => 1.2749, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.42% (0.5860 => 0.6412, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.38% (0.1940 => 0.2122, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 9.32% (3.8723 => 4.2332, std.dev.: 0.0252) MultiSource/Benchmarks/Olden/mst/mst: 9.29% (0.1163 => 0.1271, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.26% (5.0018 => 5.4651, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.24% (1.3050 => 1.4256, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.21% (0.2107 => 0.2301, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.21% (0.1510 => 0.1649, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 9.20% (0.1555 => 0.1698, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.16% (0.2271 => 0.2479, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.14% (0.5569 => 0.6078, std.dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.04% (0.3121 => 0.3403, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.02% (0.5020 => 0.5473, std.dev.: 0.0041) MultiSource/Applications/spiff/spiff: 9.02% (0.7835 => 0.8542, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.99% (0.2758 => 0.3006, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.99% (4.9449 => 5.3892, std.dev.: 0.0094) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.93% (0.8172 => 0.8902, std.dev.: 0.0064) MultiSource/Applications/lemon/lemon: 8.83% (1.0722 => 1.1669, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.83% (7.9617 => 8.6648, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.83% (0.1337 => 0.1455, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.82% (8.1363 => 8.8537, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.81% (0.9765 => 1.0625, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/bigfib: 8.80% (0.6456 => 0.7024, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 8.79% (1.5603 => 1.6975, std.dev.: 0.0081) MultiSource/Applications/treecc/treecc: 8.78% (2.0273 => 2.2052, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.73% (1.5859 => 1.7243, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 8.71% (0.3387 => 0.3682, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 8.69% (2.2969 => 2.4966, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.62% (0.2065 => 0.2243, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.62% (0.3307 => 0.3592, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 8.36% (0.3180 => 0.3446, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.17% (0.3441 => 0.3722, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.03% (1.1861 => 1.2813, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/health/health: 7.97% (0.1268 => 0.1369, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 7.96% (21.9371 => 23.6822, std.dev.: 0.0295) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.79% (2.2024 => 2.3740, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.73% (0.4103 => 0.4420, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 7.65% (0.4299 => 0.4628, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.57% (0.2603 => 0.2800, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.53% (0.6450 => 0.6936, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 7.43% (0.8921 => 0.9584, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.32% (0.3865 => 0.4148, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.32% (0.1695 => 0.1819, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 7.27% (0.4289 => 0.4601, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/lists: 7.22% (0.3422 => 0.3669, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 7.18% (0.1463 => 0.1568, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.16% (0.4203 => 0.4504, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.03% (0.3826 => 0.4095, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 6.93% (0.4620 => 0.4940) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.89% (1.4186 => 1.5163, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference-object: 6.88% (0.6030 => 0.6445, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.87% (0.5981 => 0.6392, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 6.87% (0.5925 => 0.6332, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.79% (0.3650 => 0.3898, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 6.67% (0.4048 => 0.4318, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.64% (0.4636 => 0.4944, std.dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 6.54% (1.1840 => 1.2614, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.54% (0.3136 => 0.3341, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.49% (0.2266 => 0.2413, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/sieve: 6.44% (0.3603 => 0.3835, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 6.32% (0.7326 => 0.7789, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists1: 6.27% (0.3684 => 0.3915, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.08% (0.1892 => 0.2007, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.01% (0.8101 => 0.8588, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 6.00% (0.2831 => 0.3001, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.98% (0.1906 => 0.2020, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 5.97% (0.3232 => 0.3425, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 5.96% (0.2905 => 0.3078, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.95% (0.3162 => 0.3350, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.88% (0.2891 => 0.3061, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.88% (2.0665 => 2.1880, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 5.67% (0.3283 => 0.3469, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.58% (0.3098 => 0.3271, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: 5.56% (0.2049 => 0.2163, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/except: 5.54% (0.2871 => 0.3030, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.53% (0.2877 => 0.3036, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 5.50% (0.2725 => 0.2875, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.50% (0.2872 => 0.3030, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.48% (0.2756 => 0.2907, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.44% (0.4064 => 0.4285, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.34% (0.3052 => 0.3215, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.27% (0.3379 => 0.3557, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.23% (0.2793 => 0.2939, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.19% (0.3427 => 0.3605, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.17% (0.2802 => 0.2947, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.12% (14.3668 => 15.1025, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hello: 5.08% (0.2714 => 0.2852, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 4.75% (17.1811 => 17.9975, std.dev.: 0.0241) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.57% (3.8922 => 4.0700, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.49% (0.2430 => 0.2539, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 4.41% (1.2842 => 1.3408, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/objinst: 4.34% (0.3131 => 0.3267, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.81% (1.1194 => 1.1620, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 3.62% (0.3092 => 0.3204, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.21% (1.1145 => 1.3843, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.38% (0.2944 => 0.3279, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: 9.76% (1.1396 => 1.2508, std.dev.: 0.0015) MultiSource/Applications/aha/aha: 9.18% (3.1595 => 3.4496, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 6.56% (3.1578 => 3.3649, std.dev.: 0.0090) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.4162 => 0.4322, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.74% (3.6395 => 3.7755, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.84% (4.2280 => 4.3480, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.33% (1.7254 => 1.7656, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.70% (0.8275 => 0.8416, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.35% (11.6436 => 11.8011, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.16% (2.6546 => 2.6853, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.09% (9.1159 => 9.2154, std.dev.: 0.0092) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.05% (6.5088 => 6.5774, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.03% (6.6874 => 0.1315, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.97% (5.2763 => 3.2730, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.09% (5.3855 => 3.7114, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.67% (5.3526 => 3.7109, std.dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -14.67% (54.1659 => 46.2204, std.dev.: 0.0332) MultiSource/Applications/ClamAV/clamscan: -11.97% (22.1758 => 19.5215, std.dev.: 0.0283) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.03% (2.9384 => 2.6437, std.dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.46% (1.1492 => 0.7647, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4243, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.53% (0.0998 => 0.0863, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.66% (1.2373 => 1.0930, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: -10.37% (1.5373 => 1.3779, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/mason/mason: -10.18% (0.2161 => 0.1941, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.24% (19.9488 => 18.3044, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.72% (1.8329 => 1.7097, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.30% (1.6805 => 1.5914, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.79% (1.5660 => 1.4910, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: -4.72% (1.5835 => 1.5088, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.21% (0.9957 => 0.9538, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Applications/siod/siod: -3.64% (3.2827 => 3.1632, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5068, std.dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: -2.99% (12.4730 => 12.1001, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.13% (8.1563 => 7.9824, std.dev.: 0.0204) SingleSource/Benchmarks/Misc/salsa20: -1.96% (10.2830 => 10.0817, std.dev.: 0.0088) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.91% (8.6802 => 8.5146, std.dev.: 0.0140) SingleSource/UnitTests/Vector/multiplies: -1.74% (2.5528 => 2.5084, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6835, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4205, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.05% (6.2999 => 6.2335, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8597, std.dev.: 0.0146) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 14.19% (0.5229 => 0.5971, std.dev.: 0.0062) MultiSource/Applications/SPASS/SPASS: 10.13% (14.9895 => 16.5073, std.dev.: 0.0134) MultiSource/Benchmarks/MallocBench/gs/gs: 8.63% (4.1105 => 4.4653, std.dev.: 0.0162) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.29% (1.1048 => 1.2627, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.16% (7.1582 => 7.9574, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.77% (0.6222 => 0.7452, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35900.00% (0.0001 => 0.0360, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.52% (0.2116 => 0.0645, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 14 12:53:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 14 Oct 2012 14:53:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121014195321.E7D8D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4869?compare_to=4867&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4869, Order: 165908, Start Time: 2012-10-14 18:29:53, End Time: 2012-10-14 19:55:39 To: 4867, Order: 165907, Start Time: 2012-10-14 16:35:09, End Time: 2012-10-14 18:00:50 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (188 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1042 (675 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.57% (2.0176 => 2.4931, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.65% (0.1410 => 0.1673, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 17.12% (0.2243 => 0.2627, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 17.07% (0.0826 => 0.0967, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.00% (0.0653 => 0.0764, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.21% (0.1072 => 0.1235, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.69% (0.1327 => 0.1522, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 14.22% (0.1013 => 0.1157, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.79% (0.0834 => 0.0949) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.38% (0.1413 => 0.1602, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 13.21% (0.7038 => 0.7968, std.dev.: 0.0018) MultiSource/Applications/hbd/hbd: 12.96% (1.3693 => 1.5468, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.86% (0.0964 => 0.1088, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.68% (3.9660 => 4.4688, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.66% (0.1588 => 0.1789, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.56% (0.2596 => 0.2922, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.42% (0.2721 => 0.3059, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.32% (0.7710 => 0.8660, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 12.19% (13.8202 => 15.5054, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.14% (0.5265 => 0.5904, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.13% (0.6959 => 0.7803, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/power/power: 12.06% (0.1003 => 0.1124, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.03% (1.4563 => 1.6315, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.00% (0.6283 => 0.7037, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.99% (0.9199 => 1.0302, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 11.95% (0.4328 => 0.4845, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 11.92% (0.4062 => 0.4546, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.88% (1.2193 => 1.3641, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 11.86% (0.1062 => 0.1188, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 11.68% (0.0976 => 0.1090, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.45% (1.1364 => 1.2665, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 11.43% (0.5818 => 0.6483, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 11.28% (1.0313 => 1.1476, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.24% (0.1157 => 0.1287, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.05% (0.3899 => 0.4330, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.94% (0.5577 => 0.6187, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.93% (0.3130 => 0.3472, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 10.92% (1.1061 => 1.2269, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.87% (0.4791 => 0.5312, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.79% (0.1075 => 0.1191, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 10.79% (0.5748 => 0.6368, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.72% (0.3022 => 0.3346, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 10.66% (16.6129 => 18.3838, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.64% (0.3580 => 0.3961, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.54% (0.0977 => 0.1080, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 10.51% (0.1589 => 0.1756, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 10.48% (0.6744 => 0.7451, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 10.48% (3.8646 => 4.2696, std.dev.: 0.0070) SingleSource/UnitTests/ObjC++/property-reference: 10.44% (0.7061 => 0.7798, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 10.42% (2.1791 => 2.4061, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.42% (0.3485 => 0.3848, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.41% (0.4379 => 0.4835, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 10.38% (0.2995 => 0.3306, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.38% (0.3246 => 0.3583, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.30% (0.2914 => 0.3214, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.29% (0.1865 => 0.2057, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 10.29% (1.9270 => 2.1252, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.28% (0.4016 => 0.4429, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 10.28% (0.3220 => 0.3551, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 10.26% (0.1111 => 0.1225, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.25% (0.3756 => 0.4141, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.20% (0.2127 => 0.2344, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.17% (0.3489 => 0.3844, std.dev.: 0.0056) MultiSource/Applications/d/make_dparser: 10.17% (3.1889 => 3.5132, std.dev.: 0.0070) MultiSource/Applications/viterbi/viterbi: 10.15% (0.1478 => 0.1628, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.15% (0.7460 => 0.8217, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 10.14% (0.2781 => 0.3063, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.14% (4.9865 => 5.4921, std.dev.: 0.0023) MultiSource/Applications/spiff/spiff: 10.11% (0.7506 => 0.8265, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.06% (0.1014 => 0.1116, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 10.02% (0.3293 => 0.3623, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.02% (0.1986 => 0.2185, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.97% (0.5637 => 0.6199, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.93% (0.8698 => 0.9562, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 9.93% (0.8310 => 0.9135, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 9.88% (0.2925 => 0.3214, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.88% (0.1569 => 0.1724, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.76% (0.1435 => 0.1575, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.74% (0.2966 => 0.3255, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 9.72% (0.3868 => 0.4244, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.72% (0.1276 => 0.1400, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.67% (0.2782 => 0.3051, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 9.64% (0.3453 => 0.3786, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.64% (0.2023 => 0.2218, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.58% (7.2180 => 7.9098, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/strcat: 9.57% (0.2726 => 0.2987, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.52% (0.4390 => 0.4808, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 9.43% (0.3149 => 0.3446, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 9.40% (0.3107 => 0.3399, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.40% (1.9828 => 2.1691, std.dev.: 0.0109) MultiSource/Benchmarks/nbench/nbench: 9.39% (1.0594 => 1.1589, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 9.31% (0.2760 => 0.3017, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.30% (0.2655 => 0.2902, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 9.28% (0.3534 => 0.3862, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 9.26% (0.2690 => 0.2939, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 9.23% (0.1657 => 0.1810, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.17% (1.3245 => 1.4460, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 9.17% (0.2607 => 0.2846, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 9.16% (0.2761 => 0.3014, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 9.12% (0.3192 => 0.3483, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 9.09% (0.2628 => 0.2867, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 9.06% (0.2937 => 0.3203, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 9.01% (1.2749 => 1.3898, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.01% (0.2765 => 0.3014, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.94% (0.2696 => 0.2937, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 8.91% (0.3131 => 0.3410, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 8.80% (0.2988 => 0.3251, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.78% (3.6692 => 3.9915, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.77% (4.3801 => 4.7642, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.75% (4.4433 => 4.8322, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.71% (0.6576 => 0.7149, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.71% (0.3755 => 0.4082, std.dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 8.67% (14.8535 => 16.1418, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.57% (0.2321 => 0.2520, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.51% (0.6135 => 0.6657, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 8.39% (8.4961 => 9.2092, std.dev.: 0.0170) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.39% (1.5188 => 1.6462, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.38% (0.1789 => 0.1939, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.37% (0.3511 => 0.3805, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.13% (0.8818 => 0.9535, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 8.12% (0.2945 => 0.3184, std.dev.: 0.0074) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.08% (0.2140 => 0.2313, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 8.07% (0.4113 => 0.4445, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.00% (0.9108 => 0.9837, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.95% (1.1333 => 1.2234, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.94% (3.2742 => 3.5342, std.dev.: 0.0031) MultiSource/Applications/lua/lua: 7.90% (3.7467 => 4.0427, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/parameter-passing: 7.87% (0.4003 => 0.4318, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.87% (0.4805 => 0.5183, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 7.85% (4.6629 => 5.0289, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/bigfib: 7.84% (0.6250 => 0.6740, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 7.73% (0.1385 => 0.1492, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 7.65% (6.5754 => 7.0782, std.dev.: 0.0201) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.61% (2.1007 => 2.2605, std.dev.: 0.0065) SingleSource/UnitTests/ObjC/exceptions: 7.54% (0.3914 => 0.4209, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.44% (0.3940 => 0.4233, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.39% (0.2504 => 0.2689, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 7.35% (0.3646 => 0.3914, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.33% (0.3245 => 0.3483, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.32% (0.3578 => 0.3840, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.28% (0.3789 => 0.4065, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.23% (0.3663 => 0.3928, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 7.17% (0.2008 => 0.2152, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 7.16% (0.3601 => 0.3859, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.12% (0.3650 => 0.3910, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.11% (6.2785 => 6.7249, std.dev.: 0.0118) SingleSource/UnitTests/ObjC/exceptions-3: 7.04% (0.3623 => 0.3878, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 6.79% (1.2292 => 1.3127, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.77% (13.2842 => 14.1833, std.dev.: 0.0133) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.49% (0.1819 => 0.1937, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.53% (0.2243 => 0.2367, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 5.11% (16.2614 => 17.0931, std.dev.: 0.0085) MultiSource/Applications/ClamAV/clamscan: 4.55% (14.5298 => 15.1904, std.dev.: 0.0097) MultiSource/Benchmarks/Bullet/bullet: 1.82% (33.2944 => 33.8997, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5172, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.60% (1.8175 => 2.2646, std.dev.: 0.0265) SingleSource/Benchmarks/Misc/richards_benchmark: 11.06% (1.1560 => 1.2839, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 8.99% (0.8273 => 0.9017, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.61% (3.1736 => 3.4150, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.26% (1.2998 => 1.3812, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0046, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 3.92% (11.2619 => 11.7038, std.dev.: 0.0072) MultiSource/Applications/SPASS/SPASS: 3.26% (10.7476 => 11.0977, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/flops-6: 3.24% (1.9199 => 1.9821, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: 2.25% (7.4271 => 7.5945, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.81% (1.4298 => 1.4557, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5137, std.dev.: 0.0082) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1882, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5782, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 1.11% (12.4560 => 12.5941, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0269, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.05% (8.8259 => 8.9186, std.dev.: 0.0056) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.59% (0.2670 => 0.1426, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.76% (0.4657 => 0.3923, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/mason/mason: -14.14% (0.0707 => 0.0607, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.11% (1.3819 => 1.2007, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.95% (1.3813 => 1.2024, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.64% (0.0997 => 0.0861, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.06% (0.2238 => 0.1968, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.93% (1.2308 => 1.0963, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.16% (20.3410 => 18.2734, std.dev.: 0.0240) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.63% (1.3780 => 1.3004, std.dev.: 0.0268) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0008) SingleSource/UnitTests/Vector/multiplies: -5.07% (2.6470 => 2.5128, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8004, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.22% (0.9996 => 0.9574, std.dev.: 0.0035) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1562, std.dev.: 0.0121) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.51% (1.7688 => 1.7067, std.dev.: 0.0050) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.58% (26.5159 => 25.8306, std.dev.: 0.0155) SingleSource/Regression/C/uint64_to_float: -2.53% (0.5449 => 0.5311, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.45% (3.0263 => 2.9523, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.36% (1.9762 => 1.9295, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.09% (0.6589 => 0.6451, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7150, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/lists: -1.66% (6.3560 => 6.2502, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0074, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8648, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.25% (0.8342 => 0.8238, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4955, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: -1.09% (9.3358 => 9.2337, std.dev.: 0.0364) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2587, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.02% (6.6320 => 6.5644, std.dev.: 0.0058) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 14 14:32:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 14 Oct 2012 16:32:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121014213234.4BA472A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4870?compare_to=4868&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4870, Order: 165910, Start Time: 2012-10-14 20:14:14, End Time: 2012-10-14 21:34:27 To: 4868, Order: 165908, Start Time: 2012-10-14 18:24:17, End Time: 2012-10-14 19:44:32 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (168 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 952 (678 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.66% (1.2901 => 1.3115, std.dev.: 0.0075) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.12% (0.5971 => 0.5978) MultiSource/Applications/SPASS/SPASS: 0.27% (16.5073 => 16.5524, std.dev.: 0.0134) MultiSource/Benchmarks/Bullet/bullet: 0.31% (55.7603 => 55.9321, std.dev.: 0.0288) MultiSource/Benchmarks/MallocBench/gs/gs: 0.30% (4.4653 => 4.4787, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.22% (0.0462 => 0.0463, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.43% (0.0463 => 0.0465, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.23% (0.0431 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.23% (0.0433 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.24% (0.0421 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.47% (0.0422 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.48% (0.0414 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.24% (0.0417 => 0.0418, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.23% (0.0433 => 0.0434) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.23% (0.0435 => 0.0436) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.47% (0.0427 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.23% (0.0429 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.48% (0.0416 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.24% (0.0419 => 0.0420, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.24% (0.0424 => 0.0425, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.23% (0.0426 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.23% (0.0436 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.23% (0.0438 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.24% (0.0413 => 0.0414) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.24% (0.0413 => 0.0414, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.47% (0.0424 => 0.0426) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.47% (0.0425 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.24% (0.0416 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0418 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.49% (0.0407 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.24% (0.0409 => 0.0410, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.25% (0.0406 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.25% (0.0408 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.45% (0.0443 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.22% (0.0445 => 0.0446, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0406 => 0.0406, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.25% (0.0407 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.25% (0.0407 => 0.0408) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.49% (0.0407 => 0.0409, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.48% (0.0414 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0416 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.42% (1.2627 => 1.2680, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.19% (7.9574 => 7.9728, std.dev.: 0.0155) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.38% (0.7452 => 0.7480, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.56% (0.0360 => 0.0358, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.79% (0.0645 => 0.0663, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.56% (63.2438 => 55.9321, std.dev.: 0.0288) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 35.00% (14.1553 => 19.1102, std.dev.: 0.0258) SingleSource/Benchmarks/Misc-C++-EH/spirit: 65.89% (3.4629 => 5.7445, std.dev.: 0.0042) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14223.33% (0.0720 => 10.3128, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952100.00% (0.0001 => 9.9522, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 65.82% (0.2554 => 0.4235, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 44.81% (10.3673 => 15.0127, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/richards_benchmark: 39.83% (0.1622 => 0.2268, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 34.09% (0.1056 => 0.1416) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.97% (7.0540 => 8.3918, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 18.72% (0.1432 => 0.1700) MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.42% (2.2022 => 2.6078, std.dev.: 0.0070) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.09% (0.1566 => 0.1818, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.53% (1.7609 => 2.0168, std.dev.: 0.0012) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.26% (0.1143 => 0.1306, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 13.92% (0.3282 => 0.3739, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.91% (0.0798 => 0.0909, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.55% (0.0871 => 0.0989, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 13.33% (0.1440 => 0.1632, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 12.44% (0.1584 => 0.1781, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 12.22% (10.4361 => 11.7116, std.dev.: 0.0116) MultiSource/Applications/lambda-0_1_3/lambda: 11.72% (0.7433 => 0.8304, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.47% (0.1438 => 0.1603, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.37% (0.3543 => 0.3946, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 11.24% (0.1655 => 0.1841, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.19% (0.4879 => 0.5425, std.dev.: 0.0021) MultiSource/Applications/minisat/minisat: 11.19% (0.7115 => 0.7911, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.14% (0.1625 => 0.1806, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.10% (0.3927 => 0.4363, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.96% (0.2700 => 0.2996, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.91% (0.3473 => 0.3852, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.89% (0.6675 => 0.7402, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 10.88% (9.4845 => 10.5162, std.dev.: 0.0144) SingleSource/UnitTests/ObjC/exceptions-2: 10.87% (0.3497 => 0.3877, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/exceptions-4: 10.78% (0.3543 => 0.3925, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 10.76% (0.3561 => 0.3944, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.73% (0.3886 => 0.4303, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.69% (0.3516 => 0.3892, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 10.64% (0.1175 => 0.1300, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.61% (0.3177 => 0.3514, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 10.61% (0.3828 => 0.4234, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.58% (0.3694 => 0.4085, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.51% (1.5415 => 1.7035, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 10.50% (0.1695 => 0.1873, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 10.42% (0.3109 => 0.3433, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 10.36% (3.3354 => 3.6811, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.29% (0.5860 => 0.6463, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.28% (0.1236 => 0.1363, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.27% (0.4615 => 0.5089, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 10.22% (0.3423 => 0.3773, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.13% (0.5105 => 0.5622, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 9.99% (0.1151 => 0.1266, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.95% (0.1940 => 0.2133, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 9.85% (5.7591 => 6.3262, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.83% (4.2646 => 4.6838, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 9.82% (1.1642 => 1.2785, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.81% (0.8067 => 0.8858, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.80% (0.8172 => 0.8973, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 9.79% (0.1032 => 0.1133, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.69% (5.0018 => 5.4864, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.68% (1.3050 => 1.4313, std.dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.64% (0.3121 => 0.3422, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 9.64% (3.8723 => 4.2454, std.dev.: 0.0089) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.60% (0.1510 => 0.1655, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.59% (0.5569 => 0.6103, std.dev.: 0.0019) MultiSource/Applications/viterbi/viterbi: 9.58% (0.1555 => 0.1704, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 9.54% (0.1163 => 0.1274, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.49% (0.2107 => 0.2307, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 9.49% (2.0273 => 2.2196, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.47% (0.2271 => 0.2486, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.42% (4.9449 => 5.4109, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.39% (0.2758 => 0.3017, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.35% (0.2065 => 0.2258, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 9.32% (0.6456 => 0.7058, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 9.30% (1.5603 => 1.7054, std.dev.: 0.0023) MultiSource/Applications/spiff/spiff: 9.29% (0.7835 => 0.8563, std.dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.26% (7.9617 => 8.6988, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.22% (0.3307 => 0.3612, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.22% (0.1117 => 0.1220) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.22% (8.1363 => 8.8864, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.12% (0.1337 => 0.1459, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.12% (0.5020 => 0.5478, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.10% (0.9765 => 1.0654, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 9.03% (1.0722 => 1.1690, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 8.98% (2.2969 => 2.5032, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.95% (1.5859 => 1.7278, std.dev.: 0.0064) MultiSource/Benchmarks/sim/sim: 8.80% (0.3387 => 0.3685, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 8.74% (0.3180 => 0.3458, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.51% (0.4103 => 0.4452, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 8.44% (0.1268 => 0.1375, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.40% (0.3441 => 0.3730, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 8.28% (0.4299 => 0.4655, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/Puzzle: 8.20% (0.1268 => 0.1372, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.19% (1.1861 => 1.2833, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.19% (0.6030 => 0.6524, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 8.18% (21.9371 => 23.7307, std.dev.: 0.0257) SingleSource/UnitTests/ObjC++/Hello: 8.12% (0.5925 => 0.6406, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.05% (0.3865 => 0.4176, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 8.02% (0.4289 => 0.4633, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.00% (2.2024 => 2.3787, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.91% (0.6450 => 0.6960, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.87% (0.4636 => 0.5001, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.80% (0.4203 => 0.4531, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.80% (0.2603 => 0.2806, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 7.77% (0.3422 => 0.3688, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 7.68% (0.8921 => 0.9606, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 7.64% (0.4620 => 0.4973, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/neural/neural: 7.59% (0.1463 => 0.1574, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.58% (0.3826 => 0.4116, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.51% (0.7326 => 0.7876, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/moments: 7.46% (0.4048 => 0.4350, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.37% (0.1695 => 0.1820, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.34% (0.3650 => 0.3918, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.26% (1.4186 => 1.5216, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.24% (0.5981 => 0.6414, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 7.16% (0.3603 => 0.3861, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.02% (0.3136 => 0.3356, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 7.00% (0.3684 => 0.3942, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.93% (1.1840 => 1.2660, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 6.88% (0.2905 => 0.3105, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.83% (0.3162 => 0.3378, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.80% (0.2266 => 0.2420, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.77% (2.0665 => 2.2065, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 6.75% (0.2831 => 0.3022, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.75% (0.2891 => 0.3086, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.71% (0.3232 => 0.3449, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.71% (0.2756 => 0.2941, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.61% (0.1906 => 0.2032, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.61% (0.3283 => 0.3500, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.52% (0.3098 => 0.3300, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.41% (0.2871 => 0.3055, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.37% (0.2872 => 0.3055) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.30% (0.8101 => 0.8611, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/fibo: 6.28% (0.2725 => 0.2896, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 6.26% (0.3052 => 0.3243, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.21% (0.3379 => 0.3589, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.19% (0.2793 => 0.2966, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 6.19% (0.2877 => 0.3055, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.15% (0.4064 => 0.4314, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/random: 6.03% (0.2802 => 0.2971, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.03% (0.1892 => 0.2006, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 5.81% (0.2049 => 0.2168, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.31% (0.3427 => 0.3609, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.15% (14.3668 => 15.1070, std.dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/objinst: 5.05% (0.3131 => 0.3289, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 5.04% (1.2842 => 1.3489, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 4.88% (17.1811 => 18.0201, std.dev.: 0.0166) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.86% (0.2430 => 0.2548, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.84% (3.8922 => 4.0806, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 4.27% (1.1194 => 1.1672, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: 3.72% (0.3092 => 0.3207, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.27% (0.3817 => 0.3942, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.27% (1.1145 => 1.3850, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.71% (2.6778 => 2.9647, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.85% (1.1396 => 1.2519, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4499, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3680, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.4162 => 0.4322, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.51% (3.6395 => 3.7674, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.78% (4.2280 => 4.3457, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.28% (1.7254 => 1.7648, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.72% (0.8275 => 0.8417, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.35% (11.6436 => 11.8007, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.12% (2.6546 => 2.6843, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5755, std.dev.: 0.0116) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.99% (6.6874 => 0.1345, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -79.92% (0.8651 => 0.1737, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.75% (5.2763 => 3.2844, std.dev.: 0.0095) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.58% (5.3855 => 3.7386, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.10% (5.3526 => 3.7414, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -14.58% (54.1659 => 46.2679, std.dev.: 0.0234) MultiSource/Applications/ClamAV/clamscan: -11.74% (22.1758 => 19.5714, std.dev.: 0.0242) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -9.95% (2.9384 => 2.6460, std.dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.39% (1.1492 => 0.7655, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.96% (1.6925 => 1.4224, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.53% (0.0998 => 0.0863, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.44% (1.2373 => 1.0957, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel-2: -10.37% (1.5373 => 1.3779, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/mason/mason: -10.09% (0.2161 => 0.1943, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.42% (19.9488 => 18.2691, std.dev.: 0.0168) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.75% (1.8329 => 1.7092, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.31% (1.6805 => 1.5912, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5074, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.32% (0.9957 => 0.9527, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.67% (3.2827 => 3.1621, std.dev.: 0.0050) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5093, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: -2.99% (12.4730 => 12.0996, std.dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.98% (8.1563 => 7.9946, std.dev.: 0.0156) SingleSource/Benchmarks/Misc/salsa20: -1.98% (10.2830 => 10.0794, std.dev.: 0.0317) SingleSource/Regression/C/uint64_to_float: -1.88% (0.5413 => 0.5311) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.84% (8.6802 => 8.5204, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6804, std.dev.: 0.0019) SingleSource/UnitTests/Vector/multiplies: -1.68% (2.5528 => 2.5098, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4209, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 14.32% (0.5229 => 0.5978) MultiSource/Applications/SPASS/SPASS: 10.43% (14.9895 => 16.5524, std.dev.: 0.0134) MultiSource/Benchmarks/MallocBench/gs/gs: 8.96% (4.1105 => 4.4787, std.dev.: 0.0158) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.77% (1.1048 => 1.2680, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.38% (7.1582 => 7.9728, std.dev.: 0.0155) SingleSource/Benchmarks/Misc-C++/stepanov_container: 20.22% (0.6222 => 0.7480, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35700.00% (0.0001 => 0.0358, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.67% (0.2116 => 0.0663, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 14 14:48:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 14 Oct 2012 16:48:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121014214817.D669F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4871?compare_to=4869&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4871, Order: 165910, Start Time: 2012-10-14 20:25:18, End Time: 2012-10-14 21:51:11 To: 4869, Order: 165908, Start Time: 2012-10-14 18:29:53, End Time: 2012-10-14 19:55:39 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (187 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1041 (677 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.09% (80.4934 => 81.3718, std.dev.: 0.1751) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.62% (2.0176 => 2.4941, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.65% (0.1410 => 0.1673, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.15% (0.0653 => 0.0765, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 17.07% (0.0826 => 0.0967, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 16.81% (0.2243 => 0.2620, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.21% (0.1072 => 0.1235, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.85% (0.1327 => 0.1524, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 14.31% (0.1013 => 0.1158, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.91% (0.0834 => 0.0950, std.dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 13.50% (0.7038 => 0.7988, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.38% (0.1413 => 0.1602, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 13.36% (1.3693 => 1.5522, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.33% (0.2596 => 0.2942, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 12.85% (0.4328 => 0.4884, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.76% (3.9660 => 4.4722, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.76% (0.0964 => 0.1087, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.59% (0.1588 => 0.1788, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.58% (0.0819 => 0.0922, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 12.43% (0.4062 => 0.4567, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.39% (0.6959 => 0.7821, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 12.34% (0.5818 => 0.6536, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.31% (0.2721 => 0.3056, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.31% (0.5265 => 0.5913, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 12.22% (13.8202 => 15.5093, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.16% (0.9199 => 1.0318, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.13% (0.3899 => 0.4372, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.11% (0.7710 => 0.8644, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.08% (0.6283 => 0.7042, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 12.08% (0.3022 => 0.3387, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.06% (1.4563 => 1.6320, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 12.05% (0.1062 => 0.1190, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 12.02% (0.5748 => 0.6439, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.98% (1.2193 => 1.3654, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 11.86% (0.1003 => 0.1122, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.56% (1.1364 => 1.2678, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 11.53% (0.7061 => 0.7875, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.51% (0.3485 => 0.3886, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.34% (0.3580 => 0.3986, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 11.33% (0.2781 => 0.3096, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.32% (0.1157 => 0.1288, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.30% (0.4016 => 0.4470, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 11.30% (1.0313 => 1.1478, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.21% (0.3756 => 0.4177, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.15% (0.2914 => 0.3239, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.12% (0.5577 => 0.6197, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/lists: 11.11% (0.3293 => 0.3659, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.05% (0.3130 => 0.3476, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.92% (0.3489 => 0.3870, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.92% (0.4791 => 0.5314, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 10.89% (1.1061 => 1.2266, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.89% (0.2782 => 0.3085, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 10.89% (0.3453 => 0.3829, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.88% (0.1075 => 0.1192, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.79% (0.2966 => 0.3286, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 10.79% (0.2726 => 0.3020, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 10.77% (16.6129 => 18.4028, std.dev.: 0.0110) MultiSource/Applications/minisat/minisat: 10.72% (0.6744 => 0.7467, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: 10.70% (0.3868 => 0.4282, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 10.65% (0.3107 => 0.3438, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.65% (1.9828 => 2.1940, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/ary3: 10.61% (0.3149 => 0.3483, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.58% (0.2655 => 0.2936, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 10.58% (0.2760 => 0.3052, std.dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.55% (0.4379 => 0.4841, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 10.55% (0.2607 => 0.2882, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 10.53% (0.3534 => 0.3906, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.49% (0.8698 => 0.9610, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 10.45% (0.2937 => 0.3244, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.44% (0.0977 => 0.1079, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 10.40% (0.3220 => 0.3555, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.39% (0.2127 => 0.2348, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.39% (0.4390 => 0.4846, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 10.37% (3.8646 => 4.2652, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.36% (4.9865 => 5.5030, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/mst/mst: 10.35% (0.1111 => 0.1226, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.34% (0.2765 => 0.3051, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 10.33% (0.2690 => 0.2968, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 10.32% (0.1589 => 0.1753, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 10.32% (0.2995 => 0.3304, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 10.29% (0.2761 => 0.3045, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 10.27% (2.1791 => 2.4030, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 10.27% (0.2628 => 0.2898, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.27% (0.1986 => 0.2190, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 10.24% (0.3192 => 0.3519, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.24% (0.1865 => 0.2056, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.23% (0.3246 => 0.3578, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 10.22% (0.1478 => 0.1629, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 10.19% (0.7506 => 0.8271, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 10.17% (3.1889 => 3.5131, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.16% (0.1014 => 0.1117, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.11% (0.1276 => 0.1405, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 10.11% (1.9270 => 2.1218, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.11% (0.7460 => 0.8214, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.07% (0.1569 => 0.1727, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 10.02% (0.2925 => 0.3218, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.01% (0.2696 => 0.2966, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.95% (0.5637 => 0.6198, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 9.94% (0.8310 => 0.9136, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 9.87% (0.2988 => 0.3283, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.74% (0.2023 => 0.2220, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.69% (0.1435 => 0.1574, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.62% (7.2180 => 7.9124, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.51% (0.3755 => 0.4112, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 9.42% (1.0594 => 1.1592, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 9.41% (0.2945 => 0.3222, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 9.35% (0.1657 => 0.1812, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.14% (1.3245 => 1.4456, std.dev.: 0.0037) MultiSource/Benchmarks/sim/sim: 9.01% (0.3131 => 0.3413, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 8.94% (1.2749 => 1.3889, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.90% (3.6692 => 3.9956, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.80% (4.3801 => 4.7657, std.dev.: 0.0070) MultiSource/Applications/JM/lencod/lencod: 8.74% (14.8535 => 16.1516, std.dev.: 0.0174) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.74% (4.4433 => 4.8316, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.73% (0.6576 => 0.7150, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.62% (0.6135 => 0.6664, std.dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: 8.47% (8.4961 => 9.2155, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/bigfib: 8.42% (0.6250 => 0.6776, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.41% (1.5188 => 1.6466, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.40% (0.3511 => 0.3806, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.36% (0.2321 => 0.2515, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.23% (0.8818 => 0.9544, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.22% (0.1789 => 0.1936, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.19% (0.4003 => 0.4331, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.18% (0.2140 => 0.2315, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.05% (1.1333 => 1.2245, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 8.04% (4.6629 => 5.0377, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.01% (3.2742 => 3.5366, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/05-eks/eks: 8.00% (0.4113 => 0.4442, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.99% (0.4805 => 0.5189, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.97% (0.3914 => 0.4226, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.94% (0.3578 => 0.3862, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.93% (0.9108 => 0.9830, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 7.87% (0.3646 => 0.3933, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 7.84% (0.3940 => 0.4249, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 7.80% (3.7467 => 4.0389, std.dev.: 0.0107) SingleSource/UnitTests/ObjC/for-in: 7.79% (0.3789 => 0.4084, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.73% (0.3663 => 0.3946, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 7.72% (6.5754 => 7.0833, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-2: 7.72% (0.3601 => 0.3879, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.70% (0.3245 => 0.3495, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 7.67% (1.2292 => 1.3235, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.66% (2.1007 => 2.2616, std.dev.: 0.0149) MultiSource/Benchmarks/FreeBench/neural/neural: 7.65% (0.1385 => 0.1491, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.62% (0.3623 => 0.3899, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.59% (0.3650 => 0.3927, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.39% (0.2504 => 0.2689, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 7.22% (0.2008 => 0.2153, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.16% (6.2785 => 6.7278, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.83% (13.2842 => 14.1916, std.dev.: 0.0096) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.38% (0.1819 => 0.1935, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.44% (0.2243 => 0.2365, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 5.20% (16.2614 => 17.1073, std.dev.: 0.0143) MultiSource/Applications/ClamAV/clamscan: 4.64% (14.5298 => 15.2040, std.dev.: 0.0076) MultiSource/Benchmarks/Bullet/bullet: 2.25% (33.2944 => 34.0450, std.dev.: 0.0200) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5155, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/fbench: 25.43% (1.8175 => 2.2797, std.dev.: 0.0435) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/richards_benchmark: 11.21% (1.1560 => 1.2856, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4144, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.24% (1.2998 => 1.3809, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9998, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0049, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.92% (11.2619 => 11.7038, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9851, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 3.27% (10.7476 => 11.0991, std.dev.: 0.0211) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.24% (7.4271 => 7.5935, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4532, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5142, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.25% (9.0760 => 9.1890, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5783, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0273, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5885, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.97% (0.2670 => 0.1416, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.40% (0.4657 => 0.3940, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -14.14% (0.0707 => 0.0607, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.12% (1.3813 => 1.2001, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.08% (1.3819 => 1.2012, std.dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.15% (0.2238 => 0.1966, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: -10.95% (1.2308 => 1.0960, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.13% (20.3410 => 18.2799, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-3: -6.27% (2.4152 => 2.2638, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.17% (1.3780 => 1.3068, std.dev.: 0.0134) SingleSource/UnitTests/Vector/multiplies: -5.09% (2.6470 => 2.5122, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.25% (0.9996 => 0.9571, std.dev.: 0.0044) MultiSource/Applications/siod/siod: -3.55% (3.2729 => 3.1566, std.dev.: 0.0229) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.48% (1.7688 => 1.7072, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.96% (0.4867 => 0.4723, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -2.54% (26.5159 => 25.8411, std.dev.: 0.0262) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: -2.53% (0.5449 => 0.5311, std.dev.: 0.0030) MultiSource/Applications/spiff/spiff: -2.51% (3.0263 => 2.9504, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: -2.38% (1.9762 => 1.9292, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -1.79% (28.2225 => 27.7162, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/lists: -1.72% (6.3560 => 6.2464, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0062, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/heapsort: -1.30% (3.9173 => 3.8664, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.21% (0.8342 => 0.8241, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4950, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2576, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: -1.11% (9.3358 => 9.2322, std.dev.: 0.0296) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 14 16:22:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 14 Oct 2012 18:22:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121014232201.56F9B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4872?compare_to=4870&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4872, Order: 165911, Start Time: 2012-10-14 22:03:55, End Time: 2012-10-14 23:23:53 To: 4870, Order: 165910, Start Time: 2012-10-14 20:14:14, End Time: 2012-10-14 21:34:27 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (168 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 951 (677 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.42% (55.1202 => 56.4519, std.dev.: 0.0918) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.46% (78.8951 => 80.0460, std.dev.: 0.1789) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.13% (0.5978 => 0.5970, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: -0.09% (16.5524 => 16.5368, std.dev.: 0.0175) MultiSource/Benchmarks/Bullet/bullet: -0.37% (55.9321 => 55.7230, std.dev.: 0.0146) MultiSource/Benchmarks/MallocBench/gs/gs: -0.12% (4.4787 => 4.4732, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0463 => 0.0463, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0465 => 0.0465, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.23% (0.0432 => 0.0433) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0434 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0422 => 0.0422, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0424 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0416 => 0.0416) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0418 => 0.0418) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0434 => 0.0434, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0436 => 0.0436) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.23% (0.0429 => 0.0430, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0430 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.24% (0.0418 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0420 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.24% (0.0425 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0427 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0437 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.23% (0.0439 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.24% (0.0414 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.24% (0.0414 => 0.0415) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.23% (0.0426 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.23% (0.0427 => 0.0426, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0417 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0418 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0409 => 0.0409) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0410 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0407 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0409 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0445 => 0.0445, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0446 => 0.0446, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0406 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0408 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0408 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0409 => 0.0409, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.24% (0.0416 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.24% (0.0416 => 0.0417, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.24% (1.2680 => 1.2649, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.19% (7.9728 => 7.9580, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.19% (0.7480 => 0.7466, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.28% (0.0358 => 0.0357, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.71% (0.0663 => 0.0645, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.89% (63.2438 => 55.7230, std.dev.: 0.0146) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.77% (14.1553 => 19.0777, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++-EH/spirit: 65.78% (3.4629 => 5.7407, std.dev.: 0.0059) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14225.28% (0.0720 => 10.3142, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952400.00% (0.0001 => 9.9525, std.dev.: 0.0012) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 65.54% (0.2554 => 0.4228, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 44.65% (10.3673 => 14.9964, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/richards_benchmark: 39.52% (0.1622 => 0.2263, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/distray/distray: 33.90% (0.1056 => 0.1414, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 18.58% (0.1432 => 0.1698, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.47% (7.0540 => 8.3568, std.dev.: 0.0092) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.96% (2.2022 => 2.5977, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.03% (0.1566 => 0.1817, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.08% (1.7609 => 2.0089, std.dev.: 0.0011) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.00% (0.1143 => 0.1303, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 13.74% (0.3282 => 0.3733, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.55% (0.0871 => 0.0989, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 13.06% (0.1440 => 0.1628, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 12.56% (0.1584 => 0.1783, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 12.14% (10.4361 => 11.7031, std.dev.: 0.0053) MultiSource/Applications/lambda-0_1_3/lambda: 11.56% (0.7433 => 0.8292, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 11.13% (0.7115 => 0.7907, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.13% (0.1438 => 0.1598, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.05% (0.4879 => 0.5418, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.95% (0.1625 => 0.1803, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.92% (0.3543 => 0.3930, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.89% (0.2700 => 0.2994, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.86% (0.6675 => 0.7400, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: 10.82% (0.1655 => 0.1834, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 10.80% (9.4845 => 10.5092, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/tsp/tsp: 10.72% (0.1175 => 0.1301, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 10.62% (0.3927 => 0.4344, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 10.48% (0.3473 => 0.3837, std.dev.: 0.0068) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.45% (0.3177 => 0.3509, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/synchronized: 10.39% (0.3561 => 0.3931, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 10.32% (0.3109 => 0.3430, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 10.32% (0.1695 => 0.1870, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-4: 10.27% (0.3543 => 0.3907, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.24% (0.5105 => 0.5628, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 10.24% (0.3886 => 0.4284, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.23% (0.3694 => 0.4072, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 10.21% (0.3516 => 0.3875, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.21% (0.3497 => 0.3854, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.18% (0.4615 => 0.5085, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 10.18% (3.3354 => 3.6749, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.18% (1.5415 => 1.6984, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/18-imp/imp: 10.17% (0.3423 => 0.3771, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.11% (0.1236 => 0.1361, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 10.11% (0.3828 => 0.4215, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 10.08% (0.1151 => 0.1267, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/mst/mst: 9.97% (0.1163 => 0.1279, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 9.79% (0.1032 => 0.1133, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 9.78% (1.1642 => 1.2781, std.dev.: 0.0077) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.78% (4.2646 => 4.6815, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.74% (0.1940 => 0.2129, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 9.73% (5.7591 => 6.3193, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.71% (0.5860 => 0.6429, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.66% (0.8067 => 0.8846, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.61% (0.5569 => 0.6104, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.58% (0.3121 => 0.3420, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 9.57% (3.8723 => 4.2429, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.56% (1.3050 => 1.4297, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.47% (0.2271 => 0.2486, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.40% (0.1510 => 0.1652, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.40% (0.2107 => 0.2305, std.dev.: 0.0017) MultiSource/Applications/viterbi/viterbi: 9.39% (0.1555 => 0.1701, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 9.32% (0.7835 => 0.8565, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.30% (0.8172 => 0.8932, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.25% (0.2065 => 0.2256, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.24% (5.0018 => 5.4639, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.22% (4.9449 => 5.4010, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.21% (0.2758 => 0.3012, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.20% (0.1337 => 0.1460, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.20% (0.9765 => 1.0663, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 9.13% (2.0273 => 2.2123, std.dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.08% (0.5020 => 0.5476, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.04% (0.1117 => 0.1218, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.03% (1.5859 => 1.7291, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 9.02% (1.5603 => 1.7010, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.00% (8.1363 => 8.8686, std.dev.: 0.0109) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.97% (7.9617 => 8.6760, std.dev.: 0.0129) SingleSource/Benchmarks/Misc-C++/bigfib: 8.97% (0.6456 => 0.7035, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 8.93% (1.0722 => 1.1680, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.86% (0.3307 => 0.3600, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 8.86% (2.2969 => 2.5004, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/09-vor/vor: 8.68% (0.3180 => 0.3456, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 8.65% (0.3387 => 0.3680, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.46% (0.3441 => 0.3732, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: 8.28% (0.1268 => 0.1373, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 8.19% (0.4299 => 0.4651, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.14% (1.1861 => 1.2827, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.14% (0.4103 => 0.4437, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 8.09% (21.9371 => 23.7110, std.dev.: 0.0149) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.02% (2.2024 => 2.3790, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Puzzle: 7.97% (0.1268 => 0.1369, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.83% (0.6450 => 0.6955, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.80% (0.2603 => 0.2806, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 7.77% (0.8921 => 0.9614, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.63% (0.3865 => 0.4160, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.51% (0.4289 => 0.4611, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.48% (0.4636 => 0.4983, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.47% (0.4203 => 0.4517, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: 7.45% (0.1463 => 0.1572, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.43% (0.1695 => 0.1821, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.40% (0.4620 => 0.4962, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 7.33% (0.3422 => 0.3673, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.33% (0.6030 => 0.6472, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.24% (0.5981 => 0.6414, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/Hello: 7.19% (0.5925 => 0.6351, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.19% (0.3826 => 0.4101, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.15% (1.4186 => 1.5201, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 7.11% (0.4048 => 0.4336, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.01% (0.3650 => 0.3906, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.83% (0.3603 => 0.3849, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 6.77% (1.1840 => 1.2641, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 6.70% (0.7326 => 0.7817, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.61% (0.1906 => 0.2032, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.58% (0.2266 => 0.2415, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.54% (0.3136 => 0.3341, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 6.51% (0.3684 => 0.3924, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.44% (0.2905 => 0.3092, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.39% (0.3162 => 0.3364, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/strcat: 6.32% (0.2831 => 0.3010, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.30% (2.0665 => 2.1967, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/except: 6.27% (0.2871 => 0.3051, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 6.24% (0.3283 => 0.3488, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.20% (0.8101 => 0.8603, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.19% (0.2891 => 0.3070, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.19% (0.3232 => 0.3432, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.03% (0.1892 => 0.2006, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.99% (0.2756 => 0.2921, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/matrix: 5.97% (0.3098 => 0.3283, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.85% (0.2872 => 0.3040, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.83% (0.3379 => 0.3576, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.77% (0.3052 => 0.3228, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.76% (0.2725 => 0.2882, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 5.76% (0.2049 => 0.2167, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.73% (0.4064 => 0.4297, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.67% (0.2877 => 0.3040, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.66% (0.2793 => 0.2951, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.49% (0.2714 => 0.2863, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.46% (0.2802 => 0.2955, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.14% (0.3427 => 0.3603, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.11% (14.3668 => 15.1010, std.dev.: 0.0144) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.90% (0.2430 => 0.2549, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.88% (3.8922 => 4.0822, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 4.83% (1.2842 => 1.3462, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 4.80% (17.1811 => 18.0055, std.dev.: 0.0250) SingleSource/Benchmarks/Shootout-C++/objinst: 4.66% (0.3131 => 0.3277, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.86% (1.1194 => 1.1626, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 3.85% (0.3092 => 0.3211, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.72% (0.3817 => 0.3921, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8953, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.90% (1.1396 => 1.2524, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 9.21% (3.1595 => 3.4505, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.64% (3.1578 => 3.3674, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.45% (3.6395 => 3.7652, std.dev.: 0.0045) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.55% (4.2280 => 4.3359, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.34% (1.7254 => 1.7658, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.72% (0.8275 => 0.8417, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.35% (11.6436 => 11.8011, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.04% (2.6546 => 2.6821, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.03% (6.5088 => 6.5756, std.dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.03% (6.6874 => 0.1319, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.13% (0.8651 => 0.1719, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.88% (5.2763 => 3.2779, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.17% (5.3855 => 3.7071, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.76% (5.3526 => 3.7064, std.dev.: 0.0073) SingleSource/UnitTests/Vector/constpool: -14.67% (54.1659 => 46.2211, std.dev.: 0.0186) MultiSource/Applications/ClamAV/clamscan: -11.92% (22.1758 => 19.5327, std.dev.: 0.0109) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.10% (2.9384 => 2.6415, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7645, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: -15.75% (1.6925 => 1.4260, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.13% (0.0998 => 0.0857, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -12.50% (1.2373 => 1.0826, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/mandel-2: -10.35% (1.5373 => 1.3782, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/mason/mason: -9.81% (0.2161 => 0.1949, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.44% (19.9488 => 18.2643, std.dev.: 0.0427) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.72% (1.8329 => 1.7097, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8477, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.28% (1.6805 => 1.5917, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.88% (1.5835 => 1.5063, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.01% (0.9957 => 0.9558, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Applications/siod/siod: -3.60% (3.2827 => 3.1644, std.dev.: 0.0072) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5070, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: -2.99% (12.4730 => 12.1003, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.11% (8.1563 => 7.9844, std.dev.: 0.0106) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.97% (8.6802 => 8.5089, std.dev.: 0.0221) SingleSource/Benchmarks/Misc/salsa20: -1.85% (10.2830 => 10.0926, std.dev.: 0.0132) SingleSource/UnitTests/Vector/multiplies: -1.77% (2.5528 => 2.5076, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6813, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4215, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.05% (6.2999 => 6.2340, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8596, std.dev.: 0.0103) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 14.17% (0.5229 => 0.5970, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 10.32% (14.9895 => 16.5368, std.dev.: 0.0175) MultiSource/Benchmarks/MallocBench/gs/gs: 8.82% (4.1105 => 4.4732, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.49% (1.1048 => 1.2649, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.17% (7.1582 => 7.9580, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.99% (0.6222 => 0.7466, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35600.00% (0.0001 => 0.0357, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.52% (0.2116 => 0.0645, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 14 16:43:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 14 Oct 2012 18:43:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121014234307.1DB172A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4873?compare_to=4871&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4873, Order: 165911, Start Time: 2012-10-14 22:20:15, End Time: 2012-10-14 23:46:00 To: 4871, Order: 165910, Start Time: 2012-10-14 20:25:18, End Time: 2012-10-14 21:51:11 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (186 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1042 (677 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.53% (2.0176 => 2.4924, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.72% (0.1410 => 0.1674, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.15% (0.0653 => 0.0765, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 17.07% (0.0826 => 0.0967, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 16.76% (0.2243 => 0.2619, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.11% (0.1072 => 0.1234, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.54% (0.1327 => 0.1520, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 14.31% (0.1013 => 0.1158, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.79% (0.0834 => 0.0949, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.45% (0.1413 => 0.1603, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 13.33% (0.7038 => 0.7976, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 13.24% (1.3693 => 1.5506, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.76% (0.0964 => 0.1087, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.72% (0.1588 => 0.1790, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.65% (3.9660 => 4.4676, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.37% (0.2596 => 0.2917, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 12.31% (0.4062 => 0.4562, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/hash2: 12.29% (0.4328 => 0.4860, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.27% (0.2721 => 0.3055, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 12.23% (13.8202 => 15.5105, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.16% (0.6283 => 0.7047, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.16% (0.5265 => 0.5905, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.11% (0.9199 => 1.0313, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.07% (0.6959 => 0.7799, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.06% (1.4563 => 1.6320, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.99% (1.2193 => 1.3655, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/power/power: 11.96% (0.1003 => 0.1123) MultiSource/Applications/aha/aha: 11.96% (0.1062 => 0.1189, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.96% (0.7710 => 0.8632, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.75% (0.3899 => 0.4357, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.61% (1.1364 => 1.2683, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.32% (0.1157 => 0.1288, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.32% (0.3022 => 0.3364, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 11.19% (1.0313 => 1.1467, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 11.10% (0.5818 => 0.6464, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.02% (0.3130 => 0.3475, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.01% (0.4016 => 0.4458, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.95% (0.3580 => 0.3972, std.dev.: 0.0052) MultiSource/Applications/Burg/burg: 10.94% (1.1061 => 1.2271, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 10.93% (0.5748 => 0.6376, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.92% (0.4791 => 0.5314, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.88% (0.3485 => 0.3864, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.85% (0.5577 => 0.6182, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.81% (0.2914 => 0.3229, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.70% (0.3756 => 0.4158, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.69% (0.3489 => 0.3862, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: 10.69% (0.3293 => 0.3645, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 10.64% (0.2781 => 0.3077, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.60% (0.1075 => 0.1189, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 10.59% (16.6129 => 18.3717, std.dev.: 0.0131) MultiSource/Applications/minisat/minisat: 10.54% (0.6744 => 0.7455, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 10.45% (0.3453 => 0.3814, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 10.45% (0.7061 => 0.7799, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 10.42% (0.2995 => 0.3307, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.39% (0.4379 => 0.4834, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.38% (0.2966 => 0.3274, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 10.37% (2.1791 => 2.4051, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/moments: 10.34% (0.3868 => 0.4268, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.34% (0.0977 => 0.1078, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 10.32% (0.1589 => 0.1753, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 10.29% (3.8646 => 4.2624, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.29% (0.3246 => 0.3580, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/mst/mst: 10.26% (0.1111 => 0.1225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.24% (0.2782 => 0.3067, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.24% (0.8698 => 0.9589, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/18-imp/imp: 10.22% (0.3220 => 0.3549, std.dev.: 0.0027) MultiSource/Applications/treecc/treecc: 10.20% (1.9270 => 2.1236, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.20% (0.2127 => 0.2344, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.17% (0.1986 => 0.2188, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.16% (4.9865 => 5.4931, std.dev.: 0.0322) MultiSource/Applications/viterbi/viterbi: 10.15% (0.1478 => 0.1628, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 10.11% (3.1889 => 3.5113, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/ary: 10.11% (0.3107 => 0.3421, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.09% (0.7460 => 0.8213, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.08% (0.1865 => 0.2053, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.06% (0.1014 => 0.1116, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 10.05% (0.2726 => 0.3000, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 10.05% (0.7506 => 0.8260, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 10.00% (0.3149 => 0.3464, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 9.99% (0.3534 => 0.3887, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.99% (1.9828 => 2.1808, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 9.95% (0.8310 => 0.9137, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 9.91% (0.2925 => 0.3215, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.90% (0.5637 => 0.6195, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.88% (0.1569 => 0.1724, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.87% (0.1276 => 0.1402, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 9.86% (0.2607 => 0.2864, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 9.82% (0.2760 => 0.3031, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.79% (0.4390 => 0.4820, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 9.78% (0.2690 => 0.2953, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.76% (0.2655 => 0.2914, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.73% (0.2765 => 0.3034, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 9.71% (0.2761 => 0.3029, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 9.64% (0.2937 => 0.3220, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/fibo: 9.63% (0.2628 => 0.2881, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.62% (7.2180 => 7.9126, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary2: 9.62% (0.3192 => 0.3499, std.dev.: 0.0035) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.62% (0.1435 => 0.1573, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.59% (0.2023 => 0.2217, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 9.50% (1.0594 => 1.1600, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.38% (0.2696 => 0.2949, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 9.29% (0.1657 => 0.1811, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 9.20% (0.2988 => 0.3263, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.05% (1.3245 => 1.4444, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 9.04% (0.3131 => 0.3414, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.03% (0.3755 => 0.4094, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 8.97% (1.2749 => 1.3893, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.79% (3.6692 => 3.9919, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.75% (4.3801 => 4.7633, std.dev.: 0.0037) MultiSource/Applications/JM/lencod/lencod: 8.71% (14.8535 => 16.1474, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/objinst: 8.69% (0.2945 => 0.3201, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.67% (4.4433 => 4.8285, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.55% (0.6576 => 0.7138, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.52% (0.6135 => 0.6658, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 8.49% (8.4961 => 9.2174, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.38% (0.1789 => 0.1939, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.37% (0.3511 => 0.3805, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.36% (1.5188 => 1.6457, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.27% (0.2140 => 0.2317, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.18% (0.8818 => 0.9539, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 8.13% (0.6250 => 0.6758, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.10% (0.2321 => 0.2509, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.09% (3.2742 => 3.5392, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.99% (1.1333 => 1.2239, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.99% (0.9108 => 0.9836, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.97% (0.4113 => 0.4441, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.91% (0.4805 => 0.5185, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 7.83% (3.7467 => 4.0402, std.dev.: 0.0100) SingleSource/UnitTests/ObjC/parameter-passing: 7.74% (0.4003 => 0.4313, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 7.71% (4.6629 => 5.0223, std.dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 7.66% (6.5754 => 7.0789, std.dev.: 0.0118) MultiSource/Benchmarks/FreeBench/neural/neural: 7.65% (0.1385 => 0.1491, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.64% (2.1007 => 2.2611, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.58% (0.3245 => 0.3491, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.46% (0.3914 => 0.4206, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.39% (0.2504 => 0.2689, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 7.26% (0.3940 => 0.4226, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 7.22% (0.2008 => 0.2153, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 7.19% (1.2292 => 1.3176, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 7.18% (0.3578 => 0.3835, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.13% (6.2785 => 6.7259, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/for-in: 7.13% (0.3789 => 0.4059, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.07% (0.3623 => 0.3879, std.dev.: 0.0064) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.04% (0.3650 => 0.3907, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 7.02% (0.3646 => 0.3902, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 7.02% (0.3663 => 0.3920, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.00% (0.3601 => 0.3853, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.75% (13.2842 => 14.1805, std.dev.: 0.0146) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.32% (0.1819 => 0.1934, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.35% (0.2243 => 0.2363, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 5.17% (16.2614 => 17.1028, std.dev.: 0.0216) MultiSource/Applications/ClamAV/clamscan: 4.60% (14.5298 => 15.1983, std.dev.: 0.0046) MultiSource/Benchmarks/Bullet/bullet: 1.94% (33.2944 => 33.9400, std.dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.48% (5.7573 => 7.5121, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: 24.30% (1.8175 => 2.2591, std.dev.: 0.0505) SingleSource/Benchmarks/Misc/richards_benchmark: 11.11% (1.1560 => 1.2844, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922) SingleSource/Benchmarks/Misc/ffbench: 8.98% (0.8273 => 0.9016, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4145, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.29% (1.2998 => 1.3816, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0050, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 3.92% (11.2619 => 11.7038, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.88% (1.7081 => 1.7744, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 3.48% (1.9199 => 1.9868, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.34% (10.7476 => 11.1063, std.dev.: 0.0220) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309) SingleSource/Benchmarks/Misc/salsa20: 2.24% (7.4271 => 7.5933, std.dev.: 0.0032) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4540, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5131, std.dev.: 0.0086) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2068, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1878, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.17% (5.5130 => 5.5777, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (9.9194 => 10.0268, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.08% (8.8259 => 8.9212, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5883, std.dev.: 0.0070) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.97% (0.2670 => 0.1416, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.91% (0.4657 => 0.3916, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -14.14% (0.0707 => 0.0607, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.18% (1.3819 => 1.1998, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.15% (1.3813 => 1.1996, std.dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.33% (1.0460 => 0.8543, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.74% (0.0997 => 0.0860, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.93% (0.2238 => 0.1971, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.59% (1.2308 => 1.0881, std.dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.22% (20.3410 => 18.2631, std.dev.: 0.0276) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.83% (1.3780 => 1.2976, std.dev.: 0.0169) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.16% (2.6470 => 2.5103, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.62% (0.9996 => 0.9534, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.52% (3.2729 => 3.1577, std.dev.: 0.0255) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.45% (1.7688 => 1.7077, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -2.63% (26.5159 => 25.8192, std.dev.: 0.0373) SingleSource/Regression/C/uint64_to_float: -2.53% (0.5449 => 0.5311) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.43% (3.0263 => 2.9528, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -2.41% (1.9762 => 1.9286, std.dev.: 0.0018) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.97% (0.6589 => 0.6459, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7144, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/lists: -1.77% (6.3560 => 6.2435, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0060, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/heapsort: -1.24% (3.9173 => 3.8689, std.dev.: 0.0137) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.22% (0.8342 => 0.8240, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.17% (2.5254 => 2.4958, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: -1.16% (9.3358 => 9.2276, std.dev.: 0.0138) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2566, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.08% (6.6320 => 6.5603, std.dev.: 0.0134) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 14 19:20:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 14 Oct 2012 21:20:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121015022020.CDE4E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4874?compare_to=4872&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4874, Order: 165914, Start Time: 2012-10-15 01:02:03, End Time: 2012-10-15 02:22:13 To: 4872, Order: 165911, Start Time: 2012-10-14 22:03:55, End Time: 2012-10-14 23:23:53 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (169 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 952 (678 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.19% (1.0826 => 1.0955, std.dev.: 0.0038) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.57% (0.5970 => 0.6004, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: -0.09% (16.5368 => 16.5223, std.dev.: 0.0122) MultiSource/Benchmarks/Bullet/bullet: 0.23% (55.7230 => 55.8493, std.dev.: 0.0136) MultiSource/Benchmarks/MallocBench/gs/gs: 0.02% (4.4732 => 4.4739, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.43% (0.0463 => 0.0465, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.43% (0.0465 => 0.0467) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.23% (0.0433 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.46% (0.0434 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.47% (0.0422 => 0.0424) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.47% (0.0424 => 0.0426) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.48% (0.0416 => 0.0418) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.24% (0.0418 => 0.0419, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.46% (0.0434 => 0.0436) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.23% (0.0436 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0430 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.47% (0.0430 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.48% (0.0417 => 0.0419, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0420 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.47% (0.0426 => 0.0428, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.47% (0.0427 => 0.0429, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.46% (0.0437 => 0.0439) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.46% (0.0438 => 0.0440, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.48% (0.0413 => 0.0415) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.24% (0.0415 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.47% (0.0425 => 0.0427, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.47% (0.0426 => 0.0428, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.24% (0.0417 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.24% (0.0418 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.24% (0.0409 => 0.0410) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.49% (0.0410 => 0.0412) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.49% (0.0407 => 0.0409) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.49% (0.0409 => 0.0411, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.45% (0.0445 => 0.0447, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.45% (0.0446 => 0.0448, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.74% (0.0406 => 0.0409) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.49% (0.0408 => 0.0410) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.25% (0.0408 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.49% (0.0409 => 0.0411) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.48% (0.0415 => 0.0417, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.48% (0.0417 => 0.0419, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.01% (1.2649 => 1.2648, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.42% (7.9580 => 7.9914, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.42% (0.7466 => 0.7497, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.56% (0.0357 => 0.0359, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0645 => 0.0645, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.69% (63.2438 => 55.8493, std.dev.: 0.0136) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.97% (14.1553 => 19.1061, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.09% (3.4629 => 5.7515, std.dev.: 0.0023) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14232.50% (0.0720 => 10.3194, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952400.00% (0.0001 => 9.9525, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 64.84% (0.2554 => 0.4210, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 45.15% (10.3673 => 15.0486, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/richards_benchmark: 39.83% (0.1622 => 0.2268, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 33.90% (0.1056 => 0.1414, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.73% (7.0540 => 8.3753, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops: 18.51% (0.1432 => 0.1697, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.10% (2.2022 => 2.6009, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.90% (0.1566 => 0.1815, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.16% (1.7609 => 2.0103, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.15% (0.1625 => 0.1855, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.00% (0.1143 => 0.1303, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 13.89% (0.3282 => 0.3738, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.43% (0.0871 => 0.0988, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.03% (0.0798 => 0.0902, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 12.99% (0.1440 => 0.1627, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.66% (0.1438 => 0.1620, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 12.50% (0.1584 => 0.1782, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 12.02% (0.1655 => 0.1854, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 11.95% (10.4361 => 11.6836, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.85% (0.3543 => 0.3963, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 11.49% (0.7433 => 0.8287, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/parameter-passing: 11.43% (0.3927 => 0.4376, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.40% (0.3473 => 0.3869, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 11.34% (0.7115 => 0.7922, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-2: 11.21% (0.3497 => 0.3889, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.21% (0.3543 => 0.3940, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.20% (0.3561 => 0.3960, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.15% (0.3828 => 0.4255, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.15% (0.4879 => 0.5423, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 11.15% (0.3516 => 0.3908, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.14% (0.3886 => 0.4319, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.02% (0.3694 => 0.4101, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.89% (0.6675 => 0.7402, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.78% (0.2700 => 0.2991, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 10.75% (9.4845 => 10.5043, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/tsp/tsp: 10.64% (0.1175 => 0.1300, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 10.50% (0.1695 => 0.1873, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.50% (1.5415 => 1.7033, std.dev.: 0.0071) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.42% (0.3177 => 0.3508, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.41% (0.2065 => 0.2280, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 10.37% (0.3423 => 0.3778, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.27% (0.4615 => 0.5089, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.19% (0.1236 => 0.1362, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 10.16% (0.3109 => 0.3425, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 10.15% (3.3354 => 3.6739, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.12% (0.5860 => 0.6453, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.12% (0.2758 => 0.3037, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.01% (0.5105 => 0.5616, std.dev.: 0.0018) MultiSource/Applications/aha/aha: 9.90% (0.1151 => 0.1265, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.86% (4.2646 => 4.6853, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.85% (0.1940 => 0.2131, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 9.79% (0.1032 => 0.1133, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.75% (0.4103 => 0.4503, std.dev.: 0.0016) MultiSource/Applications/Burg/burg: 9.67% (1.1642 => 1.2768, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.67% (0.8067 => 0.8847, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.60% (0.1510 => 0.1655, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.59% (0.5569 => 0.6103, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.59% (1.3050 => 1.4301, std.dev.: 0.0078) MultiSource/Applications/oggenc/oggenc: 9.58% (5.7591 => 6.3111, std.dev.: 0.0138) SingleSource/Benchmarks/Misc-C++/bigfib: 9.57% (0.6456 => 0.7074, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.55% (0.3121 => 0.3419, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.54% (0.2107 => 0.2308, std.dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: 9.52% (0.1555 => 0.1703, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.51% (0.2271 => 0.2487, std.dev.: 0.0027) MultiSource/Applications/lua/lua: 9.51% (3.8723 => 4.2404, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/mst/mst: 9.46% (0.1163 => 0.1273, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.44% (4.9449 => 5.4119, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 9.40% (1.5603 => 1.7070, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.39% (5.0018 => 5.4716, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.37% (0.3307 => 0.3617, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.30% (0.5020 => 0.5487, std.dev.: 0.0023) MultiSource/Applications/spiff/spiff: 9.28% (0.7835 => 0.8562, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.22% (8.1363 => 8.8864, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.18% (0.8172 => 0.8922, std.dev.: 0.0066) MultiSource/Applications/treecc/treecc: 9.15% (2.0273 => 2.2127, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.13% (0.9765 => 1.0657, std.dev.: 0.0046) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.12% (7.9617 => 8.6875, std.dev.: 0.0032) MultiSource/Applications/siod/siod: 9.07% (2.2969 => 2.5053, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.04% (0.1117 => 0.1218, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.89% (1.5859 => 1.7269, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 8.86% (0.4289 => 0.4669, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 8.84% (1.0722 => 1.1670, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 8.83% (0.3387 => 0.3686, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.69% (0.5925 => 0.6440, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.67% (0.6030 => 0.6553, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 8.62% (0.3180 => 0.3454, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.59% (0.4203 => 0.4564, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.54% (0.3865 => 0.4195, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.53% (0.1337 => 0.1451, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/health/health: 8.52% (0.1268 => 0.1376, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 8.51% (0.4620 => 0.5013, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.37% (0.3441 => 0.3729, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 8.33% (0.3422 => 0.3707, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.30% (0.4636 => 0.5021, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.19% (1.1861 => 1.2832, std.dev.: 0.0077) MultiSource/Benchmarks/McCat/05-eks/eks: 8.16% (0.4299 => 0.4650, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.02% (0.3826 => 0.4133, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 8.02% (0.3603 => 0.3892, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 8.00% (0.4048 => 0.4372, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.00% (0.7326 => 0.7912, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.99% (2.2024 => 2.3783, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.89% (0.3650 => 0.3938, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 7.89% (0.1268 => 0.1368, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 7.88% (0.8921 => 0.9624, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.81% (0.6450 => 0.6954, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.80% (0.2603 => 0.2806, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 7.71% (21.9371 => 23.6282, std.dev.: 0.0088) SingleSource/Regression/C++/ofstream_ctor: 7.64% (0.2905 => 0.3127, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.56% (0.3136 => 0.3373, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 7.52% (0.2831 => 0.3044, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.48% (0.2793 => 0.3002, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.47% (0.2891 => 0.3107, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 7.46% (0.3684 => 0.3959, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.46% (0.3162 => 0.3398, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 7.45% (0.1463 => 0.1572, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.43% (0.1695 => 0.1821, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.35% (2.0665 => 2.2184, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary: 7.33% (0.3232 => 0.3469, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.33% (0.2714 => 0.2913, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 7.30% (0.2877 => 0.3087, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.27% (0.5981 => 0.6416, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.25% (0.3283 => 0.3521, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.20% (1.4186 => 1.5208, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.15% (0.2756 => 0.2953, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.14% (0.2871 => 0.3076, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 7.13% (0.3098 => 0.3319, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.98% (0.3052 => 0.3265, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.97% (0.2725 => 0.2915, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.89% (0.2872 => 0.3070, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.75% (0.2802 => 0.2991, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 6.74% (1.1840 => 1.2638, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary2: 6.72% (0.3379 => 0.3606, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.66% (0.1906 => 0.2033, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.57% (0.4064 => 0.4331, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.49% (0.2266 => 0.2413, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.11% (0.8101 => 0.8596, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.97% (0.1892 => 0.2005, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 5.62% (0.3131 => 0.3307, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 5.61% (0.2049 => 0.2164, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 5.55% (1.2842 => 1.3555, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.13% (14.3668 => 15.1041, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.96% (0.3427 => 0.3597, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 4.75% (17.1811 => 17.9965, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.69% (0.2430 => 0.2544, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.65% (3.8922 => 4.0733, std.dev.: 0.0111) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.98% (1.1194 => 1.1640, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: 3.72% (0.3092 => 0.3207, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.62% (0.3817 => 0.3955, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.91% (1.1396 => 1.2525, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0021) MultiSource/Applications/aha/aha: 9.21% (3.1595 => 3.4505, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3682, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.65% (0.3463 => 0.3624, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.39% (3.6395 => 3.7630, std.dev.: 0.0058) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.74% (4.2280 => 4.3439, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.35% (1.7254 => 1.7659, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.70% (0.8275 => 0.8416, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.36% (11.6436 => 11.8017, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.15% (2.6546 => 2.6852, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.03% (6.5088 => 6.5758, std.dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.03% (6.6874 => 0.1320, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -80.08% (0.8651 => 0.1723, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.87% (5.2763 => 3.2780, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.89% (5.3855 => 3.7220, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.43% (5.3526 => 3.7239, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -14.64% (54.1659 => 46.2370, std.dev.: 0.0358) MultiSource/Applications/ClamAV/clamscan: -11.76% (22.1758 => 19.5679, std.dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -9.97% (2.9384 => 2.6453, std.dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -33.54% (1.1492 => 0.7638, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4249, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.73% (0.0998 => 0.0861, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.46% (1.2373 => 1.0955, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/mandel-2: -10.40% (1.5373 => 1.3774, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/mason/mason: -10.04% (0.2161 => 0.1944, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.27% (19.9488 => 18.2988, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.64% (1.8329 => 1.7112, std.dev.: 0.0156) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.28% (1.6805 => 1.5917, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-5: -4.62% (1.5835 => 1.5103, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.63% (3.2827 => 3.1634, std.dev.: 0.0085) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.44% (0.9957 => 0.9614, std.dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5004, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: -2.99% (12.4730 => 12.0997, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.33% (8.1563 => 7.9666, std.dev.: 0.0307) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.11% (8.6802 => 8.4971, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/salsa20: -1.99% (10.2830 => 10.0787, std.dev.: 0.0347) SingleSource/Benchmarks/Misc/flops: -1.69% (8.8334 => 8.6845, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std.dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4212, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 14.82% (0.5229 => 0.6004, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 10.23% (14.9895 => 16.5223, std.dev.: 0.0122) MultiSource/Benchmarks/MallocBench/gs/gs: 8.84% (4.1105 => 4.4739, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.48% (1.1048 => 1.2648, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.64% (7.1582 => 7.9914, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/stepanov_container: 20.49% (0.6222 => 0.7497, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35800.00% (0.0001 => 0.0359, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.52% (0.2116 => 0.0645, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 14 19:25:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 14 Oct 2012 21:25:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121015022546.1B8D72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4875?compare_to=4873&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4875, Order: 165914, Start Time: 2012-10-15 01:02:54, End Time: 2012-10-15 02:28:40 To: 4873, Order: 165911, Start Time: 2012-10-14 22:20:15, End Time: 2012-10-14 23:46:00 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 4 (188 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1038 (677 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: 1.64% (0.7799 => 0.7927, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 2.84% (2.2591 => 2.3233, std.dev.: 0.0233) MultiSource/Benchmarks/llubenchmark/llu: 2.30% (3.7538 => 3.8403, std.dev.: 0.0192) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.41% (79.3139 => 80.4346, std.dev.: 0.4260) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.54% (2.0176 => 2.4925, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.44% (0.1410 => 0.1670, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.00% (0.0653 => 0.0764, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 16.95% (0.0826 => 0.0966, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 16.72% (0.2243 => 0.2618, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.93% (0.1072 => 0.1232, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 14.31% (0.1013 => 0.1158, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.79% (0.1327 => 0.1510, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.79% (0.0834 => 0.0949, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.45% (0.1413 => 0.1603, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 13.13% (0.7038 => 0.7962, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 13.04% (1.3693 => 1.5478, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/hash2: 12.92% (0.4328 => 0.4887, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.76% (0.0964 => 0.1087, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 12.73% (0.4062 => 0.4579, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.65% (3.9660 => 4.4678, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 12.41% (0.5818 => 0.6540, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.34% (0.1588 => 0.1784, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 12.26% (0.7061 => 0.7927, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.24% (0.2721 => 0.3054, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.17% (0.2596 => 0.2912, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 12.17% (13.8202 => 15.5021, std.dev.: 0.0133) SingleSource/UnitTests/ObjC++/Hello: 12.14% (0.5748 => 0.6446, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.98% (1.4563 => 1.6308, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.94% (0.6283 => 0.7033, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.93% (0.6959 => 0.7789, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.93% (0.9199 => 1.0296, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.91% (0.5265 => 0.5892, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.89% (0.7710 => 0.8627, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.85% (1.2193 => 1.3638, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.81% (0.3022 => 0.3379, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.70% (0.3899 => 0.4355, std.dev.: 0.0050) MultiSource/Applications/aha/aha: 11.68% (0.1062 => 0.1186, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/power/power: 11.67% (0.1003 => 0.1120, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.39% (1.1364 => 1.2658, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.28% (0.4016 => 0.4469, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 11.28% (1.0313 => 1.1476, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.26% (0.3580 => 0.3983, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.25% (0.3485 => 0.3877, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 11.22% (0.2781 => 0.3093, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.18% (0.3756 => 0.4176, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.06% (0.1157 => 0.1285, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 10.96% (0.3293 => 0.3654, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.94% (0.4791 => 0.5315, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 10.87% (1.1061 => 1.2263, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.86% (0.3130 => 0.3470, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.85% (0.5577 => 0.6182, std.dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 10.80% (16.6129 => 18.4077, std.dev.: 0.0191) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.78% (0.3489 => 0.3865, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.75% (0.2782 => 0.3081, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.65% (0.2966 => 0.3282, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 10.64% (0.2726 => 0.3016, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 10.63% (0.3453 => 0.3820, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 10.55% (0.3868 => 0.4276, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 10.53% (0.6744 => 0.7454, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.51% (0.1075 => 0.1188, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.46% (1.9828 => 2.1902, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 10.43% (0.2760 => 0.3048, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 10.42% (0.3149 => 0.3477, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 10.40% (0.3107 => 0.3430, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.37% (0.8698 => 0.9600, std.dev.: 0.0159) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.34% (0.0977 => 0.1078, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 10.33% (0.3534 => 0.3899, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.32% (0.4379 => 0.4831, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hello: 10.32% (0.2607 => 0.2876, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 10.30% (0.2690 => 0.2967, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 10.28% (0.3220 => 0.3551, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 10.25% (0.2937 => 0.3238, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.24% (0.2655 => 0.2927, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 10.23% (2.1791 => 2.4021, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.21% (0.4390 => 0.4838, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 10.18% (0.2995 => 0.3300, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 10.17% (0.1111 => 0.1224, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.17% (0.3246 => 0.3576, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.16% (0.2765 => 0.3046, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.16% (0.2127 => 0.2343, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 10.15% (3.8646 => 4.2570, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/methcall: 10.14% (0.2761 => 0.3041, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 10.14% (1.9270 => 2.1224, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 10.13% (0.1589 => 0.1750, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 10.08% (0.2628 => 0.2893, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 10.08% (0.1478 => 0.1627, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.06% (0.1014 => 0.1116, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.05% (0.2914 => 0.3207, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.02% (0.1986 => 0.2185, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.02% (4.9865 => 5.4860, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 10.00% (3.1889 => 3.5077, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 9.99% (0.3192 => 0.3511, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.94% (0.1569 => 0.1725, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.92% (0.1865 => 0.2050, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.91% (0.7460 => 0.8199, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.90% (0.5637 => 0.6195, std.dev.: 0.0029) MultiSource/Applications/spiff/spiff: 9.89% (0.7506 => 0.8248, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 9.84% (0.8310 => 0.9128, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/09-vor/vor: 9.74% (0.2925 => 0.3210, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 9.74% (0.2988 => 0.3279, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.72% (0.2696 => 0.2958, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.62% (0.1435 => 0.1573, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.59% (0.2023 => 0.2217, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.56% (7.2180 => 7.9084, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.51% (0.3755 => 0.4112, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 9.32% (1.0594 => 1.1581, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.25% (0.1276 => 0.1394, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 9.11% (0.1657 => 0.1808, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 9.10% (0.2945 => 0.3213, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.08% (1.3245 => 1.4447, std.dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 8.93% (1.2749 => 1.3887, std.dev.: 0.0050) MultiSource/Benchmarks/sim/sim: 8.85% (0.3131 => 0.3408, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.83% (3.6692 => 3.9931, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.68% (4.4433 => 4.8289, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.68% (4.3801 => 4.7601, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 8.59% (14.8535 => 16.1295, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.52% (0.6576 => 0.7136, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.42% (0.4003 => 0.4340, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 8.31% (8.4961 => 9.2025, std.dev.: 0.0125) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.28% (0.6135 => 0.6643, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 8.27% (0.6250 => 0.6767, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.26% (1.5188 => 1.6443, std.dev.: 0.0066) SingleSource/UnitTests/ObjC/exceptions: 8.15% (0.3914 => 0.4233, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.14% (0.2321 => 0.2510, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.11% (0.8818 => 0.9533, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 8.08% (0.3578 => 0.3867, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.05% (0.1789 => 0.1933, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.05% (0.3940 => 0.4257, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.03% (0.4805 => 0.5191, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.03% (0.9108 => 0.9839, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.95% (3.2742 => 3.5345, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.94% (0.3789 => 0.4090, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.94% (0.2140 => 0.2310, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 7.93% (0.3646 => 0.3935, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.90% (1.1333 => 1.2228, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 7.89% (0.3663 => 0.3952, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.89% (0.3245 => 0.3501, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.83% (0.3511 => 0.3786, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 7.83% (0.3601 => 0.3883, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/05-eks/eks: 7.78% (0.4113 => 0.4433, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.76% (0.3623 => 0.3904, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.75% (0.3650 => 0.3933, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 7.73% (4.6629 => 5.0234, std.dev.: 0.0057) MultiSource/Applications/lua/lua: 7.73% (3.7467 => 4.0362, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/neural/neural: 7.73% (0.1385 => 0.1492, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 7.60% (1.2292 => 1.3226, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.60% (2.1007 => 2.2603, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 7.48% (6.5754 => 7.0675, std.dev.: 0.0135) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.35% (0.2504 => 0.2688, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 7.22% (0.2008 => 0.2153, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.18% (6.2785 => 6.7294, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.83% (13.2842 => 14.1914, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.05% (0.1819 => 0.1929, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.26% (0.2243 => 0.2361, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 5.12% (16.2614 => 17.0946, std.dev.: 0.0093) MultiSource/Applications/ClamAV/clamscan: 4.53% (14.5298 => 15.1877, std.dev.: 0.0118) MultiSource/Benchmarks/Bullet/bullet: 1.98% (33.2944 => 33.9551, std.dev.: 0.0162) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.81% (0.4846 => 0.6969, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5161, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/fbench: 27.83% (1.8175 => 2.3233, std.dev.: 0.0233) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.06% (1.0895 => 1.3625, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 11.12% (1.1560 => 1.2845, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 8.99% (0.8273 => 0.9017, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436) SingleSource/Benchmarks/Shootout-C++/hash2: 7.55% (3.1736 => 3.4131, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.24% (1.2998 => 1.3809, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0005, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0051, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.65% (0.3139 => 0.3285, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.92% (11.2619 => 11.7034, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.89% (1.7081 => 1.7745, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9856, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 3.32% (10.7476 => 11.1042, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.12% (7.4271 => 7.5845, std.dev.: 0.0077) MultiSource/Benchmarks/llubenchmark/llu: 1.78% (3.7731 => 3.8403, std.dev.: 0.0192) MultiSource/Applications/lemon/lemon: 1.61% (1.4298 => 1.4528, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2073) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5132, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2126, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1876, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 1.21% (5.5130 => 5.5796, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0272, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 1.03% (12.4560 => 12.5843, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.03% (3.6469 => 3.6843, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.93% (0.2670 => 0.1417, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.27% (0.4657 => 0.3946, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/mason/mason: -14.29% (0.0707 => 0.0606, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.29% (1.3813 => 1.1977, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.05% (1.3819 => 1.2016, std.dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.33% (1.0460 => 0.8543, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.74% (0.0997 => 0.0860, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -12.15% (0.2238 => 0.1966) SingleSource/Benchmarks/McGill/chomp: -11.02% (1.2308 => 1.0952, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.03% (20.3410 => 18.3001, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0049) SingleSource/UnitTests/Vector/multiplies: -5.06% (2.6470 => 2.5130, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.99% (1.3780 => 1.3092, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.32% (0.9996 => 0.9564, std.dev.: 0.0025) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.55% (1.7688 => 1.7060, std.dev.: 0.0014) MultiSource/Applications/siod/siod: -3.42% (3.2729 => 3.1610, std.dev.: 0.0206) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.92% (0.4867 => 0.4725, std.dev.: 0.0007) SingleSource/Regression/C/uint64_to_float: -2.55% (0.5449 => 0.5310, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4781, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.43% (3.0263 => 2.9528, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -2.41% (1.9762 => 1.9286, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Applications/lua/lua: -2.34% (26.5159 => 25.8961, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.90% (0.6589 => 0.6464, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.84% (6.3560 => 6.2392, std.dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7139, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0079, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8624, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.25% (0.8342 => 0.8238, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.15% (5.3167 => 5.2557, std.dev.: 0.0015) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 14 22:42:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 15 Oct 2012 00:42:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121015054223.76AEC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4876?compare_to=4874&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4876, Order: 165915, Start Time: 2012-10-15 04:24:10, End Time: 2012-10-15 05:44:16 To: 4874, Order: 165914, Start Time: 2012-10-15 01:02:03, End Time: 2012-10-15 02:22:13 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (166 on baseline) Performance Improvements: 3 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 948 (682 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.75% (54.9389 => 56.4490, std.dev.: 0.0879) SingleSource/Benchmarks/Misc/lowercase: 1.02% (7.9667 => 8.0479, std.dev.: 0.0143) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -1.70% (11.6836 => 11.4854, std.dev.: 0.0110) MultiSource/Benchmarks/PAQ8p/paq8p: -1.13% (15.0486 => 14.8791, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.10% (2.2184 => 2.1939, std.dev.: 0.0016) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.55% (0.6004 => 0.5971, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: -0.12% (16.5223 => 16.5023, std.dev.: 0.0207) MultiSource/Benchmarks/Bullet/bullet: 0.13% (55.8493 => 55.9203, std.dev.: 0.0333) MultiSource/Benchmarks/MallocBench/gs/gs: 0.08% (4.4739 => 4.4776, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.43% (0.0465 => 0.0463, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.43% (0.0467 => 0.0465, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.23% (0.0434 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.46% (0.0436 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.47% (0.0424 => 0.0422, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.47% (0.0426 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.48% (0.0418 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.24% (0.0419 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.46% (0.0436 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.46% (0.0437 => 0.0435, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.47% (0.0430 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.46% (0.0432 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.24% (0.0419 => 0.0418) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.24% (0.0420 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.47% (0.0428 => 0.0426) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.47% (0.0429 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.46% (0.0439 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.23% (0.0440 => 0.0439, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.48% (0.0415 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.48% (0.0416 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.47% (0.0427 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.23% (0.0428 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.24% (0.0418 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.24% (0.0419 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.24% (0.0410 => 0.0409) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.24% (0.0412 => 0.0411, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.49% (0.0409 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.49% (0.0411 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.45% (0.0447 => 0.0445, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.45% (0.0448 => 0.0446, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.49% (0.0409 => 0.0407) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.49% (0.0410 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.49% (0.0409 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.73% (0.0411 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.24% (0.0417 => 0.0416) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.72% (0.0419 => 0.0416, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.08% (1.2648 => 1.2638, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.30% (7.9914 => 7.9673, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.53% (0.7497 => 0.7457, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.84% (0.0359 => 0.0356, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1433 => 0.1434, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.41% (0.0645 => 0.0667, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.58% (63.2438 => 55.9203, std.dev.: 0.0333) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.75% (14.1553 => 19.0740, std.dev.: 0.0168) SingleSource/Benchmarks/Misc-C++-EH/spirit: 65.90% (3.4629 => 5.7449, std.dev.: 0.0096) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14220.56% (0.0720 => 10.3108, std.dev.: 0.0156) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952700.00% (0.0001 => 9.9528, std.dev.: 0.0011) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.86% (0.2554 => 0.4185, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 43.52% (10.3673 => 14.8791, std.dev.: 0.0115) SingleSource/Benchmarks/Misc/richards_benchmark: 39.40% (0.1622 => 0.2261, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/distray/distray: 33.81% (0.1056 => 0.1413, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.54% (7.0540 => 8.3615, std.dev.: 0.0234) MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.40% (2.2022 => 2.6074, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 18.23% (0.1432 => 0.1693, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.90% (0.1566 => 0.1815, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 13.83% (0.3282 => 0.3736, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.83% (1.7609 => 2.0044, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.66% (0.0871 => 0.0990, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.56% (0.1143 => 0.1298, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 13.12% (0.1440 => 0.1629, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 12.50% (0.1584 => 0.1782, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.57% (0.3543 => 0.3953, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 11.44% (0.7433 => 0.8283, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.35% (0.4879 => 0.5433, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 11.27% (0.7115 => 0.7917, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 11.08% (0.3927 => 0.4362, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.06% (0.3473 => 0.3857, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.95% (0.1625 => 0.1803, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-2: 10.90% (0.3497 => 0.3878, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.89% (0.3543 => 0.3929, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.89% (0.2700 => 0.2994, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.85% (0.1438 => 0.1594, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 10.81% (0.3561 => 0.3946, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.78% (0.3516 => 0.3895, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.76% (0.3886 => 0.4304, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 10.69% (0.1655 => 0.1832, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions: 10.66% (0.3828 => 0.4236, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.64% (0.3694 => 0.4087, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 10.64% (0.1175 => 0.1300, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.64% (0.6675 => 0.7385, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 10.54% (9.4845 => 10.4840, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.47% (1.5415 => 1.7029, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.39% (0.3177 => 0.3507, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.36% (0.4615 => 0.5093, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 10.32% (0.1695 => 0.1870, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 10.19% (3.3354 => 3.6753, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 10.11% (0.3423 => 0.3769, std.dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 10.05% (10.4361 => 11.4854, std.dev.: 0.0110) MultiSource/Applications/sgefa/sgefa: 10.04% (0.3109 => 0.3421, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.95% (0.8067 => 0.8870, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 9.90% (0.1151 => 0.1265, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.87% (0.1236 => 0.1358, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.86% (0.2758 => 0.3030, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.85% (0.1940 => 0.2131, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 9.79% (0.1032 => 0.1133, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.77% (0.5105 => 0.5604, std.dev.: 0.0092) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.75% (4.2646 => 4.6806, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.73% (0.5860 => 0.6430, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 9.71% (1.1642 => 1.2772, std.dev.: 0.0086) MultiSource/Applications/oggenc/oggenc: 9.64% (5.7591 => 6.3144, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.60% (0.1510 => 0.1655, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 9.55% (3.8723 => 4.2421, std.dev.: 0.0030) MultiSource/Applications/viterbi/viterbi: 9.52% (0.1555 => 0.1703, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.42% (0.3121 => 0.3415, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.42% (1.3050 => 1.4279, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.40% (0.2107 => 0.2305, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.38% (0.2271 => 0.2484, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.37% (0.5569 => 0.6091, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/mst/mst: 9.37% (0.1163 => 0.1272, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.30% (5.0018 => 5.4672, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.21% (4.9449 => 5.4003, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.17% (0.8172 => 0.8921, std.dev.: 0.0058) MultiSource/Applications/spiff/spiff: 9.14% (0.7835 => 0.8551, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.13% (0.9765 => 1.0657, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.12% (8.1363 => 8.8783, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.10% (0.2065 => 0.2253, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.07% (1.5859 => 1.7297, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.04% (0.1117 => 0.1218, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.04% (0.3307 => 0.3606, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 9.02% (1.0722 => 1.1689, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 8.99% (2.0273 => 2.2095, std.dev.: 0.0054) MultiSource/Applications/siod/siod: 8.96% (2.2969 => 2.5027, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.92% (0.5020 => 0.5468, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 8.92% (0.6456 => 0.7032, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.87% (7.9617 => 8.6682, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.75% (0.1337 => 0.1454, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 8.67% (1.5603 => 1.6956, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 8.50% (0.3387 => 0.3675, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.46% (0.3441 => 0.3732, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 8.36% (0.1268 => 0.1374, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 8.33% (0.3180 => 0.3445, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.11% (1.1861 => 1.2823, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.11% (2.2024 => 2.3810, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.02% (0.4103 => 0.4432, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/05-eks/eks: 7.86% (0.4299 => 0.4637, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.81% (0.6450 => 0.6954, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.71% (0.3865 => 0.4163, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.68% (0.2603 => 0.2803, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 7.66% (0.6030 => 0.6492, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 7.61% (21.9371 => 23.6059, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/football/football: 7.60% (0.8921 => 0.9599, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 7.59% (0.5925 => 0.6375, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.59% (0.4636 => 0.4988, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.54% (0.4203 => 0.4520, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.53% (0.4289 => 0.4612, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/neural/neural: 7.38% (0.1463 => 0.1571, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.36% (0.4620 => 0.4960, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.32% (0.1695 => 0.1819, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.31% (0.5981 => 0.6418, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 7.31% (0.3422 => 0.3672, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.24% (0.3826 => 0.4103, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.24% (1.4186 => 1.5213, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 7.02% (0.7326 => 0.7840, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/moments: 6.99% (0.4048 => 0.4331, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.88% (0.3650 => 0.3901, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.83% (0.3603 => 0.3849, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 6.60% (0.3684 => 0.3927, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.55% (1.1840 => 1.2616, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 6.47% (0.2905 => 0.3093, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.44% (0.3136 => 0.3338, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.39% (0.3162 => 0.3364, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.22% (0.2266 => 0.2407, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 6.20% (0.2871 => 0.3049, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.19% (0.2891 => 0.3070, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.19% (0.1906 => 0.2024, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.17% (2.0665 => 2.1939, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 6.15% (0.2831 => 0.3005, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 6.07% (0.3098 => 0.3286, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.01% (0.8101 => 0.8588, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.91% (0.2756 => 0.2919, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 5.91% (0.3283 => 0.3477, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 5.88% (0.3232 => 0.3422, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.85% (0.2872 => 0.3040, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 5.83% (0.2725 => 0.2884, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 5.80% (0.2877 => 0.3044) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.76% (0.1892 => 0.2001, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.71% (0.4064 => 0.4296, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.70% (0.3052 => 0.3226, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.59% (0.2793 => 0.2949, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 5.56% (0.2714 => 0.2865, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 5.50% (0.3379 => 0.3565, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 5.46% (0.2802 => 0.2955, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: 5.42% (0.2049 => 0.2160, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.02% (14.3668 => 15.0883, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.96% (0.3427 => 0.3597, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 4.84% (17.1811 => 18.0133, std.dev.: 0.0201) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.71% (3.8922 => 4.0757, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/objinst: 4.66% (0.3131 => 0.3277, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 4.66% (1.2842 => 1.3440, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.57% (0.2430 => 0.2541, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.59% (1.1194 => 1.1596, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 3.49% (0.3092 => 0.3200, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.30% (0.3817 => 0.3943, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.51% (5.3999 => 13.3115, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.25% (1.1145 => 1.3848, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650) SingleSource/Benchmarks/Misc/richards_benchmark: 9.95% (1.1396 => 1.2530, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4498, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.64% (3.1578 => 3.3676, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.72% (3.6395 => 3.7748, std.dev.: 0.0044) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.78% (4.2280 => 4.3457, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.70% (0.8275 => 0.8416, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.35% (11.6436 => 11.8011, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.32% (2.6546 => 2.6897, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1314, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.09% (0.8651 => 0.1722, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.96% (5.2763 => 3.2736, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.98% (5.3855 => 3.7170, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.64% (5.3526 => 3.7128, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -14.66% (54.1659 => 46.2249, std.dev.: 0.0588) MultiSource/Applications/ClamAV/clamscan: -11.94% (22.1758 => 19.5272, std.dev.: 0.0125) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.21% (2.9384 => 2.6385, std.dev.: 0.0136) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.38% (1.1492 => 0.7656, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.79% (1.6925 => 1.4252, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.83% (0.0998 => 0.0860, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -12.20% (1.2373 => 1.0864, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/mandel-2: -10.32% (1.5373 => 1.3786, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/mason/mason: -9.72% (0.2161 => 0.1951, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.23% (19.9488 => 18.3065, std.dev.: 0.0293) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4781, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.68% (1.8329 => 1.7105, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5757, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8479, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.32% (1.6805 => 1.5911, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5090, std.dev.: 0.0014) MultiSource/Applications/siod/siod: -3.74% (3.2827 => 3.1600, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4987, std.dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: -2.99% (12.4730 => 12.0996, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.85% (0.9957 => 0.9673, std.dev.: 0.0051) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.07% (8.6802 => 8.5002, std.dev.: 0.0160) SingleSource/Benchmarks/Misc/salsa20: -2.02% (10.2830 => 10.0757, std.dev.: 0.0100) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.87% (8.1563 => 8.0041, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6818, std.dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std.dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4209, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 14.19% (0.5229 => 0.5971, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 10.09% (14.9895 => 16.5023, std.dev.: 0.0207) MultiSource/Benchmarks/MallocBench/gs/gs: 8.93% (4.1105 => 4.4776, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.39% (1.1048 => 1.2638, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.30% (7.1582 => 7.9673, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.85% (0.6222 => 0.7457, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35500.00% (0.0001 => 0.0356, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.43% (0.1485 => 0.1434, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.48% (0.2116 => 0.0667, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 14 22:48:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 15 Oct 2012 00:48:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121015054809.7A9802A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4877?compare_to=4875&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4877, Order: 165915, Start Time: 2012-10-15 04:25:09, End Time: 2012-10-15 05:51:03 To: 4875, Order: 165914, Start Time: 2012-10-15 01:02:54, End Time: 2012-10-15 02:28:40 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (188 on baseline) Performance Improvements: 2 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1040 (677 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.63% (0.7927 => 0.7798, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.04% (3.8403 => 3.7621, std.dev.: 0.0066) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.27% (2.0176 => 2.5072, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.72% (0.1410 => 0.1674, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 17.55% (0.0826 => 0.0971) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.46% (0.0653 => 0.0767) MultiSource/Benchmarks/McCat/08-main/main: 16.76% (0.2243 => 0.2619, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.39% (0.1072 => 0.1237, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.69% (0.1327 => 0.1522, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 14.12% (0.1013 => 0.1156, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.67% (0.0834 => 0.0948, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.38% (0.1413 => 0.1602, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.17% (0.0964 => 0.1091, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 13.17% (0.7038 => 0.7965, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.82% (3.9660 => 4.4744, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.60% (0.2596 => 0.2923, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.53% (0.2721 => 0.3062, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.53% (0.1588 => 0.1787, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 12.46% (1.3693 => 1.5399, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.24% (0.6959 => 0.7811, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.18% (1.4563 => 1.6337, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 12.16% (0.4062 => 0.4556, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 12.15% (0.4328 => 0.4854, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 12.12% (13.8202 => 15.4953, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.11% (0.9199 => 1.0313, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.08% (0.5265 => 0.5901, std.dev.: 0.0020) MultiSource/Applications/aha/aha: 12.05% (0.1062 => 0.1190) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.05% (0.6283 => 0.7040, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.97% (1.2193 => 1.3653, std.dev.: 0.0064) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.83% (0.7710 => 0.8622, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 11.76% (0.1003 => 0.1121, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.63% (1.1364 => 1.2686, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 11.48% (0.0976 => 0.1088, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 11.37% (1.0313 => 1.1486, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.21% (0.3130 => 0.3481, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 11.21% (0.5818 => 0.6470, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.15% (0.1157 => 0.1286, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.13% (0.3899 => 0.4333, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.09% (0.3022 => 0.3357, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.06% (0.5577 => 0.6194, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 11.06% (1.1061 => 1.2284, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 10.84% (16.6129 => 18.4144, std.dev.: 0.0096) SingleSource/UnitTests/ObjC++/Hello: 10.79% (0.5748 => 0.6368, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.77% (0.4791 => 0.5307, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.76% (0.3485 => 0.3860, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.70% (0.3580 => 0.3963, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.68% (0.4016 => 0.4445, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.57% (0.3246 => 0.3589, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 10.56% (0.6744 => 0.7456, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.51% (0.1075 => 0.1188, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 10.47% (2.1791 => 2.4073, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference: 10.44% (0.7061 => 0.7798, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.39% (0.2127 => 0.2348, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 10.38% (0.2995 => 0.3306, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/gs/gs: 10.38% (3.8646 => 4.2656, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.36% (0.3756 => 0.4145, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 10.34% (1.9270 => 2.1262, std.dev.: 0.0079) SingleSource/Benchmarks/McGill/chomp: 10.32% (0.1589 => 0.1753, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 10.32% (0.2781 => 0.3068, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.28% (0.4379 => 0.4829, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 10.26% (0.3293 => 0.3631, std.dev.: 0.0107) MultiSource/Benchmarks/McCat/18-imp/imp: 10.25% (0.3220 => 0.3550, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.24% (0.0977 => 0.1077) MultiSource/Benchmarks/Prolangs-C/football/football: 10.22% (0.8310 => 0.9159, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.20% (0.3489 => 0.3845, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.19% (0.2914 => 0.3211, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 10.17% (0.1111 => 0.1224, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.13% (4.9865 => 5.4917, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.11% (0.2966 => 0.3266, std.dev.: 0.0045) MultiSource/Applications/d/make_dparser: 10.08% (3.1889 => 3.5104, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.04% (0.5637 => 0.6203, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.03% (0.8698 => 0.9570, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 9.99% (0.3453 => 0.3798, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.97% (0.7460 => 0.8204, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.97% (0.1865 => 0.2051, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.96% (0.1014 => 0.1115, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.95% (0.1276 => 0.1403, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 9.93% (0.3868 => 0.4252, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 9.93% (0.7506 => 0.8251, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 9.88% (0.1478 => 0.1624, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.83% (0.1435 => 0.1576, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.82% (0.1569 => 0.1723, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.81% (0.2782 => 0.3055, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.77% (0.1986 => 0.2180, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 9.76% (0.2726 => 0.2992, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.74% (0.2023 => 0.2220, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 9.68% (0.2925 => 0.3208, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 9.59% (0.3534 => 0.3873, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.59% (0.4390 => 0.4811, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 9.56% (0.3149 => 0.3450, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.53% (1.9828 => 2.1717, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 9.53% (0.3107 => 0.3403, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 9.47% (0.2607 => 0.2854, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.43% (7.2180 => 7.8987, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/except: 9.42% (0.2760 => 0.3020, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.42% (0.2655 => 0.2905, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 9.41% (1.0594 => 1.1591, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 9.41% (0.2690 => 0.2943, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/fibo: 9.40% (0.2628 => 0.2875, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/methcall: 9.38% (0.2761 => 0.3020, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 9.30% (0.2937 => 0.3210, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.26% (0.2765 => 0.3021, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 9.15% (0.3192 => 0.3484, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.13% (1.3245 => 1.4454, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 9.11% (0.1657 => 0.1808, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 9.07% (0.3131 => 0.3415, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.98% (3.6692 => 3.9986, std.dev.: 0.0043) MultiSource/Applications/SIBsim4/SIBsim4: 8.94% (1.2749 => 1.3889, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.94% (0.2696 => 0.2937, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 8.87% (0.2988 => 0.3253, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.87% (0.3755 => 0.4088, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.87% (0.6576 => 0.7159, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 8.71% (14.8535 => 16.1475, std.dev.: 0.0155) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.67% (1.5188 => 1.6505, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.58% (4.3801 => 4.7560, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.53% (4.4433 => 4.8224, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.51% (0.8818 => 0.9568, std.dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: 8.47% (8.4961 => 9.2155, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.44% (0.6135 => 0.6653, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.39% (3.2742 => 3.5488, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/objinst: 8.32% (0.2945 => 0.3190, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.17% (0.9108 => 0.9852, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.14% (0.2321 => 0.2510, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.12% (0.3511 => 0.3796, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.04% (0.2140 => 0.2312, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 8.02% (0.6250 => 0.6751, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.99% (0.1789 => 0.1932, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.97% (1.1333 => 1.2236, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 7.91% (4.6629 => 5.0317, std.dev.: 0.0021) MultiSource/Applications/lua/lua: 7.88% (3.7467 => 4.0420, std.dev.: 0.0090) MultiSource/Benchmarks/McCat/05-eks/eks: 7.85% (0.4113 => 0.4436, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: 7.73% (0.1385 => 0.1492, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.72% (2.1007 => 2.2629, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.70% (0.4805 => 0.5175, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 7.67% (0.4003 => 0.4310, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 7.52% (6.5754 => 7.0697, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.49% (0.3245 => 0.3488, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.47% (0.2504 => 0.2691, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 7.42% (0.2008 => 0.2157, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.41% (0.3914 => 0.4204, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.36% (0.3940 => 0.4230, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.04% (0.3578 => 0.3830, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.02% (0.3789 => 0.4055, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.99% (0.3650 => 0.3905, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 6.94% (0.3601 => 0.3851, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.94% (0.3646 => 0.3899, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 6.92% (1.2292 => 1.3143, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 6.91% (0.3663 => 0.3916, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.83% (13.2842 => 14.1916, std.dev.: 0.0144) SingleSource/UnitTests/ObjC/exceptions-3: 6.79% (0.3623 => 0.3869, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.78% (6.2785 => 6.7039, std.dev.: 0.0097) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.10% (0.1819 => 0.1930, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.62% (0.2243 => 0.2369, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 5.09% (16.2614 => 17.0884, std.dev.: 0.0050) MultiSource/Applications/ClamAV/clamscan: 4.66% (14.5298 => 15.2067, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/bh/bh: 3.53% (0.2859 => 0.2960, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 2.00% (33.2944 => 33.9613, std.dev.: 0.0183) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5131, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.06% (1.0895 => 1.3625, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.68% (1.8175 => 2.2660, std.dev.: 0.0356) SingleSource/Benchmarks/Misc/richards_benchmark: 11.23% (1.1560 => 1.2858, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922) SingleSource/Benchmarks/Misc/ffbench: 8.99% (0.8273 => 0.9017, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.70% (0.1322 => 0.1437) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4137, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.11% (1.2998 => 1.3792, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0042, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.91% (11.2619 => 11.7017, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-6: 3.48% (1.9199 => 1.9867, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 3.23% (10.7476 => 11.0948, std.dev.: 0.0330) SingleSource/Benchmarks/Misc/salsa20: 2.27% (7.4271 => 7.5956, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4536, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5143, std.dev.: 0.0068) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1846, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5779, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0276, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5909, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.78% (0.2670 => 0.1421, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.87% (0.4657 => 0.3918, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -14.14% (0.0707 => 0.0607, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.10% (1.3813 => 1.2004, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.95% (1.3819 => 1.2029, std.dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.14% (0.0997 => 0.0856, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -11.93% (0.2238 => 0.1971, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.19% (1.2308 => 1.0931, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.08% (20.3410 => 18.2902, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.52% (1.3780 => 1.3019, std.dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.11% (2.6470 => 2.5118, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.65% (0.9996 => 0.9631, std.dev.: 0.0063) MultiSource/Applications/siod/siod: -3.55% (3.2729 => 3.1567, std.dev.: 0.0233) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.46% (1.7688 => 1.7076, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: -2.53% (0.5449 => 0.5311, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4785, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.53% (26.5159 => 25.8456, std.dev.: 0.0317) MultiSource/Applications/spiff/spiff: -2.47% (3.0263 => 2.9517, std.dev.: 0.0015) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.34% (1.9762 => 1.9299, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.09% (0.6589 => 0.6451, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7143, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/lists: -1.79% (6.3560 => 6.2423, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.44% (3.9173 => 3.8610, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0080, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.29% (2.5254 => 2.4927, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.23% (0.8342 => 0.8239, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2570, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 15 00:35:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 15 Oct 2012 02:35:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121015073514.A003A2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/4878?compare_to=4876&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4878, Order: 165918, Start Time: 2012-10-15 06:13:35, End Time: 2012-10-15 07:37:07 To: 4876, Order: 165915, Start Time: 2012-10-15 04:24:10, End Time: 2012-10-15 05:44:16 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (158 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 952 (690 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 3.54% (19.5272 => 20.2189, std.dev.: 0.0354) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.64% (0.5971 => 0.6009, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 0.07% (16.5023 => 16.5145, std.dev.: 0.0281) MultiSource/Benchmarks/Bullet/bullet: -2.02% (55.9203 => 54.7923, std.dev.: 0.4930) MultiSource/Benchmarks/MallocBench/gs/gs: -0.13% (4.4776 => 4.4716, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0463 => 0.0463, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0465 => 0.0465, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0433 => 0.0433, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.23% (0.0434 => 0.0433, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.24% (0.0422 => 0.0421, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0424 => 0.0424, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0416 => 0.0416, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.24% (0.0418 => 0.0417, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0434 => 0.0434, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.23% (0.0435 => 0.0436, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.23% (0.0428 => 0.0429, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 4.19% (0.0430 => 0.0448, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0418 => 0.0418, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.24% (0.0421 => 0.0420, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.23% (0.0426 => 0.0425, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0427 => 0.0427, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.23% (0.0437 => 0.0438, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.23% (0.0439 => 0.0438, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0413 => 0.0413, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0414 => 0.0414, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.24% (0.0425 => 0.0426, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.23% (0.0427 => 0.0426, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0417 => 0.0417, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0418 => 0.0418, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0409 => 0.0409, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0411 => 0.0411, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0407 => 0.0407, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0409 => 0.0409, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0445 => 0.0445, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0446 => 0.0446, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.25% (0.0407 => 0.0406, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0408 => 0.0408, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.25% (0.0407 => 0.0408, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0408 => 0.0408, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.24% (0.0416 => 0.0415, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.24% (0.0416 => 0.0417, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.21% (1.2638 => 1.2664, std.dev.: 0.0254) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.07% (7.9673 => 7.9614, std.dev.: 0.2076) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.30% (0.7457 => 0.7479, std.dev.: 0.0067) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 1.40% (0.0356 => 0.0361, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1434 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.55% (0.0667 => 0.0704, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -13.36% (63.2438 => 54.7923, std.dev.: 0.4930) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.78% (14.1553 => 19.0782, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++-EH/spirit: 65.47% (3.4629 => 5.7300, std.dev.: 0.0013) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14221.94% (0.0720 => 10.3118, std.dev.: 0.0140) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952200.00% (0.0001 => 9.9523, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 60.45% (0.2554 => 0.4098, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: 46.73% (10.3673 => 15.2121, std.dev.: 0.1343) SingleSource/Benchmarks/Misc/richards_benchmark: 37.48% (0.1622 => 0.2230, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/distray/distray: 33.43% (0.1056 => 0.1409, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 18.37% (0.1432 => 0.1695, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.39% (7.0540 => 8.2809, std.dev.: 0.1444) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.35% (2.2022 => 2.5842, std.dev.: 0.0052) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.77% (0.1566 => 0.1813, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 15.48% (0.0730 => 0.0843, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 13.49% (0.0793 => 0.0900, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.43% (0.0871 => 0.0988, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.30% (0.1143 => 0.1295) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.81% (1.7609 => 1.9864, std.dev.: 0.0341) SingleSource/Benchmarks/Misc/oourafft: 12.55% (0.3282 => 0.3694, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 12.50% (0.1440 => 0.1620, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 12.50% (0.1584 => 0.1782, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 11.57% (0.7433 => 0.8293, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.42% (0.4879 => 0.5436, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.30% (0.2700 => 0.3005, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 11.27% (0.7115 => 0.7917, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.26% (0.3543 => 0.3942, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.95% (0.3927 => 0.4357, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.84% (1.5415 => 1.7086, std.dev.: 0.0436) SingleSource/UnitTests/ObjC/trivial-interface: 10.83% (0.3473 => 0.3849, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 10.82% (0.1655 => 0.1834, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 10.68% (0.1555 => 0.1721, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions-4: 10.67% (0.3543 => 0.3921, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 10.67% (0.3516 => 0.3891, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 10.64% (0.3497 => 0.3869, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 10.61% (0.3561 => 0.3939, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.61% (0.6675 => 0.7383, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.58% (0.3694 => 0.4085, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 10.52% (0.3886 => 0.4295, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.48% (0.3828 => 0.4229, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 10.47% (0.1175 => 0.1298, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.44% (0.4615 => 0.5097, std.dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.35% (0.8067 => 0.8902, std.dev.: 0.0073) MultiSource/Applications/d/make_dparser: 10.30% (3.3354 => 3.6791, std.dev.: 0.0055) MultiSource/Benchmarks/mafft/pairlocalalign: 10.23% (9.4845 => 10.4544, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.22% (0.2758 => 0.3040, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.17% (0.3177 => 0.3500, std.dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.15% (0.1438 => 0.1584, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.11% (0.5105 => 0.5621, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 10.09% (0.1695 => 0.1866, std.dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.04% (0.1125 => 0.1238, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 10.02% (0.3423 => 0.3766, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.87% (0.1236 => 0.1358, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.85% (0.5860 => 0.6437, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.84% (0.5569 => 0.6117, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 9.79% (0.1032 => 0.1133, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 9.75% (0.3109 => 0.3412, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.74% (0.1940 => 0.2129, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 9.67% (1.1642 => 1.2768, std.dev.: 0.0086) MultiSource/Applications/aha/aha: 9.64% (0.1151 => 0.1262, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.62% (4.2646 => 4.6749, std.dev.: 0.0051) MultiSource/Applications/lua/lua: 9.61% (3.8723 => 4.2445, std.dev.: 0.0140) MultiSource/Applications/oggenc/oggenc: 9.58% (5.7591 => 6.3107, std.dev.: 0.0145) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.56% (0.2271 => 0.2488, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.53% (1.3050 => 1.4294, std.dev.: 0.0044) MultiSource/Applications/JM/ldecod/ldecod: 9.51% (10.4361 => 11.4289, std.dev.: 0.0253) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.36% (5.0018 => 5.4702, std.dev.: 0.1254) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.36% (4.9449 => 5.4078, std.dev.: 0.1197) MultiSource/Applications/hbd/hbd: 9.33% (1.5603 => 1.7059, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/mst/mst: 9.29% (0.1163 => 0.1271, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.27% (0.1510 => 0.1650, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.25% (0.2107 => 0.2302, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 9.23% (0.6456 => 0.7052, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 9.07% (1.0722 => 1.1695, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 9.03% (2.0273 => 2.2103, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.01% (0.3307 => 0.3605, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.99% (8.1363 => 8.8675, std.dev.: 0.0157) MultiSource/Applications/spiff/spiff: 8.97% (0.7835 => 0.8538, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.97% (0.9765 => 1.0641, std.dev.: 0.0042) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.94% (0.3121 => 0.3400, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.75% (1.5859 => 1.7247, std.dev.: 0.0176) MultiSource/Applications/siod/siod: 8.73% (2.2969 => 2.4975, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.73% (0.5020 => 0.5458, std.dev.: 0.0033) MultiSource/Benchmarks/sim/sim: 8.68% (0.3387 => 0.3681, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.60% (0.3441 => 0.3737, std.dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.53% (7.9617 => 8.6408, std.dev.: 0.1125) MultiSource/Benchmarks/McCat/09-vor/vor: 8.52% (0.3180 => 0.3451, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.38% (0.3865 => 0.4189, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 8.30% (0.3422 => 0.3706, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/Hello: 8.19% (0.5925 => 0.6410, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.15% (0.1337 => 0.1446, std.dev.: 0.0037) SingleSource/UnitTests/ObjC++/property-reference-object: 8.11% (0.6030 => 0.6519, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 8.04% (0.1268 => 0.1370, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 8.02% (0.4289 => 0.4633, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.02% (1.1861 => 1.2812, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.99% (0.4203 => 0.4539, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.83% (2.2024 => 2.3748, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 7.72% (0.8921 => 0.9610, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.71% (0.3826 => 0.4121, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/hash2: 7.66% (0.4620 => 0.4974, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 7.63% (0.4048 => 0.4357, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.61% (0.2603 => 0.2801, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.60% (0.6450 => 0.6940, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 7.57% (21.9371 => 23.5970, std.dev.: 0.0305) MultiSource/Benchmarks/McCat/05-eks/eks: 7.54% (0.4299 => 0.4623, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: 7.52% (0.1463 => 0.1573, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.49% (0.7326 => 0.7875, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.40% (0.3650 => 0.3920, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/sieve: 7.35% (0.3603 => 0.3868, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.29% (0.4636 => 0.4974, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/lists1: 7.22% (0.3684 => 0.3950, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.20% (0.1695 => 0.1817, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.20% (1.4186 => 1.5207, std.dev.: 0.0070) SingleSource/Regression/C++/ofstream_ctor: 7.09% (0.2905 => 0.3111, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.06% (0.5981 => 0.6403, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.02% (0.2891 => 0.3094, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.97% (0.2725 => 0.2915, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.96% (0.3162 => 0.3382, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/strcat: 6.78% (0.2831 => 0.3023, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.75% (0.2756 => 0.2942, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 6.71% (0.3232 => 0.3449, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary3: 6.61% (0.3283 => 0.3500, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 6.60% (1.1840 => 1.2621, std.dev.: 0.0267) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.59% (0.2793 => 0.2977, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 6.59% (0.3052 => 0.3253, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.56% (0.2714 => 0.2892, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 6.55% (0.3098 => 0.3301, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.51% (0.2872 => 0.3059, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 6.48% (0.2871 => 0.3057, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.43% (0.2877 => 0.3062, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.39% (0.2802 => 0.2981, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.31% (0.8101 => 0.8612, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 6.24% (0.3379 => 0.3590, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.15% (0.4064 => 0.4314, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.69% (0.2266 => 0.2395, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.22% (0.3427 => 0.3606, std.dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 5.15% (1.2842 => 1.3503, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/objinst: 5.11% (0.3131 => 0.3291, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: 5.03% (0.2049 => 0.2152, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 4.93% (17.1811 => 18.0274, std.dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.49% (3.8922 => 4.0669, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/bh/bh: 3.59% (0.3092 => 0.3203, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.09% (0.3817 => 0.3935, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.22% (1.1145 => 1.3844, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.62% (0.2944 => 0.3286, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 10.00% (1.1396 => 1.2536, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0012) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4499, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.72% (3.1578 => 3.3701, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.47% (3.6395 => 3.7657, std.dev.: 0.0047) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.73% (4.2280 => 4.3436, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.29% (1.7254 => 1.7649, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.74% (0.8275 => 0.8419, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std.dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 1.36% (11.6436 => 11.8016, std.dev.: 0.0157) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.16% (2.6546 => 2.6854, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.14% (6.5088 => 6.5827, std.dev.: 0.0217) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1310, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/salsa20: -80.08% (0.8651 => 0.1723, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.23% (5.2763 => 3.2591, std.dev.: 0.0540) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.27% (5.3855 => 3.7012, std.dev.: 0.0504) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.83% (5.3526 => 3.7023, std.dev.: 0.0565) SingleSource/UnitTests/Vector/constpool: -14.62% (54.1659 => 46.2483, std.dev.: 0.0115) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.45% (2.9384 => 2.6314, std.dev.: 0.0707) MultiSource/Applications/ClamAV/clamscan: -8.82% (22.1758 => 20.2189, std.dev.: 0.0354) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -33.37% (1.1492 => 0.7657, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -15.93% (1.6925 => 1.4229, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.53% (0.0998 => 0.0863, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -11.37% (1.2373 => 1.0966, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -10.30% (1.5373 => 1.3789, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/mason/mason: -10.04% (0.2161 => 0.1944, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.29% (19.9488 => 18.2944, std.dev.: 0.0614) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.71% (1.8329 => 1.7100, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5753, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.28% (1.6805 => 1.5917, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7966, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.93% (1.5835 => 1.5055, std.dev.: 0.0023) MultiSource/Applications/siod/siod: -3.74% (3.2827 => 3.1600, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.69% (0.9957 => 0.9590, std.dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4956, std.dev.: 0.0071) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0987, std.dev.: 0.0014) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.95% (10.2830 => 10.0826, std.dev.: 0.0416) SingleSource/Regression/C/uint64_to_float: -1.88% (0.5413 => 0.5311, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.87% (8.1563 => 8.0040, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6819, std.dev.: 0.0015) SingleSource/UnitTests/Vector/multiplies: -1.68% (2.5528 => 2.5098, std.dev.: 0.0021) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4207, std.dev.: 0.0420) SingleSource/Benchmarks/Shootout/lists: -1.14% (6.2999 => 6.2279, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 14.92% (0.5229 => 0.6009, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 10.17% (14.9895 => 16.5145, std.dev.: 0.0281) MultiSource/Benchmarks/MallocBench/gs/gs: 8.78% (4.1105 => 4.4716, std.dev.: 0.0178) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.63% (1.1048 => 1.2664, std.dev.: 0.0254) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.22% (7.1582 => 7.9614, std.dev.: 0.2076) SingleSource/Benchmarks/Misc-C++/stepanov_container: 20.20% (0.6222 => 0.7479, std.dev.: 0.0067) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36000.00% (0.0001 => 0.0361, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -66.73% (0.2116 => 0.0704, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 15 00:47:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 15 Oct 2012 02:47:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121015074701.CB6682A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/4879?compare_to=4877&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4879, Order: 165920, Start Time: 2012-10-15 06:21:04, End Time: 2012-10-15 07:49:54 To: 4877, Order: 165915, Start Time: 2012-10-15 04:25:09, End Time: 2012-10-15 05:51:03 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (180 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1042 (688 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.73% (2.0176 => 2.4964, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.51% (0.1410 => 0.1671, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.92% (0.0653 => 0.0770, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 17.07% (0.0826 => 0.0967, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 16.63% (0.2243 => 0.2616, std.dev.: 0.0018) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.42% (0.1072 => 0.1248, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 13.92% (0.1013 => 0.1154, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 13.67% (0.1478 => 0.1680, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.49% (0.1327 => 0.1506, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.43% (0.0834 => 0.0946, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 13.38% (0.7038 => 0.7980, std.dev.: 0.0209) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.09% (0.1413 => 0.1598, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.97% (0.0964 => 0.1089, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 12.62% (0.1062 => 0.1196, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.56% (0.6959 => 0.7833, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.53% (0.2721 => 0.3062, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.53% (3.9660 => 4.4630, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.47% (0.1588 => 0.1786, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 12.47% (1.3693 => 1.5400, std.dev.: 0.0405) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.40% (0.2596 => 0.2918, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 11.98% (13.8202 => 15.4764, std.dev.: 0.3463) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.84% (1.4563 => 1.6287, std.dev.: 0.0050) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.79% (0.7710 => 0.8619, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.73% (0.6283 => 0.7020, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.73% (0.9199 => 1.0278, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.66% (0.5265 => 0.5879, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: 11.57% (0.1003 => 0.1119, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.56% (1.2193 => 1.3603, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 11.53% (0.4328 => 0.4827, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.47% (1.1364 => 1.2668, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 11.47% (0.4062 => 0.4528, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 11.31% (1.0313 => 1.1479, std.dev.: 0.0374) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.24% (0.1157 => 0.1287, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 11.03% (1.1061 => 1.2281, std.dev.: 0.0395) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.02% (0.3130 => 0.3475, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.77% (0.3899 => 0.4319, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.71% (0.2914 => 0.3226, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.69% (0.4791 => 0.5303, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.67% (0.5577 => 0.6172, std.dev.: 0.0028) MultiSource/Applications/siod/siod: 10.66% (2.1791 => 2.4115, std.dev.: 0.0761) MultiSource/Applications/minisat/minisat: 10.62% (0.6744 => 0.7460, std.dev.: 0.0244) MultiSource/Applications/kimwitu++/kc: 10.61% (16.6129 => 18.3747, std.dev.: 0.2793) SingleSource/UnitTests/ObjC++/property-reference-object: 10.48% (0.5818 => 0.6428, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.36% (0.1014 => 0.1119, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 10.32% (3.8646 => 4.2635, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.23% (0.4379 => 0.4827, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.22% (0.3485 => 0.3841, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 10.21% (0.5748 => 0.6335, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.20% (0.2127 => 0.2344, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 10.17% (1.9270 => 2.1229, std.dev.: 0.0553) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.14% (0.3246 => 0.3575, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.10% (0.1435 => 0.1580, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.09% (0.3756 => 0.4135, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.08% (0.1865 => 0.2053, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: 10.07% (0.1589 => 0.1749, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.05% (0.1075 => 0.1183, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 10.03% (0.7506 => 0.8259, std.dev.: 0.0249) MultiSource/Benchmarks/McCat/18-imp/imp: 10.03% (0.3220 => 0.3543, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/mst/mst: 9.99% (0.1111 => 0.1222, std.dev.: 0.0021) MultiSource/Applications/d/make_dparser: 9.99% (3.1889 => 3.5074, std.dev.: 0.0664) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.99% (0.4016 => 0.4417, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.93% (4.9865 => 5.4817, std.dev.: 0.0045) MultiSource/Applications/sgefa/sgefa: 9.92% (0.2995 => 0.3292, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.83% (0.3580 => 0.3932, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 9.78% (0.8310 => 0.9123, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.76% (0.7460 => 0.8188, std.dev.: 0.0058) SingleSource/UnitTests/ObjC++/property-reference: 9.76% (0.7061 => 0.7750, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.75% (0.8698 => 0.9546, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 9.74% (0.2925 => 0.3210, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.70% (0.3022 => 0.3315, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 9.64% (0.2781 => 0.3049, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 9.59% (0.3868 => 0.4239, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.56% (0.5637 => 0.6176, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 9.54% (0.3293 => 0.3607, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.52% (0.1986 => 0.2175, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.50% (0.1569 => 0.1718, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.49% (0.3489 => 0.3820, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.44% (0.2023 => 0.2214, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.41% (0.4390 => 0.4803, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.27% (0.2782 => 0.3040, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 9.27% (0.3453 => 0.3773, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.25% (0.1276 => 0.1394, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.23% (7.2180 => 7.8841, std.dev.: 0.0102) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.20% (0.3511 => 0.3834, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.15% (0.6576 => 0.7178, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.14% (1.3245 => 1.4455, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 9.12% (1.0594 => 1.1560, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.11% (1.9828 => 2.1634, std.dev.: 0.0107) MultiSource/Benchmarks/Olden/em3d/em3d: 9.05% (0.1657 => 0.1807, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 9.04% (1.2749 => 1.3902, std.dev.: 0.0334) SingleSource/Benchmarks/Shootout-C++/lists1: 8.97% (0.3534 => 0.3851, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.97% (0.2966 => 0.3232, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 8.95% (0.2726 => 0.2970, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 8.95% (0.2761 => 0.3008, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 8.92% (0.3149 => 0.3430, std.dev.: 0.0028) MultiSource/Benchmarks/sim/sim: 8.91% (0.3131 => 0.3410, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 8.82% (0.3107 => 0.3381, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 8.75% (0.2607 => 0.2835, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 8.73% (0.2760 => 0.3001, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.66% (0.2655 => 0.2885, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 8.66% (0.2690 => 0.2923, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 8.66% (14.8535 => 16.1394, std.dev.: 0.3871) SingleSource/Benchmarks/Shootout-C++/ary2: 8.62% (0.3192 => 0.3467, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.61% (0.2765 => 0.3003, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.56% (3.6692 => 3.9834, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/fibo: 8.56% (0.2628 => 0.2853, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.56% (0.6135 => 0.6660, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 8.55% (0.2937 => 0.3188, std.dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.51% (1.5188 => 1.6481, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.48% (4.3801 => 4.7516, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.36% (0.3755 => 0.4069, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.35% (4.4433 => 4.8141, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/matrix: 8.33% (0.2988 => 0.3237, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.27% (0.2696 => 0.2919, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 8.24% (8.4961 => 9.1963, std.dev.: 0.0136) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.22% (0.2140 => 0.2316) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.19% (0.2321 => 0.2511, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.99% (3.2742 => 3.5358, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.88% (0.1789 => 0.1930, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 7.88% (0.2945 => 0.3177, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 7.86% (3.7467 => 4.0413, std.dev.: 0.0940) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.84% (0.8818 => 0.9509, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.82% (2.1007 => 2.2649, std.dev.: 0.0272) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.77% (0.9108 => 0.9816, std.dev.: 0.0052) MultiSource/Applications/oggenc/oggenc: 7.75% (4.6629 => 5.0241, std.dev.: 0.1117) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.69% (1.1333 => 1.2205, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.66% (0.4805 => 0.5173, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 7.57% (0.6250 => 0.6723, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 7.55% (6.5754 => 7.0719, std.dev.: 0.1758) MultiSource/Benchmarks/McCat/05-eks/eks: 7.37% (0.4113 => 0.4416, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/neural/neural: 7.36% (0.1385 => 0.1487, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.35% (0.2504 => 0.2688, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 7.07% (0.2008 => 0.2150, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.03% (0.3245 => 0.3473, std.dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.72% (6.2785 => 6.7002, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/parameter-passing: 6.67% (0.4003 => 0.4270, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.43% (13.2842 => 14.1385, std.dev.: 0.0158) SingleSource/UnitTests/ObjC/property: 6.42% (0.3940 => 0.4193, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 6.36% (0.3914 => 0.4163, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.16% (0.1819 => 0.1931, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 6.07% (0.3789 => 0.4019, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 5.98% (0.3578 => 0.3792, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-4: 5.90% (0.3646 => 0.3861, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 5.90% (0.3663 => 0.3879, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 5.86% (0.3601 => 0.3812, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 5.82% (0.3623 => 0.3834, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.75% (0.3650 => 0.3860, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.44% (0.2243 => 0.2365, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 1.66% (33.2944 => 33.8477, std.dev.: 0.0221) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5151, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.06% (1.0895 => 1.3625, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: 24.95% (1.8175 => 2.2709, std.dev.: 0.0382) SingleSource/Benchmarks/Misc/richards_benchmark: 11.03% (1.1560 => 1.2835, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1916, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 9.05% (0.8273 => 0.9022, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.47% (0.1322 => 0.1434, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4141, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 5.99% (1.2998 => 1.3776, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.65% (1.9144 => 2.0035, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.91% (11.2619 => 11.7026, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-6: 3.48% (1.9199 => 1.9868, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: 2.25% (7.4271 => 7.5943, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.46% (2.0200 => 2.0495, std.dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5131, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1883, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5780, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.13% (8.8259 => 8.9253, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0273, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5860, std.dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.67% (0.2670 => 0.1424, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.81% (0.4657 => 0.3874, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -14.14% (0.0707 => 0.0607) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.35% (1.3813 => 1.1969, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.27% (1.3819 => 1.1985, std.dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.64% (0.0997 => 0.0861, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.89% (0.2238 => 0.1972, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -11.42% (1.2308 => 1.0902, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.34% (20.3410 => 18.2372, std.dev.: 0.0223) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.49% (1.3780 => 1.2886, std.dev.: 0.0137) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5148, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.32% (0.9996 => 0.9564, std.dev.: 0.0046) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.58% (3.2729 => 3.1557, std.dev.: 0.0420) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.58% (0.4867 => 0.4693, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: -2.53% (0.5449 => 0.5311, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.43% (3.0263 => 2.9529, std.dev.: 0.0029) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.31% (1.9762 => 1.9306, std.dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.93% (0.6589 => 0.6462, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7151, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/lists: -1.79% (6.3560 => 6.2420, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0071, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.26% (0.8342 => 0.8237, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.21% (3.9173 => 3.8698, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.16% (2.5254 => 2.4961, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2588, std.dev.: 0.0100) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 15 02:25:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 15 Oct 2012 04:25:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121015092525.F389A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4880?compare_to=4878&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4880, Order: 165923, Start Time: 2012-10-15 08:06:43, End Time: 2012-10-15 09:27:19 To: 4878, Order: 165918, Start Time: 2012-10-15 06:13:35, End Time: 2012-10-15 07:37:07 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (165 on baseline) Performance Improvements: 1 (41 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 951 (681 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.99% (15.2121 => 15.5155, std.dev.: 0.0076) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.38% (0.9089 => 0.8964, std.dev.: 0.0033) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.85% (0.6009 => 0.5958, std.dev.: 0.0039) MultiSource/Applications/SPASS/SPASS: -0.31% (16.5145 => 16.4631, std.dev.: 0.0072) MultiSource/Benchmarks/Bullet/bullet: -0.18% (54.7923 => 54.6960, std.dev.: 0.0651) MultiSource/Benchmarks/MallocBench/gs/gs: -0.31% (4.4716 => 4.4578, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.22% (0.0463 => 0.0464, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.22% (0.0465 => 0.0466, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0433 => 0.0433, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.46% (0.0433 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.48% (0.0421 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0424 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0416 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.24% (0.0417 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.23% (0.0434 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.23% (0.0436 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0429 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.79% (0.0448 => 0.0431, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0418 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0420 => 0.0420, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.24% (0.0425 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0427 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0438 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.79% (0.0438 => 0.0459, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.24% (0.0413 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.24% (0.0414 => 0.0415) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0426 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.23% (0.0426 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0417 => 0.0417, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0418 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.24% (0.0409 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.24% (0.0411 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.25% (0.0407 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0409 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.22% (0.0445 => 0.0446, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.22% (0.0446 => 0.0447, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.25% (0.0406 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.25% (0.0408 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0408 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.49% (0.0408 => 0.0410) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.48% (0.0415 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.24% (0.0417 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.26% (1.2664 => 1.2631, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.04% (7.9614 => 7.9579, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.01% (0.7479 => 0.7480, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.55% (0.0361 => 0.0359, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.27% (0.0704 => 0.0688, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -13.52% (63.2438 => 54.6960, std.dev.: 0.0651) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.55% (14.1553 => 19.0465, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 65.09% (3.4629 => 5.7170, std.dev.: 0.0015) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14222.92% (0.0720 => 10.3125, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9952000.00% (0.0001 => 9.9521, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 59.95% (0.2554 => 0.4085, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: 49.66% (10.3673 => 15.5155, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/richards_benchmark: 38.59% (0.1622 => 0.2248, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 33.33% (0.1056 => 0.1408, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 18.09% (0.1432 => 0.1691) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.74% (7.0540 => 8.3054, std.dev.: 0.0087) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.72% (2.2022 => 2.5704, std.dev.: 0.0027) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.52% (0.1566 => 0.1809, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 15.29% (0.0798 => 0.0920, std.dev.: 0.0009) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.04% (0.1143 => 0.1292, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.97% (0.0871 => 0.0984, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.81% (1.7609 => 1.9864, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: 12.64% (0.1440 => 0.1622, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 12.55% (0.3282 => 0.3694, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 12.06% (0.1584 => 0.1775, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 11.42% (0.1655 => 0.1844, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 11.14% (0.7433 => 0.8261, std.dev.: 0.0144) MultiSource/Applications/minisat/minisat: 10.86% (0.7115 => 0.7888, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.83% (0.1625 => 0.1801, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.52% (0.2700 => 0.2984, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.52% (0.6675 => 0.7377, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 10.47% (0.1175 => 0.1298, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.44% (0.3543 => 0.3913, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.33% (0.4879 => 0.5383, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.29% (0.1438 => 0.1586, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.26% (1.5415 => 1.6996, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 10.21% (10.4361 => 11.5015, std.dev.: 0.0188) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.13% (0.1125 => 0.1239, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: 10.11% (0.3927 => 0.4324, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 10.08% (9.4845 => 10.4409, std.dev.: 0.0102) SingleSource/UnitTests/ObjC/trivial-interface: 9.93% (0.3473 => 0.3818, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 9.93% (3.3354 => 3.6666, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/em3d/em3d: 9.91% (0.1695 => 0.1863, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 9.85% (0.3543 => 0.3892, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.84% (0.4615 => 0.5069, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-2: 9.81% (0.3497 => 0.3840, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.79% (0.3177 => 0.3488, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 9.79% (0.3423 => 0.3758, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.78% (0.8067 => 0.8856, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/exceptions-3: 9.76% (0.3516 => 0.3859, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/property: 9.75% (0.3886 => 0.4265, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.75% (0.3694 => 0.4054, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions: 9.69% (0.3828 => 0.4199, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.69% (0.8172 => 0.8964, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/synchronized: 9.69% (0.3561 => 0.3906, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 9.59% (0.3109 => 0.3407, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.56% (0.5105 => 0.5593, std.dev.: 0.0017) MultiSource/Applications/aha/aha: 9.56% (0.1151 => 0.1261, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.55% (0.1236 => 0.1354, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 9.41% (1.1642 => 1.2738, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.40% (0.5860 => 0.6411, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.39% (4.2646 => 4.6650, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.38% (0.1940 => 0.2122, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 9.25% (0.7835 => 0.8560, std.dev.: 0.0052) MultiSource/Applications/lua/lua: 9.21% (3.8723 => 4.2289, std.dev.: 0.0145) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.21% (0.1510 => 0.1649, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 9.13% (0.1555 => 0.1697, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.13% (0.1117 => 0.1219, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.11% (0.2271 => 0.2478, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.11% (1.3050 => 1.4239, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 9.08% (5.7591 => 6.2820, std.dev.: 0.0081) MultiSource/Applications/hbd/hbd: 9.08% (1.5603 => 1.7019, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/mst/mst: 9.03% (0.1163 => 0.1268, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.02% (0.2107 => 0.2297, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 9.00% (2.0273 => 2.2097, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 8.98% (0.6456 => 0.7036, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.96% (0.2065 => 0.2250, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.94% (0.3121 => 0.3400, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.92% (0.3307 => 0.3602, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.92% (0.2758 => 0.3004, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.91% (0.5569 => 0.6065, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.82% (8.1363 => 8.8537, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.80% (4.9449 => 5.3800, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.78% (0.9765 => 1.0622, std.dev.: 0.0026) MultiSource/Applications/lemon/lemon: 8.75% (1.0722 => 1.1660, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.74% (5.0018 => 5.4390, std.dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.63% (0.5020 => 0.5453, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 8.49% (0.6030 => 0.6542, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.49% (0.7326 => 0.7948, std.dev.: 0.0081) MultiSource/Benchmarks/sim/sim: 8.44% (0.3387 => 0.3673, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 8.42% (0.5925 => 0.6424, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.41% (1.5859 => 1.7192, std.dev.: 0.0177) MultiSource/Applications/siod/siod: 8.35% (2.2969 => 2.4887, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.30% (0.1337 => 0.1448, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 8.27% (0.3180 => 0.3443, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.22% (0.3441 => 0.3724, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.22% (7.9617 => 8.6163, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.19% (0.4103 => 0.4439, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: 8.12% (0.1268 => 0.1371, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.97% (0.3865 => 0.4173, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.80% (0.2603 => 0.2806, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.72% (0.4289 => 0.4620, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists: 7.71% (0.3422 => 0.3686, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.68% (1.1861 => 1.2772, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.64% (0.4203 => 0.4524, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.61% (0.4636 => 0.4989, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (0.4620 => 0.4970, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.49% (0.6450 => 0.6933, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.47% (2.2024 => 2.3669, std.dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 7.40% (0.2905 => 0.3120, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.37% (0.1695 => 0.1820, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 7.31% (0.4048 => 0.4344, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 7.27% (0.8921 => 0.9570, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.15% (0.2756 => 0.2953, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 7.13% (0.3603 => 0.3860, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 7.12% (21.9371 => 23.4982, std.dev.: 0.0240) MultiSource/Benchmarks/McCat/05-eks/eks: 7.09% (0.4299 => 0.4604, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.09% (0.5981 => 0.6405, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.07% (0.3650 => 0.3908, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/neural/neural: 7.04% (0.1463 => 0.1566, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.98% (0.3826 => 0.4093, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 6.94% (0.2725 => 0.2914, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.88% (1.4186 => 1.5162, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.80% (0.3162 => 0.3377, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.77% (0.2793 => 0.2982, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.75% (0.2891 => 0.3086, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 6.74% (0.2714 => 0.2897, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.70% (0.3136 => 0.3346, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.68% (0.3684 => 0.3930, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.47% (2.0665 => 2.2001, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 6.46% (0.2831 => 0.3014, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.45% (0.3379 => 0.3597, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.41% (0.2871 => 0.3055, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 6.39% (1.1840 => 1.2597, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 6.31% (0.3283 => 0.3490, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.29% (0.3052 => 0.3244, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.26% (0.3098 => 0.3292, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.25% (0.3232 => 0.3434, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.20% (0.2872 => 0.3050, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.13% (0.4064 => 0.4313, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/random: 6.10% (0.2802 => 0.2973) SingleSource/Benchmarks/Shootout-C++/methcall: 6.08% (0.2877 => 0.3052, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: 6.05% (0.2049 => 0.2173, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.93% (0.1906 => 0.2019, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.93% (0.8101 => 0.8581, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.87% (0.1892 => 0.2003, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.83% (0.2266 => 0.2398, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.97% (14.3668 => 15.0814, std.dev.: 0.0181) MultiSource/Applications/hexxagon/hexxagon: 4.87% (1.2842 => 1.3468, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.84% (0.3427 => 0.3593, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.66% (0.3131 => 0.3277, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 4.55% (17.1811 => 17.9633, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.49% (0.2430 => 0.2539, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.31% (3.8922 => 4.0600, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.46% (1.1194 => 1.1581, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8961, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2173, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9648, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.85% (1.1396 => 1.2518, std.dev.: 0.0017) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4500, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3680, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.48% (3.6395 => 3.7661, std.dev.: 0.0022) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.76% (4.2280 => 4.3446, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.72% (0.8275 => 0.8417, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.46% (0.9540 => 0.9679, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.36% (11.6436 => 11.8016, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.17% (2.6546 => 2.6856, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.01% (6.6874 => 0.1333, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -79.89% (0.8651 => 0.1740, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.95% (5.2763 => 3.2740, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.75% (5.3855 => 3.6755, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.14% (5.3526 => 3.6856, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -14.72% (54.1659 => 46.1917, std.dev.: 0.0307) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.66% (2.9384 => 2.6252, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -9.16% (22.1758 => 20.1450, std.dev.: 0.0367) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7653, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.55% (1.6925 => 1.4293, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.73% (0.0998 => 0.0861, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.90% (1.2373 => 1.0900, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/mandel-2: -10.35% (1.5373 => 1.3782, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/mason/mason: -9.86% (0.2161 => 0.1948, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.17% (19.9488 => 18.3183, std.dev.: 0.0613) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.66% (1.8329 => 1.7108, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.34% (1.6805 => 1.5908, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7966) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.48% (1.5835 => 1.5126, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.57% (3.2827 => 3.1654, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.27% (0.9957 => 0.9631, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4980, std.dev.: 0.0072) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0987, std.dev.: 0.0020) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.01% (8.6802 => 8.5059, std.dev.: 0.0200) SingleSource/Benchmarks/Misc/salsa20: -1.99% (10.2830 => 10.0783, std.dev.: 0.0163) SingleSource/Regression/C/uint64_to_float: -1.88% (0.5413 => 0.5311, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.72% (8.1563 => 8.0160, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6825, std.dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5120, std.dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4204, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.20% (6.2999 => 6.2244, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.94% (0.5229 => 0.5958, std.dev.: 0.0039) MultiSource/Applications/SPASS/SPASS: 9.83% (14.9895 => 16.4631, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/gs/gs: 8.45% (4.1105 => 4.4578, std.dev.: 0.0142) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.33% (1.1048 => 1.2631, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.17% (7.1582 => 7.9579, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_container: 20.22% (0.6222 => 0.7480, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35800.00% (0.0001 => 0.0359, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.49% (0.2116 => 0.0688, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 15 02:42:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 15 Oct 2012 04:42:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121015094232.417F52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4881?compare_to=4879&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4881, Order: 165925, Start Time: 2012-10-15 08:19:25, End Time: 2012-10-15 09:45:25 To: 4879, Order: 165920, Start Time: 2012-10-15 06:21:04, End Time: 2012-10-15 07:49:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 4 (191 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1037 (674 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: 1.74% (0.7750 => 0.7885, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.47% (0.9509 => 0.9649, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.29% (54.7178 => 56.5156, std.dev.: 0.0563) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.89% (1.2886 => 1.3129, std.dev.: 0.0068) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.11% (1.3202 => 1.3056, std.dev.: 0.0024) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.65% (2.0176 => 2.4947, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.94% (0.1410 => 0.1677, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 17.55% (0.0826 => 0.0971, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.46% (0.0653 => 0.0767) MultiSource/Benchmarks/McCat/08-main/main: 17.12% (0.2243 => 0.2627, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.07% (0.1327 => 0.1527, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.46% (0.1072 => 0.1227, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 14.41% (0.1013 => 0.1159, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.03% (0.0834 => 0.0951, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.51% (0.0770 => 0.0874, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.45% (0.1413 => 0.1603, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 13.43% (0.7038 => 0.7983, std.dev.: 0.0021) MultiSource/Applications/hbd/hbd: 13.42% (1.3693 => 1.5531, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.98% (3.9660 => 4.4806, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.97% (0.0964 => 0.1089, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.91% (0.1588 => 0.1793, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.83% (0.6959 => 0.7852, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.61% (0.2721 => 0.3064, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.59% (0.0977 => 0.1100, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.56% (0.6283 => 0.7072, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.54% (0.5265 => 0.5925, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.52% (1.4563 => 1.6387, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.48% (0.2596 => 0.2920, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.45% (0.1157 => 0.1301, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.35% (0.7710 => 0.8662, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 12.32% (0.4328 => 0.4861, std.dev.: 0.0043) MultiSource/Applications/SPASS/SPASS: 12.31% (13.8202 => 15.5217, std.dev.: 0.0224) SingleSource/Benchmarks/Shootout-C++/hash: 12.24% (0.4062 => 0.4559, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.23% (1.2193 => 1.3684, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: 12.22% (0.0818 => 0.0918, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 12.16% (0.1003 => 0.1125) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.09% (0.9199 => 1.0311, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.81% (1.1364 => 1.2706, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 11.67% (0.7061 => 0.7885, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 11.65% (1.0313 => 1.1514, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.62% (0.3899 => 0.4352, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 11.53% (0.5818 => 0.6489, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.50% (0.4791 => 0.5342, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.41% (0.3130 => 0.3487, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.39% (0.2914 => 0.3246, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: 11.21% (1.1061 => 1.2301, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/Hello: 11.19% (0.5748 => 0.6391, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 11.18% (0.6744 => 0.7498, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.15% (0.5577 => 0.6199, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.05% (0.3485 => 0.3870, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.99% (0.3022 => 0.3354, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.88% (0.1075 => 0.1192, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 10.85% (0.2995 => 0.3320, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.77% (0.4390 => 0.4863, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 10.75% (16.6129 => 18.3988, std.dev.: 0.0141) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.73% (0.4379 => 0.4849, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.73% (0.3580 => 0.3964, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.71% (0.4016 => 0.4446, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 10.66% (2.1791 => 2.4113, std.dev.: 0.0063) MultiSource/Benchmarks/MallocBench/gs/gs: 10.63% (3.8646 => 4.2754, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/18-imp/imp: 10.62% (0.3220 => 0.3562, std.dev.: 0.0021) MultiSource/Applications/treecc/treecc: 10.61% (1.9270 => 2.1314, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.60% (0.3756 => 0.4154, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 10.57% (0.1589 => 0.1757, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.53% (0.8698 => 0.9614, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/mst/mst: 10.53% (0.1111 => 0.1228, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 10.52% (0.7506 => 0.8296, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.44% (0.3246 => 0.3585, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.44% (0.2127 => 0.2349, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.40% (0.1865 => 0.2059, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 10.37% (3.1889 => 3.5195, std.dev.: 0.0017) SingleSource/Regression/C++/ofstream_ctor: 10.36% (0.2781 => 0.3069, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 10.36% (0.3293 => 0.3634, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.34% (4.9865 => 5.5021, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.32% (0.7460 => 0.8230, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.29% (0.3489 => 0.3848, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 10.28% (0.1478 => 0.1630, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.28% (0.6576 => 0.7252, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.27% (0.1986 => 0.2190, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.27% (0.1276 => 0.1407, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.25% (0.2966 => 0.3270, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/football/football: 10.17% (0.8310 => 0.9155, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 10.16% (0.3868 => 0.4261, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.13% (0.1569 => 0.1728, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 10.11% (0.3453 => 0.3802, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.10% (0.1435 => 0.1580, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.09% (0.5637 => 0.6206, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.06% (0.1014 => 0.1116, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 9.98% (0.2925 => 0.3217, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 9.98% (0.2726 => 0.2998, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.92% (0.2782 => 0.3058, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.89% (0.2023 => 0.2223, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 9.84% (0.3149 => 0.3459, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 9.82% (0.3107 => 0.3412, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 9.79% (0.3534 => 0.3880, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.78% (7.2180 => 7.9237, std.dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: 9.76% (1.0594 => 1.1628, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 9.75% (0.2760 => 0.3029, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.68% (1.9828 => 2.1747, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.66% (1.3245 => 1.4524, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.66% (0.3511 => 0.3850, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.60% (0.2655 => 0.2910, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 9.54% (1.2749 => 1.3965, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 9.49% (0.3131 => 0.3428, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.48% (0.2765 => 0.3027, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 9.44% (0.2690 => 0.2944, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.42% (0.8818 => 0.9649, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 9.41% (0.1657 => 0.1813, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 9.40% (0.3192 => 0.3492, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 9.40% (0.2607 => 0.2852, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 9.38% (0.2761 => 0.3020, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 9.36% (0.2937 => 0.3212, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 9.27% (0.2988 => 0.3265, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 9.25% (0.2628 => 0.2871, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.21% (3.6692 => 4.0070, std.dev.: 0.0147) MultiSource/Applications/JM/lencod/lencod: 9.11% (14.8535 => 16.2067, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.07% (4.3801 => 4.7775, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.05% (0.2696 => 0.2940, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.01% (4.4433 => 4.8438, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.97% (0.3755 => 0.4092, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.88% (1.5188 => 1.6537, std.dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 8.86% (8.4961 => 9.2487, std.dev.: 0.0170) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.83% (0.6135 => 0.6677, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.51% (3.2742 => 3.5527, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 8.49% (0.2945 => 0.3195, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.49% (0.2321 => 0.2518, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.42% (0.9108 => 0.9875, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.38% (0.1789 => 0.1939, std.dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 8.37% (4.6629 => 5.0531, std.dev.: 0.0067) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.36% (0.2140 => 0.2319, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.22% (1.1333 => 1.2265, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.22% (0.4805 => 0.5200, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 8.22% (0.4113 => 0.4451, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 8.18% (3.7467 => 4.0533, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 8.10% (0.6250 => 0.6756, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 8.08% (6.5754 => 7.1068, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.05% (2.1007 => 2.2698, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: 8.01% (0.1385 => 0.1496, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.91% (0.2504 => 0.2702, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.89% (0.4003 => 0.4319, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 7.87% (0.2008 => 0.2166, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.77% (0.3245 => 0.3497, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.61% (0.3914 => 0.4212, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.49% (0.3940 => 0.4235, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.41% (0.3578 => 0.3843, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 7.29% (0.3663 => 0.3930, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.26% (0.3789 => 0.4064, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 7.24% (0.3646 => 0.3910, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 7.23% (1.2292 => 1.3181, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.22% (0.3601 => 0.3861, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.22% (6.2785 => 6.7318, std.dev.: 0.0113) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.21% (0.3650 => 0.3913, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 7.20% (0.3623 => 0.3884, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.91% (13.2842 => 14.2022, std.dev.: 0.0091) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.32% (0.1819 => 0.1934, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/ReedSolomon: 5.85% (0.1777 => 0.1881, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.57% (0.2243 => 0.2368, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: 5.35% (16.2614 => 17.1320, std.dev.: 0.0080) MultiSource/Applications/ClamAV/clamscan: 4.75% (14.5298 => 15.2200, std.dev.: 0.0215) MultiSource/Benchmarks/Olden/bh/bh: 3.99% (0.2859 => 0.2973, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 2.15% (33.2944 => 34.0094, std.dev.: 0.0182) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5163, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 24.55% (1.8175 => 2.2637, std.dev.: 0.0490) SingleSource/Benchmarks/Misc/richards_benchmark: 10.97% (1.1560 => 1.2828, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 9.04% (0.8273 => 0.9021, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.63% (3.1736 => 3.4156, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 5.85% (1.2998 => 1.3758, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.02% (0.2093 => 0.2198, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0041, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.90% (11.2619 => 11.7013, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.89% (1.7081 => 1.7745, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.51% (1.9199 => 1.9872, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.20% (10.7476 => 11.0920, std.dev.: 0.0476) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.19% (7.4271 => 7.5898, std.dev.: 0.0027) MultiSource/Applications/lemon/lemon: 1.76% (1.4298 => 1.4550, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0508, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5137, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2123, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9671, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1858, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5782, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (9.9194 => 10.0276, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/ary3: 1.05% (3.6975 => 3.7365, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/lists: 1.02% (12.4560 => 12.5830, std.dev.: 0.0088) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.59% (0.2670 => 0.1426, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.76% (0.4657 => 0.3923, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/mason/mason: -14.14% (0.0707 => 0.0607, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.89% (1.3813 => 1.2032, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.68% (1.3819 => 1.2067, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.44% (0.0997 => 0.0863, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.11% (0.2238 => 0.1967, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.75% (1.2308 => 1.0985, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.24% (20.3410 => 18.2578, std.dev.: 0.0144) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2652, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0122) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5141, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.72% (1.3780 => 1.3129, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.48% (0.9996 => 0.9548, std.dev.: 0.0072) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.58% (3.2729 => 3.1557, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.45% (1.7688 => 1.7077, std.dev.: 0.0034) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: -2.55% (0.5449 => 0.5310, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.52% (26.5159 => 25.8485, std.dev.: 0.0310) MultiSource/Applications/spiff/spiff: -2.47% (3.0263 => 2.9515, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.34% (1.9762 => 1.9300, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.02% (0.6589 => 0.6456, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7148, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/lists: -1.67% (6.3560 => 6.2499, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0063, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.25% (0.8342 => 0.8238, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.21% (3.9173 => 3.8700, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4952, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2575, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 15 04:13:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 15 Oct 2012 06:13:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121015111356.38F332A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4882?compare_to=4880&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4882, Order: 165928, Start Time: 2012-10-15 09:56:54, End Time: 2012-10-15 11:15:49 To: 4880, Order: 165923, Start Time: 2012-10-15 08:06:43, End Time: 2012-10-15 09:27:19 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 10 (81 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (160 on baseline) Performance Improvements: 2 (41 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (18 on baseline) Unchanged Tests: 941 (679 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/ldecod/ldecod: -5.48% (11.5015 => 10.8717, std.dev.: 0.0210) MultiSource/Applications/JM/lencod/lencod: -2.41% (23.4982 => 22.9311, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.84% (3.6856 => 3.6178, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.59% (3.6755 => 3.6170, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++-EH/spirit: -54.53% (5.7170 => 2.5996, std.dev.: 0.0014) New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/ldecod/ldecod: -99.92% (0.1254 => 0.0001) MultiSource/Applications/JM/lencod/lencod: -100.00% (10.3125 => 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -99.97% (0.3972 => 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -99.80% (0.0503 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (9.9521 => 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.35% (15.5155 => 15.3054, std.dev.: 0.0075) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/sqlite3/sqlite3: -1.09% (4.6125 => 4.5621, std.dev.: 0.0010) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.50% (0.5958 => 0.5988, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: -0.18% (16.4631 => 16.4329, std.dev.: 0.0139) MultiSource/Benchmarks/Bullet/bullet: 0.00% (54.6960 => 54.6962, std.dev.: 0.0317) MultiSource/Benchmarks/MallocBench/gs/gs: -0.11% (4.4578 => 4.4529, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.08% (0.0464 => 0.0459, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.07% (0.0466 => 0.0461, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.92% (0.0433 => 0.0429, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.15% (0.0435 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.95% (0.0423 => 0.0419) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.94% (0.0424 => 0.0420, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.72% (0.0416 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.96% (0.0418 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.92% (0.0435 => 0.0431) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.14% (0.0437 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.93% (0.0429 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.93% (0.0431 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.72% (0.0418 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.95% (0.0420 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.94% (0.0426 => 0.0422, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.70% (0.0427 => 0.0424) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.91% (0.0438 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.87% (0.0459 => 0.0455, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.97% (0.0414 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.96% (0.0415 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.94% (0.0426 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.94% (0.0427 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.72% (0.0417 => 0.0414) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.72% (0.0418 => 0.0415) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.98% (0.0410 => 0.0406) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.73% (0.0410 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.98% (0.0408 => 0.0404, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.73% (0.0409 => 0.0406) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.12% (0.0446 => 0.0441, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.89% (0.0447 => 0.0443, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.74% (0.0407 => 0.0404) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.98% (0.0409 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.74% (0.0408 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -1.22% (0.0410 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.96% (0.0417 => 0.0413) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.96% (0.0418 => 0.0414) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.08% (1.2631 => 1.2621, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.05% (7.9579 => 7.9622, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.11% (0.7480 => 0.7472, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -1.39% (0.0359 => 0.0354, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1433 => 0.1434, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.25% (0.0688 => 0.0645, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Applications/JM/ldecod/ldecod: 4.17% (10.4361 => 10.8717, std.dev.: 0.0210) MultiSource/Applications/JM/lencod/lencod: 4.53% (21.9371 => 22.9311, std.dev.: 0.0112) MultiSource/Benchmarks/Bullet/bullet: -13.52% (63.2438 => 54.6962, std.dev.: 0.0317) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.41% (5.3526 => 3.6178, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.84% (5.3855 => 3.6170, std.dev.: 0.0053) New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Applications/JM/ldecod/ldecod: -99.92% (0.1298 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -99.97% (0.3987 => 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -99.80% (0.0506 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/kimwitu++/kc: 34.44% (14.1553 => 19.0301, std.dev.: 0.0218) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 59.67% (0.2554 => 0.4078, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 47.63% (10.3673 => 15.3054, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/richards_benchmark: 36.62% (0.1622 => 0.2216, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 32.95% (0.1056 => 0.1404, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 17.88% (0.1432 => 0.1688, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.03% (7.0540 => 8.2550, std.dev.: 0.0113) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.88% (2.2022 => 2.5739, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.39% (0.1566 => 0.1807, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.21% (0.1143 => 0.1294, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.03% (1.7609 => 1.9903, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.97% (0.0871 => 0.0984, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 12.49% (0.3282 => 0.3692, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: 12.36% (0.1440 => 0.1618, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 12.12% (0.1584 => 0.1776, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 11.33% (0.7433 => 0.8275, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 10.78% (0.7115 => 0.7882, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.65% (0.1625 => 0.1798, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.41% (0.2700 => 0.2981, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.38% (0.6675 => 0.7368, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.29% (0.4879 => 0.5381, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: 10.15% (0.1655 => 0.1823, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 10.04% (0.1175 => 0.1293, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.02% (1.5415 => 1.6959, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.82% (0.3177 => 0.3489, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 9.77% (9.4845 => 10.4111, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.74% (0.5860 => 0.6431, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 9.74% (3.3354 => 3.6602, std.dev.: 0.0086) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.74% (0.1438 => 0.1578, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 9.64% (0.3423 => 0.3753, std.dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.60% (0.1125 => 0.1233, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.56% (0.4615 => 0.5056, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 9.55% (0.3927 => 0.4302, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.51% (0.3543 => 0.3880, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 9.46% (1.5603 => 1.7079, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 9.46% (0.3109 => 0.3403, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 9.44% (0.1695 => 0.1855, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.43% (0.8067 => 0.8828, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.39% (0.1236 => 0.1352, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 9.38% (0.1151 => 0.1259, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.38% (0.5105 => 0.5584, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 9.33% (0.3473 => 0.3797, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.25% (0.3828 => 0.4182, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.24% (4.2646 => 4.6586, std.dev.: 0.0132) SingleSource/UnitTests/ObjC/property: 9.21% (0.3886 => 0.4244, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 9.19% (1.1642 => 1.2712, std.dev.: 0.0061) MultiSource/Applications/lua/lua: 9.18% (3.8723 => 4.2278, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-3: 9.16% (0.3516 => 0.3838, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.15% (0.3561 => 0.3887, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 9.15% (0.7835 => 0.8552, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-2: 9.12% (0.3497 => 0.3816, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 9.12% (0.3543 => 0.3866, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.10% (0.5569 => 0.6076, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 9.08% (5.7591 => 6.2819, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.02% (0.1940 => 0.2115, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 9.01% (0.6456 => 0.7038, std.dev.: 0.0129) SingleSource/UnitTests/ObjC/for-in: 9.01% (0.3694 => 0.4027, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.97% (1.3050 => 1.4221, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.97% (0.2107 => 0.2296, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.94% (0.1510 => 0.1645, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.85% (0.2271 => 0.2472, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.84% (0.8172 => 0.8894, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.77% (0.3307 => 0.3597, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 8.75% (1.0722 => 1.1660, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 8.75% (0.1555 => 0.1691, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.68% (0.9765 => 1.0613, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.67% (0.2758 => 0.2997, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.65% (0.3121 => 0.3391, std.dev.: 0.0021) MultiSource/Applications/treecc/treecc: 8.65% (2.0273 => 2.2026, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.58% (5.0018 => 5.4311, std.dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.58% (1.5859 => 1.7219, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 8.57% (2.2969 => 2.4937, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.55% (8.1363 => 8.8319, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.51% (0.5020 => 0.5447, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.49% (4.9449 => 5.3646, std.dev.: 0.0063) MultiSource/Benchmarks/sim/sim: 8.47% (0.3387 => 0.3674, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.43% (0.2065 => 0.2239, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.29% (0.4103 => 0.4443, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.23% (0.1337 => 0.1447, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 8.04% (0.6030 => 0.6515, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/Hello: 8.02% (0.5925 => 0.6400, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.88% (0.3441 => 0.3712, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.87% (0.3865 => 0.4169, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.86% (0.4289 => 0.4626, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/09-vor/vor: 7.83% (0.3180 => 0.3429, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.77% (7.9617 => 8.5806, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.73% (0.4203 => 0.4528, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.63% (2.2024 => 2.3705, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/lists: 7.60% (0.3422 => 0.3682, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.59% (1.1861 => 1.2761, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.53% (0.4636 => 0.4985, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.45% (0.2603 => 0.2797, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.36% (0.4620 => 0.4960, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.35% (0.6450 => 0.6924, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/moments: 7.34% (0.4048 => 0.4345, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.29% (0.7326 => 0.7860, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.26% (0.1695 => 0.1818, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 7.24% (0.3603 => 0.3864, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.16% (0.3826 => 0.4100, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 7.15% (0.8921 => 0.9559, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.12% (0.3650 => 0.3910, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.99% (1.4186 => 1.5177, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: 6.90% (0.1463 => 0.1564, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 6.86% (0.4299 => 0.4594, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.79% (0.2725 => 0.2910, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.78% (0.2905 => 0.3102, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.73% (0.3136 => 0.3347, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.70% (0.3684 => 0.3931, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.67% (0.5981 => 0.6380, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.64% (0.2891 => 0.3083, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.63% (0.3379 => 0.3603, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.62% (0.2793 => 0.2978) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.61% (0.3162 => 0.3371, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.60% (0.2714 => 0.2893, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.57% (2.0665 => 2.2023, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/strcat: 6.39% (0.2831 => 0.3012, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.31% (0.3232 => 0.3436, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 6.27% (0.3283 => 0.3489, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 6.27% (0.2871 => 0.3051, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 6.17% (1.1840 => 1.2570, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 6.17% (0.3098 => 0.3289, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.13% (0.3052 => 0.3239, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.10% (0.2756 => 0.2924, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 6.08% (0.2877 => 0.3052, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.02% (0.2872 => 0.3045, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 5.91% (0.2049 => 0.2170, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.89% (0.2802 => 0.2967, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.88% (0.8101 => 0.8577, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.86% (0.4064 => 0.4302, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.74% (0.2266 => 0.2396, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.60% (0.1892 => 0.1998, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.46% (0.1906 => 0.2010, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 4.99% (17.1811 => 18.0376, std.dev.: 0.0171) MultiSource/Applications/hexxagon/hexxagon: 4.87% (1.2842 => 1.3468, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.81% (0.3427 => 0.3592, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.78% (14.3668 => 15.0536, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/objinst: 4.63% (0.3131 => 0.3276, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.61% (0.2430 => 0.2542, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.34% (3.8922 => 4.0611, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.97% (1.1194 => 1.1638, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 10.04% (1.1396 => 1.2540, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4500, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3683, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.75% (0.4162 => 0.4318, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.57% (3.6395 => 3.7695, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.83% (4.2280 => 4.3475, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7652, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.72% (0.8275 => 0.8417, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.36% (0.9540 => 0.9670, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.35% (11.6436 => 11.8008, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.14% (2.6546 => 2.6849, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5753, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.05% (6.6874 => 0.1307, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.08% (0.8651 => 0.1723, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.92% (5.2763 => 3.2753, std.dev.: 0.0049) SingleSource/UnitTests/Vector/constpool: -14.64% (54.1659 => 46.2348, std.dev.: 0.0449) MultiSource/Benchmarks/FreeBench/mason/mason: -12.33% (0.0811 => 0.0711, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.48% (2.9384 => 2.6304, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: -9.12% (22.1758 => 20.1529, std.dev.: 0.0484) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.36% (1.1492 => 0.7658, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.97% (1.6925 => 1.4222, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.93% (0.0998 => 0.0859, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.75% (1.2373 => 1.0919, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/mandel-2: -10.92% (1.5373 => 1.3694, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/mason/mason: -9.76% (0.2161 => 0.1950, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.41% (19.9488 => 18.2716, std.dev.: 0.0168) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.63% (1.8329 => 1.7113, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8479, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.27% (1.6805 => 1.5920, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7966, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: -4.79% (1.5835 => 1.5076, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.25% (0.9957 => 0.9534, std.dev.: 0.0045) MultiSource/Applications/siod/siod: -3.72% (3.2827 => 3.1605, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5087, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: -3.03% (12.4730 => 12.0951, std.dev.: 0.0027) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.10% (8.6802 => 8.4977, std.dev.: 0.0219) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.96% (8.1563 => 7.9968, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0869, std.dev.: 0.0138) SingleSource/Regression/C/uint64_to_float: -1.88% (0.5413 => 0.5311, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: -1.77% (4.6441 => 4.5621, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6818, std.dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4218, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -1.47% (2.5528 => 2.5152, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.19% (6.2999 => 6.2248, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 14.52% (0.5229 => 0.5988, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 9.63% (14.9895 => 16.4329, std.dev.: 0.0139) MultiSource/Benchmarks/MallocBench/gs/gs: 8.33% (4.1105 => 4.4529, std.dev.: 0.0116) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.24% (1.1048 => 1.2621, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.23% (7.1582 => 7.9622, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: -24.93% (3.4629 => 2.5996, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 20.09% (0.6222 => 0.7472, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: -99.86% (0.0720 => 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35300.00% (0.0001 => 0.0354, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -3.43% (0.1485 => 0.1434, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.52% (0.2116 => 0.0645, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 15 04:36:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 15 Oct 2012 06:36:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121015113634.A324F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4883?compare_to=4881&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4883, Order: 165928, Start Time: 2012-10-15 10:14:34, End Time: 2012-10-15 11:39:29 To: 4881, Order: 165925, Start Time: 2012-10-15 08:19:25, End Time: 2012-10-15 09:45:25 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Failures: 6 (6 on baseline) Performance Regressions: 1 (187 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1034 (673 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/ldecod/ldecod: -6.47% (7.1068 => 6.6469, std.dev.: 0.0099) MultiSource/Applications/JM/lencod/lencod: -3.56% (16.2067 => 15.6297, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++-EH/spirit: -53.60% (5.5021 => 2.5529, std.dev.: 0.0052) New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/ldecod/ldecod: -99.92% (0.1188 => 0.0001) MultiSource/Applications/JM/lencod/lencod: -100.00% (7.5736 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (10.0276 => 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.08% (3.7885 => 3.8673, std.dev.: 0.0263) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.44% (1.3129 => 1.2940, std.dev.: 0.0063) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/ldecod/ldecod: 1.09% (6.5754 => 6.6469, std.dev.: 0.0099) MultiSource/Applications/JM/lencod/lencod: 5.23% (14.8535 => 15.6297, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++-EH/spirit: -48.80% (4.9865 => 2.5529, std.dev.: 0.0052) New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/ldecod/ldecod: -99.92% (0.1194 => 0.0001) MultiSource/Applications/JM/lencod/lencod: -100.00% (7.6086 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (9.9194 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.76% (2.0176 => 2.4969, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 20.22% (0.0826 => 0.0993, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.94% (0.1410 => 0.1677, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.15% (0.0653 => 0.0765, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 16.99% (0.2243 => 0.2624, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 14.61% (0.1013 => 0.1161, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.55% (0.1072 => 0.1228, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.15% (0.0834 => 0.0952, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 13.80% (1.3693 => 1.5582, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.56% (0.1327 => 0.1507, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.52% (0.1413 => 0.1604, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 13.36% (0.7038 => 0.7978, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.17% (0.0964 => 0.1091, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.10% (0.1588 => 0.1796, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.97% (3.9660 => 4.4805, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.90% (0.2721 => 0.3072, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.82% (0.6959 => 0.7851, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.67% (0.6283 => 0.7079, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/hash: 12.53% (0.4062 => 0.4571, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 12.48% (0.4328 => 0.4868, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.45% (1.4563 => 1.6376, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.44% (0.2596 => 0.2919, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 12.41% (13.8202 => 15.5351, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/power/power: 12.36% (0.1003 => 0.1127, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 12.22% (0.0818 => 0.0918, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.21% (1.2193 => 1.3682, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.21% (0.9199 => 1.0322, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.17% (0.7710 => 0.8648, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.16% (0.5265 => 0.5905, std.dev.: 0.0012) MultiSource/Applications/aha/aha: 12.05% (0.1062 => 0.1190, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.84% (1.1364 => 1.2709, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 11.59% (1.0313 => 1.1508, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.58% (0.1157 => 0.1291, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.54% (0.3899 => 0.4349, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.38% (0.4791 => 0.5336, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: 11.36% (0.5818 => 0.6479, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.31% (0.3130 => 0.3484, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 11.29% (1.1061 => 1.2310, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.08% (0.4016 => 0.4461, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.02% (0.3485 => 0.3869, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.97% (0.5577 => 0.6189, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 10.96% (0.5748 => 0.6378, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference: 10.90% (0.7061 => 0.7831, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 10.82% (0.6744 => 0.7474, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.82% (0.3022 => 0.3349, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.78% (0.3756 => 0.4161, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 10.75% (16.6129 => 18.3994, std.dev.: 0.0148) MultiSource/Applications/sgefa/sgefa: 10.75% (0.2995 => 0.3317, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 10.72% (0.2781 => 0.3079, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.71% (0.4379 => 0.4848, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.70% (0.1075 => 0.1190, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.62% (0.4390 => 0.4856, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 10.60% (0.3293 => 0.3642, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 10.58% (3.8646 => 4.2734, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.58% (0.8698 => 0.9618, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: 10.57% (0.1589 => 0.1757, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 10.55% (2.1791 => 2.4090, std.dev.: 0.0182) MultiSource/Applications/treecc/treecc: 10.54% (1.9270 => 2.1302, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.54% (0.6576 => 0.7269, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 10.53% (0.3220 => 0.3559, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 10.51% (0.3453 => 0.3816, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.50% (0.2914 => 0.3220, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: 10.50% (0.3868 => 0.4274, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.46% (0.3489 => 0.3854, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.44% (0.3246 => 0.3585, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.44% (0.0977 => 0.1079, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.42% (0.1276 => 0.1409, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.39% (0.2127 => 0.2348, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 10.35% (0.1111 => 0.1226, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: 10.34% (0.8310 => 0.9169, std.dev.: 0.0024) MultiSource/Applications/d/make_dparser: 10.33% (3.1889 => 3.5184, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.31% (0.3580 => 0.3949, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.26% (0.1569 => 0.1730, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.22% (0.1986 => 0.2189, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 10.22% (0.1478 => 0.1629, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 10.19% (0.7506 => 0.8271, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.19% (0.7460 => 0.8220, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.19% (0.1865 => 0.2055, std.dev.: 0.0037) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.17% (0.1435 => 0.1581, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.16% (0.1014 => 0.1117, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.14% (0.2782 => 0.3064, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.13% (0.5637 => 0.6208, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 10.09% (0.2925 => 0.3220, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.08% (0.2966 => 0.3265, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 10.07% (0.3149 => 0.3466, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 10.05% (0.2726 => 0.3000, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 10.03% (0.2761 => 0.3038) SingleSource/Benchmarks/Shootout-C++/lists1: 10.02% (0.3534 => 0.3888, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 9.98% (0.3107 => 0.3417, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.94% (0.2655 => 0.2919, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.89% (0.2023 => 0.2223, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.86% (1.9828 => 2.1783, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 9.78% (0.2760 => 0.3030, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.77% (7.2180 => 7.9234, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/ary2: 9.71% (0.3192 => 0.3502, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 9.70% (0.2690 => 0.2951, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 9.67% (0.2937 => 0.3221, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 9.66% (1.0594 => 1.1617, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.63% (1.3245 => 1.4521, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.62% (0.2765 => 0.3031, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 9.59% (0.2607 => 0.2857, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 9.44% (0.2628 => 0.2876, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 9.37% (0.2988 => 0.3268, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 9.36% (0.3131 => 0.3424, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 9.35% (0.1657 => 0.1812, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 9.33% (1.2749 => 1.3939, std.dev.: 0.0157) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.30% (3.6692 => 4.0104, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.29% (0.3511 => 0.3837, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.27% (0.2696 => 0.2946, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.21% (0.3755 => 0.4101, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.13% (0.8818 => 0.9623, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.02% (4.3801 => 4.7750, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 9.01% (0.2008 => 0.2189, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.90% (4.4433 => 4.8388, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.88% (1.5188 => 1.6537, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 8.85% (8.4961 => 9.2482, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.74% (0.6135 => 0.6671, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 8.73% (0.2945 => 0.3202) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.53% (0.2321 => 0.2519, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.50% (0.1789 => 0.1941, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.49% (0.9108 => 0.9881, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.48% (3.2742 => 3.5518, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.41% (0.2140 => 0.2320, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 8.29% (4.6629 => 5.0496, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/bigfib: 8.27% (0.6250 => 0.6767, std.dev.: 0.0137) MultiSource/Benchmarks/McCat/05-eks/eks: 8.24% (0.4113 => 0.4452, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.18% (1.1333 => 1.2260, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.16% (0.4805 => 0.5197, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.08% (2.1007 => 2.2704, std.dev.: 0.0046) MultiSource/Applications/lua/lua: 8.07% (3.7467 => 4.0490, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/neural/neural: 8.01% (0.1385 => 0.1496, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.91% (0.2504 => 0.2702, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.77% (0.3245 => 0.3497, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.21% (6.2785 => 6.7310, std.dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: 7.18% (1.2292 => 1.3175, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: 6.94% (0.4003 => 0.4281, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.82% (13.2842 => 14.1896, std.dev.: 0.0202) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.71% (0.1819 => 0.1941, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 6.62% (0.3914 => 0.4173, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.57% (0.3940 => 0.4199, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.33% (0.3789 => 0.4029, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 6.32% (0.3578 => 0.3804, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.20% (0.3646 => 0.3872, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 6.20% (0.3663 => 0.3890, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.11% (0.3601 => 0.3821, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 6.08% (0.1777 => 0.1885, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.07% (0.3623 => 0.3843, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.00% (0.3650 => 0.3869, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.97% (0.2243 => 0.2377, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 5.63% (16.2614 => 17.1763, std.dev.: 0.0153) MultiSource/Applications/ClamAV/clamscan: 4.83% (14.5298 => 15.2313, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/bh/bh: 3.74% (0.2859 => 0.2966, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 2.22% (33.2944 => 34.0342, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5185, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/fbench: 25.14% (1.8175 => 2.2745, std.dev.: 0.0422) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.10% (1.0895 => 1.3630, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 11.05% (1.1560 => 1.2837, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 9.03% (0.8273 => 0.9020, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/mst/mst: 8.70% (0.1322 => 0.1437, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (3.1736 => 3.4147, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.15% (1.2998 => 1.3798, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9998, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625) SingleSource/Benchmarks/Misc/flops-5: 4.64% (1.9144 => 2.0032, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.94% (11.2619 => 11.7057, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.45% (10.7476 => 11.1183, std.dev.: 0.0567) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9851, std.dev.: 0.0015) MultiSource/Benchmarks/llubenchmark/llu: 2.50% (3.7731 => 3.8673, std.dev.: 0.0263) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.14% (7.4271 => 7.5861, std.dev.: 0.0058) MultiSource/Applications/lemon/lemon: 1.70% (1.4298 => 1.4541, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5136, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1879, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.19% (1.9433 => 1.9665, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5782, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0211) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1413, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5879, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.04% (8.8259 => 8.9175, std.dev.: 0.0061) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.67% (0.2670 => 0.1424, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.56% (0.4657 => 0.3886, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.74% (1.3819 => 1.2058, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.74% (1.3813 => 1.2053, std.dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.84% (0.0997 => 0.0859, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -11.93% (0.2238 => 0.1971, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.33% (1.2308 => 1.0914, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.07% (20.3410 => 18.2930, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.10% (1.3780 => 1.2940, std.dev.: 0.0063) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.14% (2.6470 => 2.5110, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.58% (0.9996 => 0.9538, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8004, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.47% (3.2729 => 3.1592, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.45% (1.7688 => 1.7077, std.dev.: 0.0035) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.66% (26.5159 => 25.8113, std.dev.: 0.0342) SingleSource/Regression/C/uint64_to_float: -2.55% (0.5449 => 0.5310, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.51% (3.0263 => 2.9504, std.dev.: 0.0014) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.35% (1.9762 => 1.9297, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.85% (0.6589 => 0.6467, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7148, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -1.70% (6.3560 => 6.2477, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0075, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8669, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.25% (0.8342 => 0.8238, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4955, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2586, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 15 06:03:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 15 Oct 2012 08:03:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121015130311.891A52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4884?compare_to=4882&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4884, Order: 165931, Start Time: 2012-10-15 11:45:15, End Time: 2012-10-15 13:05:05 To: 4882, Order: 165928, Start Time: 2012-10-15 09:56:54, End Time: 2012-10-15 11:15:49 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 10 (4 on baseline) Performance Regressions: 0 (169 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 943 (675 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/ldecod/ldecod: 5.67% (10.8717 => 11.4882, std.dev.: 0.0080) MultiSource/Applications/JM/lencod/lencod: 2.71% (22.9311 => 23.5520, std.dev.: 0.0250) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.32% (3.6178 => 3.7018, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.32% (3.6170 => 3.7010, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 119.41% (2.5996 => 5.7038, std.dev.: 0.0087) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/ldecod/ldecod: 126400.00% (0.0001 => 0.1265, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 10314400.00% (0.0001 => 10.3145, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 397400.00% (0.0001 => 0.3975, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 50300.00% (0.0001 => 0.0504, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10034300.00% (0.0001 => 10.0344, std.dev.: 0.0021) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.23% (0.5988 => 0.6002, std.dev.: 0.0076) MultiSource/Applications/SPASS/SPASS: 0.44% (16.4329 => 16.5044, std.dev.: 0.0151) MultiSource/Benchmarks/Bullet/bullet: 0.22% (54.6962 => 54.8172, std.dev.: 0.0262) MultiSource/Benchmarks/MallocBench/gs/gs: 0.34% (4.4529 => 4.4679, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.65% (0.0459 => 0.0462, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.43% (0.0461 => 0.0463, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.47% (0.0429 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.70% (0.0430 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.48% (0.0419 => 0.0421, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.48% (0.0420 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.48% (0.0413 => 0.0415) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.48% (0.0414 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.23% (0.0431 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.46% (0.0432 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.47% (0.0425 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.23% (0.0427 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.48% (0.0415 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.72% (0.0416 => 0.0419) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.47% (0.0422 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.47% (0.0424 => 0.0426) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.23% (0.0434 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.96% (0.0455 => 0.0437, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.49% (0.0410 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.49% (0.0411 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.47% (0.0422 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.47% (0.0423 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.24% (0.0414 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.48% (0.0415 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.49% (0.0406 => 0.0408) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.49% (0.0407 => 0.0409, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.50% (0.0404 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.49% (0.0406 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.45% (0.0441 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.23% (0.0443 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.25% (0.0404 => 0.0405, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.49% (0.0405 => 0.0407) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.25% (0.0405 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.49% (0.0405 => 0.0407, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.48% (0.0413 => 0.0415, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.48% (0.0414 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.32% (1.2621 => 1.2661, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.23% (7.9622 => 7.9803, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.03% (0.7472 => 0.7470, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 1.41% (0.0354 => 0.0359, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1434 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.26% (0.0645 => 0.0666, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -13.32% (63.2438 => 54.8172, std.dev.: 0.0262) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.43% (14.1553 => 19.0286, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++-EH/spirit: 64.71% (3.4629 => 5.7038, std.dev.: 0.0087) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14225.69% (0.0720 => 10.3145, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10034300.00% (0.0001 => 10.0344, std.dev.: 0.0021) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 60.57% (0.2554 => 0.4101, std.dev.: 0.0031) MultiSource/Benchmarks/PAQ8p/paq8p: 46.95% (10.3673 => 15.2347, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/richards_benchmark: 37.24% (0.1622 => 0.2226, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 33.52% (0.1056 => 0.1410, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 18.30% (0.1432 => 0.1694, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.79% (7.0540 => 8.3087, std.dev.: 0.0147) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.72% (2.2022 => 2.5925, std.dev.: 0.0032) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.84% (0.1566 => 0.1814, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.52% (0.0730 => 0.0836, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 13.95% (0.3282 => 0.3740, std.dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.55% (0.0871 => 0.0989) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.35% (0.1625 => 0.1842, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.24% (1.7609 => 1.9940, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.16% (0.0798 => 0.0903, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 12.85% (0.1440 => 0.1625, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.77% (0.1143 => 0.1289, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 12.44% (0.1584 => 0.1781, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 11.26% (0.7433 => 0.8270, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.23% (0.3543 => 0.3941, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 11.20% (0.7115 => 0.7912, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 11.18% (0.1029 => 0.1144, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: 10.85% (0.3927 => 0.4353, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 10.80% (0.3473 => 0.3848, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.78% (0.2700 => 0.2991, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.76% (0.6675 => 0.7393, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 10.69% (0.1655 => 0.1832, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.67% (0.3543 => 0.3921, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.60% (0.4615 => 0.5104, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/synchronized: 10.59% (0.3561 => 0.3938, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.58% (0.3694 => 0.4085, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.58% (0.3497 => 0.3867, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.58% (0.3516 => 0.3888, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 10.58% (9.4845 => 10.4878, std.dev.: 0.0127) MultiSource/Benchmarks/Olden/tsp/tsp: 10.55% (0.1175 => 0.1299, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.45% (1.5415 => 1.7026, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/property: 10.45% (0.3886 => 0.4292, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.43% (0.4879 => 0.5388, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.43% (0.1438 => 0.1588, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 10.34% (0.3828 => 0.4224, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.17% (0.3177 => 0.3500, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/18-imp/imp: 10.17% (0.3423 => 0.3771, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.15% (0.1044 => 0.1150, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 10.15% (0.1695 => 0.1867, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 10.08% (10.4361 => 11.4882, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.07% (0.2065 => 0.2273, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 10.04% (0.3109 => 0.3421, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 9.94% (3.3354 => 3.6668, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.88% (0.8067 => 0.8864, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.79% (0.5105 => 0.5605, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.79% (0.1236 => 0.1357, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.74% (0.5860 => 0.6431, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 9.66% (5.7591 => 6.3153, std.dev.: 0.0142) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.64% (4.2646 => 4.6756, std.dev.: 0.0039) MultiSource/Applications/Burg/burg: 9.53% (1.1642 => 1.2752, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.51% (1.3050 => 1.4291, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.47% (0.1510 => 0.1653, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 9.47% (0.1151 => 0.1260, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.38% (0.2271 => 0.2484, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 9.38% (3.8723 => 4.2354, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.33% (0.1940 => 0.2121, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.32% (0.2758 => 0.3015, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.21% (0.5569 => 0.6082, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.20% (0.9765 => 1.0663, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/bigfib: 9.19% (0.6456 => 0.7049, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.15% (0.8172 => 0.8920, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.14% (5.0018 => 5.4589, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/mst/mst: 9.11% (0.1163 => 0.1269, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.11% (0.2107 => 0.2299, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.09% (8.1363 => 8.8756, std.dev.: 0.0034) MultiSource/Applications/viterbi/viterbi: 9.07% (0.1555 => 0.1696, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.05% (4.9449 => 5.3924, std.dev.: 0.0073) MultiSource/Applications/hbd/hbd: 9.04% (1.5603 => 1.7013, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.01% (0.3307 => 0.3605, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 8.96% (1.0722 => 1.1683, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 8.96% (0.7835 => 0.8537, std.dev.: 0.0053) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.91% (0.3121 => 0.3399, std.dev.: 0.0025) MultiSource/Applications/treecc/treecc: 8.88% (2.0273 => 2.2074, std.dev.: 0.0140) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.82% (0.5020 => 0.5463, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.82% (1.5859 => 1.7258, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 8.74% (0.3387 => 0.3683, std.dev.: 0.0076) MultiSource/Applications/siod/siod: 8.59% (2.2969 => 2.4941, std.dev.: 0.0029) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.49% (7.9617 => 8.6378, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.46% (0.3441 => 0.3732, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 8.43% (0.3180 => 0.3448, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.41% (0.4103 => 0.4448, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 8.30% (0.5925 => 0.6417, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.26% (0.6030 => 0.6528, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.15% (0.1337 => 0.1446, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.10% (0.3865 => 0.4178, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 8.04% (0.1268 => 0.1370, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.03% (1.1861 => 1.2813, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 7.99% (0.7326 => 0.7911, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.91% (2.2024 => 2.3767, std.dev.: 0.0021) SingleSource/Benchmarks/Stanford/Puzzle: 7.89% (0.1268 => 0.1368, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.88% (0.2603 => 0.2808, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 7.83% (0.4289 => 0.4625, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.78% (0.6450 => 0.6952, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.74% (0.3826 => 0.4122, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.61% (0.4203 => 0.4523, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 7.58% (0.8921 => 0.9597, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 7.57% (0.3422 => 0.3681, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.51% (0.4636 => 0.4984, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 7.49% (0.4620 => 0.4966, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.46% (0.3162 => 0.3398, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.44% (0.4299 => 0.4619, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.43% (0.1695 => 0.1821, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 7.36% (21.9371 => 23.5520, std.dev.: 0.0250) SingleSource/Benchmarks/Shootout-C++/moments: 7.34% (0.4048 => 0.4345, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 7.31% (0.1463 => 0.1570, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.30% (0.3136 => 0.3365, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.20% (1.4186 => 1.5208, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sieve: 7.13% (0.3603 => 0.3860, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.12% (0.3650 => 0.3910, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.07% (0.5981 => 0.6404, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.92% (0.2891 => 0.3091, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 6.81% (1.1840 => 1.2646, std.dev.: 0.0045) SingleSource/Regression/C++/ofstream_ctor: 6.78% (0.2905 => 0.3102, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.73% (0.3684 => 0.3932, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.57% (0.2756 => 0.2937, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.50% (2.0665 => 2.2008, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/fibo: 6.50% (0.2725 => 0.2902, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 6.45% (0.3052 => 0.3249, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.39% (0.2831 => 0.3012, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.31% (0.3283 => 0.3490, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.23% (0.2793 => 0.2967, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.22% (0.2266 => 0.2407, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.20% (0.3098 => 0.3290, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.19% (0.2714 => 0.2882, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.14% (0.1906 => 0.2023, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/random: 6.14% (0.2802 => 0.2974, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.13% (0.1892 => 0.2008, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.10% (0.2871 => 0.3046, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.09% (0.2872 => 0.3047, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.05% (0.2877 => 0.3051, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.93% (0.4064 => 0.4305, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.80% (0.3379 => 0.3575, std.dev.: 0.0053) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.76% (0.8101 => 0.8568, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 5.66% (0.2049 => 0.2165, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: 5.18% (17.1811 => 18.0708, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.11% (0.3427 => 0.3602, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.92% (14.3668 => 15.0737, std.dev.: 0.0069) MultiSource/Applications/hexxagon/hexxagon: 4.86% (1.2842 => 1.3466, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.77% (0.2430 => 0.2546, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.75% (3.8922 => 4.0771, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/objinst: 4.69% (0.3131 => 0.3278, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.88% (1.1194 => 1.1628, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 3.62% (0.3092 => 0.3204, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.09% (0.3817 => 0.3935, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8953, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.91% (1.1396 => 1.2525, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.18% (3.1595 => 3.4497, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3691, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.78% (3.6395 => 3.7771, std.dev.: 0.0051) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.66% (4.2280 => 4.3406, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7655, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.72% (0.8275 => 0.8417, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.35% (11.6436 => 11.8011, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.30% (2.6546 => 2.6891, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.10% (6.5088 => 6.5806, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.03% (6.6874 => 0.1320, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -80.11% (0.8651 => 0.1721, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.89% (5.2763 => 3.2770, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.28% (5.3855 => 3.7010, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.84% (5.3526 => 3.7018, std.dev.: 0.0080) SingleSource/UnitTests/Vector/constpool: -14.69% (54.1659 => 46.2078, std.dev.: 0.0735) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.44% (2.9384 => 2.6316, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: -9.03% (22.1758 => 20.1732, std.dev.: 0.0213) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: -33.42% (1.1492 => 0.7651, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.96% (1.6925 => 1.4223, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.63% (0.0998 => 0.0862, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.75% (1.2373 => 1.0919, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel-2: -10.45% (1.5373 => 1.3766, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/mason/mason: -9.90% (0.2161 => 0.1947, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.35% (19.9488 => 18.2824, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.68% (1.8329 => 1.7104, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -5.58% (1.9577 => 1.8484, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.29% (1.6805 => 1.5916, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5082, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.60% (0.9957 => 0.9599, std.dev.: 0.0080) MultiSource/Applications/siod/siod: -3.52% (3.2827 => 3.1670, std.dev.: 0.0047) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5015, std.dev.: 0.0071) MultiSource/Applications/hexxagon/hexxagon: -3.01% (12.4730 => 12.0980, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.03% (8.1563 => 7.9906, std.dev.: 0.0225) SingleSource/Regression/C/uint64_to_float: -1.90% (0.5413 => 0.5310, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: -1.89% (10.2830 => 10.0883, std.dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.86% (8.6802 => 8.5191, std.dev.: 0.0081) MultiSource/Applications/sqlite3/sqlite3: -1.78% (4.6441 => 4.5616, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6793, std.dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.53% (2.5528 => 2.5138, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4216, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout/lists: -1.15% (6.2999 => 6.2273, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout/hash: -1.11% (4.9088 => 4.8543, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 14.78% (0.5229 => 0.6002, std.dev.: 0.0076) MultiSource/Applications/SPASS/SPASS: 10.11% (14.9895 => 16.5044, std.dev.: 0.0151) MultiSource/Benchmarks/MallocBench/gs/gs: 8.69% (4.1105 => 4.4679, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.60% (1.1048 => 1.2661, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.48% (7.1582 => 7.9803, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: 20.06% (0.6222 => 0.7470, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35800.00% (0.0001 => 0.0359, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.53% (0.2116 => 0.0666, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 15 06:32:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 15 Oct 2012 08:32:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121015133206.DD7FE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4885?compare_to=4883&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4885, Order: 165931, Start Time: 2012-10-15 12:09:06, End Time: 2012-10-15 13:35:00 To: 4883, Order: 165928, Start Time: 2012-10-15 10:14:34, End Time: 2012-10-15 11:39:29 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== New Passes: 6 (0 on baseline) Performance Regressions: 0 (189 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1036 (676 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/ldecod/ldecod: 6.62% (6.6469 => 7.0867, std.dev.: 0.0094) MultiSource/Applications/JM/lencod/lencod: 3.44% (15.6297 => 16.1677, std.dev.: 0.0185) SingleSource/Benchmarks/Misc-C++-EH/spirit: 114.45% (2.5529 => 5.4748, std.dev.: 0.0022) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/ldecod/ldecod: 118700.00% (0.0001 => 0.1188, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 7564200.00% (0.0001 => 7.5643, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10024000.00% (0.0001 => 10.0241, std.dev.: 0.0013) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.06% (2.0176 => 2.5030, std.dev.: 0.0182) MultiSource/Benchmarks/Fhourstones/fhourstones: 19.29% (0.1410 => 0.1682, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 18.22% (0.0653 => 0.0772, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 17.43% (0.0826 => 0.0970, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 17.03% (0.2243 => 0.2625, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.79% (0.1072 => 0.1252, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.15% (0.1327 => 0.1528, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 14.51% (0.1013 => 0.1160, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.79% (0.0834 => 0.0949, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.66% (0.1413 => 0.1606, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 13.57% (0.7038 => 0.7993, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.51% (0.0770 => 0.0874, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.07% (0.0964 => 0.1090, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.95% (3.9660 => 4.4797, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: 12.82% (1.3693 => 1.5449, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.79% (0.2721 => 0.3069, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.72% (0.1588 => 0.1790, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.47% (0.6959 => 0.7827, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.44% (0.2596 => 0.2919, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.41% (0.7710 => 0.8667, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.40% (1.4563 => 1.6369, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.37% (0.6283 => 0.7060, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 12.34% (0.1062 => 0.1193, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 12.25% (0.4328 => 0.4858, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 12.18% (13.8202 => 15.5034, std.dev.: 0.0213) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.16% (0.9199 => 1.0318, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 12.11% (0.4062 => 0.4554, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 12.06% (0.1003 => 0.1124, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.06% (0.5265 => 0.5900, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.92% (1.2193 => 1.3646, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.77% (1.1364 => 1.2701, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.67% (0.1157 => 0.1292, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 11.66% (1.0313 => 1.1515, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 11.52% (0.5818 => 0.6488, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.34% (0.3130 => 0.3485, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 11.33% (0.7061 => 0.7861, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.23% (0.3899 => 0.4337, std.dev.: 0.0016) MultiSource/Applications/Burg/burg: 11.23% (1.1061 => 1.2303, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 11.22% (0.5748 => 0.6393, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.19% (0.4791 => 0.5327, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 11.12% (16.6129 => 18.4609, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.01% (0.5577 => 0.6191, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 10.95% (2.1791 => 2.4177, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.93% (0.1986 => 0.2203, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 10.75% (0.6744 => 0.7469, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/gs/gs: 10.75% (3.8646 => 4.2800, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.66% (0.4379 => 0.4846, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 10.64% (0.1589 => 0.1758, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.59% (0.3485 => 0.3854, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.57% (0.3756 => 0.4153, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.57% (0.2914 => 0.3222, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 10.55% (0.2995 => 0.3311, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 10.50% (1.9270 => 2.1294, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.48% (0.4016 => 0.4437, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.44% (0.0977 => 0.1079, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.42% (0.1075 => 0.1187, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.41% (0.3246 => 0.3584, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 10.40% (0.3220 => 0.3555, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/mst/mst: 10.35% (0.1111 => 0.1226, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.35% (0.1865 => 0.2058, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.35% (0.0976 => 0.1077, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.30% (0.8698 => 0.9594, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.27% (0.4390 => 0.4841, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.26% (0.1569 => 0.1730, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 10.26% (0.2925 => 0.3225) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.25% (0.3580 => 0.3947, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 10.25% (3.1889 => 3.5157, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.16% (0.2127 => 0.2343, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 10.11% (0.3868 => 0.4259, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.10% (0.1435 => 0.1580, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 10.10% (0.7506 => 0.8264, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.09% (0.3022 => 0.3327, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 10.08% (0.1478 => 0.1627) MultiSource/Benchmarks/Prolangs-C/football/football: 10.07% (0.8310 => 0.9147, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.05% (0.7460 => 0.8210, std.dev.: 0.0020) SingleSource/Regression/C++/ofstream_ctor: 10.03% (0.2781 => 0.3060, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.03% (0.3489 => 0.3839, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 9.99% (0.3293 => 0.3622, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.99% (0.5637 => 0.6200, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.98% (0.2655 => 0.2920, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.96% (0.1014 => 0.1115, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 9.90% (0.3453 => 0.3795, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.89% (0.2023 => 0.2223, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.81% (0.2782 => 0.3055, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.79% (4.9865 => 5.4748, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.78% (0.2966 => 0.3256, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.69% (0.6576 => 0.7213, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 9.65% (0.3534 => 0.3875, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 9.62% (0.3149 => 0.3452, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.57% (7.2180 => 7.9089, std.dev.: 0.0074) MultiSource/Benchmarks/nbench/nbench: 9.57% (1.0594 => 1.1608, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.56% (0.1276 => 0.1398, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 9.50% (0.2726 => 0.2985, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.45% (1.9828 => 2.1702, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary: 9.43% (0.3107 => 0.3400, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 9.41% (0.1657 => 0.1813, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 9.35% (0.2760 => 0.3018, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 9.34% (0.2761 => 0.3019, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.30% (1.3245 => 1.4477, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/random: 9.26% (0.2690 => 0.2939, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.22% (0.2765 => 0.3020, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 9.21% (0.2607 => 0.2847, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 9.18% (1.2749 => 1.3919, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/fibo: 9.13% (0.2628 => 0.2868, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 9.12% (0.2937 => 0.3205, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.06% (3.6692 => 4.0018, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 9.02% (0.3192 => 0.3480, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.96% (4.3801 => 4.7725, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 8.94% (0.3131 => 0.3411, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.90% (1.5188 => 1.6540, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.88% (4.4433 => 4.8380, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.87% (0.3755 => 0.4088, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 8.85% (14.8535 => 16.1677, std.dev.: 0.0185) SingleSource/Benchmarks/Shootout-C++/matrix: 8.80% (0.2988 => 0.3251, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.79% (0.2321 => 0.2525, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.72% (0.2696 => 0.2931, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.64% (0.6135 => 0.6665, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 8.55% (8.4961 => 9.2226, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.51% (0.8818 => 0.9568, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 8.49% (0.2945 => 0.3195, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.46% (3.2742 => 3.5512, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.32% (0.2140 => 0.2318, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.27% (0.1789 => 0.1937, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.26% (0.3511 => 0.3801, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 8.24% (3.7467 => 4.0553, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.22% (0.9108 => 0.9857, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 8.20% (4.6629 => 5.0452, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.18% (0.4805 => 0.5198, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.17% (2.1007 => 2.2724, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.14% (1.1333 => 1.2255, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 8.08% (0.6250 => 0.6755, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.90% (0.4113 => 0.4438, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.79% (0.2504 => 0.2699, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 7.78% (6.5754 => 7.0867, std.dev.: 0.0094) MultiSource/Benchmarks/FreeBench/neural/neural: 7.73% (0.1385 => 0.1492, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.70% (0.3245 => 0.3495, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 7.37% (0.2008 => 0.2156, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/parameter-passing: 7.17% (0.4003 => 0.4290, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 7.02% (1.2292 => 1.3155, std.dev.: 0.0039) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.97% (6.2785 => 6.7159, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.94% (13.2842 => 14.2066, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/ReedSolomon: 6.87% (0.1777 => 0.1899, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 6.75% (0.3940 => 0.4206, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 6.75% (0.3914 => 0.4178, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.71% (0.1819 => 0.1941, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 6.55% (0.3789 => 0.4037, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.53% (0.3646 => 0.3884, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 6.40% (0.3578 => 0.3807, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 6.33% (0.3663 => 0.3895, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 6.30% (0.3601 => 0.3828, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.24% (0.3623 => 0.3849, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.22% (0.3650 => 0.3877, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 5.71% (16.2614 => 17.1907, std.dev.: 0.0085) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.53% (0.2243 => 0.2367, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 4.66% (14.5298 => 15.2075, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 3.60% (0.2859 => 0.2962, std.dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: 2.04% (33.2944 => 33.9727, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.87% (0.4846 => 0.6972, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5144, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 24.65% (1.8175 => 2.2655, std.dev.: 0.0328) SingleSource/Benchmarks/Misc/richards_benchmark: 11.21% (1.1560 => 1.2856, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.04% (0.8273 => 0.9021, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4143, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.32% (1.2998 => 1.3820, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0050, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.91% (11.2619 => 11.7022, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.86% (1.7081 => 1.7740, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.57% (10.7476 => 11.1310, std.dev.: 0.0372) SingleSource/Benchmarks/Misc/flops-6: 3.47% (1.9199 => 1.9865, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.07% (7.4271 => 7.5812, std.dev.: 0.0082) MultiSource/Applications/lemon/lemon: 1.71% (1.4298 => 1.4542, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5136, std.dev.: 0.0067) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2122, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1871, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.17% (5.5130 => 5.5773, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 1.12% (12.4560 => 12.5949, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.06% (9.9194 => 10.0241, std.dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.55% (0.2670 => 0.1427) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.41% (0.4657 => 0.3893, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/mason/mason: -14.14% (0.0707 => 0.0607, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.97% (1.3819 => 1.2027, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.93% (1.3813 => 1.2027, std.dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.34% (0.0997 => 0.0864, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -11.97% (0.2238 => 0.1970, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: -10.92% (1.2308 => 1.0964, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.05% (20.3410 => 18.2970, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.38% (2.5089 => 2.3740, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.23% (1.3780 => 1.3059, std.dev.: 0.0017) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5147, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8005, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.84% (0.9996 => 0.9612, std.dev.: 0.0047) MultiSource/Applications/siod/siod: -3.56% (3.2729 => 3.1564, std.dev.: 0.0274) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.46% (1.7688 => 1.7076, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.35% (0.4867 => 0.4704, std.dev.: 0.0017) MultiSource/Applications/lua/lua: -2.72% (26.5159 => 25.7957, std.dev.: 0.0330) SingleSource/Regression/C/uint64_to_float: -2.55% (0.5449 => 0.5310, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.42% (3.0263 => 2.9530, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.33% (1.9762 => 1.9301, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.97% (0.6589 => 0.6459, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7154, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -1.61% (6.3560 => 6.2535, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0069, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8672, std.dev.: 0.0162) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.25% (0.8342 => 0.8238, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.16% (2.5254 => 2.4960, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2579, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 15 08:06:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 15 Oct 2012 10:06:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121015150602.233252A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4886?compare_to=4884&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4886, Order: 165933, Start Time: 2012-10-15 13:47:56, End Time: 2012-10-15 15:07:55 To: 4884, Order: 165931, Start Time: 2012-10-15 11:45:15, End Time: 2012-10-15 13:05:05 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (164 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 953 (680 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.47% (0.6002 => 0.5974, std.dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 0.01% (16.5044 => 16.5067, std.dev.: 0.0198) MultiSource/Benchmarks/Bullet/bullet: -0.05% (54.8172 => 54.7885, std.dev.: 0.0533) MultiSource/Benchmarks/MallocBench/gs/gs: -0.10% (4.4679 => 4.4635, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0462 => 0.0462) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0463 => 0.0463, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.23% (0.0431 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0433 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0421 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0422 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0415 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.24% (0.0416 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0432 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.23% (0.0434 => 0.0433, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0427 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.23% (0.0428 => 0.0429, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.48% (0.0417 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0419 => 0.0419) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0424 => 0.0424, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.23% (0.0426 => 0.0425, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.23% (0.0435 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0437 => 0.0437, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.24% (0.0412 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.24% (0.0413 => 0.0414, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0424 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0425 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.24% (0.0415 => 0.0416) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.24% (0.0417 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0408 => 0.0408, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0409 => 0.0409, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0406 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.25% (0.0408 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0443 => 0.0443, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0444 => 0.0444, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0405 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.25% (0.0407 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0406 => 0.0406, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.25% (0.0407 => 0.0408) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.24% (0.0415 => 0.0414, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.24% (0.0416 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.07% (1.2661 => 1.2652, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.02% (7.9803 => 7.9791, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.11% (0.7470 => 0.7462, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.28% (0.0359 => 0.0358, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1433 => 0.1434, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.15% (0.0666 => 0.0645, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -13.37% (63.2438 => 54.7885, std.dev.: 0.0533) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.41% (14.1553 => 19.0267, std.dev.: 0.0161) SingleSource/Benchmarks/Misc-C++-EH/spirit: 64.70% (3.4629 => 5.7034, std.dev.: 0.0020) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14227.36% (0.0720 => 10.3157, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10036300.00% (0.0001 => 10.0364, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 60.34% (0.2554 => 0.4095, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: 46.92% (10.3673 => 15.2320, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/richards_benchmark: 37.24% (0.1622 => 0.2226, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 33.52% (0.1056 => 0.1410, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 18.30% (0.1432 => 0.1694, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.81% (7.0540 => 8.3105, std.dev.: 0.0247) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.61% (2.2022 => 2.5900, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.09% (0.1566 => 0.1818, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.43% (0.0871 => 0.0988, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 13.38% (0.3282 => 0.3721, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.19% (1.7609 => 1.9932, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/power/power: 12.85% (0.1440 => 0.1625, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.77% (0.1143 => 0.1289, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 12.44% (0.1584 => 0.1781, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 11.12% (0.7115 => 0.7906, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 11.07% (0.7433 => 0.8256, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/parameter-passing: 10.87% (0.3927 => 0.4354, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.77% (0.6675 => 0.7394, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.74% (0.2700 => 0.2990, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.74% (0.3473 => 0.3846, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.65% (0.1625 => 0.1798, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions-4: 10.64% (0.3543 => 0.3920, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.64% (0.3543 => 0.3920, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 10.61% (9.4845 => 10.4909, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/property: 10.60% (0.3886 => 0.4298, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/synchronized: 10.56% (0.3561 => 0.3937, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 10.55% (0.3497 => 0.3866, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.55% (0.3516 => 0.3887, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.53% (0.4879 => 0.5393, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.48% (0.3121 => 0.3448, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.46% (1.5415 => 1.7027, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/chomp: 10.45% (0.1655 => 0.1828, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.42% (0.3694 => 0.4079, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 10.38% (0.1175 => 0.1297, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 10.37% (0.3828 => 0.4225, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.36% (0.1438 => 0.1587, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.14% (0.3177 => 0.3499, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.10% (0.4615 => 0.5081, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 10.08% (0.3423 => 0.3768, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 10.06% (10.4361 => 11.4858, std.dev.: 0.0143) MultiSource/Applications/d/make_dparser: 10.02% (3.3354 => 3.6696, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/em3d/em3d: 9.91% (0.1695 => 0.1863, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.81% (0.8067 => 0.8858, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.79% (0.5105 => 0.5605, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 9.78% (0.3109 => 0.3413, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.73% (0.2065 => 0.2266, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.71% (0.1236 => 0.1356, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 9.65% (5.7591 => 6.3151, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.57% (4.2646 => 4.6726, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.54% (0.5860 => 0.6419, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.50% (1.3050 => 1.4290, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 9.47% (0.1151 => 0.1260, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 9.43% (1.1642 => 1.2740, std.dev.: 0.0036) MultiSource/Applications/lua/lua: 9.34% (3.8723 => 4.2340, std.dev.: 0.0136) MultiSource/Applications/viterbi/viterbi: 9.32% (0.1555 => 0.1700, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.29% (0.2271 => 0.2482, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.28% (0.1940 => 0.2120, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.27% (0.1510 => 0.1650, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.25% (0.2107 => 0.2302, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.21% (0.5569 => 0.6082, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 9.19% (0.6456 => 0.7049, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 9.18% (0.7835 => 0.8554, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.10% (0.8172 => 0.8916, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.04% (8.1363 => 8.8717, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/mst/mst: 9.03% (0.1163 => 0.1268, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.01% (0.3307 => 0.3605, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.98% (5.0018 => 5.4510, std.dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.96% (0.2758 => 0.3005, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.95% (4.9449 => 5.3874, std.dev.: 0.0117) MultiSource/Applications/hbd/hbd: 8.93% (1.5603 => 1.6996, std.dev.: 0.0046) MultiSource/Applications/lemon/lemon: 8.93% (1.0722 => 1.1679, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.92% (0.4103 => 0.4469, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.91% (0.9765 => 1.0635, std.dev.: 0.0045) MultiSource/Applications/treecc/treecc: 8.84% (2.0273 => 2.2066, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.80% (0.5020 => 0.5462, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.76% (1.5859 => 1.7249, std.dev.: 0.0066) MultiSource/Benchmarks/sim/sim: 8.71% (0.3387 => 0.3682, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 8.58% (2.2969 => 2.4939, std.dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.50% (7.9617 => 8.6382, std.dev.: 0.0113) SingleSource/UnitTests/ObjC++/Hello: 8.25% (0.5925 => 0.6414, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.23% (0.1337 => 0.1447, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.20% (0.3441 => 0.3723, std.dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference-object: 8.19% (0.6030 => 0.6524, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 8.18% (0.3180 => 0.3440, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.10% (0.3865 => 0.4178, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 8.04% (0.1268 => 0.1370, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.95% (2.2024 => 2.3774, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.93% (1.1861 => 1.2801, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.88% (0.2603 => 0.2808, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.76% (0.4289 => 0.4622, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.64% (0.4620 => 0.4973, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.62% (0.7326 => 0.7884, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.57% (0.4203 => 0.4521, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.55% (0.6450 => 0.6937, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 7.53% (0.8921 => 0.9593, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/05-eks/eks: 7.49% (0.4299 => 0.4621, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 7.45% (0.3422 => 0.3677, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.43% (0.1695 => 0.1821, std.dev.: 0.0048) MultiSource/Applications/JM/lencod/lencod: 7.35% (21.9371 => 23.5497, std.dev.: 0.0122) MultiSource/Benchmarks/FreeBench/neural/neural: 7.31% (0.1463 => 0.1570, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: 7.31% (0.4048 => 0.4344, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.14% (1.4186 => 1.5199, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/fibo: 7.12% (0.2725 => 0.2919, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 7.11% (0.3603 => 0.3859, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.08% (0.4636 => 0.4964, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.02% (0.5981 => 0.6401, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.99% (0.3650 => 0.3905, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.93% (0.3826 => 0.4091, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hello: 6.89% (0.2714 => 0.2901, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.87% (0.3232 => 0.3454, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.85% (0.2891 => 0.3089, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.80% (0.2793 => 0.2983, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.70% (0.3684 => 0.3931, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 6.61% (1.1840 => 1.2623, std.dev.: 0.0053) SingleSource/Regression/C++/ofstream_ctor: 6.61% (0.2905 => 0.3097, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.53% (2.0665 => 2.2014, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.51% (0.3162 => 0.3368, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: 6.44% (0.2049 => 0.2181, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.44% (0.3136 => 0.3338, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.39% (0.2756 => 0.2932, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.36% (0.2831 => 0.3011, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.29% (0.3052 => 0.3244, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.24% (0.3379 => 0.3590, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.20% (0.2871 => 0.3049, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.17% (0.3098 => 0.3289, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.15% (0.3283 => 0.3485, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.13% (0.2266 => 0.2405, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.10% (0.2802 => 0.2973, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.10% (0.8101 => 0.8595, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.09% (0.1906 => 0.2022, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.06% (0.2872 => 0.3046, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 5.98% (0.2877 => 0.3049, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.92% (0.1892 => 0.2004, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.86% (0.4064 => 0.4302, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 5.17% (17.1811 => 18.0702, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.05% (0.3427 => 0.3600, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.99% (14.3668 => 15.0834, std.dev.: 0.0102) MultiSource/Applications/hexxagon/hexxagon: 4.77% (1.2842 => 1.3454, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.65% (0.2430 => 0.2543, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.61% (3.8922 => 4.0715, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/objinst: 4.47% (0.3131 => 0.3271, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.99% (1.1194 => 1.1641, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: 3.36% (0.3092 => 0.3196, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.09% (0.3817 => 0.3935, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.85% (0.1421 => 0.1561, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: 9.83% (1.1396 => 1.2516, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 9.22% (3.1595 => 3.4508, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (3.1578 => 3.3673, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.67% (3.6395 => 3.7730, std.dev.: 0.0071) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.66% (4.2280 => 4.3406, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.34% (1.7254 => 1.7657, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.70% (0.8275 => 0.8416, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.47% (0.9540 => 0.9680, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.36% (11.6436 => 11.8018, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.24% (2.6546 => 2.6875, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.03% (6.6874 => 0.1315, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -80.11% (0.8651 => 0.1721, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.90% (5.2763 => 3.2768, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.36% (5.3855 => 3.6964, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.86% (5.3526 => 3.7006, std.dev.: 0.0035) SingleSource/UnitTests/Vector/constpool: -14.50% (54.1659 => 46.3109, std.dev.: 0.0098) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.49% (2.9384 => 2.6301, std.dev.: 0.0053) MultiSource/Applications/ClamAV/clamscan: -9.04% (22.1758 => 20.1702, std.dev.: 0.0142) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -33.49% (1.1492 => 0.7643, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: -15.97% (1.6925 => 1.4222, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.03% (0.0998 => 0.0858, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.95% (1.2373 => 1.0894, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel-2: -10.43% (1.5373 => 1.3770, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/mason/mason: -10.04% (0.2161 => 0.1944, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.44% (19.9488 => 18.2657, std.dev.: 0.1230) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.70% (1.8329 => 1.7101, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.27% (1.6805 => 1.5920, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.89% (1.5835 => 1.5061, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.19% (0.9957 => 0.9540, std.dev.: 0.0037) MultiSource/Applications/siod/siod: -3.73% (3.2827 => 3.1603, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5057, std.dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: -2.99% (12.4730 => 12.0995, std.dev.: 0.0012) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Regression/C/uint64_to_float: -1.90% (0.5413 => 0.5310, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -1.83% (10.2830 => 10.0950, std.dev.: 0.0107) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.80% (8.6802 => 8.5240, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.79% (8.1563 => 8.0099, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: -1.76% (4.6441 => 4.5622, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6792, std.dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: -1.66% (2.5528 => 2.5104, std.dev.: 0.0021) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4216, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.04% (6.2999 => 6.2343, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8596, std.dev.: 0.0097) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 14.25% (0.5229 => 0.5974, std.dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 10.12% (14.9895 => 16.5067, std.dev.: 0.0198) MultiSource/Benchmarks/MallocBench/gs/gs: 8.59% (4.1105 => 4.4635, std.dev.: 0.0094) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.52% (1.1048 => 1.2652, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.47% (7.1582 => 7.9791, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.93% (0.6222 => 0.7462, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35700.00% (0.0001 => 0.0358, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -3.43% (0.1485 => 0.1434, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.52% (0.2116 => 0.0645, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 15 08:27:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 15 Oct 2012 10:27:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121015152744.53A1C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4887?compare_to=4885&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4887, Order: 165933, Start Time: 2012-10-15 14:04:14, End Time: 2012-10-15 15:30:38 To: 4885, Order: 165931, Start Time: 2012-10-15 12:09:06, End Time: 2012-10-15 13:35:00 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (191 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1042 (674 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.06% (2.0176 => 2.5031, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.94% (0.1410 => 0.1677, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 18.38% (0.0653 => 0.0773, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 17.43% (0.0826 => 0.0970, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 17.21% (0.2243 => 0.2629, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.70% (0.1072 => 0.1251, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.47% (0.1327 => 0.1519, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 14.31% (0.1013 => 0.1158, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.79% (0.0834 => 0.0949, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 13.61% (0.7038 => 0.7996, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.59% (0.1413 => 0.1605, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.25% (0.0770 => 0.0872, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.17% (0.0964 => 0.1091, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.95% (3.9660 => 4.4795, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.89% (0.6959 => 0.7856, std.dev.: 0.0111) MultiSource/Applications/hbd/hbd: 12.82% (1.3693 => 1.5448, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.78% (0.1588 => 0.1791, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.75% (0.2721 => 0.3068, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.45% (0.6283 => 0.7065, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 12.42% (13.8202 => 15.5362, std.dev.: 0.0107) MultiSource/Applications/aha/aha: 12.34% (0.1062 => 0.1193, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.33% (0.2596 => 0.2916, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.33% (1.4563 => 1.6358, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.23% (0.5265 => 0.5909, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 12.14% (0.4062 => 0.4555, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 12.13% (0.4328 => 0.4853, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.12% (0.9199 => 1.0314, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.07% (1.2193 => 1.3665, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 12.06% (0.1003 => 0.1124, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.93% (0.1157 => 0.1295, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.89% (0.7710 => 0.8627, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.75% (1.1364 => 1.2699, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 11.57% (1.0313 => 1.1506, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 11.45% (0.5818 => 0.6484, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.41% (0.3130 => 0.3487, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 11.35% (1.1061 => 1.2316, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.23% (0.4791 => 0.5329, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 11.22% (0.5748 => 0.6393, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.13% (0.3899 => 0.4333, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 11.12% (16.6129 => 18.4600, std.dev.: 0.0068) SingleSource/UnitTests/ObjC++/property-reference: 11.09% (0.7061 => 0.7844, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.99% (0.5577 => 0.6190, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 10.85% (2.1791 => 2.4156, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.78% (0.1048 => 0.1161, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 10.75% (3.8646 => 4.2801, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.73% (0.4379 => 0.4849, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 10.66% (0.6744 => 0.7463, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: 10.64% (0.1589 => 0.1758, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.63% (0.4016 => 0.4443, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.59% (0.3485 => 0.3854, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 10.56% (1.9270 => 2.1305, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.54% (0.3246 => 0.3588, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.50% (0.2914 => 0.3220, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.49% (0.3756 => 0.4150, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 10.48% (0.2995 => 0.3309, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 10.47% (0.3220 => 0.3557, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 10.44% (0.1111 => 0.1227, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.40% (0.1865 => 0.2059, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.35% (0.0976 => 0.1077, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.33% (0.1075 => 0.1186, std.dev.: 0.0019) MultiSource/Applications/spiff/spiff: 10.30% (0.7506 => 0.8279, std.dev.: 0.0081) MultiSource/Benchmarks/McCat/09-vor/vor: 10.29% (0.2925 => 0.3226, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.29% (0.8698 => 0.9593, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.28% (0.7460 => 0.8227, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.26% (0.1569 => 0.1730, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 10.25% (0.2781 => 0.3066, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.24% (0.0977 => 0.1077, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.23% (0.4390 => 0.4839, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 10.21% (3.1889 => 3.5144, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.20% (0.2127 => 0.2344, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.17% (0.3580 => 0.3944, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.15% (0.3489 => 0.3843, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 10.13% (0.3868 => 0.4260, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 10.11% (0.3293 => 0.3626, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.10% (0.1435 => 0.1580, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 10.10% (0.8310 => 0.9149, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.09% (0.3022 => 0.3327, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.06% (0.1014 => 0.1116, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.02% (0.1986 => 0.2185, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 9.95% (0.1478 => 0.1625, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.94% (0.2023 => 0.2224, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.85% (0.5637 => 0.6192, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.81% (4.9865 => 5.4756, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/sieve: 9.79% (0.3453 => 0.3791, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.74% (0.2782 => 0.3053, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.72% (0.1276 => 0.1400, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 9.60% (1.0594 => 1.1611, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.58% (0.2966 => 0.3250, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.57% (7.2180 => 7.9085, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/em3d/em3d: 9.54% (0.1657 => 0.1815, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.45% (1.3245 => 1.4496, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/ary3: 9.43% (0.3149 => 0.3446, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.43% (1.9828 => 2.1697, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 9.39% (0.3534 => 0.3866, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/strcat: 9.35% (0.2726 => 0.2981, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.34% (0.6576 => 0.7190, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 9.31% (0.2760 => 0.3017, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 9.31% (0.2761 => 0.3018, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 9.27% (0.3107 => 0.3395, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 9.20% (0.3131 => 0.3419, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 9.19% (0.2937 => 0.3207, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.19% (0.2655 => 0.2899, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 9.18% (0.2690 => 0.2937, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 9.17% (0.2607 => 0.2846, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 9.12% (1.2749 => 1.3912, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 9.09% (0.2628 => 0.2867, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.08% (0.2765 => 0.3016, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.05% (3.6692 => 4.0013, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 8.99% (0.3192 => 0.3479, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.94% (4.3801 => 4.7716, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.89% (0.3755 => 0.4089, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.88% (4.4433 => 4.8378, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.84% (1.5188 => 1.6531, std.dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 8.83% (14.8535 => 16.1650, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.79% (0.2696 => 0.2933, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 8.77% (8.4961 => 9.2408, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/matrix: 8.73% (0.2988 => 0.3249, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.64% (0.6135 => 0.6665, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.57% (0.2321 => 0.2520, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.54% (3.2742 => 3.5537, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.40% (0.3511 => 0.3806, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/objinst: 8.32% (0.2945 => 0.3190, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.28% (0.8818 => 0.9548, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.27% (2.1007 => 2.2744, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 8.26% (4.6629 => 5.0479, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.23% (0.9108 => 0.9858, std.dev.: 0.0057) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.22% (0.2140 => 0.2316, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.18% (0.4805 => 0.5198, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.15% (1.1333 => 1.2257, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 8.14% (3.7467 => 4.0517, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.11% (0.1789 => 0.1934, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 8.08% (0.6250 => 0.6755, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 8.02% (0.4113 => 0.4443, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.01% (0.3245 => 0.3505, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/neural/neural: 7.87% (0.1385 => 0.1494, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.79% (0.2504 => 0.2699, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 7.73% (6.5754 => 7.0839, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/oourafft: 7.47% (0.2008 => 0.2158, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/parameter-passing: 7.12% (0.4003 => 0.4288, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.92% (13.2842 => 14.2031, std.dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.90% (6.2785 => 6.7117, std.dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 6.87% (1.2292 => 1.3137, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/property: 6.75% (0.3940 => 0.4206, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 6.72% (0.3914 => 0.4177, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.49% (0.1819 => 0.1937, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 6.47% (0.3789 => 0.4034, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 6.43% (0.3578 => 0.3808, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.42% (0.2243 => 0.2387, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 6.39% (0.3601 => 0.3831, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.31% (0.3646 => 0.3876, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.28% (0.3663 => 0.3893, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.25% (0.3650 => 0.3878, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.13% (0.3623 => 0.3845, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 5.74% (0.1777 => 0.1879, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 5.67% (16.2614 => 17.1842, std.dev.: 0.0061) MultiSource/Applications/ClamAV/clamscan: 4.62% (14.5298 => 15.2008, std.dev.: 0.0121) MultiSource/Benchmarks/Olden/bh/bh: 3.71% (0.2859 => 0.2965, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 1.97% (33.2944 => 33.9517, std.dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5165, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 24.68% (1.8175 => 2.2661, std.dev.: 0.0291) SingleSource/Benchmarks/Misc/richards_benchmark: 11.07% (1.1560 => 1.2840, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.03% (0.8273 => 0.9020, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4141, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 5.87% (1.2998 => 1.3761, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0039, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.92% (11.2619 => 11.7037, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7748, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.36% (1.9199 => 1.9845, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 3.35% (10.7476 => 11.1080, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.24% (7.4271 => 7.5938, std.dev.: 0.0034) MultiSource/Applications/lemon/lemon: 1.68% (1.4298 => 1.4538, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5135, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9695, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1876, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5783, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5909, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.06% (9.9194 => 10.0247, std.dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.55% (0.2670 => 0.1427, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.47% (0.4657 => 0.3890, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -14.14% (0.0707 => 0.0607, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.06% (1.3819 => 1.2014, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.87% (1.3813 => 1.2035, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.94% (0.0997 => 0.0858, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -11.89% (0.2238 => 0.1972, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -10.92% (1.2308 => 1.0964, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.25% (20.3410 => 18.2562, std.dev.: 0.0154) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.12% (1.3780 => 1.2937, std.dev.: 0.0081) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5148, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8004, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.66% (0.9996 => 0.9630, std.dev.: 0.0108) MultiSource/Applications/siod/siod: -3.55% (3.2729 => 3.1568, std.dev.: 0.0257) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.39% (1.7688 => 1.7088, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.02% (0.4867 => 0.4720, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.60% (26.5159 => 25.8254, std.dev.: 0.0332) MultiSource/Applications/spiff/spiff: -2.55% (3.0263 => 2.9490, std.dev.: 0.0034) SingleSource/Regression/C/uint64_to_float: -2.55% (0.5449 => 0.5310, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.35% (1.9762 => 1.9297, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.99% (0.6589 => 0.6458, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7135, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.70% (6.3560 => 6.2477, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0067, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.25% (0.8342 => 0.8238, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4956, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/heapsort: -1.17% (3.9173 => 3.8715, std.dev.: 0.0048) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2584, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 15 09:55:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 15 Oct 2012 11:55:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121015165525.59EEE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4888?compare_to=4886&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4888, Order: 165938, Start Time: 2012-10-15 15:37:19, End Time: 2012-10-15 16:57:18 To: 4886, Order: 165933, Start Time: 2012-10-15 13:47:56, End Time: 2012-10-15 15:07:55 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (163 on baseline) Performance Improvements: 1 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 951 (682 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.97% (1.2941 => 1.3196, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.21% (15.2320 => 15.0477, std.dev.: 0.0070) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.08% (0.5974 => 0.5969, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: -0.13% (16.5067 => 16.4855, std.dev.: 0.0105) MultiSource/Benchmarks/Bullet/bullet: -0.27% (54.7885 => 54.6418, std.dev.: 0.0240) MultiSource/Benchmarks/MallocBench/gs/gs: -0.02% (4.4635 => 4.4625, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.22% (0.0462 => 0.0461, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0463 => 0.0463, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.23% (0.0432 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0433 => 0.0433) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0421 => 0.0421) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.24% (0.0422 => 0.0423) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0415 => 0.0415) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.48% (0.0415 => 0.0417, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.23% (0.0432 => 0.0433) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.23% (0.0433 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0427 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0429 => 0.0429, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.24% (0.0415 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0419 => 0.0419, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0424 => 0.0424, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.24% (0.0425 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0436 => 0.0436) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.23% (0.0437 => 0.0438, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.24% (0.0413 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.24% (0.0414 => 0.0413, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0424 => 0.0424, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.24% (0.0425 => 0.0426) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0416 => 0.0416) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.24% (0.0416 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0408 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0409 => 0.0409, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0406 => 0.0406) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.25% (0.0407 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0443 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0444 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.25% (0.0405 => 0.0406) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.25% (0.0406 => 0.0407) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.25% (0.0406 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0408 => 0.0408, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0414 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0415 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.03% (1.2652 => 1.2648, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.10% (7.9791 => 7.9710, std.dev.: 0.0185) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.01% (0.7462 => 0.7463, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0358 => 0.0358, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1434 => 0.1435, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.16% (0.0645 => 0.0646, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -13.60% (63.2438 => 54.6418, std.dev.: 0.0240) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.50% (14.1553 => 19.0395, std.dev.: 0.2637) SingleSource/Benchmarks/Misc-C++-EH/spirit: 64.68% (3.4629 => 5.7027, std.dev.: 0.0163) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14230.97% (0.0720 => 10.3183, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10035200.00% (0.0001 => 10.0353, std.dev.: 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 60.57% (0.2554 => 0.4101, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: 45.15% (10.3673 => 15.0477, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/richards_benchmark: 37.67% (0.1622 => 0.2233, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/distray/distray: 33.81% (0.1056 => 0.1413, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 18.09% (0.1432 => 0.1691, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.50% (2.2022 => 2.5876, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.43% (7.0540 => 8.2833, std.dev.: 0.0061) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.71% (0.1566 => 0.1812, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.55% (0.0871 => 0.0989, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.99% (1.7609 => 1.9897, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 12.98% (0.3282 => 0.3708, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 12.82% (0.1584 => 0.1787, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 12.78% (0.1440 => 0.1624, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.60% (0.1143 => 0.1287, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 11.14% (0.7433 => 0.8261, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: 11.06% (0.7115 => 0.7902, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.71% (0.1625 => 0.1799, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.63% (0.2700 => 0.2987, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.59% (0.6675 => 0.7382, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 10.47% (0.1175 => 0.1298, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 10.39% (0.1655 => 0.1827, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 10.39% (9.4845 => 10.4699, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.37% (0.4879 => 0.5385, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.36% (0.3927 => 0.4334, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 10.28% (0.3423 => 0.3775, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/trivial-interface: 10.28% (0.3473 => 0.3830, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.28% (1.5415 => 1.6999, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.17% (0.3177 => 0.3500, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.16% (0.3543 => 0.3903, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.15% (0.1438 => 0.1584, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-2: 10.15% (0.3497 => 0.3852, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.13% (0.3543 => 0.3902, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.08% (0.3561 => 0.3920, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.04% (0.3516 => 0.3869, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 10.00% (3.3354 => 3.6690, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 9.96% (0.3694 => 0.4062, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.95% (0.1236 => 0.1359, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/property: 9.93% (0.3886 => 0.4272, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions: 9.93% (0.3828 => 0.4208, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 9.91% (0.3109 => 0.3417, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.88% (0.4615 => 0.5071, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.85% (0.5860 => 0.6437, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/em3d/em3d: 9.73% (0.1695 => 0.1860, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 9.73% (10.4361 => 11.4512, std.dev.: 0.0178) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.68% (0.5105 => 0.5599, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.63% (0.8067 => 0.8844, std.dev.: 0.0022) MultiSource/Applications/aha/aha: 9.56% (0.1151 => 0.1261, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.52% (1.3050 => 1.4292, std.dev.: 0.0110) MultiSource/Applications/oggenc/oggenc: 9.50% (5.7591 => 6.3065, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.49% (4.2646 => 4.6691, std.dev.: 0.0033) MultiSource/Applications/spiff/spiff: 9.42% (0.7835 => 0.8573, std.dev.: 0.0080) MultiSource/Applications/lua/lua: 9.42% (3.8723 => 4.2369, std.dev.: 0.0123) MultiSource/Applications/Burg/burg: 9.40% (1.1642 => 1.2736, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.29% (0.2271 => 0.2482, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.23% (0.1940 => 0.2119, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.14% (0.1510 => 0.1648, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.12% (0.5569 => 0.6077, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.10% (0.3307 => 0.3608, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 9.03% (0.6456 => 0.7039, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.02% (0.8172 => 0.8909, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.02% (0.2107 => 0.2297, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.99% (0.2758 => 0.3006, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 8.99% (1.0722 => 1.1686, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.98% (5.0018 => 5.4512, std.dev.: 0.0082) MultiSource/Applications/hbd/hbd: 8.98% (1.5603 => 1.7004, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.94% (4.9449 => 5.3871, std.dev.: 0.0092) MultiSource/Benchmarks/Olden/mst/mst: 8.94% (0.1163 => 0.1267, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 8.90% (2.0273 => 2.2078, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.90% (0.1337 => 0.1456, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.88% (8.1363 => 8.8588, std.dev.: 0.0105) MultiSource/Applications/viterbi/viterbi: 8.87% (0.1555 => 0.1693, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.87% (0.9765 => 1.0631, std.dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.84% (0.3121 => 0.3397, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.81% (1.5859 => 1.7256, std.dev.: 0.0062) MultiSource/Applications/siod/siod: 8.72% (2.2969 => 2.4971, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.69% (0.5020 => 0.5456, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: 8.65% (0.3387 => 0.3680, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.57% (0.2065 => 0.2242, std.dev.: 0.0023) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.28% (7.9617 => 8.6213, std.dev.: 0.0137) MultiSource/Benchmarks/McCat/09-vor/vor: 8.27% (0.3180 => 0.3443, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.20% (0.3441 => 0.3723, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.02% (0.4103 => 0.4432, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.00% (2.2024 => 2.3786, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.99% (0.3865 => 0.4174, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.96% (0.6030 => 0.6510, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.95% (1.1861 => 1.2804, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 7.92% (0.5925 => 0.6394, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: 7.89% (0.1268 => 0.1368, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.80% (0.2603 => 0.2806, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.67% (0.4289 => 0.4618, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.60% (0.6450 => 0.6940, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.59% (0.4636 => 0.4988, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.54% (0.4203 => 0.4520, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 7.52% (0.8921 => 0.9592, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 7.45% (0.7326 => 0.7872, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 7.36% (0.3422 => 0.3674, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 7.34% (0.4620 => 0.4959, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: 7.25% (0.1463 => 0.1569, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 7.24% (21.9371 => 23.5262, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/moments: 7.21% (0.4048 => 0.4340, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.20% (0.1695 => 0.1817, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.19% (0.4299 => 0.4608, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.04% (1.4186 => 1.5185, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/sieve: 6.94% (0.3603 => 0.3853, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.93% (0.3826 => 0.4091, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.92% (0.5981 => 0.6395, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.88% (0.3650 => 0.3901, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.81% (0.2891 => 0.3088, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 6.65% (0.3684 => 0.3929, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.58% (0.3162 => 0.3370, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 6.47% (1.1840 => 1.2606, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.38% (0.3136 => 0.3336, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.31% (0.2756 => 0.2930, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.31% (2.0665 => 2.1968, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/strcat: 6.29% (0.2831 => 0.3009, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.28% (0.2725 => 0.2896, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 6.26% (0.3052 => 0.3243, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.12% (0.2793 => 0.2964, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 6.10% (0.3098 => 0.3287, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.10% (0.3232 => 0.3429, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 6.06% (0.3283 => 0.3482, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.03% (0.2802 => 0.2971, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.03% (0.2871 => 0.3044, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.01% (0.2714 => 0.2877, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.98% (0.1906 => 0.2020, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.96% (0.2266 => 0.2401, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.92% (0.2872 => 0.3042, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 5.91% (0.2877 => 0.3047, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.81% (0.4064 => 0.4300, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.75% (0.8101 => 0.8567, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: 5.59% (0.3379 => 0.3568, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.50% (0.1892 => 0.1996, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: 5.47% (0.2049 => 0.2161, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.14% (0.3427 => 0.3603, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 5.13% (17.1811 => 18.0627, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.01% (14.3668 => 15.0870, std.dev.: 0.0061) MultiSource/Applications/hexxagon/hexxagon: 4.80% (1.2842 => 1.3458, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.53% (0.2430 => 0.2540, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.52% (3.8922 => 4.0682, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/objinst: 4.38% (0.3131 => 0.3268, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.79% (1.1194 => 1.1618, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.88% (4.3953 => 10.8952, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.22% (1.1145 => 1.3844, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 9.78% (1.1396 => 1.2510, std.dev.: 0.0013) MultiSource/Applications/aha/aha: 9.20% (3.1595 => 3.4501, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.1578 => 3.3688, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.46% (3.6395 => 3.7656, std.dev.: 0.0016) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.80% (4.2280 => 4.3464, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.70% (0.8275 => 0.8416, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.49% (0.9540 => 0.9682, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 1.35% (11.6436 => 11.8011, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.16% (1.3045 => 1.3196, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.15% (2.6546 => 2.6851, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.01% (6.5088 => 6.5743, std.dev.: 0.0090) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.03% (6.6874 => 0.1316, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -80.11% (0.8651 => 0.1721, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.06% (5.2763 => 3.2684, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.83% (5.3855 => 3.6715, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.38% (5.3526 => 3.6728, std.dev.: 0.0054) SingleSource/UnitTests/Vector/constpool: -14.63% (54.1659 => 46.2441, std.dev.: 0.0152) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.55% (2.9384 => 2.6284, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -8.96% (22.1758 => 20.1888, std.dev.: 0.0144) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.44% (1.1492 => 0.7649, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.93% (1.6925 => 1.4229, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.93% (0.0998 => 0.0859, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -11.49% (1.2373 => 1.0951, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: -10.32% (1.5373 => 1.3786, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -10.09% (0.2161 => 0.1943, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.32% (19.9488 => 18.2884, std.dev.: 0.0360) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.63% (1.8329 => 1.7114, std.dev.: 0.0266) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.31% (1.6805 => 1.5913, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-5: -5.08% (1.5835 => 1.5031, std.dev.: 0.0050) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.80% (3.2827 => 3.1578, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.73% (1.3677 => 1.3167, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.59% (0.9957 => 0.9600, std.dev.: 0.0053) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5027, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: -2.98% (12.4730 => 12.1013, std.dev.: 0.0012) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.00% (8.6802 => 8.5065, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.99% (8.1563 => 7.9936, std.dev.: 0.0069) SingleSource/Regression/C/uint64_to_float: -1.88% (0.5413 => 0.5311, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -1.75% (4.6441 => 4.5629, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6812, std.dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5095, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -1.66% (10.2830 => 10.1123, std.dev.: 0.0219) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4205, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.00% (6.2999 => 6.2368, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 14.15% (0.5229 => 0.5969, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 9.98% (14.9895 => 16.4855, std.dev.: 0.0105) MultiSource/Benchmarks/MallocBench/gs/gs: 8.56% (4.1105 => 4.4625, std.dev.: 0.0143) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.48% (1.1048 => 1.2648, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.35% (7.1582 => 7.9710, std.dev.: 0.0185) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.95% (0.6222 => 0.7463, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35700.00% (0.0001 => 0.0358, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.37% (0.1485 => 0.1435, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.47% (0.2116 => 0.0646, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 15 10:22:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 15 Oct 2012 12:22:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121015172250.E3BFF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4889?compare_to=4887&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4889, Order: 165938, Start Time: 2012-10-15 15:59:47, End Time: 2012-10-15 17:25:44 To: 4887, Order: 165933, Start Time: 2012-10-15 14:04:14, End Time: 2012-10-15 15:30:38 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (188 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1039 (678 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.82% (54.4106 => 56.4907, std.dev.: 0.0970) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.14% (78.7095 => 80.3977, std.dev.: 0.4806) SingleSource/Benchmarks/Misc/lowercase: 1.10% (7.9733 => 8.0607, std.dev.: 0.0095) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.02% (2.0176 => 2.5022, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.94% (0.1410 => 0.1677, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 18.38% (0.0653 => 0.0773, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 17.43% (0.0826 => 0.0970, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 17.21% (0.2243 => 0.2629, std.dev.: 0.0046) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.88% (0.1072 => 0.1253, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.45% (0.1327 => 0.1532, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/tsp/tsp: 14.31% (0.1013 => 0.1158, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.79% (0.0834 => 0.0949, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 13.65% (0.7038 => 0.7999, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.52% (0.1413 => 0.1604, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.17% (0.0964 => 0.1091, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.02% (3.9660 => 4.4825, std.dev.: 0.0026) MultiSource/Applications/hbd/hbd: 12.96% (1.3693 => 1.5467, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.79% (0.2721 => 0.3069, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.72% (0.1588 => 0.1790, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.52% (1.4563 => 1.6386, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.48% (0.6283 => 0.7067, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.43% (0.6959 => 0.7824, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.40% (0.2596 => 0.2918, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 12.24% (0.1062 => 0.1192, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 12.21% (13.8202 => 15.5079, std.dev.: 0.0140) MultiSource/Benchmarks/Olden/power/power: 12.16% (0.1003 => 0.1125, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 12.15% (0.4328 => 0.4854, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.10% (0.9199 => 1.0312, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.06% (0.5265 => 0.5900, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.95% (1.2193 => 1.3650, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.73% (1.1364 => 1.2697, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 11.66% (1.0313 => 1.1516, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.64% (0.3899 => 0.4353, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.63% (0.7710 => 0.8607, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: 11.60% (0.4062 => 0.4533, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.58% (0.1157 => 0.1291, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.53% (0.3130 => 0.3491, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 11.46% (0.5818 => 0.6485, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 11.40% (1.1061 => 1.2322, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.27% (0.4791 => 0.5331, std.dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 11.22% (16.6129 => 18.4771, std.dev.: 0.0094) SingleSource/UnitTests/ObjC++/Hello: 11.17% (0.5748 => 0.6390, std.dev.: 0.0021) MultiSource/Applications/siod/siod: 10.93% (2.1791 => 2.4173, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.92% (0.5577 => 0.6186, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 10.80% (3.8646 => 4.2818, std.dev.: 0.0103) MultiSource/Applications/minisat/minisat: 10.79% (0.6744 => 0.7472, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 10.76% (0.7061 => 0.7821, std.dev.: 0.0022) MultiSource/Applications/sgefa/sgefa: 10.75% (0.2995 => 0.3317, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.67% (0.3485 => 0.3857, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 10.64% (0.1589 => 0.1758, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.55% (0.0976 => 0.1079, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.53% (0.4016 => 0.4439, std.dev.: 0.0025) MultiSource/Applications/treecc/treecc: 10.53% (1.9270 => 2.1299, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.53% (0.4379 => 0.4840, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.52% (0.3756 => 0.4151, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.51% (0.3246 => 0.3587, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.46% (0.1865 => 0.2060, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.44% (0.0977 => 0.1079, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.40% (0.2914 => 0.3217, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.39% (0.4390 => 0.4846, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/mst/mst: 10.35% (0.1111 => 0.1226, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 10.34% (0.3220 => 0.3553, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.33% (0.1075 => 0.1186, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.30% (0.8698 => 0.9594, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.30% (0.2127 => 0.2346, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.26% (0.1569 => 0.1730, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.23% (0.3489 => 0.3846, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 10.20% (3.1889 => 3.5142, std.dev.: 0.0050) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.17% (0.1435 => 0.1581, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 10.14% (0.8310 => 0.9153, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/09-vor/vor: 10.12% (0.2925 => 0.3221, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 10.11% (0.7506 => 0.8265, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: 10.11% (0.3868 => 0.4259, std.dev.: 0.0082) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.03% (0.7460 => 0.8208, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.03% (0.3022 => 0.3325, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 10.02% (0.3293 => 0.3623, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 10.01% (0.1478 => 0.1626, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 10.00% (0.2781 => 0.3059, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.94% (0.3580 => 0.3936, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 9.90% (0.3453 => 0.3795, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.85% (0.5637 => 0.6192, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.81% (0.2782 => 0.3055, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.79% (0.2023 => 0.2221, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.78% (4.9865 => 5.4742, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.72% (0.1986 => 0.2179, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.72% (0.1276 => 0.1400, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 9.68% (1.0594 => 1.1620, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.68% (0.2966 => 0.3253, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.52% (1.9828 => 2.1716, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 9.47% (0.1657 => 0.1814, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.45% (1.3245 => 1.4497, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/lists1: 9.45% (0.3534 => 0.3868, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.44% (7.2180 => 7.8992, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/methcall: 9.42% (0.2761 => 0.3021, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/strcat: 9.39% (0.2726 => 0.2982, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: 9.37% (0.3149 => 0.3444, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.35% (0.6576 => 0.7191, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.30% (0.2655 => 0.2902, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 9.30% (0.3107 => 0.3396, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 9.29% (0.2690 => 0.2940, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/except: 9.28% (0.2760 => 0.3016, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 9.17% (0.2607 => 0.2846, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 9.13% (1.2749 => 1.3913, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wc: 9.09% (0.2937 => 0.3204, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.05% (3.6692 => 4.0011, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.04% (0.2765 => 0.3015, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 9.02% (0.3192 => 0.3480, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 9.02% (0.2628 => 0.2865, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.00% (0.3511 => 0.3827, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 8.97% (0.3131 => 0.3412, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.92% (0.3755 => 0.4090, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.91% (1.5188 => 1.6541, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.90% (4.3801 => 4.7699, std.dev.: 0.0043) MultiSource/Applications/JM/lencod/lencod: 8.88% (14.8535 => 16.1732, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.79% (0.2696 => 0.2933, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.79% (4.4433 => 4.8338, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/matrix: 8.77% (0.2988 => 0.3250, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.75% (0.2321 => 0.2524, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 8.63% (8.4961 => 9.2294, std.dev.: 0.0184) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.57% (0.6135 => 0.6661, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.46% (3.2742 => 3.5511, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 8.46% (0.2945 => 0.3194, std.dev.: 0.0059) MultiSource/Applications/oggenc/oggenc: 8.27% (4.6629 => 5.0487, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.27% (0.2140 => 0.2317, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.27% (0.8818 => 0.9547, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.22% (0.9108 => 0.9857, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.20% (2.1007 => 2.2730, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.18% (0.4805 => 0.5198, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.14% (1.1333 => 1.2255, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/bigfib: 8.11% (0.6250 => 0.6757, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.11% (0.1789 => 0.1934, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 8.10% (3.7467 => 4.0501, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/05-eks/eks: 7.95% (0.4113 => 0.4440, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/neural/neural: 7.80% (0.1385 => 0.1493, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.77% (0.3245 => 0.3497, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.75% (0.2504 => 0.2698, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 7.74% (6.5754 => 7.0843, std.dev.: 0.0144) SingleSource/Benchmarks/Misc/oourafft: 7.47% (0.2008 => 0.2158, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.17% (0.4003 => 0.4290, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.05% (1.2292 => 1.3159, std.dev.: 0.0106) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.89% (6.2785 => 6.7109, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.83% (13.2842 => 14.1911, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/property: 6.75% (0.3940 => 0.4206, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.69% (0.3914 => 0.4176, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 6.54% (0.3578 => 0.3812, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 6.52% (0.3789 => 0.4036, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.43% (0.1819 => 0.1936, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.42% (0.3646 => 0.3880, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 6.36% (0.3663 => 0.3896, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.30% (0.3601 => 0.3828, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.22% (0.3650 => 0.3877, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.16% (0.3623 => 0.3846, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.97% (0.2243 => 0.2377, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 5.80% (0.1777 => 0.1880, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 5.61% (16.2614 => 17.1733, std.dev.: 0.0086) MultiSource/Applications/ClamAV/clamscan: 4.71% (14.5298 => 15.2137, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/bh/bh: 3.67% (0.2859 => 0.2964, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 1.98% (33.2944 => 33.9546, std.dev.: 0.0182) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.61% (5.7573 => 7.5195, std.dev.: 0.0253) SingleSource/Benchmarks/Misc/fbench: 25.41% (1.8175 => 2.2793, std.dev.: 0.0230) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.06% (1.0895 => 1.3625, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 11.05% (1.1560 => 1.2837, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 8.99% (0.8273 => 0.9017, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.47% (0.1322 => 0.1434, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4140, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.20% (1.2998 => 1.3804, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0049, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.49% (0.3139 => 0.3280, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.91% (11.2619 => 11.7020, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.89% (1.7081 => 1.7746, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9859, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.29% (10.7476 => 11.1016, std.dev.: 0.0247) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.18% (7.4271 => 7.5889, std.dev.: 0.0056) MultiSource/Applications/lemon/lemon: 1.67% (1.4298 => 1.4537, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0507, std.dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5135, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1865, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5779, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.14% (8.8259 => 8.9263, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/lists: 1.10% (12.4560 => 12.5934, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.06% (9.9194 => 10.0242, std.dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.55% (0.2670 => 0.1427, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.47% (0.4657 => 0.3890, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -14.14% (0.0707 => 0.0607, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.01% (1.3819 => 1.2021, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.98% (1.3813 => 1.2020, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.44% (0.0997 => 0.0863, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/mason/mason: -11.93% (0.2238 => 0.1971, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.96% (1.2308 => 1.0959, std.dev.: 0.0243) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.07% (20.3410 => 18.2922, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.01% (1.3780 => 1.2952, std.dev.: 0.0078) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.08% (2.6470 => 2.5125, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.44% (0.9996 => 0.9552, std.dev.: 0.0068) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8001, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.58% (3.2729 => 3.1558, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.46% (1.7688 => 1.7076, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: -2.55% (0.5449 => 0.5310, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.50% (26.5159 => 25.8519, std.dev.: 0.0179) MultiSource/Applications/spiff/spiff: -2.48% (3.0263 => 2.9511, std.dev.: 0.0013) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.32% (1.9762 => 1.9303, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.00% (0.6589 => 0.6457, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.91% (6.3560 => 6.2343, std.dev.: 0.0068) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7131, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0070, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.26% (0.8342 => 0.8237, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.14% (2.5254 => 2.4966, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2568, std.dev.: 0.0008) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 15 11:44:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 15 Oct 2012 13:44:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121015184438.239DC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4890?compare_to=4888&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4890, Order: 165943, Start Time: 2012-10-15 17:26:39, End Time: 2012-10-15 18:46:31 To: 4888, Order: 165938, Start Time: 2012-10-15 15:37:19, End Time: 2012-10-15 16:57:18 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (157 on baseline) Performance Improvements: 2 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 950 (687 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.80% (15.0477 => 15.3179, std.dev.: 0.0080) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -3.68% (20.1888 => 19.4462, std.dev.: 0.0309) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.14% (1.3196 => 1.2913, std.dev.: 0.0056) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.30% (0.5969 => 0.5951, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: -0.41% (16.4855 => 16.4176, std.dev.: 0.0088) MultiSource/Benchmarks/Bullet/bullet: 0.37% (54.6418 => 54.8447, std.dev.: 0.0157) MultiSource/Benchmarks/MallocBench/gs/gs: -0.27% (4.4625 => 4.4505, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.22% (0.0461 => 0.0462) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0463 => 0.0463, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0431 => 0.0431, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.23% (0.0433 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0421 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.24% (0.0423 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.24% (0.0415 => 0.0414, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.48% (0.0417 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.23% (0.0433 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0434 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.23% (0.0427 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.23% (0.0429 => 0.0428, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.24% (0.0416 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.24% (0.0419 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0424 => 0.0424, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.47% (0.0426 => 0.0424, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.46% (0.0436 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.46% (0.0438 => 0.0436, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.24% (0.0412 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.24% (0.0413 => 0.0412, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0424 => 0.0424) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.23% (0.0426 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.24% (0.0416 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.24% (0.0417 => 0.0416) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.25% (0.0408 => 0.0407, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.24% (0.0409 => 0.0408, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.25% (0.0406 => 0.0407, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.25% (0.0408 => 0.0407, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0443 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.23% (0.0444 => 0.0443, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.25% (0.0406 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.25% (0.0407 => 0.0406) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0407 => 0.0407) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.25% (0.0408 => 0.0409, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0414 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0415 => 0.0415, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.39% (1.2648 => 1.2599, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.22% (7.9710 => 7.9538, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.09% (0.7463 => 0.7456, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0358 => 0.0358, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: -0.21% (0.1435 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0646 => 0.0645, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -13.28% (63.2438 => 54.8447, std.dev.: 0.0157) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.10% (14.1553 => 18.9822, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++-EH/spirit: 64.33% (3.4629 => 5.6905, std.dev.: 0.0145) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14229.72% (0.0720 => 10.3174, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10036000.00% (0.0001 => 10.0361, std.dev.: 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 60.22% (0.2554 => 0.4092, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 47.75% (10.3673 => 15.3179, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/richards_benchmark: 36.13% (0.1622 => 0.2208, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 33.05% (0.1056 => 0.1405, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.88% (2.2022 => 2.5960, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 17.11% (0.1432 => 0.1677, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.02% (7.0540 => 8.2543, std.dev.: 0.0049) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.33% (0.1566 => 0.1806, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.56% (1.7609 => 1.9996, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 13.41% (0.3282 => 0.3722, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.86% (0.0871 => 0.0983, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 12.29% (0.1440 => 0.1617, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 12.18% (0.1584 => 0.1777, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.81% (0.1143 => 0.1278, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 10.84% (0.7433 => 0.8239, std.dev.: 0.0025) MultiSource/Applications/minisat/minisat: 10.64% (0.7115 => 0.7872, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.37% (0.6675 => 0.7367, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 10.21% (0.1175 => 0.1295, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.11% (0.2700 => 0.2973, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.01% (0.1438 => 0.1582, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.01% (0.3177 => 0.3495, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: 9.97% (0.1655 => 0.1820, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 9.92% (10.4361 => 11.4711, std.dev.: 0.0152) MultiSource/Benchmarks/mafft/pairlocalalign: 9.90% (9.4845 => 10.4238, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.86% (0.4879 => 0.5360, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.80% (1.5415 => 1.6925, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/em3d/em3d: 9.79% (0.1695 => 0.1861, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.77% (0.3543 => 0.3889, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.72% (0.8067 => 0.8851, std.dev.: 0.0055) MultiSource/Applications/d/make_dparser: 9.65% (3.3354 => 3.6574, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/18-imp/imp: 9.58% (0.3423 => 0.3751, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.53% (0.4615 => 0.5055, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.46% (0.5105 => 0.5588, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 9.45% (0.3927 => 0.4298, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 9.40% (5.7591 => 6.3005, std.dev.: 0.0038) MultiSource/Applications/sgefa/sgefa: 9.36% (0.3109 => 0.3400, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 9.30% (0.1151 => 0.1258, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.24% (0.3473 => 0.3794, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.23% (0.1940 => 0.2119, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.22% (0.3516 => 0.3840, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.18% (0.5860 => 0.6398, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions: 9.06% (0.3828 => 0.4175, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.06% (0.3543 => 0.3864, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.05% (1.3050 => 1.4231, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 9.04% (0.3561 => 0.3883, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.04% (0.3497 => 0.3813, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.03% (0.8172 => 0.8910, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.02% (4.2646 => 4.6491, std.dev.: 0.0081) SingleSource/UnitTests/ObjC/property: 9.01% (0.3886 => 0.4236, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 8.98% (1.1642 => 1.2688, std.dev.: 0.0095) MultiSource/Applications/lua/lua: 8.94% (3.8723 => 4.2186, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.92% (0.2758 => 0.3004, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/for-in: 8.88% (0.3694 => 0.4022, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.85% (0.5569 => 0.6062, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.85% (0.2271 => 0.2472, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.81% (0.1510 => 0.1643, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 8.80% (0.6456 => 0.7024, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.77% (0.3307 => 0.3597, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.73% (0.2107 => 0.2291, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 8.68% (0.1555 => 0.1690, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.62% (4.9449 => 5.3712, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.61% (0.5020 => 0.5452, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.59% (5.0018 => 5.4317, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.57% (0.2065 => 0.2242, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 8.56% (1.5603 => 1.6938, std.dev.: 0.0051) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.55% (0.3121 => 0.3388, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.52% (0.9765 => 1.0597, std.dev.: 0.0034) MultiSource/Benchmarks/sim/sim: 8.50% (0.3387 => 0.3675, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.47% (8.1363 => 8.8254, std.dev.: 0.0078) MultiSource/Applications/lemon/lemon: 8.46% (1.0722 => 1.1629, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 8.45% (2.0273 => 2.1986, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 8.44% (0.7835 => 0.8496, std.dev.: 0.0036) MultiSource/Applications/siod/siod: 8.31% (2.2969 => 2.4877, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.15% (0.1337 => 0.1446, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.13% (1.5859 => 1.7148, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 8.06% (0.6030 => 0.6516, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.05% (0.5925 => 0.6402, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.05% (0.3441 => 0.3718, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/09-vor/vor: 7.96% (0.3180 => 0.3433, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.87% (0.4103 => 0.4426, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.82% (7.9617 => 8.5841, std.dev.: 0.0221) SingleSource/UnitTests/ObjC++/property-reference: 7.74% (0.7326 => 0.7893, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.71% (0.3865 => 0.4163, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.51% (1.1861 => 1.2752, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: 7.51% (0.4289 => 0.4611, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.42% (0.4203 => 0.4515) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.38% (0.2603 => 0.2795, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.37% (2.2024 => 2.3648, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 7.34% (0.4620 => 0.4959, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 7.33% (0.3422 => 0.3673, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.24% (0.6450 => 0.6917, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 7.10% (0.8921 => 0.9554, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: 7.04% (0.4048 => 0.4333, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.96% (0.1695 => 0.1813, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.95% (0.3826 => 0.4092, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 6.94% (21.9371 => 23.4606, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.88% (0.3650 => 0.3901, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 6.86% (0.4299 => 0.4594, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.86% (0.3603 => 0.3850, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.77% (0.4636 => 0.4950, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.77% (0.5981 => 0.6386, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.65% (1.4186 => 1.5129, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.55% (0.3162 => 0.3369, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 6.51% (0.3684 => 0.3924, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.44% (0.3136 => 0.3338, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.44% (0.2905 => 0.3092, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 6.31% (0.3283 => 0.3490) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.26% (2.0665 => 2.1959, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.26% (0.2891 => 0.3072, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.20% (0.3098 => 0.3290, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.18% (0.2831 => 0.3006, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 6.06% (0.3232 => 0.3428, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.06% (0.2872 => 0.3046, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.05% (1.1840 => 1.2556, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/wc: 6.00% (0.3052 => 0.3235, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.92% (0.2871 => 0.3041, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.91% (0.2756 => 0.2919, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.91% (0.2793 => 0.2958, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.87% (0.2725 => 0.2885, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.85% (0.2802 => 0.2966, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.80% (0.2877 => 0.3044, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.78% (0.2266 => 0.2397, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.61% (0.1906 => 0.2013, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.61% (0.4064 => 0.4292, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.60% (0.2714 => 0.2866, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.47% (0.3379 => 0.3564, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.38% (0.8101 => 0.8537, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/ReedSolomon: 4.88% (0.2049 => 0.2149, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.73% (14.3668 => 15.0460, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: 4.72% (17.1811 => 17.9927, std.dev.: 0.0067) MultiSource/Applications/hexxagon/hexxagon: 4.68% (1.2842 => 1.3443, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.49% (0.3427 => 0.3581, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.34% (0.3131 => 0.3267, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.32% (0.2430 => 0.2535, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.07% (3.8922 => 4.0505, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.78% (1.1194 => 1.1617, std.dev.: 0.0085) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.55% (0.2944 => 0.3284, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.74% (2.6778 => 2.9653, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.89% (1.1396 => 1.2523, std.dev.: 0.0015) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4500, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3691, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.57% (3.6395 => 3.7696, std.dev.: 0.0028) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.68% (4.2280 => 4.3413, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.28% (1.7254 => 1.7647, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.72% (0.8275 => 0.8417, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.35% (11.6436 => 11.8008, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.23% (2.6546 => 2.6873, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.20% (6.5088 => 6.5871, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.03% (6.6874 => 0.1315, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -80.09% (0.8651 => 0.1722, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.95% (5.2763 => 3.2737, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.35% (5.3855 => 3.6970, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.98% (5.3526 => 3.6942, std.dev.: 0.0069) SingleSource/UnitTests/Vector/constpool: -14.68% (54.1659 => 46.2163, std.dev.: 0.0070) MultiSource/Applications/ClamAV/clamscan: -12.31% (22.1758 => 19.4462, std.dev.: 0.0309) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.23% (2.9384 => 2.6378, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.42% (1.1492 => 0.7651, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4236, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.03% (0.0998 => 0.0858, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.19% (1.2373 => 1.0988, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -10.36% (1.5373 => 1.3780, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/mason/mason: -9.81% (0.2161 => 0.1949, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.28% (19.9488 => 18.2965, std.dev.: 0.0155) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.68% (1.8329 => 1.7104, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.31% (1.6805 => 1.5912, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5085, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.15% (0.9957 => 0.9544, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Applications/siod/siod: -3.54% (3.2827 => 3.1666, std.dev.: 0.0151) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.4995, std.dev.: 0.0069) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0986, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.20% (8.6802 => 8.4894, std.dev.: 0.0145) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.97% (8.1563 => 7.9957, std.dev.: 0.0185) SingleSource/Regression/C/uint64_to_float: -1.88% (0.5413 => 0.5311) SingleSource/Benchmarks/Misc/salsa20: -1.86% (10.2830 => 10.0916, std.dev.: 0.0274) MultiSource/Applications/sqlite3/sqlite3: -1.81% (4.6441 => 4.5602, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: -1.69% (8.8334 => 8.6842, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5140, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4218, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout/lists: -1.22% (6.2999 => 6.2231, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.81% (0.5229 => 0.5951, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 9.53% (14.9895 => 16.4176, std.dev.: 0.0088) MultiSource/Benchmarks/MallocBench/gs/gs: 8.27% (4.1105 => 4.4505, std.dev.: 0.0090) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.04% (1.1048 => 1.2599, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.11% (7.1582 => 7.9538, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.83% (0.6222 => 0.7456, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35700.00% (0.0001 => 0.0358, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.52% (0.2116 => 0.0645, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 15 12:18:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 15 Oct 2012 14:18:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121015191807.AF2C62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4891?compare_to=4889&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4891, Order: 165945, Start Time: 2012-10-15 17:54:57, End Time: 2012-10-15 19:21:01 To: 4889, Order: 165938, Start Time: 2012-10-15 15:59:47, End Time: 2012-10-15 17:25:44 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (189 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1042 (676 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.02% (2.0176 => 2.5022, std.dev.: 0.0056) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.94% (0.1410 => 0.1677, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 18.53% (0.0653 => 0.0774, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 17.68% (0.0826 => 0.0972, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 17.12% (0.2243 => 0.2627, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.88% (0.1072 => 0.1253, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.30% (0.1327 => 0.1530, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 14.61% (0.1013 => 0.1161, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.80% (0.1413 => 0.1608, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.67% (0.0834 => 0.0948, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 13.61% (0.7038 => 0.7996, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 13.54% (1.3693 => 1.5547, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.17% (0.0964 => 0.1091, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.08% (3.9660 => 4.4848, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.95% (0.6959 => 0.7860, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.91% (0.1588 => 0.1793, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.90% (0.0977 => 0.1103, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 12.52% (0.1062 => 0.1195, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.52% (0.2596 => 0.2921, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.50% (0.2721 => 0.3061, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.49% (1.4563 => 1.6382, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.48% (0.7710 => 0.8672, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.45% (0.6283 => 0.7065, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.44% (0.5265 => 0.5920, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 12.37% (13.8202 => 15.5291, std.dev.: 0.0198) SingleSource/Benchmarks/Shootout-C++/hash2: 12.36% (0.4328 => 0.4863, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.29% (0.9199 => 1.0330, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 12.26% (0.1003 => 0.1126, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.12% (1.2193 => 1.3671, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.92% (1.1364 => 1.2719, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 11.92% (0.4062 => 0.4546, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 11.73% (1.0313 => 1.1523, std.dev.: 0.0123) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.67% (0.1157 => 0.1292, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.62% (0.3899 => 0.4352, std.dev.: 0.0029) MultiSource/Applications/Burg/burg: 11.52% (1.1061 => 1.2335, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.50% (0.3130 => 0.3490, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.48% (0.4791 => 0.5341, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.42% (0.3022 => 0.3367, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.24% (0.5577 => 0.6204, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 11.00% (0.7061 => 0.7838, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 11.00% (16.6129 => 18.4396, std.dev.: 0.0091) SingleSource/UnitTests/ObjC++/property-reference-object: 10.98% (0.5818 => 0.6457, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.93% (0.3485 => 0.3866, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 10.90% (2.1791 => 2.4166, std.dev.: 0.0144) SingleSource/Benchmarks/McGill/chomp: 10.82% (0.1589 => 0.1761, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 10.79% (3.8646 => 4.2817, std.dev.: 0.0052) MultiSource/Applications/sgefa/sgefa: 10.78% (0.2995 => 0.3318, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 10.75% (0.6744 => 0.7469, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.72% (0.1865 => 0.2065, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.71% (0.4016 => 0.4446, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.70% (0.3756 => 0.4158, std.dev.: 0.0086) SingleSource/UnitTests/ObjC++/Hello: 10.70% (0.5748 => 0.6363, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.70% (0.1075 => 0.1190, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.69% (0.3246 => 0.3593, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.66% (0.4379 => 0.4846, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.66% (0.4390 => 0.4858, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 10.57% (1.9270 => 2.1307, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.50% (0.2914 => 0.3220, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 10.50% (0.2781 => 0.3073, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 10.50% (0.3220 => 0.3558, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.49% (0.3489 => 0.3855, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.46% (0.8698 => 0.9608, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.45% (0.3580 => 0.3954, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 10.44% (0.3868 => 0.4272, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/mst/mst: 10.44% (0.1111 => 0.1227, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 10.42% (0.3293 => 0.3636, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 10.35% (0.7506 => 0.8283, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.35% (0.0976 => 0.1077, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.33% (0.1569 => 0.1731, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.30% (0.2127 => 0.2346, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.28% (0.2023 => 0.2231, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 10.28% (0.8310 => 0.9164, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.26% (0.1014 => 0.1118, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 10.23% (0.2726 => 0.3005, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.22% (0.5637 => 0.6213, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 10.20% (3.1889 => 3.5142, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 10.19% (0.3453 => 0.3805, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.19% (0.1276 => 0.1406, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 10.19% (0.2925 => 0.3223, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.16% (0.7460 => 0.8218, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.10% (0.1435 => 0.1580, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.10% (0.2782 => 0.3063, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.10% (0.6576 => 0.7240, std.dev.: 0.0072) MultiSource/Applications/viterbi/viterbi: 10.08% (0.1478 => 0.1627, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.08% (0.2966 => 0.3265, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.06% (1.9828 => 2.1823, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/except: 9.93% (0.2760 => 0.3034, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.92% (0.1986 => 0.2183, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 9.90% (0.2607 => 0.2865, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 9.89% (1.0594 => 1.1642, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 9.88% (0.3149 => 0.3460, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 9.87% (0.2937 => 0.3227, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.85% (7.2180 => 7.9293, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/random: 9.81% (0.2690 => 0.2954, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.79% (0.2655 => 0.2915, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 9.78% (0.2761 => 0.3031, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 9.78% (0.1657 => 0.1819, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 9.74% (0.3192 => 0.3503, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 9.73% (0.3534 => 0.3878, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 9.72% (0.3107 => 0.3409, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.61% (4.9865 => 5.4655, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.60% (0.3511 => 0.3848, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 9.59% (0.2628 => 0.2880, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.59% (1.3245 => 1.4515, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.53% (0.2696 => 0.2953, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.51% (0.2765 => 0.3028, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 9.36% (0.3131 => 0.3424, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.30% (3.6692 => 4.0103, std.dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: 9.21% (14.8535 => 16.2221, std.dev.: 0.0050) MultiSource/Applications/SIBsim4/SIBsim4: 9.20% (1.2749 => 1.3922, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 9.17% (0.2988 => 0.3262, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.13% (0.3755 => 0.4098, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.12% (1.5188 => 1.6573, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.04% (4.4433 => 4.8448, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.96% (4.3801 => 4.7727, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.90% (0.6135 => 0.6681, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.87% (0.8818 => 0.9600, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 8.86% (8.4961 => 9.2486, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.68% (3.2742 => 3.5584, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 8.66% (0.2945 => 0.3200, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.62% (0.2321 => 0.2521, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.60% (0.2140 => 0.2324, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.50% (0.9108 => 0.9882, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 8.45% (0.6250 => 0.6778, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 8.39% (0.4113 => 0.4458, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.28% (0.4805 => 0.5203, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.27% (2.1007 => 2.2745, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.21% (1.1333 => 1.2263, std.dev.: 0.0133) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.16% (0.1789 => 0.1935, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 8.14% (3.7467 => 4.0518, std.dev.: 0.0104) MultiSource/Applications/oggenc/oggenc: 8.10% (4.6629 => 5.0408, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/neural/neural: 8.01% (0.1385 => 0.1496, std.dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: 8.01% (6.5754 => 7.1022, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/oourafft: 7.82% (0.2008 => 0.2165, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.75% (0.2504 => 0.2698, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.64% (0.3245 => 0.3493, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.48% (1.2292 => 1.3211, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.34% (0.4003 => 0.4297, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.21% (6.2785 => 6.7313, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 7.06% (0.3940 => 0.4218, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.94% (13.2842 => 14.2066, std.dev.: 0.0079) SingleSource/UnitTests/ObjC/exceptions: 6.92% (0.3914 => 0.4185, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 6.78% (0.3789 => 0.4046, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 6.71% (0.3578 => 0.3818, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 6.66% (0.3663 => 0.3907, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.58% (0.3646 => 0.3886, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.55% (0.3601 => 0.3837, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/exceptions-3: 6.49% (0.3623 => 0.3858, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.44% (0.3650 => 0.3885, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.27% (0.1819 => 0.1933, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: 6.08% (0.1777 => 0.1885, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.80% (0.2243 => 0.2373, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 5.49% (16.2614 => 17.1540, std.dev.: 0.0127) MultiSource/Applications/ClamAV/clamscan: 4.71% (14.5298 => 15.2137, std.dev.: 0.0155) MultiSource/Benchmarks/Olden/bh/bh: 3.64% (0.2859 => 0.2963, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: 2.10% (33.2944 => 33.9921, std.dev.: 0.0126) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 30.42% (5.7573 => 7.5084, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 24.18% (1.8175 => 2.2570, std.dev.: 0.0338) SingleSource/Benchmarks/Misc/richards_benchmark: 11.01% (1.1560 => 1.2833, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1923, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 9.02% (0.8273 => 0.9019, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4140, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.28% (1.2998 => 1.3814, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0049, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.92% (11.2619 => 11.7032, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7748, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9862, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.25% (10.7476 => 11.0971, std.dev.: 0.0529) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.21% (7.4271 => 7.5916, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 1.71% (1.4298 => 1.4543, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5124, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1873, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9671, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5784, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 1.09% (12.4560 => 12.5920, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.06% (9.9194 => 10.0247, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.48% (0.2670 => 0.1429, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.26% (0.4657 => 0.3900, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -14.14% (0.0707 => 0.0607, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.20% (1.3813 => 1.1990, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.05% (1.3819 => 1.2016, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.64% (0.0997 => 0.0861, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.93% (0.2238 => 0.1971, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.66% (1.2308 => 1.0873, std.dev.: 0.0071) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.08% (20.3410 => 18.2899, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.96% (1.3780 => 1.3096, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.15% (0.9996 => 0.9581, std.dev.: 0.0071) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1562, std.dev.: 0.0028) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.54% (1.7688 => 1.7061, std.dev.: 0.0067) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.96% (0.4867 => 0.4723, std.dev.: 0.0006) MultiSource/Applications/lua/lua: -2.54% (26.5159 => 25.8423, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: -2.53% (0.5449 => 0.5311, std.dev.: 0.0022) MultiSource/Applications/spiff/spiff: -2.48% (3.0263 => 2.9511, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.31% (1.9762 => 1.9305, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.12% (0.6589 => 0.6449, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.94% (6.3560 => 6.2327, std.dev.: 0.0080) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7145, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0072, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.41% (3.9173 => 3.8622, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.23% (0.8342 => 0.8239, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4956, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2580, std.dev.: 0.0019) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 15 13:33:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 15 Oct 2012 15:33:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121015203357.F36FC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4892?compare_to=4890&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4892, Order: 165952, Start Time: 2012-10-15 19:15:56, End Time: 2012-10-15 20:35:48 To: 4890, Order: 165943, Start Time: 2012-10-15 17:26:39, End Time: 2012-10-15 18:46:31 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (163 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 951 (681 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.48% (15.3179 => 15.6976, std.dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.08% (79.1981 => 80.8450, std.dev.: 0.3201) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.13% (0.5951 => 0.5959, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 0.12% (16.4176 => 16.4365, std.dev.: 0.0232) MultiSource/Benchmarks/Bullet/bullet: -0.09% (54.8447 => 54.7955, std.dev.: 0.0123) MultiSource/Benchmarks/MallocBench/gs/gs: -0.09% (4.4505 => 4.4467, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.43% (0.0462 => 0.0464) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.65% (0.0463 => 0.0466) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.46% (0.0431 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.46% (0.0432 => 0.0434, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.24% (0.0421 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.24% (0.0422 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.48% (0.0414 => 0.0416) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.48% (0.0415 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.23% (0.0432 => 0.0433, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.23% (0.0434 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.47% (0.0426 => 0.0428, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.47% (0.0428 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.24% (0.0417 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.24% (0.0418 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.24% (0.0424 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.71% (0.0424 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.46% (0.0434 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.46% (0.0436 => 0.0438, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.49% (0.0411 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.49% (0.0412 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.24% (0.0424 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.24% (0.0425 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.48% (0.0415 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.48% (0.0416 => 0.0418) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.25% (0.0407 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.25% (0.0408 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.25% (0.0407 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.25% (0.0407 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.45% (0.0443 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.68% (0.0443 => 0.0446, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.49% (0.0405 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.49% (0.0406 => 0.0408) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.25% (0.0407 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.24% (0.0409 => 0.0410) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.24% (0.0414 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.24% (0.0415 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.10% (1.2599 => 1.2612, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.25% (7.9538 => 7.9737, std.dev.: 0.0176) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.39% (0.7456 => 0.7485, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0358 => 0.0358, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0645 => 0.0645, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -13.36% (63.2438 => 54.7955, std.dev.: 0.0123) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.08% (14.1553 => 18.9788, std.dev.: 0.0145) SingleSource/Benchmarks/Misc-C++-EH/spirit: 64.53% (3.4629 => 5.6975, std.dev.: 0.0088) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14232.92% (0.0720 => 10.3197, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10035800.00% (0.0001 => 10.0359, std.dev.: 0.0011) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 59.51% (0.2554 => 0.4074) MultiSource/Benchmarks/PAQ8p/paq8p: 51.41% (10.3673 => 15.6976, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/richards_benchmark: 36.50% (0.1622 => 0.2214, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 33.05% (0.1056 => 0.1405, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 17.74% (0.1432 => 0.1686) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.18% (7.0540 => 8.2656, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.11% (2.2022 => 2.5789, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.20% (0.1566 => 0.1804, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.14% (1.7609 => 1.9923, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 13.07% (0.3282 => 0.3711, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.97% (0.0871 => 0.0984, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 12.29% (0.1440 => 0.1617, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.87% (0.1584 => 0.1772, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 10.72% (0.7115 => 0.7878, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 10.70% (0.7433 => 0.8228, std.dev.: 0.0017) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.50% (0.1143 => 0.1263, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.49% (0.6675 => 0.7375, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 10.34% (0.3473 => 0.3832, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.33% (0.2700 => 0.2979, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.29% (0.3927 => 0.4331, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.28% (0.1625 => 0.1792, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.22% (0.3543 => 0.3905, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 10.21% (0.1175 => 0.1295, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.16% (0.3543 => 0.3903, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 10.14% (9.4845 => 10.4459, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-3: 10.10% (0.3516 => 0.3871, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.09% (0.3497 => 0.3850, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.05% (0.3561 => 0.3919, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/chomp: 10.03% (0.1655 => 0.1821, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.01% (0.1438 => 0.1582, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.98% (0.3828 => 0.4210, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.91% (0.3694 => 0.4060, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.88% (0.3886 => 0.4270, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 9.88% (10.4361 => 11.4667, std.dev.: 0.0078) MultiSource/Applications/d/make_dparser: 9.82% (3.3354 => 3.6631, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.78% (1.5415 => 1.6922, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.76% (0.3177 => 0.3487, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 9.73% (0.1695 => 0.1860, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 9.64% (0.3423 => 0.3753, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.63% (0.4879 => 0.5349, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.62% (0.5105 => 0.5596, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 9.62% (0.3109 => 0.3408, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.58% (0.4615 => 0.5057, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.22% (0.1236 => 0.1350, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.22% (4.2646 => 4.6578, std.dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 9.20% (5.7591 => 6.2890, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.16% (0.2271 => 0.2479, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.14% (0.1510 => 0.1648, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.11% (0.5860 => 0.6394, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 9.09% (1.1642 => 1.2700, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.07% (0.1940 => 0.2116, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.07% (0.8172 => 0.8913, std.dev.: 0.0015) MultiSource/Applications/lua/lua: 9.06% (3.8723 => 4.2232, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/bigfib: 9.05% (0.6456 => 0.7040, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 9.04% (0.1151 => 0.1255, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.01% (0.3307 => 0.3605, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.00% (1.3050 => 1.4224, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 8.94% (0.1555 => 0.1694, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.89% (0.8067 => 0.8784, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.87% (0.5569 => 0.6063, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.78% (0.2107 => 0.2292, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/mst/mst: 8.77% (0.1163 => 0.1265, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.75% (5.0018 => 5.4394, std.dev.: 0.0082) MultiSource/Benchmarks/sim/sim: 8.71% (0.3387 => 0.3682, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.70% (0.2758 => 0.2998, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.68% (4.9449 => 5.3743, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.68% (8.1363 => 8.8426, std.dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.63% (0.5020 => 0.5453, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.62% (0.3121 => 0.3390, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 8.61% (1.5603 => 1.6946, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.57% (0.2065 => 0.2242, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 8.54% (0.7835 => 0.8504, std.dev.: 0.0044) MultiSource/Applications/lemon/lemon: 8.52% (1.0722 => 1.1636, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.50% (0.9765 => 1.0595, std.dev.: 0.0026) MultiSource/Applications/treecc/treecc: 8.35% (2.0273 => 2.1965, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.28% (1.5859 => 1.7172, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 8.28% (0.6030 => 0.6529, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.25% (0.5925 => 0.6414, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.23% (7.9617 => 8.6166, std.dev.: 0.0021) MultiSource/Applications/siod/siod: 8.08% (2.2969 => 2.4824, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.99% (0.4103 => 0.4431, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 7.92% (0.3180 => 0.3432, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 7.89% (0.1268 => 0.1368, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.87% (0.3865 => 0.4169, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.82% (0.3441 => 0.3710, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.81% (0.4289 => 0.4624, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.71% (0.4203 => 0.4527, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.70% (0.1337 => 0.1440, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.63% (0.7326 => 0.7885, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.61% (1.1861 => 1.2764, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 7.54% (0.3422 => 0.3680, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.41% (0.2603 => 0.2796, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.40% (2.2024 => 2.3653, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 7.29% (0.4620 => 0.4957, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.20% (0.1695 => 0.1817, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.19% (0.6450 => 0.6914, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 7.16% (0.4048 => 0.4338, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 7.14% (0.4299 => 0.4606, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.12% (0.3650 => 0.3910, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.05% (0.4636 => 0.4963, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: 7.03% (0.8921 => 0.9548, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 7.00% (0.3684 => 0.3942, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/sieve: 6.99% (0.3603 => 0.3855, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.94% (0.5981 => 0.6396, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.93% (0.3826 => 0.4091, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 6.90% (0.1463 => 0.1564, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 6.87% (21.9371 => 23.4452, std.dev.: 0.0119) SingleSource/Regression/C++/ofstream_ctor: 6.71% (0.2905 => 0.3100, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.63% (2.0665 => 2.2036, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.60% (0.3136 => 0.3343, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.60% (1.4186 => 1.5122, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.55% (0.3162 => 0.3369, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.50% (0.2891 => 0.3079, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.43% (0.2831 => 0.3013, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.33% (0.3098 => 0.3294, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.31% (0.2725 => 0.2897, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/except: 6.30% (0.2871 => 0.3052, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.25% (0.3232 => 0.3434, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 6.24% (0.3283 => 0.3488, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.20% (0.2756 => 0.2927, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 6.14% (1.1840 => 1.2567, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.13% (0.2872 => 0.3048, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.05% (0.2877 => 0.3051, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.97% (0.2714 => 0.2876, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 5.96% (0.3052 => 0.3234, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.88% (0.1906 => 0.2018, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.87% (0.2793 => 0.2957, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/random: 5.85% (0.2802 => 0.2966, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.78% (0.2266 => 0.2397, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.73% (0.4064 => 0.4297, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.71% (0.1892 => 0.2000, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 5.68% (0.3379 => 0.3571, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.55% (0.8101 => 0.8551, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: 5.03% (0.2049 => 0.2152, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.94% (14.3668 => 15.0770, std.dev.: 0.0198) MultiSource/Applications/sqlite3/sqlite3: 4.81% (17.1811 => 18.0076, std.dev.: 0.0187) MultiSource/Applications/hexxagon/hexxagon: 4.73% (1.2842 => 1.3449, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 4.60% (0.3131 => 0.3275, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.52% (0.3427 => 0.3582, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.24% (0.2430 => 0.2533, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.06% (3.8922 => 4.0502, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.22% (1.1194 => 1.1554, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.51% (5.3999 => 13.3115, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2173, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.99% (0.1421 => 0.1563, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/richards_benchmark: 9.88% (1.1396 => 1.2522, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 9.22% (3.1595 => 3.4508, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.70% (3.1578 => 3.3693, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.57% (3.6395 => 3.7693, std.dev.: 0.0033) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.73% (4.2280 => 4.3435, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.72% (0.8275 => 0.8417, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.40% (0.9540 => 0.9674, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.35% (11.6436 => 11.8011, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.21% (2.6546 => 2.6866, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.10% (6.5088 => 6.5803, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.05% (6.6874 => 0.1306, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.26% (0.8651 => 0.1708, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.20% (5.2763 => 3.2608, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.81% (5.3855 => 3.6722, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.41% (5.3526 => 3.6713, std.dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -14.70% (54.1659 => 46.2058, std.dev.: 0.0258) MultiSource/Applications/ClamAV/clamscan: -12.27% (22.1758 => 19.4551, std.dev.: 0.0115) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.50% (2.9384 => 2.6300, std.dev.: 0.0183) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.51% (1.1492 => 0.7641, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4233, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.73% (0.0998 => 0.0861, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.99% (1.2373 => 1.0890, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/mandel-2: -10.37% (1.5373 => 1.3779, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/mason/mason: -10.00% (0.2161 => 0.1945, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.28% (19.9488 => 18.2975, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.66% (1.8329 => 1.7108, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5753, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8479, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.29% (1.6805 => 1.5916, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.94% (1.5835 => 1.5052, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.06% (0.9957 => 0.9553, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.61% (3.2827 => 3.1643, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4930, std.dev.: 0.0094) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0990, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.26% (8.1563 => 7.9716, std.dev.: 0.0215) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.04% (8.6802 => 8.5027, std.dev.: 0.0240) SingleSource/UnitTests/Vector/multiplies: -1.89% (2.5528 => 2.5046, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/salsa20: -1.76% (10.2830 => 10.1022, std.dev.: 0.0096) MultiSource/Applications/sqlite3/sqlite3: -1.75% (4.6441 => 4.5627, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6832, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4204, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/lists: -1.17% (6.2999 => 6.2263, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8569, std.dev.: 0.0103) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.96% (0.5229 => 0.5959, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 9.65% (14.9895 => 16.4365, std.dev.: 0.0232) MultiSource/Benchmarks/MallocBench/gs/gs: 8.18% (4.1105 => 4.4467, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.16% (1.1048 => 1.2612, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.39% (7.1582 => 7.9737, std.dev.: 0.0176) SingleSource/Benchmarks/Misc-C++/stepanov_container: 20.30% (0.6222 => 0.7485, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35700.00% (0.0001 => 0.0358, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.52% (0.2116 => 0.0645, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 15 14:13:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 15 Oct 2012 16:13:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121015211353.14A8F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4893?compare_to=4891&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4893, Order: 165955, Start Time: 2012-10-15 19:50:58, End Time: 2012-10-15 21:16:46 To: 4891, Order: 165945, Start Time: 2012-10-15 17:54:57, End Time: 2012-10-15 19:21:01 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (187 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1040 (679 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.41% (79.3664 => 80.4835, std.dev.: 0.3335) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.12% (0.9581 => 0.9688, std.dev.: 0.0021) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.55% (2.0176 => 2.4928, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.65% (0.1410 => 0.1673, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.30% (0.0653 => 0.0766) SingleSource/Benchmarks/Misc/flops: 17.19% (0.0826 => 0.0968, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 16.94% (0.2243 => 0.2623, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.21% (0.1072 => 0.1235, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/tsp/tsp: 14.22% (0.1013 => 0.1157, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.72% (0.1327 => 0.1509, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.67% (0.0834 => 0.0948, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.38% (0.1413 => 0.1602, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 13.24% (0.7038 => 0.7970, std.dev.: 0.0097) MultiSource/Applications/hbd/hbd: 13.02% (1.3693 => 1.5476, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.86% (0.0964 => 0.1088, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.83% (3.9660 => 4.4750, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.71% (0.2596 => 0.2926, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.57% (0.7710 => 0.8679, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.41% (0.1588 => 0.1785, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.31% (0.6959 => 0.7816, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash2: 12.27% (0.4328 => 0.4859, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.23% (1.4563 => 1.6344, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.18% (0.6283 => 0.7048, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.14% (0.9199 => 1.0316, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.14% (0.5265 => 0.5904, std.dev.: 0.0061) MultiSource/Applications/SPASS/SPASS: 12.13% (13.8202 => 15.4968, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.13% (0.2721 => 0.3051, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 11.86% (0.1062 => 0.1188, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: 11.86% (0.1003 => 0.1122, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.80% (1.2193 => 1.3632, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 11.67% (0.4062 => 0.4536, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.61% (1.1364 => 1.2683, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.32% (0.1157 => 0.1288, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.31% (0.3899 => 0.4340, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 11.22% (1.1061 => 1.2302, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 11.17% (0.7061 => 0.7850, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 11.15% (1.0313 => 1.1463, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 11.07% (0.5818 => 0.6462, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.00% (0.4791 => 0.5318, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.99% (0.5577 => 0.6190, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.96% (0.3130 => 0.3473, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 10.73% (0.5748 => 0.6365, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.70% (0.1075 => 0.1190, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.64% (0.0977 => 0.1081, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.62% (0.3485 => 0.3855, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.60% (0.2914 => 0.3223, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 10.60% (16.6129 => 18.3732, std.dev.: 0.0125) MultiSource/Applications/siod/siod: 10.59% (2.1791 => 2.4098, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 10.58% (3.8646 => 4.2735, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 10.54% (0.6744 => 0.7455, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.53% (0.4016 => 0.4439, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.50% (0.4390 => 0.4851, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 10.50% (0.3220 => 0.3558, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.46% (0.3756 => 0.4149, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.38% (0.3246 => 0.3583, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.37% (0.4379 => 0.4833, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/mst/mst: 10.35% (0.1111 => 0.1226, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 10.35% (0.2995 => 0.3305, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.34% (0.2127 => 0.2347, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.32% (0.1986 => 0.2191, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.32% (0.3489 => 0.3849, std.dev.: 0.0043) MultiSource/Applications/spiff/spiff: 10.26% (0.7506 => 0.8276, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 10.26% (0.1589 => 0.1752, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.26% (0.1014 => 0.1118, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 10.24% (1.9270 => 2.1244, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.24% (0.1865 => 0.2056, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.23% (0.3022 => 0.3331, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 10.18% (0.2781 => 0.3064, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.16% (0.7460 => 0.8218, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.13% (0.1569 => 0.1728, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.13% (0.8698 => 0.9579, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: 10.09% (0.2925 => 0.3220, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 10.08% (0.1478 => 0.1627, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.08% (0.2966 => 0.3265, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.08% (0.5637 => 0.6205, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.06% (0.3580 => 0.3940, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 10.05% (0.3293 => 0.3624, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 10.05% (0.3453 => 0.3800, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 9.97% (3.1889 => 3.5068, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 9.93% (0.3868 => 0.4252, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.87% (0.1276 => 0.1402, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.83% (0.1435 => 0.1576, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 9.80% (0.8310 => 0.9124, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.78% (0.2782 => 0.3054, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.74% (0.2023 => 0.2220, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 9.68% (0.2726 => 0.2990, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.66% (7.2180 => 7.9152, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.64% (4.9865 => 5.4673, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.58% (1.9828 => 2.1728, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/lists1: 9.56% (0.3534 => 0.3872, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 9.56% (0.2761 => 0.3025, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/ary3: 9.53% (0.3149 => 0.3449, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 9.47% (0.2937 => 0.3215, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 9.43% (0.3107 => 0.3400, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 9.42% (0.2760 => 0.3020, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.42% (0.2655 => 0.2905, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 9.41% (0.1657 => 0.1813, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 9.37% (0.2690 => 0.2942, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 9.36% (0.2607 => 0.2851, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 9.35% (1.0594 => 1.1585, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.22% (0.2765 => 0.3020, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 9.17% (0.2628 => 0.2869, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.16% (1.3245 => 1.4458, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary2: 9.15% (0.3192 => 0.3484, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.98% (0.2696 => 0.2938, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.95% (0.3755 => 0.4091, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 8.93% (1.2749 => 1.3887, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 8.91% (0.3131 => 0.3410, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.90% (3.6692 => 3.9958, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/matrix: 8.87% (0.2988 => 0.3253, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.80% (4.3801 => 4.7655, std.dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 8.77% (14.8535 => 16.1558, std.dev.: 0.0146) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.68% (0.6576 => 0.7147, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.67% (4.4433 => 4.8287, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.57% (1.5188 => 1.6490, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 8.54% (8.4961 => 9.2213, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/objinst: 8.52% (0.2945 => 0.3196, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.51% (0.6135 => 0.6657, std.dev.: 0.0081) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.32% (0.2140 => 0.2318, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.32% (0.2321 => 0.2514, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/bigfib: 8.24% (0.6250 => 0.6765, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.20% (0.8818 => 0.9541, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.16% (0.1789 => 0.1935, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.07% (3.2742 => 3.5384, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.03% (0.9108 => 0.9839, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.01% (1.1333 => 1.2241, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 7.93% (3.7467 => 4.0437, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/05-eks/eks: 7.93% (0.4113 => 0.4439, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.89% (0.4805 => 0.5184, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 7.83% (4.6629 => 5.0280, std.dev.: 0.0215) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.82% (2.1007 => 2.2649, std.dev.: 0.0222) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.80% (0.3511 => 0.3785, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: 7.73% (0.1385 => 0.1492, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 7.61% (6.5754 => 7.0755, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.55% (0.3245 => 0.3490, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.51% (0.2504 => 0.2692, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 7.42% (0.2008 => 0.2157) SingleSource/UnitTests/ObjC/parameter-passing: 7.02% (0.4003 => 0.4284, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 6.92% (1.2292 => 1.3142, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 6.85% (0.3940 => 0.4210, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 6.85% (0.3914 => 0.4182, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.83% (6.2785 => 6.7071, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.68% (13.2842 => 14.1719, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/for-in: 6.55% (0.3789 => 0.4037, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.54% (0.1819 => 0.1938, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 6.52% (0.3663 => 0.3902, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 6.51% (0.3578 => 0.3811, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.45% (0.3646 => 0.3881, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.39% (0.3601 => 0.3831, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.35% (0.3623 => 0.3853, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.27% (0.3650 => 0.3879, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.71% (0.2243 => 0.2371, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 5.39% (16.2614 => 17.1386, std.dev.: 0.0350) MultiSource/Applications/ClamAV/clamscan: 4.50% (14.5298 => 15.1830, std.dev.: 0.0111) MultiSource/Benchmarks/Bullet/bullet: 2.07% (33.2944 => 33.9821, std.dev.: 0.0151) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5139, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.06% (1.0895 => 1.3625, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.17% (1.8175 => 2.2568, std.dev.: 0.0170) SingleSource/Benchmarks/Misc/richards_benchmark: 11.23% (1.1560 => 1.2858, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 8.99% (0.8273 => 0.9017, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4143, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.31% (1.2998 => 1.3818, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0040, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.90% (11.2619 => 11.7013, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.86% (1.7081 => 1.7740, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 3.37% (1.9199 => 1.9846, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 3.35% (10.7476 => 11.1074, std.dev.: 0.0144) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.18% (7.4271 => 7.5892, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 1.76% (1.4298 => 1.4550, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5127, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2123, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1871, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5782, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.17% (1.9433 => 1.9661, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.06% (9.9194 => 10.0242, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5862, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.01% (3.6469 => 3.6839, std.dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.78% (0.2670 => 0.1421) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.43% (0.4657 => 0.3892, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -14.14% (0.0707 => 0.0607, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.19% (1.3813 => 1.1991, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.11% (1.3819 => 1.2008, std.dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.34% (0.0997 => 0.0864, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.11% (0.2238 => 0.1967, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.85% (1.2308 => 1.0972, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.12% (20.3410 => 18.2832, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.09% (1.3780 => 1.2941, std.dev.: 0.0145) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.54% (1.7688 => 1.7061, std.dev.: 0.0010) MultiSource/Applications/siod/siod: -3.54% (3.2729 => 3.1571, std.dev.: 0.0256) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.08% (0.9996 => 0.9688, std.dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.56% (26.5159 => 25.8372, std.dev.: 0.0200) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.47% (3.0263 => 2.9514, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: -2.36% (1.9762 => 1.9296, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.09% (0.6589 => 0.6451, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -1.86% (6.3560 => 6.2377, std.dev.: 0.0076) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7134, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0062, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8668, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.25% (0.8342 => 0.8238, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.23% (2.5254 => 2.4943, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2575, std.dev.: 0.0015) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 15 15:23:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 15 Oct 2012 17:23:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121015222355.3A34B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4894?compare_to=4892&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4894, Order: 165958, Start Time: 2012-10-15 21:05:29, End Time: 2012-10-15 22:25:49 To: 4892, Order: 165952, Start Time: 2012-10-15 19:15:56, End Time: 2012-10-15 20:35:48 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (166 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 953 (678 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.03% (0.5959 => 0.5957, std.dev.: 0.0045) MultiSource/Applications/SPASS/SPASS: 0.36% (16.4365 => 16.4964, std.dev.: 0.0208) MultiSource/Benchmarks/Bullet/bullet: 0.50% (54.7955 => 55.0692, std.dev.: 0.0218) MultiSource/Benchmarks/MallocBench/gs/gs: 0.30% (4.4467 => 4.4601, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0464 => 0.0464, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.43% (0.0466 => 0.0464, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0433 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.23% (0.0434 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0422 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0423 => 0.0423, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0416 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0417 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0433 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0435 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0428 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.23% (0.0430 => 0.0429, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0418 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0419 => 0.0419, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.24% (0.0425 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0427 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.23% (0.0436 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.97% (0.0438 => 0.0451, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0413 => 0.0413, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0414 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0425 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0426 => 0.0426, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0418 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0408 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.24% (0.0409 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.25% (0.0408 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.25% (0.0408 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.22% (0.0445 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0446 => 0.0446, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0407 => 0.0407) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0408 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0408 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0410 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0415 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0416 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.08% (1.2612 => 1.2622, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.29% (7.9737 => 7.9970, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.01% (0.7485 => 0.7484, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 1.40% (0.0358 => 0.0363, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0645 => 0.0645, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.93% (63.2438 => 55.0692, std.dev.: 0.0218) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.83% (14.1553 => 19.0861, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++-EH/spirit: 65.36% (3.4629 => 5.7262, std.dev.: 0.0035) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14233.75% (0.0720 => 10.3203, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10035200.00% (0.0001 => 10.0353, std.dev.: 0.0013) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 61.79% (0.2554 => 0.4132, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 50.11% (10.3673 => 15.5628, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/richards_benchmark: 36.07% (0.1622 => 0.2207, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 33.24% (0.1056 => 0.1407, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.41% (7.0540 => 8.2823, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/flops: 17.32% (0.1432 => 0.1680, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.11% (2.2022 => 2.5789, std.dev.: 0.0054) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.26% (0.1566 => 0.1805, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.38% (0.0730 => 0.0835, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.55% (1.7609 => 1.9995, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.48% (0.1625 => 0.1844, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 13.10% (0.3282 => 0.3712, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.97% (0.0871 => 0.0984, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.51% (0.1143 => 0.1286, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 12.36% (0.1440 => 0.1618, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.99% (0.1584 => 0.1774, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 11.21% (0.7433 => 0.8266, std.dev.: 0.0029) MultiSource/Applications/minisat/minisat: 11.09% (0.7115 => 0.7904, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.89% (0.2700 => 0.2994, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.76% (0.3177 => 0.3519, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.76% (0.6675 => 0.7393, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 10.47% (0.1175 => 0.1298, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.43% (0.1438 => 0.1588, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: 10.33% (0.1655 => 0.1826, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 10.25% (9.4845 => 10.4562, std.dev.: 0.0172) SingleSource/UnitTests/ObjC/parameter-passing: 10.16% (0.3927 => 0.4326, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.09% (0.5105 => 0.5620, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/synchronized: 10.05% (0.3561 => 0.3919, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 10.05% (0.3473 => 0.3822, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.99% (0.3543 => 0.3897, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 9.98% (3.3354 => 3.6684, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.98% (0.2065 => 0.2271, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 9.96% (0.1044 => 0.1148, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.95% (0.1940 => 0.2133, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 9.94% (0.3543 => 0.3895, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 9.90% (0.3423 => 0.3762, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.88% (0.4879 => 0.5361, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.87% (0.3516 => 0.3863, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.87% (0.3497 => 0.3842, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 9.86% (0.3886 => 0.4269, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 9.85% (0.1695 => 0.1862, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.82% (1.5415 => 1.6928, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions: 9.80% (0.3828 => 0.4203, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.75% (0.3694 => 0.4054, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.71% (0.1236 => 0.1356, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 9.67% (10.4361 => 11.4449, std.dev.: 0.0198) MultiSource/Applications/aha/aha: 9.64% (0.1151 => 0.1262, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.64% (0.4615 => 0.5060, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 9.46% (0.3109 => 0.3403, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.42% (0.5860 => 0.6412, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 9.40% (5.7591 => 6.3007, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/bigfib: 9.37% (0.6456 => 0.7061, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.33% (4.2646 => 4.6626, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.31% (0.3307 => 0.3615, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.31% (0.4103 => 0.4485, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 9.29% (1.1642 => 1.2723, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.27% (0.1510 => 0.1650, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 9.21% (3.8723 => 4.2290, std.dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.15% (1.3050 => 1.4244, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.04% (0.5020 => 0.5474, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.03% (0.5569 => 0.6072, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.03% (0.2271 => 0.2476, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.02% (4.9449 => 5.3907, std.dev.: 0.0114) MultiSource/Applications/viterbi/viterbi: 9.00% (0.1555 => 0.1695, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.95% (0.8067 => 0.8789, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/mst/mst: 8.94% (0.1163 => 0.1267, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.92% (5.0018 => 5.4479, std.dev.: 0.0089) SingleSource/UnitTests/ObjC++/property-reference-object: 8.91% (0.6030 => 0.6567, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 8.88% (0.7835 => 0.8531, std.dev.: 0.0052) SingleSource/UnitTests/ObjC++/Hello: 8.81% (0.5925 => 0.6447, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.76% (0.8172 => 0.8888, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.76% (8.1363 => 8.8489, std.dev.: 0.0114) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.72% (0.3121 => 0.3393, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.70% (0.2758 => 0.2998, std.dev.: 0.0024) MultiSource/Benchmarks/sim/sim: 8.68% (0.3387 => 0.3681, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 8.66% (1.0722 => 1.1650, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.64% (0.2107 => 0.2289, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.59% (0.9765 => 1.0604, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.56% (1.5859 => 1.7217, std.dev.: 0.0051) MultiSource/Applications/hbd/hbd: 8.55% (1.5603 => 1.6937, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.53% (7.9617 => 8.6412, std.dev.: 0.0158) MultiSource/Applications/treecc/treecc: 8.52% (2.0273 => 2.2001, std.dev.: 0.0034) MultiSource/Applications/siod/siod: 8.49% (2.2969 => 2.4918, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/property-reference: 8.45% (0.7326 => 0.7945, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.38% (0.1337 => 0.1449, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.20% (0.3865 => 0.4182, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.20% (0.3441 => 0.3723, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 8.18% (0.3180 => 0.3440, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 8.07% (0.4289 => 0.4635, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.02% (0.4203 => 0.4540, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.00% (0.3162 => 0.3415, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 7.98% (0.3422 => 0.3695, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/health/health: 7.97% (0.1268 => 0.1369, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.79% (0.4636 => 0.4997, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 7.77% (0.4620 => 0.4979, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.74% (0.3826 => 0.4122, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.73% (0.1695 => 0.1826, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.71% (1.1861 => 1.2775, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.70% (2.2024 => 2.3719, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 7.68% (0.4048 => 0.4359, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.65% (0.3136 => 0.3376, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.57% (0.2603 => 0.2800, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 7.52% (0.3603 => 0.3874, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.37% (0.3650 => 0.3919, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.35% (0.6450 => 0.6924, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 7.31% (21.9371 => 23.5412, std.dev.: 0.0307) MultiSource/Benchmarks/McCat/05-eks/eks: 7.14% (0.4299 => 0.4606, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 7.12% (0.8921 => 0.9556, std.dev.: 0.0019) SingleSource/Regression/C++/ofstream_ctor: 7.06% (0.2905 => 0.3110, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 7.00% (0.3684 => 0.3942, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 6.97% (0.1463 => 0.1565, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.81% (0.2891 => 0.3088, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.79% (0.5981 => 0.6387, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.73% (2.0665 => 2.2055, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/strcat: 6.71% (0.2831 => 0.3021, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.65% (1.4186 => 1.5129, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 6.62% (0.3098 => 0.3303, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.59% (0.3232 => 0.3445, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.55% (0.3283 => 0.3498, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.51% (0.2871 => 0.3058, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.44% (0.2872 => 0.3057, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.42% (0.2756 => 0.2933, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/methcall: 6.36% (0.2877 => 0.3060, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.35% (0.2725 => 0.2898, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 6.32% (0.3052 => 0.3245, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.27% (0.4064 => 0.4319, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.22% (0.2266 => 0.2407, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 6.22% (1.1840 => 1.2576, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary2: 6.19% (0.3379 => 0.3588, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 6.17% (0.2802 => 0.2975, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.16% (0.2793 => 0.2965, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 6.12% (0.2714 => 0.2880, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.71% (0.1892 => 0.2000, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.67% (0.1906 => 0.2014, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.51% (0.8101 => 0.8547, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/ReedSolomon: 4.98% (0.2049 => 0.2151, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 4.97% (1.2842 => 1.3480, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 4.93% (17.1811 => 18.0282, std.dev.: 0.0194) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.87% (14.3668 => 15.0665, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/objinst: 4.79% (0.3131 => 0.3281, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.64% (0.3427 => 0.3586, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.32% (0.2430 => 0.2535, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.23% (3.8922 => 4.0567, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: 3.30% (0.3092 => 0.3194, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.27% (1.1194 => 1.1560, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.20% (1.1145 => 1.3842, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.92% (1.1396 => 1.2527, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.21% (3.1595 => 3.4506, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 6.62% (3.1578 => 3.3670, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.65% (0.3463 => 0.3624, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.88% (3.6395 => 3.7808, std.dev.: 0.0046) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.66% (4.2280 => 4.3403, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.73% (0.8275 => 0.8418, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 1.35% (11.6436 => 11.8008, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.15% (6.5088 => 6.5837, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.10% (2.6546 => 2.6839, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1311, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.06% (0.8651 => 0.1725, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.94% (5.2763 => 3.2744, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.53% (5.3855 => 3.6872, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.07% (5.3526 => 3.6898, std.dev.: 0.0099) SingleSource/UnitTests/Vector/constpool: -14.65% (54.1659 => 46.2300, std.dev.: 0.0134) MultiSource/Applications/ClamAV/clamscan: -12.23% (22.1758 => 19.4634, std.dev.: 0.0405) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.41% (2.9384 => 2.6325, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.50% (1.1492 => 0.7642, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: -15.74% (1.6925 => 1.4261, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.63% (0.0998 => 0.0862, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -12.34% (1.2373 => 1.0846, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/mandel-2: -10.31% (1.5373 => 1.3788, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/mason/mason: -10.09% (0.2161 => 0.1943, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.37% (19.9488 => 18.2790, std.dev.: 0.0194) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.71% (1.8329 => 1.7099, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8478, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.33% (1.6805 => 1.5909, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5090, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.23% (0.9957 => 0.9536, std.dev.: 0.0129) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.64% (3.2827 => 3.1632, std.dev.: 0.0220) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4933, std.dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: -3.02% (12.4730 => 12.0958, std.dev.: 0.0025) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -2.14% (10.2830 => 10.0630, std.dev.: 0.0308) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.05% (8.1563 => 7.9895, std.dev.: 0.0218) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.98% (8.6802 => 8.5084, std.dev.: 0.0138) SingleSource/Regression/C/uint64_to_float: -1.90% (0.5413 => 0.5310, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: -1.78% (4.6441 => 4.5616, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6812, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -1.65% (2.5528 => 2.5107, std.dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4206, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/lists: -1.25% (6.2999 => 6.2211, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.92% (0.5229 => 0.5957, std.dev.: 0.0045) MultiSource/Applications/SPASS/SPASS: 10.05% (14.9895 => 16.4964, std.dev.: 0.0208) MultiSource/Benchmarks/MallocBench/gs/gs: 8.51% (4.1105 => 4.4601, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.25% (1.1048 => 1.2622, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.72% (7.1582 => 7.9970, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_container: 20.28% (0.6222 => 0.7484, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36200.00% (0.0001 => 0.0363, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.52% (0.2116 => 0.0645, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 15 16:09:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 15 Oct 2012 18:09:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121015230908.B46D92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4895?compare_to=4893&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4895, Order: 165975, Start Time: 2012-10-15 21:46:05, End Time: 2012-10-15 23:12:01 To: 4893, Order: 165955, Start Time: 2012-10-15 19:50:58, End Time: 2012-10-15 21:16:46 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (190 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1039 (677 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.47% (0.7147 => 0.7252, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.32% (54.9236 => 56.7497, std.dev.: 0.0589) MultiSource/Benchmarks/llubenchmark/llu: 2.57% (3.7476 => 3.8441, std.dev.: 0.0335) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.25% (2.0176 => 2.5068, std.dev.: 0.0178) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.87% (0.1410 => 0.1676, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 17.80% (0.0826 => 0.0973, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.76% (0.0653 => 0.0769, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 17.16% (0.2243 => 0.2628, std.dev.: 0.0006) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.49% (0.1072 => 0.1238, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.69% (0.1327 => 0.1522, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 14.61% (0.1013 => 0.1161, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.79% (0.0834 => 0.0949, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.66% (0.1413 => 0.1606, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 13.57% (0.7038 => 0.7993, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.10% (0.1588 => 0.1796, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.98% (3.9660 => 4.4808, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.86% (0.0964 => 0.1088, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.71% (0.2596 => 0.2926, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 12.66% (1.3693 => 1.5426, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.50% (0.2721 => 0.3061, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.49% (0.7710 => 0.8673, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/distray/distray: 12.47% (0.0818 => 0.0920, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.41% (1.4563 => 1.6370, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 12.40% (13.8202 => 15.5344, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.37% (0.6283 => 0.7060, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 12.34% (0.1062 => 0.1193, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.30% (0.6959 => 0.7815, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.25% (0.5265 => 0.5910, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.21% (0.9199 => 1.0322, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 12.16% (0.1003 => 0.1125, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.09% (1.2193 => 1.3667, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/hash2: 11.97% (0.4328 => 0.4846, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.79% (1.1364 => 1.2704, std.dev.: 0.0070) SingleSource/UnitTests/ObjC++/property-reference-object: 11.53% (0.5818 => 0.6489, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 11.50% (1.0313 => 1.1499, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.44% (0.3130 => 0.3488, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.41% (0.3899 => 0.4344, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.41% (0.1157 => 0.1289, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 11.35% (0.4062 => 0.4523, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 11.30% (0.7061 => 0.7859, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.21% (0.4791 => 0.5328, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 11.17% (1.1061 => 1.2297, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 11.05% (0.5748 => 0.6383, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.99% (0.5577 => 0.6190, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 10.90% (16.6129 => 18.4230, std.dev.: 0.0225) MultiSource/Applications/sgefa/sgefa: 10.82% (0.2995 => 0.3319, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.79% (0.1075 => 0.1191, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.77% (0.2127 => 0.2356, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/gs/gs: 10.75% (3.8646 => 4.2801, std.dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.71% (0.4379 => 0.4848, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.71% (0.2914 => 0.3226, std.dev.: 0.0017) MultiSource/Applications/minisat/minisat: 10.71% (0.6744 => 0.7466, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.67% (0.3485 => 0.3857, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 10.64% (0.1589 => 0.1758, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.56% (0.4016 => 0.4440, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.54% (0.0977 => 0.1080, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.51% (0.3246 => 0.3587, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 10.49% (2.1791 => 2.4077, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.46% (0.1865 => 0.2060, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/18-imp/imp: 10.43% (0.3220 => 0.3556, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.42% (0.1276 => 0.1409) MultiSource/Applications/viterbi/viterbi: 10.42% (0.1478 => 0.1632, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 10.39% (1.9270 => 2.1273, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.36% (0.4390 => 0.4845, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.36% (0.1014 => 0.1119, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/mst/mst: 10.35% (0.1111 => 0.1226, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.33% (0.3756 => 0.4144, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.28% (0.6576 => 0.7252, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 10.26% (0.8310 => 0.9163, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.26% (0.3489 => 0.3847, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 10.25% (0.7506 => 0.8275, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.23% (0.7460 => 0.8223, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 10.19% (0.2925 => 0.3223, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.17% (0.1986 => 0.2188, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.14% (0.8698 => 0.9580, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.13% (0.1569 => 0.1728, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.13% (0.3022 => 0.3328, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.11% (0.5637 => 0.6207, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.10% (0.1435 => 0.1580, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 10.10% (0.2781 => 0.3062, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 10.10% (3.1889 => 3.5110, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/lists: 10.05% (0.3293 => 0.3624, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.03% (0.2023 => 0.2226, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.94% (0.3580 => 0.3936, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 9.90% (0.3453 => 0.3795, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 9.77% (0.3868 => 0.4246, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.77% (7.2180 => 7.9232, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.74% (0.2966 => 0.3255, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.67% (0.2782 => 0.3051, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 9.66% (1.0594 => 1.1617, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 9.54% (0.2726 => 0.2986, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 9.47% (0.1657 => 0.1814, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.46% (1.9828 => 2.1703, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 9.40% (0.3149 => 0.3445, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.38% (4.9865 => 5.4544, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/lists1: 9.37% (0.3534 => 0.3865, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 9.33% (0.3107 => 0.3397, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 9.31% (0.2760 => 0.3017, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.27% (3.6692 => 4.0095, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.26% (0.2765 => 0.3021, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 9.24% (0.2761 => 0.3016, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 9.22% (0.2690 => 0.2938, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 9.22% (14.8535 => 16.2228, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.19% (4.3801 => 4.7827, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.19% (0.8818 => 0.9628, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 9.15% (1.2749 => 1.3916, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.15% (0.2655 => 0.2898, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.14% (4.4433 => 4.8493, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hello: 9.13% (0.2607 => 0.2845, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 9.12% (0.3192 => 0.3483, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 9.09% (0.2937 => 0.3204, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.07% (1.3245 => 1.4446, std.dev.: 0.0019) MultiSource/Benchmarks/sim/sim: 9.04% (0.3131 => 0.3414, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 9.02% (0.2628 => 0.2865, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.79% (0.3755 => 0.4085, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.75% (0.2696 => 0.2932, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 8.73% (0.2988 => 0.3249, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 8.66% (8.4961 => 9.2322, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.64% (0.6135 => 0.6665, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.61% (0.9108 => 0.9892, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.57% (0.2321 => 0.2520, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.57% (0.3511 => 0.3812, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.57% (1.5188 => 1.6490, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 8.51% (0.4113 => 0.4463, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.50% (0.1789 => 0.1941, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.49% (3.2742 => 3.5521, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.41% (0.2140 => 0.2320, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 8.34% (3.7467 => 4.0590, std.dev.: 0.0116) MultiSource/Applications/oggenc/oggenc: 8.25% (4.6629 => 5.0478, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 8.25% (0.2945 => 0.3188, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 8.16% (0.6250 => 0.6760, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.13% (1.1333 => 1.2254, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 8.12% (0.2008 => 0.2171, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.01% (0.4805 => 0.5190, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 7.89% (6.5754 => 7.0942, std.dev.: 0.0162) SingleSource/UnitTests/ObjC/parameter-passing: 7.87% (0.4003 => 0.4318, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions: 7.82% (0.3914 => 0.4220, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.77% (0.3940 => 0.4246, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.74% (2.1007 => 2.2633, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: 7.65% (0.1385 => 0.1491, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.63% (0.2504 => 0.2695, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.58% (0.3245 => 0.3491, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.47% (0.3789 => 0.4072, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.46% (0.3578 => 0.3845, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 7.32% (0.3646 => 0.3913, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/synchronized: 7.32% (0.3663 => 0.3931, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.31% (0.3623 => 0.3888, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 7.30% (0.3601 => 0.3864) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.18% (0.3650 => 0.3912, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.16% (6.2785 => 6.7278, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.89% (13.2842 => 14.1993, std.dev.: 0.0157) MultiSource/Applications/hexxagon/hexxagon: 6.83% (1.2292 => 1.3132, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.65% (0.1819 => 0.1940, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.06% (0.2243 => 0.2379, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 5.59% (16.2614 => 17.1705, std.dev.: 0.0190) MultiSource/Applications/ClamAV/clamscan: 4.63% (14.5298 => 15.2029, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/bh/bh: 3.81% (0.2859 => 0.2968, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 2.11% (33.2944 => 33.9957, std.dev.: 0.0082) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5183, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.29% (1.8175 => 2.2589, std.dev.: 0.0142) SingleSource/Benchmarks/Misc/richards_benchmark: 11.12% (1.1560 => 1.2845, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4139, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.26% (1.2998 => 1.3812, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0047, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.91% (11.2619 => 11.7024, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7748, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.46% (1.9199 => 1.9864, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.22% (10.7476 => 11.0932, std.dev.: 0.0434) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.24% (7.4271 => 7.5933, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 1.63% (1.4298 => 1.4531, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5153, std.dev.: 0.0058) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2126, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9680, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1879, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5784, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5882, std.dev.: 0.0101) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.06% (9.9194 => 10.0243, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.05% (8.8259 => 8.9183, std.dev.: 0.0141) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.03% (3.6469 => 3.6843, std.dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.59% (0.2670 => 0.1426, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.63% (0.4657 => 0.3929, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.90% (1.3813 => 1.2031, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.85% (1.3819 => 1.2043, std.dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -11.93% (0.2238 => 0.1971, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -11.22% (1.2308 => 1.0927, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.11% (20.3410 => 18.2841, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/flops-3: -6.30% (2.4152 => 2.2631, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0123) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.71% (1.3780 => 1.2993, std.dev.: 0.0057) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -5.12% (2.6470 => 2.5114, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8004, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.24% (0.9996 => 0.9572, std.dev.: 0.0146) MultiSource/Applications/siod/siod: -3.44% (3.2729 => 3.1604, std.dev.: 0.0131) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.43% (1.7688 => 1.7081, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.56% (26.5159 => 25.8381, std.dev.: 0.0224) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.44% (3.0263 => 2.9525, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: -2.38% (1.9762 => 1.9291, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.02% (0.6589 => 0.6456, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7156, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/lists: -1.66% (6.3560 => 6.2505, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/heapsort: -1.48% (3.9173 => 3.8593, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0077, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.26% (0.8342 => 0.8237, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4957, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2576, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 15 17:13:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 15 Oct 2012 19:13:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121016001314.BB4F42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4896?compare_to=4894&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4896, Order: 165985, Start Time: 2012-10-15 22:55:17, End Time: 2012-10-16 00:15:04 To: 4894, Order: 165958, Start Time: 2012-10-15 21:05:29, End Time: 2012-10-15 22:25:49 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 4 (163 on baseline) Performance Improvements: 1 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 948 (681 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.69% (2.5789 => 2.6224, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 1.39% (11.4449 => 11.6045, std.dev.: 0.0079) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.16% (1.2929 => 1.3079, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/chomp: 1.00% (1.0846 => 1.0955, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.93% (15.5628 => 15.1063, std.dev.: 0.0028) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.02% (0.5957 => 0.5956, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -0.14% (16.4964 => 16.4725, std.dev.: 0.0069) MultiSource/Benchmarks/Bullet/bullet: 0.21% (55.0692 => 55.1841, std.dev.: 0.0277) MultiSource/Benchmarks/MallocBench/gs/gs: -0.16% (4.4601 => 4.4531, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.43% (0.0464 => 0.0462, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0464 => 0.0464, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.46% (0.0433 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.46% (0.0435 => 0.0433) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.24% (0.0422 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0423 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.48% (0.0416 => 0.0414) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.24% (0.0417 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.46% (0.0433 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.46% (0.0435 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.47% (0.0428 => 0.0426) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.23% (0.0429 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.24% (0.0418 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.24% (0.0419 => 0.0418) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.70% (0.0426 => 0.0423, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.47% (0.0427 => 0.0425, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.46% (0.0437 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.33% (0.0451 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.48% (0.0413 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.24% (0.0414 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.24% (0.0425 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.23% (0.0426 => 0.0425) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.48% (0.0417 => 0.0415) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.48% (0.0418 => 0.0416, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.25% (0.0408 => 0.0407) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.49% (0.0410 => 0.0408, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.25% (0.0407 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.49% (0.0409 => 0.0407) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.23% (0.0444 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.45% (0.0446 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.49% (0.0407 => 0.0405) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.49% (0.0408 => 0.0406, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.49% (0.0408 => 0.0406, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.49% (0.0410 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.48% (0.0415 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.24% (0.0416 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.13% (1.2622 => 1.2638, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.57% (7.9970 => 7.9512, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.41% (0.7484 => 0.7453, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.28% (0.0363 => 0.0362, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.24% (0.0645 => 0.0653, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.74% (63.2438 => 55.1841, std.dev.: 0.0277) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.23% (14.1553 => 19.0000, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++-EH/spirit: 64.78% (3.4629 => 5.7062, std.dev.: 0.0026) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14233.61% (0.0720 => 10.3202, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10034800.00% (0.0001 => 10.0349, std.dev.: 0.0013) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 60.18% (0.2554 => 0.4091, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 45.71% (10.3673 => 15.1063, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/richards_benchmark: 38.16% (0.1622 => 0.2241, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 33.62% (0.1056 => 0.1411, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 19.08% (2.2022 => 2.6224, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 18.02% (0.1432 => 0.1690, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.59% (7.0540 => 8.2947, std.dev.: 0.0119) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.58% (0.1566 => 0.1810, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 14.72% (0.3282 => 0.3765, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.26% (1.7609 => 2.0120, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.09% (0.0871 => 0.0985, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 12.88% (0.1584 => 0.1788, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/power/power: 12.36% (0.1440 => 0.1618, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.23% (0.3473 => 0.3863, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 11.20% (10.4361 => 11.6045, std.dev.: 0.0079) SingleSource/UnitTests/ObjC/parameter-passing: 11.15% (0.3927 => 0.4365, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.15% (0.3543 => 0.3938, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.12% (0.3516 => 0.3907, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.09% (0.3561 => 0.3956, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.09% (0.3543 => 0.3936, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.04% (0.3497 => 0.3883, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 11.00% (0.7115 => 0.7898, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 11.00% (0.3828 => 0.4249, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.95% (0.1625 => 0.1803, std.dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: 10.91% (0.7433 => 0.8244, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.88% (0.3694 => 0.4096, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.86% (0.3886 => 0.4308, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.67% (0.1143 => 0.1265, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.66% (0.4879 => 0.5399, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.64% (0.1438 => 0.1591, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.58% (0.3177 => 0.3513, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.56% (0.2700 => 0.2985, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.50% (0.6675 => 0.7376, std.dev.: 0.0142) MultiSource/Benchmarks/Olden/tsp/tsp: 10.30% (0.1175 => 0.1296, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 10.29% (9.4845 => 10.4608, std.dev.: 0.0079) SingleSource/Benchmarks/McGill/chomp: 10.15% (0.1655 => 0.1823, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 10.01% (5.7591 => 6.3353, std.dev.: 0.0101) MultiSource/Applications/d/make_dparser: 9.87% (3.3354 => 3.6645, std.dev.: 0.0080) MultiSource/Benchmarks/McCat/18-imp/imp: 9.85% (0.3423 => 0.3760, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.76% (0.5105 => 0.5603, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.75% (1.5415 => 1.6918, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 9.68% (0.1695 => 0.1859, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.60% (0.4615 => 0.5058, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.55% (0.1236 => 0.1354, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 9.46% (0.3109 => 0.3403, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.35% (4.2646 => 4.6635, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 9.30% (0.1151 => 0.1258, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.28% (0.5860 => 0.6404, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 9.22% (3.8723 => 4.2294, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.20% (1.3050 => 1.4251, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.18% (0.1940 => 0.2118, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.15% (0.8067 => 0.8805, std.dev.: 0.0095) MultiSource/Applications/Burg/burg: 9.10% (1.1642 => 1.2702, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.07% (0.1510 => 0.1647, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.07% (0.5569 => 0.6074, std.dev.: 0.0027) MultiSource/Applications/viterbi/viterbi: 9.00% (0.1555 => 0.1695, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.98% (0.2271 => 0.2475, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.98% (5.0018 => 5.4508, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/bigfib: 8.97% (0.6456 => 0.7035, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.96% (4.9449 => 5.3879, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.92% (0.3307 => 0.3602, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.91% (0.8172 => 0.8900, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/mst/mst: 8.86% (0.1163 => 0.1266, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.80% (8.1363 => 8.8520, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.78% (0.2107 => 0.2292, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.72% (0.3121 => 0.3393, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.70% (0.2758 => 0.2998, std.dev.: 0.0030) MultiSource/Applications/spiff/spiff: 8.68% (0.7835 => 0.8515, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.67% (0.5020 => 0.5455, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.64% (0.9765 => 1.0609, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.62% (0.2065 => 0.2243, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.62% (7.9617 => 8.6479, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 8.56% (0.3387 => 0.3677, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 8.54% (1.0722 => 1.1638, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 8.51% (2.0273 => 2.1998, std.dev.: 0.0129) MultiSource/Benchmarks/McCat/09-vor/vor: 8.49% (0.3180 => 0.3450, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.45% (0.1337 => 0.1450, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.44% (1.5859 => 1.7198, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 8.42% (1.5603 => 1.6917, std.dev.: 0.0032) MultiSource/Applications/siod/siod: 8.32% (2.2969 => 2.4881, std.dev.: 0.0129) SingleSource/UnitTests/ObjC++/property-reference-object: 8.08% (0.6030 => 0.6517, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.02% (0.5925 => 0.6400, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.99% (0.3441 => 0.3716, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.87% (1.1861 => 1.2794, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.85% (0.4103 => 0.4425, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.71% (2.2024 => 2.3722, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.61% (0.3865 => 0.4159, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.49% (0.2603 => 0.2798, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.43% (0.1695 => 0.1821, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 7.42% (21.9371 => 23.5651, std.dev.: 0.0198) SingleSource/UnitTests/ObjC++/property-reference: 7.41% (0.7326 => 0.7869, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.40% (0.4636 => 0.4979, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.38% (0.4203 => 0.4513, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.34% (0.4289 => 0.4604, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.27% (0.6450 => 0.6919, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 7.14% (0.8921 => 0.9558, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: 7.10% (0.3422 => 0.3665, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.09% (0.4299 => 0.4604, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 6.99% (0.4620 => 0.4943, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 6.89% (0.4048 => 0.4327, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.85% (0.3650 => 0.3900, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.69% (0.3826 => 0.4082, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.69% (0.5981 => 0.6381, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.66% (1.4186 => 1.5131, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sieve: 6.63% (0.3603 => 0.3842, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 6.49% (0.3684 => 0.3923, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.44% (0.3136 => 0.3338, std.dev.: 0.0073) MultiSource/Benchmarks/nbench/nbench: 6.39% (1.1840 => 1.2597, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.23% (0.2891 => 0.3071, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.20% (0.3162 => 0.3358, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 6.16% (0.2905 => 0.3084, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.13% (0.2266 => 0.2405, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.04% (2.0665 => 2.1913, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.97% (0.1892 => 0.2005, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 5.93% (0.2831 => 0.2999, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.92% (0.2871 => 0.3041, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary: 5.82% (0.3232 => 0.3420, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.78% (0.3098 => 0.3277, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.77% (0.1906 => 0.2016, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.76% (0.3283 => 0.3472, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.73% (0.2756 => 0.2914, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.72% (0.2725 => 0.2881, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.63% (0.8101 => 0.8557, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.57% (0.2872 => 0.3032, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.54% (0.3052 => 0.3221, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.51% (0.4064 => 0.4288, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.49% (0.2877 => 0.3035, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: 5.47% (0.2049 => 0.2161, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.42% (0.2802 => 0.2954, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.34% (0.2714 => 0.2859, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.33% (0.2793 => 0.2942, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 5.27% (0.3379 => 0.3557, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 4.86% (17.1811 => 18.0166, std.dev.: 0.0234) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.84% (0.3427 => 0.3593, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.80% (14.3668 => 15.0571, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: 4.52% (1.2842 => 1.3422, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.44% (0.2430 => 0.2538, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.40% (3.8922 => 4.0634, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/objinst: 4.15% (0.3131 => 0.3261, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.67% (1.1194 => 1.1605, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.54% (0.3817 => 0.3952, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 3.36% (0.3092 => 0.3196, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8953, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.92% (1.1396 => 1.2527, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4500, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (3.1578 => 3.3678, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.63% (3.6395 => 3.7717, std.dev.: 0.0045) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.68% (4.2280 => 4.3414, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7655, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.70% (0.8275 => 0.8416, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.48% (0.9540 => 0.9681, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.35% (11.6436 => 11.8013, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.11% (2.6546 => 2.6840, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.03% (6.5088 => 6.5759, std.dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.03% (6.6874 => 0.1315, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -80.06% (0.8651 => 0.1725, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.73% (5.2763 => 3.2858, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.86% (5.3855 => 3.7238, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.50% (5.3526 => 3.7203, std.dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -14.69% (54.1659 => 46.2090, std.dev.: 0.0489) MultiSource/Applications/ClamAV/clamscan: -12.18% (22.1758 => 19.4755, std.dev.: 0.0166) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -9.89% (2.9384 => 2.6478, std.dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.49% (1.1492 => 0.7643, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -16.01% (1.6925 => 1.4215, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.83% (0.0998 => 0.0860, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.46% (1.2373 => 1.0955, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -10.21% (1.5373 => 1.3803, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -9.95% (0.2161 => 0.1946, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.40% (19.9488 => 18.2731, std.dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.79% (1.8329 => 1.7085, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.64% (1.9577 => 1.8473, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.36% (1.6805 => 1.5905, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.84% (1.5835 => 1.5069, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.21% (0.9957 => 0.9538, std.dev.: 0.0074) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1624, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4977, std.dev.: 0.0052) MultiSource/Applications/hexxagon/hexxagon: -2.99% (12.4730 => 12.1001, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.96% (8.6802 => 8.5098, std.dev.: 0.0078) SingleSource/Regression/C/uint64_to_float: -1.90% (0.5413 => 0.5310, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -1.83% (10.2830 => 10.0948, std.dev.: 0.0052) MultiSource/Applications/sqlite3/sqlite3: -1.77% (4.6441 => 4.5620, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6834, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.56% (8.1563 => 8.0293, std.dev.: 0.0053) SingleSource/UnitTests/Vector/multiplies: -1.54% (2.5528 => 2.5134, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4226, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/lists: -1.12% (6.2999 => 6.2296, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.90% (0.5229 => 0.5956, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 9.89% (14.9895 => 16.4725, std.dev.: 0.0069) MultiSource/Benchmarks/MallocBench/gs/gs: 8.33% (4.1105 => 4.4531, std.dev.: 0.0145) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.39% (1.1048 => 1.2638, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.08% (7.1582 => 7.9512, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.78% (0.6222 => 0.7453, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36100.00% (0.0001 => 0.0362, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.14% (0.2116 => 0.0653, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 4.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 15 18:05:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 15 Oct 2012 20:05:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121016010519.E81792A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4897?compare_to=4895&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4897, Order: 165997, Start Time: 2012-10-15 23:41:28, End Time: 2012-10-16 01:07:18 To: 4895, Order: 165975, Start Time: 2012-10-15 21:46:05, End Time: 2012-10-15 23:12:01 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (187 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1041 (679 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.64% (78.2826 => 81.1356, std.dev.: 0.3492) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.50% (2.0176 => 2.4917, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.37% (0.1410 => 0.1669, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.15% (0.0653 => 0.0765, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 17.07% (0.0826 => 0.0967, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 16.99% (0.2243 => 0.2624, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.85% (0.1327 => 0.1524, std.dev.: 0.0006) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.55% (0.1072 => 0.1228) MultiSource/Benchmarks/Olden/tsp/tsp: 14.31% (0.1013 => 0.1158, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.79% (0.0834 => 0.0949) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.77% (0.0770 => 0.0876, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 13.24% (0.7038 => 0.7970, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.16% (0.1413 => 0.1599, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.97% (0.0964 => 0.1089, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 12.73% (1.3693 => 1.5436, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.69% (3.9660 => 4.4693, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.53% (0.1588 => 0.1787, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.42% (0.2721 => 0.3059, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.31% (0.6959 => 0.7816, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.29% (0.2596 => 0.2915, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 12.27% (13.8202 => 15.5159, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/hash2: 12.27% (0.4328 => 0.4859, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.19% (0.5265 => 0.5907, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.18% (0.6283 => 0.7048, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.05% (0.3899 => 0.4369, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.01% (1.4563 => 1.6312, std.dev.: 0.0038) MultiSource/Applications/aha/aha: 11.86% (0.1062 => 0.1188, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: 11.86% (0.1003 => 0.1122, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.80% (0.7710 => 0.8620, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.75% (0.9199 => 1.0280, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.66% (1.2193 => 1.3615, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 11.57% (0.4062 => 0.4532, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.50% (0.1157 => 0.1290, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.47% (1.1364 => 1.2668, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.47% (0.3130 => 0.3489, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 11.32% (1.0313 => 1.1480, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 11.17% (1.1061 => 1.2296, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 11.10% (0.7061 => 0.7845, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference-object: 11.09% (0.5818 => 0.6463, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.98% (0.4791 => 0.5317, std.dev.: 0.0042) MultiSource/Applications/kimwitu++/kc: 10.87% (16.6129 => 18.4188, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.83% (0.5577 => 0.6181) SingleSource/UnitTests/ObjC++/Hello: 10.82% (0.5748 => 0.6370, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.81% (0.2914 => 0.3229, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.75% (0.3580 => 0.3965, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.70% (0.3485 => 0.3858, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 10.65% (0.6744 => 0.7462, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.58% (0.4016 => 0.4441, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.54% (0.3756 => 0.4152, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.51% (0.1075 => 0.1188, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.46% (0.4379 => 0.4837, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 10.43% (3.8646 => 4.2678, std.dev.: 0.0118) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.43% (0.4390 => 0.4848, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.40% (0.3489 => 0.3852, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 10.36% (2.1791 => 2.4049, std.dev.: 0.0071) SingleSource/Regression/C++/ofstream_ctor: 10.36% (0.2781 => 0.3069, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.29% (0.3022 => 0.3333, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 10.28% (0.3220 => 0.3551, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.27% (0.8698 => 0.9591, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/lists: 10.23% (0.3293 => 0.3630, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 10.22% (0.2995 => 0.3301, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 10.17% (0.1111 => 0.1224, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 10.17% (0.7506 => 0.8269, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 10.15% (1.9270 => 2.1226, std.dev.: 0.0117) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.15% (0.7460 => 0.8217, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.14% (0.3246 => 0.3575, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.13% (0.1865 => 0.2054, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 10.13% (0.1589 => 0.1750, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 10.08% (0.1478 => 0.1627, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 10.06% (3.1889 => 3.5097, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.03% (0.1276 => 0.1404, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.01% (0.1569 => 0.1726, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.99% (0.2782 => 0.3060, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 9.99% (0.3453 => 0.3798, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.96% (0.1014 => 0.1115, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.95% (0.2966 => 0.3261, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.92% (0.2127 => 0.2338, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 9.91% (0.2925 => 0.3215, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 9.90% (0.3868 => 0.4251, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.87% (0.1986 => 0.2182, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/strcat: 9.83% (0.2726 => 0.2994, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.83% (0.1435 => 0.1576, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.82% (0.6576 => 0.7222, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/football/football: 9.78% (0.8310 => 0.9123, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.76% (0.5637 => 0.6187, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.74% (1.9828 => 2.1759, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 9.68% (0.3534 => 0.3876, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 9.62% (0.3149 => 0.3452, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.60% (0.2655 => 0.2910, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 9.60% (0.2760 => 0.3025, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.59% (0.2023 => 0.2217, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.57% (7.2180 => 7.9091, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.56% (4.9865 => 5.4632, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary: 9.53% (0.3107 => 0.3403, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 9.51% (0.2607 => 0.2855, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 9.49% (0.2761 => 0.3023, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 9.48% (0.2690 => 0.2945, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.37% (0.2765 => 0.3024, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/wc: 9.36% (0.2937 => 0.3212, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 9.32% (0.2628 => 0.2873, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 9.23% (0.1657 => 0.1810, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 9.23% (1.0594 => 1.1572, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary2: 9.21% (0.3192 => 0.3486, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.07% (1.3245 => 1.4446, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/matrix: 9.04% (0.2988 => 0.3258, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.03% (0.3755 => 0.4094, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.98% (3.6692 => 3.9986, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.94% (0.2696 => 0.2937, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 8.91% (0.3131 => 0.3410, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.90% (4.3801 => 4.7701, std.dev.: 0.0027) MultiSource/Applications/SIBsim4/SIBsim4: 8.88% (1.2749 => 1.3881, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.86% (0.3511 => 0.3822, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.85% (4.4433 => 4.8367, std.dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: 8.85% (14.8535 => 16.1684, std.dev.: 0.0168) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.47% (0.8818 => 0.9565, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 8.44% (8.4961 => 9.2132, std.dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.41% (1.5188 => 1.6466, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 8.39% (0.2945 => 0.3192, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.36% (0.2321 => 0.2515, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.32% (0.2140 => 0.2318, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.30% (0.6135 => 0.6644, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 8.16% (0.6250 => 0.6760, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 8.09% (4.6629 => 5.0403, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.02% (1.1333 => 1.2242, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.96% (0.9108 => 0.9833, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 7.94% (3.7467 => 4.0441, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.93% (0.4805 => 0.5186, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.85% (3.2742 => 3.5313, std.dev.: 0.0191) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.83% (0.1789 => 0.1929, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 7.71% (0.4113 => 0.4430, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 7.68% (6.5754 => 7.0803, std.dev.: 0.0177) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.67% (0.3245 => 0.3494, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.62% (2.1007 => 2.2608, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.55% (0.2504 => 0.2693, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 7.47% (0.2008 => 0.2158, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 7.44% (0.1385 => 0.1488, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.22% (0.4003 => 0.4292, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.01% (6.2785 => 6.7185, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions: 7.00% (0.3914 => 0.4188, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 6.98% (1.2292 => 1.3150, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/property: 6.98% (0.3940 => 0.4215, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.92% (13.2842 => 14.2035, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/for-in: 6.91% (0.3789 => 0.4051, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 6.79% (0.3578 => 0.3821, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.66% (0.3663 => 0.3907, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.61% (0.3646 => 0.3887, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.58% (0.3601 => 0.3838, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.47% (0.3650 => 0.3886, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.46% (0.3623 => 0.3857, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.43% (0.1819 => 0.1936, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 5.50% (16.2614 => 17.1559, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.39% (0.2243 => 0.2364, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 4.44% (14.5298 => 15.1751, std.dev.: 0.0113) MultiSource/Benchmarks/Bullet/bullet: 2.24% (33.2944 => 34.0418, std.dev.: 0.0174) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.38% (5.7573 => 7.5065, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.09% (1.0895 => 1.3629, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: 24.08% (1.8175 => 2.2552, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/richards_benchmark: 10.98% (1.1560 => 1.2829, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 9.02% (0.8273 => 0.9019, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.56% (3.1736 => 3.4136, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.32% (1.2998 => 1.3820, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.67% (1.9144 => 2.0038, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.91% (11.2619 => 11.7025, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (1.7081 => 1.7749, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.36% (1.9199 => 1.9844, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 3.25% (10.7476 => 11.0965, std.dev.: 0.0584) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.18% (7.4271 => 7.5888, std.dev.: 0.0030) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4535, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5143, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9692, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1883, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.18% (8.8259 => 8.9303, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.15% (5.5130 => 5.5762, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.06% (9.9194 => 10.0245, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 1.01% (12.4560 => 12.5822, std.dev.: 0.0089) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.74% (0.2670 => 0.1422) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.21% (0.4657 => 0.3902, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.20% (1.3813 => 1.1989, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.13% (1.3819 => 1.2005, std.dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.64% (0.0997 => 0.0861) MultiSource/Benchmarks/FreeBench/mason/mason: -12.11% (0.2238 => 0.1967, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.81% (1.2308 => 1.0854, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.31% (20.3410 => 18.2438, std.dev.: 0.0262) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8099, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.39% (1.3780 => 1.3037, std.dev.: 0.0078) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.05% (2.6470 => 2.5132, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.66% (0.9996 => 0.9530, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0010) MultiSource/Applications/siod/siod: -3.55% (3.2729 => 3.1568, std.dev.: 0.0112) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.39% (1.7688 => 1.7088, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.18% (0.4867 => 0.4712, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -2.60% (26.5159 => 25.8276, std.dev.: 0.0324) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783) SingleSource/Regression/C/uint64_to_float: -2.53% (0.5449 => 0.5311, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: -2.44% (3.0263 => 2.9526, std.dev.: 0.0015) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -2.35% (1.9762 => 1.9298, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.85% (6.3560 => 6.2384, std.dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.84% (0.6589 => 0.6468, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7147, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.59% (0.6615 => 0.6510, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0069, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.23% (0.8342 => 0.8239, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4946, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.13% (3.9173 => 3.8732, std.dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2577, std.dev.: 0.0010) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 32.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 15 19:03:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 15 Oct 2012 21:03:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121016020323.CD2D62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4897?compare_to=4896&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4897, Order: 165999, Start Time: 2012-10-16 00:44:26, End Time: 2012-10-16 02:04:15 To: 4896, Order: 165985, Start Time: 2012-10-15 22:55:17, End Time: 2012-10-16 00:15:04 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 3 (158 on baseline) Performance Improvements: 3 (45 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 947 (684 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.00% (15.1063 => 15.4080, std.dev.: 0.0096) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.14% (54.8090 => 56.5322, std.dev.: 0.0728) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.17% (78.5527 => 80.2562, std.dev.: 0.2436) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.53% (2.6224 => 2.5823, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.47% (2.0120 => 1.9824, std.dev.: 0.0093) MultiSource/Applications/JM/ldecod/ldecod: -1.04% (11.6045 => 11.4836, std.dev.: 0.0071) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.22% (0.5956 => 0.5943, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -0.58% (16.4725 => 16.3770, std.dev.: 0.0143) MultiSource/Benchmarks/Bullet/bullet: -1.28% (55.1841 => 54.4765, std.dev.: 0.0199) MultiSource/Benchmarks/MallocBench/gs/gs: -0.39% (4.4531 => 4.4356, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0462 => 0.0462, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0464 => 0.0464, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0431 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0433 => 0.0433, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0421 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.24% (0.0423 => 0.0422, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0414 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.24% (0.0416 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0431 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0433 => 0.0433, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0426 => 0.0426, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.23% (0.0428 => 0.0427, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.24% (0.0417 => 0.0418) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0418 => 0.0418, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0423 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.24% (0.0425 => 0.0424, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.23% (0.0435 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0436 => 0.0436, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0411 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0413 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.24% (0.0424 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.24% (0.0425 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0415 => 0.0415, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0416 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0407 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0408 => 0.0408, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0406 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.25% (0.0407 => 0.0406, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.23% (0.0443 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.23% (0.0444 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.25% (0.0405 => 0.0404) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0406 => 0.0406, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0406 => 0.0406, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.25% (0.0408 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0413 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0415 => 0.0415, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.47% (1.2638 => 1.2579, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.36% (7.9512 => 7.9227, std.dev.: 0.0145) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.20% (0.7453 => 0.7438, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -1.66% (0.0362 => 0.0356, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.23% (0.0653 => 0.0645, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -13.86% (63.2438 => 54.4765, std.dev.: 0.0199) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 33.69% (14.1553 => 18.9237, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.75% (3.4629 => 5.6705, std.dev.: 0.0034) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14241.67% (0.0720 => 10.3260, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10035600.00% (0.0001 => 10.0357, std.dev.: 0.0008) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 59.48% (0.2554 => 0.4073, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 48.62% (10.3673 => 15.4080, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/richards_benchmark: 36.00% (0.1622 => 0.2206, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 32.95% (0.1056 => 0.1404, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.26% (2.2022 => 2.5823, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.19% (7.0540 => 8.2665, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/flops: 16.48% (0.1432 => 0.1668, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.88% (0.1566 => 0.1799, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.74% (0.0871 => 0.0982, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.58% (1.7609 => 1.9824, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/oourafft: 12.55% (0.3282 => 0.3694, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.74% (0.1584 => 0.1770, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 11.60% (0.1440 => 0.1607, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 10.57% (0.7115 => 0.7867, std.dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: 10.48% (0.7433 => 0.8212, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.23% (0.6675 => 0.7358, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 10.04% (10.4361 => 11.4836, std.dev.: 0.0071) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.97% (0.1143 => 0.1257, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 9.87% (0.1175 => 0.1291, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.85% (0.1625 => 0.1785, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.82% (0.3543 => 0.3891, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/trivial-interface: 9.79% (0.3473 => 0.3813, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.78% (0.2700 => 0.2964, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/parameter-passing: 9.73% (0.3927 => 0.4309, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 9.64% (0.3497 => 0.3834, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 9.63% (0.3561 => 0.3904, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.63% (0.3177 => 0.3483, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 9.62% (0.3543 => 0.3884, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 9.61% (9.4845 => 10.3956, std.dev.: 0.0048) SingleSource/Benchmarks/McGill/chomp: 9.55% (0.1655 => 0.1813, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.53% (0.3516 => 0.3851, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 9.51% (3.3354 => 3.6526, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions: 9.48% (0.3828 => 0.4191, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 9.45% (0.3694 => 0.4043, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: 9.44% (0.3423 => 0.3746, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.42% (0.3886 => 0.4252, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 9.39% (5.7591 => 6.3001, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/em3d/em3d: 9.38% (0.1695 => 0.1854, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.37% (1.5415 => 1.6859, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.32% (0.1438 => 0.1572, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.28% (0.4879 => 0.5332, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.27% (0.4615 => 0.5043, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.25% (0.5105 => 0.5577, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 9.23% (0.3109 => 0.3396, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 9.04% (0.1151 => 0.1255, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.99% (0.5860 => 0.6387, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.98% (0.1236 => 0.1347, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.94% (0.1510 => 0.1645, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.93% (1.3050 => 1.4216, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.93% (4.2646 => 4.6454, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.93% (0.8067 => 0.8787, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.85% (0.5569 => 0.6062, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.81% (0.2271 => 0.2471, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 8.79% (1.1642 => 1.2665, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 8.76% (3.8723 => 4.2116, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.68% (0.3307 => 0.3594, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.56% (0.1940 => 0.2106, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 8.53% (0.6456 => 0.7007, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.53% (0.1337 => 0.1451, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.52% (0.8172 => 0.8868, std.dev.: 0.0021) MultiSource/Applications/viterbi/viterbi: 8.49% (0.1555 => 0.1687, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.41% (0.2758 => 0.2990, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.41% (0.5020 => 0.5442, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.40% (0.2107 => 0.2284, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.38% (0.9765 => 1.0583, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.37% (5.0018 => 5.4205, std.dev.: 0.0094) MultiSource/Benchmarks/sim/sim: 8.36% (0.3387 => 0.3670, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.35% (4.9449 => 5.3577, std.dev.: 0.0050) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.33% (0.3121 => 0.3381, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.30% (8.1363 => 8.8114, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.25% (1.5859 => 1.7168, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 8.20% (1.0722 => 1.1601, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 8.19% (0.7835 => 0.8477, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.18% (0.2065 => 0.2234, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 8.07% (2.0273 => 2.1909, std.dev.: 0.0103) MultiSource/Applications/hbd/hbd: 8.06% (1.5603 => 1.6860, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 7.88% (2.2969 => 2.4780, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.64% (0.3441 => 0.3704, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 7.64% (0.3180 => 0.3423, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.61% (0.4636 => 0.4989, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.57% (7.9617 => 8.5642, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.43% (0.3865 => 0.4152, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.39% (0.4289 => 0.4606, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.39% (2.2024 => 2.3651, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.38% (0.4203 => 0.4513, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.35% (1.1861 => 1.2733, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.34% (0.4103 => 0.4404, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: 7.11% (0.6030 => 0.6459, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.07% (0.2603 => 0.2787, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/lists: 7.04% (0.3422 => 0.3663, std.dev.: 0.0061) MultiSource/Applications/JM/lencod/lencod: 7.00% (21.9371 => 23.4726, std.dev.: 0.0265) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.96% (0.1695 => 0.1813, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.95% (0.5925 => 0.6337, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.93% (0.6450 => 0.6897, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 6.88% (0.3603 => 0.3851, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.88% (0.4620 => 0.4938, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 6.84% (0.8921 => 0.9531, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 6.82% (0.4048 => 0.4324, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.80% (0.3826 => 0.4086, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.77% (0.3650 => 0.3897, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 6.63% (0.4299 => 0.4584, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.57% (0.5981 => 0.6374, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 6.43% (0.7326 => 0.7797, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.33% (0.2891 => 0.3074, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.32% (0.3684 => 0.3917, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.22% (0.3136 => 0.3331, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.18% (1.4186 => 1.5063, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 6.16% (0.2905 => 0.3084, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.07% (0.3162 => 0.3354, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.05% (2.0665 => 2.1915, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.03% (0.1892 => 0.2006, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 6.00% (0.2831 => 0.3001, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 5.97% (1.1840 => 1.2547, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary: 5.85% (0.3232 => 0.3421, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 5.84% (0.2877 => 0.3045, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 5.78% (0.2871 => 0.3037, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 5.78% (0.3098 => 0.3277, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.70% (0.3283 => 0.3470, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.64% (0.2714 => 0.2867, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.62% (0.2756 => 0.2911, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.61% (0.1906 => 0.2013, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.57% (0.2872 => 0.3032, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.54% (0.3052 => 0.3221, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.50% (0.2725 => 0.2875, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.41% (0.8101 => 0.8539, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary2: 5.39% (0.3379 => 0.3561, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.37% (0.2793 => 0.2943, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.32% (0.2802 => 0.2951, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.30% (0.2266 => 0.2386, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.29% (0.4064 => 0.4279, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: 4.57% (17.1811 => 17.9660, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.55% (14.3668 => 15.0204, std.dev.: 0.0184) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.46% (0.3427 => 0.3580, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.32% (1.2842 => 1.3397, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.24% (0.2430 => 0.2533, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.18% (0.3131 => 0.3262, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.86% (3.8922 => 4.0426, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.96% (1.1194 => 1.1525, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9648, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.91% (1.1396 => 1.2525, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4498, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (3.1578 => 3.3677, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.49% (3.6395 => 3.7665, std.dev.: 0.0042) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.79% (4.2280 => 4.3459, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.34% (1.7254 => 1.7658, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.72% (0.8275 => 0.8417, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.35% (11.6436 => 11.8010, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.12% (2.6546 => 2.6843, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.05% (6.6874 => 0.1301, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.20% (0.8651 => 0.1713, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.19% (5.2763 => 3.2615, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.42% (5.3855 => 3.6934, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.06% (5.3526 => 3.6900, std.dev.: 0.0059) SingleSource/UnitTests/Vector/constpool: -14.72% (54.1659 => 46.1933, std.dev.: 0.0171) MultiSource/Applications/ClamAV/clamscan: -12.40% (22.1758 => 19.4267, std.dev.: 0.0349) MultiSource/Benchmarks/FreeBench/mason/mason: -12.33% (0.0811 => 0.0711, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.50% (2.9384 => 2.6300, std.dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7645, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4245, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.33% (0.0998 => 0.0855, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -11.69% (1.2373 => 1.0926, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: -10.21% (1.5373 => 1.3804, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -10.04% (0.2161 => 0.1944, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.35% (19.9488 => 18.2835, std.dev.: 0.1038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.68% (1.8329 => 1.7104, std.dev.: 0.0140) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8479, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.32% (1.6805 => 1.5911, std.dev.: 0.0040) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7963, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.79% (1.5660 => 1.4910, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-5: -4.79% (1.5835 => 1.5077, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.70% (0.9957 => 0.9589, std.dev.: 0.0013) MultiSource/Applications/siod/siod: -3.68% (3.2827 => 3.1618, std.dev.: 0.0084) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5030, std.dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: -3.02% (12.4730 => 12.0963, std.dev.: 0.0023) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: -1.88% (0.5413 => 0.5311, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.87% (8.6802 => 8.5178, std.dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.81% (8.1563 => 8.0088, std.dev.: 0.0191) MultiSource/Applications/sqlite3/sqlite3: -1.77% (4.6441 => 4.5619, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -1.75% (10.2830 => 10.1027, std.dev.: 0.0129) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6807, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.56% (2.5528 => 2.5129, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4197, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8582, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0554 => 1.0446, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2358, std.dev.: 0.0081) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.65% (0.5229 => 0.5943, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 9.26% (14.9895 => 16.3770, std.dev.: 0.0143) MultiSource/Benchmarks/MallocBench/gs/gs: 7.91% (4.1105 => 4.4356, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.86% (1.1048 => 1.2579, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.68% (7.1582 => 7.9227, std.dev.: 0.0145) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.54% (0.6222 => 0.7438, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35500.00% (0.0001 => 0.0356, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.52% (0.2116 => 0.0645, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 36.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 15 20:02:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 15 Oct 2012 22:02:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121016030240.34CA52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4897?compare_to=4895&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4897, Order: 166002, Start Time: 2012-10-16 01:37:39, End Time: 2012-10-16 03:03:26 To: 4895, Order: 165975, Start Time: 2012-10-15 21:46:05, End Time: 2012-10-15 23:12:01 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (188 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1041 (677 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.77% (78.2826 => 80.4510, std.dev.: 0.4303) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.88% (2.0176 => 2.4994, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.44% (0.1410 => 0.1670, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 17.31% (0.0826 => 0.0969, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 17.08% (0.2243 => 0.2626, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.00% (0.0653 => 0.0764) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.55% (0.1072 => 0.1228, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 14.41% (0.1013 => 0.1159, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.64% (0.0770 => 0.0875, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.55% (0.0834 => 0.0947, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.41% (0.1327 => 0.1505, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.38% (0.1413 => 0.1602, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 13.16% (0.7038 => 0.7964, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.76% (0.0964 => 0.1087, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.74% (3.9660 => 4.4712, std.dev.: 0.0031) MultiSource/Applications/hbd/hbd: 12.73% (1.3693 => 1.5436, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.67% (0.2596 => 0.2925, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.46% (0.2721 => 0.3060, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.42% (0.6959 => 0.7823, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.41% (0.1588 => 0.1785, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.39% (0.7710 => 0.8665, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.38% (0.5265 => 0.5917, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash2: 12.29% (0.4328 => 0.4860, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 12.26% (13.8202 => 15.5139, std.dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.24% (0.6283 => 0.7052, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.23% (1.4563 => 1.6344, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/power/power: 11.86% (0.1003 => 0.1122, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.86% (0.9199 => 1.0290, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.75% (1.2193 => 1.3626, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 11.72% (0.4062 => 0.4538, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 11.68% (0.1062 => 0.1186, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 11.65% (0.5818 => 0.6496, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 11.51% (0.7061 => 0.7874, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.50% (0.1157 => 0.1290) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.39% (1.1364 => 1.2658, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.35% (0.4791 => 0.5335, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.31% (0.3899 => 0.4340, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 11.27% (1.0313 => 1.1475, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 11.13% (0.5748 => 0.6388, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 10.99% (1.1061 => 1.2277, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.99% (0.3022 => 0.3354, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.96% (0.3485 => 0.3867, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.93% (0.3130 => 0.3472, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.85% (0.5577 => 0.6182, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.83% (0.1986 => 0.2201, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.79% (0.1075 => 0.1191, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 10.71% (0.6744 => 0.7466, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.68% (0.4016 => 0.4445, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.60% (0.3756 => 0.4154, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 10.57% (0.2781 => 0.3075, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 10.57% (16.6129 => 18.3685, std.dev.: 0.0155) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.54% (0.0977 => 0.1080, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.46% (0.4390 => 0.4849, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.41% (0.4379 => 0.4835, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 10.38% (3.8646 => 4.2659, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/lists: 10.36% (0.3293 => 0.3634, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.35% (0.8698 => 0.9598, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.33% (0.1569 => 0.1731, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.32% (0.3489 => 0.3849, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 10.31% (2.1791 => 2.4038, std.dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.30% (0.2914 => 0.3214, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 10.28% (0.3220 => 0.3551, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 10.26% (0.1111 => 0.1225, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.25% (0.2127 => 0.2345, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.23% (0.3246 => 0.3578, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 10.22% (0.2995 => 0.3301, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.19% (0.1276 => 0.1406, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.14% (0.3580 => 0.3943, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 10.11% (0.3868 => 0.4259, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.10% (0.2782 => 0.3063, std.dev.: 0.0081) MultiSource/Applications/viterbi/viterbi: 10.08% (0.1478 => 0.1627, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 10.07% (3.1889 => 3.5100, std.dev.: 0.0107) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.06% (0.1014 => 0.1116, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.03% (0.7460 => 0.8208, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.03% (0.1865 => 0.2052, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 10.02% (0.3453 => 0.3799, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 10.01% (1.9270 => 2.1199, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/chomp: 10.01% (0.1589 => 0.1748, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.97% (0.5637 => 0.6199, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 9.95% (0.2925 => 0.3216, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.91% (1.9828 => 2.1792, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/strcat: 9.90% (0.2726 => 0.2996, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 9.86% (0.8310 => 0.9129, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.84% (0.6576 => 0.7223, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 9.83% (0.7506 => 0.8244, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.81% (0.2966 => 0.3257, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary3: 9.78% (0.3149 => 0.3457, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 9.78% (0.2761 => 0.3031, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 9.76% (0.3534 => 0.3879, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.76% (0.2655 => 0.2914, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.69% (0.2023 => 0.2219, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 9.69% (0.3107 => 0.3408, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.68% (7.2180 => 7.9164, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/except: 9.67% (0.2760 => 0.3027, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.65% (4.9865 => 5.4675, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hello: 9.63% (0.2607 => 0.2858, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.62% (0.1435 => 0.1573, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 9.59% (0.2690 => 0.2948, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.58% (0.2765 => 0.3030, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 9.55% (0.2628 => 0.2879) MultiSource/Benchmarks/nbench/nbench: 9.47% (1.0594 => 1.1597, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wc: 9.43% (0.2937 => 0.3214, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 9.37% (0.3192 => 0.3491, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/em3d/em3d: 9.23% (0.1657 => 0.1810, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.20% (0.2696 => 0.2944, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.16% (0.3755 => 0.4099, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 9.14% (0.2988 => 0.3261, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.04% (1.3245 => 1.4443, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.00% (3.6692 => 3.9995, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: 8.97% (0.3131 => 0.3412, std.dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 8.97% (1.2749 => 1.3892, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.75% (4.3801 => 4.7632, std.dev.: 0.0118) MultiSource/Applications/JM/lencod/lencod: 8.74% (14.8535 => 16.1524, std.dev.: 0.0121) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.71% (4.4433 => 4.8301, std.dev.: 0.0112) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.70% (0.6135 => 0.6669, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 8.69% (0.2945 => 0.3201, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.63% (1.5188 => 1.6498, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.57% (0.3511 => 0.3812, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 8.52% (8.4961 => 9.2197, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.35% (0.8818 => 0.9554, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.27% (0.2321 => 0.2513, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.26% (0.4805 => 0.5202, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.22% (0.2140 => 0.2316, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 8.21% (0.6250 => 0.6763, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.05% (0.9108 => 0.9841, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 8.05% (0.4113 => 0.4444, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 7.98% (4.6629 => 5.0352, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.97% (3.2742 => 3.5353, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.94% (0.1789 => 0.1931, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.87% (1.1333 => 1.2225, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.81% (2.1007 => 2.2648, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 7.77% (3.7467 => 4.0378, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.77% (0.3245 => 0.3497, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 7.61% (6.5754 => 7.0759, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/neural/neural: 7.58% (0.1385 => 0.1490, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 7.42% (0.2008 => 0.2157, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.35% (0.2504 => 0.2688, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 7.12% (0.4003 => 0.4288, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.04% (6.2785 => 6.7205, std.dev.: 0.0073) MultiSource/Applications/hexxagon/hexxagon: 7.03% (1.2292 => 1.3156, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.97% (13.2842 => 14.2107, std.dev.: 0.0100) SingleSource/UnitTests/ObjC/exceptions: 6.92% (0.3914 => 0.4185, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.90% (0.3940 => 0.4212, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.76% (0.3789 => 0.4045, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 6.68% (0.3578 => 0.3817, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.64% (0.3646 => 0.3888, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.55% (0.3663 => 0.3903, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.50% (0.3601 => 0.3835, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.46% (0.3623 => 0.3857, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.44% (0.3650 => 0.3885, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.38% (0.1819 => 0.1935, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.57% (0.2243 => 0.2368, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 5.39% (16.2614 => 17.1380, std.dev.: 0.0147) MultiSource/Applications/ClamAV/clamscan: 4.45% (14.5298 => 15.1758, std.dev.: 0.0111) MultiSource/Benchmarks/Bullet/bullet: 1.94% (33.2944 => 33.9392, std.dev.: 0.0150) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 30.61% (5.7573 => 7.5195, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 24.37% (1.8175 => 2.2605, std.dev.: 0.0407) SingleSource/Benchmarks/Misc/richards_benchmark: 10.96% (1.1560 => 1.2827, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 8.99% (0.8273 => 0.9017, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.47% (0.1322 => 0.1434, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.61% (3.1736 => 3.4150, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.22% (1.2998 => 1.3807, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0044, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std.dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 3.92% (11.2619 => 11.7032, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 3.38% (10.7476 => 11.1109, std.dev.: 0.0500) SingleSource/Benchmarks/Misc/flops-6: 3.38% (1.9199 => 1.9847, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.20% (7.4271 => 7.5902, std.dev.: 0.0061) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4540, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0496, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5129, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1866, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.16% (5.5130 => 5.5772, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.07% (8.8259 => 8.9204, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5881, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.06% (9.9194 => 10.0243) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.78% (0.2670 => 0.1421, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.23% (0.4657 => 0.3901, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.20% (1.3819 => 1.1995, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.18% (1.3813 => 1.1993, std.dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.74% (0.0997 => 0.0860, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -12.11% (0.2238 => 0.1967, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.47% (1.2308 => 1.0896, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.03% (20.3410 => 18.3016, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.50% (1.3780 => 1.3022, std.dev.: 0.0029) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0049) SingleSource/UnitTests/Vector/multiplies: -5.17% (2.6470 => 2.5101, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.34% (0.9996 => 0.9562, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8005, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.56% (3.2729 => 3.1563, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.43% (1.7688 => 1.7082, std.dev.: 0.0055) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -2.63% (26.5159 => 25.8196, std.dev.: 0.0226) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: -2.53% (0.5449 => 0.5311, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -2.46% (3.0263 => 2.9520, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.29% (1.9762 => 1.9310, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.97% (6.3560 => 6.2309, std.dev.: 0.0088) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.94% (0.6589 => 0.6461, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7158, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0078, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.43% (3.9173 => 3.8612, std.dev.: 0.0103) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4942, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.23% (0.8342 => 0.8239, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2577, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.02% (6.6320 => 6.5641, std.dev.: 0.0094) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 52.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 15 21:58:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 15 Oct 2012 23:58:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121016045801.B9E412A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4897?compare_to=4895&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4897, Order: 166004, Start Time: 2012-10-16 03:34:58, End Time: 2012-10-16 05:00:54 To: 4895, Order: 165975, Start Time: 2012-10-15 21:46:05, End Time: 2012-10-15 23:12:01 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (189 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1040 (677 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.26% (78.2826 => 80.0495, std.dev.: 0.4007) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.30% (3.8441 => 3.7557, std.dev.: 0.0290) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.96% (2.0176 => 2.5011, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.51% (0.1410 => 0.1671, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 17.43% (0.0826 => 0.0970, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 17.34% (0.2243 => 0.2632, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.00% (0.0653 => 0.0764, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.55% (0.1072 => 0.1228, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 14.41% (0.1013 => 0.1159, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.67% (0.0834 => 0.0948) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.66% (0.1413 => 0.1606, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.64% (0.1327 => 0.1508, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.38% (0.0770 => 0.0873, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 13.26% (0.7038 => 0.7971, std.dev.: 0.0154) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.91% (3.9660 => 4.4781, std.dev.: 0.0068) MultiSource/Applications/hbd/hbd: 12.88% (1.3693 => 1.5457, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.86% (0.0964 => 0.1088, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.54% (0.6959 => 0.7832, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.53% (0.1588 => 0.1787, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.46% (0.2721 => 0.3060, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 12.36% (0.4328 => 0.4863, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 12.36% (13.8202 => 15.5281, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.32% (0.6283 => 0.7057, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.32% (1.4563 => 1.6357, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 12.31% (0.4062 => 0.4562, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.25% (0.2596 => 0.2914, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/distray/distray: 12.22% (0.0818 => 0.0918, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.14% (0.5265 => 0.5904, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.08% (0.7710 => 0.8641, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: 11.96% (0.1003 => 0.1123, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 11.91% (0.1478 => 0.1654, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.90% (0.9199 => 1.0294, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.85% (1.2193 => 1.3638, std.dev.: 0.0017) MultiSource/Applications/aha/aha: 11.77% (0.1062 => 0.1187, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.67% (0.1157 => 0.1292, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 11.64% (0.5818 => 0.6495, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.48% (1.1364 => 1.2669, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 11.41% (0.7061 => 0.7867, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.36% (0.3899 => 0.4342, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.29% (0.4791 => 0.5332, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 11.26% (1.1061 => 1.2306, std.dev.: 0.0034) MultiSource/Applications/lemon/lemon: 11.25% (1.0313 => 1.1473, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 11.19% (0.5748 => 0.6391, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.18% (0.3022 => 0.3360, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.02% (0.3130 => 0.3475, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.96% (0.3485 => 0.3867, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.94% (0.5577 => 0.6187, std.dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.92% (0.4379 => 0.4857, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.79% (0.1075 => 0.1191, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 10.77% (0.6744 => 0.7470, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.73% (0.3756 => 0.4159, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.73% (0.4390 => 0.4861, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 10.73% (16.6129 => 18.3949, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.68% (0.4016 => 0.4445, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 10.57% (0.2781 => 0.3075, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.54% (0.3246 => 0.3588, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/gs/gs: 10.53% (3.8646 => 4.2717, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists: 10.48% (0.3293 => 0.3638, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.44% (0.0977 => 0.1079, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.43% (0.8698 => 0.9605, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 10.40% (0.3220 => 0.3555, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 10.38% (0.2995 => 0.3306, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.36% (0.3580 => 0.3951, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/mst/mst: 10.35% (0.1111 => 0.1226, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.32% (0.3489 => 0.3849, std.dev.: 0.0017) MultiSource/Applications/siod/siod: 10.32% (2.1791 => 2.4039, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.30% (0.2127 => 0.2346, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.28% (0.2966 => 0.3271, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.27% (0.7460 => 0.8226, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.27% (0.1276 => 0.1407, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.26% (0.1569 => 0.1730, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.26% (0.2914 => 0.3213, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 10.25% (1.9270 => 2.1246, std.dev.: 0.0034) SingleSource/Benchmarks/McGill/chomp: 10.20% (0.1589 => 0.1751, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.16% (0.1014 => 0.1117, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.14% (0.2782 => 0.3064, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 10.13% (0.3868 => 0.4260, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.13% (0.1865 => 0.2054, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 10.11% (0.3453 => 0.3802, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 10.09% (0.2925 => 0.3220, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.02% (0.1986 => 0.2185, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 10.02% (0.7506 => 0.8258, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 10.01% (3.1889 => 3.5082, std.dev.: 0.0052) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.97% (0.1435 => 0.1578, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.96% (1.9828 => 2.1802, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/strcat: 9.94% (0.2726 => 0.2997, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 9.87% (0.8310 => 0.9130, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 9.85% (0.3534 => 0.3882, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.85% (0.5637 => 0.6192, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 9.84% (0.3149 => 0.3459, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.83% (0.2655 => 0.2916, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.82% (0.6576 => 0.7222, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.79% (4.9865 => 5.4745, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/hello: 9.78% (0.2607 => 0.2862, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 9.74% (0.2761 => 0.3030, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 9.74% (0.2937 => 0.3223, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.72% (7.2180 => 7.9198, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/except: 9.71% (0.2760 => 0.3028, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.69% (0.2023 => 0.2219, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 9.67% (0.2690 => 0.2950, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 9.66% (1.0594 => 1.1617, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 9.66% (0.3107 => 0.3407, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/fibo: 9.51% (0.2628 => 0.2878, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.46% (0.2696 => 0.2951, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.44% (0.2765 => 0.3026, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/ary2: 9.34% (0.3192 => 0.3490, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 9.23% (0.1657 => 0.1810, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.23% (0.3511 => 0.3835, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.21% (0.3755 => 0.4101, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 9.14% (0.2988 => 0.3261, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.11% (1.3245 => 1.4452, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 9.01% (0.3131 => 0.3413, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 8.95% (1.2749 => 1.3890, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.94% (3.6692 => 3.9974, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.82% (4.3801 => 4.7664, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/objinst: 8.76% (0.2945 => 0.3203, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 8.74% (14.8535 => 16.1521, std.dev.: 0.0095) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.74% (4.4433 => 4.8316, std.dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.65% (1.5188 => 1.6502, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 8.58% (8.4961 => 9.2252, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.40% (0.2321 => 0.2516, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.37% (0.8818 => 0.9556, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.36% (0.2140 => 0.2319, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.35% (0.6135 => 0.6647, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/bigfib: 8.27% (0.6250 => 0.6767, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.14% (0.9108 => 0.9849, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.11% (0.1789 => 0.1934, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.03% (1.1333 => 1.2243, std.dev.: 0.0058) MultiSource/Applications/oggenc/oggenc: 8.01% (4.6629 => 5.0362, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.99% (0.4805 => 0.5189, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/05-eks/eks: 7.95% (0.4113 => 0.4440, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.93% (3.2742 => 3.5338, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.92% (0.3245 => 0.3502) MultiSource/Applications/lua/lua: 7.86% (3.7467 => 4.0412, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.82% (2.1007 => 2.2650, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 7.58% (6.5754 => 7.0740, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/neural/neural: 7.58% (0.1385 => 0.1490, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 7.47% (0.2008 => 0.2158) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.39% (0.2504 => 0.2689, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.22% (0.4003 => 0.4292, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.07% (6.2785 => 6.7222, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/property: 7.06% (0.3940 => 0.4218, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 7.03% (1.2292 => 1.3156, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 6.92% (0.3914 => 0.4185, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.90% (13.2842 => 14.2009, std.dev.: 0.0226) SingleSource/UnitTests/ObjC/for-in: 6.78% (0.3789 => 0.4046, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 6.74% (0.3578 => 0.3819, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 6.61% (0.3646 => 0.3887, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 6.57% (0.3623 => 0.3861, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.53% (0.3601 => 0.3836, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 6.52% (0.3663 => 0.3902, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.47% (0.3650 => 0.3886, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.38% (0.1819 => 0.1935, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.48% (0.2243 => 0.2366, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 5.38% (16.2614 => 17.1363, std.dev.: 0.0193) MultiSource/Applications/ClamAV/clamscan: 4.47% (14.5298 => 15.1800, std.dev.: 0.0162) MultiSource/Benchmarks/Olden/bh/bh: 3.53% (0.2859 => 0.2960, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 2.07% (33.2944 => 33.9824, std.dev.: 0.0144) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5142, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 24.50% (1.8175 => 2.2628, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/richards_benchmark: 11.15% (1.1560 => 1.2849, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 9.02% (0.8273 => 0.9019, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4146, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.21% (1.2998 => 1.3805, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.63% (1.9144 => 2.0030, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.99% (11.2619 => 11.7112, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7748, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.47% (1.9199 => 1.9865, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.39% (10.7476 => 11.1116, std.dev.: 0.0337) SingleSource/Benchmarks/Misc/salsa20: 2.25% (7.4271 => 7.5942, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.65% (1.4298 => 1.4534, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5125, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9680, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1874, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 1.17% (5.5130 => 5.5775, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5878, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.06% (9.9194 => 10.0243, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.82% (0.2670 => 0.1420, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.21% (0.4657 => 0.3902, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.18% (1.3819 => 1.1998, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.18% (1.3813 => 1.1993, std.dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.84% (0.0997 => 0.0859, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -12.11% (0.2238 => 0.1967, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.98% (1.2308 => 1.0956, std.dev.: 0.0071) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.33% (20.3410 => 18.2399, std.dev.: 0.0324) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.70% (1.3780 => 1.2994, std.dev.: 0.0077) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5144, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8004, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.12% (0.9996 => 0.9584, std.dev.: 0.0043) MultiSource/Applications/siod/siod: -3.55% (3.2729 => 3.1568, std.dev.: 0.0226) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.51% (1.7688 => 1.7067, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0013) MultiSource/Applications/lua/lua: -2.63% (26.5159 => 25.8196, std.dev.: 0.0215) MultiSource/Applications/spiff/spiff: -2.54% (3.0263 => 2.9495, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: -2.53% (0.5449 => 0.5311, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: -2.42% (1.9762 => 1.9284, std.dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -2.02% (6.3560 => 6.2277, std.dev.: 0.0106) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.84% (0.6589 => 0.6468, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7159, std.dev.: 0.0283) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0076, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.23% (0.8342 => 0.8239, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -1.23% (3.9173 => 3.8691, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4953, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2571, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 15 22:43:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 16 Oct 2012 00:43:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121016054304.855922A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4898?compare_to=4896&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4898, Order: 166004, Start Time: 2012-10-16 04:24:50, End Time: 2012-10-16 05:44:59 To: 4896, Order: 165985, Start Time: 2012-10-15 22:55:17, End Time: 2012-10-16 00:15:04 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (159 on baseline) Performance Improvements: 2 (44 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 949 (684 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.72% (15.1063 => 15.5167, std.dev.: 0.0151) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.95% (54.8090 => 56.4279, std.dev.: 0.0953) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.40% (2.6224 => 2.5856, std.dev.: 0.0089) MultiSource/Applications/JM/ldecod/ldecod: -1.33% (11.6045 => 11.4500, std.dev.: 0.0133) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.07% (0.5956 => 0.5952, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: -0.39% (16.4725 => 16.4081, std.dev.: 0.0301) MultiSource/Benchmarks/Bullet/bullet: -0.77% (55.1841 => 54.7596, std.dev.: 0.0119) MultiSource/Benchmarks/MallocBench/gs/gs: -0.25% (4.4531 => 4.4420, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.65% (0.0462 => 0.0465, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.43% (0.0464 => 0.0466) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.70% (0.0431 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.46% (0.0433 => 0.0435, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.48% (0.0421 => 0.0423, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.24% (0.0423 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.48% (0.0414 => 0.0416, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.24% (0.0416 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.70% (0.0431 => 0.0434, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.23% (0.0433 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.47% (0.0426 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.23% (0.0428 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.48% (0.0417 => 0.0419, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.48% (0.0418 => 0.0420) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.71% (0.0423 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.24% (0.0425 => 0.0426, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.23% (0.0435 => 0.0436, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.46% (0.0436 => 0.0438, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.73% (0.0411 => 0.0414, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.48% (0.0413 => 0.0415) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.24% (0.0424 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.24% (0.0425 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.48% (0.0415 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.48% (0.0416 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.25% (0.0407 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.49% (0.0408 => 0.0410) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.49% (0.0406 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.49% (0.0407 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.45% (0.0443 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.45% (0.0444 => 0.0446) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.49% (0.0405 => 0.0407) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.49% (0.0406 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.74% (0.0406 => 0.0409) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.25% (0.0408 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.48% (0.0413 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.48% (0.0415 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.22% (1.2638 => 1.2610, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.08% (7.9512 => 7.9451, std.dev.: 0.0144) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.35% (0.7453 => 0.7479, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -2.21% (0.0362 => 0.0354, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.38% (0.0653 => 0.0644, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -13.42% (63.2438 => 54.7596, std.dev.: 0.0119) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 33.46% (14.1553 => 18.8919, std.dev.: 0.0201) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.87% (3.4629 => 5.6747, std.dev.: 0.0015) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14242.78% (0.0720 => 10.3268, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10034100.00% (0.0001 => 10.0342, std.dev.: 0.0013) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 59.67% (0.2554 => 0.4078, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 49.67% (10.3673 => 15.5167, std.dev.: 0.0151) SingleSource/Benchmarks/Misc/richards_benchmark: 35.51% (0.1622 => 0.2198, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 33.24% (0.1056 => 0.1407, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.41% (2.2022 => 2.5856, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.23% (7.0540 => 8.2696, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/flops: 17.04% (0.1432 => 0.1676, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.94% (0.1566 => 0.1800, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 13.32% (0.3282 => 0.3719, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.13% (1.7609 => 1.9921, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.74% (0.0871 => 0.0982, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.47% (0.0834 => 0.0938, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 11.88% (0.1440 => 0.1611, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.55% (0.1584 => 0.1767, std.dev.: 0.0049) MultiSource/Applications/minisat/minisat: 10.63% (0.7115 => 0.7871, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 10.49% (0.7433 => 0.8213, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.29% (0.6675 => 0.7362, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 10.13% (0.1175 => 0.1294, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 10.04% (9.4845 => 10.4364, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.99% (0.3543 => 0.3897, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.89% (0.2700 => 0.2967, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.87% (0.1438 => 0.1580) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.85% (0.3177 => 0.3490, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.84% (0.4879 => 0.5359, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 9.72% (10.4361 => 11.4500, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.69% (1.5415 => 1.6908, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: 9.61% (0.1655 => 0.1814, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 9.52% (3.3354 => 3.6529, std.dev.: 0.0138) MultiSource/Benchmarks/McCat/18-imp/imp: 9.49% (0.3423 => 0.3748, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 9.47% (0.3473 => 0.3802, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 9.47% (5.7591 => 6.3042, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/parameter-passing: 9.40% (0.3927 => 0.4296, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 9.38% (0.1695 => 0.1854, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.35% (0.3561 => 0.3894, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.34% (0.3543 => 0.3874, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 9.32% (0.3497 => 0.3823, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.30% (0.3516 => 0.3843, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.30% (0.4615 => 0.5044, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 9.26% (0.3109 => 0.3397, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.23% (0.5105 => 0.5576, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions: 9.20% (0.3828 => 0.4180, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 9.18% (0.3694 => 0.4033, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.13% (0.3121 => 0.3406, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.10% (0.5860 => 0.6393, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/property: 9.08% (0.3886 => 0.4239, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.97% (4.2646 => 4.6470, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.95% (0.8067 => 0.8789, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.94% (0.2271 => 0.2474, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.91% (0.8172 => 0.8900, std.dev.: 0.0016) MultiSource/Applications/Burg/burg: 8.90% (1.1642 => 1.2678, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.87% (1.3050 => 1.4207, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.82% (0.1236 => 0.1345, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.81% (0.1940 => 0.2111, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 8.81% (0.1555 => 0.1692, std.dev.: 0.0040) MultiSource/Applications/lua/lua: 8.79% (3.8723 => 4.2126, std.dev.: 0.0120) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.74% (0.1510 => 0.1642, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.73% (0.5569 => 0.6055, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 8.72% (0.6456 => 0.7019, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 8.68% (0.1163 => 0.1264, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.66% (4.9449 => 5.3732, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.65% (0.3307 => 0.3593, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 8.63% (0.7835 => 0.8511, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.60% (0.1337 => 0.1452, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.56% (8.1363 => 8.8328, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.54% (5.0018 => 5.4292, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.52% (0.2758 => 0.2993, std.dev.: 0.0021) MultiSource/Benchmarks/sim/sim: 8.50% (0.3387 => 0.3675, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.45% (0.2107 => 0.2285, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.43% (0.2065 => 0.2239, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 8.42% (1.5603 => 1.6916, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.39% (0.5020 => 0.5441, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.38% (0.9765 => 1.0583, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 8.20% (1.0722 => 1.1601, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.12% (1.5859 => 1.7146, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 8.09% (2.0273 => 2.1914, std.dev.: 0.0033) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.08% (7.9617 => 8.6048, std.dev.: 0.0110) MultiSource/Applications/siod/siod: 7.81% (2.2969 => 2.4763, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.79% (0.3865 => 0.4166, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 7.70% (0.3180 => 0.3425, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash: 7.69% (0.4289 => 0.4619, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.61% (0.4636 => 0.4989, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.61% (0.3441 => 0.3703, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.58% (0.4103 => 0.4414, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.49% (0.4203 => 0.4518, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.48% (0.6030 => 0.6481, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 7.45% (0.3422 => 0.3677, std.dev.: 0.0064) SingleSource/UnitTests/ObjC++/Hello: 7.41% (0.5925 => 0.6364, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.41% (2.2024 => 2.3655, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.33% (1.1861 => 1.2730, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 7.27% (0.4620 => 0.4956, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 7.21% (0.4048 => 0.4340, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.15% (0.2603 => 0.2789, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 7.14% (21.9371 => 23.5024, std.dev.: 0.0151) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.02% (0.1695 => 0.1814, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.01% (0.3650 => 0.3906, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/sieve: 6.97% (0.3603 => 0.3854, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.94% (0.5981 => 0.6396, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.88% (0.6450 => 0.6894, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 6.86% (0.4299 => 0.4594, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 6.84% (0.8921 => 0.9531, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 6.83% (0.7326 => 0.7826, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.82% (0.3826 => 0.4087, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.71% (0.2891 => 0.3085, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.68% (0.2905 => 0.3099, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.57% (0.3684 => 0.3926, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.51% (0.3136 => 0.3340, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 6.46% (0.2831 => 0.3014, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.45% (0.1892 => 0.2014, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.45% (2.0665 => 2.1997, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.42% (0.3162 => 0.3365, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.39% (1.4186 => 1.5093, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 6.28% (0.3232 => 0.3435, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.26% (0.3098 => 0.3292, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.23% (0.2871 => 0.3050, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.17% (0.2756 => 0.2926, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.17% (0.2725 => 0.2893, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.16% (0.3052 => 0.3240, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.15% (0.3283 => 0.3485, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.08% (0.2877 => 0.3052, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 6.03% (1.1840 => 1.2554, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.99% (0.2872 => 0.3044, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.91% (0.2793 => 0.2958, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.90% (0.2714 => 0.2874, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 5.89% (0.2802 => 0.2967, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.71% (0.4064 => 0.4296, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.67% (0.1906 => 0.2014, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.65% (0.3379 => 0.3570, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.65% (0.2266 => 0.2394, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.52% (0.8101 => 0.8548, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 4.93% (0.2049 => 0.2150, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.76% (0.3131 => 0.3280, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.69% (14.3668 => 15.0405, std.dev.: 0.0169) MultiSource/Applications/sqlite3/sqlite3: 4.66% (17.1811 => 17.9814, std.dev.: 0.0139) MultiSource/Applications/hexxagon/hexxagon: 4.60% (1.2842 => 1.3433, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.41% (0.3427 => 0.3578, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (3.8922 => 4.0461, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.53% (1.1194 => 1.1589, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.76% (1.1396 => 1.2508, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 9.18% (3.1595 => 3.4497, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3680, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.32% (3.6395 => 3.7605, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.73% (4.2280 => 4.3435, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7650, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.70% (0.8275 => 0.8416, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.42% (0.9540 => 0.9675, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.35% (11.6436 => 11.8012, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.13% (2.6546 => 2.6847, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2069, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.11% (9.1159 => 9.2172, std.dev.: 0.0060) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.07% (6.5088 => 6.5782, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1308, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.06% (0.8651 => 0.1725, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.98% (5.2763 => 3.2722, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.17% (5.3855 => 3.7071, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.77% (5.3526 => 3.7055, std.dev.: 0.0034) SingleSource/UnitTests/Vector/constpool: -14.57% (54.1659 => 46.2740, std.dev.: 0.0483) MultiSource/Applications/ClamAV/clamscan: -12.27% (22.1758 => 19.4538, std.dev.: 0.0209) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.33% (2.9384 => 2.6348, std.dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7637, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: -15.73% (1.6925 => 1.4263, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.03% (0.0998 => 0.0858, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -11.28% (1.2373 => 1.0977, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: -10.39% (1.5373 => 1.3776, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/mason/mason: -9.90% (0.2161 => 0.1947, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.38% (19.9488 => 18.2770, std.dev.: 0.0196) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.70% (1.8329 => 1.7101, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5757, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8483, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.28% (1.6805 => 1.5917, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5080, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.73% (1.3677 => 1.3167, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.48% (3.2827 => 3.1683, std.dev.: 0.0105) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.40% (0.9957 => 0.9618, std.dev.: 0.0113) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5079, std.dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: -3.01% (12.4730 => 12.0971, std.dev.: 0.0015) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.04% (8.6802 => 8.5029, std.dev.: 0.0147) SingleSource/Benchmarks/Misc/salsa20: -1.96% (10.2830 => 10.0819, std.dev.: 0.0156) SingleSource/Regression/C/uint64_to_float: -1.88% (0.5413 => 0.5311, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.87% (8.1563 => 8.0040, std.dev.: 0.0096) MultiSource/Applications/sqlite3/sqlite3: -1.77% (4.6441 => 4.5621, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6805, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std.dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: -1.51% (9.5636 => 9.4192, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.07% (6.2999 => 6.2328, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8573, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.83% (0.5229 => 0.5952, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 9.46% (14.9895 => 16.4081, std.dev.: 0.0301) MultiSource/Benchmarks/MallocBench/gs/gs: 8.06% (4.1105 => 4.4420, std.dev.: 0.0104) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.14% (1.1048 => 1.2610, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.99% (7.1582 => 7.9451, std.dev.: 0.0144) SingleSource/Benchmarks/Misc-C++/stepanov_container: 20.20% (0.6222 => 0.7479, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35300.00% (0.0001 => 0.0354, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.57% (0.2116 => 0.0644, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 16 00:26:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 16 Oct 2012 02:26:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121016072628.312A52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4899?compare_to=4897&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4899, Order: 166008, Start Time: 2012-10-16 06:01:23, End Time: 2012-10-16 07:29:22 To: 4897, Order: 166004, Start Time: 2012-10-16 03:34:58, End Time: 2012-10-16 05:00:54 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (171 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1042 (696 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.21% (2.0176 => 2.4858, std.dev.: 0.0129) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.16% (0.1410 => 0.1666, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 17.31% (0.0826 => 0.0969, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/08-main/main: 16.72% (0.2243 => 0.2618, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.69% (0.0653 => 0.0762) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.27% (0.1072 => 0.1225, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 14.02% (0.1013 => 0.1155, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.51% (0.0770 => 0.0874, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.41% (0.1327 => 0.1505, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.09% (0.1413 => 0.1598, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 12.86% (0.7038 => 0.7943, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.62% (3.9660 => 4.4664, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.59% (0.1588 => 0.1788, std.dev.: 0.0028) MultiSource/Applications/hbd/hbd: 12.54% (1.3693 => 1.5410, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.53% (0.2721 => 0.3062, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.45% (0.0964 => 0.1084, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.37% (0.2596 => 0.2917, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 12.34% (0.4328 => 0.4862, std.dev.: 0.0086) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.24% (0.7710 => 0.8654, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash: 12.19% (0.4062 => 0.4557, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.12% (1.4563 => 1.6328, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.08% (0.6283 => 0.7042, std.dev.: 0.0294) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.00% (0.6959 => 0.7794, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.93% (0.5265 => 0.5893, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 11.92% (13.8202 => 15.4681, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.82% (0.9199 => 1.0286, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 11.67% (0.1003 => 0.1120, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.65% (1.2193 => 1.3614, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 11.57% (0.7061 => 0.7878, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.57% (0.3899 => 0.4350, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 11.53% (0.5818 => 0.6489, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 11.49% (0.1062 => 0.1184, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.41% (0.1157 => 0.1289, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.40% (1.1364 => 1.2659, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 11.36% (0.5748 => 0.6401, std.dev.: 0.0077) MultiSource/Applications/Burg/burg: 11.21% (1.1061 => 1.2301, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.19% (0.4791 => 0.5327, std.dev.: 0.0076) MultiSource/Applications/lemon/lemon: 11.06% (1.0313 => 1.1454, std.dev.: 0.0064) SingleSource/Benchmarks/McGill/chomp: 11.01% (0.1589 => 0.1764, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.88% (0.3485 => 0.3864, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.86% (0.4016 => 0.4452, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.81% (0.5577 => 0.6180, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.80% (0.3130 => 0.3468, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.70% (0.1075 => 0.1190, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.68% (0.2023 => 0.2239, std.dev.: 0.0019) MultiSource/Applications/minisat/minisat: 10.66% (0.6744 => 0.7463, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.58% (0.2127 => 0.2352, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 10.57% (0.2781 => 0.3075, std.dev.: 0.0070) MultiSource/Applications/kimwitu++/kc: 10.41% (16.6129 => 18.3423, std.dev.: 0.0230) SingleSource/Benchmarks/Shootout-C++/lists: 10.39% (0.3293 => 0.3635, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.35% (0.3489 => 0.3850, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.34% (0.4379 => 0.4832, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 10.34% (0.2726 => 0.3008, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.27% (0.8698 => 0.9591, std.dev.: 0.0225) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.25% (0.3580 => 0.3947, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.23% (0.3022 => 0.3331, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 10.22% (3.8646 => 4.2596, std.dev.: 0.0034) MultiSource/Applications/sgefa/sgefa: 10.22% (0.2995 => 0.3301, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 10.20% (2.1791 => 2.4014, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.20% (0.3246 => 0.3577, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.17% (0.2782 => 0.3065, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/sieve: 10.14% (0.3453 => 0.3803, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/18-imp/imp: 10.09% (0.3220 => 0.3545, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.09% (0.2914 => 0.3208, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 10.08% (0.1111 => 0.1223, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.06% (0.1014 => 0.1116, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 10.01% (0.1478 => 0.1626, std.dev.: 0.0018) MultiSource/Applications/treecc/treecc: 10.01% (1.9270 => 2.1198, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary3: 10.00% (0.3149 => 0.3464, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.97% (0.1865 => 0.2051, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 9.96% (0.2760 => 0.3035, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.91% (0.6576 => 0.7228, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.89% (1.9828 => 2.1788, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 9.87% (0.8310 => 0.9130, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.87% (0.7460 => 0.8196, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.83% (0.1435 => 0.1576, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.81% (0.2966 => 0.3257, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 9.79% (0.7506 => 0.8241, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 9.78% (0.3107 => 0.3411, std.dev.: 0.0088) MultiSource/Applications/d/make_dparser: 9.78% (3.1889 => 3.5008, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/random: 9.78% (0.2690 => 0.2953, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.76% (0.2765 => 0.3035, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.72% (0.5637 => 0.6185, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.72% (0.1986 => 0.2179, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.68% (4.9865 => 5.4693, std.dev.: 0.1498) SingleSource/Benchmarks/Shootout-C++/methcall: 9.56% (0.2761 => 0.3025, std.dev.: 0.0075) MultiSource/Benchmarks/McCat/09-vor/vor: 9.54% (0.2925 => 0.3204, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.53% (7.2180 => 7.9059, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/matrix: 9.50% (0.2988 => 0.3272, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/wc: 9.50% (0.2937 => 0.3216, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/fibo: 9.47% (0.2628 => 0.2877, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ary2: 9.40% (0.3192 => 0.3492, std.dev.: 0.0056) MultiSource/Benchmarks/nbench/nbench: 9.37% (1.0594 => 1.1587, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.33% (0.1276 => 0.1395, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.29% (0.3755 => 0.4104, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.24% (0.2696 => 0.2945, std.dev.: 0.0064) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.11% (0.2140 => 0.2335, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 9.05% (1.2749 => 1.3903, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 8.99% (0.1657 => 0.1806, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.94% (1.3245 => 1.4429, std.dev.: 0.0039) MultiSource/Benchmarks/sim/sim: 8.91% (0.3131 => 0.3410, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.83% (3.6692 => 3.9931, std.dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: 8.74% (14.8535 => 16.1518, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.62% (0.8818 => 0.9578, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.55% (4.3801 => 4.7547, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.49% (0.3511 => 0.3809, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.48% (4.4433 => 4.8199, std.dev.: 0.0092) MultiSource/Benchmarks/mafft/pairlocalalign: 8.47% (8.4961 => 9.2160, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.44% (3.2742 => 3.5506, std.dev.: 0.0842) SingleSource/Benchmarks/Shootout-C++/objinst: 8.42% (0.2945 => 0.3193, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.39% (1.5188 => 1.6462, std.dev.: 0.0434) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.31% (0.6135 => 0.6645, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.06% (0.2321 => 0.2508, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.99% (0.1789 => 0.1932, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.94% (0.9108 => 0.9831, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.88% (1.1333 => 1.2226, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 7.85% (0.4113 => 0.4436, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 7.85% (4.6629 => 5.0289, std.dev.: 0.0039) MultiSource/Applications/lua/lua: 7.68% (3.7467 => 4.0345, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: 7.65% (0.1385 => 0.1491, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.62% (0.4003 => 0.4308, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.61% (0.3245 => 0.3492, std.dev.: 0.0066) MultiSource/Applications/JM/ldecod/ldecod: 7.42% (6.5754 => 7.0632, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions: 7.36% (0.3914 => 0.4202, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.31% (0.3940 => 0.4228, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.27% (0.2504 => 0.2686, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.24% (0.3578 => 0.3837, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.13% (0.3789 => 0.4059, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.12% (1.2292 => 1.3167, std.dev.: 0.0098) SingleSource/UnitTests/ObjC/exceptions-2: 7.05% (0.3601 => 0.3855, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.02% (0.3646 => 0.3902, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 6.99% (0.3663 => 0.3919, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 6.87% (0.3623 => 0.3872, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.86% (6.2785 => 6.7093, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.85% (0.3650 => 0.3900, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.49% (13.2842 => 14.1459, std.dev.: 0.0987) SingleSource/Benchmarks/Misc/ReedSolomon: 6.42% (0.1777 => 0.1891, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.38% (0.1819 => 0.1935, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.26% (0.2243 => 0.2361, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 5.18% (16.2614 => 17.1035, std.dev.: 0.0148) MultiSource/Applications/ClamAV/clamscan: 4.36% (14.5298 => 15.1629, std.dev.: 0.0110) MultiSource/Benchmarks/Bullet/bullet: 2.13% (33.2944 => 34.0024, std.dev.: 0.0092) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/methcall: 30.51% (5.7573 => 7.5140, std.dev.: 0.0500) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.10% (1.0895 => 1.3630, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.17% (1.8175 => 2.2568, std.dev.: 0.0116) SingleSource/Benchmarks/Misc/richards_benchmark: 11.06% (1.1560 => 1.2838, std.dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4143, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: 6.12% (1.2998 => 1.3793, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0039, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std.dev.: 0.0057) MultiSource/Benchmarks/nbench/nbench: 3.91% (11.2619 => 11.7024, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.50% (1.9199 => 1.9871, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.33% (10.7476 => 11.1055, std.dev.: 0.0538) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.19% (7.4271 => 7.5898, std.dev.: 0.0061) MultiSource/Applications/lemon/lemon: 1.58% (1.4298 => 1.4524, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0508, std.dev.: 0.0075) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5126, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 1.43% (2.1753 => 2.2065, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2123, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1879, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/oourafft: 1.17% (5.5130 => 5.5777, std.dev.: 0.0128) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.06% (9.9194 => 10.0247, std.dev.: 0.0159) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.89% (0.2670 => 0.1418, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.91% (0.4657 => 0.3916, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -14.43% (0.0707 => 0.0605, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.36% (1.3813 => 1.1968, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.25% (1.3819 => 1.1988, std.dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.84% (0.2238 => 0.1973, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -10.61% (1.2308 => 1.1002, std.dev.: 0.0429) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.01% (20.3410 => 18.3039, std.dev.: 0.0109) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2652, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0289) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0144) SingleSource/UnitTests/Vector/multiplies: -5.05% (2.6470 => 2.5132, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.17% (0.9996 => 0.9579, std.dev.: 0.0010) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1559, std.dev.: 0.0065) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.43% (1.7688 => 1.7081, std.dev.: 0.0062) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.02% (0.4867 => 0.4720, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -2.68% (6.3560 => 6.1857, std.dev.: 0.0326) MultiSource/Applications/lua/lua: -2.61% (26.5159 => 25.8251, std.dev.: 0.0130) MultiSource/Applications/spiff/spiff: -2.54% (3.0263 => 2.9494, std.dev.: 0.0021) SingleSource/Regression/C/uint64_to_float: -2.53% (0.5449 => 0.5311, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -2.39% (1.9762 => 1.9289, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.93% (0.6589 => 0.6462, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7137, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0075) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0072, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.26% (0.8342 => 0.8237, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4951, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2582, std.dev.: 0.0010) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 16 00:35:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 16 Oct 2012 02:35:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121016073552.9F1B62A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/4900?compare_to=4898&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4900, Order: 166010, Start Time: 2012-10-16 06:14:19, End Time: 2012-10-16 07:37:47 To: 4898, Order: 166004, Start Time: 2012-10-16 04:24:50, End Time: 2012-10-16 05:44:59 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (151 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 953 (691 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.60% (0.5952 => 0.5988, std.dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 0.53% (16.4081 => 16.4954, std.dev.: 0.0182) MultiSource/Benchmarks/Bullet/bullet: 0.50% (54.7596 => 55.0307, std.dev.: 0.1016) MultiSource/Benchmarks/MallocBench/gs/gs: 0.20% (4.4420 => 4.4507, std.dev.: 0.0227) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.65% (0.0465 => 0.0468, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.64% (0.0466 => 0.0469, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.69% (0.0434 => 0.0437, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.92% (0.0435 => 0.0439, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.47% (0.0423 => 0.0425, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.71% (0.0424 => 0.0427, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.48% (0.0416 => 0.0418, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.96% (0.0417 => 0.0421, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.92% (0.0434 => 0.0438, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.15% (0.0434 => 0.0439, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.93% (0.0428 => 0.0432, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.93% (0.0429 => 0.0433, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.72% (0.0419 => 0.0422, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.95% (0.0420 => 0.0424, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.70% (0.0426 => 0.0429, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.94% (0.0426 => 0.0430, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.92% (0.0436 => 0.0440, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.34% (0.0438 => 0.0457, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.24% (0.0414 => 0.0415, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.72% (0.0415 => 0.0418, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.47% (0.0425 => 0.0427, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.94% (0.0426 => 0.0430, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.72% (0.0417 => 0.0420, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.96% (0.0418 => 0.0422, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.74% (0.0408 => 0.0411, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.73% (0.0410 => 0.0413, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.98% (0.0408 => 0.0412, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.73% (0.0409 => 0.0412, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.45% (0.0445 => 0.0447, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.67% (0.0446 => 0.0449, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.49% (0.0407 => 0.0409, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.74% (0.0408 => 0.0411, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.73% (0.0409 => 0.0412, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.22% (0.0409 => 0.0414, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.96% (0.0415 => 0.0419, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.72% (0.0417 => 0.0420, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.31% (1.2610 => 1.2649, std.dev.: 0.0233) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.31% (7.9451 => 7.9700, std.dev.: 0.1037) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.24% (0.7479 => 0.7461, std.dev.: 0.0030) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.56% (0.0354 => 0.0352, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.34% (0.0644 => 0.0717, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.99% (63.2438 => 55.0307, std.dev.: 0.1016) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 33.99% (14.1553 => 18.9670, std.dev.: 0.0182) SingleSource/Benchmarks/Misc-C++-EH/spirit: 64.24% (3.4629 => 5.6875, std.dev.: 0.0032) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14240.56% (0.0720 => 10.3252, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10035200.00% (0.0001 => 10.0353, std.dev.: 0.0015) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 60.06% (0.2554 => 0.4088, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: 46.83% (10.3673 => 15.2226, std.dev.: 0.1374) SingleSource/Benchmarks/Misc/richards_benchmark: 36.62% (0.1622 => 0.2216, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/distray/distray: 33.52% (0.1056 => 0.1410, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.14% (2.2022 => 2.6016, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 17.95% (0.1432 => 0.1689, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.74% (7.0540 => 8.3051, std.dev.: 0.1908) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.52% (0.1566 => 0.1809, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.97% (1.7609 => 2.0069, std.dev.: 0.0299) SingleSource/Benchmarks/Misc/oourafft: 13.32% (0.3282 => 0.3719, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.20% (0.0871 => 0.0986, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 12.15% (0.2065 => 0.2316, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.15% (0.1029 => 0.1154, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/power/power: 12.08% (0.1440 => 0.1614, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.93% (0.1584 => 0.1773, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.49% (0.2758 => 0.3075, std.dev.: 0.0066) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.40% (0.3543 => 0.3947, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.05% (0.3177 => 0.3528, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.97% (0.4879 => 0.5414, std.dev.: 0.0077) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.89% (0.2700 => 0.2994, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/trivial-interface: 10.88% (0.3473 => 0.3851, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.85% (0.3927 => 0.4353, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 10.84% (0.3516 => 0.3897, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 10.82% (0.7115 => 0.7885, std.dev.: 0.0082) SingleSource/UnitTests/ObjC/synchronized: 10.81% (0.3561 => 0.3946, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.81% (0.3543 => 0.3926, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 10.74% (0.3828 => 0.4239, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 10.72% (0.3497 => 0.3872, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 10.72% (0.7433 => 0.8230, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.71% (0.1438 => 0.1592, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/for-in: 10.56% (0.3694 => 0.4084, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 10.56% (10.4361 => 11.5379, std.dev.: 0.0291) SingleSource/UnitTests/ObjC/property: 10.50% (0.3886 => 0.4294, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.49% (0.6675 => 0.7375, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 10.47% (0.1175 => 0.1298, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 10.43% (9.4845 => 10.4736, std.dev.: 0.0185) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.27% (0.5860 => 0.6462, std.dev.: 0.0149) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.25% (0.4615 => 0.5088, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.17% (0.1337 => 0.1473, std.dev.: 0.0043) MultiSource/Applications/oggenc/oggenc: 10.11% (5.7591 => 6.3416, std.dev.: 0.0171) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.10% (1.5415 => 1.6972, std.dev.: 0.0363) SingleSource/Benchmarks/McGill/chomp: 10.03% (0.1655 => 0.1821, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.97% (0.1143 => 0.1257) MultiSource/Applications/d/make_dparser: 9.94% (3.3354 => 3.6668, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/em3d/em3d: 9.91% (0.1695 => 0.1863, std.dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: 9.91% (0.3109 => 0.3417, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 9.85% (0.3423 => 0.3760, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.81% (0.8067 => 0.8858, std.dev.: 0.0207) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.64% (0.2271 => 0.2490, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.56% (0.5105 => 0.5593, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.56% (4.2646 => 4.6722, std.dev.: 0.0060) MultiSource/Applications/spiff/spiff: 9.39% (0.7835 => 0.8571, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.32% (0.5569 => 0.6088, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.30% (0.1236 => 0.1351, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.30% (1.3050 => 1.4264, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 9.22% (0.6456 => 0.7051, std.dev.: 0.0046) MultiSource/Applications/viterbi/viterbi: 9.20% (0.1555 => 0.1698, std.dev.: 0.0038) MultiSource/Applications/Burg/burg: 9.17% (1.1642 => 1.2710, std.dev.: 0.0129) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.14% (0.1510 => 0.1648, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.12% (0.1940 => 0.2117, std.dev.: 0.0013) MultiSource/Applications/aha/aha: 9.12% (0.1151 => 0.1256, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.12% (8.1363 => 8.8784, std.dev.: 0.0103) MultiSource/Applications/lua/lua: 9.11% (3.8723 => 4.2251, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.07% (0.3307 => 0.3607, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.05% (4.9449 => 5.3926, std.dev.: 0.1338) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.04% (5.0018 => 5.4540, std.dev.: 0.1084) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.97% (0.2107 => 0.2296, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/mst/mst: 8.94% (0.1163 => 0.1267, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: 8.80% (0.3387 => 0.3685, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.78% (0.5020 => 0.5461, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.71% (0.9765 => 1.0616, std.dev.: 0.0304) MultiSource/Applications/treecc/treecc: 8.54% (2.0273 => 2.2004, std.dev.: 0.0052) MultiSource/Applications/lemon/lemon: 8.53% (1.0722 => 1.1637, std.dev.: 0.0051) SingleSource/UnitTests/ObjC++/property-reference-object: 8.49% (0.6030 => 0.6542, std.dev.: 0.0034) SingleSource/UnitTests/ObjC++/Hello: 8.47% (0.5925 => 0.6427, std.dev.: 0.0025) MultiSource/Applications/hbd/hbd: 8.43% (1.5603 => 1.6919, std.dev.: 0.0166) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.42% (7.9617 => 8.6322, std.dev.: 0.1395) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.33% (1.5859 => 1.7180, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 8.25% (2.2969 => 2.4864, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.10% (0.3865 => 0.4178, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/health/health: 8.04% (0.1268 => 0.1370, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 7.99% (0.3180 => 0.3434, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 7.81% (0.4289 => 0.4624, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.81% (0.4636 => 0.4998, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.77% (1.1861 => 1.2783, std.dev.: 0.0046) SingleSource/UnitTests/ObjC++/property-reference: 7.74% (0.7326 => 0.7893, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.73% (0.4203 => 0.4528, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.66% (0.3826 => 0.4119, std.dev.: 0.0085) MultiSource/Applications/JM/lencod/lencod: 7.60% (21.9371 => 23.6042, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/football/football: 7.56% (0.8921 => 0.9595, std.dev.: 0.0158) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.54% (2.2024 => 2.3685, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/lists: 7.51% (0.3422 => 0.3679, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.49% (0.2603 => 0.2798, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.43% (0.6450 => 0.6929, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 7.33% (1.1840 => 1.2708, std.dev.: 0.0235) SingleSource/Benchmarks/Shootout-C++/hash2: 7.32% (0.4620 => 0.4958, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 7.23% (0.4299 => 0.4610, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.20% (0.1695 => 0.1817, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 7.19% (0.4048 => 0.4339, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 7.11% (0.3603 => 0.3859, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.06% (1.4186 => 1.5187, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/neural/neural: 7.04% (0.1463 => 0.1566, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.94% (0.5981 => 0.6396, std.dev.: 0.0155) SingleSource/Regression/C++/ofstream_ctor: 6.92% (0.2905 => 0.3106, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.85% (0.2891 => 0.3089, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.81% (0.3684 => 0.3935, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.68% (0.2831 => 0.3020, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.60% (0.2756 => 0.2938, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 6.37% (0.3232 => 0.3438, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.31% (0.3283 => 0.3490, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.28% (0.2725 => 0.2896, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 6.23% (0.3098 => 0.3291, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.22% (0.2266 => 0.2407, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.22% (0.2877 => 0.3056, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.20% (0.2872 => 0.3050, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.15% (0.2714 => 0.2881, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 6.13% (0.2871 => 0.3047, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.12% (0.2793 => 0.2964, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 6.06% (0.3052 => 0.3237, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 6.04% (0.3379 => 0.3583, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 6.03% (0.2802 => 0.2971, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.88% (0.4064 => 0.4303, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.73% (0.8101 => 0.8565, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/ReedSolomon: 5.37% (0.2049 => 0.2159, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 4.82% (17.1811 => 18.0094, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/objinst: 4.76% (0.3131 => 0.3280, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 4.71% (1.2842 => 1.3447, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.10% (3.8922 => 4.0519, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.85% (1.1194 => 1.1625, std.dev.: 0.0164) MultiSource/Benchmarks/Olden/bh/bh: 3.46% (0.3092 => 0.3199, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.17% (0.3817 => 0.3938, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.97% (1.1396 => 1.2532, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.85% (0.1421 => 0.1561, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 9.22% (3.1595 => 3.4507, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3682, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.82% (0.4162 => 0.4321, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.54% (3.6395 => 3.7683, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.71% (4.2280 => 4.3427, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7651, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.73% (0.8275 => 0.8418, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.45% (0.9540 => 0.9678, std.dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 1.35% (11.6436 => 11.8009, std.dev.: 0.0206) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.19% (2.6546 => 2.6861, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.03% (6.6874 => 0.1316, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/salsa20: -80.00% (0.8651 => 0.1730, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.78% (5.2763 => 3.2828, std.dev.: 0.0606) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.92% (5.3855 => 3.7205, std.dev.: 0.0436) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.56% (5.3526 => 3.7169, std.dev.: 0.0575) SingleSource/UnitTests/Vector/constpool: -14.67% (54.1659 => 46.2208, std.dev.: 0.0090) MultiSource/Applications/ClamAV/clamscan: -11.92% (22.1758 => 19.5319, std.dev.: 0.0450) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.10% (2.9384 => 2.6415, std.dev.: 0.0505) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel: -33.56% (1.1492 => 0.7635, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: -15.80% (1.6925 => 1.4251, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.53% (0.0998 => 0.0863) SingleSource/Benchmarks/McGill/chomp: -11.47% (1.2373 => 1.0954, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -10.28% (1.5373 => 1.3792, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -9.81% (0.2161 => 0.1949, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.54% (19.9488 => 18.2457, std.dev.: 0.0190) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.74% (1.8329 => 1.7093, std.dev.: 0.0171) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0169) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.32% (1.6805 => 1.5911, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7966, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/flops-5: -4.78% (1.5835 => 1.5078, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.58% (3.2827 => 3.1653, std.dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.17% (0.9957 => 0.9641, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5089, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: -3.02% (12.4730 => 12.0960, std.dev.: 0.0025) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.99% (10.2830 => 10.0781, std.dev.: 0.0077) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.98% (8.1563 => 7.9948, std.dev.: 0.0159) SingleSource/Regression/C/uint64_to_float: -1.88% (0.5413 => 0.5311) MultiSource/Applications/sqlite3/sqlite3: -1.79% (4.6441 => 4.5608, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6812, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5116, std.dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4224, std.dev.: 0.0423) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.05% (1.0313 => 1.0205, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8585, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/lists: -1.01% (12.5348 => 12.4081, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout/lists: -1.01% (6.2999 => 6.2363, std.dev.: 0.0045) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 14.52% (0.5229 => 0.5988, std.dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 10.05% (14.9895 => 16.4954, std.dev.: 0.0182) MultiSource/Benchmarks/MallocBench/gs/gs: 8.28% (4.1105 => 4.4507, std.dev.: 0.0227) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.49% (1.1048 => 1.2649, std.dev.: 0.0233) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.34% (7.1582 => 7.9700, std.dev.: 0.1037) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.91% (0.6222 => 0.7461, std.dev.: 0.0030) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35100.00% (0.0001 => 0.0352, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -66.12% (0.2116 => 0.0717, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 16 02:22:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 16 Oct 2012 04:22:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121016092222.973A02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4901?compare_to=4899&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4901, Order: 166019, Start Time: 2012-10-16 07:59:11, End Time: 2012-10-16 09:25:16 To: 4899, Order: 166008, Start Time: 2012-10-16 06:01:23, End Time: 2012-10-16 07:29:22 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (187 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1040 (680 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.90% (55.0183 => 56.6142, std.dev.: 0.0252) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.56% (78.1800 => 80.1785, std.dev.: 0.7605) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.70% (2.0176 => 2.4957, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.51% (0.1410 => 0.1671, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 17.68% (0.0826 => 0.0972, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: 17.12% (0.2243 => 0.2627, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.85% (0.0653 => 0.0763, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.02% (0.1072 => 0.1233, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 14.22% (0.1013 => 0.1157, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.79% (0.0834 => 0.0949, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.52% (0.1413 => 0.1604, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.49% (0.1327 => 0.1506, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 13.17% (0.7038 => 0.7965, std.dev.: 0.0019) MultiSource/Applications/hbd/hbd: 13.08% (1.3693 => 1.5484, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.07% (0.0964 => 0.1090, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.90% (0.2721 => 0.3072, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.83% (3.9660 => 4.4748, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.59% (0.1588 => 0.1788, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 12.45% (0.4328 => 0.4867, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.40% (0.2596 => 0.2918, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/distray/distray: 12.35% (0.0818 => 0.0919, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 12.30% (13.8202 => 15.5198, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.22% (0.6283 => 0.7051, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.21% (0.6959 => 0.7809, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.09% (1.4563 => 1.6324, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.02% (0.5265 => 0.5898, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.01% (0.9199 => 1.0304, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.01% (1.2193 => 1.3657, std.dev.: 0.0089) MultiSource/Benchmarks/Olden/power/power: 11.96% (0.1003 => 0.1123, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 11.96% (0.1062 => 0.1189, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 11.92% (0.4062 => 0.4546, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.91% (0.7710 => 0.8628, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.84% (1.1364 => 1.2709, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 11.58% (0.5818 => 0.6492, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.50% (0.1157 => 0.1290, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.44% (0.3899 => 0.4345, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.37% (0.3130 => 0.3486, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 11.28% (1.1061 => 1.2309, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 11.28% (1.0313 => 1.1476, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.21% (0.4791 => 0.5328, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 11.20% (0.5748 => 0.6392, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 11.03% (0.7061 => 0.7840, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.96% (0.3485 => 0.3867, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.91% (0.4016 => 0.4454, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.90% (0.5577 => 0.6185, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.84% (0.3756 => 0.4163, std.dev.: 0.0095) MultiSource/Applications/kimwitu++/kc: 10.83% (16.6129 => 18.4120, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.79% (0.1075 => 0.1191, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 10.79% (0.2781 => 0.3081, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 10.74% (0.6744 => 0.7468, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: 10.66% (0.3293 => 0.3644, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.64% (0.0977 => 0.1081, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.60% (0.3246 => 0.3590, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.60% (0.4379 => 0.4843, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.57% (0.2782 => 0.3076, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 10.55% (0.2995 => 0.3311, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.52% (0.3489 => 0.3856, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.49% (0.3022 => 0.3339, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.47% (0.2914 => 0.3219, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 10.45% (3.8646 => 4.2686, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.45% (0.8698 => 0.9607, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 10.42% (0.3868 => 0.4271, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 10.39% (2.1791 => 2.4056, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.39% (0.3580 => 0.3952, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.39% (0.2127 => 0.2348, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.38% (0.2966 => 0.3274, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 10.35% (0.1111 => 0.1226, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 10.34% (0.3220 => 0.3553, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: 10.32% (0.1589 => 0.1753, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 10.31% (0.3453 => 0.3809, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 10.29% (1.9270 => 2.1252, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 10.28% (0.1478 => 0.1630, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.26% (0.1569 => 0.1730, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.24% (0.1435 => 0.1582, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 10.16% (3.1889 => 3.5129, std.dev.: 0.0114) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.16% (0.1014 => 0.1117, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.13% (0.1865 => 0.2054, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists1: 10.13% (0.3534 => 0.3892, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.11% (0.1276 => 0.1405, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.11% (1.9828 => 2.1832, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.09% (0.7460 => 0.8213, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/strcat: 10.09% (0.2726 => 0.3001, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 10.07% (0.7506 => 0.8262, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.07% (0.1986 => 0.2186, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 10.07% (0.3149 => 0.3466, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 10.06% (0.8310 => 0.9146, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.99% (0.2023 => 0.2225, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.95% (0.4390 => 0.4827, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.93% (0.5637 => 0.6197, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 9.91% (0.2925 => 0.3215, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 9.88% (0.3107 => 0.3414, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.87% (0.2655 => 0.2917, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 9.86% (0.2760 => 0.3032, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 9.85% (0.2690 => 0.2955, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.84% (0.6576 => 0.7223, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 9.82% (0.2607 => 0.2863, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/fibo: 9.82% (0.2628 => 0.2886, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.70% (4.9865 => 5.4700, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.69% (7.2180 => 7.9177, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/methcall: 9.67% (0.2761 => 0.3028, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 9.67% (0.2937 => 0.3221, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.66% (0.2765 => 0.3032, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 9.56% (0.3192 => 0.3497, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.42% (0.2696 => 0.2950, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 9.42% (1.0594 => 1.1592, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/matrix: 9.37% (0.2988 => 0.3268, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.29% (0.3755 => 0.4104, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 9.23% (0.1657 => 0.1810, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 9.20% (0.3131 => 0.3419, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.14% (1.3245 => 1.4456, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.08% (3.6692 => 4.0023, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.00% (4.3801 => 4.7742, std.dev.: 0.0028) MultiSource/Applications/SIBsim4/SIBsim4: 8.97% (1.2749 => 1.3893, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 8.96% (0.2945 => 0.3209, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 8.91% (14.8535 => 16.1767, std.dev.: 0.0186) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.90% (4.4433 => 4.8388, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.84% (1.5188 => 1.6531, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.80% (0.3511 => 0.3820, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.74% (0.2140 => 0.2327, std.dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 8.72% (4.6629 => 5.0693, std.dev.: 0.0078) MultiSource/Benchmarks/mafft/pairlocalalign: 8.69% (8.4961 => 9.2343, std.dev.: 0.0191) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.59% (0.6135 => 0.6662, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.44% (0.2321 => 0.2517, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.41% (0.8818 => 0.9560, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: 8.38% (0.6250 => 0.6774, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.29% (0.9108 => 0.9863, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.27% (3.2742 => 3.5451, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.27% (0.1789 => 0.1937, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 8.19% (0.4113 => 0.4450, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.14% (0.4805 => 0.5196, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.08% (1.1333 => 1.2249, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.07% (0.3245 => 0.3507, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.04% (2.1007 => 2.2696, std.dev.: 0.0048) MultiSource/Applications/lua/lua: 7.91% (3.7467 => 4.0430, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/neural/neural: 7.87% (0.1385 => 0.1494, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.79% (0.2504 => 0.2699, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.77% (0.4003 => 0.4314, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 7.69% (6.5754 => 7.0811, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/oourafft: 7.52% (0.2008 => 0.2159, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.49% (0.3914 => 0.4207, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.46% (0.3940 => 0.4234, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.29% (0.3578 => 0.3839, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 7.28% (0.3789 => 0.4065, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 7.22% (1.2292 => 1.3179, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 7.18% (0.3663 => 0.3926, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.16% (0.3646 => 0.3907, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.15% (6.2785 => 6.7277, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-2: 7.14% (0.3601 => 0.3858, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.01% (0.3623 => 0.3877, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.99% (0.3650 => 0.3905, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.89% (13.2842 => 14.1993, std.dev.: 0.0207) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.87% (0.1819 => 0.1944, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.66% (0.2243 => 0.2370, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/ReedSolomon: 5.63% (0.1777 => 0.1877, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 5.54% (16.2614 => 17.1617, std.dev.: 0.0222) MultiSource/Applications/ClamAV/clamscan: 4.58% (14.5298 => 15.1955, std.dev.: 0.0085) MultiSource/Benchmarks/Bullet/bullet: 2.04% (33.2944 => 33.9747, std.dev.: 0.0248) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5192, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fbench: 25.31% (1.8175 => 2.2776, std.dev.: 0.0422) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 11.08% (1.1560 => 1.2841, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.02% (0.8273 => 0.9019, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4145, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: 6.29% (1.2998 => 1.3816, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.89% (0.3458 => 0.3627, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-5: 4.64% (1.9144 => 2.0033, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (1.7081 => 1.7749, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.90% (11.2619 => 11.7012, std.dev.: 0.0052) MultiSource/Applications/SPASS/SPASS: 3.46% (10.7476 => 11.1194, std.dev.: 0.0303) SingleSource/Benchmarks/Misc/flops-6: 3.38% (1.9199 => 1.9848, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309) SingleSource/Benchmarks/Misc/salsa20: 2.15% (7.4271 => 7.5867, std.dev.: 0.0071) MultiSource/Applications/lemon/lemon: 1.57% (1.4298 => 1.4522, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5131, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1865, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/oourafft: 1.20% (5.5130 => 5.5789, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5904, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.52% (0.2670 => 0.1428, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.78% (0.4657 => 0.3922, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.94% (1.3813 => 1.2026, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.88% (1.3819 => 1.2039, std.dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.04% (0.0997 => 0.0857, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/mason/mason: -11.97% (0.2238 => 0.1970, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -11.24% (1.2308 => 1.0925, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.22% (20.3410 => 18.2620, std.dev.: 0.0302) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.49% (1.3780 => 1.3024, std.dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5144, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.56% (3.2729 => 3.1563, std.dev.: 0.0260) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.49% (1.7688 => 1.7071, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.35% (0.9996 => 0.9661, std.dev.: 0.0061) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.14% (0.4867 => 0.4714, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -2.60% (26.5159 => 25.8253, std.dev.: 0.0433) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.44% (3.0263 => 2.9526, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -2.42% (1.9762 => 1.9284, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.85% (0.6589 => 0.6467, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7141, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/lists: -1.72% (6.3560 => 6.2466, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.59% (0.6615 => 0.6510, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8597, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0059, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.25% (0.8342 => 0.8238, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4954, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2576, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 16 02:25:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 16 Oct 2012 04:25:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121016092541.92AF42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4902?compare_to=4900&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4902, Order: 166019, Start Time: 2012-10-16 08:07:34, End Time: 2012-10-16 09:27:37 To: 4900, Order: 166010, Start Time: 2012-10-16 06:14:19, End Time: 2012-10-16 07:37:47 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (164 on baseline) Performance Improvements: 2 (44 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 951 (679 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.20% (3.7205 => 3.6758, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.19% (3.7169 => 3.6727, std.dev.: 0.0033) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.38% (0.5988 => 0.5965, std.dev.: 0.0051) MultiSource/Applications/SPASS/SPASS: -0.20% (16.4954 => 16.4626, std.dev.: 0.0187) MultiSource/Benchmarks/Bullet/bullet: -0.64% (55.0307 => 54.6784, std.dev.: 0.0729) MultiSource/Benchmarks/MallocBench/gs/gs: 0.09% (4.4507 => 4.4548, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.21% (0.0468 => 0.0467, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0469 => 0.0469, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0437 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.46% (0.0439 => 0.0437, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.24% (0.0425 => 0.0426, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.23% (0.0427 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.24% (0.0418 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.24% (0.0421 => 0.0420) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.23% (0.0438 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.23% (0.0439 => 0.0438, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0432 => 0.0432, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.23% (0.0433 => 0.0432, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0422 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.24% (0.0424 => 0.0423, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0429 => 0.0429) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.23% (0.0430 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0440 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.06% (0.0457 => 0.0443, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.24% (0.0415 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.24% (0.0418 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0427 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.23% (0.0430 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.24% (0.0420 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.47% (0.0422 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.24% (0.0411 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0413 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.24% (0.0412 => 0.0411, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.49% (0.0412 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.22% (0.0447 => 0.0448, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0449 => 0.0449, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0409 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.49% (0.0411 => 0.0409, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0412 => 0.0412) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.48% (0.0414 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0419 => 0.0419) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.24% (0.0420 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.39% (1.2649 => 1.2600, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.14% (7.9700 => 7.9586, std.dev.: 0.0171) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.04% (0.7461 => 0.7464, std.dev.: 0.0057) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 1.42% (0.0352 => 0.0357, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 0.49% (0.1432 => 0.1439, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -10.04% (0.0717 => 0.0645, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -13.54% (63.2438 => 54.6784, std.dev.: 0.0729) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 33.95% (14.1553 => 18.9616, std.dev.: 0.0184) SingleSource/Benchmarks/Misc-C++-EH/spirit: 64.18% (3.4629 => 5.6855, std.dev.: 0.0019) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14225.69% (0.0720 => 10.3145, std.dev.: 0.0136) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9972900.00% (0.0001 => 9.9730, std.dev.: 0.0012) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 59.71% (0.2554 => 0.4079, std.dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: 45.51% (10.3673 => 15.0852, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/richards_benchmark: 36.13% (0.1622 => 0.2208, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/distray/distray: 33.05% (0.1056 => 0.1405, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.43% (2.2022 => 2.5861, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 17.39% (0.1432 => 0.1681, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 16.88% (7.0540 => 8.2450, std.dev.: 0.0134) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.39% (0.1566 => 0.1807, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.06% (1.7609 => 1.9909, std.dev.: 0.0087) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.97% (0.0871 => 0.0984, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 12.74% (0.3282 => 0.3700, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.35% (0.0834 => 0.0937, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 12.22% (0.1440 => 0.1616, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.81% (0.1584 => 0.1771, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 10.79% (0.7433 => 0.8235, std.dev.: 0.0042) MultiSource/Applications/minisat/minisat: 10.74% (0.7115 => 0.7879, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.41% (0.6675 => 0.7370, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.39% (0.3473 => 0.3834, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.31% (0.3927 => 0.4332, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.27% (0.3543 => 0.3907, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 10.21% (0.1175 => 0.1295, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.21% (0.3516 => 0.3875, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.21% (0.3497 => 0.3854, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.17% (0.3561 => 0.3923, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions: 10.16% (0.3828 => 0.4217, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.15% (0.1438 => 0.1584, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 10.14% (9.4845 => 10.4458, std.dev.: 0.0070) SingleSource/UnitTests/ObjC/exceptions-4: 10.13% (0.3543 => 0.3902, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.07% (0.2700 => 0.2972, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.03% (0.1625 => 0.1788, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 10.03% (0.1655 => 0.1821, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 9.99% (0.3694 => 0.4063, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.98% (0.3177 => 0.3494, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 9.91% (0.3886 => 0.4271, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 9.86% (10.4361 => 11.4656, std.dev.: 0.0238) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.86% (0.4879 => 0.5360, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 9.82% (5.7591 => 6.3246, std.dev.: 0.0038) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.80% (0.1143 => 0.1255, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.78% (1.5415 => 1.6923, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/em3d/em3d: 9.73% (0.1695 => 0.1860, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 9.72% (3.3354 => 3.6597, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/18-imp/imp: 9.70% (0.3423 => 0.3755, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.62% (0.4615 => 0.5059, std.dev.: 0.0022) MultiSource/Applications/sgefa/sgefa: 9.52% (0.3109 => 0.3405, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.46% (0.5105 => 0.5588, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.30% (0.1236 => 0.1351, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.23% (0.5569 => 0.6083, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.23% (0.1940 => 0.2119, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.22% (0.5860 => 0.6400, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.21% (4.2646 => 4.6575, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.16% (0.2271 => 0.2479, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.16% (1.3050 => 1.4245, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.15% (0.8172 => 0.8920, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.07% (0.1510 => 0.1647, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 9.07% (0.1555 => 0.1696, std.dev.: 0.0039) MultiSource/Applications/Burg/burg: 9.05% (1.1642 => 1.2696, std.dev.: 0.0084) MultiSource/Benchmarks/Olden/mst/mst: 9.03% (0.1163 => 0.1268, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.02% (0.8067 => 0.8795, std.dev.: 0.0109) MultiSource/Applications/lua/lua: 9.02% (3.8723 => 4.2216, std.dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.98% (0.3307 => 0.3604, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 8.97% (0.6456 => 0.7035, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 8.95% (0.1151 => 0.1254, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.91% (0.2065 => 0.2249, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.78% (0.2107 => 0.2292, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.74% (0.2758 => 0.2999, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.73% (8.1363 => 8.8465, std.dev.: 0.0164) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.69% (5.0018 => 5.4366, std.dev.: 0.0132) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.68% (0.3121 => 0.3392, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.67% (0.5020 => 0.5455, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 8.62% (0.7835 => 0.8510, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.61% (4.9449 => 5.3708, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.53% (0.1337 => 0.1451, std.dev.: 0.0022) MultiSource/Applications/hbd/hbd: 8.52% (1.5603 => 1.6932, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.51% (0.9765 => 1.0596, std.dev.: 0.0100) MultiSource/Applications/treecc/treecc: 8.48% (2.0273 => 2.1992, std.dev.: 0.0033) MultiSource/Benchmarks/sim/sim: 8.44% (0.3387 => 0.3673, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 8.40% (1.0722 => 1.1623, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.18% (1.5859 => 1.7157, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 8.15% (2.2969 => 2.4841, std.dev.: 0.0053) SingleSource/UnitTests/ObjC++/property-reference-object: 8.09% (0.6030 => 0.6518, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.05% (0.5925 => 0.6402, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 8.02% (0.3180 => 0.3435, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 7.97% (0.1268 => 0.1369, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.94% (0.3865 => 0.4172, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.94% (7.9617 => 8.5935, std.dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.87% (0.4103 => 0.4426, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.82% (0.3441 => 0.3710, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.73% (0.4203 => 0.4528, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.69% (0.4289 => 0.4619, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.60% (1.1861 => 1.2763, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 7.55% (0.4620 => 0.4969, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.51% (2.2024 => 2.3679, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/05-eks/eks: 7.40% (0.4299 => 0.4617, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 7.34% (0.7326 => 0.7864, std.dev.: 0.0099) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.30% (0.2603 => 0.2793, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.26% (0.6450 => 0.6918, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/moments: 7.21% (0.4048 => 0.4340, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 7.18% (21.9371 => 23.5122, std.dev.: 0.0207) SingleSource/Benchmarks/Shootout-C++/sieve: 7.16% (0.3603 => 0.3861, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.07% (0.3650 => 0.3908, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 7.04% (0.8921 => 0.9549, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.98% (0.3826 => 0.4093, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.96% (0.1695 => 0.1813, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: 6.90% (0.1463 => 0.1564, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.87% (0.5981 => 0.6392, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.87% (1.4186 => 1.5160, std.dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.82% (0.4636 => 0.4952, std.dev.: 0.0022) SingleSource/Regression/C++/ofstream_ctor: 6.75% (0.2905 => 0.3101, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 6.73% (0.3684 => 0.3932, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.66% (0.1892 => 0.2018, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.64% (0.2891 => 0.3083, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.62% (0.2872 => 0.3062, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.60% (0.3136 => 0.3343, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.58% (0.3283 => 0.3499, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.57% (0.2831 => 0.3017, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.48% (0.3162 => 0.3367, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.40% (0.3232 => 0.3439, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.39% (2.0665 => 2.1986, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.24% (0.2756 => 0.2928, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 6.23% (0.2871 => 0.3050, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 6.20% (1.1840 => 1.2574, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/matrix: 6.20% (0.3098 => 0.3290, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.19% (0.2877 => 0.3055, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/fibo: 6.17% (0.2725 => 0.2893, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 6.03% (0.3052 => 0.3236, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 6.01% (0.2714 => 0.2877, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/random: 5.96% (0.2802 => 0.2969, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.94% (0.2793 => 0.2959, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.93% (0.1906 => 0.2019, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.86% (0.4064 => 0.4302, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.69% (0.2266 => 0.2395, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 5.62% (0.3379 => 0.3569, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.58% (0.8101 => 0.8553, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/ReedSolomon: 5.22% (0.2049 => 0.2156, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.86% (14.3668 => 15.0655, std.dev.: 0.0217) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.81% (0.3427 => 0.3592, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.77% (1.2842 => 1.3454, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: 4.71% (17.1811 => 17.9900, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/objinst: 4.50% (0.3131 => 0.3272, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.36% (0.2430 => 0.2536, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.04% (3.8922 => 4.0493, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.35% (1.1194 => 1.1569, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.80% (0.3817 => 0.3924, std.dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.20% (1.1145 => 1.3842, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.74% (2.6778 => 2.9653, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 10.04% (1.1396 => 1.2540, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 9.21% (3.1595 => 3.4506, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3684, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.34% (3.6395 => 3.7612, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.72% (4.2280 => 4.3431, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.72% (0.8275 => 0.8417, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.35% (11.6436 => 11.8005, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.21% (2.6546 => 2.6867, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.07% (6.5088 => 6.5785, std.dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1311, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -80.27% (0.8651 => 0.1707, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.02% (5.2763 => 3.2704, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.75% (5.3855 => 3.6758, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.38% (5.3526 => 3.6727, std.dev.: 0.0033) SingleSource/UnitTests/Vector/constpool: -14.71% (54.1659 => 46.1957, std.dev.: 0.0083) MultiSource/Applications/ClamAV/clamscan: -12.24% (22.1758 => 19.4609, std.dev.: 0.0561) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.32% (2.9384 => 2.6351, std.dev.: 0.0093) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7653, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4243, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.13% (0.0998 => 0.0857, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -11.74% (1.2373 => 1.0921, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/mandel-2: -10.28% (1.5373 => 1.3792, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/mason/mason: -10.09% (0.2161 => 0.1943, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.34% (19.9488 => 18.2843, std.dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.68% (1.8329 => 1.7105, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5757, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.31% (1.6805 => 1.5913, std.dev.: 0.0021) MultiSource/Benchmarks/sim/sim: -4.98% (5.0483 => 4.7967, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5071, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.79% (1.5660 => 1.4910, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.98% (0.9957 => 0.9561, std.dev.: 0.0115) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.59% (3.2827 => 3.1650, std.dev.: 0.0074) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5032, std.dev.: 0.0059) MultiSource/Applications/hexxagon/hexxagon: -3.01% (12.4730 => 12.0979, std.dev.: 0.0018) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.10% (8.1563 => 7.9852, std.dev.: 0.0178) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.09% (8.6802 => 8.4989, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0852, std.dev.: 0.0181) SingleSource/Regression/C/uint64_to_float: -1.88% (0.5413 => 0.5311) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6796, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: -1.68% (4.6441 => 4.5662, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.51% (2.5528 => 2.5142, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4209, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/lists: -1.13% (6.2999 => 6.2287, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2879, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 14.08% (0.5229 => 0.5965, std.dev.: 0.0051) MultiSource/Applications/SPASS/SPASS: 9.83% (14.9895 => 16.4626, std.dev.: 0.0187) MultiSource/Benchmarks/MallocBench/gs/gs: 8.38% (4.1105 => 4.4548, std.dev.: 0.0107) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.05% (1.1048 => 1.2600, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.18% (7.1582 => 7.9586, std.dev.: 0.0171) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.96% (0.6222 => 0.7464, std.dev.: 0.0057) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35600.00% (0.0001 => 0.0357, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -3.10% (0.1485 => 0.1439, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.52% (0.2116 => 0.0645, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 16 08:28:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 16 Oct 2012 10:28:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121016152806.6FC322A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4903?compare_to=4902&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4903, Order: 166022, Start Time: 2012-10-16 14:10:10, End Time: 2012-10-16 15:30:00 To: 4902, Order: 166019, Start Time: 2012-10-16 08:07:34, End Time: 2012-10-16 09:27:37 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (158 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 951 (686 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.40% (15.0852 => 15.2961, std.dev.: 0.0094) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.86% (54.9272 => 56.4979, std.dev.: 0.1667) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.18% (0.5965 => 0.5954, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: -0.18% (16.4626 => 16.4332, std.dev.: 0.0030) MultiSource/Benchmarks/Bullet/bullet: -0.16% (54.6784 => 54.5922, std.dev.: 0.0184) MultiSource/Benchmarks/MallocBench/gs/gs: -0.27% (4.4548 => 4.4429, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.21% (0.0467 => 0.0466, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.43% (0.0469 => 0.0471, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.69% (0.0437 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.23% (0.0437 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.70% (0.0426 => 0.0423, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.70% (0.0428 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.72% (0.0419 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.48% (0.0420 => 0.0418, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.69% (0.0437 => 0.0434, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.23% (0.0438 => 0.0437, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.46% (0.0432 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.23% (0.0432 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.71% (0.0422 => 0.0419, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.47% (0.0423 => 0.0421, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.47% (0.0429 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.23% (0.0429 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.45% (0.0440 => 0.0438, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.68% (0.0443 => 0.0440, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.24% (0.0416 => 0.0415, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.24% (0.0417 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0427 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.23% (0.0429 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.24% (0.0419 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.24% (0.0420 => 0.0419, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.73% (0.0412 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.48% (0.0413 => 0.0411, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.49% (0.0411 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.24% (0.0410 => 0.0409, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.67% (0.0448 => 0.0445, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.67% (0.0449 => 0.0446, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.49% (0.0409 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0409 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.49% (0.0412 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.24% (0.0412 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.48% (0.0419 => 0.0417, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.24% (0.0419 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.25% (1.2600 => 1.2568, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.14% (7.9586 => 7.9472, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.05% (0.7464 => 0.7460, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.28% (0.0357 => 0.0358, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1439 => 0.1440) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0645 => 0.0645, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -13.68% (63.2438 => 54.5922, std.dev.: 0.0184) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 33.79% (14.1553 => 18.9382, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++-EH/spirit: 64.11% (3.4629 => 5.6831, std.dev.: 0.0104) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14231.94% (0.0720 => 10.3190, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9973000.00% (0.0001 => 9.9731, std.dev.: 0.0023) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 59.20% (0.2554 => 0.4066, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 47.54% (10.3673 => 15.2961, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/richards_benchmark: 36.44% (0.1622 => 0.2213, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/distray/distray: 32.86% (0.1056 => 0.1403, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.40% (2.2022 => 2.5854, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 17.39% (0.1432 => 0.1681, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.14% (7.0540 => 8.2632, std.dev.: 0.0129) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.07% (0.1566 => 0.1802, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.86% (0.0871 => 0.0983) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.77% (1.7609 => 1.9858, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 12.71% (0.3282 => 0.3699, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 11.81% (0.1440 => 0.1610, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.49% (0.1584 => 0.1766, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 10.47% (0.7115 => 0.7860, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 10.44% (0.7433 => 0.8209, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.15% (0.1438 => 0.1584, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 10.14% (0.3473 => 0.3825, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 10.13% (0.1175 => 0.1294, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.10% (0.3543 => 0.3901, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.10% (0.6675 => 0.7349, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 10.00% (0.3561 => 0.3917, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.98% (0.3927 => 0.4319, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.97% (0.1625 => 0.1787, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.96% (0.3543 => 0.3896, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 9.95% (0.3497 => 0.3845, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.90% (0.3516 => 0.3864, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 9.85% (9.4845 => 10.4189, std.dev.: 0.0134) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.85% (0.2700 => 0.2966, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 9.80% (0.3828 => 0.4203, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 9.76% (10.4361 => 11.4548, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.76% (0.4879 => 0.5355, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 9.75% (0.3694 => 0.4054, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.70% (0.3886 => 0.4263, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.69% (0.3177 => 0.3485, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 9.62% (0.3109 => 0.3408, std.dev.: 0.0034) SingleSource/Benchmarks/McGill/chomp: 9.61% (0.1655 => 0.1814, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.60% (1.5415 => 1.6895, std.dev.: 0.0055) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.54% (0.1143 => 0.1252, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 9.49% (0.3423 => 0.3748, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 9.49% (3.3354 => 3.6519, std.dev.: 0.0195) MultiSource/Benchmarks/Olden/em3d/em3d: 9.44% (0.1695 => 0.1855, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.32% (0.5105 => 0.5581, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.30% (0.4615 => 0.5044, std.dev.: 0.0022) MultiSource/Applications/viterbi/viterbi: 9.26% (0.1555 => 0.1699, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.22% (0.1236 => 0.1350, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 9.18% (5.7591 => 6.2875, std.dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.06% (0.5860 => 0.6391, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.97% (0.1940 => 0.2114, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.96% (1.3050 => 1.4219, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.93% (4.2646 => 4.6454, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.91% (0.5569 => 0.6065, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 8.89% (0.6456 => 0.7030, std.dev.: 0.0055) MultiSource/Applications/aha/aha: 8.86% (0.1151 => 0.1253, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.83% (0.3307 => 0.3599, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 8.82% (1.1642 => 1.2669, std.dev.: 0.0074) MultiSource/Applications/lua/lua: 8.82% (3.8723 => 4.2138, std.dev.: 0.0241) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.81% (0.1510 => 0.1643, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.81% (0.2271 => 0.2471, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.75% (0.8067 => 0.8773, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 8.68% (0.1163 => 0.1264, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.56% (8.1363 => 8.8328, std.dev.: 0.0065) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.55% (0.8172 => 0.8871, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.55% (4.9449 => 5.3677, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.52% (0.2065 => 0.2241, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.52% (0.2758 => 0.2993, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.50% (0.2107 => 0.2286, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.49% (0.3121 => 0.3386, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.46% (5.0018 => 5.4252, std.dev.: 0.0078) MultiSource/Applications/hbd/hbd: 8.43% (1.5603 => 1.6919, std.dev.: 0.0021) MultiSource/Benchmarks/sim/sim: 8.41% (0.3387 => 0.3672, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 8.40% (0.7835 => 0.8493, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.39% (0.5020 => 0.5441, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.32% (0.9765 => 1.0577, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.30% (0.1337 => 0.1448, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 8.24% (1.0722 => 1.1605, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 8.22% (2.0273 => 2.1940, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.15% (1.5859 => 1.7152, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.99% (0.4103 => 0.4431, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.94% (0.3865 => 0.4172, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.91% (0.6030 => 0.6507, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 7.85% (2.2969 => 2.4772, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/Hello: 7.80% (0.5925 => 0.6387, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.78% (0.4203 => 0.4530, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 7.74% (0.3180 => 0.3426, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 7.69% (0.4289 => 0.4619, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.64% (7.9617 => 8.5702, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.59% (0.3441 => 0.3702, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 7.54% (0.3422 => 0.3680, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 7.42% (0.4620 => 0.4963, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 7.41% (0.4048 => 0.4348, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.41% (1.1861 => 1.2740, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.40% (2.2024 => 2.3653, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference: 7.29% (0.7326 => 0.7860, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 7.24% (0.3603 => 0.3864, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.15% (0.2603 => 0.2789, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.08% (0.4636 => 0.4964, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.04% (0.3650 => 0.3907, std.dev.: 0.0034) MultiSource/Applications/JM/lencod/lencod: 6.99% (21.9371 => 23.4699, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.90% (0.1695 => 0.1812, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.90% (0.3826 => 0.4090, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.90% (0.6450 => 0.6895, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 6.87% (0.8921 => 0.9534, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/05-eks/eks: 6.86% (0.4299 => 0.4594, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.78% (0.2891 => 0.3087, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/lists1: 6.76% (0.3684 => 0.3933, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 6.75% (0.2905 => 0.3101, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.70% (0.5981 => 0.6382, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.66% (0.3136 => 0.3345, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.61% (0.2831 => 0.3018, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.55% (2.0665 => 2.2018, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary: 6.50% (0.3232 => 0.3442, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.49% (0.3283 => 0.3496, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.45% (0.3162 => 0.3366, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.39% (1.4186 => 1.5092, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.35% (0.2756 => 0.2931, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.35% (0.2725 => 0.2898, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.30% (0.2872 => 0.3053, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/except: 6.23% (0.2871 => 0.3050, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.23% (0.3098 => 0.3291, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 6.13% (0.3052 => 0.3239, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.12% (0.2877 => 0.3053, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.07% (0.2802 => 0.2972, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.05% (0.2793 => 0.2962, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.04% (0.2714 => 0.2878, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 5.99% (1.1840 => 1.2549, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 5.83% (0.3379 => 0.3576, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.78% (0.4064 => 0.4299, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.67% (0.1906 => 0.2014, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.60% (0.2266 => 0.2393, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.55% (0.1892 => 0.1997, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.43% (0.8101 => 0.8541, std.dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 4.82% (1.2842 => 1.3461, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.63% (0.3131 => 0.3276, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 4.59% (17.1811 => 17.9703, std.dev.: 0.0160) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.58% (14.3668 => 15.0254, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.38% (0.3427 => 0.3577, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (3.8922 => 4.0461, std.dev.: 0.0154) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.43% (1.1194 => 1.1578, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.94% (1.1396 => 1.2529, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0016) MultiSource/Applications/aha/aha: 9.21% (3.1595 => 3.4505, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.1578 => 3.3687, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.52% (3.6395 => 3.7676, std.dev.: 0.0076) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.87% (4.2280 => 4.3493, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7652, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.69% (0.8275 => 0.8415, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.35% (11.6436 => 11.8006, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.34% (2.6546 => 2.6901, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1310, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.06% (5.2763 => 3.2683, std.dev.: 0.0150) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.73% (5.3855 => 3.6768, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.37% (5.3526 => 3.6734, std.dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -14.70% (54.1659 => 46.2040, std.dev.: 0.0269) MultiSource/Applications/ClamAV/clamscan: -12.22% (22.1758 => 19.4655, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.40% (2.9384 => 2.6329, std.dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.43% (1.1492 => 0.7650, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.87% (1.6925 => 1.4239, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.53% (0.0998 => 0.0863, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.23% (1.2373 => 1.0983, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel-2: -10.32% (1.5373 => 1.3787, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/mason/mason: -10.04% (0.2161 => 0.1944, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.49% (19.9488 => 18.2552, std.dev.: 0.0191) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.84% (1.8329 => 1.7075, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.34% (1.6805 => 1.5908, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: -4.98% (1.5835 => 1.5047, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.32% (0.9957 => 0.9527, std.dev.: 0.0090) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0010) MultiSource/Applications/siod/siod: -3.64% (3.2827 => 3.1631, std.dev.: 0.0086) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5009, std.dev.: 0.0092) MultiSource/Applications/hexxagon/hexxagon: -3.03% (12.4730 => 12.0945, std.dev.: 0.0040) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.08% (8.6802 => 8.4996, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.98% (8.1563 => 7.9952, std.dev.: 0.0093) SingleSource/Regression/C/uint64_to_float: -1.88% (0.5413 => 0.5311, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: -1.80% (4.6441 => 4.5603, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6784, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/salsa20: -1.75% (10.2830 => 10.1031, std.dev.: 0.0111) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -1.49% (2.5528 => 2.5147, std.dev.: 0.0037) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4216, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.12% (2.3135 => 2.2877, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.86% (0.5229 => 0.5954, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 9.63% (14.9895 => 16.4332, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/gs/gs: 8.09% (4.1105 => 4.4429, std.dev.: 0.0176) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.76% (1.1048 => 1.2568, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.02% (7.1582 => 7.9472, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.90% (0.6222 => 0.7460, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35700.00% (0.0001 => 0.0358, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -3.03% (0.1485 => 0.1440) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.52% (0.2116 => 0.0645, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 16 08:33:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 16 Oct 2012 10:33:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121016153356.872C82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4904?compare_to=4901&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4904, Order: 166022, Start Time: 2012-10-16 14:11:10, End Time: 2012-10-16 15:36:51 To: 4901, Order: 166019, Start Time: 2012-10-16 07:59:11, End Time: 2012-10-16 09:25:16 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (190 on baseline) Performance Improvements: 2 (38 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1040 (676 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.29% (3.8445 => 3.7563, std.dev.: 0.0103) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.28% (0.9661 => 0.9537, std.dev.: 0.0040) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.17% (2.0176 => 2.5053, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.72% (0.1410 => 0.1674, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 17.92% (0.0826 => 0.0974, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 17.30% (0.2243 => 0.2631, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.00% (0.0653 => 0.0764, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.11% (0.1072 => 0.1234, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.77% (0.0819 => 0.0940, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 14.61% (0.1013 => 0.1161, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.27% (0.0834 => 0.0953, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.66% (0.1413 => 0.1606, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.49% (0.1327 => 0.1506, std.dev.: 0.0055) MultiSource/Applications/lambda-0_1_3/lambda: 13.40% (0.7038 => 0.7981, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 13.37% (1.3693 => 1.5524, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.28% (0.0964 => 0.1092, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.22% (0.1588 => 0.1798, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.15% (3.9660 => 4.4874, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.90% (0.2596 => 0.2931, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 12.87% (0.4328 => 0.4885, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.79% (0.2721 => 0.3069, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/distray/distray: 12.71% (0.0818 => 0.0922, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.63% (1.4563 => 1.6402, std.dev.: 0.0133) MultiSource/Applications/SPASS/SPASS: 12.61% (13.8202 => 15.5623, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.61% (0.6283 => 0.7075, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.54% (0.6959 => 0.7832, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.39% (0.7710 => 0.8665, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.38% (1.2193 => 1.3703, std.dev.: 0.0014) MultiSource/Applications/aha/aha: 12.34% (0.1062 => 0.1193, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.23% (0.5265 => 0.5909, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: 12.16% (0.1003 => 0.1125, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.14% (0.9199 => 1.0316, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 12.09% (0.4062 => 0.4553) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.08% (1.1364 => 1.2737, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.84% (0.1157 => 0.1294, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 11.77% (0.5818 => 0.6503, std.dev.: 0.0029) MultiSource/Applications/lemon/lemon: 11.70% (1.0313 => 1.1520, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.70% (0.3899 => 0.4355, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.53% (0.3130 => 0.3491, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.50% (0.4791 => 0.5342, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 11.50% (0.5748 => 0.6409, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 11.49% (1.1061 => 1.2332, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 11.45% (0.1589 => 0.1771, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.28% (0.3485 => 0.3878, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.26% (0.5577 => 0.6205, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.16% (0.3756 => 0.4175, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 11.13% (0.7061 => 0.7847, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 11.11% (0.2781 => 0.3090, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.11% (0.4016 => 0.4462, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 11.07% (0.1075 => 0.1194, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 10.98% (0.2995 => 0.3324, std.dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 10.89% (16.6129 => 18.4222, std.dev.: 0.0090) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.87% (0.4379 => 0.4855, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 10.87% (0.6744 => 0.7477, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.85% (0.0977 => 0.1083, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.78% (0.3489 => 0.3865, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.72% (0.3022 => 0.3346, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 10.72% (0.3293 => 0.3646, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.69% (0.8698 => 0.9628, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 10.68% (2.1791 => 2.4118, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/strcat: 10.67% (0.2726 => 0.3017, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.67% (0.2127 => 0.2354, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.66% (0.3246 => 0.3592, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.64% (0.3580 => 0.3961, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 10.62% (0.1111 => 0.1229, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.60% (0.2914 => 0.3223, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 10.60% (0.3868 => 0.4278, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 10.59% (0.3220 => 0.3561, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.57% (0.2782 => 0.3076, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.55% (0.1014 => 0.1121, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 10.55% (3.8646 => 4.2723, std.dev.: 0.0055) MultiSource/Applications/treecc/treecc: 10.52% (1.9270 => 2.1298, std.dev.: 0.0117) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.52% (0.1435 => 0.1586, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 10.51% (0.3453 => 0.3816, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.50% (0.1276 => 0.1410, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 10.50% (3.1889 => 3.5237, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 10.49% (0.1478 => 0.1633, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 10.43% (0.2760 => 0.3048, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 10.43% (0.8310 => 0.9177, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.39% (0.1569 => 0.1732, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 10.38% (0.3149 => 0.3476, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 10.37% (0.7506 => 0.8284, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.34% (1.9828 => 2.1879, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.27% (0.4390 => 0.4841, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.27% (0.1986 => 0.2190, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 10.27% (0.3534 => 0.3897, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.24% (0.7460 => 0.8224, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.24% (0.1865 => 0.2056, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.23% (0.2023 => 0.2230, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.22% (0.2966 => 0.3269, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 10.19% (0.2925 => 0.3223, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.16% (0.5637 => 0.6210, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.16% (0.2765 => 0.3046, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 10.14% (0.3107 => 0.3422, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/random: 10.11% (0.2690 => 0.2962, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.10% (0.6576 => 0.7240, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 10.09% (0.2607 => 0.2870, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 10.08% (0.2937 => 0.3233, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.06% (0.2655 => 0.2922, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.06% (7.2180 => 7.9438, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/matrix: 10.04% (0.2988 => 0.3288, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 10.00% (0.2761 => 0.3037, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 9.93% (0.2628 => 0.2889, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.85% (0.3755 => 0.4125, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.85% (4.9865 => 5.4775, std.dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/ary2: 9.84% (0.3192 => 0.3506, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 9.78% (1.0594 => 1.1630, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.68% (0.2696 => 0.2957, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 9.60% (0.1657 => 0.1816, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 9.49% (0.3131 => 0.3428, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.47% (3.6692 => 4.0165, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.45% (1.3245 => 1.4496, std.dev.: 0.0027) MultiSource/Applications/SIBsim4/SIBsim4: 9.39% (1.2749 => 1.3946, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.35% (4.3801 => 4.7898, std.dev.: 0.0065) MultiSource/Applications/JM/lencod/lencod: 9.33% (14.8535 => 16.2393, std.dev.: 0.0114) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.27% (4.4433 => 4.8554, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/objinst: 9.10% (0.2945 => 0.3213, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 9.02% (8.4961 => 9.2626, std.dev.: 0.0150) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.94% (0.3511 => 0.3825, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.91% (1.5188 => 1.6541, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.83% (0.2140 => 0.2329, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.82% (0.6135 => 0.6676, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 8.81% (4.6629 => 5.0737, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.67% (0.9108 => 0.9898, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.66% (0.1789 => 0.1944, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.66% (0.2321 => 0.2522, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 8.66% (0.4113 => 0.4469, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.61% (0.8818 => 0.9577, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 8.54% (0.6250 => 0.6784, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.51% (0.4805 => 0.5214, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.50% (3.2742 => 3.5525, std.dev.: 0.0116) MultiSource/Benchmarks/Olden/health/health: 8.49% (0.1213 => 0.1316, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.47% (0.1819 => 0.1973, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.40% (1.1333 => 1.2285, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 8.20% (3.7467 => 4.0541, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1385 => 0.1498, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 8.11% (6.5754 => 7.1087, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.10% (0.3245 => 0.3508, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.06% (2.1007 => 2.2700, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/oourafft: 8.02% (0.2008 => 0.2169, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.91% (0.2504 => 0.2702, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 7.84% (0.4003 => 0.4317, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.58% (6.2785 => 6.7544, std.dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 7.52% (1.2292 => 1.3216, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.51% (0.3940 => 0.4236, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.46% (0.3914 => 0.4206, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.41% (0.3578 => 0.3843, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.31% (0.3789 => 0.4066, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.25% (13.2842 => 14.2479, std.dev.: 0.0153) SingleSource/UnitTests/ObjC/exceptions-2: 7.25% (0.3601 => 0.3862, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 7.24% (0.3646 => 0.3910, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.18% (0.3650 => 0.3912, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 7.13% (0.3663 => 0.3924, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.98% (0.3623 => 0.3876, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 5.91% (0.1777 => 0.1882, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 5.79% (16.2614 => 17.2031, std.dev.: 0.0246) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.62% (0.2243 => 0.2369, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 4.77% (14.5298 => 15.2234, std.dev.: 0.0160) MultiSource/Benchmarks/Olden/bh/bh: 3.74% (0.2859 => 0.2966, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 2.27% (33.2944 => 34.0511, std.dev.: 0.0173) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5170, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.04% (1.0895 => 1.3623, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 24.49% (1.8175 => 2.2626, std.dev.: 0.0527) SingleSource/Benchmarks/Misc/richards_benchmark: 11.15% (1.1560 => 1.2849, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.70% (0.1322 => 0.1437, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4144, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.13% (1.2998 => 1.3795, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.64% (1.9144 => 2.0033, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.93% (11.2619 => 11.7048, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 3.46% (10.7476 => 11.1194, std.dev.: 0.0416) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9857, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.12% (7.4271 => 7.5849, std.dev.: 0.0030) MultiSource/Applications/lemon/lemon: 1.66% (1.4298 => 1.4535, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5134, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.42% (1.9433 => 1.9708, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1872, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5784, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 1.09% (12.4560 => 12.5920, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.44% (0.2670 => 0.1430, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.83% (0.4657 => 0.3920, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.86% (1.3813 => 1.2037, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.77% (1.3819 => 1.2054, std.dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.11% (0.2238 => 0.1967, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -11.36% (1.2308 => 1.0910, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.17% (20.3410 => 18.2733, std.dev.: 0.0189) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.78% (1.3780 => 1.2983, std.dev.: 0.0096) SingleSource/Benchmarks/Dhrystone/dry: -5.38% (2.5089 => 2.3740, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5144, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.59% (0.9996 => 0.9537, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1562, std.dev.: 0.0117) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.42% (1.7688 => 1.7083, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.04% (0.4867 => 0.4719, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -2.60% (26.5159 => 25.8255, std.dev.: 0.0233) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: -2.53% (0.5449 => 0.5311, std.dev.: 0.0025) MultiSource/Applications/spiff/spiff: -2.44% (3.0263 => 2.9524, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: -2.42% (1.9762 => 1.9284, std.dev.: 0.0036) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.93% (0.6589 => 0.6462, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.87% (6.3560 => 6.2370, std.dev.: 0.0065) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7147, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0079, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.27% (0.8342 => 0.8236, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.23% (3.9173 => 3.8691, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.14% (2.5254 => 2.4966, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2570, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 16 10:17:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 16 Oct 2012 12:17:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121016171715.BD4BB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4905?compare_to=4903&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4905, Order: 166023, Start Time: 2012-10-16 15:59:22, End Time: 2012-10-16 17:19:10 To: 4903, Order: 166022, Start Time: 2012-10-16 14:10:10, End Time: 2012-10-16 15:30:00 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (160 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 952 (681 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 1.92% (2.2839 => 2.3277, std.dev.: 0.0125) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.10% (0.5954 => 0.5948, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: -0.15% (16.4332 => 16.4089, std.dev.: 0.0184) MultiSource/Benchmarks/Bullet/bullet: 0.26% (54.5922 => 54.7329, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/gs/gs: -0.10% (4.4429 => 4.4385, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.21% (0.0466 => 0.0465, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.27% (0.0471 => 0.0465, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0434 => 0.0434) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0436 => 0.0436) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.24% (0.0423 => 0.0422, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.24% (0.0425 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.24% (0.0416 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0418 => 0.0418, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.23% (0.0434 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.46% (0.0437 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.23% (0.0430 => 0.0429) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.23% (0.0431 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0419 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.48% (0.0421 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.23% (0.0427 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.23% (0.0428 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.23% (0.0438 => 0.0437, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.23% (0.0440 => 0.0439, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.24% (0.0415 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.24% (0.0416 => 0.0415) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.47% (0.0427 => 0.0425, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.23% (0.0428 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.48% (0.0418 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.24% (0.0419 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.24% (0.0409 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.24% (0.0411 => 0.0410, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.24% (0.0409 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0409 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.22% (0.0445 => 0.0444, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.22% (0.0446 => 0.0447, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.25% (0.0407 => 0.0406, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.24% (0.0409 => 0.0408, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.49% (0.0410 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.24% (0.0411 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.72% (0.0417 => 0.0414, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.48% (0.0418 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.06% (1.2568 => 1.2576, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.15% (7.9472 => 7.9592, std.dev.: 0.0140) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.27% (0.7460 => 0.7480, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.84% (0.0358 => 0.0355, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1440 => 0.1439, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0645 => 0.0645, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -13.46% (63.2438 => 54.7329, std.dev.: 0.0029) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 33.88% (14.1553 => 18.9506, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++-EH/spirit: 64.29% (3.4629 => 5.6893, std.dev.: 0.0176) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14227.08% (0.0720 => 10.3155, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9973100.00% (0.0001 => 9.9732, std.dev.: 0.0014) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 59.16% (0.2554 => 0.4065, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 48.20% (10.3673 => 15.3641, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/richards_benchmark: 36.13% (0.1622 => 0.2208, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 32.77% (0.1056 => 0.1402, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.38% (2.2022 => 2.5850, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 17.32% (0.1432 => 0.1680, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.30% (7.0540 => 8.2744, std.dev.: 0.0085) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.94% (0.1566 => 0.1800, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.97% (0.0871 => 0.0984, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.73% (1.7609 => 1.9851, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 12.28% (0.3282 => 0.3685, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: 11.94% (0.1440 => 0.1612, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.49% (0.1584 => 0.1766, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 10.60% (0.7115 => 0.7869, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 10.55% (0.7433 => 0.8217, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.38% (0.6675 => 0.7368, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.38% (0.4615 => 0.5094, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/trivial-interface: 10.28% (0.3473 => 0.3830, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.26% (0.3927 => 0.4330, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.25% (0.3543 => 0.3906, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.21% (0.3497 => 0.3854, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.16% (0.3543 => 0.3903, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.08% (0.3561 => 0.3920, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.07% (0.3516 => 0.3870, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.06% (0.3828 => 0.4213, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 10.04% (0.1175 => 0.1293, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.94% (0.3694 => 0.4061, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 9.91% (10.4361 => 11.4702, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.91% (0.1625 => 0.1786, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 9.91% (0.3886 => 0.4271, std.dev.: 0.0061) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.89% (0.1143 => 0.1256, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.87% (0.1438 => 0.1580, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.85% (0.2700 => 0.2966, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 9.81% (9.4845 => 10.4152, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.79% (0.3177 => 0.3488, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.78% (0.4879 => 0.5356, std.dev.: 0.0023) MultiSource/Applications/d/make_dparser: 9.65% (3.3354 => 3.6574, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/em3d/em3d: 9.56% (0.1695 => 0.1857, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: 9.55% (0.1655 => 0.1813, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.54% (0.2758 => 0.3021, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 9.49% (0.3423 => 0.3748, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.43% (1.5415 => 1.6868, std.dev.: 0.0057) MultiSource/Applications/oggenc/oggenc: 9.41% (5.7591 => 6.3012, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.29% (0.5105 => 0.5579, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 9.26% (0.3109 => 0.3397, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.18% (0.5860 => 0.6398, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.14% (0.1236 => 0.1349, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.14% (0.5569 => 0.6078, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.03% (4.2646 => 4.6496, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.03% (0.2271 => 0.2476, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 8.98% (0.6456 => 0.7036, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.98% (0.3307 => 0.3604, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.96% (0.8172 => 0.8904, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.93% (1.3050 => 1.4215, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.87% (0.1510 => 0.1644) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.87% (0.1940 => 0.2112, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.84% (0.3121 => 0.3397, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 8.84% (3.8723 => 4.2145, std.dev.: 0.0040) MultiSource/Applications/viterbi/viterbi: 8.81% (0.1555 => 0.1692, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 8.77% (0.1151 => 0.1252, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.77% (5.0018 => 5.4403, std.dev.: 0.0033) MultiSource/Applications/Burg/burg: 8.75% (1.1642 => 1.2661, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.75% (0.8067 => 0.8773, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.59% (0.2107 => 0.2288, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.57% (0.2065 => 0.2242, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.57% (8.1363 => 8.8332, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.50% (4.9449 => 5.3653, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.41% (0.5020 => 0.5442, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 8.39% (0.3387 => 0.3671, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 8.36% (0.7835 => 0.8490, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.32% (0.9765 => 1.0577, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: 8.31% (0.6030 => 0.6531, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 8.26% (1.5603 => 1.6892, std.dev.: 0.0045) MultiSource/Applications/lemon/lemon: 8.24% (1.0722 => 1.1606, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.24% (0.4103 => 0.4441, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.23% (0.1337 => 0.1447, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.20% (0.5925 => 0.6411, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.19% (1.5859 => 1.7158, std.dev.: 0.0175) MultiSource/Applications/treecc/treecc: 8.17% (2.0273 => 2.1929, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash: 8.09% (0.4289 => 0.4636, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.07% (0.3865 => 0.4177, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/lists: 7.89% (0.3422 => 0.3692, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.88% (0.4203 => 0.4534, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 7.84% (2.2969 => 2.4770, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 7.74% (0.3180 => 0.3426, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.65% (7.9617 => 8.5704, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.64% (0.3441 => 0.3704, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 7.63% (0.7326 => 0.7885, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (0.4620 => 0.4970, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.48% (1.1861 => 1.2748, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/sieve: 7.44% (0.3603 => 0.3871, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.41% (2.2024 => 2.3655, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 7.39% (0.4048 => 0.4347, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.21% (0.3650 => 0.3913, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.18% (0.2603 => 0.2790, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.02% (0.1695 => 0.1814, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.00% (0.3826 => 0.4094, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 6.99% (21.9371 => 23.4705, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/football/football: 6.98% (0.8921 => 0.9544, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.97% (0.4636 => 0.4959, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.95% (0.6450 => 0.6898, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists1: 6.92% (0.3684 => 0.3939, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.92% (0.2905 => 0.3106, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.85% (0.2891 => 0.3089, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.82% (0.2831 => 0.3024, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 6.79% (0.4299 => 0.4591, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 6.78% (0.3232 => 0.3451, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.74% (0.3162 => 0.3375, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.73% (0.3136 => 0.3347, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.67% (0.3283 => 0.3502, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.66% (2.0665 => 2.2042, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/fibo: 6.61% (0.2725 => 0.2905, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.57% (0.5981 => 0.6374, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.57% (0.2756 => 0.2937, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.51% (0.2872 => 0.3059, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.36% (0.3098 => 0.3295, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.34% (0.2871 => 0.3053, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.33% (1.4186 => 1.5084, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wc: 6.32% (0.3052 => 0.3245, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.26% (0.2877 => 0.3057, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 6.15% (0.2714 => 0.2881, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.12% (0.2793 => 0.2964, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.10% (0.2802 => 0.2973, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.01% (1.1840 => 1.2551, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.93% (0.4064 => 0.4305, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.87% (0.1892 => 0.2003, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.86% (0.3379 => 0.3577, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.72% (0.1906 => 0.2015, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.56% (0.2266 => 0.2392, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.31% (0.8101 => 0.8531, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 4.76% (1.2842 => 1.3453, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 4.73% (0.3131 => 0.3279, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 4.68% (17.1811 => 17.9860, std.dev.: 0.0173) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.63% (14.3668 => 15.0327, std.dev.: 0.0167) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.52% (0.3427 => 0.3582, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.08% (3.8922 => 4.0510, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.39% (1.1194 => 1.1574, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.62% (0.3817 => 0.3917, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 146.51% (5.3999 => 13.3115, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.20% (1.1145 => 1.3842, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.78% (1.1396 => 1.2510, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 9.21% (3.1595 => 3.4505, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3685, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.57% (3.6395 => 3.7694, std.dev.: 0.0029) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.83% (4.2280 => 4.3475, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7652, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 2.22% (2.2771 => 2.3277, std.dev.: 0.0125) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.72% (0.8275 => 0.8417, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.38% (0.9540 => 0.9672, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 1.35% (11.6436 => 11.8008, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.12% (2.6546 => 2.6842, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5751, std.dev.: 0.0071) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1309, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.22% (0.8651 => 0.1711, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.06% (5.2763 => 3.2680, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.71% (5.3855 => 3.6777, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.34% (5.3526 => 3.6753, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -14.69% (54.1659 => 46.2066, std.dev.: 0.0216) MultiSource/Benchmarks/FreeBench/mason/mason: -12.33% (0.0811 => 0.0711, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -12.29% (22.1758 => 19.4499, std.dev.: 0.0136) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.39% (2.9384 => 2.6330, std.dev.: 0.0188) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.47% (1.1492 => 0.7646, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: -15.74% (1.6925 => 1.4261, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.73% (0.0998 => 0.0861, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.26% (1.2373 => 1.0980, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: -10.35% (1.5373 => 1.3782, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/mason/mason: -9.81% (0.2161 => 0.1949, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.42% (19.9488 => 18.2687, std.dev.: 0.1083) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.64% (1.8329 => 1.7112, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0119) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.30% (1.6805 => 1.5914, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: -4.80% (1.5835 => 1.5075, std.dev.: 0.0017) MultiSource/Applications/siod/siod: -3.74% (3.2827 => 3.1599, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.61% (0.9957 => 0.9598, std.dev.: 0.0060) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5002, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: -3.04% (12.4730 => 12.0941, std.dev.: 0.0036) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.09% (8.6802 => 8.4990, std.dev.: 0.0191) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.96% (8.1563 => 7.9967, std.dev.: 0.0154) SingleSource/Regression/C/uint64_to_float: -1.90% (0.5413 => 0.5310, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -1.79% (4.6441 => 4.5611, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/salsa20: -1.74% (10.2830 => 10.1043, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6823, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.55% (2.5528 => 2.5133, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4207, std.dev.: 0.0192) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2879, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/lists: -1.09% (6.2999 => 6.2313, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8577, std.dev.: 0.0064) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.75% (0.5229 => 0.5948, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 9.47% (14.9895 => 16.4089, std.dev.: 0.0184) MultiSource/Benchmarks/MallocBench/gs/gs: 7.98% (4.1105 => 4.4385, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.83% (1.1048 => 1.2576, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.19% (7.1582 => 7.9592, std.dev.: 0.0140) SingleSource/Benchmarks/Misc-C++/stepanov_container: 20.22% (0.6222 => 0.7480, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35400.00% (0.0001 => 0.0355, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.10% (0.1485 => 0.1439, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.52% (0.2116 => 0.0645, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 16 10:28:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 16 Oct 2012 12:28:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121016172855.9EBF62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4906?compare_to=4904&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4906, Order: 166023, Start Time: 2012-10-16 16:05:57, End Time: 2012-10-16 17:31:51 To: 4904, Order: 166022, Start Time: 2012-10-16 14:11:10, End Time: 2012-10-16 15:36:51 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (187 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1041 (681 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.45% (41.4675 => 42.4837, std.dev.: 0.0217) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.06% (2.0176 => 2.5030, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.87% (0.1410 => 0.1676, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 17.80% (0.0826 => 0.0973, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 17.03% (0.2243 => 0.2625, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.00% (0.0653 => 0.0764, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.30% (0.1072 => 0.1236, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 14.31% (0.1013 => 0.1158, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.91% (0.0834 => 0.0950, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.72% (0.1327 => 0.1509, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.66% (0.1413 => 0.1606, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 13.30% (0.7038 => 0.7974, std.dev.: 0.0125) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.28% (0.0964 => 0.1092, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 13.19% (1.3693 => 1.5499, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.16% (0.1588 => 0.1797, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.06% (3.9660 => 4.4838, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.72% (0.2721 => 0.3067, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 12.68% (0.4328 => 0.4877, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 12.53% (13.8202 => 15.5515, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.52% (0.2596 => 0.2921, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.49% (0.6283 => 0.7068, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/distray/distray: 12.47% (0.0818 => 0.0920, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.39% (0.6959 => 0.7821, std.dev.: 0.0014) MultiSource/Applications/aha/aha: 12.34% (0.1062 => 0.1193, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.32% (1.4563 => 1.6357, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.24% (1.2193 => 1.3686, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.16% (0.9199 => 1.0318, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 12.16% (0.4062 => 0.4556, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.16% (0.5265 => 0.5905, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 11.96% (0.1003 => 0.1123, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.96% (0.7710 => 0.8632, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.88% (1.1364 => 1.2714, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 11.74% (0.5818 => 0.6501, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.67% (0.5577 => 0.6228, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.64% (0.3899 => 0.4353, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.58% (0.1157 => 0.1291, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 11.55% (1.0313 => 1.1504, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.52% (0.4791 => 0.5343, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 11.48% (0.5748 => 0.6408, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.44% (0.3130 => 0.3488, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 11.37% (1.1061 => 1.2319, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.36% (0.3485 => 0.3881, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 11.32% (0.7061 => 0.7860, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.13% (0.4016 => 0.4463, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.10% (0.3756 => 0.4173, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.02% (0.3022 => 0.3355, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 10.98% (0.2995 => 0.3324, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 10.93% (0.2781 => 0.3085, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 10.91% (16.6129 => 18.4247, std.dev.: 0.0304) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.89% (0.1276 => 0.1415, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.83% (0.3489 => 0.3867, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 10.82% (0.1589 => 0.1761, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 10.81% (0.6744 => 0.7473, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.80% (0.4379 => 0.4852, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 10.78% (0.3293 => 0.3648, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 10.71% (3.8646 => 4.2786, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.70% (0.1075 => 0.1190) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.69% (0.8698 => 0.9628, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.64% (0.3580 => 0.3961, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.64% (0.2782 => 0.3078, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 10.62% (0.3220 => 0.3562, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 10.60% (2.1791 => 2.4100, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.58% (0.2127 => 0.2352, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 10.57% (0.3453 => 0.3818, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.54% (0.0977 => 0.1080, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.52% (0.1435 => 0.1586, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 10.52% (0.3868 => 0.4275, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.51% (0.3246 => 0.3587, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 10.45% (0.2726 => 0.3011, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 10.45% (0.8310 => 0.9178, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/mst/mst: 10.44% (0.1111 => 0.1227, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.41% (1.9828 => 2.1893, std.dev.: 0.0115) MultiSource/Applications/d/make_dparser: 10.40% (3.1889 => 3.5207, std.dev.: 0.0097) MultiSource/Applications/treecc/treecc: 10.40% (1.9270 => 2.1274, std.dev.: 0.0035) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.40% (0.2914 => 0.3217, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.39% (0.1569 => 0.1732, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 10.35% (0.1478 => 0.1631, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.35% (0.2966 => 0.3273, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.35% (0.1865 => 0.2058, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 10.32% (0.3149 => 0.3474, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 10.30% (0.3534 => 0.3898, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.28% (0.7460 => 0.8227, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.27% (0.4390 => 0.4841, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.27% (0.1986 => 0.2190, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 10.26% (0.2690 => 0.2966, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.24% (0.2655 => 0.2927, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 10.17% (0.3107 => 0.3423, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 10.16% (0.2607 => 0.2872, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.16% (0.1014 => 0.1117, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 10.14% (0.2760 => 0.3040, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 10.12% (0.2925 => 0.3221, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 10.09% (0.7506 => 0.8263, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 10.07% (0.2761 => 0.3039, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 10.04% (0.2937 => 0.3232, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.02% (0.5637 => 0.6202, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 10.01% (0.2628 => 0.2891, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.99% (0.6576 => 0.7233, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.99% (0.2023 => 0.2225, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.95% (0.2765 => 0.3040, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.89% (7.2180 => 7.9316, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/ary2: 9.84% (0.3192 => 0.3506, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.72% (0.2696 => 0.2958, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.71% (4.9865 => 5.4708, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/matrix: 9.67% (0.2988 => 0.3277, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 9.67% (1.0594 => 1.1618, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.59% (0.3755 => 0.4115, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 9.42% (0.3131 => 0.3426, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 9.35% (0.1657 => 0.1812, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.28% (1.3245 => 1.4474, std.dev.: 0.0021) MultiSource/Applications/SIBsim4/SIBsim4: 9.27% (1.2749 => 1.3931, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 9.27% (14.8535 => 16.2303, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.27% (3.6692 => 4.0093, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.24% (4.3801 => 4.7850, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.19% (4.4433 => 4.8515, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/objinst: 9.07% (0.2945 => 0.3212, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 9.00% (8.4961 => 9.2609, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.93% (1.5188 => 1.6544, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.83% (0.3511 => 0.3821, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.82% (0.6135 => 0.6676, std.dev.: 0.0060) MultiSource/Applications/oggenc/oggenc: 8.82% (4.6629 => 5.0740, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.70% (0.9108 => 0.9900, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 8.66% (0.6250 => 0.6791, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.64% (0.2140 => 0.2325, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.63% (3.2742 => 3.5568, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.57% (0.2321 => 0.2520, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.55% (0.8818 => 0.9572, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 8.51% (0.4113 => 0.4463, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.44% (0.1789 => 0.1940, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.35% (0.4805 => 0.5206, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.26% (1.1333 => 1.2269, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1385 => 0.1498, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.15% (2.1007 => 2.2720, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 8.13% (3.7467 => 4.0513, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.07% (0.3245 => 0.3507, std.dev.: 0.0040) MultiSource/Applications/JM/ldecod/ldecod: 8.00% (6.5754 => 7.1017, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 7.97% (0.2008 => 0.2168, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.89% (0.4003 => 0.4319, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.83% (0.2504 => 0.2700, std.dev.: 0.0068) SingleSource/UnitTests/ObjC/exceptions: 7.69% (0.3914 => 0.4215, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.66% (0.3940 => 0.4242, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.52% (0.3789 => 0.4074, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.52% (1.2292 => 1.3216, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.49% (0.3578 => 0.3846, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.41% (0.3646 => 0.3916, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.40% (6.2785 => 6.7429, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/synchronized: 7.32% (0.3663 => 0.3931, std.dev.: 0.0065) SingleSource/UnitTests/ObjC/exceptions-2: 7.30% (0.3601 => 0.3864, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.23% (0.3623 => 0.3885, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.15% (0.3650 => 0.3911, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.10% (13.2842 => 14.2270, std.dev.: 0.0142) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1819 => 0.1946, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: 5.85% (0.1777 => 0.1881, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 5.80% (16.2614 => 17.2050, std.dev.: 0.0106) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.75% (0.2243 => 0.2372, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 4.76% (14.5298 => 15.2214, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: 3.71% (0.2859 => 0.2965, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 2.23% (33.2944 => 34.0364, std.dev.: 0.0127) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.61% (5.7573 => 7.5198, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 24.35% (1.8175 => 2.2601, std.dev.: 0.0530) SingleSource/Benchmarks/Misc/richards_benchmark: 11.20% (1.1560 => 1.2855, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 8.99% (0.8273 => 0.9017, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4139, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.33% (1.2998 => 1.3821, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0042, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.93% (11.2619 => 11.7043, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7747, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.53% (1.9199 => 1.9876, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.51% (10.7476 => 11.1249, std.dev.: 0.0522) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.18% (7.4271 => 7.5890, std.dev.: 0.0030) MultiSource/Applications/lemon/lemon: 1.51% (1.4298 => 1.4514, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5123, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2122, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1888, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/oourafft: 1.17% (5.5130 => 5.5775, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5859, std.dev.: 0.0075) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.40% (0.2670 => 0.1431, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.65% (0.4657 => 0.3928, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.83% (1.3813 => 1.2041, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.81% (1.3819 => 1.2049, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.34% (0.0997 => 0.0864, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.02% (0.2238 => 0.1969, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.00% (1.2308 => 1.0954, std.dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.07% (20.3410 => 18.2932, std.dev.: 0.0337) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.89% (1.3780 => 1.2969, std.dev.: 0.0087) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.41% (0.9996 => 0.9555, std.dev.: 0.0085) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8001, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.48% (1.7688 => 1.7073, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.18% (3.2729 => 3.1687, std.dev.: 0.0189) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.45% (3.0263 => 2.9521, std.dev.: 0.0010) MultiSource/Applications/lua/lua: -2.38% (26.5159 => 25.8840, std.dev.: 0.0109) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.34% (1.9762 => 1.9300, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.93% (0.6589 => 0.6462, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.83% (6.3560 => 6.2399, std.dev.: 0.0088) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7146, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.59% (0.6615 => 0.6510, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0071, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.22% (0.8342 => 0.8240, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4953, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2588, std.dev.: 0.0005) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 16 12:08:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 16 Oct 2012 14:08:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121016190810.338582A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4907?compare_to=4905&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4907, Order: 166031, Start Time: 2012-10-16 17:50:13, End Time: 2012-10-16 19:09:59 To: 4905, Order: 166023, Start Time: 2012-10-16 15:59:22, End Time: 2012-10-16 17:19:10 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (158 on baseline) Performance Improvements: 0 (44 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 953 (685 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.08% (0.5948 => 0.5943, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: -0.03% (16.4089 => 16.4036, std.dev.: 0.0058) MultiSource/Benchmarks/Bullet/bullet: 0.20% (54.7329 => 54.8422, std.dev.: 0.0074) MultiSource/Benchmarks/MallocBench/gs/gs: 0.06% (4.4385 => 4.4410, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.43% (0.0465 => 0.0463) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0465 => 0.0465, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.23% (0.0434 => 0.0433) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.46% (0.0436 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0422 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.24% (0.0424 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0415 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.48% (0.0418 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0433 => 0.0433) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.23% (0.0435 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.23% (0.0429 => 0.0428, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.23% (0.0430 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.24% (0.0419 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0419 => 0.0419) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.23% (0.0426 => 0.0425, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.23% (0.0427 => 0.0426) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.23% (0.0437 => 0.0436) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.46% (0.0439 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.48% (0.0414 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.48% (0.0415 => 0.0413, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.47% (0.0425 => 0.0423, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.47% (0.0427 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0416 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.24% (0.0418 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0408 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.49% (0.0410 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0408 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.24% (0.0409 => 0.0408, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0444 => 0.0444, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.67% (0.0447 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.25% (0.0406 => 0.0405, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.25% (0.0408 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0408 => 0.0408) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0410 => 0.0410, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0414 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0416 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.01% (1.2576 => 1.2575, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.16% (7.9592 => 7.9466, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.41% (0.7480 => 0.7449, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 1.69% (0.0355 => 0.0361, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1439 => 0.1439, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0645 => 0.0645, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -13.28% (63.2438 => 54.8422, std.dev.: 0.0074) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 33.95% (14.1553 => 18.9617, std.dev.: 0.0138) SingleSource/Benchmarks/Misc-C++-EH/spirit: 64.21% (3.4629 => 5.6864, std.dev.: 0.0022) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14235.97% (0.0720 => 10.3219, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9974200.00% (0.0001 => 9.9743, std.dev.: 0.0013) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 59.40% (0.2554 => 0.4071, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 47.64% (10.3673 => 15.3059, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/richards_benchmark: 35.94% (0.1622 => 0.2205, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 32.77% (0.1056 => 0.1402, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.59% (2.2022 => 2.5896, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops: 17.32% (0.1432 => 0.1680, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.27% (7.0540 => 8.2720, std.dev.: 0.0196) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.01% (0.1566 => 0.1801, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.36% (1.7609 => 1.9961, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.63% (0.0871 => 0.0981, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 12.55% (0.3282 => 0.3694, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 11.88% (0.1440 => 0.1611, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.62% (0.1584 => 0.1768, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 10.91% (0.7115 => 0.7891, std.dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: 10.59% (0.7433 => 0.8220, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.43% (0.4879 => 0.5388, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.22% (0.6675 => 0.7357, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 10.13% (0.1175 => 0.1294, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.05% (0.3473 => 0.3822, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.03% (0.1625 => 0.1788, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.01% (0.1438 => 0.1582, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.97% (0.1143 => 0.1257, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 9.92% (10.4361 => 11.4717, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.91% (0.3543 => 0.3894, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.89% (0.2700 => 0.2967, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.88% (0.3927 => 0.4315, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.85% (0.3177 => 0.3490, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.84% (0.3497 => 0.3841, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.80% (0.3561 => 0.3910, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.79% (0.3543 => 0.3890, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.76% (0.3516 => 0.3859, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 9.75% (9.4845 => 10.4092, std.dev.: 0.0145) SingleSource/UnitTests/ObjC/exceptions: 9.74% (0.3828 => 0.4201, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 9.67% (0.1655 => 0.1815, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.64% (0.3694 => 0.4050, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.62% (0.3886 => 0.4260, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.57% (1.5415 => 1.6890, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 9.54% (3.3354 => 3.6535, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 9.44% (0.1695 => 0.1855, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 9.44% (0.3423 => 0.3746, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 9.38% (5.7591 => 6.2991, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.30% (0.5105 => 0.5580, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 9.20% (0.3109 => 0.3395, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.19% (0.4615 => 0.5039, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.06% (0.1236 => 0.1348, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.95% (0.3307 => 0.3603, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 8.95% (0.1151 => 0.1254, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.91% (0.5860 => 0.6382, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.90% (4.2646 => 4.6443, std.dev.: 0.0034) MultiSource/Applications/Burg/burg: 8.83% (1.1642 => 1.2670, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: 8.83% (0.6456 => 0.7026, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 8.82% (3.8723 => 4.2139, std.dev.: 0.0113) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.81% (0.1940 => 0.2111, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.81% (0.1510 => 0.1643, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.78% (1.3050 => 1.4196, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.78% (0.8067 => 0.8775, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.76% (0.2271 => 0.2470, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.74% (0.5569 => 0.6056, std.dev.: 0.0018) MultiSource/Applications/viterbi/viterbi: 8.68% (0.1555 => 0.1690, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.63% (0.8172 => 0.8877, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.49% (4.9449 => 5.3649, std.dev.: 0.0085) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.45% (0.2107 => 0.2285, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.45% (0.5020 => 0.5444, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.44% (8.1363 => 8.8233, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.43% (5.0018 => 5.4235, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.41% (0.2758 => 0.2990, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.40% (1.5859 => 1.7191, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.33% (0.3121 => 0.3381, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 8.27% (2.0273 => 2.1949, std.dev.: 0.0124) MultiSource/Applications/lemon/lemon: 8.24% (1.0722 => 1.1606, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 8.24% (0.3387 => 0.3666, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.23% (0.2065 => 0.2235, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 8.19% (0.7835 => 0.8477, std.dev.: 0.0071) SingleSource/UnitTests/ObjC++/property-reference-object: 8.18% (0.6030 => 0.6523, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.17% (0.5925 => 0.6409, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.16% (0.9765 => 1.0562, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.08% (0.1337 => 0.1445, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 8.04% (1.5603 => 1.6857, std.dev.: 0.0053) MultiSource/Applications/siod/siod: 7.97% (2.2969 => 2.4799, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.92% (0.4103 => 0.4428, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.81% (0.3865 => 0.4167, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.79% (0.3441 => 0.3709, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 7.69% (0.4289 => 0.4619, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.68% (0.4203 => 0.4526, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 7.67% (0.3180 => 0.3424, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.65% (7.9617 => 8.5704, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.56% (2.2024 => 2.3689, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 7.55% (0.7326 => 0.7879, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.45% (1.1861 => 1.2745, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists: 7.33% (0.3422 => 0.3673, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.26% (0.2603 => 0.2792, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.23% (0.4620 => 0.4954, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 7.05% (0.3603 => 0.3857, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/moments: 7.02% (0.4048 => 0.4332, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.01% (0.6450 => 0.6902, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 6.97% (21.9371 => 23.4671, std.dev.: 0.0188) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.85% (0.3650 => 0.3900, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.84% (0.1695 => 0.1811, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 6.84% (0.8921 => 0.9531, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.77% (0.4636 => 0.4950, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 6.72% (0.4299 => 0.4588, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.69% (0.3826 => 0.4082, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.57% (0.5981 => 0.6374, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 6.51% (0.3684 => 0.3924, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 6.51% (0.2905 => 0.3094, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.43% (0.2891 => 0.3077, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.39% (0.2831 => 0.3012, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.38% (0.3136 => 0.3336, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.33% (0.3162 => 0.3362, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.32% (1.4186 => 1.5082, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary: 6.31% (0.3232 => 0.3436, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.21% (0.3283 => 0.3487, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.19% (2.0665 => 2.1945, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.17% (0.2756 => 0.2926, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.06% (0.2725 => 0.2890, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.02% (0.2872 => 0.3045, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.00% (0.3098 => 0.3284, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.99% (0.2871 => 0.3043, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 5.98% (1.1840 => 1.2548, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.87% (0.2877 => 0.3046, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.87% (0.1892 => 0.2003, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/wc: 5.87% (0.3052 => 0.3231, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 5.75% (0.2714 => 0.2870, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 5.71% (0.2802 => 0.2962, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.69% (0.2266 => 0.2395, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.69% (0.2793 => 0.2952, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.61% (0.4064 => 0.4292, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.59% (0.3379 => 0.3568, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.56% (0.1906 => 0.2012, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.21% (0.8101 => 0.8523, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: 4.88% (0.2049 => 0.2149, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 4.70% (17.1811 => 17.9882, std.dev.: 0.0155) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.47% (14.3668 => 15.0094, std.dev.: 0.0055) MultiSource/Applications/hexxagon/hexxagon: 4.45% (1.2842 => 1.3414, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.41% (0.3427 => 0.3578, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.38% (0.3131 => 0.3268, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.08% (3.8922 => 4.0509, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.81% (1.1194 => 1.1621, std.dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.92% (0.1421 => 0.1562, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.78% (1.1396 => 1.2511, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 9.20% (3.1595 => 3.4503, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3691, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.49% (3.6395 => 3.7665, std.dev.: 0.0093) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.78% (4.2280 => 4.3455, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7655, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.72% (0.8275 => 0.8417, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.36% (11.6436 => 11.8014, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.16% (2.6546 => 2.6855, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1312, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -79.99% (0.8651 => 0.1731, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.88% (5.2763 => 3.2775, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.48% (5.3855 => 3.6904, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.10% (5.3526 => 3.6881, std.dev.: 0.0022) SingleSource/UnitTests/Vector/constpool: -14.63% (54.1659 => 46.2427, std.dev.: 0.0083) MultiSource/Applications/ClamAV/clamscan: -12.18% (22.1758 => 19.4742, std.dev.: 0.0091) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.30% (2.9384 => 2.6358, std.dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.37% (1.1492 => 0.7657, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4246, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.13% (0.0998 => 0.0857, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -11.28% (1.2373 => 1.0977, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -10.43% (1.5373 => 1.3769, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/mason/mason: -10.09% (0.2161 => 0.1943, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.31% (19.9488 => 18.2913, std.dev.: 0.0160) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.66% (1.8329 => 1.7109, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.28% (1.6805 => 1.5917, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7966, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.79% (1.5835 => 1.5076, std.dev.: 0.0017) MultiSource/Applications/siod/siod: -3.74% (3.2827 => 3.1598, std.dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.20% (0.9957 => 0.9638, std.dev.: 0.0042) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5043, std.dev.: 0.0061) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0983, std.dev.: 0.0016) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.99% (8.6802 => 8.5072, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/salsa20: -1.88% (10.2830 => 10.0892, std.dev.: 0.0162) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.88% (8.1563 => 8.0032, std.dev.: 0.0176) MultiSource/Applications/sqlite3/sqlite3: -1.77% (4.6441 => 4.5617, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6808, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.57% (2.5528 => 2.5126, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4200, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2878, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.11% (4.9088 => 4.8544, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/lists: -1.06% (6.2999 => 6.2330, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.65% (0.5229 => 0.5943, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 9.43% (14.9895 => 16.4036, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/gs/gs: 8.04% (4.1105 => 4.4410, std.dev.: 0.0102) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.82% (1.1048 => 1.2575, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.01% (7.1582 => 7.9466, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.72% (0.6222 => 0.7449, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36000.00% (0.0001 => 0.0361, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.10% (0.1485 => 0.1439, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.52% (0.2116 => 0.0645, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 16 12:23:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 16 Oct 2012 14:23:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121016192346.C67C72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4908?compare_to=4906&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4908, Order: 166031, Start Time: 2012-10-16 18:00:57, End Time: 2012-10-16 19:26:42 To: 4906, Order: 166023, Start Time: 2012-10-16 16:05:57, End Time: 2012-10-16 17:31:51 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (185 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1041 (680 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.70% (54.4625 => 56.4784, std.dev.: 0.0773) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.71% (2.0176 => 2.4959, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.58% (0.1410 => 0.1672, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 17.19% (0.0826 => 0.0968, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 16.94% (0.2243 => 0.2623, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.69% (0.0653 => 0.0762, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.93% (0.1072 => 0.1232, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 14.12% (0.1013 => 0.1156, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.79% (0.0834 => 0.0949, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.52% (0.1413 => 0.1604, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.49% (0.1327 => 0.1506, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.28% (0.0964 => 0.1092, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 13.09% (1.3693 => 1.5486, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 13.09% (0.7038 => 0.7959, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.72% (0.1588 => 0.1790, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.70% (3.9660 => 4.4695, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/hash2: 12.68% (0.4328 => 0.4877, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 12.68% (0.4062 => 0.4577, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.42% (0.2721 => 0.3059, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.32% (0.6283 => 0.7057, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.29% (0.2596 => 0.2915, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 12.19% (13.8202 => 15.5042, std.dev.: 0.0214) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.17% (0.6959 => 0.7806, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 12.13% (0.5818 => 0.6524, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.03% (1.4563 => 1.6315, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.98% (0.9199 => 1.0301, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.97% (0.5265 => 0.5895, std.dev.: 0.0067) MultiSource/Applications/aha/aha: 11.96% (0.1062 => 0.1189, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.92% (1.2193 => 1.3646, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 11.78% (0.5748 => 0.6425, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.77% (0.3899 => 0.4358, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 11.76% (0.1003 => 0.1121, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.67% (0.7710 => 0.8610, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.64% (1.1364 => 1.2687, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 11.53% (0.7061 => 0.7875, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.33% (0.4791 => 0.5334, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.32% (0.1157 => 0.1288, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 11.22% (1.0313 => 1.1470, std.dev.: 0.0120) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.19% (0.3485 => 0.3875, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.09% (0.3130 => 0.3477, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 11.08% (0.2781 => 0.3089, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 11.06% (1.1061 => 1.2284, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.06% (0.4016 => 0.4460, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.97% (0.3756 => 0.4168, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.85% (0.5577 => 0.6182, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 10.81% (0.3293 => 0.3649, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.79% (0.3022 => 0.3348, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 10.78% (16.6129 => 18.4036, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.75% (0.3489 => 0.3864, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 10.74% (0.6744 => 0.7468, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.64% (0.2782 => 0.3078, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.61% (0.3580 => 0.3960, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.60% (0.1075 => 0.1189, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 10.55% (0.2995 => 0.3311, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 10.55% (0.3868 => 0.4276, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 10.54% (0.3453 => 0.3817, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.53% (0.4379 => 0.4840, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.52% (0.8698 => 0.9613, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.45% (1.9828 => 2.1900, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/mst/mst: 10.44% (0.1111 => 0.1227, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.39% (0.2127 => 0.2348, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 10.38% (0.1589 => 0.1754, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 10.38% (0.2726 => 0.3009, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 10.38% (3.8646 => 4.2656, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/18-imp/imp: 10.34% (0.3220 => 0.3553, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.34% (0.0977 => 0.1078, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 10.33% (2.1791 => 2.4042, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.33% (0.2914 => 0.3215, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 10.33% (0.2760 => 0.3045, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.33% (0.1569 => 0.1731, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.26% (0.3246 => 0.3579, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 10.26% (0.3149 => 0.3472, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.25% (0.2966 => 0.3270, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 10.24% (0.3534 => 0.3896, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.23% (0.4390 => 0.4839, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 10.19% (0.2690 => 0.2964, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.17% (0.1435 => 0.1581, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.16% (0.7460 => 0.8218, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 10.15% (0.1478 => 0.1628, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 10.13% (0.2607 => 0.2871, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 10.11% (0.3107 => 0.3421, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.09% (0.2655 => 0.2923, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.08% (0.1865 => 0.2053, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 10.06% (3.1889 => 3.5097, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.06% (0.1014 => 0.1116, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 10.05% (1.9270 => 2.1206, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 10.03% (0.2761 => 0.3038, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 10.02% (0.8310 => 0.9143, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 9.98% (0.2937 => 0.3230, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.97% (0.1986 => 0.2184, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 9.97% (0.2628 => 0.2890, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 9.97% (0.7506 => 0.8254, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.95% (0.1276 => 0.1403, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.95% (0.2765 => 0.3040, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 9.90% (0.3192 => 0.3508, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 9.85% (0.2925 => 0.3213, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.81% (0.5637 => 0.6190, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 9.81% (0.2988 => 0.3281, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.79% (0.2023 => 0.2221, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.77% (0.3755 => 0.4122, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.70% (4.9865 => 5.4704, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.64% (0.2696 => 0.2956, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.56% (7.2180 => 7.9083, std.dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 9.42% (1.0594 => 1.1592, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.40% (0.6576 => 0.7194, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 9.23% (0.1657 => 0.1810, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 9.10% (0.3131 => 0.3416, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.09% (1.3245 => 1.4449, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 9.03% (0.2945 => 0.3211, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.00% (4.3801 => 4.7743, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.96% (3.6692 => 3.9978, std.dev.: 0.0059) MultiSource/Applications/JM/lencod/lencod: 8.92% (14.8535 => 16.1790, std.dev.: 0.0089) MultiSource/Applications/SIBsim4/SIBsim4: 8.90% (1.2749 => 1.3884, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.84% (4.4433 => 4.8359, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.80% (1.5188 => 1.6525, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 8.70% (8.4961 => 9.2354, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.54% (0.6135 => 0.6659, std.dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 8.54% (4.6629 => 5.0610, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/bigfib: 8.51% (0.6250 => 0.6782, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.46% (0.2140 => 0.2321, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.43% (0.8818 => 0.9561, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.37% (0.3511 => 0.3805, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.34% (0.9108 => 0.9868, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.27% (0.2321 => 0.2513, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.26% (3.2742 => 3.5447, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.22% (0.4805 => 0.5200, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.16% (1.1333 => 1.2258, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.16% (0.1789 => 0.1935, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.11% (2.1007 => 2.2711, std.dev.: 0.0149) MultiSource/Benchmarks/McCat/05-eks/eks: 8.07% (0.4113 => 0.4445, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.04% (0.3245 => 0.3506, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 7.81% (3.7467 => 4.0395, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 7.73% (0.1385 => 0.1492, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 7.62% (6.5754 => 7.0767, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: 7.62% (0.2008 => 0.2161, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.62% (0.4003 => 0.4308, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.55% (0.2504 => 0.2693, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 7.40% (1.2292 => 1.3201, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/property: 7.36% (0.3940 => 0.4230, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.36% (0.3914 => 0.4202, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 7.21% (0.3578 => 0.3836, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.18% (0.3789 => 0.4061, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.07% (6.2785 => 6.7227, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-4: 7.05% (0.3646 => 0.3903, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.04% (0.3663 => 0.3921, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.00% (0.3601 => 0.3853, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.88% (0.3650 => 0.3901, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-3: 6.87% (0.3623 => 0.3872, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.76% (0.1819 => 0.1942, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.65% (13.2842 => 14.1679, std.dev.: 0.0092) MultiSource/Applications/sqlite3/sqlite3: 5.55% (16.2614 => 17.1635, std.dev.: 0.0173) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.53% (0.2243 => 0.2367, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 4.48% (14.5298 => 15.1809, std.dev.: 0.0112) MultiSource/Benchmarks/Bullet/bullet: 2.35% (33.2944 => 34.0777, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5182, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.06% (1.0895 => 1.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 23.67% (1.8175 => 2.2477, std.dev.: 0.0473) SingleSource/Benchmarks/Misc/richards_benchmark: 11.11% (1.1560 => 1.2844, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 9.02% (0.8273 => 0.9019, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.47% (0.1322 => 0.1434, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4140, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.19% (1.2998 => 1.3803, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0042, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.95% (11.2619 => 11.7071, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7747, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.47% (10.7476 => 11.1207, std.dev.: 0.0442) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9859, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.12% (7.4271 => 7.5849, std.dev.: 0.0062) MultiSource/Applications/lemon/lemon: 1.71% (1.4298 => 1.4542, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5131, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2123, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1878, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5786, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5903, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.03% (3.6469 => 3.6844, std.dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.63% (0.2670 => 0.1425, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.91% (0.4657 => 0.3916, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -14.14% (0.0707 => 0.0607, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.01% (1.3813 => 1.2016, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.96% (1.3819 => 1.2028, std.dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -12.15% (0.2238 => 0.1966, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.94% (1.2308 => 1.0962, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.06% (20.3410 => 18.2946, std.dev.: 0.0148) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.73% (1.3780 => 1.2990, std.dev.: 0.0111) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5144, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.57% (0.9996 => 0.9539, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.52% (1.7688 => 1.7066, std.dev.: 0.0053) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -2.96% (3.2729 => 3.1760, std.dev.: 0.0103) MultiSource/Applications/lua/lua: -2.61% (26.5159 => 25.8250, std.dev.: 0.0246) SingleSource/Regression/C/uint64_to_float: -2.55% (0.5449 => 0.5310, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -2.45% (3.0263 => 2.9522, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -2.36% (1.9762 => 1.9295, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7156, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2523, std.dev.: 0.0063) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.59% (0.6615 => 0.6510, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0077, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.33% (3.9173 => 3.8651, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.25% (0.8342 => 0.8238, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4956, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2588, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 16 13:57:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 16 Oct 2012 15:57:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121016205714.86FA02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4909?compare_to=4907&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4909, Order: 166040, Start Time: 2012-10-16 19:39:29, End Time: 2012-10-16 20:59:09 To: 4907, Order: 166031, Start Time: 2012-10-16 17:50:13, End Time: 2012-10-16 19:09:59 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (162 on baseline) Performance Improvements: 1 (45 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 952 (680 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.12% (15.3059 => 15.1345, std.dev.: 0.0018) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.12% (0.5943 => 0.5950, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 0.30% (16.4036 => 16.4520, std.dev.: 0.0050) MultiSource/Benchmarks/Bullet/bullet: -0.33% (54.8422 => 54.6627, std.dev.: 0.0113) MultiSource/Benchmarks/MallocBench/gs/gs: 0.03% (4.4410 => 4.4424, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.22% (0.0463 => 0.0462) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.65% (0.0465 => 0.0462, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.69% (0.0433 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.23% (0.0434 => 0.0433) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.47% (0.0422 => 0.0420, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.47% (0.0423 => 0.0421) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.48% (0.0415 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.48% (0.0416 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.46% (0.0433 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.23% (0.0434 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.47% (0.0428 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.47% (0.0429 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.48% (0.0418 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.48% (0.0419 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.71% (0.0425 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.47% (0.0426 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.46% (0.0436 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.46% (0.0437 => 0.0435, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.24% (0.0412 => 0.0411) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.48% (0.0413 => 0.0411, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.24% (0.0423 => 0.0422, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.24% (0.0425 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.48% (0.0416 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.48% (0.0417 => 0.0415) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.49% (0.0408 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0408 => 0.0408, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.74% (0.0408 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.49% (0.0408 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.45% (0.0444 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.23% (0.0444 => 0.0443) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.25% (0.0405 => 0.0404, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.49% (0.0407 => 0.0405, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.49% (0.0408 => 0.0406, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.49% (0.0410 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.24% (0.0414 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.48% (0.0416 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.10% (1.2575 => 1.2587, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.19% (7.9466 => 7.9619, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.32% (0.7449 => 0.7473, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -1.94% (0.0361 => 0.0354, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: - (0.1439 => 0.1439) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.16% (0.0645 => 0.0644, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -13.57% (63.2438 => 54.6627, std.dev.: 0.0113) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.12% (14.1553 => 18.9856, std.dev.: 0.0124) SingleSource/Benchmarks/Misc-C++-EH/spirit: 64.32% (3.4629 => 5.6903, std.dev.: 0.0050) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14235.28% (0.0720 => 10.3214, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9972900.00% (0.0001 => 9.9730, std.dev.: 0.0012) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 59.91% (0.2554 => 0.4084, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 45.98% (10.3673 => 15.1345, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: 36.93% (0.1622 => 0.2221, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 33.05% (0.1056 => 0.1405, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.26% (2.2022 => 2.5822, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 17.11% (0.1432 => 0.1677, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 16.77% (7.0540 => 8.2370, std.dev.: 0.0036) MultiSource/Benchmarks/Fhourstones/fhourstones: 14.81% (0.1566 => 0.1798, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.09% (0.0871 => 0.0985, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.06% (1.7609 => 1.9909, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 12.86% (0.3282 => 0.3704, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 12.01% (0.1440 => 0.1613, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.87% (0.1584 => 0.1772, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.09% (0.3473 => 0.3858, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.98% (0.3543 => 0.3932, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 10.95% (0.7115 => 0.7894, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/synchronized: 10.92% (0.3561 => 0.3950, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/exceptions-2: 10.92% (0.3497 => 0.3879, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.92% (0.3543 => 0.3930, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.90% (0.3927 => 0.4355, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.89% (0.3516 => 0.3899, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 10.83% (0.7433 => 0.8238, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 10.82% (0.3828 => 0.4242, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 10.69% (0.3694 => 0.4089, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.65% (0.6675 => 0.7386, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.63% (0.3886 => 0.4299, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 10.21% (0.1175 => 0.1295, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.09% (0.1625 => 0.1789, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 10.07% (9.4845 => 10.4396, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.86% (0.4879 => 0.5360, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 9.84% (3.3354 => 3.6637, std.dev.: 0.0061) MultiSource/Applications/JM/ldecod/ldecod: 9.81% (10.4361 => 11.4598, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.78% (1.5415 => 1.6923, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.76% (0.3177 => 0.3487, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.74% (0.2700 => 0.2963, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.74% (0.5105 => 0.5602, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 9.67% (0.1655 => 0.1815, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.67% (0.1438 => 0.1577, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 9.58% (0.3423 => 0.3751, std.dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.54% (0.1143 => 0.1252, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.52% (4.2646 => 4.6705, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.51% (0.4615 => 0.5054, std.dev.: 0.0037) MultiSource/Applications/sgefa/sgefa: 9.46% (0.3109 => 0.3403, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/em3d/em3d: 9.44% (0.1695 => 0.1855, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 9.25% (5.7591 => 6.2921, std.dev.: 0.0022) MultiSource/Applications/lua/lua: 9.22% (3.8723 => 4.2293, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.16% (0.5860 => 0.6397, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.14% (0.1236 => 0.1349, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.07% (0.2271 => 0.2477, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 9.03% (1.1642 => 1.2693, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/bigfib: 9.01% (0.6456 => 0.7038, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.01% (0.1510 => 0.1646, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.98% (0.3307 => 0.3604, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.98% (1.3050 => 1.4222, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.97% (0.1940 => 0.2114, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.96% (0.5020 => 0.5470, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/mst/mst: 8.94% (0.1163 => 0.1267, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.94% (0.8067 => 0.8788, std.dev.: 0.0016) MultiSource/Applications/viterbi/viterbi: 8.87% (0.1555 => 0.1693, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.83% (0.5569 => 0.6061, std.dev.: 0.0013) MultiSource/Applications/aha/aha: 8.77% (0.1151 => 0.1252, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.68% (5.0018 => 5.4360, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.66% (4.9449 => 5.3730, std.dev.: 0.0028) MultiSource/Applications/lemon/lemon: 8.66% (1.0722 => 1.1650, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.64% (0.2107 => 0.2289, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.61% (8.1363 => 8.8369, std.dev.: 0.0033) MultiSource/Benchmarks/sim/sim: 8.56% (0.3387 => 0.3677, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.52% (0.2758 => 0.2993, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.51% (1.5859 => 1.7209, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.46% (0.9765 => 1.0591, std.dev.: 0.0024) MultiSource/Applications/treecc/treecc: 8.43% (2.0273 => 2.1983, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: 8.41% (0.7835 => 0.8494, std.dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.39% (0.3121 => 0.3383, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.33% (0.8172 => 0.8853, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 8.26% (0.6030 => 0.6528, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.23% (0.2065 => 0.2235, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 8.23% (1.5603 => 1.6887, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: 8.20% (0.5925 => 0.6411, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 8.19% (2.2969 => 2.4850, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.15% (0.1337 => 0.1446, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.01% (7.9617 => 8.5991, std.dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.94% (0.4636 => 0.5004, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 7.92% (0.3180 => 0.3432, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.87% (0.3865 => 0.4169, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.80% (0.4103 => 0.4423, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 7.76% (0.4289 => 0.4622, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.76% (0.3441 => 0.3708, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.71% (1.1861 => 1.2776, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.58% (2.2024 => 2.3694, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.57% (0.4203 => 0.4521, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 7.47% (0.7326 => 0.7873, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: 7.42% (0.3422 => 0.3676, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 7.40% (0.4620 => 0.4962, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 7.39% (21.9371 => 23.5577, std.dev.: 0.0141) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.38% (0.2603 => 0.2795, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.37% (0.1695 => 0.1820, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 7.09% (0.4048 => 0.4335, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 7.04% (0.1463 => 0.1566, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 7.01% (0.8921 => 0.9546, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.99% (0.3650 => 0.3905, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.96% (0.6450 => 0.6899, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 6.96% (0.4299 => 0.4598, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.88% (0.3603 => 0.3851, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 6.79% (0.3684 => 0.3934, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.77% (0.3826 => 0.4085, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.74% (0.5981 => 0.6384, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.57% (0.2905 => 0.3096, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.57% (0.2891 => 0.3081, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.52% (1.4186 => 1.5111, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.51% (0.3162 => 0.3368, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.51% (0.3136 => 0.3340, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.29% (1.1840 => 1.2585, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.29% (0.2831 => 0.3009, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.27% (2.0665 => 2.1960, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary3: 6.06% (0.3283 => 0.3482, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.06% (0.2756 => 0.2923, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.04% (0.3098 => 0.3285, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.03% (0.3232 => 0.3427, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.01% (0.2877 => 0.3050, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 5.99% (0.2871 => 0.3043, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.99% (0.2872 => 0.3044, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.94% (0.2725 => 0.2887, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.93% (0.4064 => 0.4305, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.90% (0.3052 => 0.3232, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.82% (0.2802 => 0.2965, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.76% (0.2793 => 0.2954, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.75% (0.2714 => 0.2870, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.65% (0.2266 => 0.2394, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.61% (0.1906 => 0.2013, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.59% (0.3379 => 0.3568, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.50% (0.1892 => 0.1996, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.37% (0.8101 => 0.8536, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: 4.93% (0.2049 => 0.2150, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.91% (14.3668 => 15.0722, std.dev.: 0.0177) MultiSource/Applications/sqlite3/sqlite3: 4.91% (17.1811 => 18.0241, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/objinst: 4.69% (0.3131 => 0.3278, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.66% (1.2842 => 1.3440, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.49% (0.3427 => 0.3581, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.06% (3.8922 => 4.0504, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.46% (0.3817 => 0.3949, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.10% (1.1194 => 1.1541, std.dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.38% (0.2944 => 0.3279, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.95% (1.1396 => 1.2530, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 9.22% (3.1595 => 3.4508, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 6.71% (3.1578 => 3.3696, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.57% (3.6395 => 3.7694, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.83% (4.2280 => 4.3478, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.70% (0.8275 => 0.8416, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.46% (0.9540 => 0.9679, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.34% (11.6436 => 11.8001, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.13% (2.6546 => 2.6845, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5751, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.05% (6.6874 => 0.1304) SingleSource/Benchmarks/Misc/salsa20: -80.04% (0.8651 => 0.1727, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.25% (5.2763 => 3.2582, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.71% (5.3855 => 3.6777, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.31% (5.3526 => 3.6766, std.dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: -14.65% (54.1659 => 46.2326, std.dev.: 0.0037) MultiSource/Applications/ClamAV/clamscan: -12.10% (22.1758 => 19.4917, std.dev.: 0.0187) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.30% (2.9384 => 2.6358, std.dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.52% (1.1492 => 0.7640, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: -16.08% (1.6925 => 1.4203, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.73% (0.0998 => 0.0861, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.53% (1.2373 => 1.0947, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -10.75% (1.5373 => 1.3720, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/mason/mason: -9.95% (0.2161 => 0.1946, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.43% (19.9488 => 18.2676, std.dev.: 0.0210) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.77% (1.8329 => 1.7088, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0146) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.28% (1.6805 => 1.5917, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.87% (1.5835 => 1.5064, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.92% (0.9957 => 0.9567, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.67% (3.2827 => 3.1621, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4956, std.dev.: 0.0074) MultiSource/Applications/hexxagon/hexxagon: -3.03% (12.4730 => 12.0953, std.dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.20% (0.4808 => 0.4702, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0840, std.dev.: 0.0268) SingleSource/Regression/C/uint64_to_float: -1.90% (0.5413 => 0.5310, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.84% (8.1563 => 8.0066, std.dev.: 0.0112) SingleSource/UnitTests/Vector/multiplies: -1.80% (2.5528 => 2.5068, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.77% (8.6802 => 8.5267, std.dev.: 0.0143) MultiSource/Applications/sqlite3/sqlite3: -1.74% (4.6441 => 4.5633, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/flops: -1.69% (8.8334 => 8.6841, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4203, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.17% (6.2999 => 6.2265, std.dev.: 0.0078) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2878, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.79% (0.5229 => 0.5950, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 9.76% (14.9895 => 16.4520, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/gs/gs: 8.07% (4.1105 => 4.4424, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.93% (1.1048 => 1.2587, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.23% (7.1582 => 7.9619, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++/stepanov_container: 20.11% (0.6222 => 0.7473, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35300.00% (0.0001 => 0.0354, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -3.10% (0.1485 => 0.1439) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.57% (0.2116 => 0.0644, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 16 14:18:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 16 Oct 2012 16:18:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121016211858.488E42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4910?compare_to=4908&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4910, Order: 166040, Start Time: 2012-10-16 19:55:54, End Time: 2012-10-16 21:21:53 To: 4908, Order: 166031, Start Time: 2012-10-16 18:00:57, End Time: 2012-10-16 19:26:42 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (187 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1042 (678 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.19% (2.0176 => 2.5056, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.58% (0.1410 => 0.1672, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 17.68% (0.0826 => 0.0972, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 16.85% (0.2243 => 0.2621, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.23% (0.0653 => 0.0759, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 14.41% (0.1013 => 0.1159, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.79% (0.0834 => 0.0949, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.52% (0.1413 => 0.1604, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.34% (0.1072 => 0.1215, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 13.34% (1.3693 => 1.5519, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.19% (0.1327 => 0.1502, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 13.19% (0.7038 => 0.7966, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.07% (0.0964 => 0.1090, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.01% (3.9660 => 4.4820, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 13.01% (0.2721 => 0.3075, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.97% (0.1588 => 0.1794, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.69% (0.6959 => 0.7842, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 12.66% (0.4328 => 0.4876, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.56% (0.6283 => 0.7072, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.52% (0.2596 => 0.2921, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 12.46% (13.8202 => 15.5423, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/hash: 12.43% (0.4062 => 0.4567, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.28% (1.4563 => 1.6351, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.24% (0.9199 => 1.0325, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/distray/distray: 12.22% (0.0818 => 0.0918, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.19% (0.5265 => 0.5907, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.13% (0.7710 => 0.8645, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.08% (1.2193 => 1.3666, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 11.86% (0.1062 => 0.1188, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 11.76% (0.1003 => 0.1121, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.70% (1.1364 => 1.2694, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.58% (0.1157 => 0.1291, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 11.57% (0.5818 => 0.6491, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 11.40% (1.0313 => 1.1489, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.29% (0.4791 => 0.5332, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.16% (0.3899 => 0.4334, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.15% (0.3130 => 0.3479, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 11.14% (1.1061 => 1.2293, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.10% (0.3485 => 0.3872, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 11.10% (0.7061 => 0.7845, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 11.10% (0.5748 => 0.6386, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.10% (0.5577 => 0.6196, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 10.93% (0.6744 => 0.7481, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.91% (0.4016 => 0.4454, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 10.89% (0.1589 => 0.1762, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.84% (0.2914 => 0.3230, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.79% (0.1075 => 0.1191, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.76% (0.3756 => 0.4160, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 10.72% (0.2781 => 0.3079, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 10.71% (0.1111 => 0.1230, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.71% (0.4390 => 0.4860, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.64% (0.4379 => 0.4845, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 10.63% (0.3293 => 0.3643, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 10.59% (0.3220 => 0.3561, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.59% (0.3022 => 0.3342, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 10.58% (16.6129 => 18.3710, std.dev.: 0.0193) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.58% (0.8698 => 0.9618, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 10.55% (0.2995 => 0.3311, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.54% (0.0977 => 0.1080, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.48% (0.2127 => 0.2350, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 10.47% (0.3868 => 0.4273, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 10.44% (2.1791 => 2.4067, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.43% (0.3489 => 0.3853, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.42% (0.1276 => 0.1409, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 10.42% (0.1478 => 0.1632, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/strcat: 10.42% (0.2726 => 0.3010, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.41% (0.3246 => 0.3584, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 10.40% (0.2760 => 0.3047, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.39% (0.1569 => 0.1732, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.35% (0.2782 => 0.3070, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 10.33% (3.8646 => 4.2638, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 10.33% (1.9270 => 2.1260, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 10.31% (0.3453 => 0.3809, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.31% (0.3580 => 0.3949, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 10.29% (0.7506 => 0.8278, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 10.28% (0.8310 => 0.9164, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 10.27% (0.3534 => 0.3897, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.26% (0.1014 => 0.1118, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 10.21% (3.1889 => 3.5144, std.dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.19% (0.1865 => 0.2055, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.17% (0.1435 => 0.1581, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 10.16% (0.3149 => 0.3469, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.11% (0.5637 => 0.6207, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.09% (1.9828 => 2.1829, std.dev.: 0.0119) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.01% (0.7460 => 0.8207, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 9.95% (0.3107 => 0.3416, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.94% (0.2655 => 0.2919, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.91% (0.2966 => 0.3260, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 9.89% (0.2761 => 0.3034, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.89% (0.2023 => 0.2223, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.87% (0.1986 => 0.2182, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 9.85% (0.2690 => 0.2955, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 9.84% (0.2937 => 0.3226, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.84% (7.2180 => 7.9281, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hello: 9.82% (0.2607 => 0.2863, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/09-vor/vor: 9.81% (0.2925 => 0.3212, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 9.81% (0.2988 => 0.3281, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.80% (0.2765 => 0.3036, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 9.65% (0.3192 => 0.3500, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.65% (4.9865 => 5.4675, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/fibo: 9.63% (0.2628 => 0.2881, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 9.61% (1.0594 => 1.1612, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.51% (0.3755 => 0.4112, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.46% (0.2696 => 0.2951, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 9.29% (0.3131 => 0.3422, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.28% (1.3245 => 1.4474, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.23% (0.6576 => 0.7183, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 9.17% (0.1657 => 0.1809, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 9.15% (1.2749 => 1.3916, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.12% (3.6692 => 4.0040, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 9.07% (0.2945 => 0.3212, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.97% (0.3511 => 0.3826, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 8.97% (14.8535 => 16.1855, std.dev.: 0.0140) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.90% (4.3801 => 4.7700, std.dev.: 0.0104) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.86% (4.4433 => 4.8368, std.dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.84% (1.5188 => 1.6530, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 8.80% (8.4961 => 9.2439, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.79% (0.2140 => 0.2328, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.69% (0.6135 => 0.6668, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 8.56% (0.6250 => 0.6785, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.37% (0.8818 => 0.9556, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.33% (0.1789 => 0.1938, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.30% (3.2742 => 3.5460, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.26% (0.9108 => 0.9860, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.19% (0.2321 => 0.2511, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.18% (0.4805 => 0.5198, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.15% (2.1007 => 2.2720, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.14% (1.1333 => 1.2255, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 8.13% (4.6629 => 5.0418, std.dev.: 0.0091) SingleSource/UnitTests/ObjC/parameter-passing: 8.07% (0.4003 => 0.4326, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 8.02% (0.4113 => 0.4443, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/neural/neural: 8.01% (0.1385 => 0.1496, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.92% (0.3245 => 0.3502, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 7.88% (3.7467 => 4.0419, std.dev.: 0.0060) SingleSource/UnitTests/ObjC/exceptions: 7.87% (0.3914 => 0.4222, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.79% (0.3940 => 0.4247, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 7.72% (6.5754 => 7.0831, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/oourafft: 7.72% (0.2008 => 0.2163, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 7.71% (0.3578 => 0.3854, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.71% (0.3789 => 0.4081, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.63% (0.2504 => 0.2695, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.57% (0.3646 => 0.3922, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 7.53% (0.3601 => 0.3872, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/synchronized: 7.51% (0.3663 => 0.3938, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.40% (0.3650 => 0.3920, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 7.40% (0.3623 => 0.3891, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 7.34% (1.2292 => 1.3194, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.32% (6.2785 => 6.7382, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.92% (13.2842 => 14.2031, std.dev.: 0.0217) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.49% (0.1819 => 0.1937, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 5.68% (0.1777 => 0.1878, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 5.62% (16.2614 => 17.1756, std.dev.: 0.0143) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.62% (0.2243 => 0.2369, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 4.69% (14.5298 => 15.2115, std.dev.: 0.0087) MultiSource/Benchmarks/Bullet/bullet: 2.12% (33.2944 => 34.0014, std.dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.36% (5.7573 => 7.5053, std.dev.: 0.0115) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 24.91% (1.8175 => 2.2703, std.dev.: 0.0426) SingleSource/Benchmarks/Misc/richards_benchmark: 11.20% (1.1560 => 1.2855, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 9.03% (0.8273 => 0.9020, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4145, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.34% (1.2998 => 1.3822, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0048, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.91% (11.2619 => 11.7028, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7748, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9851, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 3.38% (10.7476 => 11.1106, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.16% (7.4271 => 7.5872, std.dev.: 0.0061) MultiSource/Applications/lemon/lemon: 1.71% (1.4298 => 1.4543, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0507, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5140, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1859, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5779, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 1.12% (12.4560 => 12.5949, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.52% (0.2670 => 0.1428, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.53% (0.4657 => 0.3934, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -14.14% (0.0707 => 0.0607, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.96% (1.3819 => 1.2028, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.84% (1.3813 => 1.2040, std.dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.44% (0.0997 => 0.0863, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -11.97% (0.2238 => 0.1970, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.83% (1.2308 => 1.0975, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.15% (20.3410 => 18.2760, std.dev.: 0.0084) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.64% (1.3780 => 1.2865, std.dev.: 0.0139) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5148, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8005, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.00% (0.9996 => 0.9596, std.dev.: 0.0040) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.47% (1.7688 => 1.7075, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -3.42% (3.2729 => 3.1610, std.dev.: 0.0120) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.64% (26.5159 => 25.8154, std.dev.: 0.0260) SingleSource/Regression/C/uint64_to_float: -2.55% (0.5449 => 0.5310, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.46% (3.0263 => 2.9518, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.31% (1.9762 => 1.9306, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.90% (0.6589 => 0.6464, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7153, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/lists: -1.68% (6.3560 => 6.2492, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0070, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4941, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/heapsort: -1.24% (3.9173 => 3.8688, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.22% (0.8342 => 0.8240) MultiSource/Applications/lambda-0_1_3/lambda: -1.09% (5.3167 => 5.2585, std.dev.: 0.0017) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 16 15:46:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 16 Oct 2012 17:46:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121016224655.09DDD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4911?compare_to=4909&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4911, Order: 166056, Start Time: 2012-10-16 21:28:39, End Time: 2012-10-16 22:48:50 To: 4909, Order: 166040, Start Time: 2012-10-16 19:39:29, End Time: 2012-10-16 20:59:09 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (164 on baseline) Performance Improvements: 1 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 951 (680 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 10.48% (1.0947 => 1.2094, std.dev.: 0.0063) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.33% (2.5822 => 2.5478, std.dev.: 0.0007) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.39% (0.5950 => 0.5973, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 0.07% (16.4520 => 16.4630, std.dev.: 0.0085) MultiSource/Benchmarks/Bullet/bullet: -0.21% (54.6627 => 54.5471, std.dev.: 0.0070) MultiSource/Benchmarks/MallocBench/gs/gs: 0.29% (4.4424 => 4.4551, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0462 => 0.0462) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0462 => 0.0462, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.47% (0.0430 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0433 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.24% (0.0420 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0421 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.24% (0.0413 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.24% (0.0414 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.23% (0.0431 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.23% (0.0433 => 0.0434) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.23% (0.0426 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.23% (0.0427 => 0.0428, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.48% (0.0416 => 0.0418) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.24% (0.0417 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.47% (0.0422 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.24% (0.0424 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.23% (0.0434 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.46% (0.0435 => 0.0437, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.24% (0.0411 => 0.0412, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.49% (0.0411 => 0.0413) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.47% (0.0422 => 0.0424) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0424 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.24% (0.0414 => 0.0415, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0415 => 0.0415, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.25% (0.0406 => 0.0407, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.25% (0.0408 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.49% (0.0405 => 0.0407) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0406 => 0.0406, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.23% (0.0442 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0443 => 0.0443, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.25% (0.0404 => 0.0405, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.25% (0.0405 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.25% (0.0406 => 0.0407, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0408 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.24% (0.0413 => 0.0414, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.24% (0.0414 => 0.0415) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.10% (1.2587 => 1.2600, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.22% (7.9619 => 7.9792, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.29% (0.7473 => 0.7495, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.56% (0.0354 => 0.0352, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1439 => 0.1439) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.16% (0.0644 => 0.0645, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -13.75% (63.2438 => 54.5471, std.dev.: 0.0070) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.43% (14.1553 => 19.0284, std.dev.: 0.0237) SingleSource/Benchmarks/Misc-C++-EH/spirit: 64.74% (3.4629 => 5.7048, std.dev.: 0.0095) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14219.17% (0.0720 => 10.3098, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9972700.00% (0.0001 => 9.9728, std.dev.: 0.0013) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 59.24% (0.2554 => 0.4067, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 46.61% (10.3673 => 15.2000, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/richards_benchmark: 35.08% (0.1622 => 0.2191, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 33.14% (0.1056 => 0.1406, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 16.83% (0.1432 => 0.1673, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 16.16% (7.0540 => 8.1941, std.dev.: 0.0144) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.69% (2.2022 => 2.5478, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.20% (0.1566 => 0.1804, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.43% (0.0871 => 0.0988, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.47% (1.7609 => 1.9804, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 12.25% (0.3282 => 0.3684, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 12.06% (0.1584 => 0.1775, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 11.88% (0.1440 => 0.1611, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.66% (0.3543 => 0.3956, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 11.34% (0.3473 => 0.3867, std.dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: 11.26% (0.7433 => 0.8270, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/exceptions-4: 11.06% (0.3543 => 0.3935, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.03% (0.3927 => 0.4360, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.01% (0.3497 => 0.3882, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.98% (0.3561 => 0.3952, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 10.98% (0.7115 => 0.7896, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-3: 10.95% (0.3516 => 0.3901, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.94% (0.3694 => 0.4098, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/exceptions: 10.71% (0.3828 => 0.4238, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.71% (0.3886 => 0.4302, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.50% (0.6675 => 0.7376, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 10.47% (0.1175 => 0.1298, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.46% (0.1625 => 0.1795, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.26% (0.2700 => 0.2977, std.dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.24% (0.1143 => 0.1260, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 10.08% (3.3354 => 3.6715, std.dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: 10.07% (9.4845 => 10.4400, std.dev.: 0.0079) SingleSource/Benchmarks/McGill/chomp: 9.97% (0.1655 => 0.1820, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.95% (0.3177 => 0.3493, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.94% (0.1438 => 0.1581, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.93% (1.5415 => 1.6946, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/em3d/em3d: 9.85% (0.1695 => 0.1862, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.83% (0.5105 => 0.5607, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 9.82% (10.4361 => 11.4610, std.dev.: 0.0164) MultiSource/Benchmarks/McCat/18-imp/imp: 9.82% (0.3423 => 0.3759, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.71% (0.4615 => 0.5063, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.63% (0.1236 => 0.1355, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 9.49% (0.3109 => 0.3404, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.45% (0.4879 => 0.5340, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.40% (0.3307 => 0.3618, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 9.39% (0.1555 => 0.1701, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 9.39% (0.6456 => 0.7062, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.38% (0.2271 => 0.2484, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/mst/mst: 9.37% (0.1163 => 0.1272, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.37% (4.2646 => 4.6640, std.dev.: 0.0025) MultiSource/Applications/Burg/burg: 9.35% (1.1642 => 1.2730, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.33% (0.1940 => 0.2121, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.30% (0.5860 => 0.6405, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 9.30% (0.1151 => 0.1258, std.dev.: 0.0015) MultiSource/Applications/lua/lua: 9.24% (3.8723 => 4.2300, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.21% (0.1510 => 0.1649, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.20% (0.3121 => 0.3408, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.14% (0.2758 => 0.3010, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.13% (1.3050 => 1.4241, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 9.07% (5.7591 => 6.2817, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.03% (0.5569 => 0.6072, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.02% (0.8067 => 0.8795, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.98% (0.8172 => 0.8906, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: 8.97% (1.5603 => 1.7002, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.96% (0.2065 => 0.2250, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.92% (0.2107 => 0.2295, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 8.92% (0.3387 => 0.3689, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.88% (0.5020 => 0.5466, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.86% (0.9765 => 1.0630, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.82% (5.0018 => 5.4429, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.81% (4.9449 => 5.3807, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.81% (8.1363 => 8.8529, std.dev.: 0.0038) MultiSource/Applications/spiff/spiff: 8.79% (0.7835 => 0.8524, std.dev.: 0.0038) MultiSource/Applications/lemon/lemon: 8.75% (1.0722 => 1.1660, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 8.68% (2.0273 => 2.2033, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 8.66% (0.6030 => 0.6552, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.62% (1.5859 => 1.7226, std.dev.: 0.0033) SingleSource/UnitTests/ObjC++/Hello: 8.61% (0.5925 => 0.6435, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.52% (0.7326 => 0.7950, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.51% (0.4103 => 0.4452, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.41% (0.3865 => 0.4190, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.38% (0.1337 => 0.1449, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 8.34% (2.2969 => 2.4884, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.30% (0.4203 => 0.4552, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 8.30% (0.3180 => 0.3444, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 8.21% (0.4289 => 0.4641, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.18% (0.4636 => 0.5015, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 8.12% (0.3422 => 0.3700, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: 8.12% (0.1268 => 0.1371, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.11% (7.9617 => 8.6072, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/hash2: 7.88% (0.4620 => 0.4984, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.86% (2.2024 => 2.3755, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.75% (0.3650 => 0.3933, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.74% (1.1861 => 1.2779, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.73% (0.3441 => 0.3707, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: 7.71% (0.4048 => 0.4360, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 7.63% (0.3603 => 0.3878, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.55% (0.1695 => 0.1823, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.49% (0.6450 => 0.6933, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.45% (0.2603 => 0.2797, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.45% (0.3826 => 0.4111, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 7.30% (0.2905 => 0.3117, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 7.25% (0.3684 => 0.3951, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.24% (0.3136 => 0.3363, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 7.18% (0.1463 => 0.1568, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 7.17% (0.8921 => 0.9561, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: 7.09% (0.4299 => 0.4604, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.09% (0.5981 => 0.6405, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 7.06% (21.9371 => 23.4857, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/strcat: 7.03% (0.2831 => 0.3030, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary: 6.96% (0.3232 => 0.3457, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.96% (0.3162 => 0.3382, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.95% (0.2891 => 0.3092, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.90% (2.0665 => 2.2091, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 6.82% (0.3283 => 0.3507, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.80% (1.4186 => 1.5150, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/except: 6.69% (0.2871 => 0.3063, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.65% (0.2872 => 0.3063, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.61% (0.2725 => 0.2905, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.60% (0.2756 => 0.2938, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.52% (0.2714 => 0.2891, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 6.52% (0.3098 => 0.3300, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.52% (0.3052 => 0.3251, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 6.50% (0.2877 => 0.3064, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.50% (0.2802 => 0.2984, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.42% (0.4064 => 0.4325, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.41% (0.2793 => 0.2972, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 6.36% (0.3379 => 0.3594, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 6.35% (1.1840 => 1.2592, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.09% (0.1906 => 0.2022, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.76% (0.1892 => 0.2001, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.65% (0.8101 => 0.8559, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.52% (0.2266 => 0.2391, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.18% (14.3668 => 15.1114, std.dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: 5.10% (1.2842 => 1.3497, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 5.05% (0.3131 => 0.3289, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 5.03% (0.2049 => 0.2152, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 4.87% (17.1811 => 18.0186, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.55% (0.3427 => 0.3583, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.12% (0.2430 => 0.2530, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.10% (3.8922 => 4.0516, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.43% (0.3817 => 0.3948, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.47% (1.1194 => 1.1471, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.38% (0.2944 => 0.3279, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.74% (2.6778 => 2.9653, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.93% (1.1396 => 1.2528, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Puzzle: 9.85% (0.1421 => 0.1561, std.dev.: 0.0021) MultiSource/Applications/aha/aha: 9.23% (3.1595 => 3.4510, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.70% (3.1578 => 3.3694, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.57% (3.6395 => 3.7695, std.dev.: 0.0061) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.74% (4.2280 => 4.3437, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7652, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.70% (0.8275 => 0.8416, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.63% (9.1159 => 9.2646, std.dev.: 0.0136) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.35% (11.6436 => 11.8008, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.05% (2.6546 => 2.6826, std.dev.: 0.0052) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1308, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -80.28% (0.8651 => 0.1706, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.45% (5.2763 => 3.2473, std.dev.: 0.0091) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.31% (5.3855 => 3.6452, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.94% (5.3526 => 3.6428, std.dev.: 0.0038) SingleSource/UnitTests/Vector/constpool: -14.67% (54.1659 => 46.2191, std.dev.: 0.0213) MultiSource/Applications/ClamAV/clamscan: -12.37% (22.1758 => 19.4320, std.dev.: 0.0229) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.10% (2.9384 => 2.6123, std.dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7652, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: -15.88% (1.6925 => 1.4238, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.73% (0.0998 => 0.0861, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -10.41% (1.5373 => 1.3772, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/mason/mason: -9.25% (0.2161 => 0.1961, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.38% (19.9488 => 18.2768, std.dev.: 0.0964) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.69% (1.8329 => 1.7103, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.30% (1.6805 => 1.5915, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7963, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: -4.55% (1.5835 => 1.5114, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.23% (0.9957 => 0.9536, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.56% (3.2827 => 3.1657, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4976, std.dev.: 0.0093) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0987, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/chomp: -2.25% (1.2373 => 1.2094, std.dev.: 0.0063) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.05% (8.1563 => 7.9892, std.dev.: 0.0238) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.96% (8.6802 => 8.5102, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6794, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -1.69% (10.2830 => 10.1092, std.dev.: 0.0126) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5123, std.dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4205, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: -1.36% (4.6441 => 4.5809, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/lists: -1.17% (6.2999 => 6.2265, std.dev.: 0.0079) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2878, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 14.23% (0.5229 => 0.5973, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 9.83% (14.9895 => 16.4630, std.dev.: 0.0085) MultiSource/Benchmarks/MallocBench/gs/gs: 8.38% (4.1105 => 4.4551, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.05% (1.1048 => 1.2600, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.47% (7.1582 => 7.9792, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/stepanov_container: 20.46% (0.6222 => 0.7495, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35100.00% (0.0001 => 0.0352, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.10% (0.1485 => 0.1439) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.52% (0.2116 => 0.0645, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 16 16:13:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 16 Oct 2012 18:13:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121016231357.406DD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4912?compare_to=4910&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4912, Order: 166059, Start Time: 2012-10-16 21:51:00, End Time: 2012-10-16 23:16:52 To: 4910, Order: 166040, Start Time: 2012-10-16 19:55:54, End Time: 2012-10-16 21:21:53 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (189 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1040 (678 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 11.45% (1.0975 => 1.2232, std.dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.37% (0.3826 => 0.3697, std.dev.: 0.0040) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.23% (2.0176 => 2.4862, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.44% (0.1410 => 0.1670, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 17.48% (0.2243 => 0.2635, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 17.07% (0.0826 => 0.0967, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.54% (0.0653 => 0.0761, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 14.41% (0.1013 => 0.1159, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.90% (0.1072 => 0.1221, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.79% (0.0834 => 0.0949, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.66% (0.1413 => 0.1606, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.49% (0.1327 => 0.1506, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.48% (0.2596 => 0.2946, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 13.17% (0.7038 => 0.7965, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 13.12% (1.3693 => 1.5490, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.07% (0.0964 => 0.1090, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.93% (3.9660 => 4.4790, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 12.85% (0.4328 => 0.4884, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hash: 12.63% (0.4062 => 0.4575, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.50% (0.2721 => 0.3061, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.47% (0.1588 => 0.1786, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 12.45% (13.8202 => 15.5409, std.dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.38% (0.6283 => 0.7061, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/distray/distray: 12.35% (0.0818 => 0.0919, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.34% (0.6959 => 0.7818, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.26% (1.4563 => 1.6348, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.16% (0.5265 => 0.5905, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.15% (0.7710 => 0.8647, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.12% (0.9199 => 1.0314, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 11.96% (0.1003 => 0.1123, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 11.96% (0.1062 => 0.1189) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.92% (1.2193 => 1.3647, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.67% (0.1157 => 0.1292, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.66% (0.5577 => 0.6227, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.62% (1.1364 => 1.2684, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.61% (0.3022 => 0.3373, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.59% (0.3899 => 0.4351, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 11.46% (0.5818 => 0.6485, std.dev.: 0.0086) MultiSource/Applications/lemon/lemon: 11.38% (1.0313 => 1.1487, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 11.36% (1.1061 => 1.2317, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 11.35% (0.1075 => 0.1197, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.29% (0.4791 => 0.5332, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.19% (0.3485 => 0.3875, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 11.08% (0.5748 => 0.6385, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 11.05% (0.3293 => 0.3657, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.05% (0.3756 => 0.4171, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.01% (0.4016 => 0.4458, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.95% (0.0977 => 0.1084, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.93% (0.3130 => 0.3472, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 10.91% (16.6129 => 18.4256, std.dev.: 0.0091) MultiSource/Benchmarks/Olden/mst/mst: 10.89% (0.1111 => 0.1232, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 10.88% (0.6744 => 0.7478, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference: 10.85% (0.7061 => 0.7827, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.80% (0.4390 => 0.4864, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 10.79% (0.2781 => 0.3081, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.71% (0.4379 => 0.4848, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.69% (0.3489 => 0.3862, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.60% (0.8698 => 0.9620, std.dev.: 0.0020) MultiSource/Applications/viterbi/viterbi: 10.55% (0.1478 => 0.1634, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.55% (0.1014 => 0.1121, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 10.55% (0.2995 => 0.3311, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 10.54% (0.3453 => 0.3817, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.53% (0.2127 => 0.2351, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 10.51% (0.1589 => 0.1756, std.dev.: 0.0063) MultiSource/Applications/siod/siod: 10.48% (2.1791 => 2.4074, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 10.47% (3.8646 => 4.2694, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.46% (0.2782 => 0.3073, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 10.44% (0.3868 => 0.4272, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.44% (0.3246 => 0.3585, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/18-imp/imp: 10.43% (0.3220 => 0.3556, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 10.42% (0.2726 => 0.3010, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.38% (0.2966 => 0.3274, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.37% (0.1986 => 0.2192, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.36% (0.2914 => 0.3216, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.36% (0.3580 => 0.3951, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 10.36% (0.3534 => 0.3900, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.35% (0.1865 => 0.2058, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 10.34% (1.9270 => 2.1262, std.dev.: 0.0043) MultiSource/Applications/spiff/spiff: 10.30% (0.7506 => 0.8279, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.26% (0.1569 => 0.1730, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 10.26% (0.3149 => 0.3472, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 10.18% (0.2760 => 0.3041, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.16% (1.9828 => 2.1842, std.dev.: 0.0043) MultiSource/Applications/d/make_dparser: 10.15% (3.1889 => 3.5127, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/ary: 10.14% (0.3107 => 0.3422, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.13% (0.7460 => 0.8216, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.13% (0.2023 => 0.2228, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.13% (0.5637 => 0.6208, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.06% (0.2655 => 0.2922, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 10.02% (0.2925 => 0.3218, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 10.01% (0.8310 => 0.9142, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.98% (0.2765 => 0.3041, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.98% (7.2180 => 7.9381, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/random: 9.96% (0.2690 => 0.2958, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 9.93% (0.2607 => 0.2866, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 9.89% (0.2761 => 0.3034, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 9.87% (0.3192 => 0.3507, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 9.84% (0.2937 => 0.3226, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 9.82% (0.2628 => 0.2886, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.80% (4.9865 => 5.4754, std.dev.: 0.0053) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.76% (0.1435 => 0.1575, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 9.61% (0.2988 => 0.3275, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.50% (0.2696 => 0.2952, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.48% (0.1276 => 0.1397, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.45% (0.3755 => 0.4110, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 9.41% (0.1657 => 0.1813, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 9.31% (1.0594 => 1.1580, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: 9.26% (0.3131 => 0.3421, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.18% (4.3801 => 4.7822, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.15% (1.3245 => 1.4457, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.04% (3.6692 => 4.0009, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.95% (4.4433 => 4.8411, std.dev.: 0.0093) MultiSource/Applications/SIBsim4/SIBsim4: 8.90% (1.2749 => 1.3884, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 8.90% (0.2945 => 0.3207, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 8.84% (14.8535 => 16.1669, std.dev.: 0.0116) MultiSource/Benchmarks/mafft/pairlocalalign: 8.66% (8.4961 => 9.2319, std.dev.: 0.0167) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.61% (0.1789 => 0.1943, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.59% (1.5188 => 1.6493, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.57% (0.6135 => 0.6661, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 8.54% (0.4003 => 0.4345, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 8.51% (0.6250 => 0.6782, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.49% (0.2321 => 0.2518, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.46% (0.2140 => 0.2321, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 8.41% (0.1213 => 0.1315, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.33% (0.3914 => 0.4240, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.25% (0.3940 => 0.4265, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.23% (0.3245 => 0.3512, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 8.16% (0.3578 => 0.3870, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.16% (0.3789 => 0.4098, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.14% (0.8818 => 0.9536, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.12% (0.4805 => 0.5195, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.11% (0.6576 => 0.7109, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.10% (1.1333 => 1.2251, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-4: 8.04% (0.3646 => 0.3939, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.00% (0.3663 => 0.3956, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.98% (0.9108 => 0.9835, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.97% (3.2742 => 3.5352, std.dev.: 0.0110) MultiSource/Benchmarks/McCat/05-eks/eks: 7.95% (0.4113 => 0.4440, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.94% (0.3601 => 0.3887, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 7.94% (0.1385 => 0.1495, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.85% (2.1007 => 2.2657, std.dev.: 0.0027) MultiSource/Applications/lua/lua: 7.85% (3.7467 => 4.0409, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/exceptions-3: 7.84% (0.3623 => 0.3907, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.84% (0.3650 => 0.3936, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 7.74% (4.6629 => 5.0238, std.dev.: 0.0043) MultiSource/Applications/JM/ldecod/ldecod: 7.57% (6.5754 => 7.0730, std.dev.: 0.0079) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.42% (6.2785 => 6.7444, std.dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: 7.36% (1.2292 => 1.3197, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.35% (0.2504 => 0.2688, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 7.32% (0.2008 => 0.2155, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.89% (13.2842 => 14.1999, std.dev.: 0.0182) SingleSource/Benchmarks/Misc/ReedSolomon: 6.58% (0.1777 => 0.1894, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.27% (0.1819 => 0.1933, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.35% (0.2243 => 0.2363, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 5.32% (16.2614 => 17.1270, std.dev.: 0.0208) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.30% (0.3511 => 0.3697, std.dev.: 0.0040) MultiSource/Applications/ClamAV/clamscan: 4.53% (14.5298 => 15.1886, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/bh/bh: 3.81% (0.2859 => 0.2968, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 2.03% (33.2944 => 33.9712, std.dev.: 0.0105) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.85% (0.4846 => 0.6971, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5143, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.07% (1.0895 => 1.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 23.80% (1.8175 => 2.2500, std.dev.: 0.0265) SingleSource/Benchmarks/Misc/richards_benchmark: 11.04% (1.1560 => 1.2836, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1915, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 8.99% (0.8273 => 0.9017, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4144, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.29% (1.2998 => 1.3816, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9998, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0047, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.92% (11.2619 => 11.7031, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.89% (1.7081 => 1.7746, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 3.48% (1.9199 => 1.9868, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 2.80% (10.7476 => 11.0486, std.dev.: 0.0396) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.14% (7.4271 => 7.5860, std.dev.: 0.0053) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4540, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0497, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5135, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.37% (1.9433 => 1.9700, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1860, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 1.20% (5.5130 => 5.5789, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 1.09% (12.4560 => 12.5914, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.93% (0.2670 => 0.1417, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.18% (0.4657 => 0.3950, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.31% (1.3813 => 1.1975, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.24% (1.3819 => 1.1990, std.dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.64% (0.0997 => 0.0861, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -11.26% (0.2238 => 0.1986, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.14% (20.3410 => 18.2776, std.dev.: 0.0182) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.76% (1.3780 => 1.2986, std.dev.: 0.0095) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.16% (2.6470 => 2.5104, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.50% (0.9996 => 0.9546, std.dev.: 0.0066) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0011) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1562, std.dev.: 0.0119) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.36% (1.7688 => 1.7094, std.dev.: 0.0047) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.04% (0.4867 => 0.4719, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.61% (26.5159 => 25.8246, std.dev.: 0.0302) SingleSource/Regression/C/uint64_to_float: -2.55% (0.5449 => 0.5310, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.54% (3.0263 => 2.9495, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783) MultiSource/Benchmarks/Olden/bh/bh: -2.38% (1.9762 => 1.9291, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/Shootout/lists: -2.05% (6.3560 => 6.2257, std.dev.: 0.0118) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.00% (0.6615 => 0.6483) MultiSource/Benchmarks/mafft/pairlocalalign: -1.90% (28.2225 => 27.6876, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.87% (0.6589 => 0.6466, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.64% (7.1097 => 6.9928, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.50% (3.9173 => 3.8587, std.dev.: 0.0054) MultiSource/Applications/minisat/minisat: -1.45% (9.3358 => 9.2003, std.dev.: 0.0153) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.23% (0.8342 => 0.8239, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4952, std.dev.: 0.0006) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 16 18:11:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 16 Oct 2012 20:11:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121017011153.E104D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4913?compare_to=4912&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4913, Order: 166069, Start Time: 2012-10-16 23:46:09, End Time: 2012-10-17 01:11:53 To: 4912, Order: 166059, Start Time: 2012-10-16 21:51:00, End Time: 2012-10-16 23:16:52 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (186 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1041 (679 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -10.38% (1.2232 => 1.0962, std.dev.: 0.0079) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.93% (2.0176 => 2.5005, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.58% (0.1410 => 0.1672, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 17.31% (0.0826 => 0.0969, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.30% (0.0653 => 0.0766, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 16.76% (0.2243 => 0.2619, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.11% (0.1072 => 0.1234, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 14.22% (0.1013 => 0.1157, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.55% (0.0834 => 0.0947) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.45% (0.1413 => 0.1603, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.34% (0.1327 => 0.1504, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 13.21% (0.7038 => 0.7968, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 12.91% (1.3693 => 1.5461, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.86% (0.0964 => 0.1088, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.68% (3.9660 => 4.4690, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.64% (0.2721 => 0.3065, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 12.64% (0.4328 => 0.4875, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 12.63% (0.4062 => 0.4575, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.48% (0.2596 => 0.2920, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.47% (0.1588 => 0.1786, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.28% (0.0977 => 0.1097, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 12.15% (0.1062 => 0.1191, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.10% (0.6959 => 0.7801, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.06% (0.6283 => 0.7041, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 12.06% (13.8202 => 15.4865, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.97% (1.4563 => 1.6306, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.90% (0.9199 => 1.0294, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.87% (0.5265 => 0.5890, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 11.86% (0.1003 => 0.1122, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.85% (0.7710 => 0.8624, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.70% (1.2193 => 1.3620, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.68% (0.3022 => 0.3375, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.54% (0.3899 => 0.4349, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.41% (0.1157 => 0.1289, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.40% (1.1364 => 1.2660, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 11.36% (0.5818 => 0.6479, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.10% (0.3485 => 0.3872, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 11.09% (1.1061 => 1.2288, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.06% (0.4791 => 0.5321, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.02% (0.3130 => 0.3475, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 11.01% (0.5748 => 0.6381, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 11.00% (1.0313 => 1.1447, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 10.93% (0.2781 => 0.3085, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.88% (0.4016 => 0.4453, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 10.84% (16.6129 => 18.4141, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.83% (0.5577 => 0.6181, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.77% (0.4390 => 0.4863, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.76% (0.3756 => 0.4160, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.68% (0.2782 => 0.3079, std.dev.: 0.0086) MultiSource/Applications/minisat/minisat: 10.66% (0.6744 => 0.7463, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.66% (0.1276 => 0.1412, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.64% (0.2914 => 0.3224, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 10.62% (0.1111 => 0.1229, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.59% (0.3580 => 0.3959, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.58% (0.3489 => 0.3858, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 10.57% (0.3293 => 0.3641, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 10.55% (0.7061 => 0.7806, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.52% (0.1986 => 0.2195, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.51% (0.1075 => 0.1188, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 10.48% (0.3453 => 0.3815, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 10.47% (0.3868 => 0.4273, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.44% (0.4379 => 0.4836, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 10.37% (3.8646 => 4.2654, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.32% (0.3246 => 0.3581, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.30% (0.8698 => 0.9594, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.28% (1.9828 => 2.1866, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 10.26% (0.1589 => 0.1752, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.24% (0.2655 => 0.2927, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 10.24% (0.2607 => 0.2874, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.24% (0.1865 => 0.2056, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 10.24% (2.1791 => 2.4022, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/strcat: 10.23% (0.2726 => 0.3005, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.20% (0.2127 => 0.2344, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 10.19% (0.2690 => 0.2964, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.18% (0.2966 => 0.3268, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.13% (0.7460 => 0.8216, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/18-imp/imp: 10.12% (0.3220 => 0.3546, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 10.11% (0.2937 => 0.3234, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 10.08% (0.2995 => 0.3297, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 10.08% (0.1478 => 0.1627, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 10.07% (3.1889 => 3.5100, std.dev.: 0.0095) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.06% (0.1014 => 0.1116, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 10.02% (0.3534 => 0.3888, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 10.02% (1.9270 => 2.1200, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 10.00% (0.3149 => 0.3464, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 10.00% (0.2760 => 0.3036, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/fibo: 9.97% (0.2628 => 0.2890, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.97% (0.1435 => 0.1578, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 9.96% (0.2761 => 0.3036, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 9.95% (0.7506 => 0.8253, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary: 9.95% (0.3107 => 0.3416, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 9.91% (0.2925 => 0.3215, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.88% (0.5637 => 0.6194, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.88% (0.1569 => 0.1724, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.87% (0.2765 => 0.3038, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 9.82% (1.0594 => 1.1634, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/football/football: 9.75% (0.8310 => 0.9120, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.74% (0.2023 => 0.2220, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 9.71% (0.3192 => 0.3502, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.68% (0.2696 => 0.2957, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 9.50% (0.2988 => 0.3272, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.45% (0.3755 => 0.4110, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.45% (7.2180 => 7.9002, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.43% (4.9865 => 5.4567, std.dev.: 0.0141) MultiSource/Benchmarks/Olden/em3d/em3d: 9.17% (0.1657 => 0.1809, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 9.07% (0.2945 => 0.3212, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.97% (1.3245 => 1.4433, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.88% (3.6692 => 3.9949, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.79% (0.6576 => 0.7154, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 8.71% (1.2749 => 1.3859, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 8.69% (0.3131 => 0.3403, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 8.67% (14.8535 => 16.1413, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.66% (1.5188 => 1.6504, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.66% (4.3801 => 4.7593, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.58% (4.4433 => 4.8245, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.51% (0.6135 => 0.6657, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.40% (0.2321 => 0.2516, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.36% (0.2140 => 0.2319, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 8.31% (8.4961 => 9.2018, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/bigfib: 8.30% (0.6250 => 0.6769, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 8.18% (4.6629 => 5.0445, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.17% (3.2742 => 3.5418, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.15% (0.8818 => 0.9537, std.dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.11% (0.1789 => 0.1934, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.94% (0.9108 => 0.9831, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.84% (1.1333 => 1.2222, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.80% (2.1007 => 2.2646, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.72% (0.4805 => 0.5176, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.72% (0.4003 => 0.4312, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 7.69% (3.7467 => 4.0348, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/neural/neural: 7.65% (0.1385 => 0.1491, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 7.61% (0.4113 => 0.4426, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.55% (0.3245 => 0.3490, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.49% (0.3914 => 0.4207, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.46% (0.3511 => 0.3773, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 7.46% (0.3940 => 0.4234, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 7.36% (6.5754 => 7.0596, std.dev.: 0.0072) MultiSource/Applications/hexxagon/hexxagon: 7.31% (1.2292 => 1.3190, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 7.29% (0.3578 => 0.3839, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 7.27% (0.2008 => 0.2154, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.23% (0.3789 => 0.4063, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.23% (0.2504 => 0.2685, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.15% (0.1819 => 0.1949, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 7.13% (0.3663 => 0.3924, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.10% (0.3646 => 0.3905, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.08% (0.3601 => 0.3856, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 6.98% (0.3623 => 0.3876, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.94% (6.2785 => 6.7141, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.88% (0.3650 => 0.3901, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.43% (13.2842 => 14.1382, std.dev.: 0.0103) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.48% (0.2243 => 0.2366, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 5.25% (16.2614 => 17.1147, std.dev.: 0.0130) MultiSource/Applications/ClamAV/clamscan: 4.30% (14.5298 => 15.1550, std.dev.: 0.0073) MultiSource/Benchmarks/Bullet/bullet: 2.36% (33.2944 => 34.0785, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5159, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.14% (1.8175 => 2.2563, std.dev.: 0.0146) SingleSource/Benchmarks/Misc/richards_benchmark: 11.23% (1.1560 => 1.2858, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 8.97% (0.8273 => 0.9015, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.61% (3.1736 => 3.4151, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.35% (1.2998 => 1.3824, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9998, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0050, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.91% (11.2619 => 11.7020, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9858, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 3.43% (10.7476 => 11.1160, std.dev.: 0.0751) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.12% (7.4271 => 7.5849, std.dev.: 0.0040) MultiSource/Applications/lemon/lemon: 1.70% (1.4298 => 1.4541, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.45% (2.1753 => 2.2069, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5122, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9692, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1871, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 1.20% (5.5130 => 5.5792, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.14% (8.8259 => 8.9261, std.dev.: 0.0221) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5909, std.dev.: 0.0056) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.74% (0.2670 => 0.1422, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.83% (0.4657 => 0.3920, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -14.29% (0.0707 => 0.0606, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.14% (1.3813 => 1.1998, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.10% (1.3819 => 1.2009, std.dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.31% (1.0460 => 0.8545, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.64% (0.0997 => 0.0861, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -12.11% (0.2238 => 0.1967, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.94% (1.2308 => 1.0962, std.dev.: 0.0079) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.15% (20.3410 => 18.2760, std.dev.: 0.0160) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.84% (1.3780 => 1.2975, std.dev.: 0.0091) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.60% (0.9996 => 0.9536, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8001, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.56% (3.2729 => 3.1563, std.dev.: 0.0259) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.47% (1.7688 => 1.7074, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.55% (26.5159 => 25.8396, std.dev.: 0.0200) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.46% (3.0263 => 2.9518, std.dev.: 0.0013) SingleSource/Regression/C/uint64_to_float: -2.39% (0.5449 => 0.5319, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/bh/bh: -2.37% (1.9762 => 1.9294, std.dev.: 0.0043) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.96% (0.6589 => 0.6460, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7134, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/lists: -1.72% (6.3560 => 6.2468, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0076, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8659, std.dev.: 0.0160) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.23% (0.8342 => 0.8239, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4953, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.11% (5.3167 => 5.2579, std.dev.: 0.0007) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 16 19:34:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 16 Oct 2012 21:34:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121017023414.87A782A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4914?compare_to=4911&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4914, Order: 166080, Start Time: 2012-10-17 01:16:15, End Time: 2012-10-17 02:36:09 To: 4911, Order: 166056, Start Time: 2012-10-16 21:28:39, End Time: 2012-10-16 22:48:50 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 4 (162 on baseline) Performance Improvements: 4 (44 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 945 (681 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 2.71% (19.4320 => 19.9585, std.dev.: 0.0109) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.05% (2.5478 => 2.5746, std.dev.: 0.0039) MultiSource/Benchmarks/PAQ8p/paq8p: 1.04% (15.2000 => 15.3575, std.dev.: 0.0038) MultiSource/Applications/JM/ldecod/ldecod: 1.01% (11.4610 => 11.5763, std.dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.10% (2.2091 => 2.1849, std.dev.: 0.0084) MultiSource/Applications/hbd/hbd: -1.09% (1.7002 => 1.6817, std.dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -9.23% (1.2094 => 1.0978, std.dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.14% (1.3114 => 1.2964, std.dev.: 0.0040) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.57% (0.5973 => 0.5939, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -0.24% (16.4630 => 16.4233, std.dev.: 0.0110) MultiSource/Benchmarks/Bullet/bullet: 1.39% (54.5471 => 55.3072, std.dev.: 0.0231) MultiSource/Benchmarks/MallocBench/gs/gs: -0.54% (4.4551 => 4.4311, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.43% (0.0462 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0462 => 0.0462) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.69% (0.0432 => 0.0429, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.46% (0.0433 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.24% (0.0421 => 0.0420) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0421 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.48% (0.0414 => 0.0412, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.24% (0.0415 => 0.0414, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.23% (0.0432 => 0.0431, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.46% (0.0434 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.47% (0.0427 => 0.0425, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.47% (0.0428 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.48% (0.0418 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.48% (0.0418 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.71% (0.0424 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.24% (0.0425 => 0.0424) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.69% (0.0435 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.23% (0.0437 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.73% (0.0412 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.73% (0.0413 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.71% (0.0424 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.24% (0.0424 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.24% (0.0415 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.24% (0.0415 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.49% (0.0407 => 0.0405, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.73% (0.0409 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.49% (0.0407 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0406 => 0.0406, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.45% (0.0443 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.23% (0.0443 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.49% (0.0405 => 0.0403, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.49% (0.0406 => 0.0404, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.25% (0.0407 => 0.0406) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.49% (0.0408 => 0.0406, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.24% (0.0414 => 0.0413) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.48% (0.0415 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.09% (1.2600 => 1.2589, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.73% (7.9792 => 7.9212, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.68% (0.7495 => 0.7444, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 2.56% (0.0352 => 0.0361, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -0.42% (0.1439 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 234.57% (0.0645 => 0.2158, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.55% (63.2438 => 55.3072, std.dev.: 0.0231) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 33.43% (14.1553 => 18.8880, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++-EH/spirit: 63.88% (3.4629 => 5.6749, std.dev.: 0.0012) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14234.31% (0.0720 => 10.3207, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9975400.00% (0.0001 => 9.9755, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 58.93% (0.2554 => 0.4059, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 48.13% (10.3673 => 15.3575, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/richards_benchmark: 34.65% (0.1622 => 0.2184, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 32.67% (0.1056 => 0.1401, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 17.88% (0.1432 => 0.1688, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.91% (2.2022 => 2.5746, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 16.75% (7.0540 => 8.2357, std.dev.: 0.0081) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.01% (0.1566 => 0.1801, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.86% (0.0871 => 0.0983, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.66% (1.7609 => 1.9839, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 12.43% (0.3282 => 0.3690, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.68% (0.1584 => 0.1769, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 11.53% (0.1440 => 0.1606, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 10.93% (10.4361 => 11.5763, std.dev.: 0.0034) MultiSource/Applications/minisat/minisat: 10.56% (0.7115 => 0.7866, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.50% (0.3543 => 0.3915, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.34% (0.6675 => 0.7365, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 10.27% (0.7433 => 0.8196, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.21% (0.1117 => 0.1231, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.08% (0.3473 => 0.3823, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 10.04% (0.1175 => 0.1293) SingleSource/UnitTests/ObjC/parameter-passing: 10.03% (0.3927 => 0.4321, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.99% (0.5105 => 0.5615, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 9.98% (0.3516 => 0.3867, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.96% (0.3543 => 0.3896, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 9.94% (0.3561 => 0.3915, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 9.92% (0.3497 => 0.3844, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 9.90% (0.3828 => 0.4207, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.86% (0.4879 => 0.5360, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 9.85% (9.4845 => 10.4185, std.dev.: 0.0050) MultiSource/Applications/sgefa/sgefa: 9.84% (0.3109 => 0.3415, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/property: 9.83% (0.3886 => 0.4268, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/for-in: 9.83% (0.3694 => 0.4057, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.81% (0.1438 => 0.1579, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 9.79% (0.1655 => 0.1817, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.78% (0.1125 => 0.1235, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.71% (1.5415 => 1.6912, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.70% (0.2700 => 0.2962, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.66% (0.1625 => 0.1782) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.57% (0.3177 => 0.3481, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 9.50% (3.3354 => 3.6522, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 9.38% (0.3423 => 0.3744, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.34% (0.4615 => 0.5046, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/em3d/em3d: 9.32% (0.1695 => 0.1853, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.30% (0.2065 => 0.2257, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.05% (4.2646 => 4.6506, std.dev.: 0.0096) MultiSource/Applications/aha/aha: 9.04% (0.1151 => 0.1255, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.03% (0.2271 => 0.2476, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 9.01% (5.7591 => 6.2782, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.01% (0.5860 => 0.6388, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.96% (4.9449 => 5.3881, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.90% (0.1236 => 0.1346, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 8.87% (0.1555 => 0.1693, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.86% (0.1163 => 0.1266, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.84% (1.3050 => 1.4204, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.81% (0.1510 => 0.1643, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 8.76% (1.1642 => 1.2662, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.74% (0.8067 => 0.8772, std.dev.: 0.0040) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.72% (0.3121 => 0.3393, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.71% (0.5569 => 0.6054, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 8.69% (3.8723 => 4.2087, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.66% (0.1940 => 0.2108, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 8.55% (0.6456 => 0.7008, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.51% (0.9765 => 1.0596, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.50% (0.2107 => 0.2286, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.48% (0.2758 => 0.2992, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.48% (0.8172 => 0.8865, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.47% (5.0018 => 5.4255, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.44% (0.3307 => 0.3586, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 8.39% (0.3387 => 0.3671, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 8.36% (0.7835 => 0.8490, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.31% (8.1363 => 8.8126, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.30% (0.1337 => 0.1448, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.29% (0.5020 => 0.5436, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 8.24% (1.0722 => 1.1606, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.22% (1.5859 => 1.7163, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 8.08% (2.0273 => 2.1912, std.dev.: 0.0023) MultiSource/Applications/hbd/hbd: 7.78% (1.5603 => 1.6817, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 7.69% (2.2969 => 2.4736, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/09-vor/vor: 7.61% (0.3180 => 0.3422, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.61% (7.9617 => 8.5672, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.44% (2.2024 => 2.3662, std.dev.: 0.0074) MultiSource/Applications/JM/lencod/lencod: 7.42% (21.9371 => 23.5657, std.dev.: 0.0212) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.41% (0.3441 => 0.3696, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.38% (0.2603 => 0.2795, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.37% (1.1861 => 1.2735, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.36% (0.6030 => 0.6474, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.29% (0.4103 => 0.4402, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.24% (0.5925 => 0.6354, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.17% (0.3865 => 0.4142, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.16% (0.6450 => 0.6912, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/football/football: 7.14% (0.8921 => 0.9558, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.08% (0.1695 => 0.1815, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.04% (0.4289 => 0.4591, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 6.98% (0.3422 => 0.3661, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.97% (0.4203 => 0.4496, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.95% (0.4636 => 0.4958, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash2: 6.90% (0.4620 => 0.4939, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/neural/neural: 6.90% (0.1463 => 0.1564, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.84% (0.5981 => 0.6390, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/moments: 6.79% (0.4048 => 0.4323, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 6.77% (0.4299 => 0.4590, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 6.72% (0.7326 => 0.7818, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ary3: 6.58% (0.3283 => 0.3499, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.36% (0.3650 => 0.3882, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.30% (0.3826 => 0.4067, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.27% (1.4186 => 1.5076, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 6.24% (0.3603 => 0.3828, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 6.19% (0.3684 => 0.3912, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.17% (1.1840 => 1.2571, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 6.10% (0.2049 => 0.2174, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 5.86% (0.2831 => 0.2997, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 5.85% (0.2905 => 0.3075, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.84% (0.2793 => 0.2956, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.84% (0.3136 => 0.3319, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 5.83% (0.2725 => 0.2884, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.82% (0.1906 => 0.2017, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.75% (0.3098 => 0.3276, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.73% (2.0665 => 2.1849, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.72% (0.3162 => 0.3343, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary: 5.72% (0.3232 => 0.3417, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.67% (0.2891 => 0.3055, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 5.60% (0.2714 => 0.2866, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.54% (0.2871 => 0.3030, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.52% (0.2266 => 0.2391, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 5.47% (0.3379 => 0.3564, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.43% (0.2872 => 0.3028, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.42% (0.8101 => 0.8540, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.34% (0.1892 => 0.1993, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 5.28% (0.2877 => 0.3029) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.19% (0.2756 => 0.2899, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.14% (0.3052 => 0.3209, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.14% (0.4064 => 0.4273, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.00% (0.2802 => 0.2942, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.79% (14.3668 => 15.0555, std.dev.: 0.0087) MultiSource/Applications/sqlite3/sqlite3: 4.61% (17.1811 => 17.9737, std.dev.: 0.0205) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.26% (0.3427 => 0.3573, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.09% (3.8922 => 4.0513, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 4.06% (1.2842 => 1.3363, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 3.86% (0.3131 => 0.3252, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.26% (1.1194 => 1.1447, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.25% (1.1145 => 1.3848, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.97% (1.1396 => 1.2532, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0021) MultiSource/Applications/aha/aha: 9.22% (3.1595 => 3.4509, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3685, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.56% (3.6395 => 3.7690, std.dev.: 0.0031) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.83% (4.2280 => 4.3478, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7650, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.72% (0.8275 => 0.8417, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.37% (11.6436 => 11.8029, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.11% (2.6546 => 2.6841, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.11% (6.5088 => 6.5808, std.dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.05% (6.6874 => 0.1302, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.04% (0.8651 => 0.1727, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.36% (5.2763 => 3.2525, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.82% (5.3855 => 3.6718, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.27% (5.3526 => 3.6790, std.dev.: 0.0027) SingleSource/UnitTests/Vector/constpool: -14.70% (54.1659 => 46.2051, std.dev.: 0.0088) MultiSource/Benchmarks/FreeBench/mason/mason: -12.33% (0.0811 => 0.0711, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.58% (2.9384 => 2.6275, std.dev.: 0.0058) MultiSource/Applications/ClamAV/clamscan: -10.00% (22.1758 => 19.9585, std.dev.: 0.0109) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.35% (1.1492 => 0.7659, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -16.02% (1.6925 => 1.4214, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.83% (0.0998 => 0.0860, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.27% (1.2373 => 1.0978, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/mandel-2: -10.36% (1.5373 => 1.3781, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/mason/mason: -10.13% (0.2161 => 0.1942, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.42% (19.9488 => 18.2693, std.dev.: 0.0362) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.74% (1.8329 => 1.7094, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.30% (1.6805 => 1.5914, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.65% (1.5835 => 1.5098, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.71% (3.2827 => 3.1609, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.42% (0.9957 => 0.9616, std.dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5019, std.dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: -3.02% (12.4730 => 12.0969, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.97% (8.6802 => 8.5094, std.dev.: 0.0148) SingleSource/Regression/C/uint64_to_float: -1.88% (0.5413 => 0.5311, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.88% (8.1563 => 8.0029, std.dev.: 0.0142) MultiSource/Applications/sqlite3/sqlite3: -1.84% (4.6441 => 4.5585, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -1.76% (10.2830 => 10.1016, std.dev.: 0.0185) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6816, std.dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.65% (2.5528 => 2.5106, std.dev.: 0.0019) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4212, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/lists: -1.24% (6.2999 => 6.2217, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.10% (2.3135 => 2.2880, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0554 => 1.0445, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.58% (0.5229 => 0.5939, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 9.57% (14.9895 => 16.4233, std.dev.: 0.0110) MultiSource/Benchmarks/MallocBench/gs/gs: 7.80% (4.1105 => 4.4311, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.95% (1.1048 => 1.2589, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.66% (7.1582 => 7.9212, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.64% (0.6222 => 0.7444, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36000.00% (0.0001 => 0.0361, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.98% (0.2116 => 0.2158, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 16 20:06:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 16 Oct 2012 22:06:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121017030648.BB8A92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4915?compare_to=4913&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4915, Order: 166082, Start Time: 2012-10-17 01:44:02, End Time: 2012-10-17 03:09:42 To: 4913, Order: 166069, Start Time: 2012-10-16 23:46:09, End Time: 2012-10-17 01:11:53 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (185 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1039 (680 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.77% (54.5983 => 56.1132, std.dev.: 0.3102) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.04% (79.9748 => 80.8075, std.dev.: 0.2741) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.24% (2.1866 => 2.1595, std.dev.: 0.0005) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.62% (2.0176 => 2.4941, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.23% (0.1410 => 0.1667, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 17.07% (0.0826 => 0.0967, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 16.41% (0.2243 => 0.2611, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.23% (0.0653 => 0.0759, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.17% (0.1327 => 0.1515, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.16% (0.0770 => 0.0879, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 14.12% (0.1013 => 0.1156, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.31% (0.0834 => 0.0945, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.88% (0.1413 => 0.1595, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.61% (0.2721 => 0.3064, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 12.50% (0.7038 => 0.7918, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.36% (3.9660 => 4.4561, std.dev.: 0.0092) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.34% (0.0964 => 0.1083, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 12.28% (1.3693 => 1.5375, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.28% (0.0977 => 0.1097, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.28% (0.1588 => 0.1783, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.22% (0.1072 => 0.1203, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.06% (0.7710 => 0.8640, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.97% (0.6283 => 0.7035, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.95% (1.4563 => 1.6303, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.94% (0.2596 => 0.2906, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.83% (0.5265 => 0.5888, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.72% (0.9199 => 1.0277, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 11.65% (13.8202 => 15.4305, std.dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.62% (1.2193 => 1.3610, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.60% (0.6959 => 0.7766, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 11.55% (0.4328 => 0.4828, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 11.47% (0.1003 => 0.1118, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 11.40% (0.4062 => 0.4525, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.32% (1.1364 => 1.2650, std.dev.: 0.0012) MultiSource/Applications/aha/aha: 11.21% (0.1062 => 0.1181, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 10.97% (1.0313 => 1.1444, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.77% (0.4791 => 0.5307, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 10.69% (1.1061 => 1.2243, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.64% (0.3130 => 0.3463, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.59% (0.3899 => 0.4312, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference-object: 10.59% (0.5818 => 0.6434, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.53% (0.5577 => 0.6164, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.46% (0.1157 => 0.1278, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.40% (0.2914 => 0.3217, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 10.35% (0.6744 => 0.7442, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 10.23% (0.5748 => 0.6336, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.23% (0.3022 => 0.3331, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 10.18% (0.2995 => 0.3300, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 10.17% (0.1111 => 0.1224, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.14% (0.1075 => 0.1184, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 10.13% (16.6129 => 18.2966, std.dev.: 0.0191) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.13% (0.3485 => 0.3838, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.12% (0.4379 => 0.4822, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 10.06% (0.7061 => 0.7771, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.98% (0.3246 => 0.3570, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 9.95% (0.1478 => 0.1625, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.93% (0.3756 => 0.4129, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 9.88% (0.1589 => 0.1746, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.83% (0.5637 => 0.6191, std.dev.: 0.0024) MultiSource/Applications/treecc/treecc: 9.82% (1.9270 => 2.1162, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.82% (0.4390 => 0.4821, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 9.80% (3.1889 => 3.5013, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.79% (0.4016 => 0.4409, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 9.78% (0.3220 => 0.3535, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.78% (0.2127 => 0.2335, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 9.78% (3.8646 => 4.2425, std.dev.: 0.0038) MultiSource/Applications/siod/siod: 9.77% (2.1791 => 2.3920, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.77% (0.1986 => 0.2180, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.76% (0.7460 => 0.8188, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/lists: 9.75% (0.3293 => 0.3614, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 9.71% (0.2781 => 0.3051, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.66% (0.3489 => 0.3826, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.64% (0.1276 => 0.1399, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.58% (0.8698 => 0.9531, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 9.57% (0.8310 => 0.9105, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.50% (0.1569 => 0.1718, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 9.48% (1.0594 => 1.1598, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/moments: 9.46% (0.3868 => 0.4234, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.44% (0.1865 => 0.2041, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.41% (0.1435 => 0.1570, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 9.41% (0.7506 => 0.8212, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.36% (0.3580 => 0.3915, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.31% (0.2782 => 0.3041, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 9.26% (0.2925 => 0.3196, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.24% (0.2023 => 0.2210, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.24% (7.2180 => 7.8852, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sieve: 9.21% (0.3453 => 0.3771, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 9.21% (0.2726 => 0.2977, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.14% (0.2966 => 0.3237, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 9.11% (0.3149 => 0.3436, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.08% (4.9865 => 5.4394, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/lists1: 8.97% (0.3534 => 0.3851, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 8.95% (0.3107 => 0.3385, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.91% (1.9828 => 2.1595, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 8.88% (0.2760 => 0.3005, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 8.87% (0.1657 => 0.1804, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.85% (0.6576 => 0.7158, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 8.84% (0.2761 => 0.3005, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.76% (1.3245 => 1.4405, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 8.75% (0.2607 => 0.2835, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.74% (0.2655 => 0.2887, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 8.74% (0.2690 => 0.2925, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 8.69% (0.3131 => 0.3403, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 8.65% (1.2749 => 1.3852, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.64% (0.2765 => 0.3004, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 8.62% (0.3192 => 0.3467, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 8.58% (0.2937 => 0.3189, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 8.56% (0.2628 => 0.2853, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.55% (3.6692 => 3.9830, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.54% (0.3511 => 0.3811, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 8.54% (14.8535 => 16.1222, std.dev.: 0.0146) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.48% (4.3801 => 4.7514, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.40% (4.4433 => 4.8165, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: 8.37% (0.2988 => 0.3238, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.36% (1.5188 => 1.6458, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 8.35% (8.4961 => 9.2053, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.28% (0.8818 => 0.9548, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.26% (0.3755 => 0.4065, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.23% (0.2696 => 0.2918, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.17% (0.6135 => 0.6636, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.04% (0.2140 => 0.2312, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.98% (3.2742 => 3.5354, std.dev.: 0.0053) MultiSource/Applications/oggenc/oggenc: 7.93% (4.6629 => 5.0325, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 7.81% (0.2945 => 0.3175, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 7.78% (0.4113 => 0.4433, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.77% (0.1789 => 0.1928, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.71% (0.2321 => 0.2500, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 7.68% (0.6250 => 0.6730, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.64% (0.9108 => 0.9804, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.48% (2.1007 => 2.2579, std.dev.: 0.0206) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.45% (1.1333 => 1.2177, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 7.44% (3.7467 => 4.0254, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: 7.44% (0.1385 => 0.1488, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.41% (0.4805 => 0.5161, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 7.27% (6.5754 => 7.0535, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.23% (0.2504 => 0.2685, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.21% (0.3245 => 0.3479, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 7.12% (0.2008 => 0.2151, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.56% (6.2785 => 6.6901, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.47% (13.2842 => 14.1440, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/parameter-passing: 6.27% (0.4003 => 0.4254, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 6.26% (1.2292 => 1.3062, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.18% (0.3914 => 0.4156, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.16% (0.1819 => 0.1931, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.09% (0.3940 => 0.4180, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/for-in: 5.89% (0.3789 => 0.4012, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 5.84% (0.3578 => 0.3787, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 5.79% (0.3646 => 0.3857, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 5.78% (0.3601 => 0.3809, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 5.76% (0.3663 => 0.3874, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.64% (0.3650 => 0.3856, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 5.58% (0.3623 => 0.3825, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 5.29% (16.2614 => 17.1221, std.dev.: 0.0130) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.22% (0.2243 => 0.2360, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 4.22% (14.5298 => 15.1427, std.dev.: 0.0186) MultiSource/Benchmarks/Bullet/bullet: 1.58% (33.2944 => 33.8217, std.dev.: 0.0115) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.63% (5.7573 => 7.5209, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 23.94% (1.8175 => 2.2526, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/richards_benchmark: 11.14% (1.1560 => 1.2848, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.77% (0.1322 => 0.1438, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4141, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.22% (1.2998 => 1.3806, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0040, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.92% (11.2619 => 11.7030, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9852, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 3.40% (10.7476 => 11.1126, std.dev.: 0.0299) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.13% (7.4271 => 7.5851, std.dev.: 0.0084) MultiSource/Applications/lemon/lemon: 1.62% (1.4298 => 1.4530, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.44% (8.3908 => 8.5116, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1888, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (1.9433 => 1.9671, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5782, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5875, std.dev.: 0.0051) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.74% (0.2670 => 0.1422, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.94% (0.4657 => 0.3868, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -14.57% (0.0707 => 0.0604) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.43% (1.3813 => 1.1958, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.36% (1.3819 => 1.1973, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.15% (0.2238 => 0.1966, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.32% (1.2308 => 1.0915, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.21% (20.3410 => 18.2646, std.dev.: 0.0128) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.36% (1.3780 => 1.2903, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -5.06% (2.6470 => 2.5131, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8004, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.24% (0.9996 => 0.9572, std.dev.: 0.0138) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1562, std.dev.: 0.0225) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.50% (1.7688 => 1.7069, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.04% (0.4867 => 0.4719, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.56% (26.5159 => 25.8376, std.dev.: 0.0174) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: -2.53% (0.5449 => 0.5311, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.50% (3.0263 => 2.9507, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: -2.38% (1.9762 => 1.9291, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.09% (0.6589 => 0.6451, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7154, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/lists: -1.78% (6.3560 => 6.2431, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0066, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8635, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.25% (0.8342 => 0.8238, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4951, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (5.3167 => 5.2567, std.dev.: 0.0008) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 16 20:46:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 16 Oct 2012 22:46:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121017034601.EAE1C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4916?compare_to=4833&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4916, Order: 166077, Start Time: 2012-10-17 00:32:23, End Time: 2012-10-17 03:47:57 To: 4833, Order: 165818, Start Time: 2012-10-12 20:44:50, End Time: 2012-10-12 23:55:00 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (134 on baseline) Performance Improvements: 6 (17 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1033 (757 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ClamAV/clamscan: 12.65% (0.2751 => 0.3099, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.99% (0.3730 => 0.3879, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.42% (54.0945 => 54.8644, std.dev.: 0.1193) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference-object: -2.06% (0.6458 => 0.6325, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -1.97% (0.6396 => 0.6270, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -1.34% (0.7779 => 0.7675, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.21% (2.2247 => 2.1978, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -1.12% (25.1886 => 24.9066, std.dev.: 0.0183) MultiSource/Applications/hexxagon/hexxagon: -1.08% (1.0663 => 1.0548, std.dev.: 0.0025) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 10.35% (0.3488 => 0.3849, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 9.75% (0.3446 => 0.3782, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.73% (0.3465 => 0.3802, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.67% (0.3496 => 0.3834, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.65% (0.3442 => 0.3774, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.63% (0.3469 => 0.3803, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.57% (0.3460 => 0.3791, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.37% (0.3650 => 0.3992, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 9.33% (0.3643 => 0.3983, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.24% (0.3724 => 0.4068, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: 8.46% (0.1218 => 0.1321, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 8.39% (1.5932 => 1.7268, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/05-eks/eks: 8.09% (0.1619 => 0.1750, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.07% (0.4361 => 0.4713, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.83% (1.6211 => 1.7481, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 7.83% (5.5417 => 5.9757, std.dev.: 0.0074) MultiSource/Benchmarks/nbench/nbench: 7.76% (0.2566 => 0.2765, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 7.62% (0.5826 => 0.6270, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.57% (1.3152 => 1.4148, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference-object: 7.40% (0.5889 => 0.6325, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 7.34% (0.4847 => 0.5203, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.32% (0.5026 => 0.5394, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.24% (0.2736 => 0.2934, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.20% (0.5000 => 0.5360, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 7.18% (0.6634 => 0.7110, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.17% (0.4994 => 0.5352, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.10% (0.4139 => 0.4433, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.05% (0.2014 => 0.2156, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 7.03% (0.7171 => 0.7675, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.02% (0.3930 => 0.4206, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.98% (3.5627 => 3.8113, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/09-vor/vor: 6.91% (0.1505 => 0.1609, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.85% (0.1620 => 0.1731, std.dev.: 0.0013) MultiSource/Applications/d/make_dparser: 6.80% (1.0781 => 1.1514, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.73% (0.3195 => 0.3410, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.71% (0.1549 => 0.1653, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.71% (0.2875 => 0.3068, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 6.71% (4.2109 => 4.4933, std.dev.: 0.0055) MultiSource/Applications/spiff/spiff: 6.70% (0.4029 => 0.4299, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.61% (0.3890 => 0.4147, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 6.55% (1.8794 => 2.0025, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.52% (0.2866 => 0.3053, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.51% (0.5900 => 0.6284, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.46% (4.4195 => 4.7048, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: 6.45% (0.9909 => 1.0548, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.43% (0.3903 => 0.4154, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.34% (2.7292 => 2.9022, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/hash: 6.32% (0.4146 => 0.4408, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.32% (0.2738 => 0.2911, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.31% (2.0673 => 2.1978, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.30% (0.2969 => 0.3156, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.27% (0.2792 => 0.2967, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.25% (0.2911 => 0.3093, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.25% (0.3362 => 0.3572, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.20% (0.2725 => 0.2894, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.20% (0.1968 => 0.2090, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 6.20% (0.2823 => 0.2998, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.19% (0.3004 => 0.3190, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 6.19% (0.2714 => 0.2882, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.19% (0.2813 => 0.2987, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 6.18% (0.3348 => 0.3555, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.18% (0.3625 => 0.3849, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.18% (0.3124 => 0.3317, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.16% (0.3845 => 0.4082, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 6.15% (0.5546 => 0.5887, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 6.15% (0.3726 => 0.3955, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 6.14% (0.3678 => 0.3904, std.dev.: 0.0039) MultiSource/Applications/SIBsim4/SIBsim4: 6.13% (0.2691 => 0.2856, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.12% (0.2729 => 0.2896, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 6.12% (0.3336 => 0.3540, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 6.07% (0.2750 => 0.2917, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 6.07% (2.1013 => 2.2289, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/random: 6.06% (0.2803 => 0.2973, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.06% (0.3282 => 0.3481, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.04% (0.2103 => 0.2230, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 6.04% (4.6177 => 4.8964, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.03% (0.3084 => 0.3270, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 6.03% (1.4269 => 1.5129, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.02% (0.7426 => 0.7873, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 5.97% (0.2780 => 0.2946, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 5.97% (0.3267 => 0.3462, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.95% (0.3060 => 0.3242, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wc: 5.91% (0.3096 => 0.3279, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 5.90% (2.1653 => 2.2931, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.90% (0.3271 => 0.3464, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 5.90% (0.3477 => 0.3682, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 5.89% (23.5202 => 24.9066, std.dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/except: 5.87% (0.2811 => 0.2976, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 5.83% (2.0346 => 2.1533, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: 5.83% (0.4251 => 0.4499, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.80% (0.2068 => 0.2188, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 5.80% (0.3258 => 0.3447, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.80% (0.4658 => 0.4928, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 5.79% (0.3317 => 0.3509, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.78% (0.6435 => 0.6807, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.76% (0.5361 => 0.5670, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.75% (0.3690 => 0.3902, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.74% (0.2040 => 0.2157, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.70% (0.3981 => 0.4208, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 5.69% (0.2075 => 0.2193, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 5.56% (0.7875 => 0.8313, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: 5.41% (0.5012 => 0.5283, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 5.35% (0.9697 => 1.0216, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 5.31% (0.2391 => 0.2518, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.11% (1.9966 => 2.0987, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.10% (0.5584 => 0.5869, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.08% (11.6398 => 12.2314, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.02% (1.9694 => 2.0683, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.29% (4.6926 => 4.8941, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.48% (0.4253 => 0.4401, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 2.95% (11.9555 => 12.3086, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-1: 22.63% (6.2401 => 7.6525, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 10.60% (0.2802 => 0.3099, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.55% (3.3903 => 3.6122, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6746, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.04% (0.3693 => 0.3879, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-2: 4.85% (1.8057 => 1.8933, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 4.76% (0.2122 => 0.2223, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1670, std.dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/dry: 4.14% (14.0481 => 14.6298, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1946, std.dev.: 0.0081) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.67% (3.1722 => 3.2251, std.dev.: 0.0028) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3039, std.dev.: 0.0064) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2879, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5140, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5763, std.dev.: 0.0241) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5690, std.dev.: 0.0184) SingleSource/Benchmarks/Shootout-C++/ary2: -8.62% (0.2402 => 0.2195, std.dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9785, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7940, std.dev.: 0.0131) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -3.55% (11.2080 => 10.8099, std.dev.: 0.0067) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7732, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -2.97% (3.6262 => 3.5185, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.47% (17.2379 => 16.8119, std.dev.: 0.0405) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8674, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.05% (0.6293 => 0.6164, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5738, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4948, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (105.3826 => 104.1610, std.dev.: 0.0629) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0479, std.dev.: 0.0015) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 16 21:23:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 16 Oct 2012 23:23:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121017042337.3581F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4917?compare_to=4914&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4917, Order: 166084, Start Time: 2012-10-17 03:05:33, End Time: 2012-10-17 04:25:32 To: 4914, Order: 166080, Start Time: 2012-10-17 01:16:15, End Time: 2012-10-17 02:36:09 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (164 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 952 (681 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.97% (78.4421 => 79.9891, std.dev.: 0.5882) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.39% (0.5939 => 0.5962, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 0.52% (16.4233 => 16.5092, std.dev.: 0.0135) MultiSource/Benchmarks/Bullet/bullet: 0.56% (55.3072 => 55.6160, std.dev.: 0.0320) MultiSource/Benchmarks/MallocBench/gs/gs: 0.76% (4.4311 => 4.4648, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.65% (0.0460 => 0.0463, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.65% (0.0462 => 0.0465, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.93% (0.0429 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.93% (0.0431 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.48% (0.0420 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.48% (0.0421 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.73% (0.0412 => 0.0415, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.48% (0.0414 => 0.0416) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.46% (0.0431 => 0.0433) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.69% (0.0432 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.71% (0.0425 => 0.0428, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.70% (0.0426 => 0.0429) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.48% (0.0416 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.72% (0.0416 => 0.0419, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.95% (0.0421 => 0.0425, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.47% (0.0424 => 0.0426, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.93% (0.0432 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.23% (0.0436 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.73% (0.0409 => 0.0412, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.98% (0.0410 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.95% (0.0421 => 0.0425, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.71% (0.0423 => 0.0426) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.48% (0.0414 => 0.0416) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.72% (0.0414 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.74% (0.0405 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.74% (0.0406 => 0.0409) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.74% (0.0405 => 0.0408) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.49% (0.0406 => 0.0408, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.68% (0.0441 => 0.0444) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.68% (0.0442 => 0.0445, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.74% (0.0403 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.74% (0.0404 => 0.0407, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.49% (0.0406 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.74% (0.0406 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.48% (0.0413 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.73% (0.0413 => 0.0416, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.16% (1.2589 => 1.2609, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.31% (7.9212 => 7.9459, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.44% (0.7444 => 0.7477, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.55% (0.0361 => 0.0359, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.07% (0.2158 => 0.2135, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.06% (63.2438 => 55.6160, std.dev.: 0.0320) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.50% (14.1553 => 19.0392, std.dev.: 0.0161) SingleSource/Benchmarks/Misc-C++-EH/spirit: 64.62% (3.4629 => 5.7006, std.dev.: 0.0148) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 14230.14% (0.0720 => 10.3177, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9972600.00% (0.0001 => 9.9727, std.dev.: 0.0012) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 60.14% (0.2554 => 0.4090, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 47.07% (10.3673 => 15.2467, std.dev.: 0.0643) SingleSource/Benchmarks/Misc/richards_benchmark: 35.57% (0.1622 => 0.2199, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 33.33% (0.1056 => 0.1408, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.29% (2.2022 => 2.5830, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 17.25% (0.1432 => 0.1679, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 16.59% (7.0540 => 8.2241, std.dev.: 0.0048) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.52% (0.1566 => 0.1809, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.43% (0.0871 => 0.0988, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 13.19% (0.3282 => 0.3715, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.61% (1.7609 => 1.9829, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 12.37% (0.1584 => 0.1780, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 12.22% (0.1440 => 0.1616, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.55% (0.1143 => 0.1275, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.23% (0.3543 => 0.3941, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 11.02% (0.7115 => 0.7899, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 10.98% (10.4361 => 11.5817, std.dev.: 0.0094) MultiSource/Applications/lambda-0_1_3/lambda: 10.91% (0.7433 => 0.8244, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/trivial-interface: 10.80% (0.3473 => 0.3848, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/parameter-passing: 10.67% (0.3927 => 0.4346, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.65% (0.6675 => 0.7386, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.61% (0.3497 => 0.3868, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.56% (0.3543 => 0.3917, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-3: 10.52% (0.3516 => 0.3886, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.52% (0.1625 => 0.1796, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.50% (0.3561 => 0.3935, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 10.48% (0.3828 => 0.4229, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 10.45% (0.3694 => 0.4080, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 10.45% (0.3886 => 0.4292, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 10.38% (0.1175 => 0.1297, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.33% (0.2700 => 0.2979, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 10.27% (0.1655 => 0.1825, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 10.19% (9.4845 => 10.4511, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.14% (1.5415 => 1.6978, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 10.13% (3.3354 => 3.6733, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 10.10% (0.3109 => 0.3423, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 10.09% (0.1695 => 0.1866, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.95% (0.1236 => 0.1359, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.95% (0.3177 => 0.3493, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 9.90% (0.1151 => 0.1265, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/18-imp/imp: 9.90% (0.3423 => 0.3762, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.87% (0.1438 => 0.1580, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.82% (0.4615 => 0.5068, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.79% (0.5105 => 0.5605, std.dev.: 0.0060) MultiSource/Applications/oggenc/oggenc: 9.71% (5.7591 => 6.3184, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.69% (0.4879 => 0.5352, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.59% (0.5860 => 0.6422, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.59% (0.1940 => 0.2126, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.47% (4.2646 => 4.6686, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.46% (1.3050 => 1.4285, std.dev.: 0.0035) MultiSource/Applications/Burg/burg: 9.45% (1.1642 => 1.2742, std.dev.: 0.0092) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.40% (0.1510 => 0.1652, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.40% (0.8067 => 0.8825, std.dev.: 0.0040) MultiSource/Applications/viterbi/viterbi: 9.39% (0.1555 => 0.1701, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.38% (0.2271 => 0.2484, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.30% (0.5569 => 0.6087, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 9.29% (3.8723 => 4.2321, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/mst/mst: 9.29% (0.1163 => 0.1271, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 9.20% (0.7835 => 0.8556, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/bigfib: 9.15% (0.6456 => 0.7047, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.13% (0.3307 => 0.3609, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.07% (4.9449 => 5.3934, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.07% (0.3121 => 0.3404, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.04% (0.5020 => 0.5474, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.02% (5.0018 => 5.4528, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.96% (1.5859 => 1.7280, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.90% (0.1337 => 0.1456, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 8.89% (0.3387 => 0.3688, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.88% (0.2758 => 0.3003, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.88% (0.2107 => 0.2294, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.87% (0.9765 => 1.0631, std.dev.: 0.0030) MultiSource/Applications/lemon/lemon: 8.84% (1.0722 => 1.1670, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 8.79% (2.0273 => 2.2054, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.75% (0.8172 => 0.8887, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.73% (8.1363 => 8.8465, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.62% (0.2065 => 0.2243, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 8.57% (0.6030 => 0.6547, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.52% (0.5925 => 0.6430, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 8.46% (2.2969 => 2.4913, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.31% (0.4103 => 0.4444, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 8.31% (1.5603 => 1.6899, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 8.14% (0.3180 => 0.3439, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.13% (2.2024 => 2.3814, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.05% (0.3441 => 0.3718, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.96% (7.9617 => 8.5958, std.dev.: 0.0137) SingleSource/UnitTests/ObjC++/property-reference: 7.89% (0.7326 => 0.7904, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 7.89% (0.1268 => 0.1368, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.85% (0.1695 => 0.1828, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.82% (1.1861 => 1.2789, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.76% (0.3865 => 0.4165, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.67% (0.4289 => 0.4618, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.66% (0.4203 => 0.4525, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.66% (0.6450 => 0.6944, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.66% (0.4636 => 0.4991, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.65% (0.2603 => 0.2802, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 7.57% (0.3422 => 0.3681, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 7.46% (21.9371 => 23.5731, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/hash2: 7.36% (0.4620 => 0.4960, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 7.31% (0.8921 => 0.9573, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 7.25% (0.1463 => 0.1569) MultiSource/Benchmarks/McCat/05-eks/eks: 7.12% (0.4299 => 0.4605, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 7.11% (0.4048 => 0.4336, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.11% (0.5981 => 0.6406, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.07% (0.3650 => 0.3908, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.00% (0.3826 => 0.4094, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/sieve: 6.94% (0.3603 => 0.3853, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.87% (1.4186 => 1.5161, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 6.76% (0.3684 => 0.3933, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 6.52% (1.1840 => 1.2612, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.47% (0.3136 => 0.3339, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/strcat: 6.46% (0.2831 => 0.3014, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.40% (0.2905 => 0.3091, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.39% (0.3162 => 0.3364, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.31% (0.3232 => 0.3436, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.27% (0.3283 => 0.3489, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.26% (0.2891 => 0.3072, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.17% (2.0665 => 2.1940, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.09% (0.1906 => 0.2022, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.03% (0.1892 => 0.2006, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 6.00% (0.3098 => 0.3284, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.99% (0.2871 => 0.3043, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 5.87% (0.2877 => 0.3046, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.85% (0.2872 => 0.3040, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.84% (0.2756 => 0.2917, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.83% (0.2725 => 0.2884, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.73% (0.4064 => 0.4297, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.67% (0.3052 => 0.3225, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.65% (0.2266 => 0.2394, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.60% (0.8101 => 0.8555, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hello: 5.60% (0.2714 => 0.2866, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.55% (0.2793 => 0.2948, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: 5.51% (0.2049 => 0.2162, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 5.50% (0.3379 => 0.3565, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 5.50% (0.2802 => 0.2956, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.21% (14.3668 => 15.1158, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 4.90% (17.1811 => 18.0226, std.dev.: 0.0210) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.81% (0.3427 => 0.3592, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.73% (0.2430 => 0.2545, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 4.55% (1.2842 => 1.3426, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.50% (0.3131 => 0.3272, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.39% (3.8922 => 4.0630, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: 3.27% (0.3092 => 0.3193, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.07% (0.3817 => 0.3934, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.56% (1.1194 => 1.1481, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.21% (1.1145 => 1.3843, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9648, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.99% (0.1421 => 0.1563, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 9.88% (1.1396 => 1.2522, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4499, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3690, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.57% (3.6395 => 3.7694, std.dev.: 0.0025) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.83% (4.2280 => 4.3478, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7652, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.72% (0.8275 => 0.8417, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.37% (0.9540 => 0.9671, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.35% (11.6436 => 11.8007, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.10% (2.6546 => 2.6839, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1309, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -80.21% (0.8651 => 0.1712, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.22% (5.2763 => 3.2599, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.41% (5.3855 => 3.6940, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.81% (5.3526 => 3.7035, std.dev.: 0.0057) SingleSource/UnitTests/Vector/constpool: -14.74% (54.1659 => 46.1831, std.dev.: 0.0282) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.59% (2.9384 => 2.6273, std.dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: -9.73% (22.1758 => 20.0188, std.dev.: 0.0263) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.45% (1.1492 => 0.7648, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.69% (1.6925 => 1.4269, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.43% (0.0998 => 0.0864, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.29% (1.2373 => 1.0976, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -10.36% (1.5373 => 1.3781, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/mason/mason: -10.09% (0.2161 => 0.1943, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.32% (19.9488 => 18.2895, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4781, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.77% (1.8329 => 1.7089, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5753, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8479, std.dev.: 0.0021) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.30% (1.6805 => 1.5914, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5079, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.31% (0.9957 => 0.9528, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.67% (3.2827 => 3.1621, std.dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5082, std.dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0992, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -2.10% (10.2830 => 10.0667, std.dev.: 0.0166) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.07% (8.1563 => 7.9877, std.dev.: 0.0081) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.88% (8.6802 => 8.5166, std.dev.: 0.0559) MultiSource/Applications/sqlite3/sqlite3: -1.75% (4.6441 => 4.5628, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: -1.69% (8.8334 => 8.6837, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -1.68% (2.5528 => 2.5099, std.dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4201, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -1.28% (6.2999 => 6.2195, std.dev.: 0.0093) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.10% (2.3135 => 2.2880) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 14.02% (0.5229 => 0.5962, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 10.14% (14.9895 => 16.5092, std.dev.: 0.0135) MultiSource/Benchmarks/MallocBench/gs/gs: 8.62% (4.1105 => 4.4648, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.13% (1.1048 => 1.2609, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.00% (7.1582 => 7.9459, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_container: 20.17% (0.6222 => 0.7477, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35800.00% (0.0001 => 0.0359, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.90% (0.2116 => 0.2135, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 16 22:01:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 17 Oct 2012 00:01:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121017050150.94D112A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4918?compare_to=4915&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4918, Order: 166085, Start Time: 2012-10-17 03:38:56, End Time: 2012-10-17 05:04:46 To: 4915, Order: 166082, Start Time: 2012-10-17 01:44:02, End Time: 2012-10-17 03:09:42 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 5 (184 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1037 (683 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.39% (2.1595 => 2.1895, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 1.35% (0.7771 => 0.7876, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 1.35% (1.5375 => 1.5582, std.dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 1.22% (1.3062 => 1.3222, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 1.02% (33.8217 => 34.1680, std.dev.: 0.0067) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.37% (2.0176 => 2.4891, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.72% (0.1410 => 0.1674, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 17.55% (0.0826 => 0.0971, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 16.99% (0.2243 => 0.2624, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.85% (0.1327 => 0.1524, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 14.31% (0.1013 => 0.1158, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.81% (0.1072 => 0.1220, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 13.80% (1.3693 => 1.5582, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.79% (0.0834 => 0.0949) MultiSource/Applications/lambda-0_1_3/lambda: 13.53% (0.7038 => 0.7990, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.52% (0.1413 => 0.1604, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.97% (0.2721 => 0.3074, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.97% (0.0964 => 0.1089, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 12.87% (0.4328 => 0.4885, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/hash: 12.80% (0.4062 => 0.4582, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.79% (3.9660 => 4.4732, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.72% (0.1588 => 0.1790, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.51% (0.6283 => 0.7069, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 12.49% (13.8202 => 15.5463, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.44% (0.2596 => 0.2919, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.35% (0.7710 => 0.8662, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.24% (1.4563 => 1.6346, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.19% (0.9199 => 1.0320, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.19% (0.6959 => 0.7807, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.12% (0.5265 => 0.5903, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.98% (1.2193 => 1.3654, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/power/power: 11.96% (0.1003 => 0.1123, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 11.95% (0.5818 => 0.6513, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 11.86% (0.1062 => 0.1188, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.82% (0.3899 => 0.4360, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.74% (1.1364 => 1.2698, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.68% (0.3022 => 0.3375, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 11.62% (0.5748 => 0.6416, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 11.62% (1.0313 => 1.1511, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 11.54% (0.7061 => 0.7876, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.39% (0.3485 => 0.3882, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.38% (0.4791 => 0.5336, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.28% (0.3130 => 0.3483, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.23% (0.4016 => 0.4467, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 11.23% (1.1061 => 1.2303, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.21% (0.3756 => 0.4177, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 11.18% (0.2781 => 0.3092, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.15% (0.1157 => 0.1286, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.14% (0.5577 => 0.6198, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: 11.09% (0.6744 => 0.7492, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 11.08% (0.1986 => 0.2206, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.06% (0.3580 => 0.3976, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.93% (0.4390 => 0.4870, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.93% (0.2782 => 0.3086, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.89% (0.3489 => 0.3869, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 10.87% (0.3293 => 0.3651, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 10.86% (0.3453 => 0.3828, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 10.85% (16.6129 => 18.4156, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/moments: 10.78% (0.3868 => 0.4285, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 10.71% (0.1111 => 0.1230, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.69% (0.3246 => 0.3593, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 10.67% (0.2726 => 0.3017, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.65% (0.2966 => 0.3282, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.60% (0.1075 => 0.1189, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.59% (0.8698 => 0.9619, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 10.57% (0.3149 => 0.3482, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.55% (0.4379 => 0.4841, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 10.54% (0.2761 => 0.3052, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 10.47% (3.8646 => 4.2691, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/except: 10.43% (0.2760 => 0.3048, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.43% (0.2914 => 0.3218, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 10.43% (3.1889 => 3.5215, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary: 10.43% (0.3107 => 0.3431, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.42% (1.9828 => 2.1895, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.40% (0.1865 => 0.2059, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.39% (0.1569 => 0.1732, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 10.39% (2.1791 => 2.4054, std.dev.: 0.0090) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.38% (0.7460 => 0.8234, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 10.35% (0.1478 => 0.1631, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 10.35% (0.2995 => 0.3305, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.34% (0.2765 => 0.3051, std.dev.: 0.0031) MultiSource/Applications/treecc/treecc: 10.34% (1.9270 => 2.1263, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists1: 10.33% (0.3534 => 0.3899, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.32% (0.2655 => 0.2929, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 10.32% (0.2607 => 0.2876, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 10.31% (0.3220 => 0.3552, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 10.30% (0.2690 => 0.2967, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.30% (0.2127 => 0.2346, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 10.28% (0.2937 => 0.3239, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.24% (0.0977 => 0.1077, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 10.20% (0.2628 => 0.2896, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 10.20% (0.1589 => 0.1751, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 10.10% (0.8310 => 0.9149, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: 10.07% (0.7506 => 0.8262, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.04% (0.5637 => 0.6203, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.03% (0.1276 => 0.1404, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 9.99% (0.3192 => 0.3511, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.96% (0.1014 => 0.1115, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 9.95% (0.2925 => 0.3216, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.90% (4.9865 => 5.4800, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.89% (0.2023 => 0.2223, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 9.88% (1.0594 => 1.1641, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.87% (0.2696 => 0.2962, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 9.84% (0.2988 => 0.3282, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.76% (0.1435 => 0.1575, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.74% (7.2180 => 7.9210, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.56% (0.3755 => 0.4114, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 9.47% (0.2945 => 0.3224, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.28% (1.3245 => 1.4474, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: 9.20% (0.3131 => 0.3419, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 9.17% (0.1657 => 0.1809, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 9.11% (1.2749 => 1.3911, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.09% (0.6576 => 0.7174, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.92% (3.6692 => 3.9965, std.dev.: 0.0041) MultiSource/Applications/oggenc/oggenc: 8.91% (4.6629 => 5.0782, std.dev.: 0.0083) MultiSource/Applications/JM/lencod/lencod: 8.90% (14.8535 => 16.1756, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.90% (1.5188 => 1.6539, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.87% (4.3801 => 4.7688, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.85% (4.4433 => 4.8364, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/bigfib: 8.75% (0.6250 => 0.6797, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.74% (0.6135 => 0.6671, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 8.54% (8.4961 => 9.2215, std.dev.: 0.0106) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.53% (0.2321 => 0.2519, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.50% (0.2140 => 0.2322, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.49% (0.3511 => 0.3809, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.38% (0.8818 => 0.9557, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.33% (3.2742 => 3.5470, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.20% (0.4805 => 0.5199, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 8.13% (3.7467 => 4.0512, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.13% (2.1007 => 2.2714, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.01% (0.9108 => 0.9838, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.97% (1.1333 => 1.2236, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 7.94% (0.1385 => 0.1495, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.94% (0.1789 => 0.1931, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.89% (0.3245 => 0.3501, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.75% (0.2504 => 0.2698, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 7.68% (6.5754 => 7.0806, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/05-eks/eks: 7.68% (0.4113 => 0.4429, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 7.57% (1.2292 => 1.3222, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 7.37% (0.2008 => 0.2156, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.19% (0.4003 => 0.4291, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.13% (13.2842 => 14.2315, std.dev.: 0.0129) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.04% (0.1819 => 0.1947, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/property: 7.03% (0.3940 => 0.4217, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 6.97% (0.3914 => 0.4187, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.95% (6.2785 => 6.7150, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/for-in: 6.62% (0.3789 => 0.4040, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/trivial-interface: 6.62% (0.3578 => 0.3815, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.58% (0.3646 => 0.3886, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 6.58% (0.3601 => 0.3838, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 6.58% (0.3663 => 0.3904, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.47% (0.3650 => 0.3886, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 6.40% (0.3623 => 0.3855, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 5.82% (16.2614 => 17.2071, std.dev.: 0.0179) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.66% (0.2243 => 0.2370, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 4.79% (14.5298 => 15.2265, std.dev.: 0.0070) MultiSource/Benchmarks/Bullet/bullet: 2.62% (33.2944 => 34.1680, std.dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5144, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 24.23% (1.8175 => 2.2578, std.dev.: 0.0436) SingleSource/Benchmarks/Misc/richards_benchmark: 11.20% (1.1560 => 1.2855, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 9.02% (0.8273 => 0.9019, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4145, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.34% (1.2998 => 1.3822, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.65% (1.9144 => 2.0034, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.90% (11.2619 => 11.7016, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9854, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 3.40% (10.7476 => 11.1132, std.dev.: 0.0224) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.20% (7.4271 => 7.5908, std.dev.: 0.0023) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4533, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5132, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2123, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1877, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5786, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0129) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5862, std.dev.: 0.0064) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.52% (0.2670 => 0.1428, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.28% (0.4657 => 0.3899, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.94% (1.3819 => 1.2031, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.88% (1.3813 => 1.2034, std.dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.74% (0.0997 => 0.0860, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -12.11% (0.2238 => 0.1967, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.94% (1.2308 => 1.0962, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.18% (20.3410 => 18.2696, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.44% (1.3780 => 1.2893, std.dev.: 0.0194) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5148, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.41% (0.9996 => 0.9555, std.dev.: 0.0032) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -3.58% (3.2729 => 3.1558, std.dev.: 0.0127) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.47% (1.7688 => 1.7074, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4867 => 0.4717, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.52% (26.5159 => 25.8466, std.dev.: 0.0128) MultiSource/Applications/spiff/spiff: -2.43% (3.0263 => 2.9529, std.dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.34% (1.9762 => 1.9299, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.03% (0.6589 => 0.6455, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7151, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.62% (6.3560 => 6.2531, std.dev.: 0.0070) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.59% (0.6615 => 0.6510, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0079, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8642, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.25% (0.8342 => 0.8238, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.15% (2.5254 => 2.4964, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.12% (5.3167 => 5.2573, std.dev.: 0.0019) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 16 23:13:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 17 Oct 2012 01:13:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121017061314.3C8D02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4919?compare_to=4917&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4919, Order: 166086, Start Time: 2012-10-17 04:54:55, End Time: 2012-10-17 06:15:10 To: 4917, Order: 166084, Start Time: 2012-10-17 03:05:33, End Time: 2012-10-17 04:25:32 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 18 (170 on baseline) Performance Improvements: 2 (41 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 933 (676 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-12-11-LoadConstants: 15.14% (0.1275 => 0.1468, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 2.70% (19.0392 => 19.5525, std.dev.: 0.0080) MultiSource/Applications/siod/siod: 2.37% (2.4913 => 2.5503, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.55% (0.8825 => 0.8962, std.dev.: 0.0025) MultiSource/Applications/Burg/burg: 1.55% (1.2742 => 1.2939, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.54% (5.7006 => 5.7884, std.dev.: 0.0026) MultiSource/Applications/lua/lua: 1.42% (4.2321 => 4.2921, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.31% (1.7280 => 1.7507, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 1.28% (2.2054 => 2.2336, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.27% (1.5161 => 1.5354, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: 1.27% (15.2467 => 15.4407, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.24% (2.3814 => 2.4110, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.19% (1.0631 => 1.0757, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2789 => 1.2925, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.00% (4.6686 => 4.7154, std.dev.: 0.0081) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/sqlite3/sqlite3: 1.56% (4.5628 => 4.6341, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.54% (8.5166 => 8.6476, std.dev.: 0.0229) MultiSource/Applications/lemon/lemon: 1.19% (1.4362 => 1.4533, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/JM/lencod/lencod: -5.39% (10.3177 => 9.7615, std.dev.: 0.0127) SingleSource/Benchmarks/Misc/himenobmtxpa: -3.35% (3.7694 => 3.6432, std.dev.: 0.0092) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.37% (0.5962 => 0.5984, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 0.78% (16.5092 => 16.6382, std.dev.: 0.0195) MultiSource/Benchmarks/Bullet/bullet: 0.83% (55.6160 => 56.0776, std.dev.: 0.0153) MultiSource/Benchmarks/MallocBench/gs/gs: 1.94% (4.4648 => 4.5515, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.22% (0.0463 => 0.0464, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0465 => 0.0465, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.23% (0.0433 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0435 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.24% (0.0422 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0423 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0415 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.24% (0.0416 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.23% (0.0433 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.23% (0.0435 => 0.0436) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0428 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.23% (0.0429 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.24% (0.0418 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0419 => 0.0419, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0425 => 0.0425) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.47% (0.0426 => 0.0428) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0436 => 0.0436, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.23% (0.0437 => 0.0438, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.24% (0.0412 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.24% (0.0414 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0425 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.47% (0.0426 => 0.0428) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.24% (0.0416 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.24% (0.0417 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.25% (0.0408 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.24% (0.0409 => 0.0410) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0408 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.25% (0.0408 => 0.0409) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0444 => 0.0444, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.22% (0.0445 => 0.0446, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.25% (0.0406 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0407 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.25% (0.0408 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.24% (0.0409 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0415 => 0.0415, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0416 => 0.0416, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.71% (1.2609 => 1.2698, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.38% (7.9459 => 7.9760, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.21% (0.7477 => 0.7493, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.28% (0.0359 => 0.0358, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.2135 => 0.2135, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.33% (63.2438 => 56.0776, std.dev.: 0.0153) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 38.13% (14.1553 => 19.5525, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.15% (3.4629 => 5.7884, std.dev.: 0.0026) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13457.64% (0.0720 => 9.7615, std.dev.: 0.0127) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9972800.00% (0.0001 => 9.9729, std.dev.: 0.0014) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 62.26% (0.2554 => 0.4144, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 48.94% (10.3673 => 15.4407, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/richards_benchmark: 36.81% (0.1622 => 0.2219, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 33.71% (0.1056 => 0.1412, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 28.43% (0.1143 => 0.1468, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 20.96% (0.0730 => 0.0883, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 17.53% (0.1432 => 0.1683, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.50% (2.2022 => 2.5875, std.dev.: 0.0028) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.31% (0.1566 => 0.1837, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.22% (7.0540 => 8.2688, std.dev.: 0.0124) SingleSource/UnitTests/ObjC/messages-2: 17.22% (0.0662 => 0.0776, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 15.51% (0.0793 => 0.0916, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.01% (0.0871 => 0.0993, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 13.89% (0.1584 => 0.1804, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 13.76% (0.7433 => 0.8456, std.dev.: 0.0110) MultiSource/Benchmarks/Olden/power/power: 13.33% (0.1440 => 0.1632, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 13.28% (0.3282 => 0.3718, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.86% (0.1625 => 0.1834, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.83% (1.7609 => 1.9868, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 12.77% (0.1151 => 0.1298, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.63% (0.2700 => 0.3041, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.54% (0.1236 => 0.1391, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 12.45% (0.1044 => 0.1174, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.11% (0.0842 => 0.0944, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 11.98% (0.1695 => 0.1898) MultiSource/Applications/minisat/minisat: 11.97% (0.7115 => 0.7967, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 11.84% (0.1655 => 0.1851, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.80% (0.1940 => 0.2169, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: 11.76% (0.3927 => 0.4389, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.63% (0.1032 => 0.1152, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.43% (0.3543 => 0.3948, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 11.40% (0.1175 => 0.1309, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.40% (0.6675 => 0.7436, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 11.35% (10.4361 => 11.6208, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/property: 11.27% (0.3886 => 0.4324, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 11.18% (0.1163 => 0.1293, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 11.14% (1.1642 => 1.2939, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.09% (0.8067 => 0.8962, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.09% (0.5860 => 0.6510, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/18-imp/imp: 11.04% (0.3423 => 0.3801, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 11.03% (2.2969 => 2.5503, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/trivial-interface: 11.03% (0.3473 => 0.3856, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.99% (0.4615 => 0.5122, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.93% (0.5105 => 0.5663, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.85% (0.5569 => 0.6173, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 10.84% (3.8723 => 4.2921, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: 10.83% (3.3354 => 3.6967, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/life/life: 10.83% (0.0933 => 0.1034, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 10.76% (0.3561 => 0.3944, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 10.71% (0.3109 => 0.3442, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 10.71% (0.3828 => 0.4238, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 10.67% (9.4845 => 10.4966, std.dev.: 0.0145) SingleSource/UnitTests/ObjC/exceptions-4: 10.67% (0.3543 => 0.3921, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.67% (0.3497 => 0.3870, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.64% (0.3516 => 0.3890, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.60% (0.1510 => 0.1670, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.59% (1.5415 => 1.7047, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/for-in: 10.58% (0.3694 => 0.4085, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.57% (0.3121 => 0.3451, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.57% (4.2646 => 4.7154, std.dev.: 0.0081) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.54% (0.3177 => 0.3512, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.41% (0.2758 => 0.3045, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.39% (1.5859 => 1.7507, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.37% (0.3307 => 0.3650, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 10.31% (0.3180 => 0.3508, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.29% (0.4103 => 0.4525, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 10.27% (5.7591 => 6.3506, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.22% (0.2065 => 0.2276, std.dev.: 0.0016) MultiSource/Applications/treecc/treecc: 10.18% (2.0273 => 2.2336, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.16% (0.9765 => 1.0757, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.15% (0.1438 => 0.1584, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.11% (1.3050 => 1.4369, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.10% (0.1337 => 0.1472, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 10.10% (0.7835 => 0.8626, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.04% (0.2271 => 0.2499, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.02% (0.4879 => 0.5368, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 9.99% (1.0722 => 1.1793, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.92% (0.2107 => 0.2316, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.90% (0.5020 => 0.5517, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.84% (0.8172 => 0.8976, std.dev.: 0.0024) MultiSource/Applications/viterbi/viterbi: 9.77% (0.1555 => 0.1707, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.77% (5.0018 => 5.4907, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.75% (4.9449 => 5.4270, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 9.70% (0.6456 => 0.7082, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.58% (0.1117 => 0.1224, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.51% (0.1062 => 0.1163, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.50% (0.3441 => 0.3768, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.47% (2.2024 => 2.4110, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.30% (0.6030 => 0.6591, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 9.27% (0.3387 => 0.3701, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 9.23% (0.1268 => 0.1385, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.09% (0.1695 => 0.1849, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.08% (0.5925 => 0.6463, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.05% (8.1363 => 8.8726, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.97% (1.1861 => 1.2925, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 8.86% (1.5603 => 1.6985, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.74% (0.6450 => 0.7014, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.64% (0.2603 => 0.2828, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.49% (7.9617 => 8.6376, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 8.42% (0.7326 => 0.7943, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.33% (0.3865 => 0.4187, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.30% (0.4203 => 0.4552, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.23% (1.4186 => 1.5354, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.18% (0.3826 => 0.4139, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 8.16% (0.4289 => 0.4639, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 7.99% (0.8921 => 0.9634, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 7.98% (0.4299 => 0.4642, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.91% (0.5981 => 0.6454, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.90% (0.4620 => 0.4985, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 7.89% (0.3422 => 0.3692, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 7.84% (21.9371 => 23.6573, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.64% (0.3650 => 0.3929, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 7.59% (0.1463 => 0.1574, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 7.53% (0.4048 => 0.4353, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/sieve: 7.47% (0.3603 => 0.3872, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.46% (0.4636 => 0.4982, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.34% (0.3162 => 0.3394, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 7.27% (0.3684 => 0.3952, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.11% (0.3136 => 0.3359, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 7.08% (1.1840 => 1.2678, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1892 => 0.2024, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.95% (0.2905 => 0.3107, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.81% (0.2891 => 0.3088, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.79% (0.8101 => 0.8651, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.71% (0.2266 => 0.2418, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.68% (0.2831 => 0.3020, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.56% (2.0665 => 2.2021, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.53% (0.2877 => 0.3065, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.52% (0.4064 => 0.4329, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.51% (0.1906 => 0.2030, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.46% (0.3283 => 0.3495, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.40% (0.3232 => 0.3439, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.36% (0.3098 => 0.3295, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.34% (0.2871 => 0.3053, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.20% (0.2756 => 0.2927, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.16% (0.2872 => 0.3049, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.12% (0.2714 => 0.2880, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.09% (0.2725 => 0.2891, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.01% (0.3427 => 0.3633, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.97% (0.2430 => 0.2575, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.96% (0.3052 => 0.3234, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.92% (0.3379 => 0.3579, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 5.82% (0.2802 => 0.2965, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.80% (0.2793 => 0.2955, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 5.66% (0.2049 => 0.2165, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.51% (14.3668 => 15.1582, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.42% (3.8922 => 4.1033, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 5.32% (1.2842 => 1.3525, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 5.24% (17.1811 => 18.0817, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (0.3131 => 0.3293, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 4.75% (0.3092 => 0.3239, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.22% (0.3817 => 0.3940, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.70% (1.1194 => 1.1496, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.21% (1.1145 => 1.3843, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.99% (0.1421 => 0.1563, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 9.78% (1.1396 => 1.2510, std.dev.: 0.0012) MultiSource/Applications/aha/aha: 9.21% (3.1595 => 3.4504, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (3.1578 => 3.3678, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.83% (4.2280 => 4.3477, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.19% (2.6546 => 2.6862, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1308, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -79.96% (0.8651 => 0.1734, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.26% (5.2763 => 3.2574, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.41% (5.3855 => 3.6940, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.96% (5.3526 => 3.6955, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -14.72% (54.1659 => 46.1909, std.dev.: 0.0624) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.50% (2.9384 => 2.6300, std.dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: -9.36% (22.1758 => 20.1001, std.dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.35% (1.1492 => 0.7659, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: -15.65% (1.6925 => 1.4276, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.73% (0.0998 => 0.0861, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -11.14% (1.2373 => 1.0995, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/mandel-2: -10.42% (1.5373 => 1.3771, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/mason/mason: -10.13% (0.2161 => 0.1942, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.50% (19.9488 => 18.2539, std.dev.: 0.0230) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4781, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.76% (1.8329 => 1.7090, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.31% (1.6805 => 1.5912, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.87% (1.5835 => 1.5064, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.34% (0.9957 => 0.9525, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1626, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4721, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: -2.98% (12.4730 => 12.1011, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.90% (10.2830 => 10.0873, std.dev.: 0.0200) SingleSource/Regression/C/uint64_to_float: -1.90% (0.5413 => 0.5310, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.76% (8.1563 => 8.0128, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6815, std.dev.: 0.0008) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5095, std.dev.: 0.0018) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4214, std.dev.: 0.0082) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2878, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.10% (6.2999 => 6.2307, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 14.44% (0.5229 => 0.5984, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 11.00% (14.9895 => 16.6382, std.dev.: 0.0195) MultiSource/Benchmarks/MallocBench/gs/gs: 10.73% (4.1105 => 4.5515, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.93% (1.1048 => 1.2698, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.42% (7.1582 => 7.9760, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/stepanov_container: 20.43% (0.6222 => 0.7493, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35700.00% (0.0001 => 0.0358, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.90% (0.2116 => 0.2135, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 16 23:56:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 17 Oct 2012 01:56:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121017065650.BEA162A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4920?compare_to=4918&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4920, Order: 166088, Start Time: 2012-10-17 05:33:53, End Time: 2012-10-17 06:59:46 To: 4918, Order: 166085, Start Time: 2012-10-17 03:38:56, End Time: 2012-10-17 05:04:46 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (195 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1042 (671 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.80% (2.0176 => 2.4978, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 19.08% (0.1410 => 0.1679, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 18.99% (0.0653 => 0.0777) SingleSource/Benchmarks/Misc/flops: 18.16% (0.0826 => 0.0976) MultiSource/Benchmarks/McCat/08-main/main: 17.61% (0.2243 => 0.2638, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 17.54% (0.1072 => 0.1260, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.98% (0.1327 => 0.1539, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 14.71% (0.1013 => 0.1162, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.65% (0.0819 => 0.0939) MultiSource/Applications/lambda-0_1_3/lambda: 14.45% (0.7038 => 0.8055, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 14.18% (1.3693 => 1.5634, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.01% (0.1413 => 0.1611, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.91% (0.0834 => 0.0950, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 13.67% (0.0746 => 0.0848, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 13.66% (0.4062 => 0.4617, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.59% (0.0964 => 0.1095, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 13.47% (0.4328 => 0.4911, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.38% (0.0770 => 0.0873, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.35% (0.1588 => 0.1800, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 13.31% (0.7710 => 0.8736, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.13% (3.9660 => 4.4869, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.11% (0.6283 => 0.7107, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 13.05% (0.2721 => 0.3076, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.90% (0.6959 => 0.7857, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.88% (1.4563 => 1.6439, std.dev.: 0.0082) MultiSource/Applications/SPASS/SPASS: 12.87% (13.8202 => 15.5990, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.85% (0.3899 => 0.4400, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.83% (0.2596 => 0.2929, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.79% (0.9199 => 1.0376, std.dev.: 0.0038) MultiSource/Applications/aha/aha: 12.62% (0.1062 => 0.1196, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 12.56% (0.1003 => 0.1129, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/distray/distray: 12.47% (0.0818 => 0.0920, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.38% (0.5265 => 0.5917, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.21% (1.2193 => 1.3682, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 12.21% (0.3022 => 0.3391, std.dev.: 0.0065) MultiSource/Applications/lemon/lemon: 12.06% (1.0313 => 1.1557, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.04% (0.4791 => 0.5368, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 12.04% (0.0847 => 0.0949, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.02% (1.1364 => 1.2730, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.01% (0.1157 => 0.1296, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.85% (0.3130 => 0.3501, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.82% (0.3485 => 0.3897, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 11.81% (16.6129 => 18.5746, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.79% (0.3756 => 0.4199, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.79% (0.3580 => 0.4002, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.75% (0.4016 => 0.4488, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 11.74% (0.5818 => 0.6501, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 11.68% (1.1061 => 1.2353, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 11.61% (0.2781 => 0.3104, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 11.55% (0.3489 => 0.3892, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 11.47% (0.7061 => 0.7871, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.44% (0.5577 => 0.6215, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.43% (0.2782 => 0.3100, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 11.43% (0.5748 => 0.6405, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 11.42% (0.3293 => 0.3669, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 11.38% (0.3453 => 0.3846, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 11.32% (0.3868 => 0.4306, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 11.31% (0.6744 => 0.7507, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.30% (0.4390 => 0.4886, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.26% (0.1865 => 0.2075, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.21% (0.3246 => 0.3610, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 11.20% (0.2607 => 0.2899, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/strcat: 11.19% (0.2726 => 0.3031, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.17% (0.8698 => 0.9670, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 11.16% (2.1791 => 2.4223, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/office/office: 11.16% (0.2966 => 0.3297, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.15% (0.1569 => 0.1744, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.15% (0.2655 => 0.2951, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 11.06% (3.8646 => 4.2921, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: 11.05% (0.2761 => 0.3066, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 11.02% (1.9828 => 2.2013, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 11.01% (0.1589 => 0.1764, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 11.01% (0.3107 => 0.3449, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 10.99% (0.3149 => 0.3495, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 10.98% (0.2760 => 0.3063, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 10.93% (0.2690 => 0.2984, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.92% (0.4379 => 0.4857, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 10.89% (0.3534 => 0.3919, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 10.89% (0.1111 => 0.1232, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.88% (0.1075 => 0.1192, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 10.87% (1.9270 => 2.1365, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.86% (0.0976 => 0.1082, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.81% (0.2914 => 0.3229, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 10.79% (0.2937 => 0.3254, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 10.75% (0.2995 => 0.3317, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 10.73% (3.1889 => 3.5312, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 10.68% (0.3220 => 0.3564, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.67% (4.9865 => 5.5188, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.67% (0.7460 => 0.8256, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.66% (0.1276 => 0.1412, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 10.65% (0.2628 => 0.2908, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 10.65% (0.3192 => 0.3532, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.63% (0.2765 => 0.3059, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 10.55% (0.7506 => 0.8298, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.54% (0.0977 => 0.1080, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 10.49% (0.1478 => 0.1633, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 10.47% (0.8310 => 0.9180, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.44% (0.2127 => 0.2349, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 10.39% (0.2925 => 0.3229, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.39% (0.2696 => 0.2976, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.38% (0.1435 => 0.1584) SingleSource/Benchmarks/Shootout-C++/matrix: 10.37% (0.2988 => 0.3298, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.36% (0.5637 => 0.6221, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.36% (0.1014 => 0.1119, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 10.30% (1.0594 => 1.1685, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.27% (0.1986 => 0.2190, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.20% (0.3755 => 0.4138, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.18% (0.2023 => 0.2229, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 10.05% (0.2945 => 0.3241, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.90% (7.2180 => 7.9328, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 9.78% (0.1657 => 0.1819, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.66% (1.3245 => 1.4525, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.66% (0.6576 => 0.7211, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.44% (3.6692 => 4.0154, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.42% (1.5188 => 1.6618, std.dev.: 0.0114) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.39% (0.2140 => 0.2341, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 9.39% (0.6250 => 0.6837, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 9.36% (0.3131 => 0.3424, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 9.29% (4.6629 => 5.0960, std.dev.: 0.0096) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.26% (0.6135 => 0.6703, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 9.25% (1.2749 => 1.3928, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.15% (4.4433 => 4.8498, std.dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: 9.15% (14.8535 => 16.2120, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.12% (4.3801 => 4.7797, std.dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: 8.92% (8.4961 => 9.2536, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.84% (3.2742 => 3.5638, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.75% (0.2321 => 0.2524, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.60% (2.1007 => 2.2813, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.60% (0.4805 => 0.5218, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 8.51% (3.7467 => 4.0657, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/05-eks/eks: 8.51% (0.4113 => 0.4463, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.51% (0.3245 => 0.3521, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 8.49% (0.1213 => 0.1316, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.47% (0.9108 => 0.9879, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.45% (0.8818 => 0.9563, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.33% (0.1789 => 0.1938, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.30% (0.1819 => 0.1970, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.28% (1.1333 => 1.2271, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: 8.23% (0.1385 => 0.1499, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.15% (0.3511 => 0.3797, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 8.03% (1.2292 => 1.3279, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.95% (0.2504 => 0.2703, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 7.89% (6.5754 => 7.0943, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/oourafft: 7.87% (0.2008 => 0.2166, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 7.34% (0.4003 => 0.4297, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.32% (6.2785 => 6.7381, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/property: 7.16% (0.3940 => 0.4222, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.14% (13.2842 => 14.2333, std.dev.: 0.0103) SingleSource/UnitTests/ObjC/exceptions: 7.10% (0.3914 => 0.4192, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 6.70% (0.3789 => 0.4043, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 6.65% (0.3578 => 0.3816, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 6.58% (0.3663 => 0.3904, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.56% (0.3646 => 0.3885, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.52% (0.3650 => 0.3888, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 6.50% (0.3601 => 0.3835, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 6.46% (0.3623 => 0.3857, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.93% (0.2243 => 0.2376, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 5.86% (16.2614 => 17.2146, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/ReedSolomon: 5.63% (0.1777 => 0.1877, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 4.93% (14.5298 => 15.2457, std.dev.: 0.0106) MultiSource/Benchmarks/Olden/bh/bh: 3.95% (0.2859 => 0.2972, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 2.98% (33.2944 => 34.2853, std.dev.: 0.0095) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5162, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3628, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 25.02% (1.8175 => 2.2722, std.dev.: 0.0219) SingleSource/Benchmarks/Misc/richards_benchmark: 11.12% (1.1560 => 1.2845, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 9.03% (0.8273 => 0.9020, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.61% (3.1736 => 3.4151, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 5.99% (1.2998 => 1.3776, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0040, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.91% (11.2619 => 11.7028, std.dev.: 0.0186) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9861, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.23% (10.7476 => 11.0950, std.dev.: 0.0169) SingleSource/Benchmarks/Misc/salsa20: 2.27% (7.4271 => 7.5958, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.67% (1.4298 => 1.4537, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5132, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1869, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5785, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.09% (8.8259 => 8.9223, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5873, std.dev.: 0.0055) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.52% (0.2670 => 0.1428, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.30% (0.4657 => 0.3898, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.86% (1.3813 => 1.2037, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.85% (1.3819 => 1.2043, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.44% (0.0997 => 0.0863, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -11.93% (0.2238 => 0.1971, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.89% (1.2308 => 1.0968, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.16% (20.3410 => 18.2740, std.dev.: 0.0180) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std.dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.30% (1.3780 => 1.3050, std.dev.: 0.0157) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5137, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8002, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.78% (0.9996 => 0.9618, std.dev.: 0.0069) MultiSource/Applications/siod/siod: -3.57% (3.2729 => 3.1560, std.dev.: 0.0039) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.48% (1.7688 => 1.7073, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.96% (0.4867 => 0.4723, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.61% (26.5159 => 25.8243, std.dev.: 0.0430) SingleSource/Regression/C/uint64_to_float: -2.55% (0.5449 => 0.5310, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.52% (3.0263 => 2.9499, std.dev.: 0.0021) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.29% (1.9762 => 1.9309, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.88% (0.6589 => 0.6465, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7143, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/lists: -1.69% (6.3560 => 6.2487, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.59% (0.6615 => 0.6510, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0074, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8676, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.26% (0.8342 => 0.8237, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.22% (2.5254 => 2.4947, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: -1.14% (5.3167 => 5.2560, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 17 01:06:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 17 Oct 2012 03:06:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121017080641.A6E8A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4921?compare_to=4919&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4921, Order: 166089, Start Time: 2012-10-17 06:44:35, End Time: 2012-10-17 08:08:37 To: 4919, Order: 166086, Start Time: 2012-10-17 04:54:55, End Time: 2012-10-17 06:15:10 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (145 on baseline) Performance Improvements: 6 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 946 (702 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.35% (54.5266 => 56.3540, std.dev.: 0.1356) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2006-12-11-LoadConstants: -13.69% (0.1468 => 0.1267, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -2.94% (15.4407 => 14.9860, std.dev.: 0.0027) MultiSource/Applications/siod/siod: -2.34% (2.5503 => 2.4906, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.38% (5.7884 => 5.7084, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.32% (2.4110 => 2.3792, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: -1.28% (2.2336 => 2.2049, std.dev.: 0.0063) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.10% (0.5984 => 0.5990, std.dev.: 0.0062) MultiSource/Applications/SPASS/SPASS: -0.85% (16.6382 => 16.4971, std.dev.: 0.0260) MultiSource/Benchmarks/Bullet/bullet: -0.68% (56.0776 => 55.6980, std.dev.: 0.0679) MultiSource/Benchmarks/MallocBench/gs/gs: -1.97% (4.5515 => 4.4619, std.dev.: 0.1655) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.86% (0.0464 => 0.0468, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.29% (0.0465 => 0.0471, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.92% (0.0434 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.15% (0.0435 => 0.0440, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.95% (0.0423 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.18% (0.0423 => 0.0428, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.96% (0.0415 => 0.0419, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.96% (0.0417 => 0.0421, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.92% (0.0434 => 0.0438, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.69% (0.0436 => 0.0439, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.70% (0.0428 => 0.0431, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.93% (0.0430 => 0.0434, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.72% (0.0419 => 0.0422, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.19% (0.0419 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.94% (0.0425 => 0.0429, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.70% (0.0428 => 0.0431, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.15% (0.0436 => 0.0441, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.68% (0.0438 => 0.0476, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.97% (0.0413 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.72% (0.0415 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.94% (0.0425 => 0.0429, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.70% (0.0428 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.96% (0.0417 => 0.0421, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.96% (0.0418 => 0.0422, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.73% (0.0409 => 0.0412) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.73% (0.0410 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.98% (0.0408 => 0.0412, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.98% (0.0409 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.35% (0.0444 => 0.0450, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.90% (0.0446 => 0.0450, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.98% (0.0407 => 0.0411, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.98% (0.0407 => 0.0411, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.73% (0.0409 => 0.0412, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.22% (0.0410 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.96% (0.0415 => 0.0419, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.96% (0.0416 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.61% (1.2698 => 1.2621, std.dev.: 0.0314) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.04% (7.9760 => 7.9730, std.dev.: 0.0171) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.23% (0.7493 => 0.7476, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 1.40% (0.0358 => 0.0363, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.26% (0.2135 => 0.2226, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.93% (63.2438 => 55.6980, std.dev.: 0.0679) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.50% (14.1553 => 19.0395, std.dev.: 0.4561) SingleSource/Benchmarks/Misc-C++-EH/spirit: 64.84% (3.4629 => 5.7084, std.dev.: 0.0054) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13460.97% (0.0720 => 9.7639, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9974800.00% (0.0001 => 9.9749, std.dev.: 0.0013) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 60.06% (0.2554 => 0.4088, std.dev.: 0.0079) MultiSource/Benchmarks/PAQ8p/paq8p: 44.55% (10.3673 => 14.9860, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/richards_benchmark: 35.33% (0.1622 => 0.2195, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/distray/distray: 33.14% (0.1056 => 0.1406, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: 17.04% (0.1432 => 0.1676, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 16.79% (7.0540 => 8.2385, std.dev.: 0.1540) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.59% (2.2022 => 2.5676, std.dev.: 0.0221) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.52% (0.1566 => 0.1809, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.11% (0.0730 => 0.0833, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.43% (0.0871 => 0.0988, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 13.38% (0.1584 => 0.1796, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/oourafft: 13.19% (0.3282 => 0.3715, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.82% (1.7609 => 1.9866, std.dev.: 0.0213) MultiSource/Benchmarks/Olden/power/power: 12.29% (0.1440 => 0.1617, std.dev.: 0.0042) MultiSource/Applications/lambda-0_1_3/lambda: 11.93% (0.7433 => 0.8320, std.dev.: 0.0222) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.75% (0.1625 => 0.1816, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 11.09% (0.7115 => 0.7904, std.dev.: 0.0153) MultiSource/Applications/viterbi/viterbi: 11.06% (0.1555 => 0.1727, std.dev.: 0.0028) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.85% (0.1143 => 0.1267, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.85% (0.3927 => 0.4353, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 10.84% (10.4361 => 11.5678, std.dev.: 0.0235) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.84% (0.2758 => 0.3057, std.dev.: 0.0110) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.84% (0.3543 => 0.3927, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 10.77% (0.1151 => 0.1275, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: 10.77% (0.3473 => 0.3847, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.67% (0.3543 => 0.3921, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 10.64% (0.3497 => 0.3869, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 10.61% (0.3516 => 0.3889, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.59% (0.6675 => 0.7382, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 10.58% (0.3828 => 0.4233, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 10.56% (0.3561 => 0.3937, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.56% (0.3694 => 0.4084, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.49% (0.2107 => 0.2328, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/property: 10.47% (0.3886 => 0.4293, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 10.45% (3.3354 => 3.6839, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.44% (0.2271 => 0.2508, std.dev.: 0.0091) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.39% (0.3177 => 0.3507, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.30% (0.2700 => 0.2978, std.dev.: 0.0080) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.28% (0.8172 => 0.9012, std.dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: 10.24% (9.4845 => 10.4556, std.dev.: 0.0065) SingleSource/Benchmarks/McGill/chomp: 10.21% (0.1655 => 0.1824, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.11% (0.1029 => 0.1133, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 10.09% (0.1695 => 0.1866, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.09% (1.5415 => 1.6970, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.09% (0.5860 => 0.6451, std.dev.: 0.0227) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.05% (0.5105 => 0.5618, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 9.92% (1.1642 => 1.2797, std.dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.86% (0.4615 => 0.5070, std.dev.: 0.0040) MultiSource/Applications/sgefa/sgefa: 9.78% (0.3109 => 0.3413, std.dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 9.76% (5.7591 => 6.3213, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.76% (0.4879 => 0.5355, std.dev.: 0.0067) MultiSource/Applications/lua/lua: 9.73% (3.8723 => 4.2490, std.dev.: 0.1265) MultiSource/Applications/spiff/spiff: 9.73% (0.7835 => 0.8597, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.67% (0.1438 => 0.1577, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/mst/mst: 9.63% (0.1163 => 0.1275, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.59% (4.2646 => 4.6736, std.dev.: 0.1449) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.55% (0.1236 => 0.1354, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.43% (1.3050 => 1.4281, std.dev.: 0.0356) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.40% (0.1510 => 0.1652, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.40% (0.1117 => 0.1222, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.34% (4.9449 => 5.4067, std.dev.: 0.1231) SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.31% (0.3307 => 0.3615, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.23% (0.9765 => 1.0666, std.dev.: 0.0332) MultiSource/Applications/hbd/hbd: 9.19% (1.5603 => 1.7037, std.dev.: 0.0344) SingleSource/Benchmarks/Misc-C++/bigfib: 9.09% (0.6456 => 0.7043, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.04% (0.5020 => 0.5474, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.98% (5.0018 => 5.4508, std.dev.: 0.1333) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.94% (0.4103 => 0.4470, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.90% (1.5859 => 1.7271, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.83% (0.1337 => 0.1455, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: 8.81% (0.6030 => 0.6561, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.79% (8.1363 => 8.8514, std.dev.: 0.1920) MultiSource/Applications/lemon/lemon: 8.79% (1.0722 => 1.1664, std.dev.: 0.0332) MultiSource/Applications/treecc/treecc: 8.76% (2.0273 => 2.2049, std.dev.: 0.0063) MultiSource/Benchmarks/sim/sim: 8.71% (0.3387 => 0.3682, std.dev.: 0.0106) SingleSource/UnitTests/ObjC++/Hello: 8.66% (0.5925 => 0.6438, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 8.43% (2.2969 => 2.4906, std.dev.: 0.0048) SingleSource/UnitTests/ObjC++/property-reference: 8.33% (0.7326 => 0.7936, std.dev.: 0.0039) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.20% (7.9617 => 8.6145, std.dev.: 0.1408) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.03% (2.2024 => 2.3792, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.99% (0.3865 => 0.4174, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 7.97% (0.8921 => 0.9632, std.dev.: 0.0244) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.94% (1.1861 => 1.2803, std.dev.: 0.0339) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.92% (0.4636 => 0.5003, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.74% (0.6450 => 0.6949, std.dev.: 0.0155) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.73% (0.1695 => 0.1826, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 7.67% (0.4289 => 0.4618, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.65% (0.2603 => 0.2802, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.64% (0.4203 => 0.4524, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.49% (0.4620 => 0.4966, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 7.39% (0.3422 => 0.3675, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 7.31% (0.1463 => 0.1570, std.dev.: 0.0038) MultiSource/Applications/JM/lencod/lencod: 7.26% (21.9371 => 23.5297, std.dev.: 0.0232) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.21% (0.3826 => 0.4102, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 7.14% (0.4048 => 0.4337, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.99% (0.3650 => 0.3905, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.94% (0.3603 => 0.3853, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 6.81% (0.3684 => 0.3935, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.70% (0.3162 => 0.3374, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 6.68% (0.2831 => 0.3020, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.60% (0.3136 => 0.3343, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 6.45% (1.1840 => 1.2604, std.dev.: 0.0285) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.41% (2.0665 => 2.1990, std.dev.: 0.0180) SingleSource/Regression/C++/ofstream_ctor: 6.40% (0.2905 => 0.3091, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.40% (0.1892 => 0.2013, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 6.39% (0.3098 => 0.3296, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.33% (0.2891 => 0.3074, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.19% (0.1906 => 0.2024, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary3: 6.15% (0.3283 => 0.3485, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 6.15% (0.2049 => 0.2175, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.08% (0.2877 => 0.3052, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.06% (0.3232 => 0.3428, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 5.99% (0.2871 => 0.3043, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.96% (0.2266 => 0.2401, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.85% (0.2872 => 0.3040, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.84% (0.2756 => 0.2917, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.83% (0.4064 => 0.4301, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.80% (0.2793 => 0.2955, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 5.69% (0.2725 => 0.2880, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 5.64% (0.3052 => 0.3224, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 5.45% (0.3379 => 0.3563, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 5.42% (0.2714 => 0.2861, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: 5.39% (0.2802 => 0.2953, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.57% (0.3131 => 0.3274, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.41% (3.8922 => 4.0638, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.09% (0.3817 => 0.3935, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.65% (1.1194 => 1.1491, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0107) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.96% (1.1396 => 1.2531, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0020) MultiSource/Applications/aha/aha: 9.21% (3.1595 => 3.4505, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 8.04% (0.1629 => 0.1760, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3681, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.46% (0.3463 => 0.3652, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.4162 => 0.4322, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.68% (4.2280 => 4.3411, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.28% (1.7254 => 1.7648, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.34% (0.9540 => 0.9668, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.16% (2.6546 => 2.6853, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2071, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.05% (6.6874 => 0.1301, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -79.92% (0.8651 => 0.1737, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.20% (5.2763 => 3.2608, std.dev.: 0.0248) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.79% (5.3855 => 3.6734, std.dev.: 0.0581) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.35% (5.3526 => 3.6748, std.dev.: 0.0150) SingleSource/UnitTests/Vector/constpool: -14.72% (54.1659 => 46.1945, std.dev.: 0.0503) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.54% (2.9384 => 2.6288, std.dev.: 0.0208) MultiSource/Applications/ClamAV/clamscan: -9.61% (22.1758 => 20.0458, std.dev.: 0.1474) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.00% (0.0400 => 0.0204, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.44% (1.1492 => 0.7649, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.60% (1.6925 => 1.4284, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.43% (0.0998 => 0.0864, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -11.27% (1.2373 => 1.0978, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -10.47% (1.5373 => 1.3764, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/mason/mason: -8.70% (0.2161 => 0.1973, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.39% (19.9488 => 18.2760, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.28% (1.6805 => 1.5918, std.dev.: 0.0074) MultiSource/Benchmarks/sim/sim: -4.98% (5.0483 => 4.7967, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5080, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.76% (0.9957 => 0.9583, std.dev.: 0.0058) MultiSource/Applications/siod/siod: -3.75% (3.2827 => 3.1595, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.19% (32.5116 => 31.4739, std.dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: -2.99% (12.4730 => 12.1003, std.dev.: 0.0094) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.00% (8.1563 => 7.9935, std.dev.: 0.0068) SingleSource/Regression/C/uint64_to_float: -1.88% (0.5413 => 0.5311, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -1.86% (10.2830 => 10.0913, std.dev.: 0.0287) SingleSource/UnitTests/Vector/multiplies: -1.73% (2.5528 => 2.5087, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6822, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4205, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -1.23% (6.2999 => 6.2227, std.dev.: 0.0078) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2879, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 14.55% (0.5229 => 0.5990, std.dev.: 0.0062) MultiSource/Applications/SPASS/SPASS: 10.06% (14.9895 => 16.4971, std.dev.: 0.0260) MultiSource/Benchmarks/MallocBench/gs/gs: 8.55% (4.1105 => 4.4619, std.dev.: 0.1655) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.24% (1.1048 => 1.2621, std.dev.: 0.0314) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.38% (7.1582 => 7.9730, std.dev.: 0.0171) SingleSource/Benchmarks/Misc-C++/stepanov_container: 20.15% (0.6222 => 0.7476, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36200.00% (0.0001 => 0.0363, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.20% (0.2116 => 0.2226, std.dev.: 0.0100) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 17 01:57:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 17 Oct 2012 03:57:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121017085700.76DED2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4922?compare_to=4920&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4922, Order: 166090, Start Time: 2012-10-17 07:33:48, End Time: 2012-10-17 08:59:56 To: 4920, Order: 166088, Start Time: 2012-10-17 05:33:53, End Time: 2012-10-17 06:59:46 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (191 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1041 (675 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.50% (55.1095 => 56.4889, std.dev.: 0.0561) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.87% (2.0176 => 2.4993, std.dev.: 0.0040) MultiSource/Benchmarks/Fhourstones/fhourstones: 19.08% (0.1410 => 0.1679, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 18.99% (0.0653 => 0.0777, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 18.16% (0.0826 => 0.0976, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 18.01% (0.2243 => 0.2647, std.dev.: 0.0039) SingleSource/UnitTests/2006-12-11-LoadConstants: 17.54% (0.1072 => 0.1260, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 14.81% (0.1013 => 0.1163, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.77% (0.1327 => 0.1523, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 14.51% (0.7038 => 0.8059, std.dev.: 0.0019) MultiSource/Applications/hbd/hbd: 14.23% (1.3693 => 1.5642, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.03% (0.0834 => 0.0951, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.00% (0.0964 => 0.1099, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.87% (0.1413 => 0.1609, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 13.67% (0.0746 => 0.0848, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 13.49% (0.4328 => 0.4912, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.35% (0.1588 => 0.1800, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.24% (3.9660 => 4.4910, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.19% (0.6283 => 0.7112, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 13.16% (0.2721 => 0.3079, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 12.88% (13.8202 => 15.6003, std.dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.83% (0.2596 => 0.2929, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash: 12.83% (0.4062 => 0.4583, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.76% (0.5265 => 0.5937, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.75% (0.6959 => 0.7846, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 12.71% (0.1062 => 0.1197, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.62% (0.3899 => 0.4391, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.61% (1.4563 => 1.6399, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.58% (0.9199 => 1.0356, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: 12.56% (0.1003 => 0.1129, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.49% (0.7710 => 0.8673, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.49% (0.0977 => 0.1099, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 12.35% (0.0818 => 0.0919, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.23% (0.4791 => 0.5377, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.23% (1.2193 => 1.3684, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 12.04% (0.0847 => 0.0949, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.00% (1.1364 => 1.2728, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.95% (0.3130 => 0.3504, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.94% (0.3485 => 0.3901, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.93% (0.1157 => 0.1295, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 11.93% (1.0313 => 1.1543, std.dev.: 0.0061) SingleSource/UnitTests/ObjC++/property-reference-object: 11.77% (0.5818 => 0.6503, std.dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: 11.73% (16.6129 => 18.5619, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.73% (0.4016 => 0.4487, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 11.69% (1.1061 => 1.2354, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.69% (0.3756 => 0.4195, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.66% (0.5577 => 0.6227, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 11.65% (0.2781 => 0.3105, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 11.55% (0.3489 => 0.3892, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.55% (0.3022 => 0.3371, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 11.48% (0.3293 => 0.3671, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.43% (0.2782 => 0.3100, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 11.38% (0.3453 => 0.3846) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.34% (0.3580 => 0.3986, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 11.31% (0.5748 => 0.6398, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 11.30% (0.6744 => 0.7506, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 11.27% (0.3868 => 0.4304, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 11.26% (0.2726 => 0.3033, std.dev.: 0.0084) MultiSource/Applications/siod/siod: 11.24% (2.1791 => 2.4241, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hello: 11.16% (0.2607 => 0.2898, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.14% (0.8698 => 0.9667, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 11.14% (3.8646 => 4.2951, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.12% (0.3246 => 0.3607, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 11.09% (0.2966 => 0.3295, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.09% (0.1569 => 0.1743, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 11.08% (0.1589 => 0.1765, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 11.07% (0.7061 => 0.7843, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/mst/mst: 11.07% (0.1111 => 0.1234, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.07% (0.4390 => 0.4876, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 11.07% (0.1075 => 0.1194, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 11.07% (1.9270 => 2.1403, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.05% (0.2914 => 0.3236, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 11.01% (0.2760 => 0.3064, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 11.01% (0.2761 => 0.3065, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.01% (0.4379 => 0.4861, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 10.99% (0.3149 => 0.3495, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.98% (1.9828 => 2.2005, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/random: 10.97% (0.2690 => 0.2985, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 10.96% (0.2937 => 0.3259, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 10.94% (0.3107 => 0.3447, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/18-imp/imp: 10.93% (0.3220 => 0.3572, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 10.87% (0.3534 => 0.3918, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 10.85% (0.2995 => 0.3320, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.85% (0.2655 => 0.2943, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.82% (0.7460 => 0.8267, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.78% (0.1865 => 0.2066, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 10.77% (3.1889 => 3.5324, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.76% (0.0976 => 0.1081, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.66% (0.1276 => 0.1412, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 10.65% (0.2628 => 0.2908, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 10.65% (0.3192 => 0.3532, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.64% (4.9865 => 5.5172, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.63% (0.2127 => 0.2353, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.60% (0.2765 => 0.3058, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.57% (0.2696 => 0.2981, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 10.55% (0.1478 => 0.1634, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 10.53% (0.2925 => 0.3233, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 10.51% (0.7506 => 0.8295, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.50% (0.5637 => 0.6229, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/matrix: 10.37% (0.2988 => 0.3298, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 10.36% (0.8310 => 0.9171, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.32% (0.1986 => 0.2191, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.31% (0.1435 => 0.1583, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.26% (0.1014 => 0.1118, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.23% (0.2023 => 0.2230, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.20% (0.3755 => 0.4138, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 10.02% (1.0594 => 1.1656, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/objinst: 10.02% (0.2945 => 0.3240, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.94% (7.2180 => 7.9356, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/em3d/em3d: 9.90% (0.1657 => 0.1821, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.77% (1.3245 => 1.4539, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.60% (0.6576 => 0.7207, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 9.55% (0.6250 => 0.6847, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 9.49% (1.2749 => 1.3959, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.49% (1.5188 => 1.6629, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.42% (3.6692 => 4.0148, std.dev.: 0.0033) MultiSource/Applications/oggenc/oggenc: 9.35% (4.6629 => 5.0990, std.dev.: 0.0070) MultiSource/Benchmarks/sim/sim: 9.33% (0.3131 => 0.3423, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.23% (4.3801 => 4.7844, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.21% (0.6135 => 0.6700, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 9.19% (14.8535 => 16.2181, std.dev.: 0.0084) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.16% (4.4433 => 4.8501, std.dev.: 0.0080) MultiSource/Benchmarks/mafft/pairlocalalign: 9.00% (8.4961 => 9.2610, std.dev.: 0.0127) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.88% (0.2321 => 0.2527, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.79% (0.2140 => 0.2328, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.78% (3.2742 => 3.5618, std.dev.: 0.0179) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.74% (2.1007 => 2.2843, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.71% (0.8818 => 0.9586, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.60% (0.4805 => 0.5218, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 8.58% (0.4113 => 0.4466, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 8.52% (3.7467 => 4.0659, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.44% (0.1789 => 0.1940, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 8.41% (0.1213 => 0.1315, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.40% (0.3511 => 0.3806, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.39% (1.1333 => 1.2284, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.38% (0.9108 => 0.9871, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.32% (0.3245 => 0.3515, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 8.23% (0.1385 => 0.1499, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.07% (0.2504 => 0.2706, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 8.02% (1.2292 => 1.3278, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 7.97% (6.5754 => 7.0995, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/oourafft: 7.92% (0.2008 => 0.2167, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.75% (0.1819 => 0.1960, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 7.42% (0.4003 => 0.4300, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.27% (6.2785 => 6.7348, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.16% (13.2842 => 14.2358, std.dev.: 0.0242) SingleSource/UnitTests/ObjC/exceptions: 7.08% (0.3914 => 0.4191, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.06% (0.3940 => 0.4218, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 6.68% (0.3578 => 0.3817, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.68% (0.3789 => 0.4042, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.61% (0.3646 => 0.3887, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 6.58% (0.3601 => 0.3838, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.58% (0.3663 => 0.3904, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.52% (0.3650 => 0.3888, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: 6.40% (0.3623 => 0.3855, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 5.89% (16.2614 => 17.2186, std.dev.: 0.0165) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.84% (0.2243 => 0.2374, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 4.98% (14.5298 => 15.2535, std.dev.: 0.0120) MultiSource/Benchmarks/Olden/bh/bh: 3.81% (0.2859 => 0.2968, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 3.07% (33.2944 => 34.3156, std.dev.: 0.0102) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5187, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fbench: 25.46% (1.8175 => 2.2803, std.dev.: 0.0317) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 11.08% (1.1560 => 1.2841, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 9.03% (0.8273 => 0.9020, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4141, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.33% (1.2998 => 1.3821, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.65% (0.3139 => 0.3285, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.91% (11.2619 => 11.7028, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9856, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 3.42% (10.7476 => 11.1149, std.dev.: 0.0511) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.14% (7.4271 => 7.5864, std.dev.: 0.0072) MultiSource/Applications/lemon/lemon: 1.63% (1.4298 => 1.4531, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5146, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9680, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1880, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5781, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1413, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5902, std.dev.: 0.0076) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.48% (0.2670 => 0.1429) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.32% (0.4657 => 0.3897, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.87% (1.3819 => 1.2040, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.86% (1.3813 => 1.2036, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.44% (0.0997 => 0.0863, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -12.15% (0.2238 => 0.1966, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -10.83% (1.2308 => 1.0975, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.14% (20.3410 => 18.2782, std.dev.: 0.0166) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.12% (1.3780 => 1.2937, std.dev.: 0.0063) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5147, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8005, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.14% (0.9996 => 0.9582, std.dev.: 0.0028) MultiSource/Applications/siod/siod: -3.55% (3.2729 => 3.1567, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.47% (1.7688 => 1.7075, std.dev.: 0.0054) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.60% (26.5159 => 25.8278, std.dev.: 0.0156) SingleSource/Regression/C/uint64_to_float: -2.55% (0.5449 => 0.5310, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.43% (3.0263 => 2.9529, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -2.37% (1.9762 => 1.9294, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.00% (0.6589 => 0.6457, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.95% (6.3560 => 6.2321, std.dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7146, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0075, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8669, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.26% (0.8342 => 0.8237, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.21% (2.5254 => 2.4948, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2580, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 17 02:57:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 17 Oct 2012 04:57:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121017095714.592192A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4923?compare_to=4921&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4923, Order: 166091, Start Time: 2012-10-17 08:38:15, End Time: 2012-10-17 09:58:10 To: 4921, Order: 166089, Start Time: 2012-10-17 06:44:35, End Time: 2012-10-17 08:08:37 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (165 on baseline) Performance Improvements: 1 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 952 (680 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -1.09% (1.7037 => 1.6852, std.dev.: 0.0047) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.52% (0.5990 => 0.5959, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: -0.18% (16.4971 => 16.4670, std.dev.: 0.0114) MultiSource/Benchmarks/Bullet/bullet: -0.25% (55.6980 => 55.5577, std.dev.: 0.0243) MultiSource/Benchmarks/MallocBench/gs/gs: -0.14% (4.4619 => 4.4558, std.dev.: 0.0213) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.21% (0.0468 => 0.0467, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.42% (0.0471 => 0.0469, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.68% (0.0438 => 0.0435, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.45% (0.0440 => 0.0438, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.23% (0.0427 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.23% (0.0428 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0419 => 0.0419, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.24% (0.0421 => 0.0420) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.46% (0.0438 => 0.0436, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.23% (0.0439 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0431 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.46% (0.0434 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0422 => 0.0422, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.24% (0.0424 => 0.0423) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.23% (0.0429 => 0.0428, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.46% (0.0431 => 0.0429, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.23% (0.0441 => 0.0440, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.15% (0.0476 => 0.0461, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.48% (0.0417 => 0.0415, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.24% (0.0418 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.23% (0.0429 => 0.0428, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.23% (0.0431 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.48% (0.0421 => 0.0419, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.47% (0.0422 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.24% (0.0412 => 0.0411, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.24% (0.0413 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.24% (0.0412 => 0.0411, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.48% (0.0413 => 0.0411, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.67% (0.0450 => 0.0447, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.22% (0.0450 => 0.0449) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.49% (0.0411 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.24% (0.0411 => 0.0410) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.24% (0.0412 => 0.0411, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.72% (0.0415 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.24% (0.0419 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.24% (0.0420 => 0.0419) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.02% (1.2621 => 1.2618, std.dev.: 0.0079) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.40% (7.9730 => 7.9408, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.52% (0.7476 => 0.7437, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0363 => 0.0363, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.13% (0.2226 => 0.2134, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.15% (63.2438 => 55.5577, std.dev.: 0.0243) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.33% (14.1553 => 19.0150, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++-EH/spirit: 64.33% (3.4629 => 5.6905, std.dev.: 0.0094) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13454.44% (0.0720 => 9.7592, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9975400.00% (0.0001 => 9.9755, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 59.95% (0.2554 => 0.4085, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 45.53% (10.3673 => 15.0876, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/richards_benchmark: 35.76% (0.1622 => 0.2202, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 33.14% (0.1056 => 0.1406, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.95% (2.2022 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 16.76% (0.1432 => 0.1672, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 16.67% (7.0540 => 8.2297, std.dev.: 0.0036) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.33% (0.1566 => 0.1806, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.25% (0.0730 => 0.0834, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.32% (0.0871 => 0.0987, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.78% (1.7609 => 1.9859, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 12.52% (0.3282 => 0.3693, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.35% (0.0834 => 0.0937, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 12.12% (0.1584 => 0.1776, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 11.94% (0.1440 => 0.1612, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.94% (0.1625 => 0.1819, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.81% (0.1143 => 0.1278, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 10.99% (0.7433 => 0.8250, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 10.96% (10.4361 => 11.5794, std.dev.: 0.0101) MultiSource/Applications/minisat/minisat: 10.88% (0.7115 => 0.7889, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 10.74% (0.3473 => 0.3846, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/parameter-passing: 10.49% (0.3927 => 0.4339, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.44% (0.3497 => 0.3862, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 10.39% (0.3543 => 0.3911, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 10.38% (0.1175 => 0.1297, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.37% (0.2700 => 0.2980, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.37% (0.6675 => 0.7367, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.36% (0.3543 => 0.3910, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.33% (0.3561 => 0.3929, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.32% (0.3516 => 0.3879, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.29% (0.3828 => 0.4222, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.23% (0.3694 => 0.4072, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 10.21% (0.1655 => 0.1824, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.19% (0.3886 => 0.4282, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.10% (0.3177 => 0.3498, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/18-imp/imp: 9.99% (0.3423 => 0.3765, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/em3d/em3d: 9.97% (0.1695 => 0.1864, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 9.96% (3.3354 => 3.6676, std.dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 9.92% (9.4845 => 10.4255, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.89% (1.5415 => 1.6939, std.dev.: 0.0038) MultiSource/Applications/sgefa/sgefa: 9.81% (0.3109 => 0.3414, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 9.79% (5.7591 => 6.3232, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 9.77% (0.1044 => 0.1146, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.68% (0.5105 => 0.5599, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.67% (0.8067 => 0.8847, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.66% (0.4615 => 0.5061, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.59% (0.4879 => 0.5347, std.dev.: 0.0012) MultiSource/Applications/aha/aha: 9.56% (0.1151 => 0.1261, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.55% (0.1236 => 0.1354, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.53% (0.1438 => 0.1575, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.50% (0.5569 => 0.6098, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.47% (0.5860 => 0.6415, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.38% (0.2271 => 0.2484, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.38% (4.2646 => 4.6645, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/mst/mst: 9.37% (0.1163 => 0.1272, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 9.32% (1.1642 => 1.2727, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.32% (1.3050 => 1.4266, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.28% (0.1940 => 0.2120, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 9.25% (3.8723 => 4.2304, std.dev.: 0.0156) MultiSource/Applications/viterbi/viterbi: 9.20% (0.1555 => 0.1698, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.07% (0.1510 => 0.1647, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.03% (0.8172 => 0.8910, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.99% (0.9765 => 1.0643, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.97% (0.2107 => 0.2296, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.96% (0.2758 => 0.3005, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.94% (0.3121 => 0.3400, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: 8.92% (0.7835 => 0.8534, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.88% (0.5020 => 0.5466, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.86% (0.3307 => 0.3600, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.81% (0.2065 => 0.2247, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 8.80% (0.6456 => 0.7024, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.78% (5.0018 => 5.4412, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.78% (4.9449 => 5.3793, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.68% (1.5859 => 1.7235, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 8.67% (1.0722 => 1.1652, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 8.62% (0.3387 => 0.3679, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.60% (0.4103 => 0.4456, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 8.60% (2.0273 => 2.2017, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.57% (8.1363 => 8.8339, std.dev.: 0.0026) MultiSource/Applications/siod/siod: 8.57% (2.2969 => 2.4938, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 8.47% (0.6030 => 0.6541, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.45% (0.1337 => 0.1450, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.34% (0.5925 => 0.6419, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.20% (0.3441 => 0.3723, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 8.14% (0.3180 => 0.3439, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 8.00% (1.5603 => 1.6852, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.87% (1.1861 => 1.2795, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.81% (0.6450 => 0.6954, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.75% (2.2024 => 2.3730, std.dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.73% (7.9617 => 8.5768, std.dev.: 0.0139) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.57% (0.2603 => 0.2800, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.56% (0.7326 => 0.7880, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 7.54% (21.9371 => 23.5916, std.dev.: 0.0227) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.50% (0.3865 => 0.4155, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.37% (0.1695 => 0.1820, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.23% (0.4203 => 0.4507, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 7.23% (0.4289 => 0.4599, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 7.22% (0.3422 => 0.3669, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.21% (0.3826 => 0.4102, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 7.18% (0.1463 => 0.1568, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.08% (0.3136 => 0.3358, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 7.07% (0.4299 => 0.4603, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.07% (1.4186 => 1.5189, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/football/football: 7.03% (0.8921 => 0.9548, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 7.01% (0.4620 => 0.4944, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.91% (0.5981 => 0.6394, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.83% (0.3162 => 0.3378, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 6.82% (0.4048 => 0.4324, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.67% (0.4636 => 0.4945, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.66% (0.3650 => 0.3893, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.61% (0.1892 => 0.2017, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 6.52% (0.3603 => 0.3838, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 6.46% (0.3684 => 0.3922, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 6.40% (1.1840 => 1.2598, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.12% (0.2891 => 0.3068, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.09% (0.2905 => 0.3082, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 5.98% (0.2877 => 0.3049, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.96% (0.2266 => 0.2401, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.93% (0.1906 => 0.2019, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 5.90% (0.2831 => 0.2998, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.85% (0.8101 => 0.8575, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.84% (2.0665 => 2.1871, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 5.78% (0.2871 => 0.3037) SingleSource/Benchmarks/Shootout-C++/ary: 5.75% (0.3232 => 0.3418, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 5.75% (0.3098 => 0.3276, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 5.73% (0.3283 => 0.3471, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.66% (0.2756 => 0.2912, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.54% (0.2872 => 0.3031, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.50% (0.2725 => 0.2875, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 5.47% (0.3052 => 0.3219, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.39% (0.4064 => 0.4283, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 5.32% (0.2802 => 0.2951, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.30% (0.2793 => 0.2941, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 5.27% (0.2714 => 0.2857, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 5.27% (0.3379 => 0.3557, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: 5.22% (0.2049 => 0.2156, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.89% (14.3668 => 15.0695, std.dev.: 0.0081) MultiSource/Applications/sqlite3/sqlite3: 4.80% (17.1811 => 18.0054, std.dev.: 0.0202) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.70% (0.3427 => 0.3588, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.57% (0.2430 => 0.2541, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 4.43% (1.2842 => 1.3411, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 4.41% (0.3131 => 0.3269, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.36% (3.8922 => 4.0620, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 3.40% (0.3092 => 0.3197, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.86% (0.3817 => 0.3926, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.65% (1.1194 => 1.1491, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3847, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.78% (1.1396 => 1.2510, std.dev.: 0.0015) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4500, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 6.64% (3.1578 => 3.3675, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.72% (4.2280 => 4.3432, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.33% (0.8275 => 0.8385, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.10% (2.6546 => 2.6839, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5762, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.06% (6.6874 => 0.1296, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -79.98% (0.8651 => 0.1732, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.28% (5.2763 => 3.2566, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.42% (5.3855 => 3.6935, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.85% (5.3526 => 3.7012, std.dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -14.76% (54.1659 => 46.1716, std.dev.: 0.0406) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.47% (2.9384 => 2.6308, std.dev.: 0.0221) MultiSource/Applications/ClamAV/clamscan: -9.68% (22.1758 => 20.0297, std.dev.: 0.0104) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel: -33.43% (1.1492 => 0.7650, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -15.63% (1.6925 => 1.4279, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.53% (0.0998 => 0.0863, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -11.96% (1.2373 => 1.0893, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/mandel-2: -10.39% (1.5373 => 1.3775, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/mason/mason: -10.13% (0.2161 => 0.1942, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.41% (19.9488 => 18.2718, std.dev.: 0.0265) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.77% (1.8329 => 1.7089, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.31% (1.6805 => 1.5912, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7966, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5082, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.65% (3.2827 => 3.1628, std.dev.: 0.0090) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.38% (0.9957 => 0.9620, std.dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.22% (32.5116 => 31.4662, std.dev.: 0.0075) MultiSource/Applications/hexxagon/hexxagon: -3.04% (12.4730 => 12.0935, std.dev.: 0.0036) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.94% (8.1563 => 7.9980, std.dev.: 0.0063) SingleSource/Regression/C/uint64_to_float: -1.90% (0.5413 => 0.5310, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6817, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -1.72% (2.5528 => 2.5090, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: -1.55% (10.2830 => 10.1237, std.dev.: 0.0148) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4214, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2878, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/lists: -1.08% (6.2999 => 6.2321, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8573, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.96% (0.5229 => 0.5959, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 9.86% (14.9895 => 16.4670, std.dev.: 0.0114) MultiSource/Benchmarks/MallocBench/gs/gs: 8.40% (4.1105 => 4.4558, std.dev.: 0.0213) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.21% (1.1048 => 1.2618, std.dev.: 0.0079) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.93% (7.1582 => 7.9408, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.53% (0.6222 => 0.7437, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36200.00% (0.0001 => 0.0363, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.85% (0.2116 => 0.2134, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 17 03:11:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 17 Oct 2012 05:11:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121017101127.E682D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4924?compare_to=4916&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4924, Order: 166085, Start Time: 2012-10-17 04:23:47, End Time: 2012-10-17 10:13:24 To: 4916, Order: 166077, Start Time: 2012-10-17 00:32:23, End Time: 2012-10-17 03:47:57 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 4 (4 on baseline) Performance Regressions: 7 (98 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (130 on baseline) Unchanged Tests: 1031 (793 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -16.17% (5.4592 => 4.5762, std.dev.: 0.4261) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -5.60% (9.9078 => 9.3529, std.dev.: 0.3061) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -6.23% (12.0456 => 11.2952, std.dev.: 0.3516) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 0.22% (5.1752 => 5.1868, std.dev.: 0.0969) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.02% (0.7873 => 0.8111, std.dev.: 0.0069) MultiSource/Applications/oggenc/oggenc: 2.74% (1.7268 => 1.7741, std.dev.: 0.0083) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.66% (12.2314 => 12.5569, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.45% (4.8941 => 5.0138, std.dev.: 0.0128) MultiSource/Benchmarks/Bullet/bullet: 1.94% (24.9066 => 25.3893, std.dev.: 0.0282) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.53% (0.6807 => 0.6911, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.17% (2.9022 => 2.9362, std.dev.: 0.0012) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.76% (0.1063 => 0.1188, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 11.35% (1.5932 => 1.7741, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.51% (0.1028 => 0.1136, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.27% (0.3446 => 0.3800, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.27% (0.3496 => 0.3855, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.26% (0.3488 => 0.3846, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-4: 10.22% (0.3465 => 0.3819, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.17% (0.3460 => 0.3812, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.15% (0.3469 => 0.3821, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 10.14% (0.3650 => 0.4020, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.11% (0.3442 => 0.3790, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.96% (0.3643 => 0.4006, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 9.96% (0.3724 => 0.4095, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 9.62% (5.5417 => 6.0747, std.dev.: 0.1199) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.22% (0.7426 => 0.8111, std.dev.: 0.0069) MultiSource/Benchmarks/nbench/nbench: 8.96% (0.2566 => 0.2796, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: 8.87% (0.4847 => 0.5277, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.48% (0.5826 => 0.6320, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.39% (0.5361 => 0.5811, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.31% (1.3152 => 1.4245, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.31% (0.4994 => 0.5409, std.dev.: 0.0035) SingleSource/UnitTests/ObjC++/property-reference-object: 8.29% (0.5889 => 0.6377, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.18% (0.5000 => 0.5409, std.dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: 7.95% (23.5202 => 25.3893, std.dev.: 0.0282) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.94% (0.5026 => 0.5425, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.92% (0.5584 => 0.6026, std.dev.: 0.0127) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.88% (11.6398 => 12.5569, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.78% (0.1620 => 0.1746, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.75% (0.2014 => 0.2170, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.70% (0.3362 => 0.3621, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.58% (2.7292 => 2.9362, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.56% (0.2737 => 0.2944, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.40% (0.6435 => 0.6911, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.30% (0.3890 => 0.4174, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference: 7.21% (0.7171 => 0.7688, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.17% (0.3625 => 0.3885, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.17% (0.1604 => 0.1719, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.17% (0.3195 => 0.3424, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 7.16% (2.0346 => 2.1803, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.13% (0.2875 => 0.3080, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/sieve: 7.06% (0.3726 => 0.3989, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.06% (0.4251 => 0.4551, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.05% (0.5900 => 0.6316, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists1: 7.05% (0.3477 => 0.3722, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.99% (0.4146 => 0.4436, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 6.99% (0.3678 => 0.3935, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.98% (0.3267 => 0.3495, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/lists: 6.90% (0.3348 => 0.3579, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.88% (2.0673 => 2.2095, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.84% (4.6926 => 5.0138, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.84% (4.4195 => 4.7217, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.82% (0.3124 => 0.3337, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.81% (0.3258 => 0.3480, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.78% (0.2714 => 0.2898, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.78% (0.3690 => 0.3940, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: 6.76% (0.2811 => 0.3001, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 6.73% (0.2823 => 0.3013, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.72% (0.2738 => 0.2922, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.72% (0.2813 => 0.3002, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.72% (0.2725 => 0.2908, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.71% (0.2729 => 0.2912, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.70% (0.3060 => 0.3265, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.66% (0.2911 => 0.3105, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.66% (0.3004 => 0.3204, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 6.64% (0.5012 => 0.5345, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.63% (0.2792 => 0.2977, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 6.62% (0.2750 => 0.2932, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.61% (0.3981 => 0.4244, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/ary2: 6.60% (0.3317 => 0.3536, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.55% (0.3282 => 0.3497, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 6.54% (2.1013 => 2.2388, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/random: 6.49% (0.2803 => 0.2985, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.40% (0.2780 => 0.2958, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.11% (0.3845 => 0.4080, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.01% (1.9966 => 2.1166, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.94% (1.9694 => 2.0864, std.dev.: 0.0025) MultiSource/Applications/kimwitu++/kc: 4.56% (11.9555 => 12.5001, std.dev.: 0.2030) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.15% (0.4253 => 0.4387, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-1: 22.63% (6.2401 => 7.6525, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 9.78% (0.2802 => 0.3076, std.dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6103, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6775, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.93% (0.3693 => 0.3875, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1665, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-2: 4.61% (1.8057 => 1.8889, std.dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/dry: 4.26% (14.0481 => 14.6460, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1955, std.dev.: 0.0076) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.58% (3.1722 => 3.2222, std.dev.: 0.0038) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3116, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.44% (1.0927 => 1.1084, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2876, std.dev.: 0.0018) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5131, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.85% (25.4195 => 16.5600, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/ary2: -7.99% (0.2402 => 0.2210, std.dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9785, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/salsa20: -7.58% (35.5013 => 32.8099, std.dev.: 0.0136) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9574, std.dev.: 0.0079) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -3.60% (11.2080 => 10.8045, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std.dev.: 0.0061) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7741, std.dev.: 0.0256) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/fldry: -2.95% (17.2379 => 16.7294, std.dev.: 0.0751) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8694, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5759, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/bh/bh: -1.55% (5.5810 => 5.4945, std.dev.: 0.0152) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (105.3826 => 104.1613, std.dev.: 0.1912) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0414, std.dev.: 0.0048) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 17 03:52:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 17 Oct 2012 05:52:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121017105213.0ADD02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4925?compare_to=4922&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4925, Order: 166092, Start Time: 2012-10-17 09:29:11, End Time: 2012-10-17 10:55:09 To: 4922, Order: 166090, Start Time: 2012-10-17 07:33:48, End Time: 2012-10-17 08:59:56 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (191 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1042 (675 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.39% (2.0176 => 2.5096, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 19.60% (0.0653 => 0.0781, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 19.29% (0.1410 => 0.1682, std.dev.: 0.0012) SingleSource/UnitTests/2006-12-11-LoadConstants: 18.56% (0.1072 => 0.1271) SingleSource/Benchmarks/Misc/flops: 18.28% (0.0826 => 0.0977, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 17.70% (0.2243 => 0.2640, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.00% (0.1327 => 0.1526, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 14.81% (0.1013 => 0.1163) MultiSource/Applications/hbd/hbd: 14.44% (1.3693 => 1.5670, std.dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: 14.42% (0.7038 => 0.8053, std.dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.27% (0.0834 => 0.0953, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.08% (0.1413 => 0.1612, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 13.84% (0.4328 => 0.4927, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 13.81% (0.0746 => 0.0849, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.54% (0.1588 => 0.1803, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.49% (0.0964 => 0.1094, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 13.41% (0.2721 => 0.3086, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.32% (3.9660 => 4.4941, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.23% (0.6283 => 0.7114, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 13.08% (13.8202 => 15.6275, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hash: 13.07% (0.4062 => 0.4593, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.03% (0.3899 => 0.4407, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.02% (0.6959 => 0.7865, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.94% (0.2596 => 0.2932, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 12.90% (0.1062 => 0.1199, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.78% (1.4563 => 1.6424, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/distray/distray: 12.71% (0.0818 => 0.0922, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.67% (0.5265 => 0.5932, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: 12.66% (0.1003 => 0.1130, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.61% (0.9199 => 1.0359, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.56% (0.7710 => 0.8678, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.45% (0.0811 => 0.0912, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.35% (1.2193 => 1.3699, std.dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 12.33% (0.2781 => 0.3124, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.21% (1.1364 => 1.2751, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: 12.19% (1.0313 => 1.1570, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.19% (0.1157 => 0.1298, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.17% (0.4791 => 0.5374, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.05% (0.3485 => 0.3905, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 12.01% (0.5818 => 0.6517, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.00% (0.4016 => 0.4498, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 11.98% (0.3489 => 0.3907, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 11.95% (16.6129 => 18.5985, std.dev.: 0.0147) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.93% (0.3756 => 0.4204, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 11.92% (0.0847 => 0.0948, std.dev.: 0.0017) MultiSource/Applications/Burg/burg: 11.91% (1.1061 => 1.2378, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/lists: 11.78% (0.3293 => 0.3681, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: 11.76% (0.5748 => 0.6424, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.73% (0.3580 => 0.4000, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.73% (0.4390 => 0.4905, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.72% (0.2782 => 0.3108, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.71% (0.3022 => 0.3376, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.69% (0.3130 => 0.3496, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 11.66% (0.3868 => 0.4319, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.57% (0.5577 => 0.6222, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sieve: 11.53% (0.3453 => 0.3851, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 11.52% (0.2760 => 0.3078, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 11.43% (0.6744 => 0.7515, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.38% (0.8698 => 0.9688, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 11.36% (0.2966 => 0.3303, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 11.33% (2.1791 => 2.4261, std.dev.: 0.0047) SingleSource/UnitTests/ObjC++/property-reference: 11.33% (0.7061 => 0.7861, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 11.31% (0.3149 => 0.3505, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 11.30% (0.2726 => 0.3034, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 11.29% (1.9828 => 2.2066, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.28% (0.1569 => 0.1746, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 11.26% (0.1589 => 0.1768, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 11.26% (0.2761 => 0.3072, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 11.24% (0.2607 => 0.2900, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 11.20% (0.2937 => 0.3266, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 11.19% (0.2690 => 0.2991, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 11.17% (3.8646 => 4.2962, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/mst/mst: 11.16% (0.1111 => 0.1235, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.15% (0.2655 => 0.2951, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.12% (0.4379 => 0.4866, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists1: 11.12% (0.3534 => 0.3927, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 11.11% (0.2628 => 0.2920, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 11.10% (0.3107 => 0.3452, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 11.07% (0.0976 => 0.1084, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.06% (0.3246 => 0.3605, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 11.05% (0.1276 => 0.1417, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 11.02% (1.9270 => 2.1394, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.98% (0.1075 => 0.1193, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 10.95% (0.2995 => 0.3323, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 10.88% (3.1889 => 3.5359, std.dev.: 0.0131) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.88% (0.2914 => 0.3231, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: 10.84% (0.3192 => 0.3538, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.83% (4.9865 => 5.5263, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.81% (0.2765 => 0.3064, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/matrix: 10.81% (0.2988 => 0.3311, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.78% (0.1865 => 0.2066, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 10.78% (0.3220 => 0.3567, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.77% (0.2127 => 0.2356, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.75% (0.0977 => 0.1082, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.73% (0.1435 => 0.1589, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.68% (0.2696 => 0.2984, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.67% (0.7460 => 0.8256, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: 10.67% (0.2925 => 0.3237, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.62% (0.1986 => 0.2197, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 10.62% (0.1478 => 0.1635, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 10.57% (0.8310 => 0.9188, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 10.54% (0.7506 => 0.8297, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.49% (0.3755 => 0.4149, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.36% (0.5637 => 0.6221, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.28% (0.2023 => 0.2231, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.26% (0.1014 => 0.1118, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 10.21% (1.0594 => 1.1676, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 10.19% (0.2945 => 0.3245, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.13% (7.2180 => 7.9495, std.dev.: 0.0081) MultiSource/Benchmarks/Olden/em3d/em3d: 10.08% (0.1657 => 0.1824, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.75% (1.3245 => 1.4536, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.63% (0.6576 => 0.7209, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 9.62% (0.6250 => 0.6851, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.58% (1.5188 => 1.6643, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.42% (3.6692 => 4.0147, std.dev.: 0.0033) MultiSource/Applications/oggenc/oggenc: 9.41% (4.6629 => 5.1019, std.dev.: 0.0136) MultiSource/Applications/SIBsim4/SIBsim4: 9.41% (1.2749 => 1.3949, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 9.33% (14.8535 => 16.2394, std.dev.: 0.0143) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.32% (4.4433 => 4.8572, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.30% (4.3801 => 4.7875, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.19% (0.6135 => 0.6699, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 9.05% (8.4961 => 9.2650, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.97% (0.2140 => 0.2332, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.97% (0.8818 => 0.9609, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.96% (0.2321 => 0.2529, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.84% (3.2742 => 3.5638, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.76% (0.4805 => 0.5226, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.73% (2.1007 => 2.2840, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/05-eks/eks: 8.68% (0.4113 => 0.4470, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.62% (1.1333 => 1.2310, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.61% (0.1789 => 0.1943, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.57% (0.9108 => 0.9889, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 8.57% (0.1213 => 0.1317, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 8.53% (3.7467 => 4.0662, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.51% (0.3245 => 0.3521, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: 8.38% (0.1385 => 0.1501, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.32% (0.3511 => 0.3803, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 8.25% (1.2292 => 1.3306, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.19% (0.2504 => 0.2709, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 8.07% (0.2008 => 0.2170, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 8.06% (6.5754 => 7.1056, std.dev.: 0.0065) SingleSource/UnitTests/ObjC/parameter-passing: 7.92% (0.4003 => 0.4320, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.51% (0.3940 => 0.4236, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.48% (0.1819 => 0.1955, std.dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.48% (6.2785 => 6.7479, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/exceptions: 7.38% (0.3914 => 0.4203, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.37% (13.2842 => 14.2626, std.dev.: 0.0077) SingleSource/UnitTests/ObjC/trivial-interface: 7.10% (0.3578 => 0.3832, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.07% (0.3789 => 0.4057, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.07% (0.3650 => 0.3908, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 7.00% (0.3601 => 0.3853, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.99% (0.3646 => 0.3901, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 6.96% (0.3663 => 0.3918, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.90% (0.3623 => 0.3873, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.02% (0.2243 => 0.2378, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/ReedSolomon: 5.97% (0.1777 => 0.1883, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 5.93% (16.2614 => 17.2252, std.dev.: 0.0141) MultiSource/Applications/ClamAV/clamscan: 4.92% (14.5298 => 15.2444, std.dev.: 0.0083) MultiSource/Benchmarks/Olden/bh/bh: 4.06% (0.2859 => 0.2975, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 3.23% (33.2944 => 34.3707, std.dev.: 0.0091) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.64% (5.7573 => 7.5213, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.06% (1.0895 => 1.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 24.58% (1.8175 => 2.2643, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/richards_benchmark: 11.03% (1.1560 => 1.2835, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4144, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.29% (1.2998 => 1.3816, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0048, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.92% (11.2619 => 11.7029, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.89% (1.7081 => 1.7746, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 3.38% (1.9199 => 1.9847, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.34% (10.7476 => 11.1070, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.16% (7.4271 => 7.5876, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.59% (1.4298 => 1.4525, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5149, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/queens: 1.47% (2.1753 => 2.2072, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1878, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5781, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5862, std.dev.: 0.0070) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.52% (0.2670 => 0.1428, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.95% (0.4657 => 0.3914, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.74% (1.3819 => 1.2058, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.73% (1.3813 => 1.2055, std.dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.64% (0.0997 => 0.0861, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -12.20% (0.2238 => 0.1965, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -11.59% (1.2308 => 1.0881, std.dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.10% (20.3410 => 18.2865, std.dev.: 0.0157) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.34% (1.3780 => 1.2906, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0017) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8004, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.11% (0.9996 => 0.9585, std.dev.: 0.0033) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.51% (1.7688 => 1.7068, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -3.35% (3.2729 => 3.1632, std.dev.: 0.0249) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.29% (0.4867 => 0.4707, std.dev.: 0.0006) MultiSource/Applications/lua/lua: -2.61% (26.5159 => 25.8247, std.dev.: 0.0425) SingleSource/Regression/C/uint64_to_float: -2.55% (0.5449 => 0.5310, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.54% (3.0263 => 2.9493, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.40% (1.9762 => 1.9288, std.dev.: 0.0031) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.16% (0.6589 => 0.6447, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.78% (28.2225 => 27.7200, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.77% (6.3560 => 6.2438, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0068, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8671, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.25% (0.8342 => 0.8238, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.5254 => 2.4941, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -1.15% (5.3167 => 5.2555, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 17 04:46:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 17 Oct 2012 06:46:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121017114653.64E722A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4926?compare_to=4923&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4926, Order: 166096, Start Time: 2012-10-17 10:28:50, End Time: 2012-10-17 11:48:49 To: 4923, Order: 166091, Start Time: 2012-10-17 08:38:15, End Time: 2012-10-17 09:58:10 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (161 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 952 (684 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.07% (54.4440 => 56.1174, std.dev.: 0.1356) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.03% (0.5959 => 0.5957, std.dev.: 0.0044) MultiSource/Applications/SPASS/SPASS: -0.05% (16.4670 => 16.4589, std.dev.: 0.0117) MultiSource/Benchmarks/Bullet/bullet: -0.04% (55.5577 => 55.5349, std.dev.: 0.0139) MultiSource/Benchmarks/MallocBench/gs/gs: 0.01% (4.4558 => 4.4561, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.21% (0.0467 => 0.0468, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0469 => 0.0469, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.46% (0.0435 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0438 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0426 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.23% (0.0427 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0419 => 0.0419, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0420 => 0.0420, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.23% (0.0436 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0438 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0431 => 0.0431) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.23% (0.0432 => 0.0433) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0422 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0423 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0428 => 0.0428, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.23% (0.0429 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0440 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.12% (0.0461 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.24% (0.0415 => 0.0416) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0417 => 0.0417, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0428 => 0.0428) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.23% (0.0430 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0419 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.24% (0.0420 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0411 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0412 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0411 => 0.0411) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.24% (0.0411 => 0.0412) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.22% (0.0447 => 0.0448, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0449 => 0.0449, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0409 => 0.0409) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0410 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0411 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.24% (0.0412 => 0.0413, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0418 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0419 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.03% (1.2618 => 1.2614, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.04% (7.9408 => 7.9380, std.dev.: 0.0201) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.12% (0.7437 => 0.7446, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.28% (0.0363 => 0.0364, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.50% (0.2134 => 0.2166, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.19% (63.2438 => 55.5349, std.dev.: 0.0139) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.23% (14.1553 => 19.0009, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++-EH/spirit: 64.35% (3.4629 => 5.6913, std.dev.: 0.0028) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13451.94% (0.0720 => 9.7574, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9974600.00% (0.0001 => 9.9747, std.dev.: 0.0009) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 59.67% (0.2554 => 0.4078, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 45.62% (10.3673 => 15.0964, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/richards_benchmark: 35.76% (0.1622 => 0.2202, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 33.05% (0.1056 => 0.1405, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.01% (2.2022 => 2.5769, std.dev.: 0.0124) SingleSource/Benchmarks/Misc/flops: 16.83% (0.1432 => 0.1673, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 16.71% (7.0540 => 8.2329, std.dev.: 0.0139) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.39% (0.1566 => 0.1807, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.43% (0.0871 => 0.0988) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.78% (1.7609 => 1.9860, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 12.57% (0.1440 => 0.1621, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/oourafft: 12.40% (0.3282 => 0.3689, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.23% (0.0834 => 0.0936, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 12.18% (0.1584 => 0.1777, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.72% (0.1143 => 0.1277, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 11.02% (10.4361 => 11.5858, std.dev.: 0.0106) MultiSource/Applications/lambda-0_1_3/lambda: 10.82% (0.7433 => 0.8237, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 10.78% (0.7115 => 0.7882, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.60% (0.3473 => 0.3841, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.54% (0.3927 => 0.4341, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.47% (0.3543 => 0.3914, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.47% (0.3543 => 0.3914, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-2: 10.47% (0.3497 => 0.3863, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.40% (0.3828 => 0.4226, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.40% (0.6675 => 0.7369, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.39% (0.3561 => 0.3931, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.38% (0.3516 => 0.3881, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.34% (0.3886 => 0.4288, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.33% (0.2700 => 0.2979, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 10.30% (0.1175 => 0.1296, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.26% (0.3177 => 0.3503, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/for-in: 10.26% (0.3694 => 0.4073, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 10.21% (0.1655 => 0.1824, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 10.21% (0.1695 => 0.1868, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 10.02% (9.4845 => 10.4353, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.98% (1.5415 => 1.6954, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 9.97% (0.3109 => 0.3419, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 9.97% (3.3354 => 3.6678, std.dev.: 0.0080) MultiSource/Benchmarks/McCat/18-imp/imp: 9.90% (0.3423 => 0.3762, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.84% (0.4615 => 0.5069, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 9.82% (5.7591 => 6.3244, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.66% (0.5105 => 0.5598, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.63% (0.4879 => 0.5349, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: 9.59% (1.1642 => 1.2758, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.53% (0.1438 => 0.1575, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 9.47% (0.1151 => 0.1260, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.47% (0.1236 => 0.1353, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.45% (0.5860 => 0.6414, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.38% (4.2646 => 4.6648, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.36% (1.3050 => 1.4271, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.35% (0.8067 => 0.8821, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.34% (0.2271 => 0.2483, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.29% (0.1625 => 0.1776, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 9.29% (0.1163 => 0.1271, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.27% (0.5569 => 0.6085, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 9.26% (3.8723 => 4.2307, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.23% (0.1940 => 0.2119, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.14% (0.1510 => 0.1648, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 9.13% (0.1555 => 0.1697, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.02% (0.2107 => 0.2297, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.97% (0.9765 => 1.0641, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.95% (0.8172 => 0.8903, std.dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.91% (0.3121 => 0.3399, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.89% (0.3307 => 0.3601, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.88% (0.5020 => 0.5466, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.88% (0.2758 => 0.3003, std.dev.: 0.0019) MultiSource/Applications/spiff/spiff: 8.87% (0.7835 => 0.8530, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.85% (1.5859 => 1.7262, std.dev.: 0.0182) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.84% (5.0018 => 5.4438, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/bigfib: 8.80% (0.6456 => 0.7024, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 8.73% (2.0273 => 2.2042, std.dev.: 0.0123) MultiSource/Benchmarks/sim/sim: 8.71% (0.3387 => 0.3682, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.71% (4.9449 => 5.3755, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.62% (0.2065 => 0.2243, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.59% (8.1363 => 8.8352, std.dev.: 0.0107) MultiSource/Applications/lemon/lemon: 8.56% (1.0722 => 1.1640, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.53% (0.1337 => 0.1451, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 8.45% (2.2969 => 2.4911, std.dev.: 0.0047) SingleSource/UnitTests/ObjC++/property-reference-object: 8.44% (0.6030 => 0.6539, std.dev.: 0.0038) SingleSource/UnitTests/ObjC++/Hello: 8.32% (0.5925 => 0.6418, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.17% (0.3441 => 0.3722, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 8.05% (0.3180 => 0.3436, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 8.00% (1.5603 => 1.6852, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.92% (0.4103 => 0.4428, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.87% (0.3865 => 0.4169, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.84% (2.2024 => 2.3751, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.78% (1.1861 => 1.2784, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.69% (7.9617 => 8.5739, std.dev.: 0.0059) SingleSource/UnitTests/ObjC++/property-reference: 7.62% (0.7326 => 0.7884, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.61% (0.2603 => 0.2801, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 7.58% (21.9371 => 23.6002, std.dev.: 0.0104) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.52% (0.6450 => 0.6935, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.49% (0.1695 => 0.1822, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.28% (0.4203 => 0.4509, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.25% (0.4289 => 0.4600, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 7.25% (0.3422 => 0.3670, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/neural/neural: 7.18% (0.1463 => 0.1568, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.14% (0.4299 => 0.4606, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 7.13% (0.8921 => 0.9557, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: 7.10% (0.4620 => 0.4948, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.09% (0.5981 => 0.6405, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.90% (0.4636 => 0.4956, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/moments: 6.89% (0.4048 => 0.4327, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.83% (1.4186 => 1.5155, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.77% (0.1892 => 0.2020, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.63% (0.3650 => 0.3892, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.59% (0.3826 => 0.4078, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 6.55% (0.3603 => 0.3839, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 6.51% (0.3684 => 0.3924, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 6.34% (1.1840 => 1.2591, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.29% (0.3162 => 0.3361, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.27% (0.2905 => 0.3087, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 6.25% (0.2831 => 0.3008, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.25% (0.3136 => 0.3332, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.13% (0.3098 => 0.3288, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.12% (0.2891 => 0.3068) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.09% (0.2266 => 0.2404, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.09% (0.1906 => 0.2022, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.03% (0.2871 => 0.3044, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.93% (0.8101 => 0.8581, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 5.87% (0.2877 => 0.3046, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.87% (0.2793 => 0.2957, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.85% (2.0665 => 2.1874, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary3: 5.82% (0.3283 => 0.3474, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.79% (0.3232 => 0.3419, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.77% (0.3052 => 0.3228, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.68% (0.2872 => 0.3035, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 5.67% (0.2802 => 0.2961, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.66% (0.2756 => 0.2912, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 5.61% (0.2725 => 0.2878, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 5.34% (0.2714 => 0.2859, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary2: 5.33% (0.3379 => 0.3559, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/ReedSolomon: 5.08% (0.2049 => 0.2153, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.91% (14.3668 => 15.0725, std.dev.: 0.0142) MultiSource/Applications/sqlite3/sqlite3: 4.83% (17.1811 => 18.0111, std.dev.: 0.0186) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.73% (0.3427 => 0.3589, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.57% (0.2430 => 0.2541, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 4.45% (1.2842 => 1.3414, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: 4.44% (0.3131 => 0.3270, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.32% (3.8922 => 4.0602, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.93% (0.3817 => 0.3929, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.70% (1.1194 => 1.1496, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.85% (1.1396 => 1.2519, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560) MultiSource/Applications/aha/aha: 9.21% (3.1595 => 3.4506, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.64% (3.1578 => 3.3674, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.77% (4.2280 => 4.3450, std.dev.: 0.0355) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7651, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.44% (0.9540 => 0.9677, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.15% (2.6546 => 2.6850, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.09% (6.5088 => 6.5798, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 1.01% (9.1159 => 9.2078, std.dev.: 0.0113) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.06% (6.6874 => 0.1297, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -79.99% (0.8651 => 0.1731, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.28% (5.2763 => 3.2567, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.42% (5.3855 => 3.6933, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.81% (5.3526 => 3.7035, std.dev.: 0.0042) SingleSource/UnitTests/Vector/constpool: -14.74% (54.1659 => 46.1821, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.49% (2.9384 => 2.6303, std.dev.: 0.0045) MultiSource/Applications/ClamAV/clamscan: -9.67% (22.1758 => 20.0308, std.dev.: 0.0262) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.32% (1.1492 => 0.7663, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -15.79% (1.6925 => 1.4252, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.63% (0.0998 => 0.0862, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.15% (1.2373 => 1.0994, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel-2: -10.45% (1.5373 => 1.3767, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/mason/mason: -10.00% (0.2161 => 0.1945, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.37% (19.9488 => 18.2788, std.dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.68% (1.8329 => 1.7104, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.30% (1.6805 => 1.5914, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.94% (1.5835 => 1.5052, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.31% (0.9957 => 0.9528, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.73% (1.3677 => 1.3167, std.dev.: 0.0008) MultiSource/Applications/siod/siod: -3.59% (3.2827 => 3.1650, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4715, std.dev.: 0.0069) MultiSource/Applications/hexxagon/hexxagon: -3.01% (12.4730 => 12.0978, std.dev.: 0.0018) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.92% (8.1563 => 7.9996, std.dev.: 0.0144) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0858, std.dev.: 0.0093) SingleSource/Regression/C/uint64_to_float: -1.88% (0.5413 => 0.5311, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -1.83% (2.5528 => 2.5061, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6826, std.dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4217, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.16% (6.2999 => 6.2270, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.10% (2.3135 => 2.2880, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8576, std.dev.: 0.0101) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.92% (0.5229 => 0.5957, std.dev.: 0.0044) MultiSource/Applications/SPASS/SPASS: 9.80% (14.9895 => 16.4589, std.dev.: 0.0117) MultiSource/Benchmarks/MallocBench/gs/gs: 8.41% (4.1105 => 4.4561, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.17% (1.1048 => 1.2614, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.89% (7.1582 => 7.9380, std.dev.: 0.0201) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.67% (0.6222 => 0.7446, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36300.00% (0.0001 => 0.0364, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.36% (0.2116 => 0.2166, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 17 05:47:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 17 Oct 2012 07:47:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121017124734.89F8F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4927?compare_to=4925&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4927, Order: 166096, Start Time: 2012-10-17 11:24:29, End Time: 2012-10-17 12:50:30 To: 4925, Order: 166092, Start Time: 2012-10-17 09:29:11, End Time: 2012-10-17 10:55:09 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (192 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1042 (676 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.39% (2.0176 => 2.5096, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 19.60% (0.0653 => 0.0781, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 19.22% (0.1410 => 0.1681, std.dev.: 0.0013) SingleSource/UnitTests/2006-12-11-LoadConstants: 18.47% (0.1072 => 0.1270, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 18.16% (0.0826 => 0.0976, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 17.83% (0.2243 => 0.2643, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.07% (0.1327 => 0.1527, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 15.00% (0.1013 => 0.1165, std.dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: 14.63% (0.7038 => 0.8068, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 14.55% (1.3693 => 1.5685, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.27% (0.0834 => 0.0953, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.23% (0.1413 => 0.1614, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 13.91% (0.4328 => 0.4930, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.69% (0.0964 => 0.1096, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 13.67% (0.0746 => 0.0848, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.48% (0.1588 => 0.1802, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.46% (3.9660 => 4.4998, std.dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.34% (0.6283 => 0.7121, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 13.30% (0.2721 => 0.3083, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 13.26% (0.1003 => 0.1136, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 13.18% (0.1062 => 0.1202, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.16% (0.6959 => 0.7875, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash: 13.10% (0.4062 => 0.4594, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.06% (0.2596 => 0.2935, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 13.06% (13.8202 => 15.6246, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.85% (0.3899 => 0.4400, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.79% (1.4563 => 1.6425, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.71% (0.5265 => 0.5934, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.66% (0.9199 => 1.0364, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/distray/distray: 12.59% (0.0818 => 0.0921, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.54% (0.7710 => 0.8677, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.48% (1.2193 => 1.3715, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 12.25% (1.0313 => 1.1576, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.21% (1.1364 => 1.2752, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.19% (0.4791 => 0.5375, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.19% (0.1157 => 0.1298, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.17% (0.3485 => 0.3909, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 12.10% (0.5818 => 0.6522, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.08% (0.4016 => 0.4501, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 12.05% (0.2781 => 0.3116, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.98% (0.3756 => 0.4206, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 11.98% (16.6129 => 18.6031, std.dev.: 0.0197) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.88% (0.3022 => 0.3381, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 11.87% (0.3293 => 0.3684, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.87% (0.4390 => 0.4911, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 11.84% (0.3489 => 0.3902, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 11.83% (1.1061 => 1.2369, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.82% (0.3130 => 0.3500, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 11.81% (0.0847 => 0.0947, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 11.73% (0.5748 => 0.6422, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 11.70% (0.1111 => 0.1241, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 11.64% (0.3453 => 0.3855, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.61% (0.2782 => 0.3105, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.55% (0.5577 => 0.6221, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 11.53% (0.3868 => 0.4314, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.42% (0.3580 => 0.3989, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 11.42% (0.6744 => 0.7514, std.dev.: 0.0056) SingleSource/UnitTests/ObjC++/property-reference: 11.41% (0.7061 => 0.7867, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/strcat: 11.41% (0.2726 => 0.3037, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.40% (0.8698 => 0.9690, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/office/office: 11.40% (0.2966 => 0.3304, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 11.38% (0.2760 => 0.3074, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 11.30% (2.1791 => 2.4253, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.28% (0.1569 => 0.1746, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 11.26% (0.1589 => 0.1768, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 11.24% (0.3149 => 0.3503, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 11.23% (0.2761 => 0.3071, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 11.23% (1.9828 => 2.2054, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/gs/gs: 11.20% (3.8646 => 4.2976, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hello: 11.20% (0.2607 => 0.2899, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.15% (0.2655 => 0.2951, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.14% (0.4379 => 0.4867, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 11.13% (0.2937 => 0.3264, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 11.12% (0.2690 => 0.2989, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary: 11.10% (0.3107 => 0.3452, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 11.09% (0.3534 => 0.3926, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.09% (0.3246 => 0.3606, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 11.07% (0.1075 => 0.1194, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 11.05% (0.2995 => 0.3326, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 11.05% (0.1276 => 0.1417, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/fibo: 11.04% (0.2628 => 0.2918, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.99% (0.1865 => 0.2070, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 10.98% (1.9270 => 2.1385, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.96% (0.0976 => 0.1083, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 10.90% (3.1889 => 3.5366, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/18-imp/imp: 10.90% (0.3220 => 0.3571, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.89% (0.2765 => 0.3066, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 10.88% (0.7506 => 0.8323, std.dev.: 0.0046) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.88% (0.2914 => 0.3231, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 10.87% (0.3192 => 0.3539, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.86% (0.2127 => 0.2358) SingleSource/Benchmarks/Shootout-C++/matrix: 10.81% (0.2988 => 0.3311, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.80% (0.7460 => 0.8266, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 10.77% (0.2925 => 0.3240, std.dev.: 0.0019) MultiSource/Applications/viterbi/viterbi: 10.76% (0.1478 => 0.1637, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.73% (0.1435 => 0.1589, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.71% (4.9865 => 5.5208, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.68% (0.2696 => 0.2984, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 10.58% (0.8310 => 0.9189, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.57% (0.1986 => 0.2196, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.54% (0.0977 => 0.1080, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.45% (0.1014 => 0.1120, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.41% (0.5637 => 0.6224, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 10.37% (1.0594 => 1.1693, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.36% (0.3755 => 0.4144, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.33% (0.2023 => 0.2232, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 10.22% (0.2945 => 0.3246, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.08% (7.2180 => 7.9455, std.dev.: 0.0095) MultiSource/Benchmarks/Olden/em3d/em3d: 10.02% (0.1657 => 0.1823, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.81% (1.3245 => 1.4544, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.66% (0.6576 => 0.7211, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 9.57% (0.6250 => 0.6848, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.55% (1.5188 => 1.6639, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.50% (3.6692 => 4.0179, std.dev.: 0.0035) MultiSource/Applications/SIBsim4/SIBsim4: 9.47% (1.2749 => 1.3956, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 9.45% (4.6629 => 5.1035, std.dev.: 0.0090) MultiSource/Benchmarks/sim/sim: 9.42% (0.3131 => 0.3426, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.39% (4.3801 => 4.7915, std.dev.: 0.0076) MultiSource/Applications/JM/lencod/lencod: 9.38% (14.8535 => 16.2474, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.34% (4.4433 => 4.8585, std.dev.: 0.0081) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.26% (0.2321 => 0.2536, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.14% (0.6135 => 0.6696, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 9.07% (8.4961 => 9.2664, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.07% (0.2140 => 0.2334, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.96% (3.2742 => 3.5676, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.94% (0.8818 => 0.9606, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.78% (2.1007 => 2.2852, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.78% (0.4805 => 0.5227, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 8.77% (3.7467 => 4.0754, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/health/health: 8.66% (0.1213 => 0.1318, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.63% (0.9108 => 0.9894, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 8.61% (0.4113 => 0.4467, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.60% (0.3511 => 0.3813, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.50% (1.1333 => 1.2296, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.50% (0.1789 => 0.1941, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.47% (0.3245 => 0.3520, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: 8.45% (0.1385 => 0.1502, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 8.25% (1.2292 => 1.3306, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 8.14% (6.5754 => 7.1107, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.11% (0.2504 => 0.2707, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 8.02% (0.2008 => 0.2169, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.82% (0.4003 => 0.4316, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.64% (0.1819 => 0.1958, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.49% (0.3940 => 0.4235, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.45% (6.2785 => 6.7465, std.dev.: 0.0134) SingleSource/UnitTests/ObjC/exceptions: 7.41% (0.3914 => 0.4204, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.26% (13.2842 => 14.2492, std.dev.: 0.0293) SingleSource/UnitTests/ObjC/trivial-interface: 7.07% (0.3578 => 0.3831, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.05% (0.3646 => 0.3903, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.02% (0.3789 => 0.4055, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.02% (0.3663 => 0.3920, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.94% (0.3601 => 0.3851, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.90% (0.3650 => 0.3902, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.82% (0.3623 => 0.3870, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.15% (0.2243 => 0.2381, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 5.97% (0.1777 => 0.1883, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 5.95% (16.2614 => 17.2289, std.dev.: 0.0122) MultiSource/Applications/ClamAV/clamscan: 4.96% (14.5298 => 15.2501, std.dev.: 0.0093) MultiSource/Benchmarks/Olden/bh/bh: 4.09% (0.2859 => 0.2976, std.dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: 3.21% (33.2944 => 34.3632, std.dev.: 0.0115) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.77% (0.4846 => 0.6967, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 30.62% (5.7573 => 7.5201, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: 25.01% (1.8175 => 2.2721, std.dev.: 0.0342) SingleSource/Benchmarks/Misc/richards_benchmark: 11.05% (1.1560 => 1.2837, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 8.99% (0.8273 => 0.9017, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.62% (3.1736 => 3.4153, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 5.99% (1.2998 => 1.3777, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9999, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0052, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.91% (11.2619 => 11.7025, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.87% (1.7081 => 1.7742, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 3.48% (1.9199 => 1.9868, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.40% (10.7476 => 11.1125, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.14% (7.4271 => 7.5859, std.dev.: 0.0064) MultiSource/Applications/lemon/lemon: 1.78% (1.4298 => 1.4552, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0497, std.dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5131, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9698, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1881, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5780, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.13% (3.1071 => 3.1422, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5886, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.52% (0.2670 => 0.1428, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.02% (0.4657 => 0.3911, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.74% (1.3819 => 1.2059, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.72% (1.3813 => 1.2056, std.dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.04% (0.0997 => 0.0857, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -12.02% (0.2238 => 0.1969, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.39% (1.2308 => 1.0906, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.08% (20.3410 => 18.2909, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.38% (2.5089 => 2.3740, std.dev.: 0.0051) SingleSource/UnitTests/Vector/multiplies: -4.97% (2.6470 => 2.5154, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655) MultiSource/Benchmarks/sim/sim: -4.31% (5.0168 => 4.8004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.51% (1.7688 => 1.7068, std.dev.: 0.0012) MultiSource/Applications/siod/siod: -3.43% (3.2729 => 3.1606, std.dev.: 0.0209) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: -2.55% (0.5449 => 0.5310, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.51% (26.5159 => 25.8507, std.dev.: 0.0246) MultiSource/Applications/spiff/spiff: -2.49% (3.0263 => 2.9510, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: -2.39% (1.9762 => 1.9289, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.99% (0.6589 => 0.6458, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7155, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/lists: -1.73% (6.3560 => 6.2459, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.56% (0.6615 => 0.6512, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0068, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8633, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.23% (0.8342 => 0.8239, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.17% (2.5254 => 2.4958, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2580, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 17 07:02:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 17 Oct 2012 09:02:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121017140204.4BFBB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4928?compare_to=4924&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4928, Order: 166096, Start Time: 2012-10-17 10:47:44, End Time: 2012-10-17 14:03:59 To: 4924, Order: 166085, Start Time: 2012-10-17 04:23:47, End Time: 2012-10-17 10:13:24 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Passes: 4 (0 on baseline) Performance Regressions: 2 (140 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1036 (751 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 19.42% (4.5762 => 5.4650, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 6.30% (9.3529 => 9.9420, std.dev.: 0.0361) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 6.61% (11.2952 => 12.0415, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 0.10% (5.1868 => 5.1919, std.dev.: 0.0068) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 7.28% (110.4452 => 118.4865, std.dev.: 0.0890) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.92% (2.0738 => 2.1136, std.dev.: 0.0103) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.29% (0.1063 => 0.1183, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 10.73% (1.5932 => 1.7642, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.21% (0.3488 => 0.3844, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/exceptions-4: 10.16% (0.3465 => 0.3817, std.dev.: 0.0124) SingleSource/UnitTests/ObjC/exceptions-2: 10.16% (0.3446 => 0.3796, std.dev.: 0.0083) SingleSource/UnitTests/ObjC/for-in: 10.15% (0.3496 => 0.3851, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/exceptions-3: 10.14% (0.3460 => 0.3811, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.12% (0.1028 => 0.1132, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.11% (0.3442 => 0.3790, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/property: 10.11% (0.3650 => 0.4019, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/synchronized: 10.00% (0.3469 => 0.3816, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/exceptions: 9.99% (0.3643 => 0.4007, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/parameter-passing: 9.83% (0.3724 => 0.4090, std.dev.: 0.0054) MultiSource/Applications/SPASS/SPASS: 9.56% (5.5417 => 6.0714, std.dev.: 0.0069) MultiSource/Benchmarks/McCat/08-main/main: 9.28% (0.1218 => 0.1331, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 8.83% (0.1619 => 0.1762, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.75% (0.4994 => 0.5431, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.74% (0.4361 => 0.4742, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.62% (0.7426 => 0.8066, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 8.56% (0.4847 => 0.5262, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.37% (0.2103 => 0.2279, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.36% (0.5826 => 0.6313, std.dev.: 0.0033) MultiSource/Applications/siod/siod: 8.28% (0.6634 => 0.7183, std.dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 8.26% (0.2566 => 0.2778, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.20% (1.6211 => 1.7540, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.19% (0.5361 => 0.5800, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.13% (0.5889 => 0.6368, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.99% (1.3152 => 1.4203, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.98% (0.5000 => 0.5399, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.92% (0.2866 => 0.3093, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 7.82% (0.3336 => 0.3597, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.82% (0.2736 => 0.2950, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 7.78% (1.0781 => 1.1620, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.78% (0.3084 => 0.3324, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.68% (0.3930 => 0.4232, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 7.68% (1.8794 => 2.0237, std.dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: 7.65% (23.5202 => 25.3190, std.dev.: 0.0204) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.60% (0.2014 => 0.2167, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.59% (2.7292 => 2.9364, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 7.57% (0.1505 => 0.1619, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.53% (0.1620 => 0.1742, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 7.53% (0.1421 => 0.1528, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.47% (0.5584 => 0.6001, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 7.34% (1.4269 => 1.5317, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.34% (11.6398 => 12.4942, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.30% (0.2068 => 0.2219, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.28% (0.5026 => 0.5392, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.24% (0.6435 => 0.6901, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.23% (0.2737 => 0.2935, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.23% (0.1549 => 0.1661, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.20% (0.4139 => 0.4437, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.16% (0.1968 => 0.2109, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.14% (3.5627 => 3.8170, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.12% (0.3625 => 0.3883, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.11% (0.1462 => 0.1566, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.11% (0.2040 => 0.2185, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.07% (0.3903 => 0.4179, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.01% (0.7171 => 0.7674, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.01% (0.3195 => 0.3419, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 7.00% (0.4029 => 0.4311, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 7.00% (4.2109 => 4.5056, std.dev.: 0.0230) SingleSource/Benchmarks/Shootout-C++/hash: 6.99% (0.4146 => 0.4436, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.99% (0.3890 => 0.4162, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.93% (0.3362 => 0.3595, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.89% (0.2875 => 0.3073, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 6.87% (0.3726 => 0.3982, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 6.87% (0.3348 => 0.3578, std.dev.: 0.0016) MultiSource/Applications/Burg/burg: 6.85% (0.5546 => 0.5926, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.85% (0.3271 => 0.3495, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 6.84% (0.3477 => 0.3715, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.83% (0.3267 => 0.3490, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.82% (0.3678 => 0.3929, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.80% (0.4251 => 0.4540, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.79% (0.2738 => 0.2924, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 6.78% (2.0346 => 2.1725, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.75% (4.4195 => 4.7178, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.72% (0.3124 => 0.3334, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.72% (0.3258 => 0.3477, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.70% (0.2911 => 0.3106, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.69% (2.0673 => 2.2057, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 6.69% (0.2750 => 0.2934, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 6.69% (0.9909 => 1.0572, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/methcall: 6.68% (0.2813 => 0.3001, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 6.67% (2.1013 => 2.2415, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hello: 6.67% (0.2714 => 0.2895, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.66% (0.5900 => 0.6293, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary2: 6.63% (0.3317 => 0.3537, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.63% (0.3981 => 0.4245, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 6.62% (0.5012 => 0.5344, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 6.61% (0.2725 => 0.2905, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.60% (0.3060 => 0.3262, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.59% (0.2792 => 0.2976, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 6.59% (0.2823 => 0.3009, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 6.58% (0.9697 => 1.0335, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.56% (0.2729 => 0.2908, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.56% (0.3690 => 0.3932, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.50% (0.4658 => 0.4961, std.dev.: 0.0042) SingleSource/Regression/C++/ofstream_ctor: 6.49% (0.3004 => 0.3199, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.46% (0.2803 => 0.2984, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.44% (0.2811 => 0.2992, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 6.44% (0.2780 => 0.2959, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 6.41% (0.2075 => 0.2208, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.40% (0.2969 => 0.3159, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.40% (0.3282 => 0.3492, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.39% (4.6926 => 4.9924, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 6.23% (4.6177 => 4.9056, std.dev.: 0.0082) MultiSource/Applications/lemon/lemon: 6.23% (0.2391 => 0.2540, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 6.22% (0.7875 => 0.8365, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 6.19% (2.1653 => 2.2993, std.dev.: 0.0071) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.14% (0.3845 => 0.4081, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.75% (1.9966 => 2.1115, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 5.65% (0.2691 => 0.2843, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.63% (1.9694 => 2.0802, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 5.35% (0.3498 => 0.3685, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.40% (0.4253 => 0.4440, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 4.26% (11.9555 => 12.4643, std.dev.: 0.0130) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-1: 22.63% (6.2401 => 7.6525, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0300, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 9.60% (0.2802 => 0.3071, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.45% (3.3903 => 3.6090, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary: 5.56% (0.2122 => 0.2240, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6748, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.01% (0.3693 => 0.3878, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-2: 4.73% (1.8057 => 1.8911, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1675, std.dev.: 0.0034) SingleSource/Benchmarks/Dhrystone/dry: 4.24% (14.0481 => 14.6442, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2080, std.dev.: 0.0077) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.58% (3.1722 => 3.2223, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.52% (2.0820 => 2.1136, std.dev.: 0.0103) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2897, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3035, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5136, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5855, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.92% (25.4195 => 16.5432, std.dev.: 0.0086) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9765, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7985, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary2: -7.41% (0.2402 => 0.2224, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/tsp/tsp: -7.31% (2.1113 => 1.9570, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8007, std.dev.: 0.0099) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7734, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -2.95% (3.6262 => 3.5191, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.92% (0.6293 => 0.6109, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.21% (41.7953 => 40.8730, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: -2.18% (17.2379 => 16.8619, std.dev.: 0.0358) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5796, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4952, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.24% (105.3826 => 104.0797, std.dev.: 0.1108) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0449, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 17 08:29:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 17 Oct 2012 10:29:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121017152951.5C1F72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4929?compare_to=4926&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4929, Order: 166100, Start Time: 2012-10-17 14:12:04, End Time: 2012-10-17 15:31:47 To: 4926, Order: 166096, Start Time: 2012-10-17 10:28:50, End Time: 2012-10-17 11:48:49 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (161 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 953 (685 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.05% (0.5957 => 0.5960, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 0.05% (16.4589 => 16.4664, std.dev.: 0.0098) MultiSource/Benchmarks/Bullet/bullet: 0.01% (55.5349 => 55.5410, std.dev.: 0.0142) MultiSource/Benchmarks/MallocBench/gs/gs: 0.02% (4.4561 => 4.4571, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.21% (0.0468 => 0.0467, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0469 => 0.0469, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0437 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0438 => 0.0438, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0426 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.23% (0.0426 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0419 => 0.0419, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0420 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0437 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0438 => 0.0438, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0431 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0433 => 0.0433) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0422 => 0.0422, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0423 => 0.0423, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0428 => 0.0428, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0430 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0440 => 0.0440, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.23% (0.0442 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0416 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0417 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0428 => 0.0428, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.23% (0.0429 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0419 => 0.0419, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0421 => 0.0421, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0411 => 0.0411, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.24% (0.0412 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0411 => 0.0411, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.24% (0.0412 => 0.0411, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0448 => 0.0448, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0449 => 0.0449, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0409 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0410 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0411 => 0.0411, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0413 => 0.0413, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0418 => 0.0418, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.24% (0.0419 => 0.0420) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.02% (1.2614 => 1.2617, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.01% (7.9380 => 7.9384, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.11% (0.7446 => 0.7438, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.55% (0.0364 => 0.0362, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.57% (0.2166 => 0.2132, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.18% (63.2438 => 55.5410, std.dev.: 0.0142) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.17% (14.1553 => 18.9920, std.dev.: 0.0115) SingleSource/Benchmarks/Misc-C++-EH/spirit: 64.48% (3.4629 => 5.6959, std.dev.: 0.0087) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13462.78% (0.0720 => 9.7652, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9972400.00% (0.0001 => 9.9725, std.dev.: 0.0023) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 59.79% (0.2554 => 0.4081, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: 45.52% (10.3673 => 15.0868, std.dev.: 0.0145) SingleSource/Benchmarks/Misc/richards_benchmark: 36.07% (0.1622 => 0.2207, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 33.05% (0.1056 => 0.1405) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.93% (2.2022 => 2.5751, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 16.76% (0.1432 => 0.1672, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 16.68% (7.0540 => 8.2304, std.dev.: 0.0084) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.39% (0.1566 => 0.1807, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.32% (0.0871 => 0.0987) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.76% (1.7609 => 1.9856, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 12.64% (0.3282 => 0.3697, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.59% (0.0834 => 0.0939, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 12.31% (0.1584 => 0.1779, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 12.08% (0.1440 => 0.1614, std.dev.: 0.0029) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.72% (0.1143 => 0.1277, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 11.15% (0.1175 => 0.1306, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 11.02% (10.4361 => 11.5865, std.dev.: 0.0134) MultiSource/Applications/minisat/minisat: 10.91% (0.7115 => 0.7891, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 10.84% (0.7433 => 0.8239, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 10.70% (0.3927 => 0.4347, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.61% (0.3177 => 0.3514, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.58% (0.6675 => 0.7381, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.57% (0.3473 => 0.3840, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.47% (0.3543 => 0.3914, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.47% (0.3543 => 0.3914, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.44% (0.3516 => 0.3883, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.41% (0.2700 => 0.2981, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/exceptions-2: 10.38% (0.3497 => 0.3860, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.32% (0.3828 => 0.4223, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/synchronized: 10.31% (0.3561 => 0.3928, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.29% (0.3886 => 0.4286, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 10.21% (0.1655 => 0.1824, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.21% (0.3694 => 0.4071, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 9.99% (0.3423 => 0.3765, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 9.99% (3.3354 => 3.6686, std.dev.: 0.0063) MultiSource/Benchmarks/mafft/pairlocalalign: 9.98% (9.4845 => 10.4313, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.85% (1.5415 => 1.6934, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 9.85% (0.1695 => 0.1862, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 9.85% (5.7591 => 6.3262, std.dev.: 0.0031) MultiSource/Applications/sgefa/sgefa: 9.78% (0.3109 => 0.3413, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.71% (0.4615 => 0.5063, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.70% (0.5105 => 0.5600, std.dev.: 0.0066) MultiSource/Applications/aha/aha: 9.56% (0.1151 => 0.1261, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.53% (0.1438 => 0.1575, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.51% (0.4879 => 0.5343, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.47% (0.1236 => 0.1353, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/mst/mst: 9.46% (0.1163 => 0.1273, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.45% (4.2646 => 4.6676, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.39% (0.5860 => 0.6410, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 9.30% (1.1642 => 1.2725, std.dev.: 0.0111) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.29% (0.2271 => 0.2482, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.26% (1.3050 => 1.4258, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 9.25% (3.8723 => 4.2306, std.dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.25% (0.8067 => 0.8813, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.23% (0.1625 => 0.1775, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.21% (0.5569 => 0.6082, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.14% (0.1510 => 0.1648, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 9.13% (0.1555 => 0.1697, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.07% (0.1940 => 0.2116, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.07% (0.2107 => 0.2298, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.04% (0.3307 => 0.3606, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.96% (0.5020 => 0.5470, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.92% (0.2758 => 0.3004, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.91% (0.8172 => 0.8900, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.82% (5.0018 => 5.4430, std.dev.: 0.0104) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.81% (0.3121 => 0.3396, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.80% (0.9765 => 1.0624, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.77% (4.9449 => 5.3786, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.74% (1.5859 => 1.7245, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 8.72% (0.7835 => 0.8518, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 8.67% (0.6456 => 0.7016, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.65% (8.1363 => 8.8401, std.dev.: 0.0031) MultiSource/Applications/lemon/lemon: 8.62% (1.0722 => 1.1646, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.57% (0.2065 => 0.2242, std.dev.: 0.0018) MultiSource/Benchmarks/sim/sim: 8.56% (0.3387 => 0.3677, std.dev.: 0.0042) MultiSource/Applications/treecc/treecc: 8.51% (2.0273 => 2.1999, std.dev.: 0.0113) SingleSource/UnitTests/ObjC++/property-reference-object: 8.47% (0.6030 => 0.6541, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.47% (0.5925 => 0.6427, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.45% (0.1337 => 0.1450, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 8.32% (2.2969 => 2.4880, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/09-vor/vor: 8.14% (0.3180 => 0.3439, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 7.98% (1.5603 => 1.6848, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.97% (0.4103 => 0.4430, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.93% (0.3441 => 0.3714, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.90% (2.2024 => 2.3764, std.dev.: 0.0178) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.77% (1.1861 => 1.2783, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 7.68% (0.7326 => 0.7889, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.68% (7.9617 => 8.5735, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.64% (0.6450 => 0.6943, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.53% (0.2603 => 0.2799) MultiSource/Applications/JM/lencod/lencod: 7.51% (21.9371 => 23.5848, std.dev.: 0.0114) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.49% (0.1695 => 0.1822, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.40% (0.3865 => 0.4151, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.40% (0.4636 => 0.4979, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.28% (0.4203 => 0.4509, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 7.23% (0.4289 => 0.4599, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: 7.18% (0.1463 => 0.1568, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 7.15% (0.8921 => 0.9559, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 7.13% (0.3422 => 0.3666, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 7.09% (0.4299 => 0.4604, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.07% (0.5981 => 0.6404, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.99% (0.4620 => 0.4943, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 6.97% (0.4048 => 0.4330, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.84% (1.4186 => 1.5156, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.71% (0.1892 => 0.2019, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 6.58% (0.3603 => 0.3840, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.58% (0.3650 => 0.3890, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.53% (0.3826 => 0.4076, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 6.51% (0.3684 => 0.3924) MultiSource/Benchmarks/nbench/nbench: 6.38% (1.1840 => 1.2595, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.22% (0.3136 => 0.3331, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.19% (0.2891 => 0.3070, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.14% (0.3162 => 0.3356, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.13% (0.2905 => 0.3083, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.00% (0.2831 => 0.3001) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.00% (0.2266 => 0.2402, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.93% (0.1906 => 0.2019, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.93% (2.0665 => 2.1890, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/methcall: 5.87% (0.2877 => 0.3046, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 5.85% (0.3283 => 0.3475, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.84% (0.3098 => 0.3279, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 5.79% (0.3232 => 0.3419, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.78% (0.8101 => 0.8569, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 5.68% (0.2871 => 0.3034, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.66% (0.2756 => 0.2912, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.57% (0.2872 => 0.3032, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 5.50% (0.2725 => 0.2875, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.47% (0.3052 => 0.3219, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.44% (0.4064 => 0.4285, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.39% (0.2802 => 0.2953, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.34% (0.2714 => 0.2859, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.30% (0.2793 => 0.2941, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.27% (0.3379 => 0.3557, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: 5.08% (0.2049 => 0.2153, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.00% (14.3668 => 15.0849, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: 4.91% (17.1811 => 18.0239, std.dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.73% (0.3427 => 0.3589, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.69% (0.2430 => 0.2544, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 4.49% (1.2842 => 1.3419, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 4.41% (0.3131 => 0.3269, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.38% (3.8922 => 4.0625, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/bh/bh: 3.23% (0.3092 => 0.3192, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.96% (0.3817 => 0.3930, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.61% (1.1194 => 1.1486, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.23% (1.1145 => 1.3845, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.99% (1.1396 => 1.2534, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 9.21% (3.1595 => 3.4504, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.74% (3.1578 => 3.3707, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.75% (4.2280 => 4.3442, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.34% (1.7254 => 1.7657, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.43% (0.9540 => 0.9676, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.25% (2.6546 => 2.6877, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.06% (6.6874 => 0.1296, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -79.98% (0.8651 => 0.1732, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.30% (5.2763 => 3.2557, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.40% (5.3855 => 3.6944, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.85% (5.3526 => 3.7012, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -14.79% (54.1659 => 46.1552, std.dev.: 0.0322) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.46% (2.9384 => 2.6311, std.dev.: 0.0285) MultiSource/Applications/ClamAV/clamscan: -9.72% (22.1758 => 20.0209, std.dev.: 0.0102) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: -33.45% (1.1492 => 0.7648, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -15.96% (1.6925 => 1.4223, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.63% (0.0998 => 0.0862, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -12.03% (1.2373 => 1.0884, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/mandel-2: -10.28% (1.5373 => 1.3793, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/mason/mason: -10.13% (0.2161 => 0.1942, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.31% (19.9488 => 18.2915, std.dev.: 0.1293) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.75% (1.8329 => 1.7092, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.31% (1.6805 => 1.5912, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7964, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: -4.57% (1.5835 => 1.5112, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.31% (0.9957 => 0.9528, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.67% (3.2827 => 3.1621, std.dev.: 0.0137) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.18% (32.5116 => 31.4771, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: -3.00% (12.4730 => 12.0984, std.dev.: 0.0012) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.99% (10.2830 => 10.0788, std.dev.: 0.0399) SingleSource/Regression/C/uint64_to_float: -1.90% (0.5413 => 0.5310, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6811, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.68% (8.1563 => 8.0195, std.dev.: 0.0025) SingleSource/UnitTests/Vector/multiplies: -1.54% (2.5528 => 2.5136, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4203, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2879, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.01% (6.2999 => 6.2361, std.dev.: 0.0029) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.98% (0.5229 => 0.5960, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 9.85% (14.9895 => 16.4664, std.dev.: 0.0098) MultiSource/Benchmarks/MallocBench/gs/gs: 8.43% (4.1105 => 4.4571, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.20% (1.1048 => 1.2617, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.90% (7.1582 => 7.9384, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.54% (0.6222 => 0.7438, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36100.00% (0.0001 => 0.0362, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.76% (0.2116 => 0.2132, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 17 08:36:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 17 Oct 2012 10:36:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121017153608.9DF132A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4930?compare_to=4927&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4930, Order: 166100, Start Time: 2012-10-17 14:13:10, End Time: 2012-10-17 15:39:04 To: 4927, Order: 166096, Start Time: 2012-10-17 11:24:29, End Time: 2012-10-17 12:50:30 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (194 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1041 (671 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.01% (7.9729 => 8.0538, std.dev.: 0.0051) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.39% (2.0176 => 2.5096, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 19.45% (0.0653 => 0.0780, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 19.15% (0.1410 => 0.1680, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 18.47% (0.1072 => 0.1270, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 18.28% (0.0826 => 0.0977) MultiSource/Benchmarks/McCat/08-main/main: 17.65% (0.2243 => 0.2639, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 16.20% (0.1327 => 0.1542, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 14.71% (0.1013 => 0.1162, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 14.46% (0.7038 => 0.8056, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 14.34% (1.3693 => 1.5656, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.15% (0.0834 => 0.0952, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.08% (0.1413 => 0.1612, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 14.08% (0.2721 => 0.3104, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 13.82% (0.4328 => 0.4926, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.71% (0.2596 => 0.2952, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 13.67% (0.0746 => 0.0848, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 13.61% (0.4062 => 0.4615, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.59% (0.0964 => 0.1095, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.54% (0.1588 => 0.1803, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.36% (3.9660 => 4.4958, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.31% (0.3899 => 0.4418, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.23% (0.6283 => 0.7114, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.13% (0.6959 => 0.7873, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 13.09% (0.1062 => 0.1201, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 12.96% (13.8202 => 15.6117, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.93% (0.5265 => 0.5946, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.90% (1.4563 => 1.6442, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.70% (0.0819 => 0.0923, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 12.66% (0.1003 => 0.1130, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.65% (0.7710 => 0.8685, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/distray/distray: 12.59% (0.0818 => 0.0921, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.57% (0.9199 => 1.0355, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 12.44% (0.3022 => 0.3398, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.41% (1.2193 => 1.3706, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.20% (1.1364 => 1.2750, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.18% (0.3580 => 0.4016, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 12.15% (1.0313 => 1.1566, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.13% (0.4791 => 0.5372, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 12.02% (16.6129 => 18.6099, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.01% (0.1157 => 0.1296, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 12.01% (0.2781 => 0.3115, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.00% (0.4016 => 0.4498, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 12.00% (0.5818 => 0.6516, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.99% (0.3485 => 0.3903, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.93% (0.3756 => 0.4204, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 11.92% (1.1061 => 1.2380, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 11.92% (0.0847 => 0.0948, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.90% (0.2782 => 0.3113, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 11.89% (0.3489 => 0.3904, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.87% (0.5577 => 0.6239, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 11.78% (0.3293 => 0.3681, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.73% (0.3130 => 0.3497, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 11.71% (0.5748 => 0.6421, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.69% (0.4390 => 0.4903, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 11.53% (0.3868 => 0.4314, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 11.53% (0.3453 => 0.3851, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 11.52% (0.2760 => 0.3078, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/office/office: 11.46% (0.2966 => 0.3306, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 11.43% (0.3149 => 0.3509, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 11.43% (0.7061 => 0.7868, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.40% (0.8698 => 0.9690, std.dev.: 0.0159) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 11.38% (0.1986 => 0.2212, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 11.37% (0.6744 => 0.7511, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 11.37% (0.2761 => 0.3075, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 11.32% (2.1791 => 2.4258, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 11.30% (1.9828 => 2.2069, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 11.23% (0.3534 => 0.3931, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 11.23% (0.2726 => 0.3032, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.22% (0.1569 => 0.1745, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 11.20% (0.2607 => 0.2899, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 11.16% (0.1111 => 0.1235, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 11.13% (3.8646 => 4.2948, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 11.13% (0.1276 => 0.1418, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 11.08% (0.2690 => 0.2988, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 11.07% (0.3107 => 0.3451, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 11.07% (0.1075 => 0.1194) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.04% (0.2655 => 0.2948, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.03% (0.3246 => 0.3604, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 11.01% (0.1589 => 0.1764, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.01% (0.4379 => 0.4861, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wc: 11.00% (0.2937 => 0.3260, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.99% (0.1865 => 0.2070, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 10.98% (0.2995 => 0.3324, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.96% (0.0976 => 0.1083, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 10.92% (0.2628 => 0.2915, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.90% (0.7460 => 0.8273, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 10.89% (1.9270 => 2.1368, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.89% (0.2765 => 0.3066, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 10.86% (3.1889 => 3.5353, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.86% (0.2127 => 0.2358, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.84% (0.2914 => 0.3230, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 10.84% (0.2988 => 0.3312, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 10.84% (0.3192 => 0.3538, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 10.83% (0.7506 => 0.8319, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.81% (4.9865 => 5.5255, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.75% (0.0977 => 0.1082, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 10.75% (0.3220 => 0.3566, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 10.74% (0.2925 => 0.3239, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.57% (0.2696 => 0.2981, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 10.55% (0.1478 => 0.1634, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 10.55% (0.8310 => 0.9187, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.55% (0.1014 => 0.1121, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.52% (0.1435 => 0.1586, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 10.45% (1.0594 => 1.1701, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.43% (0.5637 => 0.6225, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.33% (0.3755 => 0.4143, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.28% (0.2023 => 0.2231, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 10.25% (0.2945 => 0.3247, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.11% (0.6576 => 0.7241, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 10.02% (0.1657 => 0.1823, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.02% (7.2180 => 7.9411, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.85% (1.3245 => 1.4549, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.65% (1.5188 => 1.6653, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.62% (3.6692 => 4.0221, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/bigfib: 9.62% (0.6250 => 0.6851, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 9.43% (4.6629 => 5.1024, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 9.42% (0.3131 => 0.3426, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 9.41% (1.2749 => 1.3949, std.dev.: 0.0175) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.37% (4.3801 => 4.7903, std.dev.: 0.0049) MultiSource/Applications/JM/lencod/lencod: 9.35% (14.8535 => 16.2430, std.dev.: 0.0134) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.31% (0.6135 => 0.6706, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.30% (4.4433 => 4.8564, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.21% (0.2140 => 0.2337, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.09% (0.3511 => 0.3830, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 9.08% (8.4961 => 9.2676, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.03% (0.8818 => 0.9614, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.97% (3.2742 => 3.5679, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.92% (0.2321 => 0.2528, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 8.87% (0.4113 => 0.4478, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.69% (2.1007 => 2.2833, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.68% (0.4805 => 0.5222, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.60% (0.3245 => 0.3524, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.56% (0.9108 => 0.9888, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.55% (0.1789 => 0.1942, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 8.54% (3.7467 => 4.0666, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: 8.49% (0.1213 => 0.1316, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.49% (1.1333 => 1.2295, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: 8.30% (0.1385 => 0.1500, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 8.18% (1.2292 => 1.3298, std.dev.: 0.0106) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.11% (0.2504 => 0.2707, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 8.08% (6.5754 => 7.1070, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/oourafft: 8.02% (0.2008 => 0.2169) SingleSource/UnitTests/ObjC/parameter-passing: 7.84% (0.4003 => 0.4317, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.75% (0.1819 => 0.1960, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.43% (6.2785 => 6.7449, std.dev.: 0.0069) SingleSource/UnitTests/ObjC/property: 7.41% (0.3940 => 0.4232, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.36% (0.3914 => 0.4202, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.25% (13.2842 => 14.2478, std.dev.: 0.0137) SingleSource/UnitTests/ObjC/exceptions-4: 7.16% (0.3646 => 0.3907, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.13% (0.3578 => 0.3833, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.07% (0.3650 => 0.3908, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 7.02% (0.3789 => 0.4055, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.97% (0.3601 => 0.3852, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.96% (0.3663 => 0.3918, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 6.76% (0.3623 => 0.3868, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.15% (0.2243 => 0.2381, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 5.91% (0.1777 => 0.1882, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 5.89% (16.2614 => 17.2196, std.dev.: 0.0207) MultiSource/Applications/ClamAV/clamscan: 4.94% (14.5298 => 15.2472, std.dev.: 0.0127) MultiSource/Benchmarks/Olden/bh/bh: 3.81% (0.2859 => 0.2968, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 3.23% (33.2944 => 34.3693, std.dev.: 0.0079) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/methcall: 30.64% (5.7573 => 7.5215, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.08% (1.0895 => 1.3627, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fbench: 24.61% (1.8175 => 2.2647, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/richards_benchmark: 11.00% (1.1560 => 1.2832, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.03% (0.8273 => 0.9020, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.56% (3.1736 => 3.4134, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.33% (1.2998 => 1.3821, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0048, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.93% (11.2619 => 11.7046, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.55% (10.7476 => 11.1294, std.dev.: 0.0202) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9858, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.18% (7.4271 => 7.5890, std.dev.: 0.0087) MultiSource/Applications/lemon/lemon: 1.60% (1.4298 => 1.4527, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2071, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5128, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.25% (1.9433 => 1.9676, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1881, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5781, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5886, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.04% (3.6469 => 3.6850, std.dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.48% (0.2670 => 0.1429, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.02% (0.4657 => 0.3911, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.74% (1.3819 => 1.2059, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.64% (1.3813 => 1.2067, std.dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.04% (0.0997 => 0.0857, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -12.11% (0.2238 => 0.1967, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.94% (1.2308 => 1.0962, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.31% (20.3410 => 18.2435, std.dev.: 0.0243) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.67% (1.3780 => 1.2999, std.dev.: 0.0093) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0028) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.11% (0.9996 => 0.9585, std.dev.: 0.0116) MultiSource/Applications/siod/siod: -3.58% (3.2729 => 3.1556, std.dev.: 0.0255) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.51% (1.7688 => 1.7068, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -2.50% (26.5159 => 25.8527, std.dev.: 0.0155) MultiSource/Applications/spiff/spiff: -2.46% (3.0263 => 2.9520, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -2.38% (1.9762 => 1.9291, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Regression/C/uint64_to_float: -2.00% (0.5449 => 0.5340, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.97% (0.6589 => 0.6459, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.83% (6.3560 => 6.2400, std.dev.: 0.0057) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7150, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0062, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8627, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.26% (0.8342 => 0.8237, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.18% (2.5254 => 2.4956, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.14% (5.3167 => 5.2559, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.01% (6.6320 => 6.5652, std.dev.: 0.0095) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 17 10:19:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 17 Oct 2012 12:19:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121017171912.ED19D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4931?compare_to=4929&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4931, Order: 166102, Start Time: 2012-10-17 16:01:13, End Time: 2012-10-17 17:21:09 To: 4929, Order: 166100, Start Time: 2012-10-17 14:12:04, End Time: 2012-10-17 15:31:47 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (160 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 952 (685 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.14% (54.7383 => 56.4596, std.dev.: 0.1417) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.17% (0.5960 => 0.5950, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -0.25% (16.4664 => 16.4245, std.dev.: 0.0142) MultiSource/Benchmarks/Bullet/bullet: -0.15% (55.5410 => 55.4569, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/gs/gs: -0.24% (4.4571 => 4.4466, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.64% (0.0467 => 0.0464, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.43% (0.0469 => 0.0467, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.69% (0.0437 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.68% (0.0438 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.47% (0.0426 => 0.0424) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.70% (0.0427 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.72% (0.0419 => 0.0416, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.71% (0.0420 => 0.0417, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.46% (0.0437 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.68% (0.0438 => 0.0435, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.70% (0.0431 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.46% (0.0433 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.47% (0.0422 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.71% (0.0423 => 0.0420, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.47% (0.0428 => 0.0426, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.47% (0.0430 => 0.0428, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.68% (0.0440 => 0.0437, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.68% (0.0441 => 0.0438, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.48% (0.0416 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.48% (0.0417 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.47% (0.0428 => 0.0426) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.93% (0.0430 => 0.0426, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.72% (0.0419 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.48% (0.0421 => 0.0419, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.49% (0.0411 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.97% (0.0413 => 0.0409, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.49% (0.0411 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.24% (0.0411 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.89% (0.0448 => 0.0444, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.67% (0.0449 => 0.0446, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.49% (0.0409 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.49% (0.0410 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.49% (0.0411 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.48% (0.0413 => 0.0411, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.72% (0.0418 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.71% (0.0420 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.28% (1.2617 => 1.2582, std.dev.: 0.0048) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.06% (7.9384 => 7.9338, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.13% (0.7438 => 0.7448, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -1.38% (0.0362 => 0.0357, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.64% (0.2132 => 0.2167, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.31% (63.2438 => 55.4569, std.dev.: 0.0049) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 33.81% (14.1553 => 18.9416, std.dev.: 0.0171) SingleSource/Benchmarks/Misc-C++-EH/spirit: 64.07% (3.4629 => 5.6816, std.dev.: 0.0007) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13458.47% (0.0720 => 9.7621, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9974200.00% (0.0001 => 9.9743, std.dev.: 0.0012) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 59.51% (0.2554 => 0.4074, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 45.17% (10.3673 => 15.0503, std.dev.: 0.0147) SingleSource/Benchmarks/Misc/richards_benchmark: 34.83% (0.1622 => 0.2187, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/distray/distray: 32.77% (0.1056 => 0.1402, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.67% (2.2022 => 2.5693, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 16.56% (7.0540 => 8.2220, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 16.41% (0.1432 => 0.1667, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.07% (0.1566 => 0.1802, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.97% (0.0871 => 0.0984, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.74% (1.7609 => 1.9853, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 12.19% (0.3282 => 0.3682, std.dev.: 0.0050) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.99% (0.1584 => 0.1774, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: 11.74% (0.1440 => 0.1609, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 10.81% (0.3516 => 0.3896, std.dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 10.72% (0.7433 => 0.8230, std.dev.: 0.0055) MultiSource/Applications/minisat/minisat: 10.67% (0.7115 => 0.7874, std.dev.: 0.0114) SingleSource/UnitTests/ObjC/trivial-interface: 10.51% (0.3473 => 0.3838, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.44% (0.6675 => 0.7372, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.36% (0.3543 => 0.3910, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.36% (0.3543 => 0.3910, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.34% (0.3927 => 0.4333, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 10.32% (0.3497 => 0.3858, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 10.32% (0.3828 => 0.4223, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 10.28% (10.4361 => 11.5088, std.dev.: 0.0156) SingleSource/UnitTests/ObjC/synchronized: 10.25% (0.3561 => 0.3926, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 10.24% (0.3886 => 0.4284, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.18% (0.3694 => 0.4070, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.15% (0.2700 => 0.2974, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.06% (0.1143 => 0.1258, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 10.04% (0.1175 => 0.1293, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.01% (0.3177 => 0.3495, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 9.97% (0.1655 => 0.1820, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.92% (1.5415 => 1.6944, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/18-imp/imp: 9.90% (0.3423 => 0.3762, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 9.84% (9.4845 => 10.4174, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.72% (0.4879 => 0.5353, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.70% (0.5105 => 0.5600, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 9.68% (3.3354 => 3.6584, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/em3d/em3d: 9.68% (0.1695 => 0.1859, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 9.65% (0.3109 => 0.3409, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.49% (0.4615 => 0.5053, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.47% (0.1236 => 0.1353, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 9.42% (5.7591 => 6.3016, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.33% (0.1940 => 0.2121, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.32% (0.1438 => 0.1572, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.18% (4.2646 => 4.6562, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.18% (0.5860 => 0.6398, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.16% (1.3050 => 1.4245, std.dev.: 0.0022) MultiSource/Applications/aha/aha: 9.12% (0.1151 => 0.1256, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.07% (0.2271 => 0.2477, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 9.07% (0.1555 => 0.1696, std.dev.: 0.0040) MultiSource/Applications/Burg/burg: 9.05% (1.1642 => 1.2696, std.dev.: 0.0075) MultiSource/Applications/lua/lua: 9.05% (3.8723 => 4.2227, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/mst/mst: 9.03% (0.1163 => 0.1268, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.96% (0.8067 => 0.8790, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.96% (0.5569 => 0.6068, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.94% (0.1510 => 0.1645, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.92% (0.1625 => 0.1770, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.92% (0.8172 => 0.8901, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.75% (0.3121 => 0.3394, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.75% (0.5020 => 0.5459, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.74% (0.3307 => 0.3596, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.73% (0.2107 => 0.2291, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.70% (0.2758 => 0.2998, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.69% (0.9765 => 1.0614, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.67% (4.9449 => 5.3734, std.dev.: 0.0051) MultiSource/Benchmarks/sim/sim: 8.65% (0.3387 => 0.3680, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.64% (5.0018 => 5.4342, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.60% (0.1337 => 0.1452, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 8.57% (0.6456 => 0.7009, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 8.51% (0.7835 => 0.8502, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.47% (0.2065 => 0.2240, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 8.45% (1.0722 => 1.1628, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.40% (1.5859 => 1.7191, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.36% (8.1363 => 8.8166, std.dev.: 0.0116) MultiSource/Applications/treecc/treecc: 8.25% (2.0273 => 2.1946, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 8.15% (2.2969 => 2.4841, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference-object: 8.03% (0.6030 => 0.6514, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.97% (0.5925 => 0.6397, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 7.87% (1.5603 => 1.6831, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.84% (7.9617 => 8.5861, std.dev.: 0.0887) MultiSource/Benchmarks/McCat/09-vor/vor: 7.80% (0.3180 => 0.3428, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.68% (0.4103 => 0.4418, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.67% (0.3441 => 0.3705, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.60% (1.1861 => 1.2762, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.53% (2.2024 => 2.3683, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.53% (0.3865 => 0.4156, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.41% (0.2603 => 0.2796, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 7.37% (0.4289 => 0.4605, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.35% (0.6450 => 0.6924, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.28% (0.4203 => 0.4509, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 7.26% (0.7326 => 0.7858, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.26% (0.1695 => 0.1818, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 7.22% (21.9371 => 23.5200, std.dev.: 0.0336) MultiSource/Benchmarks/McCat/05-eks/eks: 7.19% (0.4299 => 0.4608, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.16% (0.4620 => 0.4951, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/lists: 7.10% (0.3422 => 0.3665, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/football/football: 6.98% (0.8921 => 0.9544, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/neural/neural: 6.90% (0.1463 => 0.1564, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.89% (0.5981 => 0.6393, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.86% (0.4636 => 0.4954, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/moments: 6.79% (0.4048 => 0.4323, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.60% (0.3650 => 0.3891, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 6.58% (0.3603 => 0.3840, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.53% (1.4186 => 1.5113, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.51% (0.3826 => 0.4075, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 6.49% (0.3684 => 0.3923, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.35% (0.3136 => 0.3335, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 6.21% (1.1840 => 1.2575, std.dev.: 0.0097) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.18% (0.1892 => 0.2009, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.17% (0.3162 => 0.3357, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.17% (0.2871 => 0.3048, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 6.16% (0.2905 => 0.3084, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.09% (0.2266 => 0.2404, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.05% (0.2891 => 0.3066, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.04% (0.2831 => 0.3002, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.98% (2.0665 => 2.1900, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/ary3: 5.94% (0.3283 => 0.3478, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.94% (0.3098 => 0.3282, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.93% (0.1906 => 0.2019, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.79% (0.3232 => 0.3419, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.75% (0.2872 => 0.3037, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.70% (0.2877 => 0.3041, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.70% (0.2756 => 0.2913, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 5.54% (0.2725 => 0.2876, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.49% (0.8101 => 0.8546, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 5.47% (0.3052 => 0.3219, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 5.39% (0.2802 => 0.2953, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 5.38% (0.2714 => 0.2860, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.33% (0.2793 => 0.2942, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.29% (0.4064 => 0.4279, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 5.27% (0.3379 => 0.3557, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 4.88% (0.2049 => 0.2149, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.77% (14.3668 => 15.0514, std.dev.: 0.0124) MultiSource/Applications/sqlite3/sqlite3: 4.69% (17.1811 => 17.9877, std.dev.: 0.0213) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.52% (0.3427 => 0.3582, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 4.34% (1.2842 => 1.3399, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 4.31% (0.3131 => 0.3266, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.28% (0.2430 => 0.2534, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.16% (3.8922 => 4.0543, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.01% (0.3817 => 0.3932, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.64% (1.1194 => 1.1490, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.25% (1.1145 => 1.3848, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.84% (1.1396 => 1.2517, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1421 => 0.1560, std.dev.: 0.0022) MultiSource/Applications/aha/aha: 9.19% (3.1595 => 3.4499, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 6.71% (3.1578 => 3.3697, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.77% (4.2280 => 4.3453, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7655, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.36% (0.9540 => 0.9670, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 1.12% (2.1825 => 2.2070, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.08% (2.6546 => 2.6833, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5751, std.dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.06% (6.6874 => 0.1295, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -79.97% (0.8651 => 0.1733, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.37% (5.2763 => 3.2517, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.59% (5.3855 => 3.6840, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.94% (5.3526 => 3.6966, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -14.65% (54.1659 => 46.2321, std.dev.: 0.0136) MultiSource/Benchmarks/FreeBench/mason/mason: -12.33% (0.0811 => 0.0711, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.70% (2.9384 => 2.6240, std.dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: -9.81% (22.1758 => 20.0008, std.dev.: 0.0198) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.46% (1.1492 => 0.7647, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: -16.05% (1.6925 => 1.4209, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.93% (0.0998 => 0.0859, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.55% (1.2373 => 1.0944, std.dev.: 0.0142) SingleSource/Benchmarks/Misc/mandel-2: -10.39% (1.5373 => 1.3776, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/mason/mason: -10.13% (0.2161 => 0.1942, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.36% (19.9488 => 18.2814, std.dev.: 0.0577) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.73% (1.8329 => 1.7095, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.31% (1.6805 => 1.5912, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7962, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.88% (1.5835 => 1.5063, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.71% (3.2827 => 3.1608, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.52% (0.9957 => 0.9607, std.dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4707, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: -2.99% (12.4730 => 12.1002, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Regression/C/uint64_to_float: -1.88% (0.5413 => 0.5311, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -1.82% (10.2830 => 10.0962, std.dev.: 0.0205) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.80% (8.1563 => 8.0094, std.dev.: 0.0159) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6835, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -1.69% (2.5528 => 2.5097, std.dev.: 0.0021) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4218, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2878, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.05% (6.2999 => 6.2335, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.79% (0.5229 => 0.5950, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 9.57% (14.9895 => 16.4245, std.dev.: 0.0142) MultiSource/Benchmarks/MallocBench/gs/gs: 8.18% (4.1105 => 4.4466, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.88% (1.1048 => 1.2582, std.dev.: 0.0048) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.84% (7.1582 => 7.9338, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.70% (0.6222 => 0.7448, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35600.00% (0.0001 => 0.0357, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.41% (0.2116 => 0.2167, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 17 10:31:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 17 Oct 2012 12:31:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121017173129.2D7C92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4932?compare_to=4930&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4932, Order: 166102, Start Time: 2012-10-17 16:08:31, End Time: 2012-10-17 17:34:23 To: 4930, Order: 166100, Start Time: 2012-10-17 14:13:10, End Time: 2012-10-17 15:39:04 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (190 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1041 (677 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 7.39% (27.6520 => 29.6949, std.dev.: 0.0598) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.31% (2.0176 => 2.5080, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 19.08% (0.1410 => 0.1679, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 18.28% (0.0826 => 0.0977, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.76% (0.0653 => 0.0769, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 17.21% (0.2243 => 0.2629, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.67% (0.1072 => 0.1240) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.52% (0.1327 => 0.1533, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 14.61% (0.1013 => 0.1161, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.03% (0.0834 => 0.0951, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.87% (0.1413 => 0.1609, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 13.85% (1.3693 => 1.5590, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 13.68% (0.7038 => 0.8001, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.64% (0.0770 => 0.0875, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 13.41% (0.2721 => 0.3086, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.35% (3.9660 => 4.4955, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.29% (0.1588 => 0.1799, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.07% (0.0964 => 0.1090, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 12.96% (0.4328 => 0.4889, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.92% (0.6283 => 0.7095, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.77% (1.4563 => 1.6423, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.75% (0.2596 => 0.2927, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.67% (0.5265 => 0.5932, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/distray/distray: 12.59% (0.0818 => 0.0921, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 12.54% (13.8202 => 15.5533, std.dev.: 0.0169) MultiSource/Applications/aha/aha: 12.52% (0.1062 => 0.1195, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.44% (0.6959 => 0.7825, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.41% (0.7710 => 0.8667, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.36% (0.9199 => 1.0336, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.33% (1.2193 => 1.3696, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hash: 12.31% (0.4062 => 0.4562, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.99% (1.1364 => 1.2726, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/power/power: 11.96% (0.1003 => 0.1123, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.94% (0.4791 => 0.5363, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 11.85% (1.0313 => 1.1535, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.82% (0.3899 => 0.4360, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.67% (0.1157 => 0.1292, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.61% (0.3022 => 0.3373, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 11.55% (1.1061 => 1.2338, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.50% (0.3130 => 0.3490, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 11.34% (16.6129 => 18.4974, std.dev.: 0.0198) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 11.28% (0.1986 => 0.2210, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.28% (0.5577 => 0.6206, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.28% (0.3485 => 0.3878, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.23% (0.4016 => 0.4467, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 11.21% (0.6744 => 0.7500, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.21% (0.3756 => 0.4177, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.20% (0.3580 => 0.3981, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 11.11% (0.2781 => 0.3090, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 11.10% (0.5818 => 0.6464, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.03% (0.1569 => 0.1742, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.00% (0.4390 => 0.4873, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 10.98% (0.2995 => 0.3324, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/mst/mst: 10.98% (0.1111 => 0.1233, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.98% (0.3489 => 0.3872, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: 10.96% (0.3293 => 0.3654, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 10.90% (0.3220 => 0.3571, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 10.89% (0.1589 => 0.1762, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.85% (0.4379 => 0.4854, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sieve: 10.83% (0.3453 => 0.3827, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.81% (0.3246 => 0.3597, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.80% (0.8698 => 0.9637, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/moments: 10.78% (0.3868 => 0.4285, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 10.77% (2.1791 => 2.4138, std.dev.: 0.0021) MultiSource/Applications/viterbi/viterbi: 10.76% (0.1478 => 0.1637, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 10.74% (3.8646 => 4.2795, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 10.72% (0.5748 => 0.6364, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.70% (0.1075 => 0.1190, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.68% (0.2782 => 0.3079, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.67% (0.2127 => 0.2354, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 10.63% (1.9270 => 2.1319, std.dev.: 0.0049) MultiSource/Applications/d/make_dparser: 10.60% (3.1889 => 3.5270, std.dev.: 0.0057) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.57% (0.2914 => 0.3222, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.51% (0.1865 => 0.2061, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.49% (0.2966 => 0.3277, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 10.46% (0.2925 => 0.3231, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 10.46% (0.8310 => 0.9179, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 10.42% (0.7061 => 0.7797, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.42% (0.1276 => 0.1409, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 10.42% (0.2726 => 0.3010, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.41% (4.9865 => 5.5057, std.dev.: 0.0159) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.39% (0.7460 => 0.8235, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.38% (1.9828 => 2.1887, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 10.38% (0.3149 => 0.3476, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.38% (0.1435 => 0.1584, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 10.36% (0.2760 => 0.3046, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 10.36% (0.3534 => 0.3900, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.34% (0.0977 => 0.1078, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 10.33% (0.7506 => 0.8281, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 10.32% (0.2761 => 0.3046, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 10.30% (1.0594 => 1.1685, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.26% (0.1014 => 0.1118, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 10.23% (0.3107 => 0.3425, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.18% (0.5637 => 0.6211, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.09% (0.2655 => 0.2923, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 10.09% (0.2607 => 0.2870, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.08% (0.2023 => 0.2227, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 10.08% (0.2937 => 0.3233, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 10.04% (0.2690 => 0.2960, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.98% (0.2765 => 0.3041, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 9.97% (0.2628 => 0.2890, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/ary2: 9.93% (0.3192 => 0.3509, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 9.84% (0.2988 => 0.3282, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.83% (7.2180 => 7.9273, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.64% (0.3755 => 0.4117, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.61% (0.2696 => 0.2955, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.60% (1.3245 => 1.4516, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.57% (0.6576 => 0.7205, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 9.47% (0.1657 => 0.1814, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 9.46% (1.2749 => 1.3955, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 9.39% (0.3131 => 0.3425, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.38% (1.5188 => 1.6612, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 9.34% (0.2945 => 0.3220, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.33% (4.3801 => 4.7889, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.32% (3.6692 => 4.0111, std.dev.: 0.0035) MultiSource/Applications/JM/lencod/lencod: 9.29% (14.8535 => 16.2332, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.10% (4.4433 => 4.8476, std.dev.: 0.0044) MultiSource/Applications/oggenc/oggenc: 9.07% (4.6629 => 5.0858, std.dev.: 0.0148) MultiSource/Benchmarks/mafft/pairlocalalign: 9.06% (8.4961 => 9.2662, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.05% (0.8818 => 0.9616, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 9.02% (0.6250 => 0.6814, std.dev.: 0.0120) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.00% (0.6135 => 0.6687, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.95% (3.2742 => 3.5674, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.93% (0.2140 => 0.2331, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.78% (0.1789 => 0.1946, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.55% (0.9108 => 0.9887, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.53% (0.2321 => 0.2519, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.51% (0.4805 => 0.5214, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.43% (0.3511 => 0.3807, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.40% (2.1007 => 2.2771, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/05-eks/eks: 8.39% (0.4113 => 0.4458, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.32% (1.1333 => 1.2276, std.dev.: 0.0028) MultiSource/Applications/lua/lua: 8.30% (3.7467 => 4.0578, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/neural/neural: 8.30% (0.1385 => 0.1500, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.20% (0.3245 => 0.3511, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 8.17% (0.2008 => 0.2172, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.99% (0.2504 => 0.2704, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 7.87% (6.5754 => 7.0932, std.dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: 7.53% (1.2292 => 1.3218, std.dev.: 0.0117) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.34% (6.2785 => 6.7393, std.dev.: 0.0116) SingleSource/UnitTests/ObjC/parameter-passing: 7.22% (0.4003 => 0.4292, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.20% (13.2842 => 14.2406, std.dev.: 0.0127) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.87% (0.1819 => 0.1944, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.83% (0.3940 => 0.4209, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.80% (0.3914 => 0.4180, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 6.58% (0.3646 => 0.3886, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 6.57% (0.3789 => 0.4038, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 6.48% (0.3578 => 0.3810, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.39% (0.3663 => 0.3897, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.38% (0.3650 => 0.3883, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 6.36% (0.3601 => 0.3830, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 6.21% (0.3623 => 0.3848, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 5.97% (0.1777 => 0.1883, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.93% (0.2243 => 0.2376, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 5.77% (16.2614 => 17.1997, std.dev.: 0.0217) MultiSource/Applications/ClamAV/clamscan: 4.82% (14.5298 => 15.2297, std.dev.: 0.0126) MultiSource/Benchmarks/Olden/bh/bh: 3.67% (0.2859 => 0.2964, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 2.76% (33.2944 => 34.2134, std.dev.: 0.0160) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.62% (5.7573 => 7.5203, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.03% (1.0895 => 1.3622, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: 24.59% (1.8175 => 2.2645, std.dev.: 0.0173) SingleSource/Benchmarks/Misc/richards_benchmark: 11.03% (1.1560 => 1.2835, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 8.99% (0.8273 => 0.9017, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4143, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 6.10% (1.2998 => 1.3791, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.93% (11.2619 => 11.7041, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7747, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.51% (10.7476 => 11.1247, std.dev.: 0.0158) SingleSource/Benchmarks/Misc/flops-6: 3.46% (1.9199 => 1.9863, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.20% (7.4271 => 7.5902, std.dev.: 0.0026) MultiSource/Applications/lemon/lemon: 1.64% (1.4298 => 1.4533, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5131, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9696, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1880, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.16% (5.5130 => 5.5771, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 1.09% (12.4560 => 12.5913, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.01% (3.6469 => 3.6837, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.40% (0.2670 => 0.1431, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.47% (0.4657 => 0.3890, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.88% (1.3819 => 1.2039, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.86% (1.3813 => 1.2037, std.dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -12.15% (0.2238 => 0.1966, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -12.02% (1.2308 => 1.0828, std.dev.: 0.0212) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.12% (20.3410 => 18.2829, std.dev.: 0.0284) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0122) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.74% (1.3780 => 1.2989, std.dev.: 0.0051) SingleSource/Benchmarks/Dhrystone/dry: -5.38% (2.5089 => 2.3740, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5148, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.70% (0.9996 => 0.9526, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.49% (1.7688 => 1.7071, std.dev.: 0.0013) MultiSource/Applications/siod/siod: -3.48% (3.2729 => 3.1589, std.dev.: 0.0238) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.02% (0.4867 => 0.4720, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -2.62% (26.5159 => 25.8222, std.dev.: 0.0239) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4781, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.48% (3.0263 => 2.9513, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -2.42% (1.9762 => 1.9284, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.16% (0.6589 => 0.6447, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7151, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/lists: -1.77% (6.3560 => 6.2438, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0064, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.25% (0.8342 => 0.8238, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.19% (2.5254 => 2.4953, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.14% (3.9173 => 3.8726, std.dev.: 0.0144) MultiSource/Applications/lambda-0_1_3/lambda: -1.08% (5.3167 => 5.2591, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 17 12:08:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 17 Oct 2012 14:08:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121017190818.E7BF42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4933?compare_to=4931&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4933, Order: 166106, Start Time: 2012-10-17 17:50:29, End Time: 2012-10-17 19:10:14 To: 4931, Order: 166102, Start Time: 2012-10-17 16:01:13, End Time: 2012-10-17 17:21:09 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (160 on baseline) Performance Improvements: 1 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 952 (684 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.01% (3.6966 => 3.6592, std.dev.: 0.0049) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.08% (0.5950 => 0.5955, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 0.09% (16.4245 => 16.4389, std.dev.: 0.0071) MultiSource/Benchmarks/Bullet/bullet: 0.03% (55.4569 => 55.4709, std.dev.: 0.0197) MultiSource/Benchmarks/MallocBench/gs/gs: 0.11% (4.4466 => 4.4517, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.22% (0.0464 => 0.0465, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.21% (0.0467 => 0.0466, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.23% (0.0434 => 0.0435, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0435 => 0.0435, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.24% (0.0424 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0424 => 0.0424, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0416 => 0.0416, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.24% (0.0417 => 0.0418) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.23% (0.0435 => 0.0434, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.23% (0.0435 => 0.0436) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0428 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.23% (0.0431 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0420 => 0.0420) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0420 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0426 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.23% (0.0428 => 0.0427, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0437 => 0.0437, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.25% (0.0438 => 0.0461, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0414 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0415 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.23% (0.0426 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.47% (0.0426 => 0.0428, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.24% (0.0416 => 0.0417, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.48% (0.0419 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.24% (0.0409 => 0.0408, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.24% (0.0409 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0409 => 0.0409) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.49% (0.0410 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.23% (0.0444 => 0.0445, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0446 => 0.0446, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0407 => 0.0407) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0408 => 0.0408, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0409 => 0.0409, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0411 => 0.0411) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.24% (0.0415 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.03% (1.2582 => 1.2578, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.22% (7.9338 => 7.9513, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.15% (0.7448 => 0.7459, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 1.40% (0.0357 => 0.0362, std.dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.20% (0.2167 => 0.2141, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.29% (63.2438 => 55.4709, std.dev.: 0.0197) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.25% (14.1553 => 19.0040, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++-EH/spirit: 64.22% (3.4629 => 5.6868, std.dev.: 0.0036) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13451.94% (0.0720 => 9.7574, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9973900.00% (0.0001 => 9.9740, std.dev.: 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 59.79% (0.2554 => 0.4081, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 45.40% (10.3673 => 15.0740, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/richards_benchmark: 35.14% (0.1622 => 0.2192, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 32.77% (0.1056 => 0.1402, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 16.34% (0.1432 => 0.1666, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 16.23% (7.0540 => 8.1992, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.00% (2.2022 => 2.5545, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.20% (0.1566 => 0.1804, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.32% (0.0871 => 0.0987) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.37% (1.7609 => 1.9787, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/oourafft: 11.97% (0.3282 => 0.3675, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 11.94% (0.1440 => 0.1612, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.87% (0.1584 => 0.1772, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.02% (0.1625 => 0.1804, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 10.88% (0.7433 => 0.8242, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 10.79% (0.7115 => 0.7883, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/trivial-interface: 10.68% (0.3473 => 0.3844, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.68% (0.6675 => 0.7388, std.dev.: 0.0118) SingleSource/UnitTests/ObjC/exceptions-3: 10.67% (0.3516 => 0.3891, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 10.64% (0.3927 => 0.4345, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 10.58% (0.3497 => 0.3867, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.56% (0.3561 => 0.3937, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.56% (0.3694 => 0.4084, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 10.53% (0.3543 => 0.3916, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.53% (0.3543 => 0.3916, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.51% (0.3177 => 0.3511, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.40% (0.3828 => 0.4226, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 10.35% (10.4361 => 11.5166, std.dev.: 0.0107) SingleSource/UnitTests/ObjC/property: 10.32% (0.3886 => 0.4287, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 10.30% (0.1175 => 0.1296, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 10.27% (0.1655 => 0.1825, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.26% (0.2700 => 0.2977, std.dev.: 0.0056) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.06% (0.1143 => 0.1258, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.02% (1.5415 => 1.6960, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 9.91% (3.3354 => 3.6661, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/em3d/em3d: 9.91% (0.1695 => 0.1863, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.88% (0.4879 => 0.5361, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 9.87% (9.4845 => 10.4204, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/18-imp/imp: 9.85% (0.3423 => 0.3760, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 9.81% (0.3109 => 0.3414, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 9.77% (0.1044 => 0.1146, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.76% (0.5105 => 0.5603, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.62% (0.4615 => 0.5059, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.55% (0.1236 => 0.1354, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 9.48% (5.7591 => 6.3051, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.39% (1.3050 => 1.4276, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.39% (0.1438 => 0.1573, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/mst/mst: 9.37% (0.1163 => 0.1272, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.37% (0.5860 => 0.6409, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.37% (4.2646 => 4.6640, std.dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.30% (0.5569 => 0.6087, std.dev.: 0.0012) MultiSource/Applications/aha/aha: 9.30% (0.1151 => 0.1258, std.dev.: 0.0031) MultiSource/Applications/viterbi/viterbi: 9.20% (0.1555 => 0.1698, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 9.19% (3.8723 => 4.2282, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.14% (0.1510 => 0.1648, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.12% (0.1940 => 0.2117, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.11% (0.2271 => 0.2478, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 9.08% (1.1642 => 1.2699, std.dev.: 0.0082) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.06% (0.8172 => 0.8912, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.01% (0.3307 => 0.3605, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.00% (0.8067 => 0.8793, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.98% (0.5020 => 0.5471, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.88% (0.2107 => 0.2294, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.86% (0.6030 => 0.6564, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.85% (0.2758 => 0.3002, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.83% (0.9765 => 1.0627, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.75% (0.1337 => 0.1454, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.75% (5.0018 => 5.4394, std.dev.: 0.0030) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.75% (0.3121 => 0.3394, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 8.74% (0.6456 => 0.7020, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.72% (4.9449 => 5.3760, std.dev.: 0.0066) MultiSource/Applications/spiff/spiff: 8.69% (0.7835 => 0.8516, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/Hello: 8.68% (0.5925 => 0.6439, std.dev.: 0.0036) MultiSource/Benchmarks/sim/sim: 8.65% (0.3387 => 0.3680, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 8.64% (1.0722 => 1.1648, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.62% (0.2065 => 0.2243, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 8.58% (2.0273 => 2.2012, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.55% (8.1363 => 8.8319, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.53% (1.5859 => 1.7211, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 8.29% (2.2969 => 2.4874, std.dev.: 0.0181) MultiSource/Applications/hbd/hbd: 7.97% (1.5603 => 1.6847, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/09-vor/vor: 7.96% (0.3180 => 0.3433, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 7.93% (0.3441 => 0.3714, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 7.93% (0.7326 => 0.7907, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.81% (0.6450 => 0.6954, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.74% (7.9617 => 8.5780, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.73% (0.4103 => 0.4420, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.72% (1.1861 => 1.2777, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.66% (2.2024 => 2.3712, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.61% (0.3865 => 0.4159, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.57% (0.4203 => 0.4521, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.53% (0.2603 => 0.2799, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/lists: 7.45% (0.3422 => 0.3677, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.41% (0.4289 => 0.4607, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.37% (0.1695 => 0.1820, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.36% (0.4620 => 0.4960, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.32% (0.3826 => 0.4106, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.31% (0.4636 => 0.4975, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/football/football: 7.29% (0.8921 => 0.9571, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 7.24% (0.4048 => 0.4341, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 7.23% (0.4299 => 0.4610, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 7.18% (0.1463 => 0.1568, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.17% (0.3136 => 0.3361, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 7.16% (21.9371 => 23.5067, std.dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.12% (0.5981 => 0.6407, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.85% (0.3650 => 0.3900, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 6.83% (0.3603 => 0.3849, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 6.76% (0.3684 => 0.3933, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.72% (1.4186 => 1.5139, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.48% (0.3162 => 0.3367, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 6.40% (0.2905 => 0.3091, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 6.38% (1.1840 => 1.2595, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.36% (0.2891 => 0.3075, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.18% (0.2831 => 0.3006, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.09% (0.1906 => 0.2022, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.08% (2.0665 => 2.1921, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/methcall: 6.05% (0.2877 => 0.3051, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.03% (0.1892 => 0.2006, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 6.00% (0.3098 => 0.3284, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.00% (0.3283 => 0.3480, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 5.97% (0.3232 => 0.3425, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 5.92% (0.2871 => 0.3041, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.91% (0.2725 => 0.2886, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 5.88% (0.2872 => 0.3041, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.87% (0.2266 => 0.2399) SingleSource/Benchmarks/Shootout-C++/hello: 5.71% (0.2714 => 0.2869, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.67% (0.3052 => 0.3225, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.63% (0.4064 => 0.4293, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.60% (0.8101 => 0.8555, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/random: 5.57% (0.2802 => 0.2958, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.55% (0.2793 => 0.2948, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.50% (0.3379 => 0.3565, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 5.03% (0.2049 => 0.2152, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.92% (14.3668 => 15.0735, std.dev.: 0.0123) MultiSource/Applications/sqlite3/sqlite3: 4.75% (17.1811 => 17.9976, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/objinst: 4.60% (0.3131 => 0.3275, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 4.59% (1.2842 => 1.3431, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.36% (0.2430 => 0.2536, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.18% (3.8922 => 4.0547, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/bh/bh: 3.33% (0.3092 => 0.3195, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.04% (0.3817 => 0.3933, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.50% (1.1194 => 1.1474, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.24% (1.1145 => 1.3846, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.85% (1.1396 => 1.2518, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/Puzzle: 9.71% (0.1421 => 0.1559, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 9.20% (3.1595 => 3.4503, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.62% (3.1578 => 3.3669, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.82% (4.2280 => 4.3474, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.27% (1.7254 => 1.7646, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.39% (0.9540 => 0.9673, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.20% (2.6546 => 2.6864, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/queens: 1.13% (2.1825 => 2.2072) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.09% (6.5088 => 6.5797, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.07% (6.6874 => 0.1293, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.11% (0.8651 => 0.1721, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.33% (5.2763 => 3.2541, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.20% (5.3855 => 3.6516, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.64% (5.3526 => 3.6592, std.dev.: 0.0049) SingleSource/UnitTests/Vector/constpool: -14.74% (54.1659 => 46.1794, std.dev.: 0.0411) MultiSource/Benchmarks/FreeBench/mason/mason: -12.33% (0.0811 => 0.0711, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.70% (2.9384 => 2.6239, std.dev.: 0.0055) MultiSource/Applications/ClamAV/clamscan: -9.82% (22.1758 => 19.9985, std.dev.: 0.0369) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.39% (1.1492 => 0.7655, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.98% (1.6925 => 1.4221, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.83% (0.0998 => 0.0860, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.85% (1.2373 => 1.0907, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel-2: -10.29% (1.5373 => 1.3791, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -10.09% (0.2161 => 0.1943, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.34% (19.9488 => 18.2854, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.72% (1.8329 => 1.7097, std.dev.: 0.0179) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.31% (1.6805 => 1.5912, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -4.99% (5.0483 => 4.7965, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) SingleSource/Benchmarks/Misc/flops-5: -4.84% (1.5835 => 1.5069, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.57% (3.2827 => 3.1656, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.53% (0.9957 => 0.9606, std.dev.: 0.0048) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.20% (32.5116 => 31.4701, std.dev.: 0.0037) MultiSource/Applications/hexxagon/hexxagon: -2.99% (12.4730 => 12.0997, std.dev.: 0.0017) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.08% (0.4808 => 0.4708, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.89% (8.1563 => 8.0021, std.dev.: 0.0151) SingleSource/Regression/C/uint64_to_float: -1.88% (0.5413 => 0.5311) SingleSource/Benchmarks/Misc/salsa20: -1.77% (10.2830 => 10.1009, std.dev.: 0.0211) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6807, std.dev.: 0.0014) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5121, std.dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4218, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2878, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2356, std.dev.: 0.0080) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 13.88% (0.5229 => 0.5955, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 9.67% (14.9895 => 16.4389, std.dev.: 0.0071) MultiSource/Benchmarks/MallocBench/gs/gs: 8.30% (4.1105 => 4.4517, std.dev.: 0.0094) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.85% (1.1048 => 1.2578, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.08% (7.1582 => 7.9513, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.88% (0.6222 => 0.7459, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36100.00% (0.0001 => 0.0362, std.dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.18% (0.2116 => 0.2141, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 17 12:14:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 17 Oct 2012 14:14:45 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121017191445.697412A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4934?baseline=4934 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 4934, Order: 166107, Start Time: 2012-10-17 17:52:10, End Time: 2012-10-17 19:16:44 To: (none) Baseline: 4934, Order: 166107, Start Time: 2012-10-17 17:52:10, End Time: 2012-10-17 19:16:44 =============== Tests Summary =============== New Failures: 68 (0 on baseline) Added Tests: 898 (0 on baseline) Existing Failures: 0 (68 on baseline) Unchanged Tests: 76 (974 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment New Failures - Execution Time ----------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment Added Tests - Compile Time -------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sgefa/sgefa MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/sgefa/sgefa MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla ================================ Run-Over-Baseline Changes Detail ================================ Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (16.7745 => 16.7745, std.dev.: 0.0588) MultiSource/Applications/obsequi/Obsequi: - (1.0418 => 1.0418, std.dev.: 0.0080) MultiSource/Applications/sqlite3/sqlite3: - (0.6425 => 0.6425, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/08-main/main: - (0.1902 => 0.1902, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.1510 => 0.1510, std.dev.: 0.0056) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.3205 => 0.3205, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.2468 => 0.2468, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.3289 => 0.3289, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.2259 => 0.2259, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.5924 => 0.5924, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: - (0.0435 => 0.0435, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.3288 => 0.3288, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.1971 => 0.1971, std.dev.: 0.0012) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0238 => 0.0238, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0210 => 0.0210, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0414 => 0.0414, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0296 => 0.0296, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0250 => 0.0250, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0386 => 0.0386, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0193 => 0.0193, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0206 => 0.0206, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0321 => 0.0321, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: - (0.1471 => 0.1471, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: - (1.1757 => 1.1757, std.dev.: 0.0684) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: - (0.1411 => 0.1411, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: - (0.4041 => 0.4041, std.dev.: 0.0304) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: - (0.1374 => 0.1374, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: - (0.0661 => 0.0661, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0183 => 0.0183, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: - (0.0563 => 0.0563, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: - (1.1436 => 1.1436, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0545 => 0.0545, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0170 => 0.0170, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: - (0.8001 => 0.8001, std.dev.: 0.0132) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: - (2.1516 => 2.1516, std.dev.: 0.0134) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0005 => 0.0005, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0043 => 0.0043, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 17 12:28:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 17 Oct 2012 14:28:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121017192810.059742A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4935?compare_to=4932&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4935, Order: 166107, Start Time: 2012-10-17 18:05:11, End Time: 2012-10-17 19:31:07 To: 4932, Order: 166102, Start Time: 2012-10-17 16:08:31, End Time: 2012-10-17 17:34:23 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (192 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1040 (675 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.84% (55.4583 => 56.4778, std.dev.: 0.0857) SingleSource/Benchmarks/McGill/chomp: 1.24% (1.0828 => 1.0962, std.dev.: 0.0034) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.63% (2.0176 => 2.4943, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.72% (0.1410 => 0.1674, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 18.40% (0.0826 => 0.0978) MultiSource/Benchmarks/McCat/08-main/main: 17.21% (0.2243 => 0.2629, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.39% (0.0653 => 0.0760, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.85% (0.1327 => 0.1524, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 14.71% (0.1013 => 0.1162, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.29% (0.0770 => 0.0880, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.03% (0.0834 => 0.0951, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.80% (0.1413 => 0.1608, std.dev.: 0.0032) MultiSource/Applications/hbd/hbd: 13.70% (1.3693 => 1.5569, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 13.41% (0.2721 => 0.3086, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 13.26% (0.7038 => 0.7971, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/hash2: 13.10% (0.4328 => 0.4895, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.10% (0.1588 => 0.1796, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 13.10% (0.4062 => 0.4594, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.07% (0.0964 => 0.1090, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.05% (3.9660 => 4.4836, std.dev.: 0.0060) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.87% (0.1072 => 0.1210, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.81% (1.4563 => 1.6428, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.76% (0.6283 => 0.7085, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.67% (0.2596 => 0.2925, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.63% (0.6959 => 0.7838, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 12.60% (13.8202 => 15.5622, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.59% (0.9199 => 1.0357, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.52% (0.5265 => 0.5924, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/distray/distray: 12.47% (0.0818 => 0.0920, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.44% (0.7710 => 0.8669, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: 12.26% (0.1003 => 0.1126, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.26% (0.3899 => 0.4377, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.16% (1.2193 => 1.3676, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 11.88% (0.1986 => 0.2222, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.86% (0.4791 => 0.5359, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 11.84% (0.5818 => 0.6507, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 11.81% (0.0847 => 0.0947, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.79% (1.1364 => 1.2704, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 11.77% (0.1062 => 0.1187, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.65% (0.3485 => 0.3891, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 11.63% (1.0313 => 1.1512, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 11.55% (0.5748 => 0.6412, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.37% (0.5577 => 0.6211, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 11.35% (0.1075 => 0.1197, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.34% (0.3756 => 0.4182, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 11.33% (0.2781 => 0.3096, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.31% (0.3580 => 0.3985, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 11.29% (1.1061 => 1.2310, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.28% (0.4016 => 0.4469, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.28% (0.3130 => 0.3483, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 11.18% (0.3293 => 0.3661, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/mst/mst: 11.16% (0.1111 => 0.1235, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.15% (0.1157 => 0.1286, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.14% (0.4390 => 0.4879, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 11.10% (0.7061 => 0.7845, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 11.09% (0.3489 => 0.3876, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 11.03% (0.6744 => 0.7488, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 11.03% (16.6129 => 18.4454, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.02% (0.3022 => 0.3355, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.00% (0.2782 => 0.3088, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 10.96% (0.3868 => 0.4292, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 10.95% (0.2995 => 0.3323, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 10.95% (0.3453 => 0.3831, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.85% (0.0977 => 0.1083, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.83% (0.8698 => 0.9640, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.82% (0.4379 => 0.4853, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.82% (0.2966 => 0.3287, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 10.71% (3.8646 => 4.2786, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.71% (0.1569 => 0.1737, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 10.69% (0.1478 => 0.1636, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 10.68% (0.2761 => 0.3056, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.67% (0.2127 => 0.2354, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.67% (0.7460 => 0.8256, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.63% (1.9828 => 2.1936, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary3: 10.61% (0.3149 => 0.3483, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 10.60% (1.9270 => 2.1313, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.60% (0.3246 => 0.3590, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 10.59% (0.2690 => 0.2975, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 10.59% (0.2607 => 0.2883, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 10.56% (0.2726 => 0.3014, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 10.56% (0.3220 => 0.3560, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 10.55% (0.3534 => 0.3907, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 10.55% (3.1889 => 3.5253, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.52% (0.5637 => 0.6230, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.51% (0.1865 => 0.2061, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.51% (0.2655 => 0.2934, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 10.51% (0.2760 => 0.3050, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.50% (0.2914 => 0.3220, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 10.49% (0.2937 => 0.3245, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.45% (0.1014 => 0.1120, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 10.43% (0.3107 => 0.3431, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 10.38% (0.1589 => 0.1754, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 10.37% (2.1791 => 2.4050, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/fibo: 10.31% (0.2628 => 0.2899, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 10.31% (0.7506 => 0.8280, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.23% (0.2023 => 0.2230, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 10.15% (0.3192 => 0.3516, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.13% (0.2765 => 0.3045, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.11% (7.2180 => 7.9477, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/football/football: 10.11% (0.8310 => 0.9150, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: 10.09% (0.2925 => 0.3220, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.06% (4.9865 => 5.4880, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.05% (0.2696 => 0.2967, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.03% (0.1435 => 0.1579, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.03% (0.1276 => 0.1404, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 9.97% (0.2988 => 0.3286, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 9.92% (1.0594 => 1.1645, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.83% (0.3755 => 0.4124, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 9.60% (0.1657 => 0.1816, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 9.51% (0.2945 => 0.3225, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.48% (1.3245 => 1.4501, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: 9.26% (0.3131 => 0.3421, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.18% (3.6692 => 4.0061, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.17% (0.6576 => 0.7179, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 9.15% (1.2749 => 1.3915, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.13% (4.3801 => 4.7799, std.dev.: 0.0092) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.11% (4.4433 => 4.8483, std.dev.: 0.0056) MultiSource/Applications/JM/lencod/lencod: 9.06% (14.8535 => 16.1995, std.dev.: 0.0131) SingleSource/Benchmarks/Misc-C++/bigfib: 9.04% (0.6250 => 0.6815, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.02% (0.2140 => 0.2333, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 8.89% (8.4961 => 9.2518, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.88% (1.5188 => 1.6537, std.dev.: 0.0170) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.74% (0.6135 => 0.6671, std.dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 8.72% (4.6629 => 5.0694, std.dev.: 0.0136) MultiSource/Benchmarks/McCat/05-eks/eks: 8.70% (0.4113 => 0.4471, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.66% (0.1789 => 0.1944, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.55% (0.8818 => 0.9572, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.52% (0.3511 => 0.3810, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.49% (3.2742 => 3.5523, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/health/health: 8.49% (0.1213 => 0.1316, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.32% (0.4805 => 0.5205, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: 8.30% (0.1385 => 0.1500, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.23% (0.2321 => 0.2512, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.23% (0.3245 => 0.3512, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.21% (2.1007 => 2.2731, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.14% (1.1333 => 1.2256, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 8.12% (3.7467 => 4.0508, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.09% (0.9108 => 0.9845, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.08% (0.1819 => 0.1966, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 7.94% (6.5754 => 7.0974, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.79% (0.2504 => 0.2699, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 7.72% (0.2008 => 0.2163, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 7.62% (0.4003 => 0.4308, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 7.60% (1.2292 => 1.3226, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.47% (6.2785 => 6.7477, std.dev.: 0.0077) SingleSource/UnitTests/ObjC/exceptions: 7.36% (0.3914 => 0.4202, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.26% (0.3940 => 0.4226, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.24% (13.2842 => 14.2465, std.dev.: 0.0114) SingleSource/UnitTests/ObjC/trivial-interface: 7.24% (0.3578 => 0.3837, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.14% (0.3601 => 0.3858, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.04% (0.3650 => 0.3907, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.02% (0.3646 => 0.3902, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.02% (0.3789 => 0.4055, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 6.96% (0.3663 => 0.3918, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 6.85% (0.3623 => 0.3871, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 5.91% (0.1777 => 0.1882, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 5.70% (16.2614 => 17.1879, std.dev.: 0.0161) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.62% (0.2243 => 0.2369, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 4.84% (14.5298 => 15.2326, std.dev.: 0.0089) MultiSource/Benchmarks/Olden/bh/bh: 3.53% (0.2859 => 0.2960, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 2.85% (33.2944 => 34.2417, std.dev.: 0.0111) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5174, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.09% (1.0895 => 1.3629, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 25.09% (1.8175 => 2.2735, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/richards_benchmark: 11.05% (1.1560 => 1.2837, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 8.99% (0.8273 => 0.9017, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4142, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 6.28% (1.2998 => 1.3814, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.87% (0.2093 => 0.2195, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 2.9998, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0048, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.90% (11.2619 => 11.7015, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9852, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 3.34% (10.7476 => 11.1062, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.18% (7.4271 => 7.5888, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.65% (1.4298 => 1.4534, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5133, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/queens: 1.46% (2.1753 => 2.2070, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.46% (2.0200 => 2.0494, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.38% (1.9433 => 1.9701, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2123, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1888, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5787, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.15% (12.4560 => 12.5990, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.02% (3.6469 => 3.6842, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.25% (0.2670 => 0.1435, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.91% (0.4657 => 0.3916, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.84% (1.3813 => 1.2039, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.74% (1.3819 => 1.2059, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.32% (1.0460 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.0997 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.11% (0.2238 => 0.1967, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -10.94% (1.2308 => 1.0962, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.06% (20.3410 => 18.2943, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.10% (1.3780 => 1.2939, std.dev.: 0.0049) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5151, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.36% (0.9996 => 0.9560, std.dev.: 0.0030) MultiSource/Benchmarks/sim/sim: -4.32% (5.0168 => 4.8003, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.58% (3.2729 => 3.1558, std.dev.: 0.0131) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.33% (1.7688 => 1.7099, std.dev.: 0.0038) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.14% (0.4867 => 0.4714, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -2.52% (26.5159 => 25.8480, std.dev.: 0.0361) MultiSource/Applications/spiff/spiff: -2.42% (3.0263 => 2.9530, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.32% (1.9762 => 1.9303, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.96% (0.6589 => 0.6460, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -1.80% (28.2225 => 27.7144, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/lists: -1.72% (6.3560 => 6.2464, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.57% (0.6615 => 0.6511, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0075, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8638, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.23% (0.8342 => 0.8239, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.20% (2.5254 => 2.4951, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -1.10% (5.3167 => 5.2581, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 17 13:33:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 17 Oct 2012 15:33:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121017203344.625A82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4936?compare_to=4928&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4936, Order: 166105, Start Time: 2012-10-17 17:18:07, End Time: 2012-10-17 20:35:40 To: 4928, Order: 166096, Start Time: 2012-10-17 10:47:44, End Time: 2012-10-17 14:03:59 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (134 on baseline) Performance Improvements: 13 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1028 (756 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.38% (125.1694 => 129.4001, std.dev.: 1.1520) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.31% (0.8066 => 0.7880, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -2.21% (0.5800 => 0.5672, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.18% (0.6001 => 0.5870, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: -2.09% (6.0714 => 5.9446, std.dev.: 0.0123) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.99% (12.4942 => 12.2460, std.dev.: 0.0089) MultiSource/Applications/siod/siod: -1.81% (0.7183 => 0.7053, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.78% (4.9924 => 4.9037, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: -1.42% (1.7642 => 1.7391, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -1.41% (2.1725 => 2.1419, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: -1.21% (12.4643 => 12.3129, std.dev.: 0.0056) MultiSource/Applications/lua/lua: -1.19% (1.5317 => 1.5134, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: -1.08% (1.1620 => 1.1494, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.07% (25.3190 => 25.0472, std.dev.: 0.0153) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 10.65% (0.3446 => 0.3813, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.52% (0.3488 => 0.3855, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/for-in: 10.47% (0.3496 => 0.3862, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.45% (0.3465 => 0.3827, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 10.43% (0.3442 => 0.3801, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-3: 10.38% (0.3460 => 0.3819, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 10.32% (0.3469 => 0.3827, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.19% (0.3650 => 0.4022, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 10.18% (0.3643 => 0.4014, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 9.91% (0.3724 => 0.4093, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.88% (0.1063 => 0.1168) MultiSource/Applications/oggenc/oggenc: 9.16% (1.5932 => 1.7391, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 8.62% (0.1218 => 0.1323, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.62% (0.5826 => 0.6328, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.39% (0.5889 => 0.6383, std.dev.: 0.0079) MultiSource/Benchmarks/nbench/nbench: 8.22% (0.2566 => 0.2777, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 8.21% (0.1619 => 0.1752, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.97% (1.3152 => 1.4200, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.91% (0.4361 => 0.4706, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.73% (0.4994 => 0.5380, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.58% (1.6211 => 1.7440, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.52% (0.5000 => 0.5376, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 7.37% (0.4847 => 0.5204, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.35% (0.1620 => 0.1739, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 7.27% (5.5417 => 5.9446, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.20% (0.2875 => 0.3082, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 7.15% (0.7171 => 0.7684, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.14% (0.5900 => 0.6321, std.dev.: 0.0026) SingleSource/Regression/C++/ofstream_ctor: 7.12% (0.3004 => 0.3218, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.05% (0.2014 => 0.2156, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.00% (0.3930 => 0.4205, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.96% (0.4139 => 0.4427, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.95% (0.3195 => 0.3417, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.91% (2.7292 => 2.9177, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.87% (3.5627 => 3.8076, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/strcat: 6.87% (0.2750 => 0.2939, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.87% (0.2736 => 0.2924, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 6.85% (0.2714 => 0.2900, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.79% (0.2738 => 0.2924, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 6.79% (0.2725 => 0.2910, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.3267 => 0.3488, std.dev.: 0.0059) MultiSource/Applications/hexxagon/hexxagon: 6.75% (0.9909 => 1.0578, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 6.73% (0.2823 => 0.3013, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.73% (2.0673 => 2.2064, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.73% (0.5026 => 0.5364, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.71% (0.1549 => 0.1653, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.71% (0.2729 => 0.2912, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.70% (0.2792 => 0.2979, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 6.68% (0.2813 => 0.3001, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.68% (0.3625 => 0.3867, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.66% (4.4195 => 4.7139, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary: 6.66% (0.3258 => 0.3475, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 6.64% (0.1505 => 0.1605, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.63% (0.2911 => 0.3104, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 6.61% (1.8794 => 2.0037, std.dev.: 0.0021) MultiSource/Applications/d/make_dparser: 6.61% (1.0781 => 1.1494, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.60% (0.2803 => 0.2988, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.58% (0.2780 => 0.2963, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 6.55% (0.3726 => 0.3970, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 6.55% (0.2811 => 0.2995, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 6.54% (0.3317 => 0.3534, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.54% (0.3060 => 0.3260, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.51% (0.3362 => 0.3581, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.50% (0.3124 => 0.3327, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 6.49% (23.5202 => 25.0472, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/wc: 6.49% (0.3096 => 0.3297, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.49% (0.2866 => 0.3052, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 6.48% (0.3348 => 0.3565, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.48% (0.3845 => 0.4094, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 6.44% (4.2109 => 4.4820, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/hash: 6.42% (0.4146 => 0.4412, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.37% (0.3282 => 0.3491, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 6.36% (0.3477 => 0.3698, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.35% (0.3890 => 0.4137, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 6.32% (0.6634 => 0.7053, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.30% (0.3903 => 0.4149, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.29% (0.3084 => 0.3278, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.28% (0.4251 => 0.4518, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 6.28% (0.4029 => 0.4282, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.21% (0.3271 => 0.3474, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 6.18% (0.3336 => 0.3542, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.16% (0.2969 => 0.3152, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.15% (0.3981 => 0.4226, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.15% (0.6435 => 0.6831, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.13% (0.2103 => 0.2232, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.12% (0.3690 => 0.3916, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.11% (0.7426 => 0.7880, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 6.06% (1.4269 => 1.5134, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 6.06% (0.5546 => 0.5882, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.05% (0.1968 => 0.2087, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 6.02% (0.9697 => 1.0281, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.00% (0.2068 => 0.2192, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.95% (0.4658 => 0.4935, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 5.86% (2.1013 => 2.2245, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.80% (0.5361 => 0.5672, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 5.79% (0.5012 => 0.5302, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 5.59% (4.6177 => 4.8759, std.dev.: 0.0109) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.59% (0.2040 => 0.2154, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 5.57% (2.1653 => 2.2858, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/football/football: 5.49% (0.2075 => 0.2189, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.37% (1.9694 => 2.0751, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.35% (1.9966 => 2.1035, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: 5.27% (2.0346 => 2.1419, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.21% (11.6398 => 12.2460, std.dev.: 0.0089) MultiSource/Applications/treecc/treecc: 5.17% (0.7875 => 0.8282, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.12% (0.5584 => 0.5870, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 4.81% (0.2391 => 0.2506, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 4.76% (0.2691 => 0.2819, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.50% (4.6926 => 4.9037, std.dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 4.32% (0.3498 => 0.3649, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.10% (0.4253 => 0.4385, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 2.99% (11.9555 => 12.3129, std.dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 9.31% (0.2802 => 0.3063, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6101, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6739, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-2: 4.77% (1.8057 => 1.8918, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1704, std.dev.: 0.0057) SingleSource/Benchmarks/Dhrystone/dry: 4.27% (14.0481 => 14.6477, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.66% (0.3693 => 0.3828, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2101, std.dev.: 0.0023) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.59% (3.1722 => 3.2226, std.dev.: 0.0029) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3084, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2876, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.25% (1.0927 => 1.1064, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5139, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5789, std.dev.: 0.0241) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.10% (2.4764 => 2.3996, std.dev.: 0.0105) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.79% (25.4195 => 16.5770, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/ary2: -10.74% (0.2402 => 0.2144, std.dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9756, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7938, std.dev.: 0.0117) MultiSource/Benchmarks/Olden/tsp/tsp: -7.31% (2.1113 => 1.9569, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8007, std.dev.: 0.0120) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7732, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5187, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.28% (41.7953 => 40.8439, std.dev.: 0.0144) SingleSource/Benchmarks/Dhrystone/fldry: -2.27% (17.2379 => 16.8469, std.dev.: 0.0283) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.95% (0.6293 => 0.6170, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5716, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4953, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.2019, std.dev.: 0.0671) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0469, std.dev.: 0.0039) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 17 13:55:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 17 Oct 2012 15:55:44 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121017205544.CCF542A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4937?compare_to=4934&baseline=4934 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 4937, Order: 166118, Start Time: 2012-10-17 19:33:22, End Time: 2012-10-17 20:57:43 To: 4934, Order: 166107, Start Time: 2012-10-17 17:52:10, End Time: 2012-10-17 19:16:44 Baseline: 4934, Order: 166107, Start Time: 2012-10-17 17:52:10, End Time: 2012-10-17 19:16:44 =============== Tests Summary =============== Performance Regressions: 5 (5 on baseline) Performance Improvements: 8 (8 on baseline) Existing Failures: 68 (68 on baseline) Unchanged Tests: 961 (961 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.67% (0.8055 => 0.8270, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.48% (0.8044 => 0.8163, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.38% (4.4073 => 4.4682, std.dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: 1.27% (62.3172 => 63.1109, std.dev.: 0.0955) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.03% (1.4019 => 1.4163, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/d/make_dparser: -2.36% (3.3110 => 3.2330, std.dev.: 0.0254) MultiSource/Applications/SPASS/SPASS: -2.02% (14.6167 => 14.3208, std.dev.: 0.0850) MultiSource/Applications/lua/lua: -1.93% (3.8932 => 3.8181, std.dev.: 0.0087) MultiSource/Applications/spiff/spiff: -1.88% (0.8252 => 0.8097, std.dev.: 0.0051) MultiSource/Applications/treecc/treecc: -1.82% (2.0419 => 2.0047, std.dev.: 0.0095) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: -28.61% (0.2017 => 0.1440, std.dev.: 0.0121) MultiSource/Benchmarks/BitBench/five11/five11: -1.34% (5.6855 => 5.6094, std.dev.: 0.0252) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -1.34% (7.1091 => 7.0140, std.dev.: 0.0367) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -1.55% (16.7745 => 16.5141, std.dev.: 0.1233) MultiSource/Applications/obsequi/Obsequi: -0.38% (1.0418 => 1.0378, std.dev.: 0.0052) MultiSource/Applications/sqlite3/sqlite3: -2.41% (0.6425 => 0.6270, std.dev.: 0.0073) MultiSource/Benchmarks/McCat/08-main/main: -0.58% (0.1902 => 0.1891, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 8.34% (0.1510 => 0.1636, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.34% (0.3205 => 0.3194, std.dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.69% (0.2468 => 0.2451, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.73% (0.3289 => 0.3265, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.84% (0.2259 => 0.2391, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: 0.17% (0.5924 => 0.5934, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel: 9.43% (0.0435 => 0.0476, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.3288 => 0.3288, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/strcat: -0.15% (0.1971 => 0.1968, std.dev.: 0.0063) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -15.55% (0.0238 => 0.0201, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.33% (0.0210 => 0.0203, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.72% (0.0414 => 0.0411, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.35% (0.0296 => 0.0292, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 21.60% (0.0250 => 0.0304, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 5.44% (0.0386 => 0.0407, std.dev.: 0.0054) SingleSource/UnitTests/Vector/Altivec/casts: -0.52% (0.0193 => 0.0192, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/test1: 0.97% (0.0206 => 0.0208, std.dev.: 0.0020) SingleSource/UnitTests/byval-alignment: 0.31% (0.0321 => 0.0322, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -1.22% (0.1471 => 0.1453, std.dev.: 0.0067) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.17% (1.1757 => 1.1737, std.dev.: 0.0311) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 4.25% (0.1411 => 0.1471, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.97% (0.4041 => 0.4161, std.dev.: 0.0243) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.82% (0.1374 => 0.1399, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.82% (0.0661 => 0.0649, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 50.82% (0.0183 => 0.0276, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.89% (0.0563 => 0.0558, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.03% (1.1436 => 1.1440, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1700.00% (0.0001 => 0.0018, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 600.00% (0.0001 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 15.23% (0.0545 => 0.0628, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 57.06% (0.0170 => 0.0267) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.22% (0.8001 => 0.8019, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 0.21% (2.1516 => 2.1561, std.dev.: 0.0132) SingleSource/UnitTests/2003-07-10-SignConversions: 200.00% (0.0001 => 0.0003, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 81.40% (0.0043 => 0.0078, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.67% (0.8055 => 0.8270, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.48% (0.8044 => 0.8163, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.38% (4.4073 => 4.4682, std.dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: 1.27% (62.3172 => 63.1109, std.dev.: 0.0955) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.03% (1.4019 => 1.4163, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/d/make_dparser: -2.36% (3.3110 => 3.2330, std.dev.: 0.0254) MultiSource/Applications/SPASS/SPASS: -2.02% (14.6167 => 14.3208, std.dev.: 0.0850) MultiSource/Applications/lua/lua: -1.93% (3.8932 => 3.8181, std.dev.: 0.0087) MultiSource/Applications/spiff/spiff: -1.88% (0.8252 => 0.8097, std.dev.: 0.0051) MultiSource/Applications/treecc/treecc: -1.82% (2.0419 => 2.0047, std.dev.: 0.0095) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: -28.61% (0.2017 => 0.1440, std.dev.: 0.0121) MultiSource/Benchmarks/BitBench/five11/five11: -1.34% (5.6855 => 5.6094, std.dev.: 0.0252) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -1.34% (7.1091 => 7.0140, std.dev.: 0.0367) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -1.55% (16.7745 => 16.5141, std.dev.: 0.1233) MultiSource/Applications/obsequi/Obsequi: -0.38% (1.0418 => 1.0378, std.dev.: 0.0052) MultiSource/Applications/sqlite3/sqlite3: -2.41% (0.6425 => 0.6270, std.dev.: 0.0073) MultiSource/Benchmarks/McCat/08-main/main: -0.58% (0.1902 => 0.1891, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 8.34% (0.1510 => 0.1636, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.34% (0.3205 => 0.3194, std.dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.69% (0.2468 => 0.2451, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.73% (0.3289 => 0.3265, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.84% (0.2259 => 0.2391, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: 0.17% (0.5924 => 0.5934, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel: 9.43% (0.0435 => 0.0476, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.3288 => 0.3288, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/strcat: -0.15% (0.1971 => 0.1968, std.dev.: 0.0063) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -15.55% (0.0238 => 0.0201, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.33% (0.0210 => 0.0203, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.72% (0.0414 => 0.0411, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.35% (0.0296 => 0.0292, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 21.60% (0.0250 => 0.0304, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 5.44% (0.0386 => 0.0407, std.dev.: 0.0054) SingleSource/UnitTests/Vector/Altivec/casts: -0.52% (0.0193 => 0.0192, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/test1: 0.97% (0.0206 => 0.0208, std.dev.: 0.0020) SingleSource/UnitTests/byval-alignment: 0.31% (0.0321 => 0.0322, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -1.22% (0.1471 => 0.1453, std.dev.: 0.0067) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.17% (1.1757 => 1.1737, std.dev.: 0.0311) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 4.25% (0.1411 => 0.1471, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.97% (0.4041 => 0.4161, std.dev.: 0.0243) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.82% (0.1374 => 0.1399, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.82% (0.0661 => 0.0649, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 50.82% (0.0183 => 0.0276, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.89% (0.0563 => 0.0558, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.03% (1.1436 => 1.1440, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1700.00% (0.0001 => 0.0018, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 600.00% (0.0001 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 15.23% (0.0545 => 0.0628, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 57.06% (0.0170 => 0.0267) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.22% (0.8001 => 0.8019, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 0.21% (2.1516 => 2.1561, std.dev.: 0.0132) SingleSource/UnitTests/2003-07-10-SignConversions: 200.00% (0.0001 => 0.0003, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: -80.00% (0.0005 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 81.40% (0.0043 => 0.0078, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 0.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 17 13:58:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 17 Oct 2012 15:58:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121017205802.560E12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4938?compare_to=4933&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4938, Order: 166118, Start Time: 2012-10-17 19:39:47, End Time: 2012-10-17 20:59:58 To: 4933, Order: 166106, Start Time: 2012-10-17 17:50:29, End Time: 2012-10-17 19:10:14 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 1 (75 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 59 (183 on baseline) Performance Improvements: 4 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 889 (661 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 0.12% (0.1640 => 0.1642, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.59% (0.5603 => 0.5972, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 5.52% (1.2595 => 1.3290, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.45% (0.5471 => 0.5769, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.36% (0.7388 => 0.7784, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 5.14% (3.6661 => 3.8544, std.dev.: 0.0087) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.17% (0.6954 => 0.7244, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.61% (1.6960 => 1.7573, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 3.56% (0.9571 => 0.9912, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.47% (1.5139 => 1.5664, std.dev.: 0.0019) MultiSource/Applications/sgefa/sgefa: 3.46% (0.3414 => 0.3532, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 3.39% (1.1648 => 1.2043, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.33% (8.8319 => 9.1263, std.dev.: 0.0116) MultiSource/Applications/treecc/treecc: 3.29% (2.2012 => 2.2736, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.26% (1.4276 => 1.4741, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 3.22% (0.7883 => 0.8137, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.20% (0.3589 => 0.3704, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.17% (4.6640 => 4.8120, std.dev.: 0.0089) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.15% (1.2777 => 1.3179, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 3.06% (10.4204 => 10.7396, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 3.06% (0.4610 => 0.4751, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.05% (8.5780 => 8.8393, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/18-imp/imp: 3.03% (0.3760 => 0.3874, std.dev.: 0.0040) MultiSource/Benchmarks/sim/sim: 2.99% (0.3680 => 0.3790, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.97% (0.5059 => 0.5209, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 2.96% (17.9976 => 18.5301, std.dev.: 0.0169) MultiSource/Applications/Burg/burg: 2.91% (1.2699 => 1.3068, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.83% (2.3712 => 2.4384, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: 2.82% (0.4081 => 0.4196, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 2.77% (0.3605 => 0.3705, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.75% (1.0627 => 1.0919, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.71% (4.0547 => 4.1645, std.dev.: 0.0170) MultiSource/Applications/ClamAV/clamscan: 2.64% (19.9985 => 20.5259, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.60% (1.7211 => 1.7658, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.44% (5.3760 => 5.5071, std.dev.: 0.0053) MultiSource/Applications/spiff/spiff: 2.41% (0.8516 => 0.8721, std.dev.: 0.0035) MultiSource/Applications/lua/lua: 2.37% (4.2282 => 4.3286, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.34% (0.6407 => 0.6557, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.29% (5.4394 => 5.5637, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.24% (15.0735 => 15.4117, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.15% (0.6409 => 0.6547, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 2.11% (2.4874 => 2.5400, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/hash2: 2.04% (0.4960 => 0.5061, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 1.92% (11.5166 => 11.7377, std.dev.: 0.0099) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.90% (0.8912 => 0.9081, std.dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 1.68% (6.3051 => 6.4108, std.dev.: 0.0142) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.64% (5.6868 => 5.7799, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 1.61% (19.0040 => 19.3097, std.dev.: 0.0106) MultiSource/Benchmarks/PAQ8p/paq8p: 1.48% (15.0740 => 15.2969, std.dev.: 0.0062) MultiSource/Applications/lambda-0_1_3/lambda: 1.41% (0.8242 => 0.8358, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 1.40% (23.5067 => 23.8359, std.dev.: 0.0070) MultiSource/Applications/hexxagon/hexxagon: 1.15% (1.3431 => 1.3585, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.68% (0.9606 => 1.0920, std.dev.: 0.0105) SingleSource/Regression/C/uint64_to_float: 7.17% (0.5311 => 0.5692, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.62% (0.9673 => 1.0217, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.50% (12.0997 => 12.5232, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.26% (78.6619 => 80.4435, std.dev.: 0.4212) MultiSource/Benchmarks/Olden/bisort/bisort: 2.12% (0.8311 => 0.8487, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 1.69% (4.7965 => 4.8776, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.24% (3.6591 => 3.7044, std.dev.: 0.0088) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3454 => 2.9600, std.dev.: 0.0045) MultiSource/Applications/aha/aha: -7.02% (3.4503 => 3.2080, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.02% (1.3846 => 1.3013, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -1.50% (4.6317 => 4.5624, std.dev.: 0.0019) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 2.49% (0.5955 => 0.6103, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 4.19% (16.4389 => 17.1272, std.dev.: 0.0133) MultiSource/Benchmarks/Bullet/bullet: 1.09% (55.4709 => 56.0781, std.dev.: 0.0176) MultiSource/Benchmarks/MallocBench/gs/gs: 1.64% (4.4517 => 4.5247, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.43% (0.0465 => 0.0467, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.64% (0.0466 => 0.0469, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.23% (0.0435 => 0.0436, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.69% (0.0435 => 0.0438) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.71% (0.0423 => 0.0426) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.71% (0.0424 => 0.0427, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.72% (0.0416 => 0.0419, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.48% (0.0418 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.46% (0.0434 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.46% (0.0436 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.70% (0.0428 => 0.0431) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.70% (0.0430 => 0.0433) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.24% (0.0420 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.71% (0.0420 => 0.0423) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.47% (0.0426 => 0.0428) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.70% (0.0427 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.46% (0.0437 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.34% (0.0461 => 0.0441, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.24% (0.0414 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.48% (0.0415 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.71% (0.0425 => 0.0428, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.47% (0.0428 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.48% (0.0417 => 0.0419) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.72% (0.0417 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.74% (0.0408 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.49% (0.0410 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.49% (0.0409 => 0.0411) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.98% (0.0408 => 0.0412) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.45% (0.0445 => 0.0447) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.67% (0.0446 => 0.0449) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.49% (0.0407 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.49% (0.0408 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.49% (0.0409 => 0.0411, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.49% (0.0411 => 0.0413) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.48% (0.0416 => 0.0418) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.48% (0.0417 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.12% (1.2578 => 1.2845, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.69% (7.9513 => 8.1653, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.59% (0.7459 => 0.7727, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.55% (0.0362 => 0.0360, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -0.21% (0.1433 => 0.1430) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.19% (0.2141 => 0.2137, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.33% (63.2438 => 56.0781, std.dev.: 0.0176) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 0.18% (0.1639 => 0.1642, std.dev.: 0.0000) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 36.41% (14.1553 => 19.3097, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.91% (3.4629 => 5.7799, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13407.64% (0.0720 => 9.7255, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9975100.00% (0.0001 => 9.9752, std.dev.: 0.0013) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 64.29% (0.2554 => 0.4196, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 47.55% (10.3673 => 15.2969, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/distray/distray: 35.98% (0.1056 => 0.1436, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 35.02% (0.1622 => 0.2190, std.dev.: 0.0000) SingleSource/UnitTests/vla: 29.58% (0.0355 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 21.34% (0.0834 => 0.1012, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.99% (0.0871 => 0.1019, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 16.98% (0.5105 => 0.5972, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 16.97% (0.1432 => 0.1675, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.92% (0.1566 => 0.1831, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 16.61% (0.6675 => 0.7784, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 16.43% (7.0540 => 8.2132, std.dev.: 0.0050) SingleSource/Benchmarks/McGill/chomp: 15.71% (0.1655 => 0.1915, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 15.62% (0.0730 => 0.0844, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 15.56% (3.3354 => 3.8544, std.dev.: 0.0087) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.52% (2.2022 => 2.5440, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.92% (0.5020 => 0.5769, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.77% (0.1625 => 0.1865, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 14.36% (0.7115 => 0.8137, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.00% (1.5415 => 1.7573, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 13.82% (0.1440 => 0.1639, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.64% (0.1510 => 0.1716, std.dev.: 0.0027) MultiSource/Applications/sgefa/sgefa: 13.61% (0.3109 => 0.3532, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 13.27% (0.1695 => 0.1920, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 13.23% (9.4845 => 10.7396, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.21% (0.2271 => 0.2571, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 13.18% (0.3423 => 0.3874, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/matrix: 12.96% (0.0818 => 0.0924, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.96% (1.3050 => 1.4741, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 12.92% (0.3282 => 0.3706, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 12.88% (0.1584 => 0.1788, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.87% (0.4615 => 0.5209, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.86% (0.1236 => 0.1395, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.84% (4.2646 => 4.8120, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.78% (1.7609 => 1.9860, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.69% (0.1032 => 0.1163, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/exptree: 12.65% (0.0814 => 0.0917, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 12.55% (0.1163 => 0.1309, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 12.47% (10.4361 => 11.7377, std.dev.: 0.0099) MultiSource/Applications/lambda-0_1_3/lambda: 12.44% (0.7433 => 0.8358, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.37% (0.1940 => 0.2180, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 12.34% (0.1175 => 0.1320, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.34% (0.1143 => 0.1284, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 12.32% (1.0722 => 1.2043, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 12.31% (0.6450 => 0.7244, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.27% (0.1695 => 0.1903, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 12.25% (1.1642 => 1.3068, std.dev.: 0.0086) MultiSource/Benchmarks/nbench/nbench: 12.25% (1.1840 => 1.3290, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.22% (0.0933 => 0.1047, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 12.17% (8.1363 => 9.1263, std.dev.: 0.0116) MultiSource/Applications/treecc/treecc: 12.15% (2.0273 => 2.2736, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 12.08% (0.0886 => 0.0993, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 12.08% (0.1151 => 0.1290, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.04% (0.3307 => 0.3705, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.93% (0.2700 => 0.3022, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 11.90% (0.3387 => 0.3790, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 11.83% (0.1463 => 0.1636, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.82% (0.9765 => 1.0919, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 11.78% (3.8723 => 4.3286, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.72% (0.5860 => 0.6547, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 11.67% (0.1337 => 0.1493, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 11.64% (0.1555 => 0.1736, std.dev.: 0.0011) SingleSource/UnitTests/SignlessTypes/rem: 11.45% (0.1144 => 0.1275, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.44% (0.2107 => 0.2348, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.37% (4.9449 => 5.5071, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.34% (1.5859 => 1.7658, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 11.32% (5.7591 => 6.4108, std.dev.: 0.0142) MultiSource/Applications/spiff/spiff: 11.31% (0.7835 => 0.8721, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.30% (0.0929 => 0.1034, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.23% (5.0018 => 5.5637, std.dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.21% (0.3121 => 0.3471, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.13% (0.1330 => 0.1478, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.12% (0.8172 => 0.9081, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.11% (1.1861 => 1.3179, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 11.11% (0.8921 => 0.9912, std.dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.02% (7.9617 => 8.8393, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.95% (0.2758 => 0.3060, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.91% (0.8067 => 0.8947, std.dev.: 0.0068) SingleSource/UnitTests/ObjC/trivial-interface: 10.86% (0.3473 => 0.3850, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.83% (0.1117 => 0.1238, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/parameter-passing: 10.82% (0.3927 => 0.4352, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.81% (0.3543 => 0.3926, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 10.80% (0.6456 => 0.7153, std.dev.: 0.0085) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.78% (0.3543 => 0.3925, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.72% (2.2024 => 2.4384, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-2: 10.69% (0.3497 => 0.3871, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.69% (0.1029 => 0.1139, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.67% (0.3561 => 0.3941, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.67% (0.3694 => 0.4088, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.67% (0.3516 => 0.3891, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.63% (0.3828 => 0.4235, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.63% (0.1044 => 0.1155, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.63% (0.5569 => 0.6161, std.dev.: 0.0018) MultiSource/Applications/siod/siod: 10.58% (2.2969 => 2.5400, std.dev.: 0.0063) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.58% (0.3177 => 0.3513, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.55% (0.3886 => 0.4296, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 10.51% (0.4299 => 0.4751, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.49% (0.1125 => 0.1243, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.42% (1.4186 => 1.5664, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.36% (0.1062 => 0.1172, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.22% (0.1438 => 0.1585, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.17% (0.4879 => 0.5375, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.14% (0.2603 => 0.2867, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 9.97% (0.3180 => 0.3497, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.97% (0.3441 => 0.3784, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.88% (0.3826 => 0.4204, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.80% (0.4103 => 0.4505, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.69% (0.2065 => 0.2265, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.63% (0.5981 => 0.6557, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/health/health: 9.62% (0.1268 => 0.1390, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 9.59% (1.5603 => 1.7099, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.58% (0.2266 => 0.2483, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 9.55% (0.4620 => 0.5061, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 9.51% (0.4289 => 0.4697, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/ReedSolomon: 9.32% (0.2049 => 0.2240, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.18% (0.4203 => 0.4589, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.15% (0.6030 => 0.6582, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.08% (0.5925 => 0.6463, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/lists: 9.03% (0.3422 => 0.3731, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.00% (0.3865 => 0.4213, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.74% (0.4636 => 0.5041, std.dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 8.66% (21.9371 => 23.8359, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/moments: 8.52% (0.4048 => 0.4393, std.dev.: 0.0050) SingleSource/UnitTests/ObjC++/property-reference: 8.48% (0.7326 => 0.7947, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: 8.44% (0.3684 => 0.3995, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.30% (0.1892 => 0.2049, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 8.16% (0.3603 => 0.3897, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.13% (0.1906 => 0.2061, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.08% (0.3427 => 0.3704, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 7.85% (17.1811 => 18.5301, std.dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.75% (0.3136 => 0.3379, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.75% (0.3162 => 0.3407, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.59% (0.3650 => 0.3927, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.58% (0.4064 => 0.4372, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.38% (0.8101 => 0.8699, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.27% (14.3668 => 15.4117, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/matrix: 7.13% (0.3098 => 0.3319, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.02% (0.2891 => 0.3094, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.00% (3.8922 => 4.1645, std.dev.: 0.0170) SingleSource/Regression/C++/ofstream_ctor: 6.92% (0.2905 => 0.3106, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.89% (0.2831 => 0.3026, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.84% (0.3232 => 0.3453, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.83% (2.0665 => 2.2076, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.3283 => 0.3505, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 6.75% (0.3379 => 0.3607, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: 6.60% (0.2877 => 0.3067, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.55% (0.2872 => 0.3060, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.44% (0.2871 => 0.3056, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.31% (0.2756 => 0.2930, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.30% (0.2793 => 0.2969, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.26% (0.3052 => 0.3243) SingleSource/Benchmarks/Shootout-C++/fibo: 6.24% (0.2725 => 0.2895, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 6.05% (0.3092 => 0.3279, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/random: 6.03% (0.2802 => 0.2971, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.97% (0.2714 => 0.2876, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 5.79% (1.2842 => 1.3585, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.76% (0.2430 => 0.2570, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 5.33% (0.3131 => 0.3298, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.14% (0.3817 => 0.3937, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.80% (0.3935 => 0.4045, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.20% (1.1194 => 1.1440, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.76% (1.1145 => 1.3013, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 10.02% (1.1396 => 1.2538, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 9.67% (0.9957 => 1.0920, std.dev.: 0.0105) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 6.64% (3.1578 => 3.3674, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.65% (0.3463 => 0.3624, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.75% (4.2280 => 4.3442, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.85% (0.8333 => 0.8487, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.78% (3.6395 => 3.7044, std.dev.: 0.0088) MultiSource/Applications/aha/aha: 1.54% (3.1595 => 3.2080, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.37% (2.6546 => 2.6909, std.dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 1.13% (11.6436 => 11.7757, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.12% (6.5088 => 6.5820, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 1.06% (9.1159 => 9.2123, std.dev.: 0.0077) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1310, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -80.01% (0.8651 => 0.1729, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.44% (5.2763 => 3.2479, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.21% (5.3855 => 3.6506, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.72% (5.3526 => 3.6547, std.dev.: 0.0062) SingleSource/UnitTests/Vector/constpool: -14.51% (54.1659 => 46.3045, std.dev.: 0.0145) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.00% (2.9384 => 2.6152, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -7.44% (22.1758 => 20.5259, std.dev.: 0.0146) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.36% (1.1492 => 0.7658, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4233, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -12.07% (1.2373 => 1.0880, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3453 => 2.9600, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel-2: -10.84% (1.5373 => 1.3706, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.33% (19.9488 => 18.2867, std.dev.: 0.0117) MultiSource/Benchmarks/FreeBench/mason/mason: -7.87% (0.2161 => 0.1991, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.99% (1.8329 => 1.7048, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8479, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.58% (1.6805 => 1.5868, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: -5.07% (1.5835 => 1.5032, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8776, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.37% (3.2827 => 3.1720, std.dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.4992, std.dev.: 0.0038) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.60% (0.4808 => 0.4683, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.94% (8.1563 => 7.9982, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/salsa20: -1.89% (10.2830 => 10.0883, std.dev.: 0.0200) MultiSource/Applications/sqlite3/sqlite3: -1.76% (4.6441 => 4.5624, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6829, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -1.68% (2.5528 => 2.5100, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4203, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2878, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.08% (4.9088 => 4.8559, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/lists: -1.07% (6.2999 => 6.2324, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 16.71% (0.5229 => 0.6103, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 14.26% (14.9895 => 17.1272, std.dev.: 0.0133) MultiSource/Benchmarks/MallocBench/gs/gs: 10.08% (4.1105 => 4.5247, std.dev.: 0.0094) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 16.27% (1.1048 => 1.2845, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.07% (7.1582 => 8.1653, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.19% (0.6222 => 0.7727, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35900.00% (0.0001 => 0.0360, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.70% (0.1485 => 0.1430) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.99% (0.2116 => 0.2137, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 17 14:23:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 17 Oct 2012 16:23:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121017212325.2CA252A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4939?compare_to=4935&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4939, Order: 166118, Start Time: 2012-10-17 20:00:27, End Time: 2012-10-17 21:26:21 To: 4935, Order: 166107, Start Time: 2012-10-17 18:05:11, End Time: 2012-10-17 19:31:07 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 7 (192 on baseline) Performance Improvements: 4 (38 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1031 (674 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.31% (0.0862 => 0.0994, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 7.19% (0.5311 => 0.5693) SingleSource/Benchmarks/McGill/chomp: 5.93% (1.0962 => 1.1612, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 4.67% (0.9762 => 1.0218) MultiSource/Applications/hexxagon/hexxagon: 3.50% (12.0767 => 12.4997, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bisort/bisort: 2.24% (0.8294 => 0.8480, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 1.69% (4.8003 => 4.8812, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: -6.45% (1.3629 => 1.2750, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -1.23% (56.4778 => 55.7857, std.dev.: 0.2540) SingleSource/Benchmarks/Misc/himenobmtxpa: -1.12% (3.6842 => 3.6431, std.dev.: 0.0051) MultiSource/Applications/aha/aha: -1.10% (3.1484 => 3.1139, std.dev.: 0.0002) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.04% (2.0176 => 2.5027, std.dev.: 0.0181) MultiSource/Benchmarks/Fhourstones/fhourstones: 19.43% (0.1410 => 0.1684, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 17.92% (0.0826 => 0.0974) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.30% (0.0653 => 0.0766, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 16.90% (0.2243 => 0.2622, std.dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.55% (0.1072 => 0.1228, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.32% (0.1327 => 0.1517, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 14.31% (0.1013 => 0.1158, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.79% (0.0834 => 0.0949) MultiSource/Applications/hbd/hbd: 13.67% (1.3693 => 1.5565, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 13.67% (0.7038 => 0.8000, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.66% (0.1413 => 0.1606, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.35% (0.1588 => 0.1800, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.17% (0.0964 => 0.1091, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.02% (3.9660 => 4.4824, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 12.90% (0.4062 => 0.4586, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 12.82% (0.4328 => 0.4883, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.79% (0.2721 => 0.3069, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.76% (0.6283 => 0.7085, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.48% (0.2596 => 0.2920, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.45% (0.0819 => 0.0921, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.43% (1.4563 => 1.6373, std.dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 12.42% (13.8202 => 15.5364, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.34% (0.6959 => 0.7818, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.29% (0.3899 => 0.4378, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.25% (0.9199 => 1.0326, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/distray/distray: 12.22% (0.0818 => 0.0918, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.22% (1.2193 => 1.3683, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.08% (0.5265 => 0.5901, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.07% (1.1364 => 1.2736, std.dev.: 0.0015) MultiSource/Applications/aha/aha: 12.05% (0.1062 => 0.1190, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.96% (0.7710 => 0.8632, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 11.83% (1.0313 => 1.1533, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 11.76% (0.1003 => 0.1121, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.75% (0.4791 => 0.5354, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.58% (0.1157 => 0.1291, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.47% (0.3130 => 0.3489, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.28% (0.3485 => 0.3878, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 11.20% (1.1061 => 1.2300, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.18% (0.3756 => 0.4176, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.13% (0.4016 => 0.4463, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.12% (0.5577 => 0.6197, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 11.09% (0.2995 => 0.3327, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 11.08% (0.1589 => 0.1765, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 11.08% (0.2781 => 0.3089) MultiSource/Applications/kimwitu++/kc: 11.04% (16.6129 => 18.4464, std.dev.: 0.0211) SingleSource/UnitTests/ObjC++/property-reference-object: 10.98% (0.5818 => 0.6457, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 10.96% (0.6744 => 0.7483, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.94% (0.4379 => 0.4858, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.84% (0.4390 => 0.4866, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/lists: 10.84% (0.3293 => 0.3650, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.83% (0.1569 => 0.1739, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.72% (0.3022 => 0.3346, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.72% (0.3246 => 0.3594, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.72% (0.3489 => 0.3863, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 10.71% (0.1111 => 0.1230, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 10.68% (0.5748 => 0.6362, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 10.63% (0.3868 => 0.4279, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.62% (0.8698 => 0.9622, std.dev.: 0.0193) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.60% (0.2782 => 0.3077, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 10.57% (0.3453 => 0.3818, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 10.57% (2.1791 => 2.4094, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 10.55% (3.8646 => 4.2723, std.dev.: 0.0105) MultiSource/Applications/d/make_dparser: 10.54% (3.1889 => 3.5250, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.50% (0.3580 => 0.3956, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/18-imp/imp: 10.50% (0.3220 => 0.3558, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 10.47% (0.7061 => 0.7800, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 10.43% (1.9270 => 2.1279, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.42% (0.1075 => 0.1187, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.40% (0.2914 => 0.3217, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.39% (0.2127 => 0.2348, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/football/football: 10.37% (0.8310 => 0.9172, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 10.34% (0.2726 => 0.3008, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.34% (0.7460 => 0.8231, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.32% (0.2966 => 0.3272, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.31% (0.1435 => 0.1583, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 10.29% (0.2760 => 0.3044, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.27% (0.1276 => 0.1407, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.24% (0.0977 => 0.1077, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 10.22% (0.1478 => 0.1629, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 10.21% (0.2761 => 0.3043, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.21% (1.9828 => 2.1852, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 10.19% (0.3534 => 0.3894, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.17% (4.9865 => 5.4937, std.dev.: 0.0237) SingleSource/Benchmarks/Shootout-C++/hello: 10.13% (0.2607 => 0.2871, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 10.10% (0.3149 => 0.3467, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.09% (0.2655 => 0.2923, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.08% (0.1865 => 0.2053, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 10.07% (0.3107 => 0.3420, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.06% (0.1014 => 0.1116, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 10.05% (0.2925 => 0.3219, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.04% (0.5637 => 0.6203, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.03% (0.2023 => 0.2226, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 10.03% (0.7506 => 0.8259, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 9.96% (0.2690 => 0.2958, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 9.94% (0.2937 => 0.3229, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.92% (0.1986 => 0.2183, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 9.89% (0.2628 => 0.2888, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 9.89% (1.0594 => 1.1642, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/matrix: 9.84% (0.2988 => 0.3282, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.84% (0.2765 => 0.3037, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 9.84% (0.3192 => 0.3506, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.83% (7.2180 => 7.9276, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.57% (0.2696 => 0.2954, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 9.46% (14.8535 => 16.2588, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.45% (0.3755 => 0.4110, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 9.41% (0.1657 => 0.1813, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.40% (1.3245 => 1.4490, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.40% (0.6576 => 0.7194, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.33% (3.6692 => 4.0116, std.dev.: 0.0142) MultiSource/Applications/SIBsim4/SIBsim4: 9.33% (1.2749 => 1.3938, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 9.26% (0.3131 => 0.3421, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.24% (0.8818 => 0.9633, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 9.18% (4.6629 => 5.0909, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 9.17% (0.2945 => 0.3215, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 9.17% (0.1789 => 0.1953, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 9.14% (8.4961 => 9.2726, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.09% (4.4433 => 4.8473, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.06% (4.3801 => 4.7769, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.05% (0.6135 => 0.6690, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.01% (1.5188 => 1.6556, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 8.83% (0.6250 => 0.6802, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 8.80% (0.4113 => 0.4475, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.80% (0.3511 => 0.3820, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.72% (3.2742 => 3.5598, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.57% (0.9108 => 0.9889, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.36% (0.2140 => 0.2319, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.27% (0.2321 => 0.2513, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 8.23% (0.1385 => 0.1499, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.21% (1.1333 => 1.2264, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.20% (2.1007 => 2.2730, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 8.07% (0.2008 => 0.2170, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 8.04% (3.7467 => 4.0481, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 7.97% (6.5754 => 7.0994, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.95% (0.4805 => 0.5187, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.89% (0.3245 => 0.3501, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.79% (0.2504 => 0.2699, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.53% (0.1819 => 0.1956, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.44% (1.2292 => 1.3206, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.27% (6.2785 => 6.7351, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.12% (13.2842 => 14.2295, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/parameter-passing: 6.82% (0.4003 => 0.4276, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.57% (0.3914 => 0.4171, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.55% (0.3940 => 0.4198, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 6.29% (0.3578 => 0.3803, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.23% (0.3646 => 0.3873, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 6.20% (0.3789 => 0.4024, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.19% (0.3650 => 0.3876, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 6.14% (0.3663 => 0.3888, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.11% (0.3601 => 0.3821, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 6.07% (0.3623 => 0.3843, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 5.97% (0.1777 => 0.1883, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 5.87% (16.2614 => 17.2162, std.dev.: 0.0150) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.48% (0.2243 => 0.2366, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 4.69% (14.5298 => 15.2115, std.dev.: 0.0144) MultiSource/Benchmarks/Bullet/bullet: 2.70% (33.2944 => 34.1920, std.dev.: 0.0082) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.64% (5.7573 => 7.5214, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fbench: 24.32% (1.8175 => 2.2595, std.dev.: 0.0512) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.03% (1.0895 => 1.2750, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: 11.18% (1.1560 => 1.2852, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.47% (0.1322 => 0.1434, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4140, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 5.46% (1.2998 => 1.3708, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.43% (0.9692 => 1.0218) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0051, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 4.48% (0.5449 => 0.5693) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.97% (1.7081 => 1.7759, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.73% (11.2619 => 11.6823, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9856, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.37% (12.0921 => 12.4997, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bisort/bisort: 2.93% (0.8239 => 0.8480, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 2.84% (10.7476 => 11.0527, std.dev.: 0.0713) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.11% (7.4271 => 7.5841, std.dev.: 0.0063) MultiSource/Applications/lemon/lemon: 1.68% (1.4298 => 1.4538, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5132, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9689, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1886, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.22% (8.8259 => 8.9332, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5785, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 1.13% (12.4560 => 12.5971, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std.dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.85% (0.2670 => 0.1419, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.64% (0.4657 => 0.3882, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.08% (1.3819 => 1.2011, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.07% (1.3813 => 1.2008, std.dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.28% (1.0460 => 0.8548, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -12.96% (0.2238 => 0.1948, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.25% (20.3410 => 18.2569, std.dev.: 0.0202) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.70% (1.3780 => 1.2994, std.dev.: 0.0074) SingleSource/Benchmarks/McGill/chomp: -5.65% (1.2308 => 1.1612, std.dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5141, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.82% (0.9996 => 0.9514, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.86% (1.7688 => 1.7006, std.dev.: 0.0173) MultiSource/Applications/siod/siod: -3.30% (3.2729 => 3.1648, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.02% (0.4867 => 0.4720, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -2.86% (3.0263 => 2.9396, std.dev.: 0.0093) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8812, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.32% (1.9762 => 1.9303, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.99% (0.8342 => 0.8176, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.99% (0.6589 => 0.6458, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.86% (0.6615 => 0.6492, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -1.85% (26.5159 => 26.0256, std.dev.: 0.0121) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.71% (2.5254 => 2.4821, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.65% (6.3560 => 6.2514, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0069, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.33% (5.3167 => 5.2458, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/heapsort: -1.24% (3.9173 => 3.8686, std.dev.: 0.0125) MultiSource/Benchmarks/mafft/pairlocalalign: -1.19% (28.2225 => 27.8865, std.dev.: 0.0016) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1139, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -1.05% (84.4286 => 83.5386, std.dev.: 0.0069) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 17 15:35:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 17 Oct 2012 17:35:46 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121017223546.3BDBC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4940?baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 To: (none) Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 68 (0 on baseline) Added Tests: 898 (0 on baseline) Existing Failures: 0 (68 on baseline) Unchanged Tests: 76 (974 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment New Failures - Execution Time ----------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment Added Tests - Compile Time -------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sgefa/sgefa MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/sgefa/sgefa MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla ================================ Run-Over-Baseline Changes Detail ================================ Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (16.4461 => 16.4461, std.dev.: 0.1548) MultiSource/Applications/obsequi/Obsequi: - (1.0262 => 1.0262, std.dev.: 0.0160) MultiSource/Applications/sqlite3/sqlite3: - (0.6332 => 0.6332, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: - (0.1831 => 0.1831, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.1559 => 0.1559, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.3123 => 0.3123, std.dev.: 0.0132) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.2463 => 0.2463, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.3344 => 0.3344, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.2364 => 0.2364, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.6010 => 0.6010, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel: - (0.0429 => 0.0429, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.3266 => 0.3266, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.1969 => 0.1969, std.dev.: 0.0009) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0224 => 0.0224, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0123 => 0.0123, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0408 => 0.0408, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0254 => 0.0254, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0302 => 0.0302, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0384 => 0.0384, std.dev.: 0.0044) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0190 => 0.0190, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0180 => 0.0180, std.dev.: 0.0012) SingleSource/UnitTests/byval-alignment: - (0.0230 => 0.0230, std.dev.: 0.0050) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0007 => 0.0007, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: - (0.1438 => 0.1438, std.dev.: 0.0027) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: - (1.1329 => 1.1329, std.dev.: 0.0803) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: - (0.1462 => 0.1462, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: - (0.4164 => 0.4164, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: - (0.1369 => 0.1369, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: - (0.0641 => 0.0641, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0195 => 0.0195, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: - (0.0578 => 0.0578, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: - (1.1437 => 1.1437, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0014 => 0.0014, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0627 => 0.0627, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0180 => 0.0180, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: - (0.8017 => 0.8017, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: - (2.1832 => 2.1832, std.dev.: 0.0042) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0062 => 0.0062, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 1.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 17 15:48:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 17 Oct 2012 17:48:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121017224857.AF21C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4941?compare_to=4938&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4941, Order: 166125, Start Time: 2012-10-17 21:30:27, End Time: 2012-10-17 22:50:54 To: 4938, Order: 166118, Start Time: 2012-10-17 19:39:47, End Time: 2012-10-17 20:59:58 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (75 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 5 (179 on baseline) Performance Improvements: 0 (41 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 90 (15 on baseline) Unchanged Tests: 947 (666 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.77% (15.2969 => 15.8736, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.28% (2.5440 => 2.6019, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.33% (3.6506 => 3.6992, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.23% (3.6547 => 3.6995, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.05% (8.2132 => 8.2995, std.dev.: 0.0093) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.20% (0.6103 => 0.6115, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 0.25% (17.1272 => 17.1694, std.dev.: 0.0074) MultiSource/Benchmarks/Bullet/bullet: 0.41% (56.0781 => 56.3057, std.dev.: 0.0129) MultiSource/Benchmarks/MallocBench/gs/gs: 0.16% (4.5247 => 4.5320, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.43% (0.0467 => 0.0469, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.43% (0.0469 => 0.0471, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.46% (0.0436 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.46% (0.0438 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.23% (0.0426 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.23% (0.0427 => 0.0428) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.24% (0.0419 => 0.0420, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.48% (0.0420 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.69% (0.0436 => 0.0439) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.46% (0.0438 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.70% (0.0431 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.23% (0.0433 => 0.0434, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.71% (0.0421 => 0.0424, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.47% (0.0423 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.47% (0.0428 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.47% (0.0430 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.23% (0.0439 => 0.0440, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.45% (0.0441 => 0.0443, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.72% (0.0415 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.24% (0.0417 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.47% (0.0428 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.23% (0.0430 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.72% (0.0419 => 0.0422, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.48% (0.0420 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.49% (0.0411 => 0.0413, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.49% (0.0412 => 0.0414, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.49% (0.0411 => 0.0413, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.24% (0.0412 => 0.0413, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.67% (0.0447 => 0.0450, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.45% (0.0449 => 0.0451) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.49% (0.0409 => 0.0411, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.49% (0.0410 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.24% (0.0411 => 0.0412, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.24% (0.0413 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.48% (0.0418 => 0.0420, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.48% (0.0419 => 0.0421) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.33% (1.2845 => 1.2887, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.03% (8.1653 => 8.1674, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.45% (0.7727 => 0.7762, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 1.39% (0.0360 => 0.0365, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: - (0.1430 => 0.1430) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -0.06% (0.1642 => 0.1641, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.05% (0.2137 => 0.2136, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -10.97% (63.2438 => 56.3057, std.dev.: 0.0129) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 0.12% (0.1639 => 0.1641, std.dev.: 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 36.16% (14.1553 => 19.2735, std.dev.: 0.0167) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.27% (3.4629 => 5.7578, std.dev.: 0.0081) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13409.31% (0.0720 => 9.7267, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9974600.00% (0.0001 => 9.9747, std.dev.: 0.0015) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 62.84% (0.2554 => 0.4159, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 53.11% (10.3673 => 15.8736, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/richards_benchmark: 41.12% (0.1622 => 0.2289, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 36.08% (0.1056 => 0.1437, std.dev.: 0.0002) SingleSource/UnitTests/vla: 29.58% (0.0355 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 21.82% (0.0834 => 0.1016, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 18.65% (0.1432 => 0.1699, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.15% (2.2022 => 2.6019, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.66% (7.0540 => 8.2995, std.dev.: 0.0093) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.56% (0.1566 => 0.1841, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.99% (0.0871 => 0.1019, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 16.82% (0.6675 => 0.7798, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 16.81% (0.5105 => 0.5963, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 15.55% (3.3354 => 3.8541, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/chomp: 15.53% (0.1655 => 0.1912, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.78% (0.5020 => 0.5762, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 14.44% (0.1440 => 0.1648, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 14.20% (0.7115 => 0.8125, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.98% (1.5415 => 1.7570, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 13.89% (0.3282 => 0.3738, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.77% (0.1510 => 0.1718, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 13.48% (0.3109 => 0.3528, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.39% (0.2271 => 0.2575, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 13.36% (9.4845 => 10.7520, std.dev.: 0.0206) MultiSource/Benchmarks/Olden/em3d/em3d: 13.33% (0.1695 => 0.1921, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.28% (1.7609 => 1.9947, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 13.19% (0.1584 => 0.1793, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.10% (1.3050 => 1.4759, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/18-imp/imp: 13.06% (0.3423 => 0.3870, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 13.02% (10.4361 => 11.7949, std.dev.: 0.0202) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.98% (4.2646 => 4.8182, std.dev.: 0.0090) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.87% (0.4615 => 0.5209, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/exptree: 12.65% (0.0814 => 0.0917, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 12.64% (0.1163 => 0.1310, std.dev.: 0.0024) MultiSource/Applications/Burg/burg: 12.63% (1.1642 => 1.3112, std.dev.: 0.0165) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.60% (0.1032 => 0.1162, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.57% (0.1337 => 0.1505, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.54% (0.1236 => 0.1391, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.47% (0.1940 => 0.2182, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 12.43% (0.1175 => 0.1321, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 12.38% (0.7433 => 0.8353, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 12.35% (8.1363 => 9.1412, std.dev.: 0.0103) MultiSource/Benchmarks/nbench/nbench: 12.32% (1.1840 => 1.3299, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 12.30% (0.0886 => 0.0995, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/matrix: 12.22% (0.0818 => 0.0918, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 12.20% (0.6450 => 0.7237, std.dev.: 0.0046) MultiSource/Applications/lemon/lemon: 12.17% (1.0722 => 1.2027, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 12.08% (5.7591 => 6.4549, std.dev.: 0.0076) MultiSource/Applications/treecc/treecc: 12.05% (2.0273 => 2.2716, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.04% (0.1695 => 0.1899, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 11.99% (0.1151 => 0.1289, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 11.95% (0.3473 => 0.3888, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.91% (0.5860 => 0.6558, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/neural/neural: 11.89% (0.1463 => 0.1637, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions-4: 11.88% (0.3543 => 0.3964, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.85% (0.3307 => 0.3699, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 11.84% (0.7835 => 0.8763, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/for-in: 11.83% (0.3694 => 0.4131, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 11.79% (0.0933 => 0.1043, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.72% (0.3497 => 0.3907, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 11.72% (0.3516 => 0.3928, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.72% (0.9765 => 1.0909, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.71% (0.3543 => 0.3958, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 11.71% (0.3561 => 0.3978, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 11.69% (0.3387 => 0.3783, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.66% (0.3927 => 0.4385, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 11.65% (3.8723 => 4.3235, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.63% (0.1625 => 0.1814, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 11.58% (0.1555 => 0.1735, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/exceptions: 11.52% (0.3828 => 0.4269, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.52% (0.0929 => 0.1036, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/rem: 11.45% (0.1144 => 0.1275, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.44% (0.2700 => 0.3009, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.44% (4.9449 => 5.5108, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/property: 11.43% (0.3886 => 0.4330, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.41% (5.0018 => 5.5724, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.34% (0.2107 => 0.2346, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.31% (0.3121 => 0.3474, std.dev.: 0.0019) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.29% (0.1143 => 0.1272) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.26% (0.8172 => 0.9092, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.17% (1.5859 => 1.7630, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.15% (1.1861 => 1.3184, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.13% (0.1330 => 0.1478, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 11.10% (0.1117 => 0.1241, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.08% (0.8067 => 0.8961, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.06% (0.2758 => 0.3063, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/football/football: 10.97% (0.8921 => 0.9900, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 10.95% (0.6456 => 0.7163, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.90% (7.9617 => 8.8298, std.dev.: 0.0210) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.88% (0.1029 => 0.1141, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.80% (0.3177 => 0.3520, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.78% (0.4879 => 0.5405, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.76% (0.1125 => 0.1246, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.64% (0.1062 => 0.1175, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.64% (0.1438 => 0.1591, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.61% (2.2024 => 2.4361, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.59% (0.5569 => 0.6159, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/05-eks/eks: 10.54% (0.4299 => 0.4752, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 10.27% (2.2969 => 2.5329, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.24% (1.4186 => 1.5639, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: 10.16% (1.5603 => 1.7188, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.07% (0.2603 => 0.2865, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 10.06% (0.4620 => 0.5085, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 10.05% (0.4289 => 0.4720, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.98% (0.3826 => 0.4208, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.88% (0.2065 => 0.2269, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 9.87% (0.3180 => 0.3494, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 9.86% (0.1268 => 0.1393, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 9.79% (0.3422 => 0.3757, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.71% (0.2266 => 0.2486, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.59% (0.3441 => 0.3771, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.57% (0.3865 => 0.4235, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.47% (0.4203 => 0.4601, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 9.37% (0.2049 => 0.2241, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.31% (0.4103 => 0.4485, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 9.15% (21.9371 => 23.9442, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/lists1: 9.12% (0.3684 => 0.4020, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 9.12% (0.4048 => 0.4417, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 9.06% (0.5925 => 0.6462, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.00% (0.6030 => 0.6573, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.93% (0.4636 => 0.5050, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.88% (0.5981 => 0.6512, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 8.52% (0.3603 => 0.3910, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.51% (0.1892 => 0.2053, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.49% (0.7326 => 0.7948, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.41% (0.3650 => 0.3957, std.dev.: 0.0045) SingleSource/Regression/C++/ofstream_ctor: 8.19% (0.2905 => 0.3143, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.18% (0.1906 => 0.2062, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.17% (0.3427 => 0.3707, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 8.01% (0.3098 => 0.3346, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.97% (0.4064 => 0.4388, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.94% (0.3136 => 0.3385, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 7.91% (0.2831 => 0.3055, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.71% (0.2891 => 0.3114, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.61% (2.0665 => 2.2238, std.dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: 7.61% (17.1811 => 18.4881, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/ary3: 7.55% (0.3283 => 0.3531, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 7.55% (0.3232 => 0.3476, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.54% (0.8101 => 0.8712, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.53% (0.3162 => 0.3400, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.52% (0.2872 => 0.3088, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.47% (0.2877 => 0.3092, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.34% (14.3668 => 15.4218, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.30% (0.2793 => 0.2997, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.26% (0.2756 => 0.2956, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 7.19% (0.3379 => 0.3622, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.18% (0.2871 => 0.3077, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 7.16% (0.2725 => 0.2920, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 7.10% (0.2802 => 0.3001, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 7.08% (0.3052 => 0.3268, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.92% (3.8922 => 4.1616, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 6.74% (0.2714 => 0.2897, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 6.38% (1.2842 => 1.3661, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 6.16% (0.3131 => 0.3324, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/bh/bh: 5.85% (0.3092 => 0.3273, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.64% (0.2430 => 0.2567, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.11% (0.3817 => 0.3974, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.35% (0.3935 => 0.4067, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.55% (1.1194 => 1.1480, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.56% (1.1145 => 1.2991, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 11.10% (0.9957 => 1.1062, std.dev.: 0.0140) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9648, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.96% (1.1396 => 1.2531, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.70% (3.1578 => 3.3693, std.dev.: 0.0054) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.68% (4.2280 => 4.3411, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.35% (1.7254 => 1.7659, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.78% (0.8333 => 0.8481, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.75% (3.6395 => 3.7032, std.dev.: 0.0124) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2076, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.45% (2.6546 => 2.6931, std.dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 1.14% (11.6436 => 11.7762, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1312, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -79.96% (0.8651 => 0.1734, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.18% (5.2763 => 3.2619, std.dev.: 0.0119) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.31% (5.3855 => 3.6992, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.88% (5.3526 => 3.6995, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -14.69% (54.1659 => 46.2073, std.dev.: 0.0153) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.60% (2.9384 => 2.6268, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -7.36% (22.1758 => 20.5427, std.dev.: 0.0256) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.38% (1.1492 => 0.7656, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4248, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852) SingleSource/Benchmarks/McGill/chomp: -11.56% (1.2373 => 1.0943, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3453 => 2.9599, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -10.74% (1.5373 => 1.3722, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.48% (19.9488 => 18.2568, std.dev.: 0.0191) MultiSource/Benchmarks/FreeBench/mason/mason: -8.01% (0.2161 => 0.1988, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.03% (1.8329 => 1.7041, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.64% (1.9577 => 1.8473, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5758, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.53% (1.6805 => 1.5876, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.88% (1.5835 => 1.5062, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -3.39% (5.0483 => 4.8773, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.37% (3.2827 => 3.1721, std.dev.: 0.0102) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5011, std.dev.: 0.0050) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.62% (0.4808 => 0.4682, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -1.95% (10.2830 => 10.0823, std.dev.: 0.0163) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.93% (8.1563 => 7.9987, std.dev.: 0.0156) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6792, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: -1.67% (4.6441 => 4.5664, std.dev.: 0.0017) SingleSource/UnitTests/Vector/multiplies: -1.67% (2.5528 => 2.5102, std.dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4208, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2878, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8597, std.dev.: 0.0050) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 16.94% (0.5229 => 0.6115, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 14.54% (14.9895 => 17.1694, std.dev.: 0.0074) MultiSource/Benchmarks/MallocBench/gs/gs: 10.25% (4.1105 => 4.5320, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 16.65% (1.1048 => 1.2887, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.10% (7.1582 => 8.1674, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.75% (0.6222 => 0.7762, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36400.00% (0.0001 => 0.0365, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: -3.70% (0.1485 => 0.1430) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.95% (0.2116 => 0.2136, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 17 16:18:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 17 Oct 2012 18:18:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121017231857.7A6E82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4942?compare_to=4939&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4942, Order: 166129, Start Time: 2012-10-17 21:55:55, End Time: 2012-10-17 23:21:51 To: 4939, Order: 166118, Start Time: 2012-10-17 20:00:27, End Time: 2012-10-17 21:26:21 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (190 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1042 (676 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.19% (2.0176 => 2.4854, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.94% (0.1410 => 0.1677, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 17.43% (0.0826 => 0.0970, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.00% (0.0653 => 0.0764, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 16.90% (0.2243 => 0.2622, std.dev.: 0.0007) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.46% (0.1072 => 0.1227, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 14.42% (1.3693 => 1.5667, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 14.41% (0.1013 => 0.1159, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.94% (0.1327 => 0.1512, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.91% (0.0834 => 0.0950, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 13.79% (0.4328 => 0.4925, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 13.75% (0.7038 => 0.8006, std.dev.: 0.0112) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.66% (0.1413 => 0.1606, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 13.44% (0.4062 => 0.4608, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.13% (0.3899 => 0.4411, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.07% (0.0964 => 0.1090) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.90% (3.9660 => 4.4777, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.90% (0.2721 => 0.3072, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.78% (0.1588 => 0.1791, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.70% (0.6283 => 0.7081, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.67% (1.4563 => 1.6408, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 12.54% (13.8202 => 15.5528, std.dev.: 0.0123) SingleSource/Regression/C++/ofstream_ctor: 12.51% (0.2781 => 0.3129, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.48% (0.2596 => 0.2920, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.44% (0.5265 => 0.5920, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 12.42% (0.3485 => 0.3918, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.22% (0.9199 => 1.0323, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.21% (0.6959 => 0.7809, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 12.18% (0.3022 => 0.3390) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.18% (0.4016 => 0.4505, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 12.14% (0.3756 => 0.4212, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.13% (0.7710 => 0.8645, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 12.11% (0.2782 => 0.3119, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 12.05% (0.1062 => 0.1190, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.01% (1.2193 => 1.3657, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.95% (1.1364 => 1.2722, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 11.93% (0.3293 => 0.3686, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.91% (0.4390 => 0.4913, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 11.90% (0.3453 => 0.3864, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 11.89% (0.3868 => 0.4328, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 11.86% (0.1003 => 0.1122, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 11.85% (0.2726 => 0.3049, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.84% (0.3580 => 0.4004, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 11.80% (0.2966 => 0.3316, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 11.78% (0.3489 => 0.3900, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 11.77% (0.2761 => 0.3086) MultiSource/Benchmarks/Prolangs-C++/city/city: 11.74% (1.9828 => 2.2156, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.71% (0.2655 => 0.2966, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 11.67% (0.2760 => 0.3082, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 11.65% (0.3149 => 0.3516, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 11.62% (0.2607 => 0.2910, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 11.62% (0.3107 => 0.3468, std.dev.: 0.0079) MultiSource/Applications/lemon/lemon: 11.62% (1.0313 => 1.1511, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.61% (0.4791 => 0.5347, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/random: 11.60% (0.2690 => 0.3002, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 11.58% (0.2937 => 0.3277, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 11.45% (0.2628 => 0.2929, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 11.43% (0.2765 => 0.3081, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 11.36% (0.5818 => 0.6479, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 11.32% (0.3534 => 0.3934, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 11.31% (0.3192 => 0.3553, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 11.26% (1.1061 => 1.2307, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.26% (0.5577 => 0.6205, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.24% (0.1157 => 0.1287, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.21% (0.3130 => 0.3481, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 11.13% (0.5748 => 0.6388, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 11.04% (0.2988 => 0.3318, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 11.02% (0.2696 => 0.2993, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.98% (0.8698 => 0.9653, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 10.93% (0.7061 => 0.7833, std.dev.: 0.0083) MultiSource/Applications/kimwitu++/kc: 10.93% (16.6129 => 18.4281, std.dev.: 0.0201) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.88% (0.1075 => 0.1192, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 10.80% (0.1111 => 0.1231, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 10.77% (0.6744 => 0.7470, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 10.75% (0.2995 => 0.3317, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.74% (0.1276 => 0.1413, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.73% (0.4379 => 0.4849, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 10.70% (0.1589 => 0.1759, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.69% (0.3246 => 0.3593, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 10.67% (2.1791 => 2.4116, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 10.54% (1.9270 => 2.1301, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 10.53% (0.2945 => 0.3255, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 10.50% (3.8646 => 4.2705, std.dev.: 0.0063) MultiSource/Applications/d/make_dparser: 10.49% (3.1889 => 3.5233, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.47% (0.3755 => 0.4148, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.45% (0.1569 => 0.1733, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.44% (0.0977 => 0.1079, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.44% (0.2127 => 0.2349, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 10.43% (0.3220 => 0.3556, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 10.42% (0.1478 => 0.1632, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.40% (0.2914 => 0.3217, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.39% (0.7460 => 0.8235, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.32% (0.1986 => 0.2191, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/09-vor/vor: 10.26% (0.2925 => 0.3225, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.26% (0.1014 => 0.1118, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 10.25% (0.8310 => 0.9162, std.dev.: 0.0021) MultiSource/Applications/spiff/spiff: 10.19% (0.7506 => 0.8271, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.19% (0.1865 => 0.2055, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.04% (4.9865 => 5.4870, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.99% (7.2180 => 7.9390, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.93% (0.5637 => 0.6197, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.90% (0.1435 => 0.1577, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.89% (0.2023 => 0.2223, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 9.86% (1.0594 => 1.1639, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 9.54% (0.1657 => 0.1815) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.37% (1.3245 => 1.4486, std.dev.: 0.0018) MultiSource/Benchmarks/sim/sim: 9.36% (0.3131 => 0.3424, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 9.33% (0.6250 => 0.6833, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.17% (4.3801 => 4.7816, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.12% (3.6692 => 4.0037, std.dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: 9.06% (14.8535 => 16.1987, std.dev.: 0.0126) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.03% (4.4433 => 4.8445, std.dev.: 0.0083) MultiSource/Applications/SIBsim4/SIBsim4: 9.02% (1.2749 => 1.3899, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 8.86% (8.4961 => 9.2487, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.83% (0.6135 => 0.6677, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 8.74% (4.6629 => 5.0704, std.dev.: 0.0149) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.72% (1.5188 => 1.6513, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/05-eks/eks: 8.70% (0.4113 => 0.4471, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.64% (0.2140 => 0.2325, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.62% (0.8818 => 0.9578, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.55% (0.6576 => 0.7138, std.dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 8.44% (1.2292 => 1.3329, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.39% (3.2742 => 3.5490, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.38% (0.1789 => 0.1939, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 8.32% (0.4003 => 0.4336, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.32% (0.3511 => 0.3803, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.25% (2.1007 => 2.2740, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.18% (0.9108 => 0.9853, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 8.16% (3.7467 => 4.0524, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1385 => 0.1498, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.15% (1.1333 => 1.2257, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.14% (0.2321 => 0.2510, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.10% (0.3245 => 0.3508, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 8.10% (0.3914 => 0.4231, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.07% (0.3940 => 0.4258, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.05% (0.4805 => 0.5192, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 7.99% (0.3578 => 0.3864, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.97% (0.3789 => 0.4091, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.90% (0.3646 => 0.3934, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.89% (0.3663 => 0.3952, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.86% (0.3601 => 0.3884, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 7.82% (6.5754 => 7.0898, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.81% (0.3650 => 0.3935, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 7.70% (0.3623 => 0.3902, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 7.67% (0.2008 => 0.2162, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.67% (0.2504 => 0.2696, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.37% (6.2785 => 6.7411, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.37% (0.1819 => 0.1953, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.16% (13.2842 => 14.2348, std.dev.: 0.0242) MultiSource/Applications/sqlite3/sqlite3: 5.93% (16.2614 => 17.2254, std.dev.: 0.0174) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.39% (0.2243 => 0.2364, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 4.78% (14.5298 => 15.2249, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/bh/bh: 3.67% (0.2859 => 0.2964, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 2.72% (33.2944 => 34.1996, std.dev.: 0.0082) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.62% (5.7573 => 7.5201, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 24.34% (1.8175 => 2.2598, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.08% (1.0895 => 1.2756, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: 11.20% (1.1560 => 1.2855, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4138, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 5.62% (1.2998 => 1.3729, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.43% (0.9692 => 1.0218) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0006, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0051, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 4.46% (0.5449 => 0.5692, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.97% (1.7081 => 1.7759, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.74% (11.2619 => 11.6827, std.dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 3.38% (12.0921 => 12.5005, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.32% (1.9199 => 1.9837, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 2.93% (10.7476 => 11.0630, std.dev.: 0.0205) MultiSource/Benchmarks/Olden/bisort/bisort: 2.93% (0.8239 => 0.8480, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.15% (7.4271 => 7.5865, std.dev.: 0.0083) MultiSource/Applications/lemon/lemon: 1.74% (1.4298 => 1.4547, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.49% (8.3908 => 8.5156, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2126, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.24% (1.9433 => 1.9673, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1879, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.22% (8.8259 => 8.9336, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/oourafft: 1.20% (5.5130 => 5.5790, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 1.07% (12.4560 => 12.5896, std.dev.: 0.0062) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.82% (0.2670 => 0.1420, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.31% (0.4657 => 0.3944, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.02% (1.3813 => 1.2014, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.97% (1.3819 => 1.2027, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.27% (1.0460 => 0.8549, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/mason/mason: -13.00% (0.2238 => 0.1947, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.24% (20.3410 => 18.2583, std.dev.: 0.0189) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.97% (1.3780 => 1.2958, std.dev.: 0.0068) SingleSource/Benchmarks/McGill/chomp: -5.69% (1.2308 => 1.1608, std.dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5147, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.82% (0.9996 => 0.9514, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.86% (1.7688 => 1.7006, std.dev.: 0.0046) MultiSource/Applications/siod/siod: -3.28% (3.2729 => 3.1656, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.75% (3.0263 => 2.9430, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8811, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.37% (1.9762 => 1.9294, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Applications/lua/lua: -2.03% (26.5159 => 25.9788, std.dev.: 0.0374) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.99% (0.8342 => 0.8176, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.97% (0.6589 => 0.6459, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.86% (0.6615 => 0.6492, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.69% (6.3560 => 6.2484, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.62% (2.5254 => 2.4844, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0076, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.29% (5.3167 => 5.2481, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: -1.19% (28.2225 => 27.8870, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/heapsort: -1.12% (3.9173 => 3.8734, std.dev.: 0.0005) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1138, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -1.05% (84.4286 => 83.5382, std.dev.: 0.0100) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 17 17:17:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 17 Oct 2012 19:17:58 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121018001758.A80952A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4943?compare_to=4937&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 4943, Order: 166130, Start Time: 2012-10-17 22:55:06, End Time: 2012-10-18 00:19:57 To: 4937, Order: 166118, Start Time: 2012-10-17 19:33:22, End Time: 2012-10-17 20:57:43 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== Performance Regressions: 14 (13 on baseline) Performance Improvements: 1 (1 on baseline) Existing Failures: 68 (68 on baseline) Unchanged Tests: 959 (960 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.00% (0.4661 => 0.4894, std.dev.: 0.0036) MultiSource/Applications/Burg/burg: 2.35% (1.2085 => 1.2369, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.29% (0.8645 => 0.8843, std.dev.: 0.0053) MultiSource/Applications/d/make_dparser: 1.31% (3.2330 => 3.2752, std.dev.: 0.0118) SingleSource/UnitTests/Vector/constpool: 1.22% (8.6006 => 8.7053, std.dev.: 0.0178) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: 17.63% (3.1748 => 3.7345, std.dev.: 0.0400) SingleSource/Benchmarks/Shootout/heapsort: 12.61% (3.2246 => 3.6313, std.dev.: 0.0798) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.81% (14.5230 => 15.8032, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.23% (5.1631 => 5.3298, std.dev.: 0.0148) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.54% (2.6851 => 2.7533, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/except: 2.49% (0.4890 => 0.5012, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 1.63% (0.7747 => 0.7873, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary3: 1.35% (2.0026 => 2.0297, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.12% (2.9425 => 2.9754, std.dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -2.40% (1.4777 => 1.4423, std.dev.: 0.0074) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.73% (16.5141 => 16.3929, std.dev.: 0.1525) MultiSource/Applications/obsequi/Obsequi: -1.57% (1.0378 => 1.0215, std.dev.: 0.0076) MultiSource/Applications/sqlite3/sqlite3: 1.05% (0.6270 => 0.6336, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: -0.05% (0.1891 => 0.1890, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.31% (0.1636 => 0.1641, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.63% (0.3194 => 0.3174, std.dev.: 0.0105) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.04% (0.2451 => 0.2452, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.44% (0.3265 => 0.3312, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.38% (0.2391 => 0.2334, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/bigfib: 0.49% (0.5934 => 0.5963, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/mandel: -5.67% (0.0476 => 0.0449, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.3288 => 0.3288, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/strcat: -0.20% (0.1968 => 0.1964, std.dev.: 0.0033) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 19.40% (0.0201 => 0.0240, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -18.72% (0.0203 => 0.0165, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.73% (0.0411 => 0.0414, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 6.85% (0.0292 => 0.0312, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -8.88% (0.0304 => 0.0277, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -5.16% (0.0407 => 0.0386, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/casts: 0.52% (0.0192 => 0.0193, std.dev.: 0.0047) SingleSource/UnitTests/Vector/Altivec/test1: -2.40% (0.0208 => 0.0203, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -2.17% (0.0322 => 0.0315, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -38.46% (0.0013 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.21% (0.1453 => 0.1456, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -4.49% (1.1737 => 1.1210, std.dev.: 0.0361) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.27% (0.1471 => 0.1467, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.81% (0.4161 => 0.4044, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.36% (0.1399 => 0.1418, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -12.50% (0.0008 => 0.0007, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: - (0.0649 => 0.0649, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.36% (0.0276 => 0.0275, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.72% (0.0558 => 0.0554, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.01% (1.1440 => 1.1441, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 72.22% (0.0018 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 271.43% (0.0007 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.16% (0.0628 => 0.0629, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0267 => 0.0267, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.44% (0.8019 => 0.8054, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 0.05% (2.1561 => 2.1571, std.dev.: 0.0104) SingleSource/UnitTests/2003-07-10-SignConversions: -66.67% (0.0003 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -51.28% (0.0078 => 0.0038, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 3.41% (8.4179 => 8.7053, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.86% (0.8597 => 0.8843, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.61% (0.8340 => 0.8474, std.dev.: 0.0022) MultiSource/Applications/Burg/burg: 1.20% (1.2222 => 1.2369, std.dev.: 0.0054) MultiSource/Applications/d/make_dparser: 1.19% (3.2366 => 3.2752, std.dev.: 0.0118) MultiSource/Applications/SIBsim4/SIBsim4: 1.11% (1.2568 => 1.2708, std.dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: 22.38% (3.0515 => 3.7345, std.dev.: 0.0400) SingleSource/Benchmarks/Shootout/heapsort: 10.29% (3.2926 => 3.6313, std.dev.: 0.0798) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.82% (0.3186 => 0.3499, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.91% (14.6451 => 15.8032, std.dev.: 0.0135) SingleSource/Benchmarks/CoyoteBench/lpbench: 4.71% (3.9006 => 4.0843, std.dev.: 0.0703) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.63% (0.7597 => 0.7873, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary3: 1.49% (1.9999 => 2.0297, std.dev.: 0.0068) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/ffbench: -1.43% (1.4296 => 1.4091, std.dev.: 0.0077) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.32% (16.4461 => 16.3929, std.dev.: 0.1525) MultiSource/Applications/obsequi/Obsequi: -0.46% (1.0262 => 1.0215, std.dev.: 0.0076) MultiSource/Applications/sqlite3/sqlite3: 0.06% (0.6332 => 0.6336, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: 3.22% (0.1831 => 0.1890, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.26% (0.1559 => 0.1641, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.63% (0.3123 => 0.3174, std.dev.: 0.0105) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.45% (0.2463 => 0.2452, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.96% (0.3344 => 0.3312, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.27% (0.2364 => 0.2334, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/bigfib: -0.78% (0.6010 => 0.5963, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/mandel: 4.66% (0.0429 => 0.0449, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.67% (0.3266 => 0.3288, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/strcat: -0.25% (0.1969 => 0.1964, std.dev.: 0.0033) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.14% (0.0224 => 0.0240, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 34.15% (0.0123 => 0.0165, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.47% (0.0408 => 0.0414, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 22.83% (0.0254 => 0.0312, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -8.28% (0.0302 => 0.0277, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.52% (0.0384 => 0.0386, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/casts: 1.58% (0.0190 => 0.0193, std.dev.: 0.0047) SingleSource/UnitTests/Vector/Altivec/test1: 12.78% (0.0180 => 0.0203, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: 36.96% (0.0230 => 0.0315, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 14.29% (0.0007 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.25% (0.1438 => 0.1456, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.05% (1.1329 => 1.1210, std.dev.: 0.0361) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.34% (0.1462 => 0.1467, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.88% (0.4164 => 0.4044, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.58% (0.1369 => 0.1418, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -12.50% (0.0008 => 0.0007, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.25% (0.0641 => 0.0649, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.03% (0.0195 => 0.0275, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.15% (0.0578 => 0.0554, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.03% (1.1437 => 1.1441, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.32% (0.0627 => 0.0629, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.33% (0.0180 => 0.0267, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.46% (0.8017 => 0.8054, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: -1.20% (2.1832 => 2.1571, std.dev.: 0.0104) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -38.71% (0.0062 => 0.0038, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 0.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 17 17:39:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 17 Oct 2012 19:39:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121018003901.8936D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4944?compare_to=4941&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4944, Order: 166135, Start Time: 2012-10-17 23:20:39, End Time: 2012-10-18 00:40:56 To: 4941, Order: 166125, Start Time: 2012-10-17 21:30:27, End Time: 2012-10-17 22:50:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (75 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (177 on baseline) Performance Improvements: 1 (41 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 90 (15 on baseline) Unchanged Tests: 950 (668 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.72% (54.4246 => 56.4517, std.dev.: 0.0996) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.45% (15.8736 => 15.6438, std.dev.: 0.0047) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.29% (0.6115 => 0.6097, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: -0.18% (17.1694 => 17.1390, std.dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: -0.43% (56.3057 => 56.0626, std.dev.: 0.0396) MultiSource/Benchmarks/MallocBench/gs/gs: -0.68% (4.5320 => 4.5011, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.64% (0.0469 => 0.0466, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.85% (0.0471 => 0.0467, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.68% (0.0438 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.68% (0.0440 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.70% (0.0427 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.70% (0.0428 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.24% (0.0420 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.71% (0.0422 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.68% (0.0439 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.68% (0.0440 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.15% (0.0434 => 0.0429, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.46% (0.0434 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.94% (0.0424 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.71% (0.0425 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.70% (0.0430 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.69% (0.0432 => 0.0429, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.45% (0.0440 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.68% (0.0443 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.72% (0.0418 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.48% (0.0418 => 0.0416) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.23% (0.0430 => 0.0429, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.70% (0.0431 => 0.0428, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.95% (0.0422 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.71% (0.0422 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.73% (0.0413 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.48% (0.0414 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.73% (0.0413 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.73% (0.0413 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.67% (0.0450 => 0.0447) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.44% (0.0451 => 0.0449, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.73% (0.0411 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.73% (0.0412 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.49% (0.0412 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.48% (0.0414 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.48% (0.0420 => 0.0418, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.71% (0.0421 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.13% (1.2887 => 1.2870, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.27% (8.1674 => 8.1895, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.04% (0.7762 => 0.7759, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0365 => 0.0365, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1430 => 0.1430) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 0.06% (0.1641 => 0.1642, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.05% (0.2136 => 0.2137, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.35% (63.2438 => 56.0626, std.dev.: 0.0396) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 0.18% (0.1639 => 0.1642, std.dev.: 0.0000) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 35.64% (14.1553 => 19.2006, std.dev.: 0.0182) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.38% (3.4629 => 5.7617, std.dev.: 0.0008) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13402.22% (0.0720 => 9.7216, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9973200.00% (0.0001 => 9.9733, std.dev.: 0.0013) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 62.18% (0.2554 => 0.4142, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 50.90% (10.3673 => 15.6438, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/richards_benchmark: 36.37% (0.1622 => 0.2212, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/distray/distray: 35.70% (0.1056 => 0.1433, std.dev.: 0.0001) SingleSource/UnitTests/vla: 29.30% (0.0355 => 0.0459, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 21.46% (0.0834 => 0.1013, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.79% (2.2022 => 2.6159, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.64% (7.0540 => 8.3691, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/flops: 18.16% (0.1432 => 0.1692, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.99% (0.1566 => 0.1832, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 16.89% (0.5105 => 0.5967, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 16.79% (0.6675 => 0.7796, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.76% (0.0871 => 0.1017, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 15.53% (0.1655 => 0.1912, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 15.44% (3.3354 => 3.8504, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 14.72% (0.3282 => 0.3765, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.52% (0.5020 => 0.5749, std.dev.: 0.0022) MultiSource/Applications/minisat/minisat: 14.13% (0.7115 => 0.8120, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.99% (1.7609 => 2.0073, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.77% (1.5415 => 1.7537, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/power/power: 13.75% (0.1440 => 0.1638, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 13.70% (10.4361 => 11.8661, std.dev.: 0.0104) MultiSource/Benchmarks/mafft/pairlocalalign: 13.67% (9.4845 => 10.7812, std.dev.: 0.0166) MultiSource/Applications/sgefa/sgefa: 13.38% (0.3109 => 0.3525, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.38% (0.1510 => 0.1712, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.08% (0.2271 => 0.2568, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 13.01% (0.1584 => 0.1790, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.97% (1.3050 => 1.4743, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/em3d/em3d: 12.92% (0.1695 => 0.1914, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 12.74% (0.3423 => 0.3859, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.72% (0.4615 => 0.5202, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.70% (4.2646 => 4.8063, std.dev.: 0.0130) MultiSource/Benchmarks/Olden/tsp/tsp: 12.51% (0.1175 => 0.1322, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.40% (0.1032 => 0.1160) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 12.38% (8.1363 => 9.1435, std.dev.: 0.0074) MultiSource/Benchmarks/nbench/nbench: 12.36% (1.1840 => 1.3303, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: 12.35% (0.0818 => 0.0919, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 12.12% (0.1163 => 0.1304, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.12% (0.1337 => 0.1499, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 12.09% (0.6450 => 0.7230, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.06% (0.1940 => 0.2174, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.04% (0.1695 => 0.1899, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.03% (0.1438 => 0.1611, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 12.01% (5.7591 => 6.4506, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 12.00% (0.7433 => 0.8325, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 11.99% (1.0722 => 1.2008, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.97% (0.1236 => 0.1384, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.96% (0.5860 => 0.6561, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: 11.96% (0.1463 => 0.1638, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 11.85% (2.0273 => 2.2675, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/life/life: 11.79% (0.0933 => 0.1043, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 11.75% (0.3387 => 0.3785, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 11.74% (0.0886 => 0.0990, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 11.73% (1.1642 => 1.3008, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.64% (0.9765 => 1.0902, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.52% (0.3307 => 0.3688, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.52% (0.2700 => 0.3011, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.52% (0.0929 => 0.1036, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.45% (4.9449 => 5.5109, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.43% (5.0018 => 5.5734, std.dev.: 0.0034) MultiSource/Applications/lua/lua: 11.41% (3.8723 => 4.3143, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.40% (7.9617 => 8.8690, std.dev.: 0.0056) MultiSource/Applications/aha/aha: 11.38% (0.1151 => 0.1282, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 11.28% (0.1144 => 0.1273, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.26% (0.1625 => 0.1808, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 11.25% (0.1555 => 0.1730, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.11% (0.2107 => 0.2341, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.05% (1.5859 => 1.7612, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.05% (0.1330 => 0.1477, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.05% (0.3177 => 0.3528, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 11.04% (0.8921 => 0.9906, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 11.00% (0.7835 => 0.8697, std.dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.96% (0.3121 => 0.3463, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 10.95% (1.1861 => 1.3160, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 10.95% (0.6456 => 0.7163, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.92% (0.4879 => 0.5412, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.84% (0.1125 => 0.1247, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 10.82% (0.4299 => 0.4764, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.76% (0.8067 => 0.8935, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.66% (0.2758 => 0.3052, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.59% (0.1029 => 0.1138, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.53% (0.3543 => 0.3916, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.52% (2.2024 => 2.4341, std.dev.: 0.0181) SingleSource/UnitTests/ObjC/trivial-interface: 10.51% (0.3473 => 0.3838, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.47% (0.1117 => 0.1234, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions-4: 10.44% (0.3543 => 0.3913, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions: 10.42% (0.3828 => 0.4227, std.dev.: 0.0087) SingleSource/UnitTests/ObjC/for-in: 10.42% (0.3694 => 0.4079, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.36% (0.3927 => 0.4334, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.36% (0.3561 => 0.3930, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.35% (0.3516 => 0.3880, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.35% (0.3497 => 0.3859, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.32% (0.8172 => 0.9015, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.31% (1.4186 => 1.5649, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.26% (0.1062 => 0.1171, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.19% (0.2266 => 0.2497, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.16% (0.5569 => 0.6135, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.14% (0.3886 => 0.4280, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 10.07% (0.4289 => 0.4721, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash2: 9.98% (0.4620 => 0.5081, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 9.97% (1.5603 => 1.7158, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 9.87% (0.2603 => 0.2860, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: 9.81% (0.2049 => 0.2250, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 9.76% (2.2969 => 2.5210, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.67% (0.3826 => 0.4196, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 9.64% (0.3422 => 0.3752, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/health/health: 9.54% (0.1268 => 0.1389, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.49% (0.4636 => 0.5076, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.47% (0.3865 => 0.4231, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 9.47% (0.3180 => 0.3481, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 9.43% (21.9371 => 24.0062, std.dev.: 0.0200) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.33% (0.4203 => 0.4595, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.24% (0.3441 => 0.3759, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.21% (0.4103 => 0.4481, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.20% (0.2065 => 0.2255, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: 9.09% (0.4048 => 0.4416, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 9.04% (0.3684 => 0.4017, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.66% (0.5981 => 0.6499, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 8.41% (0.3603 => 0.3906, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 8.37% (0.5925 => 0.6421, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference-object: 8.33% (0.6030 => 0.6532, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.25% (0.1892 => 0.2048, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.13% (0.1906 => 0.2061, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.00% (0.3650 => 0.3942, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.85% (0.3427 => 0.3696, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 7.81% (0.3098 => 0.3340, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.81% (0.2831 => 0.3052, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.77% (0.3232 => 0.3483, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.75% (0.4064 => 0.4379, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 7.74% (0.7326 => 0.7893, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 7.72% (17.1811 => 18.5069, std.dev.: 0.0332) SingleSource/Regression/C++/ofstream_ctor: 7.71% (0.2905 => 0.3129, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.68% (0.3136 => 0.3377, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 7.65% (0.3283 => 0.3534, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.51% (0.2891 => 0.3108, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.50% (0.3162 => 0.3399, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.36% (2.0665 => 2.2185, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.31% (0.2872 => 0.3082, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 7.21% (0.2871 => 0.3078, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.20% (0.8101 => 0.8684, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 7.13% (0.2877 => 0.3082, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.08% (0.2725 => 0.2918, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.07% (14.3668 => 15.3822, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.04% (0.2756 => 0.2950, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.02% (0.2793 => 0.2989, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.01% (0.3052 => 0.3266, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.96% (3.8922 => 4.1632, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 6.90% (0.3379 => 0.3612, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.89% (0.2714 => 0.2901, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.82% (0.2802 => 0.2993, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 6.15% (1.2842 => 1.3632, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.94% (0.3131 => 0.3317, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 5.76% (0.3092 => 0.3270, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.35% (0.2430 => 0.2560, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.13% (0.3935 => 0.4058, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.10% (1.1194 => 1.1541, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.83% (0.3817 => 0.3925, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.51% (1.1145 => 1.2985, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 10.39% (0.9957 => 1.0992, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/richards_benchmark: 9.97% (1.1396 => 1.2532, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.11% (0.9540 => 1.0218) SingleSource/Benchmarks/Shootout-C++/hash2: 6.64% (3.1578 => 3.3674, std.dev.: 0.0030) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.77% (4.2280 => 4.3453, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.87% (3.6395 => 3.7075, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/bisort/bisort: 1.80% (0.8333 => 0.8483, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.53% (2.6546 => 2.6953, std.dev.: 0.0021) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2079, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.14% (11.6436 => 11.7760, std.dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.03% (6.6874 => 0.1315, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -79.96% (0.8651 => 0.1734, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.95% (5.2763 => 3.2738, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.01% (5.3855 => 3.7152, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.37% (5.3526 => 3.7270, std.dev.: 0.0048) SingleSource/UnitTests/Vector/constpool: -14.71% (54.1659 => 46.1974, std.dev.: 0.0328) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.31% (2.9384 => 2.6354, std.dev.: 0.0145) MultiSource/Applications/ClamAV/clamscan: -7.27% (22.1758 => 20.5643, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.53% (1.1492 => 0.7639, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: -15.95% (1.6925 => 1.4225, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.53% (0.0998 => 0.0853) SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3453 => 2.9600, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.48% (1.2373 => 1.0952, std.dev.: 0.0210) SingleSource/Benchmarks/Misc/mandel-2: -10.79% (1.5373 => 1.3715, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.14% (19.9488 => 18.3245, std.dev.: 0.1010) MultiSource/Benchmarks/FreeBench/mason/mason: -7.96% (0.2161 => 0.1989, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.10% (1.8329 => 1.7028, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.56% (1.6805 => 1.5870, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5084, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169, std.dev.: 0.0008) MultiSource/Applications/siod/siod: -3.40% (3.2827 => 3.1712, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8776, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5066, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.50% (0.4808 => 0.4688, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.17% (8.1563 => 7.9794, std.dev.: 0.0222) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.80% (10.2830 => 10.0974, std.dev.: 0.0151) SingleSource/UnitTests/Vector/multiplies: -1.72% (2.5528 => 2.5088, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6822, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -1.70% (4.6441 => 4.5652, std.dev.: 0.0039) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4231, std.dev.: 0.0077) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2879, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8587, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 16.60% (0.5229 => 0.6097, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 14.34% (14.9895 => 17.1390, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: 9.50% (4.1105 => 4.5011, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 16.49% (1.1048 => 1.2870, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.41% (7.1582 => 8.1895, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.70% (0.6222 => 0.7759, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36400.00% (0.0001 => 0.0365, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.70% (0.1485 => 0.1430) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.99% (0.2116 => 0.2137, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 17 18:13:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 17 Oct 2012 20:13:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121018011325.C51D22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4945?compare_to=4936&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 4945, Order: 166125, Start Time: 2012-10-17 21:58:21, End Time: 2012-10-18 01:15:23 To: 4936, Order: 166105, Start Time: 2012-10-17 17:18:07, End Time: 2012-10-17 20:35:40 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (138 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1040 (752 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 7.19% (0.2086 => 0.2236, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.97% (129.4001 => 124.2643, std.dev.: 1.4659) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: 11.40% (0.3446 => 0.3839, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.40% (0.3465 => 0.3860, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/for-in: 11.36% (0.3496 => 0.3893, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.32% (0.3488 => 0.3883, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 11.30% (0.3442 => 0.3831, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.27% (0.3460 => 0.3850, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.27% (0.3469 => 0.3860, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.10% (0.3650 => 0.4055, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.90% (0.3643 => 0.4040, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.71% (0.3724 => 0.4123, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.25% (0.1063 => 0.1172, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 8.88% (1.5932 => 1.7346, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: 8.87% (0.1218 => 0.1326) MultiSource/Benchmarks/McCat/05-eks/eks: 8.59% (0.1619 => 0.1758, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.21% (0.2875 => 0.3111, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 8.07% (0.5826 => 0.6296, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.00% (0.4361 => 0.4710, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.97% (0.4994 => 0.5392, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.95% (0.3195 => 0.3449, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.90% (0.5889 => 0.6354, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.85% (0.2750 => 0.2966, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.85% (0.2738 => 0.2953, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.84% (0.1620 => 0.1747, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 7.82% (0.2725 => 0.2938, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.81% (1.6211 => 1.7477, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.78% (0.5000 => 0.5389, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hello: 7.77% (0.2714 => 0.2925, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.77% (0.2729 => 0.2941, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.74% (0.2792 => 0.3008, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 7.72% (0.2823 => 0.3041, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.69% (0.3004 => 0.3235, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.69% (2.0673 => 2.2262, std.dev.: 0.0100) MultiSource/Benchmarks/nbench/nbench: 7.68% (0.2566 => 0.2763, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 7.65% (0.2811 => 0.3026, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.63% (0.2911 => 0.3133, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.61% (1.3152 => 1.4153, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/random: 7.60% (0.2803 => 0.3016, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 7.59% (0.2780 => 0.2991, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.57% (0.2813 => 0.3026, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary3: 7.56% (0.3267 => 0.3514, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.56% (0.9909 => 1.0658, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary: 7.55% (0.3258 => 0.3504, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 7.53% (5.5417 => 5.9591, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.48% (3.5627 => 3.8293, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/wc: 7.46% (0.3096 => 0.3327, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.45% (0.3060 => 0.3288, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.42% (0.3625 => 0.3894, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.38% (0.4146 => 0.4452, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.36% (0.3124 => 0.3354, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 7.36% (0.3317 => 0.3561, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.34% (2.7292 => 2.9296, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 7.32% (0.3348 => 0.3593, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.32% (0.3362 => 0.3608, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 7.30% (0.3726 => 0.3998, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.30% (0.2014 => 0.2161, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.30% (0.4139 => 0.4441, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.24% (0.2736 => 0.2934, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: 7.21% (0.3678 => 0.3943, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/lists1: 7.19% (0.3477 => 0.3727, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 7.18% (0.1421 => 0.1523, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 7.15% (0.4029 => 0.4317, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.13% (0.3282 => 0.3516, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.10% (0.4251 => 0.4553, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 7.04% (0.1505 => 0.1611, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 6.99% (0.6634 => 0.7098, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 6.99% (1.0781 => 1.1535, std.dev.: 0.0036) MultiSource/Applications/hbd/hbd: 6.98% (0.9697 => 1.0374, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.97% (0.1549 => 0.1657, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.92% (0.3930 => 0.4202, std.dev.: 0.0030) MultiSource/Benchmarks/PAQ8p/paq8p: 6.91% (0.4847 => 0.5182, std.dev.: 0.0081) SingleSource/UnitTests/ObjC++/property-reference: 6.87% (0.7171 => 0.7664, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 6.84% (23.5202 => 25.1291, std.dev.: 0.0089) MultiSource/Applications/ClamAV/clamscan: 6.84% (4.2109 => 4.4989, std.dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.83% (0.3690 => 0.3942, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.82% (0.3903 => 0.4169, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.81% (0.5900 => 0.6302, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.81% (0.3981 => 0.4252, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.77% (0.2866 => 0.3060, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.71% (4.4195 => 4.7160, std.dev.: 0.0075) MultiSource/Benchmarks/MallocBench/gs/gs: 6.69% (1.8794 => 2.0052, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.63% (0.3890 => 0.4148, std.dev.: 0.0015) MultiSource/Applications/lua/lua: 6.54% (1.4269 => 1.5202, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.51% (0.5026 => 0.5353, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.50% (0.6435 => 0.6853, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.43% (0.2969 => 0.3160, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 6.41% (0.3336 => 0.3550, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.40% (0.3845 => 0.4091, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.39% (0.2737 => 0.2912, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 6.30% (0.5012 => 0.5328, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 6.28% (2.1013 => 2.2333, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.25% (0.1968 => 0.2091, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 6.24% (0.5546 => 0.5892, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.23% (0.3084 => 0.3276, std.dev.: 0.0041) MultiSource/Applications/JM/lencod/lencod: 6.08% (4.6177 => 4.8983, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.04% (0.2068 => 0.2193, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.93% (0.3271 => 0.3465, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.93% (0.4658 => 0.4934, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.75% (0.2103 => 0.2224, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 5.69% (0.2075 => 0.2193, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.68% (1.9694 => 2.0813, std.dev.: 0.0057) MultiSource/Applications/JM/ldecod/ldecod: 5.67% (2.1653 => 2.2880, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.64% (0.2040 => 0.2155, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 5.50% (2.0346 => 2.1465, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.48% (1.9966 => 2.1060, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.47% (0.5361 => 0.5654, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.45% (0.7426 => 0.7831, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 5.38% (0.7875 => 0.8299, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.28% (4.6926 => 4.9404, std.dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 4.94% (0.2691 => 0.2824, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 4.94% (0.2391 => 0.2509, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.73% (11.6398 => 12.1904, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.58% (0.5584 => 0.5840, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 4.49% (0.3498 => 0.3655, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.60% (0.4253 => 0.4406, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 2.90% (11.9555 => 12.3028, std.dev.: 0.0107) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 10.10% (0.2802 => 0.3085, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6117, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 5.37% (0.2122 => 0.2236, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.20% (0.3693 => 0.3885, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6677, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/flops: 4.73% (15.4430 => 16.1737, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/flops-2: 4.70% (1.8057 => 1.8905, std.dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/dry: 4.19% (14.0481 => 14.6362, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1958, std.dev.: 0.0074) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.73% (3.1722 => 3.2271, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3064, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2888, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5399, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5913, std.dev.: 0.0089) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -36.20% (25.4195 => 16.2167, std.dev.: 0.1763) SingleSource/Benchmarks/Shootout-C++/ary2: -9.83% (0.2402 => 0.2166, std.dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9747, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7953, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std.dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -3.72% (11.2080 => 10.7909, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.13% (0.6293 => 0.6096, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7738, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -2.96% (17.2379 => 16.7268, std.dev.: 0.0754) SingleSource/Benchmarks/Misc/mandel-2: -2.96% (3.6262 => 3.5188, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.26% (41.7953 => 40.8493, std.dev.: 0.0085) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5737, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: -1.55% (5.5810 => 5.4947, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.53% (0.6688 => 0.6586, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.17% (105.3826 => 104.1465, std.dev.: 0.0697) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0455, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 17 18:14:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 17 Oct 2012 20:14:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121018011415.622732A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4946?compare_to=4942&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4946, Order: 166141, Start Time: 2012-10-17 23:51:19, End Time: 2012-10-18 01:17:12 To: 4942, Order: 166129, Start Time: 2012-10-17 21:55:55, End Time: 2012-10-17 23:21:51 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (187 on baseline) Performance Improvements: 3 (37 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1039 (680 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.71% (2.2156 => 2.1778, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: -1.37% (1.5667 => 1.5452, std.dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: -1.34% (1.3329 => 1.3151, std.dev.: 0.0016) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.43% (2.0176 => 2.4904, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.79% (0.1410 => 0.1675, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.92% (0.0653 => 0.0770) MultiSource/Benchmarks/McCat/08-main/main: 17.25% (0.2243 => 0.2630, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 17.19% (0.0826 => 0.0968, std.dev.: 0.0009) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.67% (0.1072 => 0.1240, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.37% (0.1327 => 0.1531, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 14.51% (0.1013 => 0.1160, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.79% (0.0834 => 0.0949, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.52% (0.1413 => 0.1604, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 13.50% (0.7038 => 0.7988, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.10% (0.1588 => 0.1796, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.07% (0.0964 => 0.1090) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.90% (3.9660 => 4.4778, std.dev.: 0.0125) MultiSource/Applications/hbd/hbd: 12.85% (1.3693 => 1.5452, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.61% (0.2721 => 0.3064, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.59% (0.3899 => 0.4390, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 12.56% (13.8202 => 15.5560, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.51% (0.6283 => 0.7069, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash2: 12.41% (0.4328 => 0.4865, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.40% (0.2596 => 0.2918, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.36% (0.6959 => 0.7819, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.31% (0.7710 => 0.8659, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.31% (0.5265 => 0.5913, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.23% (0.9199 => 1.0324, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.18% (1.4563 => 1.6337, std.dev.: 0.0015) MultiSource/Applications/aha/aha: 12.15% (0.1062 => 0.1191, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 12.06% (0.1003 => 0.1124, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.96% (1.2193 => 1.3651, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 11.79% (0.4062 => 0.4541, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.76% (1.1364 => 1.2700, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.58% (0.4791 => 0.5346, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 11.43% (1.0313 => 1.1492, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 11.34% (1.1061 => 1.2315, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 11.17% (0.5818 => 0.6468, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.12% (0.3130 => 0.3478, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.06% (0.5577 => 0.6194, std.dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: 11.05% (16.6129 => 18.4483, std.dev.: 0.0155) SingleSource/UnitTests/ObjC++/Hello: 10.87% (0.5748 => 0.6373, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 10.81% (0.6744 => 0.7473, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.79% (0.1075 => 0.1191, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.79% (0.3485 => 0.3861, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.78% (0.3756 => 0.4161, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.78% (0.4016 => 0.4449, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 10.70% (0.1589 => 0.1759, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.69% (0.4379 => 0.4847, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 10.65% (3.8646 => 4.2760, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 10.64% (0.7061 => 0.7812, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 10.62% (0.1111 => 0.1229, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 10.62% (2.1791 => 2.4105, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.61% (0.3580 => 0.3960, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 10.61% (0.2781 => 0.3076, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.54% (0.0977 => 0.1080, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.51% (0.3246 => 0.3587, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 10.49% (0.1478 => 0.1633, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.48% (0.4390 => 0.4850, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.46% (0.3022 => 0.3338, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.45% (0.1569 => 0.1733, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 10.44% (3.1889 => 3.5217, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 10.43% (0.3220 => 0.3556, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 10.42% (0.2995 => 0.3307, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.40% (0.2914 => 0.3217, std.dev.: 0.0051) MultiSource/Applications/treecc/treecc: 10.39% (1.9270 => 2.1272, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 10.39% (0.3293 => 0.3635, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.38% (0.3489 => 0.3851, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.38% (0.7460 => 0.8234, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.35% (0.1865 => 0.2058, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.30% (0.8698 => 0.9594, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.30% (0.2127 => 0.2346, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.28% (4.9865 => 5.4993, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 10.26% (0.2925 => 0.3225, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 10.17% (0.3453 => 0.3804, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 10.16% (0.3868 => 0.4261, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 10.15% (0.7506 => 0.8268, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.14% (0.2782 => 0.3064, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.12% (0.1986 => 0.2187, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.08% (0.2023 => 0.2227, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.06% (0.1014 => 0.1116, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 10.04% (0.8310 => 0.9144, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.99% (0.5637 => 0.6200, std.dev.: 0.0023) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.90% (0.1435 => 0.1577, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.89% (7.2180 => 7.9320, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.88% (0.2966 => 0.3259, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/lists1: 9.88% (0.3534 => 0.3883, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 9.84% (1.0594 => 1.1636, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.83% (1.9828 => 2.1778, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 9.76% (0.2726 => 0.2992, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.72% (0.1276 => 0.1400, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 9.67% (0.2690 => 0.2950, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary3: 9.62% (0.3149 => 0.3452, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.60% (0.2655 => 0.2910, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 9.60% (0.2761 => 0.3026, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 9.59% (0.2607 => 0.2857, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 9.56% (0.3107 => 0.3404, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 9.53% (0.2760 => 0.3023, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 9.47% (0.2628 => 0.2877, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 9.47% (0.2937 => 0.3215, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.44% (0.2765 => 0.3026, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.43% (0.6576 => 0.7196, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/em3d/em3d: 9.41% (0.1657 => 0.1813, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.38% (1.3245 => 1.4487, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 9.34% (0.3192 => 0.3490, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.19% (0.3755 => 0.4100, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 9.13% (14.8535 => 16.2091, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.09% (0.2696 => 0.2941, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.09% (3.6692 => 4.0026, std.dev.: 0.0038) MultiSource/Benchmarks/sim/sim: 9.07% (0.3131 => 0.3415, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 9.07% (0.2988 => 0.3259, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.97% (4.3801 => 4.7731, std.dev.: 0.0089) MultiSource/Applications/SIBsim4/SIBsim4: 8.96% (1.2749 => 1.3891, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.96% (4.4433 => 4.8412, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.88% (0.6135 => 0.6680, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 8.79% (0.2945 => 0.3204, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 8.79% (8.4961 => 9.2432, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.72% (1.5188 => 1.6513, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.60% (0.2140 => 0.2324, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.56% (0.8818 => 0.9573, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.53% (0.2321 => 0.2519, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 8.43% (0.6250 => 0.6777, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.33% (0.1789 => 0.1938, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 8.33% (4.6629 => 5.0512, std.dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.31% (3.2742 => 3.5463, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 8.16% (3.7467 => 4.0523, std.dev.: 0.0111) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.15% (0.3511 => 0.3797, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 8.14% (0.4113 => 0.4448, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.11% (2.1007 => 2.2711, std.dev.: 0.0169) MultiSource/Benchmarks/FreeBench/neural/neural: 8.01% (0.1385 => 0.1496, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.99% (0.9108 => 0.9836, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.99% (1.1333 => 1.2238, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.95% (0.4805 => 0.5187, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.89% (0.3245 => 0.3501, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 7.81% (6.5754 => 7.0892, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/oourafft: 7.67% (0.2008 => 0.2162, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.47% (0.2504 => 0.2691, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.44% (0.4003 => 0.4301, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.42% (6.2785 => 6.7444, std.dev.: 0.0122) SingleSource/UnitTests/ObjC/property: 7.21% (0.3940 => 0.4224, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.13% (0.3914 => 0.4193, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.13% (13.2842 => 14.2307, std.dev.: 0.0069) SingleSource/UnitTests/ObjC/for-in: 7.02% (0.3789 => 0.4055, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 6.99% (1.2292 => 1.3151, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/trivial-interface: 6.90% (0.3578 => 0.3825, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 6.86% (0.3646 => 0.3896, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 6.80% (0.3663 => 0.3912, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.75% (0.3601 => 0.3844, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.71% (0.3650 => 0.3895, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/exceptions-3: 6.60% (0.3623 => 0.3862, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.49% (0.1819 => 0.1937, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 5.80% (16.2614 => 17.2053, std.dev.: 0.0105) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.53% (0.2243 => 0.2367, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 4.57% (14.5298 => 15.1939, std.dev.: 0.0178) MultiSource/Benchmarks/Bullet/bullet: 2.31% (33.2944 => 34.0641, std.dev.: 0.0112) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5193, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/fbench: 24.51% (1.8175 => 2.2629, std.dev.: 0.0479) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.09% (1.0895 => 1.2757, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 11.02% (1.1560 => 1.2834, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 8.99% (0.8273 => 0.9017, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (3.1736 => 3.4147, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.42% (0.9692 => 1.0217, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: 5.39% (1.2998 => 1.3699, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0039, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 4.46% (0.5449 => 0.5692, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.75% (11.2619 => 11.6840, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9857, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.37% (12.0921 => 12.5000, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 2.98% (10.7476 => 11.0676, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/bisort/bisort: 2.94% (0.8239 => 0.8481, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.20% (7.4271 => 7.5907, std.dev.: 0.0025) MultiSource/Applications/lemon/lemon: 1.80% (1.4298 => 1.4556, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.44% (8.3908 => 8.5118, std.dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9688, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1880, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5780, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 1.02% (12.4560 => 12.5829, std.dev.: 0.0081) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.85% (0.2670 => 0.1419, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.13% (0.4657 => 0.3906, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.16% (1.3813 => 1.1995, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.00% (1.3819 => 1.2023, std.dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.28% (1.0460 => 0.8548, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.69% (0.2238 => 0.1954, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.02% (20.3410 => 18.3021, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -5.63% (1.2308 => 1.1615, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.33% (1.3780 => 1.3045, std.dev.: 0.0055) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5151, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.84% (1.7688 => 1.7009, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -3.24% (3.2729 => 3.1668, std.dev.: 0.0080) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.16% (0.4867 => 0.4713, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -2.84% (3.0263 => 2.9403, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8812, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.31% (1.9762 => 1.9305, std.dev.: 0.0051) MultiSource/Applications/lua/lua: -2.02% (26.5159 => 25.9790, std.dev.: 0.0542) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.97% (0.8342 => 0.8178, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.96% (0.6589 => 0.6460, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.84% (0.6615 => 0.6493, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.68% (6.3560 => 6.2495, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.65% (2.5254 => 2.4838, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0080, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2510, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: -1.19% (28.2225 => 27.8872, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/heapsort: -1.18% (3.9173 => 3.8712, std.dev.: 0.0032) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1138, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -1.05% (84.4286 => 83.5447, std.dev.: 0.0085) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 17 18:58:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 17 Oct 2012 20:58:06 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121018015806.E2FB92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4947?compare_to=4943&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 4947, Order: 166159, Start Time: 2012-10-18 00:36:44, End Time: 2012-10-18 02:00:05 To: 4943, Order: 166130, Start Time: 2012-10-17 22:55:06, End Time: 2012-10-18 00:19:57 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== Performance Regressions: 5 (3 on baseline) Performance Improvements: 12 (1 on baseline) Existing Failures: 68 (68 on baseline) Unchanged Tests: 957 (970 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.79% (0.5836 => 0.6057, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.99% (1.1523 => 1.1752, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.26% (0.8715 => 0.8825, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.14% (3.5696 => 3.6103, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/methcall: 1.01% (8.9494 => 9.0401, std.dev.: 0.0170) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.63% (0.3720 => 0.3585, std.dev.: 0.0028) MultiSource/Applications/spiff/spiff: -3.63% (0.8130 => 0.7835, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -2.77% (0.8843 => 0.8598, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.81% (0.8348 => 0.8197, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.30% (0.8946 => 0.8830, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.19% (0.8795 => 0.8690, std.dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: -18.28% (3.7345 => 3.0517, std.dev.: 0.2571) SingleSource/Benchmarks/Shootout/heapsort: -16.94% (3.6313 => 3.0163, std.dev.: 0.1418) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.83% (0.3499 => 0.3330, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/primes/primes: -2.27% (0.7873 => 0.7694, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -1.91% (42.1665 => 41.3599, std.dev.: 0.1366) SingleSource/Benchmarks/Shootout-C++/matrix: -1.10% (2.9006 => 2.8687, std.dev.: 0.0104) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.17% (16.3929 => 16.4210, std.dev.: 0.0752) MultiSource/Applications/obsequi/Obsequi: 0.09% (1.0215 => 1.0224, std.dev.: 0.0256) MultiSource/Applications/sqlite3/sqlite3: -1.03% (0.6336 => 0.6271, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/08-main/main: -3.07% (0.1890 => 0.1832, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.36% (0.1641 => 0.1553, std.dev.: 0.0047) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.91% (0.3174 => 0.3203, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.06% (0.2452 => 0.2328, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.75% (0.3312 => 0.3254, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.39% (0.2334 => 0.2343, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: -0.52% (0.5963 => 0.5932, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel: 4.01% (0.0449 => 0.0467, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.88% (0.3288 => 0.3259, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: -0.71% (0.1964 => 0.1950, std.dev.: 0.0017) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -4.58% (0.0240 => 0.0229, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 3.03% (0.0165 => 0.0170, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -16.67% (0.0414 => 0.0345, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -5.13% (0.0312 => 0.0296, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -16.25% (0.0277 => 0.0232, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 5.96% (0.0386 => 0.0409, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/casts: -1.04% (0.0193 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -25.62% (0.0203 => 0.0151, std.dev.: 0.0026) SingleSource/UnitTests/byval-alignment: - (0.0315 => 0.0315, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -87.50% (0.0008 => 0.0001, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -0.69% (0.1456 => 0.1446, std.dev.: 0.0024) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -3.67% (1.1210 => 1.0799, std.dev.: 0.0729) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -0.75% (0.1467 => 0.1456, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.05% (0.4044 => 0.4046, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.21% (0.1418 => 0.1421, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -11.86% (0.0649 => 0.0572, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -16.00% (0.0275 => 0.0231, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.44% (0.0554 => 0.0546, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.03% (1.1441 => 1.1444, std.dev.: 0.0164) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -70.97% (0.0031 => 0.0009, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.15% (0.0026 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -15.10% (0.0629 => 0.0534, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.23% (0.0267 => 0.0229, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.42% (0.8054 => 0.8020, std.dev.: 0.0109) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 0.77% (2.1571 => 2.1737, std.dev.: 0.0013) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -2.63% (0.0038 => 0.0037, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.47% (0.8697 => 0.8825, std.dev.: 0.0019) MultiSource/Applications/siod/siod: 1.08% (2.2184 => 2.2423, std.dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.01% (14.6451 => 16.6967, std.dev.: 0.4970) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.24% (0.2133 => 0.1936, std.dev.: 0.0074) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.15% (16.4461 => 16.4210, std.dev.: 0.0752) MultiSource/Applications/obsequi/Obsequi: -0.37% (1.0262 => 1.0224, std.dev.: 0.0256) MultiSource/Applications/sqlite3/sqlite3: -0.96% (0.6332 => 0.6271, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/08-main/main: 0.05% (0.1831 => 0.1832, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.38% (0.1559 => 0.1553, std.dev.: 0.0047) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.56% (0.3123 => 0.3203, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.48% (0.2463 => 0.2328, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.69% (0.3344 => 0.3254, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.89% (0.2364 => 0.2343, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: -1.30% (0.6010 => 0.5932, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel: 8.86% (0.0429 => 0.0467, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.21% (0.3266 => 0.3259, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: -0.96% (0.1969 => 0.1950, std.dev.: 0.0017) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.23% (0.0224 => 0.0229, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 38.21% (0.0123 => 0.0170, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -15.44% (0.0408 => 0.0345, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 16.54% (0.0254 => 0.0296, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -23.18% (0.0302 => 0.0232, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 6.51% (0.0384 => 0.0409, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/casts: 0.53% (0.0190 => 0.0191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -16.11% (0.0180 => 0.0151, std.dev.: 0.0026) SingleSource/UnitTests/byval-alignment: 36.96% (0.0230 => 0.0315, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 0.56% (0.1438 => 0.1446, std.dev.: 0.0024) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -4.68% (1.1329 => 1.0799, std.dev.: 0.0729) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -0.41% (0.1462 => 0.1456, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.83% (0.4164 => 0.4046, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.80% (0.1369 => 0.1421, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.76% (0.0641 => 0.0572, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 18.46% (0.0195 => 0.0231, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.54% (0.0578 => 0.0546, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.06% (1.1437 => 1.1444, std.dev.: 0.0164) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 800.00% (0.0001 => 0.0009, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.83% (0.0627 => 0.0534, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 27.22% (0.0180 => 0.0229, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.04% (0.8017 => 0.8020, std.dev.: 0.0109) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: -0.44% (2.1832 => 2.1737, std.dev.: 0.0013) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -40.32% (0.0062 => 0.0037, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 0.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 17 19:28:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 17 Oct 2012 21:28:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121018022845.67EAC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4948?compare_to=4944&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4948, Order: 166161, Start Time: 2012-10-18 01:10:27, End Time: 2012-10-18 02:30:42 To: 4944, Order: 166135, Start Time: 2012-10-17 23:20:39, End Time: 2012-10-18 00:40:56 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (75 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (180 on baseline) Performance Improvements: 2 (41 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 90 (15 on baseline) Unchanged Tests: 950 (665 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.14% (15.6438 => 15.4657, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.08% (3.7270 => 3.6869, std.dev.: 0.0010) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.28% (0.6097 => 0.6114, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 0.06% (17.1390 => 17.1486, std.dev.: 0.0116) MultiSource/Benchmarks/Bullet/bullet: -0.09% (56.0626 => 56.0138, std.dev.: 0.0172) MultiSource/Benchmarks/MallocBench/gs/gs: 0.49% (4.5011 => 4.5230, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.21% (0.0466 => 0.0465, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0467 => 0.0467, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0435 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.23% (0.0437 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0424 => 0.0424, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0425 => 0.0425) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.72% (0.0419 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0419 => 0.0419, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.23% (0.0436 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0437 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.23% (0.0429 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.23% (0.0432 => 0.0431) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0420 => 0.0420, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.24% (0.0422 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.23% (0.0427 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.23% (0.0429 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0438 => 0.0438) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0440 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0415 => 0.0415) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0416 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.47% (0.0429 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0428 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0418 => 0.0418) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0419 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.24% (0.0410 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.24% (0.0412 => 0.0411) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0410 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0410 => 0.0410, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.22% (0.0447 => 0.0446) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.45% (0.0449 => 0.0447, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0408 => 0.0408, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0409 => 0.0409) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0410 => 0.0410) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.24% (0.0412 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.24% (0.0418 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0418 => 0.0418, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.11% (1.2870 => 1.2884, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.01% (8.1895 => 8.1889, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.31% (0.7759 => 0.7735, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.82% (0.0365 => 0.0362, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: - (0.1430 => 0.1430) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: - (0.1642 => 0.1642, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.09% (0.2137 => 0.2139, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.43% (63.2438 => 56.0138, std.dev.: 0.0172) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 0.18% (0.1639 => 0.1642, std.dev.: 0.0000) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 36.32% (14.1553 => 19.2968, std.dev.: 0.0131) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.65% (3.4629 => 5.7709, std.dev.: 0.0034) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13414.44% (0.0720 => 9.7304, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9973000.00% (0.0001 => 9.9731, std.dev.: 0.0016) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 62.61% (0.2554 => 0.4153, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 49.18% (10.3673 => 15.4657, std.dev.: 0.0087) MultiSource/Benchmarks/FreeBench/distray/distray: 36.27% (0.1056 => 0.1439, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 36.25% (0.1622 => 0.2210, std.dev.: 0.0001) SingleSource/UnitTests/vla: 29.86% (0.0355 => 0.0461) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 21.94% (0.0834 => 0.1017, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 18.78% (0.1432 => 0.1701, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.89% (7.0540 => 8.3160, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.62% (2.2022 => 2.5903, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.31% (0.1566 => 0.1837, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.16% (0.5105 => 0.5981, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.11% (0.0871 => 0.1020, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.05% (0.6675 => 0.7813, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 15.82% (3.3354 => 3.8629, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/chomp: 15.65% (0.1655 => 0.1914, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.76% (0.5020 => 0.5761, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 14.32% (0.3282 => 0.3752, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 14.29% (0.7115 => 0.8132, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/power/power: 14.17% (0.1440 => 0.1644, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.16% (1.5415 => 1.7597, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.71% (0.1510 => 0.1717, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 13.69% (9.4845 => 10.7833, std.dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: 13.54% (10.4361 => 11.8496, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 13.51% (0.1584 => 0.1798, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 13.44% (0.3109 => 0.3527, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.34% (0.2271 => 0.2574, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.22% (1.7609 => 1.9937, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/18-imp/imp: 13.18% (0.3423 => 0.3874, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 13.10% (0.1695 => 0.1917, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.06% (1.3050 => 1.4754, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.94% (4.2646 => 4.8164, std.dev.: 0.0093) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.89% (0.4615 => 0.5210, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.86% (0.1236 => 0.1395, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/exptree: 12.78% (0.0814 => 0.0918) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.72% (0.1337 => 0.1507, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.69% (0.1032 => 0.1163, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.63% (0.1695 => 0.1909, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 12.60% (1.1840 => 1.3332, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/tsp/tsp: 12.60% (0.1175 => 0.1323, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: 12.59% (0.0818 => 0.0921) MultiSource/Applications/lemon/lemon: 12.44% (1.0722 => 1.2056, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.43% (0.0933 => 0.1049, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 12.43% (0.7433 => 0.8357, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 12.41% (1.1642 => 1.3087, std.dev.: 0.0038) MultiSource/Applications/treecc/treecc: 12.34% (2.0273 => 2.2774, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 12.33% (0.6450 => 0.7245, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 12.30% (0.1163 => 0.1306, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 12.24% (8.1363 => 9.1324, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.16% (0.1940 => 0.2176, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.11% (0.2700 => 0.3027, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 12.08% (0.1151 => 0.1290, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 12.04% (5.7591 => 6.4524, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.04% (0.3307 => 0.3705, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: 12.03% (0.1463 => 0.1639, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 11.99% (0.3387 => 0.3793, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 11.96% (0.0886 => 0.0992, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.96% (0.9765 => 1.0933, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.94% (0.1625 => 0.1819, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.93% (0.5860 => 0.6559, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 11.87% (3.8723 => 4.3321, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.66% (1.5859 => 1.7708, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.63% (4.9449 => 5.5201, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.60% (5.0018 => 5.5821, std.dev.: 0.0104) SingleSource/UnitTests/SignlessTypes/rem: 11.54% (0.1144 => 0.1276, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.52% (0.0929 => 0.1036, std.dev.: 0.0034) MultiSource/Applications/viterbi/viterbi: 11.45% (0.1555 => 0.1733, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.42% (1.1861 => 1.3216, std.dev.: 0.0107) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.39% (0.2107 => 0.2347, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.29% (0.1143 => 0.1272, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.28% (0.1330 => 0.1480, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.25% (0.3121 => 0.3472, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 11.24% (0.7835 => 0.8716, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.16% (0.8067 => 0.8967, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 11.15% (0.8921 => 0.9916, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.13% (0.1438 => 0.1598, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.11% (7.9617 => 8.8464, std.dev.: 0.0050) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.08% (0.3177 => 0.3529, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.08% (0.5569 => 0.6186, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.05% (0.4879 => 0.5418, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.88% (2.2024 => 2.4420, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.84% (0.2758 => 0.3057, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.83% (0.1117 => 0.1238, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 10.81% (0.6456 => 0.7154, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.79% (0.1029 => 0.1140, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.67% (0.1125 => 0.1245, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 10.58% (0.4299 => 0.4754, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.52% (1.4186 => 1.5679, std.dev.: 0.0019) MultiSource/Applications/siod/siod: 10.46% (2.2969 => 2.5372, std.dev.: 0.0168) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.45% (0.1062 => 0.1173, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 10.44% (0.3927 => 0.4337, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.43% (0.8172 => 0.9024, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/exceptions: 10.40% (0.3828 => 0.4226, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 10.31% (0.3473 => 0.3831, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.30% (0.3543 => 0.3908, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.30% (0.3516 => 0.3878, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.22% (0.3561 => 0.3925, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 10.22% (0.3886 => 0.4283, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.18% (0.3497 => 0.3853, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.16% (0.3543 => 0.3903, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 10.15% (0.3694 => 0.4069, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.07% (0.2603 => 0.2865, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 9.94% (0.3180 => 0.3496, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.93% (0.2266 => 0.2491, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 9.76% (0.2049 => 0.2249, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 9.70% (0.1268 => 0.1391, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.65% (0.3441 => 0.3773, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 9.62% (1.5603 => 1.7104, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 9.48% (0.4620 => 0.5058, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 9.37% (0.4289 => 0.4691, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.25% (0.2065 => 0.2256, std.dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 9.19% (21.9371 => 23.9538, std.dev.: 0.0227) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.07% (0.3826 => 0.4173, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.84% (0.5981 => 0.6510, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.82% (0.3865 => 0.4206, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 8.77% (0.3422 => 0.3722, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.76% (0.4203 => 0.4571, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 8.67% (0.6030 => 0.6553, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.56% (0.1892 => 0.2054, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.54% (0.5925 => 0.6431, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.53% (0.4103 => 0.4453, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.50% (0.4636 => 0.5030, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 8.47% (0.4048 => 0.4391, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.43% (0.3427 => 0.3716, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 8.25% (0.3684 => 0.3988, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.08% (0.1906 => 0.2060, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.96% (0.7326 => 0.7909, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 7.93% (17.1811 => 18.5435, std.dev.: 0.0247) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3603 => 0.3880, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.58% (0.4064 => 0.4372, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.50% (14.3668 => 15.4447, std.dev.: 0.0199) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.36% (0.8101 => 0.8697, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.29% (0.3650 => 0.3916, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.24% (3.8922 => 4.1739, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.81% (0.3098 => 0.3309, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.77% (0.3162 => 0.3376, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.76% (0.3136 => 0.3348, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.75% (0.3232 => 0.3450, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.68% (0.2905 => 0.3099, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.68% (0.2831 => 0.3020, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.61% (0.3283 => 0.3500, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.61% (0.2891 => 0.3082, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.47% (0.2877 => 0.3063, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.41% (2.0665 => 2.1990, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/except: 6.27% (0.2871 => 0.3051, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.24% (0.2756 => 0.2928, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.20% (0.2872 => 0.3050, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.13% (0.2725 => 0.2892, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.10% (0.3379 => 0.3585, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.09% (0.2793 => 0.2963, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/bh/bh: 6.02% (0.3092 => 0.3278, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 6.00% (0.3052 => 0.3235, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.88% (0.2430 => 0.2573, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.85% (0.2802 => 0.2966, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.78% (0.2714 => 0.2871, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 5.65% (1.2842 => 1.3568, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.30% (0.3131 => 0.3297, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.80% (0.3817 => 0.3924, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.79% (1.1194 => 1.1506, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.59% (0.3935 => 0.4037, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.51% (1.1145 => 1.2985, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 10.06% (1.1396 => 1.2542, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 9.88% (0.9957 => 1.0941, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.11% (0.9540 => 1.0218) SingleSource/Benchmarks/Shootout-C++/hash2: 6.64% (3.1578 => 3.3676, std.dev.: 0.0057) SingleSource/Regression/C/uint64_to_float: 5.08% (0.5413 => 0.5688, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.65% (4.2280 => 4.3400, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7652, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.87% (3.6395 => 3.7077, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/bisort/bisort: 1.86% (0.8333 => 0.8488, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.59% (2.6546 => 2.6968, std.dev.: 0.0012) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2075, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.13% (11.6436 => 11.7755, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.10% (6.5088 => 6.5805, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1312, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.07% (0.8651 => 0.1724, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.07% (5.2763 => 3.2678, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.64% (5.3855 => 3.6815, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.12% (5.3526 => 3.6869, std.dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -14.70% (54.1659 => 46.2038, std.dev.: 0.0151) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.40% (2.9384 => 2.6327, std.dev.: 0.0034) MultiSource/Applications/ClamAV/clamscan: -7.28% (22.1758 => 20.5604, std.dev.: 0.0114) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7645, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: -15.86% (1.6925 => 1.4240, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852) SingleSource/Benchmarks/McGill/chomp: -12.24% (1.2373 => 1.0858, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3453 => 2.9599, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -10.89% (1.5373 => 1.3699, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.29% (19.9488 => 18.2957, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/mason/mason: -8.01% (0.2161 => 0.1988, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.16% (1.8329 => 1.7017, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4780, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5757, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.57% (1.6805 => 1.5869, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.99% (1.5835 => 1.5045, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -3.40% (3.2827 => 3.1712, std.dev.: 0.0021) MultiSource/Benchmarks/sim/sim: -3.39% (5.0483 => 4.8774, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4962, std.dev.: 0.0053) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.68% (0.4808 => 0.4679, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.25% (8.1563 => 7.9730, std.dev.: 0.0289) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -1.90% (10.2830 => 10.0875, std.dev.: 0.0196) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6810, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: -1.70% (4.6441 => 4.5651, std.dev.: 0.0064) SingleSource/UnitTests/Vector/multiplies: -1.66% (2.5528 => 2.5105, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4197, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/lists: -1.15% (6.2999 => 6.2272, std.dev.: 0.0081) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2878, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 16.92% (0.5229 => 0.6114, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 14.40% (14.9895 => 17.1486, std.dev.: 0.0116) MultiSource/Benchmarks/MallocBench/gs/gs: 10.04% (4.1105 => 4.5230, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 16.62% (1.1048 => 1.2884, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.40% (7.1582 => 8.1889, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.32% (0.6222 => 0.7735, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36100.00% (0.0001 => 0.0362, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.70% (0.1485 => 0.1430) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.09% (0.2116 => 0.2139, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 17 20:09:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 17 Oct 2012 22:09:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121018030935.895E72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4949?compare_to=4946&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4949, Order: 166162, Start Time: 2012-10-18 01:46:41, End Time: 2012-10-18 03:12:32 To: 4946, Order: 166141, Start Time: 2012-10-17 23:51:19, End Time: 2012-10-18 01:17:12 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (190 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1041 (676 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.16% (54.8551 => 56.5901, std.dev.: 0.0358) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.65% (2.0176 => 2.4947, std.dev.: 0.0157) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.87% (0.1410 => 0.1676, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 17.68% (0.0826 => 0.0972, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.46% (0.0653 => 0.0767, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 17.16% (0.2243 => 0.2628, std.dev.: 0.0007) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.65% (0.1072 => 0.1229, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 14.41% (0.1013 => 0.1159, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.17% (0.1327 => 0.1515, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.79% (0.0834 => 0.0949, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.66% (0.1413 => 0.1606, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 13.65% (0.7038 => 0.7999, std.dev.: 0.0105) MultiSource/Applications/hbd/hbd: 13.00% (1.3693 => 1.5473, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.97% (0.1588 => 0.1794, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.97% (0.0964 => 0.1089) SingleSource/Benchmarks/Shootout-C++/hash2: 12.89% (0.4328 => 0.4886, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.88% (3.9660 => 4.4767, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.61% (0.2721 => 0.3064, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.56% (0.6283 => 0.7072, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.48% (1.4563 => 1.6381, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.48% (0.2596 => 0.2920, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 12.46% (13.8202 => 15.5427, std.dev.: 0.0194) MultiSource/Benchmarks/FreeBench/distray/distray: 12.35% (0.0818 => 0.0919, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.31% (0.5265 => 0.5913, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.30% (0.7710 => 0.8658, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.23% (0.6959 => 0.7810, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.21% (0.9199 => 1.0322, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 12.09% (0.4062 => 0.4553, std.dev.: 0.0018) MultiSource/Applications/aha/aha: 12.05% (0.1062 => 0.1190, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.92% (1.2193 => 1.3647, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.87% (1.1364 => 1.2713, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 11.86% (0.1003 => 0.1122, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 11.74% (0.5818 => 0.6501, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.72% (0.3899 => 0.4356, std.dev.: 0.0020) MultiSource/Applications/lemon/lemon: 11.67% (1.0313 => 1.1517, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: 11.47% (1.1061 => 1.2330, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.41% (0.1157 => 0.1289, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.37% (0.3130 => 0.3486, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 11.34% (0.5748 => 0.6400, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.31% (0.4791 => 0.5333, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.16% (0.4016 => 0.4464, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.14% (0.5577 => 0.6198, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.05% (0.3485 => 0.3870, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 11.03% (0.7061 => 0.7840, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.02% (0.3022 => 0.3355, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 11.00% (0.2781 => 0.3087, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.97% (0.3756 => 0.4168, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 10.92% (16.6129 => 18.4265, std.dev.: 0.0250) MultiSource/Applications/minisat/minisat: 10.90% (0.6744 => 0.7479, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.89% (0.4390 => 0.4868, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 10.78% (0.3868 => 0.4285, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.76% (0.4379 => 0.4850, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.70% (0.1075 => 0.1190, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.69% (0.3489 => 0.3862, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.66% (0.3246 => 0.3592, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 10.66% (0.3293 => 0.3644, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 10.65% (0.3220 => 0.3563, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 10.65% (0.2995 => 0.3314, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 10.65% (3.8646 => 4.2762, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/mst/mst: 10.62% (0.1111 => 0.1229, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 10.62% (2.1791 => 2.4105, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.60% (0.2782 => 0.3077, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.54% (0.0977 => 0.1080, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 10.54% (0.3453 => 0.3817, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 10.54% (3.1889 => 3.5250, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 10.51% (0.1589 => 0.1756, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.50% (0.2914 => 0.3220, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.48% (0.2127 => 0.2350, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.47% (0.3580 => 0.3955, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 10.38% (1.9270 => 2.1271, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.38% (0.8698 => 0.9601, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.34% (0.1276 => 0.1408, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.32% (0.2966 => 0.3272, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.29% (0.1865 => 0.2057, std.dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: 10.28% (0.1478 => 0.1630, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.28% (0.2023 => 0.2231, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.28% (0.7460 => 0.8227, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.26% (0.1014 => 0.1118, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.25% (0.5637 => 0.6215, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.24% (1.9828 => 2.1858, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 10.23% (0.2726 => 0.3005, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 10.22% (0.7506 => 0.8273, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.20% (0.1569 => 0.1729, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.17% (0.1986 => 0.2188, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 10.13% (0.8310 => 0.9152, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists1: 10.13% (0.3534 => 0.3892, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 10.12% (0.2925 => 0.3221, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/random: 10.11% (0.2690 => 0.2962, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 10.11% (0.2760 => 0.3039, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: 10.11% (0.2761 => 0.3040, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 10.10% (0.3149 => 0.3467, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.10% (4.9865 => 5.4899, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.06% (0.2655 => 0.2922, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 10.04% (0.3107 => 0.3419, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 10.01% (0.2607 => 0.2868, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 10.01% (0.2628 => 0.2891, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 9.91% (0.2937 => 0.3228, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.90% (0.1435 => 0.1577, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.88% (7.2180 => 7.9308, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.87% (0.2765 => 0.3038, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 9.65% (0.3192 => 0.3500, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 9.57% (0.2988 => 0.3274, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 9.57% (1.0594 => 1.1608, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.53% (0.2696 => 0.2953, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.42% (1.3245 => 1.4493, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/em3d/em3d: 9.41% (0.1657 => 0.1813, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.35% (0.3755 => 0.4106, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.18% (3.6692 => 4.0062, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 9.17% (14.8535 => 16.2160, std.dev.: 0.0095) MultiSource/Benchmarks/sim/sim: 9.17% (0.3131 => 0.3418, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 9.10% (0.2945 => 0.3213, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 9.00% (1.2749 => 1.3897, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.97% (0.3511 => 0.3826, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.96% (4.3801 => 4.7724, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.93% (4.4433 => 4.8399, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.87% (0.6576 => 0.7159, std.dev.: 0.0029) MultiSource/Applications/oggenc/oggenc: 8.85% (4.6629 => 5.0757, std.dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: 8.82% (8.4961 => 9.2453, std.dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.75% (1.5188 => 1.6517, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 8.74% (0.6250 => 0.6796, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.62% (0.6135 => 0.6664, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.58% (0.8818 => 0.9575, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.55% (0.2140 => 0.2323, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.53% (0.2321 => 0.2519, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.33% (0.1789 => 0.1938, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.31% (3.2742 => 3.5462, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.09% (1.1333 => 1.2250, std.dev.: 0.0035) MultiSource/Applications/lua/lua: 8.05% (3.7467 => 4.0482, std.dev.: 0.0064) MultiSource/Benchmarks/McCat/05-eks/eks: 8.02% (0.4113 => 0.4443, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.96% (0.9108 => 0.9833, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 7.94% (0.1385 => 0.1495, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.91% (2.1007 => 2.2668, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.89% (0.3245 => 0.3501, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 7.86% (6.5754 => 7.0923, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.74% (0.4805 => 0.5177, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.63% (0.2504 => 0.2695, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/oourafft: 7.57% (0.2008 => 0.2160, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.57% (0.4003 => 0.4306, std.dev.: 0.0090) SingleSource/UnitTests/ObjC/exceptions: 7.38% (0.3914 => 0.4203, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.36% (0.3940 => 0.4230, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.30% (6.2785 => 6.7368, std.dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: 7.30% (1.2292 => 1.3189, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.12% (13.2842 => 14.2299, std.dev.: 0.0200) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.09% (0.1819 => 0.1948, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.04% (0.3578 => 0.3830, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.99% (0.3789 => 0.4054, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 6.97% (0.3646 => 0.3900, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 6.93% (0.3663 => 0.3917, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.91% (0.3601 => 0.3850, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.85% (0.3650 => 0.3900, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 6.82% (0.3623 => 0.3870, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 5.81% (16.2614 => 17.2064, std.dev.: 0.0171) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.48% (0.2243 => 0.2366, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 4.64% (14.5298 => 15.2033, std.dev.: 0.0113) MultiSource/Benchmarks/Bullet/bullet: 2.28% (33.2944 => 34.0541, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.71% (0.4846 => 0.6964, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 30.62% (5.7573 => 7.5200, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: 24.48% (1.8175 => 2.2624, std.dev.: 0.0180) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.05% (1.0895 => 1.2753, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 11.12% (1.1560 => 1.2845, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 8.99% (0.8273 => 0.9017, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4144, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.42% (0.9692 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 5.14% (1.2998 => 1.3666, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.89% (2.8606 => 3.0005, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.76% (1.9144 => 2.0056, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 4.48% (0.5449 => 0.5693, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.89% (1.7081 => 1.7746, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.73% (11.2619 => 11.6824, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9856, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.38% (12.0921 => 12.5003, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 2.93% (10.7476 => 11.0627, std.dev.: 0.0672) MultiSource/Benchmarks/Olden/bisort/bisort: 2.93% (0.8239 => 0.8480, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.14% (7.4271 => 7.5863, std.dev.: 0.0028) MultiSource/Applications/lemon/lemon: 1.86% (1.4298 => 1.4564, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5138, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9696, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2126, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1870, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/oourafft: 1.17% (5.5130 => 5.5775, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5906, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.04% (8.8259 => 8.9173, std.dev.: 0.0115) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.78% (0.2670 => 0.1421, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.93% (0.4657 => 0.3915, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.10% (1.3813 => 1.2003, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.94% (1.3819 => 1.2031, std.dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.28% (1.0460 => 0.8548, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/mason/mason: -12.69% (0.2238 => 0.1954, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.16% (20.3410 => 18.2734, std.dev.: 0.0152) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -5.61% (1.2308 => 1.1617, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.52% (1.3780 => 1.3020, std.dev.: 0.0106) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5148, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.89% (0.9996 => 0.9607, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.87% (1.7688 => 1.7003, std.dev.: 0.0009) MultiSource/Applications/siod/siod: -3.29% (3.2729 => 3.1653, std.dev.: 0.0089) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.10% (0.4867 => 0.4716, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -2.81% (3.0263 => 2.9412, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8812, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783) MultiSource/Benchmarks/Olden/bh/bh: -2.39% (1.9762 => 1.9290, std.dev.: 0.0092) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.08% (0.6589 => 0.6452, std.dev.: 0.0006) MultiSource/Applications/lua/lua: -2.03% (26.5159 => 25.9770, std.dev.: 0.0145) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.98% (0.8342 => 0.8177, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.86% (0.6615 => 0.6492) SingleSource/Benchmarks/Shootout/lists: -1.74% (6.3560 => 6.2455, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.64% (2.5254 => 2.4839, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0075, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.27% (5.3167 => 5.2493, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/heapsort: -1.24% (3.9173 => 3.8688, std.dev.: 0.0123) MultiSource/Benchmarks/mafft/pairlocalalign: -1.19% (28.2225 => 27.8864, std.dev.: 0.0024) MultiSource/Applications/aha/aha: -1.08% (3.1476 => 3.1137, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -1.05% (84.4286 => 83.5416, std.dev.: 0.0103) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 17 20:38:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 17 Oct 2012 22:38:01 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121018033801.297212A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4950?compare_to=4947&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 4950, Order: 166163, Start Time: 2012-10-18 02:16:57, End Time: 2012-10-18 03:40:00 To: 4947, Order: 166159, Start Time: 2012-10-18 00:36:44, End Time: 2012-10-18 02:00:05 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== Performance Regressions: 13 (7 on baseline) Performance Improvements: 0 (1 on baseline) Existing Failures: 68 (68 on baseline) Unchanged Tests: 961 (966 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 16.71% (0.0772 => 0.0901, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Puzzle: 11.53% (0.0963 => 0.1074, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.51% (0.1936 => 0.2062, std.dev.: 0.0030) MultiSource/Applications/spiff/spiff: 3.46% (0.7835 => 0.8106, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.56% (0.8198 => 0.8408, std.dev.: 0.0032) MultiSource/Applications/lua/lua: 1.39% (3.7921 => 3.8449, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.25% (0.9278 => 0.9394, std.dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/himenobmtxpa: 3.66% (4.2985 => 4.4560, std.dev.: 0.0386) SingleSource/Benchmarks/CoyoteBench/lpbench: 3.35% (3.9475 => 4.0799, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/ffbench: 2.57% (1.4110 => 1.4472, std.dev.: 0.0060) MultiSource/Benchmarks/mafft/pairlocalalign: 1.23% (62.4768 => 63.2434, std.dev.: 0.0478) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.05% (1.5876 => 1.6043, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/whetstone: 1.01% (2.1141 => 2.1354, std.dev.: 0.0048) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.11% (16.4210 => 16.4032, std.dev.: 0.0994) MultiSource/Applications/obsequi/Obsequi: 1.75% (1.0224 => 1.0403, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: 0.97% (0.6271 => 0.6332, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/08-main/main: -2.51% (0.1832 => 0.1786, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.19% (0.1553 => 0.1618, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.3203 => 0.3203, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.50% (0.2328 => 0.2456, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.24% (0.3254 => 0.3327, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.59% (0.2343 => 0.2259, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/bigfib: -0.15% (0.5932 => 0.5923, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/mandel: -6.64% (0.0467 => 0.0436, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.80% (0.3259 => 0.3285, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/strcat: 0.10% (0.1950 => 0.1952, std.dev.: 0.0007) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 9.17% (0.0229 => 0.0250, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 20.59% (0.0170 => 0.0205, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 15.36% (0.0345 => 0.0398, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -19.93% (0.0296 => 0.0237, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 29.31% (0.0232 => 0.0300, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -10.76% (0.0409 => 0.0365, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/casts: -28.80% (0.0191 => 0.0136, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/test1: -15.89% (0.0151 => 0.0127, std.dev.: 0.0010) SingleSource/UnitTests/byval-alignment: 0.63% (0.0315 => 0.0317, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 1.31% (0.1446 => 0.1465, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.94% (1.0799 => 1.1116, std.dev.: 0.0259) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -5.22% (0.1456 => 0.1380, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.91% (0.4046 => 0.4083, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.73% (0.1421 => 0.1474, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.01% (0.0572 => 0.0635, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -16.88% (0.0231 => 0.0192, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.37% (0.0546 => 0.0619, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.11% (1.1444 => 1.1431, std.dev.: 0.0431) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 155.56% (0.0009 => 0.0023, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.87% (0.0534 => 0.0576, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.42% (0.0229 => 0.0246, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.07% (0.8020 => 0.8014, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: -0.98% (2.1737 => 2.1525, std.dev.: 0.0504) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 51.35% (0.0037 => 0.0056, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.63% (0.2180 => 0.2281, std.dev.: 0.0016) MultiSource/Applications/spiff/spiff: 1.96% (0.7950 => 0.8106, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 1.48% (1.9948 => 2.0243, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/CoyoteBench/lpbench: 4.60% (3.9006 => 4.0799, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.31% (4.3552 => 4.4560, std.dev.: 0.0386) SingleSource/Benchmarks/Misc/ffbench: 1.23% (1.4296 => 1.4472, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.12% (1.5866 => 1.6043, std.dev.: 0.0049) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/SPASS/SPASS: -3.91% (8.4326 => 8.1031, std.dev.: 0.1259) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.26% (16.4461 => 16.4032, std.dev.: 0.0994) MultiSource/Applications/obsequi/Obsequi: 1.37% (1.0262 => 1.0403, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: - (0.6332 => 0.6332, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/08-main/main: -2.46% (0.1831 => 0.1786, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.78% (0.1559 => 0.1618, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.56% (0.3123 => 0.3203, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.28% (0.2463 => 0.2456, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.51% (0.3344 => 0.3327, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.44% (0.2364 => 0.2259, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/bigfib: -1.45% (0.6010 => 0.5923, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/mandel: 1.63% (0.0429 => 0.0436, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.58% (0.3266 => 0.3285, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/strcat: -0.86% (0.1969 => 0.1952, std.dev.: 0.0007) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 11.61% (0.0224 => 0.0250, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 66.67% (0.0123 => 0.0205, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.45% (0.0408 => 0.0398, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -6.69% (0.0254 => 0.0237, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.66% (0.0302 => 0.0300, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -4.95% (0.0384 => 0.0365, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/casts: -28.42% (0.0190 => 0.0136, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/test1: -29.44% (0.0180 => 0.0127, std.dev.: 0.0010) SingleSource/UnitTests/byval-alignment: 37.83% (0.0230 => 0.0317, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 1.88% (0.1438 => 0.1465, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.88% (1.1329 => 1.1116, std.dev.: 0.0259) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -5.61% (0.1462 => 0.1380, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.95% (0.4164 => 0.4083, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.67% (0.1369 => 0.1474, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.94% (0.0641 => 0.0635, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.54% (0.0195 => 0.0192, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 7.09% (0.0578 => 0.0619, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.05% (1.1437 => 1.1431, std.dev.: 0.0431) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2200.00% (0.0001 => 0.0023, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.13% (0.0627 => 0.0576, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 36.67% (0.0180 => 0.0246, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.04% (0.8017 => 0.8014, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: -1.41% (2.1832 => 2.1525, std.dev.: 0.0504) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -9.68% (0.0062 => 0.0056, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 1.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 17 21:19:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 17 Oct 2012 23:19:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121018041904.D66442A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4951?compare_to=4948&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4951, Order: 166163, Start Time: 2012-10-18 03:00:24, End Time: 2012-10-18 04:21:02 To: 4948, Order: 166161, Start Time: 2012-10-18 01:10:27, End Time: 2012-10-18 02:30:42 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (75 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (179 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 90 (15 on baseline) Unchanged Tests: 950 (665 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 11.29% (0.3968 => 0.4416, std.dev.: 0.0123) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.44% (54.7215 => 56.0555, std.dev.: 0.2724) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.03% (0.6114 => 0.6116, std.dev.: 0.0033) MultiSource/Applications/SPASS/SPASS: -0.09% (17.1486 => 17.1337, std.dev.: 0.0249) MultiSource/Benchmarks/Bullet/bullet: 0.06% (56.0138 => 56.0472, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: 0.05% (4.5230 => 4.5251, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0465 => 0.0465, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0467 => 0.0467, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0435 => 0.0435, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.23% (0.0436 => 0.0437, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0424 => 0.0424, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0425 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0416 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0419 => 0.0419, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.23% (0.0435 => 0.0434, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0437 => 0.0437, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.23% (0.0430 => 0.0429, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0431 => 0.0431, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0420 => 0.0420, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.24% (0.0421 => 0.0420, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0426 => 0.0426, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0428 => 0.0428, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0438 => 0.0438, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0440 => 0.0440, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.24% (0.0415 => 0.0414, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0416 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.70% (0.0427 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.47% (0.0428 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.24% (0.0418 => 0.0417, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0419 => 0.0419, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.24% (0.0409 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0411 => 0.0411, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0410 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0410 => 0.0410, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0446 => 0.0446, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0447 => 0.0447, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0408 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0409 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0410 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0411 => 0.0411, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0417 => 0.0417, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0418 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.10% (1.2884 => 1.2871, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.06% (8.1889 => 8.1841, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.06% (0.7735 => 0.7740, std.dev.: 0.0148) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0362 => 0.0362, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: - (0.1430 => 0.1430, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: - (0.1642 => 0.1642) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.05% (0.2139 => 0.2138, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.38% (63.2438 => 56.0472, std.dev.: 0.0023) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 0.18% (0.1639 => 0.1642) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 36.27% (14.1553 => 19.2893, std.dev.: 0.0176) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.82% (3.4629 => 5.7769, std.dev.: 0.0105) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13405.83% (0.0720 => 9.7242, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9973400.00% (0.0001 => 9.9735, std.dev.: 0.0019) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 62.37% (0.2554 => 0.4147, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 49.09% (10.3673 => 15.4565, std.dev.: 0.0083) MultiSource/Benchmarks/FreeBench/distray/distray: 36.27% (0.1056 => 0.1439, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 36.19% (0.1622 => 0.2209, std.dev.: 0.0000) SingleSource/UnitTests/vla: 29.58% (0.0355 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 22.06% (0.0834 => 0.1018, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 18.78% (0.1432 => 0.1701, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.99% (7.0540 => 8.3233, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.65% (2.2022 => 2.5909, std.dev.: 0.0124) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.18% (0.1566 => 0.1835, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.14% (0.5105 => 0.5980, std.dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.11% (0.0871 => 0.1020, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.05% (0.6675 => 0.7813) SingleSource/Benchmarks/McGill/chomp: 15.95% (0.1655 => 0.1919, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 15.85% (3.3354 => 3.8641, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 15.34% (0.0730 => 0.0842, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.72% (0.5020 => 0.5759, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.58% (0.1625 => 0.1862, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 14.41% (0.7115 => 0.8140, std.dev.: 0.0124) SingleSource/Benchmarks/Misc/oourafft: 14.29% (0.3282 => 0.3751, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.20% (1.5415 => 1.7604, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/power/power: 14.17% (0.1440 => 0.1644, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 13.80% (9.4845 => 10.7933, std.dev.: 0.0091) MultiSource/Applications/sgefa/sgefa: 13.64% (0.3109 => 0.3533, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.58% (0.1510 => 0.1715, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 13.52% (10.4361 => 11.8473, std.dev.: 0.0218) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 13.45% (0.1584 => 0.1797, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.40% (0.0933 => 0.1058, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.25% (0.2271 => 0.2572, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.21% (1.7609 => 1.9936, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 13.18% (0.3423 => 0.3874, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 13.16% (0.1695 => 0.1918, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.07% (0.4615 => 0.5218, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.06% (1.3050 => 1.4754, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.86% (4.2646 => 4.8129, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.79% (0.1032 => 0.1164, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.72% (0.1337 => 0.1507, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.70% (0.1236 => 0.1393, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.68% (0.1695 => 0.1910, std.dev.: 0.0062) SingleSource/Benchmarks/McGill/exptree: 12.65% (0.0814 => 0.0917, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 12.60% (0.1175 => 0.1323, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 12.59% (0.0818 => 0.0921, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 12.56% (1.1840 => 1.3327, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 12.45% (0.6450 => 0.7253, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 12.41% (1.1642 => 1.3087, std.dev.: 0.0065) MultiSource/Applications/lambda-0_1_3/lambda: 12.35% (0.7433 => 0.8351, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 12.33% (1.0722 => 1.2044, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 12.29% (2.0273 => 2.2765, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 12.27% (8.1363 => 9.1344, std.dev.: 0.0079) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.16% (0.1940 => 0.2176, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 12.16% (0.1151 => 0.1291, std.dev.: 0.0026) MultiSource/Benchmarks/sim/sim: 12.13% (0.3387 => 0.3798, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/mst/mst: 12.12% (0.1163 => 0.1304, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 12.10% (0.1463 => 0.1640, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.07% (0.2700 => 0.3026, std.dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 12.05% (5.7591 => 6.4529, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.87% (0.9765 => 1.0924, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.85% (0.3307 => 0.3699, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 11.85% (0.0886 => 0.0991, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 11.85% (3.8723 => 4.3310, std.dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.71% (0.5860 => 0.6546, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.66% (4.9449 => 5.5213, std.dev.: 0.0084) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.63% (5.0018 => 5.5837, std.dev.: 0.0046) SingleSource/UnitTests/SignlessTypes/rem: 11.63% (0.1144 => 0.1277) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.62% (1.5859 => 1.7702, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 11.58% (0.1555 => 0.1735, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.52% (0.0929 => 0.1036, std.dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.41% (0.3121 => 0.3477, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.35% (0.4879 => 0.5433, std.dev.: 0.0020) MultiSource/Applications/spiff/spiff: 11.33% (0.7835 => 0.8723, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.30% (0.2107 => 0.2345, std.dev.: 0.0013) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.29% (0.1143 => 0.1272, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 11.28% (0.1117 => 0.1243, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.27% (1.1861 => 1.3198, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.24% (0.8067 => 0.8974, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.20% (0.1330 => 0.1479, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.20% (7.9617 => 8.8535, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/football/football: 11.14% (0.8921 => 0.9915, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.13% (0.2758 => 0.3065, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.13% (0.1438 => 0.1598, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.99% (0.3177 => 0.3526, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.87% (2.2024 => 2.4417, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 10.77% (0.6456 => 0.7151, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.69% (0.1029 => 0.1139, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.67% (0.1125 => 0.1245, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 10.51% (0.4299 => 0.4751, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.51% (1.4186 => 1.5677, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.49% (0.8172 => 0.9029, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.49% (0.5569 => 0.6153, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/trivial-interface: 10.37% (0.3473 => 0.3833, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.36% (0.3927 => 0.4334, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 10.32% (2.2969 => 2.5340, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-4: 10.30% (0.3543 => 0.3908, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.28% (0.3561 => 0.3927, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.26% (0.1062 => 0.1171, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.24% (0.3828 => 0.4220, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.24% (0.3497 => 0.3855, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.19% (0.3543 => 0.3904, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.18% (0.3516 => 0.3874, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.18% (0.3694 => 0.4070, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.06% (0.3886 => 0.4277, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.03% (0.2603 => 0.2864, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.97% (0.2266 => 0.2492, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 9.94% (0.3180 => 0.3496, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/ReedSolomon: 9.76% (0.2049 => 0.2249, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.68% (0.3441 => 0.3774, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.67% (0.3826 => 0.4196, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 9.56% (1.5603 => 1.7095, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash: 9.49% (0.4289 => 0.4696, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 9.46% (0.1268 => 0.1388, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 9.42% (0.4620 => 0.5055, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.39% (0.2065 => 0.2259, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.38% (0.4103 => 0.4488, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 9.22% (21.9371 => 23.9603, std.dev.: 0.0130) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.97% (0.1906 => 0.2077, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.87% (0.3865 => 0.4208, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.86% (0.5981 => 0.6511, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.78% (0.4203 => 0.4572, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 8.77% (0.3422 => 0.3722, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.54% (0.6030 => 0.6545, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 8.52% (0.4048 => 0.4393, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.52% (0.3427 => 0.3719, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.49% (0.5925 => 0.6428, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.46% (0.1892 => 0.2052, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.37% (0.4636 => 0.5024, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 8.25% (0.3684 => 0.3988, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 7.95% (17.1811 => 18.5462, std.dev.: 0.0210) SingleSource/UnitTests/ObjC++/property-reference: 7.84% (0.7326 => 0.7900, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3603 => 0.3880, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.53% (0.4064 => 0.4370, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.52% (0.8101 => 0.8710, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.46% (0.3162 => 0.3398, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.44% (14.3668 => 15.4354, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.37% (0.3650 => 0.3919, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.21% (3.8922 => 4.1730, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/matrix: 6.91% (0.3098 => 0.3312, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.86% (0.3136 => 0.3351, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 6.75% (0.2905 => 0.3101, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.75% (0.2831 => 0.3022, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.68% (0.2891 => 0.3084, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary3: 6.64% (0.3283 => 0.3501, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 6.62% (0.3232 => 0.3446, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.46% (2.0665 => 2.1999, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 6.43% (0.2877 => 0.3062, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.23% (0.2871 => 0.3050, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.23% (0.2872 => 0.3051, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.16% (0.3052 => 0.3240, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.13% (0.2756 => 0.2925, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/bh/bh: 6.08% (0.3092 => 0.3280, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.05% (0.2793 => 0.2962, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.04% (0.3379 => 0.3583, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.02% (0.2725 => 0.2889, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.01% (0.2430 => 0.2576, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 5.78% (0.2802 => 0.2964, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hello: 5.71% (0.2714 => 0.2869, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 5.60% (1.2842 => 1.3561, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.30% (0.3131 => 0.3297, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.85% (1.1194 => 1.1513, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.70% (0.3817 => 0.3920, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.50% (1.1145 => 1.2984, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.74% (2.6778 => 2.9653, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.99% (1.1396 => 1.2535, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 9.81% (0.9957 => 1.0934, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3680, std.dev.: 0.0016) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.82% (4.2280 => 4.3472, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.34% (1.7254 => 1.7657, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.90% (3.6395 => 3.7086, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/bisort/bisort: 1.84% (0.8333 => 0.8486, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.62% (2.6546 => 2.6977, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2078, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 1.13% (11.6436 => 11.7755, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1312, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.07% (0.8651 => 0.1724, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.04% (5.2763 => 3.2690, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.63% (5.3855 => 3.6819, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.13% (5.3526 => 3.6864, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -14.70% (54.1659 => 46.2023, std.dev.: 0.0285) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.39% (2.9384 => 2.6330, std.dev.: 0.0095) MultiSource/Applications/ClamAV/clamscan: -7.29% (22.1758 => 20.5600, std.dev.: 0.0347) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.49% (1.1492 => 0.7643, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.76% (1.6925 => 1.4257, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3453 => 2.9600, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.42% (1.2373 => 1.0960, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -11.19% (1.5373 => 1.3653, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.41% (19.9488 => 18.2715, std.dev.: 0.0237) MultiSource/Benchmarks/FreeBench/mason/mason: -7.73% (0.2161 => 0.1994, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.16% (1.8329 => 1.7016, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.60% (1.6805 => 1.5864, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5071, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -3.39% (5.0483 => 4.8774, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.38% (3.2827 => 3.1718, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5029, std.dev.: 0.0057) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.62% (0.4808 => 0.4682, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.11% (8.1563 => 7.9846, std.dev.: 0.0162) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0844, std.dev.: 0.0127) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6784, std.dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: -1.70% (4.6441 => 4.5651, std.dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.68% (2.5528 => 2.5098, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4213, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout/lists: -1.17% (6.2999 => 6.2259, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2879, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8566, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 16.96% (0.5229 => 0.6116, std.dev.: 0.0033) MultiSource/Applications/SPASS/SPASS: 14.30% (14.9895 => 17.1337, std.dev.: 0.0249) MultiSource/Benchmarks/MallocBench/gs/gs: 10.09% (4.1105 => 4.5251, std.dev.: 0.0170) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 16.50% (1.1048 => 1.2871, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.33% (7.1582 => 8.1841, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.40% (0.6222 => 0.7740, std.dev.: 0.0148) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36100.00% (0.0001 => 0.0362, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -3.70% (0.1485 => 0.1430, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.04% (0.2116 => 0.2138, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 17 22:04:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 18 Oct 2012 00:04:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121018050455.880C72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4952?compare_to=4949&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4952, Order: 166163, Start Time: 2012-10-18 03:42:00, End Time: 2012-10-18 05:07:52 To: 4949, Order: 166162, Start Time: 2012-10-18 01:46:41, End Time: 2012-10-18 03:12:32 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (192 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1042 (674 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.65% (2.0176 => 2.4948, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.72% (0.1410 => 0.1674, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 17.55% (0.0826 => 0.0971, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.30% (0.0653 => 0.0766, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 17.16% (0.2243 => 0.2628, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.65% (0.1072 => 0.1229, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 14.51% (0.1013 => 0.1160, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.02% (0.1327 => 0.1513, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.67% (0.0834 => 0.0948, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.66% (0.1413 => 0.1606, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 13.30% (0.7038 => 0.7974, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 13.09% (0.7710 => 0.8719, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.97% (0.0964 => 0.1089, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 12.90% (1.3693 => 1.5459, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.87% (3.9660 => 4.4765, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.86% (0.2721 => 0.3071, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 12.85% (0.4328 => 0.4884, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.85% (0.1588 => 0.1792, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.71% (0.2596 => 0.2926, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 12.68% (0.4062 => 0.4577, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.46% (0.5265 => 0.5921, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.45% (0.6283 => 0.7065, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 12.43% (13.8202 => 15.5379, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.39% (0.6959 => 0.7821, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.34% (1.4563 => 1.6360, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 12.28% (0.0847 => 0.0951, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/distray/distray: 12.22% (0.0818 => 0.0918, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 12.16% (0.1003 => 0.1125, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.11% (0.9199 => 1.0313, std.dev.: 0.0013) MultiSource/Applications/aha/aha: 12.05% (0.1062 => 0.1190, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.88% (1.2193 => 1.3642, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.84% (1.1364 => 1.2710, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.80% (0.3899 => 0.4359, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference: 11.78% (0.7061 => 0.7893, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 11.76% (0.5818 => 0.6502, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 11.47% (1.0313 => 1.1496, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.44% (0.3130 => 0.3488, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 11.43% (0.5748 => 0.6405, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.33% (0.4791 => 0.5334, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 11.33% (1.1061 => 1.2314, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.32% (0.1157 => 0.1288, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 11.23% (0.1986 => 0.2209, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.21% (0.4016 => 0.4466, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.13% (0.3485 => 0.3873, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.08% (0.3756 => 0.4172, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.06% (0.5577 => 0.6194, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.05% (0.4390 => 0.4875, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.96% (0.4379 => 0.4859, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 10.95% (16.6129 => 18.4314, std.dev.: 0.0191) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.94% (0.3246 => 0.3601, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 10.93% (0.2781 => 0.3085, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 10.83% (0.1478 => 0.1638, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/mst/mst: 10.80% (0.1111 => 0.1231, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.79% (0.3022 => 0.3348, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 10.78% (0.6744 => 0.7471, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.75% (0.3580 => 0.3965, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.75% (0.3489 => 0.3864, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.75% (0.2782 => 0.3081, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 10.69% (0.3293 => 0.3645, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 10.63% (3.8646 => 4.2754, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/moments: 10.63% (0.3868 => 0.4279, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 10.57% (0.3453 => 0.3818, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.53% (0.2127 => 0.2351, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.51% (0.1075 => 0.1188, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 10.51% (0.1589 => 0.1756, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 10.50% (2.1791 => 2.4078, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.47% (0.8698 => 0.9609, std.dev.: 0.0017) MultiSource/Applications/d/make_dparser: 10.46% (3.1889 => 3.5223, std.dev.: 0.0055) MultiSource/Applications/treecc/treecc: 10.45% (1.9270 => 2.1284, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 10.45% (0.2995 => 0.3308, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.44% (0.0977 => 0.1079, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 10.40% (0.3220 => 0.3555, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.39% (0.1569 => 0.1732, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.38% (0.2966 => 0.3274, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.36% (0.2914 => 0.3216, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.35% (0.1865 => 0.2058, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.34% (0.1276 => 0.1408, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.28% (1.9828 => 2.1867, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 10.27% (0.2726 => 0.3006, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.27% (0.5637 => 0.6216, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/09-vor/vor: 10.26% (0.2925 => 0.3225, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.26% (0.1014 => 0.1118, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.23% (0.7460 => 0.8223, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 10.19% (0.3149 => 0.3470, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 10.16% (0.3534 => 0.3893, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 10.14% (0.3107 => 0.3422, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.14% (4.9865 => 5.4920, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/except: 10.11% (0.2760 => 0.3039, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 10.06% (0.7506 => 0.8261, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hello: 10.05% (0.2607 => 0.2869, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 10.02% (0.8310 => 0.9143, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.02% (0.2655 => 0.2921, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 10.01% (0.2937 => 0.3231, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 10.00% (0.2761 => 0.3037, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.95% (0.2765 => 0.3040, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.93% (7.2180 => 7.9348, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/random: 9.93% (0.2690 => 0.2957, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 9.89% (0.2628 => 0.2888, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.84% (0.2023 => 0.2222, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.83% (0.1435 => 0.1576, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 9.77% (0.3192 => 0.3504, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 9.64% (1.0594 => 1.1615, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 9.50% (0.1789 => 0.1959, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 9.47% (0.1657 => 0.1814, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 9.47% (0.2988 => 0.3271, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.46% (0.2696 => 0.2951, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.41% (1.3245 => 1.4492, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.40% (0.3755 => 0.4108, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 9.20% (0.2945 => 0.3216, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 9.16% (14.8535 => 16.2139, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.15% (3.6692 => 4.0050, std.dev.: 0.0048) MultiSource/Benchmarks/sim/sim: 9.13% (0.3131 => 0.3417, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 8.93% (1.2749 => 1.3888, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.92% (4.3801 => 4.7708, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.92% (4.4433 => 4.8395, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.92% (0.6135 => 0.6682, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.85% (0.6576 => 0.7158, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 8.84% (8.4961 => 9.2468, std.dev.: 0.0128) MultiSource/Applications/oggenc/oggenc: 8.84% (4.6629 => 5.0749, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.72% (1.5188 => 1.6513, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.60% (0.2140 => 0.2324, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.58% (0.8818 => 0.9575, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 8.56% (0.6250 => 0.6785, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.44% (0.2321 => 0.2517, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 8.33% (0.1213 => 0.1314, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.33% (3.2742 => 3.5468, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.23% (0.3245 => 0.3512, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.17% (0.3511 => 0.3798, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 8.17% (0.4113 => 0.4449, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.06% (1.1333 => 1.2246, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 8.01% (0.1385 => 0.1496, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.98% (0.9108 => 0.9835, std.dev.: 0.0107) MultiSource/Applications/lua/lua: 7.92% (3.7467 => 4.0436, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.92% (2.1007 => 2.2670, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 7.83% (6.5754 => 7.0901, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.74% (0.4805 => 0.5177, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 7.67% (0.4003 => 0.4310, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.55% (0.2504 => 0.2693, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 7.42% (0.2008 => 0.2157, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.36% (0.3940 => 0.4230, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.36% (0.3914 => 0.4202, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.34% (1.2292 => 1.3194, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.29% (6.2785 => 6.7363, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.15% (0.1819 => 0.1949, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.08% (13.2842 => 14.2251, std.dev.: 0.0201) SingleSource/UnitTests/ObjC/trivial-interface: 7.02% (0.3578 => 0.3829, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 6.96% (0.3663 => 0.3918, std.dev.: 0.0068) SingleSource/UnitTests/ObjC/for-in: 6.94% (0.3789 => 0.4052, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 6.94% (0.3646 => 0.3899, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.90% (0.3650 => 0.3902, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 6.89% (0.3601 => 0.3849, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 6.82% (0.3623 => 0.3870, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 5.75% (16.2614 => 17.1964, std.dev.: 0.0215) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.62% (0.2243 => 0.2369, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 4.63% (14.5298 => 15.2027, std.dev.: 0.0169) MultiSource/Benchmarks/Bullet/bullet: 2.22% (33.2944 => 34.0350, std.dev.: 0.0160) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.61% (5.7573 => 7.5197, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fbench: 24.35% (1.8175 => 2.2601, std.dev.: 0.0220) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.08% (1.0895 => 1.2756, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 11.07% (1.1560 => 1.2840, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.47% (0.1322 => 0.1434, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.61% (3.1736 => 3.4150, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.43% (0.9692 => 1.0218, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: 5.38% (1.2998 => 1.3697, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0048, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.65% (0.3139 => 0.3285, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 4.46% (0.5449 => 0.5692, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.89% (1.7081 => 1.7746, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.75% (11.2619 => 11.6842, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.37% (12.0921 => 12.5001, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: 3.34% (1.9199 => 1.9840, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bisort/bisort: 2.97% (0.8239 => 0.8484, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.89% (10.7476 => 11.0577, std.dev.: 0.0478) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.19% (7.4271 => 7.5895, std.dev.: 0.0023) MultiSource/Applications/lemon/lemon: 1.84% (1.4298 => 1.4561, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5140, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9688, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2123, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1868, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5786, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1407, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5900, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.04% (8.8259 => 8.9175, std.dev.: 0.0114) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.82% (0.2670 => 0.1420, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.91% (0.4657 => 0.3916, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.10% (1.3813 => 1.2004, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.97% (1.3819 => 1.2027, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.28% (1.0460 => 0.8548, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -12.73% (0.2238 => 0.1953, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.48% (20.3410 => 18.2101, std.dev.: 0.0433) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101) SingleSource/Benchmarks/McGill/chomp: -5.63% (1.2308 => 1.1615, std.dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.07% (2.6470 => 2.5129, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.02% (1.3780 => 1.3088, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.59% (0.9996 => 0.9537, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.91% (1.7688 => 1.6996, std.dev.: 0.0058) MultiSource/Applications/siod/siod: -3.27% (3.2729 => 3.1660, std.dev.: 0.0028) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.82% (3.0263 => 2.9411, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8812, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.38% (1.9762 => 1.9291, std.dev.: 0.0061) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.98% (0.8342 => 0.8177, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.93% (0.6589 => 0.6462, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -1.91% (26.5159 => 26.0105, std.dev.: 0.0147) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.87% (0.6615 => 0.6491, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.87% (6.3560 => 6.2372, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.62% (2.5254 => 2.4844, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0062, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8636, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.3167 => 5.2533, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -1.19% (28.2225 => 27.8865, std.dev.: 0.0011) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1139, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -1.04% (84.4286 => 83.5465, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 18 00:12:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 18 Oct 2012 02:12:39 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121018071239.B8D932A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4953?compare_to=4950&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 4953, Order: 166164, Start Time: 2012-10-18 05:50:06, End Time: 2012-10-18 07:14:38 To: 4950, Order: 166163, Start Time: 2012-10-18 02:16:57, End Time: 2012-10-18 03:40:00 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== Performance Regressions: 94 (88 on baseline) Performance Improvements: 35 (35 on baseline) Existing Failures: 68 (68 on baseline) Unchanged Tests: 845 (851 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.38% (0.2179 => 0.2318, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.50% (0.9060 => 0.9468, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/05-eks/eks: 4.10% (0.4297 => 0.4473, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.85% (4.1658 => 4.3263, std.dev.: 0.0606) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.58% (0.8238 => 0.8533, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.53% (0.8697 => 0.9004, std.dev.: 0.0089) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.52% (0.8993 => 0.9310, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.38% (4.4659 => 4.6168, std.dev.: 0.0376) MultiSource/Applications/oggenc/oggenc: 3.29% (4.9451 => 5.1078, std.dev.: 0.0418) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.28% (0.8183 => 0.8451, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.23% (0.6062 => 0.6258, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.20% (0.8056 => 0.8314, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 3.19% (0.8052 => 0.8309, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.17% (0.8304 => 0.8567, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.16% (0.9052 => 0.9338, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 3.16% (0.8206 => 0.8465, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.12% (0.8296 => 0.8555, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.10% (0.8350 => 0.8609, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 3.10% (0.9046 => 0.9326, std.dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: 3.04% (6.7573 => 6.9629, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.01% (0.8413 => 0.8666, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 3.00% (0.8789 => 0.9053, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.99% (0.8052 => 0.8293, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.96% (0.8718 => 0.8976, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.94% (0.8636 => 0.8890, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.92% (0.8606 => 0.8857, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.85% (0.8350 => 0.8588, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.81% (0.8514 => 0.8753, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.79% (0.8860 => 0.9107, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.78% (0.8853 => 0.9099, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.71% (0.8656 => 0.8891, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.67% (0.8384 => 0.8608, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.63% (0.7975 => 0.8185, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.49% (0.9913 => 1.0160, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.43% (0.8096 => 0.8293, std.dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: 2.37% (15.3600 => 15.7246, std.dev.: 0.1328) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.19% (1.1545 => 1.1798, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.86% (6.6096 => 6.7328, std.dev.: 0.0119) MultiSource/Applications/hbd/hbd: 1.35% (1.4343 => 1.4536, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.30% (0.8164 => 0.8270, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 47.09% (2.9046 => 4.2725, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 36.37% (3.3761 => 4.6039, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 34.17% (0.0480 => 0.0644, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-4: 26.74% (1.6609 => 2.1050, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.18% (4.9464 => 6.1919, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 24.95% (3.7165 => 4.6436, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 23.61% (4.7659 => 5.8912, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.92% (8.2610 => 9.8237, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 18.49% (4.8489 => 5.7455, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 16.00% (1.0447 => 1.2119, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 15.94% (4.5550 => 5.2810, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.86% (2.7954 => 3.2107, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 13.78% (0.0900 => 0.1024, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 11.98% (4.9991 => 5.5979, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 11.77% (4.9495 => 5.5319, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.96% (5.3235 => 5.9067, std.dev.: 0.0039) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.10% (2.4351 => 2.6810, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.11% (0.3173 => 0.3462, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.92% (4.4560 => 4.8533, std.dev.: 0.0740) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.73% (5.1572 => 5.6074, std.dev.: 0.0213) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.47% (2.9736 => 3.2254, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 8.18% (0.1357 => 0.1468, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 7.66% (63.2434 => 68.0852, std.dev.: 0.0787) MultiSource/Applications/SIBsim4/SIBsim4: 7.63% (3.1728 => 3.4150, std.dev.: 0.0285) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 7.45% (5.4289 => 5.8331, std.dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.04% (3.7713 => 3.9990, std.dev.: 0.0826) MultiSource/Benchmarks/BitBench/drop3/drop3: 5.91% (0.2962 => 0.3137, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.72% (0.8234 => 0.8705, std.dev.: 0.0052) MultiSource/Applications/JM/lencod/lencod: 4.40% (6.6605 => 6.9535, std.dev.: 0.0316) SingleSource/Benchmarks/Shootout-C++/methcall: 4.23% (8.5705 => 8.9327, std.dev.: 0.0475) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.14% (3.7234 => 3.8775, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/neural/neural: 3.51% (1.0840 => 1.1220, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: 3.10% (23.6142 => 24.3469, std.dev.: 0.0203) MultiSource/Applications/spiff/spiff: 3.05% (2.8594 => 2.9466, std.dev.: 0.0142) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 3.04% (9.2692 => 9.5509, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/ReedSolomon: 2.77% (8.5346 => 8.7711, std.dev.: 0.0253) SingleSource/Benchmarks/Shootout/lists: 2.66% (7.2908 => 7.4850, std.dev.: 0.0157) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 2.65% (1.9295 => 1.9806, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/except: 2.55% (0.4872 => 0.4996, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.45% (1.2262 => 1.2563, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.40% (5.0217 => 5.1424, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.40% (3.5727 => 3.6584, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.35% (5.0270 => 5.1450, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.22% (6.7755 => 6.9260, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.08% (2.4622 => 2.5135, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.00% (11.4593 => 11.6883, std.dev.: 0.0609) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.56% (21.9887 => 22.3323, std.dev.: 0.0446) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.53% (5.4271 => 5.5103, std.dev.: 0.0196) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.41% (4.4222 => 4.4846, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.38% (11.5827 => 11.7431, std.dev.: 0.0184) SingleSource/Benchmarks/Misc/oourafft: 1.26% (3.7712 => 3.8186, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/flops-5: 1.23% (2.9030 => 2.9386, std.dev.: 0.0137) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.17% (1.0199 => 1.0318, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.05% (5.8315 => 5.8930, std.dev.: 0.0127) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/flops-8: -27.23% (2.5609 => 1.8635, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.76% (15.8600 => 13.0426, std.dev.: 0.2288) SingleSource/Benchmarks/Shootout-C++/ary3: -13.55% (2.0044 => 1.7328, std.dev.: 0.0318) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.87% (1.0501 => 0.9465, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/chomp: -8.90% (1.1144 => 1.0152, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -8.87% (7.0943 => 6.4647, std.dev.: 0.1481) SingleSource/Benchmarks/Misc/ffbench: -8.80% (1.4472 => 1.3198, std.dev.: 0.0328) MultiSource/Benchmarks/SciMark2-C/scimark2: -7.76% (28.5417 => 26.3280, std.dev.: 0.0358) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.71% (0.3265 => 0.3046, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.55% (6.2321 => 5.8864, std.dev.: 0.0151) MultiSource/Benchmarks/Olden/em3d/em3d: -5.29% (5.4595 => 5.1705, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout/ary3: -4.81% (2.1000 => 1.9989, std.dev.: 0.0179) MultiSource/Applications/siod/siod: -4.60% (3.6563 => 3.4882, std.dev.: 0.0110) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -4.50% (4.8642 => 4.6453, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.05% (6.1730 => 5.9229, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -3.83% (5.1343 => 4.9374, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -3.70% (0.5975 => 0.5754, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: -3.61% (0.6906 => 0.6657, std.dev.: 0.0071) MultiSource/Applications/sgefa/sgefa: -3.50% (0.3600 => 0.3474, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -3.48% (4.8529 => 4.6840, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -3.13% (5.6318 => 5.4553, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.95% (9.9087 => 9.6166, std.dev.: 0.0490) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.84% (5.4994 => 5.3432, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.65% (6.0201 => 5.8608, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.62% (4.9731 => 4.8427, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/fbench: -2.43% (3.3854 => 3.3030, std.dev.: 0.0226) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -2.28% (1.6043 => 1.5677, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -1.82% (6.3939 => 6.2776, std.dev.: 0.0107) MultiSource/Benchmarks/PAQ8p/paq8p: -1.79% (91.7035 => 90.0635, std.dev.: 0.2626) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.63% (4.7395 => 4.6623, std.dev.: 0.0067) MultiSource/Applications/aha/aha: -1.39% (3.3419 => 3.2956, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.35% (4.2463 => 4.1889, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.35% (4.7442 => 4.6803, std.dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.23% (1.5306 => 1.5117, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -1.15% (3.3958 => 3.3569, std.dev.: 0.0114) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.27% (16.4032 => 16.3591, std.dev.: 0.1113) MultiSource/Applications/obsequi/Obsequi: 1.03% (1.0403 => 1.0510, std.dev.: 0.0206) MultiSource/Applications/sqlite3/sqlite3: 0.54% (0.6332 => 0.6366, std.dev.: 0.0086) MultiSource/Benchmarks/McCat/08-main/main: 2.97% (0.1786 => 0.1839, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.15% (0.1618 => 0.1669, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.41% (0.3203 => 0.3190, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.67% (0.2456 => 0.2415, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.38% (0.3327 => 0.3281, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.63% (0.2259 => 0.2341, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/bigfib: -0.34% (0.5923 => 0.5903, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/mandel: 9.86% (0.0436 => 0.0479, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.67% (0.3285 => 0.3263, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 0.92% (0.1952 => 0.1970, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -18.00% (0.0250 => 0.0205, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.98% (0.0205 => 0.0207, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.27% (0.0398 => 0.0415, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 21.94% (0.0237 => 0.0289, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.33% (0.0300 => 0.0301, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 12.60% (0.0365 => 0.0411, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 41.18% (0.0136 => 0.0192) SingleSource/UnitTests/Vector/Altivec/test1: 57.48% (0.0127 => 0.0200, std.dev.: 0.0021) SingleSource/UnitTests/byval-alignment: -0.32% (0.0317 => 0.0316, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -1.98% (0.1465 => 0.1436, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 5.92% (1.1116 => 1.1774, std.dev.: 0.0463) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 11.16% (0.1380 => 0.1534, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.29% (0.4083 => 0.4071, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.56% (0.1474 => 0.1392, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.26% (0.0635 => 0.0643, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 49.48% (0.0192 => 0.0287, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.69% (0.0619 => 0.0559, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.13% (1.1431 => 1.2932, std.dev.: 0.0153) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 34.78% (0.0023 => 0.0031, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2500.00% (0.0001 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.38% (0.0576 => 0.0630, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.03% (0.0246 => 0.0251, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -7.16% (0.8014 => 0.7440, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 0.72% (2.1525 => 2.1679, std.dev.: 0.0068) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 21.43% (0.0056 => 0.0068, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/McGill/chomp: 6.58% (0.1565 => 0.1668, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.19% (0.1983 => 0.2086, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.34% (0.9074 => 0.9468, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.54% (0.8697 => 0.9005, std.dev.: 0.0118) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.50% (0.8995 => 0.9310, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.50% (0.8317 => 0.8608, std.dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: 3.43% (6.7320 => 6.9629, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.35% (0.8177 => 0.8451, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.30% (0.8716 => 0.9004, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.29% (0.8261 => 0.8533, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.28% (0.8050 => 0.8314, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.25% (0.8286 => 0.8555, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.24% (0.8611 => 0.8890, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 3.18% (0.8204 => 0.8465, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.11% (0.9056 => 0.9338, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 3.08% (0.8331 => 0.8588, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.04% (0.8048 => 0.8293, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.03% (0.8712 => 0.8976, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.02% (0.8597 => 0.8857, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 3.01% (0.8066 => 0.8309, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.99% (0.8359 => 0.8609, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 2.92% (4.9628 => 5.1078, std.dev.: 0.0418) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.92% (0.8420 => 0.8666, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.83% (0.9069 => 0.9326, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.82% (0.8805 => 0.9053, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.76% (0.8518 => 0.8753, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.76% (0.8855 => 0.9099, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.75% (0.7966 => 0.8185, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.75% (0.8338 => 0.8567, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.71% (0.8656 => 0.8891, std.dev.: 0.0050) MultiSource/Applications/JM/lencod/lencod: 2.59% (15.3280 => 15.7246, std.dev.: 0.1328) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.56% (0.8086 => 0.8293, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.54% (0.9908 => 1.0160, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.50% (0.8885 => 0.9107, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.39% (0.4559 => 0.4668, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.90% (6.6074 => 6.7328, std.dev.: 0.0119) MultiSource/Applications/hbd/hbd: 1.87% (1.4269 => 1.4536, std.dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 1.58% (1.1271 => 1.1449, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.52% (1.6386 => 1.6635, std.dev.: 0.0079) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.50% (0.8148 => 0.8270, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 1.43% (3.8189 => 3.8734, std.dev.: 0.0129) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 47.58% (2.8951 => 4.2725, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 36.37% (3.3761 => 4.6039, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-4: 27.34% (1.6531 => 2.1050, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.21% (4.9453 => 6.1919, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 25.00% (3.7148 => 4.6436, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 23.26% (4.7794 => 5.8912, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 19.93% (0.0537 => 0.0644, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.67% (8.2783 => 9.8237, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 18.07% (4.8660 => 5.7455, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 16.51% (4.5327 => 5.2810, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 15.75% (1.0470 => 1.2119, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 14.69% (2.7995 => 3.2107, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 11.97% (4.9994 => 5.5979, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 11.83% (4.9469 => 5.5319, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.44% (4.3552 => 4.8533, std.dev.: 0.0740) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.99% (5.3218 => 5.9067, std.dev.: 0.0039) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.18% (2.4333 => 2.6810, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.76% (5.1557 => 5.6074, std.dev.: 0.0213) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.66% (0.3186 => 0.3462, std.dev.: 0.0037) MultiSource/Benchmarks/BitBench/drop3/drop3: 8.66% (0.2887 => 0.3137, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.41% (2.9753 => 3.2254, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 7.76% (63.1822 => 68.0852, std.dev.: 0.0787) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 7.65% (5.4187 => 5.8331, std.dev.: 0.0165) MultiSource/Applications/SIBsim4/SIBsim4: 7.14% (3.1873 => 3.4150, std.dev.: 0.0285) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.26% (3.7192 => 3.8775, std.dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: 3.68% (6.7064 => 6.9535, std.dev.: 0.0316) MultiSource/Benchmarks/FreeBench/neural/neural: 3.50% (1.0841 => 1.1220, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: 3.26% (23.5781 => 24.3469, std.dev.: 0.0203) MultiSource/Applications/spiff/spiff: 3.17% (2.8561 => 2.9466, std.dev.: 0.0142) SingleSource/Benchmarks/Misc/ReedSolomon: 2.80% (8.5322 => 8.7711, std.dev.: 0.0253) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.71% (9.2989 => 9.5509, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 2.61% (1.9302 => 1.9806, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.54% (3.5679 => 3.6584, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.37% (5.0261 => 5.1450, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.35% (5.0243 => 5.1424, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.32% (41.4238 => 42.3842, std.dev.: 0.2494) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.22% (6.7755 => 6.9260, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/lists: 2.01% (7.3375 => 7.4850, std.dev.: 0.0157) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.98% (2.4647 => 2.5135, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.83% (1.2337 => 1.2563, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.57% (2.9096 => 2.9552, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.50% (11.5690 => 11.7431, std.dev.: 0.0184) SingleSource/Benchmarks/Misc/flops-5: 1.48% (2.8957 => 2.9386, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.48% (5.4300 => 5.5103, std.dev.: 0.0196) SingleSource/Benchmarks/Shootout-C++/hash2: 1.18% (3.4237 => 3.4641, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.14% (4.4340 => 4.4846, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/oourafft: 1.13% (3.7758 => 3.8186, std.dev.: 0.0102) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/flops-8: -27.23% (2.5609 => 1.8635, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: -13.36% (1.9999 => 1.7328, std.dev.: 0.0318) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -10.94% (14.6451 => 13.0426, std.dev.: 0.2288) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -10.37% (7.2130 => 6.4647, std.dev.: 0.1481) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -9.96% (1.0512 => 0.9465, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/chomp: -9.49% (1.1216 => 1.0152, std.dev.: 0.0065) MultiSource/Benchmarks/SciMark2-C/scimark2: -7.89% (28.5821 => 26.3280, std.dev.: 0.0358) SingleSource/Benchmarks/Misc/ffbench: -7.68% (1.4296 => 1.3198, std.dev.: 0.0328) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.82% (0.3269 => 0.3046, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.48% (6.2275 => 5.8864, std.dev.: 0.0151) MultiSource/Benchmarks/Olden/em3d/em3d: -5.37% (5.4641 => 5.1705, std.dev.: 0.0094) MultiSource/Applications/siod/siod: -4.81% (3.6643 => 3.4882, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout/ary3: -4.58% (2.0949 => 1.9989, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.01% (6.1706 => 5.9229, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -3.95% (4.8362 => 4.6453, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -3.76% (5.1305 => 4.9374, std.dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: -3.66% (0.6910 => 0.6657, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -3.30% (4.8436 => 4.6840, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -3.18% (5.6343 => 5.4553, std.dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: -3.10% (0.3585 => 0.3474, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.93% (9.9065 => 9.6166, std.dev.: 0.0490) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.80% (5.4972 => 5.3432, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.68% (6.0224 => 5.8608, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.53% (4.9686 => 4.8427, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/fbench: -2.39% (3.3840 => 3.3030, std.dev.: 0.0226) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -2.29% (0.5889 => 0.5754, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -1.86% (91.7701 => 90.0635, std.dev.: 0.2626) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.81% (4.7482 => 4.6623, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -1.57% (3.4104 => 3.3569, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -1.56% (6.3772 => 6.2776, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.36% (4.7449 => 4.6803, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.36% (4.2466 => 4.1889, std.dev.: 0.0035) MultiSource/Applications/aha/aha: -1.32% (3.3398 => 3.2956, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.25% (1.5308 => 1.5117, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.19% (1.5866 => 1.5677, std.dev.: 0.0056) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.53% (16.4461 => 16.3591, std.dev.: 0.1113) MultiSource/Applications/obsequi/Obsequi: 2.42% (1.0262 => 1.0510, std.dev.: 0.0206) MultiSource/Applications/sqlite3/sqlite3: 0.54% (0.6332 => 0.6366, std.dev.: 0.0086) MultiSource/Benchmarks/McCat/08-main/main: 0.44% (0.1831 => 0.1839, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.06% (0.1559 => 0.1669, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.15% (0.3123 => 0.3190, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.95% (0.2463 => 0.2415, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.88% (0.3344 => 0.3281, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.97% (0.2364 => 0.2341, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/bigfib: -1.78% (0.6010 => 0.5903, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/mandel: 11.66% (0.0429 => 0.0479, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.09% (0.3266 => 0.3263, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 0.05% (0.1969 => 0.1970, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -8.48% (0.0224 => 0.0205, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 68.29% (0.0123 => 0.0207, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.72% (0.0408 => 0.0415, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 13.78% (0.0254 => 0.0289, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.33% (0.0302 => 0.0301, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 7.03% (0.0384 => 0.0411, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 1.05% (0.0190 => 0.0192) SingleSource/UnitTests/Vector/Altivec/test1: 11.11% (0.0180 => 0.0200, std.dev.: 0.0021) SingleSource/UnitTests/byval-alignment: 37.39% (0.0230 => 0.0316, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.14% (0.1438 => 0.1436, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 3.93% (1.1329 => 1.1774, std.dev.: 0.0463) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 4.92% (0.1462 => 0.1534, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.23% (0.4164 => 0.4071, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.68% (0.1369 => 0.1392, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.31% (0.0641 => 0.0643, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 47.18% (0.0195 => 0.0287, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.29% (0.0578 => 0.0559, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.07% (1.1437 => 1.2932, std.dev.: 0.0153) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.48% (0.0627 => 0.0630, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 39.44% (0.0180 => 0.0251, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -7.20% (0.8017 => 0.7440, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: -0.70% (2.1832 => 2.1679, std.dev.: 0.0068) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 9.68% (0.0062 => 0.0068, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 18 00:23:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 18 Oct 2012 02:23:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121018072304.8DD602A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4954?compare_to=4951&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4954, Order: 166164, Start Time: 2012-10-18 06:02:12, End Time: 2012-10-18 07:24:59 To: 4951, Order: 166163, Start Time: 2012-10-18 03:00:24, End Time: 2012-10-18 04:21:02 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (75 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 36 (179 on baseline) Performance Improvements: 20 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 90 (15 on baseline) Unchanged Tests: 896 (664 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.58% (1.9936 => 2.2046, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/BoolLiteralTest: 9.53% (0.4416 => 0.4837, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.78% (0.7253 => 0.7382, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.10% (8.3233 => 8.4148, std.dev.: 0.0195) Performance Regressions - Execution Time ---------------------------------------- SingleSource/UnitTests/Vector/SSE/sse_stepfft: 15.66% (0.4682 => 0.5415, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 13.39% (3.2078 => 3.6372, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 11.63% (5.4384 => 6.0709, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.10% (3.7086 => 4.0461, std.dev.: 0.0107) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.12% (1.0934 => 1.1712, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 4.47% (6.5569 => 6.8501, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 4.44% (7.9846 => 8.3392, std.dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 3.82% (27.8408 => 28.9030, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.81% (2.5754 => 2.6736, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: 3.74% (18.2715 => 18.9557, std.dev.: 0.0873) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.74% (13.3891 => 13.8903, std.dev.: 0.0288) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.74% (4.4042 => 4.5689, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-8: 3.57% (1.7613 => 1.8242, std.dev.: 0.0052) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 3.39% (1.4909 => 1.5415, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 3.03% (9.1967 => 9.4757, std.dev.: 0.0050) MultiSource/Applications/spiff/spiff: 2.95% (2.9405 => 3.0272, std.dev.: 0.0103) SingleSource/Benchmarks/McGill/queens: 2.72% (2.1973 => 2.2570, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 2.65% (31.5029 => 32.3380, std.dev.: 0.0058) MultiSource/Benchmarks/PAQ8p/paq8p: 2.55% (85.6671 => 87.8543, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.40% (0.6461 => 0.6616, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.40% (1.7016 => 1.7424, std.dev.: 0.0033) MultiSource/Applications/lemon/lemon: 2.34% (1.4513 => 1.4853, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.21% (1.3168 => 1.3459, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 1.58% (9.7242 => 9.8780, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.53% (1.2984 => 1.3183, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.53% (4.5651 => 4.6350, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 1.41% (11.7755 => 11.9415, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 1.37% (10.0844 => 10.2230, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.33% (2.2879 => 2.3183, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.18% (6.6606 => 6.7393, std.dev.: 0.0150) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.12% (1.0217 => 1.0331) SingleSource/Benchmarks/Shootout/lists: 1.10% (6.2259 => 6.2941, std.dev.: 0.0064) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/05-eks/eks: -6.57% (0.4751 => 0.4439, std.dev.: 0.0027) MultiSource/Applications/sgefa/sgefa: -5.97% (0.3533 => 0.3322, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -2.52% (5.5837 => 5.4429, std.dev.: 0.0176) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -2.22% (5.5213 => 5.3987, std.dev.: 0.0058) MultiSource/Benchmarks/mafft/pairlocalalign: -2.15% (10.7933 => 10.5616, std.dev.: 0.0088) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: -25.67% (0.6974 => 0.5184, std.dev.: 0.0180) SingleSource/Benchmarks/McGill/chomp: -13.46% (1.0960 => 0.9485, std.dev.: 0.0196) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -10.07% (0.3625 => 0.3260, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -6.24% (1.2871 => 1.2068, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.54% (29.6489 => 28.3017, std.dev.: 0.1304) SingleSource/UnitTests/Vector/multiplies: -4.44% (2.5098 => 2.3983, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.22% (0.8549 => 0.8188, std.dev.: 0.0012) MultiSource/Applications/lua/lua: -3.75% (26.0763 => 25.0995, std.dev.: 0.0082) SingleSource/Regression/C/uint64_to_float: -2.88% (0.5693 => 0.5529) MultiSource/Applications/hexxagon/hexxagon: -2.60% (12.5223 => 12.1973, std.dev.: 0.0044) MultiSource/Benchmarks/llubenchmark/llu: -2.36% (3.8486 => 3.7577, std.dev.: 0.0257) SingleSource/Benchmarks/Misc/flops-5: -1.98% (1.5071 => 1.4773, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -1.80% (4.8774 => 4.7898, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -1.61% (9.1140 => 8.9670, std.dev.: 0.0138) SingleSource/Benchmarks/Misc/flops-6: -1.02% (1.4257 => 1.4111, std.dev.: 0.0008) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.92% (0.6116 => 0.6060, std.dev.: 0.0052) MultiSource/Applications/SPASS/SPASS: -0.38% (17.1337 => 17.0678, std.dev.: 0.0330) MultiSource/Benchmarks/Bullet/bullet: -0.49% (56.0472 => 55.7737, std.dev.: 0.0788) MultiSource/Benchmarks/MallocBench/gs/gs: -0.54% (4.5251 => 4.5008, std.dev.: 0.0245) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.43% (0.0465 => 0.0463, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.21% (0.0467 => 0.0466, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.46% (0.0435 => 0.0433, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.23% (0.0437 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.47% (0.0424 => 0.0422, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.24% (0.0425 => 0.0424, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.24% (0.0416 => 0.0415, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.24% (0.0419 => 0.0418, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0434 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.69% (0.0437 => 0.0434, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.47% (0.0429 => 0.0427, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.46% (0.0431 => 0.0429, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.48% (0.0420 => 0.0418, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.24% (0.0420 => 0.0419, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.23% (0.0426 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.47% (0.0428 => 0.0426, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.46% (0.0438 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.95% (0.0440 => 0.0453, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.24% (0.0414 => 0.0413, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.48% (0.0416 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.16% (0.0430 => 0.0425, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.93% (0.0430 => 0.0426, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.24% (0.0419 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.49% (0.0410 => 0.0408, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.49% (0.0411 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.49% (0.0410 => 0.0408, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.24% (0.0410 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.45% (0.0446 => 0.0444, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.45% (0.0447 => 0.0445, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.49% (0.0408 => 0.0406, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.49% (0.0409 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.73% (0.0410 => 0.0407, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.24% (0.0411 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.48% (0.0417 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.48% (0.0418 => 0.0416, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.68% (1.2871 => 1.3087, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.15% (8.1841 => 8.1964, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.04% (0.7740 => 0.7743, std.dev.: 0.0204) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.83% (0.0362 => 0.0359, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 2.52% (0.1430 => 0.1466, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 1.52% (0.1642 => 0.1667, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.51% (0.2138 => 0.2149, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.81% (63.2438 => 55.7737, std.dev.: 0.0788) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 1.71% (0.1639 => 0.1667, std.dev.: 0.0000) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 35.87% (14.1553 => 19.2328, std.dev.: 0.0245) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.85% (3.4629 => 5.7778, std.dev.: 0.1320) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13619.44% (0.0720 => 9.8780, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9976400.00% (0.0001 => 9.9765, std.dev.: 0.0056) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 62.41% (0.2554 => 0.4148, std.dev.: 0.0024) MultiSource/Benchmarks/PAQ8p/paq8p: 48.23% (10.3673 => 15.3679, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/distray/distray: 36.36% (0.1056 => 0.1440, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 36.25% (0.1622 => 0.2210, std.dev.: 0.0052) SingleSource/UnitTests/vla: 30.14% (0.0355 => 0.0462) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 25.20% (1.7609 => 2.2046, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 20.02% (0.0834 => 0.1001, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/exptree: 19.90% (0.0814 => 0.0976, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 19.60% (0.6675 => 0.7983, std.dev.: 0.0219) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.29% (7.0540 => 8.4148, std.dev.: 0.0195) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 19.12% (0.5105 => 0.6081, std.dev.: 0.0180) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.60% (0.0871 => 0.1033, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 18.44% (0.1432 => 0.1696, std.dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/n-body: 17.56% (0.0746 => 0.0877, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.94% (2.2022 => 2.5753, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 16.86% (0.1655 => 0.1934, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.83% (0.5020 => 0.5865, std.dev.: 0.0217) MultiSource/Applications/d/make_dparser: 15.96% (3.3354 => 3.8676, std.dev.: 0.0151) MultiSource/Benchmarks/Fhourstones/fhourstones: 15.77% (0.1566 => 0.1813, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.52% (1.5415 => 1.7653, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.45% (0.6450 => 0.7382, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 14.13% (0.2271 => 0.2592, std.dev.: 0.0029) MultiSource/Applications/JM/ldecod/ldecod: 13.98% (10.4361 => 11.8954, std.dev.: 0.0284) MultiSource/Benchmarks/McCat/18-imp/imp: 13.82% (0.3423 => 0.3896, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.71% (0.1510 => 0.1717, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 13.63% (0.7115 => 0.8085, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/power/power: 13.54% (0.1440 => 0.1635, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.39% (0.1695 => 0.1922, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.35% (0.1236 => 0.1401, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.15% (0.3307 => 0.3742, std.dev.: 0.0057) MultiSource/Benchmarks/nbench/nbench: 13.15% (1.1840 => 1.3397, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/oourafft: 13.10% (0.3282 => 0.3712, std.dev.: 0.0084) MultiSource/Applications/oggenc/oggenc: 13.05% (5.7591 => 6.5106, std.dev.: 0.0110) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.89% (0.1032 => 0.1165, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.75% (0.0933 => 0.1052, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.71% (0.1330 => 0.1499, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 12.70% (8.1363 => 9.1696, std.dev.: 0.0021) MultiSource/Applications/lua/lua: 12.67% (3.8723 => 4.3629, std.dev.: 0.0134) MultiSource/Applications/Burg/burg: 12.39% (1.1642 => 1.3085, std.dev.: 0.0143) MultiSource/Benchmarks/Olden/em3d/em3d: 12.39% (0.1695 => 0.1905, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/tsp/tsp: 12.34% (0.1175 => 0.1320, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 12.29% (1.0722 => 1.2040, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 12.28% (0.7433 => 0.8346, std.dev.: 0.0187) MultiSource/Applications/aha/aha: 12.16% (0.1151 => 0.1291, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.13% (4.2646 => 4.7818, std.dev.: 0.0092) MultiSource/Applications/treecc/treecc: 12.05% (2.0273 => 2.2716, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.97% (1.3050 => 1.4612, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/football/football: 11.90% (0.8921 => 0.9983, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.86% (0.1940 => 0.2170, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/mst/mst: 11.78% (0.1163 => 0.1300, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.77% (0.2107 => 0.2355, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.74% (0.4615 => 0.5157, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.56% (0.2700 => 0.3012, std.dev.: 0.0046) SingleSource/UnitTests/SignlessTypes/rem: 11.54% (0.1144 => 0.1276, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 11.52% (0.6456 => 0.7200, std.dev.: 0.0204) MultiSource/Applications/viterbi/viterbi: 11.51% (0.1555 => 0.1734, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.46% (0.9765 => 1.0884, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.45% (0.1625 => 0.1811, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 11.44% (0.1337 => 0.1490, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.42% (0.4879 => 0.5436, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 11.36% (9.4845 => 10.5616, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.31% (0.5860 => 0.6523, std.dev.: 0.0066) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.30% (0.3177 => 0.3536, std.dev.: 0.0021) MultiSource/Benchmarks/sim/sim: 11.16% (0.3387 => 0.3765, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.16% (0.8067 => 0.8967, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.09% (0.2758 => 0.3064, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.03% (0.2603 => 0.2890, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.92% (0.1117 => 0.1239, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.73% (0.1584 => 0.1754, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 10.68% (0.7835 => 0.8672, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.59% (0.2266 => 0.2506, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.40% (0.5569 => 0.6148, std.dev.: 0.0044) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.36% (7.9617 => 8.7866, std.dev.: 0.0160) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.35% (0.3121 => 0.3444, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/neural/neural: 10.25% (0.1463 => 0.1613, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 10.24% (1.1861 => 1.3076, std.dev.: 0.0075) SingleSource/UnitTests/ObjC/exceptions-4: 10.22% (0.3543 => 0.3905, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 10.19% (2.2969 => 2.5310, std.dev.: 0.0075) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.16% (0.8172 => 0.9002, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/ReedSolomon: 10.15% (0.2049 => 0.2257, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/trivial-interface: 10.11% (0.3473 => 0.3824, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.08% (0.3927 => 0.4323, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.07% (1.4186 => 1.5614, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.06% (0.3826 => 0.4211, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/synchronized: 10.03% (0.3561 => 0.3918, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.99% (0.3543 => 0.3897, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.98% (0.3516 => 0.3867, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.98% (0.3828 => 0.4210, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.95% (0.3497 => 0.3845, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 9.91% (0.4289 => 0.4714, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/for-in: 9.88% (0.3694 => 0.4059, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 9.88% (1.5603 => 1.7144, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/hash2: 9.87% (0.4620 => 0.5076, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 9.80% (0.3886 => 0.4267, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 9.78% (0.3180 => 0.3491, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.68% (0.3441 => 0.3774, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.60% (0.1438 => 0.1576, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/health/health: 9.54% (0.1268 => 0.1389, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.42% (0.1125 => 0.1231, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.42% (0.3865 => 0.4229, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/lists: 9.35% (0.3422 => 0.3742, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.29% (2.2024 => 2.4070, std.dev.: 0.0652) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.27% (0.1143 => 0.1249, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.18% (4.9449 => 5.3987, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.16% (0.4203 => 0.4588, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.15% (0.5981 => 0.6528, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.01% (0.2065 => 0.2251, std.dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: 9.00% (21.9371 => 23.9113, std.dev.: 0.0303) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.85% (0.4103 => 0.4466, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.82% (5.0018 => 5.4429, std.dev.: 0.0176) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.80% (0.4636 => 0.5044, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 8.72% (0.6030 => 0.6556, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 8.66% (0.3684 => 0.4003, std.dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.60% (0.1906 => 0.2070, std.dev.: 0.0038) SingleSource/UnitTests/ObjC++/Hello: 8.56% (0.5925 => 0.6432, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 8.36% (0.1268 => 0.1374, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.29% (0.3427 => 0.3711, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.06% (0.8101 => 0.8754, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sieve: 8.05% (0.3603 => 0.3893, std.dev.: 0.0108) SingleSource/UnitTests/ObjC++/property-reference: 7.96% (0.7326 => 0.7909, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 7.91% (17.1811 => 18.5402, std.dev.: 0.0211) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.67% (0.3650 => 0.3930, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.53% (14.3668 => 15.4486, std.dev.: 0.0686) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.30% (0.2891 => 0.3102, std.dev.: 0.0075) SingleSource/Regression/C++/ofstream_ctor: 7.23% (0.2905 => 0.3115, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.21% (0.3136 => 0.3362, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 7.14% (0.2831 => 0.3033, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.12% (0.3162 => 0.3387, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary: 7.05% (0.3232 => 0.3460, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.3283 => 0.3514, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/methcall: 6.95% (0.2877 => 0.3077, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.92% (2.0665 => 2.2095, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary2: 6.87% (0.3379 => 0.3611, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.86% (0.2871 => 0.3068, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.86% (0.2872 => 0.3069, std.dev.: 0.0042) MultiSource/Applications/sgefa/sgefa: 6.85% (0.3109 => 0.3322, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 6.84% (0.3098 => 0.3310, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/fibo: 6.57% (0.2725 => 0.2904, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.57% (0.2756 => 0.2937, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.55% (0.3052 => 0.3252, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hello: 6.48% (0.2714 => 0.2890, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.17% (3.8922 => 4.1324, std.dev.: 0.0646) MultiSource/Applications/hexxagon/hexxagon: 6.01% (1.2842 => 1.3614, std.dev.: 0.0130) MultiSource/Benchmarks/Olden/bh/bh: 5.82% (0.3092 => 0.3272, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.72% (0.2430 => 0.2569, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.34% (0.1892 => 0.1993, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 3.26% (0.4299 => 0.4439, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.80% (1.1194 => 1.1507, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0260) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 18.29% (1.1145 => 1.3183, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 17.63% (0.9957 => 1.1712, std.dev.: 0.0024) MultiSource/Applications/aha/aha: 15.12% (3.1595 => 3.6372, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 12.62% (0.4808 => 0.5415, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.17% (3.6395 => 4.0461, std.dev.: 0.0107) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8904 => 3.2024, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 10.00% (1.1396 => 1.2536, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 8.29% (0.9540 => 1.0331) SingleSource/Benchmarks/Shootout-C++/hash2: 6.81% (3.1578 => 3.3730, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 5.24% (6.5088 => 6.8501, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: 4.32% (0.4162 => 0.4342, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.12% (4.3882 => 4.5689, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 3.95% (9.1159 => 9.4757, std.dev.: 0.0050) MultiSource/Benchmarks/mafft/pairlocalalign: 3.80% (27.8444 => 28.9030, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 3.41% (2.1825 => 2.2570, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.36% (13.4384 => 13.8903, std.dev.: 0.0288) MultiSource/Benchmarks/PAQ8p/paq8p: 3.28% (85.0658 => 87.8543, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 3.16% (2.9346 => 3.0272, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.85% (4.2280 => 4.3483, std.dev.: 0.0310) MultiSource/Applications/lemon/lemon: 2.72% (1.4460 => 1.4853, std.dev.: 0.0067) MultiSource/Benchmarks/nbench/nbench: 2.56% (11.6436 => 11.9415, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.24% (8.1563 => 8.3392, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.21% (1.7254 => 1.7635, std.dev.: 0.0061) SingleSource/Regression/C/uint64_to_float: 2.14% (0.5413 => 0.5529) MultiSource/Benchmarks/Olden/bisort/bisort: 1.73% (0.8333 => 0.8477, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 1.40% (6.6465 => 6.7393, std.dev.: 0.0150) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.30% (2.6546 => 2.6890, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1310, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -80.01% (0.8651 => 0.1729, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.20% (5.2763 => 3.2608, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.51% (5.3855 => 3.6886, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.02% (5.3526 => 3.6920, std.dev.: 0.0039) SingleSource/UnitTests/Vector/constpool: -14.60% (54.1659 => 46.2567, std.dev.: 0.0459) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.33% (2.9384 => 2.6349, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -7.16% (22.1758 => 20.5879, std.dev.: 0.0418) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -44.50% (0.0400 => 0.0222, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -33.37% (1.1492 => 0.7657, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: -25.54% (0.6962 => 0.5184, std.dev.: 0.0180) SingleSource/Benchmarks/McGill/chomp: -23.34% (1.2373 => 0.9485, std.dev.: 0.0196) SingleSource/Benchmarks/Misc/flops-6: -16.63% (1.6925 => 1.4111, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -11.51% (3.3453 => 2.9604, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -11.01% (1.5373 => 1.3680, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/mason/mason: -7.73% (0.2161 => 0.1994, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.86% (4.8142 => 4.4838, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-5: -6.71% (1.5835 => 1.4773, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -6.23% (1.2870 => 1.2068, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -6.05% (2.5528 => 2.3983, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.86% (0.3463 => 0.3260, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0115) MultiSource/Benchmarks/sim/sim: -5.12% (5.0483 => 4.7898, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -4.98% (19.9488 => 18.9557, std.dev.: 0.0873) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.97% (1.6805 => 1.5969, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.95% (0.8614 => 0.8188, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -4.94% (1.8329 => 1.7424, std.dev.: 0.0033) MultiSource/Applications/siod/siod: -4.06% (3.2827 => 3.1494, std.dev.: 0.0022) MultiSource/Applications/lua/lua: -3.81% (26.0924 => 25.0995, std.dev.: 0.0082) MultiSource/Applications/hexxagon/hexxagon: -2.21% (12.4730 => 12.1973, std.dev.: 0.0044) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.04% (2.7294 => 2.6736, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6829, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.59% (1.3677 => 1.3459, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.56% (1.5660 => 1.5415, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -1.55% (9.5636 => 9.4158, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-8: -1.53% (1.8525 => 1.8242, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/power/power: -1.53% (1.1277 => 1.1105, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: -1.05% (5.2636 => 5.2085, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.02% (4.5009 => 4.4552, std.dev.: 0.0013) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 15.89% (0.5229 => 0.6060, std.dev.: 0.0052) MultiSource/Applications/SPASS/SPASS: 13.87% (14.9895 => 17.0678, std.dev.: 0.0330) MultiSource/Benchmarks/MallocBench/gs/gs: 9.50% (4.1105 => 4.5008, std.dev.: 0.0245) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.46% (1.1048 => 1.3087, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.50% (7.1582 => 8.1964, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.45% (0.6222 => 0.7743, std.dev.: 0.0204) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35800.00% (0.0001 => 0.0359, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -1.28% (0.1485 => 0.1466, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.56% (0.2116 => 0.2149, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 18 00:30:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 18 Oct 2012 02:30:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121018073011.C8B5D2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/4955?compare_to=4952&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4955, Order: 166164, Start Time: 2012-10-18 06:03:10, End Time: 2012-10-18 07:33:08 To: 4952, Order: 166163, Start Time: 2012-10-18 03:42:00, End Time: 2012-10-18 05:07:52 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 64 (189 on baseline) Performance Improvements: 52 (30 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 926 (685 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 34.28% (0.9575 => 1.2857, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.71% (4.0050 => 4.1135, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.29% (0.7065 => 0.7227, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.20% (0.5177 => 0.5291, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.91% (0.5334 => 0.5436, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.78% (0.6682 => 0.6801, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.53% (1.2710 => 1.2904, std.dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 1.41% (7.0901 => 7.1900, std.dev.: 0.0042) MultiSource/Applications/oggenc/oggenc: 1.31% (5.0749 => 5.1414, std.dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 31.66% (3.5668 => 4.6961, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 23.72% (0.9537 => 1.1799, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.77% (4.1655 => 4.9473, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 18.51% (5.5332 => 6.5576) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 16.96% (4.0330 => 4.7170, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 16.39% (2.1153 => 2.4619, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 14.59% (0.4721 => 0.5410, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 14.43% (4.1002 => 4.6917, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 11.60% (5.4097 => 6.0371, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.66% (3.6456 => 4.0341, std.dev.: 0.0150) SingleSource/Benchmarks/Misc/fp-convert: 9.68% (3.3454 => 3.6691, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.15% (4.7175 => 5.1490, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.58% (4.8899 => 5.3093, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.08% (4.3501 => 4.6580, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 6.75% (8.5487 => 9.1258, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 6.53% (4.9035 => 5.2235, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.44% (4.1534 => 4.4208, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.32% (4.3779 => 4.6546, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.69% (79.7371 => 84.2723, std.dev.: 0.1886) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.05% (0.2374 => 0.2494, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.98% (5.9543 => 6.2507, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 4.89% (7.9556 => 8.3449, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 4.52% (5.2118 => 5.4473, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 4.41% (4.7376 => 4.9465, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.23% (7.6518 => 7.9753, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 4.17% (18.2101 => 18.9695, std.dev.: 0.1768) MultiSource/Benchmarks/mafft/pairlocalalign: 4.17% (27.8865 => 29.0486, std.dev.: 0.0685) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 4.14% (6.5742 => 6.8463, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.01% (5.3830 => 5.5989, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 3.89% (2.9411 => 3.0556, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.80% (2.7525 => 2.8570, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.78% (2.5764 => 2.6738, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.73% (4.3960 => 4.5599, std.dev.: 0.0147) MultiSource/Benchmarks/PAQ8p/paq8p: 3.53% (83.5465 => 86.4967, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.28% (1.7746 => 1.8328, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 3.06% (1.4561 => 1.5007, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.94% (13.4620 => 13.8580, std.dev.: 0.0333) MultiSource/Benchmarks/SciMark2-C/scimark2: 2.94% (31.3880 => 32.3100, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/queens: 2.74% (2.1969 => 2.2570, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.69% (4.2493 => 4.3636, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.58% (4.4002 => 4.5138, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 2.50% (7.5671 => 7.7559, std.dev.: 0.0057) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 2.36% (2.4844 => 2.5431, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.34% (1.6996 => 1.7393, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.15% (5.1965 => 5.3083, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.02% (0.6491 => 0.6622, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 1.95% (3.8373 => 3.9123, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.90% (9.2758 => 9.4517, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/flops-6: 1.61% (1.9840 => 2.0159, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.60% (0.8177 => 0.8308, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.43% (1.2756 => 1.2939, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: 1.25% (7.5895 => 7.6847, std.dev.: 0.0098) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.10% (1.0218 => 1.0330, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.05% (4.5616 => 4.6096, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-4: 1.01% (1.1333 => 1.1447, std.dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/05-eks/eks: -7.08% (0.4449 => 0.4134, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -6.17% (0.3308 => 0.3104, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -2.93% (4.7708 => 4.6311, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -2.65% (4.8395 => 4.7114, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.56% (0.5473 => 0.5333, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: -2.49% (1.3888 => 1.3542, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.31% (0.5939 => 0.5802, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -2.29% (1.6513 => 1.6135, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.28% (0.5956 => 0.5820, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -2.26% (0.5586 => 0.5460, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -2.25% (0.6215 => 0.6075, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.24% (0.5814 => 0.5684, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -2.21% (0.5467 => 0.5346, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.21% (0.5562 => 0.5439, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.16% (0.6062 => 0.5931, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -2.11% (0.5592 => 0.5474, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -2.03% (0.5717 => 0.5601, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.00% (0.6245 => 0.6120, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.00% (0.6064 => 0.5943, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.97% (0.5794 => 0.5680, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -1.94% (0.5573 => 0.5465, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.93% (0.5844 => 0.5731, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.90% (0.5697 => 0.5589, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.84% (0.6266 => 0.6151, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.81% (0.6392 => 0.6276, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.73% (0.6658 => 0.6543, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.72% (0.6390 => 0.6280, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.68% (0.6201 => 0.6097, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.66% (0.6679 => 0.6568, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.63% (0.6680 => 0.6571, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.53% (0.6670 => 0.6568, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.46% (2.2670 => 2.2339, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.06% (6.7363 => 6.6650, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.03% (1.2246 => 1.2120, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.02% (0.9835 => 0.9735, std.dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: -25.67% (0.6974 => 0.5184, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -19.38% (1.1615 => 0.9364, std.dev.: 0.0477) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -10.09% (0.3626 => 0.3260) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -6.24% (1.2871 => 1.2068, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.77% (29.6786 => 28.2631, std.dev.: 0.0759) MultiSource/Applications/lua/lua: -4.60% (26.0105 => 24.8141, std.dev.: 0.0098) SingleSource/UnitTests/Vector/multiplies: -4.53% (2.5129 => 2.3991, std.dev.: 0.0263) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.90% (0.8548 => 0.8215, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: -3.28% (2.2601 => 2.1860, std.dev.: 0.0039) SingleSource/Regression/C/uint64_to_float: -2.88% (0.5692 => 0.5528, std.dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: -2.55% (12.5001 => 12.1809, std.dev.: 0.0027) MultiSource/Benchmarks/sim/sim: -1.92% (4.8812 => 4.7876, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -1.53% (9.0675 => 8.9290, std.dev.: 0.0097) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.43% (3.3910 => 3.3425, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.40% (1.4295 => 1.4095, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.27% (5.3404 => 5.2727, std.dev.: 0.0003) MultiSource/Applications/aha/aha: -1.19% (3.1139 => 3.0769, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 45.80% (0.8818 => 1.2857, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: 23.50% (2.0176 => 2.4918, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 17.92% (0.0826 => 0.0974, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/08-main/main: 17.34% (0.2243 => 0.2632, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.95% (0.1410 => 0.1649, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 15.77% (0.0653 => 0.0756, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 15.11% (0.0834 => 0.0960, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 15.02% (0.6283 => 0.7227, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 14.41% (0.1013 => 0.1159, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.98% (0.1588 => 0.1810, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.55% (1.1364 => 1.2904, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.52% (0.1413 => 0.1604, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.48% (0.2596 => 0.2946, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 13.46% (0.4791 => 0.5436, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 13.35% (0.4328 => 0.4906, std.dev.: 0.0092) MultiSource/Applications/hbd/hbd: 13.26% (1.3693 => 1.5509, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 13.21% (0.7038 => 0.7968, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.17% (0.0964 => 0.1091, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 13.08% (0.2721 => 0.3077, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 12.97% (0.4062 => 0.4589, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.96% (0.1327 => 0.1499, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.54% (1.4563 => 1.6389, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.53% (0.7710 => 0.8676, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/distray/distray: 12.47% (0.0818 => 0.0920, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.31% (0.5265 => 0.5913, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.13% (0.6959 => 0.7803, std.dev.: 0.0014) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.13% (0.1072 => 0.1202, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 12.11% (3.6692 => 4.1135, std.dev.: 0.0081) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.04% (3.9660 => 4.4434, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: 11.86% (0.1003 => 0.1122, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 11.77% (0.1062 => 0.1187, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.75% (0.1157 => 0.1293, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: 11.75% (0.3192 => 0.3567, std.dev.: 0.0083) MultiSource/Applications/SPASS/SPASS: 11.70% (13.8202 => 15.4368, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.65% (0.3485 => 0.3891, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.64% (0.9199 => 1.0270, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 11.62% (0.5818 => 0.6494, std.dev.: 0.0071) SingleSource/Benchmarks/McGill/chomp: 11.58% (0.1589 => 0.1773, std.dev.: 0.0052) MultiSource/Applications/lemon/lemon: 11.53% (1.0313 => 1.1502, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 11.50% (1.1061 => 1.2333, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.46% (0.4390 => 0.4893, std.dev.: 0.0137) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.33% (0.2127 => 0.2368, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.31% (0.3580 => 0.3985, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.31% (0.3899 => 0.4340, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.31% (0.3130 => 0.3484, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.27% (0.7460 => 0.8301, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.26% (0.3756 => 0.4179, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.22% (0.1569 => 0.1745, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 11.19% (0.5748 => 0.6391, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.18% (0.4016 => 0.4465, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.09% (0.3022 => 0.3357, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 11.08% (0.3293 => 0.3658, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 11.06% (0.3489 => 0.3875, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.03% (0.8698 => 0.9657, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.98% (0.1075 => 0.1193, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 10.98% (0.3453 => 0.3832, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.96% (0.2782 => 0.3087, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.92% (0.2966 => 0.3290, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 10.90% (0.3220 => 0.3571, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference: 10.86% (0.7061 => 0.7828, std.dev.: 0.0249) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.86% (0.6135 => 0.6801, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.73% (1.9828 => 2.1955, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.72% (1.2193 => 1.3500, std.dev.: 0.0205) SingleSource/Benchmarks/Shootout-C++/strcat: 10.71% (0.2726 => 0.3018, std.dev.: 0.0064) MultiSource/Applications/viterbi/viterbi: 10.69% (0.1478 => 0.1636, std.dev.: 0.0017) MultiSource/Applications/d/make_dparser: 10.65% (3.1889 => 3.5286, std.dev.: 0.0173) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.63% (0.2023 => 0.2238, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 10.55% (0.2607 => 0.2882, std.dev.: 0.0071) SingleSource/Benchmarks/Stanford/Puzzle: 10.54% (0.0977 => 0.1080, std.dev.: 0.0027) MultiSource/Applications/kimwitu++/kc: 10.51% (16.6129 => 18.3596, std.dev.: 0.0185) SingleSource/Benchmarks/Shootout-C++/except: 10.51% (0.2760 => 0.3050, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/methcall: 10.50% (0.2761 => 0.3051, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.49% (0.5577 => 0.6162, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 10.45% (0.2937 => 0.3244, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.45% (0.0995 => 0.1099, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.45% (0.5637 => 0.6226, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 10.45% (0.3149 => 0.3478, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/random: 10.45% (0.2690 => 0.2971, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/football/football: 10.45% (0.8310 => 0.9178, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 10.43% (0.2628 => 0.2902, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary: 10.33% (0.3107 => 0.3428, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.32% (0.3246 => 0.3581, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 10.32% (1.0594 => 1.1687, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 10.26% (4.6629 => 5.1414, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.24% (0.2765 => 0.3048, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.20% (7.2180 => 7.9542, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.18% (4.9865 => 5.4940, std.dev.: 0.0101) MultiSource/Applications/siod/siod: 10.15% (2.1791 => 2.4002, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.11% (0.4805 => 0.5291, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 10.08% (1.9270 => 2.1213, std.dev.: 0.0091) MultiSource/Benchmarks/Olden/mst/mst: 10.08% (0.1111 => 0.1223, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 10.06% (3.8646 => 4.2532, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.02% (0.1986 => 0.2185, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.98% (0.2696 => 0.2965, std.dev.: 0.0084) MultiSource/Applications/minisat/minisat: 9.82% (0.6744 => 0.7406, std.dev.: 0.0021) MultiSource/Applications/spiff/spiff: 9.74% (0.7506 => 0.8237, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.69% (0.3755 => 0.4119, std.dev.: 0.0124) MultiSource/Benchmarks/McCat/09-vor/vor: 9.68% (0.2925 => 0.3208, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.65% (0.1865 => 0.2045, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 9.41% (0.2945 => 0.3222, std.dev.: 0.0076) MultiSource/Applications/JM/lencod/lencod: 9.39% (14.8535 => 16.2476, std.dev.: 0.0084) MultiSource/Applications/JM/ldecod/ldecod: 9.35% (6.5754 => 7.1900, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.20% (0.6576 => 0.7181, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.20% (0.3511 => 0.3834, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/bigfib: 9.12% (0.6250 => 0.6820, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.00% (0.3245 => 0.3537, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.93% (1.3245 => 1.4428, std.dev.: 0.0077) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.93% (0.2140 => 0.2331, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.91% (0.4379 => 0.4769, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.83% (0.1789 => 0.1947, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.78% (0.1276 => 0.1388, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.68% (0.2914 => 0.3167, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 8.57% (0.1657 => 0.1799, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.51% (0.2504 => 0.2717, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 8.30% (0.3131 => 0.3391, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.12% (3.2742 => 3.5400, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.10% (0.2321 => 0.2509, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.08% (0.1435 => 0.1551, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 8.04% (3.7467 => 4.0478, std.dev.: 0.0076) MultiSource/Applications/hexxagon/hexxagon: 7.63% (1.2292 => 1.3230, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 7.27% (0.4003 => 0.4294, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.13% (13.2842 => 14.2313, std.dev.: 0.0085) SingleSource/UnitTests/ObjC/exceptions: 7.13% (0.3914 => 0.4193, std.dev.: 0.0080) SingleSource/UnitTests/ObjC/property: 6.98% (0.3940 => 0.4215, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.94% (1.1333 => 1.2120, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 6.91% (0.3789 => 0.4051, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/synchronized: 6.91% (0.3663 => 0.3916, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/trivial-interface: 6.90% (0.3578 => 0.3825, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.88% (0.9108 => 0.9735, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 6.79% (0.3623 => 0.3869, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/exceptions-4: 6.77% (0.3646 => 0.3893, std.dev.: 0.0064) SingleSource/UnitTests/ObjC/exceptions-2: 6.75% (0.3601 => 0.3844, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.58% (0.3650 => 0.3890, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.34% (2.1007 => 2.2339, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 6.33% (8.4961 => 9.0339, std.dev.: 0.1778) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.24% (1.5188 => 1.6135, std.dev.: 0.0060) MultiSource/Applications/SIBsim4/SIBsim4: 6.22% (1.2749 => 1.3542, std.dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.16% (6.2785 => 6.6650, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.03% (4.4433 => 4.7114, std.dev.: 0.0068) MultiSource/Applications/sqlite3/sqlite3: 5.75% (16.2614 => 17.1971, std.dev.: 0.0180) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.73% (4.3801 => 4.6311, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/oourafft: 5.33% (0.2008 => 0.2115, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.13% (0.2243 => 0.2358, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 4.70% (14.5298 => 15.2127, std.dev.: 0.0262) MultiSource/Applications/sgefa/sgefa: 3.64% (0.2995 => 0.3104, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5188, std.dev.: 0.0568) SingleSource/Benchmarks/Misc/fbench: 20.28% (1.8175 => 2.1860, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 18.76% (1.0895 => 1.2939, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 18.04% (0.9996 => 1.1799, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 11.16% (0.4867 => 0.5410, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 10.99% (1.1560 => 1.2831, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.62% (3.6469 => 4.0341, std.dev.: 0.0150) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 9.94% (2.8813 => 3.1677, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 8.59% (0.8273 => 0.8984, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash2: 8.12% (3.1736 => 3.4313, std.dev.: 0.0347) SingleSource/Benchmarks/Misc/fp-convert: 7.86% (3.4016 => 3.6691, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-4: 7.58% (1.0640 => 1.1447, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.30% (1.7081 => 1.8328, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 6.97% (0.4846 => 0.5184, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 6.58% (0.9692 => 1.0330, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 5.27% (1.2998 => 1.3683, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.27% (7.9275 => 8.3449, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-6: 5.00% (1.9199 => 2.0159, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 4.96% (1.4298 => 1.5007, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.40% (0.2389 => 0.2494, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.33% (2.5629 => 2.6738, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.04% (1.9144 => 1.9918, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/queens: 3.76% (2.1753 => 2.2570, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.67% (13.3668 => 13.8580, std.dev.: 0.0333) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.49% (4.4062 => 4.5599, std.dev.: 0.0147) SingleSource/Benchmarks/Misc/salsa20: 3.47% (7.4271 => 7.6847, std.dev.: 0.0098) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 3.23% (6.6320 => 6.8463, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bisort/bisort: 3.18% (0.8239 => 0.8501, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-8: 2.99% (1.9863 => 2.0456, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 2.93% (28.2225 => 29.0486, std.dev.: 0.0685) MultiSource/Benchmarks/SciMark2-C/scimark2: 2.68% (31.4682 => 32.3100, std.dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: 2.48% (3.8177 => 3.9123, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 2.45% (84.4286 => 86.4967, std.dev.: 0.0048) MultiSource/Applications/SPASS/SPASS: 2.42% (10.7476 => 11.0081, std.dev.: 0.0047) MultiSource/Applications/JM/lencod/lencod: 1.94% (7.6086 => 7.7559, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/oourafft: 1.87% (5.5130 => 5.6163, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.42% (8.3908 => 8.5096, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 1.24% (9.3358 => 9.4517, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1869, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/em3d/em3d: 1.04% (3.1071 => 3.1394, std.dev.: 0.0069) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.89% (0.2670 => 0.1418, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.15% (0.4657 => 0.3905, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.69% (1.3819 => 1.2065, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.68% (1.3813 => 1.2061, std.dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) SingleSource/Benchmarks/McGill/chomp: -23.92% (1.2308 => 0.9364, std.dev.: 0.0477) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -21.46% (1.0460 => 0.8215, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/mason/mason: -12.78% (0.2238 => 0.1952, std.dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: -9.37% (2.6470 => 2.3991, std.dev.: 0.0263) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.74% (20.3410 => 18.9695, std.dev.: 0.1768) MultiSource/Applications/lua/lua: -6.42% (26.5159 => 24.8141, std.dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -6.23% (1.2870 => 1.2068, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.73% (0.3458 => 0.3260) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.62% (1.3780 => 1.3005, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/dry: -5.38% (2.5089 => 2.3740, std.dev.: 0.0153) MultiSource/Benchmarks/sim/sim: -4.57% (5.0168 => 4.7876, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -3.72% (6.3560 => 6.1195, std.dev.: 0.0538) MultiSource/Applications/siod/siod: -3.62% (3.2729 => 3.1544, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: -2.70% (1.9762 => 1.9229, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.41% (4.5947 => 4.4838, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0009) MultiSource/Applications/aha/aha: -2.25% (3.1476 => 3.0769, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.94% (0.6589 => 0.6461, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.67% (1.7688 => 1.7393, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.61% (1.4326 => 1.4095, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: -1.31% (5.3167 => 5.2473, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/ReedSolomon: -1.13% (7.1097 => 7.0295, std.dev.: 0.0017) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 18 02:13:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 18 Oct 2012 04:13:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121018091323.836E12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4956?compare_to=4954&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4956, Order: 166170, Start Time: 2012-10-18 07:54:54, End Time: 2012-10-18 09:15:20 To: 4954, Order: 166164, Start Time: 2012-10-18 06:02:12, End Time: 2012-10-18 07:24:59 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (75 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 24 (181 on baseline) Performance Improvements: 42 (45 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 90 (15 on baseline) Unchanged Tests: 886 (660 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/05-eks/eks: 7.01% (0.4439 => 0.4750, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 6.05% (0.3322 => 0.3523, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.02% (1.4612 => 1.5053, std.dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 2.66% (10.5616 => 10.8424, std.dev.: 0.0097) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.48% (5.4429 => 5.5777, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.17% (5.3987 => 5.5161, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.74% (1.7328 => 1.7629, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.19% (8.7866 => 8.8914, std.dev.: 0.0163) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.19% (2.4070 => 2.4357, std.dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 34.51% (0.5184 => 0.6973, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 15.25% (0.9485 => 1.0931, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.23% (0.3260 => 0.3626, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 6.65% (1.2068 => 1.2871) MultiSource/Benchmarks/Olden/bh/bh: 6.15% (1.9305 => 2.0492, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.66% (28.3017 => 29.6193, std.dev.: 0.0481) SingleSource/UnitTests/Vector/multiplies: 4.64% (2.3983 => 2.5096, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.40% (0.8188 => 0.8548, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 3.70% (25.0995 => 26.0276, std.dev.: 0.0425) SingleSource/Regression/C/uint64_to_float: 2.93% (0.5529 => 0.5691, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 2.67% (12.1973 => 12.5231, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: 2.21% (1.4773 => 1.5099, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: 1.84% (4.7898 => 4.8777, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 1.70% (8.9670 => 9.1190, std.dev.: 0.0083) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.10% (1.5247 => 1.5415, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: -9.10% (0.1374 => 0.1249, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -9.00% (2.2046 => 2.0061, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: -2.32% (15.3679 => 15.0115, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.27% (0.7983 => 0.7802, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -1.86% (0.6081 => 0.5968, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: -1.82% (0.5865 => 0.5758, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.73% (0.7382 => 0.7254, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/lowercase: -53.08% (8.0471 => 3.7753, std.dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -13.48% (0.5415 => 0.4685, std.dev.: 0.0003) MultiSource/Applications/aha/aha: -11.81% (3.6372 => 3.2077, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -10.55% (6.0709 => 5.4302, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/himenobmtxpa: -8.53% (4.0461 => 3.7011, std.dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -6.77% (1.1712 => 1.0919, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -6.47% (8.3392 => 7.7996, std.dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: -4.26% (28.9030 => 27.6711, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -4.22% (82.8607 => 79.3663, std.dev.: 1.0317) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -3.92% (6.8501 => 6.5817, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.67% (2.6736 => 2.5754, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.57% (4.5689 => 4.4058, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-8: -3.45% (1.8242 => 1.7613, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.42% (18.9557 => 18.3081, std.dev.: 0.0169) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -3.29% (1.5415 => 1.4908, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -3.09% (13.8903 => 13.4615, std.dev.: 0.0226) MultiSource/Applications/minisat/minisat: -2.92% (9.4757 => 9.1987, std.dev.: 0.0074) MultiSource/Applications/spiff/spiff: -2.91% (3.0272 => 2.9390, std.dev.: 0.0039) SingleSource/Benchmarks/McGill/queens: -2.65% (2.2570 => 2.1971, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.56% (32.3380 => 31.5086, std.dev.: 0.0041) MultiSource/Benchmarks/PAQ8p/paq8p: -2.49% (87.8543 => 85.6683, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.34% (0.6616 => 0.6461, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.23% (1.7424 => 1.7035, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: -2.16% (1.3459 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -2.15% (1.4853 => 1.4533, std.dev.: 0.0053) MultiSource/Applications/JM/lencod/lencod: -1.51% (9.8780 => 9.7288, std.dev.: 0.0115) MultiSource/Applications/sqlite3/sqlite3: -1.50% (4.6350 => 4.5653, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.49% (1.3183 => 1.2987, std.dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: -1.39% (11.9415 => 11.7750, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.31% (2.3183 => 2.2879, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -1.19% (10.2230 => 10.1014, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/oourafft: -1.14% (6.7393 => 6.6628, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.10% (1.0331 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2941 => 6.2290, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-4: -1.03% (1.1332 => 1.1215, std.dev.: 0.0035) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.94% (0.6060 => 0.6117, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 0.57% (17.0678 => 17.1656, std.dev.: 0.0204) MultiSource/Benchmarks/Bullet/bullet: 0.38% (55.7737 => 55.9833, std.dev.: 0.0471) MultiSource/Benchmarks/MallocBench/gs/gs: 0.12% (4.5008 => 4.5062, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.22% (0.0463 => 0.0464, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0466 => 0.0466, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.23% (0.0433 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0436 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.24% (0.0422 => 0.0423, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0424 => 0.0424) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.48% (0.0415 => 0.0417, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.24% (0.0418 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0434 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.23% (0.0434 => 0.0435, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.47% (0.0427 => 0.0429) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.23% (0.0429 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.24% (0.0418 => 0.0419, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.24% (0.0419 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0425 => 0.0425, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.23% (0.0426 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.23% (0.0436 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.87% (0.0453 => 0.0440, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0413 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.24% (0.0414 => 0.0415, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.24% (0.0425 => 0.0426, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.23% (0.0426 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.24% (0.0417 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0418 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.49% (0.0408 => 0.0410) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.24% (0.0409 => 0.0410, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0408 => 0.0408, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.24% (0.0409 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.45% (0.0444 => 0.0446, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.22% (0.0445 => 0.0446, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.49% (0.0406 => 0.0408, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.25% (0.0407 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.49% (0.0407 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0410 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0415 => 0.0415, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0416 => 0.0416, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.36% (1.3087 => 1.2909, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.02% (8.1964 => 8.1980, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.13% (0.7743 => 0.7733, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.56% (0.0359 => 0.0361, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -2.46% (0.1466 => 0.1430, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -0.54% (0.1667 => 0.1658) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.21% (0.2149 => 0.2175, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.48% (63.2438 => 55.9833, std.dev.: 0.0471) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 1.16% (0.1639 => 0.1658) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 35.58% (14.1553 => 19.1922, std.dev.: 0.0127) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.99% (3.4629 => 5.7827, std.dev.: 0.0055) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13412.22% (0.0720 => 9.7288, std.dev.: 0.0115) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9973400.00% (0.0001 => 9.9735, std.dev.: 0.0014) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 62.53% (0.2554 => 0.4151, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/lowercase: 52.34% (0.0256 => 0.0390, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 44.80% (10.3673 => 15.0115, std.dev.: 0.0065) SingleSource/UnitTests/SignlessTypes/factor: 41.89% (0.0296 => 0.0420) SingleSource/Benchmarks/Misc/richards_benchmark: 37.30% (0.1622 => 0.2227, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/distray/distray: 35.80% (0.1056 => 0.1434, std.dev.: 0.0001) SingleSource/UnitTests/vla: 29.30% (0.0355 => 0.0459, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 22.42% (0.0834 => 0.1021, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.66% (7.0540 => 8.3704, std.dev.: 0.0132) SingleSource/Benchmarks/Misc/flops: 18.09% (0.1432 => 0.1691, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.46% (2.2022 => 2.5868, std.dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.99% (0.0871 => 0.1019, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.99% (0.1566 => 0.1832, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 16.90% (0.5105 => 0.5968, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 16.88% (0.6675 => 0.7802, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 15.90% (3.3354 => 3.8658, std.dev.: 0.0059) SingleSource/Benchmarks/McGill/chomp: 15.65% (0.1655 => 0.1914, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.35% (1.3050 => 1.5053, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.70% (0.5020 => 0.5758, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 14.49% (0.2271 => 0.2600, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 14.39% (0.7115 => 0.8139, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 14.38% (0.3282 => 0.3754, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 14.32% (9.4845 => 10.8424, std.dev.: 0.0097) MultiSource/Applications/JM/ldecod/ldecod: 14.16% (10.4361 => 11.9143, std.dev.: 0.0211) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.13% (1.5415 => 1.7593, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.92% (1.7609 => 2.0061, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: 13.89% (0.1440 => 0.1640, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.77% (0.1510 => 0.1718, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 13.32% (0.3109 => 0.3523, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 13.09% (0.3423 => 0.3871, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 13.04% (0.1695 => 0.1916, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 13.01% (0.1584 => 0.1790, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/matrix: 12.96% (0.0818 => 0.0924) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.87% (0.1438 => 0.1623, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.65% (0.4615 => 0.5199, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.55% (4.2646 => 4.7999, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 12.47% (0.6450 => 0.7254, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/tsp/tsp: 12.43% (0.1175 => 0.1321, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/exptree: 12.41% (0.0814 => 0.0915, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.40% (0.1032 => 0.1160) MultiSource/Applications/lemon/lemon: 12.39% (1.0722 => 1.2050, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.38% (0.1236 => 0.1389, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 12.24% (8.1363 => 9.1322, std.dev.: 0.0113) MultiSource/Benchmarks/FreeBench/neural/neural: 12.24% (0.1463 => 0.1642, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.21% (0.1695 => 0.1902, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.19% (0.1337 => 0.1500, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/mst/mst: 12.12% (0.1163 => 0.1304, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.11% (0.0933 => 0.1046, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 12.05% (0.7433 => 0.8329, std.dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: 12.03% (1.1840 => 1.3264, std.dev.: 0.0075) MultiSource/Applications/viterbi/viterbi: 12.03% (0.1555 => 0.1742, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 12.02% (1.1642 => 1.3041, std.dev.: 0.0087) MultiSource/Benchmarks/sim/sim: 12.02% (0.3387 => 0.3794, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 12.00% (5.7591 => 6.4504, std.dev.: 0.0071) MultiSource/Applications/treecc/treecc: 11.97% (2.0273 => 2.2700, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.93% (0.2700 => 0.3022, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 11.87% (3.8723 => 4.3320, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 11.85% (0.0886 => 0.0991, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.80% (0.3543 => 0.3961, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.78% (0.9765 => 1.0915, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.76% (0.3307 => 0.3696, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.75% (0.1940 => 0.2168, std.dev.: 0.0011) SingleSource/UnitTests/SignlessTypes/rem: 11.71% (0.1144 => 0.1278, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.68% (7.9617 => 8.8914, std.dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.62% (0.5860 => 0.6541, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 11.56% (0.1151 => 0.1284, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.55% (4.9449 => 5.5161, std.dev.: 0.0103) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.51% (5.0018 => 5.5777, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.46% (0.4879 => 0.5438, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.45% (0.1625 => 0.1811, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 11.37% (0.3543 => 0.3946, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.37% (0.3473 => 0.3868, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 11.37% (0.7835 => 0.8726, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/for-in: 11.32% (0.3694 => 0.4112, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-2: 11.21% (0.3497 => 0.3889, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.20% (0.2107 => 0.2343, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.20% (1.1861 => 1.3189, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.19% (0.0929 => 0.1033, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.16% (1.5859 => 1.7629, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/synchronized: 11.15% (0.3561 => 0.3958, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.13% (0.1330 => 0.1478, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 11.12% (0.3516 => 0.3907, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.08% (0.3828 => 0.4252, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/parameter-passing: 11.03% (0.3927 => 0.4360, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 10.97% (0.8921 => 0.9900, std.dev.: 0.0023) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.93% (0.1125 => 0.1248, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.93% (0.3121 => 0.3462, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.92% (0.3177 => 0.3524, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.90% (0.8172 => 0.9063, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/property: 10.78% (0.3886 => 0.4305, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.69% (0.1029 => 0.1139, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.62% (0.2758 => 0.3051, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.60% (0.1906 => 0.2108, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 10.59% (0.6456 => 0.7140, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.59% (2.2024 => 2.4357, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.54% (0.8067 => 0.8917, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.52% (0.5569 => 0.6155, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/05-eks/eks: 10.49% (0.4299 => 0.4750, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.47% (0.1117 => 0.1234, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.40% (1.4186 => 1.5662, std.dev.: 0.0104) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.28% (0.2266 => 0.2499, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 10.11% (1.5603 => 1.7180, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.08% (0.1062 => 0.1169, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 10.05% (0.2049 => 0.2255, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.03% (0.2603 => 0.2864, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 9.95% (2.2969 => 2.5254, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/09-vor/vor: 9.75% (0.3180 => 0.3490, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 9.63% (0.4620 => 0.5065, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 9.49% (21.9371 => 24.0197, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/hash: 9.49% (0.4289 => 0.4696, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.42% (0.3441 => 0.3765, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/health/health: 9.38% (0.1268 => 0.1387, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.30% (0.2065 => 0.2257, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.04% (0.3826 => 0.4172, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.77% (0.3865 => 0.4204, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.71% (0.4636 => 0.5040, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.68% (0.4203 => 0.4568, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.68% (0.5981 => 0.6500, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 8.62% (0.3422 => 0.3717, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.51% (0.1892 => 0.2053, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 8.44% (0.6030 => 0.6539, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 8.35% (0.4048 => 0.4386, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.24% (0.5925 => 0.6413, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 8.20% (0.3684 => 0.3986, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.14% (0.4103 => 0.4437, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 7.92% (17.1811 => 18.5426, std.dev.: 0.0273) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.91% (0.3427 => 0.3698, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference: 7.81% (0.7326 => 0.7898, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sieve: 7.60% (0.3603 => 0.3877, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.45% (0.3650 => 0.3922, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 7.34% (0.3092 => 0.3319, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.32% (14.3668 => 15.4184, std.dev.: 0.0103) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.30% (0.8101 => 0.8692, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.28% (0.4064 => 0.4360, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.14% (3.8922 => 4.1702, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.92% (0.3136 => 0.3353, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.84% (0.3379 => 0.3610, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 6.71% (0.3098 => 0.3306, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.57% (0.2831 => 0.3017, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 6.56% (0.3232 => 0.3444, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.54% (0.2905 => 0.3095, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.54% (0.2891 => 0.3080, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.52% (0.3283 => 0.3497, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.48% (0.3162 => 0.3367, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.38% (2.0665 => 2.1983, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.16% (0.2872 => 0.3049, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: 6.13% (0.2871 => 0.3047, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.12% (0.2877 => 0.3053, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.10% (0.2756 => 0.2924, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.05% (0.2793 => 0.2962, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: 5.97% (0.2714 => 0.2876, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 5.94% (0.2725 => 0.2887, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 5.93% (0.3052 => 0.3233, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 5.71% (0.2802 => 0.2962, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 5.60% (1.2842 => 1.3561, std.dev.: 0.0071) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.56% (0.2430 => 0.2565, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: 4.98% (0.3131 => 0.3287, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.54% (0.3817 => 0.3952, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.90% (1.1194 => 1.1519, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.53% (1.1145 => 1.2987, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.83% (1.1396 => 1.2516, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 9.66% (0.9957 => 1.0919, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (3.1578 => 3.3678, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 5.60% (1.9405 => 2.0492, std.dev.: 0.0029) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.87% (0.4162 => 0.4323, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.68% (4.2280 => 4.3414, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7650, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bisort/bisort: 1.78% (0.8333 => 0.8481, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.69% (3.6395 => 3.7011, std.dev.: 0.0073) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2077, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.33% (2.6546 => 2.6900, std.dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 1.13% (11.6436 => 11.7750, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.12% (6.5088 => 6.5817, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1309, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -79.90% (0.8651 => 0.1739, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.07% (5.2763 => 3.2677, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.52% (5.3855 => 3.6882, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.02% (5.3526 => 3.6921, std.dev.: 0.0020) SingleSource/UnitTests/Vector/constpool: -14.59% (54.1659 => 46.2640, std.dev.: 0.0098) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.67% (2.9384 => 2.6249, std.dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: -7.19% (22.1758 => 20.5817, std.dev.: 0.0123) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.10% (8.0499 => 3.7753, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.44% (1.1492 => 0.7649, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: -15.80% (1.6925 => 1.4251, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.53% (0.0998 => 0.0853, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.65% (1.2373 => 1.0931, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3453 => 2.9600, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -11.10% (1.5373 => 1.3666, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.22% (19.9488 => 18.3081, std.dev.: 0.0169) MultiSource/Benchmarks/FreeBench/mason/mason: -7.73% (0.2161 => 0.1994, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.06% (1.8329 => 1.7035, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.64% (1.9577 => 1.8473, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.59% (1.6805 => 1.5866, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.65% (1.5835 => 1.5099, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.37% (8.1563 => 7.7996, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8777, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.36% (3.2827 => 3.1723, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5086, std.dev.: 0.0041) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.56% (0.4808 => 0.4685, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.77% (10.2830 => 10.1014, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6828, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -1.70% (4.6441 => 4.5653, std.dev.: 0.0023) SingleSource/UnitTests/Vector/multiplies: -1.69% (2.5528 => 2.5096, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4207, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/lists: -1.13% (6.2999 => 6.2290, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2879, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8571, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-4: -1.04% (1.1333 => 1.1215, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0554 => 1.0445, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 16.98% (0.5229 => 0.6117, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 14.52% (14.9895 => 17.1656, std.dev.: 0.0204) MultiSource/Benchmarks/MallocBench/gs/gs: 9.63% (4.1105 => 4.5062, std.dev.: 0.0197) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 16.84% (1.1048 => 1.2909, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.53% (7.1582 => 8.1980, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.28% (0.6222 => 0.7733, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36000.00% (0.0001 => 0.0361, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.70% (0.1485 => 0.1430, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.79% (0.2116 => 0.2175, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 18 02:25:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 18 Oct 2012 04:25:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121018092553.1885A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4957?compare_to=4955&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4957, Order: 166170, Start Time: 2012-10-18 08:02:59, End Time: 2012-10-18 09:28:50 To: 4955, Order: 166164, Start Time: 2012-10-18 06:03:10, End Time: 2012-10-18 07:33:08 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 48 (188 on baseline) Performance Improvements: 64 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 930 (677 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/05-eks/eks: 7.62% (0.4134 => 0.4449, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 6.77% (0.3104 => 0.3314, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.90% (4.6311 => 4.7652, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.83% (4.7114 => 4.8449, std.dev.: 0.0087) MultiSource/Applications/SIBsim4/SIBsim4: 2.83% (1.3542 => 1.3925, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.26% (0.5346 => 0.5467, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 2.25% (9.0339 => 9.2376, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.23% (0.5465 => 0.5587, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.21% (0.5333 => 0.5451, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.18% (1.6135 => 1.6487, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.17% (0.5439 => 0.5557, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.15% (0.5820 => 0.5945, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.14% (0.5474 => 0.5591, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.10% (0.5680 => 0.5799, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.04% (0.5731 => 0.5848, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.99% (0.5589 => 0.5700, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.97% (0.5684 => 0.5796, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.96% (0.5802 => 0.5916, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.96% (0.6280 => 0.6403, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.93% (0.5753 => 0.5864, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.90% (0.5943 => 0.6056, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.89% (0.5601 => 0.5707, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.89% (0.5931 => 0.6043, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.85% (0.6276 => 0.6392, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.80% (0.6568 => 0.6686, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.76% (0.6120 => 0.6228, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.75% (0.6571 => 0.6686, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.64% (0.6097 => 0.6197, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.33% (2.2339 => 2.2636, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.10% (1.3500 => 1.3648, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.04% (0.9735 => 0.9836, std.dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 34.53% (0.5184 => 0.6974, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 23.91% (0.9364 => 1.1603, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.20% (0.3260 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 6.65% (1.2068 => 1.2871) MultiSource/Applications/lua/lua: 4.80% (24.8141 => 26.0049, std.dev.: 0.0145) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.64% (28.2631 => 29.5751, std.dev.: 0.1025) SingleSource/UnitTests/Vector/multiplies: 4.58% (2.3991 => 2.5089, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.04% (0.8215 => 0.8547, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 2.97% (0.5528 => 0.5692, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 2.64% (12.1809 => 12.5024, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: 2.07% (6.1195 => 6.2460, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 1.96% (4.7876 => 4.8812, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 1.50% (8.9290 => 9.0630, std.dev.: 0.0228) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.42% (1.4095 => 1.4295, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.28% (5.2727 => 5.3403, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 1.20% (3.0769 => 3.1139, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.16% (3.3425 => 3.3812, std.dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -25.51% (1.2857 => 0.9577, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -2.82% (4.1135 => 3.9973, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.19% (0.7227 => 0.7069, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.10% (0.5291 => 0.5180, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.00% (0.6801 => 0.6665, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: -1.56% (7.1900 => 7.0776, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.53% (1.2904 => 1.2706, std.dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: -1.19% (5.1414 => 5.0803, std.dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -24.05% (4.6961 => 3.5669, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -18.98% (1.1799 => 0.9559, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -15.80% (4.9473 => 4.1655, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -15.62% (6.5576 => 5.5331, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -14.51% (4.7170 => 4.0326, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -14.07% (2.4619 => 2.1154) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -12.75% (0.5410 => 0.4720, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -12.55% (4.6917 => 4.1027, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -10.54% (6.0371 => 5.4009, std.dev.: 0.0323) SingleSource/Benchmarks/Misc/himenobmtxpa: -9.56% (4.0341 => 3.6483, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: -8.83% (3.6691 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -8.39% (5.1490 => 4.7169, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -7.90% (5.3093 => 4.8898, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.60% (4.6580 => 4.3504, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.31% (9.1258 => 8.5500, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.13% (5.2235 => 4.9033, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.04% (4.4208 => 4.1536, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.94% (4.6546 => 4.3779, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -4.95% (84.2723 => 80.1011, std.dev.: 0.6435) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.83% (6.2507 => 5.9485, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.81% (0.2494 => 0.2374, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.53% (8.3449 => 7.9671, std.dev.: 0.0238) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.33% (5.4473 => 5.2113, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.23% (4.9465 => 4.7371, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.05% (7.9753 => 7.6521, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: -4.00% (29.0486 => 27.8861, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -3.89% (6.8463 => 6.5798, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.85% (5.5989 => 5.3831, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -3.72% (3.0556 => 2.9420, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.67% (2.6738 => 2.5758, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -3.65% (2.8570 => 2.7526, std.dev.: 0.0076) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.64% (18.9695 => 18.2799, std.dev.: 0.0349) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.61% (4.5599 => 4.3955, std.dev.: 0.0347) MultiSource/Benchmarks/PAQ8p/paq8p: -3.41% (86.4967 => 83.5438, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -3.21% (13.8580 => 13.4137, std.dev.: 0.0250) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.14% (1.8328 => 1.7753, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -3.00% (1.5007 => 1.4557, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.89% (32.3100 => 31.3758, std.dev.: 0.0105) SingleSource/Benchmarks/McGill/queens: -2.67% (2.2570 => 2.1967, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -2.62% (4.3636 => 4.2493, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.51% (4.5138 => 4.4006, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -2.48% (7.7559 => 7.5636, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.32% (2.5431 => 2.4842, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.27% (1.7393 => 1.6998, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.10% (5.3083 => 5.1968, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -2.04% (9.4517 => 9.2590, std.dev.: 0.0105) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.98% (0.6622 => 0.6491, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: -1.92% (11.9102 => 11.6815, std.dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: -1.86% (3.9123 => 3.8394, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-6: -1.58% (2.0159 => 1.9840, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.56% (0.8308 => 0.8178, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.39% (1.2939 => 1.2759, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -1.29% (7.6847 => 7.5852, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary3: -1.17% (3.7472 => 3.7032, std.dev.: 0.0123) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.08% (1.0330 => 1.0218) MultiSource/Applications/sqlite3/sqlite3: -1.06% (4.6096 => 4.5607, std.dev.: 0.0006) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.94% (2.0176 => 2.5006, std.dev.: 0.0065) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.37% (0.1410 => 0.1669, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 17.43% (0.0826 => 0.0970, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 16.67% (0.2243 => 0.2617, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 15.62% (0.0653 => 0.0755, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 14.12% (0.1013 => 0.1156, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.55% (0.0834 => 0.0947, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.38% (0.1413 => 0.1602, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.11% (0.1327 => 0.1501, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.97% (0.1588 => 0.1794, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 12.82% (0.4328 => 0.4883, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.78% (3.9660 => 4.4730, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.75% (0.2721 => 0.3068, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 12.75% (0.7038 => 0.7935, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 12.70% (1.3693 => 1.5432, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.66% (0.0964 => 0.1086, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.51% (0.6283 => 0.7069, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 12.30% (13.8202 => 15.5200, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.21% (0.2596 => 0.2913, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.15% (1.4563 => 1.6333, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash: 12.11% (0.4062 => 0.4554, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.01% (0.9199 => 1.0304, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.93% (1.2193 => 1.3648, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.91% (0.7710 => 0.8628, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.87% (0.5265 => 0.5890, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.81% (1.1364 => 1.2706, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.78% (0.6959 => 0.7779, std.dev.: 0.0012) MultiSource/Applications/aha/aha: 11.49% (0.1062 => 0.1184, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 11.47% (0.1003 => 0.1118, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.42% (0.4791 => 0.5338, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 11.40% (0.5818 => 0.6481, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 11.35% (1.0313 => 1.1484, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.31% (0.3485 => 0.3879, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.29% (0.1072 => 0.1193, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.24% (0.3756 => 0.4178, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.05% (0.3130 => 0.3476, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.00% (0.3899 => 0.4328, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 10.98% (0.5748 => 0.6379, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 10.95% (0.7061 => 0.7834, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.92% (0.5577 => 0.6186, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.86% (0.4016 => 0.4452, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 10.82% (0.2781 => 0.3082, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.80% (0.1157 => 0.1282, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 10.79% (1.1061 => 1.2254, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 10.75% (0.3293 => 0.3647, std.dev.: 0.0021) MultiSource/Applications/minisat/minisat: 10.71% (0.6744 => 0.7466, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/moments: 10.68% (0.3868 => 0.4281, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 10.65% (0.2995 => 0.3314, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/mst/mst: 10.53% (0.1111 => 0.1228, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.52% (0.3489 => 0.3856, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.51% (0.1075 => 0.1188, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.50% (0.2782 => 0.3074, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 10.47% (16.6129 => 18.3531, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.46% (0.3022 => 0.3338, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 10.45% (0.3453 => 0.3814, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 10.45% (0.1589 => 0.1755, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.44% (0.2127 => 0.2349, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.39% (0.8698 => 0.9602, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.37% (0.4379 => 0.4833, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 10.35% (0.1478 => 0.1631, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.35% (0.3246 => 0.3582, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.26% (0.1569 => 0.1730, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 10.23% (1.9270 => 2.1241, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.22% (0.3580 => 0.3946, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.22% (0.2966 => 0.3269, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.19% (0.2914 => 0.3211, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.19% (0.1276 => 0.1406, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.18% (0.4390 => 0.4837, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.16% (0.7460 => 0.8218, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: 10.15% (3.1889 => 3.5127, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary3: 10.13% (0.3149 => 0.3468, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 10.11% (0.2761 => 0.3040, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.10% (1.9828 => 2.1830, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/18-imp/imp: 10.09% (0.3220 => 0.3545, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 10.09% (0.2726 => 0.3001, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 10.06% (0.8310 => 0.9146, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.06% (0.1014 => 0.1116, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 10.02% (3.8646 => 4.2519, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.02% (0.2655 => 0.2921, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists1: 10.02% (0.3534 => 0.3888, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 9.96% (0.2760 => 0.3035, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 9.95% (0.3107 => 0.3416, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.94% (4.9865 => 5.4824, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.94% (0.2023 => 0.2224, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.92% (0.1865 => 0.2050, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 9.90% (0.7506 => 0.8249, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 9.90% (0.2607 => 0.2865, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 9.89% (0.2690 => 0.2956, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 9.88% (2.1791 => 2.3944, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.87% (0.2765 => 0.3038, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 9.86% (0.2628 => 0.2887, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 9.81% (0.2937 => 0.3225, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.76% (7.2180 => 7.9223, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.76% (0.5637 => 0.6187, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary2: 9.74% (0.3192 => 0.3503, std.dev.: 0.0055) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.69% (0.1435 => 0.1574, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.67% (0.1986 => 0.2178, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 9.54% (0.2925 => 0.3204, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 9.47% (0.2988 => 0.3271, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 9.44% (1.0594 => 1.1594, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.38% (0.2696 => 0.2949, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 9.35% (0.1657 => 0.1812, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.24% (0.3755 => 0.4102, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 9.22% (1.2749 => 1.3925, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/objinst: 9.10% (0.2945 => 0.3213, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 9.06% (14.8535 => 16.1987, std.dev.: 0.0111) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.04% (4.4433 => 4.8449, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.03% (1.3245 => 1.4441, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 8.95% (4.6629 => 5.0803, std.dev.: 0.0037) MultiSource/Benchmarks/sim/sim: 8.94% (0.3131 => 0.3411, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.94% (3.6692 => 3.9973, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.79% (4.3801 => 4.7652, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.76% (0.6576 => 0.7152, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 8.73% (8.4961 => 9.2376, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.64% (0.6135 => 0.6665, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.61% (0.8818 => 0.9577, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 8.56% (0.6250 => 0.6785, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.55% (1.5188 => 1.6487, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.34% (3.2742 => 3.5472, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.32% (0.2140 => 0.2318, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.27% (0.1789 => 0.1937, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 8.17% (0.4113 => 0.4449, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.12% (0.3511 => 0.3796, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.99% (0.9108 => 0.9836, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 7.94% (0.1385 => 0.1495, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.92% (0.3245 => 0.3502, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.82% (1.1333 => 1.2219, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.80% (0.4805 => 0.5180, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.75% (2.1007 => 2.2636, std.dev.: 0.0015) MultiSource/Applications/lua/lua: 7.73% (3.7467 => 4.0365, std.dev.: 0.0069) SingleSource/UnitTests/ObjC/parameter-passing: 7.72% (0.4003 => 0.4312, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 7.64% (6.5754 => 7.0776, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.63% (0.2321 => 0.2498, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 7.62% (0.2008 => 0.2161, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 7.61% (0.3914 => 0.4212, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.54% (0.3940 => 0.4237, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.52% (0.3578 => 0.3847, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.51% (0.2504 => 0.2692, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.43% (0.3663 => 0.3935, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.41% (0.3646 => 0.3916, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.37% (0.1819 => 0.1953, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.36% (0.3789 => 0.4068, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.36% (0.3601 => 0.3866, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 7.32% (1.2292 => 1.3192, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.26% (0.3650 => 0.3915, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 7.26% (0.3623 => 0.3886, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.03% (13.2842 => 14.2184, std.dev.: 0.0079) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.98% (6.2785 => 6.7167, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/ReedSolomon: 5.74% (0.1777 => 0.1879, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 5.67% (16.2614 => 17.1839, std.dev.: 0.0160) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.31% (0.2243 => 0.2362, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 4.54% (14.5298 => 15.1893, std.dev.: 0.0107) MultiSource/Benchmarks/Bullet/bullet: 2.25% (33.2944 => 34.0441, std.dev.: 0.0216) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.64% (5.7573 => 7.5211, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 24.63% (1.8175 => 2.2652, std.dev.: 0.0451) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.11% (1.0895 => 1.2759, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 11.13% (1.1560 => 1.2847, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1917, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 9.03% (0.8273 => 0.9020, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.63% (3.1736 => 3.4157, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.43% (0.9692 => 1.0218) SingleSource/Benchmarks/Misc/mandel-2: 5.25% (1.2998 => 1.3680, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.87% (2.8606 => 3.0000, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0043, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 4.46% (0.5449 => 0.5692, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 3.73% (11.2619 => 11.6815, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 3.39% (12.0921 => 12.5024, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.34% (1.9199 => 1.9840, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 2.92% (10.7476 => 11.0617, std.dev.: 0.0409) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.13% (7.4271 => 7.5852, std.dev.: 0.0038) MultiSource/Applications/lemon/lemon: 1.81% (1.4298 => 1.4557, std.dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5128, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.45% (2.0200 => 2.0492, std.dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.39% (1.9433 => 1.9703, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.25% (9.0760 => 9.1893, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0192) SingleSource/Benchmarks/Misc/oourafft: 1.16% (5.5130 => 5.5769, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 1.13% (3.1071 => 3.1422, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.08% (8.8259 => 8.9208, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/lists: 1.07% (12.4560 => 12.5889, std.dev.: 0.0075) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.00% (0.2670 => 0.1415, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.63% (0.4657 => 0.3929, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -14.14% (0.0707 => 0.0607, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.18% (1.3813 => 1.1992, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.16% (1.3819 => 1.2001, std.dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.29% (1.0460 => 0.8547, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.65% (0.2238 => 0.1955, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.13% (20.3410 => 18.2799, std.dev.: 0.0349) SingleSource/Benchmarks/Misc/flops-3: -6.27% (2.4152 => 2.2637, std.dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0059) SingleSource/Benchmarks/McGill/chomp: -5.73% (1.2308 => 1.1603, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.67% (1.3780 => 1.2998, std.dev.: 0.0151) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -5.22% (2.6470 => 2.5089, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.37% (0.9996 => 0.9559, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.90% (1.7688 => 1.6998, std.dev.: 0.0015) MultiSource/Applications/siod/siod: -3.22% (3.2729 => 3.1674, std.dev.: 0.0074) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.02% (0.4867 => 0.4720, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: -2.79% (3.0263 => 2.9420, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8812, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.35% (1.9762 => 1.9298, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.14% (0.6589 => 0.6448, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.97% (0.8342 => 0.8178, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -1.93% (26.5159 => 26.0049, std.dev.: 0.0145) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.87% (0.6615 => 0.6491, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -1.73% (6.3560 => 6.2460, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.63% (2.5254 => 2.4842, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0058, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -1.23% (5.3167 => 5.2515, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/heapsort: -1.19% (3.9173 => 3.8706, std.dev.: 0.0052) MultiSource/Benchmarks/mafft/pairlocalalign: -1.19% (28.2225 => 27.8861, std.dev.: 0.0017) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1139, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -1.05% (84.4286 => 83.5438, std.dev.: 0.0048) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 18 04:03:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 18 Oct 2012 06:03:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121018110315.6572D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4958?compare_to=4956&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4958, Order: 166174, Start Time: 2012-10-18 09:44:52, End Time: 2012-10-18 11:05:12 To: 4956, Order: 166170, Start Time: 2012-10-18 07:54:54, End Time: 2012-10-18 09:15:20 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (75 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (182 on baseline) Performance Improvements: 0 (44 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 90 (15 on baseline) Unchanged Tests: 950 (660 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 7.54% (0.4484 => 0.4822, std.dev.: 0.0123) MultiSource/Benchmarks/PAQ8p/paq8p: 5.11% (15.0115 => 15.7788, std.dev.: 0.0024) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.08% (0.6117 => 0.6122, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: -0.36% (17.1656 => 17.1030, std.dev.: 0.0281) MultiSource/Benchmarks/Bullet/bullet: -0.02% (55.9833 => 55.9741, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/gs/gs: -0.12% (4.5062 => 4.5006, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.43% (0.0464 => 0.0466) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.43% (0.0466 => 0.0468, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.23% (0.0434 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.23% (0.0436 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.47% (0.0423 => 0.0425) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.47% (0.0424 => 0.0426) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.48% (0.0417 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.46% (0.0434 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.69% (0.0435 => 0.0438) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.23% (0.0429 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.47% (0.0430 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.48% (0.0419 => 0.0421) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.71% (0.0420 => 0.0423, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.47% (0.0425 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.23% (0.0427 => 0.0428, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.46% (0.0437 => 0.0439) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.23% (0.0440 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.24% (0.0413 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.48% (0.0415 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0426 => 0.0426, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.47% (0.0427 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.48% (0.0416 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.48% (0.0418 => 0.0420, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.24% (0.0410 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.49% (0.0410 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.49% (0.0408 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0410 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.22% (0.0446 => 0.0447, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.45% (0.0446 => 0.0448, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.25% (0.0408 => 0.0409) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.49% (0.0408 => 0.0410) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.49% (0.0409 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.49% (0.0410 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.48% (0.0415 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.72% (0.0416 => 0.0419) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.06% (1.2909 => 1.2901, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.24% (8.1980 => 8.1783, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.09% (0.7733 => 0.7726, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.55% (0.0361 => 0.0359, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1430 => 0.1429, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: - (0.1658 => 0.1658) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.09% (0.2175 => 0.2177, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.49% (63.2438 => 55.9741, std.dev.: 0.0032) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 1.16% (0.1639 => 0.1658) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 35.33% (14.1553 => 19.1569, std.dev.: 0.0174) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.22% (3.4629 => 5.7560, std.dev.: 0.0008) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13412.36% (0.0720 => 9.7289, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9973500.00% (0.0001 => 9.9736, std.dev.: 0.0009) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 62.06% (0.2554 => 0.4139, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 52.34% (0.0256 => 0.0390, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 52.20% (10.3673 => 15.7788, std.dev.: 0.0024) SingleSource/UnitTests/SignlessTypes/factor: 42.23% (0.0296 => 0.0421, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 36.62% (0.1622 => 0.2216, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 36.08% (0.1056 => 0.1437, std.dev.: 0.0000) SingleSource/UnitTests/vla: 29.01% (0.0355 => 0.0458, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 24.58% (0.0834 => 0.1039, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 18.30% (0.1432 => 0.1694) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.20% (7.0540 => 8.3375, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.71% (2.2022 => 2.5923, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.92% (0.1566 => 0.1831, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.88% (0.0871 => 0.1018, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 16.85% (0.5105 => 0.5965, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 16.84% (0.6675 => 0.7799, std.dev.: 0.0133) MultiSource/Applications/d/make_dparser: 15.69% (3.3354 => 3.8587, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.39% (1.3050 => 1.5058, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 15.23% (0.1655 => 0.1907, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 14.75% (0.3282 => 0.3766, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 14.44% (0.2271 => 0.2599, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.44% (0.5020 => 0.5745, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 14.22% (0.7115 => 0.8127, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 14.18% (10.4361 => 11.9158, std.dev.: 0.0118) MultiSource/Benchmarks/mafft/pairlocalalign: 14.05% (9.4845 => 10.8168, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/power/power: 14.03% (0.1440 => 0.1642, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.00% (1.5415 => 1.7573, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.91% (0.0798 => 0.0909, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.86% (1.7609 => 2.0050, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.44% (0.1510 => 0.1713, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 13.03% (0.3423 => 0.3869, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 12.99% (0.3109 => 0.3513, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 12.86% (0.1695 => 0.1913, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.77% (4.2646 => 4.8091, std.dev.: 0.0081) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 12.75% (0.1584 => 0.1786, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.63% (0.1029 => 0.1159, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: 12.59% (0.0818 => 0.0921, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.49% (0.1337 => 0.1504, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.48% (0.4615 => 0.5191, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.46% (0.3121 => 0.3510, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 12.39% (5.7591 => 6.4727, std.dev.: 0.0140) MultiSource/Benchmarks/Olden/tsp/tsp: 12.34% (0.1175 => 0.1320, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.31% (0.1032 => 0.1159, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.22% (0.1236 => 0.1387, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 12.21% (0.1163 => 0.1305, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 12.16% (0.6450 => 0.7234, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 12.12% (8.1363 => 9.1224, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: 12.10% (0.1463 => 0.1640, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 12.03% (0.1555 => 0.1742, std.dev.: 0.0031) MultiSource/Applications/treecc/treecc: 11.99% (2.0273 => 2.2704, std.dev.: 0.0064) MultiSource/Benchmarks/nbench/nbench: 11.98% (1.1840 => 1.3259, std.dev.: 0.0053) MultiSource/Applications/lemon/lemon: 11.98% (1.0722 => 1.2006, std.dev.: 0.0168) MultiSource/Benchmarks/sim/sim: 11.96% (0.3387 => 0.3792, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 11.95% (1.1642 => 1.3033, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.92% (0.1695 => 0.1897, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.91% (0.3543 => 0.3965, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: 11.90% (0.0933 => 0.1044, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.86% (0.9765 => 1.0923, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 11.85% (0.0886 => 0.0991, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.81% (0.5860 => 0.6552, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 11.72% (0.7433 => 0.8304, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 11.60% (3.8723 => 4.3213, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.58% (0.3307 => 0.3690, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.57% (4.9449 => 5.5170, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.55% (0.1940 => 0.2164, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.49% (5.0018 => 5.5766, std.dev.: 0.0074) SingleSource/UnitTests/SignlessTypes/rem: 11.45% (0.1144 => 0.1275, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.41% (0.2700 => 0.3008, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 11.38% (0.1151 => 0.1282, std.dev.: 0.0025) MultiSource/Applications/spiff/spiff: 11.35% (0.7835 => 0.8724, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-4: 11.32% (0.3543 => 0.3944, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.32% (0.3473 => 0.3866, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.30% (7.9617 => 8.8614, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.30% (0.2107 => 0.2345, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-2: 11.27% (0.3497 => 0.3891, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.20% (0.3561 => 0.3960, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.16% (0.8172 => 0.9084, std.dev.: 0.0060) SingleSource/UnitTests/ObjC/exceptions-3: 11.15% (0.3516 => 0.3908, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.10% (0.3828 => 0.4253, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.10% (0.3694 => 0.4104, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.09% (0.0929 => 0.1032, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.08% (1.1861 => 1.3175, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.02% (0.1625 => 0.1804, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 11.00% (0.3927 => 0.4359, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.99% (0.1438 => 0.1596, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.98% (0.1330 => 0.1476, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.95% (1.5859 => 1.7596, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.94% (0.4879 => 0.5413, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 10.85% (0.8921 => 0.9889, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.81% (0.1906 => 0.2112, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/property: 10.78% (0.3886 => 0.4305, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.77% (0.2758 => 0.3055, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.74% (0.1117 => 0.1237, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.73% (0.3177 => 0.3518, std.dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.67% (0.1125 => 0.1245, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 10.58% (0.6456 => 0.7139, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.54% (0.8067 => 0.8917, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 10.51% (0.4299 => 0.4751, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.51% (0.2065 => 0.2282, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.36% (0.5569 => 0.6146, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.30% (2.2024 => 2.4292, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.26% (0.1062 => 0.1171, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.23% (1.4186 => 1.5637, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 9.95% (0.2603 => 0.2862, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 9.86% (2.2969 => 2.5233, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.80% (0.2266 => 0.2488, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.57% (0.1892 => 0.2073, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 9.56% (1.5603 => 1.7095, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/09-vor/vor: 9.53% (0.3180 => 0.3483, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 9.44% (0.4289 => 0.4694, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 9.42% (0.2049 => 0.2242, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.42% (0.3441 => 0.3765, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: 9.38% (0.1268 => 0.1387, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 9.35% (0.4620 => 0.5052, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 9.10% (21.9371 => 23.9326, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.02% (0.3826 => 0.4171, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.00% (0.3865 => 0.4213, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 8.94% (0.3422 => 0.3728, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.79% (0.5981 => 0.6507, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.76% (0.4203 => 0.4571, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.63% (0.4636 => 0.5036, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists1: 8.55% (0.3684 => 0.3999, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 8.52% (0.6030 => 0.6544, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 8.50% (0.4048 => 0.4392, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 8.37% (0.5925 => 0.6421, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.07% (0.4103 => 0.4434, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.02% (0.3427 => 0.3702, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 7.85% (17.1811 => 18.5291, std.dev.: 0.0069) SingleSource/UnitTests/ObjC++/property-reference: 7.81% (0.7326 => 0.7898, std.dev.: 0.0055) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.78% (0.8101 => 0.8731, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 7.63% (0.3603 => 0.3878, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.42% (0.3650 => 0.3921, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.34% (14.3668 => 15.4219, std.dev.: 0.0128) MultiSource/Benchmarks/Olden/bh/bh: 7.18% (0.3092 => 0.3314, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.16% (0.4064 => 0.4355, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.97% (0.3098 => 0.3314, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.94% (3.8922 => 4.1625, std.dev.: 0.0142) SingleSource/Regression/C++/ofstream_ctor: 6.82% (0.2905 => 0.3103, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.79% (0.3136 => 0.3349, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.78% (0.2891 => 0.3087, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/strcat: 6.71% (0.2831 => 0.3021, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.70% (0.3162 => 0.3374, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.67% (0.3283 => 0.3502, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 6.65% (0.3232 => 0.3447, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.55% (2.0665 => 2.2019, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.48% (0.2872 => 0.3058, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.36% (0.2877 => 0.3060, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.34% (0.2871 => 0.3053, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.20% (0.2756 => 0.2927, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 6.19% (0.2714 => 0.2882, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.16% (0.2793 => 0.2965, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 6.13% (0.2725 => 0.2892, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 6.10% (0.3379 => 0.3585, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 6.00% (0.3052 => 0.3235, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.89% (0.2802 => 0.2967, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.64% (0.2430 => 0.2567, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 5.57% (1.2842 => 1.3557, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (0.3131 => 0.3294, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.56% (0.3817 => 0.3953, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.76% (1.1194 => 1.1503, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.62% (0.3935 => 0.4038, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.58% (1.1145 => 1.2993, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.90% (1.1396 => 1.2524, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 9.80% (0.9957 => 1.0933, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217) SingleSource/Benchmarks/Shootout-C++/hash2: 6.71% (3.1578 => 3.3696, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: 5.58% (1.9405 => 2.0487, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.87% (0.4162 => 0.4323, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.75% (4.2280 => 4.3442, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.03% (3.6395 => 3.7132, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/bisort/bisort: 1.78% (0.8333 => 0.8481, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.54% (2.6546 => 2.6955, std.dev.: 0.0019) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2074, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.13% (11.6436 => 11.7749, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.08% (6.5088 => 6.5794, std.dev.: 0.0086) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1309, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -79.79% (0.8651 => 0.1748, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.09% (5.2763 => 3.2667, std.dev.: 0.0079) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.53% (5.3855 => 3.6872, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.02% (5.3526 => 3.6921, std.dev.: 0.0025) SingleSource/UnitTests/Vector/constpool: -14.59% (54.1659 => 46.2644, std.dev.: 0.0821) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.41% (2.9384 => 2.6325, std.dev.: 0.0159) MultiSource/Applications/ClamAV/clamscan: -7.13% (22.1758 => 20.5936, std.dev.: 0.0063) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.10% (8.0499 => 3.7756, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.47% (1.1492 => 0.7646, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4246, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.53% (0.0998 => 0.0853, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -11.57% (1.2373 => 1.0941, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3453 => 2.9599, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -10.62% (1.5373 => 1.3741, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.34% (19.9488 => 18.2853, std.dev.: 0.0105) MultiSource/Benchmarks/FreeBench/mason/mason: -8.01% (0.2161 => 0.1988, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.14% (1.8329 => 1.7020, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4781, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.64% (1.9577 => 1.8473, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.58% (1.6805 => 1.5867, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: -5.09% (1.5835 => 1.5029, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.34% (8.1563 => 7.8021, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8775, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.38% (3.2827 => 3.1717, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5010, std.dev.: 0.0034) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.62% (0.4808 => 0.4682, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.81% (10.2830 => 10.0973, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: -1.74% (4.6441 => 4.5631, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6830, std.dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.68% (2.5528 => 2.5099, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4216, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/lists: -1.20% (6.2999 => 6.2240, std.dev.: 0.0071) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2878, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8583, std.dev.: 0.0040) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 17.08% (0.5229 => 0.6122, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 14.10% (14.9895 => 17.1030, std.dev.: 0.0281) MultiSource/Benchmarks/MallocBench/gs/gs: 9.49% (4.1105 => 4.5006, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 16.77% (1.1048 => 1.2901, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.25% (7.1582 => 8.1783, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.17% (0.6222 => 0.7726, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35800.00% (0.0001 => 0.0359, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -3.77% (0.1485 => 0.1429, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.88% (0.2116 => 0.2177, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 18 04:20:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 18 Oct 2012 06:20:35 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121018112035.EE6DB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4959?compare_to=4953&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 4959, Order: 166174, Start Time: 2012-10-18 09:59:21, End Time: 2012-10-18 11:22:35 To: 4953, Order: 166164, Start Time: 2012-10-18 05:50:06, End Time: 2012-10-18 07:14:38 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== Performance Regressions: 33 (4 on baseline) Performance Improvements: 101 (5 on baseline) Existing Failures: 68 (68 on baseline) Unchanged Tests: 840 (965 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/flops-8: 37.41% (1.8635 => 2.5607, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/ary3: 15.45% (1.7328 => 2.0006, std.dev.: 0.0407) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.39% (0.9465 => 1.0448, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 9.72% (1.0152 => 1.1139, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.40% (26.3280 => 28.5391, std.dev.: 0.0291) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.20% (6.4647 => 6.9950, std.dev.: 0.0948) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.26% (0.3046 => 0.3267, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 6.58% (1.3198 => 1.4066, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 5.97% (5.8864 => 6.2380, std.dev.: 0.0180) MultiSource/Benchmarks/Olden/em3d/em3d: 5.60% (5.1705 => 5.4602, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout/ary3: 5.09% (1.9989 => 2.1006, std.dev.: 0.0093) MultiSource/Applications/siod/siod: 5.05% (3.4882 => 3.6642, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 4.69% (4.6453 => 4.8632, std.dev.: 0.0332) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.24% (5.9229 => 6.1740, std.dev.: 0.0398) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 4.03% (4.9374 => 5.1366, std.dev.: 0.0221) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.84% (0.5754 => 0.5975, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 3.79% (43.8331 => 45.4947, std.dev.: 0.5981) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.42% (4.6840 => 4.8444, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 3.24% (9.6166 => 9.9280, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 3.12% (5.4553 => 5.6257, std.dev.: 0.0337) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.83% (5.3432 => 5.4944, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.70% (4.8427 => 4.9736, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.69% (5.8608 => 6.0187, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/fbench: 2.39% (3.3030 => 3.3820, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.01% (6.2776 => 6.4036, std.dev.: 0.0165) MultiSource/Benchmarks/PAQ8p/paq8p: 1.96% (90.0635 => 91.8311, std.dev.: 0.3102) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.90% (4.6623 => 4.7508, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 1.47% (3.3569 => 3.4064, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.35% (4.1889 => 4.2456, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 1.29% (8.9327 => 9.0481, std.dev.: 0.0171) SingleSource/Benchmarks/BenchmarkGame/n-body: 1.29% (1.5117 => 1.5312, std.dev.: 0.0041) MultiSource/Applications/aha/aha: 1.23% (3.2956 => 3.3362, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.21% (1.4170 => 1.4341, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.71% (0.2086 => 0.1946, std.dev.: 0.0029) SingleSource/Benchmarks/McGill/chomp: -6.47% (0.1668 => 0.1560, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.62% (1.2914 => 1.2318, std.dev.: 0.0095) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.57% (0.3804 => 0.3630, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.14% (0.9468 => 0.9076, std.dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: -4.09% (6.9629 => 6.6779, std.dev.: 0.0608) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.09% (4.3263 => 4.1494, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.97% (0.7818 => 0.7508, std.dev.: 0.0111) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.66% (0.9310 => 0.8969, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -3.50% (0.8608 => 0.8307, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -3.49% (0.8309 => 0.8019, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -3.44% (0.9004 => 0.8694, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -3.43% (0.8274 => 0.7990, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -3.43% (0.8451 => 0.8161, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/05-eks/eks: -3.42% (0.4473 => 0.4320, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -3.32% (0.9326 => 0.9016, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.32% (0.8666 => 0.8378, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.29% (0.9338 => 0.9031, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.28% (0.9053 => 0.8756, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.23% (0.8567 => 0.8290, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -3.23% (0.8465 => 0.8192, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -3.21% (0.8293 => 0.8027, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -3.18% (0.8734 => 0.8456, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.18% (0.8314 => 0.8050, std.dev.: 0.0050) MultiSource/Applications/JM/lencod/lencod: -3.13% (15.7246 => 15.2317, std.dev.: 0.1220) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.13% (0.8890 => 0.8612, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -3.12% (0.8609 => 0.8340, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -3.12% (0.8857 => 0.8581, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -3.11% (0.8976 => 0.8697, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -3.10% (0.8555 => 0.8290, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -3.09% (0.9099 => 0.8818, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.04% (0.9174 => 0.8895, std.dev.: 0.0026) MultiSource/Applications/oggenc/oggenc: -3.02% (5.1078 => 4.9535, std.dev.: 0.0310) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -3.00% (0.8195 => 0.7949, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.94% (0.9263 => 0.8991, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -2.93% (0.9005 => 0.8741, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.93% (0.8537 => 0.8287, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.91% (0.8533 => 0.8285, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.89% (0.8753 => 0.8500, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -2.89% (0.9107 => 0.8844, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -2.80% (1.0160 => 0.9876, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -2.72% (0.9950 => 0.9679, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -2.70% (0.8891 => 0.8651, std.dev.: 0.0062) MultiSource/Applications/lua/lua: -2.70% (3.8734 => 3.7690, std.dev.: 0.0364) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.42% (0.6745 => 0.6582, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.37% (1.1798 => 1.1518, std.dev.: 0.0039) MultiSource/Benchmarks/nbench/nbench: -2.28% (1.1449 => 1.1188, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -2.22% (4.5432 => 4.4422, std.dev.: 0.0304) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.98% (6.7328 => 6.5998, std.dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/football/football: -1.90% (0.8900 => 0.8731, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.75% (1.1218 => 1.1022, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.32% (2.1691 => 2.1404, std.dev.: 0.0090) MultiSource/Benchmarks/mafft/pairlocalalign: -1.20% (8.7026 => 8.5984, std.dev.: 0.0213) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.05% (13.2807 => 13.1410, std.dev.: 0.0430) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -32.15% (4.2725 => 2.8990, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -26.48% (4.6039 => 3.3848, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-4: -21.11% (2.1050 => 1.6607, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -20.12% (6.1919 => 4.9459, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -19.99% (4.6436 => 3.7154, std.dev.: 0.0384) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -18.82% (5.8912 => 4.7825, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -15.68% (9.8237 => 8.2833, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -15.32% (5.7455 => 4.8652, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -13.97% (5.2810 => 4.5435, std.dev.: 0.0120) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -13.28% (1.2119 => 1.0510, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -12.87% (3.2107 => 2.7976, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -11.04% (0.1024 => 0.0911, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -10.76% (5.5979 => 4.9956, std.dev.: 0.0306) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -10.63% (5.5319 => 4.9438, std.dev.: 0.0262) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -9.88% (5.9067 => 5.3232, std.dev.: 0.0116) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -9.31% (2.6810 => 2.4315, std.dev.: 0.0345) SingleSource/Benchmarks/Shootout-C++/ackermann: -9.24% (3.9990 => 3.6295, std.dev.: 0.1212) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -8.01% (5.6074 => 5.1582, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -7.79% (3.2254 => 2.9743, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/himenobmtxpa: -7.78% (4.8533 => 4.4757, std.dev.: 0.0602) MultiSource/Benchmarks/mafft/pairlocalalign: -7.67% (68.0852 => 62.8616, std.dev.: 0.2893) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -7.20% (5.8331 => 5.4132, std.dev.: 0.0395) MultiSource/Benchmarks/McCat/18-imp/imp: -7.08% (0.1468 => 0.1364, std.dev.: 0.0039) MultiSource/Applications/SIBsim4/SIBsim4: -6.93% (3.4150 => 3.1785, std.dev.: 0.0240) MultiSource/Benchmarks/BitBench/drop3/drop3: -5.20% (0.3137 => 0.2974, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.00% (3.8775 => 3.7224, std.dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: -3.89% (6.9535 => 6.6829, std.dev.: 0.0457) MultiSource/Benchmarks/FreeBench/neural/neural: -3.37% (1.1220 => 1.0842, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -3.07% (24.3469 => 23.5992, std.dev.: 0.0276) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.04% (9.5509 => 9.2605, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/ReedSolomon: -2.73% (8.7711 => 8.5320, std.dev.: 0.0365) MultiSource/Applications/spiff/spiff: -2.67% (2.9466 => 2.8680, std.dev.: 0.0209) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -2.53% (1.9806 => 1.9305, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -2.50% (3.6584 => 3.5671, std.dev.: 0.0040) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.49% (1.2563 => 1.2250, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -2.43% (5.1424 => 5.0176, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/lists: -2.34% (7.4850 => 7.3099, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -2.31% (5.1450 => 5.0259, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.26% (6.9260 => 6.7694, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.87% (11.6883 => 11.4695, std.dev.: 0.0216) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.84% (2.5135 => 2.4673, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.44% (5.5103 => 5.4312, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-5: -1.39% (2.9386 => 2.8978, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.13% (3.2490 => 3.2123, std.dev.: 0.0128) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.11% (4.4846 => 4.4349, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/oourafft: -1.06% (3.8186 => 3.7781, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.05% (2.9552 => 2.9241, std.dev.: 0.0061) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.06% (16.3591 => 16.3497, std.dev.: 0.0660) MultiSource/Applications/obsequi/Obsequi: -4.35% (1.0510 => 1.0053, std.dev.: 0.0107) MultiSource/Applications/sqlite3/sqlite3: -0.96% (0.6366 => 0.6305, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/08-main/main: -0.65% (0.1839 => 0.1827, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.33% (0.1669 => 0.1580, std.dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.03% (0.3190 => 0.3223, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.61% (0.2415 => 0.2454, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.74% (0.3281 => 0.3371, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.08% (0.2341 => 0.2413, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 0.78% (0.5903 => 0.5949, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -8.56% (0.0479 => 0.0438, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.74% (0.3263 => 0.3287, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 0.30% (0.1970 => 0.1976, std.dev.: 0.0056) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 17.07% (0.0205 => 0.0240, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0207 => 0.0207, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.24% (0.0415 => 0.0414, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 10.38% (0.0289 => 0.0319, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0301 => 0.0301, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0411 => 0.0411, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0192 => 0.0192, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 2.50% (0.0200 => 0.0205, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -13.61% (0.0316 => 0.0273, std.dev.: 0.0027) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1436 => 0.1437, std.dev.: 0.0038) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.77% (1.1774 => 1.1865, std.dev.: 0.0475) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -4.82% (0.1534 => 0.1460, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.07% (0.4071 => 0.4074, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.43% (0.1392 => 0.1386, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.58% (0.0643 => 0.0575, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.48% (0.0287 => 0.0277, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.25% (0.0559 => 0.0552, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -11.93% (1.2932 => 1.1389, std.dev.: 0.0098) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.15% (0.0026 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.16% (0.0630 => 0.0629, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.98% (0.0251 => 0.0261, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 7.86% (0.7440 => 0.8025, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/Regression/C/uint64_to_float: 0.44% (2.1679 => 2.1775, std.dev.: 0.0014) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 1.47% (0.0068 => 0.0069, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.54% (0.3186 => 0.3458, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.29% (0.7597 => 0.7847, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.48% (1.5941 => 1.6177, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/richards_benchmark: 1.28% (1.3037 => 1.3204, std.dev.: 0.0055) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: -7.75% (0.1588 => 0.1465, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.48% (0.6943 => 0.6840, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.43% (1.1685 => 1.1518, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.32% (1.1170 => 1.1022, std.dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -6.24% (3.2926 => 3.0871, std.dev.: 0.0670) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.59% (16.4461 => 16.3497, std.dev.: 0.0660) MultiSource/Applications/obsequi/Obsequi: -2.04% (1.0262 => 1.0053, std.dev.: 0.0107) MultiSource/Applications/sqlite3/sqlite3: -0.43% (0.6332 => 0.6305, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/08-main/main: -0.22% (0.1831 => 0.1827, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.35% (0.1559 => 0.1580, std.dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.20% (0.3123 => 0.3223, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.37% (0.2463 => 0.2454, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.81% (0.3344 => 0.3371, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.07% (0.2364 => 0.2413, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -1.01% (0.6010 => 0.5949, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: 2.10% (0.0429 => 0.0438, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.64% (0.3266 => 0.3287, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 0.36% (0.1969 => 0.1976, std.dev.: 0.0056) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.14% (0.0224 => 0.0240, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 68.29% (0.0123 => 0.0207, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.47% (0.0408 => 0.0414, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 25.59% (0.0254 => 0.0319, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.33% (0.0302 => 0.0301, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 7.03% (0.0384 => 0.0411, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 1.05% (0.0190 => 0.0192, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 13.89% (0.0180 => 0.0205, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 18.70% (0.0230 => 0.0273, std.dev.: 0.0027) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1438 => 0.1437, std.dev.: 0.0038) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 4.73% (1.1329 => 1.1865, std.dev.: 0.0475) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.14% (0.1462 => 0.1460, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.16% (0.4164 => 0.4074, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.24% (0.1369 => 0.1386, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.30% (0.0641 => 0.0575, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.50% (0.0578 => 0.0552, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.42% (1.1437 => 1.1389, std.dev.: 0.0098) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.32% (0.0627 => 0.0629, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 45.00% (0.0180 => 0.0261, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.10% (0.8017 => 0.8025, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/Regression/C/uint64_to_float: -0.26% (2.1832 => 2.1775, std.dev.: 0.0014) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 11.29% (0.0062 => 0.0069, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 18 04:21:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 18 Oct 2012 06:21:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121018112102.4C10D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4960?compare_to=4957&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4960, Order: 166174, Start Time: 2012-10-18 09:58:21, End Time: 2012-10-18 11:24:00 To: 4957, Order: 166170, Start Time: 2012-10-18 08:02:59, End Time: 2012-10-18 09:28:50 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (186 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1041 (679 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.79% (54.8932 => 56.4256, std.dev.: 0.1126) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.61% (2.0176 => 2.4940, std.dev.: 0.0050) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.30% (0.1410 => 0.1668, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 17.43% (0.0826 => 0.0970, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 16.41% (0.2243 => 0.2611, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 14.22% (0.1013 => 0.1157, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.67% (0.0834 => 0.0948, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.16% (0.1413 => 0.1599, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.94% (0.0819 => 0.0925, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.63% (3.9660 => 4.4669, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.59% (0.1588 => 0.1788, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.51% (0.1327 => 0.1493, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 12.50% (0.7038 => 0.7918, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 12.48% (0.4328 => 0.4868, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 12.46% (1.3693 => 1.5399, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.46% (0.2721 => 0.3060, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.45% (0.0964 => 0.1084, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.22% (0.6283 => 0.7051, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 12.09% (0.4062 => 0.4553, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.06% (0.2596 => 0.2909, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.02% (1.4563 => 1.6313, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 11.99% (13.8202 => 15.4767, std.dev.: 0.0083) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.91% (0.7710 => 0.8628, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.89% (0.5265 => 0.5891, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.86% (0.9199 => 1.0290, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.71% (0.6959 => 0.7774, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.69% (1.1364 => 1.2692, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.67% (1.2193 => 1.3616, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 11.62% (0.5818 => 0.6494, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/power/power: 11.47% (0.1003 => 0.1118, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 11.27% (0.5748 => 0.6396, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 11.21% (0.1062 => 0.1181, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.17% (0.4791 => 0.5326, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.13% (0.3485 => 0.3873, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 11.02% (1.0313 => 1.1450, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.96% (0.3130 => 0.3473, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 10.89% (0.7061 => 0.7830, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.88% (0.4016 => 0.4453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.81% (0.3756 => 0.4162, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.79% (0.5577 => 0.6179, std.dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 10.68% (0.2781 => 0.3078, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 10.66% (1.1061 => 1.2240, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.64% (0.3899 => 0.4314, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 10.55% (0.3868 => 0.4276, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.54% (0.1157 => 0.1279, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.51% (0.1075 => 0.1188, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.50% (0.2782 => 0.3074, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 10.47% (0.6744 => 0.7450, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 10.45% (0.3293 => 0.3637, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 10.44% (0.1111 => 0.1227, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.43% (0.3489 => 0.3853, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 10.38% (0.2995 => 0.3306, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 10.37% (0.3453 => 0.3811, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.26% (0.1072 => 0.1182, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.23% (0.4379 => 0.4827, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 10.23% (3.1889 => 3.5151, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 10.21% (16.6129 => 18.3087, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.19% (0.3022 => 0.3330) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.17% (0.3246 => 0.3576, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.16% (0.2914 => 0.3210, std.dev.: 0.0035) MultiSource/Applications/viterbi/viterbi: 10.15% (0.1478 => 0.1628, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.12% (0.7460 => 0.8215, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.11% (0.1276 => 0.1405, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.11% (0.2127 => 0.2342, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.09% (0.8698 => 0.9576, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.08% (0.3580 => 0.3941, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.07% (0.1569 => 0.1727, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 10.03% (0.3220 => 0.3543, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 10.03% (1.9270 => 2.1202, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 10.01% (0.1589 => 0.1748, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.00% (0.4390 => 0.4829, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 9.93% (0.3534 => 0.3885, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 9.89% (0.2761 => 0.3034, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.89% (1.9828 => 2.1788, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 9.87% (0.2726 => 0.2995, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 9.86% (0.2628 => 0.2887, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.85% (0.5637 => 0.6192, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.81% (0.2966 => 0.3257, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.77% (0.1986 => 0.2180, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 9.77% (0.7506 => 0.8239, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 9.75% (3.8646 => 4.2415, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/football/football: 9.75% (0.8310 => 0.9120, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 9.75% (0.2760 => 0.3029, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 9.74% (0.2690 => 0.2952, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.71% (0.1865 => 0.2046, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 9.70% (0.2607 => 0.2860, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 9.69% (0.3149 => 0.3454, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.68% (0.2655 => 0.2912, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 9.66% (2.1791 => 2.3896, std.dev.: 0.0113) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.64% (0.2023 => 0.2218, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.62% (0.1435 => 0.1573, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.57% (7.2180 => 7.9091, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/wc: 9.57% (0.2937 => 0.3218, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary: 9.56% (0.3107 => 0.3404, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 9.56% (0.3192 => 0.3497, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/09-vor/vor: 9.54% (0.2925 => 0.3204, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.51% (0.2765 => 0.3028, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.43% (4.9865 => 5.4566, std.dev.: 0.0085) MultiSource/Benchmarks/nbench/nbench: 9.28% (1.0594 => 1.1577, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.24% (0.2696 => 0.2945, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 9.17% (0.2988 => 0.3262, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.11% (0.3755 => 0.4097, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 9.05% (4.6629 => 5.0851, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 9.05% (0.1657 => 0.1807, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 9.05% (1.2749 => 1.3903, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 8.96% (0.2945 => 0.3209, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.93% (0.6576 => 0.7163, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.89% (1.3245 => 1.4423, std.dev.: 0.0043) MultiSource/Benchmarks/sim/sim: 8.85% (0.3131 => 0.3408, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.83% (3.6692 => 3.9932, std.dev.: 0.0073) MultiSource/Applications/JM/lencod/lencod: 8.79% (14.8535 => 16.1596, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.73% (4.4433 => 4.8310, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.68% (4.3801 => 4.7604, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.50% (0.1789 => 0.1941, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 8.49% (8.4961 => 9.2174, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.41% (0.6135 => 0.6651, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 8.32% (0.6250 => 0.6770, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.32% (0.2140 => 0.2318, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.29% (1.5188 => 1.6447, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.17% (0.3511 => 0.3798, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.14% (0.8818 => 0.9536, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 7.97% (0.4003 => 0.4322, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.92% (3.2742 => 3.5335, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions: 7.89% (0.3914 => 0.4223, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.89% (0.3245 => 0.3501, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 7.88% (0.4113 => 0.4437, std.dev.: 0.0094) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.84% (0.9108 => 0.9822, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.74% (0.4805 => 0.5177, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.74% (0.3578 => 0.3855, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.74% (0.3940 => 0.4245, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.73% (0.3663 => 0.3946, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.68% (1.1333 => 1.2203, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 7.65% (0.1385 => 0.1491) SingleSource/UnitTests/ObjC/exceptions-4: 7.65% (0.3646 => 0.3925, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.64% (0.1819 => 0.1958, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.63% (0.3789 => 0.4078, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.63% (0.2321 => 0.2498, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 7.58% (0.3601 => 0.3874, std.dev.: 0.0078) SingleSource/UnitTests/ObjC/exceptions-3: 7.56% (0.3623 => 0.3897, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.48% (0.3650 => 0.3923, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 7.47% (6.5754 => 7.0669, std.dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.44% (2.1007 => 2.2570, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 7.41% (3.7467 => 4.0243, std.dev.: 0.0126) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.31% (0.2504 => 0.2687, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 7.27% (0.2008 => 0.2154, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 7.05% (1.2292 => 1.3158, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.77% (13.2842 => 14.1841, std.dev.: 0.0167) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.67% (6.2785 => 6.6975, std.dev.: 0.0092) MultiSource/Applications/sqlite3/sqlite3: 5.57% (16.2614 => 17.1667, std.dev.: 0.0148) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.13% (0.2243 => 0.2358, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 4.51% (14.5298 => 15.1857, std.dev.: 0.0075) MultiSource/Benchmarks/Bullet/bullet: 2.16% (33.2944 => 34.0123, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.50% (5.7573 => 7.5132, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/fbench: 24.47% (1.8175 => 2.2622, std.dev.: 0.0140) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.11% (1.0895 => 1.2759, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: 11.12% (1.1560 => 1.2845, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 8.99% (0.8273 => 0.9017, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4145, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 5.52% (1.2998 => 1.3716, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.43% (0.9692 => 1.0218, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0040, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 4.46% (0.5449 => 0.5692, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7748, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.72% (11.2619 => 11.6813, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 3.38% (12.0921 => 12.5011, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 3.38% (1.9199 => 1.9848, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bisort/bisort: 3.11% (0.8239 => 0.8495, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 2.85% (10.7476 => 11.0544, std.dev.: 0.0292) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.21% (7.4271 => 7.5910, std.dev.: 0.0039) MultiSource/Applications/lemon/lemon: 1.82% (1.4298 => 1.4558, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5130, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.20% (9.0760 => 9.1849, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5782, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5863, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/queens: 1.00% (2.1753 => 2.1971, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.93% (0.2670 => 0.1417, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.53% (0.4657 => 0.3934, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -14.29% (0.0707 => 0.0606, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.26% (1.3813 => 1.1982, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.22% (1.3819 => 1.1992, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.28% (1.0460 => 0.8548, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/mason/mason: -12.82% (0.2238 => 0.1951, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.95% (20.3410 => 18.3180, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -5.83% (1.2308 => 1.1591, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5150, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.56% (1.3780 => 1.3151, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.46% (0.9996 => 0.9550, std.dev.: 0.0130) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.77% (1.7688 => 1.7021, std.dev.: 0.0093) MultiSource/Applications/siod/siod: -3.30% (3.2729 => 3.1650, std.dev.: 0.0028) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4867 => 0.4717, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -2.86% (3.0263 => 2.9396, std.dev.: 0.0015) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8812, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -2.37% (1.9762 => 1.9294, std.dev.: 0.0032) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.11% (0.6589 => 0.6450, std.dev.: 0.0007) MultiSource/Applications/lua/lua: -2.01% (26.5159 => 25.9839, std.dev.: 0.0242) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.00% (0.8342 => 0.8175, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.87% (0.6615 => 0.6491, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.79% (6.3560 => 6.2421, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.60% (2.5254 => 2.4850, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0075, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.23% (5.3167 => 5.2513, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/heapsort: -1.21% (3.9173 => 3.8700, std.dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: -1.19% (28.2225 => 27.8857, std.dev.: 0.0026) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1138, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -1.05% (84.4286 => 83.5449, std.dev.: 0.0057) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 18 05:52:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 18 Oct 2012 07:52:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121018125244.9E3D32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4961?compare_to=4958&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4961, Order: 166176, Start Time: 2012-10-18 11:34:46, End Time: 2012-10-18 12:54:42 To: 4958, Order: 166174, Start Time: 2012-10-18 09:44:52, End Time: 2012-10-18 11:05:12 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (75 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (180 on baseline) Performance Improvements: 2 (44 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 90 (15 on baseline) Unchanged Tests: 949 (662 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.05% (55.0681 => 56.1974, std.dev.: 0.2264) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -17.15% (0.4822 => 0.3995, std.dev.: 0.0257) MultiSource/Benchmarks/PAQ8p/paq8p: -5.84% (15.7788 => 14.8571, std.dev.: 0.0051) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.51% (0.6122 => 0.6091, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 0.02% (17.1030 => 17.1065, std.dev.: 0.0104) MultiSource/Benchmarks/Bullet/bullet: -0.27% (55.9741 => 55.8212, std.dev.: 0.0351) MultiSource/Benchmarks/MallocBench/gs/gs: -0.08% (4.5006 => 4.4968, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.21% (0.0466 => 0.0465, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.21% (0.0468 => 0.0467, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.46% (0.0435 => 0.0433, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.23% (0.0437 => 0.0436) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.47% (0.0425 => 0.0423, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.23% (0.0426 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.24% (0.0417 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.24% (0.0419 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.46% (0.0436 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.23% (0.0438 => 0.0437, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.47% (0.0430 => 0.0428, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.46% (0.0432 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.24% (0.0421 => 0.0420, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.47% (0.0423 => 0.0421, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.23% (0.0427 => 0.0426, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0428 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.46% (0.0439 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.45% (0.0441 => 0.0439, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0414 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.48% (0.0417 => 0.0415) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.23% (0.0426 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.47% (0.0429 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.24% (0.0418 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.24% (0.0420 => 0.0419, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.49% (0.0411 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.24% (0.0412 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.24% (0.0410 => 0.0409) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0410 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.45% (0.0447 => 0.0445, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.45% (0.0448 => 0.0446, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.24% (0.0409 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.24% (0.0410 => 0.0409) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.24% (0.0411 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.24% (0.0412 => 0.0411, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.24% (0.0419 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.39% (1.2901 => 1.2851, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.04% (8.1783 => 8.1752, std.dev.: 0.0122) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.19% (0.7726 => 0.7711, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.28% (0.0359 => 0.0360, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: - (0.1429 => 0.1429, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -0.06% (0.1658 => 0.1657, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.84% (0.2177 => 0.2137, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.74% (63.2438 => 55.8212, std.dev.: 0.0351) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 1.10% (0.1639 => 0.1657, std.dev.: 0.0000) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 35.06% (14.1553 => 19.1181, std.dev.: 0.0171) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.44% (3.4629 => 5.7636, std.dev.: 0.0054) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13424.72% (0.0720 => 9.7378, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9973500.00% (0.0001 => 9.9736, std.dev.: 0.0010) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 61.79% (0.2554 => 0.4132, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: 51.95% (0.0256 => 0.0389, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 43.31% (10.3673 => 14.8571, std.dev.: 0.0051) SingleSource/UnitTests/SignlessTypes/factor: 41.55% (0.0296 => 0.0419, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 37.24% (0.1622 => 0.2226, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 35.89% (0.1056 => 0.1435, std.dev.: 0.0007) SingleSource/UnitTests/vla: 28.73% (0.0355 => 0.0457, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 21.10% (0.0834 => 0.1010, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.51% (7.0540 => 8.3597, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.47% (2.2022 => 2.6090, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 18.23% (0.1432 => 0.1693, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 16.67% (0.5105 => 0.5956, std.dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.65% (0.0871 => 0.1016, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.60% (0.1566 => 0.1826, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 16.54% (0.6675 => 0.7779, std.dev.: 0.0043) MultiSource/Applications/d/make_dparser: 15.40% (3.3354 => 3.8492, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.16% (1.3050 => 1.5028, std.dev.: 0.0085) SingleSource/Benchmarks/McGill/chomp: 15.11% (0.1655 => 0.1905, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 14.62% (0.2271 => 0.2603, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 14.43% (10.4361 => 11.9425, std.dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.32% (0.5020 => 0.5739, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/oourafft: 14.32% (0.3282 => 0.3752, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.06% (1.7609 => 2.0084, std.dev.: 0.0096) MultiSource/Applications/minisat/minisat: 14.04% (0.7115 => 0.8114, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/power/power: 13.96% (0.1440 => 0.1641, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 13.86% (9.4845 => 10.7992, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.65% (1.5415 => 1.7519, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.44% (0.1510 => 0.1713, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 12.90% (0.3109 => 0.3510, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: 12.77% (0.3423 => 0.3860, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 12.68% (0.1695 => 0.1910, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 12.63% (0.1584 => 0.1784, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/matrix: 12.59% (0.0818 => 0.0921, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.42% (0.4615 => 0.5188, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.39% (4.2646 => 4.7931, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/tsp/tsp: 12.34% (0.1175 => 0.1320, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 12.24% (0.1463 => 0.1642, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.11% (0.1032 => 0.1157, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 12.04% (0.1163 => 0.1303, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.97% (0.1236 => 0.1384, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 11.95% (8.1363 => 9.1083, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.92% (0.6450 => 0.7219, std.dev.: 0.0040) MultiSource/Applications/viterbi/viterbi: 11.90% (0.1555 => 0.1740, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 11.84% (1.0722 => 1.1992, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.79% (0.9765 => 1.0916, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 11.78% (5.7591 => 6.4377, std.dev.: 0.0145) MultiSource/Benchmarks/sim/sim: 11.78% (0.3387 => 0.3786, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.74% (0.1695 => 0.1894, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 11.74% (0.0886 => 0.0990, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 11.72% (1.1840 => 1.3228, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 11.68% (1.1642 => 1.3002, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/life/life: 11.58% (0.0933 => 0.1041, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 11.57% (2.0273 => 2.2619, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.56% (7.9617 => 8.8817, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.55% (0.5860 => 0.6537, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.52% (0.2700 => 0.3011, std.dev.: 0.0006) SingleSource/UnitTests/SignlessTypes/rem: 11.45% (0.1144 => 0.1275, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.44% (0.1940 => 0.2162, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 11.42% (0.7433 => 0.8282, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.42% (4.9449 => 5.5096, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.34% (0.3307 => 0.3682, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.33% (5.0018 => 5.5684, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 11.29% (0.1337 => 0.1488, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 11.27% (3.8723 => 4.3086, std.dev.: 0.0073) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.27% (0.1438 => 0.1600, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 11.12% (0.1151 => 0.1279, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.02% (0.1625 => 0.1804, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.98% (0.3543 => 0.3932, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 10.98% (0.7835 => 0.8695, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.87% (0.0929 => 0.1030, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.87% (0.2107 => 0.2336, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.86% (0.4879 => 0.5409, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 10.86% (1.1861 => 1.3149, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/trivial-interface: 10.86% (0.3473 => 0.3850, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.83% (0.1330 => 0.1474, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 10.81% (0.3543 => 0.3926, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.77% (0.3121 => 0.3457, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.76% (1.5859 => 1.7565, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 10.72% (0.3497 => 0.3872, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.70% (0.3561 => 0.3942, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.69% (0.3516 => 0.3892, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 10.68% (0.8921 => 0.9874, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions: 10.63% (0.3828 => 0.4235, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.61% (0.3694 => 0.4086, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.56% (0.1117 => 0.1235, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.54% (0.3177 => 0.3512, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.49% (0.1906 => 0.2106, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 10.49% (0.3927 => 0.4339, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.44% (0.2758 => 0.3046, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.40% (0.8172 => 0.9022, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.39% (0.8067 => 0.8905, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 10.37% (0.4299 => 0.4745, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.36% (2.2024 => 2.4306, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 10.34% (0.3886 => 0.4288, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.34% (0.5569 => 0.6145, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.31% (0.1125 => 0.1241, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.30% (0.1029 => 0.1135, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 10.27% (0.6456 => 0.7119, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.09% (1.4186 => 1.5618, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.08% (0.1062 => 0.1169, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.97% (0.2266 => 0.2492, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 9.76% (0.2603 => 0.2857, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 9.67% (21.9371 => 24.0575, std.dev.: 0.0127) MultiSource/Applications/hbd/hbd: 9.51% (1.5603 => 1.7087, std.dev.: 0.0088) MultiSource/Applications/siod/siod: 9.41% (2.2969 => 2.5130, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/health/health: 9.38% (0.1268 => 0.1387, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 9.37% (0.3180 => 0.3478, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: 9.35% (0.4620 => 0.5052, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 9.32% (0.2049 => 0.2240, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.30% (0.2065 => 0.2257, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.21% (0.3441 => 0.3758, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 9.07% (0.4289 => 0.4678, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.68% (0.3826 => 0.4158, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 8.65% (0.3422 => 0.3718, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.56% (0.3865 => 0.4196, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.54% (0.5981 => 0.6492, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.41% (0.6030 => 0.6537, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.37% (0.4203 => 0.4555, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.30% (0.4636 => 0.5021, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.27% (0.5925 => 0.6415, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists1: 8.14% (0.3684 => 0.3984, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 8.08% (0.4048 => 0.4375, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.93% (0.1892 => 0.2042, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.79% (0.3427 => 0.3694, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.70% (0.4103 => 0.4419, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 7.67% (0.7326 => 0.7888, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 7.64% (17.1811 => 18.4932, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/sieve: 7.30% (0.3603 => 0.3866, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.24% (14.3668 => 15.4067, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.04% (0.3650 => 0.3907, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.97% (0.8101 => 0.8666, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.91% (0.4064 => 0.4345, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 6.73% (0.3092 => 0.3300, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.72% (3.8922 => 4.1539, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/matrix: 6.58% (0.3098 => 0.3302, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.56% (0.3232 => 0.3444) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.54% (0.3136 => 0.3341, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.34% (0.3283 => 0.3491, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.33% (0.2905 => 0.3089, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 6.32% (0.2831 => 0.3010, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.29% (0.3162 => 0.3361, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.23% (0.2891 => 0.3071, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.22% (2.0665 => 2.1950, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.02% (0.2872 => 0.3045, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.96% (0.2871 => 0.3042, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.91% (0.2756 => 0.2919, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: 5.91% (0.2877 => 0.3047, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.87% (0.2793 => 0.2957, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.80% (0.3379 => 0.3575, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 5.80% (0.3052 => 0.3229, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.80% (0.2725 => 0.2883, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.53% (0.2802 => 0.2957, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.38% (0.2714 => 0.2860, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 5.37% (1.2842 => 1.3531, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.31% (0.2430 => 0.2559, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.76% (0.3131 => 0.3280, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.09% (0.3817 => 0.3935, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.97% (1.1194 => 1.1526, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.74% (1.1145 => 1.3011, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 10.54% (0.9957 => 1.1006, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/richards_benchmark: 9.78% (1.1396 => 1.2511, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3692, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: 5.56% (1.9405 => 2.0484, std.dev.: 0.0018) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.67% (4.2280 => 4.3410, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.98% (3.6395 => 3.7114, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bisort/bisort: 1.96% (0.8333 => 0.8496, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2076, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.47% (2.6546 => 2.6936, std.dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 1.13% (11.6436 => 11.7748, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.03% (6.5088 => 6.5758, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1311, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -79.92% (0.8651 => 0.1737, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.03% (5.2763 => 3.2698, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.99% (5.3855 => 3.7167, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.49% (5.3526 => 3.7204, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -14.68% (54.1659 => 46.2160, std.dev.: 0.0330) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.29% (2.9384 => 2.6360, std.dev.: 0.0033) MultiSource/Applications/ClamAV/clamscan: -7.39% (22.1758 => 20.5378, std.dev.: 0.0137) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.08% (8.0499 => 3.7770, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.52% (1.1492 => 0.7640, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4242, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3453 => 2.9600, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.48% (1.2373 => 1.0953, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel-2: -10.88% (1.5373 => 1.3700, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.36% (19.9488 => 18.2815, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/mason/mason: -7.73% (0.2161 => 0.1994, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.99% (1.8329 => 1.7047, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0142) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.52% (1.6805 => 1.5878, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.65% (1.5835 => 1.5098, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.45% (8.1563 => 7.7935, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -3.39% (5.0483 => 4.8774, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.36% (3.2827 => 3.1723, std.dev.: 0.0109) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4944, std.dev.: 0.0037) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.64% (0.4808 => 0.4681, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.84% (10.2830 => 10.0933, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6804, std.dev.: 0.0022) SingleSource/UnitTests/Vector/multiplies: -1.69% (2.5528 => 2.5097, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -1.67% (4.6441 => 4.5665, std.dev.: 0.0090) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.47% (9.5636 => 9.4229, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2879) SingleSource/Benchmarks/Shootout/lists: -1.07% (6.2999 => 6.2323, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8563, std.dev.: 0.0119) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 16.48% (0.5229 => 0.6091, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 14.12% (14.9895 => 17.1065, std.dev.: 0.0104) MultiSource/Benchmarks/MallocBench/gs/gs: 9.40% (4.1105 => 4.4968, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 16.32% (1.1048 => 1.2851, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.21% (7.1582 => 8.1752, std.dev.: 0.0122) SingleSource/Benchmarks/Misc-C++/stepanov_container: 23.93% (0.6222 => 0.7711, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35900.00% (0.0001 => 0.0360, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.77% (0.1485 => 0.1429, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.99% (0.2116 => 0.2137, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 18 06:00:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 18 Oct 2012 08:00:26 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121018130026.D682A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4962?compare_to=4959&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 4962, Order: 166176, Start Time: 2012-10-18 11:39:17, End Time: 2012-10-18 13:02:26 To: 4959, Order: 166174, Start Time: 2012-10-18 09:59:21, End Time: 2012-10-18 11:22:35 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== Performance Regressions: 5 (1 on baseline) Performance Improvements: 1 (8 on baseline) Existing Failures: 68 (68 on baseline) Unchanged Tests: 968 (965 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.94% (0.3630 => 0.3773, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.14% (1.1518 => 1.1765, std.dev.: 0.0047) MultiSource/Applications/Burg/burg: 1.12% (1.2182 => 1.2318, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.48% (40.8701 => 41.8856, std.dev.: 0.3050) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.18% (1.3855 => 1.4019, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/football/football: -1.15% (0.8731 => 0.8631, std.dev.: 0.0039) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.19% (16.3497 => 16.3805, std.dev.: 0.0787) MultiSource/Applications/obsequi/Obsequi: 1.52% (1.0053 => 1.0206, std.dev.: 0.0059) MultiSource/Applications/sqlite3/sqlite3: -0.06% (0.6305 => 0.6301, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/08-main/main: -2.41% (0.1827 => 0.1783, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.66% (0.1580 => 0.1622, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.25% (0.3223 => 0.3215, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.61% (0.2454 => 0.2469, std.dev.: 0.0149) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.88% (0.3371 => 0.3274, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.77% (0.2413 => 0.2322, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/bigfib: 0.05% (0.5949 => 0.5952, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -4.11% (0.0438 => 0.0420, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.3287 => 0.3287, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/strcat: 0.20% (0.1976 => 0.1980, std.dev.: 0.0019) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -34.58% (0.0240 => 0.0157, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -22.22% (0.0207 => 0.0161, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.24% (0.0414 => 0.0413, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.31% (0.0319 => 0.0320, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.33% (0.0301 => 0.0302, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.24% (0.0411 => 0.0410, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0192 => 0.0192, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -20.00% (0.0205 => 0.0164, std.dev.: 0.0021) SingleSource/UnitTests/byval-alignment: -13.55% (0.0273 => 0.0236, std.dev.: 0.0022) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -53.85% (0.0013 => 0.0006, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.63% (0.1437 => 0.1446, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.74% (1.1865 => 1.1658, std.dev.: 0.0276) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -5.96% (0.1460 => 0.1373, std.dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.96% (0.4074 => 0.4113, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.58% (0.1386 => 0.1378, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.83% (0.0575 => 0.0553, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -23.47% (0.0277 => 0.0212, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.17% (0.0552 => 0.0540, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.40% (1.1389 => 1.1434, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.77% (0.0031 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.76% (0.0629 => 0.0555, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.33% (0.0261 => 0.0174, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.06% (0.8025 => 0.7940, std.dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/Regression/C/uint64_to_float: -1.11% (2.1775 => 2.1534, std.dev.: 0.0213) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 18.84% (0.0069 => 0.0082, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.63% (0.3186 => 0.3461, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -3.51% (0.4847 => 0.4677, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.91% (1.3279 => 1.3025, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/football/football: -1.56% (0.8768 => 0.8631, std.dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: -1.36% (0.7557 => 0.7454, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.27% (8.6476 => 8.5381, std.dev.: 0.0387) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -2.32% (0.6910 => 0.6750, std.dev.: 0.0061) MultiSource/Applications/SPASS/SPASS: -1.76% (8.4326 => 8.2838, std.dev.: 0.0438) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.02% (1.2822 => 1.2691, std.dev.: 0.0029) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.40% (16.4461 => 16.3805, std.dev.: 0.0787) MultiSource/Applications/obsequi/Obsequi: -0.55% (1.0262 => 1.0206, std.dev.: 0.0059) MultiSource/Applications/sqlite3/sqlite3: -0.49% (0.6332 => 0.6301, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/08-main/main: -2.62% (0.1831 => 0.1783, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.04% (0.1559 => 0.1622, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.95% (0.3123 => 0.3215, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.24% (0.2463 => 0.2469, std.dev.: 0.0149) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.09% (0.3344 => 0.3274, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.78% (0.2364 => 0.2322, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/bigfib: -0.97% (0.6010 => 0.5952, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -2.10% (0.0429 => 0.0420, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.64% (0.3266 => 0.3287, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/strcat: 0.56% (0.1969 => 0.1980, std.dev.: 0.0019) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -29.91% (0.0224 => 0.0157, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 30.89% (0.0123 => 0.0161, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.23% (0.0408 => 0.0413, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 25.98% (0.0254 => 0.0320, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0302 => 0.0302, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 6.77% (0.0384 => 0.0410, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/casts: 1.05% (0.0190 => 0.0192, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -8.89% (0.0180 => 0.0164, std.dev.: 0.0021) SingleSource/UnitTests/byval-alignment: 2.61% (0.0230 => 0.0236, std.dev.: 0.0022) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -14.29% (0.0007 => 0.0006, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.56% (0.1438 => 0.1446, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.90% (1.1329 => 1.1658, std.dev.: 0.0276) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -6.09% (0.1462 => 0.1373, std.dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.22% (0.4164 => 0.4113, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.66% (0.1369 => 0.1378, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -13.73% (0.0641 => 0.0553, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.72% (0.0195 => 0.0212, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.57% (0.0578 => 0.0540, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.03% (1.1437 => 1.1434, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.48% (0.0627 => 0.0555, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.33% (0.0180 => 0.0174, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.96% (0.8017 => 0.7940, std.dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/Regression/C/uint64_to_float: -1.36% (2.1832 => 2.1534, std.dev.: 0.0213) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 32.26% (0.0062 => 0.0082, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 18 06:15:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 18 Oct 2012 08:15:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121018131555.868952A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4963?compare_to=4960&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4963, Order: 166176, Start Time: 2012-10-18 11:53:12, End Time: 2012-10-18 13:18:52 To: 4960, Order: 166174, Start Time: 2012-10-18 09:58:21, End Time: 2012-10-18 11:24:00 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (184 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1042 (681 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.60% (2.0176 => 2.4937, std.dev.: 0.0128) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.01% (0.1410 => 0.1664, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 16.95% (0.0826 => 0.0966, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 16.05% (0.2243 => 0.2603, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 13.82% (0.1013 => 0.1153, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.55% (0.0834 => 0.0947, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.95% (0.1413 => 0.1596, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.81% (0.1327 => 0.1497, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.57% (0.2721 => 0.3063, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 12.50% (1.3693 => 1.5404, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.46% (3.9660 => 4.4603, std.dev.: 0.0040) MultiSource/Applications/lambda-0_1_3/lambda: 12.40% (0.7038 => 0.7911, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 12.34% (0.4328 => 0.4862, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.28% (0.1588 => 0.1783, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.24% (0.0964 => 0.1082, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.06% (0.6283 => 0.7041, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.91% (1.4563 => 1.6298, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.87% (0.7710 => 0.8625, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 11.85% (13.8202 => 15.4584, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.83% (0.2596 => 0.2903, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.78% (0.9199 => 1.0283, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 11.72% (0.4062 => 0.4538) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.70% (0.5265 => 0.5881, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.56% (1.2193 => 1.3602, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.54% (0.6959 => 0.7762, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 11.53% (0.5818 => 0.6489, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.47% (1.1364 => 1.2667, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 11.27% (0.1003 => 0.1116, std.dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference: 11.22% (0.7061 => 0.7853, std.dev.: 0.0044) SingleSource/UnitTests/ObjC++/Hello: 11.13% (0.5748 => 0.6388, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.08% (0.5577 => 0.6195, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.96% (0.4791 => 0.5316, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.93% (0.3899 => 0.4325, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 10.92% (0.1062 => 0.1178, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 10.92% (1.0313 => 1.1439, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.88% (0.3485 => 0.3864, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 10.79% (0.2781 => 0.3081, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.73% (0.3130 => 0.3466, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 10.61% (1.1061 => 1.2235, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.58% (0.4016 => 0.4441, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.54% (0.3756 => 0.4152, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.51% (0.1075 => 0.1188, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 10.45% (0.3293 => 0.3637, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.37% (0.1157 => 0.1277, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.32% (0.2782 => 0.3069, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.29% (0.3022 => 0.3333, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 10.26% (0.1111 => 0.1225, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.17% (0.3489 => 0.3844, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 10.15% (0.2995 => 0.3299, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 10.14% (0.6744 => 0.7428, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 10.11% (0.3453 => 0.3802, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.10% (0.3246 => 0.3574, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.09% (0.4379 => 0.4821, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 10.08% (0.3868 => 0.4258, std.dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.07% (0.1072 => 0.1180, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.06% (0.2127 => 0.2341, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 9.99% (16.6129 => 18.2732, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/strcat: 9.98% (0.2726 => 0.2998, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 9.97% (3.1889 => 3.5069, std.dev.: 0.0084) MultiSource/Applications/viterbi/viterbi: 9.95% (0.1478 => 0.1625, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.93% (1.9828 => 2.1796, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 9.91% (0.3149 => 0.3461, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 9.88% (1.9270 => 2.1174, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.88% (0.8698 => 0.9557, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.87% (0.1276 => 0.1402, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 9.87% (0.7506 => 0.8247, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.85% (0.7460 => 0.8195, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 9.82% (0.1589 => 0.1745, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 9.81% (0.3220 => 0.3536, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.81% (0.2966 => 0.3257, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.80% (0.3580 => 0.3931, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 9.79% (0.3534 => 0.3880, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.78% (0.2914 => 0.3199, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.77% (0.4390 => 0.4819, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 9.75% (0.3107 => 0.3410, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.75% (0.1569 => 0.1722, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 9.70% (0.2690 => 0.2951, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.68% (0.2655 => 0.2912, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 9.68% (3.8646 => 4.2386, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: 9.67% (0.2761 => 0.3028, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.67% (0.1986 => 0.2178, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 9.67% (0.2607 => 0.2859, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 9.65% (0.8310 => 0.9112, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.62% (0.5637 => 0.6179, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 9.60% (0.2760 => 0.3025, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 9.55% (0.2628 => 0.2879, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.51% (0.2765 => 0.3028, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 9.50% (0.2937 => 0.3216, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.49% (0.2023 => 0.2215, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 9.49% (2.1791 => 2.3858, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.46% (0.6576 => 0.7198, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.45% (7.2180 => 7.9004, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/ary2: 9.43% (0.3192 => 0.3493, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.38% (0.1865 => 0.2040, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.33% (4.9865 => 5.4517, std.dev.: 0.0043) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.27% (0.1435 => 0.1568, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.24% (0.2696 => 0.2945, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 9.19% (1.0594 => 1.1568, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 9.16% (0.2925 => 0.3193, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 9.14% (0.2988 => 0.3261, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.95% (0.3755 => 0.4091, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 8.87% (0.1657 => 0.1804, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.77% (1.3245 => 1.4407, std.dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: 8.77% (1.2749 => 1.3867, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/objinst: 8.73% (0.2945 => 0.3202, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 8.64% (14.8535 => 16.1364, std.dev.: 0.0153) MultiSource/Benchmarks/sim/sim: 8.62% (0.3131 => 0.3401, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.61% (3.6692 => 3.9853, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.57% (4.4433 => 4.8240, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.51% (4.3801 => 4.7530, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.51% (0.8818 => 0.9568, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.43% (0.3511 => 0.3807, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 8.33% (8.4961 => 9.2037, std.dev.: 0.0071) MultiSource/Applications/oggenc/oggenc: 8.30% (4.6629 => 5.0499, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.28% (0.6135 => 0.6643, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.16% (1.5188 => 1.6428, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 8.11% (0.6250 => 0.6757, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.04% (0.2140 => 0.2312, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.94% (0.1789 => 0.1931, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.80% (3.2742 => 3.5297, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 7.61% (0.4113 => 0.4426, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.61% (0.9108 => 0.9801, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.60% (0.4805 => 0.5170, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.59% (1.1333 => 1.2193, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 7.58% (0.1385 => 0.1490, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 7.57% (0.4003 => 0.4306, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.49% (2.1007 => 2.2581, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 7.49% (0.3914 => 0.4207, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.43% (0.3245 => 0.3486, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.38% (0.3578 => 0.3842, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.36% (0.3940 => 0.4230, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 7.32% (0.2008 => 0.2155) SingleSource/UnitTests/ObjC/for-in: 7.31% (0.3789 => 0.4066, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/exceptions-4: 7.30% (0.3646 => 0.3912, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.28% (0.2321 => 0.2490, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 7.28% (6.5754 => 7.0540, std.dev.: 0.0147) SingleSource/UnitTests/ObjC/exceptions-2: 7.28% (0.3601 => 0.3863, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 7.25% (3.7467 => 4.0183, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/synchronized: 7.21% (0.3663 => 0.3927, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.19% (0.2504 => 0.2684, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.12% (0.3623 => 0.3881, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.10% (0.3650 => 0.3909, std.dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: 6.94% (1.2292 => 1.3145, std.dev.: 0.0078) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.60% (0.1819 => 0.1939, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.54% (6.2785 => 6.6894, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.45% (13.2842 => 14.1404, std.dev.: 0.0170) MultiSource/Applications/sqlite3/sqlite3: 5.41% (16.2614 => 17.1405, std.dev.: 0.0171) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.08% (0.2243 => 0.2357, std.dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: 4.39% (14.5298 => 15.1674, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: 2.02% (33.2944 => 33.9674, std.dev.: 0.0103) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5183, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 24.31% (1.8175 => 2.2593, std.dev.: 0.0502) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.08% (1.0895 => 1.2756, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 11.08% (1.1560 => 1.2841, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4146, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.43% (0.9692 => 1.0218) SingleSource/Benchmarks/Misc/mandel-2: 5.25% (1.2998 => 1.3681, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0049, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 4.48% (0.5449 => 0.5693, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.72% (11.2619 => 11.6807, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-6: 3.48% (1.9199 => 1.9868, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 3.38% (12.0921 => 12.5004, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bisort/bisort: 2.96% (0.8239 => 0.8483, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 2.84% (10.7476 => 11.0528, std.dev.: 0.0444) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.15% (7.4271 => 7.5866, std.dev.: 0.0072) MultiSource/Applications/lemon/lemon: 1.85% (1.4298 => 1.4562, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5144, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1884, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/oourafft: 1.17% (5.5130 => 5.5776, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 1.16% (12.4560 => 12.6006, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std.dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -47.12% (0.2670 => 0.1412, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.83% (0.4657 => 0.3920, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/mason/mason: -14.14% (0.0707 => 0.0607, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.40% (1.3819 => 1.1967, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.38% (1.3813 => 1.1965, std.dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.29% (1.0460 => 0.8547, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -12.87% (0.2238 => 0.1950, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.07% (20.3410 => 18.2917, std.dev.: 0.0147) SingleSource/Benchmarks/McGill/chomp: -6.26% (1.2308 => 1.1538, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2652, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0121) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.10% (1.3780 => 1.2940, std.dev.: 0.0084) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -5.10% (2.6470 => 2.5121, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.83% (0.9996 => 0.9513, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.83% (1.7688 => 1.7011, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -3.29% (3.2729 => 3.1653, std.dev.: 0.0026) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.27% (0.4867 => 0.4708, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: -2.91% (3.0263 => 2.9381, std.dev.: 0.0015) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8812, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.36% (1.9762 => 1.9296, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std.dev.: 0.0009) MultiSource/Applications/lua/lua: -1.98% (26.5159 => 25.9899, std.dev.: 0.0198) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.98% (0.8342 => 0.8177, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.90% (6.3560 => 6.2355, std.dev.: 0.0086) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.86% (0.6615 => 0.6492) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.66% (2.5254 => 2.4835, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0074, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2518, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/heapsort: -1.21% (3.9173 => 3.8699, std.dev.: 0.0067) MultiSource/Benchmarks/mafft/pairlocalalign: -1.19% (28.2225 => 27.8853, std.dev.: 0.0026) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1138, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -1.05% (84.4286 => 83.5421, std.dev.: 0.0076) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 18 08:02:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 18 Oct 2012 10:02:38 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121018150238.EFA9C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4964?compare_to=4962&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 4964, Order: 166178, Start Time: 2012-10-18 13:41:44, End Time: 2012-10-18 15:04:38 To: 4962, Order: 166176, Start Time: 2012-10-18 11:39:17, End Time: 2012-10-18 13:02:26 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 1 (1 on baseline) Performance Regressions: 21 (9 on baseline) Performance Improvements: 2 (3 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 951 (962 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -22.99% (2.1534 => 1.6584, std.dev.: 0.0039) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.16% (0.2893 => 0.3100, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.89% (0.3193 => 0.3349, std.dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.54% (0.3103 => 0.3244, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.16% (0.5864 => 0.6108, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.82% (0.5810 => 0.6032, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/05-eks/eks: 3.47% (0.4240 => 0.4387, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.92% (0.7833 => 0.8062, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.90% (0.9280 => 0.9549, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.84% (1.1417 => 1.1741, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.71% (0.7552 => 0.7757, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 2.50% (3.9971 => 4.0969, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.95% (0.5739 => 0.5851, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.91% (0.7966 => 0.8118, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.63% (1.2299 => 1.2499, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.27% (4.4076 => 4.4635, std.dev.: 0.0159) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.08% (1.5839 => 2.5038, std.dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.79% (13.9901 => 16.3385, std.dev.: 0.5954) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.45% (1.1851 => 1.2853, std.dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/fldry: 1.69% (0.6750 => 0.6864, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.53% (0.8612 => 0.8744, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.37% (4.5242 => 4.5861, std.dev.: 0.0164) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.44% (8.3218 => 8.1185, std.dev.: 0.0777) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.28% (0.3277 => 0.2973, std.dev.: 0.0023) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.37% (16.3805 => 16.3207, std.dev.: 0.1053) MultiSource/Applications/obsequi/Obsequi: 1.02% (1.0206 => 1.0310, std.dev.: 0.0171) MultiSource/Applications/sqlite3/sqlite3: 0.44% (0.6301 => 0.6329, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: 5.44% (0.1783 => 0.1880, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.84% (0.1622 => 0.1576, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.40% (0.3215 => 0.3202, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.89% (0.2469 => 0.2447, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.58% (0.3274 => 0.3293, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.78% (0.2322 => 0.2433, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/bigfib: 0.54% (0.5952 => 0.5984, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: 0.71% (0.0420 => 0.0423, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.55% (0.3287 => 0.3338, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 0.15% (0.1980 => 0.1983, std.dev.: 0.0009) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 42.04% (0.0157 => 0.0223, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 27.33% (0.0161 => 0.0205, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.73% (0.0413 => 0.0410, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.62% (0.0320 => 0.0318, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.66% (0.0302 => 0.0300, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.98% (0.0410 => 0.0406, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: -1.04% (0.0192 => 0.0190, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -1.83% (0.0164 => 0.0161, std.dev.: 0.0022) SingleSource/UnitTests/byval-alignment: 32.20% (0.0236 => 0.0312, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 116.67% (0.0006 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.69% (0.1446 => 0.1456, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -0.50% (1.1658 => 1.1600, std.dev.: 0.0328) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 9.54% (0.1373 => 0.1504, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.68% (0.4113 => 0.4044, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.18% (0.1378 => 0.1408, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 15.91% (0.0553 => 0.0641, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.83% (0.0212 => 0.0218, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.70% (0.0540 => 0.0560, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.85% (1.1434 => 1.1531, std.dev.: 0.0461) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 200.00% (0.0001 => 0.0003, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.14% (0.0555 => 0.0578, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.60% (0.0174 => 0.0182, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.05% (0.7940 => 0.8023, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: 600.00% (0.0001 => 0.0007) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -53.66% (0.0082 => 0.0038, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.04% (2.1832 => 1.6584, std.dev.: 0.0039) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.80% (0.7473 => 0.7757, std.dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.41% (0.3137 => 0.3244, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.40% (0.2998 => 0.3100, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.39% (0.8007 => 0.8118, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.21% (0.9435 => 0.9549, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.52% (1.5795 => 2.5038, std.dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.56% (14.6451 => 16.3385, std.dev.: 0.5954) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.40% (1.1857 => 1.2853, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.19% (0.3186 => 0.3447, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.56% (8.4179 => 8.1185, std.dev.: 0.0777) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.05% (0.3269 => 0.2973, std.dev.: 0.0023) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.73% (1.2822 => 1.2600, std.dev.: 0.0082) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.76% (16.4461 => 16.3207, std.dev.: 0.1053) MultiSource/Applications/obsequi/Obsequi: 0.47% (1.0262 => 1.0310, std.dev.: 0.0171) MultiSource/Applications/sqlite3/sqlite3: -0.05% (0.6332 => 0.6329, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: 2.68% (0.1831 => 0.1880, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.09% (0.1559 => 0.1576, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.53% (0.3123 => 0.3202, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.65% (0.2463 => 0.2447, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.53% (0.3344 => 0.3293, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.92% (0.2364 => 0.2433, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/bigfib: -0.43% (0.6010 => 0.5984, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: -1.40% (0.0429 => 0.0423, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.20% (0.3266 => 0.3338, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 0.71% (0.1969 => 0.1983, std.dev.: 0.0009) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.45% (0.0224 => 0.0223, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 66.67% (0.0123 => 0.0205, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.49% (0.0408 => 0.0410, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 25.20% (0.0254 => 0.0318, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.66% (0.0302 => 0.0300, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 5.73% (0.0384 => 0.0406, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0190 => 0.0190, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -10.56% (0.0180 => 0.0161, std.dev.: 0.0022) SingleSource/UnitTests/byval-alignment: 35.65% (0.0230 => 0.0312, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.25% (0.1438 => 0.1456, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 2.39% (1.1329 => 1.1600, std.dev.: 0.0328) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 2.87% (0.1462 => 0.1504, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.88% (0.4164 => 0.4044, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.85% (0.1369 => 0.1408, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: - (0.0641 => 0.0641, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 11.79% (0.0195 => 0.0218, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.11% (0.0578 => 0.0560, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.82% (1.1437 => 1.1531, std.dev.: 0.0461) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 200.00% (0.0001 => 0.0003, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.81% (0.0627 => 0.0578, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.11% (0.0180 => 0.0182, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.07% (0.8017 => 0.8023, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: 600.00% (0.0001 => 0.0007) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -38.71% (0.0062 => 0.0038, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 18 08:12:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 18 Oct 2012 10:12:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121018151243.DAD362A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4965?compare_to=4961&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4965, Order: 166178, Start Time: 2012-10-18 13:54:13, End Time: 2012-10-18 15:14:41 To: 4961, Order: 166176, Start Time: 2012-10-18 11:34:46, End Time: 2012-10-18 12:54:42 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (75 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 3 (183 on baseline) Performance Improvements: 0 (44 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 90 (15 on baseline) Unchanged Tests: 949 (659 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 16.45% (0.3995 => 0.4652, std.dev.: 0.0185) MultiSource/Benchmarks/PAQ8p/paq8p: 3.94% (14.8571 => 15.4422, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.01% (80.4188 => 81.2289, std.dev.: 0.1553) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.61% (0.6091 => 0.6128, std.dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 0.59% (17.1065 => 17.2076, std.dev.: 0.0074) MultiSource/Benchmarks/Bullet/bullet: 0.46% (55.8212 => 56.0791, std.dev.: 0.0181) MultiSource/Benchmarks/MallocBench/gs/gs: 0.37% (4.4968 => 4.5136, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0465 => 0.0465, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.21% (0.0467 => 0.0468) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.23% (0.0433 => 0.0434, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0436 => 0.0436, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.47% (0.0423 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.24% (0.0425 => 0.0426, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.24% (0.0416 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.24% (0.0418 => 0.0419, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.23% (0.0434 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.23% (0.0437 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.23% (0.0428 => 0.0429, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.23% (0.0430 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0420 => 0.0420, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.24% (0.0421 => 0.0422, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.23% (0.0426 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0428 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0437 => 0.0437, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.91% (0.0439 => 0.0443, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.24% (0.0414 => 0.0415, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0415 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.23% (0.0427 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.23% (0.0427 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0417 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0419 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.49% (0.0409 => 0.0411) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.24% (0.0411 => 0.0412) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0409 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0410 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0445 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.45% (0.0446 => 0.0448) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0408 => 0.0408) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0409 => 0.0409) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0410 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.24% (0.0411 => 0.0412) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.24% (0.0417 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0418 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.59% (1.2851 => 1.2927, std.dev.: 0.0066) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.64% (8.1752 => 8.2272, std.dev.: 0.0150) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.45% (0.7711 => 0.7746, std.dev.: 0.0039) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.83% (0.0360 => 0.0363, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1429 => 0.1430) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 0.06% (0.1657 => 0.1658) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.64% (0.2137 => 0.2172, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.33% (63.2438 => 56.0791, std.dev.: 0.0181) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 1.16% (0.1639 => 0.1658) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 35.62% (14.1553 => 19.1978, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.12% (3.4629 => 5.7871, std.dev.: 0.0037) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13415.42% (0.0720 => 9.7311, std.dev.: 0.0124) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9973800.00% (0.0001 => 9.9739, std.dev.: 0.0017) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 62.45% (0.2554 => 0.4149, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/lowercase: 52.34% (0.0256 => 0.0390, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 48.95% (10.3673 => 15.4422, std.dev.: 0.0036) SingleSource/UnitTests/SignlessTypes/factor: 42.23% (0.0296 => 0.0421, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 38.41% (0.1622 => 0.2245, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 36.55% (0.1056 => 0.1442, std.dev.: 0.0004) SingleSource/UnitTests/vla: 29.30% (0.0355 => 0.0459, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 24.46% (0.0834 => 0.1038, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.20% (7.0540 => 8.4084, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: 18.99% (0.1432 => 0.1704, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.58% (2.2022 => 2.6114, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.22% (0.0871 => 0.1021, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.18% (0.1566 => 0.1835, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.02% (0.6675 => 0.7811, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 16.98% (0.5105 => 0.5972, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 16.01% (3.3354 => 3.8693, std.dev.: 0.0055) SingleSource/Benchmarks/McGill/chomp: 15.71% (0.1655 => 0.1915, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.55% (1.3050 => 1.5079, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/oourafft: 15.27% (0.3282 => 0.3783, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 14.80% (0.2271 => 0.2607, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 14.79% (10.4361 => 11.9794, std.dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.76% (0.5020 => 0.5761, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.66% (0.0798 => 0.0915, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 14.62% (9.4845 => 10.8712, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.58% (1.7609 => 2.0177, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 14.55% (0.7115 => 0.8150, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.43% (1.5415 => 1.7640, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: 14.03% (0.1440 => 0.1642, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.85% (0.1625 => 0.1850, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.71% (0.1510 => 0.1717, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 13.44% (0.3109 => 0.3527, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 13.23% (0.3423 => 0.3876, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/matrix: 13.20% (0.0818 => 0.0926, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 13.19% (0.1584 => 0.1793, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 13.10% (0.1695 => 0.1917, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.89% (4.2646 => 4.8144, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.81% (0.4615 => 0.5206, std.dev.: 0.0017) MultiSource/Applications/viterbi/viterbi: 12.73% (0.1555 => 0.1753, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.70% (0.1236 => 0.1393, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 12.68% (0.1175 => 0.1324, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.64% (0.1337 => 0.1506, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.60% (0.1032 => 0.1162, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/exptree: 12.53% (0.0814 => 0.0916) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 12.42% (0.6450 => 0.7251, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 12.41% (5.7591 => 6.4738, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/mst/mst: 12.38% (0.1163 => 0.1307, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 12.38% (8.1363 => 9.1436, std.dev.: 0.0124) MultiSource/Applications/lemon/lemon: 12.37% (1.0722 => 1.2048, std.dev.: 0.0191) MultiSource/Benchmarks/nbench/nbench: 12.36% (1.1840 => 1.3303, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.33% (0.1695 => 0.1904, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 12.30% (0.1463 => 0.1643, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 12.11% (0.3387 => 0.3797, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 12.09% (1.1642 => 1.3049, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.06% (0.1940 => 0.2174, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.00% (0.0933 => 0.1045, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 11.96% (0.0886 => 0.0992, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 11.96% (2.0273 => 2.2697, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.93% (4.9449 => 5.5346, std.dev.: 0.0124) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.89% (0.1438 => 0.1609, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.89% (0.2700 => 0.3021, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 11.85% (0.7433 => 0.8314, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.85% (5.0018 => 5.5945, std.dev.: 0.0084) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.79% (7.9617 => 8.9005, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.79% (0.9765 => 1.0916, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.77% (0.5860 => 0.6550, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.73% (0.3307 => 0.3695, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.71% (0.3543 => 0.3958, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 11.69% (3.8723 => 4.3251, std.dev.: 0.0088) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.58% (0.2107 => 0.2351, std.dev.: 0.0014) SingleSource/UnitTests/SignlessTypes/rem: 11.54% (0.1144 => 0.1276, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.52% (0.0929 => 0.1036, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 11.47% (0.1151 => 0.1283, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.40% (0.3473 => 0.3869, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 11.37% (0.3561 => 0.3966, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.35% (0.1330 => 0.1481, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.32% (1.5859 => 1.7654, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.29% (0.4879 => 0.5430, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: 11.29% (0.3516 => 0.3913, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.29% (1.1861 => 1.3200, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 11.24% (0.7835 => 0.8716, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-4: 11.23% (0.3543 => 0.3941, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.21% (0.3497 => 0.3889, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.17% (0.3177 => 0.3532, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 11.13% (0.3828 => 0.4254, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.13% (0.3694 => 0.4105, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 11.12% (0.8921 => 0.9913, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.09% (0.3121 => 0.3467, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/parameter-passing: 11.00% (0.3927 => 0.4359, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.93% (0.8067 => 0.8949, std.dev.: 0.0032) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.93% (0.1125 => 0.1248, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/property: 10.91% (0.3886 => 0.4310, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.83% (0.1117 => 0.1238, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.81% (0.1906 => 0.2112, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.80% (0.2758 => 0.3056, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.80% (2.2024 => 2.4402, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.79% (0.1029 => 0.1140, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 10.77% (0.4299 => 0.4762, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/bigfib: 10.75% (0.6456 => 0.7150, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.50% (0.2266 => 0.2504, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.48% (1.4186 => 1.5672, std.dev.: 0.0119) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.46% (0.8172 => 0.9027, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.41% (0.5569 => 0.6149, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.36% (0.1062 => 0.1172, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 10.29% (21.9371 => 24.1940, std.dev.: 0.0315) SingleSource/Benchmarks/Misc/ReedSolomon: 10.10% (0.2049 => 0.2256, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.07% (0.2603 => 0.2865, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 9.93% (1.5603 => 1.7153, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash2: 9.87% (0.4620 => 0.5076, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 9.85% (2.2969 => 2.5232, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 9.77% (0.1044 => 0.1146, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.70% (0.3826 => 0.4197, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 9.69% (0.3180 => 0.3488, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.65% (0.3441 => 0.3773, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.64% (0.2065 => 0.2264, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 9.58% (0.4289 => 0.4700, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/health/health: 9.46% (0.1268 => 0.1388, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.40% (0.4636 => 0.5072, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 9.23% (0.3422 => 0.3738, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.07% (0.4103 => 0.4475, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.02% (0.6030 => 0.6574, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.93% (0.3865 => 0.4210, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.90% (0.4203 => 0.4577, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.86% (0.5925 => 0.6450, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.68% (0.5981 => 0.6500, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/lists1: 8.58% (0.3684 => 0.4000, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.56% (0.1892 => 0.2054, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 8.52% (0.4048 => 0.4393, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.19% (0.7326 => 0.7926, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.17% (0.3427 => 0.3707, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 8.01% (17.1811 => 18.5579, std.dev.: 0.0181) SingleSource/Benchmarks/Shootout-C++/sieve: 7.83% (0.3603 => 0.3885, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.69% (14.3668 => 15.4718, std.dev.: 0.0164) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.58% (0.4064 => 0.4372, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.43% (0.3136 => 0.3369, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.37% (0.3650 => 0.3919, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.32% (0.8101 => 0.8694, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.26% (3.8922 => 4.1746, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 7.24% (0.3092 => 0.3316, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 7.17% (0.3098 => 0.3320, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.95% (0.2905 => 0.3107, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.89% (0.3162 => 0.3380, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 6.88% (0.3283 => 0.3509, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.85% (0.2831 => 0.3025, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.78% (0.2891 => 0.3087, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.78% (0.3232 => 0.3451, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.65% (2.0665 => 2.2040, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.62% (0.2872 => 0.3062, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.33% (0.2877 => 0.3059, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 6.30% (0.2871 => 0.3052, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.30% (0.2793 => 0.2969, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.24% (0.2756 => 0.2928, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 6.24% (0.2725 => 0.2895, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 6.21% (0.3379 => 0.3589, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 6.13% (0.3052 => 0.3239, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.04% (0.2714 => 0.2878, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.96% (0.2802 => 0.2969, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 5.79% (1.2842 => 1.3586, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.68% (0.2430 => 0.2568, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.24% (0.3131 => 0.3295, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.59% (0.3817 => 0.3954, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.22% (1.1194 => 1.1554, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.77% (0.3935 => 0.4044, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.55% (1.1145 => 1.2990, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.62% (0.2944 => 0.3286, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.78% (1.1396 => 1.2511, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 9.68% (0.9957 => 1.0921, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3685, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/bh/bh: 5.59% (1.9405 => 2.0490, std.dev.: 0.0034) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.65% (0.3463 => 0.3624, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.77% (4.2280 => 4.3453, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7652, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.92% (3.6395 => 3.7095, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/bisort/bisort: 1.92% (0.8333 => 0.8493, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2077, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.46% (2.6546 => 2.6933, std.dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 1.13% (11.6436 => 11.7750, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.99% (6.6874 => 0.1341, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -79.90% (0.8651 => 0.1739, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.89% (5.2763 => 3.2771, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.99% (5.3855 => 3.7166, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.51% (5.3526 => 3.7195, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -14.59% (54.1659 => 46.2628, std.dev.: 0.0318) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.35% (2.9384 => 2.6344, std.dev.: 0.0024) MultiSource/Applications/ClamAV/clamscan: -7.13% (22.1758 => 20.5942, std.dev.: 0.0259) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.07% (8.0499 => 3.7778, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7645, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: -16.15% (1.6925 => 1.4191, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.53% (1.2373 => 1.0946, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3453 => 2.9600, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -11.17% (1.5373 => 1.3656, std.dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.21% (19.9488 => 18.3103, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/mason/mason: -7.87% (0.2161 => 0.1991, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.10% (1.8329 => 1.7028, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.57% (1.6805 => 1.5869, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5081, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.55% (8.1563 => 7.7855, std.dev.: 0.0118) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.39% (3.2827 => 3.1715, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8775, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4955, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.04% (0.4808 => 0.4662, std.dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0856, std.dev.: 0.0062) MultiSource/Applications/sqlite3/sqlite3: -1.74% (4.6441 => 4.5635, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6806, std.dev.: 0.0018) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5094, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4219, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2878, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2347, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8590, std.dev.: 0.0166) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 17.19% (0.5229 => 0.6128, std.dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 14.80% (14.9895 => 17.2076, std.dev.: 0.0074) MultiSource/Benchmarks/MallocBench/gs/gs: 9.81% (4.1105 => 4.5136, std.dev.: 0.0185) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.01% (1.1048 => 1.2927, std.dev.: 0.0066) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.93% (7.1582 => 8.2272, std.dev.: 0.0150) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.49% (0.6222 => 0.7746, std.dev.: 0.0039) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36200.00% (0.0001 => 0.0363, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -3.70% (0.1485 => 0.1430) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.65% (0.2116 => 0.2172, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 18 08:18:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 18 Oct 2012 10:18:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121018151815.5F4512A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4966?compare_to=4963&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4966, Order: 166178, Start Time: 2012-10-18 13:55:20, End Time: 2012-10-18 15:21:12 To: 4963, Order: 166176, Start Time: 2012-10-18 11:53:12, End Time: 2012-10-18 13:18:52 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (191 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1039 (675 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.42% (78.8454 => 80.7569, std.dev.: 0.4169) SingleSource/Benchmarks/Misc/fbench: 2.06% (2.2593 => 2.3059, std.dev.: 0.0175) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.16% (1.2940 => 1.3090, std.dev.: 0.0017) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.31% (2.0176 => 2.5080, std.dev.: 0.0058) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.72% (0.1410 => 0.1674, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 17.68% (0.0826 => 0.0972, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 16.54% (0.2243 => 0.2614, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 14.31% (0.1013 => 0.1158, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.03% (0.0834 => 0.0951, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.66% (0.1413 => 0.1606, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.48% (0.1588 => 0.1802, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash2: 13.38% (0.4328 => 0.4907, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 13.10% (1.3693 => 1.5487, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.05% (0.6283 => 0.7103, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.03% (3.9660 => 4.4828, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.86% (0.2721 => 0.3071, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 12.84% (0.7038 => 0.7942, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.76% (0.0964 => 0.1087, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 12.75% (0.4062 => 0.4580, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.74% (0.1327 => 0.1496) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.70% (0.0819 => 0.0923, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.61% (1.4563 => 1.6399, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.52% (0.2596 => 0.2921, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 12.43% (13.8202 => 15.5376, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.39% (0.9199 => 1.0339, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/distray/distray: 12.35% (0.0818 => 0.0919, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.28% (0.7710 => 0.8657, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.19% (0.5265 => 0.5907, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.17% (1.2193 => 1.3677, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.16% (1.1364 => 1.2746, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 12.08% (0.5818 => 0.6521, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.98% (0.6959 => 0.7793, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 11.97% (0.7061 => 0.7906, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 11.83% (0.2781 => 0.3110, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.79% (0.4791 => 0.5356, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.71% (0.3485 => 0.3893, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 11.60% (0.5748 => 0.6415, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 11.58% (0.1062 => 0.1185, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 11.47% (1.0313 => 1.1496, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.45% (0.4016 => 0.4476, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.44% (0.3899 => 0.4345, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.44% (0.3130 => 0.3488, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.42% (0.5577 => 0.6214, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.37% (0.3756 => 0.4183, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 11.37% (0.1003 => 0.1117, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.36% (0.2782 => 0.3098, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.34% (0.4390 => 0.4888, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 11.33% (0.3293 => 0.3666, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 11.22% (0.3868 => 0.4302, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.21% (0.4379 => 0.4870, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 11.21% (0.1276 => 0.1419, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.15% (0.3022 => 0.3359, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 11.12% (0.3453 => 0.3837, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 11.09% (0.3489 => 0.3876, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 11.05% (0.2995 => 0.3326, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.95% (1.9828 => 2.2000, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 10.93% (0.2726 => 0.3024, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 10.92% (1.1061 => 1.2269, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 10.91% (0.6744 => 0.7480, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.88% (0.8698 => 0.9644, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 10.85% (0.3107 => 0.3444, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 10.83% (0.3149 => 0.3490, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.80% (0.1157 => 0.1282, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.79% (0.1075 => 0.1191, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 10.76% (0.1589 => 0.1760, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 10.76% (0.2760 => 0.3057, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.76% (0.2966 => 0.3285, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 10.75% (0.3534 => 0.3914, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/mst/mst: 10.71% (0.1111 => 0.1230, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 10.69% (0.1478 => 0.1636, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.67% (0.3580 => 0.3962, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 10.67% (0.2690 => 0.2977, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.66% (0.2655 => 0.2938, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.66% (0.0976 => 0.1080, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.64% (0.1569 => 0.1736, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.63% (0.2127 => 0.2353, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 10.63% (0.2607 => 0.2884, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 10.62% (0.2628 => 0.2907, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.60% (0.2765 => 0.3058, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 10.59% (0.2937 => 0.3248, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 10.58% (0.2761 => 0.3053, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 10.56% (16.6129 => 18.3668, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.54% (0.3246 => 0.3588, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 10.53% (0.3192 => 0.3528, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 10.48% (3.1889 => 3.5230, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.44% (0.0977 => 0.1079, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.43% (0.7460 => 0.8238, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 10.37% (0.3220 => 0.3554, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.36% (0.2914 => 0.3216, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.35% (0.1072 => 0.1183, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 10.33% (1.9270 => 2.1261, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 10.29% (0.8310 => 0.9165, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.25% (0.5637 => 0.6215, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.22% (0.1986 => 0.2189, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.18% (0.2023 => 0.2229, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 10.18% (0.7506 => 0.8270, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 10.17% (0.2988 => 0.3292, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 10.15% (3.8646 => 4.2568, std.dev.: 0.0092) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.10% (0.1435 => 0.1580, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.09% (0.2696 => 0.2968, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.06% (0.1014 => 0.1116, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.98% (7.2180 => 7.9381, std.dev.: 0.0019) MultiSource/Applications/siod/siod: 9.96% (2.1791 => 2.3961, std.dev.: 0.0167) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.95% (4.9865 => 5.4825, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.92% (0.8818 => 0.9693, std.dev.: 0.0072) MultiSource/Benchmarks/nbench/nbench: 9.85% (1.0594 => 1.1638, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.80% (0.3755 => 0.4123, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.76% (0.1865 => 0.2047, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/objinst: 9.71% (0.2945 => 0.3231, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 9.59% (14.8535 => 16.2780, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.58% (0.6576 => 0.7206, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 9.50% (0.2925 => 0.3203, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 9.48% (1.2749 => 1.3958, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.40% (3.6692 => 4.0141, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.37% (4.3801 => 4.7903, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.35% (4.4433 => 4.8586, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.34% (1.3245 => 1.4482, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 9.29% (0.1657 => 0.1811, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 9.29% (4.6629 => 5.0960, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: 9.18% (0.6250 => 0.6824, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 9.03% (8.4961 => 9.2633, std.dev.: 0.0103) MultiSource/Benchmarks/sim/sim: 8.97% (0.3131 => 0.3412, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.92% (0.6135 => 0.6682, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.83% (0.2140 => 0.2329, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.83% (0.1789 => 0.1947, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 8.75% (0.4113 => 0.4473, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.73% (1.5188 => 1.6514, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 8.62% (0.4003 => 0.4348, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.60% (3.2742 => 3.5557, std.dev.: 0.0134) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.59% (0.9108 => 0.9890, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 8.56% (0.3914 => 0.4249, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/oourafft: 8.52% (0.2008 => 0.2179, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 8.44% (0.3578 => 0.3880, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.39% (0.3646 => 0.3952, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.39% (0.3601 => 0.3903, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.35% (0.3940 => 0.4269, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.34% (0.3789 => 0.4105, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.32% (0.4805 => 0.5205, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.32% (0.3511 => 0.3803, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 8.27% (0.3663 => 0.3966, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 8.23% (0.1385 => 0.1499, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.23% (0.3245 => 0.3512, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 8.17% (0.3623 => 0.3919, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.16% (0.3650 => 0.3948, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.14% (1.1333 => 1.2256, std.dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 8.00% (6.5754 => 7.1012, std.dev.: 0.0171) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.90% (2.1007 => 2.2666, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.81% (0.1819 => 0.1961, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.79% (0.2504 => 0.2699, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 7.75% (1.2292 => 1.3245, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 7.59% (3.7467 => 4.0312, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.54% (0.2321 => 0.2496, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.36% (6.2785 => 6.7405, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.05% (13.2842 => 14.2212, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: 6.19% (0.1777 => 0.1887, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 5.76% (16.2614 => 17.1983, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.35% (0.2243 => 0.2363, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 4.91% (14.5298 => 15.2434, std.dev.: 0.0111) MultiSource/Benchmarks/Bullet/bullet: 2.67% (33.2944 => 34.1836, std.dev.: 0.0147) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.63% (5.7573 => 7.5210, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: 26.87% (1.8175 => 2.3059, std.dev.: 0.0175) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.05% (1.0895 => 1.2753, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 11.08% (1.1560 => 1.2841, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4146, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 5.55% (1.2998 => 1.3720, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.43% (0.9692 => 1.0218, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0003, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.80% (0.3458 => 0.3624, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0050, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 4.48% (0.5449 => 0.5693, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.72% (11.2619 => 11.6808, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 3.47% (1.9199 => 1.9865, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 3.39% (12.0921 => 12.5021, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bisort/bisort: 2.99% (0.8239 => 0.8485, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 2.82% (10.7476 => 11.0507, std.dev.: 0.0423) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.10% (7.4271 => 7.5834, std.dev.: 0.0029) MultiSource/Applications/lemon/lemon: 1.74% (1.4298 => 1.4547, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5135, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.40% (1.9433 => 1.9706, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1879, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.21% (5.5130 => 5.5797, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists: 1.09% (12.4560 => 12.5923, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.93% (0.2670 => 0.1417, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -14.92% (0.4657 => 0.3962, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.71% (1.3819 => 1.2063, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.66% (1.3813 => 1.2064, std.dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.29% (1.0460 => 0.8547, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/mason/mason: -12.91% (0.2238 => 0.1949, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.07% (20.3410 => 18.2936, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -5.65% (1.2308 => 1.1612, std.dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.10% (2.6470 => 2.5121, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.01% (1.3780 => 1.3090, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.51% (0.9996 => 0.9545, std.dev.: 0.0073) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.85% (1.7688 => 1.7007, std.dev.: 0.0012) MultiSource/Applications/siod/siod: -3.27% (3.2729 => 3.1659, std.dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.92% (0.4867 => 0.4725, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.85% (3.0263 => 2.9401, std.dev.: 0.0021) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8813, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4785, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Olden/bh/bh: -2.30% (1.9762 => 1.9307, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.98% (0.8342 => 0.8177, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -1.97% (26.5159 => 25.9933, std.dev.: 0.0272) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.96% (0.6589 => 0.6460, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.86% (0.6615 => 0.6492, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: -1.75% (6.3560 => 6.2448, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.60% (2.5254 => 2.4851, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0082, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8642, std.dev.: 0.0050) MultiSource/Applications/lambda-0_1_3/lambda: -1.26% (5.3167 => 5.2496, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: -1.19% (28.2225 => 27.8855, std.dev.: 0.0020) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1139, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -1.04% (84.4286 => 83.5492, std.dev.: 0.0062) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 18 09:42:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 18 Oct 2012 11:42:35 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121018164235.6DAB82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4967?compare_to=4964&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 4967, Order: 166179, Start Time: 2012-10-18 15:21:12, End Time: 2012-10-18 16:44:34 To: 4964, Order: 166178, Start Time: 2012-10-18 13:41:44, End Time: 2012-10-18 15:04:38 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 7 (7 on baseline) Performance Improvements: 4 (5 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 964 (962 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/ffbench: 3.15% (1.3922 => 1.4360, std.dev.: 0.0101) MultiSource/Benchmarks/Olden/em3d/em3d: 3.07% (5.2983 => 5.4612, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 2.96% (0.7672 => 0.7899, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/life/life: 2.60% (2.5682 => 2.6351, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.36% (21.7256 => 22.2382, std.dev.: 0.1199) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.24% (4.4013 => 4.4558, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/methcall: 1.23% (8.9569 => 9.0670, std.dev.: 0.0121) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -3.61% (0.3244 => 0.3127, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/05-eks/eks: -2.64% (0.4387 => 0.4271, std.dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.26% (16.3385 => 14.9889, std.dev.: 0.5121) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -2.24% (0.6068 => 0.5932, std.dev.: 0.0043) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.92% (16.3207 => 16.4701, std.dev.: 0.1472) MultiSource/Applications/obsequi/Obsequi: -0.58% (1.0310 => 1.0250, std.dev.: 0.0062) MultiSource/Applications/sqlite3/sqlite3: - (0.6329 => 0.6329, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/08-main/main: -8.94% (0.1880 => 0.1712, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.24% (0.1576 => 0.1627, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.37% (0.3202 => 0.3214, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.53% (0.2447 => 0.2460, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.33% (0.3293 => 0.3304, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.10% (0.2433 => 0.2382, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/bigfib: -0.90% (0.5984 => 0.5930, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/mandel: -4.02% (0.0423 => 0.0406, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: -1.89% (0.3338 => 0.3275, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: -0.81% (0.1983 => 0.1967, std.dev.: 0.0110) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -15.70% (0.0223 => 0.0188, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.46% (0.0205 => 0.0208, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.24% (0.0410 => 0.0411, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -24.53% (0.0318 => 0.0240, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.67% (0.0300 => 0.0289, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.74% (0.0406 => 0.0409, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0190 => 0.0190, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -11.80% (0.0161 => 0.0142, std.dev.: 0.0029) SingleSource/UnitTests/byval-alignment: 0.96% (0.0312 => 0.0315, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.55% (0.1456 => 0.1448, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -5.04% (1.1600 => 1.1015, std.dev.: 0.0531) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -2.59% (0.1504 => 0.1465, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.32% (0.4044 => 0.4031, std.dev.: 0.0559) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.28% (0.1408 => 0.1404, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -11.08% (0.0641 => 0.0570, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -14.22% (0.0218 => 0.0187, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.86% (0.0560 => 0.0544, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.00% (1.1531 => 1.1416, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 366.67% (0.0003 => 0.0014, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.73% (0.0578 => 0.0588, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.08% (0.0182 => 0.0224, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.31% (0.8023 => 0.8048, std.dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: -42.86% (0.0007 => 0.0004, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -2.63% (0.0038 => 0.0037, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.18% (2.1832 => 1.6554, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 59.14% (1.5795 => 2.5136, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.95% (1.1857 => 1.2918, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.22% (0.3186 => 0.3448, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.98% (0.7597 => 0.7899, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.31% (4.3552 => 4.4558, std.dev.: 0.0129) SingleSource/Benchmarks/Misc/richards_benchmark: 1.34% (1.3037 => 1.3212, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/methcall: 1.01% (8.9760 => 9.0670, std.dev.: 0.0121) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/05-eks/eks: -2.87% (0.4397 => 0.4271, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.57% (4.5702 => 4.4986, std.dev.: 0.0264) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.01% (1.2526 => 1.2399, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.38% (0.3269 => 0.2995, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -7.27% (0.1430 => 0.1326, std.dev.: 0.0039) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.15% (16.4461 => 16.4701, std.dev.: 0.1472) MultiSource/Applications/obsequi/Obsequi: -0.12% (1.0262 => 1.0250, std.dev.: 0.0062) MultiSource/Applications/sqlite3/sqlite3: -0.05% (0.6332 => 0.6329, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/08-main/main: -6.50% (0.1831 => 0.1712, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.36% (0.1559 => 0.1627, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.91% (0.3123 => 0.3214, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.12% (0.2463 => 0.2460, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.20% (0.3344 => 0.3304, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.76% (0.2364 => 0.2382, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/bigfib: -1.33% (0.6010 => 0.5930, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/mandel: -5.36% (0.0429 => 0.0406, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.28% (0.3266 => 0.3275, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: -0.10% (0.1969 => 0.1967, std.dev.: 0.0110) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -16.07% (0.0224 => 0.0188, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 69.11% (0.0123 => 0.0208, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.74% (0.0408 => 0.0411, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -5.51% (0.0254 => 0.0240, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -4.30% (0.0302 => 0.0289, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 6.51% (0.0384 => 0.0409, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0190 => 0.0190, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -21.11% (0.0180 => 0.0142, std.dev.: 0.0029) SingleSource/UnitTests/byval-alignment: 36.96% (0.0230 => 0.0315, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.70% (0.1438 => 0.1448, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -2.77% (1.1329 => 1.1015, std.dev.: 0.0531) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.21% (0.1462 => 0.1465, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.19% (0.4164 => 0.4031, std.dev.: 0.0559) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.56% (0.1369 => 0.1404, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -11.08% (0.0641 => 0.0570, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.10% (0.0195 => 0.0187, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.88% (0.0578 => 0.0544, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.18% (1.1437 => 1.1416, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1300.00% (0.0001 => 0.0014, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.22% (0.0627 => 0.0588, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.44% (0.0180 => 0.0224, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.39% (0.8017 => 0.8048, std.dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: 300.00% (0.0001 => 0.0004, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -40.32% (0.0062 => 0.0037, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 18 10:02:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 18 Oct 2012 12:02:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121018170219.ACB762A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4968?compare_to=4965&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4968, Order: 166179, Start Time: 2012-10-18 15:44:12, End Time: 2012-10-18 17:04:17 To: 4965, Order: 166178, Start Time: 2012-10-18 13:54:13, End Time: 2012-10-18 15:14:41 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (75 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (182 on baseline) Performance Improvements: 2 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 90 (15 on baseline) Unchanged Tests: 949 (661 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.23% (1.0921 => 1.1055, std.dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.86% (81.2289 => 78.0946, std.dev.: 0.4022) MultiSource/Benchmarks/llubenchmark/llu: -1.92% (3.8221 => 3.7487, std.dev.: 0.0083) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.02% (0.6128 => 0.6127, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -0.02% (17.2076 => 17.2045, std.dev.: 0.0086) MultiSource/Benchmarks/Bullet/bullet: -0.01% (56.0791 => 56.0742, std.dev.: 0.0121) MultiSource/Benchmarks/MallocBench/gs/gs: -0.08% (4.5136 => 4.5102, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0465 => 0.0465, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.21% (0.0468 => 0.0467, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0434 => 0.0434, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0436 => 0.0436, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0425 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.23% (0.0426 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.24% (0.0417 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.24% (0.0419 => 0.0418, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0435 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0436 => 0.0436, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0429 => 0.0429, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0431 => 0.0431, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.24% (0.0420 => 0.0421, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.24% (0.0422 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.23% (0.0427 => 0.0426, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0428 => 0.0428, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.23% (0.0437 => 0.0438, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.45% (0.0443 => 0.0441, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.24% (0.0415 => 0.0414, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0415 => 0.0415, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.23% (0.0426 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0428 => 0.0428, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0417 => 0.0417, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.24% (0.0419 => 0.0420, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.24% (0.0411 => 0.0410, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.49% (0.0412 => 0.0410, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.24% (0.0409 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0410 => 0.0410, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0445 => 0.0445, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.22% (0.0448 => 0.0447, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.25% (0.0408 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.24% (0.0409 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0410 => 0.0410, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.24% (0.0412 => 0.0411, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.24% (0.0416 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.24% (0.0418 => 0.0417, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.22% (1.2927 => 1.2899, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.03% (8.2272 => 8.2247, std.dev.: 0.0158) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.13% (0.7746 => 0.7736, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -1.10% (0.0363 => 0.0359, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: - (0.1430 => 0.1430) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: - (0.1658 => 0.1658) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.61% (0.2172 => 0.2137, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.34% (63.2438 => 56.0742, std.dev.: 0.0121) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 1.16% (0.1639 => 0.1658) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 35.87% (14.1553 => 19.2323, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.38% (3.4629 => 5.7963, std.dev.: 0.0014) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13412.50% (0.0720 => 9.7290, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9974200.00% (0.0001 => 9.9743, std.dev.: 0.0011) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 62.57% (0.2554 => 0.4152, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/lowercase: 52.34% (0.0256 => 0.0390, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 49.00% (10.3673 => 15.4477, std.dev.: 0.0070) SingleSource/UnitTests/SignlessTypes/factor: 42.23% (0.0296 => 0.0421, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 38.47% (0.1622 => 0.2246, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 36.55% (0.1056 => 0.1442, std.dev.: 0.0002) SingleSource/UnitTests/vla: 29.30% (0.0355 => 0.0459, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 22.18% (0.0834 => 0.1019, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.17% (7.0540 => 8.4065, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/flops: 18.99% (0.1432 => 0.1704, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.61% (2.2022 => 2.6120, std.dev.: 0.0027) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.24% (0.1566 => 0.1836) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.22% (0.0871 => 0.1021, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.12% (0.5105 => 0.5979, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 16.97% (0.6675 => 0.7808, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 16.01% (3.3354 => 3.8694, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 15.89% (0.1655 => 0.1918, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.58% (1.3050 => 1.5083, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 15.27% (0.3282 => 0.3783, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 14.86% (10.4361 => 11.9872, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.86% (0.5020 => 0.5766, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 14.80% (0.2271 => 0.2607, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 14.63% (0.7115 => 0.8156, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 14.45% (9.4845 => 10.8548, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.43% (1.7609 => 2.0150, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: 14.10% (0.1440 => 0.1643, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.07% (1.5415 => 1.7584, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.64% (0.1510 => 0.1716, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 13.38% (0.3109 => 0.3525, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 13.27% (0.1695 => 0.1920, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/18-imp/imp: 13.15% (0.3423 => 0.3873, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/matrix: 13.08% (0.0818 => 0.0925, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 13.07% (0.1584 => 0.1791, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.02% (0.1029 => 0.1163, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.88% (4.2646 => 4.8140, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.87% (0.4615 => 0.5209, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/exptree: 12.65% (0.0814 => 0.0917, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.62% (0.1236 => 0.1392, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 12.60% (0.1175 => 0.1323, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.49% (0.1337 => 0.1504, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 12.47% (8.1363 => 9.1507, std.dev.: 0.0081) MultiSource/Applications/viterbi/viterbi: 12.41% (0.1555 => 0.1748, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.40% (0.1032 => 0.1160, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 12.38% (0.1163 => 0.1307, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.35% (0.5860 => 0.6584, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 12.33% (5.7591 => 6.4692, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.33% (0.0933 => 0.1048, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 12.30% (0.1463 => 0.1643, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 12.30% (1.0722 => 1.2041, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 12.29% (0.6450 => 0.7243, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.25% (0.1625 => 0.1824, std.dev.: 0.0015) MultiSource/Benchmarks/sim/sim: 12.22% (0.3387 => 0.3801, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 12.22% (0.7433 => 0.8341, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.21% (0.1695 => 0.1902, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 12.19% (0.0886 => 0.0994, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 12.15% (1.1840 => 1.3279, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 12.14% (2.0273 => 2.2735, std.dev.: 0.0083) MultiSource/Applications/Burg/burg: 12.07% (1.1642 => 1.3047, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.06% (0.1940 => 0.2174, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.04% (0.2700 => 0.3025, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.04% (0.3307 => 0.3705, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.90% (7.9617 => 8.9095, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.87% (4.9449 => 5.5318, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.80% (0.3543 => 0.3961, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.78% (5.0018 => 5.5912, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.77% (0.9765 => 1.0914, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.75% (0.1438 => 0.1607, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 11.70% (3.8723 => 4.3255, std.dev.: 0.0156) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.63% (0.2107 => 0.2352, std.dev.: 0.0028) SingleSource/UnitTests/SignlessTypes/rem: 11.54% (0.1144 => 0.1276, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.52% (0.0929 => 0.1036, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 11.47% (0.1151 => 0.1283, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.37% (0.3473 => 0.3868, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.37% (0.8067 => 0.8984, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 11.35% (0.3516 => 0.3915, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.35% (0.3561 => 0.3965, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.32% (1.1861 => 1.3204, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 11.32% (0.3543 => 0.3944, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 11.31% (0.7835 => 0.8721, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.31% (1.5859 => 1.7652, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.25% (0.4879 => 0.5428, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/for-in: 11.21% (0.3694 => 0.4108, std.dev.: 0.0064) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.20% (0.1330 => 0.1479, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 11.18% (0.3497 => 0.3888, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.13% (0.3828 => 0.4254, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 11.07% (0.8921 => 0.9909, std.dev.: 0.0071) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.02% (0.1125 => 0.1249, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.99% (0.3121 => 0.3464, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 10.98% (0.3927 => 0.4358, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.92% (0.3177 => 0.3524, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.91% (0.1906 => 0.2114, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 10.90% (0.6456 => 0.7160, std.dev.: 0.0127) MultiSource/Benchmarks/McCat/05-eks/eks: 10.84% (0.4299 => 0.4765, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.83% (0.1117 => 0.1238, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.81% (0.8172 => 0.9055, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.78% (0.3886 => 0.4305, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.73% (0.2758 => 0.3054, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.67% (2.2024 => 2.4374, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.64% (1.4186 => 1.5696, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.64% (0.2266 => 0.2507, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.56% (0.5569 => 0.6157, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 10.40% (0.2049 => 0.2262, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.36% (0.1062 => 0.1172, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 10.26% (21.9371 => 24.1873, std.dev.: 0.0193) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.10% (0.2603 => 0.2866, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 9.96% (1.5603 => 1.7157, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 9.92% (2.2969 => 2.5247, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 9.87% (0.4620 => 0.5076, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 9.78% (0.3180 => 0.3491, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: 9.78% (0.1268 => 0.1392, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.73% (0.2065 => 0.2266, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 9.54% (0.4289 => 0.4698, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.53% (0.3441 => 0.3769, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.30% (0.4636 => 0.5067, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.17% (0.3826 => 0.4177, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 9.10% (0.6030 => 0.6579, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.00% (0.3865 => 0.4213, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.99% (0.4203 => 0.4581, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/lists: 8.94% (0.3422 => 0.3728, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 8.89% (0.5925 => 0.6452, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.83% (0.5981 => 0.6509, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.77% (0.4103 => 0.4463, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: 8.70% (0.4048 => 0.4400, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.46% (0.1892 => 0.2052, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 8.41% (0.3684 => 0.3994, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.23% (0.7326 => 0.7929, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.17% (0.3427 => 0.3707, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 8.01% (17.1811 => 18.5575, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/sieve: 7.85% (0.3603 => 0.3886, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.56% (14.3668 => 15.4528, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.51% (0.3650 => 0.3924, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.48% (0.4064 => 0.4368, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 7.41% (0.3092 => 0.3321, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.39% (0.8101 => 0.8700, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.21% (3.8922 => 4.1727, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.18% (0.3162 => 0.3389, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 7.10% (0.3098 => 0.3318, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.08% (0.3136 => 0.3358, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/strcat: 6.89% (0.2831 => 0.3026, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 6.85% (0.3283 => 0.3508, std.dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 6.85% (0.2905 => 0.3104, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.85% (0.2891 => 0.3089, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.84% (0.3232 => 0.3453, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.73% (2.0665 => 2.2056, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/except: 6.55% (0.2871 => 0.3059, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.51% (0.3379 => 0.3599, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.48% (0.2872 => 0.3058, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.47% (0.2877 => 0.3063, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.35% (0.2756 => 0.2931, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.27% (0.2793 => 0.2968, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.24% (0.2725 => 0.2895, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.16% (0.3052 => 0.3240, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.01% (0.2430 => 0.2576, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.00% (0.2802 => 0.2970, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 5.97% (0.2714 => 0.2876, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 5.89% (1.2842 => 1.3598, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.33% (0.3131 => 0.3298, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.62% (0.3817 => 0.3955, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.12% (1.1194 => 1.1543, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.77% (0.3935 => 0.4044, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.57% (1.1145 => 1.2992, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 11.03% (0.9957 => 1.1055, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.76% (1.1396 => 1.2508, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3680, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 5.56% (1.9405 => 2.0484, std.dev.: 0.0005) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.80% (4.2280 => 4.3464, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.34% (1.7254 => 1.7657, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.01% (3.6395 => 3.7126, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bisort/bisort: 1.76% (0.8333 => 0.8480, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.56% (2.6546 => 2.6959, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 1.50% (3.1595 => 3.2070, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 1.14% (11.6436 => 11.7758, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.09% (6.5088 => 6.5799, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.03% (6.6874 => 0.1317, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -79.90% (0.8651 => 0.1739, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.91% (5.2763 => 3.2758, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.00% (5.3855 => 3.7158, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.51% (5.3526 => 3.7194, std.dev.: 0.0061) SingleSource/UnitTests/Vector/constpool: -14.57% (54.1659 => 46.2728, std.dev.: 0.0224) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.28% (2.9384 => 2.6363, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -7.08% (22.1758 => 20.6062, std.dev.: 0.0079) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.10% (8.0499 => 3.7753, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: -15.87% (1.6925 => 1.4239, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852) SingleSource/Benchmarks/McGill/chomp: -12.46% (1.2373 => 1.0831, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3453 => 2.9599, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -10.58% (1.5373 => 1.3746, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.40% (19.9488 => 18.2737, std.dev.: 0.0202) MultiSource/Benchmarks/FreeBench/mason/mason: -7.68% (0.2161 => 0.1995, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.10% (1.8329 => 1.7027, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4781, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.59% (1.6805 => 1.5866, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5072, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.58% (8.1563 => 7.7829, std.dev.: 0.0105) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.73% (1.3677 => 1.3167, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8776, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.38% (3.2827 => 3.1718, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5021, std.dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.58% (0.4808 => 0.4684, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.82% (10.2830 => 10.0963, std.dev.: 0.0126) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6811, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: -1.72% (4.6441 => 4.5643, std.dev.: 0.0014) SingleSource/UnitTests/Vector/multiplies: -1.67% (2.5528 => 2.5102, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -1.64% (1.1277 => 1.1092) MultiSource/Benchmarks/NPB-serial/is/is: -1.51% (9.5636 => 9.4194, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/lists: -1.29% (6.2999 => 6.2189, std.dev.: 0.0126) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2878, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 17.17% (0.5229 => 0.6127, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 14.78% (14.9895 => 17.2045, std.dev.: 0.0086) MultiSource/Benchmarks/MallocBench/gs/gs: 9.72% (4.1105 => 4.5102, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 16.75% (1.1048 => 1.2899, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.90% (7.1582 => 8.2247, std.dev.: 0.0158) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.33% (0.6222 => 0.7736, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35800.00% (0.0001 => 0.0359, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.70% (0.1485 => 0.1430) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.99% (0.2116 => 0.2137, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 18 10:13:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 18 Oct 2012 12:13:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121018171337.A25F92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4969?compare_to=4966&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4969, Order: 166179, Start Time: 2012-10-18 15:50:31, End Time: 2012-10-18 17:16:35 To: 4966, Order: 166178, Start Time: 2012-10-18 13:55:20, End Time: 2012-10-18 15:21:12 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (191 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1042 (675 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.44% (2.0176 => 2.5108, std.dev.: 0.0050) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.94% (0.1410 => 0.1677, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 17.68% (0.0826 => 0.0972) MultiSource/Benchmarks/McCat/08-main/main: 16.67% (0.2243 => 0.2617, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 14.31% (0.1013 => 0.1158, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.03% (0.0834 => 0.0951, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.52% (0.1413 => 0.1604, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.48% (0.1588 => 0.1802, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 13.26% (0.4328 => 0.4902, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.18% (0.6283 => 0.7111, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 13.16% (1.3693 => 1.5495, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.03% (3.9660 => 4.4829, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 13.01% (0.2721 => 0.3075, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 12.99% (0.7038 => 0.7952, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.96% (0.1327 => 0.1499, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 12.90% (0.4062 => 0.4586, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.86% (0.0964 => 0.1088, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.82% (0.0819 => 0.0924, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.66% (1.4563 => 1.6406, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.48% (0.9199 => 1.0347, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 12.48% (13.8202 => 15.5448, std.dev.: 0.1127) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.43% (0.7710 => 0.8668, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.40% (0.2596 => 0.2918, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.37% (1.2193 => 1.3701, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.32% (1.1364 => 1.2764, std.dev.: 0.0077) MultiSource/Benchmarks/FreeBench/distray/distray: 12.22% (0.0818 => 0.0918, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.16% (0.6959 => 0.7805, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.16% (0.5265 => 0.5905, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.06% (0.4791 => 0.5369, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 12.05% (0.5818 => 0.6519, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.71% (0.3485 => 0.3893, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 11.67% (1.0313 => 1.1517, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.67% (0.3899 => 0.4354, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 11.64% (0.5748 => 0.6417, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.63% (0.3130 => 0.3494, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 11.58% (0.7061 => 0.7879, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 11.58% (0.1062 => 0.1185, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 11.58% (0.2781 => 0.3103, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 11.57% (0.1478 => 0.1649, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 11.47% (0.1003 => 0.1118, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 11.45% (0.3293 => 0.3670, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.44% (0.4390 => 0.4892, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.43% (0.4016 => 0.4475, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.37% (0.3756 => 0.4183, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.30% (0.5577 => 0.6207, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 11.29% (0.1276 => 0.1420, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.18% (0.2782 => 0.3093, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 11.14% (0.6744 => 0.7495, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.09% (0.3022 => 0.3357, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 11.07% (0.3868 => 0.4296, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.06% (0.1157 => 0.1285, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 11.06% (0.3453 => 0.3835, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 11.05% (0.2995 => 0.3326, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: 11.05% (0.2761 => 0.3066, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: 11.03% (1.1061 => 1.2281, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 11.01% (0.3489 => 0.3873, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 10.94% (0.3107 => 0.3447, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 10.90% (0.2726 => 0.3023, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.86% (0.0976 => 0.1082, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 10.83% (0.3149 => 0.3490, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 10.82% (0.1589 => 0.1761, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.82% (0.8698 => 0.9639, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.79% (0.1075 => 0.1191, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.79% (1.9828 => 2.1967, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.73% (0.4379 => 0.4849, std.dev.: 0.0052) MultiSource/Applications/kimwitu++/kc: 10.73% (16.6129 => 18.3957, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.72% (0.3246 => 0.3594, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 10.71% (0.1111 => 0.1230, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.71% (0.1569 => 0.1737, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 10.67% (0.3534 => 0.3911, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.65% (0.2966 => 0.3282, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.63% (0.2127 => 0.2353, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 10.58% (0.2628 => 0.2906, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 10.56% (0.2690 => 0.2974, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 10.56% (3.1889 => 3.5255, std.dev.: 0.0642) SingleSource/Benchmarks/Shootout-C++/wc: 10.55% (0.2937 => 0.3247, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 10.55% (0.2607 => 0.2882, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 10.54% (0.2760 => 0.3051, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.50% (0.3580 => 0.3956, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 10.50% (1.9270 => 2.1293, std.dev.: 0.0259) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.47% (0.2655 => 0.2933, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.47% (0.7460 => 0.8241, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.44% (0.0977 => 0.1079, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.43% (0.2914 => 0.3218, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 10.43% (0.3192 => 0.3525, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 10.40% (0.3220 => 0.3555, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 10.39% (0.8310 => 0.9173, std.dev.: 0.0019) MultiSource/Applications/spiff/spiff: 10.37% (0.7506 => 0.8284, std.dev.: 0.0054) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.35% (0.1072 => 0.1183, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.34% (0.2765 => 0.3051, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.29% (0.5637 => 0.6217, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 10.23% (3.8646 => 4.2598, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.22% (0.1986 => 0.2189, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.18% (0.2023 => 0.2229, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.17% (0.1435 => 0.1581, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.16% (0.8818 => 0.9714, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.08% (0.1865 => 0.2053, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.06% (0.1014 => 0.1116, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.05% (0.2696 => 0.2967, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 10.05% (2.1791 => 2.3980, std.dev.: 0.0242) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.05% (4.9865 => 5.4874, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/matrix: 10.01% (0.2988 => 0.3287, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 9.97% (1.0594 => 1.1650, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.97% (7.2180 => 7.9373, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.88% (0.3755 => 0.4126, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 9.64% (0.2925 => 0.3207, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 9.61% (0.2945 => 0.3228) MultiSource/Applications/JM/lencod/lencod: 9.60% (14.8535 => 16.2799, std.dev.: 0.0092) MultiSource/Applications/SIBsim4/SIBsim4: 9.55% (1.2749 => 1.3967, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.53% (0.6576 => 0.7203, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.53% (3.6692 => 4.0189, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 9.47% (0.1657 => 0.1814, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.40% (4.4433 => 4.8610, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.35% (4.3801 => 4.7898, std.dev.: 0.0072) MultiSource/Applications/oggenc/oggenc: 9.34% (4.6629 => 5.0985, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.34% (1.3245 => 1.4482, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: 9.17% (0.6250 => 0.6823, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 9.06% (8.4961 => 9.2657, std.dev.: 0.0123) MultiSource/Benchmarks/sim/sim: 9.04% (0.3131 => 0.3414, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.01% (1.5188 => 1.6556, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.95% (0.6135 => 0.6684, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.83% (0.2140 => 0.2329, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 8.73% (0.4113 => 0.4472, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.72% (0.1789 => 0.1945, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.64% (3.2742 => 3.5572, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions: 8.61% (0.3914 => 0.4251, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.57% (0.9108 => 0.9889, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 8.54% (0.4003 => 0.4345, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 8.42% (0.2008 => 0.2177, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.38% (0.3578 => 0.3878, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.32% (0.3511 => 0.3803, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.30% (0.4805 => 0.5204, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.30% (0.1819 => 0.1970, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.29% (0.3245 => 0.3514, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.25% (0.3940 => 0.4265, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.25% (0.3601 => 0.3898, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.23% (0.3646 => 0.3946, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.21% (0.3789 => 0.4100, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.21% (2.1007 => 2.2731, std.dev.: 0.0164) SingleSource/UnitTests/ObjC/synchronized: 8.19% (0.3663 => 0.3963, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1385 => 0.1498, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.14% (1.1333 => 1.2256, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.14% (0.3650 => 0.3947, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 8.11% (0.3623 => 0.3917, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 8.02% (6.5754 => 7.1029, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.87% (0.2504 => 0.2701, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 7.79% (3.7467 => 4.0386, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.71% (0.2321 => 0.2500, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 7.70% (1.2292 => 1.3239, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.40% (6.2785 => 6.7433, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.11% (13.2842 => 14.2287, std.dev.: 0.0271) SingleSource/Benchmarks/Misc/ReedSolomon: 6.30% (0.1777 => 0.1889, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 5.85% (16.2614 => 17.2125, std.dev.: 0.0149) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.53% (0.2243 => 0.2367, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 4.91% (14.5298 => 15.2437, std.dev.: 0.0164) MultiSource/Benchmarks/Bullet/bullet: 2.64% (33.2944 => 34.1723, std.dev.: 0.0157) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.65% (5.7573 => 7.5219, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fbench: 26.27% (1.8175 => 2.2950, std.dev.: 0.0304) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.05% (1.0895 => 1.2753, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 11.13% (1.1560 => 1.2847, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.02% (0.8273 => 0.9019, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4141, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 5.45% (1.2998 => 1.3706, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.43% (0.9692 => 1.0218) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0001, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.65% (1.9144 => 2.0034, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: 4.46% (0.5449 => 0.5692, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (1.7081 => 1.7749, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.72% (11.2619 => 11.6813, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9855, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 3.39% (12.0921 => 12.5016, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.06% (10.7476 => 11.0769, std.dev.: 0.0268) MultiSource/Benchmarks/Olden/bisort/bisort: 2.89% (0.8239 => 0.8477, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.20% (7.4271 => 7.5902, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 1.73% (1.4298 => 1.4545, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5129, std.dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1873, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5782, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5901, std.dev.: 0.0062) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.93% (0.2670 => 0.1417, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.03% (0.4657 => 0.3957, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.69% (1.3819 => 1.2065, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.63% (1.3813 => 1.2069, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.28% (1.0460 => 0.8548, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/mason/mason: -12.78% (0.2238 => 0.1952, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.13% (20.3410 => 18.2804, std.dev.: 0.0416) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -6.22% (1.2308 => 1.1543, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5136, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.78% (1.3780 => 1.3121, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.48% (0.9996 => 0.9548, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.93% (1.7688 => 1.6992, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -3.28% (3.2729 => 3.1654, std.dev.: 0.0242) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.12% (0.4867 => 0.4715, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -2.83% (3.0263 => 2.9407, std.dev.: 0.0035) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8812, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784) MultiSource/Benchmarks/Olden/bh/bh: -2.36% (1.9762 => 1.9295, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.12% (0.6589 => 0.6449, std.dev.: 0.0010) MultiSource/Applications/lua/lua: -2.00% (26.5159 => 25.9866, std.dev.: 0.0301) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.97% (0.8342 => 0.8178, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.86% (0.6615 => 0.6492) SingleSource/Benchmarks/Shootout/lists: -1.81% (6.3560 => 6.2409, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.58% (2.5254 => 2.4856, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0062, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/heapsort: -1.26% (3.9173 => 3.8681, std.dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2531, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -1.19% (28.2225 => 27.8866, std.dev.: 0.0021) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1140, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -1.06% (84.4286 => 83.5338, std.dev.: 0.0074) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 18 11:22:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 18 Oct 2012 13:22:38 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121018182238.3582B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4970?compare_to=4967&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 4970, Order: 166184, Start Time: 2012-10-18 17:01:14, End Time: 2012-10-18 18:24:37 To: 4967, Order: 166179, Start Time: 2012-10-18 15:21:12, End Time: 2012-10-18 16:44:34 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 11 (6 on baseline) Performance Improvements: 2 (7 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 962 (961 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.47% (0.2436 => 0.2545, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.22% (0.2865 => 0.2986, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: 2.89% (0.7857 => 0.8084, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.71% (0.5793 => 0.5950, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.12% (0.6052 => 0.6180, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.65% (1.4369 => 1.4606, std.dev.: 0.0066) MultiSource/Benchmarks/nbench/nbench: 1.05% (1.1189 => 1.1307, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 5.41% (3.0594 => 3.2250, std.dev.: 0.0584) SingleSource/Benchmarks/CoyoteBench/lpbench: 3.34% (3.9362 => 4.0678, std.dev.: 0.0074) SingleSource/Benchmarks/Dhrystone/fldry: 2.68% (0.6720 => 0.6900, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.42% (4.4883 => 4.5519, std.dev.: 0.0236) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.66% (7.3631 => 7.0936, std.dev.: 0.0626) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.28% (45.6590 => 44.6202, std.dev.: 0.3904) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.42% (16.4701 => 16.4010, std.dev.: 0.1403) MultiSource/Applications/obsequi/Obsequi: 0.50% (1.0250 => 1.0301, std.dev.: 0.0121) MultiSource/Applications/sqlite3/sqlite3: 0.32% (0.6329 => 0.6349, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 9.29% (0.1712 => 0.1871, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.91% (0.1627 => 0.1658, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.34% (0.3214 => 0.3203, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.41% (0.2460 => 0.2470, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.42% (0.3304 => 0.3290, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.67% (0.2382 => 0.2398, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: -0.07% (0.5930 => 0.5926, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel: 16.75% (0.0406 => 0.0474, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.98% (0.3275 => 0.3307, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/strcat: 0.41% (0.1967 => 0.1975, std.dev.: 0.0009) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 18.09% (0.0188 => 0.0222, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -30.29% (0.0208 => 0.0145, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -6.57% (0.0411 => 0.0384, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.67% (0.0240 => 0.0236, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -25.26% (0.0289 => 0.0216, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.98% (0.0409 => 0.0413, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -24.74% (0.0190 => 0.0143, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/test1: 48.59% (0.0142 => 0.0211, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: 8.25% (0.0315 => 0.0341, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.14% (0.1448 => 0.1446, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 9.19% (1.1015 => 1.2027, std.dev.: 0.0243) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.96% (0.1465 => 0.1479, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.05% (0.4031 => 0.4029, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.99% (0.1404 => 0.1446, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: - (0.0570 => 0.0570, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 16.58% (0.0187 => 0.0218, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.71% (0.0544 => 0.0624, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.48% (1.1416 => 1.1471, std.dev.: 0.0095) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.25% (0.0588 => 0.0563, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -21.43% (0.0224 => 0.0176, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.47% (0.8048 => 0.8010, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: -75.00% (0.0004 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 67.57% (0.0037 => 0.0062, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.03% (2.1832 => 1.6586, std.dev.: 0.0022) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/spiff/spiff: 1.69% (0.7950 => 0.8084, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 59.25% (1.5795 => 2.5154, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.96% (1.1857 => 1.2919, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.16% (0.3186 => 0.3414, std.dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/lpbench: 4.29% (3.9006 => 4.0678, std.dev.: 0.0074) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.60% (0.2887 => 0.2991, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.78% (8.4179 => 8.0994, std.dev.: 0.0715) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.03% (0.6010 => 0.5888, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.83% (0.7557 => 0.7419, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/gs/gs: -1.45% (4.1305 => 4.0705, std.dev.: 0.0097) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.02% (0.3269 => 0.2974, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: -1.48% (8.4326 => 8.3080, std.dev.: 0.0450) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.18% (1.0388 => 1.0265, std.dev.: 0.0017) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.27% (16.4461 => 16.4010, std.dev.: 0.1403) MultiSource/Applications/obsequi/Obsequi: 0.38% (1.0262 => 1.0301, std.dev.: 0.0121) MultiSource/Applications/sqlite3/sqlite3: 0.27% (0.6332 => 0.6349, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 2.18% (0.1831 => 0.1871, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 6.35% (0.1559 => 0.1658, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.56% (0.3123 => 0.3203, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.28% (0.2463 => 0.2470, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.61% (0.3344 => 0.3290, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.44% (0.2364 => 0.2398, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: -1.40% (0.6010 => 0.5926, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel: 10.49% (0.0429 => 0.0474, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.26% (0.3266 => 0.3307, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/strcat: 0.30% (0.1969 => 0.1975, std.dev.: 0.0009) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.89% (0.0224 => 0.0222, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 17.89% (0.0123 => 0.0145, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.88% (0.0408 => 0.0384, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -7.09% (0.0254 => 0.0236, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -28.48% (0.0302 => 0.0216, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 7.55% (0.0384 => 0.0413, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -24.74% (0.0190 => 0.0143, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/test1: 17.22% (0.0180 => 0.0211, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: 48.26% (0.0230 => 0.0341, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.56% (0.1438 => 0.1446, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 6.16% (1.1329 => 1.2027, std.dev.: 0.0243) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.16% (0.1462 => 0.1479, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.24% (0.4164 => 0.4029, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.62% (0.1369 => 0.1446, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -11.08% (0.0641 => 0.0570, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 11.79% (0.0195 => 0.0218, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 7.96% (0.0578 => 0.0624, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.30% (1.1437 => 1.1471, std.dev.: 0.0095) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.21% (0.0627 => 0.0563, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.22% (0.0180 => 0.0176, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.09% (0.8017 => 0.8010, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0062 => 0.0062, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 18 11:52:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 18 Oct 2012 13:52:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121018185228.C7F702A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4971?compare_to=4968&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4971, Order: 166188, Start Time: 2012-10-18 17:33:56, End Time: 2012-10-18 18:54:24 To: 4968, Order: 166179, Start Time: 2012-10-18 15:44:12, End Time: 2012-10-18 17:04:17 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (75 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (181 on baseline) Performance Improvements: 1 (44 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 90 (15 on baseline) Unchanged Tests: 949 (661 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 4.76% (0.4349 => 0.4556, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.88% (54.4721 => 56.5874, std.dev.: 0.0969) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.17% (1.1055 => 1.0926, std.dev.: 0.0012) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.18% (0.6127 => 0.6116, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: -0.38% (17.2045 => 17.1383, std.dev.: 0.0173) MultiSource/Benchmarks/Bullet/bullet: -0.45% (56.0742 => 55.8199, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/gs/gs: 0.15% (4.5102 => 4.5171, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.43% (0.0465 => 0.0467) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0467 => 0.0467, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.23% (0.0434 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0436 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0425 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.24% (0.0425 => 0.0426, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.24% (0.0416 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0418 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.23% (0.0435 => 0.0436, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.46% (0.0436 => 0.0438, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.23% (0.0429 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0431 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0421 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.47% (0.0423 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.23% (0.0426 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0428 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.23% (0.0438 => 0.0439, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0441 => 0.0441, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.48% (0.0414 => 0.0416) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.24% (0.0415 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0427 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0428 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.24% (0.0417 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.24% (0.0420 => 0.0419, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.24% (0.0410 => 0.0411, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.49% (0.0410 => 0.0412) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.24% (0.0410 => 0.0411) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.24% (0.0410 => 0.0411) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.45% (0.0445 => 0.0447) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.22% (0.0447 => 0.0448) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.24% (0.0409 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.24% (0.0410 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.24% (0.0410 => 0.0411) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0411 => 0.0411, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.24% (0.0417 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.34% (1.2899 => 1.2855, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.24% (8.2247 => 8.2048, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.17% (0.7736 => 0.7723, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.84% (0.0359 => 0.0362, std.dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1430 => 0.1429, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: - (0.1658 => 0.1658) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.48% (0.2137 => 0.2190, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.74% (63.2438 => 55.8199, std.dev.: 0.0029) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 1.16% (0.1639 => 0.1658) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 35.34% (14.1553 => 19.1574, std.dev.: 0.0280) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.78% (3.4629 => 5.7755, std.dev.: 0.0008) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13410.69% (0.0720 => 9.7277, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9973400.00% (0.0001 => 9.9735, std.dev.: 0.0011) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 62.49% (0.2554 => 0.4150, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 51.95% (0.0256 => 0.0389, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 47.93% (10.3673 => 15.3359, std.dev.: 0.0039) SingleSource/UnitTests/SignlessTypes/factor: 41.89% (0.0296 => 0.0420, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 37.98% (0.1622 => 0.2238, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/distray/distray: 35.89% (0.1056 => 0.1435, std.dev.: 0.0005) SingleSource/UnitTests/vla: 29.01% (0.0355 => 0.0458, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 23.98% (0.0834 => 0.1034, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.46% (7.0540 => 8.3560, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.40% (2.2022 => 2.6073, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 17.67% (0.1432 => 0.1685) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.11% (0.0871 => 0.1020, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.99% (0.1566 => 0.1832, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 16.91% (0.6675 => 0.7804, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 16.71% (0.5105 => 0.5958, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 15.93% (3.3354 => 3.8668, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/chomp: 15.65% (0.1655 => 0.1914, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.53% (1.3050 => 1.5077, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.74% (0.5020 => 0.5760, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/oourafft: 14.66% (0.3282 => 0.3763, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 14.58% (0.2271 => 0.2602, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 14.38% (0.1440 => 0.1647, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 14.27% (0.7115 => 0.8130, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 14.25% (10.4361 => 11.9232, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.16% (0.0798 => 0.0911, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.15% (1.5415 => 1.7596, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 14.14% (9.4845 => 10.8255, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.85% (1.7609 => 2.0048, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.51% (0.1510 => 0.1714, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 13.13% (0.1584 => 0.1792, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 13.09% (0.3109 => 0.3516, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/18-imp/imp: 12.88% (0.3423 => 0.3864, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 12.86% (0.1695 => 0.1913, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.74% (0.1625 => 0.1832, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.72% (0.4615 => 0.5202, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/matrix: 12.71% (0.0818 => 0.0922, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.69% (4.2646 => 4.8057, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 12.50% (5.7591 => 6.4790, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/tsp/tsp: 12.43% (0.1175 => 0.1321, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.40% (0.1032 => 0.1160, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 12.26% (1.0722 => 1.2036, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 12.22% (0.6450 => 0.7238, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.19% (0.1337 => 0.1500, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 12.18% (8.1363 => 9.1270, std.dev.: 0.0080) MultiSource/Benchmarks/sim/sim: 12.16% (0.3387 => 0.3799, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.14% (0.1236 => 0.1386, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: 12.10% (0.1463 => 0.1640, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 12.04% (0.1163 => 0.1303, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.00% (0.0933 => 0.1045, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.98% (0.1695 => 0.1898, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 11.96% (0.1555 => 0.1741, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.96% (0.1940 => 0.2172, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 11.95% (1.1642 => 1.3033, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.93% (0.8067 => 0.9029, std.dev.: 0.0046) MultiSource/Applications/treecc/treecc: 11.92% (2.0273 => 2.2690, std.dev.: 0.0133) MultiSource/Benchmarks/nbench/nbench: 11.92% (1.1840 => 1.3251, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.90% (0.9765 => 1.0927, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.89% (0.5860 => 0.6557, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.87% (4.9449 => 5.5321, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 11.85% (0.0886 => 0.0991, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.83% (0.3543 => 0.3962, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 11.83% (0.7433 => 0.8312, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.77% (0.3543 => 0.3960, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 11.72% (0.3473 => 0.3880, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/rem: 11.71% (0.1144 => 0.1278, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.70% (0.2700 => 0.3016, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 11.63% (3.8723 => 4.3227, std.dev.: 0.0183) SingleSource/UnitTests/ObjC/for-in: 11.61% (0.3694 => 0.4123, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.61% (0.3307 => 0.3691, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 11.61% (0.3497 => 0.3903, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.57% (0.3561 => 0.3973, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.55% (0.3516 => 0.3922, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.49% (0.3177 => 0.3542, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 11.47% (0.1151 => 0.1283, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.44% (5.0018 => 5.5741, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions: 11.42% (0.3828 => 0.4265, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.38% (0.3927 => 0.4374, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.25% (1.1861 => 1.3195, std.dev.: 0.0092) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.22% (7.9617 => 8.8553, std.dev.: 0.0126) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.20% (0.2107 => 0.2343, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.19% (0.0929 => 0.1033, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.19% (0.3886 => 0.4321, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.16% (1.5859 => 1.7629, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.15% (0.4879 => 0.5423, std.dev.: 0.0038) MultiSource/Applications/spiff/spiff: 11.10% (0.7835 => 0.8705, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/football/football: 11.06% (0.8921 => 0.9908, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.05% (0.1330 => 0.1477, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.93% (0.8172 => 0.9065, std.dev.: 0.0034) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.93% (0.3121 => 0.3462, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.92% (0.1438 => 0.1595, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.76% (0.1125 => 0.1246, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.70% (0.1906 => 0.2110, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 10.67% (0.6456 => 0.7145, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.60% (2.2024 => 2.4359, std.dev.: 0.0197) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.59% (0.2758 => 0.3050, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 10.56% (0.4299 => 0.4753, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.53% (1.4186 => 1.5680, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.50% (0.5569 => 0.6154, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.50% (0.1029 => 0.1137, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.47% (0.1117 => 0.1234, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.25% (0.1044 => 0.1151, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.08% (0.1062 => 0.1169, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.07% (0.2603 => 0.2865, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.89% (0.2266 => 0.2490, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 9.87% (2.2969 => 2.5237, std.dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: 9.74% (21.9371 => 24.0741, std.dev.: 0.0318) SingleSource/Benchmarks/Shootout-C++/hash2: 9.63% (0.4620 => 0.5065, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 9.63% (0.4289 => 0.4702, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 9.63% (1.5603 => 1.7105, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/09-vor/vor: 9.53% (0.3180 => 0.3483, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.51% (0.3826 => 0.4190, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.50% (0.3441 => 0.3768, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 9.47% (0.2049 => 0.2243, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.44% (0.2065 => 0.2260, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/health/health: 9.38% (0.1268 => 0.1387, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 9.23% (0.3422 => 0.3738, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.09% (0.1892 => 0.2064, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.82% (0.3865 => 0.4206, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.78% (0.4203 => 0.4572, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.66% (0.5981 => 0.6499, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 8.50% (0.4048 => 0.4392, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.35% (0.4636 => 0.5023, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists1: 8.28% (0.3684 => 0.3989, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.16% (0.4103 => 0.4438, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.14% (0.3427 => 0.3706, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 8.05% (17.1811 => 18.5642, std.dev.: 0.0230) SingleSource/Benchmarks/Shootout-C++/sieve: 7.80% (0.3603 => 0.3884, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.75% (0.5925 => 0.6384, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.71% (0.6030 => 0.6495, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.65% (0.3136 => 0.3376, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.46% (14.3668 => 15.4390, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.43% (0.4064 => 0.4366, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.40% (0.3650 => 0.3920, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.28% (0.8101 => 0.8691, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 7.22% (0.7326 => 0.7855, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: 7.18% (0.3092 => 0.3314, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.89% (3.8922 => 4.1603, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary3: 6.85% (0.3283 => 0.3508, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 6.84% (0.3098 => 0.3310, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.81% (0.3232 => 0.3452, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.78% (0.2905 => 0.3102, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.75% (0.2831 => 0.3022, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.71% (0.2891 => 0.3085, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.70% (0.3162 => 0.3374, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.67% (2.0665 => 2.2043, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 6.42% (0.3379 => 0.3596, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.34% (0.2871 => 0.3053, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.34% (0.2872 => 0.3054, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.31% (0.2756 => 0.2930, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.30% (0.2793 => 0.2969, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 6.17% (0.2725 => 0.2893, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 6.16% (0.3052 => 0.3240, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.08% (0.2714 => 0.2879, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 5.96% (0.2802 => 0.2969, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 5.68% (1.2842 => 1.3571, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.60% (0.2430 => 0.2566, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (0.3131 => 0.3294, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.90% (0.3817 => 0.3966, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.81% (1.1194 => 1.1509, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.57% (0.3935 => 0.4036, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.56% (1.1145 => 1.2991, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.94% (1.1396 => 1.2529, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 9.73% (0.9957 => 1.0926, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3685, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/bh/bh: 5.62% (1.9405 => 2.0496, std.dev.: 0.0084) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.71% (4.2280 => 4.3424, std.dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.35% (1.7254 => 1.7659, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.10% (3.6395 => 3.7158, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/bisort/bisort: 1.80% (0.8333 => 0.8483, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.59% (2.6546 => 2.6968, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2076, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.14% (11.6436 => 11.7766, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.01% (6.6874 => 0.1333, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -79.90% (0.8651 => 0.1739, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.13% (5.2763 => 3.2647, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.99% (5.3855 => 3.7168, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.55% (5.3526 => 3.7175, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -14.58% (54.1659 => 46.2698, std.dev.: 0.0213) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.26% (2.9384 => 2.6368, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -7.22% (22.1758 => 20.5740, std.dev.: 0.0206) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.06% (8.0499 => 3.7785, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.43% (1.1492 => 0.7650, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -15.84% (1.6925 => 1.4244, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -12.61% (1.2373 => 1.0813, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3453 => 2.9599, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -10.77% (1.5373 => 1.3718, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.36% (19.9488 => 18.2813, std.dev.: 0.0204) MultiSource/Benchmarks/FreeBench/mason/mason: -7.73% (0.2161 => 0.1994, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.10% (1.8329 => 1.7027, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.56% (1.6805 => 1.5871, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5082, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.31% (8.1563 => 7.8048, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -3.39% (5.0483 => 4.8774, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -3.38% (3.2827 => 3.1718, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5055, std.dev.: 0.0024) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.45% (0.4808 => 0.4690, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -1.80% (10.2830 => 10.0984, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6809, std.dev.: 0.0015) SingleSource/UnitTests/Vector/multiplies: -1.66% (2.5528 => 2.5103, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: -1.64% (4.6441 => 4.5679, std.dev.: 0.0039) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4213, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.24% (6.2999 => 6.2216, std.dev.: 0.0097) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2879, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8594, std.dev.: 0.0102) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 16.96% (0.5229 => 0.6116, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 14.34% (14.9895 => 17.1383, std.dev.: 0.0173) MultiSource/Benchmarks/MallocBench/gs/gs: 9.89% (4.1105 => 4.5171, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 16.36% (1.1048 => 1.2855, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.62% (7.1582 => 8.2048, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.12% (0.6222 => 0.7723, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36100.00% (0.0001 => 0.0362, std.dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: -3.77% (0.1485 => 0.1429, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.50% (0.2116 => 0.2190, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 3.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 18 12:08:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 18 Oct 2012 14:08:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121018190851.530432A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4972?compare_to=4969&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4972, Order: 166188, Start Time: 2012-10-18 17:45:55, End Time: 2012-10-18 19:11:47 To: 4969, Order: 166179, Start Time: 2012-10-18 15:50:31, End Time: 2012-10-18 17:16:35 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (191 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1040 (674 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.41% (54.7249 => 56.5901, std.dev.: 0.0524) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.12% (0.9714 => 0.9605, std.dev.: 0.0011) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.90% (2.0176 => 2.4998, std.dev.: 0.0069) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.44% (0.1410 => 0.1670, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 18.16% (0.0826 => 0.0976, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 16.63% (0.2243 => 0.2616, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 14.12% (0.1013 => 0.1156, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.79% (0.0834 => 0.0949, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.46% (0.0847 => 0.0961, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.45% (0.1413 => 0.1603, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.32% (0.0811 => 0.0919, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.04% (0.1588 => 0.1795, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 13.01% (0.2721 => 0.3075, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 12.89% (1.3693 => 1.5458, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 12.85% (0.4328 => 0.4884, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 12.76% (0.7038 => 0.7936, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.75% (3.9660 => 4.4717, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.72% (0.6283 => 0.7082, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.66% (0.0964 => 0.1086, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.61% (0.5265 => 0.5929, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.58% (0.1327 => 0.1494, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.58% (0.7710 => 0.8680, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 12.41% (0.4062 => 0.4566, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.32% (1.4563 => 1.6357, std.dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: 12.32% (13.8202 => 15.5222, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.30% (0.6959 => 0.7815, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.11% (0.9199 => 1.0313, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.10% (0.2596 => 0.2910, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.97% (1.2193 => 1.3653, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.97% (1.1364 => 1.2724, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 11.76% (0.1003 => 0.1121, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.63% (0.4791 => 0.5348, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.60% (0.3130 => 0.3493, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.59% (0.3899 => 0.4351, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 11.40% (0.2781 => 0.3098, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.39% (0.4390 => 0.4890, std.dev.: 0.0032) MultiSource/Applications/lemon/lemon: 11.34% (1.0313 => 1.1483, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.23% (0.4016 => 0.4467, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 11.21% (0.1062 => 0.1181, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 11.11% (0.3293 => 0.3659, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.05% (0.3485 => 0.3870, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.05% (0.5577 => 0.6193, std.dev.: 0.0007) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.01% (0.1072 => 0.1190, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.00% (0.2782 => 0.3088, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.98% (0.1157 => 0.1284, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/mst/mst: 10.89% (0.1111 => 0.1232, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.86% (0.3756 => 0.4164, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 10.79% (1.1061 => 1.2254, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 10.78% (0.3868 => 0.4285, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 10.74% (0.3453 => 0.3824, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 10.71% (0.7061 => 0.7817, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 10.69% (0.6744 => 0.7465, std.dev.: 0.0081) SingleSource/UnitTests/ObjC++/property-reference-object: 10.69% (0.5818 => 0.6440, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 10.65% (0.3220 => 0.3563, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 10.65% (0.2995 => 0.3314, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.62% (0.8698 => 0.9622, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.62% (0.3022 => 0.3343, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.58% (0.3489 => 0.3858, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.55% (0.6576 => 0.7270, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.55% (0.0976 => 0.1079, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 10.53% (0.2726 => 0.3013, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.52% (0.1569 => 0.1734, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 10.49% (0.3107 => 0.3433, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 10.45% (0.3149 => 0.3478, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 10.44% (0.5748 => 0.6348, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/fibo: 10.43% (0.2628 => 0.2902, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.39% (0.4379 => 0.4834, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 10.32% (0.2607 => 0.2876, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 10.30% (0.3534 => 0.3898, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.30% (0.2914 => 0.3214, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.29% (0.3246 => 0.3580, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 10.25% (3.1889 => 3.5159, std.dev.: 0.0124) MultiSource/Applications/kimwitu++/kc: 10.25% (16.6129 => 18.3163, std.dev.: 0.0180) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.25% (0.2127 => 0.2345, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.23% (0.1075 => 0.1185, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 10.22% (0.2690 => 0.2965, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.21% (1.9828 => 2.1853, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.21% (0.2655 => 0.2926, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 10.20% (0.1589 => 0.1751, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.19% (0.1276 => 0.1406, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.18% (0.2966 => 0.3268, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 10.18% (1.9270 => 2.1232, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.17% (0.3580 => 0.3944, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.16% (0.7460 => 0.8218, std.dev.: 0.0014) MultiSource/Applications/viterbi/viterbi: 10.15% (0.1478 => 0.1628, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 10.13% (0.8310 => 0.9152, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 10.11% (0.2760 => 0.3039, std.dev.: 0.0074) MultiSource/Applications/spiff/spiff: 10.10% (0.7506 => 0.8264, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 10.08% (0.2937 => 0.3233, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 10.07% (0.2761 => 0.3039, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.06% (4.9865 => 5.4882, std.dev.: 0.0165) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.97% (0.1435 => 0.1578) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.95% (0.5637 => 0.6198, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 9.92% (3.8646 => 4.2479, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 9.90% (2.1791 => 2.3949, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.87% (0.2765 => 0.3038, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 9.81% (0.3192 => 0.3505, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.74% (0.2023 => 0.2220, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.72% (0.2696 => 0.2958, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 9.67% (1.0594 => 1.1618, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.62% (7.2180 => 7.9125, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.62% (0.1986 => 0.2177, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.60% (0.1865 => 0.2044, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.59% (0.3755 => 0.4115, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 9.47% (0.2988 => 0.3271, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 9.34% (0.2945 => 0.3220, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 9.30% (0.2925 => 0.3197, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.19% (1.3245 => 1.4462, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 9.14% (14.8535 => 16.2104, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.09% (3.6692 => 4.0028, std.dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: 9.06% (1.2749 => 1.3904, std.dev.: 0.0073) MultiSource/Benchmarks/mafft/pairlocalalign: 8.97% (8.4961 => 9.2580, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.92% (0.8818 => 0.9605, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 8.91% (0.3131 => 0.3410, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 8.87% (0.1657 => 0.1804, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.80% (4.3801 => 4.7656, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.75% (4.4433 => 4.8320, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/bigfib: 8.67% (0.6250 => 0.6792, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.62% (1.5188 => 1.6497, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.44% (0.6135 => 0.6653, std.dev.: 0.0102) MultiSource/Applications/oggenc/oggenc: 8.43% (4.6629 => 5.0558, std.dev.: 0.0149) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.41% (0.2140 => 0.2320, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.37% (0.3511 => 0.3805, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.32% (3.2742 => 3.5466, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.22% (0.1789 => 0.1936, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 8.19% (0.4113 => 0.4450, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.14% (0.3245 => 0.3509, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.11% (0.9108 => 0.9847, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 8.02% (0.4003 => 0.4324, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.01% (0.4805 => 0.5190, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/oourafft: 7.87% (0.2008 => 0.2166, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.85% (2.1007 => 2.2656, std.dev.: 0.0153) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.83% (1.1333 => 1.2220, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: 7.80% (0.1385 => 0.1493, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.79% (0.3914 => 0.4219, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 7.73% (6.5754 => 7.0837, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 7.63% (0.3578 => 0.3851, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.63% (0.2504 => 0.2695, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.61% (0.3940 => 0.4240, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.58% (0.2321 => 0.2497, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 7.54% (0.3646 => 0.3921, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-2: 7.53% (0.3601 => 0.3872, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.48% (0.3663 => 0.3937, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.48% (0.3650 => 0.3923, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 7.44% (0.3789 => 0.4071, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 7.44% (3.7467 => 4.0254, std.dev.: 0.0065) SingleSource/UnitTests/ObjC/exceptions-3: 7.34% (0.3623 => 0.3889, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 7.34% (1.2292 => 1.3194, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.31% (0.1819 => 0.1952, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.02% (6.2785 => 6.7191, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.88% (13.2842 => 14.1982, std.dev.: 0.0211) SingleSource/Benchmarks/Misc/ReedSolomon: 6.36% (0.1777 => 0.1890, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 5.67% (16.2614 => 17.1842, std.dev.: 0.0210) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.35% (0.2243 => 0.2363, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 4.64% (14.5298 => 15.2042, std.dev.: 0.0168) MultiSource/Benchmarks/Olden/bh/bh: 3.67% (0.2859 => 0.2964, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 2.22% (33.2944 => 34.0347, std.dev.: 0.0087) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5193, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/fbench: 24.35% (1.8175 => 2.2600, std.dev.: 0.0284) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.09% (1.0895 => 1.2757, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: 11.01% (1.1560 => 1.2833, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4142, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.43% (0.9692 => 1.0218) SingleSource/Benchmarks/Misc/mandel-2: 5.40% (1.2998 => 1.3700, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.75% (1.9144 => 2.0054, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 4.48% (0.5449 => 0.5693) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.88% (1.7081 => 1.7743, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.73% (11.2619 => 11.6816, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9857, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 3.37% (12.0921 => 12.4996, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 3.03% (10.7476 => 11.0729, std.dev.: 0.0251) MultiSource/Benchmarks/Olden/bisort/bisort: 3.00% (0.8239 => 0.8486, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.14% (7.4271 => 7.5857, std.dev.: 0.0053) MultiSource/Applications/lemon/lemon: 1.90% (1.4298 => 1.4569, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5131, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1877, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 1.20% (5.5130 => 5.5790, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5868, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/queens: 1.01% (2.1753 => 2.1972, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.97% (0.2670 => 0.1416, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.61% (0.4657 => 0.3930, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.04% (1.3813 => 1.2012, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.97% (1.3819 => 1.2027, std.dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.28% (1.0460 => 0.8548, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -12.69% (0.2238 => 0.1954, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.08% (20.3410 => 18.2907, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-3: -6.27% (2.4152 => 2.2637, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -6.08% (1.2308 => 1.1560, std.dev.: 0.0220) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.05% (2.6470 => 2.5134, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.32% (0.9996 => 0.9564, std.dev.: 0.0087) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.17% (1.3780 => 1.3205, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.87% (1.7688 => 1.7003, std.dev.: 0.0011) MultiSource/Applications/siod/siod: -3.27% (3.2729 => 3.1658, std.dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.02% (0.4867 => 0.4720, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.79% (3.0263 => 2.9420, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8812, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.36% (1.9762 => 1.9295, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.99% (0.8342 => 0.8176, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -1.97% (26.5159 => 25.9935, std.dev.: 0.0204) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.96% (0.6589 => 0.6460, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.87% (0.6615 => 0.6491, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.79% (6.3560 => 6.2425, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.64% (2.5254 => 2.4839, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0066, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.23% (5.3167 => 5.2514, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: -1.20% (28.2225 => 27.8849, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/heapsort: -1.12% (3.9173 => 3.8733, std.dev.: 0.0069) MultiSource/Applications/aha/aha: -1.08% (3.1476 => 3.1137, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -1.06% (84.4286 => 83.5368, std.dev.: 0.0082) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.05% (6.6320 => 6.5626, std.dev.: 0.0124) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 18 13:05:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 18 Oct 2012 15:05:15 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121018200515.5500B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4973?compare_to=4970&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 4973, Order: 166199, Start Time: 2012-10-18 18:42:55, End Time: 2012-10-18 20:07:14 To: 4970, Order: 166184, Start Time: 2012-10-18 17:01:14, End Time: 2012-10-18 18:24:37 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 16 (12 on baseline) Performance Improvements: 1 (2 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 958 (960 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.72% (0.1091 => 0.1197, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.40% (0.8029 => 0.8302, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.99% (0.6179 => 0.6364, std.dev.: 0.0040) MultiSource/Applications/hbd/hbd: 2.82% (1.4021 => 1.4416, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.81% (0.4736 => 0.4869, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.51% (0.8240 => 0.8447, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.41% (0.5888 => 0.6030, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.24% (0.8303 => 0.8489, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.00% (0.8070 => 0.8231, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.55% (0.8855 => 0.8992, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.33% (0.7533 => 0.7633, std.dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 1.27% (8.5693 => 8.6779, std.dev.: 0.0370) MultiSource/Benchmarks/MallocBench/gs/gs: 1.24% (4.0705 => 4.1211, std.dev.: 0.0190) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 2.07% (8.8184 => 9.0013, std.dev.: 0.0352) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.36% (1.4000 => 1.4191, std.dev.: 0.0026) MultiSource/Benchmarks/BitBench/five11/five11: 1.10% (5.5429 => 5.6041, std.dev.: 0.0203) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.39% (3.6117 => 3.5616, std.dev.: 0.0170) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.18% (16.4010 => 16.4298, std.dev.: 0.1472) MultiSource/Applications/obsequi/Obsequi: 1.17% (1.0301 => 1.0422, std.dev.: 0.0068) MultiSource/Applications/sqlite3/sqlite3: -0.54% (0.6349 => 0.6315, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: -1.12% (0.1871 => 0.1850, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.51% (0.1658 => 0.1633, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.91% (0.3203 => 0.3174, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.36% (0.2470 => 0.2461, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.36% (0.3290 => 0.3302, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.88% (0.2398 => 0.2353, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: 0.47% (0.5926 => 0.5954, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel: -16.24% (0.0474 => 0.0397, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.57% (0.3307 => 0.3288, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/strcat: -0.76% (0.1975 => 0.1960, std.dev.: 0.0015) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.90% (0.0222 => 0.0224, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 42.07% (0.0145 => 0.0206, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 7.81% (0.0384 => 0.0414, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 34.75% (0.0236 => 0.0318, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 38.89% (0.0216 => 0.0300, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.48% (0.0413 => 0.0411, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: 32.87% (0.0143 => 0.0190, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -3.32% (0.0211 => 0.0204, std.dev.: 0.0021) SingleSource/UnitTests/byval-alignment: -7.62% (0.0341 => 0.0315, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.76% (0.1446 => 0.1457, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -6.06% (1.2027 => 1.1298, std.dev.: 0.0597) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 4.87% (0.1479 => 0.1551, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.52% (0.4029 => 0.4211, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.73% (0.1446 => 0.1421, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.98% (0.0570 => 0.0587, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -12.84% (0.0218 => 0.0190, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.74% (0.0624 => 0.0557, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.31% (1.1471 => 1.1435, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.72% (0.0563 => 0.0629, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 51.70% (0.0176 => 0.0267, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.05% (0.8010 => 0.8014, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 17.74% (0.0062 => 0.0073, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.08% (2.1832 => 1.6575, std.dev.: 0.0044) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.64% (0.2180 => 0.2303, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.14% (0.7473 => 0.7633, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.07% (0.8317 => 0.8489, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.89% (0.8148 => 0.8302, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.79% (0.8086 => 0.8231, std.dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: 1.38% (31.8598 => 32.3001, std.dev.: 0.0868) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.20% (0.8885 => 0.8992, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.66% (1.5795 => 2.5060, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.88% (0.3186 => 0.3469, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.34% (1.1857 => 1.2846, std.dev.: 0.0037) MultiSource/Benchmarks/llubenchmark/llu: 1.40% (1.9967 => 2.0246, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.37% (1.5941 => 1.6159, std.dev.: 0.0076) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.39% (0.3269 => 0.2962, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -1.70% (7.2130 => 7.0904, std.dev.: 0.0261) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.10% (16.4461 => 16.4298, std.dev.: 0.1472) MultiSource/Applications/obsequi/Obsequi: 1.56% (1.0262 => 1.0422, std.dev.: 0.0068) MultiSource/Applications/sqlite3/sqlite3: -0.27% (0.6332 => 0.6315, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: 1.04% (0.1831 => 0.1850, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.75% (0.1559 => 0.1633, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.63% (0.3123 => 0.3174, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.08% (0.2463 => 0.2461, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.26% (0.3344 => 0.3302, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.47% (0.2364 => 0.2353, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: -0.93% (0.6010 => 0.5954, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel: -7.46% (0.0429 => 0.0397, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.67% (0.3266 => 0.3288, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/strcat: -0.46% (0.1969 => 0.1960, std.dev.: 0.0015) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0224 => 0.0224, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 67.48% (0.0123 => 0.0206, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.47% (0.0408 => 0.0414, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 25.20% (0.0254 => 0.0318, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.66% (0.0302 => 0.0300, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 7.03% (0.0384 => 0.0411, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0190 => 0.0190, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 13.33% (0.0180 => 0.0204, std.dev.: 0.0021) SingleSource/UnitTests/byval-alignment: 36.96% (0.0230 => 0.0315, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.32% (0.1438 => 0.1457, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -0.27% (1.1329 => 1.1298, std.dev.: 0.0597) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 6.09% (0.1462 => 0.1551, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.13% (0.4164 => 0.4211, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.80% (0.1369 => 0.1421, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.42% (0.0641 => 0.0587, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.56% (0.0195 => 0.0190, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.63% (0.0578 => 0.0557, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.02% (1.1437 => 1.1435, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.32% (0.0627 => 0.0629, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.33% (0.0180 => 0.0267, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.04% (0.8017 => 0.8014, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 17.74% (0.0062 => 0.0073, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 18 13:42:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 18 Oct 2012 15:42:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121018204220.09E6C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4974?compare_to=4971&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4974, Order: 166206, Start Time: 2012-10-18 19:23:56, End Time: 2012-10-18 20:44:15 To: 4971, Order: 166188, Start Time: 2012-10-18 17:33:56, End Time: 2012-10-18 18:54:24 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (75 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (182 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 90 (15 on baseline) Unchanged Tests: 951 (661 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 1.04% (11.9232 => 12.0470, std.dev.: 0.0050) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.13% (0.6116 => 0.6108, std.dev.: 0.0053) MultiSource/Applications/SPASS/SPASS: 0.06% (17.1383 => 17.1485, std.dev.: 0.0195) MultiSource/Benchmarks/Bullet/bullet: 0.06% (55.8199 => 55.8560, std.dev.: 0.0246) MultiSource/Benchmarks/MallocBench/gs/gs: -0.36% (4.5171 => 4.5010, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.64% (0.0467 => 0.0464, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.21% (0.0467 => 0.0468, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0435 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0436 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.24% (0.0425 => 0.0424, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.23% (0.0426 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.24% (0.0417 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0418 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.23% (0.0436 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.68% (0.0438 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.23% (0.0430 => 0.0429, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0431 => 0.0431, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0421 => 0.0421) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0421 => 0.0421, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.23% (0.0427 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0428 => 0.0428, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.46% (0.0439 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.23% (0.0441 => 0.0440, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.72% (0.0416 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.24% (0.0416 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.47% (0.0427 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0428 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.24% (0.0418 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0419 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.49% (0.0411 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.24% (0.0412 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.49% (0.0411 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.49% (0.0411 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.45% (0.0447 => 0.0445, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.22% (0.0448 => 0.0447, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.25% (0.0408 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0409 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.49% (0.0411 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0411 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.24% (0.0417 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0418 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.07% (1.2855 => 1.2864, std.dev.: 0.0068) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.09% (8.2048 => 8.1976, std.dev.: 0.0122) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.01% (0.7723 => 0.7722, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.28% (0.0362 => 0.0361, std.dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1429 => 0.1430) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: - (0.1658 => 0.1658, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.42% (0.2190 => 0.2159, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.68% (63.2438 => 55.8560, std.dev.: 0.0246) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 1.16% (0.1639 => 0.1658, std.dev.: 0.0003) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 35.26% (14.1553 => 19.1461, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.82% (3.4629 => 5.7769, std.dev.: 0.0072) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13413.61% (0.0720 => 9.7298, std.dev.: 0.0129) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9973600.00% (0.0001 => 9.9737, std.dev.: 0.0006) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 62.02% (0.2554 => 0.4138, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: 51.95% (0.0256 => 0.0389, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 49.02% (10.3673 => 15.4497, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/factor: 41.55% (0.0296 => 0.0419, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 38.35% (0.1622 => 0.2244, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 36.17% (0.1056 => 0.1438, std.dev.: 0.0001) SingleSource/UnitTests/vla: 29.01% (0.0355 => 0.0458, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 22.18% (0.0834 => 0.1019, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 19.27% (0.1432 => 0.1708, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.33% (7.0540 => 8.3472, std.dev.: 0.0162) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.83% (2.2022 => 2.5949, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.11% (0.0871 => 0.1020, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.05% (0.1566 => 0.1833, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 16.69% (0.5105 => 0.5957, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 16.60% (0.6675 => 0.7783, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 15.58% (3.3354 => 3.8551, std.dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: 15.44% (10.4361 => 12.0470, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.39% (1.3050 => 1.5058, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/chomp: 15.17% (0.1655 => 0.1906, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 14.44% (0.3282 => 0.3756, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.44% (0.5020 => 0.5745, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 14.35% (0.2271 => 0.2597, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 14.14% (9.4845 => 10.8257, std.dev.: 0.0044) MultiSource/Applications/minisat/minisat: 14.13% (0.7115 => 0.8120, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 14.03% (0.1440 => 0.1642, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.01% (1.5415 => 1.7574, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.78% (0.0798 => 0.0908, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.51% (1.7609 => 1.9988, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.44% (0.1510 => 0.1713, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 13.19% (0.1584 => 0.1793, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 13.12% (0.3109 => 0.3517, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 12.97% (0.3423 => 0.3867, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 12.80% (0.1695 => 0.1912, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.76% (4.2646 => 4.8087, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.57% (0.4615 => 0.5195, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.40% (0.1032 => 0.1160, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.38% (0.1236 => 0.1389, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/matrix: 12.35% (0.0818 => 0.0919, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 12.34% (0.1175 => 0.1320, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 12.16% (0.6450 => 0.7234, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/mst/mst: 12.12% (0.1163 => 0.1304, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 12.09% (5.7591 => 6.4553, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.04% (0.1695 => 0.1899, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 11.98% (8.1363 => 9.1109, std.dev.: 0.0094) MultiSource/Applications/viterbi/viterbi: 11.96% (0.1555 => 0.1741, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 11.89% (0.1463 => 0.1637, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 11.88% (1.1840 => 1.3246, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 11.85% (1.1642 => 1.3022, std.dev.: 0.0084) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 11.85% (0.0886 => 0.0991, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 11.84% (1.0722 => 1.1991, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 11.81% (0.3387 => 0.3787, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 11.76% (2.0273 => 2.2657, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.70% (0.2700 => 0.3016, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.68% (0.1438 => 0.1606, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 11.67% (0.1337 => 0.1493, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.66% (0.3543 => 0.3956, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.62% (0.5860 => 0.6541, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.58% (0.3307 => 0.3690, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/life/life: 11.58% (0.0933 => 0.1041, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.57% (0.9765 => 1.0895, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 11.57% (3.8723 => 4.3203, std.dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.56% (7.9617 => 8.8824, std.dev.: 0.0085) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.55% (0.1940 => 0.2164, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 11.53% (0.7433 => 0.8290, std.dev.: 0.0041) MultiSource/Applications/aha/aha: 11.47% (0.1151 => 0.1283, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.38% (0.1625 => 0.1810, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.37% (4.9449 => 5.5072, std.dev.: 0.0080) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.30% (0.0929 => 0.1034, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.28% (5.0018 => 5.5662, std.dev.: 0.0021) SingleSource/UnitTests/SignlessTypes/rem: 11.19% (0.1144 => 0.1272, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.11% (0.2107 => 0.2341, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 11.10% (0.7835 => 0.8705, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.03% (1.1861 => 1.3169, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 11.00% (0.3473 => 0.3855, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.99% (0.4879 => 0.5415, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.99% (0.3177 => 0.3526, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.98% (0.1330 => 0.1476, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 10.92% (0.3543 => 0.3930, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.92% (1.5859 => 1.7591, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 10.90% (0.8921 => 0.9893, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.81% (0.1906 => 0.2112, std.dev.: 0.0040) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.80% (0.3121 => 0.3458, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.78% (0.8067 => 0.8937, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 10.76% (0.3561 => 0.3944, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 10.75% (0.3497 => 0.3873, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.74% (0.1117 => 0.1237, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.72% (0.3516 => 0.3893, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 10.72% (0.3927 => 0.4348, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 10.69% (0.3694 => 0.4089, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.67% (0.1125 => 0.1245, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.66% (0.2758 => 0.3052, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.59% (0.1029 => 0.1138, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 10.58% (0.4299 => 0.4754, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.56% (0.8172 => 0.9035, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: 10.53% (0.6456 => 0.7136, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/exceptions: 10.53% (0.3828 => 0.4231, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 10.40% (0.3886 => 0.4290, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.34% (0.5569 => 0.6145, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.32% (1.4186 => 1.5650, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.30% (2.2024 => 2.4292, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.26% (0.1062 => 0.1171, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.93% (0.2266 => 0.2491, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 9.81% (1.5603 => 1.7134, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/ReedSolomon: 9.81% (0.2049 => 0.2250, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 9.76% (0.4620 => 0.5071, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 9.68% (0.2603 => 0.2855, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 9.50% (21.9371 => 24.0204, std.dev.: 0.0159) MultiSource/Applications/siod/siod: 9.47% (2.2969 => 2.5145, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash: 9.44% (0.4289 => 0.4694, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/09-vor/vor: 9.43% (0.3180 => 0.3480, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.39% (0.2065 => 0.2259, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/health/health: 9.38% (0.1268 => 0.1387, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.36% (0.3826 => 0.4184, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.24% (0.3441 => 0.3759, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.83% (0.4203 => 0.4574, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 8.80% (0.3422 => 0.3723, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.75% (0.3865 => 0.4203, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 8.56% (0.6030 => 0.6546, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.53% (0.5981 => 0.6491, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.47% (0.5925 => 0.6427, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 8.35% (0.4048 => 0.4386, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 8.33% (0.3684 => 0.3991, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.24% (0.4636 => 0.5018, std.dev.: 0.0072) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.19% (0.1892 => 0.2047, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.19% (0.4103 => 0.4439, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 7.90% (0.7326 => 0.7905, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.85% (0.3427 => 0.3696, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 7.65% (17.1811 => 18.4953, std.dev.: 0.0224) SingleSource/Benchmarks/Shootout-C++/sieve: 7.63% (0.3603 => 0.3878, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.56% (0.3650 => 0.3926, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.43% (0.3162 => 0.3397, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.31% (0.4064 => 0.4361, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.11% (0.3136 => 0.3359, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.11% (0.8101 => 0.8677, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.04% (14.3668 => 15.3776, std.dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.95% (3.8922 => 4.1629, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/bh/bh: 6.89% (0.3092 => 0.3305, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.84% (0.3098 => 0.3310, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.71% (0.2831 => 0.3021, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 6.68% (0.2905 => 0.3099, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.64% (0.2891 => 0.3083, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 6.62% (0.3232 => 0.3446, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.55% (0.3283 => 0.3498, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.51% (2.0665 => 2.2011, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.44% (0.2793 => 0.2973, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.41% (0.2872 => 0.3056, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.26% (0.2877 => 0.3057, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.24% (0.2756 => 0.2928, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 6.23% (0.2871 => 0.3050, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.09% (0.2725 => 0.2891, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 6.07% (0.3379 => 0.3584, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.03% (0.3052 => 0.3236, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 5.96% (0.2802 => 0.2969, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 5.86% (0.2714 => 0.2873, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 5.60% (1.2842 => 1.3561, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 5.43% (0.3131 => 0.3301, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.39% (0.2430 => 0.2561, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.14% (0.3817 => 0.3937, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.95% (1.1194 => 1.1524, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.62% (0.3935 => 0.4038, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.60% (1.1145 => 1.2995, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 10.40% (0.9957 => 1.0993, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/richards_benchmark: 9.86% (1.1396 => 1.2520, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3692, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 5.59% (1.9405 => 2.0489, std.dev.: 0.0005) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.82% (4.2280 => 4.3473, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.92% (3.6395 => 3.7092, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/bisort/bisort: 1.82% (0.8333 => 0.8485, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2079, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.35% (2.6546 => 2.6904, std.dev.: 0.0038) MultiSource/Benchmarks/nbench/nbench: 1.13% (11.6436 => 11.7751, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.12% (6.5088 => 6.5816, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1313, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -79.98% (0.8651 => 0.1732, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.07% (5.2763 => 3.2677, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.47% (5.3855 => 3.6909, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.97% (5.3526 => 3.6951, std.dev.: 0.0038) SingleSource/UnitTests/Vector/constpool: -14.61% (54.1659 => 46.2502, std.dev.: 0.0096) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.35% (2.9384 => 2.6342, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -7.45% (22.1758 => 20.5237, std.dev.: 0.0188) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.11% (8.0499 => 3.7744, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7652, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -16.42% (1.6925 => 1.4146, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.94% (1.2373 => 1.0896, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3453 => 2.9599, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -10.54% (1.5373 => 1.3753, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.26% (19.9488 => 18.3019, std.dev.: 0.0141) MultiSource/Benchmarks/FreeBench/mason/mason: -7.77% (0.2161 => 0.1993, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.07% (1.8329 => 1.7034, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.55% (1.6805 => 1.5873, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.65% (1.5835 => 1.5098, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.32% (8.1563 => 7.8042, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8775, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.36% (3.2827 => 3.1723, std.dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5062, std.dev.: 0.0041) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.72% (0.4808 => 0.4677, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.81% (10.2830 => 10.0973, std.dev.: 0.0169) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6791, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: -1.70% (4.6441 => 4.5650, std.dev.: 0.0019) SingleSource/UnitTests/Vector/multiplies: -1.66% (2.5528 => 2.5104, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4214, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2879, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.09% (6.2999 => 6.2310, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8581, std.dev.: 0.0049) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 16.81% (0.5229 => 0.6108, std.dev.: 0.0053) MultiSource/Applications/SPASS/SPASS: 14.40% (14.9895 => 17.1485, std.dev.: 0.0195) MultiSource/Benchmarks/MallocBench/gs/gs: 9.50% (4.1105 => 4.5010, std.dev.: 0.0140) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 16.44% (1.1048 => 1.2864, std.dev.: 0.0068) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.52% (7.1582 => 8.1976, std.dev.: 0.0122) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.11% (0.6222 => 0.7722, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 36000.00% (0.0001 => 0.0361, std.dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: -3.70% (0.1485 => 0.1430) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.03% (0.2116 => 0.2159, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 18 14:03:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 18 Oct 2012 16:03:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121018210355.949FD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4975?compare_to=4972&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4975, Order: 166207, Start Time: 2012-10-18 19:41:07, End Time: 2012-10-18 21:06:52 To: 4972, Order: 166188, Start Time: 2012-10-18 17:45:55, End Time: 2012-10-18 19:11:47 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (191 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1041 (674 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.25% (80.2501 => 81.2498, std.dev.: 0.1951) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.86% (2.0176 => 2.4989, std.dev.: 0.0130) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.16% (0.1410 => 0.1666, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 17.68% (0.0826 => 0.0972, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 16.54% (0.2243 => 0.2614, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 14.41% (0.1013 => 0.1159, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.67% (0.0834 => 0.0948, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.38% (0.1413 => 0.1602, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 13.19% (1.3693 => 1.5499, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.19% (0.0819 => 0.0927, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 13.05% (0.2721 => 0.3076, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 12.82% (0.4328 => 0.4883, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.66% (0.1327 => 0.1495, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.66% (0.1588 => 0.1789, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.65% (3.9660 => 4.4678, std.dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 12.63% (0.7038 => 0.7927, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.43% (1.4563 => 1.6373, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.38% (0.5265 => 0.5917, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.34% (0.0964 => 0.1083, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.33% (0.2596 => 0.2916, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.30% (0.6283 => 0.7056, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 12.25% (13.8202 => 15.5127, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash: 12.21% (0.4062 => 0.4558, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.95% (0.7710 => 0.8631, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.90% (0.9199 => 1.0294, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.87% (1.2193 => 1.3640, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 11.84% (0.5818 => 0.6507, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.75% (0.6959 => 0.7777, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.71% (1.1364 => 1.2695, std.dev.: 0.0099) MultiSource/Benchmarks/Olden/power/power: 11.67% (0.1003 => 0.1120, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.49% (0.3899 => 0.4347, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 11.47% (0.7061 => 0.7871, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.44% (0.3130 => 0.3488, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.40% (0.4791 => 0.5337, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: 11.40% (0.5748 => 0.6403, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 11.30% (0.1062 => 0.1182, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 11.29% (0.2781 => 0.3095, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 11.28% (1.0313 => 1.1476, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.22% (0.3485 => 0.3876, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.12% (0.5577 => 0.6197, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.03% (0.4390 => 0.4874, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.01% (0.4016 => 0.4458, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 10.99% (0.3293 => 0.3655, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.97% (0.3756 => 0.4168, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 10.95% (1.1061 => 1.2272, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.79% (0.1075 => 0.1191, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.75% (0.2782 => 0.3081, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 10.73% (0.3868 => 0.4283, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.72% (0.3489 => 0.3863, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.72% (0.1157 => 0.1281, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 10.71% (0.3220 => 0.3565, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.69% (0.3022 => 0.3345, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 10.63% (0.3453 => 0.3820, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 10.62% (0.6744 => 0.7460, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 10.60% (0.2726 => 0.3015, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.55% (0.0976 => 0.1079) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.52% (0.2966 => 0.3278, std.dev.: 0.0036) MultiSource/Applications/sgefa/sgefa: 10.45% (0.2995 => 0.3308, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.42% (0.1276 => 0.1409, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.42% (0.8698 => 0.9604, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary3: 10.42% (0.3149 => 0.3477, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 10.40% (3.1889 => 3.5207, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.40% (1.9828 => 2.1891, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.38% (0.3246 => 0.3583, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 10.36% (0.3107 => 0.3429, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 10.36% (0.2760 => 0.3046, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hello: 10.36% (0.2607 => 0.2877, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.35% (0.1072 => 0.1183, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 10.35% (0.1111 => 0.1226, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.34% (0.7460 => 0.8231, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: 10.32% (0.2761 => 0.3046, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.32% (0.4379 => 0.4831, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 10.32% (0.1589 => 0.1753, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.30% (0.2127 => 0.2346, std.dev.: 0.0030) MultiSource/Applications/viterbi/viterbi: 10.28% (0.1478 => 0.1630, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.28% (0.3580 => 0.3948, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.24% (0.2655 => 0.2927, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 10.24% (16.6129 => 18.3144, std.dev.: 0.0247) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.24% (0.0977 => 0.1077, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 10.22% (0.2690 => 0.2965, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 10.22% (0.3534 => 0.3895, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.20% (0.2765 => 0.3047, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.13% (0.1569 => 0.1728, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.12% (0.1986 => 0.2187, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 10.11% (0.2937 => 0.3234, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 10.10% (3.8646 => 4.2549, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.08% (0.5637 => 0.6205, std.dev.: 0.0016) MultiSource/Applications/spiff/spiff: 10.03% (0.7506 => 0.8259, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 10.03% (1.9270 => 2.1203, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: 10.03% (0.3192 => 0.3512, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.02% (0.2914 => 0.3206, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 10.01% (0.2628 => 0.2891, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 9.96% (0.8310 => 0.9138, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.96% (0.1014 => 0.1115, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.88% (7.2180 => 7.9313, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.84% (0.6576 => 0.7223, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 9.81% (2.1791 => 2.3929, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.79% (4.9865 => 5.4745, std.dev.: 0.0269) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.76% (0.2696 => 0.2959, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.74% (0.2023 => 0.2220, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 9.64% (0.2988 => 0.3276, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 9.63% (1.0594 => 1.1614, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.59% (0.3755 => 0.4115, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.49% (0.1865 => 0.2042, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.48% (0.1435 => 0.1571, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 9.47% (0.2925 => 0.3202, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: 9.24% (0.2945 => 0.3217, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 9.19% (1.2749 => 1.3920, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.04% (1.3245 => 1.4442, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.01% (3.6692 => 3.9999, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/em3d/em3d: 8.99% (0.1657 => 0.1806, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 8.97% (0.3131 => 0.3412, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 8.88% (14.8535 => 16.1729, std.dev.: 0.0217) MultiSource/Applications/oggenc/oggenc: 8.88% (4.6629 => 5.0768, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.77% (4.4433 => 4.8329, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.76% (4.3801 => 4.7640, std.dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: 8.69% (8.4961 => 9.2345, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 8.56% (0.6250 => 0.6785, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.55% (0.2140 => 0.2323, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.54% (0.8818 => 0.9571, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.40% (0.3511 => 0.3806, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.31% (0.6135 => 0.6645, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.28% (1.5188 => 1.6445, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.22% (0.1789 => 0.1936, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 8.02% (0.4113 => 0.4443, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.94% (3.2742 => 3.5341, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.93% (0.4805 => 0.5186, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.86% (0.3245 => 0.3500, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 7.85% (3.7467 => 4.0409, std.dev.: 0.0119) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.84% (1.1333 => 1.2222, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.81% (0.1819 => 0.1961, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 7.80% (0.1385 => 0.1493, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.77% (0.9108 => 0.9816, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.73% (2.1007 => 2.2630, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/parameter-passing: 7.59% (0.4003 => 0.4307, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 7.57% (6.5754 => 7.0732, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.54% (0.2321 => 0.2496, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 7.52% (0.2008 => 0.2159, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.46% (0.3914 => 0.4206, std.dev.: 0.0080) MultiSource/Applications/hexxagon/hexxagon: 7.32% (1.2292 => 1.3192, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.27% (0.2504 => 0.2686, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.24% (0.3578 => 0.3837, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.18% (0.3940 => 0.4223, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 7.16% (0.3646 => 0.3907, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.13% (0.3789 => 0.4059, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.11% (0.3601 => 0.3857, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.04% (0.3663 => 0.3921, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.04% (0.3650 => 0.3907, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.00% (13.2842 => 14.2140, std.dev.: 0.0149) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.00% (6.2785 => 6.7179, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-3: 6.96% (0.3623 => 0.3875, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 5.80% (0.1777 => 0.1880, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 5.62% (16.2614 => 17.1745, std.dev.: 0.0291) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.35% (0.2243 => 0.2363, std.dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 4.61% (14.5298 => 15.1998, std.dev.: 0.0065) MultiSource/Benchmarks/Bullet/bullet: 1.92% (33.2944 => 33.9352, std.dev.: 0.0118) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5185, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fbench: 24.83% (1.8175 => 2.2688, std.dev.: 0.0117) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.10% (1.0895 => 1.2758, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 11.08% (1.1560 => 1.2841, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 8.47% (0.1322 => 0.1434, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (3.1736 => 3.4149, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.42% (0.9692 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 5.35% (1.2998 => 1.3693, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.02% (0.2093 => 0.2198, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.88% (2.8606 => 3.0002, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0044, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 4.48% (0.5449 => 0.5693) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.89% (1.7081 => 1.7746, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.72% (11.2619 => 11.6808, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.38% (12.0921 => 12.5010, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: 3.36% (1.9199 => 1.9844, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 3.24% (10.7476 => 11.0958, std.dev.: 0.0374) MultiSource/Benchmarks/Olden/bisort/bisort: 2.93% (0.8239 => 0.8480, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/salsa20: 2.25% (7.4271 => 7.5940, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.76% (1.4298 => 1.4550, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5130, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2122, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1864, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5781, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists: 1.10% (12.4560 => 12.5934, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1407, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: 1.00% (2.1753 => 2.1971, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.97% (0.2670 => 0.1416, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.91% (0.4657 => 0.3916, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.18% (1.3819 => 1.1997, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.18% (1.3813 => 1.1993, std.dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.28% (1.0460 => 0.8548, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -12.69% (0.2238 => 0.1954, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.08% (20.3410 => 18.2898, std.dev.: 0.0097) SingleSource/Benchmarks/McGill/chomp: -6.32% (1.2308 => 1.1530, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.19% (1.3780 => 1.2927, std.dev.: 0.0110) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8098, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.98% (0.9996 => 0.9598, std.dev.: 0.0051) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.82% (1.7688 => 1.7012, std.dev.: 0.0060) MultiSource/Applications/siod/siod: -3.28% (3.2729 => 3.1656, std.dev.: 0.0041) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.83% (3.0263 => 2.9408, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8812, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.39% (1.9762 => 1.9290, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.98% (0.8342 => 0.8177, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -1.95% (26.5159 => 25.9993, std.dev.: 0.0176) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.90% (0.6589 => 0.6464, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.86% (0.6615 => 0.6492, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.80% (6.3560 => 6.2415, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.63% (2.5254 => 2.4842, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0068, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -1.29% (5.3167 => 5.2479, std.dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: -1.19% (28.2225 => 27.8867, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/heapsort: -1.14% (3.9173 => 3.8727, std.dev.: 0.0138) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1139, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.05% (6.6320 => 6.5623, std.dev.: 0.0087) MultiSource/Benchmarks/PAQ8p/paq8p: -1.04% (84.4286 => 83.5475, std.dev.: 0.0005) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 18 14:46:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 18 Oct 2012 16:46:00 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121018214600.624042A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4976?compare_to=4973&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 4976, Order: 166216, Start Time: 2012-10-18 20:24:22, End Time: 2012-10-18 21:48:00 To: 4973, Order: 166199, Start Time: 2012-10-18 18:42:55, End Time: 2012-10-18 20:07:14 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 9 (14 on baseline) Performance Improvements: 9 (5 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 957 (955 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 9.71% (3.7688 => 4.1347, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 6.32% (62.9407 => 66.9211, std.dev.: 0.0705) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.42% (0.7511 => 0.7843, std.dev.: 0.0055) MultiSource/Applications/siod/siod: 3.41% (3.6461 => 3.7703, std.dev.: 0.0175) MultiSource/Benchmarks/Prolangs-C++/life/life: 2.38% (2.5775 => 2.6388, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/ReedSolomon: 2.18% (8.5321 => 8.7183, std.dev.: 0.0282) SingleSource/Benchmarks/Shootout-C++/hash: 2.14% (0.6201 => 0.6334, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: 2.08% (2.3531 => 2.4020, std.dev.: 0.0080) MultiSource/Applications/SIBsim4/SIBsim4: 1.30% (3.1842 => 3.2256, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.33% (0.4947 => 0.4733, std.dev.: 0.0062) MultiSource/Applications/spiff/spiff: -2.28% (0.8055 => 0.7871, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -2.04% (0.8231 => 0.8063, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.38% (1.4605 => 1.4403, std.dev.: 0.0041) MultiSource/Benchmarks/Bullet/bullet: -1.32% (32.3001 => 31.8737, std.dev.: 0.1246) MultiSource/Applications/hbd/hbd: -1.07% (1.4416 => 1.4262, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -4.70% (29.7551 => 28.3576, std.dev.: 0.1074) SingleSource/Benchmarks/Shootout-C++/hash2: -1.67% (3.4293 => 3.3719, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.19% (3.3471 => 3.3072, std.dev.: 0.0017) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.63% (16.4298 => 16.3269, std.dev.: 0.1531) MultiSource/Applications/obsequi/Obsequi: -1.11% (1.0422 => 1.0306, std.dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: 1.19% (0.6315 => 0.6390, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/08-main/main: -6.86% (0.1850 => 0.1723, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.69% (0.1633 => 0.1589, std.dev.: 0.0060) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.13% (0.3174 => 0.3178, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.57% (0.2461 => 0.2447, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.06% (0.3302 => 0.3267, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.81% (0.2353 => 0.2334, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: -0.37% (0.5954 => 0.5932, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel: 7.05% (0.0397 => 0.0425, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -1.03% (0.3288 => 0.3254, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/strcat: 0.20% (0.1960 => 0.1964, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -20.09% (0.0224 => 0.0179, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0206 => 0.0206, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.21% (0.0414 => 0.0409, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.26% (0.0318 => 0.0314, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.33% (0.0300 => 0.0299, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.97% (0.0411 => 0.0407, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0190 => 0.0190, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0204 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -0.95% (0.0315 => 0.0312, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -69.23% (0.0013 => 0.0004, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 1.17% (0.1457 => 0.1474, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.69% (1.1298 => 1.1376, std.dev.: 0.0175) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -6.83% (0.1551 => 0.1445, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.32% (0.4211 => 0.4071, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.15% (0.1421 => 0.1362, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 17.38% (0.0587 => 0.0689, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 45.79% (0.0190 => 0.0277, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.36% (0.0557 => 0.0555, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.17% (1.1435 => 1.1415, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.32% (0.0629 => 0.0631, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0267 => 0.0267, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.10% (0.8014 => 0.7926, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 27.40% (0.0073 => 0.0093, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.99% (2.1832 => 1.6595, std.dev.: 0.0026) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.04% (0.6287 => 0.6415, std.dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 59.22% (1.5795 => 2.5149, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.30% (0.3186 => 0.3514, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.34% (1.1857 => 1.2846, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 5.92% (63.1822 => 66.9211, std.dev.: 0.0705) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.51% (3.9188 => 4.1347, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.46% (0.2887 => 0.2987, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.24% (0.7597 => 0.7843, std.dev.: 0.0055) MultiSource/Applications/siod/siod: 2.89% (3.6643 => 3.7703, std.dev.: 0.0175) SingleSource/Benchmarks/Misc/ReedSolomon: 2.18% (8.5322 => 8.7183, std.dev.: 0.0282) SingleSource/Benchmarks/Shootout-C++/hash: 2.08% (0.6205 => 0.6334, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: 1.95% (2.3560 => 2.4020, std.dev.: 0.0080) MultiSource/Applications/SIBsim4/SIBsim4: 1.20% (3.1873 => 3.2256, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.19% (1.5941 => 1.6130, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.68% (0.3269 => 0.3018, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -4.95% (29.8330 => 28.3576, std.dev.: 0.1074) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.59% (1.0388 => 1.0223, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash2: -1.51% (3.4237 => 3.3719, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.22% (3.3479 => 3.3072, std.dev.: 0.0017) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.72% (16.4461 => 16.3269, std.dev.: 0.1531) MultiSource/Applications/obsequi/Obsequi: 0.43% (1.0262 => 1.0306, std.dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: 0.92% (0.6332 => 0.6390, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/08-main/main: -5.90% (0.1831 => 0.1723, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.92% (0.1559 => 0.1589, std.dev.: 0.0060) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.76% (0.3123 => 0.3178, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.65% (0.2463 => 0.2447, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.30% (0.3344 => 0.3267, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.27% (0.2364 => 0.2334, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: -1.30% (0.6010 => 0.5932, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel: -0.93% (0.0429 => 0.0425, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.37% (0.3266 => 0.3254, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/strcat: -0.25% (0.1969 => 0.1964, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -20.09% (0.0224 => 0.0179, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 67.48% (0.0123 => 0.0206, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.25% (0.0408 => 0.0409, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 23.62% (0.0254 => 0.0314, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.99% (0.0302 => 0.0299, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 5.99% (0.0384 => 0.0407, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0190 => 0.0190, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 13.33% (0.0180 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: 35.65% (0.0230 => 0.0312, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -42.86% (0.0007 => 0.0004, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 2.50% (0.1438 => 0.1474, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.41% (1.1329 => 1.1376, std.dev.: 0.0175) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -1.16% (0.1462 => 0.1445, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.23% (0.4164 => 0.4071, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.51% (0.1369 => 0.1362, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.49% (0.0641 => 0.0689, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.98% (0.0578 => 0.0555, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.19% (1.1437 => 1.1415, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.64% (0.0627 => 0.0631, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.33% (0.0180 => 0.0267, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.14% (0.8017 => 0.7926, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 50.00% (0.0062 => 0.0093, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 18 15:32:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 18 Oct 2012 17:32:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121018223214.67DAC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4977?compare_to=4974&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4977, Order: 166223, Start Time: 2012-10-18 21:13:51, End Time: 2012-10-18 22:34:07 To: 4974, Order: 166206, Start Time: 2012-10-18 19:23:56, End Time: 2012-10-18 20:44:15 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (75 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 17 (186 on baseline) Performance Improvements: 2 (44 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 90 (15 on baseline) Unchanged Tests: 933 (656 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.43% (0.9035 => 0.9345, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.39% (0.6491 => 0.6711, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.81% (0.8677 => 0.8921, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.36% (3.6909 => 3.7780, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.34% (3.6951 => 3.7815, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.15% (2.5949 => 2.6506, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 1.98% (0.8705 => 0.8877, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.78% (1.0895 => 1.1089, std.dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: 1.77% (15.4497 => 15.7226, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.65% (8.3472 => 8.4853, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.61% (0.8937 => 0.9081, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: 1.41% (1.3022 => 1.3205, std.dev.: 0.0030) MultiSource/Applications/hbd/hbd: 1.30% (1.7134 => 1.7356, std.dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 16.48% (5.4026 => 6.2927, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.25% (1.0238 => 1.0571, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 1.30% (3.7111 => 3.7593, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.09% (55.5304 => 56.1379, std.dev.: 0.1791) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -1.42% (12.0470 => 11.8757, std.dev.: 0.0070) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.17% (1.5244 => 1.5065, std.dev.: 0.0061) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.97% (0.6108 => 0.6167, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 0.08% (17.1485 => 17.1624, std.dev.: 0.0069) MultiSource/Benchmarks/Bullet/bullet: 0.77% (55.8560 => 56.2851, std.dev.: 0.0112) MultiSource/Benchmarks/MallocBench/gs/gs: 1.27% (4.5010 => 4.5583, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.88% (0.0464 => 0.0482, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 3.63% (0.0468 => 0.0485, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 3.91% (0.0435 => 0.0452, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 3.90% (0.0436 => 0.0453, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 4.48% (0.0424 => 0.0443, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 4.00% (0.0425 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.33% (0.0416 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 4.07% (0.0418 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 3.91% (0.0435 => 0.0452, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 4.37% (0.0435 => 0.0454, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 4.20% (0.0429 => 0.0447, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.71% (0.0431 => 0.0447, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.80% (0.0421 => 0.0437, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.80% (0.0421 => 0.0437, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 4.23% (0.0426 => 0.0444, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.97% (0.0428 => 0.0445, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.12% (0.0437 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.86% (0.0440 => 0.0457) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 4.60% (0.0413 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 4.10% (0.0415 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 4.47% (0.0425 => 0.0444, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.97% (0.0428 => 0.0445, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.56% (0.0417 => 0.0436, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.30% (0.0419 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.65% (0.0409 => 0.0428) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 4.14% (0.0411 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 4.65% (0.0409 => 0.0428) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 4.40% (0.0409 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 4.04% (0.0445 => 0.0463, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 3.80% (0.0447 => 0.0464, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.42% (0.0407 => 0.0425, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 4.40% (0.0409 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.65% (0.0409 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.38% (0.0411 => 0.0429) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 4.33% (0.0416 => 0.0434, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.31% (0.0418 => 0.0436) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.17% (1.2864 => 1.3015, std.dev.: 0.0063) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.03% (8.1976 => 8.1948, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.09% (0.7722 => 0.7729, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -1.11% (0.0361 => 0.0357, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1430 => 0.1429, std.dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -0.60% (0.1658 => 0.1648, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.53% (0.2159 => 0.2126, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.00% (63.2438 => 56.2851, std.dev.: 0.0112) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 0.55% (0.1639 => 0.1648, std.dev.: 0.0000) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 35.29% (14.1553 => 19.1503, std.dev.: 0.0207) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.35% (3.4629 => 5.7606, std.dev.: 0.0104) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13407.36% (0.0720 => 9.7253, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050200.00% (0.0001 => 10.0503, std.dev.: 0.0012) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.35% (0.2554 => 0.4172, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/lowercase: 55.08% (0.0256 => 0.0397) MultiSource/Benchmarks/PAQ8p/paq8p: 51.66% (10.3673 => 15.7226, std.dev.: 0.0072) SingleSource/UnitTests/SignlessTypes/factor: 44.26% (0.0296 => 0.0427, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 39.58% (0.1622 => 0.2264, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 36.36% (0.1056 => 0.1440, std.dev.: 0.0002) SingleSource/UnitTests/vla: 31.55% (0.0355 => 0.0467, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 23.74% (0.0834 => 0.1032, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 20.36% (2.2022 => 2.6506, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.29% (7.0540 => 8.4853, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 19.90% (0.1432 => 0.1717, std.dev.: 0.0027) MultiSource/Benchmarks/Fhourstones/fhourstones: 19.41% (0.1566 => 0.1870, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.80% (0.0871 => 0.1026, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 16.94% (0.5105 => 0.5970, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 16.63% (0.6675 => 0.7785, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 15.95% (0.1655 => 0.1919, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 15.90% (0.3282 => 0.3804, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 15.90% (0.2271 => 0.2632, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.89% (1.3050 => 1.5123, std.dev.: 0.0013) MultiSource/Applications/d/make_dparser: 15.66% (3.3354 => 3.8576, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/power/power: 15.42% (0.1440 => 0.1662, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 15.06% (0.1175 => 0.1352, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 14.99% (0.1695 => 0.1949, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.96% (0.1337 => 0.1537, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/mst/mst: 14.79% (0.1163 => 0.1335, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.52% (0.5020 => 0.5749, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 14.49% (9.4845 => 10.8584, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.47% (1.5415 => 1.7646, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 14.39% (0.7115 => 0.8139, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.37% (0.1510 => 0.1727, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 14.35% (0.8172 => 0.9345, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.34% (0.0746 => 0.0853, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.24% (1.7609 => 2.0116, std.dev.: 0.0014) MultiSource/Applications/viterbi/viterbi: 14.21% (0.1555 => 0.1776, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 14.18% (0.3109 => 0.3550, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 14.12% (0.0793 => 0.0905, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.11% (0.0886 => 0.1011, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.08% (0.4615 => 0.5265, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 13.94% (0.3423 => 0.3900, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 13.89% (0.1584 => 0.1804, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 13.79% (10.4361 => 11.8757, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.75% (0.2065 => 0.2349, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/matrix: 13.69% (0.0818 => 0.0930, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.66% (0.0842 => 0.0957, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 13.61% (0.1940 => 0.2204, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.56% (0.9765 => 1.1089, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.44% (4.2646 => 4.8376, std.dev.: 0.0099) MultiSource/Applications/Burg/burg: 13.43% (1.1642 => 1.3205, std.dev.: 0.0030) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.39% (0.3121 => 0.3539, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.34% (0.2107 => 0.2388, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 13.30% (0.7835 => 0.8877, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.28% (0.1438 => 0.1629, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.22% (0.1906 => 0.2158, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.19% (0.1236 => 0.1399) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.16% (0.1117 => 0.1264, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/exptree: 13.14% (0.0814 => 0.0921, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.12% (0.0770 => 0.0871, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.10% (8.1363 => 9.2018, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 13.05% (0.6450 => 0.7292, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 13.03% (0.1151 => 0.1301, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.00% (0.2700 => 0.3051, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.98% (0.1032 => 0.1166, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.94% (0.2758 => 0.3115, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.94% (0.5860 => 0.6618, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.75% (0.0933 => 0.1052, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 12.66% (5.7591 => 6.4883, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.63% (0.1029 => 0.1159, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.57% (0.8067 => 0.9081, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/neural/neural: 12.51% (0.1463 => 0.1646, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.48% (4.9449 => 5.5621, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 12.39% (2.0273 => 2.2785, std.dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 12.35% (0.7433 => 0.8351, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.35% (5.0018 => 5.6195, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.33% (0.1695 => 0.1904, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.24% (0.1062 => 0.1192, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 12.24% (0.4299 => 0.4825, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.22% (0.4879 => 0.5475, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.21% (0.5981 => 0.6711, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 12.11% (1.0722 => 1.2020, std.dev.: 0.0078) MultiSource/Applications/lua/lua: 12.09% (3.8723 => 4.3405, std.dev.: 0.0046) MultiSource/Benchmarks/sim/sim: 12.08% (0.3387 => 0.3796, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.06% (0.0929 => 0.1041, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.05% (7.9617 => 8.9209, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.82% (0.1625 => 0.1817, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.80% (0.3177 => 0.3552, std.dev.: 0.0030) SingleSource/UnitTests/SignlessTypes/rem: 11.80% (0.1144 => 0.1279, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.79% (0.3307 => 0.3697, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.73% (0.1330 => 0.1486, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 11.70% (1.1840 => 1.3225, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.68% (1.1861 => 1.3246, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/health/health: 11.67% (0.1268 => 0.1416, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.60% (0.5569 => 0.6215, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.47% (0.1125 => 0.1254, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 11.46% (0.8921 => 0.9943, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.30% (0.3441 => 0.3830, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.29% (0.3543 => 0.3943, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 11.24% (1.5603 => 1.7356, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 11.19% (1.4186 => 1.5774, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.01% (1.5859 => 1.7605, std.dev.: 0.0104) MultiSource/Benchmarks/McCat/09-vor/vor: 10.85% (0.3180 => 0.3525, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.84% (0.3543 => 0.3927, std.dev.: 0.0064) SingleSource/UnitTests/ObjC/synchronized: 10.81% (0.3561 => 0.3946, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.77% (0.3473 => 0.3847, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.75% (0.3694 => 0.4091, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.72% (0.3516 => 0.3893, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.70% (0.3927 => 0.4347, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 10.69% (0.3497 => 0.3871, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 10.63% (0.6456 => 0.7142, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 10.61% (0.3828 => 0.4234, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: 10.59% (0.2049 => 0.2266, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 10.59% (21.9371 => 24.2600, std.dev.: 0.0115) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.46% (0.2266 => 0.2503, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.40% (0.3886 => 0.4290, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.20% (2.2024 => 2.4270, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.14% (0.2603 => 0.2867, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.12% (0.8101 => 0.8921, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 9.95% (2.2969 => 2.5255, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash: 9.65% (0.4289 => 0.4703, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.62% (0.1892 => 0.2074, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 9.55% (0.4620 => 0.5061, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.23% (0.4636 => 0.5064, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.21% (0.3865 => 0.4221, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.20% (0.3826 => 0.4178, std.dev.: 0.0039) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.19% (0.1143 => 0.1248, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 9.03% (0.3422 => 0.3731, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.95% (0.4203 => 0.4579, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/lists1: 8.60% (0.3684 => 0.4001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 8.57% (0.4048 => 0.4395, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.55% (0.4103 => 0.4454, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.20% (0.3427 => 0.3708, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.08% (0.6030 => 0.6517, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 7.99% (0.3603 => 0.3891, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 7.97% (0.5925 => 0.6397, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 7.83% (0.3092 => 0.3334, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 7.74% (17.1811 => 18.5117, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.67% (14.3668 => 15.4683, std.dev.: 0.0113) SingleSource/UnitTests/ObjC++/property-reference: 7.59% (0.7326 => 0.7882, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.49% (0.2430 => 0.2612, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.48% (0.3650 => 0.3923, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.40% (0.2905 => 0.3120, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 7.20% (0.3098 => 0.3321, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.18% (0.3232 => 0.3464, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.17% (3.8922 => 4.1714, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.14% (0.4064 => 0.4354, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 7.10% (0.2831 => 0.3032, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.06% (0.2891 => 0.3095, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.98% (0.3283 => 0.3512, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.95% (0.3136 => 0.3354, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.94% (2.0665 => 2.2100, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 6.85% (0.2877 => 0.3074, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.83% (0.3162 => 0.3378, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.82% (0.2872 => 0.3068, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.77% (0.2793 => 0.2982, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 6.76% (0.2871 => 0.3065, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/wc: 6.65% (0.3052 => 0.3255, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.64% (0.2756 => 0.2939, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.61% (0.2725 => 0.2905, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 6.48% (0.3379 => 0.3598, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/random: 6.35% (0.2802 => 0.2980, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.34% (0.2714 => 0.2886, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 5.81% (1.2842 => 1.3588, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/objinst: 5.62% (0.3131 => 0.3307, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.12% (0.3817 => 0.3936, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.06% (1.1194 => 1.1536, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.59% (0.3935 => 0.4037, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.58% (1.1145 => 1.2993, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.78% (1.1396 => 1.2510, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 9.68% (0.9957 => 1.0921, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3683, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 5.53% (1.9405 => 2.0479, std.dev.: 0.0029) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.68% (4.2280 => 4.3414, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.06% (3.6395 => 3.7144, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/bisort/bisort: 1.85% (0.8333 => 0.8487, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.65% (2.6546 => 2.6983, std.dev.: 0.0013) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2077, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.01% (6.6874 => 0.1330, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -80.06% (0.8651 => 0.1725, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.90% (5.2763 => 3.2766, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -29.85% (5.3855 => 3.7780, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -29.35% (5.3526 => 3.7815, std.dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -14.68% (54.1659 => 46.2158, std.dev.: 0.0536) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -9.89% (2.9384 => 2.6479, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -7.07% (22.1758 => 20.6089, std.dev.: 0.0214) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.06% (8.0499 => 3.7787, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.40% (1.1492 => 0.7654, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.64% (1.6925 => 1.4278, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852) SingleSource/Benchmarks/McGill/chomp: -11.59% (1.2373 => 1.0939, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3453 => 2.9600, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -10.82% (1.5373 => 1.3710, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.46% (19.9488 => 18.2619, std.dev.: 0.0289) MultiSource/Benchmarks/FreeBench/mason/mason: -7.82% (0.2161 => 0.1992, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.06% (1.8329 => 1.7035, std.dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.58% (1.6805 => 1.5867, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.78% (1.5835 => 1.5078, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.35% (8.1563 => 7.8015, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.61% (3.2827 => 3.1641, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8776, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5080, std.dev.: 0.0058) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.72% (0.4808 => 0.4677, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -1.71% (10.2830 => 10.1072, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6835, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.68% (2.5528 => 2.5099, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4200, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/lists: -1.23% (6.2999 => 6.2221, std.dev.: 0.0080) MultiSource/Applications/sqlite3/sqlite3: -1.23% (4.6441 => 4.5871, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2878, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8591, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 17.94% (0.5229 => 0.6167, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 14.50% (14.9895 => 17.1624, std.dev.: 0.0069) MultiSource/Benchmarks/MallocBench/gs/gs: 10.89% (4.1105 => 4.5583, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.80% (1.1048 => 1.3015, std.dev.: 0.0063) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.48% (7.1582 => 8.1948, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.22% (0.6222 => 0.7729, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35600.00% (0.0001 => 0.0357, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.77% (0.1485 => 0.1429, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.47% (0.2116 => 0.2126, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 4.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 18 15:59:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 18 Oct 2012 17:59:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121018225932.17AC52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4978?compare_to=4975&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4978, Order: 166226, Start Time: 2012-10-18 21:36:15, End Time: 2012-10-18 23:02:28 To: 4975, Order: 166207, Start Time: 2012-10-18 19:41:07, End Time: 2012-10-18 21:06:52 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 16 (202 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1025 (662 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.87% (0.8631 => 0.8965, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.27% (0.6205 => 0.6408, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.83% (0.8231 => 0.8464, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.77% (1.0294 => 1.0476, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.68% (1.1997 => 1.2198, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.53% (1.1993 => 1.2177, std.dev.: 0.0060) MultiSource/Applications/spiff/spiff: 1.48% (0.8259 => 0.8381, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.34% (0.7777 => 0.7881, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 1.21% (4.2549 => 4.3063, std.dev.: 0.0040) MultiSource/Applications/hbd/hbd: 1.17% (1.5499 => 1.5680, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.08% (7.9313 => 8.0170, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.03% (3.9999 => 4.0409, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.78% (5.4169 => 6.2719, std.dev.: 0.0204) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.80% (54.4314 => 56.4983, std.dev.: 0.0486) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.03% (1.0238 => 1.0548, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 1.30% (3.6946 => 3.7428, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/Large/ray: -1.91% (4.0903 => 4.0121, std.dev.: 0.0017) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/vla: 33.64% (0.0324 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 23.97% (2.0176 => 2.5013, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.85% (0.1410 => 0.1704, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 18.64% (0.0826 => 0.0980, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 18.01% (0.2243 => 0.2647, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 17.28% (0.1013 => 0.1188, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.28% (0.7710 => 0.8965, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.09% (0.0746 => 0.0866, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 15.62% (0.0653 => 0.0755, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 15.62% (0.2721 => 0.3146, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.87% (0.0834 => 0.0958, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.60% (0.2596 => 0.2975, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 14.51% (1.3693 => 1.5680, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.21% (0.0725 => 0.0828, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.17% (0.0847 => 0.0967, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.15% (0.1413 => 0.1613, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 14.06% (0.1003 => 0.1144, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.93% (0.0811 => 0.0924, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.88% (0.9199 => 1.0476, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.73% (0.5265 => 0.5988, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.1588 => 0.1806, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.68% (0.5637 => 0.6408, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.65% (3.9660 => 4.5075, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.58% (0.1075 => 0.1221, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 13.46% (0.7460 => 0.8464, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.39% (0.1986 => 0.2252, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.28% (0.0964 => 0.1092) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.26% (0.1327 => 0.1503, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.25% (0.6959 => 0.7881, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 13.17% (0.4328 => 0.4898, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.17% (0.1276 => 0.1444) MultiSource/Benchmarks/Olden/mst/mst: 13.14% (0.1111 => 0.1257, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 13.04% (0.7038 => 0.7956, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 12.99% (0.1062 => 0.1200, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.97% (0.2914 => 0.3292, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.79% (0.0977 => 0.1102, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 12.72% (0.1478 => 0.1666, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.70% (0.0819 => 0.0923, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 12.56% (1.1061 => 1.2450, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.53% (0.6283 => 0.7070, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.52% (0.1014 => 0.1141, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 12.48% (0.4062 => 0.4569, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/distray/distray: 12.47% (0.0818 => 0.0920, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.44% (1.2193 => 1.3710, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 12.41% (13.8202 => 15.5349, std.dev.: 0.0174) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.39% (1.4563 => 1.6368, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.38% (1.1364 => 1.2771, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.35% (0.5577 => 0.6266, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.16% (0.2023 => 0.2269, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.10% (0.4379 => 0.4909, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.98% (0.3246 => 0.3635, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.85% (0.3899 => 0.4361, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.85% (0.2127 => 0.2379, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 11.79% (0.2995 => 0.3348, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.74% (0.1865 => 0.2084, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.66% (0.1072 => 0.1197, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 11.66% (0.7506 => 0.8381, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.58% (0.1157 => 0.1291, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 11.54% (0.2781 => 0.3102, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.54% (0.4791 => 0.5344, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.47% (0.3130 => 0.3489, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.45% (0.1048 => 0.1168) MultiSource/Benchmarks/MallocBench/gs/gs: 11.43% (3.8646 => 4.3063, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/em3d/em3d: 11.41% (0.1657 => 0.1846, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.39% (0.3485 => 0.3882, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 11.36% (0.3293 => 0.3667, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 11.30% (1.0313 => 1.1478, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.25% (0.2782 => 0.3095, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.18% (0.4016 => 0.4465, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 11.17% (0.5818 => 0.6468, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 11.16% (0.2761 => 0.3069, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 11.15% (0.2925 => 0.3251, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.14% (0.4390 => 0.4879, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 11.08% (0.5748 => 0.6385, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 11.08% (0.2726 => 0.3028, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.08% (0.3756 => 0.4172, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 11.07% (7.2180 => 8.0170, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/18-imp/imp: 11.02% (0.3220 => 0.3575, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 11.01% (0.3868 => 0.4294, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.99% (0.3022 => 0.3354, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.96% (0.1789 => 0.1985, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 10.95% (0.3453 => 0.3831, std.dev.: 0.0083) MultiSource/Applications/treecc/treecc: 10.93% (1.9270 => 2.1377, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.92% (0.3489 => 0.3870, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 10.88% (0.6744 => 0.7478, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 10.82% (0.1589 => 0.1761, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.81% (0.2655 => 0.2942, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 10.81% (0.7061 => 0.7824, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary: 10.78% (0.3107 => 0.3442, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 10.78% (0.2607 => 0.2888, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.77% (1.9828 => 2.1964, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/ary3: 10.77% (0.3149 => 0.3488, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 10.74% (0.2690 => 0.2979, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.70% (0.3580 => 0.3963, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 10.69% (0.2628 => 0.2909, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.66% (0.1435 => 0.1588, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 10.64% (0.3534 => 0.3910, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: 10.63% (0.1213 => 0.1342, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 10.62% (0.2760 => 0.3053, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 10.61% (3.1889 => 3.5272, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wc: 10.59% (0.2937 => 0.3248, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.58% (0.1569 => 0.1735, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.54% (0.8698 => 0.9615, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 10.53% (0.3192 => 0.3528, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.52% (0.2765 => 0.3056, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.52% (0.2966 => 0.3278, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 10.49% (0.8310 => 0.9182, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.31% (0.2696 => 0.2974, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 10.29% (16.6129 => 18.3220, std.dev.: 0.0212) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 10.13% (3.6692 => 4.0409, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/objinst: 10.12% (0.2945 => 0.3243, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.11% (1.3245 => 1.4584, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.09% (0.2140 => 0.2356, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.08% (0.1061 => 0.1168, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 10.07% (0.2988 => 0.3289, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 9.95% (2.1791 => 2.3960, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.83% (4.3801 => 4.8108, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.82% (0.6576 => 0.7222, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 9.82% (0.4113 => 0.4517, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.82% (4.4433 => 4.8795, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.80% (0.3755 => 0.4123, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.65% (4.9865 => 5.4676, std.dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.44% (0.6135 => 0.6714, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 9.41% (14.8535 => 16.2515, std.dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.40% (0.3511 => 0.3841, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.35% (0.2321 => 0.2538, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 9.34% (1.0594 => 1.1584, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 9.18% (1.2749 => 1.3919, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.15% (0.8818 => 0.9625, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 9.02% (8.4961 => 9.2625, std.dev.: 0.0027) MultiSource/Benchmarks/sim/sim: 9.01% (0.3131 => 0.3413, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 8.66% (0.1385 => 0.1505, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 8.66% (0.6250 => 0.6791, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.63% (1.5188 => 1.6499, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.53% (1.1333 => 1.2300, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.45% (0.9108 => 0.9878, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.30% (0.1819 => 0.1970, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 8.30% (3.7467 => 4.0577, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.29% (0.3245 => 0.3514, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.27% (3.2742 => 3.5450, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 8.17% (6.5754 => 7.1127, std.dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: 8.16% (4.6629 => 5.0433, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 8.12% (0.2008 => 0.2171, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.07% (0.4805 => 0.5193, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.98% (6.2785 => 6.7797, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.80% (2.1007 => 2.2645, std.dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 7.78% (1.2292 => 1.3248, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.67% (0.2504 => 0.2696, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 7.54% (0.4003 => 0.4305, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 7.54% (0.3914 => 0.4209, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/for-in: 7.47% (0.3789 => 0.4072, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-2: 7.39% (0.3601 => 0.3867, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.35% (0.3646 => 0.3914, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.35% (0.3578 => 0.3841, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.28% (0.3940 => 0.4227, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.27% (0.2243 => 0.2406, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.26% (0.3663 => 0.3929, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.12% (13.2842 => 14.2300, std.dev.: 0.0138) SingleSource/UnitTests/ObjC/exceptions-3: 7.07% (0.3623 => 0.3879, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.99% (0.3650 => 0.3905, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 6.36% (0.1777 => 0.1890, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: 5.43% (16.2614 => 17.1442, std.dev.: 0.0202) MultiSource/Applications/ClamAV/clamscan: 5.16% (14.5298 => 15.2792, std.dev.: 0.0075) MultiSource/Benchmarks/Olden/bh/bh: 3.92% (0.2859 => 0.2971, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 2.16% (33.2944 => 34.0137, std.dev.: 0.0119) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5180, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fbench: 24.04% (1.8175 => 2.2544, std.dev.: 0.0323) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.07% (1.0895 => 1.2755, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: 11.07% (1.1560 => 1.2840, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4141, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.43% (0.9692 => 1.0218) SingleSource/Benchmarks/Misc/mandel-2: 5.24% (1.2998 => 1.3679, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.76% (1.9144 => 2.0056, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.46% (2.8606 => 2.9882, std.dev.: 0.0019) SingleSource/Regression/C/uint64_to_float: 4.44% (0.5449 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7748, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9861, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 3.38% (10.7476 => 11.1104, std.dev.: 0.0638) MultiSource/Applications/hexxagon/hexxagon: 3.37% (12.0921 => 12.4993, std.dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 3.22% (11.2619 => 11.6247, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bisort/bisort: 3.00% (0.8239 => 0.8486, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.31% (1.0310 => 1.0548, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.20% (7.4271 => 7.5902, std.dev.: 0.0035) MultiSource/Applications/lemon/lemon: 1.82% (1.4298 => 1.4558, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.44% (8.3908 => 8.5113, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2126, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9681, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1880, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.20% (5.5130 => 5.5789, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.18% (9.9194 => 10.0364, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 1.02% (12.4560 => 12.5830, std.dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.22% (0.2670 => 0.1436, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.76% (0.4657 => 0.3923, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.84% (1.3813 => 1.2177, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.73% (1.3819 => 1.2198, std.dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.29% (1.0460 => 0.8547, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.65% (0.2238 => 0.1955, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.15% (20.3410 => 18.2767, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -5.75% (1.2308 => 1.1600, std.dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5144, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.95% (1.3780 => 1.3098, std.dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.71% (0.9996 => 0.9525, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.76% (1.7688 => 1.7023, std.dev.: 0.0046) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.04% (0.4867 => 0.4719, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -2.89% (3.2729 => 3.1784, std.dev.: 0.0088) MultiSource/Applications/spiff/spiff: -2.81% (3.0263 => 2.9413, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8812, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: -2.69% (1.9762 => 1.9231, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.33% (4.1080 => 4.0121, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.86% (0.6615 => 0.6492, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -1.72% (26.5159 => 26.0611, std.dev.: 0.0303) SingleSource/Benchmarks/Shootout/lists: -1.66% (6.3560 => 6.2505, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.65% (0.8342 => 0.8204, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.65% (2.5254 => 2.4838, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0076, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.37% (3.9173 => 3.8638, std.dev.: 0.0074) MultiSource/Benchmarks/mafft/pairlocalalign: -1.24% (28.2225 => 27.8728, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2517, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.12% (6.6320 => 6.5575, std.dev.: 0.0099) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1138, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -1.04% (84.4286 => 83.5531, std.dev.: 0.0064) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 18 16:27:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 18 Oct 2012 18:27:29 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121018232729.D46BB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4979?compare_to=4976&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 4979, Order: 166230, Start Time: 2012-10-18 22:05:15, End Time: 2012-10-18 23:29:29 To: 4976, Order: 166216, Start Time: 2012-10-18 20:24:22, End Time: 2012-10-18 21:48:00 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 12 (23 on baseline) Performance Improvements: 1 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 962 (947 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.81% (0.2253 => 0.2429, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.24% (0.8097 => 0.8440, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.70% (0.9315 => 0.9660, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/05-eks/eks: 3.09% (0.4333 => 0.4467, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/gs/gs: 2.94% (4.0523 => 4.1713, std.dev.: 0.0270) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.88% (0.6218 => 0.6397, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.08% (4.4610 => 4.5537, std.dev.: 0.0274) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.94% (0.7648 => 0.7796, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.92% (1.4403 => 1.4679, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.24% (8.6463 => 8.7537, std.dev.: 0.0226) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 9.77% (1.7130 => 1.8803, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-4: 1.40% (1.6588 => 1.6821, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: -15.70% (4.1347 => 3.4857, std.dev.: 0.2051) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 1.46% (16.3269 => 16.5657, std.dev.: 0.0946) MultiSource/Applications/obsequi/Obsequi: 1.88% (1.0306 => 1.0500, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: -0.11% (0.6390 => 0.6383, std.dev.: 0.0082) MultiSource/Benchmarks/McCat/08-main/main: 8.94% (0.1723 => 0.1877, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.03% (0.1589 => 0.1669, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.67% (0.3178 => 0.3231, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.88% (0.2447 => 0.2493, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.34% (0.3267 => 0.3376, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.21% (0.2334 => 0.2409, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/bigfib: 1.38% (0.5932 => 0.6014, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/mandel: 4.24% (0.0425 => 0.0443, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.75% (0.3254 => 0.3311, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/strcat: 2.04% (0.1964 => 0.2004, std.dev.: 0.0029) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 49.72% (0.0179 => 0.0268, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 2.91% (0.0206 => 0.0212, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.96% (0.0409 => 0.0417, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 3.18% (0.0314 => 0.0324, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.34% (0.0299 => 0.0306, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 2.21% (0.0407 => 0.0416, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 3.16% (0.0190 => 0.0196, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 3.43% (0.0204 => 0.0211, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -9.94% (0.0312 => 0.0281, std.dev.: 0.0037) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 225.00% (0.0004 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.31% (0.1474 => 0.1508, std.dev.: 0.0028) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.05% (1.1376 => 1.1609, std.dev.: 0.0166) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 4.98% (0.1445 => 0.1517, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.05% (0.4071 => 0.4073, std.dev.: 0.0279) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.07% (0.1362 => 0.1431, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -11.76% (0.0689 => 0.0608, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -20.94% (0.0277 => 0.0219, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: - (0.0555 => 0.0555, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.43% (1.1415 => 1.1464, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 3.85% (0.0026 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.32% (0.0631 => 0.0629, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.61% (0.0267 => 0.0236, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.92% (0.7926 => 0.8078, std.dev.: 0.0114) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 9.68% (0.0093 => 0.0102, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.52% (2.1832 => 1.6698, std.dev.: 0.0035) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.21% (0.0810 => 0.0917, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 9.98% (0.1112 => 0.1223, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.58% (0.2279 => 0.2429, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.18% (0.2180 => 0.2293, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.32% (0.7473 => 0.7796, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.95% (1.1606 => 1.2064, std.dev.: 0.0173) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.58% (0.8148 => 0.8440, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.73% (0.6227 => 0.6397, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.38% (0.9435 => 0.9660, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.38% (1.4479 => 1.4679, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.23% (8.6476 => 8.7537, std.dev.: 0.0226) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.78% (1.5795 => 2.5079, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.29% (0.3186 => 0.3482, std.dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.43% (1.1857 => 1.2856, std.dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: 5.90% (63.1822 => 66.9117, std.dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.91% (0.7597 => 0.7894, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.87% (4.3552 => 4.4804, std.dev.: 0.0406) SingleSource/Benchmarks/Misc/ReedSolomon: 2.87% (8.5322 => 8.7767, std.dev.: 0.0302) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.57% (2.4490 => 2.5120, std.dev.: 0.0114) MultiSource/Benchmarks/Olden/bh/bh: 2.32% (2.3560 => 2.4106, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/mason/mason: 2.03% (0.5415 => 0.5525, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-4: 1.75% (1.6531 => 1.6821, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.44% (1.5941 => 1.6171, std.dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.43% (0.3269 => 0.3026, std.dev.: 0.0006) MultiSource/Applications/lua/lua: -4.63% (29.8330 => 28.4503, std.dev.: 0.1092) SingleSource/Benchmarks/Shootout-C++/hash2: -1.40% (3.4237 => 3.3756, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.27% (3.3479 => 3.3054, std.dev.: 0.0057) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.73% (16.4461 => 16.5657, std.dev.: 0.0946) MultiSource/Applications/obsequi/Obsequi: 2.32% (1.0262 => 1.0500, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 0.81% (0.6332 => 0.6383, std.dev.: 0.0082) MultiSource/Benchmarks/McCat/08-main/main: 2.51% (0.1831 => 0.1877, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.06% (0.1559 => 0.1669, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.46% (0.3123 => 0.3231, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (0.2463 => 0.2493, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.96% (0.3344 => 0.3376, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.90% (0.2364 => 0.2409, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/bigfib: 0.07% (0.6010 => 0.6014, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/mandel: 3.26% (0.0429 => 0.0443, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.38% (0.3266 => 0.3311, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/strcat: 1.78% (0.1969 => 0.2004, std.dev.: 0.0029) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 19.64% (0.0224 => 0.0268, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 72.36% (0.0123 => 0.0212, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.21% (0.0408 => 0.0417, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 27.56% (0.0254 => 0.0324, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.32% (0.0302 => 0.0306, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 8.33% (0.0384 => 0.0416, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 3.16% (0.0190 => 0.0196, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 17.22% (0.0180 => 0.0211, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 22.17% (0.0230 => 0.0281, std.dev.: 0.0037) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 4.87% (0.1438 => 0.1508, std.dev.: 0.0028) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.47% (1.1329 => 1.1609, std.dev.: 0.0166) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.76% (0.1462 => 0.1517, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.19% (0.4164 => 0.4073, std.dev.: 0.0279) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.53% (0.1369 => 0.1431, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.15% (0.0641 => 0.0608, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 12.31% (0.0195 => 0.0219, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.98% (0.0578 => 0.0555, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.24% (1.1437 => 1.1464, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.32% (0.0627 => 0.0629, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 31.11% (0.0180 => 0.0236, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.76% (0.8017 => 0.8078, std.dev.: 0.0114) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 64.52% (0.0062 => 0.0102, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 18 17:22:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 18 Oct 2012 19:22:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121019002237.EB2412A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4980?compare_to=4977&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4980, Order: 166242, Start Time: 2012-10-18 23:04:26, End Time: 2012-10-19 00:24:35 To: 4977, Order: 166223, Start Time: 2012-10-18 21:13:51, End Time: 2012-10-18 22:34:07 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (75 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (187 on baseline) Performance Improvements: 1 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 90 (15 on baseline) Unchanged Tests: 951 (656 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.40% (15.7226 => 15.1873, std.dev.: 0.0047) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.34% (0.6167 => 0.6146, std.dev.: 0.0058) MultiSource/Applications/SPASS/SPASS: 0.19% (17.1624 => 17.1949, std.dev.: 0.0079) MultiSource/Benchmarks/Bullet/bullet: 0.27% (56.2851 => 56.4348, std.dev.: 0.0125) MultiSource/Benchmarks/MallocBench/gs/gs: 0.38% (4.5583 => 4.5755, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.41% (0.0482 => 0.0484, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0485 => 0.0485, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.44% (0.0452 => 0.0454, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.44% (0.0453 => 0.0455, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0443 => 0.0443, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.45% (0.0442 => 0.0444) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.46% (0.0434 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.46% (0.0435 => 0.0437, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.44% (0.0452 => 0.0454, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.44% (0.0454 => 0.0456) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.22% (0.0447 => 0.0448, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.67% (0.0447 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.46% (0.0437 => 0.0439, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.46% (0.0437 => 0.0439, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.23% (0.0444 => 0.0445, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.22% (0.0445 => 0.0446, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.44% (0.0455 => 0.0457, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.22% (0.0457 => 0.0458, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.23% (0.0432 => 0.0433, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.46% (0.0432 => 0.0434, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.23% (0.0444 => 0.0445, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.22% (0.0445 => 0.0446, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.23% (0.0436 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0437 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.23% (0.0428 => 0.0429, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.47% (0.0428 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.23% (0.0428 => 0.0429, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.47% (0.0427 => 0.0429, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.22% (0.0463 => 0.0464, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.43% (0.0464 => 0.0466, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.47% (0.0425 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0427 => 0.0427, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.47% (0.0428 => 0.0430, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.23% (0.0429 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.23% (0.0434 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0436 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.10% (1.3015 => 1.3028, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.08% (8.1948 => 8.2011, std.dev.: 0.0196) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.30% (0.7729 => 0.7752, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.28% (0.0357 => 0.0358, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1429 => 0.1430, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -0.06% (0.1648 => 0.1647, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.2126 => 0.2126, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -10.77% (63.2438 => 56.4348, std.dev.: 0.0125) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 0.49% (0.1639 => 0.1647, std.dev.: 0.0000) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 35.45% (14.1553 => 19.1735, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.44% (3.4629 => 5.7637, std.dev.: 0.0037) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13406.67% (0.0720 => 9.7248, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050300.00% (0.0001 => 10.0504, std.dev.: 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.82% (0.2554 => 0.4184, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/lowercase: 55.08% (0.0256 => 0.0397, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 46.49% (10.3673 => 15.1873, std.dev.: 0.0047) SingleSource/UnitTests/SignlessTypes/factor: 44.59% (0.0296 => 0.0428, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 39.33% (0.1622 => 0.2260, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 36.27% (0.1056 => 0.1439, std.dev.: 0.0001) SingleSource/UnitTests/vla: 31.55% (0.0355 => 0.0467, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 24.58% (0.0834 => 0.1039, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: 21.24% (0.0485 => 0.0588, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.72% (7.0540 => 8.5154, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pifft/pifft: 20.57% (2.2022 => 2.6551, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 19.76% (0.1432 => 0.1715, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 19.60% (0.1566 => 0.1873, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.03% (0.0871 => 0.1028, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 16.98% (0.5105 => 0.5972, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 16.64% (0.6675 => 0.7786, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.08% (1.3050 => 1.5149, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.07% (0.2271 => 0.2636, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 15.95% (0.1655 => 0.1919, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 15.91% (0.0798 => 0.0925, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 15.90% (0.1440 => 0.1669, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 15.81% (3.3354 => 3.8627, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/em3d/em3d: 15.52% (0.1695 => 0.1958, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 15.40% (0.1175 => 0.1356, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 15.39% (0.3282 => 0.3787, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/mst/mst: 15.13% (0.1163 => 0.1339, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.96% (0.1337 => 0.1537, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 14.86% (0.1555 => 0.1786, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/dbms/dbms: 14.84% (0.8172 => 0.9385, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.74% (0.5020 => 0.5760, std.dev.: 0.0066) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.67% (0.0886 => 0.1016, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 14.63% (0.0793 => 0.0909, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.61% (0.0746 => 0.0855, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 14.60% (9.4845 => 10.8693, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.50% (1.7609 => 2.0162, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 14.45% (0.7115 => 0.8143, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.44% (0.1510 => 0.1728, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.37% (0.0842 => 0.0963, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 14.31% (0.3109 => 0.3554, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/matrix: 14.30% (0.0818 => 0.0935, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.23% (0.1117 => 0.1276, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.21% (0.4615 => 0.5271, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.14% (1.5415 => 1.7594, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 14.02% (0.3423 => 0.3903, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 13.95% (0.1584 => 0.1805, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 13.92% (0.1940 => 0.2210, std.dev.: 0.0016) MultiSource/Applications/Burg/burg: 13.79% (1.1642 => 1.3248, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.77% (0.1438 => 0.1636, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.75% (0.3121 => 0.3550, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.69% (0.9765 => 1.1102, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.67% (0.2107 => 0.2395, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.64% (0.1906 => 0.2166, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.63% (4.2646 => 4.8458, std.dev.: 0.0093) SingleSource/Benchmarks/McGill/exptree: 13.51% (0.0814 => 0.0924, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.40% (8.1363 => 9.2263, std.dev.: 0.0058) MultiSource/Applications/JM/ldecod/ldecod: 13.36% (10.4361 => 11.8306, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.26% (0.5860 => 0.6637, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.25% (0.0770 => 0.0872, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.22% (0.2065 => 0.2338, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 13.21% (0.7835 => 0.8870, std.dev.: 0.0036) MultiSource/Applications/aha/aha: 13.21% (0.1151 => 0.1303, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.20% (0.2758 => 0.3122, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.19% (0.1236 => 0.1399, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 13.16% (0.6450 => 0.7299, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.12% (0.1029 => 0.1164, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.08% (0.1032 => 0.1167, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.00% (0.2700 => 0.3051, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 12.81% (5.7591 => 6.4970, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.75% (0.0933 => 0.1052, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.71% (0.1062 => 0.1197, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 12.65% (0.1463 => 0.1648, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.64% (0.5981 => 0.6737, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.64% (4.9449 => 5.5697, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/05-eks/eks: 12.58% (0.4299 => 0.4840, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 12.53% (2.0273 => 2.2813, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.50% (0.4879 => 0.5489, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.49% (0.0929 => 0.1045, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.48% (5.0018 => 5.6258, std.dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: 12.40% (0.7433 => 0.8355, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/health/health: 12.38% (0.1268 => 0.1425, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 12.37% (0.3177 => 0.3570, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.33% (0.1695 => 0.1904, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.33% (7.9617 => 8.9430, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.32% (0.8067 => 0.9061, std.dev.: 0.0064) MultiSource/Benchmarks/sim/sim: 12.25% (0.3387 => 0.3802, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 12.16% (3.8723 => 4.3431, std.dev.: 0.0086) MultiSource/Applications/lemon/lemon: 12.12% (1.0722 => 1.2021, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.08% (0.3543 => 0.3971, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.07% (0.3307 => 0.3706, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.99% (0.5569 => 0.6237, std.dev.: 0.0013) SingleSource/UnitTests/SignlessTypes/rem: 11.98% (0.1144 => 0.1281, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.81% (1.1861 => 1.3262, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.80% (0.1330 => 0.1487, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.73% (0.1125 => 0.1257, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 11.73% (1.1840 => 1.3229, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.66% (0.3473 => 0.3878, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.63% (0.1625 => 0.1814, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-3: 11.60% (0.3516 => 0.3924, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.60% (0.3543 => 0.3954, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.58% (0.3497 => 0.3902, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 11.55% (0.3828 => 0.4270, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 11.54% (0.3561 => 0.3972, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.45% (0.3694 => 0.4117, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.41% (0.3927 => 0.4375, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 11.33% (0.8921 => 0.9932, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 11.33% (1.4186 => 1.5793, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.25% (0.3441 => 0.3828, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 11.25% (0.3886 => 0.4323, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 11.16% (0.3180 => 0.3535, std.dev.: 0.0036) MultiSource/Applications/hbd/hbd: 11.16% (1.5603 => 1.7344, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.02% (1.5859 => 1.7606, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 10.89% (0.6456 => 0.7159, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.57% (0.8101 => 0.8957, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 10.56% (21.9371 => 24.2531, std.dev.: 0.0160) SingleSource/Benchmarks/Misc/ReedSolomon: 10.54% (0.2049 => 0.2265, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.50% (0.2266 => 0.2504, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.31% (0.1892 => 0.2087, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.22% (0.2603 => 0.2869, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.18% (2.2024 => 2.4267, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 9.98% (0.4289 => 0.4717, std.dev.: 0.0129) MultiSource/Applications/siod/siod: 9.85% (2.2969 => 2.5231, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.83% (0.3826 => 0.4202, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 9.83% (0.4620 => 0.5074, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.57% (0.3865 => 0.4235, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 9.56% (0.3422 => 0.3749, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 9.47% (0.6030 => 0.6601, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.42% (0.4203 => 0.4599, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.42% (0.5925 => 0.6483, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 9.29% (0.4048 => 0.4424, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.21% (0.4636 => 0.5063, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.90% (0.4103 => 0.4468, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 8.85% (0.3684 => 0.4010, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.68% (0.7326 => 0.7962, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 8.58% (0.3603 => 0.3912, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.37% (0.3427 => 0.3714, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/bh/bh: 8.09% (0.3092 => 0.3342, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.96% (0.2891 => 0.3121, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.89% (0.3650 => 0.3938, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 7.88% (0.3098 => 0.3342, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 7.69% (17.1811 => 18.5027, std.dev.: 0.0194) SingleSource/Regression/C++/ofstream_ctor: 7.68% (0.2905 => 0.3128, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.66% (0.2756 => 0.2967, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.65% (0.2430 => 0.2616, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 7.59% (0.2831 => 0.3046, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.56% (14.3668 => 15.4536, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/ary2: 7.55% (0.3379 => 0.3634, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.54% (2.0665 => 2.2223, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.53% (0.4064 => 0.4370, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.53% (0.3136 => 0.3372, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.50% (0.3162 => 0.3399, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary: 7.49% (0.3232 => 0.3474, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 7.44% (0.2877 => 0.3091, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.41% (0.2714 => 0.2915, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.38% (0.2793 => 0.2999, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 7.37% (0.3283 => 0.3525, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 7.35% (0.2871 => 0.3082, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.34% (0.2725 => 0.2925, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.28% (0.2872 => 0.3081, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.18% (0.3052 => 0.3271, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.07% (3.8922 => 4.1675, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 7.03% (0.2802 => 0.2999, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 6.29% (1.2842 => 1.3650, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/objinst: 6.04% (0.3131 => 0.3320, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.06% (0.3817 => 0.3972, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.21% (1.1194 => 1.1553, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.18% (0.3935 => 0.4060, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.55% (1.1145 => 1.2989, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 10.04% (1.1396 => 1.2540, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 9.80% (0.9957 => 1.0933, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.11% (0.9540 => 1.0218) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3683, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 5.49% (1.9405 => 2.0471, std.dev.: 0.0006) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.51% (4.2280 => 4.3342, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0313 => 1.0567, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.35% (1.7254 => 1.7659, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.83% (3.6395 => 3.7060, std.dev.: 0.0074) MultiSource/Benchmarks/Olden/bisort/bisort: 1.78% (0.8333 => 0.8481, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2076, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.51% (2.6546 => 2.6948, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.00% (6.6874 => 0.1336, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -79.98% (0.8651 => 0.1732, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.66% (5.2763 => 3.2893, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -29.58% (5.3855 => 3.7923, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -29.09% (5.3526 => 3.7955, std.dev.: 0.0028) SingleSource/UnitTests/Vector/constpool: -14.62% (54.1659 => 46.2493, std.dev.: 0.0288) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -9.88% (2.9384 => 2.6480, std.dev.: 0.0096) MultiSource/Applications/ClamAV/clamscan: -6.93% (22.1758 => 20.6394, std.dev.: 0.0229) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.08% (8.0499 => 3.7770, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.40% (1.1492 => 0.7654, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.93% (1.6925 => 1.4229, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -12.16% (1.2373 => 1.0869, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3453 => 2.9599, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -10.96% (1.5373 => 1.3688, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.32% (19.9488 => 18.2882, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/mason/mason: -7.82% (0.2161 => 0.1992, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.09% (1.8329 => 1.7029, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.57% (1.6805 => 1.5869, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909) SingleSource/Benchmarks/Misc/flops-5: -4.62% (1.5835 => 1.5104, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.38% (8.1563 => 7.7991, std.dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.61% (3.2827 => 3.1641, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -3.39% (5.0483 => 4.8774, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5084, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.64% (0.4808 => 0.4681, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0850, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6826, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -1.64% (2.5528 => 2.5110, std.dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4206, std.dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: -1.26% (4.6441 => 4.5856, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/lists: -1.11% (6.2999 => 6.2300, std.dev.: 0.0086) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.10% (2.3135 => 2.2880) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 17.54% (0.5229 => 0.6146, std.dev.: 0.0058) MultiSource/Applications/SPASS/SPASS: 14.71% (14.9895 => 17.1949, std.dev.: 0.0079) MultiSource/Benchmarks/MallocBench/gs/gs: 11.31% (4.1105 => 4.5755, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.92% (1.1048 => 1.3028, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.57% (7.1582 => 8.2011, std.dev.: 0.0196) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.59% (0.6222 => 0.7752, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35700.00% (0.0001 => 0.0358, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.70% (0.1485 => 0.1430, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.47% (0.2116 => 0.2126, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 18 17:54:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 18 Oct 2012 19:54:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121019005452.438092A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4981?compare_to=4978&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4981, Order: 166245, Start Time: 2012-10-18 23:31:54, End Time: 2012-10-19 00:57:50 To: 4978, Order: 166226, Start Time: 2012-10-18 21:36:15, End Time: 2012-10-18 23:02:28 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (188 on baseline) Performance Improvements: 18 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1024 (677 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.71% (0.8965 => 0.8632, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.32% (0.6408 => 0.6195, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.86% (0.8464 => 0.8222, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.04% (0.5988 => 0.5866, std.dev.: 0.0018) MultiSource/Applications/hbd/hbd: -1.99% (1.5680 => 1.5368, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.92% (1.2198 => 1.1964, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: -1.91% (1.2450 => 1.2212, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.78% (1.0476 => 1.0290, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.72% (1.2177 => 1.1967, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: -1.57% (0.8381 => 0.8249, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.44% (8.0170 => 7.9019, std.dev.: 0.0058) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.31% (6.7797 => 6.6907, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: -1.29% (4.3063 => 4.2506, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.23% (4.0409 => 3.9911, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.23% (1.2771 => 1.2614, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.23% (4.8108 => 4.7518, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.19% (4.8795 => 4.8214, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.16% (1.4584 => 1.4415, std.dev.: 0.0007) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.47% (2.0176 => 2.4912, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.16% (0.1410 => 0.1666, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 17.19% (0.0826 => 0.0968, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 16.45% (0.2243 => 0.2612, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 13.92% (0.1013 => 0.1154, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.79% (0.0834 => 0.0949, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.02% (0.1413 => 0.1597, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.83% (0.2721 => 0.3070, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.81% (0.1327 => 0.1497, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 12.77% (0.7038 => 0.7937, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 12.68% (0.4328 => 0.4877, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.53% (3.9660 => 4.4631, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.53% (0.1588 => 0.1787, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.34% (0.0964 => 0.1083, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 12.23% (1.3693 => 1.5368, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.17% (0.2596 => 0.2912, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 12.13% (0.5818 => 0.6524, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 12.06% (0.4062 => 0.4552, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.96% (0.7710 => 0.8632, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.88% (0.6959 => 0.7786, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 11.86% (0.5748 => 0.6430, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 11.86% (13.8202 => 15.4598, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.86% (0.9199 => 1.0290, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.79% (0.6283 => 0.7024, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.69% (1.4563 => 1.6265, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 11.67% (0.1003 => 0.1120, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.43% (1.2193 => 1.3587, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.42% (0.5265 => 0.5866, std.dev.: 0.0018) MultiSource/Applications/aha/aha: 11.39% (0.1062 => 0.1183, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 11.36% (0.7061 => 0.7863, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.34% (0.3899 => 0.4341, std.dev.: 0.0012) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.29% (0.1072 => 0.1193, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.16% (0.4016 => 0.4464, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 11.15% (0.2781 => 0.3091, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.09% (0.3130 => 0.3477, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.06% (0.4791 => 0.5321, std.dev.: 0.0064) MultiSource/Applications/lemon/lemon: 11.05% (1.0313 => 1.1453, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.05% (0.3485 => 0.3870, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.00% (1.1364 => 1.2614, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.97% (0.5577 => 0.6189, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 10.84% (0.3293 => 0.3650, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.77% (0.4390 => 0.4863, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.71% (0.2782 => 0.3080, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.70% (0.3756 => 0.4158, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 10.66% (0.3453 => 0.3821, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.63% (0.1157 => 0.1280, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.60% (0.3489 => 0.3859, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/moments: 10.55% (0.3868 => 0.4276, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 10.53% (0.2726 => 0.3013, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 10.48% (0.6744 => 0.7451, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.46% (0.3022 => 0.3338, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 10.41% (1.1061 => 1.2212, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 10.32% (0.3149 => 0.3474, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.30% (0.8698 => 0.9594, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 10.28% (0.2995 => 0.3303, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.27% (0.1276 => 0.1407, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/mst/mst: 10.26% (0.1111 => 0.1225, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.24% (0.2655 => 0.2927, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 10.23% (0.3107 => 0.3425, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.23% (0.1075 => 0.1185, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.23% (0.3246 => 0.3578, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 10.23% (16.6129 => 18.3116, std.dev.: 0.0212) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.22% (0.3580 => 0.3946, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.21% (0.7460 => 0.8222, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.21% (1.9828 => 2.1852, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 10.20% (0.2607 => 0.2873, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 10.20% (0.1589 => 0.1751, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.18% (0.4379 => 0.4825, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 10.18% (0.2760 => 0.3041, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 10.18% (0.2761 => 0.3042, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 10.15% (0.2690 => 0.2963, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 10.14% (3.1889 => 3.5123, std.dev.: 0.0120) MultiSource/Applications/viterbi/viterbi: 10.08% (0.1478 => 0.1627, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.08% (0.2966 => 0.3265, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 10.02% (0.3534 => 0.3888, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 9.99% (3.8646 => 4.2506, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 9.98% (0.2937 => 0.3230, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 9.97% (1.9270 => 2.1192, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 9.97% (0.2628 => 0.2890, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.95% (0.2765 => 0.3040, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 9.90% (0.3192 => 0.3508, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.90% (0.5637 => 0.6195, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 9.90% (0.7506 => 0.8249, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.87% (0.1865 => 0.2049, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.85% (0.2914 => 0.3201, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 9.81% (0.3220 => 0.3536, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.76% (0.1435 => 0.1575, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.75% (0.1569 => 0.1722, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 9.74% (0.8310 => 0.9119, std.dev.: 0.0077) MultiSource/Applications/siod/siod: 9.64% (2.1791 => 2.3891, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.62% (0.1986 => 0.2177, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.57% (0.2696 => 0.2954, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.55% (4.9865 => 5.4625, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.54% (0.2023 => 0.2216, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 9.54% (0.2988 => 0.3273, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.47% (7.2180 => 7.9019, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.40% (0.2127 => 0.2327, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 9.30% (0.2925 => 0.3197, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.27% (0.3755 => 0.4103, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 9.13% (0.2945 => 0.3214, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 8.87% (0.1657 => 0.1804, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.85% (0.6576 => 0.7158, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.83% (1.3245 => 1.4415, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.77% (3.6692 => 3.9911, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.75% (0.8818 => 0.9590, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 8.70% (1.2749 => 1.3858, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 8.65% (4.6629 => 5.0662, std.dev.: 0.0051) MultiSource/Applications/JM/lencod/lencod: 8.63% (14.8535 => 16.1350, std.dev.: 0.0188) MultiSource/Benchmarks/nbench/nbench: 8.63% (1.0594 => 1.1508, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 8.56% (0.3131 => 0.3399, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.51% (4.4433 => 4.8214, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.51% (1.5188 => 1.6480, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.49% (4.3801 => 4.7518, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/bigfib: 8.43% (0.6250 => 0.6777, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.39% (0.6135 => 0.6650, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 8.32% (8.4961 => 9.2031, std.dev.: 0.0135) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.32% (0.2140 => 0.2318, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.29% (0.3511 => 0.3802, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.18% (3.2742 => 3.5421, std.dev.: 0.0108) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.94% (0.1789 => 0.1931, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.89% (0.3245 => 0.3501, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.89% (0.4805 => 0.5184, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.86% (0.9108 => 0.9824, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.80% (0.2321 => 0.2502, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/05-eks/eks: 7.68% (0.4113 => 0.4429, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.67% (2.1007 => 2.2619, std.dev.: 0.0083) MultiSource/Benchmarks/FreeBench/neural/neural: 7.65% (0.1385 => 0.1491) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.62% (1.1333 => 1.2197, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 7.59% (3.7467 => 4.0310, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 7.52% (0.4003 => 0.4304, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.47% (0.2504 => 0.2691, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 7.38% (6.5754 => 7.0605, std.dev.: 0.0086) SingleSource/UnitTests/ObjC/exceptions: 7.31% (0.3914 => 0.4200, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.28% (1.2292 => 1.3187, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 7.17% (0.2008 => 0.2152, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/property: 7.13% (0.3940 => 0.4221, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.07% (0.3578 => 0.3831, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.02% (0.3789 => 0.4055, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.99% (0.3646 => 0.3901, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.96% (0.3650 => 0.3904, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 6.94% (0.3601 => 0.3851, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.93% (0.1819 => 0.1945, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.91% (0.3663 => 0.3916, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 6.82% (0.3623 => 0.3870, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 6.70% (0.1777 => 0.1896, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.57% (6.2785 => 6.6907, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.21% (13.2842 => 14.1086, std.dev.: 0.0121) MultiSource/Applications/sqlite3/sqlite3: 5.35% (16.2614 => 17.1317, std.dev.: 0.0121) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.26% (0.2243 => 0.2361, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 4.38% (14.5298 => 15.1669, std.dev.: 0.0118) MultiSource/Benchmarks/Bullet/bullet: 1.69% (33.2944 => 33.8583, std.dev.: 0.0140) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.71% (0.4846 => 0.6964, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5176, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fbench: 25.16% (1.8175 => 2.2748, std.dev.: 0.0436) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.09% (1.0895 => 1.2757, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 11.12% (1.1560 => 1.2846, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.03% (0.8273 => 0.9020, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4143, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.43% (0.9692 => 1.0218) SingleSource/Benchmarks/Misc/mandel-2: 5.35% (1.2998 => 1.3693, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0037, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: 4.46% (0.5449 => 0.5692, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.46% (2.8606 => 2.9881, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7747, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.67% (10.7476 => 11.1425, std.dev.: 0.0356) MultiSource/Applications/hexxagon/hexxagon: 3.39% (12.0921 => 12.5025, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 3.35% (1.9199 => 1.9843, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 3.20% (11.2619 => 11.6225, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bisort/bisort: 3.18% (0.8239 => 0.8501, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.22% (1.0310 => 1.0539, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 2.12% (7.4271 => 7.5844, std.dev.: 0.0043) MultiSource/Applications/lemon/lemon: 1.72% (1.4298 => 1.4544, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5128, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.29% (1.9433 => 1.9683, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1872, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.20% (9.9194 => 10.0386, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5788, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1407, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5857, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.70% (0.2670 => 0.1423, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.95% (0.4657 => 0.3914, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.42% (1.3819 => 1.1964, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.36% (1.3813 => 1.1967, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.28% (1.0460 => 0.8548, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -12.96% (0.2238 => 0.1948, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.11% (20.3410 => 18.2852, std.dev.: 0.0117) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.27% (1.3780 => 1.2916, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -5.92% (1.2308 => 1.1579, std.dev.: 0.0069) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5144, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.27% (0.9996 => 0.9569, std.dev.: 0.0058) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.79% (1.7688 => 1.7017, std.dev.: 0.0052) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.02% (0.4867 => 0.4720, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -2.88% (3.2729 => 3.1785, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -2.77% (3.0263 => 2.9424, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/bh/bh: -2.72% (1.9762 => 1.9224, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8811, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.37% (4.1080 => 4.0108, std.dev.: 0.0049) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.93% (0.6589 => 0.6462, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.86% (0.6615 => 0.6492) SingleSource/Benchmarks/Shootout/lists: -1.77% (6.3560 => 6.2438, std.dev.: 0.0055) MultiSource/Applications/lua/lua: -1.72% (26.5159 => 26.0600, std.dev.: 0.0337) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.68% (0.8342 => 0.8202, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.63% (2.5254 => 2.4842, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0065, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8633, std.dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2504, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: -1.24% (28.2225 => 27.8732, std.dev.: 0.0011) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1140, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -1.04% (84.4286 => 83.5476, std.dev.: 0.0085) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 18 18:10:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 18 Oct 2012 20:10:03 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121019011003.B71ED2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4982?compare_to=4979&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 4982, Order: 166247, Start Time: 2012-10-18 23:48:44, End Time: 2012-10-19 01:12:03 To: 4979, Order: 166230, Start Time: 2012-10-18 22:05:15, End Time: 2012-10-18 23:29:29 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 3 (10 on baseline) Performance Improvements: 24 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 948 (960 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 6.64% (7.9958 => 8.5271, std.dev.: 0.0591) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.09% (6.9018 => 7.1843, std.dev.: 0.0710) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.09% (5.1660 => 5.3256, std.dev.: 0.0296) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.16% (0.2429 => 0.2328, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.98% (1.2064 => 1.1584, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/05-eks/eks: -3.18% (0.4467 => 0.4325, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -3.16% (0.9660 => 0.9355, std.dev.: 0.0108) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.99% (0.6397 => 0.6206, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.73% (0.3812 => 0.3708, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.47% (0.6234 => 0.6080, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -2.30% (1.2612 => 1.2322, std.dev.: 0.0086) MultiSource/Benchmarks/MallocBench/gs/gs: -2.23% (4.1713 => 4.0784, std.dev.: 0.0321) MultiSource/Applications/hbd/hbd: -2.13% (1.4631 => 1.4319, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -2.12% (4.6341 => 4.5359, std.dev.: 0.0028) MultiSource/Applications/Burg/burg: -2.07% (1.2293 => 1.2039, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -2.06% (0.4944 => 0.4842, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.95% (0.7796 => 0.7644, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -1.72% (1.2665 => 1.2447, std.dev.: 0.0082) MultiSource/Applications/spiff/spiff: -1.68% (0.8072 => 0.7936, std.dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.68% (6.7301 => 6.6168, std.dev.: 0.0225) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.45% (4.2241 => 4.1627, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/football/football: -1.29% (0.8831 => 0.8717, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -1.23% (0.8102 => 0.8002, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.09% (1.3404 => 1.3258, std.dev.: 0.0049) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/flops-4: -1.64% (1.6821 => 1.6545, std.dev.: 0.0029) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.31% (2.4621 => 2.4298, std.dev.: 0.0112) MultiSource/Benchmarks/Olden/bh/bh: -1.09% (2.4106 => 2.3844, std.dev.: 0.0061) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -1.15% (16.5657 => 16.3744, std.dev.: 0.1028) MultiSource/Applications/obsequi/Obsequi: -1.35% (1.0500 => 1.0358, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: -0.80% (0.6383 => 0.6332, std.dev.: 0.0090) MultiSource/Benchmarks/McCat/08-main/main: -3.41% (0.1877 => 0.1813, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.20% (0.1669 => 0.1649, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.02% (0.3231 => 0.3198, std.dev.: 0.0083) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.97% (0.2493 => 0.2394, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.98% (0.3376 => 0.3309, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.16% (0.2409 => 0.2381, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: -1.66% (0.6014 => 0.5914, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/mandel: -4.74% (0.0443 => 0.0422, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.85% (0.3311 => 0.3283, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -1.70% (0.2004 => 0.1970, std.dev.: 0.0009) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -15.67% (0.0268 => 0.0226, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -29.25% (0.0212 => 0.0150, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.44% (0.0417 => 0.0411, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.54% (0.0324 => 0.0319, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.96% (0.0306 => 0.0300, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -6.25% (0.0416 => 0.0390, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/casts: -13.27% (0.0196 => 0.0170, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/test1: -3.32% (0.0211 => 0.0204, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 14.95% (0.0281 => 0.0323, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -1.86% (0.1508 => 0.1480, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -3.09% (1.1609 => 1.1250, std.dev.: 0.0232) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.49% (0.1517 => 0.1464, std.dev.: 0.0096) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.22% (0.4073 => 0.4204, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.56% (0.1431 => 0.1423, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.25% (0.0608 => 0.0570, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 15.07% (0.0219 => 0.0252, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.24% (0.0555 => 0.0573, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.22% (1.1464 => 1.1439, std.dev.: 0.0493) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -74.07% (0.0027 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.77% (0.0629 => 0.0599, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 13.14% (0.0236 => 0.0267) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.28% (0.8078 => 0.7975, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -31.37% (0.0102 => 0.0070, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.72% (2.1832 => 1.6654, std.dev.: 0.0043) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.29% (0.7473 => 0.7644, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.23% (1.5795 => 2.4992, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.69% (0.3186 => 0.3463, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.48% (1.1857 => 1.2862, std.dev.: 0.0050) MultiSource/Benchmarks/mafft/pairlocalalign: 5.97% (63.1822 => 66.9512, std.dev.: 0.0861) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.60% (4.3552 => 4.4683, std.dev.: 0.0192) SingleSource/Benchmarks/Misc/ReedSolomon: 2.13% (8.5322 => 8.7140, std.dev.: 0.0467) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.38% (59.2638 => 60.0846, std.dev.: 0.2718) MultiSource/Benchmarks/Olden/bh/bh: 1.21% (2.3560 => 2.3844, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/whetstone: 1.05% (2.1224 => 2.1446, std.dev.: 0.0076) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -10.37% (0.3269 => 0.2930, std.dev.: 0.0041) MultiSource/Applications/lua/lua: -4.77% (29.8330 => 28.4095, std.dev.: 0.0393) SingleSource/Benchmarks/Shootout-C++/hash2: -1.47% (3.4237 => 3.3733, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.30% (3.3479 => 3.3043, std.dev.: 0.0049) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.44% (16.4461 => 16.3744, std.dev.: 0.1028) MultiSource/Applications/obsequi/Obsequi: 0.94% (1.0262 => 1.0358, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: - (0.6332 => 0.6332, std.dev.: 0.0090) MultiSource/Benchmarks/McCat/08-main/main: -0.98% (0.1831 => 0.1813, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.77% (0.1559 => 0.1649, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.40% (0.3123 => 0.3198, std.dev.: 0.0083) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.80% (0.2463 => 0.2394, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.05% (0.3344 => 0.3309, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.72% (0.2364 => 0.2381, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: -1.60% (0.6010 => 0.5914, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/mandel: -1.63% (0.0429 => 0.0422, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.52% (0.3266 => 0.3283, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 0.05% (0.1969 => 0.1970, std.dev.: 0.0009) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.89% (0.0224 => 0.0226, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 21.95% (0.0123 => 0.0150, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.74% (0.0408 => 0.0411, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 25.59% (0.0254 => 0.0319, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.66% (0.0302 => 0.0300, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.56% (0.0384 => 0.0390, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/casts: -10.53% (0.0190 => 0.0170, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/test1: 13.33% (0.0180 => 0.0204, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 40.43% (0.0230 => 0.0323, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.92% (0.1438 => 0.1480, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -0.70% (1.1329 => 1.1250, std.dev.: 0.0232) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.14% (0.1462 => 0.1464, std.dev.: 0.0096) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.96% (0.4164 => 0.4204, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.94% (0.1369 => 0.1423, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -11.08% (0.0641 => 0.0570, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 29.23% (0.0195 => 0.0252, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.87% (0.0578 => 0.0573, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.02% (1.1437 => 1.1439, std.dev.: 0.0493) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -50.00% (0.0014 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.47% (0.0627 => 0.0599, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.33% (0.0180 => 0.0267) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.52% (0.8017 => 0.7975, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 12.90% (0.0062 => 0.0070, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 18 19:12:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 18 Oct 2012 21:12:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121019021205.BB4542A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/4983?compare_to=4980&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4983, Order: 166248, Start Time: 2012-10-19 00:54:07, End Time: 2012-10-19 02:14:04 To: 4980, Order: 166242, Start Time: 2012-10-18 23:04:26, End Time: 2012-10-19 00:24:35 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (75 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (174 on baseline) Performance Improvements: 36 (41 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 90 (15 on baseline) Unchanged Tests: 914 (671 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.26% (54.7865 => 56.5721, std.dev.: 0.0235) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.83% (78.0026 => 80.2078, std.dev.: 0.6173) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.07% (0.9385 => 0.9003, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.90% (0.6737 => 0.6474, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -3.32% (0.8957 => 0.8660, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.20% (3.7923 => 3.6709, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.01% (3.7955 => 3.6813, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.96% (0.3550 => 0.3445, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.81% (2.6551 => 2.5806, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.49% (0.6237 => 0.6082, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: -2.39% (1.3248 => 1.2931, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: -2.34% (0.8870 => 0.8662, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.33% (1.1102 => 1.0843, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.22% (0.9061 => 0.8860, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/05-eks/eks: -2.21% (0.4840 => 0.4733, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -2.15% (8.5154 => 8.3327, std.dev.: 0.0247) MultiSource/Applications/hbd/hbd: -2.13% (1.7344 => 1.6975, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -2.09% (0.5271 => 0.5161, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -2.05% (0.6637 => 0.6501, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -1.82% (0.5489 => 0.5389, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.68% (9.2263 => 9.0712, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.67% (5.5697 => 5.4768, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.63% (1.5793 => 1.5536, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.53% (4.8458 => 4.7715, std.dev.: 0.0143) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.53% (5.6258 => 5.5398, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -1.50% (1.5149 => 1.4922, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.40% (0.7299 => 0.7197, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: -1.39% (24.2531 => 23.9162, std.dev.: 0.0142) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.36% (8.9430 => 8.8211, std.dev.: 0.0048) MultiSource/Applications/treecc/treecc: -1.36% (2.2813 => 2.2503, std.dev.: 0.0029) MultiSource/Applications/lua/lua: -1.33% (4.3431 => 4.2853, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.30% (1.3262 => 1.3089, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.25% (15.4536 => 15.2602, std.dev.: 0.0178) MultiSource/Applications/oggenc/oggenc: -1.24% (6.4970 => 6.4164, std.dev.: 0.0069) MultiSource/Benchmarks/mafft/pairlocalalign: -1.19% (10.8693 => 10.7401, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -1.07% (1.7594 => 1.7406, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.02% (2.2223 => 2.1997, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/football/football: -1.01% (0.9932 => 0.9832, std.dev.: 0.0004) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -1.29% (0.6146 => 0.6067, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -1.16% (17.1949 => 16.9948, std.dev.: 0.0177) MultiSource/Benchmarks/Bullet/bullet: -1.46% (56.4348 => 55.6109, std.dev.: 0.0143) MultiSource/Benchmarks/MallocBench/gs/gs: -2.24% (4.5755 => 4.4732, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.75% (0.0484 => 0.0461, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.74% (0.0485 => 0.0462, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.29% (0.0454 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.05% (0.0455 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.19% (0.0443 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.18% (0.0444 => 0.0421, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.28% (0.0436 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.03% (0.0437 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.29% (0.0454 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.04% (0.0456 => 0.0433, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.13% (0.0448 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.11% (0.0450 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.01% (0.0439 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.01% (0.0439 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.17% (0.0445 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.93% (0.0446 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.81% (0.0457 => 0.0435, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.02% (0.0458 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.08% (0.0433 => 0.0411, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.07% (0.0434 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.17% (0.0445 => 0.0422, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.93% (0.0446 => 0.0424) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.26% (0.0437 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.03% (0.0437 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.36% (0.0429 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.35% (0.0430 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.59% (0.0429 => 0.0405, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.36% (0.0429 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.74% (0.0464 => 0.0442, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.15% (0.0466 => 0.0442, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.15% (0.0427 => 0.0405, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.92% (0.0427 => 0.0406, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.58% (0.0430 => 0.0406, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.35% (0.0430 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.06% (0.0435 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.05% (0.0436 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.88% (1.3028 => 1.2783, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.44% (8.2011 => 8.1652, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.64% (0.7752 => 0.7702, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -1.40% (0.0358 => 0.0353, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: - (0.1430 => 0.1430, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 0.06% (0.1647 => 0.1648) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.05% (0.2126 => 0.2127, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -12.07% (63.2438 => 55.6109, std.dev.: 0.0143) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 0.55% (0.1639 => 0.1648) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 34.51% (14.1553 => 19.0407, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++-EH/spirit: 65.64% (3.4629 => 5.7358, std.dev.: 0.0016) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13398.75% (0.0720 => 9.7191, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049900.00% (0.0001 => 10.0500, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 61.00% (0.2554 => 0.4112, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: 51.56% (0.0256 => 0.0388) MultiSource/Benchmarks/PAQ8p/paq8p: 47.68% (10.3673 => 15.3101, std.dev.: 0.0013) SingleSource/UnitTests/SignlessTypes/factor: 41.22% (0.0296 => 0.0418, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 36.31% (0.1622 => 0.2211, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/distray/distray: 34.09% (0.1056 => 0.1416, std.dev.: 0.0002) SingleSource/UnitTests/vla: 28.45% (0.0355 => 0.0456, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 21.94% (0.0834 => 0.1017, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.13% (7.0540 => 8.3327, std.dev.: 0.0247) SingleSource/Benchmarks/Misc/flops: 17.67% (0.1432 => 0.1685, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.18% (2.2022 => 2.5806, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.65% (0.0871 => 0.1016, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 16.20% (0.5105 => 0.5932, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 16.09% (0.1566 => 0.1818, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 16.04% (0.6675 => 0.7746) MultiSource/Applications/d/make_dparser: 14.94% (3.3354 => 3.8337, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: 14.68% (0.1655 => 0.1898, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 14.49% (10.4361 => 11.9487, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 14.34% (1.3050 => 1.4922, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 14.11% (0.3282 => 0.3745, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.10% (0.5020 => 0.5728, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.63% (1.7609 => 2.0009, std.dev.: 0.0064) MultiSource/Applications/minisat/minisat: 13.56% (0.7115 => 0.8080, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 13.33% (0.1440 => 0.1632, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.30% (0.2271 => 0.2573, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 13.24% (9.4845 => 10.7401, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.92% (1.5415 => 1.7406, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.52% (0.1510 => 0.1699, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 12.51% (0.3109 => 0.3498, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 12.37% (0.1584 => 0.1780, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 12.24% (0.3423 => 0.3842, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 12.21% (0.1695 => 0.1902) MultiSource/Benchmarks/Olden/tsp/tsp: 11.91% (0.1175 => 0.1315, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.89% (4.2646 => 4.7715, std.dev.: 0.0143) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.83% (0.4615 => 0.5161, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 11.82% (0.1337 => 0.1495, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.73% (0.1236 => 0.1381, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.58% (0.6450 => 0.7197, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 11.49% (8.1363 => 9.0712, std.dev.: 0.0081) MultiSource/Applications/viterbi/viterbi: 11.45% (0.1555 => 0.1733, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.43% (0.1032 => 0.1150, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 11.41% (5.7591 => 6.4164, std.dev.: 0.0069) MultiSource/Applications/lemon/lemon: 11.40% (1.0722 => 1.1944, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 11.34% (0.3387 => 0.3771, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.33% (0.1695 => 0.1887) MultiSource/Applications/lambda-0_1_3/lambda: 11.29% (0.7433 => 0.8272, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/neural/neural: 11.28% (0.1463 => 0.1628, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 11.26% (0.1163 => 0.1294, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/life/life: 11.15% (0.0933 => 0.1037, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 11.07% (1.1642 => 1.2931, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.07% (0.3307 => 0.3673, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.04% (0.9765 => 1.0843, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.04% (0.2700 => 0.2998, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 11.00% (2.0273 => 2.2503, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.98% (0.1940 => 0.2153, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.94% (0.5860 => 0.6501, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/rem: 10.93% (0.1144 => 0.1269) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.92% (0.1438 => 0.1595, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 10.86% (0.1151 => 0.1276, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.79% (7.9617 => 8.8211, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 10.76% (4.9449 => 5.4768, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 10.76% (5.0018 => 5.5398, std.dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 10.67% (1.1840 => 1.3103, std.dev.: 0.0033) MultiSource/Applications/lua/lua: 10.67% (3.8723 => 4.2853, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.60% (0.1330 => 0.1471, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 10.56% (0.7835 => 0.8662, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.46% (0.1625 => 0.1795, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.45% (0.4879 => 0.5389, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.45% (0.3177 => 0.3509, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.43% (1.5859 => 1.7513, std.dev.: 0.0078) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.38% (0.3121 => 0.3445, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 10.35% (1.1861 => 1.3089, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.35% (0.2107 => 0.2325, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.23% (0.1906 => 0.2101, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 10.21% (0.8921 => 0.9832, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 10.19% (0.6456 => 0.7114, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.17% (0.8172 => 0.9003, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/05-eks/eks: 10.10% (0.4299 => 0.4733, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.03% (0.1117 => 0.1229, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.02% (0.3543 => 0.3898, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 9.99% (0.3473 => 0.3820, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 9.96% (0.3543 => 0.3896, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 9.96% (0.1125 => 0.1237, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 9.93% (0.3927 => 0.4317, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 9.91% (0.3694 => 0.4060, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.89% (0.3497 => 0.3843, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.88% (0.3561 => 0.3913, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.86% (0.2758 => 0.3030, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.83% (0.8067 => 0.8860, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.82% (0.1029 => 0.1130, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.78% (0.3516 => 0.3860, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.78% (2.2024 => 2.4178, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 9.77% (0.3828 => 0.4202, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.60% (0.1062 => 0.1164, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.52% (0.3886 => 0.4256, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.52% (1.4186 => 1.5536, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 9.48% (0.4620 => 0.5058, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.40% (0.2266 => 0.2479, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 9.30% (0.2603 => 0.2845, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 9.26% (0.4289 => 0.4686, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.21% (0.5569 => 0.6082, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 9.02% (21.9371 => 23.9162, std.dev.: 0.0142) MultiSource/Applications/siod/siod: 8.96% (2.2969 => 2.5027, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.87% (0.4203 => 0.4576, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.83% (0.3826 => 0.4164, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 8.79% (1.5603 => 1.6975, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 8.78% (0.2049 => 0.2229, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 8.77% (0.3422 => 0.3722, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 8.71% (0.3180 => 0.3457, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.64% (0.3865 => 0.4199, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.63% (0.3441 => 0.3738, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.62% (0.2065 => 0.2243, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: 8.57% (0.4048 => 0.4395, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 8.52% (0.1268 => 0.1376, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.31% (0.6030 => 0.6531, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.24% (0.5981 => 0.6474, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 8.24% (0.5925 => 0.6413, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 8.20% (0.3684 => 0.3986, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.13% (0.4636 => 0.5013, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: 8.05% (0.3603 => 0.3893, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.95% (0.4103 => 0.4429, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.88% (0.1892 => 0.2041, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.64% (0.7326 => 0.7886, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.27% (0.3427 => 0.3676, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 7.17% (0.3098 => 0.3320, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 7.15% (17.1811 => 18.4090, std.dev.: 0.0178) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.07% (0.3650 => 0.3908, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.3283 => 0.3514, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.03% (0.2872 => 0.3074, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.02% (0.2905 => 0.3109, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.96% (0.4064 => 0.4347, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.90% (0.8101 => 0.8660, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary: 6.78% (0.3232 => 0.3451, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.76% (0.3136 => 0.3348, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 6.75% (0.2831 => 0.3022, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.75% (0.2891 => 0.3086, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.64% (0.3162 => 0.3372, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.57% (3.8922 => 4.1479, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.45% (2.0665 => 2.1997, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.44% (0.2793 => 0.2973, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 6.41% (0.2871 => 0.3055, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.36% (0.3052 => 0.3246, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.31% (0.2756 => 0.2930, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 6.31% (0.3092 => 0.3287, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.26% (0.2877 => 0.3057, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.24% (0.2725 => 0.2895, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.22% (14.3668 => 15.2602, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/ary2: 6.21% (0.3379 => 0.3589, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.21% (0.2802 => 0.2976, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.90% (0.2714 => 0.2874, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 5.47% (1.2842 => 1.3544, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (0.3131 => 0.3292, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.69% (0.2430 => 0.2544, std.dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.49% (1.1145 => 1.2983, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.92% (1.1396 => 1.2526, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 9.78% (0.9957 => 1.0931, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.74% (3.1578 => 3.3705, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/bh/bh: 5.51% (1.9405 => 2.0475, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.73% (4.2280 => 4.3434, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7651, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.27% (1.0313 => 1.0547, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.89% (3.6395 => 3.7083, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/bisort/bisort: 1.84% (0.8333 => 0.8486, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 1.54% (3.1595 => 3.2082, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.48% (2.6546 => 2.6940, std.dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.05% (6.6874 => 0.1302, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -79.90% (0.8651 => 0.1739, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.26% (5.2763 => 3.2578, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.84% (5.3855 => 3.6709, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.22% (5.3526 => 3.6813, std.dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -14.60% (54.1659 => 46.2564, std.dev.: 0.0080) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.49% (2.9384 => 2.6301, std.dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: -7.80% (22.1758 => 20.4462, std.dev.: 0.0155) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.10% (8.0499 => 3.7751, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.37% (1.1492 => 0.7657, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.88% (1.6925 => 1.4238, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3453 => 2.9599, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.50% (1.2373 => 1.0950, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/mandel-2: -10.94% (1.5373 => 1.3691, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.26% (19.9488 => 18.3012, std.dev.: 0.1103) MultiSource/Benchmarks/FreeBench/mason/mason: -7.82% (0.2161 => 0.1992, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.16% (1.8329 => 1.7017, std.dev.: 0.0164) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.58% (1.6805 => 1.5868, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5065, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.28% (8.1563 => 7.8069, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1624, std.dev.: 0.0076) MultiSource/Benchmarks/sim/sim: -3.39% (5.0483 => 4.8774, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5050, std.dev.: 0.0043) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.91% (0.4808 => 0.4668, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.82% (10.2830 => 10.0958, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6804, std.dev.: 0.0009) SingleSource/UnitTests/Vector/multiplies: -1.65% (2.5528 => 2.5106, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4217, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: -1.25% (4.6441 => 4.5862, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2879, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 16.03% (0.5229 => 0.6067, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 13.38% (14.9895 => 16.9948, std.dev.: 0.0177) MultiSource/Benchmarks/MallocBench/gs/gs: 8.82% (4.1105 => 4.4732, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 15.70% (1.1048 => 1.2783, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.07% (7.1582 => 8.1652, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/stepanov_container: 23.79% (0.6222 => 0.7702, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35200.00% (0.0001 => 0.0353, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.70% (0.1485 => 0.1430, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.52% (0.2116 => 0.2127, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 18 19:50:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 18 Oct 2012 21:50:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121019025000.5203B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4984?compare_to=4981&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4984, Order: 166253, Start Time: 2012-10-19 01:27:14, End Time: 2012-10-19 02:52:58 To: 4981, Order: 166245, Start Time: 2012-10-18 23:31:54, End Time: 2012-10-19 00:57:50 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (188 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1041 (674 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.24% (79.5698 => 80.5576, std.dev.: 0.1879) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 22.29% (2.0176 => 2.4674, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.73% (0.1410 => 0.1660, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: 16.14% (0.2243 => 0.2605, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 16.10% (0.0826 => 0.0959, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 13.62% (0.1013 => 0.1151, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.43% (0.0819 => 0.0929, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.07% (0.0834 => 0.0943, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 12.63% (1.3693 => 1.5422, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.61% (0.2721 => 0.3064, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 12.38% (0.4328 => 0.4864, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 12.38% (0.4062 => 0.4565, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.31% (0.1413 => 0.1587, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 12.30% (0.7038 => 0.7904, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.13% (0.1327 => 0.1488, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.03% (0.0964 => 0.1080) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.94% (0.2596 => 0.2906, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.93% (3.9660 => 4.4391, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.85% (0.7710 => 0.8624, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.78% (0.1588 => 0.1775, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.45% (0.9199 => 1.0252, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.44% (0.6959 => 0.7755, std.dev.: 0.0039) SingleSource/UnitTests/ObjC++/property-reference-object: 11.38% (0.5818 => 0.6480, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 11.36% (13.8202 => 15.3895, std.dev.: 0.0125) SingleSource/UnitTests/ObjC++/property-reference: 11.32% (0.7061 => 0.7860, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.30% (0.5265 => 0.5860, std.dev.: 0.0009) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.29% (0.1072 => 0.1193, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.21% (1.4563 => 1.6195, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: 11.17% (0.1003 => 0.1115, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.11% (0.6283 => 0.6981, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 11.06% (0.5748 => 0.6384, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 10.92% (0.1062 => 0.1178, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.90% (0.3899 => 0.4324, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.88% (0.3485 => 0.3864, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.87% (1.2193 => 1.3518, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.86% (0.2782 => 0.3084, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.81% (0.4016 => 0.4450, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 10.79% (0.2781 => 0.3081, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 10.78% (0.3293 => 0.3648, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 10.68% (0.3868 => 0.4281, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.65% (0.3756 => 0.4156, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.55% (1.1364 => 1.2563, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.52% (0.4390 => 0.4852, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: 10.51% (0.3453 => 0.3816, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.45% (0.3130 => 0.3457, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.42% (0.1075 => 0.1187, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.42% (0.5577 => 0.6158, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 10.39% (1.0313 => 1.1385, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.39% (0.4791 => 0.5289, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.35% (0.3489 => 0.3850, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.32% (0.3022 => 0.3334, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.20% (0.1157 => 0.1275, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 10.19% (0.3149 => 0.3470, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 10.19% (1.1061 => 1.2188, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.19% (0.1276 => 0.1406, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 10.16% (0.2726 => 0.3003, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.13% (0.7460 => 0.8216, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.06% (1.9828 => 2.1822, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.05% (0.2765 => 0.3043, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 10.02% (0.3534 => 0.3888, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 10.00% (0.2690 => 0.2959, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 10.00% (0.2760 => 0.3036, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 10.00% (0.2761 => 0.3037, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 9.99% (0.1111 => 0.1222, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 9.98% (0.3107 => 0.3417, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 9.97% (0.2628 => 0.2890, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.94% (0.3580 => 0.3936, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.94% (0.2655 => 0.2919, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 9.91% (0.2937 => 0.3228, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 9.90% (0.2607 => 0.2865, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.89% (0.3246 => 0.3567, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 9.88% (0.1478 => 0.1624, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.84% (0.2966 => 0.3258, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.83% (0.8698 => 0.9553, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.82% (0.1986 => 0.2181, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 9.79% (16.6129 => 18.2393, std.dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.77% (0.4379 => 0.4807, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 9.75% (0.2995 => 0.3287, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 9.74% (3.8646 => 4.2410, std.dev.: 0.0046) MultiSource/Applications/minisat/minisat: 9.73% (0.6744 => 0.7400, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.71% (0.2914 => 0.3197, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 9.69% (0.7506 => 0.8233, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 9.59% (0.3192 => 0.3498, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 9.53% (3.1889 => 3.4928, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.46% (0.2696 => 0.2951, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 9.46% (1.9270 => 2.1092, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/18-imp/imp: 9.44% (0.3220 => 0.3524, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.44% (0.5637 => 0.6169, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 9.38% (0.1589 => 0.1738, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 9.34% (0.2988 => 0.3267, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.29% (7.2180 => 7.8884, std.dev.: 0.0044) MultiSource/Applications/siod/siod: 9.27% (2.1791 => 2.3810, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.22% (0.1865 => 0.2037, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 9.22% (0.8310 => 0.9076, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.19% (0.2023 => 0.2209, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.18% (0.1569 => 0.1713, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.15% (4.9865 => 5.4427, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.12% (0.2127 => 0.2321, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.06% (0.1435 => 0.1565, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 9.03% (0.2925 => 0.3189, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.00% (0.6576 => 0.7168, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.97% (0.3755 => 0.4092, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 8.93% (0.2945 => 0.3208, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 8.69% (0.1657 => 0.1801, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.60% (0.3511 => 0.3813, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.51% (3.6692 => 3.9813, std.dev.: 0.0090) MultiSource/Applications/oggenc/oggenc: 8.45% (4.6629 => 5.0570, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.42% (1.3245 => 1.4360, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.36% (0.2140 => 0.2319, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.27% (0.8818 => 0.9547, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.24% (4.3801 => 4.7409, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.20% (4.4433 => 4.8077, std.dev.: 0.0043) MultiSource/Applications/JM/lencod/lencod: 8.12% (14.8535 => 16.0595, std.dev.: 0.0157) MultiSource/Benchmarks/sim/sim: 8.02% (0.3131 => 0.3382, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 8.00% (0.6250 => 0.6750, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 7.94% (1.2749 => 1.3761, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.89% (0.6135 => 0.6619, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 7.87% (8.4961 => 9.1649, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 7.85% (1.0594 => 1.1426, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.78% (1.5188 => 1.6369, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.77% (0.1789 => 0.1928, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 7.57% (0.4003 => 0.4306, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.53% (0.9108 => 0.9794, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.49% (0.3245 => 0.3488, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 7.42% (0.4113 => 0.4418, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 7.38% (0.3914 => 0.4203, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.31% (0.1819 => 0.1952, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.29% (0.3578 => 0.3839, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 7.26% (0.3663 => 0.3929, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.24% (1.1333 => 1.2154, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.23% (0.3940 => 0.4225, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.21% (0.3789 => 0.4062, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.20% (0.2321 => 0.2488, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.17% (3.2742 => 3.5091, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 7.17% (3.7467 => 4.0154, std.dev.: 0.0083) SingleSource/UnitTests/ObjC/exceptions-2: 7.16% (0.3601 => 0.3859, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.16% (0.3646 => 0.3907, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 7.05% (1.2292 => 1.3159, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.04% (0.3650 => 0.3907, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.01% (0.4805 => 0.5142, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 7.01% (0.3623 => 0.3877, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 7.00% (6.5754 => 7.0357, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.83% (2.1007 => 2.2442, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.83% (0.2504 => 0.2675, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 6.77% (0.2008 => 0.2144, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.25% (6.2785 => 6.6707, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.87% (13.2842 => 14.0634, std.dev.: 0.0069) MultiSource/Applications/sqlite3/sqlite3: 4.88% (16.2614 => 17.0542, std.dev.: 0.0095) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.73% (0.2243 => 0.2349, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 3.97% (14.5298 => 15.1062, std.dev.: 0.0122) MultiSource/Benchmarks/Bullet/bullet: 1.62% (33.2944 => 33.8349, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5153, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/fbench: 24.10% (1.8175 => 2.2555, std.dev.: 0.0495) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.02% (1.0895 => 1.2749, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 11.05% (1.1560 => 1.2837, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/mst/mst: 8.47% (0.1322 => 0.1434, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4144, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.43% (0.9692 => 1.0218) SingleSource/Benchmarks/Misc/mandel-2: 5.21% (1.2998 => 1.3675, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0043, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 4.48% (0.5449 => 0.5693, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.46% (2.8606 => 2.9882, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.97% (1.7081 => 1.7759, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.38% (12.0921 => 12.5004, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 3.35% (10.7476 => 11.1081, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-6: 3.31% (1.9199 => 1.9834, std.dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 3.22% (11.2619 => 11.6247, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 3.14% (0.8239 => 0.8498, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0310 => 1.0559, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.11% (7.4271 => 7.5839, std.dev.: 0.0023) MultiSource/Applications/lemon/lemon: 1.82% (1.4298 => 1.4558, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5129, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9696, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1882, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5783, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.16% (9.9194 => 10.0344, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 1.11% (12.4560 => 12.5944, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 1.00% (2.1753 => 2.1971, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.89% (0.2670 => 0.1418, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.87% (0.4657 => 0.3918, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -14.29% (0.0707 => 0.0606, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.60% (1.3819 => 1.1939, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.44% (1.3813 => 1.1956, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.33% (22.5627 => 22.2631, std.dev.: 0.0125) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.28% (1.0460 => 0.8548, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.82% (0.2238 => 0.1951, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.13% (20.3410 => 18.2802, std.dev.: 0.0122) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.31% (1.3780 => 1.2911, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -5.72% (1.2308 => 1.1604, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5148, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.10% (0.9996 => 0.9586, std.dev.: 0.0029) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.83% (1.7688 => 1.7011, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -2.86% (3.2729 => 3.1794, std.dev.: 0.0068) MultiSource/Applications/spiff/spiff: -2.82% (3.0263 => 2.9409, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8811, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: -2.65% (1.9762 => 1.9239, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.43% (4.1080 => 4.0083, std.dev.: 0.0040) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.97% (0.6589 => 0.6459, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.91% (6.3560 => 6.2347, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.87% (0.6615 => 0.6491, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -1.76% (26.5159 => 26.0486, std.dev.: 0.0253) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.64% (2.5254 => 2.4839, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.64% (0.8342 => 0.8205, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0064, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -1.38% (5.3167 => 5.2432, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8649, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: -1.24% (28.2225 => 27.8716, std.dev.: 0.0024) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1138, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -1.05% (84.4286 => 83.5387, std.dev.: 0.0113) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.04% (6.6320 => 6.5633, std.dev.: 0.0052) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 18 19:50:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 18 Oct 2012 21:50:09 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121019025009.66AD22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4985?compare_to=4982&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 4985, Order: 166254, Start Time: 2012-10-19 01:28:58, End Time: 2012-10-19 02:52:09 To: 4982, Order: 166247, Start Time: 2012-10-18 23:48:44, End Time: 2012-10-19 01:12:03 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 4 (8 on baseline) Performance Improvements: 0 (5 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 971 (961 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 11.79% (20.1135 => 22.4858, std.dev.: 0.8399) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.52% (2.3732 => 2.5753, std.dev.: 0.0116) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.18% (1.0178 => 1.0400, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.09% (2.6136 => 2.6422, std.dev.: 0.0082) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.63% (16.3744 => 16.2717, std.dev.: 0.0461) MultiSource/Applications/obsequi/Obsequi: -1.09% (1.0358 => 1.0245, std.dev.: 0.0078) MultiSource/Applications/sqlite3/sqlite3: -0.77% (0.6332 => 0.6283, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: 1.43% (0.1813 => 0.1839, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.28% (0.1649 => 0.1562, std.dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.53% (0.3198 => 0.3215, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.04% (0.2394 => 0.2369, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.63% (0.3309 => 0.3255, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.44% (0.2381 => 0.2323, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/bigfib: 0.27% (0.5914 => 0.5930, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel: 12.32% (0.0422 => 0.0474, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.37% (0.3283 => 0.3271, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: -0.20% (0.1970 => 0.1966, std.dev.: 0.0009) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.31% (0.0226 => 0.0238, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -18.67% (0.0150 => 0.0122, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0411 => 0.0411, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.31% (0.0319 => 0.0318, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0300 => 0.0300, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.26% (0.0390 => 0.0389, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/casts: -4.12% (0.0170 => 0.0163, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/test1: -6.86% (0.0204 => 0.0190, std.dev.: 0.0009) SingleSource/UnitTests/byval-alignment: 4.64% (0.0323 => 0.0338, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.54% (0.1480 => 0.1472, std.dev.: 0.0028) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.89% (1.1250 => 1.1350, std.dev.: 0.0309) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.68% (0.1464 => 0.1454, std.dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.07% (0.4204 => 0.4117, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.48% (0.1423 => 0.1402, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.84% (0.0570 => 0.0609, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.40% (0.0252 => 0.0251, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.62% (0.0573 => 0.0558, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.08% (1.1439 => 1.1430, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.77% (0.0031 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 285.71% (0.0007 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.35% (0.0599 => 0.0555, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.33% (0.0267 => 0.0170, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.43% (0.7975 => 0.8009, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 38.57% (0.0070 => 0.0097, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.89% (2.1832 => 1.6616, std.dev.: 0.0100) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.75% (1.5795 => 2.5074, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.19% (14.6451 => 16.2832, std.dev.: 0.3908) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.69% (0.3186 => 0.3463, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.43% (1.1857 => 1.2856, std.dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: 5.95% (63.1822 => 66.9437, std.dev.: 0.1937) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.57% (2.2485 => 2.3513, std.dev.: 0.0178) MultiSource/Applications/siod/siod: 2.67% (3.6643 => 3.7621, std.dev.: 0.0144) SingleSource/Benchmarks/Misc/ReedSolomon: 2.22% (8.5322 => 8.7220, std.dev.: 0.0444) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.50% (4.5702 => 4.5017, std.dev.: 0.0164) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.11% (0.3269 => 0.3004, std.dev.: 0.0013) MultiSource/Applications/lua/lua: -5.17% (29.8330 => 28.2903, std.dev.: 0.1406) SingleSource/Benchmarks/Shootout-C++/hash2: -1.49% (3.4237 => 3.3726, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.27% (3.3479 => 3.3055, std.dev.: 0.0045) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -1.06% (16.4461 => 16.2717, std.dev.: 0.0461) MultiSource/Applications/obsequi/Obsequi: -0.17% (1.0262 => 1.0245, std.dev.: 0.0078) MultiSource/Applications/sqlite3/sqlite3: -0.77% (0.6332 => 0.6283, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: 0.44% (0.1831 => 0.1839, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.19% (0.1559 => 0.1562, std.dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.95% (0.3123 => 0.3215, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.82% (0.2463 => 0.2369, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.66% (0.3344 => 0.3255, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.73% (0.2364 => 0.2323, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/bigfib: -1.33% (0.6010 => 0.5930, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel: 10.49% (0.0429 => 0.0474, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.15% (0.3266 => 0.3271, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: -0.15% (0.1969 => 0.1966, std.dev.: 0.0009) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.25% (0.0224 => 0.0238, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.81% (0.0123 => 0.0122, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.74% (0.0408 => 0.0411, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 25.20% (0.0254 => 0.0318, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.66% (0.0302 => 0.0300, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.30% (0.0384 => 0.0389, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/casts: -14.21% (0.0190 => 0.0163, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/test1: 5.56% (0.0180 => 0.0190, std.dev.: 0.0009) SingleSource/UnitTests/byval-alignment: 46.96% (0.0230 => 0.0338, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.36% (0.1438 => 0.1472, std.dev.: 0.0028) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.19% (1.1329 => 1.1350, std.dev.: 0.0309) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.55% (0.1462 => 0.1454, std.dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.13% (0.4164 => 0.4117, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.41% (0.1369 => 0.1402, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.99% (0.0641 => 0.0609, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 28.72% (0.0195 => 0.0251, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.46% (0.0578 => 0.0558, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.06% (1.1437 => 1.1430, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.48% (0.0627 => 0.0555, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.56% (0.0180 => 0.0170, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.10% (0.8017 => 0.8009, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 56.45% (0.0062 => 0.0097, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 18 21:01:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 18 Oct 2012 23:01:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121019040137.D0BFD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4986?compare_to=4983&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4986, Order: 166257, Start Time: 2012-10-19 02:43:28, End Time: 2012-10-19 04:03:35 To: 4983, Order: 166248, Start Time: 2012-10-19 00:54:07, End Time: 2012-10-19 02:14:04 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 1 (76 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 8 (181 on baseline) Performance Improvements: 4 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 90 (15 on baseline) Unchanged Tests: 939 (661 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/NPB-serial/is/is: 6.41% (9.4217 => 10.0256, std.dev.: 0.0049) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/matrixTranspose: 42.07% (0.0271 => 0.0385, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: 13.14% (0.2229 => 0.2522, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/BoolLiteralTest: 11.70% (0.3889 => 0.4344, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.91% (0.1381 => 0.1504, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.26% (3.6709 => 3.7171, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 1.20% (6.4164 => 6.4935, std.dev.: 0.0036) MultiSource/Benchmarks/PAQ8p/paq8p: 1.13% (15.3101 => 15.4834, std.dev.: 0.0132) MultiSource/Benchmarks/nbench/nbench: 1.08% (1.3103 => 1.3244, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.36% (3.2578 => 3.2136, std.dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.11% (1.0217 => 0.9184, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.03% (1.5868 => 1.5546, std.dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.54% (0.6067 => 0.6100, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 0.65% (16.9948 => 17.1057, std.dev.: 0.0145) MultiSource/Benchmarks/Bullet/bullet: 0.55% (55.6109 => 55.9163, std.dev.: 0.0122) MultiSource/Benchmarks/MallocBench/gs/gs: 0.34% (4.4732 => 4.4884, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.87% (0.0461 => 0.0465, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.65% (0.0462 => 0.0465, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.70% (0.0430 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.69% (0.0432 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.71% (0.0420 => 0.0423, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.71% (0.0421 => 0.0424, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.48% (0.0413 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.48% (0.0415 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.93% (0.0430 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.23% (0.0433 => 0.0434, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.71% (0.0425 => 0.0428, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.70% (0.0427 => 0.0430, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.48% (0.0417 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.48% (0.0417 => 0.0419, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.95% (0.0422 => 0.0426, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.47% (0.0424 => 0.0426, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.23% (0.0435 => 0.0436, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.69% (0.0435 => 0.0438, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.49% (0.0411 => 0.0413, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.73% (0.0412 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.71% (0.0422 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.71% (0.0424 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.48% (0.0414 => 0.0416, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.96% (0.0415 => 0.0419, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.49% (0.0406 => 0.0408, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.49% (0.0407 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.74% (0.0405 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.74% (0.0406 => 0.0409, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.45% (0.0442 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.68% (0.0442 => 0.0445, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.49% (0.0405 => 0.0407, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.25% (0.0406 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.74% (0.0406 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.74% (0.0407 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.48% (0.0413 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.72% (0.0414 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.50% (1.2783 => 1.2847, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.57% (8.1652 => 8.2118, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.48% (0.7702 => 0.7739, std.dev.: 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.57% (0.0353 => 0.0355, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: - (0.1430 => 0.1430, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: - (0.1648 => 0.1648) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.09% (0.2127 => 0.2129, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.59% (63.2438 => 55.9163, std.dev.: 0.0122) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 0.55% (0.1639 => 0.1648) MultiSource/Benchmarks/NPB-serial/is/is: 4.83% (9.5636 => 10.0256, std.dev.: 0.0049) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 35.29% (14.1553 => 19.1505, std.dev.: 0.0207) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.83% (3.4629 => 5.7770, std.dev.: 0.0012) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13399.31% (0.0720 => 9.7195, std.dev.: 0.0121) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050000.00% (0.0001 => 10.0501, std.dev.: 0.0012) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 61.71% (0.2554 => 0.4130, std.dev.: 0.0005) SingleSource/Regression/C/matrixTranspose: 57.14% (0.0245 => 0.0385, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 51.95% (0.0256 => 0.0389) MultiSource/Benchmarks/PAQ8p/paq8p: 49.35% (10.3673 => 15.4834, std.dev.: 0.0132) SingleSource/UnitTests/SignlessTypes/factor: 41.55% (0.0296 => 0.0419, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 37.36% (0.1622 => 0.2228, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 35.04% (0.1056 => 0.1426, std.dev.: 0.0004) SingleSource/UnitTests/vla: 28.73% (0.0355 => 0.0457, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: 23.08% (0.2049 => 0.2522, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 22.30% (0.0834 => 0.1020, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.68% (0.1236 => 0.1504, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.11% (0.1566 => 0.1881, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 19.19% (0.0719 => 0.0857, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 18.58% (0.1432 => 0.1698, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.51% (7.0540 => 8.3597, std.dev.: 0.0028) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 18.50% (0.1584 => 0.1877, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.15% (2.2022 => 2.6018, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 16.79% (0.5105 => 0.5962, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.76% (0.0871 => 0.1017, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 16.49% (0.6675 => 0.7776, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 15.65% (3.3354 => 3.8573, std.dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 15.42% (10.4361 => 12.0454, std.dev.: 0.0222) SingleSource/Benchmarks/McGill/chomp: 15.35% (0.1655 => 0.1909, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 14.87% (1.3050 => 1.4991, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 14.66% (0.3282 => 0.3763, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.36% (0.5020 => 0.5741, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 14.20% (0.7115 => 0.8125, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.96% (1.5415 => 1.7567, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/power/power: 13.75% (0.1440 => 0.1638, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.69% (0.2271 => 0.2582, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.61% (1.7609 => 2.0006, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.47% (0.1032 => 0.1171, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 13.16% (9.4845 => 10.7326, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.11% (0.1510 => 0.1708, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 12.90% (0.3109 => 0.3510, std.dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 12.75% (5.7591 => 6.4935, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/18-imp/imp: 12.74% (0.3423 => 0.3859, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 12.53% (0.0838 => 0.0943, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.51% (4.2646 => 4.7981, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/em3d/em3d: 12.45% (0.1695 => 0.1906, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.29% (0.4615 => 0.5182, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/matrix: 12.22% (0.0818 => 0.0918, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 12.17% (0.1175 => 0.1318, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 12.03% (0.6450 => 0.7226, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.00% (0.2700 => 0.3024, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 11.98% (8.1363 => 9.1112, std.dev.: 0.0100) MultiSource/Applications/lemon/lemon: 11.97% (1.0722 => 1.2005, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 11.91% (0.7433 => 0.8318, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 11.89% (0.1337 => 0.1496, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.86% (0.1695 => 0.1896, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 11.86% (1.1840 => 1.3244, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 11.83% (0.1555 => 0.1739, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: 11.76% (0.1463 => 0.1635, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 11.72% (0.3387 => 0.3784, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 11.69% (0.1163 => 0.1299, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 11.65% (2.0273 => 2.2635, std.dev.: 0.0049) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.62% (7.9617 => 8.8865, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.55% (0.3307 => 0.3689, std.dev.: 0.0070) MultiSource/Applications/Burg/burg: 11.54% (1.1642 => 1.2986, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/life/life: 11.47% (0.0933 => 0.1040, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.44% (5.0018 => 5.5739, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.42% (0.4879 => 0.5436, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.39% (0.1940 => 0.2161, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.38% (0.9765 => 1.0876, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.38% (4.9449 => 5.5074, std.dev.: 0.0058) MultiSource/Applications/lua/lua: 11.30% (3.8723 => 4.3100, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.28% (0.5860 => 0.6521, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.27% (0.1438 => 0.1600, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 11.10% (0.1144 => 0.1271, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.09% (0.0929 => 0.1032) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.05% (0.1330 => 0.1477, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 11.03% (0.1151 => 0.1278, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.02% (0.1625 => 0.1804, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.95% (0.3543 => 0.3931, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.87% (0.2107 => 0.2336, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 10.83% (1.1861 => 1.3146, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/football/football: 10.83% (0.8921 => 0.9887, std.dev.: 0.0048) MultiSource/Applications/spiff/spiff: 10.80% (0.7835 => 0.8681, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.80% (0.3177 => 0.3520, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.74% (1.5859 => 1.7563, std.dev.: 0.0062) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.67% (0.1125 => 0.1245, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.65% (0.1906 => 0.2109, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.60% (0.8172 => 0.9038, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/bigfib: 10.56% (0.6456 => 0.7138, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 10.56% (0.4299 => 0.4753, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.48% (0.3121 => 0.3448, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.47% (0.3543 => 0.3914, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.45% (0.3473 => 0.3836, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.45% (0.8067 => 0.8910, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.33% (0.2758 => 0.3043, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/synchronized: 10.31% (0.3561 => 0.3928, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.29% (0.3497 => 0.3857, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.26% (0.3694 => 0.4073, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.23% (2.2024 => 2.4277, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/parameter-passing: 10.21% (0.3927 => 0.4328, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.21% (0.3516 => 0.3875, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.21% (0.1117 => 0.1231, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.20% (0.1029 => 0.1134, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions: 10.19% (0.3828 => 0.4218, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 10.01% (21.9371 => 24.1331, std.dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.99% (1.4186 => 1.5603, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/property: 9.91% (0.3886 => 0.4271, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.84% (0.2266 => 0.2489, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.79% (0.1062 => 0.1166, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 9.68% (0.4620 => 0.5067, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.64% (0.5569 => 0.6106, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 9.61% (1.5603 => 1.7102, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 9.60% (0.2603 => 0.2853, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/bh/bh: 9.57% (0.3092 => 0.3388, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hash: 9.40% (0.4289 => 0.4692, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 9.40% (2.2969 => 2.5127, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 9.34% (0.3180 => 0.3477, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 9.12% (0.3422 => 0.3734, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.07% (0.3826 => 0.4173, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.02% (0.4203 => 0.4582, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 8.99% (0.1268 => 0.1382, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.95% (0.3441 => 0.3749, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.91% (0.2065 => 0.2249, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.85% (0.3865 => 0.4207, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.83% (0.1892 => 0.2059, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 8.70% (0.4048 => 0.4400, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.62% (0.6030 => 0.6550, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.61% (0.5925 => 0.6435, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.50% (0.4636 => 0.5030, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.46% (0.5981 => 0.6487, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 8.41% (0.3684 => 0.3994, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.19% (0.4103 => 0.4439, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.11% (0.3427 => 0.3705, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/sieve: 7.99% (0.3603 => 0.3891, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.94% (0.7326 => 0.7908, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 7.85% (17.1811 => 18.5293, std.dev.: 0.0174) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.48% (0.3650 => 0.3923, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.21% (0.4064 => 0.4357, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 7.16% (0.2905 => 0.3113, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/matrix: 7.13% (0.3098 => 0.3319, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.05% (0.8101 => 0.8672, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.03% (14.3668 => 15.3773, std.dev.: 0.0182) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.00% (0.2872 => 0.3073, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.98% (0.3283 => 0.3512, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.96% (0.2831 => 0.3028, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.92% (0.3136 => 0.3353, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.90% (0.3232 => 0.3455, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.86% (3.8922 => 4.1593, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.85% (0.2891 => 0.3089, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.70% (0.3162 => 0.3374, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.63% (2.0665 => 2.2036, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 6.55% (0.2871 => 0.3059, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.53% (0.2877 => 0.3065, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.39% (0.2756 => 0.2932, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.37% (0.2793 => 0.2971, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.35% (0.2725 => 0.2898, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.32% (0.3052 => 0.3245, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.30% (0.3379 => 0.3592, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.14% (0.2802 => 0.2974, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.12% (0.2714 => 0.2880, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 5.64% (1.2842 => 1.3566, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (0.3131 => 0.3294, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.98% (0.2430 => 0.2551, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.88% (0.3817 => 0.3927, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.67% (1.1194 => 1.1493, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.59% (0.3935 => 0.4037, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.51% (5.3999 => 13.3115, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.88% (1.1396 => 1.2522, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 9.79% (0.9957 => 1.0932, std.dev.: 0.0215) SingleSource/Benchmarks/Shootout-C++/hash2: 6.62% (3.1578 => 3.3669, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: 5.95% (1.9405 => 2.0559, std.dev.: 0.0028) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.71% (4.2280 => 4.3424, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7655, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.13% (3.6395 => 3.7172, std.dev.: 0.0029) MultiSource/Applications/aha/aha: 1.54% (3.1595 => 3.2080, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.39% (2.6546 => 2.6915, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.05% (6.5088 => 6.5774, std.dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1309, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -80.09% (0.8651 => 0.1722, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.09% (5.2763 => 3.2136, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.98% (5.3855 => 3.7171, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.54% (5.3526 => 3.7180, std.dev.: 0.0033) SingleSource/UnitTests/Vector/constpool: -14.68% (54.1659 => 46.2128, std.dev.: 0.0488) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.42% (2.9384 => 2.6321, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -7.46% (22.1758 => 20.5209, std.dev.: 0.0207) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.08% (8.0499 => 3.7772, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.32% (1.1492 => 0.7663, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: -15.76% (1.6925 => 1.4258, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -12.28% (1.2373 => 1.0854, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3453 => 2.9599, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -10.59% (1.5373 => 1.3745, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.38% (19.9488 => 18.2775, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/mason/mason: -7.68% (0.2161 => 0.1995, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.49% (1.6805 => 1.5546, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.00% (1.8329 => 1.7046, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5079, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.51% (8.1563 => 7.7882, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.73% (1.3677 => 1.3167, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1624, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8776) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4941, std.dev.: 0.0060) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.50% (0.4808 => 0.4688, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.84% (10.2830 => 10.0936, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6803, std.dev.: 0.0008) SingleSource/UnitTests/Vector/multiplies: -1.65% (2.5528 => 2.5108, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -1.24% (4.6441 => 4.5866, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -1.16% (6.2999 => 6.2269, std.dev.: 0.0068) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2878, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 16.66% (0.5229 => 0.6100, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 14.12% (14.9895 => 17.1057, std.dev.: 0.0145) MultiSource/Benchmarks/MallocBench/gs/gs: 9.19% (4.1105 => 4.4884, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 16.28% (1.1048 => 1.2847, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.72% (7.1582 => 8.2118, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.38% (0.6222 => 0.7739, std.dev.: 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35400.00% (0.0001 => 0.0355, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.70% (0.1485 => 0.1430, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.61% (0.2116 => 0.2129, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 18 21:30:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 18 Oct 2012 23:30:01 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121019043001.C383A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4987?compare_to=4985&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 4987, Order: 166257, Start Time: 2012-10-19 03:08:49, End Time: 2012-10-19 04:32:00 To: 4985, Order: 166254, Start Time: 2012-10-19 01:28:58, End Time: 2012-10-19 02:52:09 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 9 (14 on baseline) Performance Improvements: 4 (7 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 962 (953 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.07% (0.3173 => 0.3302, std.dev.: 0.0041) MultiSource/Applications/oggenc/oggenc: 1.05% (4.9698 => 5.0220, std.dev.: 0.0122) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 24.91% (1.4973 => 1.8703, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.06% (21.7367 => 22.4022, std.dev.: 0.2194) SingleSource/Benchmarks/Shootout-C++/methcall: 2.68% (8.7867 => 9.0220, std.dev.: 0.0214) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.09% (2.4482 => 2.4993, std.dev.: 0.0166) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.51% (4.4213 => 4.4882, std.dev.: 0.0200) MultiSource/Benchmarks/Olden/bh/bh: 1.50% (2.3670 => 2.4024, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/em3d/em3d: 1.13% (5.4008 => 5.4620, std.dev.: 0.0088) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.11% (3.2490 => 3.1804, std.dev.: 0.0143) SingleSource/UnitTests/Vector/constpool: -1.67% (8.5450 => 8.4019, std.dev.: 0.0506) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.52% (60.0954 => 58.5818, std.dev.: 0.4331) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -1.43% (41.7790 => 41.1813, std.dev.: 0.2226) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.41% (16.2717 => 16.3384, std.dev.: 0.0720) MultiSource/Applications/obsequi/Obsequi: 1.05% (1.0245 => 1.0353, std.dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: 0.49% (0.6283 => 0.6314, std.dev.: 0.0133) MultiSource/Benchmarks/McCat/08-main/main: 0.60% (0.1839 => 0.1850, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.83% (0.1562 => 0.1575, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.65% (0.3215 => 0.3162, std.dev.: 0.0093) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.91% (0.2369 => 0.2438, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.27% (0.3255 => 0.3329, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.97% (0.2323 => 0.2392, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -0.17% (0.5930 => 0.5920, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel: -9.49% (0.0474 => 0.0429, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.67% (0.3271 => 0.3293, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/strcat: -1.42% (0.1966 => 0.1938, std.dev.: 0.0013) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -7.14% (0.0238 => 0.0221, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 66.39% (0.0122 => 0.0203, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.60% (0.0411 => 0.0388, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -12.58% (0.0318 => 0.0278, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0300 => 0.0300, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 5.14% (0.0389 => 0.0409, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 16.56% (0.0163 => 0.0190, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 7.37% (0.0190 => 0.0204, std.dev.: 0.0018) SingleSource/UnitTests/byval-alignment: - (0.0338 => 0.0338, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.14% (0.1472 => 0.1474, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.80% (1.1350 => 1.1146, std.dev.: 0.0407) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.65% (0.1454 => 0.1478, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.68% (0.4117 => 0.4048, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.29% (0.1402 => 0.1406, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.46% (0.0609 => 0.0624, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -12.75% (0.0251 => 0.0219, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.23% (0.0558 => 0.0540, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.52% (1.1430 => 1.1370, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 200.00% (0.0001 => 0.0003, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.21% (0.0555 => 0.0595, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 15.29% (0.0170 => 0.0196, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.02% (0.8009 => 0.8011, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -12.37% (0.0097 => 0.0085, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.76% (2.1832 => 1.6645, std.dev.: 0.0016) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.44% (0.0810 => 0.0927, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 1.19% (4.9628 => 5.0220, std.dev.: 0.0122) MultiSource/Applications/SIBsim4/SIBsim4: 1.03% (1.2568 => 1.2697, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 59.04% (1.5795 => 2.5120, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.66% (1.1857 => 1.2765, std.dev.: 0.0053) MultiSource/Benchmarks/mafft/pairlocalalign: 5.97% (63.1822 => 66.9521, std.dev.: 0.0095) MultiSource/Applications/siod/siod: 2.76% (3.6643 => 3.7653, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/ReedSolomon: 2.17% (8.5322 => 8.7174, std.dev.: 0.0535) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.05% (2.4490 => 2.4993, std.dev.: 0.0166) MultiSource/Benchmarks/Olden/bh/bh: 1.97% (2.3560 => 2.4024, std.dev.: 0.0040) MultiSource/Applications/minisat/minisat: 1.56% (6.1525 => 6.2486, std.dev.: 0.0270) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.29% (4.8362 => 4.8987, std.dev.: 0.0220) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.22% (4.4340 => 4.4882, std.dev.: 0.0200) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.07% (2.9096 => 2.9407, std.dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.95% (4.5702 => 4.4809, std.dev.: 0.0298) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.48% (0.6943 => 0.6840, std.dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.59% (0.3269 => 0.3021, std.dev.: 0.0026) MultiSource/Applications/lua/lua: -5.01% (29.8330 => 28.3384, std.dev.: 0.0283) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.87% (7.2130 => 6.9339, std.dev.: 0.0983) SingleSource/Benchmarks/Shootout-C++/hash2: -1.39% (3.4237 => 3.3760, std.dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.33% (3.3479 => 3.3034, std.dev.: 0.0040) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.65% (16.4461 => 16.3384, std.dev.: 0.0720) MultiSource/Applications/obsequi/Obsequi: 0.89% (1.0262 => 1.0353, std.dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: -0.28% (0.6332 => 0.6314, std.dev.: 0.0133) MultiSource/Benchmarks/McCat/08-main/main: 1.04% (0.1831 => 0.1850, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.03% (0.1559 => 0.1575, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.25% (0.3123 => 0.3162, std.dev.: 0.0093) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.02% (0.2463 => 0.2438, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.45% (0.3344 => 0.3329, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.18% (0.2364 => 0.2392, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -1.50% (0.6010 => 0.5920, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel: - (0.0429 => 0.0429, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.83% (0.3266 => 0.3293, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/strcat: -1.57% (0.1969 => 0.1938, std.dev.: 0.0013) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.34% (0.0224 => 0.0221, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 65.04% (0.0123 => 0.0203, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.90% (0.0408 => 0.0388, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 9.45% (0.0254 => 0.0278, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.66% (0.0302 => 0.0300, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 6.51% (0.0384 => 0.0409, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0190 => 0.0190, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 13.33% (0.0180 => 0.0204, std.dev.: 0.0018) SingleSource/UnitTests/byval-alignment: 46.96% (0.0230 => 0.0338, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.50% (0.1438 => 0.1474, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.62% (1.1329 => 1.1146, std.dev.: 0.0407) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.09% (0.1462 => 0.1478, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.79% (0.4164 => 0.4048, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.70% (0.1369 => 0.1406, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.65% (0.0641 => 0.0624, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 12.31% (0.0195 => 0.0219, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.57% (0.0578 => 0.0540, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.59% (1.1437 => 1.1370, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 200.00% (0.0001 => 0.0003, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.10% (0.0627 => 0.0595, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.89% (0.0180 => 0.0196, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.07% (0.8017 => 0.8011, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 37.10% (0.0062 => 0.0085, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 18 21:45:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 18 Oct 2012 23:45:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121019044515.5DDC92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4988?compare_to=4984&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4988, Order: 166257, Start Time: 2012-10-19 03:22:28, End Time: 2012-10-19 04:48:13 To: 4984, Order: 166253, Start Time: 2012-10-19 01:27:14, End Time: 2012-10-19 02:52:58 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (189 on baseline) Performance Improvements: 0 (42 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1041 (673 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.73% (1.2911 => 1.3134, std.dev.: 0.0066) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 22.75% (2.0176 => 2.4767, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 17.38% (0.1410 => 0.1655, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 16.46% (0.0826 => 0.0962, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 16.09% (0.2243 => 0.2604, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 13.62% (0.1013 => 0.1151, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 13.56% (0.2721 => 0.3090, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.19% (0.0834 => 0.0944, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.19% (0.0819 => 0.0927, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 12.69% (1.3693 => 1.5431, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.60% (0.1413 => 0.1591, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 12.59% (0.4328 => 0.4873, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 12.43% (0.4062 => 0.4567, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 12.26% (0.7038 => 0.7901, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.22% (0.1588 => 0.1782, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.14% (3.9660 => 4.4473, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.98% (0.1327 => 0.1486, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.86% (0.2596 => 0.2904, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.83% (0.0964 => 0.1078, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.75% (0.6283 => 0.7021, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.66% (0.7710 => 0.8609, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 11.50% (13.8202 => 15.4098, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.41% (0.9199 => 1.0249, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.41% (1.4563 => 1.6225, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.28% (0.6959 => 0.7744, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 11.17% (0.5818 => 0.6468, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.09% (0.5265 => 0.5849, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: 11.07% (0.1003 => 0.1114, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 10.96% (0.7061 => 0.7835, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.94% (0.4791 => 0.5315, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.93% (1.2193 => 1.3526, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: 10.89% (0.5748 => 0.6374, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.85% (0.5577 => 0.6182) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.79% (0.3485 => 0.3861, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 10.79% (0.2781 => 0.3081, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 10.73% (0.1062 => 0.1176, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.69% (1.1364 => 1.2579, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.64% (0.3899 => 0.4314, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.62% (0.4390 => 0.4856, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.56% (0.4016 => 0.4440, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.54% (0.3130 => 0.3460, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 10.53% (1.0313 => 1.1399, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.50% (0.2782 => 0.3074, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 10.48% (0.3293 => 0.3638, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.38% (0.3756 => 0.4146, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.35% (0.3489 => 0.3850, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.20% (0.1157 => 0.1275, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.19% (0.3022 => 0.3330, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 10.19% (0.3868 => 0.4262, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 10.16% (1.1061 => 1.2185, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: 10.16% (0.2726 => 0.3003, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 10.14% (0.6744 => 0.7428, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.12% (0.7460 => 0.8215, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/sieve: 10.11% (0.3453 => 0.3802, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 10.08% (0.1478 => 0.1627, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.06% (0.1014 => 0.1116, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.05% (0.1075 => 0.1183, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 10.04% (0.2690 => 0.2960, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.03% (0.1276 => 0.1404, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wc: 10.01% (0.2937 => 0.3231, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.91% (0.2655 => 0.2918, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 9.90% (0.1111 => 0.1221, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.90% (0.8698 => 0.9559, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hello: 9.90% (0.2607 => 0.2865, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 9.89% (0.2760 => 0.3033, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.87% (1.9828 => 2.1786, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 9.85% (0.2761 => 0.3033, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 9.84% (0.3149 => 0.3459, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.83% (0.3246 => 0.3565, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 9.82% (16.6129 => 18.2451, std.dev.: 0.0155) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.82% (0.4379 => 0.4809, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 9.82% (0.2995 => 0.3289, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 9.82% (3.1889 => 3.5019, std.dev.: 0.0033) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.79% (0.1072 => 0.1177, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 9.79% (0.3534 => 0.3880, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 9.78% (0.3107 => 0.3411, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 9.78% (0.2628 => 0.2885, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.75% (0.3580 => 0.3929, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.71% (0.2966 => 0.3254, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 9.68% (0.3192 => 0.3501, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.62% (0.1569 => 0.1720, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.62% (0.2765 => 0.3031, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 9.62% (0.7506 => 0.8228, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.62% (0.1986 => 0.2177, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 9.57% (0.1589 => 0.1741, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 9.54% (1.9270 => 2.1109, std.dev.: 0.0119) MultiSource/Benchmarks/McCat/18-imp/imp: 9.53% (0.3220 => 0.3527, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 9.50% (3.8646 => 4.2318, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.50% (0.2696 => 0.2952, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.49% (0.5637 => 0.6172, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 9.46% (0.8310 => 0.9096, std.dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.44% (0.2914 => 0.3189, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.35% (4.9865 => 5.4525, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.24% (0.2023 => 0.2210, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.24% (7.2180 => 7.8848, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.21% (0.2127 => 0.2323, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 9.17% (0.2988 => 0.3262, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 9.15% (2.1791 => 2.3785, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.13% (0.1435 => 0.1566, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.08% (0.3755 => 0.4096, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.06% (0.6576 => 0.7172, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.06% (0.1865 => 0.2034, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 8.92% (0.2925 => 0.3186, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 8.86% (0.2945 => 0.3206, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.86% (0.3511 => 0.3822, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.61% (1.3245 => 1.4385, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/em3d/em3d: 8.57% (0.1657 => 0.1799, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 8.55% (4.6629 => 5.0616, std.dev.: 0.0179) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.52% (0.8818 => 0.9569, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.49% (3.6692 => 3.9807, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.41% (0.2140 => 0.2320, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 8.38% (14.8535 => 16.0989, std.dev.: 0.0168) MultiSource/Benchmarks/nbench/nbench: 8.33% (1.0594 => 1.1477, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.30% (4.3801 => 4.7436, std.dev.: 0.0158) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.26% (4.4433 => 4.8101, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 8.21% (0.6250 => 0.6763, std.dev.: 0.0103) MultiSource/Applications/SIBsim4/SIBsim4: 8.20% (1.2749 => 1.3794, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: 8.11% (0.3131 => 0.3385, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 8.10% (8.4961 => 9.1844, std.dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.87% (0.6135 => 0.6618, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.78% (1.5188 => 1.6369, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.71% (0.1789 => 0.1927, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.69% (0.9108 => 0.9808, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 7.49% (0.4113 => 0.4421, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.43% (0.4805 => 0.5162, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.37% (0.3245 => 0.3484, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.36% (1.1333 => 1.2167, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.36% (3.2742 => 3.5151, std.dev.: 0.0191) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.31% (0.1819 => 0.1952, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.20% (0.2321 => 0.2488, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.17% (2.1007 => 2.2513, std.dev.: 0.0171) SingleSource/UnitTests/ObjC/parameter-passing: 7.14% (0.4003 => 0.4289, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 7.13% (6.5754 => 7.0441, std.dev.: 0.0063) MultiSource/Applications/lua/lua: 7.10% (3.7467 => 4.0129, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions: 7.03% (0.3914 => 0.4189, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 6.97% (0.2008 => 0.2148, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 6.96% (1.2292 => 1.3148, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: 6.93% (0.3578 => 0.3826, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.91% (0.3646 => 0.3898, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 6.89% (0.3789 => 0.4050, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.87% (0.2504 => 0.2676, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 6.83% (0.3601 => 0.3847, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.80% (0.3940 => 0.4208, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.80% (0.3663 => 0.3912, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.66% (0.3650 => 0.3893, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 6.65% (0.3623 => 0.3864, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.38% (6.2785 => 6.6790, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.10% (13.2842 => 14.0947, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 5.06% (16.2614 => 17.0844, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.64% (0.2243 => 0.2347, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 4.17% (14.5298 => 15.1364, std.dev.: 0.0078) MultiSource/Benchmarks/Bullet/bullet: 1.88% (33.2944 => 33.9198, std.dev.: 0.0203) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.61% (5.7573 => 7.5198, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/fbench: 23.91% (1.8175 => 2.2520, std.dev.: 0.0155) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.09% (1.0895 => 1.2757, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 11.19% (1.1560 => 1.2854, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.02% (0.8273 => 0.9019, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.47% (0.1322 => 0.1434, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4146, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.43% (0.9692 => 1.0218) SingleSource/Benchmarks/Misc/mandel-2: 5.16% (1.2998 => 1.3669, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0050, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283) SingleSource/Regression/C/uint64_to_float: 4.46% (0.5449 => 0.5692, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.45% (2.8606 => 2.9880, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7748, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 3.46% (1.9199 => 1.9863, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 3.39% (12.0921 => 12.5016, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.25% (10.7476 => 11.0966, std.dev.: 0.0885) MultiSource/Benchmarks/nbench/nbench: 3.21% (11.2619 => 11.6235, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/bisort/bisort: 2.93% (0.8239 => 0.8480, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.40% (1.0310 => 1.0557, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.16% (7.4271 => 7.5874, std.dev.: 0.0047) MultiSource/Applications/lemon/lemon: 1.77% (1.4298 => 1.4551, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5125, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9696, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1888, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5784, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.18% (9.9194 => 10.0367, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 1.11% (12.4560 => 12.5942, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/queens: 1.01% (2.1753 => 2.1973, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.89% (0.2670 => 0.1418, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.15% (0.4657 => 0.3905, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -14.14% (0.0707 => 0.0607, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.65% (1.3819 => 1.1933, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.60% (1.3813 => 1.1935, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.00% (22.5627 => 22.3361, std.dev.: 0.0116) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.29% (1.0460 => 0.8547, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.78% (0.2238 => 0.1952, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.12% (20.3410 => 18.2823, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2640, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.13% (1.2308 => 1.1553, std.dev.: 0.0049) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5135, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.69% (1.3780 => 1.3134, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.41% (0.9996 => 0.9555, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.78% (1.7688 => 1.7020, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.29% (0.4867 => 0.4707, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -2.89% (3.2729 => 3.1784, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.86% (3.0263 => 2.9397, std.dev.: 0.0021) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8811, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.69% (1.9762 => 1.9231, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.28% (4.1080 => 4.0143, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.09% (0.6589 => 0.6451, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.87% (0.6615 => 0.6491, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -1.83% (6.3560 => 6.2394, std.dev.: 0.0049) MultiSource/Applications/lua/lua: -1.75% (26.5159 => 26.0531, std.dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.67% (0.8342 => 0.8203, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.65% (2.5254 => 2.4837, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0068, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -1.27% (5.3167 => 5.2493, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/heapsort: -1.24% (3.9173 => 3.8686, std.dev.: 0.0077) MultiSource/Benchmarks/mafft/pairlocalalign: -1.22% (28.2225 => 27.8770, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.09% (6.6320 => 6.5594, std.dev.: 0.0121) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1138, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -1.05% (84.4286 => 83.5439, std.dev.: 0.0052) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 18 22:51:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 19 Oct 2012 00:51:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121019055118.763492A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4989?compare_to=4986&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4989, Order: 166261, Start Time: 2012-10-19 04:33:13, End Time: 2012-10-19 05:53:17 To: 4986, Order: 166257, Start Time: 2012-10-19 02:43:28, End Time: 2012-10-19 04:03:35 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (76 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (180 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 91 (15 on baseline) Unchanged Tests: 950 (662 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 10.01% (0.4344 => 0.4779, std.dev.: 0.0167) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.13% (0.6100 => 0.6092, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 0.11% (17.1057 => 17.1247, std.dev.: 0.0102) MultiSource/Benchmarks/Bullet/bullet: -0.01% (55.9163 => 55.9105, std.dev.: 0.0079) MultiSource/Benchmarks/MallocBench/gs/gs: 0.08% (4.4884 => 4.4921, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.22% (0.0465 => 0.0464, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0465 => 0.0465, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0433 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.23% (0.0435 => 0.0434, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.24% (0.0423 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.24% (0.0424 => 0.0423, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0415 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.24% (0.0417 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.23% (0.0434 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0434 => 0.0434, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.23% (0.0428 => 0.0427, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.23% (0.0430 => 0.0429, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0419 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0419 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.23% (0.0426 => 0.0425, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0426 => 0.0426, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0436 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0438 => 0.0438, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0413 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.24% (0.0415 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.24% (0.0425 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.23% (0.0427 => 0.0426) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0416 => 0.0416, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.48% (0.0419 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0408 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0409 => 0.0409, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0408 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.24% (0.0409 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.23% (0.0444 => 0.0443, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0445 => 0.0445, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.25% (0.0407 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0407 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.24% (0.0409 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.24% (0.0410 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.24% (0.0415 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.24% (0.0417 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.40% (1.2847 => 1.2899, std.dev.: 0.0059) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.02% (8.2118 => 8.2135, std.dev.: 0.0166) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.17% (0.7739 => 0.7726, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.56% (0.0355 => 0.0353, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: - (0.1430 => 0.1430, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: - (0.1648 => 0.1648, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.19% (0.2129 => 0.2125, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 0.05% (10.0256 => 10.0306, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.60% (63.2438 => 55.9105, std.dev.: 0.0079) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 0.55% (0.1639 => 0.1648, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 4.88% (9.5636 => 10.0306, std.dev.: 0.0009) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 35.35% (14.1553 => 19.1592, std.dev.: 0.0133) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.64% (3.4629 => 5.7706, std.dev.: 0.0017) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13410.83% (0.0720 => 9.7278, std.dev.: 0.0143) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049600.00% (0.0001 => 10.0497, std.dev.: 0.0010) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 61.90% (0.2554 => 0.4135, std.dev.: 0.0003) SingleSource/Regression/C/matrixTranspose: 57.55% (0.0245 => 0.0386) SingleSource/Benchmarks/Misc/lowercase: 51.56% (0.0256 => 0.0388, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 50.75% (10.3673 => 15.6288, std.dev.: 0.0106) SingleSource/UnitTests/SignlessTypes/factor: 41.22% (0.0296 => 0.0418, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 37.61% (0.1622 => 0.2232, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 35.04% (0.1056 => 0.1426, std.dev.: 0.0000) SingleSource/UnitTests/vla: 29.30% (0.0355 => 0.0459, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 23.23% (0.2049 => 0.2525, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 22.06% (0.0834 => 0.1018, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.28% (0.1236 => 0.1499, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.24% (0.1566 => 0.1883, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 19.27% (0.1432 => 0.1708, std.dev.: 0.0033) MultiSource/Benchmarks/NPB-serial/is/is: 19.19% (0.0719 => 0.0857, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 18.43% (0.1584 => 0.1876) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.02% (7.0540 => 8.3251, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.99% (2.2022 => 2.5984, std.dev.: 0.0114) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.76% (0.0871 => 0.1017, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 16.73% (0.5105 => 0.5959, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 16.66% (0.6675 => 0.7787, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 15.61% (3.3354 => 3.8561, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 15.47% (0.1655 => 0.1911, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 14.99% (10.4361 => 12.0000, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 14.88% (1.3050 => 1.4992, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: 14.44% (0.3282 => 0.3756, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.42% (0.5020 => 0.5744, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 14.32% (0.7115 => 0.8134, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.90% (1.5415 => 1.7558, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.74% (1.7609 => 2.0029, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.69% (0.2271 => 0.2582) MultiSource/Benchmarks/Olden/power/power: 13.68% (0.1440 => 0.1637, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.66% (0.1032 => 0.1173, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 13.36% (9.4845 => 10.7515, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.05% (0.1510 => 0.1707, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 13.03% (0.3109 => 0.3514, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/18-imp/imp: 12.77% (0.3423 => 0.3860, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.69% (4.2646 => 4.8057, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 12.65% (0.0838 => 0.0944, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: 12.59% (0.0818 => 0.0921) MultiSource/Applications/oggenc/oggenc: 12.53% (5.7591 => 6.4808, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/em3d/em3d: 12.45% (0.1695 => 0.1906, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 12.25% (0.6450 => 0.7240, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.24% (0.4615 => 0.5180, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.19% (0.1337 => 0.1500, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 12.16% (0.3387 => 0.3799, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.09% (0.1695 => 0.1900, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/tsp/tsp: 12.09% (0.1175 => 0.1317, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 12.08% (1.0722 => 1.2017, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 11.98% (8.1363 => 9.1110, std.dev.: 0.0077) MultiSource/Benchmarks/FreeBench/neural/neural: 11.89% (0.1463 => 0.1637, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 11.79% (1.1840 => 1.3236, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/life/life: 11.79% (0.0933 => 0.1043, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 11.79% (0.7433 => 0.8309, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.78% (0.2700 => 0.3018, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 11.70% (0.1555 => 0.1737, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 11.69% (0.1163 => 0.1299, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.61% (0.3307 => 0.3691, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.60% (0.1940 => 0.2165, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 11.60% (1.1642 => 1.2992, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 11.55% (2.0273 => 2.2615, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.51% (7.9617 => 8.8781, std.dev.: 0.0074) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.46% (0.3177 => 0.3541, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.42% (0.9765 => 1.0880, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.40% (0.1438 => 0.1602, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.34% (4.9449 => 5.5057, std.dev.: 0.0119) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.30% (0.0929 => 0.1034, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.28% (5.0018 => 5.5660, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.28% (0.1330 => 0.1480, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 11.25% (3.8723 => 4.3078, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.14% (0.5860 => 0.6513, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.14% (0.1625 => 0.1806, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 11.12% (0.1151 => 0.1279, std.dev.: 0.0007) SingleSource/UnitTests/SignlessTypes/rem: 11.01% (0.1144 => 0.1270, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.97% (1.5859 => 1.7598, std.dev.: 0.0195) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.97% (0.4879 => 0.5414, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.87% (0.2107 => 0.2336, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 10.86% (0.8921 => 0.9890, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 10.83% (1.1861 => 1.3146, std.dev.: 0.0065) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.80% (0.3121 => 0.3458, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 10.76% (0.7835 => 0.8678, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.64% (0.3543 => 0.3920, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 10.59% (0.6456 => 0.7140, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.58% (0.1125 => 0.1244, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.52% (0.8067 => 0.8916, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.44% (0.1906 => 0.2105, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 10.40% (0.4299 => 0.4746, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.33% (2.2024 => 2.4298, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.22% (0.2758 => 0.3040, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.16% (0.3473 => 0.3826, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.05% (0.3543 => 0.3899, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.05% (0.8172 => 0.8993, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.05% (1.4186 => 1.5611, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.03% (0.1117 => 0.1229, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.02% (0.2266 => 0.2493, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.01% (0.1029 => 0.1132, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.01% (0.3927 => 0.4320, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.99% (0.3694 => 0.4063, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.98% (0.3497 => 0.3846, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 9.94% (0.3561 => 0.3915, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions: 9.93% (0.3828 => 0.4208, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 9.91% (0.2603 => 0.2861, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 9.90% (0.3516 => 0.3864, std.dev.: 0.0055) MultiSource/Applications/JM/lencod/lencod: 9.71% (21.9371 => 24.0677, std.dev.: 0.0188) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.70% (0.1062 => 0.1165, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.62% (0.3886 => 0.4260, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.61% (0.5569 => 0.6104, std.dev.: 0.0082) MultiSource/Applications/siod/siod: 9.59% (2.2969 => 2.5172, std.dev.: 0.0062) MultiSource/Applications/hbd/hbd: 9.54% (1.5603 => 1.7091, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 9.44% (0.4620 => 0.5056, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 9.40% (0.4289 => 0.4692, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 9.38% (0.3092 => 0.3382, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 9.28% (0.3180 => 0.3475, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.25% (0.3826 => 0.4180, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.11% (0.4203 => 0.4586, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.01% (0.3441 => 0.3751, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: 8.91% (0.1268 => 0.1381, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.80% (0.3865 => 0.4205, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 8.74% (0.3422 => 0.3721, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.72% (0.2065 => 0.2245, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/moments: 8.57% (0.4048 => 0.4395, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.48% (0.4636 => 0.5029, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.39% (0.5981 => 0.6483, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.37% (0.6030 => 0.6535, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.35% (0.5925 => 0.6420, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists1: 8.28% (0.3684 => 0.3989, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.25% (0.1892 => 0.2048, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.09% (0.4103 => 0.4435, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 8.05% (0.3603 => 0.3893, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.88% (0.3427 => 0.3697, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.81% (0.7326 => 0.7898, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 7.80% (17.1811 => 18.5209, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.56% (0.3650 => 0.3926, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.11% (0.4064 => 0.4353, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.10% (3.8922 => 4.1685, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.05% (14.3668 => 15.3798, std.dev.: 0.0231) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.97% (0.8101 => 0.8666, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 6.97% (0.3098 => 0.3314, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.95% (0.3136 => 0.3354, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.92% (0.2905 => 0.3106, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.79% (0.2872 => 0.3067, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.78% (0.2831 => 0.3023, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.77% (0.3162 => 0.3376, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.3283 => 0.3505, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.71% (0.3232 => 0.3449, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.68% (0.2891 => 0.3084, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.48% (2.0665 => 2.2004, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 6.48% (0.2871 => 0.3057, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.33% (0.2877 => 0.3059, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.28% (0.2756 => 0.2929, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.19% (0.2793 => 0.2966, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 6.19% (0.3379 => 0.3588, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.17% (0.2725 => 0.2893, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.16% (0.3052 => 0.3240, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.97% (0.2714 => 0.2876, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.92% (0.2802 => 0.2968, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 5.64% (1.2842 => 1.3566, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (0.3131 => 0.3293, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.06% (0.2430 => 0.2553, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.64% (1.1194 => 1.1489, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3123, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.71% (2.6778 => 2.9647, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.96% (1.1396 => 1.2531, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 9.74% (0.9957 => 1.0927, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/hash2: 6.71% (3.1578 => 3.3698, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: 5.92% (1.9405 => 2.0553, std.dev.: 0.0097) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.73% (4.2280 => 4.3435, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7650, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.90% (3.6395 => 3.7086, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/bisort/bisort: 1.75% (0.8333 => 0.8479, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 1.54% (3.1595 => 3.2081, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.48% (2.6546 => 2.6940, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.14% (9.1159 => 9.2202, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.05% (6.6874 => 0.1307, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -80.11% (0.8651 => 0.1721, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.99% (5.2763 => 3.2192, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.34% (5.3855 => 3.6975, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.90% (5.3526 => 3.6987, std.dev.: 0.0021) SingleSource/UnitTests/Vector/constpool: -14.64% (54.1659 => 46.2374, std.dev.: 0.0207) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.48% (2.9384 => 2.6306, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -7.56% (22.1758 => 20.5003, std.dev.: 0.0150) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.08% (8.0499 => 3.7767, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.29% (1.1492 => 0.7666, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4233, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.93% (0.0998 => 0.0849, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.55% (1.2373 => 1.0944, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3453 => 2.9599, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -10.98% (1.5373 => 1.3685, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.33% (19.9488 => 18.2863, std.dev.: 0.1158) MultiSource/Benchmarks/FreeBench/mason/mason: -8.01% (0.2161 => 0.1988, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.49% (1.6805 => 1.5546, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.87% (1.8329 => 1.7070, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.47% (1.5835 => 1.5127, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.40% (8.1563 => 7.7976, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1626, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8775, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4966, std.dev.: 0.0064) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.52% (0.4808 => 0.4687, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -1.78% (10.2830 => 10.0996, std.dev.: 0.0050) SingleSource/UnitTests/Vector/multiplies: -1.72% (2.5528 => 2.5088, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6832, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -1.23% (4.6441 => 4.5870, std.dev.: 0.0083) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2878, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2359, std.dev.: 0.0015) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 16.50% (0.5229 => 0.6092, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 14.24% (14.9895 => 17.1247, std.dev.: 0.0102) MultiSource/Benchmarks/MallocBench/gs/gs: 9.28% (4.1105 => 4.4921, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 16.75% (1.1048 => 1.2899, std.dev.: 0.0059) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.74% (7.1582 => 8.2135, std.dev.: 0.0166) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.17% (0.6222 => 0.7726, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35200.00% (0.0001 => 0.0353, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -3.70% (0.1485 => 0.1430, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.43% (0.2116 => 0.2125, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 18 23:10:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 19 Oct 2012 01:10:54 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121019061054.165582A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4990?compare_to=4987&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 4990, Order: 166263, Start Time: 2012-10-19 04:49:12, End Time: 2012-10-19 06:12:54 To: 4987, Order: 166257, Start Time: 2012-10-19 03:08:49, End Time: 2012-10-19 04:32:00 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 10 (10 on baseline) Performance Improvements: 3 (6 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 962 (958 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-12-11-LoadConstants: 12.62% (0.1014 => 0.1142, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.46% (0.7936 => 0.8290, std.dev.: 0.0136) MultiSource/Applications/lua/lua: 2.10% (3.7448 => 3.8234, std.dev.: 0.0256) MultiSource/Applications/lambda-0_1_3/lambda: 2.03% (0.7375 => 0.7525, std.dev.: 0.0024) MultiSource/Applications/siod/siod: 1.53% (2.2102 => 2.2440, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.20% (0.9717 => 0.9834, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.02% (0.3340 => 0.3441, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.51% (58.5818 => 60.0539, std.dev.: 0.3193) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.11% (6.9339 => 7.0799, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/ReedSolomon: 1.22% (8.7174 => 8.8239, std.dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -1.19% (1.4378 => 1.4207, std.dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -2.66% (22.4022 => 21.8069, std.dev.: 0.1880) MultiSource/Applications/SIBsim4/SIBsim4: -1.17% (3.2213 => 3.1837, std.dev.: 0.0073) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 1.33% (16.3384 => 16.5563, std.dev.: 0.0475) MultiSource/Applications/obsequi/Obsequi: -1.74% (1.0353 => 1.0173, std.dev.: 0.0141) MultiSource/Applications/sqlite3/sqlite3: - (0.6314 => 0.6314, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -0.05% (0.1850 => 0.1849, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.95% (0.1575 => 0.1653, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.04% (0.3162 => 0.3195, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.15% (0.2438 => 0.2410, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.39% (0.3329 => 0.3316, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.17% (0.2392 => 0.2340, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 0.76% (0.5920 => 0.5965, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/mandel: -8.86% (0.0429 => 0.0391, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/reversefile: -1.15% (0.3293 => 0.3255, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: -0.10% (0.1938 => 0.1936, std.dev.: 0.0017) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.90% (0.0221 => 0.0219, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.49% (0.0203 => 0.0204, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.41% (0.0388 => 0.0409, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 9.35% (0.0278 => 0.0304, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.33% (0.0300 => 0.0299, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -22.25% (0.0409 => 0.0318, std.dev.: 0.0046) SingleSource/UnitTests/Vector/Altivec/casts: -0.53% (0.0190 => 0.0189, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -5.88% (0.0204 => 0.0192, std.dev.: 0.0008) SingleSource/UnitTests/byval-alignment: -6.80% (0.0338 => 0.0315, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.34% (0.1474 => 0.1469, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.99% (1.1146 => 1.1256, std.dev.: 0.0126) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.27% (0.1478 => 0.1482, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.30% (0.4048 => 0.4036, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.64% (0.1406 => 0.1397, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.48% (0.0624 => 0.0627, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 26.48% (0.0219 => 0.0277, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.85% (0.0540 => 0.0550, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.50% (1.1370 => 1.1427, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 633.33% (0.0003 => 0.0022, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -74.07% (0.0027 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.03% (0.0595 => 0.0613, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.08% (0.0196 => 0.0204, std.dev.: 0.0061) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.20% (0.8011 => 0.8027, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 400.00% (0.0001 => 0.0005, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 200.00% (0.0001 => 0.0003, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -8.24% (0.0085 => 0.0078, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.90% (2.1832 => 1.6614, std.dev.: 0.0063) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.51% (0.9688 => 0.9834, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.47% (1.5795 => 2.5031, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.11% (1.1857 => 1.2819, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.00% (0.3186 => 0.3441, std.dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: 5.87% (63.1822 => 66.8931, std.dev.: 0.0349) SingleSource/Benchmarks/Misc/ReedSolomon: 3.42% (8.5322 => 8.8239, std.dev.: 0.0047) MultiSource/Applications/siod/siod: 3.26% (3.6643 => 3.7838, std.dev.: 0.0214) SingleSource/Benchmarks/Shootout-C++/hash: 2.26% (0.6205 => 0.6345, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.41% (1.5866 => 1.6090, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.17% (1.5941 => 1.6128, std.dev.: 0.0069) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -1.07% (0.9810 => 0.9705, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.44% (0.3269 => 0.2993, std.dev.: 0.0013) MultiSource/Applications/lua/lua: -5.37% (29.8330 => 28.2322, std.dev.: 0.1202) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -2.21% (22.2997 => 21.8069, std.dev.: 0.1880) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -1.85% (7.2130 => 7.0799, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/hash2: -1.61% (3.4237 => 3.3686, std.dev.: 0.0063) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.67% (16.4461 => 16.5563, std.dev.: 0.0475) MultiSource/Applications/obsequi/Obsequi: -0.87% (1.0262 => 1.0173, std.dev.: 0.0141) MultiSource/Applications/sqlite3/sqlite3: -0.28% (0.6332 => 0.6314, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 0.98% (0.1831 => 0.1849, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 6.03% (0.1559 => 0.1653, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.31% (0.3123 => 0.3195, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.15% (0.2463 => 0.2410, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.84% (0.3344 => 0.3316, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.02% (0.2364 => 0.2340, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: -0.75% (0.6010 => 0.5965, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/mandel: -8.86% (0.0429 => 0.0391, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.34% (0.3266 => 0.3255, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: -1.68% (0.1969 => 0.1936, std.dev.: 0.0017) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -2.23% (0.0224 => 0.0219, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 65.85% (0.0123 => 0.0204, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.25% (0.0408 => 0.0409, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 19.69% (0.0254 => 0.0304, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.99% (0.0302 => 0.0299, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -17.19% (0.0384 => 0.0318, std.dev.: 0.0046) SingleSource/UnitTests/Vector/Altivec/casts: -0.53% (0.0190 => 0.0189, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 6.67% (0.0180 => 0.0192, std.dev.: 0.0008) SingleSource/UnitTests/byval-alignment: 36.96% (0.0230 => 0.0315, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.16% (0.1438 => 0.1469, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -0.64% (1.1329 => 1.1256, std.dev.: 0.0126) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.37% (0.1462 => 0.1482, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.07% (0.4164 => 0.4036, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.05% (0.1369 => 0.1397, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.18% (0.0641 => 0.0627, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.84% (0.0578 => 0.0550, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.09% (1.1437 => 1.1427, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2100.00% (0.0001 => 0.0022, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -50.00% (0.0014 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.23% (0.0627 => 0.0613, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 13.33% (0.0180 => 0.0204, std.dev.: 0.0061) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.12% (0.8017 => 0.8027, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 400.00% (0.0001 => 0.0005, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 200.00% (0.0001 => 0.0003, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 25.81% (0.0062 => 0.0078, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 18 23:41:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 19 Oct 2012 01:41:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121019064107.29EBE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4991?compare_to=4988&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4991, Order: 166264, Start Time: 2012-10-19 05:18:08, End Time: 2012-10-19 06:44:05 To: 4988, Order: 166257, Start Time: 2012-10-19 03:22:28, End Time: 2012-10-19 04:48:13 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 15 (193 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1027 (672 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.52% (2.4767 => 2.5143, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.44% (0.7285 => 0.7390, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 1.31% (18.2451 => 18.4836, std.dev.: 0.0186) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.24% (22.3361 => 22.6141, std.dev.: 0.0048) MultiSource/Applications/lemon/lemon: 1.21% (1.1399 => 1.1537, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.17% (3.5151 => 3.5563, std.dev.: 0.0065) MultiSource/Applications/JM/lencod/lencod: 1.17% (16.0989 => 16.2867, std.dev.: 0.0106) MultiSource/Applications/SIBsim4/SIBsim4: 1.12% (1.3794 => 1.3948, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 1.12% (7.0441 => 7.1227, std.dev.: 0.0018) MultiSource/Applications/siod/siod: 1.07% (2.3785 => 2.4040, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 1.04% (1.1477 => 1.1596, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.03% (14.0947 => 14.2405, std.dev.: 0.0108) MultiSource/Applications/d/make_dparser: 1.01% (3.5019 => 3.5374, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.00% (4.7436 => 4.7912, std.dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.39% (54.4791 => 56.3244, std.dev.: 0.0541) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.62% (2.0176 => 2.5143, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.58% (0.1410 => 0.1672, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 17.80% (0.0826 => 0.0973, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 16.81% (0.2243 => 0.2620, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 15.62% (0.0653 => 0.0755, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 14.51% (0.1013 => 0.1160, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.09% (0.1072 => 0.1223, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.03% (0.0834 => 0.0951, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.79% (0.1327 => 0.1510, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 13.71% (0.2721 => 0.3094, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.66% (0.1413 => 0.1606) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.64% (0.0770 => 0.0875, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.54% (0.1588 => 0.1803, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 13.42% (0.4328 => 0.4909, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 13.41% (0.7038 => 0.7982, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.13% (3.9660 => 4.4867, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/hash: 12.88% (0.4062 => 0.4585, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 12.78% (1.3693 => 1.5443, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.73% (0.6283 => 0.7083, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.66% (0.0964 => 0.1086, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 12.46% (13.8202 => 15.5418, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.33% (0.2596 => 0.2916, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.27% (0.6959 => 0.7813, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.25% (0.4791 => 0.5378, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 12.15% (0.1062 => 0.1191, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.14% (0.5265 => 0.5904, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.13% (0.9199 => 1.0315, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.03% (1.4563 => 1.6315, std.dev.: 0.0051) MultiSource/Applications/lemon/lemon: 11.87% (1.0313 => 1.1537, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.82% (0.3899 => 0.4360, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 11.76% (0.1003 => 0.1121, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 11.70% (0.7061 => 0.7887, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.69% (1.2193 => 1.3618, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.65% (0.7710 => 0.8608, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.62% (1.1364 => 1.2684, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference-object: 11.53% (0.5818 => 0.6489, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.50% (0.3130 => 0.3490, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 11.34% (0.6744 => 0.7509, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.32% (0.1157 => 0.1288, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.31% (0.3485 => 0.3879, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 11.26% (16.6129 => 18.4836, std.dev.: 0.0186) SingleSource/Regression/C++/ofstream_ctor: 11.25% (0.2781 => 0.3094, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.23% (0.4016 => 0.4467, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.16% (0.4390 => 0.4880, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 11.15% (0.5748 => 0.6389, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 11.05% (1.1061 => 1.2283, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.02% (0.3756 => 0.4170, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 11.02% (0.2995 => 0.3325, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.97% (0.5577 => 0.6189, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 10.96% (0.3293 => 0.3654, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 10.93% (3.1889 => 3.5374, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.86% (0.8698 => 0.9643, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.83% (0.1569 => 0.1739, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.82% (0.3022 => 0.3349, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.82% (0.2782 => 0.3083, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 10.76% (0.1589 => 0.1760, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.76% (0.4379 => 0.4850, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 10.75% (0.3868 => 0.4284, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.75% (0.3489 => 0.3864, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.74% (0.1276 => 0.1413, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 10.67% (0.2690 => 0.2977, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.64% (0.3580 => 0.3961, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 10.57% (0.3453 => 0.3818, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 10.56% (0.3220 => 0.3560, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 10.55% (0.2607 => 0.2882, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.47% (0.2655 => 0.2933, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.44% (0.3246 => 0.3585, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.44% (0.7460 => 0.8239, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/mst/mst: 10.44% (0.1111 => 0.1227, std.dev.: 0.0034) MultiSource/Applications/treecc/treecc: 10.43% (1.9270 => 2.1280, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.42% (0.1075 => 0.1187, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.39% (4.9865 => 5.5047, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/strcat: 10.38% (0.2726 => 0.3009, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 10.35% (0.1478 => 0.1631, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.34% (1.9828 => 2.1879, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 10.33% (0.3534 => 0.3899, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 10.32% (2.1791 => 2.4040, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 10.32% (0.2937 => 0.3240, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 10.30% (3.8646 => 4.2627, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/football/football: 10.29% (0.8310 => 0.9165, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/methcall: 10.29% (0.2761 => 0.3045, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.24% (0.1435 => 0.1582, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 10.22% (0.2760 => 0.3042, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary3: 10.19% (0.3149 => 0.3470, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.19% (0.2914 => 0.3211, std.dev.: 0.0021) MultiSource/Applications/spiff/spiff: 10.18% (0.7506 => 0.8270, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary2: 10.15% (0.3192 => 0.3516, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 10.14% (0.3107 => 0.3422, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 10.12% (0.2628 => 0.2894, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.11% (0.2966 => 0.3266, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.08% (0.1865 => 0.2053, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.05% (0.2696 => 0.2967, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.04% (0.5637 => 0.6203, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 10.02% (0.2925 => 0.3218, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.01% (7.2180 => 7.9403, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.98% (0.2765 => 0.3041, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.96% (0.1014 => 0.1115, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.84% (0.2023 => 0.2222, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.78% (0.2127 => 0.2335, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.67% (0.1986 => 0.2178, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 9.65% (14.8535 => 16.2867, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.64% (0.3755 => 0.4117, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 9.61% (0.2988 => 0.3275, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 9.53% (4.6629 => 5.1072, std.dev.: 0.0203) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.48% (3.6692 => 4.0172, std.dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 9.46% (1.0594 => 1.1596, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.45% (0.8818 => 0.9651, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.42% (1.3245 => 1.4493, std.dev.: 0.0032) MultiSource/Applications/SIBsim4/SIBsim4: 9.40% (1.2749 => 1.3948, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.39% (4.3801 => 4.7912, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/objinst: 9.30% (0.2945 => 0.3219, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.30% (4.4433 => 4.8565, std.dev.: 0.0105) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.29% (0.3511 => 0.3837, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 9.23% (0.1657 => 0.1810, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.14% (0.6135 => 0.6696, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 9.07% (0.3131 => 0.3415, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.06% (0.6576 => 0.7172, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 8.98% (8.4961 => 9.2590, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.97% (1.5188 => 1.6550, std.dev.: 0.0176) SingleSource/Benchmarks/Misc-C++/bigfib: 8.85% (0.6250 => 0.6803, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.69% (0.2140 => 0.2326, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.62% (3.2742 => 3.5563, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.56% (0.9108 => 0.9888, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.53% (0.4805 => 0.5215, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.50% (0.1789 => 0.1941, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 8.34% (0.4113 => 0.4456, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 8.32% (6.5754 => 7.1227, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.32% (0.2321 => 0.2514, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.17% (0.3245 => 0.3510, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1385 => 0.1498, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.14% (2.1007 => 2.2716, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.12% (1.1333 => 1.2253, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 8.05% (3.7467 => 4.0483, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 7.97% (0.2008 => 0.2168, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.79% (0.2504 => 0.2699, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 7.57% (1.2292 => 1.3223, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.32% (6.2785 => 6.7380, std.dev.: 0.0091) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.26% (0.1819 => 0.1951, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.20% (13.2842 => 14.2405, std.dev.: 0.0108) SingleSource/UnitTests/ObjC/parameter-passing: 7.14% (0.4003 => 0.4289, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 6.90% (0.3914 => 0.4184, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.75% (0.3940 => 0.4206, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.62% (0.3789 => 0.4040, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 6.60% (0.3578 => 0.3814, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.58% (0.3646 => 0.3886, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 6.55% (0.3663 => 0.3903, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.50% (0.3601 => 0.3835, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 6.49% (0.3623 => 0.3858, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.38% (0.3650 => 0.3883, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 6.13% (0.1777 => 0.1886, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 6.11% (16.2614 => 17.2542, std.dev.: 0.0237) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.44% (0.2243 => 0.2365, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 4.92% (14.5298 => 15.2451, std.dev.: 0.0162) MultiSource/Benchmarks/Bullet/bullet: 2.43% (33.2944 => 34.1045, std.dev.: 0.0138) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/methcall: 30.48% (5.7573 => 7.5122, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/fbench: 25.05% (1.8175 => 2.2727, std.dev.: 0.0355) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.14% (1.0895 => 1.2762) SingleSource/Benchmarks/Misc/richards_benchmark: 11.15% (1.1560 => 1.2849, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 8.98% (0.8273 => 0.9016, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4140, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.42% (0.9692 => 1.0217, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: 5.37% (1.2998 => 1.3696, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.67% (1.9144 => 2.0038, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 4.48% (0.5449 => 0.5693, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.45% (2.8606 => 2.9880, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.39% (10.7476 => 11.1118, std.dev.: 0.0376) MultiSource/Applications/hexxagon/hexxagon: 3.37% (12.0921 => 12.5000, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 3.28% (1.9199 => 1.9829, std.dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 3.22% (11.2619 => 11.6241, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 2.94% (0.8239 => 0.8481, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0310 => 1.0559, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.23% (7.4271 => 7.5927, std.dev.: 0.0041) MultiSource/Applications/lemon/lemon: 1.69% (1.4298 => 1.4540, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5135, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9697, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1877, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5784, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.16% (9.9194 => 10.0347, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.09% (8.8259 => 8.9223, std.dev.: 0.0116) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5885, std.dev.: 0.0099) SingleSource/Benchmarks/McGill/queens: 1.00% (2.1753 => 2.1971, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.48% (0.2670 => 0.1429) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.36% (0.4657 => 0.3895, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.22% (1.3813 => 1.1987, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.16% (1.3819 => 1.2000, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.28% (1.0460 => 0.8548, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -12.69% (0.2238 => 0.1954, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.18% (20.3410 => 18.2705, std.dev.: 0.0218) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -5.87% (1.2308 => 1.1585, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0049) SingleSource/UnitTests/Vector/multiplies: -5.06% (2.6470 => 2.5130, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.62% (1.3780 => 1.3144, std.dev.: 0.0113) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.58% (0.9996 => 0.9538, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.83% (1.7688 => 1.7011, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.02% (0.4867 => 0.4720, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -2.89% (3.2729 => 3.1784, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -2.88% (3.0263 => 2.9392, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: -2.73% (1.9762 => 1.9222, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8811, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.25% (4.1080 => 4.0157, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.00% (0.6589 => 0.6457, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.87% (0.6615 => 0.6491, std.dev.: 0.0013) MultiSource/Applications/lua/lua: -1.83% (26.5159 => 26.0313, std.dev.: 0.0473) SingleSource/Benchmarks/Shootout/lists: -1.73% (6.3560 => 6.2459, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.68% (0.8342 => 0.8202, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.65% (2.5254 => 2.4838, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0064, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.24% (28.2225 => 27.8729, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: -1.22% (5.3167 => 5.2519, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/heapsort: -1.14% (3.9173 => 3.8726, std.dev.: 0.0039) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1139, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -1.05% (84.4286 => 83.5392, std.dev.: 0.0065) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 19 00:45:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 19 Oct 2012 02:45:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121019074507.054922A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/4992?compare_to=4989&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4992, Order: 166266, Start Time: 2012-10-19 06:22:43, End Time: 2012-10-19 07:47:05 To: 4989, Order: 166261, Start Time: 2012-10-19 04:33:13, End Time: 2012-10-19 05:53:17 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (76 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (183 on baseline) Performance Improvements: 1 (41 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 91 (15 on baseline) Unchanged Tests: 948 (661 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.64% (0.8916 => 0.9151, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.30% (77.8921 => 80.4643, std.dev.: 0.3420) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.14% (15.6288 => 15.4507, std.dev.: 0.0025) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 1.85% (0.6092 => 0.6205, std.dev.: 0.0164) MultiSource/Applications/SPASS/SPASS: 0.10% (17.1247 => 17.1418, std.dev.: 0.3406) MultiSource/Benchmarks/Bullet/bullet: 0.48% (55.9105 => 56.1788, std.dev.: 0.0867) MultiSource/Benchmarks/MallocBench/gs/gs: 0.56% (4.4921 => 4.5171, std.dev.: 0.0456) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.22% (0.0464 => 0.0463, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.22% (0.0465 => 0.0466) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0433 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.23% (0.0434 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0422 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.24% (0.0423 => 0.0424) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.24% (0.0415 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.24% (0.0416 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.23% (0.0433 => 0.0434) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.23% (0.0434 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.23% (0.0427 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.23% (0.0429 => 0.0430, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.24% (0.0419 => 0.0420, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.24% (0.0419 => 0.0420) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.24% (0.0425 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.23% (0.0426 => 0.0427, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0436 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0438 => 0.0438, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.24% (0.0413 => 0.0414) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.24% (0.0414 => 0.0415) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.24% (0.0424 => 0.0425, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0426 => 0.0426, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.24% (0.0416 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.24% (0.0417 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.25% (0.0408 => 0.0409, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0409 => 0.0409, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0408 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.49% (0.0408 => 0.0410) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.45% (0.0443 => 0.0445, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.22% (0.0445 => 0.0446, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0406 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0407 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0408 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.24% (0.0409 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.24% (0.0414 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0416 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.24% (1.2899 => 1.2868, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.30% (8.2135 => 8.1885, std.dev.: 0.0114) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.04% (0.7726 => 0.7729, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.57% (0.0353 => 0.0351, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1430 => 0.1431, std.dev.: 0.0080) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -0.06% (0.1648 => 0.1647, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.24% (0.2125 => 0.2130, std.dev.: 0.0035) MultiSource/Benchmarks/NPB-serial/is/is: -0.02% (10.0306 => 10.0283, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.17% (63.2438 => 56.1788, std.dev.: 0.0867) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 0.49% (0.1639 => 0.1647, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 4.86% (9.5636 => 10.0283, std.dev.: 0.0017) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 35.99% (14.1553 => 19.2494, std.dev.: 0.0328) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.36% (3.4629 => 5.7609, std.dev.: 0.0041) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13408.47% (0.0720 => 9.7261, std.dev.: 0.1594) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050300.00% (0.0001 => 10.0504, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.51% (0.2554 => 0.4176, std.dev.: 0.0016) SingleSource/Regression/C/matrixTranspose: 57.55% (0.0245 => 0.0386) SingleSource/Benchmarks/Misc/lowercase: 51.95% (0.0256 => 0.0389, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 49.03% (10.3673 => 15.4507, std.dev.: 0.0025) SingleSource/UnitTests/SignlessTypes/factor: 41.55% (0.0296 => 0.0419, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 38.72% (0.1622 => 0.2250, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 35.13% (0.1056 => 0.1427, std.dev.: 0.0011) SingleSource/UnitTests/vla: 29.30% (0.0355 => 0.0459, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: 22.94% (0.2049 => 0.2519, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 22.90% (0.0834 => 0.1025, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.76% (0.1236 => 0.1505, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.31% (0.1566 => 0.1884, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 19.33% (0.0719 => 0.0858, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 19.13% (0.1584 => 0.1887, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 18.02% (0.1432 => 0.1690, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.66% (2.2022 => 2.5910, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.49% (7.0540 => 8.2879, std.dev.: 0.0181) MultiSource/Applications/viterbi/viterbi: 17.11% (0.1555 => 0.1821, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.99% (0.0871 => 0.1019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 16.75% (0.5105 => 0.5960, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 16.64% (0.6675 => 0.7786, std.dev.: 0.0128) MultiSource/Applications/d/make_dparser: 15.70% (3.3354 => 3.8592, std.dev.: 0.0714) SingleSource/Benchmarks/McGill/chomp: 15.59% (0.1655 => 0.1913, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.13% (1.3050 => 1.5024, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.50% (0.5020 => 0.5748, std.dev.: 0.0034) MultiSource/Applications/minisat/minisat: 14.28% (0.7115 => 0.8131, std.dev.: 0.0206) SingleSource/Benchmarks/Misc/oourafft: 14.23% (0.3282 => 0.3749, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 14.22% (0.3109 => 0.3551, std.dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.15% (0.1032 => 0.1178, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.11% (1.5415 => 1.7590, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.11% (0.0730 => 0.0833, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.09% (0.1625 => 0.1854, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 14.03% (0.1440 => 0.1642, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 13.90% (0.1151 => 0.1311, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.87% (0.2271 => 0.2586, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.44% (0.8067 => 0.9151, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.31% (0.1510 => 0.1711, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.22% (1.7609 => 1.9937, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/18-imp/imp: 13.18% (0.3423 => 0.3874, std.dev.: 0.0056) MultiSource/Benchmarks/mafft/pairlocalalign: 13.08% (9.4845 => 10.7253, std.dev.: 0.0185) SingleSource/Benchmarks/Shootout/matrix: 13.08% (0.0818 => 0.0925, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.00% (0.4615 => 0.5215, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/em3d/em3d: 12.92% (0.1695 => 0.1914, std.dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 12.74% (5.7591 => 6.4926, std.dev.: 0.1208) MultiSource/Benchmarks/Olden/tsp/tsp: 12.68% (0.1175 => 0.1324, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.63% (4.2646 => 4.8034, std.dev.: 0.0086) MultiSource/Applications/spiff/spiff: 12.48% (0.7835 => 0.8813, std.dev.: 0.0219) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.43% (0.0933 => 0.1049, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.42% (0.1337 => 0.1503, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 12.39% (0.6450 => 0.7249, std.dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 12.35% (0.7433 => 0.8351, std.dev.: 0.0264) MultiSource/Applications/lemon/lemon: 12.30% (1.0722 => 1.2041, std.dev.: 0.0274) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.27% (0.1940 => 0.2178, std.dev.: 0.0075) MultiSource/Applications/treecc/treecc: 12.26% (2.0273 => 2.2759, std.dev.: 0.0657) MultiSource/Benchmarks/nbench/nbench: 12.14% (1.1840 => 1.3277, std.dev.: 0.0054) MultiSource/Applications/Burg/burg: 12.12% (1.1642 => 1.3053, std.dev.: 0.0422) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 12.11% (8.1363 => 9.1218, std.dev.: 0.0148) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 12.05% (0.0838 => 0.0939, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/mst/mst: 12.04% (0.1163 => 0.1303, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.04% (0.1695 => 0.1899, std.dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: 11.97% (10.4361 => 11.6854, std.dev.: 0.1768) MultiSource/Benchmarks/FreeBench/neural/neural: 11.96% (0.1463 => 0.1638, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 11.90% (0.3387 => 0.3790, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.78% (0.2700 => 0.3018, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.76% (0.3307 => 0.3696, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 11.74% (0.0886 => 0.0990, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.74% (0.9765 => 1.0911, std.dev.: 0.0047) MultiSource/Applications/lua/lua: 11.72% (3.8723 => 4.3262, std.dev.: 0.0367) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.60% (0.5860 => 0.6540, std.dev.: 0.0056) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.55% (0.1143 => 0.1275, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.52% (0.0929 => 0.1036, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.45% (5.0018 => 5.5746, std.dev.: 0.0175) SingleSource/UnitTests/SignlessTypes/rem: 11.45% (0.1144 => 0.1275, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.44% (0.2107 => 0.2348, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.37% (4.9449 => 5.5069, std.dev.: 0.0171) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.34% (0.3121 => 0.3475, std.dev.: 0.0062) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.28% (0.1330 => 0.1480, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.17% (1.5859 => 1.7631, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.12% (1.1861 => 1.3180, std.dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.08% (7.9617 => 8.8441, std.dev.: 0.0171) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.06% (0.1438 => 0.1597, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.05% (0.3177 => 0.3528, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.99% (0.2758 => 0.3061, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/football/football: 10.95% (0.8921 => 0.9898, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.80% (0.4879 => 0.5406, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 10.70% (0.6456 => 0.7147, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.70% (0.8172 => 0.9046, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.67% (0.3543 => 0.3921, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.67% (0.1125 => 0.1245, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.65% (0.1906 => 0.2109, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.60% (2.2024 => 2.4358, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.56% (0.1117 => 0.1235, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.50% (0.1029 => 0.1137, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/05-eks/eks: 10.47% (0.4299 => 0.4749, std.dev.: 0.0022) MultiSource/Applications/siod/siod: 10.29% (2.2969 => 2.5333, std.dev.: 0.0738) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.26% (0.1062 => 0.1171, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 10.25% (0.3473 => 0.3829, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 10.25% (0.3543 => 0.3906, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.24% (1.4186 => 1.5638, std.dev.: 0.0096) SingleSource/UnitTests/ObjC/parameter-passing: 10.21% (0.3927 => 0.4328, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.21% (0.3516 => 0.3875, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.15% (0.3497 => 0.3852, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.15% (0.5569 => 0.6134, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/synchronized: 10.14% (0.3561 => 0.3922, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.14% (0.3828 => 0.4216, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.10% (0.3694 => 0.4067, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.07% (0.2603 => 0.2865, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.06% (0.3886 => 0.4277, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 9.83% (0.3092 => 0.3396, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.80% (0.3826 => 0.4201, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 9.76% (21.9371 => 24.0772, std.dev.: 0.4278) MultiSource/Benchmarks/McCat/09-vor/vor: 9.75% (0.3180 => 0.3490, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.62% (0.2266 => 0.2484, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 9.59% (1.5603 => 1.7100, std.dev.: 0.0398) SingleSource/Benchmarks/Shootout-C++/hash2: 9.46% (0.4620 => 0.5057, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.40% (0.4203 => 0.4598, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 9.40% (0.4289 => 0.4692, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.39% (0.2065 => 0.2259, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.36% (0.3441 => 0.3763, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/health/health: 9.31% (0.1268 => 0.1386, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.97% (0.4103 => 0.4471, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.93% (0.3865 => 0.4210, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 8.91% (0.3422 => 0.3727, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.86% (0.5981 => 0.6511, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.74% (0.4636 => 0.5041, std.dev.: 0.0062) SingleSource/UnitTests/ObjC++/property-reference-object: 8.62% (0.6030 => 0.6550, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 8.57% (0.4048 => 0.4395, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.51% (0.1892 => 0.2053, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.49% (0.7326 => 0.7948, std.dev.: 0.0062) SingleSource/UnitTests/ObjC++/Hello: 8.46% (0.5925 => 0.6426, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 8.39% (0.3684 => 0.3993, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 8.30% (0.3603 => 0.3902, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.08% (0.3427 => 0.3704, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 7.95% (17.1811 => 18.5474, std.dev.: 0.4369) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.48% (0.3650 => 0.3923, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.44% (0.2905 => 0.3121, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.43% (0.8101 => 0.8703, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.41% (0.4064 => 0.4365, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/matrix: 7.26% (0.3098 => 0.3323, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.08% (0.3162 => 0.3386, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.02% (3.8922 => 4.1656, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.00% (0.2872 => 0.3073, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.95% (0.3136 => 0.3354, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 6.92% (0.2831 => 0.3027, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.92% (14.3668 => 15.3609, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.85% (0.2891 => 0.3089, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.80% (2.0665 => 2.2070, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 6.78% (0.3232 => 0.3451, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.3283 => 0.3505, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.69% (0.2871 => 0.3063, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.57% (0.2877 => 0.3066, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.39% (0.2756 => 0.2932, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.34% (0.2793 => 0.2970, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 6.21% (0.3379 => 0.3589, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 6.20% (0.2725 => 0.2894, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 6.19% (0.3052 => 0.3241, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 6.12% (0.2714 => 0.2880, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 6.03% (0.2802 => 0.2971, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.56% (0.2430 => 0.2565, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 5.33% (0.3131 => 0.3298, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.82% (1.1194 => 1.1510, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.72% (0.3935 => 0.4042, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.65% (0.3817 => 0.3918, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.55% (0.2944 => 0.3284, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 11.52% (0.9957 => 1.1104, std.dev.: 0.0095) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.85% (1.1396 => 1.2519, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3684, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/bh/bh: 5.93% (1.9405 => 2.0556, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.79% (4.2280 => 4.3461, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.40% (1.0313 => 1.0561, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.66% (3.6395 => 3.6999, std.dev.: 0.0069) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2078, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.45% (2.6546 => 2.6931, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.13% (6.5088 => 6.5825, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1312, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/salsa20: -80.06% (0.8651 => 0.1725, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.26% (5.2763 => 3.2049, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.58% (5.3855 => 3.6847, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.20% (5.3526 => 3.6826, std.dev.: 0.0042) SingleSource/UnitTests/Vector/constpool: -14.69% (54.1659 => 46.2111, std.dev.: 0.0745) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.52% (2.9384 => 2.6294, std.dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: -7.19% (22.1758 => 20.5804, std.dev.: 0.4712) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.11% (8.0499 => 3.7744, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.39% (1.1492 => 0.7655, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: -15.71% (1.6925 => 1.4266, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.43% (0.0998 => 0.0854, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.75% (1.2373 => 1.0919, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3453 => 2.9600, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -10.73% (1.5373 => 1.3723, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.30% (19.9488 => 18.2924, std.dev.: 0.0503) MultiSource/Benchmarks/FreeBench/mason/mason: -8.01% (0.2161 => 0.1988, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.53% (1.6805 => 1.5540, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.95% (1.8329 => 1.7055, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.97% (1.5835 => 1.5048, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.52% (8.1563 => 7.7877, std.dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.67% (3.2827 => 3.1622, std.dev.: 0.0189) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8776, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5019, std.dev.: 0.0043) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.83% (0.4808 => 0.4672, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.84% (10.2830 => 10.0934, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6798, std.dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -1.68% (2.5528 => 2.5099, std.dev.: 0.0117) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2878, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 18.67% (0.5229 => 0.6205, std.dev.: 0.0164) MultiSource/Applications/SPASS/SPASS: 14.36% (14.9895 => 17.1418, std.dev.: 0.3406) MultiSource/Benchmarks/MallocBench/gs/gs: 9.89% (4.1105 => 4.5171, std.dev.: 0.0456) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 16.47% (1.1048 => 1.2868, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.39% (7.1582 => 8.1885, std.dev.: 0.0114) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.22% (0.6222 => 0.7729, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35000.00% (0.0001 => 0.0351, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431, std.dev.: 0.0080) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.66% (0.2116 => 0.2130, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 19 00:51:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 19 Oct 2012 02:51:21 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121019075121.4F5142A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/4993?compare_to=4990&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 4993, Order: 166266, Start Time: 2012-10-19 06:29:25, End Time: 2012-10-19 07:53:20 To: 4990, Order: 166263, Start Time: 2012-10-19 04:49:12, End Time: 2012-10-19 06:12:54 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 9 (9 on baseline) Performance Improvements: 1 (5 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 965 (960 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 21.45% (0.0676 => 0.0821, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.18% (0.8297 => 0.8478, std.dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 8.22% (3.0473 => 3.2977, std.dev.: 0.0828) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.46% (7.0799 => 7.2542, std.dev.: 0.0638) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 2.13% (1.8517 => 1.8912, std.dev.: 0.0053) MultiSource/Benchmarks/BitBench/five11/five11: 2.11% (5.5449 => 5.6619, std.dev.: 0.0377) MultiSource/Benchmarks/Olden/bh/bh: 1.46% (2.3695 => 2.4040, std.dev.: 0.0058) MultiSource/Applications/lua/lua: 1.40% (28.2322 => 28.6278, std.dev.: 0.0537) MultiSource/Benchmarks/Olden/em3d/em3d: 1.05% (5.4056 => 5.4624, std.dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.53% (1.2678 => 1.2484, std.dev.: 0.0016) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.93% (16.5563 => 16.4019, std.dev.: 0.2517) MultiSource/Applications/obsequi/Obsequi: 1.39% (1.0173 => 1.0314, std.dev.: 0.0072) MultiSource/Applications/sqlite3/sqlite3: 0.57% (0.6314 => 0.6350, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: 1.41% (0.1849 => 0.1875, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.99% (0.1653 => 0.1587, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.00% (0.3195 => 0.3131, std.dev.: 0.0080) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.49% (0.2410 => 0.2446, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.24% (0.3316 => 0.3275, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.22% (0.2340 => 0.2392, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: -0.62% (0.5965 => 0.5928, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel: 9.46% (0.0391 => 0.0428, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.83% (0.3255 => 0.3282, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/strcat: -0.72% (0.1936 => 0.1922, std.dev.: 0.0021) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 3.20% (0.0219 => 0.0226, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0204 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.24% (0.0409 => 0.0410, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 4.28% (0.0304 => 0.0317, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0299 => 0.0299, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 27.99% (0.0318 => 0.0407, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0189 => 0.0189, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 5.73% (0.0192 => 0.0203, std.dev.: 0.0023) SingleSource/UnitTests/byval-alignment: -20.32% (0.0315 => 0.0251, std.dev.: 0.0038) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.75% (0.1469 => 0.1480, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -0.21% (1.1256 => 1.1232, std.dev.: 0.0578) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.81% (0.1482 => 0.1470, std.dev.: 0.0098) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.29% (0.4036 => 0.4088, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.14% (0.1397 => 0.1395, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.83% (0.0627 => 0.0651, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.44% (0.0277 => 0.0273, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.27% (0.0550 => 0.0568, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.43% (1.1427 => 1.1378, std.dev.: 0.0101) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 40.91% (0.0022 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 271.43% (0.0007 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.94% (0.0613 => 0.0631, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 28.43% (0.0204 => 0.0262, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.00% (0.8027 => 0.7947, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0005 => 0.0005, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: -66.67% (0.0003 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -25.64% (0.0078 => 0.0058, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.65% (2.1832 => 1.6668, std.dev.: 0.0009) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.68% (0.7473 => 0.7673, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.89% (0.8321 => 0.8478, std.dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.87% (1.5795 => 2.5093, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 6.92% (1.1857 => 1.2678, std.dev.: 0.0088) MultiSource/Benchmarks/mafft/pairlocalalign: 6.01% (63.1822 => 66.9772, std.dev.: 0.0690) SingleSource/Benchmarks/Misc/ReedSolomon: 3.43% (8.5322 => 8.8250, std.dev.: 0.0058) MultiSource/Applications/siod/siod: 2.82% (3.6643 => 3.7677, std.dev.: 0.0095) MultiSource/Benchmarks/Olden/bh/bh: 2.04% (2.3560 => 2.4040, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.38% (4.8362 => 4.9029, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.84% (0.6943 => 0.6815, std.dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.71% (0.3269 => 0.3017, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -4.04% (29.8330 => 28.6278, std.dev.: 0.0537) SingleSource/Benchmarks/Shootout-C++/hash2: -1.49% (3.4237 => 3.3727, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.29% (3.3479 => 3.3047, std.dev.: 0.0037) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.27% (16.4461 => 16.4019, std.dev.: 0.2517) MultiSource/Applications/obsequi/Obsequi: 0.51% (1.0262 => 1.0314, std.dev.: 0.0072) MultiSource/Applications/sqlite3/sqlite3: 0.28% (0.6332 => 0.6350, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: 2.40% (0.1831 => 0.1875, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.80% (0.1559 => 0.1587, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.26% (0.3123 => 0.3131, std.dev.: 0.0080) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.69% (0.2463 => 0.2446, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.06% (0.3344 => 0.3275, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.18% (0.2364 => 0.2392, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: -1.36% (0.6010 => 0.5928, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel: -0.23% (0.0429 => 0.0428, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.49% (0.3266 => 0.3282, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/strcat: -2.39% (0.1969 => 0.1922, std.dev.: 0.0021) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.89% (0.0224 => 0.0226, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 65.85% (0.0123 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.49% (0.0408 => 0.0410, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 24.80% (0.0254 => 0.0317, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.99% (0.0302 => 0.0299, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 5.99% (0.0384 => 0.0407, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -0.53% (0.0190 => 0.0189, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 12.78% (0.0180 => 0.0203, std.dev.: 0.0023) SingleSource/UnitTests/byval-alignment: 9.13% (0.0230 => 0.0251, std.dev.: 0.0038) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.92% (0.1438 => 0.1480, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -0.86% (1.1329 => 1.1232, std.dev.: 0.0578) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.55% (0.1462 => 0.1470, std.dev.: 0.0098) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.83% (0.4164 => 0.4088, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.90% (0.1369 => 0.1395, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.56% (0.0641 => 0.0651, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 40.00% (0.0195 => 0.0273, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.73% (0.0578 => 0.0568, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.52% (1.1437 => 1.1378, std.dev.: 0.0101) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.64% (0.0627 => 0.0631, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 45.56% (0.0180 => 0.0262, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.87% (0.8017 => 0.7947, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 400.00% (0.0001 => 0.0005, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -6.45% (0.0062 => 0.0058, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 19 01:40:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 19 Oct 2012 03:40:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121019084058.D4DC72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4994?compare_to=4991&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4994, Order: 166268, Start Time: 2012-10-19 07:17:36, End Time: 2012-10-19 08:43:56 To: 4991, Order: 166264, Start Time: 2012-10-19 05:18:08, End Time: 2012-10-19 06:44:05 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (191 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1042 (674 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.17% (2.0176 => 2.5052, std.dev.: 0.0047) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.65% (0.1410 => 0.1673, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 17.31% (0.0826 => 0.0969, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 16.94% (0.2243 => 0.2623, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 15.77% (0.0653 => 0.0756, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/tsp/tsp: 14.51% (0.1013 => 0.1160, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.27% (0.0834 => 0.0953, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.81% (0.1072 => 0.1220, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.66% (0.1413 => 0.1606, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 13.63% (0.2721 => 0.3092, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.41% (0.1327 => 0.1505, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 13.36% (0.7038 => 0.7978, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.33% (0.2596 => 0.2942, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.29% (0.1588 => 0.1799, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.06% (3.9660 => 4.4838, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 13.03% (0.4328 => 0.4892, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.86% (0.0964 => 0.1088, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 12.83% (1.3693 => 1.5450, std.dev.: 0.0068) MultiSource/Applications/SPASS/SPASS: 12.46% (13.8202 => 15.5421, std.dev.: 0.0171) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.45% (0.6283 => 0.7065, std.dev.: 0.0198) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.41% (0.7710 => 0.8667, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.33% (0.6959 => 0.7817, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.26% (0.9199 => 1.0327, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.24% (1.4563 => 1.6346, std.dev.: 0.0014) MultiSource/Applications/aha/aha: 12.24% (0.1062 => 0.1192, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 12.24% (0.4062 => 0.4559, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/power/power: 11.96% (0.1003 => 0.1123, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.91% (0.5265 => 0.5892, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.83% (1.2193 => 1.3635, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 11.73% (1.0313 => 1.1523, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.67% (0.4791 => 0.5350, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 11.58% (0.5818 => 0.6492, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.52% (1.1364 => 1.2673, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.46% (0.3899 => 0.4346, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.34% (0.3130 => 0.3485, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.32% (0.1157 => 0.1288, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 11.26% (1.1061 => 1.2307, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 11.18% (0.6744 => 0.7498, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 11.18% (0.1986 => 0.2208, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.16% (0.4016 => 0.4464, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.05% (0.5577 => 0.6193, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 11.03% (0.5748 => 0.6382, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 10.94% (16.6129 => 18.4300, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/lists: 10.90% (0.3293 => 0.3652, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 10.90% (0.2781 => 0.3084, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.88% (0.1075 => 0.1192, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.88% (0.3485 => 0.3864, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.85% (0.4379 => 0.4854, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 10.82% (0.1589 => 0.1761, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 10.82% (0.2995 => 0.3319, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 10.78% (0.7061 => 0.7822, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.75% (0.3489 => 0.3864, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 10.71% (0.1111 => 0.1230, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 10.68% (3.1889 => 3.5295, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 10.67% (2.1791 => 2.4117, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/moments: 10.65% (0.3868 => 0.4280, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.64% (0.0977 => 0.1081, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.62% (0.8698 => 0.9622, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.62% (0.3756 => 0.4155, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 10.62% (0.1478 => 0.1635, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.60% (0.3246 => 0.3590, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 10.57% (0.3453 => 0.3818, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.57% (0.2914 => 0.3222, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 10.54% (3.8646 => 4.2718, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.53% (0.2782 => 0.3075, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 10.53% (0.3220 => 0.3559, std.dev.: 0.0029) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.52% (0.1435 => 0.1586, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.51% (0.1865 => 0.2061, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.47% (0.3580 => 0.3955, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.45% (0.1569 => 0.1733, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.43% (0.7460 => 0.8238, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.42% (0.3022 => 0.3337, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 10.41% (1.9270 => 2.1276, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 10.36% (0.8310 => 0.9171, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.32% (0.2966 => 0.3272, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 10.31% (0.7506 => 0.8280, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.26% (0.1014 => 0.1118, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.20% (0.5637 => 0.6212, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.19% (0.1276 => 0.1406, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.16% (0.4390 => 0.4836, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.14% (7.2180 => 7.9502, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 10.13% (0.3534 => 0.3892, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 10.11% (0.3107 => 0.3421, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: 10.11% (0.2761 => 0.3040, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 10.09% (0.2726 => 0.3001, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 10.09% (0.2925 => 0.3220, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.08% (1.9828 => 2.1827, std.dev.: 0.0073) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.00% (0.2140 => 0.2354, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.94% (0.2655 => 0.2919, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 9.93% (0.2607 => 0.2866, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 9.93% (0.2628 => 0.2889, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 9.93% (0.2760 => 0.3034) SingleSource/Benchmarks/Shootout-C++/random: 9.93% (0.2690 => 0.2957, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.89% (0.2023 => 0.2223, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.87% (0.2127 => 0.2337, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary3: 9.84% (0.3149 => 0.3459, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 9.84% (0.2937 => 0.3226, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.84% (0.2765 => 0.3037, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.81% (4.9865 => 5.4759, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 9.72% (0.1657 => 0.1818, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.64% (0.6576 => 0.7210, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 9.59% (0.3192 => 0.3498, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.54% (3.6692 => 4.0191, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.46% (1.3245 => 1.4498, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 9.40% (0.2988 => 0.3269) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.35% (0.2696 => 0.2948, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 9.32% (14.8535 => 16.2384, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.32% (0.3755 => 0.4105, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 9.31% (1.0594 => 1.1580, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 9.20% (1.2749 => 1.3922, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.12% (4.4433 => 4.8486, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.11% (4.3801 => 4.7790, std.dev.: 0.0042) MultiSource/Benchmarks/sim/sim: 9.07% (0.3131 => 0.3415, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.03% (0.3511 => 0.3828, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.01% (0.6135 => 0.6688, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 9.01% (4.6629 => 5.0831, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: 9.00% (0.2945 => 0.3210, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 8.93% (8.4961 => 9.2544, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.90% (0.8818 => 0.9603, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.84% (1.5188 => 1.6531, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 8.61% (0.6250 => 0.6788, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.57% (0.9108 => 0.9889, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 8.49% (0.4113 => 0.4462, std.dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.44% (0.1789 => 0.1940, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.40% (3.2742 => 3.5492, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.36% (0.2321 => 0.2515, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: 8.30% (0.1385 => 0.1500, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.18% (0.4805 => 0.5198, std.dev.: 0.0061) MultiSource/Applications/JM/ldecod/ldecod: 8.15% (6.5754 => 7.1114, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.11% (1.1333 => 1.2252, std.dev.: 0.0019) MultiSource/Applications/lua/lua: 8.07% (3.7467 => 4.0489, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.92% (0.3245 => 0.3502, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.89% (2.1007 => 2.2664, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.83% (0.2504 => 0.2700, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 7.82% (0.2008 => 0.2165, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.51% (6.2785 => 6.7500, std.dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: 7.40% (1.2292 => 1.3202, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/parameter-passing: 7.29% (0.4003 => 0.4295, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.12% (13.2842 => 14.2299, std.dev.: 0.0156) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1819 => 0.1946, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.92% (0.3914 => 0.4185, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/property: 6.85% (0.3940 => 0.4210, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 6.68% (0.3578 => 0.3817, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.66% (0.3601 => 0.3841, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.64% (0.3646 => 0.3888, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/for-in: 6.62% (0.3789 => 0.4040, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/synchronized: 6.58% (0.3663 => 0.3904, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.47% (0.3650 => 0.3886, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 6.46% (0.3623 => 0.3857, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: 6.13% (0.1777 => 0.1886, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 5.98% (16.2614 => 17.2331, std.dev.: 0.0161) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.57% (0.2243 => 0.2368, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 4.81% (14.5298 => 15.2293, std.dev.: 0.0128) MultiSource/Benchmarks/Bullet/bullet: 2.47% (33.2944 => 34.1162, std.dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5159, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/fbench: 24.43% (1.8175 => 2.2616, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.12% (1.0895 => 1.2760, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 11.14% (1.1560 => 1.2848, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 9.04% (0.8273 => 0.9021, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436) SingleSource/Benchmarks/Shootout-C++/hash2: 7.61% (3.1736 => 3.4150, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.43% (0.9692 => 1.0218) SingleSource/Benchmarks/Misc/mandel-2: 5.19% (1.2998 => 1.3673, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0039, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 4.48% (0.5449 => 0.5693, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.46% (2.8606 => 2.9881, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.88% (1.7081 => 1.7744, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.38% (1.9199 => 1.9848, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 3.38% (12.0921 => 12.5006, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 3.28% (10.7476 => 11.1001, std.dev.: 0.0496) MultiSource/Benchmarks/nbench/nbench: 3.21% (11.2619 => 11.6231, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bisort/bisort: 3.11% (0.8239 => 0.8495, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0310 => 1.0559, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.23% (7.4271 => 7.5926, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.85% (1.4298 => 1.4563, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0497, std.dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5122, std.dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2123, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1866, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 1.20% (5.5130 => 5.5794, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.17% (9.9194 => 10.0351, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 1.03% (12.4560 => 12.5845, std.dev.: 0.0078) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.37% (0.2670 => 0.1432, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.19% (0.4657 => 0.3903, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.16% (1.3819 => 1.2001, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.11% (1.3813 => 1.2002, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.28% (1.0460 => 0.8548) MultiSource/Benchmarks/FreeBench/mason/mason: -12.73% (0.2238 => 0.1953, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.33% (20.3410 => 18.2398, std.dev.: 0.0211) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0129) SingleSource/Benchmarks/McGill/chomp: -5.85% (1.2308 => 1.1588, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.56% (1.3780 => 1.3014, std.dev.: 0.0077) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.47% (0.9996 => 0.9549, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.79% (1.7688 => 1.7018, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.02% (0.4867 => 0.4720, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.89% (3.0263 => 2.9389, std.dev.: 0.0022) MultiSource/Applications/siod/siod: -2.88% (3.2729 => 3.1786, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: -2.81% (1.9762 => 1.9207, std.dev.: 0.0054) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8811, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4781, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.36% (4.1080 => 4.0109, std.dev.: 0.0032) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.96% (0.6589 => 0.6460, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.87% (0.6615 => 0.6491, std.dev.: 0.0013) MultiSource/Applications/lua/lua: -1.75% (26.5159 => 26.0526, std.dev.: 0.0337) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.67% (0.8342 => 0.8203, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.62% (2.5254 => 2.4845, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.61% (6.3560 => 6.2534, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0058, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.31% (5.3167 => 5.2469, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: -1.24% (28.2225 => 27.8727, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/heapsort: -1.12% (3.9173 => 3.8735, std.dev.: 0.0125) MultiSource/Applications/aha/aha: -1.08% (3.1476 => 3.1136, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -1.05% (84.4286 => 83.5454, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 19 02:32:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 19 Oct 2012 04:32:09 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121019093209.F25D52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4995?compare_to=4993&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 4995, Order: 166271, Start Time: 2012-10-19 08:10:08, End Time: 2012-10-19 09:34:10 To: 4993, Order: 166266, Start Time: 2012-10-19 06:29:25, End Time: 2012-10-19 07:53:20 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 18 (27 on baseline) Performance Improvements: 1 (5 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 956 (942 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.49% (0.2003 => 0.2113, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.94% (0.8609 => 0.8862, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.49% (0.8701 => 0.8918, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.32% (0.9920 => 1.0150, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.15% (0.7987 => 0.8159, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.03% (0.8344 => 0.8513, std.dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: 2.02% (31.7199 => 32.3613, std.dev.: 0.1591) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.71% (0.8204 => 0.8344, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.65% (0.8808 => 0.8953, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.44% (0.9069 => 0.9200, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.19% (0.8653 => 0.8756, std.dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: 1.08% (4.9576 => 5.0111, std.dev.: 0.0183) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 11.20% (3.6276 => 4.0340, std.dev.: 0.1299) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.69% (0.3243 => 0.3460, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.94% (2.2568 => 2.3458, std.dev.: 0.0267) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.30% (4.3397 => 4.4828, std.dev.: 0.0324) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.31% (1.2678 => 1.2844, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/fibo: 1.05% (4.3227 => 4.3679, std.dev.: 0.0109) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.72% (7.2542 => 7.0572, std.dev.: 0.0572) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.52% (16.4019 => 16.4879, std.dev.: 0.1948) MultiSource/Applications/obsequi/Obsequi: 0.80% (1.0314 => 1.0396, std.dev.: 0.0255) MultiSource/Applications/sqlite3/sqlite3: -1.78% (0.6350 => 0.6237, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/08-main/main: 1.01% (0.1875 => 0.1894, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.63% (0.1587 => 0.1597, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.85% (0.3131 => 0.3189, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (0.2446 => 0.2477, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.32% (0.3275 => 0.3351, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.63% (0.2392 => 0.2377, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/bigfib: 1.86% (0.5928 => 0.6038, std.dev.: 0.0203) SingleSource/Benchmarks/Misc/mandel: 8.18% (0.0428 => 0.0463, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.40% (0.3282 => 0.3295, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/strcat: 4.68% (0.1922 => 0.2012, std.dev.: 0.0061) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -19.91% (0.0226 => 0.0181, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.49% (0.0204 => 0.0205, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -9.76% (0.0410 => 0.0370, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.73% (0.0317 => 0.0283, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.67% (0.0299 => 0.0301) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.49% (0.0407 => 0.0409, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 0.53% (0.0189 => 0.0190, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0203 => 0.0203, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 13.15% (0.0251 => 0.0284, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.41% (0.1480 => 0.1474, std.dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.07% (1.1232 => 1.1240, std.dev.: 0.0167) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.33% (0.1470 => 0.1519, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.88% (0.4088 => 0.4052, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.36% (0.1395 => 0.1376, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.45% (0.0651 => 0.0583, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.10% (0.0273 => 0.0276, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.52% (0.0568 => 0.0588, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.47% (1.1378 => 1.1431, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.77% (0.0031 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.15% (0.0026 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.74% (0.0631 => 0.0620, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.60% (0.0262 => 0.0229, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.23% (0.7947 => 0.7965, std.dev.: 0.0093) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 79.31% (0.0058 => 0.0104, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.73% (2.1832 => 1.6652, std.dev.: 0.0062) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.08% (0.8597 => 0.8862, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.44% (0.9908 => 1.0150, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.36% (0.8712 => 0.8918, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.18% (0.8331 => 0.8513, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.71% (0.8204 => 0.8344, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.68% (0.8805 => 0.8953, std.dev.: 0.0047) MultiSource/Benchmarks/Bullet/bullet: 1.57% (31.8598 => 32.3613, std.dev.: 0.1591) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.44% (0.9069 => 0.9200, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.38% (0.8048 => 0.8159, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.16% (0.8656 => 0.8756, std.dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.86% (1.5795 => 2.5092, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.60% (0.3186 => 0.3460, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.32% (1.1857 => 1.2844, std.dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: 5.98% (63.1822 => 66.9608, std.dev.: 0.0332) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.33% (2.2485 => 2.3458, std.dev.: 0.0267) MultiSource/Benchmarks/FreeBench/distray/distray: 4.18% (0.2390 => 0.2490, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: 3.40% (8.5322 => 8.8224, std.dev.: 0.0250) MultiSource/Applications/siod/siod: 3.18% (3.6643 => 3.7807, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.93% (4.3552 => 4.4828, std.dev.: 0.0324) MultiSource/Benchmarks/FreeBench/mason/mason: 2.01% (0.5415 => 0.5524, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.00% (2.4490 => 2.4979, std.dev.: 0.0101) MultiSource/Benchmarks/Olden/bh/bh: 1.77% (2.3560 => 2.3977, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/fibo: 1.46% (4.3049 => 4.3679, std.dev.: 0.0109) MultiSource/Benchmarks/llubenchmark/llu: 1.36% (1.9967 => 2.0238, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.36% (4.8362 => 4.9018, std.dev.: 0.0155) MultiSource/Applications/spiff/spiff: 1.16% (2.8561 => 2.8893, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.13% (4.4340 => 4.4840, std.dev.: 0.0116) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.56% (0.3269 => 0.3022, std.dev.: 0.0006) MultiSource/Applications/lua/lua: -5.18% (29.8330 => 28.2883, std.dev.: 0.2065) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.16% (7.2130 => 7.0572, std.dev.: 0.0572) SingleSource/Benchmarks/Shootout-C++/hash2: -1.68% (3.4237 => 3.3661, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.24% (3.3479 => 3.3065, std.dev.: 0.0019) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.25% (16.4461 => 16.4879, std.dev.: 0.1948) MultiSource/Applications/obsequi/Obsequi: 1.31% (1.0262 => 1.0396, std.dev.: 0.0255) MultiSource/Applications/sqlite3/sqlite3: -1.50% (0.6332 => 0.6237, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/08-main/main: 3.44% (0.1831 => 0.1894, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.44% (0.1559 => 0.1597, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.11% (0.3123 => 0.3189, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.57% (0.2463 => 0.2477, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.21% (0.3344 => 0.3351, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.55% (0.2364 => 0.2377, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/bigfib: 0.47% (0.6010 => 0.6038, std.dev.: 0.0203) SingleSource/Benchmarks/Misc/mandel: 7.93% (0.0429 => 0.0463, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.89% (0.3266 => 0.3295, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/strcat: 2.18% (0.1969 => 0.2012, std.dev.: 0.0061) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -19.20% (0.0224 => 0.0181, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 66.67% (0.0123 => 0.0205, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -9.31% (0.0408 => 0.0370, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 11.42% (0.0254 => 0.0283, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.33% (0.0302 => 0.0301) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 6.51% (0.0384 => 0.0409, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0190 => 0.0190, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/test1: 12.78% (0.0180 => 0.0203, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 23.48% (0.0230 => 0.0284, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.50% (0.1438 => 0.1474, std.dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.79% (1.1329 => 1.1240, std.dev.: 0.0167) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.90% (0.1462 => 0.1519, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.69% (0.4164 => 0.4052, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.51% (0.1369 => 0.1376, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.05% (0.0641 => 0.0583, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.54% (0.0195 => 0.0276, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.73% (0.0578 => 0.0588, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.05% (1.1437 => 1.1431, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.12% (0.0627 => 0.0620, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 27.22% (0.0180 => 0.0229, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.65% (0.8017 => 0.7965, std.dev.: 0.0093) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 67.74% (0.0062 => 0.0104, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 19 02:36:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 19 Oct 2012 04:36:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121019093601.8B5632A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4996?compare_to=4992&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4996, Order: 166271, Start Time: 2012-10-19 08:17:01, End Time: 2012-10-19 09:38:00 To: 4992, Order: 166266, Start Time: 2012-10-19 06:22:43, End Time: 2012-10-19 07:47:05 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (76 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (184 on baseline) Performance Improvements: 2 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 91 (15 on baseline) Unchanged Tests: 948 (658 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.84% (54.9273 => 56.4850, std.dev.: 0.0841) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.30% (15.4507 => 15.0961, std.dev.: 0.0092) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.67% (1.1104 => 1.0919, std.dev.: 0.0024) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -1.56% (0.6205 => 0.6108, std.dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: -0.36% (17.1418 => 17.0806, std.dev.: 0.0187) MultiSource/Benchmarks/Bullet/bullet: -0.04% (56.1788 => 56.1554, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/gs/gs: -0.02% (4.5171 => 4.5160, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0463 => 0.0463, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.21% (0.0466 => 0.0465, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0433 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0435 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.24% (0.0422 => 0.0423) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.24% (0.0424 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.24% (0.0416 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0417 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0434 => 0.0434) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.23% (0.0435 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.23% (0.0428 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0430 => 0.0430, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.24% (0.0420 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0420 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.23% (0.0426 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0427 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.23% (0.0436 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.23% (0.0438 => 0.0439, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.24% (0.0414 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.24% (0.0415 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0425 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.47% (0.0426 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0417 => 0.0417, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0418 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.24% (0.0409 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.24% (0.0409 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.25% (0.0408 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.49% (0.0410 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.22% (0.0445 => 0.0444, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0446 => 0.0446) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.25% (0.0406 => 0.0407) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.25% (0.0407 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0408 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0410 => 0.0410, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0415 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.24% (0.0416 => 0.0417, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.01% (1.2868 => 1.2867, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.28% (8.1885 => 8.2112, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.08% (0.7729 => 0.7735, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.28% (0.0351 => 0.0350, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1431 => 0.1432) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: - (0.1647 => 0.1647, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.19% (0.2130 => 0.2126, std.dev.: 0.0029) MultiSource/Benchmarks/NPB-serial/is/is: 0.03% (10.0283 => 10.0309, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.21% (63.2438 => 56.1554, std.dev.: 0.0038) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 0.49% (0.1639 => 0.1647, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 4.89% (9.5636 => 10.0309, std.dev.: 0.0014) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 35.61% (14.1553 => 19.1958, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.72% (3.4629 => 5.7735, std.dev.: 0.0011) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13400.56% (0.0720 => 9.7204, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050700.00% (0.0001 => 10.0508, std.dev.: 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 62.53% (0.2554 => 0.4151, std.dev.: 0.0032) SingleSource/Regression/C/matrixTranspose: 57.14% (0.0245 => 0.0385) SingleSource/Benchmarks/Misc/lowercase: 51.95% (0.0256 => 0.0389, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 45.61% (10.3673 => 15.0961, std.dev.: 0.0092) SingleSource/UnitTests/SignlessTypes/factor: 41.22% (0.0296 => 0.0418, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 36.31% (0.1622 => 0.2211, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/distray/distray: 34.94% (0.1056 => 0.1425, std.dev.: 0.0011) SingleSource/UnitTests/vla: 29.01% (0.0355 => 0.0458, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 22.78% (0.0834 => 0.1024, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/ReedSolomon: 22.65% (0.2049 => 0.2513, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.36% (0.1236 => 0.1500, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.18% (0.1566 => 0.1882, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 19.33% (0.0719 => 0.0858, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 18.50% (0.1584 => 0.1877, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.58% (2.2022 => 2.5893, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 17.53% (0.1432 => 0.1683) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.28% (7.0540 => 8.2727, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.99% (0.0871 => 0.1019, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 16.57% (0.5105 => 0.5951, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 16.55% (0.6675 => 0.7780, std.dev.: 0.0024) MultiSource/Applications/d/make_dparser: 15.64% (3.3354 => 3.8572, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 15.59% (0.1655 => 0.1913, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.07% (1.3050 => 1.5017, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.62% (0.5020 => 0.5754, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 14.36% (0.7115 => 0.8137, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.15% (0.1032 => 0.1178, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.14% (1.5415 => 1.7594, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/oourafft: 14.11% (0.3282 => 0.3745, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.91% (0.2271 => 0.2587, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.91% (0.0798 => 0.0909, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.78% (0.1625 => 0.1849, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 13.75% (0.1440 => 0.1638, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 13.73% (0.3423 => 0.3893, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 13.70% (0.0730 => 0.0830, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.25% (0.1510 => 0.1710, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 13.22% (9.4845 => 10.7384, std.dev.: 0.0089) MultiSource/Applications/sgefa/sgefa: 13.06% (0.3109 => 0.3515, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 12.98% (0.1695 => 0.1915, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.78% (0.4615 => 0.5205, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.75% (1.7609 => 1.9854, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.62% (4.2646 => 4.8030, std.dev.: 0.0102) MultiSource/Applications/oggenc/oggenc: 12.54% (5.7591 => 6.4811, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/exptree: 12.53% (0.0814 => 0.0916, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 12.40% (0.6450 => 0.7250, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/matrix: 12.35% (0.0818 => 0.0919, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 12.34% (0.1175 => 0.1320, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 12.25% (0.1151 => 0.1292, std.dev.: 0.0027) MultiSource/Applications/lemon/lemon: 12.22% (1.0722 => 1.2032, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/mst/mst: 12.12% (0.1163 => 0.1304, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 12.11% (8.1363 => 9.1215, std.dev.: 0.0119) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.10% (0.1438 => 0.1612, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 12.09% (0.1555 => 0.1743, std.dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: 12.05% (0.7433 => 0.8329, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.04% (0.1337 => 0.1498, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.01% (0.1940 => 0.2173, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.00% (0.0933 => 0.1045, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.98% (0.1695 => 0.1898, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 11.97% (2.0273 => 2.2700, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/neural/neural: 11.89% (0.1463 => 0.1637, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 11.88% (0.0842 => 0.0942, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 11.85% (0.0886 => 0.0991, std.dev.: 0.0017) MultiSource/Applications/Burg/burg: 11.84% (1.1642 => 1.3020, std.dev.: 0.0085) MultiSource/Applications/lua/lua: 11.83% (3.8723 => 4.3302, std.dev.: 0.0215) MultiSource/Benchmarks/nbench/nbench: 11.82% (1.1840 => 1.3239, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 11.81% (0.3387 => 0.3787, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 11.77% (0.7835 => 0.8757, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.63% (0.2700 => 0.3014, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.62% (0.5860 => 0.6541, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.60% (0.9765 => 1.0898, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.46% (0.3307 => 0.3686, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 11.44% (10.4361 => 11.6301, std.dev.: 0.0257) SingleSource/UnitTests/SignlessTypes/rem: 11.36% (0.1144 => 0.1274, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.35% (4.9449 => 5.5063, std.dev.: 0.0164) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.30% (0.0929 => 0.1034, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.24% (0.3177 => 0.3534, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.22% (5.0018 => 5.5630, std.dev.: 0.0103) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.21% (0.3121 => 0.3471, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.20% (0.2107 => 0.2343, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 11.19% (0.1117 => 0.1242, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.13% (0.1330 => 0.1478, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.06% (1.1861 => 1.3173, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.03% (1.5859 => 1.7609, std.dev.: 0.0078) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.00% (0.8172 => 0.9071, std.dev.: 0.0220) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.99% (7.9617 => 8.8363, std.dev.: 0.0115) SingleSource/UnitTests/ObjC/exceptions-4: 10.95% (0.3543 => 0.3931, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 10.92% (0.3561 => 0.3950, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.92% (0.3543 => 0.3930, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 10.91% (0.3473 => 0.3852, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.90% (0.8067 => 0.8946, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/football/football: 10.85% (0.8921 => 0.9889, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-2: 10.84% (0.3497 => 0.3876, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.82% (0.3927 => 0.4352, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.80% (0.2758 => 0.3056, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/for-in: 10.80% (0.3694 => 0.4093, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.75% (0.3516 => 0.3894, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.74% (0.3828 => 0.4239, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.59% (0.1029 => 0.1138, std.dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.58% (0.1125 => 0.1244, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.55% (0.1062 => 0.1174, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.55% (0.1906 => 0.2107, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.52% (2.2024 => 2.4340, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.50% (0.5569 => 0.6154, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/property: 10.50% (0.3886 => 0.4294, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 10.46% (0.6456 => 0.7131, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 10.33% (0.4299 => 0.4743, std.dev.: 0.0019) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.32% (0.1143 => 0.1261, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.23% (0.4879 => 0.5378, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.21% (1.4186 => 1.5634, std.dev.: 0.0092) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.03% (0.2603 => 0.2864, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 9.99% (2.2969 => 2.5263, std.dev.: 0.0142) MultiSource/Benchmarks/McCat/09-vor/vor: 9.81% (0.3180 => 0.3492, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.64% (0.2065 => 0.2264, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.62% (0.3826 => 0.4194, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 9.61% (0.3092 => 0.3389, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: 9.46% (0.1268 => 0.1388, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.44% (0.2266 => 0.2480, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 9.44% (1.5603 => 1.7076, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.42% (0.3441 => 0.3765, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash: 9.30% (0.4289 => 0.4688, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash2: 9.29% (0.4620 => 0.5049, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 9.23% (21.9371 => 23.9624, std.dev.: 0.0282) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.99% (0.4103 => 0.4472, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.99% (0.1892 => 0.2062, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists: 8.77% (0.3422 => 0.3722, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.72% (0.3865 => 0.4202, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.66% (0.6030 => 0.6552, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.64% (0.4203 => 0.4566, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.63% (0.5981 => 0.6497, std.dev.: 0.0039) SingleSource/UnitTests/ObjC++/Hello: 8.42% (0.5925 => 0.6424, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/moments: 8.35% (0.4048 => 0.4386, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.35% (0.4636 => 0.5023, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists1: 8.25% (0.3684 => 0.3988, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.97% (0.3427 => 0.3700, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference: 7.90% (0.7326 => 0.7905, std.dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: 7.78% (17.1811 => 18.5178, std.dev.: 0.0221) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.75% (0.3136 => 0.3379, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3603 => 0.3880, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.41% (0.8101 => 0.8701, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/matrix: 7.33% (0.3098 => 0.3325, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.29% (0.3650 => 0.3916, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.04% (0.4064 => 0.4350, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.90% (14.3668 => 15.3575, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary: 6.87% (0.3232 => 0.3454, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 6.85% (0.2905 => 0.3104, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.84% (3.8922 => 4.1584, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.83% (0.3162 => 0.3378, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.75% (0.2831 => 0.3022, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.69% (0.2871 => 0.3063, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.64% (0.3283 => 0.3501, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.61% (0.2891 => 0.3082, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.53% (2.0665 => 2.2014, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.41% (0.2872 => 0.3056, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.35% (0.2725 => 0.2898, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.29% (0.2877 => 0.3058, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 6.19% (0.3379 => 0.3588, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.17% (0.2756 => 0.2926, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.16% (0.2793 => 0.2965, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 5.85% (0.2802 => 0.2966, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.82% (0.2714 => 0.2872, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 5.60% (1.2842 => 1.3561, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.43% (0.2430 => 0.2562, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 5.01% (0.3131 => 0.3288, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.27% (0.3817 => 0.3942, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.46% (1.1194 => 1.1469, std.dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8961, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9648, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.82% (1.1396 => 1.2515, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 9.66% (0.9957 => 1.0919, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.1578 => 3.3686, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/bh/bh: 5.91% (1.9405 => 2.0552, std.dev.: 0.0010) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.4162 => 0.4322, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.70% (4.2280 => 4.3422, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.33% (1.0313 => 1.0553, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7652, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.17% (3.6395 => 3.7185, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bisort/bisort: 1.81% (0.8333 => 0.8484, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2076, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.51% (2.6546 => 2.6946, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1308, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -80.14% (0.8651 => 0.1718, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.46% (5.2763 => 3.1942, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.51% (5.3855 => 3.6886, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.00% (5.3526 => 3.6934, std.dev.: 0.0158) SingleSource/UnitTests/Vector/constpool: -14.66% (54.1659 => 46.2246, std.dev.: 0.0136) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.69% (2.9384 => 2.6242, std.dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -7.38% (22.1758 => 20.5387, std.dev.: 0.0472) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.06% (8.0499 => 3.7788, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -43.00% (0.0400 => 0.0228, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel: -33.53% (1.1492 => 0.7639, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: -15.97% (1.6925 => 1.4222, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -12.11% (1.2373 => 1.0875, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3453 => 2.9599, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -10.71% (1.5373 => 1.3726, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.51% (19.9488 => 18.2512, std.dev.: 0.0481) MultiSource/Benchmarks/FreeBench/mason/mason: -7.73% (0.2161 => 0.1994, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.48% (1.6805 => 1.5548, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.99% (4.8142 => 4.4779, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.85% (1.8329 => 1.7074, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.89% (1.5835 => 1.5061, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.49% (8.1563 => 7.7903, std.dev.: 0.0067) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.73% (1.3677 => 1.3167, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.68% (3.2827 => 3.1620, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8777, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.14% (32.5116 => 31.4923, std.dev.: 0.0056) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.58% (0.4808 => 0.4684, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.85% (10.2830 => 10.0931, std.dev.: 0.0179) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6816, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -1.64% (2.5528 => 2.5110, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -1.20% (4.6441 => 4.5882, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.10% (2.3135 => 2.2880, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8566, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 16.81% (0.5229 => 0.6108, std.dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: 13.95% (14.9895 => 17.0806, std.dev.: 0.0187) MultiSource/Benchmarks/MallocBench/gs/gs: 9.86% (4.1105 => 4.5160, std.dev.: 0.0194) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 16.46% (1.1048 => 1.2867, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.71% (7.1582 => 8.2112, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.32% (0.6222 => 0.7735, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 34900.00% (0.0001 => 0.0350, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.47% (0.2116 => 0.2126, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 19 03:36:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 19 Oct 2012 05:36:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121019103655.D934D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4997?compare_to=4994&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 4997, Order: 166273, Start Time: 2012-10-19 09:13:39, End Time: 2012-10-19 10:39:53 To: 4994, Order: 166268, Start Time: 2012-10-19 07:17:36, End Time: 2012-10-19 08:43:56 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (189 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1041 (676 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.07% (54.7632 => 56.4433, std.dev.: 0.1117) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.18% (2.0176 => 2.4852, std.dev.: 0.0040) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.16% (0.1410 => 0.1666, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 17.07% (0.0826 => 0.0967, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 16.58% (0.2243 => 0.2615, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.39% (0.1327 => 0.1518, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 14.31% (0.1013 => 0.1158, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.67% (0.0834 => 0.0948, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.38% (0.0770 => 0.0873, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.09% (0.1413 => 0.1598, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 13.08% (1.3693 => 1.5484, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 13.02% (0.7038 => 0.7954, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.78% (0.1072 => 0.1209) SingleSource/Benchmarks/Shootout-C++/hash2: 12.75% (0.4328 => 0.4880, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 12.73% (0.4062 => 0.4579, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.59% (0.1588 => 0.1788, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.59% (0.7710 => 0.8681, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.55% (0.0964 => 0.1085, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.55% (3.9660 => 4.4636, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.46% (0.2721 => 0.3060, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.38% (0.0977 => 0.1098, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.33% (0.6959 => 0.7817, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.33% (0.2596 => 0.2916, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.94% (0.6283 => 0.7033, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.91% (0.9199 => 1.0295, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.87% (1.4563 => 1.6292, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 11.85% (13.8202 => 15.4583, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.70% (0.5265 => 0.5881, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 11.68% (0.1062 => 0.1186) MultiSource/Benchmarks/Olden/power/power: 11.67% (0.1003 => 0.1120, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.65% (0.3022 => 0.3374, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.59% (0.3899 => 0.4351, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 11.33% (0.1986 => 0.2211, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.30% (0.5577 => 0.6207, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.26% (1.2193 => 1.3566, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 11.22% (0.5818 => 0.6471, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 11.22% (0.2781 => 0.3093, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.18% (0.4016 => 0.4465, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.10% (0.3485 => 0.3872, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.98% (0.4791 => 0.5317, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 10.98% (0.5748 => 0.6379, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.97% (1.1364 => 1.2611, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 10.96% (1.0313 => 1.1443, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.92% (0.3756 => 0.4166, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 10.90% (0.3293 => 0.3652, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.89% (0.3130 => 0.3471, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.89% (0.3580 => 0.3970, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.89% (0.2782 => 0.3085, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 10.83% (1.1061 => 1.2259, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 10.81% (0.3868 => 0.4286, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.79% (0.1075 => 0.1191, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.75% (0.1014 => 0.1123, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.73% (0.4390 => 0.4861, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.72% (0.1157 => 0.1281, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 10.72% (0.3453 => 0.3823, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference: 10.69% (0.7061 => 0.7816, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.66% (0.3489 => 0.3861, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.55% (0.2966 => 0.3279, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 10.48% (0.6744 => 0.7451, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.46% (1.9828 => 2.1902, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.43% (0.2655 => 0.2932, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.37% (0.4379 => 0.4833, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.35% (0.3246 => 0.3582, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 10.35% (0.1111 => 0.1226, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.34% (0.1276 => 0.1408, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/strcat: 10.34% (0.2726 => 0.3008, std.dev.: 0.0029) MultiSource/Applications/kimwitu++/kc: 10.34% (16.6129 => 18.3300, std.dev.: 0.0342) SingleSource/Benchmarks/Shootout-C++/except: 10.33% (0.2760 => 0.3045, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 10.32% (0.2607 => 0.2876, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.30% (0.8698 => 0.9594, std.dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: 10.28% (0.1478 => 0.1630, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 10.26% (0.3149 => 0.3472, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 10.24% (0.3534 => 0.3896, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 10.22% (0.2690 => 0.2965, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 10.20% (0.3107 => 0.3424, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 10.18% (0.2761 => 0.3042, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 10.17% (0.7506 => 0.8269, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 10.16% (0.2628 => 0.2895, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.16% (0.2914 => 0.3210, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 10.15% (0.2937 => 0.3235, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 10.12% (1.9270 => 2.1221, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.11% (0.7460 => 0.8214, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.09% (0.2765 => 0.3044, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 10.03% (3.1889 => 3.5087, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/18-imp/imp: 10.00% (0.3220 => 0.3542, std.dev.: 0.0077) MultiSource/Benchmarks/MallocBench/gs/gs: 9.99% (3.8646 => 4.2507, std.dev.: 0.0078) MultiSource/Applications/sgefa/sgefa: 9.95% (0.2995 => 0.3293, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.94% (0.1569 => 0.1725, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.93% (0.5637 => 0.6197, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 9.90% (0.3192 => 0.3508, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 9.88% (0.1589 => 0.1746, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.87% (0.1865 => 0.2049, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 9.80% (2.1791 => 2.3927, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.76% (0.2696 => 0.2959, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.74% (7.2180 => 7.9213, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/matrix: 9.71% (0.2988 => 0.3278, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.69% (0.2023 => 0.2219, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 9.69% (0.8310 => 0.9115, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 9.61% (0.2925 => 0.3206, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.60% (4.9865 => 5.4654, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.54% (0.2127 => 0.2330, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 9.54% (0.2945 => 0.3226, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.53% (0.3755 => 0.4113, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.43% (0.3511 => 0.3842, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.41% (0.1435 => 0.1570, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 9.35% (0.1657 => 0.1812, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.99% (1.3245 => 1.4436, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.86% (3.6692 => 3.9942, std.dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 8.77% (1.0594 => 1.1523, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.74% (0.2140 => 0.2327, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.71% (0.6576 => 0.7149, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 8.67% (0.6250 => 0.6792, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 8.61% (14.8535 => 16.1320, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.60% (4.3801 => 4.7570, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 8.53% (0.3131 => 0.3398, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 8.51% (1.2749 => 1.3834, std.dev.: 0.0149) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.50% (4.4433 => 4.8212, std.dev.: 0.0065) MultiSource/Applications/oggenc/oggenc: 8.41% (4.6629 => 5.0552, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.32% (1.5188 => 1.6452, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 8.25% (8.4961 => 9.1967, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.23% (0.6135 => 0.6640, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.16% (0.1789 => 0.1935, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.96% (0.8818 => 0.9520, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.93% (0.2321 => 0.2505, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.80% (0.4805 => 0.5180, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.78% (3.2742 => 3.5290, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.74% (1.1333 => 1.2210, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 7.66% (3.7467 => 4.0337, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.64% (0.3245 => 0.3493, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 7.59% (0.4113 => 0.4425, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 7.58% (0.1385 => 0.1490, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.53% (2.1007 => 2.2589, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 7.50% (6.5754 => 7.0688, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.48% (0.9108 => 0.9789, std.dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: 7.47% (1.2292 => 1.3210, std.dev.: 0.0125) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.39% (0.2504 => 0.2689, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.12% (0.4003 => 0.4288, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions: 6.92% (0.3914 => 0.4185, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.88% (6.2785 => 6.7106, std.dev.: 0.0118) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.87% (0.1819 => 0.1944, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 6.73% (0.3940 => 0.4205, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 6.65% (0.3578 => 0.3816, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 6.62% (0.2008 => 0.2141, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 6.60% (0.3789 => 0.4039, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.58% (0.3646 => 0.3886, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.58% (0.3601 => 0.3838, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.58% (0.3663 => 0.3904, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.49% (0.3650 => 0.3887, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 6.38% (0.3623 => 0.3854, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.36% (13.2842 => 14.1291, std.dev.: 0.0054) MultiSource/Applications/sqlite3/sqlite3: 5.21% (16.2614 => 17.1090, std.dev.: 0.0170) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.04% (0.2243 => 0.2356, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 4.37% (14.5298 => 15.1643, std.dev.: 0.0075) MultiSource/Benchmarks/Bullet/bullet: 2.52% (33.2944 => 34.1349, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.62% (5.7573 => 7.5199, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/fbench: 24.69% (1.8175 => 2.2662, std.dev.: 0.0366) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.13% (1.0895 => 1.2761, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 11.06% (1.1560 => 1.2838, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 9.03% (0.8273 => 0.9020, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436) SingleSource/Benchmarks/Shootout-C++/hash2: 7.61% (3.1736 => 3.4150, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 5.45% (1.2998 => 1.3706, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.43% (0.9692 => 1.0218) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.75% (1.9144 => 2.0054, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 4.46% (0.5449 => 0.5692, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.45% (2.8606 => 2.9879, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9861, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.44% (10.7476 => 11.1171, std.dev.: 0.0224) MultiSource/Applications/hexxagon/hexxagon: 3.37% (12.0921 => 12.4999, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.23% (11.2619 => 11.6252, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bisort/bisort: 2.96% (0.8239 => 0.8483, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.33% (1.0310 => 1.0550, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: 2.27% (7.4271 => 7.5958, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.79% (1.4298 => 1.4554, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5144, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1872, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5788, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.16% (9.9194 => 10.0344, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5865, std.dev.: 0.0085) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.74% (0.2670 => 0.1422, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.28% (0.4657 => 0.3899, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/mason/mason: -14.14% (0.0707 => 0.0607, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.57% (1.3819 => 1.1944, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.38% (1.3813 => 1.1965, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.29% (1.0460 => 0.8547, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.69% (0.2238 => 0.1954, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.23% (20.3410 => 18.2605, std.dev.: 0.0345) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.82% (1.3780 => 1.2978, std.dev.: 0.0075) SingleSource/Benchmarks/McGill/chomp: -5.60% (1.2308 => 1.1619, std.dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/dry: -5.38% (2.5089 => 2.3740, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.42% (0.9996 => 0.9554, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.82% (1.7688 => 1.7012, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.27% (0.4867 => 0.4708, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -2.88% (3.2729 => 3.1788, std.dev.: 0.0048) MultiSource/Applications/spiff/spiff: -2.85% (3.0263 => 2.9399, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -2.75% (1.9762 => 1.9219, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8813, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.37% (4.1080 => 4.0108, std.dev.: 0.0039) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.19% (0.6589 => 0.6445, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.86% (0.6615 => 0.6492, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -1.82% (6.3560 => 6.2402, std.dev.: 0.0076) MultiSource/Applications/lua/lua: -1.78% (26.5159 => 26.0448, std.dev.: 0.0225) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.68% (2.5254 => 2.4829, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.67% (0.8342 => 0.8203, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0067, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -1.28% (5.3167 => 5.2484, std.dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: -1.24% (28.2225 => 27.8729, std.dev.: 0.0015) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1138, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: -1.05% (84.4286 => 83.5456, std.dev.: 0.0041) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 19 04:12:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 19 Oct 2012 06:12:33 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121019111233.0A89A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4998?compare_to=4995&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 4998, Order: 166274, Start Time: 2012-10-19 09:50:55, End Time: 2012-10-19 11:14:32 To: 4995, Order: 166271, Start Time: 2012-10-19 08:10:08, End Time: 2012-10-19 09:34:10 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 4 (21 on baseline) Performance Improvements: 1 (5 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 970 (948 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.27% (0.8406 => 0.8513, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.25% (0.8101 => 0.8202, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.01% (4.4898 => 4.5350, std.dev.: 0.0087) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/SPASS/SPASS: 2.30% (8.2016 => 8.3904, std.dev.: 0.0176) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -2.13% (0.8862 => 0.8673, std.dev.: 0.0071) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.38% (16.4879 => 16.4259, std.dev.: 0.0412) MultiSource/Applications/obsequi/Obsequi: -0.63% (1.0396 => 1.0331, std.dev.: 0.0154) MultiSource/Applications/sqlite3/sqlite3: 0.90% (0.6237 => 0.6293, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/08-main/main: -5.65% (0.1894 => 0.1787, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.38% (0.1597 => 0.1559, std.dev.: 0.0065) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.82% (0.3189 => 0.3215, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.61% (0.2477 => 0.2462, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.88% (0.3351 => 0.3288, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.06% (0.2377 => 0.2328, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/bigfib: -0.91% (0.6038 => 0.5983, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: -8.86% (0.0463 => 0.0422, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.88% (0.3295 => 0.3266, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: -6.01% (0.2012 => 0.1891, std.dev.: 0.0046) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 23.20% (0.0181 => 0.0223, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.49% (0.0205 => 0.0206, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 9.19% (0.0370 => 0.0404, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -11.31% (0.0283 => 0.0251, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.33% (0.0301 => 0.0297, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -15.16% (0.0409 => 0.0347, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/casts: -38.42% (0.0190 => 0.0117, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/test1: -36.45% (0.0203 => 0.0129, std.dev.: 0.0036) SingleSource/UnitTests/byval-alignment: -3.17% (0.0284 => 0.0275, std.dev.: 0.0031) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1474 => 0.1475, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -0.20% (1.1240 => 1.1217, std.dev.: 0.0136) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -5.86% (0.1519 => 0.1430, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.91% (0.4052 => 0.4015, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.42% (0.1376 => 0.1423, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.86% (0.0583 => 0.0588, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -31.16% (0.0276 => 0.0190, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.50% (0.0588 => 0.0538, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.42% (1.1431 => 1.1383, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.16% (0.0620 => 0.0619, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.42% (0.0229 => 0.0212, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.20% (0.7965 => 0.7949, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -33.65% (0.0104 => 0.0069, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.90% (2.1832 => 1.6615, std.dev.: 0.0063) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.68% (0.7473 => 0.7673, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.08% (0.8611 => 0.8790, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.05% (0.9074 => 0.9260, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.90% (0.9688 => 0.9872, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.84% (0.8359 => 0.8513, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.79% (0.9056 => 0.9218, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.69% (0.8177 => 0.8315, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.69% (0.8066 => 0.8202, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.67% (0.8316 => 0.8455, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.64% (0.8331 => 0.8468, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.55% (0.8338 => 0.8467, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.38% (0.8457 => 0.8574, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.97% (1.5795 => 2.5109, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.47% (1.1857 => 1.2861, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 6.00% (63.1822 => 66.9720, std.dev.: 0.0897) SingleSource/Benchmarks/Misc/ReedSolomon: 3.45% (8.5322 => 8.8264, std.dev.: 0.0317) MultiSource/Applications/siod/siod: 2.71% (3.6643 => 3.7635, std.dev.: 0.0017) MultiSource/Benchmarks/llubenchmark/llu: 2.06% (1.9967 => 2.0378, std.dev.: 0.0097) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.91% (4.8362 => 4.9286, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: 1.52% (2.3560 => 2.3919, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.40% (59.2638 => 60.0909, std.dev.: 0.3180) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -2.00% (0.6287 => 0.6161, std.dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.09% (0.3269 => 0.2972, std.dev.: 0.0026) MultiSource/Applications/lua/lua: -5.12% (29.8330 => 28.3042, std.dev.: 0.0548) SingleSource/Benchmarks/Shootout-C++/hash2: -1.47% (3.4237 => 3.3734, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.41% (3.3479 => 3.3007, std.dev.: 0.0056) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.12% (16.4461 => 16.4259, std.dev.: 0.0412) MultiSource/Applications/obsequi/Obsequi: 0.67% (1.0262 => 1.0331, std.dev.: 0.0154) MultiSource/Applications/sqlite3/sqlite3: -0.62% (0.6332 => 0.6293, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/08-main/main: -2.40% (0.1831 => 0.1787, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.1559 => 0.1559, std.dev.: 0.0065) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.95% (0.3123 => 0.3215, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.04% (0.2463 => 0.2462, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.67% (0.3344 => 0.3288, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.52% (0.2364 => 0.2328, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/bigfib: -0.45% (0.6010 => 0.5983, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: -1.63% (0.0429 => 0.0422, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.3266 => 0.3266, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: -3.96% (0.1969 => 0.1891, std.dev.: 0.0046) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.45% (0.0224 => 0.0223, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 67.48% (0.0123 => 0.0206, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.98% (0.0408 => 0.0404, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.18% (0.0254 => 0.0251, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.66% (0.0302 => 0.0297, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -9.64% (0.0384 => 0.0347, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/casts: -38.42% (0.0190 => 0.0117, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/test1: -28.33% (0.0180 => 0.0129, std.dev.: 0.0036) SingleSource/UnitTests/byval-alignment: 19.57% (0.0230 => 0.0275, std.dev.: 0.0031) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.57% (0.1438 => 0.1475, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -0.99% (1.1329 => 1.1217, std.dev.: 0.0136) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -2.19% (0.1462 => 0.1430, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.58% (0.4164 => 0.4015, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.94% (0.1369 => 0.1423, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.27% (0.0641 => 0.0588, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.56% (0.0195 => 0.0190, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.92% (0.0578 => 0.0538, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.47% (1.1437 => 1.1383, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.28% (0.0627 => 0.0619, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 17.78% (0.0180 => 0.0212, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.85% (0.8017 => 0.7949, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 11.29% (0.0062 => 0.0069, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 19 04:26:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 19 Oct 2012 06:26:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121019112603.897FD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/4999?compare_to=4996&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 4999, Order: 166274, Start Time: 2012-10-19 10:07:37, End Time: 2012-10-19 11:28:02 To: 4996, Order: 166271, Start Time: 2012-10-19 08:17:01, End Time: 2012-10-19 09:38:00 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (76 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (183 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 91 (15 on baseline) Unchanged Tests: 950 (659 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.54% (15.0961 => 15.4791, std.dev.: 0.0033) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.08% (0.6108 => 0.6103, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 0.26% (17.0806 => 17.1252, std.dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: -0.05% (56.1554 => 56.1260, std.dev.: 0.0597) MultiSource/Benchmarks/MallocBench/gs/gs: 0.18% (4.5160 => 4.5242, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.22% (0.0463 => 0.0462, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.22% (0.0465 => 0.0464) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.23% (0.0433 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.23% (0.0435 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.47% (0.0423 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.71% (0.0425 => 0.0422, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.24% (0.0415 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.24% (0.0417 => 0.0416, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.46% (0.0434 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.23% (0.0434 => 0.0433, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0427 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.47% (0.0430 => 0.0428, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.48% (0.0419 => 0.0417, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.48% (0.0420 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.47% (0.0425 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.23% (0.0427 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.46% (0.0437 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.28% (0.0439 => 0.0449, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.24% (0.0413 => 0.0412, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.24% (0.0414 => 0.0413, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.47% (0.0425 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.70% (0.0428 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.48% (0.0417 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.48% (0.0418 => 0.0416, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0408 => 0.0408) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.49% (0.0410 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0407 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0408 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.45% (0.0444 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.45% (0.0446 => 0.0444, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.49% (0.0407 => 0.0405, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.49% (0.0408 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.25% (0.0408 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.24% (0.0410 => 0.0409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.24% (0.0415 => 0.0414) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.24% (0.0417 => 0.0416) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.16% (1.2867 => 1.2847, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.27% (8.2112 => 8.1889, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.31% (0.7735 => 0.7711, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.29% (0.0350 => 0.0351, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -0.14% (0.1432 => 0.1430, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 0.06% (0.1647 => 0.1648) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.22% (0.2126 => 0.2152, std.dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: -0.05% (10.0309 => 10.0261, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.25% (63.2438 => 56.1260, std.dev.: 0.0597) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 0.55% (0.1639 => 0.1648) MultiSource/Benchmarks/NPB-serial/is/is: 4.84% (9.5636 => 10.0261, std.dev.: 0.0050) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 35.66% (14.1553 => 19.2031, std.dev.: 0.0187) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.61% (3.4629 => 5.7695, std.dev.: 0.0088) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13404.31% (0.0720 => 9.7231, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049900.00% (0.0001 => 10.0500, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.23% (0.2554 => 0.4169, std.dev.: 0.0081) SingleSource/Regression/C/matrixTranspose: 57.14% (0.0245 => 0.0385, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 51.95% (0.0256 => 0.0389, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: 49.31% (10.3673 => 15.4791, std.dev.: 0.0033) SingleSource/UnitTests/SignlessTypes/factor: 41.55% (0.0296 => 0.0419, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 36.31% (0.1622 => 0.2211, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/distray/distray: 35.13% (0.1056 => 0.1427, std.dev.: 0.0004) SingleSource/UnitTests/vla: 29.30% (0.0355 => 0.0459) SingleSource/Benchmarks/Misc/ReedSolomon: 22.74% (0.2049 => 0.2515, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 22.66% (0.0834 => 0.1023, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.76% (0.1236 => 0.1505, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.31% (0.1566 => 0.1884, std.dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: 19.47% (0.0719 => 0.0859, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 18.62% (0.1584 => 0.1879, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.83% (2.2022 => 2.5948, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 17.81% (0.1432 => 0.1687, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.50% (7.0540 => 8.2882, std.dev.: 0.0070) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.88% (0.0871 => 0.1018, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 16.79% (0.5105 => 0.5962, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 16.39% (0.6675 => 0.7769, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 15.68% (3.3354 => 3.8585, std.dev.: 0.0185) SingleSource/Benchmarks/McGill/chomp: 15.59% (0.1655 => 0.1913, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.18% (1.3050 => 1.5031, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.60% (0.5020 => 0.5753, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.43% (1.5415 => 1.7639, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 14.41% (0.7115 => 0.8140, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.15% (0.1032 => 0.1178, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 14.08% (0.3282 => 0.3744, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.91% (0.2271 => 0.2587, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.91% (0.0798 => 0.0909, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 13.89% (0.1440 => 0.1640, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.51% (1.7609 => 1.9988, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.51% (0.1510 => 0.1714, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 13.18% (0.3423 => 0.3874, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.14% (0.3121 => 0.3531, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 13.00% (9.4845 => 10.7173, std.dev.: 0.0204) MultiSource/Applications/sgefa/sgefa: 12.99% (0.3109 => 0.3513, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 12.98% (0.1695 => 0.1915, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.77% (4.2646 => 4.8092, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/matrix: 12.71% (0.0818 => 0.0922, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.68% (0.4615 => 0.5200, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.66% (0.1438 => 0.1620, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/exptree: 12.65% (0.0814 => 0.0917, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 12.51% (0.1175 => 0.1322, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 12.41% (0.1555 => 0.1748, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 12.39% (5.7591 => 6.4726, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 12.33% (1.0722 => 1.2044, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 12.32% (0.7433 => 0.8349, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 12.29% (0.0838 => 0.0941, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.27% (0.1940 => 0.2178, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.27% (0.1337 => 0.1501, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 12.26% (0.6450 => 0.7241, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 12.25% (0.1151 => 0.1292, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/mst/mst: 12.21% (0.1163 => 0.1305, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.11% (0.0933 => 0.1046, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 12.10% (8.1363 => 9.1204, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.09% (0.1695 => 0.1900, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 12.08% (0.0886 => 0.0993, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 12.06% (0.7835 => 0.8780, std.dev.: 0.0016) MultiSource/Applications/Burg/burg: 12.03% (1.1642 => 1.3042, std.dev.: 0.0020) MultiSource/Applications/treecc/treecc: 12.02% (2.0273 => 2.2709, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.94% (0.8067 => 0.9030, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.93% (0.2758 => 0.3087, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.89% (0.2700 => 0.3021, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 11.88% (1.1840 => 1.3247, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 11.86% (3.8723 => 4.3314, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.83% (0.9765 => 1.0920, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/neural/neural: 11.83% (0.1463 => 0.1636, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 11.72% (0.3387 => 0.3784, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.69% (0.1625 => 0.1815, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.59% (0.5860 => 0.6539, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.58% (0.3307 => 0.3690, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.50% (5.0018 => 5.5772, std.dev.: 0.0024) SingleSource/UnitTests/SignlessTypes/rem: 11.45% (0.1144 => 0.1275, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.44% (4.9449 => 5.5107, std.dev.: 0.0118) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.43% (0.1330 => 0.1482, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.41% (0.0929 => 0.1035, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.40% (0.8172 => 0.9104, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.39% (0.2107 => 0.2347, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 11.38% (10.4361 => 11.6241, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/football/football: 11.27% (0.8921 => 0.9926, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.18% (1.1861 => 1.3187, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.15% (7.9617 => 8.8494, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.97% (1.5859 => 1.7598, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.92% (0.1117 => 0.1239, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.86% (0.4879 => 0.5409, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.81% (0.3543 => 0.3926, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.80% (0.3177 => 0.3520, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.69% (0.1029 => 0.1139, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.65% (0.1906 => 0.2109, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.47% (2.2024 => 2.4329, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/bigfib: 10.38% (0.6456 => 0.7126, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.36% (0.1062 => 0.1172, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.36% (1.4186 => 1.5655, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.32% (0.1143 => 0.1261, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.31% (0.1125 => 0.1241, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 10.25% (0.3473 => 0.3829, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.24% (0.3497 => 0.3855, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/parameter-passing: 10.24% (0.3927 => 0.4329, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 10.23% (0.4299 => 0.4739, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.22% (0.5569 => 0.6138, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.18% (0.2603 => 0.2868, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 10.18% (2.2969 => 2.5307, std.dev.: 0.0160) SingleSource/UnitTests/ObjC/for-in: 10.15% (0.3694 => 0.4069, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.14% (0.3561 => 0.3922, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.13% (0.3543 => 0.3902, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.11% (0.3828 => 0.4215, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.01% (0.3516 => 0.3868, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 9.97% (0.3180 => 0.3497, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.91% (0.3886 => 0.4271, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.83% (0.2065 => 0.2268, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.75% (0.2266 => 0.2487, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 9.70% (0.3092 => 0.3392, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/health/health: 9.70% (0.1268 => 0.1391, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 9.57% (21.9371 => 24.0355, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.47% (0.3441 => 0.3767, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 9.45% (1.5603 => 1.7077, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 9.33% (0.4620 => 0.5051, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 9.19% (0.4289 => 0.4683, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.94% (0.3826 => 0.4168, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.86% (0.5981 => 0.6511, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.71% (0.4203 => 0.4569, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.70% (0.4103 => 0.4460, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.62% (0.3865 => 0.4198, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 8.60% (0.4048 => 0.4396, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/lists: 8.53% (0.3422 => 0.3714, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.35% (0.1892 => 0.2050, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.15% (0.4636 => 0.5014, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: 8.11% (0.6030 => 0.6519, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 8.03% (0.3684 => 0.3980, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.02% (0.3427 => 0.3702, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 8.01% (17.1811 => 18.5581, std.dev.: 0.0089) SingleSource/UnitTests/ObjC++/Hello: 7.98% (0.5925 => 0.6398, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.60% (0.8101 => 0.8717, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 7.58% (0.3603 => 0.3876, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.43% (0.7326 => 0.7870, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.15% (0.3650 => 0.3911, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.13% (14.3668 => 15.3913, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.94% (0.4064 => 0.4346, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.85% (3.8922 => 4.1589, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 6.81% (0.3098 => 0.3309, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.77% (0.3162 => 0.3376, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 6.54% (0.2905 => 0.3095, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.54% (0.3136 => 0.3341, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 6.52% (0.3283 => 0.3497, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.50% (0.2831 => 0.3015, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.40% (0.2891 => 0.3076, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.35% (2.0665 => 2.1978, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.27% (0.2872 => 0.3052, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.17% (0.2871 => 0.3048, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.08% (0.2877 => 0.3052, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.02% (0.2756 => 0.2922) SingleSource/Benchmarks/Shootout-C++/ary2: 5.95% (0.3379 => 0.3580, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.94% (0.2793 => 0.2959, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 5.83% (0.2725 => 0.2884, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.83% (0.3052 => 0.3230, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 5.75% (0.2802 => 0.2963, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.60% (0.2714 => 0.2866, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.56% (0.2430 => 0.2565, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 5.54% (1.2842 => 1.3553, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/objinst: 4.89% (0.3131 => 0.3284, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.76% (1.1194 => 1.1503, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.65% (0.3817 => 0.3918, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.79% (1.1396 => 1.2512, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 9.67% (0.9957 => 1.0920, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/hash2: 6.64% (3.1578 => 3.3674, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 5.94% (1.9405 => 2.0557, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.4162 => 0.4322, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.52% (4.2280 => 4.3344, std.dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0313 => 1.0563, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7655, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.15% (3.6395 => 3.7178, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bisort/bisort: 1.78% (0.8333 => 0.8481, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2078, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.49% (2.6546 => 2.6942, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.00% (6.6874 => 0.1335, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -79.94% (0.8651 => 0.1735, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.21% (5.2763 => 3.2072, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.25% (5.3855 => 3.7028, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.74% (5.3526 => 3.7074, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -14.62% (54.1659 => 46.2479, std.dev.: 0.0168) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.53% (2.9384 => 2.6289, std.dev.: 0.0031) MultiSource/Applications/ClamAV/clamscan: -7.25% (22.1758 => 20.5691, std.dev.: 0.0362) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.09% (8.0499 => 3.7762, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.42% (1.1492 => 0.7651, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.64% (1.6925 => 1.4278, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -12.43% (1.2373 => 1.0835, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3453 => 2.9599, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -10.93% (1.5373 => 1.3692, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.25% (19.9488 => 18.3024, std.dev.: 0.0090) MultiSource/Benchmarks/FreeBench/mason/mason: -7.96% (0.2161 => 0.1989, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.48% (1.6805 => 1.5548, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.01% (1.8329 => 1.7044, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-5: -5.10% (1.5835 => 1.5027, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.44% (8.1563 => 7.7940, std.dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Applications/siod/siod: -3.62% (3.2827 => 3.1639, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8778, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4955, std.dev.: 0.0075) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.48% (0.4808 => 0.4689, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -1.78% (10.2830 => 10.1002, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6820, std.dev.: 0.0009) SingleSource/UnitTests/Vector/multiplies: -1.68% (2.5528 => 2.5098, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: -1.23% (4.6441 => 4.5871, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2878, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8585, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 16.71% (0.5229 => 0.6103, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 14.25% (14.9895 => 17.1252, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 10.06% (4.1105 => 4.5242, std.dev.: 0.0123) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 16.28% (1.1048 => 1.2847, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.40% (7.1582 => 8.1889, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 23.93% (0.6222 => 0.7711, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35000.00% (0.0001 => 0.0351, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.70% (0.1485 => 0.1430, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.70% (0.2116 => 0.2152, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 19 05:32:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 19 Oct 2012 07:32:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121019123216.730272A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5000?compare_to=4997&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5000, Order: 166274, Start Time: 2012-10-19 11:09:24, End Time: 2012-10-19 12:35:15 To: 4997, Order: 166273, Start Time: 2012-10-19 09:13:39, End Time: 2012-10-19 10:39:53 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (189 on baseline) Performance Improvements: 1 (40 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1040 (675 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.14% (3.7475 => 3.8277, std.dev.: 0.0303) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.20% (80.9095 => 79.9367, std.dev.: 0.2033) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.24% (2.0176 => 2.4865, std.dev.: 0.0146) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.94% (0.1410 => 0.1677, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 17.07% (0.0826 => 0.0967, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 16.76% (0.2243 => 0.2619, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.32% (0.1327 => 0.1517, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 14.31% (0.1013 => 0.1158, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.55% (0.0834 => 0.0947, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.23% (0.1413 => 0.1600, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 12.94% (0.7038 => 0.7949, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 12.88% (1.3693 => 1.5456, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 12.73% (0.4328 => 0.4879, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.69% (0.1072 => 0.1208, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.64% (0.2721 => 0.3065, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.52% (0.2596 => 0.2921, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.50% (3.9660 => 4.4618, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.49% (0.6959 => 0.7828, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.37% (0.7710 => 0.8664, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.34% (0.0964 => 0.1083, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.34% (0.1588 => 0.1784, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 12.26% (0.4062 => 0.4560, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.98% (0.5265 => 0.5896, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.90% (0.3899 => 0.4363, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 11.87% (13.8202 => 15.4613, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.83% (1.4563 => 1.6286, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.79% (0.6283 => 0.7024, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 11.76% (0.1003 => 0.1121, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.76% (0.9199 => 1.0281, std.dev.: 0.0012) MultiSource/Applications/aha/aha: 11.58% (0.1062 => 0.1185, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.58% (0.3022 => 0.3372, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.29% (1.2193 => 1.3570, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 11.19% (0.5818 => 0.6469, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.02% (0.3485 => 0.3869, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 10.98% (1.0313 => 1.1445, std.dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.96% (0.4390 => 0.4871, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 10.93% (0.5748 => 0.6376, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.92% (0.4791 => 0.5314, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.91% (0.4016 => 0.4454, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.90% (1.1364 => 1.2603, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 10.90% (0.2781 => 0.3084, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 10.88% (0.3868 => 0.4289, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.86% (0.3756 => 0.4164, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 10.85% (0.7061 => 0.7827, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.84% (0.3580 => 0.3968, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.83% (0.3130 => 0.3469, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.80% (0.1157 => 0.1282, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.79% (0.1075 => 0.1191, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.78% (0.5577 => 0.6178, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 10.74% (1.1061 => 1.2249, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/lists: 10.72% (0.3293 => 0.3646, std.dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.67% (0.2914 => 0.3225, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.60% (0.2782 => 0.3077, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 10.54% (0.3453 => 0.3817, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 10.50% (0.6744 => 0.7452, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.49% (0.3489 => 0.3855, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.39% (0.4379 => 0.4834, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.38% (1.9828 => 2.1887, std.dev.: 0.0035) MultiSource/Applications/viterbi/viterbi: 10.35% (0.1478 => 0.1631, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/mst/mst: 10.35% (0.1111 => 0.1226, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.34% (0.0977 => 0.1078, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.32% (0.1986 => 0.2191, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.28% (0.2966 => 0.3271, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 10.28% (0.2607 => 0.2875, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.27% (0.1276 => 0.1407, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.26% (0.3246 => 0.3579, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 10.26% (16.6129 => 18.3170, std.dev.: 0.0259) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.26% (0.8698 => 0.9590, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/strcat: 10.23% (0.2726 => 0.3005, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.20% (0.1569 => 0.1729, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 10.19% (0.3149 => 0.3470) SingleSource/Benchmarks/Shootout-C++/methcall: 10.18% (0.2761 => 0.3042, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary: 10.17% (0.3107 => 0.3423, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.17% (0.2655 => 0.2925, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 10.15% (0.2690 => 0.2963, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 10.11% (0.2937 => 0.3234, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 10.07% (0.3534 => 0.3890, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 10.07% (0.2760 => 0.3038, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 10.05% (0.2995 => 0.3296, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 10.03% (3.1889 => 3.5087, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.03% (0.7460 => 0.8208, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 10.02% (3.8646 => 4.2517, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/fibo: 10.01% (0.2628 => 0.2891, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 10.01% (0.7506 => 0.8257, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 10.00% (0.3220 => 0.3542, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 10.00% (1.9270 => 2.1197, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.96% (0.1014 => 0.1115, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 9.94% (0.1589 => 0.1747, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.93% (0.5637 => 0.6197, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.92% (0.1865 => 0.2050, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 9.88% (0.2925 => 0.3214, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.87% (0.2765 => 0.3038, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 9.87% (0.8310 => 0.9130, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 9.84% (0.3192 => 0.3506, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.76% (0.2696 => 0.2959, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.74% (0.2023 => 0.2220, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.69% (4.9865 => 5.4699, std.dev.: 0.0048) MultiSource/Applications/siod/siod: 9.69% (2.1791 => 2.3903, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.69% (0.2127 => 0.2333, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.62% (7.2180 => 7.9127, std.dev.: 0.0028) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.48% (0.1435 => 0.1571, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 9.47% (0.2988 => 0.3271, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.29% (0.3755 => 0.4104, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 9.07% (0.2945 => 0.3212, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 9.05% (0.1657 => 0.1807, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.95% (1.3245 => 1.4430, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.93% (0.6576 => 0.7163, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.90% (3.6692 => 3.9959, std.dev.: 0.0088) MultiSource/Benchmarks/nbench/nbench: 8.76% (1.0594 => 1.1522, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.66% (0.3511 => 0.3815, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.64% (0.2140 => 0.2325, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 8.59% (0.6250 => 0.6787, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.58% (4.3801 => 4.7561, std.dev.: 0.0028) MultiSource/Applications/JM/lencod/lencod: 8.56% (14.8535 => 16.1254, std.dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.46% (0.6135 => 0.6654, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.44% (4.4433 => 4.8183, std.dev.: 0.0042) MultiSource/Applications/oggenc/oggenc: 8.40% (4.6629 => 5.0547, std.dev.: 0.0034) MultiSource/Benchmarks/sim/sim: 8.40% (0.3131 => 0.3394, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.31% (1.5188 => 1.6450, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 8.25% (8.4961 => 9.1969, std.dev.: 0.0077) MultiSource/Applications/SIBsim4/SIBsim4: 8.24% (1.2749 => 1.3799, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.22% (0.1789 => 0.1936, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.21% (0.8818 => 0.9542, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.83% (3.2742 => 3.5306, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.67% (0.3245 => 0.3494, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 7.65% (0.1385 => 0.1491, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.65% (1.1333 => 1.2200, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/05-eks/eks: 7.63% (0.4113 => 0.4427, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.55% (0.4805 => 0.5168, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.54% (2.1007 => 2.2590, std.dev.: 0.0066) MultiSource/Applications/lua/lua: 7.49% (3.7467 => 4.0273, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.47% (0.9108 => 0.9788, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 7.42% (6.5754 => 7.0634, std.dev.: 0.0073) MultiSource/Applications/hexxagon/hexxagon: 7.39% (1.2292 => 1.3200, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.23% (0.2504 => 0.2685, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/parameter-passing: 6.99% (0.4003 => 0.4283, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 6.85% (0.3914 => 0.4182, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.82% (6.2785 => 6.7068, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/property: 6.73% (0.3940 => 0.4205, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.71% (0.1819 => 0.1941, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/oourafft: 6.67% (0.2008 => 0.2142, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 6.60% (0.3578 => 0.3814, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 6.58% (0.3646 => 0.3886, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 6.57% (0.3789 => 0.4038, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.55% (0.3601 => 0.3837, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.55% (0.3663 => 0.3903, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.41% (0.3650 => 0.3884, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 6.40% (0.3623 => 0.3855, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.24% (13.2842 => 14.1137, std.dev.: 0.0051) MultiSource/Applications/sqlite3/sqlite3: 5.19% (16.2614 => 17.1059, std.dev.: 0.0104) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.90% (0.2243 => 0.2353, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 4.34% (14.5298 => 15.1597, std.dev.: 0.0150) MultiSource/Benchmarks/Bullet/bullet: 2.38% (33.2944 => 34.0858, std.dev.: 0.0185) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5177, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/fbench: 24.23% (1.8175 => 2.2578, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.04% (1.0895 => 1.2751, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: 11.11% (1.1560 => 1.2844, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 8.99% (0.8273 => 0.9017, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4142, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.43% (0.9692 => 1.0218) SingleSource/Benchmarks/Misc/mandel-2: 5.31% (1.2998 => 1.3688, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0048, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 4.48% (0.5449 => 0.5693, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.46% (2.8606 => 2.9881, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 3.61% (10.7476 => 11.1357, std.dev.: 0.0322) SingleSource/Benchmarks/Misc/flops-6: 3.46% (1.9199 => 1.9863, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.39% (12.0921 => 12.5018, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.22% (11.2619 => 11.6244, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bisort/bisort: 2.97% (0.8239 => 0.8484, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.41% (1.0310 => 1.0558, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.10% (7.4271 => 7.5827, std.dev.: 0.0028) MultiSource/Applications/lemon/lemon: 1.71% (1.4298 => 1.4543, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5132, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9692, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2122, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1887, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.21% (5.5130 => 5.5799, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.17% (9.9194 => 10.0359, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 1.07% (12.4560 => 12.5899, std.dev.: 0.0083) SingleSource/Benchmarks/McGill/queens: 1.01% (2.1753 => 2.1973, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.74% (0.2670 => 0.1422) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.36% (0.4657 => 0.3895, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/mason/mason: -14.14% (0.0707 => 0.0607) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.44% (1.3819 => 1.1962, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.39% (1.3813 => 1.1964, std.dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.28% (1.0460 => 0.8548, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -13.00% (0.2238 => 0.1947, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.08% (20.3410 => 18.2906, std.dev.: 0.0155) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.52% (1.3780 => 1.2882, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: -5.70% (1.2308 => 1.1606, std.dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5148, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.02% (0.9996 => 0.9594, std.dev.: 0.0049) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.81% (1.7688 => 1.7014, std.dev.: 0.0110) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -2.88% (3.2729 => 3.1788, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -2.87% (3.0263 => 2.9395, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: -2.75% (1.9762 => 1.9218, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8812, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.37% (4.1080 => 4.0106, std.dev.: 0.0046) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.09% (0.6589 => 0.6451, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.87% (0.6615 => 0.6491, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -1.87% (6.3560 => 6.2372, std.dev.: 0.0092) MultiSource/Applications/lua/lua: -1.68% (26.5159 => 26.0701, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.63% (0.8342 => 0.8206, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.63% (2.5254 => 2.4843, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0071, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2509, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: -1.24% (28.2225 => 27.8734, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/heapsort: -1.20% (3.9173 => 3.8702, std.dev.: 0.0117) MultiSource/Applications/aha/aha: -1.08% (3.1476 => 3.1137, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -1.05% (84.4286 => 83.5426, std.dev.: 0.0046) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 19 05:52:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 19 Oct 2012 07:52:31 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121019125231.C1DD12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5001?compare_to=4998&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5001, Order: 166278, Start Time: 2012-10-19 11:31:24, End Time: 2012-10-19 12:54:32 To: 4998, Order: 166274, Start Time: 2012-10-19 09:50:55, End Time: 2012-10-19 11:14:32 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 9 (16 on baseline) Performance Improvements: 2 (5 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 964 (953 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.86% (0.0643 => 0.0790, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.68% (0.2357 => 0.2538, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.70% (0.2121 => 0.2242, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.48% (0.5737 => 0.5994, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/gs/gs: 1.85% (4.0444 => 4.1193, std.dev.: 0.0179) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.74% (1.3067 => 1.3295, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.26% (0.8001 => 0.8102, std.dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.33% (21.4999 => 22.2169, std.dev.: 0.0343) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.07% (2.4663 => 2.4926, std.dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.61% (1.2653 => 1.2449, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Prolangs-C++/life/life: -1.41% (2.6565 => 2.6190, std.dev.: 0.0127) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.15% (16.4259 => 16.4010, std.dev.: 0.1224) MultiSource/Applications/obsequi/Obsequi: -2.06% (1.0331 => 1.0118, std.dev.: 0.0145) MultiSource/Applications/sqlite3/sqlite3: 0.59% (0.6293 => 0.6330, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: 2.85% (0.1787 => 0.1838, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.77% (0.1559 => 0.1547, std.dev.: 0.0055) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.27% (0.3215 => 0.3142, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.52% (0.2462 => 0.2400, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.61% (0.3288 => 0.3341, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.20% (0.2328 => 0.2356, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: -0.52% (0.5983 => 0.5952, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: 1.18% (0.0422 => 0.0427, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.34% (0.3266 => 0.3277, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/strcat: 4.34% (0.1891 => 0.1973, std.dev.: 0.0022) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -8.97% (0.0223 => 0.0203, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -22.82% (0.0206 => 0.0159, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -19.31% (0.0404 => 0.0326, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 25.90% (0.0251 => 0.0316, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -21.89% (0.0297 => 0.0232, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 6.63% (0.0347 => 0.0370, std.dev.: 0.0083) SingleSource/UnitTests/Vector/Altivec/casts: 62.39% (0.0117 => 0.0190, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/test1: 27.91% (0.0129 => 0.0165, std.dev.: 0.0018) SingleSource/UnitTests/byval-alignment: -8.73% (0.0275 => 0.0251, std.dev.: 0.0037) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.20% (0.1475 => 0.1478, std.dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.02% (1.1217 => 1.1219, std.dev.: 0.0251) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 5.80% (0.1430 => 0.1513, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.24% (0.4015 => 0.4145, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.19% (0.1423 => 0.1440, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.23% (0.0588 => 0.0607, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 32.11% (0.0190 => 0.0251, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.97% (0.0538 => 0.0554, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.46% (1.1383 => 1.1435, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2500.00% (0.0001 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.46% (0.0619 => 0.0579, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.66% (0.0212 => 0.0224, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.84% (0.7949 => 0.8016, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -28.99% (0.0069 => 0.0049, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.09% (2.1832 => 1.6572, std.dev.: 0.0032) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.21% (0.7473 => 0.7638, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.14% (0.7932 => 0.8102, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.59% (0.8261 => 0.8392, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.14% (1.4479 => 1.4644, std.dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.89% (1.5795 => 2.5096, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.51% (0.3186 => 0.3457, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.11% (1.1857 => 1.2819, std.dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 5.97% (63.1822 => 66.9519, std.dev.: 0.0446) SingleSource/Benchmarks/Misc/ReedSolomon: 3.14% (8.5322 => 8.7998, std.dev.: 0.0153) MultiSource/Applications/siod/siod: 2.96% (3.6643 => 3.7729, std.dev.: 0.0176) SingleSource/Benchmarks/Shootout-C++/hash: 1.80% (0.6205 => 0.6317, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.78% (2.4490 => 2.4926, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/bh/bh: 1.75% (2.3560 => 2.3973, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 1.43% (2.2485 => 2.2807, std.dev.: 0.0118) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.42% (4.8362 => 4.9047, std.dev.: 0.0124) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.07% (1.5941 => 1.6112, std.dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.71% (0.3269 => 0.3017, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -4.92% (29.8330 => 28.3657, std.dev.: 0.0443) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.99% (1.0388 => 1.0181, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/hash2: -1.43% (3.4237 => 3.3746, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.17% (3.3479 => 3.3088, std.dev.: 0.0014) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.27% (16.4461 => 16.4010, std.dev.: 0.1224) MultiSource/Applications/obsequi/Obsequi: -1.40% (1.0262 => 1.0118, std.dev.: 0.0145) MultiSource/Applications/sqlite3/sqlite3: -0.03% (0.6332 => 0.6330, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: 0.38% (0.1831 => 0.1838, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.77% (0.1559 => 0.1547, std.dev.: 0.0055) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.61% (0.3123 => 0.3142, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.56% (0.2463 => 0.2400, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.09% (0.3344 => 0.3341, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.34% (0.2364 => 0.2356, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: -0.97% (0.6010 => 0.5952, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -0.47% (0.0429 => 0.0427, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.34% (0.3266 => 0.3277, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/strcat: 0.20% (0.1969 => 0.1973, std.dev.: 0.0022) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -9.38% (0.0224 => 0.0203, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 29.27% (0.0123 => 0.0159, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -20.10% (0.0408 => 0.0326, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 24.41% (0.0254 => 0.0316, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -23.18% (0.0302 => 0.0232, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.65% (0.0384 => 0.0370, std.dev.: 0.0083) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0190 => 0.0190, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/test1: -8.33% (0.0180 => 0.0165, std.dev.: 0.0018) SingleSource/UnitTests/byval-alignment: 9.13% (0.0230 => 0.0251, std.dev.: 0.0037) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.78% (0.1438 => 0.1478, std.dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.97% (1.1329 => 1.1219, std.dev.: 0.0251) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.49% (0.1462 => 0.1513, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.46% (0.4164 => 0.4145, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.19% (0.1369 => 0.1440, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.30% (0.0641 => 0.0607, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 28.72% (0.0195 => 0.0251, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.15% (0.0578 => 0.0554, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.02% (1.1437 => 1.1435, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.66% (0.0627 => 0.0579, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.44% (0.0180 => 0.0224, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.01% (0.8017 => 0.8016, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -20.97% (0.0062 => 0.0049, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 19 06:16:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 19 Oct 2012 08:16:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121019131612.598F42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5002?compare_to=4999&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5002, Order: 166278, Start Time: 2012-10-19 11:57:47, End Time: 2012-10-19 13:18:11 To: 4999, Order: 166274, Start Time: 2012-10-19 10:07:37, End Time: 2012-10-19 11:28:02 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (76 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (183 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 91 (15 on baseline) Unchanged Tests: 950 (659 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.83% (15.4791 => 16.0718, std.dev.: 0.0079) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.31% (0.6103 => 0.6122, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 0.13% (17.1252 => 17.1475, std.dev.: 0.0220) MultiSource/Benchmarks/Bullet/bullet: 0.53% (56.1260 => 56.4238, std.dev.: 0.0104) MultiSource/Benchmarks/MallocBench/gs/gs: -0.12% (4.5242 => 4.5188, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.22% (0.0462 => 0.0463) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.22% (0.0464 => 0.0465, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.23% (0.0432 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.23% (0.0434 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.48% (0.0421 => 0.0423, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.47% (0.0422 => 0.0424) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.48% (0.0414 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.48% (0.0416 => 0.0418, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.23% (0.0432 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.46% (0.0433 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.23% (0.0427 => 0.0428) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.47% (0.0428 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.48% (0.0417 => 0.0419) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.24% (0.0418 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.71% (0.0423 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.23% (0.0426 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.23% (0.0435 => 0.0436, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.45% (0.0449 => 0.0438, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.24% (0.0412 => 0.0413) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.24% (0.0413 => 0.0414) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.47% (0.0423 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.47% (0.0425 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.24% (0.0415 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.48% (0.0416 => 0.0418) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0408 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.49% (0.0408 => 0.0410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.25% (0.0407 => 0.0408) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.25% (0.0408 => 0.0409) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.68% (0.0442 => 0.0445, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.45% (0.0444 => 0.0446, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.25% (0.0405 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.49% (0.0406 => 0.0408) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.49% (0.0407 => 0.0409) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.24% (0.0409 => 0.0410) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.24% (0.0414 => 0.0415, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0416 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.34% (1.2847 => 1.2891, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.46% (8.1889 => 8.2262, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.36% (0.7711 => 0.7739, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.28% (0.0351 => 0.0350, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1430 => 0.1431) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -0.06% (0.1648 => 0.1647, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.25% (0.2152 => 0.2125, std.dev.: 0.0021) MultiSource/Benchmarks/NPB-serial/is/is: 0.06% (10.0261 => 10.0319, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -10.78% (63.2438 => 56.4238, std.dev.: 0.0104) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 0.49% (0.1639 => 0.1647, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 4.90% (9.5636 => 10.0319, std.dev.: 0.0048) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 36.06% (14.1553 => 19.2604, std.dev.: 0.0135) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.15% (3.4629 => 5.7883, std.dev.: 0.0015) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13403.19% (0.0720 => 9.7223, std.dev.: 0.0189) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049900.00% (0.0001 => 10.0500, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.55% (0.2554 => 0.4177, std.dev.: 0.0002) SingleSource/Regression/C/matrixTranspose: 57.55% (0.0245 => 0.0386, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 55.02% (10.3673 => 16.0718, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/lowercase: 52.34% (0.0256 => 0.0390, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 41.89% (0.0296 => 0.0420, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 37.05% (0.1622 => 0.2223, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 35.70% (0.1056 => 0.1433) SingleSource/UnitTests/vla: 29.58% (0.0355 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 23.38% (0.0834 => 0.1029, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 23.23% (0.2049 => 0.2525, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 22.01% (0.1236 => 0.1508, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.75% (0.1566 => 0.1891, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 19.61% (0.0719 => 0.0860, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 18.99% (0.1432 => 0.1704, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 18.81% (0.1584 => 0.1882, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.45% (2.2022 => 2.6085, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.94% (7.0540 => 8.3195, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.22% (0.0871 => 0.1021, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.14% (0.5105 => 0.5980, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 16.81% (0.6675 => 0.7797, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 15.90% (3.3354 => 3.8656, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: 15.89% (0.1655 => 0.1918, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.29% (1.3050 => 1.5045, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.80% (0.5020 => 0.5763, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 14.60% (0.7115 => 0.8154, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/oourafft: 14.41% (0.3282 => 0.3755, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 14.31% (0.1440 => 0.1646, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 14.27% (0.2271 => 0.2595, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.27% (1.5415 => 1.7614, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.24% (0.1032 => 0.1179, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.99% (1.7609 => 2.0073, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.64% (0.1510 => 0.1716, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 13.33% (0.1695 => 0.1921, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 13.32% (0.3423 => 0.3879, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 13.32% (9.4845 => 10.7476, std.dev.: 0.0121) MultiSource/Applications/sgefa/sgefa: 13.25% (0.3109 => 0.3521, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.11% (4.2646 => 4.8237, std.dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.98% (0.4615 => 0.5214, std.dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 12.96% (5.7591 => 6.5054, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout/matrix: 12.84% (0.0818 => 0.0923, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 12.77% (0.0838 => 0.0945, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 12.77% (0.1175 => 0.1325, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/exptree: 12.65% (0.0814 => 0.0917, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.64% (0.1337 => 0.1506, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.57% (0.1695 => 0.1908, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 12.54% (1.1642 => 1.3102, std.dev.: 0.0071) MultiSource/Applications/aha/aha: 12.51% (0.1151 => 0.1295, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 12.48% (0.6450 => 0.7255, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 12.48% (0.1555 => 0.1749, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 12.44% (8.1363 => 9.1481, std.dev.: 0.0046) MultiSource/Applications/lambda-0_1_3/lambda: 12.42% (0.7433 => 0.8356, std.dev.: 0.0020) MultiSource/Applications/lemon/lemon: 12.40% (1.0722 => 1.2051, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/mst/mst: 12.38% (0.1163 => 0.1307, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.32% (0.1940 => 0.2179, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 12.30% (0.0886 => 0.0995, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.22% (0.0933 => 0.1047, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 12.20% (1.1840 => 1.3285, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 12.19% (2.0273 => 2.2744, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 12.14% (10.4361 => 11.7030, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/neural/neural: 11.96% (0.1463 => 0.1638, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 11.93% (0.3387 => 0.3791, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.90% (0.9765 => 1.0927, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 11.88% (0.7835 => 0.8766, std.dev.: 0.0021) MultiSource/Applications/lua/lua: 11.86% (3.8723 => 4.3316, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.83% (0.5860 => 0.6553, std.dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.73% (0.0929 => 0.1038, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.73% (0.3307 => 0.3695, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.70% (5.0018 => 5.5872, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.70% (0.2700 => 0.3016, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.69% (0.1625 => 0.1815, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.63% (4.9449 => 5.5202, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.55% (0.8067 => 0.8999, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.54% (0.1438 => 0.1604, std.dev.: 0.0018) SingleSource/UnitTests/SignlessTypes/rem: 11.45% (0.1144 => 0.1275, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.44% (0.3121 => 0.3478, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.44% (0.2107 => 0.2348, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.36% (1.1861 => 1.3208, std.dev.: 0.0077) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.35% (0.1330 => 0.1481, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.33% (7.9617 => 8.8641, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.20% (0.2758 => 0.3067, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.19% (0.4879 => 0.5425, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 11.11% (0.8921 => 0.9912, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.09% (0.3543 => 0.3936, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.07% (1.5859 => 1.7614, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 11.01% (0.1117 => 0.1240, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.99% (0.3177 => 0.3526, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.86% (0.1906 => 0.2113, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.81% (2.2024 => 2.4405, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.81% (0.8172 => 0.9055, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.79% (0.1029 => 0.1140, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.76% (0.1125 => 0.1246, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 10.68% (0.4299 => 0.4758, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.64% (0.1062 => 0.1175, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 10.63% (0.6456 => 0.7142, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 10.47% (0.3927 => 0.4338, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.45% (0.3473 => 0.3836, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.45% (0.3828 => 0.4228, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.44% (0.3543 => 0.3913, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.43% (0.5569 => 0.6150, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.41% (0.1143 => 0.1262, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.39% (1.4186 => 1.5660, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 10.39% (0.3561 => 0.3931, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.35% (0.3516 => 0.3880, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.35% (0.3497 => 0.3859, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.34% (0.3694 => 0.4076, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 10.27% (0.3886 => 0.4285, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 10.13% (2.2969 => 2.5296, std.dev.: 0.0140) MultiSource/Benchmarks/McCat/09-vor/vor: 10.03% (0.3180 => 0.3499, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.02% (0.2065 => 0.2272, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.02% (0.2266 => 0.2493, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 10.00% (1.5603 => 1.7164, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 9.95% (0.2603 => 0.2862, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 9.93% (0.3092 => 0.3399, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/health/health: 9.78% (0.1268 => 0.1392, std.dev.: 0.0039) MultiSource/Applications/JM/lencod/lencod: 9.69% (21.9371 => 24.0636, std.dev.: 0.0173) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.62% (0.3441 => 0.3772, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 9.52% (0.4620 => 0.5060, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 9.37% (0.4289 => 0.4691, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.23% (0.4636 => 0.5064, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.18% (0.5981 => 0.6530, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.15% (0.3826 => 0.4176, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.93% (0.1892 => 0.2061, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.90% (0.4203 => 0.4577, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 8.83% (0.3422 => 0.3724, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.77% (0.3865 => 0.4204, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 8.67% (0.4048 => 0.4399, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.65% (0.4103 => 0.4458, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 8.61% (0.6030 => 0.6549, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.49% (0.5925 => 0.6428, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 8.28% (0.3684 => 0.3989, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.20% (0.3427 => 0.3708, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 8.00% (17.1811 => 18.5548, std.dev.: 0.0038) SingleSource/UnitTests/ObjC++/property-reference: 7.84% (0.7326 => 0.7900, std.dev.: 0.0083) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.80% (0.8101 => 0.8733, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sieve: 7.74% (0.3603 => 0.3882, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.34% (0.3650 => 0.3918, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.33% (0.2905 => 0.3118, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.21% (14.3668 => 15.4027, std.dev.: 0.0122) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.17% (3.8922 => 4.1711, std.dev.: 0.0141) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.09% (0.4064 => 0.4352, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.08% (0.3162 => 0.3386, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.91% (0.3098 => 0.3312, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.79% (0.3136 => 0.3349, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 6.75% (0.2831 => 0.3022, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.71% (0.3232 => 0.3449, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.67% (0.3283 => 0.3502, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.64% (0.2891 => 0.3083, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.61% (2.0665 => 2.2030, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.51% (0.2872 => 0.3059, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.41% (0.2871 => 0.3055, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.29% (0.2877 => 0.3058, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 6.19% (0.3379 => 0.3588, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.17% (0.2756 => 0.2926, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.12% (0.2793 => 0.2964, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.06% (0.3052 => 0.3237, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.06% (0.2725 => 0.2890, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.00% (0.2802 => 0.2970, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.86% (0.2714 => 0.2873, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.76% (0.2430 => 0.2570, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 5.72% (1.2842 => 1.3577, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/objinst: 5.11% (0.3131 => 0.3291, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.93% (0.3817 => 0.3929, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.83% (1.1194 => 1.1511, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 10.02% (1.1396 => 1.2538, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 9.63% (0.9957 => 1.0916, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.1578 => 3.3686, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 5.88% (1.9405 => 2.0546, std.dev.: 0.0006) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.4162 => 0.4322, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.71% (4.2280 => 4.3426, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0313 => 1.0567, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.76% (0.8333 => 0.8480, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.71% (3.6395 => 3.7018, std.dev.: 0.0016) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2077, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.34% (2.6546 => 2.6901, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.03% (6.6874 => 0.1316, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -79.92% (0.8651 => 0.1737, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.11% (5.2763 => 3.2128, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.04% (5.3855 => 3.7140, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.51% (5.3526 => 3.7195, std.dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -14.69% (54.1659 => 46.2079, std.dev.: 0.0436) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.51% (2.9384 => 2.6296, std.dev.: 0.0124) MultiSource/Applications/ClamAV/clamscan: -7.10% (22.1758 => 20.6017, std.dev.: 0.0130) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.06% (8.0499 => 3.7783, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.35% (1.1492 => 0.7659, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.73% (1.6925 => 1.4262, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.53% (0.0998 => 0.0853, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -12.35% (1.2373 => 1.0845, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3453 => 2.9599, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -10.79% (1.5373 => 1.3714, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.16% (19.9488 => 18.3203, std.dev.: 0.0609) MultiSource/Benchmarks/FreeBench/mason/mason: -8.01% (0.2161 => 0.1988, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.49% (1.6805 => 1.5547, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.98% (1.8329 => 1.7049, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4781, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5071, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.43% (8.1563 => 7.7946, std.dev.: 0.0087) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1624, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8775, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4965, std.dev.: 0.0067) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.70% (0.4808 => 0.4678, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.78% (10.2830 => 10.0995, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6835, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -1.65% (2.5528 => 2.5106, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: -1.23% (4.6441 => 4.5872, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.12% (2.3135 => 2.2877, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.07% (6.2999 => 6.2324, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 17.08% (0.5229 => 0.6122, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 14.40% (14.9895 => 17.1475, std.dev.: 0.0220) MultiSource/Benchmarks/MallocBench/gs/gs: 9.93% (4.1105 => 4.5188, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 16.68% (1.1048 => 1.2891, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.92% (7.1582 => 8.2262, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.38% (0.6222 => 0.7739, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 34900.00% (0.0001 => 0.0350, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.43% (0.2116 => 0.2125, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 19 07:27:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 19 Oct 2012 09:27:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121019142738.342DA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5003?compare_to=5000&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5003, Order: 166278, Start Time: 2012-10-19 13:04:40, End Time: 2012-10-19 14:30:37 To: 5000, Order: 166274, Start Time: 2012-10-19 11:09:24, End Time: 2012-10-19 12:35:15 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (193 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1042 (672 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.21% (2.0176 => 2.4859, std.dev.: 0.0159) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.23% (0.1410 => 0.1667, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 17.07% (0.0826 => 0.0967, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 16.76% (0.2243 => 0.2619, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 15.77% (0.0653 => 0.0756, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.85% (0.1327 => 0.1524, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.74% (0.1072 => 0.1230) MultiSource/Benchmarks/Olden/tsp/tsp: 14.41% (0.1013 => 0.1159, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.79% (0.0834 => 0.0949, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.23% (0.1413 => 0.1600) MultiSource/Applications/lambda-0_1_3/lambda: 13.23% (0.7038 => 0.7969, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 13.12% (0.4328 => 0.4896, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.05% (0.1157 => 0.1308, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 13.02% (1.3693 => 1.5476, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.86% (0.0964 => 0.1088, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.69% (3.9660 => 4.4691, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 12.65% (0.4062 => 0.4576, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.60% (0.2596 => 0.2923, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.57% (0.2721 => 0.3063, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.47% (0.1588 => 0.1786, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.36% (0.6959 => 0.7819, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.31% (0.7710 => 0.8659, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.06% (0.6283 => 0.7041, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.06% (0.5265 => 0.5900, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 12.04% (13.8202 => 15.4835, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.99% (0.9199 => 1.0302, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 11.96% (0.1062 => 0.1189, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 11.86% (0.1003 => 0.1122, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.73% (1.4563 => 1.6271, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.61% (0.3022 => 0.3373, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.54% (0.3899 => 0.4349, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.51% (1.2193 => 1.3597, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 11.26% (0.5818 => 0.6473, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.23% (0.4791 => 0.5329, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 11.23% (1.0313 => 1.1471, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 11.10% (0.7061 => 0.7845, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.03% (0.4016 => 0.4459, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 11.03% (0.5748 => 0.6382, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.03% (0.4390 => 0.4874, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.98% (0.2914 => 0.3234, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 10.95% (1.1061 => 1.2272, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.93% (0.3485 => 0.3866, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.93% (1.1364 => 1.2606, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.89% (0.3130 => 0.3471, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.89% (0.1276 => 0.1415, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.88% (0.5577 => 0.6184, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 10.87% (0.3293 => 0.3651, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.87% (0.3580 => 0.3969, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.86% (0.3489 => 0.3868, std.dev.: 0.0042) SingleSource/Regression/C++/ofstream_ctor: 10.86% (0.2781 => 0.3083, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.82% (0.4379 => 0.4853, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.79% (0.1075 => 0.1191, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.73% (0.3756 => 0.4159, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 10.68% (0.6744 => 0.7464, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/mst/mst: 10.53% (0.1111 => 0.1228, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 10.51% (0.1589 => 0.1756, std.dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 10.50% (16.6129 => 18.3571, std.dev.: 0.0239) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.50% (0.2782 => 0.3074, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 10.49% (0.1478 => 0.1633) MultiSource/Applications/sgefa/sgefa: 10.48% (0.2995 => 0.3309, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 10.45% (0.3453 => 0.3814, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.44% (0.0977 => 0.1079, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 10.43% (0.2925 => 0.3230, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/moments: 10.39% (0.3868 => 0.4270, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.35% (0.2966 => 0.3273, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.33% (0.1569 => 0.1731, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.32% (0.8698 => 0.9596, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.32% (0.1986 => 0.2191, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 10.29% (0.2761 => 0.3045, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.26% (0.3246 => 0.3579, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 10.25% (0.3220 => 0.3550, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.18% (1.9828 => 2.1847, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 10.18% (3.8646 => 4.2580, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.16% (0.7460 => 0.8218, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.16% (0.1014 => 0.1117, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 10.13% (0.7506 => 0.8266, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 10.12% (0.2726 => 0.3002, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 10.10% (1.9270 => 2.1217, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/ary3: 10.10% (0.3149 => 0.3467, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 10.07% (0.2690 => 0.2961, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.06% (0.2655 => 0.2922, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 10.05% (0.8310 => 0.9145, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 10.05% (0.3534 => 0.3889, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 10.04% (3.1889 => 3.5091, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.03% (0.1865 => 0.2052, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 10.01% (0.2607 => 0.2868, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 10.01% (0.2628 => 0.2891, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 10.00% (2.1791 => 2.3971, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/except: 10.00% (0.2760 => 0.3036, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.95% (0.2765 => 0.3040, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 9.91% (0.2937 => 0.3228, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.90% (0.5637 => 0.6195, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 9.88% (0.3107 => 0.3414, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.85% (4.9865 => 5.4779, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.84% (0.2023 => 0.2222, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.83% (0.1435 => 0.1576, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.73% (0.2127 => 0.2334, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary2: 9.71% (0.3192 => 0.3502, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.68% (7.2180 => 7.9167, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.57% (0.2696 => 0.2954, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.48% (0.3755 => 0.4111, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.38% (1.3245 => 1.4487, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/matrix: 9.37% (0.2988 => 0.3268, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 9.34% (0.2945 => 0.3220, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 9.23% (0.1657 => 0.1810, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.99% (3.6692 => 3.9989, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.95% (0.6135 => 0.6684, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 8.83% (1.0594 => 1.1529, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.75% (4.4433 => 4.8323, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.70% (1.5188 => 1.6509, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.69% (4.3801 => 4.7609, std.dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: 8.68% (14.8535 => 16.1431, std.dev.: 0.0136) MultiSource/Applications/oggenc/oggenc: 8.66% (4.6629 => 5.0667, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.64% (0.6576 => 0.7144, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 8.54% (0.6250 => 0.6784, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/health/health: 8.49% (0.1213 => 0.1316, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 8.48% (1.2749 => 1.3830, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 8.46% (0.3131 => 0.3396, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.44% (0.1789 => 0.1940, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.41% (0.2140 => 0.2320, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 8.38% (8.4961 => 9.2082, std.dev.: 0.0140) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.35% (0.8818 => 0.9554, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.31% (3.2742 => 3.5463, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 8.27% (0.4113 => 0.4453, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.23% (0.3511 => 0.3800, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.01% (0.2321 => 0.2507, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.99% (0.9108 => 0.9836, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.97% (0.4805 => 0.5188, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.89% (2.1007 => 2.2664, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.83% (0.3245 => 0.3499, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.79% (1.1333 => 1.2216, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/neural/neural: 7.65% (0.1385 => 0.1491, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 7.58% (3.7467 => 4.0308, std.dev.: 0.0132) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.51% (0.2504 => 0.2692, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 7.48% (6.5754 => 7.0673, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/oourafft: 7.42% (0.2008 => 0.2157, std.dev.: 0.0052) MultiSource/Applications/hexxagon/hexxagon: 7.34% (1.2292 => 1.3194, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: 7.29% (0.4003 => 0.4295) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.23% (0.3650 => 0.3914, std.dev.: 0.0072) SingleSource/UnitTests/ObjC/exceptions: 7.00% (0.3914 => 0.4188, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.98% (0.1819 => 0.1946, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.89% (6.2785 => 6.7108, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/property: 6.80% (0.3940 => 0.4208, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 6.62% (0.3578 => 0.3815, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.61% (0.3646 => 0.3887, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 6.61% (0.3601 => 0.3839, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 6.60% (0.3789 => 0.4039, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 6.50% (0.3663 => 0.3901, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 6.38% (0.3623 => 0.3854, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.31% (13.2842 => 14.1227, std.dev.: 0.0176) SingleSource/Benchmarks/Misc/ReedSolomon: 5.63% (0.1777 => 0.1877, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 5.22% (16.2614 => 17.1109, std.dev.: 0.0189) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.95% (0.2243 => 0.2354, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 4.34% (14.5298 => 15.1605, std.dev.: 0.0039) MultiSource/Benchmarks/Bullet/bullet: 2.55% (33.2944 => 34.1448, std.dev.: 0.0070) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.69% (0.4846 => 0.6963, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5185, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/fbench: 26.93% (1.8175 => 2.3070, std.dev.: 0.0222) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.11% (1.0895 => 1.2759, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: 11.09% (1.1560 => 1.2842, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 8.99% (0.8273 => 0.9017, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436) SingleSource/Benchmarks/Shootout-C++/hash2: 7.55% (3.1736 => 3.4133, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.42% (0.9692 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 5.09% (1.2998 => 1.3659, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0050, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284) SingleSource/Regression/C/uint64_to_float: 4.48% (0.5449 => 0.5693) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.45% (2.8606 => 2.9880, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.42% (1.9199 => 1.9855, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.38% (12.0921 => 12.5009, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 3.27% (10.7476 => 11.0994, std.dev.: 0.0345) MultiSource/Benchmarks/nbench/nbench: 3.23% (11.2619 => 11.6251, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/bisort/bisort: 2.95% (0.8239 => 0.8482, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0310 => 1.0559, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.10% (7.4271 => 7.5834, std.dev.: 0.0053) MultiSource/Applications/lemon/lemon: 1.80% (1.4298 => 1.4555, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5126, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2123, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1886, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.20% (5.5130 => 5.5792, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.19% (9.9194 => 10.0370, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.17% (8.8259 => 8.9292, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 1.07% (12.4560 => 12.5888, std.dev.: 0.0055) SingleSource/Benchmarks/McGill/queens: 1.00% (2.1753 => 2.1971, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.78% (0.2670 => 0.1421, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.23% (0.4657 => 0.3901, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -14.29% (0.0707 => 0.0606, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.37% (1.3813 => 1.1966, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.36% (1.3819 => 1.1973, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.28% (1.0460 => 0.8548, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -12.69% (0.2238 => 0.1954, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.14% (20.3410 => 18.2783, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -5.86% (1.2308 => 1.1587, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.83% (1.3780 => 1.2977, std.dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5147, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.81% (0.9996 => 0.9515, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.80% (1.7688 => 1.7016, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4867 => 0.4717, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -2.88% (3.2729 => 3.1787, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: -2.87% (3.0263 => 2.9394, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -2.74% (1.9762 => 1.9220, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8812) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4780, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.44% (4.1080 => 4.0078, std.dev.: 0.0043) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.97% (0.6589 => 0.6459, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.86% (0.6615 => 0.6492, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.73% (6.3560 => 6.2462, std.dev.: 0.0042) MultiSource/Applications/lua/lua: -1.72% (26.5159 => 26.0601, std.dev.: 0.0198) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.67% (0.8342 => 0.8203, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.63% (2.5254 => 2.4843, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0064, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -1.31% (5.3167 => 5.2471, std.dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: -1.24% (28.2225 => 27.8727, std.dev.: 0.0013) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1139, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -1.05% (84.4286 => 83.5416, std.dev.: 0.0057) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 19 07:32:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 19 Oct 2012 09:32:45 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121019143245.B3EEA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5004?compare_to=5001&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5004, Order: 166280, Start Time: 2012-10-19 13:11:22, End Time: 2012-10-19 14:34:45 To: 5001, Order: 166278, Start Time: 2012-10-19 11:31:24, End Time: 2012-10-19 12:54:32 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 6 (15 on baseline) Performance Improvements: 2 (5 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 967 (954 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.81% (0.2806 => 0.2969, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.07% (0.8738 => 0.8919, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.97% (15.1190 => 16.3240, std.dev.: 0.3208) SingleSource/Benchmarks/Shootout-C++/except: 2.64% (0.4930 => 0.5060, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.08% (2.8816 => 2.9415, std.dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.22% (2.6190 => 2.6509, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -1.90% (0.8102 => 0.7948, std.dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: -6.30% (4.0303 => 3.7764, std.dev.: 0.0943) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.13% (16.4010 => 16.4231, std.dev.: 0.0808) MultiSource/Applications/obsequi/Obsequi: 0.97% (1.0118 => 1.0216, std.dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: 0.05% (0.6330 => 0.6333, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 1.31% (0.1838 => 0.1862, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.71% (0.1547 => 0.1536, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.65% (0.3142 => 0.3194, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.63% (0.2400 => 0.2337, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.93% (0.3341 => 0.3310, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.13% (0.2356 => 0.2353, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/bigfib: 0.18% (0.5952 => 0.5963, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel: 5.15% (0.0427 => 0.0449, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.18% (0.3277 => 0.3283, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/strcat: 1.17% (0.1973 => 0.1996, std.dev.: 0.0013) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.40% (0.0203 => 0.0216, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.03% (0.0159 => 0.0151, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 26.07% (0.0326 => 0.0411, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -18.99% (0.0316 => 0.0256, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 28.88% (0.0232 => 0.0299, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.73% (0.0370 => 0.0406, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -0.53% (0.0190 => 0.0189, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -23.64% (0.0165 => 0.0126, std.dev.: 0.0039) SingleSource/UnitTests/byval-alignment: 0.40% (0.0251 => 0.0252, std.dev.: 0.0045) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 500.00% (0.0001 => 0.0006, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 0.27% (0.1478 => 0.1482, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 1.45% (1.1219 => 1.1382, std.dev.: 0.0055) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.59% (0.1513 => 0.1504, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.41% (0.4145 => 0.4045, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.06% (0.1440 => 0.1396, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.48% (0.0607 => 0.0598, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -17.53% (0.0251 => 0.0207, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.96% (0.0554 => 0.0587, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.36% (1.1435 => 1.1394, std.dev.: 0.0147) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.15% (0.0026 => 0.0001, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.45% (0.0579 => 0.0559, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.80% (0.0224 => 0.0237, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.07% (0.8016 => 0.8010, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 108.16% (0.0049 => 0.0102, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.85% (2.1832 => 1.6626, std.dev.: 0.0021) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/siod/siod: 1.59% (2.2184 => 2.2537, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.30% (0.8457 => 0.8567, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.29% (0.8805 => 0.8919, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.90% (1.5795 => 2.5098, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.46% (14.6451 => 16.3240, std.dev.: 0.3208) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.35% (0.3186 => 0.3484, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.48% (1.1857 => 1.2863, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 5.92% (63.1822 => 66.9233, std.dev.: 0.0576) SingleSource/Benchmarks/Shootout-C++/except: 2.82% (0.4921 => 0.5060, std.dev.: 0.0023) MultiSource/Applications/siod/siod: 2.75% (3.6643 => 3.7651, std.dev.: 0.0104) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.43% (2.4490 => 2.5085, std.dev.: 0.0115) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.23% (2.8773 => 2.9415, std.dev.: 0.0172) MultiSource/Benchmarks/Olden/bh/bh: 1.74% (2.3560 => 2.3969, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.23% (1.5941 => 1.6137, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.03% (4.8362 => 4.8862, std.dev.: 0.0179) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.12% (0.3269 => 0.2971, std.dev.: 0.0009) MultiSource/Applications/lua/lua: -5.25% (29.8330 => 28.2676, std.dev.: 0.2321) SingleSource/Benchmarks/Shootout-C++/hash2: -1.40% (3.4237 => 3.3758, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.23% (1.0388 => 1.0260, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.20% (3.3479 => 3.3077, std.dev.: 0.0033) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.14% (16.4461 => 16.4231, std.dev.: 0.0808) MultiSource/Applications/obsequi/Obsequi: -0.45% (1.0262 => 1.0216, std.dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: 0.02% (0.6332 => 0.6333, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 1.69% (0.1831 => 0.1862, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.48% (0.1559 => 0.1536, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.27% (0.3123 => 0.3194, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.12% (0.2463 => 0.2337, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.02% (0.3344 => 0.3310, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.47% (0.2364 => 0.2353, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/bigfib: -0.78% (0.6010 => 0.5963, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel: 4.66% (0.0429 => 0.0449, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.52% (0.3266 => 0.3283, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/strcat: 1.37% (0.1969 => 0.1996, std.dev.: 0.0013) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -3.57% (0.0224 => 0.0216, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 22.76% (0.0123 => 0.0151, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.74% (0.0408 => 0.0411, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.79% (0.0254 => 0.0256, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.99% (0.0302 => 0.0299, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 5.73% (0.0384 => 0.0406, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -0.53% (0.0190 => 0.0189, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -30.00% (0.0180 => 0.0126, std.dev.: 0.0039) SingleSource/UnitTests/byval-alignment: 9.57% (0.0230 => 0.0252, std.dev.: 0.0045) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -14.29% (0.0007 => 0.0006, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 3.06% (0.1438 => 0.1482, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.47% (1.1329 => 1.1382, std.dev.: 0.0055) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 2.87% (0.1462 => 0.1504, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.86% (0.4164 => 0.4045, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.97% (0.1369 => 0.1396, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.71% (0.0641 => 0.0598, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.15% (0.0195 => 0.0207, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.56% (0.0578 => 0.0587, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.38% (1.1437 => 1.1394, std.dev.: 0.0147) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.85% (0.0627 => 0.0559, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 31.67% (0.0180 => 0.0237, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.09% (0.8017 => 0.8010, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 64.52% (0.0062 => 0.0102, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 19 08:06:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 19 Oct 2012 10:06:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121019150644.3A9002A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5005?compare_to=5002&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5005, Order: 166281, Start Time: 2012-10-19 13:48:21, End Time: 2012-10-19 15:08:41 To: 5002, Order: 166278, Start Time: 2012-10-19 11:57:47, End Time: 2012-10-19 13:18:11 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (76 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (181 on baseline) Performance Improvements: 1 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 91 (15 on baseline) Unchanged Tests: 949 (662 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.34% (54.7353 => 56.5609, std.dev.: 0.1430) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.35% (16.0718 => 15.5335, std.dev.: 0.0074) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.13% (0.6122 => 0.6114, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: -0.17% (17.1475 => 17.1191, std.dev.: 0.0111) MultiSource/Benchmarks/Bullet/bullet: -0.43% (56.4238 => 56.1784, std.dev.: 0.0125) MultiSource/Benchmarks/MallocBench/gs/gs: -0.34% (4.5188 => 4.5034, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.43% (0.0463 => 0.0461, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.65% (0.0465 => 0.0462, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.46% (0.0433 => 0.0431) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.92% (0.0435 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.71% (0.0423 => 0.0420, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.71% (0.0424 => 0.0421, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.48% (0.0416 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.96% (0.0418 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.46% (0.0433 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.69% (0.0435 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.70% (0.0428 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.93% (0.0430 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.48% (0.0419 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.48% (0.0419 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.70% (0.0426 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.70% (0.0427 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.46% (0.0436 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.68% (0.0438 => 0.0435, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.48% (0.0413 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.72% (0.0414 => 0.0411, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.71% (0.0425 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.70% (0.0427 => 0.0424, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.72% (0.0416 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.72% (0.0418 => 0.0415, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.49% (0.0408 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.49% (0.0410 => 0.0408) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.74% (0.0408 => 0.0405, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.73% (0.0409 => 0.0406, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.90% (0.0445 => 0.0441, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.67% (0.0446 => 0.0443, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.49% (0.0406 => 0.0404, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.74% (0.0408 => 0.0405, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.98% (0.0409 => 0.0405, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.49% (0.0410 => 0.0408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.48% (0.0415 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.48% (0.0416 => 0.0414, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.26% (1.2891 => 1.2857, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.23% (8.2262 => 8.2450, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.19% (0.7739 => 0.7724, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.86% (0.0350 => 0.0353, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: - (0.1431 => 0.1431, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 0.06% (0.1647 => 0.1648) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.11% (0.2125 => 0.2191, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -0.03% (10.0319 => 10.0284, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.17% (63.2438 => 56.1784, std.dev.: 0.0125) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 0.55% (0.1639 => 0.1648) MultiSource/Benchmarks/NPB-serial/is/is: 4.86% (9.5636 => 10.0284, std.dev.: 0.0048) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 35.52% (14.1553 => 19.1833, std.dev.: 0.0231) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.63% (3.4629 => 5.7704, std.dev.: 0.0120) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13410.28% (0.0720 => 9.7274, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049400.00% (0.0001 => 10.0495, std.dev.: 0.0014) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 62.88% (0.2554 => 0.4160, std.dev.: 0.0004) SingleSource/Regression/C/matrixTranspose: 57.14% (0.0245 => 0.0385, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 51.95% (0.0256 => 0.0389, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 49.83% (10.3673 => 15.5335, std.dev.: 0.0074) SingleSource/UnitTests/SignlessTypes/factor: 41.22% (0.0296 => 0.0418, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 38.16% (0.1622 => 0.2241, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 35.32% (0.1056 => 0.1429, std.dev.: 0.0001) SingleSource/UnitTests/vla: 29.30% (0.0355 => 0.0459, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 23.04% (0.2049 => 0.2521, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 22.30% (0.0834 => 0.1020, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.36% (0.1236 => 0.1500, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.18% (0.1566 => 0.1882, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 19.47% (0.0719 => 0.0859, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 18.56% (0.1584 => 0.1878, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 18.30% (0.1432 => 0.1694, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.87% (2.2022 => 2.5958, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.04% (0.5105 => 0.5975, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 16.90% (0.6675 => 0.7803, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.88% (0.0871 => 0.1018, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 16.84% (7.0540 => 8.2422, std.dev.: 0.0033) MultiSource/Applications/d/make_dparser: 15.67% (3.3354 => 3.8579, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 15.59% (0.1655 => 0.1913, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.23% (1.3050 => 1.5037, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.50% (0.5020 => 0.5748, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/oourafft: 14.41% (0.3282 => 0.3755, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.38% (1.5415 => 1.7631, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 14.32% (0.7115 => 0.8134, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 14.00% (0.2271 => 0.2589, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.95% (0.1032 => 0.1176, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 13.75% (0.1440 => 0.1638, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.50% (1.7609 => 1.9986, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.44% (0.1510 => 0.1713, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.41% (0.0798 => 0.0905, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 13.12% (0.3109 => 0.3517, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 12.98% (9.4845 => 10.7158, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/18-imp/imp: 12.97% (0.3423 => 0.3867, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/em3d/em3d: 12.86% (0.1695 => 0.1913, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 12.84% (0.0818 => 0.0923, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.80% (4.2646 => 4.8106, std.dev.: 0.0129) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 12.77% (0.0838 => 0.0945, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.65% (0.4615 => 0.5199, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 12.56% (5.7591 => 6.4827, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.39% (0.1695 => 0.1905, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 12.38% (1.0722 => 1.2049, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 12.26% (0.1175 => 0.1319, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 12.19% (8.1363 => 9.1280, std.dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 12.15% (1.1840 => 1.3278, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.11% (0.0933 => 0.1046, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 12.10% (0.1463 => 0.1640, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 12.06% (0.6450 => 0.7228, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 12.03% (0.1555 => 0.1742, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 11.99% (0.1151 => 0.1289, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 11.97% (1.1642 => 1.3036, std.dev.: 0.0056) MultiSource/Benchmarks/sim/sim: 11.96% (0.3387 => 0.3792, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 11.96% (2.0273 => 2.2697, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/mst/mst: 11.95% (0.1163 => 0.1302, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 11.93% (0.7433 => 0.8320, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.92% (0.8172 => 0.9146, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 11.82% (0.1337 => 0.1495, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.77% (0.5860 => 0.6550, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.76% (0.3307 => 0.3696, std.dev.: 0.0084) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 11.74% (0.0886 => 0.0990, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.71% (0.9765 => 1.0908, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.70% (0.1940 => 0.2167, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 11.60% (0.7835 => 0.8744, std.dev.: 0.0024) SingleSource/UnitTests/SignlessTypes/rem: 11.54% (0.1144 => 0.1276) MultiSource/Applications/lua/lua: 11.51% (3.8723 => 4.3180, std.dev.: 0.0101) MultiSource/Applications/JM/ldecod/ldecod: 11.50% (10.4361 => 11.6360, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.35% (4.9449 => 5.5063, std.dev.: 0.0077) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.30% (0.0929 => 0.1034, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.30% (5.0018 => 5.5669, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.22% (0.2700 => 0.3003, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.20% (1.5859 => 1.7636, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.18% (1.1861 => 1.3187, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.15% (0.2107 => 0.2342, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.14% (0.1625 => 0.1806, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.13% (0.1330 => 0.1478, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 11.09% (0.8921 => 0.9910, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.01% (0.4879 => 0.5416, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.89% (0.3121 => 0.3461, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.82% (0.8067 => 0.8940, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.80% (0.2758 => 0.3056, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.78% (0.1438 => 0.1593, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 10.75% (0.6456 => 0.7150, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.68% (2.2024 => 2.4377, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.67% (0.3177 => 0.3516, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.67% (7.9617 => 8.8110, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.59% (0.1029 => 0.1138, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.56% (0.3543 => 0.3917, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.49% (0.1906 => 0.2106, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 10.49% (0.4299 => 0.4750, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.49% (0.1125 => 0.1243, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.47% (0.1117 => 0.1234, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.47% (0.5569 => 0.6152, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.41% (1.4186 => 1.5663, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-3: 10.24% (0.3516 => 0.3876, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/synchronized: 10.19% (0.3561 => 0.3924, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.17% (0.1062 => 0.1170, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.16% (0.3543 => 0.3903, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.11% (0.3473 => 0.3824, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.07% (0.3497 => 0.3849, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.02% (0.3694 => 0.4064, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.01% (0.3927 => 0.4320, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 9.95% (0.2603 => 0.2862, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 9.93% (0.3828 => 0.4208, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 9.91% (0.3886 => 0.4271, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 9.89% (2.2969 => 2.5241, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.84% (0.2266 => 0.2489, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 9.54% (1.5603 => 1.7092, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/bh/bh: 9.54% (0.3092 => 0.3387, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 9.47% (0.3180 => 0.3481, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 9.46% (0.4620 => 0.5057, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 9.40% (0.4289 => 0.4692, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.39% (0.3441 => 0.3764, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.30% (0.2065 => 0.2257, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 9.29% (21.9371 => 23.9746, std.dev.: 0.0240) MultiSource/Benchmarks/Olden/health/health: 9.23% (0.1268 => 0.1385, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.02% (0.3826 => 0.4171, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 9.00% (0.3422 => 0.3730, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.82% (0.3865 => 0.4206, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.81% (0.5981 => 0.6508, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.68% (0.4203 => 0.4568, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 8.42% (0.4048 => 0.4389, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.30% (0.1892 => 0.2049, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.29% (0.3427 => 0.3711, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.26% (0.4636 => 0.5019, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 8.22% (0.3684 => 0.3987, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.16% (0.4103 => 0.4438, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 8.09% (0.6030 => 0.6518, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 7.92% (17.1811 => 18.5425, std.dev.: 0.0267) SingleSource/UnitTests/ObjC++/Hello: 7.90% (0.5925 => 0.6393, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 7.66% (0.3603 => 0.3879, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.49% (0.8101 => 0.8708, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 7.40% (0.7326 => 0.7868, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.18% (0.3650 => 0.3912, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.18% (14.3668 => 15.3977, std.dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.14% (3.8922 => 4.1701, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.91% (0.4064 => 0.4345, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.84% (0.3098 => 0.3310, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.73% (0.3136 => 0.3347, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.71% (0.2905 => 0.3100, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.67% (0.3162 => 0.3373, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 6.67% (0.3283 => 0.3502, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.64% (0.2831 => 0.3019, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.57% (0.2891 => 0.3081, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.57% (2.0665 => 2.2022, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.44% (0.2793 => 0.2973, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 6.33% (0.3379 => 0.3593, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.27% (0.2872 => 0.3052, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.26% (0.2877 => 0.3057, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.17% (0.2871 => 0.3048, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.13% (0.2756 => 0.2925, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 6.13% (0.3052 => 0.3239, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.06% (0.2725 => 0.2890, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 5.85% (0.2802 => 0.2966, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.78% (0.2714 => 0.2871, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 5.69% (1.2842 => 1.3573, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.51% (0.2430 => 0.2564, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 5.11% (0.3131 => 0.3291, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.71% (1.1194 => 1.1497, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.38% (0.2944 => 0.3279, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.85% (1.1396 => 1.2519, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 9.55% (0.9957 => 1.0908, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3685, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: 5.94% (1.9405 => 2.0558, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.87% (0.4162 => 0.4323, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.76% (4.2280 => 4.3446, std.dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7651, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.90% (0.8333 => 0.8491, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.84% (3.6395 => 3.7066, std.dev.: 0.0075) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.54% (2.6546 => 2.6955, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2078, std.dev.: 0.0015) MultiSource/Benchmarks/llubenchmark/llu: 1.09% (3.7781 => 3.8194, std.dev.: 0.0086) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.00% (6.6874 => 0.1336, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -79.97% (0.8651 => 0.1733, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.29% (5.2763 => 3.2035, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.61% (5.3855 => 3.6831, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.17% (5.3526 => 3.6841, std.dev.: 0.0082) SingleSource/UnitTests/Vector/constpool: -14.58% (54.1659 => 46.2692, std.dev.: 0.0238) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.20% (2.9384 => 2.6388, std.dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: -7.25% (22.1758 => 20.5678, std.dev.: 0.0161) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.11% (8.0499 => 3.7744, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7645, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4231, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -12.07% (1.2373 => 1.0880, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3453 => 2.9599, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -10.81% (1.5373 => 1.3711, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.25% (19.9488 => 18.3028, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/mason/mason: -8.01% (0.2161 => 0.1988, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.44% (1.6805 => 1.5554, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.97% (1.8329 => 1.7052, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7614) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.78% (1.5835 => 1.5078, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.45% (8.1563 => 7.7934, std.dev.: 0.0084) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.63% (3.2827 => 3.1636, std.dev.: 0.0096) MultiSource/Benchmarks/sim/sim: -3.39% (5.0483 => 4.8774, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5010, std.dev.: 0.0049) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.50% (0.4808 => 0.4688, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0862, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6802, std.dev.: 0.0019) SingleSource/UnitTests/Vector/multiplies: -1.67% (2.5528 => 2.5101, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -1.30% (4.6441 => 4.5839, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2879, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 16.92% (0.5229 => 0.6114, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 14.21% (14.9895 => 17.1191, std.dev.: 0.0111) MultiSource/Benchmarks/MallocBench/gs/gs: 9.56% (4.1105 => 4.5034, std.dev.: 0.0085) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 16.37% (1.1048 => 1.2857, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 15.18% (7.1582 => 8.2450, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.14% (0.6222 => 0.7724, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35200.00% (0.0001 => 0.0353, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.54% (0.2116 => 0.2191, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 19 09:13:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 19 Oct 2012 11:13:02 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121019161302.040142A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5006?compare_to=5004&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5006, Order: 166281, Start Time: 2012-10-19 14:51:23, End Time: 2012-10-19 16:15:03 To: 5004, Order: 166280, Start Time: 2012-10-19 13:11:22, End Time: 2012-10-19 14:34:45 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 7 (16 on baseline) Performance Improvements: 2 (6 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 966 (952 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.50% (0.1774 => 0.1907, std.dev.: 0.0028) MultiSource/Applications/Burg/burg: 2.81% (1.1938 => 1.2274, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.60% (0.8362 => 0.8496, std.dev.: 0.0027) MultiSource/Applications/treecc/treecc: 1.25% (1.9882 => 2.0131, std.dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/himenobmtxpa: 3.20% (4.3620 => 4.5014, std.dev.: 0.0309) MultiSource/Benchmarks/llubenchmark/llu: 2.27% (1.9946 => 2.0398, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.53% (1.5786 => 1.6027, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.84% (2.9415 => 2.8875, std.dev.: 0.0127) SingleSource/Benchmarks/Misc/ReedSolomon: -1.61% (8.8603 => 8.7174, std.dev.: 0.0279) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.12% (16.4231 => 16.4421, std.dev.: 0.0388) MultiSource/Applications/obsequi/Obsequi: 0.46% (1.0216 => 1.0263, std.dev.: 0.0159) MultiSource/Applications/sqlite3/sqlite3: -0.98% (0.6333 => 0.6271, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/08-main/main: -4.24% (0.1862 => 0.1783, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.71% (0.1536 => 0.1593, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.03% (0.3194 => 0.3195, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.91% (0.2337 => 0.2475, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.75% (0.3310 => 0.3368, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.57% (0.2353 => 0.2390, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 0.02% (0.5963 => 0.5964, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -5.12% (0.0449 => 0.0426, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.43% (0.3283 => 0.3297, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: -0.65% (0.1996 => 0.1983, std.dev.: 0.0030) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.78% (0.0216 => 0.0222, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 9.93% (0.0151 => 0.0166, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.35% (0.0411 => 0.0389, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -3.91% (0.0256 => 0.0246, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -7.69% (0.0299 => 0.0276, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.74% (0.0406 => 0.0403, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: -35.98% (0.0189 => 0.0121, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/test1: 62.70% (0.0126 => 0.0205, std.dev.: 0.0026) SingleSource/UnitTests/byval-alignment: 11.51% (0.0252 => 0.0281, std.dev.: 0.0025) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -83.33% (0.0006 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.74% (0.1482 => 0.1471, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -0.53% (1.1382 => 1.1322, std.dev.: 0.0159) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -4.72% (0.1504 => 0.1433, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.42% (0.4045 => 0.4028, std.dev.: 0.0178) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.23% (0.1396 => 0.1469, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.54% (0.0598 => 0.0661, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 33.82% (0.0207 => 0.0277) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.13% (0.0587 => 0.0551, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.12% (1.1394 => 1.1408, std.dev.: 0.0105) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1800.00% (0.0001 => 0.0019, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.18% (0.0559 => 0.0558, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.72% (0.0237 => 0.0195, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.11% (0.8010 => 0.8001, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -44.12% (0.0102 => 0.0057, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.62% (2.1832 => 1.6675, std.dev.: 0.0009) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.92% (0.8066 => 0.8221, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.89% (0.8338 => 0.8496, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.50% (0.8007 => 0.8127, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.38% (0.8716 => 0.8836, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.25% (0.8261 => 0.8364, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.70% (1.5795 => 2.5066, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.43% (1.1857 => 1.2856, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 5.94% (63.1822 => 66.9382, std.dev.: 0.1560) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.36% (4.3552 => 4.5014, std.dev.: 0.0309) MultiSource/Applications/siod/siod: 2.70% (3.6643 => 3.7634, std.dev.: 0.0157) SingleSource/Benchmarks/Misc/ReedSolomon: 2.17% (8.5322 => 8.7174, std.dev.: 0.0279) MultiSource/Benchmarks/llubenchmark/llu: 2.16% (1.9967 => 2.0398, std.dev.: 0.0127) MultiSource/Applications/minisat/minisat: 1.93% (6.1525 => 6.2712, std.dev.: 0.0308) MultiSource/Benchmarks/Olden/bh/bh: 1.71% (2.3560 => 2.3964, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.48% (3.9006 => 3.9584, std.dev.: 0.0194) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.01% (1.5866 => 1.6027, std.dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.48% (8.4179 => 8.1251, std.dev.: 0.1004) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.84% (0.3269 => 0.2980, std.dev.: 0.0020) MultiSource/Applications/lua/lua: -5.25% (29.8330 => 28.2667, std.dev.: 0.1077) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -3.27% (22.2997 => 21.5701, std.dev.: 0.2780) SingleSource/Benchmarks/Shootout-C++/hash2: -1.58% (3.4237 => 3.3696, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.45% (3.3479 => 3.2993, std.dev.: 0.0054) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.02% (16.4461 => 16.4421, std.dev.: 0.0388) MultiSource/Applications/obsequi/Obsequi: 0.01% (1.0262 => 1.0263, std.dev.: 0.0159) MultiSource/Applications/sqlite3/sqlite3: -0.96% (0.6332 => 0.6271, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/08-main/main: -2.62% (0.1831 => 0.1783, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.18% (0.1559 => 0.1593, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.31% (0.3123 => 0.3195, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.49% (0.2463 => 0.2475, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.72% (0.3344 => 0.3368, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.10% (0.2364 => 0.2390, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: -0.77% (0.6010 => 0.5964, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -0.70% (0.0429 => 0.0426, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.95% (0.3266 => 0.3297, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 0.71% (0.1969 => 0.1983, std.dev.: 0.0030) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.89% (0.0224 => 0.0222, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 34.96% (0.0123 => 0.0166, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.66% (0.0408 => 0.0389, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -3.15% (0.0254 => 0.0246, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -8.61% (0.0302 => 0.0276, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 4.95% (0.0384 => 0.0403, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: -36.32% (0.0190 => 0.0121, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/test1: 13.89% (0.0180 => 0.0205, std.dev.: 0.0026) SingleSource/UnitTests/byval-alignment: 22.17% (0.0230 => 0.0281, std.dev.: 0.0025) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.29% (0.1438 => 0.1471, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -0.06% (1.1329 => 1.1322, std.dev.: 0.0159) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -1.98% (0.1462 => 0.1433, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.27% (0.4164 => 0.4028, std.dev.: 0.0178) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.30% (0.1369 => 0.1469, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.12% (0.0641 => 0.0661, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.67% (0.0578 => 0.0551, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.25% (1.1437 => 1.1408, std.dev.: 0.0105) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1800.00% (0.0001 => 0.0019, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.00% (0.0627 => 0.0558, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.33% (0.0180 => 0.0195, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.20% (0.8017 => 0.8001, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -8.06% (0.0062 => 0.0057, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 19 09:23:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 19 Oct 2012 11:23:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121019162314.E52AB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5007?compare_to=5003&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5007, Order: 166281, Start Time: 2012-10-19 15:00:16, End Time: 2012-10-19 16:26:13 To: 5003, Order: 166278, Start Time: 2012-10-19 13:04:40, End Time: 2012-10-19 14:30:37 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (193 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1042 (671 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.62% (2.0176 => 2.4942, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.51% (0.1410 => 0.1671, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 17.55% (0.0826 => 0.0971, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 16.94% (0.2243 => 0.2623, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.39% (0.0653 => 0.0760, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.30% (0.1072 => 0.1236, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.00% (0.1327 => 0.1526, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 14.22% (0.1013 => 0.1157, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.79% (0.0834 => 0.0949, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.38% (0.0770 => 0.0873, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.38% (0.1413 => 0.1602, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 13.24% (0.4328 => 0.4901, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 13.23% (0.7038 => 0.7969, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 13.12% (0.4062 => 0.4595, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 12.98% (1.3693 => 1.5471, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.84% (3.9660 => 4.4751, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.76% (0.0964 => 0.1087, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.72% (0.1588 => 0.1790, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.71% (0.2596 => 0.2926, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.61% (0.2721 => 0.3064, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.52% (0.6959 => 0.7830, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.38% (0.6283 => 0.7061, std.dev.: 0.0128) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.17% (0.7710 => 0.8648, std.dev.: 0.0035) MultiSource/Applications/aha/aha: 12.15% (0.1062 => 0.1191, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 12.09% (13.8202 => 15.4910, std.dev.: 0.0105) MultiSource/Benchmarks/Olden/power/power: 12.06% (0.1003 => 0.1124, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.98% (0.9199 => 1.0301, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.87% (0.5265 => 0.5890, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.78% (1.4563 => 1.6279, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.75% (0.3899 => 0.4357, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.55% (1.2193 => 1.3601, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference-object: 11.46% (0.5818 => 0.6485, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.41% (0.1157 => 0.1289, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.41% (0.3130 => 0.3487, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.38% (0.4791 => 0.5336, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.33% (0.4016 => 0.4471, std.dev.: 0.0043) SingleSource/UnitTests/ObjC++/property-reference: 11.29% (0.7061 => 0.7858, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 11.29% (1.0313 => 1.1477, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.19% (0.3485 => 0.3875, std.dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: 11.18% (0.2781 => 0.3092, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 11.16% (0.1075 => 0.1195, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.15% (1.1364 => 1.2631, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.06% (0.3580 => 0.3976, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 11.05% (0.5748 => 0.6383, std.dev.: 0.0027) MultiSource/Applications/Burg/burg: 11.03% (1.1061 => 1.2281, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.96% (0.5577 => 0.6188, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 10.93% (0.3293 => 0.3653, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.89% (0.3756 => 0.4165, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 10.82% (0.6744 => 0.7474, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 10.82% (16.6129 => 18.4107, std.dev.: 0.0103) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.80% (0.4390 => 0.4864, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.79% (0.3022 => 0.3348, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.78% (0.2782 => 0.3082, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.78% (0.4379 => 0.4851, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.72% (0.3489 => 0.3863, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 10.71% (0.7506 => 0.8310, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/moments: 10.70% (0.3868 => 0.4282, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.66% (0.1276 => 0.1412, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 10.63% (0.3453 => 0.3820, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.62% (0.1865 => 0.2063, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.54% (0.0977 => 0.1080, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.54% (0.2914 => 0.3221, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/mst/mst: 10.53% (0.1111 => 0.1228, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 10.52% (0.2995 => 0.3310, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 10.51% (0.1589 => 0.1756, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 10.47% (0.2761 => 0.3050, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.46% (0.8698 => 0.9608, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.45% (0.1569 => 0.1733, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.45% (0.2966 => 0.3276, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 10.44% (3.8646 => 4.2679, std.dev.: 0.0111) MultiSource/Applications/viterbi/viterbi: 10.42% (0.1478 => 0.1632) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.40% (0.2655 => 0.2931, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.38% (1.9828 => 2.1887, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 10.38% (0.2726 => 0.3009, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.37% (0.1986 => 0.2192, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.35% (0.3246 => 0.3582, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 10.34% (1.9270 => 2.1263, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/random: 10.33% (0.2690 => 0.2968, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 10.30% (0.3534 => 0.3898, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.29% (0.7460 => 0.8228, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 10.26% (0.3149 => 0.3472, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.26% (0.1014 => 0.1118, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 10.25% (0.2760 => 0.3043, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/wc: 10.25% (0.2937 => 0.3238, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 10.25% (0.3220 => 0.3550, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 10.24% (3.1889 => 3.5156, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/hello: 10.24% (0.2607 => 0.2874, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 10.20% (0.8310 => 0.9158, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/09-vor/vor: 10.15% (0.2925 => 0.3222, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 10.12% (0.2628 => 0.2894, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.11% (0.5637 => 0.6207, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 10.07% (0.3107 => 0.3420, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 10.04% (2.1791 => 2.3979, std.dev.: 0.0150) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.00% (4.9865 => 5.4852, std.dev.: 0.1064) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.97% (0.1435 => 0.1578, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.91% (0.2765 => 0.3039, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 9.90% (0.3192 => 0.3508, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.79% (0.2696 => 0.2960, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.79% (0.2023 => 0.2221, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.78% (0.2127 => 0.2335, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.70% (7.2180 => 7.9179, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/matrix: 9.61% (0.2988 => 0.3275, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.51% (0.3755 => 0.4112, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 9.47% (0.1657 => 0.1814, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 9.37% (0.2945 => 0.3221, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.11% (3.6692 => 4.0033, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.01% (1.3245 => 1.4438, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.00% (0.6576 => 0.7168, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.00% (0.3511 => 0.3827, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.97% (4.3801 => 4.7729, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 8.95% (1.0594 => 1.1542, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 8.83% (14.8535 => 16.1649, std.dev.: 0.0133) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.83% (4.4433 => 4.8355, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.72% (1.5188 => 1.6512, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 8.67% (0.6250 => 0.6792, std.dev.: 0.0105) MultiSource/Applications/oggenc/oggenc: 8.63% (4.6629 => 5.0655, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.55% (0.2140 => 0.2323, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 8.53% (1.2749 => 1.3836, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.52% (0.6135 => 0.6658, std.dev.: 0.0027) MultiSource/Benchmarks/sim/sim: 8.46% (0.3131 => 0.3396, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 8.46% (8.4961 => 9.2149, std.dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.44% (0.1789 => 0.1940, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.40% (0.2321 => 0.2516, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.26% (3.2742 => 3.5446, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/05-eks/eks: 8.22% (0.4113 => 0.4451, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.06% (0.8818 => 0.9529, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.01% (0.3245 => 0.3505, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.99% (2.1007 => 2.2686, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.96% (0.9108 => 0.9833, std.dev.: 0.0125) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.94% (1.1333 => 1.2233, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.91% (0.4805 => 0.5185, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 7.73% (0.1385 => 0.1492, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 7.72% (0.4003 => 0.4312, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 7.67% (3.7467 => 4.0341, std.dev.: 0.0167) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.67% (0.2504 => 0.2696, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 7.61% (6.5754 => 7.0758, std.dev.: 0.0118) MultiSource/Applications/hexxagon/hexxagon: 7.56% (1.2292 => 1.3221, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 7.41% (0.3914 => 0.4204, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.28% (0.3940 => 0.4227, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 7.27% (0.2008 => 0.2154, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.13% (0.3789 => 0.4059, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-4: 7.10% (0.3646 => 0.3905, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 7.10% (0.3578 => 0.3832, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.09% (0.1819 => 0.1948, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 7.03% (0.3601 => 0.3854, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.02% (0.3663 => 0.3920, std.dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.97% (6.2785 => 6.7159, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.96% (0.3650 => 0.3904, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/exceptions-3: 6.90% (0.3623 => 0.3873, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.51% (13.2842 => 14.1487, std.dev.: 0.0150) SingleSource/Benchmarks/Misc/ReedSolomon: 5.63% (0.1777 => 0.1877, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 5.24% (16.2614 => 17.1136, std.dev.: 0.0145) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.17% (0.2243 => 0.2359, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 4.45% (14.5298 => 15.1762, std.dev.: 0.0114) MultiSource/Benchmarks/Bullet/bullet: 2.69% (33.2944 => 34.1901, std.dev.: 0.0264) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.41% (5.7573 => 7.5080, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/fbench: 23.99% (1.8175 => 2.2536, std.dev.: 0.0470) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.14% (1.0895 => 1.2762, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 11.05% (1.1560 => 1.2837, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 8.99% (0.8273 => 0.9017, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4145, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 5.64% (1.2998 => 1.3731, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.43% (0.9692 => 1.0218) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0043, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.46% (2.8606 => 2.9883, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 4.46% (0.5449 => 0.5692, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (1.7081 => 1.7749, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.71% (10.7476 => 11.1461, std.dev.: 0.0450) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9860, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.38% (12.0921 => 12.5004, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 3.22% (11.2619 => 11.6249, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bisort/bisort: 3.17% (0.8239 => 0.8500, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0310 => 1.0559, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.16% (7.4271 => 7.5878, std.dev.: 0.0060) MultiSource/Applications/lemon/lemon: 1.77% (1.4298 => 1.4551, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0506, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5130, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9697, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1871, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5788, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.18% (9.9194 => 10.0363, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists: 1.13% (12.4560 => 12.5971, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/queens: 1.01% (2.1753 => 2.1973, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.70% (0.2670 => 0.1423, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.91% (0.4657 => 0.3916, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -14.14% (0.0707 => 0.0607, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.39% (1.3819 => 1.1969, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.36% (1.3813 => 1.1968, std.dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.29% (1.0460 => 0.8547, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -13.00% (0.2238 => 0.1947, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.07% (20.3410 => 18.2934, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.02% (1.3780 => 1.2950, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/chomp: -5.98% (1.2308 => 1.1572, std.dev.: 0.0092) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5149, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.66% (0.9996 => 0.9530, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.90% (1.7688 => 1.6999, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -2.89% (3.2729 => 3.1782, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: -2.81% (3.0263 => 2.9412, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -2.73% (1.9762 => 1.9223, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8811, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.35% (4.1080 => 4.0115, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout/lists: -2.06% (6.3560 => 6.2251, std.dev.: 0.0145) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.00% (0.6589 => 0.6457, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.87% (0.6615 => 0.6491, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.67% (2.5254 => 2.4831, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.64% (0.8342 => 0.8205, std.dev.: 0.0016) MultiSource/Applications/lua/lua: -1.62% (26.5159 => 26.0861, std.dev.: 0.0437) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0066, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8641, std.dev.: 0.0071) MultiSource/Applications/lambda-0_1_3/lambda: -1.26% (5.3167 => 5.2498, std.dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: -1.24% (28.2225 => 27.8722, std.dev.: 0.0007) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1139, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -1.05% (84.4286 => 83.5463, std.dev.: 0.0054) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 19 10:23:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 19 Oct 2012 12:23:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121019172341.B209A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5008?compare_to=5005&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5008, Order: 166283, Start Time: 2012-10-19 16:04:36, End Time: 2012-10-19 17:25:39 To: 5005, Order: 166281, Start Time: 2012-10-19 13:48:21, End Time: 2012-10-19 15:08:41 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (76 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (183 on baseline) Performance Improvements: 1 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 91 (15 on baseline) Unchanged Tests: 949 (660 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.86% (79.2623 => 81.5316, std.dev.: 0.2242) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.62% (0.9146 => 0.8998, std.dev.: 0.0038) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.02% (0.6114 => 0.6115, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: -0.02% (17.1191 => 17.1152, std.dev.: 0.0127) MultiSource/Benchmarks/Bullet/bullet: 0.03% (56.1784 => 56.1971, std.dev.: 0.0267) MultiSource/Benchmarks/MallocBench/gs/gs: 0.10% (4.5034 => 4.5077, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.22% (0.0461 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.22% (0.0462 => 0.0461, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0431 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.23% (0.0431 => 0.0432, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.24% (0.0420 => 0.0419, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.24% (0.0421 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.24% (0.0414 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0414 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.46% (0.0431 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0432 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.24% (0.0425 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0426 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.48% (0.0417 => 0.0415, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.24% (0.0417 => 0.0418) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.24% (0.0423 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0424 => 0.0424) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0434 => 0.0434) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.22% (0.0435 => 0.0449) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0411 => 0.0411, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0411 => 0.0411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0422 => 0.0422, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.24% (0.0424 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0413 => 0.0413, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0415 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0406 => 0.0406, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.25% (0.0408 => 0.0407, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0405 => 0.0405, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0406 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0441 => 0.0441, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0443 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.25% (0.0404 => 0.0403, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.25% (0.0405 => 0.0406, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.25% (0.0405 => 0.0406, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.25% (0.0408 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.24% (0.0413 => 0.0412, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.24% (0.0414 => 0.0413, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.04% (1.2857 => 1.2852, std.dev.: 0.0058) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.00% (8.2450 => 8.2447, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.01% (0.7724 => 0.7725, std.dev.: 0.0070) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.57% (0.0353 => 0.0355, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1431 => 0.1431, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: - (0.1648 => 0.1648) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.10% (0.2191 => 0.2167, std.dev.: 0.0031) MultiSource/Benchmarks/NPB-serial/is/is: 0.04% (10.0284 => 10.0323, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.14% (63.2438 => 56.1971, std.dev.: 0.0267) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 0.55% (0.1639 => 0.1648) MultiSource/Benchmarks/NPB-serial/is/is: 4.90% (9.5636 => 10.0323, std.dev.: 0.0035) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 35.42% (14.1553 => 19.1688, std.dev.: 0.0127) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.56% (3.4629 => 5.7678, std.dev.: 0.0030) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13410.69% (0.0720 => 9.7277, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049600.00% (0.0001 => 10.0497, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 62.76% (0.2554 => 0.4157, std.dev.: 0.0017) SingleSource/Regression/C/matrixTranspose: 57.14% (0.0245 => 0.0385, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 51.95% (0.0256 => 0.0389, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 49.80% (10.3673 => 15.5303, std.dev.: 0.0041) SingleSource/UnitTests/SignlessTypes/factor: 41.55% (0.0296 => 0.0419, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 38.04% (0.1622 => 0.2239, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/distray/distray: 35.13% (0.1056 => 0.1427, std.dev.: 0.0002) SingleSource/UnitTests/vla: 29.58% (0.0355 => 0.0460, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: 24.06% (0.2049 => 0.2542, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 22.06% (0.0834 => 0.1018, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.36% (0.1236 => 0.1500, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.24% (0.1566 => 0.1883, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 19.47% (0.0719 => 0.0859, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 18.75% (0.1584 => 0.1881, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 18.23% (0.1432 => 0.1693, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.94% (2.2022 => 2.5972, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.04% (0.5105 => 0.5975, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.99% (0.0871 => 0.1019, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 16.85% (0.6675 => 0.7800, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 16.82% (7.0540 => 8.2403, std.dev.: 0.0104) SingleSource/Benchmarks/McGill/chomp: 16.68% (0.1655 => 0.1931, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 15.62% (3.3354 => 3.8564, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.28% (1.3050 => 1.5044, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: 14.56% (0.7115 => 0.8151, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.48% (0.5020 => 0.5747, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 14.41% (0.3282 => 0.3755, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.30% (1.5415 => 1.7620, std.dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/almabench: 14.25% (0.0730 => 0.0834, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.24% (0.1032 => 0.1179, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.91% (0.2271 => 0.2587, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 13.89% (0.1440 => 0.1640, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.62% (1.7609 => 2.0008, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.44% (0.1510 => 0.1713, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 13.19% (0.3109 => 0.3519, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 13.14% (9.4845 => 10.7303, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/18-imp/imp: 13.03% (0.3423 => 0.3869, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/em3d/em3d: 12.98% (0.1695 => 0.1915, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/matrix: 12.96% (0.0818 => 0.0924, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.78% (4.2646 => 4.8098, std.dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 12.77% (0.0838 => 0.0945, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.74% (0.4615 => 0.5203, std.dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 12.58% (5.7591 => 6.4838, std.dev.: 0.0160) SingleSource/Benchmarks/McGill/exptree: 12.41% (0.0814 => 0.0915, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 12.38% (1.0722 => 1.2049, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 12.34% (0.1175 => 0.1320, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 12.22% (8.1363 => 9.1308, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.21% (0.1695 => 0.1902, std.dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 12.18% (0.1125 => 0.1262, std.dev.: 0.0022) MultiSource/Applications/viterbi/viterbi: 12.15% (0.1555 => 0.1744, std.dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 12.15% (1.1840 => 1.3279, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 12.11% (0.6450 => 0.7231, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/mst/mst: 12.04% (0.1163 => 0.1303, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: 11.96% (0.1463 => 0.1638, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 11.96% (0.7433 => 0.8322, std.dev.: 0.0024) MultiSource/Applications/treecc/treecc: 11.91% (2.0273 => 2.2687, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/life/life: 11.90% (0.0933 => 0.1044, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 11.84% (0.3387 => 0.3788, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 11.83% (1.1642 => 1.3019, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.76% (0.3307 => 0.3696, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 11.74% (0.0886 => 0.0990, std.dev.: 0.0028) MultiSource/Applications/aha/aha: 11.73% (0.1151 => 0.1286, std.dev.: 0.0017) MultiSource/Applications/spiff/spiff: 11.72% (0.7835 => 0.8753, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.70% (0.1940 => 0.2167, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.63% (0.9765 => 1.0901, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 11.59% (0.1337 => 0.1492, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.54% (0.5860 => 0.6536, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.51% (1.1861 => 1.3226, std.dev.: 0.0022) MultiSource/Applications/lua/lua: 11.48% (3.8723 => 4.3170, std.dev.: 0.0787) MultiSource/Applications/JM/ldecod/ldecod: 11.47% (10.4361 => 11.6326, std.dev.: 0.0125) SingleSource/UnitTests/SignlessTypes/rem: 11.45% (0.1144 => 0.1275, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.44% (4.9449 => 5.5106, std.dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.41% (0.0929 => 0.1035, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.39% (0.2758 => 0.3072, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.35% (1.5859 => 1.7659, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.28% (0.1330 => 0.1480, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.22% (5.0018 => 5.5632, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.20% (0.1625 => 0.1807, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.11% (0.2107 => 0.2341, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.09% (0.4879 => 0.5420, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.07% (0.2700 => 0.2999, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: 11.06% (0.8921 => 0.9908, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.88% (0.8067 => 0.8945, std.dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.83% (0.3121 => 0.3459, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.73% (0.3177 => 0.3518, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/bigfib: 10.70% (0.6456 => 0.7147, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.64% (0.3543 => 0.3920, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.64% (0.1438 => 0.1591, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.61% (7.9617 => 8.8065, std.dev.: 0.0145) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.60% (0.1906 => 0.2108, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.60% (2.2024 => 2.4358, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/05-eks/eks: 10.49% (0.4299 => 0.4750, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.47% (0.1117 => 0.1234, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.24% (1.4186 => 1.5638, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.20% (0.1029 => 0.1134, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 10.18% (0.3516 => 0.3874, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/synchronized: 10.17% (0.3561 => 0.3923, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.16% (0.3473 => 0.3826, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.13% (0.3543 => 0.3902, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.13% (0.5569 => 0.6133, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.11% (0.8172 => 0.8998, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/parameter-passing: 10.08% (0.3927 => 0.4323, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.08% (0.1062 => 0.1169, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.04% (0.3497 => 0.3848, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.03% (0.2603 => 0.2864, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/for-in: 10.02% (0.3694 => 0.4064, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.01% (0.3828 => 0.4211, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 9.83% (2.2969 => 2.5227, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/property: 9.80% (0.3886 => 0.4267, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.75% (0.2266 => 0.2487, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 9.56% (1.5603 => 1.7094, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/bh/bh: 9.54% (0.3092 => 0.3387, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 9.51% (0.4289 => 0.4697, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 9.48% (0.4620 => 0.5058, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 9.43% (0.3180 => 0.3480, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.39% (0.2065 => 0.2259, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/health/health: 9.38% (0.1268 => 0.1387, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.36% (0.3441 => 0.3763, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 9.19% (21.9371 => 23.9540, std.dev.: 0.0221) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.91% (0.3826 => 0.4167, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.91% (0.4636 => 0.5049, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.88% (0.5981 => 0.6512, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.80% (0.3865 => 0.4205, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 8.71% (0.3422 => 0.3720, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.59% (0.4203 => 0.4564, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.43% (0.3427 => 0.3716, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 8.37% (0.4048 => 0.4387, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.19% (0.1892 => 0.2047, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 8.17% (0.3684 => 0.3985, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 8.09% (0.6030 => 0.6518, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.09% (0.4103 => 0.4435, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 8.05% (0.7326 => 0.7916, std.dev.: 0.0046) MultiSource/Applications/sqlite3/sqlite3: 7.96% (17.1811 => 18.5490, std.dev.: 0.0061) SingleSource/UnitTests/ObjC++/Hello: 7.85% (0.5925 => 0.6390, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 7.63% (0.3603 => 0.3878, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.28% (0.8101 => 0.8691, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.22% (14.3668 => 15.4034, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.12% (3.8922 => 4.1692, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.07% (0.3650 => 0.3908, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 7.04% (0.3098 => 0.3316, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.87% (0.4064 => 0.4343, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.77% (0.2793 => 0.2982, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.75% (0.2756 => 0.2942, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.68% (0.2725 => 0.2907, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.68% (0.2891 => 0.3084, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.63% (0.3136 => 0.3344, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.63% (0.3379 => 0.3603, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.61% (0.3283 => 0.3500, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.59% (0.3232 => 0.3445, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.57% (0.2905 => 0.3096, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.56% (2.0665 => 2.2020, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 6.53% (0.2831 => 0.3016, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wc: 6.42% (0.3052 => 0.3248, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.41% (0.2714 => 0.2888, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.29% (0.2877 => 0.3058, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.20% (0.2872 => 0.3050, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.13% (0.2871 => 0.3047, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.71% (0.2802 => 0.2962, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 5.60% (1.2842 => 1.3561, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.47% (0.2430 => 0.2563, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 5.08% (0.3131 => 0.3290, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.72% (1.1194 => 1.1499, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 10.96% (0.9957 => 1.1048, std.dev.: 0.0124) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.97% (1.1396 => 1.2532, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.62% (3.1578 => 3.3667, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 5.94% (1.9405 => 2.0558, std.dev.: 0.0006) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.87% (0.4162 => 0.4323, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.94% (4.2280 => 4.3524, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.51% (1.0313 => 1.0572, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.29% (1.7254 => 1.7649, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.80% (3.6395 => 3.7051, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/bisort/bisort: 1.78% (0.8333 => 0.8481, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2075, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.44% (2.6546 => 2.6928, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.01% (6.5088 => 6.5746, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 1.00% (3.8532 => 3.8919, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.04% (6.6874 => 0.1313, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -79.94% (0.8651 => 0.1735, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.28% (5.2763 => 3.2040, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.62% (5.3855 => 3.6826, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.17% (5.3526 => 3.6844, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -14.60% (54.1659 => 46.2599, std.dev.: 0.0159) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.56% (2.9384 => 2.6281, std.dev.: 0.0080) MultiSource/Applications/ClamAV/clamscan: -7.28% (22.1758 => 20.5619, std.dev.: 0.0211) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.07% (8.0499 => 3.7776, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7653, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4246, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.62% (1.2373 => 1.0935, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3453 => 2.9599, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -10.80% (1.5373 => 1.3712, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.50% (19.9488 => 18.2526, std.dev.: 0.0300) MultiSource/Benchmarks/FreeBench/mason/mason: -7.96% (0.2161 => 0.1989, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.45% (1.6805 => 1.5553, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.92% (1.8329 => 1.7061, std.dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5757, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5085, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.36% (8.1563 => 7.8005, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.64% (3.2827 => 3.1632, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8775, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5079, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.79% (0.4808 => 0.4674, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -1.84% (10.2830 => 10.0937, std.dev.: 0.0116) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6819, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -1.68% (2.5528 => 2.5100, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: -1.20% (4.6441 => 4.5884, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2879, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 16.94% (0.5229 => 0.6115, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 14.18% (14.9895 => 17.1152, std.dev.: 0.0127) MultiSource/Benchmarks/MallocBench/gs/gs: 9.66% (4.1105 => 4.5077, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 16.33% (1.1048 => 1.2852, std.dev.: 0.0058) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 15.18% (7.1582 => 8.2447, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.16% (0.6222 => 0.7725, std.dev.: 0.0070) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35400.00% (0.0001 => 0.0355, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.41% (0.2116 => 0.2167, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 19 10:54:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 19 Oct 2012 12:54:14 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121019175414.F41DC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5009?compare_to=5006&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5009, Order: 166285, Start Time: 2012-10-19 16:31:50, End Time: 2012-10-19 17:56:15 To: 5006, Order: 166281, Start Time: 2012-10-19 14:51:23, End Time: 2012-10-19 16:15:03 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 21 (15 on baseline) Performance Improvements: 1 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 953 (955 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.76% (0.4590 => 0.4946, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.89% (0.7707 => 0.8238, std.dev.: 0.0105) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.72% (0.1980 => 0.2113, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.91% (0.7415 => 0.7853, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.06% (0.2234 => 0.2347, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.32% (0.8005 => 0.8351, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.32% (0.9245 => 0.9644, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.97% (0.5667 => 0.5892, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.80% (1.1280 => 1.1709, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/gs/gs: 3.46% (3.9950 => 4.1334, std.dev.: 0.0336) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.91% (4.4387 => 4.5677, std.dev.: 0.0441) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.22% (4.3983 => 4.4961, std.dev.: 0.0039) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.20% (6.5457 => 6.6895, std.dev.: 0.0229) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.08% (1.2289 => 1.2544, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.93% (8.5187 => 8.6832, std.dev.: 0.0577) MultiSource/Applications/hexxagon/hexxagon: 1.40% (0.9712 => 0.9848, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.12% (4.1597 => 4.2061, std.dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 11.66% (1.6902 => 1.8872, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.62% (0.3367 => 0.3489, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.26% (5.2092 => 5.3267, std.dev.: 0.0414) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.75% (0.6121 => 0.6228, std.dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -1.06% (22.6651 => 22.4248, std.dev.: 0.0798) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.24% (16.4421 => 16.4027, std.dev.: 0.2919) MultiSource/Applications/obsequi/Obsequi: 2.12% (1.0263 => 1.0481, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.13% (0.6271 => 0.6342, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/08-main/main: 3.20% (0.1783 => 0.1840, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.89% (0.1593 => 0.1639, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.06% (0.3195 => 0.3161, std.dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.17% (0.2475 => 0.2446, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.22% (0.3368 => 0.3409, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.26% (0.2390 => 0.2420, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/bigfib: 1.44% (0.5964 => 0.6050, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/mandel: 1.64% (0.0426 => 0.0433, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.49% (0.3297 => 0.3281, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: 0.10% (0.1983 => 0.1985, std.dev.: 0.0011) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -14.41% (0.0222 => 0.0190, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 22.29% (0.0166 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.14% (0.0389 => 0.0409, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.85% (0.0246 => 0.0239, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -18.48% (0.0276 => 0.0225, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.99% (0.0403 => 0.0407, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -9.09% (0.0121 => 0.0110, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/test1: -19.02% (0.0205 => 0.0166, std.dev.: 0.0019) SingleSource/UnitTests/byval-alignment: -9.25% (0.0281 => 0.0255, std.dev.: 0.0062) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.14% (0.1471 => 0.1473, std.dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 2.52% (1.1322 => 1.1607, std.dev.: 0.0701) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 6.00% (0.1433 => 0.1519, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.57% (0.4028 => 0.4051, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.38% (0.1469 => 0.1390, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.12% (0.0661 => 0.0675, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.36% (0.0277 => 0.0276, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.81% (0.0551 => 0.0561, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.39% (1.1408 => 1.1452, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 63.16% (0.0019 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.90% (0.0558 => 0.0630, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 36.92% (0.0195 => 0.0267, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.20% (0.8001 => 0.7985, std.dev.: 0.0132) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -26.32% (0.0057 => 0.0042, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.09% (2.1832 => 1.6573, std.dev.: 0.0009) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.08% (0.7473 => 0.7853, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.24% (0.3137 => 0.3270, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.22% (0.9435 => 0.9644, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.24% (6.6074 => 6.6895, std.dev.: 0.0229) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.48% (1.5795 => 2.5032, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.51% (0.3186 => 0.3489, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.53% (1.1857 => 1.2868, std.dev.: 0.0094) MultiSource/Benchmarks/mafft/pairlocalalign: 5.98% (63.1822 => 66.9618, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/ReedSolomon: 2.84% (8.5322 => 8.7747, std.dev.: 0.0269) MultiSource/Applications/siod/siod: 2.76% (3.6643 => 3.7656, std.dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 2.09% (21.9654 => 22.4248, std.dev.: 0.0798) SingleSource/Benchmarks/Shootout-C++/hash: 1.85% (0.6205 => 0.6320, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.42% (4.8362 => 4.9049, std.dev.: 0.0137) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.29% (1.5941 => 1.6147, std.dev.: 0.0058) MultiSource/Benchmarks/PAQ8p/paq8p: 1.09% (91.7701 => 92.7692, std.dev.: 0.1829) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.62% (0.3269 => 0.3020, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -4.86% (29.8330 => 28.3824, std.dev.: 0.1693) SingleSource/Benchmarks/Shootout-C++/hash2: -1.69% (3.4237 => 3.3659, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.24% (3.3479 => 3.3063, std.dev.: 0.0154) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.26% (16.4461 => 16.4027, std.dev.: 0.2919) MultiSource/Applications/obsequi/Obsequi: 2.13% (1.0262 => 1.0481, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 0.16% (0.6332 => 0.6342, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/08-main/main: 0.49% (0.1831 => 0.1840, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.13% (0.1559 => 0.1639, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.22% (0.3123 => 0.3161, std.dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.69% (0.2463 => 0.2446, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.94% (0.3344 => 0.3409, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.37% (0.2364 => 0.2420, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/bigfib: 0.67% (0.6010 => 0.6050, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/mandel: 0.93% (0.0429 => 0.0433, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.46% (0.3266 => 0.3281, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: 0.81% (0.1969 => 0.1985, std.dev.: 0.0011) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -15.18% (0.0224 => 0.0190, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 65.04% (0.0123 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.25% (0.0408 => 0.0409, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -5.91% (0.0254 => 0.0239, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -25.50% (0.0302 => 0.0225, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 5.99% (0.0384 => 0.0407, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -42.11% (0.0190 => 0.0110, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/test1: -7.78% (0.0180 => 0.0166, std.dev.: 0.0019) SingleSource/UnitTests/byval-alignment: 10.87% (0.0230 => 0.0255, std.dev.: 0.0062) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.43% (0.1438 => 0.1473, std.dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 2.45% (1.1329 => 1.1607, std.dev.: 0.0701) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.90% (0.1462 => 0.1519, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.71% (0.4164 => 0.4051, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.53% (0.1369 => 0.1390, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.30% (0.0641 => 0.0675, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.54% (0.0195 => 0.0276, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.94% (0.0578 => 0.0561, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.13% (1.1437 => 1.1452, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.48% (0.0627 => 0.0630, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.33% (0.0180 => 0.0267, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.40% (0.8017 => 0.7985, std.dev.: 0.0132) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -32.26% (0.0062 => 0.0042, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 19 11:18:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 19 Oct 2012 13:18:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121019181837.30EB02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5010?compare_to=5007&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5010, Order: 166285, Start Time: 2012-10-19 16:55:44, End Time: 2012-10-19 18:21:36 To: 5007, Order: 166281, Start Time: 2012-10-19 15:00:16, End Time: 2012-10-19 16:26:13 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (192 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1042 (672 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.53% (2.0176 => 2.4924, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.94% (0.1410 => 0.1677, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 17.07% (0.0826 => 0.0967, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 16.94% (0.2243 => 0.2623, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.23% (0.0653 => 0.0759, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.15% (0.1327 => 0.1528, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.02% (0.1072 => 0.1233, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 14.31% (0.1013 => 0.1158, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.67% (0.0834 => 0.0948, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 13.17% (0.7038 => 0.7965, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.16% (0.1413 => 0.1599, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 13.03% (1.3693 => 1.5477, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.97% (0.1588 => 0.1794, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 12.89% (0.4328 => 0.4886, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.59% (3.9660 => 4.4655, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.55% (0.0964 => 0.1085, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.50% (0.2721 => 0.3061, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.31% (0.7710 => 0.8659, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.21% (0.2596 => 0.2913, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 12.15% (0.1062 => 0.1191, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.13% (0.6283 => 0.7045, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.10% (0.6959 => 0.7801, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 12.01% (0.4062 => 0.4550, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.96% (0.9199 => 1.0299, std.dev.: 0.0051) MultiSource/Applications/SPASS/SPASS: 11.90% (13.8202 => 15.4643, std.dev.: 0.0185) SingleSource/UnitTests/ObjC++/property-reference-object: 11.81% (0.5818 => 0.6505, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 11.76% (0.1003 => 0.1121, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.71% (1.4563 => 1.6269, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.53% (0.5265 => 0.5872, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: 11.48% (0.5748 => 0.6408, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 11.46% (0.7061 => 0.7870, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.45% (1.2193 => 1.3589, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.33% (0.4791 => 0.5334, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.32% (0.1157 => 0.1288, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.31% (0.3899 => 0.4340, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 11.23% (0.1986 => 0.2209, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 11.22% (1.0313 => 1.1470, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.01% (1.1364 => 1.2615, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 10.96% (1.1061 => 1.2273, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.88% (0.3485 => 0.3864, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.86% (0.3130 => 0.3470, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.81% (0.3580 => 0.3967, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.80% (0.4390 => 0.4864, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.71% (0.4016 => 0.4446, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.70% (0.3756 => 0.4158, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 10.68% (0.2781 => 0.3078, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.65% (0.5577 => 0.6171, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.64% (0.4379 => 0.4845, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 10.57% (0.1589 => 0.1757, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 10.57% (16.6129 => 18.3691, std.dev.: 0.0066) MultiSource/Applications/minisat/minisat: 10.53% (0.6744 => 0.7454, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.49% (0.3489 => 0.3855, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 10.48% (0.3293 => 0.3638, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.47% (0.2914 => 0.3219, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 10.44% (0.1111 => 0.1227, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.42% (0.1075 => 0.1187, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.39% (0.2782 => 0.3071, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.36% (0.3022 => 0.3335, std.dev.: 0.0091) MultiSource/Applications/sgefa/sgefa: 10.35% (0.2995 => 0.3305, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 10.34% (3.8646 => 4.2641, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/moments: 10.32% (0.3868 => 0.4267, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.29% (0.1865 => 0.2057, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.26% (0.1569 => 0.1730, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.26% (0.8698 => 0.9590, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.24% (0.0977 => 0.1077, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 10.22% (0.3453 => 0.3806, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 10.22% (0.3220 => 0.3549, std.dev.: 0.0059) MultiSource/Applications/viterbi/viterbi: 10.22% (0.1478 => 0.1629, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.19% (0.1276 => 0.1406, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.19% (0.7460 => 0.8220, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.17% (0.1435 => 0.1581, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.17% (0.3246 => 0.3576, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.15% (0.2966 => 0.3267, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 10.12% (3.1889 => 3.5116, std.dev.: 0.0030) MultiSource/Applications/spiff/spiff: 10.11% (0.7506 => 0.8265, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 10.10% (1.9270 => 2.1217, std.dev.: 0.0120) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.06% (0.1014 => 0.1116, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 10.04% (2.1791 => 2.3979, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.02% (0.2655 => 0.2921, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.00% (1.9828 => 2.1811, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 10.00% (0.2690 => 0.2959, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 10.00% (0.2761 => 0.3037, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 9.98% (0.2726 => 0.2998, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 9.93% (0.2607 => 0.2866, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 9.91% (0.3149 => 0.3461, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 9.90% (0.8310 => 0.9133, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.90% (0.5637 => 0.6195, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 9.85% (0.3534 => 0.3882, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.82% (4.9865 => 5.4762, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/except: 9.82% (0.2760 => 0.3031, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 9.82% (0.3107 => 0.3412, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 9.81% (0.2937 => 0.3225, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 9.78% (0.2925 => 0.3211, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 9.74% (0.2628 => 0.2884, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.74% (0.2023 => 0.2220, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.59% (0.2127 => 0.2331, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.58% (0.2765 => 0.3030, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 9.56% (0.3192 => 0.3497, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.54% (7.2180 => 7.9067, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.38% (0.2696 => 0.2949, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 9.34% (0.2988 => 0.3267, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 9.29% (0.1657 => 0.1811, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.27% (0.3755 => 0.4103, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 9.07% (0.2945 => 0.3212, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.00% (1.3245 => 1.4437, std.dev.: 0.0145) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.97% (3.6692 => 3.9982, std.dev.: 0.0114) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.81% (4.3801 => 4.7662, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.79% (0.6576 => 0.7154, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.75% (4.4433 => 4.8321, std.dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 8.73% (14.8535 => 16.1508, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.64% (1.5188 => 1.6501, std.dev.: 0.0161) MultiSource/Benchmarks/nbench/nbench: 8.64% (1.0594 => 1.1509, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 8.58% (4.6629 => 5.0628, std.dev.: 0.0030) MultiSource/Benchmarks/sim/sim: 8.53% (0.3131 => 0.3398, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.48% (0.6135 => 0.6655, std.dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 8.46% (1.2749 => 1.3828, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.46% (0.2140 => 0.2321, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 8.44% (8.4961 => 9.2128, std.dev.: 0.0136) SingleSource/Benchmarks/Misc-C++/bigfib: 8.37% (0.6250 => 0.6773, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.33% (0.1789 => 0.1938, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.32% (0.3511 => 0.3803, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.31% (0.8818 => 0.9551, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.15% (3.2742 => 3.5411, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.10% (0.2321 => 0.2509, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 8.00% (0.4113 => 0.4442, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.98% (2.1007 => 2.2683, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.95% (0.9108 => 0.9832, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.87% (0.4805 => 0.5183, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.77% (0.3245 => 0.3497, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.76% (1.1333 => 1.2213, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 7.61% (3.7467 => 4.0320, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/neural/neural: 7.58% (0.1385 => 0.1490, std.dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 7.54% (6.5754 => 7.0715, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/oourafft: 7.47% (0.2008 => 0.2158, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.47% (0.2504 => 0.2691, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 7.29% (0.4003 => 0.4295, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 7.29% (1.2292 => 1.3188, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.29% (0.3650 => 0.3916, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.26% (0.3914 => 0.4198, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.15% (0.1819 => 0.1949, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.10% (6.2785 => 6.7242, std.dev.: 0.0129) SingleSource/UnitTests/ObjC/property: 7.06% (0.3940 => 0.4218, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 6.81% (0.3789 => 0.4047, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.80% (0.3663 => 0.3912, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 6.76% (0.3578 => 0.3820, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.75% (0.3646 => 0.3892, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 6.69% (0.3601 => 0.3842, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.65% (0.3623 => 0.3864, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.27% (13.2842 => 14.1168, std.dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: 5.28% (16.2614 => 17.1196, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.95% (0.2243 => 0.2354, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 4.34% (14.5298 => 15.1610, std.dev.: 0.0076) MultiSource/Benchmarks/Bullet/bullet: 2.38% (33.2944 => 34.0884, std.dev.: 0.0087) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.63% (5.7573 => 7.5207, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/fbench: 24.51% (1.8175 => 2.2629, std.dev.: 0.0302) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.10% (1.0895 => 1.2758, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 11.04% (1.1560 => 1.2836, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/mst/mst: 8.47% (0.1322 => 0.1434, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.55% (3.1736 => 3.4132, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.43% (0.9692 => 1.0218) SingleSource/Benchmarks/Misc/mandel-2: 5.17% (1.2998 => 1.3670, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.97% (0.2093 => 0.2197, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.80% (0.3458 => 0.3624, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.75% (1.9144 => 2.0054, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 4.46% (0.5449 => 0.5692, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.46% (2.8606 => 2.9881, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.53% (10.7476 => 11.1274, std.dev.: 0.0244) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9849, std.dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.38% (12.0921 => 12.5006, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.23% (11.2619 => 11.6253, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/bisort/bisort: 2.97% (0.8239 => 0.8484, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.40% (1.0310 => 1.0557, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.16% (7.4271 => 7.5873, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 1.74% (1.4298 => 1.4547, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5136, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2123, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1867, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (1.9433 => 1.9669, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5785, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.19% (9.9194 => 10.0370, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 1.18% (12.4560 => 12.6029, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.15% (8.8259 => 8.9277, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.63% (0.2670 => 0.1425, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.19% (0.4657 => 0.3903, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -14.29% (0.0707 => 0.0606, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.34% (1.3813 => 1.1970, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.33% (1.3819 => 1.1977, std.dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.29% (1.0460 => 0.8547, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -13.00% (0.2238 => 0.1947, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.25% (20.3410 => 18.2558, std.dev.: 0.0278) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -5.60% (1.2308 => 1.1619, std.dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0049) SingleSource/UnitTests/Vector/multiplies: -4.96% (2.6470 => 2.5157, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.81% (0.9996 => 0.9515, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.74% (1.3780 => 1.3127, std.dev.: 0.0175) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.95% (1.7688 => 1.6990, std.dev.: 0.0102) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.04% (0.4867 => 0.4719, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -2.87% (3.2729 => 3.1789, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.81% (3.0263 => 2.9414, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: -2.73% (1.9762 => 1.9223, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -2.71% (5.0168 => 4.8810, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.24% (4.1080 => 4.0160, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.94% (0.6589 => 0.6461, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.87% (0.6615 => 0.6491, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.77% (6.3560 => 6.2433, std.dev.: 0.0074) MultiSource/Applications/lua/lua: -1.69% (26.5159 => 26.0666, std.dev.: 0.0130) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.67% (0.8342 => 0.8203, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.63% (2.5254 => 2.4843, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0077, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8632, std.dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: -1.24% (28.2225 => 27.8725, std.dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: -1.15% (5.3167 => 5.2555, std.dev.: 0.0004) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1139, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -1.06% (84.4286 => 83.5316, std.dev.: 0.0121) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 19 12:13:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 19 Oct 2012 14:13:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121019191339.85A192A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5011?compare_to=5008&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5011, Order: 166288, Start Time: 2012-10-19 17:55:23, End Time: 2012-10-19 19:15:38 To: 5008, Order: 166283, Start Time: 2012-10-19 16:04:36, End Time: 2012-10-19 17:25:39 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (76 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (185 on baseline) Performance Improvements: 1 (44 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 91 (15 on baseline) Unchanged Tests: 949 (656 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 2.30% (11.6326 => 11.8999, std.dev.: 0.0137) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.07% (81.5316 => 79.8461, std.dev.: 0.6053) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.33% (0.6115 => 0.6135, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 0.26% (17.1152 => 17.1598, std.dev.: 0.0110) MultiSource/Benchmarks/Bullet/bullet: 0.22% (56.1971 => 56.3181, std.dev.: 0.0249) MultiSource/Benchmarks/MallocBench/gs/gs: 0.17% (4.5077 => 4.5154, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.22% (0.0460 => 0.0461, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.22% (0.0461 => 0.0462, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0431 => 0.0431) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0432 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.24% (0.0419 => 0.0420, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.48% (0.0420 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.48% (0.0413 => 0.0415) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.24% (0.0414 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.23% (0.0433 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.23% (0.0432 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.71% (0.0424 => 0.0427, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.23% (0.0426 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.24% (0.0415 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.24% (0.0418 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.24% (0.0422 => 0.0423, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.24% (0.0424 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0434 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.90% (0.0449 => 0.0436, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.24% (0.0411 => 0.0412, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.49% (0.0411 => 0.0413, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.47% (0.0422 => 0.0424) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.47% (0.0423 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.48% (0.0413 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.24% (0.0415 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.25% (0.0406 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.25% (0.0407 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.25% (0.0405 => 0.0406) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.49% (0.0406 => 0.0408) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.45% (0.0441 => 0.0443) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0443 => 0.0443, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.50% (0.0403 => 0.0405) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.25% (0.0406 => 0.0405, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0406 => 0.0406, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.25% (0.0407 => 0.0406, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.49% (0.0412 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.24% (0.0413 => 0.0414, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.34% (1.2852 => 1.2896, std.dev.: 0.0075) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.21% (8.2447 => 8.2277, std.dev.: 0.0178) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.36% (0.7725 => 0.7753, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.28% (0.0355 => 0.0356, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1431 => 0.1432) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -0.06% (0.1648 => 0.1647, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.28% (0.2167 => 0.2161, std.dev.: 0.0025) MultiSource/Benchmarks/NPB-serial/is/is: 0.01% (10.0323 => 10.0329, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -10.95% (63.2438 => 56.3181, std.dev.: 0.0249) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 0.49% (0.1639 => 0.1647, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 4.91% (9.5636 => 10.0329, std.dev.: 0.0031) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 35.84% (14.1553 => 19.2280, std.dev.: 0.0139) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.39% (3.4629 => 5.7964, std.dev.: 0.0195) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13414.44% (0.0720 => 9.7304, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049900.00% (0.0001 => 10.0500, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 62.88% (0.2554 => 0.4160, std.dev.: 0.0006) SingleSource/Regression/C/matrixTranspose: 57.14% (0.0245 => 0.0385, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 52.34% (0.0256 => 0.0390, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 50.03% (10.3673 => 15.5539, std.dev.: 0.0177) SingleSource/UnitTests/SignlessTypes/factor: 41.89% (0.0296 => 0.0420) SingleSource/Benchmarks/Misc/richards_benchmark: 37.92% (0.1622 => 0.2237, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/distray/distray: 35.80% (0.1056 => 0.1434, std.dev.: 0.0001) SingleSource/UnitTests/vla: 29.30% (0.0355 => 0.0459, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: 23.43% (0.2049 => 0.2529, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 22.30% (0.0834 => 0.1020, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.76% (0.1236 => 0.1505, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.75% (0.1566 => 0.1891, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 19.61% (0.0719 => 0.0860, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 18.69% (0.1584 => 0.1880, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 18.65% (0.1432 => 0.1699, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.62% (2.2022 => 2.6122, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.98% (7.0540 => 8.3226, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.43% (0.5105 => 0.5995, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.11% (0.0871 => 0.1020, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 16.99% (0.6675 => 0.7809, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 15.78% (3.3354 => 3.8618, std.dev.: 0.0082) SingleSource/Benchmarks/McGill/chomp: 15.65% (0.1655 => 0.1914, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 15.33% (0.3282 => 0.3785, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.20% (1.3050 => 1.5033, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.02% (0.5020 => 0.5774, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.65% (1.5415 => 1.7673, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 14.59% (0.7115 => 0.8153, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.29% (1.7609 => 2.0126, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.24% (0.1032 => 0.1179, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 14.17% (0.1440 => 0.1644, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 14.13% (0.2271 => 0.2592, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 14.03% (10.4361 => 11.8999, std.dev.: 0.0137) MultiSource/Benchmarks/mafft/pairlocalalign: 13.52% (9.4845 => 10.7664, std.dev.: 0.0057) MultiSource/Applications/sgefa/sgefa: 13.38% (0.3109 => 0.3525, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.38% (0.1510 => 0.1712, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.28% (0.0798 => 0.0904, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.13% (0.0838 => 0.0948, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 13.12% (0.3423 => 0.3872, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/matrix: 13.08% (0.0818 => 0.0925, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 12.92% (0.1695 => 0.1914, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.89% (4.2646 => 4.8142, std.dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: 12.80% (5.7591 => 6.4961, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.74% (0.1695 => 0.1911, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.70% (0.4615 => 0.5201, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 12.65% (0.0814 => 0.0917, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 12.48% (0.6450 => 0.7255, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 12.48% (0.1555 => 0.1749, std.dev.: 0.0034) MultiSource/Applications/lemon/lemon: 12.46% (1.0722 => 1.2058, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.43% (0.0933 => 0.1049, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 12.43% (0.1175 => 0.1321, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 12.35% (1.1840 => 1.3302, std.dev.: 0.0030) MultiSource/Applications/Burg/burg: 12.22% (1.1642 => 1.3065, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 12.22% (0.7433 => 0.8341, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.19% (0.1337 => 0.1500, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 12.17% (0.1463 => 0.1641, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.13% (0.3307 => 0.3708, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/mst/mst: 12.12% (0.1163 => 0.1304, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 12.12% (8.1363 => 9.1221, std.dev.: 0.0034) MultiSource/Applications/treecc/treecc: 12.10% (2.0273 => 2.2727, std.dev.: 0.0045) MultiSource/Benchmarks/sim/sim: 12.05% (0.3387 => 0.3795, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.96% (0.1940 => 0.2172, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 11.90% (0.1151 => 0.1288, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.90% (0.9765 => 1.0927, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.86% (4.9449 => 5.5315, std.dev.: 0.0103) MultiSource/Applications/lua/lua: 11.81% (3.8723 => 4.3298, std.dev.: 0.0118) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 11.74% (0.0886 => 0.0990, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.71% (0.5860 => 0.6546, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.63% (5.0018 => 5.5837, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.63% (0.1625 => 0.1814, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/rem: 11.63% (0.1144 => 0.1277) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.52% (0.2700 => 0.3011, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 11.45% (0.7835 => 0.8732, std.dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.41% (0.0929 => 0.1035, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.37% (1.5859 => 1.7662, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.27% (0.1438 => 0.1600, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.26% (1.1861 => 1.3196, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.20% (0.1330 => 0.1479, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.20% (0.2107 => 0.2343, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.20% (7.9617 => 8.8531, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/football/football: 11.19% (0.8921 => 0.9919, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.02% (0.1125 => 0.1249, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.01% (0.8067 => 0.8955, std.dev.: 0.0049) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.99% (0.3121 => 0.3464, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.97% (0.4879 => 0.5414, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 10.89% (0.6456 => 0.7159, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.86% (0.3177 => 0.3522, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.84% (0.2758 => 0.3057, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.79% (0.8172 => 0.9054, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.77% (2.2024 => 2.4395, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.70% (0.1906 => 0.2110, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 10.61% (0.4299 => 0.4755, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.58% (0.3543 => 0.3918, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.47% (0.1117 => 0.1234) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.40% (0.1029 => 0.1136, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.38% (1.4186 => 1.5658, std.dev.: 0.0083) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.26% (0.1062 => 0.1171, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.18% (0.5569 => 0.6136, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.15% (0.2266 => 0.2496, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 10.12% (2.2969 => 2.5293, std.dev.: 0.0186) SingleSource/UnitTests/ObjC/exceptions-4: 10.10% (0.3543 => 0.3901, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.10% (0.2603 => 0.2866, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.08% (0.3828 => 0.4214, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.08% (0.3473 => 0.3823, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 10.07% (1.5603 => 1.7174, std.dev.: 0.0083) SingleSource/UnitTests/ObjC/exceptions-3: 10.07% (0.3516 => 0.3870, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.06% (0.3927 => 0.4322, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.03% (0.3561 => 0.3918, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.99% (0.3694 => 0.4063, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.98% (0.3497 => 0.3846, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.93% (0.3886 => 0.4272, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 9.93% (0.4289 => 0.4715, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 9.83% (0.3092 => 0.3396, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.74% (0.3441 => 0.3776, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 9.70% (0.4620 => 0.5068, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 9.56% (0.3180 => 0.3484, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.54% (0.2065 => 0.2262, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/health/health: 9.46% (0.1268 => 0.1388, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.46% (0.3826 => 0.4188, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 9.40% (21.9371 => 23.9997, std.dev.: 0.0234) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.29% (0.3865 => 0.4224, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 9.15% (0.3422 => 0.3735, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.11% (0.4203 => 0.4586, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.84% (0.6030 => 0.6563, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.78% (0.5925 => 0.6445, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.74% (0.5981 => 0.6504, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 8.72% (0.4048 => 0.4401, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.65% (0.4103 => 0.4458, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.65% (0.4636 => 0.5037, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/lists1: 8.63% (0.3684 => 0.4002, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.30% (0.1892 => 0.2049, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.29% (0.3427 => 0.3711, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 8.18% (17.1811 => 18.5870, std.dev.: 0.0154) SingleSource/UnitTests/ObjC++/property-reference: 8.14% (0.7326 => 0.7922, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sieve: 7.97% (0.3603 => 0.3890, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.62% (0.3650 => 0.3928, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.53% (0.8101 => 0.8711, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.33% (0.4064 => 0.4362, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.28% (14.3668 => 15.4122, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/matrix: 7.17% (0.3098 => 0.3320, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.16% (3.8922 => 4.1707, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.12% (0.3162 => 0.3387, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 7.06% (0.2905 => 0.3110, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.03% (0.2831 => 0.3030, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 7.02% (0.3232 => 0.3459, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.02% (0.3136 => 0.3356, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.01% (0.3283 => 0.3513, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.95% (0.2891 => 0.3092, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.89% (2.0665 => 2.2088, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 6.67% (0.2877 => 0.3069, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.62% (0.2872 => 0.3062, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.59% (0.2793 => 0.2977, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.55% (0.2871 => 0.3059, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.45% (0.3379 => 0.3597, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.42% (0.2756 => 0.2933, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 6.39% (0.2725 => 0.2899, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 6.32% (0.3052 => 0.3245, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.17% (0.2802 => 0.2975, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.12% (0.2714 => 0.2880, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 5.89% (1.2842 => 1.3598, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/objinst: 5.62% (0.3131 => 0.3307, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.60% (0.2430 => 0.2566, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.11% (1.1194 => 1.1542, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.77% (0.3935 => 0.4044, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.62% (0.3817 => 0.3917, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 10.65% (0.9957 => 1.1017, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/richards_benchmark: 9.75% (1.1396 => 1.2507, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 6.62% (3.1578 => 3.3667, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 5.93% (1.9405 => 2.0555, std.dev.: 0.0005) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.4162 => 0.4322, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.68% (4.2280 => 4.3413, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7655, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.08% (3.6395 => 3.7151, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bisort/bisort: 1.73% (0.8333 => 0.8477, std.dev.: 0.0013) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2078, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.34% (2.6546 => 2.6901, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.03% (6.5088 => 6.5757, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.00% (6.6874 => 0.1340, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -79.92% (0.8651 => 0.1737, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.99% (5.2763 => 3.2191, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.08% (5.3855 => 3.7116, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.63% (5.3526 => 3.7131, std.dev.: 0.0075) SingleSource/UnitTests/Vector/constpool: -14.61% (54.1659 => 46.2506, std.dev.: 0.0189) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.39% (2.9384 => 2.6330, std.dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: -6.83% (22.1758 => 20.6620, std.dev.: 0.0482) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.08% (8.0499 => 3.7769, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.39% (1.1492 => 0.7655, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.73% (1.6925 => 1.4263, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3453 => 2.9600, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.51% (1.2373 => 1.0949, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -10.78% (1.5373 => 1.3716, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.23% (19.9488 => 18.3070, std.dev.: 0.0578) MultiSource/Benchmarks/FreeBench/mason/mason: -7.73% (0.2161 => 0.1994, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.14% (1.6805 => 1.5605, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.89% (1.8329 => 1.7066, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8477, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5091, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.48% (8.1563 => 7.7913, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1626, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8775, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4927, std.dev.: 0.0089) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.02% (0.4808 => 0.4663, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Applications/sqlite3/sqlite3: -2.04% (4.6441 => 4.5495, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/salsa20: -1.89% (10.2830 => 10.0891, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6834, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.67% (2.5528 => 2.5102, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2879, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8574, std.dev.: 0.0010) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 17.33% (0.5229 => 0.6135, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 14.48% (14.9895 => 17.1598, std.dev.: 0.0110) MultiSource/Benchmarks/MallocBench/gs/gs: 9.85% (4.1105 => 4.5154, std.dev.: 0.0131) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 16.73% (1.1048 => 1.2896, std.dev.: 0.0075) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.94% (7.1582 => 8.2277, std.dev.: 0.0178) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.61% (0.6222 => 0.7753, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35500.00% (0.0001 => 0.0356, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.13% (0.2116 => 0.2161, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 19 12:34:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 19 Oct 2012 14:34:23 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121019193423.1ADAF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5012?compare_to=5009&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5012, Order: 166290, Start Time: 2012-10-19 18:13:16, End Time: 2012-10-19 19:36:23 To: 5009, Order: 166285, Start Time: 2012-10-19 16:31:50, End Time: 2012-10-19 17:56:15 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 2 (13 on baseline) Performance Improvements: 18 (7 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 955 (954 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.28% (0.7525 => 0.7847, std.dev.: 0.0097) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.88% (41.4894 => 42.6862, std.dev.: 0.0538) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.41% (1.1828 => 1.0952, std.dev.: 0.0318) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -7.24% (0.2347 => 0.2177, std.dev.: 0.0064) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.47% (0.1624 => 0.1519, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/05-eks/eks: -3.88% (0.4459 => 0.4286, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -3.73% (0.6373 => 0.6135, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -2.57% (4.5677 => 4.4504, std.dev.: 0.0408) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -2.55% (1.2541 => 1.2221, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.90% (0.9887 => 0.9699, std.dev.: 0.0061) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.89% (6.6895 => 6.5629, std.dev.: 0.0443) MultiSource/Applications/siod/siod: -1.85% (2.2372 => 2.1958, std.dev.: 0.0148) MultiSource/Applications/treecc/treecc: -1.82% (2.0194 => 1.9826, std.dev.: 0.0103) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.49% (1.1210 => 1.1043, std.dev.: 0.0055) MultiSource/Benchmarks/nbench/nbench: -1.41% (1.1389 => 1.1228, std.dev.: 0.0024) MultiSource/Benchmarks/Bullet/bullet: -1.34% (32.1538 => 31.7220, std.dev.: 0.1420) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: -10.07% (0.1549 => 0.1393, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.76% (1.3483 => 1.2707, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.68% (4.8322 => 4.5576, std.dev.: 0.1019) MultiSource/Benchmarks/Bullet/bullet: -1.39% (7.2078 => 7.1076, std.dev.: 0.0370) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.27% (16.4027 => 16.3584, std.dev.: 0.1820) MultiSource/Applications/obsequi/Obsequi: -2.22% (1.0481 => 1.0248, std.dev.: 0.0096) MultiSource/Applications/sqlite3/sqlite3: -1.26% (0.6342 => 0.6262, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/08-main/main: -1.90% (0.1840 => 0.1805, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.87% (0.1639 => 0.1592, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.54% (0.3161 => 0.3144, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.65% (0.2446 => 0.2430, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.88% (0.3409 => 0.3345, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.88% (0.2420 => 0.2326, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/bigfib: -1.83% (0.6050 => 0.5939, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel: 1.62% (0.0433 => 0.0440, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.03% (0.3281 => 0.3282, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/strcat: -2.17% (0.1985 => 0.1942, std.dev.: 0.0017) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.53% (0.0190 => 0.0191, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.99% (0.0203 => 0.0205, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.49% (0.0409 => 0.0411, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 33.05% (0.0239 => 0.0318, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 32.89% (0.0225 => 0.0299, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.25% (0.0407 => 0.0406, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: 72.73% (0.0110 => 0.0190, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 22.89% (0.0166 => 0.0204, std.dev.: 0.0025) SingleSource/UnitTests/byval-alignment: 23.53% (0.0255 => 0.0315, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.27% (0.1473 => 0.1469, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -1.52% (1.1607 => 1.1430, std.dev.: 0.0282) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -0.46% (0.1519 => 0.1512, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.17% (0.4051 => 0.3963, std.dev.: 0.0151) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.75% (0.1390 => 0.1456, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -13.19% (0.0675 => 0.0586, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -10.51% (0.0276 => 0.0247, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.46% (0.0561 => 0.0586, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.37% (1.1452 => 1.1410, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.77% (0.0031 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -70.37% (0.0027 => 0.0008, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.44% (0.0630 => 0.0602, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.00% (0.0267 => 0.0259, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.41% (0.7985 => 0.8018, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -7.14% (0.0042 => 0.0039, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.96% (2.1832 => 1.6602, std.dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 59.21% (1.5795 => 2.5147, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.48% (1.1857 => 1.2863, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.94% (0.3186 => 0.3439, std.dev.: 0.0063) MultiSource/Benchmarks/mafft/pairlocalalign: 5.92% (63.1822 => 66.9206, std.dev.: 0.0585) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.05% (41.4238 => 42.6862, std.dev.: 0.0538) SingleSource/Benchmarks/Misc/ReedSolomon: 2.50% (8.5322 => 8.7457, std.dev.: 0.0336) MultiSource/Applications/siod/siod: 2.47% (3.6643 => 3.7549, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.07% (2.4490 => 2.4996, std.dev.: 0.0075) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.96% (2.8773 => 2.9338, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/hash: 1.69% (0.6205 => 0.6310, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.26% (44.5605 => 45.1239, std.dev.: 0.0486) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.22% (4.8362 => 4.8952, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.14% (59.2638 => 59.9423, std.dev.: 0.1110) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -2.62% (4.5702 => 4.4504, std.dev.: 0.0408) MultiSource/Benchmarks/McCat/05-eks/eks: -2.52% (0.4397 => 0.4286, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -2.43% (1.2526 => 1.2221, std.dev.: 0.0101) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.59% (0.3269 => 0.3021, std.dev.: 0.0008) MultiSource/Applications/lua/lua: -5.23% (29.8330 => 28.2735, std.dev.: 0.0728) SingleSource/Benchmarks/Shootout-C++/hash2: -1.49% (3.4237 => 3.3728, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.24% (3.3479 => 3.3063, std.dev.: 0.0015) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.53% (16.4461 => 16.3584, std.dev.: 0.1820) MultiSource/Applications/obsequi/Obsequi: -0.14% (1.0262 => 1.0248, std.dev.: 0.0096) MultiSource/Applications/sqlite3/sqlite3: -1.11% (0.6332 => 0.6262, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/08-main/main: -1.42% (0.1831 => 0.1805, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.12% (0.1559 => 0.1592, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.67% (0.3123 => 0.3144, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.34% (0.2463 => 0.2430, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.03% (0.3344 => 0.3345, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.61% (0.2364 => 0.2326, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/bigfib: -1.18% (0.6010 => 0.5939, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel: 2.56% (0.0429 => 0.0440, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.49% (0.3266 => 0.3282, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/strcat: -1.37% (0.1969 => 0.1942, std.dev.: 0.0017) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -14.73% (0.0224 => 0.0191, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 66.67% (0.0123 => 0.0205, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.74% (0.0408 => 0.0411, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 25.20% (0.0254 => 0.0318, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.99% (0.0302 => 0.0299, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 5.73% (0.0384 => 0.0406, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0190 => 0.0190, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 13.33% (0.0180 => 0.0204, std.dev.: 0.0025) SingleSource/UnitTests/byval-alignment: 36.96% (0.0230 => 0.0315, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.16% (0.1438 => 0.1469, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.89% (1.1329 => 1.1430, std.dev.: 0.0282) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.42% (0.1462 => 0.1512, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.83% (0.4164 => 0.3963, std.dev.: 0.0151) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.36% (0.1369 => 0.1456, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.58% (0.0641 => 0.0586, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 26.67% (0.0195 => 0.0247, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.38% (0.0578 => 0.0586, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.24% (1.1437 => 1.1410, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -42.86% (0.0014 => 0.0008, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.99% (0.0627 => 0.0602, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 43.89% (0.0180 => 0.0259, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.01% (0.8017 => 0.8018, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -37.10% (0.0062 => 0.0039, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 19 13:14:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 19 Oct 2012 15:14:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121019201407.844712A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5013?compare_to=5010&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5013, Order: 166293, Start Time: 2012-10-19 18:51:08, End Time: 2012-10-19 20:17:05 To: 5010, Order: 166285, Start Time: 2012-10-19 16:55:44, End Time: 2012-10-19 18:21:36 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (187 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1041 (677 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.59% (54.9371 => 56.3615, std.dev.: 0.1082) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.36% (2.0176 => 2.5090, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.37% (0.1410 => 0.1669, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 17.80% (0.0826 => 0.0973, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 16.63% (0.2243 => 0.2616, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.47% (0.1327 => 0.1519, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 13.92% (0.1013 => 0.1154, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.43% (0.0834 => 0.0946, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.31% (0.1413 => 0.1601, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 13.17% (0.7038 => 0.7965, std.dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.15% (0.1072 => 0.1213, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 12.89% (0.4328 => 0.4886, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.83% (0.2721 => 0.3070, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.67% (3.9660 => 4.4686, std.dev.: 0.0070) MultiSource/Applications/hbd/hbd: 12.63% (1.3693 => 1.5423, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.59% (0.1588 => 0.1788) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.55% (0.0964 => 0.1085, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 12.51% (0.4062 => 0.4570, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.30% (0.7710 => 0.8658, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.17% (0.2596 => 0.2912, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.11% (0.6283 => 0.7044, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 12.04% (13.8202 => 15.4840, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.87% (1.4563 => 1.6291, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.85% (0.9199 => 1.0289, std.dev.: 0.0072) SingleSource/UnitTests/ObjC++/property-reference-object: 11.83% (0.5818 => 0.6506, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.81% (0.6959 => 0.7781, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: 11.67% (0.1003 => 0.1120, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 11.60% (0.5748 => 0.6415, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 11.49% (0.1062 => 0.1184, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.43% (0.5265 => 0.5867, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.40% (0.4791 => 0.5337, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 11.29% (0.7061 => 0.7858, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.24% (1.2193 => 1.3563, std.dev.: 0.0054) MultiSource/Applications/lemon/lemon: 11.18% (1.0313 => 1.1466, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.05% (0.3899 => 0.4330, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 11.03% (0.1986 => 0.2205, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.03% (1.1364 => 1.2617, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.02% (0.3130 => 0.3475, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 11.00% (0.2781 => 0.3087, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.98% (0.1157 => 0.1284, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.85% (0.3485 => 0.3863, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 10.79% (1.1061 => 1.2255, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.78% (0.5577 => 0.6178, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.75% (0.3580 => 0.3965, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 10.74% (0.6744 => 0.7468, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.71% (0.4016 => 0.4446, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.62% (0.3756 => 0.4155, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.55% (0.4390 => 0.4853, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 10.53% (16.6129 => 18.3624, std.dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/lists: 10.48% (0.3293 => 0.3638, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.46% (0.3489 => 0.3854, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.39% (0.1569 => 0.1732, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.39% (0.2782 => 0.3071, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.32% (0.3246 => 0.3581, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.28% (0.2966 => 0.3271, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.26% (0.3022 => 0.3332, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.26% (0.8698 => 0.9590, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.25% (0.4379 => 0.4828, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 10.22% (0.2995 => 0.3301, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 10.21% (0.3868 => 0.4263, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 10.17% (0.1111 => 0.1224, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 10.17% (1.9270 => 2.1229, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 10.17% (0.3453 => 0.3804, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 10.15% (0.7506 => 0.8268, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.14% (0.1075 => 0.1184, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 10.08% (0.1478 => 0.1627, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 10.07% (0.1589 => 0.1749, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.07% (0.7460 => 0.8211, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 10.06% (3.1889 => 3.5097, std.dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C/football/football: 10.01% (0.8310 => 0.9142, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 10.00% (0.3149 => 0.3464, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/strcat: 9.98% (0.2726 => 0.2998, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 9.97% (3.8646 => 4.2500, std.dev.: 0.0022) MultiSource/Applications/siod/siod: 9.96% (2.1791 => 2.3962, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 9.96% (0.3534 => 0.3886, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.95% (0.2914 => 0.3204, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.94% (1.9828 => 2.1798, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 9.89% (0.2761 => 0.3034, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 9.88% (0.3220 => 0.3538, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.87% (0.1276 => 0.1402, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.87% (0.1865 => 0.2049, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 9.86% (0.2607 => 0.2864, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 9.86% (0.2760 => 0.3032, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 9.78% (0.2690 => 0.2953, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.76% (4.9865 => 5.4733, std.dev.: 0.0029) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.76% (0.1435 => 0.1575, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.76% (0.2655 => 0.2914, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.74% (0.5637 => 0.6186, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary: 9.72% (0.3107 => 0.3409, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.69% (0.2765 => 0.3033, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.64% (0.2023 => 0.2218, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 9.64% (0.2937 => 0.3220, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/ary2: 9.62% (0.3192 => 0.3499, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 9.59% (0.2628 => 0.2880, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 9.57% (0.2925 => 0.3205, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.47% (7.2180 => 7.9016, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.31% (0.2696 => 0.2947, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.31% (0.2127 => 0.2325, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 9.30% (0.2988 => 0.3266, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.13% (0.3755 => 0.4098, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 9.09% (1.0594 => 1.1557, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 9.03% (0.2945 => 0.3211, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.97% (3.6692 => 3.9985, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.94% (0.6576 => 0.7164, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.89% (1.3245 => 1.4422, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/em3d/em3d: 8.81% (0.1657 => 0.1803, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 8.67% (14.8535 => 16.1412, std.dev.: 0.0164) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.65% (4.4433 => 4.8276, std.dev.: 0.0089) MultiSource/Applications/SIBsim4/SIBsim4: 8.57% (1.2749 => 1.3842, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.56% (4.3801 => 4.7549, std.dev.: 0.0114) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.54% (0.3511 => 0.3811, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 8.44% (4.6629 => 5.0566, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/bigfib: 8.43% (0.6250 => 0.6777, std.dev.: 0.0015) MultiSource/Benchmarks/sim/sim: 8.34% (0.3131 => 0.3392, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.32% (1.5188 => 1.6452, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.27% (0.2140 => 0.2317, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.26% (0.6135 => 0.6642, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 8.22% (8.4961 => 9.1942, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.12% (0.8818 => 0.9534, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.99% (0.1789 => 0.1932, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.92% (3.2742 => 3.5334, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.80% (0.2321 => 0.2502, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.80% (2.1007 => 2.2645, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.80% (0.3245 => 0.3498, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.77% (0.9108 => 0.9816, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.72% (1.1333 => 1.2208, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.70% (0.4805 => 0.5175, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 7.67% (3.7467 => 4.0342, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 7.66% (0.4113 => 0.4428, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 7.48% (6.5754 => 7.0672, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.39% (0.2504 => 0.2689, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: 7.36% (0.1385 => 0.1487, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 7.24% (1.2292 => 1.3182, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 7.12% (0.2008 => 0.2151, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.76% (0.1819 => 0.1942, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.71% (13.2842 => 14.1752, std.dev.: 0.0163) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.70% (6.2785 => 6.6991, std.dev.: 0.0113) SingleSource/UnitTests/ObjC/parameter-passing: 6.69% (0.4003 => 0.4271, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions: 6.36% (0.3914 => 0.4163, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.27% (0.3650 => 0.3879, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 6.24% (0.3940 => 0.4186, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.20% (0.3789 => 0.4024, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 6.06% (0.3646 => 0.3867, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 6.04% (0.3578 => 0.3794, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 6.03% (0.3601 => 0.3818, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 5.98% (0.3663 => 0.3882, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 5.82% (0.3623 => 0.3834, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 5.53% (16.2614 => 17.1611, std.dev.: 0.0150) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.90% (0.2243 => 0.2353, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 4.42% (14.5298 => 15.1726, std.dev.: 0.0185) MultiSource/Benchmarks/Bullet/bullet: 2.43% (33.2944 => 34.1046, std.dev.: 0.0085) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.85% (0.4846 => 0.6971, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 30.62% (5.7573 => 7.5202, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/fbench: 25.61% (1.8175 => 2.2829, std.dev.: 0.0261) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.05% (1.0895 => 1.2753, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 11.19% (1.1560 => 1.2854, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4140, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.43% (0.9692 => 1.0218) SingleSource/Benchmarks/Misc/mandel-2: 5.22% (1.2998 => 1.3676, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0047, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 4.48% (0.5449 => 0.5693, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.46% (2.8606 => 2.9881, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.47% (10.7476 => 11.1207, std.dev.: 0.0209) SingleSource/Benchmarks/Misc/flops-6: 3.39% (1.9199 => 1.9850, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 3.37% (12.0921 => 12.4994, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 3.22% (11.2619 => 11.6249, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bisort/bisort: 3.12% (0.8239 => 0.8496, std.dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0310 => 1.0559, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.14% (7.4271 => 7.5863, std.dev.: 0.0068) MultiSource/Applications/lemon/lemon: 1.76% (1.4298 => 1.4550, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5126, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.38% (1.9433 => 1.9701, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2123, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.25% (9.0760 => 9.1890, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5782, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.17% (9.9194 => 10.0351, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 1.14% (3.1071 => 3.1425, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists: 1.10% (12.4560 => 12.5932, std.dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.74% (0.2670 => 0.1422, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.75% (0.4657 => 0.3877, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.46% (1.3819 => 1.1959, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.46% (1.3813 => 1.1954, std.dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.27% (1.0460 => 0.8549, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -13.00% (0.2238 => 0.1947, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.13% (20.3410 => 18.2806, std.dev.: 0.0064) SingleSource/Benchmarks/McGill/chomp: -6.72% (1.2308 => 1.1481, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.28% (1.3780 => 1.3052, std.dev.: 0.0092) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5144, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.69% (0.9996 => 0.9527, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.93% (1.7688 => 1.6992, std.dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.25% (0.4867 => 0.4709, std.dev.: 0.0048) MultiSource/Applications/siod/siod: -2.87% (3.2729 => 3.1790, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: -2.80% (3.0263 => 2.9415, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -2.71% (1.9762 => 1.9226, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8813, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.44% (4.1080 => 4.0078, std.dev.: 0.0047) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.00% (0.6589 => 0.6457, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.87% (0.6615 => 0.6491, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.76% (6.3560 => 6.2440, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.65% (0.8342 => 0.8204, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -1.64% (26.5159 => 26.0806, std.dev.: 0.0369) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.60% (2.5254 => 2.4850, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0074, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.39% (3.9173 => 3.8627, std.dev.: 0.0086) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (5.3167 => 5.2502, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: -1.24% (28.2225 => 27.8724, std.dev.: 0.0023) MultiSource/Applications/aha/aha: -1.08% (3.1476 => 3.1137, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -1.05% (84.4286 => 83.5398, std.dev.: 0.0076) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.03% (6.6320 => 6.5637, std.dev.: 0.0082) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 19 14:03:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 19 Oct 2012 16:03:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121019210344.4D32B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5014?compare_to=5011&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5014, Order: 166296, Start Time: 2012-10-19 19:45:15, End Time: 2012-10-19 21:05:41 To: 5011, Order: 166288, Start Time: 2012-10-19 17:55:23, End Time: 2012-10-19 19:15:38 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (76 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (182 on baseline) Performance Improvements: 0 (44 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 91 (15 on baseline) Unchanged Tests: 950 (659 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.26% (15.5539 => 15.7496, std.dev.: 0.0025) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.33% (0.6135 => 0.6115, std.dev.: 0.0039) MultiSource/Applications/SPASS/SPASS: -0.05% (17.1598 => 17.1512, std.dev.: 0.0155) MultiSource/Benchmarks/Bullet/bullet: 0.11% (56.3181 => 56.3813, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/gs/gs: -0.07% (4.5154 => 4.5122, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0461 => 0.0461) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.43% (0.0462 => 0.0464, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0431 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0432 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0420 => 0.0420, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0422 => 0.0422, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0415 => 0.0415) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.24% (0.0415 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.23% (0.0432 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.23% (0.0433 => 0.0434) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0427 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.23% (0.0427 => 0.0428, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0416 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.24% (0.0417 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.24% (0.0423 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0425 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.23% (0.0434 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.23% (0.0436 => 0.0437, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0412 => 0.0412, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0413 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0424 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0425 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0415 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.24% (0.0416 => 0.0417, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.25% (0.0407 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0408 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0406 => 0.0406, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0408 => 0.0408, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0443 => 0.0443) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.23% (0.0443 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0405 => 0.0405, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.25% (0.0405 => 0.0406, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0406 => 0.0406) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.49% (0.0406 => 0.0408) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0414 => 0.0414, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.24% (0.0414 => 0.0415, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.02% (1.2896 => 1.2894, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.18% (8.2277 => 8.2129, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.12% (0.7753 => 0.7744, std.dev.: 0.0047) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.28% (0.0356 => 0.0355, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 0.06% (0.1647 => 0.1648, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.20% (0.2161 => 0.2135, std.dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: -0.05% (10.0329 => 10.0276, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -10.85% (63.2438 => 56.3813, std.dev.: 0.0073) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 0.55% (0.1639 => 0.1648, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 4.85% (9.5636 => 10.0276, std.dev.: 0.0032) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 35.74% (14.1553 => 19.2140, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.90% (3.4629 => 5.7797, std.dev.: 0.0279) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13408.89% (0.0720 => 9.7264, std.dev.: 0.0145) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049900.00% (0.0001 => 10.0500, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 62.61% (0.2554 => 0.4153, std.dev.: 0.0008) SingleSource/Regression/C/matrixTranspose: 57.55% (0.0245 => 0.0386) SingleSource/Benchmarks/Misc/lowercase: 52.34% (0.0256 => 0.0390, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 51.92% (10.3673 => 15.7496, std.dev.: 0.0025) SingleSource/UnitTests/SignlessTypes/factor: 41.89% (0.0296 => 0.0420) SingleSource/Benchmarks/Misc/richards_benchmark: 39.33% (0.1622 => 0.2260, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 35.89% (0.1056 => 0.1435, std.dev.: 0.0003) SingleSource/UnitTests/vla: 29.30% (0.0355 => 0.0459, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/ReedSolomon: 23.13% (0.2049 => 0.2523, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.84% (0.1236 => 0.1506, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 21.46% (0.0834 => 0.1013, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.63% (0.1566 => 0.1889, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 19.61% (0.0719 => 0.0860, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 19.27% (0.1432 => 0.1708, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.94% (2.2022 => 2.6192, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 18.88% (0.1584 => 0.1883, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.03% (7.0540 => 8.3258, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.26% (0.5105 => 0.5986, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.99% (0.0871 => 0.1019, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 16.84% (0.6675 => 0.7799, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 15.57% (0.3282 => 0.3793, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 15.57% (3.3354 => 3.8547, std.dev.: 0.0147) SingleSource/Benchmarks/McGill/chomp: 15.47% (0.1655 => 0.1911, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.08% (1.3050 => 1.5018, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.84% (0.5020 => 0.5765, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 14.53% (0.7115 => 0.8149, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.47% (1.5415 => 1.7646, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/power/power: 14.38% (0.1440 => 0.1647) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.24% (0.1032 => 0.1179, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 14.18% (0.2271 => 0.2593, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 14.15% (10.4361 => 11.9128, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.11% (1.7609 => 2.0094, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.44% (0.1510 => 0.1713, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.37% (0.0838 => 0.0950, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 13.25% (9.4845 => 10.7411, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout/matrix: 13.20% (0.0818 => 0.0926, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 13.10% (0.1695 => 0.1917, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 13.09% (0.3109 => 0.3516, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/18-imp/imp: 13.09% (0.3423 => 0.3871, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.83% (4.2646 => 4.8118, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.74% (0.1695 => 0.1911, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.74% (0.4615 => 0.5203, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 12.69% (5.7591 => 6.4898, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/tsp/tsp: 12.68% (0.1175 => 0.1324, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/exptree: 12.53% (0.0814 => 0.0916, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 12.48% (0.1555 => 0.1749, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 12.37% (0.6450 => 0.7248, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 12.32% (1.0722 => 1.2043, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.22% (0.0933 => 0.1047, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.22% (0.3307 => 0.3711, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 12.22% (8.1363 => 9.1302, std.dev.: 0.0035) MultiSource/Applications/Burg/burg: 12.21% (1.1642 => 1.3064, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/mst/mst: 12.21% (0.1163 => 0.1305, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 12.20% (1.1840 => 1.3285, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 12.16% (0.7433 => 0.8337, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 12.08% (0.0886 => 0.0993, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.04% (0.1337 => 0.1498, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 12.03% (2.0273 => 2.2712, std.dev.: 0.0053) MultiSource/Applications/aha/aha: 11.99% (0.1151 => 0.1289, std.dev.: 0.0020) MultiSource/Applications/spiff/spiff: 11.97% (0.7835 => 0.8773, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/neural/neural: 11.96% (0.1463 => 0.1638, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.96% (0.9765 => 1.0933, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.96% (0.1940 => 0.2172, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 11.87% (0.3387 => 0.3789, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.74% (0.2700 => 0.3017, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.72% (0.5860 => 0.6547, std.dev.: 0.0038) MultiSource/Applications/lua/lua: 11.64% (3.8723 => 4.3230, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.63% (0.1625 => 0.1814, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.54% (5.0018 => 5.5791, std.dev.: 0.0073) SingleSource/UnitTests/SignlessTypes/rem: 11.54% (0.1144 => 0.1276, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.49% (4.9449 => 5.5131, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.40% (0.1438 => 0.1602, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.37% (0.8172 => 0.9101, std.dev.: 0.0044) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.33% (7.9617 => 8.8641, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.31% (1.5859 => 1.7652, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.30% (0.0929 => 0.1034, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.25% (0.2107 => 0.2344, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.20% (1.1861 => 1.3190, std.dev.: 0.0042) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.20% (0.1125 => 0.1251, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 11.14% (0.8921 => 0.9915, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.11% (0.4879 => 0.5421, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.05% (0.1330 => 0.1477, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.05% (0.3177 => 0.3528, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.02% (0.3121 => 0.3465, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.96% (0.8067 => 0.8951, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.88% (0.2758 => 0.3058, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 10.73% (0.6456 => 0.7149, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.70% (2.2024 => 2.4380, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.65% (0.1906 => 0.2109, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 10.54% (0.4299 => 0.4752, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.50% (0.1029 => 0.1137, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.47% (0.1117 => 0.1234, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.45% (1.4186 => 1.5668, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.36% (0.1062 => 0.1172, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.19% (0.2266 => 0.2497, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.18% (0.5569 => 0.6136, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-4: 10.08% (0.3543 => 0.3900, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.05% (0.3473 => 0.3822, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 10.01% (2.2969 => 2.5268, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.96% (0.3543 => 0.3896, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 9.96% (0.3927 => 0.4318, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 9.95% (0.2603 => 0.2862, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 9.91% (0.3561 => 0.3914, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.91% (0.3694 => 0.4060, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.90% (0.3516 => 0.3864, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.89% (0.3497 => 0.3843, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.87% (0.3828 => 0.4206, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 9.87% (21.9371 => 24.1029, std.dev.: 0.0362) MultiSource/Applications/hbd/hbd: 9.83% (1.5603 => 1.7137, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.79% (0.3441 => 0.3778, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 9.78% (0.3886 => 0.4266, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 9.69% (0.3180 => 0.3488, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 9.64% (0.3092 => 0.3390, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 9.55% (0.4620 => 0.5061, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 9.46% (0.1268 => 0.1388, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 9.42% (0.4289 => 0.4693, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.39% (0.2065 => 0.2259, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.17% (0.3826 => 0.4177, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.01% (0.5981 => 0.6520, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 8.97% (0.3422 => 0.3729, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.92% (0.4203 => 0.4578, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.90% (0.3865 => 0.4209, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.62% (0.6030 => 0.6550, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.54% (0.4636 => 0.5032, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/Hello: 8.52% (0.5925 => 0.6430, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 8.39% (0.3684 => 0.3993, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 8.30% (0.4048 => 0.4384, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.23% (0.3427 => 0.3709, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.21% (0.4103 => 0.4440, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 8.04% (0.7326 => 0.7915, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.93% (0.1892 => 0.2042, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 7.76% (17.1811 => 18.5137, std.dev.: 0.0201) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3603 => 0.3880, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.59% (0.3650 => 0.3927, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.55% (0.8101 => 0.8713, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.32% (14.3668 => 15.4185, std.dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.06% (3.8922 => 4.1671, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.02% (0.3136 => 0.3356, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.01% (0.4064 => 0.4349, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.78% (0.3098 => 0.3308, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.71% (0.2891 => 0.3085, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.70% (0.3162 => 0.3374, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 6.68% (0.3232 => 0.3448, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.67% (0.3283 => 0.3502, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 6.64% (0.2905 => 0.3098, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.64% (0.2831 => 0.3019, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.58% (2.0665 => 2.2024, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.27% (0.2872 => 0.3052, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.19% (0.2793 => 0.2966, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/methcall: 6.19% (0.2877 => 0.3055, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.19% (0.3379 => 0.3588, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 6.13% (0.2871 => 0.3047, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.02% (0.2756 => 0.2922, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 5.91% (0.2725 => 0.2886, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 5.90% (0.3052 => 0.3232, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.86% (0.2714 => 0.2873, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 5.75% (0.2802 => 0.2963, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 5.68% (1.2842 => 1.3572, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.64% (0.2430 => 0.2567, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 5.27% (0.3131 => 0.3296, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.20% (1.1194 => 1.1552, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.54% (0.3935 => 0.4035, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 11.30% (0.9957 => 1.1082, std.dev.: 0.0130) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.85% (1.1396 => 1.2518, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3691, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/bh/bh: 5.93% (1.9405 => 2.0555, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.75% (0.4162 => 0.4318, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.66% (4.2280 => 4.3404, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7652, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.20% (1.0313 => 1.0540, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bisort/bisort: 1.93% (0.8333 => 0.8494, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.86% (3.6395 => 3.7071, std.dev.: 0.0041) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2076, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.36% (2.6546 => 2.6908, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.02% (6.6874 => 0.1322, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -79.93% (0.8651 => 0.1736, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.86% (5.2763 => 3.2258, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.03% (5.3855 => 3.7145, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.67% (5.3526 => 3.7109, std.dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -14.59% (54.1659 => 46.2640, std.dev.: 0.0210) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.22% (2.9384 => 2.6381, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -6.98% (22.1758 => 20.6290, std.dev.: 0.0280) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.07% (8.0499 => 3.7775, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -33.44% (1.1492 => 0.7649, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -16.14% (1.6925 => 1.4193, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.61% (1.2373 => 1.0937, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3453 => 2.9599, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -10.84% (1.5373 => 1.3706, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.27% (19.9488 => 18.2982, std.dev.: 0.0093) MultiSource/Benchmarks/FreeBench/mason/mason: -8.01% (0.2161 => 0.1988, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.12% (1.6805 => 1.5608, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.94% (1.8329 => 1.7057, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.85% (1.5835 => 1.5067, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.41% (8.1563 => 7.7962, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Applications/siod/siod: -3.61% (3.2827 => 3.1641, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8776, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5048, std.dev.: 0.0023) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.89% (0.4808 => 0.4669, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Applications/sqlite3/sqlite3: -2.03% (4.6441 => 4.5498, std.dev.: 0.0140) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0867, std.dev.: 0.0136) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6825, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.65% (2.5528 => 2.5107, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2878, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8584, std.dev.: 0.0108) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 16.94% (0.5229 => 0.6115, std.dev.: 0.0039) MultiSource/Applications/SPASS/SPASS: 14.42% (14.9895 => 17.1512, std.dev.: 0.0155) MultiSource/Benchmarks/MallocBench/gs/gs: 9.77% (4.1105 => 4.5122, std.dev.: 0.0199) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 16.71% (1.1048 => 1.2894, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.73% (7.1582 => 8.2129, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.46% (0.6222 => 0.7744, std.dev.: 0.0047) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35400.00% (0.0001 => 0.0355, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.90% (0.2116 => 0.2135, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 19 14:15:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 19 Oct 2012 16:15:33 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121019211533.224492A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5015?compare_to=5012&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5015, Order: 166296, Start Time: 2012-10-19 19:53:14, End Time: 2012-10-19 21:17:34 To: 5012, Order: 166290, Start Time: 2012-10-19 18:13:16, End Time: 2012-10-19 19:36:23 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 21 (18 on baseline) Performance Improvements: 2 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 952 (952 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/12-IOtest/iotest: 18.30% (0.0705 => 0.0834, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.64% (0.7655 => 0.8240, std.dev.: 0.0127) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.18% (1.0952 => 1.1629, std.dev.: 0.0215) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.56% (0.2177 => 0.2298, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.25% (0.2685 => 0.2826, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/oourafft: 5.17% (0.1993 => 0.2096, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.61% (0.2167 => 0.2267, std.dev.: 0.0030) MultiSource/Applications/siod/siod: 2.91% (2.1958 => 2.2597, std.dev.: 0.0137) MultiSource/Applications/hbd/hbd: 2.65% (1.4166 => 1.4542, std.dev.: 0.0058) MultiSource/Applications/spiff/spiff: 2.12% (0.7933 => 0.8101, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.99% (0.5177 => 0.5280, std.dev.: 0.0031) MultiSource/Applications/d/make_dparser: 1.75% (3.2250 => 3.2813, std.dev.: 0.0142) MultiSource/Applications/hexxagon/hexxagon: 1.53% (0.9719 => 0.9868, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.18% (1.4494 => 1.4665, std.dev.: 0.0028) MultiSource/Applications/ClamAV/clamscan: 1.08% (14.7334 => 14.8926, std.dev.: 0.0394) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 11.75% (3.7444 => 4.1845, std.dev.: 0.1198) SingleSource/Benchmarks/Shootout-C++/except: 4.18% (0.4878 => 0.5082, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/life/life: 2.97% (2.5594 => 2.6353, std.dev.: 0.0035) MultiSource/Benchmarks/Bullet/bullet: 2.11% (7.1076 => 7.2574, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.90% (6.9608 => 7.0932, std.dev.: 0.0200) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.10% (1.3805 => 1.3957, std.dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.51% (15.3427 => 14.4967, std.dev.: 0.2232) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.05% (2.9338 => 2.8737, std.dev.: 0.0074) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.57% (16.3584 => 16.4509, std.dev.: 0.1811) MultiSource/Applications/obsequi/Obsequi: -0.11% (1.0248 => 1.0237, std.dev.: 0.0118) MultiSource/Applications/sqlite3/sqlite3: 1.13% (0.6262 => 0.6333, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: 4.99% (0.1805 => 0.1895, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.71% (0.1592 => 0.1651, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.61% (0.3144 => 0.3226, std.dev.: 0.0105) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.77% (0.2430 => 0.2473, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.03% (0.3345 => 0.3346, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.05% (0.2326 => 0.2397, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 1.25% (0.5939 => 0.6013, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -9.77% (0.0440 => 0.0397, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.22% (0.3282 => 0.3322, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/strcat: 1.85% (0.1942 => 0.1978, std.dev.: 0.0017) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 15.71% (0.0191 => 0.0221, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.90% (0.0205 => 0.0197, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0411 => 0.0411, std.dev.: 0.0068) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -24.53% (0.0318 => 0.0240, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.67% (0.0299 => 0.0304, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.46% (0.0406 => 0.0396, std.dev.: 0.0053) SingleSource/UnitTests/Vector/Altivec/casts: 1.05% (0.0190 => 0.0192, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -41.18% (0.0204 => 0.0120, std.dev.: 0.0038) SingleSource/UnitTests/byval-alignment: -10.16% (0.0315 => 0.0283, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.36% (0.1469 => 0.1489, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 2.69% (1.1430 => 1.1737, std.dev.: 0.0382) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -2.12% (0.1512 => 0.1480, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 7.32% (0.3963 => 0.4253, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.26% (0.1456 => 0.1394, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.34% (0.0586 => 0.0588, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 10.53% (0.0247 => 0.0273, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.63% (0.0586 => 0.0553, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.51% (1.1410 => 1.1468, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -87.50% (0.0008 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.81% (0.0602 => 0.0567, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.31% (0.0259 => 0.0209, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.14% (0.8018 => 0.8029, std.dev.: 0.0126) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 5.13% (0.0039 => 0.0041, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.90% (2.1832 => 1.6615, std.dev.: 0.0045) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.91% (1.4269 => 1.4542, std.dev.: 0.0058) MultiSource/Applications/spiff/spiff: 1.90% (0.7950 => 0.8101, std.dev.: 0.0036) MultiSource/Applications/siod/siod: 1.86% (2.2184 => 2.2597, std.dev.: 0.0137) MultiSource/Applications/d/make_dparser: 1.38% (3.2366 => 3.2813, std.dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.34% (0.8340 => 0.8452, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.28% (1.4479 => 1.4665, std.dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.86% (0.3186 => 0.3532, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.10% (1.1857 => 1.2818, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 7.47% (2.2485 => 2.4165, std.dev.: 0.0497) MultiSource/Benchmarks/mafft/pairlocalalign: 6.03% (63.1822 => 66.9894, std.dev.: 0.0893) SingleSource/Benchmarks/Shootout-C++/except: 3.27% (0.4921 => 0.5082, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/ReedSolomon: 2.95% (8.5322 => 8.7842, std.dev.: 0.0257) MultiSource/Applications/siod/siod: 2.66% (3.6643 => 3.7617, std.dev.: 0.0371) SingleSource/Benchmarks/Dhrystone/dry: 2.01% (0.5081 => 0.5183, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 1.96% (7.1181 => 7.2574, std.dev.: 0.0184) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.17% (1.5941 => 1.6127, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.10% (4.8362 => 4.8896, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/flops-6: 1.01% (2.4416 => 2.4662, std.dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.59% (0.3269 => 0.3021, std.dev.: 0.0023) MultiSource/Applications/lua/lua: -4.95% (29.8330 => 28.3552, std.dev.: 0.1860) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -1.66% (7.2130 => 7.0932, std.dev.: 0.0200) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.16% (3.3479 => 3.3089, std.dev.: 0.0017) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.03% (16.4461 => 16.4509, std.dev.: 0.1811) MultiSource/Applications/obsequi/Obsequi: -0.24% (1.0262 => 1.0237, std.dev.: 0.0118) MultiSource/Applications/sqlite3/sqlite3: 0.02% (0.6332 => 0.6333, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: 3.50% (0.1831 => 0.1895, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.90% (0.1559 => 0.1651, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.30% (0.3123 => 0.3226, std.dev.: 0.0105) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.41% (0.2463 => 0.2473, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.06% (0.3344 => 0.3346, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.40% (0.2364 => 0.2397, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 0.05% (0.6010 => 0.6013, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -7.46% (0.0429 => 0.0397, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.71% (0.3266 => 0.3322, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/strcat: 0.46% (0.1969 => 0.1978, std.dev.: 0.0017) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.34% (0.0224 => 0.0221, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 60.16% (0.0123 => 0.0197, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.74% (0.0408 => 0.0411, std.dev.: 0.0068) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -5.51% (0.0254 => 0.0240, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.66% (0.0302 => 0.0304, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 3.13% (0.0384 => 0.0396, std.dev.: 0.0053) SingleSource/UnitTests/Vector/Altivec/casts: 1.05% (0.0190 => 0.0192, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -33.33% (0.0180 => 0.0120, std.dev.: 0.0038) SingleSource/UnitTests/byval-alignment: 23.04% (0.0230 => 0.0283, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 3.55% (0.1438 => 0.1489, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 3.60% (1.1329 => 1.1737, std.dev.: 0.0382) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.23% (0.1462 => 0.1480, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.14% (0.4164 => 0.4253, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.83% (0.1369 => 0.1394, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.27% (0.0641 => 0.0588, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 40.00% (0.0195 => 0.0273, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.33% (0.0578 => 0.0553, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.27% (1.1437 => 1.1468, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.57% (0.0627 => 0.0567, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 16.11% (0.0180 => 0.0209, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.15% (0.8017 => 0.8029, std.dev.: 0.0126) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -33.87% (0.0062 => 0.0041, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 19 15:09:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 19 Oct 2012 17:09:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121019220928.1EF092A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/5016?compare_to=5013&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5016, Order: 166296, Start Time: 2012-10-19 20:46:33, End Time: 2012-10-19 22:12:26 To: 5013, Order: 166293, Start Time: 2012-10-19 18:51:08, End Time: 2012-10-19 20:17:05 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (192 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1042 (673 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.00% (2.0176 => 2.5019, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.44% (0.1410 => 0.1670, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 17.43% (0.0826 => 0.0970, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 16.99% (0.2243 => 0.2624, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.23% (0.0653 => 0.0759, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.49% (0.1072 => 0.1238, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.94% (0.1327 => 0.1512, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 13.82% (0.1013 => 0.1153, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 13.55% (0.0834 => 0.0947, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.45% (0.1413 => 0.1603, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 13.37% (0.7038 => 0.7979, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.12% (0.0770 => 0.0871, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.66% (0.0964 => 0.1086, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.64% (0.2721 => 0.3065, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.60% (3.9660 => 4.4656, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: 12.55% (1.3693 => 1.5411, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash2: 12.48% (0.4328 => 0.4868, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.47% (0.6959 => 0.7827, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.41% (0.1588 => 0.1785, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.37% (0.2596 => 0.2917, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.32% (0.7710 => 0.8660, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash: 12.26% (0.4062 => 0.4560, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 12.19% (0.1075 => 0.1206, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.10% (0.6283 => 0.7043, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 12.04% (13.8202 => 15.4848, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.02% (1.4563 => 1.6313, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.98% (0.9199 => 1.0301, std.dev.: 0.0054) MultiSource/Applications/aha/aha: 11.86% (0.1062 => 0.1188, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 11.86% (0.1003 => 0.1122, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 11.79% (0.5818 => 0.6504, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.62% (0.5265 => 0.5877, std.dev.: 0.0036) MultiSource/Applications/lemon/lemon: 11.48% (1.0313 => 1.1497, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 11.41% (0.5748 => 0.6404, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.33% (0.4791 => 0.5334, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.32% (0.1157 => 0.1288, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.28% (0.3899 => 0.4339, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.25% (1.2193 => 1.3565, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.15% (0.3130 => 0.3479, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 11.02% (1.1061 => 1.2280, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 11.00% (0.7061 => 0.7838, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.99% (1.1364 => 1.2613, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 10.97% (0.5577 => 0.6189, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.84% (0.2914 => 0.3230, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.83% (0.1986 => 0.2201, std.dev.: 0.0022) MultiSource/Applications/minisat/minisat: 10.79% (0.6744 => 0.7472, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 10.74% (16.6129 => 18.3970, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.73% (0.3485 => 0.3859, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 10.72% (0.2781 => 0.3079, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.68% (0.4016 => 0.4445, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.60% (0.4379 => 0.4843, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.52% (0.4390 => 0.4852, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.49% (0.3756 => 0.4150, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.44% (0.0977 => 0.1079, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.42% (0.3580 => 0.3953, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.40% (0.3489 => 0.3852, std.dev.: 0.0039) MultiSource/Applications/spiff/spiff: 10.35% (0.7506 => 0.8283, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 10.35% (0.1111 => 0.1226, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.33% (0.1569 => 0.1731, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.32% (0.3022 => 0.3334, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.28% (0.2655 => 0.2928, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 10.25% (2.1791 => 2.4025, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 10.25% (0.2995 => 0.3302, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: 10.24% (1.9270 => 2.1243, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.23% (0.3246 => 0.3578, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 10.22% (0.3220 => 0.3549, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 10.20% (0.3293 => 0.3629, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 10.20% (0.1589 => 0.1751, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 10.19% (0.3868 => 0.4262, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.15% (0.8698 => 0.9581, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 10.15% (3.8646 => 4.2569, std.dev.: 0.0020) MultiSource/Applications/d/make_dparser: 10.12% (3.1889 => 3.5115, std.dev.: 0.0195) SingleSource/Benchmarks/Shootout-C++/sieve: 10.11% (0.3453 => 0.3802, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.06% (0.2782 => 0.3062, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.05% (0.2966 => 0.3264, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 10.02% (0.8310 => 0.9143, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.98% (4.9865 => 5.4841, std.dev.: 0.0039) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.97% (0.1435 => 0.1578, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.96% (0.1014 => 0.1115, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 9.95% (0.1478 => 0.1625, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.94% (0.2023 => 0.2224, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.93% (0.7460 => 0.8201, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.88% (0.5637 => 0.6194, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.87% (0.1276 => 0.1402, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 9.85% (0.2761 => 0.3033, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 9.83% (0.2726 => 0.2994, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.81% (0.1865 => 0.2048, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.77% (1.9828 => 2.1766, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 9.73% (0.3534 => 0.3878, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 9.71% (0.2925 => 0.3209, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 9.69% (0.3149 => 0.3454, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 9.67% (0.2690 => 0.2950, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 9.64% (0.2760 => 0.3026, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 9.64% (0.2937 => 0.3220, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 9.62% (0.3107 => 0.3406, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 9.59% (0.2607 => 0.2857, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.49% (7.2180 => 7.9027, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/ary2: 9.40% (0.3192 => 0.3492, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 9.36% (0.2628 => 0.2874, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.36% (0.2127 => 0.2326, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.29% (0.2765 => 0.3022, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.20% (0.2696 => 0.2944, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 9.17% (0.1657 => 0.1809, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 9.17% (0.2988 => 0.3262, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.11% (0.3755 => 0.4097, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 9.02% (1.0594 => 1.1550, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.93% (1.3245 => 1.4428, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.90% (3.6692 => 3.9958, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/objinst: 8.83% (0.2945 => 0.3205, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.76% (4.3801 => 4.7636, std.dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 8.63% (14.8535 => 16.1359, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.61% (0.6576 => 0.7142, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.60% (4.4433 => 4.8253, std.dev.: 0.0100) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.54% (0.3511 => 0.3811, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 8.50% (1.2749 => 1.3833, std.dev.: 0.0023) MultiSource/Benchmarks/sim/sim: 8.50% (0.3131 => 0.3397, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 8.48% (4.6629 => 5.0585, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.34% (1.5188 => 1.6454, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 8.32% (0.6250 => 0.6770, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 8.27% (8.4961 => 9.1987, std.dev.: 0.0057) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.22% (0.2140 => 0.2316, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.22% (0.6135 => 0.6639, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.15% (0.8818 => 0.9537, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.11% (0.1789 => 0.1934, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.06% (0.2321 => 0.2508, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.02% (3.2742 => 3.5367, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.01% (1.1333 => 1.2241, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 7.84% (3.7467 => 4.0405, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.84% (2.1007 => 2.2654, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.77% (0.9108 => 0.9816, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.77% (0.3245 => 0.3497, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.76% (0.4805 => 0.5178, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 7.61% (0.4113 => 0.4426, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 7.44% (6.5754 => 7.0646, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/neural/neural: 7.44% (0.1385 => 0.1488) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.35% (0.2504 => 0.2688, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.13% (1.2292 => 1.3168, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: 6.92% (0.2008 => 0.2147, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.76% (6.2785 => 6.7030, std.dev.: 0.0067) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.60% (0.1819 => 0.1939, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: 6.55% (0.4003 => 0.4265, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.53% (13.2842 => 14.1521, std.dev.: 0.0148) SingleSource/UnitTests/ObjC/exceptions: 6.29% (0.3914 => 0.4160, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.22% (0.3940 => 0.4185, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 5.94% (0.3789 => 0.4014, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 5.90% (0.3578 => 0.3789, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 5.87% (0.3646 => 0.3860, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 5.86% (0.3601 => 0.3812, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 5.84% (0.3663 => 0.3877, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 5.74% (0.3623 => 0.3831, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 5.73% (0.3650 => 0.3859, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 5.40% (16.2614 => 17.1395, std.dev.: 0.0214) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.17% (0.2243 => 0.2359, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 4.42% (14.5298 => 15.1713, std.dev.: 0.0115) MultiSource/Benchmarks/Bullet/bullet: 2.59% (33.2944 => 34.1555, std.dev.: 0.0090) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.71% (0.4846 => 0.6964, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 30.49% (5.7573 => 7.5127, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/fbench: 24.42% (1.8175 => 2.2613, std.dev.: 0.0537) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.10% (1.0895 => 1.2758, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 11.04% (1.1560 => 1.2836, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1916, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 9.02% (0.8273 => 0.9019, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436) SingleSource/Benchmarks/Shootout-C++/hash2: 7.56% (3.1736 => 3.4135, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.42% (0.9692 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 5.33% (1.2998 => 1.3691, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.87% (0.2093 => 0.2195, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.80% (0.3458 => 0.3624, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0041, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 4.46% (0.5449 => 0.5692, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.45% (2.8606 => 2.9880, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7747, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.71% (10.7476 => 11.1465, std.dev.: 0.0363) MultiSource/Applications/hexxagon/hexxagon: 3.38% (12.0921 => 12.5009, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 3.35% (1.9199 => 1.9843, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.23% (11.2619 => 11.6258, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/bisort/bisort: 2.97% (0.8239 => 0.8484, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0310 => 1.0560, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.11% (7.4271 => 7.5838, std.dev.: 0.0041) MultiSource/Applications/lemon/lemon: 1.65% (1.4298 => 1.4534, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std.dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.44% (8.3908 => 8.5117, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.28% (1.9433 => 1.9682, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1876, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 1.21% (5.5130 => 5.5796, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.17% (9.9194 => 10.0351, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 1.13% (12.4560 => 12.5972, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.82% (0.2670 => 0.1420, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.90% (0.4657 => 0.3870, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.52% (1.3819 => 1.1951, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.38% (1.3813 => 1.1965, std.dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.28% (1.0460 => 0.8548, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -12.96% (0.2238 => 0.1948, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.13% (20.3410 => 18.2801, std.dev.: 0.0116) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -5.89% (1.2308 => 1.1583, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.52% (1.3780 => 1.3019, std.dev.: 0.0096) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5137, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.36% (0.9996 => 0.9560, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.84% (1.7688 => 1.7009, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.02% (0.4867 => 0.4720, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -2.89% (3.2729 => 3.1784, std.dev.: 0.0036) MultiSource/Applications/spiff/spiff: -2.86% (3.0263 => 2.9396, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: -2.74% (1.9762 => 1.9220, std.dev.: 0.0042) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8812, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.32% (4.1080 => 4.0125, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.87% (0.6615 => 0.6491, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.74% (6.3560 => 6.2457, std.dev.: 0.0008) MultiSource/Applications/lua/lua: -1.73% (26.5159 => 26.0564, std.dev.: 0.0313) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.68% (0.8342 => 0.8202, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.63% (2.5254 => 2.4842, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0059, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -1.24% (28.2225 => 27.8729, std.dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2510, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/heapsort: -1.21% (3.9173 => 3.8698, std.dev.: 0.0049) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1139, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -1.05% (84.4286 => 83.5457, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 19 15:53:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 19 Oct 2012 17:53:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121019225339.159022A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5017?compare_to=5014&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5017, Order: 166316, Start Time: 2012-10-19 21:35:22, End Time: 2012-10-19 22:55:34 To: 5014, Order: 166296, Start Time: 2012-10-19 19:45:15, End Time: 2012-10-19 21:05:41 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (76 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (183 on baseline) Performance Improvements: 1 (44 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 91 (15 on baseline) Unchanged Tests: 949 (658 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.08% (1.5234 => 1.5399, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.65% (15.7496 => 15.3326, std.dev.: 0.0138) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.31% (0.6115 => 0.6134, std.dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: -0.16% (17.1512 => 17.1244, std.dev.: 0.0167) MultiSource/Benchmarks/Bullet/bullet: -0.60% (56.3813 => 56.0405, std.dev.: 0.0190) MultiSource/Benchmarks/MallocBench/gs/gs: -0.07% (4.5122 => 4.5092, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.22% (0.0461 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.43% (0.0464 => 0.0462, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.23% (0.0431 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0432 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.24% (0.0420 => 0.0419, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0422 => 0.0422, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.24% (0.0415 => 0.0414, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0416 => 0.0416) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.23% (0.0433 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.23% (0.0434 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.23% (0.0427 => 0.0426) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.23% (0.0428 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0416 => 0.0416) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0418 => 0.0418, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.24% (0.0424 => 0.0423) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0425 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.23% (0.0435 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.23% (0.0437 => 0.0436, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.24% (0.0412 => 0.0411, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0413 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.24% (0.0424 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0425 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.24% (0.0415 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.24% (0.0417 => 0.0416) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.25% (0.0408 => 0.0407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0408 => 0.0408) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.25% (0.0406 => 0.0405) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.25% (0.0408 => 0.0407) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.23% (0.0443 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.23% (0.0444 => 0.0443, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0405 => 0.0405) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0406 => 0.0406, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0406 => 0.0406) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.25% (0.0408 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.24% (0.0414 => 0.0413, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.24% (0.0415 => 0.0414, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.09% (1.2894 => 1.2905, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.11% (8.2129 => 8.2035, std.dev.: 0.0130) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.21% (0.7744 => 0.7728, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.85% (0.0355 => 0.0352, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -0.06% (0.1648 => 0.1647, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.22% (0.2135 => 0.2161, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 0.00% (10.0276 => 10.0277, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.39% (63.2438 => 56.0405, std.dev.: 0.0190) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 0.49% (0.1639 => 0.1647, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 4.85% (9.5636 => 10.0277, std.dev.: 0.0025) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 35.38% (14.1553 => 19.1629, std.dev.: 0.0271) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.68% (3.4629 => 5.7718, std.dev.: 0.0009) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13408.89% (0.0720 => 9.7264, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050600.00% (0.0001 => 10.0507, std.dev.: 0.0009) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 62.80% (0.2554 => 0.4158, std.dev.: 0.0001) SingleSource/Regression/C/matrixTranspose: 57.96% (0.0245 => 0.0387, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 52.34% (0.0256 => 0.0390, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 47.89% (10.3673 => 15.3326, std.dev.: 0.0138) SingleSource/UnitTests/SignlessTypes/factor: 41.89% (0.0296 => 0.0420, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 38.53% (0.1622 => 0.2247, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: 36.08% (0.1056 => 0.1437, std.dev.: 0.0000) SingleSource/UnitTests/vla: 29.86% (0.0355 => 0.0461, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: 23.77% (0.2049 => 0.2536, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 22.18% (0.0834 => 0.1019, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.68% (0.1236 => 0.1504, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.75% (0.1566 => 0.1891, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 19.75% (0.0719 => 0.0861, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 19.20% (0.1432 => 0.1707, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 19.19% (0.1584 => 0.1888, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.75% (2.2022 => 2.6152, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.89% (7.0540 => 8.3157, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.41% (0.5105 => 0.5994, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.34% (0.0871 => 0.1022, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.06% (0.6675 => 0.7814, std.dev.: 0.0017) MultiSource/Applications/d/make_dparser: 15.97% (3.3354 => 3.8680, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/chomp: 15.89% (0.1655 => 0.1918, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 15.57% (0.3282 => 0.3793, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.37% (1.3050 => 1.5056, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.10% (0.5020 => 0.5778, std.dev.: 0.0019) MultiSource/Applications/minisat/minisat: 14.73% (0.7115 => 0.8163, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.62% (1.5415 => 1.7669, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 14.57% (10.4361 => 11.9563, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.45% (1.7609 => 2.0153, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: 14.31% (0.1440 => 0.1646, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.24% (0.1032 => 0.1179, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 14.22% (0.2271 => 0.2594, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 13.81% (0.0746 => 0.0849, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 13.54% (0.3109 => 0.3530, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 13.50% (9.4845 => 10.7647, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.41% (0.0798 => 0.0905, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.38% (0.1510 => 0.1712, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.37% (0.0838 => 0.0950, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 13.35% (0.3423 => 0.3880, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/matrix: 13.33% (0.0818 => 0.0927, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 13.15% (5.7591 => 6.5167, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/em3d/em3d: 12.86% (0.1695 => 0.1913, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.82% (4.2646 => 4.8115, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.78% (0.4615 => 0.5205, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/exptree: 12.78% (0.0814 => 0.0918, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 12.62% (1.0722 => 1.2075, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 12.60% (0.1175 => 0.1323, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.57% (0.1337 => 0.1505, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 12.53% (1.1840 => 1.3323, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.43% (0.0933 => 0.1049, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.39% (0.1695 => 0.1905, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 12.34% (0.6450 => 0.7246, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 12.33% (8.1363 => 9.1397, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/mst/mst: 12.30% (0.1163 => 0.1306, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 12.24% (0.7433 => 0.8343, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: 12.24% (0.1463 => 0.1642, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 12.22% (0.3387 => 0.3801, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 12.22% (0.1555 => 0.1745, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 12.14% (2.0273 => 2.2734, std.dev.: 0.0081) MultiSource/Applications/Burg/burg: 12.00% (1.1642 => 1.3039, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.96% (0.1940 => 0.2172, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.91% (0.2107 => 0.2358, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 11.90% (0.1151 => 0.1288, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.87% (5.0018 => 5.5955, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 11.85% (0.0886 => 0.0991, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.83% (4.9449 => 5.5297, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.81% (0.5860 => 0.6552, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.80% (0.9765 => 1.0917, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.74% (0.2700 => 0.3017, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.73% (0.0929 => 0.1038, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 11.67% (3.8723 => 4.3241, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.64% (0.3307 => 0.3692, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.57% (0.1625 => 0.1813, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.56% (1.5859 => 1.7693, std.dev.: 0.0067) SingleSource/UnitTests/SignlessTypes/rem: 11.54% (0.1144 => 0.1276, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.52% (0.4879 => 0.5441, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 11.51% (0.8921 => 0.9948, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 11.47% (0.7835 => 0.8734, std.dev.: 0.0055) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.43% (7.9617 => 8.8719, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.43% (0.1330 => 0.1482, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.34% (0.1438 => 0.1601, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.31% (1.1861 => 1.3202, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.17% (0.3177 => 0.3532, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.12% (0.1906 => 0.2118, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.11% (0.8067 => 0.8963, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.05% (0.3121 => 0.3466, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.93% (0.1125 => 0.1248, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.90% (2.2024 => 2.4425, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.84% (0.8172 => 0.9058, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.80% (0.2758 => 0.3056, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 10.77% (0.4299 => 0.4762, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 10.67% (0.6456 => 0.7145, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.51% (1.4186 => 1.5677, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.50% (0.5569 => 0.6154, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.50% (0.1029 => 0.1137, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.38% (0.1117 => 0.1233, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.30% (0.3543 => 0.3908, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.26% (0.1062 => 0.1171, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.26% (0.2603 => 0.2870, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.19% (0.2266 => 0.2497, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 10.12% (0.3092 => 0.3405, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 10.01% (2.2969 => 2.5269, std.dev.: 0.0067) MultiSource/Applications/JM/lencod/lencod: 9.92% (21.9371 => 24.1122, std.dev.: 0.0156) SingleSource/UnitTests/ObjC/exceptions: 9.77% (0.3828 => 0.4202, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.77% (0.3543 => 0.3889, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 9.76% (0.3473 => 0.3812, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.70% (0.3927 => 0.4308, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.66% (0.3561 => 0.3905, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 9.65% (0.3180 => 0.3487, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.64% (0.3694 => 0.4050, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.64% (0.3497 => 0.3834, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 9.61% (1.5603 => 1.7102, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-3: 9.56% (0.3516 => 0.3852, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.50% (0.3441 => 0.3768, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.44% (0.3886 => 0.4253, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/health/health: 9.38% (0.1268 => 0.1387, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.30% (0.2065 => 0.2257, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 9.19% (0.4289 => 0.4683, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 9.18% (0.4620 => 0.5044, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.96% (0.5981 => 0.6517, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.91% (0.3826 => 0.4167, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.87% (0.4636 => 0.5047, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 8.68% (0.3422 => 0.3719, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.59% (0.4203 => 0.4564, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.54% (0.3865 => 0.4195, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.40% (0.1892 => 0.2051, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.37% (0.3427 => 0.3714, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/moments: 8.33% (0.4048 => 0.4385, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 8.23% (17.1811 => 18.5946, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/lists1: 8.09% (0.3684 => 0.3982, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.99% (0.4103 => 0.4431, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 7.78% (0.6030 => 0.6499, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.68% (0.5925 => 0.6380, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.64% (0.8101 => 0.8720, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.56% (14.3668 => 15.4523, std.dev.: 0.0246) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.52% (3.8922 => 4.1850, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: 7.44% (0.3603 => 0.3871, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.13% (0.7326 => 0.7848, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.01% (0.3650 => 0.3906, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.87% (0.4064 => 0.4343, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.65% (0.3098 => 0.3304, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.54% (0.3136 => 0.3341, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.51% (0.2905 => 0.3094, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 6.49% (0.3283 => 0.3496, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.48% (0.3162 => 0.3367, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 6.47% (0.3232 => 0.3441, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.46% (0.2831 => 0.3014, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.43% (0.2891 => 0.3077, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.18% (2.0665 => 2.1943, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.09% (0.2872 => 0.3047, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.09% (0.2725 => 0.2891, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/except: 6.03% (0.2871 => 0.3044, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.02% (0.2756 => 0.2922, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 6.00% (0.3052 => 0.3235, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary2: 5.95% (0.3379 => 0.3580, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 5.87% (0.2877 => 0.3046, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.87% (0.2793 => 0.2957, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.80% (0.2430 => 0.2571, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 5.64% (0.2714 => 0.2867, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 5.52% (1.2842 => 1.3551, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/random: 5.50% (0.2802 => 0.2956, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 4.79% (0.3131 => 0.3281, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.00% (1.1194 => 1.1530, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8962, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3124, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.55% (0.2944 => 0.3284, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 10.15% (0.9957 => 1.0968, std.dev.: 0.0173) SingleSource/Benchmarks/Misc/richards_benchmark: 9.82% (1.1396 => 1.2515, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.1578 => 3.3688, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: 5.91% (1.9405 => 2.0552, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.60% (4.2280 => 4.3379, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7655, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.14% (3.6395 => 3.7173, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bisort/bisort: 1.79% (0.8333 => 0.8482, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.63% (2.6546 => 2.6979, std.dev.: 0.0015) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2078, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.00% (6.6874 => 0.1338, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -79.91% (0.8651 => 0.1738, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.96% (5.2763 => 3.2204, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.02% (5.3855 => 3.7149, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.56% (5.3526 => 3.7166, std.dev.: 0.0073) SingleSource/UnitTests/Vector/constpool: -14.75% (54.1659 => 46.1765, std.dev.: 0.0387) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.28% (2.9384 => 2.6363, std.dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -6.82% (22.1758 => 20.6625, std.dev.: 0.0303) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.10% (8.0499 => 3.7751, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.34% (1.1492 => 0.7660, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.90% (1.6925 => 1.4234, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.53% (1.2373 => 1.0947, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3453 => 2.9600, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -10.82% (1.5373 => 1.3710, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.41% (19.9488 => 18.2715, std.dev.: 0.0117) MultiSource/Benchmarks/FreeBench/mason/mason: -7.77% (0.2161 => 0.1993, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.16% (1.6805 => 1.5601, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.96% (1.8329 => 1.7054, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5753, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.89% (1.5835 => 1.5061, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.43% (8.1563 => 7.7947, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Applications/siod/siod: -3.67% (3.2827 => 3.1623, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8776) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4982, std.dev.: 0.0047) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.37% (0.4808 => 0.4694, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Applications/sqlite3/sqlite3: -2.04% (4.6441 => 4.5493, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -1.80% (10.2830 => 10.0979, std.dev.: 0.0108) SingleSource/UnitTests/Vector/multiplies: -1.74% (2.5528 => 2.5085, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6827, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.22% (6.2999 => 6.2229, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.08% (2.3135 => 2.2884, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 17.31% (0.5229 => 0.6134, std.dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: 14.24% (14.9895 => 17.1244, std.dev.: 0.0167) MultiSource/Benchmarks/MallocBench/gs/gs: 9.70% (4.1105 => 4.5092, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 16.81% (1.1048 => 1.2905, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.60% (7.1582 => 8.2035, std.dev.: 0.0130) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.20% (0.6222 => 0.7728, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35100.00% (0.0001 => 0.0352, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.13% (0.2116 => 0.2161, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 19 15:57:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 19 Oct 2012 17:57:45 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121019225745.CE37E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5018?compare_to=5015&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5018, Order: 166318, Start Time: 2012-10-19 21:35:22, End Time: 2012-10-19 22:59:46 To: 5015, Order: 166296, Start Time: 2012-10-19 19:53:14, End Time: 2012-10-19 21:17:34 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 7 (15 on baseline) Performance Improvements: 1 (6 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 967 (953 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/ks/ks: 8.07% (0.1388 => 0.1500, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.28% (0.8164 => 0.8432, std.dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 22.43% (2.0287 => 2.4837, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/methcall: 9.39% (8.1892 => 8.9581, std.dev.: 0.0401) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.17% (2.7086 => 2.7675, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 2.13% (0.7682 => 0.7846, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.14% (6.3775 => 6.4503, std.dev.: 0.0178) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -6.22% (8.5618 => 8.0294, std.dev.: 0.1204) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.32% (16.4509 => 16.3982, std.dev.: 0.1607) MultiSource/Applications/obsequi/Obsequi: 1.63% (1.0237 => 1.0404, std.dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: -0.47% (0.6333 => 0.6303, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/08-main/main: -1.53% (0.1895 => 0.1866, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.36% (0.1651 => 0.1579, std.dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.15% (0.3226 => 0.3221, std.dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.32% (0.2473 => 0.2465, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.18% (0.3346 => 0.3273, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.13% (0.2397 => 0.2394, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: -0.98% (0.6013 => 0.5954, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/mandel: 7.56% (0.0397 => 0.0427, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: -1.44% (0.3322 => 0.3274, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/strcat: -0.40% (0.1978 => 0.1970, std.dev.: 0.0014) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -10.86% (0.0221 => 0.0197, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 3.55% (0.0197 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.24% (0.0411 => 0.0412, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.25% (0.0240 => 0.0315, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.32% (0.0304 => 0.0300, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 3.54% (0.0396 => 0.0410, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/casts: -0.52% (0.0192 => 0.0191) SingleSource/UnitTests/Vector/Altivec/test1: 70.00% (0.0120 => 0.0204, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 20.85% (0.0283 => 0.0342, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.47% (0.1489 => 0.1496, std.dev.: 0.0038) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -1.75% (1.1737 => 1.1532, std.dev.: 0.0635) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 2.23% (0.1480 => 0.1513, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.84% (0.4253 => 0.4047, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.15% (0.1394 => 0.1424, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.69% (0.0588 => 0.0645, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.47% (0.0273 => 0.0277, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.18% (0.0553 => 0.0554, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.07% (1.1468 => 1.1460, std.dev.: 0.0113) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2500.00% (0.0001 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.93% (0.0567 => 0.0629, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 19.14% (0.0209 => 0.0249, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.07% (0.8029 => 0.8023, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: -85.71% (0.0007 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 82.93% (0.0041 => 0.0075, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.18% (2.1832 => 1.6552, std.dev.: 0.0062) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.65% (0.8597 => 0.8825, std.dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 57.25% (1.5795 => 2.4837, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.48% (0.3186 => 0.3488, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.40% (1.1857 => 1.2853, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 5.94% (63.1822 => 66.9349, std.dev.: 0.0259) MultiSource/Benchmarks/FreeBench/distray/distray: 4.64% (0.2390 => 0.2501, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.28% (0.7597 => 0.7846, std.dev.: 0.0018) MultiSource/Applications/siod/siod: 2.93% (3.6643 => 3.7717, std.dev.: 0.0345) SingleSource/Benchmarks/Shootout-C++/hash: 2.71% (0.6205 => 0.6373, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.54% (2.4490 => 2.5112, std.dev.: 0.0177) SingleSource/Benchmarks/Shootout-C++/except: 2.36% (0.4921 => 0.5037, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/ReedSolomon: 2.28% (8.5322 => 8.7271, std.dev.: 0.0447) MultiSource/Benchmarks/Olden/bh/bh: 1.59% (2.3560 => 2.3935, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.15% (6.3772 => 6.4503, std.dev.: 0.0178) SingleSource/Benchmarks/Misc/whetstone: 1.05% (2.1224 => 2.1447, std.dev.: 0.0082) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.62% (8.4179 => 8.0294, std.dev.: 0.1204) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.47% (0.6943 => 0.6841, std.dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.56% (0.3269 => 0.3022, std.dev.: 0.0069) MultiSource/Applications/lua/lua: -4.90% (29.8330 => 28.3717, std.dev.: 0.1985) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.36% (7.2130 => 7.0430, std.dev.: 0.0420) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.25% (3.3479 => 3.3062, std.dev.: 0.0092) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.29% (16.4461 => 16.3982, std.dev.: 0.1607) MultiSource/Applications/obsequi/Obsequi: 1.38% (1.0262 => 1.0404, std.dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: -0.46% (0.6332 => 0.6303, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/08-main/main: 1.91% (0.1831 => 0.1866, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.28% (0.1559 => 0.1579, std.dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.14% (0.3123 => 0.3221, std.dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.08% (0.2463 => 0.2465, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.12% (0.3344 => 0.3273, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.27% (0.2364 => 0.2394, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: -0.93% (0.6010 => 0.5954, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/mandel: -0.47% (0.0429 => 0.0427, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.24% (0.3266 => 0.3274, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/strcat: 0.05% (0.1969 => 0.1970, std.dev.: 0.0014) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -12.05% (0.0224 => 0.0197, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 65.85% (0.0123 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.98% (0.0408 => 0.0412, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 24.02% (0.0254 => 0.0315, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.66% (0.0302 => 0.0300, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 6.77% (0.0384 => 0.0410, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/casts: 0.53% (0.0190 => 0.0191) SingleSource/UnitTests/Vector/Altivec/test1: 13.33% (0.0180 => 0.0204, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 48.70% (0.0230 => 0.0342, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 4.03% (0.1438 => 0.1496, std.dev.: 0.0038) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 1.79% (1.1329 => 1.1532, std.dev.: 0.0635) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.49% (0.1462 => 0.1513, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.81% (0.4164 => 0.4047, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.02% (0.1369 => 0.1424, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.62% (0.0641 => 0.0645, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.15% (0.0578 => 0.0554, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.20% (1.1437 => 1.1460, std.dev.: 0.0113) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.32% (0.0627 => 0.0629, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 38.33% (0.0180 => 0.0249, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.07% (0.8017 => 0.8023, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 20.97% (0.0062 => 0.0075, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 19 17:05:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 19 Oct 2012 19:05:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121020000517.E4EBF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5019?compare_to=5016&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5019, Order: 166342, Start Time: 2012-10-19 22:41:57, End Time: 2012-10-20 00:08:16 To: 5016, Order: 166296, Start Time: 2012-10-19 20:46:33, End Time: 2012-10-19 22:12:26 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (194 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1040 (671 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.55% (0.9537 => 0.9685, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.22% (78.2216 => 80.7400, std.dev.: 0.3941) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.20% (2.0176 => 2.5058, std.dev.: 0.0152) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.87% (0.1410 => 0.1676, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 17.43% (0.0826 => 0.0970, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 17.21% (0.2243 => 0.2629, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.08% (0.0653 => 0.0758, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 14.22% (0.1013 => 0.1157, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.03% (0.0834 => 0.0951, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.94% (0.1327 => 0.1512, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.77% (0.0770 => 0.0876, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.66% (0.1413 => 0.1606, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 13.48% (0.7038 => 0.7987, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 13.34% (0.2721 => 0.3084, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.29% (0.1588 => 0.1799, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.25% (0.1072 => 0.1214, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.11% (3.9660 => 4.4860, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.97% (0.0964 => 0.1089, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 12.81% (0.1062 => 0.1198, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.75% (0.6959 => 0.7846, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.70% (0.6283 => 0.7081, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 12.69% (1.3693 => 1.5431, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.66% (0.7710 => 0.8686, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 12.57% (0.4328 => 0.4872, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 12.53% (0.4062 => 0.4571, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.52% (0.2596 => 0.2921, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.51% (1.4563 => 1.6385, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.38% (0.9199 => 1.0338, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 12.35% (13.8202 => 15.5273, std.dev.: 0.0094) MultiSource/Benchmarks/Olden/power/power: 12.26% (0.1003 => 0.1126, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.17% (0.4791 => 0.5374, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.06% (0.5265 => 0.5900, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.99% (1.2193 => 1.3655, std.dev.: 0.0097) SingleSource/UnitTests/ObjC++/property-reference-object: 11.84% (0.5818 => 0.6507, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 11.70% (1.0313 => 1.1520, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 11.61% (0.7061 => 0.7881, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.60% (1.1364 => 1.2682, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.60% (0.3130 => 0.3493, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.41% (0.1157 => 0.1289, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.39% (0.2914 => 0.3246, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: 11.21% (1.1061 => 1.2301, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/Hello: 11.19% (0.5748 => 0.6391, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.15% (0.5577 => 0.6199, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.11% (0.3899 => 0.4332, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: 11.08% (0.1589 => 0.1765, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 11.05% (0.1276 => 0.1417, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 11.03% (0.1986 => 0.2205, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 10.98% (0.2995 => 0.3324, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 10.96% (0.6744 => 0.7483, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/football/football: 10.90% (0.8310 => 0.9216, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 10.77% (16.6129 => 18.4019, std.dev.: 0.0250) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.75% (0.3246 => 0.3595, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 10.74% (1.9270 => 2.1340, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.73% (0.4016 => 0.4447, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.73% (0.3485 => 0.3859, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 10.71% (0.1111 => 0.1230, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.71% (0.1569 => 0.1737, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.68% (0.3756 => 0.4157, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 10.64% (0.2781 => 0.3077, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.64% (0.4390 => 0.4857, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 10.62% (0.7506 => 0.8303, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.60% (0.1075 => 0.1189, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.60% (0.4379 => 0.4843, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.53% (0.8698 => 0.9614, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 10.47% (3.8646 => 4.2692, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.44% (0.0977 => 0.1079, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 10.44% (2.1791 => 2.4065, std.dev.: 0.0084) MultiSource/Applications/d/make_dparser: 10.43% (3.1889 => 3.5216, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 10.42% (0.3293 => 0.3636, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.40% (0.3489 => 0.3852, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 10.40% (0.3220 => 0.3555, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.38% (0.1435 => 0.1584, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 10.35% (0.1478 => 0.1631, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/moments: 10.32% (0.3868 => 0.4267, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.31% (0.7460 => 0.8229, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.29% (0.3022 => 0.3333, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.26% (0.1014 => 0.1118, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.22% (0.5637 => 0.6213, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.21% (0.2782 => 0.3066, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.20% (0.3580 => 0.3945, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.18% (0.2966 => 0.3268, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 10.14% (0.3453 => 0.3803, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.07% (4.9865 => 5.4884, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.03% (0.2023 => 0.2226, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.03% (0.1865 => 0.2052, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 9.99% (0.3534 => 0.3887, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 9.95% (0.2925 => 0.3216, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: 9.93% (0.2760 => 0.3034, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.87% (1.9828 => 2.1786, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 9.87% (0.2726 => 0.2995, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.83% (0.8818 => 0.9685, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.83% (0.2655 => 0.2916, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 9.81% (0.2690 => 0.2954, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.81% (7.2180 => 7.9259, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.74% (1.3245 => 1.4535, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.73% (0.2127 => 0.2334, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 9.72% (0.3149 => 0.3455, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 9.69% (0.3107 => 0.3408, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 9.63% (0.2761 => 0.3027, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 9.63% (0.2607 => 0.2858, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.61% (3.6692 => 4.0219, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wc: 9.57% (0.2937 => 0.3218, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.51% (0.3511 => 0.3845, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 9.47% (0.2628 => 0.2877, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 9.41% (0.1657 => 0.1813, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.40% (0.2765 => 0.3025, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 9.40% (0.3192 => 0.3492, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 9.36% (1.0594 => 1.1586, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.30% (4.3801 => 4.7875, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/matrix: 9.27% (0.2988 => 0.3265, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 9.25% (14.8535 => 16.2276, std.dev.: 0.0138) MultiSource/Applications/oggenc/oggenc: 9.19% (4.6629 => 5.0915, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.16% (0.2696 => 0.2943, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.14% (0.6576 => 0.7177, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.13% (4.4433 => 4.8489, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.08% (0.3755 => 0.4096, std.dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 9.02% (1.2749 => 1.3899, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: 8.97% (0.3131 => 0.3412, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 8.97% (8.4961 => 9.2579, std.dev.: 0.0147) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.90% (1.5188 => 1.6540, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 8.79% (0.2945 => 0.3204, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.77% (0.6135 => 0.6673, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.67% (0.9108 => 0.9898, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.66% (3.2742 => 3.5576, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/bigfib: 8.54% (0.6250 => 0.6784, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.49% (0.4805 => 0.5213, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/05-eks/eks: 8.46% (0.4113 => 0.4461, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.46% (0.2140 => 0.2321, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 8.32% (0.2008 => 0.2175, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.32% (0.2321 => 0.2514, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.31% (1.1333 => 1.2275, std.dev.: 0.0087) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.27% (0.1789 => 0.1937, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.18% (2.1007 => 2.2725, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.07% (0.3245 => 0.3507, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 7.95% (3.7467 => 4.0447, std.dev.: 0.0109) MultiSource/Applications/JM/ldecod/ldecod: 7.94% (6.5754 => 7.0973, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/neural/neural: 7.87% (0.1385 => 0.1494, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.83% (0.2504 => 0.2700, std.dev.: 0.0068) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.53% (0.1819 => 0.1956, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.26% (1.2292 => 1.3184, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 7.02% (0.4003 => 0.4284, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.97% (6.2785 => 6.7163, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.94% (13.2842 => 14.2064, std.dev.: 0.0172) SingleSource/UnitTests/ObjC/exceptions: 6.80% (0.3914 => 0.4180, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.73% (0.3940 => 0.4205, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.49% (0.3789 => 0.4035, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 6.48% (0.3578 => 0.3810, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.47% (0.3646 => 0.3882, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.47% (0.3663 => 0.3900, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 6.39% (0.3601 => 0.3831, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.27% (0.3623 => 0.3850, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.25% (0.3650 => 0.3878, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: 6.02% (0.1777 => 0.1884, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 5.66% (16.2614 => 17.1822, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.39% (0.2243 => 0.2364, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 4.82% (14.5298 => 15.2308, std.dev.: 0.0070) MultiSource/Benchmarks/Bullet/bullet: 2.21% (33.2944 => 34.0291, std.dev.: 0.0173) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5185, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: 24.44% (1.8175 => 2.2617, std.dev.: 0.0501) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.08% (1.0895 => 1.2756, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: 11.08% (1.1560 => 1.2841, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4146, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.43% (0.9692 => 1.0218) SingleSource/Benchmarks/Misc/mandel-2: 5.15% (1.2998 => 1.3667, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0049, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.46% (2.8606 => 2.9882, std.dev.: 0.0020) SingleSource/Regression/C/uint64_to_float: 4.44% (0.5449 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.88% (1.7081 => 1.7743, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.41% (10.7476 => 11.1143, std.dev.: 0.0465) MultiSource/Applications/hexxagon/hexxagon: 3.37% (12.0921 => 12.5000, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 3.33% (1.9199 => 1.9839, std.dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 3.22% (11.2619 => 11.6247, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/bisort/bisort: 2.96% (0.8239 => 0.8483, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.33% (1.0310 => 1.0550, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.11% (7.4271 => 7.5836, std.dev.: 0.0062) MultiSource/Applications/lemon/lemon: 1.85% (1.4298 => 1.4563, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.43% (8.3908 => 8.5111, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9685, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2123, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.22% (8.8259 => 8.9339, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1865, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5788, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.17% (9.9194 => 10.0354, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 1.03% (12.4560 => 12.5848, std.dev.: 0.0091) SingleSource/Benchmarks/McGill/queens: 1.01% (2.1753 => 2.1973, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.48% (0.2670 => 0.1429, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.45% (0.4657 => 0.3891, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.98% (1.3813 => 1.2020, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.79% (1.3819 => 1.2051, std.dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.28% (1.0460 => 0.8548, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -12.87% (0.2238 => 0.1950, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.13% (20.3410 => 18.2804, std.dev.: 0.0271) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.02% (1.2308 => 1.1567, std.dev.: 0.0083) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.97% (1.3780 => 1.2957, std.dev.: 0.0176) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.12% (2.6470 => 2.5116, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.60% (0.9996 => 0.9536, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.88% (1.7688 => 1.7002, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.16% (0.4867 => 0.4713, std.dev.: 0.0014) MultiSource/Applications/siod/siod: -2.89% (3.2729 => 3.1783, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: -2.86% (3.0263 => 2.9397, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: -2.83% (1.9762 => 1.9203, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8814, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.27% (4.1080 => 4.0146, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.99% (0.6589 => 0.6458, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.86% (0.6615 => 0.6492, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.77% (6.3560 => 6.2433, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.64% (0.8342 => 0.8205, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -1.63% (26.5159 => 26.0843, std.dev.: 0.0118) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.62% (2.5254 => 2.4845, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0079, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.35% (3.9173 => 3.8643, std.dev.: 0.0052) MultiSource/Benchmarks/mafft/pairlocalalign: -1.24% (28.2225 => 27.8725, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2508, std.dev.: 0.0016) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1139, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -1.05% (84.4286 => 83.5431, std.dev.: 0.0049) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 19 17:39:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 19 Oct 2012 19:39:32 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121020003932.7767B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5020?compare_to=5018&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5020, Order: 166348, Start Time: 2012-10-19 23:17:09, End Time: 2012-10-20 00:41:33 To: 5018, Order: 166318, Start Time: 2012-10-19 21:35:22, End Time: 2012-10-19 22:59:46 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 17 (29 on baseline) Performance Improvements: 1 (5 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 957 (940 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.28% (0.4808 => 0.5158, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.40% (0.8052 => 0.8487, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.66% (0.2943 => 0.3080, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.01% (0.9457 => 0.9836, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.96% (0.6029 => 0.6268, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.45% (1.3167 => 1.3621, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.27% (0.5810 => 0.6000, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.23% (0.7653 => 0.7900, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.50% (4.5265 => 4.6398, std.dev.: 0.0249) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.03% (1.4635 => 1.4932, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.02% (8.6137 => 8.7874, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.83% (1.2455 => 1.2683, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.75% (0.8264 => 0.8409, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.69% (1.2452 => 1.2663, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.66% (0.8051 => 0.8185, std.dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.50% (60.0053 => 60.9041, std.dev.: 0.2797) SingleSource/Benchmarks/Misc/ReedSolomon: 1.09% (8.7271 => 8.8224, std.dev.: 0.0222) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: -3.38% (0.7846 => 0.7581, std.dev.: 0.0063) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.94% (16.3982 => 16.5525, std.dev.: 0.2626) MultiSource/Applications/obsequi/Obsequi: 0.08% (1.0404 => 1.0412, std.dev.: 0.0208) MultiSource/Applications/sqlite3/sqlite3: 0.94% (0.6303 => 0.6362, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/08-main/main: 4.56% (0.1866 => 0.1951, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.43% (0.1579 => 0.1649, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.55% (0.3221 => 0.3171, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.24% (0.2465 => 0.2471, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.66% (0.3273 => 0.3360, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.71% (0.2394 => 0.2377, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: 0.55% (0.5954 => 0.5987, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: 1.64% (0.0427 => 0.0434, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.64% (0.3274 => 0.3295, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/strcat: 0.96% (0.1970 => 0.1989, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.61% (0.0197 => 0.0212, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 3.92% (0.0204 => 0.0212, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.70% (0.0412 => 0.0419, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 3.17% (0.0315 => 0.0325, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.00% (0.0300 => 0.0309, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.71% (0.0410 => 0.0417, std.dev.: 0.0046) SingleSource/UnitTests/Vector/Altivec/casts: 3.66% (0.0191 => 0.0198, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 4.90% (0.0204 => 0.0214, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -20.47% (0.0342 => 0.0272, std.dev.: 0.0038) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.94% (0.1496 => 0.1482, std.dev.: 0.0162) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -1.34% (1.1532 => 1.1378, std.dev.: 0.0469) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 0.59% (0.1513 => 0.1522, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.82% (0.4047 => 0.4161, std.dev.: 0.0264) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.21% (0.1424 => 0.1421, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.48% (0.0645 => 0.0661, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.72% (0.0277 => 0.0275, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 7.40% (0.0554 => 0.0595, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.27% (1.1460 => 1.1429, std.dev.: 0.0170) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 3.85% (0.0026 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.17% (0.0629 => 0.0565, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.62% (0.0249 => 0.0235, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.06% (0.8023 => 0.8028, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 10.67% (0.0075 => 0.0083, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.84% (2.1832 => 1.6627, std.dev.: 0.0176) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.70% (0.0810 => 0.0921, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.42% (0.4847 => 0.5158, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.72% (0.1905 => 0.2014, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.71% (0.7473 => 0.7900, std.dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.67% (0.3137 => 0.3315, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.52% (0.2279 => 0.2382, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.29% (0.6010 => 0.6268, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.25% (0.9435 => 0.9836, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.16% (0.8148 => 0.8487, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.77% (0.2998 => 0.3111, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.15% (0.5817 => 0.6000, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.13% (1.4479 => 1.4932, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.58% (1.3279 => 1.3621, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.21% (0.8597 => 0.8787, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.79% (0.8261 => 0.8409, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.66% (0.8611 => 0.8754, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.62% (8.6476 => 8.7874, std.dev.: 0.0123) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.52% (4.5702 => 4.6398, std.dev.: 0.0249) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.48% (0.8066 => 0.8185, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.34% (0.8007 => 0.8114, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.77% (1.5795 => 2.5078, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.98% (0.3186 => 0.3472, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.48% (1.1857 => 1.2863, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 5.93% (63.1822 => 66.9290, std.dev.: 0.0530) SingleSource/Benchmarks/Misc/ReedSolomon: 3.40% (8.5322 => 8.8224, std.dev.: 0.0222) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.18% (2.4490 => 2.5269, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.77% (59.2638 => 60.9041, std.dev.: 0.2797) MultiSource/Applications/siod/siod: 2.71% (3.6643 => 3.7635, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.82% (41.4238 => 42.1766, std.dev.: 0.2416) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.80% (0.3269 => 0.3014, std.dev.: 0.0006) MultiSource/Applications/lua/lua: -5.33% (29.8330 => 28.2443, std.dev.: 0.2643) SingleSource/Benchmarks/Shootout-C++/hash2: -1.53% (3.4237 => 3.3713, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.27% (3.3479 => 3.3055, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/ffbench: -1.07% (1.4296 => 1.4143, std.dev.: 0.0050) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.65% (16.4461 => 16.5525, std.dev.: 0.2626) MultiSource/Applications/obsequi/Obsequi: 1.46% (1.0262 => 1.0412, std.dev.: 0.0208) MultiSource/Applications/sqlite3/sqlite3: 0.47% (0.6332 => 0.6362, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/08-main/main: 6.55% (0.1831 => 0.1951, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.77% (0.1559 => 0.1649, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.54% (0.3123 => 0.3171, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.32% (0.2463 => 0.2471, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.48% (0.3344 => 0.3360, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.55% (0.2364 => 0.2377, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: -0.38% (0.6010 => 0.5987, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: 1.17% (0.0429 => 0.0434, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.89% (0.3266 => 0.3295, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/strcat: 1.02% (0.1969 => 0.1989, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -5.36% (0.0224 => 0.0212, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 72.36% (0.0123 => 0.0212, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.70% (0.0408 => 0.0419, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 27.95% (0.0254 => 0.0325, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.32% (0.0302 => 0.0309, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 8.59% (0.0384 => 0.0417, std.dev.: 0.0046) SingleSource/UnitTests/Vector/Altivec/casts: 4.21% (0.0190 => 0.0198, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 18.89% (0.0180 => 0.0214, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 18.26% (0.0230 => 0.0272, std.dev.: 0.0038) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 3.06% (0.1438 => 0.1482, std.dev.: 0.0162) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.43% (1.1329 => 1.1378, std.dev.: 0.0469) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 4.10% (0.1462 => 0.1522, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.07% (0.4164 => 0.4161, std.dev.: 0.0264) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.80% (0.1369 => 0.1421, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.12% (0.0641 => 0.0661, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.03% (0.0195 => 0.0275, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.94% (0.0578 => 0.0595, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.07% (1.1437 => 1.1429, std.dev.: 0.0170) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.89% (0.0627 => 0.0565, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 30.56% (0.0180 => 0.0235, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.14% (0.8017 => 0.8028, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 33.87% (0.0062 => 0.0083, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 19 17:43:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 19 Oct 2012 19:43:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121020004339.A4C072A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5021?compare_to=5017&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5021, Order: 166348, Start Time: 2012-10-19 23:25:14, End Time: 2012-10-20 00:45:38 To: 5017, Order: 166316, Start Time: 2012-10-19 21:35:22, End Time: 2012-10-19 22:55:34 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (76 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 10 (188 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 91 (15 on baseline) Unchanged Tests: 941 (654 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.12% (0.9058 => 0.9431, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.36% (0.6517 => 0.6736, std.dev.: 0.0055) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.76% (0.8720 => 0.8961, std.dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: 1.99% (15.3326 => 15.6380, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.80% (1.0917 => 1.1114, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.76% (0.6552 => 0.6667, std.dev.: 0.0020) MultiSource/Applications/spiff/spiff: 1.51% (0.8734 => 0.8866, std.dev.: 0.0034) MultiSource/Applications/hbd/hbd: 1.36% (1.7102 => 1.7335, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.16% (0.8963 => 0.9067, std.dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.20% (54.6211 => 56.3703, std.dev.: 0.1803) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.49% (0.6134 => 0.6164, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 0.34% (17.1244 => 17.1822, std.dev.: 0.0213) MultiSource/Benchmarks/Bullet/bullet: 0.33% (56.0405 => 56.2254, std.dev.: 0.0222) MultiSource/Benchmarks/MallocBench/gs/gs: 1.31% (4.5092 => 4.5683, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 5.00% (0.0460 => 0.0483) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.76% (0.0462 => 0.0484, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 5.35% (0.0430 => 0.0453) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 4.86% (0.0432 => 0.0453, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.25% (0.0419 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 4.98% (0.0422 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.07% (0.0414 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 4.81% (0.0416 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 4.86% (0.0432 => 0.0453, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 4.85% (0.0433 => 0.0454, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 5.16% (0.0426 => 0.0448, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.39% (0.0427 => 0.0450, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.05% (0.0416 => 0.0437, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 5.02% (0.0418 => 0.0439, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.44% (0.0423 => 0.0446) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 4.94% (0.0425 => 0.0446, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 5.07% (0.0434 => 0.0456, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.82% (0.0436 => 0.0457, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.35% (0.0411 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 5.08% (0.0413 => 0.0434, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 5.20% (0.0423 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 5.18% (0.0425 => 0.0447, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 5.31% (0.0414 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 5.05% (0.0416 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.16% (0.0407 => 0.0428, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 5.15% (0.0408 => 0.0429, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 5.43% (0.0405 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 5.41% (0.0407 => 0.0429, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 5.20% (0.0442 => 0.0465, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 4.97% (0.0443 => 0.0465, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 5.19% (0.0405 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.17% (0.0406 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 5.17% (0.0406 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 5.41% (0.0407 => 0.0429) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 5.08% (0.0413 => 0.0434, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 5.07% (0.0414 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.95% (1.2905 => 1.3027, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.31% (8.2035 => 8.1778, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.01% (0.7728 => 0.7727, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.28% (0.0352 => 0.0351, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: - (0.1647 => 0.1647, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.79% (0.2161 => 0.2178, std.dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: 0.04% (10.0277 => 10.0317, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.10% (63.2438 => 56.2254, std.dev.: 0.0222) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 0.49% (0.1639 => 0.1647, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 4.89% (9.5636 => 10.0317, std.dev.: 0.0011) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 35.33% (14.1553 => 19.1568, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.06% (3.4629 => 5.7851, std.dev.: 0.0056) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13406.25% (0.0720 => 9.7245, std.dev.: 0.0121) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050100.00% (0.0001 => 10.0502, std.dev.: 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.74% (0.2554 => 0.4182, std.dev.: 0.0008) SingleSource/Regression/C/matrixTranspose: 61.63% (0.0245 => 0.0396, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 55.47% (0.0256 => 0.0398, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 50.84% (10.3673 => 15.6380, std.dev.: 0.0072) SingleSource/UnitTests/SignlessTypes/factor: 44.59% (0.0296 => 0.0428, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 38.22% (0.1622 => 0.2242, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/distray/distray: 36.27% (0.1056 => 0.1439, std.dev.: 0.0010) SingleSource/UnitTests/vla: 32.39% (0.0355 => 0.0470, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: 24.40% (0.2049 => 0.2549, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 24.34% (0.0834 => 0.1037, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.44% (0.1566 => 0.1933, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 22.57% (0.1236 => 0.1515, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 20.86% (0.0719 => 0.0869, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 19.62% (0.1432 => 0.1713, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 19.38% (0.1584 => 0.1891, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.00% (7.0540 => 8.3945, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.16% (2.2022 => 2.6021, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.91% (0.0871 => 0.1027, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.28% (0.5105 => 0.5987, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.05% (0.6675 => 0.7813, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 16.50% (0.1655 => 0.1928, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.28% (1.3050 => 1.5175, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.12% (0.2271 => 0.2637, std.dev.: 0.0027) MultiSource/Applications/d/make_dparser: 15.89% (3.3354 => 3.8653, std.dev.: 0.0108) MultiSource/Benchmarks/Olden/power/power: 15.63% (0.1440 => 0.1665, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 15.52% (0.1695 => 0.1958, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.41% (0.8172 => 0.9431, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/tsp/tsp: 15.40% (0.1175 => 0.1356, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.18% (0.1337 => 0.1540, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 15.11% (0.3282 => 0.3778, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/mst/mst: 15.05% (0.1163 => 0.1338, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 15.01% (0.0746 => 0.0858, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.00% (1.5415 => 1.7727, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.92% (0.1032 => 0.1186, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.88% (0.5020 => 0.5767, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 14.86% (0.3109 => 0.3571, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.81% (1.7609 => 2.0217, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.67% (0.0886 => 0.1016, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: 14.67% (0.0818 => 0.0938, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 14.63% (0.0793 => 0.0909, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 14.60% (0.1555 => 0.1782, std.dev.: 0.0037) MultiSource/Applications/minisat/minisat: 14.59% (0.7115 => 0.8153, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.50% (0.1510 => 0.1729, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.50% (0.4615 => 0.5284, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.49% (0.0842 => 0.0964, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 14.31% (9.4845 => 10.8415, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.28% (0.1940 => 0.2217, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 14.20% (0.3423 => 0.3909, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 14.12% (0.1438 => 0.1641, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 14.09% (10.4361 => 11.9065, std.dev.: 0.0221) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.08% (0.0838 => 0.0956, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.97% (0.3121 => 0.3557, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.85% (0.1906 => 0.2170, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.81% (0.9765 => 1.1114, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.77% (0.5860 => 0.6667, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.75% (4.2646 => 4.8511, std.dev.: 0.0148) MultiSource/Applications/Burg/burg: 13.73% (1.1642 => 1.3240, std.dev.: 0.0087) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.67% (0.2107 => 0.2395, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/exptree: 13.64% (0.0814 => 0.0925, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.61% (0.1117 => 0.1269, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 13.51% (0.1125 => 0.1277, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 13.44% (0.6450 => 0.7317, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.39% (8.1363 => 9.2260, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.38% (0.0770 => 0.0873, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.29% (0.0933 => 0.1057, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.23% (0.2758 => 0.3123, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.22% (0.2065 => 0.2338, std.dev.: 0.0023) MultiSource/Applications/aha/aha: 13.21% (0.1151 => 0.1303, std.dev.: 0.0027) MultiSource/Applications/spiff/spiff: 13.16% (0.7835 => 0.8866, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.13% (0.0929 => 0.1051, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 13.07% (0.4299 => 0.4861, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.03% (0.0798 => 0.0902, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.02% (0.1029 => 0.1163, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.91% (4.9449 => 5.5833, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/neural/neural: 12.85% (0.1463 => 0.1651, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.81% (0.2700 => 0.3046, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.81% (0.1062 => 0.1198, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 12.80% (2.0273 => 2.2868, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.75% (0.4879 => 0.5501, std.dev.: 0.0030) MultiSource/Applications/oggenc/oggenc: 12.73% (5.7591 => 6.4923, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.68% (0.1695 => 0.1910, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 12.64% (1.1840 => 1.3336, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.62% (0.5981 => 0.6736, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.61% (5.0018 => 5.6324, std.dev.: 0.0049) MultiSource/Applications/lambda-0_1_3/lambda: 12.55% (0.7433 => 0.8366, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: 12.55% (0.3387 => 0.3812, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.41% (7.9617 => 8.9494, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.40% (0.8067 => 0.9067, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: 12.38% (1.0722 => 1.2049, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/health/health: 12.22% (0.1268 => 0.1423, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.18% (0.1330 => 0.1492, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 12.15% (0.3177 => 0.3563, std.dev.: 0.0019) MultiSource/Applications/lua/lua: 12.14% (3.8723 => 4.3424, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.12% (0.1625 => 0.1822, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.02% (1.1861 => 1.3287, std.dev.: 0.0022) SingleSource/UnitTests/SignlessTypes/rem: 11.98% (0.1144 => 0.1281, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.76% (0.3307 => 0.3696, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.76% (0.5569 => 0.6224, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/football/football: 11.61% (0.8921 => 0.9957, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 11.56% (1.4186 => 1.5826, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.44% (1.5859 => 1.7673, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 11.16% (0.3180 => 0.3535, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.15% (0.3543 => 0.3938, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.10% (0.3441 => 0.3823, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 11.10% (1.5603 => 1.7335, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.77% (0.2266 => 0.2510, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 10.74% (0.3092 => 0.3424, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 10.65% (0.3473 => 0.3843, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.64% (0.3927 => 0.4345, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.62% (0.8101 => 0.8961, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-4: 10.61% (0.3543 => 0.3919, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.56% (0.2603 => 0.2878, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.53% (0.3561 => 0.3936, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 10.53% (0.3828 => 0.4231, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.52% (0.3516 => 0.3886, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.52% (0.3497 => 0.3865, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 10.52% (0.6456 => 0.7135, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.50% (2.2024 => 2.4336, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: 10.48% (0.3694 => 0.4081, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.25% (0.1892 => 0.2086, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.16% (0.3886 => 0.4281, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 10.15% (2.2969 => 2.5301, std.dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: 9.87% (21.9371 => 24.1024, std.dev.: 0.0304) SingleSource/Benchmarks/Shootout-C++/hash: 9.58% (0.4289 => 0.4700, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 9.22% (0.4620 => 0.5046, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.99% (0.3826 => 0.4170, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 8.94% (0.3422 => 0.3728, std.dev.: 0.0006) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.84% (0.1143 => 0.1244, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.78% (0.4636 => 0.5043, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.75% (0.3865 => 0.4203, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.49% (0.4203 => 0.4560, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.35% (0.3427 => 0.3713, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 8.25% (0.4048 => 0.4382, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.14% (0.4103 => 0.4437, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 8.11% (17.1811 => 18.5747, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/lists1: 8.06% (0.3684 => 0.3981, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 7.98% (0.5925 => 0.6398, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference-object: 7.84% (0.6030 => 0.6503, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.65% (0.2430 => 0.2616, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.59% (14.3668 => 15.4567, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/sieve: 7.49% (0.3603 => 0.3873, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.47% (3.8922 => 4.1830, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.26% (0.3650 => 0.3915, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.23% (0.7326 => 0.7856, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.89% (0.4064 => 0.4344, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 6.88% (0.3098 => 0.3311, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.66% (0.3136 => 0.3345, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.61% (0.2905 => 0.3097, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.61% (0.2891 => 0.3082, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.61% (0.2831 => 0.3018, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 6.56% (0.3232 => 0.3444, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.55% (0.3162 => 0.3369, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 6.52% (0.3283 => 0.3497, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 6.43% (0.2877 => 0.3062, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.35% (0.2725 => 0.2898, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.34% (0.2872 => 0.3054, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.33% (2.0665 => 2.1974, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/except: 6.23% (0.2871 => 0.3050, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.19% (0.2793 => 0.2966, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 6.19% (0.3379 => 0.3588, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.17% (0.2756 => 0.2926, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 6.06% (0.3052 => 0.3237, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 5.97% (0.2714 => 0.2876, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 5.93% (1.2842 => 1.3603, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/random: 5.85% (0.2802 => 0.2966, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (0.3131 => 0.3292, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.01% (1.1194 => 1.1531, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.96% (0.3817 => 0.3930, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.76% (1.1396 => 1.2508, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 9.55% (0.9957 => 1.0908, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3682, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 5.94% (1.9405 => 2.0558, std.dev.: 0.0093) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.4162 => 0.4322, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.57% (4.2280 => 4.3367, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7652, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.86% (3.6395 => 3.7073, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/bisort/bisort: 1.84% (0.8333 => 0.8486, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2078, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.53% (2.6546 => 2.6951, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.01% (6.6874 => 0.1334, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/salsa20: -79.84% (0.8651 => 0.1744, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.62% (5.2763 => 3.2385, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.12% (5.3855 => 3.7098, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.69% (5.3526 => 3.7098, std.dev.: 0.0026) SingleSource/UnitTests/Vector/constpool: -14.61% (54.1659 => 46.2505, std.dev.: 0.0219) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.27% (2.9384 => 2.6367, std.dev.: 0.0144) MultiSource/Applications/ClamAV/clamscan: -6.62% (22.1758 => 20.7068, std.dev.: 0.0356) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.09% (8.0499 => 3.7765, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.49% (1.1492 => 0.7643, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.90% (1.6925 => 1.4234, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3453 => 2.9599, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.48% (1.2373 => 1.0952, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -10.84% (1.5373 => 1.3706, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.36% (19.9488 => 18.2808, std.dev.: 0.0243) MultiSource/Benchmarks/FreeBench/mason/mason: -7.96% (0.2161 => 0.1989, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.13% (1.6805 => 1.5606, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.93% (1.8329 => 1.7058, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5074, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.52% (8.1563 => 7.7873, std.dev.: 0.0083) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Applications/siod/siod: -3.69% (3.2827 => 3.1617, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8775, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5071, std.dev.: 0.0046) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.75% (0.4808 => 0.4676, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Applications/sqlite3/sqlite3: -2.03% (4.6441 => 4.5500, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0848, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6828, std.dev.: 0.0018) SingleSource/UnitTests/Vector/multiplies: -1.69% (2.5528 => 2.5096, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2879, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2348, std.dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 17.88% (0.5229 => 0.6164, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 14.63% (14.9895 => 17.1822, std.dev.: 0.0213) MultiSource/Benchmarks/MallocBench/gs/gs: 11.14% (4.1105 => 4.5683, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.91% (1.1048 => 1.3027, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.24% (7.1582 => 8.1778, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.19% (0.6222 => 0.7727, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35000.00% (0.0001 => 0.0351, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.93% (0.2116 => 0.2178, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 19 19:00:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 19 Oct 2012 21:00:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121020020042.EF0B12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5022?compare_to=5019&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5022, Order: 166354, Start Time: 2012-10-20 00:37:43, End Time: 2012-10-20 02:03:41 To: 5019, Order: 166342, Start Time: 2012-10-19 22:41:57, End Time: 2012-10-20 00:08:16 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 14 (203 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1028 (662 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.71% (0.8686 => 0.9008, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.28% (0.6213 => 0.6417, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.69% (0.8229 => 0.8450, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.76% (0.5900 => 0.6004, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.66% (1.2020 => 1.2220, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.61% (1.2051 => 1.2245, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.49% (1.0338 => 1.0492, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 1.40% (0.8303 => 0.8419, std.dev.: 0.0031) MultiSource/Applications/Burg/burg: 1.33% (1.2301 => 1.2464, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 1.17% (4.2692 => 4.3190, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.13% (7.9259 => 8.0155, std.dev.: 0.0022) MultiSource/Applications/hbd/hbd: 1.13% (1.5431 => 1.5605, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.95% (54.5864 => 56.1976, std.dev.: 0.1753) SingleSource/Benchmarks/Misc/lowercase: 1.25% (7.9444 => 8.0435, std.dev.: 0.0062) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.83% (2.0176 => 2.4983, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.42% (0.1410 => 0.1712, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 18.77% (0.0826 => 0.0981, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 18.32% (0.2243 => 0.2654, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 17.57% (0.1013 => 0.1191, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.00% (0.0653 => 0.0764, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.89% (0.0746 => 0.0872, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.84% (0.7710 => 0.9008, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.52% (0.1327 => 0.1533, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 15.47% (0.2721 => 0.3142, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.91% (0.2596 => 0.2983, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.90% (0.1986 => 0.2282, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.87% (0.0834 => 0.0958, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 14.46% (0.1003 => 0.1148, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.43% (0.0811 => 0.0928, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.41% (0.0819 => 0.0937, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.37% (0.1413 => 0.1616, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.07% (0.0725 => 0.0827, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.06% (0.9199 => 1.0492, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.05% (0.0847 => 0.0966, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 14.04% (0.5265 => 0.6004, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.03% (0.0720 => 0.0821, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.01% (0.6959 => 0.7934, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 13.96% (1.3693 => 1.5605, std.dev.: 0.0062) MultiSource/Applications/aha/aha: 13.94% (0.1062 => 0.1210, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.84% (0.5637 => 0.6417, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 13.77% (0.7038 => 0.8007, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.77% (0.1075 => 0.1223, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.73% (3.9660 => 4.5106, std.dev.: 0.0096) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.69% (0.0964 => 0.1096, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.66% (0.1588 => 0.1805, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.62% (0.1072 => 0.1218, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 13.50% (0.1111 => 0.1261, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.32% (0.2914 => 0.3302, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 13.27% (0.7460 => 0.8450, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.00% (0.0977 => 0.1104, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.93% (0.1276 => 0.1441, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/distray/distray: 12.84% (0.0818 => 0.0923, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 12.72% (0.1478 => 0.1666, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 12.70% (0.4062 => 0.4578, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 12.68% (0.4328 => 0.4877, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 12.68% (1.1061 => 1.2464, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.55% (0.5577 => 0.6277, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.52% (0.1014 => 0.1141, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.52% (1.4563 => 1.6386, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.50% (1.2193 => 1.3717, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 12.41% (13.8202 => 15.5349, std.dev.: 0.0165) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.32% (1.1364 => 1.2764, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.32% (0.6283 => 0.7057, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.21% (0.2023 => 0.2270, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 12.16% (0.7506 => 0.8419, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.11% (0.3246 => 0.3639, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.06% (0.1865 => 0.2090, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.94% (0.2127 => 0.2381, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.92% (0.4379 => 0.4901, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 11.83% (0.1657 => 0.1853, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 11.76% (3.8646 => 4.3190, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.75% (0.1157 => 0.1293, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.75% (0.3899 => 0.4357, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.63% (0.4791 => 0.5348, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.61% (0.3022 => 0.3373, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.60% (0.3130 => 0.3493, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 11.56% (0.2925 => 0.3263, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 11.52% (0.2995 => 0.3340, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.45% (0.1048 => 0.1168, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference: 11.34% (0.7061 => 0.7862, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.32% (0.3756 => 0.4181, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 11.30% (0.3220 => 0.3584, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 11.24% (1.0313 => 1.1472, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 11.21% (0.5818 => 0.6470, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.10% (0.3485 => 0.3872, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.09% (0.4390 => 0.4877, std.dev.: 0.0017) MultiSource/Applications/minisat/minisat: 11.08% (0.6744 => 0.7491, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.06% (0.3580 => 0.3976, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 11.05% (7.2180 => 8.0155, std.dev.: 0.0022) SingleSource/Regression/C++/ofstream_ctor: 11.04% (0.2781 => 0.3088, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.01% (0.1789 => 0.1986, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.98% (0.4016 => 0.4457, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 10.94% (0.5748 => 0.6377, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 10.93% (1.9270 => 2.1377, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.92% (0.2655 => 0.2945, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 10.88% (0.1213 => 0.1345, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 10.84% (0.3293 => 0.3650, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: 10.82% (0.1589 => 0.1761, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.77% (0.1569 => 0.1738, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 10.76% (16.6129 => 18.4003, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.69% (0.3489 => 0.3862, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.66% (0.1435 => 0.1588, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.64% (0.2782 => 0.3078, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 10.60% (0.3868 => 0.4278, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 10.57% (0.3453 => 0.3818, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 10.51% (2.1791 => 2.4082, std.dev.: 0.0024) MultiSource/Applications/d/make_dparser: 10.51% (3.1889 => 3.5241, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.45% (0.0976 => 0.1078, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 10.45% (0.8310 => 0.9178, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.43% (0.8698 => 0.9605, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 10.42% (0.2726 => 0.3010, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.36% (1.3245 => 1.4617, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.32% (0.2966 => 0.3272, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 10.28% (0.2607 => 0.2875, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.26% (1.9828 => 2.1863, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/except: 10.25% (0.2760 => 0.3043, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 10.22% (0.2690 => 0.2965, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 10.18% (0.2761 => 0.3042, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 10.17% (0.3107 => 0.3423, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 10.16% (0.3149 => 0.3469, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 10.16% (0.3534 => 0.3893, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.14% (0.2140 => 0.2357, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 10.11% (3.6692 => 4.0401, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.09% (4.9865 => 5.4894, std.dev.: 0.0080) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.08% (0.1061 => 0.1168, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/wc: 10.08% (0.2937 => 0.3233, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 10.05% (4.3801 => 4.8204, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.98% (0.2765 => 0.3041, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 9.89% (0.2628 => 0.2888, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.83% (4.4433 => 4.8802, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.82% (0.2321 => 0.2549, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 9.81% (0.3192 => 0.3505, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.72% (0.6576 => 0.7215, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 9.71% (0.2988 => 0.3278, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 9.68% (0.4113 => 0.4511, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.64% (0.2696 => 0.2956, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 9.43% (1.0594 => 1.1593, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.37% (0.3755 => 0.4107, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.34% (0.3511 => 0.3839, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.27% (0.6135 => 0.6704, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 9.24% (14.8535 => 16.2266, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/objinst: 9.20% (0.2945 => 0.3216, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.06% (0.8818 => 0.9617, std.dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: 9.05% (1.2749 => 1.3903, std.dev.: 0.0021) MultiSource/Benchmarks/sim/sim: 8.94% (0.3131 => 0.3411, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 8.88% (4.6629 => 5.0771, std.dev.: 0.0116) MultiSource/Benchmarks/mafft/pairlocalalign: 8.86% (8.4961 => 9.2490, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.74% (0.1819 => 0.1978, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.73% (1.1333 => 1.2322, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.60% (1.5188 => 1.6494, std.dev.: 0.0014) MultiSource/Applications/lua/lua: 8.56% (3.7467 => 4.0675, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.52% (0.9108 => 0.9884, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 8.51% (0.6250 => 0.6782, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.39% (3.2742 => 3.5490, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/neural/neural: 8.23% (0.1385 => 0.1499, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.20% (0.3245 => 0.3511, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 8.14% (6.5754 => 7.1106, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 8.02% (0.2008 => 0.2169, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.97% (0.4805 => 0.5188, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.83% (2.1007 => 2.2652, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.77% (6.2785 => 6.7662, std.dev.: 0.0129) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.75% (0.2504 => 0.2698, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.58% (0.2243 => 0.2413, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 7.52% (0.4003 => 0.4304, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.48% (1.2292 => 1.3212, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.27% (13.2842 => 14.2498, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/ReedSolomon: 7.26% (0.1777 => 0.1906, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 7.23% (0.3914 => 0.4197, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.16% (0.3940 => 0.4222, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.99% (0.3789 => 0.4054, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 6.99% (0.3578 => 0.3828, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.94% (0.3646 => 0.3899, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.93% (0.3650 => 0.3903, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 6.88% (0.3663 => 0.3915, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 6.83% (0.3601 => 0.3847, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 6.79% (0.3623 => 0.3869, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 5.41% (16.2614 => 17.1412, std.dev.: 0.0086) MultiSource/Applications/ClamAV/clamscan: 5.10% (14.5298 => 15.2711, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/bh/bh: 4.37% (0.2859 => 0.2984, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 2.74% (33.2944 => 34.2060, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.89% (0.4846 => 0.6973, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5164, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/fbench: 24.56% (1.8175 => 2.2639, std.dev.: 0.0491) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.11% (1.0895 => 1.2759, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: 11.13% (1.1560 => 1.2847, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.05% (0.8273 => 0.9022, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.70% (0.1322 => 0.1437, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4143, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 5.53% (1.2998 => 1.3717, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.43% (0.9692 => 1.0218) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.77% (1.9144 => 2.0058, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.46% (2.8606 => 2.9883, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 4.44% (0.5449 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.78% (10.7476 => 11.1537, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/flops-6: 3.49% (1.9199 => 1.9870, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.38% (12.0921 => 12.5014, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.22% (11.2619 => 11.6247, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.32% (1.0310 => 1.0549, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.20% (7.4271 => 7.5908, std.dev.: 0.0041) MultiSource/Applications/lemon/lemon: 1.83% (1.4298 => 1.4560, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5129, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9698, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1876, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.20% (5.5130 => 5.5791, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.17% (8.8259 => 8.9296, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.17% (9.9194 => 10.0356, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.09% (12.4560 => 12.5919, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.40% (0.2670 => 0.1431, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.93% (0.4657 => 0.3915, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.53% (1.3813 => 1.2220, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.39% (1.3819 => 1.2245, std.dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.29% (1.0460 => 0.8547, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.69% (0.2238 => 0.1954, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.05% (20.3410 => 18.2975, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0114) SingleSource/Benchmarks/McGill/chomp: -5.69% (1.2308 => 1.1608, std.dev.: 0.0034) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.20% (1.3780 => 1.3064, std.dev.: 0.0027) SingleSource/UnitTests/Vector/multiplies: -5.09% (2.6470 => 2.5123, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.95% (0.9996 => 0.9601, std.dev.: 0.0042) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.81% (1.7688 => 1.7014, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.02% (0.4867 => 0.4720, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -2.85% (3.2729 => 3.1795, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: -2.79% (3.0263 => 2.9419, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -2.75% (1.9762 => 1.9218, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8812, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4781, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.26% (4.1080 => 4.0153, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.96% (0.6589 => 0.6460, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.86% (0.6615 => 0.6492, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.80% (6.3560 => 6.2414, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.65% (0.8342 => 0.8204, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.60% (2.5254 => 2.4849, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -1.54% (26.5159 => 26.1065, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0060, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8671, std.dev.: 0.0071) MultiSource/Benchmarks/mafft/pairlocalalign: -1.25% (28.2225 => 27.8706, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2522, std.dev.: 0.0009) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1139, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -1.05% (84.4286 => 83.5457, std.dev.: 0.0052) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 19 19:20:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 19 Oct 2012 21:20:14 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121020022014.9CFD22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5023?compare_to=5020&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5023, Order: 166354, Start Time: 2012-10-20 00:58:31, End Time: 2012-10-20 02:22:16 To: 5020, Order: 166348, Start Time: 2012-10-19 23:17:09, End Time: 2012-10-20 00:41:33 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 7 (18 on baseline) Performance Improvements: 12 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 956 (952 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.18% (0.8666 => 0.8768, std.dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 11.02% (3.5903 => 3.9861, std.dev.: 0.0650) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.06% (4.3238 => 4.4993, std.dev.: 0.0265) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.40% (1.0193 => 1.0336, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.36% (4.5147 => 4.5761, std.dev.: 0.0151) SingleSource/Benchmarks/Misc/ffbench: 1.15% (1.4143 => 1.4305, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.06% (1.5976 => 1.6146, std.dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -3.66% (0.5158 => 0.4969, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -3.48% (0.8487 => 0.8192, std.dev.: 0.0100) MultiSource/Benchmarks/McCat/09-vor/vor: -3.18% (0.3337 => 0.3231, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.63% (0.9836 => 0.9577, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.57% (1.1379 => 1.1086, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.01% (0.9070 => 0.8888, std.dev.: 0.0053) MultiSource/Benchmarks/MallocBench/gs/gs: -1.57% (4.1864 => 4.1207, std.dev.: 0.0230) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.37% (4.5616 => 4.4993, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -1.24% (1.2683 => 1.2526, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.18% (8.7874 => 8.6839, std.dev.: 0.0260) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -3.91% (2.3738 => 2.2810, std.dev.: 0.0305) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -2.27% (42.1766 => 41.2190, std.dev.: 0.3661) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.06% (16.5525 => 16.5419, std.dev.: 0.0447) MultiSource/Applications/obsequi/Obsequi: -0.88% (1.0412 => 1.0320, std.dev.: 0.0109) MultiSource/Applications/sqlite3/sqlite3: 0.46% (0.6362 => 0.6391, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: -5.69% (0.1951 => 0.1840, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.73% (0.1649 => 0.1637, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.36% (0.3171 => 0.3214, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.20% (0.2471 => 0.2466, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.92% (0.3360 => 0.3329, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.23% (0.2377 => 0.2324, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/bigfib: -0.18% (0.5987 => 0.5976, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel: -5.30% (0.0434 => 0.0411, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.55% (0.3295 => 0.3277, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/strcat: -0.65% (0.1989 => 0.1976, std.dev.: 0.0057) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -5.19% (0.0212 => 0.0201, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0212 => 0.0212, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0419 => 0.0419, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.31% (0.0325 => 0.0324, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.65% (0.0309 => 0.0307, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.24% (0.0417 => 0.0416, std.dev.: 0.0058) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0198 => 0.0198, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/test1: -0.93% (0.0214 => 0.0212, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: 15.07% (0.0272 => 0.0313, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.67% (0.1482 => 0.1472, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.66% (1.1378 => 1.1453, std.dev.: 0.0251) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -0.33% (0.1522 => 0.1517, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.92% (0.4161 => 0.3998, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.90% (0.1421 => 0.1394, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.42% (0.0661 => 0.0645, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.36% (0.0275 => 0.0274, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.71% (0.0595 => 0.0561, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.23% (1.1429 => 1.1455, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.50% (0.0565 => 0.0630, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.38% (0.0235 => 0.0250, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.26% (0.8028 => 0.7927, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -56.63% (0.0083 => 0.0036, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.08% (2.1832 => 1.6575, std.dev.: 0.0138) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 6.15% (0.3137 => 0.3330, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.62% (0.8321 => 0.8789, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.53% (0.7473 => 0.7737, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.88% (0.6010 => 0.6183, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.52% (0.4847 => 0.4969, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.13% (0.5961 => 0.6088, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.51% (0.9435 => 0.9577, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.29% (0.8656 => 0.8768, std.dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.68% (1.5795 => 2.5063, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.32% (0.3186 => 0.3483, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.55% (1.1857 => 1.2871, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 5.99% (63.1822 => 66.9683, std.dev.: 0.0998) SingleSource/Benchmarks/Misc/ReedSolomon: 3.42% (8.5322 => 8.8237, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.31% (4.3552 => 4.4993, std.dev.: 0.0265) MultiSource/Applications/siod/siod: 2.91% (3.6643 => 3.7711, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/bh/bh: 1.87% (2.3560 => 2.4001, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.43% (4.8362 => 4.9052, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.29% (1.5941 => 1.6146, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.74% (0.3269 => 0.3016, std.dev.: 0.0034) MultiSource/Applications/lua/lua: -4.81% (29.8330 => 28.3977, std.dev.: 0.0381) SingleSource/Benchmarks/Shootout-C++/hash2: -1.59% (3.4237 => 3.3694, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.31% (3.3479 => 3.3041, std.dev.: 0.0011) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.58% (16.4461 => 16.5419, std.dev.: 0.0447) MultiSource/Applications/obsequi/Obsequi: 0.57% (1.0262 => 1.0320, std.dev.: 0.0109) MultiSource/Applications/sqlite3/sqlite3: 0.93% (0.6332 => 0.6391, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 0.49% (0.1831 => 0.1840, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.00% (0.1559 => 0.1637, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.91% (0.3123 => 0.3214, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.12% (0.2463 => 0.2466, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.45% (0.3344 => 0.3329, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.69% (0.2364 => 0.2324, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/bigfib: -0.57% (0.6010 => 0.5976, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel: -4.20% (0.0429 => 0.0411, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.34% (0.3266 => 0.3277, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/strcat: 0.36% (0.1969 => 0.1976, std.dev.: 0.0057) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -10.27% (0.0224 => 0.0201, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 72.36% (0.0123 => 0.0212, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.70% (0.0408 => 0.0419, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 27.56% (0.0254 => 0.0324, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.66% (0.0302 => 0.0307, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 8.33% (0.0384 => 0.0416, std.dev.: 0.0058) SingleSource/UnitTests/Vector/Altivec/casts: 4.21% (0.0190 => 0.0198, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/test1: 17.78% (0.0180 => 0.0212, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: 36.09% (0.0230 => 0.0313, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.36% (0.1438 => 0.1472, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 1.09% (1.1329 => 1.1453, std.dev.: 0.0251) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.76% (0.1462 => 0.1517, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.99% (0.4164 => 0.3998, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.83% (0.1369 => 0.1394, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.62% (0.0641 => 0.0645, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 40.51% (0.0195 => 0.0274, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.94% (0.0578 => 0.0561, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.16% (1.1437 => 1.1455, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.48% (0.0627 => 0.0630, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 38.89% (0.0180 => 0.0250, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.12% (0.8017 => 0.7927, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -41.94% (0.0062 => 0.0036, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 19 19:33:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 19 Oct 2012 21:33:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121020023328.189492A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5024?compare_to=5021&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5024, Order: 166354, Start Time: 2012-10-20 01:15:06, End Time: 2012-10-20 02:35:27 To: 5021, Order: 166348, Start Time: 2012-10-19 23:25:14, End Time: 2012-10-20 00:45:38 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (75 on baseline) New Passes: 1 (4 on baseline) Performance Regressions: 6 (191 on baseline) Performance Improvements: 5 (41 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 90 (15 on baseline) Unchanged Tests: 940 (654 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/NPB-serial/is/is: -6.08% (10.0317 => 9.4218, std.dev.: 0.0039) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.26% (2.1974 => 2.2251, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/dt: 94.67% (1.0510 => 2.0460, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 11.25% (0.9184 => 1.0217, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.11% (1.5606 => 1.5935, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.03% (79.0810 => 80.6847, std.dev.: 0.1854) MultiSource/Applications/viterbi/viterbi: 1.76% (4.4360 => 4.5139, std.dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C/matrixTranspose: -28.79% (0.0396 => 0.0282) SingleSource/Benchmarks/Misc/ReedSolomon: -11.49% (0.2549 => 0.2256, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -7.00% (0.1515 => 0.1409, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -2.69% (15.6380 => 15.2171, std.dev.: 0.0034) MultiSource/Applications/JM/ldecod/ldecod: -1.19% (11.9065 => 11.7649, std.dev.: 0.0036) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.47% (0.6164 => 0.6135, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: -0.08% (17.1822 => 17.1677, std.dev.: 0.0123) MultiSource/Benchmarks/Bullet/bullet: -0.05% (56.2254 => 56.1954, std.dev.: 0.0277) MultiSource/Benchmarks/MallocBench/gs/gs: 0.38% (4.5683 => 4.5855, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.41% (0.0483 => 0.0485, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.41% (0.0484 => 0.0486) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0453 => 0.0453, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.22% (0.0453 => 0.0454, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.23% (0.0441 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.23% (0.0443 => 0.0444) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.46% (0.0435 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.23% (0.0436 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.22% (0.0453 => 0.0454, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.44% (0.0454 => 0.0456, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.22% (0.0448 => 0.0449, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.22% (0.0450 => 0.0451, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.23% (0.0437 => 0.0438, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.23% (0.0439 => 0.0440, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0446 => 0.0446, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.67% (0.0446 => 0.0449, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.44% (0.0456 => 0.0458, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.44% (0.0457 => 0.0459, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.23% (0.0433 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.23% (0.0434 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.22% (0.0445 => 0.0446, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.22% (0.0447 => 0.0448, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.23% (0.0436 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.46% (0.0437 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.23% (0.0428 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.47% (0.0429 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.47% (0.0427 => 0.0429, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.23% (0.0429 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.22% (0.0465 => 0.0466, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.43% (0.0465 => 0.0467, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.23% (0.0426 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.23% (0.0427 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.23% (0.0427 => 0.0428, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0429 => 0.0429, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.46% (0.0434 => 0.0436) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.46% (0.0435 => 0.0437, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.21% (1.3027 => 1.3000, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.04% (8.1778 => 8.1745, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.53% (0.7727 => 0.7768, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 1.14% (0.0351 => 0.0355, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1432 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 0.06% (0.1647 => 0.1648) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.24% (0.2178 => 0.2205, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.14% (63.2438 => 56.1954, std.dev.: 0.0277) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 0.55% (0.1639 => 0.1648) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 36.24% (14.1553 => 19.2853, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.76% (3.4629 => 5.7746, std.dev.: 0.0026) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13402.22% (0.0720 => 9.7216, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050000.00% (0.0001 => 10.0501, std.dev.: 0.0010) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.59% (0.2554 => 0.4178, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/lowercase: 55.86% (0.0256 => 0.0399, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 46.78% (10.3673 => 15.2171, std.dev.: 0.0034) SingleSource/UnitTests/SignlessTypes/factor: 44.59% (0.0296 => 0.0428, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 37.30% (0.1622 => 0.2227, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 36.27% (0.1056 => 0.1439, std.dev.: 0.0009) SingleSource/UnitTests/vla: 31.83% (0.0355 => 0.0468, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 26.02% (0.0834 => 0.1051, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.56% (0.1566 => 0.1888, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 19.20% (0.1432 => 0.1707, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.02% (7.0540 => 8.3959, std.dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.03% (0.0871 => 0.1028, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 17.81% (0.1555 => 0.1832, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.54% (2.2022 => 2.5884, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.12% (0.5105 => 0.5979, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 16.96% (0.6675 => 0.7807, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 16.44% (0.1655 => 0.1927, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.42% (0.2271 => 0.2644, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/lists: 16.13% (0.0626 => 0.0727, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.12% (1.3050 => 1.5154, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 15.99% (0.1695 => 0.1966, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 15.99% (3.3354 => 3.8686, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: 15.83% (0.1440 => 0.1668, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 15.66% (0.0798 => 0.0923, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 15.64% (0.0793 => 0.0917, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 15.49% (0.1175 => 0.1357, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 15.48% (0.1163 => 0.1343, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.22% (0.8172 => 0.9416, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.06% (0.5020 => 0.5776, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.03% (0.1337 => 0.1538, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.90% (0.1510 => 0.1735, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.90% (0.0886 => 0.1018, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.85% (0.0842 => 0.0967, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 14.73% (0.7115 => 0.8163, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.64% (0.1940 => 0.2224, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.51% (1.5415 => 1.7652, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 14.51% (0.3109 => 0.3560, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.41% (0.4615 => 0.5280, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/oourafft: 14.38% (0.3282 => 0.3754, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 14.37% (9.4845 => 10.8473, std.dev.: 0.0231) MultiSource/Benchmarks/McCat/18-imp/imp: 14.20% (0.3423 => 0.3909, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/matrix: 14.18% (0.0818 => 0.0934, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/exptree: 14.13% (0.0814 => 0.0929, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.08% (0.0746 => 0.0851, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.07% (0.3121 => 0.3560, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.06% (0.9765 => 1.1138, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.00% (0.1236 => 0.1409, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 13.95% (0.1584 => 0.1805, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 13.94% (1.1642 => 1.3265, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.88% (0.1117 => 0.1272, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.86% (0.2107 => 0.2399, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.83% (1.7609 => 2.0044, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.83% (4.2646 => 4.8543, std.dev.: 0.0049) MultiSource/Applications/aha/aha: 13.81% (0.1151 => 0.1310, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.69% (0.1906 => 0.2167, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.66% (0.1032 => 0.1173, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.52% (0.2758 => 0.3131, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 13.52% (0.6450 => 0.7322, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.52% (0.5860 => 0.6652, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.51% (0.2065 => 0.2344, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.39% (8.1363 => 9.2255, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.38% (0.0770 => 0.0873, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 13.33% (2.0273 => 2.2976, std.dev.: 0.0083) MultiSource/Applications/spiff/spiff: 13.30% (0.7835 => 0.8877, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.22% (0.1029 => 0.1165, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.21% (0.1438 => 0.1628, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.21% (0.1143 => 0.1294, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.18% (0.0933 => 0.1056, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.18% (0.1062 => 0.1202, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.07% (0.2700 => 0.3053, std.dev.: 0.0087) MultiSource/Applications/lambda-0_1_3/lambda: 13.05% (0.7433 => 0.8403, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/neural/neural: 12.85% (0.1463 => 0.1651, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.81% (0.4879 => 0.5504, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.81% (0.0929 => 0.1048, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 12.73% (10.4361 => 11.7649, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.71% (0.5981 => 0.6741, std.dev.: 0.0027) SingleSource/UnitTests/SignlessTypes/rem: 12.67% (0.1144 => 0.1289, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.67% (4.9449 => 5.5714, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.55% (0.1625 => 0.1829, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/health/health: 12.54% (0.1268 => 0.1427, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 12.54% (0.4299 => 0.4838, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 12.53% (5.7591 => 6.4805, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.51% (0.8067 => 0.9076, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.51% (0.1695 => 0.1907, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 12.44% (3.8723 => 4.3540, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 12.43% (1.0722 => 1.2055, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.37% (5.0018 => 5.6204, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.26% (0.5569 => 0.6252, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 12.25% (0.3387 => 0.3802, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.19% (0.3307 => 0.3710, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.03% (0.1330 => 0.1490, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.96% (1.1861 => 1.3279, std.dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.94% (7.9617 => 8.9123, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.93% (0.3177 => 0.3556, std.dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: 11.80% (1.1840 => 1.3237, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 11.67% (1.4186 => 1.5841, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/09-vor/vor: 11.57% (0.3180 => 0.3548, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 11.53% (0.8921 => 0.9950, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.52% (1.5859 => 1.7686, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.46% (0.3543 => 0.3949, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.39% (0.3441 => 0.3833, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.38% (0.1125 => 0.1253, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 11.23% (0.6456 => 0.7181, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: 11.18% (1.5603 => 1.7348, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/trivial-interface: 11.03% (0.3473 => 0.3856, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 11.00% (0.3927 => 0.4359, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.98% (0.3543 => 0.3932, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.92% (0.3561 => 0.3950, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-2: 10.87% (0.3497 => 0.3877, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.86% (0.3516 => 0.3898, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.84% (0.3828 => 0.4243, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.83% (0.3694 => 0.4094, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.73% (0.1892 => 0.2095, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.71% (2.2024 => 2.4382, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 10.68% (0.3886 => 0.4301, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.64% (0.2603 => 0.2880, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.46% (0.8101 => 0.8948, std.dev.: 0.0076) MultiSource/Applications/siod/siod: 10.45% (2.2969 => 2.5370, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 10.40% (0.4289 => 0.4735, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.28% (0.2266 => 0.2499, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 10.17% (0.4620 => 0.5090, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.12% (0.3826 => 0.4213, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: 10.10% (0.2049 => 0.2256, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.81% (0.4636 => 0.5091, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 9.76% (0.3422 => 0.3756, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.68% (0.3865 => 0.4239, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 9.67% (0.1044 => 0.1145, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.48% (0.4103 => 0.4492, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 9.48% (21.9371 => 24.0158, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.47% (0.4203 => 0.4601, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 9.39% (0.3684 => 0.4030, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 9.31% (0.4048 => 0.4425, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 8.66% (0.3603 => 0.3915, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.64% (0.3427 => 0.3723, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.32% (0.5925 => 0.6418, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.30% (0.3650 => 0.3953, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.26% (0.6030 => 0.6528, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 8.25% (0.3092 => 0.3347, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.05% (0.4064 => 0.4391, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 8.01% (0.3098 => 0.3346, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.94% (0.2430 => 0.2623, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 7.89% (17.1811 => 18.5370, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/strcat: 7.88% (0.2831 => 0.3054, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.85% (0.2891 => 0.3118, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.81% (0.2905 => 0.3132, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.77% (0.3232 => 0.3483, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.71% (0.3283 => 0.3536, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.67% (2.0665 => 2.2251, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.65% (0.3162 => 0.3404, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.65% (0.3136 => 0.3376, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.62% (0.2756 => 0.2966, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.60% (0.7326 => 0.7883, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.59% (0.2872 => 0.3090, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.51% (0.2877 => 0.3093, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 7.50% (0.3052 => 0.3281, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.49% (0.2871 => 0.3086, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.48% (0.2793 => 0.3002, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.46% (14.3668 => 15.4392, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/fibo: 7.38% (0.2725 => 0.2926, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 7.22% (0.3379 => 0.3623, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.21% (3.8922 => 4.1730, std.dev.: 0.0203) SingleSource/Benchmarks/Shootout-C++/hello: 7.18% (0.2714 => 0.2909, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 7.14% (0.2802 => 0.3002, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 6.63% (1.2842 => 1.3693, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 6.26% (0.3131 => 0.3327, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.38% (0.3935 => 0.4068, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.30% (0.3817 => 0.3943, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.85% (1.1194 => 1.1513, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.55% (1.1145 => 1.2989, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 10.03% (0.9957 => 1.0956, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/richards_benchmark: 9.98% (1.1396 => 1.2533, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3684, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bh/bh: 5.51% (1.9405 => 2.0475, std.dev.: 0.0089) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.65% (0.3463 => 0.3624, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.63% (4.2280 => 4.3393, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.41% (1.0313 => 1.0562, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.05% (3.6395 => 3.7142, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/bisort/bisort: 1.84% (0.8333 => 0.8486, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2078, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.40% (2.6546 => 2.6917, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 1.10% (4.4649 => 4.5139, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.08% (6.5088 => 6.5788, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.99% (6.6874 => 0.1343, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -79.86% (0.8651 => 0.1742, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.03% (5.2763 => 3.2696, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.16% (5.3855 => 3.7075, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.78% (5.3526 => 3.7051, std.dev.: 0.0019) SingleSource/UnitTests/Vector/constpool: -14.67% (54.1659 => 46.2184, std.dev.: 0.0359) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.36% (2.9384 => 2.6340, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -6.69% (22.1758 => 20.6928, std.dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.08% (8.0499 => 3.7768, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: -33.46% (1.1492 => 0.7647, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -16.02% (1.6925 => 1.4214, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.57% (1.2373 => 1.0942, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3453 => 2.9600, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -10.88% (1.5373 => 1.3700, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.29% (19.9488 => 18.2945, std.dev.: 0.0107) MultiSource/Benchmarks/FreeBench/mason/mason: -7.73% (0.2161 => 0.1994, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.97% (1.8329 => 1.7051, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0154) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.18% (1.6805 => 1.5935, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5072, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.39% (8.1563 => 7.7986, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0008) MultiSource/Applications/siod/siod: -3.68% (3.2827 => 3.1620, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8776, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5036, std.dev.: 0.0064) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.70% (0.4808 => 0.4678, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Applications/sqlite3/sqlite3: -1.99% (4.6441 => 4.5518, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0864, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6795, std.dev.: 0.0021) SingleSource/UnitTests/Vector/multiplies: -1.68% (2.5528 => 2.5100, std.dev.: 0.0046) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4218, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2878, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 17.33% (0.5229 => 0.6135, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 14.53% (14.9895 => 17.1677, std.dev.: 0.0123) MultiSource/Benchmarks/MallocBench/gs/gs: 11.56% (4.1105 => 4.5855, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.67% (1.1048 => 1.3000, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.20% (7.1582 => 8.1745, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.85% (0.6222 => 0.7768, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35400.00% (0.0001 => 0.0355, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.21% (0.2116 => 0.2205, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 19 20:56:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 19 Oct 2012 22:56:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121020035630.084752A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5025?compare_to=5022&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5025, Order: 166361, Start Time: 2012-10-20 02:33:16, End Time: 2012-10-20 03:59:28 To: 5022, Order: 166354, Start Time: 2012-10-20 00:37:43, End Time: 2012-10-20 02:03:41 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (203 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1041 (662 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 10.97% (8.1266 => 9.0179, std.dev.: 0.0184) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.87% (2.0176 => 2.4992, std.dev.: 0.0057) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.49% (0.1410 => 0.1713, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 18.64% (0.2243 => 0.2661, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 18.52% (0.0826 => 0.0979, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 18.07% (0.0653 => 0.0771, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 17.77% (0.1013 => 0.1193, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.56% (0.0746 => 0.0877) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.89% (0.7710 => 0.9012, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.41% (0.2596 => 0.2996, std.dev.: 0.0027) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.30% (0.1072 => 0.1236, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 15.21% (0.2721 => 0.3135, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.15% (0.1327 => 0.1528, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.99% (0.0834 => 0.0959, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 14.66% (0.1003 => 0.1150, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.55% (0.0811 => 0.0929, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.52% (0.0847 => 0.0970, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.51% (0.1413 => 0.1618, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.50% (0.6959 => 0.7968, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.41% (0.0819 => 0.0937, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 14.34% (0.5265 => 0.6020, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.31% (0.0720 => 0.0823, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 14.26% (1.3693 => 1.5646, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 14.24% (0.7038 => 0.8040, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.21% (0.9199 => 1.0506, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.21% (0.0725 => 0.0828, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.20% (0.1986 => 0.2268, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 14.12% (0.1062 => 0.1212, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.97% (3.9660 => 4.5200, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/mst/mst: 13.95% (0.1111 => 0.1266, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.94% (0.5637 => 0.6423, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.90% (0.0964 => 0.1098, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.86% (0.1075 => 0.1224, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.72% (0.0977 => 0.1111, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.66% (0.1588 => 0.1805, std.dev.: 0.0038) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.66% (0.2914 => 0.3312, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.56% (0.1276 => 0.1449, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 13.50% (0.7460 => 0.8467, std.dev.: 0.0044) MultiSource/Applications/Burg/burg: 13.12% (1.1061 => 1.2512, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 12.99% (0.4328 => 0.4890, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.82% (0.1014 => 0.1144, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.82% (0.1865 => 0.2104, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.81% (1.4563 => 1.6428, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 12.79% (0.1478 => 0.1667, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/distray/distray: 12.71% (0.0818 => 0.0922, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.71% (0.5577 => 0.6286, std.dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: 12.66% (13.8202 => 15.5697, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.65% (1.2193 => 1.3736, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.65% (1.1364 => 1.2801) MultiSource/Applications/spiff/spiff: 12.47% (0.7506 => 0.8442, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.45% (0.6283 => 0.7065, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.45% (0.1157 => 0.1301, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.41% (0.2023 => 0.2274, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.31% (0.4379 => 0.4918, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.23% (0.3246 => 0.3643, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 12.13% (0.1657 => 0.1858, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 12.09% (0.4062 => 0.4553, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 12.05% (3.8646 => 4.3301, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/health/health: 12.04% (0.1213 => 0.1359, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.03% (0.3899 => 0.4368, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.99% (0.2127 => 0.2382, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.85% (0.3130 => 0.3501, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.73% (0.4791 => 0.5353, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 11.72% (0.2995 => 0.3346, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 11.71% (0.7061 => 0.7888, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 11.69% (0.2925 => 0.3267, std.dev.: 0.0085) SingleSource/UnitTests/ObjC++/property-reference-object: 11.65% (0.5818 => 0.6496, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.58% (0.3022 => 0.3372, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.45% (0.1048 => 0.1168, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/18-imp/imp: 11.40% (0.3220 => 0.3587, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 11.40% (0.5748 => 0.6403, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 11.38% (1.9270 => 2.1462, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 11.37% (1.0313 => 1.1486, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.28% (0.4390 => 0.4885, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 11.26% (0.1589 => 0.1768, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.25% (0.3485 => 0.3877, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.18% (0.1789 => 0.1989, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 11.15% (7.2180 => 8.0231, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.15% (0.1569 => 0.1744, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.11% (0.4016 => 0.4462, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 11.07% (0.0976 => 0.1084) MultiSource/Applications/kimwitu++/kc: 11.03% (16.6129 => 18.4461, std.dev.: 0.0118) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.01% (0.1435 => 0.1593, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 11.00% (0.2781 => 0.3087, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 10.99% (0.6744 => 0.7485, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.95% (0.3580 => 0.3972, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.94% (0.3756 => 0.4167, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.93% (0.2782 => 0.3086, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.92% (0.3489 => 0.3870, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 10.90% (0.3293 => 0.3652, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 10.80% (2.1791 => 2.4145, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/moments: 10.75% (0.3868 => 0.4284, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 10.74% (0.3453 => 0.3824, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 10.71% (3.1889 => 3.5304, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.67% (1.3245 => 1.4658, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 10.66% (0.8310 => 0.9196, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.59% (0.2966 => 0.3280, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 10.56% (0.2726 => 0.3014, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.55% (0.8698 => 0.9616, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists1: 10.47% (0.3534 => 0.3904, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 10.43% (0.2760 => 0.3048, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 10.42% (0.3149 => 0.3477, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.38% (1.9828 => 2.1886, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.36% (0.2655 => 0.2930, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 10.32% (0.2761 => 0.3046, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 10.32% (0.2607 => 0.2876, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 10.30% (0.3107 => 0.3427, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 10.30% (0.2690 => 0.2967, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 10.21% (0.2937 => 0.3237, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.21% (0.2321 => 0.2558, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 10.12% (0.2628 => 0.2894, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 10.11% (4.4433 => 4.8923, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 10.09% (3.6692 => 4.0393, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.05% (0.2765 => 0.3043, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 10.01% (4.3801 => 4.8186, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.01% (4.9865 => 5.4855, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.00% (0.2140 => 0.2354, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: 9.90% (0.4113 => 0.4520, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: 9.87% (0.3192 => 0.3507, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 9.81% (0.2988 => 0.3281, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.79% (0.2696 => 0.2960, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.67% (0.3755 => 0.4118, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.63% (0.6135 => 0.6726, std.dev.: 0.0081) MultiSource/Benchmarks/nbench/nbench: 9.61% (1.0594 => 1.1612, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 9.34% (0.2945 => 0.3220, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.32% (0.8818 => 0.9640, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 9.27% (14.8535 => 16.2309, std.dev.: 0.0069) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.24% (0.1819 => 0.1987, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 9.07% (0.3131 => 0.3415, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 9.06% (1.2749 => 1.3904, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.00% (0.6576 => 0.7168, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 8.93% (8.4961 => 9.2545, std.dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.90% (1.5188 => 1.6539, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 8.81% (4.6629 => 5.0739, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 8.77% (0.6250 => 0.6798, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.75% (1.1333 => 1.2325, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 8.74% (3.7467 => 4.0740, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.72% (0.3511 => 0.3817, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.63% (0.9108 => 0.9894, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: 8.52% (0.1385 => 0.1503, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.39% (0.4805 => 0.5208, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.39% (0.2504 => 0.2714, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.36% (3.2742 => 3.5480, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.35% (0.3245 => 0.3516, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 8.14% (6.5754 => 7.1107, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/oourafft: 8.12% (0.2008 => 0.2171, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.02% (2.1007 => 2.2692, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.90% (6.2785 => 6.7745, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.71% (0.2243 => 0.2416, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 7.67% (1.2292 => 1.3235, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: 7.52% (0.4003 => 0.4304, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.27% (13.2842 => 14.2494, std.dev.: 0.0133) SingleSource/UnitTests/ObjC/exceptions: 7.20% (0.3914 => 0.4196, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.11% (0.3940 => 0.4220, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 6.94% (0.3789 => 0.4052, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/trivial-interface: 6.90% (0.3578 => 0.3825, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.88% (0.3650 => 0.3901, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/exceptions-4: 6.86% (0.3646 => 0.3896, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.83% (0.3663 => 0.3913, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.75% (0.3601 => 0.3844, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 6.65% (0.3623 => 0.3864, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 6.02% (0.1777 => 0.1884, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 5.43% (16.2614 => 17.1448, std.dev.: 0.0197) MultiSource/Applications/ClamAV/clamscan: 5.23% (14.5298 => 15.2891, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/bh/bh: 4.44% (0.2859 => 0.2986, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 3.00% (33.2944 => 34.2930, std.dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5142, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/fbench: 25.73% (1.8175 => 2.2851, std.dev.: 0.0418) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.11% (1.0895 => 1.2759, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 11.06% (1.1560 => 1.2838, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.03% (0.8273 => 0.9020, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4138, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.43% (0.9692 => 1.0218) SingleSource/Benchmarks/Misc/mandel-2: 5.22% (1.2998 => 1.3677, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0047, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.65% (0.3139 => 0.3285, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.46% (2.8606 => 2.9881, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 4.44% (0.5449 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.91% (1.7081 => 1.7749, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 3.37% (12.0921 => 12.5002, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: 3.34% (1.9199 => 1.9841, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 3.24% (10.7476 => 11.0963, std.dev.: 0.0260) MultiSource/Benchmarks/nbench/nbench: 3.23% (11.2619 => 11.6260, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bisort/bisort: 2.95% (0.8239 => 0.8482, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0310 => 1.0560, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.22% (7.4271 => 7.5919, std.dev.: 0.0038) MultiSource/Applications/lemon/lemon: 1.86% (1.4298 => 1.4564, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5146, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2123, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1874, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.20% (5.5130 => 5.5789, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.17% (9.9194 => 10.0357, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 1.11% (12.4560 => 12.5946, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1407, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/queens: 1.01% (2.1753 => 2.1972, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.40% (0.2670 => 0.1431) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.02% (0.4657 => 0.3911, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.64% (1.3813 => 1.2205, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.56% (1.3819 => 1.2222, std.dev.: 0.0077) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.28% (1.0460 => 0.8548) MultiSource/Benchmarks/FreeBench/mason/mason: -12.73% (0.2238 => 0.1953, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.11% (20.3410 => 18.2839, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8095, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: -5.68% (1.2308 => 1.1609, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.53% (1.3780 => 1.3018, std.dev.: 0.0150) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.09% (2.6470 => 2.5122, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.80% (0.9996 => 0.9516, std.dev.: 0.0109) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.90% (1.7688 => 1.6999, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -2.90% (3.0263 => 2.9386, std.dev.: 0.0015) MultiSource/Applications/siod/siod: -2.87% (3.2729 => 3.1791, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/bh/bh: -2.74% (1.9762 => 1.9221, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8813, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.37% (4.1080 => 4.0108, std.dev.: 0.0042) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.06% (0.6589 => 0.6453, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.94% (6.3560 => 6.2330, std.dev.: 0.0092) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.87% (0.6615 => 0.6491, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -1.78% (26.5159 => 26.0426, std.dev.: 0.0336) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.67% (0.8342 => 0.8203, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.60% (2.5254 => 2.4851, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0070, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.42% (3.9173 => 3.8617, std.dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: -1.34% (5.3167 => 5.2454, std.dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: -1.24% (28.2225 => 27.8727, std.dev.: 0.0002) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1139, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -1.05% (84.4286 => 83.5406, std.dev.: 0.0040) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 19 21:00:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 19 Oct 2012 23:00:43 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121020040043.E427E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5026?compare_to=5023&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5026, Order: 166361, Start Time: 2012-10-20 02:39:06, End Time: 2012-10-20 04:02:45 To: 5023, Order: 166354, Start Time: 2012-10-20 00:58:31, End Time: 2012-10-20 02:22:16 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 5 (16 on baseline) Performance Improvements: 2 (6 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 968 (952 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 4.40% (8.2221 => 8.5840, std.dev.: 0.0508) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: 7.08% (3.0231 => 3.2372, std.dev.: 0.0156) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.41% (21.4138 => 22.3584, std.dev.: 0.1271) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.19% (0.7542 => 0.7858, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.12% (3.5560 => 3.5958, std.dev.: 0.0069) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.53% (1.3457 => 1.3251, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.35% (0.9189 => 0.9065, std.dev.: 0.0040) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.76% (16.5419 => 16.4159, std.dev.: 0.1674) MultiSource/Applications/obsequi/Obsequi: 1.28% (1.0320 => 1.0452, std.dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: -0.99% (0.6391 => 0.6328, std.dev.: 0.0126) MultiSource/Benchmarks/McCat/08-main/main: 1.74% (0.1840 => 0.1872, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.12% (0.1637 => 0.1635, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.72% (0.3214 => 0.3191, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.91% (0.2466 => 0.2419, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.81% (0.3329 => 0.3302, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.09% (0.2324 => 0.2419, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: -0.49% (0.5976 => 0.5947, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/mandel: 18.98% (0.0411 => 0.0489, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.24% (0.3277 => 0.3285, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/strcat: 0.20% (0.1976 => 0.1980, std.dev.: 0.0012) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 19.90% (0.0201 => 0.0241, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.94% (0.0212 => 0.0214) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0419 => 0.0419, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0324 => 0.0324, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0307 => 0.0307, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.48% (0.0416 => 0.0414, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0198 => 0.0198, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0212 => 0.0212, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 0.32% (0.0313 => 0.0314, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 7.69% (0.0013 => 0.0014) MultiSource/Applications/ClamAV/clamscan: 0.48% (0.1472 => 0.1479, std.dev.: 0.0033) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.31% (1.1453 => 1.1489, std.dev.: 0.0452) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.20% (0.1517 => 0.1514, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.30% (0.3998 => 0.4010, std.dev.: 0.0190) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.38% (0.1394 => 0.1469, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.50% (0.0645 => 0.0674, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -9.85% (0.0274 => 0.0247, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.78% (0.0561 => 0.0571, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.24% (1.1455 => 1.1427, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.77% (0.0031 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -69.23% (0.0026 => 0.0008, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.76% (0.0630 => 0.0537, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -9.60% (0.0250 => 0.0226, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.00% (0.7927 => 0.8006, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 91.67% (0.0036 => 0.0069, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.25% (2.1832 => 1.6537, std.dev.: 0.0295) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 12.47% (0.0810 => 0.0911, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.92% (0.2180 => 0.2309, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.65% (0.2279 => 0.2385, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.56% (0.7473 => 0.7739, std.dev.: 0.0073) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.25% (0.3137 => 0.3239, std.dev.: 0.0029) SingleSource/UnitTests/Vector/constpool: 1.97% (8.4179 => 8.5840, std.dev.: 0.0508) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.74% (1.1685 => 1.1888, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.06% (4.4873 => 4.5347, std.dev.: 0.0184) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.27% (1.5795 => 2.4998, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.42% (1.1857 => 1.2855, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.09% (3.0515 => 3.2372, std.dev.: 0.0156) MultiSource/Benchmarks/mafft/pairlocalalign: 5.98% (63.1822 => 66.9629, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.44% (0.7597 => 0.7858, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/ReedSolomon: 2.78% (8.5322 => 8.7694, std.dev.: 0.0492) MultiSource/Applications/siod/siod: 2.69% (3.6643 => 3.7627, std.dev.: 0.0215) MultiSource/Benchmarks/llubenchmark/llu: 1.80% (1.9967 => 2.0327, std.dev.: 0.0098) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -1.10% (1.2602 => 1.2464, std.dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.71% (0.3269 => 0.3017, std.dev.: 0.0009) MultiSource/Applications/lua/lua: -4.71% (29.8330 => 28.4267, std.dev.: 0.3610) SingleSource/Benchmarks/Shootout-C++/hash2: -1.57% (3.4237 => 3.3699, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.44% (1.0388 => 1.0238, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.35% (3.3479 => 3.3028, std.dev.: 0.0094) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.18% (16.4461 => 16.4159, std.dev.: 0.1674) MultiSource/Applications/obsequi/Obsequi: 1.85% (1.0262 => 1.0452, std.dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: -0.06% (0.6332 => 0.6328, std.dev.: 0.0126) MultiSource/Benchmarks/McCat/08-main/main: 2.24% (0.1831 => 0.1872, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.87% (0.1559 => 0.1635, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.18% (0.3123 => 0.3191, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.79% (0.2463 => 0.2419, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.26% (0.3344 => 0.3302, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.33% (0.2364 => 0.2419, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: -1.05% (0.6010 => 0.5947, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/mandel: 13.99% (0.0429 => 0.0489, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.58% (0.3266 => 0.3285, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/strcat: 0.56% (0.1969 => 0.1980, std.dev.: 0.0012) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.59% (0.0224 => 0.0241, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 73.98% (0.0123 => 0.0214) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.70% (0.0408 => 0.0419, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 27.56% (0.0254 => 0.0324, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.66% (0.0302 => 0.0307, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 7.81% (0.0384 => 0.0414, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 4.21% (0.0190 => 0.0198, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 17.78% (0.0180 => 0.0212, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 36.52% (0.0230 => 0.0314, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 100.00% (0.0007 => 0.0014) MultiSource/Applications/ClamAV/clamscan: 2.85% (0.1438 => 0.1479, std.dev.: 0.0033) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 1.41% (1.1329 => 1.1489, std.dev.: 0.0452) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.56% (0.1462 => 0.1514, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.70% (0.4164 => 0.4010, std.dev.: 0.0190) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.30% (0.1369 => 0.1469, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.15% (0.0641 => 0.0674, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 26.67% (0.0195 => 0.0247, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.21% (0.0578 => 0.0571, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.09% (1.1437 => 1.1427, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -42.86% (0.0014 => 0.0008, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.35% (0.0627 => 0.0537, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.56% (0.0180 => 0.0226, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.14% (0.8017 => 0.8006, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 11.29% (0.0062 => 0.0069, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 19 21:23:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 19 Oct 2012 23:23:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121020042309.B87462A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5027?compare_to=5024&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5027, Order: 166361, Start Time: 2012-10-20 03:05:08, End Time: 2012-10-20 04:25:09 To: 5024, Order: 166354, Start Time: 2012-10-20 01:15:06, End Time: 2012-10-20 02:35:27 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (75 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (189 on baseline) Performance Improvements: 1 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 90 (15 on baseline) Unchanged Tests: 951 (654 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -2.88% (56.1221 => 54.5037, std.dev.: 0.1409) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.08% (0.6135 => 0.6140, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 0.05% (17.1677 => 17.1757, std.dev.: 0.0083) MultiSource/Benchmarks/Bullet/bullet: -0.12% (56.1954 => 56.1275, std.dev.: 0.0118) MultiSource/Benchmarks/MallocBench/gs/gs: -0.16% (4.5855 => 4.5781, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.82% (0.0485 => 0.0481, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.82% (0.0486 => 0.0482, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.44% (0.0453 => 0.0451, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.44% (0.0454 => 0.0452, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.23% (0.0442 => 0.0441, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.68% (0.0444 => 0.0441, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.69% (0.0437 => 0.0434, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.23% (0.0437 => 0.0436, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.66% (0.0454 => 0.0451, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.66% (0.0456 => 0.0453, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.45% (0.0449 => 0.0447, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.89% (0.0451 => 0.0447, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.46% (0.0438 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.45% (0.0440 => 0.0438, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.45% (0.0446 => 0.0444) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.11% (0.0449 => 0.0444, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.66% (0.0458 => 0.0455, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.65% (0.0459 => 0.0456, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.46% (0.0434 => 0.0432, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.69% (0.0435 => 0.0432, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.45% (0.0446 => 0.0444, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.89% (0.0448 => 0.0444, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.46% (0.0437 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.46% (0.0439 => 0.0437, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.47% (0.0429 => 0.0427, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.70% (0.0431 => 0.0428, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.47% (0.0429 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.70% (0.0430 => 0.0427, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.86% (0.0466 => 0.0462, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.86% (0.0467 => 0.0463, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.47% (0.0427 => 0.0425, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.47% (0.0428 => 0.0426, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.47% (0.0428 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.47% (0.0429 => 0.0427, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.69% (0.0436 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.46% (0.0437 => 0.0435, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.15% (1.3000 => 1.2980, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.09% (8.1745 => 8.1820, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.18% (0.7768 => 0.7754, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -1.13% (0.0355 => 0.0351, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: - (0.1648 => 0.1648) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.22% (0.2205 => 0.2134, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.25% (63.2438 => 56.1275, std.dev.: 0.0118) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 0.55% (0.1639 => 0.1648) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 36.01% (14.1553 => 19.2525, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.91% (3.4629 => 5.7800, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13402.08% (0.0720 => 9.7215, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050200.00% (0.0001 => 10.0503, std.dev.: 0.0011) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 64.13% (0.2554 => 0.4192, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 55.47% (0.0256 => 0.0398, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 46.39% (10.3673 => 15.1772, std.dev.: 0.0105) SingleSource/UnitTests/SignlessTypes/factor: 44.59% (0.0296 => 0.0428, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 37.79% (0.1622 => 0.2235, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 36.08% (0.1056 => 0.1437, std.dev.: 0.0003) SingleSource/UnitTests/vla: 31.83% (0.0355 => 0.0468, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 23.86% (0.0834 => 0.1033, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.18% (0.1566 => 0.1882, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 18.78% (0.1432 => 0.1701, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.74% (7.0540 => 8.3762, std.dev.: 0.0130) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.03% (0.0871 => 0.1028, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 17.68% (0.1555 => 0.1830, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.39% (0.5105 => 0.5993, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.25% (2.2022 => 2.5821, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.11% (0.6675 => 0.7817, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 16.25% (0.1655 => 0.1924, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 16.14% (3.3354 => 3.8737, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout/lists: 16.13% (0.0626 => 0.0727, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.10% (1.3050 => 1.5151, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.03% (0.2271 => 0.2635, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 15.69% (0.1440 => 0.1666, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 15.58% (0.1695 => 0.1959, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 15.32% (0.1175 => 0.1355, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.32% (0.5020 => 0.5789, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 15.01% (0.0793 => 0.0912, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 14.96% (0.1163 => 0.1337, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 14.73% (0.8172 => 0.9376, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.70% (0.1510 => 0.1732) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.67% (0.0886 => 0.1016, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 14.65% (0.7115 => 0.8157, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.54% (0.1940 => 0.2222, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.44% (0.1337 => 0.1530, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.32% (0.4615 => 0.5276, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 14.32% (0.3282 => 0.3752, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 14.31% (0.3109 => 0.3554, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.23% (1.5415 => 1.7609, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 14.20% (0.3423 => 0.3909, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 14.18% (9.4845 => 10.8298, std.dev.: 0.0092) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.13% (0.0842 => 0.0961, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 14.06% (0.0818 => 0.0933, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.95% (0.9765 => 1.1127, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 13.88% (0.0814 => 0.0927, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 13.83% (0.1584 => 0.1803, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.81% (0.3121 => 0.3552) SingleSource/Benchmarks/BenchmarkGame/n-body: 13.81% (0.0746 => 0.0849, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 13.73% (1.1642 => 1.3241, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.72% (1.7609 => 2.0025, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.67% (0.1236 => 0.1405, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 13.64% (0.1151 => 0.1308, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.61% (0.1117 => 0.1269, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.58% (4.2646 => 4.8438, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.57% (0.2107 => 0.2393, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.57% (0.1032 => 0.1172, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 13.46% (0.6450 => 0.7318, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.40% (0.5860 => 0.6645, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.38% (0.1906 => 0.2161, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.31% (0.2758 => 0.3125, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.19% (8.1363 => 9.2094, std.dev.: 0.0100) MultiSource/Applications/lambda-0_1_3/lambda: 13.09% (0.7433 => 0.8406, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.03% (0.2065 => 0.2334, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 12.99% (0.7835 => 0.8853, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.97% (0.0933 => 0.1054, std.dev.: 0.0024) MultiSource/Applications/treecc/treecc: 12.93% (2.0273 => 2.2895, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.93% (0.1029 => 0.1162, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.87% (0.1438 => 0.1623, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.80% (0.1695 => 0.1912, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 12.71% (0.1463 => 0.1649, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.71% (0.1062 => 0.1197, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.70% (0.0929 => 0.1047) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.66% (0.0798 => 0.0899, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 12.65% (5.7591 => 6.4877, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.59% (0.2700 => 0.3040, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/rem: 12.59% (0.1144 => 0.1288, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 12.46% (3.8723 => 4.3547, std.dev.: 0.0117) MultiSource/Applications/lemon/lemon: 12.45% (1.0722 => 1.2057, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.42% (0.1143 => 0.1285, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.38% (4.9449 => 5.5573, std.dev.: 0.0029) MultiSource/Benchmarks/sim/sim: 12.37% (0.3387 => 0.3806, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.37% (0.1625 => 0.1826, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.34% (0.5981 => 0.6719, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.29% (5.0018 => 5.6164, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.25% (0.8067 => 0.9055, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.24% (0.4879 => 0.5476, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 12.23% (10.4361 => 11.7120, std.dev.: 0.0113) MultiSource/Benchmarks/Olden/health/health: 12.22% (0.1268 => 0.1423, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 12.17% (0.4299 => 0.4822, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.03% (0.1330 => 0.1490, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.00% (0.3307 => 0.3704, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.92% (0.5569 => 0.6233, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 11.87% (1.1840 => 1.3245, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.80% (0.3177 => 0.3552, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.80% (1.1861 => 1.3261, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.72% (7.9617 => 8.8945, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/09-vor/vor: 11.54% (0.3180 => 0.3547, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 11.50% (1.4186 => 1.5817, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.48% (1.5859 => 1.7679, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 11.47% (0.8921 => 0.9944, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.29% (0.1125 => 0.1252, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.07% (0.3441 => 0.3822, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 10.97% (1.5603 => 1.7314, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/bigfib: 10.92% (0.6456 => 0.7161, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.87% (0.3543 => 0.3928, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.65% (2.2024 => 2.4370, std.dev.: 0.0074) MultiSource/Applications/siod/siod: 10.55% (2.2969 => 2.5393, std.dev.: 0.0153) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.53% (0.2603 => 0.2877, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.44% (0.3543 => 0.3913, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.37% (0.3473 => 0.3833, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.34% (0.3927 => 0.4333, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.27% (0.8101 => 0.8933, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/synchronized: 10.25% (0.3561 => 0.3926, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.18% (0.3497 => 0.3853, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.15% (0.3694 => 0.4069, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.14% (0.3828 => 0.4216, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.11% (0.2266 => 0.2495, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.10% (0.3516 => 0.3871, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.04% (0.1892 => 0.2082, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.01% (0.3886 => 0.4275, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 9.96% (0.2049 => 0.2253, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 9.89% (0.4289 => 0.4713, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/hash2: 9.78% (0.4620 => 0.5072, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 9.67% (0.1044 => 0.1145, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.57% (0.3826 => 0.4192, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.37% (0.3865 => 0.4227, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 9.32% (0.3422 => 0.3741, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 9.24% (21.9371 => 23.9631, std.dev.: 0.0270) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.21% (0.4636 => 0.5063, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.19% (0.4103 => 0.4480, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.06% (0.4203 => 0.4584, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 8.90% (0.3684 => 0.4012, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 8.89% (0.4048 => 0.4408, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.49% (0.3427 => 0.3718, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sieve: 8.19% (0.3603 => 0.3898, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 8.18% (0.6030 => 0.6523, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 8.15% (0.3092 => 0.3344, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.07% (0.5925 => 0.6403, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 7.96% (17.1811 => 18.5488, std.dev.: 0.0220) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.70% (0.3650 => 0.3931, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.57% (0.2430 => 0.2614, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.53% (14.3668 => 15.4483, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/matrix: 7.52% (0.3098 => 0.3331, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.48% (0.4064 => 0.4368, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.43% (0.3162 => 0.3397, std.dev.: 0.0075) SingleSource/UnitTests/ObjC++/property-reference: 7.41% (0.7326 => 0.7869, std.dev.: 0.0097) SingleSource/Regression/C++/ofstream_ctor: 7.40% (0.2905 => 0.3120, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.37% (0.2891 => 0.3104, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.31% (0.3283 => 0.3523, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.28% (0.2831 => 0.3037, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 7.24% (0.3232 => 0.3466, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.16% (3.8922 => 4.1707, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.09% (2.0665 => 2.2131, std.dev.: 0.0290) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.08% (0.3136 => 0.3358, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.04% (0.2756 => 0.2950, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.03% (0.2872 => 0.3074, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 7.02% (0.2877 => 0.3079, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.02% (0.2793 => 0.2989, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.01% (0.2725 => 0.2916, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.93% (0.2871 => 0.3070, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.88% (0.3052 => 0.3262, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 6.74% (0.2714 => 0.2897, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 6.72% (0.3379 => 0.3606, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.71% (0.2802 => 0.2990, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 6.10% (1.2842 => 1.3625, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/objinst: 5.88% (0.3131 => 0.3315, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.00% (0.3935 => 0.4053, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.85% (1.1194 => 1.1513, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.62% (0.3817 => 0.3917, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8963, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.57% (1.1145 => 1.2992, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.75% (0.2944 => 0.3290, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 10.71% (0.9957 => 1.1023, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: 9.99% (1.1396 => 1.2535, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.11% (0.9540 => 1.0218) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (3.1578 => 3.3673, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: 5.51% (1.9405 => 2.0475, std.dev.: 0.0005) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.67% (4.2280 => 4.3410, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.40% (1.0313 => 1.0561, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7655, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 1.76% (0.8333 => 0.8480, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.74% (3.6395 => 3.7030, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.56% (2.6546 => 2.6961, std.dev.: 0.0023) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2079, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 1.33% (4.4649 => 4.5243, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.02% (6.6874 => 0.1326, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -79.86% (0.8651 => 0.1742, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.11% (5.2763 => 3.2657, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.25% (5.3855 => 3.7026, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.01% (5.3526 => 3.6928, std.dev.: 0.0022) SingleSource/UnitTests/Vector/constpool: -14.59% (54.1659 => 46.2646, std.dev.: 0.0283) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.50% (2.9384 => 2.6298, std.dev.: 0.0154) MultiSource/Applications/ClamAV/clamscan: -6.63% (22.1758 => 20.7055, std.dev.: 0.0156) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.07% (8.0499 => 3.7778, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.45% (1.1492 => 0.7648, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: -15.75% (1.6925 => 1.4260, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.83% (0.0998 => 0.0850, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.65% (1.2373 => 1.0931, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3453 => 2.9599, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -10.67% (1.5373 => 1.3732, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.42% (19.9488 => 18.2689, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/mason/mason: -8.01% (0.2161 => 0.1988, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.07% (1.8329 => 1.7034, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.19% (1.6805 => 1.5933, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -5.00% (1.5835 => 1.5043, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.41% (8.1563 => 7.7965, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Applications/siod/siod: -3.64% (3.2827 => 3.1632, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -3.39% (5.0483 => 4.8774, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4945, std.dev.: 0.0023) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.85% (0.4808 => 0.4671, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Applications/sqlite3/sqlite3: -2.03% (4.6441 => 4.5500, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -1.79% (10.2830 => 10.0992, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6816, std.dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5093, std.dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4214, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/lists: -1.30% (6.2999 => 6.2178, std.dev.: 0.0132) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.12% (2.3135 => 2.2877, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8588, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 17.42% (0.5229 => 0.6140, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 14.58% (14.9895 => 17.1757, std.dev.: 0.0083) MultiSource/Benchmarks/MallocBench/gs/gs: 11.38% (4.1105 => 4.5781, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.49% (1.1048 => 1.2980, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.30% (7.1582 => 8.1820, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.62% (0.6222 => 0.7754, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35000.00% (0.0001 => 0.0351, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.85% (0.2116 => 0.2134, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 19 22:41:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 20 Oct 2012 00:41:07 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121020054107.1A81F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5028?compare_to=5026&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5028, Order: 166364, Start Time: 2012-10-20 04:19:37, End Time: 2012-10-20 05:43:08 To: 5026, Order: 166361, Start Time: 2012-10-20 02:39:06, End Time: 2012-10-20 04:02:45 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 9 (23 on baseline) Performance Improvements: 3 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 963 (947 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.26% (0.3021 => 0.3180, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.21% (0.6074 => 0.6269, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.47% (0.8230 => 0.8433, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.99% (0.9504 => 0.9693, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.99% (3.1978 => 3.2613, std.dev.: 0.0181) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.92% (0.8637 => 0.8803, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/football/football: 1.36% (0.8662 => 0.8780, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 17.95% (19.6624 => 23.1919, std.dev.: 0.8157) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.29% (0.3198 => 0.3463, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -4.93% (0.2475 => 0.2353, std.dev.: 0.0022) MultiSource/Applications/Burg/burg: -1.05% (1.2564 => 1.2432, std.dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.74% (1.4044 => 1.3800, std.dev.: 0.0044) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.09% (16.4159 => 16.4018, std.dev.: 0.0922) MultiSource/Applications/obsequi/Obsequi: -1.52% (1.0452 => 1.0293, std.dev.: 0.0118) MultiSource/Applications/sqlite3/sqlite3: -0.32% (0.6328 => 0.6308, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/08-main/main: 1.76% (0.1872 => 0.1905, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.49% (0.1635 => 0.1692, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.69% (0.3191 => 0.3169, std.dev.: 0.0072) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.86% (0.2419 => 0.2464, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.03% (0.3302 => 0.3301, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.29% (0.2419 => 0.2412, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 0.72% (0.5947 => 0.5990, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: -16.36% (0.0489 => 0.0409, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.3285 => 0.3285, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/strcat: -0.30% (0.1980 => 0.1974, std.dev.: 0.0008) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -24.90% (0.0241 => 0.0181, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -34.58% (0.0214 => 0.0140, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -17.18% (0.0419 => 0.0347, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -3.70% (0.0324 => 0.0312, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -11.07% (0.0307 => 0.0273, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -19.81% (0.0414 => 0.0332, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/casts: -27.78% (0.0198 => 0.0143, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/test1: -27.36% (0.0212 => 0.0154, std.dev.: 0.0028) SingleSource/UnitTests/byval-alignment: 6.05% (0.0314 => 0.0333, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -7.14% (0.0014 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1479 => 0.1480, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -4.68% (1.1489 => 1.0951, std.dev.: 0.0227) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -5.42% (0.1514 => 0.1432, std.dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.10% (0.4010 => 0.4014, std.dev.: 0.0276) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.57% (0.1469 => 0.1446, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.20% (0.0674 => 0.0612, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 12.15% (0.0247 => 0.0277) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.73% (0.0571 => 0.0544, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.32% (1.1427 => 1.1390, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2500.00% (0.0001 => 0.0026, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 100.00% (0.0008 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.91% (0.0537 => 0.0558, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.75% (0.0226 => 0.0239, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.21% (0.8006 => 0.8023, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0069 => 0.0069, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.86% (2.1832 => 1.6622, std.dev.: 0.0019) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.44% (0.0810 => 0.0927, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.79% (0.8321 => 0.8803, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.87% (0.2279 => 0.2390, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.84% (0.7473 => 0.7835, std.dev.: 0.0039) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.56% (0.3137 => 0.3280, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.51% (0.2240 => 0.2341, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.31% (0.6010 => 0.6269, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.50% (0.8148 => 0.8433, std.dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: 2.98% (8.4179 => 8.6690, std.dev.: 0.0758) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.77% (0.5961 => 0.6126, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.73% (0.9435 => 0.9693, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.45% (3.1832 => 3.2613, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.80% (0.8050 => 0.8195, std.dev.: 0.0049) MultiSource/Applications/hbd/hbd: 1.77% (1.4269 => 1.4522, std.dev.: 0.0057) MultiSource/Applications/Burg/burg: 1.72% (1.2222 => 1.2432, std.dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.66% (1.5795 => 2.5061, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.69% (0.3186 => 0.3463, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.43% (1.1857 => 1.2856, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 5.94% (63.1822 => 66.9361, std.dev.: 0.0534) MultiSource/Applications/siod/siod: 2.37% (3.6643 => 3.7511, std.dev.: 0.0128) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.26% (2.4490 => 2.5044, std.dev.: 0.0174) MultiSource/Applications/minisat/minisat: 1.78% (6.1525 => 6.2621, std.dev.: 0.0307) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.24% (1.5941 => 1.6138, std.dev.: 0.0069) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -10.31% (0.3269 => 0.2932, std.dev.: 0.0020) MultiSource/Applications/lua/lua: -5.21% (29.8330 => 28.2778, std.dev.: 0.0532) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.26% (7.2130 => 7.0497, std.dev.: 0.0515) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.25% (3.3479 => 3.3061, std.dev.: 0.0097) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.27% (16.4461 => 16.4018, std.dev.: 0.0922) MultiSource/Applications/obsequi/Obsequi: 0.30% (1.0262 => 1.0293, std.dev.: 0.0118) MultiSource/Applications/sqlite3/sqlite3: -0.38% (0.6332 => 0.6308, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/08-main/main: 4.04% (0.1831 => 0.1905, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 8.53% (0.1559 => 0.1692, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.47% (0.3123 => 0.3169, std.dev.: 0.0072) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.04% (0.2463 => 0.2464, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (0.3344 => 0.3301, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (0.2364 => 0.2412, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: -0.33% (0.6010 => 0.5990, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: -4.66% (0.0429 => 0.0409, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.58% (0.3266 => 0.3285, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/strcat: 0.25% (0.1969 => 0.1974, std.dev.: 0.0008) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -19.20% (0.0224 => 0.0181, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 13.82% (0.0123 => 0.0140, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -14.95% (0.0408 => 0.0347, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 22.83% (0.0254 => 0.0312, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -9.60% (0.0302 => 0.0273, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -13.54% (0.0384 => 0.0332, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/casts: -24.74% (0.0190 => 0.0143, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/test1: -14.44% (0.0180 => 0.0154, std.dev.: 0.0028) SingleSource/UnitTests/byval-alignment: 44.78% (0.0230 => 0.0333, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.92% (0.1438 => 0.1480, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -3.34% (1.1329 => 1.0951, std.dev.: 0.0227) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -2.05% (0.1462 => 0.1432, std.dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.60% (0.4164 => 0.4014, std.dev.: 0.0276) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.62% (0.1369 => 0.1446, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.52% (0.0641 => 0.0612, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.88% (0.0578 => 0.0544, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.41% (1.1437 => 1.1390, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2500.00% (0.0001 => 0.0026, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 14.29% (0.0014 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.00% (0.0627 => 0.0558, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 32.78% (0.0180 => 0.0239, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.07% (0.8017 => 0.8023, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 11.29% (0.0062 => 0.0069, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 1.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 19 22:52:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 20 Oct 2012 00:52:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121020055204.92E812A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5029?compare_to=5025&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5029, Order: 166364, Start Time: 2012-10-20 04:28:55, End Time: 2012-10-20 05:55:04 To: 5025, Order: 166361, Start Time: 2012-10-20 02:33:16, End Time: 2012-10-20 03:59:28 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (200 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1041 (665 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -1.00% (2.2851 => 2.2622, std.dev.: 0.0023) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.46% (2.0176 => 2.4909, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.99% (0.1410 => 0.1706, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 18.50% (0.2243 => 0.2658, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 18.28% (0.0826 => 0.0977, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 17.67% (0.1013 => 0.1192, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.89% (0.0746 => 0.0872, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.85% (0.0653 => 0.0763, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.80% (0.7710 => 0.9005, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.49% (0.2596 => 0.2998, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.63% (0.0834 => 0.0956, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.54% (0.1327 => 0.1520, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 14.48% (0.2721 => 0.3115, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 14.36% (0.1003 => 0.1147, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.30% (0.0811 => 0.0927, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.23% (0.1413 => 0.1614, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.17% (0.0847 => 0.0967, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.07% (0.0725 => 0.0827, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 14.04% (1.3693 => 1.5615, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.97% (0.2914 => 0.3321, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 13.94% (0.1062 => 0.1210, std.dev.: 0.0011) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.90% (0.1072 => 0.1221, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.88% (0.9199 => 1.0476, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.81% (0.6959 => 0.7920, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.79% (0.5265 => 0.5991, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 13.74% (0.7038 => 0.8005, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.70% (0.1986 => 0.2258, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.68% (3.9660 => 4.5086, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.64% (0.5637 => 0.6406, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.58% (0.1075 => 0.1221, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.35% (0.1588 => 0.1800, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 13.23% (0.1111 => 0.1258, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 13.18% (0.7460 => 0.8443, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.94% (0.0819 => 0.0925, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.93% (0.1276 => 0.1441, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.90% (0.0977 => 0.1103, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 12.80% (0.4328 => 0.4882, std.dev.: 0.0127) MultiSource/Benchmarks/FreeBench/distray/distray: 12.71% (0.0818 => 0.0922) MultiSource/Applications/Burg/burg: 12.68% (1.1061 => 1.2464, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 12.58% (0.1478 => 0.1664, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.52% (0.1014 => 0.1141, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.48% (1.4563 => 1.6381, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.40% (1.2193 => 1.3705, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.34% (0.5577 => 0.6265, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 12.27% (13.8202 => 15.5162, std.dev.: 0.0136) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.17% (0.1865 => 0.2092, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.13% (1.1364 => 1.2742, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.11% (0.2023 => 0.2268, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.08% (0.6283 => 0.7042, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 11.96% (0.4062 => 0.4548, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.95% (0.3246 => 0.3634, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.93% (0.1157 => 0.1295, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.90% (0.4379 => 0.4900, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 11.80% (0.7506 => 0.8392, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 11.76% (0.2925 => 0.3269, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.66% (0.2127 => 0.2375, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 11.65% (0.1657 => 0.1850, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 11.59% (0.2995 => 0.3342, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 11.57% (3.8646 => 4.3116, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference-object: 11.53% (0.5818 => 0.6489, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 11.34% (0.5748 => 0.6400, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.34% (0.3899 => 0.4341, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 11.32% (0.7061 => 0.7860, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.27% (0.4791 => 0.5331, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.25% (0.3130 => 0.3482, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 11.18% (0.3220 => 0.3580, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.16% (0.1048 => 0.1165, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.07% (0.1789 => 0.1987, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 11.02% (1.0313 => 1.1449, std.dev.: 0.0064) SingleSource/Regression/C++/ofstream_ctor: 11.00% (0.2781 => 0.3087, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.95% (0.3022 => 0.3353, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.88% (0.3485 => 0.3864, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.86% (0.2782 => 0.3084, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 10.84% (1.9270 => 2.1359, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 10.82% (0.1589 => 0.1761, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 10.81% (0.6744 => 0.7473, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.81% (0.4016 => 0.4450, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 10.80% (0.1213 => 0.1344, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.78% (0.3756 => 0.4161, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.77% (7.2180 => 7.9954, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.64% (0.1569 => 0.1736, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.57% (0.4390 => 0.4854, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 10.54% (16.6129 => 18.3637, std.dev.: 0.0086) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.52% (0.1435 => 0.1586, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 10.48% (0.3293 => 0.3638, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 10.42% (0.3868 => 0.4271, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 10.37% (0.8310 => 0.9172, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sieve: 10.37% (0.3453 => 0.3811, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.35% (0.3489 => 0.3850, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 10.31% (0.2726 => 0.3007, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.31% (0.3580 => 0.3949, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 10.30% (3.1889 => 3.5172, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.29% (0.8698 => 0.9593, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 10.29% (0.2761 => 0.3045, std.dev.: 0.0041) MultiSource/Applications/siod/siod: 10.25% (2.1791 => 2.4025, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/hello: 10.24% (0.2607 => 0.2874, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 10.19% (0.3534 => 0.3894, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 10.19% (0.2690 => 0.2964, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.17% (0.2655 => 0.2925, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.16% (1.9828 => 2.1843, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/fibo: 10.16% (0.2628 => 0.2895, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 10.11% (0.2937 => 0.3234, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.11% (1.3245 => 1.4584, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/except: 10.11% (0.2760 => 0.3039, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 10.11% (0.3107 => 0.3421, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 10.10% (0.3149 => 0.3467, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.95% (0.2966 => 0.3261, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.84% (4.3801 => 4.8113, std.dev.: 0.0060) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.81% (0.2140 => 0.2350, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.81% (3.6692 => 4.0292, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.74% (0.2321 => 0.2547, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.73% (0.2765 => 0.3034, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.67% (4.4433 => 4.8728, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.64% (0.2696 => 0.2956, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.60% (0.6576 => 0.7207, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/ary2: 9.59% (0.3192 => 0.3498, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 9.57% (0.2988 => 0.3274, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 9.56% (0.4113 => 0.4506, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.55% (4.9865 => 5.4629, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.45% (0.3755 => 0.4110, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 9.31% (1.0594 => 1.1580, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/objinst: 9.30% (0.2945 => 0.3219, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.24% (0.6135 => 0.6702, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 9.04% (14.8535 => 16.1968, std.dev.: 0.0065) MultiSource/Benchmarks/sim/sim: 8.85% (0.3131 => 0.3408, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.80% (0.3511 => 0.3820, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 8.76% (1.2749 => 1.3866, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 8.71% (8.4961 => 9.2364, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.60% (0.8818 => 0.9576, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.42% (1.1333 => 1.2287, std.dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.39% (1.5188 => 1.6463, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.37% (0.9108 => 0.9870, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 8.32% (0.6250 => 0.6770, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.25% (0.1819 => 0.1969, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 8.23% (0.1385 => 0.1499, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 8.18% (3.7467 => 4.0530, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.14% (3.2742 => 3.5408, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.14% (0.3245 => 0.3509, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 8.01% (4.6629 => 5.0366, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.93% (0.4805 => 0.5186, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 7.90% (6.5754 => 7.0947, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/oourafft: 7.77% (0.2008 => 0.2164, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.74% (2.1007 => 2.2632, std.dev.: 0.0085) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.67% (0.2504 => 0.2696, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.61% (6.2785 => 6.7564, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.49% (0.4003 => 0.4303, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 7.44% (1.2292 => 1.3206, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.33% (0.3914 => 0.4201, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.27% (0.2243 => 0.2406, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.21% (0.3940 => 0.4224, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 7.13% (0.3578 => 0.3833, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.07% (0.3789 => 0.4057, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.05% (0.3646 => 0.3903, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.03% (0.3601 => 0.3854, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.99% (0.3663 => 0.3919, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.97% (13.2842 => 14.2103, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.90% (0.3650 => 0.3902, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 6.79% (0.3623 => 0.3869, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 6.02% (0.1777 => 0.1884, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 5.20% (16.2614 => 17.1063, std.dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: 4.96% (14.5298 => 15.2501, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/bh/bh: 4.20% (0.2859 => 0.2979, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: 2.51% (33.2944 => 34.1299, std.dev.: 0.0105) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 30.49% (5.7573 => 7.5127, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/fbench: 24.47% (1.8175 => 2.2622, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.13% (1.0895 => 1.2761, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: 11.09% (1.1560 => 1.2842, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1916, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 8.99% (0.8273 => 0.9017, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436) SingleSource/Benchmarks/Shootout-C++/hash2: 7.62% (3.1736 => 3.4155, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.43% (0.9692 => 1.0218) SingleSource/Benchmarks/Misc/mandel-2: 5.09% (1.2998 => 1.3660, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.64% (1.9144 => 2.0032, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.46% (2.8606 => 2.9881, std.dev.: 0.0021) SingleSource/Regression/C/uint64_to_float: 4.44% (0.5449 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.89% (1.7081 => 1.7746, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.43% (10.7476 => 11.1165, std.dev.: 0.0496) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9852, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.39% (12.0921 => 12.5015, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.23% (11.2619 => 11.6253, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bisort/bisort: 2.91% (0.8239 => 0.8479, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.41% (1.0310 => 1.0558, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.16% (7.4271 => 7.5874, std.dev.: 0.0035) MultiSource/Applications/lemon/lemon: 1.77% (1.4298 => 1.4551, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5133, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2122, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1880, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5779, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.17% (8.8259 => 8.9296, std.dev.: 0.0129) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.17% (9.9194 => 10.0354, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.08% (12.4560 => 12.5907, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.52% (0.2670 => 0.1428, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.98% (0.4657 => 0.3913, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.03% (1.3813 => 1.2151, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.90% (1.3819 => 1.2175, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.28% (1.0460 => 0.8548) MultiSource/Benchmarks/FreeBench/mason/mason: -12.96% (0.2238 => 0.1948, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.05% (20.3410 => 18.2975, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -6.04% (1.2308 => 1.1564, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.04% (1.3780 => 1.2948, std.dev.: 0.0131) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5147, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.27% (0.9996 => 0.9569, std.dev.: 0.0043) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.83% (1.7688 => 1.7011, std.dev.: 0.0049) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.04% (0.4867 => 0.4719, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.90% (3.0263 => 2.9386, std.dev.: 0.0019) MultiSource/Applications/siod/siod: -2.88% (3.2729 => 3.1787, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -2.80% (1.9762 => 1.9208, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8811, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.33% (4.1080 => 4.0122, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.16% (0.6589 => 0.6447, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: -1.99% (6.3560 => 6.2296, std.dev.: 0.0074) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.86% (0.6615 => 0.6492, std.dev.: 0.0012) MultiSource/Applications/lua/lua: -1.76% (26.5159 => 26.0492, std.dev.: 0.0251) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.68% (0.8342 => 0.8202, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.65% (2.5254 => 2.4837, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0066, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8661, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: -1.23% (28.2225 => 27.8748, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.23% (5.3167 => 5.2515, std.dev.: 0.0017) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1140, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -1.05% (84.4286 => 83.5457, std.dev.: 0.0042) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 19 23:13:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 20 Oct 2012 01:13:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121020061314.CD0BA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5030?compare_to=5027&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5030, Order: 166364, Start Time: 2012-10-20 04:54:45, End Time: 2012-10-20 06:15:15 To: 5027, Order: 166361, Start Time: 2012-10-20 03:05:08, End Time: 2012-10-20 04:25:09 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (75 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 3 (189 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 90 (15 on baseline) Unchanged Tests: 949 (654 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.39% (15.1772 => 15.3876, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.29% (54.5037 => 56.2988, std.dev.: 0.1518) MultiSource/Benchmarks/llubenchmark/llu: 1.11% (3.7539 => 3.7957, std.dev.: 0.0056) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.20% (0.6140 => 0.6128, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: -0.13% (17.1757 => 17.1532, std.dev.: 0.0202) MultiSource/Benchmarks/Bullet/bullet: 0.05% (56.1275 => 56.1553, std.dev.: 0.0129) MultiSource/Benchmarks/MallocBench/gs/gs: -0.02% (4.5781 => 4.5770, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.21% (0.0481 => 0.0482, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.21% (0.0482 => 0.0483, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0451 => 0.0451, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0452 => 0.0452, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0441 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.23% (0.0441 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.23% (0.0434 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0436 => 0.0436) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.22% (0.0451 => 0.0452, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.22% (0.0453 => 0.0454, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.22% (0.0447 => 0.0448, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.22% (0.0447 => 0.0448, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.23% (0.0436 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.23% (0.0438 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.23% (0.0444 => 0.0445, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.45% (0.0444 => 0.0446, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.22% (0.0455 => 0.0456, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.44% (0.0456 => 0.0458, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0432 => 0.0432, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.23% (0.0432 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.23% (0.0444 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.23% (0.0444 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.23% (0.0435 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.23% (0.0437 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.23% (0.0427 => 0.0428, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.23% (0.0428 => 0.0429) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0427 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.23% (0.0427 => 0.0428, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.22% (0.0462 => 0.0463, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.65% (0.0463 => 0.0466, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0425 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0426 => 0.0426, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0426 => 0.0426, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0427 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.23% (0.0433 => 0.0434, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.23% (0.0435 => 0.0436) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.08% (1.2980 => 1.2990, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.04% (8.1820 => 8.1850, std.dev.: 0.0207) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.03% (0.7754 => 0.7756, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.85% (0.0351 => 0.0354, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: - (0.1648 => 0.1648, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.50% (0.2134 => 0.2166, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.21% (63.2438 => 56.1553, std.dev.: 0.0129) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 0.55% (0.1639 => 0.1648, std.dev.: 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 36.12% (14.1553 => 19.2680, std.dev.: 0.0250) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.82% (3.4629 => 5.7768, std.dev.: 0.0017) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13408.75% (0.0720 => 9.7263, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050100.00% (0.0001 => 10.0502, std.dev.: 0.0014) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.39% (0.2554 => 0.4173, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: 55.47% (0.0256 => 0.0398, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 48.42% (10.3673 => 15.3876, std.dev.: 0.0018) SingleSource/UnitTests/SignlessTypes/factor: 44.26% (0.0296 => 0.0427, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 37.61% (0.1622 => 0.2232, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/distray/distray: 35.98% (0.1056 => 0.1436, std.dev.: 0.0030) SingleSource/UnitTests/vla: 31.83% (0.0355 => 0.0468) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 23.50% (0.0834 => 0.1030, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.05% (0.1566 => 0.1880, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 19.17% (0.0798 => 0.0951, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.41% (7.0540 => 8.3529, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/flops: 18.23% (0.1432 => 0.1693, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.14% (0.0871 => 0.1029, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 17.62% (0.1555 => 0.1829, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 17.34% (0.1655 => 0.1942, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.29% (2.2022 => 2.5830, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.14% (0.5105 => 0.5980, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 16.97% (0.6675 => 0.7808, std.dev.: 0.0048) MultiSource/Applications/d/make_dparser: 16.14% (3.3354 => 3.8736, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: 16.13% (0.0626 => 0.0727, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 15.98% (0.2271 => 0.2634, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.87% (1.3050 => 1.5121, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 15.57% (0.1175 => 0.1358, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 15.56% (0.1440 => 0.1664, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 15.52% (0.1695 => 0.1958, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 15.26% (0.0793 => 0.0914, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 15.13% (0.1163 => 0.1339, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.96% (0.5020 => 0.5771, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 14.90% (0.8172 => 0.9390, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.87% (1.5415 => 1.7707, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.73% (0.1337 => 0.1534, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 14.67% (0.7115 => 0.8159, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.67% (0.0886 => 0.1016, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.64% (0.1510 => 0.1731, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.49% (0.0842 => 0.0964, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.43% (0.1940 => 0.2220, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 14.34% (0.3423 => 0.3914, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 14.24% (1.1642 => 1.3300, std.dev.: 0.0023) MultiSource/Applications/sgefa/sgefa: 14.18% (0.3109 => 0.3550, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.17% (0.4615 => 0.5269, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 14.12% (9.4845 => 10.8238, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/oourafft: 14.11% (0.3282 => 0.3745, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/matrix: 13.94% (0.0818 => 0.0932, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.78% (0.3121 => 0.3551, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/exptree: 13.76% (0.0814 => 0.0926, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.75% (0.9765 => 1.1108, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 13.70% (0.1584 => 0.1801, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.69% (0.5860 => 0.6662, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 13.67% (0.0746 => 0.0848, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.64% (4.2646 => 4.8465, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.57% (0.2107 => 0.2393, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.51% (0.1236 => 0.1403, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 13.47% (0.1151 => 0.1306, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.43% (0.1117 => 0.1267, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 13.36% (0.6450 => 0.7312, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.28% (0.1032 => 0.1169, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.20% (0.2758 => 0.3122, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 13.18% (0.7835 => 0.8868, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.12% (0.2065 => 0.2336, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.12% (0.1029 => 0.1164, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.12% (0.0770 => 0.0871, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.12% (0.1906 => 0.2156, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.04% (8.1363 => 9.1972, std.dev.: 0.0120) MultiSource/Applications/lambda-0_1_3/lambda: 13.02% (0.7433 => 0.8401, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 12.98% (0.1125 => 0.1271, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.94% (1.7609 => 1.9887, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.93% (0.2700 => 0.3049, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.90% (0.1062 => 0.1199, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 12.90% (2.0273 => 2.2888, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.86% (0.0933 => 0.1053, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.74% (0.1695 => 0.1911, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 12.71% (0.1463 => 0.1649, std.dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.60% (0.1143 => 0.1287, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.59% (0.1438 => 0.1619, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 12.50% (0.1144 => 0.1287, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.49% (0.0929 => 0.1045, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 12.48% (1.0722 => 1.2060, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.44% (0.5981 => 0.6725, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 12.42% (3.8723 => 4.3534, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 12.40% (10.4361 => 11.7300, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.31% (0.1625 => 0.1825, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.29% (4.9449 => 5.5524, std.dev.: 0.0044) MultiSource/Applications/oggenc/oggenc: 12.27% (5.7591 => 6.4660, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.25% (0.3307 => 0.3712, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.23% (5.0018 => 5.6133, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.16% (0.8067 => 0.9048, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/health/health: 12.15% (0.1268 => 0.1422, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 12.11% (0.3387 => 0.3797, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.97% (0.4879 => 0.5463, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/05-eks/eks: 11.89% (0.4299 => 0.4810, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.87% (0.5569 => 0.6230, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.84% (1.1861 => 1.3265, std.dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 11.71% (1.1840 => 1.3227, std.dev.: 0.0079) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.65% (0.1330 => 0.1485, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.65% (0.3177 => 0.3547, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 11.57% (0.3180 => 0.3548, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.53% (1.5859 => 1.7687, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 11.39% (1.4186 => 1.5802, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 11.36% (1.5603 => 1.7375, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 11.34% (0.8921 => 0.9933, std.dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.32% (7.9617 => 8.8626, std.dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.10% (0.3441 => 0.3823, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 11.07% (0.6456 => 0.7171, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.95% (0.3543 => 0.3931, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 10.79% (0.2049 => 0.2270, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.62% (0.8101 => 0.8961, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.53% (2.2024 => 2.4344, std.dev.: 0.0185) SingleSource/UnitTests/ObjC/parameter-passing: 10.47% (0.3927 => 0.4338, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.45% (0.3473 => 0.3836, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.44% (0.3543 => 0.3913, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.41% (0.2603 => 0.2874, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.39% (0.3561 => 0.3931, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 10.35% (2.2969 => 2.5347, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hash: 10.35% (0.4289 => 0.4733, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 10.31% (0.3694 => 0.4075, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.29% (0.3497 => 0.3857, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-3: 10.27% (0.3516 => 0.3877, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.24% (0.3828 => 0.4220, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.09% (0.3886 => 0.4278, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.04% (0.1892 => 0.2082, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 10.02% (0.4620 => 0.5083, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.85% (0.3826 => 0.4203, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.84% (0.2266 => 0.2489, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 9.64% (0.3422 => 0.3752, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.57% (0.3865 => 0.4235, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 9.53% (21.9371 => 24.0287, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.46% (0.4103 => 0.4491, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.35% (0.4203 => 0.4596, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 9.17% (0.3684 => 0.4022, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 9.12% (0.4048 => 0.4417, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.97% (0.4636 => 0.5052, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.61% (0.3427 => 0.3722, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/sieve: 8.49% (0.3603 => 0.3909, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 8.19% (0.2905 => 0.3143, std.dev.: 0.0052) SingleSource/UnitTests/ObjC++/property-reference-object: 8.19% (0.6030 => 0.6524, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.16% (0.2793 => 0.3021, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.13% (0.2756 => 0.2980, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.12% (0.5925 => 0.6406, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 8.12% (0.3092 => 0.3343, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 8.04% (0.2725 => 0.2944, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.95% (0.3650 => 0.3940, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 7.93% (17.1811 => 18.5433, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/matrix: 7.81% (0.3098 => 0.3340, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.78% (0.2891 => 0.3116, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.77% (0.2714 => 0.2925, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.73% (0.4064 => 0.4378, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 7.67% (0.2831 => 0.3048, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 7.64% (0.3379 => 0.3637, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 7.58% (0.3283 => 0.3532, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 7.58% (0.3232 => 0.3477, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.57% (0.2430 => 0.2614, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.56% (0.3162 => 0.3401, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.53% (0.7326 => 0.7878, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.53% (0.3136 => 0.3372, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.44% (14.3668 => 15.4354, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.40% (2.0665 => 2.2194, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 7.35% (0.2871 => 0.3082, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.35% (0.2872 => 0.3083, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 7.34% (0.3052 => 0.3276, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.33% (0.2877 => 0.3088, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.07% (0.2802 => 0.3000, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.98% (3.8922 => 4.1638, std.dev.: 0.0166) MultiSource/Applications/hexxagon/hexxagon: 6.39% (1.2842 => 1.3662, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 6.16% (0.3131 => 0.3324, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.30% (0.3935 => 0.4065, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.80% (1.1194 => 1.1507, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.78% (0.3817 => 0.3923, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.51% (1.1145 => 1.2985, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.99% (1.1396 => 1.2535, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 9.54% (0.9957 => 1.0907, std.dev.: 0.0094) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.1578 => 3.3686, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 5.52% (1.9405 => 2.0476, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.66% (4.2280 => 4.3406, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.94% (3.6395 => 3.7100, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/bisort/bisort: 1.87% (0.8333 => 0.8489, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.53% (2.6546 => 2.6951, std.dev.: 0.0020) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2077, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 1.24% (4.4649 => 4.5203, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.99% (6.6874 => 0.1344, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -79.77% (0.8651 => 0.1750, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.18% (5.2763 => 3.2620, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.32% (5.3855 => 3.6986, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.00% (5.3526 => 3.6932, std.dev.: 0.0049) SingleSource/UnitTests/Vector/constpool: -14.60% (54.1659 => 46.2566, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.48% (2.9384 => 2.6305, std.dev.: 0.0075) MultiSource/Applications/ClamAV/clamscan: -6.64% (22.1758 => 20.7029, std.dev.: 0.0065) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.09% (8.0499 => 3.7759, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7652, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: -15.75% (1.6925 => 1.4259, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -12.23% (1.2373 => 1.0860, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3453 => 2.9599, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -10.86% (1.5373 => 1.3704, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.35% (19.9488 => 18.2838, std.dev.: 0.0122) MultiSource/Benchmarks/FreeBench/mason/mason: -8.01% (0.2161 => 0.1988, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.99% (1.8329 => 1.7047, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.64% (1.9577 => 1.8473, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.17% (1.6805 => 1.5936, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.83% (1.5835 => 1.5070, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.44% (8.1563 => 7.7945, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Applications/siod/siod: -3.67% (3.2827 => 3.1623, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -3.39% (5.0483 => 4.8774, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.4990, std.dev.: 0.0111) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.56% (0.4808 => 0.4685, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Applications/sqlite3/sqlite3: -2.01% (4.6441 => 4.5508, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: -1.81% (10.2830 => 10.0967, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/flops: -1.69% (8.8334 => 8.6840, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.67% (2.5528 => 2.5101, std.dev.: 0.0047) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4205, std.dev.: 0.0089) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2879, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8575, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2359, std.dev.: 0.0050) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 17.19% (0.5229 => 0.6128, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 14.43% (14.9895 => 17.1532, std.dev.: 0.0202) MultiSource/Benchmarks/MallocBench/gs/gs: 11.35% (4.1105 => 4.5770, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.58% (1.1048 => 1.2990, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.34% (7.1582 => 8.1850, std.dev.: 0.0207) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.65% (0.6222 => 0.7756, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35300.00% (0.0001 => 0.0354, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.36% (0.2116 => 0.2166, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 20 00:20:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 20 Oct 2012 02:20:50 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121020072050.0AF122A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5031?compare_to=5028&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5031, Order: 166367, Start Time: 2012-10-20 05:59:50, End Time: 2012-10-20 07:22:51 To: 5028, Order: 166364, Start Time: 2012-10-20 04:19:37, End Time: 2012-10-20 05:43:08 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 7 (14 on baseline) Performance Improvements: 4 (7 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 964 (953 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 9.79% (0.1491 => 0.1637, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 12.81% (0.7706 => 0.8693, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.07% (21.5801 => 22.2428, std.dev.: 0.1595) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.93% (6.3768 => 6.5638, std.dev.: 0.0698) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.58% (1.1322 => 1.1614, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.83% (2.5261 => 2.5723, std.dev.: 0.0167) MultiSource/Benchmarks/Olden/em3d/em3d: 1.12% (5.3987 => 5.4592, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.79% (3.2613 => 3.2030, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -1.57% (0.8195 => 0.8066, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.97% (4.8268 => 4.5384, std.dev.: 0.0747) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.36% (1.0406 => 1.0160, std.dev.: 0.0083) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.12% (16.4018 => 16.4223, std.dev.: 0.1282) MultiSource/Applications/obsequi/Obsequi: 1.19% (1.0293 => 1.0415, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: -0.08% (0.6308 => 0.6303, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/08-main/main: -1.00% (0.1905 => 0.1886, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.55% (0.1692 => 0.1632, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.22% (0.3169 => 0.3162, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.18% (0.2464 => 0.2435, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.33% (0.3301 => 0.3345, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.95% (0.2412 => 0.2389, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: -0.57% (0.5990 => 0.5956, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: 11.00% (0.0409 => 0.0454, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.27% (0.3285 => 0.3276, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/strcat: -0.56% (0.1974 => 0.1963, std.dev.: 0.0030) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 10.50% (0.0181 => 0.0200, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -9.29% (0.0140 => 0.0127, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 20.75% (0.0347 => 0.0419, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 4.49% (0.0312 => 0.0326, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 12.82% (0.0273 => 0.0308, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 25.30% (0.0332 => 0.0416, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 34.27% (0.0143 => 0.0192, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -8.44% (0.0154 => 0.0141, std.dev.: 0.0035) SingleSource/UnitTests/byval-alignment: -1.80% (0.0333 => 0.0327, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: - (0.1480 => 0.1480, std.dev.: 0.0029) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 4.85% (1.0951 => 1.1482, std.dev.: 0.0193) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 4.61% (0.1432 => 0.1498, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.07% (0.4014 => 0.4017, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.94% (0.1446 => 0.1389, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.90% (0.0612 => 0.0582, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -18.77% (0.0277 => 0.0225, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.21% (0.0544 => 0.0532, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.36% (1.1390 => 1.1431, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.15% (0.0026 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -68.75% (0.0016 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.61% (0.0558 => 0.0549, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.88% (0.0239 => 0.0213, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.91% (0.8023 => 0.7950, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -10.14% (0.0069 => 0.0062, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.04% (2.1832 => 1.6584, std.dev.: 0.0033) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 8.99% (0.1112 => 0.1212, std.dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.34% (0.3137 => 0.3273, std.dev.: 0.0049) MultiSource/Applications/Burg/burg: 2.51% (1.2222 => 1.2529, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.02% (1.3279 => 1.3415, std.dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.77% (1.5795 => 2.5077, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.42% (1.1857 => 1.2855, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 5.91% (63.1822 => 66.9168, std.dev.: 0.0325) SingleSource/Benchmarks/Misc/ReedSolomon: 2.96% (8.5322 => 8.7845, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.93% (6.3772 => 6.5638, std.dev.: 0.0698) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.92% (2.4490 => 2.5204, std.dev.: 0.0191) MultiSource/Applications/siod/siod: 2.72% (3.6643 => 3.7640, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.19% (1.1365 => 1.1614, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.34% (1.5941 => 1.6154, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/bh/bh: 1.29% (2.3560 => 2.3863, std.dev.: 0.0063) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -8.93% (3.2926 => 2.9986, std.dev.: 0.1000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.32% (0.3269 => 0.2997, std.dev.: 0.0011) MultiSource/Applications/lua/lua: -5.24% (29.8330 => 28.2700, std.dev.: 0.0660) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.36% (2.6356 => 2.5734, std.dev.: 0.0234) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.19% (1.0388 => 1.0160, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/hash2: -1.47% (3.4237 => 3.3735, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.21% (3.3479 => 3.3074, std.dev.: 0.0016) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.14% (16.4461 => 16.4223, std.dev.: 0.1282) MultiSource/Applications/obsequi/Obsequi: 1.49% (1.0262 => 1.0415, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: -0.46% (0.6332 => 0.6303, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/08-main/main: 3.00% (0.1831 => 0.1886, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.68% (0.1559 => 0.1632, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.25% (0.3123 => 0.3162, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.14% (0.2463 => 0.2435, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.03% (0.3344 => 0.3345, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.06% (0.2364 => 0.2389, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: -0.90% (0.6010 => 0.5956, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: 5.83% (0.0429 => 0.0454, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.31% (0.3266 => 0.3276, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/strcat: -0.30% (0.1969 => 0.1963, std.dev.: 0.0030) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -10.71% (0.0224 => 0.0200, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 3.25% (0.0123 => 0.0127, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.70% (0.0408 => 0.0419, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 28.35% (0.0254 => 0.0326, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.99% (0.0302 => 0.0308, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 8.33% (0.0384 => 0.0416, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 1.05% (0.0190 => 0.0192, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -21.67% (0.0180 => 0.0141, std.dev.: 0.0035) SingleSource/UnitTests/byval-alignment: 42.17% (0.0230 => 0.0327, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.92% (0.1438 => 0.1480, std.dev.: 0.0029) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.35% (1.1329 => 1.1482, std.dev.: 0.0193) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 2.46% (0.1462 => 0.1498, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.53% (0.4164 => 0.4017, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.46% (0.1369 => 0.1389, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.20% (0.0641 => 0.0582, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 15.38% (0.0195 => 0.0225, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.96% (0.0578 => 0.0532, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.05% (1.1437 => 1.1431, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -64.29% (0.0014 => 0.0005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.44% (0.0627 => 0.0549, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.33% (0.0180 => 0.0213, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.84% (0.8017 => 0.7950, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0062 => 0.0062, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 20 00:50:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 20 Oct 2012 02:50:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121020075025.1B2772A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/5032?compare_to=5029&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5032, Order: 166367, Start Time: 2012-10-20 06:24:33, End Time: 2012-10-20 07:53:24 To: 5029, Order: 166364, Start Time: 2012-10-20 04:28:55, End Time: 2012-10-20 05:55:04 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (204 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1042 (660 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.38% (2.0176 => 2.4893, std.dev.: 0.0063) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.92% (0.1410 => 0.1705, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 18.28% (0.0826 => 0.0977, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 18.15% (0.2243 => 0.2650, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 17.37% (0.1013 => 0.1189, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.62% (0.0746 => 0.0870, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.54% (0.0653 => 0.0761, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.49% (0.7710 => 0.8981, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.56% (0.2596 => 0.2974, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 14.52% (0.2721 => 0.3116, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.51% (0.0834 => 0.0955, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.17% (0.0847 => 0.0967, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 14.16% (0.1003 => 0.1145, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.06% (0.0811 => 0.0925, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.01% (0.1413 => 0.1611, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 13.98% (1.3693 => 1.5607, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.93% (0.0725 => 0.0826, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.89% (0.9199 => 1.0477, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.89% (0.0720 => 0.0820, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.81% (0.1072 => 0.1220, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.80% (0.6959 => 0.7919, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.73% (0.5265 => 0.5988, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.70% (0.1986 => 0.2258, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 13.65% (0.1062 => 0.1207, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.64% (0.1327 => 0.1508, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.59% (0.5637 => 0.6403, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.58% (0.1075 => 0.1221, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.52% (3.9660 => 4.5024, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 13.46% (0.7038 => 0.7985, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/mst/mst: 13.32% (0.1111 => 0.1259, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.29% (0.1588 => 0.1799, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.28% (0.0964 => 0.1092, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.11% (0.2914 => 0.3296, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.94% (0.7460 => 0.8425, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.82% (0.0819 => 0.0924, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.69% (0.0977 => 0.1101, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 12.68% (0.4062 => 0.4577, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 12.67% (1.1061 => 1.2462, std.dev.: 0.0424) SingleSource/Benchmarks/Shootout-C++/hash2: 12.66% (0.4328 => 0.4876, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.54% (0.1276 => 0.1436, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 12.52% (0.1478 => 0.1663, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/distray/distray: 12.47% (0.0818 => 0.0920, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.33% (0.1014 => 0.1139, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 12.20% (13.8202 => 15.5058, std.dev.: 0.0838) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.20% (1.4563 => 1.6339, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.14% (1.2193 => 1.3673, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.11% (0.6283 => 0.7044, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.11% (0.2023 => 0.2268, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.05% (0.5577 => 0.6249, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.03% (1.1364 => 1.2731, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.90% (0.4379 => 0.4900, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.85% (0.1865 => 0.2086, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.75% (0.1157 => 0.1293, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 11.68% (0.7061 => 0.7886, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.68% (0.3246 => 0.3625, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 11.67% (0.7506 => 0.8382, std.dev.: 0.0046) SingleSource/UnitTests/ObjC++/property-reference-object: 11.62% (0.5818 => 0.6494, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 11.59% (0.1657 => 0.1849, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.52% (0.2127 => 0.2372, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.44% (0.3899 => 0.4345, std.dev.: 0.0098) MultiSource/Applications/sgefa/sgefa: 11.39% (0.2995 => 0.3336, std.dev.: 0.0088) MultiSource/Benchmarks/MallocBench/gs/gs: 11.35% (3.8646 => 4.3032, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/Hello: 11.24% (0.5748 => 0.6394, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.23% (0.4791 => 0.5329, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 11.21% (0.2925 => 0.3253, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.15% (0.3130 => 0.3479, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.15% (0.2655 => 0.2951, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.07% (0.1048 => 0.1164, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/18-imp/imp: 11.06% (0.3220 => 0.3576, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 10.97% (1.0313 => 1.1444, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.96% (0.1789 => 0.1985, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.88% (0.3485 => 0.3864, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.87% (0.4390 => 0.4867, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.79% (7.2180 => 7.9970, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.78% (0.4016 => 0.4449, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 10.78% (0.6744 => 0.7471, std.dev.: 0.0029) SingleSource/Regression/C++/ofstream_ctor: 10.75% (0.2781 => 0.3080, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.71% (0.2782 => 0.3080, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 10.70% (0.1589 => 0.1759, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 10.69% (1.9270 => 2.1330, std.dev.: 0.0183) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.69% (0.3022 => 0.3345, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 10.63% (0.1213 => 0.1342, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.57% (0.3756 => 0.4153, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 10.54% (0.3293 => 0.3640, std.dev.: 0.0031) MultiSource/Applications/kimwitu++/kc: 10.53% (16.6129 => 18.3620, std.dev.: 0.0122) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.52% (0.1569 => 0.1734, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.45% (0.1435 => 0.1585, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 10.39% (0.3868 => 0.4270, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.38% (0.3489 => 0.3851, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 10.36% (0.8310 => 0.9171, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hello: 10.36% (0.2607 => 0.2877, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.35% (0.0976 => 0.1077, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 10.31% (0.3453 => 0.3809, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 10.31% (0.2726 => 0.3007, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 10.25% (0.2761 => 0.3044, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 10.21% (3.1889 => 3.5146, std.dev.: 0.0352) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.20% (0.3580 => 0.3945, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.19% (1.9828 => 2.1848, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.19% (0.8698 => 0.9584, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/random: 10.19% (0.2690 => 0.2964, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 10.17% (0.3107 => 0.3423, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 10.15% (0.2937 => 0.3235, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 10.15% (2.1791 => 2.4002, std.dev.: 0.0687) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.14% (1.3245 => 1.4588, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists1: 10.13% (0.3534 => 0.3892, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 10.11% (0.2760 => 0.3039, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 10.08% (0.2628 => 0.2893, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 10.03% (0.3149 => 0.3465, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.01% (0.2966 => 0.3263, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.83% (3.6692 => 4.0297, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.80% (0.2765 => 0.3036, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.68% (0.2696 => 0.2957, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.67% (0.2140 => 0.2347, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.60% (4.3801 => 4.8004, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.57% (4.4433 => 4.8684, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.57% (0.6576 => 0.7205, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 9.56% (0.3192 => 0.3497, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 9.56% (0.4113 => 0.4506, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.51% (4.9865 => 5.4609, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: 9.47% (0.2988 => 0.3271, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.44% (0.2321 => 0.2540, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.35% (0.3755 => 0.4106, std.dev.: 0.0079) MultiSource/Benchmarks/nbench/nbench: 9.28% (1.0594 => 1.1577, std.dev.: 0.0097) MultiSource/Benchmarks/sim/sim: 9.20% (0.3131 => 0.3419, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.19% (0.6135 => 0.6699, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 9.13% (0.2945 => 0.3214, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 9.02% (14.8535 => 16.1935, std.dev.: 0.0198) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.97% (0.3511 => 0.3826, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 8.67% (1.2749 => 1.3854, std.dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 8.59% (8.4961 => 9.2262, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.39% (1.1333 => 1.2284, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.30% (0.8818 => 0.9550, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.30% (1.5188 => 1.6448, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 8.27% (0.6250 => 0.6767, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 8.22% (3.7467 => 4.0548, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.21% (0.9108 => 0.9856, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.14% (0.1819 => 0.1967, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 8.09% (0.1385 => 0.1497, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.97% (3.2742 => 3.5351, std.dev.: 0.0147) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.91% (0.4805 => 0.5185, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.89% (0.3245 => 0.3501, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 7.88% (4.6629 => 5.0303, std.dev.: 0.0036) MultiSource/Applications/JM/ldecod/ldecod: 7.83% (6.5754 => 7.0903, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/oourafft: 7.67% (0.2008 => 0.2162, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.63% (1.2292 => 1.3230, std.dev.: 0.0101) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.55% (0.2504 => 0.2693, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.54% (2.1007 => 2.2591, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.50% (6.2785 => 6.7496, std.dev.: 0.0084) SingleSource/UnitTests/ObjC/exceptions: 7.46% (0.3914 => 0.4206, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 7.42% (0.4003 => 0.4300, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.40% (0.2243 => 0.2409, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 7.39% (0.3940 => 0.4231, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/synchronized: 7.21% (0.3663 => 0.3927, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/for-in: 7.05% (0.3789 => 0.4056, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.02% (0.3646 => 0.3902, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 7.01% (0.3623 => 0.3877) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.00% (13.2842 => 14.2140, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/exceptions-2: 7.00% (0.3601 => 0.3853, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 6.99% (0.3578 => 0.3828, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.85% (0.3650 => 0.3900, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: 5.91% (0.1777 => 0.1882, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 5.22% (16.2614 => 17.1107, std.dev.: 0.0030) MultiSource/Applications/ClamAV/clamscan: 4.83% (14.5298 => 15.2309, std.dev.: 0.0120) MultiSource/Benchmarks/Olden/bh/bh: 4.13% (0.2859 => 0.2977, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 2.52% (33.2944 => 34.1327, std.dev.: 0.0168) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5178, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fbench: 25.05% (1.8175 => 2.2728, std.dev.: 0.0454) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.15% (1.0895 => 1.2763, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 11.22% (1.1560 => 1.2857, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.02% (0.8273 => 0.9019, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.47% (0.1322 => 0.1434, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4137, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.43% (0.9692 => 1.0218, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.11% (0.2093 => 0.2200, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/mandel-2: 5.08% (1.2998 => 1.3658, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.80% (0.3458 => 0.3624, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.64% (1.9144 => 2.0033, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.45% (2.8606 => 2.9880, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 4.33% (0.5449 => 0.5685, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7758, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 3.67% (10.7476 => 11.1419, std.dev.: 0.0356) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9854, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.39% (12.0921 => 12.5015, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 3.21% (11.2619 => 11.6232, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bisort/bisort: 2.96% (0.8239 => 0.8483, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0310 => 1.0559, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.14% (7.4271 => 7.5860, std.dev.: 0.0070) MultiSource/Applications/lemon/lemon: 1.77% (1.4298 => 1.4551, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0507, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5135, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9698, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1879, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.17% (9.9194 => 10.0353, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.16% (5.5130 => 5.5768, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 1.10% (12.4560 => 12.5932, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.03% (8.8259 => 8.9170, std.dev.: 0.0158) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.48% (0.2670 => 0.1429, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.93% (0.4657 => 0.3915, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.98% (1.3813 => 1.2158, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.83% (1.3819 => 1.2184, std.dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.29% (1.0460 => 0.8547, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -12.73% (0.2238 => 0.1953, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.09% (20.3410 => 18.2883, std.dev.: 0.0079) SingleSource/Benchmarks/McGill/chomp: -6.62% (1.2308 => 1.1493, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.20% (1.3780 => 1.2925, std.dev.: 0.0050) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -5.07% (2.6470 => 2.5128, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.79% (0.9996 => 0.9517, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.93% (1.7688 => 1.6992, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.04% (0.4867 => 0.4719, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -2.89% (3.2729 => 3.1784, std.dev.: 0.0197) MultiSource/Applications/spiff/spiff: -2.81% (3.0263 => 2.9413, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/bh/bh: -2.74% (1.9762 => 1.9220, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8814, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.25% (4.1080 => 4.0156, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/lists: -2.04% (6.3560 => 6.2265, std.dev.: 0.0128) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.97% (0.6589 => 0.6459, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.86% (0.6615 => 0.6492, std.dev.: 0.0012) MultiSource/Applications/lua/lua: -1.67% (26.5159 => 26.0723, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.65% (0.8342 => 0.8204, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.64% (2.5254 => 2.4839, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0075, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2506, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: -1.24% (28.2225 => 27.8729, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/heapsort: -1.10% (3.9173 => 3.8741, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.08% (6.6320 => 6.5603, std.dev.: 0.0071) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1139, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: -1.05% (84.4286 => 83.5417, std.dev.: 0.0278) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 20 01:06:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 20 Oct 2012 03:06:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121020080622.C78212A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5033?compare_to=5030&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5033, Order: 166367, Start Time: 2012-10-20 06:44:45, End Time: 2012-10-20 08:08:22 To: 5030, Order: 166364, Start Time: 2012-10-20 04:54:45, End Time: 2012-10-20 06:15:15 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (75 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (183 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 90 (15 on baseline) Unchanged Tests: 951 (663 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.46% (1.2989 => 1.3179, std.dev.: 0.0018) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.44% (0.6128 => 0.6155, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 0.06% (17.1532 => 17.1634, std.dev.: 0.0273) MultiSource/Benchmarks/Bullet/bullet: 0.20% (56.1553 => 56.2670, std.dev.: 0.0571) MultiSource/Benchmarks/MallocBench/gs/gs: 0.26% (4.5770 => 4.5889, std.dev.: 0.1681) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0482 => 0.0482, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.21% (0.0483 => 0.0484) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.22% (0.0451 => 0.0452, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.22% (0.0452 => 0.0453, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0441 => 0.0441, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.23% (0.0442 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0435 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0436 => 0.0436, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0452 => 0.0452, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0454 => 0.0454, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0448 => 0.0448, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0448 => 0.0448, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0437 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.46% (0.0437 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0445 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.22% (0.0446 => 0.0445, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0456 => 0.0456, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.62% (0.0458 => 0.0470, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.23% (0.0432 => 0.0433, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0433 => 0.0433, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.22% (0.0445 => 0.0444, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.22% (0.0445 => 0.0446, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0436 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.23% (0.0436 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0428 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0429 => 0.0429, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.23% (0.0427 => 0.0428) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.23% (0.0428 => 0.0429, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.22% (0.0463 => 0.0464, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.43% (0.0466 => 0.0464, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0425 => 0.0425, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.23% (0.0426 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.23% (0.0426 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0427 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0434 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.23% (0.0436 => 0.0435, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.12% (1.2990 => 1.2974, std.dev.: 0.0388) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.00% (8.1850 => 8.1849, std.dev.: 0.0175) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.17% (0.7756 => 0.7769, std.dev.: 0.0029) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.85% (0.0354 => 0.0351, std.dev.: 0.0041) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -0.06% (0.1648 => 0.1647, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.78% (0.2166 => 0.2149, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.03% (63.2438 => 56.2670, std.dev.: 0.0571) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 0.49% (0.1639 => 0.1647, std.dev.: 0.0006) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 36.28% (14.1553 => 19.2903, std.dev.: 0.4305) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.89% (3.4629 => 5.7793, std.dev.: 0.0064) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13409.72% (0.0720 => 9.7270, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049500.00% (0.0001 => 10.0496, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.47% (0.2554 => 0.4175, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/lowercase: 55.47% (0.0256 => 0.0398, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 48.58% (10.3673 => 15.4040, std.dev.: 0.0123) SingleSource/UnitTests/SignlessTypes/factor: 44.26% (0.0296 => 0.0427, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 37.18% (0.1622 => 0.2225, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/distray/distray: 35.80% (0.1056 => 0.1434, std.dev.: 0.0038) SingleSource/UnitTests/vla: 31.83% (0.0355 => 0.0468, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 23.86% (0.0834 => 0.1033, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 19.99% (0.1566 => 0.1879, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.51% (7.0540 => 8.3599, std.dev.: 0.1908) SingleSource/Benchmarks/Misc/flops: 18.30% (0.1432 => 0.1694, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.91% (0.0871 => 0.1027, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 17.68% (0.1555 => 0.1830, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.37% (2.2022 => 2.5847, std.dev.: 0.0500) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.36% (0.5105 => 0.5991, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 16.90% (0.6675 => 0.7803, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout/lists: 16.61% (0.0626 => 0.0730, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 16.37% (0.1655 => 0.1926, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 16.32% (3.3354 => 3.8796, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.03% (0.2271 => 0.2635, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.03% (0.0730 => 0.0847, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.91% (1.3050 => 1.5126, std.dev.: 0.0489) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.68% (0.8172 => 0.9453, std.dev.: 0.0081) MultiSource/Benchmarks/Olden/power/power: 15.63% (0.1440 => 0.1665, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/em3d/em3d: 15.58% (0.1695 => 0.1959, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.54% (0.5020 => 0.5800, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.52% (0.1940 => 0.2241, std.dev.: 0.0085) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 15.26% (0.0793 => 0.0914, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.08% (0.2758 => 0.3174, std.dev.: 0.0123) MultiSource/Benchmarks/Olden/mst/mst: 15.05% (0.1163 => 0.1338, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.88% (0.5860 => 0.6732, std.dev.: 0.0258) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.79% (0.0886 => 0.1017, std.dev.: 0.0044) MultiSource/Applications/minisat/minisat: 14.74% (0.7115 => 0.8164, std.dev.: 0.0261) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.70% (0.1510 => 0.1732, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.67% (0.1029 => 0.1180, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.51% (0.1337 => 0.1531, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 14.47% (0.3109 => 0.3559, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.43% (1.5415 => 1.7640, std.dev.: 0.0116) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.37% (0.0842 => 0.0963, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.30% (0.4615 => 0.5275, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.28% (0.1625 => 0.1857, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.26% (0.3121 => 0.3566, std.dev.: 0.0127) MultiSource/Benchmarks/mafft/pairlocalalign: 14.25% (9.4845 => 10.8356, std.dev.: 0.0113) MultiSource/Benchmarks/McCat/18-imp/imp: 14.17% (0.3423 => 0.3908, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.12% (0.9765 => 1.1144, std.dev.: 0.0395) SingleSource/Benchmarks/Misc/oourafft: 14.11% (0.3282 => 0.3745, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: 14.06% (0.0818 => 0.0933, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 14.05% (1.1642 => 1.3278, std.dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.98% (0.1438 => 0.1639, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 13.83% (0.1584 => 0.1803, std.dev.: 0.0055) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.71% (4.2646 => 4.8493, std.dev.: 0.1494) SingleSource/Benchmarks/BenchmarkGame/n-body: 13.67% (0.0746 => 0.0848, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.67% (0.2107 => 0.2395, std.dev.: 0.0106) SingleSource/Benchmarks/McGill/exptree: 13.64% (0.0814 => 0.0925, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.51% (0.1236 => 0.1403, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 13.47% (0.1151 => 0.1306, std.dev.: 0.0021) MultiSource/Applications/spiff/spiff: 13.44% (0.7835 => 0.8888, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 13.40% (0.6450 => 0.7314, std.dev.: 0.0232) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.12% (8.1363 => 9.2041, std.dev.: 0.2187) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.06% (0.1906 => 0.2155, std.dev.: 0.0034) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 12.98% (0.1125 => 0.1271, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 12.97% (0.7433 => 0.8397, std.dev.: 0.0290) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.97% (0.0933 => 0.1054, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.95% (1.7609 => 1.9890, std.dev.: 0.0262) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.91% (0.0798 => 0.0901, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.90% (0.1062 => 0.1199, std.dev.: 0.0046) MultiSource/Applications/treecc/treecc: 12.88% (2.0273 => 2.2884, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.81% (0.2700 => 0.3046, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.68% (0.1695 => 0.1910, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/neural/neural: 12.65% (0.1463 => 0.1648, std.dev.: 0.0037) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.60% (0.1143 => 0.1287, std.dev.: 0.0014) MultiSource/Applications/lua/lua: 12.58% (3.8723 => 4.3596, std.dev.: 0.0946) MultiSource/Applications/JM/ldecod/ldecod: 12.50% (10.4361 => 11.7411, std.dev.: 0.0159) SingleSource/UnitTests/SignlessTypes/rem: 12.50% (0.1144 => 0.1287) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.46% (0.5981 => 0.6726, std.dev.: 0.0258) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.39% (4.9449 => 5.5575, std.dev.: 0.1253) MultiSource/Applications/lemon/lemon: 12.37% (1.0722 => 1.2048, std.dev.: 0.0324) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.34% (5.0018 => 5.6189, std.dev.: 0.1302) MultiSource/Applications/oggenc/oggenc: 12.28% (5.7591 => 6.4666, std.dev.: 0.0066) MultiSource/Benchmarks/sim/sim: 12.28% (0.3387 => 0.3803, std.dev.: 0.0091) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.27% (0.0929 => 0.1043, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.22% (0.4879 => 0.5475, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.21% (0.8067 => 0.9052, std.dev.: 0.0321) MultiSource/Applications/hbd/hbd: 12.18% (1.5603 => 1.7503, std.dev.: 0.0400) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.16% (0.3307 => 0.3709, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 11.93% (0.4299 => 0.4812, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.89% (0.5569 => 0.6231, std.dev.: 0.0217) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.81% (1.1861 => 1.3262, std.dev.: 0.0384) MultiSource/Benchmarks/McCat/09-vor/vor: 11.79% (0.3180 => 0.3555, std.dev.: 0.0090) MultiSource/Benchmarks/nbench/nbench: 11.71% (1.1840 => 1.3226, std.dev.: 0.0296) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.65% (0.1330 => 0.1485, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.65% (0.3177 => 0.3547, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: 11.53% (0.8921 => 0.9950, std.dev.: 0.0249) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.50% (7.9617 => 8.8771, std.dev.: 0.1629) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.48% (1.5859 => 1.7679, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 11.43% (1.4186 => 1.5807, std.dev.: 0.0565) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.39% (0.3441 => 0.3833, std.dev.: 0.0141) SingleSource/Benchmarks/Misc-C++/bigfib: 11.15% (0.6456 => 0.7176, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.80% (0.4103 => 0.4546, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 10.56% (0.3543 => 0.3917, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.50% (2.2024 => 2.4337, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 10.42% (0.3473 => 0.3835, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.41% (0.2603 => 0.2874, std.dev.: 0.0079) MultiSource/Applications/siod/siod: 10.41% (2.2969 => 2.5360, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.40% (0.3826 => 0.4224, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: 10.39% (0.3927 => 0.4335, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/synchronized: 10.36% (0.3561 => 0.3930, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.36% (0.3543 => 0.3910, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: 10.31% (0.3694 => 0.4075, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash: 10.31% (0.4289 => 0.4731, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 10.30% (0.3516 => 0.3878, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.27% (0.8101 => 0.8933, std.dev.: 0.0231) SingleSource/UnitTests/ObjC/exceptions-2: 10.27% (0.3497 => 0.3856, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.24% (0.3828 => 0.4220, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: 10.09% (0.4620 => 0.5086) SingleSource/UnitTests/ObjC/property: 10.06% (0.3886 => 0.4277, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: 10.05% (0.2049 => 0.2255, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.89% (0.2266 => 0.2490, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.78% (0.1892 => 0.2077, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.70% (0.3865 => 0.4240, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 9.70% (0.3422 => 0.3754, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 9.67% (0.1044 => 0.1145, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 9.62% (21.9371 => 24.0464, std.dev.: 0.0227) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.37% (0.4203 => 0.4597, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 9.31% (0.3684 => 0.4027, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 9.17% (0.4048 => 0.4419, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.93% (0.4636 => 0.5050, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sieve: 8.60% (0.3603 => 0.3913, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 8.13% (0.6030 => 0.6520, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.10% (0.5925 => 0.6405, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.03% (0.3650 => 0.3943, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 7.94% (17.1811 => 18.5456, std.dev.: 0.4232) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.89% (0.2891 => 0.3119, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.86% (0.3232 => 0.3486, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 7.84% (0.3098 => 0.3341, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.82% (0.4064 => 0.4382, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 7.68% (0.2905 => 0.3128, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 7.67% (0.2725 => 0.2934, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 7.67% (0.2831 => 0.3048, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.66% (0.2793 => 0.3007, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.59% (0.3162 => 0.3402, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 7.59% (0.7326 => 0.7882, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/ary3: 7.58% (0.3283 => 0.3532, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.56% (0.3136 => 0.3373, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.54% (2.0665 => 2.2223, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/methcall: 7.51% (0.2877 => 0.3093, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.49% (0.2430 => 0.2612, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.44% (14.3668 => 15.4357, std.dev.: 0.1555) SingleSource/Benchmarks/Shootout-C++/except: 7.42% (0.2871 => 0.3084) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.42% (0.2872 => 0.3085, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 7.40% (0.3052 => 0.3278, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.37% (0.2756 => 0.2959, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 7.30% (0.2714 => 0.2912, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 7.17% (0.2802 => 0.3003, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 7.07% (0.3379 => 0.3618, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.89% (3.8922 => 4.1605, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/objinst: 6.23% (0.3131 => 0.3326, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.30% (0.3935 => 0.4065, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.81% (1.1194 => 1.1509, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.75% (0.3817 => 0.3922, std.dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3123, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.57% (1.1145 => 1.2992, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.68% (0.2944 => 0.3288, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.95% (1.1396 => 1.2530, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 9.78% (0.9957 => 1.0931, std.dev.: 0.0195) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.70% (3.1578 => 3.3693, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/bh/bh: 5.50% (1.9405 => 2.0472, std.dev.: 0.0319) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.66% (4.2280 => 4.3403, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7650, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.07% (3.6395 => 3.7147, std.dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.57% (2.6546 => 2.6962, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2078, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.09% (6.5088 => 6.5798, std.dev.: 0.0034) MultiSource/Applications/viterbi/viterbi: 1.05% (4.4649 => 4.5118, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.03% (1.3045 => 1.3179, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.02% (6.6874 => 0.1322, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -80.00% (0.8651 => 0.1730, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.18% (5.2763 => 3.2619, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.29% (5.3855 => 3.7006, std.dev.: 0.0522) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.99% (5.3526 => 3.6937, std.dev.: 0.0063) SingleSource/UnitTests/Vector/constpool: -14.57% (54.1659 => 46.2747, std.dev.: 0.0141) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.50% (2.9384 => 2.6299, std.dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: -6.54% (22.1758 => 20.7262, std.dev.: 0.2462) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.07% (8.0499 => 3.7781, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -42.75% (0.0400 => 0.0229, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel: -33.50% (1.1492 => 0.7642, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -15.88% (1.6925 => 1.4238, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.43% (0.0998 => 0.0854, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -11.83% (1.2373 => 1.0909, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3453 => 2.9599, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -10.76% (1.5373 => 1.3719, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.13% (19.9488 => 18.3276, std.dev.: 0.0199) MultiSource/Benchmarks/FreeBench/mason/mason: -7.73% (0.2161 => 0.1994, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.18% (1.6805 => 1.5935, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-5: -4.78% (1.5835 => 1.5078, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.43% (8.1563 => 7.7951, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.63% (3.2827 => 3.1635, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -3.35% (5.0483 => 4.8791, std.dev.: 0.0072) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5052, std.dev.: 0.0211) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4808 => 0.4664, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.76% (10.2830 => 10.1018, std.dev.: 0.0132) SingleSource/UnitTests/Vector/multiplies: -1.73% (2.5528 => 2.5087, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6828, std.dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4207, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2879, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2347, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 17.71% (0.5229 => 0.6155, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 14.50% (14.9895 => 17.1634, std.dev.: 0.0273) MultiSource/Benchmarks/MallocBench/gs/gs: 11.64% (4.1105 => 4.5889, std.dev.: 0.1681) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.43% (1.1048 => 1.2974, std.dev.: 0.0388) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.34% (7.1582 => 8.1849, std.dev.: 0.0175) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.86% (0.6222 => 0.7769, std.dev.: 0.0029) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35000.00% (0.0001 => 0.0351, std.dev.: 0.0041) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.56% (0.2116 => 0.2149, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 20 02:00:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 20 Oct 2012 04:00:48 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121020090048.E690D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5034?compare_to=5031&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5034, Order: 166370, Start Time: 2012-10-20 07:39:27, End Time: 2012-10-20 09:02:49 To: 5031, Order: 166367, Start Time: 2012-10-20 05:59:50, End Time: 2012-10-20 07:22:51 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 11 (18 on baseline) Performance Improvements: 3 (3 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 961 (953 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/health/health: 8.35% (0.1270 => 0.1376, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.93% (0.8847 => 0.9018, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.73% (0.8363 => 0.8508, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.43% (0.8067 => 0.8182, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.30% (1.4556 => 1.4745, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.77% (0.3192 => 0.3504, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 5.88% (8.1814 => 8.6621, std.dev.: 0.0245) SingleSource/Benchmarks/Misc/ffbench: 2.48% (1.3967 => 1.4313, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.18% (1.0160 => 1.0381, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/methcall: 1.81% (8.8774 => 9.0383, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/whetstone: 1.32% (2.1160 => 2.1439, std.dev.: 0.0051) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.62% (0.3366 => 0.3244, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.46% (1.1614 => 1.1445, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/FloatMM: -1.25% (0.8942 => 0.8830, std.dev.: 0.0027) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.05% (16.4223 => 16.4297, std.dev.: 0.0489) MultiSource/Applications/obsequi/Obsequi: -0.86% (1.0415 => 1.0325, std.dev.: 0.0133) MultiSource/Applications/sqlite3/sqlite3: 0.17% (0.6303 => 0.6314, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/08-main/main: -3.66% (0.1886 => 0.1817, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.25% (0.1632 => 0.1636, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.25% (0.3162 => 0.3233, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.18% (0.2435 => 0.2488, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.09% (0.3345 => 0.3342, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.72% (0.2389 => 0.2348, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/bigfib: -0.45% (0.5956 => 0.5929, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -14.76% (0.0454 => 0.0387, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.06% (0.3276 => 0.3274, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/strcat: 0.76% (0.1963 => 0.1978, std.dev.: 0.0073) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 20.00% (0.0200 => 0.0240, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 41.73% (0.0127 => 0.0180, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.43% (0.0419 => 0.0413, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -25.46% (0.0326 => 0.0243, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -15.91% (0.0308 => 0.0259, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -7.45% (0.0416 => 0.0385, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/casts: -6.25% (0.0192 => 0.0180, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/test1: 24.11% (0.0141 => 0.0175, std.dev.: 0.0017) SingleSource/UnitTests/byval-alignment: -4.59% (0.0327 => 0.0312, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1480 => 0.1481, std.dev.: 0.0025) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -3.35% (1.1482 => 1.1097, std.dev.: 0.0241) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -4.21% (0.1498 => 0.1435, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.17% (0.4017 => 0.4064, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.94% (0.1389 => 0.1402, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.75% (0.0582 => 0.0566, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -8.89% (0.0225 => 0.0205, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.94% (0.0532 => 0.0537, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.01% (1.1431 => 1.1432, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -80.00% (0.0005 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.01% (0.0549 => 0.0571, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.62% (0.0213 => 0.0184, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.01% (0.7950 => 0.8030, std.dev.: 0.0103) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -35.48% (0.0062 => 0.0040, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.83% (2.1832 => 1.6629, std.dev.: 0.0021) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.50% (0.2180 => 0.2300, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.84% (0.8855 => 0.9018, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.84% (1.4479 => 1.4745, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.78% (0.8359 => 0.8508, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.66% (0.7966 => 0.8098, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.24% (0.8518 => 0.8624, std.dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 59.15% (1.5795 => 2.5137, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.98% (0.3186 => 0.3504, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.40% (1.1857 => 1.2853, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 5.95% (63.1822 => 66.9388, std.dev.: 0.0489) SingleSource/Benchmarks/Misc/ReedSolomon: 3.41% (8.5322 => 8.8233, std.dev.: 0.0146) MultiSource/Applications/siod/siod: 3.03% (3.6643 => 3.7752, std.dev.: 0.0242) MultiSource/Applications/SPASS/SPASS: 2.72% (8.4326 => 8.6621, std.dev.: 0.0245) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.63% (4.3552 => 4.4698, std.dev.: 0.0180) MultiSource/Benchmarks/Olden/bh/bh: 1.87% (2.3560 => 2.4000, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.49% (4.8362 => 4.9082, std.dev.: 0.0031) MultiSource/Applications/spiff/spiff: 1.02% (2.8561 => 2.8852, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/whetstone: 1.01% (2.1224 => 2.1439, std.dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.64% (0.3269 => 0.2954, std.dev.: 0.0032) MultiSource/Applications/lua/lua: -4.89% (29.8330 => 28.3756, std.dev.: 0.0285) SingleSource/Benchmarks/Shootout-C++/hash2: -1.41% (3.4237 => 3.3755, std.dev.: 0.0160) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.10% (16.4461 => 16.4297, std.dev.: 0.0489) MultiSource/Applications/obsequi/Obsequi: 0.61% (1.0262 => 1.0325, std.dev.: 0.0133) MultiSource/Applications/sqlite3/sqlite3: -0.28% (0.6332 => 0.6314, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/08-main/main: -0.76% (0.1831 => 0.1817, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.94% (0.1559 => 0.1636, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.52% (0.3123 => 0.3233, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.02% (0.2463 => 0.2488, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.06% (0.3344 => 0.3342, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.68% (0.2364 => 0.2348, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/bigfib: -1.35% (0.6010 => 0.5929, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -9.79% (0.0429 => 0.0387, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.24% (0.3266 => 0.3274, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/strcat: 0.46% (0.1969 => 0.1978, std.dev.: 0.0073) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.14% (0.0224 => 0.0240, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 46.34% (0.0123 => 0.0180, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.23% (0.0408 => 0.0413, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -4.33% (0.0254 => 0.0243, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -14.24% (0.0302 => 0.0259, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.26% (0.0384 => 0.0385, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/casts: -5.26% (0.0190 => 0.0180, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/test1: -2.78% (0.0180 => 0.0175, std.dev.: 0.0017) SingleSource/UnitTests/byval-alignment: 35.65% (0.0230 => 0.0312, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.99% (0.1438 => 0.1481, std.dev.: 0.0025) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -2.05% (1.1329 => 1.1097, std.dev.: 0.0241) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -1.85% (0.1462 => 0.1435, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.40% (0.4164 => 0.4064, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.41% (0.1369 => 0.1402, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -11.70% (0.0641 => 0.0566, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 5.13% (0.0195 => 0.0205, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.09% (0.0578 => 0.0537, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.04% (1.1437 => 1.1432, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.93% (0.0627 => 0.0571, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.22% (0.0180 => 0.0184, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.16% (0.8017 => 0.8030, std.dev.: 0.0103) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -35.48% (0.0062 => 0.0040, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 20 02:46:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 20 Oct 2012 04:46:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121020094609.3B32B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5035?compare_to=5032&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5035, Order: 166370, Start Time: 2012-10-20 08:23:10, End Time: 2012-10-20 09:49:08 To: 5032, Order: 166367, Start Time: 2012-10-20 06:24:33, End Time: 2012-10-20 07:53:24 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (200 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1040 (665 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.73% (54.6161 => 56.6546, std.dev.: 0.0080) SingleSource/Benchmarks/McGill/chomp: 1.08% (1.1493 => 1.1617, std.dev.: 0.0035) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.36% (2.0176 => 2.4890, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.99% (0.1410 => 0.1706, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 18.40% (0.0826 => 0.0978, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/08-main/main: 18.10% (0.2243 => 0.2649, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 17.47% (0.1013 => 0.1190, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 17.27% (0.0770 => 0.0903, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.15% (0.0653 => 0.0765, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.89% (0.0746 => 0.0872, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.38% (0.7710 => 0.8973, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.84% (0.0977 => 0.1122, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.75% (0.0834 => 0.0957, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.70% (0.1986 => 0.2278, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.64% (0.2596 => 0.2976, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 14.52% (0.2721 => 0.3116, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.46% (0.1072 => 0.1227, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 14.26% (0.1003 => 0.1146, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.18% (0.0811 => 0.0926, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.15% (0.1413 => 0.1613, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.09% (0.1327 => 0.1514, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.07% (0.0725 => 0.0827, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.05% (0.0847 => 0.0966, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.98% (0.9199 => 1.0485, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 13.97% (1.3693 => 1.5606, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.62% (0.5637 => 0.6405, std.dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 13.54% (0.7038 => 0.7991, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.49% (0.1075 => 0.1220, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.49% (0.0964 => 0.1094, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.48% (0.1588 => 0.1802, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.47% (3.9660 => 4.5004, std.dev.: 0.0037) MultiSource/Applications/aha/aha: 13.47% (0.1062 => 0.1205, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.46% (0.6959 => 0.7896, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.28% (0.2914 => 0.3301, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.20% (0.5265 => 0.5960, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 13.14% (0.1111 => 0.1257, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.91% (0.7460 => 0.8423, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 12.75% (0.4328 => 0.4880, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 12.65% (0.1478 => 0.1665, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 12.58% (1.1061 => 1.2452, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.54% (0.1276 => 0.1436, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.52% (0.1014 => 0.1141, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 12.47% (0.0818 => 0.0920, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.46% (1.4563 => 1.6377, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.33% (1.2193 => 1.3697, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.19% (0.5577 => 0.6257, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 12.12% (13.8202 => 15.4953, std.dev.: 0.0125) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.10% (1.1364 => 1.2739, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.08% (0.6283 => 0.7042, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.06% (0.1865 => 0.2090, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.06% (0.2023 => 0.2267, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.99% (0.2127 => 0.2382, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 11.94% (0.4062 => 0.4547, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.93% (0.1157 => 0.1295, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.92% (0.4379 => 0.4901, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.86% (0.3246 => 0.3631, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 11.77% (0.1657 => 0.1852, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.75% (0.3899 => 0.4357, std.dev.: 0.0017) MultiSource/Applications/spiff/spiff: 11.64% (0.7506 => 0.8380, std.dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: 11.55% (0.2995 => 0.3341, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 11.55% (0.5818 => 0.6490, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 11.52% (3.8646 => 4.3097, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/09-vor/vor: 11.38% (0.2925 => 0.3258, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.28% (0.3130 => 0.3483, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.27% (0.4791 => 0.5331, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 11.24% (0.5748 => 0.6394, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.18% (0.3022 => 0.3360, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 11.18% (1.0313 => 1.1466, std.dev.: 0.0087) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.16% (0.1048 => 0.1165, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 11.02% (0.3220 => 0.3575, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.02% (0.3485 => 0.3869, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 10.96% (0.7061 => 0.7835, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists: 10.87% (0.3293 => 0.3651, std.dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 10.86% (0.2781 => 0.3083, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.84% (0.1789 => 0.1983, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 10.82% (0.1589 => 0.1761, std.dev.: 0.0032) MultiSource/Applications/treecc/treecc: 10.81% (1.9270 => 2.1354, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.81% (7.2180 => 7.9981, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.81% (0.4016 => 0.4450, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.78% (0.3756 => 0.4161, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 10.75% (0.6744 => 0.7469, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.66% (0.3489 => 0.3861, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 10.60% (0.2726 => 0.3015, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 10.58% (16.6129 => 18.3710, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/health/health: 10.55% (0.1213 => 0.1341, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 10.55% (0.3868 => 0.4276, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.53% (0.2782 => 0.3075, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.52% (0.1569 => 0.1734, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.45% (0.1435 => 0.1585, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.45% (0.3580 => 0.3954, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/football/football: 10.43% (0.8310 => 0.9177, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 10.40% (0.3453 => 0.3812, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.36% (0.8698 => 0.9599, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 10.34% (3.1889 => 3.5186, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/methcall: 10.32% (0.2761 => 0.3046, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 10.26% (0.3149 => 0.3472, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 10.25% (0.2760 => 0.3043, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 10.23% (0.3107 => 0.3425, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 10.21% (2.1791 => 2.4016, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.21% (1.9828 => 2.1852, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 10.15% (0.2690 => 0.2963, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.15% (0.2966 => 0.3267, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.15% (1.3245 => 1.4589, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.13% (0.2655 => 0.2924, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/lists1: 10.10% (0.3534 => 0.3891, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.09% (0.4390 => 0.4833, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hello: 10.09% (0.2607 => 0.2870, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 9.99% (0.3192 => 0.3511, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 9.98% (0.2937 => 0.3230, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.98% (0.6576 => 0.7232, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.92% (3.6692 => 4.0331, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.91% (0.2765 => 0.3039, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 9.89% (0.2628 => 0.2888, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.77% (0.2140 => 0.2349, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.69% (4.4433 => 4.8738, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.68% (4.3801 => 4.8042, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.68% (0.2696 => 0.2957, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 9.64% (0.2988 => 0.3276, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 9.56% (0.4113 => 0.4506, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.54% (4.9865 => 5.4621, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.48% (0.2321 => 0.2541, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.29% (0.3511 => 0.3837, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.27% (0.3755 => 0.4103, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 9.24% (0.2945 => 0.3217, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.16% (0.6135 => 0.6697, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 9.14% (14.8535 => 16.2111, std.dev.: 0.0129) MultiSource/Benchmarks/sim/sim: 9.10% (0.3131 => 0.3416, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 8.94% (1.0594 => 1.1541, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 8.75% (8.4961 => 9.2395, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.70% (0.8818 => 0.9585, std.dev.: 0.0064) MultiSource/Applications/SIBsim4/SIBsim4: 8.66% (1.2749 => 1.3853, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.44% (1.1333 => 1.2289, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.43% (1.5188 => 1.6468, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.39% (0.9108 => 0.9872, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/bigfib: 8.34% (0.6250 => 0.6771, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 8.30% (0.1385 => 0.1500, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 8.23% (3.7467 => 4.0549, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.14% (3.2742 => 3.5406, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.04% (0.3245 => 0.3506, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.99% (0.4805 => 0.5189, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 7.94% (6.5754 => 7.0978, std.dev.: 0.0066) MultiSource/Applications/oggenc/oggenc: 7.92% (4.6629 => 5.0323, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: 7.87% (0.2008 => 0.2166, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.75% (0.1819 => 0.1960, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.71% (0.2504 => 0.2697, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.69% (2.1007 => 2.2623, std.dev.: 0.0088) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.60% (6.2785 => 6.7554, std.dev.: 0.0070) MultiSource/Applications/hexxagon/hexxagon: 7.55% (1.2292 => 1.3220, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.31% (0.2243 => 0.2407, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.04% (13.2842 => 14.2191, std.dev.: 0.0189) SingleSource/UnitTests/ObjC/parameter-passing: 6.97% (0.4003 => 0.4282, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 6.70% (0.3940 => 0.4204, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions: 6.69% (0.3914 => 0.4176, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 6.64% (0.3646 => 0.3888, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 6.60% (0.3578 => 0.3814, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-2: 6.53% (0.3601 => 0.3836, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 6.52% (0.3789 => 0.4036, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.42% (0.3663 => 0.3898, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.36% (0.3650 => 0.3882, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 6.24% (0.3623 => 0.3849, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: 6.08% (0.1777 => 0.1885, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 5.31% (16.2614 => 17.1248, std.dev.: 0.0196) MultiSource/Applications/ClamAV/clamscan: 4.84% (14.5298 => 15.2329, std.dev.: 0.0197) MultiSource/Benchmarks/Olden/bh/bh: 4.13% (0.2859 => 0.2977, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 2.48% (33.2944 => 34.1187, std.dev.: 0.0303) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.52% (5.7573 => 7.5143, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/fbench: 24.31% (1.8175 => 2.2593, std.dev.: 0.0317) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.10% (1.0895 => 1.2758, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 11.09% (1.1560 => 1.2842, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.77% (2.8813 => 3.1916, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 9.02% (0.8273 => 0.9019, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.47% (0.1322 => 0.1434, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4143, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.43% (0.9692 => 1.0218) SingleSource/Benchmarks/Misc/mandel-2: 5.17% (1.2998 => 1.3670, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0021) SingleSource/Regression/C/uint64_to_float: 4.46% (0.5449 => 0.5692, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.46% (2.8606 => 2.9881, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.69% (10.7476 => 11.1445, std.dev.: 0.0480) SingleSource/Benchmarks/Misc/flops-6: 3.46% (1.9199 => 1.9864, std.dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 3.37% (12.0921 => 12.4998, std.dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 3.21% (11.2619 => 11.6237, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bisort/bisort: 2.97% (0.8239 => 0.8484, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.41% (1.0310 => 1.0558, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.14% (7.4271 => 7.5860, std.dev.: 0.0062) MultiSource/Applications/lemon/lemon: 1.89% (1.4298 => 1.4568, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5124, std.dev.: 0.0089) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9693, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1879, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5784, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.18% (9.9194 => 10.0366, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1413, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 1.09% (12.4560 => 12.5916, std.dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.40% (0.2670 => 0.1431, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.43% (0.4657 => 0.3892, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.02% (1.3813 => 1.2153, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.97% (1.3819 => 1.2165, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.28% (1.0460 => 0.8548, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/mason/mason: -13.00% (0.2238 => 0.1947, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.21% (20.3410 => 18.2648, std.dev.: 0.0271) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.09% (1.3780 => 1.2941, std.dev.: 0.0086) SingleSource/Benchmarks/McGill/chomp: -5.61% (1.2308 => 1.1617, std.dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5138, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.32% (0.9996 => 0.9564, std.dev.: 0.0102) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.87% (1.7688 => 1.7003, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.04% (0.4867 => 0.4719, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -2.86% (3.2729 => 3.1794, std.dev.: 0.0078) MultiSource/Applications/spiff/spiff: -2.81% (3.0263 => 2.9413, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -2.76% (1.9762 => 1.9217, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8812, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.37% (4.1080 => 4.0106, std.dev.: 0.0012) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.90% (0.6589 => 0.6464, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.86% (0.6615 => 0.6492, std.dev.: 0.0012) MultiSource/Applications/lua/lua: -1.72% (26.5159 => 26.0601, std.dev.: 0.0357) SingleSource/Benchmarks/Shootout/lists: -1.69% (6.3560 => 6.2487, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.64% (0.8342 => 0.8205, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.62% (2.5254 => 2.4846, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0065, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.35% (5.3167 => 5.2450, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/heapsort: -1.25% (3.9173 => 3.8685, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: -1.24% (28.2225 => 27.8723, std.dev.: 0.0017) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1139, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -1.05% (84.4286 => 83.5416, std.dev.: 0.0054) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 20 02:57:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 20 Oct 2012 04:57:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121020095715.C5A202A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5036?compare_to=5033&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5036, Order: 166370, Start Time: 2012-10-20 08:38:24, End Time: 2012-10-20 09:58:28 To: 5033, Order: 166367, Start Time: 2012-10-20 06:44:45, End Time: 2012-10-20 08:08:22 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (75 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (189 on baseline) Performance Improvements: 2 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 90 (15 on baseline) Unchanged Tests: 950 (655 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -1.03% (1.7503 => 1.7322, std.dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.10% (1.3179 => 1.3034, std.dev.: 0.0051) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.32% (0.6155 => 0.6135, std.dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: -0.04% (17.1634 => 17.1558, std.dev.: 0.0097) MultiSource/Benchmarks/Bullet/bullet: -0.38% (56.2670 => 56.0516, std.dev.: 0.0394) MultiSource/Benchmarks/MallocBench/gs/gs: -0.33% (4.5889 => 4.5736, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.21% (0.0482 => 0.0481) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.21% (0.0484 => 0.0483, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.22% (0.0452 => 0.0451) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.22% (0.0453 => 0.0452, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.23% (0.0441 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.23% (0.0443 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.23% (0.0435 => 0.0434, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0436 => 0.0436, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0452 => 0.0452, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0454 => 0.0454) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.22% (0.0448 => 0.0447) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0448 => 0.0448, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.23% (0.0437 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.23% (0.0439 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.22% (0.0445 => 0.0444) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0445 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.22% (0.0456 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.77% (0.0470 => 0.0457) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.23% (0.0433 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0433 => 0.0433) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0444 => 0.0444, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.22% (0.0446 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.23% (0.0436 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.23% (0.0437 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.23% (0.0428 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.23% (0.0429 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.47% (0.0428 => 0.0426) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.23% (0.0429 => 0.0428) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.22% (0.0464 => 0.0463) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0464 => 0.0464, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0425 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0427 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.23% (0.0427 => 0.0426) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0427 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0434 => 0.0434) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0435 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.05% (1.2974 => 1.2968, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.17% (8.1849 => 8.1706, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.21% (0.7769 => 0.7753, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 1.14% (0.0351 => 0.0355, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1433 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 0.06% (0.1647 => 0.1648, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.70% (0.2149 => 0.2134, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.37% (63.2438 => 56.0516, std.dev.: 0.0394) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 0.55% (0.1639 => 0.1648, std.dev.: 0.0019) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 35.82% (14.1553 => 19.2254, std.dev.: 0.0166) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.45% (3.4629 => 5.7639, std.dev.: 0.0031) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13405.28% (0.0720 => 9.7238, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049900.00% (0.0001 => 10.0500, std.dev.: 0.0013) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.51% (0.2554 => 0.4176, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 55.08% (0.0256 => 0.0397, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 48.44% (10.3673 => 15.3893, std.dev.: 0.0076) SingleSource/UnitTests/SignlessTypes/factor: 44.26% (0.0296 => 0.0427, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 37.55% (0.1622 => 0.2231, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/distray/distray: 35.89% (0.1056 => 0.1435, std.dev.: 0.0010) SingleSource/UnitTests/vla: 31.83% (0.0355 => 0.0468, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 23.62% (0.0834 => 0.1031, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.24% (0.1566 => 0.1883, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.60% (7.0540 => 8.3659, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/flops: 18.37% (0.1432 => 0.1695, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.91% (0.0871 => 0.1027, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 17.68% (0.1555 => 0.1830, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.41% (2.2022 => 2.5855, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.06% (0.5105 => 0.5976, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 16.85% (0.6675 => 0.7800, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 16.07% (0.1655 => 0.1921, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 16.04% (3.3354 => 3.8704, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 15.98% (0.2271 => 0.2634, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.89% (1.3050 => 1.5123, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 15.69% (0.1440 => 0.1666, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 15.69% (0.1695 => 0.1961, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 15.38% (0.0793 => 0.0915, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 15.32% (0.1175 => 0.1355, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.16% (0.8172 => 0.9411, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/mst/mst: 15.13% (0.1163 => 0.1339, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.94% (0.5020 => 0.5770, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.79% (0.0886 => 0.1017) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.70% (0.1510 => 0.1732, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.59% (0.1940 => 0.2223, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.51% (0.1337 => 0.1531, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 14.49% (0.7115 => 0.8146, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.49% (0.0842 => 0.0964, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.32% (0.4615 => 0.5276, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 14.26% (0.3282 => 0.3750, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.23% (1.5415 => 1.7609, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 14.15% (0.3109 => 0.3549, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 14.05% (0.3423 => 0.3904, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 13.99% (9.4845 => 10.8118, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout/matrix: 13.94% (0.0818 => 0.0932, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.87% (0.9765 => 1.1119, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 13.83% (0.1584 => 0.1803, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.81% (0.3121 => 0.3552, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 13.81% (0.0746 => 0.0849, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/exptree: 13.76% (0.0814 => 0.0926, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 13.74% (1.1642 => 1.3242, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.70% (0.1117 => 0.1270, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.62% (4.2646 => 4.8455, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.51% (0.1236 => 0.1403, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 13.47% (0.1151 => 0.1306, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.39% (1.7609 => 1.9967, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.38% (0.2107 => 0.2389, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 13.38% (0.6450 => 0.7313, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.37% (0.2065 => 0.2341, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.29% (0.5860 => 0.6639, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.28% (0.0798 => 0.0904, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.28% (0.1032 => 0.1169, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.23% (0.2758 => 0.3123, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.23% (8.1363 => 9.2129, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.18% (0.1062 => 0.1202, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.17% (0.1906 => 0.2157, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.12% (0.0770 => 0.0871, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 13.10% (0.7835 => 0.8861, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.02% (0.1029 => 0.1163, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 12.92% (2.0273 => 2.2893, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 12.89% (0.7433 => 0.8391, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.86% (0.0933 => 0.1053, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.85% (0.2700 => 0.3047, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.73% (0.1438 => 0.1621, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: 12.51% (0.1463 => 0.1646, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.51% (0.1695 => 0.1907, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 12.51% (1.0722 => 1.2063, std.dev.: 0.0047) SingleSource/UnitTests/SignlessTypes/rem: 12.50% (0.1144 => 0.1287, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 12.39% (10.4361 => 11.7293, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.39% (4.9449 => 5.5574, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 12.38% (0.1268 => 0.1425, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.31% (0.1625 => 0.1825, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.31% (0.5981 => 0.6717, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.30% (5.0018 => 5.6169, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.27% (0.0929 => 0.1043, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 12.26% (5.7591 => 6.4653, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.25% (0.3307 => 0.3712, std.dev.: 0.0098) MultiSource/Applications/lua/lua: 12.23% (3.8723 => 4.3459, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.17% (0.8067 => 0.9049, std.dev.: 0.0024) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.16% (0.1143 => 0.1282, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 12.02% (0.3387 => 0.3794, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.01% (0.4879 => 0.5465, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 11.93% (0.4299 => 0.4812, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.91% (0.5569 => 0.6232, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: 11.89% (0.3473 => 0.3886, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.80% (0.3543 => 0.3961, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 11.78% (0.3497 => 0.3909, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.77% (1.1861 => 1.3257, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.74% (0.3543 => 0.3959, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 11.74% (0.3927 => 0.4388, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.74% (0.3561 => 0.3979, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.73% (0.1330 => 0.1486, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.71% (0.3177 => 0.3549, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 11.66% (1.1840 => 1.3220, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/exceptions-3: 11.63% (0.3516 => 0.3925, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 11.60% (0.3828 => 0.4272, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 11.59% (0.3694 => 0.4122, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.48% (7.9617 => 8.8760, std.dev.: 0.0129) MultiSource/Benchmarks/McCat/09-vor/vor: 11.48% (0.3180 => 0.3545, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 11.43% (1.4186 => 1.5807, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/property: 11.35% (0.3886 => 0.4327, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.32% (1.5859 => 1.7654, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/football/football: 11.24% (0.8921 => 0.9924, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1125 => 0.1250, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.07% (0.3441 => 0.3822, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 11.02% (1.5603 => 1.7322, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/bigfib: 10.77% (0.6456 => 0.7151, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.39% (2.2024 => 2.4312, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.33% (0.2603 => 0.2872, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 10.29% (2.2969 => 2.5333, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.21% (0.8101 => 0.8928, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 10.10% (0.4289 => 0.4722, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.93% (0.2266 => 0.2491, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.85% (0.3826 => 0.4203, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 9.81% (0.4620 => 0.5073, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 9.68% (21.9371 => 24.0605, std.dev.: 0.0085) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.67% (0.1892 => 0.2075, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 9.61% (0.2049 => 0.2246, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 9.41% (0.3422 => 0.3744, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.37% (0.6030 => 0.6595, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.37% (0.3865 => 0.4227, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 9.28% (0.5925 => 0.6475, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.26% (0.4103 => 0.4483, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.23% (0.4203 => 0.4591, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 9.04% (0.3684 => 0.4017, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 8.87% (0.4048 => 0.4407, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.71% (0.4636 => 0.5040, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference: 8.52% (0.7326 => 0.7950, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.32% (0.3427 => 0.3712, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 8.16% (0.3603 => 0.3897, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 8.12% (0.3092 => 0.3343, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 7.92% (17.1811 => 18.5419, std.dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.84% (0.3650 => 0.3936, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.78% (0.2891 => 0.3116, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 7.61% (0.2905 => 0.3126, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 7.55% (0.3098 => 0.3332, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.53% (0.2430 => 0.2613, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.53% (0.4064 => 0.4370, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.46% (0.3136 => 0.3370, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.39% (14.3668 => 15.4281, std.dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/strcat: 7.38% (0.2831 => 0.3040, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 7.33% (0.3232 => 0.3469, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.31% (0.3283 => 0.3523, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.31% (0.3162 => 0.3393, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.27% (2.0665 => 2.2168, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.26% (0.2756 => 0.2956, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.24% (0.2872 => 0.3080, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 7.19% (0.2877 => 0.3084, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.16% (0.2793 => 0.2993, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 7.14% (0.2871 => 0.3076, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.05% (0.2725 => 0.2917, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 7.04% (0.3052 => 0.3267, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.93% (3.8922 => 4.1620, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 6.93% (0.2714 => 0.2902, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.89% (0.2802 => 0.2995, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.75% (0.3379 => 0.3607, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 6.22% (1.2842 => 1.3641, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: 5.94% (0.3131 => 0.3317, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.09% (0.3817 => 0.3973, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.13% (0.3935 => 0.4058, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.87% (1.1194 => 1.1515, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.58% (1.1145 => 1.2993, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.71% (2.6778 => 2.9647, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.83% (1.1396 => 1.2516, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 9.75% (0.9957 => 1.0928, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.11% (0.9540 => 1.0218) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (3.1578 => 3.3679, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: 5.51% (1.9405 => 2.0475, std.dev.: 0.0100) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.65% (0.3463 => 0.3624, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.50% (4.2280 => 4.3337, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.34% (1.7254 => 1.7658, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.07% (3.6395 => 3.7150, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bisort/bisort: 1.75% (0.8333 => 0.8479, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2077, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.42% (2.6546 => 2.6923, std.dev.: 0.0039) MultiSource/Applications/viterbi/viterbi: 1.31% (4.4649 => 4.5235, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.03% (6.5088 => 6.5761, std.dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.01% (6.6874 => 0.1329, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -79.89% (0.8651 => 0.1740, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.26% (5.2763 => 3.2578, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.10% (5.3855 => 3.7105, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.64% (5.3526 => 3.7128, std.dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -14.59% (54.1659 => 46.2620, std.dev.: 0.0143) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.43% (2.9384 => 2.6320, std.dev.: 0.0073) MultiSource/Applications/ClamAV/clamscan: -6.65% (22.1758 => 20.7014, std.dev.: 0.0230) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.12% (8.0499 => 3.7740, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/mandel: -33.53% (1.1492 => 0.7639, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: -16.13% (1.6925 => 1.4195, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -11.57% (1.2373 => 1.0942, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3453 => 2.9599, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -10.64% (1.5373 => 1.3737, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.34% (19.9488 => 18.2847, std.dev.: 0.0120) MultiSource/Benchmarks/FreeBench/mason/mason: -7.87% (0.2161 => 0.1991, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.02% (1.8329 => 1.7042, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.17% (1.6805 => 1.5937, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.54% (1.5835 => 1.5116, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.28% (8.1563 => 7.8069, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.65% (3.2827 => 3.1629, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8777, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4982, std.dev.: 0.0078) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.52% (0.4808 => 0.4687, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: -1.99% (4.6441 => 4.5515, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -1.82% (10.2830 => 10.0956, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6828, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -1.68% (2.5528 => 2.5098, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4213, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/lists: -1.16% (6.2999 => 6.2270, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2878, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 17.33% (0.5229 => 0.6135, std.dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 14.45% (14.9895 => 17.1558, std.dev.: 0.0097) MultiSource/Benchmarks/MallocBench/gs/gs: 11.27% (4.1105 => 4.5736, std.dev.: 0.0102) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.38% (1.1048 => 1.2968, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.14% (7.1582 => 8.1706, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.61% (0.6222 => 0.7753, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35400.00% (0.0001 => 0.0355, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.50% (0.1485 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.85% (0.2116 => 0.2134, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 20 03:41:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 20 Oct 2012 05:41:09 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121020104109.958C42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5037?compare_to=5034&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5037, Order: 166374, Start Time: 2012-10-20 09:19:53, End Time: 2012-10-20 10:43:07 To: 5034, Order: 166370, Start Time: 2012-10-20 07:39:27, End Time: 2012-10-20 09:02:49 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 21 (20 on baseline) Performance Improvements: 4 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 950 (950 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.70% (0.2070 => 0.2188, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/18-imp/imp: 4.64% (0.3361 => 0.3517, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.59% (0.3244 => 0.3393, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.38% (0.4864 => 0.5077, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.06% (0.5880 => 0.6119, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.78% (0.8112 => 0.8419, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.57% (0.6214 => 0.6436, std.dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.39% (0.3185 => 0.3293, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.10% (0.6100 => 0.6289, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/05-eks/eks: 2.98% (0.4335 => 0.4464, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.83% (0.7562 => 0.7776, std.dev.: 0.0028) MultiSource/Applications/hbd/hbd: 2.18% (1.4300 => 1.4612, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.07% (8.5463 => 8.7234, std.dev.: 0.0151) MultiSource/Applications/lua/lua: 1.80% (3.8022 => 3.8707, std.dev.: 0.0215) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.36% (4.5203 => 4.5816, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.19% (4.4523 => 4.5055, std.dev.: 0.0100) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.14% (1.1091 => 1.1217, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.92% (5.2132 => 5.3134, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.46% (40.6161 => 41.2107, std.dev.: 0.1612) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.25% (1.4057 => 1.4233, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.14% (2.9381 => 2.9716, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -6.65% (8.9506 => 8.3557, std.dev.: 0.1793) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -4.10% (2.4119 => 2.3129, std.dev.: 0.0288) MultiSource/Applications/SPASS/SPASS: -3.03% (8.6621 => 8.3994, std.dev.: 0.0959) MultiSource/Applications/spiff/spiff: -1.29% (2.8852 => 2.8479, std.dev.: 0.0101) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.09% (16.4297 => 16.4446, std.dev.: 0.0539) MultiSource/Applications/obsequi/Obsequi: 2.37% (1.0325 => 1.0570, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: 0.46% (0.6314 => 0.6343, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/08-main/main: 5.28% (0.1817 => 0.1913, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.57% (0.1636 => 0.1678, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.06% (0.3233 => 0.3235, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.24% (0.2488 => 0.2482, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.36% (0.3342 => 0.3330, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.04% (0.2348 => 0.2349, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/bigfib: 0.67% (0.5929 => 0.5969, std.dev.: 0.0180) SingleSource/Benchmarks/Misc/mandel: 13.44% (0.0387 => 0.0439, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.12% (0.3274 => 0.3278, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -0.51% (0.1978 => 0.1968, std.dev.: 0.0019) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -9.17% (0.0240 => 0.0218, std.dev.: 0.0074) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 17.78% (0.0180 => 0.0212, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.45% (0.0413 => 0.0419, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.86% (0.0243 => 0.0318, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 17.76% (0.0259 => 0.0305, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 8.31% (0.0385 => 0.0417, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 4.44% (0.0180 => 0.0188, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/test1: -8.00% (0.0175 => 0.0161, std.dev.: 0.0022) SingleSource/UnitTests/byval-alignment: 0.96% (0.0312 => 0.0315, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1481 => 0.1480, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 2.68% (1.1097 => 1.1394, std.dev.: 0.0577) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -0.14% (0.1435 => 0.1433, std.dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.39% (0.4064 => 0.4048, std.dev.: 0.0267) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.07% (0.1402 => 0.1401, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 16.61% (0.0566 => 0.0660, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 32.68% (0.0205 => 0.0272, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.35% (0.0537 => 0.0555, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: - (1.1432 => 1.1432, std.dev.: 0.0498) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 1700.00% (0.0001 => 0.0018, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.43% (0.0571 => 0.0540, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.07% (0.0184 => 0.0197, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.01% (0.8030 => 0.8029, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 20.00% (0.0040 => 0.0048, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.12% (2.1832 => 1.6567, std.dev.: 0.0094) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.43% (0.0810 => 0.0935, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/tsp/tsp: 11.42% (0.1112 => 0.1239, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.97% (0.3137 => 0.3293, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.75% (0.4847 => 0.5077, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.64% (0.6010 => 0.6289, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.05% (0.7473 => 0.7776, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.33% (0.8148 => 0.8419, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.65% (0.5961 => 0.6119, std.dev.: 0.0050) MultiSource/Applications/hbd/hbd: 2.40% (1.4269 => 1.4612, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.37% (0.6287 => 0.6436, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.34% (1.1606 => 1.1878, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.10% (0.9435 => 0.9633, std.dev.: 0.0076) MultiSource/Applications/treecc/treecc: 1.47% (1.9948 => 2.0241, std.dev.: 0.0082) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.80% (1.5795 => 2.5083, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.88% (0.3186 => 0.3469, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.34% (1.1857 => 1.2846, std.dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: 5.96% (63.1822 => 66.9459, std.dev.: 0.0127) SingleSource/Benchmarks/Misc/ReedSolomon: 2.79% (8.5322 => 8.7700, std.dev.: 0.0414) MultiSource/Applications/siod/siod: 2.78% (3.6643 => 3.7663, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/bh/bh: 1.71% (2.3560 => 2.3964, std.dev.: 0.0083) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -10.22% (0.3269 => 0.2935, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/heapsort: -7.83% (3.2926 => 3.0349, std.dev.: 0.0903) MultiSource/Applications/lua/lua: -5.18% (29.8330 => 28.2873, std.dev.: 0.2275) SingleSource/Benchmarks/Shootout-C++/hash2: -1.54% (3.4237 => 3.3709, std.dev.: 0.0024) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.01% (16.4461 => 16.4446, std.dev.: 0.0539) MultiSource/Applications/obsequi/Obsequi: 3.00% (1.0262 => 1.0570, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: 0.17% (0.6332 => 0.6343, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/08-main/main: 4.48% (0.1831 => 0.1913, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.63% (0.1559 => 0.1678, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.59% (0.3123 => 0.3235, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.77% (0.2463 => 0.2482, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.42% (0.3344 => 0.3330, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.63% (0.2364 => 0.2349, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/bigfib: -0.68% (0.6010 => 0.5969, std.dev.: 0.0180) SingleSource/Benchmarks/Misc/mandel: 2.33% (0.0429 => 0.0439, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.37% (0.3266 => 0.3278, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -0.05% (0.1969 => 0.1968, std.dev.: 0.0019) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -2.68% (0.0224 => 0.0218, std.dev.: 0.0074) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 72.36% (0.0123 => 0.0212, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.70% (0.0408 => 0.0419, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 25.20% (0.0254 => 0.0318, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.99% (0.0302 => 0.0305, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 8.59% (0.0384 => 0.0417, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -1.05% (0.0190 => 0.0188, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/test1: -10.56% (0.0180 => 0.0161, std.dev.: 0.0022) SingleSource/UnitTests/byval-alignment: 36.96% (0.0230 => 0.0315, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.92% (0.1438 => 0.1480, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.57% (1.1329 => 1.1394, std.dev.: 0.0577) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -1.98% (0.1462 => 0.1433, std.dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.79% (0.4164 => 0.4048, std.dev.: 0.0267) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.34% (0.1369 => 0.1401, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.96% (0.0641 => 0.0660, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 39.49% (0.0195 => 0.0272, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.98% (0.0578 => 0.0555, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.04% (1.1437 => 1.1432, std.dev.: 0.0498) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 28.57% (0.0014 => 0.0018, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.88% (0.0627 => 0.0540, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 9.44% (0.0180 => 0.0197, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.15% (0.8017 => 0.8029, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -22.58% (0.0062 => 0.0048, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 4.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 20 04:44:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 20 Oct 2012 06:44:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121020114430.0DDE12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5038?compare_to=5035&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5038, Order: 166374, Start Time: 2012-10-20 10:20:13, End Time: 2012-10-20 11:47:29 To: 5035, Order: 166370, Start Time: 2012-10-20 08:23:10, End Time: 2012-10-20 09:49:08 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (201 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1038 (666 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 32.61% (0.3833 => 0.5083, std.dev.: 0.0447) MultiSource/Applications/oggenc/oggenc: 1.10% (5.0323 => 5.0877, std.dev.: 0.0068) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.40% (3.7956 => 3.8486, std.dev.: 0.0180) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.26% (80.6511 => 78.8250, std.dev.: 0.6594) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.69% (2.0176 => 2.4956, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.06% (0.1410 => 0.1707, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 18.64% (0.0826 => 0.0980, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 18.10% (0.2243 => 0.2649, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 17.37% (0.1013 => 0.1189, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.16% (0.0746 => 0.0874, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.85% (0.7710 => 0.9009, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.69% (0.0653 => 0.0762, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 15.44% (0.1062 => 0.1226, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.38% (0.0819 => 0.0945, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.22% (0.2596 => 0.2991, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 15.07% (0.2721 => 0.3131, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.37% (0.1413 => 0.1616, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.32% (0.1327 => 0.1517, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 14.26% (0.1003 => 0.1146) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.18% (0.0811 => 0.0926, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.15% (0.9199 => 1.0501, std.dev.: 0.0020) MultiSource/Applications/hbd/hbd: 14.15% (1.3693 => 1.5631, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 14.14% (0.7038 => 0.8033, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.07% (0.0725 => 0.0827, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.05% (0.0847 => 0.0966, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 14.01% (0.1478 => 0.1685, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.98% (3.9660 => 4.5205, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.95% (0.6959 => 0.7930, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.89% (0.0720 => 0.0820, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.81% (0.1072 => 0.1220, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.78% (0.5637 => 0.6414, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.73% (0.5265 => 0.5988, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.1588 => 0.1806, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.69% (0.0964 => 0.1096, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.54% (0.1986 => 0.2255, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 13.50% (0.1111 => 0.1261, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.49% (0.2023 => 0.2296, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 13.42% (0.7460 => 0.8461, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.40% (0.1276 => 0.1447, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.40% (0.1075 => 0.1219, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.07% (0.2914 => 0.3295, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 13.05% (0.4062 => 0.4592, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 13.03% (0.4328 => 0.4892, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.81% (1.4563 => 1.6428, std.dev.: 0.0028) MultiSource/Applications/Burg/burg: 12.79% (1.1061 => 1.2476, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.69% (0.0977 => 0.1101, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.62% (0.6283 => 0.7076, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 12.60% (13.8202 => 15.5619, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.59% (0.3899 => 0.4390, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/distray/distray: 12.59% (0.0818 => 0.0921) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.58% (1.2193 => 1.3727, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.52% (0.1014 => 0.1141, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.50% (1.1364 => 1.2784, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.48% (0.5577 => 0.6273, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 12.24% (0.7506 => 0.8425, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 12.12% (0.5818 => 0.6523, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.10% (0.1157 => 0.1297, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 12.05% (0.2995 => 0.3356, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.01% (0.3246 => 0.3636, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.01% (0.1865 => 0.2089, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.94% (0.4379 => 0.4902, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.82% (0.3130 => 0.3500, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.75% (0.2127 => 0.2377, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/Hello: 11.74% (0.5748 => 0.6423, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.71% (0.4791 => 0.5352, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 11.71% (0.1657 => 0.1851, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: 11.70% (0.6744 => 0.7533, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/gs/gs: 11.68% (3.8646 => 4.3161, std.dev.: 0.0082) SingleSource/UnitTests/ObjC++/property-reference: 11.51% (0.7061 => 0.7874, std.dev.: 0.0154) MultiSource/Benchmarks/McCat/09-vor/vor: 11.42% (0.2925 => 0.3259, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 11.40% (1.0313 => 1.1489, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.36% (0.3485 => 0.3881, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 11.36% (0.2781 => 0.3097, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/lists: 11.36% (0.3293 => 0.3667, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 11.24% (0.3220 => 0.3582, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.21% (0.4016 => 0.4466, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/chomp: 11.20% (0.1589 => 0.1767, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.18% (0.3756 => 0.4176, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 11.18% (1.9270 => 2.1424, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.16% (0.1048 => 0.1165, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.12% (0.1789 => 0.1988, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.11% (0.2782 => 0.3091, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.09% (0.3022 => 0.3357, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.95% (0.3489 => 0.3871, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.94% (0.1435 => 0.1592, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 10.90% (0.2726 => 0.3023, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.82% (7.2180 => 7.9993, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/moments: 10.81% (0.3868 => 0.4286, std.dev.: 0.0028) MultiSource/Applications/d/make_dparser: 10.80% (3.1889 => 3.5333, std.dev.: 0.0067) MultiSource/Applications/kimwitu++/kc: 10.78% (16.6129 => 18.4046, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/sieve: 10.77% (0.3453 => 0.3825, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.75% (0.3580 => 0.3965, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 10.72% (2.1791 => 2.4128, std.dev.: 0.0229) MultiSource/Benchmarks/Olden/health/health: 10.72% (0.1213 => 0.1343, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.71% (0.1569 => 0.1737, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 10.70% (0.3149 => 0.3486, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 10.69% (0.8310 => 0.9198, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 10.65% (0.3107 => 0.3438, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 10.65% (0.2760 => 0.3054, std.dev.: 0.0043) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 10.65% (0.1061 => 0.1174, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 10.65% (0.2761 => 0.3055, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.63% (0.8698 => 0.9623, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists1: 10.55% (0.3534 => 0.3907, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.55% (1.9828 => 2.1919, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.52% (0.4390 => 0.4852, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/hello: 10.51% (0.2607 => 0.2881, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.49% (0.2966 => 0.3277, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.45% (1.3245 => 1.4629, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 10.45% (0.2690 => 0.2971, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.44% (0.3755 => 0.4147, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/fibo: 10.43% (0.2628 => 0.2902, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 10.40% (0.3192 => 0.3524, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.27% (0.2765 => 0.3049, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 10.21% (0.2937 => 0.3237, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 10.17% (3.6692 => 4.0425, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/matrix: 10.14% (0.2988 => 0.3291, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 10.02% (4.3801 => 4.8191, std.dev.: 0.0057) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.95% (0.2140 => 0.2353, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.95% (4.4433 => 4.8852, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.94% (0.2696 => 0.2964, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.92% (4.9865 => 5.4812, std.dev.: 0.0202) MultiSource/Benchmarks/McCat/05-eks/eks: 9.92% (0.4113 => 0.4521, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.90% (0.6576 => 0.7227, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.86% (0.6135 => 0.6740, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/objinst: 9.71% (0.2945 => 0.3231, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.62% (0.1819 => 0.1994, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 9.60% (1.2749 => 1.3973, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 9.50% (1.0594 => 1.1600, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.48% (0.2321 => 0.2541, std.dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: 9.44% (14.8535 => 16.2556, std.dev.: 0.0187) MultiSource/Benchmarks/sim/sim: 9.33% (0.3131 => 0.3423, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.24% (0.8818 => 0.9633, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 9.11% (4.6629 => 5.0877, std.dev.: 0.0068) MultiSource/Benchmarks/mafft/pairlocalalign: 9.09% (8.4961 => 9.2682, std.dev.: 0.0095) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.97% (0.3511 => 0.3826, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 8.82% (0.6250 => 0.6801, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.79% (1.1333 => 1.2329, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.68% (0.9108 => 0.9899, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.66% (1.5188 => 1.6504, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 8.58% (3.7467 => 4.0683, std.dev.: 0.0166) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.52% (3.2742 => 3.5533, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/neural/neural: 8.52% (0.1385 => 0.1503, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.32% (0.4805 => 0.5205, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.32% (0.3245 => 0.3515, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 8.22% (6.5754 => 7.1158, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.20% (0.2243 => 0.2427, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 8.17% (0.2008 => 0.2172, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.00% (0.3650 => 0.3942, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.99% (0.2504 => 0.2704, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 7.96% (1.2292 => 1.3270, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.90% (2.1007 => 2.2666, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.80% (6.2785 => 6.7685, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/parameter-passing: 7.79% (0.4003 => 0.4315, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/exceptions: 7.79% (0.3914 => 0.4219, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/property: 7.56% (0.3940 => 0.4238, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/ReedSolomon: 7.54% (0.1777 => 0.1911, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 7.44% (0.3789 => 0.4071, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-2: 7.44% (0.3601 => 0.3869, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.37% (13.2842 => 14.2638, std.dev.: 0.0085) SingleSource/UnitTests/ObjC/exceptions-4: 7.35% (0.3646 => 0.3914, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/trivial-interface: 7.35% (0.3578 => 0.3841, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/synchronized: 7.26% (0.3663 => 0.3929, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions-3: 7.18% (0.3623 => 0.3883, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: 5.72% (16.2614 => 17.1908, std.dev.: 0.0106) MultiSource/Applications/ClamAV/clamscan: 5.28% (14.5298 => 15.2972, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/bh/bh: 4.44% (0.2859 => 0.2986, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 2.69% (33.2944 => 34.1886, std.dev.: 0.0186) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.64% (0.4846 => 0.6961, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5164, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fbench: 24.29% (1.8175 => 2.2589, std.dev.: 0.0153) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.10% (1.0895 => 1.2758, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 11.15% (1.1560 => 1.2849, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 9.04% (0.8273 => 0.9021, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.47% (0.1322 => 0.1434, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.47% (3.1736 => 3.4107, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 5.62% (1.2998 => 1.3728, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.43% (0.9692 => 1.0218) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.80% (0.3458 => 0.3624, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.63% (1.9144 => 2.0030, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.45% (2.8606 => 2.9880, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 4.39% (0.5449 => 0.5688, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.36% (12.0921 => 12.4982, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: 3.35% (1.9199 => 1.9842, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 3.31% (10.7476 => 11.1030, std.dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 3.23% (11.2619 => 11.6256, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bisort/bisort: 3.01% (0.8239 => 0.8487, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.41% (1.0310 => 1.0558, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.21% (7.4271 => 7.5909, std.dev.: 0.0025) MultiSource/Benchmarks/llubenchmark/llu: 2.00% (3.7731 => 3.8486, std.dev.: 0.0180) MultiSource/Applications/lemon/lemon: 1.86% (1.4298 => 1.4564, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5122, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2123, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1876, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 1.20% (5.5130 => 5.5793, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.17% (9.9194 => 10.0359, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.15% (8.8259 => 8.9270, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/lists: 1.12% (12.4560 => 12.5951, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.59% (0.2670 => 0.1426, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.65% (0.4657 => 0.3928, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.68% (1.3813 => 1.2200, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.37% (1.3819 => 1.2248, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.28% (1.0460 => 0.8548, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.82% (0.2238 => 0.1951, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.23% (20.3410 => 18.2597, std.dev.: 0.0301) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.19% (1.3780 => 1.2927, std.dev.: 0.0044) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0288) SingleSource/Benchmarks/McGill/chomp: -5.81% (1.2308 => 1.1593, std.dev.: 0.0059) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0099) SingleSource/UnitTests/Vector/multiplies: -5.15% (2.6470 => 2.5107, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.44% (0.9996 => 0.9552, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.82% (1.7688 => 1.7013, std.dev.: 0.0058) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.14% (0.4867 => 0.4714, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -2.90% (3.0263 => 2.9386, std.dev.: 0.0028) MultiSource/Applications/siod/siod: -2.89% (3.2729 => 3.1783, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -2.73% (1.9762 => 1.9222, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8814, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.37% (4.1080 => 4.0106, std.dev.: 0.0017) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.83% (6.3560 => 6.2398, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.65% (0.8342 => 0.8204, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.58% (2.5254 => 2.4855, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -1.56% (26.5159 => 26.1010, std.dev.: 0.0161) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0062, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: -1.25% (28.2225 => 27.8699, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: -1.17% (5.3167 => 5.2543, std.dev.: 0.0003) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1139, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -1.05% (84.4286 => 83.5446, std.dev.: 0.0113) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 20 04:47:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 20 Oct 2012 06:47:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121020114700.B97662A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5039?compare_to=5036&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5039, Order: 166374, Start Time: 2012-10-20 10:29:01, End Time: 2012-10-20 11:49:01 To: 5036, Order: 166370, Start Time: 2012-10-20 08:38:24, End Time: 2012-10-20 09:58:28 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 8 (83 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 8 (185 on baseline) Performance Improvements: 6 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 90 (15 on baseline) Unchanged Tests: 930 (650 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.56% (0.2634 => 0.2514, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.49% (15.4281 => 15.1984, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.88% (3.7128 => 3.5318, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -3.62% (1.1515 => 1.1098, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.83% (3.7105 => 3.5313, std.dev.: 0.0018) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -99.98% (0.4032 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -100.00% (2.9647 => 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -99.80% (0.0511 => 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 26.26% (1.7654 => 2.2290, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/BoolLiteralTest: 18.25% (0.3928 => 0.4645, std.dev.: 0.0250) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 17.42% (2.4312 => 2.8546, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 11.85% (0.1646 => 0.1841, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 9.66% (0.2246 => 0.2463, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.58% (1.5807 => 1.6057, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: 1.31% (15.3893 => 15.5905, std.dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.07% (54.3707 => 56.0373, std.dev.: 0.2521) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.10% (3.2578 => 3.2221, std.dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9698 => 2.4752, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.56% (1.2236 => 1.0699, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.12% (1.0218 => 0.9184) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.95% (1.7658 => 1.7313, std.dev.: 0.0003) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -20.96% (0.6135 => 0.4849, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 0.09% (17.1558 => 17.1713, std.dev.: 0.0197) MultiSource/Benchmarks/Bullet/bullet: 0.01% (56.0516 => 56.0578, std.dev.: 0.0362) MultiSource/Benchmarks/MallocBench/gs/gs: -0.06% (4.5736 => 4.5710, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.42% (0.0481 => 0.0479, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.62% (0.0483 => 0.0480, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.44% (0.0451 => 0.0449) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.44% (0.0452 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.45% (0.0440 => 0.0438, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.45% (0.0442 => 0.0440, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.46% (0.0434 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.46% (0.0436 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.44% (0.0452 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.66% (0.0454 => 0.0451, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.45% (0.0447 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.67% (0.0448 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.46% (0.0436 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.46% (0.0438 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.45% (0.0444 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.45% (0.0445 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.44% (0.0455 => 0.0453, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.66% (0.0457 => 0.0454, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.46% (0.0432 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.46% (0.0433 => 0.0431) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.45% (0.0444 => 0.0442, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.45% (0.0445 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.46% (0.0435 => 0.0433, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.46% (0.0436 => 0.0434, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.47% (0.0427 => 0.0425, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.23% (0.0428 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.70% (0.0426 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.70% (0.0428 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.65% (0.0463 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.65% (0.0464 => 0.0461, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.47% (0.0425 => 0.0423, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.70% (0.0427 => 0.0424, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.47% (0.0426 => 0.0424) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.70% (0.0427 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.46% (0.0434 => 0.0432, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.46% (0.0435 => 0.0433) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.09% (1.2968 => 1.2980, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.12% (8.1706 => 8.1800, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.13% (0.7753 => 0.7763, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.56% (0.0355 => 0.0353, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -0.14% (0.1433 => 0.1431, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -99.94% (0.1648 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -99.95% (0.2134 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/Bullet/bullet: -11.36% (63.2438 => 56.0578, std.dev.: 0.0362) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.70% (0.2271 => 0.2514, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.79% (14.3668 => 15.1984, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -34.02% (5.3526 => 3.5318, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -0.86% (1.1194 => 1.1098, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -34.43% (5.3855 => 3.5313, std.dev.: 0.0018) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -99.94% (0.1639 => 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -99.97% (0.3987 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -100.00% (2.6778 => 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -99.80% (0.0506 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 35.79% (14.1553 => 19.2208, std.dev.: 0.0208) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.56% (3.4629 => 5.7677, std.dev.: 0.0067) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13489.58% (0.0720 => 9.7845, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049900.00% (0.0001 => 10.0500, std.dev.: 0.0011) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.63% (0.2554 => 0.4179, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/lowercase: 55.86% (0.0256 => 0.0399) MultiSource/Benchmarks/PAQ8p/paq8p: 50.38% (10.3673 => 15.5905, std.dev.: 0.0017) SingleSource/UnitTests/SignlessTypes/factor: 44.26% (0.0296 => 0.0427, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 40.55% (1.5859 => 2.2290, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/distray/distray: 36.08% (0.1056 => 0.1437, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 35.76% (0.1622 => 0.2202, std.dev.: 0.0000) SingleSource/UnitTests/vla: 32.11% (0.0355 => 0.0469, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 29.61% (2.2024 => 2.8546, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 25.84% (0.1463 => 0.1841, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 24.82% (0.0834 => 0.1041, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.50% (0.1566 => 0.1887, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 20.20% (0.2049 => 0.2463, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 19.48% (0.1432 => 0.1711, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.80% (7.0540 => 8.3095, std.dev.: 0.0157) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.80% (0.0871 => 0.1026, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 17.68% (0.1555 => 0.1830, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.36% (0.5105 => 0.5991, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.05% (0.6675 => 0.7813, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.88% (2.2022 => 2.5739, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 16.19% (0.1655 => 0.1923, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.02% (1.3050 => 1.5141, std.dev.: 0.0029) MultiSource/Applications/d/make_dparser: 16.01% (3.3354 => 3.8693, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.74% (0.0648 => 0.0750, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 15.48% (0.0730 => 0.0843, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 15.41% (0.0798 => 0.0921, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/em3d/em3d: 15.40% (0.1695 => 0.1956, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 15.35% (0.1440 => 0.1661, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/tsp/tsp: 15.15% (0.1175 => 0.1353, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 15.13% (0.1163 => 0.1339, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 15.13% (0.0793 => 0.0913, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.12% (0.1032 => 0.1188, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.02% (0.5020 => 0.5774, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.99% (1.5415 => 1.7725, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.96% (0.1337 => 0.1537, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 14.78% (0.8172 => 0.9380, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.77% (0.1510 => 0.1733, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.68% (0.0838 => 0.0961) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.67% (0.0886 => 0.1016, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 14.60% (0.7115 => 0.8154, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.49% (0.0842 => 0.0964, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 14.38% (0.3109 => 0.3556, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 14.37% (0.3423 => 0.3915, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 14.29% (0.3282 => 0.3751, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.21% (0.0746 => 0.0852, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.18% (0.1940 => 0.2215, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.05% (1.7609 => 2.0083, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.04% (4.2646 => 4.8633, std.dev.: 0.0022) MultiSource/Applications/aha/aha: 13.99% (0.1151 => 0.1312, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.97% (0.9765 => 1.1129, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.90% (0.2065 => 0.2352, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 13.90% (1.1642 => 1.3260, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout/matrix: 13.81% (0.0818 => 0.0931, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 13.76% (0.1584 => 0.1802, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/exptree: 13.76% (0.0814 => 0.0926, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.62% (0.2107 => 0.2394, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.59% (0.3121 => 0.3545, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.51% (0.1236 => 0.1403, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 13.50% (0.6450 => 0.7321, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 13.42% (9.4845 => 10.7573, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.31% (0.2758 => 0.3125, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.28% (0.5860 => 0.6638, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.25% (0.1117 => 0.1265, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.25% (0.0770 => 0.0872, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.22% (0.1906 => 0.2158, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.19% (1.4186 => 1.6057, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.15% (0.4615 => 0.5222, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.15% (8.1363 => 9.2064, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.14% (0.1438 => 0.1627, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.08% (0.0933 => 0.1055, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 13.07% (0.1125 => 0.1272, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 13.01% (5.7591 => 6.5081, std.dev.: 0.0062) MultiSource/Applications/treecc/treecc: 13.00% (2.0273 => 2.2909, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 12.99% (0.7835 => 0.8853, std.dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: 12.92% (0.7433 => 0.8393, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.83% (0.1029 => 0.1161, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.80% (0.1695 => 0.1912, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/rem: 12.76% (0.1144 => 0.1290, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.71% (0.1062 => 0.1197, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.59% (0.0929 => 0.1046, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 12.58% (1.1840 => 1.3329, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.56% (0.2700 => 0.3039, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 12.50% (1.0722 => 1.2062, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.49% (0.5981 => 0.6728, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.44% (4.9449 => 5.5600, std.dev.: 0.0036) MultiSource/Applications/lua/lua: 12.34% (3.8723 => 4.3500, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.32% (0.4879 => 0.5480, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 12.31% (0.4299 => 0.4828, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 12.30% (10.4361 => 11.7199, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.29% (5.0018 => 5.6164, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.28% (0.3307 => 0.3713, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.25% (0.1625 => 0.1824, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.17% (0.8067 => 0.9049, std.dev.: 0.0032) MultiSource/Benchmarks/sim/sim: 12.13% (0.3387 => 0.3798, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: 12.07% (0.1268 => 0.1421, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.84% (1.1861 => 1.3265, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.82% (0.5569 => 0.6227, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.80% (0.1330 => 0.1487, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.79% (0.2603 => 0.2910, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.71% (0.3177 => 0.3549, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.64% (7.9617 => 8.8881, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/football/football: 11.61% (0.8921 => 0.9957, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/09-vor/vor: 11.29% (0.3180 => 0.3539, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.22% (0.3441 => 0.3827, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 11.21% (0.1044 => 0.1161, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.20% (0.1143 => 0.1271, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 11.15% (1.5603 => 1.7343, std.dev.: 0.0095) MultiSource/Benchmarks/Olden/bh/bh: 11.06% (0.3092 => 0.3434, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 10.84% (0.6456 => 0.7156, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.50% (0.2266 => 0.2504, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.48% (0.3473 => 0.3837, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.47% (0.1892 => 0.2090, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.44% (0.3543 => 0.3913, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.42% (0.3927 => 0.4336, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.36% (0.3561 => 0.3930, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.36% (0.3543 => 0.3910, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.34% (0.3694 => 0.4076, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 10.32% (0.3497 => 0.3858, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 10.31% (2.2969 => 2.5338, std.dev.: 0.0166) SingleSource/UnitTests/ObjC/exceptions: 10.27% (0.3828 => 0.4221, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.24% (0.3516 => 0.3876, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.22% (0.3826 => 0.4217, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.20% (0.8101 => 0.8927, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 10.16% (0.3886 => 0.4281, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 9.96% (0.4289 => 0.4716, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 9.85% (0.4620 => 0.5075, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.56% (0.4636 => 0.5079, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 9.50% (0.3422 => 0.3747, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.34% (0.3865 => 0.4226, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.23% (0.4203 => 0.4591, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.12% (0.4103 => 0.4477, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 8.90% (0.3684 => 0.4012, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 8.84% (0.4048 => 0.4406, std.dev.: 0.0081) MultiSource/Applications/JM/lencod/lencod: 8.84% (21.9371 => 23.8764, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.58% (0.3427 => 0.3721, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 8.35% (0.3603 => 0.3904, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.24% (0.6030 => 0.6527, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.15% (0.5925 => 0.6408, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 8.01% (17.1811 => 18.5566, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.94% (0.3136 => 0.3385, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.80% (3.8922 => 4.1957, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.73% (0.3650 => 0.3932, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 7.70% (0.7326 => 0.7890, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/strcat: 7.59% (0.2831 => 0.3046, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 7.59% (0.3098 => 0.3333, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.57% (0.2430 => 0.2614, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 7.55% (0.3232 => 0.3476, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.52% (0.3283 => 0.3530, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.51% (0.2891 => 0.3108, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.47% (0.2905 => 0.3122, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.21% (0.3162 => 0.3390, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.13% (2.0665 => 2.2138, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.11% (0.2756 => 0.2952, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.05% (0.2725 => 0.2917, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.03% (0.2872 => 0.3074, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.02% (0.2793 => 0.2989, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 7.00% (0.2871 => 0.3072, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 6.98% (0.3379 => 0.3615, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.95% (0.2877 => 0.3077, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.88% (0.3052 => 0.3262, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.71% (0.2802 => 0.2990, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.71% (0.2714 => 0.2896, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 6.28% (1.2842 => 1.3648, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/objinst: 5.72% (0.3131 => 0.3310, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.92% (0.3935 => 0.4050, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.83% (0.3817 => 0.3925, std.dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.55% (0.2944 => 0.3284, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.30% (2.8904 => 3.2171, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 9.87% (1.1396 => 1.2521, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 9.65% (0.9957 => 1.0918, std.dev.: 0.0203) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.1578 => 3.3687, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: 5.92% (1.9405 => 2.0553, std.dev.: 0.0030) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.59% (4.2280 => 4.3376, std.dev.: 0.0219) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.98% (3.6395 => 3.7114, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/bisort/bisort: 1.82% (0.8333 => 0.8485, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 1.54% (3.1595 => 3.2080, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.48% (2.6546 => 2.6940, std.dev.: 0.0029) MultiSource/Applications/viterbi/viterbi: 1.20% (4.4649 => 4.5183, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.02% (6.6874 => 0.1324, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -79.89% (0.8651 => 0.1740, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.93% (5.2763 => 3.2221, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -14.50% (54.1659 => 46.3120, std.dev.: 0.0135) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.52% (2.9384 => 2.6293, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -6.71% (22.1758 => 20.6880, std.dev.: 0.0110) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.08% (8.0499 => 3.7773, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.43% (1.1492 => 0.7650, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4752, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.94% (1.6925 => 1.4227, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.53% (0.0998 => 0.0853, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.72% (1.2258 => 1.0699, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -11.65% (1.2373 => 1.0932, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3453 => 2.9599, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -11.02% (1.5373 => 1.3679, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.57% (19.9488 => 18.2384, std.dev.: 0.0357) MultiSource/Benchmarks/FreeBench/mason/mason: -7.82% (0.2161 => 0.1992, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.03% (1.8329 => 1.7041, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.18% (1.6805 => 1.5935, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-5: -5.15% (1.5835 => 1.5020, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.44% (8.1563 => 7.7944, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1627, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8775, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5051, std.dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.83% (0.4808 => 0.4672, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6796, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -1.73% (10.2830 => 10.1054, std.dev.: 0.0074) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5093, std.dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4218, std.dev.: 0.0083) MultiSource/Applications/sqlite3/sqlite3: -1.45% (4.6441 => 4.5768, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2878, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -7.27% (0.5229 => 0.4849, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 14.56% (14.9895 => 17.1713, std.dev.: 0.0197) MultiSource/Benchmarks/MallocBench/gs/gs: 11.20% (4.1105 => 4.5710, std.dev.: 0.0101) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.49% (1.1048 => 1.2980, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.27% (7.1582 => 8.1800, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.77% (0.6222 => 0.7763, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35200.00% (0.0001 => 0.0353, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.64% (0.1485 => 0.1431, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -99.95% (0.2116 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 20 06:54:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 20 Oct 2012 08:54:04 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121020135404.B6E662A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5040?compare_to=5037&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5040, Order: 166375, Start Time: 2012-10-20 12:32:12, End Time: 2012-10-20 13:56:06 To: 5037, Order: 166374, Start Time: 2012-10-20 09:19:53, End Time: 2012-10-20 10:43:07 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 8 (24 on baseline) Performance Improvements: 0 (6 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 967 (944 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.78% (0.8647 => 0.8801, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.65% (1.2471 => 1.2677, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.46% (0.8094 => 0.8212, std.dev.: 0.0020) MultiSource/Applications/d/make_dparser: 1.23% (3.2466 => 3.2865, std.dev.: 0.0096) MultiSource/Applications/oggenc/oggenc: 1.00% (4.9444 => 4.9939, std.dev.: 0.0179) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 5.21% (21.3641 => 22.4782, std.dev.: 0.1194) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.52% (2.4204 => 2.4571, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.03% (1.5997 => 1.6161, std.dev.: 0.0022) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.21% (16.4446 => 16.4101, std.dev.: 0.2047) MultiSource/Applications/obsequi/Obsequi: -1.49% (1.0570 => 1.0413, std.dev.: 0.0049) MultiSource/Applications/sqlite3/sqlite3: 0.57% (0.6343 => 0.6379, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/08-main/main: -7.84% (0.1913 => 0.1763, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.30% (0.1678 => 0.1683, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.05% (0.3235 => 0.3201, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.45% (0.2482 => 0.2446, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.04% (0.3330 => 0.3262, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.34% (0.2349 => 0.2357, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/bigfib: -0.25% (0.5969 => 0.5954, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/mandel: -4.10% (0.0439 => 0.0421, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.06% (0.3278 => 0.3276, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/strcat: -1.22% (0.1968 => 0.1944, std.dev.: 0.0053) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -5.05% (0.0218 => 0.0207, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.42% (0.0212 => 0.0209, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.48% (0.0419 => 0.0417, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -15.41% (0.0318 => 0.0269, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.33% (0.0305 => 0.0306, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -9.11% (0.0417 => 0.0379, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/casts: 4.26% (0.0188 => 0.0196, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -16.15% (0.0161 => 0.0135, std.dev.: 0.0037) SingleSource/UnitTests/byval-alignment: 6.98% (0.0315 => 0.0337, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1480 => 0.1479, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.26% (1.1394 => 1.1364, std.dev.: 0.0189) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 6.00% (0.1433 => 0.1519, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.35% (0.4048 => 0.4062, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.00% (0.1401 => 0.1345, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.21% (0.0660 => 0.0668, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.10% (0.0272 => 0.0275, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.42% (0.0555 => 0.0574, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.11% (1.1432 => 1.1445, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 44.44% (0.0018 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 16.85% (0.0540 => 0.0631, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 19.80% (0.0197 => 0.0236, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.46% (0.8029 => 0.7992, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 400.00% (0.0001 => 0.0005, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 41.67% (0.0048 => 0.0068, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.82% (2.1832 => 1.6631, std.dev.: 0.0136) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.05% (0.2180 => 0.2290, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.64% (0.7473 => 0.7820, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.99% (0.6010 => 0.6250, std.dev.: 0.0023) MultiSource/Applications/Burg/burg: 3.49% (1.2222 => 1.2648, std.dev.: 0.0102) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.19% (0.3137 => 0.3237, std.dev.: 0.0025) MultiSource/Applications/treecc/treecc: 2.92% (1.9948 => 2.0530, std.dev.: 0.0116) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.71% (0.8148 => 0.8369, std.dev.: 0.0037) MultiSource/Applications/spiff/spiff: 2.59% (0.7950 => 0.8156, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.21% (0.8611 => 0.8801, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.77% (0.8069 => 0.8212, std.dev.: 0.0020) MultiSource/Applications/d/make_dparser: 1.54% (3.2366 => 3.2865, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.46% (1.1606 => 1.1776, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 1.33% (14.2605 => 14.4503, std.dev.: 0.0639) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.25% (0.9435 => 0.9553, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.21% (4.1763 => 4.2268, std.dev.: 0.0112) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.57% (1.5795 => 2.5046, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.48% (1.1857 => 1.2863, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.38% (0.3186 => 0.3453, std.dev.: 0.0059) MultiSource/Benchmarks/mafft/pairlocalalign: 5.96% (63.1822 => 66.9493, std.dev.: 0.0213) SingleSource/Benchmarks/Misc/ReedSolomon: 3.40% (8.5322 => 8.8224, std.dev.: 0.0048) MultiSource/Applications/siod/siod: 2.72% (3.6643 => 3.7639, std.dev.: 0.0252) MultiSource/Benchmarks/Olden/bh/bh: 1.77% (2.3560 => 2.3977, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.40% (4.8362 => 4.9039, std.dev.: 0.0097) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.38% (1.5941 => 1.6161, std.dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.56% (0.3269 => 0.3022, std.dev.: 0.0077) MultiSource/Applications/lua/lua: -5.15% (29.8330 => 28.2960, std.dev.: 0.1943) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.40% (7.2130 => 6.9677, std.dev.: 0.0655) SingleSource/Benchmarks/Shootout-C++/hash2: -1.60% (3.4237 => 3.3688, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.22% (3.3479 => 3.3072, std.dev.: 0.0155) SingleSource/Benchmarks/Misc/ffbench: -1.09% (1.4296 => 1.4140, std.dev.: 0.0030) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.22% (16.4461 => 16.4101, std.dev.: 0.2047) MultiSource/Applications/obsequi/Obsequi: 1.47% (1.0262 => 1.0413, std.dev.: 0.0049) MultiSource/Applications/sqlite3/sqlite3: 0.74% (0.6332 => 0.6379, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/08-main/main: -3.71% (0.1831 => 0.1763, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.95% (0.1559 => 0.1683, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.50% (0.3123 => 0.3201, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.69% (0.2463 => 0.2446, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.45% (0.3344 => 0.3262, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.30% (0.2364 => 0.2357, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/bigfib: -0.93% (0.6010 => 0.5954, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/mandel: -1.86% (0.0429 => 0.0421, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.31% (0.3266 => 0.3276, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/strcat: -1.27% (0.1969 => 0.1944, std.dev.: 0.0053) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -7.59% (0.0224 => 0.0207, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 69.92% (0.0123 => 0.0209, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.21% (0.0408 => 0.0417, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 5.91% (0.0254 => 0.0269, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.32% (0.0302 => 0.0306, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.30% (0.0384 => 0.0379, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/casts: 3.16% (0.0190 => 0.0196, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -25.00% (0.0180 => 0.0135, std.dev.: 0.0037) SingleSource/UnitTests/byval-alignment: 46.52% (0.0230 => 0.0337, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.85% (0.1438 => 0.1479, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.31% (1.1329 => 1.1364, std.dev.: 0.0189) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.90% (0.1462 => 0.1519, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.45% (0.4164 => 0.4062, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.75% (0.1369 => 0.1345, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.21% (0.0641 => 0.0668, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.03% (0.0195 => 0.0275, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.69% (0.0578 => 0.0574, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.07% (1.1437 => 1.1445, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.64% (0.0627 => 0.0631, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 31.11% (0.0180 => 0.0236, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.31% (0.8017 => 0.7992, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 400.00% (0.0001 => 0.0005, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 9.68% (0.0062 => 0.0068, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 20 07:02:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 20 Oct 2012 09:02:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121020140238.5CCCB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5041?compare_to=5039&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5041, Order: 166375, Start Time: 2012-10-20 12:44:24, End Time: 2012-10-20 14:04:38 To: 5039, Order: 166374, Start Time: 2012-10-20 10:29:01, End Time: 2012-10-20 11:49:01 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (83 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 3 (187 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 98 (15 on baseline) Unchanged Tests: 941 (648 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.46% (15.5905 => 15.9741, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.11% (8.3095 => 8.4015, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.25% (79.5362 => 81.3234, std.dev.: 0.0667) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.08% (0.4849 => 0.4845, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 0.18% (17.1713 => 17.2027, std.dev.: 0.0121) MultiSource/Benchmarks/Bullet/bullet: 0.05% (56.0578 => 56.0884, std.dev.: 0.0166) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -0.04% (0.2514 => 0.2513, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 0.11% (4.5710 => 4.5762, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.23% (15.1984 => 15.2332, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 0.86% (3.5318 => 3.5622, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0479 => 0.0479) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0480 => 0.0480, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0449 => 0.0449, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0450 => 0.0450, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0438 => 0.0438) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0440 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0432 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.23% (0.0434 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0450 => 0.0450, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0451 => 0.0451, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.22% (0.0445 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.22% (0.0445 => 0.0446, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0434 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0436 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.23% (0.0442 => 0.0441, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0443 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0453 => 0.0453) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.22% (0.0454 => 0.0455, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0430 => 0.0430, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0431 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.23% (0.0442 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0443 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0433 => 0.0433) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0434 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.24% (0.0425 => 0.0426) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.23% (0.0427 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0423 => 0.0423, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.24% (0.0425 => 0.0426, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0460 => 0.0460, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0461 => 0.0461, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0423 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.24% (0.0424 => 0.0425) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0424 => 0.0424) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.24% (0.0424 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.23% (0.0432 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0433 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 0.05% (1.1098 => 1.1103, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.88% (3.5313 => 3.5622, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.37% (1.2980 => 1.3028, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.19% (8.1800 => 8.1957, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.06% (0.7763 => 0.7758, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.57% (0.0353 => 0.0351, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1431 => 0.1432) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/Bullet/bullet: -11.31% (63.2438 => 56.0884, std.dev.: 0.0166) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.66% (0.2271 => 0.2513, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.03% (14.3668 => 15.2332, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -33.45% (5.3526 => 3.5622, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -0.81% (1.1194 => 1.1103, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.86% (5.3855 => 3.5622, std.dev.: 0.0040) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -99.94% (0.1639 => 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -99.97% (0.3987 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -100.00% (2.6778 => 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -99.80% (0.0506 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 36.02% (14.1553 => 19.2537, std.dev.: 0.0130) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.80% (3.4629 => 5.7760, std.dev.: 0.0010) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13491.11% (0.0720 => 9.7856, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050100.00% (0.0001 => 10.0502, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.82% (0.2554 => 0.4184, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/lowercase: 55.47% (0.0256 => 0.0398, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 54.08% (10.3673 => 15.9741, std.dev.: 0.0152) SingleSource/UnitTests/SignlessTypes/factor: 44.59% (0.0296 => 0.0428, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 40.68% (1.5859 => 2.2310, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 38.22% (0.1622 => 0.2242, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 36.65% (0.1056 => 0.1443, std.dev.: 0.0001) SingleSource/UnitTests/vla: 31.83% (0.0355 => 0.0468, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 29.61% (2.2024 => 2.8545, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/neural/neural: 25.77% (0.1463 => 0.1840, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 25.42% (0.0834 => 0.1046, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.43% (0.1566 => 0.1886, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: 20.35% (0.2049 => 0.2466, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 20.18% (0.1432 => 0.1721, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.10% (7.0540 => 8.4015, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.91% (0.0871 => 0.1027, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.79% (2.2022 => 2.5939, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 17.68% (0.1555 => 0.1830, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.49% (0.5105 => 0.5998, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.06% (0.6675 => 0.7814, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 16.37% (0.1655 => 0.1926, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.28% (1.3050 => 1.5174, std.dev.: 0.0028) MultiSource/Applications/d/make_dparser: 16.18% (3.3354 => 3.8752, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: 15.97% (0.1440 => 0.1670, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 15.91% (0.0798 => 0.0925, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 15.58% (0.1695 => 0.1959, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 15.57% (0.1175 => 0.1358, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.21% (0.1032 => 0.1189, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 15.21% (0.0730 => 0.0841, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.15% (1.5415 => 1.7750, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 15.13% (0.1163 => 0.1339, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 15.13% (0.0793 => 0.0913, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.06% (0.5020 => 0.5776, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.03% (0.1337 => 0.1538, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 14.97% (0.8172 => 0.9395, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.92% (0.0838 => 0.0963, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.90% (0.1510 => 0.1735, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 14.80% (0.7115 => 0.8168, std.dev.: 0.0047) MultiSource/Applications/sgefa/sgefa: 14.80% (0.3109 => 0.3569, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.79% (0.0886 => 0.1017, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.48% (0.0746 => 0.0854, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 14.47% (0.3282 => 0.3757, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/matrix: 14.43% (0.0818 => 0.0936, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.37% (0.0842 => 0.0963, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.33% (0.2065 => 0.2361, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.28% (0.1940 => 0.2217, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.28% (1.7609 => 2.0123, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.23% (0.9765 => 1.1155, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.21% (4.2646 => 4.8707, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/18-imp/imp: 14.20% (0.3423 => 0.3909, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 13.95% (0.1584 => 0.1805, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.94% (0.3121 => 0.3556, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.91% (0.1438 => 0.1638, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/exptree: 13.88% (0.0814 => 0.0927, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 13.86% (1.1642 => 1.3256, std.dev.: 0.0082) MultiSource/Benchmarks/mafft/pairlocalalign: 13.84% (9.4845 => 10.7972, std.dev.: 0.0018) MultiSource/Applications/aha/aha: 13.73% (0.1151 => 0.1309, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.67% (0.1236 => 0.1405, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.64% (8.1363 => 9.2463, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 13.58% (0.6450 => 0.7326, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.57% (0.2107 => 0.2393, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.52% (0.1117 => 0.1268, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 13.51% (5.7591 => 6.5374, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.38% (0.2758 => 0.3127, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.38% (0.5860 => 0.6644, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.38% (0.1906 => 0.2161, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.38% (0.0770 => 0.0873, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.32% (1.4186 => 1.6075, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.29% (0.0933 => 0.1057, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 13.24% (0.7835 => 0.8872, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.17% (0.4615 => 0.5223, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.92% (0.1695 => 0.1914, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 12.89% (10.4361 => 11.7812, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.89% (0.2700 => 0.3048, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 12.87% (2.0273 => 2.2882, std.dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: 12.83% (0.7433 => 0.8387, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.83% (0.1029 => 0.1161, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 12.80% (1.1840 => 1.3355, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.76% (0.5981 => 0.6744, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.73% (0.4879 => 0.5500, std.dev.: 0.0007) SingleSource/UnitTests/SignlessTypes/rem: 12.67% (0.1144 => 0.1289, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.67% (5.0018 => 5.6353, std.dev.: 0.0098) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.62% (0.1062 => 0.1196, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.59% (0.0929 => 0.1046, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.59% (4.9449 => 5.5674, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 12.53% (1.0722 => 1.2066, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 12.52% (0.3387 => 0.3811, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.37% (0.1625 => 0.1826, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 12.31% (3.8723 => 4.3488, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/05-eks/eks: 12.31% (0.4299 => 0.4828, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.28% (0.8067 => 0.9058, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: 12.15% (0.1268 => 0.1422, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.07% (0.3307 => 0.3706, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 12.06% (0.3177 => 0.3560, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.02% (0.2603 => 0.2916, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.98% (1.1861 => 1.3282, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.96% (7.9617 => 8.9136, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.88% (0.1330 => 0.1488, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.82% (0.5569 => 0.6227, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 11.73% (0.8921 => 0.9967, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.64% (0.1143 => 0.1276, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 11.59% (0.1044 => 0.1165, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 11.45% (0.3180 => 0.3544, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 11.42% (1.5603 => 1.7385, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.30% (0.3441 => 0.3830, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.20% (0.1125 => 0.1251, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 11.13% (0.3092 => 0.3436, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 11.00% (0.6456 => 0.7166, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.68% (0.2266 => 0.2508, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.62% (0.1892 => 0.2093, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.59% (0.3927 => 0.4343, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.58% (0.3543 => 0.3918, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.58% (0.3828 => 0.4233, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.57% (0.3473 => 0.3840, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.55% (0.3516 => 0.3887, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.53% (0.3561 => 0.3936, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.53% (0.3543 => 0.3916, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.47% (0.8101 => 0.8949, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 10.44% (0.3497 => 0.3862, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 10.42% (0.3694 => 0.4079, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 10.40% (2.2969 => 2.5358, std.dev.: 0.0136) SingleSource/UnitTests/ObjC/property: 10.29% (0.3886 => 0.4286, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.25% (0.3826 => 0.4218, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 9.79% (0.4289 => 0.4709, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 9.78% (0.4620 => 0.5072, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 9.72% (21.9371 => 24.0685, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/lists: 9.53% (0.3422 => 0.3748, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.47% (0.4636 => 0.5075, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.31% (0.3865 => 0.4225, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.18% (0.4203 => 0.4589, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.04% (0.4103 => 0.4474, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 8.87% (0.4048 => 0.4407, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.78% (0.3427 => 0.3728, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.77% (0.6030 => 0.6559, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 8.71% (0.3684 => 0.4005, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.71% (0.5925 => 0.6441, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.23% (0.2430 => 0.2630, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.05% (0.7326 => 0.7916, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 8.05% (0.3603 => 0.3893, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 8.04% (17.1811 => 18.5624, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.00% (0.3136 => 0.3387, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.75% (0.3650 => 0.3933, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.74% (3.8922 => 4.1934, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary: 7.58% (0.3232 => 0.3477, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.58% (0.4064 => 0.4372, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.56% (0.2831 => 0.3045, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 7.49% (0.3098 => 0.3330, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 7.37% (0.3283 => 0.3525, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.37% (0.2891 => 0.3104, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.37% (0.2905 => 0.3119, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.12% (2.0665 => 2.2136, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.12% (0.3162 => 0.3387, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.07% (0.2872 => 0.3075, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.02% (0.2793 => 0.2989, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.00% (0.2756 => 0.2949, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.97% (0.2725 => 0.2915, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.95% (0.3052 => 0.3264, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.86% (0.2871 => 0.3068, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.85% (0.2877 => 0.3074, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.81% (0.3379 => 0.3609, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.71% (0.2802 => 0.2990, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.71% (0.2714 => 0.2896, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 6.21% (1.2842 => 1.3640, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 5.69% (0.3131 => 0.3309, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.04% (0.3817 => 0.3933, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.85% (0.3935 => 0.4047, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2173, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 9.91% (1.1396 => 1.2525, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 9.66% (0.9957 => 1.0919, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3685, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/bh/bh: 5.91% (1.9405 => 2.0552, std.dev.: 0.0006) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.83% (4.2280 => 4.3477, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.20% (1.0313 => 1.0540, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.81% (3.6395 => 3.7054, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/bisort/bisort: 1.79% (0.8333 => 0.8482, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2076, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.47% (2.6546 => 2.6935, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.22% (6.5088 => 6.5884, std.dev.: 0.0020) MultiSource/Applications/viterbi/viterbi: 1.18% (4.4649 => 4.5177, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/heapsort: 1.12% (3.8532 => 3.8965, std.dev.: 0.0095) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.01% (6.6874 => 0.1331, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -79.89% (0.8651 => 0.1740, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.77% (5.2763 => 3.2305, std.dev.: 0.0049) SingleSource/UnitTests/Vector/constpool: -14.63% (54.1659 => 46.2417, std.dev.: 0.0346) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.48% (2.9384 => 2.6306, std.dev.: 0.0196) MultiSource/Applications/ClamAV/clamscan: -6.57% (22.1758 => 20.7199, std.dev.: 0.0177) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.09% (8.0499 => 3.7761, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.44% (1.1492 => 0.7649, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4750, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.72% (1.6925 => 1.4265, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.69% (1.2258 => 1.0703, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3453 => 2.9599, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.48% (1.2373 => 1.0952, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -10.79% (1.5373 => 1.3714, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.39% (19.9488 => 18.2755, std.dev.: 0.0087) MultiSource/Benchmarks/FreeBench/mason/mason: -7.68% (0.2161 => 0.1995) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.04% (1.8329 => 1.7038, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0109) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.21% (1.6805 => 1.5930, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: -5.03% (1.5835 => 1.5038, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.41% (8.1563 => 7.7969, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -3.67% (3.2827 => 3.1623, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8776, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5029, std.dev.: 0.0040) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.60% (0.4808 => 0.4683, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.89% (10.2830 => 10.0882, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/flops: -1.69% (8.8334 => 8.6837, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.67% (2.5528 => 2.5101, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4214, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -1.31% (4.6441 => 4.5832, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.12% (2.3135 => 2.2877, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -7.34% (0.5229 => 0.4845, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 14.77% (14.9895 => 17.2027, std.dev.: 0.0121) MultiSource/Benchmarks/MallocBench/gs/gs: 11.33% (4.1105 => 4.5762, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.92% (1.1048 => 1.3028, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.49% (7.1582 => 8.1957, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.69% (0.6222 => 0.7758, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35000.00% (0.0001 => 0.0351, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -99.95% (0.2116 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 20 07:09:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 20 Oct 2012 09:09:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121020140937.A22F62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5042?compare_to=5038&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5042, Order: 166375, Start Time: 2012-10-20 12:46:14, End Time: 2012-10-20 14:12:37 To: 5038, Order: 166374, Start Time: 2012-10-20 10:20:13, End Time: 2012-10-20 11:47:29 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (202 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1040 (663 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.23% (55.1041 => 56.3338, std.dev.: 0.1298) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.36% (3.8486 => 3.7576, std.dev.: 0.0297) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.84% (2.0176 => 2.4986, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.13% (0.1410 => 0.1708, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 18.52% (0.0826 => 0.0979, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 18.06% (0.2243 => 0.2648, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 17.37% (0.1013 => 0.1189, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.02% (0.0746 => 0.0873, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.00% (0.0653 => 0.0764, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.96% (0.7710 => 0.9018, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 15.84% (0.0770 => 0.0892, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.37% (0.2596 => 0.2995, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.02% (0.0819 => 0.0942, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 14.74% (0.2721 => 0.3122, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.70% (0.1986 => 0.2278, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.63% (0.0834 => 0.0956, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.51% (0.1413 => 0.1618, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 14.49% (1.3693 => 1.5677, std.dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.46% (0.1072 => 0.1227, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.30% (0.0811 => 0.0927, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.29% (0.0847 => 0.0968, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 14.26% (0.1003 => 0.1146, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.09% (0.1327 => 0.1514, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.07% (0.0725 => 0.0827, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.97% (0.9199 => 1.0484, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.89% (0.0720 => 0.0820, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.71% (3.9660 => 4.5097, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.69% (0.0964 => 0.1096, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.66% (0.5637 => 0.6407, std.dev.: 0.0017) MultiSource/Applications/aha/aha: 13.65% (0.1062 => 0.1207, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.64% (0.6959 => 0.7908, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.51% (0.0977 => 0.1109, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/mst/mst: 13.50% (0.1111 => 0.1261, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.45% (0.5265 => 0.5973, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 13.44% (0.7038 => 0.7984, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.40% (0.1075 => 0.1219, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.35% (0.1588 => 0.1800, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.35% (0.2914 => 0.3303, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 13.28% (0.7460 => 0.8451, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.01% (0.1276 => 0.1442, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 13.01% (0.4328 => 0.4891, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/hash: 12.75% (0.4062 => 0.4580, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 12.66% (1.1061 => 1.2461, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.62% (1.4563 => 1.6401, std.dev.: 0.0096) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.52% (0.1014 => 0.1141, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/distray/distray: 12.47% (0.0818 => 0.0920, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 12.45% (0.1478 => 0.1662, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.41% (0.5577 => 0.6269, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.31% (0.2023 => 0.2272, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 12.31% (13.8202 => 15.5211, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.30% (1.2193 => 1.3693, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.28% (1.1364 => 1.2760, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.21% (0.6283 => 0.7050, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.10% (0.1157 => 0.1297, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.01% (0.1865 => 0.2089, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.92% (0.3246 => 0.3633, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.83% (0.4379 => 0.4897, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 11.79% (3.8646 => 4.3204, std.dev.: 0.0108) SingleSource/UnitTests/ObjC++/property-reference: 11.77% (0.7061 => 0.7892, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 11.72% (0.7506 => 0.8386, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference-object: 11.72% (0.5818 => 0.6500, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 11.71% (0.1657 => 0.1851, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.71% (0.2127 => 0.2376, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.57% (0.3899 => 0.4350, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.57% (0.3130 => 0.3492, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 11.42% (0.2995 => 0.3337, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.40% (0.4791 => 0.5337, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 11.40% (0.5748 => 0.6403, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 11.32% (0.2925 => 0.3256, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 11.23% (1.0313 => 1.1471, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.16% (0.3485 => 0.3874, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 11.08% (1.9270 => 2.1405, std.dev.: 0.0094) MultiSource/Benchmarks/McCat/18-imp/imp: 11.06% (0.3220 => 0.3576, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.06% (0.4016 => 0.4460, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 11.05% (0.3293 => 0.3657, std.dev.: 0.0018) SingleSource/Regression/C++/ofstream_ctor: 11.00% (0.2781 => 0.3087, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.98% (0.3489 => 0.3872, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.97% (0.1048 => 0.1163, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.96% (0.1789 => 0.1985, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.89% (0.3756 => 0.4165, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.89% (0.4390 => 0.4868, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 10.82% (0.1589 => 0.1761, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.82% (0.2966 => 0.3287, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 10.81% (0.6744 => 0.7473, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.75% (0.3022 => 0.3347, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.75% (0.2782 => 0.3081, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.74% (7.2180 => 7.9934, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/health/health: 10.72% (0.1213 => 0.1343, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 10.71% (0.2726 => 0.3018, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 10.65% (0.3868 => 0.4280, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.64% (0.1569 => 0.1736, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 10.63% (0.3453 => 0.3820, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 10.61% (16.6129 => 18.3747, std.dev.: 0.0084) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.59% (0.1435 => 0.1587, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.56% (0.3580 => 0.3958, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 10.51% (3.1889 => 3.5242, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.45% (0.8698 => 0.9607, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 10.42% (0.3149 => 0.3477, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 10.39% (0.2761 => 0.3048, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.38% (1.9828 => 2.1887, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/except: 10.36% (0.2760 => 0.3046, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 10.35% (2.1791 => 2.4047, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hello: 10.32% (0.2607 => 0.2876, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 10.30% (0.3107 => 0.3427, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 10.29% (0.8310 => 0.9165, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.28% (1.3245 => 1.4607, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.28% (0.2655 => 0.2928, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 10.26% (0.2690 => 0.2966, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 10.19% (0.3534 => 0.3894, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 10.18% (0.2937 => 0.3236, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 10.14% (3.6692 => 4.0411, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/fibo: 10.12% (0.2628 => 0.2894, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 10.12% (0.3192 => 0.3515, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.09% (0.2765 => 0.3044, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.00% (0.2140 => 0.2354, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 9.87% (0.2988 => 0.3283, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.85% (0.6576 => 0.7224, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.79% (0.2696 => 0.2960, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.71% (4.3801 => 4.8055, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.68% (4.4433 => 4.8736, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.56% (0.2321 => 0.2543) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.46% (4.9865 => 5.4584, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 9.46% (0.4113 => 0.4502, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.43% (0.3755 => 0.4109, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 9.34% (0.2945 => 0.3220, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.31% (0.6135 => 0.6706, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.24% (0.1819 => 0.1987, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 9.04% (14.8535 => 16.1956, std.dev.: 0.0155) MultiSource/Benchmarks/sim/sim: 8.94% (0.3131 => 0.3411, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 8.89% (1.0594 => 1.1536, std.dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: 8.85% (1.2749 => 1.3877, std.dev.: 0.0083) MultiSource/Applications/oggenc/oggenc: 8.75% (4.6629 => 5.0710, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.72% (0.3511 => 0.3817, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.69% (0.8818 => 0.9584, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 8.62% (8.4961 => 9.2281, std.dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.49% (1.5188 => 1.6477, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.45% (1.1333 => 1.2291, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 8.38% (0.6250 => 0.6774, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 8.35% (3.7467 => 4.0597, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.32% (0.3245 => 0.3515, std.dev.: 0.0102) MultiSource/Benchmarks/FreeBench/neural/neural: 8.23% (0.1385 => 0.1499, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.21% (0.9108 => 0.9856, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.19% (3.2742 => 3.5424, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.05% (0.4805 => 0.5192, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 7.94% (6.5754 => 7.0973, std.dev.: 0.0207) MultiSource/Applications/hexxagon/hexxagon: 7.75% (1.2292 => 1.3245, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.71% (0.2504 => 0.2697, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.69% (2.1007 => 2.2622, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.59% (0.3650 => 0.3927, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/parameter-passing: 7.57% (0.4003 => 0.4306, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 7.52% (0.2008 => 0.2159, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.51% (6.2785 => 6.7502, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.40% (0.2243 => 0.2409, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.38% (0.3914 => 0.4203, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 7.18% (0.3578 => 0.3835, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.18% (0.3940 => 0.4223, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 7.18% (0.3789 => 0.4061, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.17% (13.2842 => 14.2366, std.dev.: 0.0199) SingleSource/UnitTests/ObjC/exceptions-4: 7.13% (0.3646 => 0.3906, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/ReedSolomon: 7.09% (0.1777 => 0.1903, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.03% (0.3601 => 0.3854, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 6.99% (0.3663 => 0.3919, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 6.87% (0.3623 => 0.3872, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 5.27% (16.2614 => 17.1187, std.dev.: 0.0135) MultiSource/Applications/ClamAV/clamscan: 4.98% (14.5298 => 15.2539, std.dev.: 0.0142) MultiSource/Benchmarks/Olden/bh/bh: 4.20% (0.2859 => 0.2979, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 2.38% (33.2944 => 34.0862, std.dev.: 0.0392) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5193, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fbench: 24.03% (1.8175 => 2.2542, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.10% (1.0895 => 1.2758, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 11.02% (1.1560 => 1.2834, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1918, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.02% (0.8273 => 0.9019, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4137, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.43% (0.9692 => 1.0218) SingleSource/Benchmarks/Misc/mandel-2: 5.41% (1.2998 => 1.3701, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0044, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.49% (0.3139 => 0.3280, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.46% (2.8606 => 2.9883, std.dev.: 0.0014) SingleSource/Regression/C/uint64_to_float: 4.44% (0.5449 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9854, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.38% (12.0921 => 12.5009, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 3.38% (10.7476 => 11.1105, std.dev.: 0.0115) MultiSource/Benchmarks/nbench/nbench: 3.22% (11.2619 => 11.6245, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/bisort/bisort: 3.12% (0.8239 => 0.8496, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0310 => 1.0559, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 2.23% (7.4271 => 7.5925, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 1.73% (1.4298 => 1.4546, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.47% (2.0200 => 2.0497, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5132, std.dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (1.9433 => 1.9690, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2123, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1882, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.18% (9.9194 => 10.0364, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/oourafft: 1.17% (5.5130 => 5.5776, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5878, std.dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.48% (0.2670 => 0.1429) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.95% (0.4657 => 0.3914, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.68% (1.3813 => 1.2200, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.64% (1.3819 => 1.2211, std.dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.29% (1.0460 => 0.8547, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -12.60% (0.2238 => 0.1956, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.25% (20.3410 => 18.2557, std.dev.: 0.0280) SingleSource/Benchmarks/McGill/chomp: -6.56% (1.2308 => 1.1501, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.16% (1.3780 => 1.2931, std.dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.68% (0.9996 => 0.9528, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.79% (1.7688 => 1.7018, std.dev.: 0.0062) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -2.90% (3.2729 => 3.1781, std.dev.: 0.0025) MultiSource/Applications/spiff/spiff: -2.79% (3.0263 => 2.9419, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -2.78% (1.9762 => 1.9213, std.dev.: 0.0037) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8811, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4785, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.41% (4.1080 => 4.0090, std.dev.: 0.0017) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.02% (0.6589 => 0.6456, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.87% (0.6615 => 0.6491, std.dev.: 0.0012) MultiSource/Applications/lua/lua: -1.74% (26.5159 => 26.0538, std.dev.: 0.0263) SingleSource/Benchmarks/Shootout/lists: -1.69% (6.3560 => 6.2485, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.67% (2.5254 => 2.4832, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.67% (0.8342 => 0.8203, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0060, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8632, std.dev.: 0.0059) MultiSource/Benchmarks/mafft/pairlocalalign: -1.24% (28.2225 => 27.8721, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.3167 => 5.2536, std.dev.: 0.0003) MultiSource/Applications/aha/aha: -1.08% (3.1476 => 3.1137, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -1.05% (84.4286 => 83.5388, std.dev.: 0.0066) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 20 08:34:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 20 Oct 2012 10:34:32 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121020153432.E47F82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5043?compare_to=5040&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5043, Order: 166378, Start Time: 2012-10-20 14:12:54, End Time: 2012-10-20 15:36:34 To: 5040, Order: 166375, Start Time: 2012-10-20 12:32:12, End Time: 2012-10-20 13:56:06 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 9 (34 on baseline) Performance Improvements: 3 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 963 (936 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 7.16% (0.1508 => 0.1616, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.63% (0.3117 => 0.3230, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/09-vor/vor: 3.58% (0.3188 => 0.3302, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.90% (0.4937 => 0.5080, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.25% (0.8217 => 0.8320, std.dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 19.54% (20.1369 => 24.0713, std.dev.: 0.7956) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.73% (1.4007 => 1.4249, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 1.34% (3.2017 => 3.2446, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.11% (1.2435 => 1.2573, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.93% (0.8801 => 0.8631, std.dev.: 0.0063) MultiSource/Applications/d/make_dparser: -1.01% (3.2865 => 3.2532, std.dev.: 0.0103) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -2.98% (22.4782 => 21.8076, std.dev.: 0.2411) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.40% (16.4101 => 16.4753, std.dev.: 0.2091) MultiSource/Applications/obsequi/Obsequi: 1.38% (1.0413 => 1.0557, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: 0.13% (0.6379 => 0.6387, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/08-main/main: 9.42% (0.1763 => 0.1929, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.84% (0.1683 => 0.1652, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.03% (0.3201 => 0.3200, std.dev.: 0.0130) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (0.2446 => 0.2477, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.56% (0.3262 => 0.3378, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.42% (0.2357 => 0.2347, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/bigfib: 0.05% (0.5954 => 0.5957, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/mandel: 6.89% (0.0421 => 0.0450, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.86% (0.3276 => 0.3337, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/strcat: 2.21% (0.1944 => 0.1987, std.dev.: 0.0015) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 18.84% (0.0207 => 0.0246, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -37.32% (0.0209 => 0.0131, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -9.11% (0.0417 => 0.0379, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -11.90% (0.0269 => 0.0237, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -5.88% (0.0306 => 0.0288, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 3.17% (0.0379 => 0.0391, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/casts: 1.02% (0.0196 => 0.0198, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 25.19% (0.0135 => 0.0169, std.dev.: 0.0018) SingleSource/UnitTests/byval-alignment: -1.48% (0.0337 => 0.0332, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -38.46% (0.0013 => 0.0008, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: - (0.1479 => 0.1479, std.dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.99% (1.1364 => 1.1252, std.dev.: 0.0209) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -4.87% (0.1519 => 0.1445, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.50% (0.4062 => 0.4123, std.dev.: 0.0239) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.58% (0.1345 => 0.1447, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.29% (0.0668 => 0.0646, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.73% (0.0275 => 0.0277, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.87% (0.0574 => 0.0579, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.43% (1.1445 => 1.1494, std.dev.: 0.0481) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.15% (0.0026 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.04% (0.0631 => 0.0555, std.dev.: 0.0090) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 13.14% (0.0236 => 0.0267, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.30% (0.7992 => 0.8016, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -80.00% (0.0005 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 63.24% (0.0068 => 0.0111, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.25% (2.1832 => 1.6538, std.dev.: 0.0063) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.95% (0.0810 => 0.0923, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/tsp/tsp: 10.52% (0.1112 => 0.1229, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.26% (0.1425 => 0.1557, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.60% (0.2180 => 0.2302, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.09% (0.6010 => 0.6316, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.81% (0.4847 => 0.5080, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.56% (0.7473 => 0.7814, std.dev.: 0.0052) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.53% (0.3137 => 0.3279, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.06% (0.8321 => 0.8659, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.39% (0.3124 => 0.3230, std.dev.: 0.0017) MultiSource/Applications/spiff/spiff: 3.03% (0.7950 => 0.8191, std.dev.: 0.0068) MultiSource/Applications/Burg/burg: 2.86% (1.2222 => 1.2571, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.68% (0.9435 => 0.9688, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.66% (1.1606 => 1.1915, std.dev.: 0.0055) MultiSource/Applications/hbd/hbd: 2.03% (1.4269 => 1.4559, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.01% (1.1685 => 1.1920, std.dev.: 0.0037) MultiSource/Applications/lua/lua: 1.62% (3.8189 => 3.8807, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.41% (0.8204 => 0.8320, std.dev.: 0.0032) MultiSource/Benchmarks/PAQ8p/paq8p: 1.38% (2.3764 => 2.4091, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.28% (4.1763 => 4.2297, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.23% (1.6386 => 1.6588, std.dev.: 0.0055) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.22% (6.6074 => 6.6879, std.dev.: 0.0150) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.16% (4.4873 => 4.5393, std.dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.04% (1.5795 => 2.4963, std.dev.: 0.0094) MultiSource/Benchmarks/nbench/nbench: 9.59% (21.9654 => 24.0713, std.dev.: 0.7956) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.59% (1.1857 => 1.2876, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.29% (0.3186 => 0.3450, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 5.96% (63.1822 => 66.9482, std.dev.: 0.0350) SingleSource/Benchmarks/Misc/ReedSolomon: 3.39% (8.5322 => 8.8218, std.dev.: 0.0055) MultiSource/Applications/siod/siod: 2.79% (3.6643 => 3.7665, std.dev.: 0.0240) SingleSource/Benchmarks/Shootout-C++/hash: 1.82% (0.6205 => 0.6318, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/bh/bh: 1.66% (2.3560 => 2.3951, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.60% (1.5941 => 1.6196, std.dev.: 0.0025) MultiSource/Applications/minisat/minisat: 1.48% (6.1525 => 6.2434, std.dev.: 0.0352) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.74% (0.3269 => 0.3016, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -5.14% (29.8330 => 28.3001, std.dev.: 0.2663) SingleSource/Benchmarks/Shootout-C++/hash2: -1.47% (3.4237 => 3.3734, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.22% (3.3479 => 3.3072, std.dev.: 0.0014) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.18% (16.4461 => 16.4753, std.dev.: 0.2091) MultiSource/Applications/obsequi/Obsequi: 2.87% (1.0262 => 1.0557, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: 0.87% (0.6332 => 0.6387, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/08-main/main: 5.35% (0.1831 => 0.1929, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.97% (0.1559 => 0.1652, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.47% (0.3123 => 0.3200, std.dev.: 0.0130) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.57% (0.2463 => 0.2477, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.02% (0.3344 => 0.3378, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.72% (0.2364 => 0.2347, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/bigfib: -0.88% (0.6010 => 0.5957, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/mandel: 4.90% (0.0429 => 0.0450, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.17% (0.3266 => 0.3337, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/strcat: 0.91% (0.1969 => 0.1987, std.dev.: 0.0015) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 9.82% (0.0224 => 0.0246, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 6.50% (0.0123 => 0.0131, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -7.11% (0.0408 => 0.0379, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -6.69% (0.0254 => 0.0237, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -4.64% (0.0302 => 0.0288, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.82% (0.0384 => 0.0391, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/casts: 4.21% (0.0190 => 0.0198, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: -6.11% (0.0180 => 0.0169, std.dev.: 0.0018) SingleSource/UnitTests/byval-alignment: 44.35% (0.0230 => 0.0332, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 14.29% (0.0007 => 0.0008, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.85% (0.1438 => 0.1479, std.dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.68% (1.1329 => 1.1252, std.dev.: 0.0209) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -1.16% (0.1462 => 0.1445, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.98% (0.4164 => 0.4123, std.dev.: 0.0239) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.70% (0.1369 => 0.1447, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.78% (0.0641 => 0.0646, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.17% (0.0578 => 0.0579, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.50% (1.1437 => 1.1494, std.dev.: 0.0481) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.48% (0.0627 => 0.0555, std.dev.: 0.0090) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.33% (0.0180 => 0.0267, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.01% (0.8017 => 0.8016, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 79.03% (0.0062 => 0.0111, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 20 08:51:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 20 Oct 2012 10:51:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121020155156.B8B8E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5044?compare_to=5041&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5044, Order: 166378, Start Time: 2012-10-20 14:34:08, End Time: 2012-10-20 15:53:57 To: 5041, Order: 166375, Start Time: 2012-10-20 12:44:24, End Time: 2012-10-20 14:04:38 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (83 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (184 on baseline) Performance Improvements: 1 (44 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 98 (15 on baseline) Unchanged Tests: 942 (650 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.01% (2.0553 => 2.0761, std.dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.62% (81.3234 => 79.1952, std.dev.: 0.5031) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.23% (0.4845 => 0.4856, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: -0.09% (17.2027 => 17.1880, std.dev.: 0.0201) MultiSource/Benchmarks/Bullet/bullet: -0.08% (56.0884 => 56.0445, std.dev.: 0.0166) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 0.24% (0.2513 => 0.2519, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 0.05% (4.5762 => 4.5787, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.06% (15.2332 => 15.2417, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 0.40% (3.5622 => 3.5765, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.21% (0.0479 => 0.0480, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.21% (0.0480 => 0.0481, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0449 => 0.0449, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0450 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.23% (0.0438 => 0.0439, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.23% (0.0440 => 0.0441, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.23% (0.0432 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.23% (0.0433 => 0.0434, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.22% (0.0450 => 0.0451) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.22% (0.0451 => 0.0452) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.23% (0.0444 => 0.0445, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.22% (0.0446 => 0.0447, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.23% (0.0434 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0436 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.45% (0.0441 => 0.0443) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.23% (0.0443 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.22% (0.0453 => 0.0454, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0455 => 0.0455, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.23% (0.0430 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.23% (0.0431 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.45% (0.0441 => 0.0443, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.23% (0.0443 => 0.0444, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.23% (0.0433 => 0.0434) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.23% (0.0434 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0426 => 0.0426, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.23% (0.0426 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.24% (0.0423 => 0.0424, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0426 => 0.0426, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.22% (0.0460 => 0.0461, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.22% (0.0461 => 0.0462, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.24% (0.0423 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0425 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.24% (0.0424 => 0.0425) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.24% (0.0425 => 0.0426, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.23% (0.0431 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.23% (0.0433 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -0.05% (1.1103 => 1.1098, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.30% (3.5622 => 3.5728, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.04% (1.3028 => 1.3023, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.17% (8.1957 => 8.1815, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.09% (0.7758 => 0.7751, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 1.42% (0.0351 => 0.0356, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/Bullet/bullet: -11.38% (63.2438 => 56.0445, std.dev.: 0.0166) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.92% (0.2271 => 0.2519, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.09% (14.3668 => 15.2417, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -33.18% (5.3526 => 3.5765, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -0.86% (1.1194 => 1.1098, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.66% (5.3855 => 3.5728, std.dev.: 0.0037) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -99.94% (0.1639 => 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -99.97% (0.3987 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -100.00% (2.6778 => 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -99.80% (0.0506 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 35.93% (14.1553 => 19.2416, std.dev.: 0.0124) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.63% (3.4629 => 5.7702, std.dev.: 0.0125) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13484.44% (0.0720 => 9.7808, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050300.00% (0.0001 => 10.0504, std.dev.: 0.0011) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.98% (0.2554 => 0.4188, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: 55.86% (0.0256 => 0.0399, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 52.65% (10.3673 => 15.8262, std.dev.: 0.0095) SingleSource/UnitTests/SignlessTypes/factor: 44.59% (0.0296 => 0.0428, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 40.63% (1.5859 => 2.2303, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 38.47% (0.1622 => 0.2246, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 36.46% (0.1056 => 0.1441, std.dev.: 0.0003) SingleSource/UnitTests/vla: 31.83% (0.0355 => 0.0468, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 29.66% (2.2024 => 2.8556, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/neural/neural: 25.91% (0.1463 => 0.1842, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 25.90% (0.0834 => 0.1050, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.82% (0.1566 => 0.1892, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: 20.55% (0.2049 => 0.2470, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 20.32% (0.1432 => 0.1723, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.25% (7.0540 => 8.4122, std.dev.: 0.0110) MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.41% (2.2022 => 2.6076, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.14% (0.0871 => 0.1029, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 18.14% (0.1555 => 0.1837, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.63% (0.5105 => 0.6005, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 16.97% (0.6675 => 0.7808, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 16.50% (0.1655 => 0.1928, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 16.28% (3.3354 => 3.8784, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.21% (1.3050 => 1.5166, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: 16.13% (0.0626 => 0.0727, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 15.90% (0.1440 => 0.1669, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 15.58% (0.1695 => 0.1959, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 15.40% (0.1175 => 0.1356, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 15.39% (0.1163 => 0.1342, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.21% (0.1032 => 0.1189, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.18% (0.1337 => 0.1540, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.18% (1.5415 => 1.7755, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.16% (0.0838 => 0.0965, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.14% (0.5020 => 0.5780, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 15.01% (0.0793 => 0.0912, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.97% (0.1510 => 0.1736, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 14.93% (0.8172 => 0.9392, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.79% (0.0886 => 0.1017, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 14.69% (0.7115 => 0.8160, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 14.63% (0.3282 => 0.3762, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 14.54% (0.3109 => 0.3561, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.37% (0.0842 => 0.0963, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.33% (0.1940 => 0.2218, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 14.31% (0.3423 => 0.3913, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.21% (4.2646 => 4.8707, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.21% (0.0746 => 0.0852, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 14.18% (0.0818 => 0.0934, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.15% (0.9765 => 1.1147, std.dev.: 0.0061) SingleSource/Benchmarks/McGill/exptree: 14.13% (0.0814 => 0.0929, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.08% (0.1584 => 0.1807, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.05% (1.7609 => 2.0083, std.dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 13.94% (9.4845 => 10.8071, std.dev.: 0.0081) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.94% (0.3121 => 0.3556, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.92% (0.1236 => 0.1408, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 13.91% (1.1642 => 1.3261, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.79% (0.1117 => 0.1271, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 13.67% (0.6450 => 0.7332, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 13.67% (5.7591 => 6.5465, std.dev.: 0.0136) MultiSource/Applications/aha/aha: 13.64% (0.1151 => 0.1308, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.60% (8.1363 => 9.2432, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.48% (0.5860 => 0.6650, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.43% (0.2107 => 0.2390, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.42% (0.1438 => 0.1631, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.38% (0.1906 => 0.2161, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.38% (0.0770 => 0.0873, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.37% (0.4615 => 0.5232, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.37% (1.4186 => 1.6082, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.34% (0.2758 => 0.3126, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 13.25% (0.7835 => 0.8873, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.18% (0.0933 => 0.1056, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.08% (0.2065 => 0.2335, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.02% (0.1029 => 0.1163, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.99% (0.1062 => 0.1200, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 12.96% (2.0273 => 2.2900, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 12.89% (0.7433 => 0.8391, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.86% (0.1695 => 0.1913, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 12.86% (10.4361 => 11.7777, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.85% (0.2700 => 0.3047, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.79% (0.4879 => 0.5503, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.78% (0.0798 => 0.0900, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 12.77% (1.1840 => 1.3352, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.70% (0.0929 => 0.1047, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.68% (0.8067 => 0.9090, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.62% (4.9449 => 5.5688, std.dev.: 0.0023) MultiSource/Applications/lemon/lemon: 12.61% (1.0722 => 1.2074, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.57% (0.5981 => 0.6733, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.56% (5.0018 => 5.6299, std.dev.: 0.0029) MultiSource/Applications/lua/lua: 12.51% (3.8723 => 4.3566, std.dev.: 0.0076) SingleSource/UnitTests/SignlessTypes/rem: 12.50% (0.1144 => 0.1287, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 12.49% (0.3387 => 0.3810, std.dev.: 0.0071) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 12.43% (0.3177 => 0.3572, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/health/health: 12.38% (0.1268 => 0.1425, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 12.37% (0.4299 => 0.4831, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.31% (0.1625 => 0.1825, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.05% (1.1861 => 1.3290, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.03% (0.1330 => 0.1490, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.00% (7.9617 => 8.9168, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.97% (0.3307 => 0.3703, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.95% (0.2603 => 0.2914, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.89% (0.5569 => 0.6231, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 11.69% (0.8921 => 0.9964, std.dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.55% (0.1143 => 0.1275, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 11.46% (0.3473 => 0.3871, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 11.45% (1.5603 => 1.7389, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/09-vor/vor: 11.42% (0.3180 => 0.3543, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 11.35% (0.3543 => 0.3945, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.29% (0.1125 => 0.1252, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.28% (0.3441 => 0.3829, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.26% (0.3561 => 0.3962, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.18% (0.3543 => 0.3939, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.15% (0.3694 => 0.4106, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.13% (0.3927 => 0.4364, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: 11.12% (0.3497 => 0.3886, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 11.09% (0.3092 => 0.3435, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.09% (0.3516 => 0.3906, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.00% (0.3828 => 0.4249, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 10.92% (0.6456 => 0.7161, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.81% (0.3886 => 0.4306, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.77% (0.2266 => 0.2510, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.59% (0.8101 => 0.8959, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.57% (0.1892 => 0.2092, std.dev.: 0.0015) MultiSource/Applications/siod/siod: 10.41% (2.2969 => 2.5359, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 9.98% (0.4289 => 0.4717, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 9.85% (0.4620 => 0.5075, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 9.77% (21.9371 => 24.0813, std.dev.: 0.0243) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.64% (0.3826 => 0.4195, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/lists: 9.47% (0.3422 => 0.3746, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.34% (0.3865 => 0.4226, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.34% (0.4636 => 0.5069, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.16% (0.4203 => 0.4588, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 8.94% (0.4048 => 0.4410, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.92% (0.4103 => 0.4469, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.87% (0.3427 => 0.3731, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.77% (0.6030 => 0.6559, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 8.77% (0.3684 => 0.4007, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.68% (0.5925 => 0.6439, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 8.15% (17.1811 => 18.5813, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/sieve: 8.10% (0.3603 => 0.3895, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.02% (0.2430 => 0.2625, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.97% (0.7326 => 0.7910, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.95% (0.3650 => 0.3940, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.77% (3.8922 => 4.1948, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.68% (0.4064 => 0.4376, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 7.65% (0.3098 => 0.3335, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/strcat: 7.56% (0.2831 => 0.3045, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.51% (0.2891 => 0.3108, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.43% (0.3283 => 0.3527, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 7.43% (0.3232 => 0.3472, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.33% (0.3136 => 0.3366, std.dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 7.33% (0.2905 => 0.3118, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.09% (2.0665 => 2.2130, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.08% (0.3162 => 0.3386, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.07% (0.2872 => 0.3075, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 7.04% (0.2871 => 0.3073, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.02% (0.2793 => 0.2989, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.00% (0.2756 => 0.2949, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 6.98% (0.3379 => 0.3615, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/fibo: 6.97% (0.2725 => 0.2915, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.91% (0.3052 => 0.3263, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.88% (0.2877 => 0.3075, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.74% (0.2714 => 0.2897, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.71% (0.2802 => 0.2990, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 6.19% (1.2842 => 1.3637, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.78% (0.3131 => 0.3312, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.56% (0.3817 => 0.3953, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.97% (0.3935 => 0.4052, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.92% (1.1145 => 1.2919, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.85% (1.1396 => 1.2519, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 9.62% (0.9957 => 1.0915, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.1578 => 3.3687, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 5.92% (1.9405 => 2.0554, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.66% (4.2280 => 4.3405, std.dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.78% (0.8333 => 0.8481, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.64% (3.6395 => 3.6993, std.dev.: 0.0091) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.60% (2.6546 => 2.6970, std.dev.: 0.0020) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2077, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 1.27% (4.4649 => 4.5215, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.01% (6.6874 => 0.1332, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -79.84% (0.8651 => 0.1744, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.80% (5.2763 => 3.2292, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -14.66% (54.1659 => 46.2260, std.dev.: 0.0604) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.27% (2.9384 => 2.6367, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -6.55% (22.1758 => 20.7241, std.dev.: 0.0258) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.08% (8.0499 => 3.7769, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.50% (1.1492 => 0.7642, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4751, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.06% (1.6925 => 1.4207, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.67% (1.2258 => 1.0705, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.86% (1.2373 => 1.0906, std.dev.: 0.0323) SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3453 => 2.9600, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -11.05% (1.5373 => 1.3675, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.34% (19.9488 => 18.2849, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/mason/mason: -7.77% (0.2161 => 0.1993, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.07% (1.8329 => 1.7033, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.17% (1.6805 => 1.5937, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5082, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.46% (8.1563 => 7.7922, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.73% (1.3677 => 1.3167, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.67% (3.2827 => 3.1621, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8775, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5047, std.dev.: 0.0045) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.70% (0.4808 => 0.4678, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.88% (10.2830 => 10.0893, std.dev.: 0.0143) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6812, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.64% (2.5528 => 2.5109, std.dev.: 0.0039) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4207, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: -1.38% (4.6441 => 4.5802, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2879, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.08% (6.2999 => 6.2319, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0554 => 1.0446, std.dev.: 0.0008) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -7.13% (0.5229 => 0.4856, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 14.67% (14.9895 => 17.1880, std.dev.: 0.0201) MultiSource/Benchmarks/MallocBench/gs/gs: 11.39% (4.1105 => 4.5787, std.dev.: 0.0120) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.88% (1.1048 => 1.3023, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.30% (7.1582 => 8.1815, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.57% (0.6222 => 0.7751, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35500.00% (0.0001 => 0.0356, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -99.95% (0.2116 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 20 09:05:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 20 Oct 2012 11:05:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121020160512.B513A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5045?compare_to=5042&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5045, Order: 166378, Start Time: 2012-10-20 14:42:03, End Time: 2012-10-20 16:08:12 To: 5042, Order: 166375, Start Time: 2012-10-20 12:46:14, End Time: 2012-10-20 14:12:37 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (199 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1041 (667 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.30% (78.3968 => 80.2028, std.dev.: 0.5257) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.78% (2.0176 => 2.4974, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.99% (0.1410 => 0.1706, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 18.04% (0.0826 => 0.0975, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 17.79% (0.2243 => 0.2642, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 17.18% (0.1013 => 0.1187, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.62% (0.0746 => 0.0870, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.23% (0.0653 => 0.0759, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.20% (0.7710 => 0.8959, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.45% (0.2596 => 0.2997, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.02% (0.0819 => 0.0942, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 14.74% (0.2721 => 0.3122, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.63% (0.0834 => 0.0956, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.30% (0.0811 => 0.0927, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 14.20% (1.3693 => 1.5638, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.01% (0.1413 => 0.1611, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 13.96% (0.1003 => 0.1143) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.93% (0.0847 => 0.0965, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.86% (0.1075 => 0.1224, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.80% (0.1986 => 0.2260, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.79% (0.9199 => 1.0468, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.79% (0.0725 => 0.0825, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.73% (0.5265 => 0.5988, std.dev.: 0.0024) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.62% (0.1072 => 0.1218, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.56% (0.1327 => 0.1507, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.54% (0.5637 => 0.6400, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.48% (0.6959 => 0.7897, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.43% (3.9660 => 4.4986, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.41% (0.1588 => 0.1801, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.38% (0.0964 => 0.1093, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 13.30% (0.7038 => 0.7974, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 13.18% (0.1062 => 0.1202, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/mst/mst: 13.14% (0.1111 => 0.1257, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 13.11% (0.7460 => 0.8438, std.dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.04% (0.2914 => 0.3294, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.70% (0.1276 => 0.1438, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.69% (0.0977 => 0.1101, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 12.59% (0.4328 => 0.4873, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/distray/distray: 12.59% (0.0818 => 0.0921, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 12.52% (0.1478 => 0.1663, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 12.46% (0.4062 => 0.4568, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.43% (0.1014 => 0.1140, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 12.42% (1.1061 => 1.2435, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.26% (1.4563 => 1.6349, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.25% (1.2193 => 1.3687, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.16% (0.5577 => 0.6255, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 12.10% (13.8202 => 15.4925, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.10% (1.1364 => 1.2739, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.01% (0.2023 => 0.2266, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 12.00% (0.7506 => 0.8407, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference-object: 11.93% (0.5818 => 0.6512, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.90% (0.1865 => 0.2087, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.86% (0.6283 => 0.7028, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.81% (0.4379 => 0.4896, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.75% (0.1157 => 0.1293, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.75% (0.2127 => 0.2377, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.58% (0.3246 => 0.3622, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.55% (0.4390 => 0.4897, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 11.53% (0.1657 => 0.1848, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 11.52% (0.5748 => 0.6410, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 11.48% (3.8646 => 4.3083, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 11.47% (0.7061 => 0.7871, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.37% (0.3756 => 0.4183, std.dev.: 0.0046) MultiSource/Applications/sgefa/sgefa: 11.29% (0.2995 => 0.3333, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.28% (0.3130 => 0.3483, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.26% (0.1048 => 0.1166, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.19% (0.4791 => 0.5327, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 11.15% (0.2925 => 0.3251, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.07% (0.1789 => 0.1987, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.03% (0.3899 => 0.4329, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 10.96% (0.3220 => 0.3573, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.93% (0.3485 => 0.3866, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 10.92% (1.0313 => 1.1439, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 10.82% (0.2781 => 0.3082, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.82% (7.2180 => 7.9988, std.dev.: 0.0109) MultiSource/Applications/treecc/treecc: 10.80% (1.9270 => 2.1351, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/chomp: 10.70% (0.1589 => 0.1759, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.66% (0.4016 => 0.4444, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/health/health: 10.63% (0.1213 => 0.1342, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.60% (0.2782 => 0.3077, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 10.60% (0.3293 => 0.3642, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.59% (0.3022 => 0.3342, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 10.54% (0.6744 => 0.7455, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.53% (0.3580 => 0.3957, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.52% (0.3489 => 0.3856, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 10.50% (0.3868 => 0.4274, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 10.45% (0.2726 => 0.3011, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 10.39% (3.1889 => 3.5202, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.35% (0.2966 => 0.3273, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.31% (0.1435 => 0.1583, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 10.28% (16.6129 => 18.3205, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/sieve: 10.25% (0.3453 => 0.3807, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 10.24% (0.8310 => 0.9161, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.23% (0.2140 => 0.2359, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary3: 10.23% (0.3149 => 0.3471, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.22% (1.9828 => 2.1854, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.21% (1.3245 => 1.4597, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.17% (0.2655 => 0.2925, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 10.15% (0.2690 => 0.2963, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 10.14% (0.2761 => 0.3041, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 10.14% (0.3107 => 0.3422, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 10.11% (0.2760 => 0.3039, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.09% (0.8698 => 0.9576, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 10.09% (0.2607 => 0.2870, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.07% (0.1569 => 0.1727, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 10.05% (0.3534 => 0.3889, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 10.03% (2.1791 => 2.3976, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: 9.96% (0.3192 => 0.3510, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.95% (0.2765 => 0.3040, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 9.93% (0.2628 => 0.2889, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 9.87% (0.2937 => 0.3227, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.87% (0.6576 => 0.7225, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.78% (4.3801 => 4.8086, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.73% (3.6692 => 4.0262, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.61% (4.4433 => 4.8704, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/matrix: 9.61% (0.2988 => 0.3275, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.50% (0.2696 => 0.2952, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 9.48% (0.4113 => 0.4503, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.39% (0.2321 => 0.2539, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 9.24% (0.2945 => 0.3217, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.19% (0.6135 => 0.6699, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.19% (0.3755 => 0.4100, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.18% (0.1819 => 0.1986, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.15% (4.9865 => 5.4426, std.dev.: 0.0249) MultiSource/Benchmarks/nbench/nbench: 9.13% (1.0594 => 1.1561, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.11% (0.3511 => 0.3831, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 9.05% (14.8535 => 16.1979, std.dev.: 0.0095) MultiSource/Benchmarks/sim/sim: 8.91% (0.3131 => 0.3410, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 8.75% (1.2749 => 1.3864, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 8.69% (8.4961 => 9.2342, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.64% (0.8818 => 0.9580, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 8.61% (4.6629 => 5.0645, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.32% (1.1333 => 1.2276, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/neural/neural: 8.16% (0.1385 => 0.1498, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 8.15% (3.7467 => 4.0519, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.12% (0.9108 => 0.9848, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 8.08% (0.6250 => 0.6755, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.06% (1.5188 => 1.6412, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 8.02% (0.4003 => 0.4324, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.97% (0.3914 => 0.4226, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.95% (3.2742 => 3.5345, std.dev.: 0.0049) MultiSource/Applications/JM/ldecod/ldecod: 7.92% (6.5754 => 7.0962, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.89% (0.4805 => 0.5184, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.83% (0.3245 => 0.3499, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/for-in: 7.73% (0.3789 => 0.4082, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.72% (0.3940 => 0.4244, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.69% (0.3578 => 0.3853, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 7.68% (0.3646 => 0.3926, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 7.67% (0.2008 => 0.2162, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 7.66% (0.3601 => 0.3877, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 7.65% (0.3623 => 0.3900, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.62% (0.3663 => 0.3942, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 7.61% (1.2292 => 1.3227, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.59% (0.2504 => 0.2694, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.58% (6.2785 => 6.7545, std.dev.: 0.0083) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.48% (0.3650 => 0.3923, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.33% (2.1007 => 2.2547, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.18% (0.2243 => 0.2404, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.01% (13.2842 => 14.2159, std.dev.: 0.0142) SingleSource/Benchmarks/Misc/ReedSolomon: 6.98% (0.1777 => 0.1901, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 5.23% (16.2614 => 17.1125, std.dev.: 0.0193) MultiSource/Applications/ClamAV/clamscan: 4.92% (14.5298 => 15.2445, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/bh/bh: 3.99% (0.2859 => 0.2973, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 2.16% (33.2944 => 34.0124, std.dev.: 0.0115) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5152, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fbench: 24.05% (1.8175 => 2.2546, std.dev.: 0.0496) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.00% (1.0895 => 1.2747, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 11.19% (1.1560 => 1.2854, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.03% (0.8273 => 0.9020, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4143, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.42% (0.9692 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 5.25% (1.2998 => 1.3681, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0048, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 4.48% (0.5449 => 0.5693, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.46% (2.8606 => 2.9882, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.58% (1.9199 => 1.9887, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.43% (10.7476 => 11.1160, std.dev.: 0.0631) MultiSource/Applications/hexxagon/hexxagon: 3.37% (12.0921 => 12.4993, std.dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 3.21% (11.2619 => 11.6235, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bisort/bisort: 2.91% (0.8239 => 0.8479, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.35% (1.0310 => 1.0552, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.14% (7.4271 => 7.5862, std.dev.: 0.0071) MultiSource/Applications/lemon/lemon: 1.80% (1.4298 => 1.4555, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.46% (2.0200 => 2.0495, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5124, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1859, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 1.20% (5.5130 => 5.5790, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.16% (9.9194 => 10.0346, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists: 1.12% (12.4560 => 12.5954, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.52% (0.2670 => 0.1428, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.48% (0.4657 => 0.3936, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.58% (1.3813 => 1.2213, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.50% (1.3819 => 1.2230, std.dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.28% (1.0460 => 0.8548, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.73% (0.2238 => 0.1953, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.11% (20.3410 => 18.2837, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2639, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -6.20% (1.9290 => 1.8094, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -5.68% (1.2308 => 1.1609, std.dev.: 0.0141) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0049) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5151, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.79% (0.9996 => 0.9517, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.86% (1.7688 => 1.7006, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.02% (0.4867 => 0.4720, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -2.88% (3.2729 => 3.1788, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: -2.79% (3.0263 => 2.9418, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: -2.72% (1.9762 => 1.9224, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8812, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.33% (4.1080 => 4.0124, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.94% (0.6589 => 0.6461, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.86% (0.6615 => 0.6492, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.74% (6.3560 => 6.2453, std.dev.: 0.0040) MultiSource/Applications/lua/lua: -1.71% (26.5159 => 26.0623, std.dev.: 0.0378) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.65% (0.8342 => 0.8204, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.64% (2.5254 => 2.4839, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0068, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.28% (5.3167 => 5.2486, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/heapsort: -1.24% (3.9173 => 3.8687, std.dev.: 0.0060) MultiSource/Benchmarks/mafft/pairlocalalign: -1.23% (28.2225 => 27.8752, std.dev.: 0.0011) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1138, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -1.05% (84.4286 => 83.5436, std.dev.: 0.0109) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 20 15:33:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 20 Oct 2012 17:33:03 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121020223303.4F51D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5046?compare_to=5043&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5046, Order: 166379, Start Time: 2012-10-20 21:11:47, End Time: 2012-10-20 22:35:04 To: 5043, Order: 166378, Start Time: 2012-10-20 14:12:54, End Time: 2012-10-20 15:36:34 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 5 (25 on baseline) Performance Improvements: 5 (5 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 965 (944 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.74% (0.8344 => 0.8489, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.22% (1.2547 => 1.2700, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 26.35% (12.8308 => 16.2120, std.dev.: 0.1805) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.43% (0.7563 => 0.7898, std.dev.: 0.0109) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.43% (2.5826 => 2.6454, std.dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.25% (2.4091 => 2.3789, std.dev.: 0.0086) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -12.02% (24.0713 => 21.1777, std.dev.: 0.9698) SingleSource/Benchmarks/Shootout-C++/ackermann: -8.94% (4.0087 => 3.6504, std.dev.: 0.0517) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.95% (4.6080 => 4.5180, std.dev.: 0.0197) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -1.82% (46.1140 => 45.2740, std.dev.: 0.3220) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.11% (16.4753 => 16.4579, std.dev.: 0.1106) MultiSource/Applications/obsequi/Obsequi: -0.88% (1.0557 => 1.0464, std.dev.: 0.0074) MultiSource/Applications/sqlite3/sqlite3: -0.47% (0.6387 => 0.6357, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/08-main/main: -0.62% (0.1929 => 0.1917, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.27% (0.1652 => 0.1673, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.56% (0.3200 => 0.3250, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.75% (0.2477 => 0.2384, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.27% (0.3378 => 0.3335, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.45% (0.2347 => 0.2313, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/bigfib: 0.02% (0.5957 => 0.5958, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/mandel: -6.00% (0.0450 => 0.0423, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.87% (0.3337 => 0.3308, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/strcat: -0.40% (0.1987 => 0.1979, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.63% (0.0246 => 0.0242, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 31.30% (0.0131 => 0.0172, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.54% (0.0379 => 0.0400, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 18.99% (0.0237 => 0.0282, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 7.29% (0.0288 => 0.0309, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 7.93% (0.0391 => 0.0422, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: 1.01% (0.0198 => 0.0200, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/test1: -14.79% (0.0169 => 0.0144, std.dev.: 0.0041) SingleSource/UnitTests/byval-alignment: - (0.0332 => 0.0332, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 62.50% (0.0008 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.61% (0.1479 => 0.1488, std.dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 3.20% (1.1252 => 1.1612, std.dev.: 0.0269) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 4.71% (0.1445 => 0.1513, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.16% (0.4123 => 0.4075, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.21% (0.1447 => 0.1415, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.42% (0.0646 => 0.0611, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -22.74% (0.0277 => 0.0214, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.60% (0.0579 => 0.0535, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.04% (1.1494 => 1.1375, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 100.00% (0.0001 => 0.0002, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.50% (0.0555 => 0.0580, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.72% (0.0267 => 0.0193, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.05% (0.8016 => 0.8012, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -53.15% (0.0111 => 0.0052, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.64% (2.1832 => 1.6670, std.dev.: 0.0220) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.06% (0.0810 => 0.0932, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.32% (0.3137 => 0.3304, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.42% (0.7473 => 0.7803, std.dev.: 0.0075) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.17% (0.8321 => 0.8668, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.55% (0.4847 => 0.5019, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.55% (1.1606 => 1.1902, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 2.34% (1.2222 => 1.2508, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.07% (0.8317 => 0.8489, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.02% (1.4479 => 1.4772, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.84% (0.9435 => 0.9609, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.39% (1.2526 => 1.2700, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.29% (0.8656 => 0.8768, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.88% (1.5795 => 2.5095, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.70% (14.6451 => 16.2120, std.dev.: 0.1805) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.10% (0.3186 => 0.3476, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.48% (1.1857 => 1.2862, std.dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 5.94% (63.1822 => 66.9382, std.dev.: 0.1207) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.96% (0.7597 => 0.7898, std.dev.: 0.0109) SingleSource/Benchmarks/Misc/ReedSolomon: 2.84% (8.5322 => 8.7742, std.dev.: 0.0255) MultiSource/Applications/siod/siod: 2.82% (3.6643 => 3.7676, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.68% (2.5763 => 2.6454, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash: 1.93% (0.6205 => 0.6325, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: 1.65% (2.3560 => 2.3948, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.04% (4.0473 => 4.0894, std.dev.: 0.0057) MultiSource/Benchmarks/llubenchmark/llu: 1.02% (1.9967 => 2.0170, std.dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.63% (0.3269 => 0.2987, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.85% (3.9188 => 3.6504, std.dev.: 0.0517) MultiSource/Applications/lua/lua: -5.32% (29.8330 => 28.2447, std.dev.: 0.0706) SingleSource/Benchmarks/Shootout-C++/hash2: -1.39% (3.4237 => 3.3760, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.22% (3.3479 => 3.3072, std.dev.: 0.0022) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.07% (16.4461 => 16.4579, std.dev.: 0.1106) MultiSource/Applications/obsequi/Obsequi: 1.97% (1.0262 => 1.0464, std.dev.: 0.0074) MultiSource/Applications/sqlite3/sqlite3: 0.39% (0.6332 => 0.6357, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/08-main/main: 4.70% (0.1831 => 0.1917, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.31% (0.1559 => 0.1673, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.07% (0.3123 => 0.3250, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.21% (0.2463 => 0.2384, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.27% (0.3344 => 0.3335, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.16% (0.2364 => 0.2313, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/bigfib: -0.87% (0.6010 => 0.5958, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/mandel: -1.40% (0.0429 => 0.0423, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.29% (0.3266 => 0.3308, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/strcat: 0.51% (0.1969 => 0.1979, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.04% (0.0224 => 0.0242, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 39.84% (0.0123 => 0.0172, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.96% (0.0408 => 0.0400, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 11.02% (0.0254 => 0.0282, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.32% (0.0302 => 0.0309, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.90% (0.0384 => 0.0422, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: 5.26% (0.0190 => 0.0200, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/test1: -20.00% (0.0180 => 0.0144, std.dev.: 0.0041) SingleSource/UnitTests/byval-alignment: 44.35% (0.0230 => 0.0332, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 3.48% (0.1438 => 0.1488, std.dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 2.50% (1.1329 => 1.1612, std.dev.: 0.0269) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.49% (0.1462 => 0.1513, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.14% (0.4164 => 0.4075, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.36% (0.1369 => 0.1415, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.68% (0.0641 => 0.0611, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 9.74% (0.0195 => 0.0214, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.44% (0.0578 => 0.0535, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.54% (1.1437 => 1.1375, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -85.71% (0.0014 => 0.0002, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.50% (0.0627 => 0.0580, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.22% (0.0180 => 0.0193, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.06% (0.8017 => 0.8012, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -16.13% (0.0062 => 0.0052, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 20 15:42:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 20 Oct 2012 17:42:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121020224208.DE4392A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5047?compare_to=5044&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5047, Order: 166379, Start Time: 2012-10-20 21:24:11, End Time: 2012-10-20 22:44:08 To: 5044, Order: 166378, Start Time: 2012-10-20 14:34:08, End Time: 2012-10-20 15:53:57 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (83 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (184 on baseline) Performance Improvements: 0 (43 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 98 (15 on baseline) Unchanged Tests: 944 (651 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.14% (0.4856 => 0.4849, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 0.05% (17.1880 => 17.1965, std.dev.: 0.0134) MultiSource/Benchmarks/Bullet/bullet: 0.00% (56.0445 => 56.0454, std.dev.: 0.0182) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 0.40% (0.2519 => 0.2529, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: -0.04% (4.5787 => 4.5768, std.dev.: 0.0250) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.02% (15.2417 => 15.2445, std.dev.: 0.0158) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 0.03% (3.5765 => 3.5775, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.21% (0.0480 => 0.0481, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0481 => 0.0481, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.22% (0.0449 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0450 => 0.0450, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0439 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0441 => 0.0441, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0433 => 0.0433, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0434 => 0.0434, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.22% (0.0451 => 0.0452, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.22% (0.0452 => 0.0453, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0445 => 0.0445, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.22% (0.0447 => 0.0446, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0435 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.23% (0.0436 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0443 => 0.0443, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0444 => 0.0444, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0454 => 0.0454, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0455 => 0.0455, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0431 => 0.0431) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0432 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0443 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.23% (0.0444 => 0.0443, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0434 => 0.0434, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0435 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.23% (0.0426 => 0.0427, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.70% (0.0427 => 0.0430, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.24% (0.0424 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0426 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.22% (0.0461 => 0.0462, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.65% (0.0462 => 0.0465, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0424 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0425 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.24% (0.0425 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0426 => 0.0426) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0432 => 0.0432, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0434 => 0.0434, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 0.03% (1.1098 => 1.1101, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.10% (3.5728 => 3.5765, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.22% (1.3023 => 1.3051, std.dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.07% (8.1815 => 8.1873, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.03% (0.7751 => 0.7753, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0356 => 0.0356, std.dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/Bullet/bullet: -11.38% (63.2438 => 56.0454, std.dev.: 0.0182) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.36% (0.2271 => 0.2529, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.11% (14.3668 => 15.2445, std.dev.: 0.0158) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -33.16% (5.3526 => 3.5775, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -0.83% (1.1194 => 1.1101, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.59% (5.3855 => 3.5765, std.dev.: 0.0032) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -99.94% (0.1639 => 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -99.97% (0.3987 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -100.00% (2.6778 => 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -99.80% (0.0506 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 35.96% (14.1553 => 19.2461, std.dev.: 0.0120) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.71% (3.4629 => 5.7730, std.dev.: 0.0072) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13482.08% (0.0720 => 9.7791, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050300.00% (0.0001 => 10.0504, std.dev.: 0.0009) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.70% (0.2554 => 0.4181, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: 56.25% (0.0256 => 0.0400, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 52.69% (10.3673 => 15.8294, std.dev.: 0.0124) SingleSource/UnitTests/SignlessTypes/factor: 44.59% (0.0296 => 0.0428, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 40.84% (1.5859 => 2.2336, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 38.41% (0.1622 => 0.2245, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/distray/distray: 36.55% (0.1056 => 0.1442, std.dev.: 0.0000) SingleSource/UnitTests/vla: 31.83% (0.0355 => 0.0468, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 29.59% (2.2024 => 2.8541, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/neural/neural: 25.97% (0.1463 => 0.1843, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 25.42% (0.0834 => 0.1046, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: 20.89% (0.2049 => 0.2477, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.63% (0.1566 => 0.1889, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 20.39% (0.1432 => 0.1724, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.22% (7.0540 => 8.4095, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.40% (2.2022 => 2.6074, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.14% (0.0871 => 0.1029, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 17.81% (0.1555 => 0.1832, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.71% (0.5105 => 0.6009, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.06% (0.6675 => 0.7814, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 16.44% (0.1655 => 0.1927, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.27% (1.3050 => 1.5173, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 16.23% (3.3354 => 3.8766, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: 15.97% (0.1440 => 0.1670, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 15.75% (0.1695 => 0.1962, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/tsp/tsp: 15.40% (0.1175 => 0.1356, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 15.38% (0.0793 => 0.0915, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.28% (0.5020 => 0.5787, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.26% (0.1337 => 0.1541, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.23% (1.5415 => 1.7763, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.16% (0.0838 => 0.0965, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 15.13% (0.1163 => 0.1339, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.12% (0.1032 => 0.1188, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.06% (0.8172 => 0.9403, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.83% (0.1510 => 0.1734, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 14.72% (0.3282 => 0.3765, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 14.70% (0.7115 => 0.8161, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.67% (0.0886 => 0.1016, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 14.46% (0.3423 => 0.3918, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.43% (0.1940 => 0.2220, std.dev.: 0.0045) MultiSource/Applications/sgefa/sgefa: 14.41% (0.3109 => 0.3557, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.37% (4.2646 => 4.8776, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.37% (0.0842 => 0.0963, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.21% (0.0746 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/exptree: 14.13% (0.0814 => 0.0929, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.10% (0.3121 => 0.3561, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.08% (0.1584 => 0.1807, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/matrix: 14.06% (0.0818 => 0.0933, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.04% (1.7609 => 2.0082, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.04% (0.9765 => 1.1136, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: 13.92% (1.1642 => 1.3263, std.dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 13.90% (9.4845 => 10.8032, std.dev.: 0.0062) MultiSource/Applications/oggenc/oggenc: 13.69% (5.7591 => 6.5474, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.67% (0.1236 => 0.1405, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.67% (0.2107 => 0.2395, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 13.61% (0.6450 => 0.7328, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.61% (0.1117 => 0.1269, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.59% (8.1363 => 9.2417, std.dev.: 0.0129) MultiSource/Applications/aha/aha: 13.55% (0.1151 => 0.1307, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.51% (0.1029 => 0.1168, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.51% (0.0770 => 0.0874, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.48% (0.1906 => 0.2163, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.44% (1.4186 => 1.6092, std.dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.42% (0.1438 => 0.1631, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.42% (0.2758 => 0.3128, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.40% (0.0933 => 0.1058, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.40% (0.5860 => 0.6645, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 13.32% (0.4879 => 0.5529, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 13.27% (0.7835 => 0.8875, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.22% (0.2065 => 0.2338, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.22% (0.4615 => 0.5225, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.11% (0.2700 => 0.3054, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.10% (0.1695 => 0.1917, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.09% (0.1062 => 0.1201, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 13.03% (2.0273 => 2.2915, std.dev.: 0.0053) MultiSource/Applications/lambda-0_1_3/lambda: 12.83% (0.7433 => 0.8387, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 12.82% (1.1840 => 1.3358, std.dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 12.79% (10.4361 => 11.7704, std.dev.: 0.0105) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.70% (0.0929 => 0.1047, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.66% (0.0798 => 0.0899, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.65% (4.9449 => 5.5705, std.dev.: 0.0105) SingleSource/UnitTests/SignlessTypes/rem: 12.59% (0.1144 => 0.1288, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 12.58% (0.3387 => 0.3813, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 12.57% (1.0722 => 1.2070, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.56% (0.5981 => 0.6732, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.55% (5.0018 => 5.6297, std.dev.: 0.0110) MultiSource/Benchmarks/McCat/05-eks/eks: 12.42% (0.4299 => 0.4833, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.36% (0.8067 => 0.9064, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 12.27% (3.8723 => 4.3476, std.dev.: 0.0271) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.25% (0.1625 => 0.1824, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: 12.22% (0.1268 => 0.1423, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 12.18% (0.3177 => 0.3564, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.16% (0.3307 => 0.3709, std.dev.: 0.0099) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.10% (0.2603 => 0.2918, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.03% (7.9617 => 8.9194, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.01% (0.5569 => 0.6238, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.01% (1.1861 => 1.3285, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.95% (0.1330 => 0.1489, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 11.89% (0.3180 => 0.3558, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 11.70% (0.8921 => 0.9965, std.dev.: 0.0013) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.64% (0.1143 => 0.1276, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 11.56% (1.5603 => 1.7406, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/trivial-interface: 11.34% (0.3473 => 0.3867, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.25% (0.3441 => 0.3828, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 11.21% (0.3543 => 0.3940, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.20% (0.1125 => 0.1251, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: 11.18% (0.3497 => 0.3888, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.15% (0.3828 => 0.4255, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.15% (0.3561 => 0.3958, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.13% (0.3927 => 0.4364, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.12% (0.3543 => 0.3937, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.09% (0.3516 => 0.3906, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.04% (0.3886 => 0.4315, std.dev.: 0.0082) SingleSource/UnitTests/ObjC/for-in: 11.02% (0.3694 => 0.4101, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 11.00% (0.6456 => 0.7166, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 11.00% (0.3092 => 0.3432, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.90% (0.2266 => 0.2513, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.78% (0.1892 => 0.2096, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.64% (0.8101 => 0.8963, std.dev.: 0.0052) MultiSource/Applications/siod/siod: 10.45% (2.2969 => 2.5370, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 9.89% (0.4289 => 0.4713, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 9.81% (0.4620 => 0.5073, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 9.76% (21.9371 => 24.0783, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/lists: 9.76% (0.3422 => 0.3756, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.70% (0.3826 => 0.4197, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.62% (0.4636 => 0.5082, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.37% (0.3865 => 0.4227, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.21% (0.4203 => 0.4590, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 8.99% (0.4048 => 0.4412, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 8.98% (0.3684 => 0.4015, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.94% (0.4103 => 0.4470, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.90% (0.3427 => 0.3732, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.87% (0.6030 => 0.6565, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.86% (0.5925 => 0.6450, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 8.33% (0.3603 => 0.3903, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 8.05% (17.1811 => 18.5640, std.dev.: 0.0243) SingleSource/UnitTests/ObjC++/property-reference: 8.01% (0.7326 => 0.7913, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.98% (0.2430 => 0.2624, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 7.84% (0.3098 => 0.3341) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.84% (0.3650 => 0.3936, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.82% (3.8922 => 4.1965, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/strcat: 7.67% (0.2831 => 0.3048, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.58% (0.4064 => 0.4372, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 7.52% (0.3283 => 0.3530, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.49% (0.3232 => 0.3474, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.44% (0.2905 => 0.3121, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.42% (2.0665 => 2.2198, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.40% (0.2891 => 0.3105, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.35% (0.2872 => 0.3083, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 7.30% (0.2725 => 0.2924, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.21% (0.3162 => 0.3390, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.21% (0.3136 => 0.3362, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.12% (0.2793 => 0.2992, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 7.07% (0.2871 => 0.3074) SingleSource/Benchmarks/Shootout-C++/ary2: 7.04% (0.3379 => 0.3617, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.04% (0.2756 => 0.2950, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 6.95% (0.2877 => 0.3077, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 6.91% (0.3052 => 0.3263, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.82% (0.2714 => 0.2899, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 6.78% (0.2802 => 0.2992, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 6.28% (1.2842 => 1.3648, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: 5.78% (0.3131 => 0.3312, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.72% (0.3817 => 0.3959, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.00% (0.3935 => 0.4053, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.95% (1.1396 => 1.2530, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 9.71% (0.9957 => 1.0924, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/hash2: 6.61% (3.1578 => 3.3666, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: 5.92% (1.9405 => 2.0554, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.83% (4.2280 => 4.3478, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569) MultiSource/Benchmarks/Olden/bisort/bisort: 1.74% (0.8333 => 0.8478, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.70% (3.6395 => 3.7014, std.dev.: 0.0068) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2075, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.38% (2.6546 => 2.6912, std.dev.: 0.0034) MultiSource/Applications/viterbi/viterbi: 1.23% (4.4649 => 4.5200, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.20% (6.5088 => 6.5868, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.01% (6.6874 => 0.1332, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -79.83% (0.8651 => 0.1745, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.81% (5.2763 => 3.2285, std.dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -14.61% (54.1659 => 46.2517, std.dev.: 0.0252) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.26% (2.9384 => 2.6368, std.dev.: 0.0031) MultiSource/Applications/ClamAV/clamscan: -6.43% (22.1758 => 20.7490, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.10% (8.0499 => 3.7757, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.47% (1.1492 => 0.7646, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4752, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.99% (1.6925 => 1.4219, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.66% (1.2258 => 1.0706, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.60% (1.2373 => 1.0938, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3453 => 2.9599, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -10.93% (1.5373 => 1.3692, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.39% (19.9488 => 18.2758, std.dev.: 0.0122) MultiSource/Benchmarks/FreeBench/mason/mason: -7.91% (0.2161 => 0.1990, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.02% (1.8329 => 1.7042, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4781, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8478, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.18% (1.6805 => 1.5935, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.83% (1.5835 => 1.5070, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.30% (8.1563 => 7.8056, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.61% (3.2827 => 3.1641, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8775, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.4995, std.dev.: 0.0081) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.66% (0.4808 => 0.4680, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0850, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6822, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -1.66% (2.5528 => 2.5104, std.dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4202, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -1.39% (4.6441 => 4.5795, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2879, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -7.27% (0.5229 => 0.4849, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 14.72% (14.9895 => 17.1965, std.dev.: 0.0134) MultiSource/Benchmarks/MallocBench/gs/gs: 11.34% (4.1105 => 4.5768, std.dev.: 0.0250) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.13% (1.1048 => 1.3051, std.dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.38% (7.1582 => 8.1873, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.61% (0.6222 => 0.7753, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35500.00% (0.0001 => 0.0356, std.dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -99.95% (0.2116 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 20 15:48:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 20 Oct 2012 17:48:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121020224831.20B812A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5048?compare_to=5045&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5048, Order: 166379, Start Time: 2012-10-20 21:25:26, End Time: 2012-10-20 22:51:31 To: 5045, Order: 166378, Start Time: 2012-10-20 14:42:03, End Time: 2012-10-20 16:08:12 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (203 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1041 (661 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.17% (0.9517 => 0.9628, std.dev.: 0.0021) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.97% (2.0176 => 2.5012, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.06% (0.1410 => 0.1707, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 18.40% (0.0826 => 0.0978, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 18.19% (0.2243 => 0.2651, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.12% (0.0618 => 0.0730, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 17.47% (0.1013 => 0.1190, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.89% (0.0746 => 0.0872, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.74% (0.7710 => 0.9001, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.69% (0.0653 => 0.0762, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.03% (0.0725 => 0.0834, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.02% (0.0819 => 0.0942, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.95% (0.2596 => 0.2984, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 14.88% (0.2721 => 0.3126, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.87% (0.0834 => 0.0958, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.55% (0.0811 => 0.0929, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.51% (0.1413 => 0.1618, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 14.46% (0.1003 => 0.1148, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.40% (0.0847 => 0.0969, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 14.21% (1.3693 => 1.5639, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.17% (0.0720 => 0.0822) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.15% (0.1986 => 0.2267, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.09% (0.9199 => 1.0495, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.93% (0.5637 => 0.6422, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.90% (0.5265 => 0.5997, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.84% (0.6959 => 0.7922, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.80% (0.0964 => 0.1097, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.79% (0.1327 => 0.1510, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.79% (3.9660 => 4.5129, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.77% (0.1075 => 0.1223, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 13.63% (0.7038 => 0.7997, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.60% (0.1588 => 0.1804, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.53% (0.1072 => 0.1217, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 13.47% (0.1062 => 0.1205, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 13.41% (0.1111 => 0.1260, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 13.34% (0.7460 => 0.8455, std.dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.32% (0.2914 => 0.3302, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.10% (0.0977 => 0.1105, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.96% (0.5577 => 0.6300, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.93% (0.1276 => 0.1441, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 12.76% (1.1061 => 1.2472, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.75% (1.4563 => 1.6420, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.72% (0.1014 => 0.1143) MultiSource/Applications/viterbi/viterbi: 12.72% (0.1478 => 0.1666, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 12.68% (0.4328 => 0.4877, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 12.60% (0.4062 => 0.4574, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 12.59% (0.0818 => 0.0921, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.53% (1.1364 => 1.2788, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.47% (1.2193 => 1.3713, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 12.36% (13.8202 => 15.5281, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.26% (0.2023 => 0.2271, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.23% (0.1865 => 0.2093, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 12.20% (0.7506 => 0.8422, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.10% (0.1157 => 0.1297, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.10% (0.6283 => 0.7043, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.08% (0.4379 => 0.4908, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.08% (0.3246 => 0.3638, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 12.07% (0.1657 => 0.1857, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 11.95% (0.2995 => 0.3353, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 11.86% (0.5818 => 0.6508, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.85% (0.2127 => 0.2379, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.83% (0.1048 => 0.1172, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 11.74% (3.8646 => 4.3182, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 11.73% (0.2925 => 0.3268, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.73% (0.3130 => 0.3497, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.64% (0.3899 => 0.4353, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 11.64% (0.7061 => 0.7883, std.dev.: 0.0051) SingleSource/UnitTests/ObjC++/Hello: 11.50% (0.5748 => 0.6409, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/18-imp/imp: 11.46% (0.3220 => 0.3589, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.38% (0.4791 => 0.5336, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 11.24% (1.0313 => 1.1472, std.dev.: 0.0104) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.24% (0.1789 => 0.1990, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.09% (0.4390 => 0.4877, std.dev.: 0.0037) SingleSource/Regression/C++/ofstream_ctor: 11.04% (0.2781 => 0.3088, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.02% (0.3485 => 0.3869, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 11.01% (1.9270 => 2.1392, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.99% (7.2180 => 8.0111, std.dev.: 0.0107) SingleSource/Benchmarks/McGill/chomp: 10.95% (0.1589 => 0.1763, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 10.91% (0.6744 => 0.7480, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 10.88% (0.1213 => 0.1345, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.88% (0.4016 => 0.4453, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/lists: 10.87% (0.3293 => 0.3651, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.85% (0.3022 => 0.3350, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.76% (0.3756 => 0.4160, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.68% (0.2782 => 0.3079, std.dev.: 0.0052) MultiSource/Applications/d/make_dparser: 10.65% (3.1889 => 3.5284, std.dev.: 0.0044) MultiSource/Applications/kimwitu++/kc: 10.59% (16.6129 => 18.3721, std.dev.: 0.0208) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.58% (0.3489 => 0.3858, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 10.55% (0.3868 => 0.4276, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.53% (0.3580 => 0.3957, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 10.53% (0.8310 => 0.9185, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.52% (0.1435 => 0.1586, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.45% (0.1569 => 0.1733, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 10.43% (0.3453 => 0.3813, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 10.42% (0.2726 => 0.3010, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 10.38% (2.1791 => 2.4053, std.dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.35% (0.0976 => 0.1077, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.34% (1.3245 => 1.4614, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/except: 10.33% (0.2760 => 0.3045, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.32% (0.8698 => 0.9596, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 10.25% (0.2761 => 0.3044, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.23% (0.2140 => 0.2359, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 10.23% (0.3149 => 0.3471, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.20% (0.2765 => 0.3047, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.19% (1.9828 => 2.1848, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 10.17% (0.3107 => 0.3423, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.17% (0.2655 => 0.2925, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/random: 10.15% (0.2690 => 0.2963, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.11% (0.2966 => 0.3266, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 10.05% (0.2607 => 0.2869, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 10.05% (0.3534 => 0.3889, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.99% (3.6692 => 4.0356, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/wc: 9.98% (0.2937 => 0.3230, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.93% (4.3801 => 4.8149, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/fibo: 9.89% (0.2628 => 0.2888, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 9.87% (0.4113 => 0.4519, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 9.87% (0.3192 => 0.3507, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.84% (4.4433 => 4.8805, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/matrix: 9.71% (0.2988 => 0.3278, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.57% (0.2696 => 0.2954, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.56% (0.2321 => 0.2543, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.47% (0.6576 => 0.7199, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.46% (0.1819 => 0.1991, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.45% (0.6135 => 0.6715, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.43% (0.3511 => 0.3842, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.41% (4.9865 => 5.4555, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 9.30% (14.8535 => 16.2344, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/objinst: 9.27% (0.2945 => 0.3218, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.27% (0.3755 => 0.4103, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 9.20% (1.0594 => 1.1569, std.dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: 9.08% (1.2749 => 1.3907, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: 9.01% (0.3131 => 0.3413, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 8.87% (8.4961 => 9.2497, std.dev.: 0.0180) MultiSource/Applications/oggenc/oggenc: 8.85% (4.6629 => 5.0757, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.80% (0.8818 => 0.9594, std.dev.: 0.0100) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.55% (1.1333 => 1.2302, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.55% (1.5188 => 1.6486, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 8.50% (3.7467 => 4.0650, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.41% (0.9108 => 0.9874, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: 8.38% (0.1385 => 0.1501, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 8.22% (0.6250 => 0.6764, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.18% (3.2742 => 3.5420, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 8.13% (6.5754 => 7.1098, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.07% (0.3245 => 0.3507, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.05% (0.4805 => 0.5192, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 8.02% (0.4003 => 0.4324, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 7.89% (0.3914 => 0.4223, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 7.87% (0.2008 => 0.2166, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.85% (0.2243 => 0.2419, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.83% (0.2504 => 0.2700, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.75% (2.1007 => 2.2636, std.dev.: 0.0175) SingleSource/UnitTests/ObjC/for-in: 7.73% (0.3789 => 0.4082, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.73% (6.2785 => 6.7639, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/property: 7.69% (0.3940 => 0.4243, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 7.66% (0.3578 => 0.3852, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-4: 7.65% (0.3646 => 0.3925, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.64% (0.3601 => 0.3876, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.62% (0.3663 => 0.3942, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.57% (1.2292 => 1.3222, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 7.54% (0.3623 => 0.3896, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.45% (0.3650 => 0.3922, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.36% (13.2842 => 14.2613, std.dev.: 0.0164) SingleSource/Benchmarks/Misc/ReedSolomon: 7.20% (0.1777 => 0.1905, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 5.45% (16.2614 => 17.1484, std.dev.: 0.0192) MultiSource/Applications/ClamAV/clamscan: 5.10% (14.5298 => 15.2710, std.dev.: 0.0205) MultiSource/Benchmarks/Olden/bh/bh: 4.20% (0.2859 => 0.2979, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 2.39% (33.2944 => 34.0893, std.dev.: 0.0292) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 30.61% (5.7573 => 7.5194, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/fbench: 23.87% (1.8175 => 2.2513, std.dev.: 0.0489) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.05% (1.0895 => 1.2753, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 11.05% (1.1560 => 1.2837, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.40% (0.1322 => 0.1433, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4139, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.42% (0.9692 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 5.14% (1.2998 => 1.3666, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0040, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: 4.46% (0.5449 => 0.5692, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.45% (2.8606 => 2.9880, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.86% (1.7081 => 1.7741, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 3.74% (10.7476 => 11.1496, std.dev.: 0.0458) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9859, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 3.37% (12.0921 => 12.4991, std.dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 3.21% (11.2619 => 11.6230, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bisort/bisort: 3.00% (0.8239 => 0.8486, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.39% (1.0310 => 1.0556, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.22% (7.4271 => 7.5920, std.dev.: 0.0085) MultiSource/Applications/lemon/lemon: 1.79% (1.4298 => 1.4554, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0500, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5136, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2123, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1874, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5778, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.17% (9.9194 => 10.0352, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1407, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.03% (12.4560 => 12.5846, std.dev.: 0.0062) SingleSource/Benchmarks/McGill/queens: 1.00% (2.1753 => 2.1971, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.44% (0.2670 => 0.1430, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.50% (0.4657 => 0.3935, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.57% (1.3813 => 1.2215, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.26% (1.3819 => 1.2263, std.dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.29% (1.0460 => 0.8547, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.82% (0.2238 => 0.1951, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -9.97% (20.3410 => 18.3120, std.dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.44% (1.3780 => 1.2892, std.dev.: 0.0154) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -5.84% (1.2308 => 1.1589, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5149, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.84% (1.7688 => 1.7008, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.68% (0.9996 => 0.9628, std.dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4867 => 0.4717, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -2.89% (3.2729 => 3.1784, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: -2.88% (3.0263 => 2.9392, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -2.77% (1.9762 => 1.9215, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8811, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.40% (4.1080 => 4.0094, std.dev.: 0.0035) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.08% (0.6589 => 0.6452, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.86% (0.6615 => 0.6492) SingleSource/Benchmarks/Shootout/lists: -1.79% (6.3560 => 6.2424, std.dev.: 0.0059) MultiSource/Applications/lua/lua: -1.70% (26.5159 => 26.0659, std.dev.: 0.0201) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.65% (0.8342 => 0.8204, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.64% (2.5254 => 2.4839, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0067, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.34% (3.9173 => 3.8647, std.dev.: 0.0069) MultiSource/Applications/lambda-0_1_3/lambda: -1.29% (5.3167 => 5.2482, std.dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: -1.24% (28.2225 => 27.8732, std.dev.: 0.0015) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1138, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -1.04% (84.4286 => 83.5541, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.03% (6.6320 => 6.5639, std.dev.: 0.0054) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 20 17:33:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 20 Oct 2012 19:33:06 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121021003306.B22A12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5049?compare_to=5046&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5049, Order: 166382, Start Time: 2012-10-20 23:11:48, End Time: 2012-10-21 00:35:07 To: 5046, Order: 166379, Start Time: 2012-10-20 21:11:47, End Time: 2012-10-20 22:35:04 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 7 (18 on baseline) Performance Improvements: 7 (6 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 961 (950 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.61% (0.8318 => 0.8452, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/football/football: 1.35% (0.8650 => 0.8767, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.19% (1.1783 => 1.1923, std.dev.: 0.0050) MultiSource/Applications/JM/ldecod/ldecod: 1.03% (6.7297 => 6.7988, std.dev.: 0.0145) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 7.38% (21.1777 => 22.7407, std.dev.: 0.4735) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.61% (59.9024 => 60.8685, std.dev.: 0.2834) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.34% (1.6061 => 1.6277, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.05% (0.2199 => 0.2044, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -3.59% (0.5019 => 0.4839, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -3.40% (0.5912 => 0.5711, std.dev.: 0.0062) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.15% (0.3304 => 0.3200, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -2.03% (0.8768 => 0.8590, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.04% (1.2700 => 1.2568, std.dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -2.42% (2.6454 => 2.5815, std.dev.: 0.0052) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.13% (16.4579 => 16.4797, std.dev.: 0.1152) MultiSource/Applications/obsequi/Obsequi: -1.83% (1.0464 => 1.0272, std.dev.: 0.0117) MultiSource/Applications/sqlite3/sqlite3: 0.22% (0.6357 => 0.6371, std.dev.: 0.0073) MultiSource/Benchmarks/McCat/08-main/main: -8.09% (0.1917 => 0.1762, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.05% (0.1673 => 0.1622, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.58% (0.3250 => 0.3231, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.36% (0.2384 => 0.2488, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.96% (0.3335 => 0.3367, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.34% (0.2313 => 0.2344, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 0.13% (0.5958 => 0.5966, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/mandel: 16.31% (0.0423 => 0.0492, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.15% (0.3308 => 0.3303, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/strcat: 0.81% (0.1979 => 0.1995, std.dev.: 0.0047) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.24% (0.0242 => 0.0239, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -11.63% (0.0172 => 0.0152, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.50% (0.0400 => 0.0418, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.12% (0.0282 => 0.0245, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.97% (0.0309 => 0.0306, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.42% (0.0422 => 0.0416, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -39.50% (0.0200 => 0.0121, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/test1: 46.53% (0.0144 => 0.0211, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: -3.61% (0.0332 => 0.0320, std.dev.: 0.0017) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -1.08% (0.1488 => 0.1472, std.dev.: 0.0053) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -3.90% (1.1612 => 1.1159, std.dev.: 0.0781) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -4.49% (0.1513 => 0.1445, std.dev.: 0.0073) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.42% (0.4075 => 0.4058, std.dev.: 0.0172) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.49% (0.1415 => 0.1408, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.78% (0.0611 => 0.0628, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 14.95% (0.0214 => 0.0246, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.06% (0.0535 => 0.0546, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.31% (1.1375 => 1.1524, std.dev.: 0.0451) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.77% (0.0031 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -50.00% (0.0002 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.76% (0.0580 => 0.0596, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -9.84% (0.0193 => 0.0174, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.59% (0.8012 => 0.7965, std.dev.: 0.0109) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: -85.71% (0.0007 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 42.31% (0.0052 => 0.0074, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.25% (2.1832 => 1.6537, std.dev.: 0.0095) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.13% (0.3295 => 0.3398, std.dev.: 0.0019) MultiSource/Applications/Burg/burg: 2.30% (1.2222 => 1.2503, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.04% (1.1685 => 1.1923, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.64% (0.8316 => 0.8452, std.dev.: 0.0047) MultiSource/Applications/spiff/spiff: 1.60% (0.7950 => 0.8077, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.42% (1.4479 => 1.4684, std.dev.: 0.0045) MultiSource/Applications/siod/siod: 1.40% (2.2184 => 2.2494, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 1.15% (3.2366 => 3.2738, std.dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.99% (1.5795 => 2.5113, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.95% (0.3186 => 0.3471, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.55% (1.1857 => 1.2871, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 5.92% (63.1822 => 66.9230, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.17% (0.7597 => 0.7838, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.71% (59.2638 => 60.8685, std.dev.: 0.2834) MultiSource/Applications/siod/siod: 2.69% (3.6643 => 3.7630, std.dev.: 0.0311) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.11% (1.5941 => 1.6277, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 1.97% (0.6205 => 0.6327, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: 1.77% (2.3560 => 2.3977, std.dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -1.39% (1.2602 => 1.2427, std.dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.56% (0.3269 => 0.3022, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -4.96% (29.8330 => 28.3541, std.dev.: 0.0365) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.99% (3.9188 => 3.7623, std.dev.: 0.0539) SingleSource/Benchmarks/Shootout-C++/hash2: -1.35% (3.4237 => 3.3776, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.30% (3.3479 => 3.3043, std.dev.: 0.0094) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.20% (16.4461 => 16.4797, std.dev.: 0.1152) MultiSource/Applications/obsequi/Obsequi: 0.10% (1.0262 => 1.0272, std.dev.: 0.0117) MultiSource/Applications/sqlite3/sqlite3: 0.62% (0.6332 => 0.6371, std.dev.: 0.0073) MultiSource/Benchmarks/McCat/08-main/main: -3.77% (0.1831 => 0.1762, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.04% (0.1559 => 0.1622, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.46% (0.3123 => 0.3231, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.02% (0.2463 => 0.2488, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.69% (0.3344 => 0.3367, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.85% (0.2364 => 0.2344, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: -0.73% (0.6010 => 0.5966, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/mandel: 14.69% (0.0429 => 0.0492, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.13% (0.3266 => 0.3303, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/strcat: 1.32% (0.1969 => 0.1995, std.dev.: 0.0047) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.70% (0.0224 => 0.0239, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 23.58% (0.0123 => 0.0152, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.45% (0.0408 => 0.0418, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -3.54% (0.0254 => 0.0245, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.32% (0.0302 => 0.0306, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 8.33% (0.0384 => 0.0416, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -36.32% (0.0190 => 0.0121, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/test1: 17.22% (0.0180 => 0.0211, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: 39.13% (0.0230 => 0.0320, std.dev.: 0.0017) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 2.36% (0.1438 => 0.1472, std.dev.: 0.0053) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -1.50% (1.1329 => 1.1159, std.dev.: 0.0781) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.16% (0.1462 => 0.1445, std.dev.: 0.0073) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.55% (0.4164 => 0.4058, std.dev.: 0.0172) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.85% (0.1369 => 0.1408, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.03% (0.0641 => 0.0628, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 26.15% (0.0195 => 0.0246, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.54% (0.0578 => 0.0546, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.76% (1.1437 => 1.1524, std.dev.: 0.0451) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.94% (0.0627 => 0.0596, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.33% (0.0180 => 0.0174, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.65% (0.8017 => 0.7965, std.dev.: 0.0109) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 19.35% (0.0062 => 0.0074, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 20 17:42:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 20 Oct 2012 19:42:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121021004213.CB2D92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5050?compare_to=5047&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5050, Order: 166382, Start Time: 2012-10-20 23:24:10, End Time: 2012-10-21 00:44:14 To: 5047, Order: 166379, Start Time: 2012-10-20 21:24:11, End Time: 2012-10-20 22:44:08 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (83 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 1 (184 on baseline) Performance Improvements: 0 (44 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 98 (15 on baseline) Unchanged Tests: 943 (650 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.37% (1.0924 => 1.1074, std.dev.: 0.0051) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.06% (0.4849 => 0.4846, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 0.07% (17.1965 => 17.2078, std.dev.: 0.0058) MultiSource/Benchmarks/Bullet/bullet: -0.01% (56.0454 => 56.0412, std.dev.: 0.0178) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -0.40% (0.2529 => 0.2519, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 0.12% (4.5768 => 4.5821, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.07% (15.2445 => 15.2340, std.dev.: 0.0140) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -0.03% (3.5775 => 3.5765, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.42% (0.0481 => 0.0479, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0481 => 0.0481, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0450 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.22% (0.0450 => 0.0451, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0439 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0441 => 0.0441, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0433 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.23% (0.0434 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.22% (0.0452 => 0.0451) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.22% (0.0453 => 0.0452, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0445 => 0.0445, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0446 => 0.0446, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0435 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0437 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0443 => 0.0443, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0444 => 0.0444, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.22% (0.0454 => 0.0453, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0455 => 0.0455, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0431 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0432 => 0.0432, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0443 => 0.0443, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.23% (0.0443 => 0.0444, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0434 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0435 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.23% (0.0427 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.70% (0.0430 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.24% (0.0425 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0426 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0462 => 0.0462) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.43% (0.0465 => 0.0463, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.24% (0.0424 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0425 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.23% (0.0426 => 0.0425, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0426 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.23% (0.0432 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0434 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 0.36% (1.1101 => 1.1141, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.04% (3.5765 => 3.5752, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.02% (1.3051 => 1.3048, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.03% (8.1873 => 8.1850, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.04% (0.7753 => 0.7756, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.84% (0.0356 => 0.0353, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/Bullet/bullet: -11.39% (63.2438 => 56.0412, std.dev.: 0.0178) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.92% (0.2271 => 0.2519, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.04% (14.3668 => 15.2340, std.dev.: 0.0140) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -33.18% (5.3526 => 3.5765, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -0.47% (1.1194 => 1.1141, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.61% (5.3855 => 3.5752, std.dev.: 0.0045) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -99.94% (0.1639 => 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -99.97% (0.3987 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -100.00% (2.6778 => 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -99.80% (0.0506 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 35.96% (14.1553 => 19.2462, std.dev.: 0.0157) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.69% (3.4629 => 5.7722, std.dev.: 0.0069) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13490.69% (0.0720 => 9.7853, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049300.00% (0.0001 => 10.0494, std.dev.: 0.0015) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.63% (0.2554 => 0.4179, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/lowercase: 55.47% (0.0256 => 0.0398, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 52.67% (10.3673 => 15.8282, std.dev.: 0.0103) SingleSource/UnitTests/SignlessTypes/factor: 44.93% (0.0296 => 0.0429, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 40.73% (1.5859 => 2.2319, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 38.41% (0.1622 => 0.2245, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 36.55% (0.1056 => 0.1442, std.dev.: 0.0003) SingleSource/UnitTests/vla: 32.11% (0.0355 => 0.0469, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 29.67% (2.2024 => 2.8559, std.dev.: 0.0165) MultiSource/Benchmarks/FreeBench/neural/neural: 26.04% (0.1463 => 0.1844, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 25.66% (0.0834 => 0.1048, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.63% (0.1566 => 0.1889, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: 20.55% (0.2049 => 0.2470, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 20.39% (0.1432 => 0.1724, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.31% (7.0540 => 8.4163, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.39% (2.2022 => 2.6072, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.14% (0.0871 => 0.1029, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 17.94% (0.1555 => 0.1834, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.44% (0.0648 => 0.0761, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.41% (0.5105 => 0.5994, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 16.87% (0.6675 => 0.7801, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 16.50% (0.1655 => 0.1928, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.36% (1.3050 => 1.5185, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 16.20% (3.3354 => 3.8757, std.dev.: 0.0053) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.15% (0.3121 => 0.3625, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/power/power: 15.90% (0.1440 => 0.1669, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 15.69% (0.1695 => 0.1961, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 15.54% (0.0798 => 0.0922, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 15.49% (0.1175 => 0.1357, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.45% (0.0770 => 0.0889, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.30% (0.1510 => 0.1741, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.28% (1.5415 => 1.7771, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 15.26% (0.0793 => 0.0914, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.21% (0.1032 => 0.1189, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.19% (0.8172 => 0.9413, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.18% (0.1337 => 0.1540, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.14% (0.5020 => 0.5780, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/mst/mst: 15.13% (0.1163 => 0.1339, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.04% (0.0838 => 0.0964, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.01% (0.0886 => 0.1019, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 14.81% (0.7115 => 0.8169, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.79% (0.1940 => 0.2227, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 14.66% (0.3282 => 0.3763, std.dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: 14.60% (0.3109 => 0.3563, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.49% (0.0842 => 0.0964, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.34% (0.0746 => 0.0853, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.33% (4.2646 => 4.8759, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.25% (0.2758 => 0.3151, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/18-imp/imp: 14.23% (0.3423 => 0.3910, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.18% (0.9765 => 1.1150, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/exptree: 14.13% (0.0814 => 0.0929, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.08% (0.1584 => 0.1807, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.07% (1.7609 => 2.0087, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/matrix: 14.06% (0.0818 => 0.0933, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 13.94% (9.4845 => 10.8063, std.dev.: 0.0119) MultiSource/Applications/Burg/burg: 13.93% (1.1642 => 1.3264, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.80% (0.4615 => 0.5252, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.75% (0.1236 => 0.1406, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 13.75% (0.6450 => 0.7337, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.72% (0.2107 => 0.2396, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.71% (8.1363 => 9.2514, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 13.66% (5.7591 => 6.5460, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 13.64% (0.1151 => 0.1308, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.61% (0.1117 => 0.1269, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.57% (0.5860 => 0.6655, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.56% (0.1438 => 0.1633, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.48% (0.1906 => 0.2163, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.46% (1.4186 => 1.6096, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.29% (0.0933 => 0.1057, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 13.21% (0.7835 => 0.8870, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.20% (0.8067 => 0.9132, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.17% (0.2065 => 0.2337, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.12% (0.1029 => 0.1164, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.04% (0.1695 => 0.1916, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 12.99% (2.0273 => 2.2906, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 12.98% (0.7433 => 0.8398, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.92% (0.0929 => 0.1049, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.90% (0.1062 => 0.1199, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.89% (0.2700 => 0.3048, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 12.84% (1.1840 => 1.3360, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.83% (0.4879 => 0.5505, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/rem: 12.76% (0.1144 => 0.1290, std.dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: 12.76% (10.4361 => 11.7675, std.dev.: 0.0178) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.69% (5.0018 => 5.6367, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.69% (0.5981 => 0.6740, std.dev.: 0.0032) MultiSource/Applications/lemon/lemon: 12.66% (1.0722 => 1.2079, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.64% (4.9449 => 5.5697, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 12.61% (0.3387 => 0.3814, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 12.56% (0.4299 => 0.4839, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.43% (0.1625 => 0.1827, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 12.40% (0.3177 => 0.3571, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 12.33% (3.8723 => 4.3496, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/health/health: 12.22% (0.1268 => 0.1423, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.11% (0.1330 => 0.1491, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.10% (0.3307 => 0.3707, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 12.05% (0.8921 => 0.9996, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.02% (7.9617 => 8.9190, std.dev.: 0.0100) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.02% (1.1861 => 1.3287, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.01% (0.5569 => 0.6238, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.99% (0.2603 => 0.2915, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.55% (0.1143 => 0.1275, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 11.51% (1.5603 => 1.7399, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.51% (0.3441 => 0.3837, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/09-vor/vor: 11.42% (0.3180 => 0.3543, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/parameter-passing: 11.41% (0.3927 => 0.4375, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 11.34% (0.3473 => 0.3867, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.29% (0.1125 => 0.1252, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 11.26% (0.3543 => 0.3942, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.23% (0.3561 => 0.3961, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.21% (0.3497 => 0.3889, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.21% (0.3543 => 0.3940, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.15% (0.3516 => 0.3908, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.07% (0.3694 => 0.4103, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.05% (0.3828 => 0.4251, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 11.03% (0.3092 => 0.3433, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 10.92% (0.6456 => 0.7161, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.89% (0.3886 => 0.4309, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.81% (0.2266 => 0.2511, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.78% (0.1892 => 0.2096, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.53% (0.8101 => 0.8954, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 10.47% (2.2969 => 2.5374, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 10.05% (0.4289 => 0.4720, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 9.87% (0.4620 => 0.5076, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 9.81% (21.9371 => 24.0890, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.75% (0.3826 => 0.4199, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 9.56% (0.3422 => 0.3749, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.37% (0.3865 => 0.4227, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.21% (0.4103 => 0.4481, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.11% (0.4203 => 0.4586, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/moments: 8.99% (0.4048 => 0.4412, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.99% (0.3427 => 0.3735, std.dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.93% (0.4636 => 0.5050, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference-object: 8.82% (0.6030 => 0.6562, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 8.82% (0.3684 => 0.4009, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.81% (0.5925 => 0.6447, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.71% (0.7326 => 0.7964, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 8.22% (0.3603 => 0.3899, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 8.12% (17.1811 => 18.5756, std.dev.: 0.0137) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.94% (0.2430 => 0.2623, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.75% (0.3650 => 0.3933, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.69% (3.8922 => 4.1914, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/matrix: 7.68% (0.3098 => 0.3336, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 7.63% (0.2831 => 0.3047, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.58% (0.2891 => 0.3110, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.53% (0.4064 => 0.4370, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.52% (0.3232 => 0.3475, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 7.49% (0.3283 => 0.3529, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.44% (0.2905 => 0.3121, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.36% (2.0665 => 2.2186, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.24% (0.3162 => 0.3391, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.14% (0.3136 => 0.3360, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.14% (0.2871 => 0.3076, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.11% (0.2756 => 0.2952, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.09% (0.2793 => 0.2991, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.07% (0.2872 => 0.3075, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.05% (0.2725 => 0.2917, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: 6.98% (0.3379 => 0.3615, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 6.92% (0.2877 => 0.3076, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.88% (0.3052 => 0.3262, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.74% (0.2714 => 0.2897, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 6.71% (0.2802 => 0.2990, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 6.32% (1.2842 => 1.3653, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.72% (0.3131 => 0.3310, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.62% (0.3817 => 0.3955, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.95% (0.3935 => 0.4051, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 11.22% (0.9957 => 1.1074, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/richards_benchmark: 9.79% (1.1396 => 1.2512, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.1578 => 3.3686, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 5.93% (1.9405 => 2.0555, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.56% (4.2280 => 4.3361, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.32% (1.0313 => 1.0552, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.24% (3.6395 => 3.7209, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2077, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.51% (2.6546 => 2.6947, std.dev.: 0.0015) MultiSource/Applications/viterbi/viterbi: 1.17% (4.4649 => 4.5173, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 1.10% (9.1159 => 9.2163, std.dev.: 0.0228) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.97% (6.6874 => 0.1357, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -79.84% (0.8651 => 0.1744, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.77% (5.2763 => 3.2309, std.dev.: 0.0082) SingleSource/UnitTests/Vector/constpool: -14.59% (54.1659 => 46.2617, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.26% (2.9384 => 2.6368, std.dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: -6.45% (22.1758 => 20.7453, std.dev.: 0.0275) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.09% (8.0499 => 3.7761, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.49% (1.1492 => 0.7643, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.64% (2.9695 => 2.4753, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.80% (1.6925 => 1.4251, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.70% (1.2258 => 1.0701, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -12.12% (1.2373 => 1.0874, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3453 => 2.9599, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3735, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.17% (19.9488 => 18.3189, std.dev.: 0.0127) MultiSource/Benchmarks/FreeBench/mason/mason: -7.73% (0.2161 => 0.1994, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.00% (1.8329 => 1.7046, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.17% (1.6805 => 1.5937, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -5.00% (1.5835 => 1.5043, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.39% (8.1563 => 7.7981, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1624, std.dev.: 0.0024) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8776, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4979, std.dev.: 0.0098) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.68% (0.4808 => 0.4679, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0862, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6818, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -1.60% (2.5528 => 2.5119, std.dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4216, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: -1.45% (4.6441 => 4.5767, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/lists: -1.12% (6.2999 => 6.2295, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2879, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -7.32% (0.5229 => 0.4846, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 14.80% (14.9895 => 17.2078, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/gs/gs: 11.47% (4.1105 => 4.5821, std.dev.: 0.0097) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.10% (1.1048 => 1.3048, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.34% (7.1582 => 8.1850, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.65% (0.6222 => 0.7756, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35200.00% (0.0001 => 0.0353, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -99.95% (0.2116 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 20 17:48:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 20 Oct 2012 19:48:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121021004821.E26E32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5051?compare_to=5048&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5051, Order: 166382, Start Time: 2012-10-20 23:25:18, End Time: 2012-10-21 00:51:19 To: 5048, Order: 166379, Start Time: 2012-10-20 21:25:26, End Time: 2012-10-20 22:51:31 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (202 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1041 (663 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.07% (0.9628 => 0.9525, std.dev.: 0.0038) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.88% (2.0176 => 2.4994, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.28% (0.1410 => 0.1710, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 18.40% (0.0826 => 0.0978, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 18.32% (0.2243 => 0.2654, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 17.57% (0.1013 => 0.1191, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.89% (0.0746 => 0.0872, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.84% (0.7710 => 0.9008, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.54% (0.0653 => 0.0761, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.14% (0.0819 => 0.0943, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.91% (0.2596 => 0.2983, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 14.88% (0.2721 => 0.3126, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.87% (0.0834 => 0.0958, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.43% (0.0811 => 0.0928, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.37% (0.1413 => 0.1616, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.29% (0.0847 => 0.0968, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 14.26% (1.3693 => 1.5645, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.21% (0.0725 => 0.0828, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 14.16% (0.1003 => 0.1145, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.14% (0.1075 => 0.1227, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.08% (0.9199 => 1.0494, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.05% (0.1986 => 0.2265, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.89% (3.9660 => 4.5169, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.89% (0.0720 => 0.0820, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.87% (0.6959 => 0.7924, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.78% (0.5637 => 0.6414, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.72% (0.1327 => 0.1509, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 13.63% (0.7038 => 0.7997, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.59% (0.0964 => 0.1095) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.53% (0.1072 => 0.1217, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 13.50% (0.1111 => 0.1261, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.48% (0.1588 => 0.1802, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.41% (0.5265 => 0.5971, std.dev.: 0.0013) MultiSource/Applications/aha/aha: 13.37% (0.1062 => 0.1204, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.21% (0.2914 => 0.3299, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 13.20% (0.7460 => 0.8445, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.00% (0.0977 => 0.1104, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.93% (0.1276 => 0.1441, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 12.79% (0.1478 => 0.1667, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 12.75% (0.4328 => 0.4880, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 12.70% (0.4062 => 0.4578, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 12.66% (1.1061 => 1.2461, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.62% (0.1014 => 0.1142, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 12.59% (0.0818 => 0.0921, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.38% (1.2193 => 1.3703, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.38% (1.4563 => 1.6366, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.35% (0.5577 => 0.6266, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.29% (1.1364 => 1.2761, std.dev.: 0.0051) MultiSource/Applications/SPASS/SPASS: 12.27% (13.8202 => 15.5158, std.dev.: 0.0141) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.21% (0.2023 => 0.2270, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.11% (0.3246 => 0.3639, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.10% (0.6283 => 0.7043, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.06% (0.1865 => 0.2090, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.06% (0.4379 => 0.4907, std.dev.: 0.0037) SingleSource/UnitTests/ObjC++/property-reference-object: 11.93% (0.5818 => 0.6512, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 11.92% (0.7506 => 0.8401, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.85% (0.2127 => 0.2379, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.84% (0.1157 => 0.1294, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/em3d/em3d: 11.77% (0.1657 => 0.1852, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 11.64% (0.5748 => 0.6417, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.60% (0.3130 => 0.3493, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 11.57% (3.8646 => 4.3118, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: 11.52% (0.2925 => 0.3262, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 11.45% (0.2995 => 0.3338, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.41% (0.3899 => 0.4344, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.35% (0.1048 => 0.1167, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 11.32% (0.7061 => 0.7860, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.31% (0.4791 => 0.5333, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 11.24% (1.0313 => 1.1472, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.18% (0.1789 => 0.1989, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 11.15% (0.3220 => 0.3579, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.13% (0.3485 => 0.3873, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.05% (0.3756 => 0.4171, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.05% (0.4390 => 0.4875, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 10.97% (1.9270 => 2.1383, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.96% (7.2180 => 8.0090, std.dev.: 0.0089) SingleSource/Regression/C++/ofstream_ctor: 10.93% (0.2781 => 0.3085, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.93% (0.4016 => 0.4455, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 10.90% (0.3293 => 0.3652, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 10.88% (0.1213 => 0.1345, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.85% (0.3022 => 0.3350, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 10.82% (0.1589 => 0.1761, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.82% (0.2782 => 0.3083, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.81% (0.3489 => 0.3866, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 10.77% (0.6744 => 0.7470, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 10.75% (0.2726 => 0.3019, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 10.69% (0.2760 => 0.3055, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 10.65% (0.3868 => 0.4280, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.61% (0.3580 => 0.3960, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.59% (0.1435 => 0.1587, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 10.57% (3.1889 => 3.5261, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 10.54% (0.3453 => 0.3817, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.52% (0.1569 => 0.1734, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 10.49% (16.6129 => 18.3556, std.dev.: 0.0167) MultiSource/Benchmarks/Prolangs-C/football/football: 10.47% (0.8310 => 0.9180, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.43% (1.9828 => 2.1897, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.43% (0.2655 => 0.2932, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.42% (0.2140 => 0.2363, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 10.36% (0.2761 => 0.3047, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 10.36% (0.2607 => 0.2877, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 10.35% (0.3149 => 0.3475, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.34% (0.8698 => 0.9597, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 10.30% (2.1791 => 2.4035, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 10.30% (0.2690 => 0.2967, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 10.27% (0.3107 => 0.3426, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 10.24% (0.3534 => 0.3896, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.16% (1.3245 => 1.4591, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/fibo: 10.12% (0.2628 => 0.2894, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 10.12% (0.3192 => 0.3515, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.11% (0.2966 => 0.3266, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 10.11% (0.2937 => 0.3234, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.05% (0.2765 => 0.3043, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 10.05% (3.6692 => 4.0379, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.94% (4.4433 => 4.8851, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.87% (4.3801 => 4.8125, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/matrix: 9.74% (0.2988 => 0.3279, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 9.73% (0.4113 => 0.4513, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.72% (0.2696 => 0.2958, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.71% (4.9865 => 5.4705, std.dev.: 0.0224) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.69% (0.6576 => 0.7213, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.56% (0.2321 => 0.2543, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 9.47% (0.2945 => 0.3224, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.45% (0.3755 => 0.4110, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.40% (0.1819 => 0.1990, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.40% (0.3511 => 0.3841, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.29% (0.6135 => 0.6705, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 9.21% (1.0594 => 1.1570, std.dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 9.20% (14.8535 => 16.2204, std.dev.: 0.0155) MultiSource/Applications/SIBsim4/SIBsim4: 9.00% (1.2749 => 1.3897, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 8.94% (0.3131 => 0.3411, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 8.82% (4.6629 => 5.0740, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.79% (0.8818 => 0.9593, std.dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 8.78% (8.4961 => 9.2417, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.55% (1.1333 => 1.2302, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.45% (1.5188 => 1.6471, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 8.38% (0.1385 => 0.1501, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 8.35% (0.6250 => 0.6772, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.32% (0.9108 => 0.9866, std.dev.: 0.0055) MultiSource/Applications/lua/lua: 8.28% (3.7467 => 4.0571, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.14% (0.3245 => 0.3509, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/parameter-passing: 8.12% (0.4003 => 0.4328, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.06% (3.2742 => 3.5382, std.dev.: 0.0066) MultiSource/Applications/JM/ldecod/ldecod: 8.05% (6.5754 => 7.1050, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 8.05% (0.3914 => 0.4229, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.95% (0.4805 => 0.5187, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 7.89% (0.3789 => 0.4088, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 7.88% (0.3578 => 0.3860, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 7.87% (0.2008 => 0.2166, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.87% (0.3940 => 0.4250, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 7.84% (0.3663 => 0.3950, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.83% (0.3601 => 0.3883, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 7.79% (0.3646 => 0.3930, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.79% (0.2504 => 0.2699, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.74% (6.2785 => 6.7642, std.dev.: 0.0088) SingleSource/UnitTests/ObjC/exceptions-3: 7.65% (0.3623 => 0.3900, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.63% (2.1007 => 2.2609, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.59% (0.3650 => 0.3927, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.58% (0.2243 => 0.2413, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 7.54% (1.2292 => 1.3219, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.35% (13.2842 => 14.2610, std.dev.: 0.0203) SingleSource/Benchmarks/Misc/ReedSolomon: 6.02% (0.1777 => 0.1884, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 5.30% (16.2614 => 17.1237, std.dev.: 0.0252) MultiSource/Applications/ClamAV/clamscan: 5.12% (14.5298 => 15.2730, std.dev.: 0.0196) MultiSource/Benchmarks/Olden/bh/bh: 3.95% (0.2859 => 0.2972, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 2.44% (33.2944 => 34.1081, std.dev.: 0.0117) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.55% (5.7573 => 7.5162, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/fbench: 24.43% (1.8175 => 2.2615, std.dev.: 0.0425) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.02% (1.0895 => 1.2749, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 11.09% (1.1560 => 1.2842, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.03% (0.8273 => 0.9020) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4139, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.43% (0.9692 => 1.0218) SingleSource/Benchmarks/Misc/mandel-2: 5.37% (1.2998 => 1.3696, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0039, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.46% (2.8606 => 2.9882, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 4.40% (0.5449 => 0.5689, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.38% (12.0921 => 12.5006, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.36% (10.7476 => 11.1082, std.dev.: 0.0249) SingleSource/Benchmarks/Misc/flops-6: 3.32% (1.9199 => 1.9837, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.22% (11.2619 => 11.6249, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 2.95% (0.8239 => 0.8482, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0310 => 1.0559, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.18% (7.4271 => 7.5888, std.dev.: 0.0036) MultiSource/Applications/lemon/lemon: 1.65% (1.4298 => 1.4534, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5141, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.25% (9.0760 => 9.1893, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5788, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.17% (9.9194 => 10.0355, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.09% (12.4560 => 12.5915, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.07% (8.8259 => 8.9201, std.dev.: 0.0136) SingleSource/Benchmarks/McGill/queens: 1.01% (2.1753 => 2.1973, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.44% (0.2670 => 0.1430, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.37% (0.4657 => 0.3941, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.41% (1.3813 => 1.2237, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.30% (1.3819 => 1.2258, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.28% (1.0460 => 0.8548, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -13.00% (0.2238 => 0.1947, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.09% (20.3410 => 18.2887, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.24% (1.3780 => 1.2920, std.dev.: 0.0223) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2647, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -5.77% (1.2308 => 1.1598, std.dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5136, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.71% (0.9996 => 0.9525, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.87% (1.7688 => 1.7003, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.04% (0.4867 => 0.4719, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.92% (3.0263 => 2.9380, std.dev.: 0.0121) MultiSource/Applications/siod/siod: -2.88% (3.2729 => 3.1785, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: -2.74% (1.9762 => 1.9221, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8813, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.28% (4.1080 => 4.0142, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.05% (0.6589 => 0.6454, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.86% (0.6615 => 0.6492, std.dev.: 0.0013) MultiSource/Applications/lua/lua: -1.70% (26.5159 => 26.0656, std.dev.: 0.0311) SingleSource/Benchmarks/Shootout/lists: -1.67% (6.3560 => 6.2496, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.65% (0.8342 => 0.8204, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.64% (2.5254 => 2.4839, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0070, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -1.24% (28.2225 => 27.8739, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -1.18% (5.3167 => 5.2538, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/heapsort: -1.14% (3.9173 => 3.8725, std.dev.: 0.0039) MultiSource/Applications/aha/aha: -1.08% (3.1476 => 3.1136, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -1.05% (84.4286 => 83.5438, std.dev.: 0.0048) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 4.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 20 20:06:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 20 Oct 2012 22:06:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121021030608.1F1B72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5052?compare_to=5050&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5052, Order: 166383, Start Time: 2012-10-21 01:48:13, End Time: 2012-10-21 03:08:07 To: 5050, Order: 166382, Start Time: 2012-10-20 23:24:10, End Time: 2012-10-21 00:44:14 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (83 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (183 on baseline) Performance Improvements: 1 (44 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 98 (15 on baseline) Unchanged Tests: 943 (651 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.70% (0.7964 => 0.7829, std.dev.: 0.0008) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.02% (0.4846 => 0.4847, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: -0.04% (17.2078 => 17.2005, std.dev.: 0.0172) MultiSource/Benchmarks/Bullet/bullet: 0.04% (56.0412 => 56.0619, std.dev.: 0.0199) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -0.12% (0.2519 => 0.2516, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: -0.11% (4.5821 => 4.5771, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.12% (15.2340 => 15.2520, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -0.26% (3.5765 => 3.5673, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.42% (0.0479 => 0.0481, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.21% (0.0481 => 0.0482) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.22% (0.0450 => 0.0451) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0451 => 0.0451, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.23% (0.0439 => 0.0440, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0441 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.23% (0.0433 => 0.0434) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0435 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.22% (0.0451 => 0.0452, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.22% (0.0452 => 0.0453) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.22% (0.0445 => 0.0446, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.22% (0.0446 => 0.0447) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.23% (0.0435 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0437 => 0.0437, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.23% (0.0443 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.23% (0.0444 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.22% (0.0453 => 0.0454, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0455 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0431 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0432 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0443 => 0.0443, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0444 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.23% (0.0434 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0435 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.23% (0.0426 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.23% (0.0427 => 0.0428, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.24% (0.0424 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.23% (0.0426 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0462 => 0.0462, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0463 => 0.0463, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.24% (0.0423 => 0.0424, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.24% (0.0425 => 0.0426) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.24% (0.0425 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0426 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0433 => 0.0433, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0434 => 0.0434, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -0.54% (1.1141 => 1.1081, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.33% (3.5752 => 3.5633, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (1.3048 => 1.3048, std.dev.: 0.0100) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.00% (8.1850 => 8.1849, std.dev.: 0.0145) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.01% (0.7756 => 0.7755, std.dev.: 0.0060) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.85% (0.0353 => 0.0356, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/Bullet/bullet: -11.36% (63.2438 => 56.0619, std.dev.: 0.0199) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.79% (0.2271 => 0.2516, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.16% (14.3668 => 15.2520, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -33.35% (5.3526 => 3.5673, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.01% (1.1194 => 1.1081, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.84% (5.3855 => 3.5633, std.dev.: 0.0012) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -99.94% (0.1639 => 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -99.97% (0.3987 => 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -100.00% (2.6778 => 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -99.80% (0.0506 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 35.87% (14.1553 => 19.2335, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.97% (3.4629 => 5.7821, std.dev.: 0.0027) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13489.31% (0.0720 => 9.7843, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049200.00% (0.0001 => 10.0493, std.dev.: 0.0012) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.51% (0.2554 => 0.4176, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/lowercase: 55.86% (0.0256 => 0.0399) MultiSource/Benchmarks/PAQ8p/paq8p: 53.72% (10.3673 => 15.9361, std.dev.: 0.0036) SingleSource/UnitTests/SignlessTypes/factor: 44.26% (0.0296 => 0.0427, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 40.86% (1.5859 => 2.2339, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/richards_benchmark: 38.59% (0.1622 => 0.2248, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 36.36% (0.1056 => 0.1440, std.dev.: 0.0004) SingleSource/UnitTests/vla: 31.83% (0.0355 => 0.0468, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 29.85% (2.2024 => 2.8598, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/neural/neural: 25.97% (0.1463 => 0.1843, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 25.06% (0.0834 => 0.1043, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 20.60% (0.2049 => 0.2471, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.56% (0.1566 => 0.1888, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 20.46% (0.1432 => 0.1725, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.25% (7.0540 => 8.4121, std.dev.: 0.0093) MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.45% (2.2022 => 2.6085, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.14% (0.0871 => 0.1029, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 17.81% (0.1555 => 0.1832, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.57% (0.5105 => 0.6002, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.05% (0.6675 => 0.7813, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 16.37% (0.1655 => 0.1926, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 16.29% (3.3354 => 3.8788, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.18% (1.3050 => 1.5161, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: 15.69% (0.1440 => 0.1666, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 15.58% (0.1695 => 0.1959, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 15.32% (0.1175 => 0.1355, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.23% (1.5415 => 1.7762, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/mst/mst: 15.22% (0.1163 => 0.1340) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.12% (0.1032 => 0.1188, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.04% (0.0838 => 0.0964, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 15.01% (0.0793 => 0.0912, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.98% (0.5020 => 0.5772, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.97% (0.1510 => 0.1736, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.96% (0.1337 => 0.1537, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 14.91% (0.7115 => 0.8176, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 14.72% (0.3282 => 0.3765, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.67% (0.0886 => 0.1016, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 14.62% (0.8172 => 0.9367, std.dev.: 0.0028) MultiSource/Applications/sgefa/sgefa: 14.51% (0.3109 => 0.3560, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 14.46% (0.3423 => 0.3918, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.32% (4.2646 => 4.8752, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.23% (0.1940 => 0.2216, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.21% (0.0746 => 0.0852, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.14% (0.1584 => 0.1808, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 14.13% (0.0814 => 0.0929, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.06% (0.9765 => 1.1138, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/matrix: 14.06% (0.0818 => 0.0933, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.01% (0.0842 => 0.0960, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 13.93% (9.4845 => 10.8057, std.dev.: 0.0075) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.87% (0.3121 => 0.3554, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 13.82% (1.1642 => 1.3251, std.dev.: 0.0121) MultiSource/Applications/oggenc/oggenc: 13.80% (5.7591 => 6.5536, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.78% (1.7609 => 2.0036, std.dev.: 0.0016) MultiSource/Applications/aha/aha: 13.73% (0.1151 => 0.1309, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 13.63% (0.6450 => 0.7329, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.59% (0.1236 => 0.1404, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.57% (0.2107 => 0.2393, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.52% (0.1117 => 0.1268, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.48% (0.5860 => 0.6650, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.47% (8.1363 => 9.2322, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.42% (0.2758 => 0.3128, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.38% (0.0770 => 0.0873, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.33% (0.1906 => 0.2160, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.29% (1.4186 => 1.6071, std.dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.28% (0.1438 => 0.1629, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.26% (0.4615 => 0.5227, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.18% (0.0933 => 0.1056, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.16% (0.1695 => 0.1918, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 13.13% (0.7835 => 0.8864, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.02% (0.1029 => 0.1163, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 12.91% (2.0273 => 2.2891, std.dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 12.89% (1.1840 => 1.3366, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 12.88% (0.2065 => 0.2331, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 12.83% (10.4361 => 11.7751, std.dev.: 0.0136) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.81% (0.1062 => 0.1198, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.77% (0.4879 => 0.5502, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 12.75% (0.7433 => 0.8381, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 12.75% (1.0722 => 1.2089, std.dev.: 0.0138) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.70% (0.2700 => 0.3043, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.70% (0.0929 => 0.1047, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 12.70% (0.3387 => 0.3817, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.66% (0.0798 => 0.0899, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.59% (0.5981 => 0.6734, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.53% (4.9449 => 5.5647, std.dev.: 0.0161) SingleSource/UnitTests/SignlessTypes/rem: 12.50% (0.1144 => 0.1287, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.42% (5.0018 => 5.6230, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.37% (0.8067 => 0.9065, std.dev.: 0.0032) MultiSource/Applications/lua/lua: 12.26% (3.8723 => 4.3471, std.dev.: 0.0127) MultiSource/Benchmarks/McCat/05-eks/eks: 12.24% (0.4299 => 0.4825, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/health/health: 12.22% (0.1268 => 0.1423) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 12.15% (0.3177 => 0.3563, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.12% (0.1625 => 0.1822, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.06% (1.1861 => 1.3292, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.95% (0.1330 => 0.1489, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.91% (0.3307 => 0.3701, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.91% (0.2603 => 0.2913, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.85% (0.5569 => 0.6229, std.dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.84% (7.9617 => 8.9042, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/football/football: 11.77% (0.8921 => 0.9971, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 11.51% (0.3180 => 0.3546, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.33% (0.3441 => 0.3831, std.dev.: 0.0029) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.29% (0.1143 => 0.1272, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.20% (0.1125 => 0.1251, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 11.14% (1.5603 => 1.7341, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 11.00% (0.3092 => 0.3432, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 10.84% (0.6456 => 0.7156, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.74% (0.3473 => 0.3846, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.64% (0.2266 => 0.2507, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.56% (0.3543 => 0.3917, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.54% (0.3927 => 0.4341, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.50% (0.8101 => 0.8952, std.dev.: 0.0060) MultiSource/Applications/siod/siod: 10.49% (2.2969 => 2.5378, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 10.47% (0.3561 => 0.3934, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.42% (0.3828 => 0.4227, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.40% (0.3694 => 0.4078, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.38% (0.3516 => 0.3881, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 10.38% (0.3497 => 0.3860, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.36% (0.3543 => 0.3910, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.31% (0.1892 => 0.2087, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.29% (0.3886 => 0.4286, std.dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: 9.85% (21.9371 => 24.0974, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/hash: 9.68% (0.4289 => 0.4704, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 9.65% (0.4620 => 0.5066, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.36% (0.3826 => 0.4184, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.34% (0.4636 => 0.5069, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.24% (0.3865 => 0.4222, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.16% (0.3427 => 0.3741, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 9.15% (0.3422 => 0.3735, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.95% (0.4203 => 0.4579, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.65% (0.4103 => 0.4458, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 8.62% (0.4048 => 0.4397, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 8.47% (0.3684 => 0.3996, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 8.13% (17.1811 => 18.5784, std.dev.: 0.0175) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.11% (0.2430 => 0.2627, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 7.88% (0.3603 => 0.3887, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.76% (3.8922 => 4.1941, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.67% (0.3650 => 0.3930, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 7.43% (0.6030 => 0.6478, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.38% (0.4064 => 0.4364, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 7.31% (0.2831 => 0.3038, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.29% (0.5925 => 0.6357, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary3: 7.28% (0.3283 => 0.3522, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 7.26% (0.3098 => 0.3323, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.24% (0.3232 => 0.3466, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.16% (0.2891 => 0.3098, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.13% (0.2905 => 0.3112, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.90% (2.0665 => 2.2091, std.dev.: 0.0133) SingleSource/UnitTests/ObjC++/property-reference: 6.87% (0.7326 => 0.7829, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.86% (0.3162 => 0.3379, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.82% (0.3052 => 0.3260, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.80% (0.2793 => 0.2983, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.76% (0.3136 => 0.3348, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.75% (0.2756 => 0.2942) SingleSource/Benchmarks/Shootout-C++/fibo: 6.72% (0.2725 => 0.2908, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.69% (0.2872 => 0.3064, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 6.64% (0.2877 => 0.3068, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 6.63% (0.3379 => 0.3603, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.58% (0.2871 => 0.3060, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 6.48% (0.2714 => 0.2890, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.42% (0.2802 => 0.2982, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 5.99% (1.2842 => 1.3611, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.43% (0.3131 => 0.3301, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.93% (0.3817 => 0.3929, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.80% (0.3935 => 0.4045, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.95% (1.1145 => 1.2923, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 10.00% (0.9957 => 1.0953, std.dev.: 0.0192) SingleSource/Benchmarks/Misc/richards_benchmark: 9.95% (1.1396 => 1.2530, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3690, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 5.95% (1.9405 => 2.0560, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.67% (4.2280 => 4.3409, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.10% (3.6395 => 3.7159, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bisort/bisort: 1.81% (0.8333 => 0.8484, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.58% (2.6546 => 2.6965, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2076, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 1.18% (4.4649 => 4.5174, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.01% (6.6874 => 0.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -79.98% (0.8651 => 0.1732, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.85% (5.2763 => 3.2266, std.dev.: 0.0019) SingleSource/UnitTests/Vector/constpool: -14.60% (54.1659 => 46.2599, std.dev.: 0.0365) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.30% (2.9384 => 2.6357, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -6.52% (22.1758 => 20.7297, std.dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.12% (8.0499 => 3.7740, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.34% (1.1492 => 0.7660, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4751, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4247, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.67% (1.2258 => 1.0705, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -12.04% (1.2373 => 1.0883, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3453 => 2.9600, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -10.73% (1.5373 => 1.3724, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.43% (19.9488 => 18.2672, std.dev.: 0.0201) MultiSource/Benchmarks/FreeBench/mason/mason: -8.01% (0.2161 => 0.1988, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.00% (1.8329 => 1.7046, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.11% (1.6805 => 1.5947, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.96% (1.5835 => 1.5049, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.42% (8.1563 => 7.7961, std.dev.: 0.0124) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1626, std.dev.: 0.0023) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8775, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5033, std.dev.: 0.0035) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.79% (0.4808 => 0.4674, std.dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -1.85% (10.2830 => 10.0929, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6811, std.dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5094, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4208, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: -1.42% (4.6441 => 4.5783, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/lists: -1.16% (6.2999 => 6.2269, std.dev.: 0.0094) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2879, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -7.31% (0.5229 => 0.4847, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 14.75% (14.9895 => 17.2005, std.dev.: 0.0172) MultiSource/Benchmarks/MallocBench/gs/gs: 11.35% (4.1105 => 4.5771, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.10% (1.1048 => 1.3048, std.dev.: 0.0100) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.34% (7.1582 => 8.1849, std.dev.: 0.0145) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.64% (0.6222 => 0.7755, std.dev.: 0.0060) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35500.00% (0.0001 => 0.0356, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -99.95% (0.2116 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 20 20:12:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 20 Oct 2012 22:12:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121021031205.EC8A62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5053?compare_to=5051&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5053, Order: 166383, Start Time: 2012-10-21 01:49:07, End Time: 2012-10-21 03:15:05 To: 5051, Order: 166382, Start Time: 2012-10-20 23:25:18, End Time: 2012-10-21 00:51:19 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (202 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1041 (663 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.47% (54.8130 => 56.7125, std.dev.: 0.0228) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.86% (2.0176 => 2.4989, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.99% (0.1410 => 0.1706, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 18.52% (0.0826 => 0.0979, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 17.92% (0.2243 => 0.2645, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 17.37% (0.1013 => 0.1189, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.76% (0.0746 => 0.0871, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.74% (0.7710 => 0.9001, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.39% (0.0653 => 0.0760, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.60% (0.2596 => 0.3001, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.87% (0.0834 => 0.0958) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.84% (0.0977 => 0.1122, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.80% (0.1986 => 0.2280, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 14.77% (0.2721 => 0.3123, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.53% (0.0819 => 0.0938, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.43% (0.0811 => 0.0928, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.30% (0.1413 => 0.1615, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.29% (0.0847 => 0.0968, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 14.06% (0.1003 => 0.1144, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.02% (0.9199 => 1.0489, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 13.99% (1.3693 => 1.5609, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.93% (0.0725 => 0.0826, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.82% (0.6959 => 0.7921, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.81% (3.9660 => 4.5137, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.80% (0.5637 => 0.6415, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.64% (0.1327 => 0.1508, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.62% (0.1072 => 0.1218, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.59% (0.0964 => 0.1095, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.54% (0.1588 => 0.1803, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.49% (0.1075 => 0.1220, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 13.46% (0.7038 => 0.7985, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 13.41% (0.1111 => 0.1260, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.31% (0.5265 => 0.5966, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 13.28% (0.1062 => 0.1203, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.25% (0.2914 => 0.3300, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 13.08% (0.7460 => 0.8436, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.85% (0.1276 => 0.1440, std.dev.: 0.0019) MultiSource/Applications/Burg/burg: 12.66% (1.1061 => 1.2461, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 12.65% (0.1478 => 0.1665, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.52% (0.1014 => 0.1141, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.50% (1.4563 => 1.6383, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/distray/distray: 12.47% (0.0818 => 0.0920, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 12.46% (0.4062 => 0.4568, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 12.45% (0.4328 => 0.4867, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.41% (0.5577 => 0.6269, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.32% (1.2193 => 1.3695, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.27% (0.6283 => 0.7054, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.25% (1.1364 => 1.2756, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 12.24% (13.8202 => 15.5121, std.dev.: 0.0161) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.06% (0.2023 => 0.2267, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.01% (0.1865 => 0.2089, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.98% (0.3130 => 0.3505, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.97% (0.4379 => 0.4903, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 11.87% (0.7506 => 0.8397, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.80% (0.3246 => 0.3629, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 11.79% (0.2995 => 0.3348, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.75% (0.1157 => 0.1293, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.71% (0.2127 => 0.2376, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 11.65% (0.1657 => 0.1850, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 11.49% (3.8646 => 4.3086, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.35% (0.4791 => 0.5335, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 11.25% (0.2925 => 0.3254, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 11.24% (1.0313 => 1.1472, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.16% (0.1048 => 0.1165, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 11.15% (0.3220 => 0.3579, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.03% (0.3899 => 0.4329, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.01% (0.1789 => 0.1986, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 10.98% (1.9270 => 2.1386, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.90% (0.3485 => 0.3865, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.88% (7.2180 => 8.0035, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/lists: 10.84% (0.3293 => 0.3650, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.78% (0.4016 => 0.4449, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 10.78% (0.6744 => 0.7471, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 10.72% (0.1213 => 0.1343, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 10.70% (0.1589 => 0.1759, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.68% (0.3756 => 0.4157, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 10.66% (0.5818 => 0.6438, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 10.61% (0.2781 => 0.3076, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.58% (0.1569 => 0.1735) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.57% (0.2782 => 0.3076, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 10.54% (0.0977 => 0.1080, std.dev.: 0.0029) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.52% (0.1435 => 0.1586, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 10.52% (0.3868 => 0.4275, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 10.52% (16.6129 => 18.3608, std.dev.: 0.0096) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.50% (0.4390 => 0.4851, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 10.50% (3.1889 => 3.5237, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.46% (0.3489 => 0.3854, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 10.40% (0.8310 => 0.9174, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 10.40% (0.3453 => 0.3812, std.dev.: 0.0046) SingleSource/UnitTests/ObjC++/Hello: 10.37% (0.5748 => 0.6344, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.36% (0.3022 => 0.3335, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 10.32% (0.2761 => 0.3046, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.31% (1.3245 => 1.4610, std.dev.: 0.0054) MultiSource/Applications/siod/siod: 10.27% (2.1791 => 2.4029, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.25% (0.3580 => 0.3947, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 10.23% (0.3107 => 0.3425, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 10.23% (0.2726 => 0.3005, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 10.21% (0.7061 => 0.7782, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.15% (0.8698 => 0.9581, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/ary3: 10.07% (0.3149 => 0.3466, std.dev.: 0.0080) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.00% (0.2140 => 0.2354, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 10.00% (0.2760 => 0.3036, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 9.99% (0.3534 => 0.3887, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 9.97% (0.2628 => 0.2890, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.93% (3.6692 => 4.0337, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.89% (1.9828 => 2.1789, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.88% (0.2966 => 0.3259, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 9.86% (0.2607 => 0.2864, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.86% (4.3801 => 4.8118, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/random: 9.85% (0.2690 => 0.2955, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.80% (4.4433 => 4.8786, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.79% (0.2655 => 0.2915) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.78% (0.6576 => 0.7219, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.69% (0.2765 => 0.3033, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 9.67% (0.2937 => 0.3221, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/ary2: 9.65% (0.3192 => 0.3500, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 9.51% (0.4113 => 0.4504, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 9.50% (1.0594 => 1.1600, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.45% (4.9865 => 5.4578, std.dev.: 0.0100) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.39% (0.2321 => 0.2539, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 9.37% (0.2988 => 0.3268, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.31% (0.3511 => 0.3838, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.31% (0.2696 => 0.2947, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 9.23% (14.8535 => 16.2243, std.dev.: 0.0148) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.23% (0.6135 => 0.6701, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 9.07% (0.3131 => 0.3415, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.05% (0.3755 => 0.4095, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 9.01% (4.6629 => 5.0831, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/objinst: 9.00% (0.2945 => 0.3210, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 8.93% (1.2749 => 1.3888, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.91% (0.1819 => 0.1981, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.85% (0.8818 => 0.9598, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 8.80% (8.4961 => 9.2440, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.50% (1.1333 => 1.2296, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.41% (1.5188 => 1.6466, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.38% (0.9108 => 0.9871, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/neural/neural: 8.38% (0.1385 => 0.1501) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.29% (0.3245 => 0.3514, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 8.21% (3.7467 => 4.0542, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.20% (3.2742 => 3.5428, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 8.13% (0.6250 => 0.6758, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.03% (0.2504 => 0.2705, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 8.00% (6.5754 => 7.1013, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.89% (0.4805 => 0.5184, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 7.77% (0.2008 => 0.2164, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.71% (2.1007 => 2.2627, std.dev.: 0.0063) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.67% (6.2785 => 6.7599, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.45% (0.2243 => 0.2410, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 7.39% (0.4003 => 0.4299, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions: 7.36% (0.3914 => 0.4202, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 7.32% (1.2292 => 1.3192, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.22% (13.2842 => 14.2439, std.dev.: 0.0145) SingleSource/UnitTests/ObjC/trivial-interface: 7.10% (0.3578 => 0.3832, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 7.08% (0.3940 => 0.4219, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 7.08% (0.3646 => 0.3904, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 7.05% (0.3789 => 0.4056, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 7.00% (0.3601 => 0.3853, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 6.91% (0.3663 => 0.3916, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.82% (0.3650 => 0.3899, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: 6.79% (0.3623 => 0.3869, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 6.30% (0.1777 => 0.1889, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 5.45% (16.2614 => 17.1474, std.dev.: 0.0142) MultiSource/Applications/ClamAV/clamscan: 5.12% (14.5298 => 15.2739, std.dev.: 0.0099) MultiSource/Benchmarks/Olden/bh/bh: 4.02% (0.2859 => 0.2974, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 2.43% (33.2944 => 34.1032, std.dev.: 0.0095) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.75% (0.4846 => 0.6966, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 30.57% (5.7573 => 7.5173, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/fbench: 24.05% (1.8175 => 2.2546, std.dev.: 0.0079) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.15% (1.0895 => 1.2763, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 11.01% (1.1560 => 1.2833, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.40% (0.1322 => 0.1433, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4143, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.42% (0.9692 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 5.27% (1.2998 => 1.3683, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0049, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 4.50% (0.5449 => 0.5694) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.46% (2.8606 => 2.9882, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.66% (10.7476 => 11.1414, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/flops-6: 3.38% (1.9199 => 1.9847, std.dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 3.37% (12.0921 => 12.4995, std.dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 3.22% (11.2619 => 11.6240, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bisort/bisort: 2.96% (0.8239 => 0.8483, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.40% (1.0310 => 1.0557, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.16% (7.4271 => 7.5872, std.dev.: 0.0069) MultiSource/Applications/lemon/lemon: 1.76% (1.4298 => 1.4549, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.53% (2.0200 => 2.0509, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5130, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9679, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1867, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 1.20% (5.5130 => 5.5789, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.17% (9.9194 => 10.0359, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: 1.10% (12.4560 => 12.5925, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.01% (8.8259 => 8.9149, std.dev.: 0.0113) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.48% (0.2670 => 0.1429, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.06% (0.4657 => 0.3909, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.65% (1.3813 => 1.2204, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.40% (1.3819 => 1.2244, std.dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.28% (1.0460 => 0.8548, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/mason/mason: -12.73% (0.2238 => 0.1953, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.12% (20.3410 => 18.2824, std.dev.: 0.0109) SingleSource/Benchmarks/Misc/flops-3: -6.29% (2.4152 => 2.2633, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101) SingleSource/Benchmarks/McGill/chomp: -5.65% (1.2308 => 1.1612, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.59% (1.3780 => 1.3010, std.dev.: 0.0103) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3744, std.dev.: 0.0048) SingleSource/UnitTests/Vector/multiplies: -5.09% (2.6470 => 2.5123, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.64% (0.9996 => 0.9532, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.89% (1.7688 => 1.7000, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4867 => 0.4717, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -2.88% (3.2729 => 3.1785, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -2.78% (3.0263 => 2.9423, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8811, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -2.67% (1.9762 => 1.9235, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.31% (4.1080 => 4.0132, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.96% (0.6589 => 0.6460, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.86% (0.6615 => 0.6492) SingleSource/Benchmarks/Shootout/lists: -1.82% (6.3560 => 6.2401, std.dev.: 0.0036) MultiSource/Applications/lua/lua: -1.74% (26.5159 => 26.0558, std.dev.: 0.0407) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.67% (0.8342 => 0.8203) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.66% (2.5254 => 2.4835, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0068, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8676, std.dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: -1.23% (28.2225 => 27.8741, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2524, std.dev.: 0.0010) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1139, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -1.05% (84.4286 => 83.5424, std.dev.: 0.0048) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 20 20:15:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 20 Oct 2012 22:15:04 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121021031504.2A01F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5054?compare_to=5049&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5054, Order: 166383, Start Time: 2012-10-21 01:53:32, End Time: 2012-10-21 03:17:07 To: 5049, Order: 166382, Start Time: 2012-10-20 23:11:48, End Time: 2012-10-21 00:35:07 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 14 (28 on baseline) Performance Improvements: 2 (6 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 959 (940 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: 6.66% (0.1667 => 0.1778, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.00% (0.7941 => 0.8338, std.dev.: 0.0075) MultiSource/Benchmarks/McCat/05-eks/eks: 3.59% (0.4261 => 0.4414, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/gs/gs: 3.13% (4.0638 => 4.1912, std.dev.: 0.0315) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.03% (0.5711 => 0.5884, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.91% (0.6249 => 0.6431, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.90% (4.4316 => 4.5157, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.82% (0.9071 => 0.9236, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.76% (8.5610 => 8.7120, std.dev.: 0.0189) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.70% (0.8280 => 0.8421, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.37% (0.8380 => 0.8495, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 11.72% (0.7732 => 0.8638, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/n-body: 1.48% (1.5107 => 1.5331, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/tsp/tsp: 1.30% (1.4745 => 1.4937, std.dev.: 0.0070) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.66% (1.6277 => 1.6007, std.dev.: 0.0101) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.18% (1.5990 => 1.5801, std.dev.: 0.0048) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.06% (16.4797 => 16.4895, std.dev.: 0.0819) MultiSource/Applications/obsequi/Obsequi: 1.11% (1.0272 => 1.0386, std.dev.: 0.0104) MultiSource/Applications/sqlite3/sqlite3: -0.42% (0.6371 => 0.6344, std.dev.: 0.0247) MultiSource/Benchmarks/McCat/08-main/main: 6.64% (0.1762 => 0.1879, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.70% (0.1622 => 0.1682, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.64% (0.3231 => 0.3178, std.dev.: 0.0136) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.40% (0.2488 => 0.2478, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.27% (0.3367 => 0.3358, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.77% (0.2344 => 0.2362, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: 0.87% (0.5966 => 0.6018, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel: -7.72% (0.0492 => 0.0454, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.33% (0.3303 => 0.3314, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/strcat: 1.05% (0.1995 => 0.2016, std.dev.: 0.0036) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.26% (0.0239 => 0.0242, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 6.58% (0.0152 => 0.0162, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.48% (0.0418 => 0.0420, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 25.31% (0.0245 => 0.0307, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0306 => 0.0306, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.24% (0.0416 => 0.0417, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/casts: 62.81% (0.0121 => 0.0197, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0211 => 0.0211, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 9.38% (0.0320 => 0.0350, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013) MultiSource/Applications/ClamAV/clamscan: - (0.1472 => 0.1472, std.dev.: 0.0033) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 1.77% (1.1159 => 1.1356, std.dev.: 0.0257) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -0.14% (0.1445 => 0.1443, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.75% (0.4058 => 0.3987, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.27% (0.1408 => 0.1376, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.17% (0.0628 => 0.0583, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -25.61% (0.0246 => 0.0183, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.21% (0.0546 => 0.0569, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.71% (1.1524 => 1.1442, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 700.00% (0.0001 => 0.0008, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.69% (0.0596 => 0.0618, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.94% (0.0174 => 0.0200, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.72% (0.7965 => 0.8022, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -10.81% (0.0074 => 0.0066, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.75% (2.1832 => 1.6647, std.dev.: 0.0020) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.09% (0.0810 => 0.0916, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/tsp/tsp: 9.53% (0.1112 => 0.1218, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.69% (0.2180 => 0.2304, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.17% (0.2519 => 0.2624, std.dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.98% (0.3137 => 0.3262, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.24% (0.7473 => 0.7715, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.91% (0.6010 => 0.6185, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.79% (1.4479 => 1.4883, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.29% (0.6287 => 0.6431, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.11% (0.4783 => 0.4884, std.dev.: 0.0022) MultiSource/Applications/Burg/burg: 1.92% (1.2222 => 1.2457, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.79% (0.9074 => 0.9236, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.63% (0.8359 => 0.8495, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.38% (0.8420 => 0.8536, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.29% (6.6074 => 6.6924, std.dev.: 0.0133) MultiSource/Applications/siod/siod: 1.13% (2.2184 => 2.2435, std.dev.: 0.0082) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.83% (1.5795 => 2.5087, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.14% (14.6451 => 16.2764, std.dev.: 0.5081) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.67% (1.1857 => 1.2766, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.34% (0.3186 => 0.3420, std.dev.: 0.0056) MultiSource/Benchmarks/mafft/pairlocalalign: 5.96% (63.1822 => 66.9477, std.dev.: 0.0366) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 3.46% (44.5605 => 46.1002, std.dev.: 0.5494) SingleSource/Benchmarks/Misc/ReedSolomon: 2.83% (8.5322 => 8.7736, std.dev.: 0.0319) MultiSource/Applications/siod/siod: 2.70% (3.6643 => 3.7633, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.75% (41.4238 => 42.1478, std.dev.: 0.0317) MultiSource/Benchmarks/Olden/bh/bh: 1.68% (2.3560 => 2.3955, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.66% (2.4490 => 2.4897, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.13% (4.8362 => 4.8908, std.dev.: 0.0137) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.75% (0.3269 => 0.2983, std.dev.: 0.0038) MultiSource/Applications/lua/lua: -5.08% (29.8330 => 28.3162, std.dev.: 0.0449) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.89% (7.2130 => 6.9321, std.dev.: 0.1027) SingleSource/Benchmarks/Shootout-C++/hash2: -1.64% (3.4237 => 3.3674, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.39% (3.3479 => 3.3015, std.dev.: 0.0036) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.01% (1.2822 => 1.2692, std.dev.: 0.0038) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.26% (16.4461 => 16.4895, std.dev.: 0.0819) MultiSource/Applications/obsequi/Obsequi: 1.21% (1.0262 => 1.0386, std.dev.: 0.0104) MultiSource/Applications/sqlite3/sqlite3: 0.19% (0.6332 => 0.6344, std.dev.: 0.0247) MultiSource/Benchmarks/McCat/08-main/main: 2.62% (0.1831 => 0.1879, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.89% (0.1559 => 0.1682, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.76% (0.3123 => 0.3178, std.dev.: 0.0136) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.61% (0.2463 => 0.2478, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.42% (0.3344 => 0.3358, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.08% (0.2364 => 0.2362, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: 0.13% (0.6010 => 0.6018, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel: 5.83% (0.0429 => 0.0454, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.47% (0.3266 => 0.3314, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/strcat: 2.39% (0.1969 => 0.2016, std.dev.: 0.0036) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.04% (0.0224 => 0.0242, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 31.71% (0.0123 => 0.0162, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.94% (0.0408 => 0.0420, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 20.87% (0.0254 => 0.0307, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.32% (0.0302 => 0.0306, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 8.59% (0.0384 => 0.0417, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/casts: 3.68% (0.0190 => 0.0197, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 17.22% (0.0180 => 0.0211, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 52.17% (0.0230 => 0.0350, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.36% (0.1438 => 0.1472, std.dev.: 0.0033) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.24% (1.1329 => 1.1356, std.dev.: 0.0257) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -1.30% (0.1462 => 0.1443, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.25% (0.4164 => 0.3987, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.51% (0.1369 => 0.1376, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.05% (0.0641 => 0.0583, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -6.15% (0.0195 => 0.0183, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.56% (0.0578 => 0.0569, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.04% (1.1437 => 1.1442, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 700.00% (0.0001 => 0.0008, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.44% (0.0627 => 0.0618, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 11.11% (0.0180 => 0.0200, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.06% (0.8017 => 0.8022, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 6.45% (0.0062 => 0.0066, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 20 21:55:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 20 Oct 2012 23:55:15 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121021045515.EB4262A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5055?compare_to=5054&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5055, Order: 166384, Start Time: 2012-10-21 03:34:02, End Time: 2012-10-21 04:57:18 To: 5054, Order: 166383, Start Time: 2012-10-21 01:53:32, End Time: 2012-10-21 03:17:07 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 4 (19 on baseline) Performance Improvements: 4 (5 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 967 (950 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.33% (4.4992 => 4.5591, std.dev.: 0.0172) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.00% (1.2393 => 1.2517, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.66% (5.1751 => 5.3127, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.26% (3.5662 => 3.6110, std.dev.: 0.0161) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.09% (1.4883 => 1.4721, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -8.11% (3.3138 => 3.0449, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/heapsort: -6.58% (3.2837 => 3.0675, std.dev.: 0.0806) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.08% (42.1478 => 40.8503, std.dev.: 0.4064) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.28% (16.4895 => 16.5349, std.dev.: 0.1800) MultiSource/Applications/obsequi/Obsequi: -0.04% (1.0386 => 1.0382, std.dev.: 0.0111) MultiSource/Applications/sqlite3/sqlite3: -0.02% (0.6344 => 0.6343, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: 1.60% (0.1879 => 0.1909, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.65% (0.1682 => 0.1671, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.60% (0.3178 => 0.3229, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.16% (0.2478 => 0.2482, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.05% (0.3358 => 0.3289, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.72% (0.2362 => 0.2345, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/bigfib: -1.06% (0.6018 => 0.5954, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel: 8.37% (0.0454 => 0.0492, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.88% (0.3314 => 0.3285, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: -0.64% (0.2016 => 0.2003, std.dev.: 0.0013) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -3.72% (0.0242 => 0.0233, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 30.86% (0.0162 => 0.0212, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.24% (0.0420 => 0.0421, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -8.79% (0.0307 => 0.0280, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -5.56% (0.0306 => 0.0289, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -6.00% (0.0417 => 0.0392, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/casts: -1.52% (0.0197 => 0.0194, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -0.47% (0.0211 => 0.0210, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -24.86% (0.0350 => 0.0263, std.dev.: 0.0046) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.27% (0.1472 => 0.1468, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.58% (1.1356 => 1.1177, std.dev.: 0.0240) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 0.35% (0.1443 => 0.1448, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.76% (0.3987 => 0.4137, std.dev.: 0.0952) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.58% (0.1376 => 0.1368, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.26% (0.0583 => 0.0637, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 48.63% (0.0183 => 0.0272, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.23% (0.0569 => 0.0576, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.18% (1.1442 => 1.1421, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -87.50% (0.0008 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.07% (0.0618 => 0.0599, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 29.50% (0.0200 => 0.0259, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.62% (0.8022 => 0.7972, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 74.24% (0.0066 => 0.0115, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.99% (2.1832 => 1.6594, std.dev.: 0.0063) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.32% (0.0810 => 0.0926, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.25% (0.2180 => 0.2338, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.78% (0.8321 => 0.8719, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.55% (0.8611 => 0.8831, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.55% (1.1606 => 1.1902, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.45% (0.4783 => 0.4900, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.78% (1.1685 => 1.1893, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.67% (1.4479 => 1.4721, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.60% (4.4873 => 4.5591, std.dev.: 0.0172) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.43% (6.6074 => 6.7018, std.dev.: 0.0182) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.39% (4.1763 => 4.2344, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.36% (0.8338 => 0.8451, std.dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.97% (1.5795 => 2.5110, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.13% (14.6451 => 16.1284, std.dev.: 0.4084) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.42% (1.1857 => 1.2855, std.dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 5.94% (63.1822 => 66.9366, std.dev.: 0.1257) SingleSource/Benchmarks/Misc/ReedSolomon: 3.36% (8.5322 => 8.8193, std.dev.: 0.0170) MultiSource/Applications/siod/siod: 2.85% (3.6643 => 3.7689, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/bh/bh: 1.93% (2.3560 => 2.4015, std.dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -7.52% (3.2926 => 3.0449, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.46% (0.3269 => 0.3025, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -4.78% (29.8330 => 28.4080, std.dev.: 0.1567) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.52% (3.3479 => 3.2971, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash2: -1.50% (3.4237 => 3.3725, std.dev.: 0.0041) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.54% (16.4461 => 16.5349, std.dev.: 0.1800) MultiSource/Applications/obsequi/Obsequi: 1.17% (1.0262 => 1.0382, std.dev.: 0.0111) MultiSource/Applications/sqlite3/sqlite3: 0.17% (0.6332 => 0.6343, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: 4.26% (0.1831 => 0.1909, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.18% (0.1559 => 0.1671, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.39% (0.3123 => 0.3229, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.77% (0.2463 => 0.2482, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.64% (0.3344 => 0.3289, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.80% (0.2364 => 0.2345, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/bigfib: -0.93% (0.6010 => 0.5954, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel: 14.69% (0.0429 => 0.0492, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.58% (0.3266 => 0.3285, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: 1.73% (0.1969 => 0.2003, std.dev.: 0.0013) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.02% (0.0224 => 0.0233, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 72.36% (0.0123 => 0.0212, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.19% (0.0408 => 0.0421, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 10.24% (0.0254 => 0.0280, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -4.30% (0.0302 => 0.0289, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 2.08% (0.0384 => 0.0392, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/casts: 2.11% (0.0190 => 0.0194, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 16.67% (0.0180 => 0.0210, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 14.35% (0.0230 => 0.0263, std.dev.: 0.0046) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.09% (0.1438 => 0.1468, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.34% (1.1329 => 1.1177, std.dev.: 0.0240) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -0.96% (0.1462 => 0.1448, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.65% (0.4164 => 0.4137, std.dev.: 0.0952) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.07% (0.1369 => 0.1368, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -12.50% (0.0008 => 0.0007, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.62% (0.0641 => 0.0637, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 39.49% (0.0195 => 0.0272, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.35% (0.0578 => 0.0576, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.14% (1.1437 => 1.1421, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.47% (0.0627 => 0.0599, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 43.89% (0.0180 => 0.0259, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.56% (0.8017 => 0.7972, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 85.48% (0.0062 => 0.0115, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 20 21:55:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 20 Oct 2012 23:55:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121021045541.34F172A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5056?compare_to=5052&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5056, Order: 166384, Start Time: 2012-10-21 03:37:32, End Time: 2012-10-21 04:57:41 To: 5052, Order: 166383, Start Time: 2012-10-21 01:48:13, End Time: 2012-10-21 03:08:07 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (75 on baseline) New Passes: 8 (4 on baseline) Performance Regressions: 1 (189 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 90 (15 on baseline) Unchanged Tests: 943 (652 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.01% (0.2516 => 0.2642, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.46% (15.2520 => 15.4741, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.66% (3.5673 => 3.6980, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.92% (1.1081 => 1.1515, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.59% (3.5633 => 3.6911, std.dev.: 0.0010) New Passes - Execution Time --------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 409100.00% (0.0001 => 0.4092, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2965000.00% (0.0001 => 2.9651, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 52000.00% (0.0001 => 0.0521, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.16% (1.2964 => 1.3115, std.dev.: 0.0015) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 28.84% (0.4847 => 0.6245, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 0.12% (17.2005 => 17.2214, std.dev.: 0.0038) MultiSource/Benchmarks/Bullet/bullet: -0.10% (56.0619 => 56.0057, std.dev.: 0.0233) MultiSource/Benchmarks/MallocBench/gs/gs: 0.02% (4.5771 => 4.5780, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.21% (0.0481 => 0.0480, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.21% (0.0482 => 0.0481, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.22% (0.0451 => 0.0450, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0451 => 0.0451, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0440 => 0.0440, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.23% (0.0441 => 0.0442, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.23% (0.0434 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.23% (0.0435 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.22% (0.0452 => 0.0451) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.22% (0.0453 => 0.0452, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0446 => 0.0446, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0447 => 0.0447, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0436 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0437 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.23% (0.0444 => 0.0443, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.22% (0.0445 => 0.0444, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0454 => 0.0454, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0455 => 0.0455, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.23% (0.0431 => 0.0430, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0432 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0443 => 0.0443) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0444 => 0.0444) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.23% (0.0435 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0435 => 0.0435, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.23% (0.0427 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0428 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0425 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.23% (0.0427 => 0.0426, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.22% (0.0462 => 0.0461, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0463 => 0.0463, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0424 => 0.0424) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.23% (0.0426 => 0.0425, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.23% (0.0426 => 0.0425) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0426 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0433 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0434 => 0.0434, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.41% (1.3048 => 1.2995, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.02% (8.1849 => 8.1829, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.04% (0.7755 => 0.7758, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.28% (0.0356 => 0.0357, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 164600.00% (0.0001 => 0.1647, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 213800.00% (0.0001 => 0.2139, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.44% (63.2438 => 56.0057, std.dev.: 0.0233) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 0.49% (0.1639 => 0.1647, std.dev.: 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 35.94% (14.1553 => 19.2422, std.dev.: 0.1326) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.87% (3.4629 => 5.7786, std.dev.: 0.0135) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13489.17% (0.0720 => 9.7842, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049900.00% (0.0001 => 10.0500, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.35% (0.2554 => 0.4172, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: 55.86% (0.0256 => 0.0399, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 52.81% (10.3673 => 15.8419, std.dev.: 0.0109) SingleSource/UnitTests/SignlessTypes/factor: 44.59% (0.0296 => 0.0428, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.52% (1.5859 => 2.2444, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/distray/distray: 36.46% (0.1056 => 0.1441, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 35.70% (0.1622 => 0.2201, std.dev.: 0.0002) SingleSource/UnitTests/vla: 31.83% (0.0355 => 0.0468, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 29.73% (2.2024 => 2.8571, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: 25.84% (0.1463 => 0.1841, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 24.58% (0.0834 => 0.1039, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.69% (0.1566 => 0.1890, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 20.60% (0.2049 => 0.2471, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 20.11% (0.1432 => 0.1720, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.14% (0.0871 => 0.1029, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.10% (7.0540 => 8.3309, std.dev.: 0.0086) MultiSource/Applications/viterbi/viterbi: 17.94% (0.1555 => 0.1834, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.49% (0.5105 => 0.5998, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.29% (2.2022 => 2.5830, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.06% (0.6675 => 0.7814, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.34% (0.2271 => 0.2642, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 16.27% (3.3354 => 3.8781, std.dev.: 0.0066) SingleSource/Benchmarks/McGill/chomp: 16.25% (0.1655 => 0.1924, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.24% (1.3050 => 1.5169, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/lists: 16.13% (0.0626 => 0.0727, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 15.99% (0.1695 => 0.1966, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 15.49% (0.1440 => 0.1663, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/mst/mst: 15.39% (0.1163 => 0.1342, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 15.32% (0.1175 => 0.1355, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.21% (0.1032 => 0.1189, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.17% (1.5415 => 1.7753, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.10% (0.5020 => 0.5778, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.00% (0.8172 => 0.9398, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.90% (0.1510 => 0.1735, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 14.88% (0.0793 => 0.0911, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 14.84% (0.7115 => 0.8171, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.79% (0.0886 => 0.1017, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.73% (0.1337 => 0.1534, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.56% (0.0838 => 0.0960, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 14.54% (0.3109 => 0.3561, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 14.50% (0.3282 => 0.3758, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: 14.49% (1.1642 => 1.3329, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.37% (0.0842 => 0.0963, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.34% (0.0746 => 0.0853, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.23% (0.1940 => 0.2216, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.19% (4.2646 => 4.8698, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/18-imp/imp: 14.11% (0.3423 => 0.3906, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.08% (0.1584 => 0.1807, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.05% (0.9765 => 1.1137, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/exptree: 14.00% (0.0814 => 0.0928, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.94% (0.3121 => 0.3556, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.90% (1.7609 => 2.0056, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/matrix: 13.81% (0.0818 => 0.0931, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 13.69% (9.4845 => 10.7830, std.dev.: 0.0157) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.67% (0.1236 => 0.1405, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.62% (0.2107 => 0.2394, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.61% (0.1117 => 0.1269, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 13.55% (0.1151 => 0.1307, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.54% (0.1906 => 0.2164, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.49% (0.1438 => 0.1632, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 13.47% (0.6450 => 0.7319, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.41% (0.5860 => 0.6646, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.38% (0.2758 => 0.3127, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.38% (8.1363 => 9.2248, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.38% (0.0770 => 0.0873, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 13.31% (5.7591 => 6.5258, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 13.30% (0.7835 => 0.8877, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.29% (0.0933 => 0.1057, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.22% (0.2065 => 0.2338, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.16% (0.1695 => 0.1918, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.15% (0.4615 => 0.5222, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.14% (1.4186 => 1.6050, std.dev.: 0.0019) MultiSource/Applications/treecc/treecc: 13.01% (2.0273 => 2.2911, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.93% (0.1029 => 0.1162, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.91% (0.0798 => 0.0901, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.90% (0.1062 => 0.1199, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: 12.83% (0.7433 => 0.8387, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.81% (0.0929 => 0.1048, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 12.80% (1.1840 => 1.3355, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.71% (0.4879 => 0.5499, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 12.62% (1.0722 => 1.2075, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.60% (5.0018 => 5.6322, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.59% (0.2700 => 0.3040, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.54% (4.9449 => 5.5651, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.52% (0.5981 => 0.6730, std.dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 12.51% (10.4361 => 11.7416, std.dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.43% (0.1625 => 0.1827, std.dev.: 0.0006) SingleSource/UnitTests/SignlessTypes/rem: 12.41% (0.1144 => 0.1286, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 12.31% (0.3387 => 0.3804, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 12.31% (0.4299 => 0.4828, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 12.30% (0.1268 => 0.1424, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.30% (0.8067 => 0.9059, std.dev.: 0.0019) MultiSource/Applications/lua/lua: 12.29% (3.8723 => 4.3481, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.26% (0.2603 => 0.2922, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 12.21% (0.3177 => 0.3565, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.03% (0.1330 => 0.1490, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.97% (0.3307 => 0.3703, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.88% (1.1861 => 1.3270, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.85% (0.5569 => 0.6229, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/football/football: 11.71% (0.8921 => 0.9966, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.66% (7.9617 => 8.8898, std.dev.: 0.0106) MultiSource/Applications/hbd/hbd: 11.47% (1.5603 => 1.7392, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.38% (0.1125 => 0.1253, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 11.29% (0.3180 => 0.3539, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.25% (0.3441 => 0.3828, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.20% (0.1143 => 0.1271, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 11.01% (0.6456 => 0.7167, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/bh/bh: 10.87% (0.3092 => 0.3428, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.77% (0.2266 => 0.2510, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.57% (0.3473 => 0.3840, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.56% (0.3543 => 0.3917, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 10.50% (0.3561 => 0.3935, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.47% (0.3927 => 0.4338, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.44% (0.8101 => 0.8947, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: 10.44% (0.3497 => 0.3862, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.42% (0.3694 => 0.4079, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.39% (0.3543 => 0.3911, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 10.38% (0.3516 => 0.3881, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions: 10.37% (0.3828 => 0.4225, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 10.35% (2.2969 => 2.5346, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.31% (0.1892 => 0.2087, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 10.24% (0.3886 => 0.4284, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 10.03% (0.4289 => 0.4719, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/hash2: 9.76% (0.4620 => 0.5071, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.46% (0.3826 => 0.4188, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 9.40% (21.9371 => 23.9996, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/lists: 9.38% (0.3422 => 0.3743, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.24% (0.3865 => 0.4222, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.11% (0.4203 => 0.4586, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.96% (0.3427 => 0.3734, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: 8.79% (0.4048 => 0.4404, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.77% (0.4103 => 0.4463, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.74% (0.4636 => 0.5041, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 8.60% (0.3684 => 0.4001, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 8.09% (17.1811 => 18.5718, std.dev.: 0.0234) SingleSource/Benchmarks/Shootout-C++/sieve: 8.08% (0.3603 => 0.3894, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.86% (0.2430 => 0.2621, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.75% (0.3650 => 0.3933, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.71% (14.3668 => 15.4741, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.62% (3.8922 => 4.1888, std.dev.: 0.0051) SingleSource/UnitTests/ObjC++/property-reference-object: 7.58% (0.6030 => 0.6487, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 7.56% (0.5925 => 0.6373, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.55% (0.4064 => 0.4371, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 7.52% (0.2831 => 0.3044, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 7.42% (0.3098 => 0.3328, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.37% (0.2891 => 0.3104, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 7.37% (0.2905 => 0.3119, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 7.36% (0.3232 => 0.3470, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.34% (0.3283 => 0.3524, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.25% (0.7326 => 0.7857, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.23% (0.2793 => 0.2995, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.11% (0.2756 => 0.2952, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.08% (0.3162 => 0.3386, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.05% (0.3136 => 0.3357, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.01% (2.0665 => 2.2114, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.91% (0.3052 => 0.3263, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.87% (0.3379 => 0.3611, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.86% (0.2872 => 0.3069, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.85% (0.2877 => 0.3074, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.83% (0.2871 => 0.3067, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.83% (0.2725 => 0.2911, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 6.75% (0.2802 => 0.2991, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.67% (0.2714 => 0.2895, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 6.23% (1.2842 => 1.3642, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 5.65% (0.3131 => 0.3308, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.91% (0.3817 => 0.3928, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.87% (1.1194 => 1.1515, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.85% (0.3935 => 0.4047, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 9.88% (0.9957 => 1.0941, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/richards_benchmark: 9.76% (1.1396 => 1.2508, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3685, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/bh/bh: 5.93% (1.9405 => 2.0555, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.75% (4.2280 => 4.3444, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.63% (0.3987 => 0.4092, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0313 => 1.0566, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.17% (3.6395 => 3.7185, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.57% (2.6546 => 2.6964, std.dev.: 0.0023) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2078, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 1.18% (4.4649 => 4.5178, std.dev.: 0.0019) MultiSource/Applications/minisat/minisat: 1.07% (9.1159 => 9.2134, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.01% (6.6874 => 0.1332, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -79.92% (0.8651 => 0.1737, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.80% (5.2763 => 3.2289, std.dev.: 0.0132) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.46% (5.3855 => 3.6911, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.91% (5.3526 => 3.6980, std.dev.: 0.0023) SingleSource/UnitTests/Vector/constpool: -14.60% (54.1659 => 46.2601, std.dev.: 0.0096) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.52% (2.9384 => 2.6294, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -6.71% (22.1758 => 20.6868, std.dev.: 0.0147) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.09% (8.0499 => 3.7763, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.40% (1.1492 => 0.7654, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4751, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.02% (1.6925 => 1.4213, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.70% (1.2258 => 1.0701, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -11.61% (1.2373 => 1.0937, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3453 => 2.9600, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -10.73% (1.5373 => 1.3723, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.47% (19.9488 => 18.2601, std.dev.: 0.1262) MultiSource/Benchmarks/FreeBench/mason/mason: -7.73% (0.2161 => 0.1994, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.97% (1.8329 => 1.7051, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0146) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.19% (1.6805 => 1.5933, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: -4.98% (1.5835 => 1.5046, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.50% (8.1563 => 7.7894, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.67% (3.2827 => 3.1623, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -3.39% (5.0483 => 4.8774, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5053, std.dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.79% (0.4808 => 0.4674, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.87% (10.2830 => 10.0908, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6812, std.dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.66% (2.5528 => 2.5105, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4206, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: -1.41% (4.6441 => 4.5787, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2879, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 19.43% (0.5229 => 0.6245, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 14.89% (14.9895 => 17.2214, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/gs/gs: 11.37% (4.1105 => 4.5780, std.dev.: 0.0092) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.62% (1.1048 => 1.2995, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.32% (7.1582 => 8.1829, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.69% (0.6222 => 0.7758, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35600.00% (0.0001 => 0.0357, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.09% (0.2116 => 0.2139, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 20 22:07:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 21 Oct 2012 00:07:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121021050740.BCFE82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5057?compare_to=5053&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5057, Order: 166384, Start Time: 2012-10-21 03:44:33, End Time: 2012-10-21 05:10:41 To: 5053, Order: 166383, Start Time: 2012-10-21 01:49:07, End Time: 2012-10-21 03:15:05 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (202 on baseline) Performance Improvements: 0 (40 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1042 (662 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.27% (2.0176 => 2.5072, std.dev.: 0.0156) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.49% (0.1410 => 0.1713, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 18.89% (0.0826 => 0.0982, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 18.37% (0.2243 => 0.2655, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 17.67% (0.1013 => 0.1192, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.64% (0.0618 => 0.0727, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.00% (0.0653 => 0.0764, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.86% (0.7710 => 0.9010, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.76% (0.0746 => 0.0871, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 15.14% (0.2721 => 0.3133, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.06% (0.1986 => 0.2285, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.99% (0.0834 => 0.0959, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.95% (0.2596 => 0.2984, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.76% (0.0847 => 0.0972, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.67% (0.0811 => 0.0930, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.65% (0.1413 => 0.1620, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.53% (0.0819 => 0.0938, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.39% (0.1327 => 0.1518, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 14.36% (1.3693 => 1.5659, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: 14.36% (0.1003 => 0.1147, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.28% (0.9199 => 1.0513, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.17% (0.1588 => 0.1813) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.17% (0.6959 => 0.7945, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.17% (0.0720 => 0.0822, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.07% (0.0725 => 0.0827, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.04% (3.9660 => 4.5228, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.90% (0.0964 => 0.1098, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.89% (0.5637 => 0.6420, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 13.81% (0.7038 => 0.8010, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.77% (0.1075 => 0.1223, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 13.65% (0.1062 => 0.1207, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.64% (0.5265 => 0.5983, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/mst/mst: 13.59% (0.1111 => 0.1262, std.dev.: 0.0014) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.43% (0.1072 => 0.1216) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.42% (0.2914 => 0.3305, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 13.35% (0.7460 => 0.8456, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.32% (0.1276 => 0.1446, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.07% (1.4563 => 1.6467, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 13.07% (0.4062 => 0.4593, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 13.04% (1.1061 => 1.2503, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 13.03% (0.4328 => 0.4892, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.00% (0.0977 => 0.1104, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 12.99% (0.1478 => 0.1670, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 12.96% (0.0818 => 0.0924, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.75% (1.2193 => 1.3747, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 12.74% (13.8202 => 15.5808, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.70% (0.2023 => 0.2280, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.64% (0.5577 => 0.6282, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.64% (0.6283 => 0.7077, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.64% (1.1364 => 1.2800, std.dev.: 0.0183) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.62% (0.1014 => 0.1142, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 12.36% (0.7506 => 0.8434, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.28% (0.1865 => 0.2094, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.19% (0.4379 => 0.4913, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.18% (0.2127 => 0.2386, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.10% (0.1157 => 0.1297, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.08% (0.3246 => 0.3638, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 12.07% (0.1657 => 0.1857, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.96% (0.4791 => 0.5364, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 11.95% (0.2995 => 0.3353, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.88% (0.3130 => 0.3502, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 11.84% (3.8646 => 4.3223, std.dev.: 0.0078) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.74% (0.1048 => 0.1171, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.62% (0.3899 => 0.4352, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 11.58% (1.0313 => 1.1507, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 11.56% (0.2925 => 0.3263, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 11.43% (0.3220 => 0.3588, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.40% (0.1789 => 0.1993, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.36% (0.3485 => 0.3881, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 11.30% (0.6744 => 0.7506, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 11.30% (1.9270 => 2.1447, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists: 11.30% (0.3293 => 0.3665, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 11.26% (0.1589 => 0.1768, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.23% (0.4016 => 0.4467, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 11.22% (0.2781 => 0.3093, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: 11.21% (0.1213 => 0.1349, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 11.21% (7.2180 => 8.0269, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.14% (0.4390 => 0.4879, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.08% (0.3756 => 0.4172, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 11.05% (0.5818 => 0.6461, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.02% (0.3022 => 0.3355, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.01% (0.3580 => 0.3974, std.dev.: 0.0042) SingleSource/UnitTests/ObjC++/property-reference: 10.99% (0.7061 => 0.7837, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 10.99% (0.3868 => 0.4293, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 10.95% (3.1889 => 3.5380, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.94% (0.1435 => 0.1592, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.90% (0.1569 => 0.1740, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.89% (0.2782 => 0.3085, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.89% (0.3489 => 0.3869, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 10.83% (0.8310 => 0.9210, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 10.75% (16.6129 => 18.3993, std.dev.: 0.0060) SingleSource/UnitTests/ObjC++/Hello: 10.75% (0.5748 => 0.6366, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 10.75% (0.2726 => 0.3019, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.68% (0.8698 => 0.9627, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 10.65% (0.2760 => 0.3054, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 10.63% (0.3453 => 0.3820, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 10.62% (0.3107 => 0.3437, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.62% (0.2966 => 0.3281, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 10.58% (0.2761 => 0.3053, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 10.57% (0.3149 => 0.3482, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 10.54% (2.1791 => 2.4087, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.54% (1.9828 => 2.1917, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 10.47% (0.2607 => 0.2880, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/lists1: 10.44% (0.3534 => 0.3903, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 10.41% (0.2690 => 0.2970, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.40% (1.3245 => 1.4623, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 10.38% (3.6692 => 4.0501, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/wc: 10.32% (0.2937 => 0.3240, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 10.31% (0.2628 => 0.2899, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.28% (0.2655 => 0.2928, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.28% (0.2140 => 0.2360, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 10.28% (0.3192 => 0.3520, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.27% (0.2765 => 0.3049, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 10.26% (4.4433 => 4.8992, std.dev.: 0.0509) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 10.25% (4.3801 => 4.8289, std.dev.: 0.0026) SingleSource/Benchmarks/Stanford/Puzzle: 10.24% (0.0977 => 0.1077, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 10.07% (0.4113 => 0.4527, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 10.04% (0.2988 => 0.3288, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.99% (0.6576 => 0.7233, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.90% (0.2696 => 0.2963, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.88% (4.9865 => 5.4792, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.76% (0.6135 => 0.6734, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 9.65% (0.3131 => 0.3433, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 9.64% (1.0594 => 1.1615, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.61% (0.3755 => 0.4116, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.61% (0.2321 => 0.2544, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 9.58% (0.2945 => 0.3227, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 9.55% (14.8535 => 16.2725, std.dev.: 0.0119) MultiSource/Applications/SIBsim4/SIBsim4: 9.53% (1.2749 => 1.3964, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.46% (0.3511 => 0.3843, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.36% (0.8818 => 0.9643, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.29% (0.1819 => 0.1988, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 9.13% (8.4961 => 9.2716, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 9.02% (4.6629 => 5.0836, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.90% (0.9108 => 0.9919, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.84% (1.1333 => 1.2335, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.78% (1.5188 => 1.6522, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/neural/neural: 8.74% (0.1385 => 0.1506, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/bigfib: 8.70% (0.6250 => 0.6794, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.66% (3.2742 => 3.5579, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 8.64% (3.7467 => 4.0703, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 8.52% (0.2008 => 0.2179, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 8.47% (6.5754 => 7.1321, std.dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.30% (0.4805 => 0.5204, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.26% (0.3245 => 0.3513, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.12% (6.2785 => 6.7884, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.11% (0.2504 => 0.2707, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.08% (2.1007 => 2.2704, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 7.82% (0.4003 => 0.4316, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.76% (0.2243 => 0.2417, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/exceptions: 7.74% (0.3914 => 0.4217, std.dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: 7.73% (1.2292 => 1.3242, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.64% (13.2842 => 14.2987, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/trivial-interface: 7.55% (0.3578 => 0.3848, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.44% (0.3789 => 0.4071, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.44% (0.3940 => 0.4233, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.41% (0.3601 => 0.3868, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.40% (0.3650 => 0.3920, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 7.30% (0.3646 => 0.3912, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/synchronized: 7.23% (0.3663 => 0.3928, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 7.20% (0.3623 => 0.3884, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/ReedSolomon: 6.47% (0.1777 => 0.1892, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 5.75% (16.2614 => 17.1958, std.dev.: 0.0205) MultiSource/Applications/ClamAV/clamscan: 5.32% (14.5298 => 15.3027, std.dev.: 0.0105) MultiSource/Benchmarks/Olden/bh/bh: 4.58% (0.2859 => 0.2990, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 2.89% (33.2944 => 34.2567, std.dev.: 0.0142) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5184, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/fbench: 23.70% (1.8175 => 2.2483, std.dev.: 0.0522) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.04% (1.0895 => 1.2752, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/richards_benchmark: 11.07% (1.1560 => 1.2840, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 8.98% (0.8273 => 0.9016, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4140, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.42% (0.9692 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 5.39% (1.2998 => 1.3699, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0042, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 4.46% (0.5449 => 0.5692, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.45% (2.8606 => 2.9880, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7758, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.49% (1.9199 => 1.9869, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.48% (10.7476 => 11.1214, std.dev.: 0.0736) MultiSource/Applications/hexxagon/hexxagon: 3.37% (12.0921 => 12.4991, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 3.22% (11.2619 => 11.6245, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.40% (1.0310 => 1.0557, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.18% (7.4271 => 7.5893, std.dev.: 0.0059) MultiSource/Applications/lemon/lemon: 1.73% (1.4298 => 1.4545, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0507, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5136, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9697, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1866, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/sieve: 1.19% (5.1531 => 5.2144, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5778, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.17% (9.9194 => 10.0356, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/em3d/em3d: 1.14% (3.1071 => 3.1424, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 1.12% (12.4560 => 12.5954, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.33% (0.2670 => 0.1433, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.72% (0.4657 => 0.3925, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.61% (1.3813 => 1.2210, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.47% (1.3819 => 1.2234, std.dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.28% (1.0460 => 0.8548, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/mason/mason: -12.65% (0.2238 => 0.1955, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.06% (20.3410 => 18.2945, std.dev.: 0.0259) SingleSource/Benchmarks/McGill/chomp: -6.49% (1.2308 => 1.1509, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0008) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5143, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.89% (1.3780 => 1.3106, std.dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.81% (0.9996 => 0.9515, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.83% (1.7688 => 1.7010, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.04% (0.4867 => 0.4719, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -2.88% (3.2729 => 3.1785, std.dev.: 0.0024) MultiSource/Applications/spiff/spiff: -2.86% (3.0263 => 2.9396, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: -2.76% (1.9762 => 1.9216, std.dev.: 0.0045) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8812, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.28% (4.1080 => 4.0143, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.03% (0.6589 => 0.6455, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.86% (0.6615 => 0.6492) SingleSource/Benchmarks/Shootout/lists: -1.82% (6.3560 => 6.2405, std.dev.: 0.0061) MultiSource/Applications/lua/lua: -1.74% (26.5159 => 26.0546, std.dev.: 0.0382) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.67% (2.5254 => 2.4833, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.67% (0.8342 => 0.8203, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0071, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -1.30% (5.3167 => 5.2475, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8669, std.dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: -1.24% (28.2225 => 27.8729, std.dev.: 0.0042) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1138, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -1.06% (84.4286 => 83.5318, std.dev.: 0.0082) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.04% (6.6320 => 6.5631, std.dev.: 0.0116) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 20 23:35:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 21 Oct 2012 01:35:36 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121021063536.D06462A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5058?compare_to=5055&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5058, Order: 166386, Start Time: 2012-10-21 05:13:57, End Time: 2012-10-21 06:37:36 To: 5055, Order: 166384, Start Time: 2012-10-21 03:34:02, End Time: 2012-10-21 04:57:18 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 9 (20 on baseline) Performance Improvements: 2 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 964 (950 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 9.80% (0.1102 => 0.1210, std.dev.: 0.0025) MultiSource/Applications/viterbi/viterbi: 9.21% (0.1509 => 0.1648, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.78% (0.9268 => 0.9618, std.dev.: 0.0072) MultiSource/Applications/treecc/treecc: 2.52% (1.9883 => 2.0384, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.25% (1.5048 => 1.8847, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.04% (0.3252 => 0.3481, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.34% (2.6840 => 2.7736, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 1.33% (1.4015 => 1.4201, std.dev.: 0.0050) SingleSource/Benchmarks/McGill/chomp: 1.21% (1.1103 => 1.1237, std.dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.18% (0.9062 => 0.8864, std.dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: -4.31% (0.9040 => 0.8650, std.dev.: 0.0108) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.11% (16.5349 => 16.5175, std.dev.: 0.0032) MultiSource/Applications/obsequi/Obsequi: -0.26% (1.0382 => 1.0355, std.dev.: 0.0135) MultiSource/Applications/sqlite3/sqlite3: 0.20% (0.6343 => 0.6356, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: -5.29% (0.1909 => 0.1808, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.63% (0.1671 => 0.1577, std.dev.: 0.0056) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.43% (0.3229 => 0.3215, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.48% (0.2482 => 0.2494, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.73% (0.3289 => 0.3346, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.30% (0.2345 => 0.2399, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/bigfib: 0.13% (0.5954 => 0.5962, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -1.22% (0.0492 => 0.0486, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.67% (0.3285 => 0.3307, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/strcat: -0.25% (0.2003 => 0.1998, std.dev.: 0.0060) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -8.58% (0.0233 => 0.0213, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.94% (0.0212 => 0.0214, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.24% (0.0421 => 0.0420, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 6.07% (0.0280 => 0.0297, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 6.23% (0.0289 => 0.0307, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 7.40% (0.0392 => 0.0421, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -7.22% (0.0194 => 0.0180, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/test1: -29.52% (0.0210 => 0.0148, std.dev.: 0.0032) SingleSource/UnitTests/byval-alignment: 6.46% (0.0263 => 0.0280, std.dev.: 0.0027) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.48% (0.1468 => 0.1475, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 2.70% (1.1177 => 1.1479, std.dev.: 0.0126) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 2.14% (0.1448 => 0.1479, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.45% (0.4137 => 0.4077, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.27% (0.1368 => 0.1399, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.22% (0.0637 => 0.0591, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -18.38% (0.0272 => 0.0222, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.16% (0.0576 => 0.0529, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.15% (1.1421 => 1.1438, std.dev.: 0.0528) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 600.00% (0.0001 => 0.0007, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.18% (0.0599 => 0.0550, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.53% (0.0259 => 0.0211, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.40% (0.7972 => 0.8004, std.dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -39.13% (0.0115 => 0.0070, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.96% (2.1832 => 1.6600, std.dev.: 0.0089) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.46% (0.0810 => 0.0919, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.15% (0.2180 => 0.2314, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.34% (0.3137 => 0.3273, std.dev.: 0.0019) MultiSource/Applications/sgefa/sgefa: 3.43% (0.2999 => 0.3102, std.dev.: 0.0031) MultiSource/Applications/treecc/treecc: 2.19% (1.9948 => 2.0384, std.dev.: 0.0047) MultiSource/Applications/hbd/hbd: 2.15% (1.4269 => 1.4576, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.01% (1.4479 => 1.4770, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.37% (0.9688 => 0.9821, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.01% (1.2423 => 1.2548, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 59.00% (1.5795 => 2.5114, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.26% (0.3186 => 0.3481, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.39% (1.1857 => 1.2852, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 5.92% (63.1822 => 66.9229, std.dev.: 0.0982) MultiSource/Applications/siod/siod: 2.59% (3.6643 => 3.7591, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/ReedSolomon: 2.18% (8.5322 => 8.7178, std.dev.: 0.0534) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.03% (2.4490 => 2.4986, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.96% (44.5605 => 45.4342, std.dev.: 0.1954) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.44% (1.5941 => 1.6170, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.14% (4.8362 => 4.8914, std.dev.: 0.0143) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.06% (1.1365 => 1.1485, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.38% (0.3269 => 0.2995, std.dev.: 0.0011) MultiSource/Applications/lua/lua: -4.92% (29.8330 => 28.3663, std.dev.: 0.0371) SingleSource/Benchmarks/Shootout-C++/hash2: -1.46% (3.4237 => 3.3737, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.37% (3.3479 => 3.3021, std.dev.: 0.0121) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.43% (16.4461 => 16.5175, std.dev.: 0.0032) MultiSource/Applications/obsequi/Obsequi: 0.91% (1.0262 => 1.0355, std.dev.: 0.0135) MultiSource/Applications/sqlite3/sqlite3: 0.38% (0.6332 => 0.6356, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: -1.26% (0.1831 => 0.1808, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.15% (0.1559 => 0.1577, std.dev.: 0.0056) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.95% (0.3123 => 0.3215, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (0.2463 => 0.2494, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.06% (0.3344 => 0.3346, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.48% (0.2364 => 0.2399, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/bigfib: -0.80% (0.6010 => 0.5962, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: 13.29% (0.0429 => 0.0486, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.26% (0.3266 => 0.3307, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/strcat: 1.47% (0.1969 => 0.1998, std.dev.: 0.0060) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -4.91% (0.0224 => 0.0213, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 73.98% (0.0123 => 0.0214, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.94% (0.0408 => 0.0420, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 16.93% (0.0254 => 0.0297, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.66% (0.0302 => 0.0307, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.64% (0.0384 => 0.0421, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -5.26% (0.0190 => 0.0180, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/test1: -17.78% (0.0180 => 0.0148, std.dev.: 0.0032) SingleSource/UnitTests/byval-alignment: 21.74% (0.0230 => 0.0280, std.dev.: 0.0027) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.57% (0.1438 => 0.1475, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 1.32% (1.1329 => 1.1479, std.dev.: 0.0126) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.16% (0.1462 => 0.1479, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.09% (0.4164 => 0.4077, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.19% (0.1369 => 0.1399, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.80% (0.0641 => 0.0591, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 13.85% (0.0195 => 0.0222, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.48% (0.0578 => 0.0529, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.01% (1.1437 => 1.1438, std.dev.: 0.0528) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 600.00% (0.0001 => 0.0007, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.28% (0.0627 => 0.0550, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 17.22% (0.0180 => 0.0211, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.16% (0.8017 => 0.8004, std.dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 12.90% (0.0062 => 0.0070, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Report Time: 4.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 20 23:45:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 21 Oct 2012 01:45:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121021064518.C30322A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5059?compare_to=5056&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5059, Order: 166386, Start Time: 2012-10-21 05:27:13, End Time: 2012-10-21 06:47:19 To: 5056, Order: 166384, Start Time: 2012-10-21 03:37:32, End Time: 2012-10-21 04:57:41 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (75 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (190 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 90 (15 on baseline) Unchanged Tests: 952 (650 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.03% (0.6245 => 0.6243, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 0.05% (17.2214 => 17.2308, std.dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: 0.38% (56.0057 => 56.2190, std.dev.: 0.0144) MultiSource/Benchmarks/MallocBench/gs/gs: -0.01% (4.5780 => 4.5775, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.63% (0.0480 => 0.0483, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.42% (0.0481 => 0.0483, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.44% (0.0450 => 0.0452, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.44% (0.0451 => 0.0453, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.45% (0.0440 => 0.0442, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.23% (0.0442 => 0.0443, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.69% (0.0433 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.46% (0.0434 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.44% (0.0451 => 0.0453, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.88% (0.0452 => 0.0456, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.45% (0.0446 => 0.0448, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.22% (0.0447 => 0.0448, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.23% (0.0436 => 0.0437, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.46% (0.0437 => 0.0439, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.45% (0.0443 => 0.0445, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.45% (0.0444 => 0.0446, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.66% (0.0454 => 0.0457) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.44% (0.0455 => 0.0457, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.70% (0.0430 => 0.0433, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.46% (0.0432 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.45% (0.0443 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.45% (0.0444 => 0.0446, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.46% (0.0434 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.46% (0.0435 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.47% (0.0426 => 0.0428, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.47% (0.0428 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.47% (0.0425 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.47% (0.0426 => 0.0428) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.65% (0.0461 => 0.0464, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.43% (0.0463 => 0.0465, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.47% (0.0424 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.47% (0.0425 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.71% (0.0425 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.47% (0.0426 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.46% (0.0433 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.46% (0.0434 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.02% (1.2995 => 1.2998, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.12% (8.1829 => 8.1927, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.03% (0.7758 => 0.7756, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -1.96% (0.0357 => 0.0350, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: - (0.1432 => 0.1432) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 0.06% (0.1647 => 0.1648) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.05% (0.2139 => 0.2140, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.11% (63.2438 => 56.2190, std.dev.: 0.0144) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 0.55% (0.1639 => 0.1648) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 35.75% (14.1553 => 19.2165, std.dev.: 0.0287) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.56% (3.4629 => 5.7678, std.dev.: 0.0067) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13489.03% (0.0720 => 9.7841, std.dev.: 0.0121) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049700.00% (0.0001 => 10.0498, std.dev.: 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.86% (0.2554 => 0.4185, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/lowercase: 55.86% (0.0256 => 0.0399, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 53.56% (10.3673 => 15.9202, std.dev.: 0.0149) SingleSource/UnitTests/SignlessTypes/factor: 44.93% (0.0296 => 0.0429) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 40.73% (1.5859 => 2.2318, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/distray/distray: 36.65% (0.1056 => 0.1443, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 35.76% (0.1622 => 0.2202, std.dev.: 0.0020) SingleSource/UnitTests/vla: 32.11% (0.0355 => 0.0469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 29.63% (2.2024 => 2.8550, std.dev.: 0.0199) MultiSource/Benchmarks/FreeBench/neural/neural: 25.84% (0.1463 => 0.1841, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 25.78% (0.0834 => 0.1049, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.69% (0.1566 => 0.1890, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: 20.64% (0.2049 => 0.2472, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 20.04% (0.1432 => 0.1719, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 18.52% (0.1555 => 0.1843, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.51% (7.0540 => 8.3596, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.37% (0.0871 => 0.1031, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.85% (2.2022 => 2.5952, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.30% (0.5105 => 0.5988, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 16.85% (0.6675 => 0.7800, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.38% (0.2271 => 0.2643, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/chomp: 16.37% (0.1655 => 0.1926, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.23% (1.3050 => 1.5168, std.dev.: 0.0092) MultiSource/Applications/d/make_dparser: 16.12% (3.3354 => 3.8729, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.04% (0.0798 => 0.0926, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 15.75% (0.1695 => 0.1962, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 15.63% (0.1440 => 0.1665, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 15.40% (0.1175 => 0.1356, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 15.39% (0.1163 => 0.1342, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.18% (0.1337 => 0.1540, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 15.13% (0.0793 => 0.0913, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.12% (1.5415 => 1.7746, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.12% (0.1032 => 0.1188, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.06% (0.8172 => 0.9403, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/oourafft: 15.02% (0.3282 => 0.3775, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.02% (0.5020 => 0.5774, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.90% (0.1510 => 0.1735, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.90% (0.0886 => 0.1018, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 14.80% (0.7115 => 0.8168, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.75% (0.0746 => 0.0856, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 14.73% (0.3109 => 0.3567, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.61% (0.0842 => 0.0965, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.56% (0.0838 => 0.0960, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.43% (0.1940 => 0.2220, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.21% (4.2646 => 4.8707, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/18-imp/imp: 14.20% (0.3423 => 0.3909, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.15% (1.7609 => 2.0101, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.15% (0.1117 => 0.1275, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.14% (0.1584 => 0.1808, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/exptree: 14.13% (0.0814 => 0.0929, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.07% (0.3121 => 0.3560, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: 14.06% (0.0818 => 0.0933) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.05% (0.9765 => 1.1137, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.03% (0.2758 => 0.3145, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.98% (0.1438 => 0.1639, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.85% (0.1906 => 0.2170, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 13.83% (1.1642 => 1.3252, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.81% (0.2107 => 0.2398, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.75% (0.1236 => 0.1406, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 13.75% (9.4845 => 10.7887, std.dev.: 0.0128) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 13.64% (0.6450 => 0.7330, std.dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.63% (0.4615 => 0.5244, std.dev.: 0.0018) MultiSource/Applications/aha/aha: 13.55% (0.1151 => 0.1307, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.51% (0.0770 => 0.0874, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.41% (0.2065 => 0.2342, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.41% (8.1363 => 9.2271, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.40% (0.0933 => 0.1058, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 13.35% (5.7591 => 6.5279, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.34% (0.5860 => 0.6642, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.34% (1.4186 => 1.6079, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.18% (0.1062 => 0.1202, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 13.14% (10.4361 => 11.8069, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.12% (0.1029 => 0.1164, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 13.07% (0.7835 => 0.8859, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 13.01% (0.4879 => 0.5514, std.dev.: 0.0029) MultiSource/Applications/treecc/treecc: 12.93% (2.0273 => 2.2895, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.86% (0.1695 => 0.1913, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.81% (0.0929 => 0.1048, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 12.70% (0.1268 => 0.1429, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 12.69% (0.7433 => 0.8376, std.dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 12.68% (1.1840 => 1.3341, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.64% (4.9449 => 5.5698, std.dev.: 0.0118) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.63% (0.2700 => 0.3041, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 12.61% (0.4299 => 0.4841, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.60% (5.0018 => 5.6322, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.57% (0.5981 => 0.6733, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 12.53% (1.0722 => 1.2065, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.45% (0.8067 => 0.9071, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 12.43% (0.3177 => 0.3572, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/rem: 12.41% (0.1144 => 0.1286, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 12.30% (3.8723 => 4.3484, std.dev.: 0.0105) MultiSource/Benchmarks/sim/sim: 12.28% (0.3387 => 0.3803, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.25% (0.1625 => 0.1824, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.08% (0.5569 => 0.6242, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.03% (0.1330 => 0.1490, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.00% (0.3307 => 0.3704, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.99% (0.2603 => 0.2915, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.98% (1.1861 => 1.3282, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.81% (7.9617 => 8.9021, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/football/football: 11.73% (0.8921 => 0.9967, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/09-vor/vor: 11.51% (0.3180 => 0.3546, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.47% (0.1125 => 0.1254, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.16% (0.3441 => 0.3825, std.dev.: 0.0015) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.11% (0.1143 => 0.1270, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 11.06% (1.5603 => 1.7329, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: 11.06% (0.3092 => 0.3434, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 10.82% (0.3927 => 0.4352, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.81% (0.3543 => 0.3926, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.81% (0.3497 => 0.3875, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 10.80% (0.3473 => 0.3848, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.75% (0.3543 => 0.3924, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.73% (0.1892 => 0.2095, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 10.72% (0.6456 => 0.7148, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.68% (0.2266 => 0.2508, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.64% (0.3561 => 0.3940, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 10.63% (0.3828 => 0.4235, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.58% (0.3694 => 0.4085, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.53% (0.8101 => 0.8954, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-3: 10.52% (0.3516 => 0.3886, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 10.34% (2.2969 => 2.5345, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/property: 10.32% (0.3886 => 0.4287, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 9.89% (21.9371 => 24.1056, std.dev.: 0.0257) SingleSource/Benchmarks/Shootout-C++/hash: 9.75% (0.4289 => 0.4707, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 9.74% (0.4620 => 0.5070, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 9.38% (0.3422 => 0.3743, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.36% (0.3826 => 0.4184, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.29% (0.3865 => 0.4224, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.09% (0.4103 => 0.4476, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.99% (0.4203 => 0.4581, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.87% (0.4636 => 0.5047, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 8.84% (0.4048 => 0.4406, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.75% (0.3427 => 0.3727, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 8.52% (0.3684 => 0.3998, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.44% (0.6030 => 0.6539, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.34% (0.5925 => 0.6419, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 8.02% (0.3603 => 0.3892, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 7.89% (17.1811 => 18.5374, std.dev.: 0.0196) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.82% (0.2430 => 0.2620, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.79% (0.7326 => 0.7897, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.75% (14.3668 => 15.4800, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.64% (0.3650 => 0.3929, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.63% (3.8922 => 4.1893, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.58% (0.4064 => 0.4372, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 7.45% (0.2831 => 0.3042, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 7.39% (0.3098 => 0.3327, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.33% (0.3232 => 0.3469, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 7.28% (0.3283 => 0.3522, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.23% (0.2891 => 0.3100, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 7.16% (0.2905 => 0.3113, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.99% (0.3162 => 0.3383, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.96% (2.0665 => 2.2103, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.95% (0.3136 => 0.3354, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.95% (0.2793 => 0.2987, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.93% (0.2756 => 0.2947, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.90% (0.2871 => 0.3069, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.89% (0.2872 => 0.3070, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.79% (0.2725 => 0.2910, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.78% (0.3052 => 0.3259, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.69% (0.3379 => 0.3605, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.67% (0.2877 => 0.3069, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.60% (0.2802 => 0.2987, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.45% (0.2714 => 0.2889, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 6.10% (1.2842 => 1.3626, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 5.56% (0.3131 => 0.3305, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.07% (0.3817 => 0.3934, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.97% (1.1194 => 1.1527, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.92% (0.3935 => 0.4050, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.11% (1.1145 => 1.2941, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 10.01% (1.1396 => 1.2537, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 9.58% (0.9957 => 1.0911, std.dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3684, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 5.92% (1.9405 => 2.0554, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.62% (4.2280 => 4.3388, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.61% (0.3987 => 0.4091, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0313 => 1.0567, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.80% (3.6395 => 3.7049, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/bisort/bisort: 1.73% (0.8333 => 0.8477, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2077, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.47% (2.6546 => 2.6937, std.dev.: 0.0032) MultiSource/Applications/viterbi/viterbi: 1.27% (4.4649 => 4.5218, std.dev.: 0.0022) MultiSource/Applications/minisat/minisat: 1.23% (9.1159 => 9.2281, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.00% (6.5088 => 6.5741, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.00% (6.6874 => 0.1335, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -79.97% (0.8651 => 0.1733, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.67% (5.2763 => 3.2361, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.12% (5.3855 => 3.7096, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.64% (5.3526 => 3.7123, std.dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -14.63% (54.1659 => 46.2395, std.dev.: 0.0158) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.39% (2.9384 => 2.6332, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -6.68% (22.1758 => 20.6954, std.dev.: 0.0119) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.09% (8.0499 => 3.7765, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4750, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -16.06% (1.6925 => 1.4207, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.69% (1.2258 => 1.0702, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.69% (1.2373 => 1.0926, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3453 => 2.9599, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -10.80% (1.5373 => 1.3713, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.29% (19.9488 => 18.2957, std.dev.: 0.0144) MultiSource/Benchmarks/FreeBench/mason/mason: -7.73% (0.2161 => 0.1994, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.03% (1.8329 => 1.7040, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.24% (1.6805 => 1.5925, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7614) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5073, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.46% (8.1563 => 7.7924, std.dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.62% (3.2827 => 3.1638, std.dev.: 0.0018) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8777, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5017, std.dev.: 0.0056) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.04% (0.4808 => 0.4662, std.dev.: 0.0013) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0834, std.dev.: 0.0147) SingleSource/UnitTests/Vector/multiplies: -1.72% (2.5528 => 2.5088, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6825, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4209, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -1.41% (4.6441 => 4.5788, std.dev.: 0.0091) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.10% (2.3135 => 2.2880) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2355, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 19.39% (0.5229 => 0.6243, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 14.95% (14.9895 => 17.2308, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/gs/gs: 11.36% (4.1105 => 4.5775, std.dev.: 0.0164) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.65% (1.1048 => 1.2998, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.45% (7.1582 => 8.1927, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.65% (0.6222 => 0.7756, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 34900.00% (0.0001 => 0.0350, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: -3.57% (0.1485 => 0.1432) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.13% (0.2116 => 0.2140, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 21 00:04:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 21 Oct 2012 02:04:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121021070449.167AD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5060?compare_to=5057&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5060, Order: 166386, Start Time: 2012-10-21 05:40:04, End Time: 2012-10-21 07:07:49 To: 5057, Order: 166384, Start Time: 2012-10-21 03:44:33, End Time: 2012-10-21 05:10:41 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (202 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1042 (664 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.10% (2.0176 => 2.5038, std.dev.: 0.0580) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.13% (0.1410 => 0.1708, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 18.89% (0.0826 => 0.0982, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 18.41% (0.2243 => 0.2656, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 17.47% (0.1013 => 0.1190, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.02% (0.7710 => 0.9022, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.62% (0.0746 => 0.0870, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.54% (0.0653 => 0.0761, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.52% (0.2596 => 0.2999, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.30% (0.1327 => 0.1530, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 15.10% (0.2721 => 0.3132, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.75% (0.0834 => 0.0957, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.65% (0.0819 => 0.0939, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.51% (0.1413 => 0.1618, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.30% (0.0811 => 0.0927, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 14.28% (1.3693 => 1.5649, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.18% (0.9199 => 1.0503, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.17% (0.0847 => 0.0967, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.07% (0.0725 => 0.0827, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 14.06% (0.1003 => 0.1144, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.03% (0.0720 => 0.0821, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.88% (0.6959 => 0.7925, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.85% (0.1986 => 0.2261, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.78% (0.5637 => 0.6414, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.1588 => 0.1806, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.72% (3.9660 => 4.5103, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.67% (0.1075 => 0.1222, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 13.64% (0.7038 => 0.7998, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.50% (0.5265 => 0.5976, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.49% (0.0964 => 0.1094, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 13.41% (0.1111 => 0.1260, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 13.40% (0.7460 => 0.8460, std.dev.: 0.0017) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.25% (0.1072 => 0.1214, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 13.18% (0.1062 => 0.1202, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.17% (0.1276 => 0.1444, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 13.08% (0.4328 => 0.4894, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 13.07% (0.4062 => 0.4593, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.97% (0.2914 => 0.3292, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/distray/distray: 12.96% (0.0818 => 0.0924, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.90% (0.0977 => 0.1103, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 12.86% (0.1478 => 0.1668, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 12.71% (1.1061 => 1.2467, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.56% (1.2193 => 1.3724, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 12.55% (13.8202 => 15.5552, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.52% (0.1014 => 0.1141, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.48% (0.5577 => 0.6273, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.48% (1.4563 => 1.6380, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.35% (0.4379 => 0.4920, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.35% (0.6283 => 0.7059, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.28% (1.1364 => 1.2759, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.21% (0.2023 => 0.2270, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.17% (0.1865 => 0.2092, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 12.11% (0.3022 => 0.3388, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.05% (0.3899 => 0.4369, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.05% (0.3246 => 0.3637, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.93% (0.1157 => 0.1295, std.dev.: 0.0040) MultiSource/Applications/spiff/spiff: 11.90% (0.7506 => 0.8399, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.89% (0.2127 => 0.2380, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 11.83% (0.1657 => 0.1853, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.76% (0.3130 => 0.3498, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 11.76% (0.5818 => 0.6502, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 11.75% (0.2995 => 0.3347, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 11.71% (3.8646 => 4.3170, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.62% (0.3485 => 0.3890, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.62% (0.3580 => 0.3996, std.dev.: 0.0098) SingleSource/UnitTests/ObjC++/property-reference: 11.60% (0.7061 => 0.7880, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: 11.57% (0.5748 => 0.6413, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.56% (0.4791 => 0.5345, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 11.48% (0.0976 => 0.1088, std.dev.: 0.0033) SingleSource/Regression/C++/ofstream_ctor: 11.43% (0.2781 => 0.3099, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 11.42% (0.3293 => 0.3669, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 11.38% (0.2925 => 0.3258, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.38% (0.4016 => 0.4473, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 11.34% (1.0313 => 1.1482, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.26% (0.1048 => 0.1166, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.24% (0.3756 => 0.4178, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.21% (0.2782 => 0.3094, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 11.21% (0.3489 => 0.3880, std.dev.: 0.0114) MultiSource/Benchmarks/McCat/18-imp/imp: 11.18% (0.3220 => 0.3580, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.14% (0.4390 => 0.4879, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 11.09% (1.9270 => 2.1407, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 11.09% (1.9828 => 2.2026, std.dev.: 0.0665) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.07% (0.1789 => 0.1987, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 11.04% (0.3868 => 0.4295, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 11.01% (0.2726 => 0.3026, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 11.00% (0.3453 => 0.3833, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 10.97% (0.2761 => 0.3064, std.dev.: 0.0074) MultiSource/Applications/minisat/minisat: 10.93% (0.6744 => 0.7481, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.89% (7.2180 => 8.0039, std.dev.: 0.0055) SingleSource/Benchmarks/McGill/chomp: 10.89% (0.1589 => 0.1762, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 10.88% (0.1213 => 0.1345, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 10.83% (0.2760 => 0.3059, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 10.82% (0.2690 => 0.2981, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.80% (0.1435 => 0.1590, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.76% (0.2966 => 0.3285, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.71% (0.1569 => 0.1737, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.70% (0.2655 => 0.2939, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 10.69% (0.3107 => 0.3439, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 10.67% (0.3149 => 0.3485, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 10.66% (0.2937 => 0.3250, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 10.65% (3.1889 => 3.5286, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C/football/football: 10.60% (0.8310 => 0.9191, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 10.59% (0.2607 => 0.2883, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 10.58% (0.3534 => 0.3908, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 10.54% (16.6129 => 18.3633, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/ary2: 10.49% (0.3192 => 0.3527, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.49% (0.2765 => 0.3055, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.45% (0.8698 => 0.9607, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/fibo: 10.43% (0.2628 => 0.2902, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.40% (1.3245 => 1.4622, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.20% (0.2696 => 0.2971, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.19% (0.2140 => 0.2358, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 10.16% (2.1791 => 2.4006, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: 10.14% (0.2988 => 0.3291, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 10.13% (3.6692 => 4.0408, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.95% (4.3801 => 4.8161, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.94% (4.4433 => 4.8849, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/05-eks/eks: 9.90% (0.4113 => 0.4520, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.85% (0.3755 => 0.4125, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 9.75% (0.2945 => 0.3232, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.66% (4.9865 => 5.4680, std.dev.: 0.0207) MultiSource/Benchmarks/nbench/nbench: 9.51% (1.0594 => 1.1601, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.49% (0.6135 => 0.6717, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.44% (0.2321 => 0.2540, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 9.16% (14.8535 => 16.2138, std.dev.: 0.0114) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.14% (0.6576 => 0.7177, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.13% (0.1819 => 0.1985, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 9.09% (1.2749 => 1.3908, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 9.07% (0.3131 => 0.3415, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.00% (0.3511 => 0.3827, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 8.80% (4.6629 => 5.0733, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 8.80% (8.4961 => 9.2434, std.dev.: 0.2110) SingleSource/Benchmarks/Misc-C++/bigfib: 8.61% (0.6250 => 0.6788, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.58% (1.1333 => 1.2305, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.53% (0.8818 => 0.9570, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.50% (0.9108 => 0.9882, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.48% (1.5188 => 1.6476, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.41% (0.3245 => 0.3518, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 8.38% (0.1385 => 0.1501, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 8.37% (3.7467 => 4.0604, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.32% (3.2742 => 3.5466, std.dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 8.24% (6.5754 => 7.1174, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.16% (0.4805 => 0.5197, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 7.90% (1.2292 => 1.3263, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 7.82% (0.2008 => 0.2165, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.75% (0.2504 => 0.2698, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.74% (2.1007 => 2.2632, std.dev.: 0.0066) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.69% (6.2785 => 6.7616, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/parameter-passing: 7.69% (0.4003 => 0.4311, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 7.64% (0.3914 => 0.4213, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.49% (0.2243 => 0.2411, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 7.44% (0.3789 => 0.4071, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 7.44% (0.3940 => 0.4233, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.38% (13.2842 => 14.2645, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/trivial-interface: 7.38% (0.3578 => 0.3842, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.33% (0.3601 => 0.3865, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.30% (0.3646 => 0.3912, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.29% (0.3650 => 0.3916, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 7.21% (0.3663 => 0.3927, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 7.15% (0.3623 => 0.3882, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: 6.19% (0.1777 => 0.1887, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 5.54% (16.2614 => 17.1620, std.dev.: 0.0178) MultiSource/Applications/ClamAV/clamscan: 5.23% (14.5298 => 15.2900, std.dev.: 0.0143) MultiSource/Benchmarks/Olden/bh/bh: 4.20% (0.2859 => 0.2979, std.dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5148, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fbench: 25.02% (1.8175 => 2.2722, std.dev.: 0.0438) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.08% (1.0895 => 1.2756, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 11.22% (1.1560 => 1.2857, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 9.02% (0.8273 => 0.9019, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.47% (0.1322 => 0.1434, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.61% (3.1736 => 3.4150, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.43% (0.9692 => 1.0218, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 5.09% (1.2998 => 1.3660, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0039, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0008) SingleSource/Regression/C/uint64_to_float: 4.46% (0.5449 => 0.5692, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.45% (2.8606 => 2.9880, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.38% (12.0921 => 12.5005, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 3.37% (10.7476 => 11.1097, std.dev.: 0.0459) SingleSource/Benchmarks/Misc/flops-6: 3.31% (1.9199 => 1.9835, std.dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 3.22% (11.2619 => 11.6245, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bisort/bisort: 2.94% (0.8239 => 0.8481, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.41% (1.0310 => 1.0558, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.21% (7.4271 => 7.5912, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 1.78% (1.4298 => 1.4553, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5134, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.29% (3.1720 => 3.2128, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1874, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5785, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.17% (9.9194 => 10.0357, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5871, std.dev.: 0.0056) SingleSource/Benchmarks/McGill/queens: 1.00% (2.1753 => 2.1971, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.40% (0.2670 => 0.1431, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.76% (0.4657 => 0.3923, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.68% (1.3813 => 1.2200, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.49% (1.3819 => 1.2231, std.dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.29% (1.0460 => 0.8547, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/mason/mason: -13.00% (0.2238 => 0.1947, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.16% (20.3410 => 18.2751, std.dev.: 0.0161) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.82% (1.3780 => 1.2978, std.dev.: 0.0061) SingleSource/Benchmarks/McGill/chomp: -5.74% (1.2308 => 1.1602, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -4.97% (2.6470 => 2.5154, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.63% (0.9996 => 0.9533, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.87% (1.7688 => 1.7004, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.10% (0.4867 => 0.4716, std.dev.: 0.0015) MultiSource/Applications/siod/siod: -2.90% (3.2729 => 3.1779, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -2.89% (3.0263 => 2.9388, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: -2.73% (1.9762 => 1.9222, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8813, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.25% (4.1080 => 4.0155, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.94% (0.6589 => 0.6461, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.87% (0.6615 => 0.6491, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -1.78% (26.5159 => 26.0428, std.dev.: 0.0586) SingleSource/Benchmarks/Shootout/lists: -1.66% (6.3560 => 6.2502, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.65% (0.8342 => 0.8204, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.62% (2.5254 => 2.4845, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0065, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/heapsort: -1.38% (3.9173 => 3.8631, std.dev.: 0.0055) MultiSource/Applications/lambda-0_1_3/lambda: -1.32% (5.3167 => 5.2466, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.15% (6.6320 => 6.5558, std.dev.: 0.0128) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1139, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 21 01:16:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 21 Oct 2012 03:16:28 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121021081628.4DE412A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5061?compare_to=5058&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5061, Order: 166387, Start Time: 2012-10-21 06:54:31, End Time: 2012-10-21 08:18:28 To: 5058, Order: 166386, Start Time: 2012-10-21 05:13:57, End Time: 2012-10-21 06:37:36 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 15 (37 on baseline) Performance Improvements: 3 (6 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 957 (931 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/Burg/burg: 3.27% (1.2399 => 1.2804, std.dev.: 0.0117) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.86% (0.8223 => 0.8458, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.79% (1.2553 => 1.2903, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.24% (0.5991 => 0.6125, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 2.08% (0.6824 => 0.6966, std.dev.: 0.0047) SingleSource/UnitTests/Vector/constpool: 1.89% (8.5082 => 8.6692, std.dev.: 0.0471) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.76% (1.1870 => 1.2079, std.dev.: 0.0063) MultiSource/Applications/siod/siod: 1.55% (2.2362 => 2.2708, std.dev.: 0.0079) MultiSource/Applications/hexxagon/hexxagon: 1.39% (0.9879 => 1.0016, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 1.23% (14.3769 => 14.5533, std.dev.: 0.0544) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.15% (1.2474 => 1.2618, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.47% (41.6115 => 42.2213, std.dev.: 0.1393) SingleSource/Benchmarks/Misc/ReedSolomon: 1.21% (8.7178 => 8.8229, std.dev.: 0.0273) SingleSource/Benchmarks/Misc/mandel-2: 1.11% (2.8883 => 2.9204, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.03% (1.0505 => 1.0613, std.dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.35% (1.2548 => 1.2379, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.26% (0.9821 => 0.9697, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -6.12% (2.4081 => 2.2608, std.dev.: 0.0513) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.28% (16.5175 => 16.5634, std.dev.: 0.3318) MultiSource/Applications/obsequi/Obsequi: 2.11% (1.0355 => 1.0574, std.dev.: 0.0085) MultiSource/Applications/sqlite3/sqlite3: 0.46% (0.6356 => 0.6385, std.dev.: 0.0073) MultiSource/Benchmarks/McCat/08-main/main: 5.42% (0.1808 => 0.1906, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.83% (0.1577 => 0.1669, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.47% (0.3215 => 0.3230, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.36% (0.2494 => 0.2460, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.23% (0.3346 => 0.3305, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.50% (0.2399 => 0.2387, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/bigfib: 0.39% (0.5962 => 0.5985, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/mandel: -11.32% (0.0486 => 0.0431, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.24% (0.3307 => 0.3299, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: -0.10% (0.1998 => 0.1996, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -12.68% (0.0213 => 0.0186, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.93% (0.0214 => 0.0212, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.24% (0.0420 => 0.0421, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 9.43% (0.0297 => 0.0325, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.65% (0.0307 => 0.0309, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.19% (0.0421 => 0.0416, std.dev.: 0.0086) SingleSource/UnitTests/Vector/Altivec/casts: 10.00% (0.0180 => 0.0198) SingleSource/UnitTests/Vector/Altivec/test1: 42.57% (0.0148 => 0.0211, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 16.79% (0.0280 => 0.0327, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1475 => 0.1474, std.dev.: 0.0019) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.07% (1.1479 => 1.1602, std.dev.: 0.0126) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.20% (0.1479 => 0.1482, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.79% (0.4077 => 0.4150, std.dev.: 0.0212) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.57% (0.1399 => 0.1463, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.69% (0.0591 => 0.0601, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 23.42% (0.0222 => 0.0274, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.84% (0.0529 => 0.0544, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.59% (1.1438 => 1.1370, std.dev.: 0.0440) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 71.43% (0.0007 => 0.0012, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 900.00% (0.0001 => 0.0010, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.73% (0.0550 => 0.0576, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.11% (0.0211 => 0.0177, std.dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.37% (0.8004 => 0.7974, std.dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -42.86% (0.0070 => 0.0040, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.13% (2.1832 => 1.6563, std.dev.: 0.0292) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.67% (0.0810 => 0.0945, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 12.94% (0.0773 => 0.0873, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.86% (0.8321 => 0.8725, std.dev.: 0.0081) MultiSource/Applications/Burg/burg: 4.76% (1.2222 => 1.2804, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.64% (0.7473 => 0.7820, std.dev.: 0.0093) MultiSource/Applications/spiff/spiff: 4.55% (0.7950 => 0.8312, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.43% (0.2279 => 0.2380, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.08% (1.1606 => 1.2079, std.dev.: 0.0063) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.80% (0.8148 => 0.8458, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.01% (1.2526 => 1.2903, std.dev.: 0.0066) SingleSource/UnitTests/Vector/constpool: 2.99% (8.4179 => 8.6692, std.dev.: 0.0471) MultiSource/Applications/treecc/treecc: 2.91% (1.9948 => 2.0528, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.75% (0.5961 => 0.6125, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.69% (0.9435 => 0.9689, std.dev.: 0.0071) MultiSource/Applications/siod/siod: 2.36% (2.2184 => 2.2708, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.17% (1.4479 => 1.4793, std.dev.: 0.0052) MultiSource/Applications/d/make_dparser: 2.14% (3.2366 => 3.3058, std.dev.: 0.0260) MultiSource/Applications/SIBsim4/SIBsim4: 2.12% (1.2568 => 1.2835, std.dev.: 0.0084) MultiSource/Applications/hexxagon/hexxagon: 2.10% (0.9810 => 1.0016, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 2.05% (14.2605 => 14.5533, std.dev.: 0.0544) MultiSource/Applications/minisat/minisat: 1.93% (0.6834 => 0.6966, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.45% (4.4873 => 4.5524, std.dev.: 0.0214) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.36% (1.1685 => 1.1844, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.20% (13.1811 => 13.3395, std.dev.: 0.0182) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 59.04% (1.5795 => 2.5121, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.56% (1.1857 => 1.2872, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.19% (0.3186 => 0.3415, std.dev.: 0.0085) MultiSource/Benchmarks/mafft/pairlocalalign: 5.91% (63.1822 => 66.9134, std.dev.: 0.0927) SingleSource/Benchmarks/Misc/ReedSolomon: 3.41% (8.5322 => 8.8229, std.dev.: 0.0273) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.06% (2.4490 => 2.5239, std.dev.: 0.0188) MultiSource/Applications/siod/siod: 2.75% (3.6643 => 3.7650, std.dev.: 0.0144) MultiSource/Benchmarks/Olden/bh/bh: 2.07% (2.3560 => 2.4047, std.dev.: 0.0153) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.93% (41.4238 => 42.2213, std.dev.: 0.1393) SingleSource/Benchmarks/Shootout-C++/hash: 1.90% (0.6205 => 0.6323, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.37% (1.0470 => 1.0613, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.25% (1.0998 => 1.1135, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.11% (2.7551 => 2.7857, std.dev.: 0.0097) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -7.75% (3.2926 => 3.0373, std.dev.: 0.0716) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.49% (0.3269 => 0.3024, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -5.10% (29.8330 => 28.3106, std.dev.: 0.2112) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.54% (7.2130 => 6.8856, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout-C++/hash2: -1.44% (3.4237 => 3.3744, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/ffbench: -1.18% (1.4296 => 1.4127, std.dev.: 0.0056) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.71% (16.4461 => 16.5634, std.dev.: 0.3318) MultiSource/Applications/obsequi/Obsequi: 3.04% (1.0262 => 1.0574, std.dev.: 0.0085) MultiSource/Applications/sqlite3/sqlite3: 0.84% (0.6332 => 0.6385, std.dev.: 0.0073) MultiSource/Benchmarks/McCat/08-main/main: 4.10% (0.1831 => 0.1906, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.06% (0.1559 => 0.1669, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.43% (0.3123 => 0.3230, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.12% (0.2463 => 0.2460, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.17% (0.3344 => 0.3305, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.97% (0.2364 => 0.2387, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/bigfib: -0.42% (0.6010 => 0.5985, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/mandel: 0.47% (0.0429 => 0.0431, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.01% (0.3266 => 0.3299, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: 1.37% (0.1969 => 0.1996, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -16.96% (0.0224 => 0.0186, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 72.36% (0.0123 => 0.0212, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.19% (0.0408 => 0.0421, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 27.95% (0.0254 => 0.0325, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.32% (0.0302 => 0.0309, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 8.33% (0.0384 => 0.0416, std.dev.: 0.0086) SingleSource/UnitTests/Vector/Altivec/casts: 4.21% (0.0190 => 0.0198) SingleSource/UnitTests/Vector/Altivec/test1: 17.22% (0.0180 => 0.0211, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 42.17% (0.0230 => 0.0327, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.50% (0.1438 => 0.1474, std.dev.: 0.0019) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.41% (1.1329 => 1.1602, std.dev.: 0.0126) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.37% (0.1462 => 0.1482, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.34% (0.4164 => 0.4150, std.dev.: 0.0212) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.87% (0.1369 => 0.1463, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.24% (0.0641 => 0.0601, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 40.51% (0.0195 => 0.0274, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.88% (0.0578 => 0.0544, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.59% (1.1437 => 1.1370, std.dev.: 0.0440) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1100.00% (0.0001 => 0.0012, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -28.57% (0.0014 => 0.0010, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.13% (0.0627 => 0.0576, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.67% (0.0180 => 0.0177, std.dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.54% (0.8017 => 0.7974, std.dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -35.48% (0.0062 => 0.0040, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 21 01:39:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 21 Oct 2012 03:39:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121021083946.925872A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5062?compare_to=5059&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5062, Order: 166387, Start Time: 2012-10-21 07:21:13, End Time: 2012-10-21 08:41:47 To: 5059, Order: 166386, Start Time: 2012-10-21 05:27:13, End Time: 2012-10-21 06:47:19 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (75 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 3 (190 on baseline) Performance Improvements: 1 (45 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 90 (15 on baseline) Unchanged Tests: 948 (651 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.15% (78.4590 => 80.9275, std.dev.: 0.1086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.41% (55.2064 => 56.5343, std.dev.: 0.0434) SingleSource/Benchmarks/Shootout/ary3: 1.03% (3.6920 => 3.7301, std.dev.: 0.0086) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.57% (15.9202 => 15.6698, std.dev.: 0.0013) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.18% (0.6243 => 0.6232, std.dev.: 0.0042) MultiSource/Applications/SPASS/SPASS: -0.33% (17.2308 => 17.1743, std.dev.: 0.0228) MultiSource/Benchmarks/Bullet/bullet: -0.16% (56.2190 => 56.1265, std.dev.: 0.0861) MultiSource/Benchmarks/MallocBench/gs/gs: -0.17% (4.5775 => 4.5697, std.dev.: 0.0230) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.41% (0.0483 => 0.0481, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.21% (0.0483 => 0.0482, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.44% (0.0452 => 0.0450, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.44% (0.0453 => 0.0451, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.45% (0.0442 => 0.0440, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.23% (0.0443 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.46% (0.0436 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0436 => 0.0436) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.22% (0.0453 => 0.0452, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.66% (0.0456 => 0.0453, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.22% (0.0448 => 0.0447) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0448 => 0.0448, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0437 => 0.0437, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.23% (0.0439 => 0.0438) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.22% (0.0445 => 0.0444) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.45% (0.0446 => 0.0444, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.44% (0.0457 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.22% (0.0457 => 0.0456, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.23% (0.0433 => 0.0432, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.46% (0.0434 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.22% (0.0445 => 0.0444) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.22% (0.0446 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.23% (0.0436 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.23% (0.0437 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.23% (0.0428 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.47% (0.0430 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.47% (0.0427 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.23% (0.0428 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.22% (0.0464 => 0.0463, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.22% (0.0465 => 0.0464) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.47% (0.0426 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.47% (0.0427 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.47% (0.0428 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.47% (0.0428 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.46% (0.0435 => 0.0433) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.23% (0.0436 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.06% (1.2998 => 1.2990, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.25% (8.1927 => 8.1721, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.7756 => 0.7756, std.dev.: 0.0017) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0350 => 0.0350, std.dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 0.35% (0.1432 => 0.1437, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: - (0.1648 => 0.1648) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.33% (0.2140 => 0.2133, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.25% (63.2438 => 56.1265, std.dev.: 0.0861) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 0.55% (0.1639 => 0.1648) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 35.82% (14.1553 => 19.2256, std.dev.: 0.0233) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.53% (3.4629 => 5.7666, std.dev.: 0.0148) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13493.61% (0.0720 => 9.7874, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049700.00% (0.0001 => 10.0498, std.dev.: 0.0019) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.63% (0.2554 => 0.4179, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/lowercase: 55.47% (0.0256 => 0.0398, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 51.15% (10.3673 => 15.6698, std.dev.: 0.0013) SingleSource/UnitTests/SignlessTypes/factor: 44.26% (0.0296 => 0.0427, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 42.07% (0.0271 => 0.0385, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 40.65% (1.5859 => 2.2306, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/distray/distray: 36.36% (0.1056 => 0.1440, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 36.19% (0.1622 => 0.2209, std.dev.: 0.0006) SingleSource/UnitTests/vla: 31.83% (0.0355 => 0.0468, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 29.65% (2.2024 => 2.8555, std.dev.: 0.0077) MultiSource/Benchmarks/FreeBench/neural/neural: 25.77% (0.1463 => 0.1840, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 25.42% (0.0834 => 0.1046, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.50% (0.1566 => 0.1887, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: 20.25% (0.2049 => 0.2464, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 20.11% (0.1432 => 0.1720, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.38% (7.0540 => 8.3504, std.dev.: 0.0148) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.91% (0.0871 => 0.1027, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 17.75% (0.1555 => 0.1831, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.38% (2.2022 => 2.5849, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.26% (0.5105 => 0.5986, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 16.81% (0.6675 => 0.7797, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.29% (0.2271 => 0.2641, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 16.25% (0.1655 => 0.1924, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.08% (1.3050 => 1.5149, std.dev.: 0.0021) MultiSource/Applications/d/make_dparser: 16.03% (3.3354 => 3.8700, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/power/power: 15.56% (0.1440 => 0.1664, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 15.52% (0.1695 => 0.1958, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/tsp/tsp: 15.23% (0.1175 => 0.1354, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 15.22% (0.1163 => 0.1340, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 15.13% (0.0793 => 0.0913, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.03% (0.1337 => 0.1538, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.02% (0.1032 => 0.1187, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.95% (1.5415 => 1.7720, std.dev.: 0.0076) MultiSource/Benchmarks/VersaBench/dbms/dbms: 14.90% (0.8172 => 0.9390, std.dev.: 0.0121) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.90% (0.0886 => 0.1018, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.82% (0.5020 => 0.5764, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.77% (0.1510 => 0.1733, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 14.65% (0.7115 => 0.8157, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.61% (0.0842 => 0.0965, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/oourafft: 14.44% (0.3282 => 0.3756, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.34% (0.0746 => 0.0853, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.32% (0.0838 => 0.0958) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.29% (0.0770 => 0.0880, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.28% (0.1940 => 0.2217, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 14.25% (0.3109 => 0.3552, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.09% (0.9765 => 1.1141, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/18-imp/imp: 14.08% (0.3423 => 0.3905, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.06% (4.2646 => 4.8641, std.dev.: 0.0049) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 13.95% (0.1584 => 0.1805, std.dev.: 0.0042) MultiSource/Applications/Burg/burg: 13.95% (1.1642 => 1.3266, std.dev.: 0.0067) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.91% (0.3121 => 0.3555, std.dev.: 0.0061) SingleSource/Benchmarks/McGill/exptree: 13.88% (0.0814 => 0.0927, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.72% (0.2107 => 0.2396, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/matrix: 13.69% (0.0818 => 0.0930, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.67% (0.1236 => 0.1405, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 13.60% (9.4845 => 10.7742, std.dev.: 0.0250) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.57% (1.7609 => 1.9999, std.dev.: 0.0066) MultiSource/Applications/aha/aha: 13.55% (0.1151 => 0.1307, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.55% (8.1363 => 9.2389, std.dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.48% (0.1906 => 0.2163, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 13.44% (0.6450 => 0.7317, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.43% (0.1117 => 0.1267, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.40% (1.4186 => 1.6087, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.29% (0.5860 => 0.6639, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.28% (0.1438 => 0.1629, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.23% (0.2758 => 0.3123, std.dev.: 0.0052) MultiSource/Applications/oggenc/oggenc: 13.19% (5.7591 => 6.5190, std.dev.: 0.0030) MultiSource/Applications/spiff/spiff: 13.15% (0.7835 => 0.8865, std.dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.13% (0.4615 => 0.5221, std.dev.: 0.0030) MultiSource/Applications/JM/ldecod/ldecod: 13.12% (10.4361 => 11.8057, std.dev.: 0.0208) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.08% (0.2065 => 0.2335, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.92% (0.1695 => 0.1914, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 12.91% (2.0273 => 2.2891, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.86% (0.0933 => 0.1053, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 12.85% (0.7433 => 0.8388, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.83% (0.1029 => 0.1161, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.81% (0.1062 => 0.1198, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.78% (0.0798 => 0.0900, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.63% (0.2700 => 0.3041, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 12.62% (1.1840 => 1.3334, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.61% (0.5981 => 0.6735, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.59% (0.0929 => 0.1046, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.54% (0.4879 => 0.5491, std.dev.: 0.0033) MultiSource/Applications/lemon/lemon: 12.49% (1.0722 => 1.2061, std.dev.: 0.0010) SingleSource/UnitTests/SignlessTypes/rem: 12.41% (0.1144 => 0.1286, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 12.40% (0.3387 => 0.3807, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.40% (4.9449 => 5.5579, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.38% (0.8067 => 0.9066, std.dev.: 0.0104) MultiSource/Benchmarks/Olden/health/health: 12.38% (0.1268 => 0.1425, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.37% (0.1625 => 0.1826, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 12.33% (0.4299 => 0.4829, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.26% (5.0018 => 5.6150, std.dev.: 0.0104) MultiSource/Applications/lua/lua: 12.12% (3.8723 => 4.3416, std.dev.: 0.0164) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.99% (0.3177 => 0.3558, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.99% (0.2603 => 0.2915, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.98% (0.5569 => 0.6236, std.dev.: 0.0055) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.95% (0.1330 => 0.1489, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.95% (1.1861 => 1.3278, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.88% (0.3307 => 0.3700, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/football/football: 11.59% (0.8921 => 0.9955, std.dev.: 0.0029) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.58% (7.9617 => 8.8833, std.dev.: 0.0246) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.48% (0.3441 => 0.3836, std.dev.: 0.0029) MultiSource/Applications/hbd/hbd: 11.32% (1.5603 => 1.7370, std.dev.: 0.0107) MultiSource/Benchmarks/McCat/09-vor/vor: 11.29% (0.3180 => 0.3539, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.20% (0.1125 => 0.1251, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.20% (0.1143 => 0.1271, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 11.00% (0.3092 => 0.3432, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 10.92% (0.6456 => 0.7161, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.57% (0.1892 => 0.2092, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.54% (0.3473 => 0.3839, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.53% (0.3543 => 0.3916, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 10.52% (0.3927 => 0.4340, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.44% (0.3543 => 0.3913, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 10.42% (0.3828 => 0.4227, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.41% (0.3516 => 0.3882, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.41% (0.3497 => 0.3861, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.40% (0.3694 => 0.4078, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.39% (0.3561 => 0.3931, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.37% (0.2266 => 0.2501, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.37% (0.8101 => 0.8941, std.dev.: 0.0015) MultiSource/Applications/siod/siod: 10.25% (2.2969 => 2.5324, std.dev.: 0.0087) SingleSource/UnitTests/ObjC/property: 10.19% (0.3886 => 0.4282, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 9.91% (0.4289 => 0.4714, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 9.78% (0.4620 => 0.5072, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.51% (0.3826 => 0.4190, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.50% (0.3865 => 0.4232, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 9.43% (21.9371 => 24.0065, std.dev.: 0.0270) SingleSource/Benchmarks/Shootout-C++/lists: 9.41% (0.3422 => 0.3744, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.16% (0.4203 => 0.4588, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.95% (0.4636 => 0.5051, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.94% (0.4103 => 0.4470, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 8.84% (0.4048 => 0.4406, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 8.69% (0.3684 => 0.4004, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.67% (0.3427 => 0.3724, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.46% (0.6030 => 0.6540, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.44% (0.5925 => 0.6425, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 8.18% (17.1811 => 18.5858, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/sieve: 8.10% (0.3603 => 0.3895, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.89% (0.3650 => 0.3938, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.86% (0.2430 => 0.2621, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 7.73% (0.7326 => 0.7892, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.69% (3.8922 => 4.1916, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/strcat: 7.67% (0.2831 => 0.3048, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.65% (0.4064 => 0.4375, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.64% (0.3232 => 0.3479, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.56% (14.3668 => 15.4526, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary3: 7.55% (0.3283 => 0.3531, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 7.55% (0.3098 => 0.3332, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.51% (0.2891 => 0.3108, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.44% (0.2905 => 0.3121, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 7.23% (0.2725 => 0.2922, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.21% (0.3162 => 0.3390, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.16% (0.2793 => 0.2993, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 7.14% (0.3052 => 0.3270, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.12% (2.0665 => 2.2136, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.11% (0.3136 => 0.3359, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.10% (0.2872 => 0.3076, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 7.04% (0.3379 => 0.3617, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.04% (0.2756 => 0.2950, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: 7.00% (0.2871 => 0.3072, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.99% (0.2877 => 0.3078, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/random: 6.85% (0.2802 => 0.2994, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 6.74% (0.2714 => 0.2897, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 6.31% (1.2842 => 1.3652, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/objinst: 5.78% (0.3131 => 0.3312, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.97% (0.3935 => 0.4052, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.91% (0.3817 => 0.3928, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.81% (1.1194 => 1.1509, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.87% (1.1396 => 1.2521, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 9.65% (0.9957 => 1.0918, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash2: 6.72% (3.1578 => 3.3701, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/bh/bh: 5.93% (1.9405 => 2.0556, std.dev.: 0.0011) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.69% (4.2280 => 4.3419, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.61% (0.3987 => 0.4091, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0313 => 1.0567, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.87% (3.6395 => 3.7077, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/bisort/bisort: 1.70% (0.8333 => 0.8475, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2079, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.36% (2.6546 => 2.6908, std.dev.: 0.0019) MultiSource/Applications/viterbi/viterbi: 1.26% (4.4649 => 4.5212, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.10% (6.5088 => 6.5807, std.dev.: 0.0075) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.01% (6.6874 => 0.1330, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -79.98% (0.8651 => 0.1732, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.93% (5.2763 => 3.2223, std.dev.: 0.0134) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.30% (5.3855 => 3.6999, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.94% (5.3526 => 3.6967, std.dev.: 0.0046) SingleSource/UnitTests/Vector/constpool: -14.57% (54.1659 => 46.2754, std.dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.55% (2.9384 => 2.6284, std.dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: -6.66% (22.1758 => 20.6986, std.dev.: 0.0532) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.07% (8.0499 => 3.7776, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.44% (1.1492 => 0.7649, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4751, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.94% (1.6925 => 1.4227, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.53% (0.0998 => 0.0853, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.69% (1.2258 => 1.0703, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -11.52% (3.3453 => 2.9599, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.46% (1.2373 => 1.0955, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -10.73% (1.5373 => 1.3724, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.55% (19.9488 => 18.2441, std.dev.: 0.0478) MultiSource/Benchmarks/FreeBench/mason/mason: -8.01% (0.2161 => 0.1988, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.02% (1.8329 => 1.7042, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.17% (1.6805 => 1.5936, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.65% (1.5835 => 1.5098, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.24% (8.1563 => 7.8102, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.63% (3.2827 => 3.1635, std.dev.: 0.0056) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8776, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5030, std.dev.: 0.0053) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.45% (0.4808 => 0.4690, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0845, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6822, std.dev.: 0.0008) SingleSource/UnitTests/Vector/multiplies: -1.67% (2.5528 => 2.5101, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -1.51% (4.6441 => 4.5741, std.dev.: 0.0043) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4208, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2878, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 19.18% (0.5229 => 0.6232, std.dev.: 0.0042) MultiSource/Applications/SPASS/SPASS: 14.58% (14.9895 => 17.1743, std.dev.: 0.0228) MultiSource/Benchmarks/MallocBench/gs/gs: 11.17% (4.1105 => 4.5697, std.dev.: 0.0230) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.58% (1.1048 => 1.2990, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.16% (7.1582 => 8.1721, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.65% (0.6222 => 0.7756, std.dev.: 0.0017) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 34900.00% (0.0001 => 0.0350, std.dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: -3.23% (0.1485 => 0.1437, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.80% (0.2116 => 0.2133, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 21 02:02:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 21 Oct 2012 04:02:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121021090200.1FF5E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5063?compare_to=5060&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5063, Order: 166388, Start Time: 2012-10-21 07:38:56, End Time: 2012-10-21 09:05:00 To: 5060, Order: 166386, Start Time: 2012-10-21 05:40:04, End Time: 2012-10-21 07:07:49 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (202 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1041 (663 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.22% (0.6837 => 0.6685, std.dev.: 0.0007) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.12% (2.0176 => 2.5043, std.dev.: 0.0076) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.35% (0.1410 => 0.1711, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 18.64% (0.0826 => 0.0980, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 18.50% (0.2243 => 0.2658, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 17.47% (0.1013 => 0.1190, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.02% (0.0746 => 0.0873, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.67% (0.7710 => 0.8995, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.54% (0.0653 => 0.0761, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 15.14% (0.2721 => 0.3133, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.02% (0.2596 => 0.2986, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.88% (0.0847 => 0.0973, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.87% (0.0834 => 0.0958, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.77% (0.0819 => 0.0940, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.58% (0.1413 => 0.1619, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.55% (0.0811 => 0.0929, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 14.48% (1.3693 => 1.5676, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 14.26% (0.1003 => 0.1146, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.21% (0.0725 => 0.0828, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.16% (0.9199 => 1.0502, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.03% (0.0720 => 0.0821, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.00% (0.5637 => 0.6426, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.95% (0.1986 => 0.2263, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.87% (0.1327 => 0.1511, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.84% (3.9660 => 4.5150, std.dev.: 0.0104) MultiSource/Applications/lambda-0_1_3/lambda: 13.70% (0.7038 => 0.8002, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.67% (0.1075 => 0.1222, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.62% (0.6959 => 0.7907, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/mst/mst: 13.59% (0.1111 => 0.1262, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.59% (0.0964 => 0.1095, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 13.56% (0.1062 => 0.1206, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.54% (0.1588 => 0.1803, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.49% (0.2914 => 0.3307, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.49% (0.5265 => 0.5975, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.32% (0.1276 => 0.1446, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 13.22% (0.7460 => 0.8446, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.10% (0.0977 => 0.1105, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.97% (0.1072 => 0.1211, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 12.94% (0.4328 => 0.4888, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 12.86% (0.1478 => 0.1668, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: 12.81% (1.1061 => 1.2478, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.72% (0.1014 => 0.1143, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 12.71% (0.0818 => 0.0922) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.61% (0.5577 => 0.6280, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash: 12.56% (0.4062 => 0.4572, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.50% (1.1364 => 1.2784, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.49% (1.2193 => 1.3716, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 12.46% (13.8202 => 15.5427, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.45% (1.4563 => 1.6376, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.31% (0.2023 => 0.2272, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.27% (0.6283 => 0.7054, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.19% (0.1157 => 0.1298, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.06% (0.1865 => 0.2090, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.04% (0.2127 => 0.2383, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.03% (0.4379 => 0.4906, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 11.99% (0.7506 => 0.8406, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 11.95% (0.1657 => 0.1855, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.92% (0.3246 => 0.3633, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 11.76% (0.5818 => 0.6502, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.63% (0.3130 => 0.3494, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 11.61% (3.8646 => 4.3133, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.56% (0.3485 => 0.3888, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 11.55% (0.2995 => 0.3341, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.52% (0.3899 => 0.4348, std.dev.: 0.0087) SingleSource/UnitTests/ObjC++/Hello: 11.48% (0.5748 => 0.6408, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 11.45% (0.2925 => 0.3260, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 11.43% (0.2781 => 0.3099, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.40% (0.1789 => 0.1993, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.40% (0.4791 => 0.5337, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.39% (0.2782 => 0.3099) SingleSource/Benchmarks/Shootout-C++/lists: 11.39% (0.3293 => 0.3668, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.38% (0.4016 => 0.4473, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.35% (0.1048 => 0.1167, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 11.24% (0.3220 => 0.3582, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 11.23% (1.0313 => 1.1471, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 11.16% (1.9270 => 2.1420, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 11.13% (0.7061 => 0.7847, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.08% (0.3756 => 0.4172, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 11.07% (7.2180 => 8.0173, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 11.03% (0.3489 => 0.3874, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.02% (0.3022 => 0.3355, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 10.97% (0.6744 => 0.7484, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: 10.91% (0.3868 => 0.4290, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 10.90% (0.2726 => 0.3023, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 10.89% (0.1589 => 0.1762, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 10.88% (0.1213 => 0.1345, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 10.86% (0.3453 => 0.3828, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 10.73% (0.3149 => 0.3487, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 10.65% (0.3107 => 0.3438, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 10.65% (3.1889 => 3.5284, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.64% (0.3580 => 0.3961, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 10.60% (16.6129 => 18.3738, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.59% (1.9828 => 2.1927, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.58% (0.1569 => 0.1735, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 10.54% (0.2760 => 0.3051, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.52% (0.1435 => 0.1586, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 10.52% (0.8310 => 0.9184, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.51% (0.2140 => 0.2365, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hello: 10.51% (0.2607 => 0.2881, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 10.50% (0.2761 => 0.3051, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 10.48% (0.2690 => 0.2972, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.47% (0.8698 => 0.9609, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.47% (0.2655 => 0.2933, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 10.44% (0.3534 => 0.3903, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.38% (0.2765 => 0.3052, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.35% (1.3245 => 1.4616, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.35% (0.2966 => 0.3273, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 10.32% (0.2937 => 0.3240, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 10.31% (0.2628 => 0.2899, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 10.31% (0.3192 => 0.3521, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 10.28% (2.1791 => 2.4031, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.23% (0.4390 => 0.4839, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.98% (4.4433 => 4.8869, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.98% (0.2696 => 0.2965, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/matrix: 9.97% (0.2988 => 0.3286, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.97% (4.3801 => 4.8166, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.94% (3.6692 => 4.0341, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/05-eks/eks: 9.77% (0.4113 => 0.4515, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 9.61% (0.2945 => 0.3228, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.59% (0.3755 => 0.4115, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.54% (0.6135 => 0.6720, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.52% (0.2321 => 0.2542, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.52% (4.9865 => 5.4612, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.18% (0.1819 => 0.1986, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 9.18% (1.0594 => 1.1566, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.17% (0.6576 => 0.7179, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 9.16% (1.2749 => 1.3917, std.dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: 9.15% (14.8535 => 16.2123, std.dev.: 0.0182) MultiSource/Benchmarks/sim/sim: 9.04% (0.3131 => 0.3414, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 8.79% (4.6629 => 5.0726, std.dev.: 0.0123) MultiSource/Benchmarks/mafft/pairlocalalign: 8.73% (8.4961 => 9.2376, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.64% (1.1333 => 1.2312, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.63% (0.3511 => 0.3814, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.60% (0.8818 => 0.9576, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.59% (1.5188 => 1.6493, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.54% (0.3245 => 0.3522, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 8.50% (0.6250 => 0.6781, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 8.38% (3.7467 => 4.0606, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/neural/neural: 8.38% (0.1385 => 0.1501, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.37% (0.9108 => 0.9870, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.17% (3.2742 => 3.5416, std.dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 8.10% (6.5754 => 7.1077, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.07% (0.4805 => 0.5193, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 7.92% (0.2008 => 0.2167, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.87% (0.2504 => 0.2701, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 7.84% (0.4003 => 0.4317, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.80% (1.2292 => 1.3251, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.73% (6.2785 => 6.7637, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.69% (2.1007 => 2.2622, std.dev.: 0.0075) SingleSource/UnitTests/ObjC/exceptions: 7.64% (0.3914 => 0.4213, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.62% (0.2243 => 0.2414, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.34% (13.2842 => 14.2593, std.dev.: 0.0209) SingleSource/UnitTests/ObjC/property: 7.31% (0.3940 => 0.4228, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 7.26% (0.3789 => 0.4064, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.23% (0.3650 => 0.3914, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 7.21% (0.3646 => 0.3909, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 7.21% (0.3578 => 0.3836, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 7.18% (0.3663 => 0.3926, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 7.14% (0.3601 => 0.3858, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 7.09% (0.3623 => 0.3880, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: 6.13% (0.1777 => 0.1886, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 5.52% (16.2614 => 17.1596, std.dev.: 0.0112) MultiSource/Applications/ClamAV/clamscan: 5.13% (14.5298 => 15.2759, std.dev.: 0.0134) MultiSource/Benchmarks/Olden/bh/bh: 4.06% (0.2859 => 0.2975, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 2.98% (33.2944 => 34.2860, std.dev.: 0.0272) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.62% (5.7573 => 7.5204, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/fbench: 25.47% (1.8175 => 2.2804, std.dev.: 0.0240) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.10% (1.0895 => 1.2758, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 11.22% (1.1560 => 1.2857, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (3.1736 => 3.4149, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.43% (0.9692 => 1.0218, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: 5.25% (1.2998 => 1.3680, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0037, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0009) SingleSource/Regression/C/uint64_to_float: 4.46% (0.5449 => 0.5692, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.46% (2.8606 => 2.9881, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.40% (10.7476 => 11.1133, std.dev.: 0.0267) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9852, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.37% (12.0921 => 12.5002, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.21% (11.2619 => 11.6239, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bisort/bisort: 3.05% (0.8239 => 0.8490, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0310 => 1.0559, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.24% (7.4271 => 7.5934, std.dev.: 0.0049) MultiSource/Applications/lemon/lemon: 1.82% (1.4298 => 1.4558, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0498, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5144, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.31% (1.9433 => 1.9687, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2123, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1889, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/oourafft: 1.20% (5.5130 => 5.5789, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.18% (9.9194 => 10.0361, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.07% (12.4560 => 12.5887, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.01% (2.1753 => 2.1972, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.44% (0.2670 => 0.1430, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.78% (0.4657 => 0.3922, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.68% (1.3813 => 1.2199, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.53% (1.3819 => 1.2226, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.28% (1.0460 => 0.8548, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/mason/mason: -12.82% (0.2238 => 0.1951, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.10% (20.3410 => 18.2862, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.20% (1.9290 => 1.8094, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -5.61% (1.2308 => 1.1617, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.09% (1.3780 => 1.3078, std.dev.: 0.0181) SingleSource/UnitTests/Vector/multiplies: -5.01% (2.6470 => 2.5145, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.82% (0.9996 => 0.9514, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.93% (1.7688 => 1.6992, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.96% (0.4867 => 0.4723, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -2.88% (3.2729 => 3.1787, std.dev.: 0.0024) MultiSource/Applications/spiff/spiff: -2.86% (3.0263 => 2.9396, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: -2.70% (1.9762 => 1.9228, std.dev.: 0.0028) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8814, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.32% (4.1080 => 4.0125, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.99% (0.6589 => 0.6458, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.86% (0.6615 => 0.6492, std.dev.: 0.0013) MultiSource/Applications/lua/lua: -1.71% (26.5159 => 26.0630, std.dev.: 0.0379) SingleSource/Benchmarks/Shootout/lists: -1.69% (6.3560 => 6.2487, std.dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.67% (0.8342 => 0.8203, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.64% (2.5254 => 2.4839, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0065, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -1.24% (28.2225 => 27.8731, std.dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: -1.17% (5.3167 => 5.2543, std.dev.: 0.0001) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1138, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -1.05% (84.4286 => 83.5425, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout/heapsort: -1.04% (3.9173 => 3.8764, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 21 02:56:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 21 Oct 2012 04:56:36 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121021095636.472432A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5064?compare_to=5061&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5064, Order: 166388, Start Time: 2012-10-21 08:35:06, End Time: 2012-10-21 09:58:38 To: 5061, Order: 166387, Start Time: 2012-10-21 06:54:31, End Time: 2012-10-21 08:18:28 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 4 (30 on baseline) Performance Improvements: 7 (5 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 964 (939 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.81% (0.2048 => 0.2167, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/himenobmtxpa: 2.85% (4.3329 => 4.4564, std.dev.: 0.0278) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 1.84% (0.5698 => 0.5803, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.77% (6.8856 => 7.0078, std.dev.: 0.0277) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.71% (8.6692 => 8.3473, std.dev.: 0.0886) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -3.06% (1.2903 => 1.2508, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.57% (1.2079 => 1.1768, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.50% (1.3559 => 1.3355, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.65% (1.0613 => 1.0438, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -1.58% (42.2213 => 41.5554, std.dev.: 0.0947) SingleSource/Benchmarks/Misc/mandel-2: -1.15% (2.9204 => 2.8869, std.dev.: 0.0016) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.66% (16.5634 => 16.4548, std.dev.: 0.0612) MultiSource/Applications/obsequi/Obsequi: -1.77% (1.0574 => 1.0387, std.dev.: 0.0135) MultiSource/Applications/sqlite3/sqlite3: -1.25% (0.6385 => 0.6305, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/08-main/main: 2.68% (0.1906 => 0.1957, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.38% (0.1669 => 0.1646, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.31% (0.3230 => 0.3240, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.73% (0.2460 => 0.2478, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.39% (0.3305 => 0.3318, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.54% (0.2387 => 0.2374, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: -0.22% (0.5985 => 0.5972, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel: 5.10% (0.0431 => 0.0453, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.27% (0.3299 => 0.3308, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/strcat: 0.60% (0.1996 => 0.2008, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 29.03% (0.0186 => 0.0240, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -8.02% (0.0212 => 0.0195, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.19% (0.0421 => 0.0416, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -19.08% (0.0325 => 0.0263, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -10.36% (0.0309 => 0.0277, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.48% (0.0416 => 0.0418, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0198 => 0.0198, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: -34.60% (0.0211 => 0.0138, std.dev.: 0.0035) SingleSource/UnitTests/byval-alignment: 0.92% (0.0327 => 0.0330, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: - (0.1474 => 0.1474, std.dev.: 0.0053) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -3.73% (1.1602 => 1.1169, std.dev.: 0.0353) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 0.20% (0.1482 => 0.1485, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.75% (0.4150 => 0.4036, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.39% (0.1463 => 0.1428, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.83% (0.0601 => 0.0630, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -27.01% (0.0274 => 0.0200, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.21% (0.0544 => 0.0556, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.74% (1.1370 => 1.1454, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -91.67% (0.0012 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -30.00% (0.0010 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.47% (0.0576 => 0.0556, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.82% (0.0177 => 0.0172, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.68% (0.7974 => 0.7920, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 200.00% (0.0001 => 0.0003, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 102.50% (0.0040 => 0.0081, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.99% (2.1832 => 1.6595, std.dev.: 0.0028) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.83% (0.0810 => 0.0922, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/tsp/tsp: 10.07% (0.1112 => 0.1224, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.25% (0.2180 => 0.2338, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.22% (0.3137 => 0.3332, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.54% (0.8321 => 0.8782, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.46% (0.1905 => 0.2009, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.64% (0.2240 => 0.2344, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.31% (0.7473 => 0.7795, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.09% (0.4847 => 0.5045, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.44% (0.8148 => 0.8428, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.86% (0.6287 => 0.6467, std.dev.: 0.0061) MultiSource/Applications/hbd/hbd: 2.71% (1.4269 => 1.4656, std.dev.: 0.0108) MultiSource/Applications/treecc/treecc: 2.56% (1.9948 => 2.0458, std.dev.: 0.0193) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.98% (1.4479 => 1.4765, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.92% (0.9435 => 0.9616, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 1.63% (4.1305 => 4.1979, std.dev.: 0.0170) MultiSource/Applications/lua/lua: 1.59% (3.8189 => 3.8797, std.dev.: 0.0213) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.54% (6.6074 => 6.7092, std.dev.: 0.0332) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.40% (1.1606 => 1.1768, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.84% (1.5795 => 2.5089, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.45% (0.3186 => 0.3487, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.49% (1.1857 => 1.2864, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 5.97% (63.1822 => 66.9535, std.dev.: 0.0413) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.87% (0.7597 => 0.7891, std.dev.: 0.0039) MultiSource/Applications/siod/siod: 2.58% (3.6643 => 3.7589, std.dev.: 0.0238) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.32% (4.3552 => 4.4564, std.dev.: 0.0278) SingleSource/Benchmarks/Misc/ReedSolomon: 2.14% (8.5322 => 8.7152, std.dev.: 0.0517) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.22% (1.5941 => 1.6135, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.17% (4.4340 => 4.4859, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.01% (4.8362 => 4.8849, std.dev.: 0.0096) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.64% (0.3269 => 0.2954, std.dev.: 0.0028) MultiSource/Applications/lua/lua: -5.29% (29.8330 => 28.2554, std.dev.: 0.2365) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.84% (7.2130 => 7.0078, std.dev.: 0.0277) SingleSource/Benchmarks/Shootout-C++/hash2: -1.72% (3.4237 => 3.3647, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.25% (3.3479 => 3.3062, std.dev.: 0.0014) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.05% (16.4461 => 16.4548, std.dev.: 0.0612) MultiSource/Applications/obsequi/Obsequi: 1.22% (1.0262 => 1.0387, std.dev.: 0.0135) MultiSource/Applications/sqlite3/sqlite3: -0.43% (0.6332 => 0.6305, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/08-main/main: 6.88% (0.1831 => 0.1957, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.58% (0.1559 => 0.1646, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.75% (0.3123 => 0.3240, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.61% (0.2463 => 0.2478, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.78% (0.3344 => 0.3318, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.42% (0.2364 => 0.2374, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: -0.63% (0.6010 => 0.5972, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel: 5.59% (0.0429 => 0.0453, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.29% (0.3266 => 0.3308, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/strcat: 1.98% (0.1969 => 0.2008, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.14% (0.0224 => 0.0240, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 58.54% (0.0123 => 0.0195, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.96% (0.0408 => 0.0416, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 3.54% (0.0254 => 0.0263, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -8.28% (0.0302 => 0.0277, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 8.85% (0.0384 => 0.0418, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/casts: 4.21% (0.0190 => 0.0198, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: -23.33% (0.0180 => 0.0138, std.dev.: 0.0035) SingleSource/UnitTests/byval-alignment: 43.48% (0.0230 => 0.0330, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.50% (0.1438 => 0.1474, std.dev.: 0.0053) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -1.41% (1.1329 => 1.1169, std.dev.: 0.0353) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 1.57% (0.1462 => 0.1485, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.07% (0.4164 => 0.4036, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.31% (0.1369 => 0.1428, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.72% (0.0641 => 0.0630, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.56% (0.0195 => 0.0200, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.81% (0.0578 => 0.0556, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.15% (1.1437 => 1.1454, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -50.00% (0.0014 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.32% (0.0627 => 0.0556, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.44% (0.0180 => 0.0172, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.21% (0.8017 => 0.7920, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 200.00% (0.0001 => 0.0003, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 30.65% (0.0062 => 0.0081, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 2.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 21 03:30:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 21 Oct 2012 05:30:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121021103003.E1CDB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5065?compare_to=5062&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5065, Order: 166388, Start Time: 2012-10-21 09:11:25, End Time: 2012-10-21 10:32:04 To: 5062, Order: 166387, Start Time: 2012-10-21 07:21:13, End Time: 2012-10-21 08:41:47 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 1 (4 on baseline) Performance Regressions: 3 (194 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 949 (647 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -0.24% (0.1648 => 0.1644, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.45% (0.5221 => 0.5349, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 40.97% (2.9599 => 4.1726, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.95% (1.0918 => 1.1240, std.dev.: 0.0120) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.26% (0.6232 => 0.6248, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 0.33% (17.1743 => 17.2309, std.dev.: 0.0196) MultiSource/Benchmarks/Bullet/bullet: 0.21% (56.1265 => 56.2460, std.dev.: 0.0237) MultiSource/Benchmarks/MallocBench/gs/gs: 0.30% (4.5697 => 4.5836, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.42% (0.0481 => 0.0483) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.41% (0.0482 => 0.0484, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.44% (0.0450 => 0.0452, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.44% (0.0451 => 0.0453, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.45% (0.0440 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.23% (0.0442 => 0.0443) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.46% (0.0434 => 0.0436) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.23% (0.0436 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.22% (0.0452 => 0.0453, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.44% (0.0453 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.22% (0.0447 => 0.0448, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.22% (0.0448 => 0.0449, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.23% (0.0437 => 0.0438) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.23% (0.0438 => 0.0439, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.45% (0.0444 => 0.0446) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.45% (0.0444 => 0.0446, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.22% (0.0455 => 0.0456, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.22% (0.0456 => 0.0457, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.23% (0.0432 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.46% (0.0432 => 0.0434, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.23% (0.0444 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.22% (0.0445 => 0.0446) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.46% (0.0435 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.46% (0.0436 => 0.0438) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.23% (0.0427 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.23% (0.0428 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.47% (0.0425 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.23% (0.0427 => 0.0428, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.22% (0.0463 => 0.0464, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.22% (0.0464 => 0.0465, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.47% (0.0424 => 0.0426) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.47% (0.0425 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.23% (0.0426 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.47% (0.0426 => 0.0428, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.46% (0.0433 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.23% (0.0435 => 0.0436, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.19% (1.2990 => 1.3015, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.31% (8.1721 => 8.1977, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.48% (0.7756 => 0.7793, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.57% (0.0350 => 0.0352, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1437 => 0.1436, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.09% (0.2133 => 0.2135, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.06% (63.2438 => 56.2460, std.dev.: 0.0237) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 36.35% (14.1553 => 19.3009, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.90% (3.4629 => 5.7796, std.dev.: 0.0018) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13499.72% (0.0720 => 9.7918, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050000.00% (0.0001 => 10.0501, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.82% (0.2554 => 0.4184, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/lowercase: 56.25% (0.0256 => 0.0400, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 51.03% (10.3673 => 15.6580, std.dev.: 0.0119) SingleSource/UnitTests/SignlessTypes/factor: 46.28% (0.0296 => 0.0433, std.dev.: 0.0009) SingleSource/Regression/C/sumarray2d: 42.44% (0.0271 => 0.0386, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.16% (1.5859 => 2.2387, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/distray/distray: 36.27% (0.1056 => 0.1439, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 35.64% (0.1622 => 0.2200, std.dev.: 0.0004) SingleSource/UnitTests/vla: 32.39% (0.0355 => 0.0470, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.19% (2.2024 => 2.8674, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/neural/neural: 26.11% (0.1463 => 0.1845, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 25.18% (0.0834 => 0.1044, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 21.08% (0.2049 => 0.2481, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.88% (0.1566 => 0.1893, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 20.04% (0.1432 => 0.1719, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.43% (7.0540 => 8.3537, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.25% (0.0871 => 0.1030, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 18.01% (0.1555 => 0.1835, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.94% (0.5105 => 0.6021, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.40% (2.2022 => 2.5853, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.14% (0.6675 => 0.7819, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 16.56% (0.1655 => 0.1929, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.42% (0.0798 => 0.0929, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.33% (1.3050 => 1.5181, std.dev.: 0.0063) MultiSource/Applications/d/make_dparser: 16.20% (3.3354 => 3.8756, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/lists: 16.13% (0.0626 => 0.0727, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.12% (0.2271 => 0.2637, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/em3d/em3d: 15.99% (0.1695 => 0.1966, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.90% (0.4615 => 0.5349, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.50% (0.1032 => 0.1192, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 15.48% (0.1163 => 0.1343, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.44% (0.5020 => 0.5795, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 15.42% (0.1440 => 0.1662, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.35% (1.5415 => 1.7781, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/tsp/tsp: 15.23% (0.1175 => 0.1354, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.18% (0.1337 => 0.1540, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 15.13% (0.0793 => 0.0913, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.12% (0.0886 => 0.1020, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.03% (0.1510 => 0.1737, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 14.97% (0.7115 => 0.8180, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 14.92% (0.8172 => 0.9391, std.dev.: 0.0083) MultiSource/Applications/sgefa/sgefa: 14.83% (0.3109 => 0.3570, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.80% (0.0838 => 0.0962, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.73% (0.0842 => 0.0966, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/matrix: 14.55% (0.0818 => 0.0937, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.54% (0.1940 => 0.2222, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/exptree: 14.50% (0.0814 => 0.0932, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.48% (0.0746 => 0.0854, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.38% (4.2646 => 4.8778, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/18-imp/imp: 14.37% (0.3423 => 0.3915, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/oourafft: 14.35% (0.3282 => 0.3753, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.34% (0.9765 => 1.1165, std.dev.: 0.0048) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.26% (0.3121 => 0.3566, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.16% (0.1236 => 0.1411, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.14% (0.1584 => 0.1808, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 14.03% (1.1642 => 1.3275, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.99% (1.7609 => 2.0073, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.86% (0.2107 => 0.2399, std.dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 13.84% (9.4845 => 10.7976, std.dev.: 0.0125) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 13.81% (0.6450 => 0.7341, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.79% (0.1117 => 0.1271, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.77% (0.1438 => 0.1636, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 13.64% (0.1151 => 0.1308, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.64% (0.0770 => 0.0875, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.60% (0.2758 => 0.3133, std.dev.: 0.0039) MultiSource/Applications/spiff/spiff: 13.59% (0.7835 => 0.8900, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.54% (0.1906 => 0.2164, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.51% (8.1363 => 9.2353, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.45% (0.5860 => 0.6648, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.44% (1.4186 => 1.6092, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.37% (0.2065 => 0.2341, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.31% (0.1029 => 0.1166, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.29% (0.0933 => 0.1057, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.28% (0.1062 => 0.1203, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 13.22% (0.4879 => 0.5524, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 13.17% (5.7591 => 6.5175, std.dev.: 0.0119) MultiSource/Applications/treecc/treecc: 13.14% (2.0273 => 2.2937, std.dev.: 0.0035) MultiSource/Applications/JM/ldecod/ldecod: 13.10% (10.4361 => 11.8031, std.dev.: 0.0077) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.02% (0.0929 => 0.1050, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 13.01% (0.7433 => 0.8400, std.dev.: 0.0133) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.98% (0.1695 => 0.1915, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 12.84% (1.1840 => 1.3360, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.78% (0.2700 => 0.3045, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.77% (0.5981 => 0.6745, std.dev.: 0.0038) MultiSource/Applications/lemon/lemon: 12.69% (1.0722 => 1.2083, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.68% (0.1625 => 0.1831, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 12.62% (0.1268 => 0.1428, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 12.61% (0.4299 => 0.4841, std.dev.: 0.0012) SingleSource/UnitTests/SignlessTypes/rem: 12.59% (0.1144 => 0.1288, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.57% (4.9449 => 5.5663, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.55% (5.0018 => 5.6297, std.dev.: 0.0210) MultiSource/Benchmarks/sim/sim: 12.52% (0.3387 => 0.3811, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.46% (0.3307 => 0.3719, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.45% (0.8067 => 0.9071, std.dev.: 0.0113) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 12.40% (0.3177 => 0.3571, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 12.38% (3.8723 => 4.3515, std.dev.: 0.0156) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.26% (0.2603 => 0.2922, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.18% (0.1330 => 0.1492, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.07% (1.1861 => 1.3293, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.07% (0.5569 => 0.6241, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/football/football: 11.92% (0.8921 => 0.9984, std.dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.77% (7.9617 => 8.8989, std.dev.: 0.0056) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.73% (0.1125 => 0.1257, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 11.59% (1.5603 => 1.7411, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.57% (0.3543 => 0.3953, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.57% (0.3441 => 0.3839, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 11.51% (0.3180 => 0.3546, std.dev.: 0.0021) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.29% (0.1143 => 0.1272, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 11.28% (0.6456 => 0.7184, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 11.22% (0.3092 => 0.3439, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 11.17% (0.4289 => 0.4768, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-4: 10.98% (0.3543 => 0.3932, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 10.97% (0.3473 => 0.3854, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.92% (0.3927 => 0.4356, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 10.92% (0.3828 => 0.4246, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 10.87% (0.3561 => 0.3948, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.87% (0.3497 => 0.3877, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 10.81% (0.3516 => 0.3896, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 10.75% (0.3694 => 0.4091, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.68% (0.1892 => 0.2094, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.58% (0.8101 => 0.8958, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.55% (0.2266 => 0.2505, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 10.52% (0.3886 => 0.4295, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 10.36% (2.2969 => 2.5349, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash2: 10.35% (0.4620 => 0.5098, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 10.05% (0.3422 => 0.3766, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.04% (0.3826 => 0.4210, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.96% (0.3865 => 0.4250, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.92% (0.4203 => 0.4620, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 9.87% (0.1044 => 0.1147, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 9.63% (0.4048 => 0.4438, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 9.56% (21.9371 => 24.0340, std.dev.: 0.0249) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.53% (0.4636 => 0.5078, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.36% (0.4103 => 0.4487, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: 9.20% (0.3684 => 0.4023, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sieve: 8.96% (0.3603 => 0.3926, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.75% (0.3427 => 0.3727, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 8.52% (0.6030 => 0.6544, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.46% (0.5925 => 0.6426, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.36% (0.3650 => 0.3955, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 8.24% (17.1811 => 18.5974, std.dev.: 0.0195) SingleSource/Benchmarks/Shootout-C++/strcat: 8.23% (0.2831 => 0.3064, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 8.20% (0.3098 => 0.3352, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 8.16% (0.3283 => 0.3551, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.16% (0.2891 => 0.3127, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.12% (0.4064 => 0.4394, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 8.09% (0.2905 => 0.3140, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary: 8.08% (0.3232 => 0.3493, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.04% (0.7326 => 0.7915, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.94% (0.2430 => 0.2623, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.81% (0.2793 => 0.3011, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.80% (0.2756 => 0.2971, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.77% (3.8922 => 4.1948, std.dev.: 0.0190) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.76% (2.0665 => 2.2269, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary2: 7.75% (0.3379 => 0.3641, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.75% (14.3668 => 15.4805, std.dev.: 0.0208) SingleSource/Benchmarks/Shootout-C++/wc: 7.70% (0.3052 => 0.3287, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.70% (0.2871 => 0.3092, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.69% (0.3162 => 0.3405, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.67% (0.2725 => 0.2934, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.66% (0.2872 => 0.3092, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.63% (0.2714 => 0.2921, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.62% (0.3136 => 0.3375, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 7.47% (0.2877 => 0.3092, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/random: 7.39% (0.2802 => 0.3009, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 6.68% (1.2842 => 1.3700, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/objinst: 6.36% (0.3131 => 0.3330, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.46% (0.3935 => 0.4071, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.30% (0.3817 => 0.3943, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.81% (1.1194 => 1.1509, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1726, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 12.89% (0.9957 => 1.1240, std.dev.: 0.0120) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.79% (1.1396 => 1.2512, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 6.64% (3.1578 => 3.3674, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: 5.89% (1.9405 => 2.0547, std.dev.: 0.0010) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.86% (4.2280 => 4.3491, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.63% (0.3987 => 0.4092) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.40% (1.0313 => 1.0561, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.93% (3.6395 => 3.7096, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/bisort/bisort: 1.80% (0.8333 => 0.8483, std.dev.: 0.0013) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2075, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.44% (2.6546 => 2.6927, std.dev.: 0.0028) MultiSource/Applications/viterbi/viterbi: 1.22% (4.4649 => 4.5193, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.07% (6.5088 => 6.5784, std.dev.: 0.0017) MultiSource/Applications/minisat/minisat: 1.05% (9.1159 => 9.2118, std.dev.: 0.0262) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.01% (6.6874 => 0.1334, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -79.96% (0.8651 => 0.1734, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.78% (5.2763 => 3.2304, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.51% (5.3855 => 3.6883, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.98% (5.3526 => 3.6944, std.dev.: 0.0039) SingleSource/UnitTests/Vector/constpool: -14.65% (54.1659 => 46.2286, std.dev.: 0.0214) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.47% (2.9384 => 2.6307, std.dev.: 0.0040) MultiSource/Applications/ClamAV/clamscan: -6.60% (22.1758 => 20.7112, std.dev.: 0.0351) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.08% (8.0499 => 3.7769, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.53% (1.1492 => 0.7639, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.64% (2.9695 => 2.4753, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -16.12% (1.6925 => 1.4196, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.67% (1.2258 => 1.0705, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -12.41% (1.2373 => 1.0837, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/mandel-2: -10.95% (1.5373 => 1.3689, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.49% (19.9488 => 18.2545, std.dev.: 0.0396) MultiSource/Benchmarks/FreeBench/mason/mason: -7.82% (0.2161 => 0.1992, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.00% (1.8329 => 1.7046, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.17% (1.6805 => 1.5936, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5065, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.21% (8.1563 => 7.8133, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.73% (1.3677 => 1.3167, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.65% (3.2827 => 3.1629, std.dev.: 0.0048) MultiSource/Benchmarks/sim/sim: -3.39% (5.0483 => 4.8773, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5042, std.dev.: 0.0031) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.52% (0.4808 => 0.4687, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -2.31% (4.6441 => 4.5369, std.dev.: 0.0022) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0831, std.dev.: 0.0249) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6809, std.dev.: 0.0024) SingleSource/UnitTests/Vector/multiplies: -1.64% (2.5528 => 2.5110, std.dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4203, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout/lists: -1.14% (6.2999 => 6.2279, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2878, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8571, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 19.49% (0.5229 => 0.6248, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 14.95% (14.9895 => 17.2309, std.dev.: 0.0196) MultiSource/Benchmarks/MallocBench/gs/gs: 11.51% (4.1105 => 4.5836, std.dev.: 0.0188) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.80% (1.1048 => 1.3015, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.52% (7.1582 => 8.1977, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_container: 25.25% (0.6222 => 0.7793, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35100.00% (0.0001 => 0.0352, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.30% (0.1485 => 0.1436, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.90% (0.2116 => 0.2135, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 21 06:30:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 21 Oct 2012 08:30:26 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121021133026.4124A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5066?compare_to=5064&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5066, Order: 166389, Start Time: 2012-10-21 12:09:30, End Time: 2012-10-21 13:32:29 To: 5064, Order: 166388, Start Time: 2012-10-21 08:35:06, End Time: 2012-10-21 09:58:38 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 7 (15 on baseline) Performance Improvements: 2 (8 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 966 (951 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.45% (0.2257 => 0.2380, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.39% (0.8549 => 0.8668, std.dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: 1.18% (31.8213 => 32.1979, std.dev.: 0.0525) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 12.10% (3.3629 => 3.7697, std.dev.: 0.1294) MultiSource/Benchmarks/Olden/bh/bh: 1.57% (2.3717 => 2.4089, std.dev.: 0.0072) MultiSource/Applications/SPASS/SPASS: 1.36% (8.2016 => 8.3133, std.dev.: 0.0271) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.17% (8.2612 => 8.3577, std.dev.: 0.0348) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/treecc/treecc: -1.66% (2.0458 => 2.0118, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -1.00% (1.1183 => 1.1071, std.dev.: 0.0042) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.52% (16.4548 => 16.5406, std.dev.: 0.2451) MultiSource/Applications/obsequi/Obsequi: 1.45% (1.0387 => 1.0538, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: 1.40% (0.6305 => 0.6393, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/08-main/main: -4.09% (0.1957 => 0.1877, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.31% (0.1646 => 0.1684, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.40% (0.3240 => 0.3227, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.21% (0.2478 => 0.2448, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.15% (0.3318 => 0.3280, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.98% (0.2374 => 0.2421, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -0.30% (0.5972 => 0.5954, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel: -3.75% (0.0453 => 0.0436, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.45% (0.3308 => 0.3293, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/strcat: -1.89% (0.2008 => 0.1970, std.dev.: 0.0010) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -25.83% (0.0240 => 0.0178, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 8.72% (0.0195 => 0.0212, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.72% (0.0416 => 0.0419, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 23.57% (0.0263 => 0.0325, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 10.83% (0.0277 => 0.0307, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.24% (0.0418 => 0.0417, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -0.51% (0.0198 => 0.0197, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 52.90% (0.0138 => 0.0211, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -10.00% (0.0330 => 0.0297, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.22% (0.1474 => 0.1492, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.96% (1.1169 => 1.1276, std.dev.: 0.0573) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 0.20% (0.1485 => 0.1488, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.69% (0.4036 => 0.4064, std.dev.: 0.0382) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.99% (0.1428 => 0.1371, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -12.22% (0.0630 => 0.0553, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 5.50% (0.0200 => 0.0211, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.04% (0.0556 => 0.0528, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.25% (1.1454 => 1.1425, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -85.71% (0.0007 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.90% (0.0556 => 0.0551, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 9.30% (0.0172 => 0.0188, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.93% (0.7920 => 0.7994, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -66.67% (0.0003 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -49.38% (0.0081 => 0.0041, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.67% (2.1832 => 1.6664, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 9.89% (0.1112 => 0.1222, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.46% (0.2240 => 0.2340, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.43% (0.2279 => 0.2380, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.39% (1.4479 => 1.4825, std.dev.: 0.0085) MultiSource/Applications/Burg/burg: 2.10% (1.2222 => 1.2479, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.94% (1.1606 => 1.1831, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.76% (0.8518 => 0.8668, std.dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: 1.06% (31.8598 => 32.1979, std.dev.: 0.0525) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.61% (1.5795 => 2.5053, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.49% (1.1857 => 1.2864, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 5.91% (63.1822 => 66.9186, std.dev.: 0.0796) MultiSource/Applications/siod/siod: 2.65% (3.6643 => 3.7613, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/bh/bh: 2.25% (2.3560 => 2.4089, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/ReedSolomon: 2.23% (8.5322 => 8.7226, std.dev.: 0.0398) SingleSource/Benchmarks/Shootout-C++/hash: 1.69% (0.6205 => 0.6310, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.87% (0.3269 => 0.2979, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/heapsort: -8.09% (3.2926 => 3.0261, std.dev.: 0.0937) MultiSource/Applications/lua/lua: -4.41% (29.8330 => 28.5181, std.dev.: 0.1628) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.83% (1.0388 => 1.0198, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hash2: -1.50% (3.4237 => 3.3725, std.dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: -1.41% (8.4326 => 8.3133, std.dev.: 0.0271) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.33% (3.3479 => 3.3034, std.dev.: 0.0088) SingleSource/Benchmarks/McGill/chomp: -1.29% (1.1216 => 1.1071, std.dev.: 0.0042) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.57% (16.4461 => 16.5406, std.dev.: 0.2451) MultiSource/Applications/obsequi/Obsequi: 2.69% (1.0262 => 1.0538, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: 0.96% (0.6332 => 0.6393, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/08-main/main: 2.51% (0.1831 => 0.1877, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 8.02% (0.1559 => 0.1684, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.33% (0.3123 => 0.3227, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.61% (0.2463 => 0.2448, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.91% (0.3344 => 0.3280, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.41% (0.2364 => 0.2421, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -0.93% (0.6010 => 0.5954, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel: 1.63% (0.0429 => 0.0436, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.83% (0.3266 => 0.3293, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/strcat: 0.05% (0.1969 => 0.1970, std.dev.: 0.0010) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -20.54% (0.0224 => 0.0178, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 72.36% (0.0123 => 0.0212, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.70% (0.0408 => 0.0419, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 27.95% (0.0254 => 0.0325, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.66% (0.0302 => 0.0307, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 8.59% (0.0384 => 0.0417, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 3.68% (0.0190 => 0.0197, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 17.22% (0.0180 => 0.0211, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 29.13% (0.0230 => 0.0297, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 3.76% (0.1438 => 0.1492, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -0.47% (1.1329 => 1.1276, std.dev.: 0.0573) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 1.78% (0.1462 => 0.1488, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.40% (0.4164 => 0.4064, std.dev.: 0.0382) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.15% (0.1369 => 0.1371, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -13.73% (0.0641 => 0.0553, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.21% (0.0195 => 0.0211, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.65% (0.0578 => 0.0528, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.10% (1.1437 => 1.1425, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.12% (0.0627 => 0.0551, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.44% (0.0180 => 0.0188, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.29% (0.8017 => 0.7994, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -33.87% (0.0062 => 0.0041, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 21 06:40:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 21 Oct 2012 08:40:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121021134025.3B4AD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5067?compare_to=5065&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5067, Order: 166389, Start Time: 2012-10-21 12:22:14, End Time: 2012-10-21 13:42:26 To: 5065, Order: 166388, Start Time: 2012-10-21 09:11:25, End Time: 2012-10-21 10:32:04 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 0 (190 on baseline) Performance Improvements: 1 (45 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 952 (652 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.02% (2.2269 => 2.2042, std.dev.: 0.0023) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.29% (0.6248 => 0.6230, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -0.34% (17.2309 => 17.1716, std.dev.: 0.0137) MultiSource/Benchmarks/Bullet/bullet: -0.12% (56.2460 => 56.1770, std.dev.: 0.0171) MultiSource/Benchmarks/MallocBench/gs/gs: -0.30% (4.5836 => 4.5698, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.41% (0.0483 => 0.0481, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.41% (0.0484 => 0.0482, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.22% (0.0452 => 0.0451) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.22% (0.0453 => 0.0452, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.23% (0.0442 => 0.0441) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.23% (0.0443 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.46% (0.0436 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.23% (0.0437 => 0.0436) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.22% (0.0453 => 0.0452) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.22% (0.0455 => 0.0454) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.22% (0.0448 => 0.0447, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.22% (0.0449 => 0.0448) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.46% (0.0438 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.23% (0.0439 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.45% (0.0446 => 0.0444) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.22% (0.0446 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.22% (0.0456 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.16% (0.0457 => 0.0476, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.23% (0.0433 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.23% (0.0434 => 0.0433) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.22% (0.0445 => 0.0444, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.22% (0.0446 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.46% (0.0437 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.46% (0.0438 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.47% (0.0428 => 0.0426, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0429 => 0.0429, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.23% (0.0427 => 0.0426, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.23% (0.0428 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.22% (0.0464 => 0.0463, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.22% (0.0465 => 0.0464, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.23% (0.0426 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.23% (0.0427 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.23% (0.0427 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.23% (0.0428 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.23% (0.0435 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.23% (0.0436 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.22% (1.3015 => 1.2986, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.08% (8.1977 => 8.1912, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.65% (0.7793 => 0.7742, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.57% (0.0352 => 0.0354, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1436 => 0.1437, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.14% (0.2135 => 0.2202, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.17% (63.2438 => 56.1770, std.dev.: 0.0171) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 35.62% (14.1553 => 19.1977, std.dev.: 0.0131) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.48% (3.4629 => 5.7650, std.dev.: 0.0021) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13494.58% (0.0720 => 9.7881, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049800.00% (0.0001 => 10.0499, std.dev.: 0.0008) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.98% (0.2554 => 0.4188, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/lowercase: 56.25% (0.0256 => 0.0400) MultiSource/Benchmarks/PAQ8p/paq8p: 51.38% (10.3673 => 15.6944, std.dev.: 0.0049) SingleSource/UnitTests/SignlessTypes/factor: 45.61% (0.0296 => 0.0431, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 42.07% (0.0271 => 0.0385, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 40.83% (1.5859 => 2.2335, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/richards_benchmark: 36.56% (0.1622 => 0.2215, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/distray/distray: 36.46% (0.1056 => 0.1441, std.dev.: 0.0000) SingleSource/UnitTests/vla: 31.83% (0.0355 => 0.0468, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 29.74% (2.2024 => 2.8573, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/neural/neural: 25.56% (0.1463 => 0.1837, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 25.30% (0.0834 => 0.1045, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.24% (0.1566 => 0.1883, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 20.16% (0.2049 => 0.2462, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 19.76% (0.1432 => 0.1715) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.86% (7.0540 => 8.3846, std.dev.: 0.0090) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.91% (0.0871 => 0.1027, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.84% (2.2022 => 2.5950, std.dev.: 0.0025) MultiSource/Applications/viterbi/viterbi: 17.81% (0.1555 => 0.1832, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.30% (0.5105 => 0.5988, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 16.79% (0.6675 => 0.7796, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 16.19% (0.1655 => 0.1923, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.05% (1.3050 => 1.5144, std.dev.: 0.0013) MultiSource/Applications/d/make_dparser: 15.97% (3.3354 => 3.8680, std.dev.: 0.0136) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 15.68% (0.2271 => 0.2627, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 15.49% (0.1440 => 0.1663, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 15.46% (0.1695 => 0.1957, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.45% (0.4615 => 0.5328, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.26% (0.1337 => 0.1541, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 15.06% (0.1175 => 0.1352, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.03% (0.8172 => 0.9400, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/mst/mst: 14.96% (0.1163 => 0.1337, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.92% (0.1032 => 0.1186, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 14.87% (0.3282 => 0.3770, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.86% (0.5020 => 0.5766, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.82% (1.5415 => 1.7699, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 14.75% (0.0793 => 0.0910, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.67% (0.0886 => 0.1016, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.64% (0.1510 => 0.1731, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 14.52% (0.7115 => 0.8148, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.34% (0.0746 => 0.0853, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.27% (1.7609 => 2.0122, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.25% (0.0842 => 0.0962, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.23% (0.1940 => 0.2216, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.20% (0.0838 => 0.0957, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 14.15% (0.3109 => 0.3549, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.02% (0.1584 => 0.1806, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 13.99% (0.3423 => 0.3902, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.94% (4.2646 => 4.8592, std.dev.: 0.0043) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.84% (0.3121 => 0.3553, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.81% (0.9765 => 1.1114, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: 13.81% (0.0818 => 0.0931, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/exptree: 13.64% (0.0814 => 0.0925, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 13.63% (9.4845 => 10.7777, std.dev.: 0.0040) MultiSource/Applications/JM/ldecod/ldecod: 13.59% (10.4361 => 11.8539, std.dev.: 0.0093) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.57% (0.2107 => 0.2393, std.dev.: 0.0025) MultiSource/Applications/Burg/burg: 13.55% (1.1642 => 1.3219, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.52% (0.1117 => 0.1268, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 13.52% (5.7591 => 6.5375, std.dev.: 0.0127) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 13.38% (0.6450 => 0.7313, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.38% (8.1363 => 9.2249, std.dev.: 0.0060) MultiSource/Applications/aha/aha: 13.29% (0.1151 => 0.1304, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.28% (0.1438 => 0.1629, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.27% (0.1906 => 0.2159, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.27% (0.1236 => 0.1400, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.22% (0.2065 => 0.2338, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.18% (0.0933 => 0.1056, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.13% (0.2758 => 0.3120, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.12% (0.0770 => 0.0871, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.08% (1.4186 => 1.6042, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.07% (0.5860 => 0.6626, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.02% (0.1029 => 0.1163) MultiSource/Applications/spiff/spiff: 13.01% (0.7835 => 0.8854, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.99% (0.1062 => 0.1200, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.91% (0.0798 => 0.0901, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.85% (0.4879 => 0.5506, std.dev.: 0.0025) MultiSource/Applications/treecc/treecc: 12.69% (2.0273 => 2.2846, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.61% (4.9449 => 5.5683, std.dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.59% (0.0929 => 0.1046, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.57% (0.1695 => 0.1908, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 12.54% (0.4299 => 0.4838, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 12.53% (0.7433 => 0.8364, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.52% (0.2700 => 0.3038, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 12.52% (1.1840 => 1.3322, std.dev.: 0.0011) SingleSource/UnitTests/SignlessTypes/rem: 12.41% (0.1144 => 0.1286, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.38% (5.0018 => 5.6211, std.dev.: 0.0048) MultiSource/Applications/lemon/lemon: 12.38% (1.0722 => 1.2049, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 12.30% (0.1268 => 0.1424, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.27% (0.5981 => 0.6715, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 12.24% (0.3177 => 0.3566, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.20% (0.8067 => 0.9051, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 12.17% (3.8723 => 4.3434, std.dev.: 0.0132) MultiSource/Benchmarks/sim/sim: 12.16% (0.3387 => 0.3799, std.dev.: 0.0071) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.95% (0.1330 => 0.1489, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.94% (0.1625 => 0.1819, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.91% (0.3307 => 0.3701, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.91% (7.9617 => 8.9101, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.87% (0.2603 => 0.2912, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.80% (0.5569 => 0.6226, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.69% (1.1861 => 1.3247, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.56% (0.1125 => 0.1255, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 11.44% (0.8921 => 0.9942, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.29% (0.3543 => 0.3943, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 11.19% (0.3180 => 0.3536, std.dev.: 0.0012) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.02% (0.1143 => 0.1269, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 11.00% (1.5603 => 1.7320, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.93% (0.3441 => 0.3817, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 10.87% (0.3092 => 0.3428, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.86% (0.3473 => 0.3850, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 10.73% (0.3561 => 0.3943, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 10.73% (0.3543 => 0.3923, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.69% (0.3516 => 0.3892, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.69% (0.3694 => 0.4089, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.68% (0.1892 => 0.2094, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: 10.67% (0.3927 => 0.4346, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.67% (0.3497 => 0.3870, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 10.56% (0.6456 => 0.7138, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/property: 10.55% (0.3886 => 0.4296, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.53% (0.3828 => 0.4231, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.41% (0.2266 => 0.2502, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.25% (0.8101 => 0.8931, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 10.09% (2.2969 => 2.5287, std.dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 9.96% (21.9371 => 24.1211, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash: 9.61% (0.4289 => 0.4701, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 9.57% (0.4620 => 0.5062, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.23% (0.4636 => 0.5064, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.15% (0.3826 => 0.4176, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.11% (0.3865 => 0.4217, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 9.03% (0.3422 => 0.3731, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.85% (0.4203 => 0.4575, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 8.60% (0.4048 => 0.4396, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.51% (0.4103 => 0.4452, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.40% (0.3427 => 0.3715, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/lists1: 8.33% (0.3684 => 0.3991, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 8.20% (17.1811 => 18.5898, std.dev.: 0.0137) SingleSource/UnitTests/ObjC++/property-reference-object: 8.13% (0.6030 => 0.6520, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.10% (0.5925 => 0.6405, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 7.80% (0.3603 => 0.3884, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.65% (0.2430 => 0.2616, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.51% (3.8922 => 4.1845, std.dev.: 0.0218) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.51% (0.3650 => 0.3924, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.50% (14.3668 => 15.4449, std.dev.: 0.0149) SingleSource/UnitTests/ObjC++/property-reference: 7.48% (0.7326 => 0.7874, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.33% (0.2891 => 0.3103, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.28% (0.4064 => 0.4360, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/matrix: 7.26% (0.3098 => 0.3323, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 7.24% (0.2831 => 0.3036, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 7.09% (0.3232 => 0.3461, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.3283 => 0.3514, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.99% (0.2905 => 0.3108, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.95% (0.3136 => 0.3354, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.80% (0.3162 => 0.3377, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.73% (0.2793 => 0.2981, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.69% (0.2871 => 0.3063, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.68% (0.2756 => 0.2940, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.66% (2.0665 => 2.2042, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.62% (0.2872 => 0.3062, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.59% (0.3052 => 0.3253, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.57% (0.2725 => 0.2904, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary2: 6.54% (0.3379 => 0.3600, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.41% (0.2714 => 0.2888, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 6.40% (0.2877 => 0.3061, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.39% (0.2802 => 0.2981, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 5.94% (1.2842 => 1.3605, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (0.3131 => 0.3294, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.14% (1.1194 => 1.1546, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.12% (0.3817 => 0.3936, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.67% (0.3935 => 0.4040, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1725, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.14% (1.1145 => 1.2944, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.57% (0.9957 => 1.1308, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.80% (1.1396 => 1.2513, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3680, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: 5.95% (1.9405 => 2.0560, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.4162 => 0.4322, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.61% (0.3987 => 0.4091, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.52% (4.2280 => 4.3346, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.93% (3.6395 => 3.7098, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/bisort/bisort: 1.80% (0.8333 => 0.8483, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.59% (2.6546 => 2.6967, std.dev.: 0.0015) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2077, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 1.22% (4.4649 => 4.5195, std.dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.01% (6.6874 => 0.1332, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -79.85% (0.8651 => 0.1743, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.88% (5.2763 => 3.2250, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.92% (5.3855 => 3.7203, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.52% (5.3526 => 3.7192, std.dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -14.55% (54.1659 => 46.2851, std.dev.: 0.0251) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.33% (2.9384 => 2.6348, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -6.66% (22.1758 => 20.6995, std.dev.: 0.0069) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.09% (8.0499 => 3.7760, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.39% (1.1492 => 0.7655, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4750, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.67% (1.6925 => 1.4273, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.70% (1.2258 => 1.0701, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -12.38% (1.2373 => 1.0841, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/mandel-2: -11.15% (1.5373 => 1.3659, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.33% (19.9488 => 18.2878, std.dev.: 0.0154) MultiSource/Benchmarks/FreeBench/mason/mason: -7.82% (0.2161 => 0.1992, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.08% (1.8329 => 1.7031, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.64% (1.9577 => 1.8473, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -5.39% (1.5835 => 1.4981, std.dev.: 0.0051) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.17% (1.6805 => 1.5937, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.32% (8.1563 => 7.8036, std.dev.: 0.0091) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.65% (3.2827 => 3.1630, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -3.39% (5.0483 => 4.8774, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4944, std.dev.: 0.0067) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.77% (0.4808 => 0.4675, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -2.33% (4.6441 => 4.5360, std.dev.: 0.0016) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.84% (10.2830 => 10.0936, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6829, std.dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -1.66% (2.5528 => 2.5104, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4214, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2879, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8597, std.dev.: 0.0141) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 19.14% (0.5229 => 0.6230, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 14.56% (14.9895 => 17.1716, std.dev.: 0.0137) MultiSource/Benchmarks/MallocBench/gs/gs: 11.17% (4.1105 => 4.5698, std.dev.: 0.0130) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.54% (1.1048 => 1.2986, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.43% (7.1582 => 8.1912, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.43% (0.6222 => 0.7742, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35300.00% (0.0001 => 0.0354, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -3.23% (0.1485 => 0.1437, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.06% (0.2116 => 0.2202, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 21 06:46:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 21 Oct 2012 08:46:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121021134621.E51A92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5068?compare_to=5063&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5068, Order: 166389, Start Time: 2012-10-21 12:23:19, End Time: 2012-10-21 13:49:22 To: 5063, Order: 166388, Start Time: 2012-10-21 07:38:56, End Time: 2012-10-21 09:05:00 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (203 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1041 (663 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.68% (55.6768 => 56.6129, std.dev.: 0.0701) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.95% (2.0176 => 2.5008, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.13% (0.1410 => 0.1708, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 18.89% (0.0826 => 0.0982) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.19% (0.0819 => 0.0968, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 18.15% (0.2243 => 0.2650, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 17.37% (0.1013 => 0.1189, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.67% (0.7710 => 0.8995, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.62% (0.0746 => 0.0870, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.54% (0.0653 => 0.0761, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 15.69% (0.2721 => 0.3148, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.75% (0.2596 => 0.2979, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.75% (0.0834 => 0.0957, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.44% (0.1413 => 0.1617, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.30% (0.0811 => 0.0927, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 14.26% (0.1003 => 0.1146, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.17% (0.0847 => 0.0967, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.14% (0.9199 => 1.0500, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.07% (0.0725 => 0.0827, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 13.93% (1.3693 => 1.5601, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.89% (0.0720 => 0.0820, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.79% (0.1327 => 0.1510, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.77% (0.5637 => 0.6413, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 13.73% (0.7038 => 0.8004, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.65% (0.1986 => 0.2257, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.64% (3.9660 => 4.5069, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.59% (0.0964 => 0.1095, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.58% (0.1075 => 0.1221, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.58% (0.6959 => 0.7904, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.48% (0.1276 => 0.1448, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 13.37% (0.1062 => 0.1204, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.35% (0.1588 => 0.1800, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 13.32% (0.1111 => 0.1259, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.31% (0.5265 => 0.5966, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.25% (0.1072 => 0.1214, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 13.24% (0.7460 => 0.8448, std.dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.18% (0.2914 => 0.3298, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.90% (0.0977 => 0.1103, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 12.76% (1.1061 => 1.2472, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.74% (1.4563 => 1.6418, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 12.58% (0.1478 => 0.1664, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 12.55% (0.4328 => 0.4871, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.53% (0.5577 => 0.6276, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.52% (0.1014 => 0.1141) MultiSource/Benchmarks/FreeBench/distray/distray: 12.47% (0.0818 => 0.0920, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.38% (1.2193 => 1.3703, std.dev.: 0.0053) MultiSource/Applications/SPASS/SPASS: 12.30% (13.8202 => 15.5203, std.dev.: 0.0107) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.29% (1.1364 => 1.2761, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 12.17% (0.3130 => 0.3511, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.16% (0.2023 => 0.2269, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.16% (0.6283 => 0.7047, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.08% (0.4379 => 0.4908, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.06% (0.1865 => 0.2090) MultiSource/Applications/spiff/spiff: 11.95% (0.7506 => 0.8403, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.89% (0.3246 => 0.3632, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 11.89% (0.4062 => 0.4545, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 11.77% (0.1657 => 0.1852, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.75% (0.1157 => 0.1293, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.75% (0.2127 => 0.2377, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 11.54% (3.8646 => 4.3105, std.dev.: 0.0088) MultiSource/Applications/sgefa/sgefa: 11.49% (0.2995 => 0.3339, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 11.48% (0.5818 => 0.6486, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.44% (0.4791 => 0.5339, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 11.38% (0.2925 => 0.3258, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 11.22% (0.5748 => 0.6393, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.21% (0.3899 => 0.4336, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 11.20% (1.0313 => 1.1468, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.16% (0.1048 => 0.1165, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.12% (0.1789 => 0.1988, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 11.06% (0.3220 => 0.3576, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 11.05% (1.9270 => 2.1399, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.99% (0.3485 => 0.3868, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 10.98% (0.7061 => 0.7836, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.86% (7.2180 => 8.0020, std.dev.: 0.0066) MultiSource/Applications/minisat/minisat: 10.84% (0.6744 => 0.7475, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.84% (0.3756 => 0.4163, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 10.81% (0.3293 => 0.3649, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/health/health: 10.80% (0.1213 => 0.1344, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 10.79% (0.2781 => 0.3081, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.78% (0.4016 => 0.4449, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.78% (0.3489 => 0.3865, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 10.76% (0.1589 => 0.1760, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.67% (0.1819 => 0.2013, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.62% (0.3022 => 0.3343, std.dev.: 0.0081) MultiSource/Applications/kimwitu++/kc: 10.59% (16.6129 => 18.3729, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.53% (0.2782 => 0.3075, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.52% (0.1569 => 0.1734, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 10.50% (3.1889 => 3.5236, std.dev.: 0.0155) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.45% (0.1435 => 0.1585, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 10.42% (0.2726 => 0.3010, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 10.39% (0.3868 => 0.4270, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 10.37% (0.8310 => 0.9172, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.36% (0.3580 => 0.3951, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 10.28% (0.3453 => 0.3808, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.28% (0.8698 => 0.9592, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 10.24% (2.1791 => 2.4022, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary3: 10.19% (0.3149 => 0.3470, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/methcall: 10.18% (0.2761 => 0.3042, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.18% (1.3245 => 1.4593, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 10.14% (0.2760 => 0.3040, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 10.10% (0.3534 => 0.3891, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 10.07% (0.3107 => 0.3420, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.05% (0.2966 => 0.3264, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.00% (1.9828 => 2.1811, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.95% (0.4390 => 0.4827, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.95% (0.2140 => 0.2353, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.94% (0.2655 => 0.2919, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 9.93% (0.2690 => 0.2957, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.92% (3.6692 => 4.0331, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/hello: 9.86% (0.2607 => 0.2864, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/fibo: 9.86% (0.2628 => 0.2887, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 9.84% (0.2937 => 0.3226, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.82% (4.3801 => 4.8103, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.79% (4.4433 => 4.8785, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/ary2: 9.77% (0.3192 => 0.3504, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.76% (0.2765 => 0.3035, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 9.64% (0.2988 => 0.3276, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.57% (0.2696 => 0.2954, std.dev.: 0.0087) MultiSource/Benchmarks/McCat/05-eks/eks: 9.56% (0.4113 => 0.4506, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.48% (0.2321 => 0.2541, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.47% (4.9865 => 5.4589, std.dev.: 0.0117) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.34% (0.6135 => 0.6708, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 9.17% (0.2945 => 0.3215, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.16% (0.3755 => 0.4099, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 9.13% (14.8535 => 16.2100, std.dev.: 0.0106) MultiSource/Benchmarks/nbench/nbench: 9.09% (1.0594 => 1.1557, std.dev.: 0.0046) MultiSource/Applications/SIBsim4/SIBsim4: 9.03% (1.2749 => 1.3900, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.00% (0.6576 => 0.7168, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 8.88% (0.3131 => 0.3409, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 8.66% (8.4961 => 9.2318, std.dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.66% (0.3511 => 0.3815, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 8.56% (4.6629 => 5.0622, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.51% (1.1333 => 1.2297, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.49% (1.5188 => 1.6477, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/neural/neural: 8.38% (0.1385 => 0.1501, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.37% (0.8818 => 0.9556, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.32% (0.9108 => 0.9866, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.32% (0.3245 => 0.3515, std.dev.: 0.0085) MultiSource/Applications/lua/lua: 8.24% (3.7467 => 4.0554, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 8.18% (0.6250 => 0.6761, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.13% (3.2742 => 3.5404, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.11% (0.2504 => 0.2707, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.99% (0.4805 => 0.5189, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 7.95% (6.5754 => 7.0984, std.dev.: 0.0097) SingleSource/UnitTests/ObjC/exceptions: 7.87% (0.3914 => 0.4222, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.87% (0.4003 => 0.4318, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.74% (0.3940 => 0.4245, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: 7.67% (0.2008 => 0.2162, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.66% (2.1007 => 2.2617, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.65% (6.2785 => 6.7588, std.dev.: 0.0063) SingleSource/UnitTests/ObjC/for-in: 7.63% (0.3789 => 0.4078, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.57% (0.3578 => 0.3849, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.52% (0.3646 => 0.3920, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 7.48% (0.3663 => 0.3937, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 7.47% (0.3601 => 0.3870, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.42% (0.3623 => 0.3892, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.40% (0.2243 => 0.2409, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 7.39% (1.2292 => 1.3200, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.37% (0.3650 => 0.3919, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.31% (13.2842 => 14.2551, std.dev.: 0.0193) SingleSource/Benchmarks/Misc/ReedSolomon: 6.08% (0.1777 => 0.1885, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 5.51% (16.2614 => 17.1568, std.dev.: 0.0131) MultiSource/Applications/ClamAV/clamscan: 5.08% (14.5298 => 15.2675, std.dev.: 0.0126) MultiSource/Benchmarks/Olden/bh/bh: 3.95% (0.2859 => 0.2972, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 2.52% (33.2944 => 34.1348, std.dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5169, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/fbench: 24.40% (1.8175 => 2.2610, std.dev.: 0.0456) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.04% (1.0895 => 1.2752, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: 11.19% (1.1560 => 1.2854, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921) SingleSource/Benchmarks/Misc/ffbench: 9.03% (0.8273 => 0.9020, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4138, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.42% (0.9692 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 5.35% (1.2998 => 1.3694, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.69% (1.9144 => 2.0042, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: 4.48% (0.5449 => 0.5693) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.46% (2.8606 => 2.9882, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7752, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 3.75% (10.7476 => 11.1510, std.dev.: 0.0110) MultiSource/Applications/hexxagon/hexxagon: 3.38% (12.0921 => 12.5012, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: 3.38% (1.9199 => 1.9848, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.21% (11.2619 => 11.6230, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bisort/bisort: 3.07% (0.8239 => 0.8492, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.38% (1.0310 => 1.0555, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.15% (7.4271 => 7.5866, std.dev.: 0.0048) MultiSource/Applications/lemon/lemon: 1.77% (1.4298 => 1.4551, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5125, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9691, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1882, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5786, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.17% (9.9194 => 10.0359, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5871, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.02% (8.8259 => 8.9162, std.dev.: 0.0066) SingleSource/Benchmarks/McGill/queens: 1.00% (2.1753 => 2.1971, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.48% (0.2670 => 0.1429) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.48% (0.4657 => 0.3936, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.69% (1.3813 => 1.2198, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.53% (1.3819 => 1.2225, std.dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.29% (1.0460 => 0.8547, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -12.78% (0.2238 => 0.1952, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.12% (20.3410 => 18.2817, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2645, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: -5.65% (1.2308 => 1.1612, std.dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.17% (1.3780 => 1.3067, std.dev.: 0.0132) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.70% (0.9996 => 0.9526, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.78% (1.7688 => 1.7019, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.25% (0.4867 => 0.4709, std.dev.: 0.0008) MultiSource/Applications/siod/siod: -2.89% (3.2729 => 3.1782, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: -2.74% (3.0263 => 2.9434, std.dev.: 0.0028) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8813, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -2.70% (1.9762 => 1.9229, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.37% (4.1080 => 4.0108, std.dev.: 0.0028) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.96% (0.6589 => 0.6460, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.87% (0.6615 => 0.6491, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.77% (6.3560 => 6.2435, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.67% (0.8342 => 0.8203, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.66% (2.5254 => 2.4834, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0006) MultiSource/Applications/lua/lua: -1.63% (26.5159 => 26.0832, std.dev.: 0.0144) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0059, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.37% (5.3167 => 5.2436, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: -1.24% (28.2225 => 27.8726, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/heapsort: -1.23% (3.9173 => 3.8691, std.dev.: 0.0058) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1138, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -1.04% (84.4286 => 83.5485, std.dev.: 0.0055) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 21 09:54:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 21 Oct 2012 11:54:42 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121021165442.929452A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5069?compare_to=5066&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5069, Order: 166390, Start Time: 2012-10-21 15:32:09, End Time: 2012-10-21 16:56:45 To: 5066, Order: 166389, Start Time: 2012-10-21 12:09:30, End Time: 2012-10-21 13:32:29 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 11 (23 on baseline) Performance Improvements: 0 (3 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 964 (948 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/bh/bh: 5.80% (0.3033 => 0.3209, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.01% (0.8257 => 0.8423, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.26% (1.5349 => 1.5543, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.24% (0.8734 => 0.8842, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 15.29% (24.7917 => 28.5830, std.dev.: 0.0700) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.12% (0.3233 => 0.3528, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.32% (0.2979 => 0.3197, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/mason/mason: 1.94% (0.5404 => 0.5509, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 1.17% (8.9528 => 9.0576, std.dev.: 0.0167) MultiSource/Applications/JM/lencod/lencod: 1.05% (6.6658 => 6.7356, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout-C++/lists: 1.02% (16.6827 => 16.8526, std.dev.: 0.0512) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 1.15% (16.5406 => 16.7312, std.dev.: 0.2278) MultiSource/Applications/obsequi/Obsequi: 1.11% (1.0538 => 1.0655, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 0.22% (0.6393 => 0.6407, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: 4.26% (0.1877 => 0.1957, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.91% (0.1684 => 0.1635, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.15% (0.3227 => 0.3232, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.21% (0.2448 => 0.2502, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.50% (0.3280 => 0.3362, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.50% (0.2421 => 0.2409, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 0.22% (0.5954 => 0.5967, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel: -13.76% (0.0436 => 0.0376, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.06% (0.3293 => 0.3295, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/strcat: 0.81% (0.1970 => 0.1986, std.dev.: 0.0025) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 46.07% (0.0178 => 0.0260, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0212 => 0.0212, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.48% (0.0419 => 0.0421, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0325 => 0.0325, std.dev.: 0.0046) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.33% (0.0307 => 0.0308, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.72% (0.0417 => 0.0414, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: 0.51% (0.0197 => 0.0198, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0211 => 0.0211, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 20.20% (0.0297 => 0.0357, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 1300.00% (0.0001 => 0.0014) MultiSource/Applications/ClamAV/clamscan: -1.81% (0.1492 => 0.1465, std.dev.: 0.0031) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.06% (1.1276 => 1.1508, std.dev.: 0.0479) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 1.95% (0.1488 => 0.1517, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.30% (0.4064 => 0.4198, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.50% (0.1371 => 0.1419, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.67% (0.0553 => 0.0612, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 27.96% (0.0211 => 0.0270, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.20% (0.0528 => 0.0603, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.17% (1.1425 => 1.1444, std.dev.: 0.0274) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 800.00% (0.0001 => 0.0009, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 20.33% (0.0551 => 0.0663, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 42.02% (0.0188 => 0.0267, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.25% (0.7994 => 0.8014, std.dev.: 0.0084) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 70.73% (0.0041 => 0.0070, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.88% (2.1832 => 1.6618, std.dev.: 0.0008) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-12-11-LoadConstants: 10.08% (0.1091 => 0.1201, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.58% (0.1425 => 0.1533, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 7.50% (0.2985 => 0.3209, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.06% (0.2180 => 0.2334, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/em3d/em3d: 6.04% (0.1721 => 0.1825, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.27% (0.2279 => 0.2399, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.87% (0.7473 => 0.7837, std.dev.: 0.0117) MultiSource/Applications/spiff/spiff: 4.00% (0.7950 => 0.8268, std.dev.: 0.0070) MultiSource/Applications/Burg/burg: 3.73% (1.2222 => 1.2678, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.74% (0.4127 => 0.4240, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.62% (1.1606 => 1.1910, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.93% (8.6476 => 8.8144, std.dev.: 0.0552) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.81% (6.6074 => 6.7267, std.dev.: 0.0410) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.49% (0.8712 => 0.8842, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.49% (1.5315 => 1.5543, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.46% (0.7932 => 0.8048, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.03% (3.1832 => 3.2161, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.91% (1.5795 => 2.5100, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.73% (0.3186 => 0.3528, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.43% (1.1857 => 1.2857, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 5.96% (63.1822 => 66.9480, std.dev.: 0.1128) MultiSource/Applications/siod/siod: 2.73% (3.6643 => 3.7645, std.dev.: 0.0138) SingleSource/Benchmarks/Misc/ReedSolomon: 2.28% (8.5322 => 8.7270, std.dev.: 0.0267) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -3.80% (29.8330 => 28.6991, std.dev.: 0.1217) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.78% (7.2130 => 7.0126, std.dev.: 0.0716) SingleSource/Benchmarks/Shootout-C++/hash2: -1.36% (3.4237 => 3.3770, std.dev.: 0.0110) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 1.73% (16.4461 => 16.7312, std.dev.: 0.2278) MultiSource/Applications/obsequi/Obsequi: 3.83% (1.0262 => 1.0655, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.18% (0.6332 => 0.6407, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: 6.88% (0.1831 => 0.1957, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.87% (0.1559 => 0.1635, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.49% (0.3123 => 0.3232, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.58% (0.2463 => 0.2502, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.54% (0.3344 => 0.3362, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.90% (0.2364 => 0.2409, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -0.72% (0.6010 => 0.5967, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel: -12.35% (0.0429 => 0.0376, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.89% (0.3266 => 0.3295, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/strcat: 0.86% (0.1969 => 0.1986, std.dev.: 0.0025) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 16.07% (0.0224 => 0.0260, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 72.36% (0.0123 => 0.0212, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.19% (0.0408 => 0.0421, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 27.95% (0.0254 => 0.0325, std.dev.: 0.0046) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.99% (0.0302 => 0.0308, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 7.81% (0.0384 => 0.0414, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: 4.21% (0.0190 => 0.0198, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 17.22% (0.0180 => 0.0211, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 55.22% (0.0230 => 0.0357, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 100.00% (0.0007 => 0.0014) MultiSource/Applications/ClamAV/clamscan: 1.88% (0.1438 => 0.1465, std.dev.: 0.0031) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.58% (1.1329 => 1.1508, std.dev.: 0.0479) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.76% (0.1462 => 0.1517, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.82% (0.4164 => 0.4198, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.65% (0.1369 => 0.1419, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.52% (0.0641 => 0.0612, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 38.46% (0.0195 => 0.0270, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.33% (0.0578 => 0.0603, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.06% (1.1437 => 1.1444, std.dev.: 0.0274) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -35.71% (0.0014 => 0.0009, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.74% (0.0627 => 0.0663, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.33% (0.0180 => 0.0267, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.04% (0.8017 => 0.8014, std.dev.: 0.0084) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 12.90% (0.0062 => 0.0070, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 21 10:02:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 21 Oct 2012 12:02:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121021170253.501812A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5070?compare_to=5067&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5070, Order: 166390, Start Time: 2012-10-21 15:44:34, End Time: 2012-10-21 17:04:54 To: 5067, Order: 166389, Start Time: 2012-10-21 12:22:14, End Time: 2012-10-21 13:42:26 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 4 (194 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 949 (647 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 4.12% (15.6944 => 16.3403, std.dev.: 0.0081) MultiSource/Applications/JM/ldecod/ldecod: 1.54% (11.8539 => 12.0364, std.dev.: 0.0160) MultiSource/Benchmarks/nbench/nbench: 1.27% (1.3322 => 1.3491, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.64% (3.7824 => 3.8444, std.dev.: 0.0007) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.58% (0.6230 => 0.6266, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 0.71% (17.1716 => 17.2928, std.dev.: 0.0051) MultiSource/Benchmarks/Bullet/bullet: 0.19% (56.1770 => 56.2830, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/gs/gs: 0.65% (4.5698 => 4.5996, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0481 => 0.0481, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0482 => 0.0482, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0451 => 0.0451, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.22% (0.0452 => 0.0453, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0441 => 0.0441, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0442 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.23% (0.0434 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.23% (0.0436 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.22% (0.0452 => 0.0453, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0454 => 0.0454, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0447 => 0.0447, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0448 => 0.0448, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.46% (0.0436 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0438 => 0.0438, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0444 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0445 => 0.0445, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.22% (0.0455 => 0.0456, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.78% (0.0476 => 0.0458, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.23% (0.0432 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0433 => 0.0433, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0444 => 0.0444, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0445 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.23% (0.0435 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0436 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.23% (0.0426 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0429 => 0.0429) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.23% (0.0426 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0427 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0463 => 0.0463, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0464 => 0.0464, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.24% (0.0425 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0426 => 0.0426, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.23% (0.0426 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.23% (0.0427 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0434 => 0.0434) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.46% (0.0435 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.39% (1.2986 => 1.3037, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.22% (8.1912 => 8.2089, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.14% (0.7742 => 0.7753, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -0.56% (0.0354 => 0.0352, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: - (0.1437 => 0.1437) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.54% (0.2202 => 0.2214, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.01% (63.2438 => 56.2830, std.dev.: 0.0044) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 36.84% (14.1553 => 19.3706, std.dev.: 0.0240) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.39% (3.4629 => 5.7966, std.dev.: 0.0020) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13476.94% (0.0720 => 9.7754, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049800.00% (0.0001 => 10.0499, std.dev.: 0.0012) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 65.54% (0.2554 => 0.4228, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 57.61% (10.3673 => 16.3403, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/lowercase: 56.64% (0.0256 => 0.0401) SingleSource/UnitTests/SignlessTypes/factor: 45.95% (0.0296 => 0.0432, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 42.44% (0.0271 => 0.0386, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.67% (1.5859 => 2.2468, std.dev.: 0.0137) SingleSource/Benchmarks/Misc/richards_benchmark: 36.44% (0.1622 => 0.2213, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 36.36% (0.1056 => 0.1440, std.dev.: 0.0004) SingleSource/UnitTests/vla: 32.68% (0.0355 => 0.0471, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.41% (2.2024 => 2.8721, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/neural/neural: 26.25% (0.1463 => 0.1847, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 25.30% (0.0834 => 0.1045, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.95% (0.1566 => 0.1894, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 19.48% (0.1432 => 0.1711, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.37% (0.0871 => 0.1031, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.36% (7.0540 => 8.3489, std.dev.: 0.0028) MultiSource/Applications/viterbi/viterbi: 18.01% (0.1555 => 0.1835, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 18.00% (0.5105 => 0.6024, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.35% (0.6675 => 0.7833, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 17.34% (0.1655 => 0.1942, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.23% (2.2022 => 2.5817, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/lists: 16.93% (0.0626 => 0.0732) MultiSource/Applications/d/make_dparser: 16.76% (3.3354 => 3.8943, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.61% (1.3050 => 1.5218, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/em3d/em3d: 16.34% (0.1695 => 0.1972, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 16.04% (0.1440 => 0.1671, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.02% (0.0793 => 0.0920, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.01% (0.4615 => 0.5354, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/ReedSolomon: 15.96% (0.2049 => 0.2376, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 15.94% (0.2271 => 0.2633, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.86% (0.1337 => 0.1549, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.77% (0.8172 => 0.9461, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.70% (0.1032 => 0.1194, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 15.57% (0.1175 => 0.1358, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 15.56% (0.1163 => 0.1344, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.56% (0.5020 => 0.5801, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.43% (0.1510 => 0.1743, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 15.33% (10.4361 => 12.0364, std.dev.: 0.0160) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.28% (1.5415 => 1.7771, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.24% (0.0886 => 0.1021, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 15.08% (0.7115 => 0.8188, std.dev.: 0.0142) MultiSource/Applications/sgefa/sgefa: 14.99% (0.3109 => 0.3575, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.96% (0.0842 => 0.0968, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.95% (0.1940 => 0.2230, std.dev.: 0.0011) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.87% (0.1143 => 0.1313) MultiSource/Benchmarks/McCat/18-imp/imp: 14.81% (0.3423 => 0.3930, std.dev.: 0.0079) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.70% (4.2646 => 4.8917, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/oourafft: 14.69% (0.3282 => 0.3764, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 14.62% (0.0814 => 0.0933, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.61% (0.0746 => 0.0855, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.60% (0.9765 => 1.1191, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/matrix: 14.55% (0.0818 => 0.0937, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 14.50% (1.1642 => 1.3330, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.48% (0.1236 => 0.1415, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.44% (0.0838 => 0.0959) MultiSource/Applications/aha/aha: 14.42% (0.1151 => 0.1317, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.39% (0.1584 => 0.1812, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.29% (0.3121 => 0.3567, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.25% (0.0730 => 0.0834, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.17% (0.6450 => 0.7364, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.10% (0.2107 => 0.2404, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 14.08% (0.7835 => 0.8938, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 13.98% (9.4845 => 10.8100, std.dev.: 0.0092) MultiSource/Benchmarks/nbench/nbench: 13.94% (1.1840 => 1.3491, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.85% (0.2758 => 0.3140, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.83% (0.0933 => 0.1062, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.79% (0.5860 => 0.6668, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.79% (0.1117 => 0.1271, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.77% (0.0770 => 0.0876, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.75% (8.1363 => 9.2550, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.69% (0.1906 => 0.2167, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.64% (1.4186 => 1.6121, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.62% (1.7609 => 2.0008, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 13.58% (2.0273 => 2.3026, std.dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: 13.55% (0.7433 => 0.8440, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 13.54% (5.7591 => 6.5391, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.49% (0.1438 => 0.1632, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.47% (0.1062 => 0.1205, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.46% (0.2065 => 0.2343, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.45% (0.1695 => 0.1923, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.33% (0.2700 => 0.3060, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.22% (0.1029 => 0.1165, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.16% (0.0798 => 0.0903, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.13% (0.0929 => 0.1051, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.11% (0.1625 => 0.1838, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 13.04% (1.0722 => 1.2120, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/rem: 13.02% (0.1144 => 0.1293, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 12.98% (0.4299 => 0.4857, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.84% (0.5981 => 0.6749, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.83% (0.8067 => 0.9102, std.dev.: 0.0019) MultiSource/Applications/lua/lua: 12.77% (3.8723 => 4.3667, std.dev.: 0.0107) MultiSource/Benchmarks/sim/sim: 12.75% (0.3387 => 0.3819, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.71% (0.4879 => 0.5499, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: 12.70% (0.1268 => 0.1429, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.41% (0.1330 => 0.1495, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.37% (0.2603 => 0.2925, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.34% (0.3307 => 0.3715, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.34% (0.5569 => 0.6256, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.32% (1.1861 => 1.3322, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.26% (0.1892 => 0.2124, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/football/football: 12.21% (0.8921 => 1.0010, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.18% (7.9617 => 8.9312, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.15% (4.9449 => 5.5455, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 12.09% (0.3177 => 0.3561, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.03% (5.0018 => 5.6033, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/09-vor/vor: 12.01% (0.3180 => 0.3562, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.73% (0.1125 => 0.1257, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.57% (0.3543 => 0.3953, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.57% (0.3441 => 0.3839, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 11.51% (0.3092 => 0.3448, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 11.21% (2.2969 => 2.5544, std.dev.: 0.0132) SingleSource/UnitTests/ObjC/trivial-interface: 11.14% (0.3473 => 0.3860, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 11.12% (1.5603 => 1.7338, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/exceptions-4: 11.09% (0.3543 => 0.3936, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/parameter-passing: 11.08% (0.3927 => 0.4362, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.95% (0.3561 => 0.3951, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 10.90% (0.6456 => 0.7160, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/for-in: 10.86% (0.3694 => 0.4095, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.84% (0.3828 => 0.4243, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/exceptions-2: 10.81% (0.3497 => 0.3875, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.80% (0.8101 => 0.8976, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 10.78% (0.3516 => 0.3895, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.77% (0.2266 => 0.2510, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/property: 10.73% (0.3886 => 0.4303, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.44% (0.1044 => 0.1153, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 10.09% (21.9371 => 24.1508, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/hash: 9.75% (0.4289 => 0.4707, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 9.70% (0.4620 => 0.5068, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.49% (0.4636 => 0.5076, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.49% (0.3826 => 0.4189, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/lists: 9.29% (0.3422 => 0.3740, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.26% (0.3865 => 0.4223, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.14% (0.4203 => 0.4587, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.07% (0.4103 => 0.4475, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.05% (0.3427 => 0.3737, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 8.67% (0.4048 => 0.4399, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 8.58% (17.1811 => 18.6558, std.dev.: 0.0217) SingleSource/Benchmarks/Shootout-C++/lists1: 8.52% (0.3684 => 0.3998, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 8.03% (0.6030 => 0.6514, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.99% (3.8922 => 4.2033, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/Hello: 7.93% (0.5925 => 0.6395, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.91% (14.3668 => 15.5030, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/sieve: 7.85% (0.3603 => 0.3886, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.78% (0.2430 => 0.2619, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.75% (0.3650 => 0.3933, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.73% (0.4064 => 0.4378, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.51% (0.7326 => 0.7876, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/matrix: 7.42% (0.3098 => 0.3328, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.28% (0.2831 => 0.3037, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.26% (0.2891 => 0.3101, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 7.16% (0.3283 => 0.3518, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.15% (0.3232 => 0.3463, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 7.09% (0.2905 => 0.3111, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.05% (0.3162 => 0.3385, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.89% (0.3136 => 0.3352, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.87% (0.2793 => 0.2985, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.86% (0.2756 => 0.2945, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.85% (2.0665 => 2.2081, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wc: 6.75% (0.3052 => 0.3258, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.72% (0.3379 => 0.3606, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.69% (0.2871 => 0.3063, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.65% (0.2872 => 0.3063, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.64% (0.2725 => 0.2906, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.64% (0.2877 => 0.3068, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.46% (0.2802 => 0.2983, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.34% (0.2714 => 0.2886, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 6.20% (1.2842 => 1.3638, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.53% (0.3131 => 0.3304, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.27% (0.3817 => 0.3942, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.95% (0.3935 => 0.4051, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.68% (1.1194 => 1.1494, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8961, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1726) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.38% (0.9957 => 1.1289, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.84% (1.1396 => 1.2517, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 6.70% (3.1578 => 3.3693, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: 5.90% (1.9405 => 2.0549, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.87% (0.4162 => 0.4323, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.73% (0.3987 => 0.4096, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.62% (4.2280 => 4.3386, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.79% (3.6395 => 3.7047, std.dev.: 0.0060) MultiSource/Benchmarks/llubenchmark/llu: 1.75% (3.7781 => 3.8444, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.70% (2.6546 => 2.6997, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 1.51% (3.1595 => 3.2071, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 1.18% (4.4649 => 4.5176, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.03% (6.5088 => 6.5759, std.dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.01% (6.6874 => 0.1332, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -79.94% (0.8651 => 0.1735, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.04% (5.2763 => 3.2165, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.51% (5.3855 => 3.6883, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.03% (5.3526 => 3.6918, std.dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -14.77% (54.1659 => 46.1676, std.dev.: 0.0270) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.65% (2.9384 => 2.6254, std.dev.: 0.0045) MultiSource/Applications/ClamAV/clamscan: -6.27% (22.1758 => 20.7863, std.dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.10% (8.0499 => 3.7753, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7652, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4752, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4236, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.71% (1.2258 => 1.0700, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -11.54% (1.2373 => 1.0945, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -10.80% (1.5373 => 1.3713, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.33% (19.9488 => 18.2876, std.dev.: 0.0091) MultiSource/Benchmarks/FreeBench/mason/mason: -7.77% (0.2161 => 0.1993, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.03% (1.8329 => 1.7040, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5757, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.18% (1.6805 => 1.5934, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5085, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.23% (8.1563 => 7.8114, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.74% (1.3677 => 1.3166, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1626, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8775, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4974, std.dev.: 0.0034) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.58% (0.4808 => 0.4684, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -2.25% (4.6441 => 4.5398, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -1.88% (10.2830 => 10.0895, std.dev.: 0.0231) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6803, std.dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -1.73% (2.5528 => 2.5086, std.dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4211, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2879, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8583, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2356, std.dev.: 0.0042) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 19.83% (0.5229 => 0.6266, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 15.37% (14.9895 => 17.2928, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/gs/gs: 11.90% (4.1105 => 4.5996, std.dev.: 0.0091) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.00% (1.1048 => 1.3037, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.68% (7.1582 => 8.2089, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.61% (0.6222 => 0.7753, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35100.00% (0.0001 => 0.0352, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.23% (0.1485 => 0.1437) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.63% (0.2116 => 0.2214, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 21 10:08:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 21 Oct 2012 12:08:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121021170817.9EA6C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5071?compare_to=5068&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5071, Order: 166390, Start Time: 2012-10-21 15:45:19, End Time: 2012-10-21 17:11:18 To: 5068, Order: 166389, Start Time: 2012-10-21 12:23:19, End Time: 2012-10-21 13:49:22 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (203 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1042 (662 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.09% (2.0176 => 2.5036, std.dev.: 0.0069) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.70% (0.1410 => 0.1716, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 18.84% (0.0653 => 0.0776, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 18.77% (0.2243 => 0.2664, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 18.77% (0.0826 => 0.0981, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 18.10% (0.0746 => 0.0881, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 17.67% (0.1013 => 0.1192, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 17.26% (0.1072 => 0.1257) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.22% (0.0819 => 0.0960, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.16% (0.7710 => 0.9033, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.83% (0.2596 => 0.3007, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 15.58% (0.2721 => 0.3145, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 15.11% (0.0834 => 0.0960, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.07% (0.1413 => 0.1626, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.04% (0.0811 => 0.0933, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.88% (0.0847 => 0.0973, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.72% (0.0720 => 0.0826, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.69% (0.1327 => 0.1522, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 14.66% (0.1003 => 0.1150, std.dev.: 0.0012) MultiSource/Applications/aha/aha: 14.60% (0.1062 => 0.1217, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 14.53% (0.5265 => 0.6030, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.51% (0.9199 => 1.0534, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.48% (0.6959 => 0.7967, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.48% (0.0725 => 0.0830, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.42% (0.0964 => 0.1103, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.40% (0.1986 => 0.2272, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 14.34% (1.3693 => 1.5657, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/mst/mst: 14.31% (0.1111 => 0.1270, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 14.24% (0.7038 => 0.8040, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.18% (3.9660 => 4.5285, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.09% (0.5637 => 0.6431, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.95% (0.1075 => 0.1225, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.87% (0.1276 => 0.1453, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.83% (0.2914 => 0.3317, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 13.67% (0.7460 => 0.8480, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.60% (0.1588 => 0.1804, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.31% (0.0977 => 0.1107, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 13.24% (1.1061 => 1.2525, std.dev.: 0.0069) SingleSource/Benchmarks/McGill/exptree: 13.15% (0.0768 => 0.0869, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.12% (0.1014 => 0.1147, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 13.06% (0.1478 => 0.1671, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.98% (0.5577 => 0.6301, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 12.96% (0.0818 => 0.0924, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 12.92% (0.4328 => 0.4887, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.76% (0.1865 => 0.2103, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.75% (0.3246 => 0.3660, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.75% (1.2193 => 1.3748, std.dev.: 0.0068) MultiSource/Applications/SPASS/SPASS: 12.75% (13.8202 => 15.5825, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.71% (0.1157 => 0.1304, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.70% (1.4563 => 1.6413, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.65% (1.1364 => 1.2802, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.61% (0.2023 => 0.2278, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 12.54% (0.7506 => 0.8447, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/em3d/em3d: 12.49% (0.1657 => 0.1864, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.46% (0.6283 => 0.7066, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.40% (0.4379 => 0.4922, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 12.28% (0.4062 => 0.4561, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.27% (0.2127 => 0.2388, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 12.27% (0.3130 => 0.3514, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/gs/gs: 12.21% (3.8646 => 4.3365, std.dev.: 0.0552) MultiSource/Benchmarks/McCat/09-vor/vor: 12.07% (0.2925 => 0.3278, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.00% (0.3899 => 0.4367, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 11.82% (0.2995 => 0.3349, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.77% (0.4791 => 0.5355, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 11.68% (1.0313 => 1.1518, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 11.68% (0.3220 => 0.3596, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 11.60% (0.5818 => 0.6493, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 11.60% (1.9270 => 2.1505, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.55% (0.1048 => 0.1169, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 11.53% (0.7061 => 0.7875, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 11.45% (0.1589 => 0.1771, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.40% (0.1789 => 0.1993, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 11.38% (0.1213 => 0.1351, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 11.36% (7.2180 => 8.0382, std.dev.: 0.1203) SingleSource/Regression/C++/ofstream_ctor: 11.36% (0.2781 => 0.3097, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 11.29% (0.5748 => 0.6397, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.28% (0.3022 => 0.3363, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 11.27% (16.6129 => 18.4848, std.dev.: 0.0122) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.22% (0.3485 => 0.3876, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.22% (0.1435 => 0.1596, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 11.18% (0.3293 => 0.3661, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 11.14% (0.6744 => 0.7495, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.10% (0.3756 => 0.4173, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 11.07% (0.0976 => 0.1084, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.06% (0.4016 => 0.4460, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 11.04% (3.1889 => 3.5408, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/football/football: 11.03% (0.8310 => 0.9227, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.03% (0.1569 => 0.1742, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.98% (0.3580 => 0.3973, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.98% (0.3489 => 0.3872, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 10.96% (2.1791 => 2.4180, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.80% (1.3245 => 1.4675, std.dev.: 0.0309) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.78% (0.2782 => 0.3082, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 10.78% (0.3868 => 0.4285, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.70% (0.2140 => 0.2369, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.63% (0.8698 => 0.9623) SingleSource/Benchmarks/Shootout-C++/strcat: 10.60% (0.2726 => 0.3015, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 10.57% (0.3453 => 0.3818, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 10.54% (0.2760 => 0.3051, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 10.54% (0.3149 => 0.3481, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.45% (0.1819 => 0.2009, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/methcall: 10.43% (0.2761 => 0.3049, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 10.41% (0.3534 => 0.3902, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 10.40% (0.3107 => 0.3430, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.38% (1.9828 => 2.1886, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.35% (0.2966 => 0.3273, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 10.32% (0.2607 => 0.2876, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 10.28% (3.6692 => 4.0463, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/random: 10.26% (0.2690 => 0.2966, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.25% (0.4390 => 0.4840, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.21% (0.2655 => 0.2926, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 10.18% (0.2937 => 0.3236, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 10.16% (0.2628 => 0.2895, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 10.13% (1.0594 => 1.1667, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary2: 10.12% (0.3192 => 0.3515, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.09% (0.2765 => 0.3044, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 10.04% (0.2988 => 0.3288, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.04% (0.2321 => 0.2554, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 9.94% (0.4113 => 0.4522, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.85% (0.6135 => 0.6739, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.81% (4.3801 => 4.8099, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.79% (0.2696 => 0.2960, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.74% (4.4433 => 4.8762, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.70% (4.9865 => 5.4700, std.dev.: 0.0149) MultiSource/Applications/oggenc/oggenc: 9.55% (4.6629 => 5.1080, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.51% (0.3755 => 0.4112, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.47% (0.6576 => 0.7199, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 9.44% (0.2945 => 0.3223, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 9.31% (14.8535 => 16.2364, std.dev.: 0.0107) MultiSource/Applications/SIBsim4/SIBsim4: 9.25% (1.2749 => 1.3928, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: 9.07% (1.1333 => 1.2361, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: 9.07% (0.3131 => 0.3415, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 9.03% (8.4961 => 9.2635, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.99% (1.5188 => 1.6554, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.86% (0.3511 => 0.3822, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.71% (0.9108 => 0.9901, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 8.69% (3.7467 => 4.0724, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/neural/neural: 8.66% (0.1385 => 0.1505, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 8.58% (0.6250 => 0.6786, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.53% (3.2742 => 3.5536, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.47% (0.2504 => 0.2716, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.45% (0.8818 => 0.9563, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.44% (0.3245 => 0.3519, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.32% (0.4805 => 0.5205, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 8.24% (0.4003 => 0.4333, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 8.15% (6.5754 => 7.1110, std.dev.: 0.0070) SingleSource/UnitTests/ObjC/exceptions: 8.05% (0.3914 => 0.4229, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.02% (2.1007 => 2.2692, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.02% (6.2785 => 6.7818, std.dev.: 0.0094) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.94% (0.2243 => 0.2421, std.dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: 7.92% (1.2292 => 1.3266, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/oourafft: 7.92% (0.2008 => 0.2167, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.89% (0.3940 => 0.4251, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 7.83% (0.3578 => 0.3858, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.71% (0.3646 => 0.3927, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.71% (0.3789 => 0.4081, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 7.64% (0.3601 => 0.3876, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.62% (0.3663 => 0.3942, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.56% (0.3650 => 0.3926, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.49% (13.2842 => 14.2787, std.dev.: 0.0165) SingleSource/UnitTests/ObjC/exceptions-3: 7.42% (0.3623 => 0.3892, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 5.76% (16.2614 => 17.1983, std.dev.: 0.0181) MultiSource/Applications/ClamAV/clamscan: 5.49% (14.5298 => 15.3278, std.dev.: 0.0146) MultiSource/Benchmarks/Olden/bh/bh: 5.21% (0.2859 => 0.3008, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 3.18% (33.2944 => 34.3532, std.dev.: 0.0146) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5183, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/fbench: 23.63% (1.8175 => 2.2470, std.dev.: 0.0218) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.11% (1.0895 => 1.2759, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 10.97% (1.1560 => 1.2828, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 8.99% (0.8273 => 0.9017, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.58% (3.1736 => 3.4143, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.42% (0.9692 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 5.17% (1.2998 => 1.3670, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 4.46% (0.5449 => 0.5692) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.45% (2.8606 => 2.9880, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7747, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.84% (11.2619 => 11.6946, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 3.37% (12.0921 => 12.4996, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 3.35% (1.9199 => 1.9842, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 3.31% (10.7476 => 11.1033, std.dev.: 0.0176) MultiSource/Benchmarks/Olden/bisort/bisort: 3.03% (0.8239 => 0.8489, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0310 => 1.0559, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.16% (7.4271 => 7.5873, std.dev.: 0.0043) MultiSource/Applications/lemon/lemon: 1.71% (1.4298 => 1.4542, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5123, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.35% (1.9433 => 1.9696, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1866, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5788, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.18% (9.9194 => 10.0360, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 1.09% (12.4560 => 12.5917, std.dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.05% (8.8259 => 8.9188, std.dev.: 0.0070) SingleSource/Benchmarks/McGill/queens: 1.00% (2.1753 => 2.1971, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.10% (0.2670 => 0.1439, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.50% (0.4657 => 0.3935, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.29% (1.3819 => 1.2259, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.27% (1.3813 => 1.2256, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.28% (1.0460 => 0.8548, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -12.69% (0.2238 => 0.1954, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.06% (20.3410 => 18.2947, std.dev.: 0.0204) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -5.88% (1.2308 => 1.1584, std.dev.: 0.0074) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.71% (1.3780 => 1.2993, std.dev.: 0.0055) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0049) SingleSource/UnitTests/Vector/multiplies: -5.05% (2.6470 => 2.5134, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.31% (0.9996 => 0.9565, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.86% (1.7688 => 1.7005, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.14% (0.4867 => 0.4714, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -2.89% (3.2729 => 3.1783, std.dev.: 0.0031) MultiSource/Applications/spiff/spiff: -2.88% (3.0263 => 2.9391, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8815, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -2.68% (1.9762 => 1.9233, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.37% (4.1080 => 4.0107, std.dev.: 0.0033) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.03% (0.6589 => 0.6455, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.87% (0.6615 => 0.6491, std.dev.: 0.0006) MultiSource/Applications/lua/lua: -1.76% (26.5159 => 26.0490, std.dev.: 0.0181) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.67% (0.8342 => 0.8203, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.66% (6.3560 => 6.2503, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.57% (2.5254 => 2.4857, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/heapsort: -1.47% (3.9173 => 3.8596, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/ReedSolomon: -1.42% (7.1097 => 7.0085, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.34% (5.3167 => 5.2452, std.dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: -1.24% (28.2225 => 27.8726, std.dev.: 0.0019) MultiSource/Applications/aha/aha: -1.08% (3.1476 => 3.1136, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -1.06% (84.4286 => 83.5352, std.dev.: 0.0062) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 21 11:34:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 21 Oct 2012 13:34:30 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121021183430.4C1712A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5072?compare_to=5069&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5072, Order: 166395, Start Time: 2012-10-21 17:13:30, End Time: 2012-10-21 18:36:32 To: 5069, Order: 166390, Start Time: 2012-10-21 15:32:09, End Time: 2012-10-21 16:56:45 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 4 (22 on baseline) Performance Improvements: 3 (5 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 968 (947 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.69% (14.7887 => 15.3351, std.dev.: 0.1169) SingleSource/Benchmarks/Misc/flops: 1.35% (9.2479 => 9.3731, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.26% (2.4826 => 2.5139, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.13% (1.2376 => 1.2516, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.78% (0.8449 => 0.8299, std.dev.: 0.0057) MultiSource/Applications/lua/lua: -1.49% (3.9050 => 3.8470, std.dev.: 0.0192) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.80% (47.0029 => 45.2145, std.dev.: 0.4933) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -1.53% (16.7312 => 16.4745, std.dev.: 0.1647) MultiSource/Applications/obsequi/Obsequi: -1.47% (1.0655 => 1.0498, std.dev.: 0.0104) MultiSource/Applications/sqlite3/sqlite3: -1.59% (0.6407 => 0.6305, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/08-main/main: -7.31% (0.1957 => 0.1814, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.69% (0.1635 => 0.1679, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.03% (0.3232 => 0.3233, std.dev.: 0.0086) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.36% (0.2502 => 0.2493, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.07% (0.3362 => 0.3326, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.03% (0.2409 => 0.2360, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: 0.27% (0.5967 => 0.5983, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/mandel: 28.99% (0.0376 => 0.0485, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.09% (0.3295 => 0.3298, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/strcat: 1.81% (0.1986 => 0.2022, std.dev.: 0.0013) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -33.46% (0.0260 => 0.0173, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -23.58% (0.0212 => 0.0162, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.24% (0.0421 => 0.0420, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0325 => 0.0325, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.65% (0.0308 => 0.0306, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.21% (0.0414 => 0.0419, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -34.34% (0.0198 => 0.0130, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/test1: -1.42% (0.0211 => 0.0208, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -8.12% (0.0357 => 0.0328, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -92.86% (0.0014 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -1.77% (0.1465 => 0.1439, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -2.90% (1.1508 => 1.1174, std.dev.: 0.0375) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -5.80% (0.1517 => 0.1429, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.12% (0.4198 => 0.4067, std.dev.: 0.0353) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.24% (0.1419 => 0.1373, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.10% (0.0612 => 0.0593, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -11.48% (0.0270 => 0.0239, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.13% (0.0603 => 0.0554, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.03% (1.1444 => 1.1440, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.77% (0.0031 => 0.0001, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -44.44% (0.0009 => 0.0005, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.86% (0.0663 => 0.0591, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -35.58% (0.0267 => 0.0172, std.dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.12% (0.8014 => 0.8024, std.dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 54.29% (0.0070 => 0.0108, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.96% (2.1832 => 1.6601, std.dev.: 0.0046) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.06% (0.2180 => 0.2312, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.75% (0.2279 => 0.2410, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.44% (0.2998 => 0.3101, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 2.64% (1.1271 => 1.1568, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.46% (1.1685 => 1.1973, std.dev.: 0.0110) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.85% (0.8148 => 0.8299, std.dev.: 0.0057) MultiSource/Applications/hbd/hbd: 1.40% (1.4269 => 1.4469, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.33% (1.4479 => 1.4672, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.23% (0.8611 => 0.8717, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.22% (1.6386 => 1.6586, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.08% (4.5702 => 4.6195, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.09% (1.5795 => 2.4971, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.47% (0.3186 => 0.3456, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.47% (1.1857 => 1.2861, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 5.90% (63.1822 => 66.9123, std.dev.: 0.0271) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.71% (14.6451 => 15.3351, std.dev.: 0.1169) MultiSource/Applications/siod/siod: 2.88% (3.6643 => 3.7700, std.dev.: 0.0103) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.65% (2.4490 => 2.5139, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.76% (4.8362 => 4.9215, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/bh/bh: 1.74% (2.3560 => 2.3971, std.dev.: 0.0125) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.58% (41.4238 => 42.0789, std.dev.: 0.2428) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.43% (59.2638 => 60.1120, std.dev.: 0.1487) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -7.99% (3.2926 => 3.0294, std.dev.: 0.0729) MultiSource/Applications/lua/lua: -5.26% (29.8330 => 28.2634, std.dev.: 0.2828) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.37% (0.3269 => 0.3126, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hash2: -1.39% (3.4237 => 3.3761, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.22% (3.3479 => 3.3071, std.dev.: 0.0042) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.17% (16.4461 => 16.4745, std.dev.: 0.1647) MultiSource/Applications/obsequi/Obsequi: 2.30% (1.0262 => 1.0498, std.dev.: 0.0104) MultiSource/Applications/sqlite3/sqlite3: -0.43% (0.6332 => 0.6305, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/08-main/main: -0.93% (0.1831 => 0.1814, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.70% (0.1559 => 0.1679, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.52% (0.3123 => 0.3233, std.dev.: 0.0086) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.22% (0.2463 => 0.2493, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.54% (0.3344 => 0.3326, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.17% (0.2364 => 0.2360, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: -0.45% (0.6010 => 0.5983, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/mandel: 13.05% (0.0429 => 0.0485, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.98% (0.3266 => 0.3298, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/strcat: 2.69% (0.1969 => 0.2022, std.dev.: 0.0013) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -22.77% (0.0224 => 0.0173, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 31.71% (0.0123 => 0.0162, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.94% (0.0408 => 0.0420, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 27.95% (0.0254 => 0.0325, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.32% (0.0302 => 0.0306, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.11% (0.0384 => 0.0419, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -31.58% (0.0190 => 0.0130, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/test1: 15.56% (0.0180 => 0.0208, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: 42.61% (0.0230 => 0.0328, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1438 => 0.1439, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -1.37% (1.1329 => 1.1174, std.dev.: 0.0375) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -2.26% (0.1462 => 0.1429, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.33% (0.4164 => 0.4067, std.dev.: 0.0353) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.29% (0.1369 => 0.1373, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.49% (0.0641 => 0.0593, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 22.56% (0.0195 => 0.0239, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.15% (0.0578 => 0.0554, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.03% (1.1437 => 1.1440, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -64.29% (0.0014 => 0.0005, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.74% (0.0627 => 0.0591, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.44% (0.0180 => 0.0172, std.dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.09% (0.8017 => 0.8024, std.dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 74.19% (0.0062 => 0.0108, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 21 11:53:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 21 Oct 2012 13:53:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121021185315.141162A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5073?compare_to=5070&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5073, Order: 166395, Start Time: 2012-10-21 17:34:17, End Time: 2012-10-21 18:55:16 To: 5070, Order: 166390, Start Time: 2012-10-21 15:44:34, End Time: 2012-10-21 17:04:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (195 on baseline) Performance Improvements: 3 (45 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 948 (647 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 18.47% (0.4121 => 0.4882, std.dev.: 0.0192) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.11% (1.2933 => 1.3077, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.06% (16.3403 => 16.0038, std.dev.: 0.0136) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -1.64% (55.3574 => 54.4489, std.dev.: 0.2097) MultiSource/Benchmarks/llubenchmark/llu: -1.13% (3.8444 => 3.8009, std.dev.: 0.0142) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.18% (0.6266 => 0.6255, std.dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: -0.04% (17.2928 => 17.2862, std.dev.: 0.0173) MultiSource/Benchmarks/Bullet/bullet: 0.26% (56.2830 => 56.4301, std.dev.: 0.0138) MultiSource/Benchmarks/MallocBench/gs/gs: 0.03% (4.5996 => 4.6010, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.42% (0.0481 => 0.0483, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.41% (0.0482 => 0.0484, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.67% (0.0451 => 0.0454, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.22% (0.0453 => 0.0454, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.23% (0.0441 => 0.0442, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.45% (0.0442 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.23% (0.0435 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0437 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.44% (0.0453 => 0.0455, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.22% (0.0454 => 0.0455, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.45% (0.0447 => 0.0449, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.22% (0.0448 => 0.0449, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0438 => 0.0438, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.23% (0.0438 => 0.0439, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.45% (0.0444 => 0.0446, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.22% (0.0445 => 0.0446, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.22% (0.0456 => 0.0457, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0458 => 0.0458, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.46% (0.0433 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.23% (0.0433 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.23% (0.0444 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.22% (0.0445 => 0.0446, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.23% (0.0436 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.46% (0.0436 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.47% (0.0427 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.23% (0.0429 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0427 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.47% (0.0427 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.43% (0.0463 => 0.0465, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.43% (0.0464 => 0.0466, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0426 => 0.0426, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.47% (0.0426 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.23% (0.0427 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.23% (0.0428 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.23% (0.0434 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0437 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.23% (1.3037 => 1.3007, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.23% (8.2089 => 8.2276, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.49% (0.7753 => 0.7791, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.28% (0.0352 => 0.0353, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: - (0.1437 => 0.1437, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.36% (0.2214 => 0.2184, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -10.77% (63.2438 => 56.4301, std.dev.: 0.0138) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 37.12% (14.1553 => 19.4093, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.82% (3.4629 => 5.8115, std.dev.: 0.0019) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13482.08% (0.0720 => 9.7791, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049800.00% (0.0001 => 10.0499, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 65.97% (0.2554 => 0.4239, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/lowercase: 56.64% (0.0256 => 0.0401) MultiSource/Benchmarks/PAQ8p/paq8p: 54.37% (10.3673 => 16.0038, std.dev.: 0.0136) SingleSource/UnitTests/SignlessTypes/factor: 46.28% (0.0296 => 0.0433, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 42.80% (0.0271 => 0.0387, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.55% (1.5859 => 2.2449, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/richards_benchmark: 39.70% (0.1622 => 0.2266, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: 36.36% (0.1056 => 0.1440, std.dev.: 0.0009) SingleSource/UnitTests/vla: 32.68% (0.0355 => 0.0471, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.41% (2.2024 => 2.8722, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: 26.18% (0.1463 => 0.1846, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 25.42% (0.0834 => 0.1046, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/hash: 21.03% (0.0485 => 0.0587, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.82% (0.1566 => 0.1892, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 20.04% (0.1432 => 0.1719, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.98% (7.0540 => 8.3932, std.dev.: 0.0065) SingleSource/Benchmarks/McGill/chomp: 18.55% (0.1655 => 0.1962, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 18.52% (0.1555 => 0.1843, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.48% (0.0871 => 0.1032, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: 18.37% (0.0626 => 0.0741, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 18.06% (0.5105 => 0.6027, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.93% (2.2022 => 2.5971, std.dev.: 0.0165) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.56% (0.6675 => 0.7847, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/ReedSolomon: 17.03% (0.2049 => 0.2398, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 16.74% (3.3354 => 3.8938, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.69% (1.3050 => 1.5228, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 16.28% (0.1695 => 0.1971, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.14% (0.0793 => 0.0921, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 16.11% (0.1440 => 0.1672, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.06% (0.4615 => 0.5356, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.03% (0.2271 => 0.2635, std.dev.: 0.0029) MultiSource/Applications/JM/ldecod/ldecod: 15.83% (10.4361 => 12.0883, std.dev.: 0.0149) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.79% (0.1032 => 0.1195, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.78% (0.1337 => 0.1548, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 15.74% (0.1175 => 0.1360, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.74% (0.5020 => 0.5810, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/mst/mst: 15.65% (0.1163 => 0.1345, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.57% (1.5415 => 1.7815, std.dev.: 0.0069) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.41% (0.8172 => 0.9431, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.36% (0.1510 => 0.1742, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.35% (0.0886 => 0.1022, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: 15.24% (0.7115 => 0.8199, std.dev.: 0.0143) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.10% (0.1940 => 0.2233, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.96% (0.0842 => 0.0968, std.dev.: 0.0020) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.96% (0.1143 => 0.1314, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 14.86% (0.0814 => 0.0935, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 14.84% (0.3282 => 0.3769, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 14.80% (0.3109 => 0.3569, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/matrix: 14.79% (0.0818 => 0.0939, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.61% (4.2646 => 4.8877, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/18-imp/imp: 14.61% (0.3423 => 0.3923, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.48% (0.1236 => 0.1415, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.48% (0.0746 => 0.0854, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.45% (0.9765 => 1.1176, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.44% (0.0838 => 0.0959, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.42% (0.3121 => 0.3571, std.dev.: 0.0019) MultiSource/Applications/Burg/burg: 14.35% (1.1642 => 1.3313, std.dev.: 0.0065) MultiSource/Applications/aha/aha: 14.34% (0.1151 => 0.1316, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.33% (0.1584 => 0.1811, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 14.30% (9.4845 => 10.8408, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.25% (0.0730 => 0.0834, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.05% (0.2107 => 0.2403, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.05% (0.6450 => 0.7356, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.99% (1.7609 => 2.0073, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.97% (0.1117 => 0.1273, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 13.91% (5.7591 => 6.5600, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 13.90% (1.1840 => 1.3486, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.85% (0.2758 => 0.3140, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.85% (0.2065 => 0.2351, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.82% (1.4186 => 1.6147, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.82% (8.1363 => 9.2607, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.79% (0.5860 => 0.6668, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.77% (0.1438 => 0.1636, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.77% (0.0770 => 0.0876, std.dev.: 0.0034) MultiSource/Applications/spiff/spiff: 13.71% (0.7835 => 0.8909, std.dev.: 0.0054) MultiSource/Applications/treecc/treecc: 13.67% (2.0273 => 2.3044, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.64% (0.1906 => 0.2166, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 13.63% (0.7433 => 0.8446, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.61% (0.0933 => 0.1060, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 13.60% (0.1125 => 0.1278, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.56% (0.1062 => 0.1206, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.51% (0.1695 => 0.1924, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.41% (0.1029 => 0.1167, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.28% (0.0798 => 0.0904, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.22% (0.2700 => 0.3057, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 13.20% (0.1144 => 0.1295, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.13% (0.0929 => 0.1051, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.05% (0.1625 => 0.1837, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 12.95% (1.0722 => 1.2111, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 12.89% (0.4299 => 0.4853, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 12.88% (3.8723 => 4.3712, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.87% (0.5981 => 0.6751, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.85% (0.3307 => 0.3732, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.79% (0.8067 => 0.9099, std.dev.: 0.0021) MultiSource/Benchmarks/sim/sim: 12.75% (0.3387 => 0.3819, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 12.70% (0.1268 => 0.1429, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.69% (0.4879 => 0.5498, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.68% (0.2603 => 0.2933, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.55% (0.5569 => 0.6268, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.44% (1.1861 => 1.3336, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.41% (0.1330 => 0.1495, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 12.34% (0.3177 => 0.3569, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 12.20% (0.8921 => 1.0009, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.16% (7.9617 => 8.9300, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.15% (4.9449 => 5.5458, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/09-vor/vor: 12.11% (0.3180 => 0.3565, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.08% (5.0018 => 5.6061, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.97% (0.3441 => 0.3853, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.66% (0.3543 => 0.3956, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.57% (0.3543 => 0.3953, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 11.48% (0.3092 => 0.3447, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 11.43% (1.5603 => 1.7386, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/bigfib: 11.34% (0.6456 => 0.7188, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 11.28% (0.3927 => 0.4370, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 11.21% (2.2969 => 2.5544, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/trivial-interface: 11.14% (0.3473 => 0.3860, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.05% (0.1892 => 0.2101, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 11.04% (0.3561 => 0.3954, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.01% (0.8101 => 0.8993, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 11.00% (0.3828 => 0.4249, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.96% (0.3694 => 0.4099, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.95% (0.3497 => 0.3880, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.92% (0.3516 => 0.3900, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.86% (0.3886 => 0.4308, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.68% (0.2266 => 0.2508, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 10.42% (0.4289 => 0.4736, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.34% (0.1044 => 0.1152, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 10.28% (0.4620 => 0.5095, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.12% (0.3826 => 0.4213, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/lists: 10.11% (0.3422 => 0.3768, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 10.07% (21.9371 => 24.1460, std.dev.: 0.0338) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.94% (0.3865 => 0.4249, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.85% (0.4203 => 0.4617, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.58% (0.4103 => 0.4496, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 9.36% (0.4048 => 0.4427, std.dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.34% (0.4636 => 0.5069, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.25% (0.3427 => 0.3744, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 9.17% (0.3684 => 0.4022, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 8.96% (0.6030 => 0.6570, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 8.89% (0.5925 => 0.6452, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 8.80% (0.3603 => 0.3920, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 8.63% (17.1811 => 18.6634, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.36% (0.3650 => 0.3955, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.34% (0.2793 => 0.3026, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.30% (0.7326 => 0.7934, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.24% (0.2756 => 0.2983, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/matrix: 8.20% (0.3098 => 0.3352, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.17% (0.4064 => 0.4396, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 8.11% (0.2725 => 0.2946, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 8.05% (0.2831 => 0.3059, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 8.04% (0.3283 => 0.3547, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.99% (0.2891 => 0.3122, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.99% (14.3668 => 15.5145, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary: 7.95% (0.3232 => 0.3489, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.93% (3.8922 => 4.2008, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.90% (0.2430 => 0.2622, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 7.87% (0.3379 => 0.3645, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.85% (0.2714 => 0.2927, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.80% (0.2872 => 0.3096, std.dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 7.78% (0.2905 => 0.3131, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.56% (0.3162 => 0.3401, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 7.56% (0.2871 => 0.3088, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.55% (2.0665 => 2.2225, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.53% (0.3136 => 0.3372, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 7.50% (0.3052 => 0.3281, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.33% (0.2877 => 0.3088, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 7.28% (0.2802 => 0.3006, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 6.63% (1.2842 => 1.3694, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/objinst: 6.45% (0.3131 => 0.3333, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.43% (0.3817 => 0.3948, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.41% (0.3935 => 0.4069, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.72% (1.1194 => 1.1498, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1725, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.00% (0.9957 => 1.1251, std.dev.: 0.0191) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.84% (1.1396 => 1.2517, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 6.71% (3.1578 => 3.3697, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: 5.94% (1.9405 => 2.0557, std.dev.: 0.0005) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.44% (0.4162 => 0.4305, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.72% (4.2280 => 4.3428, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.61% (0.3987 => 0.4091, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.51% (1.0313 => 1.0572, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bisort/bisort: 1.78% (0.8333 => 0.8481, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.68% (3.6395 => 3.7007, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.56% (2.6546 => 2.6960, std.dev.: 0.0017) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2079, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 1.24% (4.4649 => 4.5201, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.01% (6.5088 => 6.5744, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.01% (6.6874 => 0.1334, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -79.92% (0.8651 => 0.1737, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.93% (5.2763 => 3.2220, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.95% (5.3855 => 3.7188, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.47% (5.3526 => 3.7214, std.dev.: 0.0054) SingleSource/UnitTests/Vector/constpool: -14.74% (54.1659 => 46.1836, std.dev.: 0.0080) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.53% (2.9384 => 2.6290, std.dev.: 0.0054) MultiSource/Applications/ClamAV/clamscan: -6.25% (22.1758 => 20.7892, std.dev.: 0.0209) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.07% (8.0499 => 3.7777, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7636, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.64% (2.9695 => 2.4753, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -16.07% (1.6925 => 1.4205, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.74% (1.2258 => 1.0696, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -11.59% (1.2373 => 1.0939, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel-2: -11.01% (1.5373 => 1.3681, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.34% (19.9488 => 18.2855, std.dev.: 0.0206) MultiSource/Benchmarks/FreeBench/mason/mason: -7.82% (0.2161 => 0.1992, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.03% (1.8329 => 1.7041, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.18% (1.6805 => 1.5935, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: -4.64% (1.5835 => 1.5101, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.20% (8.1563 => 7.8135, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Applications/siod/siod: -3.65% (3.2827 => 3.1630, std.dev.: 0.0088) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8775, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4930, std.dev.: 0.0037) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.77% (0.4808 => 0.4675, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -2.29% (4.6441 => 4.5377, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.90% (10.2830 => 10.0873, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: -1.69% (8.8334 => 8.6838, std.dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.67% (2.5528 => 2.5102, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4200, std.dev.: 0.0077) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2878, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2357, std.dev.: 0.0054) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 19.62% (0.5229 => 0.6255, std.dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: 15.32% (14.9895 => 17.2862, std.dev.: 0.0173) MultiSource/Benchmarks/MallocBench/gs/gs: 11.93% (4.1105 => 4.6010, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.73% (1.1048 => 1.3007, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.94% (7.1582 => 8.2276, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 25.22% (0.6222 => 0.7791, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35200.00% (0.0001 => 0.0353, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.23% (0.1485 => 0.1437, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.21% (0.2116 => 0.2184, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 21 12:04:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 21 Oct 2012 14:04:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121021190403.EF76C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5074?compare_to=5071&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5074, Order: 166395, Start Time: 2012-10-21 17:40:41, End Time: 2012-10-21 19:07:05 To: 5071, Order: 166390, Start Time: 2012-10-21 15:45:19, End Time: 2012-10-21 17:11:18 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (203 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1042 (662 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.20% (2.0176 => 2.5059, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.70% (0.1410 => 0.1716, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 18.99% (0.0653 => 0.0777, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 18.77% (0.0826 => 0.0981) MultiSource/Benchmarks/McCat/08-main/main: 18.72% (0.2243 => 0.2663, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.83% (0.0746 => 0.0879, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 17.67% (0.1013 => 0.1192, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 17.07% (0.1072 => 0.1255, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.73% (0.7710 => 0.9000, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.24% (0.0819 => 0.0952, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 16.13% (0.1327 => 0.1541, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 15.40% (0.2721 => 0.3140, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.25% (0.2596 => 0.2992, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 15.11% (0.0834 => 0.0960, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.07% (0.1413 => 0.1626) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.67% (0.0811 => 0.0930, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 14.56% (0.1003 => 0.1149, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.52% (0.0847 => 0.0970, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 14.50% (0.1062 => 0.1216, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.48% (0.9199 => 1.0531, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 14.46% (1.3693 => 1.5673, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.35% (0.1986 => 0.2271, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.34% (0.0725 => 0.0829, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.34% (0.6959 => 0.7957, std.dev.: 0.0102) MultiSource/Applications/lambda-0_1_3/lambda: 14.32% (0.7038 => 0.8046, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.31% (0.0720 => 0.0823, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.11% (0.0964 => 0.1100, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.08% (3.9660 => 4.5243, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.07% (0.5637 => 0.6430, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.94% (0.5265 => 0.5999, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/mst/mst: 13.86% (0.1111 => 0.1265, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.77% (0.1075 => 0.1223, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.64% (0.1276 => 0.1450, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 13.63% (0.7460 => 0.8477, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.54% (0.1588 => 0.1803, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.52% (0.2914 => 0.3308, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 13.35% (1.1061 => 1.2538, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.10% (0.0977 => 0.1105, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/exptree: 13.02% (0.0768 => 0.0868, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.87% (0.5577 => 0.6295, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 12.82% (0.4328 => 0.4883, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 12.80% (0.4062 => 0.4582, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 12.78% (13.8202 => 15.5864, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.72% (0.1014 => 0.1143, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 12.72% (0.1478 => 0.1666, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 12.71% (0.0818 => 0.0922, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.71% (0.1865 => 0.2102, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.69% (1.2193 => 1.3740, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.66% (1.4563 => 1.6406, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.62% (0.1157 => 0.1303, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.51% (0.2023 => 0.2276, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.50% (1.1364 => 1.2784, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.49% (0.6283 => 0.7068, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.45% (0.3246 => 0.3650, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.40% (0.4379 => 0.4922, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/em3d/em3d: 12.37% (0.1657 => 0.1862, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 12.31% (0.7506 => 0.8430, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 12.20% (3.8646 => 4.3361, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 12.04% (0.3130 => 0.3507, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.98% (0.3899 => 0.4366, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.94% (0.2127 => 0.2381, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 11.90% (0.2925 => 0.3273, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.77% (0.4791 => 0.5355, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 11.72% (0.2995 => 0.3346, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.71% (0.3022 => 0.3376, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 11.66% (1.0313 => 1.1516, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 11.65% (0.5818 => 0.6496, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 11.58% (1.9270 => 2.1502, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 11.55% (0.3220 => 0.3592, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.54% (0.3580 => 0.3993, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 11.52% (0.1589 => 0.1772, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.45% (0.1048 => 0.1168, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 11.34% (0.6744 => 0.7509, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 11.31% (16.6129 => 18.4914, std.dev.: 0.0189) SingleSource/UnitTests/ObjC++/Hello: 11.24% (0.5748 => 0.6394, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 11.24% (0.3489 => 0.3881, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/health/health: 11.21% (0.1213 => 0.1349, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 11.17% (0.0976 => 0.1085, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.13% (0.3756 => 0.4174, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 11.10% (0.8310 => 0.9232, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.08% (0.1435 => 0.1594, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.08% (0.3485 => 0.3871, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 11.06% (0.7061 => 0.7842, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.03% (0.4016 => 0.4459, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.03% (0.1569 => 0.1742, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 11.02% (7.2180 => 8.0133, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.01% (0.1789 => 0.1986, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 11.00% (0.2781 => 0.3087, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 10.99% (0.3293 => 0.3655, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 10.97% (3.1889 => 3.5388, std.dev.: 0.0047) MultiSource/Applications/siod/siod: 10.97% (2.1791 => 2.4182, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.91% (0.4390 => 0.4869, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 10.73% (0.3868 => 0.4283, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 10.69% (0.3453 => 0.3822, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.64% (0.2782 => 0.3078, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.64% (1.3245 => 1.4654, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.61% (0.8698 => 0.9621, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.55% (0.2966 => 0.3279, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 10.53% (0.2726 => 0.3013, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 10.47% (1.0594 => 1.1703, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.47% (0.2140 => 0.2364, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 10.38% (0.3534 => 0.3901, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 10.35% (0.3149 => 0.3475, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 10.33% (0.2760 => 0.3045, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.31% (1.9828 => 2.1873, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 10.29% (0.2761 => 0.3045, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 10.27% (0.3107 => 0.3426, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 10.13% (0.2607 => 0.2871, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 10.11% (0.2690 => 0.2962, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 10.08% (0.2628 => 0.2893, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 10.08% (0.2937 => 0.3233, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.04% (0.2321 => 0.2554, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.02% (0.2655 => 0.2921, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.02% (0.2765 => 0.3042, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.01% (0.1819 => 0.2001, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 10.00% (3.6692 => 4.0363, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary2: 9.99% (0.3192 => 0.3511, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/05-eks/eks: 9.85% (0.4113 => 0.4518, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 9.81% (0.2988 => 0.3281, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.75% (4.3801 => 4.8070, std.dev.: 0.0119) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.73% (0.6135 => 0.6732, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.69% (4.9865 => 5.4697, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.68% (4.4433 => 4.8732, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.57% (0.2696 => 0.2954, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.40% (0.3755 => 0.4108, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 9.37% (0.2945 => 0.3221, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 9.34% (4.6629 => 5.0983, std.dev.: 0.0055) MultiSource/Applications/JM/lencod/lencod: 9.26% (14.8535 => 16.2295, std.dev.: 0.0027) MultiSource/Applications/SIBsim4/SIBsim4: 9.19% (1.2749 => 1.3920, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 9.12% (8.4961 => 9.2713, std.dev.: 0.0080) MultiSource/Benchmarks/sim/sim: 9.07% (0.3131 => 0.3415, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.00% (1.5188 => 1.6555, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.96% (1.1333 => 1.2349, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.86% (0.3511 => 0.3822, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.80% (0.6576 => 0.7155, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 8.70% (3.7467 => 4.0726, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/neural/neural: 8.59% (0.1385 => 0.1504, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.57% (0.9108 => 0.9889, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 8.46% (0.6250 => 0.6779, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.41% (3.2742 => 3.5497, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.41% (0.4805 => 0.5209, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.38% (0.3245 => 0.3517, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.31% (0.8818 => 0.9551, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.19% (0.2504 => 0.2709, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 8.08% (6.5754 => 7.1067, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.08% (2.1007 => 2.2704, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.93% (6.2785 => 6.7762, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/oourafft: 7.87% (0.2008 => 0.2166, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.85% (0.2243 => 0.2419, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 7.79% (1.2292 => 1.3250, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/parameter-passing: 7.62% (0.4003 => 0.4308, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.41% (13.2842 => 14.2692, std.dev.: 0.0064) SingleSource/UnitTests/ObjC/exceptions: 7.41% (0.3914 => 0.4204, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 7.26% (0.3940 => 0.4226, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.10% (0.3789 => 0.4058, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 7.07% (0.3578 => 0.3831, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.07% (0.3663 => 0.3922, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.99% (0.3646 => 0.3901, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 6.98% (0.3623 => 0.3876, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.94% (0.3601 => 0.3851, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.88% (0.3650 => 0.3901, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 5.68% (16.2614 => 17.1850, std.dev.: 0.0048) MultiSource/Applications/ClamAV/clamscan: 5.43% (14.5298 => 15.3187, std.dev.: 0.0199) MultiSource/Benchmarks/Olden/bh/bh: 4.65% (0.2859 => 0.2992, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 3.03% (33.2944 => 34.3022, std.dev.: 0.0255) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5181, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 26.34% (1.8175 => 2.2963, std.dev.: 0.0357) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.04% (1.0895 => 1.2752, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 11.02% (1.1560 => 1.2834, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 8.99% (0.8273 => 0.9017, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4144, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 5.47% (1.2998 => 1.3709, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.43% (0.9692 => 1.0218) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.76% (1.9144 => 2.0056, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.46% (2.8606 => 2.9882, std.dev.: 0.0028) SingleSource/Regression/C/uint64_to_float: 4.44% (0.5449 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.85% (11.2619 => 11.6958, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 3.38% (12.0921 => 12.5006, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: 3.27% (1.9199 => 1.9827, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 3.22% (10.7476 => 11.0941, std.dev.: 0.0475) MultiSource/Benchmarks/Olden/bisort/bisort: 3.00% (0.8239 => 0.8486, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.41% (1.0310 => 1.0558, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.16% (7.4271 => 7.5873, std.dev.: 0.0024) MultiSource/Applications/lemon/lemon: 1.80% (1.4298 => 1.4555, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5124, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.36% (1.9433 => 1.9698, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2122, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1877, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 1.20% (5.5130 => 5.5790, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.20% (9.9194 => 10.0381, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 1.09% (12.4560 => 12.5916, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/queens: 1.01% (2.1753 => 2.1972, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.22% (0.2670 => 0.1436, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.98% (0.4657 => 0.3913, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.44% (1.3819 => 1.2238, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.43% (1.3813 => 1.2234, std.dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.29% (1.0460 => 0.8547, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.78% (0.2238 => 0.1952, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.15% (20.3410 => 18.2756, std.dev.: 0.0137) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -5.60% (1.2308 => 1.1619, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.44% (1.3780 => 1.3031, std.dev.: 0.0091) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0050) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5152, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.77% (0.9996 => 0.9519, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.77% (1.7688 => 1.7021, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.16% (0.4867 => 0.4713, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -2.90% (3.0263 => 2.9386, std.dev.: 0.0018) MultiSource/Applications/siod/siod: -2.87% (3.2729 => 3.1790, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -2.76% (1.9762 => 1.9217, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8812, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.34% (4.1080 => 4.0119, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.90% (0.6589 => 0.6464, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.86% (0.6615 => 0.6492) SingleSource/Benchmarks/Shootout/lists: -1.71% (6.3560 => 6.2473, std.dev.: 0.0045) MultiSource/Applications/lua/lua: -1.69% (26.5159 => 26.0676, std.dev.: 0.0202) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.65% (0.8342 => 0.8204, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.64% (2.5254 => 2.4841, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: -1.41% (7.1097 => 7.0094, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: -1.36% (5.3167 => 5.2446, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: -1.24% (28.2225 => 27.8719, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -1.16% (3.9173 => 3.8720, std.dev.: 0.0024) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1139, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -1.06% (84.4286 => 83.5377, std.dev.: 0.0081) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 21 13:53:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 21 Oct 2012 15:53:45 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121021205345.BBD0D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5075?compare_to=5072&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5075, Order: 166398, Start Time: 2012-10-21 19:31:54, End Time: 2012-10-21 20:55:48 To: 5072, Order: 166395, Start Time: 2012-10-21 17:13:30, End Time: 2012-10-21 18:36:32 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 17 (29 on baseline) Performance Improvements: 2 (3 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 956 (942 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.12% (0.0726 => 0.0843, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.36% (0.3027 => 0.3159, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.24% (0.6040 => 0.6296, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.82% (0.2987 => 0.3101, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/09-vor/vor: 3.51% (0.3221 => 0.3334, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 2.44% (4.1402 => 4.2411, std.dev.: 0.0278) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.41% (0.9507 => 0.9736, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.31% (0.8491 => 0.8687, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.31% (0.6416 => 0.6564, std.dev.: 0.0016) MultiSource/Applications/treecc/treecc: 2.30% (2.0142 => 2.0605, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.83% (0.7707 => 0.7848, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.81% (0.6203 => 0.6315, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 1.79% (0.7478 => 0.7612, std.dev.: 0.0037) MultiSource/Applications/Burg/burg: 1.45% (1.2451 => 1.2632, std.dev.: 0.0041) MultiSource/Benchmarks/PAQ8p/paq8p: 1.23% (2.3753 => 2.4046, std.dev.: 0.0068) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/himenobmtxpa: 4.69% (4.2994 => 4.5012, std.dev.: 0.0365) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.02% (21.8743 => 22.3155, std.dev.: 0.1635) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.52% (4.9215 => 4.8465, std.dev.: 0.0227) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -1.08% (42.0789 => 41.6259, std.dev.: 0.0529) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.13% (16.4745 => 16.4955, std.dev.: 0.2316) MultiSource/Applications/obsequi/Obsequi: -1.19% (1.0498 => 1.0373, std.dev.: 0.0078) MultiSource/Applications/sqlite3/sqlite3: 1.14% (0.6305 => 0.6377, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: 2.70% (0.1814 => 0.1863, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -11.14% (0.1679 => 0.1492, std.dev.: 0.0096) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.12% (0.3233 => 0.3237, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.20% (0.2493 => 0.2488, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.54% (0.3326 => 0.3344, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.51% (0.2360 => 0.2372, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/bigfib: -0.45% (0.5983 => 0.5956, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel: -8.45% (0.0485 => 0.0444, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.30% (0.3298 => 0.3288, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/strcat: -2.27% (0.2022 => 0.1976, std.dev.: 0.0028) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.94% (0.0173 => 0.0185, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 30.86% (0.0162 => 0.0212, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0420 => 0.0420, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.31% (0.0325 => 0.0324, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.33% (0.0306 => 0.0307, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.72% (0.0419 => 0.0416, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 50.77% (0.0130 => 0.0196, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 2.40% (0.0208 => 0.0213, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 2.74% (0.0328 => 0.0337, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.83% (0.1439 => 0.1451, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.41% (1.1174 => 1.1220, std.dev.: 0.0266) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 6.09% (0.1429 => 0.1516, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.61% (0.4067 => 0.4214, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.01% (0.1373 => 0.1428, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.71% (0.0593 => 0.0615, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -7.53% (0.0239 => 0.0221, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.36% (0.0554 => 0.0556, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.14% (1.1440 => 1.1456, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 440.00% (0.0005 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.89% (0.0591 => 0.0568, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.60% (0.0172 => 0.0204, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.27% (0.8024 => 0.7922, std.dev.: 0.0070) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -44.44% (0.0108 => 0.0060, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.08% (2.1832 => 1.6575, std.dev.: 0.0054) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.83% (0.0810 => 0.0922, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/tsp/tsp: 11.06% (0.1112 => 0.1235, std.dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.31% (0.3137 => 0.3335, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.06% (0.2180 => 0.2312, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.70% (0.2279 => 0.2409, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.03% (0.4847 => 0.5091, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.02% (0.7473 => 0.7848, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.76% (0.6010 => 0.6296, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.41% (0.6287 => 0.6564, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.40% (0.8321 => 0.8687, std.dev.: 0.0062) MultiSource/Applications/spiff/spiff: 3.89% (0.7950 => 0.8259, std.dev.: 0.0054) MultiSource/Applications/Burg/burg: 3.35% (1.2222 => 1.2632, std.dev.: 0.0041) MultiSource/Applications/treecc/treecc: 3.29% (1.9948 => 2.0605, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.19% (0.9435 => 0.9736, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/gs/gs: 2.68% (4.1305 => 4.2411, std.dev.: 0.0278) MultiSource/Applications/hbd/hbd: 2.42% (1.4269 => 1.4614, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.28% (1.1685 => 1.1951, std.dev.: 0.0034) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.97% (6.6074 => 6.7376, std.dev.: 0.0283) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.57% (1.3279 => 1.3488, std.dev.: 0.0077) MultiSource/Applications/d/make_dparser: 1.36% (3.2366 => 3.2805, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.35% (4.4873 => 4.5477, std.dev.: 0.0232) MultiSource/Benchmarks/PAQ8p/paq8p: 1.19% (2.3764 => 2.4046, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.11% (4.1763 => 4.2228, std.dev.: 0.0162) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.68% (1.5795 => 2.5064, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.37% (1.1857 => 1.2849, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.13% (0.3186 => 0.3445, std.dev.: 0.0089) MultiSource/Benchmarks/mafft/pairlocalalign: 5.98% (63.1822 => 66.9621, std.dev.: 0.0889) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.35% (4.3552 => 4.5012, std.dev.: 0.0365) MultiSource/Applications/siod/siod: 2.65% (3.6643 => 3.7613, std.dev.: 0.0091) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -33.43% (0.0338 => 0.0225, std.dev.: 0.0042) MultiSource/Applications/lua/lua: -5.23% (29.8330 => 28.2725, std.dev.: 0.2372) SingleSource/Benchmarks/Shootout-C++/hash2: -1.59% (3.4237 => 3.3692, std.dev.: 0.0026) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.30% (16.4461 => 16.4955, std.dev.: 0.2316) MultiSource/Applications/obsequi/Obsequi: 1.08% (1.0262 => 1.0373, std.dev.: 0.0078) MultiSource/Applications/sqlite3/sqlite3: 0.71% (0.6332 => 0.6377, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: 1.75% (0.1831 => 0.1863, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.30% (0.1559 => 0.1492, std.dev.: 0.0096) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.65% (0.3123 => 0.3237, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.02% (0.2463 => 0.2488, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.3344 => 0.3344, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.34% (0.2364 => 0.2372, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/bigfib: -0.90% (0.6010 => 0.5956, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel: 3.50% (0.0429 => 0.0444, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.67% (0.3266 => 0.3288, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/strcat: 0.36% (0.1969 => 0.1976, std.dev.: 0.0028) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -17.41% (0.0224 => 0.0185, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 72.36% (0.0123 => 0.0212, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.94% (0.0408 => 0.0420, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 27.56% (0.0254 => 0.0324, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.66% (0.0302 => 0.0307, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 8.33% (0.0384 => 0.0416, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 3.16% (0.0190 => 0.0196, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 18.33% (0.0180 => 0.0213, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 46.52% (0.0230 => 0.0337, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.90% (0.1438 => 0.1451, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -0.96% (1.1329 => 1.1220, std.dev.: 0.0266) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.69% (0.1462 => 0.1516, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.20% (0.4164 => 0.4214, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.31% (0.1369 => 0.1428, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.06% (0.0641 => 0.0615, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 13.33% (0.0195 => 0.0221, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.81% (0.0578 => 0.0556, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.17% (1.1437 => 1.1456, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.41% (0.0627 => 0.0568, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 13.33% (0.0180 => 0.0204, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.18% (0.8017 => 0.7922, std.dev.: 0.0070) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -3.23% (0.0062 => 0.0060, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 21 14:02:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 21 Oct 2012 16:02:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121021210247.E001B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5076?compare_to=5073&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5076, Order: 166398, Start Time: 2012-10-21 19:44:30, End Time: 2012-10-21 21:04:48 To: 5073, Order: 166395, Start Time: 2012-10-21 17:34:17, End Time: 2012-10-21 18:55:16 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (4 on baseline) Performance Regressions: 2 (194 on baseline) Performance Improvements: 1 (45 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 89 (15 on baseline) Unchanged Tests: 950 (648 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.74% (54.4489 => 55.9385, std.dev.: 0.3060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.01% (29.0889 => 29.6738, std.dev.: 0.0468) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.31% (16.0038 => 15.7944, std.dev.: 0.0091) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.02% (0.6255 => 0.6254, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 0.05% (17.2862 => 17.2957, std.dev.: 0.0074) MultiSource/Benchmarks/Bullet/bullet: -0.01% (56.4301 => 56.4233, std.dev.: 0.0167) MultiSource/Benchmarks/MallocBench/gs/gs: 0.04% (4.6010 => 4.6027, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0483 => 0.0483) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0484 => 0.0484) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.22% (0.0454 => 0.0453, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0454 => 0.0454, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0442 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.23% (0.0444 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0436 => 0.0436, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.23% (0.0437 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.44% (0.0455 => 0.0453, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.22% (0.0455 => 0.0456) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.22% (0.0449 => 0.0448, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0449 => 0.0449, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0438 => 0.0438) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.23% (0.0439 => 0.0440, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0446 => 0.0446) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0446 => 0.0446, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0457 => 0.0457, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0458 => 0.0458) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.46% (0.0435 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0434 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.22% (0.0445 => 0.0446, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0446 => 0.0446, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0437 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0438 => 0.0438, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0429 => 0.0429) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0430 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0427 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.23% (0.0429 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.22% (0.0465 => 0.0464, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0466 => 0.0466) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0426 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.23% (0.0428 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.23% (0.0428 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0429 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0435 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0437 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.14% (1.3007 => 1.3025, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.05% (8.2276 => 8.2236, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.03% (0.7791 => 0.7793, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 0.85% (0.0353 => 0.0356, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: - (0.1437 => 0.1437, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.18% (0.2184 => 0.2180, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -10.78% (63.2438 => 56.4233, std.dev.: 0.0167) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/kimwitu++/kc: 36.83% (14.1553 => 19.3680, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.64% (3.4629 => 5.8052, std.dev.: 0.0108) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13488.19% (0.0720 => 9.7835, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049700.00% (0.0001 => 10.0498, std.dev.: 0.0013) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 65.15% (0.2554 => 0.4218, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/lowercase: 56.64% (0.0256 => 0.0401) MultiSource/Benchmarks/PAQ8p/paq8p: 52.35% (10.3673 => 15.7944, std.dev.: 0.0091) SingleSource/UnitTests/SignlessTypes/factor: 45.95% (0.0296 => 0.0432, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 42.44% (0.0271 => 0.0386, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.57% (1.5859 => 2.2451, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/distray/distray: 36.46% (0.1056 => 0.1441, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 35.76% (0.1622 => 0.2202, std.dev.: 0.0007) SingleSource/UnitTests/vla: 32.68% (0.0355 => 0.0471) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.29% (2.2024 => 2.8695, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/neural/neural: 26.32% (0.1463 => 0.1848, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 25.42% (0.0834 => 0.1046, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.01% (0.1566 => 0.1895, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/hash: 20.82% (0.0485 => 0.0586, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 19.06% (0.1432 => 0.1705, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.77% (7.0540 => 8.3780, std.dev.: 0.0120) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.48% (0.0871 => 0.1032, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 18.14% (0.1555 => 0.1837, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.86% (0.5105 => 0.6017, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.76% (2.2022 => 2.5934, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.59% (0.6675 => 0.7849, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 17.04% (0.1655 => 0.1937, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: 16.93% (0.0626 => 0.0732, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 16.81% (3.3354 => 3.8961, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.60% (1.3050 => 1.5216, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 16.22% (0.1695 => 0.1970, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.19% (0.4615 => 0.5362, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.14% (0.0793 => 0.0921, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.12% (0.2271 => 0.2637, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.98% (0.5020 => 0.5822, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 15.90% (0.1440 => 0.1669, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.79% (0.1032 => 0.1195, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: 15.76% (0.2049 => 0.2372, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 15.76% (10.4361 => 12.0805, std.dev.: 0.0120) MultiSource/Benchmarks/Olden/tsp/tsp: 15.66% (0.1175 => 0.1359, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 15.65% (0.1163 => 0.1345, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.63% (0.1337 => 0.1546, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.43% (0.1510 => 0.1743, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.24% (1.5415 => 1.7765, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.24% (0.0886 => 0.1021, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.16% (0.8172 => 0.9411, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: 15.08% (0.7115 => 0.8188, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.05% (0.1940 => 0.2232, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.96% (0.0842 => 0.0968, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 14.96% (0.3282 => 0.3773, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 14.80% (0.3109 => 0.3569, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 14.67% (0.3423 => 0.3925, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/exptree: 14.62% (0.0814 => 0.0933, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.61% (0.0746 => 0.0855) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.60% (4.2646 => 4.8872, std.dev.: 0.0121) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.58% (0.1584 => 0.1815, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.41% (0.9765 => 1.1172, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.32% (0.1117 => 0.1277, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.32% (0.3121 => 0.3568, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.32% (0.1236 => 0.1413, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.32% (0.0838 => 0.0958, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 14.30% (0.0818 => 0.0935, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 14.29% (1.1642 => 1.3306, std.dev.: 0.0082) MultiSource/Applications/aha/aha: 14.25% (0.1151 => 0.1315, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.17% (1.7609 => 2.0104, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.14% (0.2107 => 0.2405, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 14.12% (0.7835 => 0.8941, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 14.08% (9.4845 => 10.8200, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.04% (0.2065 => 0.2355, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.02% (0.6450 => 0.7354, std.dev.: 0.0015) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.00% (0.1143 => 0.1303, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 13.97% (0.0730 => 0.0832, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.91% (0.0798 => 0.0909) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.90% (0.0770 => 0.0877, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.77% (0.1438 => 0.1636, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 13.76% (5.7591 => 6.5516, std.dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 13.76% (1.1840 => 1.3469, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.73% (8.1363 => 9.2538, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.72% (0.0933 => 0.1061, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.71% (0.2758 => 0.3136, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.66% (1.4186 => 1.6124, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.65% (0.5860 => 0.6660, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.59% (0.1906 => 0.2165, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 13.57% (0.7433 => 0.8442, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 13.52% (2.0273 => 2.3013, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.45% (0.1695 => 0.1923, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.41% (0.1029 => 0.1167, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.37% (0.1062 => 0.1204, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 13.25% (0.1268 => 0.1436, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.15% (0.2700 => 0.3055, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.05% (0.1625 => 0.1837, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.02% (0.0929 => 0.1050, std.dev.: 0.0006) SingleSource/UnitTests/SignlessTypes/rem: 13.02% (0.1144 => 0.1293, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 12.97% (1.0722 => 1.2113, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/05-eks/eks: 12.84% (0.4299 => 0.4851, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: 12.81% (0.3387 => 0.3821, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 12.81% (3.8723 => 4.3684, std.dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 12.80% (0.1125 => 0.1269, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.76% (0.3307 => 0.3729, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.71% (0.8067 => 0.9092, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.69% (0.5981 => 0.6740, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.66% (0.5569 => 0.6274, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.56% (0.4879 => 0.5492, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.41% (0.2603 => 0.2926, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 12.37% (0.3177 => 0.3570, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.33% (0.1330 => 0.1494, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.26% (1.1861 => 1.3315, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/09-vor/vor: 12.23% (0.3180 => 0.3569, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.20% (7.9617 => 8.9333, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.12% (4.9449 => 5.5444, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.09% (5.0018 => 5.6065, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/football/football: 11.88% (0.8921 => 0.9981, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.69% (0.3543 => 0.3957, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 11.61% (0.3092 => 0.3451, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.57% (0.3441 => 0.3839, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 11.38% (0.6456 => 0.7191, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 11.24% (1.5603 => 1.7356, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/parameter-passing: 11.20% (0.3927 => 0.4367, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 11.17% (0.3473 => 0.3861, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 11.14% (2.2969 => 2.5527, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-4: 11.12% (0.3543 => 0.3937, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 11.04% (0.3561 => 0.3954, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 11.04% (0.3516 => 0.3904, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.02% (0.3828 => 0.4250, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.01% (0.3886 => 0.4314, std.dev.: 0.0091) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.99% (0.1892 => 0.2100, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-2: 10.98% (0.3497 => 0.3881, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 10.96% (0.3694 => 0.4099, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.96% (0.8101 => 0.8989, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.81% (0.2266 => 0.2511, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 10.48% (0.4620 => 0.5104, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 10.26% (0.4289 => 0.4729, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.25% (0.1044 => 0.1151, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 9.96% (0.3422 => 0.3763, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.96% (0.3826 => 0.4207, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 9.94% (21.9371 => 24.1178, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.75% (0.3865 => 0.4242, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.68% (0.4103 => 0.4500, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.61% (0.4203 => 0.4607, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 9.41% (0.4048 => 0.4429, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.17% (0.4636 => 0.5061, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 9.15% (0.3684 => 0.4021, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.02% (0.3427 => 0.3736, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 8.78% (0.5925 => 0.6445, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 8.74% (0.6030 => 0.6557, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 8.68% (17.1811 => 18.6732, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/sieve: 8.58% (0.3603 => 0.3912, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 8.27% (0.7326 => 0.7932, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.22% (0.3650 => 0.3950, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.10% (0.4064 => 0.4393, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.03% (3.8922 => 4.2047, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 8.01% (0.3283 => 0.3546, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.01% (14.3668 => 15.5175, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/matrix: 7.91% (0.3098 => 0.3343, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 7.88% (0.2831 => 0.3054, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 7.78% (0.2905 => 0.3131, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.77% (0.3232 => 0.3483, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.76% (0.2872 => 0.3095, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.75% (0.2891 => 0.3115, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.74% (0.2430 => 0.2618, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.69% (0.3162 => 0.3405, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.59% (0.3136 => 0.3374, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.45% (0.2793 => 0.3001, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.42% (2.0665 => 2.2198, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.40% (0.2756 => 0.2960, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 7.35% (0.2871 => 0.3082, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 7.32% (0.2802 => 0.3007, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/wc: 7.31% (0.3052 => 0.3275, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 7.27% (0.2725 => 0.2923, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 7.26% (0.2877 => 0.3086, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 7.16% (0.3379 => 0.3621, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 7.04% (0.2714 => 0.2905, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 6.59% (1.2842 => 1.3688, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 6.00% (0.3131 => 0.3319, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.54% (0.3817 => 0.3952, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.33% (0.3935 => 0.4066, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.93% (1.1194 => 1.1522, std.dev.: 0.0113) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8953, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.51% (5.3999 => 13.3115, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1726, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.92% (1.1145 => 1.2919, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.80% (0.9957 => 1.1331, std.dev.: 0.0120) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2173, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.90% (1.1396 => 1.2524, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3682, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/bh/bh: 5.92% (1.9405 => 2.0554, std.dev.: 0.0005) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.72% (0.4162 => 0.4317, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.63% (4.2280 => 4.3390, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.61% (0.3987 => 0.4091, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.13% (3.6395 => 3.7169, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bisort/bisort: 1.79% (0.8333 => 0.8482, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.60% (2.6546 => 2.6971, std.dev.: 0.0013) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2076, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 1.08% (4.4649 => 4.5132, std.dev.: 0.0058) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.00% (6.6874 => 0.1336, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -79.94% (0.8651 => 0.1735, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.85% (5.2763 => 3.2263, std.dev.: 0.0191) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.21% (5.3855 => 3.7047, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.74% (5.3526 => 3.7073, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -14.79% (54.1659 => 46.1549, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.54% (2.9384 => 2.6286, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -6.41% (22.1758 => 20.7544, std.dev.: 0.0263) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.06% (8.0499 => 3.7784, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.44% (1.1492 => 0.7649, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4752, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -16.10% (1.6925 => 1.4200, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.53% (0.0998 => 0.0853) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.69% (1.2258 => 1.0702, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.49% (1.2373 => 1.0951, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -10.73% (1.5373 => 1.3723, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.26% (19.9488 => 18.3001, std.dev.: 0.0173) MultiSource/Benchmarks/FreeBench/mason/mason: -7.73% (0.2161 => 0.1994, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.04% (1.8329 => 1.7038, std.dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8478, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.17% (1.6805 => 1.5936, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.67% (1.5835 => 1.5096, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.34% (8.1563 => 7.8025, std.dev.: 0.0122) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Applications/siod/siod: -3.65% (3.2827 => 3.1628, std.dev.: 0.0026) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8775, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5008, std.dev.: 0.0063) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.66% (0.4808 => 0.4680, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -2.27% (4.6441 => 4.5386, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0863, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6804, std.dev.: 0.0020) SingleSource/UnitTests/Vector/multiplies: -1.69% (2.5528 => 2.5096, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4199, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.10% (2.3135 => 2.2880) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.01% (6.2999 => 6.2361, std.dev.: 0.0113) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 19.60% (0.5229 => 0.6254, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 15.39% (14.9895 => 17.2957, std.dev.: 0.0074) MultiSource/Benchmarks/MallocBench/gs/gs: 11.97% (4.1105 => 4.6027, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.89% (1.1048 => 1.3025, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.88% (7.1582 => 8.2236, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/stepanov_container: 25.25% (0.6222 => 0.7793, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: 35500.00% (0.0001 => 0.0356, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -3.23% (0.1485 => 0.1437, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.02% (0.2116 => 0.2180, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 21 14:08:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 21 Oct 2012 16:08:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121021210824.730112A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5077?compare_to=5074&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5077, Order: 166398, Start Time: 2012-10-21 19:45:24, End Time: 2012-10-21 21:11:25 To: 5074, Order: 166395, Start Time: 2012-10-21 17:40:41, End Time: 2012-10-21 19:07:05 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (204 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1042 (661 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.40% (2.0176 => 2.5099, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.63% (0.1410 => 0.1715, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 18.89% (0.0826 => 0.0982, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 18.84% (0.0653 => 0.0776, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 18.72% (0.2243 => 0.2663, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.69% (0.0746 => 0.0878, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 17.57% (0.1013 => 0.1191, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.03% (0.7710 => 0.9023, std.dev.: 0.0039) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.70% (0.1072 => 0.1251, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.24% (0.0819 => 0.0952, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 15.84% (0.0770 => 0.0892, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 15.66% (0.2721 => 0.3147, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.23% (0.0847 => 0.0976, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.22% (0.2596 => 0.2991, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 15.11% (0.0834 => 0.0960, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.92% (0.1327 => 0.1525, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.86% (0.1413 => 0.1623, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.80% (0.0811 => 0.0931, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.73% (0.0964 => 0.1106, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 14.56% (0.1003 => 0.1149, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 14.50% (0.1062 => 0.1216, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.43% (0.9199 => 1.0526, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.37% (0.6959 => 0.7959, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.34% (0.0725 => 0.0829, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.31% (0.0720 => 0.0823, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 14.26% (1.3693 => 1.5646, std.dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: 14.24% (0.7038 => 0.8040, std.dev.: 0.0082) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.15% (3.9660 => 4.5271, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.00% (0.1986 => 0.2264, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.98% (0.5637 => 0.6425, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/mst/mst: 13.95% (0.1111 => 0.1266, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.81% (0.5265 => 0.5992, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.79% (0.1276 => 0.1452, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.77% (0.1075 => 0.1223, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.73% (0.1588 => 0.1806, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 13.55% (0.7460 => 0.8471, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.52% (0.2914 => 0.3308, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/exptree: 13.28% (0.0768 => 0.0870, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 13.15% (1.1061 => 1.2515, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.00% (0.0977 => 0.1104, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.88% (1.4563 => 1.6438, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.87% (0.1865 => 0.2105, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 12.86% (0.1478 => 0.1668, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/distray/distray: 12.84% (0.0818 => 0.0923, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.84% (1.2193 => 1.3758, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 12.80% (13.8202 => 15.5888, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.75% (0.5577 => 0.6288, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.72% (0.1014 => 0.1143, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 12.68% (0.4328 => 0.4877, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.67% (1.1364 => 1.2804, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.62% (0.1157 => 0.1303, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 12.56% (0.4062 => 0.4572, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.51% (0.3246 => 0.3652, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.51% (0.2023 => 0.2276, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.42% (0.4379 => 0.4923, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.41% (0.6283 => 0.7063, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 12.39% (0.7506 => 0.8436, std.dev.: 0.0069) MultiSource/Benchmarks/MallocBench/gs/gs: 12.27% (3.8646 => 4.3388, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/em3d/em3d: 12.25% (0.1657 => 0.1860, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.22% (0.2127 => 0.2387, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 12.20% (0.3130 => 0.3512, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.02% (0.1048 => 0.1174, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 11.90% (0.2925 => 0.3273, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 11.89% (0.2995 => 0.3351, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 11.78% (1.0313 => 1.1528, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.77% (0.3899 => 0.4358, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.77% (0.4791 => 0.5355, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 11.59% (1.9270 => 2.1503, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 11.58% (0.1589 => 0.1773, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 11.55% (0.5818 => 0.6490, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 11.49% (0.7061 => 0.7872, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/18-imp/imp: 11.46% (0.3220 => 0.3589, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.35% (0.3022 => 0.3365, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 11.20% (16.6129 => 18.4742, std.dev.: 0.0222) MultiSource/Applications/minisat/minisat: 11.18% (0.6744 => 0.7498, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 11.17% (0.5748 => 0.6390, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 11.17% (0.0976 => 0.1085, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.15% (0.1435 => 0.1595, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 11.13% (7.2180 => 8.0211, std.dev.: 0.0083) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.12% (0.1789 => 0.1988, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 11.07% (2.1791 => 2.4204, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.05% (0.3485 => 0.3870, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 11.05% (0.1213 => 0.1347, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.03% (0.1569 => 0.1742, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 11.02% (0.8310 => 0.9226, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 10.99% (3.1889 => 3.5395, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 10.93% (0.2781 => 0.3085, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.86% (0.4016 => 0.4452, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.84% (0.3756 => 0.4163, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.81% (0.3489 => 0.3866, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 10.78% (0.3293 => 0.3648, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.75% (0.4390 => 0.4862, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.75% (1.3245 => 1.4669, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.67% (0.3580 => 0.3962, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 10.57% (0.3868 => 0.4277, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.47% (0.2140 => 0.2364, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.43% (0.8698 => 0.9605, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.35% (0.2782 => 0.3070, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 10.33% (1.0594 => 1.1688, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: 10.31% (0.2726 => 0.3007, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.28% (0.1819 => 0.2006, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sieve: 10.22% (0.3453 => 0.3806, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.15% (0.2966 => 0.3267, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 10.14% (0.2761 => 0.3041, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 10.13% (0.3534 => 0.3892) SingleSource/Benchmarks/Shootout-C++/except: 10.11% (0.2760 => 0.3039, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.09% (1.9828 => 2.1828, std.dev.: 0.0102) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.08% (0.2321 => 0.2555, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 10.07% (0.3107 => 0.3420, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 10.07% (0.3149 => 0.3466, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 10.06% (3.6692 => 4.0384, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hello: 10.01% (0.2607 => 0.2868, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/05-eks/eks: 9.94% (0.4113 => 0.4522, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 9.93% (0.2690 => 0.2957, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 9.87% (0.2937 => 0.3227, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.84% (4.3801 => 4.8109, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.83% (0.2655 => 0.2916, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 9.82% (0.2628 => 0.2886, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 9.81% (0.3192 => 0.3505, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.78% (0.6135 => 0.6735, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.77% (4.4433 => 4.8774, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.73% (0.2765 => 0.3034, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.64% (4.9865 => 5.4673, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/matrix: 9.57% (0.2988 => 0.3274, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 9.41% (14.8535 => 16.2518, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.38% (0.2696 => 0.2949, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 9.30% (4.6629 => 5.0966, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.24% (0.3755 => 0.4102, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 9.20% (0.3131 => 0.3419, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 9.19% (1.2749 => 1.3920, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/objinst: 9.17% (0.2945 => 0.3215, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 9.10% (8.4961 => 9.2695, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.01% (1.5188 => 1.6556, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.95% (1.1333 => 1.2347, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 8.89% (3.7467 => 4.0798, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.86% (0.3511 => 0.3822, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.72% (0.8818 => 0.9587, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.72% (0.9108 => 0.9902, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.67% (0.6576 => 0.7146, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: 8.66% (0.1385 => 0.1505, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.59% (0.2504 => 0.2719, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.44% (3.2742 => 3.5505, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/oourafft: 8.37% (0.2008 => 0.2176, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 8.32% (0.6250 => 0.6770, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.30% (0.4805 => 0.5204, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 8.28% (6.5754 => 7.1199, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.23% (0.3245 => 0.3512, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.13% (6.2785 => 6.7887, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.04% (2.1007 => 2.2696, std.dev.: 0.0181) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.89% (0.2243 => 0.2420, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/parameter-passing: 7.87% (0.4003 => 0.4318, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.63% (1.2292 => 1.3230, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.56% (13.2842 => 14.2888, std.dev.: 0.0107) SingleSource/UnitTests/ObjC/exceptions: 7.54% (0.3914 => 0.4209, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 7.41% (0.3940 => 0.4232) SingleSource/UnitTests/ObjC/trivial-interface: 7.29% (0.3578 => 0.3839, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 7.28% (0.3601 => 0.3863, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-4: 7.19% (0.3646 => 0.3908, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 7.18% (0.3789 => 0.4061, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.07% (0.3663 => 0.3922, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.07% (0.3650 => 0.3908, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 6.98% (0.3623 => 0.3876, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 5.78% (16.2614 => 17.2010, std.dev.: 0.0133) MultiSource/Applications/ClamAV/clamscan: 5.36% (14.5298 => 15.3081, std.dev.: 0.0212) MultiSource/Benchmarks/Olden/bh/bh: 4.76% (0.2859 => 0.2995, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 3.01% (33.2944 => 34.2951, std.dev.: 0.0091) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5158, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/fbench: 26.84% (1.8175 => 2.3053, std.dev.: 0.0313) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.10% (1.0895 => 1.2758, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: 11.04% (1.1560 => 1.2836, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4144, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.42% (0.9692 => 1.0217, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: 5.22% (1.2998 => 1.3676, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0048, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.45% (2.8606 => 2.9880, std.dev.: 0.0013) SingleSource/Regression/C/uint64_to_float: 4.42% (0.5449 => 0.5690, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.85% (11.2619 => 11.6950, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.38% (12.0921 => 12.5009, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: 3.33% (1.9199 => 1.9838, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 3.29% (10.7476 => 11.1007, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bisort/bisort: 3.10% (0.8239 => 0.8494, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.40% (1.0310 => 1.0557, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.15% (7.4271 => 7.5865, std.dev.: 0.0040) MultiSource/Applications/lemon/lemon: 1.84% (1.4298 => 1.4561, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5137, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.37% (1.9433 => 1.9699, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.25% (9.0760 => 9.1893, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.18% (9.9194 => 10.0366, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5780, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1410, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.03% (12.4560 => 12.5841, std.dev.: 0.0071) SingleSource/Benchmarks/McGill/queens: 1.00% (2.1753 => 2.1971, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.14% (0.2670 => 0.1438, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.89% (0.4657 => 0.3917, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.36% (1.3813 => 1.2244, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.27% (1.3819 => 1.2262, std.dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.29% (1.0460 => 0.8547, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/mason/mason: -12.65% (0.2238 => 0.1955) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.18% (20.3410 => 18.2710, std.dev.: 0.0202) SingleSource/Benchmarks/Misc/flops-3: -6.26% (2.4152 => 2.2641, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.73% (1.3780 => 1.2990, std.dev.: 0.0145) SingleSource/Benchmarks/McGill/chomp: -5.65% (1.2308 => 1.1612, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.06% (2.6470 => 2.5131, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.82% (0.9996 => 0.9514, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.87% (1.7688 => 1.7003, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -2.88% (3.2729 => 3.1786, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -2.79% (3.0263 => 2.9419, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -2.76% (1.9762 => 1.9217, std.dev.: 0.0039) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8814, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.28% (4.1080 => 4.0145, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.94% (0.6589 => 0.6461, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.87% (0.6615 => 0.6491) MultiSource/Applications/lua/lua: -1.79% (26.5159 => 26.0421, std.dev.: 0.0307) SingleSource/Benchmarks/Shootout/lists: -1.78% (6.3560 => 6.2427, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.63% (0.8342 => 0.8206, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.61% (2.5254 => 2.4848, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: -1.43% (7.1097 => 7.0081, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -1.24% (28.2225 => 27.8731, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.3167 => 5.2534, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -1.10% (3.9173 => 3.8741, std.dev.: 0.0007) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1138, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -1.06% (84.4286 => 83.5346, std.dev.: 0.0091) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.03% (6.6320 => 6.5637, std.dev.: 0.0092) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 21 15:34:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 21 Oct 2012 17:34:03 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121021223403.42C622A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5078?compare_to=5075&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5078, Order: 166401, Start Time: 2012-10-21 21:12:57, End Time: 2012-10-21 22:36:05 To: 5075, Order: 166398, Start Time: 2012-10-21 19:31:54, End Time: 2012-10-21 20:55:48 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 8 (21 on baseline) Performance Improvements: 8 (2 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 959 (951 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.57% (15.5893 => 16.4573, std.dev.: 0.2972) SingleSource/Benchmarks/Dhrystone/fldry: 4.09% (0.6626 => 0.6897, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.90% (1.1226 => 1.1439, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/em3d/em3d: 1.46% (5.4002 => 5.4789, std.dev.: 0.0232) SingleSource/Benchmarks/Misc/ReedSolomon: 1.37% (8.6741 => 8.7930, std.dev.: 0.0166) MultiSource/Benchmarks/Fhourstones/fhourstones: 1.20% (1.2631 => 1.2783, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.19% (4.5295 => 4.5836, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/bh/bh: 1.07% (2.3670 => 2.3923, std.dev.: 0.0051) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.41% (0.8687 => 0.8391, std.dev.: 0.0085) MultiSource/Benchmarks/MallocBench/gs/gs: -2.02% (4.2411 => 4.1555, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -1.77% (0.6564 => 0.6448, std.dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: -1.32% (1.1478 => 1.1326, std.dev.: 0.0053) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (2.4046 => 2.3740, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -1.22% (0.8212 => 0.8112, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.92% (0.3195 => 0.2974, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/himenobmtxpa: -3.34% (4.5012 => 4.3510, std.dev.: 0.0528) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.52% (16.4955 => 16.4095, std.dev.: 0.0684) MultiSource/Applications/obsequi/Obsequi: 1.35% (1.0373 => 1.0513, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: -1.22% (0.6377 => 0.6299, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/08-main/main: 2.36% (0.1863 => 0.1907, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.39% (0.1492 => 0.1647, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.74% (0.3237 => 0.3261, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.41% (0.2488 => 0.2453, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.3344 => 0.3344, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.31% (0.2372 => 0.2341, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: -0.57% (0.5956 => 0.5922, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: 7.21% (0.0444 => 0.0476, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.3288 => 0.3288, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: -0.51% (0.1976 => 0.1966, std.dev.: 0.0026) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 22.16% (0.0185 => 0.0226, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -11.79% (0.0212 => 0.0187, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.95% (0.0420 => 0.0416, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -18.21% (0.0324 => 0.0265, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -12.70% (0.0307 => 0.0268, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.24% (0.0416 => 0.0415, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 1.02% (0.0196 => 0.0198, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: -37.56% (0.0213 => 0.0133, std.dev.: 0.0037) SingleSource/UnitTests/byval-alignment: -10.09% (0.0337 => 0.0303, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -76.92% (0.0013 => 0.0003, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 0.96% (0.1451 => 0.1465, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.97% (1.1220 => 1.1329, std.dev.: 0.0063) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -5.28% (0.1516 => 0.1436, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.84% (0.4214 => 0.4010, std.dev.: 0.0177) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.70% (0.1428 => 0.1418, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.15% (0.0615 => 0.0571, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 18.10% (0.0221 => 0.0261, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.88% (0.0556 => 0.0572, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.29% (1.1456 => 1.1423, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.77% (0.0031 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.58% (0.0568 => 0.0594, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.82% (0.0204 => 0.0186, std.dev.: 0.0061) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.48% (0.7922 => 0.7960, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -3.33% (0.0060 => 0.0058, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.16% (2.1832 => 1.6558, std.dev.: 0.0033) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.54% (0.0810 => 0.0944, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/tsp/tsp: 10.61% (0.1112 => 0.1230, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.69% (0.2180 => 0.2304, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.12% (0.7473 => 0.7781, std.dev.: 0.0058) MultiSource/Applications/spiff/spiff: 3.32% (0.7950 => 0.8214, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.56% (0.6287 => 0.6448, std.dev.: 0.0035) MultiSource/Applications/treecc/treecc: 1.71% (1.9948 => 2.0289, std.dev.: 0.0132) MultiSource/Applications/d/make_dparser: 1.29% (3.2366 => 3.2783, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.26% (1.4479 => 1.4662, std.dev.: 0.0055) MultiSource/Applications/lua/lua: 1.17% (3.8189 => 3.8637, std.dev.: 0.0148) MultiSource/Applications/ClamAV/clamscan: 1.03% (14.7684 => 14.9202, std.dev.: 0.0312) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.97% (1.5795 => 2.5109, std.dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.37% (14.6451 => 16.4573, std.dev.: 0.2972) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.45% (1.1857 => 1.2859, std.dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 5.97% (63.1822 => 66.9521, std.dev.: 0.0818) SingleSource/Benchmarks/Misc/ReedSolomon: 3.06% (8.5322 => 8.7930, std.dev.: 0.0166) MultiSource/Applications/siod/siod: 2.76% (3.6643 => 3.7653, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/hash: 1.89% (0.6205 => 0.6322, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: 1.54% (2.3560 => 2.3923, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.34% (1.0998 => 1.1145, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/whetstone: 1.03% (2.1224 => 2.1442, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.02% (0.3269 => 0.2974, std.dev.: 0.0022) MultiSource/Applications/lua/lua: -5.20% (29.8330 => 28.2819, std.dev.: 0.1232) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.22% (16.4461 => 16.4095, std.dev.: 0.0684) MultiSource/Applications/obsequi/Obsequi: 2.45% (1.0262 => 1.0513, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: -0.52% (0.6332 => 0.6299, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/08-main/main: 4.15% (0.1831 => 0.1907, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.64% (0.1559 => 0.1647, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.42% (0.3123 => 0.3261, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.41% (0.2463 => 0.2453, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.3344 => 0.3344, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.97% (0.2364 => 0.2341, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: -1.46% (0.6010 => 0.5922, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: 10.96% (0.0429 => 0.0476, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.67% (0.3266 => 0.3288, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: -0.15% (0.1969 => 0.1966, std.dev.: 0.0026) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.89% (0.0224 => 0.0226, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 52.03% (0.0123 => 0.0187, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.96% (0.0408 => 0.0416, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 4.33% (0.0254 => 0.0265, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -11.26% (0.0302 => 0.0268, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 8.07% (0.0384 => 0.0415, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 4.21% (0.0190 => 0.0198, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: -26.11% (0.0180 => 0.0133, std.dev.: 0.0037) SingleSource/UnitTests/byval-alignment: 31.74% (0.0230 => 0.0303, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -57.14% (0.0007 => 0.0003, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 1.88% (0.1438 => 0.1465, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: - (1.1329 => 1.1329, std.dev.: 0.0063) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.78% (0.1462 => 0.1436, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.70% (0.4164 => 0.4010, std.dev.: 0.0177) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.58% (0.1369 => 0.1418, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.92% (0.0641 => 0.0571, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 33.85% (0.0195 => 0.0261, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.04% (0.0578 => 0.0572, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.12% (1.1437 => 1.1423, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.26% (0.0627 => 0.0594, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.33% (0.0180 => 0.0186, std.dev.: 0.0061) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.71% (0.8017 => 0.7960, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -6.45% (0.0062 => 0.0058, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 21 15:52:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 21 Oct 2012 17:52:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121021225235.44E9A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5079?compare_to=5076&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5079, Order: 166401, Start Time: 2012-10-21 21:34:19, End Time: 2012-10-21 22:54:36 To: 5076, Order: 166398, Start Time: 2012-10-21 19:44:30, End Time: 2012-10-21 21:04:48 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 1 (74 on baseline) New Passes: 2 (5 on baseline) Performance Regressions: 0 (190 on baseline) Performance Improvements: 1 (45 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 87 (14 on baseline) Unchanged Tests: 951 (652 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/kimwitu++/kc: -19.50% (19.3680 => 15.5912, std.dev.: 0.0030) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MallocBench/gs/gs: 0.69% (4.6027 => 4.6344, std.dev.: 0.0066) New Passes - Execution Time --------------------------- MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -1.55% (12.0805 => 11.8933, std.dev.: 0.0121) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.21% (0.6254 => 0.6241, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: -0.42% (17.2957 => 17.2225, std.dev.: 0.0186) MultiSource/Benchmarks/Bullet/bullet: -0.48% (56.4233 => 56.1516, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.21% (0.0483 => 0.0482, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.21% (0.0484 => 0.0483, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.22% (0.0453 => 0.0452, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.22% (0.0454 => 0.0453, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0442 => 0.0442, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0443 => 0.0443, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.23% (0.0436 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.46% (0.0438 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0453 => 0.0453, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.22% (0.0456 => 0.0455, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.22% (0.0448 => 0.0447, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0449 => 0.0449, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.23% (0.0438 => 0.0437, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.23% (0.0440 => 0.0439, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.22% (0.0446 => 0.0445, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0446 => 0.0446, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.22% (0.0457 => 0.0456, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.22% (0.0458 => 0.0457, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.23% (0.0433 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.23% (0.0434 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0446 => 0.0446, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.22% (0.0446 => 0.0445, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.23% (0.0437 => 0.0436, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.23% (0.0438 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0429 => 0.0429, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.23% (0.0430 => 0.0429, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.23% (0.0427 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0428 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0464 => 0.0464, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.21% (0.0466 => 0.0465, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0426 => 0.0426, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0427 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0427 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.23% (0.0429 => 0.0428) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0435 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.23% (0.0437 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.11% (1.3025 => 1.4863, std.dev.: 0.0067) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.48% (8.2236 => 8.1845, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/stepanov_container: -11.86% (0.7793 => 0.6869, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: -99.72% (0.0356 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1437 => 0.1437) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.06% (0.2180 => 0.2135, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.21% (63.2438 => 56.1516, std.dev.: 0.0088) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/MallocBench/gs/gs: 12.75% (4.1105 => 4.6344, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.86% (3.4629 => 5.7781, std.dev.: 0.0017) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13497.64% (0.0720 => 9.7903, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050200.00% (0.0001 => 10.0503, std.dev.: 0.0006) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 65.39% (0.2554 => 0.4224, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/lowercase: 56.25% (0.0256 => 0.0400, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 53.50% (10.3673 => 15.9136, std.dev.: 0.0065) SingleSource/UnitTests/SignlessTypes/factor: 46.28% (0.0296 => 0.0433) SingleSource/Regression/C/sumarray2d: 42.44% (0.0271 => 0.0386, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 40.89% (1.5859 => 2.2343, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/distray/distray: 36.74% (0.1056 => 0.1444, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 35.88% (0.1622 => 0.2204, std.dev.: 0.0005) SingleSource/UnitTests/vla: 32.11% (0.0355 => 0.0469, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 29.89% (2.2024 => 2.8606, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/neural/neural: 25.70% (0.1463 => 0.1839, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 25.30% (0.0834 => 0.1045, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.43% (0.1566 => 0.1886, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 20.20% (0.2049 => 0.2463, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 19.48% (0.1432 => 0.1711, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.54% (7.0540 => 8.3616, std.dev.: 0.0257) MultiSource/Applications/viterbi/viterbi: 18.07% (0.1555 => 0.1836, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.03% (0.0871 => 0.1028, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.32% (0.5105 => 0.5989, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.27% (2.2022 => 2.5825, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.00% (0.6675 => 0.7810, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 16.31% (0.1655 => 0.1925, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.28% (1.3050 => 1.5175, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout/lists: 16.13% (0.0626 => 0.0727, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 16.09% (3.3354 => 3.8721, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 15.90% (0.2271 => 0.2632, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 15.87% (0.1695 => 0.1964, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.69% (0.4615 => 0.5339, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/tsp/tsp: 15.66% (0.1175 => 0.1359, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 15.63% (0.1440 => 0.1665, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 15.51% (0.0793 => 0.0916, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.48% (0.1337 => 0.1544, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 15.48% (0.1163 => 0.1343, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.23% (0.8172 => 0.9417, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.12% (0.1032 => 0.1188, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.08% (1.5415 => 1.7740, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.04% (0.5020 => 0.5775, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.03% (0.1510 => 0.1737, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.01% (0.0886 => 0.1019, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.73% (0.0842 => 0.0966, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 14.63% (0.3282 => 0.3762, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 14.55% (0.7115 => 0.8150, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.48% (0.1940 => 0.2221, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.48% (0.0746 => 0.0854, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 14.28% (0.3109 => 0.3553, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 14.17% (0.3423 => 0.3908, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.16% (0.3121 => 0.3563, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.14% (4.2646 => 4.8678, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.09% (0.9765 => 1.1141, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.08% (0.0838 => 0.0956, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 13.96% (10.4361 => 11.8933, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout/matrix: 13.94% (0.0818 => 0.0932, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.91% (1.7609 => 2.0058, std.dev.: 0.0086) SingleSource/Benchmarks/McGill/exptree: 13.88% (0.0814 => 0.0927, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 13.88% (1.1642 => 1.3258, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.88% (0.1117 => 0.1272, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.81% (0.2758 => 0.3139, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.81% (0.2107 => 0.2398, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.78% (0.0798 => 0.0908, std.dev.: 0.0031) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 13.76% (0.1584 => 0.1802, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.75% (0.2065 => 0.2349, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.64% (0.0770 => 0.0875, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 13.62% (9.4845 => 10.7759, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.59% (0.1236 => 0.1404, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.59% (0.1906 => 0.2165, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 13.58% (0.6450 => 0.7326, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 13.48% (0.7835 => 0.8891, std.dev.: 0.0037) MultiSource/Applications/aha/aha: 13.47% (0.1151 => 0.1306, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.46% (0.5860 => 0.6649, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.45% (8.1363 => 9.2308, std.dev.: 0.0070) MultiSource/Applications/oggenc/oggenc: 13.36% (5.7591 => 6.5283, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.28% (0.1438 => 0.1629, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.28% (0.1062 => 0.1203, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.27% (1.4186 => 1.6068, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.22% (0.1029 => 0.1165, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.18% (0.0933 => 0.1056, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 13.07% (2.0273 => 2.2922, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.86% (0.1695 => 0.1913, std.dev.: 0.0005) SingleSource/UnitTests/SignlessTypes/rem: 12.85% (0.1144 => 0.1291) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.75% (0.4879 => 0.5501, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.74% (0.5981 => 0.6743, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.74% (0.1625 => 0.1832, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.70% (0.2700 => 0.3043, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.70% (0.0929 => 0.1047) MultiSource/Applications/lambda-0_1_3/lambda: 12.67% (0.7433 => 0.8375, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 12.63% (1.1840 => 1.3335, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.56% (4.9449 => 5.5660, std.dev.: 0.0042) MultiSource/Applications/lemon/lemon: 12.50% (1.0722 => 1.2062, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.49% (5.0018 => 5.6263, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.48% (0.5569 => 0.6264, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/health/health: 12.46% (0.1268 => 0.1426, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 12.37% (0.4299 => 0.4831, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.37% (0.3307 => 0.3716, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 12.36% (3.8723 => 4.3508, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.31% (0.8067 => 0.9060, std.dev.: 0.0039) MultiSource/Benchmarks/sim/sim: 12.25% (0.3387 => 0.3802, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 12.18% (0.3177 => 0.3564, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.97% (1.1861 => 1.3281, std.dev.: 0.0080) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.91% (7.9617 => 8.9100, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.91% (0.2603 => 0.2913, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.88% (0.1330 => 0.1488, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.85% (0.3543 => 0.3963, std.dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.72% (0.1143 => 0.1277, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 11.67% (0.3180 => 0.3551, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 11.61% (0.8921 => 0.9957, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/trivial-interface: 11.60% (0.3473 => 0.3876, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.52% (0.3543 => 0.3951, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.47% (0.1125 => 0.1254, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 11.44% (0.3497 => 0.3897, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.38% (0.3927 => 0.4374, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 11.34% (0.3694 => 0.4113, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.26% (0.3516 => 0.3912, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.20% (0.3561 => 0.3960, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.19% (0.3441 => 0.3826, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 11.13% (0.3828 => 0.4254, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 11.06% (0.3092 => 0.3434, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.05% (0.1892 => 0.2101, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 10.99% (0.3886 => 0.4313, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 10.85% (1.5603 => 1.7296, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 10.78% (0.6456 => 0.7152, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.64% (0.8101 => 0.8963, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 10.46% (2.2969 => 2.5371, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.37% (0.2266 => 0.2501, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 9.70% (0.4289 => 0.4705, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 9.70% (21.9371 => 24.0640, std.dev.: 0.0209) SingleSource/Benchmarks/Shootout-C++/hash2: 9.63% (0.4620 => 0.5065, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.38% (0.3826 => 0.4185, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.34% (0.3865 => 0.4226, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 9.29% (0.3422 => 0.3740, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.26% (0.4203 => 0.4592, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.80% (0.4103 => 0.4464, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 8.72% (0.4048 => 0.4401, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.71% (0.4636 => 0.5040, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.67% (0.3427 => 0.3724, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 8.50% (0.3684 => 0.3997, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 8.18% (17.1811 => 18.5859, std.dev.: 0.0178) SingleSource/UnitTests/ObjC++/Hello: 8.10% (0.5925 => 0.6405, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.09% (0.6030 => 0.6518, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 7.97% (0.3603 => 0.3890, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.78% (0.2430 => 0.2619, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.73% (14.3668 => 15.4777, std.dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.67% (3.8922 => 4.1909, std.dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference: 7.62% (0.7326 => 0.7884, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.62% (0.3650 => 0.3928, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.53% (0.4064 => 0.4370, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.51% (0.2891 => 0.3108, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 7.43% (0.3232 => 0.3472, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/strcat: 7.38% (0.2831 => 0.3040, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 7.33% (0.3098 => 0.3325, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 7.25% (0.3283 => 0.3521, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.18% (0.3162 => 0.3389, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.09% (0.2905 => 0.3111, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.94% (2.0665 => 2.2100, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.84% (0.2793 => 0.2984, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.79% (0.3136 => 0.3349, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.79% (0.2871 => 0.3066, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.79% (0.2756 => 0.2943, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.75% (0.2872 => 0.3066, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.68% (0.3052 => 0.3256, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.61% (0.2725 => 0.2905, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.60% (0.2877 => 0.3067, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.60% (0.3379 => 0.3602, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.50% (0.2802 => 0.2984, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hello: 6.48% (0.2714 => 0.2890) MultiSource/Applications/hexxagon/hexxagon: 6.02% (1.2842 => 1.3615, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.62% (0.3131 => 0.3307, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.69% (0.3817 => 0.3958, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.82% (0.3935 => 0.4046, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1727, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.28% (0.9957 => 1.1279, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 10.05% (1.1396 => 1.2541, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3685, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 5.93% (1.9405 => 2.0555, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.65% (0.3463 => 0.3624, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.61% (0.3987 => 0.4091, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.49% (4.2280 => 4.3333, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.03% (3.6395 => 3.7133, std.dev.: 0.0045) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2076, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.52% (2.6546 => 2.6949, std.dev.: 0.0018) MultiSource/Applications/viterbi/viterbi: 1.26% (4.4649 => 4.5213, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.16% (9.1159 => 9.2215, std.dev.: 0.0314) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.00% (6.6874 => 0.1335, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -79.61% (0.8651 => 0.1764, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.89% (5.2763 => 3.2246, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.23% (5.3855 => 3.7034, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.75% (5.3526 => 3.7069, std.dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -14.58% (54.1659 => 46.2698, std.dev.: 0.0156) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.63% (2.9384 => 2.6260, std.dev.: 0.0032) MultiSource/Applications/ClamAV/clamscan: -6.64% (22.1758 => 20.7038, std.dev.: 0.0204) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.09% (8.0499 => 3.7762, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.46% (1.1492 => 0.7647, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.66% (2.9695 => 2.4749, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -16.00% (1.6925 => 1.4217, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.68% (1.2258 => 1.0704, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.83% (1.2373 => 1.0909, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel-2: -10.99% (1.5373 => 1.3683, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.19% (19.9488 => 18.3153, std.dev.: 0.0122) MultiSource/Benchmarks/FreeBench/mason/mason: -7.73% (0.2161 => 0.1994, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.98% (1.8329 => 1.7050, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.19% (1.6805 => 1.5933, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5081, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.23% (8.1563 => 7.8113, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Applications/siod/siod: -3.67% (3.2827 => 3.1623, std.dev.: 0.0103) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8776) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5020, std.dev.: 0.0058) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.91% (0.4808 => 0.4668, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: -2.28% (4.6441 => 4.5384, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.74% (10.2830 => 10.1044, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6822, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5094, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4212, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -1.12% (6.2999 => 6.2293, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2878, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 19.35% (0.5229 => 0.6241, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 14.90% (14.9895 => 17.2225, std.dev.: 0.0186) MultiSource/Applications/kimwitu++/kc: 10.14% (14.1553 => 15.5912, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 34.53% (1.1048 => 1.4863, std.dev.: 0.0067) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.34% (7.1582 => 8.1845, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.40% (0.6222 => 0.6869, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.23% (0.1485 => 0.1437) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.90% (0.2116 => 0.2135, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 21 16:03:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 21 Oct 2012 18:03:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121021230348.B07DC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5080?compare_to=5077&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5080, Order: 166401, Start Time: 2012-10-21 21:40:54, End Time: 2012-10-21 23:06:50 To: 5077, Order: 166398, Start Time: 2012-10-21 19:45:24, End Time: 2012-10-21 21:11:25 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (205 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1040 (660 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.24% (79.6408 => 80.6322, std.dev.: 0.2483) MultiSource/Benchmarks/llubenchmark/llu: 1.11% (3.7758 => 3.8176, std.dev.: 0.0098) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.13% (2.0176 => 2.5044, std.dev.: 0.0139) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.28% (0.1410 => 0.1710, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: 19.01% (0.0826 => 0.0983, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 18.37% (0.2243 => 0.2655, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 17.47% (0.1013 => 0.1190, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.16% (0.0746 => 0.0874, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.00% (0.0653 => 0.0764, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.58% (0.7710 => 0.8988, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 15.25% (0.2721 => 0.3136, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.80% (0.0811 => 0.0931, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.79% (0.2596 => 0.2980, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.75% (0.0834 => 0.0957, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.64% (0.0847 => 0.0971, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.58% (0.1413 => 0.1619, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.41% (0.0819 => 0.0937, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.39% (0.1327 => 0.1518, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.21% (0.0725 => 0.0828, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.19% (0.9199 => 1.0504, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.17% (0.0720 => 0.0822, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 14.16% (0.1003 => 0.1145, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 14.09% (1.3693 => 1.5623, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.90% (0.1986 => 0.2262, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.81% (0.1072 => 0.1220, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.80% (0.0964 => 0.1097, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.79% (0.1276 => 0.1452, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.77% (0.5637 => 0.6413, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.75% (3.9660 => 4.5115, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.67% (0.1075 => 0.1222, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 13.64% (0.7038 => 0.7998, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.64% (0.5265 => 0.5983, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.58% (0.6959 => 0.7904, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.48% (0.1588 => 0.1802, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 13.47% (0.1062 => 0.1205, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 13.41% (0.1111 => 0.1260, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 13.24% (0.7460 => 0.8448, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.14% (0.2914 => 0.3297, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.90% (0.0977 => 0.1103, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 12.87% (1.1061 => 1.2484, std.dev.: 0.0015) MultiSource/Applications/viterbi/viterbi: 12.86% (0.1478 => 0.1668, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash2: 12.66% (0.4328 => 0.4876, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.62% (0.1014 => 0.1142, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 12.59% (0.0818 => 0.0921, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.50% (0.5577 => 0.6274, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.40% (1.2193 => 1.3705, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.39% (1.1364 => 1.2772, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.39% (1.4563 => 1.6367, std.dev.: 0.0104) MultiSource/Applications/SPASS/SPASS: 12.34% (13.8202 => 15.5257, std.dev.: 0.0153) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.33% (0.1865 => 0.2095, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.26% (0.3246 => 0.3644, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.22% (0.6283 => 0.7051, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.22% (0.4379 => 0.4914, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.16% (0.2023 => 0.2269, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 12.02% (0.7506 => 0.8408, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 12.00% (0.2925 => 0.3276, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.93% (0.1157 => 0.1295, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.85% (0.2127 => 0.2379, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 11.83% (0.1657 => 0.1853, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 11.79% (0.4062 => 0.4541, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 11.79% (3.8646 => 4.3201, std.dev.: 0.0023) MultiSource/Applications/sgefa/sgefa: 11.65% (0.2995 => 0.3344, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.63% (0.3130 => 0.3494, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.58% (0.4791 => 0.5346, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.52% (0.3899 => 0.4348, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.45% (0.1048 => 0.1168, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 11.43% (0.3220 => 0.3588, std.dev.: 0.0040) MultiSource/Applications/lemon/lemon: 11.24% (1.0313 => 1.1472, std.dev.: 0.0059) MultiSource/Applications/treecc/treecc: 11.19% (1.9270 => 2.1426, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 11.10% (0.7061 => 0.7845, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 11.08% (0.1589 => 0.1765, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.05% (0.3022 => 0.3356, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 11.03% (0.5818 => 0.6460, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.01% (0.1789 => 0.1986, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.94% (0.3756 => 0.4167, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.89% (7.2180 => 8.0044, std.dev.: 0.0109) MultiSource/Benchmarks/Olden/health/health: 10.88% (0.1213 => 0.1345, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 10.79% (0.6744 => 0.7472, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.79% (0.3485 => 0.3861, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.77% (0.1569 => 0.1738, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 10.77% (0.5748 => 0.6367, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.76% (0.4016 => 0.4448, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.73% (0.1435 => 0.1589, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 10.72% (0.2781 => 0.3079, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 10.63% (0.3293 => 0.3643, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 10.63% (0.8310 => 0.9193, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 10.62% (16.6129 => 18.3764, std.dev.: 0.0279) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.62% (0.4390 => 0.4856, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.52% (0.3489 => 0.3856, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 10.49% (3.1889 => 3.5234, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.47% (0.3580 => 0.3955, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 10.45% (0.2726 => 0.3011, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.45% (0.0976 => 0.1078, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.42% (0.2782 => 0.3072, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 10.39% (2.1791 => 2.4056, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 10.37% (0.3868 => 0.4269, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.28% (0.2966 => 0.3271, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.25% (1.3245 => 1.4603, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.24% (0.8698 => 0.9589, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 10.22% (0.3453 => 0.3806, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.19% (0.2140 => 0.2358, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 10.16% (0.3149 => 0.3469, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 10.14% (0.2760 => 0.3040, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.11% (1.9828 => 2.1833, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 10.06% (3.6692 => 4.0384, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ary: 10.04% (0.3107 => 0.3419, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 9.99% (0.3534 => 0.3887, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.95% (4.4433 => 4.8853, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 9.92% (0.2761 => 0.3035, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.92% (4.3801 => 4.8146, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hello: 9.90% (0.2607 => 0.2865, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 9.78% (0.2690 => 0.2953, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 9.77% (0.2937 => 0.3224, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.76% (0.2655 => 0.2914, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 9.71% (0.3192 => 0.3502, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.67% (0.6135 => 0.6728, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/fibo: 9.67% (0.2628 => 0.2882, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.64% (4.9865 => 5.4670, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 9.60% (0.4113 => 0.4508, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.55% (0.2765 => 0.3029, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 9.54% (0.2988 => 0.3273, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.52% (0.2321 => 0.2542, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 9.37% (1.0594 => 1.1587, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.31% (0.2696 => 0.2947, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 9.24% (14.8535 => 16.2258, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.21% (0.3755 => 0.4101, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 9.17% (0.2945 => 0.3215, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.07% (0.8818 => 0.9618, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 9.01% (0.3131 => 0.3413, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 8.98% (1.2749 => 1.3894, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.89% (0.3511 => 0.3823, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.85% (0.1819 => 0.1980, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.84% (0.6576 => 0.7157, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 8.78% (8.4961 => 9.2423, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.73% (1.1333 => 1.2322, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.63% (1.5188 => 1.6499, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 8.42% (0.6250 => 0.6776, std.dev.: 0.0040) MultiSource/Applications/lua/lua: 8.41% (3.7467 => 4.0618, std.dev.: 0.0152) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.39% (0.9108 => 0.9872, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 8.35% (4.6629 => 5.0522, std.dev.: 0.0071) MultiSource/Benchmarks/FreeBench/neural/neural: 8.30% (0.1385 => 0.1500, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.19% (3.2742 => 3.5422, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.11% (0.2243 => 0.2425, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.10% (0.4805 => 0.5194, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 8.05% (6.5754 => 7.1048, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/oourafft: 7.97% (0.2008 => 0.2168, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.95% (0.3245 => 0.3503, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.86% (6.2785 => 6.7717, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.82% (2.1007 => 2.2650, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.71% (0.2504 => 0.2697, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/parameter-passing: 7.62% (0.4003 => 0.4308, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.54% (0.3914 => 0.4209, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 7.49% (1.2292 => 1.3213, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.28% (13.2842 => 14.2515, std.dev.: 0.0205) SingleSource/UnitTests/ObjC/property: 7.23% (0.3940 => 0.4225, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.18% (0.3789 => 0.4061, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 7.15% (0.3578 => 0.3834, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 7.08% (0.3646 => 0.3904, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 7.07% (0.3663 => 0.3922, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 7.03% (0.3601 => 0.3854, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.99% (0.3650 => 0.3905, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-3: 6.90% (0.3623 => 0.3873, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: 6.08% (0.1777 => 0.1885, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 5.39% (16.2614 => 17.1382, std.dev.: 0.0207) MultiSource/Applications/ClamAV/clamscan: 5.12% (14.5298 => 15.2742, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/bh/bh: 4.37% (0.2859 => 0.2984, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 2.71% (33.2944 => 34.1962, std.dev.: 0.0182) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.65% (5.7573 => 7.5218, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fbench: 24.32% (1.8175 => 2.2595, std.dev.: 0.0357) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.14% (1.0895 => 1.2762, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 11.01% (1.1560 => 1.2833, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4144, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) SingleSource/Benchmarks/Misc/mandel-2: 5.58% (1.2998 => 1.3723, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.43% (0.9692 => 1.0218) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.80% (0.3458 => 0.3624, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0044, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.46% (2.8606 => 2.9883, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: 4.46% (0.5449 => 0.5692, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7747, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.46% (1.9199 => 1.9863, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 3.39% (10.7476 => 11.1115, std.dev.: 0.0504) MultiSource/Applications/hexxagon/hexxagon: 3.38% (12.0921 => 12.5005, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.22% (11.2619 => 11.6243, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bisort/bisort: 2.94% (0.8239 => 0.8481, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.39% (1.0310 => 1.0556, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.22% (7.4271 => 7.5920, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 1.78% (1.4298 => 1.4552, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5130, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2126, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.27% (1.9433 => 1.9680, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1885, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 1.20% (5.5130 => 5.5794, std.dev.: 0.0011) MultiSource/Benchmarks/llubenchmark/llu: 1.18% (3.7731 => 3.8176, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.18% (9.9194 => 10.0361, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.14% (8.8259 => 8.9269, std.dev.: 0.0119) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 1.05% (12.4560 => 12.5865, std.dev.: 0.0099) SingleSource/Benchmarks/McGill/queens: 1.00% (2.1753 => 2.1971, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.33% (0.2670 => 0.1433, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.93% (0.4657 => 0.3915, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.60% (1.3813 => 1.2211, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.43% (1.3819 => 1.2240, std.dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.28% (1.0460 => 0.8548, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -13.00% (0.2238 => 0.1947, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.05% (20.3410 => 18.2970, std.dev.: 0.0151) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -5.61% (1.2308 => 1.1618, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.47% (1.3780 => 1.3026, std.dev.: 0.0052) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -5.09% (2.6470 => 2.5123, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.04% (0.9996 => 0.9592, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.88% (1.7688 => 1.7001, std.dev.: 0.0048) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -2.88% (3.2729 => 3.1788, std.dev.: 0.0069) MultiSource/Applications/spiff/spiff: -2.78% (3.0263 => 2.9423, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: -2.73% (1.9762 => 1.9222, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8812, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.27% (4.1080 => 4.0147, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.17% (0.6589 => 0.6446, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.86% (0.6615 => 0.6492, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -1.70% (26.5159 => 26.0663, std.dev.: 0.0250) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.64% (0.8342 => 0.8205, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.61% (2.5254 => 2.4848, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.55% (6.3560 => 6.2576, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0065, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -1.42% (5.3167 => 5.2412, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: -1.24% (28.2225 => 27.8718, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/heapsort: -1.19% (3.9173 => 3.8705, std.dev.: 0.0136) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1139, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -1.06% (84.4286 => 83.5347, std.dev.: 0.0059) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 21 17:47:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 21 Oct 2012 19:47:36 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121022004736.885722A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5081?compare_to=5078&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5081, Order: 166404, Start Time: 2012-10-21 23:25:20, End Time: 2012-10-22 00:49:38 To: 5078, Order: 166401, Start Time: 2012-10-21 21:12:57, End Time: 2012-10-21 22:36:05 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 6 (15 on baseline) Performance Improvements: 1 (3 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 968 (956 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.11% (0.4686 => 0.5019, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.31% (0.5866 => 0.6060, std.dev.: 0.0051) SingleSource/UnitTests/Vector/constpool: 2.23% (8.1906 => 8.3731, std.dev.: 0.0526) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 10.87% (8.1244 => 9.0073, std.dev.: 0.0150) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.05% (0.3192 => 0.3481, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 2.82% (0.6322 => 0.6500, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -2.73% (0.5979 => 0.5816, std.dev.: 0.0055) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.20% (16.4095 => 16.4429, std.dev.: 0.2963) MultiSource/Applications/obsequi/Obsequi: -1.16% (1.0513 => 1.0391, std.dev.: 0.0617) MultiSource/Applications/sqlite3/sqlite3: 1.06% (0.6299 => 0.6366, std.dev.: 0.0089) MultiSource/Benchmarks/McCat/08-main/main: 1.68% (0.1907 => 0.1939, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.94% (0.1647 => 0.1615, std.dev.: 0.0050) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.49% (0.3261 => 0.3245, std.dev.: 0.0096) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.43% (0.2453 => 0.2488, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.45% (0.3344 => 0.3329, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.45% (0.2341 => 0.2375, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 0.52% (0.5922 => 0.5953, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel: -1.26% (0.0476 => 0.0470, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.12% (0.3288 => 0.3292, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/strcat: 1.58% (0.1966 => 0.1997, std.dev.: 0.0018) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 14.60% (0.0226 => 0.0259, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 12.83% (0.0187 => 0.0211, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.96% (0.0416 => 0.0420, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 22.26% (0.0265 => 0.0324, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 15.30% (0.0268 => 0.0309, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0415 => 0.0415, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -1.52% (0.0198 => 0.0195, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 41.35% (0.0133 => 0.0188, std.dev.: 0.0011) SingleSource/UnitTests/byval-alignment: 12.87% (0.0303 => 0.0342, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -66.67% (0.0003 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.37% (0.1465 => 0.1485, std.dev.: 0.0024) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -0.04% (1.1329 => 1.1325, std.dev.: 0.0263) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1436 => 0.1437, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.62% (0.4010 => 0.4035, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.35% (0.1418 => 0.1413, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.16% (0.0571 => 0.0629, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -6.51% (0.0261 => 0.0244, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.90% (0.0572 => 0.0544, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.19% (1.1423 => 1.1445, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.56% (0.0594 => 0.0561, std.dev.: 0.0100) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.38% (0.0186 => 0.0196, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.72% (0.7960 => 0.8017, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0058 => 0.0058, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.20% (2.1832 => 1.6548, std.dev.: 0.0146) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.83% (0.0810 => 0.0922, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.09% (0.2279 => 0.2395, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.67% (0.7473 => 0.7747, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/hash2: 2.50% (0.4125 => 0.4228, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.08% (1.4479 => 1.4780, std.dev.: 0.0099) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 57.82% (1.5795 => 2.4927, std.dev.: 0.0108) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.10% (14.6451 => 16.2708, std.dev.: 0.3647) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.26% (0.3186 => 0.3481, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.09% (1.1857 => 1.2816, std.dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 5.92% (63.1822 => 66.9233, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/hash: 4.75% (0.6205 => 0.6500, std.dev.: 0.0026) MultiSource/Applications/siod/siod: 2.94% (3.6643 => 3.7719, std.dev.: 0.0244) SingleSource/Benchmarks/Dhrystone/dry: 2.05% (0.5081 => 0.5185, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 1.78% (2.3560 => 2.3980, std.dev.: 0.0131) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.44% (1.5941 => 1.6171, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.37% (0.3269 => 0.3028, std.dev.: 0.0021) MultiSource/Applications/lua/lua: -5.00% (29.8330 => 28.3424, std.dev.: 0.3595) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.09% (3.3479 => 3.3115, std.dev.: 0.0027) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.02% (16.4461 => 16.4429, std.dev.: 0.2963) MultiSource/Applications/obsequi/Obsequi: 1.26% (1.0262 => 1.0391, std.dev.: 0.0617) MultiSource/Applications/sqlite3/sqlite3: 0.54% (0.6332 => 0.6366, std.dev.: 0.0089) MultiSource/Benchmarks/McCat/08-main/main: 5.90% (0.1831 => 0.1939, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.59% (0.1559 => 0.1615, std.dev.: 0.0050) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.91% (0.3123 => 0.3245, std.dev.: 0.0096) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.02% (0.2463 => 0.2488, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.45% (0.3344 => 0.3329, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.47% (0.2364 => 0.2375, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: -0.95% (0.6010 => 0.5953, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel: 9.56% (0.0429 => 0.0470, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.80% (0.3266 => 0.3292, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/strcat: 1.42% (0.1969 => 0.1997, std.dev.: 0.0018) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 15.62% (0.0224 => 0.0259, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 71.54% (0.0123 => 0.0211, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.94% (0.0408 => 0.0420, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 27.56% (0.0254 => 0.0324, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.32% (0.0302 => 0.0309, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 8.07% (0.0384 => 0.0415, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 2.63% (0.0190 => 0.0195, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 4.44% (0.0180 => 0.0188, std.dev.: 0.0011) SingleSource/UnitTests/byval-alignment: 48.70% (0.0230 => 0.0342, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 3.27% (0.1438 => 0.1485, std.dev.: 0.0024) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -0.04% (1.1329 => 1.1325, std.dev.: 0.0263) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -1.71% (0.1462 => 0.1437, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.10% (0.4164 => 0.4035, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.21% (0.1369 => 0.1413, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.87% (0.0641 => 0.0629, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 25.13% (0.0195 => 0.0244, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.88% (0.0578 => 0.0544, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.07% (1.1437 => 1.1445, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.53% (0.0627 => 0.0561, std.dev.: 0.0100) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.89% (0.0180 => 0.0196, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: - (0.8017 => 0.8017, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -6.45% (0.0062 => 0.0058, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 1.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 21 17:56:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 21 Oct 2012 19:56:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121022005603.6B0452A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5082?compare_to=5079&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5082, Order: 166404, Start Time: 2012-10-21 23:38:09, End Time: 2012-10-22 00:58:05 To: 5079, Order: 166401, Start Time: 2012-10-21 21:34:19, End Time: 2012-10-21 22:54:36 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (5 on baseline) Performance Regressions: 1 (189 on baseline) Performance Improvements: 2 (45 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 88 (14 on baseline) Unchanged Tests: 951 (653 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.81% (54.9469 => 56.4906, std.dev.: 0.1138) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -6.85% (0.4496 => 0.4188, std.dev.: 0.0119) MultiSource/Applications/JM/ldecod/ldecod: -1.13% (11.8933 => 11.7587, std.dev.: 0.0103) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.24% (0.6241 => 0.6226, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: -0.27% (17.2225 => 17.1754, std.dev.: 0.0071) MultiSource/Applications/kimwitu++/kc: 0.06% (15.5912 => 15.6001, std.dev.: 0.0057) MultiSource/Benchmarks/Bullet/bullet: -0.43% (56.1516 => 55.9095, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.62% (0.0482 => 0.0479, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.62% (0.0483 => 0.0480, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.44% (0.0452 => 0.0450, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.66% (0.0453 => 0.0450, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.90% (0.0442 => 0.0438, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.68% (0.0443 => 0.0440, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.46% (0.0435 => 0.0433, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.46% (0.0436 => 0.0434, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.66% (0.0453 => 0.0450, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.88% (0.0455 => 0.0451, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.45% (0.0447 => 0.0445, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.89% (0.0449 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.46% (0.0437 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.68% (0.0439 => 0.0436, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.67% (0.0445 => 0.0442, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.67% (0.0446 => 0.0443) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.66% (0.0456 => 0.0453, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.66% (0.0457 => 0.0454, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.46% (0.0432 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.46% (0.0433 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.90% (0.0446 => 0.0442, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.45% (0.0445 => 0.0443, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.69% (0.0436 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.69% (0.0437 => 0.0434) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.70% (0.0429 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.70% (0.0429 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.47% (0.0426 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.70% (0.0428 => 0.0425, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.65% (0.0464 => 0.0461, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.65% (0.0465 => 0.0462) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.70% (0.0426 => 0.0423, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.70% (0.0427 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.70% (0.0427 => 0.0424, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.70% (0.0428 => 0.0425) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.69% (0.0435 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.69% (0.0436 => 0.0433) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.24% (1.4863 => 1.4828, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.05% (8.1845 => 8.1890, std.dev.: 0.0137) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.22% (0.6869 => 0.6854, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1437 => 0.1437, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.89% (0.2135 => 0.2154, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.60% (63.2438 => 55.9095, std.dev.: 0.0191) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/MallocBench/gs/gs: 12.42% (4.1105 => 4.6210, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.81% (3.4629 => 5.7764, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13499.03% (0.0720 => 9.7913, std.dev.: 0.0091) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049800.00% (0.0001 => 10.0499, std.dev.: 0.0019) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 64.06% (0.2554 => 0.4190, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 55.86% (0.0256 => 0.0399) MultiSource/Benchmarks/PAQ8p/paq8p: 53.19% (10.3673 => 15.8814, std.dev.: 0.0155) SingleSource/UnitTests/SignlessTypes/factor: 45.27% (0.0296 => 0.0430, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 42.07% (0.0271 => 0.0385) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 40.85% (1.5859 => 2.2338, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: 36.25% (0.1622 => 0.2210, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 35.61% (0.1056 => 0.1432, std.dev.: 0.0000) SingleSource/UnitTests/vla: 31.83% (0.0355 => 0.0468, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 29.80% (2.2024 => 2.8588, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/neural/neural: 25.50% (0.1463 => 0.1836, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 25.30% (0.0834 => 0.1045, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.05% (0.1566 => 0.1880, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 19.86% (0.2049 => 0.2456, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 19.13% (0.1432 => 0.1706, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.04% (7.0540 => 8.3266, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.73% (0.5105 => 0.6010, std.dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.68% (0.0871 => 0.1025, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 17.62% (0.1555 => 0.1829, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.86% (2.2022 => 2.5735, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 16.84% (0.6675 => 0.7799, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 16.25% (0.1655 => 0.1924, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.04% (1.3050 => 1.5143, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 15.91% (0.0798 => 0.0925, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 15.83% (3.3354 => 3.8634, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/power/power: 15.42% (0.1440 => 0.1662, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 15.40% (0.1695 => 0.1956, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 15.37% (0.2271 => 0.2620, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.36% (0.4615 => 0.5324, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 15.15% (0.1175 => 0.1353, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 15.05% (0.1163 => 0.1338, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.95% (1.5415 => 1.7719, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.92% (0.1032 => 0.1186, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.92% (0.5020 => 0.5769, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 14.88% (0.0793 => 0.0911, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.64% (0.1510 => 0.1731, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.58% (0.1337 => 0.1532, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 14.49% (0.7115 => 0.8146, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 14.49% (0.8172 => 0.9356, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.33% (0.0886 => 0.1013, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 14.28% (0.3109 => 0.3553, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 14.23% (0.3282 => 0.3749, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.12% (0.1940 => 0.2214, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.01% (0.0842 => 0.0960, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.90% (4.2646 => 4.8573, std.dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.84% (0.0838 => 0.0954, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.84% (0.9765 => 1.1116, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 13.79% (0.3423 => 0.3895, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/exptree: 13.76% (0.0814 => 0.0926) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.67% (1.7609 => 2.0017, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 13.67% (1.1642 => 1.3234, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.67% (0.1236 => 0.1405, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 13.67% (0.0746 => 0.0848, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.62% (0.3121 => 0.3546, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/matrix: 13.57% (0.0818 => 0.0929, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 13.51% (0.1584 => 0.1798, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.38% (0.2107 => 0.2389, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 13.38% (0.1151 => 0.1305, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 13.24% (0.6450 => 0.7304, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 13.21% (9.4845 => 10.7371, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.16% (0.2758 => 0.3121, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.16% (0.1117 => 0.1264, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.14% (0.5860 => 0.6630, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.10% (0.1695 => 0.1917, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.08% (0.0933 => 0.1055, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 13.02% (2.0273 => 2.2912, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.00% (1.4186 => 1.6030, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 12.99% (0.7835 => 0.8853, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 12.94% (8.1363 => 9.1893, std.dev.: 0.0108) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 12.91% (0.1906 => 0.2152, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 12.83% (0.2065 => 0.2330, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.71% (0.1062 => 0.1197, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 12.67% (10.4361 => 11.7587, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.63% (0.1029 => 0.1159, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 12.62% (0.7433 => 0.8371, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.59% (0.0929 => 0.1046, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.59% (0.1438 => 0.1619, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 12.53% (5.7591 => 6.4808, std.dev.: 0.0040) SingleSource/UnitTests/SignlessTypes/rem: 12.50% (0.1144 => 0.1287, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 12.47% (1.1840 => 1.3316, std.dev.: 0.0056) MultiSource/Applications/lemon/lemon: 12.46% (1.0722 => 1.2058, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.41% (0.2700 => 0.3035, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.31% (0.1625 => 0.1825, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.31% (0.5981 => 0.6717, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.16% (4.9449 => 5.5462, std.dev.: 0.0136) MultiSource/Applications/lua/lua: 12.15% (3.8723 => 4.3429, std.dev.: 0.0099) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.13% (5.0018 => 5.6087, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.09% (0.8067 => 0.9042, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 12.02% (0.3387 => 0.3794, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 11.99% (0.1268 => 0.1420, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 11.98% (0.4299 => 0.4814, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.94% (0.3307 => 0.3702, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.91% (0.4879 => 0.5460, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.79% (0.2603 => 0.2910, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.69% (0.5569 => 0.6220, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.65% (0.1330 => 0.1485, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.63% (1.1861 => 1.3241, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.55% (0.3177 => 0.3544, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 11.46% (0.8921 => 0.9943, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.44% (7.9617 => 8.8728, std.dev.: 0.0038) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.29% (0.1143 => 0.1272, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 11.26% (0.3180 => 0.3538, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.16% (0.3441 => 0.3825, std.dev.: 0.0058) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.1125 => 0.1250, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.84% (0.3543 => 0.3927, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 10.70% (1.5603 => 1.7273, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 10.61% (0.6456 => 0.7141, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 10.58% (0.3092 => 0.3419, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.29% (0.3927 => 0.4331, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 10.25% (2.2969 => 2.5324, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-2: 10.18% (0.3497 => 0.3853, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.14% (0.3473 => 0.3825, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.10% (0.3543 => 0.3901, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.10% (0.8101 => 0.8919, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/synchronized: 10.08% (0.3561 => 0.3920, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions: 10.01% (0.3828 => 0.4211, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.99% (0.3694 => 0.4063, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.98% (0.3516 => 0.3867, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.97% (0.2266 => 0.2492, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 9.91% (0.3886 => 0.4271, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.51% (0.1892 => 0.2072, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 9.51% (0.4289 => 0.4697, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: 9.42% (0.4620 => 0.5055, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.18% (0.3865 => 0.4220, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.15% (0.4636 => 0.5060, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.02% (0.3826 => 0.4171, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 8.97% (0.3422 => 0.3729, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 8.87% (21.9371 => 23.8837, std.dev.: 0.0257) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.78% (0.4203 => 0.4572, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.51% (0.4103 => 0.4452, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 8.47% (0.3684 => 0.3996, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 8.40% (0.4048 => 0.4388, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.29% (0.3427 => 0.3711, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 8.14% (17.1811 => 18.5795, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/sieve: 7.66% (0.3603 => 0.3879, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.62% (14.3668 => 15.4618, std.dev.: 0.0180) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.61% (0.2430 => 0.2615, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.58% (0.5925 => 0.6374, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.55% (0.6030 => 0.6485, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.37% (3.8922 => 4.1792, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.33% (0.4064 => 0.4362, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.18% (0.3650 => 0.3912, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 7.02% (0.2905 => 0.3109, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 6.99% (0.7326 => 0.7838, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/matrix: 6.97% (0.3098 => 0.3314, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.92% (0.2891 => 0.3091, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 6.71% (0.2831 => 0.3021, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.70% (0.3162 => 0.3374, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 6.65% (0.3232 => 0.3447, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.64% (0.3283 => 0.3501, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.62% (0.2793 => 0.2978, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.57% (0.2725 => 0.2904, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.53% (0.2756 => 0.2936, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.51% (0.3136 => 0.3340, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.47% (2.0665 => 2.2001, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 6.45% (0.3052 => 0.3249, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.44% (0.2872 => 0.3057, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.41% (0.2871 => 0.3055) SingleSource/Benchmarks/Shootout-C++/ary2: 6.33% (0.3379 => 0.3593, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 6.28% (0.2802 => 0.2978, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.26% (0.2877 => 0.3057, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.19% (0.2714 => 0.2882, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 5.75% (1.2842 => 1.3581, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (0.3131 => 0.3293, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.79% (1.1194 => 1.1506, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.69% (0.3935 => 0.4041, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8961, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1726, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.28% (0.9957 => 1.1279, std.dev.: 0.0107) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.86% (1.1396 => 1.2520, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 6.64% (3.1578 => 3.3676, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 5.90% (1.9405 => 2.0549, std.dev.: 0.0091) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.61% (0.3987 => 0.4091, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.58% (4.2280 => 4.3372, std.dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bisort/bisort: 1.97% (0.8333 => 0.8497, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.87% (3.6395 => 3.7076, std.dev.: 0.0016) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2079, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.39% (2.6546 => 2.6914, std.dev.: 0.0015) MultiSource/Applications/viterbi/viterbi: 1.27% (4.4649 => 4.5214, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.01% (6.5088 => 6.5745, std.dev.: 0.0057) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.02% (6.6874 => 0.1327, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -79.90% (0.8651 => 0.1739, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.14% (5.2763 => 3.2114, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.47% (5.3855 => 3.6908, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.94% (5.3526 => 3.6964, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -14.66% (54.1659 => 46.2239, std.dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.88% (2.9384 => 2.6188, std.dev.: 0.0248) MultiSource/Applications/ClamAV/clamscan: -6.72% (22.1758 => 20.6859, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.09% (8.0499 => 3.7759, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7645, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.64% (2.9695 => 2.4755, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.80% (1.6925 => 1.4251, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.53% (0.0998 => 0.0853, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.68% (1.2258 => 1.0704, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.54% (1.2373 => 1.0945, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -10.82% (1.5373 => 1.3710, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.41% (19.9488 => 18.2721, std.dev.: 0.0117) MultiSource/Benchmarks/FreeBench/mason/mason: -7.77% (0.2161 => 0.1993, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.07% (1.8329 => 1.7033, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4781, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.14% (1.6805 => 1.5941, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-5: -4.68% (1.5835 => 1.5094, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.17% (8.1563 => 7.8160, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.64% (3.2827 => 3.1631, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8776, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5045, std.dev.: 0.0049) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.52% (0.4808 => 0.4687, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -2.31% (4.6441 => 4.5369, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.79% (10.2830 => 10.0994, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6829, std.dev.: 0.0014) SingleSource/UnitTests/Vector/multiplies: -1.65% (2.5528 => 2.5108, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4208, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.14% (6.2999 => 6.2278, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2878, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 19.07% (0.5229 => 0.6226, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 14.58% (14.9895 => 17.1754, std.dev.: 0.0071) MultiSource/Applications/kimwitu++/kc: 10.21% (14.1553 => 15.6001, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 34.21% (1.1048 => 1.4828, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.40% (7.1582 => 8.1890, std.dev.: 0.0137) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.16% (0.6222 => 0.6854, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.23% (0.1485 => 0.1437, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.80% (0.2116 => 0.2154, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 21 18:02:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 21 Oct 2012 20:02:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121022010207.44E932A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5083?compare_to=5080&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5083, Order: 166404, Start Time: 2012-10-21 23:39:15, End Time: 2012-10-22 01:05:09 To: 5080, Order: 166401, Start Time: 2012-10-21 21:40:54, End Time: 2012-10-21 23:06:50 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (200 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1042 (665 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.63% (2.0176 => 2.4944, std.dev.: 0.0052) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.85% (0.1410 => 0.1704) SingleSource/Benchmarks/Misc/flops: 18.28% (0.0826 => 0.0977, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 18.19% (0.2243 => 0.2651, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/tsp/tsp: 17.37% (0.1013 => 0.1189, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.49% (0.0746 => 0.0869, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.39% (0.7710 => 0.8974, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.23% (0.0653 => 0.0759, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.64% (0.2596 => 0.3002, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 14.63% (0.2721 => 0.3119, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.27% (0.0834 => 0.0953, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.23% (0.1413 => 0.1614, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.18% (0.0811 => 0.0926, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.05% (0.0847 => 0.0966, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 13.99% (1.3693 => 1.5609, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/power/power: 13.96% (0.1003 => 0.1143, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.93% (0.0725 => 0.0826, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.91% (0.9199 => 1.0479, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.72% (0.1327 => 0.1509, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.65% (0.1986 => 0.2257, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.64% (0.5637 => 0.6406, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.45% (3.9660 => 4.4996, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.35% (0.1588 => 0.1800, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 13.34% (0.7038 => 0.7977, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.34% (0.6959 => 0.7887, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.30% (0.1075 => 0.1218, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.28% (0.0964 => 0.1092, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.24% (0.5265 => 0.5962, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/mst/mst: 13.23% (0.1111 => 0.1258, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 13.09% (0.1062 => 0.1201, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.88% (0.7460 => 0.8421, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.85% (0.1276 => 0.1440, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.73% (0.2914 => 0.3285, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.69% (0.0977 => 0.1101, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 12.58% (0.4062 => 0.4573, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash2: 12.55% (0.4328 => 0.4871, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 12.50% (1.1061 => 1.2444, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 12.45% (0.1478 => 0.1662, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 12.35% (0.0818 => 0.0919, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.33% (0.1014 => 0.1139) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.31% (0.1072 => 0.1204, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.26% (1.4563 => 1.6349, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.23% (0.5577 => 0.6259, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.19% (1.2193 => 1.3679, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.05% (1.1364 => 1.2733, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 11.98% (13.8202 => 15.4764, std.dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.97% (0.6283 => 0.7035, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.96% (0.2023 => 0.2265, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.90% (0.1865 => 0.2087, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.83% (0.4379 => 0.4897, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.74% (0.3246 => 0.3627, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 11.64% (0.7506 => 0.8380, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 11.59% (0.1657 => 0.1849, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.58% (0.1157 => 0.1291, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.57% (0.2127 => 0.2373, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 11.41% (3.8646 => 4.3055, std.dev.: 0.0161) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.39% (0.3899 => 0.4343, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 11.35% (0.2925 => 0.3257, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 11.22% (0.7061 => 0.7853, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 11.19% (0.2995 => 0.3330, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.17% (0.4791 => 0.5326, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.16% (0.1048 => 0.1165, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.05% (0.3130 => 0.3476, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 11.05% (1.0313 => 1.1453, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/18-imp/imp: 10.96% (0.3220 => 0.3573, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.96% (0.3485 => 0.3867, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 10.95% (0.5818 => 0.6455, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.94% (0.3756 => 0.4167, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.80% (0.4390 => 0.4864, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 10.76% (1.9270 => 2.1344, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.73% (0.1789 => 0.1981, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 10.70% (0.1589 => 0.1759, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.68% (0.4016 => 0.4445, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 10.68% (0.5748 => 0.6362, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 10.66% (0.3293 => 0.3644, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.65% (7.2180 => 7.9869, std.dev.: 0.0017) SingleSource/Regression/C++/ofstream_ctor: 10.64% (0.2781 => 0.3077, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.62% (0.3022 => 0.3343, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.58% (0.1569 => 0.1735, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 10.57% (0.3868 => 0.4277, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 10.51% (0.6744 => 0.7453, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 10.47% (0.1213 => 0.1340, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 10.41% (0.2690 => 0.2970, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.35% (0.3489 => 0.3850, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.34% (0.3580 => 0.3950, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.32% (0.2782 => 0.3069, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.31% (0.1435 => 0.1583, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 10.28% (16.6129 => 18.3199, std.dev.: 0.0207) SingleSource/Benchmarks/Shootout-C++/sieve: 10.22% (0.3453 => 0.3806, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 10.21% (0.2761 => 0.3043, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 10.20% (0.2726 => 0.3004, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 10.13% (0.8310 => 0.9152) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.09% (0.8698 => 0.9576, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 10.08% (3.1889 => 3.5104, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.08% (1.9828 => 2.1827, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/except: 10.07% (0.2760 => 0.3038, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 10.05% (0.2607 => 0.2869, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.00% (1.3245 => 1.4570, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 9.96% (2.1791 => 2.3962, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.94% (0.2655 => 0.2919, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 9.93% (0.3534 => 0.3885, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.91% (0.2966 => 0.3260, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 9.88% (0.3149 => 0.3460, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 9.87% (0.2937 => 0.3227, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 9.85% (0.3107 => 0.3413, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 9.82% (0.2628 => 0.2886, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.80% (0.2765 => 0.3036, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 9.77% (0.3192 => 0.3504, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.72% (3.6692 => 4.0259, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.69% (4.4433 => 4.8739, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.57% (0.2696 => 0.2954, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.55% (4.3801 => 4.7986, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.49% (0.2140 => 0.2343, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 9.40% (0.2988 => 0.3269, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.39% (0.2321 => 0.2539, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.35% (4.9865 => 5.4527, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 9.29% (0.4113 => 0.4495, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/objinst: 9.24% (0.2945 => 0.3217, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.14% (0.6135 => 0.6696, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.13% (0.3755 => 0.4098, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 9.12% (1.0594 => 1.1560, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 8.83% (14.8535 => 16.1649, std.dev.: 0.0055) MultiSource/Benchmarks/sim/sim: 8.78% (0.3131 => 0.3406, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 8.71% (1.2749 => 1.3859, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.63% (0.8818 => 0.9579, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.61% (0.6576 => 0.7142, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 8.58% (8.4961 => 9.2249, std.dev.: 0.0097) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.54% (0.3511 => 0.3811, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.41% (1.5188 => 1.6465, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.30% (1.1333 => 1.2274, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 8.18% (0.6250 => 0.6761, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 8.15% (3.7467 => 4.0522, std.dev.: 0.0132) MultiSource/Benchmarks/FreeBench/neural/neural: 8.09% (0.1385 => 0.1497, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.08% (0.9108 => 0.9844, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.95% (0.3245 => 0.3503, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.83% (3.2742 => 3.5305, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.70% (0.4805 => 0.5175, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 7.70% (6.5754 => 7.0817, std.dev.: 0.0201) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.63% (6.2785 => 6.7577, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.59% (2.1007 => 2.2601, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 7.57% (0.2008 => 0.2160, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.53% (0.1819 => 0.1956, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.51% (0.2504 => 0.2692, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 7.48% (4.6629 => 5.0117, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 7.37% (1.2292 => 1.3198, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.18% (0.2243 => 0.2404, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: 7.17% (0.4003 => 0.4290, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 7.08% (0.3914 => 0.4191, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.05% (13.2842 => 14.2204, std.dev.: 0.0166) SingleSource/UnitTests/ObjC/property: 6.98% (0.3940 => 0.4215, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.97% (0.3789 => 0.4053, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 6.85% (0.3578 => 0.3823, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.80% (0.3601 => 0.3846, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/exceptions-4: 6.80% (0.3646 => 0.3894, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.80% (0.3663 => 0.3912, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.66% (0.3650 => 0.3893, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 6.65% (0.3623 => 0.3864, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 5.68% (0.1777 => 0.1878, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 5.33% (16.2614 => 17.1283, std.dev.: 0.0036) MultiSource/Applications/ClamAV/clamscan: 4.85% (14.5298 => 15.2347, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/bh/bh: 3.78% (0.2859 => 0.2967, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 2.24% (33.2944 => 34.0388, std.dev.: 0.0115) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.87% (0.4846 => 0.6972, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.61% (5.7573 => 7.5198, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fbench: 23.98% (1.8175 => 2.2534, std.dev.: 0.0469) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.04% (1.0895 => 1.2751, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 11.05% (1.1560 => 1.2837, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4138, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.42% (0.9692 => 1.0217, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: 5.32% (1.2998 => 1.3690, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.68% (1.9144 => 2.0040, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: 4.48% (0.5449 => 0.5693, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.46% (2.8606 => 2.9882, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.51% (10.7476 => 11.1251, std.dev.: 0.0471) SingleSource/Benchmarks/Misc/flops-6: 3.45% (1.9199 => 1.9861, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.37% (12.0921 => 12.4998, std.dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 3.22% (11.2619 => 11.6250, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bisort/bisort: 3.00% (0.8239 => 0.8486, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.41% (1.0310 => 1.0558, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.10% (7.4271 => 7.5833, std.dev.: 0.0067) MultiSource/Applications/lemon/lemon: 1.84% (1.4298 => 1.4561, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5142, std.dev.: 0.0101) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.42% (1.9433 => 1.9708, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1868, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5787, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.16% (9.9194 => 10.0346, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 1.13% (12.4560 => 12.5962, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/em3d/em3d: 1.10% (3.1071 => 3.1412, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 1.01% (2.1753 => 2.1973, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.44% (0.2670 => 0.1430, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.19% (0.4657 => 0.3903, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.03% (1.3813 => 1.2151, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.02% (1.3819 => 1.2158, std.dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.28% (1.0460 => 0.8548) MultiSource/Benchmarks/FreeBench/mason/mason: -13.00% (0.2238 => 0.1947, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.07% (20.3410 => 18.2928, std.dev.: 0.0161) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8097, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -5.65% (1.2308 => 1.1612, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -5.09% (2.6470 => 2.5122, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.64% (1.3780 => 1.3140, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.50% (0.9996 => 0.9546, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.86% (1.7688 => 1.7005, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.08% (0.4867 => 0.4717, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -2.88% (3.2729 => 3.1786, std.dev.: 0.0029) MultiSource/Applications/spiff/spiff: -2.85% (3.0263 => 2.9401, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: -2.73% (1.9762 => 1.9223, std.dev.: 0.0031) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8812, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4785, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.36% (4.1080 => 4.0112, std.dev.: 0.0017) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.02% (0.6589 => 0.6456, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.87% (0.6615 => 0.6491, std.dev.: 0.0016) MultiSource/Applications/lua/lua: -1.79% (26.5159 => 26.0415, std.dev.: 0.0387) SingleSource/Benchmarks/Shootout/lists: -1.75% (6.3560 => 6.2445, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.68% (0.8342 => 0.8202, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.67% (2.5254 => 2.4831, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0074, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/heapsort: -1.36% (3.9173 => 3.8640, std.dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: -1.24% (28.2225 => 27.8715, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: -1.19% (5.3167 => 5.2534, std.dev.: 0.0007) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1138, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -1.05% (84.4286 => 83.5440, std.dev.: 0.0049) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 21 19:48:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 21 Oct 2012 21:48:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121022024826.D23162A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5084?compare_to=5082&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5084, Order: 166406, Start Time: 2012-10-22 01:30:32, End Time: 2012-10-22 02:50:28 To: 5082, Order: 166404, Start Time: 2012-10-21 23:38:09, End Time: 2012-10-22 00:58:05 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (5 on baseline) Performance Regressions: 0 (188 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 88 (14 on baseline) Unchanged Tests: 954 (654 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.16% (0.6226 => 0.6236, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 0.00% (17.1754 => 17.1757, std.dev.: 0.0175) MultiSource/Applications/kimwitu++/kc: -0.07% (15.6001 => 15.5888, std.dev.: 0.0074) MultiSource/Benchmarks/Bullet/bullet: 0.01% (55.9095 => 55.9164, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0479 => 0.0479, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0480 => 0.0480, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.22% (0.0450 => 0.0449, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0450 => 0.0450, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.23% (0.0438 => 0.0439) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0440 => 0.0440, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0433 => 0.0433) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0434 => 0.0434, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0450 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0451 => 0.0451, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.22% (0.0445 => 0.0446, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.22% (0.0445 => 0.0446, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0435 => 0.0435, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0436 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0442 => 0.0442, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0443 => 0.0443, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0453 => 0.0453, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.22% (0.0454 => 0.0455, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0430 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0431 => 0.0431, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.23% (0.0442 => 0.0443) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0443 => 0.0443, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.23% (0.0433 => 0.0434) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0434 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.23% (0.0426 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.23% (0.0426 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0424 => 0.0424) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.24% (0.0425 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0461 => 0.0461) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0462 => 0.0462, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0423 => 0.0423) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.24% (0.0424 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.24% (0.0424 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0425 => 0.0425, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0432 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0433 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.06% (1.4828 => 1.4819, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.09% (8.1890 => 8.1817, std.dev.: 0.0190) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.01% (0.6854 => 0.6855, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1437 => 0.1436, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.97% (0.2154 => 0.2133, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.59% (63.2438 => 55.9164, std.dev.: 0.0043) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/MallocBench/gs/gs: 12.39% (4.1105 => 4.6199, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.61% (3.4629 => 5.7697, std.dev.: 0.0012) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13494.17% (0.0720 => 9.7878, std.dev.: 0.0157) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049800.00% (0.0001 => 10.0499, std.dev.: 0.0013) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 64.06% (0.2554 => 0.4190, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: 55.86% (0.0256 => 0.0399) MultiSource/Benchmarks/PAQ8p/paq8p: 53.12% (10.3673 => 15.8739, std.dev.: 0.0075) SingleSource/UnitTests/SignlessTypes/factor: 45.61% (0.0296 => 0.0431, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 42.07% (0.0271 => 0.0385, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 40.73% (1.5859 => 2.2318, std.dev.: 0.0142) SingleSource/Benchmarks/Misc/richards_benchmark: 36.25% (0.1622 => 0.2210, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/distray/distray: 35.61% (0.1056 => 0.1432, std.dev.: 0.0001) SingleSource/UnitTests/vla: 31.83% (0.0355 => 0.0468) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 29.76% (2.2024 => 2.8578, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/neural/neural: 25.50% (0.1463 => 0.1836, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 22.54% (0.0834 => 0.1022, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 19.99% (0.1566 => 0.1879, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 19.77% (0.2049 => 0.2454, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 19.20% (0.1432 => 0.1707, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.06% (7.0540 => 8.3282, std.dev.: 0.0141) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.80% (0.0871 => 0.1026, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 17.62% (0.1555 => 0.1829, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.16% (0.5105 => 0.5981, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.82% (2.2022 => 2.5727, std.dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 16.81% (0.6675 => 0.7797, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 16.07% (0.1655 => 0.1921, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.88% (1.3050 => 1.5122, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 15.79% (3.3354 => 3.8622, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 15.42% (0.1440 => 0.1662, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.34% (0.4615 => 0.5323, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/em3d/em3d: 15.34% (0.1695 => 0.1955, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 15.28% (0.2271 => 0.2618, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.98% (0.5020 => 0.5772, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 14.98% (0.1175 => 0.1351, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 14.96% (0.1163 => 0.1337, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.92% (0.1032 => 0.1186, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.82% (1.5415 => 1.7700, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.77% (0.1510 => 0.1733, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 14.75% (0.0793 => 0.0910, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.73% (0.1337 => 0.1534, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 14.61% (0.8172 => 0.9366, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 14.49% (0.7115 => 0.8146, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.33% (0.0886 => 0.1013, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 14.26% (0.3282 => 0.3750, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.25% (0.0842 => 0.0962, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.23% (0.1940 => 0.2216, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 14.12% (0.3109 => 0.3548, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 13.94% (0.0746 => 0.0850, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 13.88% (0.3423 => 0.3898, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.80% (0.9765 => 1.1113, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 13.80% (1.1642 => 1.3249, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.79% (4.2646 => 4.8528, std.dev.: 0.0049) SingleSource/Benchmarks/McGill/exptree: 13.76% (0.0814 => 0.0926, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.72% (0.0838 => 0.0953, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.68% (0.3121 => 0.3548, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.65% (1.7609 => 2.0012, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.59% (0.1236 => 0.1404, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 13.57% (0.1584 => 0.1799, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 13.57% (0.0818 => 0.0929, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.34% (0.2107 => 0.2388, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 13.32% (0.6450 => 0.7309, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.25% (0.0770 => 0.0872, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 13.21% (0.1151 => 0.1303, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 13.20% (9.4845 => 10.7364, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.20% (0.2758 => 0.3122, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.09% (0.5860 => 0.6627, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.07% (0.1117 => 0.1263, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.00% (8.1363 => 9.1937, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.97% (0.0933 => 0.1054, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 12.96% (0.1906 => 0.2153, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 12.93% (0.7835 => 0.8848, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 12.91% (1.4186 => 1.6017, std.dev.: 0.0057) MultiSource/Applications/treecc/treecc: 12.86% (2.0273 => 2.2881, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 12.83% (0.2065 => 0.2330, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.81% (0.1062 => 0.1198, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.74% (0.1695 => 0.1911, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.70% (0.0929 => 0.1047) MultiSource/Applications/JM/ldecod/ldecod: 12.64% (10.4361 => 11.7549, std.dev.: 0.0178) SingleSource/UnitTests/SignlessTypes/rem: 12.59% (0.1144 => 0.1288, std.dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 12.57% (5.7591 => 6.4828, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 12.55% (1.1840 => 1.3326, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.54% (0.1029 => 0.1158, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.53% (0.0798 => 0.0898, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.52% (0.1438 => 0.1618, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 12.49% (1.0722 => 1.2061, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 12.46% (0.7433 => 0.8359, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.41% (0.2700 => 0.3035, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.37% (0.1625 => 0.1826, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.34% (0.5981 => 0.6719, std.dev.: 0.0017) MultiSource/Applications/lua/lua: 12.13% (3.8723 => 4.3420, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.13% (4.9449 => 5.5447, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.10% (5.0018 => 5.6068, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/health/health: 11.99% (0.1268 => 0.1420, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 11.96% (0.3387 => 0.3792, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.89% (0.8067 => 0.9026, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.89% (0.4879 => 0.5459, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 11.89% (0.4299 => 0.4810, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.88% (0.3307 => 0.3700, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.87% (0.2603 => 0.2912, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.69% (1.1861 => 1.3247, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.65% (0.1330 => 0.1485, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.58% (0.5569 => 0.6214, std.dev.: 0.0039) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.55% (0.1143 => 0.1275, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 11.52% (0.8921 => 0.9949, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.52% (0.3177 => 0.3543, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.40% (7.9617 => 8.8691, std.dev.: 0.0122) MultiSource/Benchmarks/McCat/09-vor/vor: 11.26% (0.3180 => 0.3538, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.10% (0.3441 => 0.3823, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.02% (0.1125 => 0.1249, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.64% (0.3543 => 0.3920, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 10.61% (1.5603 => 1.7259, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/bh/bh: 10.58% (0.3092 => 0.3419, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 10.47% (0.6456 => 0.7132, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 10.26% (2.2969 => 2.5326, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/synchronized: 10.22% (0.3561 => 0.3925, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.21% (0.3694 => 0.4071, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/trivial-interface: 10.19% (0.3473 => 0.3827, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 10.19% (0.3543 => 0.3904, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.19% (0.3927 => 0.4327, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.18% (0.3516 => 0.3874, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.12% (0.8101 => 0.8921, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 10.07% (0.3497 => 0.3849, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.02% (0.2266 => 0.2493, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 10.01% (0.3828 => 0.4211, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.93% (0.3886 => 0.4272, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash: 9.49% (0.4289 => 0.4696, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.41% (0.1892 => 0.2070, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 9.35% (0.4620 => 0.5052, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.21% (0.3865 => 0.4221, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.12% (0.3826 => 0.4175, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.06% (0.4636 => 0.5056, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 8.97% (0.3422 => 0.3729, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 8.87% (21.9371 => 23.8837, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.68% (0.4203 => 0.4568, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.58% (0.4103 => 0.4455, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 8.35% (0.4048 => 0.4386, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.26% (0.3427 => 0.3710, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 8.25% (0.3684 => 0.3988, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 8.10% (17.1811 => 18.5735, std.dev.: 0.0207) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.66% (14.3668 => 15.4678, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/sieve: 7.63% (0.3603 => 0.3878, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.60% (0.6030 => 0.6488, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.57% (0.2430 => 0.2614, std.dev.: 0.0036) SingleSource/UnitTests/ObjC++/Hello: 7.49% (0.5925 => 0.6369, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.36% (3.8922 => 4.1788, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.26% (0.3650 => 0.3915, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.21% (0.4064 => 0.4357, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 7.06% (0.7326 => 0.7843, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/matrix: 6.91% (0.3098 => 0.3312, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.81% (0.2891 => 0.3088, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.75% (0.2831 => 0.3022, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.71% (0.2905 => 0.3100, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.61% (0.3283 => 0.3500, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.59% (0.3232 => 0.3445, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.58% (0.3162 => 0.3370, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.55% (0.2793 => 0.2976, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.53% (0.2725 => 0.2903, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.48% (0.2872 => 0.3058, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.47% (2.0665 => 2.2001, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.46% (0.2756 => 0.2934, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.41% (0.3136 => 0.3337, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 6.30% (0.2871 => 0.3052, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.19% (0.2714 => 0.2882, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.19% (0.3379 => 0.3588, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.15% (0.2877 => 0.3054, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.14% (0.2802 => 0.2974, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 5.76% (1.2842 => 1.3582, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.08% (0.3131 => 0.3290, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.73% (1.1194 => 1.1500, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.54% (0.3935 => 0.4035, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1725, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.69% (0.9957 => 1.1320, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.86% (1.1396 => 1.2520, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3684, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 5.96% (1.9405 => 2.0561, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.68% (4.2280 => 4.3414, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.61% (0.3987 => 0.4091, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.12% (3.6395 => 3.7168, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bisort/bisort: 2.04% (0.8333 => 0.8503, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 1.54% (3.1595 => 3.2081, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.46% (2.6546 => 2.6934, std.dev.: 0.0030) MultiSource/Applications/viterbi/viterbi: 1.26% (4.4649 => 4.5211, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.02% (6.6874 => 0.1327, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -79.90% (0.8651 => 0.1739, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.14% (5.2763 => 3.2112, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.50% (5.3855 => 3.6890, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.95% (5.3526 => 3.6958, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -14.64% (54.1659 => 46.2367, std.dev.: 0.0375) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.73% (2.9384 => 2.6230, std.dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: -6.79% (22.1758 => 20.6711, std.dev.: 0.0265) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.09% (8.0499 => 3.7762, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.49% (1.1492 => 0.7643, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4752, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4231, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.66% (1.2258 => 1.0706) SingleSource/Benchmarks/McGill/chomp: -11.45% (1.2373 => 1.0956, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/mandel-2: -10.71% (1.5373 => 1.3727, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.36% (19.9488 => 18.2803, std.dev.: 0.0158) MultiSource/Benchmarks/FreeBench/mason/mason: -7.73% (0.2161 => 0.1994, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.06% (1.8329 => 1.7035, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4781, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.64% (1.9577 => 1.8473, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.15% (1.6805 => 1.5939, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5085, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.30% (8.1563 => 7.8057, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1625, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8775, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5013, std.dev.: 0.0042) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.52% (0.4808 => 0.4687, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -2.32% (4.6441 => 4.5365, std.dev.: 0.0037) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -1.82% (10.2830 => 10.0959, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6816, std.dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.68% (2.5528 => 2.5099, std.dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4203, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/lists: -1.14% (6.2999 => 6.2278, std.dev.: 0.0079) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.10% (2.3135 => 2.2880) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 19.26% (0.5229 => 0.6236, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 14.58% (14.9895 => 17.1757, std.dev.: 0.0175) MultiSource/Applications/kimwitu++/kc: 10.13% (14.1553 => 15.5888, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 34.13% (1.1048 => 1.4819, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.30% (7.1582 => 8.1817, std.dev.: 0.0190) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.17% (0.6222 => 0.6855, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.30% (0.1485 => 0.1436, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.80% (0.2116 => 0.2133, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 21 19:57:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 21 Oct 2012 21:57:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121022025733.270822A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5085?compare_to=5083&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5085, Order: 166406, Start Time: 2012-10-22 01:34:34, End Time: 2012-10-22 03:00:35 To: 5083, Order: 166404, Start Time: 2012-10-21 23:39:15, End Time: 2012-10-22 01:05:09 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (199 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1040 (666 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.72% (54.4437 => 56.4707, std.dev.: 0.0919) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.40% (1.3140 => 1.2956, std.dev.: 0.0044) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.60% (2.0176 => 2.4938, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.92% (0.1410 => 0.1705, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/flops: 18.28% (0.0826 => 0.0977, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 17.97% (0.2243 => 0.2646, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 17.87% (0.1013 => 0.1194, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.62% (0.0746 => 0.0870, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.13% (0.7710 => 0.8954, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.08% (0.0653 => 0.0758, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.60% (0.2596 => 0.3001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 14.66% (0.2721 => 0.3120, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.39% (0.0834 => 0.0954, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 14.24% (1.3693 => 1.5643, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.18% (0.0811 => 0.0926, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.15% (0.1413 => 0.1613, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.05% (0.0847 => 0.0966, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 13.96% (0.1003 => 0.1143, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.82% (0.9199 => 1.0470, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.79% (0.0725 => 0.0825, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.72% (0.1327 => 0.1509, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.65% (0.1986 => 0.2257, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.52% (0.5637 => 0.6399, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.49% (0.1075 => 0.1220, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.45% (3.9660 => 4.4996, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.35% (0.1588 => 0.1800, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.34% (0.6959 => 0.7887, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.31% (0.5265 => 0.5966, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.28% (0.0964 => 0.1092, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 13.23% (0.1111 => 0.1258, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 13.20% (0.7038 => 0.7967, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.93% (0.1276 => 0.1441, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 12.90% (0.1062 => 0.1199, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.88% (0.7460 => 0.8421, std.dev.: 0.0030) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.87% (0.2914 => 0.3289, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 12.65% (0.1478 => 0.1665, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.59% (0.0977 => 0.1100, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 12.48% (0.4328 => 0.4868, std.dev.: 0.0039) MultiSource/Applications/Burg/burg: 12.46% (1.1061 => 1.2439, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.39% (1.4563 => 1.6368, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/distray/distray: 12.35% (0.0818 => 0.0919, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 12.33% (0.4062 => 0.4563, std.dev.: 0.0056) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.31% (0.1072 => 0.1204, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.23% (0.1014 => 0.1138, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.18% (0.5577 => 0.6256, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.16% (1.1364 => 1.2746, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.13% (1.2193 => 1.3672, std.dev.: 0.0114) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.01% (0.2023 => 0.2266, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 11.99% (13.8202 => 15.4769, std.dev.: 0.0148) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.92% (0.6283 => 0.7032, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.90% (0.1865 => 0.2087, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 11.80% (0.7506 => 0.8392, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.71% (0.3246 => 0.3626, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.69% (0.4379 => 0.4891, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.61% (0.2127 => 0.2374, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 11.53% (0.1657 => 0.1848, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 11.50% (3.8646 => 4.3089, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.41% (0.1157 => 0.1289, std.dev.: 0.0051) MultiSource/Applications/sgefa/sgefa: 11.35% (0.2995 => 0.3335, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.28% (0.3130 => 0.3483, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.13% (0.4791 => 0.5324, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 11.12% (0.7061 => 0.7846, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 11.11% (0.2925 => 0.3250, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.07% (0.1048 => 0.1164, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.05% (0.3899 => 0.4330, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 11.02% (0.3220 => 0.3575, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 11.00% (1.0313 => 1.1447, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 10.93% (0.5818 => 0.6454, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.90% (0.3485 => 0.3865, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.89% (0.3580 => 0.3970, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.89% (0.3756 => 0.4165, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 10.83% (1.9270 => 2.1356, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/health/health: 10.80% (0.1213 => 0.1344, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.79% (0.1789 => 0.1982, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 10.72% (0.2781 => 0.3079, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.71% (0.4390 => 0.4860, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.70% (0.5748 => 0.6363, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 10.69% (0.3293 => 0.3645, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.63% (0.4016 => 0.4443, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.61% (7.2180 => 7.9841, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 10.57% (0.1589 => 0.1757, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 10.52% (0.3868 => 0.4275, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.52% (0.1569 => 0.1734, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 10.51% (0.6744 => 0.7453, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.49% (0.3022 => 0.3339, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.46% (0.2782 => 0.3073, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.31% (0.1435 => 0.1583, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.29% (0.3489 => 0.3848, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/sieve: 10.28% (0.3453 => 0.3808, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 10.21% (16.6129 => 18.3087, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/football/football: 10.16% (0.8310 => 0.9154, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: 10.14% (0.2761 => 0.3041, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 10.12% (3.1889 => 3.5116, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.10% (1.3245 => 1.4583, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 10.07% (0.2760 => 0.3038, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 10.05% (0.2726 => 0.3000, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.05% (0.8698 => 0.9572, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.05% (0.2966 => 0.3264, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 9.99% (0.3534 => 0.3887, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 9.97% (0.2607 => 0.2867, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.97% (1.9828 => 2.1805, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 9.94% (2.1791 => 2.3957, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 9.93% (0.2690 => 0.2957, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 9.88% (0.3149 => 0.3460, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.83% (0.2655 => 0.2916, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 9.82% (0.3107 => 0.3412, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 9.77% (0.3192 => 0.3504, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 9.77% (0.2937 => 0.3224, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 9.74% (0.2628 => 0.2884, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.73% (0.2765 => 0.3034, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.66% (3.6692 => 4.0237, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.63% (4.3801 => 4.8020, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.59% (4.4433 => 4.8693, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.53% (0.2140 => 0.2344, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/05-eks/eks: 9.46% (0.4113 => 0.4502, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.38% (0.2696 => 0.2949, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 9.37% (0.2988 => 0.3268, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.33% (4.9865 => 5.4517, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.22% (0.2321 => 0.2535, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.13% (0.3755 => 0.4098, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 9.10% (0.2945 => 0.3213, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.10% (0.6135 => 0.6693, std.dev.: 0.0052) MultiSource/Benchmarks/nbench/nbench: 9.02% (1.0594 => 1.1550, std.dev.: 0.0084) MultiSource/Benchmarks/sim/sim: 8.91% (0.3131 => 0.3410, std.dev.: 0.0090) MultiSource/Applications/JM/lencod/lencod: 8.84% (14.8535 => 16.1659, std.dev.: 0.0113) MultiSource/Applications/SIBsim4/SIBsim4: 8.70% (1.2749 => 1.3858, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.60% (0.3511 => 0.3813, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 8.59% (8.4961 => 9.2260, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.56% (0.6576 => 0.7139, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.36% (1.1333 => 1.2280, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.34% (0.8818 => 0.9553, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.18% (1.5188 => 1.6430, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/bigfib: 8.14% (0.6250 => 0.6759, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 8.12% (3.7467 => 4.0509, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.11% (0.9108 => 0.9847, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 8.09% (0.1385 => 0.1497, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.98% (0.3245 => 0.3504, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.93% (3.2742 => 3.5340, std.dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 7.79% (6.5754 => 7.0877, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.78% (0.4805 => 0.5179, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.70% (0.1819 => 0.1959, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.69% (6.2785 => 6.7614, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.58% (2.1007 => 2.2600, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 7.52% (0.2008 => 0.2159, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.51% (0.2504 => 0.2692, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 7.48% (1.2292 => 1.3212, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 7.47% (4.6629 => 5.0114, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/exceptions: 7.20% (0.3914 => 0.4196, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.19% (0.4003 => 0.4291, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.13% (0.2243 => 0.2403, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 7.01% (0.3940 => 0.4216, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.97% (13.2842 => 14.2098, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/for-in: 6.91% (0.3789 => 0.4051, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.85% (0.3650 => 0.3900, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 6.85% (0.3578 => 0.3823, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.83% (0.3646 => 0.3895, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.83% (0.3663 => 0.3913, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.78% (0.3601 => 0.3845, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 6.62% (0.3623 => 0.3863, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: 5.68% (0.1777 => 0.1878, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 5.28% (16.2614 => 17.1198, std.dev.: 0.0127) MultiSource/Applications/ClamAV/clamscan: 4.89% (14.5298 => 15.2400, std.dev.: 0.0135) MultiSource/Benchmarks/Olden/bh/bh: 3.85% (0.2859 => 0.2969, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 2.19% (33.2944 => 34.0232, std.dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974) SingleSource/Benchmarks/Shootout-C++/methcall: 30.56% (5.7573 => 7.5169, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/fbench: 24.40% (1.8175 => 2.2609, std.dev.: 0.0457) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.09% (1.0895 => 1.2757, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 11.06% (1.1560 => 1.2839, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.03% (0.8273 => 0.9020, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (3.1736 => 3.4140, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.43% (0.9692 => 1.0218) SingleSource/Benchmarks/Misc/mandel-2: 5.17% (1.2998 => 1.3670, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.56% (0.3139 => 0.3282, std.dev.: 0.0032) SingleSource/Regression/C/uint64_to_float: 4.48% (0.5449 => 0.5693, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.45% (2.8606 => 2.9880, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9853, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.40% (10.7476 => 11.1127, std.dev.: 0.0071) MultiSource/Applications/hexxagon/hexxagon: 3.37% (12.0921 => 12.4997, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.22% (11.2619 => 11.6243, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bisort/bisort: 3.12% (0.8239 => 0.8496, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.40% (1.0310 => 1.0557, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.21% (7.4271 => 7.5913, std.dev.: 0.0032) MultiSource/Applications/lemon/lemon: 1.79% (1.4298 => 1.4554, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5145, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1889, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5778, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.17% (9.9194 => 10.0357, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 1.08% (3.1071 => 3.1408, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.04% (12.4560 => 12.5859, std.dev.: 0.0066) SingleSource/Benchmarks/McGill/queens: 1.00% (2.1753 => 2.1971, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.40% (0.2670 => 0.1431, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.15% (0.4657 => 0.3905, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.15% (1.3813 => 1.2135, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.01% (1.3819 => 1.2159, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.29% (1.0460 => 0.8547, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -13.00% (0.2238 => 0.1947, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.04% (20.3410 => 18.2987, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.98% (1.3780 => 1.2956, std.dev.: 0.0044) SingleSource/Benchmarks/McGill/chomp: -5.74% (1.2308 => 1.1601, std.dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5152, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.55% (0.9996 => 0.9541, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.79% (1.7688 => 1.7018, std.dev.: 0.0046) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.02% (0.4867 => 0.4720, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -2.88% (3.2729 => 3.1785, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -2.76% (3.0263 => 2.9429, std.dev.: 0.0101) MultiSource/Benchmarks/Olden/bh/bh: -2.73% (1.9762 => 1.9222, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8812, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4781, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.37% (4.1080 => 4.0106, std.dev.: 0.0045) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.91% (0.6589 => 0.6463, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.86% (0.6615 => 0.6492, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -1.78% (6.3560 => 6.2427, std.dev.: 0.0092) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.68% (2.5254 => 2.4830, std.dev.: 0.0011) MultiSource/Applications/lua/lua: -1.67% (26.5159 => 26.0735, std.dev.: 0.0559) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.65% (0.8342 => 0.8204, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0068, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.27% (3.9173 => 3.8676, std.dev.: 0.0152) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2506, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: -1.24% (28.2225 => 27.8723, std.dev.: 0.0016) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1138, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -1.06% (84.4286 => 83.5356, std.dev.: 0.0062) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 21 20:15:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 21 Oct 2012 22:15:05 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121022031505.2A66B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5086?compare_to=5081&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5086, Order: 166405, Start Time: 2012-10-22 01:06:27, End Time: 2012-10-22 03:17:08 To: 5081, Order: 166404, Start Time: 2012-10-21 23:25:20, End Time: 2012-10-22 00:49:38 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 47 (47 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 11 (20 on baseline) Performance Improvements: 7 (8 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 910 (899 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/d/make_dparser MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/treecc/treecc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/VersaBench/dbms/dbms SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/DuffsDevice SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp MultiSource/Applications/JM/lencod/lencod: -99.97% (6.6680 => 0.0020, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 5.79% (3.2018 => 3.3872, std.dev.: 0.0104) MultiSource/Applications/SPASS/SPASS: -100.00% (8.7173 => 0.0001, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: -99.69% (0.0324 => 0.0001, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -100.00% (28.3424 => 0.0001) MultiSource/Applications/minisat/minisat: -98.61% (6.3303 => 0.0883, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 900.00% (0.0001 => 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.54% (2.4574 => 0.0112, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 293.41% (7.1494 => 28.1263, std.dev.: 0.7595) MultiSource/Benchmarks/FreeBench/distray/distray: -46.07% (0.2407 => 0.1298, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: -33.92% (0.6233 => 0.4119, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/gs/gs: -99.87% (0.0790 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 1.34% (0.1268 => 0.1285, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: -61.11% (0.1427 => 0.0555, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -99.82% (0.0541 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 111703.30% (0.3028 => 338.5404, std.dev.: 0.7357) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 143327.15% (0.3481 => 499.2699, std.dev.: 0.1440) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.17% (1.4969 => 1.8886, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -99.17% (2.3980 => 0.0198, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/health/health: -2.89% (0.3524 => 0.3422, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/mst/mst: -17.08% (0.1399 => 0.1160, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/power/power: -82.36% (1.2107 => 0.2136, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/voronoi/voronoi: -95.73% (0.3397 => 0.0145, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: -99.59% (0.0244 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1012.50% (0.0064 => 0.0712, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 81.20% (0.0532 => 0.0964, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.91% (1.1038 => 0.0010, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.00% (2.5861 => 2.7413, std.dev.: 0.1152) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.02% (2.5635 => 2.4091, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 31.83% (6.7934 => 8.9555, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -81.98% (3.7075 => 0.6680, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -0.16% (3.4166 => 3.4113, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/almabench: -1.20% (22.1503 => 21.8845, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/chomp: -87.36% (1.1182 => 0.1413, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -88.01% (3.3115 => 0.3969, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/stepanov_container: -91.09% (4.5602 => 0.4063, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/mandel-2: -99.95% (2.8897 => 0.0014, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -0.25% (1.4588 => 1.4551, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash: -99.98% (0.6500 => 0.0001, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -100.00% (3.3728 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -99.90% (0.1006 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C++/EH/function_try_block: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: - (0.0001 => 0.0001, std.dev.: 0.0010) SingleSource/Regression/C/DuffsDevice: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2008-04-18-LoopBug: - (0.0007 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2008-04-20-LoopBug2: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2008-07-13-InlineSetjmp: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/12-IOtest/iotest: 21.80% (0.0711 => 0.0866, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.65% (0.2237 => 0.2341, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.41% (0.5816 => 0.5956, std.dev.: 0.0028) MultiSource/Applications/JM/lencod/lencod: 1.50% (15.2323 => 15.4606, std.dev.: 0.0396) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.24% (4.1920 => 4.2438, std.dev.: 0.0153) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/hash: 75.05% (4.2807 => 7.4932, std.dev.: 0.0664) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.81% (3.6511 => 3.8998, std.dev.: 0.0893) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.86% (16.2708 => 16.8990, std.dev.: 0.2005) MultiSource/Applications/hexxagon/hexxagon: 3.49% (14.0201 => 14.5098, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.05% (2.4518 => 2.5267, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/ReedSolomon: 1.11% (8.7152 => 8.8119, std.dev.: 0.0326) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -7.79% (0.6585 => 0.6072, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.34% (0.2854 => 0.2730, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.99% (1.2609 => 1.2358, std.dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/siod/siod: -5.09% (3.7719 => 3.5800, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.03% (1.0444 => 1.0232, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/functionobjects: -1.30% (3.7850 => 3.7357, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: -1.14% (2.8789 => 2.8462, std.dev.: 0.0110) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -1.78% (16.4429 => 16.1509, std.dev.: 0.1034) MultiSource/Applications/obsequi/Obsequi: 0.30% (1.0391 => 1.0422, std.dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: -0.38% (0.6366 => 0.6342, std.dev.: 0.0142) MultiSource/Benchmarks/McCat/08-main/main: -6.76% (0.1939 => 0.1808, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.46% (0.1615 => 0.1687, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.22% (0.3245 => 0.3252, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.04% (0.2488 => 0.2487, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.08% (0.3329 => 0.3365, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.43% (0.2375 => 0.2409, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: -0.02% (0.5953 => 0.5952, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel: -5.53% (0.0470 => 0.0444, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.12% (0.3292 => 0.3329, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/strcat: -2.25% (0.1997 => 0.1952, std.dev.: 0.0024) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -17.76% (0.0259 => 0.0213, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.95% (0.0211 => 0.0213, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.24% (0.0420 => 0.0419, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -24.69% (0.0324 => 0.0244, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.65% (0.0309 => 0.0307, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.20% (0.0415 => 0.0410, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 1.03% (0.0195 => 0.0197, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 7.45% (0.0188 => 0.0202, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -12.87% (0.0342 => 0.0298, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 800.00% (0.0001 => 0.0009, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -49.36% (0.1485 => 0.0752, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.72% (1.1325 => 1.1406, std.dev.: 0.0488) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -99.93% (0.1437 => 0.0001, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.45% (0.4035 => 0.4134, std.dev.: 0.0208) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.71% (0.1413 => 0.1423, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.56% (0.0629 => 0.0594, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -15.98% (0.0244 => 0.0205, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.78% (0.0544 => 0.0570, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.23% (1.1445 => 1.1419, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 1800.00% (0.0001 => 0.0019, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.25% (0.0561 => 0.0554, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.88% (0.0196 => 0.0233, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.02% (0.8017 => 0.8019, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: -100.00% (0.0001 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 200.00% (0.0001 => 0.0003, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -10.34% (0.0058 => 0.0052, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/d/make_dparser MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/treecc/treecc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/VersaBench/dbms/dbms SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/DuffsDevice SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp MultiSource/Applications/JM/lencod/lencod: -99.97% (6.7064 => 0.0020, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 6.27% (3.1873 => 3.3872, std.dev.: 0.0104) MultiSource/Applications/SPASS/SPASS: -100.00% (8.4326 => 0.0001, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: -99.74% (0.0384 => 0.0001, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -100.00% (29.8330 => 0.0001) MultiSource/Applications/minisat/minisat: -98.56% (6.1525 => 0.0883, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 900.00% (0.0001 => 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.54% (2.4333 => 0.0112, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 295.14% (7.1181 => 28.1263, std.dev.: 0.7595) MultiSource/Benchmarks/FreeBench/distray/distray: -45.69% (0.2390 => 0.1298, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: -33.02% (0.6150 => 0.4119, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/gs/gs: -99.87% (0.0788 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 1.90% (0.1261 => 0.1285, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: -59.49% (0.1370 => 0.0555, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -99.81% (0.0528 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 103460.84% (0.3269 => 338.5404, std.dev.: 0.7357) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 156607.44% (0.3186 => 499.2699, std.dev.: 0.1440) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 0.30% (1.8829 => 1.8886, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -99.16% (2.3560 => 0.0198, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/health/health: -2.84% (0.3522 => 0.3422, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/mst/mst: -16.31% (0.1386 => 0.1160, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/power/power: -82.29% (1.2061 => 0.2136, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/voronoi/voronoi: -95.76% (0.3421 => 0.0145, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: -99.50% (0.0199 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 584.62% (0.0104 => 0.0712, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 79.52% (0.0537 => 0.0964, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.91% (1.0998 => 0.0010, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.40% (2.5763 => 2.7413, std.dev.: 0.1152) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.25% (2.5697 => 2.4091, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 32.17% (6.7755 => 8.9555, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -82.04% (3.7192 => 0.6680, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 0.03% (3.4104 => 3.4113, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/almabench: -1.17% (22.1437 => 21.8845, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/chomp: -87.40% (1.1216 => 0.1413, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -88.14% (3.3479 => 0.3969, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/stepanov_container: -91.08% (4.5547 => 0.4063, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/mandel-2: -99.95% (2.8951 => 0.0014, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 0.10% (1.4536 => 1.4551, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash: -99.98% (0.6205 => 0.0001, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -100.00% (3.4237 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -99.89% (0.0949 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C++/EH/function_try_block: -50.00% (0.0002 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: -93.33% (0.0015 => 0.0001, std.dev.: 0.0010) SingleSource/Regression/C/DuffsDevice: 75.00% (0.0004 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2008-04-18-LoopBug: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2008-04-20-LoopBug2: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2008-07-13-InlineSetjmp: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.85% (2.1832 => 1.6626, std.dev.: 0.0030) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.93% (0.0810 => 0.0939, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 9.53% (0.1112 => 0.1218, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.19% (0.2180 => 0.2315, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.51% (0.2240 => 0.2341, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.46% (0.7473 => 0.7806, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.39% (0.5817 => 0.5956, std.dev.: 0.0028) MultiSource/Applications/hbd/hbd: 2.32% (1.4269 => 1.4600, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.62% (4.1763 => 4.2438, std.dev.: 0.0153) MultiSource/Applications/d/make_dparser: 1.58% (3.2366 => 3.2876, std.dev.: 0.0139) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/hash: 73.91% (4.3087 => 7.4932, std.dev.: 0.0664) SingleSource/Benchmarks/Misc/pi: 58.37% (1.5795 => 2.5015, std.dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.39% (14.6451 => 16.8990, std.dev.: 0.2005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.43% (1.1857 => 1.2856, std.dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: 5.92% (63.1822 => 66.9198, std.dev.: 0.0265) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 5.71% (2.2485 => 2.3770, std.dev.: 0.0083) MultiSource/Applications/hexxagon/hexxagon: 3.59% (14.0064 => 14.5098, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/ReedSolomon: 3.28% (8.5322 => 8.8119, std.dev.: 0.0326) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.17% (2.4490 => 2.5267, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/mason/mason: 1.88% (0.5415 => 0.5517, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.84% (1.5941 => 1.6234, std.dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -7.80% (0.6586 => 0.6072, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.01% (0.2844 => 0.2730, std.dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -34.02% (0.0338 => 0.0223, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -7.48% (0.1430 => 0.1323, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.38% (7.2130 => 6.8969, std.dev.: 0.1070) MultiSource/Applications/siod/siod: -2.30% (3.6643 => 3.5800, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.50% (1.0388 => 1.0232, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/functionobjects: -1.12% (3.7781 => 3.7357, std.dev.: 0.0007) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -1.79% (16.4461 => 16.1509, std.dev.: 0.1034) MultiSource/Applications/obsequi/Obsequi: 1.56% (1.0262 => 1.0422, std.dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: 0.16% (0.6332 => 0.6342, std.dev.: 0.0142) MultiSource/Benchmarks/McCat/08-main/main: -1.26% (0.1831 => 0.1808, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 8.21% (0.1559 => 0.1687, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.13% (0.3123 => 0.3252, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.97% (0.2463 => 0.2487, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.63% (0.3344 => 0.3365, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.90% (0.2364 => 0.2409, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: -0.97% (0.6010 => 0.5952, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel: 3.50% (0.0429 => 0.0444, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.93% (0.3266 => 0.3329, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/strcat: -0.86% (0.1969 => 0.1952, std.dev.: 0.0024) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -4.91% (0.0224 => 0.0213, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 73.17% (0.0123 => 0.0213, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.70% (0.0408 => 0.0419, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -3.94% (0.0254 => 0.0244, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.66% (0.0302 => 0.0307, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 6.77% (0.0384 => 0.0410, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 3.68% (0.0190 => 0.0197, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 12.22% (0.0180 => 0.0202, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: 29.57% (0.0230 => 0.0298, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 28.57% (0.0007 => 0.0009, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -47.71% (0.1438 => 0.0752, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.68% (1.1329 => 1.1406, std.dev.: 0.0488) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -99.93% (0.1462 => 0.0001, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.72% (0.4164 => 0.4134, std.dev.: 0.0208) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.94% (0.1369 => 0.1423, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.33% (0.0641 => 0.0594, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 5.13% (0.0195 => 0.0205, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.38% (0.0578 => 0.0570, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.16% (1.1437 => 1.1419, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 35.71% (0.0014 => 0.0019, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.64% (0.0627 => 0.0554, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 29.44% (0.0180 => 0.0233, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.02% (0.8017 => 0.8019, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 200.00% (0.0001 => 0.0003, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -16.13% (0.0062 => 0.0052, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 21 21:56:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 21 Oct 2012 23:56:08 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121022045608.54F932A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5087?compare_to=5086&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5087, Order: 166407, Start Time: 2012-10-22 03:34:13, End Time: 2012-10-22 04:58:10 To: 5086, Order: 166405, Start Time: 2012-10-22 01:06:27, End Time: 2012-10-22 03:17:08 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 46 (1 on baseline) Performance Regressions: 16 (37 on baseline) Performance Improvements: 6 (6 on baseline) Existing Failures: 68 (67 on baseline) Unchanged Tests: 906 (930 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/d/make_dparser MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/treecc/treecc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/VersaBench/dbms/dbms SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/DuffsDevice SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp MultiSource/Applications/JM/lencod/lencod: 333565.00% (0.0020 => 6.6733, std.dev.: 0.0082) MultiSource/Applications/SIBsim4/SIBsim4: -5.82% (3.3872 => 3.1900, std.dev.: 0.0159) MultiSource/Applications/d/make_dparser: 33100.00% (0.0001 => 0.0332, std.dev.: 0.0027) MultiSource/Applications/lua/lua: 28597900.00% (0.0001 => 28.5980, std.dev.: 0.0034) MultiSource/Applications/minisat/minisat: 6965.80% (0.0883 => 6.2391, std.dev.: 0.0043) MultiSource/Applications/treecc/treecc: -90.00% (0.0010 => 0.0001, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 21777.68% (0.0112 => 2.4503, std.dev.: 0.0632) MultiSource/Benchmarks/Bullet/bullet: -74.67% (28.1263 => 7.1230, std.dev.: 0.0415) MultiSource/Benchmarks/FreeBench/distray/distray: 86.67% (0.1298 => 0.2423, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/espresso/espresso: 50.35% (0.4119 => 0.6193, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/gs/gs: 81400.00% (0.0001 => 0.0815, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/09-vor/vor: -0.78% (0.1285 => 0.1275, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/18-imp/imp: 161.08% (0.0555 => 0.1449, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 58000.00% (0.0001 => 0.0581, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -99.91% (338.5404 => 0.2995, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -99.94% (499.2699 => 0.3194, std.dev.: 0.0147) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -0.17% (1.8886 => 1.8853, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/bh/bh: 12030.30% (0.0198 => 2.4018, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/health/health: 2.89% (0.3422 => 0.3521, std.dev.: 0.0150) MultiSource/Benchmarks/Olden/mst/mst: 19.66% (0.1160 => 0.1388, std.dev.: 0.0113) MultiSource/Benchmarks/Olden/power/power: 462.78% (0.2136 => 1.2021, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/voronoi/voronoi: 2246.90% (0.0145 => 0.3403, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 18900.00% (0.0001 => 0.0190, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -85.96% (0.0712 => 0.0100, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -43.98% (0.0964 => 0.0540, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 110170.00% (0.0010 => 1.1027, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: -8.47% (2.7413 => 2.5090, std.dev.: 0.1152) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.27% (2.4091 => 2.5842, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -25.00% (8.9555 => 6.7162, std.dev.: 0.0160) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 451.56% (0.6680 => 3.6844, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -0.02% (3.4113 => 3.4107, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/almabench: 1.24% (21.8845 => 22.1561, std.dev.: 0.0090) SingleSource/Benchmarks/McGill/chomp: 695.82% (0.1413 => 1.1245, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 733.51% (0.3969 => 3.3082, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1021.81% (0.4063 => 4.5579, std.dev.: 0.0762) SingleSource/Benchmarks/Misc/mandel-2: 206478.57% (0.0014 => 2.8921, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -0.07% (1.4551 => 1.4541, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/hash: 633400.00% (0.0001 => 0.6335, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash2: 3372000.00% (0.0001 => 3.3721, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/moments: 100900.00% (0.0001 => 0.1010, std.dev.: 0.0002) SingleSource/Regression/C++/EH/function_try_block: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: - (0.0001 => 0.0001, std.dev.: 0.0010) SingleSource/Regression/C/DuffsDevice: -85.71% (0.0007 => 0.0001) SingleSource/UnitTests/2008-04-18-LoopBug: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2008-04-20-LoopBug2: - (0.0001 => 0.0001) SingleSource/UnitTests/2008-07-13-InlineSetjmp: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.29% (0.6072 => 0.6697, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.91% (0.2078 => 0.2180, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.51% (0.4653 => 0.4863, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.47% (0.2730 => 0.2852, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.04% (0.2972 => 0.3092, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.91% (0.6131 => 0.6371, std.dev.: 0.0062) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.38% (0.3222 => 0.3331, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.38% (0.5916 => 0.6116, std.dev.: 0.0033) SingleSource/UnitTests/Vector/constpool: 3.37% (8.2103 => 8.4866, std.dev.: 0.0260) MultiSource/Benchmarks/nbench/nbench: 2.79% (1.1143 => 1.1454, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.70% (1.2358 => 1.2692, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.33% (0.8027 => 0.8214, std.dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 1.70% (1.2473 => 1.2685, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/football/football: 1.42% (0.8754 => 0.8878, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.13% (8.6844 => 8.7828, std.dev.: 0.0126) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/siod/siod: 5.04% (3.5800 => 3.7605, std.dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/d/make_dparser: -1.02% (3.2876 => 3.2540, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/hash: -42.68% (7.4932 => 4.2954, std.dev.: 0.0093) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.69% (2.5267 => 2.4335, std.dev.: 0.0267) MultiSource/Applications/hexxagon/hexxagon: -3.51% (14.5098 => 14.0009, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -1.41% (22.3625 => 22.0481, std.dev.: 0.1149) MultiSource/Benchmarks/llubenchmark/llu: -1.14% (2.0333 => 2.0102, std.dev.: 0.0056) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 1.68% (16.1509 => 16.4226, std.dev.: 0.0638) MultiSource/Applications/obsequi/Obsequi: -0.59% (1.0422 => 1.0361, std.dev.: 0.0084) MultiSource/Applications/sqlite3/sqlite3: 0.44% (0.6342 => 0.6370, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: 5.03% (0.1808 => 0.1899, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.40% (0.1687 => 0.1579, std.dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.71% (0.3252 => 0.3164, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.97% (0.2487 => 0.2463, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.04% (0.3365 => 0.3330, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.37% (0.2409 => 0.2376, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/bigfib: 0.12% (0.5952 => 0.5959, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: 10.59% (0.0444 => 0.0491, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: -1.86% (0.3329 => 0.3267, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 1.79% (0.1952 => 0.1987, std.dev.: 0.0008) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 11.74% (0.0213 => 0.0238, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.47% (0.0213 => 0.0212, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.48% (0.0419 => 0.0417, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 32.38% (0.0244 => 0.0323, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -15.31% (0.0307 => 0.0260, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.98% (0.0410 => 0.0414, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0197 => 0.0197) SingleSource/UnitTests/Vector/Altivec/test1: 3.47% (0.0202 => 0.0209, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 8.72% (0.0298 => 0.0324, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -88.89% (0.0009 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 95.61% (0.0752 => 0.1471, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 8300000.00% (0.0001 => 8.3001, std.dev.: 0.0437) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.65% (1.1406 => 1.1480, std.dev.: 0.0342) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 149000.00% (0.0001 => 0.1491, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.44% (0.4134 => 0.4033, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.79% (0.1423 => 0.1369, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: - (0.0594 => 0.0594, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 9.76% (0.0205 => 0.0225, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.18% (0.0570 => 0.0571, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: - (1.1419 => 1.1419, std.dev.: 0.0138) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1900.00% (0.0001 => 0.0020, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -78.95% (0.0019 => 0.0004, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.19% (0.0554 => 0.0616, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.15% (0.0233 => 0.0238, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.62% (0.8019 => 0.7969, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -66.67% (0.0003 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 98.08% (0.0052 => 0.0103, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/SPASS/SPASS MultiSource/Applications/SPASS/SPASS: -1.57% (8.4326 => 8.3001, std.dev.: 0.0437) New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.90% (2.1832 => 1.6614, std.dev.: 0.0059) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 12.59% (0.0810 => 0.0912, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/tsp/tsp: 9.62% (0.1112 => 0.1219, std.dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.18% (0.3137 => 0.3331, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.04% (0.1905 => 0.2020, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.01% (0.6010 => 0.6371, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.60% (0.2180 => 0.2302, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.48% (0.8321 => 0.8777, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.56% (0.2279 => 0.2383, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.09% (0.7473 => 0.7779, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.02% (0.4847 => 0.5042, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.30% (0.8148 => 0.8417, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.28% (1.1606 => 1.1987, std.dev.: 0.0104) MultiSource/Applications/hbd/hbd: 2.94% (1.4269 => 1.4688, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.60% (0.5961 => 0.6116, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.59% (0.8007 => 0.8214, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: 2.15% (0.7950 => 0.8121, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.69% (0.6586 => 0.6697, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.69% (0.9435 => 0.9594, std.dev.: 0.0046) MultiSource/Benchmarks/nbench/nbench: 1.62% (1.1271 => 1.1454, std.dev.: 0.0056) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.57% (6.6074 => 6.7114, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.56% (8.6476 => 8.7828, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.42% (1.6386 => 1.6619, std.dev.: 0.0088) MultiSource/Benchmarks/MallocBench/gs/gs: 1.32% (4.1305 => 4.1852, std.dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C/football/football: 1.25% (0.8768 => 0.8878, std.dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: 1.12% (31.8598 => 32.2179, std.dev.: 0.0903) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.91% (1.5795 => 2.5100, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.26% (14.6451 => 16.7333, std.dev.: 0.1426) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.90% (1.1857 => 1.2794, std.dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: 6.00% (63.1822 => 66.9721, std.dev.: 0.1176) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 3.02% (44.5605 => 45.9041, std.dev.: 0.4562) SingleSource/Benchmarks/Misc/ReedSolomon: 2.99% (8.5322 => 8.7874, std.dev.: 0.0221) MultiSource/Applications/siod/siod: 2.63% (3.6643 => 3.7605, std.dev.: 0.0050) SingleSource/Benchmarks/Dhrystone/dry: 1.99% (0.5081 => 0.5182, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 1.94% (2.3560 => 2.4018, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: 1.41% (6.1525 => 6.2391, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.26% (4.8362 => 4.8970, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/whetstone: 1.02% (2.1224 => 2.1441, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.38% (0.3269 => 0.2995, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -7.83% (3.2926 => 3.0348, std.dev.: 0.0043) MultiSource/Applications/lua/lua: -4.14% (29.8330 => 28.5980, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: -1.51% (3.4237 => 3.3721, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.19% (3.3479 => 3.3082, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/functionobjects: -1.07% (3.7781 => 3.7376, std.dev.: 0.0087) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.14% (16.4461 => 16.4226, std.dev.: 0.0638) MultiSource/Applications/obsequi/Obsequi: 0.96% (1.0262 => 1.0361, std.dev.: 0.0084) MultiSource/Applications/sqlite3/sqlite3: 0.60% (0.6332 => 0.6370, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: 3.71% (0.1831 => 0.1899, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.28% (0.1559 => 0.1579, std.dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.31% (0.3123 => 0.3164, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.2463 => 0.2463, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.42% (0.3344 => 0.3330, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.51% (0.2364 => 0.2376, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/bigfib: -0.85% (0.6010 => 0.5959, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: 14.45% (0.0429 => 0.0491, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.03% (0.3266 => 0.3267, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 0.91% (0.1969 => 0.1987, std.dev.: 0.0008) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.25% (0.0224 => 0.0238, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 72.36% (0.0123 => 0.0212, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.21% (0.0408 => 0.0417, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 27.17% (0.0254 => 0.0323, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -13.91% (0.0302 => 0.0260, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 7.81% (0.0384 => 0.0414, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 3.68% (0.0190 => 0.0197) SingleSource/UnitTests/Vector/Altivec/test1: 16.11% (0.0180 => 0.0209, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 40.87% (0.0230 => 0.0324, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.29% (0.1438 => 0.1471, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.33% (1.1329 => 1.1480, std.dev.: 0.0342) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 1.98% (0.1462 => 0.1491, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.15% (0.4164 => 0.4033, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: - (0.1369 => 0.1369, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.33% (0.0641 => 0.0594, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 15.38% (0.0195 => 0.0225, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.21% (0.0578 => 0.0571, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.16% (1.1437 => 1.1419, std.dev.: 0.0138) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1900.00% (0.0001 => 0.0020, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -71.43% (0.0014 => 0.0004, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.75% (0.0627 => 0.0616, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 32.22% (0.0180 => 0.0238, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.60% (0.8017 => 0.7969, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 66.13% (0.0062 => 0.0103, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 21 22:02:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 22 Oct 2012 00:02:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121022050215.99D1E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5088?compare_to=5084&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5088, Order: 166407, Start Time: 2012-10-22 03:44:17, End Time: 2012-10-22 05:04:17 To: 5084, Order: 166406, Start Time: 2012-10-22 01:30:32, End Time: 2012-10-22 02:50:28 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (5 on baseline) Performance Regressions: 6 (194 on baseline) Performance Improvements: 4 (45 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 88 (14 on baseline) Unchanged Tests: 944 (648 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.63% (2.5727 => 2.6146, std.dev.: 0.0031) MultiSource/Applications/JM/ldecod/ldecod: 1.41% (11.7549 => 11.9206, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.33% (0.7797 => 0.7901, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 1.21% (6.4828 => 6.5613, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.16% (8.3282 => 8.4244, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.11% (3.6890 => 3.7300, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: -3.70% (0.4190 => 0.4035, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash2: -1.87% (3.3684 => 3.3054, std.dev.: 0.0064) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.15% (1.5939 => 1.5756, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.03% (10.0499 => 9.9463, std.dev.: 0.0001) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.14% (0.6236 => 0.6245, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 0.45% (17.1757 => 17.2533, std.dev.: 0.0127) MultiSource/Applications/kimwitu++/kc: 0.50% (15.5888 => 15.6669, std.dev.: 0.0227) MultiSource/Benchmarks/Bullet/bullet: 0.59% (55.9164 => 56.2468, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.21% (0.0479 => 0.0480, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.21% (0.0480 => 0.0481, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.22% (0.0449 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.22% (0.0450 => 0.0451, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0439 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.23% (0.0440 => 0.0441) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.23% (0.0433 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0434 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.22% (0.0450 => 0.0451, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.89% (0.0451 => 0.0455, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.22% (0.0446 => 0.0445, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0446 => 0.0446, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.23% (0.0435 => 0.0436, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.23% (0.0436 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.23% (0.0442 => 0.0443, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.23% (0.0443 => 0.0444, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.22% (0.0453 => 0.0454) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.40% (0.0455 => 0.0475, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.23% (0.0430 => 0.0431, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.23% (0.0431 => 0.0432, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0443 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.23% (0.0443 => 0.0444) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0434 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.23% (0.0434 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.24% (0.0425 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0427 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0424 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0426 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.22% (0.0461 => 0.0462) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0462 => 0.0462, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.24% (0.0423 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0425 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0425 => 0.0425, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0425 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.23% (0.0432 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.23% (0.0433 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.57% (1.4819 => 1.4903, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.43% (8.1817 => 8.2170, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.25% (0.6855 => 0.6872, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1436 => 0.1437, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.05% (0.2133 => 0.2134, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.06% (63.2438 => 56.2468, std.dev.: 0.0097) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/MallocBench/gs/gs: 13.02% (4.1105 => 4.6455, std.dev.: 0.0131) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.64% (3.4629 => 5.8053, std.dev.: 0.0207) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13492.64% (0.0720 => 9.7867, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9946200.00% (0.0001 => 9.9463, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 57.99% (0.2554 => 0.4035, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: 56.25% (0.0256 => 0.0400, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 52.07% (10.3673 => 15.7660, std.dev.: 0.0110) SingleSource/UnitTests/SignlessTypes/factor: 45.95% (0.0296 => 0.0432, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 42.44% (0.0271 => 0.0386) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.28% (1.5859 => 2.2405, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: 38.47% (0.1622 => 0.2246, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 36.08% (0.1056 => 0.1437, std.dev.: 0.0006) SingleSource/UnitTests/vla: 32.39% (0.0355 => 0.0470, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.27% (2.2024 => 2.8691, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/neural/neural: 25.84% (0.1463 => 0.1841, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 25.30% (0.0834 => 0.1045, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.14% (0.1566 => 0.1897, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 20.40% (0.2049 => 0.2467, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 19.62% (0.1432 => 0.1713, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.43% (7.0540 => 8.4244, std.dev.: 0.0077) MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.73% (2.2022 => 2.6146, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.37% (0.6675 => 0.7901, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.03% (0.0871 => 0.1028, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.69% (0.5105 => 0.6008, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 17.68% (0.1555 => 0.1830, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 16.86% (0.1655 => 0.1934, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: 16.61% (0.0626 => 0.0730, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.40% (1.3050 => 1.5190, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 16.37% (3.3354 => 3.8813, std.dev.: 0.0121) MultiSource/Benchmarks/Olden/power/power: 16.04% (0.1440 => 0.1671, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 15.81% (0.1695 => 0.1963, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 15.81% (0.2271 => 0.2630, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 15.76% (0.0793 => 0.0918, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.75% (0.4615 => 0.5342, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.63% (0.1337 => 0.1546, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.60% (0.1032 => 0.1193, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 15.60% (0.3282 => 0.3794, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 15.49% (0.1175 => 0.1357, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.44% (0.5020 => 0.5795, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/mst/mst: 15.22% (0.1163 => 0.1340, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.10% (1.5415 => 1.7743, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.10% (0.1510 => 0.1738, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 15.09% (0.7115 => 0.8189, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.01% (0.0886 => 0.1019, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 14.87% (0.8172 => 0.9387, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.79% (0.1940 => 0.2227, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.77% (0.1584 => 0.1818, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.61% (0.0842 => 0.0965, std.dev.: 0.0025) MultiSource/Applications/sgefa/sgefa: 14.60% (0.3109 => 0.3563, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.56% (0.0838 => 0.0960, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.48% (0.0746 => 0.0854, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 14.43% (0.3423 => 0.3917, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.42% (1.7609 => 2.0149, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.40% (0.1236 => 0.1414, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.38% (0.0730 => 0.0835, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/exptree: 14.37% (0.0814 => 0.0931, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.34% (4.2646 => 4.8760, std.dev.: 0.0015) MultiSource/Applications/aha/aha: 14.34% (0.1151 => 0.1316, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.29% (0.3121 => 0.3567, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.24% (0.9765 => 1.1156, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.24% (0.2107 => 0.2407, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 14.22% (10.4361 => 11.9206, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/matrix: 14.06% (0.0818 => 0.0933) MultiSource/Applications/Burg/burg: 14.04% (1.1642 => 1.3277, std.dev.: 0.0012) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.00% (0.1143 => 0.1303, std.dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 13.93% (5.7591 => 6.5613, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 13.90% (9.4845 => 10.8027, std.dev.: 0.0104) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 13.78% (0.6450 => 0.7339, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.63% (0.2758 => 0.3134, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.61% (0.1117 => 0.1269, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.53% (0.5860 => 0.6653, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.51% (0.1695 => 0.1924, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.51% (0.0770 => 0.0874, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.46% (0.2065 => 0.2343, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.45% (8.1363 => 9.2308, std.dev.: 0.0035) MultiSource/Applications/spiff/spiff: 13.43% (0.7835 => 0.8887, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.38% (0.1906 => 0.2161, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.37% (1.4186 => 1.6082, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.35% (0.1438 => 0.1630, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 13.21% (2.0273 => 2.2952, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.18% (0.0933 => 0.1056, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 13.16% (0.7433 => 0.8411, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.05% (0.1625 => 0.1837, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.02% (0.0929 => 0.1050, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.00% (0.2700 => 0.3051, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 12.96% (1.1840 => 1.3375, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.90% (0.1062 => 0.1199, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.85% (0.8067 => 0.9104, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.83% (0.1029 => 0.1161, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.78% (0.0798 => 0.0900, std.dev.: 0.0021) MultiSource/Applications/lua/lua: 12.78% (3.8723 => 4.3670, std.dev.: 0.0084) MultiSource/Applications/lemon/lemon: 12.76% (1.0722 => 1.2090, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.75% (5.0018 => 5.6395, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.73% (0.4879 => 0.5500, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.71% (4.9449 => 5.5732, std.dev.: 0.0163) SingleSource/UnitTests/SignlessTypes/rem: 12.67% (0.1144 => 0.1289, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.67% (0.5981 => 0.6739, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 12.58% (0.4299 => 0.4840, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: 12.43% (0.3387 => 0.3808, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 12.28% (0.3177 => 0.3567, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: 12.22% (0.1268 => 0.1423, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.20% (1.1861 => 1.3308, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.19% (0.3307 => 0.3710, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.17% (0.5569 => 0.6247, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.10% (0.2603 => 0.2918, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.00% (0.3543 => 0.3968, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.95% (7.9617 => 8.9134, std.dev.: 0.0150) MultiSource/Benchmarks/McCat/09-vor/vor: 11.76% (0.3180 => 0.3554, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 11.75% (0.8921 => 0.9969, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.64% (0.1125 => 0.1256, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: 11.56% (0.3927 => 0.4381, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.43% (0.1330 => 0.1482, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 11.35% (0.3543 => 0.3945, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 11.34% (0.3473 => 0.3867, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 11.32% (0.3516 => 0.3914, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.31% (0.3828 => 0.4261, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.25% (0.3441 => 0.3828, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 11.25% (0.3886 => 0.4323, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 11.24% (0.3497 => 0.3890, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 11.23% (0.3694 => 0.4109, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.23% (0.3561 => 0.3961, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.10% (0.1892 => 0.2102, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 11.04% (1.5603 => 1.7325, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 11.01% (0.6456 => 0.7167, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.94% (0.2266 => 0.2514, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 10.90% (2.2969 => 2.5473, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: 10.90% (0.3092 => 0.3429, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.37% (0.8101 => 0.8941, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.15% (0.1044 => 0.1150, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 9.82% (21.9371 => 24.0907, std.dev.: 0.0192) SingleSource/Benchmarks/Shootout-C++/hash: 9.70% (0.4289 => 0.4705, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 9.65% (0.4620 => 0.5066, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.30% (0.4636 => 0.5067, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.28% (0.3826 => 0.4181, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.21% (0.3865 => 0.4221, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 9.12% (0.3422 => 0.3734, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.04% (0.4103 => 0.4474, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.04% (0.4203 => 0.4583, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.84% (0.3427 => 0.3730, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 8.82% (0.4048 => 0.4405, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.64% (0.2430 => 0.2640, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists1: 8.52% (0.3684 => 0.3998, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 8.51% (17.1811 => 18.6431, std.dev.: 0.0141) SingleSource/UnitTests/ObjC++/property-reference-object: 8.26% (0.6030 => 0.6528, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.12% (0.5925 => 0.6406, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.02% (3.8922 => 4.2045, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.86% (14.3668 => 15.4954, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/sieve: 7.85% (0.3603 => 0.3886, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.56% (0.3650 => 0.3926, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.55% (0.4064 => 0.4371, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference: 7.53% (0.7326 => 0.7878, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 7.26% (0.3098 => 0.3323, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.08% (0.3162 => 0.3386, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.95% (0.2891 => 0.3092, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: 6.92% (0.2831 => 0.3027, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.88% (0.3283 => 0.3509, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.85% (0.2905 => 0.3104, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.81% (0.3232 => 0.3452, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.79% (2.0665 => 2.2069, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.79% (0.3136 => 0.3349, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.70% (0.2793 => 0.2980, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.69% (0.3379 => 0.3605, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.62% (0.2871 => 0.3061, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.55% (0.2872 => 0.3060, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.49% (0.2756 => 0.2935, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.49% (0.3052 => 0.3250, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/methcall: 6.47% (0.2877 => 0.3063, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.46% (0.2725 => 0.2901, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.41% (0.2714 => 0.2888, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.32% (0.2802 => 0.2979, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 6.17% (1.2842 => 1.3634, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/objinst: 5.43% (0.3131 => 0.3301, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.69% (0.3817 => 0.3958, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.99% (1.1194 => 1.1529, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.57% (0.3935 => 0.4036, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1725, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.22% (0.9957 => 1.1273, std.dev.: 0.0106) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.79% (1.1396 => 1.2512, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: 5.91% (1.9405 => 2.0552, std.dev.: 0.0007) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625) SingleSource/Benchmarks/Shootout-C++/hash2: 4.67% (3.1578 => 3.3054, std.dev.: 0.0064) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.61% (0.3987 => 0.4091, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.45% (4.2280 => 4.3316, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.92% (3.6395 => 3.7095, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/bisort/bisort: 1.78% (0.8333 => 0.8481, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.64% (2.6546 => 2.6982, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 1.56% (0.7455 => 0.7571, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2077, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 1.16% (4.4649 => 4.5166, std.dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.01% (6.6874 => 0.1334, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -79.86% (0.8651 => 0.1742, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.75% (5.2763 => 3.2318, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.74% (5.3855 => 3.7300, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.29% (5.3526 => 3.7312, std.dev.: 0.0038) SingleSource/UnitTests/Vector/constpool: -14.70% (54.1659 => 46.2030, std.dev.: 0.0395) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.45% (2.9384 => 2.6312, std.dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: -6.48% (22.1758 => 20.7395, std.dev.: 0.0153) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.09% (8.0499 => 3.7761, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.45% (1.1492 => 0.7648, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.66% (2.9695 => 2.4749, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.87% (1.6925 => 1.4239, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.70% (1.2258 => 1.0701, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.76% (1.2373 => 1.0918, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/mandel-2: -10.96% (1.5373 => 1.3688, std.dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.30% (19.9488 => 18.2937, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/mason/mason: -7.68% (0.2161 => 0.1995, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.97% (1.8329 => 1.7052, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.40% (2.7294 => 2.5546, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.24% (1.6805 => 1.5756, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0148) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5080, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.13% (8.1563 => 7.8192, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Applications/siod/siod: -3.55% (3.2827 => 3.1661, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8776, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.06% (32.5116 => 31.5153, std.dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.58% (0.4808 => 0.4684, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.88% (10.2830 => 10.0894, std.dev.: 0.0064) SingleSource/UnitTests/Vector/multiplies: -1.77% (2.5528 => 2.5075, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: -1.75% (4.6441 => 4.5628, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6828, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4206, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2879, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2355, std.dev.: 0.0077) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 19.43% (0.5229 => 0.6245, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 15.10% (14.9895 => 17.2533, std.dev.: 0.0127) MultiSource/Applications/kimwitu++/kc: 10.68% (14.1553 => 15.6669, std.dev.: 0.0227) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 34.89% (1.1048 => 1.4903, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.79% (7.1582 => 8.2170, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.45% (0.6222 => 0.6872, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.23% (0.1485 => 0.1437, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.85% (0.2116 => 0.2134, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 21 22:08:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 22 Oct 2012 00:08:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121022050839.2416B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5089?compare_to=5085&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5089, Order: 166407, Start Time: 2012-10-22 03:45:43, End Time: 2012-10-22 05:11:41 To: 5085, Order: 166406, Start Time: 2012-10-22 01:34:34, End Time: 2012-10-22 03:00:35 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (198 on baseline) Performance Improvements: 2 (40 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1038 (666 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 5.95% (0.4000 => 0.4238, std.dev.: 0.0047) MultiSource/Applications/oggenc/oggenc: 1.25% (5.0114 => 5.0741, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash2: -3.22% (3.4140 => 3.3042, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.11% (10.0357 => 9.9241, std.dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.99% (2.0176 => 2.5017, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.35% (0.1410 => 0.1711, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 18.64% (0.0826 => 0.0980, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 18.10% (0.2243 => 0.2649, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 17.57% (0.1013 => 0.1191, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.02% (0.0746 => 0.0873, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.86% (0.7710 => 0.9010, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.75% (0.0770 => 0.0899, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.69% (0.0653 => 0.0762, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.51% (0.0819 => 0.0946, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.14% (0.2596 => 0.2989, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 15.07% (0.2721 => 0.3131, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.72% (0.1413 => 0.1621, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.63% (0.0834 => 0.0956, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.55% (0.0811 => 0.0929, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.52% (0.0847 => 0.0970, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.37% (0.9199 => 1.0521, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 14.35% (1.3693 => 1.5658, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 14.26% (0.1003 => 0.1146, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.24% (0.1327 => 0.1516, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.21% (0.0725 => 0.0828, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.90% (0.1986 => 0.2262, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.89% (0.0720 => 0.0820, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.89% (3.9660 => 4.5167, std.dev.: 0.0317) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.84% (0.5637 => 0.6417, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.81% (0.6959 => 0.7920, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.80% (0.0964 => 0.1097, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.79% (0.1588 => 0.1807, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.77% (0.1075 => 0.1223, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 13.70% (0.7038 => 0.8002, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.69% (0.5265 => 0.5986, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 13.63% (0.7460 => 0.8477, std.dev.: 0.0099) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.62% (0.1072 => 0.1218, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 13.59% (0.1111 => 0.1262, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.59% (0.2914 => 0.3310, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 13.47% (0.1062 => 0.1205, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.29% (0.6283 => 0.7118, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.17% (0.1276 => 0.1444, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.00% (0.0977 => 0.1104, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 13.00% (0.4062 => 0.4590, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 12.96% (0.4328 => 0.4889, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.82% (0.1014 => 0.1144, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.78% (0.5577 => 0.6290, std.dev.: 0.0057) MultiSource/Applications/Burg/burg: 12.78% (1.1061 => 1.2475, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.73% (1.4563 => 1.6417, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/distray/distray: 12.71% (0.0818 => 0.0922, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.69% (1.2193 => 1.3740, std.dev.: 0.0026) MultiSource/Applications/viterbi/viterbi: 12.65% (0.1478 => 0.1665, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.48% (1.1364 => 1.2782, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 12.47% (13.8202 => 15.5434, std.dev.: 0.0175) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.46% (0.2023 => 0.2275, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.28% (0.1865 => 0.2094, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.20% (0.3246 => 0.3642, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.10% (0.4379 => 0.4909, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.08% (0.2127 => 0.2384, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 12.05% (0.2995 => 0.3356, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.02% (0.1048 => 0.1174, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.01% (0.1157 => 0.1296, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 12.01% (0.1657 => 0.1856, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 11.99% (0.7506 => 0.8406, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.80% (0.3899 => 0.4359, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 11.73% (3.8646 => 4.3180, std.dev.: 0.0642) MultiSource/Benchmarks/McCat/09-vor/vor: 11.73% (0.2925 => 0.3268, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 11.73% (0.7061 => 0.7889, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.63% (0.3130 => 0.3494, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.63% (0.4791 => 0.5348, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 11.61% (0.3220 => 0.3594, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: 11.52% (0.5818 => 0.6488, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.40% (0.1789 => 0.1993, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 11.33% (0.1589 => 0.1769, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 11.33% (0.5748 => 0.6399, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.32% (0.3022 => 0.3364, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 11.30% (1.0313 => 1.1478, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.29% (0.1435 => 0.1597, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.28% (0.3485 => 0.3878, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.21% (0.4016 => 0.4466, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 11.15% (0.2781 => 0.3091, std.dev.: 0.0051) MultiSource/Applications/treecc/treecc: 11.12% (1.9270 => 2.1412, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists: 11.05% (0.3293 => 0.3657, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.00% (0.2782 => 0.3088, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.98% (7.2180 => 8.0107, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.96% (0.4390 => 0.4871, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.89% (0.3756 => 0.4165, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: 10.88% (0.1213 => 0.1345, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 10.85% (0.6744 => 0.7476, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/moments: 10.83% (0.3868 => 0.4287, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.81% (0.3489 => 0.3866, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.77% (0.1569 => 0.1738, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 10.76% (0.2761 => 0.3058, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 10.73% (0.8310 => 0.9202, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 10.69% (0.3453 => 0.3822, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.66% (1.9828 => 2.1942, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.65% (0.2966 => 0.3282, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.64% (0.3580 => 0.3961, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 10.60% (0.2726 => 0.3015, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 10.54% (0.2760 => 0.3051, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 10.53% (3.1889 => 3.5246, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 10.52% (2.1791 => 2.4083, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.49% (0.8698 => 0.9610, std.dev.: 0.0019) MultiSource/Applications/kimwitu++/kc: 10.48% (16.6129 => 18.3535, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/hello: 10.47% (0.2607 => 0.2880, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 10.47% (0.3534 => 0.3904, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 10.43% (0.3107 => 0.3431, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.41% (1.3245 => 1.4624, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/random: 10.41% (0.2690 => 0.2970, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.36% (0.2655 => 0.2930, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.35% (0.0976 => 0.1077, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 10.32% (0.3149 => 0.3474, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 10.28% (0.2937 => 0.3239, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.27% (0.2765 => 0.3049, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/fibo: 10.24% (0.2628 => 0.2897, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 10.21% (3.6692 => 4.0439, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/05-eks/eks: 10.19% (0.4113 => 0.4532, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 10.06% (0.3192 => 0.3513, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 10.04% (0.2988 => 0.3288, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.96% (4.3801 => 4.8162, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.93% (4.4433 => 4.8845, std.dev.: 0.0060) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.91% (0.2140 => 0.2352, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.90% (0.2696 => 0.2963, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.68% (0.1819 => 0.1995, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.67% (0.6135 => 0.6728, std.dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 9.66% (1.0594 => 1.1617, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 9.64% (0.2945 => 0.3229, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.58% (4.9865 => 5.4644, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.56% (0.3755 => 0.4114, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.35% (0.2321 => 0.2538, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 9.30% (14.8535 => 16.2351, std.dev.: 0.0118) MultiSource/Benchmarks/sim/sim: 9.20% (0.3131 => 0.3419, std.dev.: 0.0035) MultiSource/Applications/SIBsim4/SIBsim4: 9.19% (1.2749 => 1.3921, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.16% (0.8818 => 0.9626, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 9.04% (8.4961 => 9.2645, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.82% (1.5188 => 1.6528, std.dev.: 0.0050) MultiSource/Applications/oggenc/oggenc: 8.82% (4.6629 => 5.0741, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.73% (0.6576 => 0.7150, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.72% (1.1333 => 1.2321, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 8.59% (0.6250 => 0.6787, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 8.51% (3.7467 => 4.0655, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.50% (3.2742 => 3.5526, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/parameter-passing: 8.24% (0.4003 => 0.4333, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.23% (0.3511 => 0.3800, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 8.18% (6.5754 => 7.1135, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/oourafft: 8.17% (0.2008 => 0.2172, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.15% (0.3914 => 0.4233, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.10% (0.3245 => 0.3508, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.03% (0.4805 => 0.5191, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.97% (6.2785 => 6.7787, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/property: 7.92% (0.3940 => 0.4252, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.91% (0.3578 => 0.3861, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.86% (0.3789 => 0.4087, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.85% (2.1007 => 2.2657, std.dev.: 0.0181) SingleSource/UnitTests/ObjC/exceptions-4: 7.84% (0.3646 => 0.3932, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.83% (0.3601 => 0.3883, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 7.81% (1.2292 => 1.3252, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 7.81% (0.3663 => 0.3949, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.67% (0.3650 => 0.3930, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.62% (0.3623 => 0.3899, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.45% (0.2243 => 0.2410, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.18% (13.2842 => 14.2381, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/ReedSolomon: 6.08% (0.1777 => 0.1885, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 5.36% (16.2614 => 17.1332, std.dev.: 0.0270) MultiSource/Applications/ClamAV/clamscan: 5.17% (14.5298 => 15.2806, std.dev.: 0.0123) MultiSource/Benchmarks/Olden/bh/bh: 3.99% (0.2859 => 0.2973, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 2.51% (33.2944 => 34.1292, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.91% (0.4846 => 0.6974, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5150, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/fbench: 24.42% (1.8175 => 2.2613, std.dev.: 0.0322) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.01% (1.0895 => 1.2748, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 11.07% (1.1560 => 1.2840, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.01% (0.8273 => 0.9018, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.43% (0.9692 => 1.0218) SingleSource/Benchmarks/Misc/mandel-2: 5.29% (1.2998 => 1.3685, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.76% (1.9144 => 2.0055, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.45% (2.8606 => 2.9879, std.dev.: 0.0021) SingleSource/Regression/C/uint64_to_float: 4.37% (0.5449 => 0.5687, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 4.12% (3.1736 => 3.3042, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7747, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9860, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 3.37% (12.0921 => 12.4999, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 3.28% (10.7476 => 11.1006, std.dev.: 0.0053) MultiSource/Benchmarks/nbench/nbench: 3.20% (11.2619 => 11.6227, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bisort/bisort: 3.00% (0.8239 => 0.8486, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.40% (1.0310 => 1.0557, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.12% (7.4271 => 7.5847, std.dev.: 0.0064) MultiSource/Applications/lemon/lemon: 1.84% (1.4298 => 1.4561, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5140, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1868, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 1.19% (5.5130 => 5.5784, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 1.06% (12.4560 => 12.5879, std.dev.: 0.0061) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.48% (0.2670 => 0.1429, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.37% (0.4657 => 0.3941, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.58% (1.3813 => 1.2213, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.53% (1.3819 => 1.2225, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.27% (1.0460 => 0.8549, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/mason/mason: -13.00% (0.2238 => 0.1947, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.12% (20.3410 => 18.2831, std.dev.: 0.0190) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.34% (1.3780 => 1.2907, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -5.73% (1.2308 => 1.1603, std.dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3741, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.05% (2.6470 => 2.5133, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.70% (0.9996 => 0.9526, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9653, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.40% (1.7688 => 1.7086, std.dev.: 0.0014) MultiSource/Applications/siod/siod: -3.07% (3.2729 => 3.1724, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.74% (1.9762 => 1.9221, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8812, std.dev.: 0.0034) MultiSource/Applications/spiff/spiff: -2.59% (3.0263 => 2.9478, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.37% (4.1080 => 4.0106, std.dev.: 0.0031) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) MultiSource/Benchmarks/mafft/pairlocalalign: -1.99% (28.2225 => 27.6619, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.91% (0.6589 => 0.6463, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.87% (0.6615 => 0.6491, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.75% (6.3560 => 6.2447, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.67% (0.8342 => 0.8203, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.62% (2.5254 => 2.4845, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -1.49% (26.5159 => 26.1219, std.dev.: 0.0327) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0064, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8661, std.dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: -1.28% (5.3167 => 5.2487, std.dev.: 0.0023) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1140, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -1.05% (84.4286 => 83.5429, std.dev.: 0.0065) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.02% (6.6320 => 6.5646, std.dev.: 0.0081) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 21 23:36:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 22 Oct 2012 01:36:42 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121022063642.4EC842A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5090?compare_to=5087&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5090, Order: 166409, Start Time: 2012-10-22 05:15:30, End Time: 2012-10-22 06:38:46 To: 5087, Order: 166407, Start Time: 2012-10-22 03:34:13, End Time: 2012-10-22 04:58:10 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 4 (16 on baseline) Performance Improvements: 6 (6 on baseline) Existing Failures: 68 (67 on baseline) Unchanged Tests: 964 (951 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 6.77% (0.1507 => 0.1609, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.33% (0.3194 => 0.3460, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.48% (2.5090 => 2.5712, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout/methcall: 2.19% (8.0838 => 8.2605, std.dev.: 0.0116) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -2.36% (0.8214 => 0.8020, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.93% (1.1987 => 1.1756, std.dev.: 0.0090) MultiSource/Applications/lambda-0_1_3/lambda: -1.67% (0.7651 => 0.7523, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.41% (0.8509 => 0.8389, std.dev.: 0.0017) MultiSource/Applications/hbd/hbd: -1.14% (1.4688 => 1.4521, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/ffbench: -1.11% (1.4296 => 1.4138, std.dev.: 0.0039) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.29% (16.4226 => 16.4697, std.dev.: 0.1927) MultiSource/Applications/obsequi/Obsequi: 0.86% (1.0361 => 1.0450, std.dev.: 0.0112) MultiSource/Applications/sqlite3/sqlite3: 0.05% (0.6370 => 0.6373, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: -0.11% (0.1899 => 0.1897, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 6.84% (0.1579 => 0.1687, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.78% (0.3164 => 0.3252, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.02% (0.2463 => 0.2438, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.87% (0.3330 => 0.3301, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.09% (0.2376 => 0.2402, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: -0.30% (0.5959 => 0.5941, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/mandel: -0.81% (0.0491 => 0.0487, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.43% (0.3267 => 0.3281, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: -0.25% (0.1987 => 0.1982, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.98% (0.0238 => 0.0257, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.94% (0.0212 => 0.0210, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.48% (0.0417 => 0.0419, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.93% (0.0323 => 0.0326, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 18.08% (0.0260 => 0.0307, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.72% (0.0414 => 0.0417, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0197 => 0.0197, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -17.70% (0.0209 => 0.0172, std.dev.: 0.0019) SingleSource/UnitTests/byval-alignment: 1.54% (0.0324 => 0.0329, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.14% (0.1471 => 0.1473, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -1.21% (8.3001 => 8.1998, std.dev.: 0.1497) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -2.95% (1.1480 => 1.1141, std.dev.: 0.0145) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -4.36% (0.1491 => 0.1426, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.48% (0.4033 => 0.4133, std.dev.: 0.0740) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.48% (0.1369 => 0.1403, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.73% (0.0594 => 0.0634, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.00% (0.0225 => 0.0243, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.53% (0.0571 => 0.0528, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.41% (1.1419 => 1.1466, std.dev.: 0.0477) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -10.00% (0.0020 => 0.0018, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -75.00% (0.0004 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.64% (0.0616 => 0.0532, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.68% (0.0238 => 0.0234, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.46% (0.7969 => 0.8006, std.dev.: 0.0220) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 100.00% (0.0001 => 0.0002, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -10.68% (0.0103 => 0.0092, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/SPASS/SPASS MultiSource/Applications/SPASS/SPASS: -2.76% (8.4326 => 8.1998, std.dev.: 0.1497) New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.91% (2.1832 => 1.6612, std.dev.: 0.0044) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.20% (0.0810 => 0.0925, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.01% (0.2180 => 0.2311, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.25% (0.8611 => 0.8805, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.95% (0.9435 => 0.9619, std.dev.: 0.0020) MultiSource/Applications/hbd/hbd: 1.77% (1.4269 => 1.4521, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.52% (6.6074 => 6.7078, std.dev.: 0.0182) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.34% (1.5795 => 2.5010, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.60% (0.3186 => 0.3460, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.43% (1.1857 => 1.2856, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 5.99% (63.1822 => 66.9658, std.dev.: 0.0270) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.62% (0.7597 => 0.7872, std.dev.: 0.0082) MultiSource/Applications/siod/siod: 2.47% (3.6643 => 3.7548, std.dev.: 0.0199) SingleSource/Benchmarks/Misc/ReedSolomon: 2.10% (8.5322 => 8.7115, std.dev.: 0.0301) MultiSource/Benchmarks/Olden/bh/bh: 1.84% (2.3560 => 2.3993, std.dev.: 0.0051) MultiSource/Applications/minisat/minisat: 1.54% (6.1525 => 6.2474, std.dev.: 0.0197) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.29% (1.1365 => 1.1512, std.dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.57% (0.3269 => 0.2956, std.dev.: 0.0035) MultiSource/Applications/lua/lua: -3.92% (29.8330 => 28.6629, std.dev.: 0.1585) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.42% (3.3479 => 3.3003, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/functionobjects: -1.12% (3.7781 => 3.7356, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/ffbench: -1.11% (1.4296 => 1.4138, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash2: -1.10% (3.4237 => 3.3862, std.dev.: 0.0136) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.14% (16.4461 => 16.4697, std.dev.: 0.1927) MultiSource/Applications/obsequi/Obsequi: 1.83% (1.0262 => 1.0450, std.dev.: 0.0112) MultiSource/Applications/sqlite3/sqlite3: 0.65% (0.6332 => 0.6373, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: 3.60% (0.1831 => 0.1897, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 8.21% (0.1559 => 0.1687, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.13% (0.3123 => 0.3252, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.02% (0.2463 => 0.2438, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (0.3344 => 0.3301, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.61% (0.2364 => 0.2402, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: -1.15% (0.6010 => 0.5941, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/mandel: 13.52% (0.0429 => 0.0487, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.46% (0.3266 => 0.3281, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: 0.66% (0.1969 => 0.1982, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 14.73% (0.0224 => 0.0257, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 70.73% (0.0123 => 0.0210, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.70% (0.0408 => 0.0419, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 28.35% (0.0254 => 0.0326, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.66% (0.0302 => 0.0307, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 8.59% (0.0384 => 0.0417, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: 3.68% (0.0190 => 0.0197, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -4.44% (0.0180 => 0.0172, std.dev.: 0.0019) SingleSource/UnitTests/byval-alignment: 43.04% (0.0230 => 0.0329, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.43% (0.1438 => 0.1473, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.66% (1.1329 => 1.1141, std.dev.: 0.0145) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -2.46% (0.1462 => 0.1426, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.74% (0.4164 => 0.4133, std.dev.: 0.0740) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.48% (0.1369 => 0.1403, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.09% (0.0641 => 0.0634, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 24.62% (0.0195 => 0.0243, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.65% (0.0578 => 0.0528, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.25% (1.1437 => 1.1466, std.dev.: 0.0477) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1700.00% (0.0001 => 0.0018, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -15.15% (0.0627 => 0.0532, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 30.00% (0.0180 => 0.0234, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.14% (0.8017 => 0.8006, std.dev.: 0.0220) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 100.00% (0.0001 => 0.0002, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 48.39% (0.0062 => 0.0092, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 21 23:52:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 22 Oct 2012 01:52:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121022065220.9F4472A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5091?compare_to=5088&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5091, Order: 166410, Start Time: 2012-10-22 05:34:23, End Time: 2012-10-22 06:54:21 To: 5088, Order: 166407, Start Time: 2012-10-22 03:44:17, End Time: 2012-10-22 05:04:17 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (5 on baseline) Performance Regressions: 1 (194 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 88 (14 on baseline) Unchanged Tests: 953 (648 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.01% (1.2922 => 1.3052, std.dev.: 0.0040) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.02% (0.6245 => 0.6244, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: -0.01% (17.2533 => 17.2509, std.dev.: 0.0025) MultiSource/Applications/kimwitu++/kc: -0.09% (15.6669 => 15.6528, std.dev.: 0.0185) MultiSource/Benchmarks/Bullet/bullet: -0.06% (56.2468 => 56.2115, std.dev.: 0.0207) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.21% (0.0480 => 0.0481, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0481 => 0.0481, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0450 => 0.0450, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0451 => 0.0451) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0439 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0441 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.23% (0.0434 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.23% (0.0434 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0451 => 0.0451) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.66% (0.0455 => 0.0452, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.22% (0.0445 => 0.0446) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0446 => 0.0446, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0436 => 0.0436) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.23% (0.0437 => 0.0438) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0443 => 0.0443) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0444 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0454 => 0.0454) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.21% (0.0475 => 0.0455, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0431 => 0.0431) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.23% (0.0432 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0443 => 0.0443) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0444 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0434 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0435 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0426 => 0.0426) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0427 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.24% (0.0424 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.23% (0.0426 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0462 => 0.0462, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0462 => 0.0462, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0424 => 0.0424, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0425 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0425 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.24% (0.0425 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.23% (0.0433 => 0.0432, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0434 => 0.0434) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.11% (1.4903 => 1.4886, std.dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.02% (8.2170 => 8.2151, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.04% (0.6872 => 0.6869, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1437 => 0.1436, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.2134 => 0.2134, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.12% (63.2438 => 56.2115, std.dev.: 0.0207) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/MallocBench/gs/gs: 12.95% (4.1105 => 4.6430, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.40% (3.4629 => 5.7969, std.dev.: 0.0029) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13498.06% (0.0720 => 9.7906, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9945600.00% (0.0001 => 9.9457, std.dev.: 0.0013) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 57.79% (0.2554 => 0.4030, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: 56.25% (0.0256 => 0.0400, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 50.96% (10.3673 => 15.6507, std.dev.: 0.0111) SingleSource/UnitTests/SignlessTypes/factor: 45.95% (0.0296 => 0.0432, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 42.44% (0.0271 => 0.0386, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.28% (1.5859 => 2.2406, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 38.04% (0.1622 => 0.2239, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/distray/distray: 36.08% (0.1056 => 0.1437, std.dev.: 0.0003) SingleSource/UnitTests/vla: 32.39% (0.0355 => 0.0470, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.05% (2.2024 => 2.8643, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/neural/neural: 25.97% (0.1463 => 0.1843, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 25.30% (0.0834 => 0.1045, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.95% (0.1566 => 0.1894, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 20.35% (0.2049 => 0.2466, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 19.55% (0.1432 => 0.1712, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.30% (7.0540 => 8.4155, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.63% (2.2022 => 2.6124, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.46% (0.6675 => 0.7907, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.25% (0.0871 => 0.1030, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.81% (0.5105 => 0.6014, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 17.75% (0.1555 => 0.1831, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/chomp: 16.80% (0.1655 => 0.1933, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.38% (1.3050 => 1.5187, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.32% (0.4615 => 0.5368, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout/lists: 16.29% (0.0626 => 0.0728, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 16.23% (3.3354 => 3.8768, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/em3d/em3d: 15.81% (0.1695 => 0.1963, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 15.76% (0.1440 => 0.1667, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 15.76% (0.0793 => 0.0918, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 15.68% (0.2271 => 0.2627, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.60% (0.1032 => 0.1193) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.56% (0.1337 => 0.1545, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 15.40% (0.1175 => 0.1356, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.34% (0.5020 => 0.5790, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 15.31% (0.1163 => 0.1341, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 15.30% (0.3282 => 0.3784, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.08% (1.5415 => 1.7739, std.dev.: 0.0096) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.03% (0.1510 => 0.1737, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 14.98% (0.8172 => 0.9396, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.90% (0.0886 => 0.1018) MultiSource/Applications/minisat/minisat: 14.90% (0.7115 => 0.8175, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 14.76% (0.3109 => 0.3568, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.74% (0.1940 => 0.2226, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.71% (0.1584 => 0.1817, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.49% (0.0842 => 0.0964, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.42% (1.7609 => 2.0149, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.34% (0.0746 => 0.0853, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.32% (4.2646 => 4.8754, std.dev.: 0.0135) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.26% (0.3121 => 0.3566, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/18-imp/imp: 14.26% (0.3423 => 0.3911, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/exptree: 14.25% (0.0814 => 0.0930, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.25% (0.0730 => 0.0834, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.20% (0.0838 => 0.0957, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 14.16% (0.1151 => 0.1314, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 14.16% (1.1642 => 1.3290, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.12% (0.9765 => 1.1144, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 14.00% (10.4361 => 11.8967, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout/matrix: 13.94% (0.0818 => 0.0932, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.82% (0.1143 => 0.1301, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 13.81% (5.7591 => 6.5547, std.dev.: 0.0119) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.76% (0.2107 => 0.2397, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 13.76% (9.4845 => 10.7892, std.dev.: 0.0154) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.70% (0.1117 => 0.1270) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 13.69% (0.6450 => 0.7333, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.57% (0.5860 => 0.6655, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.51% (0.1695 => 0.1924, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 13.45% (0.7835 => 0.8889, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.45% (0.2758 => 0.3129, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.41% (1.4186 => 1.6089, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.38% (0.0770 => 0.0873, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.35% (0.1438 => 0.1630, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.33% (0.1906 => 0.2160, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.32% (8.1363 => 9.2203, std.dev.: 0.0099) MultiSource/Applications/treecc/treecc: 13.21% (2.0273 => 2.2952, std.dev.: 0.0059) MultiSource/Applications/lambda-0_1_3/lambda: 13.18% (0.7433 => 0.8413, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.17% (0.2065 => 0.2337, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.05% (0.1625 => 0.1837, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 12.93% (1.1840 => 1.3371, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.93% (0.1029 => 0.1162, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.92% (0.0929 => 0.1049, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.90% (0.1062 => 0.1199, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.85% (0.2700 => 0.3047, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.78% (0.0798 => 0.0900, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.75% (0.0933 => 0.1052, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 12.64% (1.0722 => 1.2077, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.64% (4.9449 => 5.5697, std.dev.: 0.0037) MultiSource/Applications/lua/lua: 12.60% (3.8723 => 4.3601, std.dev.: 0.0025) SingleSource/UnitTests/SignlessTypes/rem: 12.59% (0.1144 => 0.1288, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 12.58% (0.4299 => 0.4840, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.57% (0.8067 => 0.9081, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.54% (0.4879 => 0.5491, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.54% (5.0018 => 5.6288, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.46% (0.5981 => 0.6726, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 12.28% (0.3387 => 0.3803, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.23% (0.5569 => 0.6250, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/health/health: 12.22% (0.1268 => 0.1423, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.16% (0.3307 => 0.3709, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.09% (1.1861 => 1.3295, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 12.06% (0.3177 => 0.3560, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.97% (0.3543 => 0.3967, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.95% (0.2603 => 0.2914, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.84% (7.9617 => 8.9043, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 11.84% (0.8921 => 0.9977, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.64% (0.1125 => 0.1256, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 11.64% (0.3180 => 0.3550, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 11.46% (0.3473 => 0.3871, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.46% (0.3927 => 0.4377, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.43% (0.3543 => 0.3948, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.39% (0.3441 => 0.3833, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 11.37% (0.3561 => 0.3966, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.35% (0.1330 => 0.1481, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.29% (0.3694 => 0.4111, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.27% (0.3497 => 0.3891, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.26% (0.3516 => 0.3912, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.21% (0.3828 => 0.4257, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.19% (0.3886 => 0.4321, std.dev.: 0.0031) MultiSource/Applications/hbd/hbd: 11.06% (1.5603 => 1.7328, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/bigfib: 10.98% (0.6456 => 0.7165, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.94% (0.1892 => 0.2099, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.90% (0.2266 => 0.2513, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 10.70% (2.2969 => 2.5427, std.dev.: 0.0184) MultiSource/Benchmarks/Olden/bh/bh: 10.61% (0.3092 => 0.3420, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.36% (0.8101 => 0.8940, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.06% (0.1044 => 0.1149, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 9.82% (0.4289 => 0.4710, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 9.78% (21.9371 => 24.0826, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/hash2: 9.65% (0.4620 => 0.5066, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.57% (0.3826 => 0.4192, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.26% (0.3865 => 0.4223, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.17% (0.4636 => 0.5061, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 9.03% (0.3422 => 0.3731, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.90% (0.4203 => 0.4577, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.90% (0.4103 => 0.4468, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.67% (0.3427 => 0.3724, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 8.66% (0.3684 => 0.4003, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 8.65% (0.4048 => 0.4398, std.dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: 8.43% (17.1811 => 18.6288, std.dev.: 0.0080) SingleSource/UnitTests/ObjC++/property-reference-object: 8.28% (0.6030 => 0.6529, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.10% (0.5925 => 0.6405, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.02% (0.2430 => 0.2625, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.92% (3.8922 => 4.2006, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/sieve: 7.91% (0.3603 => 0.3888, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.80% (14.3668 => 15.4867, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 7.66% (0.7326 => 0.7887, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.56% (0.3650 => 0.3926, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.41% (0.4064 => 0.4365, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 7.17% (0.3098 => 0.3320, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.12% (0.3162 => 0.3387, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.02% (0.2905 => 0.3109, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.02% (0.3136 => 0.3356, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.93% (0.3232 => 0.3456, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.92% (0.2831 => 0.3027, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.92% (0.2891 => 0.3091, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 6.88% (0.3283 => 0.3509, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.77% (2.0665 => 2.2065, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.70% (0.2793 => 0.2980, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 6.65% (0.2871 => 0.3062, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.62% (0.2872 => 0.3062, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.57% (0.2756 => 0.2937, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 6.53% (0.2877 => 0.3065, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.51% (0.3379 => 0.3599, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 6.49% (0.3052 => 0.3250, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.46% (0.2725 => 0.2901, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: 6.34% (0.2714 => 0.2886, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 6.25% (0.2802 => 0.2977, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 6.09% (1.2842 => 1.3624, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 5.59% (0.3131 => 0.3306, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.77% (0.3817 => 0.3961, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.98% (1.1194 => 1.1528, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.67% (0.3935 => 0.4040, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1725, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.24% (0.9957 => 1.1275, std.dev.: 0.0150) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2173, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.77% (1.1396 => 1.2509, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: 5.94% (1.9405 => 2.0557, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 5.12% (3.1578 => 3.3196, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.81% (4.2280 => 4.3466, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.66% (0.3987 => 0.4093, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.79% (0.8333 => 0.8482, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.68% (3.6395 => 3.7008, std.dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.55% (2.6546 => 2.6958, std.dev.: 0.0024) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2079, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 1.26% (4.4649 => 4.5211, std.dev.: 0.0022) MultiSource/Applications/minisat/minisat: 1.05% (9.1159 => 9.2114, std.dev.: 0.0078) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5753, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.01% (6.6874 => 0.1333, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -79.86% (0.8651 => 0.1742, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.85% (5.2763 => 3.2266, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.74% (5.3855 => 3.7299, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.31% (5.3526 => 3.7300, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -14.66% (54.1659 => 46.2252, std.dev.: 0.0358) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.48% (2.9384 => 2.6306, std.dev.: 0.0172) MultiSource/Applications/ClamAV/clamscan: -6.52% (22.1758 => 20.7307, std.dev.: 0.0234) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.08% (8.0499 => 3.7772, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.49% (1.1492 => 0.7643, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4752, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -16.06% (1.6925 => 1.4206, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.53% (0.0998 => 0.0853, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.67% (1.2258 => 1.0705, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.52% (1.2373 => 1.0948, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel-2: -10.56% (1.5373 => 1.3749, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.35% (19.9488 => 18.2837, std.dev.: 0.0689) MultiSource/Benchmarks/FreeBench/mason/mason: -7.73% (0.2161 => 0.1994, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.97% (1.8329 => 1.7052, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.41% (2.7294 => 2.5545, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.24% (1.6805 => 1.5757, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8483, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) SingleSource/Benchmarks/Misc/flops-5: -4.83% (1.5835 => 1.5070, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.27% (8.1563 => 7.8079, std.dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.53% (3.2827 => 3.1669, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8775, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.4995, std.dev.: 0.0055) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.62% (0.4808 => 0.4682, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.78% (10.2830 => 10.0997, std.dev.: 0.0142) MultiSource/Applications/sqlite3/sqlite3: -1.74% (4.6441 => 4.5634, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6815, std.dev.: 0.0015) SingleSource/UnitTests/Vector/multiplies: -1.67% (2.5528 => 2.5101, std.dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4206, std.dev.: 0.0079) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2878, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.09% (6.2999 => 6.2314, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 19.41% (0.5229 => 0.6244, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 15.09% (14.9895 => 17.2509, std.dev.: 0.0025) MultiSource/Applications/kimwitu++/kc: 10.58% (14.1553 => 15.6528, std.dev.: 0.0185) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 34.74% (1.1048 => 1.4886, std.dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.76% (7.1582 => 8.2151, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.40% (0.6222 => 0.6869, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.30% (0.1485 => 0.1436, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.85% (0.2116 => 0.2134, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 22 00:05:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 22 Oct 2012 02:05:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121022070551.34D292A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5092?compare_to=5089&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5092, Order: 166410, Start Time: 2012-10-22 05:40:59, End Time: 2012-10-22 07:08:51 To: 5089, Order: 166407, Start Time: 2012-10-22 03:45:43, End Time: 2012-10-22 05:11:41 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (199 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1040 (666 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.07% (7.9616 => 8.0466, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -1.13% (3.7298 => 3.6876, std.dev.: 0.0083) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.13% (2.0176 => 2.5044, std.dev.: 0.0378) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.56% (0.1410 => 0.1714, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 18.52% (0.0826 => 0.0979, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 18.10% (0.2243 => 0.2649, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 17.67% (0.1013 => 0.1192, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.02% (0.0746 => 0.0873, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.55% (0.7710 => 0.8986, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.54% (0.0653 => 0.0761, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.06% (0.2596 => 0.2987, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.02% (0.0819 => 0.0942, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.75% (0.0834 => 0.0957, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 14.74% (0.2721 => 0.3122, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.72% (0.1413 => 0.1621, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.67% (0.0811 => 0.0930, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 14.46% (0.1003 => 0.1148, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 14.37% (1.3693 => 1.5660, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.35% (0.9199 => 1.0519, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.34% (0.0725 => 0.0829, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.34% (0.6959 => 0.7957, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.29% (0.0847 => 0.0968, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.24% (0.1327 => 0.1516, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.17% (0.0720 => 0.0822, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 14.11% (0.5265 => 0.6008, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.98% (0.5637 => 0.6425, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.95% (0.1986 => 0.2263, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.77% (0.1075 => 0.1223, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.75% (3.9660 => 4.5112, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.69% (0.0964 => 0.1096, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 13.68% (0.1111 => 0.1263, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.66% (0.1588 => 0.1805, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 13.57% (0.7038 => 0.7993, std.dev.: 0.0018) MultiSource/Applications/aha/aha: 13.47% (0.1062 => 0.1205, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.43% (0.1072 => 0.1216, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.38% (0.2914 => 0.3304, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 13.35% (0.7460 => 0.8456, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.21% (0.6283 => 0.7113, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.20% (0.0977 => 0.1106, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.17% (0.1276 => 0.1444, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 12.86% (0.1478 => 0.1668, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: 12.83% (0.4062 => 0.4583, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.82% (0.1014 => 0.1144, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 12.74% (1.1061 => 1.2470, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.71% (0.5577 => 0.6286, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 12.71% (0.4328 => 0.4878, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/distray/distray: 12.59% (0.0818 => 0.0921, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.55% (1.2193 => 1.3723, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.53% (1.4563 => 1.6388, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.43% (1.1364 => 1.2776, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 12.38% (13.8202 => 15.5305, std.dev.: 0.0162) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.33% (0.1865 => 0.2095, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.31% (0.2023 => 0.2272, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.17% (0.3246 => 0.3641, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.08% (0.4379 => 0.4908, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 12.07% (0.1657 => 0.1857, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.04% (0.2127 => 0.2383, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 12.02% (0.7506 => 0.8408, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 11.91% (3.8646 => 4.3250, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.85% (0.3130 => 0.3501, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.84% (0.1157 => 0.1294, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.80% (0.3899 => 0.4359, std.dev.: 0.0142) MultiSource/Applications/sgefa/sgefa: 11.72% (0.2995 => 0.3346, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 11.53% (0.5818 => 0.6489, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.52% (0.4791 => 0.5343, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 11.50% (0.7061 => 0.7873, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 11.38% (0.2925 => 0.3258, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.36% (0.1435 => 0.1598, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.35% (0.1789 => 0.1992, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 11.29% (0.5748 => 0.6397, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.26% (0.1048 => 0.1166, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 11.24% (1.0313 => 1.1472, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 11.21% (0.3220 => 0.3581, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.15% (0.3022 => 0.3359, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.08% (0.3485 => 0.3871, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.06% (0.4016 => 0.4460) MultiSource/Applications/treecc/treecc: 11.05% (1.9270 => 2.1399, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: 11.05% (0.1213 => 0.1347, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 11.01% (0.1589 => 0.1764, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.96% (7.2180 => 8.0089, std.dev.: 0.0069) SingleSource/Regression/C++/ofstream_ctor: 10.93% (0.2781 => 0.3085, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.84% (0.4390 => 0.4866, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 10.84% (0.3293 => 0.3650, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 10.78% (0.6744 => 0.7471, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.76% (0.3756 => 0.4160, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.75% (0.2782 => 0.3081, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 10.65% (0.8310 => 0.9195, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.60% (0.3489 => 0.3859, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/moments: 10.55% (0.3868 => 0.4276, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/sieve: 10.54% (0.3453 => 0.3817, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 10.54% (0.2761 => 0.3052, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.52% (0.1569 => 0.1734, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 10.49% (16.6129 => 18.3556, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.49% (1.3245 => 1.4634, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 10.48% (3.1889 => 3.5232, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/except: 10.47% (0.2760 => 0.3049, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.42% (0.2966 => 0.3275, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.40% (1.9828 => 2.1890, std.dev.: 0.0729) SingleSource/Benchmarks/Shootout-C++/hello: 10.40% (0.2607 => 0.2878, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 10.38% (0.2726 => 0.3009, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 10.37% (0.2690 => 0.2969, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.36% (0.3580 => 0.3951, std.dev.: 0.0086) MultiSource/Applications/siod/siod: 10.31% (2.1791 => 2.4038, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.29% (0.8698 => 0.9593, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.24% (0.2655 => 0.2927, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 10.24% (0.3534 => 0.3896, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 10.23% (0.3149 => 0.3471, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 10.21% (0.2937 => 0.3237, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 10.12% (0.3192 => 0.3515, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 10.11% (0.3107 => 0.3421, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.09% (0.2765 => 0.3044, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.05% (0.2140 => 0.2355, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 10.05% (0.2628 => 0.2892, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 10.02% (3.6692 => 4.0370, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/05-eks/eks: 9.99% (0.4113 => 0.4524, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.98% (0.2696 => 0.2965, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.94% (4.4433 => 4.8848, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.89% (4.3801 => 4.8135, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: 9.84% (0.2988 => 0.3282, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.60% (4.9865 => 5.4654, std.dev.: 0.0132) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.60% (0.6135 => 0.6724, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 9.51% (0.2945 => 0.3225) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.48% (0.3755 => 0.4111, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.46% (0.1819 => 0.1991, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.35% (0.2321 => 0.2538, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 9.33% (1.2749 => 1.3938, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 9.28% (1.0594 => 1.1577, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 9.16% (14.8535 => 16.2142, std.dev.: 0.0152) MultiSource/Benchmarks/sim/sim: 8.97% (0.3131 => 0.3412, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 8.81% (8.4961 => 9.2447, std.dev.: 0.1890) MultiSource/Applications/oggenc/oggenc: 8.74% (4.6629 => 5.0706, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.74% (0.8818 => 0.9589, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.66% (1.1333 => 1.2314, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.61% (0.6576 => 0.7142, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.61% (1.5188 => 1.6495, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 8.58% (0.6250 => 0.6786, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.53% (0.9108 => 0.9885, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 8.45% (0.1385 => 0.1502, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.44% (3.2742 => 3.5507, std.dev.: 0.0094) MultiSource/Applications/lua/lua: 8.38% (3.7467 => 4.0607, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 8.32% (0.2008 => 0.2175, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.14% (0.4805 => 0.5196, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 8.05% (6.5754 => 7.1046, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.04% (0.3245 => 0.3506, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.03% (0.3511 => 0.3793, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 8.02% (0.4003 => 0.4324, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.97% (0.3914 => 0.4226, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.91% (0.2504 => 0.2702, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 7.89% (0.3940 => 0.4251, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.82% (6.2785 => 6.7697, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.77% (2.1007 => 2.2640, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 7.70% (1.2292 => 1.3239, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 7.69% (0.3578 => 0.3853, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 7.65% (0.3789 => 0.4079, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 7.65% (0.3646 => 0.3925, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 7.62% (0.3623 => 0.3899, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 7.53% (0.3663 => 0.3939, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.53% (0.2243 => 0.2412, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 7.53% (0.3601 => 0.3872, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.42% (0.3650 => 0.3921, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.09% (13.2842 => 14.2262, std.dev.: 0.0146) SingleSource/Benchmarks/Misc/ReedSolomon: 6.02% (0.1777 => 0.1884, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 5.27% (16.2614 => 17.1188, std.dev.: 0.0218) MultiSource/Applications/ClamAV/clamscan: 5.07% (14.5298 => 15.2665, std.dev.: 0.0144) MultiSource/Benchmarks/Olden/bh/bh: 4.30% (0.2859 => 0.2982, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5191, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/fbench: 24.11% (1.8175 => 2.2557, std.dev.: 0.0560) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.10% (1.0895 => 1.2758, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 11.04% (1.1560 => 1.2836, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 9.03% (0.8273 => 0.9020, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.42% (0.9692 => 1.0217, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 5.38% (1.2998 => 1.3697, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.81% (1.9144 => 2.0064, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.59% (0.3139 => 0.3283, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 4.48% (0.5449 => 0.5693, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.46% (2.8606 => 2.9881, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.13% (3.1736 => 3.3048, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.89% (1.7081 => 1.7746, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9852, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.37% (12.0921 => 12.4995, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 3.23% (10.7476 => 11.0945, std.dev.: 0.0459) MultiSource/Benchmarks/nbench/nbench: 3.20% (11.2619 => 11.6226, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bisort/bisort: 2.99% (0.8239 => 0.8485, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.40% (1.0310 => 1.0557, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.23% (7.4271 => 7.5925, std.dev.: 0.0033) MultiSource/Applications/lemon/lemon: 1.90% (1.4298 => 1.4570, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0503, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5137, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.34% (1.9433 => 1.9694, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1861, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5781, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2135, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1411, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 1.09% (12.4560 => 12.5918, std.dev.: 0.0060) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.59% (0.2670 => 0.1426, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.50% (0.4657 => 0.3935, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.64% (1.3819 => 1.2210, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.47% (1.3813 => 1.2229, std.dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.29% (1.0460 => 0.8547, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -12.69% (0.2238 => 0.1954, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.16% (20.3410 => 18.2752, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2643, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8101, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -5.77% (1.2308 => 1.1598, std.dev.: 0.0188) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0049) SingleSource/UnitTests/Vector/multiplies: -5.28% (2.6470 => 2.5072, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.59% (1.3780 => 1.3147, std.dev.: 0.0147) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.34% (0.9996 => 0.9562, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.39% (1.7688 => 1.7089, std.dev.: 0.0066) MultiSource/Applications/siod/siod: -3.06% (3.2729 => 3.1726, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -2.74% (1.9762 => 1.9221, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8813, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.63% (3.0263 => 2.9467, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.28% (4.1080 => 4.0145, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: -1.99% (28.2225 => 27.6608, std.dev.: 0.0213) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.96% (0.6589 => 0.6460, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.86% (0.6615 => 0.6492, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.67% (0.8342 => 0.8203, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.63% (6.3560 => 6.2522, std.dev.: 0.0060) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.61% (2.5254 => 2.4847, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -1.56% (26.5159 => 26.1016, std.dev.: 0.0407) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0067, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/heapsort: -1.40% (3.9173 => 3.8623, std.dev.: 0.0051) MultiSource/Applications/lambda-0_1_3/lambda: -1.20% (5.3167 => 5.2528, std.dev.: 0.0009) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1139, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -1.01% (4.5928 => 4.5465, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 22 01:16:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 22 Oct 2012 03:16:34 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121022081634.7A2132A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5093?compare_to=5090&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5093, Order: 166410, Start Time: 2012-10-22 06:55:36, End Time: 2012-10-22 08:18:38 To: 5090, Order: 166409, Start Time: 2012-10-22 05:15:30, End Time: 2012-10-22 06:38:46 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 11 (20 on baseline) Performance Improvements: 1 (6 on baseline) Existing Failures: 68 (67 on baseline) Unchanged Tests: 962 (947 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.20% (0.5906 => 0.6154, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.79% (0.7678 => 0.7892, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.05% (1.1762 => 1.2003, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.25% (4.4978 => 4.5541, std.dev.: 0.0165) MultiSource/Applications/SIBsim4/SIBsim4: 1.11% (1.2548 => 1.2687, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.03% (4.5338 => 4.5803, std.dev.: 0.0163) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 15.37% (24.7700 => 28.5782, std.dev.: 0.0235) MultiSource/Benchmarks/Olden/em3d/em3d: 3.99% (5.2503 => 5.4599, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.95% (4.3643 => 4.4931, std.dev.: 0.0337) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.46% (58.8368 => 60.2852, std.dev.: 0.1592) SingleSource/Benchmarks/Misc/richards_benchmark: 1.33% (1.2966 => 1.3139, std.dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.64% (1.1512 => 1.1323, std.dev.: 0.0036) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.62% (16.4697 => 16.3682, std.dev.: 0.0654) MultiSource/Applications/obsequi/Obsequi: -1.23% (1.0450 => 1.0321, std.dev.: 0.0126) MultiSource/Applications/sqlite3/sqlite3: -0.22% (0.6373 => 0.6359, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/08-main/main: 1.21% (0.1897 => 0.1920, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.50% (0.1687 => 0.1628, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.43% (0.3252 => 0.3173, std.dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.31% (0.2438 => 0.2406, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.48% (0.3301 => 0.3317, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.75% (0.2402 => 0.2420, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 0.10% (0.5941 => 0.5947, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel: -8.42% (0.0487 => 0.0446, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.18% (0.3281 => 0.3275, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.1982 => 0.1982, std.dev.: 0.0012) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -4.67% (0.0257 => 0.0245, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -18.57% (0.0210 => 0.0171, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -20.76% (0.0419 => 0.0332, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -19.33% (0.0326 => 0.0263, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.65% (0.0307 => 0.0305, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.48% (0.0417 => 0.0415, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0197 => 0.0197, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -19.77% (0.0172 => 0.0138, std.dev.: 0.0034) SingleSource/UnitTests/byval-alignment: - (0.0329 => 0.0329, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 0.20% (0.1473 => 0.1476, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -0.40% (8.1998 => 8.1673, std.dev.: 0.1114) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 2.03% (1.1141 => 1.1367, std.dev.: 0.0338) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 1.47% (0.1426 => 0.1447, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.81% (0.4133 => 0.4249, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.50% (0.1403 => 0.1410, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.21% (0.0634 => 0.0620, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -18.11% (0.0243 => 0.0199, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.07% (0.0528 => 0.0597, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.14% (1.1466 => 1.1450, std.dev.: 0.0528) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 61.11% (0.0018 => 0.0029, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.83% (0.0532 => 0.0579, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 12.39% (0.0234 => 0.0263, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.20% (0.8006 => 0.7990, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -50.00% (0.0002 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -18.48% (0.0092 => 0.0075, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/SPASS/SPASS MultiSource/Applications/SPASS/SPASS: -3.15% (8.4326 => 8.1673, std.dev.: 0.1114) New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.89% (2.1832 => 1.6617, std.dev.: 0.0045) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.70% (0.0810 => 0.0921, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.61% (0.7473 => 0.7892, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.44% (0.8321 => 0.8774, std.dev.: 0.0114) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.09% (0.2180 => 0.2291, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.55% (0.4847 => 0.5019, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.80% (0.8611 => 0.8852, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.72% (1.1685 => 1.2003, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.49% (4.4873 => 4.5541, std.dev.: 0.0165) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.40% (6.6074 => 6.7002, std.dev.: 0.0345) MultiSource/Benchmarks/nbench/nbench: 1.07% (1.1271 => 1.1392, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 57.70% (1.5795 => 2.4909, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.76% (0.3186 => 0.3465, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.43% (1.1857 => 1.2857, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 5.96% (63.1822 => 66.9449, std.dev.: 0.0393) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.17% (4.3552 => 4.4931, std.dev.: 0.0337) MultiSource/Applications/siod/siod: 2.61% (3.6643 => 3.7600, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.72% (59.2638 => 60.2852, std.dev.: 0.1592) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.57% (4.8362 => 4.9120, std.dev.: 0.0148) MultiSource/Benchmarks/Olden/bh/bh: 1.21% (2.3560 => 2.3846, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/whetstone: 1.10% (2.1224 => 2.1458, std.dev.: 0.0049) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.15% (0.3269 => 0.2970, std.dev.: 0.0021) MultiSource/Applications/lua/lua: -3.55% (29.8330 => 28.7729, std.dev.: 0.0573) SingleSource/Benchmarks/Shootout-C++/hash2: -1.55% (3.4237 => 3.3708, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.49% (3.3479 => 3.2981, std.dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.15% (3.7192 => 3.6766, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/functionobjects: -1.10% (3.7781 => 3.7364, std.dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.47% (16.4461 => 16.3682, std.dev.: 0.0654) MultiSource/Applications/obsequi/Obsequi: 0.57% (1.0262 => 1.0321, std.dev.: 0.0126) MultiSource/Applications/sqlite3/sqlite3: 0.43% (0.6332 => 0.6359, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/08-main/main: 4.86% (0.1831 => 0.1920, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.43% (0.1559 => 0.1628, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.60% (0.3123 => 0.3173, std.dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.31% (0.2463 => 0.2406, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.81% (0.3344 => 0.3317, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.37% (0.2364 => 0.2420, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: -1.05% (0.6010 => 0.5947, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel: 3.96% (0.0429 => 0.0446, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.28% (0.3266 => 0.3275, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 0.66% (0.1969 => 0.1982, std.dev.: 0.0012) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 9.38% (0.0224 => 0.0245, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 39.02% (0.0123 => 0.0171, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -18.63% (0.0408 => 0.0332, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 3.54% (0.0254 => 0.0263, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.99% (0.0302 => 0.0305, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 8.07% (0.0384 => 0.0415, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 3.68% (0.0190 => 0.0197, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -23.33% (0.0180 => 0.0138, std.dev.: 0.0034) SingleSource/UnitTests/byval-alignment: 43.04% (0.0230 => 0.0329, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.64% (0.1438 => 0.1476, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.34% (1.1329 => 1.1367, std.dev.: 0.0338) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -1.03% (0.1462 => 0.1447, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.04% (0.4164 => 0.4249, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.99% (0.1369 => 0.1410, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.28% (0.0641 => 0.0620, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.05% (0.0195 => 0.0199, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.29% (0.0578 => 0.0597, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.11% (1.1437 => 1.1450, std.dev.: 0.0528) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2800.00% (0.0001 => 0.0029, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.66% (0.0627 => 0.0579, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 46.11% (0.0180 => 0.0263, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.34% (0.8017 => 0.7990, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 20.97% (0.0062 => 0.0075, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 22 11:11:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 22 Oct 2012 13:11:52 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121022181152.5B87B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5094?compare_to=5093&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5094, Order: 166421, Start Time: 2012-10-22 16:49:30, End Time: 2012-10-22 18:13:55 To: 5093, Order: 166410, Start Time: 2012-10-22 06:55:36, End Time: 2012-10-22 08:18:38 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (18 on baseline) Performance Improvements: 2 (4 on baseline) Existing Failures: 68 (67 on baseline) Unchanged Tests: 970 (951 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 27.00% (12.7505 => 16.1926, std.dev.: 0.3083) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.03% (21.1668 => 21.8074, std.dev.: 0.2198) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.81% (0.8852 => 0.8692, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.50% (0.7892 => 0.7774, std.dev.: 0.0034) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.27% (16.3682 => 16.4127, std.dev.: 0.0338) MultiSource/Applications/obsequi/Obsequi: 1.15% (1.0321 => 1.0440, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: 0.17% (0.6359 => 0.6370, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: -4.69% (0.1920 => 0.1830, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.87% (0.1628 => 0.1691, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.17% (0.3173 => 0.3242, std.dev.: 0.0072) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.12% (0.2406 => 0.2403, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.96% (0.3317 => 0.3285, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.66% (0.2420 => 0.2404, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 1.18% (0.5947 => 0.6017, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel: -1.57% (0.0446 => 0.0439, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.21% (0.3275 => 0.3282, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.1982 => 0.1982, std.dev.: 0.0053) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -6.53% (0.0245 => 0.0229, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 24.56% (0.0171 => 0.0213, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 16.27% (0.0332 => 0.0386, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 15.21% (0.0263 => 0.0303, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -4.26% (0.0305 => 0.0292, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.72% (0.0415 => 0.0418, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -0.51% (0.0197 => 0.0196, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 13.77% (0.0138 => 0.0157, std.dev.: 0.0024) SingleSource/UnitTests/byval-alignment: -11.25% (0.0329 => 0.0292, std.dev.: 0.0030) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -23.08% (0.0013 => 0.0010, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: - (0.1476 => 0.1476, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 1.95% (8.1673 => 8.3266, std.dev.: 0.9076) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -3.43% (1.1367 => 1.0977, std.dev.: 0.0447) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.83% (0.1447 => 0.1459, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.70% (0.4249 => 0.4007, std.dev.: 0.0269) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.18% (0.1410 => 0.1483, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.19% (0.0620 => 0.0646, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 36.18% (0.0199 => 0.0271, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.19% (0.0597 => 0.0572, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.04% (1.1450 => 1.1455, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 6.90% (0.0029 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.87% (0.0579 => 0.0613, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.52% (0.0263 => 0.0267, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.50% (0.7990 => 0.8030, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -52.00% (0.0075 => 0.0036, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/SPASS/SPASS MultiSource/Applications/SPASS/SPASS: -1.26% (8.4326 => 8.3266, std.dev.: 0.9076) New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.64% (2.1832 => 1.6671, std.dev.: 0.0152) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 12.59% (0.0810 => 0.0912, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.19% (0.2180 => 0.2315, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.86% (0.8321 => 0.8725, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.03% (0.7473 => 0.7774, std.dev.: 0.0034) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.79% (0.3137 => 0.3256, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.25% (0.5961 => 0.6095, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.05% (1.4479 => 1.4776, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.03% (1.1685 => 1.1922, std.dev.: 0.0023) MultiSource/Applications/Burg/burg: 2.02% (1.2222 => 1.2469, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.53% (0.6586 => 0.6687, std.dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: 1.06% (31.8598 => 32.1973, std.dev.: 0.0683) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.88% (1.5795 => 2.5095, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.57% (14.6451 => 16.1926, std.dev.: 0.3083) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.54% (0.3186 => 0.3458, std.dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.39% (1.1857 => 1.2852, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 5.98% (63.1822 => 66.9581, std.dev.: 0.0623) SingleSource/Benchmarks/Misc/ReedSolomon: 3.10% (8.5322 => 8.7966, std.dev.: 0.0137) MultiSource/Applications/siod/siod: 2.82% (3.6643 => 3.7677, std.dev.: 0.0224) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.65% (0.3269 => 0.3019, std.dev.: 0.0011) MultiSource/Applications/lua/lua: -4.16% (29.8330 => 28.5909, std.dev.: 0.0939) MultiSource/Benchmarks/Ptrdist/ft/ft: -1.56% (0.8789 => 0.8652, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: -1.45% (3.4237 => 3.3739, std.dev.: 0.0066) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.20% (16.4461 => 16.4127, std.dev.: 0.0338) MultiSource/Applications/obsequi/Obsequi: 1.73% (1.0262 => 1.0440, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: 0.60% (0.6332 => 0.6370, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: -0.05% (0.1831 => 0.1830, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 8.47% (0.1559 => 0.1691, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.81% (0.3123 => 0.3242, std.dev.: 0.0072) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.44% (0.2463 => 0.2403, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.76% (0.3344 => 0.3285, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.69% (0.2364 => 0.2404, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 0.12% (0.6010 => 0.6017, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel: 2.33% (0.0429 => 0.0439, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.49% (0.3266 => 0.3282, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/strcat: 0.66% (0.1969 => 0.1982, std.dev.: 0.0053) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.23% (0.0224 => 0.0229, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 73.17% (0.0123 => 0.0213, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.39% (0.0408 => 0.0386, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 19.29% (0.0254 => 0.0303, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.31% (0.0302 => 0.0292, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 8.85% (0.0384 => 0.0418, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 3.16% (0.0190 => 0.0196, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -12.78% (0.0180 => 0.0157, std.dev.: 0.0024) SingleSource/UnitTests/byval-alignment: 26.96% (0.0230 => 0.0292, std.dev.: 0.0030) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 42.86% (0.0007 => 0.0010, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 2.64% (0.1438 => 0.1476, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -3.11% (1.1329 => 1.0977, std.dev.: 0.0447) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.21% (0.1462 => 0.1459, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.77% (0.4164 => 0.4007, std.dev.: 0.0269) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.33% (0.1369 => 0.1483, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.78% (0.0641 => 0.0646, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 38.97% (0.0195 => 0.0271, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.04% (0.0578 => 0.0572, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.16% (1.1437 => 1.1455, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.23% (0.0627 => 0.0613, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.33% (0.0180 => 0.0267, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.16% (0.8017 => 0.8030, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -41.94% (0.0062 => 0.0036, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 22 11:20:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 22 Oct 2012 13:20:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121022182056.1A8502A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5095?compare_to=5091&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5095, Order: 166421, Start Time: 2012-10-22 17:02:34, End Time: 2012-10-22 18:22:58 To: 5091, Order: 166410, Start Time: 2012-10-22 05:34:23, End Time: 2012-10-22 06:54:21 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (5 on baseline) Performance Regressions: 1 (195 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 88 (14 on baseline) Unchanged Tests: 953 (646 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.68% (78.4217 => 80.5218, std.dev.: 0.5813) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.02% (0.6244 => 0.6245, std.dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: -0.01% (17.2509 => 17.2494, std.dev.: 0.0370) MultiSource/Applications/kimwitu++/kc: 0.09% (15.6528 => 15.6674, std.dev.: 0.0100) MultiSource/Benchmarks/Bullet/bullet: -0.04% (56.2115 => 56.1901, std.dev.: 0.0963) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.21% (0.0481 => 0.0480, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0481 => 0.0481, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0450 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.22% (0.0451 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.23% (0.0439 => 0.0440, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0441 => 0.0441, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.23% (0.0433 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0435 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0451 => 0.0451, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.22% (0.0452 => 0.0453, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0446 => 0.0446, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.22% (0.0446 => 0.0447, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.23% (0.0436 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.23% (0.0438 => 0.0437, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0443 => 0.0443, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0444 => 0.0444, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0454 => 0.0454, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0455 => 0.0455, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0431 => 0.0431) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0431 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0443 => 0.0443) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0444 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0434 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0435 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0426 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.23% (0.0427 => 0.0428, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.24% (0.0425 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.23% (0.0427 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0462 => 0.0462, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.22% (0.0462 => 0.0463, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0424 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0425 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0425 => 0.0425, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0426 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.23% (0.0432 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0434 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.03% (1.4886 => 1.4891, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (8.2151 => 8.2151, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.19% (0.6869 => 0.6882, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1436 => 0.1436, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.2134 => 0.2134, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.15% (63.2438 => 56.1901, std.dev.: 0.0963) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/MallocBench/gs/gs: 12.89% (4.1105 => 4.6404, std.dev.: 0.0229) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.58% (3.4629 => 5.8031, std.dev.: 0.0049) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13495.00% (0.0720 => 9.7884, std.dev.: 0.0150) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9945200.00% (0.0001 => 9.9453, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 57.99% (0.2554 => 0.4035, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/lowercase: 56.25% (0.0256 => 0.0400, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 51.11% (10.3673 => 15.6656, std.dev.: 0.0040) SingleSource/UnitTests/SignlessTypes/factor: 45.95% (0.0296 => 0.0432, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 42.44% (0.0271 => 0.0386, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.35% (1.5859 => 2.2416, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: 38.10% (0.1622 => 0.2240, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: 36.08% (0.1056 => 0.1437, std.dev.: 0.0008) SingleSource/UnitTests/vla: 32.39% (0.0355 => 0.0470, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.07% (2.2024 => 2.8647, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/neural/neural: 25.84% (0.1463 => 0.1841, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 25.42% (0.0834 => 0.1046, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.95% (0.1566 => 0.1894, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: 20.40% (0.2049 => 0.2467, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 19.48% (0.1432 => 0.1711, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.31% (7.0540 => 8.4158, std.dev.: 0.0193) MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.59% (2.2022 => 2.6115, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.43% (0.6675 => 0.7905, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.14% (0.0871 => 0.1029, std.dev.: 0.0026) MultiSource/Applications/viterbi/viterbi: 17.75% (0.1555 => 0.1831, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.65% (0.5105 => 0.6006, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 16.80% (0.1655 => 0.1933, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: 16.45% (0.0626 => 0.0729, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.38% (1.3050 => 1.5187, std.dev.: 0.0103) MultiSource/Applications/d/make_dparser: 16.26% (3.3354 => 3.8778, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.02% (0.0793 => 0.0920, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 15.93% (0.1695 => 0.1965, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.86% (0.4615 => 0.5347, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 15.85% (0.2271 => 0.2631, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/power/power: 15.83% (0.1440 => 0.1668, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.56% (0.1337 => 0.1545, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.41% (0.1032 => 0.1191, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 15.40% (0.1175 => 0.1356, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 15.39% (0.3282 => 0.3787, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.36% (0.5020 => 0.5791, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.35% (0.0886 => 0.1022, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/mst/mst: 15.31% (0.1163 => 0.1341, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.10% (0.1510 => 0.1738, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.08% (1.5415 => 1.7740, std.dev.: 0.0043) MultiSource/Applications/minisat/minisat: 15.08% (0.7115 => 0.8188, std.dev.: 0.0039) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 15.03% (0.1584 => 0.1822, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 14.88% (0.8172 => 0.9388, std.dev.: 0.0096) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.73% (0.0842 => 0.0966, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.69% (0.1940 => 0.2225, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 14.51% (0.3109 => 0.3560, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.42% (1.7609 => 2.0148, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.40% (0.1236 => 0.1414, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.38% (0.0730 => 0.0835, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: 14.37% (0.3423 => 0.3915, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.34% (0.0746 => 0.0853, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.33% (4.2646 => 4.8757, std.dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.32% (0.0838 => 0.0958) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.29% (0.3121 => 0.3567, std.dev.: 0.0059) SingleSource/Benchmarks/McGill/exptree: 14.25% (0.0814 => 0.0930, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 14.16% (0.1151 => 0.1314, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.14% (0.9765 => 1.1146, std.dev.: 0.0038) MultiSource/Applications/Burg/burg: 14.11% (1.1642 => 1.3285, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout/matrix: 14.06% (0.0818 => 0.0933) MultiSource/Applications/JM/ldecod/ldecod: 14.02% (10.4361 => 11.8988, std.dev.: 0.0266) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.96% (0.5860 => 0.6678, std.dev.: 0.0031) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.91% (0.1143 => 0.1302, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 13.83% (5.7591 => 6.5556, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.81% (0.2107 => 0.2398, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.78% (0.2758 => 0.3138, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 13.77% (9.4845 => 10.7905, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.70% (0.1117 => 0.1270, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 13.64% (0.6450 => 0.7330, std.dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.43% (0.1906 => 0.2162, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.41% (0.2065 => 0.2342, std.dev.: 0.0033) MultiSource/Applications/spiff/spiff: 13.39% (0.7835 => 0.8884, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.38% (0.0770 => 0.0873, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.37% (8.1363 => 9.2241, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.36% (1.4186 => 1.6081, std.dev.: 0.0115) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.35% (0.1438 => 0.1630, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.33% (0.1695 => 0.1921, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: 13.27% (2.0273 => 2.2963, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.22% (0.1029 => 0.1165, std.dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 13.20% (0.7433 => 0.8414, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.11% (0.1625 => 0.1838, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.03% (0.0798 => 0.0902, std.dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 12.93% (1.1840 => 1.3371, std.dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.92% (0.0929 => 0.1049, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.90% (0.1062 => 0.1199, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.89% (0.2700 => 0.3048, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.86% (0.0933 => 0.1053, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 12.76% (1.0722 => 1.2090, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.71% (4.9449 => 5.5735, std.dev.: 0.0176) MultiSource/Applications/lua/lua: 12.67% (3.8723 => 4.3630, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.67% (0.8067 => 0.9089, std.dev.: 0.0097) MultiSource/Benchmarks/sim/sim: 12.61% (0.3387 => 0.3814, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.61% (0.4879 => 0.5494, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.60% (5.0018 => 5.6320, std.dev.: 0.0183) SingleSource/UnitTests/SignlessTypes/rem: 12.59% (0.1144 => 0.1288, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 12.58% (0.4299 => 0.4840, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.52% (0.5981 => 0.6730, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/health/health: 12.22% (0.1268 => 0.1423, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.22% (0.3307 => 0.3711, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.10% (0.5569 => 0.6243, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.09% (1.1861 => 1.3295, std.dev.: 0.0124) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 12.06% (0.3177 => 0.3560, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.02% (0.2603 => 0.2916, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.83% (7.9617 => 8.9035, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/football/football: 11.76% (0.8921 => 0.9970, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/09-vor/vor: 11.70% (0.3180 => 0.3552, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 11.58% (0.3473 => 0.3875, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.56% (0.1125 => 0.1255, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 11.54% (0.3543 => 0.3952, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.48% (0.3441 => 0.3836, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/parameter-passing: 11.43% (0.3927 => 0.4376, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.35% (0.3561 => 0.3965, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-3: 11.29% (0.3516 => 0.3913, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.29% (0.3543 => 0.3943, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.28% (0.1330 => 0.1480, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/exceptions-2: 11.27% (0.3497 => 0.3891, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.15% (0.3828 => 0.4255, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.15% (0.3694 => 0.4106, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.12% (0.3886 => 0.4318, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.10% (0.1892 => 0.2102, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 11.06% (0.6456 => 0.7170, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 11.05% (1.5603 => 1.7327, std.dev.: 0.0120) MultiSource/Benchmarks/Olden/bh/bh: 11.00% (0.3092 => 0.3432, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 10.86% (2.2969 => 2.5464, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.86% (0.2266 => 0.2512, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.33% (0.8101 => 0.8938, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.06% (0.1044 => 0.1149) SingleSource/Benchmarks/Shootout-C++/hash: 9.96% (0.4289 => 0.4716, std.dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 9.75% (21.9371 => 24.0754, std.dev.: 0.0260) SingleSource/Benchmarks/Shootout-C++/hash2: 9.72% (0.4620 => 0.5069, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.42% (0.3865 => 0.4229, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.30% (0.3826 => 0.4182, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 9.29% (0.3422 => 0.3740, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.19% (0.4103 => 0.4480, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.97% (0.4203 => 0.4580, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.80% (0.4636 => 0.5044, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists1: 8.77% (0.3684 => 0.4007, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.72% (0.3427 => 0.3726, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 8.72% (0.4048 => 0.4401, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 8.38% (17.1811 => 18.6202, std.dev.: 0.0039) SingleSource/UnitTests/ObjC++/property-reference-object: 8.16% (0.6030 => 0.6522, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.03% (0.5925 => 0.6401, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.94% (0.2430 => 0.2623, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.93% (3.8922 => 4.2009, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/sieve: 7.88% (0.3603 => 0.3887, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.78% (14.3668 => 15.4839, std.dev.: 0.0092) SingleSource/UnitTests/ObjC++/property-reference: 7.63% (0.7326 => 0.7885, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.58% (0.4064 => 0.4372, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.51% (0.3650 => 0.3924, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.18% (0.3162 => 0.3389, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 7.17% (0.3098 => 0.3320, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.05% (0.3232 => 0.3460, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.02% (0.2905 => 0.3109, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.02% (0.2891 => 0.3094, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 6.96% (0.2831 => 0.3028, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.86% (0.3136 => 0.3351, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.85% (0.3283 => 0.3508, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.73% (0.2793 => 0.2981, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.69% (2.0665 => 2.2048, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.65% (0.2872 => 0.3063, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.58% (0.2871 => 0.3060, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.57% (0.2756 => 0.2937, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 6.47% (0.2877 => 0.3063, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.45% (0.3052 => 0.3249, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 6.42% (0.3379 => 0.3596, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 6.42% (0.2725 => 0.2900, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 6.23% (0.2714 => 0.2883, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/random: 6.21% (0.2802 => 0.2976, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 6.15% (1.2842 => 1.3632, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/objinst: 5.40% (0.3131 => 0.3300, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.69% (0.3817 => 0.3958, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.90% (1.1194 => 1.1519, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.82% (0.3935 => 0.4046, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1725, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.92% (1.1145 => 1.2919, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.63% (0.9957 => 1.1314, std.dev.: 0.0098) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.79% (1.1396 => 1.2512, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 5.93% (1.9405 => 2.0556, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.95% (3.1578 => 3.3142, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.65% (0.3463 => 0.3624, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.61% (0.3987 => 0.4091, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.59% (4.2280 => 4.3376, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.01% (3.6395 => 3.7125, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/bisort/bisort: 1.80% (0.8333 => 0.8483, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2077, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 1.50% (0.7455 => 0.7567, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.42% (2.6546 => 2.6922, std.dev.: 0.0040) MultiSource/Applications/viterbi/viterbi: 1.20% (4.4649 => 4.5185, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 1.01% (9.1159 => 9.2077, std.dev.: 0.0334) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.01% (6.6874 => 0.1333, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: -79.86% (0.8651 => 0.1742, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.87% (5.2763 => 3.2255, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.75% (5.3855 => 3.7295, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.33% (5.3526 => 3.7291, std.dev.: 0.0061) SingleSource/UnitTests/Vector/constpool: -14.63% (54.1659 => 46.2407, std.dev.: 0.0566) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.42% (2.9384 => 2.6323, std.dev.: 0.0060) MultiSource/Applications/ClamAV/clamscan: -6.52% (22.1758 => 20.7296, std.dev.: 0.0480) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.10% (8.0499 => 3.7753, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4751, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.97% (1.6925 => 1.4222, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.67% (1.2258 => 1.0705, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -12.05% (1.2373 => 1.0882, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel-2: -10.77% (1.5373 => 1.3717, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.29% (19.9488 => 18.2948, std.dev.: 0.0423) MultiSource/Benchmarks/FreeBench/mason/mason: -7.87% (0.2161 => 0.1991, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4781, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.95% (1.8329 => 1.7055, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.41% (2.7294 => 2.5545, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.27% (1.6805 => 1.5752, std.dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.58% (1.5835 => 1.5110, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.24% (8.1563 => 7.8103, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.54% (3.2827 => 3.1664, std.dev.: 0.0093) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8777, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5065, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.79% (0.4808 => 0.4674, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Applications/sqlite3/sqlite3: -1.83% (4.6441 => 4.5592, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/salsa20: -1.81% (10.2830 => 10.0966, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/flops: -1.69% (8.8334 => 8.6837, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -1.68% (2.5528 => 2.5098, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4218, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2879, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.09% (6.2999 => 6.2313, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8566, std.dev.: 0.0138) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 19.43% (0.5229 => 0.6245, std.dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: 15.08% (14.9895 => 17.2494, std.dev.: 0.0370) MultiSource/Applications/kimwitu++/kc: 10.68% (14.1553 => 15.6674, std.dev.: 0.0100) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 34.78% (1.1048 => 1.4891, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.76% (7.1582 => 8.2151, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.61% (0.6222 => 0.6882, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.30% (0.1485 => 0.1436, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.85% (0.2116 => 0.2134, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 22 11:26:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 22 Oct 2012 13:26:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121022182646.80A992A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5096?compare_to=5092&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5096, Order: 166421, Start Time: 2012-10-22 17:03:35, End Time: 2012-10-22 18:29:38 To: 5092, Order: 166410, Start Time: 2012-10-22 05:40:59, End Time: 2012-10-22 07:08:51 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (200 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1042 (665 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.07% (2.0176 => 2.5032, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.35% (0.1410 => 0.1711, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 18.64% (0.0826 => 0.0980, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 18.28% (0.2243 => 0.2653, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 17.47% (0.1013 => 0.1190, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.02% (0.0746 => 0.0873, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.89% (0.7710 => 0.9012, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.85% (0.0653 => 0.0763, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.26% (0.0819 => 0.0944, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.22% (0.2596 => 0.2991, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.75% (0.0834 => 0.0957, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 14.70% (0.2721 => 0.3121, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.65% (0.1413 => 0.1620, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.55% (0.0811 => 0.0929, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.40% (0.0847 => 0.0969, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 14.40% (1.3693 => 1.5665, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.35% (0.1986 => 0.2271, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.34% (0.0725 => 0.0829, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.32% (0.1327 => 0.1517, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.27% (0.9199 => 1.0512, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/power/power: 14.16% (0.1003 => 0.1145, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.03% (0.0720 => 0.0821, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.96% (0.5637 => 0.6424, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.95% (0.6959 => 0.7930, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.88% (3.9660 => 4.5163, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.86% (0.1075 => 0.1224, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.83% (0.2914 => 0.3317, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.75% (0.5265 => 0.5989, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.66% (0.1588 => 0.1805, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 13.65% (0.1062 => 0.1207, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/mst/mst: 13.59% (0.1111 => 0.1262, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.59% (0.0964 => 0.1095, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.53% (0.1072 => 0.1217, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 13.48% (0.7038 => 0.7987, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 13.28% (0.7460 => 0.8451, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.24% (0.6283 => 0.7115, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.17% (0.1276 => 0.1444, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.00% (0.0977 => 0.1104, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 12.82% (0.4328 => 0.4883, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.82% (0.1014 => 0.1144, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 12.79% (0.1478 => 0.1667, std.dev.: 0.0024) MultiSource/Applications/Burg/burg: 12.77% (1.1061 => 1.2474, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.68% (0.5577 => 0.6284, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/distray/distray: 12.59% (0.0818 => 0.0921, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.56% (1.2193 => 1.3725, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.46% (1.1364 => 1.2780, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.42% (1.4563 => 1.6372, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 12.35% (13.8202 => 15.5276, std.dev.: 0.0196) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.31% (0.2023 => 0.2272, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.24% (0.4379 => 0.4915, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.23% (0.3246 => 0.3643, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.23% (0.1865 => 0.2093, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 12.21% (0.4062 => 0.4558, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 12.11% (0.7506 => 0.8415, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.10% (0.1157 => 0.1297, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 12.07% (0.1657 => 0.1857, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.99% (0.2127 => 0.2382, std.dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: 11.89% (0.2995 => 0.3351, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 11.78% (3.8646 => 4.3197, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.63% (0.3130 => 0.3494, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.57% (0.3899 => 0.4350, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.44% (0.4791 => 0.5339, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 11.43% (0.5818 => 0.6483, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.40% (0.1789 => 0.1993, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 11.39% (0.1589 => 0.1770, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 11.35% (0.2925 => 0.3257, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 11.31% (0.5748 => 0.6398, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 11.20% (1.0313 => 1.1468, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 11.18% (0.3220 => 0.3580, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.16% (0.1048 => 0.1165, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.15% (0.1435 => 0.1595, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 11.13% (0.1213 => 0.1348, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 11.12% (1.9270 => 2.1413, std.dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 11.11% (0.2781 => 0.3090, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.08% (0.3485 => 0.3871, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.06% (0.4016 => 0.4460, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 10.99% (0.7061 => 0.7837, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.98% (7.2180 => 8.0106, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/lists: 10.93% (0.3293 => 0.3653, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.92% (0.3022 => 0.3352, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.78% (0.2782 => 0.3082, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.73% (0.3756 => 0.4159, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 10.72% (0.6744 => 0.7467, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.64% (0.1569 => 0.1736) SingleSource/Benchmarks/Shootout-C++/moments: 10.63% (0.3868 => 0.4279, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.60% (0.3489 => 0.3859, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 10.60% (0.3453 => 0.3819, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 10.56% (3.1889 => 3.5257, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 10.56% (16.6129 => 18.3668, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/football/football: 10.55% (0.8310 => 0.9187, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 10.54% (0.2761 => 0.3052, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/strcat: 10.53% (0.2726 => 0.3013, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.50% (0.3580 => 0.3956, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.42% (1.9828 => 2.1895, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 10.36% (0.2760 => 0.3046, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hello: 10.36% (0.2607 => 0.2877, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 10.36% (0.3534 => 0.3900, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 10.35% (2.1791 => 2.4046, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/random: 10.30% (0.2690 => 0.2967, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.29% (1.3245 => 1.4608, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.29% (0.8698 => 0.9593, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.28% (0.2966 => 0.3271, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.27% (0.4390 => 0.4841, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 10.23% (3.6692 => 4.0444, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 10.19% (0.3149 => 0.3470, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.17% (0.2655 => 0.2925, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 10.16% (0.2628 => 0.2895, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 10.14% (0.3107 => 0.3422, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.09% (0.2765 => 0.3044, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 10.01% (0.2937 => 0.3231, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.00% (0.2140 => 0.2354, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.98% (4.3801 => 4.8171, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.96% (4.4433 => 4.8858, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/05-eks/eks: 9.90% (0.4113 => 0.4520, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/matrix: 9.81% (0.2988 => 0.3281, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 9.81% (0.3192 => 0.3505, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.79% (0.2696 => 0.2960, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.68% (0.6135 => 0.6729, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.63% (4.9865 => 5.4666, std.dev.: 0.0180) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.45% (0.3755 => 0.4110, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 9.41% (0.2945 => 0.3222, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.40% (0.1819 => 0.1990, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.39% (0.2321 => 0.2539, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 9.38% (1.0594 => 1.1588, std.dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 9.26% (14.8535 => 16.2284, std.dev.: 0.0114) MultiSource/Applications/SIBsim4/SIBsim4: 9.11% (1.2749 => 1.3911, std.dev.: 0.0029) MultiSource/Benchmarks/sim/sim: 8.97% (0.3131 => 0.3412, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 8.87% (8.4961 => 9.2499, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.80% (0.6576 => 0.7155, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 8.77% (4.6629 => 5.0720, std.dev.: 0.0145) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.72% (0.8818 => 0.9587, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.67% (1.5188 => 1.6505, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.64% (1.1333 => 1.2312, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: 8.59% (0.1385 => 0.1504, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 8.53% (0.6250 => 0.6783, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.48% (0.9108 => 0.9880, std.dev.: 0.0048) MultiSource/Applications/lua/lua: 8.42% (3.7467 => 4.0621, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.42% (3.2742 => 3.5498, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.20% (0.3245 => 0.3511, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 8.07% (0.4003 => 0.4326, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.06% (0.3511 => 0.3794, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.03% (0.4805 => 0.5191, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 8.02% (6.5754 => 7.1029, std.dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.95% (2.1007 => 2.2678, std.dev.: 0.0187) SingleSource/UnitTests/ObjC/exceptions: 7.95% (0.3914 => 0.4225, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 7.92% (0.2008 => 0.2167, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.91% (0.2504 => 0.2702, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.87% (6.2785 => 6.7724, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/property: 7.74% (0.3940 => 0.4245, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.71% (1.2292 => 1.3240, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 7.71% (0.3789 => 0.4081, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 7.69% (0.3601 => 0.3878, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/trivial-interface: 7.63% (0.3578 => 0.3851, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 7.62% (0.3646 => 0.3924, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 7.59% (0.3663 => 0.3941, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.49% (0.2243 => 0.2411, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.48% (0.3650 => 0.3923, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 7.42% (0.3623 => 0.3892, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.18% (13.2842 => 14.2377, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/ReedSolomon: 6.13% (0.1777 => 0.1886, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 5.41% (16.2614 => 17.1408, std.dev.: 0.0184) MultiSource/Applications/ClamAV/clamscan: 5.15% (14.5298 => 15.2783, std.dev.: 0.0105) MultiSource/Benchmarks/Olden/bh/bh: 3.99% (0.2859 => 0.2973, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 2.47% (33.2944 => 34.1178, std.dev.: 0.0257) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5180, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fbench: 24.44% (1.8175 => 2.2617, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.12% (1.0895 => 1.2760, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: 11.02% (1.1560 => 1.2834, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.03% (0.8273 => 0.9020, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.43% (0.9692 => 1.0218) SingleSource/Benchmarks/Misc/mandel-2: 5.15% (1.2998 => 1.3668, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625) SingleSource/Benchmarks/Misc/flops-5: 4.64% (1.9144 => 2.0033, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 4.48% (0.5449 => 0.5693, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.46% (2.8606 => 2.9881, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 4.12% (3.1736 => 3.3043, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.90% (1.7081 => 1.7747, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.38% (12.0921 => 12.5012, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: 3.35% (1.9199 => 1.9842, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 3.29% (10.7476 => 11.1016, std.dev.: 0.0151) MultiSource/Benchmarks/nbench/nbench: 3.22% (11.2619 => 11.6245, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bisort/bisort: 3.01% (0.8239 => 0.8487, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0310 => 1.0559, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.11% (7.4271 => 7.5835, std.dev.: 0.0039) MultiSource/Applications/lemon/lemon: 1.80% (1.4298 => 1.4555, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.46% (2.0200 => 2.0495, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.45% (8.3908 => 8.5122, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (1.9433 => 1.9686, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2123, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.22% (9.0760 => 9.1863, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.16% (5.5130 => 5.5767, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 1.07% (12.4560 => 12.5897, std.dev.: 0.0079) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.55% (0.2670 => 0.1427) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.53% (0.4657 => 0.3934, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.61% (1.3819 => 1.2214, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.61% (1.3813 => 1.2210, std.dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.27% (1.0460 => 0.8549, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -13.00% (0.2238 => 0.1947, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.29% (20.3410 => 18.2479, std.dev.: 0.0267) SingleSource/Benchmarks/Misc/flops-3: -6.25% (2.4152 => 2.2642, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -5.74% (1.2308 => 1.1602, std.dev.: 0.0273) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3744, std.dev.: 0.0042) SingleSource/UnitTests/Vector/multiplies: -5.05% (2.6470 => 2.5133, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.02% (1.3780 => 1.3088, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.48% (0.9996 => 0.9648, std.dev.: 0.0047) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.37% (1.7688 => 1.7092, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.06% (3.2729 => 3.1729, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: -2.72% (1.9762 => 1.9225, std.dev.: 0.0036) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8813, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.60% (3.0263 => 2.9476, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.31% (4.1080 => 4.0129, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.09% (0.6589 => 0.6451, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -1.99% (28.2225 => 27.6620, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.86% (0.6615 => 0.6492, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -1.71% (6.3560 => 6.2471, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.68% (0.8342 => 0.8202, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.64% (2.5254 => 2.4841, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0073, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -1.40% (26.5159 => 26.1453, std.dev.: 0.0349) SingleSource/Benchmarks/Shootout/heapsort: -1.31% (3.9173 => 3.8659, std.dev.: 0.0048) MultiSource/Applications/lambda-0_1_3/lambda: -1.28% (5.3167 => 5.2488, std.dev.: 0.0030) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1138, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -1.05% (84.4286 => 83.5432, std.dev.: 0.0033) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 22 12:52:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 22 Oct 2012 14:52:41 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121022195241.7CA6B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5097?compare_to=5094&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5097, Order: 166423, Start Time: 2012-10-22 18:31:02, End Time: 2012-10-22 19:54:45 To: 5094, Order: 166421, Start Time: 2012-10-22 16:49:30, End Time: 2012-10-22 18:13:55 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 5 (24 on baseline) Performance Improvements: 4 (6 on baseline) Existing Failures: 68 (67 on baseline) Unchanged Tests: 965 (943 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.62% (1.6390 => 1.6656, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.31% (0.9565 => 0.9690, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/life/life: 3.33% (2.5647 => 2.6502, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.48% (9.8697 => 10.0162, std.dev.: 0.0298) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.42% (1.4124 => 1.4325, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.98% (8.7288 => 8.4685, std.dev.: 0.0696) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: -8.69% (3.8828 => 3.5455, std.dev.: 0.1227) SingleSource/Benchmarks/Misc/richards_benchmark: -1.64% (1.3230 => 1.3013, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.62% (0.6241 => 0.6140, std.dev.: 0.0036) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.28% (16.4127 => 16.4589, std.dev.: 0.0968) MultiSource/Applications/obsequi/Obsequi: -0.60% (1.0440 => 1.0377, std.dev.: 0.0054) MultiSource/Applications/sqlite3/sqlite3: -0.77% (0.6370 => 0.6321, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/08-main/main: 3.17% (0.1830 => 0.1888, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.20% (0.1691 => 0.1620, std.dev.: 0.0123) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.52% (0.3242 => 0.3225, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.33% (0.2403 => 0.2483, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.07% (0.3285 => 0.3353, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.54% (0.2404 => 0.2367, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/bigfib: -0.96% (0.6017 => 0.5959, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/mandel: -13.21% (0.0439 => 0.0381, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.52% (0.3282 => 0.3299, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 0.45% (0.1982 => 0.1991, std.dev.: 0.0009) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.24% (0.0229 => 0.0241, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.47% (0.0213 => 0.0212, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 8.81% (0.0386 => 0.0420, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.97% (0.0303 => 0.0294, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 5.14% (0.0292 => 0.0307, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.72% (0.0418 => 0.0415, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 0.51% (0.0196 => 0.0197, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 8.92% (0.0157 => 0.0171, std.dev.: 0.0020) SingleSource/UnitTests/byval-alignment: 8.22% (0.0292 => 0.0316, std.dev.: 0.0040) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -20.00% (0.0010 => 0.0008, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 0.27% (0.1476 => 0.1480, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: -2.57% (8.3266 => 8.1125, std.dev.: 0.0879) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 2.86% (1.0977 => 1.1291, std.dev.: 0.0223) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 2.88% (0.1459 => 0.1501, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.17% (0.4007 => 0.4214, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.33% (0.1483 => 0.1404, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.32% (0.0646 => 0.0631, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -20.66% (0.0271 => 0.0215, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.10% (0.0572 => 0.0560, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.50% (1.1455 => 1.1398, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.45% (0.0031 => 0.0029, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 1100.00% (0.0001 => 0.0012, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.96% (0.0613 => 0.0625, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -23.22% (0.0267 => 0.0205, std.dev.: 0.0058) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.09% (0.8030 => 0.8023, std.dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 169.44% (0.0036 => 0.0097, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/SPASS/SPASS MultiSource/Applications/SPASS/SPASS: -3.80% (8.4326 => 8.1125, std.dev.: 0.0879) New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.89% (2.1832 => 1.6616, std.dev.: 0.0030) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.32% (0.0810 => 0.0926, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.62% (0.2279 => 0.2407, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.46% (0.2180 => 0.2299, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.96% (0.6010 => 0.6308, std.dev.: 0.0082) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.57% (0.8321 => 0.8701, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.01% (0.2519 => 0.2620, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.56% (0.7473 => 0.7739, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.03% (0.3295 => 0.3395, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.01% (0.6287 => 0.6476, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.70% (0.9435 => 0.9690, std.dev.: 0.0047) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.12% (6.6074 => 6.7477, std.dev.: 0.0269) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.65% (1.6386 => 1.6656, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.61% (0.8340 => 0.8474, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.28% (1.4479 => 1.4665, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.99% (1.5795 => 2.5112, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.60% (0.3186 => 0.3492, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.43% (1.1857 => 1.2856, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 5.98% (63.1822 => 66.9580, std.dev.: 0.2014) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.69% (0.7597 => 0.7877, std.dev.: 0.0042) MultiSource/Applications/siod/siod: 2.68% (3.6643 => 3.7626, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/ReedSolomon: 2.15% (8.5322 => 8.7154, std.dev.: 0.0564) MultiSource/Benchmarks/Olden/bh/bh: 1.81% (2.3560 => 2.3986, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.51% (2.9096 => 2.9536, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.11% (9.9065 => 10.0162, std.dev.: 0.0298) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: -9.53% (3.9188 => 3.5455, std.dev.: 0.1227) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.69% (0.3269 => 0.2985, std.dev.: 0.0015) MultiSource/Applications/lua/lua: -4.13% (29.8330 => 28.6001, std.dev.: 0.1627) SingleSource/Benchmarks/Shootout-C++/hash2: -1.40% (3.4237 => 3.3758, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.16% (3.3479 => 3.3091, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.05% (3.7192 => 3.6800, std.dev.: 0.0024) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.08% (16.4461 => 16.4589, std.dev.: 0.0968) MultiSource/Applications/obsequi/Obsequi: 1.12% (1.0262 => 1.0377, std.dev.: 0.0054) MultiSource/Applications/sqlite3/sqlite3: -0.17% (0.6332 => 0.6321, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/08-main/main: 3.11% (0.1831 => 0.1888, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.91% (0.1559 => 0.1620, std.dev.: 0.0123) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.27% (0.3123 => 0.3225, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.81% (0.2463 => 0.2483, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.27% (0.3344 => 0.3353, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.13% (0.2364 => 0.2367, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/bigfib: -0.85% (0.6010 => 0.5959, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/mandel: -11.19% (0.0429 => 0.0381, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.01% (0.3266 => 0.3299, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 1.12% (0.1969 => 0.1991, std.dev.: 0.0009) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.59% (0.0224 => 0.0241, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 72.36% (0.0123 => 0.0212, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.94% (0.0408 => 0.0420, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 15.75% (0.0254 => 0.0294, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.66% (0.0302 => 0.0307, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 8.07% (0.0384 => 0.0415, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 3.68% (0.0190 => 0.0197, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -5.00% (0.0180 => 0.0171, std.dev.: 0.0020) SingleSource/UnitTests/byval-alignment: 37.39% (0.0230 => 0.0316, std.dev.: 0.0040) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 14.29% (0.0007 => 0.0008, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 2.92% (0.1438 => 0.1480, std.dev.: 0.0019) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -0.34% (1.1329 => 1.1291, std.dev.: 0.0223) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 2.67% (0.1462 => 0.1501, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.20% (0.4164 => 0.4214, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.56% (0.1369 => 0.1404, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.56% (0.0641 => 0.0631, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 10.26% (0.0195 => 0.0215, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.11% (0.0578 => 0.0560, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.34% (1.1437 => 1.1398, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2800.00% (0.0001 => 0.0029, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -14.29% (0.0014 => 0.0012, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.32% (0.0627 => 0.0625, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 13.89% (0.0180 => 0.0205, std.dev.: 0.0058) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.07% (0.8017 => 0.8023, std.dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 56.45% (0.0062 => 0.0097, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 22 13:12:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 22 Oct 2012 15:12:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121022201211.9ACA92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5098?compare_to=5095&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5098, Order: 166425, Start Time: 2012-10-22 18:54:33, End Time: 2012-10-22 20:14:13 To: 5095, Order: 166421, Start Time: 2012-10-22 17:02:34, End Time: 2012-10-22 18:22:58 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (5 on baseline) Performance Regressions: 5 (188 on baseline) Performance Improvements: 6 (44 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 88 (14 on baseline) Unchanged Tests: 943 (655 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 3.32% (0.4035 => 0.4169, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.01% (1.1314 => 1.1654, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: 1.58% (3.3142 => 3.3665, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.18% (1.5752 => 1.5938, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.06% (9.9453 => 10.0503, std.dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.93% (15.6656 => 15.3629, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.72% (2.6115 => 2.5665, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.42% (3.7295 => 3.6765, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.39% (0.7905 => 0.7795, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.26% (3.7291 => 3.6822, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.17% (8.4158 => 8.3172, std.dev.: 0.0074) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.34% (0.6245 => 0.6224, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: -0.57% (17.2494 => 17.1506, std.dev.: 0.0050) MultiSource/Applications/kimwitu++/kc: -0.66% (15.6674 => 15.5633, std.dev.: 0.0143) MultiSource/Benchmarks/Bullet/bullet: -0.53% (56.1901 => 55.8948, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.42% (0.0480 => 0.0478, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.42% (0.0481 => 0.0479, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.22% (0.0450 => 0.0449, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0450 => 0.0450, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.45% (0.0440 => 0.0438) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.45% (0.0441 => 0.0439, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.46% (0.0434 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.46% (0.0435 => 0.0433, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.22% (0.0451 => 0.0450, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.44% (0.0453 => 0.0451, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.45% (0.0446 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.45% (0.0447 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.23% (0.0435 => 0.0434) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.46% (0.0437 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.45% (0.0443 => 0.0441, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.45% (0.0444 => 0.0442, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.22% (0.0454 => 0.0453, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.22% (0.0455 => 0.0454, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.23% (0.0431 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.23% (0.0431 => 0.0430, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.45% (0.0443 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.23% (0.0444 => 0.0443, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.23% (0.0434 => 0.0433) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.23% (0.0435 => 0.0434) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.23% (0.0426 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.47% (0.0428 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.24% (0.0424 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.23% (0.0426 => 0.0425) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.22% (0.0462 => 0.0461, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.43% (0.0463 => 0.0461, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.24% (0.0424 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.24% (0.0425 => 0.0424) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.24% (0.0425 => 0.0424, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.47% (0.0426 => 0.0424, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.46% (0.0433 => 0.0431, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.23% (0.0434 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.65% (1.4891 => 1.4794, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.42% (8.2151 => 8.1808, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.44% (0.6882 => 0.6852, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1436 => 0.1436, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.09% (0.2134 => 0.2132, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.62% (63.2438 => 55.8948, std.dev.: 0.0048) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/MallocBench/gs/gs: 12.32% (4.1105 => 4.6168, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.59% (3.4629 => 5.7689, std.dev.: 0.0016) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13479.86% (0.0720 => 9.7775, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050200.00% (0.0001 => 10.0503, std.dev.: 0.0010) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.23% (0.2554 => 0.4169, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/lowercase: 55.86% (0.0256 => 0.0399) MultiSource/Benchmarks/PAQ8p/paq8p: 48.19% (10.3673 => 15.3629, std.dev.: 0.0031) SingleSource/UnitTests/SignlessTypes/factor: 45.27% (0.0296 => 0.0430, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 42.07% (0.0271 => 0.0385, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 40.63% (1.5859 => 2.2302, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/richards_benchmark: 35.94% (0.1622 => 0.2205, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 35.61% (0.1056 => 0.1432, std.dev.: 0.0003) SingleSource/UnitTests/vla: 32.11% (0.0355 => 0.0469, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 29.67% (2.2024 => 2.8559, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 25.36% (0.1463 => 0.1834, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 24.22% (0.0834 => 0.1036, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.05% (0.1566 => 0.1880, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: 20.01% (0.2049 => 0.2459, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 18.09% (0.1432 => 0.1691, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.91% (7.0540 => 8.3172, std.dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.80% (0.0871 => 0.1026, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 17.49% (0.1555 => 0.1827, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.20% (0.5105 => 0.5983, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 16.78% (0.6675 => 0.7795, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.54% (2.2022 => 2.5665, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: 16.44% (0.1655 => 0.1927, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.97% (1.3050 => 1.5134, std.dev.: 0.0025) MultiSource/Applications/d/make_dparser: 15.81% (3.3354 => 3.8627, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 15.54% (0.2271 => 0.2624, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/em3d/em3d: 15.34% (0.1695 => 0.1955, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 15.28% (0.1440 => 0.1660, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.23% (0.4615 => 0.5318, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 15.06% (0.1175 => 0.1352, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.02% (0.1032 => 0.1187, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 14.96% (0.1163 => 0.1337, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.88% (0.1337 => 0.1536, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.86% (0.5020 => 0.5766, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.71% (1.5415 => 1.7682, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 14.63% (0.0793 => 0.0909, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.50% (0.1510 => 0.1729, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 14.46% (0.8172 => 0.9354, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.45% (0.0886 => 0.1014, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 14.43% (0.7115 => 0.8142, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.25% (0.0842 => 0.0962, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 14.15% (0.3109 => 0.3549, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 14.08% (0.3282 => 0.3744, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.07% (0.1940 => 0.2213, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 14.05% (10.4361 => 11.9020, std.dev.: 0.0196) MultiSource/Benchmarks/McCat/18-imp/imp: 13.82% (0.3423 => 0.3896, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.76% (4.2646 => 4.8514, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 13.70% (0.1584 => 0.1801, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.68% (0.9765 => 1.1101, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: 13.67% (0.0746 => 0.0848, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/exptree: 13.64% (0.0814 => 0.0925, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.60% (0.0838 => 0.0952) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.59% (0.1236 => 0.1404, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 13.53% (0.6450 => 0.7323, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 13.49% (1.1642 => 1.3212, std.dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.46% (0.3121 => 0.3541, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 13.39% (9.4845 => 10.7544, std.dev.: 0.0137) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.38% (0.2107 => 0.2389, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.38% (1.7609 => 1.9965, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/matrix: 13.33% (0.0818 => 0.0927, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 13.21% (0.1151 => 0.1303, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.13% (0.2758 => 0.3120, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.12% (0.0770 => 0.0871, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.12% (0.1906 => 0.2156, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.08% (0.0933 => 0.1055, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.07% (0.1117 => 0.1263, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.05% (0.5860 => 0.6625, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: 12.98% (0.7835 => 0.8852, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 12.94% (1.4186 => 1.6021, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 12.93% (8.1363 => 9.1880, std.dev.: 0.0080) MultiSource/Applications/oggenc/oggenc: 12.90% (5.7591 => 6.5020, std.dev.: 0.0117) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.73% (0.1438 => 0.1621, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 12.72% (2.0273 => 2.2851, std.dev.: 0.0105) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.71% (0.1062 => 0.1197, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 12.69% (0.2065 => 0.2327, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.68% (0.1695 => 0.1910, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 12.65% (0.7433 => 0.8373, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.63% (0.1029 => 0.1159, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 12.49% (1.1840 => 1.3319, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.48% (0.2700 => 0.3037, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 12.32% (1.0722 => 1.2043, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.29% (0.5981 => 0.6716, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.27% (0.0929 => 0.1043, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.25% (0.1625 => 0.1824, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/rem: 12.24% (0.1144 => 0.1284, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.11% (4.9449 => 5.5438, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.09% (5.0018 => 5.6065, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 12.02% (3.8723 => 4.3376, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/health/health: 11.99% (0.1268 => 0.1420, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.99% (0.8067 => 0.9034, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: 11.90% (0.3387 => 0.3790, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 11.86% (0.4299 => 0.4809, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.81% (0.4879 => 0.5455, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.79% (0.3307 => 0.3697, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.73% (0.1330 => 0.1486, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.71% (1.1861 => 1.3250, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.68% (0.2603 => 0.2907, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.60% (0.5569 => 0.6215, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.52% (0.3177 => 0.3543, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 11.46% (0.8921 => 0.9943, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.38% (0.1125 => 0.1253, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.25% (7.9617 => 8.8576, std.dev.: 0.0095) MultiSource/Benchmarks/McCat/09-vor/vor: 11.10% (0.3180 => 0.3533, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.99% (0.3441 => 0.3819, std.dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.67% (0.1143 => 0.1265) SingleSource/Benchmarks/Misc-C++/bigfib: 10.67% (0.6456 => 0.7145, std.dev.: 0.0018) MultiSource/Applications/hbd/hbd: 10.61% (1.5603 => 1.7259, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 10.61% (0.3092 => 0.3420, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.32% (0.8101 => 0.8937, std.dev.: 0.0047) MultiSource/Applications/siod/siod: 10.11% (2.2969 => 2.5291, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.10% (0.1892 => 0.2083, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.05% (0.3473 => 0.3822, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/parameter-passing: 10.03% (0.3927 => 0.4321, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.01% (0.3497 => 0.3847, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.97% (0.3561 => 0.3916, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 9.96% (0.3543 => 0.3896, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.91% (0.3543 => 0.3894, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-3: 9.87% (0.3516 => 0.3863, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.85% (0.3828 => 0.4205, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.84% (0.2266 => 0.2489, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 9.83% (0.3694 => 0.4057, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/property: 9.78% (0.3886 => 0.4266, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 9.70% (0.4289 => 0.4705, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash2: 9.33% (0.4620 => 0.5051, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.12% (0.3826 => 0.4175, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 8.98% (21.9371 => 23.9066, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.95% (0.3865 => 0.4211, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 8.91% (0.3422 => 0.3727, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.59% (0.4203 => 0.4564, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.46% (0.4636 => 0.5028, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists1: 8.39% (0.3684 => 0.3993, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.38% (0.4103 => 0.4447, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 8.37% (0.4048 => 0.4387, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.20% (0.3427 => 0.3708, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 8.19% (0.6030 => 0.6524, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 8.08% (17.1811 => 18.5697, std.dev.: 0.0169) SingleSource/UnitTests/ObjC++/Hello: 8.07% (0.5925 => 0.6403, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 7.53% (0.7326 => 0.7878, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.49% (0.2430 => 0.2612, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 7.47% (0.3603 => 0.3872, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.45% (3.8922 => 4.1822, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.39% (14.3668 => 15.4286, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.23% (0.4064 => 0.4358, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.21% (0.3650 => 0.3913, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 7.13% (0.3098 => 0.3319, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.02% (0.2891 => 0.3094, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.85% (0.2905 => 0.3104, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.80% (0.2793 => 0.2983, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.75% (0.2831 => 0.3022, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.58% (0.3283 => 0.3499, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.57% (0.2725 => 0.2904, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary: 6.56% (0.3232 => 0.3444, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.49% (0.2756 => 0.2935, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.45% (0.3052 => 0.3249, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.45% (0.3162 => 0.3366, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.44% (0.2872 => 0.3057, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.41% (0.3136 => 0.3337, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.39% (2.0665 => 2.1986, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 6.37% (0.2871 => 0.3054, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.28% (0.2802 => 0.2978, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.24% (0.3379 => 0.3590, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.22% (0.2877 => 0.3056, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 6.15% (0.2714 => 0.2881, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 5.78% (1.2842 => 1.3584, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/objinst: 5.05% (0.3131 => 0.3289, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.54% (0.3935 => 0.4035, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.44% (1.1194 => 1.1467, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8962, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3124, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: 24.72% (3.3453 => 4.1724, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 17.04% (0.9957 => 1.1654, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.58% (0.2944 => 0.3285, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.78% (1.1396 => 1.2510, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 6.61% (3.1578 => 3.3665, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 5.94% (1.9405 => 2.0558, std.dev.: 0.0007) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.63% (0.3987 => 0.4092, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.54% (4.2280 => 4.3353, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.99% (3.6395 => 3.7118, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/bisort/bisort: 1.90% (0.8333 => 0.8491, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.59% (2.6546 => 2.6967, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2077, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 1.22% (4.4649 => 4.5195, std.dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.02% (6.6874 => 0.1324, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -80.01% (0.8651 => 0.1729, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.20% (5.2763 => 3.2078, std.dev.: 0.0161) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.73% (5.3855 => 3.6765, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -31.21% (5.3526 => 3.6822, std.dev.: 0.0057) SingleSource/UnitTests/Vector/constpool: -14.68% (54.1659 => 46.2132, std.dev.: 0.0742) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.87% (2.9384 => 2.6190, std.dev.: 0.0074) MultiSource/Applications/ClamAV/clamscan: -6.83% (22.1758 => 20.6604, std.dev.: 0.0169) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.09% (8.0499 => 3.7764, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7645, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4752, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.95% (1.6925 => 1.4226, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.70% (1.2258 => 1.0701, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.39% (1.2373 => 1.0964, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/mandel-2: -11.00% (1.5373 => 1.3682, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.26% (19.9488 => 18.3013, std.dev.: 0.0692) MultiSource/Benchmarks/FreeBench/mason/mason: -7.96% (0.2161 => 0.1989, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.01% (1.8329 => 1.7045, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4781, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5753, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.16% (1.6805 => 1.5938, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.91% (1.5835 => 1.5057, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.28% (8.1563 => 7.8071, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.62% (3.2827 => 3.1638, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8776, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5025, std.dev.: 0.0028) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.64% (0.4808 => 0.4681, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: -2.37% (4.6441 => 4.5340, std.dev.: 0.0025) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -1.87% (10.2830 => 10.0907, std.dev.: 0.0114) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6819, std.dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -1.62% (2.5528 => 2.5114, std.dev.: 0.0035) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4202, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2878, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/whetstone: -1.08% (1.0554 => 1.0440, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 19.03% (0.5229 => 0.6224, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 14.42% (14.9895 => 17.1506, std.dev.: 0.0050) MultiSource/Applications/kimwitu++/kc: 9.95% (14.1553 => 15.5633, std.dev.: 0.0143) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 33.91% (1.1048 => 1.4794, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.29% (7.1582 => 8.1808, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.13% (0.6222 => 0.6852, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.30% (0.1485 => 0.1436, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.76% (0.2116 => 0.2132, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 22 13:22:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 22 Oct 2012 15:22:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121022202214.1B2482A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5099?compare_to=5096&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5099, Order: 166425, Start Time: 2012-10-22 18:59:19, End Time: 2012-10-22 20:25:12 To: 5096, Order: 166421, Start Time: 2012-10-22 17:03:35, End Time: 2012-10-22 18:29:38 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (200 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1040 (665 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash2: 3.34% (3.3043 => 3.4148, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.14% (9.9237 => 10.0366, std.dev.: 0.0004) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 23.96% (2.0176 => 2.5010, std.dev.: 0.0117) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.85% (0.1410 => 0.1704, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 18.28% (0.0826 => 0.0977) MultiSource/Benchmarks/McCat/08-main/main: 17.43% (0.2243 => 0.2634, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 17.18% (0.1013 => 0.1187, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.09% (0.0746 => 0.0866, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.08% (0.0653 => 0.0758, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.88% (0.7710 => 0.8934, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.92% (0.1327 => 0.1525, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 14.70% (0.2721 => 0.3121, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.53% (0.0977 => 0.1119, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.41% (0.2596 => 0.2970, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.39% (0.0834 => 0.0954, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.20% (0.1986 => 0.2268, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.15% (0.1413 => 0.1613, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.93% (0.0811 => 0.0924, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 13.92% (0.0819 => 0.0933, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 13.89% (1.3693 => 1.5595, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 13.86% (0.1003 => 0.1142, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.74% (0.9199 => 1.0463, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.70% (0.0847 => 0.0963, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.31% (0.6959 => 0.7885, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.29% (0.5637 => 0.6386, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.26% (3.9660 => 4.4918, std.dev.: 0.0077) MultiSource/Applications/lambda-0_1_3/lambda: 13.21% (0.7038 => 0.7968, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.17% (0.0964 => 0.1091, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.12% (0.5265 => 0.5956, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.12% (0.1075 => 0.1216, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/mst/mst: 12.87% (0.1111 => 0.1254, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.85% (0.1588 => 0.1792, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 12.81% (0.1062 => 0.1198, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.80% (0.7460 => 0.8415, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.77% (0.1276 => 0.1439, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.70% (0.2914 => 0.3284, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.48% (0.5577 => 0.6273, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 12.48% (0.4328 => 0.4868, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 12.35% (0.0818 => 0.0919, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 12.31% (0.1478 => 0.1660, std.dev.: 0.0014) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.22% (0.1072 => 0.1203) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.18% (1.4563 => 1.6337, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: 12.14% (1.1061 => 1.2404, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.13% (0.1014 => 0.1137, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.03% (1.2193 => 1.3660, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 11.97% (13.8202 => 15.4745, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.95% (0.6283 => 0.7034, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.91% (1.1364 => 1.2717, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.81% (0.2023 => 0.2262, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.58% (0.1157 => 0.1291, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash: 11.57% (0.4062 => 0.4532, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.55% (0.3246 => 0.3621, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.53% (0.4379 => 0.4884, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.53% (0.1865 => 0.2080, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.47% (0.2127 => 0.2371, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 11.43% (0.7506 => 0.8364, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: 11.38% (0.5818 => 0.6480, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 11.29% (0.1657 => 0.1844, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.26% (0.3899 => 0.4338, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 11.25% (0.2995 => 0.3332, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 11.20% (3.8646 => 4.2974, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.18% (0.3130 => 0.3480, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.17% (0.4791 => 0.5326, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 11.12% (0.5748 => 0.6387, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 10.84% (0.2925 => 0.3242, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 10.79% (1.0313 => 1.1426, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 10.79% (0.7061 => 0.7823, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.72% (0.3022 => 0.3346, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.69% (0.1048 => 0.1160, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.65% (0.3485 => 0.3856, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 10.64% (0.1589 => 0.1758, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.62% (0.3756 => 0.4155, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.62% (0.1789 => 0.1979, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.61% (0.3580 => 0.3960, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 10.56% (0.3220 => 0.3560, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 10.51% (1.9270 => 2.1295, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.46% (0.4016 => 0.4436, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.45% (0.1569 => 0.1733, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 10.44% (0.6744 => 0.7448, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 10.39% (0.2781 => 0.3070, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.35% (7.2180 => 7.9653, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/lists: 10.23% (0.3293 => 0.3630, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 10.22% (0.1213 => 0.1337, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 10.18% (0.8310 => 0.9156, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.17% (0.1435 => 0.1581, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 10.11% (3.1889 => 3.5112, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 10.07% (16.6129 => 18.2866, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.06% (0.2782 => 0.3062, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.06% (0.3489 => 0.3840, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 10.05% (0.3453 => 0.3800, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 10.01% (0.2726 => 0.2999, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 10.01% (0.3868 => 0.4255, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.96% (0.8698 => 0.9564, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 9.93% (0.2760 => 0.3034, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 9.90% (2.1791 => 2.3948, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 9.88% (0.3149 => 0.3460, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.85% (1.3245 => 1.4550, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.83% (1.9828 => 2.1777, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.79% (0.4390 => 0.4820, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 9.76% (0.3534 => 0.3879, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 9.74% (0.2761 => 0.3030, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.72% (3.6692 => 4.0258, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary: 9.69% (0.3107 => 0.3408) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.68% (0.2966 => 0.3253, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 9.63% (0.2607 => 0.2858, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.58% (0.2765 => 0.3030, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.58% (0.2140 => 0.2345, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/random: 9.55% (0.2690 => 0.2947, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.53% (0.2655 => 0.2908, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 9.50% (0.2937 => 0.3216, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 9.40% (0.2628 => 0.2875, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 9.37% (0.2988 => 0.3268, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.35% (4.4433 => 4.8586, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/ary2: 9.34% (0.3192 => 0.3490, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.33% (4.3801 => 4.7888, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.31% (4.9865 => 5.4509, std.dev.: 0.0176) MultiSource/Benchmarks/nbench/nbench: 9.09% (1.0594 => 1.1557, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 9.07% (0.4113 => 0.4486, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.05% (0.2696 => 0.2940, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.03% (0.3755 => 0.4094, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.97% (0.3511 => 0.3826, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.93% (0.6576 => 0.7163, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.92% (0.2321 => 0.2528, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.90% (0.6135 => 0.6681, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 8.90% (0.2945 => 0.3207, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 8.68% (14.8535 => 16.1434, std.dev.: 0.0160) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.63% (0.1819 => 0.1976, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 8.54% (1.2749 => 1.3838, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 8.53% (0.3131 => 0.3398, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 8.36% (8.4961 => 9.2062, std.dev.: 0.0051) MultiSource/Applications/oggenc/oggenc: 8.21% (4.6629 => 5.0457, std.dev.: 0.0132) SingleSource/Benchmarks/Misc-C++/bigfib: 8.21% (0.6250 => 0.6763, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.19% (1.5188 => 1.6432, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.15% (0.8818 => 0.9537, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.14% (1.1333 => 1.2256, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.04% (3.2742 => 3.5374, std.dev.: 0.0026) MultiSource/Applications/lua/lua: 7.92% (3.7467 => 4.0436, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/neural/neural: 7.87% (0.1385 => 0.1494, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.80% (0.9108 => 0.9818, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.77% (0.3245 => 0.3497, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.58% (0.4805 => 0.5169, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 7.58% (6.5754 => 7.0735, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.52% (2.1007 => 2.2586, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.35% (0.2504 => 0.2688, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.22% (0.2243 => 0.2405, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 7.18% (1.2292 => 1.3175, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 7.17% (0.2008 => 0.2152, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.15% (6.2785 => 6.7276, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.90% (13.2842 => 14.2010, std.dev.: 0.0060) SingleSource/UnitTests/ObjC/parameter-passing: 6.87% (0.4003 => 0.4278, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 6.85% (0.3914 => 0.4182, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.60% (0.3940 => 0.4200, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.57% (0.3789 => 0.4038, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 6.57% (0.3578 => 0.3813, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.53% (0.3646 => 0.3884, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.47% (0.3601 => 0.3834, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 6.44% (0.3663 => 0.3899, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.38% (0.3650 => 0.3883, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 6.32% (0.3623 => 0.3852, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 5.97% (0.1777 => 0.1883, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 5.24% (16.2614 => 17.1127, std.dev.: 0.0281) MultiSource/Applications/ClamAV/clamscan: 4.79% (14.5298 => 15.2265, std.dev.: 0.0143) MultiSource/Benchmarks/Olden/bh/bh: 3.71% (0.2859 => 0.2965, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 2.37% (33.2944 => 34.0847, std.dev.: 0.0182) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.66% (0.4846 => 0.6962, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5183, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/fbench: 23.77% (1.8175 => 2.2495, std.dev.: 0.0194) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.07% (1.0895 => 1.2755, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/richards_benchmark: 11.19% (1.1560 => 1.2854, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 8.99% (0.8273 => 0.9017, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.70% (0.1322 => 0.1437, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.60% (3.1736 => 3.4148, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.42% (0.9692 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 5.24% (1.2998 => 1.3679, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.66% (1.9144 => 2.0036, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.52% (0.3139 => 0.3281, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 4.48% (0.5449 => 0.5693, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.45% (2.8606 => 2.9880, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7756, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9860, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 3.37% (12.0921 => 12.5001, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 3.35% (10.7476 => 11.1079, std.dev.: 0.0372) MultiSource/Benchmarks/nbench/nbench: 3.21% (11.2619 => 11.6230, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bisort/bisort: 2.84% (0.8239 => 0.8473, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.39% (1.0310 => 1.0556, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.18% (7.4271 => 7.5893, std.dev.: 0.0027) MultiSource/Applications/lemon/lemon: 1.77% (1.4298 => 1.4551, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.48% (2.0200 => 2.0499, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 1.44% (8.3908 => 8.5117, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.37% (1.9433 => 1.9699, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2123, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1885, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5783, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.18% (9.9194 => 10.0366, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.17% (5.1531 => 5.2136, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 1.09% (12.4560 => 12.5919, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/queens: 1.00% (2.1753 => 2.1971, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.59% (0.2670 => 0.1426, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.43% (0.4657 => 0.3892, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.00% (1.3813 => 1.2155, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.87% (1.3819 => 1.2179, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.28% (1.0460 => 0.8548, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -12.96% (0.2238 => 0.1948, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.12% (20.3410 => 18.2835, std.dev.: 0.0156) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.19% (1.9290 => 1.8096, std.dev.: 0.0125) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.12% (1.3780 => 1.2937, std.dev.: 0.0104) SingleSource/Benchmarks/McGill/chomp: -5.61% (1.2308 => 1.1617, std.dev.: 0.0074) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.56% (0.9996 => 0.9540, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9654, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.80% (1.7688 => 1.7015, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -2.88% (3.2729 => 3.1788, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: -2.84% (3.0263 => 2.9405, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: -2.74% (1.9762 => 1.9221, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8811, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4782, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.44% (4.1080 => 4.0079, std.dev.: 0.0047) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.94% (0.6589 => 0.6461, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.86% (0.6615 => 0.6492) SingleSource/Benchmarks/Shootout/lists: -1.77% (6.3560 => 6.2435, std.dev.: 0.0057) MultiSource/Applications/lua/lua: -1.73% (26.5159 => 26.0563, std.dev.: 0.0332) SingleSource/Benchmarks/Misc/fp-convert: -1.66% (3.4016 => 3.3453, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.65% (0.8342 => 0.8204, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.62% (2.5254 => 2.4845, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (7.1097 => 7.0070, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.26% (5.3167 => 5.2497, std.dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: -1.24% (28.2225 => 27.8717, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/heapsort: -1.16% (3.9173 => 3.8717, std.dev.: 0.0007) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1138, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -1.05% (84.4286 => 83.5431, std.dev.: 0.0044) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 5.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 22 14:33:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 22 Oct 2012 16:33:48 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121022213348.2C1932A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5100?compare_to=5097&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5100, Order: 166435, Start Time: 2012-10-22 20:12:21, End Time: 2012-10-22 21:35:51 To: 5097, Order: 166423, Start Time: 2012-10-22 18:31:02, End Time: 2012-10-22 19:54:45 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 1 (1 on baseline) Performance Regressions: 7 (13 on baseline) Performance Improvements: 9 (7 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 958 (954 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- MultiSource/Applications/SPASS/SPASS MultiSource/Applications/SPASS/SPASS: 4.63% (8.1125 => 8.4881, std.dev.: 0.3105) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/Burg/burg: 1.81% (1.2373 => 1.2597, std.dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 6.69% (3.5455 => 3.7828, std.dev.: 0.0465) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.91% (59.0560 => 60.7716, std.dev.: 0.3657) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.74% (4.3563 => 4.4322, std.dev.: 0.0165) MultiSource/Benchmarks/llubenchmark/llu: 1.36% (1.9950 => 2.0222, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.24% (3.7360 => 3.7824, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.09% (6.7260 => 6.7994, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/football/football: -2.89% (0.8886 => 0.8629, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.24% (0.8474 => 0.8369, std.dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -7.35% (3.2570 => 3.0177, std.dev.: 0.0838) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.54% (7.2025 => 7.0193, std.dev.: 0.0639) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.33% (2.5326 => 2.4735, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/lists1: -1.61% (0.6211 => 0.6111, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/ary3: -1.50% (2.1237 => 2.0919, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.04% (2.9536 => 2.9229, std.dev.: 0.0049) MultiSource/Applications/lua/lua: -1.02% (28.6001 => 28.3090, std.dev.: 0.0851) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.32% (16.4589 => 16.4057, std.dev.: 0.1370) MultiSource/Applications/obsequi/Obsequi: -0.64% (1.0377 => 1.0311, std.dev.: 0.0223) MultiSource/Applications/sqlite3/sqlite3: 0.62% (0.6321 => 0.6360, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/08-main/main: 3.28% (0.1888 => 0.1950, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.48% (0.1620 => 0.1644, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.03% (0.3225 => 0.3224, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.09% (0.2483 => 0.2456, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.33% (0.3353 => 0.3342, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.17% (0.2367 => 0.2371, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/bigfib: -0.35% (0.5959 => 0.5938, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: 16.27% (0.0381 => 0.0443, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.36% (0.3299 => 0.3287, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: -0.80% (0.1991 => 0.1975, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -5.39% (0.0241 => 0.0228, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -18.40% (0.0212 => 0.0173, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.48% (0.0420 => 0.0418, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.04% (0.0294 => 0.0288, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -23.13% (0.0307 => 0.0236, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.20% (0.0415 => 0.0420, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0197 => 0.0197, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/test1: -22.81% (0.0171 => 0.0132, std.dev.: 0.0037) SingleSource/UnitTests/byval-alignment: -14.87% (0.0316 => 0.0269, std.dev.: 0.0031) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 62.50% (0.0008 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 0.14% (0.1480 => 0.1482, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 2.44% (1.1291 => 1.1566, std.dev.: 0.0158) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.67% (0.1501 => 0.1476, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.32% (0.4214 => 0.4396, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.92% (0.1404 => 0.1431, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.78% (0.0631 => 0.0563, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -10.70% (0.0215 => 0.0192, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.43% (0.0560 => 0.0552, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.36% (1.1398 => 1.1357, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -79.31% (0.0029 => 0.0006, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 25.00% (0.0012 => 0.0015, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -15.04% (0.0625 => 0.0531, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.29% (0.0205 => 0.0222, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.19% (0.8023 => 0.8008, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -36.08% (0.0097 => 0.0062, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.32% (2.1832 => 1.6522, std.dev.: 0.0077) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.20% (0.7473 => 0.7712, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: 3.07% (1.2222 => 1.2597, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.36% (0.8286 => 0.8399, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.66% (1.5795 => 2.5061, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.01% (0.3186 => 0.3505, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.68% (1.1857 => 1.2768, std.dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 5.92% (63.1822 => 66.9246, std.dev.: 0.0697) MultiSource/Applications/siod/siod: 2.71% (3.6643 => 3.7635, std.dev.: 0.0118) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.54% (59.2638 => 60.7716, std.dev.: 0.3657) SingleSource/Benchmarks/Misc/ReedSolomon: 2.07% (8.5322 => 8.7089, std.dev.: 0.0562) MultiSource/Benchmarks/Olden/bh/bh: 1.84% (2.3560 => 2.3994, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.77% (4.3552 => 4.4322, std.dev.: 0.0165) MultiSource/Benchmarks/llubenchmark/llu: 1.28% (1.9967 => 2.0222, std.dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -8.35% (3.2926 => 3.0177, std.dev.: 0.0838) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.20% (0.3269 => 0.3001, std.dev.: 0.0011) MultiSource/Applications/lua/lua: -5.11% (29.8330 => 28.3090, std.dev.: 0.0851) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.47% (3.9188 => 3.7828, std.dev.: 0.0465) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.69% (7.2130 => 7.0193, std.dev.: 0.0639) SingleSource/Benchmarks/Shootout-C++/hash2: -1.55% (3.4237 => 3.3708, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.31% (3.3479 => 3.3039, std.dev.: 0.0034) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.25% (16.4461 => 16.4057, std.dev.: 0.1370) MultiSource/Applications/obsequi/Obsequi: 0.48% (1.0262 => 1.0311, std.dev.: 0.0223) MultiSource/Applications/sqlite3/sqlite3: 0.44% (0.6332 => 0.6360, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/08-main/main: 6.50% (0.1831 => 0.1950, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.45% (0.1559 => 0.1644, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.23% (0.3123 => 0.3224, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.28% (0.2463 => 0.2456, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.06% (0.3344 => 0.3342, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.30% (0.2364 => 0.2371, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/bigfib: -1.20% (0.6010 => 0.5938, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: 3.26% (0.0429 => 0.0443, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.64% (0.3266 => 0.3287, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 0.30% (0.1969 => 0.1975, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.79% (0.0224 => 0.0228, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 40.65% (0.0123 => 0.0173, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.45% (0.0408 => 0.0418, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 13.39% (0.0254 => 0.0288, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -21.85% (0.0302 => 0.0236, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.38% (0.0384 => 0.0420, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/casts: 3.68% (0.0190 => 0.0197, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/test1: -26.67% (0.0180 => 0.0132, std.dev.: 0.0037) SingleSource/UnitTests/byval-alignment: 16.96% (0.0230 => 0.0269, std.dev.: 0.0031) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 3.06% (0.1438 => 0.1482, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 2.09% (1.1329 => 1.1566, std.dev.: 0.0158) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.96% (0.1462 => 0.1476, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.57% (0.4164 => 0.4396, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.53% (0.1369 => 0.1431, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -12.17% (0.0641 => 0.0563, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.54% (0.0195 => 0.0192, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.50% (0.0578 => 0.0552, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.70% (1.1437 => 1.1357, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 500.00% (0.0001 => 0.0006, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 7.14% (0.0014 => 0.0015, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -15.31% (0.0627 => 0.0531, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.33% (0.0180 => 0.0222, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.11% (0.8017 => 0.8008, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0062 => 0.0062, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 22 15:01:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 22 Oct 2012 17:01:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121022220153.6B0C32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5101?compare_to=5098&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5101, Order: 166436, Start Time: 2012-10-22 20:43:41, End Time: 2012-10-22 22:03:54 To: 5098, Order: 166425, Start Time: 2012-10-22 18:54:33, End Time: 2012-10-22 20:14:13 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (5 on baseline) Performance Regressions: 7 (190 on baseline) Performance Improvements: 1 (45 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 88 (14 on baseline) Unchanged Tests: 946 (652 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 6.53% (15.3629 => 16.3662, std.dev.: 0.0075) MultiSource/Applications/JM/ldecod/ldecod: 1.75% (11.9020 => 12.1098, std.dev.: 0.0105) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.73% (2.5665 => 2.6108, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.59% (8.3172 => 8.4494, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.55% (3.6765 => 3.7334, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.52% (3.6822 => 3.7380, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 1.19% (23.9066 => 24.1913, std.dev.: 0.0069) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.15% (1.1654 => 1.1287, std.dev.: 0.0035) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.24% (0.6224 => 0.6239, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 0.38% (17.1506 => 17.2151, std.dev.: 0.0173) MultiSource/Applications/kimwitu++/kc: -0.02% (15.5633 => 15.5600, std.dev.: 0.0083) MultiSource/Benchmarks/Bullet/bullet: 0.43% (55.8948 => 56.1350, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.63% (0.0478 => 0.0481) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.84% (0.0479 => 0.0483) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.45% (0.0449 => 0.0451) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.44% (0.0450 => 0.0452) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.46% (0.0438 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.46% (0.0439 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.46% (0.0432 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.46% (0.0433 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.22% (0.0450 => 0.0451, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.44% (0.0451 => 0.0453) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.45% (0.0444 => 0.0446, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.45% (0.0445 => 0.0447) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.46% (0.0434 => 0.0436) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.69% (0.0435 => 0.0438, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.68% (0.0441 => 0.0444, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.68% (0.0442 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.44% (0.0453 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.44% (0.0454 => 0.0456) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.23% (0.0430 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.47% (0.0430 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.68% (0.0441 => 0.0444) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.23% (0.0443 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.46% (0.0433 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.46% (0.0434 => 0.0436) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.47% (0.0425 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.47% (0.0426 => 0.0428) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.47% (0.0423 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.47% (0.0425 => 0.0427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.43% (0.0461 => 0.0463, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.65% (0.0461 => 0.0464) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.24% (0.0423 => 0.0424, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.24% (0.0424 => 0.0425, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.47% (0.0424 => 0.0426) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.71% (0.0424 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.46% (0.0431 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.23% (0.0433 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.33% (1.4794 => 1.4843, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.14% (8.1808 => 8.1925, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.04% (0.6852 => 0.6849, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1436 => 0.1436, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.09% (0.2132 => 0.2134, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.24% (63.2438 => 56.1350, std.dev.: 0.0023) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/MallocBench/gs/gs: 12.56% (4.1105 => 4.6269, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.13% (3.4629 => 5.7877, std.dev.: 0.0161) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13490.42% (0.0720 => 9.7851, std.dev.: 0.0120) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050100.00% (0.0001 => 10.0502, std.dev.: 0.0006) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.27% (0.2554 => 0.4170, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 57.86% (10.3673 => 16.3662, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/lowercase: 55.47% (0.0256 => 0.0398, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 45.27% (0.0296 => 0.0430, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 41.70% (0.0271 => 0.0384) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 40.72% (1.5859 => 2.2316, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 39.77% (0.1622 => 0.2267, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 36.36% (0.1056 => 0.1440, std.dev.: 0.0001) SingleSource/UnitTests/vla: 31.27% (0.0355 => 0.0466, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 29.73% (2.2024 => 2.8571, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/neural/neural: 25.22% (0.1463 => 0.1832, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 24.58% (0.0834 => 0.1039, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 20.25% (0.2049 => 0.2464, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.18% (0.1566 => 0.1882, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.78% (7.0540 => 8.4494, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 19.20% (0.1432 => 0.1707, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.55% (2.2022 => 2.6108, std.dev.: 0.0040) MultiSource/Applications/viterbi/viterbi: 17.94% (0.1555 => 0.1834, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.91% (0.0871 => 0.1027, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.10% (0.5105 => 0.5978, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 16.81% (0.6675 => 0.7797, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 16.27% (3.3354 => 3.8780, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout/lists: 16.13% (0.0626 => 0.0727, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 16.07% (0.1655 => 0.1921, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 16.04% (10.4361 => 12.1098, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.93% (1.3050 => 1.5129, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: 15.83% (0.1440 => 0.1668, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 15.50% (0.2271 => 0.2623, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 15.46% (0.1695 => 0.1957, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 15.33% (0.3282 => 0.3785, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.26% (0.1337 => 0.1541, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.19% (0.4615 => 0.5316, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 15.15% (0.1175 => 0.1353, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 15.05% (0.1163 => 0.1338, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.92% (0.1032 => 0.1186, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.86% (1.5415 => 1.7705, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.83% (0.1510 => 0.1734, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 14.79% (0.7115 => 0.8167, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 14.77% (0.8172 => 0.9379, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.68% (0.5020 => 0.5757, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 14.63% (0.0793 => 0.0909, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.48% (0.0746 => 0.0854, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.45% (0.0886 => 0.1014, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.12% (0.1940 => 0.2214, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.08% (4.2646 => 4.8650, std.dev.: 0.0131) MultiSource/Applications/sgefa/sgefa: 14.02% (0.3109 => 0.3545, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.96% (0.0838 => 0.0955, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/matrix: 13.94% (0.0818 => 0.0932) MultiSource/Benchmarks/McCat/18-imp/imp: 13.94% (0.3423 => 0.3900, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.90% (0.0842 => 0.0959, std.dev.: 0.0031) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 13.89% (0.1584 => 0.1804, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.84% (0.9765 => 1.1116, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.68% (0.3121 => 0.3548, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/exptree: 13.64% (0.0814 => 0.0925, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 13.56% (1.1642 => 1.3221, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.51% (0.1236 => 0.1403, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.48% (0.2107 => 0.2391, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 13.44% (9.4845 => 10.7595, std.dev.: 0.0135) MultiSource/Applications/oggenc/oggenc: 13.39% (5.7591 => 6.5303, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.34% (0.2758 => 0.3126, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.34% (0.1117 => 0.1266, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.29% (8.1363 => 9.2176, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.28% (0.5860 => 0.6638, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 13.16% (0.6450 => 0.7299, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 13.12% (0.7835 => 0.8863, std.dev.: 0.0037) MultiSource/Applications/aha/aha: 13.12% (0.1151 => 0.1302, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.12% (0.0770 => 0.0871, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.01% (0.1906 => 0.2154, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.00% (1.7609 => 1.9899, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 12.99% (1.4186 => 1.6029, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.92% (0.1695 => 0.1914, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 12.91% (2.0273 => 2.2891, std.dev.: 0.0091) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.89% (0.2700 => 0.3048, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 12.83% (0.2065 => 0.2330, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.75% (0.0933 => 0.1052, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.73% (0.1029 => 0.1160, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.73% (0.1438 => 0.1621, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 12.72% (1.1840 => 1.3346, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 12.66% (0.7433 => 0.8374, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.66% (0.0798 => 0.0899, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.62% (0.1062 => 0.1196, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.47% (0.5981 => 0.6727, std.dev.: 0.0026) MultiSource/Applications/lemon/lemon: 12.46% (1.0722 => 1.2058, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.38% (4.9449 => 5.5570, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.37% (0.8067 => 0.9065, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.37% (5.0018 => 5.6203, std.dev.: 0.0024) MultiSource/Applications/lua/lua: 12.31% (3.8723 => 4.3489, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.31% (0.1625 => 0.1825, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/rem: 12.24% (0.1144 => 0.1284, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.24% (0.4879 => 0.5476, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.16% (0.0929 => 0.1042, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 12.13% (0.3387 => 0.3798, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 11.99% (0.1268 => 0.1420, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.85% (0.5569 => 0.6229, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.80% (0.3177 => 0.3552, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.80% (1.1861 => 1.3261, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.77% (7.9617 => 8.8987, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.73% (0.3307 => 0.3695, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.73% (0.1330 => 0.1486, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 11.70% (0.4299 => 0.4802, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.60% (0.2603 => 0.2905, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 11.48% (0.8921 => 0.9945, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 11.32% (0.3180 => 0.3540, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.29% (0.1125 => 0.1252, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 11.29% (0.3473 => 0.3865, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.25% (0.3441 => 0.3828, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.21% (0.3543 => 0.3940, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.18% (0.3543 => 0.3939, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 11.10% (0.3927 => 0.4363, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.10% (0.3497 => 0.3885, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/synchronized: 11.09% (0.3561 => 0.3956, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.09% (0.3516 => 0.3906, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 11.02% (0.3694 => 0.4101, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.97% (0.3828 => 0.4248, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 10.93% (0.3092 => 0.3430, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 10.90% (1.5603 => 1.7303, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/property: 10.76% (0.3886 => 0.4304, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 10.73% (0.6456 => 0.7149, std.dev.: 0.0048) MultiSource/Applications/siod/siod: 10.31% (2.2969 => 2.5338, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.31% (0.1892 => 0.2087, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 10.28% (21.9371 => 24.1913, std.dev.: 0.0069) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.23% (0.8101 => 0.8930, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.02% (0.2266 => 0.2493, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.97% (0.1143 => 0.1257, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 9.58% (0.4289 => 0.4700, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash2: 9.33% (0.4620 => 0.5051, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.90% (0.3865 => 0.4209, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.89% (0.3826 => 0.4166, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.71% (0.4203 => 0.4569, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.70% (0.3427 => 0.3725, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 8.68% (0.3422 => 0.3719, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.43% (0.4103 => 0.4449, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.37% (0.4636 => 0.5024, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 8.33% (17.1811 => 18.6120, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/moments: 8.28% (0.4048 => 0.4383, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 8.22% (0.3684 => 0.3987, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 8.21% (0.6030 => 0.6525, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.14% (0.5925 => 0.6407, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.90% (0.2430 => 0.2622, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.87% (14.3668 => 15.4973, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/sieve: 7.49% (0.3603 => 0.3873, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.48% (0.7326 => 0.7874, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.35% (3.8922 => 4.1783, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.23% (0.3650 => 0.3914, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.01% (0.4064 => 0.4349, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.81% (0.3098 => 0.3309, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.66% (0.3136 => 0.3345, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.64% (0.2831 => 0.3019, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 6.62% (0.3232 => 0.3446, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.61% (0.2905 => 0.3097, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.57% (0.2891 => 0.3081, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.51% (0.3162 => 0.3368, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.48% (0.2793 => 0.2974, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.46% (0.3283 => 0.3495, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.41% (2.0665 => 2.1990, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.34% (0.2871 => 0.3053, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.31% (0.2756 => 0.2930, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.30% (0.2872 => 0.3053, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.22% (0.2877 => 0.3056, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.17% (0.2725 => 0.2893, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.09% (0.3052 => 0.3238, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 6.01% (0.3379 => 0.3582, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.00% (0.2802 => 0.2970, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.93% (0.2714 => 0.2875, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 5.68% (1.2842 => 1.3571, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (0.3131 => 0.3293, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.51% (0.3817 => 0.3951, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.61% (1.1194 => 1.1486, std.dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1725, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.36% (0.9957 => 1.1287, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.87% (1.1396 => 1.2521, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (3.1578 => 3.3679, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/bh/bh: 5.95% (1.9405 => 2.0559, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.72% (4.2280 => 4.3428, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.71% (0.3987 => 0.4095, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bisort/bisort: 1.87% (0.8333 => 0.8489, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.76% (3.6395 => 3.7036, std.dev.: 0.0043) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2078, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.45% (2.6546 => 2.6931, std.dev.: 0.0024) MultiSource/Applications/viterbi/viterbi: 1.21% (4.4649 => 4.5190, std.dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.01% (6.6874 => 0.1328, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -80.12% (0.8651 => 0.1720, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.10% (5.2763 => 3.2134, std.dev.: 0.0160) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.68% (5.3855 => 3.7334, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.16% (5.3526 => 3.7380, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -14.81% (54.1659 => 46.1429, std.dev.: 0.0117) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.60% (2.9384 => 2.6270, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: -6.69% (22.1758 => 20.6919, std.dev.: 0.0134) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.07% (8.0499 => 3.7779, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.52% (1.1492 => 0.7640, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.64% (2.9695 => 2.4755, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -16.12% (1.6925 => 1.4196, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.70% (1.2258 => 1.0701, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.45% (1.2373 => 1.0956, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: -10.71% (1.5373 => 1.3727, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.57% (19.9488 => 18.2398, std.dev.: 0.0333) MultiSource/Benchmarks/FreeBench/mason/mason: -7.82% (0.2161 => 0.1992, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.11% (1.8329 => 1.7026, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.21% (1.6805 => 1.5930, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5072, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.29% (8.1563 => 7.8060, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.72% (0.9540 => 0.9185) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1627, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8775, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.08% (32.5116 => 31.5116, std.dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.58% (0.4808 => 0.4684, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -2.31% (4.6441 => 4.5367, std.dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.75% (10.2830 => 10.1026, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6793, std.dev.: 0.0017) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5094, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4213, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.12% (2.3135 => 2.2877, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 19.32% (0.5229 => 0.6239, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 14.85% (14.9895 => 17.2151, std.dev.: 0.0173) MultiSource/Applications/kimwitu++/kc: 9.92% (14.1553 => 15.5600, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 34.35% (1.1048 => 1.4843, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.45% (7.1582 => 8.1925, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.08% (0.6222 => 0.6849, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.30% (0.1485 => 0.1436, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.85% (0.2116 => 0.2134, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 22 15:17:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 22 Oct 2012 17:17:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121022221756.7A8232A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5102?compare_to=5099&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5102, Order: 166436, Start Time: 2012-10-22 20:54:58, End Time: 2012-10-22 22:20:59 To: 5099, Order: 166425, Start Time: 2012-10-22 18:59:19, End Time: 2012-10-22 20:25:12 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 2 (204 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1040 (661 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.03% (3.7503 => 3.8265, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/fbench: 1.92% (2.2495 => 2.2928, std.dev.: 0.0112) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 24.76% (2.0176 => 2.5172, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.28% (0.1410 => 0.1710, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: 18.77% (0.0826 => 0.0981, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 18.37% (0.2243 => 0.2655, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 17.57% (0.1013 => 0.1191, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.02% (0.0746 => 0.0873, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.00% (0.0653 => 0.0764) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.58% (0.7710 => 0.8988, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.52% (0.1327 => 0.1533, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 15.03% (0.2721 => 0.3130, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.91% (0.2596 => 0.2983, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.90% (0.1986 => 0.2282, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.75% (0.0834 => 0.0957, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.58% (0.1413 => 0.1619, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.52% (0.0847 => 0.0970, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.43% (0.0811 => 0.0928, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 14.34% (1.3693 => 1.5657, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/power/power: 14.16% (0.1003 => 0.1145, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.11% (0.9199 => 1.0497, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.07% (0.0725 => 0.0827, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.05% (0.6959 => 0.7937, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.04% (0.0819 => 0.0934, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.94% (0.5265 => 0.5999, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.90% (0.0964 => 0.1098, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.89% (0.0720 => 0.0820, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.85% (3.9660 => 4.5151, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.84% (0.5637 => 0.6417, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.58% (0.1075 => 0.1221, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 13.56% (0.1062 => 0.1206, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 13.54% (0.7038 => 0.7991, std.dev.: 0.0019) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.53% (0.1072 => 0.1217, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.48% (0.1276 => 0.1448, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.48% (0.1588 => 0.1802, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 13.47% (0.7460 => 0.8465, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 13.41% (0.1111 => 0.1260, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.28% (0.2914 => 0.3301, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.00% (0.0977 => 0.1104, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 12.99% (1.1061 => 1.2498, std.dev.: 0.0033) MultiSource/Applications/viterbi/viterbi: 12.86% (0.1478 => 0.1668, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/distray/distray: 12.84% (0.0818 => 0.0923, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 12.62% (0.4328 => 0.4874, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.61% (1.4563 => 1.6400, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 12.55% (13.8202 => 15.5550, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.52% (0.1014 => 0.1141, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.44% (0.5577 => 0.6271, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.43% (1.2193 => 1.3709, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.35% (0.6283 => 0.7059, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.34% (1.1364 => 1.2766, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.21% (0.2023 => 0.2270, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.12% (0.1865 => 0.2091, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.10% (0.1157 => 0.1297, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.08% (0.3246 => 0.3638, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.99% (0.2127 => 0.2382, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.95% (0.3130 => 0.3504) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.94% (0.4379 => 0.4902, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 11.91% (0.7506 => 0.8400, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash: 11.84% (0.4062 => 0.4543, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 11.77% (3.8646 => 4.3195, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/em3d/em3d: 11.77% (0.1657 => 0.1852, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 11.56% (0.2925 => 0.3263, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 11.53% (0.5818 => 0.6489, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 11.52% (0.2995 => 0.3340, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.50% (0.4791 => 0.5342, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.49% (0.3899 => 0.4347, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 11.41% (1.0313 => 1.1490, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 11.40% (0.3220 => 0.3587, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.35% (0.1048 => 0.1167, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 11.24% (0.5748 => 0.6394, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.12% (0.1789 => 0.1988, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.12% (0.3022 => 0.3358, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.09% (0.3580 => 0.3977, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 11.01% (0.1589 => 0.1764, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.97% (7.2180 => 8.0100, std.dev.: 0.0055) SingleSource/UnitTests/ObjC++/property-reference: 10.96% (0.7061 => 0.7835, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 10.96% (1.9270 => 2.1382, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.83% (0.1569 => 0.1739, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.80% (0.1435 => 0.1590, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 10.80% (0.1213 => 0.1344, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 10.78% (0.6744 => 0.7471, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.76% (0.3485 => 0.3860, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.65% (0.3756 => 0.4156, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 10.64% (0.2781 => 0.3077, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.56% (0.4016 => 0.4440, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 10.52% (3.1889 => 3.5243, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/football/football: 10.49% (0.8310 => 0.9182, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 10.48% (16.6129 => 18.3532, std.dev.: 0.0170) MultiSource/Applications/siod/siod: 10.44% (2.1791 => 2.4065, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 10.39% (0.3293 => 0.3635, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.37% (1.3245 => 1.4619, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.33% (0.2140 => 0.2361, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.32% (0.3489 => 0.3849, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: 10.19% (0.3868 => 0.4262, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.17% (0.8698 => 0.9583, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 10.11% (3.6692 => 4.0403, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.10% (0.2782 => 0.3063, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 10.09% (0.2607 => 0.2870, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.08% (0.2966 => 0.3265, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 10.05% (4.3801 => 4.8204, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/methcall: 10.03% (0.2761 => 0.3038, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 9.99% (0.3453 => 0.3798, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 9.98% (0.2726 => 0.2998, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.98% (0.4390 => 0.4828, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.95% (1.9828 => 2.1800, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 9.93% (0.3534 => 0.3885, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.91% (4.4433 => 4.8835, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/except: 9.89% (0.2760 => 0.3033, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.85% (4.9865 => 5.4775, std.dev.: 0.0294) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.75% (0.6135 => 0.6733, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 9.74% (0.2690 => 0.2952, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.72% (0.2655 => 0.2913, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 9.72% (0.3149 => 0.3455, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/05-eks/eks: 9.68% (0.4113 => 0.4511, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: 9.67% (0.2628 => 0.2882, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 9.66% (0.3107 => 0.3407, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 9.62% (1.0594 => 1.1613, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 9.57% (0.2937 => 0.3218, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.57% (0.6576 => 0.7205, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.52% (0.2321 => 0.2542, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.51% (0.2765 => 0.3028, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 9.43% (0.3192 => 0.3493, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 9.40% (0.2988 => 0.3269, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 9.39% (14.8535 => 16.2478, std.dev.: 0.0100) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.20% (0.3511 => 0.3834, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.20% (0.2696 => 0.2944, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.16% (0.3755 => 0.4099, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/objinst: 9.13% (0.2945 => 0.3214, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 9.04% (0.3131 => 0.3414, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 8.97% (1.2749 => 1.3893, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.96% (0.1819 => 0.1982, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 8.89% (8.4961 => 9.2510, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.67% (1.5188 => 1.6505, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.65% (1.1333 => 1.2313, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.53% (0.8818 => 0.9570, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.43% (0.9108 => 0.9876, std.dev.: 0.0060) MultiSource/Applications/lua/lua: 8.39% (3.7467 => 4.0609, std.dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 8.30% (4.6629 => 5.0501, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: 8.30% (0.1385 => 0.1500, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 8.29% (0.6250 => 0.6768, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.24% (3.2742 => 3.5441, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/parameter-passing: 8.19% (0.4003 => 0.4331) MultiSource/Applications/JM/ldecod/ldecod: 8.19% (6.5754 => 7.1137, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/exceptions: 8.10% (0.3914 => 0.4231, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.03% (0.4805 => 0.5191, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.95% (0.3245 => 0.3503, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.90% (2.1007 => 2.2667, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 7.86% (0.3789 => 0.4087, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 7.84% (0.3940 => 0.4249, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.83% (0.2504 => 0.2700, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.82% (6.2785 => 6.7696, std.dev.: 0.0089) SingleSource/UnitTests/ObjC/trivial-interface: 7.77% (0.3578 => 0.3856, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.71% (0.3646 => 0.3927, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.70% (0.3663 => 0.3945, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/oourafft: 7.67% (0.2008 => 0.2162, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 7.66% (0.3601 => 0.3877, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 7.59% (0.3623 => 0.3898, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.53% (0.2243 => 0.2412, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.53% (0.3650 => 0.3925, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 7.44% (1.2292 => 1.3207, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.24% (13.2842 => 14.2466, std.dev.: 0.0138) SingleSource/Benchmarks/Misc/ReedSolomon: 6.19% (0.1777 => 0.1887, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 5.51% (16.2614 => 17.1567, std.dev.: 0.0196) MultiSource/Benchmarks/Olden/bh/bh: 5.21% (0.2859 => 0.3008, std.dev.: 0.0036) MultiSource/Applications/ClamAV/clamscan: 5.01% (14.5298 => 15.2580, std.dev.: 0.0134) MultiSource/Benchmarks/Bullet/bullet: 2.76% (33.2944 => 34.2120, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/methcall: 30.61% (5.7573 => 7.5196, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/fbench: 26.15% (1.8175 => 2.2928, std.dev.: 0.0112) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.10% (1.0895 => 1.2758, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 11.00% (1.1560 => 1.2832, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.78% (2.8813 => 3.1919, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.02% (0.8273 => 0.9019, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.62% (0.1322 => 0.1436, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.56% (3.1736 => 3.4134, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.43% (0.9692 => 1.0218) SingleSource/Benchmarks/Misc/mandel-2: 5.06% (1.2998 => 1.3656, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.83% (0.3458 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.78% (1.9144 => 2.0060, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.45% (2.8606 => 2.9880, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 4.42% (0.5449 => 0.5690, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7750, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.43% (10.7476 => 11.1167, std.dev.: 0.0229) SingleSource/Benchmarks/Misc/flops-6: 3.38% (1.9199 => 1.9848, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 3.37% (12.0921 => 12.5000, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 3.21% (11.2619 => 11.6229, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bisort/bisort: 2.95% (0.8239 => 0.8482, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0310 => 1.0559, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0310) SingleSource/Benchmarks/Misc/salsa20: 2.24% (7.4271 => 7.5933, std.dev.: 0.0035) MultiSource/Applications/lemon/lemon: 1.82% (1.4298 => 1.4558, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.49% (2.0200 => 2.0501, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5136, std.dev.: 0.0005) MultiSource/Benchmarks/llubenchmark/llu: 1.42% (3.7731 => 3.8265, std.dev.: 0.0096) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.33% (1.9433 => 1.9692, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.27% (3.1720 => 3.2124, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1879, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2137, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.17% (9.9194 => 10.0357, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 1.16% (5.5130 => 5.5768, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 1.11% (12.4560 => 12.5937, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.06% (8.8259 => 8.9192, std.dev.: 0.0139) SingleSource/Benchmarks/McGill/queens: 1.00% (2.1753 => 2.1971, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.07% (0.2670 => 0.1440, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.44% (0.4657 => 0.3938, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.66% (1.3813 => 1.2203, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.58% (1.3819 => 1.2219, std.dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.28% (1.0460 => 0.8548, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -12.87% (0.2238 => 0.1950, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.21% (20.3410 => 18.2644, std.dev.: 0.0250) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.97% (1.3780 => 1.2958, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: -5.72% (1.2308 => 1.1604, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (2.5089 => 2.3742, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -5.00% (2.6470 => 2.5146, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.63% (0.9996 => 0.9533, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9655, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.87% (1.7688 => 1.7004, std.dev.: 0.0105) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -2.87% (3.2729 => 3.1791, std.dev.: 0.0023) MultiSource/Applications/spiff/spiff: -2.81% (3.0263 => 2.9412, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -2.78% (1.9762 => 1.9213, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8811, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.54% (4.5947 => 4.4781, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.37% (4.1080 => 4.0106, std.dev.: 0.0045) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.09% (0.6589 => 0.6451, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.86% (0.6615 => 0.6492, std.dev.: 0.0012) MultiSource/Applications/lua/lua: -1.81% (26.5159 => 26.0361, std.dev.: 0.0395) SingleSource/Benchmarks/Shootout/lists: -1.73% (6.3560 => 6.2459, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.67% (0.8342 => 0.8203, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3454) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.64% (2.5254 => 2.4841, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -1.46% (7.1097 => 7.0061, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -1.24% (5.3167 => 5.2508, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: -1.24% (28.2225 => 27.8733, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/heapsort: -1.20% (3.9173 => 3.8701, std.dev.: 0.0057) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1138, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -1.05% (84.4286 => 83.5384, std.dev.: 0.0087) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 22 16:14:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 22 Oct 2012 18:14:31 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121022231431.A33F12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5103?compare_to=5100&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5103, Order: 166441, Start Time: 2012-10-22 21:52:44, End Time: 2012-10-22 23:16:34 To: 5100, Order: 166435, Start Time: 2012-10-22 20:12:21, End Time: 2012-10-22 21:35:51 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 24 (29 on baseline) Performance Improvements: 2 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 949 (941 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.30% (0.7793 => 0.8440, std.dev.: 0.0071) MultiSource/Applications/viterbi/viterbi: 6.79% (0.1560 => 0.1666, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.49% (0.3160 => 0.3365, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.52% (0.4710 => 0.4970, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.89% (0.5871 => 0.6158, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.79% (0.6159 => 0.6454, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.56% (0.2257 => 0.2360, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.44% (0.2903 => 0.3032, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 3.34% (1.4073 => 1.4543, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.39% (0.6109 => 0.6255, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.31% (0.9414 => 0.9631, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/gs/gs: 2.30% (4.0716 => 4.1653, std.dev.: 0.0265) MultiSource/Applications/lua/lua: 2.17% (3.7848 => 3.8670, std.dev.: 0.0197) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.14% (8.5675 => 8.7505, std.dev.: 0.0152) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.84% (1.2390 => 1.2618, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 1.58% (8.6304 => 8.7664, std.dev.: 0.0275) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.45% (1.3193 => 1.3384, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.40% (1.2460 => 1.2635, std.dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: 1.25% (31.9014 => 32.3001, std.dev.: 0.0829) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 24.72% (1.4973 => 1.8674, std.dev.: 0.0079) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.78% (13.9475 => 15.7294, std.dev.: 0.2009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.96% (21.2176 => 22.0579, std.dev.: 0.2834) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.65% (1.0200 => 1.0470, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.13% (1.5830 => 1.6009, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: -4.05% (0.7847 => 0.7529, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.72% (60.7716 => 59.7267, std.dev.: 0.3568) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.48% (16.4057 => 16.4844, std.dev.: 0.2667) MultiSource/Applications/obsequi/Obsequi: 0.46% (1.0311 => 1.0358, std.dev.: 0.0101) MultiSource/Applications/sqlite3/sqlite3: -0.55% (0.6360 => 0.6325, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/08-main/main: -5.38% (0.1950 => 0.1845, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.73% (0.1644 => 0.1632, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.81% (0.3224 => 0.3250, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.18% (0.2456 => 0.2485, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.99% (0.3342 => 0.3309, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.86% (0.2371 => 0.2415, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 0.12% (0.5938 => 0.5945, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/mandel: 2.48% (0.0443 => 0.0454, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.3287 => 0.3287, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.1975 => 0.1975, std.dev.: 0.0014) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -16.23% (0.0228 => 0.0191, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 24.28% (0.0173 => 0.0215, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.44% (0.0418 => 0.0424, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 13.89% (0.0288 => 0.0328, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 31.78% (0.0236 => 0.0311, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -5.95% (0.0420 => 0.0395, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/casts: -27.41% (0.0197 => 0.0143, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0132 => 0.0132, std.dev.: 0.0039) SingleSource/UnitTests/byval-alignment: 11.15% (0.0269 => 0.0299, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.61% (0.1482 => 0.1473, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -3.77% (1.1566 => 1.1130, std.dev.: 0.0415) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 2.57% (0.1476 => 0.1514, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -8.19% (0.4396 => 0.4036, std.dev.: 0.0208) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.96% (0.1431 => 0.1403, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.75% (0.0563 => 0.0601, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 22.40% (0.0192 => 0.0235, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.36% (0.0552 => 0.0550, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.30% (1.1357 => 1.1391, std.dev.: 0.0097) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 383.33% (0.0006 => 0.0029, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -93.33% (0.0015 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.75% (0.0531 => 0.0535, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.95% (0.0222 => 0.0211, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.01% (0.8008 => 0.7927, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 6.45% (0.0062 => 0.0066, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.14% (2.1832 => 1.6781, std.dev.: 0.0130) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.58% (0.8148 => 0.8440, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.52% (0.7473 => 0.7736, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.30% (0.5961 => 0.6158, std.dev.: 0.0033) MultiSource/Applications/Burg/burg: 2.75% (1.2222 => 1.2558, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.66% (0.6287 => 0.6454, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.24% (1.1606 => 1.1866, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.08% (0.9435 => 0.9631, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.94% (1.4479 => 1.4760, std.dev.: 0.0021) MultiSource/Applications/hbd/hbd: 1.92% (1.4269 => 1.4543, std.dev.: 0.0084) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.73% (6.6074 => 6.7218, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.69% (0.8050 => 0.8186, std.dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 1.64% (8.6247 => 8.7664, std.dev.: 0.0275) MultiSource/Benchmarks/nbench/nbench: 1.59% (1.1271 => 1.1450, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.49% (0.8261 => 0.8384, std.dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: 1.38% (31.8598 => 32.3001, std.dev.: 0.0829) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.33% (0.8697 => 0.8813, std.dev.: 0.0042) MultiSource/Applications/oggenc/oggenc: 1.22% (4.9628 => 5.0233, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.19% (8.6476 => 8.7505, std.dev.: 0.0152) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.34% (1.5795 => 2.5010, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.51% (0.3186 => 0.3457, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.27% (1.1857 => 1.2837, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.40% (14.6451 => 15.7294, std.dev.: 0.2009) MultiSource/Benchmarks/mafft/pairlocalalign: 6.04% (63.1822 => 67.0004, std.dev.: 0.3124) SingleSource/Benchmarks/Misc/ReedSolomon: 2.85% (8.5322 => 8.7750, std.dev.: 0.0257) MultiSource/Applications/siod/siod: 2.65% (3.6643 => 3.7614, std.dev.: 0.0097) MultiSource/Benchmarks/llubenchmark/llu: 1.79% (1.9967 => 2.0325, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.72% (2.4490 => 2.4912, std.dev.: 0.0102) MultiSource/Benchmarks/Olden/bh/bh: 1.62% (2.3560 => 2.3941, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.12% (6.3772 => 6.4484, std.dev.: 0.0148) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -10.06% (0.3269 => 0.2940, std.dev.: 0.0039) MultiSource/Applications/lua/lua: -5.06% (29.8330 => 28.3241, std.dev.: 0.2403) SingleSource/Benchmarks/Shootout-C++/hash2: -1.67% (3.4237 => 3.3665, std.dev.: 0.0145) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.28% (3.3479 => 3.3050, std.dev.: 0.0033) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.23% (16.4461 => 16.4844, std.dev.: 0.2667) MultiSource/Applications/obsequi/Obsequi: 0.94% (1.0262 => 1.0358, std.dev.: 0.0101) MultiSource/Applications/sqlite3/sqlite3: -0.11% (0.6332 => 0.6325, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/08-main/main: 0.76% (0.1831 => 0.1845, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.68% (0.1559 => 0.1632, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.07% (0.3123 => 0.3250, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.89% (0.2463 => 0.2485, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.05% (0.3344 => 0.3309, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.16% (0.2364 => 0.2415, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -1.08% (0.6010 => 0.5945, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/mandel: 5.83% (0.0429 => 0.0454, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.64% (0.3266 => 0.3287, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 0.30% (0.1969 => 0.1975, std.dev.: 0.0014) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -14.73% (0.0224 => 0.0191, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 74.80% (0.0123 => 0.0215, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.92% (0.0408 => 0.0424, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.13% (0.0254 => 0.0328, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.98% (0.0302 => 0.0311, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 2.86% (0.0384 => 0.0395, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/casts: -24.74% (0.0190 => 0.0143, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/test1: -26.67% (0.0180 => 0.0132, std.dev.: 0.0039) SingleSource/UnitTests/byval-alignment: 30.00% (0.0230 => 0.0299, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.43% (0.1438 => 0.1473, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.76% (1.1329 => 1.1130, std.dev.: 0.0415) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.56% (0.1462 => 0.1514, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.07% (0.4164 => 0.4036, std.dev.: 0.0208) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.48% (0.1369 => 0.1403, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.24% (0.0641 => 0.0601, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 20.51% (0.0195 => 0.0235, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.84% (0.0578 => 0.0550, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.40% (1.1437 => 1.1391, std.dev.: 0.0097) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2800.00% (0.0001 => 0.0029, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.67% (0.0627 => 0.0535, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 17.22% (0.0180 => 0.0211, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.12% (0.8017 => 0.7927, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 6.45% (0.0062 => 0.0066, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 22 16:52:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 22 Oct 2012 18:52:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121022235200.B70492A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5104?compare_to=5101&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5104, Order: 166442, Start Time: 2012-10-22 22:33:18, End Time: 2012-10-22 23:53:22 To: 5101, Order: 166436, Start Time: 2012-10-22 20:43:41, End Time: 2012-10-22 22:03:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (5 on baseline) Performance Regressions: 0 (189 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 88 (14 on baseline) Unchanged Tests: 954 (652 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.21% (0.6239 => 0.6252, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 0.02% (17.2151 => 17.2191, std.dev.: 0.0102) MultiSource/Applications/kimwitu++/kc: -0.09% (15.5600 => 15.5454, std.dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: -0.22% (56.1350 => 56.0135, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.42% (0.0481 => 0.0479, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.41% (0.0483 => 0.0481, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0451 => 0.0451, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.22% (0.0452 => 0.0451, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.23% (0.0440 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0441 => 0.0441) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0434 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.23% (0.0435 => 0.0434, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0451 => 0.0451, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0453 => 0.0453, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.22% (0.0446 => 0.0445, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.22% (0.0447 => 0.0446, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0436 => 0.0436) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.23% (0.0438 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.23% (0.0444 => 0.0443, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.22% (0.0445 => 0.0444, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.44% (0.0455 => 0.0453, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.44% (0.0456 => 0.0454, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0431 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0432 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.45% (0.0444 => 0.0442, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0444 => 0.0444, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0435 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.23% (0.0436 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0427 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0428 => 0.0428) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0425 => 0.0425, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.23% (0.0427 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0463 => 0.0463, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.22% (0.0464 => 0.0463, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0424 => 0.0424) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0425 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.23% (0.0426 => 0.0425, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.47% (0.0427 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0433 => 0.0433, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0434 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.18% (1.4843 => 1.4869, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.03% (8.1925 => 8.1947, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.01% (0.6849 => 0.6848, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1436 => 0.1436, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.2134 => 0.2134, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.43% (63.2438 => 56.0135, std.dev.: 0.0070) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/MallocBench/gs/gs: 12.53% (4.1105 => 4.6255, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.52% (3.4629 => 5.8011, std.dev.: 0.0144) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13496.67% (0.0720 => 9.7896, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049200.00% (0.0001 => 10.0493, std.dev.: 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.23% (0.2554 => 0.4169, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 57.31% (10.3673 => 16.3090, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/lowercase: 55.86% (0.0256 => 0.0399) SingleSource/UnitTests/SignlessTypes/factor: 45.27% (0.0296 => 0.0430, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 41.70% (0.0271 => 0.0384, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 40.62% (1.5859 => 2.2301, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 39.70% (0.1622 => 0.2266, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 36.27% (0.1056 => 0.1439, std.dev.: 0.0002) SingleSource/UnitTests/vla: 31.55% (0.0355 => 0.0467, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 29.63% (2.2024 => 2.8549, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/neural/neural: 25.56% (0.1463 => 0.1837, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 24.10% (0.0834 => 0.1035, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 20.50% (0.2049 => 0.2469, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.11% (0.1566 => 0.1881, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.61% (7.0540 => 8.4373, std.dev.: 0.0168) SingleSource/Benchmarks/Misc/flops: 19.34% (0.1432 => 0.1709, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.16% (2.2022 => 2.6021, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.14% (0.0871 => 0.1029) MultiSource/Applications/viterbi/viterbi: 17.75% (0.1555 => 0.1831, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.20% (0.5105 => 0.5983, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 16.85% (0.6675 => 0.7800, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 16.56% (3.3354 => 3.8877, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: 16.13% (0.1655 => 0.1922, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.10% (1.3050 => 1.5151, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 15.97% (10.4361 => 12.1032, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.88% (0.4615 => 0.5348, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 15.79% (0.0798 => 0.0924, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 15.69% (0.1440 => 0.1666, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 15.69% (0.1695 => 0.1961, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 15.68% (0.2271 => 0.2627, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.63% (0.1337 => 0.1546, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 15.33% (0.3282 => 0.3785, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.28% (1.5415 => 1.7770, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 15.26% (0.0793 => 0.0914, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 15.15% (0.1175 => 0.1353, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 15.13% (0.1163 => 0.1339, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.02% (0.1032 => 0.1187, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.83% (0.1510 => 0.1734, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 14.83% (0.7115 => 0.8170, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.72% (0.5020 => 0.5759, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 14.60% (0.8172 => 0.9365, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.56% (0.0886 => 0.1015, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.34% (0.0746 => 0.0853, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 14.28% (0.3109 => 0.3553, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.25% (0.0842 => 0.0962, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.19% (4.2646 => 4.8697, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.08% (0.0838 => 0.0956, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 14.02% (0.3423 => 0.3903, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.02% (0.1940 => 0.2212, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.02% (0.1584 => 0.1806, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/matrix: 13.94% (0.0818 => 0.0932) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.87% (0.9765 => 1.1119, std.dev.: 0.0107) MultiSource/Benchmarks/mafft/pairlocalalign: 13.77% (9.4845 => 10.7907, std.dev.: 0.0129) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.75% (0.1236 => 0.1406, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 13.73% (1.1642 => 1.3240, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.66% (8.1363 => 9.2476, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.62% (0.3121 => 0.3546, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 13.61% (5.7591 => 6.5429, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.52% (0.1117 => 0.1268, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/exptree: 13.51% (0.0814 => 0.0924, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.51% (0.0770 => 0.0874, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.48% (0.2107 => 0.2391, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 13.41% (0.6450 => 0.7315, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.34% (0.2758 => 0.3126, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 13.29% (0.1151 => 0.1304, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 13.26% (0.7835 => 0.8874, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.26% (1.7609 => 1.9944, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.21% (0.5860 => 0.6634, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.12% (0.2065 => 0.2336, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.06% (1.4186 => 1.6038, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.01% (0.1906 => 0.2154, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.97% (0.0933 => 0.1054, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 12.94% (2.0273 => 2.2896, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.93% (0.2700 => 0.3049, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.87% (0.1438 => 0.1623, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 12.83% (1.1840 => 1.3359, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.83% (0.1029 => 0.1161, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.74% (0.1695 => 0.1911, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.71% (0.1062 => 0.1197, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 12.67% (0.7433 => 0.8375, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 12.59% (3.8723 => 4.3597, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.57% (4.9449 => 5.5663, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 12.55% (1.0722 => 1.2068, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.48% (0.8067 => 0.9074, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.43% (0.1625 => 0.1827, std.dev.: 0.0026) SingleSource/UnitTests/SignlessTypes/rem: 12.41% (0.1144 => 0.1286, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.37% (5.0018 => 5.6203, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.29% (0.5981 => 0.6716, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 12.19% (0.3387 => 0.3800, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.16% (0.0929 => 0.1042, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 12.07% (0.1268 => 0.1421, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.05% (0.4879 => 0.5467, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.03% (0.1330 => 0.1490, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.99% (0.5569 => 0.6237, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.89% (1.1861 => 1.3271, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.80% (0.3177 => 0.3552, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.78% (7.9617 => 8.8996, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/05-eks/eks: 11.72% (0.4299 => 0.4803, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.67% (0.3307 => 0.3693, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 11.62% (0.8921 => 0.9958, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 11.58% (0.3092 => 0.3450, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.56% (0.1125 => 0.1255, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.49% (0.2603 => 0.2902, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.42% (0.3441 => 0.3834, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 11.26% (0.3180 => 0.3538, std.dev.: 0.0035) MultiSource/Applications/hbd/hbd: 10.93% (1.5603 => 1.7309, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 10.64% (0.6456 => 0.7143, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 10.64% (21.9371 => 24.2709, std.dev.: 0.0120) SingleSource/UnitTests/ObjC/trivial-interface: 10.62% (0.3473 => 0.3842, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.54% (0.3927 => 0.4341, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.53% (0.3543 => 0.3916, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 10.50% (0.3561 => 0.3935, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.47% (0.8101 => 0.8949, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.44% (0.3543 => 0.3913, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 10.44% (0.3497 => 0.3862, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.41% (0.2266 => 0.2502, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.40% (0.3828 => 0.4226, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 10.37% (0.3694 => 0.4077, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 10.35% (0.3516 => 0.3880, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.20% (0.1892 => 0.2085, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 10.16% (2.2969 => 2.5302, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/property: 10.14% (0.3886 => 0.4280, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.06% (0.1143 => 0.1258, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 9.24% (0.4620 => 0.5047, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 9.21% (0.4289 => 0.4684, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.98% (0.3865 => 0.4212, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.78% (0.3826 => 0.4162, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 8.71% (0.3422 => 0.3720, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.70% (0.3427 => 0.3725, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.66% (0.4203 => 0.4567, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 8.49% (17.1811 => 18.6404, std.dev.: 0.0181) SingleSource/Benchmarks/Shootout-C++/lists1: 8.28% (0.3684 => 0.3989, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.21% (0.4103 => 0.4440, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.18% (0.4636 => 0.5015, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/moments: 8.13% (0.4048 => 0.4377, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.05% (14.3668 => 15.5230, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.86% (0.2430 => 0.2621, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 7.56% (0.6030 => 0.6486, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.54% (0.5925 => 0.6372, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 7.52% (0.3603 => 0.3874, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.48% (3.8922 => 4.1832, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.29% (0.3650 => 0.3916, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 6.95% (0.7326 => 0.7835, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.91% (0.4064 => 0.4345, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.78% (0.3098 => 0.3308, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.68% (0.2831 => 0.3020, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.64% (0.2891 => 0.3083, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.57% (0.3136 => 0.3342, std.dev.: 0.0065) SingleSource/Regression/C++/ofstream_ctor: 6.54% (0.2905 => 0.3095, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.50% (0.3232 => 0.3442, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary3: 6.43% (0.3283 => 0.3494, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.36% (0.3162 => 0.3363, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.29% (2.0665 => 2.1965, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 6.17% (0.2871 => 0.3048, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.12% (0.2793 => 0.2964, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.10% (0.2756 => 0.2924, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.06% (0.2725 => 0.2890, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 6.00% (0.3052 => 0.3235, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 5.98% (0.2877 => 0.3049, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.89% (0.3379 => 0.3578, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/random: 5.85% (0.2802 => 0.2966, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.78% (0.2714 => 0.2871, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 5.64% (1.2842 => 1.3566, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 4.95% (0.3131 => 0.3286, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.88% (0.3817 => 0.3927, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.60% (1.1194 => 1.1485, std.dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1725, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.38% (0.9957 => 1.1289, std.dev.: 0.0123) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9648, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.80% (1.1396 => 1.2513, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3682, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: 5.91% (1.9405 => 2.0551, std.dev.: 0.0028) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.68% (4.2280 => 4.3412, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.61% (0.3987 => 0.4091, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.85% (0.8333 => 0.8487, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.80% (3.6395 => 3.7051, std.dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.60% (2.6546 => 2.6972, std.dev.: 0.0014) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2077, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 1.31% (4.4649 => 4.5235, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.14% (6.5088 => 6.5832, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.02% (6.6874 => 0.1326) SingleSource/Benchmarks/Misc/salsa20: -80.09% (0.8651 => 0.1722, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.16% (5.2763 => 3.2100, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.90% (5.3855 => 3.7215, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.33% (5.3526 => 3.7290, std.dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -14.80% (54.1659 => 46.1520, std.dev.: 0.0522) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.47% (2.9384 => 2.6307, std.dev.: 0.0023) MultiSource/Applications/ClamAV/clamscan: -6.55% (22.1758 => 20.7232, std.dev.: 0.0174) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.10% (8.0499 => 3.7753, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.40% (1.1492 => 0.7654, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.64% (2.9695 => 2.4754, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.09% (1.6925 => 1.4202, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.69% (1.2258 => 1.0702, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.47% (1.2373 => 1.0954, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: -10.94% (1.5373 => 1.3691, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.37% (19.9488 => 18.2795, std.dev.: 0.0150) MultiSource/Benchmarks/FreeBench/mason/mason: -7.91% (0.2161 => 0.1990, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.01% (1.8329 => 1.7045, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4781, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5757, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.12% (1.6805 => 1.5944, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-5: -4.96% (1.5835 => 1.5049, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.18% (8.1563 => 7.8154, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.63% (3.2827 => 3.1634, std.dev.: 0.0091) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8778, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5016, std.dev.: 0.0060) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.77% (0.4808 => 0.4675, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -2.32% (4.6441 => 4.5365, std.dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.81% (10.2830 => 10.0971, std.dev.: 0.0070) SingleSource/UnitTests/Vector/multiplies: -1.72% (2.5528 => 2.5090, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6822, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4215, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout/lists: -1.15% (6.2999 => 6.2276, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2879, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0554 => 1.0445, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 19.56% (0.5229 => 0.6252, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 14.87% (14.9895 => 17.2191, std.dev.: 0.0102) MultiSource/Applications/kimwitu++/kc: 9.82% (14.1553 => 15.5454, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 34.59% (1.1048 => 1.4869, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.48% (7.1582 => 8.1947, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.06% (0.6222 => 0.6848, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.30% (0.1485 => 0.1436, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.85% (0.2116 => 0.2134, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 4.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 22 17:16:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 22 Oct 2012 19:16:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121023001654.E81882A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5105?compare_to=5102&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5105, Order: 166442, Start Time: 2012-10-22 22:50:28, End Time: 2012-10-23 00:19:56 To: 5102, Order: 166436, Start Time: 2012-10-22 20:54:58, End Time: 2012-10-22 22:20:59 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 3 (202 on baseline) Performance Improvements: 1 (38 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1038 (664 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.02% (54.5619 => 56.7567, std.dev.: 0.0462) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.49% (77.9424 => 79.8864, std.dev.: 0.7129) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.58% (4.3965 => 4.4659, std.dev.: 0.0234) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -1.43% (2.2928 => 2.2601, std.dev.: 0.0018) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 25.23% (2.0176 => 2.5266, std.dev.: 0.0136) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.85% (0.1410 => 0.1704, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: 18.16% (0.0826 => 0.0976, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 18.10% (0.2243 => 0.2649, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/tsp/tsp: 17.37% (0.1013 => 0.1189, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.85% (0.7710 => 0.9009, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.54% (0.0653 => 0.0761, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.49% (0.0746 => 0.0869, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.26% (0.0819 => 0.0944, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 14.74% (0.2721 => 0.3122, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.64% (0.2596 => 0.2976, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: 14.63% (0.0834 => 0.0956, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.47% (0.1327 => 0.1519, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.30% (0.1986 => 0.2270, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.30% (0.1413 => 0.1615, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.30% (0.9199 => 1.0514, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.23% (0.0977 => 0.1116, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.18% (0.0811 => 0.0926, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.14% (0.1075 => 0.1227, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 14.06% (0.1003 => 0.1144, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.05% (0.0847 => 0.0966, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 13.98% (1.3693 => 1.5607, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.93% (0.0725 => 0.0826, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.89% (0.0720 => 0.0820, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.58% (0.6959 => 0.7904, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.49% (0.0964 => 0.1094, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.48% (0.5637 => 0.6397, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.45% (3.9660 => 4.4995, std.dev.: 0.0221) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.35% (0.5265 => 0.5968, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.22% (0.1588 => 0.1798, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 13.16% (0.7038 => 0.7964, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/mst/mst: 13.14% (0.1111 => 0.1257, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.12% (0.0770 => 0.0871, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 13.09% (0.1062 => 0.1201, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.01% (0.1276 => 0.1442, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.99% (0.7460 => 0.8429, std.dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.83% (0.2914 => 0.3288, std.dev.: 0.0015) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.69% (0.1072 => 0.1208, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 12.58% (0.1478 => 0.1664, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 12.54% (1.1061 => 1.2448, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.52% (1.4563 => 1.6387, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout-C++/hash2: 12.52% (0.4328 => 0.4870, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.43% (0.1014 => 0.1140, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/distray/distray: 12.35% (0.0818 => 0.0919, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.32% (0.5577 => 0.6264, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.27% (0.6283 => 0.7054, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.26% (1.1364 => 1.2757, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.24% (1.2193 => 1.3685, std.dev.: 0.0045) MultiSource/Applications/SPASS/SPASS: 12.12% (13.8202 => 15.4956, std.dev.: 0.0769) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.01% (0.2023 => 0.2266, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.96% (0.1865 => 0.2088, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 11.94% (0.4062 => 0.4547, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.92% (0.4379 => 0.4901, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.87% (0.3899 => 0.4362, std.dev.: 0.0089) MultiSource/Benchmarks/Olden/em3d/em3d: 11.83% (0.1657 => 0.1853, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 11.77% (0.5818 => 0.6503, std.dev.: 0.0023) MultiSource/Applications/spiff/spiff: 11.76% (0.7506 => 0.8389, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.75% (0.1157 => 0.1293, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.66% (0.2127 => 0.2375, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.65% (0.3246 => 0.3624, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: 11.48% (0.5748 => 0.6408, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 11.42% (3.8646 => 4.3058, std.dev.: 0.0211) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.40% (0.4791 => 0.5337, std.dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: 11.39% (0.2995 => 0.3336, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 11.15% (0.3489 => 0.3878, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.12% (0.3130 => 0.3478, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/09-vor/vor: 11.11% (0.2925 => 0.3250, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.09% (0.3022 => 0.3357, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.07% (0.1048 => 0.1164, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 11.07% (0.0976 => 0.1084, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 11.05% (0.7061 => 0.7841, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.03% (0.3580 => 0.3975, std.dev.: 0.0035) MultiSource/Applications/lemon/lemon: 10.95% (1.0313 => 1.1442, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.93% (0.3485 => 0.3866, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.90% (0.1789 => 0.1984, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 10.87% (0.3220 => 0.3570, std.dev.: 0.0016) SingleSource/Regression/C++/ofstream_ctor: 10.79% (0.2781 => 0.3081, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.75% (7.2180 => 7.9936, std.dev.: 0.0290) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.73% (0.4016 => 0.4447, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/health/health: 10.72% (0.1213 => 0.1343, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 10.72% (1.9270 => 2.1335, std.dev.: 0.0096) MultiSource/Applications/minisat/minisat: 10.69% (0.6744 => 0.7465, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/lists: 10.69% (0.3293 => 0.3645, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 10.64% (0.1589 => 0.1758, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.57% (0.2782 => 0.3076, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.52% (0.1569 => 0.1734, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 10.48% (0.3453 => 0.3815, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.41% (0.3756 => 0.4147, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.38% (0.1435 => 0.1584, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 10.34% (0.3868 => 0.4268, std.dev.: 0.0015) MultiSource/Applications/siod/siod: 10.27% (2.1791 => 2.4030, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/football/football: 10.25% (0.8310 => 0.9162, std.dev.: 0.0081) MultiSource/Applications/d/make_dparser: 10.18% (3.1889 => 3.5135, std.dev.: 0.0171) MultiSource/Applications/kimwitu++/kc: 10.16% (16.6129 => 18.3008, std.dev.: 0.0835) SingleSource/Benchmarks/Shootout-C++/lists1: 10.10% (0.3534 => 0.3891, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 10.07% (0.2761 => 0.3039, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 10.05% (0.2726 => 0.3000, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.04% (0.8698 => 0.9571, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary: 10.01% (0.3107 => 0.3418, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.01% (1.9828 => 2.1812, std.dev.: 0.0524) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.99% (1.3245 => 1.4568, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.97% (3.6692 => 4.0351, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/fibo: 9.93% (0.2628 => 0.2889, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.91% (0.2966 => 0.3260, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/except: 9.89% (0.2760 => 0.3033, std.dev.: 0.0058) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.86% (0.2140 => 0.2351, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 9.85% (0.2690 => 0.2955, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 9.81% (0.3149 => 0.3458, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.79% (0.4390 => 0.4820, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.79% (0.2655 => 0.2915, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 9.78% (0.2607 => 0.2862, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.75% (4.3801 => 4.8072, std.dev.: 0.0193) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.69% (0.2765 => 0.3033, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 9.64% (0.2937 => 0.3220, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.57% (0.1819 => 0.1993, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 9.53% (0.4113 => 0.4505, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.52% (4.4433 => 4.8663, std.dev.: 0.0269) SingleSource/Benchmarks/Shootout-C++/ary2: 9.43% (0.3192 => 0.3493, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.40% (4.9865 => 5.4553, std.dev.: 0.0470) SingleSource/Benchmarks/Shootout-C++/matrix: 9.34% (0.2988 => 0.3267, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.31% (0.6135 => 0.6706, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.26% (0.2321 => 0.2536, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.24% (0.2696 => 0.2945, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.22% (0.6576 => 0.7182, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/objinst: 9.13% (0.2945 => 0.3214, std.dev.: 0.0048) MultiSource/Benchmarks/nbench/nbench: 9.07% (1.0594 => 1.1555, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.03% (0.3755 => 0.4094, std.dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 8.98% (14.8535 => 16.1869, std.dev.: 0.0694) MultiSource/Benchmarks/mafft/pairlocalalign: 8.69% (8.4961 => 9.2347, std.dev.: 0.1003) MultiSource/Applications/SIBsim4/SIBsim4: 8.66% (1.2749 => 1.3853, std.dev.: 0.0102) MultiSource/Benchmarks/sim/sim: 8.66% (0.3131 => 0.3402, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.60% (0.3511 => 0.3813, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.39% (0.8818 => 0.9558, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.36% (1.5188 => 1.6458, std.dev.: 0.0129) MultiSource/Benchmarks/FreeBench/neural/neural: 8.30% (0.1385 => 0.1500, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.28% (0.9108 => 0.9862, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/bigfib: 8.21% (0.6250 => 0.6763, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.21% (1.1333 => 1.2263, std.dev.: 0.0060) MultiSource/Applications/lua/lua: 8.15% (3.7467 => 4.0522, std.dev.: 0.0129) SingleSource/UnitTests/ObjC/parameter-passing: 8.12% (0.4003 => 0.4328, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 8.03% (4.6629 => 5.0374, std.dev.: 0.0217) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.01% (0.3245 => 0.3505, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions: 8.00% (0.3914 => 0.4227, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.99% (3.2742 => 3.5358, std.dev.: 0.0183) MultiSource/Applications/JM/ldecod/ldecod: 7.93% (6.5754 => 7.0970, std.dev.: 0.0434) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.91% (6.2785 => 6.7751, std.dev.: 0.0459) SingleSource/UnitTests/ObjC/property: 7.87% (0.3940 => 0.4250, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-2: 7.86% (0.3601 => 0.3884, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 7.85% (0.3578 => 0.3859, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/for-in: 7.79% (0.3789 => 0.4084, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.72% (0.4805 => 0.5176, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-4: 7.71% (0.3646 => 0.3927, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.71% (2.1007 => 2.2626, std.dev.: 0.0109) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.64% (0.3650 => 0.3929, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/synchronized: 7.59% (0.3663 => 0.3941, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.55% (0.2504 => 0.2693, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 7.52% (0.2008 => 0.2159, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 7.51% (0.3623 => 0.3895, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 7.30% (1.2292 => 1.3189, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.09% (0.2243 => 0.2402, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.93% (13.2842 => 14.2054, std.dev.: 0.2149) SingleSource/Benchmarks/Misc/ReedSolomon: 5.80% (0.1777 => 0.1880, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 5.21% (16.2614 => 17.1084, std.dev.: 0.1135) MultiSource/Applications/ClamAV/clamscan: 5.07% (14.5298 => 15.2664, std.dev.: 0.2086) MultiSource/Benchmarks/Olden/bh/bh: 3.88% (0.2859 => 0.2970, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 30.53% (5.7573 => 7.5149, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/fbench: 24.35% (1.8175 => 2.2601, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.11% (1.0895 => 1.2759, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 10.99% (1.1560 => 1.2831, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1923, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 8.96% (0.8273 => 0.9014, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/mst/mst: 8.55% (0.1322 => 0.1435, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (3.1736 => 3.4146, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-4: 6.51% (1.0640 => 1.1333, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.42% (0.9692 => 1.0217, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: 5.17% (1.2998 => 1.3670, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.86% (0.3458 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: 4.77% (1.9144 => 2.0057, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.62% (0.3139 => 0.3284, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.46% (2.8606 => 2.9881, std.dev.: 0.0010) SingleSource/Regression/C/uint64_to_float: 4.44% (0.5449 => 0.5691, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 4.41% (10.7476 => 11.2216, std.dev.: 0.1796) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.89% (1.7081 => 1.7746, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: 3.47% (1.9199 => 1.9865, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 3.39% (12.0921 => 12.5024, std.dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 3.23% (11.2619 => 11.6262, std.dev.: 0.0105) MultiSource/Benchmarks/Olden/bisort/bisort: 3.22% (0.8239 => 0.8504, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-8: 2.25% (1.9863 => 2.0309, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.98% (1.0310 => 1.0514, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 1.83% (1.4298 => 1.4559, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.53% (2.0200 => 2.0510, std.dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.51% (8.3908 => 8.5177, std.dev.: 0.0161) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.37% (1.9433 => 1.9699, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.28% (3.1720 => 3.2125, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1861, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/oourafft: 1.20% (5.5130 => 5.5792, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2138, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.18% (9.9194 => 10.0361, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/em3d/em3d: 1.09% (3.1071 => 3.1409, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 1.07% (12.4560 => 12.5887, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/queens: 1.00% (2.1753 => 2.1971, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -46.07% (0.2670 => 0.1440, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.27% (0.4657 => 0.3946, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.90% (1.3813 => 1.2169, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.67% (1.3819 => 1.2207, std.dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.6002 => 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.28% (1.0460 => 0.8548, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -12.56% (0.2238 => 0.1957, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.11% (20.3410 => 18.2855, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0034) SingleSource/Benchmarks/McGill/chomp: -6.07% (1.2308 => 1.1561, std.dev.: 0.0275) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.72% (1.3780 => 1.2992, std.dev.: 0.0229) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3743, std.dev.: 0.0021) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5151, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.83% (0.9996 => 0.9513, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/perlin: -4.55% (6.2497 => 5.9656, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: -4.29% (0.2333 => 0.2233, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.81% (1.7688 => 1.7014, std.dev.: 0.0193) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.06% (0.4867 => 0.4718, std.dev.: 0.0011) MultiSource/Applications/siod/siod: -2.88% (3.2729 => 3.1787, std.dev.: 0.0063) MultiSource/Applications/spiff/spiff: -2.85% (3.0263 => 2.9402, std.dev.: 0.0030) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8812, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: -2.70% (1.9762 => 1.9229, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4783, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.50% (4.1080 => 4.0055, std.dev.: 0.0035) SingleSource/UnitTests/Vector/build2: -2.35% (1.3891 => 1.3564, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.99% (0.6589 => 0.6458, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.90% (6.3560 => 6.2352, std.dev.: 0.0078) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.86% (0.6615 => 0.6492, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -1.75% (26.5159 => 26.0509, std.dev.: 0.0570) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.67% (2.5254 => 2.4831, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3455, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.64% (0.8342 => 0.8205, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (7.1097 => 7.0065, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: -1.41% (28.2225 => 27.8243, std.dev.: 0.0252) MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (5.3167 => 5.2523, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/heapsort: -1.17% (3.9173 => 3.8713, std.dev.: 0.0174) MultiSource/Applications/aha/aha: -1.07% (3.1476 => 3.1139, std.dev.: 0.0010) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 22 17:55:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 22 Oct 2012 19:55:49 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121023005549.137092A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5106?compare_to=5103&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5106, Order: 166447, Start Time: 2012-10-22 23:33:24, End Time: 2012-10-23 00:57:53 To: 5103, Order: 166441, Start Time: 2012-10-22 21:52:44, End Time: 2012-10-22 23:16:34 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 19 (38 on baseline) Performance Improvements: 0 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 956 (932 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 7.60% (0.1553 => 0.1671, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.93% (0.6155 => 0.6520, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.31% (0.2976 => 0.3134, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.75% (0.2231 => 0.2337, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.09% (0.7874 => 0.8196, std.dev.: 0.0072) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.42% (0.8712 => 0.8923, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.29% (0.5816 => 0.5949, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.25% (1.1801 => 1.2067, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.04% (1.1866 => 1.2108, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.64% (0.6454 => 0.6560, std.dev.: 0.0028) MultiSource/Applications/siod/siod: 1.64% (2.2293 => 2.2658, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.34% (0.9631 => 0.9760, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.33% (0.8813 => 0.8930, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.09% (1.6481 => 1.6661, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.02% (4.5932 => 4.6399, std.dev.: 0.0132) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 4.24% (44.5176 => 46.4064, std.dev.: 0.1198) SingleSource/Benchmarks/Misc/whetstone: 1.96% (2.1024 => 2.1436, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/ffbench: 1.69% (1.4058 => 1.4295, std.dev.: 0.0059) MultiSource/Applications/SIBsim4/SIBsim4: 1.27% (3.1796 => 3.2199, std.dev.: 0.0080) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.28% (16.4844 => 16.4381, std.dev.: 0.2066) MultiSource/Applications/obsequi/Obsequi: 1.81% (1.0358 => 1.0545, std.dev.: 0.0064) MultiSource/Applications/sqlite3/sqlite3: 0.93% (0.6325 => 0.6384, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 2.22% (0.1845 => 0.1886, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.33% (0.1632 => 0.1670, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.02% (0.3250 => 0.3217, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.04% (0.2485 => 0.2484, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.33% (0.3309 => 0.3320, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.12% (0.2415 => 0.2412, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 0.08% (0.5945 => 0.5950, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel: -2.20% (0.0454 => 0.0444, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.91% (0.3287 => 0.3317, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 2.13% (0.1975 => 0.2017, std.dev.: 0.0009) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 27.75% (0.0191 => 0.0244, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.47% (0.0215 => 0.0216, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.94% (0.0424 => 0.0420, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0328 => 0.0328, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.29% (0.0311 => 0.0307, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 6.84% (0.0395 => 0.0422, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 40.56% (0.0143 => 0.0201, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/test1: 62.88% (0.0132 => 0.0215, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: 11.37% (0.0299 => 0.0333, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 7.69% (0.0013 => 0.0014, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1473 => 0.1474, std.dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 5.91% (1.1130 => 1.1788, std.dev.: 0.0129) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 0.53% (0.1514 => 0.1522, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.18% (0.4036 => 0.4124, std.dev.: 0.0182) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.43% (0.1403 => 0.1409, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.98% (0.0601 => 0.0661, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 14.47% (0.0235 => 0.0269, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.18% (0.0550 => 0.0551, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.47% (1.1391 => 1.1445, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 6.90% (0.0029 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 17.57% (0.0535 => 0.0629, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 26.54% (0.0211 => 0.0267, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.10% (0.7927 => 0.8014, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -34.85% (0.0066 => 0.0043, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.89% (2.1832 => 1.6617, std.dev.: 0.0037) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.94% (0.0810 => 0.0931, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/tsp/tsp: 10.97% (0.1112 => 0.1234, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.49% (0.6010 => 0.6520, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.23% (0.8321 => 0.8923, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.20% (0.2180 => 0.2337, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.29% (0.7473 => 0.7868, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.54% (0.2998 => 0.3134, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.34% (0.6287 => 0.6560, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.33% (1.1606 => 1.2108, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.44% (0.9435 => 0.9760, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.40% (0.8148 => 0.8425, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.27% (1.1685 => 1.2067, std.dev.: 0.0034) MultiSource/Applications/spiff/spiff: 3.09% (0.7950 => 0.8196, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.78% (0.5961 => 0.6127, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.68% (0.8697 => 0.8930, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.27% (0.5817 => 0.5949, std.dev.: 0.0049) MultiSource/Applications/treecc/treecc: 2.22% (1.9948 => 2.0390, std.dev.: 0.0092) MultiSource/Applications/siod/siod: 2.14% (2.2184 => 2.2658, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.68% (1.6386 => 1.6661, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.61% (0.8050 => 0.8180, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.53% (4.5702 => 4.6399, std.dev.: 0.0132) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.49% (6.6074 => 6.7057, std.dev.: 0.0317) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.47% (1.2526 => 1.2710, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 1.30% (14.2605 => 14.4453, std.dev.: 0.0599) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.17% (1.4479 => 1.4648, std.dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.88% (1.5795 => 2.5095, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.36% (0.3186 => 0.3516, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.42% (1.1857 => 1.2855, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 5.94% (63.1822 => 66.9346, std.dev.: 0.0608) MultiSource/Benchmarks/FreeBench/distray/distray: 4.35% (0.2390 => 0.2494, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 4.14% (44.5605 => 46.4064, std.dev.: 0.1198) MultiSource/Applications/siod/siod: 2.61% (3.6643 => 3.7599, std.dev.: 0.0224) SingleSource/Benchmarks/Misc/ReedSolomon: 2.10% (8.5322 => 8.7115, std.dev.: 0.0361) MultiSource/Benchmarks/Olden/bh/bh: 1.66% (2.3560 => 2.3951, std.dev.: 0.0142) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.44% (4.8362 => 4.9059, std.dev.: 0.0163) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.0998 => 1.1113, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 1.04% (3.2169 => 3.2502, std.dev.: 0.0089) MultiSource/Applications/SIBsim4/SIBsim4: 1.02% (3.1873 => 3.2199, std.dev.: 0.0080) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.65% (0.3269 => 0.3019, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -5.02% (29.8330 => 28.3354, std.dev.: 0.1846) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.46% (3.3479 => 3.2991, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: -1.37% (3.4237 => 3.3767, std.dev.: 0.0159) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.05% (16.4461 => 16.4381, std.dev.: 0.2066) MultiSource/Applications/obsequi/Obsequi: 2.76% (1.0262 => 1.0545, std.dev.: 0.0064) MultiSource/Applications/sqlite3/sqlite3: 0.82% (0.6332 => 0.6384, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 3.00% (0.1831 => 0.1886, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.12% (0.1559 => 0.1670, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.01% (0.3123 => 0.3217, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.85% (0.2463 => 0.2484, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.72% (0.3344 => 0.3320, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (0.2364 => 0.2412, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: -1.00% (0.6010 => 0.5950, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel: 3.50% (0.0429 => 0.0444, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.56% (0.3266 => 0.3317, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 2.44% (0.1969 => 0.2017, std.dev.: 0.0009) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.93% (0.0224 => 0.0244, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 75.61% (0.0123 => 0.0216, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.94% (0.0408 => 0.0420, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.13% (0.0254 => 0.0328, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.66% (0.0302 => 0.0307, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.90% (0.0384 => 0.0422, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 5.79% (0.0190 => 0.0201, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/test1: 19.44% (0.0180 => 0.0215, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: 44.78% (0.0230 => 0.0333, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 100.00% (0.0007 => 0.0014, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.50% (0.1438 => 0.1474, std.dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 4.05% (1.1329 => 1.1788, std.dev.: 0.0129) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 4.10% (0.1462 => 0.1522, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.96% (0.4164 => 0.4124, std.dev.: 0.0182) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.92% (0.1369 => 0.1409, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.12% (0.0641 => 0.0661, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 37.95% (0.0195 => 0.0269, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.67% (0.0578 => 0.0551, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.07% (1.1437 => 1.1445, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.32% (0.0627 => 0.0629, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.33% (0.0180 => 0.0267, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.04% (0.8017 => 0.8014, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -30.65% (0.0062 => 0.0043, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 22 18:41:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 22 Oct 2012 20:41:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121023014129.D3C422A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5107?compare_to=5104&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5107, Order: 166448, Start Time: 2012-10-23 00:23:37, End Time: 2012-10-23 01:43:32 To: 5104, Order: 166442, Start Time: 2012-10-22 22:33:18, End Time: 2012-10-22 23:53:22 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (5 on baseline) Performance Regressions: 1 (191 on baseline) Performance Improvements: 2 (46 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 88 (14 on baseline) Unchanged Tests: 951 (650 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.28% (0.9365 => 0.9485, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -6.56% (16.3090 => 15.2388, std.dev.: 0.0048) MultiSource/Applications/JM/ldecod/ldecod: -1.10% (12.1032 => 11.9698, std.dev.: 0.0047) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.6252 => 0.6252, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -0.06% (17.2191 => 17.2096, std.dev.: 0.0112) MultiSource/Applications/kimwitu++/kc: 0.18% (15.5454 => 15.5731, std.dev.: 0.0113) MultiSource/Benchmarks/Bullet/bullet: 0.34% (56.0135 => 56.2048, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.46% (0.0479 => 0.0486, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.46% (0.0481 => 0.0488, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.33% (0.0451 => 0.0457, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.55% (0.0451 => 0.0458, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.37% (0.0439 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.13% (0.0441 => 0.0446, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.15% (0.0434 => 0.0439) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.38% (0.0434 => 0.0440, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.33% (0.0451 => 0.0457, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.10% (0.0453 => 0.0458, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.35% (0.0445 => 0.0451, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.35% (0.0446 => 0.0452, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.38% (0.0436 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.14% (0.0437 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.13% (0.0443 => 0.0448) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.13% (0.0444 => 0.0449, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.32% (0.0453 => 0.0459, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.95% (0.0454 => 0.0481, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.16% (0.0431 => 0.0436) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.16% (0.0432 => 0.0437, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.36% (0.0442 => 0.0448) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.13% (0.0444 => 0.0449, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.92% (0.0435 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.15% (0.0435 => 0.0440, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.17% (0.0427 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.17% (0.0428 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.41% (0.0425 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.41% (0.0426 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.86% (0.0463 => 0.0467) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.08% (0.0463 => 0.0468, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.18% (0.0424 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.41% (0.0425 => 0.0431, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.65% (0.0425 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.65% (0.0425 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.15% (0.0433 => 0.0438) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.38% (0.0434 => 0.0440, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.25% (1.4869 => 1.4906, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.24% (8.1947 => 8.2145, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.34% (0.6848 => 0.6871, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1436 => 0.1436, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.78% (0.2134 => 0.0645, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.13% (63.2438 => 56.2048, std.dev.: 0.0020) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/MallocBench/gs/gs: 13.24% (4.1105 => 4.6549, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.02% (3.4629 => 5.7838, std.dev.: 0.0091) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13481.81% (0.0720 => 9.7789, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049900.00% (0.0001 => 10.0500, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 63.86% (0.2554 => 0.4185, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/lowercase: 57.42% (0.0256 => 0.0403, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 46.99% (10.3673 => 15.2388, std.dev.: 0.0048) SingleSource/UnitTests/SignlessTypes/factor: 46.62% (0.0296 => 0.0434, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 43.17% (0.0271 => 0.0388, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 40.99% (1.5859 => 2.2360, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 40.01% (0.1622 => 0.2271, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/distray/distray: 36.46% (0.1056 => 0.1441, std.dev.: 0.0007) SingleSource/UnitTests/vla: 32.96% (0.0355 => 0.0472, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 29.99% (2.2024 => 2.8628, std.dev.: 0.0173) MultiSource/Benchmarks/FreeBench/neural/neural: 25.84% (0.1463 => 0.1841, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 23.98% (0.0834 => 0.1034, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.20% (0.1566 => 0.1898, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 20.94% (0.2049 => 0.2478, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 19.34% (0.1432 => 0.1709, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.33% (7.0540 => 8.4177, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.60% (0.0871 => 0.1033, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 18.52% (0.1555 => 0.1843, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.15% (2.2022 => 2.6019, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.49% (0.5105 => 0.5998, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 16.88% (0.6675 => 0.7802, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 16.80% (0.1655 => 0.1933, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.63% (1.3050 => 1.5220, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: 16.61% (0.0626 => 0.0730, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 16.39% (3.3354 => 3.8822, std.dev.: 0.0124) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.39% (0.0793 => 0.0923, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.32% (0.4615 => 0.5368, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 16.22% (0.1695 => 0.1970, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.16% (0.2271 => 0.2638, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 16.11% (0.1440 => 0.1672) MultiSource/Benchmarks/Olden/mst/mst: 16.08% (0.1163 => 0.1350, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.07% (0.8172 => 0.9485, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/tsp/tsp: 16.00% (0.1175 => 0.1363, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.78% (0.1337 => 0.1548, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.50% (0.1032 => 0.1192, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.46% (0.0886 => 0.1023, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.30% (1.5415 => 1.7774, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.26% (0.5020 => 0.5786, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.08% (0.0842 => 0.0969, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.00% (0.1940 => 0.2231, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 14.96% (0.3282 => 0.3773, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 14.94% (0.7115 => 0.8178, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 14.91% (0.0818 => 0.0940, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.77% (0.1510 => 0.1733, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 14.76% (0.3109 => 0.3568, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.71% (0.1584 => 0.1817, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 14.70% (10.4361 => 11.9698, std.dev.: 0.0047) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.67% (0.3121 => 0.3579, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.64% (0.9765 => 1.1195, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.53% (0.2065 => 0.2365, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.44% (0.0838 => 0.0959, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 14.43% (0.3423 => 0.3917, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.42% (0.0770 => 0.0881, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.32% (0.1117 => 0.1277, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/exptree: 14.25% (0.0814 => 0.0930, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.23% (4.2646 => 4.8713, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.21% (0.0746 => 0.0852, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 14.11% (0.1906 => 0.2175, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 14.05% (1.1642 => 1.3278, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.00% (0.2107 => 0.2402, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.00% (0.1236 => 0.1409, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.00% (0.2758 => 0.3144, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 13.88% (9.4845 => 10.8011, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.87% (0.5860 => 0.6673, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 13.83% (0.6450 => 0.7342, std.dev.: 0.0018) MultiSource/Applications/aha/aha: 13.81% (0.1151 => 0.1310, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.81% (1.7609 => 2.0041, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.77% (0.1438 => 0.1636, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.70% (0.1029 => 0.1170, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 13.68% (0.7835 => 0.8907, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.64% (0.5981 => 0.6797, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.61% (0.0933 => 0.1060, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.57% (1.4186 => 1.6111, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.55% (8.1363 => 9.2386, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.41% (0.0798 => 0.0905, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.37% (0.1062 => 0.1204, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 13.35% (5.7591 => 6.5281, std.dev.: 0.0084) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.22% (0.2700 => 0.3057, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 13.18% (2.0273 => 2.2944, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.12% (0.0770 => 0.0871) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.03% (0.8067 => 0.9118, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 13.02% (1.1840 => 1.3382, std.dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 13.01% (0.7433 => 0.8400, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.98% (0.5569 => 0.6292, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.93% (0.4879 => 0.5510, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.92% (0.0929 => 0.1049, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.90% (4.9449 => 5.5827, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.86% (0.1695 => 0.1913, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.82% (5.0018 => 5.6430, std.dev.: 0.0138) MultiSource/Benchmarks/Olden/health/health: 12.78% (0.1268 => 0.1430, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/rem: 12.76% (0.1144 => 0.1290, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.74% (0.1625 => 0.1832, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 12.66% (3.8723 => 4.3627, std.dev.: 0.0034) MultiSource/Applications/lemon/lemon: 12.62% (1.0722 => 1.2075, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 12.51% (0.4299 => 0.4837, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.48% (0.1330 => 0.1496, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 12.25% (0.3387 => 0.3802, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.25% (1.1861 => 1.3314, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.22% (0.3307 => 0.3711, std.dev.: 0.0053) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 12.15% (0.3177 => 0.3563, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.13% (7.9617 => 8.9278, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.99% (0.2603 => 0.2915, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 11.82% (0.3180 => 0.3556, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 11.80% (0.8921 => 0.9974, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.64% (0.1125 => 0.1256, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 11.54% (1.5603 => 1.7404, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.51% (0.3441 => 0.3837, std.dev.: 0.0009) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.46% (0.1143 => 0.1274) MultiSource/Benchmarks/Olden/bh/bh: 11.42% (0.3092 => 0.3445, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.27% (0.8101 => 0.9014, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 10.94% (0.6456 => 0.7162, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.47% (0.1892 => 0.2090, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.41% (0.2266 => 0.2502, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 10.31% (2.2969 => 2.5338, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/parameter-passing: 10.24% (0.3927 => 0.4329, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.22% (0.3473 => 0.3828, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.16% (0.3543 => 0.3903, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.10% (0.3543 => 0.3901, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.08% (0.3561 => 0.3920, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.06% (0.3828 => 0.4213, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.04% (0.3694 => 0.4065, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.04% (0.3497 => 0.3848, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.01% (0.3516 => 0.3868, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 9.89% (21.9371 => 24.1056, std.dev.: 0.0115) SingleSource/UnitTests/ObjC/property: 9.88% (0.3886 => 0.4270, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 9.77% (0.4289 => 0.4708, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 9.74% (0.4620 => 0.5070, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.64% (0.3826 => 0.4195, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.33% (0.4203 => 0.4595, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 9.29% (0.3422 => 0.3740, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.18% (0.3865 => 0.4220, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 9.02% (0.4048 => 0.4413, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.75% (0.4103 => 0.4462, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.72% (0.2430 => 0.2642, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.71% (0.4636 => 0.5040, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 8.67% (0.6030 => 0.6553, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 8.66% (0.5925 => 0.6438, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 8.58% (0.3684 => 0.4000, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 8.51% (17.1811 => 18.6426, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.43% (0.3427 => 0.3716, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 8.27% (0.3603 => 0.3901, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.95% (0.3650 => 0.3940, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.92% (0.7326 => 0.7906, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.83% (14.3668 => 15.4913, std.dev.: 0.0186) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.69% (3.8922 => 4.1914, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/matrix: 7.39% (0.3098 => 0.3327, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.36% (0.4064 => 0.4363, std.dev.: 0.0029) SingleSource/Regression/C++/ofstream_ctor: 7.26% (0.2905 => 0.3116, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.24% (0.3136 => 0.3363, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.13% (0.2891 => 0.3097, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.99% (0.2831 => 0.3029, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.98% (0.3379 => 0.3615, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.96% (0.3162 => 0.3382, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.93% (0.3232 => 0.3456, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.92% (2.0665 => 2.2094, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 6.85% (0.3283 => 0.3508, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.83% (0.2871 => 0.3067, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.82% (0.2872 => 0.3068, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.80% (0.2793 => 0.2983, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.71% (0.2756 => 0.2941, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.67% (0.2877 => 0.3069, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.67% (0.2714 => 0.2895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.65% (0.3052 => 0.3255, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.64% (0.2725 => 0.2906, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.46% (0.2802 => 0.2983, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 6.32% (1.2842 => 1.3653, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/objinst: 5.56% (0.3131 => 0.3305, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.20% (1.1194 => 1.1552, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.85% (0.3935 => 0.4047, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.65% (0.3817 => 0.3918, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8962, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 146.51% (5.3999 => 13.3115, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1725, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.52% (0.9957 => 1.1303, std.dev.: 0.0187) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.35% (0.2944 => 0.3278, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.91% (1.1396 => 1.2525, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.1578 => 3.3686, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 5.91% (1.9405 => 2.0551, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.00% (4.2280 => 4.3547, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.61% (0.3987 => 0.4091, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.02% (3.6395 => 3.7130, std.dev.: 0.0025) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2076, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.41% (2.6546 => 2.6920, std.dev.: 0.0027) MultiSource/Applications/viterbi/viterbi: 1.29% (4.4649 => 4.5227, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.00% (6.6874 => 0.1335, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -79.83% (0.8651 => 0.1745, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.05% (5.2763 => 3.2159, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.71% (5.3855 => 3.7318, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.34% (5.3526 => 3.7287, std.dev.: 0.0031) SingleSource/UnitTests/Vector/constpool: -14.76% (54.1659 => 46.1734, std.dev.: 0.0217) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.57% (2.9384 => 2.6278, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -5.65% (22.1758 => 20.9238, std.dev.: 0.0080) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.08% (8.0499 => 3.7774, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.38% (1.1492 => 0.7656, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.64% (2.9695 => 2.4753, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -16.02% (1.6925 => 1.4213, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.70% (1.2258 => 1.0701, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -12.65% (1.2373 => 1.0808, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/mandel-2: -10.79% (1.5373 => 1.3715, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.29% (19.9488 => 18.2960, std.dev.: 0.0183) MultiSource/Benchmarks/FreeBench/mason/mason: -8.01% (0.2161 => 0.1988, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.11% (1.8329 => 1.7026, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.24% (1.6805 => 1.5925, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.84% (1.5835 => 1.5068, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.36% (8.1563 => 7.8006, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.67% (3.2827 => 3.1622, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8776, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.4996, std.dev.: 0.0050) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.48% (0.4808 => 0.4689, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -2.30% (4.6441 => 4.5372, std.dev.: 0.0040) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.89% (10.2830 => 10.0884, std.dev.: 0.0145) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6813, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.68% (2.5528 => 2.5099, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091) MultiSource/Benchmarks/NPB-serial/is/is: -1.51% (9.5636 => 9.4190, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2878, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8594, std.dev.: 0.0015) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 19.56% (0.5229 => 0.6252, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 14.81% (14.9895 => 17.2096, std.dev.: 0.0112) MultiSource/Applications/kimwitu++/kc: 10.02% (14.1553 => 15.5731, std.dev.: 0.0113) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 34.92% (1.1048 => 1.4906, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.76% (7.1582 => 8.2145, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.43% (0.6222 => 0.6871, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.30% (0.1485 => 0.1436, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.52% (0.2116 => 0.0645, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 22 18:56:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 22 Oct 2012 20:56:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121023015634.F33912A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5108?compare_to=4945&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5108, Order: 166431, Start Time: 2012-10-22 22:42:40, End Time: 2012-10-23 01:58:37 To: 4945, Order: 166125, Start Time: 2012-10-17 21:58:21, End Time: 2012-10-18 01:15:23 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 115 (170 on baseline) Performance Improvements: 3 (19 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 924 (719 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 29.12% (0.0697 => 0.0900, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 20.90% (0.1172 => 0.1417, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 18.79% (0.4406 => 0.5234, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 16.00% (1.7346 => 2.0122, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 15.92% (0.3160 => 0.3663, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.76% (0.0768 => 0.0889, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 14.96% (0.1190 => 0.1368, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 14.07% (0.4441 => 0.5066, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 13.98% (0.6302 => 0.7183, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.48% (0.5392 => 0.6119, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 13.34% (0.5389 => 0.6108, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.55% (0.0956 => 0.1076, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.34% (0.1686 => 0.1894, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 12.22% (0.1097 => 0.1231, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 12.19% (0.1747 => 0.1960, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 12.13% (0.1195 => 0.1340, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 11.20% (0.1018 => 0.1132, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.01% (0.1072 => 0.1190, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.84% (0.1208 => 0.1339, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.82% (0.4169 => 0.4620, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.80% (0.1657 => 0.1836, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.80% (0.1185 => 0.1313, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 10.40% (0.1010 => 0.1115, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.09% (0.2161 => 0.2379, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.05% (0.4148 => 0.4565, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.62% (0.1560 => 0.1710, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 9.56% (0.1758 => 0.1926, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.17% (0.2934 => 0.3203, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.13% (1.4153 => 1.5445, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 9.00% (0.1611 => 0.1756, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.92% (0.4934 => 0.5374, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 8.88% (2.0052 => 2.1832, std.dev.: 0.0044) MultiSource/Applications/spiff/spiff: 8.87% (0.4317 => 0.4700, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 8.84% (0.5892 => 0.6413, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.73% (0.3060 => 0.3327, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.69% (0.3465 => 0.3766, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.66% (0.2091 => 0.2272, std.dev.: 0.0013) MultiSource/Applications/d/make_dparser: 8.60% (1.1535 => 1.2527, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.54% (0.5353 => 0.5810, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.40% (3.8293 => 4.1510, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.30% (2.1060 => 2.2809, std.dev.: 0.0037) SingleSource/UnitTests/ObjC++/Hello: 8.29% (0.6296 => 0.6818, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 8.21% (0.1523 => 0.1648, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 8.09% (0.6354 => 0.6868, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.09% (2.0813 => 2.2496, std.dev.: 0.0083) MultiSource/Benchmarks/Olden/bh/bh: 8.07% (0.1363 => 0.1473, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 7.93% (0.7664 => 0.8272, std.dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: 7.65% (4.4989 => 4.8432, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.60% (1.7477 => 1.8805, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: 7.55% (1.0374 => 1.1157, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.54% (0.4202 => 0.4519, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: 7.54% (0.1326 => 0.1426, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.51% (4.7160 => 5.0704, std.dev.: 0.0052) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.47% (2.9296 => 3.1485, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/football/football: 7.20% (0.2193 => 0.2351, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.08% (0.2953 => 0.3162, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 6.96% (2.2880 => 2.4473, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 6.78% (0.8299 => 0.8862, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 6.77% (0.2938 => 0.3137, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.72% (0.3111 => 0.3320, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 6.69% (25.1291 => 26.8099, std.dev.: 0.0233) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.60% (0.4091 => 0.4361, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 6.56% (0.2925 => 0.3117, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.55% (0.3235 => 0.3447, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 6.48% (0.3026 => 0.3222, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 6.46% (0.3327 => 0.3542, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.46% (0.2941 => 0.3131, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 6.39% (0.4710 => 0.5011, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.38% (0.3008 => 0.3200, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 6.35% (1.0658 => 1.1335, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 6.35% (0.3026 => 0.3218, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.33% (0.3016 => 0.3207, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.32% (0.3133 => 0.3331, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 6.31% (0.3041 => 0.3233, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.29% (2.2262 => 2.3663, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/strcat: 6.27% (0.2966 => 0.3152, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 6.23% (0.2824 => 0.3000, std.dev.: 0.0025) MultiSource/Applications/lua/lua: 6.18% (1.5202 => 1.6142, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 6.15% (0.3514 => 0.3730, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.12% (0.3449 => 0.3660, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 6.10% (4.8983 => 5.1972, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.03% (0.2155 => 0.2285, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.90% (0.3354 => 0.3552, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.90% (0.3288 => 0.3482, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.87% (0.3561 => 0.3770, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.82% (0.3504 => 0.3708, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.74% (0.3608 => 0.3815, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.63% (0.3516 => 0.3714, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 5.51% (2.2333 => 2.3564, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: 5.51% (0.3593 => 0.3791, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/moments: 5.50% (0.3943 => 0.4160, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.48% (0.4252 => 0.4485, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 5.47% (0.3727 => 0.3931, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 5.38% (0.3998 => 0.4213, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 5.34% (0.3655 => 0.3850, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.33% (0.3942 => 0.4152, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 5.26% (0.5328 => 0.5608, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.24% (0.3894 => 0.4098, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 5.21% (0.2763 => 0.2907, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 4.94% (0.4553 => 0.4778, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 4.92% (0.4452 => 0.4671, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.93% (0.6853 => 0.7122, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 3.46% (5.9591 => 6.1650, std.dev.: 0.0153) MultiSource/Applications/sqlite3/sqlite3: 3.41% (2.1465 => 2.2197, std.dev.: 0.0086) MultiSource/Applications/siod/siod: 3.07% (0.7098 => 0.7316, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 2.87% (0.3550 => 0.3652, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 2.82% (12.3028 => 12.6492, std.dev.: 0.0132) MultiSource/Benchmarks/PAQ8p/paq8p: 2.49% (0.5182 => 0.5311, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 2.47% (0.4123 => 0.4225, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.40% (12.1904 => 12.4826, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.39% (4.9404 => 5.0584, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.04% (0.5840 => 0.5959, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.00% (0.5654 => 0.5767, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 1.14% (16.2167 => 16.4022, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.07% (1.6029 => 1.6201, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.68% (2.4129 => 2.3724, std.dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/dry: -1.46% (14.6362 => 14.4220, std.dev.: 0.0108) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.30% (22.0026 => 21.7155, std.dev.: 0.0381) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 44.00% (0.0625 => 0.0900, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.30% (0.1063 => 0.1417, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 26.30% (1.5932 => 2.0122, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.51% (0.0714 => 0.0889, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 23.69% (0.1106 => 0.1368, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 23.37% (0.2969 => 0.3663, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.07% (0.4253 => 0.5234, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 22.53% (0.4994 => 0.6119, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 22.40% (0.4139 => 0.5066, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.16% (0.5000 => 0.6108, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 21.75% (0.5900 => 0.7183, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 21.57% (0.0547 => 0.0665, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 21.47% (0.0475 => 0.0577, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.05% (0.1107 => 0.1340, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 20.99% (0.1620 => 0.1960, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 20.57% (0.1021 => 0.1231, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.38% (0.0584 => 0.0703, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 19.96% (0.0897 => 0.1076, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/04-bisect/bisect: 19.43% (0.0633 => 0.0756, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 19.41% (0.0948 => 0.1132, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.35% (0.0584 => 0.0697, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 19.20% (0.0599 => 0.0714, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.16% (0.0642 => 0.0765, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.04% (0.1103 => 0.1313, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 18.96% (0.1619 => 0.1926, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 18.88% (0.0821 => 0.0976, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.73% (0.0822 => 0.0976, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.67% (0.0541 => 0.0642, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.64% (0.1003 => 0.1190, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.53% (0.1549 => 0.1836, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.37% (0.3903 => 0.4620, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.12% (0.2014 => 0.2379, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 18.08% (0.1604 => 0.1894, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 18.05% (0.0604 => 0.0713, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 17.74% (0.0947 => 0.1115, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.43% (1.3152 => 1.5445, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.35% (0.3890 => 0.4565, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 17.08% (0.1218 => 0.1426, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.07% (0.2736 => 0.3203, std.dev.: 0.0037) SingleSource/UnitTests/ObjC++/Hello: 17.03% (0.5826 => 0.6818, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.96% (0.1462 => 0.1710, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 16.68% (0.1505 => 0.1756, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 16.65% (0.4029 => 0.4700, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 16.62% (0.5889 => 0.6868, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 16.58% (0.0808 => 0.0942, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.51% (3.5627 => 4.1510, std.dev.: 0.0040) MultiSource/Applications/d/make_dparser: 16.20% (1.0781 => 1.2527, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/voronoi/voronoi: 16.18% (0.1088 => 0.1264, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 16.16% (1.8794 => 2.1832, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.09% (0.2866 => 0.3327, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/mst/mst: 16.05% (0.0698 => 0.0810, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.00% (1.6211 => 1.8805, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/18-imp/imp: 15.97% (0.1421 => 0.1648, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 15.63% (0.5546 => 0.6413, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.60% (0.5026 => 0.5810, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.49% (0.2738 => 0.3162, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.48% (0.2875 => 0.3320, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.45% (0.1968 => 0.2272, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.43% (0.1160 => 0.1339, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 15.37% (0.4658 => 0.5374, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.36% (2.7292 => 3.1485, std.dev.: 0.0050) SingleSource/UnitTests/ObjC++/property-reference: 15.35% (0.7171 => 0.8272, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.14% (0.1090 => 0.1255, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.13% (0.3271 => 0.3766, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 15.12% (0.2725 => 0.3137, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 15.06% (0.9697 => 1.1157, std.dev.: 0.0036) MultiSource/Applications/ClamAV/clamscan: 15.02% (4.2109 => 4.8432, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.99% (0.3930 => 0.4519, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 14.90% (0.4361 => 0.5011, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 14.85% (0.2714 => 0.3117, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 14.78% (0.2780 => 0.3191, std.dev.: 0.0085) SingleSource/Regression/C++/ofstream_ctor: 14.75% (0.3004 => 0.3447, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 14.73% (0.2729 => 0.3131, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 14.73% (4.4195 => 5.0704, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/bh/bh: 14.72% (0.1284 => 0.1473, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 14.62% (0.2750 => 0.3152, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.61% (0.2792 => 0.3200, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.55% (0.3195 => 0.3660, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 14.54% (0.2813 => 0.3222, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 14.52% (0.2823 => 0.3233, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 14.48% (0.2811 => 0.3218, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.46% (2.0673 => 2.3663, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.43% (0.2911 => 0.3331, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 14.41% (0.2803 => 0.3207, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 14.41% (0.3096 => 0.3542, std.dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: 14.39% (0.9909 => 1.1335, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.24% (1.9966 => 2.2809, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.23% (1.9694 => 2.2496, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/ary3: 14.17% (0.3267 => 0.3730, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 14.17% (0.3465 => 0.3956, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 14.16% (0.3446 => 0.3934, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 14.16% (0.3496 => 0.3991, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 14.05% (0.3460 => 0.3946, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 14.03% (0.3442 => 0.3925, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.99% (0.3488 => 0.3976, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 13.99% (23.5202 => 26.8099, std.dev.: 0.0233) SingleSource/UnitTests/ObjC/synchronized: 13.98% (0.3469 => 0.3954, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary: 13.81% (0.3258 => 0.3708, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 13.79% (0.3060 => 0.3482, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.70% (0.3124 => 0.3552, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 13.67% (0.3650 => 0.4149, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 13.66% (0.3317 => 0.3770, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 13.64% (0.3643 => 0.4140, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.47% (0.3362 => 0.3815, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 13.45% (0.3724 => 0.4225, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.42% (0.3845 => 0.4361, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 13.30% (0.2075 => 0.2351, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 13.29% (0.2566 => 0.2907, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 13.23% (0.3348 => 0.3791, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.16% (0.3282 => 0.3714, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 13.13% (1.4269 => 1.6142, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 13.10% (0.3678 => 0.4160, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 13.07% (0.3726 => 0.4213, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 13.06% (0.3477 => 0.3931, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.05% (0.3625 => 0.4098, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 13.02% (2.1653 => 2.4473, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 12.66% (0.4146 => 0.4671, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.66% (0.3981 => 0.4485, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 12.55% (4.6177 => 5.1972, std.dev.: 0.0029) MultiSource/Applications/treecc/treecc: 12.53% (0.7875 => 0.8862, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.52% (0.3690 => 0.4152, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 12.40% (0.4251 => 0.4778, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 12.14% (2.1013 => 2.3564, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.01% (0.2040 => 0.2285, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 11.89% (0.5012 => 0.5608, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 11.48% (0.2691 => 0.3000, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.42% (0.1383 => 0.1541, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 11.25% (5.5417 => 6.1650, std.dev.: 0.0153) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.68% (0.6435 => 0.7122, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 10.28% (0.6634 => 0.7316, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 10.06% (0.3498 => 0.3850, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.96% (0.2068 => 0.2274, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.94% (0.2737 => 0.3009, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 9.57% (0.4847 => 0.5311, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 9.47% (0.3336 => 0.3652, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.44% (0.3084 => 0.3375, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 9.10% (2.0346 => 2.2197, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.84% (0.2103 => 0.2289, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 8.62% (0.2391 => 0.2597, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.80% (4.6926 => 5.0584, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.57% (0.5361 => 0.5767, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.24% (11.6398 => 12.4826, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.79% (0.7426 => 0.7930, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.72% (0.5584 => 0.5959, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 5.80% (11.9555 => 12.6492, std.dev.: 0.0132) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.67% (0.3792 => 0.3969, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.37% (0.2162 => 0.3532, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-1: 22.66% (6.2401 => 7.6538) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.25% (0.5917 => 0.6701, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 7.92% (0.2802 => 0.3024, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary: 7.02% (0.2122 => 0.2271, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6106, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.52% (0.3693 => 0.3897, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.04% (12.0509 => 12.6585, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1686, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-2: 3.95% (1.8057 => 1.8771, std.dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/dry: 2.66% (14.0481 => 14.4220, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1909, std.dev.: 0.0087) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.70% (3.1722 => 3.2262, std.dev.: 0.0019) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3076, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2901, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.26% (2.0820 => 2.1082, std.dev.: 0.0078) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.25% (1.0142 => 1.0269, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5137, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.14% (1.0927 => 1.1052, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.08% (1.2451 => 1.2585, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5849, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.20% (2.4764 => 2.3724, std.dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.47% (25.4195 => 16.4022, std.dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9769, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7758, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: -6.29% (0.2402 => 0.2251, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2420, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.44% (11.2080 => 10.8227, std.dev.: 0.0638) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7733, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5217, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.81% (0.6293 => 0.6116, std.dev.: 0.0044) SingleSource/Benchmarks/Dhrystone/fldry: -2.27% (17.2379 => 16.8464, std.dev.: 0.0094) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.18% (41.7953 => 40.8823, std.dev.: 0.0104) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5710, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4958, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.1976, std.dev.: 0.1972) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0415, std.dev.: 0.0033) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.03% (3.3991 => 3.3640, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 22 19:15:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 22 Oct 2012 21:15:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121023021511.9618F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5109?compare_to=5105&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5109, Order: 166452, Start Time: 2012-10-23 00:50:15, End Time: 2012-10-23 02:18:14 To: 5105, Order: 166442, Start Time: 2012-10-22 22:50:28, End Time: 2012-10-23 00:19:56 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 31 (213 on baseline) Performance Improvements: 3 (38 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1008 (653 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 22.30% (0.4112 => 0.5029, std.dev.: 0.0344) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.66% (0.6397 => 0.6631, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.64% (0.9009 => 0.9337, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.06% (0.8429 => 0.8687, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 1.95% (1.2448 => 1.2691, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 1.90% (0.8389 => 0.8548, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.82% (1.2169 => 1.2391, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.79% (0.5968 => 0.6075, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/gs/gs: 1.75% (4.3058 => 4.3811, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.69% (1.0514 => 1.0692, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.69% (0.6264 => 0.6370, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.61% (1.2207 => 1.2403, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.49% (0.7904 => 0.8022, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.42% (1.4568 => 1.4775, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.25% (7.9936 => 8.0936, std.dev.: 0.0129) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.20% (1.2757 => 1.2910, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.14% (4.8663 => 4.9216, std.dev.: 0.0100) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.03% (4.4995 => 4.5459, std.dev.: 0.0146) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2263 => 1.2389, std.dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.14% (0.1825 => 0.3543, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 5.75% (1.5003 => 1.5866, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 5.26% (4.5092 => 4.7463, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 5.14% (1.5115 => 1.5892, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 4.85% (3.3707 => 3.5342, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 3.89% (1.4954 => 1.5536, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 3.74% (1.3078 => 1.3567, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 3.20% (2.7282 => 2.8155, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.40% (5.1601 => 5.2324, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/salsa20: 1.38% (7.4828 => 7.5858, std.dev.: 0.0051) MultiSource/Applications/lemon/lemon: 1.24% (1.4559 => 1.4739, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.20% (5.4159 => 5.4810, std.dev.: 0.0118) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash2: -6.47% (3.4146 => 3.1936, std.dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.51% (4.4659 => 4.3983, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/lists: -1.31% (12.5887 => 12.4238, std.dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/vla: 31.17% (0.0324 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 24.33% (2.0176 => 2.5084, std.dev.: 0.0211) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.97% (0.1410 => 0.1748, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 21.98% (0.0746 => 0.0910, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 21.10% (0.7710 => 0.9337, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/tsp/tsp: 21.03% (0.1013 => 0.1226, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 19.97% (0.2243 => 0.2691, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 19.61% (0.0826 => 0.0988, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 18.99% (0.0653 => 0.0777, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.77% (0.0618 => 0.0734, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 17.92% (0.0770 => 0.0908, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.66% (0.0725 => 0.0853, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.63% (0.5637 => 0.6631, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.63% (0.0811 => 0.0954, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 17.53% (0.2721 => 0.3198, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.53% (0.2596 => 0.3051, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.52% (0.1986 => 0.2334, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.50% (0.0720 => 0.0846, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.24% (0.0847 => 0.0993, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 17.05% (0.1003 => 0.1174, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.74% (0.1075 => 0.1255, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 16.65% (0.1111 => 0.1296, std.dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: 16.58% (0.1478 => 0.1723, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.51% (0.0648 => 0.0755, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.51% (0.1072 => 0.1249, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/messages-2: 16.45% (0.0614 => 0.0715, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.45% (0.7460 => 0.8687, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 16.23% (0.9199 => 1.0692, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_isamax: 16.21% (0.0654 => 0.0760, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.13% (0.2914 => 0.3384, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.92% (0.1413 => 0.1638, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 15.83% (0.0834 => 0.0966, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 15.81% (1.3693 => 1.5858, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.56% (0.0977 => 0.1129, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 15.38% (0.5265 => 0.6075, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.28% (0.1276 => 0.1471, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.28% (0.6959 => 0.8022, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.26% (0.0819 => 0.0944, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 15.25% (0.1062 => 0.1224, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.22% (0.1327 => 0.1529, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.99% (0.1014 => 0.1166, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.75% (0.1865 => 0.2140, std.dev.: 0.0019) MultiSource/Applications/Burg/burg: 14.74% (1.1061 => 1.2691, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.73% (0.0964 => 0.1106, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.62% (3.9660 => 4.5459, std.dev.: 0.0146) MultiSource/Applications/lambda-0_1_3/lambda: 14.56% (0.7038 => 0.8063, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.53% (0.2023 => 0.2317, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 14.42% (0.1657 => 0.1896, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 14.23% (0.3246 => 0.3708, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.22% (0.5577 => 0.6370, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 14.10% (0.2127 => 0.2427, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.93% (0.1048 => 0.1194, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 13.88% (0.7506 => 0.8548, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.86% (0.1789 => 0.2037, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.85% (0.1588 => 0.1808, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.79% (0.4379 => 0.4983, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 13.77% (0.1213 => 0.1380, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 13.67% (0.0768 => 0.0873, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.60% (1.1364 => 1.2910, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.51% (1.4563 => 1.6530, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 13.47% (0.2925 => 0.3319, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/distray/distray: 13.45% (0.0818 => 0.0928, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 13.36% (3.8646 => 4.3811, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.34% (1.2193 => 1.3820, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 12.94% (0.0804 => 0.0908, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.88% (0.1157 => 0.1306, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 12.75% (13.8202 => 15.5818, std.dev.: 0.0080) MultiSource/Applications/sgefa/sgefa: 12.65% (0.2995 => 0.3374, std.dev.: 0.0089) MultiSource/Benchmarks/McCat/18-imp/imp: 12.52% (0.3220 => 0.3623, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.48% (0.0825 => 0.0928, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.40% (0.6283 => 0.7062, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/hash2: 12.32% (0.4328 => 0.4861, std.dev.: 0.0163) MultiSource/Applications/treecc/treecc: 12.24% (1.9270 => 2.1628, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/hash: 12.24% (0.4062 => 0.4559, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 12.13% (7.2180 => 8.0936, std.dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.65% (0.4791 => 0.5349, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.63% (0.3130 => 0.3494, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.59% (0.2140 => 0.2388, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 11.58% (0.1589 => 0.1773, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 11.55% (1.3245 => 1.4775, std.dev.: 0.0077) MultiSource/Applications/lemon/lemon: 11.49% (1.0313 => 1.1498, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 11.48% (0.0976 => 0.1088, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 11.43% (0.7061 => 0.7868, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.37% (0.2321 => 0.2585, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.36% (0.3899 => 0.4342, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.34% (0.1569 => 0.1747, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 11.33% (0.6744 => 0.7508, std.dev.: 0.0029) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.29% (0.1435 => 0.1597, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 11.12% (0.5818 => 0.6465, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 11.12% (0.8310 => 0.9234, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 11.04% (0.4113 => 0.4567, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 10.82% (0.5748 => 0.6370, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 10.80% (4.3801 => 4.8532, std.dev.: 0.0036) MultiSource/Applications/d/make_dparser: 10.80% (3.1889 => 3.5333, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 10.76% (4.4433 => 4.9216, std.dev.: 0.0100) MultiSource/Applications/siod/siod: 10.72% (2.1791 => 2.4126, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.70% (0.3485 => 0.3858, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 10.69% (16.6129 => 18.3881, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 10.68% (3.6692 => 4.0611, std.dev.: 0.0046) SingleSource/Benchmarks/Stanford/Puzzle: 10.64% (0.0977 => 0.1081, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.59% (0.6135 => 0.6785, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.58% (0.4016 => 0.4441, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 10.57% (0.3293 => 0.3641, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.56% (0.3022 => 0.3341, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.50% (0.1819 => 0.2010, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.46% (0.3756 => 0.4149, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.46% (0.4390 => 0.4849, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.42% (0.3580 => 0.3953, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.32% (0.8698 => 0.9596, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 10.32% (0.2781 => 0.3068, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.26% (0.3489 => 0.3847, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.24% (0.2655 => 0.2927, std.dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 10.23% (0.3511 => 0.3870, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.12% (0.2243 => 0.2470, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 10.11% (0.3868 => 0.4259, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.10% (4.9865 => 5.4900, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/strcat: 10.05% (0.2726 => 0.3000, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.03% (0.2782 => 0.3061, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 9.90% (0.3453 => 0.3795, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.84% (0.2966 => 0.3258, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 9.81% (0.3149 => 0.3458, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 9.75% (0.3107 => 0.3410) SingleSource/Benchmarks/Shootout-C++/except: 9.75% (0.2760 => 0.3029, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 9.74% (0.2761 => 0.3030, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 9.71% (0.3534 => 0.3877, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 9.70% (1.0594 => 1.1622, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.66% (1.9828 => 2.1744, std.dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 9.60% (14.8535 => 16.2789, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/random: 9.59% (0.2690 => 0.2948, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 9.56% (1.2749 => 1.3968, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 9.55% (0.2607 => 0.2856, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 9.46% (0.3192 => 0.3494, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 9.40% (0.2628 => 0.2875, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 9.40% (0.2937 => 0.3213, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.33% (0.2765 => 0.3023, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 9.33% (0.3131 => 0.3423, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.32% (0.6576 => 0.7189, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 9.32% (1.1333 => 1.2389, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/matrix: 9.24% (0.2988 => 0.3264, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 9.15% (8.4961 => 9.2734, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 9.13% (3.7467 => 4.0889, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.12% (0.2696 => 0.2942, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 9.10% (0.1385 => 0.1511, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.96% (1.5188 => 1.6549, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.89% (0.3755 => 0.4089, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 8.76% (0.2945 => 0.3203, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 8.61% (6.5754 => 7.1418, std.dev.: 0.0195) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.61% (0.9108 => 0.9892, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.52% (6.2785 => 6.8134, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.36% (3.2742 => 3.5479, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.32% (0.8818 => 0.9552, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/oourafft: 8.32% (0.2008 => 0.2175, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 8.27% (0.6250 => 0.6767, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 8.25% (4.6629 => 5.0474, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.23% (0.3245 => 0.3512, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.14% (0.4805 => 0.5196, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.11% (2.1007 => 2.2711, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.07% (0.2504 => 0.2706, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 7.82% (0.1777 => 0.1916, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.70% (0.3650 => 0.3931, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/parameter-passing: 7.69% (0.4003 => 0.4311, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 7.53% (1.2292 => 1.3217, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.49% (13.2842 => 14.2798, std.dev.: 0.0180) SingleSource/UnitTests/ObjC/exceptions: 7.49% (0.3914 => 0.4207, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 7.39% (0.3940 => 0.4231, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 7.28% (0.3789 => 0.4065, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 7.28% (0.3601 => 0.3863, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 7.13% (0.3646 => 0.3906, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.13% (0.3578 => 0.3833, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 7.07% (0.3663 => 0.3922, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 6.96% (0.3623 => 0.3875, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.62% (14.5298 => 15.3466, std.dev.: 0.0175) MultiSource/Applications/sqlite3/sqlite3: 5.52% (16.2614 => 17.1587, std.dev.: 0.0233) MultiSource/Benchmarks/Olden/bh/bh: 5.42% (0.2859 => 0.3014, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: 3.24% (33.2944 => 34.3748, std.dev.: 0.0097) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.24% (0.1824 => 0.3543, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.97% (0.4846 => 0.6977, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.44% (5.7573 => 7.5100, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/fbench: 24.19% (1.8175 => 2.2572, std.dev.: 0.0584) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.15% (1.0895 => 1.2764, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 11.20% (1.1560 => 1.2855, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.03% (0.8273 => 0.9020, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.85% (0.1322 => 0.1439, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.54% (1.0640 => 1.1336) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.46% (0.9692 => 1.0221) SingleSource/Benchmarks/Misc/mandel-2: 5.35% (1.2998 => 1.3694, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.95% (0.3458 => 0.3629, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: 4.73% (1.9144 => 2.0050, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.71% (0.3139 => 0.3287, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 4.53% (0.5449 => 0.5696, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.50% (2.8606 => 2.9893, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.93% (1.7081 => 1.7753, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6785, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 3.47% (10.7476 => 11.1208, std.dev.: 0.0736) MultiSource/Applications/hexxagon/hexxagon: 3.45% (12.0921 => 12.5092, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: 3.38% (1.9199 => 1.9847, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: 3.08% (1.4298 => 1.4739, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/bisort/bisort: 2.91% (0.8239 => 0.8479, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.44% (1.0310 => 1.0562, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: 2.27% (1.9863 => 2.0313) SingleSource/Benchmarks/Misc/salsa20: 2.14% (7.4271 => 7.5858, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0502, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5137, std.dev.: 0.0124) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.40% (1.9433 => 1.9705, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.30% (3.1720 => 3.2133, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1886, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 1.20% (5.5130 => 5.5793, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2140, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.12% (3.1071 => 3.1420, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.05% (9.9194 => 10.0240, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.04% (8.8259 => 8.9179, std.dev.: 0.0205) SingleSource/Benchmarks/McGill/queens: 1.01% (2.1753 => 2.1972, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -45.73% (0.2670 => 0.1449, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.87% (0.4657 => 0.3918, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.29% (1.3813 => 1.2391, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.25% (1.3819 => 1.2403, std.dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -99.99% (8.6002 => 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.23% (1.0460 => 0.8553, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/mason/mason: -12.56% (0.2238 => 0.1957, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.13% (20.3410 => 18.2814, std.dev.: 0.0315) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2650, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.15% (1.9290 => 1.8104, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.48% (1.3780 => 1.3025, std.dev.: 0.0143) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3745, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -5.22% (1.2308 => 1.1665, std.dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -5.07% (2.6470 => 2.5129, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.67% (0.9996 => 0.9529, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/perlin: -4.46% (6.2497 => 5.9711, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -2.84% (3.2729 => 3.1798, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.71% (4.1080 => 3.9968, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/bh/bh: -2.69% (1.9762 => 1.9230, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -2.69% (5.0168 => 4.8818, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4784, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.38% (3.0263 => 2.9543, std.dev.: 0.0017) SingleSource/UnitTests/Vector/build2: -2.33% (1.3891 => 1.3567, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.18% (0.6615 => 0.6471, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.03% (0.6589 => 0.6455, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.91% (6.3560 => 6.2344, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3456, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.58% (2.5254 => 2.4855, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -1.54% (4.5928 => 4.5223, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -1.49% (7.1097 => 7.0041, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -1.42% (28.2225 => 27.8231, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/heapsort: -1.17% (3.9173 => 3.8716, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: -1.14% (5.3167 => 5.2562, std.dev.: 0.0042) MultiSource/Applications/viterbi/viterbi: -1.10% (4.4810 => 4.4316, std.dev.: 0.0044) MultiSource/Applications/lua/lua: -1.06% (26.5159 => 26.2351, std.dev.: 0.0259) MultiSource/Applications/aha/aha: -1.06% (3.1476 => 3.1143, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -1.04% (84.4286 => 83.5475, std.dev.: 0.0072) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 22 19:36:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 22 Oct 2012 21:36:18 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121023023618.95E032A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5110?compare_to=5106&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5110, Order: 166456, Start Time: 2012-10-23 01:14:38, End Time: 2012-10-23 02:38:21 To: 5106, Order: 166447, Start Time: 2012-10-22 23:33:24, End Time: 2012-10-23 00:57:53 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 6 (22 on baseline) Performance Improvements: 8 (5 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 961 (947 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.04% (1.4648 => 1.4801, std.dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.80% (15.0940 => 16.4217, std.dev.: 0.2441) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.12% (40.1378 => 41.3907, std.dev.: 0.1616) MultiSource/Benchmarks/Olden/em3d/em3d: 1.66% (5.3721 => 5.4612, std.dev.: 0.0149) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.13% (1.5830 => 1.6009, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.04% (1.3882 => 1.4026, std.dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.34% (1.2108 => 1.1825, std.dev.: 0.0018) MultiSource/Applications/siod/siod: -1.64% (2.2658 => 2.2287, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -1.50% (1.6661 => 1.6411, std.dev.: 0.0076) MultiSource/Applications/lemon/lemon: -1.06% (1.1099 => 1.0981, std.dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/minisat/minisat: -3.16% (6.4767 => 6.2723, std.dev.: 0.0191) MultiSource/Benchmarks/llubenchmark/llu: -1.73% (2.0312 => 1.9961, std.dev.: 0.0055) SingleSource/Benchmarks/McGill/chomp: -1.71% (1.1431 => 1.1236, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.13% (1.0531 => 1.0412, std.dev.: 0.0041) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.08% (16.4381 => 16.4256, std.dev.: 0.1141) MultiSource/Applications/obsequi/Obsequi: -1.21% (1.0545 => 1.0417, std.dev.: 0.0089) MultiSource/Applications/sqlite3/sqlite3: 0.09% (0.6384 => 0.6390, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/08-main/main: -0.27% (0.1886 => 0.1881, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.84% (0.1670 => 0.1656, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.81% (0.3217 => 0.3243, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.29% (0.2484 => 0.2452, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.30% (0.3320 => 0.3330, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.95% (0.2412 => 0.2365, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/bigfib: 1.50% (0.5950 => 0.6039, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/mandel: -0.23% (0.0444 => 0.0443, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.42% (0.3317 => 0.3303, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/strcat: -1.54% (0.2017 => 0.1986, std.dev.: 0.0023) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 10.66% (0.0244 => 0.0270, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0216 => 0.0216, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -17.62% (0.0420 => 0.0346, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.30% (0.0328 => 0.0329, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.98% (0.0307 => 0.0310, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.13% (0.0422 => 0.0413, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0201 => 0.0201, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -33.49% (0.0215 => 0.0143, std.dev.: 0.0035) SingleSource/UnitTests/byval-alignment: -7.21% (0.0333 => 0.0309, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -7.14% (0.0014 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.75% (0.1474 => 0.1485, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -6.59% (1.1788 => 1.1011, std.dev.: 0.0226) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -0.46% (0.1522 => 0.1515, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.12% (0.4124 => 0.4078, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.97% (0.1409 => 0.1353, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.97% (0.0661 => 0.0648, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.97% (0.0269 => 0.0277) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.54% (0.0551 => 0.0548, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.06% (1.1445 => 1.1438, std.dev.: 0.0497) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.68% (0.0031 => 0.0028, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0629 => 0.0629, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.49% (0.0267 => 0.0247, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.04% (0.8014 => 0.8017, std.dev.: 0.0092) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: -85.71% (0.0007 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 11.63% (0.0043 => 0.0048, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.29% (2.1832 => 1.6530, std.dev.: 0.0071) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.79% (0.2180 => 0.2328, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.04% (0.8321 => 0.8824, std.dev.: 0.0035) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.16% (0.3137 => 0.3299, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.02% (0.6010 => 0.6312, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.84% (0.4847 => 0.5033, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.71% (0.8148 => 0.8450, std.dev.: 0.0082) MultiSource/Applications/spiff/spiff: 2.58% (0.7950 => 0.8155, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.40% (1.1685 => 1.1965, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.22% (1.4479 => 1.4801, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.89% (1.1606 => 1.1825, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.36% (4.1763 => 4.2333, std.dev.: 0.0075) MultiSource/Applications/treecc/treecc: 1.24% (1.9948 => 2.0195, std.dev.: 0.0080) MultiSource/Applications/SIBsim4/SIBsim4: 1.16% (1.2568 => 1.2714, std.dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.52% (1.5795 => 2.5038, std.dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.13% (14.6451 => 16.4217, std.dev.: 0.2441) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.98% (0.3186 => 0.3504, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.36% (1.1857 => 1.2848, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 5.95% (63.1822 => 66.9446, std.dev.: 0.0882) MultiSource/Applications/siod/siod: 2.57% (3.6643 => 3.7585, std.dev.: 0.0114) MultiSource/Applications/minisat/minisat: 1.95% (6.1525 => 6.2723, std.dev.: 0.0191) MultiSource/Benchmarks/Olden/bh/bh: 1.68% (2.3560 => 2.3956, std.dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.04% (1.3882 => 1.4026, std.dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.65% (0.3269 => 0.3019, std.dev.: 0.0020) MultiSource/Applications/lua/lua: -4.59% (29.8330 => 28.4627, std.dev.: 0.3006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.89% (7.2130 => 6.9324, std.dev.: 0.0551) SingleSource/Benchmarks/Shootout-C++/hash2: -1.42% (3.4237 => 3.3752, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.27% (3.3479 => 3.3054, std.dev.: 0.0017) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.12% (16.4461 => 16.4256, std.dev.: 0.1141) MultiSource/Applications/obsequi/Obsequi: 1.51% (1.0262 => 1.0417, std.dev.: 0.0089) MultiSource/Applications/sqlite3/sqlite3: 0.92% (0.6332 => 0.6390, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/08-main/main: 2.73% (0.1831 => 0.1881, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 6.22% (0.1559 => 0.1656, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.84% (0.3123 => 0.3243, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.45% (0.2463 => 0.2452, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.42% (0.3344 => 0.3330, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.04% (0.2364 => 0.2365, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/bigfib: 0.48% (0.6010 => 0.6039, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/mandel: 3.26% (0.0429 => 0.0443, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.13% (0.3266 => 0.3303, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/strcat: 0.86% (0.1969 => 0.1986, std.dev.: 0.0023) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 20.54% (0.0224 => 0.0270, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 75.61% (0.0123 => 0.0216, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -15.20% (0.0408 => 0.0346, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.53% (0.0254 => 0.0329, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.65% (0.0302 => 0.0310, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 7.55% (0.0384 => 0.0413, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: 5.79% (0.0190 => 0.0201, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -20.56% (0.0180 => 0.0143, std.dev.: 0.0035) SingleSource/UnitTests/byval-alignment: 34.35% (0.0230 => 0.0309, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 3.27% (0.1438 => 0.1485, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -2.81% (1.1329 => 1.1011, std.dev.: 0.0226) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.63% (0.1462 => 0.1515, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.07% (0.4164 => 0.4078, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.17% (0.1369 => 0.1353, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.09% (0.0641 => 0.0648, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.19% (0.0578 => 0.0548, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.01% (1.1437 => 1.1438, std.dev.: 0.0497) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2700.00% (0.0001 => 0.0028, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.32% (0.0627 => 0.0629, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 37.22% (0.0180 => 0.0247, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: - (0.8017 => 0.8017, std.dev.: 0.0092) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -22.58% (0.0062 => 0.0048, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 22 20:32:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 22 Oct 2012 22:32:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121023033209.F27202A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5111?compare_to=5107&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5111, Order: 166459, Start Time: 2012-10-23 02:14:22, End Time: 2012-10-23 03:34:11 To: 5107, Order: 166448, Start Time: 2012-10-23 00:23:37, End Time: 2012-10-23 01:43:32 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (5 on baseline) Performance Regressions: 3 (196 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 88 (14 on baseline) Unchanged Tests: 951 (646 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.75% (15.2388 => 15.8104, std.dev.: 0.0143) MultiSource/Applications/JM/ldecod/ldecod: 1.06% (11.9698 => 12.0971, std.dev.: 0.0109) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.16% (1.0808 => 1.0933, std.dev.: 0.0008) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.18% (0.6252 => 0.6263, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 0.06% (17.2096 => 17.2205, std.dev.: 0.0190) MultiSource/Applications/kimwitu++/kc: 0.36% (15.5731 => 15.6288, std.dev.: 0.0263) MultiSource/Benchmarks/Bullet/bullet: -0.43% (56.2048 => 55.9628, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.21% (0.0486 => 0.0487) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0488 => 0.0488, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0457 => 0.0457) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.22% (0.0458 => 0.0457, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.22% (0.0445 => 0.0446) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0446 => 0.0446, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0439 => 0.0439, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0440 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.22% (0.0457 => 0.0456, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0458 => 0.0458) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0451 => 0.0451, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0452 => 0.0452, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0442 => 0.0442, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.23% (0.0442 => 0.0443, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0448 => 0.0448, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0449 => 0.0449, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0459 => 0.0459, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.16% (0.0481 => 0.0461, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0436 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0437 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.22% (0.0448 => 0.0449) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.22% (0.0449 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.23% (0.0439 => 0.0440, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.23% (0.0440 => 0.0441, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0432 => 0.0432, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0433 => 0.0433) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.23% (0.0431 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0432 => 0.0432, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0467 => 0.0467) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0468 => 0.0468, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.23% (0.0429 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0431 => 0.0431) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0432 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.23% (0.0432 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0438 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0440 => 0.0440, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.28% (1.4906 => 1.4948, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.02% (8.2145 => 8.2128, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.25% (0.6871 => 0.6888, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1436 => 0.1436) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.16% (0.0645 => 0.0646, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.51% (63.2438 => 55.9628, std.dev.: 0.0085) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/MallocBench/gs/gs: 13.13% (4.1105 => 4.6503, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.20% (3.4629 => 5.7901, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13479.72% (0.0720 => 9.7774, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050200.00% (0.0001 => 10.0503, std.dev.: 0.0015) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 64.29% (0.2554 => 0.4196, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/lowercase: 57.81% (0.0256 => 0.0404, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 52.50% (10.3673 => 15.8104, std.dev.: 0.0143) SingleSource/UnitTests/SignlessTypes/factor: 46.96% (0.0296 => 0.0435, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 43.54% (0.0271 => 0.0389) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 40.87% (1.5859 => 2.2341, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: 40.07% (0.1622 => 0.2272, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/distray/distray: 36.55% (0.1056 => 0.1442, std.dev.: 0.0000) SingleSource/UnitTests/vla: 33.52% (0.0355 => 0.0474) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.19% (2.2024 => 2.8673, std.dev.: 0.0140) MultiSource/Benchmarks/FreeBench/neural/neural: 26.59% (0.1463 => 0.1852, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 25.78% (0.0834 => 0.1049, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.07% (0.1566 => 0.1896, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 20.50% (0.2049 => 0.2469, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 19.34% (0.1432 => 0.1709, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.20% (7.0540 => 8.4082, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.71% (0.0871 => 0.1034) MultiSource/Applications/viterbi/viterbi: 18.65% (0.1555 => 0.1845, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.02% (2.2022 => 2.5991, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 18.02% (0.5105 => 0.6025, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.35% (0.6675 => 0.7833, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout/lists: 16.93% (0.0626 => 0.0732, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 16.93% (0.1695 => 0.1982, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 16.86% (0.1655 => 0.1934, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.77% (0.0793 => 0.0926, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.68% (1.3050 => 1.5227, std.dev.: 0.0056) MultiSource/Applications/d/make_dparser: 16.53% (3.3354 => 3.8869, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.53% (0.8172 => 0.9523, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.51% (0.2271 => 0.2646, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 16.34% (0.1175 => 0.1367, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 16.34% (0.1163 => 0.1353, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 16.32% (0.1440 => 0.1675, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.25% (0.4615 => 0.5365, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 16.08% (0.1337 => 0.1552, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.99% (0.1032 => 0.1197, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 15.92% (10.4361 => 12.0971, std.dev.: 0.0109) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.69% (0.0886 => 0.1025, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.64% (1.5415 => 1.7826, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.56% (0.0842 => 0.0973, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.56% (0.5020 => 0.5801, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.41% (0.1940 => 0.2239, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.23% (0.1510 => 0.1740, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.11% (0.0675 => 0.0777, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 15.03% (0.0672 => 0.0773, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.00% (0.3121 => 0.3589, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 14.99% (0.3282 => 0.3774, std.dev.: 0.0031) MultiSource/Applications/minisat/minisat: 14.97% (0.7115 => 0.8180, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.91% (0.9765 => 1.1221, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 14.89% (0.3109 => 0.3572, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 14.69% (0.3423 => 0.3926, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: 14.67% (0.0818 => 0.0938, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 14.59% (1.1642 => 1.3341, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.59% (0.1117 => 0.1280, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.56% (4.2646 => 4.8856, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.55% (0.0770 => 0.0882, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.48% (0.0746 => 0.0854, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.38% (0.2107 => 0.2410, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.33% (0.2065 => 0.2361, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 14.32% (0.1906 => 0.2179, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/exptree: 14.25% (0.0814 => 0.0930, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.25% (0.2758 => 0.3151, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.20% (0.1584 => 0.1809, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.20% (0.0838 => 0.0957, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 14.16% (0.1151 => 0.1314, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.11% (0.6450 => 0.7360, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.08% (0.1236 => 0.1410, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.98% (0.5860 => 0.6679, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.90% (0.1029 => 0.1172, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.88% (0.5981 => 0.6811, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 13.84% (0.0730 => 0.0831, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.83% (0.0933 => 0.1062, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 13.82% (0.7835 => 0.8918, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 13.77% (5.7591 => 6.5520, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.75% (8.1363 => 9.2554, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.75% (1.4186 => 1.6136, std.dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 13.71% (9.4845 => 10.7847, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.66% (0.0798 => 0.0907, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.65% (0.1062 => 0.1207, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.64% (0.0770 => 0.0875, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 13.43% (2.0273 => 2.2995, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.42% (1.7609 => 1.9972, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.39% (0.1695 => 0.1922, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.28% (0.1438 => 0.1629, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 13.20% (1.1840 => 1.3403, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.19% (0.2700 => 0.3056, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 13.16% (0.7433 => 0.8411, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.13% (0.0929 => 0.1051, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 13.09% (0.1268 => 0.1434, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.05% (0.8067 => 0.9120, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.98% (4.9449 => 5.5869, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.95% (5.0018 => 5.6493, std.dev.: 0.0085) SingleSource/UnitTests/SignlessTypes/rem: 12.94% (0.1144 => 0.1292, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.92% (0.1625 => 0.1835, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 12.77% (0.4299 => 0.4848, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.73% (0.5569 => 0.6278, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 12.71% (3.8723 => 4.3646, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 12.67% (1.0722 => 1.2081, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.61% (0.4879 => 0.5494, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.56% (0.1330 => 0.1497, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 12.43% (0.3387 => 0.3808, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.25% (0.3307 => 0.3712, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.21% (1.1861 => 1.3309, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.14% (0.2603 => 0.2919, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 12.11% (0.3180 => 0.3565, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.00% (0.3441 => 0.3854, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.93% (0.3177 => 0.3556, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.87% (7.9617 => 8.9070, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/football/football: 11.87% (0.8921 => 0.9980, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.64% (0.1125 => 0.1256, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.57% (0.8101 => 0.9038, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: 11.43% (1.5603 => 1.7386, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.42% (0.1892 => 0.2108, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 11.38% (0.3092 => 0.3444, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 11.04% (0.6456 => 0.7169, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.94% (0.1143 => 0.1268, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.71% (0.3473 => 0.3845, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.67% (0.3543 => 0.3921, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.66% (0.3828 => 0.4236, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.59% (0.3927 => 0.4343, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 10.59% (0.3561 => 0.3938, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.58% (0.3497 => 0.3867, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.56% (0.3694 => 0.4084, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.56% (0.3543 => 0.3917, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.55% (0.3516 => 0.3887, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 10.44% (2.2969 => 2.5366, std.dev.: 0.0185) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.37% (0.2266 => 0.2501, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.29% (0.3886 => 0.4286, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 10.16% (21.9371 => 24.1661, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 9.87% (0.1044 => 0.1147, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 9.86% (0.4289 => 0.4712, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 9.76% (0.4620 => 0.5071, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.49% (0.3826 => 0.4189, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 9.47% (0.3422 => 0.3746, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.37% (0.3865 => 0.4227, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.30% (0.4203 => 0.4594, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.04% (0.4103 => 0.4474, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.82% (0.4636 => 0.5045, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 8.82% (0.4048 => 0.4405, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.74% (0.6030 => 0.6557, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.73% (0.5925 => 0.6442, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 8.69% (0.3684 => 0.4004, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.67% (0.3427 => 0.3724, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.60% (0.2430 => 0.2639, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 8.42% (17.1811 => 18.6283, std.dev.: 0.0264) SingleSource/Benchmarks/Shootout-C++/sieve: 8.13% (0.3603 => 0.3896, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.07% (0.7326 => 0.7917, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.88% (14.3668 => 15.4988, std.dev.: 0.0194) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.82% (3.8922 => 4.1966, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.64% (0.3650 => 0.3929, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.43% (0.4064 => 0.4366, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 7.42% (0.3098 => 0.3328, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.16% (0.2891 => 0.3098, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 7.10% (0.2831 => 0.3032, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.09% (0.2905 => 0.3111, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.05% (0.3136 => 0.3357, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.3283 => 0.3514, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.99% (0.3232 => 0.3458, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.99% (0.3162 => 0.3383, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.94% (2.0665 => 2.2100, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.86% (0.2872 => 0.3069, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.84% (0.2793 => 0.2984, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.83% (0.2871 => 0.3067, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 6.78% (0.3379 => 0.3608, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.71% (0.2756 => 0.2941, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.68% (0.2725 => 0.2907, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.62% (0.3052 => 0.3254, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/methcall: 6.57% (0.2877 => 0.3066, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.53% (0.2802 => 0.2985, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 6.48% (0.2714 => 0.2890, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 6.19% (1.2842 => 1.3637, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.62% (0.3131 => 0.3307, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.85% (0.3935 => 0.4047, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.71% (1.1194 => 1.1497, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8961, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1726, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.16% (0.9957 => 1.1267, std.dev.: 0.0101) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.85% (1.1396 => 1.2518, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3691, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/bh/bh: 5.90% (1.9405 => 2.0549, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.90% (4.2280 => 4.3507, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.61% (0.3987 => 0.4091, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0313 => 1.0566, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 1.74% (0.8333 => 0.8478, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.67% (3.6395 => 3.7003, std.dev.: 0.0100) MultiSource/Applications/aha/aha: 1.54% (3.1595 => 3.2080, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.41% (2.6546 => 2.6921, std.dev.: 0.0026) MultiSource/Applications/viterbi/viterbi: 1.24% (4.4649 => 4.5204, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.05% (6.5088 => 6.5774, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.00% (6.6874 => 0.1336, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -79.83% (0.8651 => 0.1745) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.18% (5.2763 => 3.2089, std.dev.: 0.0111) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.78% (5.3855 => 3.7280, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.38% (5.3526 => 3.7264, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -14.68% (54.1659 => 46.2153, std.dev.: 0.0280) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.58% (2.9384 => 2.6274, std.dev.: 0.0041) MultiSource/Applications/ClamAV/clamscan: -5.62% (22.1758 => 20.9295, std.dev.: 0.0117) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.10% (8.0499 => 3.7758, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.39% (1.1492 => 0.7655, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4752, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.96% (1.6925 => 1.4223, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.70% (1.2258 => 1.0701, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.64% (1.2373 => 1.0933, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -10.86% (1.5373 => 1.3704, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.24% (19.9488 => 18.3059, std.dev.: 0.0874) MultiSource/Benchmarks/FreeBench/mason/mason: -7.73% (0.2161 => 0.1994, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.08% (1.8329 => 1.7031, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.22% (1.6805 => 1.5928, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.62% (1.5835 => 1.5104, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.35% (8.1563 => 7.8017, std.dev.: 0.0075) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1624, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8775, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.15% (32.5116 => 31.4864, std.dev.: 0.0085) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.62% (0.4808 => 0.4682, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -2.31% (4.6441 => 4.5370, std.dev.: 0.0017) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -1.82% (10.2830 => 10.0955, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6819, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.68% (2.5528 => 2.5100, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2878, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 19.77% (0.5229 => 0.6263, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 14.88% (14.9895 => 17.2205, std.dev.: 0.0190) MultiSource/Applications/kimwitu++/kc: 10.41% (14.1553 => 15.6288, std.dev.: 0.0263) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 35.30% (1.1048 => 1.4948, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.73% (7.1582 => 8.2128, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.70% (0.6222 => 0.6888, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.30% (0.1485 => 0.1436) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.47% (0.2116 => 0.0646, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 22 21:13:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 22 Oct 2012 23:13:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121023041321.CEE9E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5112?compare_to=5109&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5112, Order: 166461, Start Time: 2012-10-23 02:48:17, End Time: 2012-10-23 04:16:24 To: 5109, Order: 166452, Start Time: 2012-10-23 00:50:15, End Time: 2012-10-23 02:18:14 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (212 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1042 (653 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/vla: 31.48% (0.0324 => 0.0426, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 25.00% (2.0176 => 2.5220, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.90% (0.1410 => 0.1747, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 21.98% (0.0746 => 0.0910, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 21.41% (0.7710 => 0.9361, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/tsp/tsp: 21.22% (0.1013 => 0.1228, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 19.97% (0.2243 => 0.2691, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 19.49% (0.0826 => 0.0987, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 19.30% (0.0653 => 0.0779, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 19.26% (0.0618 => 0.0737, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.91% (0.2596 => 0.3061, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.86% (0.5637 => 0.6644, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.79% (0.0725 => 0.0854, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 17.79% (0.0770 => 0.0907, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.78% (0.0720 => 0.0848, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.76% (0.0811 => 0.0955, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 17.75% (0.2721 => 0.3204, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.52% (0.1986 => 0.2334, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.47% (0.0847 => 0.0995, std.dev.: 0.0009) SingleSource/UnitTests/2006-12-11-LoadConstants: 17.44% (0.1072 => 0.1259, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 17.35% (0.1003 => 0.1177, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 17.04% (0.7460 => 0.8731, std.dev.: 0.0094) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.99% (0.2914 => 0.3409, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/mst/mst: 16.83% (0.1111 => 0.1298, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.82% (0.0648 => 0.0757, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.56% (0.1075 => 0.1253, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/messages-2: 16.45% (0.0614 => 0.0715, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 16.24% (0.9199 => 1.0693, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.24% (0.0819 => 0.0952, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.19% (0.0834 => 0.0969, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.11% (0.5265 => 0.6113, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 16.08% (0.0622 => 0.0722, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 16.07% (0.1413 => 0.1640, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_isamax: 16.06% (0.0654 => 0.0759, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 15.96% (1.3693 => 1.5879, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.84% (0.6959 => 0.8061, std.dev.: 0.0170) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.75% (0.1276 => 0.1477, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 15.73% (0.1062 => 0.1229, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.56% (0.0977 => 0.1129, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.52% (0.2023 => 0.2337, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.37% (0.1327 => 0.1531, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.19% (0.1014 => 0.1168, std.dev.: 0.0014) MultiSource/Applications/viterbi/viterbi: 15.09% (0.1478 => 0.1701, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 14.89% (1.1061 => 1.2708, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.85% (0.1865 => 0.2142, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.83% (3.9660 => 4.5541, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.73% (0.0964 => 0.1106, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 14.66% (0.7038 => 0.8070, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/em3d/em3d: 14.54% (0.1657 => 0.1898, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.52% (0.5577 => 0.6387, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 14.19% (0.2925 => 0.3340, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 14.08% (0.3246 => 0.3703, std.dev.: 0.0034) SingleSource/Benchmarks/McGill/exptree: 13.93% (0.0768 => 0.0875, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.93% (0.1048 => 0.1194, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 13.92% (0.7506 => 0.8551, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.85% (0.1588 => 0.1808, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.82% (0.2127 => 0.2421, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.81% (0.1789 => 0.2036, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.80% (1.1364 => 1.2932, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.79% (0.4379 => 0.4983, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.69% (1.4563 => 1.6556, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: 13.69% (0.1213 => 0.1379, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 13.57% (3.8646 => 4.3891, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/distray/distray: 13.57% (0.0818 => 0.0929, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.39% (1.2193 => 1.3826, std.dev.: 0.0019) MultiSource/Applications/sgefa/sgefa: 13.06% (0.2995 => 0.3386, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash2: 13.03% (0.4328 => 0.4892, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 13.00% (0.4062 => 0.4590, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.96% (0.1157 => 0.1307, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 12.94% (0.0804 => 0.0908, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 12.91% (13.8202 => 15.6043, std.dev.: 0.0214) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.65% (0.6283 => 0.7078, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 12.52% (0.7061 => 0.7945, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.48% (0.0825 => 0.0928, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 12.45% (0.3220 => 0.3621, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 12.28% (7.2180 => 8.1043, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 12.14% (0.3130 => 0.3510, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 12.11% (1.9270 => 2.1603, std.dev.: 0.0053) SingleSource/UnitTests/ObjC++/property-reference-object: 12.05% (0.5818 => 0.6519, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.87% (0.3899 => 0.4362, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.86% (0.4791 => 0.5359, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 11.76% (1.0313 => 1.1526, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 11.76% (0.5748 => 0.6424, std.dev.: 0.0128) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.64% (0.2140 => 0.2389, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 11.62% (1.3245 => 1.4784, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.60% (0.1569 => 0.1751, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 11.58% (0.0976 => 0.1089, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 11.52% (0.1589 => 0.1772, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 11.49% (0.8310 => 0.9265, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 11.45% (0.6744 => 0.7516, std.dev.: 0.0223) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.43% (0.1435 => 0.1599, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.42% (0.3485 => 0.3883, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 11.29% (0.2781 => 0.3095, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.28% (0.4016 => 0.4469, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 11.27% (0.3293 => 0.3664, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.25% (0.2321 => 0.2582, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 11.12% (16.6129 => 18.4601, std.dev.: 0.0183) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.10% (4.3801 => 4.8662, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.08% (0.3756 => 0.4172, std.dev.: 0.0036) MultiSource/Applications/siod/siod: 11.07% (2.1791 => 2.4204, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.07% (0.4390 => 0.4876, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.05% (0.3022 => 0.3356, std.dev.: 0.0106) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.03% (4.4433 => 4.9336, std.dev.: 0.0042) MultiSource/Applications/d/make_dparser: 11.03% (3.1889 => 3.5407, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.00% (0.1819 => 0.2019, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 10.97% (0.4113 => 0.4564, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.92% (0.3489 => 0.3870, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 10.87% (3.6692 => 4.0679, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.86% (0.2782 => 0.3084, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 10.85% (0.0977 => 0.1083, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.81% (0.3580 => 0.3967, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 10.81% (0.3868 => 0.4286, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 10.80% (0.3453 => 0.3826, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.79% (0.2966 => 0.3286, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 10.79% (0.2726 => 0.3020, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.75% (0.8698 => 0.9633, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/except: 10.58% (0.2760 => 0.3052, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.55% (0.6135 => 0.6782, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary3: 10.54% (0.3149 => 0.3481, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 10.53% (0.3534 => 0.3906, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.52% (1.9828 => 2.1914, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 10.50% (0.2761 => 0.3051, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.43% (0.2243 => 0.2477, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 10.43% (0.3107 => 0.3431, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 10.40% (0.2607 => 0.2878, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 10.37% (0.2690 => 0.2969, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.36% (0.2655 => 0.2930, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.31% (0.2765 => 0.3050, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 10.28% (0.3192 => 0.3520, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.25% (0.6576 => 0.7250, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/fibo: 10.24% (0.2628 => 0.2897, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 10.21% (0.2937 => 0.3237, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.17% (4.9865 => 5.4937, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/matrix: 10.04% (0.2988 => 0.3288, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.98% (0.2696 => 0.2965, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.85% (0.3755 => 0.4125, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 9.83% (1.0594 => 1.1635, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.71% (0.3511 => 0.3852, std.dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 9.63% (14.8535 => 16.2841, std.dev.: 0.0154) MultiSource/Applications/SIBsim4/SIBsim4: 9.55% (1.2749 => 1.3967, std.dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/objinst: 9.47% (0.2945 => 0.3224, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 9.45% (0.3131 => 0.3427, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 9.39% (1.1333 => 1.2397, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 9.34% (3.7467 => 4.0965, std.dev.: 0.0805) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.23% (1.5188 => 1.6590, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 9.17% (8.4961 => 9.2749, std.dev.: 0.0223) MultiSource/Benchmarks/FreeBench/neural/neural: 9.10% (0.1385 => 0.1511, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.93% (0.9108 => 0.9921, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.82% (0.8818 => 0.9596, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 8.68% (6.5754 => 7.1463, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/bigfib: 8.67% (0.6250 => 0.6792, std.dev.: 0.0052) MultiSource/Applications/oggenc/oggenc: 8.67% (4.6629 => 5.0670, std.dev.: 0.0251) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.63% (0.2504 => 0.2720, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 8.57% (0.2008 => 0.2180, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.54% (3.2742 => 3.5539, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.54% (0.3245 => 0.3522, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.43% (0.4805 => 0.5210, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.39% (6.2785 => 6.8051, std.dev.: 0.0295) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.07% (2.1007 => 2.2702, std.dev.: 0.0082) MultiSource/Applications/hexxagon/hexxagon: 7.93% (1.2292 => 1.3267, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: 7.88% (0.1777 => 0.1917, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.63% (13.2842 => 14.2980, std.dev.: 0.0128) SingleSource/UnitTests/ObjC/parameter-passing: 7.54% (0.4003 => 0.4305, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.45% (0.3650 => 0.3922, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 7.38% (0.3914 => 0.4203, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.34% (0.3940 => 0.4229, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 7.08% (0.3646 => 0.3904, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/for-in: 7.07% (0.3789 => 0.4057, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 7.07% (0.3578 => 0.3831, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 6.94% (0.3601 => 0.3851, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.93% (0.3663 => 0.3917, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 6.93% (0.3623 => 0.3874, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 5.89% (14.5298 => 15.3855, std.dev.: 0.0209) MultiSource/Applications/sqlite3/sqlite3: 5.75% (16.2614 => 17.1958, std.dev.: 0.0277) MultiSource/Benchmarks/Olden/bh/bh: 5.53% (0.2859 => 0.3017, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 3.00% (33.2944 => 34.2942, std.dev.: 0.0094) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.19% (0.1824 => 0.3542, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 44.00% (0.4846 => 0.6978) SingleSource/Benchmarks/Shootout-C++/methcall: 30.47% (5.7573 => 7.5115, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/fbench: 24.21% (1.8175 => 2.2575, std.dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.10% (1.0895 => 1.2758, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 11.05% (1.1560 => 1.2837, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.80% (2.8813 => 3.1925, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 9.02% (0.8273 => 0.9019, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.77% (0.1322 => 0.1438, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.54% (1.0640 => 1.1336, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.46% (0.9692 => 1.0221) SingleSource/Benchmarks/Misc/mandel-2: 5.39% (1.2998 => 1.3699, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.89% (0.3458 => 0.3627, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.71% (0.3139 => 0.3287, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.71% (1.9144 => 2.0045, std.dev.: 0.0011) SingleSource/Regression/C/uint64_to_float: 4.53% (0.5449 => 0.5696, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.50% (2.8606 => 2.9893, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.95% (1.7081 => 1.7755, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.69% (11.2619 => 11.6776, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 3.68% (10.7476 => 11.1431, std.dev.: 0.0116) SingleSource/Benchmarks/Misc/flops-6: 3.48% (1.9199 => 1.9867, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 3.45% (12.0921 => 12.5093, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 3.11% (1.4298 => 1.4743, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bisort/bisort: 3.08% (0.8239 => 0.8493, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0310 => 1.0561, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.27% (1.9863 => 2.0313) SingleSource/Benchmarks/Misc/salsa20: 2.11% (7.4271 => 7.5839, std.dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.56% (2.0200 => 2.0515, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5137, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.30% (3.1720 => 3.2132, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 1.23% (9.0760 => 9.1876, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5783, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2140, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 1.12% (3.1071 => 3.1420, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.04% (9.9194 => 10.0226, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/queens: 1.02% (2.1753 => 2.1974, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -45.54% (0.2670 => 0.1454, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -15.87% (0.4657 => 0.3918, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.08% (1.3819 => 1.2426, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -9.92% (1.3813 => 1.2443, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -99.99% (8.6002 => 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.24% (1.0460 => 0.8552, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -12.51% (0.2238 => 0.1958, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.05% (20.3410 => 18.2976, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2646, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8099, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -5.57% (1.2308 => 1.1623, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.52% (1.3780 => 1.3020, std.dev.: 0.0113) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3745, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.04% (2.6470 => 2.5135, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.56% (0.9996 => 0.9540, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/perlin: -4.46% (6.2497 => 5.9711, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.81% (1.7688 => 1.7014, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.98% (0.4867 => 0.4722, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -2.88% (3.2729 => 3.1786, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -2.74% (1.9762 => 1.9220, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.72% (4.1080 => 3.9961, std.dev.: 0.0045) MultiSource/Benchmarks/sim/sim: -2.69% (5.0168 => 4.8816, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4785, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -2.38% (3.0263 => 2.9544, std.dev.: 0.0033) SingleSource/UnitTests/Vector/build2: -2.33% (1.3891 => 1.3567) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.18% (0.6615 => 0.6471, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.81% (0.6589 => 0.6470, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.67% (6.3560 => 6.2496, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: -1.64% (3.4016 => 3.3457, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.60% (2.5254 => 2.4851, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -1.58% (4.5928 => 4.5203, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: -1.50% (7.1097 => 7.0027, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: -1.42% (28.2225 => 27.8225, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/heapsort: -1.28% (3.9173 => 3.8673, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: -1.07% (5.3167 => 5.2600, std.dev.: 0.0028) MultiSource/Applications/viterbi/viterbi: -1.06% (4.4810 => 4.4334, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: -1.06% (84.4286 => 83.5371, std.dev.: 0.0111) MultiSource/Applications/aha/aha: -1.05% (3.1476 => 3.1145, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -1.00% (26.5159 => 26.2501, std.dev.: 0.0413) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 22 21:16:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 22 Oct 2012 23:16:25 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121023041625.F15BB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5113?compare_to=5110&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5113, Order: 166461, Start Time: 2012-10-23 02:55:11, End Time: 2012-10-23 04:18:31 To: 5110, Order: 166456, Start Time: 2012-10-23 01:14:38, End Time: 2012-10-23 02:38:21 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 6 (15 on baseline) Performance Improvements: 2 (3 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 967 (956 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 16.11% (0.7690 => 0.8929, std.dev.: 0.0079) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.32% (24.8031 => 28.6026, std.dev.: 0.0291) MultiSource/Benchmarks/Olden/mst/mst: 9.63% (0.1392 => 0.1526, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.92% (0.7538 => 0.7984, std.dev.: 0.0170) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.98% (21.8298 => 22.2627, std.dev.: 0.1244) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.90% (2.6043 => 2.6538, std.dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.40% (1.4277 => 1.4077, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/ffbench: -1.36% (1.4403 => 1.4207, std.dev.: 0.0039) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.39% (16.4256 => 16.4899, std.dev.: 0.3176) MultiSource/Applications/obsequi/Obsequi: -0.60% (1.0417 => 1.0354, std.dev.: 0.0226) MultiSource/Applications/sqlite3/sqlite3: -0.23% (0.6390 => 0.6375, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/08-main/main: -4.04% (0.1881 => 0.1805, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.45% (0.1656 => 0.1680, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.31% (0.3243 => 0.3253, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.57% (0.2452 => 0.2466, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.39% (0.3330 => 0.3343, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.54% (0.2365 => 0.2425, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/bigfib: -1.18% (0.6039 => 0.5968, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/mandel: 1.58% (0.0443 => 0.0450, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.82% (0.3303 => 0.3330, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 0.05% (0.1986 => 0.1987, std.dev.: 0.0027) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -11.11% (0.0270 => 0.0240, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.93% (0.0216 => 0.0214, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.60% (0.0346 => 0.0355, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.74% (0.0329 => 0.0320, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0310 => 0.0310, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.45% (0.0413 => 0.0419) SingleSource/UnitTests/Vector/Altivec/casts: -0.50% (0.0201 => 0.0200, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 10.49% (0.0143 => 0.0158, std.dev.: 0.0023) SingleSource/UnitTests/byval-alignment: 12.30% (0.0309 => 0.0347, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.81% (0.1485 => 0.1473, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 3.32% (1.1011 => 1.1377, std.dev.: 0.0106) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -2.51% (0.1515 => 0.1477, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.17% (0.4078 => 0.4071, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.37% (0.1353 => 0.1385, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.86% (0.0648 => 0.0610, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -13.36% (0.0277 => 0.0240, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.46% (0.0548 => 0.0556, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.72% (1.1438 => 1.1356, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.43% (0.0028 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.59% (0.0027 => 0.0002, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.56% (0.0629 => 0.0594, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.69% (0.0247 => 0.0228, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.01% (0.8017 => 0.8018, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 156.25% (0.0048 => 0.0123, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.18% (2.1832 => 1.6554, std.dev.: 0.0052) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.32% (0.0810 => 0.0926, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.56% (0.7473 => 0.7664, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.58% (1.1685 => 1.1870, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.22% (0.8611 => 0.8716, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.63% (1.5795 => 2.5056, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/mst/mst: 10.10% (0.1386 => 0.1526, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.86% (0.3186 => 0.3500, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.42% (1.1857 => 1.2855, std.dev.: 0.0224) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.31% (14.6451 => 15.8618, std.dev.: 0.4198) MultiSource/Benchmarks/mafft/pairlocalalign: 5.95% (63.1822 => 66.9443, std.dev.: 0.0711) SingleSource/Benchmarks/Misc/ReedSolomon: 3.48% (8.5322 => 8.8293, std.dev.: 0.0162) MultiSource/Applications/siod/siod: 2.83% (3.6643 => 3.7681, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: 2.80% (0.6205 => 0.6379, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: 1.85% (2.3560 => 2.3997, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.12% (1.5941 => 1.6120, std.dev.: 0.0069) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.42% (0.3269 => 0.2961, std.dev.: 0.0016) MultiSource/Applications/lua/lua: -5.02% (29.8330 => 28.3353, std.dev.: 0.4864) SingleSource/Benchmarks/Shootout-C++/hash2: -1.46% (3.4237 => 3.3736, std.dev.: 0.0058) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.27% (16.4461 => 16.4899, std.dev.: 0.3176) MultiSource/Applications/obsequi/Obsequi: 0.90% (1.0262 => 1.0354, std.dev.: 0.0226) MultiSource/Applications/sqlite3/sqlite3: 0.68% (0.6332 => 0.6375, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/08-main/main: -1.42% (0.1831 => 0.1805, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.76% (0.1559 => 0.1680, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.16% (0.3123 => 0.3253, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.12% (0.2463 => 0.2466, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.03% (0.3344 => 0.3343, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.58% (0.2364 => 0.2425, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/bigfib: -0.70% (0.6010 => 0.5968, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/mandel: 4.90% (0.0429 => 0.0450, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.96% (0.3266 => 0.3330, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 0.91% (0.1969 => 0.1987, std.dev.: 0.0027) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.14% (0.0224 => 0.0240, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 73.98% (0.0123 => 0.0214, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -12.99% (0.0408 => 0.0355, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 25.98% (0.0254 => 0.0320, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.65% (0.0302 => 0.0310, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.11% (0.0384 => 0.0419) SingleSource/UnitTests/Vector/Altivec/casts: 5.26% (0.0190 => 0.0200, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -12.22% (0.0180 => 0.0158, std.dev.: 0.0023) SingleSource/UnitTests/byval-alignment: 50.87% (0.0230 => 0.0347, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.43% (0.1438 => 0.1473, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.42% (1.1329 => 1.1377, std.dev.: 0.0106) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 1.03% (0.1462 => 0.1477, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.23% (0.4164 => 0.4071, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.17% (0.1369 => 0.1385, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.84% (0.0641 => 0.0610, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 23.08% (0.0195 => 0.0240, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.81% (0.0578 => 0.0556, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.71% (1.1437 => 1.1356, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -85.71% (0.0014 => 0.0002, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.26% (0.0627 => 0.0594, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 26.67% (0.0180 => 0.0228, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.01% (0.8017 => 0.8018, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 98.39% (0.0062 => 0.0123, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 22 22:21:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 23 Oct 2012 00:21:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121023052136.053372A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5114?compare_to=5111&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5114, Order: 166463, Start Time: 2012-10-23 04:03:41, End Time: 2012-10-23 05:23:37 To: 5111, Order: 166459, Start Time: 2012-10-23 02:14:22, End Time: 2012-10-23 03:34:11 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (5 on baseline) Performance Regressions: 1 (193 on baseline) Performance Improvements: 1 (47 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 88 (14 on baseline) Unchanged Tests: 952 (647 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.29% (1.2968 => 1.3135, std.dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -1.60% (2.3197 => 2.2826, std.dev.: 0.0118) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.26% (0.6263 => 0.6279, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 0.03% (17.2205 => 17.2255, std.dev.: 0.0159) MultiSource/Applications/kimwitu++/kc: 0.04% (15.6288 => 15.6344, std.dev.: 0.0225) MultiSource/Benchmarks/Bullet/bullet: 0.45% (55.9628 => 56.2148, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0487 => 0.0487, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.20% (0.0488 => 0.0489) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0457 => 0.0457, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.22% (0.0457 => 0.0458, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0446 => 0.0446, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.22% (0.0446 => 0.0447) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0439 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0440 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.22% (0.0456 => 0.0457) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0458 => 0.0458, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0451 => 0.0451, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0452 => 0.0452, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.23% (0.0442 => 0.0443) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0443 => 0.0443) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.45% (0.0448 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0449 => 0.0449, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.22% (0.0459 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0461 => 0.0461, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.23% (0.0436 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0437 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0449 => 0.0449, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.22% (0.0450 => 0.0449, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0440 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0441 => 0.0441) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0432 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0433 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0432 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0432 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.43% (0.0467 => 0.0469, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.21% (0.0468 => 0.0469, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0430 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0431 => 0.0431) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0432 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0433 => 0.0433) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.23% (0.0438 => 0.0439) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.23% (0.0440 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.11% (1.4948 => 1.4964, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.10% (8.2128 => 8.2049, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.41% (0.6888 => 0.6860, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1436 => 0.1436, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0646 => 0.0646) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.11% (63.2438 => 56.2148, std.dev.: 0.0177) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/MallocBench/gs/gs: 13.27% (4.1105 => 4.6561, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.16% (3.4629 => 5.7887, std.dev.: 0.0034) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13483.06% (0.0720 => 9.7798, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050300.00% (0.0001 => 10.0504, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 64.41% (0.2554 => 0.4199, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/lowercase: 57.42% (0.0256 => 0.0403, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 53.59% (10.3673 => 15.9227, std.dev.: 0.0075) SingleSource/UnitTests/SignlessTypes/factor: 46.96% (0.0296 => 0.0435, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 43.54% (0.0271 => 0.0389, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.21% (1.5859 => 2.2395, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 40.57% (0.1622 => 0.2280, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/distray/distray: 36.65% (0.1056 => 0.1443, std.dev.: 0.0002) SingleSource/UnitTests/vla: 33.24% (0.0355 => 0.0473, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.28% (2.2024 => 2.8692, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/neural/neural: 26.18% (0.1463 => 0.1846, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 24.82% (0.0834 => 0.1041, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.29% (0.1566 => 0.1915, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: 20.50% (0.2049 => 0.2469, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.50% (7.0540 => 8.4292, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 19.34% (0.1432 => 0.1709, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.60% (0.0871 => 0.1033, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 18.59% (0.1555 => 0.1844, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.03% (2.2022 => 2.5993, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.99% (0.1117 => 0.1318, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.75% (0.5105 => 0.6011, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.23% (0.6675 => 0.7825, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 17.10% (0.1655 => 0.1938, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: 17.09% (0.0626 => 0.0733) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.90% (0.0793 => 0.0927, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.81% (1.3050 => 1.5244, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.75% (0.8172 => 0.9541, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 16.66% (3.3354 => 3.8912, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/em3d/em3d: 16.64% (0.1695 => 0.1977, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/tsp/tsp: 16.51% (0.1175 => 0.1369, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.47% (0.2271 => 0.2645, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 16.42% (0.1163 => 0.1354, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 16.38% (0.1337 => 0.1556, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 16.32% (0.1440 => 0.1675, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.27% (0.4615 => 0.5366, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 16.06% (10.4361 => 12.1121, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.89% (0.1032 => 0.1196, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.80% (0.0886 => 0.1026, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.58% (1.5415 => 1.7817, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.56% (0.0842 => 0.0973, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.50% (0.1510 => 0.1744, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.48% (0.5020 => 0.5797, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.41% (0.0675 => 0.0779, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.36% (0.1940 => 0.2238, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.19% (0.3121 => 0.3595, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 15.04% (0.7115 => 0.8185, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.01% (0.9765 => 1.1231, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 14.99% (0.3109 => 0.3575, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 14.96% (0.3282 => 0.3773, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/matrix: 14.91% (0.0818 => 0.0940, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.90% (0.2758 => 0.3169, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 14.88% (0.0672 => 0.0772, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 14.84% (0.3423 => 0.3931, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.68% (4.2646 => 4.8907, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.68% (0.0770 => 0.0883, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 14.66% (1.1642 => 1.3349, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.62% (0.5860 => 0.6717, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.58% (0.2065 => 0.2366, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.52% (0.2107 => 0.2413, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/exptree: 14.50% (0.0814 => 0.0932) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.48% (0.0746 => 0.0854, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.44% (0.0838 => 0.0959, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.33% (0.1584 => 0.1811, std.dev.: 0.0016) MultiSource/Applications/aha/aha: 14.25% (0.1151 => 0.1315, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.24% (0.1236 => 0.1412, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 14.17% (0.1906 => 0.2176, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.15% (0.0933 => 0.1065, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.14% (0.6450 => 0.7362, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 14.10% (2.0273 => 2.3132, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.10% (1.7609 => 2.0091, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 14.08% (0.7835 => 0.8938, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 14.06% (1.4186 => 1.6181, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.04% (0.5981 => 0.6821, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.99% (0.1029 => 0.1173, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.90% (8.1363 => 9.2670, std.dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 13.76% (9.4845 => 10.7893, std.dev.: 0.0172) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.70% (0.1438 => 0.1635, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.66% (0.0798 => 0.0907, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.64% (0.0770 => 0.0875, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.63% (0.1695 => 0.1926, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 13.62% (5.7591 => 6.5434, std.dev.: 0.0132) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.56% (0.1062 => 0.1206, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.54% (0.1625 => 0.1845, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 13.45% (0.7433 => 0.8433, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.26% (0.8067 => 0.9137, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.26% (0.2700 => 0.3058, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/health/health: 13.25% (0.1268 => 0.1436, std.dev.: 0.0053) MultiSource/Benchmarks/nbench/nbench: 13.23% (1.1840 => 1.3406, std.dev.: 0.0028) SingleSource/UnitTests/SignlessTypes/rem: 13.20% (0.1144 => 0.1295) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.02% (0.0929 => 0.1050, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 13.01% (4.9449 => 5.5881, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 12.87% (1.0722 => 1.2102, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.87% (5.0018 => 5.6454, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.86% (0.5569 => 0.6285, std.dev.: 0.0023) MultiSource/Applications/lua/lua: 12.86% (3.8723 => 4.3701, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/05-eks/eks: 12.84% (0.4299 => 0.4851, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.79% (0.4879 => 0.5503, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 12.55% (0.3387 => 0.3812, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.48% (0.1330 => 0.1496, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.42% (0.1143 => 0.1285) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.39% (1.1861 => 1.3330, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.33% (0.2603 => 0.2924, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 12.26% (0.3180 => 0.3570, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.23% (0.3441 => 0.3862, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.19% (0.3307 => 0.3710, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 12.18% (0.3177 => 0.3564, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.15% (7.9617 => 8.9289, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: 12.07% (0.8921 => 0.9998, std.dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.73% (0.1125 => 0.1257, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 11.61% (0.3092 => 0.3451, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.49% (0.8101 => 0.9032, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: 11.43% (1.5603 => 1.7387, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/bigfib: 11.00% (0.6456 => 0.7166, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.99% (0.1892 => 0.2100, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 10.92% (2.2969 => 2.5478, std.dev.: 0.0149) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.72% (0.2266 => 0.2509, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.54% (0.1044 => 0.1154, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 10.30% (21.9371 => 24.1958, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/parameter-passing: 10.01% (0.3927 => 0.4320, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.99% (0.3473 => 0.3820, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.88% (0.3543 => 0.3893, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.87% (0.3497 => 0.3842, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.86% (0.3561 => 0.3912, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.85% (0.3828 => 0.4205, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 9.82% (0.4289 => 0.4710, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 9.80% (0.3694 => 0.4056, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.79% (0.3543 => 0.3890, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 9.78% (0.3516 => 0.3860, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.70% (0.3886 => 0.4263, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 9.68% (0.4620 => 0.5067, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.28% (0.3826 => 0.4181, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.11% (0.3865 => 0.4217, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 9.09% (0.3422 => 0.3733, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.04% (0.4203 => 0.4583, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.96% (0.3427 => 0.3734, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.85% (0.2430 => 0.2645, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.80% (0.4103 => 0.4464, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 8.57% (0.4048 => 0.4395, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 8.56% (17.1811 => 18.6512, std.dev.: 0.0303) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.52% (0.4636 => 0.5031, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 8.50% (0.3684 => 0.3997, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.08% (3.8922 => 4.2065, std.dev.: 0.0149) SingleSource/UnitTests/ObjC++/property-reference-object: 8.04% (0.6030 => 0.6515, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.95% (0.5925 => 0.6396, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.93% (14.3668 => 15.5057, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/sieve: 7.88% (0.3603 => 0.3887, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.53% (0.4064 => 0.4370, std.dev.: 0.0041) SingleSource/UnitTests/ObjC++/property-reference: 7.41% (0.7326 => 0.7869, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.40% (0.3650 => 0.3920, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 7.39% (0.3098 => 0.3327, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.09% (0.2891 => 0.3096, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.03% (0.2831 => 0.3030, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.99% (0.3232 => 0.3458, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.95% (0.2905 => 0.3107, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.89% (0.3162 => 0.3380, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.88% (0.3283 => 0.3509, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.76% (0.3136 => 0.3348, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.68% (0.2756 => 0.2940, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.67% (2.0665 => 2.2044, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.65% (0.2871 => 0.3062, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.55% (0.2872 => 0.3060, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.50% (0.2877 => 0.3064, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.44% (0.2793 => 0.2973, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 6.42% (0.3379 => 0.3596, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.42% (0.2725 => 0.2900, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.39% (0.3052 => 0.3247, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 6.17% (0.2802 => 0.2975, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 6.14% (1.2842 => 1.3631, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 6.12% (0.2714 => 0.2880, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.46% (0.3131 => 0.3302, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.94% (1.1194 => 1.1523, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.62% (0.3935 => 0.4038, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8963, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1725, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.40% (0.9957 => 1.1291, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.62% (0.2944 => 0.3286, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.93% (1.1396 => 1.2528, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3683, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/bh/bh: 5.90% (1.9405 => 2.0550, std.dev.: 0.0255) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.72% (4.2280 => 4.3429, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.61% (0.3987 => 0.4091, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.28% (1.0313 => 1.0548, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.93% (3.6395 => 3.7096, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.58% (2.6546 => 2.6966, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2076, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 1.19% (4.4649 => 4.5182, std.dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.01% (6.6874 => 0.1333, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -79.76% (0.8651 => 0.1751, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.18% (5.2763 => 3.2092, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.68% (5.3855 => 3.7332, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.27% (5.3526 => 3.7323, std.dev.: 0.0020) SingleSource/UnitTests/Vector/constpool: -14.53% (54.1659 => 46.2965, std.dev.: 0.0157) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.51% (2.9384 => 2.6295, std.dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: -5.47% (22.1758 => 20.9627, std.dev.: 0.0150) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.10% (8.0499 => 3.7751, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.53% (1.1492 => 0.7639, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.64% (2.9695 => 2.4754, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.97% (1.6925 => 1.4222, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.69% (1.2258 => 1.0703, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -12.07% (1.2373 => 1.0880, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel-2: -10.95% (1.5373 => 1.3689, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.37% (19.9488 => 18.2790, std.dev.: 0.0157) MultiSource/Benchmarks/FreeBench/mason/mason: -8.01% (0.2161 => 0.1988, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.93% (1.8329 => 1.7059, std.dev.: 0.0274) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5757, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.13% (1.6805 => 1.5943, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.58% (1.5835 => 1.5110, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.30% (8.1563 => 7.8053, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.67% (3.2827 => 3.1623, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8775, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4936, std.dev.: 0.0063) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.68% (0.4808 => 0.4679, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -2.37% (4.6441 => 4.5342, std.dev.: 0.0015) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.84% (10.2830 => 10.0935, std.dev.: 0.0116) SingleSource/UnitTests/Vector/multiplies: -1.74% (2.5528 => 2.5085, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6821, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -1.63% (1.1277 => 1.1093, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4204, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.12% (2.3135 => 2.2877, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0554 => 1.0445, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2355, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8592, std.dev.: 0.0122) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 20.08% (0.5229 => 0.6279, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 14.92% (14.9895 => 17.2255, std.dev.: 0.0159) MultiSource/Applications/kimwitu++/kc: 10.45% (14.1553 => 15.6344, std.dev.: 0.0225) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 35.45% (1.1048 => 1.4964, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.62% (7.1582 => 8.2049, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.25% (0.6222 => 0.6860, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.30% (0.1485 => 0.1436, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.47% (0.2116 => 0.0646) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 22 22:56:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 23 Oct 2012 00:56:40 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121023055640.495EA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5115?compare_to=5113&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5115, Order: 166466, Start Time: 2012-10-23 04:35:22, End Time: 2012-10-23 05:58:43 To: 5113, Order: 166461, Start Time: 2012-10-23 02:55:11, End Time: 2012-10-23 04:18:31 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 19 (27 on baseline) Performance Improvements: 1 (6 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 955 (941 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: 31.80% (0.0478 => 0.0630, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 11.76% (0.1105 => 0.1235, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 11.09% (0.1371 => 0.1523, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.78% (0.8330 => 0.8895, std.dev.: 0.0187) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.95% (0.2301 => 0.2438, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.57% (0.5908 => 0.6237, std.dev.: 0.0088) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.31% (0.4714 => 0.4917, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.75% (0.4886 => 0.5069, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.99% (0.9432 => 0.9714, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.68% (0.5750 => 0.5904, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.20% (0.5957 => 0.6088, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 1.66% (2.0217 => 2.0553, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.44% (1.2471 => 1.2650, std.dev.: 0.0068) MultiSource/Benchmarks/MallocBench/gs/gs: 1.39% (4.1055 => 4.1624, std.dev.: 0.0213) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.19% (6.6482 => 6.7270, std.dev.: 0.0180) MultiSource/Benchmarks/nbench/nbench: 1.15% (1.1312 => 1.1442, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 3.71% (21.5941 => 22.3957, std.dev.: 0.2888) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.95% (6.9079 => 7.1114, std.dev.: 0.0135) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.09% (1.4077 => 1.4230, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: -9.11% (0.1526 => 0.1387, std.dev.: 0.0026) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.38% (16.4899 => 16.4266, std.dev.: 0.1192) MultiSource/Applications/obsequi/Obsequi: 0.25% (1.0354 => 1.0380, std.dev.: 0.0129) MultiSource/Applications/sqlite3/sqlite3: 0.05% (0.6375 => 0.6378, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/08-main/main: 2.05% (0.1805 => 0.1842, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.07% (0.1680 => 0.1698, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.08% (0.3253 => 0.3218, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.28% (0.2466 => 0.2473, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.59% (0.3343 => 0.3290, std.dev.: 0.0134) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.72% (0.2425 => 0.2359, std.dev.: 0.0101) SingleSource/Benchmarks/Misc-C++/bigfib: 0.12% (0.5968 => 0.5975, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: 2.22% (0.0450 => 0.0460, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: -1.14% (0.3330 => 0.3292, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/strcat: 0.10% (0.1987 => 0.1989, std.dev.: 0.0044) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.42% (0.0240 => 0.0253, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -26.64% (0.0214 => 0.0157, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 7.04% (0.0355 => 0.0380, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.81% (0.0320 => 0.0311, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.65% (0.0310 => 0.0312, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0419 => 0.0419, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -2.00% (0.0200 => 0.0196, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 3.80% (0.0158 => 0.0164, std.dev.: 0.0022) SingleSource/UnitTests/byval-alignment: -5.48% (0.0347 => 0.0328, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.20% (0.1473 => 0.1476, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -8.02% (1.1377 => 1.0464, std.dev.: 0.0488) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -1.42% (0.1477 => 0.1456, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.87% (0.4071 => 0.3995, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.97% (0.1385 => 0.1440, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.02% (0.0610 => 0.0665, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 13.75% (0.0240 => 0.0273, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.16% (0.0556 => 0.0568, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.45% (1.1356 => 1.1407, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 400.00% (0.0002 => 0.0010, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.41% (0.0594 => 0.0550, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.63% (0.0228 => 0.0234, std.dev.: 0.0053) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.26% (0.8018 => 0.7997, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -10.57% (0.0123 => 0.0110, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.81% (2.1832 => 1.6633, std.dev.: 0.0011) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.94% (0.0810 => 0.0931, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/tsp/tsp: 11.06% (0.1112 => 0.1235, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.90% (0.8321 => 0.8895, std.dev.: 0.0187) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.58% (0.4847 => 0.5069, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.12% (0.7473 => 0.7781, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.78% (0.6010 => 0.6237, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.57% (0.2998 => 0.3105, std.dev.: 0.0032) MultiSource/Applications/treecc/treecc: 3.03% (1.9948 => 2.0553, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.96% (0.9435 => 0.9714, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.88% (0.6287 => 0.6468, std.dev.: 0.0066) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.80% (0.4783 => 0.4917, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.59% (1.1685 => 1.1988, std.dev.: 0.0088) MultiSource/Applications/Burg/burg: 2.53% (1.2222 => 1.2531, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.13% (0.5961 => 0.6088, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.92% (0.9688 => 0.9874, std.dev.: 0.0046) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.81% (6.6074 => 6.7270, std.dev.: 0.0180) MultiSource/Benchmarks/nbench/nbench: 1.52% (1.1271 => 1.1442, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.49% (0.8261 => 0.8384, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.78% (1.5795 => 2.5080, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.88% (0.3186 => 0.3469, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.35% (1.1857 => 1.2847, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 5.96% (63.1822 => 66.9490, std.dev.: 0.0534) SingleSource/Benchmarks/Misc/ReedSolomon: 3.40% (8.5322 => 8.8221, std.dev.: 0.0052) MultiSource/Applications/siod/siod: 2.64% (3.6643 => 3.7611, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.13% (2.4490 => 2.5012, std.dev.: 0.0146) MultiSource/Benchmarks/Olden/bh/bh: 1.69% (2.3560 => 2.3959, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.16% (1.5941 => 1.6126, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.56% (0.3269 => 0.3022, std.dev.: 0.0022) MultiSource/Applications/lua/lua: -5.26% (29.8330 => 28.2647, std.dev.: 0.1453) SingleSource/Benchmarks/Shootout-C++/hash2: -1.67% (3.4237 => 3.3665, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.59% (1.0388 => 1.0223, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.48% (3.3479 => 3.2984, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -1.41% (7.2130 => 7.1114, std.dev.: 0.0135) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.12% (16.4461 => 16.4266, std.dev.: 0.1192) MultiSource/Applications/obsequi/Obsequi: 1.15% (1.0262 => 1.0380, std.dev.: 0.0129) MultiSource/Applications/sqlite3/sqlite3: 0.73% (0.6332 => 0.6378, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/08-main/main: 0.60% (0.1831 => 0.1842, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 8.92% (0.1559 => 0.1698, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.04% (0.3123 => 0.3218, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.41% (0.2463 => 0.2473, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.61% (0.3344 => 0.3290, std.dev.: 0.0134) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.21% (0.2364 => 0.2359, std.dev.: 0.0101) SingleSource/Benchmarks/Misc-C++/bigfib: -0.58% (0.6010 => 0.5975, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: 7.23% (0.0429 => 0.0460, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.80% (0.3266 => 0.3292, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/strcat: 1.02% (0.1969 => 0.1989, std.dev.: 0.0044) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 12.95% (0.0224 => 0.0253, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 27.64% (0.0123 => 0.0157, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -6.86% (0.0408 => 0.0380, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 22.44% (0.0254 => 0.0311, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.11% (0.0384 => 0.0419, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 3.16% (0.0190 => 0.0196, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -8.89% (0.0180 => 0.0164, std.dev.: 0.0022) SingleSource/UnitTests/byval-alignment: 42.61% (0.0230 => 0.0328, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.64% (0.1438 => 0.1476, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -7.64% (1.1329 => 1.0464, std.dev.: 0.0488) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -0.41% (0.1462 => 0.1456, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.06% (0.4164 => 0.3995, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.19% (0.1369 => 0.1440, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.74% (0.0641 => 0.0665, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 40.00% (0.0195 => 0.0273, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.73% (0.0578 => 0.0568, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.26% (1.1437 => 1.1407, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -28.57% (0.0014 => 0.0010, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.28% (0.0627 => 0.0550, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 30.00% (0.0180 => 0.0234, std.dev.: 0.0053) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.25% (0.8017 => 0.7997, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 77.42% (0.0062 => 0.0110, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 22 23:02:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 23 Oct 2012 01:02:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121023060253.6CA7C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5116?compare_to=5108&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5116, Order: 166459, Start Time: 2012-10-23 02:46:18, End Time: 2012-10-23 06:04:56 To: 5108, Order: 166431, Start Time: 2012-10-22 22:42:40, End Time: 2012-10-23 01:58:37 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 26 (174 on baseline) Performance Improvements: 1 (20 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1015 (714 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.13% (0.7183 => 0.7336, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.90% (0.5374 => 0.5476, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 1.81% (0.6413 => 0.6529, std.dev.: 0.0020) MultiSource/Applications/hbd/hbd: 1.74% (1.1157 => 1.1351, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 1.72% (0.8862 => 0.9014, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 1.68% (1.1335 => 1.1525, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.68% (2.2496 => 2.2873, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.61% (2.3663 => 2.4043, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.53% (0.7930 => 0.8051, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 1.48% (2.1832 => 2.2155, std.dev.: 0.0014) MultiSource/Applications/lua/lua: 1.47% (1.6142 => 1.6380, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.45% (0.7122 => 0.7225, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.42% (2.2809 => 2.3133, std.dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 1.36% (2.3564 => 2.3885, std.dev.: 0.0037) MultiSource/Applications/kimwitu++/kc: 1.29% (12.6492 => 12.8121, std.dev.: 0.0059) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.27% (3.1485 => 3.1884, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.26% (12.4826 => 12.6401, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.25% (5.0704 => 5.1336, std.dev.: 0.0077) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.24% (1.8805 => 1.9038, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 1.17% (4.8432 => 4.8997, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.16% (4.1510 => 4.1990, std.dev.: 0.0042) MultiSource/Benchmarks/Bullet/bullet: 1.14% (26.8099 => 27.1168, std.dev.: 0.0078) MultiSource/Applications/SPASS/SPASS: 1.12% (6.1650 => 6.2339, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.08% (1.5445 => 1.5612, std.dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: 1.01% (2.4473 => 2.4719, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.24% (54.1743 => 54.8462, std.dev.: 0.0812) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.44% (2.0122 => 1.9833, std.dev.: 0.0024) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 39.84% (0.0625 => 0.0874, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.17% (0.1063 => 0.1405) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.47% (0.0714 => 0.0903, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.20% (0.2969 => 0.3747, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.13% (0.1106 => 0.1395, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.69% (0.4139 => 0.5161, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 24.49% (1.5932 => 1.9833, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.34% (0.5900 => 0.7336, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.83% (0.4994 => 0.6184, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.79% (0.0475 => 0.0588, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.72% (0.5000 => 0.6186, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.51% (0.4253 => 0.5253, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.22% (0.0547 => 0.0674, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.12% (0.0584 => 0.0719, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.96% (0.1620 => 0.1992, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.72% (0.1021 => 0.1253, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.40% (0.1107 => 0.1355, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.30% (0.0897 => 0.1097, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 22.20% (0.0599 => 0.0732, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 21.84% (0.0948 => 0.1155, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.56% (0.1549 => 0.1883, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.33% (0.0633 => 0.0768, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: 21.19% (0.0821 => 0.0995, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 21.19% (0.0604 => 0.0732, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.12% (0.1103 => 0.1336, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.07% (0.0541 => 0.0655, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.06% (0.0584 => 0.0707, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.03% (0.0642 => 0.0777, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 20.88% (0.1619 => 0.1957, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.81% (0.0495 => 0.0598, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.64% (0.1003 => 0.1210, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.64% (0.1604 => 0.1935, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.60% (0.3903 => 0.4707, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.56% (0.0822 => 0.0991, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 19.54% (0.0947 => 0.1132, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/09-vor/vor: 19.40% (0.1505 => 0.1797, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.22% (0.2014 => 0.2401, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.15% (0.3890 => 0.4635, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 18.91% (0.4029 => 0.4791, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.81% (0.1462 => 0.1737, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 18.80% (0.1218 => 0.1447, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.70% (1.3152 => 1.5612, std.dev.: 0.0028) MultiSource/Applications/sgefa/sgefa: 18.69% (0.0808 => 0.0959, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/mst/mst: 18.34% (0.0698 => 0.0826, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.28% (0.2866 => 0.3390, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.17% (0.2736 => 0.3233, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.11% (0.1088 => 0.1285, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 18.06% (0.5826 => 0.6878, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 17.88% (1.8794 => 2.2155, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.86% (3.5627 => 4.1990, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.83% (0.0572 => 0.0674, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 17.74% (0.5889 => 0.6934, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 17.72% (0.5546 => 0.6529, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.68% (0.2738 => 0.3222, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.63% (0.0573 => 0.0674, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.56% (0.4658 => 0.5476, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.50% (0.2875 => 0.3378, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.48% (0.1968 => 0.2312, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.44% (1.6211 => 1.9038, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.27% (0.3271 => 0.3836, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.24% (0.1160 => 0.1360, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 17.24% (0.1421 => 0.1666, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.19% (0.0605 => 0.0709, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 17.06% (0.2725 => 0.3190, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 17.06% (0.9697 => 1.1351, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.03% (0.5026 => 0.5882, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hello: 16.95% (0.2714 => 0.3174, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.83% (2.7292 => 3.1884, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 16.78% (0.3004 => 0.3508, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 16.73% (0.2750 => 0.3210, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.71% (0.2729 => 0.3185, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.67% (0.4361 => 0.5088, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 16.58% (1.0781 => 1.2568, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 16.55% (0.2780 => 0.3240, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 16.51% (0.3096 => 0.3607, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 16.50% (0.3267 => 0.3806, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 16.48% (0.2803 => 0.3265, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 16.46% (0.2813 => 0.3276, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.44% (0.2792 => 0.3251, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.43% (0.3195 => 0.3720, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 16.37% (0.2823 => 0.3285, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 16.36% (0.2811 => 0.3271, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 16.36% (4.2109 => 4.8997, std.dev.: 0.0078) MultiSource/Applications/hexxagon/hexxagon: 16.31% (0.9909 => 1.1525, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.30% (2.0673 => 2.4043, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.26% (0.3930 => 0.4569, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.25% (0.2911 => 0.3384, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.16% (4.4195 => 5.1336, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.14% (1.9694 => 2.2873, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: 16.12% (0.1284 => 0.1491, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 15.98% (0.7171 => 0.8317, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.86% (1.9966 => 2.3133, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary: 15.81% (0.3258 => 0.3773, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.78% (0.3060 => 0.3543, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.69% (0.1090 => 0.1261, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 15.53% (0.3317 => 0.3832, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.35% (0.3362 => 0.3878, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 15.29% (23.5202 => 27.1168, std.dev.: 0.0078) SingleSource/UnitTests/ObjC/exceptions-3: 15.29% (0.3460 => 0.3989, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.27% (0.3124 => 0.3601, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 15.22% (0.3496 => 0.4028, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 15.21% (0.3465 => 0.3992, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 15.16% (0.2566 => 0.2955, std.dev.: 0.0066) SingleSource/UnitTests/ObjC/exceptions-2: 15.15% (0.3446 => 0.3968, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.08% (0.3488 => 0.4014, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 15.08% (0.3442 => 0.3961, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 15.02% (0.3469 => 0.3990, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 15.01% (0.3678 => 0.4230, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.93% (0.3282 => 0.3772, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 14.87% (0.3348 => 0.3846, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 14.84% (0.3726 => 0.4279, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.81% (0.3625 => 0.4162, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 14.80% (0.2075 => 0.2382, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 14.79% (1.4269 => 1.6380, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists1: 14.78% (0.3477 => 0.3991, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 14.68% (0.3650 => 0.4186, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 14.63% (0.3643 => 0.4176, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.56% (0.3845 => 0.4405, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/parameter-passing: 14.50% (0.3724 => 0.4264, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 14.46% (0.7875 => 0.9014, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.42% (0.3690 => 0.4222, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.37% (0.3981 => 0.4553, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 14.28% (0.4251 => 0.4858, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 14.28% (0.4146 => 0.4738, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 14.16% (2.1653 => 2.4719, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 13.67% (2.1013 => 2.3885, std.dev.: 0.0037) MultiSource/Benchmarks/sim/sim: 13.59% (0.0758 => 0.0861, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.58% (0.2040 => 0.2317, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 13.55% (4.6177 => 5.2435, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/bigfib: 13.53% (0.5012 => 0.5690, std.dev.: 0.0037) MultiSource/Applications/SIBsim4/SIBsim4: 12.78% (0.2691 => 0.3035, std.dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: 12.49% (5.5417 => 6.2339, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.28% (0.6435 => 0.7225, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 11.86% (0.3498 => 0.3913, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.77% (0.1028 => 0.1149, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 11.71% (0.6634 => 0.7411, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.40% (0.2737 => 0.3049, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.35% (0.1383 => 0.1540, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.32% (0.2068 => 0.2302, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.86% (0.3084 => 0.3419, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 10.79% (0.4847 => 0.5370, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 10.76% (0.3336 => 0.3695, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.32% (0.2103 => 0.2320, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 10.13% (2.0346 => 2.2408, std.dev.: 0.0079) MultiSource/Applications/lemon/lemon: 9.79% (0.2391 => 0.2625, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.99% (0.5361 => 0.5843, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.81% (4.6926 => 5.1062, std.dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.59% (11.6398 => 12.6401, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.42% (0.7426 => 0.8051, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.31% (0.5584 => 0.6048, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 7.16% (11.9555 => 12.8121, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.67% (0.3792 => 0.4007, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6534, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.25% (0.5917 => 0.6701, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 9.03% (0.2802 => 0.3055, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.55% (3.3903 => 3.6125, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.04% (12.0509 => 12.6584, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1638, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/flops-2: 3.68% (1.8057 => 1.8721, std.dev.: 0.0050) SingleSource/Benchmarks/Dhrystone/dry: 2.78% (14.0481 => 14.4386, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2002, std.dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.67% (3.1722 => 3.2253, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.61% (2.0820 => 2.1155, std.dev.: 0.0089) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3075, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2882, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5140, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.07% (1.2451 => 1.2584, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5925, std.dev.: 0.0210) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.40% (2.4764 => 2.3921, std.dev.: 0.0115) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.52% (25.4195 => 16.3894, std.dev.: 0.0196) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9746, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7734, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -5.87% (0.2402 => 0.2261, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.05% (0.6293 => 0.6101, std.dev.: 0.0060) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7725, std.dev.: 0.0022) SingleSource/UnitTests/Vector/build2: -2.90% (11.2080 => 10.8827, std.dev.: 0.0249) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5219, std.dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/fldry: -2.40% (17.2379 => 16.8241, std.dev.: 0.0282) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.19% (41.7953 => 40.8802, std.dev.: 0.0146) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.81% (10.7630 => 10.5678, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4948, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.20% (105.3826 => 104.1142, std.dev.: 0.1067) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.09% (21.9346 => 21.6956, std.dev.: 0.0668) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0431, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.04% (3.3991 => 3.3638, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 22 23:11:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 23 Oct 2012 01:11:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121023061145.9035C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5117?compare_to=5112&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5117, Order: 166463, Start Time: 2012-10-23 04:46:18, End Time: 2012-10-23 06:14:49 To: 5112, Order: 166461, Start Time: 2012-10-23 02:48:17, End Time: 2012-10-23 04:16:24 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (209 on baseline) Performance Improvements: 0 (39 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1042 (656 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/vla: 30.86% (0.0324 => 0.0424) MultiSource/Benchmarks/PAQ8p/paq8p: 24.12% (2.0176 => 2.5042, std.dev.: 0.0051) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.40% (0.1410 => 0.1740, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 21.74% (0.7710 => 0.9386, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 21.31% (0.0746 => 0.0905, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 21.03% (0.1013 => 0.1226) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 20.26% (0.0770 => 0.0926, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 19.79% (0.2243 => 0.2687, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 19.01% (0.0826 => 0.0983, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 18.93% (0.1986 => 0.2362, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fbench: 18.75% (0.0544 => 0.0646, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.61% (0.0618 => 0.0733, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.86% (0.5637 => 0.6644, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.80% (0.2596 => 0.3058, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.76% (0.0653 => 0.0769, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.63% (0.0811 => 0.0954, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 17.57% (0.2721 => 0.3199, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.50% (0.0720 => 0.0846, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.24% (0.0725 => 0.0850, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.24% (0.0847 => 0.0993, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 16.75% (0.1003 => 0.1171, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.65% (0.1075 => 0.1254, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.51% (0.0648 => 0.0755) MultiSource/Benchmarks/Olden/mst/mst: 16.47% (0.1111 => 0.1294, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.30% (0.7460 => 0.8676, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_isamax: 16.21% (0.0654 => 0.0760, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.99% (0.9199 => 1.0670, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 15.95% (0.5265 => 0.6105, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.85% (0.2914 => 0.3376, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: 15.78% (1.3693 => 1.5854, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 15.71% (0.0834 => 0.0965, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.64% (0.1413 => 0.1634, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.46% (0.0977 => 0.1128, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.09% (0.6959 => 0.8009, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.05% (0.1276 => 0.1468, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 15.02% (0.1478 => 0.1700, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.99% (0.1014 => 0.1166, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 14.88% (0.1062 => 0.1220, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.77% (0.0819 => 0.0940, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.77% (0.1327 => 0.1523, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.50% (3.9660 => 4.5410, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.42% (0.0964 => 0.1103, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.37% (0.1865 => 0.2133, std.dev.: 0.0007) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.37% (0.1072 => 0.1226, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.29% (0.2023 => 0.2312, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 14.28% (1.1061 => 1.2641, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.17% (0.5577 => 0.6367, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 14.12% (0.1657 => 0.1891, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 14.11% (0.7038 => 0.8031, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: 13.86% (0.7506 => 0.8546, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.84% (0.1048 => 0.1193, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.83% (0.3246 => 0.3695, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.78% (0.2127 => 0.2420, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.64% (0.1789 => 0.2033, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/exptree: 13.54% (0.0768 => 0.0872, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.43% (0.4379 => 0.4967, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.41% (0.1588 => 0.1801, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.41% (1.1364 => 1.2888, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/health/health: 13.36% (0.1213 => 0.1375, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 13.33% (0.0818 => 0.0927, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.25% (1.4563 => 1.6492, std.dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.23% (1.2193 => 1.3806, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 13.20% (0.2925 => 0.3311, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 13.12% (3.8646 => 4.3715, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 12.85% (0.4062 => 0.4584, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/hash2: 12.75% (0.4328 => 0.4880, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 12.72% (0.2995 => 0.3376, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 12.69% (0.0804 => 0.0906, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 12.64% (13.8202 => 15.5676, std.dev.: 0.0264) MultiSource/Benchmarks/McCat/18-imp/imp: 12.36% (0.3220 => 0.3618, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.36% (0.1157 => 0.1300, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.32% (0.6283 => 0.7057, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 12.18% (7.2180 => 8.0975, std.dev.: 0.0127) MultiSource/Applications/treecc/treecc: 11.87% (1.9270 => 2.1557, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.60% (0.3130 => 0.3493, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.57% (0.3899 => 0.4350, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.54% (0.4791 => 0.5344, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 11.48% (1.3245 => 1.4766, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 11.48% (1.0313 => 1.1497, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.45% (0.2140 => 0.2385, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 11.45% (0.5818 => 0.6484, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 11.40% (0.7061 => 0.7866, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.33% (0.3485 => 0.3880, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.23% (0.4016 => 0.4467, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 11.22% (0.5748 => 0.6393, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.18% (0.4390 => 0.4881, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 11.15% (0.6744 => 0.7496, std.dev.: 0.0024) SingleSource/Regression/C++/ofstream_ctor: 11.15% (0.2781 => 0.3091, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 11.14% (0.1589 => 0.1766, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.13% (0.3756 => 0.4174, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 11.07% (0.0976 => 0.1084, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.03% (0.1569 => 0.1742, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.01% (0.1435 => 0.1593, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.00% (0.2782 => 0.3088, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.95% (0.3022 => 0.3353, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.90% (0.2321 => 0.2574, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 10.87% (0.3293 => 0.3651, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 10.84% (4.3801 => 4.8551, std.dev.: 0.0197) MultiSource/Benchmarks/Prolangs-C/football/football: 10.83% (0.8310 => 0.9210, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 10.75% (0.3868 => 0.4284, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 10.75% (3.6692 => 4.0637, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.72% (0.3489 => 0.3863, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 10.72% (3.1889 => 3.5306, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/sieve: 10.66% (0.3453 => 0.3821, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 10.63% (4.4433 => 4.9158, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/05-eks/eks: 10.60% (0.4113 => 0.4549, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.59% (0.3580 => 0.3959, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.56% (1.9828 => 2.1921, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 10.52% (0.2690 => 0.2973, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 10.51% (0.2607 => 0.2881, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 10.50% (16.6129 => 18.3566, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.49% (0.8698 => 0.9610, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 10.47% (0.2760 => 0.3049, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 10.47% (0.2761 => 0.3050, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 10.45% (0.2726 => 0.3011, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.40% (0.2655 => 0.2931, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.39% (0.1819 => 0.2008, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 10.39% (0.2628 => 0.2901, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 10.37% (2.1791 => 2.4050, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists1: 10.36% (0.3534 => 0.3900, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.35% (0.2966 => 0.3273, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 10.32% (0.3149 => 0.3474, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 10.32% (0.2937 => 0.3240, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.27% (0.6135 => 0.6765, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.24% (0.2765 => 0.3048, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 10.14% (0.3107 => 0.3422, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.03% (0.2243 => 0.2468, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 9.99% (0.3192 => 0.3511, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.90% (0.2696 => 0.2963, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.83% (4.9865 => 5.4769, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: 9.74% (0.2988 => 0.3279, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.70% (0.6576 => 0.7214, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 9.61% (0.2945 => 0.3228, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.53% (0.3755 => 0.4113, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 9.51% (1.0594 => 1.1602, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.48% (0.3511 => 0.3844, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 9.44% (14.8535 => 16.2559, std.dev.: 0.0144) MultiSource/Benchmarks/Ptrdist/bc/bc: 9.17% (1.1333 => 1.2372, std.dev.: 0.0029) MultiSource/Benchmarks/sim/sim: 9.13% (0.3131 => 0.3417, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 9.11% (1.2749 => 1.3911, std.dev.: 0.0021) MultiSource/Applications/lua/lua: 9.03% (3.7467 => 4.0851, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 8.93% (8.4961 => 9.2544, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/neural/neural: 8.88% (0.1385 => 0.1508, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 8.54% (6.5754 => 7.1370, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.54% (1.5188 => 1.6485, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 8.46% (0.6250 => 0.6779, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.44% (0.9108 => 0.9877, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.35% (0.3245 => 0.3516, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.18% (6.2785 => 6.7919, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.16% (0.4805 => 0.5197, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.15% (0.8818 => 0.9537, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/oourafft: 8.12% (0.2008 => 0.2171, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.11% (0.2504 => 0.2707, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 8.04% (4.6629 => 5.0379, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.98% (3.2742 => 3.5356, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 7.79% (1.2292 => 1.3249, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.76% (2.1007 => 2.2637, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.60% (13.2842 => 14.2942, std.dev.: 0.0192) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.18% (0.3650 => 0.3912, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 7.17% (0.4003 => 0.4290, std.dev.: 0.0085) SingleSource/UnitTests/ObjC/exceptions: 7.05% (0.3914 => 0.4190, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 6.95% (0.3940 => 0.4214, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 6.93% (0.3578 => 0.3826, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 6.84% (0.3789 => 0.4048, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.75% (0.3646 => 0.3892, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 6.72% (0.3663 => 0.3909, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-2: 6.69% (0.3601 => 0.3842, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 6.54% (0.3623 => 0.3860, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 6.42% (0.1777 => 0.1891, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 5.66% (14.5298 => 15.3527, std.dev.: 0.0056) MultiSource/Applications/sqlite3/sqlite3: 5.53% (16.2614 => 17.1605, std.dev.: 0.0372) MultiSource/Benchmarks/Olden/bh/bh: 5.28% (0.2859 => 0.3010, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 2.91% (33.2944 => 34.2634, std.dev.: 0.0379) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.13% (0.1824 => 0.3541, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.93% (0.4846 => 0.6975, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 30.60% (5.7573 => 7.5193, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/fbench: 24.45% (1.8175 => 2.2619, std.dev.: 0.0129) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.13% (1.0895 => 1.2761, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 11.11% (1.1560 => 1.2844, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1923, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 8.97% (0.8273 => 0.9015, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 8.85% (0.1322 => 0.1439, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-4: 6.54% (1.0640 => 1.1336, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.45% (0.9692 => 1.0220, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 5.42% (1.2998 => 1.3702, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.95% (0.3458 => 0.3629, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0043, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.68% (0.3139 => 0.3286, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: 4.53% (0.5449 => 0.5696) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.49% (2.8606 => 2.9891, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.99% (1.7081 => 1.7762, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6786, std.dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 3.44% (12.0921 => 12.5083, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: 3.41% (1.9199 => 1.9853, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.34% (10.7476 => 11.1066, std.dev.: 0.0138) MultiSource/Benchmarks/Olden/bisort/bisort: 3.00% (0.8239 => 0.8486, std.dev.: 0.0078) MultiSource/Applications/lemon/lemon: 2.97% (1.4298 => 1.4722, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0310 => 1.0561, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.33% (7.4271 => 7.5999, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-8: 2.27% (1.9863 => 2.0313) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.52% (2.0200 => 2.0507, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5130, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.37% (1.9433 => 1.9699, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.31% (3.1720 => 3.2134, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 1.21% (5.5130 => 5.5796, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 1.21% (9.0760 => 9.1854, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.12% (3.1071 => 3.1419, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.05% (9.9194 => 10.0234, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -45.73% (0.2670 => 0.1449, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.10% (0.4657 => 0.3907, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.35% (1.3819 => 1.2389, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.24% (1.3813 => 1.2398, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -99.99% (8.6002 => 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.24% (1.0460 => 0.8552, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/mason/mason: -12.73% (0.2238 => 0.1953, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.04% (20.3410 => 18.2991, std.dev.: 0.0088) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.43% (1.3780 => 1.2894, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-3: -6.20% (2.4152 => 2.2655, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8099, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3744, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -5.13% (1.2308 => 1.1676, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -5.03% (2.6470 => 2.5139, std.dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.83% (0.9996 => 0.9513, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/perlin: -4.46% (6.2497 => 5.9710, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.91% (1.7688 => 1.6997, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.02% (0.4867 => 0.4720, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -2.85% (3.2729 => 3.1796, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.76% (4.1080 => 3.9945, std.dev.: 0.0039) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8815) MultiSource/Benchmarks/Olden/bh/bh: -2.69% (1.9762 => 1.9230, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4786, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -2.33% (1.3891 => 1.3567, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: -2.25% (3.0263 => 2.9583, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.18% (0.6615 => 0.6471, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.85% (0.6589 => 0.6467, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.76% (6.3560 => 6.2444, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3456, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.63% (2.5254 => 2.4843, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -1.57% (4.5928 => 4.5208, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -1.49% (7.1097 => 7.0036, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: -1.41% (28.2225 => 27.8236, std.dev.: 0.0033) MultiSource/Applications/lua/lua: -1.35% (26.5159 => 26.1582, std.dev.: 0.0240) SingleSource/Benchmarks/Shootout/heapsort: -1.21% (3.9173 => 3.8698, std.dev.: 0.0013) MultiSource/Applications/aha/aha: -1.05% (3.1476 => 3.1145, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -1.05% (5.3167 => 5.2611, std.dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: -1.04% (84.4286 => 83.5486, std.dev.: 0.0116) MultiSource/Applications/viterbi/viterbi: -1.04% (4.4810 => 4.4345, std.dev.: 0.0059) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 23 00:13:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 23 Oct 2012 02:13:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121023071350.61CD22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5118?compare_to=5114&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5118, Order: 166467, Start Time: 2012-10-23 05:53:09, End Time: 2012-10-23 07:15:52 To: 5114, Order: 166463, Start Time: 2012-10-23 04:03:41, End Time: 2012-10-23 05:23:37 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (5 on baseline) Performance Regressions: 0 (190 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 88 (14 on baseline) Unchanged Tests: 954 (652 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.06% (0.6279 => 0.6275, std.dev.: 0.0173) MultiSource/Applications/SPASS/SPASS: 0.08% (17.2255 => 17.2388, std.dev.: 0.3778) MultiSource/Applications/kimwitu++/kc: -0.14% (15.6344 => 15.6125, std.dev.: 0.3634) MultiSource/Benchmarks/Bullet/bullet: 0.04% (56.2148 => 56.2357, std.dev.: 0.0882) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.21% (0.0487 => 0.0488, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.20% (0.0489 => 0.0488, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0457 => 0.0457, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0458 => 0.0458, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.22% (0.0446 => 0.0447, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0447 => 0.0447, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0439 => 0.0439, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0440 => 0.0440, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0457 => 0.0457, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0458 => 0.0458, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.22% (0.0451 => 0.0452, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0452 => 0.0452, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0443 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0443 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.22% (0.0450 => 0.0449, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0449 => 0.0449, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0460 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0461 => 0.0461, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.23% (0.0437 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.23% (0.0437 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0449 => 0.0449, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.22% (0.0449 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0440 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0441 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0432 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0433 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.23% (0.0432 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0432 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.21% (0.0469 => 0.0468, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0469 => 0.0469, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0430 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0431 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0432 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0433 => 0.0433) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0439 => 0.0439, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.23% (0.0439 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.09% (1.4964 => 1.4950, std.dev.: 0.0161) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.02% (8.2049 => 8.2062, std.dev.: 0.0134) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.06% (0.6860 => 0.6864, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1436 => 0.1436, std.dev.: 0.0033) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0646 => 0.0647, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.08% (63.2438 => 56.2357, std.dev.: 0.0882) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/MallocBench/gs/gs: 13.23% (4.1105 => 4.6542, std.dev.: 0.1684) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.35% (3.4629 => 5.7951, std.dev.: 0.0071) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13485.83% (0.0720 => 9.7818, std.dev.: 0.1075) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050700.00% (0.0001 => 10.0508, std.dev.: 0.0011) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 64.17% (0.2554 => 0.4193, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/lowercase: 57.81% (0.0256 => 0.0404) MultiSource/Benchmarks/PAQ8p/paq8p: 53.57% (10.3673 => 15.9210, std.dev.: 0.0013) SingleSource/UnitTests/SignlessTypes/factor: 46.96% (0.0296 => 0.0435, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 43.54% (0.0271 => 0.0389) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.40% (1.5859 => 2.2424, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 40.57% (0.1622 => 0.2280, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 36.65% (0.1056 => 0.1443, std.dev.: 0.0062) SingleSource/UnitTests/vla: 33.24% (0.0355 => 0.0473, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.29% (2.2024 => 2.8696, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/neural/neural: 26.32% (0.1463 => 0.1848, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 24.70% (0.0834 => 0.1040, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.39% (0.1566 => 0.1901, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/ReedSolomon: 20.40% (0.2049 => 0.2467, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.42% (7.0540 => 8.4241, std.dev.: 0.0422) SingleSource/Benchmarks/Misc/flops: 19.27% (0.1432 => 0.1708, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 18.78% (0.1555 => 0.1847, std.dev.: 0.0087) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.60% (0.0871 => 0.1033, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.05% (2.2022 => 2.5997, std.dev.: 0.0481) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.90% (0.5105 => 0.6019, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.27% (0.6675 => 0.7828, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: 17.09% (0.0626 => 0.0733, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 16.98% (0.1655 => 0.1936, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.90% (0.0793 => 0.0927, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.72% (1.3050 => 1.5232, std.dev.: 0.0440) MultiSource/Benchmarks/Olden/em3d/em3d: 16.64% (0.1695 => 0.1977, std.dev.: 0.0091) MultiSource/Applications/d/make_dparser: 16.58% (3.3354 => 3.8884, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.54% (0.0798 => 0.0930, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 16.53% (0.1337 => 0.1558, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.52% (0.8172 => 0.9522, std.dev.: 0.0084) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.47% (0.2271 => 0.2645, std.dev.: 0.0103) MultiSource/Benchmarks/Olden/tsp/tsp: 16.43% (0.1175 => 0.1368, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/mst/mst: 16.42% (0.1163 => 0.1354, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/power/power: 16.32% (0.1440 => 0.1675, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.27% (0.4615 => 0.5366, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.18% (0.1032 => 0.1199, std.dev.: 0.0038) MultiSource/Applications/JM/ldecod/ldecod: 15.98% (10.4361 => 12.1037, std.dev.: 0.2109) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.91% (0.0886 => 0.1027, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.82% (1.5415 => 1.7854, std.dev.: 0.0065) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.68% (0.0842 => 0.0974, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.46% (0.1940 => 0.2240, std.dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.43% (0.1510 => 0.1743, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.40% (0.5020 => 0.5793, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 15.11% (0.7115 => 0.8190, std.dev.: 0.0272) SingleSource/Benchmarks/Misc/oourafft: 15.05% (0.3282 => 0.3776, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 14.99% (0.3109 => 0.3575, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.96% (0.3121 => 0.3588, std.dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.96% (0.9765 => 1.1226, std.dev.: 0.0324) SingleSource/Benchmarks/Shootout/matrix: 14.79% (0.0818 => 0.0939) MultiSource/Applications/Burg/burg: 14.73% (1.1642 => 1.3357, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/18-imp/imp: 14.72% (0.3423 => 0.3927, std.dev.: 0.0105) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.71% (0.1584 => 0.1817, std.dev.: 0.0053) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.70% (4.2646 => 4.8916, std.dev.: 0.1320) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.68% (0.0770 => 0.0883, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.62% (0.2107 => 0.2415, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.59% (0.1117 => 0.1280, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.54% (0.5860 => 0.6712, std.dev.: 0.0224) SingleSource/Benchmarks/McGill/exptree: 14.50% (0.0814 => 0.0932, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.48% (0.1029 => 0.1178, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.48% (0.0746 => 0.0854, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.43% (0.2065 => 0.2363, std.dev.: 0.0039) MultiSource/Applications/aha/aha: 14.34% (0.1151 => 0.1316, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 14.32% (0.1906 => 0.2179, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.32% (0.2758 => 0.3153, std.dev.: 0.0152) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.32% (0.0838 => 0.0958, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.30% (0.5981 => 0.6836, std.dev.: 0.0254) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.25% (0.6450 => 0.7369, std.dev.: 0.0220) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.16% (0.1236 => 0.1411, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.15% (0.0933 => 0.1065, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.08% (1.7609 => 2.0089, std.dev.: 0.0026) MultiSource/Applications/spiff/spiff: 13.98% (0.7835 => 0.8930, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.90% (1.4186 => 1.6158, std.dev.: 0.0466) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.89% (8.1363 => 9.2662, std.dev.: 0.2064) MultiSource/Benchmarks/mafft/pairlocalalign: 13.88% (9.4845 => 10.8006, std.dev.: 0.0072) MultiSource/Benchmarks/nbench/nbench: 13.67% (1.1840 => 1.3459, std.dev.: 0.0116) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.64% (0.0770 => 0.0875, std.dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 13.63% (5.7591 => 6.5442, std.dev.: 0.1202) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.63% (0.1438 => 0.1634, std.dev.: 0.0018) MultiSource/Applications/treecc/treecc: 13.60% (2.0273 => 2.3031, std.dev.: 0.0755) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.56% (0.1062 => 0.1206, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.48% (0.1625 => 0.1844, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.39% (0.1695 => 0.1922, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.33% (0.2700 => 0.3060, std.dev.: 0.0099) MultiSource/Applications/lambda-0_1_3/lambda: 13.33% (0.7433 => 0.8424, std.dev.: 0.0283) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.21% (0.8067 => 0.9133, std.dev.: 0.0360) SingleSource/UnitTests/SignlessTypes/rem: 13.20% (0.1144 => 0.1295, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 13.05% (3.8723 => 4.3777, std.dev.: 0.1221) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.02% (0.0929 => 0.1050, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.95% (4.9449 => 5.5852, std.dev.: 0.0164) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.94% (5.0018 => 5.6488, std.dev.: 0.0318) MultiSource/Applications/lemon/lemon: 12.88% (1.0722 => 1.2103, std.dev.: 0.0294) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.86% (0.5569 => 0.6285, std.dev.: 0.0251) MultiSource/Benchmarks/McCat/05-eks/eks: 12.84% (0.4299 => 0.4851, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.81% (0.4879 => 0.5504, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.71% (0.1330 => 0.1499, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 12.64% (0.3387 => 0.3815, std.dev.: 0.0093) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.44% (1.1861 => 1.3336, std.dev.: 0.0369) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.34% (0.1143 => 0.1284, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.29% (0.2603 => 0.2923, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.28% (0.3307 => 0.3713, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 12.21% (0.8921 => 1.0010, std.dev.: 0.0301) MultiSource/Benchmarks/McCat/09-vor/vor: 12.20% (0.3180 => 0.3568, std.dev.: 0.0115) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.11% (7.9617 => 8.9255, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.09% (0.3441 => 0.3857, std.dev.: 0.0135) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 12.09% (0.3177 => 0.3561, std.dev.: 0.0024) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.73% (0.1125 => 0.1257, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: 11.61% (0.3092 => 0.3451, std.dev.: 0.0118) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.52% (0.8101 => 0.9034, std.dev.: 0.0336) MultiSource/Applications/hbd/hbd: 11.46% (1.5603 => 1.7391, std.dev.: 0.0462) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.05% (0.1892 => 0.2101, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 10.97% (0.6456 => 0.7164, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 10.77% (2.2969 => 2.5442, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.72% (0.2266 => 0.2509, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.54% (0.1044 => 0.1154, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 10.26% (21.9371 => 24.1875, std.dev.: 0.3596) SingleSource/UnitTests/ObjC/parameter-passing: 9.96% (0.3927 => 0.4318) SingleSource/UnitTests/ObjC/exceptions-3: 9.95% (0.3516 => 0.3866, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 9.94% (0.3543 => 0.3895) SingleSource/UnitTests/ObjC/for-in: 9.88% (0.3694 => 0.4059, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.88% (0.3473 => 0.3816, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.83% (0.3561 => 0.3911, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.82% (0.3543 => 0.3891, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 9.80% (0.3828 => 0.4203, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 9.78% (0.4620 => 0.5072, std.dev.: 0.0118) SingleSource/UnitTests/ObjC/exceptions-2: 9.78% (0.3497 => 0.3839, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.68% (0.3886 => 0.4262, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash: 9.63% (0.4289 => 0.4702, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.34% (0.3865 => 0.4226, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 9.23% (0.3422 => 0.3738, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.12% (0.3826 => 0.4175, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.92% (0.4203 => 0.4578, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.92% (0.4103 => 0.4469, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.87% (0.3427 => 0.3731, std.dev.: 0.0114) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.72% (0.2430 => 0.2642, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 8.63% (17.1811 => 18.6633, std.dev.: 0.3548) SingleSource/Benchmarks/Shootout-C++/lists1: 8.52% (0.3684 => 0.3998, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.48% (0.4636 => 0.5029, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: 8.47% (0.4048 => 0.4391, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.09% (3.8922 => 4.2069, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.05% (14.3668 => 15.5228, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference-object: 8.04% (0.6030 => 0.6515, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 7.88% (0.5925 => 0.6392, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3603 => 0.3880, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.43% (0.4064 => 0.4366, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.40% (0.7326 => 0.7868, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.40% (0.3650 => 0.3920, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 7.30% (0.3098 => 0.3324, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.13% (0.2905 => 0.3112, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 7.07% (0.3283 => 0.3515, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 7.06% (0.2831 => 0.3031, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.90% (0.3232 => 0.3455, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.85% (0.2891 => 0.3089, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.80% (0.3162 => 0.3377, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.79% (0.3136 => 0.3349, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.70% (2.0665 => 2.2049, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.69% (0.2872 => 0.3064, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.52% (0.2793 => 0.2975, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.48% (0.2871 => 0.3057, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.46% (0.2756 => 0.2934, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 6.40% (0.2877 => 0.3061, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.39% (0.2725 => 0.2899, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.29% (0.3052 => 0.3244, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 6.27% (0.3379 => 0.3591, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.07% (0.2802 => 0.2972, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.04% (0.2714 => 0.2878, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.24% (0.3131 => 0.3295, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.94% (1.1194 => 1.1523, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.64% (0.3935 => 0.4039, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1725, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.48% (0.9957 => 1.1299, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.58% (0.2944 => 0.3285, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.86% (1.1396 => 1.2520, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3680, std.dev.: 0.0136) MultiSource/Benchmarks/Olden/bh/bh: 6.27% (1.9405 => 2.0622, std.dev.: 0.0278) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.66% (4.2280 => 4.3405, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.61% (0.3987 => 0.4091, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.88% (3.6395 => 3.7081, std.dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.53% (2.6546 => 2.6952, std.dev.: 0.0013) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2076, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 1.35% (4.4649 => 4.5253, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.06% (6.5088 => 6.5778, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.00% (6.6874 => 0.1335, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -79.75% (0.8651 => 0.1752, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.19% (5.2763 => 3.2086, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.68% (5.3855 => 3.7330, std.dev.: 0.0173) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.26% (5.3526 => 3.7331, std.dev.: 0.0053) SingleSource/UnitTests/Vector/constpool: -14.48% (54.1659 => 46.3216, std.dev.: 0.0094) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.43% (2.9384 => 2.6319, std.dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.09% (8.0499 => 3.7764, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.49% (1.1492 => 0.7643, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4752, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -16.04% (1.6925 => 1.4211, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.69% (1.2258 => 1.0702, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.52% (1.2373 => 1.0948, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -10.53% (1.5373 => 1.3754, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.27% (19.9488 => 18.2996, std.dev.: 0.0282) MultiSource/Benchmarks/FreeBench/mason/mason: -7.77% (0.2161 => 0.1993, std.dev.: 0.0034) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.05% (1.8329 => 1.7036, std.dev.: 0.0341) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.17% (1.6805 => 1.5936, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5090, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.28% (8.1563 => 7.8070, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1625, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8778, std.dev.: 0.0069) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5036, std.dev.: 0.0020) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.72% (0.4808 => 0.4677, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.83% (10.2830 => 10.0953, std.dev.: 0.0059) SingleSource/UnitTests/Vector/multiplies: -1.74% (2.5528 => 2.5083, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: -1.69% (8.8334 => 8.6837, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/lists: -1.34% (6.2999 => 6.2157, std.dev.: 0.0102) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2878, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8571, std.dev.: 0.0063) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 20.00% (0.5229 => 0.6275, std.dev.: 0.0173) MultiSource/Applications/SPASS/SPASS: 15.01% (14.9895 => 17.2388, std.dev.: 0.3778) MultiSource/Applications/kimwitu++/kc: 10.29% (14.1553 => 15.6125, std.dev.: 0.3634) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 35.32% (1.1048 => 1.4950, std.dev.: 0.0161) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.64% (7.1582 => 8.2062, std.dev.: 0.0134) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.32% (0.6222 => 0.6864, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.30% (0.1485 => 0.1436, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.42% (0.2116 => 0.0647, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 23 00:36:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 23 Oct 2012 02:36:51 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121023073651.B9ABF2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/5119?compare_to=5115&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5119, Order: 166467, Start Time: 2012-10-23 06:15:25, End Time: 2012-10-23 07:38:56 To: 5115, Order: 166466, Start Time: 2012-10-23 04:35:22, End Time: 2012-10-23 05:58:43 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 9 (31 on baseline) Performance Improvements: 1 (5 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 965 (938 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 2.76% (1.4361 => 1.4757, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.20% (0.8078 => 0.8256, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.58% (0.8770 => 0.8909, std.dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: 7.78% (3.0231 => 3.2582, std.dev.: 0.0909) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 2.63% (0.7657 => 0.7858, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 1.28% (1.4071 => 1.4251, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/whetstone: 1.13% (2.1149 => 2.1387, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.12% (6.1979 => 6.2673, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.08% (1.2416 => 1.2550, std.dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/treecc/treecc: -1.60% (2.0553 => 2.0224, std.dev.: 0.0086) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.15% (16.4266 => 16.4520, std.dev.: 0.0899) MultiSource/Applications/obsequi/Obsequi: 1.53% (1.0380 => 1.0539, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: 0.36% (0.6378 => 0.6401, std.dev.: 0.0069) MultiSource/Benchmarks/McCat/08-main/main: 5.21% (0.1842 => 0.1938, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.30% (0.1698 => 0.1659, std.dev.: 0.0056) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.22% (0.3218 => 0.3211, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.33% (0.2473 => 0.2440, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.28% (0.3290 => 0.3332, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.72% (0.2359 => 0.2342, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: -0.08% (0.5975 => 0.5970, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel: -8.48% (0.0460 => 0.0421, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.3292 => 0.3292, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/strcat: -1.36% (0.1989 => 0.1962, std.dev.: 0.0033) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -31.23% (0.0253 => 0.0174, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 36.94% (0.0157 => 0.0215, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 11.58% (0.0380 => 0.0424, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 5.79% (0.0311 => 0.0329, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.64% (0.0312 => 0.0310, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.48% (0.0419 => 0.0421, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 4.08% (0.0196 => 0.0204, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/test1: 31.71% (0.0164 => 0.0216, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: 2.74% (0.0328 => 0.0337, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.14% (0.1476 => 0.1474, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 9.94% (1.0464 => 1.1504, std.dev.: 0.0154) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -1.99% (0.1456 => 0.1427, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.38% (0.3995 => 0.4130, std.dev.: 0.0219) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: - (0.1440 => 0.1440, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.97% (0.0665 => 0.0612, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -16.85% (0.0273 => 0.0227, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.46% (0.0568 => 0.0537, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.46% (1.1407 => 1.1460, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.77% (0.0031 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -20.00% (0.0010 => 0.0008, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.82% (0.0550 => 0.0560, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.14% (0.0234 => 0.0229, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.31% (0.7997 => 0.8022, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -55.45% (0.0110 => 0.0049, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.12% (2.1832 => 1.6567, std.dev.: 0.0064) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.35% (0.1425 => 0.1544, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.40% (0.8321 => 0.8937, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.42% (0.2180 => 0.2320, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.39% (0.7473 => 0.7876, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.04% (0.1983 => 0.2083, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.92% (0.9435 => 0.9805, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.67% (0.2998 => 0.3108, std.dev.: 0.0019) MultiSource/Applications/hbd/hbd: 3.42% (1.4269 => 1.4757, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: 2.65% (0.7950 => 0.8161, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/05-eks/eks: 2.62% (0.4397 => 0.4512, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.56% (0.8050 => 0.8256, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.21% (0.8716 => 0.8909, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.86% (4.1763 => 4.2540, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.81% (0.8518 => 0.8672, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.65% (0.8066 => 0.8199, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.62% (1.4479 => 1.4713, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.54% (0.7966 => 0.8089, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.42% (0.8331 => 0.8449, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 1.38% (1.9948 => 2.0224, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.38% (13.1811 => 13.3632, std.dev.: 0.0468) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.34% (6.6074 => 6.6962, std.dev.: 0.0326) MultiSource/Benchmarks/nbench/nbench: 1.07% (1.1271 => 1.1392, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.83% (1.5795 => 2.5087, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.33% (0.3186 => 0.3515, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.44% (1.1857 => 1.2858, std.dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: 5.95% (63.1822 => 66.9392, std.dev.: 0.0721) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.44% (0.7597 => 0.7858, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 3.40% (8.5322 => 8.8220, std.dev.: 0.0041) MultiSource/Applications/siod/siod: 2.87% (3.6643 => 3.7693, std.dev.: 0.0171) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.82% (2.4490 => 2.5180, std.dev.: 0.0090) MultiSource/Benchmarks/Olden/bh/bh: 1.88% (2.3560 => 2.4004, std.dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -10.06% (0.3269 => 0.2940, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/heapsort: -7.44% (3.2926 => 3.0475, std.dev.: 0.0242) MultiSource/Applications/lua/lua: -5.00% (29.8330 => 28.3410, std.dev.: 0.1994) SingleSource/Benchmarks/Shootout-C++/hash2: -1.43% (3.4237 => 3.3748, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.22% (3.3479 => 3.3070, std.dev.: 0.0129) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.04% (16.4461 => 16.4520, std.dev.: 0.0899) MultiSource/Applications/obsequi/Obsequi: 2.70% (1.0262 => 1.0539, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: 1.09% (0.6332 => 0.6401, std.dev.: 0.0069) MultiSource/Benchmarks/McCat/08-main/main: 5.84% (0.1831 => 0.1938, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 6.41% (0.1559 => 0.1659, std.dev.: 0.0056) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.82% (0.3123 => 0.3211, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.93% (0.2463 => 0.2440, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.36% (0.3344 => 0.3332, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.93% (0.2364 => 0.2342, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: -0.67% (0.6010 => 0.5970, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel: -1.86% (0.0429 => 0.0421, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.80% (0.3266 => 0.3292, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/strcat: -0.36% (0.1969 => 0.1962, std.dev.: 0.0033) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -22.32% (0.0224 => 0.0174, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 74.80% (0.0123 => 0.0215, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.92% (0.0408 => 0.0424, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.53% (0.0254 => 0.0329, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.65% (0.0302 => 0.0310, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.64% (0.0384 => 0.0421, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/test1: 20.00% (0.0180 => 0.0216, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: 46.52% (0.0230 => 0.0337, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.50% (0.1438 => 0.1474, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 1.54% (1.1329 => 1.1504, std.dev.: 0.0154) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -2.39% (0.1462 => 0.1427, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.82% (0.4164 => 0.4130, std.dev.: 0.0219) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.19% (0.1369 => 0.1440, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.52% (0.0641 => 0.0612, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 16.41% (0.0195 => 0.0227, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.09% (0.0578 => 0.0537, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.20% (1.1437 => 1.1460, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -42.86% (0.0014 => 0.0008, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.69% (0.0627 => 0.0560, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 27.22% (0.0180 => 0.0229, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.06% (0.8017 => 0.8022, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -20.97% (0.0062 => 0.0049, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 23 01:13:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 23 Oct 2012 03:13:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121023081324.628FC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5120?compare_to=5117&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5120, Order: 166467, Start Time: 2012-10-23 06:44:38, End Time: 2012-10-23 08:16:27 To: 5117, Order: 166463, Start Time: 2012-10-23 04:46:18, End Time: 2012-10-23 06:14:49 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (200 on baseline) Performance Improvements: 1 (37 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1041 (667 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.85% (81.6268 => 80.1128, std.dev.: 0.4316) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/vla: 31.17% (0.0324 => 0.0425, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 24.13% (0.0746 => 0.0926, std.dev.: 0.0030) MultiSource/Benchmarks/PAQ8p/paq8p: 23.94% (2.0176 => 2.5006, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.76% (0.1410 => 0.1745, std.dev.: 0.0062) MultiSource/Benchmarks/VersaBench/dbms/dbms: 21.58% (0.7710 => 0.9374, std.dev.: 0.0468) MultiSource/Benchmarks/Olden/tsp/tsp: 20.83% (0.1013 => 0.1224, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/08-main/main: 19.71% (0.2243 => 0.2685, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/flops: 19.01% (0.0826 => 0.0983, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.61% (0.0618 => 0.0733, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.76% (0.0653 => 0.0769, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.69% (0.5637 => 0.6634, std.dev.: 0.0215) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 17.68% (0.2721 => 0.3202, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.50% (0.0720 => 0.0846, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.47% (0.0847 => 0.0995, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.39% (0.0811 => 0.0952, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.33% (0.2596 => 0.3046, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.27% (0.1986 => 0.2329, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.24% (0.0725 => 0.0850, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/power/power: 16.95% (0.1003 => 0.1173, std.dev.: 0.0052) MultiSource/Applications/viterbi/viterbi: 16.71% (0.1478 => 0.1725, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.65% (0.1075 => 0.1254, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/mst/mst: 16.29% (0.1111 => 0.1292, std.dev.: 0.0045) SingleSource/UnitTests/Vector/SSE/sse_isamax: 16.21% (0.0654 => 0.0760) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.20% (0.0648 => 0.0753, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.17% (0.7460 => 0.8666, std.dev.: 0.0364) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.99% (0.9199 => 1.0670, std.dev.: 0.0299) SingleSource/Benchmarks/CoyoteBench/huffbench: 15.95% (0.0834 => 0.0967, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.75% (0.2914 => 0.3373, std.dev.: 0.0158) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 15.75% (0.5265 => 0.6094, std.dev.: 0.0264) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.64% (0.1413 => 0.1634, std.dev.: 0.0073) MultiSource/Applications/hbd/hbd: 15.58% (1.3693 => 1.5827, std.dev.: 0.0431) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.46% (0.0977 => 0.1128, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.27% (0.2023 => 0.2332, std.dev.: 0.0059) MultiSource/Applications/aha/aha: 15.16% (0.1062 => 0.1223, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.15% (0.6959 => 0.8013, std.dev.: 0.0248) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.13% (0.1276 => 0.1469, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.99% (0.1014 => 0.1166, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.90% (0.0819 => 0.0941, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.54% (0.1327 => 0.1520, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 14.54% (1.1061 => 1.2669, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.52% (3.9660 => 4.5419, std.dev.: 0.1263) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.46% (0.1072 => 0.1227, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.42% (0.1865 => 0.2134, std.dev.: 0.0092) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.32% (0.0964 => 0.1102, std.dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: 14.18% (0.7038 => 0.8036, std.dev.: 0.0239) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.13% (0.5577 => 0.6365, std.dev.: 0.0266) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.87% (0.2127 => 0.2422, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.80% (0.3246 => 0.3694, std.dev.: 0.0132) MultiSource/Applications/spiff/spiff: 13.71% (0.7506 => 0.8535, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.65% (0.1048 => 0.1191, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.54% (0.4379 => 0.4972, std.dev.: 0.0145) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.39% (1.1364 => 1.2886, std.dev.: 0.0344) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.35% (0.1588 => 0.1800, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 13.28% (0.0768 => 0.0870, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 13.23% (0.2925 => 0.3312, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.16% (1.2193 => 1.3798, std.dev.: 0.0399) MultiSource/Benchmarks/MallocBench/gs/gs: 13.08% (3.8646 => 4.3701, std.dev.: 0.1583) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.98% (1.4563 => 1.6453, std.dev.: 0.0442) SingleSource/Benchmarks/Shootout-C++/hash: 12.95% (0.4062 => 0.4588, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 12.94% (0.0804 => 0.0908, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: 12.71% (0.4328 => 0.4878, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 12.61% (13.8202 => 15.5636, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.45% (0.1157 => 0.1301, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 12.42% (0.2995 => 0.3367, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.32% (0.6283 => 0.7057, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 12.30% (0.3220 => 0.3616, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 12.19% (7.2180 => 8.0982, std.dev.: 0.1846) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.90% (0.3899 => 0.4363, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 11.90% (1.9270 => 2.1563, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.44% (0.3130 => 0.3488, std.dev.: 0.0066) SingleSource/UnitTests/ObjC++/property-reference-object: 11.43% (0.5818 => 0.6483, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 11.42% (1.3245 => 1.4757, std.dev.: 0.0490) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.40% (0.2140 => 0.2384, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.40% (0.4791 => 0.5337, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 11.38% (1.0313 => 1.1487, std.dev.: 0.0411) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.33% (0.3485 => 0.3880, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 11.17% (0.6744 => 0.7497, std.dev.: 0.0286) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.16% (0.4016 => 0.4464, std.dev.: 0.0069) SingleSource/UnitTests/ObjC++/Hello: 11.15% (0.5748 => 0.6389, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 11.11% (0.2781 => 0.3090, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 11.11% (0.8310 => 0.9233, std.dev.: 0.0215) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.04% (0.2782 => 0.3089, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.03% (0.1569 => 0.1742, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 11.01% (0.1589 => 0.1764, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.00% (0.3756 => 0.4169, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.96% (0.0976 => 0.1083, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 10.96% (0.7061 => 0.7835, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.96% (0.4390 => 0.4871, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists: 10.87% (0.3293 => 0.3651, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.87% (0.1435 => 0.1591, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.81% (0.2321 => 0.2572, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.79% (0.3022 => 0.3348, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 10.76% (3.1889 => 3.5319, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.75% (0.3580 => 0.3965, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 10.73% (0.3868 => 0.4283, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 10.70% (0.4113 => 0.4553, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 10.68% (4.3801 => 4.8480, std.dev.: 0.1225) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.66% (0.3489 => 0.3861, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 10.66% (3.6692 => 4.0604, std.dev.: 0.1028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 10.65% (4.4433 => 4.9167, std.dev.: 0.1216) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.59% (0.6135 => 0.6785, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/sieve: 10.57% (0.3453 => 0.3818, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.55% (0.2655 => 0.2935, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 10.54% (16.6129 => 18.3644, std.dev.: 0.3819) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.52% (0.2966 => 0.3278, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 10.51% (0.2607 => 0.2881, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 10.45% (0.2726 => 0.3011, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 10.45% (2.1791 => 2.4068, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/random: 10.41% (0.2690 => 0.2970, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.39% (0.8698 => 0.9602, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: 10.36% (0.2761 => 0.3047, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.35% (1.9828 => 2.1881, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/except: 10.29% (0.2760 => 0.3044, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/lists1: 10.24% (0.3534 => 0.3896, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 10.24% (0.2628 => 0.2897, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 10.21% (0.2937 => 0.3237, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 10.19% (0.3149 => 0.3470, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.09% (0.2765 => 0.3044, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 10.04% (0.3107 => 0.3419, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.03% (0.2243 => 0.2468, std.dev.: 0.0072) MultiSource/Benchmarks/sim/sim: 9.87% (0.3131 => 0.3440, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.87% (0.2696 => 0.2962, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.83% (0.3755 => 0.4124, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 9.81% (0.3192 => 0.3505, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.80% (4.9865 => 5.4752, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/matrix: 9.74% (0.2988 => 0.3279, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: 9.68% (0.1385 => 0.1519, std.dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: 9.51% (14.8535 => 16.2657, std.dev.: 0.0193) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.43% (0.3511 => 0.3842, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/objinst: 9.41% (0.2945 => 0.3222, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.38% (0.6576 => 0.7193, std.dev.: 0.0144) MultiSource/Applications/SIBsim4/SIBsim4: 9.37% (1.2749 => 1.3943, std.dev.: 0.0073) MultiSource/Benchmarks/nbench/nbench: 9.18% (1.0594 => 1.1566, std.dev.: 0.0277) MultiSource/Applications/lua/lua: 9.04% (3.7467 => 4.0853, std.dev.: 0.0930) MultiSource/Benchmarks/Ptrdist/bc/bc: 9.01% (1.1333 => 1.2354, std.dev.: 0.0369) MultiSource/Benchmarks/mafft/pairlocalalign: 8.92% (8.4961 => 9.2541, std.dev.: 0.0208) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.51% (0.9108 => 0.9883, std.dev.: 0.0185) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.50% (1.5188 => 1.6479, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 8.48% (0.6250 => 0.6780, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 8.45% (6.5754 => 7.1311, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.41% (0.3245 => 0.3518, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.22% (6.2785 => 6.7948, std.dev.: 0.1422) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.05% (0.4805 => 0.5192, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.03% (0.2504 => 0.2705, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.02% (0.8818 => 0.9525, std.dev.: 0.0188) MultiSource/Applications/oggenc/oggenc: 8.00% (4.6629 => 5.0359, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/oourafft: 7.97% (0.2008 => 0.2168, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.97% (3.2742 => 3.5350, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.57% (2.1007 => 2.2598, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.43% (13.2842 => 14.2717, std.dev.: 0.3805) SingleSource/UnitTests/ObjC/parameter-passing: 7.24% (0.4003 => 0.4293, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 7.03% (0.3914 => 0.4189, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 7.01% (0.3940 => 0.4216, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.84% (0.3789 => 0.4048, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 6.79% (0.3578 => 0.3821, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 6.77% (0.3646 => 0.3893, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/exceptions-2: 6.72% (0.3601 => 0.3843, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 6.69% (0.3663 => 0.3908, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.68% (0.3650 => 0.3894, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 6.57% (0.3623 => 0.3861, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/ReedSolomon: 6.36% (0.1777 => 0.1890, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 5.98% (0.2859 => 0.3030, std.dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: 5.62% (16.2614 => 17.1757, std.dev.: 0.0345) MultiSource/Applications/ClamAV/clamscan: 5.59% (14.5298 => 15.3414, std.dev.: 0.0117) MultiSource/Benchmarks/Bullet/bullet: 2.78% (33.2944 => 34.2212, std.dev.: 0.0336) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.24% (0.1824 => 0.3543, std.dev.: 0.0093) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.97% (0.4846 => 0.6977, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 30.54% (5.7573 => 7.5154, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/fbench: 24.24% (1.8175 => 2.2580, std.dev.: 0.0499) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.07% (1.0895 => 1.2755, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/richards_benchmark: 11.06% (1.1560 => 1.2838, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1921, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 9.04% (0.8273 => 0.9021, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.85% (0.1322 => 0.1439, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-4: 6.54% (1.0640 => 1.1336, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 5.47% (1.2998 => 1.3709, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.45% (0.9692 => 1.0220, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.97% (0.3458 => 0.3630, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.78% (0.3139 => 0.3289, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0047, std.dev.: 0.0007) SingleSource/Regression/C/uint64_to_float: 4.51% (0.5449 => 0.5695, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.50% (2.8606 => 2.9893, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.92% (1.7081 => 1.7751, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.74% (10.7476 => 11.1500, std.dev.: 0.0529) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6790, std.dev.: 0.0292) MultiSource/Applications/hexxagon/hexxagon: 3.47% (12.0921 => 12.5111, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-6: 3.43% (1.9199 => 1.9857, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0310 => 1.0559, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: 2.26% (1.9863 => 2.0312, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.15% (7.4271 => 7.5867, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 1.47% (8.3908 => 8.5142, std.dev.: 0.0361) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.37% (1.9433 => 1.9700, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.30% (3.1720 => 3.2132, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1883, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 1.20% (5.5130 => 5.5794, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 1.12% (3.1071 => 3.1420, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.03% (9.9194 => 10.0216, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/queens: 1.02% (2.1753 => 2.1974, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -45.77% (0.2670 => 0.1448, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.15% (0.4657 => 0.3905) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.36% (1.3813 => 1.2382, std.dev.: 0.0395) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.99% (1.3819 => 1.2438, std.dev.: 0.0314) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -99.99% (8.6002 => 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.24% (1.0460 => 0.8552, std.dev.: 0.0128) MultiSource/Benchmarks/FreeBench/mason/mason: -12.87% (0.2238 => 0.1950, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.01% (20.3410 => 18.3053, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/flops-3: -6.23% (2.4152 => 2.2648, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8099, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -5.77% (1.2308 => 1.1598, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.47% (1.3780 => 1.3026, std.dev.: 0.0116) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3745, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -4.98% (2.6470 => 2.5153, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.83% (0.9996 => 0.9513, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/perlin: -4.46% (6.2497 => 5.9712, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -2.88% (3.2729 => 3.1786, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/bh/bh: -2.69% (1.9762 => 1.9231, std.dev.: 0.0192) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.66% (4.1080 => 3.9989, std.dev.: 0.0027) MultiSource/Benchmarks/sim/sim: -2.64% (5.0168 => 4.8843, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4786, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -2.33% (1.3891 => 1.3567) MultiSource/Applications/spiff/spiff: -2.32% (3.0263 => 2.9561, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.02% (0.6589 => 0.6456, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.77% (0.6615 => 0.6498, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: -1.69% (6.3560 => 6.2487, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.67% (2.5254 => 2.4832, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -1.64% (3.4016 => 3.3458) SingleSource/Benchmarks/Misc/ReedSolomon: -1.52% (7.1097 => 7.0019, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: -1.41% (28.2225 => 27.8236, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/heapsort: -1.29% (3.9173 => 3.8666, std.dev.: 0.0072) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.19% (6.6320 => 6.5528, std.dev.: 0.0263) MultiSource/Applications/lambda-0_1_3/lambda: -1.17% (5.3167 => 5.2545, std.dev.: 0.0113) MultiSource/Benchmarks/PAQ8p/paq8p: -1.06% (84.4286 => 83.5360, std.dev.: 0.0070) MultiSource/Applications/aha/aha: -1.05% (3.1476 => 3.1144, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: -1.02% (4.4810 => 4.4353, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 23 02:04:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 23 Oct 2012 04:04:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121023090427.D642B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5121?compare_to=5118&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5121, Order: 166471, Start Time: 2012-10-23 07:45:45, End Time: 2012-10-23 09:06:30 To: 5118, Order: 166467, Start Time: 2012-10-23 05:53:09, End Time: 2012-10-23 07:15:52 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (5 on baseline) Performance Regressions: 2 (198 on baseline) Performance Improvements: 1 (47 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 88 (14 on baseline) Unchanged Tests: 951 (642 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 24.01% (0.3961 => 0.4912, std.dev.: 0.0328) MultiSource/Benchmarks/Olden/power/power: 9.91% (0.1675 => 0.1841, std.dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.48% (15.9210 => 15.6846, std.dev.: 0.0019) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.06% (0.6275 => 0.6271, std.dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: 0.17% (17.2388 => 17.2688, std.dev.: 0.0236) MultiSource/Applications/kimwitu++/kc: -0.07% (15.6125 => 15.6017, std.dev.: 0.0086) MultiSource/Benchmarks/Bullet/bullet: 0.28% (56.2357 => 56.3908, std.dev.: 0.0604) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.61% (0.0488 => 0.0485, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.41% (0.0488 => 0.0486, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.44% (0.0457 => 0.0455, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.44% (0.0458 => 0.0456, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.45% (0.0447 => 0.0445, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.45% (0.0447 => 0.0445, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.23% (0.0439 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.45% (0.0440 => 0.0438) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.22% (0.0457 => 0.0456, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.44% (0.0458 => 0.0456, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.66% (0.0452 => 0.0449, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.44% (0.0452 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.23% (0.0443 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.45% (0.0443 => 0.0441) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.45% (0.0449 => 0.0447) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.45% (0.0449 => 0.0447, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.65% (0.0460 => 0.0457, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.90% (0.0461 => 0.0479, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.23% (0.0436 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.68% (0.0438 => 0.0435, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.67% (0.0449 => 0.0446, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.67% (0.0450 => 0.0447) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.45% (0.0440 => 0.0438, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.68% (0.0441 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.23% (0.0432 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.46% (0.0433 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0431 => 0.0431) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.46% (0.0432 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.43% (0.0468 => 0.0466, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.64% (0.0469 => 0.0466, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.23% (0.0430 => 0.0429) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.46% (0.0431 => 0.0429, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.46% (0.0432 => 0.0430, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.46% (0.0433 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.46% (0.0439 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.45% (0.0440 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.06% (1.4950 => 1.4941, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.48% (8.2062 => 8.2460, std.dev.: 0.0182) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.35% (0.6864 => 0.6888, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1436 => 0.1436, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.71% (0.0647 => 0.0671, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -10.84% (63.2438 => 56.3908, std.dev.: 0.0604) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/MallocBench/gs/gs: 13.51% (4.1105 => 4.6658, std.dev.: 0.0134) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.79% (3.4629 => 5.8103, std.dev.: 0.0027) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13490.00% (0.0720 => 9.7848, std.dev.: 0.0079) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049500.00% (0.0001 => 10.0496, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 67.15% (0.2554 => 0.4269, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/lowercase: 58.20% (0.0256 => 0.0405, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 51.29% (10.3673 => 15.6846, std.dev.: 0.0019) SingleSource/UnitTests/SignlessTypes/factor: 46.28% (0.0296 => 0.0433, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 44.33% (0.1622 => 0.2341, std.dev.: 0.0009) SingleSource/Regression/C/sumarray2d: 43.17% (0.0271 => 0.0388, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.02% (1.5859 => 2.2365, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: 37.22% (0.1056 => 0.1449, std.dev.: 0.0009) SingleSource/UnitTests/vla: 33.24% (0.0355 => 0.0473, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.17% (2.2024 => 2.8668, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 27.85% (0.1440 => 0.1841, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: 26.52% (0.1463 => 0.1851, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 23.92% (0.0439 => 0.0544, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/objinst: 23.89% (0.0427 => 0.0529, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 23.14% (0.0834 => 0.1027, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: 21.43% (0.2049 => 0.2488, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: 21.24% (0.0485 => 0.0588, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.07% (0.1566 => 0.1896, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 19.94% (0.1555 => 0.1865, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.40% (7.0540 => 8.4225, std.dev.: 0.0195) SingleSource/Benchmarks/Misc/flops: 19.27% (0.1432 => 0.1708, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.48% (0.0871 => 0.1032, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.36% (0.0648 => 0.0767, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 18.14% (0.5105 => 0.6031, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.38% (2.2022 => 2.5850, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.35% (0.6675 => 0.7833, std.dev.: 0.0075) SingleSource/Benchmarks/McGill/chomp: 17.22% (0.1655 => 0.1940, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 17.02% (3.3354 => 3.9032, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.94% (0.4615 => 0.5397, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: 16.77% (0.0626 => 0.0731, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 16.68% (0.1175 => 0.1371, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.62% (0.8172 => 0.9530, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.60% (1.3050 => 1.5216, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.52% (0.0793 => 0.0924, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 16.40% (0.1695 => 0.1973, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/mst/mst: 16.34% (0.1163 => 0.1353, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.34% (0.2271 => 0.2642, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.16% (0.0730 => 0.0848, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.00% (0.5020 => 0.5823, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.93% (0.1337 => 0.1550, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.76% (1.5415 => 1.7844, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.70% (0.1032 => 0.1194, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.65% (0.1029 => 0.1190, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.46% (0.0886 => 0.1023, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 15.39% (0.7115 => 0.8210, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/18-imp/imp: 15.37% (0.3423 => 0.3949, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.33% (0.2107 => 0.2430, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.30% (0.1510 => 0.1741, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 15.25% (10.4361 => 12.0281, std.dev.: 0.0237) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 15.22% (0.1906 => 0.2196, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 15.21% (0.3109 => 0.3582, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.20% (0.0842 => 0.0970, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.10% (0.1940 => 0.2233, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/17-bintr/bintr: 14.96% (0.0675 => 0.0776, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.91% (0.9765 => 1.1221, std.dev.: 0.0050) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.90% (0.3121 => 0.3586, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.81% (0.0770 => 0.0884, std.dev.: 0.0017) MultiSource/Applications/Burg/burg: 14.77% (1.1642 => 1.3362, std.dev.: 0.0077) MultiSource/Applications/spiff/spiff: 14.69% (0.7835 => 0.8986, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 14.60% (0.1438 => 0.1648, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.56% (4.2646 => 4.8854, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/matrix: 14.43% (0.0818 => 0.0936, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.42% (0.6450 => 0.7380, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.39% (0.2758 => 0.3155, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.32% (0.1117 => 0.1277, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/exptree: 14.25% (0.0814 => 0.0930, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 14.20% (0.3282 => 0.3748, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.08% (0.5860 => 0.6685, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.08% (0.0746 => 0.0851, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 14.07% (0.1151 => 0.1313, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.02% (0.1584 => 0.1806, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.00% (0.2065 => 0.2354, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.99% (8.1363 => 9.2744, std.dev.: 0.0223) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.96% (0.0838 => 0.0955, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.96% (0.5981 => 0.6816, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.83% (0.1236 => 0.1407, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 13.83% (9.4845 => 10.7959, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.83% (0.0933 => 0.1062, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.73% (1.4186 => 1.6134, std.dev.: 0.0063) MultiSource/Applications/treecc/treecc: 13.70% (2.0273 => 2.3050, std.dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: 13.66% (0.7433 => 0.8448, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.64% (0.0770 => 0.0875, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.54% (0.5569 => 0.6323, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.53% (0.1330 => 0.1510, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 13.52% (1.1840 => 1.3441, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.51% (0.1695 => 0.1924, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.34% (0.8067 => 0.9143, std.dev.: 0.0100) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 13.33% (0.1125 => 0.1275, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.28% (0.0798 => 0.0904, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.28% (0.1062 => 0.1203, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 13.24% (5.7591 => 6.5217, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.17% (1.7609 => 1.9928, std.dev.: 0.0035) SingleSource/UnitTests/SignlessTypes/rem: 13.11% (0.1144 => 0.1294, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 13.09% (0.1268 => 0.1434, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.07% (0.2700 => 0.3053, std.dev.: 0.0035) MultiSource/Applications/lemon/lemon: 12.98% (1.0722 => 1.2114, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 12.85% (3.8723 => 4.3698, std.dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.80% (0.1625 => 0.1833, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.75% (0.4879 => 0.5501, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.70% (0.0929 => 0.1047, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.66% (4.9449 => 5.5711, std.dev.: 0.0092) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.60% (5.0018 => 5.6322, std.dev.: 0.0136) MultiSource/Benchmarks/McCat/05-eks/eks: 12.58% (0.4299 => 0.4840, std.dev.: 0.0021) MultiSource/Benchmarks/sim/sim: 12.55% (0.3387 => 0.3812, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.52% (1.1861 => 1.3346, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 12.48% (0.3092 => 0.3478, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 12.32% (0.8921 => 1.0020, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.31% (0.3307 => 0.3714, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.29% (0.3441 => 0.3864, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 12.24% (0.3177 => 0.3566, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.18% (0.2603 => 0.2920, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.07% (7.9617 => 8.9229, std.dev.: 0.0098) MultiSource/Benchmarks/McCat/09-vor/vor: 11.98% (0.3180 => 0.3561, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.69% (0.8101 => 0.9048, std.dev.: 0.0035) MultiSource/Applications/hbd/hbd: 11.58% (1.5603 => 1.7410, std.dev.: 0.0087) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.11% (0.1143 => 0.1270, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 10.69% (0.6456 => 0.7146, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 10.60% (2.2969 => 2.5403, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.37% (0.2266 => 0.2501, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.25% (0.1892 => 0.2086, std.dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 10.07% (21.9371 => 24.1459, std.dev.: 0.0222) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 9.87% (0.1044 => 0.1147, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 9.56% (0.4289 => 0.4699, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-4: 9.46% (0.3543 => 0.3878, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 9.42% (0.3927 => 0.4297, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.42% (0.3473 => 0.3800, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 9.39% (0.4620 => 0.5054, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 9.29% (0.3694 => 0.4037, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.23% (0.3543 => 0.3870, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 9.21% (0.3497 => 0.3819, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.20% (0.3828 => 0.4180, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.10% (0.3516 => 0.3836, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.10% (0.3561 => 0.3885, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.05% (0.3427 => 0.3737, std.dev.: 0.0078) SingleSource/UnitTests/ObjC/property: 9.03% (0.3886 => 0.4237, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.87% (0.3865 => 0.4208, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.83% (0.3826 => 0.4164, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.80% (0.4203 => 0.4573, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 8.77% (17.1811 => 18.6886, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/lists: 8.74% (0.3422 => 0.3721, std.dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.54% (0.4636 => 0.5032, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.48% (0.2430 => 0.2636, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.34% (0.4103 => 0.4445, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/moments: 8.25% (0.4048 => 0.4382, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 8.09% (0.3684 => 0.3982, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.94% (14.3668 => 15.5070, std.dev.: 0.0081) SingleSource/UnitTests/ObjC++/property-reference-object: 7.93% (0.6030 => 0.6508, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.85% (0.5925 => 0.6390, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.82% (3.8922 => 4.1966, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sieve: 7.58% (0.3603 => 0.3876, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference: 7.36% (0.7326 => 0.7865, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.04% (0.3650 => 0.3907, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.96% (0.4064 => 0.4347, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 6.75% (0.3098 => 0.3307, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.68% (0.2891 => 0.3084, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.50% (0.3232 => 0.3442, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.45% (0.3162 => 0.3366, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.44% (0.3136 => 0.3338, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 6.39% (0.2831 => 0.3012, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.37% (0.2793 => 0.2971, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 6.37% (0.2905 => 0.3090, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: 6.28% (0.2725 => 0.2896, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 6.27% (0.3283 => 0.3489, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.26% (2.0665 => 2.1958, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.20% (0.2756 => 0.2927, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 6.19% (0.3052 => 0.3241, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.09% (0.2872 => 0.3047, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 6.03% (1.2842 => 1.3617, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/except: 6.03% (0.2871 => 0.3044, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 5.94% (0.2877 => 0.3048, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 5.86% (0.2714 => 0.2873, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 5.85% (0.2802 => 0.2966, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.83% (0.3379 => 0.3576, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 5.01% (0.3131 => 0.3288, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.80% (1.1194 => 1.1507, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8953, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1727, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.37% (0.9957 => 1.1288, std.dev.: 0.0172) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.79% (1.1396 => 1.2512, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (3.1578 => 3.3678, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: 5.93% (1.9405 => 2.0556, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.87% (0.4162 => 0.4323, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.58% (0.3987 => 0.4090, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.49% (4.2280 => 4.3332, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.40% (1.0313 => 1.0561, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.10% (3.6395 => 3.7159, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bisort/bisort: 1.81% (0.8333 => 0.8484, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2076, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 1.27% (4.4649 => 4.5218, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.25% (2.6546 => 2.6877, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.09% (6.5088 => 6.5795, std.dev.: 0.0069) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.01% (6.6874 => 0.1331, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -79.61% (0.8651 => 0.1764, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.33% (5.2763 => 3.2011, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.15% (5.3855 => 3.7079, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.65% (5.3526 => 3.7120, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -14.50% (54.1659 => 46.3118, std.dev.: 0.0264) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.69% (2.9384 => 2.6244, std.dev.: 0.0032) MultiSource/Applications/ClamAV/clamscan: -5.36% (22.1758 => 20.9867, std.dev.: 0.0359) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.08% (8.0499 => 3.7769, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.45% (1.1492 => 0.7648, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.64% (2.9695 => 2.4754, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.51% (1.6925 => 1.4300, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.69% (1.2258 => 1.0703, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -12.57% (1.2373 => 1.0818, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/mandel-2: -10.84% (1.5373 => 1.3707, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.31% (19.9488 => 18.2909, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/mason/mason: -7.68% (0.2161 => 0.1995, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.98% (1.8329 => 1.7050, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0149) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.15% (1.6805 => 1.5940, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.68% (1.5835 => 1.5094, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.31% (8.1563 => 7.8047, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.63% (3.2827 => 3.1637, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8776, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5083, std.dev.: 0.0050) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.50% (0.4808 => 0.4688, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -2.30% (4.6441 => 4.5374, std.dev.: 0.0018) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0856, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6835, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5095, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -1.64% (1.1277 => 1.1092) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4203, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/lists: -1.20% (6.2999 => 6.2246, std.dev.: 0.0110) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2879, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8581, std.dev.: 0.0052) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 19.93% (0.5229 => 0.6271, std.dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: 15.21% (14.9895 => 17.2688, std.dev.: 0.0236) MultiSource/Applications/kimwitu++/kc: 10.22% (14.1553 => 15.6017, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 35.24% (1.1048 => 1.4941, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 15.20% (7.1582 => 8.2460, std.dev.: 0.0182) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.70% (0.6222 => 0.6888, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.30% (0.1485 => 0.1436, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.29% (0.2116 => 0.0671, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 23 02:17:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 23 Oct 2012 04:17:00 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121023091700.730BF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5122?compare_to=5119&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5122, Order: 166471, Start Time: 2012-10-23 07:55:36, End Time: 2012-10-23 09:19:03 To: 5119, Order: 166467, Start Time: 2012-10-23 06:15:25, End Time: 2012-10-23 07:38:56 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 8 (21 on baseline) Performance Improvements: 5 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 962 (949 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.59% (0.6074 => 0.6292, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.68% (0.6161 => 0.6326, std.dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 2.66% (0.7408 => 0.7605, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.15% (0.6320 => 0.6456, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.54% (8.6090 => 8.7417, std.dev.: 0.0347) MultiSource/Applications/minisat/minisat: 1.47% (0.6791 => 0.6891, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.32% (1.1173 => 1.1321, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.08% (4.4800 => 4.5286, std.dev.: 0.0151) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.66% (0.8937 => 0.8789, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.52% (0.9225 => 0.9085, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.31% (1.0038 => 0.9907, std.dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.31% (10.0045 => 9.8730, std.dev.: 0.0484) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.17% (6.2673 => 6.1940, std.dev.: 0.0241) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.71% (16.4520 => 16.5693, std.dev.: 0.0678) MultiSource/Applications/obsequi/Obsequi: -0.51% (1.0539 => 1.0485, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: -0.42% (0.6401 => 0.6374, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/08-main/main: -6.50% (0.1938 => 0.1812, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.23% (0.1659 => 0.1696, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.87% (0.3211 => 0.3239, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.78% (0.2440 => 0.2459, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.08% (0.3332 => 0.3296, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.99% (0.2342 => 0.2412, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/bigfib: 0.27% (0.5970 => 0.5986, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel: 18.05% (0.0421 => 0.0497, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.06% (0.3292 => 0.3294, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/strcat: 1.78% (0.1962 => 0.1997, std.dev.: 0.0015) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 41.95% (0.0174 => 0.0247, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -2.33% (0.0215 => 0.0210, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -14.15% (0.0424 => 0.0364, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0329 => 0.0329, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.32% (0.0310 => 0.0311, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0421 => 0.0421, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -16.18% (0.0204 => 0.0171, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/test1: -7.87% (0.0216 => 0.0199, std.dev.: 0.0013) SingleSource/UnitTests/byval-alignment: 2.97% (0.0337 => 0.0347, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.14% (0.1474 => 0.1472, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -0.48% (1.1504 => 1.1449, std.dev.: 0.0112) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 2.31% (0.1427 => 0.1460, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.83% (0.4130 => 0.3972, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.68% (0.1440 => 0.1387, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.14% (0.0612 => 0.0619, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.88% (0.0227 => 0.0225, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 7.26% (0.0537 => 0.0576, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.29% (1.1460 => 1.1427, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -87.50% (0.0008 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.14% (0.0560 => 0.0628, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -24.45% (0.0229 => 0.0173, std.dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.05% (0.8022 => 0.8018, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 57.14% (0.0049 => 0.0077, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.25% (2.1832 => 1.6538, std.dev.: 0.0133) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.05% (0.0810 => 0.0940, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 10.70% (0.1112 => 0.1231, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.62% (0.8321 => 0.8789, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.51% (0.7473 => 0.7885, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.69% (0.6010 => 0.6292, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.23% (1.4479 => 1.4946, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.69% (0.6287 => 0.6456, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.20% (0.4783 => 0.4888, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: 1.37% (0.9810 => 0.9944, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.35% (1.1170 => 1.1321, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.09% (8.6476 => 8.7417, std.dev.: 0.0347) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.22% (1.5795 => 2.4991, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.99% (0.3186 => 0.3536, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.42% (1.1857 => 1.2855, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 5.93% (63.1822 => 66.9305, std.dev.: 0.0935) SingleSource/Benchmarks/Misc/ReedSolomon: 3.43% (8.5322 => 8.8248, std.dev.: 0.0322) MultiSource/Applications/siod/siod: 2.55% (3.6643 => 3.7577, std.dev.: 0.0111) SingleSource/Benchmarks/CoyoteBench/lpbench: 2.34% (3.9006 => 3.9919, std.dev.: 0.0336) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.34% (2.4490 => 2.5063, std.dev.: 0.0194) MultiSource/Benchmarks/Olden/bh/bh: 1.72% (2.3560 => 2.3965, std.dev.: 0.0073) MultiSource/Benchmarks/Bullet/bullet: 1.05% (7.1181 => 7.1927, std.dev.: 0.0194) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.33% (0.3269 => 0.2964, std.dev.: 0.0027) MultiSource/Applications/lua/lua: -4.84% (29.8330 => 28.3904, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/hash2: -1.46% (3.4237 => 3.3737, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.21% (3.3479 => 3.3075, std.dev.: 0.0025) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.75% (16.4461 => 16.5693, std.dev.: 0.0678) MultiSource/Applications/obsequi/Obsequi: 2.17% (1.0262 => 1.0485, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: 0.66% (0.6332 => 0.6374, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/08-main/main: -1.04% (0.1831 => 0.1812, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 8.79% (0.1559 => 0.1696, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.71% (0.3123 => 0.3239, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.16% (0.2463 => 0.2459, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.44% (0.3344 => 0.3296, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (0.2364 => 0.2412, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/bigfib: -0.40% (0.6010 => 0.5986, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel: 15.85% (0.0429 => 0.0497, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.86% (0.3266 => 0.3294, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/strcat: 1.42% (0.1969 => 0.1997, std.dev.: 0.0015) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 10.27% (0.0224 => 0.0247, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 70.73% (0.0123 => 0.0210, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -10.78% (0.0408 => 0.0364, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.53% (0.0254 => 0.0329, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.98% (0.0302 => 0.0311, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.64% (0.0384 => 0.0421, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -10.00% (0.0190 => 0.0171, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/test1: 10.56% (0.0180 => 0.0199, std.dev.: 0.0013) SingleSource/UnitTests/byval-alignment: 50.87% (0.0230 => 0.0347, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.36% (0.1438 => 0.1472, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 1.06% (1.1329 => 1.1449, std.dev.: 0.0112) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -0.14% (0.1462 => 0.1460, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.61% (0.4164 => 0.3972, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.31% (0.1369 => 0.1387, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.43% (0.0641 => 0.0619, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 15.38% (0.0195 => 0.0225, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.35% (0.0578 => 0.0576, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.09% (1.1437 => 1.1427, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.16% (0.0627 => 0.0628, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.89% (0.0180 => 0.0173, std.dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.01% (0.8017 => 0.8018, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 24.19% (0.0062 => 0.0077, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 23 03:09:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 23 Oct 2012 05:09:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121023100947.7E6942A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5123?compare_to=5116&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5123, Order: 166467, Start Time: 2012-10-23 06:52:57, End Time: 2012-10-23 10:11:50 To: 5116, Order: 166459, Start Time: 2012-10-23 02:46:18, End Time: 2012-10-23 06:04:56 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (170 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1041 (720 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.21% (21.6956 => 21.9586, std.dev.: 0.0299) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.92% (0.0625 => 0.0887, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.21% (0.1063 => 0.1416, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.49% (0.1106 => 0.1399, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.34% (0.2969 => 0.3751, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.05% (0.0714 => 0.0900, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 25.22% (0.0452 => 0.0566, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 24.82% (0.0947 => 0.1182, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.79% (0.4139 => 0.5165, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 24.75% (1.5932 => 1.9875, std.dev.: 0.0150) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.59% (0.5900 => 0.7351, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.29% (0.4994 => 0.6207, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.79% (0.0475 => 0.0588, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.56% (0.5000 => 0.6178, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.22% (0.0547 => 0.0674, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.12% (0.0584 => 0.0719, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.09% (0.1620 => 0.1994, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.82% (0.1021 => 0.1254, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.76% (0.1107 => 0.1359, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 22.76% (0.4253 => 0.5221, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.59% (0.0642 => 0.0787, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 22.20% (0.0599 => 0.0732, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.96% (0.0897 => 0.1094, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.64% (0.0633 => 0.0770, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 21.62% (0.0948 => 0.1153, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.49% (0.1103 => 0.1340, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.23% (0.0584 => 0.0708, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.88% (0.3903 => 0.4718, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: 20.83% (0.0821 => 0.0992, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.64% (0.1003 => 0.1210, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.56% (0.0822 => 0.0991, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.52% (0.0541 => 0.0652, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 20.44% (0.1619 => 0.1950, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.40% (0.1549 => 0.1865, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.20% (0.1604 => 0.1928, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 20.20% (0.0604 => 0.0726, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.41% (0.2014 => 0.2405, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.02% (0.3890 => 0.4630, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.81% (0.1462 => 0.1737, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 18.80% (0.1218 => 0.1447, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 18.80% (0.5826 => 0.6921, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 18.58% (0.5889 => 0.6983, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 18.47% (0.4029 => 0.4773, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 18.44% (0.0808 => 0.0957, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.44% (1.3152 => 1.5577, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.38% (0.2736 => 0.3239, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: 18.34% (0.1505 => 0.1781, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ackermann: 18.30% (0.2738 => 0.3239, std.dev.: 0.0061) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.21% (0.0582 => 0.0688, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/mst/mst: 18.05% (0.0698 => 0.0824, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.00% (3.5627 => 4.2041, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.93% (0.2866 => 0.3380, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.83% (0.0572 => 0.0674, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 17.78% (1.8794 => 2.2135, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.67% (0.2875 => 0.3383, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/reversefile: 17.67% (0.3690 => 0.4342, std.dev.: 0.0104) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.65% (0.1088 => 0.1280, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.63% (0.0573 => 0.0674, std.dev.: 0.0016) MultiSource/Applications/Burg/burg: 17.62% (0.5546 => 0.6523, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 17.52% (0.9697 => 1.1396, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.50% (0.1160 => 0.1363, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 17.45% (0.2803 => 0.3292, std.dev.: 0.0168) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.43% (1.6211 => 1.9037, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/fibo: 17.28% (0.2725 => 0.3196, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.23% (0.1968 => 0.2307, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.12% (0.3930 => 0.4603, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 17.12% (0.7171 => 0.8399, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: 17.11% (0.2811 => 0.3292, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/18-imp/imp: 17.10% (0.1421 => 0.1664, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 17.10% (0.2714 => 0.3178, std.dev.: 0.0171) SingleSource/Benchmarks/Shootout-C++/matrix: 17.05% (0.2780 => 0.3254, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.00% (2.0673 => 2.4188, std.dev.: 0.0029) SingleSource/Regression/C++/ofstream_ctor: 16.98% (0.3004 => 0.3514, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.93% (2.7292 => 3.1913, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.93% (0.2729 => 0.3191, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.91% (0.5026 => 0.5876, std.dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 16.87% (0.9909 => 1.1581, std.dev.: 0.0051) MultiSource/Applications/d/make_dparser: 16.87% (1.0781 => 1.2600, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.85% (0.4658 => 0.5443, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/strcat: 16.80% (0.2750 => 0.3212, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.76% (0.4361 => 0.5092, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.76% (0.2792 => 0.3260, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.73% (0.2911 => 0.3398, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.72% (0.3271 => 0.3818, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 16.71% (0.2813 => 0.3283, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/wc: 16.70% (0.3096 => 0.3613, std.dev.: 0.0145) SingleSource/UnitTests/ObjC/instance-method-metadata: 16.66% (0.3488 => 0.4069, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.62% (0.3195 => 0.3726, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/objinst: 16.54% (0.2823 => 0.3290, std.dev.: 0.0114) SingleSource/UnitTests/ObjC/exceptions-2: 16.45% (0.3446 => 0.4013, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 16.45% (0.3460 => 0.4029, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 16.43% (0.1284 => 0.1495, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 16.36% (0.3496 => 0.4068, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 16.31% (0.3465 => 0.4030, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 16.30% (0.3442 => 0.4003, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 16.26% (0.3469 => 0.4033, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: 16.25% (23.5202 => 27.3428, std.dev.: 0.0236) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.21% (0.3362 => 0.3907, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 16.16% (4.2109 => 4.8915, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/ary3: 15.89% (0.3267 => 0.3786, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.78% (1.9966 => 2.3117, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/property: 15.78% (0.3650 => 0.4226, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.77% (4.4195 => 5.1163, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary: 15.75% (0.3258 => 0.3771, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 15.71% (0.3317 => 0.3838, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 15.70% (0.3643 => 0.4215, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.69% (0.3060 => 0.3540, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.67% (1.9694 => 2.2780, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.60% (0.1090 => 0.1260, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 15.52% (0.3724 => 0.4302, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 15.47% (0.2566 => 0.2963, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.33% (0.3124 => 0.3603, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.23% (0.3282 => 0.3782, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 15.20% (0.3348 => 0.3857, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/sieve: 15.11% (0.3726 => 0.4289, std.dev.: 0.0137) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.03% (0.3845 => 0.4423, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/hash: 14.91% (0.4146 => 0.4764, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.57% (0.3981 => 0.4561, std.dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C/football/football: 14.41% (0.2075 => 0.2374, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 14.32% (1.4269 => 1.6313, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash2: 14.28% (0.4251 => 0.4858, std.dev.: 0.0061) MultiSource/Applications/treecc/treecc: 14.10% (0.7875 => 0.8985, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 14.05% (0.2691 => 0.3069, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 13.70% (2.1653 => 2.4619, std.dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 13.52% (2.1013 => 2.3853, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/bigfib: 13.45% (0.5012 => 0.5686, std.dev.: 0.0241) MultiSource/Applications/JM/lencod/lencod: 13.37% (4.6177 => 5.2352, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.65% (0.2040 => 0.2298, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 12.64% (0.3498 => 0.3940, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 12.40% (5.5417 => 6.2286, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.15% (0.6435 => 0.7217, std.dev.: 0.0172) MultiSource/Applications/minisat/minisat: 11.96% (0.3336 => 0.3735, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.36% (0.2737 => 0.3048, std.dev.: 0.0083) MultiSource/Applications/siod/siod: 11.34% (0.6634 => 0.7386, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.22% (0.2068 => 0.2300, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.19% (0.1028 => 0.1143, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.57% (0.3084 => 0.3410, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.56% (0.1383 => 0.1529, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: 10.46% (0.4847 => 0.5354, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.80% (0.2103 => 0.2309, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 9.65% (2.0346 => 2.2310, std.dev.: 0.0043) MultiSource/Applications/lemon/lemon: 9.20% (0.2391 => 0.2611, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.75% (4.6926 => 5.1032, std.dev.: 0.0318) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.36% (0.5361 => 0.5809, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.19% (11.6398 => 12.5935, std.dev.: 0.0160) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.65% (0.7426 => 0.7994, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.56% (0.5584 => 0.6006, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 7.04% (11.9555 => 12.7974, std.dev.: 0.0085) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.72% (0.3792 => 0.4047, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6530, std.dev.: 0.0143) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.22% (0.5917 => 0.6699, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 8.24% (0.2802 => 0.3033, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6105, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.58% (0.3693 => 0.3899, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: 5.01% (12.0509 => 12.6549, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1669, std.dev.: 0.0217) SingleSource/Benchmarks/Misc/flops-2: 3.75% (1.8057 => 1.8734, std.dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/dry: 2.71% (14.0481 => 14.4286, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/ary3: 1.84% (15.8721 => 16.1634, std.dev.: 0.0210) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.66% (3.1722 => 3.2249, std.dev.: 0.0020) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3095, std.dev.: 0.0145) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2860, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1062, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5146, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 1.12% (50.0626 => 50.6246, std.dev.: 0.0208) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.07% (1.2451 => 1.2584, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.37% (2.4764 => 2.3683, std.dev.: 0.0202) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -36.18% (25.4195 => 16.2230, std.dev.: 0.0877) SingleSource/Benchmarks/Shootout-C++/ary2: -10.87% (0.2402 => 0.2141, std.dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: -7.70% (28.1477 => 25.9797, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -7.66% (35.5013 => 32.7807, std.dev.: 0.1095) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9585, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.29% (11.2080 => 10.8392, std.dev.: 0.0332) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7726, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel-2: -2.87% (3.6262 => 3.5221, std.dev.: 0.0100) SingleSource/Benchmarks/Dhrystone/fldry: -2.49% (17.2379 => 16.8090, std.dev.: 0.0294) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.20% (41.7953 => 40.8770, std.dev.: 0.0089) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.78% (0.6293 => 0.6181, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5728, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/bh/bh: -1.55% (5.5810 => 5.4944, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.10% (105.3826 => 104.2216, std.dev.: 0.0597) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.02% (3.3991 => 3.3645, std.dev.: 0.0039) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 23 03:11:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 23 Oct 2012 05:11:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121023101136.779D52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5124?compare_to=5120&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5124, Order: 166473, Start Time: 2012-10-23 08:46:41, End Time: 2012-10-23 10:14:37 To: 5120, Order: 166467, Start Time: 2012-10-23 06:44:38, End Time: 2012-10-23 08:16:27 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (212 on baseline) Performance Improvements: 0 (37 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1041 (655 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1.31% (7.9514 => 8.0555, std.dev.: 0.0315) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/vla: 36.73% (0.0324 => 0.0443, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/treeadd/treeadd: 25.64% (0.0390 => 0.0490, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 23.77% (2.0176 => 2.4972, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.55% (0.1410 => 0.1742, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 21.98% (0.0746 => 0.0910, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 21.93% (0.7710 => 0.9401, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 21.43% (0.0826 => 0.1003, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 21.13% (0.1013 => 0.1227, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 19.75% (0.2243 => 0.2686, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.93% (0.0618 => 0.0735, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 18.84% (0.0653 => 0.0776, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.57% (0.2596 => 0.3078, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fbench: 18.57% (0.0544 => 0.0645, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.92% (0.5637 => 0.6647, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.78% (0.0720 => 0.0848, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 17.66% (0.0770 => 0.0906, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.66% (0.0725 => 0.0853) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.52% (0.1986 => 0.2334, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.39% (0.0811 => 0.0952, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 17.35% (0.2721 => 0.3193, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.24% (0.0847 => 0.0993, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 17.15% (0.1003 => 0.1175, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.74% (0.1075 => 0.1255, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.69% (0.7460 => 0.8705, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/mst/mst: 16.47% (0.1111 => 0.1294, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.23% (0.1072 => 0.1246, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.20% (0.0648 => 0.0753, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 16.14% (0.9199 => 1.0684, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 15.95% (0.5265 => 0.6105, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 15.90% (1.3693 => 1.5870, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.89% (0.2914 => 0.3377, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: 15.83% (0.0834 => 0.0966, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.75% (0.0654 => 0.0757, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.71% (0.6959 => 0.8052, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.66% (0.0977 => 0.1130, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.64% (0.1413 => 0.1634, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 15.57% (0.1657 => 0.1915, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 15.25% (0.1062 => 0.1224, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.07% (0.1327 => 0.1527, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.07% (0.1865 => 0.2146, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.97% (0.1276 => 0.1467, std.dev.: 0.0035) MultiSource/Applications/viterbi/viterbi: 14.88% (0.1478 => 0.1698, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.79% (0.1014 => 0.1164, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.77% (0.0819 => 0.0940, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 14.68% (1.1061 => 1.2685, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.63% (0.0964 => 0.1105, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 14.61% (0.7038 => 0.8066, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.58% (3.9660 => 4.5441, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.43% (0.5577 => 0.6382, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.14% (0.2023 => 0.2309, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 14.02% (0.2925 => 0.3335, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.92% (0.3246 => 0.3698, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.78% (0.2127 => 0.2420, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 13.71% (0.7506 => 0.8535, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.65% (0.1048 => 0.1191, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 13.60% (0.1213 => 0.1378, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/exptree: 13.54% (0.0768 => 0.0872) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.53% (0.1789 => 0.2031, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.52% (1.4563 => 1.6532, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.48% (0.1157 => 0.1313, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.42% (1.1364 => 1.2889, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.41% (0.1588 => 0.1801, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.36% (1.2193 => 1.3822, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.34% (0.4379 => 0.4963, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 13.31% (3.8646 => 4.3791, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/distray/distray: 13.20% (0.0818 => 0.0926) MultiSource/Applications/SPASS/SPASS: 12.71% (13.8202 => 15.5772, std.dev.: 0.0159) MultiSource/Applications/sgefa/sgefa: 12.52% (0.2995 => 0.3370, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 12.45% (0.4328 => 0.4867, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 12.36% (0.4062 => 0.4564, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 12.27% (0.3220 => 0.3615, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.18% (0.6283 => 0.7048, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.08% (0.3899 => 0.4370, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 11.98% (7.2180 => 8.0825, std.dev.: 0.0105) SingleSource/UnitTests/ObjC++/property-reference-object: 11.96% (0.5818 => 0.6514, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 11.91% (1.9270 => 2.1565, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 11.68% (0.7061 => 0.7886, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/Hello: 11.60% (0.5748 => 0.6415, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.60% (0.3130 => 0.3493, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 11.57% (1.3245 => 1.4777, std.dev.: 0.0050) MultiSource/Applications/lemon/lemon: 11.40% (1.0313 => 1.1489, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.38% (0.4791 => 0.5336, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 11.37% (0.0976 => 0.1087, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.36% (0.2140 => 0.2383, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.22% (0.1569 => 0.1745, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 11.17% (0.6744 => 0.7497, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: 11.14% (0.1589 => 0.1766, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.07% (0.2321 => 0.2578, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.01% (0.1435 => 0.1593, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 10.97% (0.4113 => 0.4564, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.96% (0.4016 => 0.4456, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.93% (0.3485 => 0.3866, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.92% (0.3756 => 0.4166, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 10.79% (16.6129 => 18.4061, std.dev.: 0.0323) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.76% (0.6135 => 0.6795, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 10.75% (2.1791 => 2.4134, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 10.73% (3.1889 => 3.5310, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 10.72% (0.8310 => 0.9201, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.68% (0.4390 => 0.4859, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 10.67% (4.3801 => 4.8475, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 10.57% (0.2781 => 0.3075, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 10.53% (4.4433 => 4.9113, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.50% (0.2782 => 0.3074, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 10.48% (0.3293 => 0.3638, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 10.47% (3.6692 => 4.0534, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/sieve: 10.45% (0.3453 => 0.3814, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.45% (0.3580 => 0.3954, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.40% (0.3489 => 0.3852, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.39% (0.2243 => 0.2476, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.38% (0.8698 => 0.9601, std.dev.: 0.0208) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.36% (0.3022 => 0.3335, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 10.32% (0.3868 => 0.4267, std.dev.: 0.0104) SingleSource/Benchmarks/Stanford/Puzzle: 10.24% (0.0977 => 0.1077, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.23% (0.1819 => 0.2005, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 10.20% (0.2726 => 0.3004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.00% (4.9865 => 5.4851, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/methcall: 10.00% (0.2761 => 0.3037, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 9.99% (0.3534 => 0.3887, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 9.97% (0.3149 => 0.3463, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.95% (1.9828 => 2.1801, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.95% (0.2966 => 0.3261, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 9.93% (0.2607 => 0.2866, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 9.93% (0.2760 => 0.3034, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 9.89% (0.2690 => 0.2956, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.79% (0.2655 => 0.2915, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 9.74% (0.2628 => 0.2884, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 9.72% (0.3107 => 0.3409, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 9.70% (0.2937 => 0.3222, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.58% (0.2765 => 0.3030, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.51% (0.3511 => 0.3845, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.47% (0.6576 => 0.7199, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 9.44% (1.0594 => 1.1594, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.35% (0.2696 => 0.2948, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 9.34% (0.3192 => 0.3490, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 9.30% (0.2988 => 0.3266, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 9.26% (0.3131 => 0.3421, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 9.25% (1.2749 => 1.3928, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 9.21% (14.8535 => 16.2214, std.dev.: 0.0182) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.19% (0.3755 => 0.4100, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 9.13% (1.1333 => 1.2368, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 9.13% (3.7467 => 4.0888, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/objinst: 9.07% (0.2945 => 0.3212, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.88% (1.5188 => 1.6537, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 8.76% (0.2008 => 0.2184, std.dev.: 0.0065) MultiSource/Benchmarks/mafft/pairlocalalign: 8.73% (8.4961 => 9.2380, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/neural/neural: 8.66% (0.1385 => 0.1505, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.40% (0.8818 => 0.9559, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 8.40% (6.5754 => 7.1277, std.dev.: 0.0280) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.32% (0.9108 => 0.9866, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.26% (0.3245 => 0.3513, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 8.26% (0.6250 => 0.6766, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.24% (0.4805 => 0.5201, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.23% (0.2504 => 0.2710, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.10% (3.2742 => 3.5393, std.dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.01% (6.2785 => 6.7814, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.99% (2.1007 => 2.2685, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 7.73% (4.6629 => 5.0232, std.dev.: 0.0227) MultiSource/Applications/hexxagon/hexxagon: 7.66% (1.2292 => 1.3233, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.40% (13.2842 => 14.2678, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/parameter-passing: 7.04% (0.4003 => 0.4285, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 7.04% (0.3650 => 0.3907, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 6.92% (0.3914 => 0.4185, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.88% (0.3940 => 0.4211, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 6.65% (0.3578 => 0.3816, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 6.62% (0.3789 => 0.4040, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/exceptions-4: 6.53% (0.3646 => 0.3884, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 6.53% (0.3601 => 0.3836, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 6.50% (0.3663 => 0.3901, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/ReedSolomon: 6.42% (0.1777 => 0.1891, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 6.35% (0.3623 => 0.3853, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 5.57% (14.5298 => 15.3396, std.dev.: 0.0228) MultiSource/Benchmarks/Olden/bh/bh: 5.56% (0.2859 => 0.3018, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 5.54% (16.2614 => 17.1616, std.dev.: 0.0282) MultiSource/Benchmarks/Bullet/bullet: 3.05% (33.2944 => 34.3114, std.dev.: 0.0433) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.13% (0.1824 => 0.3541, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.73% (0.4846 => 0.6965, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.59% (5.7573 => 7.5186, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fbench: 24.40% (1.8175 => 2.2610, std.dev.: 0.0359) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.13% (1.0895 => 1.2761, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 11.13% (1.1560 => 1.2847, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 9.04% (0.8273 => 0.9021, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.70% (0.1322 => 0.1437, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.54% (1.0640 => 1.1336, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: 5.57% (1.2998 => 1.3722, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.46% (0.9692 => 1.0221) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.95% (0.3458 => 0.3629, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.75% (0.3139 => 0.3288, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: 4.74% (1.9144 => 2.0052, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: 4.53% (0.5449 => 0.5696, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.49% (2.8606 => 2.9891, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6791, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.46% (10.7476 => 11.1194, std.dev.: 0.0131) MultiSource/Applications/hexxagon/hexxagon: 3.44% (12.0921 => 12.5080, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: 3.40% (1.9199 => 1.9851, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bisort/bisort: 2.97% (0.8239 => 0.8484, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 2.97% (1.4298 => 1.4722, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0310 => 1.0560, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.26% (1.9863 => 2.0312, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.11% (7.4271 => 7.5839, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.50% (2.0200 => 2.0504, std.dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5135, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.39% (1.9433 => 1.9703, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.30% (3.1720 => 3.2132, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1883, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.20% (5.5130 => 5.5790, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.13% (3.1071 => 3.1423, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.06% (8.8259 => 8.9194, std.dev.: 0.0127) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.04% (9.9194 => 10.0227, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/queens: 1.02% (2.1753 => 2.1975, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -45.58% (0.2670 => 0.1453, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.34% (0.4657 => 0.3896, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.53% (1.3813 => 1.2359, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.35% (1.3819 => 1.2389, std.dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -99.99% (8.6002 => 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.25% (1.0460 => 0.8551, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/mason/mason: -12.38% (0.2238 => 0.1961, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.17% (20.3410 => 18.2728, std.dev.: 0.0182) SingleSource/Benchmarks/Misc/flops-3: -6.22% (2.4152 => 2.2649, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.18% (1.9290 => 1.8098, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.15% (1.3780 => 1.2933, std.dev.: 0.0133) SingleSource/Benchmarks/McGill/chomp: -5.90% (1.2308 => 1.1582, std.dev.: 0.0050) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3744, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -5.06% (2.6470 => 2.5130, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: -4.46% (6.2497 => 5.9712, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.24% (0.9996 => 0.9572, std.dev.: 0.0093) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.80% (1.7688 => 1.7016, std.dev.: 0.0065) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.96% (0.4867 => 0.4723, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -2.85% (3.2729 => 3.1796, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: -2.80% (1.9762 => 1.9209, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.78% (4.1080 => 3.9939, std.dev.: 0.0041) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8814, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4785, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.33% (1.3891 => 1.3567, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.27% (3.0263 => 2.9577, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.19% (0.6615 => 0.6470, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/partialsums: -2.02% (0.6589 => 0.6456, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.64% (3.4016 => 3.3457, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.64% (2.5254 => 2.4839, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -1.59% (6.3560 => 6.2549, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: -1.56% (4.5928 => 4.5210, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/ReedSolomon: -1.52% (7.1097 => 7.0017, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -1.41% (28.2225 => 27.8243, std.dev.: 0.0025) MultiSource/Applications/lua/lua: -1.22% (26.5159 => 26.1934, std.dev.: 0.0188) MultiSource/Applications/aha/aha: -1.06% (3.1476 => 3.1142, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -1.05% (84.4286 => 83.5411, std.dev.: 0.0089) MultiSource/Applications/lambda-0_1_3/lambda: -1.04% (5.3167 => 5.2613, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 3.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 23 13:55:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 23 Oct 2012 15:55:46 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121023205546.DA4662A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5137?compare_to=5135&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5137, Order: 166492, Start Time: 2012-10-23 19:33:19, End Time: 2012-10-23 20:57:52 To: 5135, Order: 166485, Start Time: 2012-10-23 17:51:55, End Time: 2012-10-23 19:16:29 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 14 (37 on baseline) Performance Improvements: 2 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 959 (933 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/12-IOtest/iotest: 15.30% (0.0758 => 0.0874, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.50% (0.9640 => 0.9977, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.15% (0.7680 => 0.7922, std.dev.: 0.0041) MultiSource/Applications/Burg/burg: 2.77% (1.2287 => 1.2627, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.35% (0.6246 => 0.6393, std.dev.: 0.0022) MultiSource/Applications/lua/lua: 2.15% (3.8389 => 3.9215, std.dev.: 0.0128) MultiSource/Applications/hexxagon/hexxagon: 2.15% (0.9789 => 0.9999, std.dev.: 0.0077) MultiSource/Benchmarks/MallocBench/gs/gs: 1.46% (4.1730 => 4.2341, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.26% (0.8119 => 0.8221, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.24% (1.2576 => 1.2732, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.39% (1.2448 => 1.2745, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.10% (60.0677 => 61.3305, std.dev.: 0.1133) SingleSource/Benchmarks/Shootout/methcall: 1.08% (8.1495 => 8.2374, std.dev.: 0.0290) SingleSource/Benchmarks/Misc/ReedSolomon: 1.04% (8.7396 => 8.8306, std.dev.: 0.0087) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.69% (46.1582 => 44.9164, std.dev.: 0.4321) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.35% (1.1605 => 1.1332, std.dev.: 0.0020) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.81% (16.4463 => 16.5801, std.dev.: 0.1672) MultiSource/Applications/obsequi/Obsequi: 3.00% (1.0294 => 1.0603, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: 2.44% (0.6321 => 0.6475, std.dev.: 0.0094) MultiSource/Benchmarks/McCat/08-main/main: -1.59% (0.1954 => 0.1923, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.44% (0.1629 => 0.1685, std.dev.: 0.0109) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.22% (0.3278 => 0.3238, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.68% (0.2504 => 0.2487, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.92% (0.3376 => 0.3345, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.27% (0.2418 => 0.2363, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: -0.99% (0.6050 => 0.5990, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/mandel: 14.55% (0.0433 => 0.0496, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.15% (0.3310 => 0.3305, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/strcat: -0.65% (0.2008 => 0.1995, std.dev.: 0.0008) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.90% (0.0191 => 0.0208, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.40% (0.0215 => 0.0218, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0426 => 0.0426, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.90% (0.0333 => 0.0330, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.65% (0.0310 => 0.0312, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.48% (0.0421 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0202 => 0.0202, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 1.88% (0.0213 => 0.0217, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 7.49% (0.0334 => 0.0359, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0008 => 0.0008, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.54% (0.1472 => 0.1480, std.dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 8.41% (1.0981 => 1.1905, std.dev.: 0.0530) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.20% (0.1523 => 0.1520, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.81% (0.4099 => 0.4025, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.10% (0.1360 => 0.1443, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.77% (0.0647 => 0.0642, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.36% (0.0275 => 0.0274, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: - (0.0555 => 0.0555, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.15% (1.1426 => 1.1443, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 3.85% (0.0026 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.18% (0.0632 => 0.0555, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -15.73% (0.0267 => 0.0225, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.19% (0.8013 => 0.7998, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: -85.71% (0.0007 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -4.29% (0.0070 => 0.0067, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.03% (2.1832 => 1.6585, std.dev.: 0.0122) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.67% (0.0810 => 0.0945, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/tsp/tsp: 12.14% (0.1112 => 0.1247, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.61% (0.2180 => 0.2346, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.55% (0.4847 => 0.5213, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.28% (0.8321 => 0.8927, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.63% (0.2279 => 0.2430, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.01% (0.7473 => 0.7922, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.74% (0.9435 => 0.9977, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.27% (0.2240 => 0.2358, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.15% (0.8148 => 0.8568, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.25% (0.3295 => 0.3435, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.13% (0.2519 => 0.2623, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.56% (0.6287 => 0.6511, std.dev.: 0.0044) MultiSource/Applications/hbd/hbd: 3.45% (1.4269 => 1.4761, std.dev.: 0.0146) MultiSource/Applications/Burg/burg: 3.31% (1.2222 => 1.2627, std.dev.: 0.0022) MultiSource/Applications/lua/lua: 2.69% (3.8189 => 3.9215, std.dev.: 0.0128) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.67% (0.6227 => 0.6393, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 2.51% (4.1305 => 4.2341, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.46% (1.3279 => 1.3605, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.45% (1.4479 => 1.4834, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.43% (0.5961 => 0.6106, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.12% (0.8050 => 0.8221, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.73% (8.6476 => 8.7972, std.dev.: 0.0333) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.65% (4.4880 => 4.5620, std.dev.: 0.0170) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.25% (0.8995 => 0.9107, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.03% (1.2602 => 1.2732, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 55.37% (1.5795 => 2.4541, std.dev.: 0.0281) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.51% (0.3186 => 0.3457, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.36% (1.1857 => 1.2848, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 5.95% (63.1822 => 66.9445, std.dev.: 0.0927) MultiSource/Benchmarks/FreeBench/distray/distray: 4.73% (0.2390 => 0.2503, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: 3.50% (8.5322 => 8.8306, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.49% (59.2638 => 61.3305, std.dev.: 0.1133) MultiSource/Applications/siod/siod: 2.69% (3.6643 => 3.7627, std.dev.: 0.0129) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.17% (1.2474 => 1.2745, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 1.57% (1.3037 => 1.3242, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.14% (4.8362 => 4.8914, std.dev.: 0.0124) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.74% (0.3269 => 0.3016, std.dev.: 0.0037) MultiSource/Applications/lua/lua: -4.98% (29.8330 => 28.3469, std.dev.: 0.2887) SingleSource/Benchmarks/Shootout-C++/hash2: -1.45% (3.4237 => 3.3742, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.26% (3.3479 => 3.3057, std.dev.: 0.0157) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.81% (16.4461 => 16.5801, std.dev.: 0.1672) MultiSource/Applications/obsequi/Obsequi: 3.32% (1.0262 => 1.0603, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: 2.26% (0.6332 => 0.6475, std.dev.: 0.0094) MultiSource/Benchmarks/McCat/08-main/main: 5.02% (0.1831 => 0.1923, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 8.08% (0.1559 => 0.1685, std.dev.: 0.0109) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.68% (0.3123 => 0.3238, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.97% (0.2463 => 0.2487, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.03% (0.3344 => 0.3345, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.04% (0.2364 => 0.2363, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: -0.33% (0.6010 => 0.5990, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/mandel: 15.62% (0.0429 => 0.0496, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.19% (0.3266 => 0.3305, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/strcat: 1.32% (0.1969 => 0.1995, std.dev.: 0.0008) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -7.14% (0.0224 => 0.0208, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 56.09% (0.0230 => 0.0359, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 14.29% (0.0007 => 0.0008, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.92% (0.1438 => 0.1480, std.dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 5.08% (1.1329 => 1.1905, std.dev.: 0.0530) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.97% (0.1462 => 0.1520, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.34% (0.4164 => 0.4025, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.41% (0.1369 => 0.1443, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.16% (0.0641 => 0.0642, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 40.51% (0.0195 => 0.0274, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.98% (0.0578 => 0.0555, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.05% (1.1437 => 1.1443, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.48% (0.0627 => 0.0555, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.00% (0.0180 => 0.0225, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.24% (0.8017 => 0.7998, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 8.06% (0.0062 => 0.0067, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 23 05:09:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 23 Oct 2012 07:09:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121023120926.CDC1F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5127?compare_to=5124&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5127, Order: 166475, Start Time: 2012-10-23 10:44:38, End Time: 2012-10-23 12:12:30 To: 5124, Order: 166473, Start Time: 2012-10-23 08:46:41, End Time: 2012-10-23 10:14:37 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (212 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1041 (654 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.06% (1.3550 => 1.3693, std.dev.: 0.0035) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/vla: 31.17% (0.0324 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 24.28% (2.0176 => 2.5075, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.97% (0.1410 => 0.1748, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.39% (0.0746 => 0.0913, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 21.42% (0.1013 => 0.1230, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 21.06% (0.7710 => 0.9334, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 20.06% (0.0653 => 0.0784, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/08-main/main: 19.93% (0.2243 => 0.2690, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 19.49% (0.0826 => 0.0987, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.77% (0.0618 => 0.0734, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 18.43% (0.1986 => 0.2352, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.90% (0.5637 => 0.6646, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.80% (0.2596 => 0.3058, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.78% (0.0720 => 0.0848) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 17.75% (0.2721 => 0.3204, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.66% (0.0725 => 0.0853, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 17.54% (0.1072 => 0.1260, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 17.53% (0.0770 => 0.0905, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.51% (0.0811 => 0.0953, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.36% (0.0847 => 0.0994, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 17.35% (0.1003 => 0.1177, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.81% (0.7460 => 0.8714, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/mst/mst: 16.74% (0.1111 => 0.1297, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/messages-2: 16.61% (0.0614 => 0.0716, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 16.53% (0.9199 => 1.0720, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.51% (0.0648 => 0.0755, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.37% (0.1075 => 0.1251, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.33% (0.2914 => 0.3390, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 16.24% (0.0622 => 0.0723, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.07% (0.6959 => 0.8077, std.dev.: 0.0028) MultiSource/Applications/hbd/hbd: 15.95% (1.3693 => 1.5877, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: 15.95% (0.0834 => 0.0967, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.75% (0.0654 => 0.0757, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 15.73% (0.1062 => 0.1229, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.71% (0.1413 => 0.1635, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.67% (0.1327 => 0.1535, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 15.61% (0.5265 => 0.6087, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.36% (0.1276 => 0.1472, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.35% (0.0977 => 0.1127, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 14.96% (1.1061 => 1.2716, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.91% (0.1865 => 0.2143, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 14.88% (0.1478 => 0.1698, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 14.85% (0.7038 => 0.8083, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.83% (0.0964 => 0.1107) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.77% (0.0819 => 0.0940, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.69% (0.1014 => 0.1163, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.69% (3.9660 => 4.5487, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.40% (0.5577 => 0.6380, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 14.36% (0.1657 => 0.1895, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.29% (0.2023 => 0.2312, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 14.23% (0.7506 => 0.8574, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 14.20% (0.3246 => 0.3707, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.78% (0.2127 => 0.2420, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.72% (1.1364 => 1.2923, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.66% (0.4379 => 0.4977, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.65% (0.1048 => 0.1191, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.60% (0.1588 => 0.1804, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 13.59% (3.8646 => 4.3897, std.dev.: 0.0039) SingleSource/Benchmarks/McGill/exptree: 13.54% (0.0768 => 0.0872, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 13.54% (0.2925 => 0.3321, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.49% (1.4563 => 1.6527, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.42% (0.1789 => 0.2029, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.37% (1.2193 => 1.3823, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/health/health: 13.36% (0.1213 => 0.1375, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 13.33% (0.0818 => 0.0927, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.22% (0.1157 => 0.1310, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.97% (0.0825 => 0.0932, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 12.94% (13.8202 => 15.6087, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 12.81% (0.0804 => 0.0907, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 12.71% (0.4328 => 0.4878, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 12.65% (0.2995 => 0.3374, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/hash: 12.53% (0.4062 => 0.4571, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.49% (0.6283 => 0.7068, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/18-imp/imp: 12.39% (0.3220 => 0.3619, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 12.30% (1.9270 => 2.1640, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.98% (0.3899 => 0.4366, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 11.94% (7.2180 => 8.0795, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.88% (0.3130 => 0.3502, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 11.80% (1.0313 => 1.1530, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 11.73% (1.3245 => 1.4798, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.69% (0.4791 => 0.5351, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 11.64% (0.6744 => 0.7529, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.54% (0.1569 => 0.1750, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.45% (0.2140 => 0.2385, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.43% (0.1435 => 0.1599, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 11.33% (0.1589 => 0.1769, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.29% (0.2321 => 0.2583, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 11.20% (16.6129 => 18.4735, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/football/football: 11.16% (0.8310 => 0.9237, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 11.13% (2.1791 => 2.4216, std.dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference-object: 11.05% (0.5818 => 0.6461, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 11.02% (0.7061 => 0.7839, std.dev.: 0.0032) MultiSource/Applications/d/make_dparser: 10.93% (3.1889 => 3.5373, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 10.83% (3.6692 => 4.0667, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.82% (0.6135 => 0.6799, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 10.79% (4.3801 => 4.8529, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.78% (0.4016 => 0.4449, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.70% (0.3485 => 0.3858, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.69% (0.3489 => 0.3862, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/Hello: 10.68% (0.5748 => 0.6362, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 10.68% (4.4433 => 4.9179, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 10.67% (0.4113 => 0.4552, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.66% (0.2243 => 0.2482, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.57% (0.3756 => 0.4153, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 10.57% (0.3293 => 0.3641, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.55% (0.4390 => 0.4853, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.50% (0.3580 => 0.3956, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.49% (0.3022 => 0.3339, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 10.46% (0.2781 => 0.3072, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 10.44% (0.0977 => 0.1079, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.40% (0.8698 => 0.9603, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.33% (4.9865 => 5.5017, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.28% (0.2782 => 0.3068, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 10.25% (0.3453 => 0.3807, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 10.21% (0.3868 => 0.4263, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.17% (0.1819 => 0.2004, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.15% (0.2966 => 0.3267, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 10.09% (0.2726 => 0.3001, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 10.07% (0.3534 => 0.3890, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 10.07% (0.2761 => 0.3039, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.04% (1.9828 => 2.1818, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.98% (0.2655 => 0.2920, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 9.93% (0.2760 => 0.3034, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 9.90% (0.2607 => 0.2865, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 9.78% (1.0594 => 1.1630, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 9.78% (0.2690 => 0.2953, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 9.69% (0.3149 => 0.3454, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 9.67% (0.2937 => 0.3221, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 9.63% (0.2628 => 0.2881, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.63% (0.3511 => 0.3849, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 9.56% (0.3107 => 0.3404, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.55% (0.2765 => 0.3029, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 9.51% (3.7467 => 4.1030, std.dev.: 0.0032) MultiSource/Applications/SIBsim4/SIBsim4: 9.50% (1.2749 => 1.3960, std.dev.: 0.0059) MultiSource/Applications/JM/lencod/lencod: 9.39% (14.8535 => 16.2480, std.dev.: 0.0220) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.38% (0.6576 => 0.7193, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 9.34% (0.2988 => 0.3267, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 9.32% (1.1333 => 1.2389, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.31% (0.2696 => 0.2947, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 9.30% (0.3192 => 0.3489, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.24% (0.3755 => 0.4102, std.dev.: 0.0124) MultiSource/Benchmarks/sim/sim: 9.20% (0.3131 => 0.3419, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 9.10% (0.2945 => 0.3213, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.08% (1.5188 => 1.6567, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 8.97% (8.4961 => 9.2586, std.dev.: 0.0230) MultiSource/Benchmarks/FreeBench/neural/neural: 8.88% (0.1385 => 0.1508, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.67% (0.9108 => 0.9898, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.61% (0.8818 => 0.9577, std.dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 8.48% (6.5754 => 7.1329, std.dev.: 0.0171) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.47% (0.4805 => 0.5212, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.41% (3.2742 => 3.5495, std.dev.: 0.0220) SingleSource/Benchmarks/Misc-C++/bigfib: 8.40% (0.6250 => 0.6775, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.39% (0.2504 => 0.2714, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 8.30% (4.6629 => 5.0500, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.26% (0.3245 => 0.3513, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.16% (2.1007 => 2.2722, std.dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.10% (6.2785 => 6.7873, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/oourafft: 7.97% (0.2008 => 0.2168, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: 7.82% (0.1777 => 0.1916, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 7.60% (1.2292 => 1.3226, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.55% (13.2842 => 14.2871, std.dev.: 0.0170) SingleSource/UnitTests/ObjC/parameter-passing: 6.72% (0.4003 => 0.4272, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.49% (0.3650 => 0.3887, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 6.46% (0.3914 => 0.4167, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.40% (0.3940 => 0.4192, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 6.23% (0.3789 => 0.4025, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 6.06% (0.3578 => 0.3795, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 6.01% (0.3646 => 0.3865, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 5.97% (0.3601 => 0.3816, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 5.95% (0.3663 => 0.3881, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 5.91% (16.2614 => 17.2221, std.dev.: 0.0229) SingleSource/UnitTests/ObjC/exceptions-3: 5.82% (0.3623 => 0.3834, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 5.77% (0.2859 => 0.3024, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.77% (14.5298 => 15.3675, std.dev.: 0.0136) MultiSource/Benchmarks/Bullet/bullet: 3.10% (33.2944 => 34.3269, std.dev.: 0.0274) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.13% (0.1824 => 0.3541, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.73% (0.4846 => 0.6965, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.64% (5.7573 => 7.5212, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: 24.20% (1.8175 => 2.2574, std.dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.10% (1.0895 => 1.2758, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 11.07% (1.1560 => 1.2840, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1922, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 9.05% (0.8273 => 0.9022, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.85% (0.1322 => 0.1439, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-4: 6.54% (1.0640 => 1.1336) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.46% (0.9692 => 1.0221) SingleSource/Benchmarks/Misc/mandel-2: 5.43% (1.2998 => 1.3704, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.95% (0.3458 => 0.3629, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.75% (0.3139 => 0.3288, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: 4.70% (1.9144 => 2.0044, std.dev.: 0.0007) SingleSource/Regression/C/uint64_to_float: 4.53% (0.5449 => 0.5696, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.50% (2.8606 => 2.9892, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.96% (1.7081 => 1.7757, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6781, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 3.50% (10.7476 => 11.1234, std.dev.: 0.0641) SingleSource/Benchmarks/Misc/flops-6: 3.49% (1.9199 => 1.9869, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 3.46% (12.0921 => 12.5099, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 3.01% (1.4298 => 1.4729, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bisort/bisort: 2.90% (0.8239 => 0.8478, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.44% (1.0310 => 1.0562, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.32% (7.4271 => 7.5994, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-8: 2.27% (1.9863 => 2.0313, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.46% (2.0200 => 2.0495, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 1.46% (8.3908 => 8.5130, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.31% (3.1720 => 3.2134, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.25% (9.0760 => 9.1890, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 1.22% (5.5130 => 5.5803, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/em3d/em3d: 1.12% (3.1071 => 3.1420, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.09% (8.8259 => 8.9217, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.05% (9.9194 => 10.0235, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: 1.02% (2.1753 => 2.1975, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -45.66% (0.2670 => 0.1451, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.71% (0.4657 => 0.3879, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.19% (1.3813 => 1.2405, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.04% (1.3819 => 1.2431, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -99.99% (8.6002 => 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.24% (1.0460 => 0.8552, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -12.69% (0.2238 => 0.1954, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.11% (20.3410 => 18.2837, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/flops-3: -6.24% (2.4152 => 2.2644, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.17% (1.9290 => 1.8100, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -5.44% (1.2308 => 1.1639, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3744, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -5.05% (2.6470 => 2.5133, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.04% (1.3780 => 1.3085, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/perlin: -4.46% (6.2497 => 5.9712, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.19% (0.9996 => 0.9577, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.82% (1.7688 => 1.7012, std.dev.: 0.0037) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.94% (0.4867 => 0.4724, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -2.87% (3.2729 => 3.1789, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.78% (4.1080 => 3.9937, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/bh/bh: -2.76% (1.9762 => 1.9217, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -2.69% (5.0168 => 4.8816, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4785, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.33% (1.3891 => 1.3567) MultiSource/Applications/spiff/spiff: -2.31% (3.0263 => 2.9564, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.18% (0.6615 => 0.6471, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.91% (0.6589 => 0.6463, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.83% (6.3560 => 6.2395, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3456, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.64% (2.5254 => 2.4840, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: -1.51% (7.1097 => 7.0023, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: -1.41% (28.2225 => 27.8233, std.dev.: 0.0036) MultiSource/Applications/lua/lua: -1.29% (26.5159 => 26.1731, std.dev.: 0.0247) SingleSource/Benchmarks/Shootout/heapsort: -1.13% (3.9173 => 3.8730, std.dev.: 0.0036) MultiSource/Applications/viterbi/viterbi: -1.12% (4.4810 => 4.4306, std.dev.: 0.0031) MultiSource/Applications/aha/aha: -1.05% (3.1476 => 3.1144, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -1.05% (84.4286 => 83.5444, std.dev.: 0.0081) MultiSource/Applications/lambda-0_1_3/lambda: -1.03% (5.3167 => 5.2622, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 2.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 23 15:23:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 23 Oct 2012 17:23:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121023222338.28C332A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5140?compare_to=5134&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5140, Order: 166489, Start Time: 2012-10-23 19:08:09, End Time: 2012-10-23 22:23:52 To: 5134, Order: 166478, Start Time: 2012-10-23 15:03:36, End Time: 2012-10-23 18:20:12 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (170 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1041 (720 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/perimeter/perimeter: 1.64% (0.6107 => 0.6207, std.dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.80% (0.0625 => 0.0880, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.89% (0.1063 => 0.1402, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 26.53% (0.0475 => 0.0601, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.19% (0.0714 => 0.0901, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.77% (0.2969 => 0.3734, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 24.86% (0.1106 => 0.1381, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.47% (0.5900 => 0.7344, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.18% (0.4139 => 0.5140, std.dev.: 0.0034) MultiSource/Applications/oggenc/oggenc: 23.94% (1.5932 => 1.9746, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.93% (0.4994 => 0.6189, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 23.72% (0.0822 => 0.1017, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.54% (0.5000 => 0.6177, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.03% (0.0547 => 0.0673, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.02% (0.1620 => 0.1993, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.82% (0.1021 => 0.1254, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.43% (0.0584 => 0.0715, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 22.27% (0.4253 => 0.5200, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.13% (0.1107 => 0.1352, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 21.70% (0.0599 => 0.0729) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.52% (0.0897 => 0.1090, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.48% (0.0633 => 0.0769, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.40% (0.0584 => 0.0709, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.34% (0.0642 => 0.0779, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 20.99% (0.0948 => 0.1147, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 20.94% (0.1619 => 0.1958, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 20.86% (0.0604 => 0.0730, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 20.71% (0.0821 => 0.0991, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.58% (0.1103 => 0.1330, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.53% (0.1549 => 0.1867, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.50% (0.3903 => 0.4703, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.33% (0.0541 => 0.0651, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.24% (0.1003 => 0.1206, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.14% (0.1604 => 0.1927, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 19.70% (0.1218 => 0.1458, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 19.47% (0.1505 => 0.1798, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 19.43% (0.0947 => 0.1131, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.67% (0.2014 => 0.2390, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.51% (1.3152 => 1.5587, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.26% (0.1462 => 0.1729, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.21% (0.2866 => 0.3388, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: 18.14% (0.4029 => 0.4760, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 18.13% (0.5826 => 0.6882, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.12% (0.3890 => 0.4595, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 18.05% (0.5889 => 0.6952, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/mst/mst: 17.91% (0.0698 => 0.0823, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.85% (3.5627 => 4.1985, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.84% (0.1160 => 0.1367, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.84% (0.2736 => 0.3224, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 17.82% (0.0808 => 0.0952, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.66% (0.0572 => 0.0673, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.65% (0.1088 => 0.1280, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 17.18% (1.8794 => 2.2022, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.89% (1.6211 => 1.8949, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/18-imp/imp: 16.89% (0.1421 => 0.1661, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.82% (0.1968 => 0.2299, std.dev.: 0.0017) MultiSource/Applications/Burg/burg: 16.80% (0.5546 => 0.6478, std.dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.72% (2.7292 => 3.1854, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.59% (0.2875 => 0.3352, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 16.56% (0.9697 => 1.1303, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.33% (0.4361 => 0.5073, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.32% (0.4658 => 0.5418, std.dev.: 0.0013) MultiSource/Applications/d/make_dparser: 16.32% (1.0781 => 1.2540, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.28% (0.5026 => 0.5844, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.23% (0.3271 => 0.3802, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 16.11% (0.2725 => 0.3164, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 16.06% (0.2714 => 0.3150, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: 16.04% (0.1284 => 0.1490, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-3: 15.95% (0.3460 => 0.4012, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.92% (0.2738 => 0.3174, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: 15.88% (0.3496 => 0.4051, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 15.87% (0.3465 => 0.4015, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 15.87% (0.7171 => 0.8309, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-2: 15.84% (0.3446 => 0.3992, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 15.83% (0.2780 => 0.3220, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.80% (0.3930 => 0.4551, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.80% (1.9694 => 2.2805, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/trivial-interface: 15.78% (0.3442 => 0.3985, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.76% (0.2729 => 0.3159, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 15.72% (0.2811 => 0.3253, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 15.71% (0.3004 => 0.3476, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.71% (0.3488 => 0.4036, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.70% (0.2911 => 0.3368, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.65% (0.2792 => 0.3229, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 15.65% (4.2109 => 4.8699, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/methcall: 15.64% (0.2813 => 0.3253, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 15.64% (0.2750 => 0.3180, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/synchronized: 15.60% (0.3469 => 0.4010, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 15.55% (0.9909 => 1.1450, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.50% (2.0673 => 2.3877, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 15.48% (0.2823 => 0.3260, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.43% (0.3195 => 0.3688, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 15.41% (0.2803 => 0.3235, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 15.34% (0.3096 => 0.3571, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 15.32% (0.3650 => 0.4209, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.29% (1.9966 => 2.3019, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.26% (4.4195 => 5.0938, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions: 15.23% (0.3643 => 0.4198, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 14.99% (23.5202 => 27.0468, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.99% (0.3362 => 0.3866, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 14.98% (0.3724 => 0.4282, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 14.94% (0.3267 => 0.3755, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.90% (0.3060 => 0.3516, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary: 14.79% (0.3258 => 0.3740, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.68% (0.1090 => 0.1250, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 14.56% (0.3317 => 0.3800, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 14.44% (0.3477 => 0.3979, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.37% (0.3124 => 0.3573, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.17% (0.3282 => 0.3747, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/lists: 14.13% (0.3348 => 0.3821, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 14.08% (0.3678 => 0.4196, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.01% (0.3690 => 0.4207, std.dev.: 0.0017) MultiSource/Applications/lua/lua: 13.97% (1.4269 => 1.6262, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.93% (0.3625 => 0.4130, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 13.91% (0.2566 => 0.2923, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 13.85% (0.3726 => 0.4242, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 13.73% (0.7875 => 0.8956, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 13.64% (0.2075 => 0.2358, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.58% (0.3845 => 0.4367, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 13.48% (2.1653 => 2.4572, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.39% (0.3981 => 0.4514, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 13.39% (0.4146 => 0.4701, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash2: 13.39% (0.4251 => 0.4820, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 13.03% (4.6177 => 5.2192, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 13.00% (2.1013 => 2.3745, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/bigfib: 12.57% (0.5012 => 0.5642, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.91% (0.2040 => 0.2283, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 11.74% (0.2691 => 0.3007, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 11.69% (5.5417 => 6.1894, std.dev.: 0.0101) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.25% (0.6435 => 0.7159, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 10.72% (0.3498 => 0.3873, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.56% (0.2737 => 0.3026, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.51% (0.1028 => 0.1136, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.44% (0.2068 => 0.2284, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 10.08% (0.6634 => 0.7303, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.02% (0.3084 => 0.3393, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.98% (0.1383 => 0.1521, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 9.80% (0.3336 => 0.3663, std.dev.: 0.0073) MultiSource/Benchmarks/PAQ8p/paq8p: 9.53% (0.4847 => 0.5309, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.18% (0.2103 => 0.2296, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 8.63% (2.0346 => 2.2101, std.dev.: 0.0170) MultiSource/Applications/lemon/lemon: 8.36% (0.2391 => 0.2591, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.06% (4.6926 => 5.0706, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.89% (0.5361 => 0.5784, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.46% (11.6398 => 12.5082, std.dev.: 0.1905) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.96% (0.7426 => 0.7943, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.61% (0.5584 => 0.5953, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.30% (0.3792 => 0.4031, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 6.30% (11.9555 => 12.7081, std.dev.: 0.0133) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6534, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 17.59% (2.5769 => 3.0301, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 8.10% (0.2802 => 0.3029, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6100, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 5.98% (0.2122 => 0.2249, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/objinst: 5.03% (12.0509 => 12.6570, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1713, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/flops-2: 3.47% (1.8057 => 1.8683, std.dev.: 0.0044) SingleSource/Benchmarks/Dhrystone/dry: 2.76% (14.0481 => 14.4360, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary3: 2.00% (15.8721 => 16.1897, std.dev.: 0.0085) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.71% (3.1722 => 3.2266, std.dev.: 0.0025) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3080, std.dev.: 0.0094) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2891, std.dev.: 0.0041) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.25% (1.0142 => 1.0269, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5134, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5982, std.dev.: 0.0212) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.41% (2.4764 => 2.3673, std.dev.: 0.0246) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.52% (25.4195 => 16.3903, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/ary2: -8.74% (0.2402 => 0.2192, std.dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: -7.70% (28.1477 => 25.9816, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7754, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0096) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7738, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -2.89% (3.6262 => 3.5215, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.74% (11.2080 => 10.9006, std.dev.: 0.0196) SingleSource/Benchmarks/Dhrystone/fldry: -2.33% (17.2379 => 16.8361, std.dev.: 0.0096) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.19% (41.7953 => 40.8811, std.dev.: 0.0516) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5702, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4950, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.29% (105.3826 => 104.0231, std.dev.: 0.1639) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.06% (3.3991 => 3.3629, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0451, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 23 03:53:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 23 Oct 2012 05:53:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121023105328.1BBD12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5125?compare_to=5121&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5125, Order: 166474, Start Time: 2012-10-23 09:36:24, End Time: 2012-10-23 10:55:30 To: 5121, Order: 166471, Start Time: 2012-10-23 07:45:45, End Time: 2012-10-23 09:06:30 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 12 (84 on baseline) New Passes: 0 (3 on baseline) Performance Regressions: 1 (192 on baseline) Performance Improvements: 3 (42 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 88 (16 on baseline) Unchanged Tests: 938 (643 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lua/lua MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg SingleSource/UnitTests/Vector/multiplies MultiSource/Applications/ClamAV/clamscan: -3.98% (20.9867 => 20.1509, std.dev.: 0.0399) MultiSource/Applications/lua/lua: -3.23% (4.3698 => 4.2285, std.dev.: 0.0190) MultiSource/Benchmarks/MallocBench/gs/gs: -0.77% (4.6658 => 4.6299, std.dev.: 0.0272) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -53.79% (0.1331 => 0.0615, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -0.51% (5.6322 => 5.6032, std.dev.: 0.0052) SingleSource/UnitTests/Vector/multiplies: -40.62% (0.0325 => 0.0193, std.dev.: 0.0000) New Failures - Execution Time ----------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lua/lua MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg SingleSource/UnitTests/Vector/multiplies MultiSource/Applications/ClamAV/clamscan: -99.94% (0.1713 => 0.0001) MultiSource/Applications/lua/lua: -100.00% (26.0038 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: -99.84% (0.0634 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.51% (0.0203 => 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -97.30% (0.0037 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (2.5095 => 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.51% (55.1945 => 56.5807, std.dev.: 0.0865) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Olden/power/power: -8.80% (0.1841 => 0.1679, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -1.72% (15.6846 => 15.4151, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.05% (3.8100 => 3.7701, std.dev.: 0.0112) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.24% (0.6271 => 0.6256, std.dev.: 0.0042) MultiSource/Applications/SPASS/SPASS: -0.09% (17.2688 => 17.2539, std.dev.: 0.0057) MultiSource/Applications/kimwitu++/kc: 0.04% (15.6017 => 15.6075, std.dev.: 0.0133) MultiSource/Benchmarks/Bullet/bullet: -0.49% (56.3908 => 56.1157, std.dev.: 0.0495) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.21% (0.0485 => 0.0486, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.21% (0.0486 => 0.0487, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.22% (0.0455 => 0.0456, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.22% (0.0456 => 0.0457, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0445 => 0.0445, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0445 => 0.0445, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0438 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.46% (0.0438 => 0.0440, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0456 => 0.0456, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.22% (0.0456 => 0.0457, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.22% (0.0449 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.22% (0.0450 => 0.0451, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.23% (0.0442 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0441 => 0.0441, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0447 => 0.0447, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.22% (0.0447 => 0.0448, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.44% (0.0457 => 0.0459, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.97% (0.0479 => 0.0460, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0435 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.23% (0.0435 => 0.0436, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.45% (0.0446 => 0.0448, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.45% (0.0447 => 0.0449, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.23% (0.0438 => 0.0439, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.23% (0.0438 => 0.0439, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0431 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.23% (0.0431 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.23% (0.0431 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0430 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0466 => 0.0466, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.21% (0.0466 => 0.0467, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0429 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.23% (0.0429 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0430 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.23% (0.0431 => 0.0432, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0437 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0438 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.09% (1.4941 => 1.4927, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.32% (8.2460 => 8.2196, std.dev.: 0.0153) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.33% (0.6888 => 0.6865, std.dev.: 0.0041) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1436 => 0.1436) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.45% (0.0671 => 0.0668, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lua/lua MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg SingleSource/UnitTests/Vector/multiplies MultiSource/Applications/ClamAV/clamscan: -9.13% (22.1758 => 20.1509, std.dev.: 0.0399) MultiSource/Applications/lua/lua: 9.20% (3.8723 => 4.2285, std.dev.: 0.0190) MultiSource/Benchmarks/Bullet/bullet: -11.27% (63.2438 => 56.1157, std.dev.: 0.0495) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.08% (6.6874 => 0.0615, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.02% (5.0018 => 5.6032, std.dev.: 0.0052) SingleSource/UnitTests/Vector/multiplies: -30.82% (0.0279 => 0.0193, std.dev.: 0.0000) New Failures - Execution Time ----------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lua/lua MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg SingleSource/UnitTests/Vector/multiplies MultiSource/Applications/ClamAV/clamscan: -99.94% (0.1629 => 0.0001) MultiSource/Applications/lua/lua: -100.00% (26.0924 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -97.30% (0.0037 => 0.0001) SingleSource/UnitTests/Vector/multiplies: -100.00% (2.5528 => 0.0001) New Passes - Compile Time ------------------------- SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.48% (3.4629 => 5.7998, std.dev.: 0.0020) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13508.06% (0.0720 => 9.7978, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049200.00% (0.0001 => 10.0493, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 65.23% (0.0256 => 0.0423, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 64.10% (0.2554 => 0.4191, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: 48.69% (10.3673 => 15.4151, std.dev.: 0.0045) SingleSource/UnitTests/SignlessTypes/factor: 46.28% (0.0296 => 0.0433, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 43.17% (0.0271 => 0.0388) SingleSource/Benchmarks/Misc/richards_benchmark: 41.43% (0.1622 => 0.2294, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.13% (1.5859 => 2.2382, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/distray/distray: 36.17% (0.1056 => 0.1438, std.dev.: 0.0009) SingleSource/UnitTests/vla: 33.24% (0.0355 => 0.0473, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.25% (2.2024 => 2.8687, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/neural/neural: 25.84% (0.1463 => 0.1841, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 24.10% (0.0834 => 0.1035, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.39% (0.1566 => 0.1901, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/hash: 21.03% (0.0485 => 0.0587, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 20.30% (0.2049 => 0.2465, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.17% (7.0540 => 8.4061, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 18.78% (0.1432 => 0.1701, std.dev.: 0.0038) MultiSource/Applications/viterbi/viterbi: 18.65% (0.1555 => 0.1845, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 18.47% (0.5105 => 0.6048, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.25% (0.0871 => 0.1030, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.78% (2.2022 => 2.5937, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.12% (0.6675 => 0.7818, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/lists: 16.77% (0.0626 => 0.0731, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.65% (0.8172 => 0.9533, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.65% (0.0793 => 0.0925, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.62% (1.3050 => 1.5219, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: 16.60% (0.1440 => 0.1679, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.58% (0.0730 => 0.0851, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 16.50% (0.1655 => 0.1928, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 16.37% (3.3354 => 3.8814, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.34% (0.4615 => 0.5369, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/mst/mst: 16.25% (0.1163 => 0.1352, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/tsp/tsp: 16.17% (0.1175 => 0.1365, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 16.17% (0.1695 => 0.1969, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.03% (0.2271 => 0.2635, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.58% (1.5415 => 1.7817, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.56% (0.1337 => 0.1545, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.55% (0.1029 => 0.1189, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.50% (0.1032 => 0.1192, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 15.50% (10.4361 => 12.0532, std.dev.: 0.0204) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.46% (0.0886 => 0.1023, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.30% (0.5020 => 0.5788, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: 15.23% (0.3282 => 0.3782, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.21% (0.1940 => 0.2235, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.20% (0.0842 => 0.0970, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.17% (0.1510 => 0.1739, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.01% (0.2065 => 0.2375, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 14.96% (0.0675 => 0.0776, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 14.96% (0.3109 => 0.3574, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 14.88% (0.0672 => 0.0772, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.87% (0.3121 => 0.3585, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: 14.84% (0.7115 => 0.8171, std.dev.: 0.0025) MultiSource/Applications/Burg/burg: 14.66% (1.1642 => 1.3349, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.65% (0.9765 => 1.1196, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/matrix: 14.55% (0.0818 => 0.0937, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 14.46% (0.3423 => 0.3918, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.42% (0.0770 => 0.0881, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.41% (4.2646 => 4.8793, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.34% (0.0746 => 0.0853, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.32% (0.2758 => 0.3153, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.23% (0.1117 => 0.1276, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.20% (0.1584 => 0.1809, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/exptree: 14.13% (0.0814 => 0.0929, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.11% (0.5860 => 0.6687, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.08% (0.0838 => 0.0956, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.00% (0.2107 => 0.2402, std.dev.: 0.0024) MultiSource/Applications/spiff/spiff: 13.99% (0.7835 => 0.8931, std.dev.: 0.0030) MultiSource/Applications/aha/aha: 13.99% (0.1151 => 0.1312, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 13.98% (0.6450 => 0.7352, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.92% (0.1236 => 0.1408, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.90% (0.1906 => 0.2171, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.86% (0.5981 => 0.6810, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.84% (0.1438 => 0.1637, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 13.77% (9.4845 => 10.7901, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.72% (0.0933 => 0.1061, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.65% (1.4186 => 1.6123, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.60% (8.1363 => 9.2426, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.53% (1.7609 => 1.9991, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.45% (0.1695 => 0.1923, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 13.45% (5.7591 => 6.5336, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.38% (0.0770 => 0.0873, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.37% (0.1062 => 0.1204, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 13.32% (2.0273 => 2.2973, std.dev.: 0.0047) MultiSource/Applications/lambda-0_1_3/lambda: 13.29% (0.7433 => 0.8421, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.16% (0.0798 => 0.0903, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 13.15% (4.9449 => 5.5952, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.11% (0.2700 => 0.3054, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 13.07% (1.1840 => 1.3387, std.dev.: 0.0101) MultiSource/Benchmarks/Olden/health/health: 13.01% (0.1268 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.90% (0.8067 => 0.9108, std.dev.: 0.0113) SingleSource/UnitTests/SignlessTypes/rem: 12.85% (0.1144 => 0.1291, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.84% (0.5569 => 0.6284, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.80% (0.1625 => 0.1833, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.77% (0.4879 => 0.5502, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.70% (0.0929 => 0.1047, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 12.63% (1.0722 => 1.2076, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 12.56% (0.4299 => 0.4839, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.41% (0.1330 => 0.1495, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 12.37% (0.3387 => 0.3806, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.35% (0.3441 => 0.3866, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.19% (0.3307 => 0.3710, std.dev.: 0.0102) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.16% (1.1861 => 1.3303, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.14% (0.2603 => 0.2919, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.96% (0.3177 => 0.3557, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 11.89% (0.3180 => 0.3558, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.87% (7.9617 => 8.9065, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/football/football: 11.85% (0.8921 => 0.9978, std.dev.: 0.0025) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.64% (0.1143 => 0.1276, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.52% (0.8101 => 0.9034, std.dev.: 0.0026) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.47% (0.1125 => 0.1254, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/bh/bh: 11.38% (0.3092 => 0.3444, std.dev.: 0.0057) MultiSource/Applications/hbd/hbd: 11.22% (1.5603 => 1.7354, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/bigfib: 10.89% (0.6456 => 0.7159, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.68% (0.1892 => 0.2094, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 10.62% (2.2969 => 2.5408, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.50% (0.2266 => 0.2504, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 10.04% (21.9371 => 24.1392, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 9.96% (0.1044 => 0.1148, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 9.48% (0.4620 => 0.5058, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 9.45% (0.3927 => 0.4298, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.41% (0.4103 => 0.4489, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 9.39% (0.3473 => 0.3799, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash: 9.35% (0.4289 => 0.4690, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.26% (0.3543 => 0.3871, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 9.24% (0.3497 => 0.3820, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 9.22% (0.3828 => 0.4181, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.20% (0.3543 => 0.3869, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.18% (0.3694 => 0.4033, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 9.02% (0.3516 => 0.3833, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.01% (0.3561 => 0.3882, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.01% (0.3886 => 0.4236, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.99% (0.3826 => 0.4170, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.85% (0.3865 => 0.4207, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.85% (0.2430 => 0.2645, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 8.80% (0.3422 => 0.3723, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.73% (0.4203 => 0.4570, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.67% (0.3427 => 0.3724, std.dev.: 0.0082) MultiSource/Applications/sqlite3/sqlite3: 8.56% (17.1811 => 18.6519, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/lists1: 8.41% (0.3684 => 0.3994, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.41% (0.4636 => 0.5026, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: 8.18% (0.4048 => 0.4379, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.94% (14.3668 => 15.5074, std.dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.85% (3.8922 => 4.1979, std.dev.: 0.0067) SingleSource/UnitTests/ObjC++/property-reference-object: 7.76% (0.6030 => 0.6498, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.65% (0.5925 => 0.6378, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 7.51% (0.7326 => 0.7876, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/sieve: 7.41% (0.3603 => 0.3870, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.07% (0.3650 => 0.3908, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.75% (0.3098 => 0.3307, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.48% (0.3162 => 0.3367, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.47% (0.3136 => 0.3339, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 6.47% (0.2905 => 0.3093, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.47% (0.2891 => 0.3078, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.46% (0.2831 => 0.3014) SingleSource/Benchmarks/Shootout-C++/except: 6.41% (0.2871 => 0.3055, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.37% (2.0665 => 2.1981, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 6.34% (0.3232 => 0.3437, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.31% (0.3283 => 0.3490, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.20% (0.2872 => 0.3050, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.12% (0.2877 => 0.3053, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.09% (0.2793 => 0.2963, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.99% (0.2756 => 0.2921, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.98% (0.2725 => 0.2888, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 5.93% (0.3052 => 0.3233, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 5.92% (0.3379 => 0.3579, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 5.80% (1.2842 => 1.3587, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/hello: 5.71% (0.2714 => 0.2869, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 5.64% (0.2802 => 0.2960, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.08% (0.3131 => 0.3290, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.89% (1.1194 => 1.1518, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1726, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.66% (0.9957 => 1.1317, std.dev.: 0.0099) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652) SingleSource/Benchmarks/Misc/richards_benchmark: 10.03% (1.1396 => 1.2539, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.64% (3.1578 => 3.3674, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 5.96% (1.9405 => 2.0562, std.dev.: 0.0029) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.65% (0.3463 => 0.3624, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.87% (0.4162 => 0.4323, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.81% (4.2280 => 4.3466, std.dev.: 0.0309) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.61% (0.3987 => 0.4091, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.08% (3.6395 => 3.7152, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/bisort/bisort: 1.80% (0.8333 => 0.8483, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.56% (2.6546 => 2.6960, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2078, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 1.21% (4.4649 => 4.5188, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -79.60% (0.8651 => 0.1765, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.93% (5.2763 => 3.2225, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.06% (5.3855 => 3.7130, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.61% (5.3526 => 3.7140, std.dev.: 0.0054) SingleSource/UnitTests/Vector/constpool: -14.59% (54.1659 => 46.2630, std.dev.: 0.0075) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.41% (2.9384 => 2.6326, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.08% (8.0499 => 3.7770, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.50% (1.1492 => 0.7642, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4751, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4245, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.66% (1.2258 => 1.0706, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -12.49% (1.2373 => 1.0828, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel-2: -10.59% (1.5373 => 1.3745, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.31% (19.9488 => 18.2906, std.dev.: 0.0401) MultiSource/Benchmarks/FreeBench/mason/mason: -7.87% (0.2161 => 0.1991, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.04% (1.8329 => 1.7039, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4780, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0145) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.20% (1.6805 => 1.5931, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: -4.96% (1.5835 => 1.5050, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.21% (8.1563 => 7.8127, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.65% (3.2827 => 3.1629, std.dev.: 0.0074) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8775, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5069, std.dev.: 0.0080) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.58% (0.4808 => 0.4684, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -2.15% (4.6441 => 4.5443, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.89% (10.2830 => 10.0882, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6817, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4206, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2879, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.09% (6.2999 => 6.2314, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0015) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 19.64% (0.5229 => 0.6256, std.dev.: 0.0042) MultiSource/Applications/SPASS/SPASS: 15.11% (14.9895 => 17.2539, std.dev.: 0.0057) MultiSource/Applications/kimwitu++/kc: 10.26% (14.1553 => 15.6075, std.dev.: 0.0133) MultiSource/Benchmarks/MallocBench/gs/gs: 12.64% (4.1105 => 4.6299, std.dev.: 0.0272) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 35.11% (1.1048 => 1.4927, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.83% (7.1582 => 8.2196, std.dev.: 0.0153) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.33% (0.6222 => 0.6865, std.dev.: 0.0041) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.30% (0.1485 => 0.1436) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.43% (0.2116 => 0.0668, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 23 13:59:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 23 Oct 2012 15:59:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121023205934.AB5352A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5138?baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 To: (none) Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Added Tests: 1014 (0 on baseline) Unchanged Tests: 28 (1042 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Added Tests - Compile Time -------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sgefa/sgefa MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/ObjC++/Hello SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/ObjC++/property-reference-object SingleSource/UnitTests/ObjC++/reference-in-block-args SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/ObjC/bitfield-access SingleSource/UnitTests/ObjC/bitfield-access-2 SingleSource/UnitTests/ObjC/block-byref-aggr SingleSource/UnitTests/ObjC/constant-strings SingleSource/UnitTests/ObjC/dot-syntax SingleSource/UnitTests/ObjC/dot-syntax-1 SingleSource/UnitTests/ObjC/dot-syntax-2 SingleSource/UnitTests/ObjC/exceptions SingleSource/UnitTests/ObjC/exceptions-2 SingleSource/UnitTests/ObjC/exceptions-3 SingleSource/UnitTests/ObjC/exceptions-4 SingleSource/UnitTests/ObjC/for-in SingleSource/UnitTests/ObjC/instance-method-metadata SingleSource/UnitTests/ObjC/messages SingleSource/UnitTests/ObjC/messages-2 SingleSource/UnitTests/ObjC/parameter-passing SingleSource/UnitTests/ObjC/predefined-expr-in-method SingleSource/UnitTests/ObjC/property SingleSource/UnitTests/ObjC/protocols SingleSource/UnitTests/ObjC/synchronized SingleSource/UnitTests/ObjC/trivial-interface SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sgefa/sgefa MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/8b10b/8b10b MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/ObjC++/Hello SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/ObjC++/property-reference-object SingleSource/UnitTests/ObjC++/reference-in-block-args SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/ObjC/bitfield-access SingleSource/UnitTests/ObjC/bitfield-access-2 SingleSource/UnitTests/ObjC/block-byref-aggr SingleSource/UnitTests/ObjC/constant-strings SingleSource/UnitTests/ObjC/dot-syntax SingleSource/UnitTests/ObjC/dot-syntax-1 SingleSource/UnitTests/ObjC/dot-syntax-2 SingleSource/UnitTests/ObjC/exceptions SingleSource/UnitTests/ObjC/exceptions-2 SingleSource/UnitTests/ObjC/exceptions-3 SingleSource/UnitTests/ObjC/exceptions-4 SingleSource/UnitTests/ObjC/for-in SingleSource/UnitTests/ObjC/instance-method-metadata SingleSource/UnitTests/ObjC/messages SingleSource/UnitTests/ObjC/messages-2 SingleSource/UnitTests/ObjC/parameter-passing SingleSource/UnitTests/ObjC/predefined-expr-in-method SingleSource/UnitTests/ObjC/property SingleSource/UnitTests/ObjC/protocols SingleSource/UnitTests/ObjC/synchronized SingleSource/UnitTests/ObjC/trivial-interface SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Vector/SSE/sse_expandfft SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vector/SSE/sse_stepfft SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/ms_struct-bitfield SingleSource/UnitTests/ms_struct-bitfield-1 SingleSource/UnitTests/ms_struct-bitfield-init SingleSource/UnitTests/ms_struct-bitfield-init-1 SingleSource/UnitTests/ms_struct_pack_layout SingleSource/UnitTests/ms_struct_pack_layout-1 SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla ================================ Run-Over-Baseline Changes Detail ================================ Report Time: 0.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 23 03:58:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 23 Oct 2012 05:58:18 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121023105818.A0B312A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5126?compare_to=5122&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5126, Order: 166475, Start Time: 2012-10-23 09:36:17, End Time: 2012-10-23 11:00:22 To: 5122, Order: 166471, Start Time: 2012-10-23 07:55:36, End Time: 2012-10-23 09:19:03 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 10 (38 on baseline) Performance Improvements: 4 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 961 (932 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.45% (0.1875 => 0.1996, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.44% (0.2363 => 0.2468, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 3.13% (1.2257 => 1.2641, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.70% (0.8370 => 0.8596, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.33% (1.2380 => 1.2669, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.30% (0.8469 => 0.8664, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.93% (1.3394 => 1.3652, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.51% (0.9628 => 0.9773, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.82% (1.0057 => 1.0341, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.63% (1.6059 => 1.6320, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/himenobmtxpa: -6.95% (0.1798 => 0.1673, std.dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -9.64% (0.3536 => 0.3195, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C++/primes/primes: -4.33% (0.7914 => 0.7571, std.dev.: 0.0110) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -2.74% (0.5996 => 0.5832, std.dev.: 0.0045) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.44% (16.5693 => 16.4970, std.dev.: 0.0888) MultiSource/Applications/obsequi/Obsequi: 0.43% (1.0485 => 1.0530, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: - (0.6374 => 0.6374, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/08-main/main: 5.30% (0.1812 => 0.1908, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.24% (0.1696 => 0.1658, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.09% (0.3239 => 0.3242, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (0.2459 => 0.2491, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.06% (0.3296 => 0.3331, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.70% (0.2412 => 0.2429, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 0.57% (0.5986 => 0.6020, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -3.62% (0.0497 => 0.0479, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.18% (0.3294 => 0.3300, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/strcat: -0.20% (0.1997 => 0.1993, std.dev.: 0.0011) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.62% (0.0247 => 0.0243, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -10.95% (0.0210 => 0.0187, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 12.91% (0.0364 => 0.0411, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.68% (0.0329 => 0.0284, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0311 => 0.0311, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -12.59% (0.0421 => 0.0368, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/casts: 17.54% (0.0171 => 0.0201, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -20.10% (0.0199 => 0.0159, std.dev.: 0.0028) SingleSource/UnitTests/byval-alignment: 3.46% (0.0347 => 0.0359, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.48% (0.1472 => 0.1479, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.18% (1.1449 => 1.1314, std.dev.: 0.0170) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -0.27% (0.1460 => 0.1456, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.15% (0.3972 => 0.3966, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.45% (0.1387 => 0.1421, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.27% (0.0619 => 0.0664, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 23.11% (0.0225 => 0.0277) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.56% (0.0576 => 0.0567, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.03% (1.1427 => 1.1430, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.67% (0.0628 => 0.0561, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 36.99% (0.0173 => 0.0237, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.02% (0.8018 => 0.7936, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: -100.00% (0.0001 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0077 => 0.0077, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.89% (2.1832 => 1.6616, std.dev.: 0.0252) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.42% (0.0810 => 0.0943, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.58% (0.2279 => 0.2429, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.28% (0.2180 => 0.2317, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.06% (0.3137 => 0.3327, std.dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.89% (0.1885 => 0.1996, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.50% (0.8148 => 0.8596, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.33% (0.7473 => 0.7871, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.14% (0.6010 => 0.6319, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.72% (0.4847 => 0.5076, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.72% (0.2519 => 0.2638, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.30% (0.2998 => 0.3127, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.58% (0.9435 => 0.9773, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 3.43% (1.2222 => 1.2641, std.dev.: 0.0084) MultiSource/Applications/hbd/hbd: 2.96% (1.4269 => 1.4692, std.dev.: 0.0080) MultiSource/Applications/spiff/spiff: 2.96% (0.7950 => 0.8185, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.81% (1.3279 => 1.3652, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.67% (0.5961 => 0.6120, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.59% (0.6287 => 0.6450, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.45% (0.8457 => 0.8664, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.34% (0.4783 => 0.4895, std.dev.: 0.0031) SingleSource/UnitTests/Vector/constpool: 2.23% (8.4179 => 8.6055, std.dev.: 0.0575) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.23% (1.1685 => 1.1945, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.22% (1.1606 => 1.1864, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.10% (1.4479 => 1.4783, std.dev.: 0.0068) MultiSource/Applications/treecc/treecc: 1.87% (1.9948 => 2.0321, std.dev.: 0.0079) MultiSource/Applications/lua/lua: 1.43% (3.8189 => 3.8737, std.dev.: 0.0147) MultiSource/Applications/hexxagon/hexxagon: 1.41% (0.9810 => 0.9948, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 1.33% (14.2605 => 14.4504, std.dev.: 0.0180) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.28% (6.6074 => 6.6919, std.dev.: 0.0328) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.24% (13.1811 => 13.3439, std.dev.: 0.0129) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.21% (1.1170 => 1.1305, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.78% (1.5795 => 2.5080, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.76% (1.1857 => 1.2777, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: 5.94% (63.1822 => 66.9331, std.dev.: 0.0152) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.61% (2.4490 => 2.5373, std.dev.: 0.0281) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.38% (1.5941 => 1.6320, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 2.19% (3.6643 => 3.7444, std.dev.: 0.0145) MultiSource/Benchmarks/Olden/bh/bh: 1.55% (2.3560 => 2.3925, std.dev.: 0.0121) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.91% (0.3269 => 0.2945, std.dev.: 0.0037) MultiSource/Applications/lua/lua: -4.87% (29.8330 => 28.3809, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/hash2: -1.32% (3.4237 => 3.3784, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.25% (3.3479 => 3.3062, std.dev.: 0.0030) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.31% (16.4461 => 16.4970, std.dev.: 0.0888) MultiSource/Applications/obsequi/Obsequi: 2.61% (1.0262 => 1.0530, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: 0.66% (0.6332 => 0.6374, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/08-main/main: 4.21% (0.1831 => 0.1908, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 6.35% (0.1559 => 0.1658, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.81% (0.3123 => 0.3242, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.14% (0.2463 => 0.2491, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.39% (0.3344 => 0.3331, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.75% (0.2364 => 0.2429, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 0.17% (0.6010 => 0.6020, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: 11.66% (0.0429 => 0.0479, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.04% (0.3266 => 0.3300, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/strcat: 1.22% (0.1969 => 0.1993, std.dev.: 0.0011) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.48% (0.0224 => 0.0243, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 52.03% (0.0123 => 0.0187, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.74% (0.0408 => 0.0411, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 11.81% (0.0254 => 0.0284, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.98% (0.0302 => 0.0311, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -4.17% (0.0384 => 0.0368, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/casts: 5.79% (0.0190 => 0.0201, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -11.67% (0.0180 => 0.0159, std.dev.: 0.0028) SingleSource/UnitTests/byval-alignment: 56.09% (0.0230 => 0.0359, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.85% (0.1438 => 0.1479, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.13% (1.1329 => 1.1314, std.dev.: 0.0170) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -0.41% (0.1462 => 0.1456, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.76% (0.4164 => 0.3966, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.80% (0.1369 => 0.1421, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.59% (0.0641 => 0.0664, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.90% (0.0578 => 0.0567, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.06% (1.1437 => 1.1430, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.53% (0.0627 => 0.0561, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 31.67% (0.0180 => 0.0237, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.01% (0.8017 => 0.7936, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 24.19% (0.0062 => 0.0077, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 23 10:48:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 23 Oct 2012 12:48:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121023174840.91D5F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5133?compare_to=5129&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5133, Order: 166479, Start Time: 2012-10-23 16:23:45, End Time: 2012-10-23 17:51:44 To: 5129, Order: 166478, Start Time: 2012-10-23 12:42:28, End Time: 2012-10-23 14:10:22 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 1 (213 on baseline) Performance Improvements: 0 (36 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1041 (655 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 13.87% (0.4327 => 0.4927, std.dev.: 0.0121) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/vla: 31.48% (0.0324 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/treeadd/treeadd: 25.64% (0.0390 => 0.0490, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 24.29% (2.0176 => 2.5077, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.04% (0.1410 => 0.1749, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.39% (0.0746 => 0.0913, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 21.48% (0.7710 => 0.9366, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 21.42% (0.1013 => 0.1230, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 19.84% (0.2243 => 0.2688, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 19.75% (0.0653 => 0.0782, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 19.49% (0.0826 => 0.0987, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.77% (0.0618 => 0.0734, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 18.33% (0.1986 => 0.2350, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 18.18% (0.5637 => 0.6662, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 17.86% (0.2721 => 0.3207, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.79% (0.0725 => 0.0854, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.78% (0.0720 => 0.0848, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.76% (0.2596 => 0.3057, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 17.66% (0.0770 => 0.0906, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.63% (0.0811 => 0.0954, std.dev.: 0.0008) SingleSource/UnitTests/2006-12-11-LoadConstants: 17.44% (0.1072 => 0.1259, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 17.42% (0.1062 => 0.1247, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.24% (0.0847 => 0.0993, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 17.15% (0.1003 => 0.1175, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.73% (0.7460 => 0.8708, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.67% (0.0648 => 0.0756, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/mst/mst: 16.65% (0.1111 => 0.1296, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.47% (0.1075 => 0.1252, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/messages-2: 16.45% (0.0614 => 0.0715, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 16.45% (0.9199 => 1.0712, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 16.24% (0.0622 => 0.0723) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.03% (0.2914 => 0.3381, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.85% (0.1413 => 0.1637, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 15.83% (0.0834 => 0.0966, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.75% (0.0654 => 0.0757, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 15.69% (1.3693 => 1.5841, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 15.67% (0.5265 => 0.6090, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.66% (0.6959 => 0.8049, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.60% (0.1327 => 0.1534, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.44% (0.1276 => 0.1473, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.35% (0.0977 => 0.1127, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.14% (0.0819 => 0.0943, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.99% (0.1014 => 0.1166, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 14.85% (0.7038 => 0.8083, std.dev.: 0.0215) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.83% (0.0964 => 0.1107, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 14.82% (0.1478 => 0.1697, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.80% (0.1865 => 0.2141, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 14.79% (1.1061 => 1.2697, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.71% (3.9660 => 4.5493, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 14.54% (0.1657 => 0.1898, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.52% (0.5577 => 0.6387, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 14.20% (0.3246 => 0.3707, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.19% (0.2023 => 0.2310, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: 14.03% (0.7506 => 0.8559, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 13.85% (0.1213 => 0.1381, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 13.80% (0.0768 => 0.0874, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.73% (0.2127 => 0.2419, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.70% (1.4563 => 1.6558, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.67% (1.1364 => 1.2918, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.65% (0.1048 => 0.1191, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.54% (0.4379 => 0.4972, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.54% (0.1588 => 0.1803, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.53% (0.1789 => 0.2031, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 13.51% (3.8646 => 4.3866, std.dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.50% (1.2193 => 1.3839, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/distray/distray: 13.45% (0.0818 => 0.0928, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 13.44% (0.2925 => 0.3318, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.05% (0.1157 => 0.1308, std.dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 12.95% (13.8202 => 15.6103, std.dev.: 0.0163) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 12.94% (0.0804 => 0.0908, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.85% (0.0825 => 0.0931, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 12.75% (0.2995 => 0.3377, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 12.71% (0.4328 => 0.4878, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.53% (0.6283 => 0.7070, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 12.48% (0.4062 => 0.4569, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 12.45% (0.3220 => 0.3621, std.dev.: 0.0081) MultiSource/Applications/treecc/treecc: 12.36% (1.9270 => 2.1651, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.98% (0.3899 => 0.4366, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 11.89% (7.2180 => 8.0762, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 11.89% (0.0976 => 0.1092, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.82% (0.3130 => 0.3500, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 11.81% (1.3245 => 1.4809, std.dev.: 0.0086) MultiSource/Applications/lemon/lemon: 11.74% (1.0313 => 1.1524, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.71% (0.4791 => 0.5352, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 11.58% (0.1589 => 0.1773, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.57% (0.1435 => 0.1601, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 11.49% (0.6744 => 0.7519, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.47% (0.1569 => 0.1749, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.40% (0.2140 => 0.2384, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 11.30% (2.1791 => 2.4254, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.25% (0.2321 => 0.2582, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 11.23% (0.8310 => 0.9243, std.dev.: 0.0046) MultiSource/Applications/kimwitu++/kc: 11.09% (16.6129 => 18.4553, std.dev.: 0.0101) SingleSource/UnitTests/ObjC++/property-reference-object: 11.05% (0.5818 => 0.6461, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 11.00% (0.7061 => 0.7838, std.dev.: 0.0018) MultiSource/Applications/d/make_dparser: 10.99% (3.1889 => 3.5393, std.dev.: 0.0100) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.84% (0.4390 => 0.4866, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.81% (0.4016 => 0.4450, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 10.77% (4.3801 => 4.8520, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 10.75% (4.4433 => 4.9208, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.74% (0.2243 => 0.2484, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 10.70% (0.5748 => 0.6363, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 10.69% (3.6692 => 4.0615, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.65% (0.3485 => 0.3856, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.63% (0.3489 => 0.3860, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 10.61% (0.2781 => 0.3076, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 10.60% (0.4113 => 0.4549, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.57% (0.3756 => 0.4153, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.51% (0.6135 => 0.6780, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.49% (0.8698 => 0.9610, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 10.48% (0.3293 => 0.3638, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 10.44% (0.0977 => 0.1079) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.42% (0.3022 => 0.3337, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.36% (0.3580 => 0.3951, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.35% (0.2782 => 0.3070, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.26% (4.9865 => 5.4983, std.dev.: 0.0464) SingleSource/Benchmarks/Shootout-C++/sieve: 10.25% (0.3453 => 0.3807, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.23% (0.1819 => 0.2005, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 10.16% (0.3868 => 0.4261, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.06% (0.2655 => 0.2922, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 10.05% (0.3534 => 0.3889, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 10.03% (0.2761 => 0.3038, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 10.00% (1.0594 => 1.1653, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.97% (1.9828 => 2.1805, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/except: 9.93% (0.2760 => 0.3034, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.91% (0.2966 => 0.3260, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 9.90% (0.2726 => 0.2996, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 9.82% (0.2607 => 0.2863, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.80% (0.3511 => 0.3855, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 9.70% (0.2690 => 0.2951, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 9.67% (0.2937 => 0.3221, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 9.66% (0.3107 => 0.3407, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 9.62% (0.3149 => 0.3452, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 9.59% (0.2628 => 0.2880, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.58% (0.2765 => 0.3030, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 9.41% (3.7467 => 4.0992, std.dev.: 0.0143) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.40% (0.6576 => 0.7194, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 9.37% (14.8535 => 16.2451, std.dev.: 0.0236) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.34% (1.5188 => 1.6607, std.dev.: 0.0277) SingleSource/Benchmarks/Shootout-C++/ary2: 9.34% (0.3192 => 0.3490, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 9.30% (0.2988 => 0.3266, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 9.29% (0.3131 => 0.3422, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.27% (0.2696 => 0.2946, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 9.26% (1.1333 => 1.2383, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 9.26% (1.2749 => 1.3929, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.21% (0.3755 => 0.4101, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 9.13% (0.2945 => 0.3214, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 8.95% (8.4961 => 9.2569, std.dev.: 0.0208) MultiSource/Benchmarks/FreeBench/neural/neural: 8.95% (0.1385 => 0.1509, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.71% (0.9108 => 0.9901, std.dev.: 0.0177) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.60% (0.8818 => 0.9576, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.45% (3.2742 => 3.5509, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/bigfib: 8.45% (0.6250 => 0.6778, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 8.45% (6.5754 => 7.1307, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.39% (0.4805 => 0.5208, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.35% (0.3245 => 0.3516, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 8.31% (4.6629 => 5.0506, std.dev.: 0.0110) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.31% (0.2504 => 0.2712, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.28% (2.1007 => 2.2746, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.08% (6.2785 => 6.7856, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/oourafft: 8.07% (0.2008 => 0.2170, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: 7.88% (0.1777 => 0.1917, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 7.57% (1.2292 => 1.3223, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.49% (13.2842 => 14.2796, std.dev.: 0.0164) SingleSource/UnitTests/ObjC/parameter-passing: 6.65% (0.4003 => 0.4269, std.dev.: 0.0084) SingleSource/UnitTests/ObjC/exceptions: 6.44% (0.3914 => 0.4166, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.38% (0.3650 => 0.3883, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 6.32% (0.3940 => 0.4189, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 6.07% (0.3789 => 0.4019, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 6.01% (0.3578 => 0.3793, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 5.98% (0.3646 => 0.3864, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 5.92% (0.3663 => 0.3880, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 5.91% (16.2614 => 17.2219, std.dev.: 0.0295) SingleSource/UnitTests/ObjC/exceptions-2: 5.83% (0.3601 => 0.3811, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.79% (14.5298 => 15.3718, std.dev.: 0.0188) SingleSource/UnitTests/ObjC/exceptions-3: 5.71% (0.3623 => 0.3830, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 5.53% (0.2859 => 0.3017, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 3.04% (33.2944 => 34.3060, std.dev.: 0.0241) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.24% (0.1824 => 0.3543, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.73% (0.4846 => 0.6965, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/methcall: 30.64% (5.7573 => 7.5211, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/fbench: 24.16% (1.8175 => 2.2566, std.dev.: 0.0430) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.08% (1.0895 => 1.2756, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 11.03% (1.1560 => 1.2835, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.80% (2.8813 => 3.1924, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 9.04% (0.8273 => 0.9021, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 8.85% (0.1322 => 0.1439, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-4: 6.54% (1.0640 => 1.1336, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.46% (0.9692 => 1.0221) SingleSource/Benchmarks/Misc/mandel-2: 5.32% (1.2998 => 1.3689, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.92% (0.3458 => 0.3628, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-5: 4.72% (1.9144 => 2.0048, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.68% (0.3139 => 0.3286, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 4.50% (0.5449 => 0.5694, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.50% (2.8606 => 2.9892, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.94% (1.7081 => 1.7754, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6787, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: 3.48% (1.9199 => 1.9868, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 3.46% (12.0921 => 12.5102, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.38% (10.7476 => 11.1110, std.dev.: 0.0248) MultiSource/Applications/lemon/lemon: 3.05% (1.4298 => 1.4734, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bisort/bisort: 2.94% (0.8239 => 0.8481, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0310 => 1.0561, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 2.26% (1.9863 => 2.0312, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 2.21% (7.4271 => 7.5911, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.51% (2.0200 => 2.0505, std.dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: 1.44% (8.3908 => 8.5120, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.30% (3.1720 => 3.2132, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1882, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 1.18% (5.5130 => 5.5782, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2140, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 1.12% (3.1071 => 3.1419, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.05% (9.9194 => 10.0234, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/queens: 1.01% (2.1753 => 2.1973, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -45.73% (0.2670 => 0.1449, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.79% (0.4657 => 0.3875, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.32% (1.3813 => 1.2388, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.24% (1.3819 => 1.2404, std.dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -99.99% (8.6002 => 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.23% (1.0460 => 0.8553, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/mason/mason: -12.82% (0.2238 => 0.1951, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.18% (20.3410 => 18.2702, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -6.15% (1.9290 => 1.8104, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.99% (1.3780 => 1.2954, std.dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/dry: -5.35% (2.5089 => 2.3746, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -4.99% (2.6470 => 2.5148, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.80% (0.9996 => 0.9516, std.dev.: 0.0150) SingleSource/Benchmarks/Misc/perlin: -4.46% (6.2497 => 5.9711, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.83% (1.7688 => 1.7011, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.94% (0.4867 => 0.4724, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -2.88% (3.2729 => 3.1788, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.70% (4.1080 => 3.9971, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: -2.70% (1.9762 => 1.9229, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -2.70% (5.0168 => 4.8815, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4786, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -2.33% (1.3891 => 1.3567) MultiSource/Applications/spiff/spiff: -2.28% (3.0263 => 2.9574, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.18% (0.6615 => 0.6471, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.87% (0.6589 => 0.6466, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.72% (6.3560 => 6.2468, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/fp-convert: -1.65% (3.4016 => 3.3456, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.61% (2.5254 => 2.4848, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -1.51% (7.1097 => 7.0021, std.dev.: 0.0010) MultiSource/Applications/lua/lua: -1.49% (26.5159 => 26.1220, std.dev.: 0.0360) MultiSource/Benchmarks/mafft/pairlocalalign: -1.42% (28.2225 => 27.8229, std.dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (5.3167 => 5.2551, std.dev.: 0.0040) MultiSource/Applications/aha/aha: -1.05% (3.1476 => 3.1144, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -1.05% (84.4286 => 83.5406, std.dev.: 0.0121) MultiSource/Applications/viterbi/viterbi: -1.05% (4.4810 => 4.4340, std.dev.: 0.0042) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 23 11:18:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 23 Oct 2012 13:18:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121023181807.C3B232A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5134?compare_to=5130&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5134, Order: 166478, Start Time: 2012-10-23 15:03:36, End Time: 2012-10-23 18:20:12 To: 5130, Order: 166475, Start Time: 2012-10-23 10:59:34, End Time: 2012-10-23 14:15:41 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (172 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1041 (717 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.87% (0.2112 => 0.2236, std.dev.: 0.0027) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 39.68% (0.0625 => 0.0873, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.42% (0.1063 => 0.1397, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.14% (0.2969 => 0.3745, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.05% (0.1106 => 0.1383, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.38% (0.4139 => 0.5148, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.37% (0.0714 => 0.0888, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 24.07% (1.5932 => 1.9767, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.03% (0.5900 => 0.7318, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.87% (0.4994 => 0.6186, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.58% (0.0475 => 0.0587, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.28% (0.5000 => 0.6164, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.03% (0.0547 => 0.0673, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.72% (0.1620 => 0.1988, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.60% (0.0584 => 0.0716, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.43% (0.1021 => 0.1250, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.19% (0.0897 => 0.1096, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.95% (0.1107 => 0.1350, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 21.87% (0.0599 => 0.0730, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 21.87% (0.4253 => 0.5183, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/em3d/em3d: 21.20% (0.0948 => 0.1149, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.89% (0.0584 => 0.0706, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.85% (0.0633 => 0.0765, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.72% (0.0642 => 0.0775, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 20.63% (0.1619 => 0.1953, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 20.58% (0.0821 => 0.0990, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.58% (0.1103 => 0.1330, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.40% (0.0495 => 0.0596, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.32% (0.0822 => 0.0989, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.16% (0.3903 => 0.4690, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.15% (0.0541 => 0.0650, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.14% (0.1003 => 0.1205, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 20.03% (0.0604 => 0.0725, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.88% (0.1549 => 0.1857, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.83% (0.1604 => 0.1922, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 19.32% (0.0947 => 0.1130, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.60% (0.1462 => 0.1734, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.47% (0.2014 => 0.2386, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 18.44% (0.4029 => 0.4772, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: 18.39% (0.1218 => 0.1442, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.38% (0.2736 => 0.3239, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.36% (1.3152 => 1.5567, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.33% (0.3890 => 0.4603, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/09-vor/vor: 18.07% (0.1505 => 0.1777, std.dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 18.07% (0.0808 => 0.0954, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/mst/mst: 17.91% (0.0698 => 0.0823, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 17.89% (0.5826 => 0.6868, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.79% (0.2866 => 0.3376, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.67% (0.5026 => 0.5914, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.65% (0.1088 => 0.1280, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference-object: 17.63% (0.5889 => 0.6927, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.43% (3.5627 => 4.1838, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 17.22% (0.5546 => 0.6501, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.18% (0.2875 => 0.3369, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 17.15% (1.8794 => 2.2017, std.dev.: 0.0039) MultiSource/Applications/hbd/hbd: 17.11% (0.9697 => 1.1356, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hello: 17.06% (0.2714 => 0.3177, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.98% (0.1160 => 0.1357, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.97% (0.1968 => 0.2302, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.94% (0.4658 => 0.5447, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.91% (1.6211 => 1.8952, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/fibo: 16.84% (0.2725 => 0.3184, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 16.82% (0.1421 => 0.1660, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 16.76% (0.7171 => 0.8373, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 16.69% (0.0605 => 0.0706, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.65% (2.7292 => 3.1837, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.58% (0.2738 => 0.3192, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 16.47% (0.2750 => 0.3203, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.45% (0.2729 => 0.3178, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 16.40% (0.2780 => 0.3236, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.36% (0.3271 => 0.3806, std.dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 16.28% (0.3004 => 0.3493, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 16.22% (1.0781 => 1.2530, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 16.21% (0.3096 => 0.3598, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 16.19% (0.2811 => 0.3266, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.18% (2.0673 => 2.4018, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.15% (0.2792 => 0.3243, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 16.14% (0.2813 => 0.3267, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/random: 16.13% (0.2803 => 0.3255, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 16.12% (0.1284 => 0.1491, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.09% (0.3195 => 0.3709, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 16.08% (0.2823 => 0.3277, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.07% (0.4361 => 0.5062, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 16.05% (0.3258 => 0.3781, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 15.99% (4.2109 => 4.8841, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.94% (0.2911 => 0.3375, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.92% (0.3060 => 0.3547, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/ary3: 15.89% (0.3267 => 0.3786, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.86% (1.9694 => 2.2817, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.85% (0.3930 => 0.4553, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 15.84% (0.9909 => 1.1479, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-4: 15.70% (0.3465 => 0.4009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.69% (1.9966 => 2.3098, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.57% (0.3488 => 0.4031, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.44% (4.4195 => 5.1018, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/for-in: 15.30% (0.3496 => 0.4031, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 15.28% (0.3317 => 0.3824, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 15.24% (0.3446 => 0.3971, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.23% (0.1090 => 0.1256, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.20% (0.3124 => 0.3599, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.20% (0.3362 => 0.3873, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 15.14% (0.3460 => 0.3984, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 15.14% (0.3442 => 0.3963, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 15.13% (0.3469 => 0.3994, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 15.13% (23.5202 => 27.0779, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/lists1: 15.01% (0.3477 => 0.3999, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 15.00% (0.2566 => 0.2951, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 14.82% (0.3678 => 0.4223, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 14.81% (0.3348 => 0.3844, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/property: 14.77% (0.3650 => 0.4189, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.75% (0.3282 => 0.3766, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.69% (0.3845 => 0.4410, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 14.66% (0.3643 => 0.4177, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 14.57% (0.4146 => 0.4750, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.57% (0.3625 => 0.4153, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 14.55% (0.3726 => 0.4268, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: 14.53% (0.3724 => 0.4265, std.dev.: 0.0019) MultiSource/Applications/lua/lua: 14.34% (1.4269 => 1.6315, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/football/football: 14.27% (0.2075 => 0.2371, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 14.07% (0.7875 => 0.8983, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash2: 14.00% (0.4251 => 0.4846, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.99% (0.3981 => 0.4538, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.98% (0.3690 => 0.4206, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 13.63% (2.1653 => 2.4605, std.dev.: 0.0088) MultiSource/Applications/JM/lencod/lencod: 13.40% (4.6177 => 5.2365, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 13.25% (0.5012 => 0.5676, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 13.23% (2.1013 => 2.3793, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.65% (0.2040 => 0.2298, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 12.15% (0.2691 => 0.3018, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.92% (0.6435 => 0.7202, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 11.82% (5.5417 => 6.1968, std.dev.: 0.0217) MultiSource/Applications/lambda-0_1_3/lambda: 11.35% (0.3498 => 0.3895, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.19% (0.1028 => 0.1143, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 10.97% (0.6634 => 0.7362, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.96% (0.2737 => 0.3037, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.83% (0.2068 => 0.2292, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.64% (0.3084 => 0.3412, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.63% (0.1383 => 0.1530, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 10.52% (0.3336 => 0.3687, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 10.32% (0.4847 => 0.5347, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.89% (0.2103 => 0.2311) MultiSource/Applications/sqlite3/sqlite3: 9.47% (2.0346 => 2.2272, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: 9.16% (0.2391 => 0.2610, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.87% (4.6926 => 5.1086, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.66% (0.5361 => 0.5825, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.35% (11.6398 => 12.6121, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.86% (0.7426 => 0.8010, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.77% (0.5584 => 0.6018, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 6.71% (11.9555 => 12.7572, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.80% (0.3792 => 0.4012, std.dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.37% (0.2162 => 0.3532, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6536, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 7.39% (0.2802 => 0.3009, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6110, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.69% (0.3693 => 0.3903, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 5.37% (0.2122 => 0.2236, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/objinst: 5.06% (12.0509 => 12.6612, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1663, std.dev.: 0.0803) SingleSource/Benchmarks/Misc/flops-2: 3.66% (1.8057 => 1.8717, std.dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/dry: 2.74% (14.0481 => 14.4326, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1957, std.dev.: 0.0057) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.69% (3.1722 => 3.2258, std.dev.: 0.0043) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3078, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2859, std.dev.: 0.0021) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5141, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5403, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5954, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.15% (2.4764 => 2.3736, std.dev.: 0.0146) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.47% (25.4195 => 16.4024, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary2: -8.08% (0.2402 => 0.2208, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9774, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -7.69% (35.5013 => 32.7730, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7741, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.96% (0.6293 => 0.6107, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/mandel-2: -2.89% (3.6262 => 3.5214, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.78% (11.2080 => 10.8963, std.dev.: 0.0288) SingleSource/Benchmarks/Dhrystone/fldry: -2.34% (17.2379 => 16.8349, std.dev.: 0.0174) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8680, std.dev.: 0.0096) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.81% (10.7630 => 10.5685, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4958, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7160, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.13% (105.3826 => 104.1931, std.dev.: 0.0105) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.06% (3.3991 => 3.3632, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0464, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 23 05:43:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 23 Oct 2012 07:43:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121023124327.CA98F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5128?compare_to=5125&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5128, Order: 166478, Start Time: 2012-10-23 11:25:20, End Time: 2012-10-23 12:45:30 To: 5125, Order: 166474, Start Time: 2012-10-23 09:36:24, End Time: 2012-10-23 10:55:30 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 12 (5 on baseline) Performance Regressions: 1 (194 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 88 (14 on baseline) Unchanged Tests: 941 (648 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lua/lua MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg SingleSource/UnitTests/Vector/multiplies MultiSource/Applications/ClamAV/clamscan: 3.86% (20.1509 => 20.9295, std.dev.: 0.0315) MultiSource/Applications/lua/lua: 3.29% (4.2285 => 4.3677, std.dev.: 0.0104) MultiSource/Benchmarks/MallocBench/gs/gs: 0.43% (4.6299 => 4.6496, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 117.56% (0.0615 => 0.1338, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 0.64% (5.6032 => 5.6388, std.dev.: 0.0041) SingleSource/UnitTests/Vector/multiplies: 68.91% (0.0193 => 0.0326, std.dev.: 0.0009) New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lua/lua MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg SingleSource/UnitTests/Vector/multiplies MultiSource/Applications/ClamAV/clamscan: 169400.00% (0.0001 => 0.1695, std.dev.: 0.0054) MultiSource/Applications/lua/lua: 26007200.00% (0.0001 => 26.0073, std.dev.: 0.0173) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 20200.00% (0.0001 => 0.0203) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3600.00% (0.0001 => 0.0037, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: 2510200.00% (0.0001 => 2.5103, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.15% (1.0828 => 1.0953, std.dev.: 0.0024) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.05% (0.6256 => 0.6253, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: -0.15% (17.2539 => 17.2282, std.dev.: 0.0180) MultiSource/Applications/kimwitu++/kc: -0.02% (15.6075 => 15.6038, std.dev.: 0.0215) MultiSource/Benchmarks/Bullet/bullet: 0.01% (56.1157 => 56.1237, std.dev.: 0.0267) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.21% (0.0486 => 0.0485, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0487 => 0.0487, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0456 => 0.0456, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0457 => 0.0457, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0445 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0445 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0438 => 0.0438, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.23% (0.0440 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.22% (0.0456 => 0.0455, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.22% (0.0457 => 0.0458) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0450 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0451 => 0.0451) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.23% (0.0441 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0441 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0447 => 0.0447, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0448 => 0.0448, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.22% (0.0459 => 0.0458, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0460 => 0.0460, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0435 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0436 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.22% (0.0448 => 0.0447) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.22% (0.0449 => 0.0448, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0439 => 0.0439) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0439 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0431 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0432 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.23% (0.0430 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0430 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.21% (0.0466 => 0.0467, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0467 => 0.0467, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.23% (0.0429 => 0.0430, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.23% (0.0430 => 0.0429, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.23% (0.0430 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.23% (0.0432 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.23% (0.0437 => 0.0438, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.23% (0.0438 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.02% (1.4927 => 1.4930, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.02% (8.2196 => 8.2183, std.dev.: 0.0137) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.15% (0.6865 => 0.6855, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1436 => 0.1436, std.dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.05% (0.0668 => 0.0675, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.26% (63.2438 => 56.1237, std.dev.: 0.0267) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/MallocBench/gs/gs: 13.12% (4.1105 => 4.6496, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.51% (3.4629 => 5.8007, std.dev.: 0.0134) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13513.33% (0.0720 => 9.8016, std.dev.: 0.0112) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050400.00% (0.0001 => 10.0505, std.dev.: 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 64.37% (0.2554 => 0.4198, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: 57.42% (0.0256 => 0.0403, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: 48.72% (10.3673 => 15.4186, std.dev.: 0.0035) SingleSource/UnitTests/SignlessTypes/factor: 46.62% (0.0296 => 0.0434, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 42.80% (0.0271 => 0.0387, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 41.31% (0.1622 => 0.2292, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.06% (1.5859 => 2.2371, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/distray/distray: 36.46% (0.1056 => 0.1441, std.dev.: 0.0032) SingleSource/UnitTests/vla: 32.96% (0.0355 => 0.0472, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.14% (2.2024 => 2.8663, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: 25.84% (0.1463 => 0.1841, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 23.98% (0.0834 => 0.1034, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.20% (0.1566 => 0.1898, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: 20.62% (0.0485 => 0.0585, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 20.35% (0.2049 => 0.2466, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.28% (7.0540 => 8.4141, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/flops: 18.85% (0.1432 => 0.1702, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 18.39% (0.1555 => 0.1841, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.25% (0.0871 => 0.1030, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.98% (0.5105 => 0.6023, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.79% (2.2022 => 2.5940, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.09% (0.6675 => 0.7816, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: 16.77% (0.0626 => 0.0731, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 16.70% (0.1695 => 0.1978, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 16.68% (0.1655 => 0.1931, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.52% (1.3050 => 1.5206, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.52% (0.0793 => 0.0924, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 16.43% (0.1175 => 0.1368, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 16.39% (0.1440 => 0.1676, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 16.38% (3.3354 => 3.8818, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.26% (0.8172 => 0.9501, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/mst/mst: 16.25% (0.1163 => 0.1352, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.20% (0.2271 => 0.2639, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.95% (0.4615 => 0.5351, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.58% (0.0886 => 0.1024, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.56% (0.1337 => 0.1545, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.50% (0.1032 => 0.1192, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 15.48% (10.4361 => 12.0516, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.46% (0.5020 => 0.5796, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.45% (1.5415 => 1.7797, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 15.41% (0.0798 => 0.0921, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 15.30% (0.1438 => 0.1658, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 15.23% (0.3282 => 0.3782, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.20% (0.0842 => 0.0970, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.10% (0.1510 => 0.1738, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.96% (0.2065 => 0.2374, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/17-bintr/bintr: 14.96% (0.0675 => 0.0776, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 14.95% (0.7115 => 0.8179, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.95% (0.1940 => 0.2230, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 14.92% (0.3109 => 0.3573, std.dev.: 0.0074) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.87% (0.3121 => 0.3585, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.76% (0.9765 => 1.1206, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 14.64% (0.3423 => 0.3924, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/matrix: 14.55% (0.0818 => 0.0937, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.55% (0.0770 => 0.0882, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.47% (0.5860 => 0.6708, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: 14.43% (1.1642 => 1.3322, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.34% (0.0746 => 0.0853, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.34% (4.2646 => 4.8760, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.32% (0.2758 => 0.3153, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.24% (0.2107 => 0.2407, std.dev.: 0.0016) MultiSource/Applications/aha/aha: 14.16% (0.1151 => 0.1314, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.15% (0.1117 => 0.1275, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/exptree: 14.13% (0.0814 => 0.0929) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.00% (0.1236 => 0.1409, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.96% (0.0838 => 0.0955, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.96% (0.1906 => 0.2172, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 13.89% (0.6450 => 0.7346, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 13.89% (0.1584 => 0.1804, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.83% (0.0933 => 0.1062, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 13.81% (9.4845 => 10.7941, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.81% (0.1695 => 0.1929, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.74% (0.5981 => 0.6803, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 13.69% (0.7835 => 0.8908, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.62% (1.4186 => 1.6118, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.61% (0.1029 => 0.1169, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.53% (8.1363 => 9.2371, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.52% (1.7609 => 1.9989, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.51% (0.0770 => 0.0874, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 13.37% (0.7433 => 0.8427, std.dev.: 0.0036) MultiSource/Applications/oggenc/oggenc: 13.37% (5.7591 => 6.5290, std.dev.: 0.0081) MultiSource/Applications/treecc/treecc: 13.31% (2.0273 => 2.2972, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.28% (0.1062 => 0.1203, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.11% (0.2700 => 0.3054, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.11% (0.1625 => 0.1838, std.dev.: 0.0049) MultiSource/Benchmarks/nbench/nbench: 12.96% (1.1840 => 1.3375, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/health/health: 12.93% (0.1268 => 0.1432, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/rem: 12.85% (0.1144 => 0.1291, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.83% (0.8067 => 0.9102, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.81% (4.9449 => 5.5785, std.dev.: 0.0103) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.81% (0.0929 => 0.1048, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.80% (0.5569 => 0.6282, std.dev.: 0.0019) MultiSource/Applications/lua/lua: 12.79% (3.8723 => 4.3677, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.75% (0.4879 => 0.5501, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.74% (5.0018 => 5.6388, std.dev.: 0.0041) MultiSource/Applications/lemon/lemon: 12.69% (1.0722 => 1.2083, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 12.63% (0.4299 => 0.4842, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 12.43% (0.3387 => 0.3808, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.33% (0.1330 => 0.1494, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.22% (1.1861 => 1.3310, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.06% (0.2603 => 0.2917, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 12.04% (0.3180 => 0.3563, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.97% (0.3307 => 0.3703, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.97% (0.3441 => 0.3853, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.93% (0.3177 => 0.3556, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 11.92% (0.8921 => 0.9984, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.88% (7.9617 => 8.9075, std.dev.: 0.0100) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.64% (0.1143 => 0.1276, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.56% (0.1125 => 0.1255, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.53% (0.8101 => 0.9035, std.dev.: 0.0021) MultiSource/Applications/hbd/hbd: 11.44% (1.5603 => 1.7388, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: 11.42% (0.3092 => 0.3445, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 10.86% (0.6456 => 0.7157) MultiSource/Applications/siod/siod: 10.65% (2.2969 => 2.5415, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.57% (0.1892 => 0.2092, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.55% (0.2266 => 0.2505, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 9.96% (0.1044 => 0.1148, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 9.93% (21.9371 => 24.1162, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.71% (0.3543 => 0.3887, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 9.51% (0.4289 => 0.4697, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: 9.32% (0.3927 => 0.4293, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 9.29% (0.4620 => 0.5049, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.20% (0.3543 => 0.3869, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.17% (0.3828 => 0.4179, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.16% (0.3473 => 0.3791, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.15% (0.3694 => 0.4032, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.09% (0.3497 => 0.3815, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 9.07% (0.3561 => 0.3884, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.98% (0.3886 => 0.4235, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 8.93% (0.3516 => 0.3830, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.80% (0.4636 => 0.5044, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.80% (0.3865 => 0.4205, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.78% (0.3826 => 0.4162, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 8.77% (0.3422 => 0.3722, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.67% (0.3427 => 0.3724, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.64% (0.4203 => 0.4566, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 8.62% (17.1811 => 18.6614, std.dev.: 0.0178) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.60% (0.2430 => 0.2639, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.46% (0.4103 => 0.4450, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 8.15% (0.4048 => 0.4378, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 8.12% (0.3684 => 0.3983, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.87% (3.8922 => 4.1986, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.83% (14.3668 => 15.4921, std.dev.: 0.0152) SingleSource/UnitTests/ObjC++/property-reference-object: 7.60% (0.6030 => 0.6488, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.59% (0.3162 => 0.3402, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.56% (0.5925 => 0.6373, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.49% (0.7326 => 0.7875, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 7.47% (0.3603 => 0.3872, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.10% (0.3650 => 0.3909, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.91% (0.4064 => 0.4345, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.65% (0.3098 => 0.3304, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.59% (0.3232 => 0.3445, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.51% (0.2905 => 0.3094, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.47% (0.2891 => 0.3078, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/strcat: 6.39% (0.2831 => 0.3012, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.31% (0.3136 => 0.3334, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 6.31% (0.3283 => 0.3490, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.29% (2.0665 => 2.1965, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/fibo: 6.20% (0.2725 => 0.2894, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/except: 6.13% (0.2871 => 0.3047, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.09% (0.2872 => 0.3047, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.09% (0.2793 => 0.2963, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 5.98% (0.2877 => 0.3049, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.95% (0.2756 => 0.2920, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.93% (0.3052 => 0.3233, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 5.86% (0.3379 => 0.3577, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 5.77% (1.2842 => 1.3583, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hello: 5.64% (0.2714 => 0.2867, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 5.57% (0.2802 => 0.2958, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.01% (0.3131 => 0.3288, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.06% (1.1194 => 1.1537, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1725, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.95% (1.1145 => 1.2923, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.33% (0.9957 => 1.1284, std.dev.: 0.0087) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.58% (0.2944 => 0.3285, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.87% (1.1396 => 1.2521, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3684, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 5.89% (1.9405 => 2.0547, std.dev.: 0.0061) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.61% (0.3987 => 0.4091, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.60% (4.2280 => 4.3381, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0313 => 1.0567, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.96% (3.6395 => 3.7110, std.dev.: 0.0096) MultiSource/Benchmarks/Olden/bisort/bisort: 1.81% (0.8333 => 0.8484, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.57% (2.6546 => 2.6962, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2074, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 1.16% (4.4649 => 4.5166, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.09% (6.5088 => 6.5795, std.dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.00% (6.6874 => 0.1338, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -79.83% (0.8651 => 0.1745, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.88% (5.2763 => 3.2251, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.08% (5.3855 => 3.7117, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.72% (5.3526 => 3.7084, std.dev.: 0.0071) SingleSource/UnitTests/Vector/constpool: -14.63% (54.1659 => 46.2427, std.dev.: 0.0184) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.45% (2.9384 => 2.6313, std.dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: -5.62% (22.1758 => 20.9295, std.dev.: 0.0315) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.07% (8.0499 => 3.7778, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.36% (1.1492 => 0.7658, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4750, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.72% (1.6925 => 1.4265, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.69% (1.2258 => 1.0702, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.48% (1.2373 => 1.0953, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel-2: -10.84% (1.5373 => 1.3707, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.62% (19.9488 => 18.2288, std.dev.: 0.0381) MultiSource/Benchmarks/FreeBench/mason/mason: -7.96% (0.2161 => 0.1989, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.05% (1.8329 => 1.7037, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.62% (2.7294 => 2.5759, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.19% (1.6805 => 1.5933, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5085, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.33% (8.1563 => 7.8031, std.dev.: 0.0084) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1627, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8775, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4974, std.dev.: 0.0088) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.60% (0.4808 => 0.4683, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -2.15% (4.6441 => 4.5444, std.dev.: 0.0031) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6820, std.dev.: 0.0009) SingleSource/UnitTests/Vector/multiplies: -1.66% (2.5528 => 2.5103, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -1.65% (10.2830 => 10.1134, std.dev.: 0.0073) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4204, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2879, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 19.58% (0.5229 => 0.6253, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 14.94% (14.9895 => 17.2282, std.dev.: 0.0180) MultiSource/Applications/kimwitu++/kc: 10.23% (14.1553 => 15.6038, std.dev.: 0.0215) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 35.14% (1.1048 => 1.4930, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.81% (7.1582 => 8.2183, std.dev.: 0.0137) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.17% (0.6222 => 0.6855, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.30% (0.1485 => 0.1436, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.10% (0.2116 => 0.0675, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 23 07:07:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 23 Oct 2012 09:07:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121023140717.E5FF32A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/5129?compare_to=5127&baseline=6 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:1 Comparing: Run: 5129, Order: 166478, Start Time: 2012-10-23 12:42:28, End Time: 2012-10-23 14:10:22 To: 5127, Order: 166475, Start Time: 2012-10-23 10:44:38, End Time: 2012-10-23 12:12:30 Baseline: 6, Order: 153879, Start Time: 2012-04-02 17:48:39, End Time: 2012-04-02 18:44:53 =============== Tests Summary =============== Performance Regressions: 0 (211 on baseline) Performance Improvements: 0 (38 on baseline) Added Tests: 0 (138 on baseline) Unchanged Tests: 1042 (655 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/vla: 31.17% (0.0324 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 24.33% (2.0176 => 2.5085, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.83% (0.1410 => 0.1746, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.12% (0.0746 => 0.0911, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 21.21% (0.7710 => 0.9345, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/tsp/tsp: 21.13% (0.1013 => 0.1227, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 19.75% (0.0653 => 0.0782, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 19.66% (0.2243 => 0.2684, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 19.61% (0.0826 => 0.0988, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.61% (0.0618 => 0.0733, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 18.33% (0.1986 => 0.2350, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 18.09% (0.5637 => 0.6657, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 17.90% (0.2721 => 0.3208, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.80% (0.2596 => 0.3058, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.78% (0.0720 => 0.0848, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.66% (0.0725 => 0.0853, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.51% (0.0811 => 0.0953, std.dev.: 0.0009) SingleSource/UnitTests/2006-12-11-LoadConstants: 17.44% (0.1072 => 0.1259) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 17.40% (0.0770 => 0.0904, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 17.16% (0.7460 => 0.8740, std.dev.: 0.0108) MultiSource/Benchmarks/Olden/power/power: 17.15% (0.1003 => 0.1175, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.12% (0.0847 => 0.0992, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 16.76% (0.1062 => 0.1240, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.51% (0.0648 => 0.0755, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 16.50% (0.9199 => 1.0717, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 16.47% (0.1111 => 0.1294, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/messages-2: 16.45% (0.0614 => 0.0715) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.44% (0.2914 => 0.3393, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.37% (0.1075 => 0.1251, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 16.08% (0.0622 => 0.0722, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 15.83% (0.0834 => 0.0966, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.78% (0.1413 => 0.1636, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 15.76% (1.3693 => 1.5851, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 15.63% (0.5265 => 0.6088, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.61% (0.6959 => 0.8045, std.dev.: 0.0018) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.60% (0.0654 => 0.0756, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.52% (0.1327 => 0.1533, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.44% (0.1276 => 0.1473, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.35% (0.0977 => 0.1127, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 14.89% (0.7038 => 0.8086, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 14.88% (0.1478 => 0.1698, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.83% (0.0964 => 0.1107) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.79% (0.1014 => 0.1164) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.77% (0.0819 => 0.0940, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.75% (0.1865 => 0.2140, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.60% (3.9660 => 4.5451, std.dev.: 0.0023) MultiSource/Applications/Burg/burg: 14.60% (1.1061 => 1.2676, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/em3d/em3d: 14.36% (0.1657 => 0.1895, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.34% (0.2023 => 0.2313, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.24% (0.5577 => 0.6371, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 14.17% (0.3246 => 0.3706, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 14.10% (0.7506 => 0.8564, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.73% (0.2127 => 0.2419, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.68% (0.4379 => 0.4978) SingleSource/Benchmarks/McGill/exptree: 13.67% (0.0768 => 0.0873, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.64% (1.1364 => 1.2914, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.58% (1.4563 => 1.6541, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.55% (0.1048 => 0.1190, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.54% (0.1588 => 0.1803, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 13.52% (0.1213 => 0.1377, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.51% (1.2193 => 1.3840, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 13.48% (3.8646 => 4.3855, std.dev.: 0.0136) MultiSource/Benchmarks/McCat/09-vor/vor: 13.37% (0.2925 => 0.3316, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.36% (0.1789 => 0.2028, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 13.20% (0.0818 => 0.0926, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 12.88% (13.8202 => 15.6003, std.dev.: 0.0207) SingleSource/Benchmarks/Shootout-C++/hash2: 12.78% (0.4328 => 0.4881, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 12.69% (0.0804 => 0.0906, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.61% (0.0825 => 0.0929, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 12.59% (0.2995 => 0.3372, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.57% (0.6283 => 0.7073, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 12.51% (0.4062 => 0.4570, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 12.48% (0.3220 => 0.3622, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 12.18% (1.9270 => 2.1618, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.11% (0.3899 => 0.4371, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 11.92% (7.2180 => 8.0781, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 11.89% (0.0976 => 0.1092, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.85% (0.3130 => 0.3501, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 11.83% (1.0313 => 1.1533, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 11.72% (1.3245 => 1.4797, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.71% (0.4791 => 0.5352, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.54% (0.1569 => 0.1750, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 11.52% (0.6744 => 0.7521, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 11.50% (0.7061 => 0.7873, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.40% (0.2140 => 0.2384, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 11.39% (0.1589 => 0.1770, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 11.26% (2.1791 => 2.4245, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 11.22% (0.1435 => 0.1596, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.20% (0.2321 => 0.2581, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 11.13% (16.6129 => 18.4624, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/football/football: 11.13% (0.8310 => 0.9235, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 11.03% (0.5818 => 0.6460, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 10.86% (4.3801 => 4.8557, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.83% (0.3489 => 0.3867, std.dev.: 0.0039) MultiSource/Applications/d/make_dparser: 10.80% (3.1889 => 3.5334, std.dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.77% (0.4390 => 0.4863, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 10.74% (4.4433 => 4.9206, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.73% (0.4016 => 0.4447, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 10.68% (0.5748 => 0.6362, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.67% (0.3485 => 0.3857, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 10.58% (3.6692 => 4.0573, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.57% (0.2243 => 0.2480, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.55% (0.2655 => 0.2935, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.52% (0.3756 => 0.4151, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 10.50% (0.4113 => 0.4545, std.dev.: 0.0073) SingleSource/Regression/C++/ofstream_ctor: 10.50% (0.2781 => 0.3073, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.50% (0.6135 => 0.6779, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 10.48% (0.3293 => 0.3638, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 10.44% (0.0977 => 0.1079, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.44% (0.8698 => 0.9606, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.42% (0.3022 => 0.3337, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.39% (0.1819 => 0.2008, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.36% (0.3580 => 0.3951, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.30% (4.9865 => 5.5003, std.dev.: 0.0361) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.24% (0.2782 => 0.3067, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 10.17% (0.3453 => 0.3804, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 10.16% (0.3868 => 0.4261, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 10.14% (0.2761 => 0.3041) SingleSource/Benchmarks/Shootout-C++/strcat: 10.01% (0.2726 => 0.2999, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 9.96% (0.3534 => 0.3886, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.95% (0.2966 => 0.3261, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.95% (1.9828 => 2.1800, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/hello: 9.90% (0.2607 => 0.2865, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 9.86% (0.2760 => 0.3032, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 9.85% (0.2690 => 0.2955, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 9.78% (0.2628 => 0.2885, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 9.77% (1.0594 => 1.1629, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 9.72% (0.3149 => 0.3455, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 9.67% (0.2937 => 0.3221, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.66% (0.2765 => 0.3032, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 9.59% (0.3107 => 0.3405, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.57% (0.3511 => 0.3847, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 9.42% (3.7467 => 4.0995, std.dev.: 0.0129) MultiSource/Applications/JM/lencod/lencod: 9.40% (14.8535 => 16.2492, std.dev.: 0.0223) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.38% (0.6576 => 0.7193, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.31% (0.2696 => 0.2947, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 9.31% (1.1333 => 1.2388, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/ary2: 9.27% (0.3192 => 0.3488, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 9.27% (0.2988 => 0.3265, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.24% (0.3755 => 0.4102, std.dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 9.23% (1.2749 => 1.3926, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.22% (1.5188 => 1.6589, std.dev.: 0.0279) SingleSource/Benchmarks/Shootout-C++/objinst: 9.13% (0.2945 => 0.3214, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 9.10% (0.3131 => 0.3416, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 8.95% (8.4961 => 9.2568, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: 8.88% (0.1385 => 0.1508, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.64% (0.9108 => 0.9895, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.61% (0.8818 => 0.9577, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 8.44% (6.5754 => 7.1302, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/bigfib: 8.43% (0.6250 => 0.6777, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.43% (0.4805 => 0.5210, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.36% (3.2742 => 3.5480, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.35% (0.2504 => 0.2713, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.33% (2.1007 => 2.2757, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.29% (0.3245 => 0.3514, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 8.28% (4.6629 => 5.0490, std.dev.: 0.0131) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.15% (6.2785 => 6.7899, std.dev.: 0.0181) SingleSource/Benchmarks/Misc/oourafft: 8.07% (0.2008 => 0.2170, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: 7.82% (0.1777 => 0.1916, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.57% (1.2292 => 1.3223, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.50% (13.2842 => 14.2807, std.dev.: 0.0227) SingleSource/UnitTests/ObjC/parameter-passing: 6.77% (0.4003 => 0.4274, std.dev.: 0.0063) SingleSource/UnitTests/ObjC/exceptions: 6.52% (0.3914 => 0.4169, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 6.38% (0.3650 => 0.3883, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 6.32% (0.3940 => 0.4189, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 6.04% (0.3789 => 0.4018, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 6.00% (0.3601 => 0.3817, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 5.98% (0.3578 => 0.3792, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 5.92% (0.3663 => 0.3880, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 5.90% (0.3646 => 0.3861, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 5.88% (16.2614 => 17.2169, std.dev.: 0.0289) MultiSource/Applications/ClamAV/clamscan: 5.74% (14.5298 => 15.3644, std.dev.: 0.0219) SingleSource/UnitTests/ObjC/exceptions-3: 5.71% (0.3623 => 0.3830, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 5.56% (0.2859 => 0.3018, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 3.08% (33.2944 => 34.3211, std.dev.: 0.0103) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 94.08% (0.1824 => 0.3540, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 43.73% (0.4846 => 0.6965, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 30.58% (5.7573 => 7.5176, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/fbench: 24.41% (1.8175 => 2.2612, std.dev.: 0.0503) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.15% (1.0895 => 1.2763, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 11.01% (1.1560 => 1.2833, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 10.79% (2.8813 => 3.1923, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 9.05% (0.8273 => 0.9022, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 8.85% (0.1322 => 0.1439, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-4: 6.54% (1.0640 => 1.1336, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: 5.55% (1.2998 => 1.3720, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 5.46% (0.9692 => 1.0221) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.95% (0.3458 => 0.3629) SingleSource/Benchmarks/Misc/flops-5: 4.78% (1.9144 => 2.0060, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 4.71% (0.3139 => 0.3287, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: 4.53% (0.5449 => 0.5696) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.51% (2.8606 => 2.9895, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.97% (1.7081 => 1.7759, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.71% (10.7476 => 11.1464, std.dev.: 0.0141) MultiSource/Benchmarks/nbench/nbench: 3.70% (11.2619 => 11.6784, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 3.45% (12.0921 => 12.5092, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: 3.44% (1.9199 => 1.9860, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 3.12% (1.4298 => 1.4744, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0310 => 1.0560, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: 2.27% (1.9863 => 2.0313) SingleSource/Benchmarks/Misc/salsa20: 2.10% (7.4271 => 7.5834, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.53% (2.0200 => 2.0509, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 1.48% (8.3908 => 8.5148, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.39% (1.9433 => 1.9703, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.30% (3.1720 => 3.2133, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 1.24% (9.0760 => 9.1882, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 1.20% (5.5130 => 5.5790, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/sieve: 1.18% (5.1531 => 5.2139, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 1.12% (3.1071 => 3.1419, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.05% (9.9194 => 10.0234, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/queens: 1.02% (2.1753 => 2.1975, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -45.66% (0.2670 => 0.1451) SingleSource/UnitTests/ObjC/block-byref-aggr: -16.83% (0.4657 => 0.3873, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.38% (1.3813 => 1.2379, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.27% (1.3819 => 1.2400, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -99.99% (8.6002 => 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -18.24% (1.0460 => 0.8552, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -12.56% (0.2238 => 0.1957, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -10.18% (20.3410 => 18.2700, std.dev.: 0.0214) SingleSource/Benchmarks/Misc/flops-3: -6.21% (2.4152 => 2.2651, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -6.16% (1.9290 => 1.8102, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -5.36% (2.5089 => 2.3744, std.dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.27% (1.3780 => 1.3054, std.dev.: 0.0073) SingleSource/Benchmarks/McGill/chomp: -5.22% (1.2308 => 1.1665, std.dev.: 0.0028) SingleSource/UnitTests/Vector/multiplies: -5.02% (2.6470 => 2.5142, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.75% (0.9996 => 0.9521, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/perlin: -4.46% (6.2497 => 5.9712, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.83% (1.7688 => 1.7010, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4867 => 0.4721, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -2.88% (3.2729 => 3.1785, std.dev.: 0.0123) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.79% (4.1080 => 3.9932, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/bh/bh: -2.77% (1.9762 => 1.9215, std.dev.: 0.0034) MultiSource/Benchmarks/sim/sim: -2.69% (5.0168 => 4.8817, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.53% (4.5947 => 4.4785, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -2.37% (3.0263 => 2.9547, std.dev.: 0.0014) SingleSource/UnitTests/Vector/build2: -2.33% (1.3891 => 1.3567) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.18% (0.6615 => 0.6471, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.90% (0.6589 => 0.6464, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -1.64% (3.4016 => 3.3457, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.64% (2.5254 => 2.4840, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.54% (6.3560 => 6.2584, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -1.51% (7.1097 => 7.0022, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -1.42% (28.2225 => 27.8231, std.dev.: 0.0030) MultiSource/Applications/lua/lua: -1.41% (26.5159 => 26.1416, std.dev.: 0.0438) SingleSource/Benchmarks/Shootout/heapsort: -1.32% (3.9173 => 3.8657, std.dev.: 0.0049) MultiSource/Applications/aha/aha: -1.06% (3.1476 => 3.1143, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -1.05% (84.4286 => 83.5437, std.dev.: 0.0109) MultiSource/Applications/lambda-0_1_3/lambda: -1.03% (5.3167 => 5.2622, std.dev.: 0.0022) MultiSource/Applications/viterbi/viterbi: -1.01% (4.4810 => 4.4356, std.dev.: 0.0023) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Regression/C/compare SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vector/constpool Report Time: 1.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 23 12:14:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 23 Oct 2012 14:14:24 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121023191424.B51EF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5135?compare_to=5131&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5135, Order: 166485, Start Time: 2012-10-23 17:51:55, End Time: 2012-10-23 19:16:29 To: 5131, Order: 166479, Start Time: 2012-10-23 16:10:22, End Time: 2012-10-23 17:34:37 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 9 (31 on baseline) Performance Improvements: 0 (6 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 966 (937 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.55% (0.2055 => 0.2169, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.74% (1.1739 => 1.2061, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.76% (0.8916 => 0.9073, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.28% (0.9116 => 0.9233, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.01% (4.5068 => 4.5525, std.dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.76% (21.8150 => 22.4167, std.dev.: 0.0266) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.62% (1.1309 => 1.1605, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 1.83% (0.5690 => 0.5794, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.00% (2.5985 => 2.6246, std.dev.: 0.0090) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.19% (16.4768 => 16.4463, std.dev.: 0.2125) MultiSource/Applications/obsequi/Obsequi: -1.35% (1.0435 => 1.0294, std.dev.: 0.0097) MultiSource/Applications/sqlite3/sqlite3: 0.02% (0.6320 => 0.6321, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/08-main/main: 3.88% (0.1881 => 0.1954, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.61% (0.1639 => 0.1629, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.08% (0.3243 => 0.3278, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.24% (0.2498 => 0.2504, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.24% (0.3384 => 0.3376, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.21% (0.2423 => 0.2418, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: -0.21% (0.6063 => 0.6050, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel: 4.84% (0.0413 => 0.0433, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.15% (0.3315 => 0.3310, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 0.80% (0.1992 => 0.2008, std.dev.: 0.0053) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -22.36% (0.0246 => 0.0191, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -2.27% (0.0220 => 0.0215, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.95% (0.0422 => 0.0426, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.91% (0.0330 => 0.0333, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0310 => 0.0310, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0421 => 0.0421, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 0.50% (0.0201 => 0.0202, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -0.47% (0.0214 => 0.0213, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: 1.52% (0.0329 => 0.0334, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -38.46% (0.0013 => 0.0008, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.14% (0.1470 => 0.1472, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -2.55% (1.1268 => 1.0981, std.dev.: 0.0413) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.96% (0.1465 => 0.1523, std.dev.: 0.0144) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.17% (0.4233 => 0.4099, std.dev.: 0.0169) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.09% (0.1389 => 0.1360, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.25% (0.0639 => 0.0647, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.72% (0.0277 => 0.0275, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.97% (0.0572 => 0.0555, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.04% (1.1421 => 1.1426, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 72.22% (0.0018 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 188.89% (0.0009 => 0.0026, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.03% (0.0585 => 0.0632, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 13.62% (0.0235 => 0.0267, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.34% (0.8040 => 0.8013, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 100.00% (0.0035 => 0.0070, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.89% (2.1832 => 1.6616, std.dev.: 0.0010) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.58% (0.0810 => 0.0920, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 11.60% (0.1112 => 0.1241, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.01% (0.2279 => 0.2416, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.90% (0.8321 => 0.8812, std.dev.: 0.0102) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.67% (0.3137 => 0.3315, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.22% (1.1685 => 1.2061, std.dev.: 0.0100) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.85% (1.1606 => 1.1937, std.dev.: 0.0044) MultiSource/Applications/hbd/hbd: 2.59% (1.4269 => 1.4639, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.21% (0.8457 => 0.8644, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.17% (0.9435 => 0.9640, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.12% (0.8885 => 0.9073, std.dev.: 0.0034) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.87% (6.6074 => 6.7310, std.dev.: 0.0211) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.77% (1.4479 => 1.4735, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.75% (0.9074 => 0.9233, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.51% (1.6386 => 1.6634, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.45% (4.4873 => 4.5525, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.37% (0.8340 => 0.8454, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.15% (4.1763 => 4.2243, std.dev.: 0.0163) MultiSource/Benchmarks/Bullet/bullet: 1.01% (31.8598 => 32.1817, std.dev.: 0.1249) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.21% (1.5795 => 2.4989, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.32% (0.3186 => 0.3483, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.64% (1.1857 => 1.2881, std.dev.: 0.0057) MultiSource/Benchmarks/mafft/pairlocalalign: 5.91% (63.1822 => 66.9191, std.dev.: 0.0415) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 3.59% (44.5605 => 46.1582, std.dev.: 0.5589) MultiSource/Applications/siod/siod: 2.60% (3.6643 => 3.7596, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/ReedSolomon: 2.43% (8.5322 => 8.7396, std.dev.: 0.0554) SingleSource/Benchmarks/Shootout-C++/hash: 2.35% (0.6205 => 0.6351, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.11% (1.1365 => 1.1605, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.78% (4.8362 => 4.9222, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/bh/bh: 1.71% (2.3560 => 2.3963, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/whetstone: 1.21% (2.1224 => 2.1481, std.dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.53% (0.3269 => 0.3023, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -5.40% (29.8330 => 28.2216, std.dev.: 0.1973) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.50% (7.2130 => 7.0325, std.dev.: 0.0350) SingleSource/Benchmarks/Shootout-C++/hash2: -1.59% (3.4237 => 3.3694, std.dev.: 0.0090) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.22% (1.0388 => 1.0261, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.20% (3.3479 => 3.3076, std.dev.: 0.0024) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.00% (16.4461 => 16.4463, std.dev.: 0.2125) MultiSource/Applications/obsequi/Obsequi: 0.31% (1.0262 => 1.0294, std.dev.: 0.0097) MultiSource/Applications/sqlite3/sqlite3: -0.17% (0.6332 => 0.6321, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/08-main/main: 6.72% (0.1831 => 0.1954, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.49% (0.1559 => 0.1629, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.96% (0.3123 => 0.3278, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.66% (0.2463 => 0.2504, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.96% (0.3344 => 0.3376, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.28% (0.2364 => 0.2418, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 0.67% (0.6010 => 0.6050, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel: 0.93% (0.0429 => 0.0433, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.35% (0.3266 => 0.3310, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 1.98% (0.1969 => 0.2008, std.dev.: 0.0053) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -14.73% (0.0224 => 0.0191, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 74.80% (0.0123 => 0.0215, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.65% (0.0302 => 0.0310, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.64% (0.0384 => 0.0421, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 18.33% (0.0180 => 0.0213, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: 45.22% (0.0230 => 0.0334, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 14.29% (0.0007 => 0.0008, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.36% (0.1438 => 0.1472, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -3.07% (1.1329 => 1.0981, std.dev.: 0.0413) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 4.17% (0.1462 => 0.1523, std.dev.: 0.0144) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.56% (0.4164 => 0.4099, std.dev.: 0.0169) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.66% (0.1369 => 0.1360, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.94% (0.0641 => 0.0647, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.03% (0.0195 => 0.0275, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.98% (0.0578 => 0.0555, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.10% (1.1437 => 1.1426, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.80% (0.0627 => 0.0632, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.33% (0.0180 => 0.0267, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.05% (0.8017 => 0.8013, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 12.90% (0.0062 => 0.0070, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 23 15:36:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 23 Oct 2012 17:36:37 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121023223637.E7C572A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5141?compare_to=5137&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5141, Order: 166500, Start Time: 2012-10-23 21:14:33, End Time: 2012-10-23 22:38:42 To: 5137, Order: 166492, Start Time: 2012-10-23 19:33:19, End Time: 2012-10-23 20:57:52 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 18 (67 on baseline) Performance Improvements: 2 (5 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 955 (902 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.52% (0.2011 => 0.2122, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.85% (0.3073 => 0.3222, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.30% (0.3270 => 0.3378, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.33% (1.6466 => 1.6850, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.74% (0.8378 => 0.8524, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.71% (0.8809 => 0.8960, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.68% (1.5339 => 1.5596, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.59% (0.8370 => 0.8503, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.44% (0.8361 => 0.8481, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.37% (0.7940 => 0.8049, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.36% (0.8725 => 0.8844, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.29% (0.8081 => 0.8185, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.26% (0.8499 => 0.8606, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.17% (0.9719 => 0.9833, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/life/life: 2.68% (2.5611 => 2.6298, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/methcall: 1.56% (8.8907 => 9.0292, std.dev.: 0.0164) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.10% (1.8750 => 1.8957, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.09% (1.5734 => 1.5906, std.dev.: 0.0062) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -2.40% (0.5213 => 0.5088, std.dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/hash: -1.83% (4.3637 => 4.2837, std.dev.: 0.0213) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.30% (16.5801 => 16.5310, std.dev.: 0.2232) MultiSource/Applications/obsequi/Obsequi: 1.19% (1.0603 => 1.0729, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: -0.76% (0.6475 => 0.6426, std.dev.: 0.0090) MultiSource/Benchmarks/McCat/08-main/main: 1.82% (0.1923 => 0.1958, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.25% (0.1685 => 0.1706, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.11% (0.3238 => 0.3202, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.01% (0.2487 => 0.2512, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.69% (0.3345 => 0.3368, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.21% (0.2363 => 0.2368, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.5990 => 0.5990, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/mandel: -7.86% (0.0496 => 0.0457, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.36% (0.3305 => 0.3317, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/strcat: 0.95% (0.1995 => 0.2014, std.dev.: 0.0020) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 27.40% (0.0208 => 0.0265, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0218 => 0.0218, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.23% (0.0426 => 0.0427, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.30% (0.0330 => 0.0331, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.96% (0.0312 => 0.0309, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0423 => 0.0423, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0202 => 0.0202, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 0.46% (0.0217 => 0.0218, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -11.70% (0.0359 => 0.0317, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 62.50% (0.0008 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.14% (0.1480 => 0.1482, std.dev.: 0.0024) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -7.46% (1.1905 => 1.1017, std.dev.: 0.0457) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.46% (0.1520 => 0.1513, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.53% (0.4025 => 0.4127, std.dev.: 0.0289) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.08% (0.1443 => 0.1413, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.96% (0.0642 => 0.0661, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -24.45% (0.0274 => 0.0207, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.62% (0.0555 => 0.0546, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.02% (1.1443 => 1.1445, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 13.51% (0.0555 => 0.0630) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.67% (0.0225 => 0.0267) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.31% (0.7998 => 0.8023, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: 600.00% (0.0001 => 0.0007) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -1.49% (0.0067 => 0.0066, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.67% (2.1832 => 1.6664, std.dev.: 0.0030) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.90% (0.0810 => 0.0955, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/tsp/tsp: 12.68% (0.1112 => 0.1253, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.81% (0.2180 => 0.2372, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.14% (0.1425 => 0.1541, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.68% (0.3137 => 0.3378, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.47% (0.2998 => 0.3222, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.33% (0.2279 => 0.2446, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.01% (0.1983 => 0.2122, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.89% (0.6010 => 0.6424, std.dev.: 0.0124) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.85% (0.8148 => 0.8706, std.dev.: 0.0072) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.79% (0.8321 => 0.8886, std.dev.: 0.0212) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.89% (0.1885 => 0.1996, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.63% (0.7473 => 0.7894, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.97% (0.4847 => 0.5088, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.57% (0.2519 => 0.2634, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.99% (1.1606 => 1.2069, std.dev.: 0.0090) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.58% (0.3717 => 0.3850, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.56% (0.3003 => 0.3110, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.49% (0.9435 => 0.9764, std.dev.: 0.0086) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.43% (6.6074 => 6.8343, std.dev.: 0.0516) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.10% (0.6287 => 0.6482, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.02% (0.8697 => 0.8960, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.97% (0.5961 => 0.6138, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.83% (1.6386 => 1.6850, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.80% (0.5817 => 0.5980, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.61% (1.1170 => 1.1461, std.dev.: 0.0079) MultiSource/Benchmarks/MallocBench/gs/gs: 2.56% (4.1305 => 4.2363, std.dev.: 0.0210) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.47% (4.4880 => 4.5988, std.dev.: 0.0104) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.40% (1.2526 => 1.2827, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.36% (8.6476 => 8.8518, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.32% (0.8331 => 0.8524, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.27% (1.4479 => 1.4808, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.24% (0.4783 => 0.4890, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.97% (0.8317 => 0.8481, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.95% (0.8340 => 0.8503, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.93% (4.5702 => 4.6584, std.dev.: 0.0224) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.83% (0.8611 => 0.8769, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.83% (1.5315 => 1.5596, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.78% (0.8597 => 0.8750, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.76% (0.8457 => 0.8606, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.66% (0.8050 => 0.8184, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.64% (0.8086 => 0.8219, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.52% (0.8712 => 0.8844, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.51% (0.8716 => 0.8848, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.50% (0.9688 => 0.9833, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.48% (0.8066 => 0.8185, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.48% (0.7932 => 0.8049, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.34% (1.2602 => 1.2771, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.32% (0.8316 => 0.8426, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.31% (0.8656 => 0.8769, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.25% (0.8420 => 0.8525, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.24% (0.8805 => 0.8914, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.18% (0.8885 => 0.8990, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.15% (0.9039 => 0.9143, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 56.86% (1.5795 => 2.4776, std.dev.: 0.0180) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.48% (0.3186 => 0.3488, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.27% (1.1857 => 1.2838, std.dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 5.95% (63.1822 => 66.9413, std.dev.: 0.0740) MultiSource/Benchmarks/FreeBench/distray/distray: 4.64% (0.2390 => 0.2501, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.37% (2.2485 => 2.3468, std.dev.: 0.0236) SingleSource/Benchmarks/Misc/ReedSolomon: 2.89% (8.5322 => 8.7787, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.87% (2.4490 => 2.5192, std.dev.: 0.0192) SingleSource/Benchmarks/Shootout-C++/hash: 2.47% (0.6205 => 0.6358, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.43% (59.2638 => 60.7058, std.dev.: 0.2978) MultiSource/Applications/siod/siod: 2.41% (3.6643 => 3.7525, std.dev.: 0.0255) MultiSource/Benchmarks/Olden/bh/bh: 2.21% (2.3560 => 2.4081, std.dev.: 0.0089) MultiSource/Benchmarks/Bullet/bullet: 1.44% (7.1181 => 7.2204, std.dev.: 0.0106) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.56% (0.3269 => 0.3022, std.dev.: 0.0018) MultiSource/Applications/lua/lua: -5.19% (29.8330 => 28.2839, std.dev.: 0.1004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.09% (1.0388 => 1.0171, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash2: -1.56% (3.4237 => 3.3704, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.27% (3.3479 => 3.3054, std.dev.: 0.0106) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.52% (16.4461 => 16.5310, std.dev.: 0.2232) MultiSource/Applications/obsequi/Obsequi: 4.55% (1.0262 => 1.0729, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 1.48% (0.6332 => 0.6426, std.dev.: 0.0090) MultiSource/Benchmarks/McCat/08-main/main: 6.94% (0.1831 => 0.1958, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.43% (0.1559 => 0.1706, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.53% (0.3123 => 0.3202, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.99% (0.2463 => 0.2512, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.72% (0.3344 => 0.3368, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.17% (0.2364 => 0.2368, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: -0.33% (0.6010 => 0.5990, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/mandel: 6.53% (0.0429 => 0.0457, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.56% (0.3266 => 0.3317, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/strcat: 2.29% (0.1969 => 0.2014, std.dev.: 0.0020) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 18.30% (0.0224 => 0.0265, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.31% (0.0254 => 0.0331, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.32% (0.0302 => 0.0309, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: 37.83% (0.0230 => 0.0317, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 3.06% (0.1438 => 0.1482, std.dev.: 0.0024) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -2.75% (1.1329 => 1.1017, std.dev.: 0.0457) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.49% (0.1462 => 0.1513, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.89% (0.4164 => 0.4127, std.dev.: 0.0289) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.21% (0.1369 => 0.1413, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -12.50% (0.0008 => 0.0007, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.12% (0.0641 => 0.0661, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.15% (0.0195 => 0.0207, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.54% (0.0578 => 0.0546, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.07% (1.1437 => 1.1445, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.48% (0.0627 => 0.0630) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.33% (0.0180 => 0.0267) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.07% (0.8017 => 0.8023, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: 600.00% (0.0001 => 0.0007) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 6.45% (0.0062 => 0.0066, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 23 12:33:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 23 Oct 2012 14:33:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121023193343.0066C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5136?compare_to=5132&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5136, Order: 166487, Start Time: 2012-10-23 18:15:15, End Time: 2012-10-23 19:35:45 To: 5132, Order: 166479, Start Time: 2012-10-23 16:22:23, End Time: 2012-10-23 17:42:31 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (5 on baseline) Performance Regressions: 1 (196 on baseline) Performance Improvements: 0 (47 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 88 (14 on baseline) Unchanged Tests: 953 (644 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.91% (54.9719 => 56.5690, std.dev.: 0.0153) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.46% (0.6252 => 0.6281, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 0.41% (17.2393 => 17.3105, std.dev.: 0.0096) MultiSource/Applications/kimwitu++/kc: 0.46% (15.6024 => 15.6747, std.dev.: 0.0241) MultiSource/Benchmarks/Bullet/bullet: 0.20% (56.1113 => 56.2223, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.41% (0.0486 => 0.0488, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.82% (0.0486 => 0.0490, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.22% (0.0457 => 0.0458, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.44% (0.0457 => 0.0459) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.45% (0.0445 => 0.0447, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.67% (0.0445 => 0.0448) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.69% (0.0437 => 0.0440, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.46% (0.0439 => 0.0441, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.66% (0.0456 => 0.0459, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.44% (0.0457 => 0.0459, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.44% (0.0450 => 0.0452, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.67% (0.0451 => 0.0454) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.23% (0.0442 => 0.0443, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.68% (0.0441 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.67% (0.0447 => 0.0450, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.67% (0.0448 => 0.0451, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.44% (0.0459 => 0.0461, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.65% (0.0459 => 0.0462, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.92% (0.0435 => 0.0439, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.46% (0.0436 => 0.0438, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.45% (0.0447 => 0.0449, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.67% (0.0448 => 0.0451, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.68% (0.0438 => 0.0441, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.68% (0.0439 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.46% (0.0431 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.23% (0.0433 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.46% (0.0431 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.46% (0.0431 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.64% (0.0466 => 0.0469, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.43% (0.0468 => 0.0470, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.47% (0.0429 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.93% (0.0429 => 0.0433) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.70% (0.0430 => 0.0433, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.69% (0.0432 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.23% (0.0438 => 0.0439, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.46% (0.0439 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.29% (1.4930 => 1.4974, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.09% (8.2168 => 8.2241, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.26% (0.6860 => 0.6878, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1436 => 0.1436) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.79% (0.0646 => 0.0664, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.10% (63.2438 => 56.2223, std.dev.: 0.0155) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/MallocBench/gs/gs: 13.84% (4.1105 => 4.6792, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.97% (3.4629 => 5.8166, std.dev.: 0.0062) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13506.94% (0.0720 => 9.7970, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049800.00% (0.0001 => 10.0499, std.dev.: 0.0011) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 64.33% (0.2554 => 0.4197, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/lowercase: 58.20% (0.0256 => 0.0405, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 47.91% (10.3673 => 15.3344, std.dev.: 0.0164) SingleSource/UnitTests/SignlessTypes/factor: 46.96% (0.0296 => 0.0435, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 43.54% (0.0271 => 0.0389, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.62% (1.5859 => 2.2460, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 38.47% (0.1622 => 0.2246, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 36.84% (0.1056 => 0.1445, std.dev.: 0.0012) SingleSource/UnitTests/vla: 33.52% (0.0355 => 0.0474, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.55% (2.2024 => 2.8753, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/neural/neural: 26.38% (0.1463 => 0.1849, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 24.94% (0.0834 => 0.1042, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.78% (0.1566 => 0.1907, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/hash: 21.24% (0.0485 => 0.0588, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 20.99% (0.2049 => 0.2479, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 19.34% (0.1432 => 0.1709, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 18.97% (0.1555 => 0.1850, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.83% (7.0540 => 8.3823, std.dev.: 0.0107) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.83% (0.0871 => 0.1035, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 18.14% (0.5105 => 0.6031, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.57% (0.6675 => 0.7848, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.50% (2.2022 => 2.5876, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: 17.41% (0.0626 => 0.0735, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 17.34% (0.1655 => 0.1942, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/em3d/em3d: 17.17% (0.1695 => 0.1986, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.98% (1.3050 => 1.5266, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.90% (0.0793 => 0.0927, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 16.83% (3.3354 => 3.8967, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/tsp/tsp: 16.60% (0.1175 => 0.1370, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/mst/mst: 16.60% (0.1163 => 0.1356, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.53% (0.4615 => 0.5378, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.51% (0.2271 => 0.2646, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/power/power: 16.46% (0.1440 => 0.1677, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.42% (0.8172 => 0.9514, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.29% (0.0798 => 0.0928, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.28% (0.1032 => 0.1200, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 16.12% (10.4361 => 12.1185, std.dev.: 0.0168) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 16.01% (0.1337 => 0.1551, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.96% (1.5415 => 1.7876, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.91% (0.0886 => 0.1027, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.74% (0.1029 => 0.1191, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.67% (0.1940 => 0.2244, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.66% (0.5020 => 0.5806, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.56% (0.0842 => 0.0973, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.56% (0.0675 => 0.0780, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.50% (0.1510 => 0.1744, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 15.47% (0.3109 => 0.3590, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.35% (0.3121 => 0.3600, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: 15.29% (0.7115 => 0.8203, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 15.23% (0.3282 => 0.3782, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 15.18% (0.0672 => 0.0774, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.14% (0.9765 => 1.1243, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/matrix: 15.04% (0.0818 => 0.0941, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 15.01% (1.1642 => 1.3389, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.94% (0.0770 => 0.0885, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 14.90% (0.3423 => 0.3933, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.89% (4.2646 => 4.8996, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.72% (0.1236 => 0.1418, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.68% (0.0838 => 0.0961, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.67% (0.2107 => 0.2416, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/exptree: 14.62% (0.0814 => 0.0933, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.61% (0.0746 => 0.0855, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.53% (0.2065 => 0.2365, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.52% (0.5860 => 0.6711, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.52% (0.1584 => 0.1814, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 14.51% (0.1151 => 0.1318, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.50% (0.2758 => 0.3158, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.46% (1.7609 => 2.0156, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.41% (0.1117 => 0.1278, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 14.38% (0.7835 => 0.8962, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.37% (0.6450 => 0.7377, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 14.27% (0.1906 => 0.2178, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.26% (0.0933 => 0.1066, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 14.19% (0.1438 => 0.1642, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.13% (0.5981 => 0.6826, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 14.08% (1.4186 => 1.6184, std.dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: 14.05% (9.4845 => 10.8172, std.dev.: 0.0226) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.90% (0.0770 => 0.0877, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.87% (8.1363 => 9.2648, std.dev.: 0.0103) MultiSource/Applications/treecc/treecc: 13.84% (2.0273 => 2.3078, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 13.84% (0.0730 => 0.0831, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 13.76% (0.7433 => 0.8456, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 13.69% (0.1125 => 0.1279, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.65% (0.8067 => 0.9168, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.63% (0.2700 => 0.3068, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.56% (0.1062 => 0.1206, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 13.54% (5.7591 => 6.5388, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.54% (0.1625 => 0.1845, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.46% (0.0929 => 0.1054, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.45% (0.1695 => 0.1923, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 13.36% (1.1840 => 1.3422, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 13.26% (3.8723 => 4.3856, std.dev.: 0.0125) MultiSource/Benchmarks/Olden/health/health: 13.25% (0.1268 => 0.1436, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 13.20% (4.9449 => 5.5975, std.dev.: 0.0136) MultiSource/Applications/lemon/lemon: 13.14% (1.0722 => 1.2131, std.dev.: 0.0057) SingleSource/UnitTests/SignlessTypes/rem: 13.11% (0.1144 => 0.1294, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.11% (5.0018 => 5.6574, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 13.08% (0.4879 => 0.5517, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.07% (0.5569 => 0.6297, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/05-eks/eks: 12.86% (0.4299 => 0.4852, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 12.81% (0.3387 => 0.3821, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.78% (0.1330 => 0.1500, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.66% (1.1861 => 1.3363, std.dev.: 0.0009) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.51% (0.1143 => 0.1286, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.49% (0.2603 => 0.2928, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 12.48% (0.3180 => 0.3577, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.44% (0.3441 => 0.3869, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.37% (0.3307 => 0.3716, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 12.30% (0.8921 => 1.0018, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 12.18% (0.3177 => 0.3564, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.06% (7.9617 => 8.9218, std.dev.: 0.0178) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.91% (0.8101 => 0.9066, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.84% (0.1892 => 0.2116, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 11.80% (0.3092 => 0.3457, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: 11.52% (1.5603 => 1.7401, std.dev.: 0.0037) MultiSource/Applications/siod/siod: 11.07% (2.2969 => 2.5511, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/bigfib: 11.01% (0.6456 => 0.7167, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.72% (0.2266 => 0.2509, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.63% (0.1044 => 0.1155, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.50% (0.3543 => 0.3915, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.08% (0.3927 => 0.4323, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 10.06% (21.9371 => 24.1431, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/for-in: 10.04% (0.3694 => 0.4065, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.03% (0.3828 => 0.4212, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 10.02% (0.3473 => 0.3821, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 9.99% (0.3543 => 0.3897, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 9.91% (0.3561 => 0.3914, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.89% (0.3497 => 0.3843, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.84% (0.3516 => 0.3862, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.78% (0.3886 => 0.4266, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 9.72% (0.4289 => 0.4706, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 9.65% (0.4620 => 0.5066, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.58% (0.4636 => 0.5080, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.43% (0.3427 => 0.3750, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.30% (0.3826 => 0.4182, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 9.23% (0.3422 => 0.3738, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.14% (0.2430 => 0.2652, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.98% (0.3865 => 0.4212, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.94% (0.4103 => 0.4470, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.92% (0.4203 => 0.4578, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 8.87% (17.1811 => 18.7053, std.dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/moments: 8.55% (0.4048 => 0.4394, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists1: 8.31% (0.3684 => 0.3990, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.24% (3.8922 => 4.2128, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.12% (14.3668 => 15.5328, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: 7.96% (0.6030 => 0.6510, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.93% (0.5925 => 0.6395, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3603 => 0.3880, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 7.47% (0.7326 => 0.7873, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.26% (0.4064 => 0.4359, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.23% (0.3650 => 0.3914, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 6.91% (0.3098 => 0.3312, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.80% (0.3162 => 0.3377, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.75% (0.2905 => 0.3101, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 6.61% (0.3283 => 0.3500, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.57% (0.2891 => 0.3081, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.57% (2.0665 => 2.2023, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/strcat: 6.57% (0.2831 => 0.3017, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.54% (0.3136 => 0.3341, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 6.50% (0.3232 => 0.3442, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 6.43% (0.2877 => 0.3062, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.37% (0.2871 => 0.3054, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.35% (0.2756 => 0.2931, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.30% (0.2872 => 0.3053, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.29% (0.3052 => 0.3244, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.27% (0.2793 => 0.2968, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 6.21% (0.3379 => 0.3589, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 6.12% (1.2842 => 1.3628, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/fibo: 6.06% (0.2725 => 0.2890, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 5.90% (0.2714 => 0.2874, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 5.82% (0.2802 => 0.2965, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.11% (0.3131 => 0.3291, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.26% (1.1194 => 1.1559, std.dev.: 0.0137) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1725, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 14.68% (0.9957 => 1.1419, std.dev.: 0.0142) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.79% (1.1396 => 1.2512, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (3.1578 => 3.3672, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: 5.92% (1.9405 => 2.0553, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.65% (4.2280 => 4.3400, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.61% (0.3987 => 0.4091, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.15% (3.6395 => 3.7177, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bisort/bisort: 1.94% (0.8333 => 0.8495, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.55% (2.6546 => 2.6958, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2074, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 1.18% (4.4649 => 4.5175, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.01% (6.5088 => 6.5748, std.dev.: 0.0066) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.00% (6.6874 => 0.1337, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -79.72% (0.8651 => 0.1754, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.00% (5.2763 => 3.2184, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.16% (5.3855 => 3.7072, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.83% (5.3526 => 3.7026, std.dev.: 0.0038) SingleSource/UnitTests/Vector/constpool: -14.42% (54.1659 => 46.3565, std.dev.: 0.0262) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.42% (2.9384 => 2.6322, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -5.37% (22.1758 => 20.9841, std.dev.: 0.0326) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.10% (8.0499 => 3.7756, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.52% (1.1492 => 0.7640, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4751, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.96% (1.6925 => 1.4224, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.70% (1.2258 => 1.0701, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.81% (1.2373 => 1.0912, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/mandel-2: -10.79% (1.5373 => 1.3715, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.24% (19.9488 => 18.3041, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/mason/mason: -7.91% (0.2161 => 0.1990, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.10% (1.8329 => 1.7027, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.15% (1.6805 => 1.5940, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.79% (1.5835 => 1.5077, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.26% (8.1563 => 7.8086, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Applications/siod/siod: -3.61% (3.2827 => 3.1641, std.dev.: 0.0071) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8775, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4986, std.dev.: 0.0051) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.52% (0.4808 => 0.4687, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -2.18% (4.6441 => 4.5429, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -1.87% (10.2830 => 10.0905, std.dev.: 0.0171) SingleSource/Benchmarks/Misc/flops: -1.69% (8.8334 => 8.6839, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -1.65% (2.5528 => 2.5108, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/lists: -1.20% (6.2999 => 6.2244, std.dev.: 0.0079) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.12% (2.3135 => 2.2877, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8576, std.dev.: 0.0039) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 20.12% (0.5229 => 0.6281, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 15.48% (14.9895 => 17.3105, std.dev.: 0.0096) MultiSource/Applications/kimwitu++/kc: 10.73% (14.1553 => 15.6747, std.dev.: 0.0241) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 35.54% (1.1048 => 1.4974, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.89% (7.1582 => 8.2241, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.54% (0.6222 => 0.6878, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.30% (0.1485 => 0.1436) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.62% (0.2116 => 0.0664, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 23 10:32:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 23 Oct 2012 12:32:33 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121023173233.11FE92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5131?compare_to=5126&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5131, Order: 166479, Start Time: 2012-10-23 16:10:22, End Time: 2012-10-23 17:34:37 To: 5126, Order: 166475, Start Time: 2012-10-23 09:36:17, End Time: 2012-10-23 11:00:22 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 6 (20 on baseline) Performance Improvements: 2 (5 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 967 (949 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/himenobmtxpa: 7.05% (0.1673 => 0.1791, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 3.02% (0.3415 => 0.3518, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.49% (0.3195 => 0.3530, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.94% (11.2404 => 11.5709, std.dev.: 0.0116) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.53% (1.4013 => 1.4227, std.dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.21% (2.4246 => 2.4540, std.dev.: 0.0066) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.75% (1.3652 => 1.3413, std.dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.48% (1.6320 => 1.6078, std.dev.: 0.0006) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.12% (16.4970 => 16.4768, std.dev.: 0.1184) MultiSource/Applications/obsequi/Obsequi: -0.90% (1.0530 => 1.0435, std.dev.: 0.0060) MultiSource/Applications/sqlite3/sqlite3: -0.85% (0.6374 => 0.6320, std.dev.: 0.0101) MultiSource/Benchmarks/McCat/08-main/main: -1.42% (0.1908 => 0.1881, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.15% (0.1658 => 0.1639, std.dev.: 0.0067) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.03% (0.3242 => 0.3243, std.dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.28% (0.2491 => 0.2498, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.59% (0.3331 => 0.3384, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.25% (0.2429 => 0.2423, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/bigfib: 0.71% (0.6020 => 0.6063, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/mandel: -13.78% (0.0479 => 0.0413, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.45% (0.3300 => 0.3315, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: -0.05% (0.1993 => 0.1992, std.dev.: 0.0017) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.23% (0.0243 => 0.0246, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 17.65% (0.0187 => 0.0220, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.68% (0.0411 => 0.0422, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 16.20% (0.0284 => 0.0330, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0311 => 0.0310, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 14.40% (0.0368 => 0.0421, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0201 => 0.0201, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 34.59% (0.0159 => 0.0214, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -8.36% (0.0359 => 0.0329, std.dev.: 0.0039) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.61% (0.1479 => 0.1470, std.dev.: 0.0047) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.41% (1.1314 => 1.1268, std.dev.: 0.0039) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 0.62% (0.1456 => 0.1465, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 6.73% (0.3966 => 0.4233, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.25% (0.1421 => 0.1389, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.77% (0.0664 => 0.0639, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0277 => 0.0277) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.88% (0.0567 => 0.0572, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.08% (1.1430 => 1.1421, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1700.00% (0.0001 => 0.0018, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -66.67% (0.0027 => 0.0009, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.28% (0.0561 => 0.0585, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.84% (0.0237 => 0.0235, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.31% (0.7936 => 0.8040, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -54.55% (0.0077 => 0.0035, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.92% (2.1832 => 1.6609, std.dev.: 0.0095) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 9.71% (0.1112 => 0.1220, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.04% (0.7473 => 0.7850, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.87% (0.2279 => 0.2390, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.71% (0.8148 => 0.8450, std.dev.: 0.0113) MultiSource/Applications/spiff/spiff: 3.57% (0.7950 => 0.8234, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.34% (0.2998 => 0.3098, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 2.95% (1.2222 => 1.2583, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.58% (1.1606 => 1.1906, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.53% (1.4479 => 1.4845, std.dev.: 0.0133) MultiSource/Applications/hbd/hbd: 2.23% (1.4269 => 1.4587, std.dev.: 0.0043) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.43% (6.6074 => 6.7020, std.dev.: 0.0146) MultiSource/Benchmarks/nbench/nbench: 1.09% (1.1271 => 1.1394, std.dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.55% (1.5795 => 2.5043, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.80% (0.3186 => 0.3530, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.42% (1.1857 => 1.2855, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 5.94% (63.1822 => 66.9339, std.dev.: 0.1248) MultiSource/Applications/siod/siod: 2.62% (3.6643 => 3.7602, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/ReedSolomon: 2.16% (8.5322 => 8.7162, std.dev.: 0.0557) MultiSource/Benchmarks/Olden/bh/bh: 1.80% (2.3560 => 2.3983, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.44% (4.8362 => 4.9057, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.65% (0.3269 => 0.3019, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -5.26% (29.8330 => 28.2625, std.dev.: 0.0658) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.21% (7.2130 => 6.9813, std.dev.: 0.0406) SingleSource/Benchmarks/Shootout-C++/hash2: -1.53% (3.4237 => 3.3712, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.24% (3.3479 => 3.3063, std.dev.: 0.0030) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.19% (16.4461 => 16.4768, std.dev.: 0.1184) MultiSource/Applications/obsequi/Obsequi: 1.69% (1.0262 => 1.0435, std.dev.: 0.0060) MultiSource/Applications/sqlite3/sqlite3: -0.19% (0.6332 => 0.6320, std.dev.: 0.0101) MultiSource/Benchmarks/McCat/08-main/main: 2.73% (0.1831 => 0.1881, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.13% (0.1559 => 0.1639, std.dev.: 0.0067) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.84% (0.3123 => 0.3243, std.dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.42% (0.2463 => 0.2498, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.20% (0.3344 => 0.3384, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.50% (0.2364 => 0.2423, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/bigfib: 0.88% (0.6010 => 0.6063, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/mandel: -3.73% (0.0429 => 0.0413, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.50% (0.3266 => 0.3315, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 1.17% (0.1969 => 0.1992, std.dev.: 0.0017) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 9.82% (0.0224 => 0.0246, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.86% (0.0123 => 0.0220, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.43% (0.0408 => 0.0422, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.65% (0.0302 => 0.0310, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.64% (0.0384 => 0.0421, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 5.79% (0.0190 => 0.0201, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 18.89% (0.0180 => 0.0214, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: 43.04% (0.0230 => 0.0329, std.dev.: 0.0039) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.23% (0.1438 => 0.1470, std.dev.: 0.0047) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.54% (1.1329 => 1.1268, std.dev.: 0.0039) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 0.21% (0.1462 => 0.1465, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.66% (0.4164 => 0.4233, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.46% (0.1369 => 0.1389, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.31% (0.0641 => 0.0639, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.04% (0.0578 => 0.0572, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.14% (1.1437 => 1.1421, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1700.00% (0.0001 => 0.0018, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -35.71% (0.0014 => 0.0009, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.70% (0.0627 => 0.0585, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 30.56% (0.0180 => 0.0235, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.29% (0.8017 => 0.8040, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -43.55% (0.0062 => 0.0035, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 23 10:40:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 23 Oct 2012 12:40:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121023174027.19EDF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5132?compare_to=5128&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5132, Order: 166479, Start Time: 2012-10-23 16:22:23, End Time: 2012-10-23 17:42:31 To: 5128, Order: 166478, Start Time: 2012-10-23 11:25:20, End Time: 2012-10-23 12:45:30 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (5 on baseline) Performance Regressions: 0 (193 on baseline) Performance Improvements: 0 (47 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 88 (14 on baseline) Unchanged Tests: 954 (647 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.02% (0.6253 => 0.6252, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 0.06% (17.2282 => 17.2393, std.dev.: 0.0102) MultiSource/Applications/kimwitu++/kc: -0.01% (15.6038 => 15.6024, std.dev.: 0.0122) MultiSource/Benchmarks/Bullet/bullet: -0.02% (56.1237 => 56.1113, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.21% (0.0485 => 0.0486) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.21% (0.0487 => 0.0486, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.22% (0.0456 => 0.0457, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0457 => 0.0457, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0445 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0445 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.23% (0.0438 => 0.0437, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0439 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.22% (0.0455 => 0.0456, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.22% (0.0458 => 0.0457, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0450 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0451 => 0.0451, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0442 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0441 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0447 => 0.0447, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0448 => 0.0448) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.22% (0.0458 => 0.0459, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.22% (0.0460 => 0.0459, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0435 => 0.0435, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0436 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0447 => 0.0447, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0448 => 0.0448, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.23% (0.0439 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0439 => 0.0439) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0431 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.23% (0.0432 => 0.0433, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0431 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.23% (0.0430 => 0.0431) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.21% (0.0467 => 0.0466, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.21% (0.0467 => 0.0468, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.23% (0.0430 => 0.0429, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0429 => 0.0429, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.23% (0.0431 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.23% (0.0431 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0438 => 0.0438, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0439 => 0.0439, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (1.4930 => 1.4930, std.dev.: 0.0074) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.02% (8.2183 => 8.2168, std.dev.: 0.0154) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.07% (0.6855 => 0.6860, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1436 => 0.1436, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.30% (0.0675 => 0.0646, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.28% (63.2438 => 56.1113, std.dev.: 0.0113) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/MallocBench/gs/gs: 13.15% (4.1105 => 4.6510, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.52% (3.4629 => 5.8011, std.dev.: 0.0062) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13508.47% (0.0720 => 9.7981, std.dev.: 0.0091) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049400.00% (0.0001 => 10.0495, std.dev.: 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: 64.13% (0.2554 => 0.4192, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/lowercase: 57.81% (0.0256 => 0.0404) MultiSource/Benchmarks/PAQ8p/paq8p: 48.69% (10.3673 => 15.4153, std.dev.: 0.0051) SingleSource/UnitTests/SignlessTypes/factor: 46.28% (0.0296 => 0.0433, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 43.17% (0.0271 => 0.0388, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 41.18% (0.1622 => 0.2290, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.08% (1.5859 => 2.2374, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/distray/distray: 36.27% (0.1056 => 0.1439, std.dev.: 0.0004) SingleSource/UnitTests/vla: 32.96% (0.0355 => 0.0472, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.14% (2.2024 => 2.8661, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: 25.91% (0.1463 => 0.1842, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 23.98% (0.0834 => 0.1034, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.46% (0.1566 => 0.1902, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/hash: 21.03% (0.0485 => 0.0587, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 20.40% (0.2049 => 0.2467, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.12% (7.0540 => 8.4029, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 18.85% (0.1432 => 0.1702) MultiSource/Applications/viterbi/viterbi: 18.59% (0.1555 => 0.1844, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.37% (0.0871 => 0.1031, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.96% (0.5105 => 0.6022, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.79% (2.2022 => 2.5940, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.23% (0.6675 => 0.7825, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 16.92% (0.1655 => 0.1935, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: 16.77% (0.0626 => 0.0731) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.64% (0.8172 => 0.9532, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.55% (1.3050 => 1.5210, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.52% (0.0793 => 0.0924, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 16.46% (0.1695 => 0.1974, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.44% (0.0730 => 0.0850, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 16.39% (0.1440 => 0.1676, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 16.36% (3.3354 => 3.8811, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 16.34% (0.1175 => 0.1367, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 16.27% (0.0842 => 0.0979, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.25% (0.2271 => 0.2640, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.14% (0.0886 => 0.1029, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 16.08% (0.1163 => 0.1350, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ft/ft: 16.03% (0.1940 => 0.2251, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.95% (0.4615 => 0.5351, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 15.62% (10.4361 => 12.0661, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.57% (1.5415 => 1.7815, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.48% (0.1337 => 0.1544, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.41% (0.1032 => 0.1191, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.30% (0.5020 => 0.5788, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 15.23% (0.3282 => 0.3782, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.10% (0.1510 => 0.1738, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 15.00% (0.7115 => 0.8182, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 14.86% (0.3109 => 0.3571, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.71% (0.3121 => 0.3580, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.71% (0.9765 => 1.1201, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 14.67% (0.1438 => 0.1649, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: 14.55% (0.0818 => 0.0937, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 14.43% (0.3423 => 0.3917, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.42% (0.0770 => 0.0881, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.40% (4.2646 => 4.8786, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.34% (0.0746 => 0.0853, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 14.34% (1.1642 => 1.3311, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.33% (0.2107 => 0.2409, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 14.25% (0.1151 => 0.1315, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.18% (0.2758 => 0.3149, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.15% (0.1117 => 0.1275, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/exptree: 14.13% (0.0814 => 0.0929, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 14.09% (0.7835 => 0.8939, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.08% (0.0838 => 0.0956, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.08% (0.1584 => 0.1807, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.96% (0.5860 => 0.6678, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.94% (0.5981 => 0.6815, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.90% (0.1906 => 0.2171, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.90% (0.2065 => 0.2352, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 13.89% (0.6450 => 0.7346, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.83% (0.1236 => 0.1407, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.72% (0.0933 => 0.1061, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 13.69% (9.4845 => 10.7825, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.64% (1.4186 => 1.6121, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.61% (0.1029 => 0.1169, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.54% (8.1363 => 9.2381, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.52% (1.7609 => 1.9989, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.51% (0.0770 => 0.0874, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 13.42% (5.7591 => 6.5318, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 13.36% (2.0273 => 2.2981, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.33% (0.1695 => 0.1921, std.dev.: 0.0049) MultiSource/Applications/lambda-0_1_3/lambda: 13.29% (0.7433 => 0.8421, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.28% (0.1062 => 0.1203, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.16% (0.0798 => 0.0903, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.15% (0.2700 => 0.3055, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.02% (0.8067 => 0.9117, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/health/health: 13.01% (0.1268 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 13.01% (4.9449 => 5.5882, std.dev.: 0.0084) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.96% (5.0018 => 5.6500, std.dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 12.93% (1.1840 => 1.3371, std.dev.: 0.0016) SingleSource/UnitTests/SignlessTypes/rem: 12.85% (0.1144 => 0.1291) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.81% (0.0929 => 0.1048, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.80% (0.1625 => 0.1833, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 12.78% (3.8723 => 4.3670, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.77% (0.4879 => 0.5502, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.77% (0.5569 => 0.6280, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 12.66% (1.0722 => 1.2079, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 12.58% (0.4299 => 0.4840, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.41% (0.1330 => 0.1495, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 12.34% (0.3387 => 0.3805, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.22% (1.1861 => 1.3310, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.06% (0.2603 => 0.2917, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 12.06% (0.3177 => 0.3560, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.00% (0.3307 => 0.3704, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 11.92% (0.3180 => 0.3559, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.92% (0.3441 => 0.3851, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.90% (0.8101 => 0.9065, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.89% (7.9617 => 8.9080, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/football/football: 11.78% (0.8921 => 0.9972, std.dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.64% (0.1143 => 0.1276) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.56% (0.1125 => 0.1255, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 11.38% (0.3092 => 0.3444, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 11.24% (1.5603 => 1.7357, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 10.77% (0.6456 => 0.7151, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.68% (0.1892 => 0.2094, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 10.64% (2.2969 => 2.5413, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.50% (0.2266 => 0.2504, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 9.90% (21.9371 => 24.1098, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 9.87% (0.1044 => 0.1147, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.62% (0.3543 => 0.3884, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 9.49% (0.4289 => 0.4696, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 9.37% (0.4620 => 0.5053, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.27% (0.3927 => 0.4291, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.19% (0.3473 => 0.3792, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.18% (0.3694 => 0.4033, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions: 9.14% (0.3828 => 0.4178, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.09% (0.3543 => 0.3865, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.99% (0.3516 => 0.3832, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.96% (0.3561 => 0.3880, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 8.96% (0.3886 => 0.4234, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 8.95% (0.3497 => 0.3810, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.81% (0.3826 => 0.4163, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.75% (0.3865 => 0.4203, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.74% (0.4636 => 0.5041, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.66% (0.4203 => 0.4567, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 8.65% (0.3422 => 0.3718, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.60% (0.2430 => 0.2639, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 8.55% (17.1811 => 18.6505, std.dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.55% (0.3427 => 0.3720, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.48% (0.4103 => 0.4451, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 8.17% (0.3684 => 0.3985, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 8.10% (0.4048 => 0.4376, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.90% (14.3668 => 15.5023, std.dev.: 0.0170) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.84% (3.8922 => 4.1972, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.61% (0.6030 => 0.6489, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.61% (0.5925 => 0.6376, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 7.44% (0.3603 => 0.3871, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.23% (0.4064 => 0.4358, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.14% (0.3136 => 0.3360, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.06% (0.7326 => 0.7843, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.99% (0.3650 => 0.3905, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.75% (0.3098 => 0.3307, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 6.68% (0.2831 => 0.3020, std.dev.: 0.0049) SingleSource/Regression/C++/ofstream_ctor: 6.47% (0.2905 => 0.3093, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.42% (0.3162 => 0.3365, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 6.37% (0.3232 => 0.3438, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.36% (0.2891 => 0.3075, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 6.31% (0.3283 => 0.3490, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.25% (2.0665 => 2.1957, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.17% (0.2871 => 0.3048, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.05% (0.2793 => 0.2962, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.03% (0.3052 => 0.3236, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.02% (0.2872 => 0.3045, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.02% (0.2725 => 0.2889, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.99% (0.2756 => 0.2921, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 5.89% (0.3379 => 0.3578, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 5.87% (0.2877 => 0.3046, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 5.78% (1.2842 => 1.3584, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hello: 5.64% (0.2714 => 0.2867, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.60% (0.2802 => 0.2959, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.89% (0.3131 => 0.3284, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.97% (1.1194 => 1.1527, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8961, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1725, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.02% (0.9957 => 1.1253, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.94% (1.1396 => 1.2529, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3689, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: 5.92% (1.9405 => 2.0554, std.dev.: 0.0094) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.61% (0.3987 => 0.4091, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.59% (4.2280 => 4.3376, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.91% (3.6395 => 3.7091, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/bisort/bisort: 1.79% (0.8333 => 0.8482, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 1.54% (3.1595 => 3.2081, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.41% (2.6546 => 2.6921, std.dev.: 0.0035) MultiSource/Applications/viterbi/viterbi: 1.26% (4.4649 => 4.5211, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.98% (6.6874 => 0.1353, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -79.61% (0.8651 => 0.1764, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.95% (5.2763 => 3.2211, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.09% (5.3855 => 3.7111, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.60% (5.3526 => 3.7149, std.dev.: 0.0088) SingleSource/UnitTests/Vector/constpool: -14.63% (54.1659 => 46.2412, std.dev.: 0.0134) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.45% (2.9384 => 2.6314, std.dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: -5.61% (22.1758 => 20.9314, std.dev.: 0.0246) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -53.08% (8.0499 => 3.7772, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7636, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4751, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.88% (1.6925 => 1.4237, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.71% (1.2258 => 1.0700, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.69% (1.2373 => 1.0926, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -10.90% (1.5373 => 1.3697, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.35% (19.9488 => 18.2836, std.dev.: 0.0084) MultiSource/Benchmarks/FreeBench/mason/mason: -7.73% (0.2161 => 0.1994, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.98% (1.8329 => 1.7049, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.14% (1.6805 => 1.5941, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.96% (1.5835 => 1.5050, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.30% (8.1563 => 7.8054, std.dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Applications/siod/siod: -3.67% (3.2827 => 3.1622, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8777, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4979, std.dev.: 0.0058) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.93% (0.4808 => 0.4667, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: -2.16% (4.6441 => 4.5436, std.dev.: 0.0103) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -1.77% (10.2830 => 10.1014, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6793, std.dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: -1.67% (2.5528 => 2.5102, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4207, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2879, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.06% (6.2999 => 6.2331, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8571, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 19.56% (0.5229 => 0.6252, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 15.01% (14.9895 => 17.2393, std.dev.: 0.0102) MultiSource/Applications/kimwitu++/kc: 10.22% (14.1553 => 15.6024, std.dev.: 0.0122) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 35.14% (1.1048 => 1.4930, std.dev.: 0.0074) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.79% (7.1582 => 8.2168, std.dev.: 0.0154) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.25% (0.6222 => 0.6860, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.30% (0.1485 => 0.1436, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.47% (0.2116 => 0.0646, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 23 07:13:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 23 Oct 2012 09:13:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121023141336.D1F8E2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/5130?compare_to=5123&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5130, Order: 166475, Start Time: 2012-10-23 10:59:34, End Time: 2012-10-23 14:15:41 To: 5123, Order: 166467, Start Time: 2012-10-23 06:52:57, End Time: 2012-10-23 10:11:50 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (170 on baseline) Performance Improvements: 2 (19 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1038 (719 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.50% (125.3965 => 129.7825, std.dev.: 1.1498) SingleSource/Benchmarks/Shootout-C++/methcall: 1.17% (16.2230 => 16.4120, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/reversefile: -3.04% (0.4342 => 0.4210, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: -1.30% (0.8399 => 0.8290, std.dev.: 0.0028) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 39.84% (0.0625 => 0.0874, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.51% (0.1063 => 0.1398, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.83% (0.2969 => 0.3736, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.14% (0.1106 => 0.1384, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.51% (0.0714 => 0.0889, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.28% (0.4139 => 0.5144, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 24.13% (0.0547 => 0.0679) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.05% (0.4994 => 0.6195, std.dev.: 0.0046) MultiSource/Applications/oggenc/oggenc: 23.90% (1.5932 => 1.9739, std.dev.: 0.0102) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.76% (0.5900 => 0.7302, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.37% (0.0475 => 0.0586, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.22% (0.5000 => 0.6161, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.84% (0.1620 => 0.1990, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.60% (0.0584 => 0.0716, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 22.53% (0.4253 => 0.5211, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.23% (0.1021 => 0.1248, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 21.87% (0.0599 => 0.0730, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.86% (0.1107 => 0.1349, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.63% (0.0897 => 0.1091, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 21.20% (0.0948 => 0.1149, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.17% (0.0633 => 0.0767, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.89% (0.0584 => 0.0706, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.87% (0.0642 => 0.0776, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.76% (0.1103 => 0.1332, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 20.70% (0.0604 => 0.0729, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 20.63% (0.1619 => 0.1953, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 20.46% (0.0821 => 0.0989, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.44% (0.0822 => 0.0990, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.33% (0.0541 => 0.0651, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.32% (0.3903 => 0.4696, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.24% (0.1003 => 0.1206, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.21% (0.1549 => 0.1862, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.01% (0.1604 => 0.1925, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 19.32% (0.0947 => 0.1130, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.95% (0.1462 => 0.1739, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 18.67% (0.1505 => 0.1786, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.64% (0.2736 => 0.3246, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.62% (0.2014 => 0.2389, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.53% (0.3890 => 0.4611, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 18.39% (0.1218 => 0.1442, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 18.19% (0.0808 => 0.0955, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 18.12% (0.4029 => 0.4759, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.10% (0.1160 => 0.1370, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.01% (1.3152 => 1.5521, std.dev.: 0.0054) SingleSource/UnitTests/ObjC++/Hello: 17.95% (0.5826 => 0.6872, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 17.91% (0.0698 => 0.0823, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 17.90% (0.0581 => 0.0685, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 17.88% (0.5889 => 0.6942, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.74% (0.1088 => 0.1281, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.62% (0.2866 => 0.3371, std.dev.: 0.0034) MultiSource/Applications/hbd/hbd: 17.51% (0.9697 => 1.1395, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.43% (3.5627 => 4.1837, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: 17.38% (1.8794 => 2.2061, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.21% (0.5026 => 0.5891, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.20% (0.2738 => 0.3209, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 17.18% (0.5546 => 0.6499, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.15% (0.2875 => 0.3368, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.13% (1.6211 => 1.8988, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.97% (0.1968 => 0.2302, std.dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 16.94% (0.3004 => 0.3513, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.90% (0.4658 => 0.5445, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 16.89% (0.1421 => 0.1661, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 16.66% (0.2725 => 0.3179, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.64% (0.3930 => 0.4584, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.56% (2.7292 => 3.1811, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/hello: 16.54% (0.2714 => 0.3163, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 16.44% (0.2750 => 0.3202, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.42% (0.2729 => 0.3177, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 16.39% (1.0781 => 1.2548, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.39% (0.3271 => 0.3807, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 16.29% (0.2780 => 0.3233, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 16.29% (0.2811 => 0.3269, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 16.21% (0.9909 => 1.1515, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.19% (0.2792 => 0.3244, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 16.18% (0.3096 => 0.3597, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.18% (2.0673 => 2.4018, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/random: 16.16% (0.2803 => 0.3256, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.14% (0.4361 => 0.5065, std.dev.: 0.0030) MultiSource/Applications/ClamAV/clamscan: 16.11% (4.2109 => 4.8891, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/objinst: 16.08% (0.2823 => 0.3277, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.06% (0.3195 => 0.3708, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 16.03% (0.2813 => 0.3264, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.97% (0.2911 => 0.3376, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.84% (1.9694 => 2.2813, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary3: 15.76% (0.3267 => 0.3782, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 15.65% (0.3258 => 0.3768, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 15.61% (0.3446 => 0.3984, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.61% (1.9966 => 2.3082, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 15.60% (0.7171 => 0.8290, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary2: 15.59% (0.3317 => 0.3834, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 15.58% (0.1284 => 0.1484, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.54% (0.3488 => 0.4030, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 15.50% (0.3348 => 0.3867, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.47% (4.4195 => 5.1032, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/for-in: 15.30% (0.3496 => 0.4031, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 15.30% (0.3465 => 0.3995, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 15.23% (0.3460 => 0.3987, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.23% (0.3362 => 0.3874, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/trivial-interface: 15.22% (0.3442 => 0.3966, std.dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 15.20% (0.2566 => 0.2956, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.20% (0.3060 => 0.3525, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/synchronized: 15.19% (0.3469 => 0.3996, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 15.16% (23.5202 => 27.0865, std.dev.: 0.0441) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.14% (0.3124 => 0.3597, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.14% (0.1090 => 0.1255, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 14.87% (0.3678 => 0.4225, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 14.79% (0.3650 => 0.4190, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 14.74% (0.3643 => 0.4180, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.72% (0.3282 => 0.3765, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 14.68% (0.3726 => 0.4273, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 14.61% (0.3477 => 0.3985, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 14.61% (0.3724 => 0.4268, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.59% (0.3625 => 0.4154, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 14.32% (1.4269 => 1.6313, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/football/football: 14.17% (0.2075 => 0.2369, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.09% (0.3690 => 0.4210, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 14.04% (0.4146 => 0.4728, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.97% (0.3981 => 0.4537, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.97% (0.3845 => 0.4382, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 13.90% (0.4251 => 0.4842, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 13.79% (0.7875 => 0.8961, std.dev.: 0.0057) MultiSource/Applications/JM/ldecod/ldecod: 13.67% (2.1653 => 2.4612, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 13.35% (2.1013 => 2.3818, std.dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: 13.30% (4.6177 => 5.2317, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/bigfib: 13.25% (0.5012 => 0.5676, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.70% (0.2040 => 0.2299, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 12.13% (5.5417 => 6.2139, std.dev.: 0.0128) MultiSource/Applications/SIBsim4/SIBsim4: 12.11% (0.2691 => 0.3017, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.95% (0.6435 => 0.7204, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 11.38% (0.3498 => 0.3896, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.28% (0.1028 => 0.1144, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 11.26% (0.6634 => 0.7381, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.00% (0.2737 => 0.3038, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.88% (0.2068 => 0.2293, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.67% (0.3084 => 0.3413, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.63% (0.1383 => 0.1530, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 10.46% (0.3336 => 0.3685, std.dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: 10.21% (0.4847 => 0.5342, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.80% (0.2103 => 0.2309, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 9.45% (2.0346 => 2.2269, std.dev.: 0.0063) MultiSource/Applications/lemon/lemon: 9.16% (0.2391 => 0.2610, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.70% (4.6926 => 5.1008, std.dev.: 0.0169) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.64% (0.5361 => 0.5824, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.24% (11.6398 => 12.5994, std.dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.80% (0.7426 => 0.8005, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.68% (0.5584 => 0.6013, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 6.62% (11.9555 => 12.7464, std.dev.: 0.0262) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.72% (0.3792 => 0.4009, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6533, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.59% (2.5769 => 3.0302, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.22% (0.5917 => 0.6699, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 9.31% (0.2802 => 0.3063, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6103, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.31% (0.3693 => 0.3926, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 4.98% (12.0509 => 12.6514, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1691, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-2: 3.87% (1.8057 => 1.8755, std.dev.: 0.0046) SingleSource/Benchmarks/Dhrystone/dry: 2.78% (14.0481 => 14.4390, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1907, std.dev.: 0.0083) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.78% (3.1722 => 3.2287, std.dev.: 0.0027) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3018, std.dev.: 0.0164) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2861, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5402, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.07% (1.2451 => 1.2584) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5792, std.dev.: 0.0214) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.96% (2.4764 => 2.3784, std.dev.: 0.0112) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.44% (25.4195 => 16.4120, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary2: -9.70% (0.2402 => 0.2169, std.dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9771, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7734, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2421, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.16% (11.2080 => 10.8537, std.dev.: 0.0458) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7742, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5217, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -2.29% (17.2379 => 16.8436, std.dev.: 0.0121) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8634, std.dev.: 0.0192) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.94% (0.6293 => 0.6171, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.80% (10.7630 => 10.5695, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: -1.55% (5.5810 => 5.4947, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.13% (105.3826 => 104.1885, std.dev.: 0.0671) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0440, std.dev.: 0.0035) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.03% (3.3991 => 3.3640, std.dev.: 0.0010) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 23 14:23:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 23 Oct 2012 16:23:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121023212344.11CEF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5139?compare_to=5136&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5139, Order: 166492, Start Time: 2012-10-23 20:05:23, End Time: 2012-10-23 21:25:46 To: 5136, Order: 166487, Start Time: 2012-10-23 18:15:15, End Time: 2012-10-23 19:35:45 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (5 on baseline) Performance Regressions: 2 (197 on baseline) Performance Improvements: 4 (48 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 88 (14 on baseline) Unchanged Tests: 948 (642 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/McGill/chomp: 6.28% (0.1942 => 0.2064, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 1.02% (15.3344 => 15.4910, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.05% (2.0156 => 1.9945, std.dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.21% (3.2178 => 3.0824, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -1.96% (2.0553 => 2.0151, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.17% (1.1419 => 1.1285, std.dev.: 0.0035) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.30% (0.6281 => 0.6262, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: -0.50% (17.3105 => 17.2246, std.dev.: 0.0152) MultiSource/Applications/kimwitu++/kc: -0.60% (15.6747 => 15.5802, std.dev.: 0.0204) MultiSource/Benchmarks/Bullet/bullet: -0.40% (56.2223 => 55.9994, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.20% (0.0488 => 0.0487, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.20% (0.0490 => 0.0489, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0458 => 0.0458, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0459 => 0.0459, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0447 => 0.0447, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.22% (0.0448 => 0.0447, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0440 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0441 => 0.0441, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.44% (0.0459 => 0.0457, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.22% (0.0459 => 0.0458, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0452 => 0.0452, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.22% (0.0454 => 0.0453, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.23% (0.0443 => 0.0444) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.23% (0.0444 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.22% (0.0450 => 0.0449, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.22% (0.0451 => 0.0450, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.22% (0.0461 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0462 => 0.0462, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.46% (0.0439 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.23% (0.0438 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0449 => 0.0449, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.44% (0.0451 => 0.0449, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.23% (0.0441 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0442 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0433 => 0.0433, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.23% (0.0434 => 0.0433, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.23% (0.0433 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.23% (0.0433 => 0.0432, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0469 => 0.0469) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.21% (0.0470 => 0.0469, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0431 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.23% (0.0433 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.23% (0.0433 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.46% (0.0435 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0439 => 0.0439, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.23% (0.0441 => 0.0440, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.29% (1.4974 => 1.4931, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.32% (8.2241 => 8.1974, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.13% (0.6878 => 0.6869, std.dev.: 0.0049) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1436 => 0.1435, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.56% (0.0664 => 0.0647, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.45% (63.2438 => 55.9994, std.dev.: 0.0186) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/MallocBench/gs/gs: 13.29% (4.1105 => 4.6567, std.dev.: 0.0137) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.37% (3.4629 => 5.7959, std.dev.: 0.0125) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13511.25% (0.0720 => 9.8001, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049800.00% (0.0001 => 10.0499, std.dev.: 0.0007) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 69.14% (0.0256 => 0.0433, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 63.78% (0.2554 => 0.4183, std.dev.: 0.0018) SingleSource/Regression/C/sumarraymalloc: 51.03% (0.0243 => 0.0367) MultiSource/Benchmarks/PAQ8p/paq8p: 49.42% (10.3673 => 15.4910, std.dev.: 0.0037) SingleSource/UnitTests/SignlessTypes/factor: 46.96% (0.0296 => 0.0435, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 43.91% (0.0271 => 0.0390) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.09% (1.5859 => 2.2375, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 38.29% (0.1622 => 0.2243, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 36.65% (0.1056 => 0.1443) SingleSource/UnitTests/vla: 33.52% (0.0355 => 0.0474, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.10% (2.2024 => 2.8654, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/neural/neural: 27.82% (0.1463 => 0.1870, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 24.71% (0.1655 => 0.2064, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 23.98% (0.0834 => 0.1034, std.dev.: 0.0023) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.39% (0.1566 => 0.1901, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: 21.24% (0.0485 => 0.0588, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 20.35% (0.2049 => 0.2466, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.99% (7.0540 => 8.3934, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops: 18.92% (0.1432 => 0.1703, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 18.59% (0.1555 => 0.1844, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.48% (0.0871 => 0.1032, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.02% (2.2022 => 2.5991, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.79% (0.5105 => 0.6013, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.75% (0.0648 => 0.0763, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.54% (0.8172 => 0.9605, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.26% (0.6675 => 0.7827, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 17.21% (0.1906 => 0.2234, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.10% (0.1029 => 0.1205, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: 16.93% (0.0626 => 0.0732, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.77% (0.0793 => 0.0926, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 16.76% (0.1695 => 0.1979, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.73% (0.3121 => 0.3643, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.67% (1.3050 => 1.5225, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/mst/mst: 16.51% (0.1163 => 0.1355, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 16.47% (3.3354 => 3.8848, std.dev.: 0.0092) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.47% (0.2271 => 0.2645, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 16.46% (0.1440 => 0.1677, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.45% (0.4615 => 0.5374, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/tsp/tsp: 16.43% (0.1175 => 0.1368, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.29% (0.0798 => 0.0928, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.93% (0.1337 => 0.1550, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.70% (0.1032 => 0.1194, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.69% (0.0886 => 0.1025, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.67% (1.5415 => 1.7830, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.44% (0.0842 => 0.0972, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.26% (0.0675 => 0.0778, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.26% (0.5020 => 0.5786, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.15% (0.1940 => 0.2234, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 15.12% (0.3109 => 0.3579, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.10% (0.1510 => 0.1738, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 15.08% (10.4361 => 12.0098, std.dev.: 0.0167) SingleSource/Benchmarks/Misc/oourafft: 15.05% (0.3282 => 0.3776, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.91% (0.9765 => 1.1221, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 14.88% (0.0672 => 0.0772, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.81% (0.0770 => 0.0884, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 14.73% (0.7115 => 0.8163, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.64% (4.2646 => 4.8890, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 14.64% (0.3423 => 0.3924, std.dev.: 0.0034) SingleSource/Benchmarks/McGill/exptree: 14.62% (0.0814 => 0.0933, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.61% (0.0746 => 0.0855, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.50% (0.1117 => 0.1279, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.43% (0.2107 => 0.2411, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 14.42% (1.1642 => 1.3321, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.36% (0.2758 => 0.3154, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.33% (0.2065 => 0.2361, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/matrix: 14.30% (0.0818 => 0.0935, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 14.25% (0.1151 => 0.1315, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.20% (0.1584 => 0.1809, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.08% (0.0838 => 0.0956, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.08% (0.1236 => 0.1410, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.03% (0.5981 => 0.6820, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.02% (0.6450 => 0.7354, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.01% (0.5860 => 0.6681, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.93% (0.0933 => 0.1063, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 13.91% (0.7835 => 0.8925, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.87% (1.4186 => 1.6153, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 13.79% (9.4845 => 10.7921, std.dev.: 0.0180) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.75% (0.1062 => 0.1208, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.64% (0.0770 => 0.0875, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.59% (8.1363 => 9.2423, std.dev.: 0.0091) MultiSource/Applications/oggenc/oggenc: 13.43% (5.7591 => 6.5327, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.42% (0.1438 => 0.1631) MultiSource/Applications/treecc/treecc: 13.40% (2.0273 => 2.2990, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.30% (0.2700 => 0.3059, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.27% (1.7609 => 1.9945, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/health/health: 13.25% (0.1268 => 0.1436, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.24% (0.0929 => 0.1052, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 13.22% (0.7433 => 0.8416, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.16% (0.1695 => 0.1918, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 13.10% (0.4299 => 0.4862, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 13.06% (1.1840 => 1.3386, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.98% (0.8067 => 0.9114, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.95% (4.9449 => 5.5855, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.92% (5.0018 => 5.6478, std.dev.: 0.0024) SingleSource/UnitTests/SignlessTypes/rem: 12.85% (0.1144 => 0.1291, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 12.84% (1.0722 => 1.2099, std.dev.: 0.0068) MultiSource/Applications/lua/lua: 12.82% (3.8723 => 4.3689, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.80% (0.1625 => 0.1833, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.79% (0.5569 => 0.6281, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.71% (0.1330 => 0.1499, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.52% (0.4879 => 0.5490, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.37% (1.1861 => 1.3328, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 12.35% (0.3092 => 0.3474) MultiSource/Benchmarks/sim/sim: 12.34% (0.3387 => 0.3805, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.27% (7.9617 => 8.9387, std.dev.: 0.0177) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.23% (0.3441 => 0.3862, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.14% (0.2603 => 0.2919, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 12.13% (0.8921 => 1.0003, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/09-vor/vor: 12.11% (0.3180 => 0.3565, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 12.09% (0.1125 => 0.1261, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.96% (0.3177 => 0.3557, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.91% (0.3307 => 0.3701, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.81% (0.1143 => 0.1278, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.70% (0.8101 => 0.9049, std.dev.: 0.0042) MultiSource/Applications/hbd/hbd: 11.24% (1.5603 => 1.7357, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.89% (0.1892 => 0.2098, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 10.67% (0.6456 => 0.7145, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 10.57% (2.2969 => 2.5396, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.55% (0.2266 => 0.2505, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.25% (0.3543 => 0.3906, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 9.87% (0.1044 => 0.1147, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 9.75% (0.3927 => 0.4310, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 9.67% (0.3497 => 0.3835) SingleSource/UnitTests/ObjC/for-in: 9.66% (0.3694 => 0.4051, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 9.66% (21.9371 => 24.0555, std.dev.: 0.0062) SingleSource/UnitTests/ObjC/exceptions-4: 9.65% (0.3543 => 0.3885, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 9.65% (0.3473 => 0.3808, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.64% (0.3828 => 0.4197, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 9.61% (0.4289 => 0.4701, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 9.55% (0.3561 => 0.3901, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.47% (0.3516 => 0.3849, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.47% (0.3886 => 0.4254, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 9.29% (0.4620 => 0.5049, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.12% (0.3826 => 0.4175, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 8.85% (0.3422 => 0.3725, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.85% (0.3865 => 0.4207, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.67% (0.3427 => 0.3724, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.64% (0.4203 => 0.4566, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.60% (0.2430 => 0.2639, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.58% (0.4103 => 0.4455, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 8.55% (17.1811 => 18.6500, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/moments: 8.40% (0.4048 => 0.4388, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.39% (0.4636 => 0.5025, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists1: 8.03% (0.3684 => 0.3980, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.89% (14.3668 => 15.5006, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.86% (3.8922 => 4.1982, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: 7.56% (0.6030 => 0.6486, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/sieve: 7.44% (0.3603 => 0.3871, std.dev.: 0.0085) SingleSource/UnitTests/ObjC++/Hello: 7.43% (0.5925 => 0.6365, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.19% (0.4064 => 0.4356, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.96% (0.3650 => 0.3904, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 6.93% (0.7326 => 0.7834, std.dev.: 0.0021) SingleSource/Regression/C++/ofstream_ctor: 6.82% (0.2905 => 0.3103, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 6.75% (0.3098 => 0.3307, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.51% (0.3162 => 0.3368, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.50% (0.2891 => 0.3079, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.46% (0.2831 => 0.3014, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 6.44% (0.3232 => 0.3440, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.40% (2.0665 => 2.1988, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.38% (0.3136 => 0.3336, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.37% (0.3283 => 0.3492, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.16% (0.2793 => 0.2965, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.13% (0.2756 => 0.2925, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.13% (0.3379 => 0.3586, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.09% (0.2872 => 0.3047, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.06% (0.2725 => 0.2890, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 6.05% (0.2877 => 0.3051, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.00% (0.3052 => 0.3235, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 5.83% (1.2842 => 1.3591, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hello: 5.75% (0.2714 => 0.2870, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 5.75% (0.2802 => 0.2963, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.01% (0.3131 => 0.3288, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.93% (1.1194 => 1.1522, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.59% (0.3935 => 0.4037, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1725, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.95% (1.1145 => 1.2923, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.34% (0.9957 => 1.1285, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.92% (1.1396 => 1.2526, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.64% (2.8904 => 3.0824, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.64% (3.1578 => 3.3674, std.dev.: 0.0009) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 3.84% (1.9405 => 2.0151, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.73% (4.2280 => 4.3435, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.61% (0.3987 => 0.4091, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.98% (0.8333 => 0.8498, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.92% (3.6395 => 3.7095, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.56% (2.6546 => 2.6959, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2075, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 1.27% (4.4649 => 4.5218, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.10% (6.5088 => 6.5803, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.96% (6.6874 => 0.1362, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -79.91% (0.8651 => 0.1738, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.01% (5.2763 => 3.2182, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.06% (5.3855 => 3.7130, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.68% (5.3526 => 3.7102, std.dev.: 0.0029) SingleSource/UnitTests/Vector/constpool: -14.57% (54.1659 => 46.2732, std.dev.: 0.0206) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.47% (2.9384 => 2.6307, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -5.70% (22.1758 => 20.9121, std.dev.: 0.0260) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -52.86% (8.0499 => 3.7944, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7637, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.64% (2.9695 => 2.4753, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.96% (1.6925 => 1.4224, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.66% (1.2258 => 1.0706, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.37% (1.2373 => 1.0966, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -10.97% (1.5373 => 1.3686, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.33% (19.9488 => 18.2861, std.dev.: 0.0130) MultiSource/Benchmarks/FreeBench/mason/mason: -8.01% (0.2161 => 0.1988, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.07% (1.8329 => 1.7033, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4781, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0023) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.12% (1.6805 => 1.5944, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5079, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.29% (8.1563 => 7.8068, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Applications/siod/siod: -3.67% (3.2827 => 3.1621, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8776, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4952, std.dev.: 0.0083) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.64% (0.4808 => 0.4681, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -2.20% (4.6441 => 4.5421, std.dev.: 0.0017) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0848, std.dev.: 0.0243) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6826, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.63% (2.5528 => 2.5112, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4197, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2879, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.09% (1.0554 => 1.0439, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8574, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/lists: -1.05% (12.5348 => 12.4036, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout/lists: -1.00% (6.2999 => 6.2366, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 19.76% (0.5229 => 0.6262, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 14.91% (14.9895 => 17.2246, std.dev.: 0.0152) MultiSource/Applications/kimwitu++/kc: 10.07% (14.1553 => 15.5802, std.dev.: 0.0204) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 35.15% (1.1048 => 1.4931, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.52% (7.1582 => 8.1974, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.40% (0.6222 => 0.6869, std.dev.: 0.0049) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.37% (0.1485 => 0.1435, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.42% (0.2116 => 0.0647, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 23 16:14:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 23 Oct 2012 18:14:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121023231418.812AF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5142?compare_to=5139&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5142, Order: 166501, Start Time: 2012-10-23 21:55:33, End Time: 2012-10-23 23:16:13 To: 5139, Order: 166492, Start Time: 2012-10-23 20:05:23, End Time: 2012-10-23 21:25:46 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (5 on baseline) Performance Regressions: 13 (195 on baseline) Performance Improvements: 1 (46 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 88 (14 on baseline) Unchanged Tests: 940 (646 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/salsa20: 12.54% (0.1738 => 0.1956, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 10.95% (2.6307 => 2.9187, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 7.87% (1.1522 => 1.2429, std.dev.: 0.0057) SingleSource/UnitTests/Vector/constpool: 6.10% (46.2732 => 49.0950, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.46% (3.2182 => 3.2974, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 2.31% (0.5490 => 0.5617, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.07% (2.5991 => 2.6530, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.35% (8.3934 => 8.5065, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.26% (3.7102 => 3.7569, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.18% (3.7130 => 3.7567, std.dev.: 0.0027) MultiSource/Benchmarks/PAQ8p/paq8p: 1.07% (15.4910 => 15.6564, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.00% (1.9945 => 2.0145, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 202.64% (3.0017 => 9.0843, std.dev.: 0.0068) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.36% (0.9605 => 0.9474, std.dev.: 0.0023) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.38% (0.6262 => 0.6286, std.dev.: 0.0033) MultiSource/Applications/SPASS/SPASS: 0.08% (17.2246 => 17.2379, std.dev.: 0.0199) MultiSource/Applications/kimwitu++/kc: 0.63% (15.5802 => 15.6776, std.dev.: 0.0221) MultiSource/Benchmarks/Bullet/bullet: 0.60% (55.9994 => 56.3369, std.dev.: 0.0354) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.62% (0.0487 => 0.0484, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.41% (0.0489 => 0.0487, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.66% (0.0458 => 0.0455, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.65% (0.0459 => 0.0456, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.45% (0.0447 => 0.0445, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.45% (0.0447 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.45% (0.0440 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.45% (0.0441 => 0.0439) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.44% (0.0457 => 0.0455, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.22% (0.0458 => 0.0457) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.66% (0.0452 => 0.0449, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.44% (0.0453 => 0.0451, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.90% (0.0444 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.23% (0.0443 => 0.0442, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.45% (0.0449 => 0.0447) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.44% (0.0450 => 0.0448, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.43% (0.0460 => 0.0458, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.87% (0.0462 => 0.0458, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.46% (0.0437 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.23% (0.0437 => 0.0436) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.45% (0.0449 => 0.0447) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.45% (0.0449 => 0.0447, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.45% (0.0440 => 0.0438, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.68% (0.0442 => 0.0439, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.46% (0.0433 => 0.0431) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.46% (0.0433 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.46% (0.0432 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.46% (0.0432 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.85% (0.0469 => 0.0465, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.21% (0.0469 => 0.0468, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.46% (0.0431 => 0.0429) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.46% (0.0432 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.23% (0.0432 => 0.0431) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.23% (0.0433 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.68% (0.0439 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.68% (0.0440 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.40% (1.4931 => 1.4991, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.82% (8.1974 => 8.2644, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.28% (0.6869 => 0.6888, std.dev.: 0.0092) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1435 => 0.1435, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.40% (0.0647 => 0.0669, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -10.92% (63.2438 => 56.3369, std.dev.: 0.0354) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/MallocBench/gs/gs: 13.31% (4.1105 => 4.6577, std.dev.: 0.0132) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.65% (3.4629 => 5.8055, std.dev.: 0.0086) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13508.89% (0.0720 => 9.7984, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050100.00% (0.0001 => 10.0502, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 68.75% (0.0256 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 64.45% (0.2554 => 0.4200, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 51.02% (10.3673 => 15.6564, std.dev.: 0.0042) SingleSource/Regression/C/sumarraymalloc: 49.79% (0.0243 => 0.0364, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 46.96% (0.0296 => 0.0435, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 43.91% (0.0271 => 0.0390, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.13% (1.5859 => 2.2382, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/richards_benchmark: 39.21% (0.1622 => 0.2258, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/distray/distray: 37.31% (0.1056 => 0.1450, std.dev.: 0.0009) SingleSource/UnitTests/vla: 32.96% (0.0355 => 0.0472, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.30% (2.2024 => 2.8697, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: 28.23% (0.1463 => 0.1876, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 24.17% (0.1655 => 0.2055, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 23.74% (0.0834 => 0.1032, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.39% (0.1566 => 0.1901, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 21.03% (0.2049 => 0.2480, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.59% (7.0540 => 8.5065, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pifft/pifft: 20.47% (2.2022 => 2.6530, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 20.25% (0.1432 => 0.1722, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 19.05% (0.0798 => 0.0950, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.71% (0.0871 => 0.1034, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.66% (0.1029 => 0.1221, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 18.39% (0.1555 => 0.1841, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 18.16% (0.5105 => 0.6032, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.77% (0.6675 => 0.7861, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.82% (1.3050 => 1.5245, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 16.81% (0.1440 => 0.1682) MultiSource/Applications/d/make_dparser: 16.68% (3.3354 => 3.8916, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/lists: 16.61% (0.0626 => 0.0730, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.52% (0.0793 => 0.0924, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 16.43% (0.1175 => 0.1368, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 16.40% (0.1695 => 0.1973, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.29% (0.2271 => 0.2641, std.dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.21% (0.3121 => 0.3627, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.16% (0.4615 => 0.5361, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.04% (1.5415 => 1.7888, std.dev.: 0.0101) MultiSource/Benchmarks/Olden/mst/mst: 15.99% (0.1163 => 0.1349, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.93% (0.8172 => 0.9474, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.86% (0.1337 => 0.1549, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 15.81% (0.3282 => 0.3801, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.66% (0.5020 => 0.5806, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 15.37% (0.3109 => 0.3587, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.35% (0.0886 => 0.1022, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.31% (0.1032 => 0.1190, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 15.17% (0.7115 => 0.8194, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 15.13% (0.4879 => 0.5617, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.10% (0.1510 => 0.1738, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.96% (0.0842 => 0.0968, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.82% (0.9765 => 1.1212, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.69% (0.1940 => 0.2225, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.68% (0.0838 => 0.0961, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/matrix: 14.67% (0.0818 => 0.0938, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 14.58% (0.3423 => 0.3922, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 14.57% (0.3177 => 0.3640, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 14.56% (1.1642 => 1.3337, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 14.53% (8.1363 => 9.3184, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.48% (0.0746 => 0.0854, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 14.46% (9.4845 => 10.8558, std.dev.: 0.0056) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.46% (0.1584 => 0.1813, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.42% (4.2646 => 4.8796, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.40% (1.7609 => 2.0145, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.33% (0.2107 => 0.2409, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 14.29% (10.4361 => 11.9274, std.dev.: 0.0152) SingleSource/Benchmarks/McGill/exptree: 14.25% (0.0814 => 0.0930, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 14.22% (0.1906 => 0.2177, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.18% (0.2758 => 0.3149, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 14.16% (0.1151 => 0.1314, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.16% (0.0770 => 0.0879, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.15% (0.1117 => 0.1275, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 13.97% (0.0730 => 0.0832, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 13.92% (0.6450 => 0.7348, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.89% (0.5860 => 0.6674, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.88% (0.5981 => 0.6811, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.83% (0.1236 => 0.1407, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.83% (0.0933 => 0.1062, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 13.81% (0.7835 => 0.8917, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.77% (0.1438 => 0.1636, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 13.76% (5.7591 => 6.5514, std.dev.: 0.0106) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.67% (0.2700 => 0.3069, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.65% (1.4186 => 1.6123, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.61% (0.2065 => 0.2346, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.56% (0.1062 => 0.1206, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 13.55% (0.1144 => 0.1299, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 13.54% (2.0273 => 2.3018, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.45% (0.1695 => 0.1923, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 13.40% (0.7433 => 0.8429, std.dev.: 0.0068) MultiSource/Benchmarks/nbench/nbench: 13.34% (1.1840 => 1.3420, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.33% (0.8067 => 0.9142, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.25% (0.0770 => 0.0872, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 13.23% (1.0722 => 1.2141, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.17% (0.1625 => 0.1839, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 13.12% (4.9449 => 5.5938, std.dev.: 0.0123) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.05% (5.0018 => 5.6545, std.dev.: 0.0076) MultiSource/Benchmarks/sim/sim: 12.99% (0.3387 => 0.3827, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 12.98% (3.8723 => 4.3749, std.dev.: 0.0155) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.93% (0.1330 => 0.1502, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.92% (0.0929 => 0.1049, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 12.85% (0.1268 => 0.1431, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 12.72% (0.4299 => 0.4846, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.60% (1.1861 => 1.3355, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.52% (0.2603 => 0.2929, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.52% (7.9617 => 8.9584, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.44% (0.5569 => 0.6262, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.38% (0.3441 => 0.3867, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.31% (0.3307 => 0.3714, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 12.25% (0.8921 => 1.0014, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/09-vor/vor: 12.23% (0.3180 => 0.3569, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: 12.23% (0.3092 => 0.3470, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.09% (0.2266 => 0.2540, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 12.09% (0.1125 => 0.1261, std.dev.: 0.0025) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.90% (0.1143 => 0.1279, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.89% (0.1892 => 0.2117, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: 11.61% (1.5603 => 1.7415, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.52% (0.8101 => 0.9034, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 11.12% (0.6456 => 0.7174, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.03% (1.1194 => 1.2429, std.dev.: 0.0057) MultiSource/Applications/siod/siod: 10.58% (2.2969 => 2.5398, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.44% (0.1044 => 0.1153, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 10.18% (21.9371 => 24.1692, std.dev.: 0.0231) SingleSource/Benchmarks/Shootout-C++/hash2: 10.13% (0.4620 => 0.5088, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.10% (0.3543 => 0.3901, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 9.91% (0.4289 => 0.4714, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/parameter-passing: 9.75% (0.3927 => 0.4310) SingleSource/UnitTests/ObjC/synchronized: 9.69% (0.3561 => 0.3906, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.65% (0.3886 => 0.4261, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 9.64% (0.3828 => 0.4197, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.62% (0.3473 => 0.3807, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 9.58% (0.3516 => 0.3853, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.56% (0.3694 => 0.4047, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.54% (0.3543 => 0.3881, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.47% (0.3497 => 0.3828, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.43% (0.3427 => 0.3750, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.28% (0.3826 => 0.4181, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.26% (0.3865 => 0.4223, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 9.23% (0.3422 => 0.3738, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.19% (0.4103 => 0.4480, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.06% (0.4203 => 0.4584, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.93% (0.2430 => 0.2647, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 8.87% (17.1811 => 18.7057, std.dev.: 0.0075) SingleSource/UnitTests/ObjC++/property-reference-object: 8.87% (0.6030 => 0.6565, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 8.77% (0.4048 => 0.4403, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 8.77% (0.3684 => 0.4007, std.dev.: 0.0082) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.67% (0.4636 => 0.5038, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/Hello: 8.57% (0.5925 => 0.6433, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.23% (14.3668 => 15.5492, std.dev.: 0.0177) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.18% (3.8922 => 4.2107, std.dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/sieve: 8.05% (0.3603 => 0.3893, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.95% (0.3650 => 0.3940, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 7.94% (0.7326 => 0.7908, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.46% (0.3162 => 0.3398, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 7.42% (0.3098 => 0.3328, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.31% (0.4064 => 0.4361, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.13% (0.2891 => 0.3097, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 7.10% (0.2831 => 0.3032, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 7.05% (0.3232 => 0.3460, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.3283 => 0.3514, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.98% (0.3136 => 0.3355, std.dev.: 0.0016) SingleSource/Regression/C++/ofstream_ctor: 6.95% (0.2905 => 0.3107, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.82% (2.0665 => 2.2075, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/except: 6.79% (0.2871 => 0.3066, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.68% (0.2756 => 0.2940, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.67% (0.2877 => 0.3069, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.65% (0.2872 => 0.3063, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.63% (0.3379 => 0.3603, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.55% (0.3052 => 0.3252, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.55% (0.2793 => 0.2976, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 6.53% (0.2725 => 0.2903, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.32% (0.2802 => 0.2979, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 6.32% (1.2842 => 1.3653, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hello: 6.30% (0.2714 => 0.2885, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.65% (0.3131 => 0.3308, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.85% (0.3935 => 0.4047, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1725, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.47% (0.9957 => 1.1298, std.dev.: 0.0224) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.78% (1.1396 => 1.2510, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.73% (3.1578 => 3.3703, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.64% (2.8904 => 3.0822, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625) MultiSource/Benchmarks/Olden/bh/bh: 3.78% (1.9405 => 2.0139, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.80% (4.2280 => 4.3463, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.61% (0.3987 => 0.4091, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.05% (3.6395 => 3.7141, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bisort/bisort: 1.79% (0.8333 => 0.8482, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.63% (2.6546 => 2.6978, std.dev.: 0.0012) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2076, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 1.32% (4.4649 => 4.5238, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.00% (6.5088 => 6.5740, std.dev.: 0.0071) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.00% (6.6874 => 0.1339, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -77.39% (0.8651 => 0.1956, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.51% (5.2763 => 3.2974, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.24% (5.3855 => 3.7567, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -29.81% (5.3526 => 3.7569, std.dev.: 0.0087) SingleSource/UnitTests/Vector/constpool: -9.36% (54.1659 => 49.0950, std.dev.: 0.0095) MultiSource/Applications/ClamAV/clamscan: -4.79% (22.1758 => 21.1131, std.dev.: 0.0191) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -52.86% (8.0499 => 3.7946, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.46% (1.1492 => 0.7647, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4751, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -16.01% (1.6925 => 1.4216, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.69% (1.2258 => 1.0703, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.54% (1.2373 => 1.0945, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -11.07% (1.5373 => 1.3671, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.31% (19.9488 => 18.2903, std.dev.: 0.0574) MultiSource/Benchmarks/FreeBench/mason/mason: -8.01% (0.2161 => 0.1988, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.01% (1.8329 => 1.7045, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4781, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.18% (1.6805 => 1.5935, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.94% (1.5835 => 1.5053, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.31% (8.1563 => 7.8045, std.dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1627, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8778, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5055, std.dev.: 0.0031) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.77% (0.4808 => 0.4675, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: -2.20% (4.6441 => 4.5421, std.dev.: 0.0014) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0867, std.dev.: 0.0164) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6794, std.dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -1.67% (2.5528 => 2.5102, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4203, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout/lists: -1.14% (6.2999 => 6.2283, std.dev.: 0.0094) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2879, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/hash: -1.10% (4.9088 => 4.8549, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 20.21% (0.5229 => 0.6286, std.dev.: 0.0033) MultiSource/Applications/SPASS/SPASS: 15.00% (14.9895 => 17.2379, std.dev.: 0.0199) MultiSource/Applications/kimwitu++/kc: 10.75% (14.1553 => 15.6776, std.dev.: 0.0221) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 35.69% (1.1048 => 1.4991, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 15.45% (7.1582 => 8.2644, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.70% (0.6222 => 0.6888, std.dev.: 0.0092) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.37% (0.1485 => 0.1435, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.38% (0.2116 => 0.0669, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 23 17:49:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 23 Oct 2012 19:49:34 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121024004934.8D7D32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5143?compare_to=5141&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5143, Order: 166517, Start Time: 2012-10-23 23:26:58, End Time: 2012-10-24 00:51:39 To: 5141, Order: 166500, Start Time: 2012-10-23 21:14:33, End Time: 2012-10-23 22:38:42 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 8 (48 on baseline) Performance Improvements: 2 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 965 (922 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.10% (1.3395 => 1.3810, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.98% (0.6482 => 0.6675, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.92% (0.9177 => 0.9353, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.44% (0.8769 => 0.8895, std.dev.: 0.0028) MultiSource/Applications/siod/siod: 1.35% (2.2154 => 2.2453, std.dev.: 0.0018) MultiSource/Applications/hbd/hbd: 1.11% (1.4443 => 1.4604, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/ffbench: 1.73% (1.3894 => 1.4135, std.dev.: 0.0049) SingleSource/Benchmarks/McGill/chomp: 1.42% (1.1099 => 1.1257, std.dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Ptrdist/bc/bc: -1.46% (1.1461 => 1.1294, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.23% (0.8503 => 0.8398, std.dev.: 0.0022) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.09% (16.5310 => 16.5460, std.dev.: 0.2279) MultiSource/Applications/obsequi/Obsequi: -1.44% (1.0729 => 1.0575, std.dev.: 0.0064) MultiSource/Applications/sqlite3/sqlite3: -0.65% (0.6426 => 0.6384, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/08-main/main: -1.48% (0.1958 => 0.1929, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.34% (0.1706 => 0.1649, std.dev.: 0.0292) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.56% (0.3202 => 0.3252, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.35% (0.2512 => 0.2478, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.76% (0.3368 => 0.3275, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.49% (0.2368 => 0.2309, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/bigfib: -0.13% (0.5990 => 0.5982, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/mandel: 6.56% (0.0457 => 0.0487, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: -1.39% (0.3317 => 0.3271, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/strcat: -1.44% (0.2014 => 0.1985, std.dev.: 0.0008) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -10.94% (0.0265 => 0.0236, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.46% (0.0218 => 0.0217, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.94% (0.0427 => 0.0423, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0331 => 0.0331, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.32% (0.0309 => 0.0310, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.71% (0.0423 => 0.0420, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0202 => 0.0202, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/test1: -0.46% (0.0218 => 0.0217, std.dev.: 0.0021) SingleSource/UnitTests/byval-alignment: -12.62% (0.0317 => 0.0277, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -38.46% (0.0013 => 0.0008, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.54% (0.1482 => 0.1474, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 6.39% (1.1017 => 1.1721, std.dev.: 0.0186) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.20% (0.1513 => 0.1516, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.62% (0.4127 => 0.4194, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.84% (0.1413 => 0.1439, std.dev.: 0.0175) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.29% (0.0007 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.17% (0.0661 => 0.0607, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.45% (0.0207 => 0.0204, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.34% (0.0546 => 0.0597, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.06% (1.1445 => 1.1438, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.77% (0.0031 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 3.85% (0.0026 => 0.0027, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.03% (0.0630 => 0.0592, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.37% (0.0267 => 0.0266, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.11% (0.8023 => 0.8014, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: -85.71% (0.0007 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -30.30% (0.0066 => 0.0046, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.87% (2.1832 => 1.6620, std.dev.: 0.0021) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.06% (0.0810 => 0.0932, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 10.88% (0.1112 => 0.1233, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.49% (0.8321 => 0.8861, std.dev.: 0.0166) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.47% (0.1885 => 0.2007, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.17% (0.6287 => 0.6675, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.53% (0.7473 => 0.7886, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.10% (0.3295 => 0.3463, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.00% (1.3279 => 1.3810, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.53% (1.1685 => 1.2097, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.28% (0.9056 => 0.9353, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.16% (0.4783 => 0.4934, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.12% (0.5961 => 0.6147, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.06% (4.1763 => 4.3040, std.dev.: 0.0378) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.93% (0.4127 => 0.4248, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.79% (13.1811 => 13.5486, std.dev.: 0.0389) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.76% (0.8656 => 0.8895, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.76% (0.8007 => 0.8228, std.dev.: 0.0040) MultiSource/Applications/SIBsim4/SIBsim4: 2.62% (1.2568 => 1.2897, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.58% (0.8611 => 0.8833, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.56% (1.4479 => 1.4849, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/gs/gs: 2.49% (4.1305 => 4.2332, std.dev.: 0.0299) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.48% (1.6386 => 1.6793, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.43% (0.7932 => 0.8125, std.dev.: 0.0037) MultiSource/Applications/hbd/hbd: 2.35% (1.4269 => 1.4604, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.27% (0.7966 => 0.8147, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.20% (1.2423 => 1.2696, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.16% (8.6476 => 8.8346, std.dev.: 0.0309) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.12% (0.8885 => 0.9073, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.91% (0.8050 => 0.8204, std.dev.: 0.0036) MultiSource/Applications/ClamAV/clamscan: 1.91% (14.7684 => 15.0504, std.dev.: 0.0754) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.88% (0.8317 => 0.8473, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.68% (0.9074 => 0.9226, std.dev.: 0.0045) MultiSource/Applications/treecc/treecc: 1.67% (1.9948 => 2.0282, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.53% (0.8420 => 0.8549, std.dev.: 0.0033) MultiSource/Applications/JM/ldecod/ldecod: 1.45% (6.7320 => 6.8299, std.dev.: 0.0223) MultiSource/Applications/JM/lencod/lencod: 1.29% (15.3280 => 15.5256, std.dev.: 0.0427) MultiSource/Applications/siod/siod: 1.21% (2.2184 => 2.2453, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: 1.11% (1.0945 => 1.1067, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: 1.11% (3.2366 => 3.2724, std.dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: 1.07% (4.9628 => 5.0158, std.dev.: 0.0158) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.16% (1.5795 => 2.4981, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.02% (0.3186 => 0.3537, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.43% (1.1857 => 1.2856, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 5.97% (63.1822 => 66.9536, std.dev.: 0.0410) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.98% (0.2887 => 0.3002, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 2.83% (3.6643 => 3.7679, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/bh/bh: 1.77% (2.3560 => 2.3976, std.dev.: 0.0104) SingleSource/Benchmarks/Misc/richards_benchmark: 1.43% (1.3037 => 1.3224, std.dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.18% (0.3269 => 0.2969, std.dev.: 0.0028) MultiSource/Applications/lua/lua: -4.81% (29.8330 => 28.3969, std.dev.: 0.2263) SingleSource/Benchmarks/Shootout-C++/hash2: -1.38% (3.4237 => 3.3766, std.dev.: 0.0173) SingleSource/Benchmarks/Misc/ffbench: -1.13% (1.4296 => 1.4135, std.dev.: 0.0049) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.61% (16.4461 => 16.5460, std.dev.: 0.2279) MultiSource/Applications/obsequi/Obsequi: 3.05% (1.0262 => 1.0575, std.dev.: 0.0064) MultiSource/Applications/sqlite3/sqlite3: 0.82% (0.6332 => 0.6384, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/08-main/main: 5.35% (0.1831 => 0.1929, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.77% (0.1559 => 0.1649, std.dev.: 0.0292) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.13% (0.3123 => 0.3252, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.61% (0.2463 => 0.2478, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.06% (0.3344 => 0.3275, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.33% (0.2364 => 0.2309, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/bigfib: -0.47% (0.6010 => 0.5982, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/mandel: 13.52% (0.0429 => 0.0487, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.15% (0.3266 => 0.3271, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/strcat: 0.81% (0.1969 => 0.1985, std.dev.: 0.0008) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.36% (0.0224 => 0.0236, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 76.42% (0.0123 => 0.0217, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.68% (0.0408 => 0.0423, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.31% (0.0254 => 0.0331, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.65% (0.0302 => 0.0310, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.38% (0.0384 => 0.0420, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0021) SingleSource/UnitTests/byval-alignment: 20.43% (0.0230 => 0.0277, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 14.29% (0.0007 => 0.0008, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.50% (0.1438 => 0.1474, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 3.46% (1.1329 => 1.1721, std.dev.: 0.0186) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.69% (0.1462 => 0.1516, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.72% (0.4164 => 0.4194, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.11% (0.1369 => 0.1439, std.dev.: 0.0175) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.30% (0.0641 => 0.0607, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 4.62% (0.0195 => 0.0204, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.29% (0.0578 => 0.0597, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.01% (1.1437 => 1.1438, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.58% (0.0627 => 0.0592, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.78% (0.0180 => 0.0266, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.04% (0.8017 => 0.8014, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -25.81% (0.0062 => 0.0046, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 23 18:04:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 23 Oct 2012 20:04:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121024010432.8E9532A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5144?compare_to=5142&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5144, Order: 166519, Start Time: 2012-10-23 23:46:15, End Time: 2012-10-24 01:06:36 To: 5142, Order: 166501, Start Time: 2012-10-23 21:55:33, End Time: 2012-10-23 23:16:13 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (5 on baseline) Performance Regressions: 1 (195 on baseline) Performance Improvements: 2 (45 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 88 (14 on baseline) Unchanged Tests: 951 (647 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 2.13% (21.1131 => 21.5631, std.dev.: 0.0119) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.71% (15.6564 => 15.3883, std.dev.: 0.0078) MultiSource/Applications/JM/ldecod/ldecod: -1.50% (11.9274 => 11.7487, std.dev.: 0.0123) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.6286 => 0.6286, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 0.18% (17.2379 => 17.2683, std.dev.: 0.0123) MultiSource/Applications/kimwitu++/kc: -0.19% (15.6776 => 15.6473, std.dev.: 0.0059) MultiSource/Benchmarks/Bullet/bullet: -0.07% (56.3369 => 56.2979, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.24% (0.0484 => 0.0490, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.23% (0.0487 => 0.0493, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.88% (0.0455 => 0.0459, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.32% (0.0456 => 0.0462, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.90% (0.0445 => 0.0449, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.12% (0.0445 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.68% (0.0438 => 0.0441, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.91% (0.0439 => 0.0443, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.10% (0.0455 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.88% (0.0457 => 0.0461, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.34% (0.0449 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.33% (0.0451 => 0.0457) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.14% (0.0440 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.68% (0.0442 => 0.0445, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.12% (0.0447 => 0.0452, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.34% (0.0448 => 0.0454) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.87% (0.0458 => 0.0462, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.53% (0.0458 => 0.0465, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.92% (0.0435 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.15% (0.0436 => 0.0441) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.12% (0.0447 => 0.0452, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.34% (0.0447 => 0.0453, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.14% (0.0438 => 0.0443) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.14% (0.0439 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.93% (0.0431 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.16% (0.0431 => 0.0436) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.16% (0.0430 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.16% (0.0430 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.29% (0.0465 => 0.0471) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.85% (0.0468 => 0.0472, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.70% (0.0429 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.70% (0.0430 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.93% (0.0431 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.16% (0.0432 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.15% (0.0436 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.37% (0.0437 => 0.0443) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.22% (1.4991 => 1.5024, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.20% (8.2644 => 8.2811, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.42% (0.6888 => 0.6917, std.dev.: 0.0120) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1435 => 0.1436, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 218.98% (0.0669 => 0.2134, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -10.98% (63.2438 => 56.2979, std.dev.: 0.0180) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/MallocBench/gs/gs: 13.24% (4.1105 => 4.6548, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.43% (3.4629 => 5.7979, std.dev.: 0.0115) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13496.94% (0.0720 => 9.7898, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050100.00% (0.0001 => 10.0502, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 69.53% (0.0256 => 0.0434) MultiSource/Benchmarks/McCat/08-main/main: 64.84% (0.2554 => 0.4210, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 50.62% (0.0243 => 0.0366, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 48.43% (10.3673 => 15.3883, std.dev.: 0.0078) SingleSource/UnitTests/SignlessTypes/factor: 47.30% (0.0296 => 0.0436, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 43.54% (0.0271 => 0.0389, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.18% (1.5859 => 2.2390, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/richards_benchmark: 39.03% (0.1622 => 0.2255, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/distray/distray: 37.59% (0.1056 => 0.1453, std.dev.: 0.0000) SingleSource/UnitTests/vla: 32.96% (0.0355 => 0.0472, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.39% (2.2024 => 2.8718, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: 28.50% (0.1463 => 0.1880, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 25.30% (0.0834 => 0.1045, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 24.11% (0.1655 => 0.2054, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 21.58% (0.1432 => 0.1741, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: 21.24% (0.0485 => 0.0588, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.20% (0.1566 => 0.1898, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.89% (7.0540 => 8.5275, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/ReedSolomon: 20.89% (0.2049 => 0.2477, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/pifft/pifft: 20.38% (2.2022 => 2.6509, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.06% (0.0871 => 0.1037, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 18.91% (0.1555 => 0.1849, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 18.57% (0.5105 => 0.6053, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.05% (0.6675 => 0.7880, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 17.70% (0.1695 => 0.1995, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.30% (0.1029 => 0.1207, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/power/power: 17.22% (0.1440 => 0.1688, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 17.02% (0.1175 => 0.1375, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.92% (0.0798 => 0.0933, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 16.91% (3.3354 => 3.8993, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.80% (1.3050 => 1.5243, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: 16.77% (0.0626 => 0.0731, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 16.60% (0.1163 => 0.1356, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.51% (0.2271 => 0.2646, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.46% (0.8172 => 0.9517, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.40% (0.4615 => 0.5372, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 16.23% (0.1337 => 0.1554, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.14% (1.5415 => 1.7903, std.dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.08% (0.3121 => 0.3623, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.96% (0.5020 => 0.5821, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 15.64% (0.0793 => 0.0917, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 15.58% (0.1906 => 0.2203, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.58% (0.0886 => 0.1024, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 15.54% (0.3282 => 0.3792, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.41% (0.1032 => 0.1191, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 15.33% (0.7115 => 0.8206, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 15.33% (0.4879 => 0.5627, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.32% (0.0842 => 0.0971, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.30% (0.1510 => 0.1741, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.09% (0.2107 => 0.2425, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 15.05% (0.3109 => 0.3577, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/matrix: 15.04% (0.0818 => 0.0941, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 15.00% (1.7609 => 2.0251, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.00% (0.1940 => 0.2231, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 14.99% (8.1363 => 9.3556, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.95% (0.1117 => 0.1284, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 14.90% (0.3423 => 0.3933, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.84% (0.9765 => 1.1214, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.80% (0.0838 => 0.0962, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.76% (4.2646 => 4.8940, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.68% (0.0770 => 0.0883, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.61% (0.0746 => 0.0855, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 14.60% (0.3177 => 0.3641, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 14.54% (9.4845 => 10.8639, std.dev.: 0.0095) MultiSource/Applications/Burg/burg: 14.51% (1.1642 => 1.3331, std.dev.: 0.0078) SingleSource/Benchmarks/McGill/exptree: 14.25% (0.0814 => 0.0930, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 14.25% (0.0730 => 0.0834, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.19% (0.2065 => 0.2358, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.14% (0.2758 => 0.3148, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 14.12% (0.1438 => 0.1641, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.05% (0.6450 => 0.7356, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.02% (0.1584 => 0.1806, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.01% (0.5860 => 0.6681, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 13.94% (0.7835 => 0.8927, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.85% (1.4186 => 1.6151, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.84% (0.1062 => 0.1209, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.83% (0.0933 => 0.1062, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 13.81% (0.1151 => 0.1310, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.75% (0.1236 => 0.1406, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.74% (0.5981 => 0.6803, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.74% (0.2700 => 0.3071, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/rem: 13.72% (0.1144 => 0.1301, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 13.72% (5.7591 => 6.5493, std.dev.: 0.0036) MultiSource/Applications/treecc/treecc: 13.45% (2.0273 => 2.3000, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.45% (0.1695 => 0.1923, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 13.41% (0.1268 => 0.1438, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 13.35% (4.9449 => 5.6051, std.dev.: 0.0061) MultiSource/Benchmarks/sim/sim: 13.35% (0.3387 => 0.3839, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 13.34% (1.1840 => 1.3420, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.29% (5.0018 => 5.6666, std.dev.: 0.0077) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.29% (7.9617 => 9.0198, std.dev.: 0.0160) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.25% (0.0770 => 0.0872, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 13.07% (0.4299 => 0.4861, std.dev.: 0.0046) MultiSource/Applications/lemon/lemon: 13.07% (1.0722 => 1.2123, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.02% (0.0929 => 0.1050, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 12.97% (3.8723 => 4.3744, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.93% (0.8067 => 0.9110, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 12.90% (0.7433 => 0.8392, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.79% (0.3307 => 0.3730, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.78% (0.1330 => 0.1500, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.74% (1.1861 => 1.3372, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.73% (0.5569 => 0.6278, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.62% (0.1625 => 0.1830, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 12.58% (10.4361 => 11.7487, std.dev.: 0.0123) MultiSource/Benchmarks/Olden/bh/bh: 12.48% (0.3092 => 0.3478, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.41% (0.2603 => 0.2926, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.27% (0.2266 => 0.2544, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 12.27% (0.1125 => 0.1263, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 12.08% (0.3180 => 0.3564, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 12.04% (0.8921 => 0.9995, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.03% (0.3441 => 0.3855, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 11.77% (1.5603 => 1.7440, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.73% (0.8101 => 0.9051, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/bigfib: 11.63% (0.6456 => 0.7207, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.38% (1.1194 => 1.2468, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.31% (0.1892 => 0.2106, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.15% (0.3543 => 0.3938, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.71% (0.3473 => 0.3845, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 10.69% (0.4620 => 0.5114, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 10.68% (0.4289 => 0.4747, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 10.64% (0.3497 => 0.3869, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.61% (0.3543 => 0.3919, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 10.61% (0.3828 => 0.4234, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 10.60% (21.9371 => 24.2630, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/synchronized: 10.59% (0.3561 => 0.3938, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.54% (0.3927 => 0.4341, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.52% (0.3516 => 0.3886, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.45% (0.3694 => 0.4080, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 10.45% (0.3886 => 0.4292, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 10.43% (2.2969 => 2.5364, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.18% (0.4636 => 0.5108, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.14% (0.3865 => 0.4257, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 10.14% (0.3422 => 0.3769, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.95% (0.4203 => 0.4621, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.91% (0.3826 => 0.4205, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 9.69% (0.3684 => 0.4041, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 9.68% (0.4048 => 0.4440, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.45% (0.1143 => 0.1251, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.24% (0.4103 => 0.4482, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 9.00% (17.1811 => 18.7279, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.96% (0.3427 => 0.3734, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 8.91% (0.3603 => 0.3924, std.dev.: 0.0116) SingleSource/UnitTests/ObjC++/Hello: 8.83% (0.5925 => 0.6448, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.82% (0.6030 => 0.6562, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.77% (0.2430 => 0.2643, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.39% (0.4064 => 0.4405, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/matrix: 8.33% (0.3098 => 0.3356, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 8.31% (0.7326 => 0.7935, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.31% (14.3668 => 15.5602, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.27% (0.2891 => 0.3130, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.16% (0.3650 => 0.3948, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.15% (3.8922 => 4.2094, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/strcat: 8.12% (0.2831 => 0.3061, std.dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: 8.12% (0.2905 => 0.3141, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.94% (0.3136 => 0.3385, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 7.92% (0.3232 => 0.3488, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 7.89% (0.3283 => 0.3542, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.81% (2.0665 => 2.2279, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.80% (0.2756 => 0.2971, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 7.78% (0.2725 => 0.2937, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.76% (0.2872 => 0.3095, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/except: 7.70% (0.2871 => 0.3092, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/methcall: 7.68% (0.2877 => 0.3098, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.65% (0.3162 => 0.3404, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.59% (0.2793 => 0.3005, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 7.57% (0.3052 => 0.3283, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 7.49% (0.3379 => 0.3632, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 7.35% (0.2802 => 0.3008, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 7.33% (0.2714 => 0.2913, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 6.93% (1.2842 => 1.3732, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 6.61% (0.3131 => 0.3338, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.79% (0.3935 => 0.4084, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.96% (0.3817 => 0.3930, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1725, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.90% (0.9957 => 1.1341, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.79% (1.1396 => 1.2512, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.72% (3.1578 => 3.3699, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.64% (2.8904 => 3.0824, std.dev.: 0.0006) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: 3.82% (1.9405 => 2.0147, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.77% (4.2280 => 4.3451, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.61% (0.3987 => 0.4091, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 1.84% (0.8333 => 0.8486, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.77% (3.6395 => 3.7039, std.dev.: 0.0077) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.57% (2.6546 => 2.6964, std.dev.: 0.0024) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2076, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5764, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.99% (6.6874 => 0.1346, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -76.96% (0.8651 => 0.1993, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.15% (5.2763 => 3.3164, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -29.89% (5.3855 => 3.7756, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -29.34% (5.3526 => 3.7821, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -9.40% (54.1659 => 49.0767, std.dev.: 0.0326) MultiSource/Applications/ClamAV/clamscan: -2.76% (22.1758 => 21.5631, std.dev.: 0.0119) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -52.88% (8.0499 => 3.7933, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7652, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4752, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.69% (1.6925 => 1.4270, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.53% (0.0998 => 0.0853, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.69% (1.2258 => 1.0703, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.55% (1.2373 => 1.0944, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel-2: -11.03% (1.5373 => 1.3677, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.40% (19.9488 => 18.2730, std.dev.: 0.0251) MultiSource/Benchmarks/FreeBench/mason/mason: -7.73% (0.2161 => 0.1994, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.02% (1.8329 => 1.7042, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8477, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.15% (1.6805 => 1.5940, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: -4.60% (1.5835 => 1.5106, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.36% (8.1563 => 7.8008, std.dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.73% (1.3677 => 1.3167, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.67% (3.2827 => 3.1623, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8776, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5029, std.dev.: 0.0024) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.85% (0.4808 => 0.4671, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -2.19% (4.6441 => 4.5424, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0846, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6814, std.dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.66% (2.5528 => 2.5104, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4205, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2878, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8597, std.dev.: 0.0130) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 20.21% (0.5229 => 0.6286, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 15.20% (14.9895 => 17.2683, std.dev.: 0.0123) MultiSource/Applications/kimwitu++/kc: 10.54% (14.1553 => 15.6473, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 35.99% (1.1048 => 1.5024, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 15.69% (7.1582 => 8.2811, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.17% (0.6222 => 0.6917, std.dev.: 0.0120) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.30% (0.1485 => 0.1436, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.85% (0.2116 => 0.2134, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 23 18:14:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 23 Oct 2012 20:14:23 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121024011423.340752A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5145?compare_to=5138&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5145, Order: 166522, Start Time: 2012-10-23 23:51:58, End Time: 2012-10-24 01:16:26 To: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 5 (5 on baseline) Performance Improvements: 185 (185 on baseline) Unchanged Tests: 852 (852 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: 2.61% (7.4937 => 7.6895, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.57% (2.0478 => 2.1004, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash2: 2.37% (3.1932 => 3.2688, std.dev.: 0.0005) MultiSource/Benchmarks/llubenchmark/llu: 2.32% (3.7435 => 3.8302, std.dev.: 0.0070) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.15% (0.1431 => 0.1300, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.27% (0.3821 => 0.3505, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -8.00% (2.4924 => 2.2930, std.dev.: 0.0123) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.52% (22.4056 => 20.7203, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/trivial-interface: -7.48% (0.3812 => 0.3527, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.44% (0.3884 => 0.3595, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: -7.42% (0.3880 => 0.3592, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -7.42% (0.3357 => 0.3108, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -7.39% (0.3831 => 0.3548, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -7.38% (3.5339 => 3.2730, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-3: -7.38% (0.3848 => 0.3564, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.35% (0.3142 => 0.2911, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.30% (0.3891 => 0.3607, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -7.29% (0.3896 => 0.3612, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.28% (0.9542 => 0.8847, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.25% (0.2428 => 0.2252, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions: -7.21% (0.4176 => 0.3875, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -7.17% (0.4033 => 0.3744, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -7.08% (0.4280 => 0.3977, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -7.05% (0.4199 => 0.3903, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: -7.05% (0.9179 => 0.8532, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -7.04% (0.1761 => 0.1637, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: -7.02% (0.1796 => 0.1670, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.01% (0.1584 => 0.1473, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -6.98% (16.1920 => 15.0625, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/ReedSolomon: -6.97% (0.1879 => 0.1748, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: -6.94% (0.2160 => 0.2010, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: -6.91% (1.1530 => 1.0733, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.88% (1.6474 => 1.5340, std.dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: -6.88% (7.0961 => 6.6079, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.87% (0.9852 => 0.9175, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -6.87% (9.2283 => 8.5946, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.83% (0.3658 => 0.3408, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -6.76% (4.3330 => 4.0400, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.75% (0.2695 => 0.2513, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.74% (5.4682 => 5.0996, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.74% (0.6736 => 0.6282, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/neural/neural: -6.73% (0.1500 => 0.1399, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.72% (0.6484 => 0.6048, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: -6.71% (0.7447 => 0.6947, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.70% (0.1716 => 0.1601, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -6.69% (1.1450 => 1.0684, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.69% (1.0544 => 0.9839, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.68% (0.7919 => 0.7390, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: -6.67% (1.2515 => 1.1680, std.dev.: 0.0022) MultiSource/Applications/siod/siod: -6.67% (2.4021 => 2.2420, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.66% (1.3722 => 1.2808, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.65% (1.4642 => 1.3669, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.64% (0.5591 => 0.5220, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.63% (1.2784 => 1.1937, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.60% (4.0323 => 3.7663, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.59% (14.2083 => 13.2719, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.58% (0.2355 => 0.2200, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -6.57% (4.0594 => 3.7928, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.55% (2.2587 => 2.1108, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.54% (0.6052 => 0.5656, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.54% (0.6297 => 0.5885, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.52% (0.5857 => 0.5475, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -6.52% (15.5079 => 14.4974, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.51% (1.6364 => 1.5299, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/08-main/main: -6.51% (0.2659 => 0.2486, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: -6.50% (0.5168 => 0.4832, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.49% (0.7339 => 0.6863, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.49% (0.6260 => 0.5854, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.48% (0.5478 => 0.5123, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.48% (4.8161 => 4.5042, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -6.47% (0.6676 => 0.6244, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -6.47% (0.2985 => 0.2792, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -6.45% (0.6230 => 0.5828, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.45% (0.5863 => 0.5485, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.43% (0.5925 => 0.5544, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.42% (4.5069 => 4.2174, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.42% (1.2300 => 1.1510, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.42% (0.6446 => 0.6032, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.42% (0.6681 => 0.6252, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: -6.42% (0.1621 => 0.1517, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.41% (6.7716 => 6.3376, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/stepanov_container: -6.40% (0.9557 => 0.8945, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -6.40% (0.6660 => 0.6234, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.39% (0.5805 => 0.5434, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: -6.39% (0.3491 => 0.3268, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.38% (0.6304 => 0.5902, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.37% (0.6293 => 0.5892, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.36% (0.6194 => 0.5800, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.36% (0.4813 => 0.4507, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.35% (0.5859 => 0.5487, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.35% (0.6395 => 0.5989, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.35% (4.8802 => 4.5705, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: -6.34% (0.4861 => 0.4553, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -6.33% (0.4515 => 0.4229, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: -6.33% (1.3864 => 1.2986, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -6.33% (0.6667 => 0.6245, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.33% (0.5581 => 0.5228, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -6.32% (0.5456 => 0.5111, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.32% (0.2548 => 0.2387, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -6.28% (0.3581 => 0.3356, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -6.28% (0.5705 => 0.5347, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -6.25% (0.6395 => 0.5995, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -6.25% (0.6750 => 0.6328, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -6.25% (0.7524 => 0.7054, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.24% (0.6189 => 0.5803, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.23% (0.3483 => 0.3266) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.22% (0.7021 => 0.6584, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.22% (0.5802 => 0.5441, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -6.21% (17.1032 => 16.0404, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.20% (0.5999 => 0.5627, std.dev.: 0.0028) MultiSource/Benchmarks/sim/sim: -6.19% (0.3406 => 0.3195, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -6.18% (15.2527 => 14.3095, std.dev.: 0.0183) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.17% (0.5329 => 0.5000, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.15% (0.4083 => 0.3832, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.14% (0.4151 => 0.3896, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: -6.14% (3.5154 => 3.2995, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: -6.14% (1.3148 => 1.2341, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -6.14% (0.5849 => 0.5490, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -6.13% (0.5567 => 0.5226, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -6.12% (0.5575 => 0.5234, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.11% (0.7198 => 0.6758, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -6.11% (0.5569 => 0.5229, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: -6.10% (0.2999 => 0.2816, std.dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: -6.09% (34.0927 => 32.0169, std.dev.: 0.0295) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.08% (0.3849 => 0.3615, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.06% (1.2221 => 1.1480, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.05% (0.5688 => 0.5344, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.03% (0.3931 => 0.3694, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -6.03% (0.5941 => 0.5583, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.01% (0.6440 => 0.6053, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.01% (0.8521 => 0.8009, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -6.00% (0.6033 => 0.5671, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.99% (1.2210 => 1.1479, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.96% (0.4916 => 0.4623, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.95% (0.2385 => 0.2243, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.93% (0.2278 => 0.2143, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: -5.92% (0.4524 => 0.4256, std.dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: -5.92% (18.2933 => 17.2097, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.91% (0.5570 => 0.5241, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: -5.84% (0.4248 => 0.4000, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -5.83% (0.3446 => 0.3245, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -5.83% (0.3621 => 0.3410, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/except: -5.82% (0.3026 => 0.2850, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.82% (0.3319 => 0.3126, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -5.81% (0.7982 => 0.7518, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.78% (8.0126 => 7.5494, std.dev.: 0.0019) MultiSource/Applications/treecc/treecc: -5.78% (2.1401 => 2.0164, std.dev.: 0.0075) MultiSource/Benchmarks/McCat/09-vor/vor: -5.78% (0.3271 => 0.3082, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: -5.78% (0.3255 => 0.3067, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -5.77% (0.3394 => 0.3198, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.76% (0.3837 => 0.3616, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.75% (0.3323 => 0.3132, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.74% (0.4427 => 0.4173, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -5.73% (0.3788 => 0.3571, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.70% (0.3016 => 0.2844, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.70% (0.2106 => 0.1986, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -5.69% (0.2989 => 0.2819, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -5.66% (0.3481 => 0.3284, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -5.65% (0.3025 => 0.2854, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.65% (0.4321 => 0.4077, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -5.64% (0.3867 => 0.3649, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -5.62% (0.3205 => 0.3025, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.61% (0.2903 => 0.2740, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.56% (0.3057 => 0.2887, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -5.56% (0.8418 => 0.7950, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.56% (2.1713 => 2.0506, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -5.54% (0.3194 => 0.3017, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.54% (0.2871 => 0.2712) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.52% (0.2933 => 0.2771, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.50% (0.3252 => 0.3073, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hello: -5.48% (0.2849 => 0.2693, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -5.44% (0.2939 => 0.2779, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -5.19% (0.7779 => 0.7375, std.dev.: 0.0039) SingleSource/Regression/C++/ofstream_ctor: -5.13% (0.3059 => 0.2902, std.dev.: 0.0047) SingleSource/UnitTests/ObjC++/Hello: -4.98% (0.6347 => 0.6031, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -4.93% (5.0226 => 4.7748, std.dev.: 0.0043) SingleSource/UnitTests/ObjC++/property-reference-object: -4.88% (0.6441 => 0.6127, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.74% (0.9077 => 0.8647, std.dev.: 0.0023) MultiSource/Applications/hbd/hbd: -4.47% (1.5610 => 1.4912, std.dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -3.68% (20.7746 => 20.0093, std.dev.: 0.0065) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.36% (7.5137 => 5.7583, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -8.69% (1.2842 => 1.1726, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7062, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.72% (2.2633 => 2.1790, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.33% (1.3096 => 1.2660, std.dev.: 0.0144) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.04% (1.0557 => 1.0236, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4669, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: 2.61% (7.4937 => 7.6895, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.57% (2.0478 => 2.1004, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash2: 2.37% (3.1932 => 3.2688, std.dev.: 0.0005) MultiSource/Benchmarks/llubenchmark/llu: 2.32% (3.7435 => 3.8302, std.dev.: 0.0070) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.15% (0.1431 => 0.1300, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.27% (0.3821 => 0.3505, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -8.00% (2.4924 => 2.2930, std.dev.: 0.0123) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.52% (22.4056 => 20.7203, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/trivial-interface: -7.48% (0.3812 => 0.3527, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.44% (0.3884 => 0.3595, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: -7.42% (0.3880 => 0.3592, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -7.42% (0.3357 => 0.3108, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -7.39% (0.3831 => 0.3548, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -7.38% (3.5339 => 3.2730, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-3: -7.38% (0.3848 => 0.3564, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.35% (0.3142 => 0.2911, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.30% (0.3891 => 0.3607, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -7.29% (0.3896 => 0.3612, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.28% (0.9542 => 0.8847, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.25% (0.2428 => 0.2252, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions: -7.21% (0.4176 => 0.3875, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -7.17% (0.4033 => 0.3744, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -7.08% (0.4280 => 0.3977, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -7.05% (0.4199 => 0.3903, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: -7.05% (0.9179 => 0.8532, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -7.04% (0.1761 => 0.1637, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: -7.02% (0.1796 => 0.1670, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.01% (0.1584 => 0.1473, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -6.98% (16.1920 => 15.0625, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/ReedSolomon: -6.97% (0.1879 => 0.1748, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: -6.94% (0.2160 => 0.2010, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: -6.91% (1.1530 => 1.0733, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.88% (1.6474 => 1.5340, std.dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: -6.88% (7.0961 => 6.6079, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.87% (0.9852 => 0.9175, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -6.87% (9.2283 => 8.5946, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.83% (0.3658 => 0.3408, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -6.76% (4.3330 => 4.0400, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.75% (0.2695 => 0.2513, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.74% (5.4682 => 5.0996, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.74% (0.6736 => 0.6282, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/neural/neural: -6.73% (0.1500 => 0.1399, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.72% (0.6484 => 0.6048, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: -6.71% (0.7447 => 0.6947, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.70% (0.1716 => 0.1601, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -6.69% (1.1450 => 1.0684, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.69% (1.0544 => 0.9839, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.68% (0.7919 => 0.7390, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: -6.67% (1.2515 => 1.1680, std.dev.: 0.0022) MultiSource/Applications/siod/siod: -6.67% (2.4021 => 2.2420, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.66% (1.3722 => 1.2808, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.65% (1.4642 => 1.3669, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.64% (0.5591 => 0.5220, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.63% (1.2784 => 1.1937, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.60% (4.0323 => 3.7663, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.59% (14.2083 => 13.2719, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.58% (0.2355 => 0.2200, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -6.57% (4.0594 => 3.7928, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.55% (2.2587 => 2.1108, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.54% (0.6052 => 0.5656, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.54% (0.6297 => 0.5885, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.52% (0.5857 => 0.5475, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -6.52% (15.5079 => 14.4974, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.51% (1.6364 => 1.5299, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/08-main/main: -6.51% (0.2659 => 0.2486, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: -6.50% (0.5168 => 0.4832, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.49% (0.7339 => 0.6863, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.49% (0.6260 => 0.5854, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.48% (0.5478 => 0.5123, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.48% (4.8161 => 4.5042, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -6.47% (0.6676 => 0.6244, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -6.47% (0.2985 => 0.2792, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -6.45% (0.6230 => 0.5828, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.45% (0.5863 => 0.5485, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.43% (0.5925 => 0.5544, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.42% (4.5069 => 4.2174, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.42% (1.2300 => 1.1510, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.42% (0.6446 => 0.6032, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.42% (0.6681 => 0.6252, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: -6.42% (0.1621 => 0.1517, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.41% (6.7716 => 6.3376, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/stepanov_container: -6.40% (0.9557 => 0.8945, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -6.40% (0.6660 => 0.6234, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.39% (0.5805 => 0.5434, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: -6.39% (0.3491 => 0.3268, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.38% (0.6304 => 0.5902, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.37% (0.6293 => 0.5892, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.36% (0.6194 => 0.5800, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.36% (0.4813 => 0.4507, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.35% (0.5859 => 0.5487, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.35% (0.6395 => 0.5989, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.35% (4.8802 => 4.5705, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: -6.34% (0.4861 => 0.4553, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -6.33% (0.4515 => 0.4229, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: -6.33% (1.3864 => 1.2986, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -6.33% (0.6667 => 0.6245, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.33% (0.5581 => 0.5228, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -6.32% (0.5456 => 0.5111, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.32% (0.2548 => 0.2387, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -6.28% (0.3581 => 0.3356, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -6.28% (0.5705 => 0.5347, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -6.25% (0.6395 => 0.5995, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -6.25% (0.6750 => 0.6328, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -6.25% (0.7524 => 0.7054, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.24% (0.6189 => 0.5803, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.23% (0.3483 => 0.3266) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.22% (0.7021 => 0.6584, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.22% (0.5802 => 0.5441, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -6.21% (17.1032 => 16.0404, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.20% (0.5999 => 0.5627, std.dev.: 0.0028) MultiSource/Benchmarks/sim/sim: -6.19% (0.3406 => 0.3195, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -6.18% (15.2527 => 14.3095, std.dev.: 0.0183) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.17% (0.5329 => 0.5000, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.15% (0.4083 => 0.3832, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.14% (0.4151 => 0.3896, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: -6.14% (3.5154 => 3.2995, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: -6.14% (1.3148 => 1.2341, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -6.14% (0.5849 => 0.5490, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -6.13% (0.5567 => 0.5226, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -6.12% (0.5575 => 0.5234, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.11% (0.7198 => 0.6758, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -6.11% (0.5569 => 0.5229, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: -6.10% (0.2999 => 0.2816, std.dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: -6.09% (34.0927 => 32.0169, std.dev.: 0.0295) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.08% (0.3849 => 0.3615, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.06% (1.2221 => 1.1480, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.05% (0.5688 => 0.5344, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.03% (0.3931 => 0.3694, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -6.03% (0.5941 => 0.5583, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.01% (0.6440 => 0.6053, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.01% (0.8521 => 0.8009, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -6.00% (0.6033 => 0.5671, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.99% (1.2210 => 1.1479, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.96% (0.4916 => 0.4623, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.95% (0.2385 => 0.2243, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.93% (0.2278 => 0.2143, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: -5.92% (0.4524 => 0.4256, std.dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: -5.92% (18.2933 => 17.2097, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.91% (0.5570 => 0.5241, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: -5.84% (0.4248 => 0.4000, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -5.83% (0.3446 => 0.3245, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -5.83% (0.3621 => 0.3410, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/except: -5.82% (0.3026 => 0.2850, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.82% (0.3319 => 0.3126, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -5.81% (0.7982 => 0.7518, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.78% (8.0126 => 7.5494, std.dev.: 0.0019) MultiSource/Applications/treecc/treecc: -5.78% (2.1401 => 2.0164, std.dev.: 0.0075) MultiSource/Benchmarks/McCat/09-vor/vor: -5.78% (0.3271 => 0.3082, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: -5.78% (0.3255 => 0.3067, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -5.77% (0.3394 => 0.3198, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.76% (0.3837 => 0.3616, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.75% (0.3323 => 0.3132, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.74% (0.4427 => 0.4173, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -5.73% (0.3788 => 0.3571, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.70% (0.3016 => 0.2844, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.70% (0.2106 => 0.1986, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -5.69% (0.2989 => 0.2819, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -5.66% (0.3481 => 0.3284, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -5.65% (0.3025 => 0.2854, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.65% (0.4321 => 0.4077, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -5.64% (0.3867 => 0.3649, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -5.62% (0.3205 => 0.3025, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.61% (0.2903 => 0.2740, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.56% (0.3057 => 0.2887, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -5.56% (0.8418 => 0.7950, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.56% (2.1713 => 2.0506, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -5.54% (0.3194 => 0.3017, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.54% (0.2871 => 0.2712) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.52% (0.2933 => 0.2771, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.50% (0.3252 => 0.3073, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hello: -5.48% (0.2849 => 0.2693, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -5.44% (0.2939 => 0.2779, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -5.19% (0.7779 => 0.7375, std.dev.: 0.0039) SingleSource/Regression/C++/ofstream_ctor: -5.13% (0.3059 => 0.2902, std.dev.: 0.0047) SingleSource/UnitTests/ObjC++/Hello: -4.98% (0.6347 => 0.6031, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -4.93% (5.0226 => 4.7748, std.dev.: 0.0043) SingleSource/UnitTests/ObjC++/property-reference-object: -4.88% (0.6441 => 0.6127, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.74% (0.9077 => 0.8647, std.dev.: 0.0023) MultiSource/Applications/hbd/hbd: -4.47% (1.5610 => 1.4912, std.dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -3.68% (20.7746 => 20.0093, std.dev.: 0.0065) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.36% (7.5137 => 5.7583, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -8.69% (1.2842 => 1.1726, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7062, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.72% (2.2633 => 2.1790, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.33% (1.3096 => 1.2660, std.dev.: 0.0144) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.04% (1.0557 => 1.0236, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4669, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0000) Report Time: 1.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 23 19:27:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 23 Oct 2012 21:27:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121024022741.1CFEF2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/5146?compare_to=5140&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5146, Order: 166505, Start Time: 2012-10-23 23:13:38, End Time: 2012-10-24 02:29:44 To: 5140, Order: 166489, Start Time: 2012-10-23 19:08:09, End Time: 2012-10-23 22:23:52 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (172 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1039 (718 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.06% (5.0706 => 5.1243, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.05% (12.5082 => 12.6394, std.dev.: 0.0164) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 7.99% (109.7452 => 118.5175, std.dev.: 0.0924) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.28% (0.0625 => 0.0883, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.17% (0.1063 => 0.1405, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.10% (0.2969 => 0.3744, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 25.09% (1.5932 => 1.9929, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.05% (0.1106 => 0.1383, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.33% (0.4139 => 0.5146, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.23% (0.0714 => 0.0887, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.19% (0.5900 => 0.7327, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.05% (0.4253 => 0.5276, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.99% (0.4994 => 0.6192, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.77% (0.0547 => 0.0677, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.37% (0.0475 => 0.0586, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.00% (0.5000 => 0.6150, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.95% (0.0584 => 0.0718, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.35% (0.1620 => 0.1982, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.23% (0.1021 => 0.1248, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.96% (0.0897 => 0.1094, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 21.87% (0.0599 => 0.0730, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.68% (0.1107 => 0.1347, std.dev.: 0.0018) MultiSource/Applications/viterbi/viterbi: 21.54% (0.0947 => 0.1151, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 20.99% (0.0948 => 0.1147, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.70% (0.0633 => 0.0764, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 20.53% (0.0604 => 0.0728, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.52% (0.0541 => 0.0652, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.49% (0.1103 => 0.1329, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.40% (0.0642 => 0.0773, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.40% (0.0495 => 0.0596, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.38% (0.0584 => 0.0703, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/health/health: 20.34% (0.0821 => 0.0988, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 20.26% (0.1619 => 0.1947, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.20% (0.1604 => 0.1928, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.14% (0.1003 => 0.1205, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.86% (0.3903 => 0.4678, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.83% (0.0822 => 0.0985, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.82% (0.1549 => 0.1856, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.54% (0.1462 => 0.1733, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.42% (0.2736 => 0.3240, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.42% (0.2014 => 0.2385, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.38% (0.3890 => 0.4605, std.dev.: 0.0035) SingleSource/UnitTests/ObjC++/Hello: 18.33% (0.5826 => 0.6894, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 18.14% (0.1218 => 0.1439, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 18.14% (0.1505 => 0.1778, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 18.10% (0.5889 => 0.6955, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 17.97% (0.4029 => 0.4753, std.dev.: 0.0031) MultiSource/Applications/sgefa/sgefa: 17.95% (0.0808 => 0.0953, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 17.91% (0.0698 => 0.0823) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.81% (1.3152 => 1.5495, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 17.56% (0.0581 => 0.0683, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.56% (0.1088 => 0.1279, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.31% (0.2866 => 0.3362, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.28% (3.5627 => 4.1784, std.dev.: 0.0036) MultiSource/Applications/Burg/burg: 17.06% (0.5546 => 0.6492, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 17.02% (1.8794 => 2.1993, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.97% (0.2875 => 0.3363, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 16.82% (0.9697 => 1.1328, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.77% (0.1968 => 0.2298, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.70% (0.4658 => 0.5436, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.68% (1.6211 => 1.8915, std.dev.: 0.0075) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.55% (0.1160 => 0.1352, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 16.40% (0.2725 => 0.3172, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.39% (0.5026 => 0.5850, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: 16.39% (1.0781 => 1.2548, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.29% (0.2738 => 0.3184, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 16.25% (0.3004 => 0.3492, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 16.21% (0.2714 => 0.3154, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.20% (0.2729 => 0.3171, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 16.19% (0.7171 => 0.8332, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/18-imp/imp: 16.19% (0.1421 => 0.1651, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.14% (0.3271 => 0.3799, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/wc: 16.05% (0.3096 => 0.3593, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: 16.04% (0.1284 => 0.1490, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 16.04% (0.2750 => 0.3191, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 16.01% (0.2780 => 0.3225, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.00% (2.7292 => 3.1660, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/except: 15.90% (0.2811 => 0.3258, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 15.87% (0.9909 => 1.1482, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.83% (0.2792 => 0.3234, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 15.80% (0.2803 => 0.3246, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 15.80% (0.2823 => 0.3269, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.77% (0.2911 => 0.3370, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.73% (0.4361 => 0.5047, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.72% (2.0673 => 2.3922, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 15.71% (0.2813 => 0.3255, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.71% (0.3195 => 0.3697, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.59% (0.3060 => 0.3537, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.57% (0.3930 => 0.4542, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 15.50% (4.2109 => 4.8638, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.50% (0.1090 => 0.1259, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.39% (1.9966 => 2.3038, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.27% (1.9694 => 2.2702, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ary: 15.19% (0.3258 => 0.3753, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 15.18% (0.3446 => 0.3969, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 15.15% (0.3465 => 0.3990, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 15.15% (0.3267 => 0.3762, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 15.14% (0.3460 => 0.3984, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 15.13% (0.3317 => 0.3819, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.11% (0.3488 => 0.4015, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 15.10% (0.3496 => 0.4024, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 15.06% (23.5202 => 27.0624, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/trivial-interface: 15.02% (0.3442 => 0.3959, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 14.96% (0.3469 => 0.3988, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 14.91% (4.4195 => 5.0783, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.90% (0.3362 => 0.3863, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.84% (0.3282 => 0.3769, std.dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 14.81% (0.2566 => 0.2946, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 14.63% (0.3650 => 0.4184, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 14.60% (0.3643 => 0.4175, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.53% (0.3124 => 0.3578, std.dev.: 0.0063) SingleSource/UnitTests/ObjC/parameter-passing: 14.50% (0.3724 => 0.4264, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 14.41% (0.3726 => 0.4263, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.40% (0.3625 => 0.4147, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 14.37% (0.3348 => 0.3829, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: 14.36% (0.3678 => 0.4206, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 14.35% (0.4146 => 0.4741, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 14.24% (0.3477 => 0.3972, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 14.22% (1.4269 => 1.6298, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.97% (0.3981 => 0.4537, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 13.90% (0.4251 => 0.4842, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.85% (0.3690 => 0.4201, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.81% (0.3845 => 0.4376, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 13.73% (0.2075 => 0.2360, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 13.52% (2.1653 => 2.4581, std.dev.: 0.0073) MultiSource/Applications/treecc/treecc: 13.33% (0.7875 => 0.8925, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/bigfib: 13.15% (0.5012 => 0.5671, std.dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 13.13% (4.6177 => 5.2242, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 12.75% (2.1013 => 2.3693, std.dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: 12.67% (0.2691 => 0.3032, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.25% (0.2040 => 0.2290, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.81% (0.6435 => 0.7195, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 11.80% (5.5417 => 6.1956, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.99% (0.1028 => 0.1141, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.92% (0.2737 => 0.3036, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 10.81% (0.3498 => 0.3876, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.78% (0.2068 => 0.2291, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 10.61% (0.3336 => 0.3690, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 10.60% (0.6634 => 0.7337, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.34% (0.1383 => 0.1526, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.18% (0.3084 => 0.3398, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 10.07% (0.4847 => 0.5335, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.51% (0.2103 => 0.2303, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 9.26% (2.0346 => 2.2230, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.20% (4.6926 => 5.1243, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: 9.03% (0.2391 => 0.2607, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.59% (11.6398 => 12.6394, std.dev.: 0.0164) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.21% (0.5361 => 0.5801, std.dev.: 0.0150) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.49% (0.5584 => 0.6002, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.39% (0.7426 => 0.7975, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 6.74% (11.9555 => 12.7611, std.dev.: 0.0211) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.64% (0.3792 => 0.4006, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6536, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 8.67% (0.2802 => 0.3045, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.54% (3.3903 => 3.6120, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.04% (12.0509 => 12.6585, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary: 5.00% (0.2122 => 0.2228, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 4.74% (15.4430 => 16.1755, std.dev.: 0.0904) SingleSource/Benchmarks/Misc/flops-2: 4.11% (1.8057 => 1.8800, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.49% (0.3693 => 0.3822, std.dev.: 0.0044) SingleSource/Benchmarks/Dhrystone/dry: 2.75% (14.0481 => 14.4339, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2086, std.dev.: 0.0096) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.79% (3.1722 => 3.2290, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3029, std.dev.: 0.0149) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2865, std.dev.: 0.0016) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.23% (1.0142 => 1.0267, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5968, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.53% (25.4195 => 16.3887, std.dev.: 0.0152) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9784, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -7.66% (35.5013 => 32.7823, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: -7.24% (0.2402 => 0.2228, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/power/power: -3.69% (3.3665 => 3.2422, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -3.52% (11.2080 => 10.8134, std.dev.: 0.0724) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.15% (0.6293 => 0.6095, std.dev.: 0.0049) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7746, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5219, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.20% (41.7953 => 40.8747, std.dev.: 0.0152) SingleSource/Benchmarks/Dhrystone/fldry: -2.14% (17.2379 => 16.8691, std.dev.: 0.0145) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5748, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4948, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7160, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.17% (105.3826 => 104.1536, std.dev.: 0.0455) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0445, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.04% (3.3991 => 3.3636, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 23 19:30:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 23 Oct 2012 21:30:46 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121024023046.7BDBE2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/5147?compare_to=5143&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5147, Order: 166531, Start Time: 2012-10-24 01:08:49, End Time: 2012-10-24 02:32:51 To: 5143, Order: 166517, Start Time: 2012-10-23 23:26:58, End Time: 2012-10-24 00:51:39 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 4 (44 on baseline) Performance Improvements: 4 (5 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 967 (925 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.82% (0.8204 => 0.8435, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.40% (1.2097 => 1.2266, std.dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/SPASS/SPASS: 4.05% (8.1828 => 8.5145, std.dev.: 0.1063) SingleSource/Benchmarks/Misc/ffbench: 1.67% (1.4135 => 1.4371, std.dev.: 0.0070) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -2.92% (0.6675 => 0.6480, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -2.51% (1.3810 => 1.3463, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.46% (0.8445 => 0.8322, std.dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: -3.67% (0.7870 => 0.7581, std.dev.: 0.0034) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 1.40% (16.5460 => 16.7784, std.dev.: 0.0738) MultiSource/Applications/obsequi/Obsequi: -1.32% (1.0575 => 1.0435, std.dev.: 0.0199) MultiSource/Applications/sqlite3/sqlite3: -0.14% (0.6384 => 0.6375, std.dev.: 0.0077) MultiSource/Benchmarks/McCat/08-main/main: 0.57% (0.1929 => 0.1940, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.03% (0.1649 => 0.1699, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.57% (0.3252 => 0.3201, std.dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.52% (0.2478 => 0.2465, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.55% (0.3275 => 0.3293, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.77% (0.2309 => 0.2373, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: 0.08% (0.5982 => 0.5987, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -12.73% (0.0487 => 0.0425, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.18% (0.3271 => 0.3277, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/strcat: -0.25% (0.1985 => 0.1980, std.dev.: 0.0010) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.12% (0.0236 => 0.0241, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.38% (0.0217 => 0.0220, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.18% (0.0423 => 0.0428, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -12.69% (0.0331 => 0.0289, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -16.45% (0.0310 => 0.0259, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.62% (0.0420 => 0.0409, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: 0.50% (0.0202 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -20.74% (0.0217 => 0.0172, std.dev.: 0.0020) SingleSource/UnitTests/byval-alignment: 7.58% (0.0277 => 0.0298, std.dev.: 0.0030) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 62.50% (0.0008 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 0.34% (0.1474 => 0.1479, std.dev.: 0.0051) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 2.06% (1.1721 => 1.1963, std.dev.: 0.0274) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -2.70% (0.1516 => 0.1475, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.31% (0.4194 => 0.4097, std.dev.: 0.0398) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.20% (0.1439 => 0.1393, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -37.50% (0.0008 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.77% (0.0607 => 0.0642, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.47% (0.0204 => 0.0207, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.69% (0.0597 => 0.0569, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.60% (1.1438 => 1.1369, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -14.81% (0.0027 => 0.0023, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.14% (0.0592 => 0.0532, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -15.79% (0.0266 => 0.0224, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.31% (0.8014 => 0.8039, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 91.30% (0.0046 => 0.0088, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.96% (2.1832 => 1.6600, std.dev.: 0.0043) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 11.15% (0.1112 => 0.1236, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.40% (0.8321 => 0.9020, std.dev.: 0.0062) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.77% (0.3137 => 0.3318, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.52% (0.1885 => 0.1989, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.27% (0.2998 => 0.3156, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.14% (0.8148 => 0.8567, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.06% (0.7473 => 0.7851, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.97% (1.1685 => 1.2266, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.57% (0.8066 => 0.8435, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.54% (0.4847 => 0.5067, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.56% (0.5961 => 0.6173, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.40% (0.9435 => 0.9756, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.07% (0.6287 => 0.6480, std.dev.: 0.0029) MultiSource/Applications/hbd/hbd: 3.03% (1.4269 => 1.4702, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.63% (0.8457 => 0.8679, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.54% (1.4479 => 1.4847, std.dev.: 0.0109) MultiSource/Applications/ClamAV/clamscan: 2.25% (14.7684 => 15.1003, std.dev.: 0.0856) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.01% (0.8050 => 0.8212, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.97% (0.8286 => 0.8449, std.dev.: 0.0052) MultiSource/Applications/treecc/treecc: 1.96% (1.9948 => 2.0338, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.95% (0.8317 => 0.8479, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.86% (0.9069 => 0.9238, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.74% (0.8204 => 0.8347, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/gs/gs: 1.68% (4.1305 => 4.1998, std.dev.: 0.0254) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.65% (0.8597 => 0.8739, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.48% (0.8316 => 0.8439, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.46% (4.4880 => 4.5536, std.dev.: 0.0192) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.46% (8.6476 => 8.7736, std.dev.: 0.0278) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.42% (0.8885 => 0.9011, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.42% (1.2423 => 1.2599, std.dev.: 0.0056) MultiSource/Applications/SPASS/SPASS: 1.39% (14.2605 => 14.4583, std.dev.: 0.0486) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.39% (1.3279 => 1.3463, std.dev.: 0.0034) MultiSource/Applications/d/make_dparser: 1.30% (3.2366 => 3.2786, std.dev.: 0.0094) MultiSource/Applications/siod/siod: 1.24% (2.2184 => 2.2460, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.22% (0.8716 => 0.8822, std.dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 56.63% (1.5795 => 2.4739, std.dev.: 0.0212) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.23% (0.3186 => 0.3512, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.93% (1.1857 => 1.2797, std.dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 5.96% (63.1822 => 66.9481, std.dev.: 0.1895) SingleSource/Benchmarks/Misc/ReedSolomon: 2.95% (8.5322 => 8.7835, std.dev.: 0.0176) MultiSource/Applications/siod/siod: 2.91% (3.6643 => 3.7708, std.dev.: 0.0125) MultiSource/Benchmarks/Olden/bh/bh: 2.20% (2.3560 => 2.4079, std.dev.: 0.0105) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.00% (2.4490 => 2.4981, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.11% (4.8362 => 4.8899, std.dev.: 0.0182) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -10.22% (0.3269 => 0.2935, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout/heapsort: -9.17% (3.2926 => 2.9906, std.dev.: 0.0836) MultiSource/Applications/lua/lua: -5.01% (29.8330 => 28.3376, std.dev.: 0.2169) SingleSource/Benchmarks/Shootout-C++/hash2: -1.49% (3.4237 => 3.3727, std.dev.: 0.0161) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.39% (3.3479 => 3.3012, std.dev.: 0.0045) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 2.02% (16.4461 => 16.7784, std.dev.: 0.0738) MultiSource/Applications/obsequi/Obsequi: 1.69% (1.0262 => 1.0435, std.dev.: 0.0199) MultiSource/Applications/sqlite3/sqlite3: 0.68% (0.6332 => 0.6375, std.dev.: 0.0077) MultiSource/Benchmarks/McCat/08-main/main: 5.95% (0.1831 => 0.1940, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 8.98% (0.1559 => 0.1699, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.50% (0.3123 => 0.3201, std.dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.08% (0.2463 => 0.2465, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.53% (0.3344 => 0.3293, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.38% (0.2364 => 0.2373, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: -0.38% (0.6010 => 0.5987, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -0.93% (0.0429 => 0.0425, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.34% (0.3266 => 0.3277, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/strcat: 0.56% (0.1969 => 0.1980, std.dev.: 0.0010) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.59% (0.0224 => 0.0241, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.86% (0.0123 => 0.0220, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 13.78% (0.0254 => 0.0289, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -14.24% (0.0302 => 0.0259, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 6.51% (0.0384 => 0.0409, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -4.44% (0.0180 => 0.0172, std.dev.: 0.0020) SingleSource/UnitTests/byval-alignment: 29.57% (0.0230 => 0.0298, std.dev.: 0.0030) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.85% (0.1438 => 0.1479, std.dev.: 0.0051) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 5.60% (1.1329 => 1.1963, std.dev.: 0.0274) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.89% (0.1462 => 0.1475, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.61% (0.4164 => 0.4097, std.dev.: 0.0398) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.75% (0.1369 => 0.1393, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -37.50% (0.0008 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.16% (0.0641 => 0.0642, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.15% (0.0195 => 0.0207, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.56% (0.0578 => 0.0569, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.59% (1.1437 => 1.1369, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 64.29% (0.0014 => 0.0023, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -15.15% (0.0627 => 0.0532, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.44% (0.0180 => 0.0224, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.27% (0.8017 => 0.8039, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 41.94% (0.0062 => 0.0088, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 23 19:54:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 23 Oct 2012 21:54:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121024025431.841DC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5148?compare_to=5144&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5148, Order: 166532, Start Time: 2012-10-24 01:36:12, End Time: 2012-10-24 02:56:34 To: 5144, Order: 166519, Start Time: 2012-10-23 23:46:15, End Time: 2012-10-24 01:06:36 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (5 on baseline) Performance Regressions: 3 (202 on baseline) Performance Improvements: 0 (44 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 88 (14 on baseline) Unchanged Tests: 951 (641 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 2.81% (11.7487 => 12.0783, std.dev.: 0.0233) MultiSource/Applications/JM/lencod/lencod: 1.21% (24.2630 => 24.5560, std.dev.: 0.0136) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.56% (3.7776 => 3.8366, std.dev.: 0.0157) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.38% (0.6286 => 0.6310, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 0.39% (17.2683 => 17.3362, std.dev.: 0.0142) MultiSource/Applications/kimwitu++/kc: 0.48% (15.6473 => 15.7218, std.dev.: 0.0189) MultiSource/Benchmarks/Bullet/bullet: -0.04% (56.2979 => 56.2736, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0490 => 0.0490, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0493 => 0.0493, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.44% (0.0459 => 0.0461, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0462 => 0.0462, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.22% (0.0449 => 0.0450, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.22% (0.0450 => 0.0451) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.45% (0.0441 => 0.0443, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0443 => 0.0443, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.43% (0.0460 => 0.0462, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.22% (0.0461 => 0.0462, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.22% (0.0455 => 0.0454, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0457 => 0.0457, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.45% (0.0445 => 0.0447) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.45% (0.0445 => 0.0447, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.22% (0.0452 => 0.0453) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0454 => 0.0454, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.22% (0.0462 => 0.0463, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.52% (0.0465 => 0.0486, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.23% (0.0439 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0441 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0452 => 0.0452, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0453 => 0.0453, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.23% (0.0443 => 0.0444, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.23% (0.0444 => 0.0445, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0435 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0436 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0435 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0435 => 0.0435, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.21% (0.0471 => 0.0472) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0472 => 0.0472, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0432 => 0.0432, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.46% (0.0433 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0435 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.23% (0.0437 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.45% (0.0441 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0443 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.35% (1.5024 => 1.5077, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.24% (8.2811 => 8.3006, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.17% (0.6917 => 0.6929, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1436 => 0.1436, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.28% (0.2134 => 0.2140, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.02% (63.2438 => 56.2736, std.dev.: 0.0110) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/MallocBench/gs/gs: 13.81% (4.1105 => 4.6781, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.82% (3.4629 => 5.8459, std.dev.: 0.0142) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13519.58% (0.0720 => 9.8061, std.dev.: 0.0074) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049700.00% (0.0001 => 10.0498, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 69.53% (0.0256 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 66.33% (0.2554 => 0.4248, std.dev.: 0.0010) SingleSource/Regression/C/sumarraymalloc: 51.85% (0.0243 => 0.0369, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/factor: 48.31% (0.0296 => 0.0439) MultiSource/Benchmarks/PAQ8p/paq8p: 48.09% (10.3673 => 15.3530, std.dev.: 0.0128) SingleSource/Regression/C/sumarray2d: 45.02% (0.0271 => 0.0393, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 41.99% (0.1622 => 0.2303, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.60% (1.5859 => 2.2456, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/distray/distray: 38.16% (0.1056 => 0.1459, std.dev.: 0.0009) SingleSource/UnitTests/vla: 33.80% (0.0355 => 0.0475, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.76% (2.2024 => 2.8799, std.dev.: 0.0064) MultiSource/Benchmarks/FreeBench/neural/neural: 28.78% (0.1463 => 0.1884, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 24.71% (0.1655 => 0.2064, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 24.70% (0.0834 => 0.1040, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/hash: 22.06% (0.0485 => 0.0592, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.78% (0.1566 => 0.1907, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 21.35% (7.0540 => 8.5597, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/ReedSolomon: 21.33% (0.2049 => 0.2486, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 21.25% (2.2022 => 2.6702, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 21.16% (0.1432 => 0.1735, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 19.61% (0.1555 => 0.1860, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.40% (0.0871 => 0.1040, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 18.81% (0.5105 => 0.6065, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.37% (0.6675 => 0.7901, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.08% (0.1029 => 0.1215, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: 18.06% (0.1440 => 0.1700, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: 17.73% (0.0626 => 0.0737) MultiSource/Benchmarks/Olden/tsp/tsp: 17.45% (0.1175 => 0.1380, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 17.35% (0.2271 => 0.2665, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.30% (1.3050 => 1.5308, std.dev.: 0.0067) MultiSource/Applications/d/make_dparser: 17.29% (3.3354 => 3.9122, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.18% (0.8172 => 0.9576, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/em3d/em3d: 17.17% (0.1695 => 0.1986, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.13% (0.1337 => 0.1566, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.12% (0.4615 => 0.5405, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.02% (0.0793 => 0.0928, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.98% (0.3121 => 0.3651, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/mst/mst: 16.94% (0.1163 => 0.1360, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.81% (1.5415 => 1.8006, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/oourafft: 16.76% (0.3282 => 0.3832, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.59% (0.0886 => 0.1033, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/matrix: 16.26% (0.0818 => 0.0951, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.20% (0.5020 => 0.5833, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.09% (0.1032 => 0.1198, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 16.03% (0.0842 => 0.0977, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.82% (0.1940 => 0.2247, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.76% (0.1510 => 0.1748, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 15.74% (10.4361 => 12.0783, std.dev.: 0.0233) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.70% (0.0675 => 0.0781, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 15.70% (0.7115 => 0.8232, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 15.64% (0.4879 => 0.5642, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 15.63% (0.0672 => 0.0777) MultiSource/Applications/sgefa/sgefa: 15.50% (0.3109 => 0.3591, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.44% (0.9765 => 1.1273, std.dev.: 0.0063) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.43% (0.0648 => 0.0748, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.42% (0.2107 => 0.2432, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 15.42% (0.0746 => 0.0861) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.40% (0.1117 => 0.1289, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 15.32% (0.1906 => 0.2198, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: 15.27% (1.1642 => 1.3420, std.dev.: 0.0066) MultiSource/Benchmarks/McCat/18-imp/imp: 15.22% (0.3423 => 0.3944, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 15.20% (8.1363 => 9.3732, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.06% (0.0770 => 0.0886, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 15.05% (0.3177 => 0.3655, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 15.02% (0.5860 => 0.6740, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 15.01% (4.2646 => 4.9046, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.97% (0.2758 => 0.3171, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.96% (0.2065 => 0.2374, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.92% (0.0838 => 0.0963, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 14.82% (9.4845 => 10.8905, std.dev.: 0.0173) MultiSource/Applications/spiff/spiff: 14.82% (0.7835 => 0.8996, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.81% (0.1236 => 0.1419, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.79% (1.7609 => 2.0214, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.71% (0.1584 => 0.1817, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.70% (0.2700 => 0.3097, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.68% (0.0933 => 0.1070, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 14.67% (0.1438 => 0.1649, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/exptree: 14.62% (0.0814 => 0.0933, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 14.60% (0.1151 => 0.1319, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.58% (0.5981 => 0.6853, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.54% (0.0798 => 0.0914, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/almabench: 14.52% (0.0730 => 0.0836, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.51% (0.6450 => 0.7386, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.50% (0.1062 => 0.1216, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.42% (0.0770 => 0.0881, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/rem: 14.34% (0.1144 => 0.1308, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 14.25% (1.4186 => 1.6208, std.dev.: 0.0052) MultiSource/Applications/treecc/treecc: 14.15% (2.0273 => 2.3142, std.dev.: 0.0075) MultiSource/Applications/lambda-0_1_3/lambda: 13.99% (0.7433 => 0.8473, std.dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 13.99% (5.7591 => 6.5647, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.97% (0.8067 => 0.9194, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/health/health: 13.96% (0.1268 => 0.1445, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.92% (0.1695 => 0.1931, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 13.91% (4.9449 => 5.6327, std.dev.: 0.0085) MultiSource/Benchmarks/nbench/nbench: 13.80% (1.1840 => 1.3474, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.78% (5.0018 => 5.6911, std.dev.: 0.0052) MultiSource/Applications/lua/lua: 13.67% (3.8723 => 4.4017, std.dev.: 0.0115) MultiSource/Applications/lemon/lemon: 13.61% (1.0722 => 1.2181, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 13.46% (0.3387 => 0.3843, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.45% (0.5569 => 0.6318, std.dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.40% (7.9617 => 9.0285, std.dev.: 0.0123) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.35% (0.0929 => 0.1053, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.31% (0.1330 => 0.1507, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 13.31% (0.4299 => 0.4871, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.18% (0.3307 => 0.3743, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.17% (0.1625 => 0.1839, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 13.14% (1.1861 => 1.3420, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 13.00% (0.3092 => 0.3494, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 12.89% (0.3180 => 0.3590, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.67% (0.3441 => 0.3877, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.64% (0.2603 => 0.2932, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 12.62% (0.1125 => 0.1267, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 12.55% (0.8921 => 1.0041, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.34% (0.8101 => 0.9101, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 12.28% (1.5603 => 1.7519, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.27% (0.2266 => 0.2544, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 11.94% (21.9371 => 24.5560, std.dev.: 0.0136) SingleSource/Benchmarks/Misc-C++/bigfib: 11.88% (0.6456 => 0.7223, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.85% (0.3543 => 0.3963, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.63% (0.1892 => 0.2112, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.52% (1.1194 => 1.2484, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/trivial-interface: 11.32% (0.3473 => 0.3866, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.26% (0.3927 => 0.4369, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.21% (0.3828 => 0.4257, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.20% (0.1143 => 0.1271, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 11.18% (0.3543 => 0.3939, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.18% (0.3561 => 0.3959, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 11.10% (0.3497 => 0.3885, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.09% (0.3516 => 0.3906, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 11.08% (2.2969 => 2.5513, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/for-in: 11.07% (0.3694 => 0.4103, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.07% (0.3886 => 0.4316, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.82% (0.1044 => 0.1157, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 10.71% (0.4620 => 0.5115, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 10.66% (0.4289 => 0.4746, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 10.49% (0.0953 => 0.1053, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.35% (0.4636 => 0.5116, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.27% (0.3865 => 0.4262, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.16% (0.4203 => 0.4630, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 10.14% (0.3422 => 0.3769, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.09% (0.3826 => 0.4212, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 9.72% (0.3684 => 0.4042, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 9.56% (0.4048 => 0.4435, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.47% (0.2430 => 0.2660, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.46% (0.4103 => 0.4491, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 9.35% (17.1811 => 18.7881, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.31% (0.3427 => 0.3746, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/sieve: 9.02% (0.3603 => 0.3928, std.dev.: 0.0037) SingleSource/UnitTests/ObjC++/property-reference-object: 8.92% (0.6030 => 0.6568, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.78% (0.5925 => 0.6445, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.52% (3.8922 => 4.2240, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference: 8.44% (0.7326 => 0.7944, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.40% (14.3668 => 15.5736, std.dev.: 0.0115) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.39% (0.4064 => 0.4405, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.30% (0.2891 => 0.3131, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 8.30% (0.3098 => 0.3355, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.25% (0.3650 => 0.3951, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 8.09% (0.2831 => 0.3060, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 8.06% (0.2905 => 0.3139, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 7.86% (0.3232 => 0.3486, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.84% (0.3136 => 0.3382, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 7.83% (0.3283 => 0.3540, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.81% (0.3162 => 0.3409, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.80% (0.2872 => 0.3096, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.80% (2.0665 => 2.2276, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.73% (0.2756 => 0.2969, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.70% (0.2793 => 0.3008, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/except: 7.63% (0.2871 => 0.3090, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.58% (0.2877 => 0.3095, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.49% (0.2725 => 0.2929, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 7.46% (0.3379 => 0.3631, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 7.44% (0.3052 => 0.3279, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 7.42% (0.2802 => 0.3010, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.41% (0.2714 => 0.2915, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 6.96% (1.2842 => 1.3736, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/objinst: 6.55% (0.3131 => 0.3336, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.74% (0.3935 => 0.4082, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.56% (0.3817 => 0.3953, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1726, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.47% (0.9957 => 1.1298, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 10.00% (1.1396 => 1.2536, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.1578 => 3.3686, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.65% (2.8904 => 3.0825, std.dev.: 0.0008) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 3.86% (1.9405 => 2.0155, std.dev.: 0.0027) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.78% (4.2280 => 4.3454, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.61% (0.3987 => 0.4091, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.94% (0.8333 => 0.8495, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.70% (2.6546 => 2.6998, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.63% (3.6395 => 3.6990, std.dev.: 0.0092) MultiSource/Benchmarks/llubenchmark/llu: 1.55% (3.7781 => 3.8366, std.dev.: 0.0157) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2076, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 1.17% (4.4649 => 4.5170, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.06% (6.5088 => 6.5781, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.98% (6.6874 => 0.1351, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -77.17% (0.8651 => 0.1975, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.27% (5.2763 => 3.3100, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -29.45% (5.3855 => 3.7996, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -28.84% (5.3526 => 3.8089, std.dev.: 0.0030) SingleSource/UnitTests/Vector/constpool: -9.48% (54.1659 => 49.0298, std.dev.: 0.0083) MultiSource/Applications/ClamAV/clamscan: -2.49% (22.1758 => 21.6237, std.dev.: 0.0299) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -52.88% (8.0499 => 3.7933, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.52% (1.1492 => 0.7640, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.64% (2.9695 => 2.4753, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.95% (1.6925 => 1.4226, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.69% (1.2258 => 1.0703, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.39% (1.2373 => 1.0964, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel-2: -10.71% (1.5373 => 1.3726, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.42% (19.9488 => 18.2695, std.dev.: 0.0164) MultiSource/Benchmarks/FreeBench/mason/mason: -8.01% (0.2161 => 0.1988, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.02% (1.8329 => 1.7043, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0075) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.19% (1.6805 => 1.5933, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.90% (1.5835 => 1.5059, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.35% (8.1563 => 7.8017, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Applications/siod/siod: -3.63% (3.2827 => 3.1635, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8775, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5062, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.72% (0.4808 => 0.4677, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -2.20% (4.6441 => 4.5420, std.dev.: 0.0019) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.86% (10.2830 => 10.0920, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6829, std.dev.: 0.0009) SingleSource/UnitTests/Vector/multiplies: -1.67% (2.5528 => 2.5102, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091) MultiSource/Benchmarks/NPB-serial/is/is: -1.45% (9.5636 => 9.4251, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2878, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 20.67% (0.5229 => 0.6310, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 15.66% (14.9895 => 17.3362, std.dev.: 0.0142) MultiSource/Applications/kimwitu++/kc: 11.07% (14.1553 => 15.7218, std.dev.: 0.0189) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.47% (1.1048 => 1.5077, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 15.96% (7.1582 => 8.3006, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.36% (0.6222 => 0.6929, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.30% (0.1485 => 0.1436, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.13% (0.2116 => 0.2140, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 23 20:01:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 23 Oct 2012 22:01:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121024030132.0C3992A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5149?compare_to=5145&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5149, Order: 166532, Start Time: 2012-10-24 01:39:01, End Time: 2012-10-24 03:03:35 To: 5145, Order: 166522, Start Time: 2012-10-23 23:51:58, End Time: 2012-10-24 01:16:26 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (184 on baseline) Unchanged Tests: 1041 (853 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.16% (55.0869 => 56.2767, std.dev.: 0.2372) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.12% (54.5751 => 56.2767, std.dev.: 0.2372) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.93% (2.0478 => 2.1078, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/salsa20: 2.48% (7.4937 => 7.6792, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/hash2: 2.21% (3.1932 => 3.2637, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.36% (0.1431 => 0.1297, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.82% (0.3821 => 0.3484, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -8.56% (2.4924 => 2.2790, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/BoolLiteralTest: -7.96% (0.3834 => 0.3529, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -7.87% (0.3812 => 0.3512, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -7.83% (0.3831 => 0.3531, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -7.82% (0.3848 => 0.3547, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.80% (0.3884 => 0.3581, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.76% (0.3891 => 0.3589, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -7.76% (0.3880 => 0.3579, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -7.71% (0.4033 => 0.3722, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.68% (0.9542 => 0.8809, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -7.67% (0.3896 => 0.3597, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -7.61% (0.4176 => 0.3858, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.54% (22.4056 => 20.7156, std.dev.: 0.0035) MultiSource/Applications/sgefa/sgefa: -7.48% (0.3357 => 0.3106, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -7.45% (0.4199 => 0.3886, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -7.45% (0.4280 => 0.3961, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.29% (0.3142 => 0.2913, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -7.27% (3.5339 => 3.2771, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: -7.21% (0.1761 => 0.1634, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -7.21% (16.1920 => 15.0252, std.dev.: 0.0136) SingleSource/Benchmarks/Misc/himenobmtxpa: -7.18% (0.1796 => 0.1667, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.17% (0.2428 => 0.2254, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: -7.16% (0.9179 => 0.8522, std.dev.: 0.0037) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.13% (0.1584 => 0.1471, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -7.08% (0.1879 => 0.1746, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -7.06% (7.0961 => 6.5950, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/oourafft: -7.04% (0.2160 => 0.2008) MultiSource/Benchmarks/nbench/nbench: -6.99% (1.1530 => 1.0724, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -6.95% (4.3330 => 4.0320, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -6.92% (9.2283 => 8.5895, std.dev.: 0.0074) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.92% (0.2355 => 0.2192, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.92% (1.3722 => 1.2773, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.91% (14.2083 => 13.2260, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.86% (0.2695 => 0.2510, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: -6.86% (1.2515 => 1.1657, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.84% (6.7716 => 6.3084, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.83% (0.6736 => 0.6276, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -6.80% (0.1500 => 0.1398, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.78% (0.3658 => 0.3410, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.76% (1.6474 => 1.5361, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.75% (5.4682 => 5.0993, std.dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.74% (1.0544 => 0.9833, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -6.73% (4.0594 => 3.7863, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.71% (0.9852 => 0.9191, std.dev.: 0.0069) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.71% (4.5069 => 4.2047, std.dev.: 0.0078) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.70% (0.1716 => 0.1601, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: -6.70% (0.7447 => 0.6948, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -6.69% (1.1450 => 1.0684, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.67% (1.2784 => 1.1931, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.67% (4.0323 => 3.7634, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.65% (1.6364 => 1.5275, std.dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: -6.65% (15.5079 => 14.4771, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.62% (4.8161 => 4.4973, std.dev.: 0.0104) MultiSource/Applications/siod/siod: -6.62% (2.4021 => 2.2431, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.62% (1.4642 => 1.3673, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.60% (0.6484 => 0.6056, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: -6.60% (0.5168 => 0.4827, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.59% (0.2548 => 0.2380, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.55% (0.7919 => 0.7400, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -6.54% (0.2659 => 0.2485, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.54% (0.6395 => 0.5977, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: -6.52% (1.3864 => 1.2960, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.51% (4.8802 => 4.5623, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.51% (0.6681 => 0.6246, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.49% (2.2587 => 2.1122, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.48% (0.6293 => 0.5885, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: -6.48% (0.1621 => 0.1516, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.46% (0.4813 => 0.4502, std.dev.: 0.0095) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.46% (1.2300 => 1.1506, std.dev.: 0.0091) MultiSource/Benchmarks/McCat/18-imp/imp: -6.45% (0.3581 => 0.3350, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: -6.40% (1.3148 => 1.2306, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.40% (0.5591 => 0.5233, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: -6.40% (0.4515 => 0.4226, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -6.40% (0.3406 => 0.3188, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.39% (0.7339 => 0.6870, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.39% (0.5857 => 0.5483, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.38% (0.5925 => 0.5547, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -6.37% (0.9557 => 0.8948, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -6.37% (0.7524 => 0.7045, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.37% (0.5859 => 0.5486, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -6.37% (0.2985 => 0.2795, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.36% (0.5863 => 0.5490, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -6.33% (0.6667 => 0.6245, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -6.33% (15.2527 => 14.2873, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.33% (0.6052 => 0.5669, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.31% (0.6304 => 0.5906, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -6.31% (0.5705 => 0.5345, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: -6.30% (3.5154 => 3.2940, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.30% (0.6194 => 0.5804, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.29% (0.6189 => 0.5800, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.28% (0.5478 => 0.5134, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.27% (0.5329 => 0.4995, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.26% (0.4151 => 0.3891, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.26% (0.6297 => 0.5903, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -6.25% (0.4861 => 0.4557, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.25% (0.5805 => 0.5442, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: -6.24% (0.3491 => 0.3273, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -6.24% (0.5575 => 0.5227, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.23% (0.5999 => 0.5625, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.23% (1.2210 => 1.1449, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -6.23% (0.6230 => 0.5842, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.22% (0.7021 => 0.6584, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -6.22% (34.0927 => 31.9712, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/bigfib: -6.22% (0.6750 => 0.6330, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -6.21% (0.5569 => 0.5223, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -6.20% (17.1032 => 16.0425, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.20% (0.3483 => 0.3267, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.19% (1.2221 => 1.1464, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.17% (0.6446 => 0.6048, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.17% (0.4083 => 0.3831, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -6.17% (0.6676 => 0.6264, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.17% (0.6260 => 0.5874, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -6.16% (0.5570 => 0.5227, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -6.16% (0.6660 => 0.6250, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -6.15% (0.6395 => 0.6002, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: -6.15% (0.4524 => 0.4246, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: -6.14% (2.1401 => 2.0088, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.12% (0.5802 => 0.5447, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -6.11% (0.5567 => 0.5227, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.11% (0.3849 => 0.3614, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.10% (0.7198 => 0.6759, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: -6.10% (0.4248 => 0.3989, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.08% (0.4916 => 0.4617, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -6.07% (0.2999 => 0.2817, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -6.07% (0.6033 => 0.5667, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -6.06% (0.2278 => 0.2140, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -6.05% (0.3026 => 0.2843, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -6.04% (0.5849 => 0.5496, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -6.03% (0.5456 => 0.5127, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.02% (0.3837 => 0.3606, std.dev.: 0.0083) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.01% (0.8521 => 0.8009, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -6.00% (8.0126 => 7.5315, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary2: -6.00% (0.3481 => 0.3272, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.00% (0.2385 => 0.2242, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -5.99% (0.3255 => 0.3060, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.99% (0.3323 => 0.3124, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: -5.98% (0.3025 => 0.2844, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -5.98% (0.3394 => 0.3191, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.98% (0.5941 => 0.5586, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: -5.97% (18.2933 => 17.2008, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.97% (0.3252 => 0.3058, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -5.97% (0.3621 => 0.3405, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.92% (0.2903 => 0.2731, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -5.92% (0.3194 => 0.3005) SingleSource/Benchmarks/Shootout-C++/sieve: -5.91% (0.3788 => 0.3564, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.90% (0.4321 => 0.4066, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -5.90% (0.3867 => 0.3639, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -5.89% (0.7982 => 0.7512, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.88% (0.5581 => 0.5253, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.87% (0.4427 => 0.4167, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.87% (2.1713 => 2.0438, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.87% (0.5688 => 0.5354, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.87% (0.3016 => 0.2839, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.85% (0.6440 => 0.6063, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -5.85% (0.2871 => 0.2703, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -5.83% (0.3205 => 0.3018, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.82% (0.3057 => 0.2879, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -5.80% (0.3446 => 0.3246, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.79% (0.2106 => 0.1984, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -5.79% (0.2849 => 0.2684, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -5.75% (0.2989 => 0.2817, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: -5.75% (0.3271 => 0.3083, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -5.72% (0.2939 => 0.2771, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.66% (0.3319 => 0.3131, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: -5.66% (0.3059 => 0.2886, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.63% (0.2933 => 0.2768, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: -5.55% (0.8418 => 0.7951, std.dev.: 0.0069) SingleSource/UnitTests/ObjC++/property-reference: -5.51% (0.7779 => 0.7350, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: -5.34% (0.6347 => 0.6008, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -5.26% (0.6441 => 0.6102, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: -4.77% (1.5610 => 1.4866, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.69% (0.9077 => 0.8651, std.dev.: 0.0036) MultiSource/Applications/oggenc/oggenc: -4.67% (5.0226 => 4.7880, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -3.37% (20.7746 => 20.0740, std.dev.: 0.0333) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7570, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: -8.64% (1.2842 => 1.1732, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -4.01% (2.2633 => 2.1726, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.91% (1.7753 => 1.7059, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.05% (1.3096 => 1.2697, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4696, std.dev.: 0.0009) Report Time: 1.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 23 21:11:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 23 Oct 2012 23:11:14 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121024041114.96EB72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5150?compare_to=5147&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5150, Order: 166539, Start Time: 2012-10-24 02:49:36, End Time: 2012-10-24 04:13:19 To: 5147, Order: 166531, Start Time: 2012-10-24 01:08:49, End Time: 2012-10-24 02:32:51 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 5 (28 on baseline) Performance Improvements: 3 (3 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 967 (943 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: 4.38% (0.3150 => 0.3288, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/05-eks/eks: 4.00% (0.4302 => 0.4474, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/bh/bh: 3.70% (0.2947 => 0.3056, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: 3.19% (8.4484 => 8.7176, std.dev.: 0.0950) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 30.55% (12.9350 => 16.8868, std.dev.: 0.3468) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.95% (1.2266 => 1.1782, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -3.60% (0.8435 => 0.8131, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: -1.20% (5.0397 => 4.9793, std.dev.: 0.0073) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -1.69% (16.7784 => 16.4949, std.dev.: 0.2001) MultiSource/Applications/obsequi/Obsequi: 1.07% (1.0435 => 1.0547, std.dev.: 0.0117) MultiSource/Applications/sqlite3/sqlite3: -0.19% (0.6375 => 0.6363, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/08-main/main: 0.67% (0.1940 => 0.1953, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.12% (0.1699 => 0.1680, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.34% (0.3201 => 0.3212, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.70% (0.2465 => 0.2423, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.94% (0.3293 => 0.3357, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.85% (0.2373 => 0.2417, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/bigfib: -0.62% (0.5987 => 0.5950, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/mandel: 2.35% (0.0425 => 0.0435, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.73% (0.3277 => 0.3301, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 1.06% (0.1980 => 0.2001, std.dev.: 0.0030) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.49% (0.0241 => 0.0247, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.36% (0.0220 => 0.0217, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.93% (0.0428 => 0.0424, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -3.11% (0.0289 => 0.0280, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 15.44% (0.0259 => 0.0299, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 3.18% (0.0409 => 0.0422, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: -16.75% (0.0203 => 0.0169, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/test1: 26.16% (0.0172 => 0.0217, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 21.48% (0.0298 => 0.0362, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -23.08% (0.0013 => 0.0010, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.54% (0.1479 => 0.1471, std.dev.: 0.0046) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -6.55% (1.1963 => 1.1180, std.dev.: 0.0303) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1475 => 0.1474, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.05% (0.4097 => 0.4222, std.dev.: 0.0229) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.81% (0.1393 => 0.1460, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -80.00% (0.0005 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -13.40% (0.0642 => 0.0556, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.21% (0.0207 => 0.0224, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.88% (0.0569 => 0.0564, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.40% (1.1369 => 1.1414, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.23% (0.0031 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -95.65% (0.0023 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.13% (0.0532 => 0.0538, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.50% (0.0224 => 0.0196, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.02% (0.8039 => 0.7957, std.dev.: 0.0081) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -27.27% (0.0088 => 0.0064, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.89% (2.1832 => 1.6616, std.dev.: 0.0018) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.28% (0.0810 => 0.0950, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.95% (0.8321 => 0.8899, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.11% (0.4847 => 0.5143, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.69% (0.2240 => 0.2345, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.42% (0.7473 => 0.7803, std.dev.: 0.0075) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.10% (0.8148 => 0.8482, std.dev.: 0.0031) SingleSource/UnitTests/Vector/constpool: 3.56% (8.4179 => 8.7176, std.dev.: 0.0950) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.52% (1.1606 => 1.2014, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.75% (0.6287 => 0.6460, std.dev.: 0.0027) MultiSource/Applications/hbd/hbd: 2.52% (1.4269 => 1.4629, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.43% (0.8597 => 0.8806, std.dev.: 0.0048) MultiSource/Applications/lua/lua: 2.28% (3.8189 => 3.9060, std.dev.: 0.0274) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.76% (0.8007 => 0.8148, std.dev.: 0.0028) MultiSource/Applications/SIBsim4/SIBsim4: 1.75% (1.2568 => 1.2788, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.69% (0.9074 => 0.9227, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.58% (0.8457 => 0.8591, std.dev.: 0.0030) MultiSource/Applications/ClamAV/clamscan: 1.53% (14.7684 => 14.9948, std.dev.: 0.0354) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.34% (0.8050 => 0.8158, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.24% (0.8656 => 0.8763, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 1.08% (6.7320 => 6.8049, std.dev.: 0.0179) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 57.45% (1.5795 => 2.4870, std.dev.: 0.0128) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.31% (14.6451 => 16.8868, std.dev.: 0.3468) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.98% (0.3186 => 0.3472, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.52% (1.1857 => 1.2867, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 5.92% (63.1822 => 66.9232, std.dev.: 0.0885) MultiSource/Applications/siod/siod: 2.69% (3.6643 => 3.7628, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/ReedSolomon: 2.14% (8.5322 => 8.7152, std.dev.: 0.0459) MultiSource/Benchmarks/Olden/bh/bh: 1.68% (2.3560 => 2.3955, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.80% (0.3269 => 0.3014, std.dev.: 0.0025) MultiSource/Applications/lua/lua: -4.92% (29.8330 => 28.3642, std.dev.: 0.1172) SingleSource/Benchmarks/Shootout-C++/hash2: -1.47% (3.4237 => 3.3733, std.dev.: 0.0035) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.30% (16.4461 => 16.4949, std.dev.: 0.2001) MultiSource/Applications/obsequi/Obsequi: 2.78% (1.0262 => 1.0547, std.dev.: 0.0117) MultiSource/Applications/sqlite3/sqlite3: 0.49% (0.6332 => 0.6363, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/08-main/main: 6.66% (0.1831 => 0.1953, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.76% (0.1559 => 0.1680, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.85% (0.3123 => 0.3212, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.62% (0.2463 => 0.2423, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.39% (0.3344 => 0.3357, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.24% (0.2364 => 0.2417, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/bigfib: -1.00% (0.6010 => 0.5950, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/mandel: 1.40% (0.0429 => 0.0435, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.07% (0.3266 => 0.3301, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 1.63% (0.1969 => 0.2001, std.dev.: 0.0030) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 10.27% (0.0224 => 0.0247, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 76.42% (0.0123 => 0.0217, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.92% (0.0408 => 0.0424, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 10.24% (0.0254 => 0.0280, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.99% (0.0302 => 0.0299, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.90% (0.0384 => 0.0422, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: -11.05% (0.0190 => 0.0169, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 57.39% (0.0230 => 0.0362, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 42.86% (0.0007 => 0.0010, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.29% (0.1438 => 0.1471, std.dev.: 0.0046) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.32% (1.1329 => 1.1180, std.dev.: 0.0303) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.82% (0.1462 => 0.1474, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.39% (0.4164 => 0.4222, std.dev.: 0.0229) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.65% (0.1369 => 0.1460, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -13.26% (0.0641 => 0.0556, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 14.87% (0.0195 => 0.0224, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.42% (0.0578 => 0.0564, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.20% (1.1437 => 1.1414, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2900.00% (0.0001 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.19% (0.0627 => 0.0538, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.89% (0.0180 => 0.0196, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.75% (0.8017 => 0.7957, std.dev.: 0.0081) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 3.23% (0.0062 => 0.0064, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 23 21:44:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 23 Oct 2012 23:44:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121024044442.990A12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5151?compare_to=5148&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5151, Order: 166540, Start Time: 2012-10-24 03:26:06, End Time: 2012-10-24 04:46:45 To: 5148, Order: 166532, Start Time: 2012-10-24 01:36:12, End Time: 2012-10-24 02:56:34 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (5 on baseline) Performance Regressions: 2 (198 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 88 (14 on baseline) Unchanged Tests: 952 (643 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.69% (15.3530 => 15.6132, std.dev.: 0.0077) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.58% (54.3406 => 56.2884, std.dev.: 0.1164) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.17% (0.6310 => 0.6299, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: -0.05% (17.3362 => 17.3268, std.dev.: 0.0207) MultiSource/Applications/kimwitu++/kc: -0.05% (15.7218 => 15.7136, std.dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: 0.06% (56.2736 => 56.3081, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.82% (0.0490 => 0.0494) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.61% (0.0493 => 0.0496) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.43% (0.0461 => 0.0463, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.43% (0.0462 => 0.0464, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.44% (0.0450 => 0.0452, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.44% (0.0451 => 0.0453) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.45% (0.0443 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.90% (0.0443 => 0.0447) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.43% (0.0462 => 0.0464, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.43% (0.0462 => 0.0464, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.88% (0.0454 => 0.0458) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.22% (0.0457 => 0.0458, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.22% (0.0447 => 0.0448, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.22% (0.0447 => 0.0448, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.44% (0.0453 => 0.0455, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.44% (0.0454 => 0.0456, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.65% (0.0463 => 0.0466, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.70% (0.0486 => 0.0468, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.23% (0.0440 => 0.0441, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.45% (0.0441 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.44% (0.0452 => 0.0454, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.66% (0.0453 => 0.0456) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.45% (0.0444 => 0.0446, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.45% (0.0445 => 0.0447) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.46% (0.0435 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.46% (0.0436 => 0.0438, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.46% (0.0435 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.69% (0.0435 => 0.0438, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.42% (0.0472 => 0.0474, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.64% (0.0472 => 0.0475, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.93% (0.0432 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.46% (0.0435 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.23% (0.0435 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.46% (0.0436 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.23% (0.0443 => 0.0444, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.45% (0.0443 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.07% (1.5077 => 1.5066, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.18% (8.3006 => 8.3154, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.26% (0.6929 => 0.6947, std.dev.: 0.0052) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1436 => 0.1437, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.37% (0.2140 => 0.2132, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -10.97% (63.2438 => 56.3081, std.dev.: 0.0099) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/MallocBench/gs/gs: 13.71% (4.1105 => 4.6741, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.75% (3.4629 => 5.8436, std.dev.: 0.0119) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13518.75% (0.0720 => 9.8055, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049600.00% (0.0001 => 10.0497, std.dev.: 0.0014) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 69.53% (0.0256 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 65.74% (0.2554 => 0.4233, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 51.03% (0.0243 => 0.0367, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 50.60% (10.3673 => 15.6132, std.dev.: 0.0077) SingleSource/UnitTests/SignlessTypes/factor: 47.64% (0.0296 => 0.0437, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 44.28% (0.0271 => 0.0391, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.56% (1.5859 => 2.2450, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 40.88% (0.1622 => 0.2285, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 37.59% (0.1056 => 0.1453, std.dev.: 0.0001) SingleSource/UnitTests/vla: 34.08% (0.0355 => 0.0476, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.72% (2.2024 => 2.8790, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/neural/neural: 28.43% (0.1463 => 0.1879, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 24.65% (0.1655 => 0.2063, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 23.50% (0.0834 => 0.1030, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: 21.65% (0.0485 => 0.0590, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.65% (0.1566 => 0.1905, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 21.30% (0.1432 => 0.1737, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 21.23% (0.2049 => 0.2484, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.83% (7.0540 => 8.5237, std.dev.: 0.0254) MultiSource/Benchmarks/FreeBench/pifft/pifft: 20.50% (2.2022 => 2.6536, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.53% (0.1029 => 0.1230, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.29% (0.0871 => 0.1039, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 19.23% (0.1555 => 0.1854, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 18.63% (0.5105 => 0.6056, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.31% (0.6675 => 0.7897, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 17.92% (0.1440 => 0.1698, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.29% (1.3050 => 1.5306, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/lists: 17.25% (0.0626 => 0.0734, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 17.11% (0.1175 => 0.1376, std.dev.: 0.0032) MultiSource/Applications/d/make_dparser: 17.10% (3.3354 => 3.9057, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/em3d/em3d: 16.93% (0.1695 => 0.1982, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.90% (0.0793 => 0.0927, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.82% (0.2271 => 0.2653, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.75% (0.8172 => 0.9541, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.73% (0.4615 => 0.5387, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/mst/mst: 16.60% (0.1163 => 0.1356, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.53% (0.3121 => 0.3637, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: 16.36% (0.3282 => 0.3819, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.33% (1.5415 => 1.7932, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.16% (0.5020 => 0.5831, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.14% (0.0886 => 0.1029, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 16.01% (0.1337 => 0.1551, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/matrix: 15.89% (0.0818 => 0.0948) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.89% (0.1032 => 0.1196, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 15.72% (0.4879 => 0.5646, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 15.67% (0.7115 => 0.8230, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.63% (0.1510 => 0.1746, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.56% (0.0842 => 0.0973, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 15.48% (0.0672 => 0.0776, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 15.47% (0.3109 => 0.3590, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.46% (0.1940 => 0.2240, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.41% (0.0675 => 0.0779, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 15.39% (1.7609 => 2.0319, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.29% (0.9765 => 1.1258, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.14% (0.2107 => 0.2426, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 15.10% (1.1642 => 1.3400, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.06% (0.0770 => 0.0886, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 15.06% (8.1363 => 9.3620, std.dev.: 0.0045) MultiSource/Applications/JM/ldecod/ldecod: 15.02% (10.4361 => 12.0032, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.95% (0.1117 => 0.1284, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 14.93% (0.3423 => 0.3934, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.93% (4.2646 => 4.9011, std.dev.: 0.0110) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 14.92% (0.3177 => 0.3651, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.88% (0.0746 => 0.0857, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.80% (0.0838 => 0.0962, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 14.80% (0.1906 => 0.2188, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.76% (0.2758 => 0.3165, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.72% (0.1236 => 0.1418, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 14.71% (9.4845 => 10.8799, std.dev.: 0.0087) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.71% (0.1584 => 0.1817, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/exptree: 14.62% (0.0814 => 0.0933, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.58% (0.0933 => 0.1069, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.52% (0.5860 => 0.6711, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/almabench: 14.52% (0.0730 => 0.0836, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 14.51% (0.1151 => 0.1318, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.43% (0.2065 => 0.2363, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 14.39% (0.1438 => 0.1645, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 14.38% (0.7835 => 0.8962, std.dev.: 0.0024) SingleSource/UnitTests/SignlessTypes/rem: 14.34% (0.1144 => 0.1308, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.33% (0.5981 => 0.6838, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.28% (0.6450 => 0.7371, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 14.13% (1.4186 => 1.6191, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: 14.07% (2.0273 => 2.3125, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.04% (0.2700 => 0.3079, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.04% (0.0798 => 0.0910, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.03% (0.1062 => 0.1211, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.86% (0.1695 => 0.1930, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 13.80% (5.7591 => 6.5537, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.77% (0.0770 => 0.0876, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 13.67% (0.7433 => 0.8449, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 13.64% (0.1268 => 0.1441, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.64% (0.8067 => 0.9167, std.dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 13.59% (1.1840 => 1.3449, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 13.56% (4.9449 => 5.6156, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.45% (5.0018 => 5.6747, std.dev.: 0.0018) MultiSource/Benchmarks/sim/sim: 13.43% (0.3387 => 0.3842, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 13.42% (3.8723 => 4.3919, std.dev.: 0.0093) MultiSource/Applications/lemon/lemon: 13.41% (1.0722 => 1.2160, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.27% (0.5569 => 0.6308, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.24% (0.0929 => 0.1052, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.20% (7.9617 => 9.0127, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.18% (0.3307 => 0.3743, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.16% (0.1330 => 0.1505, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.98% (0.1625 => 0.1836, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 12.98% (0.4299 => 0.4857, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.97% (1.1861 => 1.3399, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 12.74% (0.3092 => 0.3486, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 12.71% (0.1125 => 0.1268, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.70% (0.3441 => 0.3878, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 12.67% (0.3180 => 0.3583, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.60% (0.2603 => 0.2931, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 12.49% (0.8921 => 1.0035, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.40% (0.2266 => 0.2547, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.12% (0.8101 => 0.9083, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 12.07% (0.6456 => 0.7235, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 12.00% (1.5603 => 1.7475, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.67% (1.1194 => 1.2500, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 11.57% (21.9371 => 24.4757, std.dev.: 0.0131) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.20% (0.1143 => 0.1271, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.05% (0.1892 => 0.2101, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 11.00% (0.4620 => 0.5128, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 10.91% (2.2969 => 2.5475, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 10.80% (0.4289 => 0.4752, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.78% (0.3543 => 0.3925, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 10.60% (0.0953 => 0.1054, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.54% (0.1044 => 0.1154, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.35% (0.3865 => 0.4265, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.34% (0.3828 => 0.4224, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/parameter-passing: 10.34% (0.3927 => 0.4333, std.dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.33% (0.4636 => 0.5115, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 10.29% (0.3422 => 0.3774, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 10.28% (0.3473 => 0.3830, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/exceptions-2: 10.24% (0.3497 => 0.3855, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.16% (0.4203 => 0.4630, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.14% (0.3826 => 0.4214, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 10.14% (0.3561 => 0.3922, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/property: 10.11% (0.3886 => 0.4279, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/exceptions-4: 10.10% (0.3543 => 0.3901, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/for-in: 10.07% (0.3694 => 0.4066, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/exceptions-3: 10.07% (0.3516 => 0.3870, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/moments: 9.98% (0.4048 => 0.4452, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 9.93% (0.3684 => 0.4050, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.58% (0.4103 => 0.4496, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.25% (0.3427 => 0.3744, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 9.19% (0.3603 => 0.3934, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.18% (0.2430 => 0.2653, std.dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: 9.16% (17.1811 => 18.7545, std.dev.: 0.0096) SingleSource/UnitTests/ObjC++/property-reference-object: 8.86% (0.6030 => 0.6564, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.76% (14.3668 => 15.6252, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.71% (0.4064 => 0.4418, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.68% (0.5925 => 0.6439, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.47% (0.2891 => 0.3136, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.47% (3.8922 => 4.2219, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.44% (0.3650 => 0.3958, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 8.43% (0.2905 => 0.3150, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 8.36% (0.3098 => 0.3357, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.34% (0.7326 => 0.7937, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary3: 8.32% (0.3283 => 0.3556, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 8.30% (0.2831 => 0.3066, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.15% (0.2872 => 0.3106, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 8.11% (0.3232 => 0.3494, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.03% (0.3162 => 0.3416, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.00% (0.3136 => 0.3387, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.99% (2.0665 => 2.2316, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 7.96% (0.2877 => 0.3106, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.95% (0.2756 => 0.2975, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.91% (0.2793 => 0.3014, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: 7.91% (0.2871 => 0.3098, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.89% (0.2725 => 0.2940, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 7.67% (0.3052 => 0.3286, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 7.64% (0.2802 => 0.3016, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 7.58% (0.3379 => 0.3635, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 7.55% (0.2714 => 0.2919, std.dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 7.06% (1.2842 => 1.3749, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/objinst: 6.77% (0.3131 => 0.3343, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.94% (0.3935 => 0.4090, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1725, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 14.16% (0.9957 => 1.1367, std.dev.: 0.0117) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.95% (1.1396 => 1.2530, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.1578 => 3.3686, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.64% (2.8904 => 3.0823, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 5.08% (0.5413 => 0.5688, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.65% (0.3463 => 0.3624, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 3.82% (1.9405 => 2.0146, std.dev.: 0.0096) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.65% (4.2280 => 4.3399, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.61% (0.3987 => 0.4091, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.08% (3.6395 => 3.7153, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bisort/bisort: 2.00% (0.8333 => 0.8500, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 1.54% (3.1595 => 3.2081, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 1.28% (4.4649 => 4.5219, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.24% (2.6546 => 2.6876, std.dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.98% (6.6874 => 0.1348, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -76.90% (0.8651 => 0.1998, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.02% (5.2763 => 3.3229, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -29.82% (5.3855 => 3.7798, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -29.14% (5.3526 => 3.7929, std.dev.: 0.0026) SingleSource/UnitTests/Vector/constpool: -9.39% (54.1659 => 49.0788, std.dev.: 0.0275) MultiSource/Applications/ClamAV/clamscan: -2.57% (22.1758 => 21.6062, std.dev.: 0.0360) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -52.87% (8.0499 => 3.7942, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.32% (1.1492 => 0.7663, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4752, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -15.80% (1.6925 => 1.4251, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.73% (0.0998 => 0.0851, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.69% (1.2258 => 1.0702, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -12.03% (1.2373 => 1.0885, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel-2: -10.98% (1.5373 => 1.3685, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.44% (19.9488 => 18.2656, std.dev.: 0.1090) MultiSource/Benchmarks/FreeBench/mason/mason: -7.87% (0.2161 => 0.1991, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.95% (1.8329 => 1.7055, std.dev.: 0.0166) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.17% (1.6805 => 1.5936, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5080, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.26% (8.1563 => 7.8092, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.62% (3.2827 => 3.1640, std.dev.: 0.0019) MultiSource/Benchmarks/sim/sim: -3.39% (5.0483 => 4.8774, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.14% (32.5116 => 31.4914, std.dev.: 0.0078) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.83% (0.4808 => 0.4672, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -2.17% (4.6441 => 4.5433, std.dev.: 0.0049) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -1.87% (10.2830 => 10.0903, std.dev.: 0.0198) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6831, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -1.63% (2.5528 => 2.5112, std.dev.: 0.0028) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2879, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8578, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2355, std.dev.: 0.0075) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 20.46% (0.5229 => 0.6299, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 15.59% (14.9895 => 17.3268, std.dev.: 0.0207) MultiSource/Applications/kimwitu++/kc: 11.01% (14.1553 => 15.7136, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.37% (1.1048 => 1.5066, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 16.17% (7.1582 => 8.3154, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.65% (0.6222 => 0.6947, std.dev.: 0.0052) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.23% (0.1485 => 0.1437, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.76% (0.2116 => 0.2132, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 23 21:48:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 23 Oct 2012 23:48:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121024044850.D03302A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5152?compare_to=5149&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5152, Order: 166540, Start Time: 2012-10-24 03:26:26, End Time: 2012-10-24 04:50:55 To: 5149, Order: 166532, Start Time: 2012-10-24 01:39:01, End Time: 2012-10-24 03:03:35 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (6 on baseline) Performance Improvements: 0 (186 on baseline) Unchanged Tests: 1042 (850 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.37% (54.5751 => 56.4117, std.dev.: 0.0831) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.58% (2.0478 => 2.1006, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: 2.23% (7.4937 => 7.6611, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/hash2: 2.17% (3.1932 => 3.2624, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.03% (3.6283 => 3.6655, std.dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.22% (0.1431 => 0.1299, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.66% (0.3821 => 0.3490, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -8.59% (2.4924 => 2.2782, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/BoolLiteralTest: -7.77% (0.3834 => 0.3536, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -7.76% (0.3812 => 0.3516, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.70% (0.3884 => 0.3585, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.68% (0.3891 => 0.3592, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -7.68% (0.3880 => 0.3582, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -7.67% (0.3831 => 0.3537, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -7.67% (0.3848 => 0.3553, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.60% (22.4056 => 20.7037, std.dev.: 0.0063) SingleSource/UnitTests/ObjC/for-in: -7.59% (0.4033 => 0.3727, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -7.57% (0.3896 => 0.3601, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -7.52% (0.4176 => 0.3862, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.43% (0.9542 => 0.8833, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -7.39% (0.3357 => 0.3109, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -7.38% (0.4199 => 0.3889, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -7.36% (0.4280 => 0.3965, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -7.20% (3.5339 => 3.2796, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.13% (0.3142 => 0.2918, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: -7.13% (0.1796 => 0.1668, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: -7.11% (16.1920 => 15.0414, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/ReedSolomon: -7.08% (0.1879 => 0.1746, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.07% (0.1584 => 0.1472, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.04% (0.2428 => 0.2257, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: -7.03% (0.9179 => 0.8534, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: -7.00% (1.1530 => 1.0723, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: -6.99% (0.2160 => 0.2009, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -6.98% (0.1761 => 0.1638, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -6.95% (7.0961 => 6.6028, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.92% (1.3722 => 1.2772, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.90% (5.4682 => 5.0907, std.dev.: 0.0146) MultiSource/Benchmarks/MallocBench/gs/gs: -6.87% (4.3330 => 4.0353, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.86% (0.3658 => 0.3407, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.84% (0.2355 => 0.2194, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -6.83% (9.2283 => 8.5984, std.dev.: 0.0133) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.82% (6.7716 => 6.3096, std.dev.: 0.0027) MultiSource/Applications/Burg/burg: -6.81% (1.2515 => 1.1663, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.75% (0.2695 => 0.2513, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -6.74% (0.7447 => 0.6945, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.74% (0.6736 => 0.6282, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: -6.72% (15.5079 => 14.4652, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.71% (1.0544 => 0.9836, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.71% (1.6474 => 1.5369, std.dev.: 0.0006) MultiSource/Applications/lua/lua: -6.69% (4.0594 => 3.7878, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.69% (0.9852 => 0.9193, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.67% (0.7919 => 0.7391, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: -6.67% (0.4861 => 0.4537, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.65% (0.4151 => 0.3875, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.65% (0.6484 => 0.6053, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -6.65% (1.1450 => 1.0689, std.dev.: 0.0033) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.64% (0.1716 => 0.1602, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.64% (4.5069 => 4.2075, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.64% (1.6364 => 1.5277, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.63% (1.2784 => 1.1937, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.62% (4.8161 => 4.4974, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.60% (1.4642 => 1.3676, std.dev.: 0.0092) MultiSource/Applications/siod/siod: -6.58% (2.4021 => 2.2440, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -6.58% (0.2659 => 0.2484, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: -6.58% (0.5168 => 0.4828, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.55% (0.2548 => 0.2381, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.54% (4.0323 => 3.7687, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.52% (0.4813 => 0.4499, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.52% (2.2587 => 2.1115, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_container: -6.51% (0.9557 => 0.8935, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -6.50% (0.2985 => 0.2791, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.49% (4.8802 => 4.5635, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.49% (1.2300 => 1.1502, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: -6.45% (1.3864 => 1.2970, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -6.45% (0.3491 => 0.3266, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -6.42% (0.3581 => 0.3351, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.42% (0.3849 => 0.3602, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: -6.42% (0.1621 => 0.1517, std.dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: -6.40% (1.3148 => 1.2306, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.40% (0.6293 => 0.5890, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.38% (0.5329 => 0.4989, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: -6.32% (0.4524 => 0.4238, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.32% (0.6395 => 0.5991, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -6.31% (0.3406 => 0.3191, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.31% (14.2083 => 13.3115, std.dev.: 0.0267) SingleSource/Benchmarks/Misc-C++/bigfib: -6.28% (0.6750 => 0.6326, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -6.27% (15.2527 => 14.2965, std.dev.: 0.0105) MultiSource/Benchmarks/McCat/05-eks/eks: -6.27% (0.4515 => 0.4232, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.26% (0.5925 => 0.5554, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -6.26% (0.7524 => 0.7053, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.25% (0.6052 => 0.5674, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.24% (0.7021 => 0.6583, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.23% (0.5857 => 0.5492, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.21% (0.6681 => 0.6266, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.21% (0.5591 => 0.5244, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.20% (0.5802 => 0.5442, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.20% (0.7339 => 0.6884, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -6.19% (0.6667 => 0.6254, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.19% (1.2210 => 1.1454, std.dev.: 0.0043) MultiSource/Applications/d/make_dparser: -6.19% (3.5154 => 3.2979, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.18% (0.5999 => 0.5628, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -6.18% (17.1032 => 16.0463, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -6.17% (0.5705 => 0.5353, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: -6.17% (0.4248 => 0.3986, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.16% (0.5859 => 0.5498, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.16% (0.3931 => 0.3689, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.15% (0.6304 => 0.5916, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -6.15% (0.3059 => 0.2871, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.15% (0.6297 => 0.5910, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -6.13% (34.0927 => 32.0018, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.13% (0.5805 => 0.5449, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: -6.13% (18.2933 => 17.1721, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary3: -6.12% (0.3446 => 0.3235, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -6.12% (2.1401 => 2.0091, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.12% (0.6194 => 0.5815, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -6.12% (0.6230 => 0.5849, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -6.11% (0.6395 => 0.6004, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -6.11% (0.6676 => 0.6268, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: -6.10% (0.2999 => 0.2816, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.09% (0.6189 => 0.5812, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -6.09% (0.4321 => 0.4058, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.09% (0.7198 => 0.6760, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.08% (0.6446 => 0.6054, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.08% (1.2221 => 1.1478, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.07% (0.3837 => 0.3604, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.07% (2.1713 => 2.0396, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.06% (0.3252 => 0.3055, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.05% (0.5863 => 0.5508, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -6.05% (0.5569 => 0.5232, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.04% (0.2385 => 0.2241, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -6.04% (8.0126 => 7.5289, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.02% (0.4083 => 0.3837, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.02% (0.5478 => 0.5148, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.02% (0.6260 => 0.5883, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -6.02% (0.2989 => 0.2809, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -6.02% (0.3621 => 0.3403, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -6.01% (0.2278 => 0.2141, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -6.01% (0.5575 => 0.5240, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.00% (0.4916 => 0.4621, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.00% (0.3483 => 0.3274, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.98% (0.5567 => 0.5234, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: -5.98% (0.3194 => 0.3003, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.96% (0.5570 => 0.5238, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: -5.96% (0.3255 => 0.3061, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.96% (0.3323 => 0.3125, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: -5.95% (0.3025 => 0.2845, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.95% (0.6440 => 0.6057, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -5.95% (0.3481 => 0.3274, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.94% (0.5941 => 0.5588, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.93% (0.6660 => 0.6265, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.92% (0.6033 => 0.5676, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.92% (0.5849 => 0.5503, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: -5.92% (0.3026 => 0.2847, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.91% (0.5581 => 0.5251, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.90% (0.3016 => 0.2838, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.90% (0.4427 => 0.4166, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.88% (0.8521 => 0.8020, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -5.87% (0.7779 => 0.7322, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -5.87% (0.3271 => 0.3079, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.87% (0.5456 => 0.5136, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.82% (0.2871 => 0.2704, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -5.81% (0.3788 => 0.3568, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -5.80% (0.7982 => 0.7519, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists1: -5.79% (0.3867 => 0.3643, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.79% (0.2903 => 0.2735, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.78% (0.5688 => 0.5359, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.75% (0.2106 => 0.1985, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: -5.70% (0.6347 => 0.5985, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.69% (0.3057 => 0.2883, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -5.69% (0.8418 => 0.7939, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -5.68% (0.2939 => 0.2772, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: -5.68% (0.3205 => 0.3023, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -5.65% (0.2849 => 0.2688, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.51% (0.3319 => 0.3136, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.49% (0.2933 => 0.2772, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -5.46% (0.6441 => 0.6089, std.dev.: 0.0079) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.05% (0.2001 => 0.1900, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.89% (0.9077 => 0.8633, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: -4.80% (1.5610 => 1.4860, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.57% (0.2277 => 0.2173, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -4.43% (5.0226 => 4.8000, std.dev.: 0.0051) SingleSource/UnitTests/Vector/constpool: -3.35% (20.7746 => 20.0780, std.dev.: 0.0391) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7544, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/richards_benchmark: -8.75% (1.2842 => 1.1718, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: -3.94% (2.2633 => 2.1741, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7068, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.03% (1.0557 => 1.0237, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.93% (1.3096 => 1.2712, std.dev.: 0.0129) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.48% (6.5735 => 6.4762, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 23 22:52:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 24 Oct 2012 00:52:18 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121024055218.9BAB82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5153?compare_to=5150&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5153, Order: 166544, Start Time: 2012-10-24 04:30:34, End Time: 2012-10-24 05:54:24 To: 5150, Order: 166539, Start Time: 2012-10-24 02:49:36, End Time: 2012-10-24 04:13:19 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 18 (58 on baseline) Performance Improvements: 1 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 956 (912 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.91% (0.2267 => 0.2469, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.89% (0.2025 => 0.2205, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.40% (0.1909 => 0.2012, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.24% (0.5892 => 0.6201, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.98% (0.5680 => 0.5963, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.95% (0.2968 => 0.3115, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.85% (0.9578 => 0.9851, std.dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.57% (0.4830 => 0.4954, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.33% (1.1782 => 1.2057, std.dev.: 0.0078) MultiSource/Applications/treecc/treecc: 2.27% (1.9853 => 2.0303, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.20% (4.4746 => 4.5732, std.dev.: 0.0355) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.04% (0.7803 => 0.7962, std.dev.: 0.0029) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.75% (6.6579 => 6.7742, std.dev.: 0.0257) MultiSource/Applications/lambda-0_1_3/lambda: 1.73% (0.7509 => 0.7639, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: 1.53% (4.1695 => 4.2334, std.dev.: 0.0225) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.29% (1.6360 => 1.6571, std.dev.: 0.0076) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.28% (0.8899 => 0.9013, std.dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 12.94% (21.2921 => 24.0472, std.dev.: 0.9077) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: -11.33% (4.2222 => 3.7439, std.dev.: 0.1830) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.82% (16.4949 => 16.6304, std.dev.: 0.0396) MultiSource/Applications/obsequi/Obsequi: 0.11% (1.0547 => 1.0559, std.dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: -0.06% (0.6363 => 0.6359, std.dev.: 0.0163) MultiSource/Benchmarks/McCat/08-main/main: -5.33% (0.1953 => 0.1849, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.08% (0.1680 => 0.1715, std.dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.68% (0.3212 => 0.3266, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.15% (0.2423 => 0.2475, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.15% (0.3357 => 0.3352, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.32% (0.2417 => 0.2361, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/bigfib: 0.99% (0.5950 => 0.6009, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/mandel: 11.26% (0.0435 => 0.0484, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.51% (0.3301 => 0.3318, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/strcat: -0.20% (0.2001 => 0.1997, std.dev.: 0.0019) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.81% (0.0247 => 0.0245, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.92% (0.0217 => 0.0219, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.94% (0.0424 => 0.0428, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 18.57% (0.0280 => 0.0332, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 5.02% (0.0299 => 0.0314, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.71% (0.0422 => 0.0425, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 20.12% (0.0169 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 0.46% (0.0217 => 0.0218, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -7.73% (0.0362 => 0.0334, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -90.00% (0.0010 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.75% (0.1471 => 0.1482, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.89% (1.1180 => 1.1279, std.dev.: 0.0063) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 1.76% (0.1474 => 0.1500, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.60% (0.4222 => 0.4070, std.dev.: 0.0358) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.81% (0.1460 => 0.1419, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.33% (0.0556 => 0.0619, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 23.21% (0.0224 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.03% (0.0564 => 0.0530, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.14% (1.1414 => 1.1430, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3.33% (0.0030 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 17.10% (0.0538 => 0.0630, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 36.22% (0.0196 => 0.0267, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.93% (0.7957 => 0.8031, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 4.69% (0.0064 => 0.0067, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.91% (2.1832 => 1.6611, std.dev.: 0.0126) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.32% (0.0810 => 0.0926, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/tsp/tsp: 11.51% (0.1112 => 0.1240, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.34% (0.2279 => 0.2469, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.32% (0.8321 => 0.9013, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.74% (0.1885 => 0.2012, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.54% (0.7473 => 0.7962, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.55% (0.2180 => 0.2301, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.35% (0.1983 => 0.2089, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.84% (1.1606 => 1.2168, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.41% (0.9435 => 0.9851, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.36% (0.6287 => 0.6561, std.dev.: 0.0105) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.16% (0.8148 => 0.8487, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.03% (0.5961 => 0.6201, std.dev.: 0.0047) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.98% (0.3137 => 0.3262, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.90% (0.2998 => 0.3115, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.58% (0.4783 => 0.4954, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.18% (1.1685 => 1.2057, std.dev.: 0.0078) MultiSource/Applications/Burg/burg: 2.68% (1.2222 => 1.2550, std.dev.: 0.0121) MultiSource/Benchmarks/McCat/05-eks/eks: 2.68% (0.4397 => 0.4515, std.dev.: 0.0023) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.52% (6.6074 => 6.7742, std.dev.: 0.0257) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.51% (0.5817 => 0.5963, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: 2.49% (4.1305 => 4.2334, std.dev.: 0.0225) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.19% (8.6476 => 8.8369, std.dev.: 0.0490) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.19% (0.8457 => 0.8642, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.12% (1.4479 => 1.4786, std.dev.: 0.0103) MultiSource/Applications/lua/lua: 1.97% (3.8189 => 3.8943, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.94% (0.8007 => 0.8162, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.82% (0.8331 => 0.8483, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.80% (0.8611 => 0.8766, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: 1.79% (0.6834 => 0.6956, std.dev.: 0.0037) MultiSource/Applications/ClamAV/clamscan: 1.65% (14.7684 => 15.0123, std.dev.: 0.0342) MultiSource/Applications/oggenc/oggenc: 1.54% (4.9628 => 5.0390, std.dev.: 0.0276) MultiSource/Applications/JM/lencod/lencod: 1.51% (15.3280 => 15.5592, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.49% (0.7932 => 0.8050, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.48% (0.8420 => 0.8545, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.47% (0.8805 => 0.8934, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 1.46% (6.7320 => 6.8302, std.dev.: 0.0156) MultiSource/Applications/SPASS/SPASS: 1.44% (14.2605 => 14.4654, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.43% (0.8050 => 0.8165, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.42% (0.8317 => 0.8435, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.42% (0.7966 => 0.8079, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.32% (0.8885 => 0.9002, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.31% (0.8261 => 0.8369, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.29% (0.8712 => 0.8824, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.28% (0.8204 => 0.8309, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.22% (0.8177 => 0.8277, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 57.70% (1.5795 => 2.4908, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.73% (0.3186 => 0.3464, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.48% (1.1857 => 1.2862, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 5.97% (63.1822 => 66.9566, std.dev.: 0.1126) MultiSource/Benchmarks/FreeBench/distray/distray: 4.35% (0.2390 => 0.2494, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: 3.11% (8.5322 => 8.7977, std.dev.: 0.0151) MultiSource/Applications/siod/siod: 2.56% (3.6643 => 3.7580, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/mason/mason: 1.88% (0.5415 => 0.5517, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bh/bh: 1.83% (2.3560 => 2.3990, std.dev.: 0.0048) MultiSource/Applications/minisat/minisat: 1.70% (6.1525 => 6.2569, std.dev.: 0.0264) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.61% (4.8362 => 4.9139, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.32% (1.5941 => 1.6152, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.38% (0.3269 => 0.2995, std.dev.: 0.0020) MultiSource/Applications/lua/lua: -4.95% (29.8330 => 28.3570, std.dev.: 0.0315) SingleSource/Benchmarks/Shootout-C++/hash2: -1.67% (3.4237 => 3.3664, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.24% (3.3479 => 3.3065, std.dev.: 0.0018) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 1.12% (16.4461 => 16.6304, std.dev.: 0.0396) MultiSource/Applications/obsequi/Obsequi: 2.89% (1.0262 => 1.0559, std.dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: 0.43% (0.6332 => 0.6359, std.dev.: 0.0163) MultiSource/Benchmarks/McCat/08-main/main: 0.98% (0.1831 => 0.1849, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.01% (0.1559 => 0.1715, std.dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.58% (0.3123 => 0.3266, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.49% (0.2463 => 0.2475, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.24% (0.3344 => 0.3352, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.13% (0.2364 => 0.2361, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/bigfib: -0.02% (0.6010 => 0.6009, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/mandel: 12.82% (0.0429 => 0.0484, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.59% (0.3266 => 0.3318, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/strcat: 1.42% (0.1969 => 0.1997, std.dev.: 0.0019) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 9.38% (0.0224 => 0.0245, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.71% (0.0254 => 0.0332, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: 45.22% (0.0230 => 0.0334, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 3.06% (0.1438 => 0.1482, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -0.44% (1.1329 => 1.1279, std.dev.: 0.0063) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 2.60% (0.1462 => 0.1500, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.26% (0.4164 => 0.4070, std.dev.: 0.0358) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.65% (0.1369 => 0.1419, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.43% (0.0641 => 0.0619, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.54% (0.0195 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.30% (0.0578 => 0.0530, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.06% (1.1437 => 1.1430, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.48% (0.0627 => 0.0630, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.33% (0.0180 => 0.0267, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.17% (0.8017 => 0.8031, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 8.06% (0.0062 => 0.0067, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 23 23:32:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 24 Oct 2012 01:32:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121024063245.CCB722A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5154?compare_to=5146&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5154, Order: 166539, Start Time: 2012-10-24 03:17:58, End Time: 2012-10-24 06:34:50 To: 5146, Order: 166505, Start Time: 2012-10-23 23:13:38, End Time: 2012-10-24 02:29:44 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (169 on baseline) Performance Improvements: 1 (17 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1038 (722 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.94% (123.5326 => 130.8702, std.dev.: 0.6334) MultiSource/Benchmarks/Olden/perimeter/perimeter: 2.12% (0.6095 => 0.6224, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.35% (54.1491 => 54.8809, std.dev.: 0.0550) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.44% (2.4672 => 2.4316, std.dev.: 0.0075) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.72% (0.0625 => 0.0892, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.30% (0.1063 => 0.1417, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.04% (0.2969 => 0.3742, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.41% (0.1106 => 0.1387, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.28% (0.4253 => 0.5328, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.07% (0.0714 => 0.0893, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 24.97% (1.5932 => 1.9910, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.57% (0.4139 => 0.5156, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.53% (0.0897 => 0.1117, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.34% (0.5900 => 0.7336, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.25% (0.4994 => 0.6205, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.58% (0.0475 => 0.0587, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.40% (0.0547 => 0.0675, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.36% (0.5000 => 0.6168, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.29% (0.0584 => 0.0720, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.35% (0.1620 => 0.1982, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.14% (0.1021 => 0.1247, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.77% (0.1107 => 0.1348, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 21.54% (0.0599 => 0.0728, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.01% (0.0633 => 0.0766, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 20.78% (0.0948 => 0.1145, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.70% (0.0541 => 0.0653, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.56% (0.0642 => 0.0774, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.55% (0.0584 => 0.0704, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.40% (0.1103 => 0.1328, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.32% (0.1604 => 0.1930, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.24% (0.1003 => 0.1206, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: 20.22% (0.0821 => 0.0987, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 20.20% (0.0604 => 0.0726, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.11% (0.3903 => 0.4688, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.08% (0.1549 => 0.1860, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 20.07% (0.1619 => 0.1944, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.83% (0.0822 => 0.0985, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 19.11% (0.0947 => 0.1128, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.60% (0.1462 => 0.1734, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.52% (0.2014 => 0.2387, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.38% (0.2736 => 0.3239, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.35% (0.3890 => 0.4604, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 18.34% (0.1505 => 0.1781, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 18.23% (0.1218 => 0.1440, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 18.19% (0.0808 => 0.0955, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.85% (1.3152 => 1.5500, std.dev.: 0.0052) SingleSource/UnitTests/ObjC++/Hello: 17.80% (0.5826 => 0.6863, std.dev.: 0.0098) MultiSource/Applications/spiff/spiff: 17.70% (0.4029 => 0.4742, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/mst/mst: 17.62% (0.0698 => 0.0821, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 17.52% (0.5889 => 0.6921, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 17.31% (1.8794 => 2.2047, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.31% (0.2866 => 0.3362, std.dev.: 0.0025) MultiSource/Applications/Burg/burg: 17.29% (0.5546 => 0.6505, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.28% (0.1088 => 0.1276, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.12% (3.5627 => 4.1726, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.85% (0.4658 => 0.5443, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.77% (0.5026 => 0.5869, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.70% (0.2875 => 0.3355, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.62% (0.2738 => 0.3193, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.57% (0.1968 => 0.2294, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.54% (1.6211 => 1.8892, std.dev.: 0.0037) MultiSource/Applications/hbd/hbd: 16.45% (0.9697 => 1.1292, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.38% (0.1160 => 0.1350, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.26% (0.3271 => 0.3803, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 16.22% (0.2725 => 0.3167, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.12% (0.4361 => 0.5064, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 16.12% (0.1421 => 0.1650, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 16.01% (0.2780 => 0.3225, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 15.95% (0.2714 => 0.3147, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 15.90% (0.2811 => 0.3258, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 15.90% (1.0781 => 1.2495, std.dev.: 0.0031) SingleSource/Regression/C++/ofstream_ctor: 15.81% (0.3004 => 0.3479, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.79% (0.2729 => 0.3160, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 15.79% (0.7171 => 0.8303, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/strcat: 15.78% (0.2750 => 0.3184, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 15.77% (0.9909 => 1.1472, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.76% (0.2792 => 0.3232, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 15.65% (0.1284 => 0.1485, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 15.63% (4.2109 => 4.8689, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.57% (2.0673 => 2.3892, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/random: 15.55% (0.2803 => 0.3239, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.54% (2.7292 => 3.1532, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.52% (0.3930 => 0.4540, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: 15.52% (0.2823 => 0.3261, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.49% (0.2911 => 0.3362, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 15.46% (0.2813 => 0.3248, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 15.41% (0.3096 => 0.3573, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.40% (0.3195 => 0.3687, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.31% (1.9694 => 2.2709, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.28% (4.4195 => 5.0948, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/ary2: 15.13% (0.3317 => 0.3819, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.12% (1.9966 => 2.2984, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 15.10% (23.5202 => 27.0718, std.dev.: 0.0279) SingleSource/Benchmarks/Shootout-C++/ary3: 15.09% (0.3267 => 0.3760, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.02% (0.3362 => 0.3867, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 14.92% (0.3258 => 0.3744, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.74% (0.3060 => 0.3511, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 14.69% (0.2566 => 0.2943, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.66% (0.3124 => 0.3582, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.40% (0.1090 => 0.1247, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 14.37% (0.3348 => 0.3829, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.36% (0.3845 => 0.4397, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 14.33% (0.4146 => 0.4740, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 14.22% (0.3678 => 0.4201, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 14.22% (0.2075 => 0.2370, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.20% (0.3282 => 0.3748, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 14.14% (0.3726 => 0.4253, std.dev.: 0.0083) MultiSource/Applications/lua/lua: 14.01% (1.4269 => 1.6268, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/lists1: 13.92% (0.3477 => 0.3961, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.87% (0.3981 => 0.4533, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.85% (0.3625 => 0.4127, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.74% (0.3690 => 0.4197, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash2: 13.74% (0.4251 => 0.4835, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 13.61% (2.1653 => 2.4601, std.dev.: 0.0019) MultiSource/Applications/treecc/treecc: 13.55% (0.7875 => 0.8942, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 13.49% (0.3446 => 0.3911, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.45% (0.3488 => 0.3957, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/exceptions-4: 13.42% (0.3465 => 0.3930, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 13.36% (0.3496 => 0.3963, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/synchronized: 13.32% (0.3469 => 0.3931, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 13.31% (0.3442 => 0.3900, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 13.29% (0.3460 => 0.3920, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 13.21% (0.5012 => 0.5674, std.dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 13.06% (4.6177 => 5.2207, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/property: 12.99% (0.3650 => 0.4124, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.93% (0.3643 => 0.4114, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 12.81% (0.3724 => 0.4201, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 12.36% (2.1013 => 2.3610, std.dev.: 0.0046) MultiSource/Applications/SIBsim4/SIBsim4: 11.89% (0.2691 => 0.3011, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.86% (0.2040 => 0.2282, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.66% (0.6435 => 0.7185, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.65% (0.2068 => 0.2309, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 11.56% (5.5417 => 6.1825, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.28% (0.1028 => 0.1144, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.96% (0.2737 => 0.3037, std.dev.: 0.0041) MultiSource/Applications/lambda-0_1_3/lambda: 10.92% (0.3498 => 0.3880, std.dev.: 0.0078) MultiSource/Applications/siod/siod: 10.91% (0.6634 => 0.7358, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 10.73% (0.3336 => 0.3694, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.41% (0.1383 => 0.1527, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.25% (0.3084 => 0.3400, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 9.96% (0.4847 => 0.5330, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.75% (0.2103 => 0.2308, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.12% (4.6926 => 5.1206, std.dev.: 0.0124) MultiSource/Applications/sqlite3/sqlite3: 9.01% (2.0346 => 2.2180, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.73% (0.5361 => 0.5829, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 8.70% (0.2391 => 0.2599, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.65% (11.6398 => 12.6467, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.82% (0.7426 => 0.8007, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.74% (0.5584 => 0.6016, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 6.76% (11.9555 => 12.7637, std.dev.: 0.0115) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.17% (0.3792 => 0.3950, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.37% (0.2162 => 0.3532, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6535, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.27% (0.5917 => 0.6702, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 7.64% (0.2802 => 0.3016, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6111, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 5.11% (12.0509 => 12.6671, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1696, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-2: 4.12% (1.8057 => 1.8801, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.60% (0.3693 => 0.3826, std.dev.: 0.0044) SingleSource/Benchmarks/Dhrystone/dry: 2.68% (14.0481 => 14.4249, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1994, std.dev.: 0.0023) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.92% (3.1722 => 3.2331, std.dev.: 0.0047) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3069, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2867, std.dev.: 0.0033) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.26% (1.0142 => 1.0270, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5136, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.08% (1.2451 => 1.2585, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5966, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.81% (2.4764 => 2.4316, std.dev.: 0.0075) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.49% (25.4195 => 16.3981, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ary2: -8.91% (0.2402 => 0.2188, std.dev.: 0.0053) MultiSource/Applications/hexxagon/hexxagon: -7.70% (28.1477 => 25.9790, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7752, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.45% (11.2080 => 10.8218, std.dev.: 0.0119) MultiSource/Applications/siod/siod: -2.97% (6.9842 => 6.7766, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5217, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -2.51% (17.2379 => 16.8051, std.dev.: 0.0317) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8596, std.dev.: 0.0112) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5757, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4955, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.32% (5.7935 => 5.7168, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0423, std.dev.: 0.0035) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.06% (3.3991 => 3.3632, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 23 23:34:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 24 Oct 2012 01:34:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121024063452.DB7D92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5155?compare_to=5151&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5155, Order: 166546, Start Time: 2012-10-24 05:16:22, End Time: 2012-10-24 06:36:56 To: 5151, Order: 166540, Start Time: 2012-10-24 03:26:06, End Time: 2012-10-24 04:46:45 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (5 on baseline) Performance Regressions: 0 (197 on baseline) Performance Improvements: 1 (46 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 88 (14 on baseline) Unchanged Tests: 953 (644 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/JM/lencod/lencod: -1.11% (24.4757 => 24.2028, std.dev.: 0.0112) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.22% (0.6299 => 0.6285, std.dev.: 0.0037) MultiSource/Applications/SPASS/SPASS: -0.38% (17.3268 => 17.2613, std.dev.: 0.0133) MultiSource/Applications/kimwitu++/kc: -0.34% (15.7136 => 15.6605, std.dev.: 0.0164) MultiSource/Benchmarks/Bullet/bullet: -0.29% (56.3081 => 56.1435, std.dev.: 0.0418) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.01% (0.0494 => 0.0489) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.01% (0.0496 => 0.0491) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.86% (0.0463 => 0.0459) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.86% (0.0464 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.88% (0.0452 => 0.0448) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.88% (0.0453 => 0.0449) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.90% (0.0445 => 0.0441) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.12% (0.0447 => 0.0442, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.86% (0.0464 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.86% (0.0464 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.09% (0.0458 => 0.0453, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.66% (0.0458 => 0.0455, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.89% (0.0448 => 0.0444, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.67% (0.0448 => 0.0445, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.88% (0.0455 => 0.0451, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.88% (0.0456 => 0.0452, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.86% (0.0466 => 0.0462) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.07% (0.0468 => 0.0463, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.68% (0.0441 => 0.0438, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.90% (0.0443 => 0.0439, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.88% (0.0454 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.88% (0.0456 => 0.0452) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.90% (0.0446 => 0.0442, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.89% (0.0447 => 0.0443, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.92% (0.0437 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.68% (0.0438 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.69% (0.0437 => 0.0434, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.91% (0.0438 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.05% (0.0474 => 0.0469, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.84% (0.0475 => 0.0471, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -1.15% (0.0436 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -1.14% (0.0437 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.46% (0.0436 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.68% (0.0438 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.68% (0.0444 => 0.0441) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.45% (0.0445 => 0.0443) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.31% (1.5066 => 1.5020, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.42% (8.3154 => 8.2801, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.43% (0.6947 => 0.6917, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1437 => 0.1437, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.50% (0.2132 => 0.2164, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.23% (63.2438 => 56.1435, std.dev.: 0.0418) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/MallocBench/gs/gs: 13.27% (4.1105 => 4.6561, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.60% (3.4629 => 5.8384, std.dev.: 0.0040) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13520.14% (0.0720 => 9.8065, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049900.00% (0.0001 => 10.0500, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 69.14% (0.0256 => 0.0433, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 64.60% (0.2554 => 0.4204, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 51.65% (10.3673 => 15.7224, std.dev.: 0.0180) SingleSource/Regression/C/sumarraymalloc: 50.62% (0.0243 => 0.0366, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/factor: 47.30% (0.0296 => 0.0436, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 44.28% (0.0271 => 0.0391, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.19% (1.5859 => 2.2391, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/richards_benchmark: 38.53% (0.1622 => 0.2247, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/distray/distray: 37.41% (0.1056 => 0.1451, std.dev.: 0.0029) SingleSource/UnitTests/vla: 33.24% (0.0355 => 0.0473) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.39% (2.2024 => 2.8716, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 28.02% (0.1463 => 0.1873, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 24.05% (0.1655 => 0.2053, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 23.98% (0.0834 => 0.1034, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.52% (0.1566 => 0.1903, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 21.09% (0.1432 => 0.1734, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/ReedSolomon: 21.08% (0.2049 => 0.2481, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.25% (7.0540 => 8.4826, std.dev.: 0.0090) MultiSource/Benchmarks/FreeBench/pifft/pifft: 20.04% (2.2022 => 2.6435, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 18.91% (0.1555 => 0.1849, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.83% (0.0871 => 0.1035, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 18.37% (0.5105 => 0.6043, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.83% (0.6675 => 0.7865, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 17.43% (0.1440 => 0.1691, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.20% (0.1029 => 0.1206, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.87% (1.3050 => 1.5252, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/tsp/tsp: 16.85% (0.1175 => 0.1373, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: 16.77% (0.0626 => 0.0731, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 16.70% (0.1695 => 0.1978, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.64% (0.2271 => 0.2649, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 16.64% (3.3354 => 3.8903, std.dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.53% (0.4615 => 0.5378, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.52% (0.0793 => 0.0924, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.51% (0.8172 => 0.9521, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/mst/mst: 16.42% (0.1163 => 0.1354, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.28% (0.3121 => 0.3629, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.03% (0.0886 => 0.1028, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 16.01% (0.1337 => 0.1551, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.91% (0.0842 => 0.0976, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.76% (0.5020 => 0.5811, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/oourafft: 15.75% (0.3282 => 0.3799, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.72% (1.5415 => 1.7838, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 15.70% (0.4879 => 0.5645, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.50% (0.1032 => 0.1192, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 15.40% (0.0818 => 0.0944, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 15.35% (0.7115 => 0.8207, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.30% (0.1510 => 0.1741, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.26% (0.0675 => 0.0778, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.21% (0.1940 => 0.2235, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 15.18% (0.0672 => 0.0774, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 15.09% (0.3109 => 0.3578, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.96% (0.9765 => 1.1226, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.95% (0.1117 => 0.1284, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.88% (1.7609 => 2.0230, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.81% (0.2107 => 0.2419, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.81% (0.0770 => 0.0884, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 14.79% (1.1642 => 1.3364, std.dev.: 0.0059) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 14.76% (0.3177 => 0.3646, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 14.69% (0.1906 => 0.2186, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.68% (0.0838 => 0.0961, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.62% (0.2065 => 0.2367, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 14.62% (10.4361 => 11.9622, std.dev.: 0.0161) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.61% (0.0746 => 0.0855) MultiSource/Benchmarks/McCat/18-imp/imp: 14.61% (0.3423 => 0.3923, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 14.60% (8.1363 => 9.3243, std.dev.: 0.0056) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.58% (4.2646 => 4.8863, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.56% (0.1236 => 0.1416, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.54% (0.2758 => 0.3159, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/exptree: 14.37% (0.0814 => 0.0931, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 14.34% (9.4845 => 10.8443, std.dev.: 0.0187) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.27% (0.1584 => 0.1810, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 14.26% (0.1438 => 0.1643, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 14.25% (0.1151 => 0.1315, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 14.25% (0.0730 => 0.0834, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 14.23% (0.7835 => 0.8950, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.20% (0.5860 => 0.6692, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.15% (0.0933 => 0.1065, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.14% (0.6450 => 0.7362, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.13% (0.5981 => 0.6826, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.04% (0.1125 => 0.1283, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.04% (0.0798 => 0.0910, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.96% (0.2700 => 0.3077, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.94% (0.1062 => 0.1210, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.81% (0.1695 => 0.1929, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.75% (1.4186 => 1.6136, std.dev.: 0.0012) SingleSource/UnitTests/SignlessTypes/rem: 13.72% (0.1144 => 0.1301, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.64% (0.0770 => 0.0875, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 13.49% (5.7591 => 6.5362, std.dev.: 0.0049) MultiSource/Applications/treecc/treecc: 13.49% (2.0273 => 2.3008, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: 13.41% (0.1268 => 0.1438, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 13.30% (1.1840 => 1.3415, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.26% (0.8067 => 0.9137, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 13.26% (4.9449 => 5.6005, std.dev.: 0.0041) MultiSource/Applications/lambda-0_1_3/lambda: 13.25% (0.7433 => 0.8418, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.16% (5.0018 => 5.6601, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.00% (0.5569 => 0.6293, std.dev.: 0.0045) MultiSource/Applications/lua/lua: 13.00% (3.8723 => 4.3756, std.dev.: 0.0029) MultiSource/Benchmarks/sim/sim: 12.99% (0.3387 => 0.3827, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 12.89% (1.0722 => 1.2104, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.86% (0.1330 => 0.1501, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.86% (7.9617 => 8.9853, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.82% (0.3307 => 0.3731, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.81% (0.0929 => 0.1048, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.80% (0.1625 => 0.1833, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: 12.75% (0.4299 => 0.4847, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.58% (1.1861 => 1.3353, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: 12.48% (0.3092 => 0.3478, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.29% (0.2603 => 0.2923, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.11% (0.8101 => 0.9082, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/09-vor/vor: 12.11% (0.3180 => 0.3565, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.09% (0.2266 => 0.2540, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.06% (0.3441 => 0.3856, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/football/football: 11.96% (0.8921 => 0.9988, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 11.71% (1.5603 => 1.7430, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 11.68% (0.6456 => 0.7210, std.dev.: 0.0131) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.46% (0.1143 => 0.1274) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.26% (1.1194 => 1.2455, std.dev.: 0.0119) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.21% (0.1892 => 0.2104, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.81% (0.3543 => 0.3926, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 10.61% (0.4289 => 0.4744, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-4: 10.50% (0.3543 => 0.3915, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 10.43% (0.4620 => 0.5102, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 10.42% (0.3473 => 0.3835, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/parameter-passing: 10.34% (0.3927 => 0.4333, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 10.34% (2.2969 => 2.5343, std.dev.: 0.0040) MultiSource/Applications/JM/lencod/lencod: 10.33% (21.9371 => 24.2028, std.dev.: 0.0112) SingleSource/UnitTests/ObjC/exceptions: 10.32% (0.3828 => 0.4223, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.31% (0.3694 => 0.4075, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.25% (0.1044 => 0.1151, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.22% (0.3561 => 0.3925, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-3: 10.21% (0.3516 => 0.3875, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.18% (0.3497 => 0.3853, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.11% (0.3886 => 0.4279, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.09% (0.3865 => 0.4255, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 9.94% (0.3422 => 0.3762, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.93% (0.3826 => 0.4206, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.85% (0.4203 => 0.4617, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.79% (0.4636 => 0.5090, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 9.45% (0.3684 => 0.4032, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.33% (0.4103 => 0.4486, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 9.31% (0.4048 => 0.4425, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.94% (0.6030 => 0.6569, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.93% (0.3427 => 0.3733, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.89% (0.2430 => 0.2646, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 8.88% (0.3603 => 0.3923, std.dev.: 0.0034) SingleSource/UnitTests/ObjC++/Hello: 8.76% (0.5925 => 0.6444, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: 8.64% (17.1811 => 18.6647, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.27% (3.8922 => 4.2139, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 8.26% (0.7326 => 0.7931, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.13% (0.2891 => 0.3126, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.06% (14.3668 => 15.5245, std.dev.: 0.0055) SingleSource/Regression/C++/ofstream_ctor: 8.06% (0.2905 => 0.3139, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.00% (0.3650 => 0.3942, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.00% (0.4064 => 0.4389, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 7.88% (0.3098 => 0.3342, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 7.77% (0.2831 => 0.3051, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 7.74% (0.2725 => 0.2936, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 7.68% (0.3283 => 0.3535, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.62% (0.2756 => 0.2966, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.59% (0.2872 => 0.3090, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 7.58% (0.3232 => 0.3477, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.56% (2.0665 => 2.2227, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.56% (0.3162 => 0.3401, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.49% (0.3136 => 0.3371, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.41% (0.2793 => 0.3000, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 7.31% (0.3052 => 0.3275, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.30% (0.2877 => 0.3087, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 7.28% (0.2871 => 0.3080, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.22% (0.2714 => 0.2910, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 7.22% (0.3379 => 0.3623, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 7.17% (0.2802 => 0.3003, std.dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 6.64% (1.2842 => 1.3695, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/objinst: 6.13% (0.3131 => 0.3323, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.53% (0.3935 => 0.4074, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.70% (0.3817 => 0.3920, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1726, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.51% (0.9957 => 1.1302, std.dev.: 0.0133) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.89% (1.1396 => 1.2523, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3680, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.64% (2.8904 => 3.0824, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 3.84% (1.9405 => 2.0151, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.63% (0.3987 => 0.4092, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.52% (4.2280 => 4.3346, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.00% (3.6395 => 3.7124, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/bisort/bisort: 1.76% (0.8333 => 0.8480, std.dev.: 0.0012) MultiSource/Applications/aha/aha: 1.51% (3.1595 => 3.2073, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.39% (2.6546 => 2.6914, std.dev.: 0.0044) MultiSource/Applications/viterbi/viterbi: 1.24% (4.4649 => 4.5204, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.99% (6.6874 => 0.1345, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -77.24% (0.8651 => 0.1969, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.06% (5.2763 => 3.3210, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.13% (5.3855 => 3.7629, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -29.52% (5.3526 => 3.7724, std.dev.: 0.0023) SingleSource/UnitTests/Vector/constpool: -9.42% (54.1659 => 49.0618, std.dev.: 0.0101) MultiSource/Applications/ClamAV/clamscan: -2.88% (22.1758 => 21.5363, std.dev.: 0.0150) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -52.87% (8.0499 => 3.7937, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.42% (1.1492 => 0.7651, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4751, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4248, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.53% (0.0998 => 0.0853, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.69% (1.2258 => 1.0702, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -12.36% (1.2373 => 1.0844, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/mandel-2: -10.99% (1.5373 => 1.3684, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.38% (19.9488 => 18.2773, std.dev.: 0.0741) MultiSource/Benchmarks/FreeBench/mason/mason: -7.68% (0.2161 => 0.1995, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.11% (1.8329 => 1.7026, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.64% (1.9577 => 1.8473, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.16% (1.6805 => 1.5938, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.71% (1.5835 => 1.5089, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.32% (8.1563 => 7.8041, std.dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.62% (3.2827 => 3.1638, std.dev.: 0.0074) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8776, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5034, std.dev.: 0.0031) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.97% (0.4808 => 0.4665, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -2.17% (4.6441 => 4.5431, std.dev.: 0.0017) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.76% (10.2830 => 10.1018, std.dev.: 0.0104) SingleSource/UnitTests/Vector/multiplies: -1.73% (2.5528 => 2.5087, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6822, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4222, std.dev.: 0.0081) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2879, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8585, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/lists: -1.00% (6.2999 => 6.2368, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 20.20% (0.5229 => 0.6285, std.dev.: 0.0037) MultiSource/Applications/SPASS/SPASS: 15.16% (14.9895 => 17.2613, std.dev.: 0.0133) MultiSource/Applications/kimwitu++/kc: 10.63% (14.1553 => 15.6605, std.dev.: 0.0164) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 35.95% (1.1048 => 1.5020, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 15.67% (7.1582 => 8.2801, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.17% (0.6222 => 0.6917, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.23% (0.1485 => 0.1437, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.27% (0.2116 => 0.2164, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 23 23:36:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 24 Oct 2012 01:36:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121024063607.D1D4E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5156?compare_to=5152&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5156, Order: 166546, Start Time: 2012-10-24 05:13:33, End Time: 2012-10-24 06:38:12 To: 5152, Order: 166540, Start Time: 2012-10-24 03:26:26, End Time: 2012-10-24 04:50:55 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (185 on baseline) Unchanged Tests: 1042 (852 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.86% (54.5751 => 56.6820, std.dev.: 0.0112) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.82% (2.0478 => 2.1056, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/hash2: 2.26% (3.1932 => 3.2655, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: 2.25% (7.4937 => 7.6624, std.dev.: 0.0125) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.29% (0.1431 => 0.1298, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.43% (0.3821 => 0.3499, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/BoolLiteralTest: -7.96% (0.3834 => 0.3529, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -7.95% (0.3812 => 0.3509, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.93% (0.3884 => 0.3576, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -7.86% (0.3880 => 0.3575, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -7.86% (0.3831 => 0.3530, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -7.82% (2.4924 => 2.2974, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.79% (0.3891 => 0.3588, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -7.77% (0.3848 => 0.3549, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -7.73% (0.3896 => 0.3595, std.dev.: 0.0067) SingleSource/UnitTests/ObjC/exceptions: -7.61% (0.4176 => 0.3858, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -7.61% (0.4033 => 0.3726, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.55% (22.4056 => 20.7132, std.dev.: 0.0110) SingleSource/UnitTests/ObjC/parameter-passing: -7.52% (0.4280 => 0.3958, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -7.38% (0.4199 => 0.3889, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -7.36% (0.3357 => 0.3110, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.33% (0.9542 => 0.8843, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -7.18% (3.5339 => 3.2803, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.03% (0.3142 => 0.2921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -6.99% (0.2160 => 0.2009, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -6.96% (16.1920 => 15.0646, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/football/football: -6.93% (0.9179 => 0.8543, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -6.93% (0.1761 => 0.1639, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -6.92% (0.1879 => 0.1749, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.91% (0.4151 => 0.3864, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: -6.87% (1.1530 => 1.0738, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -6.85% (9.2283 => 8.5959, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.85% (0.1796 => 0.1673, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.84% (5.4682 => 5.0942, std.dev.: 0.0070) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.82% (6.7716 => 6.3098, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.82% (0.1584 => 0.1476, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -6.81% (7.0961 => 6.6126, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.81% (0.3658 => 0.3409, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -6.81% (4.3330 => 4.0381, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.79% (1.3722 => 1.2790, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.75% (0.2428 => 0.2264, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.69% (1.6474 => 1.5372, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/hash2: -6.69% (0.4861 => 0.4536, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.68% (0.6736 => 0.6286, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.67% (0.2355 => 0.2198, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.66% (0.9852 => 0.9196, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -6.66% (1.2515 => 1.1682, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.65% (1.0544 => 0.9843, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.64% (0.2695 => 0.2516, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -6.60% (0.2985 => 0.2788, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -6.59% (0.7447 => 0.6956, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.59% (0.4813 => 0.4496, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/08-main/main: -6.58% (0.2659 => 0.2484, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -6.57% (0.9557 => 0.8929, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.56% (4.0323 => 3.7677, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: -6.56% (0.5168 => 0.4829, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.55% (0.6484 => 0.6059, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.55% (0.3849 => 0.3597, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -6.53% (1.3148 => 1.2290, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.52% (1.2784 => 1.1951, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.51% (0.2548 => 0.2382, std.dev.: 0.0006) MultiSource/Applications/lua/lua: -6.49% (4.0594 => 3.7959, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.49% (4.8161 => 4.5035, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.49% (1.4642 => 1.3692, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.48% (0.7919 => 0.7406, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.47% (4.5069 => 4.2151, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: -6.46% (15.5079 => 14.5066, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/hash: -6.45% (0.4524 => 0.4232, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.45% (1.6364 => 1.5308, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -6.45% (1.1450 => 1.0712, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.41% (2.2587 => 2.1140, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: -6.40% (0.4515 => 0.4226, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.38% (0.3025 => 0.2832, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.37% (1.2300 => 1.1516, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.37% (4.8802 => 4.5694, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -6.37% (2.4021 => 2.2492, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.35% (0.1716 => 0.1607, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -6.35% (1.3864 => 1.2984, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -6.34% (0.3059 => 0.2865, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: -6.34% (0.3581 => 0.3354, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -6.30% (0.3491 => 0.3271, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -6.29% (34.0927 => 31.9471, std.dev.: 0.0102) MultiSource/Benchmarks/sim/sim: -6.28% (0.3406 => 0.3192, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.28% (0.6293 => 0.5898, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -6.27% (0.3446 => 0.3230, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: -6.26% (0.3194 => 0.2994, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.26% (0.3931 => 0.3685, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.25% (0.4083 => 0.3828, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -6.23% (0.7524 => 0.7055, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.23% (2.1713 => 2.0360, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: -6.23% (0.1621 => 0.1520, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.23% (0.5329 => 0.4997, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -6.22% (15.2527 => 14.3033, std.dev.: 0.0147) SingleSource/Benchmarks/Misc-C++/bigfib: -6.22% (0.6750 => 0.6330, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.19% (0.6304 => 0.5914, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.18% (0.6681 => 0.6268, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -6.18% (0.4321 => 0.4054, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.18% (0.6395 => 0.6000, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: -6.17% (0.4248 => 0.3986, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -6.17% (0.2871 => 0.2694, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.16% (14.2083 => 13.3334, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/strcat: -6.16% (0.2989 => 0.2805, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: -6.16% (3.5154 => 3.2990, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.15% (0.7021 => 0.6589, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.15% (1.2210 => 1.1459, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -6.14% (0.3323 => 0.3119, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -6.13% (0.3621 => 0.3399, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -6.13% (0.3394 => 0.3186, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.12% (0.3837 => 0.3602, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.11% (0.5859 => 0.5501, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.11% (0.5925 => 0.5563, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.10% (0.4916 => 0.4616, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.10% (0.5591 => 0.5250, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -6.09% (0.7779 => 0.7305, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -6.09% (0.3481 => 0.3269, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.09% (0.3252 => 0.3054, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.08% (0.6297 => 0.5914, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -6.08% (0.6676 => 0.6270, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.07% (1.2221 => 1.1479, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.07% (0.5802 => 0.5450, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.05% (0.6194 => 0.5819, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -6.05% (0.5705 => 0.5360, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -6.04% (0.6667 => 0.6264, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.04% (0.5857 => 0.5503, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.04% (0.6189 => 0.5815, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -6.04% (0.6395 => 0.6009, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.02% (0.6260 => 0.5883, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.02% (0.8521 => 0.8008, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.02% (0.5999 => 0.5638, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/except: -6.01% (0.3026 => 0.2844, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -6.01% (17.1032 => 16.0751, std.dev.: 0.0229) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -6.01% (8.0126 => 7.5311, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -6.01% (0.5575 => 0.5240, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.00% (0.5863 => 0.5511, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: -6.00% (0.2999 => 0.2819, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.00% (0.2385 => 0.2242, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -5.99% (0.3255 => 0.3060, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.97% (0.5478 => 0.5151, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.97% (0.2933 => 0.2758, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.96% (0.6052 => 0.5691, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.96% (0.5805 => 0.5459, std.dev.: 0.0060) SingleSource/UnitTests/ObjC++/Hello: -5.96% (0.6347 => 0.5969, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -5.95% (2.1401 => 2.0127, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.95% (0.5567 => 0.5236, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.94% (0.7339 => 0.6903, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.94% (0.6230 => 0.5860, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -5.91% (18.2933 => 17.2127, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.90% (0.6033 => 0.5677, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: -5.90% (0.3205 => 0.3016, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -5.90% (0.2849 => 0.2681, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.89% (0.5941 => 0.5591, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sieve: -5.89% (0.3788 => 0.3565, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.88% (0.2278 => 0.2144, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.87% (0.4427 => 0.4167, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -5.87% (0.3867 => 0.3640, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.87% (0.3016 => 0.2839, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.86% (0.6446 => 0.6068, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: -5.85% (0.2939 => 0.2767, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.82% (0.5569 => 0.5245, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.80% (0.5570 => 0.5247, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: -5.79% (0.6441 => 0.6068, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.78% (0.3319 => 0.3127, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.76% (0.5456 => 0.5142, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.75% (0.5581 => 0.5260, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.75% (0.6660 => 0.6277, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.75% (0.6440 => 0.6070, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: -5.72% (0.3271 => 0.3084, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.71% (0.7198 => 0.6787, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.68% (0.5849 => 0.5517, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.64% (0.5688 => 0.5367, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: -5.58% (0.8418 => 0.7948, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.56% (0.2106 => 0.1989, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -5.55% (0.7982 => 0.7539, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.46% (0.3483 => 0.3293, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.15% (0.2001 => 0.1898, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.97% (0.9077 => 0.8626, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: -4.74% (1.5610 => 1.4870, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.61% (0.2277 => 0.2172, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -4.52% (5.0226 => 4.7955, std.dev.: 0.0116) SingleSource/UnitTests/Vector/constpool: -3.09% (20.7746 => 20.1327, std.dev.: 0.0285) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7534, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/richards_benchmark: -8.73% (1.2842 => 1.1721, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.92% (1.7753 => 1.7057, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.68% (2.2633 => 2.1800, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.92% (1.3096 => 1.2713, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4700, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.02% (3.2107 => 3.1781, std.dev.: 0.0003) Report Time: 1.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 24 00:32:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 24 Oct 2012 02:32:49 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121024073249.3D6A02A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/5157?compare_to=5153&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5157, Order: 166546, Start Time: 2012-10-24 06:11:18, End Time: 2012-10-24 07:34:55 To: 5153, Order: 166544, Start Time: 2012-10-24 04:30:34, End Time: 2012-10-24 05:54:24 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 4 (46 on baseline) Performance Improvements: 2 (5 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 969 (923 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.46% (0.8787 => 0.9003, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.88% (1.0021 => 1.0209, std.dev.: 0.0030) MultiSource/Applications/SIBsim4/SIBsim4: 1.43% (1.2669 => 1.2850, std.dev.: 0.0070) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.17% (6.9418 => 7.0924, std.dev.: 0.0401) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -5.09% (1.0602 => 1.0062, std.dev.: 0.0130) SingleSource/Benchmarks/CoyoteBench/lpbench: -2.50% (3.9994 => 3.8993, std.dev.: 0.0120) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.09% (16.6304 => 16.6158, std.dev.: 0.3287) MultiSource/Applications/obsequi/Obsequi: 0.45% (1.0559 => 1.0606, std.dev.: 0.0154) MultiSource/Applications/sqlite3/sqlite3: 1.54% (0.6359 => 0.6457, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: 2.11% (0.1849 => 0.1888, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.86% (0.1715 => 0.1666, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.76% (0.3266 => 0.3176, std.dev.: 0.0082) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.97% (0.2475 => 0.2451, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.16% (0.3352 => 0.3313, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.16% (0.2361 => 0.2412, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: -0.50% (0.6009 => 0.5979, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -15.70% (0.0484 => 0.0408, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.54% (0.3318 => 0.3300, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -0.60% (0.1997 => 0.1985, std.dev.: 0.0006) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0245 => 0.0245, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -33.33% (0.0219 => 0.0146, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.70% (0.0428 => 0.0425, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.16% (0.0332 => 0.0285, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0314 => 0.0314, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.47% (0.0425 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0203 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -0.92% (0.0218 => 0.0216, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -20.66% (0.0334 => 0.0265, std.dev.: 0.0042) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001) MultiSource/Applications/ClamAV/clamscan: -0.61% (0.1482 => 0.1473, std.dev.: 0.0030) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.03% (1.1279 => 1.1282, std.dev.: 0.0117) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.87% (0.1500 => 0.1442, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.62% (0.4070 => 0.4004, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.04% (0.1419 => 0.1390, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.81% (0.0619 => 0.0624, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -33.70% (0.0276 => 0.0183, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.83% (0.0530 => 0.0545, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.60% (1.1430 => 1.1499, std.dev.: 0.0084) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.77% (0.0031 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.89% (0.0630 => 0.0574, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.12% (0.0267 => 0.0256, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.09% (0.8031 => 0.8024, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 7.46% (0.0067 => 0.0072, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.06% (2.1832 => 1.6580, std.dev.: 0.0051) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.94% (0.0810 => 0.0931, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.75% (0.1425 => 0.1564, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.76% (0.1983 => 0.2117, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.27% (0.2279 => 0.2422, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.82% (0.4847 => 0.5129, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.62% (0.6010 => 0.6348, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.62% (0.7473 => 0.7893, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.33% (0.2519 => 0.2628, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.19% (1.1606 => 1.2092, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.14% (0.9435 => 0.9826, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.66% (0.3003 => 0.3113, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.52% (0.8697 => 0.9003, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.18% (1.4479 => 1.4939, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.04% (0.9908 => 1.0209, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.79% (0.9074 => 0.9327, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.76% (6.6074 => 6.7896, std.dev.: 0.0528) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.75% (0.8050 => 0.8271, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.70% (4.1763 => 4.2892, std.dev.: 0.0218) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.45% (0.4783 => 0.4900, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.42% (0.9688 => 0.9922, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.39% (0.8317 => 0.8516, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.33% (4.4873 => 4.5919, std.dev.: 0.0391) MultiSource/Applications/ClamAV/clamscan: 2.28% (14.7684 => 15.1058, std.dev.: 0.0749) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.27% (0.8712 => 0.8910, std.dev.: 0.0060) MultiSource/Applications/SIBsim4/SIBsim4: 2.24% (1.2568 => 1.2850, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.23% (0.9039 => 0.9241, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.20% (0.8177 => 0.8357, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.09% (0.8316 => 0.8490, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.04% (0.8656 => 0.8833, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.92% (0.8338 => 0.8498, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.77% (0.6943 => 0.7066, std.dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 1.72% (6.7320 => 6.8480, std.dev.: 0.0407) MultiSource/Benchmarks/mafft/pairlocalalign: 1.55% (8.6247 => 8.7582, std.dev.: 0.0184) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.46% (0.8995 => 0.9126, std.dev.: 0.0045) MultiSource/Applications/SPASS/SPASS: 1.31% (14.2605 => 14.4470, std.dev.: 0.0571) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.18% (2.1401 => 2.1654, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.08% (1.2602 => 1.2738, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.68% (1.5795 => 2.5063, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.79% (0.3186 => 0.3466, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.38% (1.1857 => 1.2851, std.dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 5.97% (63.1822 => 66.9531, std.dev.: 0.0387) SingleSource/Benchmarks/Misc/ReedSolomon: 2.78% (8.5322 => 8.7690, std.dev.: 0.0079) MultiSource/Applications/siod/siod: 2.67% (3.6643 => 3.7620, std.dev.: 0.0163) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.15% (2.4490 => 2.5017, std.dev.: 0.0143) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.48% (4.8362 => 4.9080, std.dev.: 0.0184) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.39% (4.3552 => 4.4159, std.dev.: 0.0214) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.88% (0.3269 => 0.2946, std.dev.: 0.0048) MultiSource/Applications/lua/lua: -4.97% (29.8330 => 28.3513, std.dev.: 0.3074) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -1.67% (7.2130 => 7.0924, std.dev.: 0.0401) SingleSource/Benchmarks/Shootout-C++/hash2: -1.43% (3.4237 => 3.3747, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.19% (3.3479 => 3.3080, std.dev.: 0.0015) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 1.03% (16.4461 => 16.6158, std.dev.: 0.3287) MultiSource/Applications/obsequi/Obsequi: 3.35% (1.0262 => 1.0606, std.dev.: 0.0154) MultiSource/Applications/sqlite3/sqlite3: 1.97% (0.6332 => 0.6457, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: 3.11% (0.1831 => 0.1888, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 6.86% (0.1559 => 0.1666, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.70% (0.3123 => 0.3176, std.dev.: 0.0082) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.49% (0.2463 => 0.2451, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.93% (0.3344 => 0.3313, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (0.2364 => 0.2412, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: -0.52% (0.6010 => 0.5979, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -4.90% (0.0429 => 0.0408, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.04% (0.3266 => 0.3300, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 0.81% (0.1969 => 0.1985, std.dev.: 0.0006) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 9.38% (0.0224 => 0.0245, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 18.70% (0.0123 => 0.0146, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.17% (0.0408 => 0.0425, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 12.20% (0.0254 => 0.0285, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 20.00% (0.0180 => 0.0216, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: 15.22% (0.0230 => 0.0265, std.dev.: 0.0042) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001) MultiSource/Applications/ClamAV/clamscan: 2.43% (0.1438 => 0.1473, std.dev.: 0.0030) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.41% (1.1329 => 1.1282, std.dev.: 0.0117) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.37% (0.1462 => 0.1442, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.84% (0.4164 => 0.4004, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.53% (0.1369 => 0.1390, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.65% (0.0641 => 0.0624, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -6.15% (0.0195 => 0.0183, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.71% (0.0578 => 0.0545, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.54% (1.1437 => 1.1499, std.dev.: 0.0084) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.45% (0.0627 => 0.0574, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 42.22% (0.0180 => 0.0256, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.09% (0.8017 => 0.8024, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 16.13% (0.0062 => 0.0072, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 24 02:11:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 24 Oct 2012 04:11:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121024091119.02FAA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5158?compare_to=5156&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5158, Order: 166547, Start Time: 2012-10-24 07:48:31, End Time: 2012-10-24 09:13:21 To: 5156, Order: 166546, Start Time: 2012-10-24 05:13:33, End Time: 2012-10-24 06:38:12 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (184 on baseline) Unchanged Tests: 1042 (854 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1014, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: 2.44% (7.4937 => 7.6767, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/hash2: 2.16% (3.1932 => 3.2622, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.22% (0.1431 => 0.1299, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.45% (0.3821 => 0.3498, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -7.84% (0.3812 => 0.3513, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.83% (0.3884 => 0.3580, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-2: -7.80% (0.3831 => 0.3532, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -7.80% (2.4924 => 2.2981, std.dev.: 0.0077) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.74% (0.3891 => 0.3590, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -7.69% (0.3848 => 0.3552, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/synchronized: -7.67% (0.3896 => 0.3597, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -7.63% (0.3880 => 0.3584, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/for-in: -7.56% (0.4033 => 0.3728, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -7.54% (0.4176 => 0.3861, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.54% (22.4056 => 20.7163, std.dev.: 0.0187) SingleSource/UnitTests/ObjC/parameter-passing: -7.36% (0.4280 => 0.3965, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -7.36% (0.4199 => 0.3890, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.33% (0.9542 => 0.8843, std.dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: -7.15% (0.3357 => 0.3117, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -7.01% (3.5339 => 3.2863, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: -6.99% (0.2160 => 0.2009, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.97% (0.3142 => 0.2923, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.93% (5.4682 => 5.0894, std.dev.: 0.0079) MultiSource/Applications/JM/lencod/lencod: -6.90% (16.1920 => 15.0750, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.87% (0.4151 => 0.3866, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -6.87% (0.1879 => 0.1750, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.84% (0.2428 => 0.2262, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -6.83% (9.2283 => 8.5977, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/football/football: -6.83% (0.9179 => 0.8552, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: -6.82% (1.1530 => 1.0744, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: -6.81% (7.0961 => 6.6131, std.dev.: 0.0183) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.79% (0.1796 => 0.1674) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.76% (0.1584 => 0.1477, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.73% (1.3722 => 1.2799, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.71% (6.7716 => 6.3173, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: -6.71% (0.4861 => 0.4535, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.67% (0.4813 => 0.4492, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.67% (0.2355 => 0.2198, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -6.64% (0.1761 => 0.1644, std.dev.: 0.0017) MultiSource/Applications/Burg/burg: -6.64% (1.2515 => 1.1684, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.64% (1.0544 => 0.9844, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.61% (0.9852 => 0.9201, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: -6.59% (0.7447 => 0.6956, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.59% (0.6736 => 0.6292, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: -6.58% (4.3330 => 4.0479, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: -6.57% (0.9557 => 0.8929, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.55% (0.3849 => 0.3597, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.54% (4.0323 => 3.7685, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.52% (0.6484 => 0.6061, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.49% (0.2695 => 0.2520, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.48% (0.3658 => 0.3421, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.47% (1.6474 => 1.5408, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -6.47% (0.2659 => 0.2487, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.47% (0.7919 => 0.7407, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: -6.46% (0.5168 => 0.4834, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.46% (1.2784 => 1.1958, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/05-eks/eks: -6.45% (0.4515 => 0.4224, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.44% (1.6364 => 1.5310, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.44% (1.4642 => 1.3699, std.dev.: 0.0008) MultiSource/Applications/lua/lua: -6.43% (4.0594 => 3.7982, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.42% (4.8161 => 4.5071, std.dev.: 0.0074) MultiSource/Applications/SPASS/SPASS: -6.41% (15.5079 => 14.5137, std.dev.: 0.0103) MultiSource/Applications/hexxagon/hexxagon: -6.40% (1.3148 => 1.2306, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.40% (0.2548 => 0.2385, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.39% (4.5069 => 4.2188, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.38% (4.8802 => 4.5688, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/hash: -6.37% (0.4524 => 0.4236, std.dev.: 0.0037) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.35% (0.1716 => 0.1607, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -6.34% (0.3059 => 0.2865, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -6.33% (0.2985 => 0.2796, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -6.33% (2.4021 => 2.2501, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/methcall: -6.31% (0.3025 => 0.2834, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.31% (1.2300 => 1.1524, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.29% (2.2587 => 2.1166, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: -6.28% (0.3581 => 0.3356, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -6.28% (0.3406 => 0.3192, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -6.28% (1.1450 => 1.0731, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: -6.28% (1.3864 => 1.2994, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary3: -6.27% (0.3446 => 0.3230, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.26% (0.6293 => 0.5899, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.26% (0.3931 => 0.3685, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.22% (0.4083 => 0.3829, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.19% (2.1713 => 2.0369, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.17% (0.5329 => 0.5000, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -6.17% (34.0927 => 31.9898, std.dev.: 0.0203) SingleSource/Benchmarks/Shootout-C++/strcat: -6.16% (0.2989 => 0.2805, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.15% (0.3837 => 0.3601, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -6.15% (0.6750 => 0.6335, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -6.14% (0.7524 => 0.7062, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -6.14% (0.3323 => 0.3119, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -6.14% (0.3194 => 0.2998, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: -6.13% (0.3491 => 0.3277, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -6.13% (0.3394 => 0.3186, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: -6.12% (3.5154 => 3.3001, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.12% (0.5591 => 0.5249, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.11% (14.2083 => 13.3396, std.dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -6.11% (0.4321 => 0.4057, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.10% (0.5805 => 0.5451, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.10% (0.5857 => 0.5500, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.09% (0.6681 => 0.6274, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.09% (0.6304 => 0.5920, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.09% (1.2221 => 1.1477, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.08% (0.5859 => 0.5503, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.07% (0.7021 => 0.6595, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.07% (0.6395 => 0.6007, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.07% (0.5802 => 0.5450, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.06% (0.3252 => 0.3055, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -6.05% (15.2527 => 14.3303, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/matrix: -6.02% (0.3255 => 0.3059, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.02% (0.5999 => 0.5638, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -6.01% (0.6667 => 0.6266, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -6.01% (0.5705 => 0.5362, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -6.01% (0.5575 => 0.5240, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.01% (0.5925 => 0.5569, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -6.00% (0.7779 => 0.7312, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: -6.00% (0.4248 => 0.3993, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.00% (1.2210 => 1.1478, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.99% (8.0126 => 7.5324, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/fibo: -5.99% (0.2871 => 0.2699, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: -5.98% (0.3026 => 0.2845, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.98% (0.6189 => 0.5819, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.97% (0.6194 => 0.5824, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.97% (0.6297 => 0.5921, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.96% (0.6052 => 0.5691, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: -5.96% (17.1032 => 16.0832, std.dev.: 0.0228) SingleSource/Benchmarks/Shootout-C++/wc: -5.96% (0.3205 => 0.3014, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.96% (0.2903 => 0.2730, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.95% (0.5478 => 0.5152, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.95% (0.5849 => 0.5501, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: -5.94% (0.3621 => 0.3406, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.94% (0.2999 => 0.2821, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: -5.92% (0.2939 => 0.2765) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.92% (0.4916 => 0.4625, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.91% (0.8521 => 0.8017, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.91% (0.3483 => 0.3277, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.91% (0.2385 => 0.2244, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.90% (0.2933 => 0.2760, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -5.90% (0.2849 => 0.2681, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -5.89% (0.3481 => 0.3276, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.89% (0.7339 => 0.6907, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.88% (0.5863 => 0.5518, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.87% (0.6230 => 0.5864, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.87% (0.6676 => 0.6284, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.87% (0.3016 => 0.2839, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.86% (0.6395 => 0.6020, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: -5.86% (0.3788 => 0.3566, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.85% (0.6260 => 0.5894, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -5.85% (0.6347 => 0.5976, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: -5.84% (2.1401 => 2.0151, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.84% (0.6660 => 0.6271, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.84% (0.5941 => 0.5594, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: -5.83% (18.2933 => 17.2260, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.82% (0.5567 => 0.5243, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.79% (0.2278 => 0.2146, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.79% (0.5456 => 0.5140, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.78% (0.4427 => 0.4171, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.77% (0.6033 => 0.5685, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.76% (0.6446 => 0.6075, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.75% (0.7198 => 0.6784, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.73% (0.6440 => 0.6071, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.73% (0.5569 => 0.5250, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.73% (0.5570 => 0.5251, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.72% (0.3057 => 0.2882, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.72% (0.5581 => 0.5262, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -5.70% (0.6441 => 0.6074, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.66% (0.5688 => 0.5366, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: -5.66% (0.3271 => 0.3086, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.65% (0.2106 => 0.1987, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -5.64% (0.3867 => 0.3649, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.60% (0.3319 => 0.3133, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: -5.42% (0.7982 => 0.7549, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: -5.39% (0.8418 => 0.7964, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.10% (0.2001 => 0.1899, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.94% (0.9077 => 0.8629, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.61% (0.2277 => 0.2172, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -4.61% (1.5610 => 1.4891, std.dev.: 0.0042) MultiSource/Applications/oggenc/oggenc: -4.47% (5.0226 => 4.7982, std.dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -3.17% (20.7746 => 20.1163, std.dev.: 0.0168) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7580, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/richards_benchmark: -8.63% (1.2842 => 1.1734, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.94% (2.2633 => 2.1742, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.90% (1.3096 => 1.2847, std.dev.: 0.0087) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4730, std.dev.: 0.0001) Report Time: 2.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 24 02:13:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 24 Oct 2012 04:13:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121024091330.2E19A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5159?compare_to=5155&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5159, Order: 166547, Start Time: 2012-10-24 07:54:55, End Time: 2012-10-24 09:15:28 To: 5155, Order: 166546, Start Time: 2012-10-24 05:16:22, End Time: 2012-10-24 06:36:56 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (5 on baseline) Performance Regressions: 2 (199 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 88 (14 on baseline) Unchanged Tests: 952 (643 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.36% (54.4692 => 56.2981, std.dev.: 0.1295) MultiSource/Benchmarks/llubenchmark/llu: 3.15% (3.7661 => 3.8846, std.dev.: 0.0152) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.06% (0.6285 => 0.6281, std.dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: 0.01% (17.2613 => 17.2637, std.dev.: 0.0212) MultiSource/Applications/kimwitu++/kc: 0.02% (15.6605 => 15.6637, std.dev.: 0.0215) MultiSource/Benchmarks/Bullet/bullet: -0.03% (56.1435 => 56.1245, std.dev.: 0.0884) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0489 => 0.0489, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0491 => 0.0491, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0459 => 0.0459, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0460 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0448 => 0.0448, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.22% (0.0449 => 0.0448, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0441 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0442 => 0.0442, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0460 => 0.0460, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.22% (0.0460 => 0.0461, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0453 => 0.0453, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0455 => 0.0455, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0444 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0445 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.22% (0.0451 => 0.0450, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0452 => 0.0452) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0462 => 0.0462, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.22% (0.0463 => 0.0464, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0438 => 0.0438, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.23% (0.0439 => 0.0440, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.22% (0.0450 => 0.0451, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.22% (0.0452 => 0.0451, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.23% (0.0442 => 0.0443, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0443 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0433 => 0.0433, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0435 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.23% (0.0434 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0434 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.21% (0.0469 => 0.0470, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0471 => 0.0471, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.23% (0.0431 => 0.0432, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.23% (0.0432 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0434 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0435 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.23% (0.0441 => 0.0442, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.45% (0.0443 => 0.0441, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.17% (1.5020 => 1.5045, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.04% (8.2801 => 8.2832, std.dev.: 0.0151) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.6917 => 0.6917, std.dev.: 0.0029) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1437 => 0.1437, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.09% (0.2164 => 0.2162, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.26% (63.2438 => 56.1245, std.dev.: 0.0884) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/MallocBench/gs/gs: 13.44% (4.1105 => 4.6629, std.dev.: 0.0238) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.69% (3.4629 => 5.8415, std.dev.: 0.0014) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13520.83% (0.0720 => 9.8070, std.dev.: 0.0091) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050700.00% (0.0001 => 10.0508, std.dev.: 0.0011) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 68.75% (0.0256 => 0.0432, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 64.64% (0.2554 => 0.4205, std.dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: 51.82% (10.3673 => 15.7395, std.dev.: 0.0066) SingleSource/Regression/C/sumarraymalloc: 50.62% (0.0243 => 0.0366, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 47.30% (0.0296 => 0.0436, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 44.28% (0.0271 => 0.0391, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.12% (1.5859 => 2.2381, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 38.47% (0.1622 => 0.2246, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 37.31% (0.1056 => 0.1450, std.dev.: 0.0009) SingleSource/UnitTests/vla: 32.96% (0.0355 => 0.0472, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.28% (2.2024 => 2.8693, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/neural/neural: 27.96% (0.1463 => 0.1872, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 26.74% (0.0834 => 0.1057, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 24.05% (0.1655 => 0.2053, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: 21.43% (0.2049 => 0.2488, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.39% (0.1566 => 0.1901, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 21.02% (0.1432 => 0.1733, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.32% (7.0540 => 8.4876, std.dev.: 0.0136) MultiSource/Benchmarks/FreeBench/pifft/pifft: 20.02% (2.2022 => 2.6430, std.dev.: 0.0032) MultiSource/Applications/viterbi/viterbi: 18.97% (0.1555 => 0.1850, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.83% (0.0871 => 0.1035, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 18.53% (0.5105 => 0.6051, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.95% (0.6675 => 0.7873, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 17.36% (0.1440 => 0.1690, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.30% (0.1029 => 0.1207, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/tsp/tsp: 17.02% (0.1175 => 0.1375, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 16.92% (3.3354 => 3.8999, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.92% (0.0798 => 0.0933, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.83% (1.3050 => 1.5246, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/em3d/em3d: 16.70% (0.1695 => 0.1978, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/lists: 16.61% (0.0626 => 0.0730, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.60% (0.2271 => 0.2648, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.50% (0.8172 => 0.9520, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/mst/mst: 16.42% (0.1163 => 0.1354, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.40% (0.4615 => 0.5372, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.39% (0.0793 => 0.0923, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.28% (0.3121 => 0.3629, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 16.01% (0.1337 => 0.1551, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.92% (1.5415 => 1.7869, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.88% (0.5020 => 0.5817, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/oourafft: 15.87% (0.3282 => 0.3803, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.80% (0.0886 => 0.1026, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 15.70% (0.4879 => 0.5645, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.60% (0.1032 => 0.1193, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.55% (0.9765 => 1.1283, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.44% (0.0842 => 0.0972, std.dev.: 0.0023) MultiSource/Applications/minisat/minisat: 15.35% (0.7115 => 0.8207, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/18-imp/imp: 15.31% (0.3423 => 0.3947, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/matrix: 15.28% (0.0818 => 0.0943, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.23% (0.1510 => 0.1740, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.21% (0.1940 => 0.2235, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.11% (0.0675 => 0.0777, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 15.09% (0.3109 => 0.3578, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 15.03% (0.0672 => 0.0773, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.98% (1.7609 => 2.0246, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.95% (0.1117 => 0.1284, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 14.73% (0.3177 => 0.3645, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.71% (0.2107 => 0.2417, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.68% (0.0838 => 0.0961, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.68% (0.0770 => 0.0883, std.dev.: 0.0019) MultiSource/Applications/Burg/burg: 14.66% (1.1642 => 1.3349, std.dev.: 0.0096) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 14.59% (0.1906 => 0.2184, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 14.57% (8.1363 => 9.3215, std.dev.: 0.0116) MultiSource/Applications/JM/ldecod/ldecod: 14.56% (10.4361 => 11.9552, std.dev.: 0.0317) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.53% (4.2646 => 4.8841, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.48% (0.0746 => 0.0854, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 14.46% (0.1438 => 0.1646, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.43% (0.2065 => 0.2363, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.43% (0.2758 => 0.3156, std.dev.: 0.0058) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.39% (0.1584 => 0.1812, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.36% (0.0933 => 0.1067, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 14.27% (9.4845 => 10.8382, std.dev.: 0.0129) MultiSource/Applications/aha/aha: 14.25% (0.1151 => 0.1315, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.24% (0.1236 => 0.1412, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.21% (0.5981 => 0.6831, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.16% (0.5860 => 0.6690, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/exptree: 14.13% (0.0814 => 0.0929, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 14.11% (0.0730 => 0.0833, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.03% (0.6450 => 0.7355, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.00% (0.2700 => 0.3078, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: 13.94% (0.7835 => 0.8927, std.dev.: 0.0106) SingleSource/UnitTests/SignlessTypes/rem: 13.81% (0.1144 => 0.1302) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.76% (1.4186 => 1.6138, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.75% (0.1695 => 0.1928, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.65% (0.1062 => 0.1207, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.64% (0.0770 => 0.0875, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 13.56% (0.1268 => 0.1440, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 13.52% (5.7591 => 6.5378, std.dev.: 0.0030) MultiSource/Applications/treecc/treecc: 13.44% (2.0273 => 2.2997, std.dev.: 0.0052) MultiSource/Applications/lambda-0_1_3/lambda: 13.37% (0.7433 => 0.8427, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 13.35% (4.9449 => 5.6051, std.dev.: 0.0113) MultiSource/Benchmarks/nbench/nbench: 13.34% (1.1840 => 1.3420, std.dev.: 0.0072) MultiSource/Benchmarks/sim/sim: 13.23% (0.3387 => 0.3835, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.23% (0.8067 => 0.9134, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.21% (0.3307 => 0.3744, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.12% (5.0018 => 5.6578, std.dev.: 0.0112) MultiSource/Applications/lua/lua: 12.99% (3.8723 => 4.3753, std.dev.: 0.0133) MultiSource/Applications/lemon/lemon: 12.94% (1.0722 => 1.2109, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.91% (7.9617 => 8.9898, std.dev.: 0.0190) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.89% (0.5569 => 0.6287, std.dev.: 0.0050) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.86% (0.1330 => 0.1501, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.81% (0.0929 => 0.1048, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 12.79% (0.4299 => 0.4849, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.74% (0.1625 => 0.1832, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.52% (1.1861 => 1.3346, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/bh/bh: 12.39% (0.3092 => 0.3475, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 12.36% (0.1125 => 0.1264, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.29% (0.2603 => 0.2923, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 12.20% (0.3180 => 0.3568, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.14% (0.2266 => 0.2541, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.06% (0.3441 => 0.3856, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.89% (0.8101 => 0.9064, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 11.86% (0.8921 => 0.9979, std.dev.: 0.0030) MultiSource/Applications/hbd/hbd: 11.82% (1.5603 => 1.7448, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/bigfib: 11.76% (0.6456 => 0.7215, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.37% (0.1143 => 0.1273, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.21% (0.1892 => 0.2104, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.19% (1.1194 => 1.2447, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 10.54% (0.4289 => 0.4741, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash2: 10.50% (0.4620 => 0.5105, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.42% (0.3927 => 0.4336, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 10.41% (2.2969 => 2.5360, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/trivial-interface: 10.34% (0.3473 => 0.3832, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 10.32% (21.9371 => 24.2009, std.dev.: 0.0350) SingleSource/UnitTests/ObjC/synchronized: 10.25% (0.3561 => 0.3926, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.21% (0.3828 => 0.4219, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 10.21% (0.3497 => 0.3854, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.19% (0.3543 => 0.3904, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.19% (0.3543 => 0.3904, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 10.12% (0.3694 => 0.4068, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.10% (0.3516 => 0.3871, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.06% (0.3886 => 0.4277, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.06% (0.1044 => 0.1149, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.04% (0.3865 => 0.4253, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.90% (0.4203 => 0.4619, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 9.79% (0.3422 => 0.3757, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.72% (0.3826 => 0.4198, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.48% (0.4103 => 0.4492, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists1: 9.39% (0.3684 => 0.4030, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 9.36% (0.4048 => 0.4427, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 9.19% (0.3603 => 0.3934, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.17% (0.4636 => 0.5061, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.10% (0.3427 => 0.3739, std.dev.: 0.0057) SingleSource/UnitTests/ObjC++/property-reference-object: 9.02% (0.6030 => 0.6574, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.97% (0.2430 => 0.2648, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: 8.78% (0.5925 => 0.6445, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 8.66% (17.1811 => 18.6698, std.dev.: 0.0187) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.34% (0.2891 => 0.3132, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.29% (0.7326 => 0.7933, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.25% (3.8922 => 4.2133, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.08% (14.3668 => 15.5273, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.07% (0.4064 => 0.4392, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.92% (0.3650 => 0.3939, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 7.88% (0.3098 => 0.3342, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.87% (0.2756 => 0.2973, std.dev.: 0.0036) SingleSource/Regression/C++/ofstream_ctor: 7.85% (0.2905 => 0.3133, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 7.81% (0.2831 => 0.3052, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.64% (0.3232 => 0.3479, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 7.55% (0.3283 => 0.3531, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.53% (0.3162 => 0.3400, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.49% (0.2872 => 0.3087, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.48% (0.2793 => 0.3002, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.48% (2.0665 => 2.2211, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hello: 7.48% (0.2714 => 0.2917, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 7.41% (0.2725 => 0.2927, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 7.35% (0.2871 => 0.3082, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 7.34% (0.3379 => 0.3627, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 7.34% (0.3052 => 0.3276, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.33% (0.2877 => 0.3088, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.27% (0.3136 => 0.3364, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 7.24% (0.2802 => 0.3005, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 6.70% (1.2842 => 1.3703, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/objinst: 6.10% (0.3131 => 0.3322, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.61% (0.3935 => 0.4077, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.70% (0.3817 => 0.3920, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1726) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.46% (0.9957 => 1.1297, std.dev.: 0.0100) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.78% (1.1396 => 1.2510, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (3.1578 => 3.3677, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.64% (2.8904 => 3.0822, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.87% (0.4162 => 0.4323, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 3.81% (1.9405 => 2.0144, std.dev.: 0.0027) MultiSource/Benchmarks/llubenchmark/llu: 2.82% (3.7781 => 3.8846, std.dev.: 0.0152) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.71% (4.2280 => 4.3425, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.61% (0.3987 => 0.4091, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.96% (3.6395 => 3.7110, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bisort/bisort: 1.79% (0.8333 => 0.8482, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.61% (2.6546 => 2.6974, std.dev.: 0.0016) MultiSource/Applications/aha/aha: 1.54% (3.1595 => 3.2080, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 1.24% (4.4649 => 4.5201, std.dev.: 0.0023) MultiSource/Applications/minisat/minisat: 1.09% (9.1159 => 9.2151, std.dev.: 0.0325) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.99% (6.6874 => 0.1343, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -77.29% (0.8651 => 0.1965, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.10% (5.2763 => 3.3187, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.12% (5.3855 => 3.7636, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -29.58% (5.3526 => 3.7691, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -9.46% (54.1659 => 49.0418, std.dev.: 0.0162) MultiSource/Applications/ClamAV/clamscan: -3.01% (22.1758 => 21.5074, std.dev.: 0.0555) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -52.88% (8.0499 => 3.7935, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.42% (1.1492 => 0.7651, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4750, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.76% (1.6925 => 1.4257, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.68% (1.2258 => 1.0704, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -12.16% (1.2373 => 1.0869, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel-2: -10.77% (1.5373 => 1.3718, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.28% (19.9488 => 18.2966, std.dev.: 0.1067) MultiSource/Benchmarks/FreeBench/mason/mason: -7.68% (0.2161 => 0.1995, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.04% (1.8329 => 1.7039, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.19% (1.6805 => 1.5932, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.57% (1.5835 => 1.5112, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.20% (8.1563 => 7.8137, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1627, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8779, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4976, std.dev.: 0.0065) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.58% (0.4808 => 0.4684, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Applications/sqlite3/sqlite3: -2.08% (4.6441 => 4.5476, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/salsa20: -1.81% (10.2830 => 10.0967, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6836, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.64% (2.5528 => 2.5110, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -1.46% (9.5636 => 9.4244, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2879, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2347, std.dev.: 0.0019) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 20.12% (0.5229 => 0.6281, std.dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: 15.17% (14.9895 => 17.2637, std.dev.: 0.0212) MultiSource/Applications/kimwitu++/kc: 10.66% (14.1553 => 15.6637, std.dev.: 0.0215) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.18% (1.1048 => 1.5045, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 15.72% (7.1582 => 8.2832, std.dev.: 0.0151) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.17% (0.6222 => 0.6917, std.dev.: 0.0029) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.23% (0.1485 => 0.1437, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.17% (0.2116 => 0.2162, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 3.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 24 02:13:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 24 Oct 2012 04:13:49 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121024091349.E396F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5160?compare_to=5157&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5160, Order: 166547, Start Time: 2012-10-24 07:51:52, End Time: 2012-10-24 09:15:56 To: 5157, Order: 166546, Start Time: 2012-10-24 06:11:18, End Time: 2012-10-24 07:34:55 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 12 (78 on baseline) Performance Improvements: 4 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 959 (892 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.86% (0.2252 => 0.2384, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 5.33% (0.2007 => 0.2114, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.41% (0.3335 => 0.3482, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.18% (0.6363 => 0.6629, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.83% (0.2691 => 0.2794, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 3.29% (0.3248 => 0.3355, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 3.07% (0.7466 => 0.7695, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.29% (1.1939 => 1.2213, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.33% (0.7968 => 0.8074, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.31% (7.0924 => 7.3273, std.dev.: 0.0573) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.62% (1.0062 => 1.0326, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.89% (1.2433 => 1.2668, std.dev.: 0.0058) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.57% (1.0209 => 1.0049, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.37% (0.9003 => 0.8880, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.01% (0.9922 => 0.9822, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: -1.65% (0.8847 => 0.8701, std.dev.: 0.0023) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.65% (16.6158 => 16.5075, std.dev.: 0.0671) MultiSource/Applications/obsequi/Obsequi: 1.07% (1.0606 => 1.0719, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: -0.22% (0.6457 => 0.6443, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/08-main/main: 1.59% (0.1888 => 0.1918, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.42% (0.1666 => 0.1723, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.98% (0.3176 => 0.3239, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.51% (0.2451 => 0.2488, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.75% (0.3313 => 0.3371, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.33% (0.2412 => 0.2380, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: 0.18% (0.5979 => 0.5990, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: 22.79% (0.0408 => 0.0501, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.52% (0.3300 => 0.3283, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/strcat: -0.25% (0.1985 => 0.1980, std.dev.: 0.0018) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -4.08% (0.0245 => 0.0235, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 2.74% (0.0146 => 0.0150, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.47% (0.0425 => 0.0427, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.70% (0.0285 => 0.0283, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -4.14% (0.0314 => 0.0301, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.71% (0.0423 => 0.0426, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -0.99% (0.0203 => 0.0201, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -37.04% (0.0216 => 0.0136, std.dev.: 0.0039) SingleSource/UnitTests/byval-alignment: 27.55% (0.0265 => 0.0338, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.02% (0.1473 => 0.1488, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.66% (1.1282 => 1.1207, std.dev.: 0.0202) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 0.21% (0.1442 => 0.1445, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.70% (0.4004 => 0.4032, std.dev.: 0.0199) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.07% (0.1390 => 0.1391, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.81% (0.0624 => 0.0594, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.01% (0.0183 => 0.0194, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.49% (0.0545 => 0.0564, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.77% (1.1499 => 1.1410, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1300.00% (0.0001 => 0.0014, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -44.44% (0.0027 => 0.0015, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.01% (0.0574 => 0.0551, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -25.78% (0.0256 => 0.0190, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.20% (0.8024 => 0.7928, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: -100.00% (0.0001 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: -100.00% (0.0001 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -41.67% (0.0072 => 0.0042, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.26% (2.1832 => 1.6536, std.dev.: 0.0078) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.17% (0.0810 => 0.0941, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 13.40% (0.1112 => 0.1261, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.36% (0.2180 => 0.2384, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.16% (0.2279 => 0.2465, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.40% (0.6010 => 0.6455, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.18% (0.4847 => 0.5195, std.dev.: 0.0100) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.94% (0.8321 => 0.8815, std.dev.: 0.0144) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.93% (0.3137 => 0.3323, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.89% (0.1885 => 0.1996, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.83% (0.1905 => 0.2016, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.81% (0.7473 => 0.7907, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.68% (0.3295 => 0.3482, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.45% (0.1983 => 0.2091, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.44% (0.6287 => 0.6629, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.64% (0.2240 => 0.2344, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.58% (0.5961 => 0.6234, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.52% (1.1685 => 1.2213, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.25% (0.2519 => 0.2626, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.10% (0.3003 => 0.3126, std.dev.: 0.0047) MultiSource/Applications/Burg/burg: 3.85% (1.2222 => 1.2692, std.dev.: 0.0168) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.70% (1.1606 => 1.2035, std.dev.: 0.0062) MultiSource/Applications/hbd/hbd: 3.62% (1.4269 => 1.4786, std.dev.: 0.0108) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.45% (0.4783 => 0.4948, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.13% (0.4127 => 0.4256, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.87% (8.6476 => 8.8957, std.dev.: 0.0888) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.81% (1.6386 => 1.6846, std.dev.: 0.0115) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.72% (0.3717 => 0.3818, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/05-eks/eks: 2.68% (0.4397 => 0.4515, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.56% (4.4873 => 4.6022, std.dev.: 0.0167) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.47% (4.1763 => 4.2796, std.dev.: 0.0124) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.37% (6.6074 => 6.7638, std.dev.: 0.0221) MultiSource/Applications/ClamAV/clamscan: 2.27% (14.7684 => 15.1032, std.dev.: 0.0936) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.14% (4.4880 => 4.5842, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.10% (0.8697 => 0.8880, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.09% (0.6227 => 0.6357, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.05% (0.8007 => 0.8171, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.00% (13.1811 => 13.4449, std.dev.: 0.0718) MultiSource/Applications/lua/lua: 2.00% (3.8189 => 3.8952, std.dev.: 0.0173) MultiSource/Applications/SIBsim4/SIBsim4: 2.00% (1.2568 => 1.2819, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.99% (0.8611 => 0.8782, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.97% (0.8286 => 0.8449, std.dev.: 0.0056) MultiSource/Applications/minisat/minisat: 1.90% (0.6834 => 0.6964, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.84% (0.8317 => 0.8470, std.dev.: 0.0054) MultiSource/Applications/lambda-0_1_3/lambda: 1.83% (0.7557 => 0.7695, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.81% (0.8066 => 0.8212, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.79% (0.8359 => 0.8509, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.79% (0.8050 => 0.8194, std.dev.: 0.0042) MultiSource/Benchmarks/nbench/nbench: 1.71% (1.1271 => 1.1464, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.68% (0.8331 => 0.8471, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.68% (0.9056 => 0.9208, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.56% (0.8261 => 0.8390, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.56% (0.8069 => 0.8195, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.49% (0.7932 => 0.8050, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.48% (0.8656 => 0.8784, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.47% (0.8177 => 0.8297, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.45% (0.8716 => 0.8842, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.44% (0.8805 => 0.8932, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.42% (0.9908 => 1.0049, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.40% (0.8712 => 0.8834, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.38% (0.9688 => 0.9822, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.37% (0.9039 => 0.9163, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.36% (0.8518 => 0.8634, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.36% (0.7966 => 0.8074, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 1.31% (8.6247 => 8.7376, std.dev.: 0.0393) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.27% (0.9069 => 0.9184, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.20% (0.8338 => 0.8438, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.11% (0.8995 => 0.9095, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.85% (1.5795 => 2.5091, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.54% (1.1857 => 1.2751, std.dev.: 0.0044) MultiSource/Benchmarks/mafft/pairlocalalign: 5.95% (63.1822 => 66.9407, std.dev.: 0.0081) MultiSource/Applications/siod/siod: 2.88% (3.6643 => 3.7697, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/ReedSolomon: 2.19% (8.5322 => 8.7188, std.dev.: 0.0403) SingleSource/Benchmarks/Shootout-C++/hash: 1.84% (0.6205 => 0.6319, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.64% (4.3552 => 4.4267, std.dev.: 0.0187) MultiSource/Benchmarks/Olden/bh/bh: 1.60% (2.3560 => 2.3938, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.56% (1.2474 => 1.2668, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.28% (4.8362 => 4.8979, std.dev.: 0.0101) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.20% (59.2638 => 59.9737, std.dev.: 0.0938) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.57% (0.3269 => 0.2989, std.dev.: 0.0016) MultiSource/Applications/lua/lua: -5.14% (29.8330 => 28.2983, std.dev.: 0.0268) SingleSource/Benchmarks/Shootout-C++/hash2: -1.52% (3.4237 => 3.3718, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.28% (3.3479 => 3.3049, std.dev.: 0.0109) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.37% (16.4461 => 16.5075, std.dev.: 0.0671) MultiSource/Applications/obsequi/Obsequi: 4.45% (1.0262 => 1.0719, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: 1.75% (0.6332 => 0.6443, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/08-main/main: 4.75% (0.1831 => 0.1918, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.52% (0.1559 => 0.1723, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.71% (0.3123 => 0.3239, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.02% (0.2463 => 0.2488, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.81% (0.3344 => 0.3371, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.68% (0.2364 => 0.2380, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: -0.33% (0.6010 => 0.5990, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: 16.78% (0.0429 => 0.0501, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.52% (0.3266 => 0.3283, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/strcat: 0.56% (0.1969 => 0.1980, std.dev.: 0.0018) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.91% (0.0224 => 0.0235, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 21.95% (0.0123 => 0.0150, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 11.42% (0.0254 => 0.0283, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.33% (0.0302 => 0.0301, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.94% (0.0384 => 0.0426, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 5.79% (0.0190 => 0.0201, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -24.44% (0.0180 => 0.0136, std.dev.: 0.0039) SingleSource/UnitTests/byval-alignment: 46.96% (0.0230 => 0.0338, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 3.48% (0.1438 => 0.1488, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.08% (1.1329 => 1.1207, std.dev.: 0.0202) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -1.16% (0.1462 => 0.1445, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.17% (0.4164 => 0.4032, std.dev.: 0.0199) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.61% (0.1369 => 0.1391, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.33% (0.0641 => 0.0594, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.51% (0.0195 => 0.0194, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.42% (0.0578 => 0.0564, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.24% (1.1437 => 1.1410, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1300.00% (0.0001 => 0.0014, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 7.14% (0.0014 => 0.0015, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.12% (0.0627 => 0.0551, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.56% (0.0180 => 0.0190, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.11% (0.8017 => 0.7928, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -32.26% (0.0062 => 0.0042, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 24 03:43:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 24 Oct 2012 05:43:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121024104333.832A92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5161?compare_to=5154&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5161, Order: 166546, Start Time: 2012-10-24 07:29:53, End Time: 2012-10-24 10:45:38 To: 5154, Order: 166539, Start Time: 2012-10-24 03:17:58, End Time: 2012-10-24 06:34:50 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (169 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1042 (720 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 43.36% (0.0625 => 0.0896, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.49% (0.1063 => 0.1419, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.17% (0.2969 => 0.3746, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.70% (0.4253 => 0.5346, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.41% (0.1106 => 0.1387, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 25.35% (1.5932 => 1.9970, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.74% (0.4139 => 0.5163, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.09% (0.0714 => 0.0886, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.71% (0.4994 => 0.6178, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.61% (0.5900 => 0.7293, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.58% (0.0475 => 0.0587, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.42% (0.5000 => 0.6171, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.67% (0.0547 => 0.0671, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.60% (0.0584 => 0.0716, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.59% (0.1620 => 0.1986, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.33% (0.1021 => 0.1249, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.07% (0.0897 => 0.1095, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.04% (0.1107 => 0.1351, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 21.70% (0.0599 => 0.0729, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 20.99% (0.0948 => 0.1147, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.85% (0.0633 => 0.0765, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.72% (0.0584 => 0.0705, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.72% (0.0642 => 0.0775, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.58% (0.1103 => 0.1330, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 20.53% (0.0604 => 0.0728, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.52% (0.0541 => 0.0652, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.50% (0.3903 => 0.4703, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.44% (0.0822 => 0.0990, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.40% (0.0495 => 0.0596, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.39% (0.1604 => 0.1931, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/health/health: 20.34% (0.0821 => 0.0988, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.14% (0.1003 => 0.1205, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 20.01% (0.1619 => 0.1943, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.95% (0.1549 => 0.1858, std.dev.: 0.0015) MultiSource/Applications/viterbi/viterbi: 19.22% (0.0947 => 0.1129, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/Hello: 18.74% (0.5826 => 0.6918, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.62% (0.2014 => 0.2389, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 18.54% (0.5889 => 0.6981, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.54% (0.1462 => 0.1733, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 18.47% (0.1218 => 0.1443, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 18.44% (0.0808 => 0.0957, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 18.21% (0.1505 => 0.1779, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.20% (0.3890 => 0.4598, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 17.91% (0.0698 => 0.0823, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.88% (1.3152 => 1.5504, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.74% (0.1088 => 0.1281, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 17.62% (0.4029 => 0.4739, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.62% (0.2736 => 0.3218, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.37% (3.5627 => 4.1814, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.24% (0.2866 => 0.3360, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 17.20% (1.8794 => 2.2027, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.07% (0.1160 => 0.1358, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: 17.06% (0.5546 => 0.6492, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.01% (0.2875 => 0.3364, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.72% (0.1968 => 0.2297, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.68% (1.6211 => 1.8915, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/18-imp/imp: 16.54% (0.1421 => 0.1656, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.51% (0.4658 => 0.5427, std.dev.: 0.0045) MultiSource/Applications/hbd/hbd: 16.43% (0.9697 => 1.1290, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 16.36% (0.7171 => 0.8344, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/fibo: 16.33% (0.2725 => 0.3170, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 16.29% (0.2780 => 0.3233, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.29% (0.3271 => 0.3804, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 16.25% (1.0781 => 1.2533, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/hello: 16.21% (0.2714 => 0.3154, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 16.20% (0.1284 => 0.1492, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.18% (0.2738 => 0.3181, std.dev.: 0.0029) SingleSource/Regression/C++/ofstream_ctor: 16.18% (0.3004 => 0.3490, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.12% (0.2792 => 0.3242, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 16.08% (0.2811 => 0.3263, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.05% (0.2729 => 0.3167, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.01% (0.4361 => 0.5059, std.dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.99% (2.7292 => 3.1657, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/random: 15.91% (0.2803 => 0.3249, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 15.89% (0.2750 => 0.3187, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.84% (0.5026 => 0.5822, std.dev.: 0.0050) MultiSource/Applications/ClamAV/clamscan: 15.82% (4.2109 => 4.8771, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: 15.75% (0.2813 => 0.3256, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 15.73% (0.2823 => 0.3267, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.71% (0.3195 => 0.3697, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.70% (0.3930 => 0.4547, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.70% (0.2911 => 0.3368, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.67% (2.0673 => 2.3912, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 15.67% (0.3096 => 0.3581, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 15.58% (0.9909 => 1.1453, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 15.43% (0.3267 => 0.3771, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.41% (1.9694 => 2.2729, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/ary2: 15.32% (0.3317 => 0.3825, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.31% (4.4195 => 5.0963, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.17% (1.9966 => 2.2994, std.dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: 15.06% (23.5202 => 27.0613, std.dev.: 0.0295) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.03% (0.3060 => 0.3520, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 15.01% (0.3258 => 0.3747, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.86% (0.1090 => 0.1252, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.78% (0.3362 => 0.3859, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.72% (0.3124 => 0.3584, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 14.67% (0.3348 => 0.3839, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sieve: 14.44% (0.3726 => 0.4264, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/moments: 14.41% (0.3678 => 0.4208, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.23% (0.3282 => 0.3749, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 14.14% (1.4269 => 1.6287, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.12% (0.3625 => 0.4137, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 14.09% (0.3477 => 0.3967, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.04% (0.3981 => 0.4540, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 14.03% (0.2566 => 0.2926, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.01% (0.3690 => 0.4207, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 13.99% (0.3446 => 0.3928, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 13.94% (0.4146 => 0.4724, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 13.93% (0.2075 => 0.2364, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 13.93% (0.4251 => 0.4843, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 13.91% (0.3465 => 0.3947, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/for-in: 13.90% (0.3496 => 0.3982, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.88% (0.3488 => 0.3972, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 13.81% (0.3469 => 0.3948, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 13.79% (0.3460 => 0.3937, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/trivial-interface: 13.77% (0.3442 => 0.3916, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 13.51% (0.3650 => 0.4143, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 13.48% (0.3643 => 0.4134, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.47% (0.3845 => 0.4363, std.dev.: 0.0023) MultiSource/Applications/treecc/treecc: 13.42% (0.7875 => 0.8932, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 13.35% (0.3724 => 0.4221, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 13.29% (0.5012 => 0.5678, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 13.22% (2.1653 => 2.4515, std.dev.: 0.0187) MultiSource/Applications/JM/lencod/lencod: 13.00% (4.6177 => 5.2178, std.dev.: 0.0060) MultiSource/Benchmarks/mafft/pairlocalalign: 12.72% (2.1013 => 2.3686, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.40% (0.2040 => 0.2293, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 11.97% (0.2691 => 0.3013, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 11.83% (5.5417 => 6.1975, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.83% (0.6435 => 0.7196, std.dev.: 0.0141) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.19% (0.1028 => 0.1143, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 11.18% (0.3498 => 0.3889, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.17% (0.2068 => 0.2299, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.00% (0.2737 => 0.3038, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.56% (0.1383 => 0.1529, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.47% (0.3084 => 0.3407, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 10.14% (0.6634 => 0.7307, std.dev.: 0.0045) MultiSource/Applications/minisat/minisat: 10.13% (0.3336 => 0.3674, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 10.13% (0.4847 => 0.5338, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.75% (0.2103 => 0.2308, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 9.24% (0.2391 => 0.2612, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 9.18% (2.0346 => 2.2213, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.14% (4.6926 => 5.1214, std.dev.: 0.0177) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.75% (0.5361 => 0.5830, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.59% (11.6398 => 12.6398, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.84% (0.5584 => 0.6022, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.74% (0.7426 => 0.8001, std.dev.: 0.0107) MultiSource/Applications/kimwitu++/kc: 6.98% (11.9555 => 12.7894, std.dev.: 0.0072) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.54% (0.3792 => 0.3964, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6535, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.25% (0.5917 => 0.6701, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 8.92% (0.2802 => 0.3052, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6114, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.02% (12.0509 => 12.6562, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 4.64% (15.4430 => 16.1601, std.dev.: 0.0247) SingleSource/Benchmarks/Misc/flops-2: 3.96% (1.8057 => 1.8772, std.dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/dry: 2.66% (14.0481 => 14.4218, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/ary3: 2.10% (15.8721 => 16.2052, std.dev.: 0.0644) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.79% (3.1722 => 3.2290, std.dev.: 0.0022) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3114, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.35% (7.1849 => 7.2818, std.dev.: 0.0054) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5147, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5887, std.dev.: 0.1218) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.16% (2.4764 => 2.4230, std.dev.: 0.0133) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.47% (25.4195 => 16.4040, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary2: -8.99% (0.2402 => 0.2186, std.dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: -7.70% (28.1477 => 25.9802, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7731, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/tsp/tsp: -7.20% (2.1113 => 1.9593, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.45% (11.2080 => 10.8208, std.dev.: 0.0436) MultiSource/Applications/siod/siod: -2.98% (6.9842 => 6.7759, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.96% (0.6293 => 0.6107, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5217, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.17% (41.7953 => 40.8903, std.dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/fldry: -2.13% (17.2379 => 16.8713, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5737, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/bh/bh: -1.55% (5.5810 => 5.4947, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7161, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.26% (105.3826 => 104.0559, std.dev.: 0.0976) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0413, std.dev.: 0.0057) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.06% (3.3991 => 3.3630, std.dev.: 0.0041) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 24 07:13:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 24 Oct 2012 09:13:49 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121024141349.2ED542A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5162?compare_to=5160&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5162, Order: 166552, Start Time: 2012-10-24 12:52:15, End Time: 2012-10-24 14:15:55 To: 5160, Order: 166547, Start Time: 2012-10-24 07:51:52, End Time: 2012-10-24 09:15:56 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 5 (67 on baseline) Performance Improvements: 3 (5 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 967 (902 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/bc/bc: 1.33% (1.1258 => 1.1408, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 10.43% (3.6876 => 4.0722, std.dev.: 0.0715) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.31% (0.3201 => 0.3467, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/ReedSolomon: 1.23% (8.7188 => 8.8263, std.dev.: 0.0232) SingleSource/Benchmarks/Misc/richards_benchmark: 1.07% (1.2980 => 1.3119, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -12.08% (24.7232 => 21.7367, std.dev.: 0.3712) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.34% (2.9439 => 2.8751, std.dev.: 0.0124) MultiSource/Applications/spiff/spiff: -1.50% (2.9146 => 2.8708, std.dev.: 0.0079) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.57% (16.5075 => 16.6010, std.dev.: 0.0141) MultiSource/Applications/obsequi/Obsequi: -0.74% (1.0719 => 1.0640, std.dev.: 0.0073) MultiSource/Applications/sqlite3/sqlite3: 0.02% (0.6443 => 0.6444, std.dev.: 0.0081) MultiSource/Benchmarks/McCat/08-main/main: -2.03% (0.1918 => 0.1879, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.75% (0.1723 => 0.1624, std.dev.: 0.0053) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.46% (0.3239 => 0.3224, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.61% (0.2488 => 0.2448, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.09% (0.3371 => 0.3374, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.68% (0.2380 => 0.2420, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 0.27% (0.5990 => 0.6006, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/mandel: -5.99% (0.0501 => 0.0471, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.13% (0.3283 => 0.3320, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/strcat: 1.11% (0.1980 => 0.2002, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -8.51% (0.0235 => 0.0215, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 42.00% (0.0150 => 0.0213, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.23% (0.0427 => 0.0428, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 17.31% (0.0283 => 0.0332, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.98% (0.0301 => 0.0316, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.47% (0.0426 => 0.0428, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: 1.99% (0.0201 => 0.0205, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 61.76% (0.0136 => 0.0220, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -8.58% (0.0338 => 0.0309, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -0.27% (0.1488 => 0.1484, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 1.73% (1.1207 => 1.1401, std.dev.: 0.0627) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 4.71% (0.1445 => 0.1513, std.dev.: 0.0056) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.46% (0.4032 => 0.4131, std.dev.: 0.0114) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.16% (0.1391 => 0.1421, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.20% (0.0594 => 0.0613, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 16.49% (0.0194 => 0.0226, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: - (0.0564 => 0.0564, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.11% (1.1410 => 1.1397, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 13.33% (0.0015 => 0.0017, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.99% (0.0551 => 0.0584, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 33.16% (0.0190 => 0.0253, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.96% (0.7928 => 0.8004, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 38.10% (0.0042 => 0.0058, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.96% (2.1832 => 1.6600, std.dev.: 0.0044) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.42% (0.0810 => 0.0943, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.29% (0.6010 => 0.6508, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.00% (0.1425 => 0.1539, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.61% (0.2180 => 0.2346, std.dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.83% (0.3137 => 0.3320, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.64% (0.3295 => 0.3481, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.19% (0.8148 => 0.8571, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.04% (0.7473 => 0.7775, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.03% (1.1685 => 1.2156, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.52% (0.6287 => 0.6508, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.48% (1.6386 => 1.6956, std.dev.: 0.0064) MultiSource/Applications/hbd/hbd: 3.41% (1.4269 => 1.4756, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.40% (0.2998 => 0.3100, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.32% (1.1606 => 1.1991, std.dev.: 0.0123) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.21% (6.6074 => 6.8194, std.dev.: 0.0631) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.09% (4.4873 => 4.6261, std.dev.: 0.0446) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.93% (0.9435 => 0.9711, std.dev.: 0.0067) MultiSource/Applications/treecc/treecc: 2.89% (1.9948 => 2.0525, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.83% (0.4127 => 0.4244, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.79% (0.8611 => 0.8851, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.74% (0.3717 => 0.3819, std.dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: 2.47% (1.2568 => 1.2878, std.dev.: 0.0072) MultiSource/Applications/ClamAV/clamscan: 2.38% (14.7684 => 15.1195, std.dev.: 0.1152) MultiSource/Benchmarks/nbench/nbench: 2.29% (1.1271 => 1.1529, std.dev.: 0.0095) MultiSource/Applications/lua/lua: 2.26% (3.8189 => 3.9052, std.dev.: 0.0195) MultiSource/Applications/d/make_dparser: 2.26% (3.2366 => 3.3096, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.15% (0.8697 => 0.8884, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.14% (0.8331 => 0.8509, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.13% (1.1170 => 1.1408, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/gs/gs: 1.92% (4.1305 => 4.2097, std.dev.: 0.0293) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.91% (0.6227 => 0.6346, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.91% (0.8597 => 0.8761, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.89% (0.8048 => 0.8200, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.89% (1.4479 => 1.4752, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.88% (0.8050 => 0.8201, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 1.87% (0.6834 => 0.6962, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.86% (0.8086 => 0.8236, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.84% (0.8855 => 0.9018, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.83% (0.8177 => 0.8327, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.82% (0.9688 => 0.9864, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.74% (0.8716 => 0.8868, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.73% (0.8317 => 0.8461, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.73% (0.8204 => 0.8346, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.73% (0.9908 => 1.0079, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.72% (0.9074 => 0.9230, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.70% (0.8805 => 0.8955, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.66% (0.9056 => 0.9206, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.65% (0.8712 => 0.8856, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.64% (0.8518 => 0.8658, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.59% (0.8359 => 0.8492, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 1.55% (0.8768 => 0.8904, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.52% (0.8316 => 0.8442, std.dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: 1.47% (31.8598 => 32.3289, std.dev.: 0.0362) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.45% (0.8885 => 0.9014, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 1.43% (8.6247 => 8.7479, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.36% (0.9039 => 0.9162, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.35% (0.8286 => 0.8398, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.35% (0.8066 => 0.8175, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 59.11% (1.5795 => 2.5132, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.82% (0.3186 => 0.3467, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.32% (1.1857 => 1.2843, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 5.97% (63.1822 => 66.9512, std.dev.: 0.0338) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.91% (2.2485 => 2.3365, std.dev.: 0.0338) SingleSource/Benchmarks/Misc/ReedSolomon: 3.45% (8.5322 => 8.8263, std.dev.: 0.0232) MultiSource/Applications/siod/siod: 2.82% (3.6643 => 3.7676, std.dev.: 0.0116) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.03% (2.4490 => 2.4988, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/bh/bh: 1.61% (2.3560 => 2.3940, std.dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.82% (0.3269 => 0.2948, std.dev.: 0.0107) MultiSource/Applications/lua/lua: -5.31% (29.8330 => 28.2501, std.dev.: 0.0559) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.03% (1.0388 => 1.0073, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/hash2: -1.34% (3.4237 => 3.3777, std.dev.: 0.0125) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.25% (3.3479 => 3.3062, std.dev.: 0.0099) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.94% (16.4461 => 16.6010, std.dev.: 0.0141) MultiSource/Applications/obsequi/Obsequi: 3.68% (1.0262 => 1.0640, std.dev.: 0.0073) MultiSource/Applications/sqlite3/sqlite3: 1.77% (0.6332 => 0.6444, std.dev.: 0.0081) MultiSource/Benchmarks/McCat/08-main/main: 2.62% (0.1831 => 0.1879, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.17% (0.1559 => 0.1624, std.dev.: 0.0053) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.23% (0.3123 => 0.3224, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.61% (0.2463 => 0.2448, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.90% (0.3344 => 0.3374, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.37% (0.2364 => 0.2420, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -0.07% (0.6010 => 0.6006, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/mandel: 9.79% (0.0429 => 0.0471, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.65% (0.3266 => 0.3320, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/strcat: 1.68% (0.1969 => 0.2002, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -4.02% (0.0224 => 0.0215, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 73.17% (0.0123 => 0.0213, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.71% (0.0254 => 0.0332, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.64% (0.0302 => 0.0316, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.46% (0.0384 => 0.0428, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 22.22% (0.0180 => 0.0220, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: 34.35% (0.0230 => 0.0309, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 3.20% (0.1438 => 0.1484, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.64% (1.1329 => 1.1401, std.dev.: 0.0627) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.49% (0.1462 => 0.1513, std.dev.: 0.0056) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.79% (0.4164 => 0.4131, std.dev.: 0.0114) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.80% (0.1369 => 0.1421, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.37% (0.0641 => 0.0613, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 15.90% (0.0195 => 0.0226, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.42% (0.0578 => 0.0564, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.35% (1.1437 => 1.1397, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 21.43% (0.0014 => 0.0017, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.86% (0.0627 => 0.0584, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 40.56% (0.0180 => 0.0253, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.16% (0.8017 => 0.8004, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -6.45% (0.0062 => 0.0058, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 24 07:20:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 24 Oct 2012 09:20:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121024142024.89C222A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5163?compare_to=5158&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5163, Order: 166552, Start Time: 2012-10-24 12:57:44, End Time: 2012-10-24 14:22:29 To: 5158, Order: 166547, Start Time: 2012-10-24 07:48:31, End Time: 2012-10-24 09:13:21 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (182 on baseline) Unchanged Tests: 1041 (855 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.37% (54.5711 => 56.4082, std.dev.: 0.0999) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.36% (54.5751 => 56.4082, std.dev.: 0.0999) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.91% (2.0478 => 2.1074, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: 2.72% (7.4937 => 7.6978, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/hash2: 2.15% (3.1932 => 3.2618, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.22% (0.1431 => 0.1299, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.45% (0.3821 => 0.3498, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -7.84% (0.3880 => 0.3576, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -7.83% (0.3831 => 0.3531, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -7.78% (2.4924 => 2.2985, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/trivial-interface: -7.71% (0.3812 => 0.3518, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.71% (0.3891 => 0.3591, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.70% (0.3884 => 0.3585, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -7.67% (0.3896 => 0.3597, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -7.64% (0.3848 => 0.3554, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -7.61% (0.4033 => 0.3726, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.58% (22.4056 => 20.7077, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/exceptions: -7.47% (0.4176 => 0.3864, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -7.36% (0.4280 => 0.3965, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.35% (0.9542 => 0.8841, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: -7.30% (0.3357 => 0.3112, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -7.24% (0.4199 => 0.3895, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.10% (0.3142 => 0.2919, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -7.06% (3.5339 => 3.2843, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: -6.99% (0.2160 => 0.2009, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: -6.94% (16.1920 => 15.0679, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.92% (5.4682 => 5.0896, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.92% (0.2428 => 0.2260, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.90% (0.1796 => 0.1672, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: -6.85% (0.9179 => 0.8550, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: -6.84% (1.1530 => 1.0741, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.84% (0.4151 => 0.3867, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -6.84% (9.2283 => 8.5972, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: -6.83% (7.0961 => 6.6112, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/gs/gs: -6.82% (4.3330 => 4.0374, std.dev.: 0.0110) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.82% (0.1584 => 0.1476, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -6.81% (0.1879 => 0.1751, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.77% (6.7716 => 6.3131, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.75% (0.3658 => 0.3411, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.75% (0.2355 => 0.2196, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.74% (1.3722 => 1.2797, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.73% (0.9852 => 0.9189, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.71% (0.6736 => 0.6284, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: -6.69% (0.4861 => 0.4536, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -6.68% (1.2515 => 1.1679, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.2695 => 0.2515, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.63% (1.6474 => 1.5381, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.61% (1.0544 => 0.9847, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -6.59% (0.1761 => 0.1645, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: -6.58% (0.5168 => 0.4828, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.57% (0.3849 => 0.3596, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: -6.57% (0.7447 => 0.6958, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.56% (4.0323 => 3.7679, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.54% (0.4813 => 0.4498, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: -6.54% (0.9557 => 0.8932, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.51% (0.2548 => 0.2382, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: -6.51% (0.2659 => 0.2486, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.50% (0.7919 => 0.7404, std.dev.: 0.0013) MultiSource/Applications/lua/lua: -6.50% (4.0594 => 3.7955, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/bh/bh: -6.50% (0.2985 => 0.2791, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.49% (0.6484 => 0.6063, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.48% (1.6364 => 1.5304, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.48% (1.2784 => 1.1956, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -6.47% (0.3491 => 0.3265, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.47% (0.1716 => 0.1605, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.46% (4.5069 => 4.2158, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -6.45% (0.4524 => 0.4232, std.dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: -6.45% (1.3148 => 1.2300, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.42% (4.8161 => 4.5069, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.42% (2.2587 => 2.1137, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.41% (1.4642 => 1.3704, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: -6.40% (0.4515 => 0.4226, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: -6.39% (1.1450 => 1.0718, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.39% (4.8802 => 4.5685, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.35% (1.2300 => 1.1519, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.35% (0.3025 => 0.2833, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: -6.33% (1.3864 => 1.2986, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: -6.32% (15.5079 => 14.5272, std.dev.: 0.0097) MultiSource/Benchmarks/McCat/18-imp/imp: -6.31% (0.3581 => 0.3355, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: -6.28% (0.3059 => 0.2867, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.25% (2.1713 => 2.0355, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: -6.25% (0.3406 => 0.3193, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -6.25% (0.4321 => 0.4051, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -6.24% (0.3446 => 0.3231, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -6.23% (0.3194 => 0.2995, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.23% (0.5329 => 0.4997, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -6.22% (2.4021 => 2.2527, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -6.21% (0.4248 => 0.3984, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -6.19% (0.3394 => 0.3184, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -6.19% (15.2527 => 14.3093, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -6.18% (0.7524 => 0.7059, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.18% (0.3837 => 0.3600, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.17% (0.5999 => 0.5629, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -6.15% (34.0927 => 31.9944, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.15% (0.6681 => 0.6270, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -6.15% (0.3481 => 0.3267, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.15% (0.6395 => 0.6002, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: -6.14% (3.5154 => 3.2995, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.14% (14.2083 => 13.3358, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/bigfib: -6.13% (0.6750 => 0.6336, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -6.13% (0.3621 => 0.3399, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.12% (0.4083 => 0.3833, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.11% (0.5925 => 0.5563, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -6.11% (0.3323 => 0.3120, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.11% (0.6304 => 0.5919, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.10% (0.5591 => 0.5250, std.dev.: 0.0065) SingleSource/UnitTests/ObjC++/property-reference: -6.09% (0.7779 => 0.7305, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.09% (0.3252 => 0.3054, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.08% (0.6297 => 0.5914, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.08% (0.2385 => 0.2240, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.08% (0.5859 => 0.5503, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.06% (1.2221 => 1.1480, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: -6.06% (0.2871 => 0.2697, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.05% (0.7021 => 0.6596, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.05% (1.2210 => 1.1471, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.05% (0.5802 => 0.5451, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.04% (0.6189 => 0.5815, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -6.03% (0.5705 => 0.5361, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.03% (0.5805 => 0.5455, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.03% (0.5857 => 0.5504, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -6.02% (0.6676 => 0.6274, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: -6.01% (0.3026 => 0.2844, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.01% (0.6293 => 0.5915, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -6.00% (8.0126 => 7.5316, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -6.00% (0.6667 => 0.6267, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: -5.99% (0.3255 => 0.3060, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.99% (0.4427 => 0.4162, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -5.98% (17.1032 => 16.0804, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.97% (0.6260 => 0.5886, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.97% (0.5575 => 0.5242, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.97% (0.6230 => 0.5858, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.97% (0.5863 => 0.5513, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.97% (0.2999 => 0.2820, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.96% (0.6052 => 0.5691, std.dev.: 0.0075) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.96% (0.8521 => 0.8013, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.96% (0.4916 => 0.4623, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -5.96% (0.2989 => 0.2811, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.94% (0.6395 => 0.6015, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.94% (0.6194 => 0.5826, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.94% (0.7339 => 0.6903, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -5.94% (0.3788 => 0.3563, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.93% (0.2933 => 0.2759, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.93% (0.3931 => 0.3698, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.93% (0.2278 => 0.2143, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.92% (0.5941 => 0.5589, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -5.92% (0.2939 => 0.2765, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -5.90% (18.2933 => 17.2137, std.dev.: 0.0141) MultiSource/Applications/treecc/treecc: -5.90% (2.1401 => 2.0138, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.89% (0.2903 => 0.2732, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.88% (0.5478 => 0.5156, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.87% (0.5569 => 0.5242, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.86% (0.3483 => 0.3279, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.86% (0.5567 => 0.5241, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.83% (0.6446 => 0.6070, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -5.82% (0.3867 => 0.3642, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -5.81% (0.6347 => 0.5978, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.81% (0.5849 => 0.5509, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.81% (0.6440 => 0.6066, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: -5.81% (0.6441 => 0.6067, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.80% (0.3016 => 0.2841, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.80% (0.6033 => 0.5683, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.80% (0.5570 => 0.5247, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.80% (0.6660 => 0.6274, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.79% (0.3057 => 0.2880, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.79% (0.5581 => 0.5258, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.77% (0.5456 => 0.5141, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: -5.76% (0.2849 => 0.2685, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: -5.72% (0.3271 => 0.3084, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wc: -5.65% (0.3205 => 0.3024, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.64% (0.7198 => 0.6792, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: -5.62% (0.8418 => 0.7945, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.59% (0.5688 => 0.5370, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.51% (0.3319 => 0.3136, std.dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: -5.51% (0.7982 => 0.7542, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.37% (0.2106 => 0.1993, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.75% (0.9077 => 0.8646, std.dev.: 0.0018) MultiSource/Applications/hbd/hbd: -4.73% (1.5610 => 1.4871, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.57% (0.2277 => 0.2173, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -4.42% (5.0226 => 4.8008, std.dev.: 0.0096) SingleSource/UnitTests/Vector/constpool: -3.17% (20.7746 => 20.1168, std.dev.: 0.0356) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7575, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1728, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7061, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.68% (2.2633 => 2.1801, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.01% (1.0557 => 1.0239, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.65% (6.5735 => 6.4648, std.dev.: 0.0053) Report Time: 1.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 24 07:22:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 24 Oct 2012 09:22:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121024142221.5AC872A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5164?compare_to=5159&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5164, Order: 166552, Start Time: 2012-10-24 13:04:09, End Time: 2012-10-24 14:24:26 To: 5159, Order: 166547, Start Time: 2012-10-24 07:54:55, End Time: 2012-10-24 09:15:28 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (5 on baseline) Performance Regressions: 0 (197 on baseline) Performance Improvements: 1 (46 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 88 (14 on baseline) Unchanged Tests: 953 (644 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -3.37% (3.8846 => 3.7535, std.dev.: 0.0396) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.08% (0.6281 => 0.6276, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 0.10% (17.2637 => 17.2811, std.dev.: 0.0047) MultiSource/Applications/kimwitu++/kc: -0.07% (15.6637 => 15.6520, std.dev.: 0.0148) MultiSource/Benchmarks/Bullet/bullet: 0.02% (56.1245 => 56.1365, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0489 => 0.0489, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0491 => 0.0491) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0459 => 0.0459, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0460 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0448 => 0.0448) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.22% (0.0448 => 0.0449) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0441 => 0.0441, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0442 => 0.0442, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.22% (0.0460 => 0.0459, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.22% (0.0461 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0453 => 0.0453, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0455 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0444 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0445 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.22% (0.0450 => 0.0451) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0452 => 0.0452) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0462 => 0.0462) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.22% (0.0464 => 0.0463, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0438 => 0.0438, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.23% (0.0440 => 0.0439, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.22% (0.0451 => 0.0450, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0451 => 0.0451, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.23% (0.0443 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.23% (0.0443 => 0.0442, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0433 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0435 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.23% (0.0433 => 0.0434) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0434 => 0.0434) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0470 => 0.0470, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0471 => 0.0471, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.23% (0.0432 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.23% (0.0433 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0434 => 0.0434, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0435 => 0.0435, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.45% (0.0442 => 0.0440, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0441 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.21% (1.5045 => 1.5013, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.03% (8.2832 => 8.2806, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.04% (0.6917 => 0.6920, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1437 => 0.1436, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.30% (0.2162 => 0.2134, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.24% (63.2438 => 56.1365, std.dev.: 0.0127) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/MallocBench/gs/gs: 13.33% (4.1105 => 4.6586, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.54% (3.4629 => 5.8364, std.dev.: 0.0025) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13517.08% (0.0720 => 9.8043, std.dev.: 0.0132) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049900.00% (0.0001 => 10.0500, std.dev.: 0.0005) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 69.14% (0.0256 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 64.57% (0.2554 => 0.4203, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 51.86% (10.3673 => 15.7442, std.dev.: 0.0171) SingleSource/Regression/C/sumarraymalloc: 51.03% (0.0243 => 0.0367) SingleSource/UnitTests/SignlessTypes/factor: 47.30% (0.0296 => 0.0436, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 43.91% (0.0271 => 0.0390, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.13% (1.5859 => 2.2382, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 38.53% (0.1622 => 0.2247, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 37.50% (0.1056 => 0.1452, std.dev.: 0.0001) SingleSource/UnitTests/vla: 33.24% (0.0355 => 0.0473, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.48% (2.2024 => 2.8737, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/neural/neural: 28.02% (0.1463 => 0.1873, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 24.17% (0.1655 => 0.2055, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 23.38% (0.0834 => 0.1029, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.46% (0.1566 => 0.1902, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 21.09% (0.1432 => 0.1734, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: 20.99% (0.2049 => 0.2479, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.42% (7.0540 => 8.4942, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/pifft/pifft: 19.99% (2.2022 => 2.6425, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.83% (0.0871 => 0.1035, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 18.78% (0.1555 => 0.1847, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 18.33% (0.5105 => 0.6041, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.98% (0.6675 => 0.7875, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 17.43% (0.1440 => 0.1691, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.40% (0.1029 => 0.1208, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.01% (1.3050 => 1.5270, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: 16.77% (0.0626 => 0.0731, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 16.77% (0.1175 => 0.1372, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 16.70% (0.1695 => 0.1978, std.dev.: 0.0036) MultiSource/Applications/d/make_dparser: 16.66% (3.3354 => 3.8911, std.dev.: 0.0106) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.60% (0.2271 => 0.2648, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.39% (0.0793 => 0.0923, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.38% (0.4615 => 0.5371, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.35% (0.8172 => 0.9508, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/mst/mst: 16.34% (0.1163 => 0.1353, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.31% (0.3121 => 0.3630, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 16.16% (0.1337 => 0.1553, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 15.90% (0.3282 => 0.3804, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.88% (0.5020 => 0.5817, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.69% (0.0886 => 0.1025, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.66% (1.5415 => 1.7829, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.60% (0.1032 => 0.1193, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.44% (0.0842 => 0.0972, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.30% (0.1510 => 0.1741, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: 15.28% (0.0818 => 0.0943, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 15.26% (0.7115 => 0.8201, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 15.21% (0.4879 => 0.5621, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 15.18% (0.0672 => 0.0774, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.15% (0.1940 => 0.2234, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.11% (0.0675 => 0.0777, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 15.02% (0.3109 => 0.3576, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.87% (1.7609 => 2.0228, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.87% (0.9765 => 1.1217, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 14.81% (0.3423 => 0.3930, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.77% (0.1117 => 0.1282, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 14.76% (0.3177 => 0.3646, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 14.70% (8.1363 => 9.3326, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 14.68% (10.4361 => 11.9679, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.68% (0.0838 => 0.0961, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.68% (0.0770 => 0.0883, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.67% (0.2107 => 0.2416, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.62% (4.2646 => 4.8881, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.61% (0.0746 => 0.0855, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.56% (0.1236 => 0.1416, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 14.55% (1.1642 => 1.3336, std.dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 14.53% (0.1906 => 0.2183, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.43% (0.2758 => 0.3156, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 14.38% (0.0730 => 0.0835, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.38% (0.2065 => 0.2362, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 14.36% (9.4845 => 10.8462, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.26% (0.0933 => 0.1066, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 14.16% (0.1151 => 0.1314, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.15% (0.5860 => 0.6689, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.14% (0.1584 => 0.1808, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/exptree: 14.13% (0.0814 => 0.0929, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 14.12% (0.1438 => 0.1641, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.11% (0.5981 => 0.6825, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.09% (0.6450 => 0.7359, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.07% (0.2700 => 0.3080, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 14.05% (0.7835 => 0.8936, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.91% (0.0798 => 0.0909, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.84% (0.1062 => 0.1209, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.81% (0.1695 => 0.1929, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.75% (1.4186 => 1.6137, std.dev.: 0.0021) SingleSource/UnitTests/SignlessTypes/rem: 13.64% (0.1144 => 0.1300, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.64% (0.0770 => 0.0875, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 13.56% (0.1268 => 0.1440) MultiSource/Applications/treecc/treecc: 13.55% (2.0273 => 2.3021, std.dev.: 0.0049) MultiSource/Applications/oggenc/oggenc: 13.55% (5.7591 => 6.5392, std.dev.: 0.0051) MultiSource/Applications/lambda-0_1_3/lambda: 13.35% (0.7433 => 0.8425, std.dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 13.32% (1.1840 => 1.3417, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.26% (0.8067 => 0.9137, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 13.23% (4.9449 => 5.5991, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.14% (5.0018 => 5.6590, std.dev.: 0.0035) MultiSource/Benchmarks/sim/sim: 13.11% (0.3387 => 0.3831, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.09% (0.5569 => 0.6298, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.97% (0.3307 => 0.3736, std.dev.: 0.0056) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.91% (7.9617 => 8.9896, std.dev.: 0.0032) MultiSource/Applications/lemon/lemon: 12.90% (1.0722 => 1.2105, std.dev.: 0.0017) MultiSource/Applications/lua/lua: 12.89% (3.8723 => 4.3714, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.81% (0.0929 => 0.1048, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.78% (0.1330 => 0.1500, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 12.77% (0.4299 => 0.4848, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.74% (0.1625 => 0.1832, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.66% (1.1861 => 1.3363, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.41% (0.2603 => 0.2926, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: 12.35% (0.3092 => 0.3474, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 12.27% (0.8921 => 1.0016, std.dev.: 0.0094) MultiSource/Benchmarks/McCat/09-vor/vor: 12.14% (0.3180 => 0.3566, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 12.09% (0.1125 => 0.1261, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.06% (0.3441 => 0.3856, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.00% (0.2266 => 0.2538, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.84% (0.8101 => 0.9060, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 11.83% (0.6456 => 0.7220, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 11.70% (1.5603 => 1.7429, std.dev.: 0.0025) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.46% (0.1143 => 0.1274, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.21% (1.1194 => 1.2449, std.dev.: 0.0094) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.89% (0.1892 => 0.2098, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 10.48% (0.4620 => 0.5104, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 10.46% (2.2969 => 2.5372, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash: 10.45% (0.4289 => 0.4737, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/trivial-interface: 10.42% (0.3473 => 0.3835, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 10.35% (21.9371 => 24.2074, std.dev.: 0.0086) SingleSource/UnitTests/ObjC/synchronized: 10.31% (0.3561 => 0.3928, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.29% (0.3828 => 0.4222, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.29% (0.3927 => 0.4331, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.25% (0.3543 => 0.3906, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.22% (0.3543 => 0.3905, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: 10.18% (0.3497 => 0.3853, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.18% (0.3694 => 0.4070, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.15% (0.3516 => 0.3873, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.09% (0.3886 => 0.4278, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.06% (0.1044 => 0.1149, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.01% (0.3865 => 0.4252, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.85% (0.4203 => 0.4617, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 9.79% (0.3422 => 0.3757, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.67% (0.3826 => 0.4196, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 9.46% (0.4048 => 0.4431, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 9.45% (0.3684 => 0.4032, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.41% (0.4103 => 0.4489, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.25% (0.4636 => 0.5065, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.99% (0.3427 => 0.3735, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 8.94% (0.3603 => 0.3925, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.92% (0.6030 => 0.6568, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.81% (0.5925 => 0.6447, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.77% (0.2430 => 0.2643, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 8.73% (17.1811 => 18.6817, std.dev.: 0.0155) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.32% (0.4064 => 0.4402, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.26% (0.7326 => 0.7931, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.25% (3.8922 => 4.2133, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.09% (0.2891 => 0.3125, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.06% (14.3668 => 15.5250, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.05% (0.3650 => 0.3944, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 8.02% (0.2905 => 0.3138, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 7.91% (0.3098 => 0.3343, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.84% (0.2831 => 0.3053, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 7.64% (0.3232 => 0.3479, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 7.58% (0.3283 => 0.3532, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.56% (0.3162 => 0.3401, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.56% (0.2872 => 0.3089, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.55% (0.2793 => 0.3004, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.46% (2.0665 => 2.2206, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.38% (0.2725 => 0.2926, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.37% (0.3136 => 0.3367, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 7.31% (0.3379 => 0.3626, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 7.31% (0.3052 => 0.3275, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 7.28% (0.2871 => 0.3080, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.26% (0.2877 => 0.3086, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.22% (0.2714 => 0.2910, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 7.21% (0.2802 => 0.3004, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 6.70% (1.2842 => 1.3702, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 6.10% (0.3131 => 0.3322, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.71% (0.3935 => 0.4081, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.70% (0.3817 => 0.3920, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.51% (5.3999 => 13.3115, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1725, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.37% (0.9957 => 1.1288, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.55% (0.2944 => 0.3284, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.92% (1.1396 => 1.2527, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 6.64% (3.1578 => 3.3676, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.64% (2.8904 => 3.0824, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 5.08% (0.5413 => 0.5688, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 3.80% (1.9405 => 2.0143, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.63% (0.3987 => 0.4092, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.59% (4.2280 => 4.3376, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.12% (3.6395 => 3.7166, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.09% (1.0313 => 1.0529, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bisort/bisort: 1.81% (0.8333 => 0.8484, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 1.54% (3.1595 => 3.2081, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.47% (2.6546 => 2.6935, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 1.14% (4.4649 => 4.5158, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.09% (6.5088 => 6.5798, std.dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.99% (6.6874 => 0.1343, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -77.29% (0.8651 => 0.1965, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.09% (5.2763 => 3.3195, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.08% (5.3855 => 3.7657, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -29.61% (5.3526 => 3.7675, std.dev.: 0.0033) SingleSource/UnitTests/Vector/constpool: -9.45% (54.1659 => 49.0484, std.dev.: 0.0147) MultiSource/Applications/ClamAV/clamscan: -2.88% (22.1758 => 21.5375, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -52.87% (8.0499 => 3.7938, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.53% (1.1492 => 0.7639, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4751, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.87% (1.6925 => 1.4239, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.67% (1.2258 => 1.0705, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.55% (1.2373 => 1.0944, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -10.98% (1.5373 => 1.3685, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.42% (19.9488 => 18.2684, std.dev.: 0.0159) MultiSource/Benchmarks/FreeBench/mason/mason: -7.87% (0.2161 => 0.1991, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.01% (1.8329 => 1.7044, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5757, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.17% (1.6805 => 1.5937, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5081, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.28% (8.1563 => 7.8069, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Applications/siod/siod: -3.68% (3.2827 => 3.1620, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -3.39% (5.0483 => 4.8774, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4982, std.dev.: 0.0072) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.77% (0.4808 => 0.4675, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -2.14% (4.6441 => 4.5445, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.82% (10.2830 => 10.0961, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6812, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -1.64% (2.5528 => 2.5110, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4211, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/lists: -1.12% (6.2999 => 6.2292, std.dev.: 0.0069) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.12% (2.3135 => 2.2877, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.08% (1.0554 => 1.0440, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8583, std.dev.: 0.0079) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 20.02% (0.5229 => 0.6276, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 15.29% (14.9895 => 17.2811, std.dev.: 0.0047) MultiSource/Applications/kimwitu++/kc: 10.57% (14.1553 => 15.6520, std.dev.: 0.0148) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 35.89% (1.1048 => 1.5013, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 15.68% (7.1582 => 8.2806, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.22% (0.6222 => 0.6920, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.30% (0.1485 => 0.1436, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.85% (0.2116 => 0.2134, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 24 07:47:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 24 Oct 2012 09:47:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121024144713.37B9D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5165?compare_to=5161&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5165, Order: 166547, Start Time: 2012-10-24 11:33:40, End Time: 2012-10-24 14:49:17 To: 5161, Order: 166546, Start Time: 2012-10-24 07:29:53, End Time: 2012-10-24 10:45:38 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (171 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1038 (719 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 7.29% (0.2085 => 0.2237, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.78% (0.3735 => 0.3839, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: 1.72% (0.6107 => 0.6212, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.48% (54.1338 => 54.9346, std.dev.: 0.0858) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 43.04% (0.0625 => 0.0894, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.49% (0.1063 => 0.1419, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.95% (0.1106 => 0.1393, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.77% (0.2969 => 0.3734, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.58% (0.4253 => 0.5341, std.dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 25.33% (1.5932 => 1.9968, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.52% (0.4139 => 0.5154, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.23% (0.0714 => 0.0887, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.89% (0.4994 => 0.6187, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.77% (0.0547 => 0.0677, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.61% (0.5900 => 0.7293, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.58% (0.0475 => 0.0587, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.00% (0.5000 => 0.6150, std.dev.: 0.0023) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.77% (0.0584 => 0.0717) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.59% (0.1620 => 0.1986, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.04% (0.1021 => 0.1246, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 21.87% (0.0599 => 0.0730, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.86% (0.1107 => 0.1349, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.29% (0.0897 => 0.1088, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 20.99% (0.0948 => 0.1147, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 20.86% (0.0604 => 0.0730, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.85% (0.0633 => 0.0765, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.56% (0.0642 => 0.0774, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.55% (0.0584 => 0.0704, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.52% (0.0541 => 0.0652, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.49% (0.1103 => 0.1329, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 20.46% (0.0821 => 0.0989, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.40% (0.0495 => 0.0596, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 20.32% (0.1619 => 0.1948, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.32% (0.0822 => 0.0989, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.20% (0.1604 => 0.1928, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.01% (0.3903 => 0.4684, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.94% (0.1003 => 0.1203, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.82% (0.1549 => 0.1856, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 19.11% (0.0947 => 0.1128, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 18.61% (0.5826 => 0.6910, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.60% (0.1462 => 0.1734, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.57% (0.2014 => 0.2388, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.41% (0.3890 => 0.4606, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 18.39% (0.1218 => 0.1442, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 18.36% (0.5889 => 0.6970, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 18.19% (0.0808 => 0.0955, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 18.07% (0.1505 => 0.1777, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.96% (1.3152 => 1.5514, std.dev.: 0.0031) MultiSource/Applications/spiff/spiff: 17.82% (0.4029 => 0.4747, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 17.77% (0.0698 => 0.0822, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.65% (0.1088 => 0.1280, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.47% (0.2736 => 0.3214, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.32% (3.5627 => 4.1799, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.24% (0.2866 => 0.3360, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 17.02% (0.5546 => 0.6490, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.98% (0.1160 => 0.1357, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 16.91% (1.8794 => 2.1973, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.90% (0.2875 => 0.3361, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.77% (1.6211 => 1.8930, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 16.68% (0.1421 => 0.1658, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.62% (0.1968 => 0.2295, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 16.51% (0.7171 => 0.8355, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.44% (0.4658 => 0.5424, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 16.40% (0.9697 => 1.1287, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/fibo: 16.37% (0.2725 => 0.3171, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 16.25% (0.2714 => 0.3155, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 16.25% (0.3004 => 0.3492, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 16.22% (0.2780 => 0.3231, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.22% (0.2738 => 0.3182, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.20% (0.3271 => 0.3801, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.15% (0.2792 => 0.3243, std.dev.: 0.0044) MultiSource/Applications/d/make_dparser: 16.13% (1.0781 => 1.2520, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/except: 16.12% (0.2811 => 0.3264, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.05% (0.2729 => 0.3167, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.98% (2.7292 => 3.1653, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.96% (0.5026 => 0.5828, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: 15.93% (0.2750 => 0.3188, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 15.84% (0.9909 => 1.1479, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 15.84% (0.2803 => 0.3247, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/bh/bh: 15.81% (0.1284 => 0.1487, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.80% (0.4361 => 0.5050, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 15.78% (0.2813 => 0.3257, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.77% (0.3195 => 0.3699, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 15.73% (0.3096 => 0.3583, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 15.69% (0.2823 => 0.3266, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.67% (0.3930 => 0.4546, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.66% (2.0673 => 2.3911, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.64% (1.9694 => 2.2774, std.dev.: 0.0023) MultiSource/Applications/ClamAV/clamscan: 15.55% (4.2109 => 4.8659, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.53% (0.2911 => 0.3363, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.31% (1.9966 => 2.3023, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary3: 15.27% (0.3267 => 0.3766, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 15.22% (0.3317 => 0.3822, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.21% (4.4195 => 5.0918, std.dev.: 0.0069) MultiSource/Benchmarks/Bullet/bullet: 15.12% (23.5202 => 27.0753, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary: 15.07% (0.3258 => 0.3749, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.86% (0.1090 => 0.1252, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.81% (0.3362 => 0.3860, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.74% (0.3060 => 0.3511, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.72% (0.3124 => 0.3584, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 14.58% (0.3348 => 0.3836, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 14.41% (0.3726 => 0.4263, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/moments: 14.38% (0.3678 => 0.4207, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 14.24% (0.3442 => 0.3932, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.20% (0.3282 => 0.3748, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.12% (0.3625 => 0.4137, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.07% (0.3981 => 0.4541, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 13.99% (0.3446 => 0.3928, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 13.97% (0.3465 => 0.3949, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.96% (0.3690 => 0.4205, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 13.95% (1.4269 => 1.6260, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.93% (0.3488 => 0.3974, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 13.92% (0.3477 => 0.3961, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 13.91% (0.2566 => 0.2923, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: 13.90% (0.3496 => 0.3982, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 13.88% (0.2075 => 0.2363, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 13.81% (0.4251 => 0.4838, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.81% (0.3469 => 0.3948, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 13.80% (0.4146 => 0.4718, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/exceptions-3: 13.79% (0.3460 => 0.3937, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.60% (0.3845 => 0.4368, std.dev.: 0.0115) SingleSource/UnitTests/ObjC/exceptions: 13.51% (0.3643 => 0.4135, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 13.45% (0.3650 => 0.4141, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 13.45% (0.7875 => 0.8934, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/parameter-passing: 13.29% (0.3724 => 0.4219, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 13.26% (2.1653 => 2.4525, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: 13.15% (0.5012 => 0.5671, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 12.92% (4.6177 => 5.2145, std.dev.: 0.0063) MultiSource/Benchmarks/mafft/pairlocalalign: 12.63% (2.1013 => 2.3666, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.45% (0.2040 => 0.2294, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 12.00% (0.2691 => 0.3014, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 11.80% (5.5417 => 6.1956, std.dev.: 0.0123) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.73% (0.6435 => 0.7190, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.19% (0.1028 => 0.1143, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.18% (0.2737 => 0.3043, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.98% (0.2068 => 0.2295, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 10.89% (0.3498 => 0.3879, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.63% (0.1383 => 0.1530, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 10.48% (0.6634 => 0.7329, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.44% (0.3084 => 0.3406, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 10.17% (0.4847 => 0.5340, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 10.01% (0.3336 => 0.3670, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.61% (0.2103 => 0.2305, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 9.28% (0.2391 => 0.2613, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 9.22% (2.0346 => 2.2221, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.07% (4.6926 => 5.1181, std.dev.: 0.0207) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.75% (0.5361 => 0.5830, std.dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.73% (11.6398 => 12.6557, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.20% (0.5584 => 0.6042, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.95% (0.7426 => 0.8016, std.dev.: 0.0027) MultiSource/Applications/kimwitu++/kc: 6.69% (11.9555 => 12.7557, std.dev.: 0.0094) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.56% (0.3792 => 0.3965, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6535, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 7.96% (0.2802 => 0.3025, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6108, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 5.42% (0.2122 => 0.2237, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/objinst: 5.00% (12.0509 => 12.6539, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1682, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.95% (0.3693 => 0.3839, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-2: 3.85% (1.8057 => 1.8752, std.dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/dry: 2.74% (14.0481 => 14.4329, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1924, std.dev.: 0.0053) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.66% (3.1722 => 3.2247, std.dev.: 0.0039) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3048, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2858, std.dev.: 0.0024) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.26% (1.0142 => 1.0270, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1062, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5139, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.08% (1.2451 => 1.2586, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5869, std.dev.: 0.0055) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.64% (2.4764 => 2.4358, std.dev.: 0.0091) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.49% (25.4195 => 16.3971, std.dev.: 0.0113) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9783, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -7.69% (35.5013 => 32.7728, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -6.87% (0.2402 => 0.2237, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7749, std.dev.: 0.0027) SingleSource/UnitTests/Vector/build2: -2.99% (11.2080 => 10.8729, std.dev.: 0.0267) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5219, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.39% (17.2379 => 16.8266, std.dev.: 0.0248) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.21% (41.7953 => 40.8726, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5720, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4953, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.10% (105.3826 => 104.2284, std.dev.: 0.0586) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0450, std.dev.: 0.0035) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.02% (3.3991 => 3.3644, std.dev.: 0.0008) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 24 08:53:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 24 Oct 2012 10:53:54 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121024155354.2C5BB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5166?compare_to=5162&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5166, Order: 166560, Start Time: 2012-10-24 14:32:29, End Time: 2012-10-24 15:56:00 To: 5162, Order: 166552, Start Time: 2012-10-24 12:52:15, End Time: 2012-10-24 14:15:55 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 6 (58 on baseline) Performance Improvements: 1 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 968 (912 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 1.24% (15.1195 => 15.3074, std.dev.: 0.0249) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/SPASS/SPASS: 4.58% (8.1820 => 8.5568, std.dev.: 0.0950) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.30% (1.0073 => 1.0305, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.73% (2.8751 => 2.9247, std.dev.: 0.0110) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.38% (21.9339 => 22.2357, std.dev.: 0.0597) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.04% (1.6086 => 1.6253, std.dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.36% (1.2737 => 1.2564, std.dev.: 0.0041) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.31% (16.6010 => 16.5502, std.dev.: 0.1163) MultiSource/Applications/obsequi/Obsequi: -0.33% (1.0640 => 1.0605, std.dev.: 0.0145) MultiSource/Applications/sqlite3/sqlite3: 0.56% (0.6444 => 0.6480, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/08-main/main: 4.63% (0.1879 => 0.1966, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.94% (0.1624 => 0.1688, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.28% (0.3224 => 0.3233, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.92% (0.2448 => 0.2495, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.71% (0.3374 => 0.3350, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.20% (0.2420 => 0.2391, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: -0.15% (0.6006 => 0.5997, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel: - (0.0471 => 0.0471, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.03% (0.3320 => 0.3321, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/strcat: -0.50% (0.2002 => 0.1992, std.dev.: 0.0015) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 19.07% (0.0215 => 0.0256, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -22.54% (0.0213 => 0.0165, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.70% (0.0428 => 0.0425, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -24.10% (0.0332 => 0.0252, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.95% (0.0316 => 0.0313, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -15.42% (0.0428 => 0.0362, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/casts: -0.98% (0.0205 => 0.0203, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -1.36% (0.0220 => 0.0217, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 11.33% (0.0309 => 0.0344, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.67% (0.1484 => 0.1474, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.01% (1.1401 => 1.1630, std.dev.: 0.0085) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -4.49% (0.1513 => 0.1445, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.53% (0.4131 => 0.3944, std.dev.: 0.0606) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.56% (0.1421 => 0.1429, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.79% (0.0613 => 0.0553, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -10.62% (0.0226 => 0.0202, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.77% (0.0564 => 0.0554, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.35% (1.1397 => 1.1437, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -11.76% (0.0017 => 0.0015, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.16% (0.0584 => 0.0548, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.81% (0.0253 => 0.0170, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: - (0.8004 => 0.8004, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -25.86% (0.0058 => 0.0043, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.72% (2.1832 => 1.6654, std.dev.: 0.0006) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.59% (0.2180 => 0.2389, std.dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: 6.85% (0.1577 => 0.1685, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.63% (0.2279 => 0.2430, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.54% (0.2240 => 0.2364, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.49% (0.7473 => 0.7883, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.97% (0.2998 => 0.3147, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.72% (0.6287 => 0.6584, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.58% (1.1606 => 1.2138, std.dev.: 0.0125) MultiSource/Applications/sgefa/sgefa: 4.10% (0.2999 => 0.3122, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.07% (1.1685 => 1.2160, std.dev.: 0.0066) MultiSource/Applications/Burg/burg: 4.02% (1.2222 => 1.2713, std.dev.: 0.0065) MultiSource/Applications/treecc/treecc: 3.89% (1.9948 => 2.0723, std.dev.: 0.0105) MultiSource/Applications/hbd/hbd: 3.76% (1.4269 => 1.4806, std.dev.: 0.0068) MultiSource/Applications/ClamAV/clamscan: 3.65% (14.7684 => 15.3074, std.dev.: 0.0249) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.65% (1.6386 => 1.6984, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/bh/bh: 3.52% (0.2985 => 0.3090, std.dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: 3.42% (1.2568 => 1.2998, std.dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.31% (6.6074 => 6.8261, std.dev.: 0.0477) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.26% (0.3717 => 0.3838, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.63% (4.5702 => 4.6902, std.dev.: 0.0221) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.61% (4.1763 => 4.2855, std.dev.: 0.0224) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.61% (4.4873 => 4.6045, std.dev.: 0.0284) MultiSource/Applications/lemon/lemon: 2.38% (1.0945 => 1.1206, std.dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 2.37% (1.1271 => 1.1538, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.35% (1.2526 => 1.2820, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.32% (0.7966 => 0.8151, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.29% (1.4479 => 1.4811, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.22% (0.8697 => 0.8890, std.dev.: 0.0027) MultiSource/Applications/d/make_dparser: 2.22% (3.2366 => 3.3083, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.14% (0.8457 => 0.8638, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.10% (13.1811 => 13.4585, std.dev.: 0.0999) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.10% (0.8007 => 0.8175, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 2.06% (0.6834 => 0.6975, std.dev.: 0.0050) MultiSource/Applications/JM/lencod/lencod: 1.87% (15.3280 => 15.6139, std.dev.: 0.0734) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.85% (0.8177 => 0.8328, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.73% (0.9039 => 0.9195, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.65% (0.8317 => 0.8454, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.57% (0.8656 => 0.8792, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.56% (0.9074 => 0.9216, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.56% (0.8316 => 0.8446, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.56% (0.8086 => 0.8212, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.52% (0.9056 => 0.9194, std.dev.: 0.0017) MultiSource/Applications/siod/siod: 1.52% (2.2184 => 2.2522, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.47% (1.2602 => 1.2787, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.44% (0.7932 => 0.8046, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.33% (0.8066 => 0.8173, std.dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 1.23% (31.8598 => 32.2502, std.dev.: 0.1028) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.13% (1.2423 => 1.2564, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 44.94% (1.5795 => 2.2893, std.dev.: 0.1025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.45% (0.3186 => 0.3519, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.21% (1.1857 => 1.2830, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 5.91% (63.1822 => 66.9170, std.dev.: 0.1201) SingleSource/Benchmarks/Misc/ReedSolomon: 3.43% (8.5322 => 8.8248, std.dev.: 0.0156) MultiSource/Applications/siod/siod: 2.61% (3.6643 => 3.7598, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.09% (2.4490 => 2.5003, std.dev.: 0.0136) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.96% (1.5941 => 1.6253, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/bh/bh: 1.71% (2.3560 => 2.3962, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.65% (2.8773 => 2.9247, std.dev.: 0.0110) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.05% (0.3269 => 0.2973, std.dev.: 0.0022) MultiSource/Applications/lua/lua: -5.24% (29.8330 => 28.2710, std.dev.: 0.0908) SingleSource/Benchmarks/Shootout-C++/hash2: -1.49% (3.4237 => 3.3728, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.19% (3.3479 => 3.3082, std.dev.: 0.0026) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.63% (16.4461 => 16.5502, std.dev.: 0.1163) MultiSource/Applications/obsequi/Obsequi: 3.34% (1.0262 => 1.0605, std.dev.: 0.0145) MultiSource/Applications/sqlite3/sqlite3: 2.34% (0.6332 => 0.6480, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/08-main/main: 7.37% (0.1831 => 0.1966, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 8.27% (0.1559 => 0.1688, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.52% (0.3123 => 0.3233, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (0.2463 => 0.2495, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.18% (0.3344 => 0.3350, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.14% (0.2364 => 0.2391, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: -0.22% (0.6010 => 0.5997, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel: 9.79% (0.0429 => 0.0471, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.68% (0.3266 => 0.3321, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/strcat: 1.17% (0.1969 => 0.1992, std.dev.: 0.0015) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 14.29% (0.0224 => 0.0256, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 34.15% (0.0123 => 0.0165, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.17% (0.0408 => 0.0425, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.79% (0.0254 => 0.0252, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -5.73% (0.0384 => 0.0362, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 49.57% (0.0230 => 0.0344, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.50% (0.1438 => 0.1474, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.66% (1.1329 => 1.1630, std.dev.: 0.0085) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.16% (0.1462 => 0.1445, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.28% (0.4164 => 0.3944, std.dev.: 0.0606) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.38% (0.1369 => 0.1429, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -13.73% (0.0641 => 0.0553, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 3.59% (0.0195 => 0.0202, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.15% (0.0578 => 0.0554, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: - (1.1437 => 1.1437, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 7.14% (0.0014 => 0.0015, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.60% (0.0627 => 0.0548, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.56% (0.0180 => 0.0170, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.16% (0.8017 => 0.8004, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -30.65% (0.0062 => 0.0043, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 24 09:08:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 24 Oct 2012 11:08:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121024160808.77FAE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5167?compare_to=5163&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5167, Order: 166562, Start Time: 2012-10-24 14:45:38, End Time: 2012-10-24 16:10:12 To: 5163, Order: 166552, Start Time: 2012-10-24 12:57:44, End Time: 2012-10-24 14:22:29 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 1 (185 on baseline) Unchanged Tests: 1040 (852 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 4.51% (41.0597 => 42.9096, std.dev.: 0.0842) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.52% (56.4082 => 54.4203, std.dev.: 0.2085) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 2.61% (7.4937 => 7.6896, std.dev.: 0.0153) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1011, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash2: 2.19% (3.1932 => 3.2631, std.dev.: 0.0027) MultiSource/Benchmarks/llubenchmark/llu: 2.07% (3.7435 => 3.8209, std.dev.: 0.0174) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.29% (0.1431 => 0.1298, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.45% (0.3821 => 0.3498, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -8.16% (0.3812 => 0.3501, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -8.14% (0.3831 => 0.3519, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -8.06% (0.3884 => 0.3571, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: -8.02% (0.3880 => 0.3569, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -8.01% (0.3896 => 0.3584, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: -8.00% (0.3848 => 0.3540, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.97% (0.3891 => 0.3581, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -7.88% (0.4033 => 0.3715, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -7.85% (2.4924 => 2.2967, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -7.79% (0.4199 => 0.3872, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: -7.78% (0.4176 => 0.3851, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -7.69% (0.4280 => 0.3951, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.57% (22.4056 => 20.7100, std.dev.: 0.0142) MultiSource/Applications/sgefa/sgefa: -7.39% (0.3357 => 0.3109, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.37% (0.9542 => 0.8839, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.16% (0.3142 => 0.2917, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -7.14% (3.5339 => 3.2815, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: -6.99% (0.2160 => 0.2009, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -6.98% (16.1920 => 15.0626, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: -6.97% (0.9179 => 0.8539, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.96% (0.2428 => 0.2259, std.dev.: 0.0038) MultiSource/Benchmarks/nbench/nbench: -6.95% (1.1530 => 1.0729, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -6.93% (0.1761 => 0.1639, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.92% (5.4682 => 5.0897, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.90% (0.1796 => 0.1672, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.90% (0.6736 => 0.6271, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: -6.88% (7.0961 => 6.6076, std.dev.: 0.0087) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.88% (0.2355 => 0.2193, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.87% (1.3722 => 1.2779, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.84% (6.7716 => 6.3084, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.83% (0.3658 => 0.3408, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.82% (0.1584 => 0.1476, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: -6.82% (9.2283 => 8.5992, std.dev.: 0.0097) MultiSource/Benchmarks/MallocBench/gs/gs: -6.78% (4.3330 => 4.0392, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/ReedSolomon: -6.76% (0.1879 => 0.1752, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: -6.73% (1.2515 => 1.1673, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.72% (0.4151 => 0.3872, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.72% (0.9852 => 0.9190, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.72% (0.2695 => 0.2514, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.71% (1.6474 => 1.5369, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.69% (0.6484 => 0.6050, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: -6.67% (0.7447 => 0.6950, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.67% (1.0544 => 0.9841, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.66% (4.0323 => 3.7639, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: -6.64% (0.4861 => 0.4538, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.60% (0.7919 => 0.7396, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.59% (4.5069 => 4.2097, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: -6.58% (0.2659 => 0.2484, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.57% (4.8161 => 4.4995, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.56% (1.4642 => 1.3681, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.54% (1.6364 => 1.5294, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: -6.53% (0.2985 => 0.2790, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.52% (1.2300 => 1.1498, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.51% (0.2548 => 0.2382, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.51% (4.8802 => 4.5624, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.50% (1.2784 => 1.1953, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: -6.50% (0.9557 => 0.8936, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.48% (0.4813 => 0.4501, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: -6.48% (0.3581 => 0.3349, std.dev.: 0.0034) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.47% (0.1716 => 0.1605, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -6.46% (1.3148 => 1.2298, std.dev.: 0.0006) MultiSource/Applications/lua/lua: -6.46% (4.0594 => 3.7971, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/05-eks/eks: -6.45% (0.4515 => 0.4224, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: -6.44% (0.5168 => 0.4835, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.44% (2.2587 => 2.1132, std.dev.: 0.0241) MultiSource/Applications/lemon/lemon: -6.43% (1.1450 => 1.0714, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -6.43% (2.4021 => 2.2477, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: -6.42% (15.5079 => 14.5126, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.39% (0.3849 => 0.3603, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: -6.37% (0.4524 => 0.4236, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: -6.35% (0.1621 => 0.1518, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -6.31% (1.3864 => 1.2989, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: -6.30% (0.3491 => 0.3271, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.28% (0.5999 => 0.5622, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -6.28% (0.3406 => 0.3192, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.25% (0.7021 => 0.6582, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: -6.25% (0.6750 => 0.6328, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -6.23% (0.7524 => 0.7055, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.23% (0.3931 => 0.3686, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.21% (0.5329 => 0.4998, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.19% (0.5925 => 0.5558, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.19% (14.2083 => 13.3286, std.dev.: 0.0195) MultiSource/Benchmarks/Bullet/bullet: -6.19% (34.0927 => 31.9825, std.dev.: 0.0085) MultiSource/Applications/ClamAV/clamscan: -6.17% (15.2527 => 14.3110, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.17% (0.5805 => 0.5447, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.16% (1.2221 => 1.1468, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.16% (0.6189 => 0.5808, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: -6.15% (0.3059 => 0.2871, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.15% (0.6297 => 0.5910, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: -6.14% (0.4248 => 0.3987, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.14% (0.4916 => 0.4614, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: -6.14% (3.5154 => 3.2996, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: -6.14% (0.2999 => 0.2815, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.13% (1.2210 => 1.1461, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.13% (0.5857 => 0.5498, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.13% (0.5859 => 0.5500, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.13% (0.8521 => 0.7999, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.12% (0.4083 => 0.3833, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.12% (0.2385 => 0.2239, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.12% (0.6293 => 0.5908, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -6.12% (0.3025 => 0.2840, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.11% (0.6304 => 0.5919, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.10% (0.7339 => 0.6891, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.10% (0.5802 => 0.5448, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.10% (0.6395 => 0.6005, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -6.09% (0.3446 => 0.3236, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.08% (0.5591 => 0.5251, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.08% (0.5478 => 0.5145, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.07% (0.5863 => 0.5507, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -6.06% (0.4321 => 0.4059, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -6.06% (0.5575 => 0.5237, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: -6.06% (2.1401 => 2.0105, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: -6.06% (0.2989 => 0.2808, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.05% (0.6260 => 0.5881, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.05% (0.6052 => 0.5686, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -6.05% (0.5705 => 0.5360, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.05% (0.6681 => 0.6277, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.04% (2.1713 => 2.0401, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -6.03% (8.0126 => 7.5298, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.02% (0.3837 => 0.3606, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -6.01% (0.6667 => 0.6266, std.dev.: 0.0084) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -6.01% (0.2278 => 0.2141, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -6.00% (0.6230 => 0.5856, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.00% (0.7198 => 0.6766, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -6.00% (17.1032 => 16.0777, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/lists: -5.99% (0.3621 => 0.3404, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.99% (0.3323 => 0.3124, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.98% (0.6660 => 0.6262, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.97% (0.3252 => 0.3058, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.96% (0.5569 => 0.5237, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.96% (0.6446 => 0.6062, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: -5.95% (0.3394 => 0.3192, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: -5.95% (0.3194 => 0.3004, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -5.95% (0.3481 => 0.3274, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.93% (0.6676 => 0.6280, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.93% (0.6395 => 0.6016, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.92% (0.5941 => 0.5589, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -5.92% (0.3026 => 0.2847, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.91% (0.3483 => 0.3277, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.90% (0.6033 => 0.5677, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: -5.90% (18.2933 => 17.2142, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.89% (0.5567 => 0.5239, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -5.87% (0.3271 => 0.3079, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: -5.86% (0.7779 => 0.7323, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: -5.85% (0.2871 => 0.2703, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.85% (0.3319 => 0.3125, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -5.84% (0.3255 => 0.3065, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.83% (0.5456 => 0.5138, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.81% (0.5581 => 0.5257, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.81% (0.4427 => 0.4170, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.80% (0.5849 => 0.5510, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.79% (0.2106 => 0.1984, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -5.78% (0.6347 => 0.5980, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.78% (0.6440 => 0.6068, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.77% (0.3016 => 0.2842, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.76% (0.5570 => 0.5249, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/random: -5.75% (0.2939 => 0.2770, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.73% (0.2933 => 0.2765, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.72% (0.2903 => 0.2737, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.71% (0.5688 => 0.5363, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: -5.71% (0.3205 => 0.3022, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: -5.70% (0.3788 => 0.3572, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -5.66% (0.3867 => 0.3648, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.66% (0.3057 => 0.2884, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -5.65% (0.2849 => 0.2688, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -5.62% (0.8418 => 0.7945, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: -5.60% (0.6441 => 0.6080, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -5.49% (0.7982 => 0.7544, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.25% (0.2001 => 0.1896, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -5.07% (0.9077 => 0.8617, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.83% (0.2277 => 0.2167, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -4.73% (1.5610 => 1.4871, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: -4.60% (5.0226 => 4.7916, std.dev.: 0.0098) SingleSource/UnitTests/Vector/constpool: -3.20% (20.7746 => 20.1108, std.dev.: 0.0349) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7506, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: -8.72% (1.2842 => 1.1722, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: -3.96% (2.2633 => 2.1736, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7063, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.60% (1.3096 => 1.2625, std.dev.: 0.0144) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.56% (6.5735 => 6.4707, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0003) Report Time: 1.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 24 09:12:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 24 Oct 2012 11:12:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121024161234.C5F5E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5168?compare_to=5164&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5168, Order: 166562, Start Time: 2012-10-24 14:54:04, End Time: 2012-10-24 16:14:39 To: 5164, Order: 166552, Start Time: 2012-10-24 13:04:09, End Time: 2012-10-24 14:24:26 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (5 on baseline) Performance Regressions: 3 (198 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 88 (14 on baseline) Unchanged Tests: 951 (643 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 7.21% (0.3855 => 0.4133, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.74% (27.7286 => 29.5968, std.dev.: 0.0304) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.84% (41.6692 => 42.8535, std.dev.: 0.0998) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.11% (0.6276 => 0.6283, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: -0.06% (17.2811 => 17.2714, std.dev.: 0.0095) MultiSource/Applications/kimwitu++/kc: 0.06% (15.6520 => 15.6607, std.dev.: 0.0073) MultiSource/Benchmarks/Bullet/bullet: 0.06% (56.1365 => 56.1710, std.dev.: 0.0409) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.20% (0.0489 => 0.0488, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.20% (0.0491 => 0.0490, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.22% (0.0459 => 0.0458) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.22% (0.0460 => 0.0459, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.22% (0.0448 => 0.0447, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.22% (0.0449 => 0.0448, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.23% (0.0441 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.23% (0.0442 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.22% (0.0459 => 0.0458) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.22% (0.0460 => 0.0459, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.22% (0.0453 => 0.0452, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.22% (0.0455 => 0.0454, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.23% (0.0444 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.22% (0.0445 => 0.0444) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.22% (0.0451 => 0.0450, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.22% (0.0452 => 0.0451, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.22% (0.0462 => 0.0461) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.32% (0.0463 => 0.0483, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.23% (0.0438 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.23% (0.0439 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.22% (0.0450 => 0.0449, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0451 => 0.0451) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.23% (0.0442 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0442 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0433 => 0.0433) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.46% (0.0435 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.46% (0.0434 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.23% (0.0434 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.21% (0.0470 => 0.0469, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.21% (0.0471 => 0.0470, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0431 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.23% (0.0432 => 0.0431, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.23% (0.0434 => 0.0433) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.23% (0.0435 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.23% (0.0440 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.23% (0.0441 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.03% (1.5013 => 1.5017, std.dev.: 0.0056) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.22% (8.2806 => 8.2621, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.13% (0.6920 => 0.6911, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1436 => 0.1436, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.08% (0.2134 => 0.2157, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -11.18% (63.2438 => 56.1710, std.dev.: 0.0409) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/MallocBench/gs/gs: 13.27% (4.1105 => 4.6558, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.39% (3.4629 => 5.8313, std.dev.: 0.0290) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13511.94% (0.0720 => 9.8006, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050400.00% (0.0001 => 10.0505, std.dev.: 0.0013) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 69.14% (0.0256 => 0.0433) MultiSource/Benchmarks/McCat/08-main/main: 64.60% (0.2554 => 0.4204, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: 51.94% (10.3673 => 15.7521, std.dev.: 0.0126) SingleSource/Regression/C/sumarraymalloc: 50.62% (0.0243 => 0.0366) SingleSource/UnitTests/SignlessTypes/factor: 47.30% (0.0296 => 0.0436, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 43.91% (0.0271 => 0.0390, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.16% (1.5859 => 2.2386, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 38.72% (0.1622 => 0.2250, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 37.31% (0.1056 => 0.1450, std.dev.: 0.0010) SingleSource/UnitTests/vla: 32.96% (0.0355 => 0.0472, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.31% (2.2024 => 2.8700, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/neural/neural: 27.89% (0.1463 => 0.1871, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 24.46% (0.0834 => 0.1038, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 24.05% (0.1655 => 0.2053, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.33% (0.1566 => 0.1900, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 21.30% (0.1432 => 0.1737, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 21.28% (0.2049 => 0.2485, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.45% (7.0540 => 8.4964, std.dev.: 0.0111) MultiSource/Benchmarks/FreeBench/pifft/pifft: 20.43% (2.2022 => 2.6522, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 18.97% (0.1555 => 0.1850, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.83% (0.0871 => 0.1035, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 18.16% (0.5105 => 0.6032, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.81% (0.6675 => 0.7864, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.30% (0.1029 => 0.1207, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 17.29% (0.1440 => 0.1689, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.96% (1.3050 => 1.5263, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.88% (0.4615 => 0.5394, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/lists: 16.77% (0.0626 => 0.0731, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 16.77% (0.1175 => 0.1372, std.dev.: 0.0018) MultiSource/Applications/d/make_dparser: 16.62% (3.3354 => 3.8897, std.dev.: 0.0145) MultiSource/Benchmarks/Olden/em3d/em3d: 16.58% (0.1695 => 0.1976, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.54% (0.8172 => 0.9524, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.47% (0.2271 => 0.2645, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 16.45% (0.1337 => 0.1557, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.39% (0.0793 => 0.0923, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/mst/mst: 16.25% (0.1163 => 0.1352, std.dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.18% (0.3121 => 0.3626, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 16.03% (0.3282 => 0.3808, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 15.95% (0.4879 => 0.5657, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 15.92% (0.1438 => 0.1667, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.84% (0.5020 => 0.5815, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.69% (0.0886 => 0.1025, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.68% (1.5415 => 1.7832, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.50% (0.1032 => 0.1192, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 15.48% (1.7609 => 2.0335, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/matrix: 15.40% (0.0818 => 0.0944, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.32% (0.0842 => 0.0971, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 15.29% (0.7115 => 0.8203, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.17% (0.1510 => 0.1739, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.11% (0.0675 => 0.0777, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 15.03% (0.0672 => 0.0773) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.00% (0.1940 => 0.2231, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.95% (0.1117 => 0.1284, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 14.92% (0.3109 => 0.3573, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 14.92% (0.3177 => 0.3651, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.88% (0.9765 => 1.1218, std.dev.: 0.0033) MultiSource/Applications/JM/ldecod/ldecod: 14.71% (10.4361 => 11.9711, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 14.70% (8.1363 => 9.3325, std.dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.68% (0.0838 => 0.0961, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.68% (0.0770 => 0.0883, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 14.64% (0.3423 => 0.3924, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.62% (0.2065 => 0.2367, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: 14.57% (1.1642 => 1.3338, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.53% (4.2646 => 4.8843, std.dev.: 0.0261) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.52% (0.2107 => 0.2413, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 14.48% (0.1906 => 0.2182, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.48% (0.0746 => 0.0854, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 14.27% (9.4845 => 10.8384, std.dev.: 0.0186) SingleSource/Benchmarks/CoyoteBench/almabench: 14.25% (0.0730 => 0.0834, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.23% (0.5860 => 0.6694, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.20% (0.1584 => 0.1809, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.16% (0.1236 => 0.1411, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.14% (0.2758 => 0.3148, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/exptree: 14.13% (0.0814 => 0.0929, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 14.07% (0.1151 => 0.1313, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.04% (0.0933 => 0.1064, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 13.88% (0.6450 => 0.7345, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.85% (0.2700 => 0.3074, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.81% (0.5981 => 0.6807, std.dev.: 0.0041) MultiSource/Applications/spiff/spiff: 13.81% (0.7835 => 0.8917, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.78% (0.0798 => 0.0908, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.78% (1.4186 => 1.6141, std.dev.: 0.0098) SingleSource/UnitTests/SignlessTypes/rem: 13.72% (0.1144 => 0.1301) MultiSource/Applications/oggenc/oggenc: 13.72% (5.7591 => 6.5494, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.65% (0.1062 => 0.1207, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.64% (0.0770 => 0.0875, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.63% (0.1695 => 0.1926, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 13.40% (2.0273 => 2.2990, std.dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 13.37% (1.1840 => 1.3423, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.36% (5.0018 => 5.6700, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 13.34% (4.9449 => 5.6044, std.dev.: 0.0080) MultiSource/Applications/lambda-0_1_3/lambda: 13.29% (0.7433 => 0.8421, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/health/health: 13.25% (0.1268 => 0.1436, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.14% (0.8067 => 0.9127, std.dev.: 0.0028) MultiSource/Benchmarks/sim/sim: 13.05% (0.3387 => 0.3829, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 12.90% (1.0722 => 1.2105, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.89% (0.5569 => 0.6287, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.89% (7.9617 => 8.9877, std.dev.: 0.0185) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.86% (0.1330 => 0.1501, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 12.78% (3.8723 => 4.3671, std.dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.74% (0.1625 => 0.1832, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 12.72% (0.4299 => 0.4846, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.70% (0.0929 => 0.1047, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.64% (0.3307 => 0.3725, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.61% (1.1861 => 1.3357, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/bh/bh: 12.52% (0.3092 => 0.3479, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.29% (0.2603 => 0.2923, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 12.27% (0.1125 => 0.1263, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 12.26% (0.3180 => 0.3570, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.22% (0.2266 => 0.2543, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.21% (0.8101 => 0.9090, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.03% (0.3441 => 0.3855, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/football/football: 11.95% (0.8921 => 0.9987, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.83% (0.3543 => 0.3962, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.71% (1.1194 => 1.2505, std.dev.: 0.0017) MultiSource/Applications/hbd/hbd: 11.71% (1.5603 => 1.7430, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/bigfib: 11.49% (0.6456 => 0.7198, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.46% (0.1143 => 0.1274, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.46% (0.3473 => 0.3871, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.29% (0.3543 => 0.3943, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.26% (0.3561 => 0.3962, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.21% (0.3497 => 0.3889, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.21% (0.1892 => 0.2104, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.20% (0.3927 => 0.4367, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.18% (0.3516 => 0.3909, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.15% (0.3828 => 0.4255, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.15% (0.3694 => 0.4106, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.01% (0.3886 => 0.4314, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 10.45% (21.9371 => 24.2294, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout-C++/hash2: 10.43% (0.4620 => 0.5102, std.dev.: 0.0053) MultiSource/Applications/siod/siod: 10.41% (2.2969 => 2.5359, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash: 10.21% (0.4289 => 0.4727, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.15% (0.1044 => 0.1150, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.83% (0.3865 => 0.4245, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 9.64% (0.3422 => 0.3752, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.64% (0.4203 => 0.4608, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.62% (0.3826 => 0.4194, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.39% (0.6030 => 0.6596, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.27% (0.5925 => 0.6474, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 9.20% (0.3684 => 0.4023, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 9.12% (0.4048 => 0.4417, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.04% (0.4103 => 0.4474, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.96% (0.3427 => 0.3734, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.93% (0.2430 => 0.2647, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.89% (0.4636 => 0.5048, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 8.73% (17.1811 => 18.6808, std.dev.: 0.0126) SingleSource/UnitTests/ObjC++/property-reference: 8.65% (0.7326 => 0.7960, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sieve: 8.63% (0.3603 => 0.3914, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.31% (3.8922 => 4.2155, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.19% (14.3668 => 15.5432, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.99% (0.2891 => 0.3122, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.85% (0.4064 => 0.4383, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.81% (0.3650 => 0.3935, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.75% (0.2905 => 0.3130, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 7.68% (0.3098 => 0.3336, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.59% (0.2831 => 0.3046, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 7.45% (0.2871 => 0.3085, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.43% (0.3232 => 0.3472, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 7.40% (0.3283 => 0.3526, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.40% (0.3162 => 0.3396, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.33% (0.2756 => 0.2958, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.28% (0.2872 => 0.3081, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.24% (0.3136 => 0.3363, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.23% (2.0665 => 2.2160, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.23% (0.2793 => 0.2995, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.16% (0.2725 => 0.2920, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.02% (0.2877 => 0.3079, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 7.01% (0.3379 => 0.3616, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 7.01% (0.3052 => 0.3266, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 6.96% (0.2714 => 0.2903, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.96% (0.2802 => 0.2997, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 6.54% (1.2842 => 1.3682, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: 5.91% (0.3131 => 0.3316, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.64% (0.3817 => 0.3956, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.43% (0.3935 => 0.4070, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.51% (5.3999 => 13.3115, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1725, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.72% (0.9957 => 1.1323, std.dev.: 0.0090) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.93% (1.1396 => 1.2528, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.1578 => 3.3686, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.64% (2.8904 => 3.0822, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 3.79% (1.9405 => 2.0141, std.dev.: 0.0046) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.71% (4.2280 => 4.3426, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.61% (0.3987 => 0.4091, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.92% (0.8333 => 0.8493, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.68% (3.6395 => 3.7006, std.dev.: 0.0077) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.57% (2.6546 => 2.6964, std.dev.: 0.0014) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2077, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 1.18% (4.4649 => 4.5177, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 1.10% (9.1159 => 9.2158, std.dev.: 0.0283) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.99% (6.6874 => 0.1344, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/salsa20: -76.95% (0.8651 => 0.1994, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -36.89% (5.2763 => 3.3300, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -29.92% (5.3855 => 3.7743, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -29.26% (5.3526 => 3.7866, std.dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -9.27% (54.1659 => 49.1434, std.dev.: 0.0210) MultiSource/Applications/ClamAV/clamscan: -2.90% (22.1758 => 21.5331, std.dev.: 0.0126) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -52.87% (8.0499 => 3.7936, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.45% (1.1492 => 0.7648, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.66% (2.9695 => 2.4749, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.87% (1.6925 => 1.4239, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.69% (1.2258 => 1.0703, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.44% (1.2373 => 1.0957, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -11.26% (1.5373 => 1.3642, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.38% (19.9488 => 18.2779, std.dev.: 0.0838) MultiSource/Benchmarks/FreeBench/mason/mason: -8.01% (0.2161 => 0.1988, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.97% (1.8329 => 1.7052, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.15% (1.6805 => 1.5939, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5091, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.22% (8.1563 => 7.8123, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.73% (1.3677 => 1.3167, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.65% (3.2827 => 3.1630, std.dev.: 0.0083) MultiSource/Benchmarks/sim/sim: -3.39% (5.0483 => 4.8773, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4986, std.dev.: 0.0037) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.66% (0.4808 => 0.4680, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -2.15% (4.6441 => 4.5443, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0857, std.dev.: 0.0137) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6794, std.dev.: 0.0028) SingleSource/UnitTests/Vector/multiplies: -1.68% (2.5528 => 2.5098, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4200, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.10% (2.3135 => 2.2880, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.07% (6.2999 => 6.2328, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8580, std.dev.: 0.0029) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 20.16% (0.5229 => 0.6283, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 15.22% (14.9895 => 17.2714, std.dev.: 0.0095) MultiSource/Applications/kimwitu++/kc: 10.63% (14.1553 => 15.6607, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 35.93% (1.1048 => 1.5017, std.dev.: 0.0056) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 15.42% (7.1582 => 8.2621, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.07% (0.6222 => 0.6911, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.30% (0.1485 => 0.1436, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.94% (0.2116 => 0.2157, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 24 10:35:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 24 Oct 2012 12:35:08 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121024173508.573272A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5169?compare_to=5166&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5169, Order: 166572, Start Time: 2012-10-24 16:13:10, End Time: 2012-10-24 17:37:14 To: 5166, Order: 166560, Start Time: 2012-10-24 14:32:29, End Time: 2012-10-24 15:56:00 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 11 (62 on baseline) Performance Improvements: 9 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 955 (908 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/18-imp/imp: 5.48% (0.3373 => 0.3558, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.06% (0.8681 => 0.9120, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.00% (0.4901 => 0.5097, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.98% (0.6103 => 0.6346, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/football/football: 1.87% (0.8755 => 0.8919, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.85% (0.6109 => 0.6222, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.59% (0.6298 => 0.6398, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 23.66% (1.5197 => 1.8793, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/pi: 9.47% (2.2893 => 2.5062, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.65% (2.5661 => 2.6084, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/whetstone: 1.52% (2.1123 => 2.1445, std.dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/treecc/treecc: -1.93% (2.0723 => 2.0324, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -1.69% (1.6984 => 1.6697, std.dev.: 0.0083) MultiSource/Applications/ClamAV/clamscan: -1.58% (15.3074 => 15.0652, std.dev.: 0.0795) MultiSource/Applications/SIBsim4/SIBsim4: -1.44% (1.2998 => 1.2811, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: -1.35% (1.1206 => 1.1055, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: -4.73% (0.7892 => 0.7519, std.dev.: 0.0143) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.04% (1.3112 => 1.2713, std.dev.: 0.0093) MultiSource/Benchmarks/BitBench/five11/five11: -2.39% (5.6855 => 5.5496, std.dev.: 0.0334) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -1.52% (6.4859 => 6.3873, std.dev.: 0.0271) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.37% (16.5502 => 16.6118, std.dev.: 0.0204) MultiSource/Applications/obsequi/Obsequi: -1.08% (1.0605 => 1.0490, std.dev.: 0.0206) MultiSource/Applications/sqlite3/sqlite3: -1.13% (0.6480 => 0.6407, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: -2.75% (0.1966 => 0.1912, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.30% (0.1688 => 0.1693, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.67% (0.3233 => 0.3179, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.60% (0.2495 => 0.2480, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.39% (0.3350 => 0.3363, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.50% (0.2391 => 0.2403, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: -0.37% (0.5997 => 0.5975, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel: -4.25% (0.0471 => 0.0451, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.69% (0.3321 => 0.3298, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: -0.10% (0.1992 => 0.1990, std.dev.: 0.0014) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -18.36% (0.0256 => 0.0209, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 32.73% (0.0165 => 0.0219, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.18% (0.0425 => 0.0430, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.75% (0.0252 => 0.0332, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.32% (0.0313 => 0.0314, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 17.13% (0.0362 => 0.0424, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0203 => 0.0203, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/test1: 0.92% (0.0217 => 0.0219, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -10.76% (0.0344 => 0.0307, std.dev.: 0.0044) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: - (0.1474 => 0.1474, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.87% (1.1630 => 1.1412, std.dev.: 0.0018) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.83% (0.1445 => 0.1433, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.18% (0.3944 => 0.4109, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.59% (0.1429 => 0.1392, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.24% (0.0553 => 0.0582, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 32.18% (0.0202 => 0.0267, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.35% (0.0554 => 0.0541, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.10% (1.1437 => 1.1425, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1000.00% (0.0001 => 0.0011, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -93.33% (0.0015 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.56% (0.0548 => 0.0573, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 44.12% (0.0170 => 0.0245, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.54% (0.8004 => 0.7961, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -4.65% (0.0043 => 0.0041, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.64% (2.1832 => 1.6671, std.dev.: 0.0027) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.90% (0.0810 => 0.0955, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 10.52% (0.1112 => 0.1229, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.60% (0.8321 => 0.9120, std.dev.: 0.0133) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.58% (0.1885 => 0.2009, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.56% (0.2180 => 0.2323, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.59% (0.6010 => 0.6346, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.22% (0.2279 => 0.2398, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.16% (0.4847 => 0.5097, std.dev.: 0.0056) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.97% (0.3137 => 0.3293, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.96% (0.7473 => 0.7844, std.dev.: 0.0099) MultiSource/Applications/spiff/spiff: 4.82% (0.7950 => 0.8333, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/bh/bh: 4.69% (0.2985 => 0.3125, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.38% (0.5961 => 0.6222, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.25% (1.1606 => 1.2099, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.55% (0.3717 => 0.3849, std.dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: 3.50% (0.2999 => 0.3104, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.24% (0.6287 => 0.6491, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.75% (0.6227 => 0.6398, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.63% (4.1763 => 4.2863, std.dev.: 0.0257) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.44% (6.6074 => 6.7685, std.dev.: 0.0136) MultiSource/Applications/minisat/minisat: 2.36% (0.6834 => 0.6995, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.21% (1.3279 => 1.3573, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.17% (4.4880 => 4.5852, std.dev.: 0.0169) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.11% (13.1811 => 13.4590, std.dev.: 0.0747) MultiSource/Benchmarks/nbench/nbench: 2.08% (1.1271 => 1.1506, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.07% (8.6476 => 8.8264, std.dev.: 0.0281) MultiSource/Applications/ClamAV/clamscan: 2.01% (14.7684 => 15.0652, std.dev.: 0.0795) MultiSource/Applications/lua/lua: 1.97% (3.8189 => 3.8942, std.dev.: 0.0240) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.95% (4.4873 => 4.5747, std.dev.: 0.0111) MultiSource/Applications/SIBsim4/SIBsim4: 1.93% (1.2568 => 1.2811, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.90% (1.6386 => 1.6697, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.89% (0.8457 => 0.8617, std.dev.: 0.0034) MultiSource/Applications/treecc/treecc: 1.88% (1.9948 => 2.0324, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.87% (0.8069 => 0.8220, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.84% (0.9074 => 0.9241, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.81% (0.8611 => 0.8767, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.76% (0.8261 => 0.8406, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 1.72% (0.8768 => 0.8919, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/gs/gs: 1.70% (4.1305 => 4.2008, std.dev.: 0.0167) MultiSource/Applications/d/make_dparser: 1.55% (3.2366 => 3.2869, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.54% (0.8597 => 0.8729, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 1.45% (15.3280 => 15.5502, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.43% (0.9908 => 1.0050, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 1.39% (14.2605 => 14.4590, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.38% (0.8177 => 0.8290, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.38% (0.8359 => 0.8474, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.35% (0.8716 => 0.8834, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.27% (0.9056 => 0.9171, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.25% (0.8048 => 0.8149, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 1.24% (6.7320 => 6.8155, std.dev.: 0.0301) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.23% (2.1401 => 2.1665, std.dev.: 0.0043) MultiSource/Applications/siod/siod: 1.14% (2.2184 => 2.2438, std.dev.: 0.0094) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.67% (1.5795 => 2.5062, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.72% (0.3186 => 0.3432, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.68% (1.1857 => 1.2768, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 5.94% (63.1822 => 66.9338, std.dev.: 0.0583) MultiSource/Applications/siod/siod: 2.73% (3.6643 => 3.7644, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/ReedSolomon: 2.23% (8.5322 => 8.7227, std.dev.: 0.0487) MultiSource/Benchmarks/Olden/bh/bh: 2.04% (2.3560 => 2.4040, std.dev.: 0.0092) MultiSource/Applications/minisat/minisat: 1.72% (6.1525 => 6.2583, std.dev.: 0.0264) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.27% (1.5941 => 1.6144, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/whetstone: 1.04% (2.1224 => 2.1445, std.dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.49% (0.3269 => 0.3024, std.dev.: 0.0011) MultiSource/Applications/lua/lua: -4.95% (29.8330 => 28.3554, std.dev.: 0.0318) SingleSource/Benchmarks/Shootout-C++/hash2: -1.56% (3.4237 => 3.3704, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.18% (3.3479 => 3.3083, std.dev.: 0.0078) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 1.01% (16.4461 => 16.6118, std.dev.: 0.0204) MultiSource/Applications/obsequi/Obsequi: 2.22% (1.0262 => 1.0490, std.dev.: 0.0206) MultiSource/Applications/sqlite3/sqlite3: 1.18% (0.6332 => 0.6407, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: 4.42% (0.1831 => 0.1912, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 8.60% (0.1559 => 0.1693, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.79% (0.3123 => 0.3179, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.69% (0.2463 => 0.2480, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.57% (0.3344 => 0.3363, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.65% (0.2364 => 0.2403, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: -0.58% (0.6010 => 0.5975, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel: 5.13% (0.0429 => 0.0451, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.98% (0.3266 => 0.3298, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: 1.07% (0.1969 => 0.1990, std.dev.: 0.0014) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -6.70% (0.0224 => 0.0209, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.39% (0.0408 => 0.0430, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.71% (0.0254 => 0.0332, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0384 => 0.0424, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: 33.48% (0.0230 => 0.0307, std.dev.: 0.0044) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.50% (0.1438 => 0.1474, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.73% (1.1329 => 1.1412, std.dev.: 0.0018) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.98% (0.1462 => 0.1433, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.32% (0.4164 => 0.4109, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.68% (0.1369 => 0.1392, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.20% (0.0641 => 0.0582, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 36.92% (0.0195 => 0.0267, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.40% (0.0578 => 0.0541, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.10% (1.1437 => 1.1425, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1000.00% (0.0001 => 0.0011, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.61% (0.0627 => 0.0573, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 36.11% (0.0180 => 0.0245, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.70% (0.8017 => 0.7961, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -33.87% (0.0062 => 0.0041, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 24 10:55:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 24 Oct 2012 12:55:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121024175554.6E4002A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5170?compare_to=5167&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5170, Order: 166579, Start Time: 2012-10-24 16:33:12, End Time: 2012-10-24 17:57:58 To: 5167, Order: 166562, Start Time: 2012-10-24 14:45:38, End Time: 2012-10-24 16:10:12 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 0 (187 on baseline) Unchanged Tests: 1041 (851 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.43% (1.2625 => 1.2805, std.dev.: 0.0038) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.80% (2.0478 => 2.1051, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: 2.58% (7.4937 => 7.6873, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/hash2: 2.24% (3.1932 => 3.2648, std.dev.: 0.0089) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.87% (0.1431 => 0.1304, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.37% (0.3821 => 0.3501, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -7.64% (2.4924 => 2.3020, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: -7.54% (0.3831 => 0.3542, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -7.48% (0.3812 => 0.3527, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -7.45% (0.3880 => 0.3591, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.44% (0.3884 => 0.3595, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -7.43% (0.3848 => 0.3562, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -7.37% (0.3896 => 0.3609, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -7.34% (0.4033 => 0.3737, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -7.33% (0.3357 => 0.3111, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.30% (0.3891 => 0.3607, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.21% (22.4056 => 20.7909, std.dev.: 0.0140) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -7.16% (3.5339 => 3.2809, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/property: -7.12% (0.4199 => 0.3900, std.dev.: 0.0062) SingleSource/UnitTests/ObjC/exceptions: -7.11% (0.4176 => 0.3879, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/chomp: -7.10% (0.1761 => 0.1636, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -7.08% (0.4280 => 0.3977, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.06% (0.9542 => 0.8868, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.96% (0.2428 => 0.2259, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.96% (0.1796 => 0.1671, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -6.89% (16.1920 => 15.0756, std.dev.: 0.0199) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.88% (0.1584 => 0.1475, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.87% (0.3142 => 0.2926, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/ReedSolomon: -6.87% (0.1879 => 0.1750, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.84% (0.6736 => 0.6275, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.83% (0.2695 => 0.2511, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: -6.81% (0.9179 => 0.8554, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/BoolLiteralTest: -6.81% (0.3834 => 0.3573, std.dev.: 0.0091) MultiSource/Applications/JM/ldecod/ldecod: -6.79% (7.0961 => 6.6144, std.dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.77% (6.7716 => 6.3132, std.dev.: 0.0092) MultiSource/Applications/Burg/burg: -6.77% (1.2515 => 1.1668, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.76% (1.3722 => 1.2795, std.dev.: 0.0084) MultiSource/Benchmarks/mafft/pairlocalalign: -6.74% (9.2283 => 8.6059, std.dev.: 0.0134) MultiSource/Benchmarks/FreeBench/neural/neural: -6.73% (0.1500 => 0.1399, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: -6.73% (4.3330 => 4.0413, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/oourafft: -6.71% (0.2160 => 0.2015, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.67% (0.3658 => 0.3414, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.66% (0.6484 => 0.6052, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.65% (0.7919 => 0.7392, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.63% (0.2548 => 0.2379, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.63% (1.0544 => 0.9845, std.dev.: 0.0060) MultiSource/Benchmarks/nbench/nbench: -6.63% (1.1530 => 1.0766, std.dev.: 0.0027) MultiSource/Applications/lemon/lemon: -6.60% (1.1450 => 1.0694, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.59% (5.4682 => 5.1080, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.56% (1.6474 => 1.5393, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.54% (1.4642 => 1.3684, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: -6.51% (0.2659 => 0.2486, std.dev.: 0.0007) MultiSource/Applications/lua/lua: -6.48% (4.0594 => 3.7962, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.47% (4.5069 => 4.2155, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.45% (0.2355 => 0.2203, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.45% (4.8161 => 4.5054, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.43% (1.2300 => 1.1509, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: -6.42% (0.4515 => 0.4225, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.41% (1.2784 => 1.1964, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -6.41% (15.5079 => 14.5133, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.41% (4.0323 => 3.7737, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.41% (1.6364 => 1.5315, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.40% (0.9852 => 0.9221, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.40% (0.7339 => 0.6869, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -6.40% (2.4021 => 2.2483, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.38% (0.5925 => 0.5547, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: -6.38% (0.7447 => 0.6972, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.37% (0.5478 => 0.5129, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.36% (0.4151 => 0.3887, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.36% (0.5802 => 0.5433, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -6.35% (0.6676 => 0.6252, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.34% (4.8802 => 4.5708, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: -6.31% (0.3406 => 0.3191, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.30% (0.6297 => 0.5900, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.30% (0.6681 => 0.6260, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.29% (0.1716 => 0.1608, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: -6.28% (0.3581 => 0.3356, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.28% (0.5863 => 0.5495, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.25% (0.6446 => 0.6043, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.25% (0.6194 => 0.5807, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: -6.25% (1.3864 => 1.2998, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.24% (0.5591 => 0.5242, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.23% (2.2587 => 2.1179, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -6.23% (0.2985 => 0.2799, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: -6.23% (0.1621 => 0.1520, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: -6.23% (0.5168 => 0.4846, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -6.19% (0.5705 => 0.5352, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.18% (0.6052 => 0.5678, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -6.18% (0.5570 => 0.5226, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -6.17% (0.9557 => 0.8967, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -6.16% (0.6395 => 0.6001, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: -6.16% (1.3148 => 1.2338, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.15% (0.4813 => 0.4517, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.14% (0.4916 => 0.4614, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.14% (0.6304 => 0.5917, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -6.10% (15.2527 => 14.3227, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.09% (14.2083 => 13.3431, std.dev.: 0.0195) SingleSource/Benchmarks/Shootout-C++/wordfreq: -6.07% (0.3491 => 0.3279, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -6.07% (0.4861 => 0.4566, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.07% (0.8521 => 0.8004, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.06% (0.5805 => 0.5453, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.06% (0.5329 => 0.5006, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.06% (0.5859 => 0.5504, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.06% (0.5581 => 0.5243, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -6.05% (0.6230 => 0.5853, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.05% (0.4083 => 0.3836, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -6.04% (0.5941 => 0.5582, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -6.04% (0.5567 => 0.5231, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: -6.04% (0.2999 => 0.2818, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.03% (0.3849 => 0.3617, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.03% (0.5857 => 0.5504, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.02% (0.6293 => 0.5914, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.02% (0.5999 => 0.5638, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: -6.01% (3.5154 => 3.3043, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -6.00% (0.6667 => 0.6267, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: -5.99% (0.4524 => 0.4253, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: -5.98% (0.4248 => 0.3994, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.98% (0.6189 => 0.5819, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.98% (0.3931 => 0.3696, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.98% (0.6660 => 0.6262, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.95% (0.7021 => 0.6603, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.95% (0.6033 => 0.5674, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.94% (0.3483 => 0.3276, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -5.94% (17.1032 => 16.0869, std.dev.: 0.0155) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.94% (1.2221 => 1.1495, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.93% (0.7524 => 0.7078, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.93% (0.6260 => 0.5889, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -5.93% (0.6750 => 0.6350, std.dev.: 0.0124) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.92% (1.2210 => 1.1487, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: -5.92% (2.1401 => 2.0134, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.92% (0.5575 => 0.5245, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.91% (0.2385 => 0.2244, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.90% (0.4321 => 0.4066, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -5.89% (34.0927 => 32.0861, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.88% (0.2278 => 0.2144, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.86% (0.5849 => 0.5506, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.86% (8.0126 => 7.5429, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.84% (0.5688 => 0.5356, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.84% (0.5569 => 0.5244, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/fibo: -5.82% (0.2871 => 0.2704, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: -5.81% (18.2933 => 17.2296, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.81% (0.3837 => 0.3614, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.81% (0.7198 => 0.6780, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.79% (0.6440 => 0.6067, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.79% (0.5456 => 0.5140, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.79% (2.1713 => 2.0456, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -5.78% (0.3026 => 0.2851, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.78% (0.3252 => 0.3064, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.75% (0.2106 => 0.1985, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: -5.72% (0.3025 => 0.2852, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.72% (0.2903 => 0.2737, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -5.72% (0.3446 => 0.3249, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -5.72% (0.2939 => 0.2771, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.69% (0.3319 => 0.3130, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.69% (0.4427 => 0.4175, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.69% (0.3057 => 0.2883, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -5.69% (0.3867 => 0.3647, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -5.68% (0.3255 => 0.3070, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -5.68% (0.7982 => 0.7529, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.67% (0.3016 => 0.2845, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -5.65% (0.2989 => 0.2820, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -5.65% (0.3205 => 0.3024, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -5.63% (0.3621 => 0.3417, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -5.63% (0.3394 => 0.3203, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -5.63% (0.3271 => 0.3087, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: -5.62% (0.2849 => 0.2689, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: -5.60% (0.3194 => 0.3015, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.60% (0.3323 => 0.3137, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -5.57% (0.3481 => 0.3287, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -5.57% (0.8418 => 0.7949, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: -5.57% (0.3788 => 0.3577, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.56% (0.2933 => 0.2770, std.dev.: 0.0037) SingleSource/UnitTests/ObjC++/property-reference: -5.50% (0.7779 => 0.7351, std.dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: -5.43% (0.3059 => 0.2893, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -5.28% (0.6347 => 0.6012, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -5.20% (0.6441 => 0.6106, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.15% (0.2001 => 0.1898, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -5.06% (0.9077 => 0.8618, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.48% (0.2277 => 0.2175, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: -4.45% (1.5610 => 1.4915, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: -4.33% (5.0226 => 4.8049, std.dev.: 0.0112) SingleSource/UnitTests/Vector/constpool: -3.47% (20.7746 => 20.0539, std.dev.: 0.0469) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7543, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1724, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.93% (2.2633 => 2.1744, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7068, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.06% (1.0557 => 1.0234, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.22% (1.3096 => 1.2805, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4689, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0009) Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 24 11:02:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 24 Oct 2012 13:02:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121024180237.E073F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5171?compare_to=5168&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5171, Order: 166579, Start Time: 2012-10-24 16:44:28, End Time: 2012-10-24 18:04:42 To: 5168, Order: 166562, Start Time: 2012-10-24 14:54:04, End Time: 2012-10-24 16:14:39 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (5 on baseline) Performance Regressions: 0 (197 on baseline) Performance Improvements: 2 (45 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 88 (14 on baseline) Unchanged Tests: 952 (645 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -2.68% (21.5331 => 20.9565, std.dev.: 0.0198) MultiSource/Benchmarks/PAQ8p/paq8p: -1.98% (15.7521 => 15.4406, std.dev.: 0.0177) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.08% (0.6283 => 0.6288, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 0.01% (17.2714 => 17.2735, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 0.33% (15.6607 => 15.7125, std.dev.: 0.0049) MultiSource/Benchmarks/Bullet/bullet: 1.66% (56.1710 => 57.1038, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0488 => 0.0488, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0490 => 0.0490, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0458 => 0.0458) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.22% (0.0459 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0447 => 0.0447, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.22% (0.0448 => 0.0449) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.45% (0.0440 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.45% (0.0441 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.44% (0.0458 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.22% (0.0459 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.44% (0.0452 => 0.0454, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.22% (0.0454 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0443 => 0.0443, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.23% (0.0444 => 0.0445, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.22% (0.0450 => 0.0451, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.22% (0.0451 => 0.0452, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.22% (0.0461 => 0.0462, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.93% (0.0483 => 0.0464, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.46% (0.0437 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.46% (0.0438 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.45% (0.0449 => 0.0451, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.22% (0.0451 => 0.0452) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.23% (0.0441 => 0.0442, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.23% (0.0442 => 0.0443, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.46% (0.0433 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.46% (0.0433 => 0.0435, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.23% (0.0432 => 0.0433) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.46% (0.0433 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.21% (0.0469 => 0.0470, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.21% (0.0470 => 0.0471, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.46% (0.0431 => 0.0433) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.70% (0.0431 => 0.0434) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0433 => 0.0433) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0434 => 0.0434) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.68% (0.0439 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.45% (0.0440 => 0.0442, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (1.5017 => 1.5017, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.08% (8.2621 => 8.2687, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.14% (0.6911 => 0.6901, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1436 => 0.1437, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.96% (0.2157 => 0.0648, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -9.71% (63.2438 => 57.1038, std.dev.: 0.0140) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/MallocBench/gs/gs: 13.57% (4.1105 => 4.6682, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.22% (3.4629 => 5.8253, std.dev.: 0.0071) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13522.22% (0.0720 => 9.8080, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050500.00% (0.0001 => 10.0506, std.dev.: 0.0023) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 68.75% (0.0256 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 64.96% (0.2554 => 0.4213, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 50.62% (0.0243 => 0.0366) MultiSource/Benchmarks/PAQ8p/paq8p: 48.94% (10.3673 => 15.4406, std.dev.: 0.0177) SingleSource/UnitTests/SignlessTypes/factor: 46.96% (0.0296 => 0.0435, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 43.91% (0.0271 => 0.0390, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.20% (1.5859 => 2.2393, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 38.53% (0.1622 => 0.2247, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 37.41% (0.1056 => 0.1451, std.dev.: 0.0000) SingleSource/UnitTests/vla: 33.24% (0.0355 => 0.0473) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.28% (2.2024 => 2.8692, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/neural/neural: 27.96% (0.1463 => 0.1872, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 24.46% (0.0834 => 0.1038, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 24.41% (0.1655 => 0.2059, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.84% (0.1566 => 0.1908, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/hash: 21.03% (0.0485 => 0.0587, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 20.84% (0.2049 => 0.2476, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 20.74% (0.1432 => 0.1729, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.45% (7.0540 => 8.4964, std.dev.: 0.0122) MultiSource/Benchmarks/FreeBench/pifft/pifft: 19.93% (2.2022 => 2.6411, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.83% (0.0871 => 0.1035, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 18.71% (0.1555 => 0.1846, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 18.24% (0.5105 => 0.6036, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.80% (0.6675 => 0.7863, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/power/power: 17.29% (0.1440 => 0.1689, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.20% (0.1029 => 0.1206, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: 17.09% (0.0626 => 0.0733, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.01% (1.3050 => 1.5270, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 16.94% (0.1175 => 0.1374, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.90% (0.0793 => 0.0927, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 16.73% (0.3282 => 0.3831, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 16.69% (3.3354 => 3.8920, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/em3d/em3d: 16.52% (0.1695 => 0.1975, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.42% (0.2271 => 0.2644, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/mst/mst: 16.42% (0.1163 => 0.1354) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.38% (0.4615 => 0.5371, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.34% (0.3121 => 0.3631, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.30% (0.8172 => 0.9504, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.93% (0.1337 => 0.1550, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.90% (1.5415 => 1.7866, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 15.86% (0.1438 => 0.1666, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.82% (0.5020 => 0.5814, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.80% (0.0886 => 0.1026, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.70% (0.1032 => 0.1194, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.44% (0.0842 => 0.0972, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 15.40% (0.0818 => 0.0944, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 15.36% (0.7115 => 0.8208, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.30% (0.1510 => 0.1741, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 15.28% (0.3109 => 0.3584, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 15.27% (0.4879 => 0.5624, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.26% (0.1940 => 0.2236, std.dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 15.12% (10.4361 => 12.0139, std.dev.: 0.0098) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.11% (0.0675 => 0.0777, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.97% (0.9765 => 1.1227, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 14.88% (0.0672 => 0.0772, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.88% (0.0746 => 0.0857, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.78% (1.7609 => 2.0212, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.77% (0.1117 => 0.1282, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 14.77% (0.7835 => 0.8992, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 14.72% (0.3423 => 0.3927, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.68% (0.0770 => 0.0883, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 14.67% (0.3177 => 0.3643, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 14.57% (8.1363 => 9.3221, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.57% (0.2107 => 0.2414, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 14.56% (1.1642 => 1.3337, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.54% (0.2758 => 0.3159, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.51% (4.2646 => 4.8834, std.dev.: 0.0093) MultiSource/Benchmarks/mafft/pairlocalalign: 14.51% (9.4845 => 10.8604, std.dev.: 0.0088) SingleSource/Benchmarks/McGill/exptree: 14.50% (0.0814 => 0.0932) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.46% (0.1584 => 0.1813, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.44% (0.0838 => 0.0959) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 14.43% (0.1906 => 0.2181, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.40% (0.1236 => 0.1414, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 14.34% (0.1151 => 0.1316, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 14.25% (0.0730 => 0.0834, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.24% (0.2065 => 0.2359, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.20% (0.5860 => 0.6692, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.14% (0.5981 => 0.6827, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.12% (0.6450 => 0.7361, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 14.00% (5.7591 => 6.5656, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.00% (0.2700 => 0.3078, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.93% (0.0933 => 0.1063, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 13.90% (0.1144 => 0.1303, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.89% (1.4186 => 1.6156, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.84% (0.1062 => 0.1209, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.78% (0.0798 => 0.0908, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 13.70% (0.0730 => 0.0830, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.64% (0.0770 => 0.0875, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.63% (0.1695 => 0.1926, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 13.59% (2.0273 => 2.3029, std.dev.: 0.0074) MultiSource/Benchmarks/Olden/health/health: 13.56% (0.1268 => 0.1440, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.46% (0.8067 => 0.9153, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 13.40% (4.9449 => 5.6076, std.dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: 13.40% (0.7433 => 0.8429, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.25% (5.0018 => 5.6646, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 13.22% (1.1840 => 1.3405, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 13.17% (0.3387 => 0.3833, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 13.16% (3.8723 => 4.3819, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/05-eks/eks: 13.10% (0.4299 => 0.4862, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 13.04% (1.0722 => 1.2120, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.04% (0.1143 => 0.1292, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.02% (0.0929 => 0.1050, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.01% (0.1330 => 0.1503, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.00% (7.9617 => 8.9969, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.96% (0.5569 => 0.6291, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.86% (0.1625 => 0.1834, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.76% (0.3307 => 0.3729, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 12.71% (0.3092 => 0.3485, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.66% (1.1861 => 1.3363, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.52% (0.2603 => 0.2929, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 12.48% (0.3180 => 0.3577, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.23% (0.3441 => 0.3862, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.18% (0.2266 => 0.2542, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 12.18% (0.1125 => 0.1262, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 12.07% (0.8921 => 0.9998, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 12.07% (1.5603 => 1.7486, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.86% (0.8101 => 0.9062, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 11.45% (0.6456 => 0.7195, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.26% (0.1892 => 0.2105, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.18% (1.1194 => 1.2445, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 10.87% (2.2969 => 2.5466, std.dev.: 0.0171) MultiSource/Applications/JM/lencod/lencod: 10.83% (21.9371 => 24.3132, std.dev.: 0.0099) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.78% (0.3543 => 0.3925, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 10.63% (0.4620 => 0.5111, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 10.52% (0.4289 => 0.4740, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: 10.39% (0.3927 => 0.4335, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.19% (0.3473 => 0.3827, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.14% (0.3828 => 0.4216, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.08% (0.3543 => 0.3900, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.07% (0.3497 => 0.3849, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/property: 10.06% (0.3886 => 0.4277, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.05% (0.3561 => 0.3919, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.01% (0.3826 => 0.4209, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 9.99% (0.3694 => 0.4063, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 9.93% (0.3516 => 0.3865, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.81% (0.4636 => 0.5091, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.78% (0.3865 => 0.4243, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.73% (0.4203 => 0.4612, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 9.59% (0.3422 => 0.3750, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 9.39% (0.3684 => 0.4030, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.29% (0.4103 => 0.4484, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 9.24% (0.4048 => 0.4422, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.10% (0.3427 => 0.3739, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.05% (0.2430 => 0.2650, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 8.85% (0.3603 => 0.3922, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 8.76% (17.1811 => 18.6854, std.dev.: 0.0167) SingleSource/UnitTests/ObjC++/property-reference-object: 8.59% (0.6030 => 0.6548, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.52% (0.5925 => 0.6430, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.31% (14.3668 => 15.5602, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.11% (0.3650 => 0.3946, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.08% (3.8922 => 4.2066, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.95% (0.4064 => 0.4387, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 7.91% (0.3098 => 0.3343, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 7.89% (0.7326 => 0.7904, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.82% (0.2891 => 0.3117, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 7.74% (0.2831 => 0.3050, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.68% (0.2905 => 0.3128, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 7.68% (0.3283 => 0.3535, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.59% (0.2872 => 0.3090, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.58% (0.3232 => 0.3477, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.46% (0.3162 => 0.3398, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.43% (0.3136 => 0.3369, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.43% (2.0665 => 2.2200, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 7.42% (0.2871 => 0.3084, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 7.31% (0.3052 => 0.3275, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.27% (0.2793 => 0.2996, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.26% (0.2756 => 0.2956, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.23% (0.2877 => 0.3085, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 7.16% (0.3379 => 0.3621, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 7.16% (0.2725 => 0.2920, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.03% (0.2802 => 0.2999, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.93% (0.2714 => 0.2902, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 6.61% (1.2842 => 1.3691, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/objinst: 5.97% (0.3131 => 0.3318, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.30% (0.3935 => 0.4065, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1726, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.38% (0.9957 => 1.1289, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.86% (1.1396 => 1.2520, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3683, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.64% (2.8904 => 3.0824, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 3.88% (1.9405 => 2.0157, std.dev.: 0.0034) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.63% (0.3987 => 0.4092) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.62% (4.2280 => 4.3387, std.dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bisort/bisort: 1.79% (0.8333 => 0.8482, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.76% (3.6395 => 3.7034, std.dev.: 0.0042) MultiSource/Applications/aha/aha: 1.51% (3.1595 => 3.2072, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.40% (2.6546 => 2.6918, std.dev.: 0.0037) MultiSource/Applications/viterbi/viterbi: 1.23% (4.4649 => 4.5196, std.dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.99% (6.6874 => 0.1343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -77.36% (0.8651 => 0.1959) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.08% (5.2763 => 3.3198, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.03% (5.3855 => 3.7683, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -29.56% (5.3526 => 3.7706, std.dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -9.34% (54.1659 => 49.1087, std.dev.: 0.0154) MultiSource/Applications/ClamAV/clamscan: -5.50% (22.1758 => 20.9565, std.dev.: 0.0198) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -52.89% (8.0499 => 3.7927, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.49% (1.1492 => 0.7643, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.64% (2.9695 => 2.4753, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -16.03% (1.6925 => 1.4212, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.70% (1.2258 => 1.0701, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -11.48% (1.2373 => 1.0953, std.dev.: 0.0265) SingleSource/Benchmarks/Misc/mandel-2: -10.71% (1.5373 => 1.3727, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.34% (19.9488 => 18.2849, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/mason/mason: -7.73% (0.2161 => 0.1994, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.11% (1.8329 => 1.7025, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.21% (1.6805 => 1.5930, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5084, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.27% (8.1563 => 7.8082, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1626, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8776, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5035, std.dev.: 0.0036) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.58% (0.4808 => 0.4684, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -2.20% (4.6441 => 4.5418, std.dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0841, std.dev.: 0.0172) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6800, std.dev.: 0.0017) SingleSource/UnitTests/Vector/multiplies: -1.64% (2.5528 => 2.5109, std.dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4197, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2878, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.10% (6.2999 => 6.2303, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout/hash: -1.08% (4.9088 => 4.8557, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 20.25% (0.5229 => 0.6288, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 15.24% (14.9895 => 17.2735, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 11.00% (14.1553 => 15.7125, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 35.93% (1.1048 => 1.5017, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 15.51% (7.1582 => 8.2687, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.91% (0.6222 => 0.6901, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.23% (0.1485 => 0.1437, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 24 11:51:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 24 Oct 2012 13:51:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121024185124.92C212A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5172?compare_to=5165&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5172, Order: 166562, Start Time: 2012-10-24 15:37:10, End Time: 2012-10-24 18:53:30 To: 5165, Order: 166547, Start Time: 2012-10-24 11:33:40, End Time: 2012-10-24 14:49:17 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (170 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1041 (719 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.64% (125.9546 => 129.2788, std.dev.: 1.2533) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.76% (0.0625 => 0.0886, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.64% (0.1063 => 0.1410, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.73% (0.2969 => 0.3733, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.41% (0.1106 => 0.1387, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.30% (0.4253 => 0.5329, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.52% (0.4139 => 0.5154, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.51% (0.0714 => 0.0889, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 24.49% (1.5932 => 1.9833, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.95% (0.0547 => 0.0678, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.79% (0.0475 => 0.0588, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.54% (0.5900 => 0.7289, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.43% (0.4994 => 0.6164, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.34% (0.5000 => 0.6167, std.dev.: 0.0036) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.77% (0.0584 => 0.0717, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.72% (0.1620 => 0.1988, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.43% (0.1021 => 0.1250, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.86% (0.1107 => 0.1349, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.85% (0.0897 => 0.1093, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 21.70% (0.0599 => 0.0729, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.17% (0.0633 => 0.0767, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.89% (0.0584 => 0.0706, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.89% (0.0541 => 0.0654, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 20.89% (0.0948 => 0.1146, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.72% (0.0642 => 0.0775, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.58% (0.1103 => 0.1330, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 20.53% (0.0604 => 0.0728, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 20.46% (0.0821 => 0.0989, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.34% (0.3903 => 0.4697, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.32% (0.0822 => 0.0989, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.27% (0.1549 => 0.1863, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 20.26% (0.1619 => 0.1947, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.24% (0.1003 => 0.1206, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.20% (0.1604 => 0.1928, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 19.22% (0.0947 => 0.1129, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 18.88% (0.5826 => 0.6926, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.88% (0.1462 => 0.1738, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 18.56% (0.1218 => 0.1444, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.42% (0.2014 => 0.2385, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 18.37% (0.5889 => 0.6971, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 18.32% (0.0808 => 0.0956, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.30% (0.3890 => 0.4602, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 18.07% (0.1505 => 0.1777, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 17.92% (0.4029 => 0.4751, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.91% (0.2736 => 0.3226, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 17.91% (0.0698 => 0.0823, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.91% (1.3152 => 1.5507, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.56% (0.1088 => 0.1279, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.41% (3.5627 => 4.1830, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.34% (0.2866 => 0.3363, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 17.03% (1.8794 => 2.1995, std.dev.: 0.0064) MultiSource/Applications/Burg/burg: 16.91% (0.5546 => 0.6484, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.90% (0.1160 => 0.1356, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 16.83% (0.9697 => 1.1329, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.82% (0.1968 => 0.2299, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.75% (1.6211 => 1.8927, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.66% (0.2875 => 0.3354, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.64% (0.4658 => 0.5433, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 16.54% (0.1421 => 0.1656, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 16.28% (0.3004 => 0.3493, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 16.26% (0.7171 => 0.8337, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.23% (0.3271 => 0.3802, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: 16.14% (1.0781 => 1.2521, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/matrix: 16.12% (0.2780 => 0.3228, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.05% (2.7292 => 3.1672, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.01% (0.4361 => 0.5059, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 15.99% (0.2714 => 0.3148, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.97% (0.2792 => 0.3238, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.96% (0.2738 => 0.3175, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/fibo: 15.93% (0.2725 => 0.3159, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 15.90% (0.2811 => 0.3258, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.87% (0.2729 => 0.3162, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.82% (0.5026 => 0.5821, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/random: 15.73% (0.2803 => 0.3244, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 15.73% (0.1284 => 0.1486, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.73% (0.3930 => 0.4548, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wc: 15.70% (0.3096 => 0.3582, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 15.69% (0.9909 => 1.1464, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 15.67% (0.2750 => 0.3181, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 15.61% (0.2813 => 0.3252, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.56% (0.3195 => 0.3692, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.52% (2.0673 => 2.3882, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/objinst: 15.48% (0.2823 => 0.3260, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.42% (0.2911 => 0.3360, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 15.42% (4.2109 => 4.8601, std.dev.: 0.0166) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.32% (1.9694 => 2.2711, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.21% (1.9966 => 2.3003, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.17% (4.4195 => 5.0898, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/ary3: 15.09% (0.3267 => 0.3760, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 15.07% (0.3317 => 0.3817, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.80% (0.3060 => 0.3513, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 14.79% (0.3258 => 0.3740, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 14.77% (23.5202 => 26.9932, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.75% (0.3362 => 0.3858, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.68% (0.1090 => 0.1250, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.53% (0.3124 => 0.3578, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 14.40% (0.3348 => 0.3830, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 14.34% (0.3460 => 0.3956, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 14.30% (0.3726 => 0.4259, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.20% (0.3282 => 0.3748, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 14.19% (0.3678 => 0.4200, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 14.16% (1.4269 => 1.6290, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.11% (0.3488 => 0.3980, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 14.10% (0.3446 => 0.3932, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 14.10% (0.3496 => 0.3989, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 14.08% (0.3465 => 0.3953, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 13.99% (0.2566 => 0.2925, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 13.97% (0.3442 => 0.3923, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 13.95% (0.3469 => 0.3953, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.92% (0.3981 => 0.4535, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 13.89% (0.3477 => 0.3960, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.88% (0.3625 => 0.4128, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 13.78% (0.2075 => 0.2361, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.77% (0.3690 => 0.4198, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 13.71% (0.4251 => 0.4834, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 13.68% (0.4146 => 0.4713, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 13.59% (0.3650 => 0.4146, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 13.59% (0.3643 => 0.4138, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 13.46% (0.7875 => 0.8935, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/parameter-passing: 13.40% (0.3724 => 0.4223, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.37% (0.3845 => 0.4359, std.dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 13.30% (2.1653 => 2.4532, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: 13.11% (0.5012 => 0.5669, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 13.06% (4.6177 => 5.2210, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 12.78% (2.1013 => 2.3698, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.35% (0.2040 => 0.2292, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 11.97% (0.2691 => 0.3013, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.75% (0.6435 => 0.7191, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 11.64% (5.5417 => 6.1870, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.03% (0.2737 => 0.3039, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.93% (0.2068 => 0.2294, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.89% (0.1028 => 0.1140, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 10.83% (0.3498 => 0.3877, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.63% (0.1383 => 0.1530, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.25% (0.3084 => 0.3400, std.dev.: 0.0081) MultiSource/Applications/siod/siod: 10.13% (0.6634 => 0.7306, std.dev.: 0.0026) MultiSource/Benchmarks/PAQ8p/paq8p: 9.90% (0.4847 => 0.5327, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 9.86% (0.3336 => 0.3665, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.56% (0.2103 => 0.2304, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 8.97% (2.0346 => 2.2172, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.92% (4.6926 => 5.1113, std.dev.: 0.0035) MultiSource/Applications/lemon/lemon: 8.91% (0.2391 => 0.2604, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.58% (0.5361 => 0.5821, std.dev.: 0.0077) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.53% (11.6398 => 12.6321, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.61% (0.5584 => 0.6009, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.61% (0.7426 => 0.7991, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 6.87% (11.9555 => 12.7772, std.dev.: 0.0114) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.77% (0.3792 => 0.3973, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.32% (0.2162 => 0.3531, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.66% (6.2401 => 7.6538, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 8.92% (0.2802 => 0.3052, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.45% (3.3903 => 3.6091, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary: 5.75% (0.2122 => 0.2244, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 4.97% (12.0509 => 12.6504, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1690, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-2: 4.16% (1.8057 => 1.8808, std.dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/dry: 2.68% (14.0481 => 14.4251, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1945, std.dev.: 0.0072) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.68% (3.1722 => 3.2256, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists: 1.63% (28.0362 => 28.4939, std.dev.: 0.0553) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.48% (7.1849 => 7.2914, std.dev.: 0.0014) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3025, std.dev.: 0.0054) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.23% (1.0142 => 1.0267, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5401, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5889, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.19% (2.4764 => 2.4470, std.dev.: 0.0065) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.52% (25.4195 => 16.3902, std.dev.: 0.0123) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9780, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7750, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: -6.29% (0.2402 => 0.2251, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7738, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -2.87% (3.6262 => 3.5220, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -2.63% (11.2080 => 10.9136, std.dev.: 0.0179) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.19% (41.7953 => 40.8791, std.dev.: 0.0105) SingleSource/Benchmarks/Dhrystone/fldry: -2.12% (17.2379 => 16.8722, std.dev.: 0.0414) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.86% (0.6293 => 0.6176, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5702, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4948, std.dev.: 0.0081) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (105.3826 => 104.1645, std.dev.: 0.0900) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0423, std.dev.: 0.0039) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.04% (3.3991 => 3.3636, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 24 12:18:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 24 Oct 2012 14:18:04 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121024191804.2EFCC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5173?compare_to=5169&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5173, Order: 166596, Start Time: 2012-10-24 17:55:06, End Time: 2012-10-24 19:20:10 To: 5169, Order: 166572, Start Time: 2012-10-24 16:13:10, End Time: 2012-10-24 17:37:14 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 15 (58 on baseline) Performance Improvements: 2 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 958 (912 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: 10.07% (0.1122 => 0.1235, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.89% (0.5855 => 0.6083, std.dev.: 0.0061) MultiSource/Applications/oggenc/oggenc: 2.59% (5.0081 => 5.1379, std.dev.: 0.0223) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.00% (1.2625 => 1.2878, std.dev.: 0.0087) MultiSource/Applications/hbd/hbd: 1.87% (1.4528 => 1.4800, std.dev.: 0.0082) MultiSource/Applications/JM/ldecod/ldecod: 1.84% (6.8155 => 6.9407, std.dev.: 0.0216) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.11% (6.7685 => 6.8434, std.dev.: 0.0249) MultiSource/Applications/ClamAV/clamscan: 1.09% (15.0652 => 15.2299, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.01% (1.4628 => 1.4776, std.dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/SPASS/SPASS: 4.65% (8.2947 => 8.6806, std.dev.: 0.0594) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.50% (2.4347 => 2.5443, std.dev.: 0.0317) SingleSource/Benchmarks/CoyoteBench/lpbench: 3.56% (3.9151 => 4.0546, std.dev.: 0.0531) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.71% (0.3947 => 0.4054, std.dev.: 0.0018) MultiSource/Benchmarks/llubenchmark/llu: 1.78% (1.9925 => 2.0280, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.59% (2.6084 => 2.6500, std.dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -8.70% (3.3028 => 3.0156, std.dev.: 0.1108) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.62% (3.8808 => 3.7014, std.dev.: 0.0190) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.20% (16.6118 => 16.6443, std.dev.: 0.2519) MultiSource/Applications/obsequi/Obsequi: 1.01% (1.0490 => 1.0596, std.dev.: 0.0147) MultiSource/Applications/sqlite3/sqlite3: 0.83% (0.6407 => 0.6460, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 1.05% (0.1912 => 0.1932, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.71% (0.1693 => 0.1705, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.60% (0.3179 => 0.3230, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.05% (0.2480 => 0.2506, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.62% (0.3363 => 0.3342, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.79% (0.2403 => 0.2288, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/bigfib: -0.08% (0.5975 => 0.5970, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/mandel: 11.09% (0.0451 => 0.0501, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.24% (0.3298 => 0.3306, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: -0.15% (0.1990 => 0.1987, std.dev.: 0.0025) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -13.40% (0.0209 => 0.0181, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.46% (0.0219 => 0.0220, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.23% (0.0430 => 0.0429, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.30% (0.0332 => 0.0331, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.64% (0.0314 => 0.0316, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.47% (0.0424 => 0.0426, std.dev.: 0.0071) SingleSource/UnitTests/Vector/Altivec/casts: 1.97% (0.0203 => 0.0207, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0219 => 0.0219, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 10.75% (0.0307 => 0.0340, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 0.61% (0.1474 => 0.1483, std.dev.: 0.0042) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.64% (1.1412 => 1.1485, std.dev.: 0.0337) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000) MultiSource/Applications/oggenc/oggenc: 5.93% (0.1433 => 0.1518, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.41% (0.4109 => 0.4126, std.dev.: 0.0150) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.29% (0.1392 => 0.1374, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.59% (0.0582 => 0.0632, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.75% (0.0267 => 0.0269, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.18% (0.0541 => 0.0540, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.23% (1.1425 => 1.1451, std.dev.: 0.0220) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 63.64% (0.0011 => 0.0018, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.12% (0.0573 => 0.0631, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 9.39% (0.0245 => 0.0268, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.58% (0.7961 => 0.8007, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 63.41% (0.0041 => 0.0067, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.48% (2.1832 => 1.6705, std.dev.: 0.0037) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.68% (0.0810 => 0.0937, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/tsp/tsp: 12.59% (0.1112 => 0.1252, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.91% (0.0848 => 0.0949, std.dev.: 0.0034) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.77% (0.3137 => 0.3412, std.dev.: 0.0053) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.42% (0.8321 => 0.9022, std.dev.: 0.0173) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.03% (0.2180 => 0.2355, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.99% (0.2279 => 0.2461, std.dev.: 0.0035) MultiSource/Applications/spiff/spiff: 6.83% (0.7950 => 0.8493, std.dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.52% (0.4847 => 0.5163, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.46% (0.7473 => 0.7956, std.dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.37% (0.1885 => 0.2005, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.14% (0.1905 => 0.2022, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.27% (0.2240 => 0.2358, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.72% (0.2519 => 0.2638, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.69% (0.6287 => 0.6582, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.57% (0.5817 => 0.6083, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.17% (0.2998 => 0.3123, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.14% (0.5961 => 0.6208, std.dev.: 0.0071) MultiSource/Applications/hbd/hbd: 3.72% (1.4269 => 1.4800, std.dev.: 0.0082) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.57% (6.6074 => 6.8434, std.dev.: 0.0249) MultiSource/Applications/oggenc/oggenc: 3.53% (4.9628 => 5.1379, std.dev.: 0.0223) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.40% (1.3279 => 1.3731, std.dev.: 0.0123) MultiSource/Applications/d/make_dparser: 3.37% (3.2366 => 3.3457, std.dev.: 0.0250) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.27% (0.3124 => 0.3226, std.dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: 3.12% (14.7684 => 15.2299, std.dev.: 0.0030) MultiSource/Applications/JM/ldecod/ldecod: 3.10% (6.7320 => 6.9407, std.dev.: 0.0216) MultiSource/Applications/SPASS/SPASS: 3.09% (14.2605 => 14.7012, std.dev.: 0.1507) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.07% (0.4783 => 0.4930, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.85% (0.3717 => 0.3823, std.dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: 2.79% (1.2568 => 1.2919, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.77% (0.8050 => 0.8273, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.70% (4.4873 => 4.6084, std.dev.: 0.0122) MultiSource/Applications/lua/lua: 2.62% (3.8189 => 3.9190, std.dev.: 0.0066) MultiSource/Applications/JM/lencod/lencod: 2.61% (15.3280 => 15.7288, std.dev.: 0.0997) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.51% (13.1811 => 13.5124, std.dev.: 0.0644) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.49% (0.8457 => 0.8668, std.dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 2.28% (1.1271 => 1.1528, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.19% (1.2602 => 1.2878, std.dev.: 0.0087) MultiSource/Applications/lemon/lemon: 2.06% (1.0945 => 1.1170, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.05% (1.4479 => 1.4776, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.00% (1.6386 => 1.6714, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.72% (0.8995 => 0.9150, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.62% (1.1170 => 1.1351, std.dev.: 0.0054) MultiSource/Applications/lambda-0_1_3/lambda: 1.60% (0.7557 => 0.7678, std.dev.: 0.0042) MultiSource/Benchmarks/Bullet/bullet: 1.32% (31.8598 => 32.2810, std.dev.: 0.1548) MultiSource/Benchmarks/mafft/pairlocalalign: 1.29% (8.6247 => 8.7358, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.23% (0.8597 => 0.8703, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 1.21% (0.8768 => 0.8874, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.14% (1.5795 => 2.4979, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.05% (0.3186 => 0.3538, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.44% (1.1857 => 1.2858, std.dev.: 0.0065) MultiSource/Benchmarks/mafft/pairlocalalign: 5.97% (63.1822 => 66.9550, std.dev.: 0.0274) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.56% (2.4333 => 2.5443, std.dev.: 0.0317) SingleSource/Benchmarks/CoyoteBench/lpbench: 3.95% (3.9006 => 4.0546, std.dev.: 0.0531) MultiSource/Applications/siod/siod: 3.20% (3.6643 => 3.7816, std.dev.: 0.0378) MultiSource/Applications/SPASS/SPASS: 2.94% (8.4326 => 8.6806, std.dev.: 0.0594) MultiSource/Benchmarks/llubenchmark/llu: 1.57% (1.9967 => 2.0280, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.46% (4.8362 => 4.9069, std.dev.: 0.0090) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.68% (0.3269 => 0.3018, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.55% (3.9188 => 3.7014, std.dev.: 0.0190) MultiSource/Applications/lua/lua: -5.16% (29.8330 => 28.2927, std.dev.: 0.2091) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.28% (3.3479 => 3.3050, std.dev.: 0.0066) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 1.21% (16.4461 => 16.6443, std.dev.: 0.2519) MultiSource/Applications/obsequi/Obsequi: 3.25% (1.0262 => 1.0596, std.dev.: 0.0147) MultiSource/Applications/sqlite3/sqlite3: 2.02% (0.6332 => 0.6460, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 5.52% (0.1831 => 0.1932, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.36% (0.1559 => 0.1705, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.43% (0.3123 => 0.3230, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.75% (0.2463 => 0.2506, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.06% (0.3344 => 0.3342, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.21% (0.2364 => 0.2288, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/bigfib: -0.67% (0.6010 => 0.5970, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/mandel: 16.78% (0.0429 => 0.0501, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.22% (0.3266 => 0.3306, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 0.91% (0.1969 => 0.1987, std.dev.: 0.0025) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -19.20% (0.0224 => 0.0181, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.86% (0.0123 => 0.0220, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.15% (0.0408 => 0.0429, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.31% (0.0254 => 0.0331, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.64% (0.0302 => 0.0316, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.94% (0.0384 => 0.0426, std.dev.: 0.0071) SingleSource/UnitTests/Vector/Altivec/casts: 8.95% (0.0190 => 0.0207, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 47.83% (0.0230 => 0.0340, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 3.13% (0.1438 => 0.1483, std.dev.: 0.0042) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.38% (1.1329 => 1.1485, std.dev.: 0.0337) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.83% (0.1462 => 0.1518, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.91% (0.4164 => 0.4126, std.dev.: 0.0150) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.37% (0.1369 => 0.1374, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.40% (0.0641 => 0.0632, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 37.95% (0.0195 => 0.0269, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.57% (0.0578 => 0.0540, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.12% (1.1437 => 1.1451, std.dev.: 0.0220) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1700.00% (0.0001 => 0.0018, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.64% (0.0627 => 0.0631, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.89% (0.0180 => 0.0268, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.12% (0.8017 => 0.8007, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 8.06% (0.0062 => 0.0067, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 24 12:44:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 24 Oct 2012 14:44:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121024194424.868CE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5174?compare_to=5170&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5174, Order: 166601, Start Time: 2012-10-24 18:21:42, End Time: 2012-10-24 19:46:28 To: 5170, Order: 166579, Start Time: 2012-10-24 16:33:12, End Time: 2012-10-24 17:57:58 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (4 on baseline) Performance Improvements: 0 (186 on baseline) Unchanged Tests: 1040 (852 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 4.34% (0.3573 => 0.3728, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.91% (78.9181 => 80.4256, std.dev.: 0.3388) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.11% (2.0478 => 2.1114, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/salsa20: 2.54% (7.4937 => 7.6840, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/hash2: 2.21% (3.1932 => 3.2638, std.dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.53% (0.1431 => 0.1309, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.67% (0.3821 => 0.3528, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -7.39% (0.3357 => 0.3109, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.33% (22.4056 => 20.7623, std.dev.: 0.0083) SingleSource/UnitTests/ObjC/exceptions-4: -7.22% (0.3880 => 0.3600, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -7.21% (3.5339 => 3.2791, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-2: -7.20% (0.3831 => 0.3555, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.18% (0.3884 => 0.3605, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -7.16% (0.1761 => 0.1635, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -7.15% (0.3848 => 0.3573, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -7.14% (0.3812 => 0.3540, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -7.11% (0.3896 => 0.3619, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.09% (0.3891 => 0.3615, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -7.09% (0.4033 => 0.3747, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -7.05% (0.3658 => 0.3400, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: -7.03% (0.4280 => 0.3979, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -7.03% (0.4199 => 0.3904, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -7.01% (2.4924 => 2.3177, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: -6.97% (0.4176 => 0.3885, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -6.95% (9.2283 => 8.5867, std.dev.: 0.0061) MultiSource/Applications/Burg/burg: -6.92% (1.2515 => 1.1649, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: -6.90% (0.2160 => 0.2011, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.88% (0.2428 => 0.2261, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: -6.88% (4.3330 => 4.0350, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.87% (1.6474 => 1.5342, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -6.87% (2.4021 => 2.2371, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: -6.82% (0.9179 => 0.8553, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.82% (0.1584 => 0.1476, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: -6.80% (16.1920 => 15.0917, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.79% (0.1796 => 0.1674, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.79% (0.9542 => 0.8894, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.79% (0.9852 => 0.9183, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -6.77% (0.2659 => 0.2479, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.76% (1.0544 => 0.9831, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.74% (0.6736 => 0.6282, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.73% (0.7919 => 0.7386, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.70% (0.1716 => 0.1601, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.70% (5.4682 => 5.1021, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: -6.67% (7.0961 => 6.6228, std.dev.: 0.0077) MultiSource/Benchmarks/nbench/nbench: -6.65% (1.1530 => 1.0763, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.64% (0.2695 => 0.2516, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.63% (0.2548 => 0.2379) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.62% (1.4642 => 1.3673, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: -6.60% (0.1879 => 0.1755, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.60% (1.3722 => 1.2817, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.56% (0.3142 => 0.2936, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -6.55% (1.1450 => 1.0700, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.50% (1.2784 => 1.1953, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/bh/bh: -6.50% (0.2985 => 0.2791, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.49% (4.0323 => 3.7707, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -6.47% (4.0594 => 3.7968, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.45% (1.2300 => 1.1507, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.45% (0.6484 => 0.6066, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: -6.44% (0.5168 => 0.4835, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.44% (0.6293 => 0.5888, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.43% (2.2587 => 2.1134, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.43% (0.4151 => 0.3884, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.43% (6.7716 => 6.3364, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.43% (4.8161 => 4.5066, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.41% (1.6364 => 1.5315, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.41% (4.5069 => 4.2180, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.38% (0.6304 => 0.5902, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.38% (0.6681 => 0.6255, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: -6.37% (0.3581 => 0.3353, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: -6.35% (0.1621 => 0.1518, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -6.34% (0.7447 => 0.6975, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.33% (4.8802 => 4.5711, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.33% (0.5591 => 0.5237, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -6.32% (0.6660 => 0.6239, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.32% (0.6395 => 0.5991, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: -6.29% (18.2933 => 17.1421, std.dev.: 0.0204) MultiSource/Applications/SPASS/SPASS: -6.29% (15.5079 => 14.5326, std.dev.: 0.0087) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.28% (0.2355 => 0.2207, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.26% (0.6052 => 0.5673, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.26% (0.6297 => 0.5903, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.24% (0.5925 => 0.5555, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.24% (0.5478 => 0.5136, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -6.23% (0.6230 => 0.5842, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -6.21% (0.5849 => 0.5486, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -6.21% (0.5705 => 0.5351, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.20% (0.5805 => 0.5445, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.20% (0.3483 => 0.3267, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.20% (0.5999 => 0.5627, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.20% (0.7339 => 0.6884, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.16% (0.4916 => 0.4613, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.16% (0.5859 => 0.5498, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.16% (0.5863 => 0.5502, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -6.15% (0.5575 => 0.5232, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.15% (0.4813 => 0.4517, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: -6.14% (0.2999 => 0.2815, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -6.13% (34.0927 => 32.0020, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/wordfreq: -6.13% (0.3491 => 0.3277, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.12% (0.5802 => 0.5447, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: -6.09% (1.3864 => 1.3019, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: -6.09% (3.5154 => 3.3013, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -6.09% (0.7524 => 0.7066, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.08% (0.3931 => 0.3692, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.08% (1.2221 => 1.1478, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: -6.08% (0.3406 => 0.3199, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.07% (0.6260 => 0.5880, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -6.07% (0.5569 => 0.5231, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -6.07% (0.4861 => 0.4566, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -6.05% (0.9557 => 0.8979, std.dev.: 0.0141) MultiSource/Applications/hexxagon/hexxagon: -6.05% (1.3148 => 1.2353, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.04% (0.6189 => 0.5815, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: -6.03% (2.1401 => 2.0111, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.03% (0.5857 => 0.5504, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -6.02% (0.4515 => 0.4243, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.02% (0.6194 => 0.5821, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -6.01% (0.6667 => 0.6266, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -6.01% (0.6676 => 0.6275, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.00% (0.3849 => 0.3618, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.98% (0.5581 => 0.5247, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.98% (0.6440 => 0.6055) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.97% (0.8521 => 0.8012, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.96% (0.5567 => 0.5235, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.95% (0.4321 => 0.4064, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: -5.94% (17.1032 => 16.0865, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.94% (0.3837 => 0.3609, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.94% (0.2106 => 0.1981, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.93% (1.2210 => 1.1486, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -5.91% (0.7982 => 0.7510, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.91% (0.6395 => 0.6017, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.90% (0.5456 => 0.5134, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.89% (0.5941 => 0.5591, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.89% (14.2083 => 13.3717, std.dev.: 0.0083) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.88% (0.2278 => 0.2144, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -5.88% (0.3026 => 0.2848, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -5.88% (0.6750 => 0.6353, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.88% (0.4083 => 0.3843, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.87% (0.5329 => 0.5016, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.87% (0.7021 => 0.6609, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -5.85% (15.2527 => 14.3600, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.85% (8.0126 => 7.5442, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.83% (0.6446 => 0.6070, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.82% (0.2871 => 0.2704, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -5.80% (0.3446 => 0.3246, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.80% (0.6033 => 0.5683, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.79% (0.2385 => 0.2247, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.76% (0.4427 => 0.4172, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -5.75% (0.2989 => 0.2817, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.75% (0.5570 => 0.5250, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -5.75% (0.3255 => 0.3068, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.66% (0.3319 => 0.3131, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -5.66% (0.3481 => 0.3284, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -5.65% (0.3788 => 0.3574, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -5.63% (0.3621 => 0.3417, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -5.63% (0.3394 => 0.3203, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.63% (0.3323 => 0.3136, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.63% (0.3057 => 0.2885, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: -5.59% (0.4524 => 0.4271, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -5.59% (0.3867 => 0.3651, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: -5.58% (0.2939 => 0.2775, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.56% (0.2933 => 0.2770, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -5.55% (0.3205 => 0.3027, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.55% (0.2903 => 0.2742, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.54% (0.3016 => 0.2849, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -5.53% (0.4248 => 0.4013, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -5.51% (0.8418 => 0.7954, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: -5.51% (0.2849 => 0.2692, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.47% (2.1713 => 2.0526, std.dev.: 0.0041) SingleSource/Regression/C++/ofstream_ctor: -5.43% (0.3059 => 0.2893, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -5.42% (0.3025 => 0.2861, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.41% (0.3252 => 0.3076, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -5.29% (0.3194 => 0.3025, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: -5.29% (0.3271 => 0.3098, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.20% (0.2001 => 0.1897, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.20% (0.7198 => 0.6824, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -5.17% (0.7779 => 0.7377, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: -5.08% (5.0226 => 4.7675, std.dev.: 0.0072) SingleSource/UnitTests/ObjC++/property-reference-object: -4.95% (0.6441 => 0.6122, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -4.85% (0.6347 => 0.6039, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.80% (0.9077 => 0.8641, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.52% (0.2277 => 0.2174, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: -3.97% (1.5610 => 1.4990, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -3.06% (20.7746 => 20.1395, std.dev.: 0.0294) SingleSource/UnitTests/ObjC/BoolLiteralTest: -2.76% (0.3834 => 0.3728, std.dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7579, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1728, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.74% (2.2633 => 2.1786, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.54% (1.3096 => 1.2764, std.dev.: 0.0055) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4717, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0001) Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 24 12:53:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 24 Oct 2012 14:53:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121024195342.022F92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5175?compare_to=5171&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5175, Order: 166602, Start Time: 2012-10-24 18:35:14, End Time: 2012-10-24 19:55:46 To: 5171, Order: 166579, Start Time: 2012-10-24 16:44:28, End Time: 2012-10-24 18:04:42 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (5 on baseline) Performance Regressions: 10 (199 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 88 (14 on baseline) Unchanged Tests: 944 (642 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 3.49% (20.9565 => 21.6880, std.dev.: 0.0420) MultiSource/Benchmarks/PAQ8p/paq8p: 2.06% (15.4406 => 15.7580, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.97% (8.4964 => 8.6637, std.dev.: 0.0084) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.63% (2.6411 => 2.6842, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.48% (3.7683 => 3.8240, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.42% (3.7706 => 3.8243, std.dev.: 0.0033) MultiSource/Applications/JM/ldecod/ldecod: 1.34% (12.0139 => 12.1747, std.dev.: 0.0170) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.26% (2.0212 => 2.0466, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 1.02% (24.3132 => 24.5624, std.dev.: 0.0100) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.50% (79.9073 => 81.1065, std.dev.: 0.2189) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.51% (0.6288 => 0.6320, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 0.38% (17.2735 => 17.3400, std.dev.: 0.0079) MultiSource/Applications/kimwitu++/kc: 0.43% (15.7125 => 15.7797, std.dev.: 0.0166) MultiSource/Benchmarks/Bullet/bullet: 0.49% (57.1038 => 57.3808, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.41% (0.0488 => 0.0490, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.41% (0.0490 => 0.0492) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.44% (0.0458 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.22% (0.0460 => 0.0461, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.45% (0.0447 => 0.0449, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.45% (0.0449 => 0.0451, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.23% (0.0442 => 0.0443) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.23% (0.0443 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.22% (0.0460 => 0.0461) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.43% (0.0460 => 0.0462) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.22% (0.0454 => 0.0455, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.22% (0.0455 => 0.0456, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.45% (0.0443 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.45% (0.0445 => 0.0447) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.22% (0.0451 => 0.0452, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.44% (0.0452 => 0.0454) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.43% (0.0462 => 0.0464) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.22% (0.0464 => 0.0465, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.23% (0.0439 => 0.0440, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.23% (0.0440 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.22% (0.0451 => 0.0452) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.22% (0.0452 => 0.0453, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.23% (0.0442 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.23% (0.0443 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.23% (0.0435 => 0.0436) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.46% (0.0435 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.23% (0.0433 => 0.0434, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.23% (0.0435 => 0.0436, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.43% (0.0470 => 0.0472) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.42% (0.0471 => 0.0473) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.23% (0.0433 => 0.0434) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0434 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.23% (0.0433 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.23% (0.0434 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0442 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.23% (0.0442 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 0.43% (1.5017 => 1.5081, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.41% (8.2687 => 8.3029, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.68% (0.6901 => 0.6948, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1437 => 0.1437, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0648 => 0.0649, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -9.27% (63.2438 => 57.3808, std.dev.: 0.0066) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/MallocBench/gs/gs: 14.12% (4.1105 => 4.6908, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 69.25% (3.4629 => 5.8610, std.dev.: 0.0143) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13511.67% (0.0720 => 9.8004, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049800.00% (0.0001 => 10.0499, std.dev.: 0.0014) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 69.53% (0.0256 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 65.97% (0.2554 => 0.4239, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 52.00% (10.3673 => 15.7580, std.dev.: 0.0060) SingleSource/Regression/C/sumarraymalloc: 50.62% (0.0243 => 0.0366, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 47.64% (0.0296 => 0.0437, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 44.65% (0.0271 => 0.0392, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.85% (1.5859 => 2.2496, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 40.26% (0.1622 => 0.2275, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 37.78% (0.1056 => 0.1455, std.dev.: 0.0003) SingleSource/UnitTests/vla: 33.80% (0.0355 => 0.0475, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.83% (2.2024 => 2.8813, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 28.57% (0.1463 => 0.1881, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 25.56% (0.1655 => 0.2078, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 24.58% (0.0834 => 0.1039, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 22.82% (7.0540 => 8.6637, std.dev.: 0.0084) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.97% (0.1566 => 0.1910, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 21.89% (2.2022 => 2.6842, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: 21.86% (0.0485 => 0.0591, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 21.77% (0.2049 => 0.2495, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 21.23% (0.1432 => 0.1736, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 19.29% (0.1555 => 0.1855, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.29% (0.0871 => 0.1039, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 19.08% (0.5105 => 0.6079, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.53% (0.6675 => 0.7912, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 17.78% (0.1440 => 0.1696, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 17.67% (0.3282 => 0.3862, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.59% (0.1029 => 0.1210, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 17.57% (0.0626 => 0.0736, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 17.45% (0.1175 => 0.1380, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.41% (1.3050 => 1.5322, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.28% (0.0793 => 0.0930, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 17.22% (3.3354 => 3.9099, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.03% (0.4615 => 0.5401, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 17.00% (0.2271 => 0.2657, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 16.99% (0.1695 => 0.1983, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.85% (0.3121 => 0.3647, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 16.77% (0.1163 => 0.1358, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.73% (0.8172 => 0.9539, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 16.66% (10.4361 => 12.1747, std.dev.: 0.0170) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.33% (0.5020 => 0.5840, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.28% (0.1032 => 0.1200, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 16.27% (0.4879 => 0.5673, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 16.23% (0.1337 => 0.1554, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 16.22% (1.7609 => 2.0466, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.21% (1.5415 => 1.7914, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.91% (0.0842 => 0.0976, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.91% (0.0886 => 0.1027, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: 15.83% (0.7115 => 0.8241, std.dev.: 0.0033) MultiSource/Applications/sgefa/sgefa: 15.79% (0.3109 => 0.3600, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.76% (0.1510 => 0.1748, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 15.68% (0.0746 => 0.0863, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.67% (0.1940 => 0.2244, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 15.63% (0.0672 => 0.0777, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 15.58% (0.1438 => 0.1662, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/matrix: 15.53% (0.0818 => 0.0945, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.41% (0.0675 => 0.0779, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.34% (0.9765 => 1.1263, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 15.27% (0.3177 => 0.3662, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 15.25% (0.3423 => 0.3945, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/exptree: 15.23% (0.0814 => 0.0938, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/espresso/espresso: 15.21% (4.2646 => 4.9134, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 15.13% (8.1363 => 9.3672, std.dev.: 0.0044) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 15.09% (0.1584 => 0.1823, std.dev.: 0.0054) MultiSource/Applications/Burg/burg: 15.07% (1.1642 => 1.3396, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.06% (0.0770 => 0.0886) MultiSource/Benchmarks/mafft/pairlocalalign: 15.06% (9.4845 => 10.9125, std.dev.: 0.0183) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 15.05% (0.1236 => 0.1422, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.04% (0.1117 => 0.1285, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 14.95% (0.1906 => 0.2191, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.95% (0.2107 => 0.2422, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 14.94% (0.1151 => 0.1323, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.92% (0.0838 => 0.0963, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.87% (0.2758 => 0.3168, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 14.79% (0.0730 => 0.0838, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.79% (0.0933 => 0.1071, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.74% (0.6450 => 0.7401, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.63% (0.2700 => 0.3095, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.59% (0.5860 => 0.6715, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.53% (0.2065 => 0.2365, std.dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 14.39% (5.7591 => 6.5877, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 14.36% (0.7835 => 0.8960, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.35% (0.5981 => 0.6839, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.34% (0.1695 => 0.1938, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 14.32% (1.4186 => 1.6217, std.dev.: 0.0075) SingleSource/UnitTests/SignlessTypes/rem: 14.25% (0.1144 => 0.1307, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.22% (0.1062 => 0.1213, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.16% (0.0798 => 0.0911, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 14.02% (2.0273 => 2.3116, std.dev.: 0.0108) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.01% (7.9617 => 9.0770, std.dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: 14.01% (0.7433 => 0.8474, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 13.99% (4.9449 => 5.6369, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.90% (0.0770 => 0.0877, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 13.85% (1.1840 => 1.3480, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.85% (5.0018 => 5.6946, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 13.80% (0.1268 => 0.1443, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 13.76% (0.3387 => 0.3853, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.70% (0.8067 => 0.9172, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: 13.68% (0.4299 => 0.4887, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.67% (0.0929 => 0.1056, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.54% (0.1625 => 0.1845, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.47% (0.1143 => 0.1297, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 13.47% (1.0722 => 1.2166, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 13.46% (3.8723 => 4.3936, std.dev.: 0.0117) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.38% (0.1330 => 0.1508, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.31% (0.3307 => 0.3747, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.29% (0.5569 => 0.6309, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.22% (0.2603 => 0.2947, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 13.14% (1.1861 => 1.3419, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 13.07% (0.3092 => 0.3496, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 12.86% (0.3180 => 0.3589, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 12.80% (0.1125 => 0.1269, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.75% (0.2266 => 0.2555, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.73% (0.3441 => 0.3879, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 12.71% (0.8921 => 1.0055, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 12.34% (1.5603 => 1.7529, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.18% (0.8101 => 0.9088, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.16% (1.1194 => 1.2555, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 12.05% (0.6456 => 0.7234, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 11.97% (21.9371 => 24.5624, std.dev.: 0.0100) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.97% (0.3543 => 0.3967, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 11.60% (0.3473 => 0.3876, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.51% (0.3927 => 0.4379, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.40% (0.3561 => 0.3967, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.40% (0.3886 => 0.4329, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.40% (0.3694 => 0.4115, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.37% (0.3543 => 0.3946, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 11.35% (0.3516 => 0.3915, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.32% (0.3497 => 0.3893, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.31% (0.1892 => 0.2106, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.29% (0.3828 => 0.4260, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 11.15% (2.2969 => 2.5530, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/hash2: 11.00% (0.4620 => 0.5128, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 10.87% (0.4289 => 0.4755, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.63% (0.1044 => 0.1155, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 10.60% (0.0953 => 0.1054, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 10.26% (0.3422 => 0.3773, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.25% (0.3865 => 0.4261, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.14% (0.3826 => 0.4214, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.02% (0.4203 => 0.4624, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.99% (0.4103 => 0.4513, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 9.91% (0.3684 => 0.4049, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 9.71% (0.4048 => 0.4441, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.64% (0.4636 => 0.5083, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 9.52% (0.6030 => 0.6604, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.40% (0.5925 => 0.6482, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.26% (0.2430 => 0.2655, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.25% (0.3427 => 0.3744, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 9.16% (0.3603 => 0.3933, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 9.06% (17.1811 => 18.7371, std.dev.: 0.0141) SingleSource/UnitTests/ObjC++/property-reference: 8.82% (0.7326 => 0.7972, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.62% (14.3668 => 15.6055, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.59% (3.8922 => 4.2266, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.56% (0.4064 => 0.4412, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.47% (0.3650 => 0.3959, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 8.23% (0.3098 => 0.3353, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/strcat: 8.19% (0.2831 => 0.3063, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 8.04% (0.3232 => 0.3492, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 8.04% (0.3283 => 0.3547, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 8.02% (0.2905 => 0.3138, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.99% (0.2891 => 0.3122, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.91% (0.3162 => 0.3412, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.88% (2.0665 => 2.2294, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.87% (0.2872 => 0.3098, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.82% (0.2725 => 0.2938, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 7.80% (0.3052 => 0.3290, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.75% (0.3136 => 0.3379, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.68% (0.2877 => 0.3098, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.66% (0.2793 => 0.3007, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.62% (0.2756 => 0.2966, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 7.59% (0.2871 => 0.3089, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 7.52% (0.3379 => 0.3633, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/random: 7.28% (0.2802 => 0.3006, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.26% (0.2714 => 0.2911, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 7.09% (1.2842 => 1.3753, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/objinst: 6.32% (0.3131 => 0.3329, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.86% (0.3935 => 0.4087, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.77% (0.3817 => 0.3961, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1726, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.49% (0.9957 => 1.1300, std.dev.: 0.0098) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.38% (0.2944 => 0.3279, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651) SingleSource/Benchmarks/Misc/richards_benchmark: 10.03% (1.1396 => 1.2539, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3681, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.64% (2.8904 => 3.0823, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 3.82% (1.9405 => 2.0147, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.68% (4.2280 => 4.3412, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.63% (0.3987 => 0.4092, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.12% (3.6395 => 3.7167, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bisort/bisort: 1.70% (0.8333 => 0.8475, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.55% (2.6546 => 2.6958, std.dev.: 0.0019) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2078, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 1.29% (4.4649 => 4.5225, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.98% (6.6874 => 0.1350, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -76.88% (0.8651 => 0.2000, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -36.83% (5.2763 => 3.3331, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -28.99% (5.3855 => 3.8240, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -28.55% (5.3526 => 3.8243, std.dev.: 0.0033) SingleSource/UnitTests/Vector/constpool: -9.48% (54.1659 => 49.0302, std.dev.: 0.0276) MultiSource/Applications/ClamAV/clamscan: -2.20% (22.1758 => 21.6880, std.dev.: 0.0420) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -52.90% (8.0499 => 3.7914, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7653, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.64% (2.9695 => 2.4753, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4242, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.71% (1.2258 => 1.0700, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -11.34% (1.2373 => 1.0970, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: -11.03% (1.5373 => 1.3678, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.33% (19.9488 => 18.2870, std.dev.: 0.0307) MultiSource/Benchmarks/FreeBench/mason/mason: -7.87% (0.2161 => 0.1991, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.99% (1.8329 => 1.7047, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.17% (1.6805 => 1.5936, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.90% (1.5835 => 1.5059, std.dev.: 0.0050) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.24% (8.1563 => 7.8103, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.63% (3.2827 => 3.1637, std.dev.: 0.0078) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8778, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4970, std.dev.: 0.0029) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.85% (0.4808 => 0.4671, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Applications/sqlite3/sqlite3: -2.10% (4.6441 => 4.5467, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -1.95% (10.2830 => 10.0829, std.dev.: 0.0114) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6801, std.dev.: 0.0014) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5094, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4209, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.12% (2.3135 => 2.2877, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8589, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -1.00% (6.2999 => 6.2367, std.dev.: 0.0044) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 20.86% (0.5229 => 0.6320, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 15.68% (14.9895 => 17.3400, std.dev.: 0.0079) MultiSource/Applications/kimwitu++/kc: 11.48% (14.1553 => 15.7797, std.dev.: 0.0166) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.50% (1.1048 => 1.5081, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 15.99% (7.1582 => 8.3029, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.67% (0.6222 => 0.6948, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.23% (0.1485 => 0.1437, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 24 13:59:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 24 Oct 2012 15:59:30 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121024205930.AA4112A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5176?compare_to=5173&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5176, Order: 166609, Start Time: 2012-10-24 19:37:19, End Time: 2012-10-24 21:01:36 To: 5173, Order: 166596, Start Time: 2012-10-24 17:55:06, End Time: 2012-10-24 19:20:10 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 3 (53 on baseline) Performance Improvements: 5 (5 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 967 (916 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.26% (0.8703 => 0.8900, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.19% (2.1599 => 2.2072, std.dev.: 0.0100) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.39% (1.2399 => 1.2571, std.dev.: 0.0065) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/Burg/burg: -2.81% (1.2954 => 1.2590, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -2.35% (0.6083 => 0.5940, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: -1.71% (3.3457 => 3.2884, std.dev.: 0.0162) MultiSource/Applications/siod/siod: -1.25% (2.2817 => 2.2532, std.dev.: 0.0103) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -1.86% (22.5063 => 22.0879, std.dev.: 0.1453) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.48% (16.6443 => 16.5640, std.dev.: 0.3074) MultiSource/Applications/obsequi/Obsequi: -0.89% (1.0596 => 1.0502, std.dev.: 0.0080) MultiSource/Applications/sqlite3/sqlite3: -0.60% (0.6460 => 0.6421, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/08-main/main: -1.14% (0.1932 => 0.1910, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.53% (0.1705 => 0.1696, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.19% (0.3230 => 0.3236, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.84% (0.2506 => 0.2485, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.57% (0.3342 => 0.3361, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.80% (0.2288 => 0.2375, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 0.55% (0.5970 => 0.6003, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/mandel: -7.98% (0.0501 => 0.0461, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.06% (0.3306 => 0.3308, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/strcat: -0.20% (0.1987 => 0.1983, std.dev.: 0.0016) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 24.86% (0.0181 => 0.0226, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.45% (0.0220 => 0.0219, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.70% (0.0429 => 0.0426, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0331 => 0.0331, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.63% (0.0316 => 0.0314) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0426 => 0.0426, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -1.45% (0.0207 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0219 => 0.0219, std.dev.: 0.0009) SingleSource/UnitTests/byval-alignment: -0.29% (0.0340 => 0.0339, std.dev.: 0.0028) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1483 => 0.1482, std.dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -1.87% (1.1485 => 1.1270, std.dev.: 0.0181) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1518 => 0.1519, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.58% (0.4126 => 0.4102, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.77% (0.1374 => 0.1412, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.69% (0.0632 => 0.0649, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.97% (0.0269 => 0.0277, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.89% (0.0540 => 0.0561, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.12% (1.1451 => 1.1437, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 72.22% (0.0018 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.16% (0.0631 => 0.0630, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.97% (0.0268 => 0.0252, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.25% (0.8007 => 0.8027, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -34.33% (0.0067 => 0.0044, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.94% (2.1832 => 1.6606, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.17% (0.0810 => 0.0941, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 13.58% (0.1112 => 0.1263, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.84% (0.1425 => 0.1551, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.39% (0.2180 => 0.2341, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.15% (0.8321 => 0.8916, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.99% (0.7473 => 0.7995, std.dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.53% (0.3137 => 0.3342, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.52% (0.6010 => 0.6402, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.35% (0.4847 => 0.5155, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.10% (0.2998 => 0.3181, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.05% (0.2279 => 0.2394, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.02% (0.2133 => 0.2240, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.70% (0.3295 => 0.3450, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.58% (1.1606 => 1.2138, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.52% (1.1685 => 1.2213, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.28% (0.6287 => 0.6556, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.28% (0.5961 => 0.6216, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.52% (0.8597 => 0.8900, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.28% (0.9435 => 0.9744, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.14% (2.1401 => 2.2072, std.dev.: 0.0100) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.05% (6.6074 => 6.8089, std.dev.: 0.0127) MultiSource/Applications/Burg/burg: 3.01% (1.2222 => 1.2590, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.95% (1.3279 => 1.3671, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.77% (4.1763 => 4.2919, std.dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.65% (0.4559 => 0.4680, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.15% (0.6227 => 0.6361, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.11% (0.5817 => 0.5940, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.01% (0.8007 => 0.8168, std.dev.: 0.0038) MultiSource/Benchmarks/nbench/nbench: 1.94% (1.1271 => 1.1490, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.90% (1.4479 => 1.4754, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.86% (4.5702 => 4.6552, std.dev.: 0.0181) MultiSource/Applications/ClamAV/clamscan: 1.85% (14.7684 => 15.0419, std.dev.: 0.1001) MultiSource/Applications/minisat/minisat: 1.81% (0.6834 => 0.6958, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.79% (1.2526 => 1.2750, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.62% (0.8317 => 0.8452, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.61% (0.9074 => 0.9220, std.dev.: 0.0046) MultiSource/Applications/d/make_dparser: 1.60% (3.2366 => 3.2884, std.dev.: 0.0162) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.59% (1.2423 => 1.2620, std.dev.: 0.0055) MultiSource/Benchmarks/Bullet/bullet: 1.58% (31.8598 => 32.3635, std.dev.: 0.1408) MultiSource/Applications/siod/siod: 1.57% (2.2184 => 2.2532, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.57% (0.8359 => 0.8490, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.55% (0.8086 => 0.8211, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.51% (0.8331 => 0.8457, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.38% (0.8177 => 0.8290, std.dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 1.02% (8.6247 => 8.7123, std.dev.: 0.0165) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 57.47% (1.5795 => 2.4873, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.48% (0.3186 => 0.3488, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.54% (1.1857 => 1.2869, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 5.93% (63.1822 => 66.9314, std.dev.: 0.0158) SingleSource/Benchmarks/Misc/ReedSolomon: 3.01% (8.5322 => 8.7890, std.dev.: 0.0301) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.67% (1.5941 => 1.6207, std.dev.: 0.0095) MultiSource/Benchmarks/Olden/bh/bh: 1.65% (2.3560 => 2.3949, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.00% (6.3772 => 6.4411, std.dev.: 0.0167) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.56% (0.3269 => 0.3022, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -5.22% (29.8330 => 28.2744, std.dev.: 0.3043) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.27% (7.2130 => 6.9771, std.dev.: 0.0901) SingleSource/Benchmarks/Shootout-C++/hash2: -1.48% (3.4237 => 3.3730, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.23% (3.3479 => 3.3067, std.dev.: 0.0015) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.72% (16.4461 => 16.5640, std.dev.: 0.3074) MultiSource/Applications/obsequi/Obsequi: 2.34% (1.0262 => 1.0502, std.dev.: 0.0080) MultiSource/Applications/sqlite3/sqlite3: 1.41% (0.6332 => 0.6421, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/08-main/main: 4.31% (0.1831 => 0.1910, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 8.79% (0.1559 => 0.1696, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.62% (0.3123 => 0.3236, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.89% (0.2463 => 0.2485, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.51% (0.3344 => 0.3361, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.47% (0.2364 => 0.2375, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: -0.12% (0.6010 => 0.6003, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/mandel: 7.46% (0.0429 => 0.0461, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.29% (0.3266 => 0.3308, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/strcat: 0.71% (0.1969 => 0.1983, std.dev.: 0.0016) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.89% (0.0224 => 0.0226, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.31% (0.0254 => 0.0331, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.94% (0.0384 => 0.0426, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0009) SingleSource/UnitTests/byval-alignment: 47.39% (0.0230 => 0.0339, std.dev.: 0.0028) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 3.06% (0.1438 => 0.1482, std.dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -0.52% (1.1329 => 1.1270, std.dev.: 0.0181) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.90% (0.1462 => 0.1519, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.49% (0.4164 => 0.4102, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.14% (0.1369 => 0.1412, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.25% (0.0641 => 0.0649, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.94% (0.0578 => 0.0561, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: - (1.1437 => 1.1437, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.48% (0.0627 => 0.0630, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 40.00% (0.0180 => 0.0252, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.12% (0.8017 => 0.8027, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -29.03% (0.0062 => 0.0044, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 24 14:32:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 24 Oct 2012 16:32:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121024213202.918B42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5177?compare_to=5174&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5177, Order: 166611, Start Time: 2012-10-24 20:09:22, End Time: 2012-10-24 21:34:06 To: 5174, Order: 166601, Start Time: 2012-10-24 18:21:42, End Time: 2012-10-24 19:46:28 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 2 (186 on baseline) Unchanged Tests: 1039 (850 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.47% (54.5770 => 56.4715, std.dev.: 0.1290) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.08% (2.3177 => 2.2926, std.dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.88% (3.8644 => 3.7917, std.dev.: 0.0124) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.47% (54.5751 => 56.4715, std.dev.: 0.1290) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1012, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/salsa20: 2.46% (7.4937 => 7.6777, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout-C++/hash2: 2.26% (3.1932 => 3.2653, std.dev.: 0.0030) MultiSource/Benchmarks/llubenchmark/llu: 1.29% (3.7435 => 3.7917, std.dev.: 0.0124) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.29% (0.1431 => 0.1298, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.40% (0.3821 => 0.3500, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: -8.02% (2.4924 => 2.2926, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -7.67% (0.3831 => 0.3537, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -7.63% (0.3880 => 0.3584, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.62% (0.3884 => 0.3588, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -7.54% (0.3848 => 0.3558, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -7.52% (0.3896 => 0.3603) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.52% (22.4056 => 20.7213, std.dev.: 0.0212) SingleSource/UnitTests/ObjC/trivial-interface: -7.48% (0.3812 => 0.3527, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -7.46% (0.4033 => 0.3732, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.45% (0.3891 => 0.3601, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.45% (0.3142 => 0.2908, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -7.40% (0.4176 => 0.3867, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -7.39% (0.3357 => 0.3109, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.33% (0.2428 => 0.2250, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -7.18% (0.2160 => 0.2005, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -7.17% (0.4199 => 0.3898, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.13% (0.9542 => 0.8862, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -7.12% (16.1920 => 15.0390, std.dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -7.11% (3.5339 => 3.2827, std.dev.: 0.0156) SingleSource/UnitTests/ObjC/parameter-passing: -7.03% (0.4280 => 0.3979, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: -7.02% (0.1796 => 0.1670, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -6.98% (34.0927 => 31.7139, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/ReedSolomon: -6.97% (0.1879 => 0.1748, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.96% (6.7716 => 6.3006, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.95% (0.9852 => 0.9167, std.dev.: 0.0049) MultiSource/Applications/Burg/burg: -6.95% (1.2515 => 1.1645, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: -6.95% (0.9179 => 0.8541, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: -6.95% (1.1530 => 1.0729, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -6.95% (7.0961 => 6.6032, std.dev.: 0.0161) MultiSource/Benchmarks/mafft/pairlocalalign: -6.92% (9.2283 => 8.5897, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.89% (0.3658 => 0.3406, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.88% (0.2355 => 0.2193, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -6.87% (0.1761 => 0.1640, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.87% (1.0544 => 0.9820, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: -6.86% (4.3330 => 4.0357, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.80% (4.0323 => 3.7583, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.77% (0.6484 => 0.6045, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.76% (0.1716 => 0.1600, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.75% (0.2695 => 0.2513, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.75% (1.3722 => 1.2796, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -6.73% (0.1500 => 0.1399) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.73% (0.6736 => 0.6283, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: -6.69% (0.2659 => 0.2481, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -6.67% (0.7447 => 0.6950, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.65% (0.4151 => 0.3875, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.64% (1.6474 => 1.5380, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.62% (1.6364 => 1.5280, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: -6.60% (1.1450 => 1.0694) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.59% (1.4642 => 1.3677, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.58% (0.6293 => 0.5879, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.57% (4.5069 => 4.2108, std.dev.: 0.0076) MultiSource/Applications/siod/siod: -6.57% (2.4021 => 2.2443, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.57% (0.1584 => 0.1480, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.55% (0.2548 => 0.2381, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.53% (4.8161 => 4.5014, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -6.53% (0.2985 => 0.2790, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.53% (5.4682 => 5.1110, std.dev.: 0.0159) MultiSource/Applications/SPASS/SPASS: -6.52% (15.5079 => 14.4965, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.51% (1.2300 => 1.1499, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.49% (1.2784 => 1.1954, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: -6.48% (0.1621 => 0.1516, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.47% (0.7919 => 0.7407, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.44% (0.6052 => 0.5662, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.44% (0.6304 => 0.5898, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: -6.42% (0.5168 => 0.4836, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -6.42% (0.3581 => 0.3351, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.42% (0.5591 => 0.5232, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.40% (0.7198 => 0.6737, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -6.40% (4.0594 => 3.7998, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash2: -6.38% (0.4861 => 0.4551, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.36% (2.2587 => 2.1151, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: -6.35% (1.3864 => 1.2984, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -6.34% (0.6230 => 0.5835, std.dev.: 0.0084) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.33% (4.8802 => 4.5711, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.32% (0.7339 => 0.6875, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.32% (14.2083 => 13.3101, std.dev.: 0.0073) MultiSource/Benchmarks/McCat/05-eks/eks: -6.31% (0.4515 => 0.4230, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.30% (0.5999 => 0.5621, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.29% (0.6681 => 0.6261, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -6.28% (0.3406 => 0.3192, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -6.27% (0.3491 => 0.3272, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.27% (1.2210 => 1.1445, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.26% (0.5478 => 0.5135, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -6.26% (0.6660 => 0.6243, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.26% (0.6297 => 0.5903, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -6.25% (1.3148 => 1.2326, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.24% (0.5925 => 0.5555, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.24% (0.6395 => 0.5996, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: -6.23% (0.4524 => 0.4242, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.23% (0.4813 => 0.4513, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -6.22% (0.5575 => 0.5228, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: -6.22% (3.5154 => 3.2966, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.22% (1.2221 => 1.1461, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_container: -6.22% (0.9557 => 0.8963, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -6.21% (0.5941 => 0.5572, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -6.21% (0.6667 => 0.6253, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: -6.20% (0.2999 => 0.2813, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -6.20% (15.2527 => 14.3068, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -6.17% (0.5849 => 0.5488, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -6.17% (0.5705 => 0.5353, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.17% (0.5805 => 0.5447, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.16% (0.4916 => 0.4613, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -6.16% (0.6750 => 0.6334, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -6.16% (0.5569 => 0.5226, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.16% (0.6446 => 0.6049, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.16% (0.3931 => 0.3689, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -6.15% (17.1032 => 16.0509, std.dev.: 0.0205) SingleSource/Benchmarks/Shootout-C++/ary3: -6.15% (0.3446 => 0.3234, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.15% (0.6440 => 0.6044, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.15% (0.5857 => 0.5497, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.14% (0.5863 => 0.5503, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.12% (0.6189 => 0.5810, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -6.12% (0.2989 => 0.2806, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -6.12% (0.5456 => 0.5122, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.12% (0.2385 => 0.2239, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.12% (0.5802 => 0.5447, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -6.11% (0.7524 => 0.7064, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.11% (0.5859 => 0.5501, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.10% (0.6260 => 0.5878, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.09% (0.3483 => 0.3271, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -6.08% (0.6676 => 0.6270, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.08% (0.3849 => 0.3615, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.07% (0.3837 => 0.3604, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -6.07% (8.0126 => 7.5262, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -6.07% (0.5570 => 0.5232, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -6.06% (0.2278 => 0.2140, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.06% (0.5581 => 0.5243, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.06% (0.8521 => 0.8005, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.04% (0.5329 => 0.5007, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -6.04% (0.3394 => 0.3189) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.03% (0.5688 => 0.5345, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -6.02% (0.6033 => 0.5670, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -6.00% (0.3481 => 0.3272, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.00% (0.7021 => 0.6600, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -5.99% (0.3621 => 0.3404, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -5.99% (2.1401 => 2.0119, std.dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: -5.98% (0.3059 => 0.2876, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.97% (0.6395 => 0.6013, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.97% (0.3252 => 0.3058, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.94% (0.6194 => 0.5826, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -5.93% (0.3271 => 0.3077, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.93% (0.4083 => 0.3841, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.91% (0.5567 => 0.5238, std.dev.: 0.0032) MultiSource/Applications/kimwitu++/kc: -5.89% (18.2933 => 17.2165, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.85% (0.4427 => 0.4168, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -5.82% (0.3025 => 0.2849, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.81% (0.3323 => 0.3130, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.81% (2.1713 => 2.0452, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.79% (0.2106 => 0.1984, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -5.79% (0.3194 => 0.3009, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.79% (0.4321 => 0.4071, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.78% (0.3319 => 0.3127, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: -5.71% (0.3255 => 0.3069, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -5.70% (0.7982 => 0.7527, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists1: -5.66% (0.3867 => 0.3648, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: -5.65% (0.3026 => 0.2855, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.65% (0.2903 => 0.2739, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -5.62% (0.3788 => 0.3575, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -5.57% (0.2871 => 0.2711, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.56% (0.3057 => 0.2887, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -5.55% (0.8418 => 0.7951, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/random: -5.48% (0.2939 => 0.2778, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -5.43% (0.3205 => 0.3031, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.37% (0.3016 => 0.2854, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -5.31% (5.0226 => 4.7560, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.30% (0.2001 => 0.1895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.28% (0.2933 => 0.2778, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: -5.19% (0.2849 => 0.2701, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: -5.10% (0.9077 => 0.8614, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: -5.09% (0.6441 => 0.6113, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -5.06% (0.7779 => 0.7385, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -5.03% (0.6347 => 0.6028, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -4.66% (1.5610 => 1.4883, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.61% (0.2277 => 0.2172, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -3.04% (20.7746 => 20.1430, std.dev.: 0.0333) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7574, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1723, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.73% (2.2633 => 2.1788, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.54% (1.3096 => 1.2632, std.dev.: 0.0120) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.52% (6.5735 => 6.4735, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 24 14:43:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 24 Oct 2012 16:43:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121024214353.D6AAA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5178?compare_to=5175&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5178, Order: 166612, Start Time: 2012-10-24 20:25:29, End Time: 2012-10-24 21:45:58 To: 5175, Order: 166602, Start Time: 2012-10-24 18:35:14, End Time: 2012-10-24 19:55:46 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (5 on baseline) Performance Regressions: 2 (201 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 88 (14 on baseline) Unchanged Tests: 952 (641 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.07% (15.7580 => 15.9270, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.52% (55.0447 => 56.4298, std.dev.: 0.1943) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.14% (0.6320 => 0.6311, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 0.00% (17.3400 => 17.3404, std.dev.: 0.0029) MultiSource/Applications/kimwitu++/kc: -0.19% (15.7797 => 15.7502, std.dev.: 0.0144) MultiSource/Benchmarks/Bullet/bullet: -0.09% (57.3808 => 57.3266, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0490 => 0.0490, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0492 => 0.0492, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.22% (0.0460 => 0.0459, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0461 => 0.0461) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.22% (0.0449 => 0.0448, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.22% (0.0451 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.23% (0.0443 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0444 => 0.0444) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0461 => 0.0461, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.22% (0.0462 => 0.0461, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0455 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0456 => 0.0456, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.22% (0.0445 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0447 => 0.0447) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0452 => 0.0452, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.22% (0.0454 => 0.0453, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.22% (0.0464 => 0.0463, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0465 => 0.0465, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0440 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0441 => 0.0441) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0452 => 0.0452) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0453 => 0.0453, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0443 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.23% (0.0444 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.23% (0.0436 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.23% (0.0437 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0434 => 0.0434) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0436 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0472 => 0.0472, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.21% (0.0473 => 0.0472, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.23% (0.0434 => 0.0433, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0434 => 0.0434, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0434 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0435 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0442 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0443 => 0.0443, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -0.04% (1.5081 => 1.5075, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.02% (8.3029 => 8.3013, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.36% (0.6948 => 0.6923, std.dev.: 0.0035) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1437 => 0.1437, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.31% (0.0649 => 0.0647, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -9.36% (63.2438 => 57.3266, std.dev.: 0.0125) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/MallocBench/gs/gs: 13.64% (4.1105 => 4.6711, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++-EH/spirit: 69.25% (3.4629 => 5.8609, std.dev.: 0.0218) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MallocBench/gs/gs SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13506.11% (0.0720 => 9.7964, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050200.00% (0.0001 => 10.0503, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 69.53% (0.0256 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 65.35% (0.2554 => 0.4223, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 53.63% (10.3673 => 15.9270, std.dev.: 0.0042) SingleSource/Regression/C/sumarraymalloc: 51.03% (0.0243 => 0.0367) SingleSource/UnitTests/SignlessTypes/factor: 47.64% (0.0296 => 0.0437, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 44.65% (0.0271 => 0.0392, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.88% (1.5859 => 2.2500, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 40.32% (0.1622 => 0.2276, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 37.50% (0.1056 => 0.1452, std.dev.: 0.0001) SingleSource/UnitTests/vla: 33.80% (0.0355 => 0.0475, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.87% (2.2024 => 2.8823, std.dev.: 0.0156) MultiSource/Benchmarks/FreeBench/neural/neural: 28.57% (0.1463 => 0.1881, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 24.95% (0.1655 => 0.2068, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 23.86% (0.0834 => 0.1033, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.84% (0.1566 => 0.1908, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: 21.62% (0.2049 => 0.2492, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 21.60% (7.0540 => 8.5779, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout/hash: 21.24% (0.0485 => 0.0588, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 21.16% (0.1432 => 0.1735, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 21.00% (2.2022 => 2.6646, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.29% (0.0871 => 0.1039, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 19.26% (0.5105 => 0.6088, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 19.23% (0.1555 => 0.1854, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.64% (0.6675 => 0.7919, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: 17.57% (0.0626 => 0.0736, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.49% (0.1029 => 0.1209, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 17.45% (0.1175 => 0.1380, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 17.43% (0.1440 => 0.1691, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.32% (1.3050 => 1.5310, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 17.20% (3.3354 => 3.9091, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/em3d/em3d: 16.99% (0.1695 => 0.1983, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.95% (0.2271 => 0.2656, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.81% (0.4615 => 0.5391, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.77% (0.0793 => 0.0926, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.76% (0.3121 => 0.3644, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/mst/mst: 16.68% (0.1163 => 0.1357, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 16.61% (0.3282 => 0.3827, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.51% (0.8172 => 0.9521, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.28% (0.1032 => 0.1200, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.25% (0.5020 => 0.5836, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.16% (1.5415 => 1.7906, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.14% (0.0886 => 0.1029) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 16.05% (0.4879 => 0.5662, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 15.98% (0.7115 => 0.8252, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.86% (0.1337 => 0.1549, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 15.83% (10.4361 => 12.0885, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.83% (0.1510 => 0.1749, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: 15.77% (0.0818 => 0.0947, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 15.75% (1.7609 => 2.0382, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 15.73% (0.3109 => 0.3598, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.72% (0.1940 => 0.2245, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.68% (0.0842 => 0.0974, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 15.48% (0.0672 => 0.0776) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.41% (0.0675 => 0.0779, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.37% (0.9765 => 1.1266, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 15.28% (0.0746 => 0.0860, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 15.16% (0.3423 => 0.3942, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 15.16% (0.1438 => 0.1656, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.16% (0.0838 => 0.0965, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.13% (0.1117 => 0.1286, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 15.11% (1.1642 => 1.3401, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 15.09% (8.1363 => 9.3641, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/espresso/espresso: 15.02% (4.2646 => 4.9053, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 14.95% (0.1906 => 0.2191) MultiSource/Benchmarks/mafft/pairlocalalign: 14.94% (9.4845 => 10.9012, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.94% (0.0770 => 0.0885, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 14.92% (0.3177 => 0.3651, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.86% (0.2107 => 0.2420, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 14.79% (0.0730 => 0.0838, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.77% (0.1584 => 0.1818, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/exptree: 14.74% (0.0814 => 0.0934, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.64% (0.1236 => 0.1417, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.62% (0.6450 => 0.7393, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 14.60% (0.1151 => 0.1319, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.58% (0.2758 => 0.3160, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.56% (0.2700 => 0.3093, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.51% (0.5860 => 0.6710, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.48% (0.2065 => 0.2364, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.47% (0.0933 => 0.1068, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.38% (0.5981 => 0.6841, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.34% (0.1695 => 0.1938, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 14.21% (0.7835 => 0.8948, std.dev.: 0.0024) SingleSource/UnitTests/SignlessTypes/rem: 14.16% (0.1144 => 0.1306, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 14.13% (1.4186 => 1.6190, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.03% (0.1062 => 0.1211, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 13.93% (5.7591 => 6.5611, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.91% (0.0798 => 0.0909, std.dev.: 0.0019) MultiSource/Applications/treecc/treecc: 13.85% (2.0273 => 2.3081, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 13.85% (4.9449 => 5.6296, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 13.84% (0.0730 => 0.0831, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 13.82% (0.7433 => 0.8460, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.81% (5.0018 => 5.6926, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.77% (0.0770 => 0.0876, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 13.73% (1.1840 => 1.3466, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 13.72% (0.1268 => 0.1442, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 13.67% (0.3387 => 0.3850, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 13.60% (1.0722 => 1.2180, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.56% (0.0929 => 0.1055, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 13.49% (3.8723 => 4.3945, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.47% (0.8067 => 0.9154, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 13.47% (0.4299 => 0.4878, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.46% (0.1330 => 0.1509, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.42% (7.9617 => 9.0299, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.37% (0.3307 => 0.3749, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.29% (0.1625 => 0.1841, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 13.05% (1.1861 => 1.3409, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.02% (0.2603 => 0.2942, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.00% (0.5569 => 0.6293, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 12.90% (0.3092 => 0.3491, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 12.83% (0.3180 => 0.3588, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 12.62% (0.1125 => 0.1267, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.62% (0.2266 => 0.2552, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 12.60% (0.8921 => 1.0045, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.60% (0.1143 => 0.1287, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.44% (0.3441 => 0.3869, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 12.12% (1.5603 => 1.7494, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.02% (0.3543 => 0.3969, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.85% (0.8101 => 0.9061, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.83% (1.1194 => 1.2518, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 11.82% (0.6456 => 0.7219, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.57% (0.3543 => 0.3953, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 11.55% (0.3473 => 0.3874, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.51% (0.3561 => 0.3971, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.38% (0.3927 => 0.4374, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/property: 11.35% (0.3886 => 0.4327, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.34% (0.3694 => 0.4113, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.32% (0.3497 => 0.3893, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.32% (0.3516 => 0.3914, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.31% (0.3828 => 0.4261, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 11.19% (21.9371 => 24.3929, std.dev.: 0.0149) MultiSource/Applications/siod/siod: 11.06% (2.2969 => 2.5510, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.94% (0.1892 => 0.2099, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 10.89% (0.4620 => 0.5123, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 10.73% (0.4289 => 0.4749, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.54% (0.1044 => 0.1154, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 10.49% (0.0953 => 0.1053) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.06% (0.3865 => 0.4254, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 9.96% (0.3422 => 0.3763, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.96% (0.3826 => 0.4207, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.78% (0.4203 => 0.4614, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.73% (0.4636 => 0.5087, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.68% (0.4103 => 0.4500, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 9.66% (0.3684 => 0.4040, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 9.54% (0.4048 => 0.4434, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.47% (0.5925 => 0.6486, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.37% (0.3427 => 0.3748, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 9.35% (0.6030 => 0.6594, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 9.32% (17.1811 => 18.7828, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.09% (0.2430 => 0.2651, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 8.85% (0.3603 => 0.3922, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 8.76% (0.7326 => 0.7968, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.57% (3.8922 => 4.2258, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.56% (14.3668 => 15.5972, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.29% (0.4064 => 0.4401, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.19% (0.3650 => 0.3949, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 8.07% (0.3098 => 0.3348, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 7.86% (0.3283 => 0.3541, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/strcat: 7.77% (0.2831 => 0.3051, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.75% (0.3162 => 0.3407, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.70% (0.3232 => 0.3481, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.68% (0.2891 => 0.3113, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.62% (0.3136 => 0.3375, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 7.57% (0.2905 => 0.3125, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.56% (0.2872 => 0.3089, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.48% (2.0665 => 2.2210, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.38% (0.2871 => 0.3083, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.33% (0.2756 => 0.2958, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 7.31% (0.3379 => 0.3626, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/methcall: 7.26% (0.2877 => 0.3086, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.23% (0.2793 => 0.2995, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 7.19% (0.2725 => 0.2921, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 7.11% (0.3052 => 0.3269, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 7.00% (0.2802 => 0.2998, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.96% (0.2714 => 0.2903, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 6.70% (1.2842 => 1.3702, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.97% (0.3131 => 0.3318, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.80% (0.3817 => 0.3962, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.56% (0.3935 => 0.4075, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1725, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.39% (0.9957 => 1.1290, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 10.06% (1.1396 => 1.2542, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3689, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.64% (2.8904 => 3.0823, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625) MultiSource/Benchmarks/Olden/bh/bh: 3.82% (1.9405 => 2.0146, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.72% (4.2280 => 4.3432, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.61% (0.3987 => 0.4091, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0313 => 1.0567, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.91% (0.8333 => 0.8492, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.85% (3.6395 => 3.7070, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.58% (2.6546 => 2.6965, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 1.54% (3.1595 => 3.2081, std.dev.: 0.0007) MultiSource/Benchmarks/llubenchmark/llu: 1.53% (3.7781 => 3.8359, std.dev.: 0.0135) MultiSource/Applications/viterbi/viterbi: 1.19% (4.4649 => 4.5180, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.99% (6.6874 => 0.1346, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -77.08% (0.8651 => 0.1983, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -36.93% (5.2763 => 3.3278, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -29.45% (5.3855 => 3.7997, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -29.06% (5.3526 => 3.7969, std.dev.: 0.0082) SingleSource/UnitTests/Vector/constpool: -9.50% (54.1659 => 49.0194, std.dev.: 0.0232) MultiSource/Applications/ClamAV/clamscan: -2.08% (22.1758 => 21.7155, std.dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -52.87% (8.0499 => 3.7940, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.43% (1.1492 => 0.7650, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4750, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -15.99% (1.6925 => 1.4218, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.71% (1.2258 => 1.0700, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -12.00% (1.2373 => 1.0888, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/mandel-2: -10.60% (1.5373 => 1.3743, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.32% (19.9488 => 18.2898, std.dev.: 0.0134) MultiSource/Benchmarks/FreeBench/mason/mason: -8.01% (0.2161 => 0.1988, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.00% (1.8329 => 1.7046, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8479, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.17% (1.6805 => 1.5936, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.67% (1.5835 => 1.5095, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.23% (8.1563 => 7.8109, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1625, std.dev.: 0.0077) MultiSource/Benchmarks/sim/sim: -3.39% (5.0483 => 4.8774, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4961, std.dev.: 0.0045) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.60% (0.4808 => 0.4683, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: -2.18% (4.6441 => 4.5430, std.dev.: 0.0022) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.90% (10.2830 => 10.0873, std.dev.: 0.0180) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6834, std.dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -1.66% (2.5528 => 2.5105, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4224, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2879, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/lists: -1.10% (6.2999 => 6.2309, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 20.69% (0.5229 => 0.6311, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 15.68% (14.9895 => 17.3404, std.dev.: 0.0029) MultiSource/Applications/kimwitu++/kc: 11.27% (14.1553 => 15.7502, std.dev.: 0.0144) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.45% (1.1048 => 1.5075, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 15.97% (7.1582 => 8.3013, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.27% (0.6222 => 0.6923, std.dev.: 0.0035) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.23% (0.1485 => 0.1437, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.42% (0.2116 => 0.0647, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 24 15:42:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 24 Oct 2012 17:42:12 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121024224212.9AAC62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5179?compare_to=5176&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5179, Order: 166621, Start Time: 2012-10-24 21:19:27, End Time: 2012-10-24 22:44:18 To: 5176, Order: 166609, Start Time: 2012-10-24 19:37:19, End Time: 2012-10-24 21:01:36 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 10 (36 on baseline) Performance Improvements: 1 (5 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 964 (933 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.65% (0.9190 => 0.9342, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 1.34% (1.4675 => 1.4871, std.dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 9.01% (20.1183 => 21.9304, std.dev.: 0.4617) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.18% (2.4355 => 2.4887, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.14% (2.9117 => 2.9741, std.dev.: 0.0029) MultiSource/Applications/SIBsim4/SIBsim4: 1.25% (3.1807 => 3.2205, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/fp-convert: 1.23% (15.7011 => 15.8945, std.dev.: 0.0172) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.08% (1.8726 => 1.8928, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/pi: 1.05% (2.4873 => 2.5133, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/tsp/tsp: 1.01% (1.4812 => 1.4961, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.09% (2.9139 => 2.8822, std.dev.: 0.0095) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 1.31% (16.5640 => 16.7811, std.dev.: 0.1094) MultiSource/Applications/obsequi/Obsequi: 1.83% (1.0502 => 1.0694, std.dev.: 0.0121) MultiSource/Applications/sqlite3/sqlite3: 0.44% (0.6421 => 0.6449, std.dev.: 0.0096) MultiSource/Benchmarks/McCat/08-main/main: 5.29% (0.1910 => 0.2011, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.12% (0.1696 => 0.1660, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.25% (0.3236 => 0.3228, std.dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.36% (0.2485 => 0.2476, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.54% (0.3361 => 0.3379, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.15% (0.2375 => 0.2426, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/bigfib: -0.55% (0.6003 => 0.5970, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel: 2.39% (0.0461 => 0.0472, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.94% (0.3308 => 0.3277, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/strcat: -0.35% (0.1983 => 0.1976, std.dev.: 0.0011) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 14.16% (0.0226 => 0.0258, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.91% (0.0219 => 0.0221, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.23% (0.0426 => 0.0427, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.30% (0.0331 => 0.0330, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.64% (0.0314 => 0.0312, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.23% (0.0426 => 0.0425, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -0.98% (0.0204 => 0.0202, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -1.37% (0.0219 => 0.0216, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -6.49% (0.0339 => 0.0317, std.dev.: 0.0030) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 7.69% (0.0013 => 0.0014) MultiSource/Applications/ClamAV/clamscan: 2.02% (0.1482 => 0.1512, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 5.00% (1.1270 => 1.1834, std.dev.: 0.0378) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.26% (0.1519 => 0.1523, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.71% (0.4102 => 0.4172, std.dev.: 0.0389) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.92% (0.1412 => 0.1399, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.93% (0.0649 => 0.0630, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.72% (0.0277 => 0.0275, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.39% (0.0561 => 0.0542, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.37% (1.1437 => 1.1479, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.86% (0.0630 => 0.0612, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.35% (0.0252 => 0.0236, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.01% (0.8027 => 0.7946, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 9.09% (0.0044 => 0.0048, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.07% (2.1832 => 1.6576, std.dev.: 0.0088) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.54% (0.0810 => 0.0944, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.31% (0.8321 => 0.9179, std.dev.: 0.0293) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.15% (0.1137 => 0.1241, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.30% (0.2180 => 0.2361, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.27% (0.2998 => 0.3216, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.92% (0.4847 => 0.5134, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.78% (0.7473 => 0.7905, std.dev.: 0.0071) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.74% (0.2133 => 0.2234, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.49% (0.2519 => 0.2632, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.30% (0.8148 => 0.8498, std.dev.: 0.0134) MultiSource/Applications/hbd/hbd: 4.22% (1.4269 => 1.4871, std.dev.: 0.0074) MultiSource/Applications/Burg/burg: 4.02% (1.2222 => 1.2713, std.dev.: 0.0142) MultiSource/Applications/spiff/spiff: 3.91% (0.7950 => 0.8261, std.dev.: 0.0096) MultiSource/Applications/sgefa/sgefa: 3.47% (0.2999 => 0.3103, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 3.01% (0.9069 => 0.9342, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 2.84% (14.7684 => 15.1879, std.dev.: 0.0506) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.75% (1.6386 => 1.6837, std.dev.: 0.0174) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.73% (0.9435 => 0.9693, std.dev.: 0.0097) MultiSource/Applications/SIBsim4/SIBsim4: 2.60% (1.2568 => 1.2895, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.60% (0.5817 => 0.5968, std.dev.: 0.0053) MultiSource/Applications/JM/ldecod/ldecod: 2.23% (6.7320 => 6.8823, std.dev.: 0.0300) MultiSource/Applications/lemon/lemon: 2.03% (1.0945 => 1.1167, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.83% (0.8697 => 0.8856, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.73% (0.8317 => 0.8461, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.69% (0.8331 => 0.8472, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.22% (0.8885 => 0.8993, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 59.12% (1.5795 => 2.5133, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.73% (0.3186 => 0.3496, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.49% (1.1857 => 1.2864, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 5.97% (63.1822 => 66.9526, std.dev.: 0.1292) SingleSource/Benchmarks/Misc/ReedSolomon: 3.53% (8.5322 => 8.8338, std.dev.: 0.0061) MultiSource/Applications/siod/siod: 2.68% (3.6643 => 3.7624, std.dev.: 0.0199) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.28% (2.4333 => 2.4887, std.dev.: 0.0164) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.56% (2.4490 => 2.4872, std.dev.: 0.0142) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.24% (1.0998 => 1.1134, std.dev.: 0.0036) MultiSource/Applications/SIBsim4/SIBsim4: 1.04% (3.1873 => 3.2205, std.dev.: 0.0065) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.88% (0.3269 => 0.2946, std.dev.: 0.0044) MultiSource/Applications/lua/lua: -4.93% (29.8330 => 28.3609, std.dev.: 0.1703) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.98% (7.2130 => 6.9978, std.dev.: 0.0802) SingleSource/Benchmarks/Shootout-C++/hash2: -1.48% (3.4237 => 3.3729, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.31% (3.3479 => 3.3042, std.dev.: 0.0020) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 2.04% (16.4461 => 16.7811, std.dev.: 0.1094) MultiSource/Applications/obsequi/Obsequi: 4.21% (1.0262 => 1.0694, std.dev.: 0.0121) MultiSource/Applications/sqlite3/sqlite3: 1.85% (0.6332 => 0.6449, std.dev.: 0.0096) MultiSource/Benchmarks/McCat/08-main/main: 9.83% (0.1831 => 0.2011, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 6.48% (0.1559 => 0.1660, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.36% (0.3123 => 0.3228, std.dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.53% (0.2463 => 0.2476, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.05% (0.3344 => 0.3379, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.62% (0.2364 => 0.2426, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/bigfib: -0.67% (0.6010 => 0.5970, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel: 10.02% (0.0429 => 0.0472, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.34% (0.3266 => 0.3277, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/strcat: 0.36% (0.1969 => 0.1976, std.dev.: 0.0011) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 15.18% (0.0224 => 0.0258, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 79.67% (0.0123 => 0.0221, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 20.00% (0.0180 => 0.0216, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: 37.83% (0.0230 => 0.0317, std.dev.: 0.0030) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 100.00% (0.0007 => 0.0014) MultiSource/Applications/ClamAV/clamscan: 5.15% (0.1438 => 0.1512, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 4.46% (1.1329 => 1.1834, std.dev.: 0.0378) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 4.17% (0.1462 => 0.1523, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.19% (0.4164 => 0.4172, std.dev.: 0.0389) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.19% (0.1369 => 0.1399, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.72% (0.0641 => 0.0630, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.03% (0.0195 => 0.0275, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.23% (0.0578 => 0.0542, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.37% (1.1437 => 1.1479, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.39% (0.0627 => 0.0612, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 31.11% (0.0180 => 0.0236, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.89% (0.8017 => 0.7946, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -22.58% (0.0062 => 0.0048, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 24 15:55:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 24 Oct 2012 17:55:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121024225523.0C4C02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5180?compare_to=5172&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5180, Order: 166607, Start Time: 2012-10-24 19:41:55, End Time: 2012-10-24 22:57:26 To: 5172, Order: 166562, Start Time: 2012-10-24 15:37:10, End Time: 2012-10-24 18:53:30 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 5 (172 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1036 (718 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Bullet/bullet: 1.74% (26.9932 => 27.4639, std.dev.: 0.0128) MultiSource/Applications/sqlite3/sqlite3: 1.26% (2.2172 => 2.2452, std.dev.: 0.0020) MultiSource/Applications/hbd/hbd: 1.13% (1.1329 => 1.1457, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.11% (2.3882 => 2.4147, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.02% (5.0898 => 5.1417, std.dev.: 0.0060) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/lists: -1.03% (28.4939 => 28.1994, std.dev.: 0.0233) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.44% (0.0625 => 0.0884, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.55% (0.1063 => 0.1409, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.51% (0.2969 => 0.3756, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.31% (0.1106 => 0.1397, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.68% (0.4253 => 0.5345, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.20% (0.4139 => 0.5182, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 24.93% (1.5932 => 1.9904, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.23% (0.0714 => 0.0887, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 24.13% (0.0547 => 0.0679, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.89% (0.4994 => 0.6187, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.58% (0.0475 => 0.0587, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.56% (0.5900 => 0.7290, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.34% (0.5000 => 0.6167, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.12% (0.0584 => 0.0719, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.74% (0.0897 => 0.1101, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.35% (0.1620 => 0.1982, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.23% (0.1021 => 0.1248, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 22.04% (0.0599 => 0.0731, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.68% (0.1107 => 0.1347, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.07% (0.0541 => 0.0655, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 20.99% (0.0948 => 0.1147, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.86% (0.3903 => 0.4717, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.85% (0.0633 => 0.0765, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.81% (0.0495 => 0.0598, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.67% (0.1103 => 0.1331, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 20.58% (0.0821 => 0.0990, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.55% (0.0584 => 0.0704, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.46% (0.1549 => 0.1866, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.40% (0.0642 => 0.0773, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.39% (0.1604 => 0.1931, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 20.20% (0.0604 => 0.0726, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.04% (0.1003 => 0.1204, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.95% (0.0822 => 0.0986, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 19.89% (0.1619 => 0.1941, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 19.32% (0.0947 => 0.1130, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.15% (0.1462 => 0.1742, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.10% (0.3890 => 0.4633, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 19.06% (0.0808 => 0.0962, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.82% (0.2014 => 0.2393, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: 18.31% (0.1218 => 0.1441, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 18.27% (0.1505 => 0.1780, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.26% (1.3152 => 1.5554, std.dev.: 0.0022) MultiSource/Applications/spiff/spiff: 18.17% (0.4029 => 0.4761, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: 18.15% (0.9697 => 1.1457, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.13% (0.2736 => 0.3232, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 17.91% (0.0698 => 0.0823, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 17.85% (0.2750 => 0.3241, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.83% (0.1088 => 0.1282, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.81% (0.2875 => 0.3387, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 17.80% (0.5826 => 0.6863, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference-object: 17.73% (0.5889 => 0.6933, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.55% (0.2866 => 0.3369, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 17.54% (1.8794 => 2.2091, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.54% (3.5627 => 4.1876, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: 17.51% (0.5546 => 0.6517, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.50% (0.1160 => 0.1363, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 17.32% (0.2725 => 0.3197, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 17.28% (0.2714 => 0.3183, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.20% (0.4658 => 0.5459, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 17.18% (0.3004 => 0.3520, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.17% (0.1968 => 0.2306, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 17.16% (0.2780 => 0.3257, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 17.10% (0.1421 => 0.1664, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.06% (0.2738 => 0.3205, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.00% (0.2729 => 0.3193, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.98% (1.6211 => 1.8964, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.87% (0.2792 => 0.3263, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 16.86% (0.0605 => 0.0707, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 16.83% (0.2811 => 0.3284, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.80% (2.0673 => 2.4147, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 16.80% (0.3096 => 0.3616, std.dev.: 0.0013) MultiSource/Applications/d/make_dparser: 16.79% (1.0781 => 1.2591, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.78% (0.3271 => 0.3820, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 16.77% (23.5202 => 27.4639, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.76% (0.2911 => 0.3399, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/random: 16.73% (0.2803 => 0.3272, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.71% (0.3195 => 0.3729, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/objinst: 16.68% (0.2823 => 0.3294, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 16.67% (0.2813 => 0.3282, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.65% (0.5026 => 0.5863, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 16.61% (0.9909 => 1.1555, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.49% (0.4361 => 0.5080, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 16.44% (0.3267 => 0.3804, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.34% (4.4195 => 5.1417, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ary: 16.30% (0.3258 => 0.3789, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 16.07% (4.2109 => 4.8878, std.dev.: 0.0083) MultiSource/Benchmarks/Olden/bh/bh: 16.04% (0.1284 => 0.1490, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.03% (0.3930 => 0.4560, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.95% (2.7292 => 3.1644, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.94% (0.3362 => 0.3898, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 15.92% (0.3317 => 0.3845, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.65% (0.3060 => 0.3539, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.64% (1.9694 => 2.2775, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.54% (1.9966 => 2.3068, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.52% (0.3124 => 0.3609, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 15.42% (0.7171 => 0.8277, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 15.42% (0.2075 => 0.2395, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.33% (0.3282 => 0.3785, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 15.32% (0.3726 => 0.4297, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.32% (0.1090 => 0.1257, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 15.17% (0.3348 => 0.3856, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 15.14% (0.3678 => 0.4235, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 15.08% (0.4251 => 0.4892, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 15.04% (0.3477 => 0.4000, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 14.93% (0.2566 => 0.2949, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.85% (0.3981 => 0.4572, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.79% (0.3625 => 0.4161, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.77% (0.3690 => 0.4235, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 14.69% (0.4146 => 0.4755, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.49% (0.3845 => 0.4402, std.dev.: 0.0017) MultiSource/Applications/lua/lua: 14.39% (1.4269 => 1.6323, std.dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 14.37% (2.1653 => 2.4765, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 14.23% (0.5012 => 0.5725, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 14.06% (4.6177 => 5.2668, std.dev.: 0.0126) MultiSource/Applications/treecc/treecc: 13.99% (0.7875 => 0.8977, std.dev.: 0.0034) MultiSource/Benchmarks/sim/sim: 13.85% (0.0758 => 0.0863, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 13.68% (0.3465 => 0.3939, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.63% (0.2040 => 0.2318, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.59% (0.3488 => 0.3962, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 13.41% (2.1013 => 2.3830, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-2: 13.35% (0.3446 => 0.3906, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/for-in: 13.33% (0.3496 => 0.3962, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 13.29% (0.3460 => 0.3920, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 13.28% (0.3442 => 0.3899, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 13.26% (0.3469 => 0.3929, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 13.12% (0.2691 => 0.3044, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 13.10% (0.3650 => 0.4128, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 12.90% (0.3643 => 0.4113, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 12.84% (0.3724 => 0.4202, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.57% (0.6435 => 0.7244, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.51% (0.1383 => 0.1556, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 12.18% (0.3498 => 0.3924, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 11.85% (5.5417 => 6.1985, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.77% (0.1028 => 0.1149, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.66% (0.2737 => 0.3056, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.27% (0.2068 => 0.2301, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 11.22% (0.4847 => 0.5391, std.dev.: 0.0044) MultiSource/Applications/siod/siod: 11.06% (0.6634 => 0.7368, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.06% (0.3084 => 0.3425, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 10.94% (0.3336 => 0.3701, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.46% (0.2103 => 0.2323, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 10.35% (2.0346 => 2.2452, std.dev.: 0.0020) MultiSource/Applications/lemon/lemon: 10.00% (0.2391 => 0.2630, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.55% (4.6926 => 5.1408, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.31% (0.5361 => 0.5860, std.dev.: 0.0057) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.23% (11.6398 => 12.7140, std.dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.49% (0.5584 => 0.6058, std.dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.42% (0.7426 => 0.8051, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 7.37% (11.9555 => 12.8361, std.dev.: 0.0145) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.14% (0.3792 => 0.3949, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.32% (0.2162 => 0.3531, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6533, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.25% (0.5917 => 0.6701) MultiSource/Applications/ClamAV/clamscan: 8.10% (0.2802 => 0.3029, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6093, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 5.00% (12.0509 => 12.6530, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/ary: 5.00% (0.2122 => 0.2228, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 4.73% (15.4430 => 16.1732, std.dev.: 0.0159) SingleSource/Benchmarks/Misc/flops-2: 3.84% (1.8057 => 1.8750, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/dry: 2.74% (14.0481 => 14.4334, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary3: 2.10% (15.8721 => 16.2050, std.dev.: 0.0348) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.76% (3.1722 => 3.2279, std.dev.: 0.0020) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3082, std.dev.: 0.0103) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2843, std.dev.: 0.0061) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5145, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.07% (1.2451 => 1.2584, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5896, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.48% (25.4195 => 16.4001, std.dev.: 0.0144) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9762, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -7.67% (35.5013 => 32.7766, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/tsp/tsp: -7.18% (2.1113 => 1.9597, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary2: -6.29% (0.2402 => 0.2251, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.39% (11.2080 => 10.8277, std.dev.: 0.0485) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7740, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5217, std.dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/fldry: -2.58% (17.2379 => 16.7937, std.dev.: 0.0372) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8653, std.dev.: 0.0226) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5713, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.72% (0.6293 => 0.6185, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: -1.44% (5.5810 => 5.5006, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7160, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.15% (105.3826 => 104.1675, std.dev.: 0.0888) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0431, std.dev.: 0.0029) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.03% (3.3991 => 3.3641, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 24 16:19:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 24 Oct 2012 18:19:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121024231952.3D8CD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5181?compare_to=5177&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5181, Order: 166624, Start Time: 2012-10-24 21:57:00, End Time: 2012-10-24 23:21:56 To: 5177, Order: 166611, Start Time: 2012-10-24 20:09:22, End Time: 2012-10-24 21:34:06 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 0 (179 on baseline) Unchanged Tests: 1041 (859 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.55% (29.0113 => 29.7508, std.dev.: 0.0973) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1008, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/hash2: 2.42% (3.1932 => 3.2704, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: 2.36% (7.4937 => 7.6709, std.dev.: 0.0180) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.43% (0.1431 => 0.1296, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.58% (0.3821 => 0.3493, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -7.95% (2.4924 => 2.2943, std.dev.: 0.0348) MultiSource/Applications/sgefa/sgefa: -7.54% (0.3357 => 0.3104, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.51% (0.3142 => 0.2906, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.47% (22.4056 => 20.7308, std.dev.: 0.0104) SingleSource/Benchmarks/Misc/oourafft: -7.36% (0.2160 => 0.2001, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.33% (0.9542 => 0.8843, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.29% (0.2428 => 0.2251, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -7.28% (3.5339 => 3.2765, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -7.10% (0.9852 => 0.9153, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -7.08% (16.1920 => 15.0454, std.dev.: 0.0115) SingleSource/Benchmarks/Misc/ReedSolomon: -7.08% (0.1879 => 0.1746, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: -7.07% (0.1796 => 0.1669, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: -7.06% (4.3330 => 4.0270, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: -7.04% (0.9179 => 0.8533, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -7.03% (0.3658 => 0.3401, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -7.01% (9.2283 => 8.5810, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: -6.98% (0.1761 => 0.1638, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.96% (1.6474 => 1.5328, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.94% (0.1584 => 0.1474, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -6.94% (7.0961 => 6.6038, std.dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.91% (1.0544 => 0.9815, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: -6.91% (1.1530 => 1.0733, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -6.90% (1.2515 => 1.1652, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.88% (0.6484 => 0.6038, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.88% (0.1716 => 0.1598, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.84% (5.4682 => 5.0944, std.dev.: 0.0083) SingleSource/UnitTests/ObjC/exceptions-4: -6.83% (0.3880 => 0.3615, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -6.81% (0.3831 => 0.3570, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.79% (0.2548 => 0.2375, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.78% (0.6736 => 0.6279, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.77% (1.3722 => 1.2793, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.77% (4.0323 => 3.7595, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.75% (0.2695 => 0.2513, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.75% (0.2355 => 0.2196, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.75% (0.3896 => 0.3633, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.75% (6.7716 => 6.3145, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: -6.72% (0.4033 => 0.3762, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.71% (0.3891 => 0.3630, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.70% (0.3848 => 0.3590, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -6.70% (2.4021 => 2.2411, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.70% (1.4642 => 1.3661, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.69% (0.7919 => 0.7389, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -6.69% (4.0594 => 3.7879, std.dev.: 0.0083) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.67% (0.3884 => 0.3625, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -6.67% (0.2985 => 0.2786, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -6.65% (1.1450 => 1.0689, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -6.64% (0.3812 => 0.3559, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.60% (4.5069 => 4.2094, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: -6.59% (0.7447 => 0.6956, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.59% (1.2784 => 1.1942, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -6.58% (0.2659 => 0.2484, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.56% (0.6052 => 0.5655, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -6.55% (0.4199 => 0.3924, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.54% (0.4176 => 0.3903, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.52% (0.6304 => 0.5893, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -6.52% (0.4280 => 0.4001, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.50% (1.2300 => 1.1500, std.dev.: 0.0118) MultiSource/Benchmarks/Bullet/bullet: -6.49% (34.0927 => 31.8815, std.dev.: 0.0159) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.48% (4.8161 => 4.5042, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.46% (1.6364 => 1.5307, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.45% (0.6293 => 0.5887, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.43% (0.6297 => 0.5892, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -6.43% (0.3406 => 0.3187, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -6.42% (0.5168 => 0.4836, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: -6.42% (0.1621 => 0.1517, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.40% (0.3483 => 0.3260, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.40% (2.2587 => 2.1141, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.40% (1.2221 => 1.1439, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.39% (14.2083 => 13.3007, std.dev.: 0.0293) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.39% (4.8802 => 4.5685, std.dev.: 0.0040) MultiSource/Applications/SIBsim4/SIBsim4: -6.38% (1.3864 => 1.2979, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -6.38% (0.7524 => 0.7044, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.38% (0.6681 => 0.6255, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -6.36% (15.5079 => 14.5211, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -6.36% (0.5705 => 0.5342, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -6.36% (0.5849 => 0.5477, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -6.36% (0.6230 => 0.5834, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: -6.33% (0.4515 => 0.4229, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -6.32% (0.6660 => 0.6239, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.32% (0.5478 => 0.5132, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.32% (0.5859 => 0.5489, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -6.31% (0.5575 => 0.5223, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.31% (0.5925 => 0.5551, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: -6.31% (0.3581 => 0.3355, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.30% (0.6395 => 0.5992, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.29% (1.2210 => 1.1442, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.28% (0.5591 => 0.5240, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.27% (0.7339 => 0.6879, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: -6.26% (3.5154 => 3.2955, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -6.25% (0.6667 => 0.6250, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.25% (0.6446 => 0.6043, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.24% (0.8521 => 0.7989, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.24% (0.5863 => 0.5497, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.24% (0.7198 => 0.6749, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.23% (0.5857 => 0.5492, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.22% (0.5802 => 0.5441, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.22% (0.6189 => 0.5804, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.22% (0.4151 => 0.3893, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -6.19% (0.5570 => 0.5225, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.18% (0.5999 => 0.5628, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.18% (0.5805 => 0.5446, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.18% (0.6260 => 0.5873, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -6.17% (15.2527 => 14.3112, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -6.17% (0.6033 => 0.5661, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: -6.13% (18.2933 => 17.1720, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.12% (0.6440 => 0.6046, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -6.12% (17.1032 => 16.0570, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -6.11% (0.5941 => 0.5578, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.11% (0.4813 => 0.4519, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.10% (0.6194 => 0.5816, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -6.09% (0.5569 => 0.5230, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -6.09% (0.5456 => 0.5124, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.08% (0.5688 => 0.5342, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.08% (0.4916 => 0.4617, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -6.07% (0.5567 => 0.5229, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -6.07% (0.4861 => 0.4566, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.06% (0.5581 => 0.5243, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -6.04% (0.6395 => 0.6009, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: -6.04% (0.2999 => 0.2818, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -6.01% (0.2278 => 0.2141, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -6.01% (1.3148 => 1.2358, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/stepanov_container: -6.01% (0.9557 => 0.8983, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.99% (0.6676 => 0.6276, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.99% (0.3491 => 0.3282, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.95% (0.7021 => 0.6603, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.93% (0.5329 => 0.5013, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.90% (8.0126 => 7.5400, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.90% (0.3849 => 0.3622, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -5.90% (0.6750 => 0.6352, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -5.88% (0.7982 => 0.7513, std.dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.88% (0.3319 => 0.3124, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: -5.84% (0.3271 => 0.3080, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.83% (0.4083 => 0.3845, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: -5.82% (2.1401 => 2.0156, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.75% (0.2106 => 0.1985, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.70% (0.3931 => 0.3707, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/matrix: -5.62% (0.3255 => 0.3072, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.58% (0.4427 => 0.4180, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.58% (0.2385 => 0.2252, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/except: -5.55% (0.3026 => 0.2858, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -5.52% (0.3481 => 0.3289, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -5.51% (0.3446 => 0.3256, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -5.49% (0.2989 => 0.2825, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: -5.47% (0.2871 => 0.2714, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -5.46% (5.0226 => 4.7482, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.46% (0.3057 => 0.2890, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -5.46% (0.3867 => 0.3656, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -5.42% (0.3394 => 0.3210, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: -5.41% (0.3788 => 0.3583, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/moments: -5.39% (0.4248 => 0.4019, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.37% (2.1713 => 2.0546, std.dev.: 0.0318) SingleSource/Benchmarks/Shootout-C++/objinst: -5.35% (0.3194 => 0.3023, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.34% (0.2903 => 0.2748, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -5.34% (0.3205 => 0.3034, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.32% (0.2933 => 0.2777, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -5.31% (0.2939 => 0.2783, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.27% (0.3016 => 0.2857, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -5.27% (0.2849 => 0.2699, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.26% (0.3252 => 0.3081, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -5.26% (0.3025 => 0.2866, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -5.23% (0.3059 => 0.2899, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: -5.08% (0.4524 => 0.4294, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -5.06% (0.8418 => 0.7992, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -4.98% (0.6441 => 0.6120, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -4.97% (0.7779 => 0.7392, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: -4.96% (0.6347 => 0.6032, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.74% (0.9077 => 0.8647, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: -4.55% (1.5610 => 1.4900, std.dev.: 0.0020) SingleSource/UnitTests/Vector/constpool: -3.26% (20.7746 => 20.0970, std.dev.: 0.0186) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7547, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: -8.77% (1.2842 => 1.1716, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.87% (1.7753 => 1.7066, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.83% (2.2633 => 2.1766, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.26% (1.3096 => 1.2800, std.dev.: 0.0088) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4721, std.dev.: 0.0033) Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 24 16:34:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 24 Oct 2012 18:34:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121024233408.6355B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5182?compare_to=5178&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5182, Order: 166625, Start Time: 2012-10-24 22:15:45, End Time: 2012-10-24 23:36:08 To: 5178, Order: 166612, Start Time: 2012-10-24 20:25:29, End Time: 2012-10-24 21:45:58 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 2 (7 on baseline) Performance Regressions: 0 (202 on baseline) Performance Improvements: 2 (46 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 86 (12 on baseline) Unchanged Tests: 952 (639 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.63% (1.5075 => 1.5924, std.dev.: 0.0022) New Passes - Execution Time --------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.08% (15.9270 => 15.5960, std.dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.42% (3.8359 => 3.7813, std.dev.: 0.0186) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.08% (0.6311 => 0.6306, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 0.13% (17.3404 => 17.3638, std.dev.: 0.0236) MultiSource/Applications/kimwitu++/kc: 0.53% (15.7502 => 15.8334, std.dev.: 0.0131) MultiSource/Benchmarks/Bullet/bullet: 0.07% (57.3266 => 57.3681, std.dev.: 0.0236) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.61% (0.0490 => 0.0487, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.61% (0.0492 => 0.0489, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.44% (0.0459 => 0.0457, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.43% (0.0461 => 0.0459) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.45% (0.0448 => 0.0446, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.44% (0.0450 => 0.0448, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.45% (0.0442 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.45% (0.0444 => 0.0442, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.65% (0.0461 => 0.0458, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.22% (0.0461 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.66% (0.0455 => 0.0452, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.44% (0.0456 => 0.0454, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.45% (0.0444 => 0.0442, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.45% (0.0447 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.44% (0.0452 => 0.0450, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.44% (0.0453 => 0.0451, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.43% (0.0463 => 0.0461, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.43% (0.0465 => 0.0463, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.45% (0.0440 => 0.0438, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.45% (0.0441 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.44% (0.0452 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.22% (0.0453 => 0.0452, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.45% (0.0443 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.67% (0.0445 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.23% (0.0435 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.23% (0.0436 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.46% (0.0434 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.46% (0.0436 => 0.0434) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.64% (0.0472 => 0.0469, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.42% (0.0472 => 0.0470, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.23% (0.0433 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.46% (0.0434 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.46% (0.0434 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.46% (0.0435 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.23% (0.0442 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.45% (0.0443 => 0.0441, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.18% (8.3013 => 8.3160, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.14% (0.6923 => 0.6933, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1437 => 0.1437, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0647 => 0.0648, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -9.29% (63.2438 => 57.3681, std.dev.: 0.0236) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/MallocBench/gs/gs: 14.08% (4.1105 => 4.6894, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 44.13% (1.1048 => 1.5924, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 69.67% (3.4629 => 5.8754, std.dev.: 0.0013) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13507.22% (0.0720 => 9.7972, std.dev.: 0.0162) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050000.00% (0.0001 => 10.0501, std.dev.: 0.0005) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 69.53% (0.0256 => 0.0434) MultiSource/Benchmarks/McCat/08-main/main: 65.78% (0.2554 => 0.4234, std.dev.: 0.0006) SingleSource/Regression/C/sumarraymalloc: 51.44% (0.0243 => 0.0368) MultiSource/Benchmarks/PAQ8p/paq8p: 50.43% (10.3673 => 15.5960, std.dev.: 0.0027) SingleSource/UnitTests/SignlessTypes/factor: 47.64% (0.0296 => 0.0437, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 44.65% (0.0271 => 0.0392, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 42.23% (1.5859 => 2.2557, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/richards_benchmark: 41.31% (0.1622 => 0.2292, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 37.59% (0.1056 => 0.1453) SingleSource/UnitTests/vla: 33.80% (0.0355 => 0.0475, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 31.31% (2.2024 => 2.8920, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: 28.64% (0.1463 => 0.1882, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 24.83% (0.1655 => 0.2066, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 23.74% (0.0834 => 0.1032, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/hash: 22.27% (0.0485 => 0.0593, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.03% (0.1566 => 0.1911, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: 21.47% (0.2049 => 0.2489, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 21.31% (7.0540 => 8.5575, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/flops: 21.23% (0.1432 => 0.1736, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 20.63% (2.2022 => 2.6566, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.52% (0.0871 => 0.1041, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 19.36% (0.1555 => 0.1856, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 19.08% (0.5105 => 0.6079, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.67% (0.6675 => 0.7921, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/power/power: 18.13% (0.1440 => 0.1701, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: 17.89% (0.0626 => 0.0738, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.69% (0.1029 => 0.1211, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.65% (0.0793 => 0.0933, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 17.62% (0.1175 => 0.1382, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.36% (1.3050 => 1.5316, std.dev.: 0.0099) MultiSource/Applications/d/make_dparser: 17.36% (3.3354 => 3.9143, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/em3d/em3d: 17.17% (0.1695 => 0.1986, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 17.00% (0.2271 => 0.2657, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.88% (0.4615 => 0.5394, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.84% (0.8172 => 0.9548, std.dev.: 0.0040) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.82% (0.3121 => 0.3646, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/mst/mst: 16.77% (0.1163 => 0.1358, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 16.58% (0.4879 => 0.5688, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.56% (1.5415 => 1.7968, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 16.51% (0.3282 => 0.3824, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.39% (0.5020 => 0.5843, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.38% (0.1032 => 0.1201, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.25% (0.0886 => 0.1030, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 16.23% (0.1337 => 0.1554, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 16.19% (0.7115 => 0.8267, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 16.19% (0.1940 => 0.2254, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 16.15% (0.0842 => 0.0978, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 16.03% (0.1510 => 0.1752, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.00% (0.0675 => 0.0783, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 15.92% (0.0672 => 0.0779, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 15.75% (1.1642 => 1.3476, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/matrix: 15.65% (0.0818 => 0.0946, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 15.63% (0.3109 => 0.3595, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.59% (0.9765 => 1.1287, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 15.57% (1.7609 => 2.0351, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 15.54% (0.3423 => 0.3955, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 15.50% (10.4361 => 12.0542, std.dev.: 0.0087) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.43% (0.0648 => 0.0748, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.39% (0.0838 => 0.0967, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 15.28% (0.0746 => 0.0860, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.22% (0.1117 => 0.1287, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 15.21% (0.1236 => 0.1424, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 15.20% (8.1363 => 9.3728, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.19% (0.2758 => 0.3177, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 15.17% (0.3177 => 0.3659, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 15.16% (0.1438 => 0.1656, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 15.15% (4.2646 => 4.9109, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.14% (0.2107 => 0.2426, std.dev.: 0.0012) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.14% (0.1143 => 0.1316, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/messages-2: 15.11% (0.0662 => 0.0762, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.06% (0.0770 => 0.0886, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/exptree: 14.99% (0.0814 => 0.0936, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.96% (0.1584 => 0.1821, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.93% (0.0730 => 0.0839, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 14.86% (0.1151 => 0.1322, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 14.83% (9.4845 => 10.8909, std.dev.: 0.0101) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 14.80% (0.1906 => 0.2188, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.77% (0.2065 => 0.2370, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.74% (0.2700 => 0.3098, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.70% (0.6450 => 0.7398, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.69% (0.1695 => 0.1944, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.68% (0.0933 => 0.1070, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.66% (0.5860 => 0.6719, std.dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/almabench: 14.66% (0.0730 => 0.0837, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 14.61% (0.7835 => 0.8980, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.55% (0.5981 => 0.6851, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.41% (0.0798 => 0.0913, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.41% (0.1062 => 0.1215, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 14.39% (1.4186 => 1.6227, std.dev.: 0.0036) MultiSource/Applications/treecc/treecc: 14.30% (2.0273 => 2.3173, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 14.29% (0.7433 => 0.8495, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/rem: 14.25% (0.1144 => 0.1307, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 14.22% (5.7591 => 6.5780, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.16% (0.0770 => 0.0879, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.97% (0.1625 => 0.1852, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 13.96% (0.1268 => 0.1445, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 13.87% (4.9449 => 5.6310, std.dev.: 0.0068) MultiSource/Applications/lua/lua: 13.87% (3.8723 => 4.4092, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.80% (0.8067 => 0.9180, std.dev.: 0.0050) MultiSource/Applications/lemon/lemon: 13.78% (1.0722 => 1.2200, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 13.75% (1.1840 => 1.3468, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.71% (5.0018 => 5.6875, std.dev.: 0.0078) MultiSource/Benchmarks/sim/sim: 13.67% (0.3387 => 0.3850, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.61% (0.3307 => 0.3757, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.47% (7.9617 => 9.0345, std.dev.: 0.0086) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.46% (0.0929 => 0.1054, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.45% (0.5569 => 0.6318, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 13.35% (1.1861 => 1.3444, std.dev.: 0.0084) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.23% (0.1330 => 0.1506, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 13.17% (0.4299 => 0.4865, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 13.14% (0.3180 => 0.3598, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.10% (0.2603 => 0.2944, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 13.10% (0.3092 => 0.3497, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.87% (0.3441 => 0.3884, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 12.61% (1.5603 => 1.7570, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 12.54% (0.8921 => 1.0040, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.49% (0.2266 => 0.2549, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 12.44% (0.1125 => 0.1265) SingleSource/Benchmarks/Misc-C++/bigfib: 12.25% (0.6456 => 0.7247, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.22% (0.3543 => 0.3976) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.18% (0.8101 => 0.9088, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.89% (1.1194 => 1.2525, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 11.86% (0.3473 => 0.3885, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/parameter-passing: 11.71% (0.3927 => 0.4387, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 11.61% (2.2969 => 2.5636, std.dev.: 0.0095) SingleSource/UnitTests/ObjC/exceptions-4: 11.57% (0.3543 => 0.3953, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.56% (0.3694 => 0.4121, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.52% (0.3497 => 0.3900, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/synchronized: 11.49% (0.3561 => 0.3970, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.48% (0.3886 => 0.4332, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.43% (0.3516 => 0.3918, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.42% (0.3828 => 0.4265, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 11.30% (0.1044 => 0.1162, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.21% (0.1892 => 0.2104, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 10.99% (21.9371 => 24.3489, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/hash2: 10.84% (0.4620 => 0.5121, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/hash: 10.84% (0.4289 => 0.4754, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.52% (0.4203 => 0.4645, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 10.49% (0.0953 => 0.1053, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.25% (0.3865 => 0.4261, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.22% (0.3826 => 0.4217, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 10.11% (0.3422 => 0.3768, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.07% (0.4103 => 0.4516, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 9.99% (0.3684 => 0.4052, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 9.66% (0.4048 => 0.4439, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.66% (0.3427 => 0.3758, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 9.62% (0.6030 => 0.6610, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.55% (0.5925 => 0.6491, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 9.49% (0.3603 => 0.3945, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.38% (0.4636 => 0.5071, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 9.31% (17.1811 => 18.7806, std.dev.: 0.0079) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.30% (0.2430 => 0.2656, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.90% (0.7326 => 0.7978, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.80% (3.8922 => 4.2349, std.dev.: 0.0174) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.76% (14.3668 => 15.6257, std.dev.: 0.0225) SingleSource/Benchmarks/Shootout-C++/matrix: 8.52% (0.3098 => 0.3362, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.52% (0.3650 => 0.3961, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.25% (0.3162 => 0.3423, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.24% (0.4064 => 0.4399, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.11% (0.2872 => 0.3105, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 8.09% (0.2831 => 0.3060, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 8.04% (0.3283 => 0.3547, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 8.02% (0.2905 => 0.3138, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.98% (0.3232 => 0.3490, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 7.98% (0.2871 => 0.3100, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.89% (0.2891 => 0.3119, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.68% (0.3136 => 0.3377, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.65% (2.0665 => 2.2245, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 7.54% (0.2877 => 0.3094, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.51% (0.2756 => 0.2963, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.48% (0.2793 => 0.3002, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 7.40% (0.3379 => 0.3629, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.34% (0.3052 => 0.3276, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 7.30% (0.2725 => 0.2924, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 7.21% (0.2802 => 0.3004, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.15% (0.2714 => 0.2908, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 7.08% (1.2842 => 1.3751, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 6.29% (0.3131 => 0.3328, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.85% (0.3817 => 0.3964, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.66% (0.3935 => 0.4079) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1725, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.95% (1.1145 => 1.2923, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.39% (0.9957 => 1.1290, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.55% (0.2944 => 0.3284, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.85% (1.1396 => 1.2518, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3692, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.64% (2.8904 => 3.0823, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 3.82% (1.9405 => 2.0147, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.61% (0.3987 => 0.4091, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.54% (4.2280 => 4.3353, std.dev.: 0.0084) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.94% (3.6395 => 3.7102, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/bisort/bisort: 1.84% (0.8333 => 0.8486, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.54% (2.6546 => 2.6956, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 1.54% (3.1595 => 3.2081) MultiSource/Applications/viterbi/viterbi: 1.33% (4.4649 => 4.5241, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.98% (6.6874 => 0.1352, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -76.87% (0.8651 => 0.2001, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.01% (5.2763 => 3.3235, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -29.27% (5.3855 => 3.8093, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -28.87% (5.3526 => 3.8073, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -9.34% (54.1659 => 49.1059, std.dev.: 0.0144) MultiSource/Applications/ClamAV/clamscan: -2.16% (22.1758 => 21.6957, std.dev.: 0.0117) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -52.88% (8.0499 => 3.7931, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.47% (1.1492 => 0.7646, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.64% (2.9695 => 2.4755, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4245, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.67% (1.2258 => 1.0705, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.42% (1.2373 => 1.0960, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/mandel-2: -10.92% (1.5373 => 1.3695, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.46% (19.9488 => 18.2618, std.dev.: 0.1556) MultiSource/Benchmarks/FreeBench/mason/mason: -7.96% (0.2161 => 0.1989, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.03% (1.8329 => 1.7040, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4781, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.17% (1.6805 => 1.5936, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5081, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.24% (8.1563 => 7.8108, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.64% (3.2827 => 3.1633, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8775, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5075, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.56% (0.4808 => 0.4685, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -2.15% (4.6441 => 4.5443, std.dev.: 0.0097) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.95% (10.2830 => 10.0829, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6809, std.dev.: 0.0015) SingleSource/UnitTests/Vector/multiplies: -1.69% (2.5528 => 2.5097, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4212, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2879, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.09% (6.2999 => 6.2312, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8566, std.dev.: 0.0045) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 20.60% (0.5229 => 0.6306, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 15.84% (14.9895 => 17.3638, std.dev.: 0.0236) MultiSource/Applications/kimwitu++/kc: 11.85% (14.1553 => 15.8334, std.dev.: 0.0131) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 16.17% (7.1582 => 8.3160, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.43% (0.6222 => 0.6933, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.23% (0.1485 => 0.1437, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 24 17:25:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 24 Oct 2012 19:25:11 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121025002511.909E32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5183?compare_to=5179&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5183, Order: 166634, Start Time: 2012-10-24 23:01:25, End Time: 2012-10-25 00:27:18 To: 5179, Order: 166621, Start Time: 2012-10-24 21:19:27, End Time: 2012-10-24 22:44:18 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 32 (91 on baseline) Performance Improvements: 2 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 941 (879 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.37% (0.8104 => 0.8377, std.dev.: 0.0017) MultiSource/Applications/spiff/spiff: 3.07% (0.8261 => 0.8515, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.05% (0.9175 => 0.9455, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.76% (0.9042 => 0.9292, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.73% (0.8288 => 0.8514, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.38% (0.8388 => 0.8588, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.37% (0.7975 => 0.8164, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.34% (0.8047 => 0.8235, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.27% (0.8385 => 0.8575, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.26% (0.8146 => 0.8330, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.25% (0.8121 => 0.8304, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.19% (0.9170 => 0.9371, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.11% (0.8856 => 0.9043, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.95% (0.8958 => 0.9133, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.92% (0.9819 => 1.0008, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.92% (0.8366 => 0.8527, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.92% (0.8472 => 0.8635, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/football/football: 1.92% (0.8790 => 0.8959, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.85% (0.9014 => 0.9181, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.80% (0.8590 => 0.8745, std.dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: 1.80% (2.4036 => 2.4468, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.77% (0.8066 => 0.8209, std.dev.: 0.0052) MultiSource/Applications/SPASS/SPASS: 1.71% (14.4331 => 14.6799, std.dev.: 0.0757) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.60% (0.8546 => 0.8683, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.55% (0.8828 => 0.8965, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.32% (8.7679 => 8.8838, std.dev.: 0.0305) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.19% (1.1329 => 1.1464, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.14% (13.4592 => 13.6123, std.dev.: 0.0393) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/ffbench: 3.05% (1.3903 => 1.4327, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.67% (21.9286 => 22.5141, std.dev.: 0.1261) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.64% (4.3590 => 4.4742, std.dev.: 0.0423) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.05% (1.4187 => 1.4336, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.42% (2.0393 => 2.0104, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/tsp/tsp: -1.14% (1.4961 => 1.4791, std.dev.: 0.0056) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -1.33% (16.7811 => 16.5584, std.dev.: 0.1326) MultiSource/Applications/obsequi/Obsequi: 0.13% (1.0694 => 1.0708, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: 0.64% (0.6449 => 0.6490, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/08-main/main: -3.33% (0.2011 => 0.1944, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.49% (0.1660 => 0.1718, std.dev.: 0.0046) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.38% (0.3228 => 0.3337, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.70% (0.2476 => 0.2518, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.44% (0.3379 => 0.3394, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.11% (0.2426 => 0.2399, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: 0.17% (0.5970 => 0.5980, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel: 2.33% (0.0472 => 0.0483, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.37% (0.3277 => 0.3322, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 1.21% (0.1976 => 0.2000, std.dev.: 0.0029) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -4.65% (0.0258 => 0.0246, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.81% (0.0221 => 0.0217, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.23% (0.0427 => 0.0426, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.52% (0.0330 => 0.0335, std.dev.: 0.0046) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0312 => 0.0311, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.47% (0.0425 => 0.0423, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/casts: -0.50% (0.0202 => 0.0201, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/test1: 0.93% (0.0216 => 0.0218, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: 5.99% (0.0317 => 0.0336, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0014 => 0.0014) MultiSource/Applications/ClamAV/clamscan: -2.12% (0.1512 => 0.1480, std.dev.: 0.0147) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -0.85% (1.1834 => 1.1733, std.dev.: 0.0338) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.26% (0.1523 => 0.1519, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.45% (0.4172 => 0.4028, std.dev.: 0.0212) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.07% (0.1399 => 0.1398, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.27% (0.0630 => 0.0622, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.73% (0.0275 => 0.0277, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.21% (0.0542 => 0.0530, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.37% (1.1479 => 1.1437, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.78% (0.0612 => 0.0629, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 12.29% (0.0236 => 0.0265, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.48% (0.7946 => 0.7984, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 39.58% (0.0048 => 0.0067, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.66% (2.1832 => 1.6667, std.dev.: 0.0080) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.04% (0.0810 => 0.0948, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 12.05% (0.1112 => 0.1246, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.67% (0.8321 => 0.9126, std.dev.: 0.0100) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.80% (0.2180 => 0.2350, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 7.11% (0.7950 => 0.8515, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.64% (0.2998 => 0.3197, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.61% (0.6010 => 0.6407, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.77% (0.7473 => 0.7904, std.dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.25% (0.1905 => 0.2005, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.07% (0.8148 => 0.8561, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.85% (0.4847 => 0.5082, std.dev.: 0.0075) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.72% (0.3137 => 0.3285, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.64% (0.2519 => 0.2636, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.50% (0.2378 => 0.2485, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 4.48% (0.8656 => 0.9044, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.48% (1.1685 => 1.2208, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 4.24% (0.8069 => 0.8411, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.20% (0.9074 => 0.9455, std.dev.: 0.0105) MultiSource/Applications/treecc/treecc: 4.18% (1.9948 => 2.0782, std.dev.: 0.0220) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.09% (0.3717 => 0.3869, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.98% (0.8697 => 0.9043, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.89% (1.1606 => 1.2057, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.71% (0.8007 => 0.8304, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.67% (0.6287 => 0.6518, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 3.65% (0.8331 => 0.8635, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.60% (0.8086 => 0.8377, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.57% (0.5961 => 0.6174, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.49% (0.8286 => 0.8575, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.48% (0.9056 => 0.9371, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.42% (0.8597 => 0.8891, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.41% (0.8611 => 0.8905, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.41% (0.8457 => 0.8745, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.39% (1.6386 => 1.6942, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.38% (0.7966 => 0.8235, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 3.30% (0.9688 => 1.0008, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 3.27% (0.8066 => 0.8330, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.27% (13.1811 => 13.6123, std.dev.: 0.0393) MultiSource/Applications/ClamAV/clamscan: 3.23% (14.7684 => 15.2454, std.dev.: 0.0330) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 3.17% (0.8204 => 0.8464, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.15% (0.8317 => 0.8579, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 3.14% (0.8855 => 0.9133, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.12% (0.8420 => 0.8683, std.dev.: 0.0025) MultiSource/Applications/hbd/hbd: 3.08% (1.4269 => 1.4708, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.06% (0.8261 => 0.8514, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.00% (4.4873 => 4.6219, std.dev.: 0.0349) MultiSource/Benchmarks/PAQ8p/paq8p: 2.96% (2.3764 => 2.4468, std.dev.: 0.0097) MultiSource/Applications/SPASS/SPASS: 2.94% (14.2605 => 14.6799, std.dev.: 0.0757) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.92% (0.7932 => 0.8164, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.92% (1.3279 => 1.3667, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.86% (0.8716 => 0.8965, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.85% (0.8927 => 0.9181, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.80% (0.9039 => 0.9292, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.75% (0.9069 => 0.9318, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.74% (0.8359 => 0.8588, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.73% (8.6476 => 8.8838, std.dev.: 0.0305) MultiSource/Applications/d/make_dparser: 2.72% (3.2366 => 3.3247, std.dev.: 0.0243) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.71% (4.1763 => 4.2893, std.dev.: 0.0185) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.67% (0.4127 => 0.4237, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.65% (0.4559 => 0.4680, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.64% (0.8885 => 0.9120, std.dev.: 0.0055) MultiSource/Applications/SIBsim4/SIBsim4: 2.63% (1.2568 => 1.2899, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.63% (1.1170 => 1.1464, std.dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 2.62% (6.7320 => 6.9083, std.dev.: 0.0464) MultiSource/Applications/JM/lencod/lencod: 2.59% (15.3280 => 15.7249, std.dev.: 0.0786) MultiSource/Benchmarks/MallocBench/gs/gs: 2.54% (4.1305 => 4.2354, std.dev.: 0.0283) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.54% (0.8316 => 0.8527, std.dev.: 0.0029) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.43% (6.6074 => 6.7680, std.dev.: 0.0564) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.29% (4.4880 => 4.5909, std.dev.: 0.0225) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.28% (0.8805 => 0.9006, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.27% (1.4479 => 1.4807, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.18% (1.2602 => 1.2877, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/football/football: 2.18% (0.8768 => 0.8959, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.10% (0.8050 => 0.8219, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.00% (0.8048 => 0.8209, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.88% (0.6227 => 0.6344, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.84% (1.2423 => 1.2652, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.52% (0.8995 => 0.9132, std.dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.53% (1.5795 => 2.5040, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.76% (0.3186 => 0.3465, std.dev.: 0.0102) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.39% (1.1857 => 1.2852, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 6.02% (63.1822 => 66.9836, std.dev.: 0.2054) MultiSource/Benchmarks/Bullet/bullet: 3.20% (7.1181 => 7.3458, std.dev.: 0.0594) MultiSource/Applications/siod/siod: 3.11% (3.6643 => 3.7783, std.dev.: 0.0140) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.73% (4.3552 => 4.4742, std.dev.: 0.0423) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.43% (2.4490 => 2.5085, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/ReedSolomon: 2.22% (8.5322 => 8.7214, std.dev.: 0.0676) MultiSource/Benchmarks/Olden/bh/bh: 1.91% (2.3560 => 2.4011, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.64% (41.4238 => 42.1032, std.dev.: 0.1105) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.33% (4.8362 => 4.9004, std.dev.: 0.0158) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 1.18% (3.2169 => 3.2548, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.14% (2.9096 => 2.9429, std.dev.: 0.0108) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.59% (0.3269 => 0.3021, std.dev.: 0.0011) MultiSource/Applications/lua/lua: -5.22% (29.8330 => 28.2771, std.dev.: 0.2467) SingleSource/Benchmarks/Shootout-C++/hash2: -1.57% (3.4237 => 3.3700, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.14% (3.3479 => 3.3098, std.dev.: 0.0063) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.68% (16.4461 => 16.5584, std.dev.: 0.1326) MultiSource/Applications/obsequi/Obsequi: 4.35% (1.0262 => 1.0708, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: 2.50% (0.6332 => 0.6490, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/08-main/main: 6.17% (0.1831 => 0.1944, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.20% (0.1559 => 0.1718, std.dev.: 0.0046) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.85% (0.3123 => 0.3337, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.23% (0.2463 => 0.2518, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.50% (0.3344 => 0.3394, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.48% (0.2364 => 0.2399, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: -0.50% (0.6010 => 0.5980, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel: 12.59% (0.0429 => 0.0483, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.71% (0.3266 => 0.3322, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 1.57% (0.1969 => 0.2000, std.dev.: 0.0029) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 9.82% (0.0224 => 0.0246, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 76.42% (0.0123 => 0.0217, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.89% (0.0254 => 0.0335, std.dev.: 0.0046) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.98% (0.0302 => 0.0311, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/casts: 5.79% (0.0190 => 0.0201, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: 46.09% (0.0230 => 0.0336, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 100.00% (0.0007 => 0.0014) MultiSource/Applications/ClamAV/clamscan: 2.92% (0.1438 => 0.1480, std.dev.: 0.0147) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 3.57% (1.1329 => 1.1733, std.dev.: 0.0338) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.90% (0.1462 => 0.1519, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.27% (0.4164 => 0.4028, std.dev.: 0.0212) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.12% (0.1369 => 0.1398, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.96% (0.0641 => 0.0622, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.30% (0.0578 => 0.0530, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: - (1.1437 => 1.1437, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.32% (0.0627 => 0.0629, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.22% (0.0180 => 0.0265, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.41% (0.8017 => 0.7984, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 8.06% (0.0062 => 0.0067, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 24 18:07:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 24 Oct 2012 20:07:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121025010738.2869F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5184?compare_to=5181&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5184, Order: 166638, Start Time: 2012-10-24 23:44:54, End Time: 2012-10-25 01:09:42 To: 5181, Order: 166624, Start Time: 2012-10-24 21:57:00, End Time: 2012-10-24 23:21:56 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 0 (186 on baseline) Unchanged Tests: 1041 (852 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.01% (78.9440 => 80.5289, std.dev.: 0.3181) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.83% (2.0478 => 2.1057, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: 2.68% (7.4937 => 7.6948, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: 1.82% (3.1932 => 3.2514, std.dev.: 0.0085) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.43% (0.1431 => 0.1296, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.37% (0.3821 => 0.3501, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -7.68% (2.4924 => 2.3010, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: -7.47% (0.3831 => 0.3545, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: -7.39% (0.3357 => 0.3109, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.31% (0.3884 => 0.3600, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -7.29% (0.3880 => 0.3597, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.27% (0.3891 => 0.3608, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -7.27% (0.2160 => 0.2003, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.23% (22.4056 => 20.7861, std.dev.: 0.0098) SingleSource/UnitTests/ObjC/trivial-interface: -7.21% (0.3812 => 0.3537, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -7.19% (0.3896 => 0.3616, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-3: -7.17% (0.3848 => 0.3572, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -7.17% (0.4033 => 0.3744, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.16% (0.3142 => 0.2917, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.11% (0.9542 => 0.8864, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -7.10% (0.4199 => 0.3901, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -7.09% (0.4176 => 0.3880, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -7.09% (16.1920 => 15.0447, std.dev.: 0.0112) SingleSource/UnitTests/ObjC/parameter-passing: -7.06% (0.4280 => 0.3978, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -7.03% (3.5339 => 3.2854, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: -7.02% (0.1796 => 0.1670, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.96% (0.9852 => 0.9166, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.96% (0.2428 => 0.2259, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -6.94% (4.3330 => 4.0322, std.dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: -6.93% (7.0961 => 6.6046, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/ReedSolomon: -6.92% (0.1879 => 0.1749, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.92% (0.3658 => 0.3405, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: -6.89% (0.9179 => 0.8547, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -6.87% (9.2283 => 8.5946, std.dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: -6.86% (1.1530 => 1.0739, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.82% (0.1584 => 0.1476, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: -6.82% (1.2515 => 1.1662, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: -6.81% (0.1761 => 0.1641, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.79% (0.2355 => 0.2195, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.75% (0.6736 => 0.6281, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.75% (0.2695 => 0.2513, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.73% (6.7716 => 6.3162, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.70% (0.4151 => 0.3873, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: -6.69% (0.2659 => 0.2481, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -6.69% (2.4021 => 2.2414, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.69% (4.0323 => 3.7626, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: -6.68% (1.1450 => 1.0685, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.67% (0.2548 => 0.2378, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.67% (1.6474 => 1.5375, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/bh/bh: -6.67% (0.2985 => 0.2786, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.67% (1.4642 => 1.3666, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.66% (1.3722 => 1.2808, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.65% (1.0544 => 0.9843, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.64% (0.1716 => 0.1602, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.60% (0.6484 => 0.6056, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.58% (1.2300 => 1.1491, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.57% (4.8161 => 4.4996, std.dev.: 0.0108) MultiSource/Applications/lua/lua: -6.56% (4.0594 => 3.7932, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.55% (0.7919 => 0.7400, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.55% (5.4682 => 5.1103, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: -6.54% (0.5168 => 0.4830, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.54% (4.5069 => 4.2123, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.54% (0.6304 => 0.5892, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: -6.47% (0.7447 => 0.6965, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -6.47% (34.0927 => 31.8879, std.dev.: 0.0103) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.44% (0.4813 => 0.4503, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: -6.42% (0.3581 => 0.3351, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.41% (4.8802 => 4.5676, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.40% (1.2784 => 1.1966, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.40% (1.6364 => 1.5317, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -6.40% (0.4861 => 0.4550, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -6.38% (15.5079 => 14.5179, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.38% (0.6052 => 0.5666, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.37% (0.6293 => 0.5892, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -6.37% (0.3406 => 0.3189, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -6.37% (1.3148 => 1.2311, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.37% (0.3849 => 0.3604, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.36% (0.5925 => 0.5548, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -6.33% (0.4515 => 0.4229, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.33% (0.5478 => 0.5131, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.32% (2.2587 => 2.1159, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.32% (0.6395 => 0.5991, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -6.31% (0.5705 => 0.5345, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.31% (0.3931 => 0.3683, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -6.31% (0.6660 => 0.6240, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.30% (0.5805 => 0.5439, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: -6.29% (0.1621 => 0.1519, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.29% (0.6297 => 0.5901, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.29% (0.3483 => 0.3264, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.25% (0.7339 => 0.6880, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.25% (0.5859 => 0.5493, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: -6.25% (1.3864 => 1.2998, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.25% (14.2083 => 13.3208, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/except: -6.25% (0.3026 => 0.2837, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.24% (0.4916 => 0.4609, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -6.24% (0.5849 => 0.5484, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -6.23% (0.6230 => 0.5842, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -6.22% (0.2989 => 0.2803, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -6.21% (0.5569 => 0.5223, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/fibo: -6.20% (0.2871 => 0.2693, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.20% (0.6681 => 0.6267, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.20% (0.4083 => 0.3830, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -6.19% (0.7524 => 0.7058, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -6.19% (18.2933 => 17.1609, std.dev.: 0.0204) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -6.19% (0.5575 => 0.5230, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -6.19% (0.3491 => 0.3275, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.18% (0.3837 => 0.3600, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -6.18% (0.5456 => 0.5119, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.17% (0.5802 => 0.5444, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: -6.17% (3.5154 => 3.2986, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: -6.16% (0.9557 => 0.8968, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.15% (0.5999 => 0.5630, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.13% (0.5591 => 0.5248, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -6.13% (0.4321 => 0.4056, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.13% (0.6446 => 0.6051, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.13% (0.8521 => 0.7999, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.12% (0.5863 => 0.5504, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -6.12% (0.5570 => 0.5229, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -6.12% (0.6667 => 0.6259, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/matrix: -6.11% (0.3255 => 0.3056, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.11% (0.5581 => 0.5240, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -6.11% (0.3323 => 0.3120, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.10% (1.2221 => 1.1475, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -6.10% (15.2527 => 14.3217, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/ary3: -6.09% (0.3446 => 0.3236, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.08% (0.5688 => 0.5342, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.07% (0.6260 => 0.5880, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -6.07% (0.3394 => 0.3188, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -6.06% (0.3481 => 0.3270, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.06% (0.6189 => 0.5814, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.06% (0.6440 => 0.6050, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -6.05% (0.5567 => 0.5230, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.05% (0.3057 => 0.2872, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.04% (0.7198 => 0.6763, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.03% (0.2903 => 0.2728, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.03% (0.5857 => 0.5504, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.02% (0.6194 => 0.5821, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -6.02% (0.6676 => 0.6274, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -6.02% (0.3788 => 0.3560, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.00% (0.3252 => 0.3057, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/random: -5.99% (0.2939 => 0.2763, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -5.98% (0.4248 => 0.3994, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.97% (1.2210 => 1.1481, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.97% (0.6033 => 0.5673, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.97% (0.2933 => 0.2758, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.96% (0.4427 => 0.4163, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.96% (8.0126 => 7.5352, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: -5.95% (0.3025 => 0.2845, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: -5.94% (17.1032 => 16.0876, std.dev.: 0.0111) MultiSource/Benchmarks/McCat/09-vor/vor: -5.93% (0.3271 => 0.3077, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -5.93% (0.3205 => 0.3015, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.93% (0.6395 => 0.6016, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.93% (0.2278 => 0.2143, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.92% (0.5941 => 0.5589, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.91% (2.1713 => 2.0429, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.90% (0.2999 => 0.2822, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: -5.90% (0.4524 => 0.4257, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.90% (0.3016 => 0.2838, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -5.90% (0.6750 => 0.6352, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: -5.86% (0.2849 => 0.2682, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.84% (0.2106 => 0.1983, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -5.84% (0.7982 => 0.7516, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: -5.82% (0.3194 => 0.3008, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -5.82% (0.3059 => 0.2881, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.82% (0.3319 => 0.3126, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/lists: -5.80% (0.3621 => 0.3411, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: -5.79% (2.1401 => 2.0161, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.79% (0.2385 => 0.2247, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.77% (0.7021 => 0.6616, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.72% (0.5329 => 0.5024, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -5.69% (0.3867 => 0.3647, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -5.45% (5.0226 => 4.7488, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -5.36% (0.8418 => 0.7967, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: -5.13% (0.7779 => 0.7380, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -5.07% (0.6347 => 0.6025, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.05% (0.2001 => 0.1900, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: -5.00% (0.6441 => 0.6119, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.76% (0.9077 => 0.8645, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.52% (0.2277 => 0.2174, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -4.47% (1.5610 => 1.4912, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -2.86% (20.7746 => 20.1812, std.dev.: 0.0658) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.51% (7.5137 => 5.7475, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/richards_benchmark: -8.74% (1.2842 => 1.1719, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: -4.04% (2.2633 => 2.1718, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.91% (1.7753 => 1.7058, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.42% (1.3096 => 1.2779, std.dev.: 0.0104) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4718, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 24 18:24:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 24 Oct 2012 20:24:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121025012410.56A6B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5185?compare_to=5182&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5185, Order: 166638, Start Time: 2012-10-25 00:05:55, End Time: 2012-10-25 01:26:14 To: 5182, Order: 166625, Start Time: 2012-10-24 22:15:45, End Time: 2012-10-24 23:36:08 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (74 on baseline) New Passes: 0 (7 on baseline) Performance Regressions: 0 (199 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 86 (12 on baseline) Unchanged Tests: 956 (643 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.6306 => 0.6306, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: -0.16% (17.3638 => 17.3353, std.dev.: 0.0093) MultiSource/Applications/kimwitu++/kc: -0.75% (15.8334 => 15.7149, std.dev.: 0.0190) MultiSource/Benchmarks/Bullet/bullet: -0.40% (57.3681 => 57.1390, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.41% (0.0487 => 0.0489, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.41% (0.0489 => 0.0491) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.22% (0.0457 => 0.0458, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.22% (0.0459 => 0.0460, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.45% (0.0446 => 0.0448) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.45% (0.0448 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.68% (0.0440 => 0.0443, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.23% (0.0442 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.44% (0.0458 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.22% (0.0460 => 0.0461, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.44% (0.0452 => 0.0454, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.22% (0.0454 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.45% (0.0442 => 0.0444, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.22% (0.0445 => 0.0446, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.22% (0.0450 => 0.0451, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.44% (0.0451 => 0.0453, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.22% (0.0461 => 0.0462, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.22% (0.0463 => 0.0464, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.23% (0.0438 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.46% (0.0439 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.44% (0.0450 => 0.0452) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.22% (0.0452 => 0.0453) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.23% (0.0441 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.45% (0.0442 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.23% (0.0434 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.23% (0.0435 => 0.0436) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.46% (0.0432 => 0.0434) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.23% (0.0434 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.43% (0.0469 => 0.0471, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.43% (0.0470 => 0.0472, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.46% (0.0432 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.46% (0.0432 => 0.0434) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.23% (0.0432 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.46% (0.0433 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.23% (0.0441 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.23% (0.0441 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.25% (8.3160 => 8.2953, std.dev.: 0.0124) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.19% (0.6933 => 0.6920, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1437 => 0.1437, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.62% (0.0648 => 0.0652, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -9.65% (63.2438 => 57.1390, std.dev.: 0.0090) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/MallocBench/gs/gs: 13.78% (4.1105 => 4.6769, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 43.93% (1.1048 => 1.5901, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.87% (3.4629 => 5.8478, std.dev.: 0.0019) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13520.14% (0.0720 => 9.8065, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049700.00% (0.0001 => 10.0498, std.dev.: 0.0016) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 69.14% (0.0256 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 65.86% (0.2554 => 0.4236, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 51.03% (0.0243 => 0.0367) MultiSource/Benchmarks/PAQ8p/paq8p: 49.91% (10.3673 => 15.5417, std.dev.: 0.0080) SingleSource/UnitTests/SignlessTypes/factor: 47.30% (0.0296 => 0.0436, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 44.28% (0.0271 => 0.0391, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.58% (1.5859 => 2.2453, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 39.77% (0.1622 => 0.2267, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 37.41% (0.1056 => 0.1451, std.dev.: 0.0002) SingleSource/UnitTests/vla: 33.24% (0.0355 => 0.0473) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.56% (2.2024 => 2.8754, std.dev.: 0.0161) MultiSource/Benchmarks/FreeBench/neural/neural: 28.37% (0.1463 => 0.1878, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 24.65% (0.1655 => 0.2063, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 23.50% (0.0834 => 0.1030, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: 21.65% (0.0485 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.46% (0.1566 => 0.1902, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 21.21% (7.0540 => 8.5504, std.dev.: 0.0115) SingleSource/Benchmarks/Misc/ReedSolomon: 20.99% (0.2049 => 0.2479, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 20.88% (0.1432 => 0.1731, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 20.39% (2.2022 => 2.6512, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 19.68% (0.1555 => 0.1861, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.06% (0.0871 => 0.1037, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 18.77% (0.5105 => 0.6063, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.22% (0.6675 => 0.7891, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/power/power: 17.57% (0.1440 => 0.1693, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: 17.41% (0.0626 => 0.0735, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.40% (0.1029 => 0.1208, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 17.36% (0.1175 => 0.1379, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 17.34% (3.3354 => 3.9138, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.16% (1.3050 => 1.5290, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 16.77% (0.1163 => 0.1358, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.73% (0.2271 => 0.2651, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 16.64% (0.1695 => 0.1977, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.58% (0.4615 => 0.5380, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.56% (0.8172 => 0.9525, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.52% (0.0793 => 0.0924, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 16.42% (0.3282 => 0.3821, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.28% (0.3121 => 0.3629, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.15% (1.5415 => 1.7904, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.09% (0.1032 => 0.1198, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.06% (0.5020 => 0.5826, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.03% (0.0886 => 0.1028, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 16.01% (0.1337 => 0.1551, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 15.80% (0.7115 => 0.8239, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 15.78% (0.4879 => 0.5649, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.70% (0.1510 => 0.1747, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.57% (0.1940 => 0.2242, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 15.52% (10.4361 => 12.0560, std.dev.: 0.0111) MultiSource/Applications/sgefa/sgefa: 15.50% (0.3109 => 0.3591, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.44% (0.0842 => 0.0972, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/matrix: 15.40% (0.0818 => 0.0944, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 15.34% (1.7609 => 2.0311, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 15.33% (0.0672 => 0.0775) MultiSource/Applications/Burg/burg: 15.30% (1.1642 => 1.3423, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.26% (0.0675 => 0.0778, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.25% (0.9765 => 1.1254, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.13% (0.1117 => 0.1286, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 15.08% (8.1363 => 9.3632, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/18-imp/imp: 15.07% (0.3423 => 0.3939, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.04% (0.0838 => 0.0964, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.93% (4.2646 => 4.9012, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.90% (0.2107 => 0.2421, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.88% (0.0746 => 0.0857, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 14.83% (0.3177 => 0.3648, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 14.74% (0.1438 => 0.1650, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 14.66% (9.4845 => 10.8753, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/exptree: 14.62% (0.0814 => 0.0933, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.58% (0.2758 => 0.3160, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.55% (0.0770 => 0.0882, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 14.53% (0.1906 => 0.2183, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 14.52% (0.0730 => 0.0836, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.52% (0.1584 => 0.1814, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.43% (0.6450 => 0.7381, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.40% (0.1236 => 0.1414, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.39% (0.5860 => 0.6703, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.36% (0.0933 => 0.1067, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 14.34% (0.1151 => 0.1316, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.33% (0.2065 => 0.2361, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 14.28% (0.7835 => 0.8954, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.22% (0.1062 => 0.1213, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.18% (0.5981 => 0.6829, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.16% (0.0798 => 0.0911, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.11% (0.2700 => 0.3081, std.dev.: 0.0006) SingleSource/UnitTests/SignlessTypes/rem: 14.07% (0.1144 => 0.1305, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 14.07% (1.4186 => 1.6182, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 14.00% (2.0273 => 2.3111, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.98% (0.1695 => 0.1932, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 13.98% (5.7591 => 6.5643, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 13.92% (0.7433 => 0.8468, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 13.81% (4.9449 => 5.6279, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.77% (0.0770 => 0.0876, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 13.64% (1.0722 => 1.2184, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.63% (5.0018 => 5.6835, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: 13.56% (0.1268 => 0.1440, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 13.54% (1.1840 => 1.3443, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 13.49% (0.3387 => 0.3844, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 13.48% (3.8723 => 4.3941, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.38% (0.8067 => 0.9146, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.35% (0.0929 => 0.1053, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.34% (0.3307 => 0.3748, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.32% (7.9617 => 9.0222, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.22% (0.5569 => 0.6305, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.17% (0.1625 => 0.1839, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 13.03% (0.4299 => 0.4859, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.99% (1.1861 => 1.3402, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.93% (0.1330 => 0.1502, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 12.77% (0.3180 => 0.3586, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.72% (0.2603 => 0.2934, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 12.71% (0.3092 => 0.3485, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 12.45% (0.8921 => 1.0032, std.dev.: 0.0072) MultiSource/Applications/hbd/hbd: 12.45% (1.5603 => 1.7546, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.41% (0.3441 => 0.3868, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 12.36% (0.1125 => 0.1264, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.22% (0.2266 => 0.2543, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 11.97% (0.6456 => 0.7229, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.83% (0.8101 => 0.9059, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.70% (1.1194 => 1.2504, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.64% (0.1143 => 0.1276, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.49% (0.3543 => 0.3950, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 11.43% (0.3473 => 0.3870, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.36% (0.3927 => 0.4373, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.35% (0.3543 => 0.3945, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.29% (0.3516 => 0.3913, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.29% (0.3561 => 0.3963, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.26% (0.3828 => 0.4259, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.24% (0.3497 => 0.3890, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.14% (0.3886 => 0.4319, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.10% (0.3694 => 0.4104, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 11.06% (2.2969 => 2.5509, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash: 10.91% (0.4289 => 0.4757, std.dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 10.89% (21.9371 => 24.3264, std.dev.: 0.0120) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.84% (0.1892 => 0.2097, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 10.78% (0.4620 => 0.5118, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.54% (0.1044 => 0.1154, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.43% (0.3826 => 0.4225, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.40% (0.4203 => 0.4640, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.38% (0.3865 => 0.4266, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 10.29% (0.3422 => 0.3774, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/lists1: 9.83% (0.3684 => 0.4046, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.77% (0.4103 => 0.4504, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.68% (0.6030 => 0.6614, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 9.68% (0.4048 => 0.4440, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 9.44% (0.3603 => 0.3943, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.43% (0.5925 => 0.6484, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.34% (0.4636 => 0.5069, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.31% (0.3427 => 0.3746, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 9.28% (17.1811 => 18.7753, std.dev.: 0.0155) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.09% (0.2430 => 0.2651, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.90% (0.3650 => 0.3975, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 8.75% (0.3098 => 0.3369, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 8.72% (0.2831 => 0.3078, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.71% (0.7326 => 0.7964, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.69% (14.3668 => 15.6157, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/ary: 8.60% (0.3232 => 0.3510, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 8.47% (0.3283 => 0.3561, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.36% (3.8922 => 4.2177, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.29% (0.4064 => 0.4401, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 8.25% (0.2871 => 0.3108, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.22% (0.2872 => 0.3108, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.19% (0.3162 => 0.3421, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.09% (0.2891 => 0.3125, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 8.09% (0.2905 => 0.3140, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.00% (0.3136 => 0.3387, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.87% (0.2756 => 0.2973, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.82% (2.0665 => 2.2280, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.70% (0.2793 => 0.3008, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.67% (0.2725 => 0.2934, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.65% (0.2877 => 0.3097, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.60% (0.3052 => 0.3284, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 7.58% (0.3379 => 0.3635, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 7.53% (0.2802 => 0.3013, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.44% (0.2714 => 0.2916, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 7.05% (1.2842 => 1.3747, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/objinst: 6.42% (0.3131 => 0.3332, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.91% (0.3935 => 0.4089, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.64% (0.3817 => 0.3956, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1727) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.43% (0.9957 => 1.1294, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.78% (1.1396 => 1.2511, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3683, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.64% (2.8904 => 3.0824, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 3.78% (1.9405 => 2.0138, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.75% (4.2280 => 4.3443, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.61% (0.3987 => 0.4091, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.00% (3.6395 => 3.7122, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/bisort/bisort: 1.96% (0.8333 => 0.8496, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.60% (2.6546 => 2.6971, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 1.54% (3.1595 => 3.2080, std.dev.: 0.0053) MultiSource/Applications/minisat/minisat: 1.25% (9.1159 => 9.2295, std.dev.: 0.0083) MultiSource/Applications/viterbi/viterbi: 1.12% (4.4649 => 4.5148, std.dev.: 0.0061) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.99% (6.6874 => 0.1345, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -76.89% (0.8651 => 0.1999, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.11% (5.2763 => 3.3181, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -29.61% (5.3855 => 3.7909, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -29.18% (5.3526 => 3.7907, std.dev.: 0.0025) SingleSource/UnitTests/Vector/constpool: -9.29% (54.1659 => 49.1315, std.dev.: 0.0189) MultiSource/Applications/ClamAV/clamscan: -2.26% (22.1758 => 21.6757, std.dev.: 0.0247) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -52.88% (8.0499 => 3.7929, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7645, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.64% (2.9695 => 2.4753, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4236, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.69% (1.2258 => 1.0702, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.33% (1.2373 => 1.0971, std.dev.: 0.0177) SingleSource/Benchmarks/Misc/mandel-2: -11.19% (1.5373 => 1.3653, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.31% (19.9488 => 18.2908, std.dev.: 0.1098) MultiSource/Benchmarks/FreeBench/mason/mason: -7.73% (0.2161 => 0.1994, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.02% (1.8329 => 1.7043, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4781, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.19% (1.6805 => 1.5933, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5066, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.25% (8.1563 => 7.8094, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1625, std.dev.: 0.0028) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8775, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4984, std.dev.: 0.0080) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.72% (0.4808 => 0.4677, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: -2.19% (4.6441 => 4.5425, std.dev.: 0.0012) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.85% (10.2830 => 10.0928, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6818, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.63% (2.5528 => 2.5112, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -1.51% (9.5636 => 9.4196, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout/lists: -1.16% (6.2999 => 6.2267, std.dev.: 0.0079) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2878, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 20.60% (0.5229 => 0.6306, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 15.65% (14.9895 => 17.3353, std.dev.: 0.0093) MultiSource/Applications/kimwitu++/kc: 11.02% (14.1553 => 15.7149, std.dev.: 0.0190) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 15.89% (7.1582 => 8.2953, std.dev.: 0.0124) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.22% (0.6222 => 0.6920, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.23% (0.1485 => 0.1437, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 24 19:05:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 24 Oct 2012 21:05:51 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121025020551.E12E12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5186?compare_to=5183&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5186, Order: 166651, Start Time: 2012-10-25 00:44:21, End Time: 2012-10-25 02:07:58 To: 5183, Order: 166634, Start Time: 2012-10-24 23:01:25, End Time: 2012-10-25 00:27:18 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 2 (28 on baseline) Performance Improvements: 22 (5 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 951 (941 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.45% (0.7572 => 0.7909, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.25% (3.5657 => 3.6101, std.dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -3.44% (0.8515 => 0.8222, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -3.17% (0.9044 => 0.8757, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -3.15% (0.8411 => 0.8146, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.57% (0.9052 => 0.8819, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -2.41% (0.8464 => 0.8260, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.35% (0.9371 => 0.9151, std.dev.: 0.0040) MultiSource/Applications/siod/siod: -2.34% (2.2815 => 2.2281, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.22% (0.8235 => 0.8052, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.19% (0.9133 => 0.8933, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -2.15% (0.8377 => 0.8197, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -2.09% (0.8575 => 0.8396, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -2.02% (1.0008 => 0.9806, std.dev.: 0.0072) MultiSource/Benchmarks/PAQ8p/paq8p: -1.88% (2.4468 => 2.4009, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.76% (0.8905 => 0.8748, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.51% (3.2433 => 3.1942, std.dev.: 0.0073) MultiSource/Applications/d/make_dparser: -1.51% (3.3247 => 3.2746, std.dev.: 0.0059) MultiSource/Benchmarks/Bullet/bullet: -1.46% (32.5682 => 32.0942, std.dev.: 0.1428) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.36% (2.1775 => 2.1478, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Prolangs-C++/life/life: -3.00% (2.6527 => 2.5730, std.dev.: 0.0276) MultiSource/Benchmarks/Bullet/bullet: -2.79% (7.3458 => 7.1405, std.dev.: 0.0480) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -1.98% (42.1032 => 41.2677, std.dev.: 0.2507) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.78% (60.2614 => 59.1870, std.dev.: 0.3796) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.84% (16.5584 => 16.4194, std.dev.: 0.2613) MultiSource/Applications/obsequi/Obsequi: -0.86% (1.0708 => 1.0616, std.dev.: 0.0059) MultiSource/Applications/sqlite3/sqlite3: -0.15% (0.6490 => 0.6480, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/08-main/main: -2.01% (0.1944 => 0.1905, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.96% (0.1718 => 0.1650, std.dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.87% (0.3337 => 0.3208, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.10% (0.2518 => 0.2465, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.09% (0.3394 => 0.3323, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.33% (0.2399 => 0.2407, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: -0.65% (0.5980 => 0.5941, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: -7.25% (0.0483 => 0.0448, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.09% (0.3322 => 0.3319, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -1.25% (0.2000 => 0.1975, std.dev.: 0.0018) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.81% (0.0246 => 0.0248, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -16.59% (0.0217 => 0.0181, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.23% (0.0426 => 0.0425, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.43% (0.0335 => 0.0290, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.64% (0.0311 => 0.0313, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.47% (0.0423 => 0.0421, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0201 => 0.0201, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -0.46% (0.0218 => 0.0217, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -2.08% (0.0336 => 0.0329, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -7.14% (0.0014 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.68% (0.1480 => 0.1490, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -5.53% (1.1733 => 1.1084, std.dev.: 0.0450) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -0.92% (0.1519 => 0.1505, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.12% (0.4028 => 0.4073, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.72% (0.1398 => 0.1422, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.40% (0.0622 => 0.0576, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -21.66% (0.0277 => 0.0217, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.28% (0.0530 => 0.0558, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.37% (1.1437 => 1.1395, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 3.85% (0.0026 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.93% (0.0629 => 0.0598, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.08% (0.0265 => 0.0180, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.35% (0.7984 => 0.8012, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: -71.43% (0.0007 => 0.0002, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -43.28% (0.0067 => 0.0038, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.87% (2.1832 => 1.6621, std.dev.: 0.0270) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.56% (0.0810 => 0.0936, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/tsp/tsp: 12.59% (0.1112 => 0.1252, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.92% (0.2180 => 0.2309, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.76% (0.6010 => 0.6356, std.dev.: 0.0072) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.97% (0.3137 => 0.3293, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.57% (0.2519 => 0.2634, std.dev.: 0.0034) MultiSource/Applications/Burg/burg: 3.44% (1.2222 => 1.2643, std.dev.: 0.0161) MultiSource/Applications/spiff/spiff: 3.42% (0.7950 => 0.8222, std.dev.: 0.0061) MultiSource/Applications/hbd/hbd: 2.67% (1.4269 => 1.4650, std.dev.: 0.0105) MultiSource/Applications/minisat/minisat: 1.95% (0.6834 => 0.6967, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.78% (0.8805 => 0.8962, std.dev.: 0.0060) MultiSource/Applications/lua/lua: 1.74% (3.8189 => 3.8853, std.dev.: 0.0195) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.66% (1.2423 => 1.2629, std.dev.: 0.0038) MultiSource/Applications/lemon/lemon: 1.64% (1.0945 => 1.1125, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.59% (0.8611 => 0.8748, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.49% (0.8050 => 0.8170, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.42% (1.4479 => 1.4684, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.33% (0.8286 => 0.8396, std.dev.: 0.0020) MultiSource/Applications/d/make_dparser: 1.17% (3.2366 => 3.2746, std.dev.: 0.0059) MultiSource/Benchmarks/PAQ8p/paq8p: 1.03% (2.3764 => 2.4009, std.dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 59.05% (1.5795 => 2.5122, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.30% (0.3186 => 0.3514, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.44% (1.1857 => 1.2858, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 5.94% (63.1822 => 66.9375, std.dev.: 0.0944) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.11% (0.7597 => 0.7909, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 2.43% (3.6643 => 3.7532, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/ReedSolomon: 2.16% (8.5322 => 8.7168, std.dev.: 0.0445) MultiSource/Benchmarks/Olden/bh/bh: 1.62% (2.3560 => 2.3942, std.dev.: 0.0082) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.80% (0.3269 => 0.3014, std.dev.: 0.0025) MultiSource/Applications/lua/lua: -5.04% (29.8330 => 28.3292, std.dev.: 0.1375) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.04% (1.0388 => 1.0176, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/hash2: -1.47% (3.4237 => 3.3735, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.25% (3.3479 => 3.3061, std.dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.16% (16.4461 => 16.4194, std.dev.: 0.2613) MultiSource/Applications/obsequi/Obsequi: 3.45% (1.0262 => 1.0616, std.dev.: 0.0059) MultiSource/Applications/sqlite3/sqlite3: 2.34% (0.6332 => 0.6480, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/08-main/main: 4.04% (0.1831 => 0.1905, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.84% (0.1559 => 0.1650, std.dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.72% (0.3123 => 0.3208, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.08% (0.2463 => 0.2465, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.63% (0.3344 => 0.3323, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.82% (0.2364 => 0.2407, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: -1.15% (0.6010 => 0.5941, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: 4.43% (0.0429 => 0.0448, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.62% (0.3266 => 0.3319, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 0.30% (0.1969 => 0.1975, std.dev.: 0.0018) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 10.71% (0.0224 => 0.0248, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 47.15% (0.0123 => 0.0181, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.17% (0.0408 => 0.0425, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 14.17% (0.0254 => 0.0290, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.64% (0.0384 => 0.0421, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 5.79% (0.0190 => 0.0201, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: 43.04% (0.0230 => 0.0329, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 3.62% (0.1438 => 0.1490, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -2.16% (1.1329 => 1.1084, std.dev.: 0.0450) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 2.94% (0.1462 => 0.1505, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.19% (0.4164 => 0.4073, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.87% (0.1369 => 0.1422, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.14% (0.0641 => 0.0576, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 11.28% (0.0195 => 0.0217, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.46% (0.0578 => 0.0558, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.37% (1.1437 => 1.1395, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.63% (0.0627 => 0.0598, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0180 => 0.0180, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.06% (0.8017 => 0.8012, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 100.00% (0.0001 => 0.0002, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -38.71% (0.0062 => 0.0038, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 24 20:49:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 24 Oct 2012 22:49:20 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121025034920.10FD82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5187?compare_to=5186&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5187, Order: 166659, Start Time: 2012-10-25 02:25:04, End Time: 2012-10-25 03:48:46 To: 5186, Order: 166651, Start Time: 2012-10-25 00:44:21, End Time: 2012-10-25 02:07:58 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 16 (63 on baseline) Performance Improvements: 3 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 956 (907 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 16.71% (0.0730 => 0.0852, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.34% (0.6199 => 0.6592, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.09% (0.3280 => 0.3414, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.25% (0.7637 => 0.7885, std.dev.: 0.0056) MultiSource/Benchmarks/MallocBench/gs/gs: 2.87% (4.1104 => 4.2282, std.dev.: 0.0217) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.59% (1.3174 => 1.3515, std.dev.: 0.0107) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.45% (4.4630 => 4.5725, std.dev.: 0.0198) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.36% (1.1864 => 1.2144, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.12% (1.2527 => 1.2792, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.02% (1.4684 => 1.4981, std.dev.: 0.0101) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.62% (4.5725 => 4.6467, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 1.35% (0.7582 => 0.7684, std.dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: 1.25% (32.0942 => 32.4964, std.dev.: 0.0405) MultiSource/Benchmarks/PAQ8p/paq8p: 1.22% (2.4009 => 2.4303, std.dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 1.36% (0.8683 => 0.8801, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/ReedSolomon: 1.28% (8.7168 => 8.8282, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/oourafft: -4.72% (0.2117 => 0.2017, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -13.00% (15.6318 => 13.6000, std.dev.: 0.5049) MultiSource/Applications/SPASS/SPASS: -1.96% (8.3918 => 8.2273, std.dev.: 0.0138) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 1.48% (16.4194 => 16.6629, std.dev.: 0.0453) MultiSource/Applications/obsequi/Obsequi: -1.60% (1.0616 => 1.0446, std.dev.: 0.0195) MultiSource/Applications/sqlite3/sqlite3: -0.66% (0.6480 => 0.6437, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/08-main/main: -4.25% (0.1905 => 0.1824, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.76% (0.1650 => 0.1522, std.dev.: 0.0090) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.09% (0.3208 => 0.3205, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.57% (0.2465 => 0.2377, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.57% (0.3323 => 0.3304, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.04% (0.2407 => 0.2358, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/bigfib: 1.31% (0.5941 => 0.6019, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: 1.56% (0.0448 => 0.0455, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.39% (0.3319 => 0.3332, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/strcat: 1.16% (0.1975 => 0.1998, std.dev.: 0.0033) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -26.21% (0.0248 => 0.0183, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -8.29% (0.0181 => 0.0166, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.94% (0.0425 => 0.0421, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.38% (0.0290 => 0.0294, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -22.36% (0.0313 => 0.0243, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.24% (0.0421 => 0.0420, std.dev.: 0.0053) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0201 => 0.0201, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0217 => 0.0217, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -3.65% (0.0329 => 0.0317, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -1.34% (0.1490 => 0.1470, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.65% (1.1084 => 1.1156, std.dev.: 0.0262) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -4.98% (0.1505 => 0.1430, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.66% (0.4073 => 0.4100, std.dev.: 0.0175) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.91% (0.1422 => 0.1409, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.52% (0.0576 => 0.0573, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 21.20% (0.0217 => 0.0263, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.41% (0.0558 => 0.0539, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.14% (1.1395 => 1.1379, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -51.61% (0.0031 => 0.0015, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -48.15% (0.0027 => 0.0014, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.02% (0.0598 => 0.0562, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 19.44% (0.0180 => 0.0215, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.95% (0.8012 => 0.7936, std.dev.: 0.0092) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: -50.00% (0.0002 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 21.05% (0.0038 => 0.0046, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.72% (2.1832 => 1.6653, std.dev.: 0.0041) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.57% (0.0810 => 0.0928, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.03% (0.0848 => 0.0950, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 11.24% (0.1112 => 0.1237, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.60% (0.1983 => 0.2094, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.51% (0.7473 => 0.7885, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.85% (0.6287 => 0.6592, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.74% (0.2279 => 0.2387, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.64% (1.1606 => 1.2144, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.20% (1.1685 => 1.2176, std.dev.: 0.0136) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.04% (0.3717 => 0.3867, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.80% (0.3003 => 0.3117, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.47% (1.4479 => 1.4981, std.dev.: 0.0101) MultiSource/Applications/Burg/burg: 3.41% (1.2222 => 1.2639, std.dev.: 0.0087) MultiSource/Applications/hbd/hbd: 3.19% (1.4269 => 1.4724, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.14% (0.5961 => 0.6148, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash: 2.66% (0.3800 => 0.3901, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.52% (0.4127 => 0.4231, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.51% (0.8712 => 0.8931, std.dev.: 0.0046) MultiSource/Applications/ClamAV/clamscan: 2.49% (14.7684 => 15.1359, std.dev.: 0.0482) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.46% (0.8007 => 0.8204, std.dev.: 0.0070) MultiSource/Benchmarks/MallocBench/gs/gs: 2.37% (4.1305 => 4.2282, std.dev.: 0.0217) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.34% (0.8050 => 0.8238, std.dev.: 0.0038) MultiSource/Benchmarks/PAQ8p/paq8p: 2.27% (2.3764 => 2.4303, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.26% (0.7966 => 0.8146, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.25% (0.8697 => 0.8893, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.23% (0.8066 => 0.8246, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.18% (0.8331 => 0.8513, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.18% (0.5191 => 0.5304, std.dev.: 0.0023) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.07% (6.6074 => 6.7445, std.dev.: 0.0209) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.04% (0.8069 => 0.8234, std.dev.: 0.0052) MultiSource/Benchmarks/Bullet/bullet: 2.00% (31.8598 => 32.4964, std.dev.: 0.0405) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.98% (4.1763 => 4.2591, std.dev.: 0.0303) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.95% (0.8204 => 0.8364, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.92% (1.2423 => 1.2661, std.dev.: 0.0056) MultiSource/Applications/minisat/minisat: 1.89% (0.6834 => 0.6963, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.88% (4.4880 => 4.5725, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.88% (0.8286 => 0.8442, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.87% (0.8716 => 0.8879, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.81% (0.9074 => 0.9238, std.dev.: 0.0063) MultiSource/Applications/lambda-0_1_3/lambda: 1.68% (0.7557 => 0.7684, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.67% (4.5702 => 4.6467, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.67% (0.8340 => 0.8479, std.dev.: 0.0051) MultiSource/Applications/SIBsim4/SIBsim4: 1.64% (1.2568 => 1.2774, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.64% (0.8855 => 0.9000, std.dev.: 0.0049) MultiSource/Benchmarks/nbench/nbench: 1.61% (1.1271 => 1.1453, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.58% (0.6586 => 0.6690, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.57% (0.8177 => 0.8305, std.dev.: 0.0046) MultiSource/Applications/JM/lencod/lencod: 1.56% (15.3280 => 15.5673, std.dev.: 0.0478) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.54% (8.6476 => 8.7812, std.dev.: 0.0502) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.51% (4.4873 => 4.5550, std.dev.: 0.0092) MultiSource/Applications/oggenc/oggenc: 1.43% (4.9628 => 5.0339, std.dev.: 0.0094) MultiSource/Applications/d/make_dparser: 1.37% (3.2366 => 3.2811, std.dev.: 0.0157) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.31% (1.6386 => 1.6600, std.dev.: 0.0079) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.29% (0.8995 => 0.9111, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.20% (1.5315 => 1.5499, std.dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.90% (1.5795 => 2.5099, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.67% (0.3186 => 0.3494, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.48% (1.1857 => 1.2863, std.dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 5.93% (63.1822 => 66.9277, std.dev.: 0.0682) SingleSource/Benchmarks/Misc/ReedSolomon: 3.47% (8.5322 => 8.8282, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 2.64% (3.6643 => 3.7612, std.dev.: 0.0161) MultiSource/Applications/minisat/minisat: 2.13% (6.1525 => 6.2838, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/bh/bh: 1.68% (2.3560 => 2.3956, std.dev.: 0.0090) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -10.22% (0.3269 => 0.2935, std.dev.: 0.0052) MultiSource/Applications/lua/lua: -5.01% (29.8330 => 28.3385, std.dev.: 0.0685) MultiSource/Applications/SPASS/SPASS: -2.43% (8.4326 => 8.2273, std.dev.: 0.0138) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.14% (3.3479 => 3.3099, std.dev.: 0.0075) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 1.32% (16.4461 => 16.6629, std.dev.: 0.0453) MultiSource/Applications/obsequi/Obsequi: 1.79% (1.0262 => 1.0446, std.dev.: 0.0195) MultiSource/Applications/sqlite3/sqlite3: 1.66% (0.6332 => 0.6437, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/08-main/main: -0.38% (0.1831 => 0.1824, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.37% (0.1559 => 0.1522, std.dev.: 0.0090) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.63% (0.3123 => 0.3205, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.49% (0.2463 => 0.2377, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.20% (0.3344 => 0.3304, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.25% (0.2364 => 0.2358, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/bigfib: 0.15% (0.6010 => 0.6019, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: 6.06% (0.0429 => 0.0455, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.02% (0.3266 => 0.3332, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/strcat: 1.47% (0.1969 => 0.1998, std.dev.: 0.0033) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -18.30% (0.0224 => 0.0183, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 34.96% (0.0123 => 0.0166, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.19% (0.0408 => 0.0421, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 15.75% (0.0254 => 0.0294, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -19.54% (0.0302 => 0.0243, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.38% (0.0384 => 0.0420, std.dev.: 0.0053) SingleSource/UnitTests/Vector/Altivec/casts: 5.79% (0.0190 => 0.0201, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 37.83% (0.0230 => 0.0317, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.23% (0.1438 => 0.1470, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -1.53% (1.1329 => 1.1156, std.dev.: 0.0262) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -2.19% (0.1462 => 0.1430, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.54% (0.4164 => 0.4100, std.dev.: 0.0175) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.92% (0.1369 => 0.1409, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.61% (0.0641 => 0.0573, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 34.87% (0.0195 => 0.0263, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.75% (0.0578 => 0.0539, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.51% (1.1437 => 1.1379, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1400.00% (0.0001 => 0.0015, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0014 => 0.0014, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.37% (0.0627 => 0.0562, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 19.44% (0.0180 => 0.0215, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.01% (0.8017 => 0.7936, std.dev.: 0.0092) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -25.81% (0.0062 => 0.0046, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 13.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 24 21:46:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 24 Oct 2012 23:46:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121025044621.C7A152A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5188?compare_to=5184&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5188, Order: 166661, Start Time: 2012-10-25 03:21:29, End Time: 2012-10-25 04:46:11 To: 5184, Order: 166638, Start Time: 2012-10-24 23:44:54, End Time: 2012-10-25 01:09:42 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 0 (185 on baseline) Unchanged Tests: 1041 (853 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.20% (4.7488 => 4.8056, std.dev.: 0.0155) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1011, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/salsa20: 2.52% (7.4937 => 7.6828, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash2: 2.03% (3.1932 => 3.2581, std.dev.: 0.0057) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.15% (0.1431 => 0.1300, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.24% (0.3821 => 0.3506, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -7.65% (2.4924 => 2.3018, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.35% (22.4056 => 20.7593, std.dev.: 0.0105) MultiSource/Applications/sgefa/sgefa: -7.30% (0.3357 => 0.3112, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.24% (0.9542 => 0.8851, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -7.23% (0.3831 => 0.3554, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -7.21% (0.1761 => 0.1634, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -7.19% (3.5339 => 3.2797, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: -7.19% (0.3812 => 0.3538, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.16% (0.3884 => 0.3606, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -7.15% (0.3848 => 0.3573, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -7.09% (0.4176 => 0.3880, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -7.08% (0.2160 => 0.2007, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: -7.07% (0.9179 => 0.8530, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.07% (0.3891 => 0.3616, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -7.06% (0.3880 => 0.3606, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -7.05% (16.1920 => 15.0510, std.dev.: 0.0203) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.03% (0.3142 => 0.2921, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: -6.98% (0.3896 => 0.3624, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/ReedSolomon: -6.97% (0.1879 => 0.1748, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -6.97% (0.4033 => 0.3752, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.96% (0.9852 => 0.9166, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -6.95% (7.0961 => 6.6026, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.92% (0.2428 => 0.2260, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -6.91% (0.4199 => 0.3909, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.90% (0.1796 => 0.1672, std.dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: -6.90% (9.2283 => 8.5915, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.90% (1.6474 => 1.5338, std.dev.: 0.0028) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.88% (0.1584 => 0.1475, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: -6.84% (1.1530 => 1.0741, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: -6.81% (4.3330 => 4.0381, std.dev.: 0.0102) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.78% (6.7716 => 6.3125, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.78% (0.3658 => 0.3410, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: -6.78% (1.2515 => 1.1667, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: -6.78% (0.4280 => 0.3990, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.75% (1.0544 => 0.9832, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: -6.73% (0.1500 => 0.1399, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.72% (0.4151 => 0.3872, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.72% (0.2695 => 0.2514, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -6.67% (1.1450 => 1.0686, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -6.67% (2.4021 => 2.2420, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.65% (1.3722 => 1.2809, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.65% (0.6736 => 0.6288, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.65% (5.4682 => 5.1048, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.62% (1.4642 => 1.3672, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.60% (0.6484 => 0.6056, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: -6.58% (0.5168 => 0.4828, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.57% (4.0323 => 3.7673, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.55% (4.5069 => 4.2118, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.54% (4.8161 => 4.5011, std.dev.: 0.0106) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.54% (0.2355 => 0.2201, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.53% (1.6364 => 1.5296, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.51% (0.2548 => 0.2382, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.51% (1.2784 => 1.1952, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: -6.50% (0.7447 => 0.6963, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.50% (0.3849 => 0.3599, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.48% (1.2300 => 1.1503, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ks/ks: -6.48% (0.1621 => 0.1516, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -6.47% (0.2659 => 0.2487, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.47% (0.1716 => 0.1605, std.dev.: 0.0009) MultiSource/Applications/lua/lua: -6.45% (4.0594 => 3.7974, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.45% (2.2587 => 2.1131, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.44% (0.3931 => 0.3678, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -6.43% (0.2985 => 0.2793, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.43% (0.6052 => 0.5663, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.42% (0.6304 => 0.5899, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: -6.42% (0.3581 => 0.3351, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: -6.41% (0.3026 => 0.2832, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: -6.40% (15.5079 => 14.5149, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.40% (0.7919 => 0.7412, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.40% (0.3252 => 0.3044, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.40% (4.8802 => 4.5681, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.39% (0.6293 => 0.5891, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -6.38% (0.6660 => 0.6235, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.36% (0.7339 => 0.6872, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: -6.36% (0.3446 => 0.3227, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: -6.35% (1.3864 => 1.2984, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.34% (0.4083 => 0.3824, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -6.34% (0.3406 => 0.3190, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.33% (0.5591 => 0.5237, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: -6.33% (0.3255 => 0.3049, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: -6.32% (0.9557 => 0.8953, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -6.31% (0.7524 => 0.7049, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.31% (0.3837 => 0.3595, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -6.31% (0.3394 => 0.3180, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -6.31% (1.3148 => 1.2319, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.30% (0.2903 => 0.2720, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -6.30% (0.3491 => 0.3271) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.30% (0.4813 => 0.4510, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.30% (0.5925 => 0.5552, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -6.29% (0.5705 => 0.5346, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -6.29% (0.3481 => 0.3262, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: -6.29% (0.2989 => 0.2801, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.29% (0.6395 => 0.5993, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.28% (0.5478 => 0.5134, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.27% (0.6297 => 0.5902, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/fibo: -6.27% (0.2871 => 0.2691, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -6.27% (0.3621 => 0.3394, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -6.26% (0.6230 => 0.5840, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -6.26% (0.4524 => 0.4241, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.25% (14.2083 => 13.3197, std.dev.: 0.0187) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.25% (0.3057 => 0.2866, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.25% (0.6260 => 0.5869, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: -6.23% (0.4427 => 0.4151, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -6.22% (0.5575 => 0.5228, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.22% (0.5805 => 0.5444, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.21% (0.5863 => 0.5499, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.20% (0.5999 => 0.5627, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -6.20% (0.3323 => 0.3117, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.20% (0.5859 => 0.5496, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.19% (0.6189 => 0.5806, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.18% (0.4916 => 0.4612, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: -6.18% (0.4515 => 0.4236, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: -6.18% (0.3205 => 0.3007, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -6.18% (0.5569 => 0.5225, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -6.17% (34.0927 => 31.9875, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/hash2: -6.17% (0.4861 => 0.4561, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -6.16% (0.4321 => 0.4055, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.15% (0.5802 => 0.5445, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -6.14% (0.5941 => 0.5576, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.13% (0.5857 => 0.5498, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.12% (2.1713 => 2.0384, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -6.12% (0.6750 => 0.6337, std.dev.: 0.0080) MultiSource/Applications/ClamAV/clamscan: -6.11% (15.2527 => 14.3208, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/hello: -6.11% (0.2849 => 0.2675, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -6.10% (0.5456 => 0.5123, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.10% (0.6440 => 0.6047, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: -6.10% (3.5154 => 3.3011, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -6.09% (0.6667 => 0.6261, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -6.08% (0.6676 => 0.6270, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.07% (0.5581 => 0.5242, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: -6.07% (0.3788 => 0.3558, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -6.07% (0.5570 => 0.5232, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.07% (0.7021 => 0.6595, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.07% (0.6446 => 0.6055, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -6.06% (17.1032 => 16.0666, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -6.05% (0.5567 => 0.5230, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -6.04% (0.3194 => 0.3001, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -6.03% (0.2933 => 0.2756, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: -6.03% (0.3016 => 0.2834, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.03% (0.5688 => 0.5345, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -6.03% (0.3867 => 0.3634, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.02% (0.5329 => 0.5008, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: -6.02% (0.2939 => 0.2762, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.02% (0.6194 => 0.5821, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -6.02% (0.6033 => 0.5670, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -6.00% (0.6395 => 0.6011, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/moments: -6.00% (0.4248 => 0.3993, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.97% (0.3483 => 0.3275, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: -5.96% (2.1401 => 2.0125, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -5.94% (18.2933 => 17.2060, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.91% (0.6681 => 0.6286, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.90% (0.2999 => 0.2822, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.90% (8.0126 => 7.5398, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: -5.88% (0.3059 => 0.2879, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.86% (0.7198 => 0.6776, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.86% (0.8521 => 0.8022, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.84% (0.2278 => 0.2145, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.81% (1.2221 => 1.1511, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.81% (1.2210 => 1.1501, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: -5.75% (0.3271 => 0.3083, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.74% (0.2385 => 0.2248, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.65% (0.2106 => 0.1987, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: -5.65% (0.7982 => 0.7531, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.60% (0.3319 => 0.3133, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -5.11% (0.8418 => 0.7988, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.10% (0.2001 => 0.1899, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: -5.09% (0.7779 => 0.7383, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: -4.99% (0.6347 => 0.6030, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -4.94% (0.6441 => 0.6123, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.75% (0.9077 => 0.8646, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.52% (0.2277 => 0.2174, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -4.32% (5.0226 => 4.8056, std.dev.: 0.0155) MultiSource/Applications/hbd/hbd: -4.17% (1.5610 => 1.4959, std.dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -2.98% (20.7746 => 20.1562, std.dev.: 0.0748) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7550, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: -8.62% (1.2842 => 1.1735, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -4.03% (2.2633 => 2.1721, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.85% (1.7753 => 1.7070, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.40% (1.3096 => 1.2782, std.dev.: 0.0117) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4727, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0001) Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 24 22:07:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 00:07:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121025050751.8D7342A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5189?compare_to=5185&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5189, Order: 166661, Start Time: 2012-10-25 03:47:24, End Time: 2012-10-25 05:07:43 To: 5185, Order: 166638, Start Time: 2012-10-25 00:05:55, End Time: 2012-10-25 01:26:14 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 1 (75 on baseline) New Passes: 0 (7 on baseline) Performance Regressions: 4 (200 on baseline) Performance Improvements: 0 (44 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 86 (12 on baseline) Unchanged Tests: 951 (642 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.13% (0.6973 => 0.3826, std.dev.: 0.0132) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 12.16% (0.3964 => 0.4446, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/richards_benchmark: 8.03% (0.2267 => 0.2449, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 1.35% (15.5417 => 15.7519, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.22% (5.8478 => 5.9189, std.dev.: 0.0018) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.02% (0.6306 => 0.6307, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 0.41% (17.3353 => 17.4063, std.dev.: 0.0143) MultiSource/Applications/kimwitu++/kc: 0.53% (15.7149 => 15.7982, std.dev.: 0.0104) MultiSource/Benchmarks/Bullet/bullet: 0.19% (57.1390 => 57.2449, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.41% (0.0489 => 0.0491, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.41% (0.0491 => 0.0493, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.44% (0.0458 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.43% (0.0460 => 0.0462, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.45% (0.0448 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.22% (0.0450 => 0.0451, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0443 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.45% (0.0443 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.43% (0.0460 => 0.0462) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.43% (0.0461 => 0.0463) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.44% (0.0454 => 0.0456, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.44% (0.0455 => 0.0457, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.23% (0.0444 => 0.0445, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.22% (0.0446 => 0.0447, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.44% (0.0451 => 0.0453, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.44% (0.0453 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.65% (0.0462 => 0.0465, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.43% (0.0464 => 0.0466, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.46% (0.0439 => 0.0441) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.23% (0.0441 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.22% (0.0452 => 0.0453, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.44% (0.0453 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.45% (0.0442 => 0.0444, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.45% (0.0444 => 0.0446) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.23% (0.0435 => 0.0436, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.23% (0.0436 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.23% (0.0434 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.46% (0.0435 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.42% (0.0471 => 0.0473) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.42% (0.0472 => 0.0474) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0434 => 0.0434) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.23% (0.0434 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.46% (0.0433 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.23% (0.0435 => 0.0436) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.23% (0.0442 => 0.0443, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.45% (0.0442 => 0.0444, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.55% (8.2953 => 8.3410, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.49% (0.6920 => 0.6954, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.14% (0.1437 => 0.1439, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.61% (0.0652 => 0.0648, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -9.49% (63.2438 => 57.2449, std.dev.: 0.0200) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/BenchmarkGame/puzzle MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.04% (0.6962 => 0.3826, std.dev.: 0.0132) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/MallocBench/gs/gs: 13.90% (4.1105 => 4.6819, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 44.23% (1.1048 => 1.5934, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 70.92% (3.4629 => 5.9189, std.dev.: 0.0018) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13507.08% (0.0720 => 9.7971, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050200.00% (0.0001 => 10.0503, std.dev.: 0.0051) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 69.92% (0.0256 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 67.54% (0.2554 => 0.4279, std.dev.: 0.0007) SingleSource/Regression/C/sumarraymalloc: 52.26% (0.0243 => 0.0370) MultiSource/Benchmarks/PAQ8p/paq8p: 51.94% (10.3673 => 15.7519, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/richards_benchmark: 50.99% (0.1622 => 0.2449, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 44.28% (0.0271 => 0.0391) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.97% (1.5859 => 2.2515, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/distray/distray: 37.50% (0.1056 => 0.1452, std.dev.: 0.0030) SingleSource/UnitTests/vla: 33.52% (0.0355 => 0.0474, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 31.41% (2.2024 => 2.8942, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/neural/neural: 28.84% (0.1463 => 0.1885, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 24.70% (0.0834 => 0.1040, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 24.53% (0.1655 => 0.2061, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/objinst: 24.12% (0.0427 => 0.0530) SingleSource/Benchmarks/Shootout/hash: 21.86% (0.0485 => 0.0591, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.58% (0.1566 => 0.1904, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 21.51% (0.1432 => 0.1740, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: 20.99% (0.2049 => 0.2479, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.96% (7.0540 => 8.5325, std.dev.: 0.0300) MultiSource/Applications/viterbi/viterbi: 19.68% (0.1555 => 0.1861, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pifft/pifft: 19.62% (2.2022 => 2.6342, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.29% (0.0871 => 0.1039) MultiSource/Benchmarks/Olden/power/power: 18.96% (0.1440 => 0.1713, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 18.94% (0.5105 => 0.6072, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.64% (0.6675 => 0.7919, std.dev.: 0.0139) MultiSource/Benchmarks/Olden/tsp/tsp: 17.79% (0.1175 => 0.1384, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 17.73% (0.0626 => 0.0737, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.69% (0.1029 => 0.1211, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: 17.67% (3.3354 => 3.9248, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.30% (1.3050 => 1.5307, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.28% (0.0793 => 0.0930, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 17.20% (0.1163 => 0.1363, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 17.08% (0.2271 => 0.2659, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 17.05% (0.1695 => 0.1984, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.84% (0.4615 => 0.5392, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.69% (0.8172 => 0.9536, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 16.60% (0.1337 => 0.1559, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 16.56% (0.7115 => 0.8293, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.50% (0.3121 => 0.3636, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/matrix: 16.38% (0.0818 => 0.0952, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.37% (0.0886 => 0.1031, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.35% (0.5020 => 0.5841, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.28% (1.5415 => 1.7925, std.dev.: 0.0087) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.09% (0.1032 => 0.1198, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 16.03% (0.3282 => 0.3808, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.96% (0.1510 => 0.1751, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 15.92% (0.0672 => 0.0779, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.91% (0.0842 => 0.0976, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.88% (0.1940 => 0.2248, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 15.76% (0.4879 => 0.5648, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 15.70% (10.4361 => 12.0750, std.dev.: 0.0166) MultiSource/Applications/Burg/burg: 15.68% (1.1642 => 1.3468, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 15.63% (0.3109 => 0.3595, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 15.57% (8.1363 => 9.4028, std.dev.: 0.0087) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.56% (0.0675 => 0.0780, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.45% (0.0770 => 0.0889, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.31% (0.1117 => 0.1288, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.28% (0.2107 => 0.2429, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 15.28% (0.3423 => 0.3946, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.25% (0.9765 => 1.1254, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 15.17% (9.4845 => 10.9232, std.dev.: 0.0095) MultiSource/Benchmarks/MallocBench/espresso/espresso: 15.11% (4.2646 => 4.9088, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.05% (0.2758 => 0.3173, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.04% (0.0838 => 0.0964, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.91% (0.5860 => 0.6734, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.87% (0.1695 => 0.1947, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/exptree: 14.86% (0.0814 => 0.0935, std.dev.: 0.0039) MultiSource/Applications/treecc/treecc: 14.80% (2.0273 => 2.3274, std.dev.: 0.0090) SingleSource/UnitTests/SignlessTypes/rem: 14.77% (0.1144 => 0.1313, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.76% (0.5981 => 0.6864, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 14.72% (0.7835 => 0.8988, std.dev.: 0.0027) MultiSource/Applications/aha/aha: 14.68% (0.1151 => 0.1320, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.64% (0.1236 => 0.1417, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.61% (0.0746 => 0.0855, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.60% (0.6450 => 0.7392, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 14.56% (1.4186 => 1.6251, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.54% (1.7609 => 2.0170, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 14.53% (0.1906 => 0.2183, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.48% (0.2065 => 0.2364, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 14.48% (0.3177 => 0.3637, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.47% (0.0933 => 0.1068, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.46% (0.1584 => 0.1813, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.44% (0.2700 => 0.3090, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.41% (0.0798 => 0.0913, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 14.38% (0.0730 => 0.0835, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.26% (7.9617 => 9.0974, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 14.26% (0.1438 => 0.1643, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 14.19% (1.1840 => 1.3520, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 14.08% (3.8723 => 4.4174, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 14.05% (0.7433 => 0.8477, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.03% (0.3307 => 0.3771, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.03% (0.0770 => 0.0878, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.98% (0.8067 => 0.9195, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.94% (0.1062 => 0.1210, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 13.80% (0.1268 => 0.1443, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 13.76% (1.0722 => 1.2197, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 13.64% (0.3387 => 0.3849, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.63% (0.5569 => 0.6328, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 13.60% (5.7591 => 6.5423, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.58% (5.0018 => 5.6808, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.54% (0.1625 => 0.1845, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 13.50% (4.9449 => 5.6124, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 13.41% (1.1861 => 1.3452, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.24% (0.0929 => 0.1052, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.19% (0.3441 => 0.3895, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 13.16% (0.3092 => 0.3499, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 13.00% (0.4299 => 0.4858, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.95% (0.2603 => 0.2940, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.93% (0.1330 => 0.1502, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 12.78% (1.5603 => 1.7597, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 12.77% (0.3180 => 0.3586, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 12.68% (0.8921 => 1.0052, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.60% (0.1143 => 0.1287, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 12.56% (0.6456 => 0.7267, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.34% (0.8101 => 0.9101, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 12.27% (0.1125 => 0.1263, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.05% (0.2266 => 0.2539, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.63% (0.3543 => 0.3955, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 11.54% (0.4289 => 0.4784, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.47% (0.1892 => 0.2109, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 11.43% (0.4620 => 0.5148, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 11.34% (2.2969 => 2.5574, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/trivial-interface: 11.20% (0.3473 => 0.3862, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.05% (0.3927 => 0.4361, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 11.04% (0.3694 => 0.4102, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/synchronized: 11.04% (0.3561 => 0.3954, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-4: 11.04% (0.3543 => 0.3934, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.00% (0.3828 => 0.4249, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.97% (0.4203 => 0.4664, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.90% (1.1194 => 1.2414, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 10.90% (0.3497 => 0.3878, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.89% (0.3516 => 0.3899, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.89% (0.3865 => 0.4286, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 10.84% (0.3422 => 0.3793, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 10.84% (21.9371 => 24.3144, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/property: 10.78% (0.3886 => 0.4305, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.63% (0.1044 => 0.1155, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 10.48% (0.3684 => 0.4070, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.43% (0.4103 => 0.4531, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 10.23% (0.4048 => 0.4462, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/sieve: 10.10% (0.3603 => 0.3967, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.07% (0.3427 => 0.3772, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.92% (0.4636 => 0.5096, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 9.42% (0.6030 => 0.6598, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 9.41% (17.1811 => 18.7970, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.33% (0.3826 => 0.4183, std.dev.: 0.0125) SingleSource/UnitTests/ObjC++/Hello: 9.28% (0.5925 => 0.6475, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/strcat: 9.25% (0.2831 => 0.3093, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 9.23% (0.3098 => 0.3384, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.12% (0.3650 => 0.3983, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 9.07% (0.3232 => 0.3525, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.05% (0.2430 => 0.2650, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 9.05% (0.3283 => 0.3580, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.93% (0.4064 => 0.4427, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 8.81% (0.2871 => 0.3124, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.80% (14.3668 => 15.6308, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.76% (0.3162 => 0.3439, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 8.71% (0.2905 => 0.3158, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.71% (0.7326 => 0.7964, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.70% (0.2872 => 0.3122, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.65% (0.2891 => 0.3141, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.58% (0.3136 => 0.3405, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.45% (0.2756 => 0.2989, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.45% (3.8922 => 4.2211, std.dev.: 0.0403) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.34% (2.0665 => 2.2388, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 8.27% (0.2877 => 0.3115, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 8.18% (0.2725 => 0.2948, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.16% (0.2793 => 0.3021, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 8.13% (0.3052 => 0.3300, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 8.05% (0.3379 => 0.3651, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 7.96% (0.2714 => 0.2930, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 7.96% (0.2802 => 0.3025, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 7.59% (1.2842 => 1.3817, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/objinst: 7.06% (0.3131 => 0.3352, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.38% (0.3817 => 0.3946, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8961, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1725, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.34% (0.9957 => 1.1285, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.92% (1.1396 => 1.2527, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3683, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.64% (2.8904 => 3.0824, std.dev.: 0.0038) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 3.81% (1.9405 => 2.0145, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.61% (0.3987 => 0.4091, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.47% (4.2280 => 4.3325, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/bisort/bisort: 1.84% (0.8333 => 0.8486, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.76% (3.6395 => 3.7035, std.dev.: 0.0072) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2078, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.46% (2.6546 => 2.6934, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.40% (1.0313 => 1.0457, std.dev.: 0.0053) MultiSource/Applications/viterbi/viterbi: 1.25% (4.4649 => 4.5207, std.dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 1.22% (11.6436 => 11.7857, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.10% (6.5088 => 6.5801, std.dev.: 0.0055) MultiSource/Applications/minisat/minisat: 1.00% (9.1159 => 9.2071, std.dev.: 0.0275) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.99% (6.6874 => 0.1343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -77.20% (0.8651 => 0.1972, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.39% (5.2763 => 3.3033, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.16% (5.3855 => 3.7614, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -29.76% (5.3526 => 3.7599, std.dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -9.58% (54.1659 => 48.9752, std.dev.: 0.0160) MultiSource/Applications/ClamAV/clamscan: -2.03% (22.1758 => 21.7258, std.dev.: 0.0151) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -52.85% (8.0499 => 3.7956, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.50% (1.1492 => 0.7642, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4751, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.86% (1.6925 => 1.4241, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.72% (1.2258 => 1.0699, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -11.50% (1.2373 => 1.0950, std.dev.: 0.0193) SingleSource/Benchmarks/Misc/mandel-2: -10.58% (1.5373 => 1.3747, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.45% (19.9488 => 18.2626, std.dev.: 0.0180) MultiSource/Benchmarks/FreeBench/mason/mason: -7.87% (0.2161 => 0.1991, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.02% (1.8329 => 1.7043, std.dev.: 0.0171) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.22% (1.6805 => 1.5928, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7614, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.83% (1.5835 => 1.5070, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.25% (8.1563 => 7.8093, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0012) MultiSource/Applications/siod/siod: -3.64% (3.2827 => 3.1633, std.dev.: 0.0082) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8775, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5060, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.62% (0.4808 => 0.4682, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -2.18% (4.6441 => 4.5428, std.dev.: 0.0016) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0854, std.dev.: 0.0209) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6780, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.64% (2.5528 => 2.5110, std.dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4223, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2878, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 20.62% (0.5229 => 0.6307, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 16.12% (14.9895 => 17.4063, std.dev.: 0.0143) MultiSource/Applications/kimwitu++/kc: 11.61% (14.1553 => 15.7982, std.dev.: 0.0104) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 16.52% (7.1582 => 8.3410, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.76% (0.6222 => 0.6954, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.10% (0.1485 => 0.1439, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 24 22:30:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 00:30:15 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121025053015.D00562A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5190?compare_to=5187&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5190, Order: 166661, Start Time: 2012-10-25 04:06:12, End Time: 2012-10-25 05:30:11 To: 5187, Order: 166659, Start Time: 2012-10-25 02:25:04, End Time: 2012-10-25 03:48:46 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 2 (43 on baseline) Performance Improvements: 3 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 970 (927 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.11% (0.8279 => 0.8702, std.dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/ffbench: 1.78% (1.4108 => 1.4359, std.dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.78% (8.7915 => 8.4589, std.dev.: 0.0954) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.52% (1.4981 => 1.4603, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.38% (0.8479 => 0.8362, std.dev.: 0.0015) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.29% (16.6629 => 16.6152, std.dev.: 0.1839) MultiSource/Applications/obsequi/Obsequi: 2.54% (1.0446 => 1.0711, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: -1.07% (0.6437 => 0.6368, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/08-main/main: 7.62% (0.1824 => 0.1963, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 8.34% (0.1522 => 0.1649, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.40% (0.3205 => 0.3160, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.33% (0.2377 => 0.2480, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.60% (0.3304 => 0.3251, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.37% (0.2358 => 0.2414, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/bigfib: -1.18% (0.6019 => 0.5948, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: -1.54% (0.0455 => 0.0448, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: -1.53% (0.3332 => 0.3281, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: -0.70% (0.1998 => 0.1984, std.dev.: 0.0014) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 34.43% (0.0183 => 0.0246, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 13.86% (0.0166 => 0.0189, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0421 => 0.0421, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.61% (0.0294 => 0.0254, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 13.17% (0.0243 => 0.0275, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0420 => 0.0420, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0201 => 0.0201, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -0.92% (0.0217 => 0.0215, std.dev.: 0.0023) SingleSource/UnitTests/byval-alignment: -12.62% (0.0317 => 0.0277, std.dev.: 0.0028) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 700.00% (0.0001 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.20% (0.1470 => 0.1473, std.dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.27% (1.1156 => 1.1298, std.dev.: 0.0337) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 2.87% (0.1430 => 0.1471, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.76% (0.4100 => 0.4131, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.92% (0.1409 => 0.1396, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.63% (0.0573 => 0.0611, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 3.42% (0.0263 => 0.0272, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.93% (0.0539 => 0.0544, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.46% (1.1379 => 1.1431, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 106.67% (0.0015 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.31% (0.0562 => 0.0575, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 9.30% (0.0215 => 0.0235, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.10% (0.7936 => 0.8023, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -10.87% (0.0046 => 0.0041, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.29% (2.1832 => 1.6530, std.dev.: 0.0051) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.54% (0.0810 => 0.0944, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 12.14% (0.1112 => 0.1247, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.13% (0.8321 => 0.8914, std.dev.: 0.0118) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.11% (0.2180 => 0.2335, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.80% (0.8148 => 0.8702, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.46% (0.1905 => 0.2028, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.85% (0.7473 => 0.7910, std.dev.: 0.0127) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.78% (0.1885 => 0.1994, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.64% (0.3295 => 0.3481, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.10% (0.2998 => 0.3151, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.46% (0.5961 => 0.6227, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.14% (1.1606 => 1.2086, std.dev.: 0.0108) MultiSource/Applications/hbd/hbd: 3.69% (1.4269 => 1.4796, std.dev.: 0.0164) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.64% (1.1685 => 1.2110, std.dev.: 0.0063) MultiSource/Applications/spiff/spiff: 3.18% (0.7950 => 0.8203, std.dev.: 0.0053) MultiSource/Applications/Burg/burg: 3.15% (1.2222 => 1.2607, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.10% (0.4127 => 0.4255, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.96% (0.3717 => 0.3827, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.25% (1.2602 => 1.2886, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.23% (4.1763 => 4.2694, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.14% (0.8007 => 0.8178, std.dev.: 0.0048) MultiSource/Applications/SIBsim4/SIBsim4: 2.06% (1.2568 => 1.2827, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.88% (0.8317 => 0.8473, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.80% (1.2423 => 1.2647, std.dev.: 0.0070) MultiSource/Applications/d/make_dparser: 1.79% (3.2366 => 3.2946, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.63% (13.1811 => 13.3961, std.dev.: 0.0605) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.63% (0.7932 => 0.8061, std.dev.: 0.0035) MultiSource/Applications/siod/siod: 1.38% (2.2184 => 2.2491, std.dev.: 0.0108) MultiSource/Benchmarks/PAQ8p/paq8p: 1.32% (2.3764 => 2.4078, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.24% (0.8656 => 0.8763, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.23% (0.8927 => 0.9037, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.06% (2.1401 => 2.1627, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.73% (1.5795 => 2.5072, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.26% (1.1857 => 1.2836, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.97% (0.3186 => 0.3408, std.dev.: 0.0055) MultiSource/Benchmarks/mafft/pairlocalalign: 5.99% (63.1822 => 66.9664, std.dev.: 0.0289) MultiSource/Benchmarks/FreeBench/distray/distray: 4.23% (0.2390 => 0.2491, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 2.72% (3.6643 => 3.7638, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/ReedSolomon: 2.13% (8.5322 => 8.7142, std.dev.: 0.0510) MultiSource/Benchmarks/Olden/bh/bh: 1.99% (2.3560 => 2.4030, std.dev.: 0.0116) MultiSource/Benchmarks/FreeBench/mason/mason: 1.85% (0.5415 => 0.5515, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.17% (1.5941 => 1.6127, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.17% (4.8362 => 4.8926, std.dev.: 0.0139) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.53% (0.3269 => 0.3023, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -5.24% (29.8330 => 28.2706, std.dev.: 0.2752) SingleSource/Benchmarks/Shootout-C++/hash2: -1.68% (3.4237 => 3.3661, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.19% (3.3479 => 3.3079, std.dev.: 0.0052) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 1.03% (16.4461 => 16.6152, std.dev.: 0.1839) MultiSource/Applications/obsequi/Obsequi: 4.38% (1.0262 => 1.0711, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 0.57% (0.6332 => 0.6368, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/08-main/main: 7.21% (0.1831 => 0.1963, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.77% (0.1559 => 0.1649, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.18% (0.3123 => 0.3160, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.69% (0.2463 => 0.2480, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.78% (0.3344 => 0.3251, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.12% (0.2364 => 0.2414, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/bigfib: -1.03% (0.6010 => 0.5948, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: 4.43% (0.0429 => 0.0448, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.46% (0.3266 => 0.3281, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 0.76% (0.1969 => 0.1984, std.dev.: 0.0014) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 9.82% (0.0224 => 0.0246, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 53.66% (0.0123 => 0.0189, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.19% (0.0408 => 0.0421, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0254 => 0.0254, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -8.94% (0.0302 => 0.0275, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.38% (0.0384 => 0.0420, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 5.79% (0.0190 => 0.0201, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 19.44% (0.0180 => 0.0215, std.dev.: 0.0023) SingleSource/UnitTests/byval-alignment: 20.43% (0.0230 => 0.0277, std.dev.: 0.0028) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 14.29% (0.0007 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.43% (0.1438 => 0.1473, std.dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.27% (1.1329 => 1.1298, std.dev.: 0.0337) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.62% (0.1462 => 0.1471, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.79% (0.4164 => 0.4131, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.97% (0.1369 => 0.1396, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.68% (0.0641 => 0.0611, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 39.49% (0.0195 => 0.0272, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.88% (0.0578 => 0.0544, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.05% (1.1437 => 1.1431, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.29% (0.0627 => 0.0575, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 30.56% (0.0180 => 0.0235, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.07% (0.8017 => 0.8023, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -33.87% (0.0062 => 0.0041, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 24 23:34:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 01:34:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121025063407.113652A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5191?compare_to=5188&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5191, Order: 166662, Start Time: 2012-10-25 05:09:09, End Time: 2012-10-25 06:33:59 To: 5188, Order: 166661, Start Time: 2012-10-25 03:21:29, End Time: 2012-10-25 04:46:11 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (183 on baseline) Unchanged Tests: 1042 (855 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 2.68% (7.4937 => 7.6942, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1013, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/hash2: 2.23% (3.1932 => 3.2643, std.dev.: 0.0108) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.08% (0.1431 => 0.1301, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.30% (0.3821 => 0.3504, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -7.62% (2.4924 => 2.3024, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -7.30% (3.5339 => 3.2759, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: -7.30% (0.3357 => 0.3112, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.26% (22.4056 => 20.7787, std.dev.: 0.0168) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.13% (0.3142 => 0.2918, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.12% (0.9542 => 0.8863, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -6.99% (0.2160 => 0.2009, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: -6.98% (0.9179 => 0.8538, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.96% (0.2428 => 0.2259, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: -6.95% (16.1920 => 15.0663, std.dev.: 0.0123) MultiSource/Benchmarks/mafft/pairlocalalign: -6.91% (9.2283 => 8.5902, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.90% (0.1796 => 0.1672, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: -6.90% (4.3330 => 4.0340, std.dev.: 0.0076) MultiSource/Applications/JM/ldecod/ldecod: -6.86% (7.0961 => 6.6090, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.85% (0.9852 => 0.9177, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.83% (0.2695 => 0.2511, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.82% (0.1584 => 0.1476, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.79% (1.6474 => 1.5355, std.dev.: 0.0168) MultiSource/Benchmarks/nbench/nbench: -6.76% (1.1530 => 1.0750, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.75% (0.3658 => 0.3411, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -6.75% (1.2515 => 1.1670, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.72% (1.0544 => 0.9835, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.72% (0.3884 => 0.3623, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.70% (0.1716 => 0.1601, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -6.70% (0.1761 => 0.1643, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: -6.68% (0.3880 => 0.3621, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -6.67% (1.1450 => 1.0686, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -6.66% (0.3831 => 0.3576, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -6.65% (0.3896 => 0.3637, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.62% (6.7716 => 6.3230, std.dev.: 0.0138) MultiSource/Applications/siod/siod: -6.61% (2.4021 => 2.2433, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -6.61% (0.3812 => 0.3560, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/exceptions-3: -6.60% (0.3848 => 0.3594, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -6.60% (0.4033 => 0.3767, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.59% (0.6736 => 0.6292, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.59% (1.3722 => 1.2818, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions: -6.59% (0.4176 => 0.3901, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.58% (0.3891 => 0.3635, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.58% (1.4642 => 1.3679, std.dev.: 0.0032) MultiSource/Applications/lua/lua: -6.57% (4.0594 => 3.7928, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/bh/bh: -6.57% (0.2985 => 0.2789, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.55% (0.7919 => 0.7400, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.51% (0.2548 => 0.2382, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.51% (4.0323 => 3.7698, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: -6.51% (0.2659 => 0.2486, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.50% (5.4682 => 5.1128, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/property: -6.48% (0.4199 => 0.3927, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.48% (0.6484 => 0.6064, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.46% (2.2587 => 2.1128, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.45% (0.2355 => 0.2203, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: -6.44% (0.1879 => 0.1758, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.43% (4.5069 => 4.2172, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.42% (1.2300 => 1.1510, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: -6.42% (0.7447 => 0.6969, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.41% (1.2784 => 1.1964, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: -6.40% (0.3406 => 0.3188, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.39% (1.6364 => 1.5319, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.37% (4.8161 => 4.5092, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/functionobjects: -6.37% (0.5168 => 0.4839, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.36% (4.8802 => 4.5700, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.34% (0.7339 => 0.6874, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.34% (0.4151 => 0.3888, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -6.33% (0.4280 => 0.4009, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.32% (0.5805 => 0.5438, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: -6.31% (1.3864 => 1.2989, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.30% (0.6052 => 0.5671, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -6.29% (0.5705 => 0.5346, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.28% (0.6304 => 0.5908, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.28% (0.5859 => 0.5491, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -6.28% (15.5079 => 14.5347, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.27% (0.6297 => 0.5902, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.26% (0.5478 => 0.5135, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.26% (0.6681 => 0.6263, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.25% (14.2083 => 13.3202, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.25% (0.6260 => 0.5869, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.24% (0.5925 => 0.5555, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: -6.23% (0.1621 => 0.1520, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.21% (0.6395 => 0.5998, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -6.20% (0.4515 => 0.4235, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.17% (0.5863 => 0.5501, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: -6.16% (3.5154 => 3.2989, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.15% (0.7198 => 0.6755, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -6.15% (0.6230 => 0.5847, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.14% (0.5802 => 0.5446, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.11% (0.6446 => 0.6052, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -6.09% (0.5941 => 0.5579, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: -6.09% (0.3581 => 0.3363, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -6.09% (0.7524 => 0.7066, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.09% (0.3483 => 0.3271, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -6.09% (34.0927 => 32.0177, std.dev.: 0.0142) MultiSource/Applications/sqlite3/sqlite3: -6.08% (17.1032 => 16.0631, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -6.08% (0.5575 => 0.5236, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.08% (0.6189 => 0.5813, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -6.07% (1.3148 => 1.2350, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -6.07% (0.6660 => 0.6256, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -6.05% (15.2527 => 14.3295, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.05% (0.5591 => 0.5253, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.04% (0.4916 => 0.4619, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -6.04% (0.6395 => 0.6009, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.02% (0.6440 => 0.6052, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.02% (0.6293 => 0.5914, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -6.02% (2.1401 => 2.0113, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.01% (0.5857 => 0.5505, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -6.01% (0.6676 => 0.6275, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: -6.01% (0.9557 => 0.8983, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: -6.00% (18.2933 => 17.1950, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.00% (0.5999 => 0.5639, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -6.00% (0.5569 => 0.5235, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.00% (0.5688 => 0.5347, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: -5.99% (0.4861 => 0.4570, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.98% (0.3931 => 0.3696, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.97% (0.8521 => 0.8012, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.97% (0.2999 => 0.2820, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.97% (0.6033 => 0.5673, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.95% (0.6667 => 0.6270, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.95% (0.4321 => 0.4064, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.93% (0.5329 => 0.5013, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.93% (0.4083 => 0.3841, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: -5.93% (0.6750 => 0.6350, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.92% (0.5456 => 0.5133, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.91% (0.5581 => 0.5251, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.91% (0.5567 => 0.5238, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.91% (0.5570 => 0.5241, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.90% (0.5849 => 0.5504, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.88% (0.2278 => 0.2144, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.87% (1.2221 => 1.1504, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.84% (0.6194 => 0.5832, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.84% (0.3491 => 0.3287, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.82% (1.2210 => 1.1499, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.82% (0.3849 => 0.3625, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.81% (0.3837 => 0.3614, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.80% (8.0126 => 7.5476, std.dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: -5.80% (0.7982 => 0.7519, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (0.7021 => 0.6614, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.74% (0.2385 => 0.2248, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: -5.73% (0.4524 => 0.4265, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.72% (0.3319 => 0.3129, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -5.72% (0.3026 => 0.2853, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -5.72% (0.3481 => 0.3282, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.70% (0.2106 => 0.1986, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.69% (0.3057 => 0.2883, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.66% (0.3323 => 0.3135, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -5.65% (0.3255 => 0.3071, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.65% (0.2903 => 0.2739, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -5.63% (0.3446 => 0.3252, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.61% (0.4813 => 0.4543, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.61% (0.2871 => 0.2710, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.59% (0.2933 => 0.2769, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -5.59% (0.2989 => 0.2822, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.58% (0.4427 => 0.4180, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary: -5.57% (0.3394 => 0.3205, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -5.56% (0.4248 => 0.4012, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -5.55% (0.3205 => 0.3027, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -5.55% (0.3621 => 0.3420, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: -5.55% (0.2939 => 0.2776, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -5.53% (0.3867 => 0.3653, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.50% (2.1713 => 2.0518, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hello: -5.48% (0.2849 => 0.2693, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -5.46% (0.3788 => 0.3581, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -5.39% (0.3025 => 0.2862, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: -5.38% (0.3271 => 0.3095, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.37% (0.3016 => 0.2854, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.35% (0.3252 => 0.3078, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -5.33% (0.3059 => 0.2896, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: -5.32% (0.3194 => 0.3024, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -5.26% (0.8418 => 0.7975, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -5.15% (5.0226 => 4.7638, std.dev.: 0.0127) SingleSource/UnitTests/ObjC++/property-reference: -4.74% (0.7779 => 0.7410, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/Hello: -4.60% (0.6347 => 0.6055, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.58% (0.9077 => 0.8661, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference-object: -4.52% (0.6441 => 0.6150, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: -3.75% (1.5610 => 1.5024, std.dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -2.40% (20.7746 => 20.2764, std.dev.: 0.0731) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7567, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/richards_benchmark: -8.72% (1.2842 => 1.1722, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.91% (1.7753 => 1.7058, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: -3.80% (2.2633 => 2.1774, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0245, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.99% (1.3096 => 1.2835, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.65% (6.5735 => 6.4649, std.dev.: 0.0042) Report Time: 1.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 24 23:58:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 01:58:10 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121025065810.01A2C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5192?compare_to=5189&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5192, Order: 166662, Start Time: 2012-10-25 05:37:30, End Time: 2012-10-25 06:58:02 To: 5189, Order: 166661, Start Time: 2012-10-25 03:47:24, End Time: 2012-10-25 05:07:43 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (75 on baseline) New Passes: 0 (7 on baseline) Performance Regressions: 2 (199 on baseline) Performance Improvements: 4 (46 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 87 (12 on baseline) Unchanged Tests: 949 (641 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.65% (54.8492 => 56.3017, std.dev.: 0.1127) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.06% (1.0457 => 1.0568, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -5.88% (0.2449 => 0.2305, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -2.92% (15.7519 => 15.2922, std.dev.: 0.0102) MultiSource/Applications/JM/ldecod/ldecod: -2.25% (12.0750 => 11.8038, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.02% (5.9189 => 5.8588, std.dev.: 0.0061) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.33% (0.6307 => 0.6286, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: -0.56% (17.4063 => 17.3082, std.dev.: 0.0056) MultiSource/Applications/kimwitu++/kc: -0.33% (15.7982 => 15.7460, std.dev.: 0.0153) MultiSource/Benchmarks/Bullet/bullet: 0.03% (57.2449 => 57.2641, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.20% (0.0491 => 0.0492) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.41% (0.0493 => 0.0495, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.22% (0.0460 => 0.0461, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.22% (0.0462 => 0.0463, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.22% (0.0450 => 0.0451, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.44% (0.0451 => 0.0453, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.23% (0.0443 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.22% (0.0445 => 0.0446, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.22% (0.0462 => 0.0463, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.22% (0.0463 => 0.0464, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.22% (0.0456 => 0.0457, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.44% (0.0457 => 0.0459, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.22% (0.0445 => 0.0446, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.45% (0.0447 => 0.0449, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.44% (0.0453 => 0.0455, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.44% (0.0455 => 0.0457) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.22% (0.0465 => 0.0466, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.43% (0.0466 => 0.0468, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.45% (0.0441 => 0.0443) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.23% (0.0442 => 0.0443, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.22% (0.0453 => 0.0454, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.22% (0.0455 => 0.0456, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.23% (0.0444 => 0.0445, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.22% (0.0446 => 0.0447, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.46% (0.0436 => 0.0438) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.23% (0.0437 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.23% (0.0435 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.23% (0.0437 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.21% (0.0473 => 0.0474, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.21% (0.0474 => 0.0475, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.23% (0.0434 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.46% (0.0435 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.23% (0.0435 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.46% (0.0436 => 0.0438, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.23% (0.0443 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.45% (0.0444 => 0.0446) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.64% (8.3410 => 8.2877, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.32% (0.6954 => 0.6932, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1439 => 0.1439) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0648 => 0.0648, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.03% (0.3826 => 0.3827, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -9.45% (63.2438 => 57.2641, std.dev.: 0.0052) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/BenchmarkGame/puzzle MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.03% (0.6962 => 0.3827, std.dev.: 0.0010) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/MallocBench/gs/gs: 13.92% (4.1105 => 4.6825, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 43.60% (1.1048 => 1.5865, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 69.19% (3.4629 => 5.8588, std.dev.: 0.0061) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13504.86% (0.0720 => 9.7955, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050300.00% (0.0001 => 10.0504, std.dev.: 0.0005) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 69.53% (0.0256 => 0.0434) MultiSource/Benchmarks/McCat/08-main/main: 64.84% (0.2554 => 0.4210, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 51.03% (0.0243 => 0.0367, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 47.50% (10.3673 => 15.2922, std.dev.: 0.0102) SingleSource/Regression/C/sumarray2d: 43.91% (0.0271 => 0.0390, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 42.11% (0.1622 => 0.2305, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.51% (1.5859 => 2.2442, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/distray/distray: 36.84% (0.1056 => 0.1445, std.dev.: 0.0003) SingleSource/UnitTests/vla: 33.24% (0.0355 => 0.0473, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.78% (2.2024 => 2.8802, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: 28.16% (0.1463 => 0.1875, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 24.58% (0.0834 => 0.1039, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 24.35% (0.1655 => 0.2058, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.78% (0.1566 => 0.1907, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/hash: 21.24% (0.0485 => 0.0588, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 20.84% (0.2049 => 0.2476, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 20.60% (0.1432 => 0.1727, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.33% (7.0540 => 8.4882, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: 19.37% (2.2022 => 2.6287, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 19.04% (0.1555 => 0.1851, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.94% (0.0871 => 0.1036, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 18.59% (0.5105 => 0.6054, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.05% (0.6675 => 0.7880, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 17.64% (0.1440 => 0.1694, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.40% (0.1029 => 0.1208, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 17.28% (0.1175 => 0.1378, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.28% (0.0793 => 0.0930, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: 17.09% (0.0626 => 0.0733, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.06% (1.3050 => 1.5276, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 16.78% (3.3354 => 3.8952, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/em3d/em3d: 16.76% (0.1695 => 0.1979, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.73% (0.2271 => 0.2651, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 16.68% (0.1163 => 0.1357, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.60% (0.3121 => 0.3639, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.54% (0.8172 => 0.9524, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.38% (0.4615 => 0.5371, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.14% (0.0886 => 0.1029, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.09% (0.1032 => 0.1198, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 16.08% (0.1337 => 0.1552, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.92% (0.5020 => 0.5819, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 15.91% (0.7115 => 0.8247, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.74% (1.5415 => 1.7842, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.70% (0.1510 => 0.1747, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 15.64% (0.4879 => 0.5642, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 15.57% (0.3282 => 0.3793, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.57% (0.1940 => 0.2242, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.56% (0.0842 => 0.0973, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.43% (0.0648 => 0.0748, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.41% (0.0675 => 0.0779, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 15.34% (0.3109 => 0.3586, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout/matrix: 15.28% (0.0818 => 0.0943, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 15.18% (0.0672 => 0.0774, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.13% (0.1117 => 0.1286, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 15.06% (8.1363 => 9.3615, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.94% (0.0770 => 0.0885, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 14.93% (1.1642 => 1.3380, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 14.93% (0.3423 => 0.3934, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 14.83% (0.3177 => 0.3648, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.82% (0.9765 => 1.1212, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.81% (0.2107 => 0.2419, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.80% (0.0838 => 0.0962, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.72% (0.2758 => 0.3164, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.65% (4.2646 => 4.8892, std.dev.: 0.0090) MultiSource/Benchmarks/mafft/pairlocalalign: 14.61% (9.4845 => 10.8700, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.58% (0.2065 => 0.2366, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.54% (1.7609 => 2.0170, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 14.53% (0.1438 => 0.1647, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 14.53% (0.1906 => 0.2183, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 14.42% (0.1151 => 0.1317, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.42% (0.5860 => 0.6705, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.41% (0.5981 => 0.6843, std.dev.: 0.0027) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.39% (0.1584 => 0.1812, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/exptree: 14.37% (0.0814 => 0.0931, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.34% (0.0746 => 0.0853, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.34% (0.6450 => 0.7375, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.32% (0.1236 => 0.1413, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 14.28% (0.7835 => 0.8954, std.dev.: 0.0025) SingleSource/UnitTests/SignlessTypes/rem: 14.25% (0.1144 => 0.1307, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.22% (0.2700 => 0.3084, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 14.11% (0.0730 => 0.0833) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.04% (0.0933 => 0.1064, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.04% (0.0798 => 0.0910, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.03% (0.1062 => 0.1211, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 14.03% (1.4186 => 1.6176, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.98% (0.1695 => 0.1932, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 13.90% (2.0273 => 2.3090, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.77% (0.0770 => 0.0876, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 13.74% (0.7433 => 0.8454, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 13.65% (1.1840 => 1.3456, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 13.60% (5.7591 => 6.5424, std.dev.: 0.0116) MultiSource/Applications/lua/lua: 13.56% (3.8723 => 4.3974, std.dev.: 0.0089) MultiSource/Benchmarks/Olden/health/health: 13.41% (0.1268 => 0.1438, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 13.40% (0.3387 => 0.3841, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.39% (0.8067 => 0.9147, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 13.35% (4.9449 => 5.6051, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.34% (0.3307 => 0.3748, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.33% (7.9617 => 9.0227, std.dev.: 0.0029) MultiSource/Applications/lemon/lemon: 13.32% (1.0722 => 1.2150, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.26% (5.0018 => 5.6652, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 13.25% (1.5603 => 1.7671, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.14% (0.5569 => 0.6301, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 13.11% (10.4361 => 11.8038, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.05% (0.1625 => 0.1837, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.81% (0.0929 => 0.1048, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 12.80% (0.3180 => 0.3587, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 12.72% (0.4299 => 0.4846, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.72% (0.2603 => 0.2934, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 12.71% (0.3092 => 0.3485, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.71% (0.1330 => 0.1499, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.67% (1.1861 => 1.3364, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.67% (0.3441 => 0.3877, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/football/football: 12.39% (0.8921 => 1.0026, std.dev.: 0.0190) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 12.36% (0.1125 => 0.1264, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: 12.30% (0.6456 => 0.7250, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.07% (0.1143 => 0.1281, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.05% (0.8101 => 0.9077, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.83% (0.2266 => 0.2534, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.52% (1.1194 => 1.2483, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.31% (0.1892 => 0.2106, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 11.19% (0.4289 => 0.4769, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.18% (0.3543 => 0.3939, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 11.06% (0.4620 => 0.5131, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 10.93% (2.2969 => 2.5480, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 10.86% (0.3473 => 0.3850, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.80% (0.3927 => 0.4351, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.73% (0.3543 => 0.3923, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.63% (0.3865 => 0.4276, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.56% (0.3561 => 0.3937, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.53% (0.3694 => 0.4083, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.52% (0.3516 => 0.3886) SingleSource/UnitTests/ObjC/exceptions-2: 10.52% (0.3497 => 0.3865, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 10.52% (0.3422 => 0.3782, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.40% (0.3828 => 0.4226, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 10.39% (21.9371 => 24.2169, std.dev.: 0.0124) SingleSource/UnitTests/ObjC/property: 10.37% (0.3886 => 0.4289, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.34% (0.1044 => 0.1152, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.28% (0.4203 => 0.4635, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 10.23% (0.3684 => 0.4061, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.02% (0.4103 => 0.4514, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 9.96% (0.4048 => 0.4451, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.88% (0.4636 => 0.5094, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 9.38% (0.3603 => 0.3941, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.25% (0.3427 => 0.3744, std.dev.: 0.0087) SingleSource/UnitTests/ObjC++/property-reference: 9.21% (0.7326 => 0.8001, std.dev.: 0.0057) SingleSource/UnitTests/ObjC++/Hello: 9.18% (0.5925 => 0.6469, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.12% (0.3826 => 0.4175, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.05% (0.2430 => 0.2650, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.97% (0.6030 => 0.6571, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.96% (0.3650 => 0.3977, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 8.94% (0.2831 => 0.3084, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 8.90% (17.1811 => 18.7107, std.dev.: 0.0184) SingleSource/Benchmarks/Shootout-C++/matrix: 8.75% (0.3098 => 0.3369, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.72% (0.2891 => 0.3143, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.69% (0.4064 => 0.4417, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 8.66% (0.3232 => 0.3512, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 8.65% (0.3283 => 0.3567, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.51% (0.3136 => 0.3403, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 8.50% (0.2905 => 0.3152, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.48% (0.3162 => 0.3430, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.40% (14.3668 => 15.5730, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.38% (0.2756 => 0.2987, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.37% (2.0665 => 2.2394, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: 8.32% (0.2871 => 0.3110, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.18% (0.2872 => 0.3107, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 8.17% (0.2877 => 0.3112, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.16% (0.2793 => 0.3021, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 8.15% (0.2725 => 0.2947, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.12% (3.8922 => 4.2081, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/wc: 8.03% (0.3052 => 0.3297, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 7.99% (0.3379 => 0.3649, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.92% (0.2714 => 0.2929, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 7.82% (0.2802 => 0.3021, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.24% (1.2842 => 1.3772, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 6.83% (0.3131 => 0.3345, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.02% (0.3935 => 0.4093, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.96% (0.3817 => 0.3930, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1726) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.64% (0.9957 => 1.1315, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.95% (1.1396 => 1.2530, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.1578 => 3.3688, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.64% (2.8904 => 3.0823, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 3.81% (1.9405 => 2.0145, std.dev.: 0.0137) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.79% (4.2280 => 4.3461, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.71% (0.3987 => 0.4095, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.88% (0.8333 => 0.8490, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.74% (3.6395 => 3.7027, std.dev.: 0.0077) MultiSource/Applications/aha/aha: 1.51% (3.1595 => 3.2072, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.50% (11.6436 => 11.8183, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.39% (2.6546 => 2.6916, std.dev.: 0.0021) MultiSource/Applications/viterbi/viterbi: 1.17% (4.4649 => 4.5172, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.99% (6.6874 => 0.1345, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -77.14% (0.8651 => 0.1978, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -36.83% (5.2763 => 3.3328, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.33% (5.3855 => 3.7519, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -29.94% (5.3526 => 3.7501, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -9.41% (54.1659 => 49.0662, std.dev.: 0.0162) MultiSource/Applications/ClamAV/clamscan: -2.46% (22.1758 => 21.6294, std.dev.: 0.0253) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -52.84% (8.0499 => 3.7965, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7652, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4750, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.90% (1.6925 => 1.4234, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.68% (1.2258 => 1.0704, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.32% (1.2373 => 1.0972, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: -10.88% (1.5373 => 1.3700, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.26% (19.9488 => 18.3008, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/mason/mason: -8.01% (0.2161 => 0.1988, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.06% (1.8329 => 1.7035, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5757, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.17% (1.6805 => 1.5937, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) SingleSource/Benchmarks/Misc/flops-5: -4.91% (1.5835 => 1.5058, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.32% (8.1563 => 7.8040, std.dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.73% (1.3677 => 1.3167, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.68% (3.2827 => 3.1619, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -3.37% (5.0483 => 4.8781, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4984, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.60% (0.4808 => 0.4683, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Applications/sqlite3/sqlite3: -2.11% (4.6441 => 4.5460, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -1.87% (10.2830 => 10.0912, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6807, std.dev.: 0.0015) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5093, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -1.64% (1.1277 => 1.1092) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4211, std.dev.: 0.0055) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.12% (2.3135 => 2.2877, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8589, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout/lists: -1.01% (6.2999 => 6.2360, std.dev.: 0.0066) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 20.21% (0.5229 => 0.6286, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 15.47% (14.9895 => 17.3082, std.dev.: 0.0056) MultiSource/Applications/kimwitu++/kc: 11.24% (14.1553 => 15.7460, std.dev.: 0.0153) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 15.78% (7.1582 => 8.2877, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.41% (0.6222 => 0.6932, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.10% (0.1485 => 0.1439) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 00:08:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 02:08:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121025070815.0D7742A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5193?compare_to=5180&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5193, Order: 166661, Start Time: 2012-10-25 03:50:41, End Time: 2012-10-25 07:08:08 To: 5180, Order: 166607, Start Time: 2012-10-24 19:41:55, End Time: 2012-10-24 22:57:26 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (167 on baseline) Performance Improvements: 5 (20 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1036 (721 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.47% (111.4441 => 118.6580, std.dev.: 0.0234) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -1.60% (1.1457 => 1.1274, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.20% (2.4147 => 2.3857, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -1.19% (1.1555 => 1.1418, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: -1.11% (2.4765 => 2.4489, std.dev.: 0.0074) MultiSource/Applications/sqlite3/sqlite3: -1.03% (2.2452 => 2.2221, std.dev.: 0.0003) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.48% (0.0625 => 0.0878, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.70% (0.1063 => 0.1400, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.04% (0.2969 => 0.3742, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.41% (0.1106 => 0.1387, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.31% (0.4139 => 0.5145, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.80% (0.5900 => 0.7304, std.dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 23.74% (1.5932 => 1.9715, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.37% (0.4253 => 0.5247, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.29% (0.4994 => 0.6157, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.16% (0.0475 => 0.0585, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.11% (0.0714 => 0.0879, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.03% (0.0547 => 0.0673, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.95% (0.0584 => 0.0718, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.60% (0.5000 => 0.6130, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.19% (0.0897 => 0.1096, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.04% (0.1620 => 0.1977, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 21.70% (0.0599 => 0.0729, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.65% (0.1021 => 0.1242, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.23% (0.1107 => 0.1342, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 20.57% (0.0948 => 0.1143, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.54% (0.0633 => 0.0763, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.40% (0.0642 => 0.0773, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.22% (0.1103 => 0.1326, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.21% (0.0584 => 0.0702, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.15% (0.0541 => 0.0650, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.11% (0.3903 => 0.4688, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/health/health: 19.98% (0.0821 => 0.0985, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.95% (0.1604 => 0.1924, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.88% (0.1549 => 0.1857, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.84% (0.1003 => 0.1202, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 19.77% (0.1619 => 0.1939, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 19.70% (0.0604 => 0.0723, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.34% (0.0822 => 0.0981, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 18.69% (0.0947 => 0.1124, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.67% (0.1462 => 0.1735, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.46% (0.3890 => 0.4608, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/Hello: 18.30% (0.5826 => 0.6892, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 18.19% (0.0808 => 0.0955, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 18.14% (0.1218 => 0.1439, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.97% (0.2014 => 0.2376, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: 17.97% (0.5889 => 0.6947, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 17.81% (0.1505 => 0.1773, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.80% (0.2736 => 0.3223, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 17.77% (0.4029 => 0.4745, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/mst/mst: 17.34% (0.0698 => 0.0819, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.31% (1.3152 => 1.5429, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.28% (0.1088 => 0.1276, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.03% (0.2866 => 0.3354, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 16.88% (0.5546 => 0.6482, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 16.84% (1.8794 => 2.1958, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.72% (0.1160 => 0.1354, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.69% (3.5627 => 4.1574, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.56% (0.2875 => 0.3351, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.47% (0.2738 => 0.3189, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.41% (0.1968 => 0.2291, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.32% (1.6211 => 1.8856, std.dev.: 0.0020) MultiSource/Applications/hbd/hbd: 16.26% (0.9697 => 1.1274, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.25% (0.4658 => 0.5415, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference: 16.19% (0.7171 => 0.8332, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.02% (0.3271 => 0.3795, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 15.97% (0.1421 => 0.1648, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 15.88% (0.2714 => 0.3145, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 15.85% (0.2725 => 0.3157, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.78% (0.5026 => 0.5819, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.72% (0.2729 => 0.3158, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 15.68% (0.3004 => 0.3475, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 15.64% (0.2750 => 0.3180, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 15.63% (1.0781 => 1.2466, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 15.59% (0.2823 => 0.3263, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 15.58% (0.2780 => 0.3213, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.52% (0.3195 => 0.3691, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.52% (0.4361 => 0.5038, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/except: 15.51% (0.2811 => 0.3247, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.51% (0.2792 => 0.3225, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.48% (2.7292 => 3.1516, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 15.45% (0.2803 => 0.3236, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 15.41% (0.3096 => 0.3573, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.40% (2.0673 => 2.3857, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 15.39% (0.2813 => 0.3246, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.34% (0.3930 => 0.4533, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.34% (4.4195 => 5.0976, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.29% (0.2911 => 0.3356, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 15.26% (0.1284 => 0.1480, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 15.23% (0.9909 => 1.1418, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 15.15% (4.2109 => 4.8489, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary3: 15.12% (0.3267 => 0.3761, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.08% (1.9694 => 2.2663, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 14.97% (23.5202 => 27.0414, std.dev.: 0.6851) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.96% (1.9966 => 2.2953, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 14.86% (0.3258 => 0.3742, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 14.83% (0.3317 => 0.3809, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.78% (0.3362 => 0.3859, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.67% (0.3060 => 0.3509, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.50% (0.1090 => 0.1248, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.37% (0.3124 => 0.3573, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.29% (0.3282 => 0.3751, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 14.16% (0.3348 => 0.3822, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 14.08% (0.3678 => 0.4196, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 14.01% (0.3726 => 0.4248, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 13.86% (0.3477 => 0.3959, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 13.86% (1.4269 => 1.6246, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.85% (0.3625 => 0.4127, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 13.83% (0.2075 => 0.2362, std.dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 13.80% (0.2566 => 0.2920, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 13.78% (0.4251 => 0.4837, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.73% (0.3496 => 0.3976, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 13.67% (0.3446 => 0.3917, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 13.65% (0.4146 => 0.4712, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 13.65% (0.3465 => 0.3938, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.65% (0.3488 => 0.3964, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.63% (0.3690 => 0.4193, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.61% (0.3981 => 0.4523, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 13.61% (0.3469 => 0.3941, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 13.55% (0.3460 => 0.3929, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 13.54% (0.3442 => 0.3908, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 13.31% (0.7875 => 0.8923, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 13.26% (0.3650 => 0.4134, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.24% (0.3845 => 0.4354, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: 13.21% (0.3724 => 0.4216, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 13.10% (2.1653 => 2.4489, std.dev.: 0.0074) SingleSource/UnitTests/ObjC/exceptions: 13.09% (0.3643 => 0.4120, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 12.99% (0.5012 => 0.5663, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 12.99% (4.6177 => 5.2174, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 12.29% (2.1013 => 2.3596, std.dev.: 0.0734) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.25% (0.2040 => 0.2290, std.dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: 11.78% (0.2691 => 0.3008, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.56% (0.6435 => 0.7179, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 11.54% (5.5417 => 6.1814, std.dev.: 0.0159) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.38% (0.1028 => 0.1145, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 11.12% (0.3498 => 0.3887, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.85% (0.2737 => 0.3034, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.83% (0.2068 => 0.2292, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: 10.34% (0.3336 => 0.3681, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.34% (0.1383 => 0.1526, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.31% (0.3084 => 0.3402, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 10.28% (0.6634 => 0.7316, std.dev.: 0.0076) MultiSource/Benchmarks/PAQ8p/paq8p: 10.15% (0.4847 => 0.5339, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.84% (0.2103 => 0.2310, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 9.22% (2.0346 => 2.2221, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.06% (4.6926 => 5.1178, std.dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.64% (0.5361 => 0.5824, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.52% (11.6398 => 12.6311, std.dev.: 0.2107) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.83% (0.5584 => 0.6021, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.76% (0.7426 => 0.8002, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 6.77% (11.9555 => 12.7652, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.43% (0.3792 => 0.3960, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6535, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.25% (0.5917 => 0.6701, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 8.85% (0.2802 => 0.3050, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6099, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 5.07% (12.0509 => 12.6613, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1642, std.dev.: 0.0141) SingleSource/Benchmarks/Misc/flops-2: 3.72% (1.8057 => 1.8728, std.dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/dry: 2.73% (14.0481 => 14.4312, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2096, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.62% (3.1722 => 3.2236, std.dev.: 0.0028) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3051, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2863, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.25% (1.0927 => 1.1064, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5128, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5402, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5927, std.dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.15% (2.4764 => 2.4480, std.dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.51% (25.4195 => 16.3942, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/ary2: -9.70% (0.2402 => 0.2169, std.dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9780, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -7.67% (35.5013 => 32.7766, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2420, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.43% (11.2080 => 10.8231, std.dev.: 0.0283) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.04% (0.6293 => 0.6102, std.dev.: 0.0068) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7746, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5216, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.34% (17.2379 => 16.8348, std.dev.: 0.0216) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.19% (41.7953 => 40.8789, std.dev.: 0.3013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5705, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4948, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7160, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.14% (21.9346 => 21.6848, std.dev.: 0.0584) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.06% (3.3991 => 3.3631, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0447, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.05% (105.3826 => 104.2711, std.dev.: 0.0342) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 00:11:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 02:11:23 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121025071123.917642A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5194?compare_to=5190&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5194, Order: 166662, Start Time: 2012-10-25 05:47:26, End Time: 2012-10-25 07:11:19 To: 5190, Order: 166661, Start Time: 2012-10-25 04:06:12, End Time: 2012-10-25 05:30:11 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 5 (46 on baseline) Performance Improvements: 4 (3 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 966 (925 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.98% (0.3023 => 0.3234, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: 3.09% (0.5089 => 0.5246, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/richards_benchmark: 1.68% (1.2918 => 1.3135, std.dev.: 0.0079) MultiSource/Applications/SIBsim4/SIBsim4: 1.35% (3.1854 => 3.2285, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/ReedSolomon: 1.24% (8.7142 => 8.8226, std.dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: -4.64% (0.3296 => 0.3143, std.dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: -5.54% (0.2095 => 0.1979, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.23% (1.1102 => 1.0966, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: -1.12% (16.8915 => 16.7029, std.dev.: 0.0305) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.95% (16.6152 => 16.4571, std.dev.: 0.0327) MultiSource/Applications/obsequi/Obsequi: -0.95% (1.0711 => 1.0609, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: 0.30% (0.6368 => 0.6387, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/08-main/main: -0.05% (0.1963 => 0.1962, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.70% (0.1649 => 0.1677, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.59% (0.3160 => 0.3242, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.24% (0.2480 => 0.2486, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.77% (0.3251 => 0.3341, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.08% (0.2414 => 0.2416, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 0.15% (0.5948 => 0.5957, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel: -0.89% (0.0448 => 0.0444, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.34% (0.3281 => 0.3292, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.1984 => 0.1984, std.dev.: 0.0027) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -28.86% (0.0246 => 0.0175, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -17.99% (0.0189 => 0.0155, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.66% (0.0421 => 0.0428, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 14.18% (0.0275 => 0.0314, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.90% (0.0420 => 0.0428, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 2.49% (0.0201 => 0.0206, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -13.95% (0.0215 => 0.0185, std.dev.: 0.0018) SingleSource/UnitTests/byval-alignment: 9.03% (0.0277 => 0.0302, std.dev.: 0.0029) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 62.50% (0.0008 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 0.88% (0.1473 => 0.1486, std.dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 1.00% (1.1298 => 1.1411, std.dev.: 0.0482) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.40% (0.1471 => 0.1521, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.15% (0.4131 => 0.4042, std.dev.: 0.0166) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.37% (0.1396 => 0.1335, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.53% (0.0611 => 0.0657, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.84% (0.0272 => 0.0277, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.10% (0.0544 => 0.0538, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.03% (1.1431 => 1.1427, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -69.23% (0.0026 => 0.0008, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.39% (0.0575 => 0.0629, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 13.62% (0.0235 => 0.0267) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.05% (0.8023 => 0.7939, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 112.20% (0.0041 => 0.0087, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.96% (2.1832 => 1.6602, std.dev.: 0.0054) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.80% (0.0810 => 0.0938, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 12.77% (0.1112 => 0.1254, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.80% (0.2180 => 0.2350, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.63% (0.8321 => 0.8956, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.10% (0.4847 => 0.5191, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.42% (0.6010 => 0.6396, std.dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.09% (0.3137 => 0.3328, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.77% (0.2998 => 0.3171, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.57% (0.2279 => 0.2406, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.30% (0.1905 => 0.2006, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.07% (0.8148 => 0.8561, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.96% (0.7473 => 0.7844, std.dev.: 0.0099) MultiSource/Applications/hbd/hbd: 4.81% (1.4269 => 1.4955, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.63% (0.6287 => 0.6515, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.60% (0.4783 => 0.4955, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.52% (0.3717 => 0.3848, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.46% (0.3295 => 0.3409, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.16% (1.1685 => 1.2054, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.55% (0.5961 => 0.6113, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.51% (0.5817 => 0.5963, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/gs/gs: 2.29% (4.1305 => 4.2249, std.dev.: 0.0250) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.17% (4.1763 => 4.2669, std.dev.: 0.0165) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.13% (4.4873 => 4.5831, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.91% (0.8007 => 0.8160, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.88% (1.6386 => 1.6694, std.dev.: 0.0107) MultiSource/Benchmarks/nbench/nbench: 1.85% (1.1271 => 1.1480, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.74% (0.8611 => 0.8761, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.73% (1.4479 => 1.4730, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.71% (1.1170 => 1.1361, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.69% (13.1811 => 13.4043, std.dev.: 0.0357) MultiSource/Applications/hexxagon/hexxagon: 1.69% (0.9810 => 0.9976, std.dev.: 0.0051) MultiSource/Applications/lua/lua: 1.57% (3.8189 => 3.8789, std.dev.: 0.0217) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.55% (0.8066 => 0.8191, std.dev.: 0.0041) MultiSource/Applications/SPASS/SPASS: 1.51% (14.2605 => 14.4761, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.41% (0.8855 => 0.8980, std.dev.: 0.0036) MultiSource/Applications/d/make_dparser: 1.36% (3.2366 => 3.2805, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.19% (1.2423 => 1.2571, std.dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.79% (1.5795 => 2.5081, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.48% (0.3186 => 0.3488, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.21% (1.1857 => 1.2831, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 5.96% (63.1822 => 66.9508, std.dev.: 0.0328) SingleSource/Benchmarks/Misc/ReedSolomon: 3.40% (8.5322 => 8.8226, std.dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/dry: 3.25% (0.5081 => 0.5246, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 2.59% (3.6643 => 3.7592, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: 1.63% (2.3560 => 2.3943, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 1.29% (3.1873 => 3.2285, std.dev.: 0.0110) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -5.23% (29.8330 => 28.2731, std.dev.: 0.0506) SingleSource/Benchmarks/Shootout-C++/hash2: -1.62% (3.4237 => 3.3681, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.50% (3.3479 => 3.2978, std.dev.: 0.0050) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.07% (16.4461 => 16.4571, std.dev.: 0.0327) MultiSource/Applications/obsequi/Obsequi: 3.38% (1.0262 => 1.0609, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: 0.87% (0.6332 => 0.6387, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/08-main/main: 7.15% (0.1831 => 0.1962, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.57% (0.1559 => 0.1677, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.81% (0.3123 => 0.3242, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.93% (0.2463 => 0.2486, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.09% (0.3344 => 0.3341, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.20% (0.2364 => 0.2416, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -0.88% (0.6010 => 0.5957, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel: 3.50% (0.0429 => 0.0444, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.80% (0.3266 => 0.3292, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 0.76% (0.1969 => 0.1984, std.dev.: 0.0027) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -21.87% (0.0224 => 0.0175, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 26.02% (0.0123 => 0.0155, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.46% (0.0384 => 0.0428, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 8.42% (0.0190 => 0.0206, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 2.78% (0.0180 => 0.0185, std.dev.: 0.0018) SingleSource/UnitTests/byval-alignment: 31.30% (0.0230 => 0.0302, std.dev.: 0.0029) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 3.34% (0.1438 => 0.1486, std.dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.72% (1.1329 => 1.1411, std.dev.: 0.0482) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 4.04% (0.1462 => 0.1521, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.93% (0.4164 => 0.4042, std.dev.: 0.0166) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.48% (0.1369 => 0.1335, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.50% (0.0641 => 0.0657, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.92% (0.0578 => 0.0538, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.09% (1.1437 => 1.1427, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -42.86% (0.0014 => 0.0008, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.32% (0.0627 => 0.0629, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.33% (0.0180 => 0.0267) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.97% (0.8017 => 0.7939, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 40.32% (0.0062 => 0.0087, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 1.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 01:24:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 03:24:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121025082456.60B5A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5195?compare_to=5191&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5195, Order: 166664, Start Time: 2012-10-25 06:57:48, End Time: 2012-10-25 08:24:49 To: 5191, Order: 166662, Start Time: 2012-10-25 05:09:09, End Time: 2012-10-25 06:33:59 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (174 on baseline) Unchanged Tests: 1042 (864 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: 2.91% (7.4937 => 7.7117, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.55% (2.0478 => 2.1000, std.dev.: 0.0196) SingleSource/Benchmarks/Shootout-C++/hash2: 2.11% (3.1932 => 3.2605, std.dev.: 0.0247) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.15% (0.1431 => 0.1300, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -7.62% (2.4924 => 2.3025, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.48% (0.3821 => 0.3535, std.dev.: 0.0031) MultiSource/Applications/sgefa/sgefa: -7.39% (0.3357 => 0.3109, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.35% (22.4056 => 20.7595, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -7.25% (3.5339 => 3.2778, std.dev.: 0.0724) SingleSource/UnitTests/ObjC/exceptions-2: -7.13% (0.3831 => 0.3558, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -7.12% (0.3848 => 0.3574, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -7.11% (0.3880 => 0.3604, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -7.11% (0.3812 => 0.3541, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.11% (0.3884 => 0.3608, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: -7.05% (0.9179 => 0.8532, std.dev.: 0.0050) MultiSource/Applications/JM/lencod/lencod: -7.04% (16.1920 => 15.0514, std.dev.: 0.0147) SingleSource/Benchmarks/McGill/chomp: -7.04% (0.1761 => 0.1637, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/oourafft: -7.04% (0.2160 => 0.2008, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/synchronized: -7.03% (0.3896 => 0.3622, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -7.02% (0.4176 => 0.3883, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -6.97% (0.4033 => 0.3752, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.96% (0.3891 => 0.3620, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.96% (0.9542 => 0.8878, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.94% (0.3142 => 0.2924, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.92% (0.3658 => 0.3405, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -6.89% (7.0961 => 6.6070, std.dev.: 0.0089) MultiSource/Benchmarks/mafft/pairlocalalign: -6.86% (9.2283 => 8.5948, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.85% (0.1796 => 0.1673, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/property: -6.83% (0.4199 => 0.3912, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.83% (0.9852 => 0.9179, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -6.82% (0.4280 => 0.3988, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.82% (0.1584 => 0.1476, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.2695 => 0.2512, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -6.75% (1.1450 => 1.0677, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: -6.75% (4.3330 => 4.0407, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.73% (1.0544 => 0.9834, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: -6.73% (0.1500 => 0.1399, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.71% (6.7716 => 6.3171, std.dev.: 0.0129) MultiSource/Applications/siod/siod: -6.70% (2.4021 => 2.2411, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.70% (1.3722 => 1.2803, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: -6.69% (0.2659 => 0.2481, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.68% (1.4642 => 1.3664, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.67% (0.2548 => 0.2378, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -6.66% (1.2515 => 1.1682, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/ReedSolomon: -6.65% (0.1879 => 0.1754, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.64% (0.1716 => 0.1602, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.62% (5.4682 => 5.1063, std.dev.: 0.1198) MultiSource/Benchmarks/Olden/bh/bh: -6.57% (0.2985 => 0.2789, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: -6.53% (1.3148 => 1.2289, std.dev.: 0.0105) MultiSource/Benchmarks/nbench/nbench: -6.53% (1.1530 => 1.0777, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.53% (2.2587 => 2.1112, std.dev.: 0.0493) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.52% (0.6484 => 0.6061, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.52% (1.2300 => 1.1498, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.51% (4.5069 => 4.2134, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.49% (1.2784 => 1.1954, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.46% (0.3837 => 0.3589, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: -6.42% (0.1621 => 0.1517, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.40% (4.8161 => 4.5077, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.39% (0.3931 => 0.3680, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.38% (4.8802 => 4.5690, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -6.37% (0.3406 => 0.3189, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.36% (0.6304 => 0.5903, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -6.36% (0.4515 => 0.4228, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.35% (0.5478 => 0.5130, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.35% (4.0323 => 3.7764, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -6.35% (0.5705 => 0.5343, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.34% (0.3849 => 0.3605, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.34% (0.6297 => 0.5898, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -6.34% (0.4861 => 0.4553, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.33% (0.5925 => 0.5550, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -6.33% (34.0927 => 31.9353, std.dev.: 0.0288) SingleSource/Benchmarks/Shootout-C++/lists: -6.32% (0.3621 => 0.3392, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.31% (0.7919 => 0.7419, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: -6.31% (0.3581 => 0.3355, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: -6.31% (0.2933 => 0.2748, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/random: -6.29% (0.2939 => 0.2754, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.29% (0.5863 => 0.5494, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: -6.29% (15.5079 => 14.5325, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.29% (0.5805 => 0.5440, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -6.28% (4.0594 => 3.8044, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.28% (0.7339 => 0.6878, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -6.28% (0.6230 => 0.5839, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.27% (0.4083 => 0.3827, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/ary3: -6.27% (0.3446 => 0.3230, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.26% (0.5859 => 0.5492, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: -6.24% (0.7447 => 0.6982, std.dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: -6.24% (18.2933 => 17.1513, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.24% (0.6395 => 0.5996, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: -6.24% (0.9557 => 0.8961, std.dev.: 0.0225) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.21% (0.6260 => 0.5871, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.21% (2.1713 => 2.0364, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary2: -6.21% (0.3481 => 0.3265, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.19% (0.5591 => 0.5245, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -6.19% (0.5575 => 0.5230, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: -6.19% (0.3491 => 0.3275, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -6.19% (0.6660 => 0.6248, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.18% (14.2083 => 13.3299, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -6.18% (0.7524 => 0.7059, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.18% (0.2428 => 0.2278, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -6.18% (0.2849 => 0.2673, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.15% (0.6736 => 0.6322, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.14% (0.5802 => 0.5446, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.13% (0.6052 => 0.5681, std.dev.: 0.0113) MultiSource/Applications/sqlite3/sqlite3: -6.13% (17.1032 => 16.0550, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -6.12% (0.5569 => 0.5228, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: -6.12% (0.4524 => 0.4247, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/moments: -6.12% (0.4248 => 0.3988, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -6.11% (0.6395 => 0.6004, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -6.11% (0.3255 => 0.3056, std.dev.: 0.0030) MultiSource/Applications/SIBsim4/SIBsim4: -6.11% (1.3864 => 1.3017, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: -6.11% (3.5154 => 3.3007, std.dev.: 0.0117) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.10% (0.4916 => 0.4616, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -6.09% (2.1401 => 2.0098, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.09% (0.3483 => 0.3271, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.09% (0.6194 => 0.5817, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.08% (0.6446 => 0.6054, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.07% (0.5581 => 0.5242, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.07% (0.2355 => 0.2212, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: -6.07% (0.3788 => 0.3558, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/fibo: -6.06% (0.2871 => 0.2697, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/wc: -6.05% (0.3205 => 0.3011, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/lists1: -6.05% (0.3867 => 0.3633, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/methcall: -6.05% (0.3025 => 0.2842, std.dev.: 0.0032) MultiSource/Applications/ClamAV/clamscan: -6.04% (15.2527 => 14.3312, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.03% (1.6364 => 1.5377, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.03% (0.5688 => 0.5345, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.03% (0.3252 => 0.3056, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.03% (0.5857 => 0.5504, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -6.02% (0.6676 => 0.6274, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.00% (0.4813 => 0.4524, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.99% (0.6293 => 0.5916, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.99% (0.5329 => 0.5010, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.98% (0.6667 => 0.6268, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.98% (0.5567 => 0.5234, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.96% (0.5570 => 0.5238, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.96% (0.5941 => 0.5587, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.93% (0.5849 => 0.5502, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.93% (0.6681 => 0.6285, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: -5.92% (0.3059 => 0.2878, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.92% (0.6440 => 0.6059, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.90% (0.2999 => 0.2822, std.dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: -5.90% (0.7982 => 0.7511, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.90% (0.3323 => 0.3127, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.90% (0.6189 => 0.5824, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.89% (0.2106 => 0.1982, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.87% (8.0126 => 7.5426, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.82% (0.6033 => 0.5682, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.74% (0.4321 => 0.4073, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.74% (0.5456 => 0.5143, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.72% (0.3319 => 0.3129, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.70% (0.3016 => 0.2844, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/objinst: -5.67% (0.3194 => 0.3013, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/09-vor/vor: -5.66% (0.3271 => 0.3086, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.61% (0.8521 => 0.8043, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.60% (1.2221 => 1.1537, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.53% (1.2210 => 1.1535, std.dev.: 0.0037) SingleSource/UnitTests/ObjC++/property-reference: -5.46% (0.7779 => 0.7354, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.45% (0.5999 => 0.5672, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: -5.44% (0.6347 => 0.6002, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: -5.43% (0.8418 => 0.7961, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: -5.37% (0.6441 => 0.6095, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.10% (0.7198 => 0.6831, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.05% (0.2278 => 0.2163, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.00% (0.2001 => 0.1901, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.95% (0.2385 => 0.2267, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: -4.79% (5.0226 => 4.7821, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.64% (0.9077 => 0.8656, std.dev.: 0.0026) MultiSource/Applications/hbd/hbd: -3.93% (1.5610 => 1.4997, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -2.27% (20.7746 => 20.3023, std.dev.: 0.0358) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.35% (7.5137 => 5.7596, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1728, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/fbench: -3.93% (2.2633 => 2.1743, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.83% (1.7753 => 1.7073, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.56% (6.5735 => 6.4711, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/lists: -1.18% (6.2463 => 6.1728, std.dev.: 0.0273) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 01:51:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 03:51:48 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121025085148.74BED2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5196?compare_to=5194&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5196, Order: 166664, Start Time: 2012-10-25 07:28:20, End Time: 2012-10-25 08:51:44 To: 5194, Order: 166662, Start Time: 2012-10-25 05:47:26, End Time: 2012-10-25 07:11:19 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 5 (30 on baseline) Performance Improvements: 7 (6 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 963 (938 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.51% (0.0755 => 0.0857, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.71% (0.7567 => 0.7848, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.21% (58.9113 => 60.8029, std.dev.: 0.3878) SingleSource/Benchmarks/McGill/chomp: 1.40% (1.1104 => 1.1259, std.dev.: 0.0057) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.19% (2.5552 => 2.5857, std.dev.: 0.0070) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -4.55% (0.5191 => 0.4955, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.29% (1.2112 => 1.1835, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.24% (0.6113 => 0.5976, std.dev.: 0.0046) SingleSource/UnitTests/Vector/constpool: -2.08% (8.6910 => 8.5099, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.34% (0.9943 => 0.9810, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: -1.48% (3.2285 => 3.1806, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.01% (1.6085 => 1.5922, std.dev.: 0.0038) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.53% (16.4571 => 16.5444, std.dev.: 0.0672) MultiSource/Applications/obsequi/Obsequi: -0.99% (1.0609 => 1.0504, std.dev.: 0.0131) MultiSource/Applications/sqlite3/sqlite3: 0.31% (0.6387 => 0.6407, std.dev.: 0.0126) MultiSource/Benchmarks/McCat/08-main/main: -5.45% (0.1962 => 0.1855, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.48% (0.1677 => 0.1669, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.78% (0.3242 => 0.3152, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.89% (0.2486 => 0.2439, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.15% (0.3341 => 0.3336, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.86% (0.2416 => 0.2347, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: 0.15% (0.5957 => 0.5966, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/mandel: 5.41% (0.0444 => 0.0468, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.27% (0.3292 => 0.3283, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: -0.10% (0.1984 => 0.1982, std.dev.: 0.0042) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 39.43% (0.0175 => 0.0244, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 6.45% (0.0155 => 0.0165, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.40% (0.0428 => 0.0422, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.94% (0.0330 => 0.0284, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.59% (0.0314 => 0.0309, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.34% (0.0428 => 0.0418, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -2.43% (0.0206 => 0.0201, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 16.76% (0.0185 => 0.0216, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -3.97% (0.0302 => 0.0290, std.dev.: 0.0035) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -0.94% (0.1486 => 0.1472, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.98% (1.1411 => 1.1299, std.dev.: 0.0565) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -5.52% (0.1521 => 0.1437, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.52% (0.4042 => 0.4144, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.87% (0.1335 => 0.1400, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.07% (0.0657 => 0.0650, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -14.80% (0.0277 => 0.0236, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: - (0.0538 => 0.0538, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.18% (1.1427 => 1.1447, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -87.50% (0.0008 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.27% (0.0629 => 0.0577, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.87% (0.0267 => 0.0262, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.01% (0.7939 => 0.8019, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: -87.50% (0.0008 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 6.90% (0.0087 => 0.0093, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.16% (2.1832 => 1.6557, std.dev.: 0.0072) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.87% (0.2774 => 0.2909, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.61% (0.6287 => 0.6514, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.47% (0.3717 => 0.3846, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.15% (0.5817 => 0.6000, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.12% (0.8697 => 0.8968, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.94% (1.1685 => 1.2029, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.37% (0.8007 => 0.8197, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.06% (0.8359 => 0.8531, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.99% (13.1811 => 13.4428, std.dev.: 0.0571) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.97% (1.1606 => 1.1835, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.73% (0.8611 => 0.8760, std.dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: 1.73% (14.7684 => 15.0234, std.dev.: 0.0754) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.62% (4.1763 => 4.2441, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.45% (0.8597 => 0.8722, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.40% (1.2423 => 1.2597, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.26% (0.9688 => 0.9810, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: 1.09% (8.4179 => 8.5099, std.dev.: 0.0038) MultiSource/Applications/lemon/lemon: 1.03% (1.0945 => 1.1058, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 1.03% (8.6247 => 8.7134, std.dev.: 0.0096) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.54% (1.1857 => 1.2869, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.06% (0.3186 => 0.3411, std.dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 6.04% (63.1822 => 66.9999, std.dev.: 0.0138) SingleSource/Benchmarks/Dhrystone/dry: 3.37% (0.5081 => 0.5252, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.30% (0.7597 => 0.7848, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 2.64% (3.6643 => 3.7611, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.60% (59.2638 => 60.8029, std.dev.: 0.3878) SingleSource/Benchmarks/Misc/ReedSolomon: 2.43% (8.5322 => 8.7399, std.dev.: 0.0576) MultiSource/Benchmarks/Olden/bh/bh: 1.84% (2.3560 => 2.3994, std.dev.: 0.0099) MultiSource/Applications/minisat/minisat: 1.70% (6.1525 => 6.2574, std.dev.: 0.0167) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.00% (1.3882 => 1.4021, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -8.56% (3.2926 => 3.0107, std.dev.: 0.0356) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -7.20% (0.1430 => 0.1327, std.dev.: 0.0035) MultiSource/Applications/lua/lua: -5.17% (29.8330 => 28.2921, std.dev.: 0.0940) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -3.79% (0.3269 => 0.3145, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hash2: -1.45% (3.4237 => 3.3741, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.25% (3.3479 => 3.3061, std.dev.: 0.0004) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.60% (16.4461 => 16.5444, std.dev.: 0.0672) MultiSource/Applications/obsequi/Obsequi: 2.36% (1.0262 => 1.0504, std.dev.: 0.0131) MultiSource/Applications/sqlite3/sqlite3: 1.18% (0.6332 => 0.6407, std.dev.: 0.0126) MultiSource/Benchmarks/McCat/08-main/main: 1.31% (0.1831 => 0.1855, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.06% (0.1559 => 0.1669, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.93% (0.3123 => 0.3152, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.97% (0.2463 => 0.2439, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.24% (0.3344 => 0.3336, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.72% (0.2364 => 0.2347, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: -0.73% (0.6010 => 0.5966, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/mandel: 9.09% (0.0429 => 0.0468, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.52% (0.3266 => 0.3283, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 0.66% (0.1969 => 0.1982, std.dev.: 0.0042) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.93% (0.0224 => 0.0244, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 34.15% (0.0123 => 0.0165, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.43% (0.0408 => 0.0422, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 11.81% (0.0254 => 0.0284, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.32% (0.0302 => 0.0309, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 8.85% (0.0384 => 0.0418, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 5.79% (0.0190 => 0.0201, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 20.00% (0.0180 => 0.0216, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 26.09% (0.0230 => 0.0290, std.dev.: 0.0035) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 2.36% (0.1438 => 0.1472, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.26% (1.1329 => 1.1299, std.dev.: 0.0565) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.71% (0.1462 => 0.1437, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.48% (0.4164 => 0.4144, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.26% (0.1369 => 0.1400, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.40% (0.0641 => 0.0650, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 21.03% (0.0195 => 0.0236, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.92% (0.0578 => 0.0538, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.09% (1.1437 => 1.1447, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.97% (0.0627 => 0.0577, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 45.56% (0.0180 => 0.0262, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.02% (0.8017 => 0.8019, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 50.00% (0.0062 => 0.0093, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 01:52:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 03:52:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121025085233.C49EB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5197?compare_to=5192&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5197, Order: 166664, Start Time: 2012-10-25 07:31:37, End Time: 2012-10-25 08:52:27 To: 5192, Order: 166662, Start Time: 2012-10-25 05:37:30, End Time: 2012-10-25 06:58:02 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (75 on baseline) New Passes: 0 (7 on baseline) Performance Regressions: 0 (200 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 87 (12 on baseline) Unchanged Tests: 955 (641 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.08% (0.6286 => 0.6291, std.dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 0.30% (17.3082 => 17.3598, std.dev.: 0.0271) MultiSource/Applications/kimwitu++/kc: 0.20% (15.7460 => 15.7782, std.dev.: 0.0103) MultiSource/Benchmarks/Bullet/bullet: 0.13% (57.2641 => 57.3370, std.dev.: 0.0852) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0492 => 0.0492, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.20% (0.0495 => 0.0494, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0461 => 0.0461, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0463 => 0.0463, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.22% (0.0451 => 0.0450, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.22% (0.0453 => 0.0452, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0444 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0446 => 0.0446, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.22% (0.0463 => 0.0462, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.22% (0.0464 => 0.0463, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0457 => 0.0457, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.22% (0.0459 => 0.0458, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.22% (0.0446 => 0.0447, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.22% (0.0449 => 0.0448, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.22% (0.0455 => 0.0454, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.22% (0.0457 => 0.0456, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0466 => 0.0466) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.49% (0.0468 => 0.0489, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.45% (0.0443 => 0.0441, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0443 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0454 => 0.0454, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.22% (0.0456 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.22% (0.0445 => 0.0446, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.22% (0.0447 => 0.0446, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.23% (0.0438 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0438 => 0.0438) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0436 => 0.0436) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.23% (0.0438 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.21% (0.0474 => 0.0473, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.21% (0.0475 => 0.0474, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0435 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.46% (0.0437 => 0.0435, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0436 => 0.0436) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.23% (0.0438 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.23% (0.0444 => 0.0443, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.22% (0.0446 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.46% (8.2877 => 8.3257, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.32% (0.6932 => 0.6954, std.dev.: 0.0019) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1439 => 0.1439, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.40% (0.0648 => 0.0670, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.03% (0.3827 => 0.3828, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -9.34% (63.2438 => 57.3370, std.dev.: 0.0852) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/BenchmarkGame/puzzle MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.02% (0.6962 => 0.3828, std.dev.: 0.0009) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/MallocBench/gs/gs: 14.02% (4.1105 => 4.6869, std.dev.: 0.0265) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 44.04% (1.1048 => 1.5914, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 69.14% (3.4629 => 5.8571, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13508.47% (0.0720 => 9.7981, std.dev.: 0.0083) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050300.00% (0.0001 => 10.0504, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 69.53% (0.0256 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 65.35% (0.2554 => 0.4223, std.dev.: 0.0023) SingleSource/Regression/C/sumarraymalloc: 51.03% (0.0243 => 0.0367, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 46.38% (10.3673 => 15.1754, std.dev.: 0.0032) SingleSource/Regression/C/sumarray2d: 44.28% (0.0271 => 0.0391, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 43.16% (0.1622 => 0.2322, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.72% (1.5859 => 2.2475, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/distray/distray: 37.22% (0.1056 => 0.1449, std.dev.: 0.0012) SingleSource/UnitTests/vla: 33.52% (0.0355 => 0.0474, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.94% (2.2024 => 2.8839, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/neural/neural: 28.43% (0.1463 => 0.1879, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 25.18% (0.0834 => 0.1044, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 24.47% (0.1655 => 0.2060, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.97% (0.1566 => 0.1910, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/hash: 21.44% (0.0485 => 0.0589, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 21.18% (0.2049 => 0.2483, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 20.88% (0.1432 => 0.1731) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.76% (7.0540 => 8.5185, std.dev.: 0.0121) MultiSource/Benchmarks/FreeBench/pifft/pifft: 19.52% (2.2022 => 2.6320, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 19.16% (0.1555 => 0.1853, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.06% (0.0871 => 0.1037, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 18.94% (0.5105 => 0.6072, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.41% (0.6675 => 0.7904, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 17.71% (0.1440 => 0.1695, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.30% (0.1029 => 0.1207, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/tsp/tsp: 17.28% (0.1175 => 0.1378, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: 17.25% (0.0626 => 0.0734) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.16% (1.3050 => 1.5289, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.15% (0.0793 => 0.0929, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 16.98% (3.3354 => 3.9016, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.94% (0.8172 => 0.9556, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.91% (0.2271 => 0.2655, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/em3d/em3d: 16.87% (0.1695 => 0.1981, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/mst/mst: 16.68% (0.1163 => 0.1357, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.64% (0.4615 => 0.5383, std.dev.: 0.0030) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.63% (0.3121 => 0.3640, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 16.45% (0.1337 => 0.1557, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 16.38% (0.4879 => 0.5678, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.18% (0.1032 => 0.1199, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 16.09% (0.7115 => 0.8260, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.03% (0.0886 => 0.1028, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.02% (0.5020 => 0.5824, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.93% (1.5415 => 1.7871, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/oourafft: 15.87% (0.3282 => 0.3803, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.83% (0.1510 => 0.1749, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.77% (0.1940 => 0.2246, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/matrix: 15.77% (0.0818 => 0.0947, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.68% (0.0842 => 0.0974, std.dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: 15.63% (0.3109 => 0.3595, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.56% (0.0675 => 0.0780, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 15.33% (0.0672 => 0.0775, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 15.26% (1.1642 => 1.3418, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 15.14% (8.1363 => 9.3684, std.dev.: 0.0170) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.06% (0.0770 => 0.0886, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/18-imp/imp: 14.99% (0.3423 => 0.3936, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.96% (0.9765 => 1.1226, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 14.95% (0.3177 => 0.3652, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.95% (0.1117 => 0.1284, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.92% (0.0838 => 0.0963, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.90% (0.2107 => 0.2421, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.90% (0.2758 => 0.3169, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 14.88% (0.1438 => 0.1652, std.dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 14.87% (9.4845 => 10.8952, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.85% (1.7609 => 2.0224, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.75% (4.2646 => 4.8937, std.dev.: 0.0056) MultiSource/Benchmarks/nbench/nbench: 14.67% (1.1840 => 1.3577, std.dev.: 0.0082) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.65% (0.1584 => 0.1816, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/exptree: 14.62% (0.0814 => 0.0933, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.61% (0.0746 => 0.0855, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.56% (0.1236 => 0.1416, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.52% (0.5860 => 0.6711, std.dev.: 0.0030) MultiSource/Applications/aha/aha: 14.51% (0.1151 => 0.1318, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 14.48% (0.1906 => 0.2182, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.43% (0.2065 => 0.2363, std.dev.: 0.0035) MultiSource/Applications/spiff/spiff: 14.40% (0.7835 => 0.8963, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.39% (0.6450 => 0.7378, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.36% (0.5981 => 0.6840, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.33% (0.2700 => 0.3087, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/rem: 14.25% (0.1144 => 0.1307, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 14.25% (0.0730 => 0.0834, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 14.18% (1.4186 => 1.6198, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.15% (0.0933 => 0.1065, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.12% (0.1062 => 0.1212, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.04% (0.0798 => 0.0910, std.dev.: 0.0033) MultiSource/Applications/treecc/treecc: 13.99% (2.0273 => 2.3109, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.98% (0.1695 => 0.1932, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 13.86% (0.7433 => 0.8463, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.77% (0.0770 => 0.0876, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 13.70% (0.3387 => 0.3851, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.61% (0.3307 => 0.3757, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.57% (5.0018 => 5.6806, std.dev.: 0.0091) MultiSource/Applications/oggenc/oggenc: 13.52% (5.7591 => 6.5379, std.dev.: 0.0026) MultiSource/Applications/lemon/lemon: 13.51% (1.0722 => 1.2171, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 13.49% (4.9449 => 5.6121, std.dev.: 0.0234) MultiSource/Benchmarks/Olden/health/health: 13.49% (0.1268 => 0.1439, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.45% (0.8067 => 0.9152, std.dev.: 0.0110) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.45% (7.9617 => 9.0322, std.dev.: 0.0152) MultiSource/Applications/lua/lua: 13.38% (3.8723 => 4.3905, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.29% (0.1625 => 0.1841, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.16% (0.5569 => 0.6302, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.13% (0.0929 => 0.1051, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 13.11% (0.3180 => 0.3597, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 13.03% (0.4299 => 0.4859, std.dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 13.01% (10.4361 => 11.7937, std.dev.: 0.0254) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.78% (0.1330 => 0.1500, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 12.74% (0.3092 => 0.3486, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.74% (1.1861 => 1.3372, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.72% (0.2603 => 0.2934, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.70% (0.3441 => 0.3878, std.dev.: 0.0030) MultiSource/Applications/hbd/hbd: 12.63% (1.5603 => 1.7573, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/bigfib: 12.62% (0.6456 => 0.7271, std.dev.: 0.0036) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 12.53% (0.1125 => 0.1266, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 12.39% (0.8921 => 1.0026, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.01% (0.8101 => 0.9074, std.dev.: 0.0021) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.99% (0.1143 => 0.1280, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.96% (0.2266 => 0.2537, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.58% (1.1194 => 1.2490, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 11.52% (0.4289 => 0.4783, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/trivial-interface: 11.37% (0.3473 => 0.3868, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 11.32% (0.4620 => 0.5143, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 11.31% (0.3927 => 0.4371, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.26% (0.1892 => 0.2105, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.21% (0.3543 => 0.3940, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 11.18% (0.3561 => 0.3959, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.15% (0.3543 => 0.3938, std.dev.: 0.0032) MultiSource/Applications/siod/siod: 11.11% (2.2969 => 2.5520, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/exceptions-2: 11.04% (0.3497 => 0.3883, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.98% (0.3516 => 0.3902, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.94% (0.3694 => 0.4098, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.89% (0.3828 => 0.4245, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.89% (0.3865 => 0.4286, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.86% (0.3886 => 0.4308, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 10.84% (0.3422 => 0.3793, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.83% (0.4203 => 0.4658, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 10.54% (21.9371 => 24.2488, std.dev.: 0.0348) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 10.49% (0.0953 => 0.1053, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 10.45% (0.3684 => 0.4069, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 10.41% (0.5925 => 0.6542, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.36% (0.4103 => 0.4528, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.34% (0.1044 => 0.1152, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 10.33% (0.7326 => 0.8083, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.29% (0.4636 => 0.5113, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/moments: 10.28% (0.4048 => 0.4464, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 10.15% (0.6030 => 0.6642, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.07% (0.3427 => 0.3772, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 9.80% (0.3603 => 0.3956, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.62% (0.3826 => 0.4194, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 9.22% (0.2831 => 0.3092, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.21% (0.3650 => 0.3986, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.10% (0.2891 => 0.3154, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 9.07% (0.3098 => 0.3379, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.01% (0.2430 => 0.2649, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 9.00% (0.3232 => 0.3523, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 8.99% (0.3283 => 0.3578, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 8.98% (0.2905 => 0.3166, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.96% (0.4064 => 0.4428, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.90% (0.3136 => 0.3415, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 8.89% (17.1811 => 18.7078, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.85% (0.2756 => 0.3000, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.75% (2.0665 => 2.2473, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 8.69% (0.2877 => 0.3127, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.67% (0.2872 => 0.3121, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.67% (0.3162 => 0.3436, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 8.60% (0.2871 => 0.3118, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 8.59% (0.2725 => 0.2959, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.52% (14.3668 => 15.5913, std.dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.38% (3.8922 => 4.2183, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.34% (0.2793 => 0.3026, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 8.33% (0.2714 => 0.2940, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 8.29% (0.3052 => 0.3305, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 8.28% (0.2802 => 0.3034, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 8.23% (0.3379 => 0.3657, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 7.51% (1.2842 => 1.3806, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/objinst: 7.15% (0.3131 => 0.3355, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.24% (0.3935 => 0.4102, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.43% (0.3817 => 0.3948, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1726, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.38% (0.9957 => 1.1289, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9652, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.86% (1.1396 => 1.2520, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 6.87% (3.1578 => 3.3746, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.64% (2.8904 => 3.0823, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 5.04% (0.5413 => 0.5686, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.65% (0.3463 => 0.3624, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.4162 => 0.4322, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 3.79% (1.9405 => 2.0141, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.79% (4.2280 => 4.3460, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.63% (0.3987 => 0.4092, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.08% (1.0313 => 1.0527, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.76% (3.6395 => 3.7035, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.59% (2.6546 => 2.6968, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2077, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.50% (11.6436 => 11.8178, std.dev.: 0.0017) MultiSource/Applications/viterbi/viterbi: 1.15% (4.4649 => 4.5161, std.dev.: 0.0052) MultiSource/Applications/minisat/minisat: 1.04% (9.1159 => 9.2107, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: 1.03% (3.8532 => 3.8930, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.99% (6.6874 => 0.1345, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: -77.12% (0.8651 => 0.1979, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -36.65% (5.2763 => 3.3423, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.14% (5.3855 => 3.7624, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -29.73% (5.3526 => 3.7613, std.dev.: 0.0054) SingleSource/UnitTests/Vector/constpool: -9.35% (54.1659 => 49.0990, std.dev.: 0.0403) MultiSource/Applications/ClamAV/clamscan: -2.46% (22.1758 => 21.6308, std.dev.: 0.0541) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -52.85% (8.0499 => 3.7955, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4750, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4250, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.70% (1.2258 => 1.0701, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.65% (1.2373 => 1.0931, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: -10.82% (1.5373 => 1.3709, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.35% (19.9488 => 18.2825, std.dev.: 0.0123) MultiSource/Benchmarks/FreeBench/mason/mason: -7.77% (0.2161 => 0.1993, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.03% (1.8329 => 1.7041, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4780, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.15% (1.6805 => 1.5939, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: -5.15% (1.5835 => 1.5020, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.33% (8.1563 => 7.8028, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.67% (3.2827 => 3.1623, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8777, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5009, std.dev.: 0.0030) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.79% (0.4808 => 0.4674, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Applications/sqlite3/sqlite3: -2.14% (4.6441 => 4.5449, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -1.87% (10.2830 => 10.0906, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6813, std.dev.: 0.0021) SingleSource/UnitTests/Vector/multiplies: -1.66% (2.5528 => 2.5103, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4209, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/lists: -1.18% (6.2999 => 6.2253, std.dev.: 0.0106) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2879, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 20.31% (0.5229 => 0.6291, std.dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 15.81% (14.9895 => 17.3598, std.dev.: 0.0271) MultiSource/Applications/kimwitu++/kc: 11.46% (14.1553 => 15.7782, std.dev.: 0.0103) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 16.31% (7.1582 => 8.3257, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.76% (0.6222 => 0.6954, std.dev.: 0.0019) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.10% (0.1485 => 0.1439, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.34% (0.2116 => 0.0670, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 03:13:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 05:13:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121025101339.0C76D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5198?compare_to=5195&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5198, Order: 166665, Start Time: 2012-10-25 08:48:19, End Time: 2012-10-25 10:13:30 To: 5195, Order: 166664, Start Time: 2012-10-25 06:57:48, End Time: 2012-10-25 08:24:49 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (183 on baseline) Unchanged Tests: 1042 (855 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.72% (2.0478 => 2.1034, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/salsa20: 2.59% (7.4937 => 7.6878, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 2.32% (3.1932 => 3.2674, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.22% (0.1431 => 0.1299, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.64% (0.3821 => 0.3529, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -7.55% (2.4924 => 2.3041, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.40% (22.4056 => 20.7467, std.dev.: 0.0196) MultiSource/Applications/sgefa/sgefa: -7.24% (0.3357 => 0.3114, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -7.17% (3.5339 => 3.2805, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: -7.13% (0.3831 => 0.3558, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -7.11% (0.3880 => 0.3604, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.03% (0.3142 => 0.2921, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: -7.03% (0.3896 => 0.3622, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -7.03% (0.3812 => 0.3544, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: -6.99% (16.1920 => 15.0599, std.dev.: 0.0154) SingleSource/UnitTests/ObjC/exceptions-3: -6.99% (0.3848 => 0.3579, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.98% (0.1761 => 0.1638, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.96% (0.3891 => 0.3620, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.95% (0.3884 => 0.3614, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: -6.94% (0.2160 => 0.2010, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: -6.94% (0.9179 => 0.8542, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: -6.92% (0.4176 => 0.3887, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.92% (0.2428 => 0.2260, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: -6.92% (0.4033 => 0.3754, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.90% (0.1796 => 0.1672, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.90% (0.2695 => 0.2509, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.86% (0.9542 => 0.8887, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.86% (0.9852 => 0.9176, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -6.84% (9.2283 => 8.5974, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/property: -6.81% (0.4199 => 0.3913, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.79% (1.6474 => 1.5356, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.78% (1.0544 => 0.9829, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/parameter-passing: -6.75% (0.4280 => 0.3991, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -6.75% (4.3330 => 4.0407, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.75% (0.4151 => 0.3871, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -6.74% (7.0961 => 6.6179, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: -6.72% (1.2515 => 1.1674, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: -6.70% (1.1450 => 1.0683, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.68% (5.4682 => 5.1028, std.dev.: 0.0121) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.67% (6.7716 => 6.3196, std.dev.: 0.0098) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.67% (0.2548 => 0.2378, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -6.65% (0.1879 => 0.1754, std.dev.: 0.0010) MultiSource/Applications/siod/siod: -6.62% (2.4021 => 2.2431, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.62% (0.3658 => 0.3416, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.59% (0.1716 => 0.1603, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: -6.58% (0.2659 => 0.2484, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.58% (1.3722 => 1.2819, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.56% (1.4642 => 1.3682, std.dev.: 0.0086) MultiSource/Benchmarks/nbench/nbench: -6.51% (1.1530 => 1.0779, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -6.50% (0.2985 => 0.2791, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.50% (1.2300 => 1.1501, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.49% (0.3931 => 0.3676, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.44% (0.1584 => 0.1482, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: -6.44% (0.4861 => 0.4548, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.43% (4.5069 => 4.2170, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.43% (2.2587 => 2.1135, std.dev.: 0.0174) MultiSource/Applications/hexxagon/hexxagon: -6.42% (1.3148 => 1.2304, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.42% (0.4083 => 0.3821, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.42% (4.8161 => 4.5071, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.38% (1.2784 => 1.1968, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.36% (0.6304 => 0.5903, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.35% (0.6484 => 0.6072) MultiSource/Applications/lua/lua: -6.34% (4.0594 => 3.8020, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/fibo: -6.34% (0.2871 => 0.2689, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: -6.34% (15.5079 => 14.5253, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.33% (0.6052 => 0.5669, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.33% (0.2355 => 0.2206, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.32% (0.5478 => 0.5132, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -6.31% (0.3406 => 0.3191, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.31% (14.2083 => 13.3121, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.31% (0.3837 => 0.3595, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.31% (4.8802 => 4.5725, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wordfreq: -6.30% (0.3491 => 0.3271, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: -6.29% (0.1621 => 0.1519, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.29% (4.0323 => 3.7787, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.29% (0.3849 => 0.3607, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.27% (0.2903 => 0.2721, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -6.27% (0.5168 => 0.4844, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -6.27% (0.3255 => 0.3051, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: -6.26% (0.2989 => 0.2802, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.25% (0.3057 => 0.2866, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.25% (2.1713 => 2.0357, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: -6.24% (18.2933 => 17.1514, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/lists: -6.24% (0.3621 => 0.3395, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.23% (0.6293 => 0.5901, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: -6.23% (0.3581 => 0.3358, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.23% (0.7919 => 0.7426, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: -6.22% (0.7447 => 0.6984, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -6.21% (0.3026 => 0.2838, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -6.21% (0.2849 => 0.2672, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -6.21% (0.3446 => 0.3232, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.21% (0.6297 => 0.5906, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.21% (0.5591 => 0.5244, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -6.21% (0.5705 => 0.5351, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -6.20% (0.6660 => 0.6247, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -6.20% (0.3323 => 0.3117, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.20% (0.5859 => 0.5496, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -6.19% (0.6395 => 0.5999, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.19% (0.6736 => 0.6319, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.19% (0.5802 => 0.5443, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: -6.19% (0.3394 => 0.3184, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.18% (0.5805 => 0.5446, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -6.18% (34.0927 => 31.9847, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.18% (0.6681 => 0.6268, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.18% (0.5925 => 0.5559, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -6.17% (0.9557 => 0.8967, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -6.17% (0.5575 => 0.5231, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: -6.17% (0.4427 => 0.4154, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.17% (0.6260 => 0.5874, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -6.16% (0.6750 => 0.6334, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.16% (0.6395 => 0.6001, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/random: -6.16% (0.2939 => 0.2758, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.15% (0.7339 => 0.6888, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.14% (1.6364 => 1.5359, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.13% (0.5581 => 0.5239, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -6.11% (0.7524 => 0.7064, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.11% (0.5857 => 0.5499, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.11% (0.5863 => 0.5505, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/heapsort: -6.10% (0.3016 => 0.2832, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -6.10% (0.6676 => 0.6269, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -6.09% (0.6667 => 0.6261, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: -6.09% (3.5154 => 3.3014, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wc: -6.08% (0.3205 => 0.3010, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -6.08% (17.1032 => 16.0632, std.dev.: 0.0077) MultiSource/Applications/SIBsim4/SIBsim4: -6.07% (1.3864 => 1.3023, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: -6.06% (0.3481 => 0.3270, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.05% (0.6446 => 0.6056, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -6.05% (0.4515 => 0.4242, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: -6.05% (0.3788 => 0.3559, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -6.03% (0.2933 => 0.2756, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -6.03% (15.2527 => 14.3337, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.02% (0.6194 => 0.5821, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -6.00% (0.4248 => 0.3993, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.00% (0.4916 => 0.4621, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.00% (0.3483 => 0.3274, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -6.00% (0.3867 => 0.3635, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -6.00% (0.5569 => 0.5235, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.99% (0.5329 => 0.5010, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.98% (0.6033 => 0.5672, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: -5.98% (0.3059 => 0.2876, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.97% (0.6230 => 0.5858, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.96% (0.5941 => 0.5587, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.95% (0.6189 => 0.5821, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.93% (0.3252 => 0.3059, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.93% (0.6440 => 0.6058, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: -5.93% (2.1401 => 2.0132, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.92% (0.4813 => 0.4528, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: -5.92% (0.3025 => 0.2846, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -5.92% (0.3194 => 0.3005, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.92% (0.5849 => 0.5503, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.91% (0.5567 => 0.5238, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.90% (0.7021 => 0.6607, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.89% (0.5570 => 0.5242, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.85% (8.0126 => 7.5441, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.83% (0.4321 => 0.4069, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.77% (1.2210 => 1.1505, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.76% (0.5456 => 0.5142, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.75% (0.2278 => 0.2147, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.75% (0.2106 => 0.1985, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: -5.70% (0.4524 => 0.4266, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.70% (0.2999 => 0.2828, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.70% (0.5688 => 0.5364, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.68% (1.2221 => 1.1527, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: -5.66% (0.3271 => 0.3086, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.64% (0.8521 => 0.8040, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -5.60% (0.7982 => 0.7535, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.58% (0.5999 => 0.5664, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/Hello: -5.44% (0.6347 => 0.6002, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -5.37% (0.6441 => 0.6095, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.15% (0.7198 => 0.6827, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.12% (0.3319 => 0.3149, std.dev.: 0.0037) MultiSource/Applications/spiff/spiff: -5.12% (0.8418 => 0.7987, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: -5.04% (0.7779 => 0.7387, std.dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: -4.83% (5.0226 => 4.7799, std.dev.: 0.0124) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.82% (0.2385 => 0.2270, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.14% (0.9077 => 0.8701, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: -3.73% (1.5610 => 1.5028, std.dev.: 0.0035) SingleSource/UnitTests/Vector/constpool: -2.41% (20.7746 => 20.2736, std.dev.: 0.0684) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.53% (7.5137 => 5.7460, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/richards_benchmark: -8.64% (1.2842 => 1.1733, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.91% (1.7753 => 1.7059, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.87% (2.2633 => 2.1758, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.18% (1.3096 => 1.2680, std.dev.: 0.0096) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.00% (1.0557 => 1.0240, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4686, std.dev.: 0.0043) Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 03:32:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 05:32:29 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121025103229.C233F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5199?compare_to=5196&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5199, Order: 166669, Start Time: 2012-10-25 09:08:59, End Time: 2012-10-25 10:32:24 To: 5196, Order: 166664, Start Time: 2012-10-25 07:28:20, End Time: 2012-10-25 08:51:44 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 17 (50 on baseline) Performance Improvements: 2 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 956 (920 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.11% (0.2008 => 0.2191, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/05-eks/eks: 4.60% (0.4260 => 0.4456, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.59% (0.3288 => 0.3439, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 3.96% (1.2108 => 1.2588, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.77% (0.4955 => 0.5142, std.dev.: 0.0063) MultiSource/Applications/spiff/spiff: 3.70% (0.7969 => 0.8264, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.25% (0.5976 => 0.6170, std.dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 2.14% (0.7443 => 0.7602, std.dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: 1.86% (1.2681 => 1.2917, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.40% (8.7359 => 8.8581, std.dev.: 0.0208) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.39% (4.5135 => 4.5762, std.dev.: 0.0123) MultiSource/Applications/treecc/treecc: 1.31% (2.0040 => 2.0302, std.dev.: 0.0101) MultiSource/Applications/lua/lua: 1.26% (3.8589 => 3.9075, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.13% (1.1835 => 1.1969, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 30.89% (1.9190 => 2.5117, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.24% (1.4967 => 1.8894, std.dev.: 0.0042) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.79% (24.8922 => 28.5735, std.dev.: 0.0564) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.85% (0.2909 => 0.2797, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/SPASS/SPASS: -1.55% (8.3343 => 8.2048, std.dev.: 0.0246) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.20% (16.5444 => 16.5770, std.dev.: 0.1010) MultiSource/Applications/obsequi/Obsequi: 0.71% (1.0504 => 1.0579, std.dev.: 0.0100) MultiSource/Applications/sqlite3/sqlite3: 0.19% (0.6407 => 0.6419, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: 5.71% (0.1855 => 0.1961, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.36% (0.1669 => 0.1613, std.dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.78% (0.3152 => 0.3271, std.dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.82% (0.2439 => 0.2419, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.42% (0.3336 => 0.3322, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.38% (0.2347 => 0.2356, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/bigfib: -0.12% (0.5966 => 0.5959, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel: -7.05% (0.0468 => 0.0435, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.43% (0.3283 => 0.3269, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/strcat: 0.20% (0.1982 => 0.1986, std.dev.: 0.0019) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.23% (0.0244 => 0.0247, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 13.94% (0.0165 => 0.0188, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.24% (0.0422 => 0.0421, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -12.32% (0.0284 => 0.0249, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.32% (0.0309 => 0.0310, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -17.46% (0.0418 => 0.0345, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/casts: -17.91% (0.0201 => 0.0165, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/test1: -29.17% (0.0216 => 0.0153, std.dev.: 0.0029) SingleSource/UnitTests/byval-alignment: 1.72% (0.0290 => 0.0295, std.dev.: 0.0035) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.20% (0.1472 => 0.1475, std.dev.: 0.0025) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.09% (1.1299 => 1.1535, std.dev.: 0.0142) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.70% (0.1437 => 0.1447, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.29% (0.4144 => 0.4049, std.dev.: 0.0363) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.29% (0.1400 => 0.1340, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -12.15% (0.0650 => 0.0571, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.51% (0.0236 => 0.0223, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.55% (0.0538 => 0.0584, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.45% (1.1447 => 1.1395, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.77% (0.0031 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2100.00% (0.0001 => 0.0022, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.37% (0.0577 => 0.0608, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.97% (0.0262 => 0.0173, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.09% (0.8019 => 0.8026, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -49.46% (0.0093 => 0.0047, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.97% (2.1832 => 1.6599, std.dev.: 0.0095) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.30% (0.0810 => 0.0942, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/tsp/tsp: 10.88% (0.1112 => 0.1233, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.09% (0.4847 => 0.5142, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.37% (0.3295 => 0.3439, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.34% (0.6010 => 0.6271, std.dev.: 0.0078) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.16% (0.8148 => 0.8487, std.dev.: 0.0116) MultiSource/Applications/spiff/spiff: 3.95% (0.7950 => 0.8264, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.84% (0.7473 => 0.7760, std.dev.: 0.0093) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.67% (0.3137 => 0.3252, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.58% (0.3717 => 0.3850, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.51% (0.5961 => 0.6170, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.13% (1.1606 => 1.1969, std.dev.: 0.0036) MultiSource/Applications/Burg/burg: 2.99% (1.2222 => 1.2588, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.89% (0.4783 => 0.4921, std.dev.: 0.0043) MultiSource/Applications/SIBsim4/SIBsim4: 2.78% (1.2568 => 1.2917, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.45% (0.8611 => 0.8822, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.43% (8.6476 => 8.8581, std.dev.: 0.0208) MultiSource/Applications/lua/lua: 2.32% (3.8189 => 3.9075, std.dev.: 0.0078) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.18% (4.4880 => 4.5860, std.dev.: 0.0336) MultiSource/Applications/ClamAV/clamscan: 2.16% (14.7684 => 15.0879, std.dev.: 0.0252) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.98% (4.4873 => 4.5762, std.dev.: 0.0123) MultiSource/Applications/JM/lencod/lencod: 1.93% (15.3280 => 15.6238, std.dev.: 0.0582) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.93% (6.6074 => 6.7346, std.dev.: 0.0239) MultiSource/Applications/treecc/treecc: 1.77% (1.9948 => 2.0302, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.71% (0.8066 => 0.8204, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.70% (0.8457 => 0.8601, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.67% (0.8007 => 0.8141, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.65% (1.2602 => 1.2810, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.59% (0.8177 => 0.8307, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.48% (13.1811 => 13.3760, std.dev.: 0.0279) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.48% (0.8597 => 0.8724, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.45% (0.9074 => 0.9206, std.dev.: 0.0035) MultiSource/Applications/d/make_dparser: 1.44% (3.2366 => 3.2833, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.42% (0.8086 => 0.8201, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.40% (0.9908 => 1.0047, std.dev.: 0.0039) MultiSource/Applications/SPASS/SPASS: 1.33% (14.2605 => 14.4508, std.dev.: 0.0666) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.25% (0.8712 => 0.8821, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.19% (0.8656 => 0.8759, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.16% (0.8855 => 0.8958, std.dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: 1.15% (4.9628 => 5.0198, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.13% (0.9039 => 0.9141, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 59.02% (1.5795 => 2.5117, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.48% (1.1857 => 1.2863, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.35% (0.3186 => 0.3452, std.dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: 6.00% (63.1822 => 66.9761, std.dev.: 0.0619) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.00% (0.7597 => 0.7977, std.dev.: 0.0065) SingleSource/Benchmarks/Dhrystone/dry: 2.97% (0.5081 => 0.5232, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/ReedSolomon: 2.88% (8.5322 => 8.7779, std.dev.: 0.0212) MultiSource/Benchmarks/Olden/bh/bh: 2.02% (2.3560 => 2.4037, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash: 1.64% (0.6205 => 0.6307, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -5.24% (29.8330 => 28.2687, std.dev.: 0.1061) MultiSource/Applications/SPASS/SPASS: -2.70% (8.4326 => 8.2048, std.dev.: 0.0246) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -1.51% (7.2130 => 7.1041, std.dev.: 0.0402) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.28% (3.3479 => 3.3050, std.dev.: 0.0010) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.80% (16.4461 => 16.5770, std.dev.: 0.1010) MultiSource/Applications/obsequi/Obsequi: 3.09% (1.0262 => 1.0579, std.dev.: 0.0100) MultiSource/Applications/sqlite3/sqlite3: 1.37% (0.6332 => 0.6419, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/08-main/main: 7.10% (0.1831 => 0.1961, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.46% (0.1559 => 0.1613, std.dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.74% (0.3123 => 0.3271, std.dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.79% (0.2463 => 0.2419, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.66% (0.3344 => 0.3322, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.34% (0.2364 => 0.2356, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/bigfib: -0.85% (0.6010 => 0.5959, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel: 1.40% (0.0429 => 0.0435, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.09% (0.3266 => 0.3269, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/strcat: 0.86% (0.1969 => 0.1986, std.dev.: 0.0019) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 10.27% (0.0224 => 0.0247, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 52.85% (0.0123 => 0.0188, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.19% (0.0408 => 0.0421, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.97% (0.0254 => 0.0249, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.65% (0.0302 => 0.0310, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -10.16% (0.0384 => 0.0345, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/casts: -13.16% (0.0190 => 0.0165, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/test1: -15.00% (0.0180 => 0.0153, std.dev.: 0.0029) SingleSource/UnitTests/byval-alignment: 28.26% (0.0230 => 0.0295, std.dev.: 0.0035) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.57% (0.1438 => 0.1475, std.dev.: 0.0025) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.82% (1.1329 => 1.1535, std.dev.: 0.0142) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.03% (0.1462 => 0.1447, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.76% (0.4164 => 0.4049, std.dev.: 0.0363) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.12% (0.1369 => 0.1340, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.92% (0.0641 => 0.0571, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 14.36% (0.0195 => 0.0223, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.04% (0.0578 => 0.0584, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.37% (1.1437 => 1.1395, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 57.14% (0.0014 => 0.0022, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.03% (0.0627 => 0.0608, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.89% (0.0180 => 0.0173, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.11% (0.8017 => 0.8026, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -24.19% (0.0062 => 0.0047, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 03:43:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 05:43:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121025104306.A8AC42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5200?compare_to=5197&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5200, Order: 166671, Start Time: 2012-10-25 09:22:26, End Time: 2012-10-25 10:42:58 To: 5197, Order: 166664, Start Time: 2012-10-25 07:31:37, End Time: 2012-10-25 08:52:27 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (75 on baseline) New Passes: 0 (7 on baseline) Performance Regressions: 1 (201 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 87 (12 on baseline) Unchanged Tests: 954 (640 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 5.75% (0.4298 => 0.4545, std.dev.: 0.0074) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.14% (0.6291 => 0.6300, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: -0.09% (17.3598 => 17.3440, std.dev.: 0.0204) MultiSource/Applications/kimwitu++/kc: -0.04% (15.7782 => 15.7725, std.dev.: 0.0238) MultiSource/Benchmarks/Bullet/bullet: 0.05% (57.3370 => 57.3650, std.dev.: 0.0292) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0492 => 0.0492, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0494 => 0.0494, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0461 => 0.0461, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0463 => 0.0463, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0450 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0452 => 0.0452) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0444 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0446 => 0.0446, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.22% (0.0462 => 0.0463, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.22% (0.0463 => 0.0464, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0457 => 0.0457, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0458 => 0.0458) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.22% (0.0447 => 0.0446) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0448 => 0.0448) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0454 => 0.0454, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.22% (0.0456 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.21% (0.0466 => 0.0465, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.50% (0.0489 => 0.0467, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0441 => 0.0441) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0443 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0454 => 0.0454, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0455 => 0.0455, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.22% (0.0446 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0446 => 0.0446, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0437 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0438 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.23% (0.0436 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0437 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0473 => 0.0473, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.21% (0.0474 => 0.0475, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0435 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0435 => 0.0435, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0436 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0437 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.23% (0.0443 => 0.0444) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0445 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.02% (8.3257 => 8.3270, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.01% (0.6954 => 0.6955, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1439 => 0.1439, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.99% (0.0670 => 0.0690, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.03% (0.3828 => 0.3827, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -9.30% (63.2438 => 57.3650, std.dev.: 0.0292) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/BenchmarkGame/puzzle MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.03% (0.6962 => 0.3827, std.dev.: 0.0011) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/MallocBench/gs/gs: 14.14% (4.1105 => 4.6919, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 43.85% (1.1048 => 1.5892, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: 69.25% (3.4629 => 5.8609, std.dev.: 0.0203) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13511.94% (0.0720 => 9.8006, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050200.00% (0.0001 => 10.0503, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 69.53% (0.0256 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 65.23% (0.2554 => 0.4220, std.dev.: 0.0012) SingleSource/Regression/C/sumarraymalloc: 51.03% (0.0243 => 0.0367, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 46.40% (10.3673 => 15.1782, std.dev.: 0.0108) SingleSource/Regression/C/sumarray2d: 44.28% (0.0271 => 0.0391, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 43.16% (0.1622 => 0.2322, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.69% (1.5859 => 2.2471, std.dev.: 0.0075) MultiSource/Benchmarks/FreeBench/distray/distray: 37.12% (0.1056 => 0.1448, std.dev.: 0.0001) SingleSource/UnitTests/vla: 33.52% (0.0355 => 0.0474, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 31.03% (2.2024 => 2.8859, std.dev.: 0.0163) MultiSource/Benchmarks/FreeBench/neural/neural: 28.37% (0.1463 => 0.1878, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 24.77% (0.1655 => 0.2065, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 24.34% (0.0834 => 0.1037, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/hash: 21.86% (0.0485 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.78% (0.1566 => 0.1907, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 21.18% (0.2049 => 0.2483, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 20.88% (0.1432 => 0.1731, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.78% (7.0540 => 8.5200, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/pifft/pifft: 19.57% (2.2022 => 2.6331, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 19.42% (0.1555 => 0.1857, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 19.16% (0.5105 => 0.6083, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.94% (0.0871 => 0.1036, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.23% (0.6675 => 0.7892, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.91% (0.8172 => 0.9636, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.90% (0.0648 => 0.0764, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 17.71% (0.1440 => 0.1695, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 17.41% (0.0626 => 0.0735) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.40% (0.1029 => 0.1208, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 17.29% (0.0798 => 0.0936, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 17.28% (0.1175 => 0.1378, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.28% (0.0793 => 0.0930, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.23% (1.3050 => 1.5298, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 17.00% (0.2271 => 0.2657, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 16.98% (3.3354 => 3.9019, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/em3d/em3d: 16.93% (0.1695 => 0.1982, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.77% (0.4615 => 0.5389, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/mst/mst: 16.77% (0.1163 => 0.1358, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.76% (0.3121 => 0.3644, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 16.60% (0.1337 => 0.1559, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 16.48% (0.4879 => 0.5683, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.31% (0.5020 => 0.5839, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.18% (0.1032 => 0.1199, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.09% (1.5415 => 1.7895, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 16.08% (0.7115 => 0.8259, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.03% (0.0886 => 0.1028, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.93% (0.1940 => 0.2249, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: 15.90% (0.3282 => 0.3804, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.89% (0.1510 => 0.1750, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 15.77% (0.0818 => 0.0947, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 15.63% (0.3109 => 0.3595, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.56% (0.0842 => 0.0973, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.56% (0.0675 => 0.0780, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.38% (0.2107 => 0.2431, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 15.33% (0.0672 => 0.0775, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 15.25% (0.3423 => 0.3945, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.22% (0.1117 => 0.1287, std.dev.: 0.0016) MultiSource/Applications/Burg/burg: 15.19% (1.1642 => 1.3410, std.dev.: 0.0025) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 15.11% (0.1125 => 0.1295, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 15.07% (8.1363 => 9.3621, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.06% (0.0770 => 0.0886, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.05% (0.2758 => 0.3173, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 15.01% (0.3177 => 0.3654, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.92% (0.0838 => 0.0963, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 14.91% (9.4845 => 10.8986, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 14.88% (0.1438 => 0.1652, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.87% (4.2646 => 4.8989, std.dev.: 0.0089) SingleSource/Benchmarks/McGill/exptree: 14.86% (0.0814 => 0.0935, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.83% (0.9765 => 1.1213, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.81% (0.5860 => 0.6728, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.81% (1.7609 => 2.0217, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.75% (0.0746 => 0.0856, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.72% (0.1236 => 0.1418, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.65% (0.1584 => 0.1816, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 14.64% (0.1906 => 0.2185, std.dev.: 0.0012) MultiSource/Applications/aha/aha: 14.60% (0.1151 => 0.1319, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.56% (0.2700 => 0.3093, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.53% (0.2065 => 0.2365, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.53% (0.6450 => 0.7387, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.46% (0.5981 => 0.6846, std.dev.: 0.0111) SingleSource/UnitTests/SignlessTypes/rem: 14.34% (0.1144 => 0.1308) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 14.31% (1.4186 => 1.6216, std.dev.: 0.0050) MultiSource/Applications/spiff/spiff: 14.29% (0.7835 => 0.8955, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.26% (0.0933 => 0.1066, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 14.25% (0.0730 => 0.0834, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.10% (0.1695 => 0.1934, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.03% (0.1062 => 0.1211, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 13.95% (2.0273 => 2.3102, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.90% (0.0770 => 0.0877, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 13.87% (1.1840 => 1.3482, std.dev.: 0.0045) MultiSource/Benchmarks/sim/sim: 13.82% (0.3387 => 0.3855, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 13.76% (0.7433 => 0.8456, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 13.69% (4.9449 => 5.6217, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: 13.64% (0.1268 => 0.1441) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.64% (5.0018 => 5.6840, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 13.60% (5.7591 => 6.5426, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.57% (0.8067 => 0.9162, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.52% (0.3307 => 0.3754, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 13.50% (1.0722 => 1.2169, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.46% (7.9617 => 9.0334, std.dev.: 0.0046) MultiSource/Applications/lua/lua: 13.39% (3.8723 => 4.3907, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.23% (0.5569 => 0.6306, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.23% (0.1625 => 0.1840, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.13% (0.0929 => 0.1051, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 13.13% (10.4361 => 11.8065, std.dev.: 0.0133) MultiSource/Benchmarks/McCat/09-vor/vor: 13.08% (0.3180 => 0.3596, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 13.00% (0.4299 => 0.4858, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 12.82% (0.8921 => 1.0065, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.79% (1.1861 => 1.3378, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.78% (0.1330 => 0.1500, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.76% (0.3441 => 0.3880, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.75% (0.2603 => 0.2935, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 12.74% (0.3092 => 0.3486, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 12.61% (1.5603 => 1.7570, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/bigfib: 12.52% (0.6456 => 0.7264, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.22% (0.8101 => 0.9091, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.00% (0.2266 => 0.2538) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.90% (0.1143 => 0.1279, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.69% (0.3543 => 0.3957, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.59% (1.1194 => 1.2491, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 11.58% (0.4620 => 0.5155, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 11.49% (0.4289 => 0.4782, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.47% (0.1892 => 0.2109, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 11.32% (0.3473 => 0.3866, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/exceptions-4: 11.18% (0.3543 => 0.3939, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.15% (0.3927 => 0.4365, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.12% (0.3497 => 0.3886, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/synchronized: 11.04% (0.3561 => 0.3954, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 11.03% (2.2969 => 2.5502, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/exceptions-3: 10.95% (0.3516 => 0.3901, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/for-in: 10.94% (0.3694 => 0.4098, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.89% (0.3828 => 0.4245, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.89% (0.3865 => 0.4286, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 10.81% (0.3886 => 0.4306, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 10.75% (0.3422 => 0.3790, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.71% (0.4203 => 0.4653, std.dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 10.55% (21.9371 => 24.2506, std.dev.: 0.0216) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 10.49% (0.0953 => 0.1053, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 10.45% (0.4048 => 0.4471, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/Hello: 10.43% (0.5925 => 0.6543, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.40% (0.4636 => 0.5118, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists1: 10.37% (0.3684 => 0.4066, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.26% (0.4103 => 0.4524, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.25% (0.1044 => 0.1151, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 10.08% (0.6030 => 0.6638, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 9.77% (0.3603 => 0.3955, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.68% (0.7326 => 0.8035, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.59% (0.3826 => 0.4193, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.40% (0.3427 => 0.3749, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.21% (0.3650 => 0.3986, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 9.18% (0.2831 => 0.3091, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 9.13% (0.3098 => 0.3381, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.03% (0.2891 => 0.3152, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.01% (0.2430 => 0.2649, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 8.99% (0.3283 => 0.3578, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 8.98% (0.2905 => 0.3166, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 8.97% (0.3232 => 0.3522, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.96% (0.4064 => 0.4428, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 8.95% (0.2871 => 0.3128, std.dev.: 0.0076) MultiSource/Applications/sqlite3/sqlite3: 8.87% (17.1811 => 18.7054, std.dev.: 0.0232) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.77% (0.3136 => 0.3411, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.74% (0.2872 => 0.3123, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.60% (0.3162 => 0.3434, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.60% (0.2756 => 0.2993, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.60% (2.0665 => 2.2442, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/wc: 8.55% (0.3052 => 0.3313, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.52% (14.3668 => 15.5908, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/random: 8.49% (0.2802 => 0.3040, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.45% (0.2793 => 0.3029, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 8.44% (0.2725 => 0.2955, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.39% (3.8922 => 4.2186, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: 8.38% (0.2877 => 0.3118, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 8.38% (0.3379 => 0.3662, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 8.25% (0.2714 => 0.2938, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 7.51% (1.2842 => 1.3807, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 7.12% (0.3131 => 0.3354, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.19% (0.3935 => 0.4100, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.33% (0.3817 => 0.3944, std.dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8962, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3123, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1726, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.57% (0.9957 => 1.1308, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.55% (0.2944 => 0.3284, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9648, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.88% (1.1396 => 1.2522, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3683, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.64% (2.8904 => 3.0824) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.4162 => 0.4322, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 3.83% (1.9405 => 2.0148, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.78% (4.2280 => 4.3457, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.61% (0.3987 => 0.4091, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.87% (0.8333 => 0.8489, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.73% (3.6395 => 3.7025, std.dev.: 0.0089) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.53% (2.6546 => 2.6951, std.dev.: 0.0017) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2075, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 1.50% (11.6436 => 11.8184, std.dev.: 0.0076) MultiSource/Applications/viterbi/viterbi: 1.21% (4.4649 => 4.5189, std.dev.: 0.0058) MultiSource/Applications/minisat/minisat: 1.01% (9.1159 => 9.2077, std.dev.: 0.0136) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.96% (6.6874 => 0.1365, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -77.10% (0.8651 => 0.1981, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -36.61% (5.2763 => 3.3446, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.14% (5.3855 => 3.7622, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -29.76% (5.3526 => 3.7597, std.dev.: 0.0061) SingleSource/UnitTests/Vector/constpool: -9.43% (54.1659 => 49.0562, std.dev.: 0.0270) MultiSource/Applications/ClamAV/clamscan: -2.43% (22.1758 => 21.6371, std.dev.: 0.0402) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -52.86% (8.0499 => 3.7946, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.51% (1.1492 => 0.7641, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4752, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.79% (1.6925 => 1.4253, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.66% (1.2258 => 1.0706) SingleSource/Benchmarks/McGill/chomp: -11.36% (1.2373 => 1.0967, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -11.17% (1.5373 => 1.3656, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.36% (19.9488 => 18.2805, std.dev.: 0.0073) MultiSource/Benchmarks/FreeBench/mason/mason: -7.96% (0.2161 => 0.1989, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.02% (1.8329 => 1.7042, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.17% (1.6805 => 1.5937, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.67% (1.5835 => 1.5095, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.24% (8.1563 => 7.8105, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.65% (3.2827 => 3.1628, std.dev.: 0.0028) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8775, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4981, std.dev.: 0.0035) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.60% (0.4808 => 0.4683, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: -2.05% (4.6441 => 4.5490, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -1.87% (10.2830 => 10.0910, std.dev.: 0.0070) SingleSource/UnitTests/Vector/multiplies: -1.73% (2.5528 => 2.5086, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6830, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4212, std.dev.: 0.0055) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.10% (2.3135 => 2.2880, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-4: -1.01% (1.1333 => 1.1219, std.dev.: 0.0023) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 20.48% (0.5229 => 0.6300, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 15.71% (14.9895 => 17.3440, std.dev.: 0.0204) MultiSource/Applications/kimwitu++/kc: 11.42% (14.1553 => 15.7725, std.dev.: 0.0238) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 16.33% (7.1582 => 8.3270, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.78% (0.6222 => 0.6955, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.10% (0.1485 => 0.1439, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.39% (0.2116 => 0.0690, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 04:15:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 06:15:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121025111530.20E8A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5201?compare_to=5193&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5201, Order: 166664, Start Time: 2012-10-25 07:59:30, End Time: 2012-10-25 11:15:24 To: 5193, Order: 166661, Start Time: 2012-10-25 03:50:41, End Time: 2012-10-25 07:08:08 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (171 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1039 (719 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 4.94% (0.2165 => 0.2272, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.97% (0.3754 => 0.3903, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: 1.82% (0.6102 => 0.6213, std.dev.: 0.0012) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.96% (0.0625 => 0.0881, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.17% (0.1063 => 0.1405, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.93% (0.2969 => 0.3739, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.68% (0.1106 => 0.1390, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.05% (0.0475 => 0.0594, std.dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 24.89% (1.5932 => 1.9898, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.31% (0.4139 => 0.5145, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.91% (0.4994 => 0.6188, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.86% (0.5900 => 0.7308, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.53% (0.0714 => 0.0882, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.23% (0.4253 => 0.5241, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.03% (0.0547 => 0.0673, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.96% (0.5000 => 0.6148, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.60% (0.0584 => 0.0716, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.30% (0.0897 => 0.1097, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.73% (0.1620 => 0.1972, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.35% (0.1021 => 0.1239, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 21.20% (0.0599 => 0.0726, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 20.96% (0.1107 => 0.1339, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.57% (0.1604 => 0.1934, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 20.36% (0.0948 => 0.1141, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.22% (0.0633 => 0.0761, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.15% (0.0541 => 0.0650, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.09% (0.0642 => 0.0771) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.04% (0.1003 => 0.1204, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.04% (0.1103 => 0.1324, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.03% (0.0584 => 0.0701, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.75% (0.3903 => 0.4674, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: 19.73% (0.0821 => 0.0983, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 19.70% (0.0604 => 0.0723, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.63% (0.1549 => 0.1853, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 19.52% (0.1619 => 0.1935, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.46% (0.0822 => 0.0982, std.dev.: 0.0021) MultiSource/Applications/viterbi/viterbi: 18.59% (0.0947 => 0.1123, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.47% (0.1462 => 0.1732, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 18.31% (0.5826 => 0.6893, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.20% (0.3890 => 0.4598, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 18.07% (0.0808 => 0.0954, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 17.98% (0.5889 => 0.6948, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.87% (0.2014 => 0.2374, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 17.73% (0.1218 => 0.1434, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.65% (0.2736 => 0.3219, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 17.61% (0.1505 => 0.1770, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 17.55% (0.4029 => 0.4736, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.43% (1.3152 => 1.5444, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.41% (0.2866 => 0.3365, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.37% (0.1088 => 0.1277, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/mst/mst: 17.34% (0.0698 => 0.0819, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.74% (3.5627 => 4.1590, std.dev.: 0.0040) MultiSource/Applications/Burg/burg: 16.73% (0.5546 => 0.6474, std.dev.: 0.0053) MultiSource/Benchmarks/MallocBench/gs/gs: 16.71% (1.8794 => 2.1935, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.68% (0.4658 => 0.5435, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.63% (0.5026 => 0.5862, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.47% (0.1160 => 0.1351, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.38% (0.2875 => 0.3346, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.31% (0.1968 => 0.2289, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 16.30% (0.9697 => 1.1278, std.dev.: 0.0043) SingleSource/UnitTests/ObjC++/property-reference: 16.18% (0.7171 => 0.8331, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.16% (1.6211 => 1.8831, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/18-imp/imp: 15.83% (0.1421 => 0.1646, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.81% (0.3271 => 0.3788, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 15.78% (1.0781 => 1.2482, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hello: 15.73% (0.2714 => 0.3141, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 15.71% (0.2725 => 0.3153, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 15.67% (0.2750 => 0.3181, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.67% (0.2738 => 0.3167, std.dev.: 0.0020) SingleSource/Regression/C++/ofstream_ctor: 15.58% (0.3004 => 0.3472, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.52% (0.3930 => 0.4540, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/matrix: 15.50% (0.2780 => 0.3211, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.50% (0.2729 => 0.3152, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.48% (0.4361 => 0.5036, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: 15.45% (0.2803 => 0.3236, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 15.37% (0.2823 => 0.3257, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 15.37% (0.2811 => 0.3243, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 15.36% (0.2813 => 0.3245, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.36% (2.7292 => 3.1483, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: 15.34% (0.1284 => 0.1481, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 15.34% (0.9909 => 1.1429, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.33% (1.9694 => 2.2713, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.33% (0.2792 => 0.3220, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.32% (4.4195 => 5.0964, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/wc: 15.31% (0.3096 => 0.3570, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.21% (2.0673 => 2.3818, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.21% (0.3195 => 0.3681, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.18% (0.2911 => 0.3353, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 15.08% (4.2109 => 4.8460, std.dev.: 0.0099) MultiSource/Benchmarks/Bullet/bullet: 15.03% (23.5202 => 27.0547, std.dev.: 0.0242) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.92% (1.9966 => 2.2945, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.86% (0.1090 => 0.1252, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 14.81% (0.3267 => 0.3751, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 14.76% (0.3258 => 0.3739, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.72% (0.3362 => 0.3857, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 14.56% (0.3317 => 0.3800, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.35% (0.3060 => 0.3499, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.21% (0.3124 => 0.3568, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 14.12% (0.2075 => 0.2368, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 13.95% (0.2566 => 0.2924, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 13.95% (0.3348 => 0.3815, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/moments: 13.89% (0.3678 => 0.4189, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.86% (0.3282 => 0.3737, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 13.84% (0.4146 => 0.4720, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 13.81% (0.3477 => 0.3957, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 13.79% (1.4269 => 1.6237, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 13.74% (0.3726 => 0.4238, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.57% (0.3625 => 0.4117, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 13.55% (0.4251 => 0.4827, std.dev.: 0.0049) MultiSource/Applications/JM/ldecod/ldecod: 13.45% (2.1653 => 2.4566, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/for-in: 13.42% (0.3496 => 0.3965, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.41% (0.3690 => 0.4185, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-4: 13.39% (0.3465 => 0.3929, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 13.35% (0.3446 => 0.3906, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.33% (0.3488 => 0.3953, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.31% (0.3981 => 0.4511, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 13.31% (0.3442 => 0.3900, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 13.27% (0.3460 => 0.3919, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.21% (0.3845 => 0.4353, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/synchronized: 13.17% (0.3469 => 0.3926, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 13.07% (0.7875 => 0.8904, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/exceptions: 13.04% (0.3643 => 0.4118, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 13.01% (0.3650 => 0.4125, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 12.92% (0.3724 => 0.4205, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 12.83% (4.6177 => 5.2100, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: 12.81% (0.5012 => 0.5654, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 12.52% (2.1013 => 2.3643, std.dev.: 0.0112) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.81% (0.2040 => 0.2281, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 11.78% (0.2691 => 0.3008, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.59% (0.6435 => 0.7181, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 11.58% (5.5417 => 6.1832, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.48% (0.1028 => 0.1146, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.06% (0.1383 => 0.1536, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 10.98% (0.3498 => 0.3882, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.88% (0.2068 => 0.2293, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.74% (0.2737 => 0.3031, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 10.58% (0.6634 => 0.7336, std.dev.: 0.0021) MultiSource/Applications/minisat/minisat: 10.46% (0.3336 => 0.3685, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.21% (0.3084 => 0.3399, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 10.11% (0.4847 => 0.5337, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.89% (0.2103 => 0.2311, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 9.67% (2.0346 => 2.2313, std.dev.: 0.0165) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.25% (4.6926 => 5.1266, std.dev.: 0.0026) MultiSource/Applications/lemon/lemon: 9.16% (0.2391 => 0.2610, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.90% (0.5361 => 0.5838, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.55% (11.6398 => 12.6352, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.08% (0.5584 => 0.6035, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.01% (0.7426 => 0.8021, std.dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: 6.81% (11.9555 => 12.7698, std.dev.: 0.0082) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.17% (0.3792 => 0.3950, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.41% (0.2162 => 0.3533, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6534, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 9.14% (0.2802 => 0.3058, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 7.07% (0.2122 => 0.2272, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6103, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.69% (0.3693 => 0.3903, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 5.09% (12.0509 => 12.6639, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1678, std.dev.: 0.0144) SingleSource/Benchmarks/Misc/flops-2: 3.92% (1.8057 => 1.8764, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/dry: 2.76% (14.0481 => 14.4364, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1982, std.dev.: 0.0094) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.74% (3.1722 => 3.2274, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3064, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2890, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 1.31% (28.0362 => 28.4030, std.dev.: 0.0446) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.26% (1.0142 => 1.0270, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5402, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.07% (1.2451 => 1.2584, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5836, std.dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.65% (2.4764 => 2.4356, std.dev.: 0.0080) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.49% (25.4195 => 16.3985, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/ary2: -7.83% (0.2402 => 0.2214, std.dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9771, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7742, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2420, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7751, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5218, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (17.2379 => 16.7847, std.dev.: 0.0570) SingleSource/UnitTests/Vector/build2: -2.54% (11.2080 => 10.9233, std.dev.: 0.0106) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8648, std.dev.: 0.0173) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.80% (10.7630 => 10.5695, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4950, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.33% (5.7935 => 5.7163, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.08% (105.3826 => 104.2496, std.dev.: 0.0147) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.06% (3.3991 => 3.3629, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0441, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 05:02:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 07:02:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121025120212.F3F242A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5202?compare_to=5198&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5202, Order: 166674, Start Time: 2012-10-25 10:37:01, End Time: 2012-10-25 12:02:05 To: 5198, Order: 166665, Start Time: 2012-10-25 08:48:19, End Time: 2012-10-25 10:13:30 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (183 on baseline) Unchanged Tests: 1041 (854 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 3.30% (3.7578 => 3.8817, std.dev.: 0.0457) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) MultiSource/Benchmarks/llubenchmark/llu: 3.69% (3.7435 => 3.8817, std.dev.: 0.0457) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.65% (2.0478 => 2.1021, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/salsa20: 2.32% (7.4937 => 7.6679, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/hash2: 2.12% (3.1932 => 3.2608, std.dev.: 0.0103) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.15% (0.1431 => 0.1300, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.98% (0.3821 => 0.3516, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -7.56% (2.4924 => 2.3040, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.42% (22.4056 => 20.7437, std.dev.: 0.0123) MultiSource/Applications/sgefa/sgefa: -7.39% (0.3357 => 0.3109, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -7.27% (3.5339 => 3.2770, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.14% (0.9542 => 0.8861, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -7.13% (0.3831 => 0.3558, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -7.09% (0.3880 => 0.3605, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.08% (0.3884 => 0.3609, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.04% (0.2428 => 0.2257, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -7.04% (0.2160 => 0.2008, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.03% (0.3142 => 0.2921, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -7.03% (0.3896 => 0.3622, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -7.02% (0.4176 => 0.3883, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.02% (0.3891 => 0.3618, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.01% (0.1584 => 0.1473, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.99% (0.3848 => 0.3579, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -6.98% (0.1761 => 0.1638, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: -6.98% (16.1920 => 15.0612, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/trivial-interface: -6.98% (0.3812 => 0.3546, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -6.92% (7.0961 => 6.6049, std.dev.: 0.0067) SingleSource/UnitTests/ObjC/for-in: -6.92% (0.4033 => 0.3754, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.92% (0.3658 => 0.3405, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -6.91% (9.2283 => 8.5904, std.dev.: 0.0137) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.90% (0.1796 => 0.1672, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -6.88% (0.4199 => 0.3910, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.86% (0.9852 => 0.9176, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.84% (1.6474 => 1.5348, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -6.83% (1.2515 => 1.1660, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.83% (0.2695 => 0.2511) MultiSource/Benchmarks/nbench/nbench: -6.81% (1.1530 => 1.0745, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.79% (0.2548 => 0.2375, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.77% (0.4151 => 0.3870, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: -6.77% (0.9179 => 0.8558, std.dev.: 0.0031) MultiSource/Applications/lemon/lemon: -6.76% (1.1450 => 1.0676, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.75% (1.0544 => 0.9832, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/neural/neural: -6.73% (0.1500 => 0.1399, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.73% (6.7716 => 6.3157, std.dev.: 0.0117) MultiSource/Benchmarks/McCat/08-main/main: -6.73% (0.2659 => 0.2480, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -6.73% (4.3330 => 4.0414, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/parameter-passing: -6.73% (0.4280 => 0.3992, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.73% (1.4642 => 1.3657, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.71% (5.4682 => 5.1015, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.68% (1.3722 => 1.2806, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.65% (0.7919 => 0.7392, std.dev.: 0.0009) MultiSource/Applications/siod/siod: -6.65% (2.4021 => 2.2424, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.64% (0.1716 => 0.1602, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.62% (0.6484 => 0.6055, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.61% (0.6736 => 0.6291, std.dev.: 0.0008) MultiSource/Applications/lua/lua: -6.58% (4.0594 => 3.7922, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.58% (4.5069 => 4.2103, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.57% (4.8161 => 4.4996, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.56% (4.0323 => 3.7677, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/functionobjects: -6.56% (0.5168 => 0.4829, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.53% (2.2587 => 2.1111, std.dev.: 0.0174) MultiSource/Applications/hexxagon/hexxagon: -6.50% (1.3148 => 1.2293, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -6.50% (0.2985 => 0.2791, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.50% (0.5478 => 0.5122, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.50% (1.2300 => 1.1501, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.49% (0.4083 => 0.3818, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.48% (4.8802 => 4.5640, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.45% (0.2355 => 0.2203, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: -6.45% (0.7447 => 0.6967, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.44% (0.3837 => 0.3590, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.42% (0.6681 => 0.6252, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.41% (0.6052 => 0.5664, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.41% (0.3931 => 0.3679, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: -6.40% (0.4515 => 0.4226, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: -6.40% (15.5079 => 14.5160, std.dev.: 0.2183) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.39% (0.3849 => 0.3603, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.39% (1.2784 => 1.1967, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: -6.38% (0.3026 => 0.2833, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.37% (14.2083 => 13.3037, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/ks/ks: -6.35% (0.1621 => 0.1518, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -6.35% (34.0927 => 31.9282, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -6.34% (0.6230 => 0.5835, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.34% (0.2903 => 0.2719, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.33% (0.5591 => 0.5237, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -6.33% (0.5705 => 0.5344, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: -6.33% (18.2933 => 17.1358, std.dev.: 0.0174) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -6.32% (0.4321 => 0.4048, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.31% (0.3057 => 0.2864, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.31% (0.5925 => 0.5551, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: -6.30% (0.3491 => 0.3271, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -6.30% (0.6395 => 0.5992, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: -6.30% (0.3446 => 0.3229, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -6.30% (0.4861 => 0.4555, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.29% (1.6364 => 1.5334, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/ary2: -6.29% (0.3481 => 0.3262, std.dev.: 0.0050) MultiSource/Benchmarks/sim/sim: -6.28% (0.3406 => 0.3192, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.28% (0.7339 => 0.6878, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -6.27% (0.2871 => 0.2691, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -6.27% (0.3255 => 0.3051, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: -6.26% (0.9557 => 0.8959, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.25% (0.6194 => 0.5807, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -6.24% (0.2933 => 0.2750, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.23% (0.6304 => 0.5911, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.23% (0.6260 => 0.5870, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.23% (0.5859 => 0.5494, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -6.22% (0.6750 => 0.6330, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.22% (2.1713 => 2.0363, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -6.21% (0.3621 => 0.3396, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: -6.21% (0.3205 => 0.3006, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -6.20% (17.1032 => 16.0435, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/random: -6.19% (0.2939 => 0.2757, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.19% (0.6395 => 0.5999, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -6.19% (0.2989 => 0.2804, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -6.19% (0.4427 => 0.4153, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: -6.18% (1.3864 => 1.3007, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -6.18% (0.7524 => 0.7059, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -6.18% (0.6667 => 0.6255, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -6.18% (0.2849 => 0.2673, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.17% (0.5802 => 0.5444, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -6.16% (2.1401 => 2.0082, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.16% (0.6446 => 0.6049, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: -6.16% (0.3394 => 0.3185, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.15% (0.5581 => 0.5238, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.15% (0.6297 => 0.5910, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/18-imp/imp: -6.14% (0.3581 => 0.3361, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.14% (0.4916 => 0.4614, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: -6.14% (3.5154 => 3.2996, std.dev.: 0.0248) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.13% (0.5857 => 0.5498, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: -6.13% (0.3867 => 0.3630, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -6.13% (0.6676 => 0.6267, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.11% (0.4813 => 0.4519, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: -6.10% (0.3788 => 0.3557, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.10% (0.5805 => 0.5451, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -6.10% (0.4248 => 0.3989, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -6.10% (0.6660 => 0.6254, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.09% (0.6440 => 0.6048, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.09% (0.3483 => 0.3271, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.08% (0.3025 => 0.2841, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -6.08% (0.5941 => 0.5580, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.07% (0.5863 => 0.5507, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.07% (0.6293 => 0.5911, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -6.04% (0.5575 => 0.5238, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.03% (0.5999 => 0.5637, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -6.03% (0.5569 => 0.5233, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -6.03% (15.2527 => 14.3325, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.03% (0.6189 => 0.5816, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -6.03% (0.7982 => 0.7501, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/heapsort: -6.00% (0.3016 => 0.2835, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.00% (0.3252 => 0.3057, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.98% (0.7021 => 0.6601, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -5.98% (0.3194 => 0.3003, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.98% (0.5570 => 0.5237, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.97% (0.6033 => 0.5673, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.96% (0.5456 => 0.5131, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.94% (0.2999 => 0.2821, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.93% (0.3323 => 0.3126, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: -5.92% (0.3059 => 0.2878, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.91% (8.0126 => 7.5391, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.88% (0.5849 => 0.5505, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.88% (0.3319 => 0.3124, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.87% (1.2221 => 1.1504, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.85% (0.5688 => 0.5355, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.84% (0.2106 => 0.1983, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.82% (0.5329 => 0.5019, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.79% (0.2385 => 0.2247, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.77% (0.5567 => 0.5246, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.77% (1.2210 => 1.1506, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.76% (0.8521 => 0.8030, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: -5.75% (0.3271 => 0.3083, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: -5.66% (0.4524 => 0.4268, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -5.57% (0.7779 => 0.7346, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.53% (0.7198 => 0.6800, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: -5.45% (0.6441 => 0.6090, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -5.42% (0.6347 => 0.6003, std.dev.: 0.0088) MultiSource/Applications/spiff/spiff: -5.13% (0.8418 => 0.7986, std.dev.: 0.0032) MultiSource/Applications/oggenc/oggenc: -4.88% (5.0226 => 4.7773, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.83% (0.2278 => 0.2168, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.79% (0.9077 => 0.8642, std.dev.: 0.0030) MultiSource/Applications/hbd/hbd: -3.74% (1.5610 => 1.5026, std.dev.: 0.0020) SingleSource/UnitTests/Vector/constpool: -2.42% (20.7746 => 20.2721, std.dev.: 0.0524) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7568, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: -8.66% (1.2842 => 1.1730, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.91% (2.2633 => 2.1748, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4680, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Report Time: 2.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 05:13:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 07:13:36 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121025121336.DC55C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5203?compare_to=5199&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5203, Order: 166676, Start Time: 2012-10-25 10:49:29, End Time: 2012-10-25 12:13:32 To: 5199, Order: 166669, Start Time: 2012-10-25 09:08:59, End Time: 2012-10-25 10:32:24 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 14 (70 on baseline) Performance Improvements: 1 (3 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 960 (901 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/12-IOtest/iotest: 13.33% (0.0795 => 0.0901, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.16% (0.0813 => 0.0920, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.30% (0.2190 => 0.2328, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.51% (0.2995 => 0.3160, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.07% (0.9616 => 0.9911, std.dev.: 0.0051) SingleSource/UnitTests/Vector/constpool: 2.14% (8.4194 => 8.5998, std.dev.: 0.0248) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.02% (0.8435 => 0.8605, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.89% (0.7891 => 0.8040, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.30% (1.3503 => 1.3678, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.12% (0.9839 => 0.9949, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.56% (14.4703 => 16.2874, std.dev.: 0.5248) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.54% (0.8761 => 0.8896, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.20% (1.2428 => 1.2577, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 1.04% (3.2050 => 3.2383, std.dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.12% (1.1417 => 1.1289, std.dev.: 0.0034) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.28% (16.5770 => 16.5304, std.dev.: 0.1134) MultiSource/Applications/obsequi/Obsequi: -1.04% (1.0579 => 1.0469, std.dev.: 0.0153) MultiSource/Applications/sqlite3/sqlite3: -0.11% (0.6419 => 0.6412, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: -0.92% (0.1961 => 0.1943, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 6.08% (0.1613 => 0.1711, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.58% (0.3271 => 0.3252, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.56% (0.2419 => 0.2505, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.57% (0.3322 => 0.3374, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.44% (0.2356 => 0.2437, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 1.09% (0.5959 => 0.6024, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/mandel: 12.18% (0.0435 => 0.0488, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.47% (0.3269 => 0.3317, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/strcat: 1.91% (0.1986 => 0.2024, std.dev.: 0.0019) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.81% (0.0247 => 0.0245, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 16.49% (0.0188 => 0.0219, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.19% (0.0421 => 0.0426, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 33.33% (0.0249 => 0.0332, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -21.61% (0.0310 => 0.0243, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 22.32% (0.0345 => 0.0422, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -7.88% (0.0165 => 0.0152, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/test1: 12.42% (0.0153 => 0.0172, std.dev.: 0.0023) SingleSource/UnitTests/byval-alignment: 9.15% (0.0295 => 0.0322, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 500.00% (0.0001 => 0.0006, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 0.54% (0.1475 => 0.1483, std.dev.: 0.0062) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -2.23% (1.1535 => 1.1278, std.dev.: 0.0319) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 4.22% (0.1447 => 0.1508, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.27% (0.4049 => 0.4038, std.dev.: 0.0242) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.97% (0.1340 => 0.1353, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.98% (0.0571 => 0.0588, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 11.21% (0.0223 => 0.0248, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.42% (0.0584 => 0.0564, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.18% (1.1395 => 1.1375, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 22.73% (0.0022 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.78% (0.0608 => 0.0631, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.58% (0.0173 => 0.0174, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.20% (0.8026 => 0.8010, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: -100.00% (0.0001 => 0.0000) SingleSource/Benchmarks/Misc/mandel: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 500.00% (0.0001 => 0.0006, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 114.89% (0.0047 => 0.0101, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.58% (2.1832 => 1.6684, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.04% (0.0810 => 0.0948, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 12.23% (0.1112 => 0.1248, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.00% (0.1425 => 0.1539, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.17% (0.8321 => 0.8918, std.dev.: 0.0128) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.14% (0.1905 => 0.2041, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.33% (0.2180 => 0.2318, std.dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.93% (0.3137 => 0.3323, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.66% (0.2279 => 0.2408, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.40% (0.2998 => 0.3160, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.10% (0.4847 => 0.5094, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.05% (0.9435 => 0.9911, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.88% (0.6010 => 0.6303, std.dev.: 0.0073) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.29% (0.2378 => 0.2480, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.14% (0.5961 => 0.6208, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.83% (0.4127 => 0.4285, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.67% (0.8177 => 0.8477, std.dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.58% (0.3717 => 0.3850, std.dev.: 0.0032) MultiSource/Applications/sgefa/sgefa: 3.57% (0.2999 => 0.3106, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.52% (0.6287 => 0.6508, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.01% (1.1685 => 1.2037, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.00% (1.3279 => 1.3678, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.94% (0.8359 => 0.8605, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.82% (0.9056 => 0.9311, std.dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.80% (0.4783 => 0.4917, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.79% (0.7932 => 0.8153, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.69% (0.9688 => 0.9949, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.52% (0.8204 => 0.8411, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.50% (0.8331 => 0.8539, std.dev.: 0.0036) MultiSource/Applications/lua/lua: 2.47% (3.8189 => 3.9134, std.dev.: 0.0236) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.36% (0.8048 => 0.8238, std.dev.: 0.0059) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.36% (6.6074 => 6.7632, std.dev.: 0.0561) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.33% (0.8086 => 0.8274, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.29% (0.8611 => 0.8808, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.26% (0.8597 => 0.8791, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.20% (8.6476 => 8.8382, std.dev.: 0.0181) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.20% (13.1811 => 13.4709, std.dev.: 0.0146) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.19% (4.1763 => 4.2677, std.dev.: 0.0229) MultiSource/Applications/d/make_dparser: 2.16% (3.2366 => 3.3066, std.dev.: 0.0227) SingleSource/UnitTests/Vector/constpool: 2.16% (8.4179 => 8.5998, std.dev.: 0.0248) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.11% (3.1832 => 3.2503, std.dev.: 0.0218) MultiSource/Applications/minisat/minisat: 2.11% (0.6834 => 0.6978, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.04% (4.4873 => 4.5788, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.02% (0.8066 => 0.8229, std.dev.: 0.0051) MultiSource/Applications/SIBsim4/SIBsim4: 2.01% (1.2568 => 1.2821, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.88% (0.8286 => 0.8442, std.dev.: 0.0028) MultiSource/Applications/ClamAV/clamscan: 1.76% (14.7684 => 15.0282, std.dev.: 0.0345) MultiSource/Benchmarks/nbench/nbench: 1.76% (1.1271 => 1.1469, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.69% (0.8420 => 0.8562, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.68% (0.8805 => 0.8953, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.56% (1.6386 => 1.6642, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.53% (1.2423 => 1.2613, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.47% (0.9069 => 0.9202, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.46% (0.8656 => 0.8782, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.45% (0.9908 => 1.0052, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.44% (0.8316 => 0.8436, std.dev.: 0.0036) MultiSource/Benchmarks/PAQ8p/paq8p: 1.28% (2.3764 => 2.4069, std.dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: 1.14% (31.8598 => 32.2241, std.dev.: 0.0608) MultiSource/Applications/lemon/lemon: 1.12% (1.0945 => 1.1068, std.dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.81% (1.5795 => 2.5084, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.21% (14.6451 => 16.2874, std.dev.: 0.5248) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.63% (0.3186 => 0.3461, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.47% (1.1857 => 1.2861, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 5.92% (63.1822 => 66.9232, std.dev.: 0.0252) SingleSource/Benchmarks/Dhrystone/dry: 2.99% (0.5081 => 0.5233, std.dev.: 0.0037) MultiSource/Applications/siod/siod: 2.70% (3.6643 => 3.7632, std.dev.: 0.0156) SingleSource/Benchmarks/Misc/ReedSolomon: 2.48% (8.5322 => 8.7440, std.dev.: 0.0316) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.78% (1.5941 => 1.6225, std.dev.: 0.0090) MultiSource/Benchmarks/Olden/bh/bh: 1.77% (2.3560 => 2.3978, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.64% (59.2638 => 60.2357, std.dev.: 0.3441) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.22% (0.8789 => 0.8896, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -4.96% (29.8330 => 28.3545, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/hash2: -1.66% (3.4237 => 3.3669, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.27% (3.3479 => 3.3053, std.dev.: 0.0090) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.51% (16.4461 => 16.5304, std.dev.: 0.1134) MultiSource/Applications/obsequi/Obsequi: 2.02% (1.0262 => 1.0469, std.dev.: 0.0153) MultiSource/Applications/sqlite3/sqlite3: 1.26% (0.6332 => 0.6412, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: 6.12% (0.1831 => 0.1943, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.75% (0.1559 => 0.1711, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.13% (0.3123 => 0.3252, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.71% (0.2463 => 0.2505, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.90% (0.3344 => 0.3374, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.09% (0.2364 => 0.2437, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 0.23% (0.6010 => 0.6024, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/mandel: 13.75% (0.0429 => 0.0488, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.56% (0.3266 => 0.3317, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/strcat: 2.79% (0.1969 => 0.2024, std.dev.: 0.0019) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 9.38% (0.0224 => 0.0245, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.71% (0.0254 => 0.0332, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -19.54% (0.0302 => 0.0243, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.90% (0.0384 => 0.0422, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -20.00% (0.0190 => 0.0152, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/test1: -4.44% (0.0180 => 0.0172, std.dev.: 0.0023) SingleSource/UnitTests/byval-alignment: 40.00% (0.0230 => 0.0322, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -14.29% (0.0007 => 0.0006, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 3.13% (0.1438 => 0.1483, std.dev.: 0.0062) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -0.45% (1.1329 => 1.1278, std.dev.: 0.0319) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.15% (0.1462 => 0.1508, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.03% (0.4164 => 0.4038, std.dev.: 0.0242) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.17% (0.1369 => 0.1353, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.27% (0.0641 => 0.0588, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 27.18% (0.0195 => 0.0248, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.42% (0.0578 => 0.0564, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.54% (1.1437 => 1.1375, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.64% (0.0627 => 0.0631, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.33% (0.0180 => 0.0174, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.09% (0.8017 => 0.8010, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 500.00% (0.0001 => 0.0006, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 62.90% (0.0062 => 0.0101, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 05:33:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 07:33:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121025123313.EE4712A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5204?compare_to=5200&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5204, Order: 166676, Start Time: 2012-10-25 11:12:46, End Time: 2012-10-25 12:33:08 To: 5200, Order: 166671, Start Time: 2012-10-25 09:22:26, End Time: 2012-10-25 10:42:58 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (75 on baseline) New Passes: 0 (7 on baseline) Performance Regressions: 0 (202 on baseline) Performance Improvements: 1 (45 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 87 (12 on baseline) Unchanged Tests: 954 (639 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -11.82% (0.4545 => 0.4008, std.dev.: 0.0201) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.13% (0.6300 => 0.6292, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 0.08% (17.3440 => 17.3572, std.dev.: 0.0138) MultiSource/Applications/kimwitu++/kc: -0.05% (15.7725 => 15.7649, std.dev.: 0.0144) MultiSource/Benchmarks/Bullet/bullet: -0.14% (57.3650 => 57.2865, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.20% (0.0492 => 0.0491, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.20% (0.0494 => 0.0493, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0461 => 0.0461, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.22% (0.0463 => 0.0462, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.22% (0.0450 => 0.0449, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.22% (0.0452 => 0.0451, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0444 => 0.0444) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.22% (0.0446 => 0.0445, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.22% (0.0463 => 0.0462, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.22% (0.0464 => 0.0463, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.22% (0.0457 => 0.0456, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0458 => 0.0458, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0446 => 0.0446) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.22% (0.0448 => 0.0447, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0454 => 0.0454, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0455 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0465 => 0.0465, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0467 => 0.0467) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0441 => 0.0441, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0443 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.22% (0.0454 => 0.0453, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.22% (0.0455 => 0.0454, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0445 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0446 => 0.0446, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0437 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.23% (0.0438 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0435 => 0.0435, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0437 => 0.0437, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0473 => 0.0473) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.21% (0.0475 => 0.0474, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.23% (0.0435 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0435 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.23% (0.0436 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.23% (0.0437 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.23% (0.0444 => 0.0443, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.22% (0.0445 => 0.0444, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.24% (8.3270 => 8.3074, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.29% (0.6955 => 0.6935, std.dev.: 0.0053) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1439 => 0.1438, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.09% (0.0690 => 0.0648, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.03% (0.3827 => 0.3826, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -9.42% (63.2438 => 57.2865, std.dev.: 0.0115) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/BenchmarkGame/puzzle MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.04% (0.6962 => 0.3826, std.dev.: 0.0011) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/MallocBench/gs/gs: 14.00% (4.1105 => 4.6861, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 43.92% (1.1048 => 1.5900, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: 69.47% (3.4629 => 5.8687, std.dev.: 0.0024) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13514.86% (0.0720 => 9.8027, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049700.00% (0.0001 => 10.0498, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 69.53% (0.0256 => 0.0434) MultiSource/Benchmarks/McCat/08-main/main: 65.39% (0.2554 => 0.4224, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 51.44% (0.0243 => 0.0368) MultiSource/Benchmarks/PAQ8p/paq8p: 47.42% (10.3673 => 15.2838, std.dev.: 0.0110) SingleSource/Regression/C/sumarray2d: 44.65% (0.0271 => 0.0392, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 42.85% (0.1622 => 0.2317, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.68% (1.5859 => 2.2469, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 37.22% (0.1056 => 0.1449, std.dev.: 0.0004) SingleSource/UnitTests/vla: 33.80% (0.0355 => 0.0475, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.83% (2.2024 => 2.8814, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: 28.30% (0.1463 => 0.1877, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 24.41% (0.1655 => 0.2059, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 23.26% (0.0834 => 0.1028, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.90% (0.1566 => 0.1909, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: 21.44% (0.0485 => 0.0589, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 21.28% (0.2049 => 0.2485, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 20.88% (0.1432 => 0.1731, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.58% (7.0540 => 8.5055, std.dev.: 0.0102) MultiSource/Benchmarks/FreeBench/pifft/pifft: 19.88% (2.2022 => 2.6400, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 19.42% (0.1555 => 0.1857, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.06% (0.0871 => 0.1037, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 18.75% (0.5105 => 0.6062, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.28% (0.6675 => 0.7895, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/power/power: 17.78% (0.1440 => 0.1696, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.30% (0.1029 => 0.1207, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/tsp/tsp: 17.28% (0.1175 => 0.1378, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.28% (0.0793 => 0.0930, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 17.25% (0.0626 => 0.0734, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.15% (1.3050 => 1.5288, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: 16.91% (3.3354 => 3.8994, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/em3d/em3d: 16.81% (0.1695 => 0.1980, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.78% (0.2271 => 0.2652, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.62% (0.4615 => 0.5382, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/mst/mst: 16.60% (0.1163 => 0.1356, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.50% (0.3121 => 0.3636, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.48% (0.8172 => 0.9519, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 16.16% (0.1337 => 0.1553, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.14% (0.0886 => 0.1029, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 16.12% (0.7115 => 0.8262, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/oourafft: 16.09% (0.3282 => 0.3810, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.09% (0.1032 => 0.1198, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 16.07% (0.4879 => 0.5663, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.96% (0.5020 => 0.5821, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.80% (0.0842 => 0.0975, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.74% (1.5415 => 1.7842, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.70% (0.1510 => 0.1747, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.62% (0.1940 => 0.2243, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 15.53% (0.0818 => 0.0945, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 15.50% (0.3109 => 0.3591, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 15.48% (0.0672 => 0.0776, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.41% (0.0675 => 0.0779) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 15.08% (8.1363 => 9.3631, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.06% (0.0770 => 0.0886, std.dev.: 0.0017) MultiSource/Applications/Burg/burg: 15.06% (1.1642 => 1.3395, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.04% (0.1117 => 0.1285, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.04% (0.0838 => 0.0964, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 15.02% (0.3423 => 0.3937, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.00% (0.2107 => 0.2423, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 14.98% (0.3177 => 0.3653, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.97% (0.1236 => 0.1421, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.96% (0.9765 => 1.1226, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.88% (0.0746 => 0.0857, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.87% (1.7609 => 2.0228, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.86% (4.2646 => 4.8983, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 14.85% (9.4845 => 10.8931, std.dev.: 0.0126) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 14.81% (0.1438 => 0.1651, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.68% (0.2758 => 0.3163, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 14.64% (0.1906 => 0.2185, std.dev.: 0.0029) SingleSource/Benchmarks/McGill/exptree: 14.62% (0.0814 => 0.0933, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.58% (0.1584 => 0.1815, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.51% (0.5860 => 0.6710, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.50% (0.5981 => 0.6848, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.43% (0.2065 => 0.2363, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 14.42% (0.1151 => 0.1317, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 14.36% (0.3441 => 0.3935, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.33% (0.6450 => 0.7374, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 14.29% (0.7835 => 0.8955, std.dev.: 0.0038) SingleSource/UnitTests/SignlessTypes/rem: 14.25% (0.1144 => 0.1307, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 14.25% (0.0730 => 0.0834, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 14.23% (1.4186 => 1.6205, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.22% (0.1695 => 0.1936, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.19% (0.2700 => 0.3083, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.15% (0.0933 => 0.1065, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.12% (0.1062 => 0.1212, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.04% (0.0798 => 0.0910, std.dev.: 0.0030) MultiSource/Applications/treecc/treecc: 13.93% (2.0273 => 2.3097, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.90% (0.0770 => 0.0877, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 13.77% (1.1840 => 1.3470, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 13.67% (0.7433 => 0.8449, std.dev.: 0.0035) MultiSource/Benchmarks/sim/sim: 13.55% (0.3387 => 0.3846, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 13.52% (4.9449 => 5.6134, std.dev.: 0.0066) MultiSource/Applications/JM/ldecod/ldecod: 13.51% (10.4361 => 11.8458, std.dev.: 0.0112) MultiSource/Benchmarks/Olden/health/health: 13.49% (0.1268 => 0.1439, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.46% (5.0018 => 5.6752, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.46% (0.8067 => 0.9153, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: 13.46% (1.0722 => 1.2165, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.46% (0.3307 => 0.3752, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 13.38% (3.8723 => 4.3903, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.37% (7.9617 => 9.0258, std.dev.: 0.0166) MultiSource/Applications/oggenc/oggenc: 13.36% (5.7591 => 6.5287, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.29% (0.1625 => 0.1841, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.25% (0.5569 => 0.6307, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 13.08% (0.3180 => 0.3596, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 13.00% (0.4299 => 0.4858, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.83% (0.2603 => 0.2937, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.81% (0.0929 => 0.1048, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.78% (0.1330 => 0.1500, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 12.77% (0.3092 => 0.3487, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.76% (1.1861 => 1.3375, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 12.46% (0.8921 => 1.0033, std.dev.: 0.0018) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 12.44% (0.1125 => 0.1265, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: 12.15% (1.5603 => 1.7499, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.14% (0.2266 => 0.2541, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 12.02% (0.6456 => 0.7232, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.01% (0.8101 => 0.9074, std.dev.: 0.0008) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.99% (0.1143 => 0.1280, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.59% (1.1194 => 1.2491, std.dev.: 0.0063) MultiSource/Applications/siod/siod: 11.33% (2.2969 => 2.5571, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/synchronized: 11.26% (0.3561 => 0.3962, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 11.18% (0.3927 => 0.4366, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.15% (0.3543 => 0.3938, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 11.09% (0.3473 => 0.3858, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.06% (0.3543 => 0.3935, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.98% (0.3516 => 0.3902, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.95% (0.3497 => 0.3880, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.94% (0.3886 => 0.4311, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions: 10.92% (0.3828 => 0.4246, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 10.91% (0.3694 => 0.4097, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 10.91% (0.4620 => 0.5124, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.89% (0.1892 => 0.2098, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 10.75% (0.4289 => 0.4750, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 10.63% (21.9371 => 24.2686, std.dev.: 0.0192) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 10.60% (0.0953 => 0.1054, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.54% (0.1044 => 0.1154, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.38% (0.3865 => 0.4266, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 10.29% (0.3422 => 0.3774, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.16% (0.4203 => 0.4630, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 9.88% (0.4048 => 0.4448, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 9.85% (0.3684 => 0.4047, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.85% (0.4103 => 0.4507, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 9.82% (0.5925 => 0.6507, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.66% (0.4636 => 0.5084, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 9.65% (0.6030 => 0.6612, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.40% (0.3427 => 0.3749, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 9.19% (0.3603 => 0.3934, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 9.19% (0.7326 => 0.7999, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.14% (0.2430 => 0.2652, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.94% (0.3826 => 0.4168, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 8.94% (17.1811 => 18.7167, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.71% (0.3650 => 0.3968, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 8.65% (0.2831 => 0.3076, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.64% (14.3668 => 15.6074, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.46% (0.4064 => 0.4408, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 8.39% (0.3098 => 0.3358, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.23% (0.2891 => 0.3129, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 8.23% (0.2905 => 0.3144, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.21% (3.8922 => 4.2117, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 8.20% (0.3232 => 0.3497, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 8.19% (0.3283 => 0.3552, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.10% (0.3136 => 0.3390, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.10% (0.3162 => 0.3418, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/except: 8.08% (0.2871 => 0.3103, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.00% (2.0665 => 2.2318, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.97% (0.2872 => 0.3101, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.90% (0.3052 => 0.3293, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.88% (0.2793 => 0.3013, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 7.85% (0.2802 => 0.3022, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.84% (0.2756 => 0.2972, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 7.71% (0.2725 => 0.2935, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 7.68% (0.2877 => 0.3098, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 7.66% (0.3379 => 0.3638, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 7.48% (0.2714 => 0.2917, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 6.97% (1.2842 => 1.3737, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 6.52% (0.3131 => 0.3335, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.66% (0.3935 => 0.4079, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.35% (0.3817 => 0.3945, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1726, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 14.25% (0.9957 => 1.1376, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.93% (1.1396 => 1.2528, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3692, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.64% (2.8904 => 3.0824, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 3.80% (1.9405 => 2.0143, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.68% (4.2280 => 4.3414, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.61% (0.3987 => 0.4091, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.29% (1.0313 => 1.0549, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bisort/bisort: 1.82% (0.8333 => 0.8485, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.79% (3.6395 => 3.7047, std.dev.: 0.0110) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.54% (2.6546 => 2.6954, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2079, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 1.49% (11.6436 => 11.8175, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 1.29% (4.4649 => 4.5224, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 1.10% (9.1159 => 9.2165, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/heapsort: 1.09% (3.8532 => 3.8952, std.dev.: 0.0111) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.07% (6.5088 => 6.5784, std.dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.99% (6.6874 => 0.1347, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -77.12% (0.8651 => 0.1979, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -36.68% (5.2763 => 3.3411, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.12% (5.3855 => 3.7633, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -29.68% (5.3526 => 3.7638, std.dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: -9.44% (54.1659 => 49.0504, std.dev.: 0.0456) MultiSource/Applications/ClamAV/clamscan: -2.43% (22.1758 => 21.6373, std.dev.: 0.0185) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -52.88% (8.0499 => 3.7930, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.39% (1.1492 => 0.7655, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4751, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -16.08% (1.6925 => 1.4203, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.53% (0.0998 => 0.0853) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.70% (1.2258 => 1.0701, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -11.46% (1.2373 => 1.0955, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -10.93% (1.5373 => 1.3693, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.48% (19.9488 => 18.2566, std.dev.: 0.0277) MultiSource/Benchmarks/FreeBench/mason/mason: -7.77% (0.2161 => 0.1993, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.97% (1.8329 => 1.7051, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0145) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.16% (1.6805 => 1.5938, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.89% (1.5835 => 1.5060, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.33% (8.1563 => 7.8035, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0016) MultiSource/Applications/siod/siod: -3.64% (3.2827 => 3.1632, std.dev.: 0.0024) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8776, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.4998, std.dev.: 0.0047) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.72% (0.4808 => 0.4677, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Applications/sqlite3/sqlite3: -2.11% (4.6441 => 4.5462, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0839, std.dev.: 0.0164) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6801, std.dev.: 0.0019) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5093, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4213, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/lists: -1.28% (6.2999 => 6.2190, std.dev.: 0.0119) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2879, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 20.33% (0.5229 => 0.6292, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 15.80% (14.9895 => 17.3572, std.dev.: 0.0138) MultiSource/Applications/kimwitu++/kc: 11.37% (14.1553 => 15.7649, std.dev.: 0.0144) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 16.05% (7.1582 => 8.3074, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.46% (0.6222 => 0.6935, std.dev.: 0.0053) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.16% (0.1485 => 0.1438, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 06:50:29 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 08:50:29 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121025135029.17B8C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5205?compare_to=5202&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5205, Order: 166676, Start Time: 2012-10-25 12:25:19, End Time: 2012-10-25 13:50:22 To: 5202, Order: 166674, Start Time: 2012-10-25 10:37:01, End Time: 2012-10-25 12:02:05 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (186 on baseline) Unchanged Tests: 1042 (852 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.10% (2.0478 => 2.1112, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: 2.24% (3.1932 => 3.2648, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: 2.20% (7.4937 => 7.6583, std.dev.: 0.0137) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.01% (0.1431 => 0.1302, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.09% (0.3821 => 0.3512, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: -7.88% (0.3831 => 0.3529, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.80% (0.3884 => 0.3581, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -7.78% (0.3880 => 0.3578, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -7.76% (0.3812 => 0.3516, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -7.72% (0.3848 => 0.3551, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -7.70% (0.3896 => 0.3596, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -7.68% (2.4924 => 2.3011, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -7.66% (0.4176 => 0.3856, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -7.66% (0.4033 => 0.3724, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.66% (0.3891 => 0.3593, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -7.50% (0.4199 => 0.3884, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -7.43% (0.4280 => 0.3962, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -7.42% (0.3357 => 0.3108, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.39% (22.4056 => 20.7498, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -7.29% (3.5339 => 3.2762, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: -7.18% (0.2160 => 0.2005, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -7.16% (0.3658 => 0.3396, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: -7.11% (16.1920 => 15.0410, std.dev.: 0.0144) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.08% (0.2428 => 0.2256, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: -7.06% (0.9179 => 0.8531, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: -7.05% (7.0961 => 6.5958, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/ray: -7.03% (0.4151 => 0.3859, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.03% (0.3142 => 0.2921, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.03% (0.9542 => 0.8871, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: -7.02% (0.1796 => 0.1670, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -7.00% (0.2871 => 0.2670, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.99% (0.9852 => 0.9163, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.96% (1.6474 => 1.5327, std.dev.: 0.0172) MultiSource/Benchmarks/mafft/pairlocalalign: -6.94% (9.2283 => 8.5875, std.dev.: 0.0123) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.94% (0.2695 => 0.2508, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.91% (1.0544 => 0.9815, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.88% (0.3837 => 0.3573, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: -6.88% (1.2515 => 1.1654, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.87% (0.3057 => 0.2847, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: -6.87% (0.1500 => 0.1397, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.86% (0.4083 => 0.3803, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: -6.84% (0.3026 => 0.2819, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -6.84% (0.3481 => 0.3243, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.83% (0.3849 => 0.3586, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hash2: -6.83% (0.4861 => 0.4529, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: -6.83% (1.1530 => 1.0743, std.dev.: 0.0017) MultiSource/Applications/siod/siod: -6.82% (2.4021 => 2.2382, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.82% (0.2903 => 0.2705, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.82% (0.3931 => 0.3663, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: -6.81% (0.2939 => 0.2739, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -6.80% (1.1450 => 1.0671, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -6.80% (0.3323 => 0.3097, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: -6.79% (0.3446 => 0.3212, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: -6.79% (0.3255 => 0.3034, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: -6.78% (0.2933 => 0.2734, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -6.78% (1.3148 => 1.2256, std.dev.: 0.0109) MultiSource/Benchmarks/McCat/08-main/main: -6.77% (0.2659 => 0.2479, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -6.76% (0.1761 => 0.1642, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.76% (0.1584 => 0.1477, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: -6.75% (0.3394 => 0.3165, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.75% (2.1713 => 2.0248, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wc: -6.74% (0.3205 => 0.2989, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.73% (6.7716 => 6.3160, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: -6.72% (4.3330 => 4.0418, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.71% (0.2548 => 0.2377, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: -6.70% (0.2849 => 0.2658, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -6.70% (0.3491 => 0.3257, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.70% (0.1716 => 0.1601, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: -6.69% (0.2989 => 0.2789, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.68% (1.4642 => 1.3664, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.67% (1.2300 => 1.1479, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.66% (4.8161 => 4.4954, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.65% (0.6484 => 0.6053, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -6.64% (0.3025 => 0.2824, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -6.64% (0.4321 => 0.4034, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: -6.64% (0.4427 => 0.4133, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.64% (5.4682 => 5.1053, std.dev.: 0.0194) SingleSource/Benchmarks/Shootout-C++/heapsort: -6.63% (0.3016 => 0.2816, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -6.63% (0.3621 => 0.3381, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.62% (1.3722 => 1.2814, std.dev.: 0.0008) MultiSource/Applications/lua/lua: -6.61% (4.0594 => 3.7909, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.61% (2.2587 => 2.1094, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.61% (4.5069 => 4.2092, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.60% (4.0323 => 3.7661, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/05-eks/eks: -6.60% (0.4515 => 0.4217, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: -6.60% (0.3788 => 0.3538, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -6.60% (0.5168 => 0.4827, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.58% (0.2355 => 0.2200, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -6.58% (0.6750 => 0.6306, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.57% (4.8802 => 4.5596, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.54% (0.7919 => 0.7401, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -6.54% (0.7447 => 0.6960, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: -6.54% (0.3059 => 0.2859, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: -6.53% (15.5079 => 14.4945, std.dev.: 0.0149) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.52% (1.2784 => 1.1950, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: -6.52% (0.4248 => 0.3971, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -6.52% (0.9557 => 0.8934, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: -6.50% (0.4524 => 0.4230, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.49% (0.3252 => 0.3041, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.48% (0.5478 => 0.5123, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: -6.48% (0.1621 => 0.1516, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.46% (0.4813 => 0.4502, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: -6.44% (0.3867 => 0.3618, std.dev.: 0.0044) MultiSource/Applications/kimwitu++/kc: -6.43% (18.2933 => 17.1166, std.dev.: 0.0101) MultiSource/Benchmarks/sim/sim: -6.43% (0.3406 => 0.3187, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.43% (1.6364 => 1.5312, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference: -6.43% (0.7779 => 0.7279, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: -6.42% (0.3194 => 0.2989, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.42% (0.7339 => 0.6868, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.42% (0.6297 => 0.5893, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -6.42% (0.5705 => 0.5339, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.41% (0.6736 => 0.6304, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.41% (0.5805 => 0.5433, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -6.40% (0.2985 => 0.2794, std.dev.: 0.0058) SingleSource/UnitTests/ObjC++/Hello: -6.40% (0.6347 => 0.5941, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: -6.39% (0.3581 => 0.3352, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -6.39% (0.6230 => 0.5832, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.39% (0.5591 => 0.5234, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.38% (0.6052 => 0.5666, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.38% (0.6304 => 0.5902, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.37% (14.2083 => 13.3028, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.36% (0.5925 => 0.5548, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -6.35% (0.6441 => 0.6032, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.33% (0.5859 => 0.5488, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -6.33% (0.7524 => 0.7048, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: -6.31% (1.3864 => 1.2989, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -6.31% (0.6660 => 0.6240, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.29% (0.5863 => 0.5494, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.29% (0.4916 => 0.4607, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.26% (0.5802 => 0.5439, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.25% (0.6395 => 0.5995, std.dev.: 0.0041) MultiSource/Benchmarks/Bullet/bullet: -6.25% (34.0927 => 31.9603, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.25% (0.6194 => 0.5807, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -6.24% (0.6395 => 0.5996, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.23% (0.5857 => 0.5492, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.21% (0.6260 => 0.5871, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -6.21% (2.1401 => 2.0073, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.20% (0.3483 => 0.3267, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -6.19% (0.5575 => 0.5230, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -6.19% (17.1032 => 16.0452, std.dev.: 0.0250) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.18% (0.7021 => 0.6587, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -6.18% (0.6667 => 0.6255, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.16% (0.6446 => 0.6049, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: -6.15% (3.5154 => 3.2991, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.15% (0.6681 => 0.6270, std.dev.: 0.0068) MultiSource/Applications/ClamAV/clamscan: -6.14% (15.2527 => 14.3164, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.12% (0.6293 => 0.5908, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -6.12% (8.0126 => 7.5225, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.11% (0.5581 => 0.5240, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -6.11% (0.5569 => 0.5229, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: -6.07% (0.2999 => 0.2817, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -6.07% (0.6676 => 0.6271, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -6.06% (0.3319 => 0.3118, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.02% (0.5329 => 0.5008, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -6.01% (0.5570 => 0.5235, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -6.00% (0.5849 => 0.5498, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.00% (0.5999 => 0.5639, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -6.00% (0.6033 => 0.5671, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -6.00% (0.5567 => 0.5233, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.99% (0.6189 => 0.5818, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.97% (0.8521 => 0.8012, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: -5.96% (0.7982 => 0.7506, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.96% (1.2210 => 1.1482, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.96% (0.5941 => 0.5587, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.94% (0.5688 => 0.5350, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.92% (0.6440 => 0.6059, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.87% (0.2385 => 0.2245, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/09-vor/vor: -5.84% (0.3271 => 0.3080, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.76% (1.2221 => 1.1517, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -5.69% (0.1879 => 0.1772, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.65% (0.2106 => 0.1987, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.65% (0.5456 => 0.5148, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.47% (0.7198 => 0.6804, std.dev.: 0.0046) MultiSource/Applications/spiff/spiff: -5.41% (0.8418 => 0.7963, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: -5.37% (0.1862 => 0.1762, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.20% (0.2001 => 0.1897, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: -4.94% (5.0226 => 4.7746, std.dev.: 0.0121) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.87% (0.2278 => 0.2167, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.52% (0.2277 => 0.2174, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.43% (0.9077 => 0.8675, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: -4.07% (1.5610 => 1.4975, std.dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -2.36% (20.7746 => 20.2844, std.dev.: 0.0669) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.34% (7.5137 => 5.7602, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/richards_benchmark: -8.70% (1.2842 => 1.1725, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fbench: -3.93% (2.2633 => 2.1743, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7060, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.52% (6.5735 => 6.4733, std.dev.: 0.0014) Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 07:16:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 09:16:23 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121025141623.CF2A62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5206?compare_to=5203&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5206, Order: 166677, Start Time: 2012-10-25 12:52:19, End Time: 2012-10-25 14:16:19 To: 5203, Order: 166676, Start Time: 2012-10-25 10:49:29, End Time: 2012-10-25 12:13:32 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 6 (69 on baseline) Performance Improvements: 6 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 963 (901 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.01% (0.6508 => 0.6704, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.98% (0.8422 => 0.8673, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.89% (1.2641 => 1.2880, std.dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: 22.60% (3.0610 => 3.7529, std.dev.: 0.0956) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.67% (0.2892 => 0.2998, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 2.58% (1.3037 => 1.3373, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -2.38% (0.8477 => 0.8275, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.39% (0.9949 => 0.9811, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -1.30% (0.8153 => 0.8047, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.23% (3.2503 => 3.2104, std.dev.: 0.0148) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.37% (7.2062 => 6.9630, std.dev.: 0.0853) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.35% (1.2577 => 1.2407, std.dev.: 0.0054) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.13% (16.5304 => 16.5521, std.dev.: 0.0541) MultiSource/Applications/obsequi/Obsequi: 0.25% (1.0469 => 1.0495, std.dev.: 0.0158) MultiSource/Applications/sqlite3/sqlite3: 0.41% (0.6412 => 0.6438, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: -3.96% (0.1943 => 0.1866, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.28% (0.1711 => 0.1672, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.55% (0.3252 => 0.3335, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.48% (0.2505 => 0.2468, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.15% (0.3374 => 0.3369, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.93% (0.2437 => 0.2390, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/bigfib: -0.15% (0.6024 => 0.6015, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/mandel: -3.69% (0.0488 => 0.0470, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.45% (0.3317 => 0.3332, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/strcat: -0.44% (0.2024 => 0.2015, std.dev.: 0.0020) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.82% (0.0245 => 0.0247, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -15.07% (0.0219 => 0.0186, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0426 => 0.0426, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.60% (0.0332 => 0.0330, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 28.40% (0.0243 => 0.0312, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0422 => 0.0422, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/casts: 25.00% (0.0152 => 0.0190, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/test1: 26.16% (0.0172 => 0.0217, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 5.59% (0.0322 => 0.0340, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 116.67% (0.0006 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.47% (0.1483 => 0.1476, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.08% (1.1278 => 1.1287, std.dev.: 0.0221) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 0.73% (0.1508 => 0.1519, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.79% (0.4038 => 0.4070, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.77% (0.1353 => 0.1329, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.88% (0.0588 => 0.0652, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 11.69% (0.0248 => 0.0277) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.71% (0.0564 => 0.0568, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.47% (1.1375 => 1.1428, std.dev.: 0.0520) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.32% (0.0631 => 0.0629, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 45.98% (0.0174 => 0.0254, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.79% (0.8010 => 0.7947, std.dev.: 0.0079) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: -83.33% (0.0006 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -61.39% (0.0101 => 0.0039, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.06% (2.1832 => 1.6580, std.dev.: 0.0025) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.33% (0.0810 => 0.0918, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.94% (0.2180 => 0.2375, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.72% (0.6010 => 0.6474, std.dev.: 0.0103) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.65% (0.3137 => 0.3377, std.dev.: 0.0077) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.39% (0.8321 => 0.8936, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.63% (0.6287 => 0.6704, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.47% (0.1885 => 0.2007, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.44% (0.8148 => 0.8673, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.06% (0.7473 => 0.7926, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.00% (0.4847 => 0.5138, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.62% (0.2240 => 0.2366, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.61% (0.5961 => 0.6236, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.34% (0.2998 => 0.3128, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.12% (1.1606 => 1.2084, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.65% (1.1685 => 1.2112, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.40% (0.3003 => 0.3105, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.39% (0.9435 => 0.9755, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.35% (8.6476 => 8.9373, std.dev.: 0.0463) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.28% (0.3717 => 0.3839, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.26% (1.3279 => 1.3712, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.83% (1.2526 => 1.2880, std.dev.: 0.0051) MultiSource/Applications/hbd/hbd: 2.81% (1.4269 => 1.4670, std.dev.: 0.0132) MultiSource/Benchmarks/MallocBench/gs/gs: 2.80% (4.1305 => 4.2463, std.dev.: 0.0378) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.43% (6.6074 => 6.7682, std.dev.: 0.0514) MultiSource/Applications/lua/lua: 2.41% (3.8189 => 3.9109, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.27% (0.8359 => 0.8549, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.26% (1.4479 => 1.4806, std.dev.: 0.0053) MultiSource/Applications/JM/ldecod/ldecod: 2.24% (6.7320 => 6.8828, std.dev.: 0.0289) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.20% (4.4880 => 4.5868, std.dev.: 0.0347) MultiSource/Applications/ClamAV/clamscan: 2.20% (14.7684 => 15.0931, std.dev.: 0.0605) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.13% (4.4873 => 4.5828, std.dev.: 0.0290) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.13% (0.9074 => 0.9267, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.03% (1.6386 => 1.6719, std.dev.: 0.0079) MultiSource/Applications/JM/lencod/lencod: 1.99% (15.3280 => 15.6333, std.dev.: 0.0937) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.96% (1.1170 => 1.1389, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.89% (0.8611 => 0.8774, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.88% (0.8331 => 0.8488, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.81% (0.8697 => 0.8854, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.71% (0.9056 => 0.9211, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.70% (0.8316 => 0.8457, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.68% (0.8457 => 0.8599, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.68% (0.8050 => 0.8185, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.60% (0.8338 => 0.8471, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.55% (0.8261 => 0.8389, std.dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 1.50% (14.2605 => 14.4742, std.dev.: 0.0786) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.47% (0.8712 => 0.8840, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.47% (0.8855 => 0.8985, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.45% (0.7932 => 0.8047, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.38% (1.5315 => 1.5526, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.32% (0.8086 => 0.8193, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 1.32% (2.2184 => 2.2477, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.30% (0.8518 => 0.8629, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.29% (0.8885 => 0.9000, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.27% (0.9688 => 0.9811, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.23% (0.8716 => 0.8823, std.dev.: 0.0027) MultiSource/Benchmarks/PAQ8p/paq8p: 1.14% (2.3764 => 2.4035, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 55.76% (1.5795 => 2.4603, std.dev.: 0.0208) SingleSource/Benchmarks/Shootout-C++/heapsort: 22.99% (3.0515 => 3.7529, std.dev.: 0.0956) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 19.32% (0.0528 => 0.0630, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.32% (0.3186 => 0.3483, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.16% (1.1857 => 1.2825, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 6.02% (63.1822 => 66.9855, std.dev.: 0.1169) SingleSource/Benchmarks/Dhrystone/dry: 4.61% (0.5081 => 0.5315, std.dev.: 0.0082) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.2887 => 0.2998, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 2.73% (3.6643 => 3.7645, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/richards_benchmark: 2.58% (1.3037 => 1.3373, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 1.97% (0.6205 => 0.6327, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.30% (1.5941 => 1.6148, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.25% (2.4490 => 2.4796, std.dev.: 0.0118) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -5.15% (29.8330 => 28.2957, std.dev.: 0.4097) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.47% (7.2130 => 6.9630, std.dev.: 0.0853) SingleSource/Benchmarks/Shootout-C++/hash2: -1.32% (3.4237 => 3.3784, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.06% (3.3479 => 3.3124, std.dev.: 0.0096) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.64% (16.4461 => 16.5521, std.dev.: 0.0541) MultiSource/Applications/obsequi/Obsequi: 2.27% (1.0262 => 1.0495, std.dev.: 0.0158) MultiSource/Applications/sqlite3/sqlite3: 1.67% (0.6332 => 0.6438, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: 1.91% (0.1831 => 0.1866, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.25% (0.1559 => 0.1672, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.79% (0.3123 => 0.3335, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.20% (0.2463 => 0.2468, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.75% (0.3344 => 0.3369, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.10% (0.2364 => 0.2390, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/bigfib: 0.08% (0.6010 => 0.6015, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/mandel: 9.56% (0.0429 => 0.0470, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.02% (0.3266 => 0.3332, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/strcat: 2.34% (0.1969 => 0.2015, std.dev.: 0.0020) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 10.27% (0.0224 => 0.0247, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 51.22% (0.0123 => 0.0186, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.90% (0.0384 => 0.0422, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0190 => 0.0190, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 47.83% (0.0230 => 0.0340, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.64% (0.1438 => 0.1476, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -0.37% (1.1329 => 1.1287, std.dev.: 0.0221) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.90% (0.1462 => 0.1519, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.26% (0.4164 => 0.4070, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.92% (0.1369 => 0.1329, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.72% (0.0641 => 0.0652, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.73% (0.0578 => 0.0568, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.08% (1.1437 => 1.1428, std.dev.: 0.0520) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.32% (0.0627 => 0.0629, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 41.11% (0.0180 => 0.0254, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.87% (0.8017 => 0.7947, std.dev.: 0.0079) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -37.10% (0.0062 => 0.0039, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 07:25:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 09:25:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121025142528.B40422A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5207?compare_to=5204&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5207, Order: 166677, Start Time: 2012-10-25 13:04:54, End Time: 2012-10-25 14:25:23 To: 5204, Order: 166676, Start Time: 2012-10-25 11:12:46, End Time: 2012-10-25 12:33:08 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (75 on baseline) New Passes: 0 (7 on baseline) Performance Regressions: 0 (200 on baseline) Performance Improvements: 1 (46 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 87 (12 on baseline) Unchanged Tests: 954 (640 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.46% (15.2838 => 15.0599, std.dev.: 0.0019) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.03% (0.6292 => 0.6290, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: -0.23% (17.3572 => 17.3170, std.dev.: 0.0057) MultiSource/Applications/kimwitu++/kc: -0.35% (15.7649 => 15.7101, std.dev.: 0.0166) MultiSource/Benchmarks/Bullet/bullet: -0.05% (57.2865 => 57.2560, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.61% (0.0491 => 0.0494) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.61% (0.0493 => 0.0496, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.43% (0.0461 => 0.0463, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.65% (0.0462 => 0.0465, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.67% (0.0449 => 0.0452, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.67% (0.0451 => 0.0454, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.45% (0.0444 => 0.0446, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.67% (0.0445 => 0.0448) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.65% (0.0462 => 0.0465, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.65% (0.0463 => 0.0466) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.66% (0.0456 => 0.0459, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.44% (0.0458 => 0.0460, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.45% (0.0446 => 0.0448) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.67% (0.0447 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.44% (0.0454 => 0.0456) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.66% (0.0455 => 0.0458) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.65% (0.0465 => 0.0468) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.43% (0.0467 => 0.0469, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.68% (0.0441 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.45% (0.0443 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.66% (0.0453 => 0.0456, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.66% (0.0454 => 0.0457, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.45% (0.0445 => 0.0447) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.45% (0.0446 => 0.0448, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.46% (0.0437 => 0.0439) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.69% (0.0437 => 0.0440, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.46% (0.0435 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.46% (0.0437 => 0.0439, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.63% (0.0473 => 0.0476, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.63% (0.0474 => 0.0477) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.69% (0.0434 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.69% (0.0435 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.69% (0.0435 => 0.0438) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.69% (0.0436 => 0.0439, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.68% (0.0443 => 0.0446, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.68% (0.0444 => 0.0447) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.19% (8.3074 => 8.2919, std.dev.: 0.0151) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.42% (0.6935 => 0.6964, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1438 => 0.1439) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0648 => 0.0649, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.03% (0.3826 => 0.3825, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -9.47% (63.2438 => 57.2560, std.dev.: 0.0162) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/BenchmarkGame/puzzle MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.06% (0.6962 => 0.3825, std.dev.: 0.0094) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/MallocBench/gs/gs: 13.80% (4.1105 => 4.6777, std.dev.: 0.0157) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 43.41% (1.1048 => 1.5844, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.91% (3.4629 => 5.8493, std.dev.: 0.0050) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13505.00% (0.0720 => 9.7956, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049900.00% (0.0001 => 10.0500, std.dev.: 0.0013) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 69.14% (0.0256 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 64.72% (0.2554 => 0.4207, std.dev.: 0.0031) SingleSource/Regression/C/sumarraymalloc: 51.03% (0.0243 => 0.0367, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 45.26% (10.3673 => 15.0599, std.dev.: 0.0019) SingleSource/Regression/C/sumarray2d: 44.65% (0.0271 => 0.0392) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.24% (1.5859 => 2.2399, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 38.41% (0.1622 => 0.2245, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 36.65% (0.1056 => 0.1443, std.dev.: 0.0001) SingleSource/UnitTests/vla: 33.24% (0.0355 => 0.0473, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.46% (2.2024 => 2.8733, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: 28.23% (0.1463 => 0.1876, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 24.29% (0.1655 => 0.2057, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 23.50% (0.0834 => 0.1030, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.71% (0.1566 => 0.1906, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 21.41% (0.1555 => 0.1888, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/ReedSolomon: 21.18% (0.2049 => 0.2483, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: 21.03% (0.0485 => 0.0587, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 20.67% (0.1432 => 0.1728, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.18% (7.0540 => 8.4772, std.dev.: 0.0077) MultiSource/Benchmarks/FreeBench/pifft/pifft: 19.47% (2.2022 => 2.6310, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.94% (0.0871 => 0.1036, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 18.73% (0.5105 => 0.6061, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.26% (0.6675 => 0.7894, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.40% (0.1029 => 0.1208, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 17.08% (0.1440 => 0.1686, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 17.02% (0.1175 => 0.1375, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.00% (1.3050 => 1.5269, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/lists: 16.93% (0.0626 => 0.0732, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.90% (0.0793 => 0.0927, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 16.81% (0.1695 => 0.1980, std.dev.: 0.0058) MultiSource/Applications/d/make_dparser: 16.80% (3.3354 => 3.8959, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.78% (0.2271 => 0.2652, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 16.77% (0.1163 => 0.1358, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 16.68% (0.1337 => 0.1560, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.57% (0.3121 => 0.3638, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.55% (0.4615 => 0.5379, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.47% (0.8172 => 0.9518, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 16.03% (0.0842 => 0.0977, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 16.03% (0.3282 => 0.3808, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.02% (0.5020 => 0.5824, std.dev.: 0.0108) MultiSource/Applications/minisat/minisat: 15.94% (0.7115 => 0.8249, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.91% (0.0886 => 0.1027, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.70% (1.5415 => 1.7835, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.70% (0.1032 => 0.1194, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 15.66% (0.4879 => 0.5643, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.56% (0.0675 => 0.0780, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.52% (0.1940 => 0.2241, std.dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: 15.44% (0.3109 => 0.3589, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.43% (0.1510 => 0.1743, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.22% (0.1117 => 0.1287, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 15.11% (0.3177 => 0.3657, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 15.07% (1.7609 => 2.0262, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/matrix: 15.04% (0.0818 => 0.0941, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 15.01% (8.1363 => 9.3578, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.92% (0.2065 => 0.2373, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 14.90% (0.1906 => 0.2190, std.dev.: 0.0026) MultiSource/Applications/Burg/burg: 14.89% (1.1642 => 1.3375, std.dev.: 0.0078) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 14.88% (0.1438 => 0.1652, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 14.88% (0.0672 => 0.0772, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.88% (0.0746 => 0.0857) MultiSource/Benchmarks/mafft/pairlocalalign: 14.88% (9.4845 => 10.8954, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.86% (0.2107 => 0.2420, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.81% (0.0770 => 0.0884, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 14.78% (0.3423 => 0.3929, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.68% (0.0838 => 0.0961, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.66% (4.2646 => 4.8896, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.65% (0.9765 => 1.1196, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/exptree: 14.62% (0.0814 => 0.0933, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.54% (0.2758 => 0.3159, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.48% (0.1236 => 0.1415, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.46% (0.1584 => 0.1813, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 14.42% (0.1151 => 0.1317, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 14.40% (0.7433 => 0.8503, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.29% (0.0798 => 0.0912, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.25% (0.5860 => 0.6695, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 14.25% (0.0730 => 0.0834, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.23% (0.6450 => 0.7368, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 14.22% (0.7835 => 0.8949, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.19% (0.5981 => 0.6830, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.12% (0.1062 => 0.1212, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.94% (1.4186 => 1.6163, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.93% (0.2700 => 0.3076, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 13.90% (0.1144 => 0.1303, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.83% (0.0933 => 0.1062, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.77% (0.0770 => 0.0876, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 13.73% (4.9449 => 5.6239, std.dev.: 0.0134) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.69% (0.1695 => 0.1927, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 13.61% (2.0273 => 2.3033, std.dev.: 0.0056) MultiSource/Benchmarks/nbench/nbench: 13.60% (1.1840 => 1.3450, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 13.56% (0.1268 => 0.1440, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.52% (5.0018 => 5.6778, std.dev.: 0.0050) MultiSource/Benchmarks/sim/sim: 13.46% (0.3387 => 0.3843, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 13.42% (0.4299 => 0.4876, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.40% (0.3307 => 0.3750, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 13.35% (5.7591 => 6.5277, std.dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 13.32% (10.4361 => 11.8258, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.26% (0.8067 => 0.9137, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.24% (0.0929 => 0.1052, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.15% (7.9617 => 9.0083, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.13% (0.5569 => 0.6300, std.dev.: 0.0025) MultiSource/Applications/lua/lua: 13.10% (3.8723 => 4.3795, std.dev.: 0.0191) MultiSource/Applications/lemon/lemon: 13.08% (1.0722 => 1.2124, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 12.86% (0.3180 => 0.3589, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.86% (0.1625 => 0.1834) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.86% (0.1330 => 0.1501, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 12.61% (1.5603 => 1.7570, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.56% (0.2603 => 0.2930, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.54% (1.1861 => 1.3348, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 12.53% (0.1125 => 0.1266, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.45% (0.3543 => 0.3984, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 12.42% (0.3092 => 0.3476, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 12.22% (0.8921 => 1.0011, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.09% (0.2266 => 0.2540, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.09% (0.3441 => 0.3857, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 11.97% (0.6456 => 0.7229, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.92% (0.8101 => 0.9067, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 11.89% (0.3473 => 0.3886, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.87% (0.3927 => 0.4393, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 11.77% (0.3543 => 0.3960, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.72% (0.3497 => 0.3907, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.69% (0.3516 => 0.3927, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.68% (0.3561 => 0.3977, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.64% (0.1143 => 0.1276) SingleSource/UnitTests/ObjC/for-in: 11.61% (0.3694 => 0.4123, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.53% (0.3886 => 0.4334, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 11.47% (0.4289 => 0.4781, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 11.47% (0.3828 => 0.4267, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.32% (1.1194 => 1.2461, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 11.21% (0.4620 => 0.5138, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/lists: 11.02% (0.3422 => 0.3799, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.89% (0.1892 => 0.2098, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 10.64% (2.2969 => 2.5413, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 10.60% (0.0953 => 0.1054, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.56% (0.3865 => 0.4273, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.54% (0.4203 => 0.4646, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.44% (0.4636 => 0.5120, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 10.43% (21.9371 => 24.2250, std.dev.: 0.0195) SingleSource/Benchmarks/Shootout-C++/lists1: 10.21% (0.3684 => 0.4060, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 10.20% (0.4048 => 0.4461, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.09% (0.4103 => 0.4517, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 9.87% (0.1044 => 0.1147, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 9.71% (0.3603 => 0.3953, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 9.60% (0.5925 => 0.6494, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.52% (0.6030 => 0.6604, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.17% (0.3826 => 0.4177, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 8.97% (0.3098 => 0.3376, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.93% (0.3650 => 0.3976, std.dev.: 0.0039) SingleSource/Regression/C++/ofstream_ctor: 8.92% (0.2905 => 0.3164, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/strcat: 8.87% (0.2831 => 0.3082, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.86% (0.7326 => 0.7975, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.77% (0.2430 => 0.2643, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.76% (0.3162 => 0.3439, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.75% (0.2891 => 0.3144, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 8.73% (0.3232 => 0.3514, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 8.71% (0.3283 => 0.3569, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.71% (0.4064 => 0.4418, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.70% (0.3427 => 0.3725, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.64% (0.2872 => 0.3120, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 8.63% (17.1811 => 18.6633, std.dev.: 0.0198) SingleSource/Benchmarks/Shootout-C++/ary2: 8.61% (0.3379 => 0.3670, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.53% (2.0665 => 2.2428, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.53% (0.2756 => 0.2991, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 8.50% (0.2871 => 0.3115, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.45% (0.3136 => 0.3401, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 8.45% (0.2877 => 0.3120, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.34% (14.3668 => 15.5648, std.dev.: 0.0189) SingleSource/Benchmarks/Shootout-C++/hello: 8.33% (0.2714 => 0.2940, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.31% (0.2793 => 0.3025, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 8.29% (0.2725 => 0.2951, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 8.26% (0.3052 => 0.3304, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.00% (3.8922 => 4.2035, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 7.99% (0.2802 => 0.3026, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 7.37% (1.2842 => 1.3788, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 7.09% (0.3131 => 0.3353, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.12% (0.3935 => 0.4097, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.03% (0.3817 => 0.3971, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1725, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.31% (0.9957 => 1.1282, std.dev.: 0.0079) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 10.02% (1.1396 => 1.2538, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3685, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.64% (2.8904 => 3.0823, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.65% (0.3463 => 0.3624, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 3.82% (1.9405 => 2.0147, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.63% (4.2280 => 4.3392, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.61% (0.3987 => 0.4091, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0313 => 1.0563, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.80% (3.6395 => 3.7051, std.dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.59% (2.6546 => 2.6969, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2077, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.49% (11.6436 => 11.8171, std.dev.: 0.0103) MultiSource/Applications/viterbi/viterbi: 1.26% (4.4649 => 4.5210, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.19% (9.1159 => 9.2248, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.10% (6.5088 => 6.5803, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.99% (6.6874 => 0.1346, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -77.14% (0.8651 => 0.1978, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -36.84% (5.2763 => 3.3323, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.47% (5.3855 => 3.7444, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.04% (5.3526 => 3.7446, std.dev.: 0.0022) SingleSource/UnitTests/Vector/constpool: -9.55% (54.1659 => 48.9932, std.dev.: 0.0455) MultiSource/Applications/ClamAV/clamscan: -2.61% (22.1758 => 21.5965, std.dev.: 0.0116) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -52.87% (8.0499 => 3.7943, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.37% (1.1492 => 0.7657, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4751, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -16.20% (1.6925 => 1.4183, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.73% (0.0998 => 0.0851, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.70% (1.2258 => 1.0701, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.47% (1.2373 => 1.0954, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: -10.97% (1.5373 => 1.3686, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.37% (19.9488 => 18.2787, std.dev.: 0.1153) MultiSource/Benchmarks/FreeBench/mason/mason: -7.73% (0.2161 => 0.1994, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.00% (1.8329 => 1.7046, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.17% (1.6805 => 1.5937, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5073, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.31% (8.1563 => 7.8051, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.67% (3.2827 => 3.1623, std.dev.: 0.0030) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8775, std.dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4986, std.dev.: 0.0039) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.85% (0.4808 => 0.4671, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: -2.15% (4.6441 => 4.5442, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.87% (10.2830 => 10.0903, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6823, std.dev.: 0.0008) SingleSource/UnitTests/Vector/multiplies: -1.66% (2.5528 => 2.5103, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4211, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/lists: -1.19% (6.2999 => 6.2251, std.dev.: 0.0121) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2878, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8564, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 20.29% (0.5229 => 0.6290, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 15.53% (14.9895 => 17.3170, std.dev.: 0.0057) MultiSource/Applications/kimwitu++/kc: 10.98% (14.1553 => 15.7101, std.dev.: 0.0166) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 15.84% (7.1582 => 8.2919, std.dev.: 0.0151) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.93% (0.6222 => 0.6964, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.10% (0.1485 => 0.1439) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 08:19:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 10:19:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121025151924.EFC912A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5208?compare_to=5201&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5208, Order: 166676, Start Time: 2012-10-25 12:03:25, End Time: 2012-10-25 15:19:19 To: 5201, Order: 166664, Start Time: 2012-10-25 07:59:30, End Time: 2012-10-25 11:15:24 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (170 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1042 (718 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 43.20% (0.0625 => 0.0895, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.08% (0.1063 => 0.1404, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.70% (0.2969 => 0.3732, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.59% (0.1106 => 0.1389, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.84% (0.0475 => 0.0593, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 24.79% (1.5932 => 1.9882, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.14% (0.4139 => 0.5138, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.55% (0.4994 => 0.6170, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.47% (0.5900 => 0.7285, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.11% (0.0714 => 0.0879, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.04% (0.4253 => 0.5233, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.92% (0.5000 => 0.6146, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.60% (0.0584 => 0.0716, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.49% (0.0547 => 0.0670, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.63% (0.0897 => 0.1091, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 21.37% (0.0599 => 0.0727) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.36% (0.1620 => 0.1966, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.25% (0.1021 => 0.1238, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 20.60% (0.1107 => 0.1335, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.40% (0.1549 => 0.1865, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 20.20% (0.0604 => 0.0726, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 20.04% (0.0948 => 0.1138, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.96% (0.0541 => 0.0649, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 19.91% (0.0633 => 0.0759, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.83% (0.3903 => 0.4677, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.78% (0.0642 => 0.0769, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.76% (0.1103 => 0.1321, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.69% (0.0584 => 0.0699, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 19.52% (0.1619 => 0.1935, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 19.49% (0.0821 => 0.0981, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.24% (0.1003 => 0.1196, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.20% (0.1604 => 0.1912, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.10% (0.0822 => 0.0979, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.62% (0.2014 => 0.2389, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.26% (0.1462 => 0.1729, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.17% (0.3890 => 0.4597, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 18.16% (0.0947 => 0.1119, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 18.07% (0.0808 => 0.0954, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 17.83% (0.5889 => 0.6939, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 17.80% (0.5826 => 0.6863, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 17.57% (0.1218 => 0.1432, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.47% (1.3152 => 1.5449, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.36% (0.2736 => 0.3211, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 17.34% (0.1505 => 0.1766, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 17.20% (0.4029 => 0.4722, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/mst/mst: 17.05% (0.0698 => 0.0817, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 16.95% (0.5546 => 0.6486, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 16.91% (0.1088 => 0.1272, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.71% (0.2866 => 0.3345, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.60% (0.3271 => 0.3814, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 16.56% (1.8794 => 2.1906, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.54% (3.5627 => 4.1520, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.47% (0.4658 => 0.5425, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.43% (0.5026 => 0.5852, std.dev.: 0.0020) MultiSource/Applications/hbd/hbd: 16.41% (0.9697 => 1.1288, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.29% (0.1160 => 0.1349, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.28% (0.3930 => 0.4570, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.27% (1.6211 => 1.8848, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.14% (0.2875 => 0.3339, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.06% (0.1968 => 0.2284, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 15.83% (0.1421 => 0.1646, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 15.81% (0.7171 => 0.8305, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/fibo: 15.71% (0.2725 => 0.3153, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 15.65% (1.0781 => 1.2468, std.dev.: 0.0061) SingleSource/Regression/C++/ofstream_ctor: 15.51% (0.3004 => 0.3470, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 15.50% (0.1284 => 0.1483, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.49% (0.2911 => 0.3362, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.49% (0.2738 => 0.3162, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 15.40% (0.2714 => 0.3132, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.39% (0.4361 => 0.5032, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 15.38% (0.2750 => 0.3173, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.32% (2.0673 => 2.3840, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/objinst: 15.27% (0.2823 => 0.3254, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 15.25% (0.2780 => 0.3204, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.24% (0.2729 => 0.3145, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 15.18% (0.2813 => 0.3240, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.15% (0.2792 => 0.3215, std.dev.: 0.0055) MultiSource/Applications/hexxagon/hexxagon: 15.13% (0.9909 => 1.1408, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/random: 15.13% (0.2803 => 0.3227, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.12% (0.3195 => 0.3678, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 15.08% (0.2811 => 0.3235, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.08% (1.9694 => 2.2663, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wc: 15.02% (0.3096 => 0.3561, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.01% (4.4195 => 5.0827, std.dev.: 0.0103) MultiSource/Applications/ClamAV/clamscan: 14.93% (4.2109 => 4.8395, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.93% (2.7292 => 3.1366, std.dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: 14.89% (23.5202 => 27.0220, std.dev.: 0.0158) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.67% (1.9966 => 2.2896, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.57% (0.3362 => 0.3852, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 14.51% (0.3267 => 0.3741, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.50% (0.1090 => 0.1248, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 14.47% (0.3317 => 0.3797, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 14.43% (0.3258 => 0.3728, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.28% (0.3060 => 0.3497, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 13.98% (0.2075 => 0.2365, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 13.95% (0.3678 => 0.4191, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.92% (0.3124 => 0.3559, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 13.86% (0.3348 => 0.3812, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.78% (0.3845 => 0.4375, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.71% (0.3282 => 0.3732, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.71% (0.3625 => 0.4122, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 13.60% (0.2566 => 0.2915, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 13.57% (0.3477 => 0.3949, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 13.55% (1.4269 => 1.6202, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: 13.53% (0.3726 => 0.4230, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: 13.43% (0.7875 => 0.8933, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 13.27% (0.4251 => 0.4815, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 13.17% (0.4146 => 0.4692, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.14% (0.3690 => 0.4175, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.11% (0.3981 => 0.4503, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 13.08% (2.1653 => 2.4486, std.dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 12.77% (4.6177 => 5.2076, std.dev.: 0.0115) SingleSource/UnitTests/ObjC/exceptions-2: 12.74% (0.3446 => 0.3885, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 12.73% (0.3496 => 0.3941, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.73% (0.3465 => 0.3906, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 12.66% (0.3460 => 0.3898, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.64% (0.3488 => 0.3929, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 12.64% (0.3442 => 0.3877, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.63% (0.3469 => 0.3907, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 12.49% (0.5012 => 0.5638, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/property: 12.44% (0.3650 => 0.4104, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 12.30% (0.3643 => 0.4091, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 12.28% (2.1013 => 2.3594, std.dev.: 0.0065) SingleSource/UnitTests/ObjC/parameter-passing: 12.22% (0.3724 => 0.4179, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.01% (0.2040 => 0.2285, std.dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 11.71% (0.2691 => 0.3006, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.42% (0.6435 => 0.7170, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.28% (0.1383 => 0.1539, std.dev.: 0.0037) MultiSource/Applications/SPASS/SPASS: 11.10% (5.5417 => 6.1570, std.dev.: 0.0045) MultiSource/Applications/lambda-0_1_3/lambda: 10.78% (0.3498 => 0.3875, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.60% (0.1028 => 0.1137, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.59% (0.2068 => 0.2287, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 10.54% (0.6634 => 0.7333, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.41% (0.2737 => 0.3022, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 10.19% (0.4847 => 0.5341, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 10.01% (0.3336 => 0.3670, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.73% (0.3084 => 0.3384, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 9.22% (2.0346 => 2.2222, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.03% (0.2103 => 0.2293, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 8.95% (0.2391 => 0.2605, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.51% (4.6926 => 5.0921, std.dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.13% (0.5361 => 0.5797, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.99% (11.6398 => 12.5693, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.55% (0.7426 => 0.7987, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.49% (0.5584 => 0.6002, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 6.45% (11.9555 => 12.7262, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.61% (0.3792 => 0.3929, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6535, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.22% (0.5917 => 0.6699, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 8.35% (0.2802 => 0.3036, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6096, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 5.84% (0.2122 => 0.2246, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 4.96% (12.0509 => 12.6486, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.87% (0.3693 => 0.3873, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1705, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-2: 3.99% (1.8057 => 1.8777, std.dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/dry: 2.68% (14.0481 => 14.4249, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1914, std.dev.: 0.0056) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.69% (3.1722 => 3.2257, std.dev.: 0.0038) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3046, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2860, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.25% (1.0142 => 1.0269, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5146, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5970, std.dev.: 0.0087) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.43% (2.4764 => 2.4411, std.dev.: 0.0068) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.47% (25.4195 => 16.4031, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ary2: -10.45% (0.2402 => 0.2151, std.dev.: 0.0046) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9766, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7731, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -3.20% (11.2080 => 10.8492, std.dev.: 0.0115) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.15% (0.6293 => 0.6095, std.dev.: 0.0056) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7732, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5216, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.37% (17.2379 => 16.8285, std.dev.: 0.0142) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.15% (41.7953 => 40.8951, std.dev.: 0.0166) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.82% (10.7630 => 10.5667, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4950, std.dev.: 0.0066) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.22% (21.9346 => 21.6663, std.dev.: 0.0850) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0434, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.05% (105.3826 => 104.2746, std.dev.: 0.0395) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.04% (3.3991 => 3.3639, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 08:38:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 10:38:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121025153844.603BB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5209?compare_to=5205&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5209, Order: 166680, Start Time: 2012-10-25 14:13:29, End Time: 2012-10-25 15:38:37 To: 5205, Order: 166676, Start Time: 2012-10-25 12:25:19, End Time: 2012-10-25 13:50:22 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 1 (185 on baseline) Unchanged Tests: 1041 (853 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.26% (20.2844 => 20.0283, std.dev.: 0.0201) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.63% (2.0478 => 2.1017, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/salsa20: 2.63% (7.4937 => 7.6906, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash2: 2.15% (3.1932 => 3.2619, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.22% (0.1431 => 0.1299) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.11% (0.3821 => 0.3511, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -7.71% (2.4924 => 2.3002, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: -7.52% (0.3831 => 0.3543, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -7.50% (0.3880 => 0.3589, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.49% (22.4056 => 20.7266, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/trivial-interface: -7.48% (0.3812 => 0.3527, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.43% (0.3891 => 0.3602, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -7.42% (0.3896 => 0.3607, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -7.42% (0.3357 => 0.3108, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -7.39% (0.4033 => 0.3735, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -7.35% (0.3848 => 0.3565, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.29% (0.3884 => 0.3601, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -7.28% (3.5339 => 3.2767, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions: -7.23% (0.4176 => 0.3874, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.19% (0.3142 => 0.2916, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -7.19% (0.4199 => 0.3897, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.17% (0.2428 => 0.2254, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: -7.13% (4.3330 => 4.0239, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.13% (0.9542 => 0.8862, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -7.11% (2.4021 => 2.2312, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -7.08% (0.3658 => 0.3399, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -7.08% (0.4280 => 0.3977, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/football/football: -7.04% (0.9179 => 0.8533, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: -7.01% (0.4151 => 0.3860, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: -6.99% (0.2160 => 0.2009, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -6.98% (16.1920 => 15.0615, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.95% (0.9852 => 0.9167, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.94% (0.1584 => 0.1474, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: -6.92% (7.0961 => 6.6050, std.dev.: 0.0080) MultiSource/Applications/Burg/burg: -6.92% (1.2515 => 1.1649, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: -6.91% (9.2283 => 8.5903, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.90% (0.1796 => 0.1672, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.90% (1.6474 => 1.5337, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: -6.88% (1.1450 => 1.0662, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.86% (5.4682 => 5.0933, std.dev.: 0.0065) MultiSource/Benchmarks/nbench/nbench: -6.85% (1.1530 => 1.0740, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.84% (1.0544 => 0.9823, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.83% (0.2548 => 0.2374, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.83% (0.2695 => 0.2511, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.80% (1.4642 => 1.3646, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: -6.79% (1.3148 => 1.2255, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.78% (1.2300 => 1.1466, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/08-main/main: -6.77% (0.2659 => 0.2479, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -6.75% (0.4861 => 0.4533, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: -6.71% (0.5168 => 0.4821, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.70% (0.1716 => 0.1601, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.69% (0.3931 => 0.3668, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.69% (0.4083 => 0.3810, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.68% (0.3849 => 0.3592, std.dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.66% (6.7716 => 6.3204, std.dev.: 0.0031) MultiSource/Applications/lua/lua: -6.66% (4.0594 => 3.7890, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: -6.65% (15.5079 => 14.4763, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.64% (0.7919 => 0.7393, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -6.63% (0.2985 => 0.2787, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -6.62% (0.2989 => 0.2791, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -6.62% (0.2871 => 0.2681, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.62% (1.3722 => 1.2814, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: -6.61% (18.2933 => 17.0838, std.dev.: 0.0179) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.61% (0.6736 => 0.6291, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.58% (0.2355 => 0.2200, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.57% (4.5069 => 4.2110, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.55% (1.6364 => 1.5292, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.54% (0.3837 => 0.3586, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.53% (1.2784 => 1.1949, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -6.53% (0.3446 => 0.3221, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -6.52% (0.3481 => 0.3254, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.52% (4.0323 => 3.7694, std.dev.: 0.0079) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.51% (4.8802 => 4.5624, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_container: -6.50% (0.9557 => 0.8936, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hello: -6.49% (0.2849 => 0.2664, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -6.49% (0.6750 => 0.6312, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -6.48% (0.3394 => 0.3174, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.48% (2.2587 => 2.1123, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -6.48% (0.2933 => 0.2743, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: -6.48% (0.1621 => 0.1516, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.48% (0.3057 => 0.2859, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: -6.47% (0.3491 => 0.3265, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.47% (0.6304 => 0.5896, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.47% (4.8161 => 4.5046, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/random: -6.46% (0.2939 => 0.2749, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -6.46% (0.3406 => 0.3186, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -6.46% (0.7447 => 0.6966, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: -6.43% (0.4524 => 0.4233, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.43% (2.1713 => 2.0317, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.43% (0.5478 => 0.5126, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -6.42% (0.3581 => 0.3351, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.42% (0.6484 => 0.6068, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.41% (0.6052 => 0.5664, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: -6.41% (0.3621 => 0.3389, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -6.40% (0.3205 => 0.3000, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.39% (0.5805 => 0.5434, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.37% (0.3483 => 0.3261, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.36% (0.6260 => 0.5862, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: -6.35% (0.3025 => 0.2833, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.35% (14.2083 => 13.3066, std.dev.: 0.0169) SingleSource/Benchmarks/Shootout-C++/lists1: -6.34% (0.3867 => 0.3622, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -6.33% (0.4515 => 0.4229, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: -6.33% (1.3864 => 1.2986, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: -6.33% (0.4248 => 0.3979, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.33% (0.5925 => 0.5550, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -6.32% (0.6230 => 0.5836, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -6.32% (0.6395 => 0.5991, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.32% (0.6681 => 0.6259, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.32% (0.5859 => 0.5489, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.31% (0.5591 => 0.5238, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -6.31% (0.3059 => 0.2866, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.31% (0.7339 => 0.6876, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -6.29% (0.6660 => 0.6241, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.29% (0.6297 => 0.5901, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -6.28% (0.6676 => 0.6257, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -6.28% (0.5705 => 0.5347, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.27% (0.4813 => 0.4511, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -6.27% (0.4321 => 0.4050, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: -6.27% (0.3255 => 0.3051, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.24% (0.5581 => 0.5233, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -6.23% (0.7524 => 0.7055, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -6.23% (0.3194 => 0.2995, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -6.22% (17.1032 => 16.0394, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/except: -6.21% (0.3026 => 0.2838, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.21% (0.3252 => 0.3050, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.20% (0.4916 => 0.4611, std.dev.: 0.0019) MultiSource/Applications/d/make_dparser: -6.20% (3.5154 => 3.2975, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.19% (0.6395 => 0.5999, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.19% (0.6189 => 0.5806, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -6.19% (0.5575 => 0.5230, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -6.17% (34.0927 => 31.9904, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -6.16% (0.6667 => 0.6256, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -6.15% (0.7982 => 0.7491, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.15% (0.6440 => 0.6044, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/spellcheck: -6.14% (0.4427 => 0.4155, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: -6.14% (2.1401 => 2.0088, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.13% (0.5999 => 0.5631, std.dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: -6.12% (15.2527 => 14.3185, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.12% (0.5802 => 0.5447, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.12% (0.5688 => 0.5340, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.12% (0.6293 => 0.5908, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.11% (0.5857 => 0.5499, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.10% (0.6194 => 0.5816, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -6.10% (0.6033 => 0.5665, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: -6.10% (0.3788 => 0.3557, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.09% (0.5863 => 0.5506, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -6.08% (0.1761 => 0.1654, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.05% (0.6446 => 0.6056, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.04% (0.7021 => 0.6597, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -6.04% (0.5567 => 0.5231, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -6.02% (0.5569 => 0.5234, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -6.00% (0.3319 => 0.3120, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.98% (0.2106 => 0.1980, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.98% (0.5570 => 0.5237, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.98% (0.5941 => 0.5586, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.98% (0.5456 => 0.5130, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.97% (0.2278 => 0.2142, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.96% (0.2903 => 0.2730, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.95% (0.5329 => 0.5012, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.93% (0.5849 => 0.5502, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.90% (0.3016 => 0.2838, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.87% (8.0126 => 7.5422, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.85% (0.7198 => 0.6777, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.83% (0.2385 => 0.2246, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.81% (0.3323 => 0.3130, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.80% (0.2999 => 0.2825, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: -5.78% (0.3271 => 0.3082, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.77% (1.2221 => 1.1516, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.75% (1.2210 => 1.1508, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.64% (0.8521 => 0.8040, std.dev.: 0.0033) MultiSource/Applications/spiff/spiff: -5.61% (0.8418 => 0.7946, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -5.59% (0.1879 => 0.1774) SingleSource/UnitTests/ObjC++/property-reference: -5.54% (0.7779 => 0.7348, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -5.26% (0.6441 => 0.6102, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -5.26% (0.6347 => 0.6013, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -5.18% (5.0226 => 4.7626, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.00% (0.2001 => 0.1901, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.64% (0.9077 => 0.8656, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: -3.84% (1.5610 => 1.5011, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -3.59% (20.7746 => 20.0283, std.dev.: 0.0201) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7525, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/richards_benchmark: -8.73% (1.2842 => 1.1721, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -4.01% (2.2633 => 2.1726, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.85% (1.7753 => 1.7070, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.67% (1.3096 => 1.2746, std.dev.: 0.0082) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.89% (6.5735 => 6.4493, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 08:56:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 10:56:48 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121025155648.7792B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5210?compare_to=5206&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5210, Order: 166681, Start Time: 2012-10-25 14:33:13, End Time: 2012-10-25 15:56:44 To: 5206, Order: 166677, Start Time: 2012-10-25 12:52:19, End Time: 2012-10-25 14:16:19 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 9 (48 on baseline) Performance Improvements: 5 (3 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 961 (923 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/spiff/spiff: 1.31% (0.8104 => 0.8210, std.dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 12.68% (0.7674 => 0.8647, std.dev.: 0.0087) MultiSource/Benchmarks/nbench/nbench: 11.81% (20.8884 => 23.3561, std.dev.: 0.4183) MultiSource/Benchmarks/Olden/em3d/em3d: 4.58% (5.2229 => 5.4622, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/ReedSolomon: 2.37% (8.6277 => 8.8322, std.dev.: 0.0050) MultiSource/Applications/SPASS/SPASS: 2.26% (8.2722 => 8.4595, std.dev.: 0.0210) SingleSource/Benchmarks/Misc/pi: 1.89% (2.4603 => 2.5067, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/bh/bh: 1.37% (2.3673 => 2.3998, std.dev.: 0.0038) MultiSource/Benchmarks/llubenchmark/llu: 1.07% (2.0063 => 2.0277, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.05% (0.6474 => 0.6082, std.dev.: 0.0139) MultiSource/Applications/lua/lua: -1.82% (3.9109 => 3.8396, std.dev.: 0.0243) MultiSource/Applications/JM/ldecod/ldecod: -1.27% (6.8828 => 6.7953, std.dev.: 0.0309) MultiSource/Applications/JM/lencod/lencod: -1.06% (15.6333 => 15.4677, std.dev.: 0.0481) MultiSource/Applications/ClamAV/clamscan: -1.02% (15.0931 => 14.9395, std.dev.: 0.0277) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.12% (16.5521 => 16.5328, std.dev.: 0.0539) MultiSource/Applications/obsequi/Obsequi: -0.20% (1.0495 => 1.0474, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: -0.85% (0.6438 => 0.6383, std.dev.: 0.0060) MultiSource/Benchmarks/McCat/08-main/main: 3.05% (0.1866 => 0.1923, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.79% (0.1672 => 0.1642, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.09% (0.3335 => 0.3232, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.57% (0.2468 => 0.2454, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.27% (0.3369 => 0.3378, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.80% (0.2390 => 0.2433, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: -0.13% (0.6015 => 0.6007, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel: 3.62% (0.0470 => 0.0487, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.66% (0.3332 => 0.3310, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/strcat: -0.65% (0.2015 => 0.2002, std.dev.: 0.0094) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.21% (0.0247 => 0.0244, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 16.67% (0.0186 => 0.0217, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.94% (0.0426 => 0.0422, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.30% (0.0330 => 0.0331, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0312 => 0.0312, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -17.77% (0.0422 => 0.0347, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/casts: -34.74% (0.0190 => 0.0124, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/test1: -2.76% (0.0217 => 0.0211, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -0.59% (0.0340 => 0.0338, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.27% (0.1476 => 0.1472, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.96% (1.1287 => 1.1395, std.dev.: 0.0171) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -5.66% (0.1519 => 0.1433, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -100.00% (0.0001 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.79% (0.4070 => 0.4038, std.dev.: 0.0146) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.08% (0.1329 => 0.1330, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.75% (0.0652 => 0.0608, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -29.60% (0.0277 => 0.0195, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.05% (0.0568 => 0.0545, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.79% (1.1428 => 1.1338, std.dev.: 0.0273) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -64.52% (0.0031 => 0.0011, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.15% (0.0026 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.52% (0.0629 => 0.0588, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.31% (0.0254 => 0.0177, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: - (0.7947 => 0.7947, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 107.69% (0.0039 => 0.0081, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.67% (2.1832 => 1.6664, std.dev.: 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.95% (0.0810 => 0.0923, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 9.17% (0.1112 => 0.1214, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.55% (0.7473 => 0.7888, std.dev.: 0.0071) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.31% (0.8148 => 0.8581, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.09% (0.2279 => 0.2395, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.84% (0.2519 => 0.2641, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.60% (0.2998 => 0.3136, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.44% (0.3717 => 0.3845, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 3.27% (0.7950 => 0.8210, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.12% (0.8359 => 0.8620, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.19% (0.6586 => 0.6730, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.06% (0.8317 => 0.8488, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.94% (0.8697 => 0.8866, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.91% (1.4479 => 1.4756, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.79% (0.8805 => 0.8963, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.74% (0.8086 => 0.8227, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.74% (0.8007 => 0.8146, std.dev.: 0.0053) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.67% (6.6074 => 6.7180, std.dev.: 0.0284) MultiSource/Applications/SIBsim4/SIBsim4: 1.67% (1.2568 => 1.2778, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.64% (1.1170 => 1.1353, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.57% (0.8611 => 0.8746, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.55% (0.8597 => 0.8730, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.54% (1.6386 => 1.6639, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.51% (0.8656 => 0.8787, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.46% (0.8069 => 0.8187, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.43% (0.9688 => 0.9827, std.dev.: 0.0047) MultiSource/Benchmarks/PAQ8p/paq8p: 1.42% (2.3764 => 2.4102, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.38% (0.8712 => 0.8832, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 1.37% (1.9948 => 2.0222, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.37% (0.9908 => 1.0044, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.37% (0.8420 => 0.8535, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.26% (0.8855 => 0.8967, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.20% (0.8927 => 0.9034, std.dev.: 0.0031) MultiSource/Applications/ClamAV/clamscan: 1.16% (14.7684 => 14.9395, std.dev.: 0.0277) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.09% (1.2423 => 1.2558, std.dev.: 0.0025) MultiSource/Applications/siod/siod: 1.03% (2.2184 => 2.2412, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.70% (1.5795 => 2.5067, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.40% (1.1857 => 1.2853, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.31% (0.3186 => 0.3419, std.dev.: 0.0043) MultiSource/Benchmarks/nbench/nbench: 6.33% (21.9654 => 23.3561, std.dev.: 0.4183) MultiSource/Benchmarks/mafft/pairlocalalign: 6.05% (63.1822 => 67.0071, std.dev.: 0.0296) SingleSource/Benchmarks/Dhrystone/dry: 4.11% (0.5081 => 0.5290, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/ReedSolomon: 3.52% (8.5322 => 8.8322, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/hash: 3.22% (0.6205 => 0.6405, std.dev.: 0.0034) MultiSource/Applications/siod/siod: 2.59% (3.6643 => 3.7592, std.dev.: 0.0137) MultiSource/Benchmarks/Olden/bh/bh: 1.86% (2.3560 => 2.3998, std.dev.: 0.0038) MultiSource/Benchmarks/llubenchmark/llu: 1.55% (1.9967 => 2.0277, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.02% (4.8362 => 4.8855, std.dev.: 0.0152) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -5.16% (29.8330 => 28.2951, std.dev.: 0.0583) SingleSource/Benchmarks/Shootout-C++/hash2: -1.69% (3.4237 => 3.3658, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.24% (3.3479 => 3.3065, std.dev.: 0.0121) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.53% (16.4461 => 16.5328, std.dev.: 0.0539) MultiSource/Applications/obsequi/Obsequi: 2.07% (1.0262 => 1.0474, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: 0.81% (0.6332 => 0.6383, std.dev.: 0.0060) MultiSource/Benchmarks/McCat/08-main/main: 5.02% (0.1831 => 0.1923, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.32% (0.1559 => 0.1642, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.49% (0.3123 => 0.3232, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.37% (0.2463 => 0.2454, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.02% (0.3344 => 0.3378, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.92% (0.2364 => 0.2433, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: -0.05% (0.6010 => 0.6007, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel: 13.52% (0.0429 => 0.0487, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.35% (0.3266 => 0.3310, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/strcat: 1.68% (0.1969 => 0.2002, std.dev.: 0.0094) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.93% (0.0224 => 0.0244, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 76.42% (0.0123 => 0.0217, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.43% (0.0408 => 0.0422, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.31% (0.0254 => 0.0331, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -9.64% (0.0384 => 0.0347, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/casts: -34.74% (0.0190 => 0.0124, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/test1: 17.22% (0.0180 => 0.0211, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: 46.96% (0.0230 => 0.0338, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.36% (0.1438 => 0.1472, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.58% (1.1329 => 1.1395, std.dev.: 0.0171) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.98% (0.1462 => 0.1433, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.03% (0.4164 => 0.4038, std.dev.: 0.0146) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.85% (0.1369 => 0.1330, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.15% (0.0641 => 0.0608, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0195 => 0.0195, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.71% (0.0578 => 0.0545, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.87% (1.1437 => 1.1338, std.dev.: 0.0273) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1000.00% (0.0001 => 0.0011, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.22% (0.0627 => 0.0588, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.67% (0.0180 => 0.0177, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.87% (0.8017 => 0.7947, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 30.65% (0.0062 => 0.0081, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 09:15:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 11:15:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121025161543.BB6BC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5211?compare_to=5207&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5211, Order: 166681, Start Time: 2012-10-25 14:55:13, End Time: 2012-10-25 16:15:38 To: 5207, Order: 166677, Start Time: 2012-10-25 13:04:54, End Time: 2012-10-25 14:25:23 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (75 on baseline) New Passes: 0 (7 on baseline) Performance Regressions: 3 (201 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 87 (12 on baseline) Unchanged Tests: 952 (640 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 4.36% (15.0599 => 15.7160, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.27% (8.4772 => 8.5847, std.dev.: 0.0123) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.89% (54.4098 => 56.5245, std.dev.: 0.0635) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.17% (0.6290 => 0.6301, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 0.01% (17.3170 => 17.3180, std.dev.: 0.0119) MultiSource/Applications/kimwitu++/kc: 0.26% (15.7101 => 15.7502, std.dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: 0.18% (57.2560 => 57.3609, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.81% (0.0494 => 0.0490, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.81% (0.0496 => 0.0492) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.86% (0.0463 => 0.0459, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.86% (0.0465 => 0.0461, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.88% (0.0452 => 0.0448, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.66% (0.0454 => 0.0451) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.90% (0.0446 => 0.0442, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.89% (0.0448 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.86% (0.0465 => 0.0461, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.07% (0.0466 => 0.0461, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.87% (0.0459 => 0.0455, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.87% (0.0460 => 0.0456, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.89% (0.0448 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.67% (0.0450 => 0.0447) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.88% (0.0456 => 0.0452, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.87% (0.0458 => 0.0454, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.85% (0.0468 => 0.0464) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.85% (0.0469 => 0.0465, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.90% (0.0444 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.67% (0.0445 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.88% (0.0456 => 0.0452) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.66% (0.0457 => 0.0454, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.89% (0.0447 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.67% (0.0448 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.91% (0.0439 => 0.0435, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.91% (0.0440 => 0.0436, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.69% (0.0437 => 0.0434) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.68% (0.0439 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.84% (0.0476 => 0.0472) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.84% (0.0477 => 0.0473, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.92% (0.0437 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.91% (0.0438 => 0.0434) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.91% (0.0438 => 0.0434, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.91% (0.0439 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.90% (0.0446 => 0.0442, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.89% (0.0447 => 0.0443, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.06% (8.2919 => 8.2871, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.40% (0.6964 => 0.6936, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1439 => 0.1438, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.63% (0.0649 => 0.0692, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: - (0.3825 => 0.3825, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -9.30% (63.2438 => 57.3609, std.dev.: 0.0088) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/BenchmarkGame/puzzle MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.06% (0.6962 => 0.3825, std.dev.: 0.0012) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/MallocBench/gs/gs: 13.82% (4.1105 => 4.6787, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 43.85% (1.1048 => 1.5892, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 69.11% (3.4629 => 5.8562, std.dev.: 0.0276) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13506.11% (0.0720 => 9.7964, std.dev.: 0.0063) MultiSource/Benchmarks/MallocBench/gs/gs: 63200.00% (0.0001 => 0.0633, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050400.00% (0.0001 => 10.0505, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 69.53% (0.0256 => 0.0434) MultiSource/Benchmarks/McCat/08-main/main: 64.57% (0.2554 => 0.4203, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 51.59% (10.3673 => 15.7160, std.dev.: 0.0024) SingleSource/Regression/C/sumarraymalloc: 51.03% (0.0243 => 0.0367) SingleSource/Regression/C/sumarray2d: 44.28% (0.0271 => 0.0391, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.62% (1.5859 => 2.2460, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 38.90% (0.1622 => 0.2253, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 36.93% (0.1056 => 0.1446, std.dev.: 0.0001) SingleSource/UnitTests/vla: 33.80% (0.0355 => 0.0475, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.85% (2.2024 => 2.8818, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 28.50% (0.1463 => 0.1880, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 25.54% (0.0834 => 0.1047, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 24.71% (0.1655 => 0.2064, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.90% (0.1566 => 0.1909, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 21.70% (7.0540 => 8.5847, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/ReedSolomon: 21.43% (0.2049 => 0.2488, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 21.23% (0.1432 => 0.1736, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/hash: 21.03% (0.0485 => 0.0587, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 20.58% (2.2022 => 2.6554, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.63% (0.1029 => 0.1231, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 19.22% (0.5105 => 0.6086, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 19.16% (0.1555 => 0.1853, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.06% (0.0871 => 0.1037, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.28% (0.6675 => 0.7895, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 17.92% (0.0798 => 0.0941, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.90% (0.0648 => 0.0764, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 17.36% (0.1175 => 0.1379, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 17.29% (0.1440 => 0.1689, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.29% (1.3050 => 1.5306, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: 17.09% (0.0626 => 0.0733, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 17.00% (3.3354 => 3.9025, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/em3d/em3d: 16.99% (0.1695 => 0.1983, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.90% (0.0793 => 0.0927, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.89% (0.8172 => 0.9552, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/oourafft: 16.88% (0.3282 => 0.3836, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.88% (0.4615 => 0.5394, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.86% (0.2271 => 0.2654, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 16.68% (0.1163 => 0.1357, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.57% (0.3121 => 0.3638, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 16.53% (0.1337 => 0.1558, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.14% (0.0886 => 0.1029, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.12% (0.5020 => 0.5829, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.09% (1.5415 => 1.7896, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 16.09% (0.7115 => 0.8260, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 15.93% (0.4879 => 0.5656, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.89% (0.1032 => 0.1196, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 15.70% (0.3109 => 0.3597, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.63% (0.1510 => 0.1746, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.56% (0.0842 => 0.0973, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.46% (0.1940 => 0.2240, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.41% (0.0675 => 0.0779, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 15.31% (0.3423 => 0.3947, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 15.23% (0.3177 => 0.3661, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 15.18% (0.0672 => 0.0774, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 15.17% (1.7609 => 2.0281, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.16% (0.0838 => 0.0965, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 15.15% (0.0746 => 0.0859, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.13% (0.1117 => 0.1286, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 15.06% (8.1363 => 9.3618, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout/matrix: 15.04% (0.0818 => 0.0941, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 15.01% (1.1642 => 1.3389, std.dev.: 0.0066) MultiSource/Benchmarks/mafft/pairlocalalign: 14.99% (9.4845 => 10.9066, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.94% (0.0770 => 0.0885, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 14.88% (0.1438 => 0.1652, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.87% (4.2646 => 4.8987, std.dev.: 0.0130) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.86% (0.2107 => 0.2420, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.85% (0.9765 => 1.1215, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.77% (0.1584 => 0.1818, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.74% (0.5860 => 0.6724, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/exptree: 14.74% (0.0814 => 0.0934) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.64% (0.1236 => 0.1417, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 14.64% (0.1906 => 0.2185, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.63% (0.2700 => 0.3095, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 14.60% (0.1151 => 0.1319, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.50% (0.2758 => 0.3158, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.47% (0.6450 => 0.7383, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.43% (0.2065 => 0.2363, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 14.38% (0.0730 => 0.0835, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.36% (0.0933 => 0.1067, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 14.31% (1.4186 => 1.6216, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 14.29% (0.7835 => 0.8955, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.26% (0.5981 => 0.6834, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.16% (0.1695 => 0.1935, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.12% (0.1062 => 0.1212, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/rem: 14.07% (0.1144 => 0.1305, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 13.96% (4.9449 => 5.6352, std.dev.: 0.0061) MultiSource/Applications/treecc/treecc: 13.93% (2.0273 => 2.3098, std.dev.: 0.0044) MultiSource/Benchmarks/nbench/nbench: 13.93% (1.1840 => 1.3489, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.92% (5.0018 => 5.6983, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.77% (0.0770 => 0.0876, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 13.72% (0.1268 => 0.1442) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.70% (0.8067 => 0.9172, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 13.67% (0.3387 => 0.3850, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 13.67% (0.7433 => 0.8449, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 13.58% (5.7591 => 6.5411, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 13.54% (10.4361 => 11.8488, std.dev.: 0.0051) MultiSource/Applications/lemon/lemon: 13.45% (1.0722 => 1.2164, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 13.33% (0.4299 => 0.4872, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.27% (0.5569 => 0.6308, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.24% (0.0929 => 0.1052, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 13.23% (3.8723 => 4.3845, std.dev.: 0.0061) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.20% (7.9617 => 9.0124, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.18% (0.3307 => 0.3743, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 13.11% (0.3180 => 0.3597, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.05% (0.1625 => 0.1837, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.01% (0.1330 => 0.1503) MultiSource/Benchmarks/Olden/bh/bh: 12.77% (0.3092 => 0.3487, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.72% (0.2603 => 0.2934, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.71% (1.1861 => 1.3369, std.dev.: 0.0068) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 12.71% (0.1125 => 0.1268, std.dev.: 0.0026) MultiSource/Applications/hbd/hbd: 12.52% (1.5603 => 1.7556, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 12.43% (0.8921 => 1.0030, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.29% (0.3441 => 0.3864, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.27% (0.2266 => 0.2544, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.01% (0.8101 => 0.9074, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.00% (0.1892 => 0.2119, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 11.97% (0.6456 => 0.7229, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.81% (0.1143 => 0.1278, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.77% (1.1194 => 1.2511, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.57% (0.3543 => 0.3953, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 11.14% (0.4289 => 0.4767, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: 11.08% (0.3927 => 0.4362, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 11.06% (21.9371 => 24.3625, std.dev.: 0.0067) SingleSource/UnitTests/ObjC/trivial-interface: 11.03% (0.3473 => 0.3856, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 10.97% (0.4620 => 0.5127, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.95% (0.3561 => 0.3951, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 10.91% (2.2969 => 2.5476, std.dev.: 0.0217) SingleSource/UnitTests/ObjC/exceptions-4: 10.89% (0.3543 => 0.3929, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.83% (0.3694 => 0.4094, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.81% (0.3516 => 0.3896, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.79% (0.3828 => 0.4241, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.78% (0.3886 => 0.4305, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.78% (0.3497 => 0.3874, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 10.75% (0.3422 => 0.3790, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 10.49% (0.0953 => 0.1053, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.48% (0.3865 => 0.4270, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.30% (0.4203 => 0.4636, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.15% (0.1044 => 0.1150, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 9.96% (0.4048 => 0.4451, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 9.88% (0.3684 => 0.4048, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.75% (0.4103 => 0.4503, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.62% (0.4636 => 0.5082, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 9.49% (0.3603 => 0.3945, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.32% (0.6030 => 0.6592, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.28% (0.3826 => 0.4181, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.25% (0.5925 => 0.6473, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.14% (0.2430 => 0.2652, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.10% (0.3427 => 0.3739, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 9.05% (0.7326 => 0.7989, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 8.85% (17.1811 => 18.7017, std.dev.: 0.0211) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.71% (0.3650 => 0.3968, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 8.59% (0.3098 => 0.3364, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.54% (0.3162 => 0.3432, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 8.51% (0.2831 => 0.3072, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.49% (14.3668 => 15.5861, std.dev.: 0.0039) SingleSource/Regression/C++/ofstream_ctor: 8.47% (0.2905 => 0.3151, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 8.44% (0.3283 => 0.3560, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.41% (0.2891 => 0.3134, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.39% (0.4064 => 0.4405, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.32% (3.8922 => 4.2162, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.24% (2.0665 => 2.2367, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary: 8.23% (0.3232 => 0.3498, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.15% (0.2872 => 0.3106, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 8.14% (0.3379 => 0.3654, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.10% (0.3136 => 0.3390, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.06% (0.2793 => 0.3018, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.06% (0.2756 => 0.2978, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 8.03% (0.2877 => 0.3108, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 8.01% (0.2871 => 0.3101, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.90% (0.3052 => 0.3293, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.82% (0.2725 => 0.2938, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.71% (0.2802 => 0.3018, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 7.66% (0.2714 => 0.2922, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 7.11% (1.2842 => 1.3755, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 6.99% (0.3131 => 0.3350, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.07% (0.3935 => 0.4095, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.27% (0.3817 => 0.3942, std.dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1726, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.75% (0.9957 => 1.1326, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 10.00% (1.1396 => 1.2536, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3690, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.65% (2.8904 => 3.0825, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 3.80% (1.9405 => 2.0142, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.81% (0.3987 => 0.4099, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.60% (4.2280 => 4.3379, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.89% (3.6395 => 3.7082, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/bisort/bisort: 1.79% (0.8333 => 0.8482, std.dev.: 0.0012) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2074, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.51% (2.6546 => 2.6948, std.dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 1.50% (11.6436 => 11.8184, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 1.23% (4.4649 => 4.5197, std.dev.: 0.0034) MultiSource/Applications/minisat/minisat: 1.03% (9.1159 => 9.2095, std.dev.: 0.0329) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.95% (6.6874 => 0.1372, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -77.10% (0.8651 => 0.1981, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -36.67% (5.2763 => 3.3415, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -29.81% (5.3855 => 3.7802, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -29.42% (5.3526 => 3.7780, std.dev.: 0.0096) SingleSource/UnitTests/Vector/constpool: -9.47% (54.1659 => 49.0371, std.dev.: 0.0536) MultiSource/Applications/ClamAV/clamscan: -2.38% (22.1758 => 21.6477, std.dev.: 0.0215) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -52.87% (8.0499 => 3.7939, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.54% (1.1492 => 0.7638, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.64% (2.9695 => 2.4754, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4247, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.67% (1.2258 => 1.0705, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.46% (1.2373 => 1.0955, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: -11.09% (1.5373 => 1.3668, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.26% (19.9488 => 18.3011, std.dev.: 0.0186) MultiSource/Benchmarks/FreeBench/mason/mason: -8.01% (0.2161 => 0.1988, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.99% (1.8329 => 1.7048, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4780, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.12% (1.6805 => 1.5944, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.69% (1.5835 => 1.5092, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.37% (8.1563 => 7.7999, std.dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.61% (3.2827 => 3.1642, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8775, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.5011, std.dev.: 0.0034) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.66% (0.4808 => 0.4680, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -2.19% (4.6441 => 4.5426, std.dev.: 0.0058) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.84% (10.2830 => 10.0936, std.dev.: 0.0114) SingleSource/Benchmarks/Misc/flops: -1.68% (8.8334 => 8.6847, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -1.66% (2.5528 => 2.5103, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4200, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2878, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2348, std.dev.: 0.0033) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 20.50% (0.5229 => 0.6301, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 15.53% (14.9895 => 17.3180, std.dev.: 0.0119) MultiSource/Applications/kimwitu++/kc: 11.27% (14.1553 => 15.7502, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 15.77% (7.1582 => 8.2871, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.48% (0.6222 => 0.6936, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.16% (0.1485 => 0.1438, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.30% (0.2116 => 0.0692, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 10:27:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 12:27:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121025172714.DCA082A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5212?compare_to=5209&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5212, Order: 166683, Start Time: 2012-10-25 16:01:50, End Time: 2012-10-25 17:27:08 To: 5209, Order: 166680, Start Time: 2012-10-25 14:13:29, End Time: 2012-10-25 15:38:37 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 0 (183 on baseline) Unchanged Tests: 1041 (855 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.15% (78.9889 => 80.6863, std.dev.: 0.4185) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1013, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: 2.49% (7.4937 => 7.6803, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hash2: 2.31% (3.1932 => 3.2671, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.15% (0.1431 => 0.1300) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.14% (0.3821 => 0.3510, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -7.73% (2.4924 => 2.2998, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: -7.48% (0.3357 => 0.3106, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.46% (22.4056 => 20.7346, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -7.18% (3.5339 => 3.2800, std.dev.: 0.0138) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.13% (0.2428 => 0.2255, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -7.10% (0.1761 => 0.1636, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -7.08% (0.3658 => 0.3399, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: -7.06% (0.9179 => 0.8531, std.dev.: 0.0018) MultiSource/Applications/siod/siod: -7.05% (2.4021 => 2.2328, std.dev.: 0.0131) MultiSource/Applications/JM/lencod/lencod: -7.01% (16.1920 => 15.0566, std.dev.: 0.0095) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.01% (0.1584 => 0.1473, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: -6.99% (0.2160 => 0.2009, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -6.95% (7.0961 => 6.6030, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.94% (0.3142 => 0.2924, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: -6.93% (1.1450 => 1.0657, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.92% (1.6474 => 1.5334, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.90% (0.1796 => 0.1672, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -6.90% (4.3330 => 4.0341, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.89% (0.9852 => 0.9173, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.87% (0.2548 => 0.2373, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.86% (0.2695 => 0.2510, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -6.86% (9.2283 => 8.5949, std.dev.: 0.0141) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.82% (0.3884 => 0.3619, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -6.81% (0.3831 => 0.3570, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: -6.81% (0.2659 => 0.2478, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.80% (0.9542 => 0.8893, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: -6.78% (0.3880 => 0.3617, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -6.78% (1.2515 => 1.1667, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.78% (5.4682 => 5.0977, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/trivial-interface: -6.77% (0.3812 => 0.3554, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.75% (1.0544 => 0.9832, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/synchronized: -6.75% (0.3896 => 0.3633, std.dev.: 0.0058) MultiSource/Applications/lua/lua: -6.75% (4.0594 => 3.7854, std.dev.: 0.0062) SingleSource/UnitTests/ObjC/for-in: -6.72% (0.4033 => 0.3762, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -6.70% (0.4176 => 0.3896, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.70% (0.1716 => 0.1601, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.70% (1.3722 => 1.2803, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.69% (0.7919 => 0.7389, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.67% (0.4151 => 0.3874, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.65% (1.4642 => 1.3668, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.63% (0.3891 => 0.3633, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.60% (6.7716 => 6.3248, std.dev.: 0.0078) SingleSource/UnitTests/ObjC/parameter-passing: -6.59% (0.4280 => 0.3998, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -6.57% (0.3848 => 0.3595, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -6.55% (0.4199 => 0.3924, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.54% (4.5069 => 4.2120, std.dev.: 0.0119) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.54% (0.2355 => 0.2201, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -6.54% (15.5079 => 14.4940, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.53% (2.2587 => 2.1113, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.49% (0.6484 => 0.6063, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/ks/ks: -6.48% (0.1621 => 0.1516, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.48% (1.2784 => 1.1956, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.47% (1.2300 => 1.1504, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.47% (0.6681 => 0.6249, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: -6.46% (1.1530 => 1.0785, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: -6.45% (18.2933 => 17.1141, std.dev.: 0.0172) MultiSource/Benchmarks/Olden/bh/bh: -6.43% (0.2985 => 0.2793, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.43% (4.0323 => 3.7730, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.42% (4.8161 => 4.5068, std.dev.: 0.0075) MultiSource/Benchmarks/sim/sim: -6.40% (0.3406 => 0.3188, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.40% (4.8802 => 4.5679, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.39% (0.5805 => 0.5434, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: -6.37% (0.5168 => 0.4839, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -6.36% (0.4861 => 0.4552, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -6.36% (0.6230 => 0.5834, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.35% (1.6364 => 1.5325, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: -6.35% (1.3864 => 1.2984, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.33% (0.5478 => 0.5131, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.32% (0.6736 => 0.6310, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.32% (0.7339 => 0.6875, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.32% (0.6297 => 0.5899, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -6.32% (0.6395 => 0.5991, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -6.31% (0.5705 => 0.5345, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.30% (0.5591 => 0.5239, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.30% (0.6052 => 0.5671, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.29% (0.6260 => 0.5866, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -6.28% (1.3148 => 1.2322, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.28% (0.5925 => 0.5553, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.28% (0.5863 => 0.5495, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.28% (14.2083 => 13.3166, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/wordfreq: -6.27% (0.3491 => 0.3272, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.27% (0.4083 => 0.3827, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/05-eks/eks: -6.27% (0.4515 => 0.4232, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -6.25% (17.1032 => 16.0340, std.dev.: 0.0154) SingleSource/Benchmarks/Misc-C++/stepanov_container: -6.24% (0.9557 => 0.8961, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.24% (0.3849 => 0.3609, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.23% (0.6304 => 0.5911, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: -6.23% (0.7447 => 0.6983, std.dev.: 0.0119) MultiSource/Applications/d/make_dparser: -6.23% (3.5154 => 3.2965, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -6.23% (0.4321 => 0.4052, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.22% (0.7198 => 0.6750, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -6.22% (0.7524 => 0.7056, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -6.21% (0.7982 => 0.7486, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.21% (0.5859 => 0.5495, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.20% (0.3837 => 0.3599, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -6.18% (34.0927 => 31.9851, std.dev.: 0.0234) SingleSource/Benchmarks/Misc-C++/bigfib: -6.18% (0.6750 => 0.6333, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.18% (0.6395 => 0.6000, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -6.17% (0.6676 => 0.6264, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.17% (0.5999 => 0.5629, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.16% (0.8521 => 0.7996, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.15% (0.5857 => 0.5497, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.15% (0.5581 => 0.5238, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -6.14% (0.5941 => 0.5576, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.14% (0.5802 => 0.5446, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.13% (0.6194 => 0.5814, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -6.12% (0.3446 => 0.3235, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.12% (0.4916 => 0.4615, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.12% (0.3483 => 0.3270, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -6.11% (15.2527 => 14.3206, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.10% (0.6440 => 0.6047, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -6.09% (0.6667 => 0.6261, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: -6.09% (0.2989 => 0.2807, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -6.08% (0.6033 => 0.5666, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.08% (0.6446 => 0.6054, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -6.08% (0.6660 => 0.6255, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: -6.07% (0.2999 => 0.2817, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.06% (0.6189 => 0.5814, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.04% (0.5329 => 0.5007, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: -6.03% (0.2106 => 0.1979, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -6.03% (0.5575 => 0.5239, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.02% (0.6293 => 0.5914, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -6.01% (0.5456 => 0.5128, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.01% (0.7021 => 0.6599, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -6.00% (0.5567 => 0.5233, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.99% (0.3057 => 0.2874, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: -5.98% (2.1401 => 2.0121, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: -5.98% (0.3481 => 0.3273, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: -5.97% (0.4524 => 0.4254, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.96% (0.4813 => 0.4526, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: -5.96% (0.2871 => 0.2700, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -5.95% (0.3394 => 0.3192, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.94% (1.2221 => 1.1495, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.93% (0.5849 => 0.5502, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.93% (0.2278 => 0.2143, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.92% (0.5570 => 0.5240, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: -5.92% (0.2939 => 0.2765, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.90% (0.3252 => 0.3060, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.90% (0.3931 => 0.3699, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/wc: -5.90% (0.3205 => 0.3016, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -5.88% (0.3621 => 0.3408, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.88% (2.1713 => 2.0436, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.86% (0.2933 => 0.2761, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -5.86% (0.4248 => 0.3999, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.86% (1.2210 => 1.1495, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: -5.85% (0.3025 => 0.2848, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.84% (8.0126 => 7.5450, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/lists1: -5.82% (0.3867 => 0.3642, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.82% (0.3319 => 0.3126, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: -5.79% (0.2849 => 0.2684, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.78% (0.5688 => 0.5359) SingleSource/Benchmarks/Shootout-C++/except: -5.78% (0.3026 => 0.2851, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -5.78% (0.3255 => 0.3067, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: -5.76% (0.3194 => 0.3010, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -5.75% (0.3581 => 0.3375, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.74% (0.4427 => 0.4173, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: -5.72% (0.3271 => 0.3084, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.68% (0.2903 => 0.2738, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: -5.66% (0.3059 => 0.2886, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -5.64% (0.1879 => 0.1773, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.53% (0.2385 => 0.2253, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: -5.49% (0.3788 => 0.3580, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -5.39% (0.8418 => 0.7964, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.34% (0.3016 => 0.2855, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.30% (0.3323 => 0.3147, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -5.11% (5.0226 => 4.7657, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference: -5.08% (0.7779 => 0.7384, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: -4.84% (0.6347 => 0.6040, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -4.80% (0.6441 => 0.6132, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.33% (0.9077 => 0.8684, std.dev.: 0.0030) MultiSource/Applications/hbd/hbd: -4.01% (1.5610 => 1.4984, std.dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -3.50% (20.7746 => 20.0474, std.dev.: 0.0255) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.31% (7.5137 => 5.7620, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -8.72% (1.2842 => 1.1722, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.87% (2.2633 => 2.1756, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.80% (1.7753 => 1.7079, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.96% (1.3096 => 1.2839, std.dev.: 0.0066) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4732, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0003) Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 10:39:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 12:39:54 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121025173954.A32AC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5213?compare_to=5210&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5213, Order: 166684, Start Time: 2012-10-25 16:14:20, End Time: 2012-10-25 17:39:50 To: 5210, Order: 166681, Start Time: 2012-10-25 14:33:13, End Time: 2012-10-25 15:56:44 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 14 (63 on baseline) Performance Improvements: 1 (3 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 960 (908 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 10.68% (0.1039 => 0.1150, std.dev.: 0.0016) MultiSource/Applications/Burg/burg: 3.53% (1.2332 => 1.2767, std.dev.: 0.0096) SingleSource/UnitTests/Vector/constpool: 2.79% (8.3565 => 8.5899, std.dev.: 0.0606) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.16% (2.1627 => 2.2094, std.dev.: 0.0169) MultiSource/Applications/treecc/treecc: 2.08% (2.0222 => 2.0642, std.dev.: 0.0120) MultiSource/Applications/hbd/hbd: 1.99% (1.4629 => 1.4920, std.dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 1.86% (0.9826 => 1.0009, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/football/football: 1.67% (0.8793 => 0.8940, std.dev.: 0.0045) MultiSource/Applications/ClamAV/clamscan: 1.52% (14.9395 => 15.1672, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.51% (0.8832 => 0.8965, std.dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 5.12% (44.6757 => 46.9645, std.dev.: 0.2937) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.67% (1.2620 => 1.3083, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/except: 2.59% (0.4906 => 0.5033, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.08% (1.5801 => 1.5972, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.25% (0.8620 => 0.8512, std.dev.: 0.0040) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.44% (16.5328 => 16.6055, std.dev.: 0.2447) MultiSource/Applications/obsequi/Obsequi: 0.80% (1.0474 => 1.0558, std.dev.: 0.0107) MultiSource/Applications/sqlite3/sqlite3: 1.75% (0.6383 => 0.6495, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: -0.31% (0.1923 => 0.1917, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.67% (0.1642 => 0.1653, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.68% (0.3232 => 0.3254, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.44% (0.2454 => 0.2514, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.10% (0.3378 => 0.3415, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.08% (0.2433 => 0.2435, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/bigfib: 0.72% (0.6007 => 0.6050, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel: -2.26% (0.0487 => 0.0476, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.00% (0.3310 => 0.3343, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: -0.10% (0.2002 => 0.2000, std.dev.: 0.0025) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.87% (0.0244 => 0.0251, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.46% (0.0217 => 0.0216, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0422 => 0.0422, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.60% (0.0331 => 0.0329, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0312 => 0.0311, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 21.61% (0.0347 => 0.0422, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 62.10% (0.0124 => 0.0201, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 2.37% (0.0211 => 0.0216, std.dev.: 0.0017) SingleSource/UnitTests/byval-alignment: 5.92% (0.0338 => 0.0358, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 700.00% (0.0001 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.43% (0.1472 => 0.1493, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.99% (1.1395 => 1.1508, std.dev.: 0.0127) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 5.79% (0.1433 => 0.1516, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.36% (0.4038 => 0.4093, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.08% (0.1330 => 0.1329, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.45% (0.0608 => 0.0629, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 38.97% (0.0195 => 0.0271, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.28% (0.0545 => 0.0552, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.83% (1.1338 => 1.1432, std.dev.: 0.0135) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 181.82% (0.0011 => 0.0031, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.48% (0.0588 => 0.0632, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 33.33% (0.0177 => 0.0236, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.21% (0.7947 => 0.8043, std.dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 24.69% (0.0081 => 0.0101, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.88% (2.1832 => 1.6618, std.dev.: 0.0038) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.42% (0.0810 => 0.0943, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 11.96% (0.1112 => 0.1245, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.46% (0.8321 => 0.8942, std.dev.: 0.0175) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.48% (0.8148 => 0.8676, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.56% (0.1905 => 0.2011, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.30% (0.1983 => 0.2088, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.29% (0.7473 => 0.7868, std.dev.: 0.0048) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.72% (0.3137 => 0.3285, std.dev.: 0.0034) MultiSource/Applications/hbd/hbd: 4.56% (1.4269 => 1.4920, std.dev.: 0.0022) MultiSource/Applications/Burg/burg: 4.46% (1.2222 => 1.2767, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.30% (0.9435 => 0.9841, std.dev.: 0.0057) MultiSource/Applications/spiff/spiff: 4.26% (0.7950 => 0.8289, std.dev.: 0.0124) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.60% (1.1606 => 1.2024, std.dev.: 0.0134) MultiSource/Applications/treecc/treecc: 3.48% (1.9948 => 2.0642, std.dev.: 0.0120) MultiSource/Benchmarks/MallocBench/gs/gs: 3.24% (4.1305 => 4.2644, std.dev.: 0.0329) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.24% (2.1401 => 2.2094, std.dev.: 0.0169) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.16% (3.1832 => 3.2839, std.dev.: 0.0319) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.01% (0.3657 => 0.3767, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.97% (4.4880 => 4.6215, std.dev.: 0.0286) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.97% (1.5315 => 1.5770, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.90% (0.8712 => 0.8965, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.81% (0.4127 => 0.4243, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/05-eks/eks: 2.73% (0.4397 => 0.4517, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.72% (0.8048 => 0.8267, std.dev.: 0.0065) MultiSource/Applications/ClamAV/clamscan: 2.70% (14.7684 => 15.1672, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.68% (0.8597 => 0.8827, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.63% (0.4559 => 0.4679, std.dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.46% (6.6074 => 6.7697, std.dev.: 0.0371) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.45% (0.4783 => 0.4900, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.34% (0.8007 => 0.8194, std.dev.: 0.0046) MultiSource/Applications/SIBsim4/SIBsim4: 2.32% (1.2568 => 1.2859, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.26% (1.1170 => 1.1422, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.23% (1.2526 => 1.2805, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.18% (0.8317 => 0.8498, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.11% (0.9908 => 1.0117, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.10% (0.9074 => 0.9265, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: 2.04% (8.4179 => 8.5899, std.dev.: 0.0606) MultiSource/Applications/hexxagon/hexxagon: 2.03% (0.9810 => 1.0009, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/football/football: 1.96% (0.8768 => 0.8940, std.dev.: 0.0045) MultiSource/Applications/SPASS/SPASS: 1.94% (14.2605 => 14.5377, std.dev.: 0.0975) MultiSource/Applications/JM/lencod/lencod: 1.87% (15.3280 => 15.6150, std.dev.: 0.0959) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.83% (0.8359 => 0.8512, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.79% (1.6386 => 1.6680, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.78% (4.1763 => 4.2506, std.dev.: 0.0284) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.60% (4.5702 => 4.6432, std.dev.: 0.0276) MultiSource/Benchmarks/nbench/nbench: 1.56% (1.1271 => 1.1447, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.35% (0.8805 => 0.8924, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.24% (0.8086 => 0.8186, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 59.22% (1.5795 => 2.5149, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.64% (1.1857 => 1.2881, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.47% (0.3186 => 0.3456, std.dev.: 0.0054) MultiSource/Benchmarks/mafft/pairlocalalign: 5.94% (63.1822 => 66.9366, std.dev.: 0.1397) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 5.39% (44.5605 => 46.9645, std.dev.: 0.2937) SingleSource/Benchmarks/Dhrystone/dry: 3.92% (0.5081 => 0.5280, std.dev.: 0.0024) MultiSource/Applications/siod/siod: 2.75% (3.6643 => 3.7652, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/hash: 2.61% (0.6205 => 0.6367, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.43% (2.4490 => 2.5085, std.dev.: 0.0177) SingleSource/Benchmarks/Misc/ReedSolomon: 2.30% (8.5322 => 8.7284, std.dev.: 0.0507) SingleSource/Benchmarks/Shootout-C++/except: 2.28% (0.4921 => 0.5033, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 2.04% (1.2822 => 1.3083, std.dev.: 0.0093) MultiSource/Benchmarks/llubenchmark/llu: 1.77% (1.9967 => 2.0321, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.36% (1.5941 => 1.6158, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.36% (4.8362 => 4.9018, std.dev.: 0.0090) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -4.96% (29.8330 => 28.3521, std.dev.: 0.1334) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.25% (7.2130 => 6.9786, std.dev.: 0.0743) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.04% (3.3479 => 3.3132, std.dev.: 0.0115) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.97% (16.4461 => 16.6055, std.dev.: 0.2447) MultiSource/Applications/obsequi/Obsequi: 2.88% (1.0262 => 1.0558, std.dev.: 0.0107) MultiSource/Applications/sqlite3/sqlite3: 2.57% (0.6332 => 0.6495, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: 4.70% (0.1831 => 0.1917, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 6.03% (0.1559 => 0.1653, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.19% (0.3123 => 0.3254, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.07% (0.2463 => 0.2514, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.12% (0.3344 => 0.3415, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.00% (0.2364 => 0.2435, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/bigfib: 0.67% (0.6010 => 0.6050, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel: 10.96% (0.0429 => 0.0476, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.36% (0.3266 => 0.3343, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 1.57% (0.1969 => 0.2000, std.dev.: 0.0025) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 12.05% (0.0224 => 0.0251, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 75.61% (0.0123 => 0.0216, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.43% (0.0408 => 0.0422, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.53% (0.0254 => 0.0329, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.98% (0.0302 => 0.0311, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.90% (0.0384 => 0.0422, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 5.79% (0.0190 => 0.0201, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 20.00% (0.0180 => 0.0216, std.dev.: 0.0017) SingleSource/UnitTests/byval-alignment: 55.65% (0.0230 => 0.0358, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 14.29% (0.0007 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 3.82% (0.1438 => 0.1493, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.58% (1.1329 => 1.1508, std.dev.: 0.0127) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.69% (0.1462 => 0.1516, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.71% (0.4164 => 0.4093, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.92% (0.1369 => 0.1329, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.87% (0.0641 => 0.0629, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 38.97% (0.0195 => 0.0271, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.50% (0.0578 => 0.0552, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.04% (1.1437 => 1.1432, std.dev.: 0.0135) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.80% (0.0627 => 0.0632, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 31.11% (0.0180 => 0.0236, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.32% (0.8017 => 0.8043, std.dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 62.90% (0.0062 => 0.0101, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 11:06:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 13:06:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121025180601.640FB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5214?compare_to=5211&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5214, Order: 166686, Start Time: 2012-10-25 16:45:30, End Time: 2012-10-25 18:05:55 To: 5211, Order: 166681, Start Time: 2012-10-25 14:55:13, End Time: 2012-10-25 16:15:38 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (75 on baseline) New Passes: 0 (7 on baseline) Performance Regressions: 1 (199 on baseline) Performance Improvements: 1 (46 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 87 (12 on baseline) Unchanged Tests: 953 (641 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 4.12% (0.4273 => 0.4449, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.63% (15.7160 => 15.4591, std.dev.: 0.0019) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: -0.19% (0.6301 => 0.6289, std.dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 0.01% (17.3180 => 17.3203, std.dev.: 0.0136) MultiSource/Applications/kimwitu++/kc: -0.17% (15.7502 => 15.7235, std.dev.: 0.0058) MultiSource/Benchmarks/Bullet/bullet: 0.19% (57.3609 => 57.4703, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.20% (0.0490 => 0.0491) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0492 => 0.0492, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.22% (0.0459 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0461 => 0.0461, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.22% (0.0448 => 0.0449) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0451 => 0.0451) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.23% (0.0442 => 0.0443, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0444 => 0.0444) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0461 => 0.0461) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.22% (0.0461 => 0.0462, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0455 => 0.0455, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.22% (0.0456 => 0.0457) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.23% (0.0444 => 0.0445, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0447 => 0.0447, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.22% (0.0452 => 0.0453) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0454 => 0.0454, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0464 => 0.0464, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.22% (0.0465 => 0.0466, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0440 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0442 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.22% (0.0452 => 0.0453, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0454 => 0.0454, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.23% (0.0443 => 0.0444) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0445 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0435 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.23% (0.0436 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.23% (0.0434 => 0.0435, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0436 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0472 => 0.0472, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0473 => 0.0473, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0433 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.23% (0.0434 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0434 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0435 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.23% (0.0442 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0443 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.07% (8.2871 => 8.2927, std.dev.: 0.0121) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.20% (0.6936 => 0.6950, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1438 => 0.1438, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.36% (0.0692 => 0.0648, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.05% (0.3825 => 0.3827, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -9.13% (63.2438 => 57.4703, std.dev.: 0.0142) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/BenchmarkGame/puzzle MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.03% (0.6962 => 0.3827, std.dev.: 0.0010) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/MallocBench/gs/gs: 13.65% (4.1105 => 4.6714, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 44.08% (1.1048 => 1.5918, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 69.38% (3.4629 => 5.8654, std.dev.: 0.0098) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13510.56% (0.0720 => 9.7996, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/gs/gs: 63200.00% (0.0001 => 0.0633, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049800.00% (0.0001 => 10.0499, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 69.53% (0.0256 => 0.0434, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 64.68% (0.2554 => 0.4206, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 50.62% (0.0243 => 0.0366, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 49.11% (10.3673 => 15.4591, std.dev.: 0.0019) SingleSource/Regression/C/sumarray2d: 44.28% (0.0271 => 0.0391) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.61% (1.5859 => 2.2458, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/richards_benchmark: 40.07% (0.1622 => 0.2272, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 36.93% (0.1056 => 0.1446, std.dev.: 0.0000) SingleSource/UnitTests/vla: 33.24% (0.0355 => 0.0473, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.89% (2.2024 => 2.8828, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/neural/neural: 28.37% (0.1463 => 0.1878, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 24.53% (0.1655 => 0.2061, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 23.74% (0.0834 => 0.1032, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.90% (0.1566 => 0.1909) SingleSource/Benchmarks/Shootout/hash: 21.86% (0.0485 => 0.0591, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: 21.47% (0.2049 => 0.2489, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 21.30% (0.1432 => 0.1737, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 21.03% (7.0540 => 8.5374, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pifft/pifft: 20.65% (2.2022 => 2.6570, std.dev.: 0.0024) MultiSource/Applications/viterbi/viterbi: 19.04% (0.1555 => 0.1851, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.94% (0.0871 => 0.1036, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 18.65% (0.5105 => 0.6057, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.32% (0.6675 => 0.7898, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.30% (0.1029 => 0.1207, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 17.29% (0.1440 => 0.1689, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.21% (1.3050 => 1.5296, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/tsp/tsp: 17.11% (0.1175 => 0.1376, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 17.00% (0.3282 => 0.3840, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: 16.93% (0.0626 => 0.0732) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.92% (0.0798 => 0.0933, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 16.86% (3.3354 => 3.8976, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/em3d/em3d: 16.81% (0.1695 => 0.1980, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.69% (0.2271 => 0.2650, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.58% (0.4615 => 0.5380, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.53% (0.3121 => 0.3637, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.52% (0.0793 => 0.0924, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 16.42% (0.1163 => 0.1354, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.41% (0.8172 => 0.9513, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 16.31% (0.4879 => 0.5675, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 16.12% (0.7115 => 0.8262, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.10% (0.5020 => 0.5828, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 16.01% (0.1337 => 0.1551, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.99% (0.1032 => 0.1197, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.89% (1.5415 => 1.7864, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.80% (0.0886 => 0.1026, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 15.78% (1.7609 => 2.0387, std.dev.: 0.0089) MultiSource/Applications/sgefa/sgefa: 15.76% (0.3109 => 0.3599, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.63% (0.1510 => 0.1746, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.56% (0.0842 => 0.0973, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.36% (0.1940 => 0.2238, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 15.33% (0.0672 => 0.0775, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/matrix: 15.28% (0.0818 => 0.0943) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 15.27% (0.3177 => 0.3662, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.26% (0.0675 => 0.0778, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 15.23% (0.1438 => 0.1657, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 15.15% (0.0746 => 0.0859, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 15.08% (1.1642 => 1.3398, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 15.04% (8.1363 => 9.3602, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 15.04% (9.4845 => 10.9111, std.dev.: 0.0075) MultiSource/Benchmarks/McCat/18-imp/imp: 14.96% (0.3423 => 0.3935, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.94% (0.0770 => 0.0885, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.92% (0.0838 => 0.0963, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.77% (0.1117 => 0.1282, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.77% (0.9765 => 1.1207, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.76% (4.2646 => 4.8941, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.76% (0.2107 => 0.2418, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/exptree: 14.74% (0.0814 => 0.0934, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.71% (0.1584 => 0.1817, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.65% (0.2758 => 0.3162, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.64% (0.1236 => 0.1417, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 14.59% (0.1906 => 0.2184, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.38% (0.2065 => 0.2362) MultiSource/Applications/aha/aha: 14.34% (0.1151 => 0.1316, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.28% (0.5860 => 0.6697, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.25% (0.6450 => 0.7369, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 14.25% (0.0730 => 0.0834, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.21% (0.5981 => 0.6831, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.16% (0.1695 => 0.1935, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 14.14% (0.7835 => 0.8943, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.04% (0.0933 => 0.1064, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 14.03% (1.4186 => 1.6176, std.dev.: 0.0036) SingleSource/UnitTests/SignlessTypes/rem: 13.99% (0.1144 => 0.1304, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.96% (0.2700 => 0.3077, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.94% (0.1062 => 0.1210, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 13.92% (10.4361 => 11.8885, std.dev.: 0.0127) MultiSource/Applications/treecc/treecc: 13.92% (2.0273 => 2.3094, std.dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 13.81% (1.1840 => 1.3475, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 13.67% (0.3387 => 0.3850, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.64% (0.0770 => 0.0875, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 13.61% (4.9449 => 5.6178, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 13.54% (5.7591 => 6.5387, std.dev.: 0.0154) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.48% (5.0018 => 5.6762, std.dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: 13.47% (0.7433 => 0.8434, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.41% (7.9617 => 9.0297, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.40% (0.3307 => 0.3750, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 13.36% (1.0722 => 1.2154, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.35% (0.8067 => 0.9144, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 13.33% (0.4299 => 0.4872, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/health/health: 13.33% (0.1268 => 0.1437, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 13.17% (3.8723 => 4.3822, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.04% (0.5569 => 0.6295, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.02% (0.0929 => 0.1050, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.98% (0.1625 => 0.1836, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 12.80% (0.3180 => 0.3587, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.78% (0.1330 => 0.1500, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.68% (0.2603 => 0.2933, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.62% (1.1861 => 1.3358, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 12.57% (1.5603 => 1.7564, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.53% (0.2266 => 0.2550, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 12.52% (0.3092 => 0.3479, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.41% (0.3441 => 0.3868, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 12.36% (0.1125 => 0.1264, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/football/football: 12.32% (0.8921 => 1.0020, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 12.21% (1.1194 => 1.2561, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/bigfib: 12.11% (0.6456 => 0.7238, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.92% (0.8101 => 0.9067, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/hash: 11.40% (0.4289 => 0.4778, std.dev.: 0.0016) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.20% (0.1143 => 0.1271, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.15% (0.1892 => 0.2103, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 11.09% (21.9371 => 24.3694, std.dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/hash2: 11.06% (0.4620 => 0.5131, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.89% (0.3543 => 0.3929, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 10.81% (2.2969 => 2.5452, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.50% (0.3865 => 0.4271, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/lists: 10.49% (0.3422 => 0.3781, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.44% (0.3927 => 0.4337, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.30% (0.3543 => 0.3908, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.25% (0.4203 => 0.4634, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 10.25% (0.3473 => 0.3829, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.25% (0.3561 => 0.3926, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.23% (0.3694 => 0.4072, std.dev.: 0.0069) SingleSource/UnitTests/ObjC/property: 10.09% (0.3886 => 0.4278, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.08% (0.3828 => 0.4214, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.07% (0.3516 => 0.3870, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.06% (0.1044 => 0.1149, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 10.04% (0.3497 => 0.3848, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 9.96% (0.3684 => 0.4051, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 9.96% (0.4048 => 0.4451, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.75% (0.4103 => 0.4503, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.73% (0.4636 => 0.5087, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 9.30% (0.3603 => 0.3938, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.19% (0.3427 => 0.3742, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.14% (0.2430 => 0.2652, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.03% (0.5925 => 0.6460, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 8.99% (0.6030 => 0.6572, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.90% (0.3650 => 0.3975, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.89% (0.3826 => 0.4166, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 8.88% (17.1811 => 18.7073, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/matrix: 8.65% (0.3098 => 0.3366, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 8.58% (0.2831 => 0.3074, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 8.57% (0.2905 => 0.3154, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.56% (0.4064 => 0.4412, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 8.54% (0.7326 => 0.7952, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary3: 8.44% (0.3283 => 0.3560, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.38% (14.3668 => 15.5707, std.dev.: 0.0148) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.37% (3.8922 => 4.2180, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 8.35% (0.3232 => 0.3502, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.34% (0.2891 => 0.3132, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.16% (0.3162 => 0.3420, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.15% (0.2872 => 0.3106, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.13% (0.2756 => 0.2980, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.11% (2.0665 => 2.2341, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.07% (0.3136 => 0.3389, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 8.01% (0.2871 => 0.3101, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.98% (0.2793 => 0.3016, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.96% (0.2725 => 0.2942, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 7.86% (0.3052 => 0.3292, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 7.84% (0.3379 => 0.3644, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 7.82% (0.2877 => 0.3102, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.82% (0.2802 => 0.3021, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 7.66% (0.2714 => 0.2922, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 7.16% (1.2842 => 1.3761, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 6.64% (0.3131 => 0.3339, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.96% (0.3935 => 0.4091, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.65% (0.3817 => 0.3918, std.dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8961, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1725, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.95% (1.1145 => 1.2923, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 12.88% (0.9957 => 1.1239, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.72% (2.6778 => 2.9649, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.78% (1.1396 => 1.2511, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (3.1578 => 3.3679, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.64% (2.8904 => 3.0824, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 3.81% (1.9405 => 2.0144, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.85% (4.2280 => 4.3484, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.61% (0.3987 => 0.4091, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.92% (3.6395 => 3.7095, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/bisort/bisort: 1.91% (0.8333 => 0.8492, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.55% (2.6546 => 2.6957, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 1.54% (3.1595 => 3.2080, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.49% (11.6436 => 11.8168, std.dev.: 0.0117) MultiSource/Applications/viterbi/viterbi: 1.17% (4.4649 => 4.5172, std.dev.: 0.0060) MultiSource/Applications/minisat/minisat: 1.06% (9.1159 => 9.2124, std.dev.: 0.0303) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.98% (6.6874 => 0.1349, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -76.82% (0.8651 => 0.2005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -36.48% (5.2763 => 3.3514, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -29.86% (5.3855 => 3.7775, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -29.42% (5.3526 => 3.7776, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -9.35% (54.1659 => 49.0995, std.dev.: 0.0120) MultiSource/Applications/ClamAV/clamscan: -2.24% (22.1758 => 21.6787, std.dev.: 0.0141) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -52.87% (8.0499 => 3.7941, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.43% (1.1492 => 0.7650, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4751, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4231, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.73% (1.2258 => 1.0698, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -11.61% (1.2373 => 1.0937, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: -10.90% (1.5373 => 1.3697, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.29% (19.9488 => 18.2946, std.dev.: 0.0097) MultiSource/Benchmarks/FreeBench/mason/mason: -8.01% (0.2161 => 0.1988, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.96% (1.8329 => 1.7054, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.21% (1.6805 => 1.5930, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: -4.94% (1.5835 => 1.5053, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.30% (8.1563 => 7.8053, std.dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.63% (3.2827 => 3.1635, std.dev.: 0.0071) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8777, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4939, std.dev.: 0.0060) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.50% (0.4808 => 0.4688, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Applications/sqlite3/sqlite3: -2.14% (4.6441 => 4.5447, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -1.89% (10.2830 => 10.0888, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6803, std.dev.: 0.0015) SingleSource/UnitTests/Vector/multiplies: -1.69% (2.5528 => 2.5096, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4210, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2878, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/hash: -1.09% (4.9088 => 4.8551, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.04% (6.2999 => 6.2342, std.dev.: 0.0063) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 20.27% (0.5229 => 0.6289, std.dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 15.55% (14.9895 => 17.3203, std.dev.: 0.0136) MultiSource/Applications/kimwitu++/kc: 11.08% (14.1553 => 15.7235, std.dev.: 0.0058) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 15.85% (7.1582 => 8.2927, std.dev.: 0.0121) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.70% (0.6222 => 0.6950, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.16% (0.1485 => 0.1438, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 12:15:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 14:15:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121025191547.B2D852A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5215?compare_to=5212&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5215, Order: 166694, Start Time: 2012-10-25 17:50:23, End Time: 2012-10-25 19:15:41 To: 5212, Order: 166683, Start Time: 2012-10-25 16:01:50, End Time: 2012-10-25 17:27:08 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 1 (185 on baseline) Unchanged Tests: 1040 (852 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.14% (54.5019 => 56.2154, std.dev.: 0.2880) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.37% (3.8239 => 3.7715, std.dev.: 0.0187) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.01% (54.5751 => 56.2154, std.dev.: 0.2880) SingleSource/Benchmarks/Misc/salsa20: 2.75% (7.4937 => 7.7000, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.64% (2.0478 => 2.1018, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/hash2: 2.22% (3.1932 => 3.2642, std.dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.22% (0.1431 => 0.1299, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.14% (0.3821 => 0.3510, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -7.60% (2.4924 => 2.3029, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: -7.48% (0.3357 => 0.3106, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.42% (22.4056 => 20.7427, std.dev.: 0.0111) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.21% (0.2428 => 0.2253, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -7.15% (3.5339 => 3.2812, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/oourafft: -7.13% (0.2160 => 0.2006, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.12% (0.9542 => 0.8863, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.10% (0.3142 => 0.2919, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -7.00% (0.9852 => 0.9162, std.dev.: 0.0051) MultiSource/Applications/siod/siod: -6.99% (2.4021 => 2.2343, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: -6.96% (4.3330 => 4.0314, std.dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: -6.95% (16.1920 => 15.0668, std.dev.: 0.0110) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.94% (0.1584 => 0.1474, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.94% (0.3658 => 0.3404, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.93% (0.3884 => 0.3615, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -6.93% (0.3812 => 0.3548, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.92% (0.3831 => 0.3566, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.91% (0.3880 => 0.3612, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.90% (0.1796 => 0.1672, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -6.88% (7.0961 => 6.6078, std.dev.: 0.0064) MultiSource/Applications/lemon/lemon: -6.86% (1.1450 => 1.0664, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.85% (1.6474 => 1.5346, std.dev.: 0.0069) MultiSource/Benchmarks/mafft/pairlocalalign: -6.81% (9.2283 => 8.5998, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/exceptions-3: -6.81% (0.3848 => 0.3586, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: -6.80% (0.9179 => 0.8555, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.78% (1.0544 => 0.9829, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions: -6.75% (0.4176 => 0.3894, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.75% (0.2548 => 0.2376, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: -6.75% (1.1530 => 1.0752, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/for-in: -6.74% (0.4033 => 0.3761, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -6.74% (0.4199 => 0.3916, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -6.74% (1.2515 => 1.1672, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.73% (5.4682 => 5.1004, std.dev.: 0.0090) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.72% (0.2695 => 0.2514, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -6.71% (0.4280 => 0.3993, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.70% (0.1716 => 0.1601, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: -6.70% (0.3896 => 0.3635, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/08-main/main: -6.69% (0.2659 => 0.2481, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -6.63% (0.2985 => 0.2787, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.59% (1.3722 => 1.2818, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.59% (6.7716 => 6.3255, std.dev.: 0.0040) MultiSource/Applications/lua/lua: -6.58% (4.0594 => 3.7922, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.58% (1.2300 => 1.1491, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.57% (0.6484 => 0.6058, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.52% (1.4642 => 1.3688, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.50% (4.0323 => 3.7703, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.50% (4.5069 => 4.2141, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.49% (0.3931 => 0.3676, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.48% (2.2587 => 2.1124, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.47% (4.8161 => 4.5045, std.dev.: 0.0074) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.45% (0.2355 => 0.2203, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.44% (0.6736 => 0.6302, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.44% (0.7919 => 0.7409, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.43% (1.6364 => 1.5311, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: -6.43% (15.5079 => 14.5112, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/ks/ks: -6.42% (0.1621 => 0.1517, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -6.39% (18.2933 => 17.1235, std.dev.: 0.0131) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.39% (1.2784 => 1.1967, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/functionobjects: -6.39% (0.5168 => 0.4838, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: -6.37% (1.3864 => 1.2981, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: -6.37% (1.3148 => 1.2311, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -6.36% (0.6230 => 0.5834, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.35% (0.5478 => 0.5130, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.35% (0.3891 => 0.3644, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.35% (0.6681 => 0.6257, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -6.34% (0.4861 => 0.4553, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.33% (4.8802 => 4.5711, std.dev.: 0.0076) MultiSource/Benchmarks/Bullet/bullet: -6.33% (34.0927 => 31.9334, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.32% (14.2083 => 13.3101, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -6.32% (0.6395 => 0.5991, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.31% (0.5591 => 0.5238, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: -6.31% (0.7447 => 0.6977, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.31% (0.7339 => 0.6876, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.30% (0.5805 => 0.5439, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.30% (0.6052 => 0.5671, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: -6.29% (0.9557 => 0.8956, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.26% (0.6260 => 0.5868, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.26% (0.6297 => 0.5903, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: -6.26% (0.3581 => 0.3357, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: -6.25% (3.5154 => 3.2956, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -6.25% (0.4321 => 0.4051, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: -6.24% (0.3491 => 0.3273, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: -6.24% (0.6750 => 0.6329, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.22% (0.4083 => 0.3829, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.22% (0.5581 => 0.5234, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.21% (0.3849 => 0.3610, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -6.21% (17.1032 => 16.0412, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -6.19% (0.6676 => 0.6263, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: -6.18% (0.4515 => 0.4236, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.18% (0.5859 => 0.5497, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.18% (0.3837 => 0.3600, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -6.17% (0.5705 => 0.5353, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.15% (0.6304 => 0.5916, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -6.15% (0.7524 => 0.7061, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.15% (0.5802 => 0.5445, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.14% (0.3483 => 0.3269, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.13% (0.5925 => 0.5562, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.12% (0.6189 => 0.5810, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -6.12% (0.3446 => 0.3235, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.11% (0.5863 => 0.5505, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.09% (0.4151 => 0.3898, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -6.09% (0.5941 => 0.5579, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.09% (0.6194 => 0.5817, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.09% (0.6293 => 0.5910, std.dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.08% (0.4916 => 0.4617, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: -6.08% (0.3406 => 0.3199, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -6.08% (0.7982 => 0.7497, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: -6.07% (0.3394 => 0.3188, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -6.06% (0.3481 => 0.3270, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -6.06% (0.6667 => 0.6263, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -6.05% (0.6660 => 0.6257, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -6.05% (0.6033 => 0.5668, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: -6.05% (2.1401 => 2.0107, std.dev.: 0.0098) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.04% (0.8521 => 0.8006, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.04% (0.6440 => 0.6051, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -6.04% (15.2527 => 14.3316, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.04% (0.6395 => 0.6009, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: -6.03% (0.4524 => 0.4251, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: -6.03% (0.2871 => 0.2698, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -6.02% (0.2989 => 0.2809, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -6.02% (0.3621 => 0.3403, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.02% (0.7198 => 0.6765, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -6.01% (0.5575 => 0.5240, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.99% (0.5456 => 0.5129, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.99% (0.5857 => 0.5506, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.99% (0.3057 => 0.2874, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.97% (0.6446 => 0.6061, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -5.96% (0.1761 => 0.1656) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.95% (2.1713 => 2.0422, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.94% (0.5569 => 0.5238, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -5.93% (0.3205 => 0.3015, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -5.92% (0.3867 => 0.3638, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.90% (0.3252 => 0.3060, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.88% (0.2278 => 0.2144, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.87% (0.7021 => 0.6609, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.86% (0.2933 => 0.2761, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -5.86% (0.4248 => 0.3999, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -5.83% (0.2849 => 0.2683, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.80% (0.5570 => 0.5247, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.80% (0.5849 => 0.5510, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.79% (0.2106 => 0.1984, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: -5.78% (0.2939 => 0.2769, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.78% (0.5329 => 0.5021, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: -5.78% (0.3271 => 0.3082, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/matrix: -5.78% (0.3255 => 0.3067, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.75% (0.5688 => 0.5361, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -5.75% (0.1879 => 0.1771, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.74% (0.2999 => 0.2827, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: -5.72% (0.3059 => 0.2884, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.71% (0.4427 => 0.4174, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.71% (8.0126 => 7.5547, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.71% (0.5567 => 0.5249, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.70% (0.2385 => 0.2249, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: -5.70% (0.3194 => 0.3012, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.69% (1.2210 => 1.1515, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.69% (1.2221 => 1.1526, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: -5.65% (0.3025 => 0.2854, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/except: -5.62% (0.3026 => 0.2856, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.62% (0.5999 => 0.5662, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.59% (0.4813 => 0.4544, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: -5.54% (0.3788 => 0.3578, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.45% (0.3323 => 0.3142, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.44% (0.3016 => 0.2852, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -5.37% (0.8418 => 0.7966, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.34% (0.2903 => 0.2748, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.15% (0.3319 => 0.3148, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: -5.01% (5.0226 => 4.7709, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -4.99% (0.7779 => 0.7391, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: -4.76% (0.6347 => 0.6045, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -4.70% (0.6441 => 0.6138, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.52% (0.9077 => 0.8667, std.dev.: 0.0026) MultiSource/Applications/hbd/hbd: -3.91% (1.5610 => 1.4999, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -3.62% (20.7746 => 20.0233, std.dev.: 0.0274) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7567, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/richards_benchmark: -8.64% (1.2842 => 1.1733, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.92% (2.2633 => 2.1746, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7068, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.81% (1.3096 => 1.2728, std.dev.: 0.0133) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4694, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.18% (1.6086 => 1.5896, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0000) Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 12:21:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 14:21:32 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121025192132.098092A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5216?compare_to=5213&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5216, Order: 166694, Start Time: 2012-10-25 17:57:01, End Time: 2012-10-25 19:21:28 To: 5213, Order: 166684, Start Time: 2012-10-25 16:14:20, End Time: 2012-10-25 17:39:50 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 11 (53 on baseline) Performance Improvements: 1 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 963 (917 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.88% (0.2357 => 0.2472, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.87% (0.3037 => 0.3185, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.75% (0.5073 => 0.5263, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.71% (0.6346 => 0.6518, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.61% (4.5213 => 4.5941, std.dev.: 0.0151) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.39% (1.2024 => 1.2191, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: 1.99% (1.3006 => 1.3265, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/ReedSolomon: 1.11% (8.7284 => 8.8256, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.09% (4.4391 => 4.4876, std.dev.: 0.0159) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.03% (1.0413 => 1.0520, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/whetstone: 1.00% (2.1162 => 2.1374, std.dev.: 0.0052) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/football/football: -1.33% (0.8940 => 0.8821, std.dev.: 0.0035) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.33% (16.6055 => 16.5508, std.dev.: 0.1114) MultiSource/Applications/obsequi/Obsequi: 0.72% (1.0558 => 1.0634, std.dev.: 0.0102) MultiSource/Applications/sqlite3/sqlite3: -1.68% (0.6495 => 0.6386, std.dev.: 0.0081) MultiSource/Benchmarks/McCat/08-main/main: 1.72% (0.1917 => 0.1950, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.66% (0.1653 => 0.1697, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.86% (0.3254 => 0.3282, std.dev.: 0.0135) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.03% (0.2514 => 0.2488, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.61% (0.3415 => 0.3326, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.74% (0.2435 => 0.2417, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: -1.52% (0.6050 => 0.5958, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/mandel: -14.71% (0.0476 => 0.0406, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: -1.56% (0.3343 => 0.3291, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 0.35% (0.2000 => 0.2007, std.dev.: 0.0024) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -21.51% (0.0251 => 0.0197, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.85% (0.0216 => 0.0220, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.71% (0.0422 => 0.0425, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.30% (0.0329 => 0.0330, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.64% (0.0311 => 0.0309, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0422 => 0.0422, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0201 => 0.0201, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/test1: -38.89% (0.0216 => 0.0132, std.dev.: 0.0042) SingleSource/UnitTests/byval-alignment: -6.42% (0.0358 => 0.0335, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0008 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -1.07% (0.1493 => 0.1477, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -0.06% (1.1508 => 1.1501, std.dev.: 0.0291) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1516 => 0.1517, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.22% (0.4093 => 0.4102, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.29% (0.1329 => 0.1386, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.32% (0.0629 => 0.0631, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.74% (0.0271 => 0.0269, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.91% (0.0552 => 0.0557, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.42% (1.1432 => 1.1480, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.32% (0.0632 => 0.0630, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 13.56% (0.0236 => 0.0268) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.36% (0.8043 => 0.8014, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -41.58% (0.0101 => 0.0059, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.96% (2.1832 => 1.6601, std.dev.: 0.0068) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.80% (0.0810 => 0.0938, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.07% (0.0773 => 0.0874, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 12.32% (0.1112 => 0.1249, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.29% (0.0830 => 0.0932, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.58% (0.4847 => 0.5263, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.47% (0.2279 => 0.2472, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.45% (0.6010 => 0.6518, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/health/health: 7.80% (0.1347 => 0.1452, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.43% (0.8321 => 0.8939, std.dev.: 0.0069) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.29% (0.8148 => 0.8742, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.77% (0.7473 => 0.7979, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.06% (0.3003 => 0.3185, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.64% (0.2180 => 0.2303, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.04% (1.1606 => 1.2191, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.58% (0.9435 => 0.9867, std.dev.: 0.0158) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.17% (0.3717 => 0.3872, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.17% (0.2519 => 0.2624, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: 3.74% (1.4269 => 1.4803, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.61% (1.1685 => 1.2107, std.dev.: 0.0145) MultiSource/Benchmarks/MallocBench/gs/gs: 3.44% (4.1305 => 4.2727, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.39% (0.4127 => 0.4267, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.72% (0.4783 => 0.4913, std.dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 2.70% (6.7320 => 6.9137, std.dev.: 0.0437) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.59% (0.8317 => 0.8532, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.54% (1.2526 => 1.2844, std.dev.: 0.0057) MultiSource/Benchmarks/nbench/nbench: 2.53% (1.1271 => 1.1556, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.48% (8.6476 => 8.8621, std.dev.: 0.0481) MultiSource/Applications/treecc/treecc: 2.40% (1.9948 => 2.0426, std.dev.: 0.0166) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.38% (4.4873 => 4.5941, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.25% (0.7966 => 0.8145, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.21% (0.8885 => 0.9081, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.16% (4.5702 => 4.6689, std.dev.: 0.0127) MultiSource/Applications/JM/lencod/lencod: 2.13% (15.3280 => 15.6551, std.dev.: 0.0411) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.13% (6.6074 => 6.7482, std.dev.: 0.0090) MultiSource/Benchmarks/PAQ8p/paq8p: 2.10% (2.3764 => 2.4264, std.dev.: 0.0126) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.03% (1.1170 => 1.1397, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.01% (4.4880 => 4.5781, std.dev.: 0.0124) MultiSource/Applications/ClamAV/clamscan: 1.88% (14.7684 => 15.0454, std.dev.: 0.0776) MultiSource/Benchmarks/mafft/pairlocalalign: 1.86% (8.6247 => 8.7851, std.dev.: 0.0260) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.84% (1.4479 => 1.4746, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.69% (0.8069 => 0.8205, std.dev.: 0.0044) MultiSource/Applications/minisat/minisat: 1.54% (0.6834 => 0.6939, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 57.59% (1.5795 => 2.4892, std.dev.: 0.0113) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.58% (1.1857 => 1.2874, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 6.00% (63.1822 => 66.9739, std.dev.: 0.1193) SingleSource/Benchmarks/Misc/ReedSolomon: 3.44% (8.5322 => 8.8256, std.dev.: 0.0079) SingleSource/Benchmarks/Dhrystone/dry: 3.27% (0.5081 => 0.5247, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 3.19% (44.5605 => 45.9813, std.dev.: 0.4914) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.02% (59.2638 => 60.4592, std.dev.: 0.4601) SingleSource/Benchmarks/Misc/richards_benchmark: 1.75% (1.3037 => 1.3265, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.74% (4.8362 => 4.9203, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bh/bh: 1.55% (2.3560 => 2.3926, std.dev.: 0.0124) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.21% (4.4340 => 4.4876, std.dev.: 0.0159) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -5.14% (29.8330 => 28.3006, std.dev.: 0.2144) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.54% (7.2130 => 7.0298, std.dev.: 0.0663) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.57% (1.0388 => 1.0225, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.25% (3.3479 => 3.3060, std.dev.: 0.0135) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.64% (16.4461 => 16.5508, std.dev.: 0.1114) MultiSource/Applications/obsequi/Obsequi: 3.63% (1.0262 => 1.0634, std.dev.: 0.0102) MultiSource/Applications/sqlite3/sqlite3: 0.85% (0.6332 => 0.6386, std.dev.: 0.0081) MultiSource/Benchmarks/McCat/08-main/main: 6.50% (0.1831 => 0.1950, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 8.85% (0.1559 => 0.1697, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.09% (0.3123 => 0.3282, std.dev.: 0.0135) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.02% (0.2463 => 0.2488, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.54% (0.3344 => 0.3326, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.24% (0.2364 => 0.2417, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: -0.87% (0.6010 => 0.5958, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/mandel: -5.36% (0.0429 => 0.0406, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.77% (0.3266 => 0.3291, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 1.93% (0.1969 => 0.2007, std.dev.: 0.0024) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -12.05% (0.0224 => 0.0197, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.86% (0.0123 => 0.0220, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.17% (0.0408 => 0.0425, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.32% (0.0302 => 0.0309, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.90% (0.0384 => 0.0422, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/casts: 5.79% (0.0190 => 0.0201, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/test1: -26.67% (0.0180 => 0.0132, std.dev.: 0.0042) SingleSource/UnitTests/byval-alignment: 45.65% (0.0230 => 0.0335, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 14.29% (0.0007 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.71% (0.1438 => 0.1477, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 1.52% (1.1329 => 1.1501, std.dev.: 0.0291) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.76% (0.1462 => 0.1517, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.49% (0.4164 => 0.4102, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.24% (0.1369 => 0.1386, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.56% (0.0641 => 0.0631, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 37.95% (0.0195 => 0.0269, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.63% (0.0578 => 0.0557, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.38% (1.1437 => 1.1480, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.48% (0.0627 => 0.0630, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.89% (0.0180 => 0.0268) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.04% (0.8017 => 0.8014, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -4.84% (0.0062 => 0.0059, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 12:22:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 14:22:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121025192255.D151B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5217?compare_to=5208&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5217, Order: 166683, Start Time: 2012-10-25 16:07:31, End Time: 2012-10-25 19:22:51 To: 5208, Order: 166676, Start Time: 2012-10-25 12:03:25, End Time: 2012-10-25 15:19:19 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (169 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1042 (721 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.56% (0.0625 => 0.0891, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.11% (0.1063 => 0.1415, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.68% (0.0475 => 0.0597, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.60% (0.2969 => 0.3729, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.23% (0.1106 => 0.1385, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 25.03% (1.5932 => 1.9919, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.57% (0.4139 => 0.5156, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.09% (0.0714 => 0.0886, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.95% (0.5900 => 0.7313, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.77% (0.4994 => 0.6181, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.40% (0.0547 => 0.0675, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.94% (0.5000 => 0.6147, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 22.83% (0.4253 => 0.5224, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.52% (0.0897 => 0.1099, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.09% (0.0584 => 0.0713, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.23% (0.1620 => 0.1964, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 21.20% (0.0599 => 0.0726, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.06% (0.1021 => 0.1236, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 20.87% (0.1107 => 0.1338, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 20.04% (0.0948 => 0.1138, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.03% (0.0584 => 0.0701, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.96% (0.0541 => 0.0649, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 19.91% (0.0633 => 0.0759, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.63% (0.0642 => 0.0768, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.60% (0.3903 => 0.4668, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.49% (0.1103 => 0.1318, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 19.39% (0.1619 => 0.1933, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 19.37% (0.0604 => 0.0721, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: 19.37% (0.0821 => 0.0980, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.24% (0.1003 => 0.1196, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.22% (0.0822 => 0.0980, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.17% (0.1549 => 0.1846, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.14% (0.1604 => 0.1911, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.47% (0.1462 => 0.1732, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.19% (0.1160 => 0.1371, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 18.16% (0.0947 => 0.1119, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.84% (0.3890 => 0.4584, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 17.82% (0.0808 => 0.0952, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.78% (0.2014 => 0.2372, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/Hello: 17.68% (0.5826 => 0.6856, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 17.62% (0.4029 => 0.4739, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 17.58% (0.5889 => 0.6924, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 17.49% (0.1218 => 0.1431, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.48% (1.3152 => 1.5451, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/09-vor/vor: 17.21% (0.1505 => 0.1764, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/mst/mst: 17.19% (0.0698 => 0.0818, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.11% (0.2736 => 0.3204, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 16.91% (0.1088 => 0.1272, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.71% (0.2866 => 0.3345, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.45% (0.3271 => 0.3809, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 16.37% (0.5546 => 0.6454, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.34% (3.5627 => 4.1448, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 16.30% (1.8794 => 2.1858, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.26% (0.5026 => 0.5843, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.14% (0.4658 => 0.5410, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.14% (0.2738 => 0.3180, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.14% (0.2875 => 0.3339, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.07% (1.6211 => 1.8816, std.dev.: 0.0018) MultiSource/Applications/hbd/hbd: 15.96% (0.9697 => 1.1245, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.85% (0.1968 => 0.2280, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 15.72% (0.7171 => 0.8298, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/18-imp/imp: 15.69% (0.1421 => 0.1644, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 15.63% (0.2725 => 0.3151, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 15.59% (1.0781 => 1.2462, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.52% (0.4361 => 0.5038, std.dev.: 0.0028) SingleSource/Regression/C++/ofstream_ctor: 15.45% (0.3004 => 0.3468, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 15.33% (0.2714 => 0.3130, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 15.26% (0.1284 => 0.1480, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.21% (0.2729 => 0.3144, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 15.20% (0.2750 => 0.3168, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.18% (0.3195 => 0.3680, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 15.14% (0.2780 => 0.3201, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 15.07% (0.9909 => 1.1402, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/random: 15.06% (0.2803 => 0.3225, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.04% (0.2792 => 0.3212, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 15.02% (0.2823 => 0.3247, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wc: 15.02% (0.3096 => 0.3561, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/except: 15.01% (0.2811 => 0.3233, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.99% (0.3930 => 0.4519, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.97% (2.0673 => 2.3767, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 14.97% (0.2813 => 0.3234, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.92% (2.7292 => 3.1363, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.81% (0.2911 => 0.3342, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 14.80% (4.4195 => 5.0736, std.dev.: 0.0042) MultiSource/Applications/ClamAV/clamscan: 14.76% (4.2109 => 4.8324, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.70% (1.9694 => 2.2589, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 14.60% (0.3267 => 0.3744, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.50% (0.1090 => 0.1248, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 14.43% (23.5202 => 26.9138, std.dev.: 0.0162) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.37% (1.9966 => 2.2836, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 14.36% (0.3258 => 0.3726, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 14.29% (0.3317 => 0.3791, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.28% (0.3362 => 0.3842, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.17% (0.3282 => 0.3747, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.15% (0.3060 => 0.3493, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.96% (0.3124 => 0.3560, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.84% (0.3845 => 0.4377, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 13.82% (0.4146 => 0.4719, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 13.68% (0.3348 => 0.3806, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 13.59% (0.3678 => 0.4178, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 13.47% (0.3726 => 0.4228, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 13.46% (1.4269 => 1.6190, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/football/football: 13.45% (0.2075 => 0.2354, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 13.43% (0.3477 => 0.3944, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.38% (0.3625 => 0.4110, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 13.29% (0.2566 => 0.2907, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 13.17% (0.4251 => 0.4811, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.17% (0.3690 => 0.4176, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.11% (0.3981 => 0.4503, std.dev.: 0.0024) MultiSource/Applications/treecc/treecc: 12.97% (0.7875 => 0.8896, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 12.83% (0.3446 => 0.3888, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 12.81% (0.3496 => 0.3944, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 12.81% (0.3465 => 0.3909, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 12.80% (0.3460 => 0.3903, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 12.67% (0.3442 => 0.3878, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.65% (0.3469 => 0.3908, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.64% (0.3488 => 0.3929, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 12.62% (2.1653 => 2.4385, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/bigfib: 12.41% (0.5012 => 0.5634, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/property: 12.38% (0.3650 => 0.4102, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 12.35% (4.6177 => 5.1878, std.dev.: 0.0088) SingleSource/UnitTests/ObjC/exceptions: 12.30% (0.3643 => 0.4091, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.22% (0.3724 => 0.4179, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 11.95% (2.1013 => 2.3525, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 11.36% (5.5417 => 6.1710, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.27% (0.6435 => 0.7160, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.23% (0.2040 => 0.2269, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 11.15% (0.2691 => 0.2991, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.89% (0.1028 => 0.1140) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.88% (0.2068 => 0.2293, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 10.75% (0.3498 => 0.3874, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 10.69% (0.6634 => 0.7343, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.38% (0.2737 => 0.3021, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.98% (0.1383 => 0.1521, std.dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: 9.92% (0.4847 => 0.5328, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.76% (0.3084 => 0.3385, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 9.68% (0.3336 => 0.3659, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.42% (0.2103 => 0.2301, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.88% (4.6926 => 5.1094, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 8.77% (2.0346 => 2.2131, std.dev.: 0.0044) MultiSource/Applications/lemon/lemon: 8.53% (0.2391 => 0.2595, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.30% (0.5361 => 0.5806, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.24% (11.6398 => 12.5986, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.55% (0.7426 => 0.7987, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.49% (0.5584 => 0.6002, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 6.38% (11.9555 => 12.7183, std.dev.: 0.0145) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.51% (0.3792 => 0.3925, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.32% (0.2162 => 0.3531, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6536, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 9.31% (0.2802 => 0.3063, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6111, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.05% (12.0509 => 12.6594, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.79% (0.3693 => 0.3870, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 4.73% (15.4430 => 16.1734, std.dev.: 0.0169) SingleSource/Benchmarks/Misc/flops-2: 3.75% (1.8057 => 1.8734, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/dry: 2.69% (14.0481 => 14.4256, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/ary3: 2.10% (15.8721 => 16.2047, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.63% (3.1722 => 3.2238, std.dev.: 0.0033) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3054, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.35% (7.1849 => 7.2819, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.25% (1.0927 => 1.1064, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5126, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5933, std.dev.: 0.0107) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.50% (25.4195 => 16.3944, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -8.78% (0.2402 => 0.2191, std.dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: -7.70% (28.1477 => 25.9810, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -7.67% (35.5013 => 32.7797, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/tsp/tsp: -7.19% (2.1113 => 1.9594, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.37% (11.2080 => 10.8301, std.dev.: 0.0577) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.13% (0.6293 => 0.6096, std.dev.: 0.0052) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7741, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -2.87% (3.6262 => 3.5221, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: -2.54% (17.2379 => 16.8000, std.dev.: 0.0370) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.21% (41.7953 => 40.8716, std.dev.: 0.0245) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5726, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4958, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7160, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0418, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.05% (105.3826 => 104.2728, std.dev.: 0.0470) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.03% (3.3991 => 3.3640, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 12:56:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 14:56:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121025195609.6E31D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5218?compare_to=5214&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5218, Order: 166699, Start Time: 2012-10-25 18:35:41, End Time: 2012-10-25 19:56:03 To: 5214, Order: 166686, Start Time: 2012-10-25 16:45:30, End Time: 2012-10-25 18:05:55 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (75 on baseline) New Passes: 0 (7 on baseline) Performance Regressions: 1 (198 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 87 (12 on baseline) Unchanged Tests: 954 (643 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.78% (15.4591 => 15.7338, std.dev.: 0.0059) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.02% (0.6289 => 0.6290, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: -0.09% (17.3203 => 17.3042, std.dev.: 0.0162) MultiSource/Applications/kimwitu++/kc: -0.07% (15.7235 => 15.7124, std.dev.: 0.0162) MultiSource/Benchmarks/Bullet/bullet: -0.37% (57.4703 => 57.2578, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.41% (0.0491 => 0.0489, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0492 => 0.0492, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.22% (0.0460 => 0.0459, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.22% (0.0461 => 0.0460, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0449 => 0.0449, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.22% (0.0451 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.23% (0.0443 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0444 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0461 => 0.0461, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0462 => 0.0462, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0455 => 0.0455, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.22% (0.0457 => 0.0456, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.22% (0.0445 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.22% (0.0447 => 0.0446) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.22% (0.0453 => 0.0452) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.22% (0.0454 => 0.0453, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.22% (0.0464 => 0.0463, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0466 => 0.0466, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0440 => 0.0440, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.23% (0.0442 => 0.0441, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.44% (0.0453 => 0.0451, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.22% (0.0454 => 0.0453) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.23% (0.0444 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0445 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0435 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.23% (0.0437 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.23% (0.0435 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0436 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.21% (0.0472 => 0.0471, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0473 => 0.0473) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0433 => 0.0433) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.23% (0.0435 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0434 => 0.0434, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0435 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.23% (0.0443 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.23% (0.0443 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.01% (8.2927 => 8.2917, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: -0.01% (0.6950 => 0.6949, std.dev.: 0.0037) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1438 => 0.1438, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0648 => 0.0649, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.08% (0.3827 => 0.3824, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -9.46% (63.2438 => 57.2578, std.dev.: 0.0125) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/BenchmarkGame/puzzle MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.07% (0.6962 => 0.3824, std.dev.: 0.0011) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/MallocBench/gs/gs: 13.58% (4.1105 => 4.6688, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 43.74% (1.1048 => 1.5880, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 69.06% (3.4629 => 5.8543, std.dev.: 0.0077) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13514.03% (0.0720 => 9.8021, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/gs/gs: 63200.00% (0.0001 => 0.0633, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049700.00% (0.0001 => 10.0498, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 69.53% (0.0256 => 0.0434, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 64.45% (0.2554 => 0.4200, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 51.76% (10.3673 => 15.7338, std.dev.: 0.0059) SingleSource/Regression/C/sumarraymalloc: 51.03% (0.0243 => 0.0367) SingleSource/Regression/C/sumarray2d: 44.28% (0.0271 => 0.0391, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.40% (1.5859 => 2.2425, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 39.15% (0.1622 => 0.2257, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/distray/distray: 36.93% (0.1056 => 0.1446, std.dev.: 0.0004) SingleSource/UnitTests/vla: 33.52% (0.0355 => 0.0474, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.60% (2.2024 => 2.8764, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: 28.30% (0.1463 => 0.1877, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 24.47% (0.1655 => 0.2060, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 23.38% (0.0834 => 0.1029, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.84% (0.1566 => 0.1908, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 21.45% (7.0540 => 8.5668, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/hash: 21.24% (0.0485 => 0.0588, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 21.23% (0.1432 => 0.1736, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 21.18% (0.2049 => 0.2483, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 20.35% (2.2022 => 2.6504, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 19.10% (0.1555 => 0.1852, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.94% (0.0871 => 0.1036, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 18.65% (0.5105 => 0.6057, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.14% (0.6675 => 0.7886, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.40% (0.1029 => 0.1208, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 17.22% (0.1440 => 0.1688, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 17.17% (0.0798 => 0.0935, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.16% (1.3050 => 1.5290, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 17.13% (0.2271 => 0.2660, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 17.02% (0.1175 => 0.1375, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 17.02% (3.3354 => 3.9030, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/lists: 16.93% (0.0626 => 0.0732, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/em3d/em3d: 16.81% (0.1695 => 0.1980, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.77% (0.0793 => 0.0926, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 16.61% (0.3282 => 0.3827, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.60% (0.4615 => 0.5381, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.57% (0.3121 => 0.3638, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 16.51% (0.1163 => 0.1355, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.45% (0.8172 => 0.9516, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 16.23% (0.1337 => 0.1554, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 16.05% (0.7115 => 0.8257, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.02% (0.5020 => 0.5824, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.89% (0.1032 => 0.1196, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 15.84% (0.4879 => 0.5652, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.83% (1.5415 => 1.7855, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.80% (0.0886 => 0.1026, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.56% (0.1510 => 0.1745, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.56% (0.0842 => 0.0973, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 15.47% (0.3109 => 0.3590, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.41% (0.1940 => 0.2239, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.41% (0.0675 => 0.0779, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 15.40% (1.7609 => 2.0320, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 15.33% (0.0672 => 0.0775, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.22% (0.1117 => 0.1287, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.16% (0.0838 => 0.0965, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 15.10% (0.3423 => 0.3940, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 15.05% (0.3177 => 0.3655, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: 15.04% (0.0818 => 0.0941, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 15.01% (1.1642 => 1.3390, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/n-body: 15.01% (0.0746 => 0.0858, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 14.98% (8.1363 => 9.3552, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.94% (0.0770 => 0.0885, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 14.84% (9.4845 => 10.8920, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.83% (4.2646 => 4.8969, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.77% (0.9765 => 1.1207, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.76% (0.2107 => 0.2418, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 14.64% (0.1906 => 0.2185, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.62% (0.2065 => 0.2367, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/exptree: 14.62% (0.0814 => 0.0933, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.61% (0.2758 => 0.3161, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 14.53% (0.1438 => 0.1647, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.52% (0.1584 => 0.1814, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 14.51% (0.1151 => 0.1318, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.48% (0.1236 => 0.1415, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 14.38% (0.7835 => 0.8962, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 14.38% (0.0730 => 0.0835) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.36% (0.0933 => 0.1067, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.35% (0.5860 => 0.6701, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.28% (0.6450 => 0.7371, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.22% (0.2700 => 0.3084, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.19% (0.5981 => 0.6830, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 14.06% (1.4186 => 1.6180, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.94% (0.1062 => 0.1210, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/rem: 13.90% (0.1144 => 0.1303, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.90% (0.0770 => 0.0877) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.86% (0.1695 => 0.1930, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 13.84% (1.1840 => 1.3479, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 13.75% (2.0273 => 2.3061, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 13.56% (0.1268 => 0.1440, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 13.56% (4.9449 => 5.6155, std.dev.: 0.0031) MultiSource/Benchmarks/sim/sim: 13.55% (0.3387 => 0.3846, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 13.55% (5.7591 => 6.5395, std.dev.: 0.0136) MultiSource/Applications/lambda-0_1_3/lambda: 13.55% (0.7433 => 0.8440, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.47% (5.0018 => 5.6754, std.dev.: 0.0094) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.35% (0.0929 => 0.1053, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.30% (0.8067 => 0.9140, std.dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 13.30% (10.4361 => 11.8237, std.dev.: 0.0101) MultiSource/Applications/lemon/lemon: 13.23% (1.0722 => 1.2140, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.21% (0.3307 => 0.3744, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 13.17% (3.8723 => 4.3822, std.dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.15% (7.9617 => 9.0085, std.dev.: 0.0114) MultiSource/Benchmarks/McCat/05-eks/eks: 13.12% (0.4299 => 0.4863, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.05% (0.1625 => 0.1837, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.01% (0.1330 => 0.1503, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.00% (0.5569 => 0.6293, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 12.96% (0.3180 => 0.3592, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 12.76% (1.5603 => 1.7594, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.68% (0.2603 => 0.2933, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 12.58% (0.3092 => 0.3481, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.53% (1.1861 => 1.3347, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.36% (0.2266 => 0.2546, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 12.36% (0.1125 => 0.1264, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 12.35% (0.8921 => 1.0023, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.26% (0.3441 => 0.3863, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 12.04% (0.6456 => 0.7233, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.86% (0.8101 => 0.9062, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.78% (1.1194 => 1.2513, std.dev.: 0.0008) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.64% (0.1143 => 0.1276, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.57% (0.3543 => 0.3953, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 11.32% (0.4620 => 0.5143, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.15% (0.3927 => 0.4365, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 11.14% (0.4289 => 0.4767, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 11.14% (0.3473 => 0.3860, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.94% (0.1892 => 0.2099, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 10.90% (0.3561 => 0.3949, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-4: 10.89% (0.3543 => 0.3929, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 10.85% (21.9371 => 24.3183, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/lists: 10.84% (0.3422 => 0.3793, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.84% (0.3497 => 0.3876, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.78% (0.3516 => 0.3895, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 10.78% (2.2969 => 2.5444, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/exceptions: 10.74% (0.3828 => 0.4239, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.73% (0.3886 => 0.4303, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.72% (0.3694 => 0.4090, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.48% (0.3865 => 0.4270, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.33% (0.4203 => 0.4637, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.15% (0.1044 => 0.1150, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 10.05% (0.4048 => 0.4455, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 9.96% (0.3684 => 0.4051, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.94% (0.4103 => 0.4511, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.88% (0.4636 => 0.5094, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sieve: 9.55% (0.3603 => 0.3947, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.32% (0.6030 => 0.6592, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.32% (0.5925 => 0.6477, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.15% (0.3650 => 0.3984, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.15% (0.3826 => 0.4176, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.05% (0.3427 => 0.3737, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.97% (0.2430 => 0.2648, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 8.94% (0.3098 => 0.3375, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 8.73% (17.1811 => 18.6818, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/strcat: 8.69% (0.2831 => 0.3077, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.65% (0.7326 => 0.7960, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.54% (0.4064 => 0.4411, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 8.54% (0.2905 => 0.3153, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.52% (14.3668 => 15.5914, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.44% (0.3162 => 0.3429, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.44% (0.2891 => 0.3135, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 8.44% (0.3283 => 0.3560, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 8.38% (0.3232 => 0.3503, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.36% (0.2872 => 0.3112, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.31% (2.0665 => 2.2383, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.31% (0.2756 => 0.2985, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.30% (3.8922 => 4.2153, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.29% (0.3136 => 0.3396, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 8.25% (0.2871 => 0.3108, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 8.17% (0.2877 => 0.3112, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 8.16% (0.3052 => 0.3301, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.13% (0.2793 => 0.3020, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 8.11% (0.3379 => 0.3653, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/fibo: 8.04% (0.2725 => 0.2944, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.85% (0.2714 => 0.2927, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 7.78% (0.2802 => 0.3020, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 7.25% (1.2842 => 1.3773, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 6.96% (0.3131 => 0.3349, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.96% (0.3935 => 0.4091, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.25% (0.3817 => 0.3941, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1725, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 12.95% (0.9957 => 1.1246, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9650, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 10.03% (1.1396 => 1.2539, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 6.70% (3.1578 => 3.3694, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.64% (2.8904 => 3.0824, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 3.81% (1.9405 => 2.0145, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.61% (0.3987 => 0.4091, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.46% (4.2280 => 4.3319, std.dev.: 0.0098) MultiSource/Benchmarks/Olden/bisort/bisort: 1.94% (0.8333 => 0.8495, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.87% (3.6395 => 3.7076, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.56% (2.6546 => 2.6960, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2078, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.49% (11.6436 => 11.8170, std.dev.: 0.0156) MultiSource/Applications/viterbi/viterbi: 1.30% (4.4649 => 4.5231, std.dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.98% (6.6874 => 0.1351, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -76.81% (0.8651 => 0.2006, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -36.98% (5.2763 => 3.3251, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -29.86% (5.3855 => 3.7774, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -29.40% (5.3526 => 3.7790, std.dev.: 0.0056) SingleSource/UnitTests/Vector/constpool: -9.37% (54.1659 => 49.0916, std.dev.: 0.0096) MultiSource/Applications/ClamAV/clamscan: -2.38% (22.1758 => 21.6474, std.dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -52.89% (8.0499 => 3.7922, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.54% (1.1492 => 0.7638, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4750, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.90% (1.6925 => 1.4234, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.67% (1.2258 => 1.0705) SingleSource/Benchmarks/McGill/chomp: -11.53% (1.2373 => 1.0946, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel-2: -10.89% (1.5373 => 1.3699, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.23% (19.9488 => 18.3075, std.dev.: 0.0096) MultiSource/Benchmarks/FreeBench/mason/mason: -8.01% (0.2161 => 0.1988, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.02% (1.8329 => 1.7043, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.17% (1.6805 => 1.5937, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908) SingleSource/Benchmarks/Misc/flops-5: -4.57% (1.5835 => 1.5111, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.34% (8.1563 => 7.8021, std.dev.: 0.0091) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1624, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -3.39% (5.0483 => 4.8773, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.4992, std.dev.: 0.0071) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.60% (0.4808 => 0.4683, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -2.15% (4.6441 => 4.5444, std.dev.: 0.0032) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.86% (10.2830 => 10.0921, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6815, std.dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.69% (2.5528 => 2.5097, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4219, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.11% (2.3135 => 2.2878, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.05% (6.2999 => 6.2337, std.dev.: 0.0045) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 20.29% (0.5229 => 0.6290, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 15.44% (14.9895 => 17.3042, std.dev.: 0.0162) MultiSource/Applications/kimwitu++/kc: 11.00% (14.1553 => 15.7124, std.dev.: 0.0162) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 15.83% (7.1582 => 8.2917, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.68% (0.6222 => 0.6949, std.dev.: 0.0037) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.16% (0.1485 => 0.1438, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 14:02:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 16:02:34 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121025210234.E9CAF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5219?compare_to=5216&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5219, Order: 166710, Start Time: 2012-10-25 19:38:19, End Time: 2012-10-25 21:02:30 To: 5216, Order: 166694, Start Time: 2012-10-25 17:57:01, End Time: 2012-10-25 19:21:28 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 14 (56 on baseline) Performance Improvements: 6 (3 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 955 (915 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.17% (0.9150 => 0.9349, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.12% (0.8729 => 0.8914, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.02% (0.8773 => 0.8950, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.96% (0.8117 => 0.8276, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.68% (0.8394 => 0.8535, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.59% (0.9794 => 0.9950, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.33% (0.8263 => 0.8373, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.03% (0.3199 => 0.3456, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 5.55% (8.5201 => 8.9932, std.dev.: 0.0267) MultiSource/Benchmarks/Prolangs-C++/life/life: 2.85% (2.5665 => 2.6397, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.24% (2.7058 => 2.7663, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.13% (4.3541 => 4.4470, std.dev.: 0.0291) SingleSource/Benchmarks/Shootout-C++/heapsort: 1.40% (3.0376 => 3.0800, std.dev.: 0.0098) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.23% (2.3474 => 2.3763, std.dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/loader/loader: -6.28% (0.3185 => 0.2985, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.10% (0.9867 => 0.9660, std.dev.: 0.0037) MultiSource/Applications/JM/ldecod/ldecod: -1.82% (6.9137 => 6.7876, std.dev.: 0.0375) MultiSource/Applications/JM/lencod/lencod: -1.23% (15.6551 => 15.4624, std.dev.: 0.0418) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: -2.55% (3.2637 => 3.1805, std.dev.: 0.0231) MultiSource/Benchmarks/Bullet/bullet: -1.51% (7.2632 => 7.1537, std.dev.: 0.0309) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.10% (16.5508 => 16.5341, std.dev.: 0.2026) MultiSource/Applications/obsequi/Obsequi: -0.62% (1.0634 => 1.0568, std.dev.: 0.0172) MultiSource/Applications/sqlite3/sqlite3: 0.19% (0.6386 => 0.6398, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/08-main/main: -2.97% (0.1950 => 0.1892, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.94% (0.1697 => 0.1664, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.06% (0.3282 => 0.3280, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.61% (0.2488 => 0.2448, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.09% (0.3326 => 0.3323, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.46% (0.2417 => 0.2428, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 0.59% (0.5958 => 0.5993, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/mandel: 4.19% (0.0406 => 0.0423, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.34% (0.3291 => 0.3335, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: -0.05% (0.2007 => 0.2006, std.dev.: 0.0020) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 25.38% (0.0197 => 0.0247, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.45% (0.0220 => 0.0219, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.47% (0.0425 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0330 => 0.0330, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.29% (0.0309 => 0.0313, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.47% (0.0422 => 0.0420, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 1.49% (0.0201 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 12.88% (0.0132 => 0.0149, std.dev.: 0.0032) SingleSource/UnitTests/byval-alignment: -6.87% (0.0335 => 0.0312, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 62.50% (0.0008 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1477 => 0.1478, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.29% (1.1501 => 1.1534, std.dev.: 0.0169) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -5.47% (0.1517 => 0.1434, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.20% (0.4102 => 0.4094, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.18% (0.1386 => 0.1328, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.01% (0.0631 => 0.0650, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.49% (0.0269 => 0.0265, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.23% (0.0557 => 0.0575, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.35% (1.1480 => 1.1440, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.77% (0.0031 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -44.44% (0.0027 => 0.0015, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.17% (0.0630 => 0.0610, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -35.45% (0.0268 => 0.0173, std.dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.06% (0.8014 => 0.8019, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 28.81% (0.0059 => 0.0076, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.88% (2.1832 => 1.6619, std.dev.: 0.0013) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 11.15% (0.1112 => 0.1236, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.32% (0.8321 => 0.8930, std.dev.: 0.0152) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.20% (0.2180 => 0.2337, std.dev.: 0.0047) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.73% (0.3137 => 0.3348, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.65% (0.7473 => 0.7895, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.57% (0.2998 => 0.3165, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.34% (0.6010 => 0.6331, std.dev.: 0.0079) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.74% (1.1606 => 1.2156, std.dev.: 0.0190) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.68% (0.2519 => 0.2637, std.dev.: 0.0021) MultiSource/Applications/spiff/spiff: 3.72% (0.7950 => 0.8246, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.58% (0.4783 => 0.4954, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.52% (0.8611 => 0.8914, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.47% (0.8317 => 0.8606, std.dev.: 0.0040) MultiSource/Applications/Burg/burg: 3.31% (1.2222 => 1.2627, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.24% (0.9056 => 0.9349, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 3.06% (0.8927 => 0.9200, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.91% (0.8697 => 0.8950, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.83% (1.1685 => 1.2016, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.70% (0.9688 => 0.9950, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.67% (0.9074 => 0.9316, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.60% (0.8066 => 0.8276, std.dev.: 0.0053) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.55% (6.6074 => 6.7760, std.dev.: 0.0270) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.50% (4.1763 => 4.2809, std.dev.: 0.0326) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.50% (0.4127 => 0.4230, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.45% (0.8805 => 0.9021, std.dev.: 0.0074) MultiSource/Applications/hbd/hbd: 2.45% (1.4269 => 1.4619, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.40% (0.8177 => 0.8373, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.38% (0.9435 => 0.9660, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.36% (0.8338 => 0.8535, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.35% (0.8069 => 0.8259, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.22% (1.6386 => 1.6750, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.16% (0.8316 => 0.8496, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.02% (0.8204 => 0.8370, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.95% (0.7966 => 0.8121, std.dev.: 0.0046) MultiSource/Benchmarks/Bullet/bullet: 1.83% (31.8598 => 32.4415, std.dev.: 0.0453) MultiSource/Applications/SIBsim4/SIBsim4: 1.78% (1.2568 => 1.2792, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.71% (0.6943 => 0.7062, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.71% (4.4873 => 4.5640, std.dev.: 0.0211) MultiSource/Applications/ClamAV/clamscan: 1.63% (14.7684 => 15.0092, std.dev.: 0.0504) MultiSource/Applications/treecc/treecc: 1.60% (1.9948 => 2.0267, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: 1.41% (0.9810 => 0.9948, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.35% (0.8340 => 0.8453, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.31% (1.2423 => 1.2586, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.75% (1.5795 => 2.5075, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.47% (0.3186 => 0.3456, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.44% (1.1857 => 1.2858, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 5.95% (63.1822 => 66.9390, std.dev.: 0.0130) SingleSource/Benchmarks/Dhrystone/dry: 4.57% (0.5081 => 0.5313, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: 3.39% (8.5322 => 8.8218, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.38% (0.7597 => 0.7854, std.dev.: 0.0042) MultiSource/Applications/siod/siod: 2.64% (3.6643 => 3.7609, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.11% (4.3552 => 4.4470, std.dev.: 0.0291) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.75% (2.4490 => 2.4918, std.dev.: 0.0096) MultiSource/Benchmarks/Olden/bh/bh: 1.65% (2.3560 => 2.3948, std.dev.: 0.0107) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.18% (2.3487 => 2.3763, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.04% (4.8362 => 4.8867, std.dev.: 0.0085) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -5.10% (29.8330 => 28.3101, std.dev.: 0.1840) SingleSource/Benchmarks/Shootout-C++/hash2: -1.47% (3.4237 => 3.3734, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.46% (3.3479 => 3.2990, std.dev.: 0.0051) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.54% (16.4461 => 16.5341, std.dev.: 0.2026) MultiSource/Applications/obsequi/Obsequi: 2.98% (1.0262 => 1.0568, std.dev.: 0.0172) MultiSource/Applications/sqlite3/sqlite3: 1.04% (0.6332 => 0.6398, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/08-main/main: 3.33% (0.1831 => 0.1892, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 6.74% (0.1559 => 0.1664, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.03% (0.3123 => 0.3280, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.61% (0.2463 => 0.2448, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.63% (0.3344 => 0.3323, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.71% (0.2364 => 0.2428, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: -0.28% (0.6010 => 0.5993, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/mandel: -1.40% (0.0429 => 0.0423, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.11% (0.3266 => 0.3335, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 1.88% (0.1969 => 0.2006, std.dev.: 0.0020) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 10.27% (0.0224 => 0.0247, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.68% (0.0408 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.38% (0.0384 => 0.0420, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -17.22% (0.0180 => 0.0149, std.dev.: 0.0032) SingleSource/UnitTests/byval-alignment: 35.65% (0.0230 => 0.0312, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.78% (0.1438 => 0.1478, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 1.81% (1.1329 => 1.1534, std.dev.: 0.0169) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -1.92% (0.1462 => 0.1434, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.68% (0.4164 => 0.4094, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.99% (0.1369 => 0.1328, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.40% (0.0641 => 0.0650, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 35.90% (0.0195 => 0.0265, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.52% (0.0578 => 0.0575, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.03% (1.1437 => 1.1440, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 7.14% (0.0014 => 0.0015, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.71% (0.0627 => 0.0610, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.89% (0.0180 => 0.0173, std.dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.02% (0.8017 => 0.8019, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 22.58% (0.0062 => 0.0076, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 14:03:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 16:03:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121025210348.C60222A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5220?compare_to=5215&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5220, Order: 166710, Start Time: 2012-10-25 19:38:49, End Time: 2012-10-25 21:03:43 To: 5215, Order: 166694, Start Time: 2012-10-25 17:50:23, End Time: 2012-10-25 19:15:41 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 0 (188 on baseline) Unchanged Tests: 1041 (850 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.04% (1.5896 => 1.6062, std.dev.: 0.0006) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1014, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/salsa20: 2.33% (7.4937 => 7.6681, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/hash2: 2.03% (3.1932 => 3.2581, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.15% (0.1431 => 0.1300, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: -7.75% (2.4924 => 2.2993, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: -7.57% (0.3357 => 0.3103, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.53% (22.4056 => 20.7192, std.dev.: 0.0155) SingleSource/UnitTests/ObjC/exceptions-2: -7.52% (0.3831 => 0.3543, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -7.50% (0.3880 => 0.3589, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -7.49% (0.3896 => 0.3604, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -7.48% (0.3812 => 0.3527, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.47% (0.3884 => 0.3594, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: -7.46% (0.3848 => 0.3561, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.43% (0.3821 => 0.3537, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -7.41% (0.4033 => 0.3734, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -7.37% (3.5339 => 3.2733, std.dev.: 0.0133) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.35% (0.3891 => 0.3605, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: -7.33% (0.4176 => 0.3870, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/property: -7.31% (0.4199 => 0.3892, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -7.27% (0.1761 => 0.1633, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: -7.20% (0.4280 => 0.3972, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -7.19% (16.1920 => 15.0285, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -7.16% (0.3658 => 0.3396, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: -7.14% (0.9179 => 0.8524, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.13% (0.1584 => 0.1471, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.13% (0.3142 => 0.2918, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.13% (0.9542 => 0.8862, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: -7.11% (4.3330 => 4.0249, std.dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: -7.10% (7.0961 => 6.5922, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.08% (0.2428 => 0.2256, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: -7.04% (0.2160 => 0.2008, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -7.02% (9.2283 => 8.5805, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/himenobmtxpa: -7.02% (0.1796 => 0.1670, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: -6.98% (1.2515 => 1.1641, std.dev.: 0.0014) MultiSource/Applications/siod/siod: -6.97% (2.4021 => 2.2347, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/08-main/main: -6.96% (0.2659 => 0.2474, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.95% (1.0544 => 0.9811, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.95% (0.6736 => 0.6268, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.95% (0.7919 => 0.7369, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.94% (0.2695 => 0.2508, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.93% (1.6474 => 1.5332, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.92% (0.9852 => 0.9170, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: -6.92% (1.1530 => 1.0732, std.dev.: 0.0051) MultiSource/Applications/lemon/lemon: -6.87% (1.1450 => 1.0663, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.82% (0.4151 => 0.3868, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.81% (5.4682 => 5.0957, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.81% (1.3722 => 1.2788, std.dev.: 0.0066) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.76% (0.1716 => 0.1600, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.76% (1.2300 => 1.1469, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.75% (1.4642 => 1.3653, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.75% (0.2548 => 0.2376, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.74% (0.6484 => 0.6047, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/neural/neural: -6.73% (0.1500 => 0.1399, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.71% (6.7716 => 6.3169, std.dev.: 0.0113) MultiSource/Applications/minisat/minisat: -6.71% (0.7447 => 0.6947, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.69% (0.3931 => 0.3668, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -6.67% (0.4321 => 0.4033, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.64% (4.0323 => 3.7644, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.64% (4.5069 => 4.2077, std.dev.: 0.0084) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.63% (1.2784 => 1.1936, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.63% (4.8161 => 4.4970, std.dev.: 0.0110) MultiSource/Applications/lua/lua: -6.61% (4.0594 => 3.7911, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.61% (1.6364 => 1.5283, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/ks/ks: -6.60% (0.1621 => 0.1514, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.60% (4.8802 => 4.5581, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.58% (0.2355 => 0.2200, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.57% (2.2587 => 2.1103, std.dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: -6.56% (1.3148 => 1.2285, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: -6.55% (18.2933 => 17.0950, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.54% (0.6052 => 0.5656, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.54% (0.4083 => 0.3816, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -6.54% (34.0927 => 31.8640, std.dev.: 0.0228) MultiSource/Benchmarks/McCat/18-imp/imp: -6.53% (0.3581 => 0.3347, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -6.53% (0.4515 => 0.4220, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -6.53% (0.2985 => 0.2790, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.53% (0.5591 => 0.5226, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: -6.52% (0.4861 => 0.4544, std.dev.: 0.0035) MultiSource/Benchmarks/sim/sim: -6.52% (0.3406 => 0.3184, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -6.51% (0.3026 => 0.2829, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: -6.50% (0.5168 => 0.4832, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -6.50% (0.6230 => 0.5825, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.50% (0.5478 => 0.5122, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -6.49% (15.5079 => 14.5007, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -6.49% (0.5705 => 0.5335, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.46% (0.3837 => 0.3589, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -6.46% (0.6395 => 0.5982, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.45% (0.4916 => 0.4599, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.45% (0.5925 => 0.5543, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.43% (14.2083 => 13.2945, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.43% (0.3252 => 0.3043, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -6.42% (0.3491 => 0.3267, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: -6.41% (0.3446 => 0.3225, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.41% (0.5863 => 0.5487, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: -6.41% (0.2871 => 0.2687, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.40% (0.7339 => 0.6869, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.39% (0.6304 => 0.5901, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -6.39% (0.3255 => 0.3047, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.39% (0.6260 => 0.5860, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.38% (0.6297 => 0.5895, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: -6.38% (1.3864 => 1.2979, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -6.37% (0.4427 => 0.4145, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.37% (0.5999 => 0.5617, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: -6.36% (0.2989 => 0.2799, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/lists: -6.35% (0.3621 => 0.3391, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.35% (0.3057 => 0.2863, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.34% (0.5805 => 0.5437, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.33% (0.5859 => 0.5488, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.33% (0.6681 => 0.6258, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.33% (0.5802 => 0.5435, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.31% (0.6194 => 0.5803, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.30% (2.1713 => 2.0345, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: -6.30% (3.5154 => 3.2940, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: -6.29% (0.3481 => 0.3262, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -6.28% (0.6667 => 0.6248, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -6.28% (0.3788 => 0.3550, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -6.28% (0.6750 => 0.6326, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: -6.28% (17.1032 => 16.0296, std.dev.: 0.0107) MultiSource/Applications/treecc/treecc: -6.27% (2.1401 => 2.0059, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: -6.27% (0.9557 => 0.8958, std.dev.: 0.0072) MultiSource/Applications/ClamAV/clamscan: -6.26% (15.2527 => 14.2976, std.dev.: 0.0145) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.26% (0.3849 => 0.3608, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.26% (0.6293 => 0.5899, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -6.26% (0.7524 => 0.7053, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.25% (0.5857 => 0.5491, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: -6.25% (0.3394 => 0.3182, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -6.25% (0.6676 => 0.6259, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.24% (0.6446 => 0.6044, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.24% (0.5581 => 0.5233, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -6.23% (0.7982 => 0.7485, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -6.21% (0.5569 => 0.5223, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: -6.19% (0.2939 => 0.2757, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.18% (0.6440 => 0.6042, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.18% (0.6395 => 0.6000, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/ft/ft: -6.17% (0.2106 => 0.1976, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -6.17% (0.3323 => 0.3118, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: -6.17% (0.2999 => 0.2814, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.17% (0.2903 => 0.2724, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -6.16% (0.6660 => 0.6250, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.16% (0.5329 => 0.5001, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.15% (0.7021 => 0.6589, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -6.15% (0.3059 => 0.2871, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.14% (0.3483 => 0.3269, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -6.14% (0.4248 => 0.3987, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -6.14% (0.5941 => 0.5576, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -6.14% (0.2933 => 0.2753, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.12% (0.6189 => 0.5810, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -6.12% (0.6033 => 0.5664, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -6.12% (0.3205 => 0.3009, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -6.11% (0.2849 => 0.2675, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -6.10% (0.2278 => 0.2139, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -6.09% (0.5570 => 0.5231, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -6.08% (0.5575 => 0.5236, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -6.08% (0.3867 => 0.3632, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.07% (0.4813 => 0.4521, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -6.06% (8.0126 => 7.5267, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/methcall: -6.05% (0.3025 => 0.2842, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -6.03% (0.3016 => 0.2834, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -6.03% (0.5456 => 0.5127, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -6.03% (0.3319 => 0.3119, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: -6.01% (0.3194 => 0.3002, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.98% (0.5849 => 0.5499, std.dev.: 0.0099) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.98% (1.2210 => 1.1480, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.97% (0.8521 => 0.8012, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: -5.97% (0.4524 => 0.4254, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.95% (0.2385 => 0.2243, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.92% (0.5688 => 0.5351, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.92% (1.2221 => 1.1497, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: -5.91% (0.7779 => 0.7319, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: -5.90% (0.3271 => 0.3078, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.87% (0.5567 => 0.5240, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.81% (0.7198 => 0.6780, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -5.80% (0.1879 => 0.1770, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: -5.60% (0.6441 => 0.6080, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -5.53% (0.6347 => 0.5996, std.dev.: 0.0039) MultiSource/Applications/oggenc/oggenc: -5.49% (5.0226 => 4.7470, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: -5.45% (0.8418 => 0.7959, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: -5.37% (0.1862 => 0.1762, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.20% (0.2001 => 0.1897, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.72% (0.9077 => 0.8649, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.57% (0.2277 => 0.2173, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: -4.50% (1.5610 => 1.4907, std.dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -3.26% (20.7746 => 20.0981, std.dev.: 0.0187) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7531, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/richards_benchmark: -8.69% (1.2842 => 1.1726, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.96% (2.2633 => 2.1736, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.18% (1.3096 => 1.2810, std.dev.: 0.0084) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4680, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0001) Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 14:46:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 16:46:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121025214619.372D52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5221?compare_to=5218&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5221, Order: 166711, Start Time: 2012-10-25 20:25:44, End Time: 2012-10-25 21:46:12 To: 5218, Order: 166699, Start Time: 2012-10-25 18:35:41, End Time: 2012-10-25 19:56:03 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (75 on baseline) New Passes: 0 (7 on baseline) Performance Regressions: 1 (198 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 87 (12 on baseline) Unchanged Tests: 954 (642 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.59% (55.6088 => 56.4933, std.dev.: 0.0934) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 0.05% (0.6290 => 0.6293, std.dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: -0.05% (17.3042 => 17.2956, std.dev.: 0.0228) MultiSource/Applications/kimwitu++/kc: 0.19% (15.7124 => 15.7425, std.dev.: 0.0051) MultiSource/Benchmarks/Bullet/bullet: 0.04% (57.2578 => 57.2805, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.41% (0.0489 => 0.0487, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.61% (0.0492 => 0.0489, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.65% (0.0459 => 0.0456, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.43% (0.0460 => 0.0458, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.67% (0.0449 => 0.0446) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.67% (0.0450 => 0.0447, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.45% (0.0442 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.45% (0.0444 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.43% (0.0461 => 0.0459, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.65% (0.0462 => 0.0459, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.66% (0.0455 => 0.0452, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.44% (0.0456 => 0.0454, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.45% (0.0444 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.45% (0.0446 => 0.0444, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.44% (0.0452 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.44% (0.0453 => 0.0451, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.43% (0.0463 => 0.0461, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.86% (0.0466 => 0.0462, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.45% (0.0440 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.68% (0.0441 => 0.0438, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.44% (0.0451 => 0.0449, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.44% (0.0453 => 0.0451, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.45% (0.0443 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.67% (0.0445 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.23% (0.0435 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.69% (0.0436 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.69% (0.0434 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.46% (0.0436 => 0.0434) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.42% (0.0471 => 0.0469, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.63% (0.0473 => 0.0470, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.46% (0.0433 => 0.0431) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.46% (0.0434 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.46% (0.0434 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.46% (0.0435 => 0.0433) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.45% (0.0442 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.23% (0.0442 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.09% (8.2917 => 8.2990, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 0.06% (0.6949 => 0.6953, std.dev.: 0.0048) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: - (0.1438 => 0.1438, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0649 => 0.0649, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.03% (0.3824 => 0.3825, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -9.43% (63.2438 => 57.2805, std.dev.: 0.0093) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/BenchmarkGame/puzzle MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.06% (0.6962 => 0.3825, std.dev.: 0.0002) New Passes - Compile Time ------------------------- MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Benchmarks/MallocBench/gs/gs: 13.56% (4.1105 => 4.6678, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 43.65% (1.1048 => 1.5871, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 69.32% (3.4629 => 5.8633, std.dev.: 0.0005) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit MultiSource/Applications/JM/lencod/lencod: 13504.17% (0.0720 => 9.7950, std.dev.: 0.0128) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050200.00% (0.0001 => 10.0503, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 69.53% (0.0256 => 0.0434, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 64.72% (0.2554 => 0.4207, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 52.20% (10.3673 => 15.7788, std.dev.: 0.0125) SingleSource/Regression/C/sumarraymalloc: 50.62% (0.0243 => 0.0366, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 44.28% (0.0271 => 0.0391, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.73% (1.5859 => 2.2477, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: 38.41% (0.1622 => 0.2245, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/distray/distray: 37.03% (0.1056 => 0.1447, std.dev.: 0.0001) SingleSource/UnitTests/vla: 33.24% (0.0355 => 0.0473, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.78% (2.2024 => 2.8804, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/neural/neural: 28.09% (0.1463 => 0.1874, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 25.62% (0.1655 => 0.2079, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 23.38% (0.0834 => 0.1029, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.71% (0.1566 => 0.1906, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 20.99% (0.2049 => 0.2479, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 20.81% (0.1432 => 0.1730, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.52% (7.0540 => 8.5018, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pifft/pifft: 19.60% (2.2022 => 2.6339, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 18.91% (0.1555 => 0.1849, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 18.83% (0.0871 => 0.1035, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 18.77% (0.5105 => 0.6063, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.19% (0.6675 => 0.7889, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.20% (0.1029 => 0.1206, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 17.19% (0.1175 => 0.1377, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.12% (0.0730 => 0.0855, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 17.08% (0.1440 => 0.1686, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.00% (1.3050 => 1.5269, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: 16.93% (0.0626 => 0.0732, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.90% (0.0793 => 0.0927, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 16.80% (3.3354 => 3.8956, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/em3d/em3d: 16.70% (0.1695 => 0.1978, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.60% (0.2271 => 0.2648, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.50% (0.3121 => 0.3636, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/mst/mst: 16.42% (0.1163 => 0.1354, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.38% (0.4615 => 0.5371, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 16.38% (0.1337 => 0.1556, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 16.36% (0.3282 => 0.3819, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.30% (0.8172 => 0.9504, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.20% (0.5020 => 0.5833, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 16.12% (0.7115 => 0.8262, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.99% (0.1032 => 0.1197, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 15.80% (0.4879 => 0.5650, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.80% (0.0886 => 0.1026, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.75% (0.1625 => 0.1881, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.59% (1.5415 => 1.7818, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.56% (0.1510 => 0.1745, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 15.48% (0.0672 => 0.0776) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.46% (0.1940 => 0.2240, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 15.31% (0.3109 => 0.3585, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.26% (0.0675 => 0.0778, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 15.23% (1.7609 => 2.0291, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.20% (0.0842 => 0.0970, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: 15.04% (0.0818 => 0.0941, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 14.98% (0.3177 => 0.3653, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.92% (0.0838 => 0.0963, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 14.84% (0.3423 => 0.3931, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 14.83% (1.1642 => 1.3369, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 14.75% (8.1363 => 9.3362, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.70% (4.2646 => 4.8915, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.68% (0.1117 => 0.1281, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.68% (0.0770 => 0.0883, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.67% (0.9765 => 1.1198, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.67% (0.2107 => 0.2416, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.64% (0.1236 => 0.1417, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 14.64% (9.4845 => 10.8731, std.dev.: 0.0152) SingleSource/Benchmarks/BenchmarkGame/n-body: 14.61% (0.0746 => 0.0855, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 14.60% (0.1151 => 0.1319, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.58% (0.2758 => 0.3160, std.dev.: 0.0023) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.52% (0.1584 => 0.1814, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 14.46% (0.1438 => 0.1646, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 14.38% (0.1906 => 0.2180, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/exptree: 14.37% (0.0814 => 0.0931, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.28% (0.6450 => 0.7371, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.28% (0.1695 => 0.1937, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.27% (0.5860 => 0.6696, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.26% (0.0933 => 0.1066, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.15% (0.2700 => 0.3082, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.14% (0.2065 => 0.2357, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/almabench: 14.11% (0.0730 => 0.0833, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.09% (0.5981 => 0.6824, std.dev.: 0.0047) SingleSource/UnitTests/SignlessTypes/rem: 14.07% (0.1144 => 0.1305, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 14.04% (0.7835 => 0.8935, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.92% (1.4186 => 1.6161, std.dev.: 0.0021) MultiSource/Applications/treecc/treecc: 13.83% (2.0273 => 2.3076, std.dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 13.79% (1.1840 => 1.3473, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.78% (0.0798 => 0.0908, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 13.78% (0.7433 => 0.8457, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.77% (0.0770 => 0.0876, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.75% (0.1062 => 0.1208, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 13.48% (5.7591 => 6.5352, std.dev.: 0.0049) MultiSource/Benchmarks/sim/sim: 13.43% (0.3387 => 0.3842, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 13.38% (10.4361 => 11.8326, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.31% (0.8067 => 0.9141, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 13.31% (1.0722 => 1.2149, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.27% (5.0018 => 5.6656, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/health/health: 13.25% (0.1268 => 0.1436, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.24% (0.3307 => 0.3745, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 13.24% (4.9449 => 5.5995, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 13.15% (3.8723 => 4.3814, std.dev.: 0.0029) MultiSource/Applications/hbd/hbd: 12.97% (1.5603 => 1.7626, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.92% (0.0929 => 0.1049, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.87% (0.5569 => 0.6286, std.dev.: 0.0049) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.86% (7.9617 => 8.9856, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/09-vor/vor: 12.80% (0.3180 => 0.3587, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 12.77% (0.4299 => 0.4848, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: 12.71% (0.3092 => 0.3485, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.58% (1.1861 => 1.3353, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.56% (0.1330 => 0.1497, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.52% (0.2603 => 0.2929, std.dev.: 0.0006) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.42% (0.1143 => 0.1285, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 12.36% (0.1044 => 0.1173, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 12.31% (0.2266 => 0.2545, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 12.31% (0.8921 => 1.0019, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.26% (0.3441 => 0.3863, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.15% (0.8101 => 0.9085, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 12.10% (0.6456 => 0.7237, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 12.00% (0.1125 => 0.1260, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 11.71% (1.1194 => 1.2505, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 11.39% (0.4620 => 0.5146, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 11.35% (0.4289 => 0.4776, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 10.96% (0.3422 => 0.3797, std.dev.: 0.0104) MultiSource/Applications/siod/siod: 10.91% (2.2969 => 2.5476, std.dev.: 0.0094) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.87% (0.3543 => 0.3928, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.82% (0.4103 => 0.4547, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.78% (0.1892 => 0.2096, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.66% (0.4636 => 0.5130, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.59% (0.4203 => 0.4648, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.56% (0.3865 => 0.4273, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 10.54% (0.3927 => 0.4341, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 10.53% (21.9371 => 24.2473, std.dev.: 0.0165) SingleSource/UnitTests/ObjC/synchronized: 10.19% (0.3561 => 0.3924, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.19% (0.3473 => 0.3827, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.19% (0.3543 => 0.3904, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 10.18% (0.3684 => 0.4059, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 10.16% (0.3886 => 0.4281, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.14% (0.3828 => 0.4216, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.12% (0.3694 => 0.4068, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 10.10% (0.4048 => 0.4457, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 10.07% (0.3516 => 0.3870, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.07% (0.3497 => 0.3849, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 9.85% (0.3603 => 0.3958, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.75% (0.3826 => 0.4199, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.53% (0.3650 => 0.3998, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.33% (0.3162 => 0.3457, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.16% (0.3427 => 0.3741, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.15% (0.3136 => 0.3423, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 9.14% (0.6030 => 0.6581, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.14% (0.2430 => 0.2652, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 9.13% (0.3098 => 0.3381, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: 9.00% (0.5925 => 0.6458, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 8.89% (17.1811 => 18.7083, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/strcat: 8.72% (0.2831 => 0.3078, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 8.68% (0.3283 => 0.3568, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 8.64% (0.3379 => 0.3671, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.61% (0.4064 => 0.4414, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.58% (0.2891 => 0.3139, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.57% (0.2872 => 0.3118, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 8.54% (0.3232 => 0.3508, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 8.50% (0.2871 => 0.3115, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 8.47% (0.2905 => 0.3151, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.45% (3.8922 => 4.2211, std.dev.: 0.0048) SingleSource/UnitTests/ObjC++/property-reference: 8.41% (0.7326 => 0.7942, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.40% (14.3668 => 15.5739, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.36% (2.0665 => 2.2393, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.31% (0.2793 => 0.3025, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.27% (0.2756 => 0.2984, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 8.20% (0.2877 => 0.3113, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 8.11% (0.2725 => 0.2946, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 8.07% (0.2714 => 0.2933, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 8.03% (0.3052 => 0.3297, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.92% (0.2802 => 0.3024, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 7.38% (1.2842 => 1.3790, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/objinst: 6.96% (0.3131 => 0.3349, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.04% (0.3935 => 0.4094, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1726, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 12.89% (0.9957 => 1.1240, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.73% (2.6778 => 2.9651, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.81% (1.1396 => 1.2514, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.64% (2.8904 => 3.0823, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (3.1578 => 3.3671, std.dev.: 0.0016) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 3.80% (1.9405 => 2.0143, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.73% (4.2280 => 4.3433, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.58% (0.3987 => 0.4090, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.99% (3.6395 => 3.7120, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/bisort/bisort: 1.81% (0.8333 => 0.8484, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2077, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.50% (11.6436 => 11.8183, std.dev.: 0.0242) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.37% (2.6546 => 2.6909, std.dev.: 0.0030) MultiSource/Applications/viterbi/viterbi: 1.22% (4.4649 => 4.5193, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.03% (6.5088 => 6.5759, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.99% (6.6874 => 0.1345, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -76.87% (0.8651 => 0.2001, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.05% (5.2763 => 3.3216, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.07% (5.3855 => 3.7663, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -29.67% (5.3526 => 3.7644, std.dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -9.54% (54.1659 => 48.9995, std.dev.: 0.0144) MultiSource/Applications/ClamAV/clamscan: -2.47% (22.1758 => 21.6284, std.dev.: 0.0301) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -52.86% (8.0499 => 3.7947, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -33.37% (1.1492 => 0.7657, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4752, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.72% (1.6925 => 1.4264, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.53% (0.0998 => 0.0853, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.68% (1.2258 => 1.0704, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.52% (1.2373 => 1.0948, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel-2: -11.11% (1.5373 => 1.3665, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.48% (19.9488 => 18.2570, std.dev.: 0.0318) MultiSource/Benchmarks/FreeBench/mason/mason: -7.73% (0.2161 => 0.1994, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.01% (1.8329 => 1.7045, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.19% (1.6805 => 1.5933, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: -5.06% (1.5835 => 1.5033, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7611, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.22% (8.1563 => 7.8125, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.73% (1.3677 => 1.3167, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.68% (3.2827 => 3.1620, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -3.38% (5.0483 => 4.8777, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5025, std.dev.: 0.0034) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.66% (0.4808 => 0.4680, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Applications/sqlite3/sqlite3: -2.14% (4.6441 => 4.5448, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -1.79% (10.2830 => 10.0985, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6802, std.dev.: 0.0022) SingleSource/UnitTests/Vector/multiplies: -1.66% (2.5528 => 2.5103, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4215, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.12% (2.3135 => 2.2877, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.06% (6.2999 => 6.2333, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8594, std.dev.: 0.0080) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 20.35% (0.5229 => 0.6293, std.dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 15.38% (14.9895 => 17.2956, std.dev.: 0.0228) MultiSource/Applications/kimwitu++/kc: 11.21% (14.1553 => 15.7425, std.dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 15.94% (7.1582 => 8.2990, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.75% (0.6222 => 0.6953, std.dev.: 0.0048) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: - (0.0001 => 0.0001) MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -3.16% (0.1485 => 0.1438, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: - (0.0001 => 0.0001) Report Time: 2.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 15:45:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 17:45:28 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121025224528.73E982A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5222?compare_to=5219&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5222, Order: 166714, Start Time: 2012-10-25 21:19:45, End Time: 2012-10-25 22:45:24 To: 5219, Order: 166710, Start Time: 2012-10-25 19:38:19, End Time: 2012-10-25 21:02:30 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 14 (52 on baseline) Performance Improvements: 2 (1 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 959 (921 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 30.46% (0.0371 => 0.0484, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.53% (0.2985 => 0.3150, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.68% (0.6007 => 0.6288, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.70% (3.2127 => 3.3315, std.dev.: 0.0321) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.06% (2.1609 => 2.2271, std.dev.: 0.0119) MultiSource/Applications/oggenc/oggenc: 2.96% (4.9877 => 5.1355, std.dev.: 0.0524) MultiSource/Applications/Burg/burg: 2.76% (1.2627 => 1.2976, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.65% (1.2016 => 1.2334, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.64% (1.5417 => 1.5824, std.dev.: 0.0111) MultiSource/Applications/SIBsim4/SIBsim4: 2.04% (1.2792 => 1.3053, std.dev.: 0.0051) MultiSource/Applications/JM/ldecod/ldecod: 1.93% (6.7876 => 6.9184, std.dev.: 0.0505) MultiSource/Applications/JM/lencod/lencod: 1.92% (15.4624 => 15.7588, std.dev.: 0.1004) MultiSource/Applications/SPASS/SPASS: 1.91% (14.3844 => 14.6592, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.06% (1.2631 => 1.2765, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.64% (0.9200 => 0.9049, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.65% (5.3309 => 5.2431, std.dev.: 0.0318) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.16% (16.5341 => 16.5607, std.dev.: 0.2045) MultiSource/Applications/obsequi/Obsequi: -0.36% (1.0568 => 1.0530, std.dev.: 0.0115) MultiSource/Applications/sqlite3/sqlite3: 1.14% (0.6398 => 0.6471, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/08-main/main: 4.18% (0.1892 => 0.1971, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.90% (0.1664 => 0.1649, std.dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.13% (0.3280 => 0.3243, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.45% (0.2448 => 0.2508, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.11% (0.3323 => 0.3393, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.86% (0.2428 => 0.2449, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/bigfib: 1.47% (0.5993 => 0.6081, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel: -5.67% (0.0423 => 0.0399, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.21% (0.3335 => 0.3342, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 0.60% (0.2006 => 0.2018, std.dev.: 0.0012) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.43% (0.0247 => 0.0253, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0219 => 0.0219, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.24% (0.0423 => 0.0424, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.61% (0.0330 => 0.0332, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0313 => 0.0312, std.dev.: 0.0073) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.95% (0.0420 => 0.0424, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0204 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 52.35% (0.0149 => 0.0227, std.dev.: 0.0014) SingleSource/UnitTests/byval-alignment: 17.63% (0.0312 => 0.0367, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 0.95% (0.1478 => 0.1492, std.dev.: 0.0136) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -3.38% (1.1534 => 1.1144, std.dev.: 0.0654) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 6.28% (0.1434 => 0.1524, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.88% (0.4094 => 0.4212, std.dev.: 0.0162) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.00% (0.1328 => 0.1421, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.46% (0.0650 => 0.0653, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 4.53% (0.0265 => 0.0277, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.96% (0.0575 => 0.0535, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.03% (1.1440 => 1.1443, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 80.00% (0.0015 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.77% (0.0610 => 0.0633, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 36.99% (0.0173 => 0.0237, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.21% (0.8019 => 0.8002, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 30.26% (0.0076 => 0.0099, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.78% (2.1832 => 1.6640, std.dev.: 0.0033) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.56% (0.0810 => 0.0936, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 13.94% (0.1112 => 0.1267, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.98% (0.8321 => 0.9068, std.dev.: 0.0149) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.62% (0.2180 => 0.2368, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.28% (0.1425 => 0.1543, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.11% (0.2279 => 0.2441, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.86% (0.7473 => 0.7986, std.dev.: 0.0186) MultiSource/Applications/Burg/burg: 6.17% (1.2222 => 1.2976, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.04% (0.2998 => 0.3179, std.dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.73% (0.1885 => 0.1993, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.55% (1.1685 => 1.2334, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.49% (0.5961 => 0.6288, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.90% (0.3003 => 0.3150, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.66% (3.1832 => 3.3315, std.dev.: 0.0321) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.20% (0.6287 => 0.6551, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.07% (2.1401 => 2.2271, std.dev.: 0.0119) MultiSource/Applications/spiff/spiff: 3.90% (0.7950 => 0.8260, std.dev.: 0.0086) MultiSource/Applications/SIBsim4/SIBsim4: 3.86% (1.2568 => 1.3053, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.84% (0.3124 => 0.3244, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.77% (0.8697 => 0.9025, std.dev.: 0.0051) MultiSource/Applications/oggenc/oggenc: 3.48% (4.9628 => 5.1355, std.dev.: 0.0524) MultiSource/Applications/hbd/hbd: 3.43% (1.4269 => 1.4758, std.dev.: 0.0168) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.32% (1.5315 => 1.5824, std.dev.: 0.0111) MultiSource/Applications/siod/siod: 3.18% (2.2184 => 2.2890, std.dev.: 0.0248) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.12% (0.3717 => 0.3833, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.97% (4.1763 => 4.3005, std.dev.: 0.0230) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.86% (1.4479 => 1.4893, std.dev.: 0.0135) MultiSource/Applications/JM/lencod/lencod: 2.81% (15.3280 => 15.7588, std.dev.: 0.1004) MultiSource/Applications/SPASS/SPASS: 2.80% (14.2605 => 14.6592, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.78% (4.4873 => 4.6121, std.dev.: 0.0229) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.78% (0.8204 => 0.8432, std.dev.: 0.0067) MultiSource/Applications/JM/ldecod/ldecod: 2.77% (6.7320 => 6.9184, std.dev.: 0.0505) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.75% (0.8340 => 0.8569, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.70% (1.2526 => 1.2864, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.70% (0.8050 => 0.8267, std.dev.: 0.0026) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.63% (6.6074 => 6.7811, std.dev.: 0.0539) MultiSource/Benchmarks/nbench/nbench: 2.56% (1.1271 => 1.1559, std.dev.: 0.0042) MultiSource/Applications/d/make_dparser: 2.38% (3.2366 => 3.3135, std.dev.: 0.0227) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.37% (0.4559 => 0.4667, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.06% (0.8261 => 0.8431, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.98% (4.5702 => 4.6608, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.78% (0.9039 => 0.9200, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.29% (1.2602 => 1.2765, std.dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.43% (1.5795 => 2.5024, std.dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.74% (1.1857 => 1.2775, std.dev.: 0.0056) MultiSource/Benchmarks/mafft/pairlocalalign: 5.98% (63.1822 => 66.9624, std.dev.: 0.0198) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 3.79% (44.5605 => 46.2481, std.dev.: 0.4725) MultiSource/Applications/siod/siod: 2.86% (3.6643 => 3.7691, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/ReedSolomon: 2.28% (8.5322 => 8.7266, std.dev.: 0.0660) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 1.87% (3.2169 => 3.2771, std.dev.: 0.0228) MultiSource/Benchmarks/Olden/bh/bh: 1.75% (2.3560 => 2.3973, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.10% (4.8362 => 4.8895, std.dev.: 0.0196) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -5.05% (29.8330 => 28.3251, std.dev.: 0.2437) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.70% (16.4461 => 16.5607, std.dev.: 0.2045) MultiSource/Applications/obsequi/Obsequi: 2.61% (1.0262 => 1.0530, std.dev.: 0.0115) MultiSource/Applications/sqlite3/sqlite3: 2.20% (0.6332 => 0.6471, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/08-main/main: 7.65% (0.1831 => 0.1971, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.77% (0.1559 => 0.1649, std.dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.84% (0.3123 => 0.3243, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.83% (0.2463 => 0.2508, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.47% (0.3344 => 0.3393, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.60% (0.2364 => 0.2449, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/bigfib: 1.18% (0.6010 => 0.6081, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel: -6.99% (0.0429 => 0.0399, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.33% (0.3266 => 0.3342, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 2.49% (0.1969 => 0.2018, std.dev.: 0.0012) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 12.95% (0.0224 => 0.0253, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.92% (0.0408 => 0.0424, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.71% (0.0254 => 0.0332, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0073) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0384 => 0.0424, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 26.11% (0.0180 => 0.0227, std.dev.: 0.0014) SingleSource/UnitTests/byval-alignment: 59.57% (0.0230 => 0.0367, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 3.76% (0.1438 => 0.1492, std.dev.: 0.0136) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -1.63% (1.1329 => 1.1144, std.dev.: 0.0654) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 4.24% (0.1462 => 0.1524, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.15% (0.4164 => 0.4212, std.dev.: 0.0162) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.80% (0.1369 => 0.1421, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.87% (0.0641 => 0.0653, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.44% (0.0578 => 0.0535, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.05% (1.1437 => 1.1443, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.96% (0.0627 => 0.0633, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 31.67% (0.0180 => 0.0237, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.19% (0.8017 => 0.8002, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 59.68% (0.0062 => 0.0099, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 15:52:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 17:52:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121025225202.F31F32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5223?compare_to=5220&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5223, Order: 166714, Start Time: 2012-10-25 21:26:51, End Time: 2012-10-25 22:51:56 To: 5220, Order: 166710, Start Time: 2012-10-25 19:38:49, End Time: 2012-10-25 21:03:43 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (187 on baseline) Unchanged Tests: 1042 (851 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: 2.77% (7.4937 => 7.7013, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1008, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/hash2: 2.15% (3.1932 => 3.2618, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.29% (0.1431 => 0.1298, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: -8.29% (0.1230 => 0.1128, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.17% (0.3821 => 0.3509, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -7.81% (2.4924 => 2.2977, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: -7.63% (0.3357 => 0.3101, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -7.60% (0.3831 => 0.3540, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -7.58% (0.3880 => 0.3586, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.54% (0.3884 => 0.3591, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.52% (22.4056 => 20.7216, std.dev.: 0.0160) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -7.51% (3.5339 => 3.2684, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: -7.50% (0.3812 => 0.3526, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -7.49% (0.3896 => 0.3604, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.45% (0.3891 => 0.3601, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: -7.44% (0.4033 => 0.3733, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -7.43% (0.3848 => 0.3562, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -7.42% (0.4176 => 0.3866, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.35% (0.3142 => 0.2911, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -7.34% (0.4199 => 0.3891, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -7.33% (0.1761 => 0.1632, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.29% (0.9542 => 0.8846, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -7.27% (0.4280 => 0.3969, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -7.22% (0.3658 => 0.3394, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/himenobmtxpa: -7.18% (0.1796 => 0.1667) SingleSource/Benchmarks/Misc/oourafft: -7.18% (0.2160 => 0.2005, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.13% (0.1584 => 0.1471, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -7.13% (9.2283 => 8.5701, std.dev.: 0.0063) MultiSource/Benchmarks/MallocBench/gs/gs: -7.13% (4.3330 => 4.0242, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/voronoi/voronoi: -7.10% (0.2548 => 0.2367, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -7.10% (16.1920 => 15.0430, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/football/football: -7.07% (0.9179 => 0.8530, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -7.06% (7.0961 => 6.5953, std.dev.: 0.0090) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.05% (0.1716 => 0.1595, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.05% (0.2695 => 0.2505, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -7.03% (1.6474 => 1.5316, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -7.00% (0.7919 => 0.7365, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.99% (0.9852 => 0.9163, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -6.98% (1.1450 => 1.0651, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: -6.97% (0.1879 => 0.1748, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/08-main/main: -6.96% (0.2659 => 0.2474, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -6.95% (2.4021 => 2.2351, std.dev.: 0.0061) MultiSource/Applications/Burg/burg: -6.92% (1.2515 => 1.1649, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.92% (1.3722 => 1.2773, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.89% (1.0544 => 0.9817, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: -6.87% (0.1500 => 0.1397) MultiSource/Benchmarks/nbench/nbench: -6.82% (1.1530 => 1.0744, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.80% (1.4642 => 1.3646, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: -6.80% (0.2985 => 0.2782, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.79% (0.4151 => 0.3869, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.79% (6.7716 => 6.3118, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.79% (1.2300 => 1.1465, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.77% (0.6484 => 0.6045, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.75% (0.2355 => 0.2196, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.75% (1.2784 => 1.1921, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.74% (4.5069 => 4.2030, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.73% (5.4682 => 5.1002, std.dev.: 0.0014) MultiSource/Applications/lua/lua: -6.73% (4.0594 => 3.7864, std.dev.: 0.0117) MultiSource/Applications/minisat/minisat: -6.71% (0.7447 => 0.6947, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.71% (2.2587 => 2.1071, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.70% (0.5478 => 0.5111, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.69% (4.8161 => 4.4937, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/hash2: -6.67% (0.4861 => 0.4537, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -6.66% (1.3148 => 1.2272, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.65% (0.6736 => 0.6288, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.63% (4.8802 => 4.5566, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -6.63% (0.6230 => 0.5817, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -6.63% (0.5705 => 0.5327, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -6.62% (0.5168 => 0.4826, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.61% (0.6304 => 0.5887, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.61% (0.3931 => 0.3671, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: -6.59% (15.5079 => 14.4853, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.59% (4.0323 => 3.7665, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.58% (0.5805 => 0.5423, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -6.58% (34.0927 => 31.8506, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.55% (0.5925 => 0.5537, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.53% (0.6260 => 0.5851, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.53% (0.6297 => 0.5886, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: -6.52% (0.3406 => 0.3184, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -6.52% (0.6660 => 0.6226, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.51% (0.5802 => 0.5424, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.51% (0.4916 => 0.4596, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -6.51% (0.6395 => 0.5979, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.51% (0.6395 => 0.5979, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -6.50% (0.7524 => 0.7035, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.49% (0.5859 => 0.5479, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.48% (1.6364 => 1.5303, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.48% (0.5863 => 0.5483, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: -6.47% (18.2933 => 17.1090, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -6.46% (0.4321 => 0.4042, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.44% (0.4083 => 0.3820, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.44% (0.5591 => 0.5231, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -6.43% (1.3864 => 1.2972, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/05-eks/eks: -6.42% (0.4515 => 0.4225, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: -6.42% (0.3491 => 0.3267, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -6.41% (0.3446 => 0.3225, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.41% (0.6052 => 0.5664, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -6.41% (0.3026 => 0.2832, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.41% (14.2083 => 13.2977, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.40% (0.5857 => 0.5482, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.40% (0.5581 => 0.5224, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.39% (0.6446 => 0.6034, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.39% (0.7339 => 0.6870, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -6.39% (0.3255 => 0.3047, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -6.39% (0.6667 => 0.6241, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.38% (0.2428 => 0.2273, std.dev.: 0.0039) MultiSource/Applications/d/make_dparser: -6.38% (3.5154 => 3.2910, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -6.38% (0.3323 => 0.3111, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.38% (0.6194 => 0.5799, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: -6.37% (2.1401 => 2.0037, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -6.37% (0.5575 => 0.5220, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -6.37% (0.6676 => 0.6251, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.35% (0.6440 => 0.6031, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.35% (0.6681 => 0.6257, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.34% (0.6293 => 0.5894, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: -6.34% (0.3581 => 0.3354, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -6.34% (0.5569 => 0.5216, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: -6.33% (0.3394 => 0.3179, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.33% (0.3252 => 0.3046, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: -6.30% (0.2999 => 0.2810, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: -6.30% (17.1032 => 16.0257, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/strcat: -6.29% (0.2989 => 0.2801, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: -6.29% (0.9557 => 0.8956, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.29% (0.3483 => 0.3264, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: -6.28% (0.4427 => 0.4149, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -6.28% (0.5941 => 0.5568, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.27% (2.1713 => 2.0351, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.27% (0.2903 => 0.2721, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -6.25% (0.5567 => 0.5219, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -6.24% (0.7982 => 0.7484, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -6.23% (0.6033 => 0.5657, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -6.23% (0.3788 => 0.3552, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -6.23% (15.2527 => 14.3029, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.22% (0.6189 => 0.5804, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: -6.22% (0.2106 => 0.1975, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: -6.21% (0.6750 => 0.6331, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.21% (0.5688 => 0.5335, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: -6.20% (0.2871 => 0.2693, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -6.19% (0.5570 => 0.5225, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.18% (0.3849 => 0.3611, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.18% (0.3057 => 0.2868, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -6.18% (0.3481 => 0.3266, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.16% (0.5329 => 0.5001, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.15% (0.7021 => 0.6589, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.15% (0.4813 => 0.4517, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -6.14% (0.5849 => 0.5490, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: -6.13% (0.3016 => 0.2831, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.12% (0.3025 => 0.2840, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -6.10% (0.3621 => 0.3400, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -6.10% (0.3867 => 0.3631, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: -6.09% (0.2939 => 0.2760, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -6.08% (0.3205 => 0.3010, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.08% (1.2221 => 1.1478, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -6.07% (8.0126 => 7.5259, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/objinst: -6.07% (0.3194 => 0.3000, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.05% (0.5999 => 0.5636, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -6.05% (0.4248 => 0.3991, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -6.04% (0.2849 => 0.2677, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -6.03% (0.2933 => 0.2756, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: -6.02% (0.3271 => 0.3074, std.dev.: 0.0052) SingleSource/Regression/C++/ofstream_ctor: -6.02% (0.3059 => 0.2875, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.98% (0.5456 => 0.5130, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.91% (1.2210 => 1.1488, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.88% (0.8521 => 0.8020, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash: -5.86% (0.4524 => 0.4259, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.79% (0.2385 => 0.2247, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.77% (0.7198 => 0.6783, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: -5.74% (0.8418 => 0.7935, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -5.66% (0.7779 => 0.7339, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: -5.64% (0.1862 => 0.1757, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -5.62% (0.6441 => 0.6079, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -5.61% (0.6347 => 0.5991, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.45% (0.3319 => 0.3138, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -5.37% (5.0226 => 4.7527, std.dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.30% (0.2001 => 0.1895, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.09% (0.2278 => 0.2162, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.92% (0.9077 => 0.8630, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.66% (0.2277 => 0.2171, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: -4.28% (1.5610 => 1.4942, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -3.24% (20.7746 => 20.1012, std.dev.: 0.0301) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7564, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1728, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7061, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.88% (2.2633 => 2.1754, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.70% (1.3096 => 1.2742, std.dev.: 0.0116) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4696, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0003) Report Time: 2.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 16:27:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 18:27:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121025232756.3B7F92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5224?compare_to=5217&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5224, Order: 166710, Start Time: 2012-10-25 20:11:15, End Time: 2012-10-25 23:27:51 To: 5217, Order: 166683, Start Time: 2012-10-25 16:07:31, End Time: 2012-10-25 19:22:51 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (170 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1039 (720 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.03% (3.1363 => 3.1687, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 16.88% (101.5549 => 118.6951, std.dev.: 0.0348) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.95% (124.3700 => 129.2783, std.dev.: 0.8855) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.28% (0.0625 => 0.0883, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.27% (0.1063 => 0.1406, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.10% (0.2969 => 0.3744, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.32% (0.1106 => 0.1386, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 24.43% (1.5932 => 1.9824, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.31% (0.4139 => 0.5145, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.98% (0.5900 => 0.7315, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.44% (0.4253 => 0.5250, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.39% (0.0714 => 0.0881, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.33% (0.4994 => 0.6159, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.16% (0.5000 => 0.6158, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.16% (0.0475 => 0.0585, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.85% (0.0547 => 0.0672, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.43% (0.0584 => 0.0715, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.07% (0.0897 => 0.1095, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.85% (0.1620 => 0.1974, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.74% (0.1021 => 0.1243, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 21.54% (0.0599 => 0.0728, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.14% (0.1107 => 0.1341, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 20.70% (0.0604 => 0.0729, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 20.57% (0.0948 => 0.1143, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.54% (0.0633 => 0.0763, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.38% (0.0584 => 0.0703, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.25% (0.0642 => 0.0772, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.15% (0.0541 => 0.0650, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.04% (0.1103 => 0.1324, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.95% (0.1604 => 0.1924, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.95% (0.1549 => 0.1858, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.93% (0.3903 => 0.4681, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/health/health: 19.85% (0.0821 => 0.0984, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.84% (0.1003 => 0.1202, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.59% (0.0822 => 0.0983, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/05-eks/eks: 19.58% (0.1619 => 0.1936, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 18.59% (0.0947 => 0.1123, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.33% (0.1462 => 0.1730, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.33% (0.3890 => 0.4603, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 18.19% (0.0808 => 0.0955, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.07% (0.2014 => 0.2378, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 17.90% (0.1218 => 0.1436, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.66% (0.2866 => 0.3372, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 17.62% (0.0698 => 0.0821, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.59% (1.3152 => 1.5465, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/09-vor/vor: 17.54% (0.1505 => 0.1769, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference-object: 17.44% (0.5889 => 0.6916, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 17.42% (0.5826 => 0.6841, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 17.35% (0.4029 => 0.4728, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.28% (0.1088 => 0.1276, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.21% (0.2736 => 0.3207, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 16.88% (0.5546 => 0.6482, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 16.84% (1.8794 => 2.1958, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.70% (0.2875 => 0.3355, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.61% (3.5627 => 4.1546, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.47% (0.1160 => 0.1351, std.dev.: 0.0019) MultiSource/Applications/hbd/hbd: 16.40% (0.9697 => 1.1287, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: 16.37% (0.2725 => 0.3171, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.26% (0.1968 => 0.2288, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.17% (0.4658 => 0.5411, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.10% (2.7292 => 3.1687, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.07% (0.4361 => 0.5062, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.06% (1.6211 => 1.8814, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.00% (0.2738 => 0.3176, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 15.92% (0.2714 => 0.3146, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 15.82% (0.2750 => 0.3185, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 15.79% (0.2780 => 0.3219, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.77% (0.3271 => 0.3787, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/18-imp/imp: 15.76% (0.1421 => 0.1645, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 15.75% (0.3004 => 0.3477, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 15.73% (0.1284 => 0.1486, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.72% (0.2729 => 0.3158, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 15.63% (0.2803 => 0.3241, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.62% (0.2792 => 0.3228, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: 15.61% (0.3267 => 0.3777, std.dev.: 0.0019) MultiSource/Applications/d/make_dparser: 15.55% (1.0781 => 1.2457, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/wc: 15.54% (0.3096 => 0.3577, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.52% (0.3195 => 0.3691, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 15.50% (0.2813 => 0.3249, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 15.44% (0.2823 => 0.3259, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 15.44% (0.2811 => 0.3245, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 15.44% (0.7171 => 0.8278, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary: 15.41% (0.3258 => 0.3760, std.dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: 15.40% (0.9909 => 1.1435, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.39% (0.2911 => 0.3359, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.35% (2.0673 => 2.3846, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.22% (0.5026 => 0.5791, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.19% (1.9694 => 2.2685, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.18% (4.4195 => 5.0903, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.14% (0.3930 => 0.4525, std.dev.: 0.0039) MultiSource/Applications/ClamAV/clamscan: 15.02% (4.2109 => 4.8435, std.dev.: 0.0117) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.92% (1.9966 => 2.2945, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.75% (0.3362 => 0.3858, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 14.68% (0.3317 => 0.3804, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 14.67% (23.5202 => 26.9714, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.64% (0.3060 => 0.3508, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.47% (0.3124 => 0.3576, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 14.39% (0.3726 => 0.4262, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.31% (0.1090 => 0.1246, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 14.06% (0.3678 => 0.4195, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 14.01% (0.3348 => 0.3817, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.89% (0.3282 => 0.3738, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 13.81% (0.3477 => 0.3957, std.dev.: 0.0015) MultiSource/Applications/lua/lua: 13.79% (1.4269 => 1.6237, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.77% (0.3625 => 0.4124, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 13.73% (0.2075 => 0.2360, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 13.60% (0.4146 => 0.4710, std.dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 13.56% (0.2566 => 0.2914, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.54% (0.3981 => 0.4520, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 13.50% (0.4251 => 0.4825, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.50% (0.3690 => 0.4188, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.45% (0.3845 => 0.4362, std.dev.: 0.0023) MultiSource/Applications/treecc/treecc: 13.22% (0.7875 => 0.8916, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 13.10% (0.3496 => 0.3954, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.06% (0.3446 => 0.3896, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-4: 13.02% (0.3465 => 0.3916, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 13.02% (0.3442 => 0.3890, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.96% (0.3488 => 0.3940, std.dev.: 0.0084) SingleSource/UnitTests/ObjC/exceptions: 12.96% (0.3643 => 0.4115, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.95% (0.3460 => 0.3908, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 12.94% (2.1653 => 2.4454, std.dev.: 0.0141) SingleSource/UnitTests/ObjC/synchronized: 12.91% (0.3469 => 0.3917, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 12.75% (0.5012 => 0.5651, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/property: 12.68% (0.3650 => 0.4113, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 12.48% (4.6177 => 5.1938, std.dev.: 0.0082) MultiSource/Benchmarks/mafft/pairlocalalign: 12.47% (2.1013 => 2.3634, std.dev.: 0.0642) SingleSource/UnitTests/ObjC/parameter-passing: 12.43% (0.3724 => 0.4187, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.79% (0.1383 => 0.1546, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.76% (0.2040 => 0.2280, std.dev.: 0.0025) MultiSource/Applications/SIBsim4/SIBsim4: 11.56% (0.2691 => 0.3002, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.38% (0.6435 => 0.7167, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 11.24% (5.5417 => 6.1646, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.89% (0.1028 => 0.1140, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 10.72% (0.3498 => 0.3873, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: 10.48% (0.4847 => 0.5355, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.45% (0.2737 => 0.3023, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 10.45% (0.6634 => 0.7327, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.35% (0.2068 => 0.2282, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.02% (0.3084 => 0.3393, std.dev.: 0.0046) MultiSource/Applications/minisat/minisat: 9.71% (0.3336 => 0.3660, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.32% (0.2103 => 0.2299, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 8.88% (2.0346 => 2.2153, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.79% (4.6926 => 5.1052, std.dev.: 0.0041) MultiSource/Applications/lemon/lemon: 8.66% (0.2391 => 0.2598, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.45% (0.5361 => 0.5814, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.30% (11.6398 => 12.6058, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.79% (0.5584 => 0.6019, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.27% (0.7426 => 0.7966, std.dev.: 0.0042) MultiSource/Applications/kimwitu++/kc: 6.22% (11.9555 => 12.6996, std.dev.: 0.0169) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.72% (0.3792 => 0.3933, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6533, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.59% (2.5769 => 3.0301, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.25% (0.5917 => 0.6701, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 8.96% (0.2802 => 0.3053, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6114, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.71% (0.3693 => 0.3904, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary: 5.37% (0.2122 => 0.2236, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/objinst: 5.03% (12.0509 => 12.6576, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1700, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-2: 3.61% (1.8057 => 1.8709, std.dev.: 0.0060) SingleSource/Benchmarks/Dhrystone/dry: 2.72% (14.0481 => 14.4298, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1975, std.dev.: 0.0047) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.83% (3.1722 => 3.2301, std.dev.: 0.0023) MultiSource/Applications/viterbi/viterbi: 1.49% (46.6247 => 47.3174, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2859, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.21% (1.0142 => 1.0265, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/five11/five11: 1.19% (8.4155 => 8.5154, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5885, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.55% (25.4195 => 16.3838, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary2: -7.91% (0.2402 => 0.2212, std.dev.: 0.0037) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9774, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -7.66% (35.5013 => 32.7817, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2421, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.36% (11.2080 => 10.8311, std.dev.: 0.0395) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.16% (0.6293 => 0.6094, std.dev.: 0.0047) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7736, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5216, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.34% (17.2379 => 16.8342, std.dev.: 0.0206) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.21% (41.7953 => 40.8720, std.dev.: 0.0093) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5712, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4950, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.33% (5.7935 => 5.7163, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.28% (105.3826 => 104.0345, std.dev.: 0.1225) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0458, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.05% (3.3991 => 3.3635, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 17:26:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 19:26:39 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121026002639.1FD372A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5225?compare_to=5222&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5225, Order: 166731, Start Time: 2012-10-25 23:02:23, End Time: 2012-10-26 00:26:34 To: 5222, Order: 166714, Start Time: 2012-10-25 21:19:45, End Time: 2012-10-25 22:45:24 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 3 (56 on baseline) Performance Improvements: 1 (3 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 971 (915 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.63% (2.3564 => 2.6068, std.dev.: 0.0626) MultiSource/Benchmarks/Prolangs-C++/life/life: 2.79% (2.5695 => 2.6411, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.26% (5.2431 => 5.3090, std.dev.: 0.0125) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: -2.17% (1.2967 => 1.2685, std.dev.: 0.0073) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.14% (16.5607 => 16.5834, std.dev.: 0.0845) MultiSource/Applications/obsequi/Obsequi: 1.72% (1.0530 => 1.0711, std.dev.: 0.0061) MultiSource/Applications/sqlite3/sqlite3: -0.32% (0.6471 => 0.6450, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/08-main/main: -1.47% (0.1971 => 0.1942, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.79% (0.1649 => 0.1662, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.15% (0.3243 => 0.3238, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.32% (0.2508 => 0.2541, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.09% (0.3393 => 0.3390, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.57% (0.2449 => 0.2386, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: -1.04% (0.6081 => 0.6018, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/mandel: 7.02% (0.0399 => 0.0427, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.33% (0.3342 => 0.3331, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/strcat: 0.10% (0.2018 => 0.2020, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -17.39% (0.0253 => 0.0209, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -20.55% (0.0219 => 0.0174, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.24% (0.0424 => 0.0425, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.55% (0.0332 => 0.0287, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.64% (0.0312 => 0.0314, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -6.84% (0.0424 => 0.0395, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/casts: -0.98% (0.0204 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -5.73% (0.0227 => 0.0214, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -16.89% (0.0367 => 0.0305, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -38.46% (0.0013 => 0.0008, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.80% (0.1492 => 0.1480, std.dev.: 0.0027) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.32% (1.1144 => 1.1180, std.dev.: 0.0546) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -0.92% (0.1524 => 0.1510, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.06% (0.4212 => 0.4041, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.54% (0.1421 => 0.1328, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.14% (0.0653 => 0.0639, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -6.86% (0.0277 => 0.0258, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.50% (0.0535 => 0.0543, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.19% (1.1443 => 1.1421, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.77% (0.0031 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -55.56% (0.0027 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.32% (0.0633 => 0.0612, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.49% (0.0237 => 0.0224, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.10% (0.8002 => 0.8010, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -24.24% (0.0099 => 0.0075, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.79% (2.1832 => 1.6639, std.dev.: 0.0083) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.15% (0.0810 => 0.0957, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.71% (0.0773 => 0.0879, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/tsp/tsp: 9.98% (0.1112 => 0.1223, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.44% (0.6010 => 0.6517, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.21% (0.2180 => 0.2359, std.dev.: 0.0060) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.84% (0.3137 => 0.3383, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.80% (0.1885 => 0.2032, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.79% (0.4847 => 0.5176, std.dev.: 0.0106) MultiSource/Applications/viterbi/viterbi: 6.53% (0.1577 => 0.1680, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.32% (0.2279 => 0.2423, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.98% (0.7473 => 0.7920, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.61% (0.3295 => 0.3480, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.58% (0.2240 => 0.2365, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.30% (0.1983 => 0.2088, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.24% (0.8148 => 0.8575, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.49% (0.6287 => 0.6569, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.14% (0.9435 => 0.9826, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.13% (0.2519 => 0.2623, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.09% (0.5817 => 0.6055, std.dev.: 0.0077) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.95% (0.3717 => 0.3864, std.dev.: 0.0016) MultiSource/Applications/treecc/treecc: 3.86% (1.9948 => 2.0717, std.dev.: 0.0270) MultiSource/Applications/hbd/hbd: 3.78% (1.4269 => 1.4809, std.dev.: 0.0168) MultiSource/Applications/spiff/spiff: 3.61% (0.7950 => 0.8237, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.40% (0.8048 => 0.8322, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.32% (4.1763 => 4.3150, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (1.4479 => 1.4954, std.dev.: 0.0122) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.95% (6.6074 => 6.8023, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.81% (0.4127 => 0.4243, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.76% (0.8050 => 0.8272, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.67% (0.8611 => 0.8841, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.61% (0.8855 => 0.9086, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.55% (0.8697 => 0.8919, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.41% (0.9069 => 0.9288, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.38% (1.6386 => 1.6776, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.35% (13.1811 => 13.4907, std.dev.: 0.0874) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.31% (8.6476 => 8.8471, std.dev.: 0.0308) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.26% (4.4873 => 4.5889, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.09% (0.9039 => 0.9228, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.01% (0.9056 => 0.9238, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.95% (0.8359 => 0.8522, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.81% (4.5702 => 4.6527, std.dev.: 0.0168) MultiSource/Benchmarks/Bullet/bullet: 1.74% (31.8598 => 32.4134, std.dev.: 0.1799) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.64% (0.8069 => 0.8201, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.59% (1.2602 => 1.2802, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/football/football: 1.32% (0.8768 => 0.8884, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.26% (0.8995 => 0.9108, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.22% (1.2423 => 1.2575, std.dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.04% (1.5795 => 2.4963, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 19.32% (0.0528 => 0.0630, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.45% (1.1857 => 1.2859, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.07% (0.3186 => 0.3443, std.dev.: 0.0071) MultiSource/Benchmarks/mafft/pairlocalalign: 6.00% (63.1822 => 66.9710, std.dev.: 0.0313) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.25% (2.4490 => 2.5287, std.dev.: 0.0112) SingleSource/Benchmarks/Dhrystone/dry: 3.23% (0.5081 => 0.5245, std.dev.: 0.0034) MultiSource/Applications/siod/siod: 2.65% (3.6643 => 3.7615, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/hash: 1.74% (0.6205 => 0.6313, std.dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -5.23% (29.8330 => 28.2729, std.dev.: 0.1129) SingleSource/Benchmarks/Shootout-C++/hash2: -1.38% (3.4237 => 3.3766, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.24% (3.3479 => 3.3064, std.dev.: 0.0109) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.83% (16.4461 => 16.5834, std.dev.: 0.0845) MultiSource/Applications/obsequi/Obsequi: 4.38% (1.0262 => 1.0711, std.dev.: 0.0061) MultiSource/Applications/sqlite3/sqlite3: 1.86% (0.6332 => 0.6450, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/08-main/main: 6.06% (0.1831 => 0.1942, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 6.61% (0.1559 => 0.1662, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.68% (0.3123 => 0.3238, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.17% (0.2463 => 0.2541, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.38% (0.3344 => 0.3390, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.93% (0.2364 => 0.2386, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: 0.13% (0.6010 => 0.6018, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/mandel: -0.47% (0.0429 => 0.0427, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.99% (0.3266 => 0.3331, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/strcat: 2.59% (0.1969 => 0.2020, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -6.70% (0.0224 => 0.0209, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 41.46% (0.0123 => 0.0174, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.17% (0.0408 => 0.0425, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 12.99% (0.0254 => 0.0287, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 2.86% (0.0384 => 0.0395, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 18.89% (0.0180 => 0.0214, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 32.61% (0.0230 => 0.0305, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 14.29% (0.0007 => 0.0008, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.92% (0.1438 => 0.1480, std.dev.: 0.0027) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.32% (1.1329 => 1.1180, std.dev.: 0.0546) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.28% (0.1462 => 0.1510, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.95% (0.4164 => 0.4041, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.99% (0.1369 => 0.1328, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.31% (0.0641 => 0.0639, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 32.31% (0.0195 => 0.0258, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.06% (0.0578 => 0.0543, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.14% (1.1437 => 1.1421, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -14.29% (0.0014 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.39% (0.0627 => 0.0612, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.44% (0.0180 => 0.0224, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.09% (0.8017 => 0.8010, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 20.97% (0.0062 => 0.0075, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 17:40:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 19:40:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121026004007.D19002A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5226?compare_to=5223&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5226, Order: 166731, Start Time: 2012-10-25 23:15:14, End Time: 2012-10-26 00:40:02 To: 5223, Order: 166714, Start Time: 2012-10-25 21:26:51, End Time: 2012-10-25 22:51:56 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== New Failures: 1 (1 on baseline) Performance Regressions: 1 (5 on baseline) Performance Improvements: 1 (180 on baseline) Removed Tests: 2 (2 on baseline) Unchanged Tests: 1037 (854 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/ClamAV/clamscan: -3.87% (0.1552 => 0.1492, std.dev.: 0.0026) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 1.65% (14.3029 => 14.5386, std.dev.: 0.0100) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -3.39% (0.3927 => 0.3794, std.dev.: 0.0042) Removed Tests - Compile Time ---------------------------- MultiSource/Benchmarks/VersaBench/8b10b/8b10b Removed Tests - Execution Time ------------------------------ MultiSource/Benchmarks/VersaBench/8b10b/8b10b ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/ClamAV/clamscan: -3.49% (0.1546 => 0.1492, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.35% (1.2783 => 1.3722, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1010, std.dev.: 0.0114) SingleSource/Benchmarks/Misc/salsa20: 2.38% (7.4937 => 7.6717, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.25% (54.5751 => 55.8034, std.dev.: 0.4495) SingleSource/Benchmarks/Shootout-C++/hash2: 2.17% (3.1932 => 3.2624, std.dev.: 0.0174) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.94% (0.1431 => 0.1303, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.06% (0.3821 => 0.3513, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -7.51% (2.4924 => 2.3053, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: -7.49% (0.3831 => 0.3544, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/exceptions-4: -7.47% (0.3880 => 0.3590, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.47% (0.3884 => 0.3594, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -7.38% (0.3848 => 0.3564, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -7.37% (0.3812 => 0.3531, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -7.30% (0.3357 => 0.3112, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: -7.29% (0.4033 => 0.3739, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -7.28% (0.4176 => 0.3872, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -7.21% (0.3896 => 0.3615, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.14% (22.4056 => 20.8058, std.dev.: 0.0191) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.13% (0.3142 => 0.2918, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -7.05% (0.4199 => 0.3903, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.04% (0.2428 => 0.2257, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: -7.01% (0.4280 => 0.3980, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.97% (3.5339 => 3.2876, std.dev.: 0.0085) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.91% (0.3891 => 0.3622, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.88% (1.6474 => 1.5340, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.82% (0.1584 => 0.1476, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -6.81% (0.1761 => 0.1641, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.72% (0.9852 => 0.9190, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: -6.71% (0.2160 => 0.2015, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -6.71% (9.2283 => 8.6089, std.dev.: 0.0172) MultiSource/Applications/JM/lencod/lencod: -6.69% (16.1920 => 15.1085, std.dev.: 0.0078) MultiSource/Applications/JM/ldecod/ldecod: -6.69% (7.0961 => 6.6213, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/football/football: -6.68% (0.9179 => 0.8566, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: -6.66% (1.2515 => 1.1681, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -6.63% (1.1450 => 1.0691, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.63% (0.1796 => 0.1677, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: -6.62% (0.2659 => 0.2483, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.56% (0.9542 => 0.8916, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.56% (1.3722 => 1.2822, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.55% (0.2548 => 0.2381, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.55% (1.0544 => 0.9853, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.55% (0.6736 => 0.6295, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.54% (0.2355 => 0.2201) MultiSource/Applications/siod/siod: -6.54% (2.4021 => 2.2451, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/bh/bh: -6.53% (0.2985 => 0.2790, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.53% (0.1716 => 0.1604, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: -6.52% (4.3330 => 4.0506, std.dev.: 0.0026) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.48% (6.7716 => 6.3328, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.47% (5.4682 => 5.1143, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.47% (1.2300 => 1.1504, std.dev.: 0.0091) MultiSource/Benchmarks/nbench/nbench: -6.47% (1.1530 => 1.0784, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.46% (1.4642 => 1.3696, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.45% (0.6484 => 0.6066, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.42% (0.3658 => 0.3423, std.dev.: 0.0020) MultiSource/Applications/lua/lua: -6.42% (4.0594 => 3.7987, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.42% (1.2784 => 1.1963, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.42% (2.2587 => 2.1137, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.40% (4.8161 => 4.5079, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.35% (0.7919 => 0.7416, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.31% (4.8802 => 4.5724, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.27% (0.2695 => 0.2526, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: -6.26% (15.5079 => 14.5377, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.23% (1.6364 => 1.5344, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ks/ks: -6.23% (0.1621 => 0.1520, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: -6.20% (0.4515 => 0.4235, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.19% (4.0323 => 3.7825, std.dev.: 0.0083) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.19% (4.5069 => 4.2278, std.dev.: 0.0103) MultiSource/Applications/treecc/treecc: -6.18% (2.1401 => 2.0078, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: -6.18% (0.7447 => 0.6987, std.dev.: 0.0106) MultiSource/Benchmarks/McCat/18-imp/imp: -6.17% (0.3581 => 0.3360, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.17% (0.4151 => 0.3895, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -6.17% (0.3406 => 0.3196, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: -6.15% (0.5168 => 0.4850, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.15% (0.5478 => 0.5141, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.15% (14.2083 => 13.3348, std.dev.: 0.0209) MultiSource/Applications/SIBsim4/SIBsim4: -6.15% (1.3864 => 1.3012, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.12% (0.3483 => 0.3270, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.10% (0.6293 => 0.5909, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -6.10% (0.5705 => 0.5357, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.10% (0.5805 => 0.5451, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.09% (0.6681 => 0.6274, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: -6.07% (0.2999 => 0.2817, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.06% (0.6304 => 0.5922, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: -6.05% (18.2933 => 17.1866, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/wordfreq: -6.04% (0.3491 => 0.3280, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.03% (0.6297 => 0.5917, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -6.03% (0.4861 => 0.4568, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.03% (0.5925 => 0.5568, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.02% (0.5863 => 0.5510, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.01% (0.5591 => 0.5255, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -5.98% (17.1032 => 16.0802, std.dev.: 0.0142) MultiSource/Applications/d/make_dparser: -5.97% (3.5154 => 3.3057, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.96% (0.5802 => 0.5456, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.96% (0.6660 => 0.6263, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.96% (0.4916 => 0.4623, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.95% (0.3931 => 0.3697, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.94% (0.6395 => 0.6015, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.94% (0.7339 => 0.6903, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.93% (1.2221 => 1.1496, std.dev.: 0.0089) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.93% (0.2278 => 0.2143, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.92% (0.5575 => 0.5245, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.91% (1.2210 => 1.1488, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.91% (0.5581 => 0.5251, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.91% (0.5859 => 0.5513, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -5.90% (1.3148 => 1.2372, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.89% (0.5569 => 0.5241, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.89% (0.2106 => 0.1982, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.88% (0.6052 => 0.5696, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.87% (0.6189 => 0.5826, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.86% (0.6667 => 0.6276, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.86% (0.6395 => 0.6020, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.84% (0.8521 => 0.8023, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.83% (0.6230 => 0.5867, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.82% (0.5999 => 0.5650, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.80% (0.4083 => 0.3846, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -5.80% (34.0927 => 32.1159, std.dev.: 0.0218) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.78% (0.7524 => 0.7089, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -5.78% (0.6750 => 0.6360, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -5.78% (0.7982 => 0.7521, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.75% (0.5857 => 0.5520, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.75% (8.0126 => 7.5521, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.74% (0.6676 => 0.6293, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.73% (0.6194 => 0.5839, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.73% (0.5849 => 0.5514, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.73% (0.7021 => 0.6619, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.71% (0.5688 => 0.5363, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.70% (0.5329 => 0.5025, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.68% (0.6440 => 0.6074, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.68% (0.3837 => 0.3619, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.66% (0.3849 => 0.3631, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.66% (0.6446 => 0.6081, std.dev.: 0.0122) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.66% (0.2385 => 0.2250, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.65% (0.6260 => 0.5906, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -5.64% (0.1879 => 0.1773, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.64% (0.5941 => 0.5606, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.63% (0.3323 => 0.3136, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.62% (0.5567 => 0.5254, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.62% (0.9557 => 0.9020, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.60% (0.5570 => 0.5258, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.59% (0.5456 => 0.5151, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.59% (0.6033 => 0.5696, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -5.58% (0.3026 => 0.2857, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.58% (0.7198 => 0.6796, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.58% (0.2903 => 0.2741, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.58% (0.4427 => 0.4180, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.57% (0.3252 => 0.3071, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -5.54% (0.3446 => 0.3255, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -5.54% (0.8418 => 0.7952, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.53% (2.1713 => 2.0512, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: -5.53% (0.3255 => 0.3075, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: -5.52% (0.2989 => 0.2824, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -5.52% (0.3481 => 0.3289, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.50% (0.2871 => 0.2713, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -5.44% (0.3788 => 0.3582, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.43% (0.3057 => 0.2891, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -5.42% (0.3394 => 0.3210, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.40% (0.4813 => 0.4553, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -5.39% (0.3025 => 0.2862, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.37% (0.4321 => 0.4089, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.35% (0.2933 => 0.2776, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -5.35% (0.3271 => 0.3096, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: -5.34% (0.2939 => 0.2782, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: -5.33% (0.3059 => 0.2896, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -5.32% (0.3194 => 0.3024, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -5.31% (0.4524 => 0.4284, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/wc: -5.30% (0.3205 => 0.3035, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.27% (0.3319 => 0.3144, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: -5.23% (0.4248 => 0.4026, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.17% (0.3016 => 0.2860, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists1: -5.17% (0.3867 => 0.3667, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: -5.05% (0.7779 => 0.7386, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: -5.04% (5.0226 => 4.7695, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/Hello: -4.99% (0.6347 => 0.6030, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -4.97% (0.6441 => 0.6121, std.dev.: 0.0030) MultiSource/Applications/ClamAV/clamscan: -4.68% (15.2527 => 14.5386, std.dev.: 0.0100) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.48% (0.9077 => 0.8670, std.dev.: 0.0022) MultiSource/Applications/hbd/hbd: -4.22% (1.5610 => 1.4952, std.dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -2.36% (20.7746 => 20.2835, std.dev.: 0.0283) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.32% (7.5137 => 5.7618, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/richards_benchmark: -8.76% (1.2842 => 1.1717, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: -3.91% (2.2633 => 2.1747, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7061, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.06% (1.0557 => 1.0234, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0002) Removed Tests - Compile Time ---------------------------- MultiSource/Benchmarks/VersaBench/8b10b/8b10b Removed Tests - Execution Time ------------------------------ MultiSource/Benchmarks/VersaBench/8b10b/8b10b Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 19:07:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 21:07:49 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121026020749.1D16D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5227?compare_to=5225&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5227, Order: 166742, Start Time: 2012-10-26 00:43:43, End Time: 2012-10-26 02:07:43 To: 5225, Order: 166731, Start Time: 2012-10-25 23:02:23, End Time: 2012-10-26 00:26:34 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 5 (59 on baseline) Performance Improvements: 6 (3 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 964 (912 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 13.30% (3.0034 => 3.4030, std.dev.: 0.1275) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.97% (0.7589 => 0.8042, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.99% (59.5320 => 60.7195, std.dev.: 0.3342) SingleSource/Benchmarks/Misc/ReedSolomon: 1.39% (8.7137 => 8.8346, std.dev.: 0.0414) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.09% (1.4467 => 1.4624, std.dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.57% (0.3480 => 0.3286, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/loader/loader: -3.61% (0.3126 => 0.3013, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/football/football: -2.05% (0.8884 => 0.8702, std.dev.: 0.0070) MultiSource/Applications/treecc/treecc: -2.03% (2.0717 => 2.0296, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.41% (0.9086 => 0.8958, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -1.05% (2.3912 => 2.3662, std.dev.: 0.0062) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.29% (16.5834 => 16.6309, std.dev.: 0.1336) MultiSource/Applications/obsequi/Obsequi: -1.14% (1.0711 => 1.0589, std.dev.: 0.0106) MultiSource/Applications/sqlite3/sqlite3: -0.31% (0.6450 => 0.6430, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/08-main/main: 1.85% (0.1942 => 0.1978, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.60% (0.1662 => 0.1569, std.dev.: 0.0106) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.46% (0.3238 => 0.3253, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.14% (0.2541 => 0.2512, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.62% (0.3390 => 0.3369, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.05% (0.2386 => 0.2337, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/bigfib: 0.70% (0.6018 => 0.6060, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel: 8.43% (0.0427 => 0.0463, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.36% (0.3331 => 0.3343, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/strcat: -0.20% (0.2020 => 0.2016, std.dev.: 0.0014) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 19.62% (0.0209 => 0.0250, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 24.71% (0.0174 => 0.0217, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0425 => 0.0425, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 15.33% (0.0287 => 0.0331, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.96% (0.0314 => 0.0311, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 6.84% (0.0395 => 0.0422, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -1.49% (0.0202 => 0.0199, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 1.87% (0.0214 => 0.0218, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: 11.48% (0.0305 => 0.0340, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 62.50% (0.0008 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1480 => 0.1481, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 1.78% (1.1180 => 1.1379, std.dev.: 0.0404) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.73% (0.1510 => 0.1521, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.62% (0.4041 => 0.4016, std.dev.: 0.0207) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.39% (0.1328 => 0.1373, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.16% (0.0639 => 0.0638, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 7.36% (0.0258 => 0.0277) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.03% (0.0543 => 0.0554, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.20% (1.1421 => 1.1444, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1800.00% (0.0001 => 0.0019, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -91.67% (0.0012 => 0.0001, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.61% (0.0612 => 0.0628, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.57% (0.0224 => 0.0232, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.39% (0.8010 => 0.8041, std.dev.: 0.0068) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 9.33% (0.0075 => 0.0082, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.97% (2.1832 => 1.6599, std.dev.: 0.0025) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.91% (0.0810 => 0.0947, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/tsp/tsp: 10.61% (0.1112 => 0.1230, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.41% (0.8321 => 0.8938, std.dev.: 0.0092) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.42% (0.1885 => 0.2006, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.72% (0.1905 => 0.2014, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.23% (0.2180 => 0.2294, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.68% (0.2519 => 0.2637, std.dev.: 0.0029) MultiSource/Applications/hbd/hbd: 4.58% (1.4269 => 1.4923, std.dev.: 0.0071) MultiSource/Applications/Burg/burg: 3.77% (1.2222 => 1.2683, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.36% (1.1685 => 1.2078, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.26% (0.3717 => 0.3838, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 3.19% (0.7932 => 0.8185, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.12% (1.1606 => 1.1968, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.83% (0.5191 => 0.5338, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.72% (1.4479 => 1.4873, std.dev.: 0.0054) MultiSource/Applications/lua/lua: 2.57% (3.8189 => 3.9170, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/hash2: 2.50% (0.4125 => 0.4228, std.dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: 2.46% (14.7684 => 15.1321, std.dev.: 0.0543) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.46% (0.4559 => 0.4671, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.30% (0.8007 => 0.8191, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.23% (0.8340 => 0.8526, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.04% (0.8716 => 0.8894, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.02% (13.1811 => 13.4479, std.dev.: 0.0645) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.99% (4.1763 => 4.2596, std.dev.: 0.0250) MultiSource/Applications/minisat/minisat: 1.93% (0.6834 => 0.6966, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.83% (0.8611 => 0.8769, std.dev.: 0.0051) MultiSource/Applications/siod/siod: 1.82% (2.2184 => 2.2588, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.82% (0.8697 => 0.8855, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.80% (0.9074 => 0.9237, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.74% (0.9908 => 1.0080, std.dev.: 0.0034) MultiSource/Applications/lemon/lemon: 1.71% (1.0945 => 1.1132, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 1.65% (0.9810 => 0.9972, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.62% (0.8805 => 0.8948, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 1.62% (14.2605 => 14.4916, std.dev.: 0.0618) MultiSource/Applications/JM/ldecod/ldecod: 1.60% (6.7320 => 6.8394, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.55% (0.9688 => 0.9838, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.38% (0.8286 => 0.8400, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.33% (0.8204 => 0.8313, std.dev.: 0.0037) MultiSource/Applications/JM/lencod/lencod: 1.29% (15.3280 => 15.5255, std.dev.: 0.0353) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.28% (0.8066 => 0.8169, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.16% (0.8855 => 0.8958, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.07% (1.2423 => 1.2556, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 1.00% (4.9628 => 5.0125, std.dev.: 0.0106) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 54.17% (1.5795 => 2.4351, std.dev.: 0.0325) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.29% (0.3186 => 0.3482, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.66% (1.1857 => 1.2765, std.dev.: 0.0053) MultiSource/Benchmarks/mafft/pairlocalalign: 5.94% (63.1822 => 66.9350, std.dev.: 0.0242) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.86% (0.7597 => 0.8042, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 5.23% (2.2485 => 2.3662, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/distray/distray: 4.44% (0.2390 => 0.2496, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: 3.54% (8.5322 => 8.8346, std.dev.: 0.0414) SingleSource/Benchmarks/Dhrystone/dry: 2.99% (0.5081 => 0.5233, std.dev.: 0.0048) MultiSource/Applications/siod/siod: 2.76% (3.6643 => 3.7656, std.dev.: 0.0170) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.46% (59.2638 => 60.7195, std.dev.: 0.3342) MultiSource/Benchmarks/Olden/bh/bh: 1.79% (2.3560 => 2.3981, std.dev.: 0.0100) MultiSource/Applications/minisat/minisat: 1.60% (6.1525 => 6.2509, std.dev.: 0.0337) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.47% (4.8362 => 4.9075, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.44% (1.5941 => 1.6170, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/whetstone: 1.01% (2.1224 => 2.1439, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -5.04% (29.8330 => 28.3290, std.dev.: 0.1169) SingleSource/Benchmarks/Shootout-C++/hash2: -1.35% (3.4237 => 3.3776, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.13% (3.3479 => 3.3102, std.dev.: 0.0111) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 1.12% (16.4461 => 16.6309, std.dev.: 0.1336) MultiSource/Applications/obsequi/Obsequi: 3.19% (1.0262 => 1.0589, std.dev.: 0.0106) MultiSource/Applications/sqlite3/sqlite3: 1.55% (0.6332 => 0.6430, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/08-main/main: 8.03% (0.1831 => 0.1978, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.64% (0.1559 => 0.1569, std.dev.: 0.0106) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.16% (0.3123 => 0.3253, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.99% (0.2463 => 0.2512, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.75% (0.3344 => 0.3369, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.14% (0.2364 => 0.2337, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/bigfib: 0.83% (0.6010 => 0.6060, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel: 7.93% (0.0429 => 0.0463, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.36% (0.3266 => 0.3343, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/strcat: 2.39% (0.1969 => 0.2016, std.dev.: 0.0014) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 11.61% (0.0224 => 0.0250, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 76.42% (0.0123 => 0.0217, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.17% (0.0408 => 0.0425, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.31% (0.0254 => 0.0331, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.98% (0.0302 => 0.0311, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.90% (0.0384 => 0.0422, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 4.74% (0.0190 => 0.0199, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: 47.83% (0.0230 => 0.0340, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.99% (0.1438 => 0.1481, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.44% (1.1329 => 1.1379, std.dev.: 0.0404) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 4.04% (0.1462 => 0.1521, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.55% (0.4164 => 0.4016, std.dev.: 0.0207) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.29% (0.1369 => 0.1373, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.47% (0.0641 => 0.0638, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.15% (0.0578 => 0.0554, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.06% (1.1437 => 1.1444, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1800.00% (0.0001 => 0.0019, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.16% (0.0627 => 0.0628, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 28.89% (0.0180 => 0.0232, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.30% (0.8017 => 0.8041, std.dev.: 0.0068) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 32.26% (0.0062 => 0.0082, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 19:29:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 21:29:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121026022936.E0CA02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5228?compare_to=5226&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5228, Order: 166745, Start Time: 2012-10-26 01:04:25, End Time: 2012-10-26 02:29:30 To: 5226, Order: 166731, Start Time: 2012-10-25 23:15:14, End Time: 2012-10-26 00:40:02 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== New Passes: 1 (0 on baseline) Performance Regressions: 0 (4 on baseline) Performance Improvements: 2 (181 on baseline) Added Tests: 2 (0 on baseline) Unchanged Tests: 1037 (857 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/ClamAV/clamscan: 5.03% (0.1492 => 0.1567, std.dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.22% (20.2835 => 20.0359, std.dev.: 0.0239) MultiSource/Applications/ClamAV/clamscan: -1.15% (14.5386 => 14.3709, std.dev.: 0.0121) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/VersaBench/8b10b/8b10b Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/VersaBench/8b10b/8b10b ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.80% (2.0478 => 2.1052, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: 2.54% (7.4937 => 7.6837, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/hash2: 2.15% (3.1932 => 3.2619, std.dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.94% (0.1431 => 0.1303, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.93% (0.3821 => 0.3518, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -7.24% (2.4924 => 2.3120, std.dev.: 0.0051) MultiSource/Applications/sgefa/sgefa: -7.21% (0.3357 => 0.3115, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.98% (0.3884 => 0.3613, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: -6.97% (0.3831 => 0.3564, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.96% (0.3880 => 0.3610, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.93% (0.3896 => 0.3626, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: -6.92% (0.4033 => 0.3754, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.91% (0.3891 => 0.3622, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: -6.91% (0.3848 => 0.3582, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.90% (0.4176 => 0.3888, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.84% (22.4056 => 20.8726, std.dev.: 0.0188) SingleSource/UnitTests/ObjC/trivial-interface: -6.82% (0.3812 => 0.3552, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -6.81% (0.1761 => 0.1641, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.78% (0.3142 => 0.2929, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: -6.75% (0.9179 => 0.8559, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.73% (3.5339 => 3.2962, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.72% (0.3658 => 0.3412, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -6.64% (0.4199 => 0.3920, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: -6.62% (0.2160 => 0.2017, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -6.60% (0.1879 => 0.1755, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: -6.60% (9.2283 => 8.6196, std.dev.: 0.0120) MultiSource/Benchmarks/nbench/nbench: -6.59% (1.1530 => 1.0770, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.59% (0.2428 => 0.2268, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.57% (0.1796 => 0.1678, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: -6.56% (1.2515 => 1.1694, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -6.54% (0.4280 => 0.4000, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -6.53% (16.1920 => 15.1340, std.dev.: 0.0091) MultiSource/Applications/JM/ldecod/ldecod: -6.51% (7.0961 => 6.6341, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.51% (0.9542 => 0.8921, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.50% (0.1584 => 0.1481, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.49% (1.6474 => 1.5405, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.49% (1.0544 => 0.9860, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.46% (0.6484 => 0.6065, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -6.46% (4.3330 => 4.0531, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.44% (0.9852 => 0.9218, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.38% (1.3722 => 1.2846, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.38% (1.4642 => 1.3708, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: -6.36% (0.2659 => 0.2490, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -6.32% (1.1450 => 1.0726, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.31% (1.2784 => 1.1977, std.dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.31% (6.7716 => 6.3442, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.31% (0.2695 => 0.2525, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -6.30% (4.0594 => 3.8036, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.29% (0.6736 => 0.6312, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.29% (0.1716 => 0.1608, std.dev.: 0.0012) MultiSource/Applications/siod/siod: -6.27% (2.4021 => 2.2515, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: -6.26% (0.7447 => 0.6981, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (4.0323 => 3.7802, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.24% (0.2548 => 0.2389, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.24% (1.2300 => 1.1533, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.22% (4.5069 => 4.2264, std.dev.: 0.0099) MultiSource/Benchmarks/McCat/05-eks/eks: -6.16% (0.4515 => 0.4237, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.15% (5.4682 => 5.1318, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.15% (0.6293 => 0.5906, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.14% (0.4151 => 0.3896, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/bh/bh: -6.13% (0.2985 => 0.2802, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.11% (0.2355 => 0.2211, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.10% (4.8802 => 4.5824, std.dev.: 0.0053) MultiSource/Applications/hexxagon/hexxagon: -6.10% (1.3148 => 1.2346, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.10% (2.2587 => 2.1210, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.09% (4.8161 => 4.5227, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.07% (0.7198 => 0.6761, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: -6.07% (0.4861 => 0.4566, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -6.05% (1.3864 => 1.3025, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.05% (0.6052 => 0.5686, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -6.03% (34.0927 => 32.0370, std.dev.: 0.0165) MultiSource/Benchmarks/sim/sim: -6.02% (0.3406 => 0.3201, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/functionobjects: -6.02% (0.5168 => 0.4857, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.99% (14.2083 => 13.3570, std.dev.: 0.0119) MultiSource/Applications/SPASS/SPASS: -5.99% (15.5079 => 14.5791, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.99% (1.6364 => 1.5384, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.98% (0.3849 => 0.3619, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.97% (0.5591 => 0.5257, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.95% (0.4083 => 0.3840, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.92% (0.6304 => 0.5931, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.92% (0.3837 => 0.3610, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.90% (0.3491 => 0.3285, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: -5.89% (0.3581 => 0.3370, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary2: -5.89% (0.3481 => 0.3276, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.88% (0.7919 => 0.7453, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/except: -5.88% (0.3026 => 0.2848, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.87% (0.5805 => 0.5464, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.87% (0.5705 => 0.5370, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.87% (0.5859 => 0.5515, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.86% (0.4321 => 0.4068, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.85% (0.6681 => 0.6290, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -5.85% (0.6750 => 0.6355, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.85% (0.2871 => 0.2703, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.85% (0.3931 => 0.3701, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.84% (0.6230 => 0.5866, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.84% (0.3323 => 0.3129, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.84% (0.4916 => 0.4629, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: -5.83% (0.3621 => 0.3410, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -5.82% (0.7779 => 0.7326, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.82% (0.5857 => 0.5516, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: -5.82% (0.2989 => 0.2815, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -5.82% (17.1032 => 16.1077, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.82% (0.7339 => 0.6912, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.82% (0.6395 => 0.6023, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: -5.81% (2.1401 => 2.0157, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.81% (0.6194 => 0.5834, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.80% (0.6667 => 0.6280, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: -5.80% (0.3446 => 0.3246, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.80% (0.6395 => 0.6024, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: -5.80% (3.5154 => 3.3115, std.dev.: 0.0077) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.79% (0.2278 => 0.2146, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.79% (0.6446 => 0.6073, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -5.78% (15.2527 => 14.3709, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.78% (0.6297 => 0.5933, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.77% (0.3483 => 0.3282, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.77% (0.2999 => 0.2826, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.77% (0.6676 => 0.6291, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.77% (0.6260 => 0.5899, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.76% (0.5925 => 0.5584, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.75% (0.2903 => 0.2736, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.75% (0.3252 => 0.3065, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.75% (0.5478 => 0.5163, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.75% (0.5863 => 0.5526, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.74% (0.5575 => 0.5255, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -5.72% (18.2933 => 17.2461, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/methcall: -5.72% (0.3025 => 0.2852, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.72% (1.2210 => 1.1512, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.72% (0.7524 => 0.7094, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -5.71% (0.3255 => 0.3069, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -5.71% (0.3205 => 0.3022, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.71% (0.5941 => 0.5602, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.71% (0.6660 => 0.6280, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.70% (2.1713 => 2.0476, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.69% (0.3057 => 0.2883, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.69% (0.6189 => 0.5837, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: -5.69% (0.3394 => 0.3201, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -5.68% (0.2939 => 0.2772, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.67% (0.4427 => 0.4176, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.67% (0.8521 => 0.8038, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.66% (0.5581 => 0.5265, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.66% (0.2933 => 0.2767, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -5.65% (0.2849 => 0.2688, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.64% (0.6440 => 0.6077, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.63% (1.2221 => 1.1533, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.62% (0.6033 => 0.5694, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.60% (0.2106 => 0.1988, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.60% (8.0126 => 7.5637, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.60% (0.7021 => 0.6628, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: -5.60% (0.3788 => 0.3576, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -5.59% (0.3059 => 0.2888, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.59% (0.9557 => 0.9023, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.58% (0.5570 => 0.5259, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.58% (0.2385 => 0.2252, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.57% (0.5329 => 0.5032, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.54% (0.3319 => 0.3135, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: -5.54% (0.3194 => 0.3017, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -5.53% (0.3867 => 0.3653, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.51% (0.5569 => 0.5262, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -5.51% (0.4248 => 0.4014, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.50% (0.5688 => 0.5375, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -5.50% (0.6441 => 0.6087, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.49% (0.5849 => 0.5528, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.49% (0.4813 => 0.4549, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/Hello: -5.48% (0.6347 => 0.5999, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.46% (0.5456 => 0.5158, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.46% (0.5567 => 0.5263, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.45% (0.5999 => 0.5672, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.40% (0.3016 => 0.2853, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -5.38% (0.3271 => 0.3095, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -5.32% (0.7982 => 0.7557, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: -5.26% (0.8418 => 0.7975, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: -5.19% (0.4524 => 0.4289, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.69% (0.9077 => 0.8651, std.dev.: 0.0024) MultiSource/Applications/oggenc/oggenc: -4.68% (5.0226 => 4.7875, std.dev.: 0.0020) MultiSource/Applications/hbd/hbd: -4.32% (1.5610 => 1.4936, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -3.56% (20.7746 => 20.0359, std.dev.: 0.0239) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7513, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/richards_benchmark: -8.61% (1.2842 => 1.1736) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7063, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.87% (2.2633 => 2.1757, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.64% (1.3096 => 1.2750, std.dev.: 0.0064) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4705, std.dev.: 0.0012) Report Time: 2.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 20:19:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 22:19:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121026031932.AB3312A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5229?compare_to=5221&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5229, Order: 166745, Start Time: 2012-10-26 01:55:46, End Time: 2012-10-26 03:19:26 To: 5221, Order: 166711, Start Time: 2012-10-25 20:25:44, End Time: 2012-10-25 21:46:12 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (73 on baseline) New Passes: 12 (17 on baseline) Performance Regressions: 7 (147 on baseline) Performance Improvements: 24 (44 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 75 (2 on baseline) Unchanged Tests: 924 (697 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 151.30% (0.6293 => 1.5814, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 0.45% (17.2956 => 17.3734, std.dev.: 0.0186) MultiSource/Applications/kimwitu++/kc: 23.77% (15.7425 => 19.4852, std.dev.: 0.0033) MultiSource/Benchmarks/Bullet/bullet: 1.34% (57.2805 => 58.0487, std.dev.: 0.0175) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 261.43% (8.2990 => 29.9947, std.dev.: 0.0156) SingleSource/Benchmarks/Misc-C++/stepanov_container: 49.91% (0.6953 => 1.0423, std.dev.: 0.0689) New Passes - Execution Time --------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 4016800.00% (0.0001 => 4.0169, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 11183600.00% (0.0001 => 11.1837, std.dev.: 0.0089) MultiSource/Applications/kimwitu++/kc: 50400.00% (0.0001 => 0.0505, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 7626100.00% (0.0001 => 7.6262, std.dev.: 0.0110) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 793300.00% (0.0001 => 0.7934, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5487700.00% (0.0001 => 5.4878, std.dev.: 0.8919) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: 15.35% (0.0736 => 0.0849, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 2.94% (0.5650 => 0.5816, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 2.87% (0.3653 => 0.3758, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.93% (1.3473 => 1.3733, std.dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/salsa20: 33.81% (10.0985 => 13.5130, std.dev.: 0.0495) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.03% (2.9651 => 3.0549, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.04% (79.5457 => 80.3698, std.dev.: 0.2486) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -60.49% (0.2245 => 0.0887, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/08-main/main: -28.48% (0.4207 => 0.3009, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -24.58% (3.3216 => 2.5050, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -24.29% (0.2001 => 0.1515, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -20.44% (2.0291 => 1.6144, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -15.85% (3.7663 => 3.1692, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -15.52% (3.7644 => 3.1803, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -14.62% (1.2505 => 1.0677, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -14.04% (8.5018 => 7.3079, std.dev.: 0.0098) MultiSource/Benchmarks/Olden/power/power: -13.17% (0.1686 => 0.1464, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -10.08% (15.7788 => 14.1889, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -9.96% (0.1646 => 0.1482, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -7.70% (2.6339 => 2.4312, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.27% (8.9856 => 8.4221, std.dev.: 0.0122) MultiSource/Applications/JM/ldecod/ldecod: -5.59% (11.8326 => 11.1708, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.41% (1.5871 => 1.5012, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.92% (2.9397 => 2.7950, std.dev.: 0.0021) MultiSource/Applications/hbd/hbd: -3.09% (1.7626 => 1.7082, std.dev.: 0.0042) MultiSource/Applications/ClamAV/clamscan: -2.39% (21.6284 => 21.1117, std.dev.: 0.0098) MultiSource/Applications/oggenc/oggenc: -2.36% (6.5352 => 6.3809, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.00% (9.3362 => 9.2428, std.dev.: 0.0093) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/JM/lencod/lencod: -12.27% (9.7950 => 8.5927, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/oourafft: -5.65% (6.6605 => 6.2841, std.dev.: 0.0206) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.28% (1.5193 => 1.4999, std.dev.: 0.0067) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.21% (0.0487 => 0.0488, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.20% (0.0489 => 0.0490, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.22% (0.0456 => 0.0457, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.22% (0.0458 => 0.0459) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.22% (0.0446 => 0.0447, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.67% (0.0447 => 0.0450, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.23% (0.0440 => 0.0441) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.23% (0.0442 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0459 => 0.0459, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.22% (0.0459 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.22% (0.0452 => 0.0453, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.22% (0.0454 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.23% (0.0442 => 0.0443, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.23% (0.0444 => 0.0445, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0450 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.22% (0.0451 => 0.0452, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.22% (0.0461 => 0.0462, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.43% (0.0462 => 0.0464, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.23% (0.0438 => 0.0439) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.23% (0.0438 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.45% (0.0449 => 0.0451) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.22% (0.0451 => 0.0452) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.23% (0.0441 => 0.0442, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.23% (0.0442 => 0.0443, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.23% (0.0434 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.46% (0.0433 => 0.0435, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.23% (0.0431 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0434 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.21% (0.0469 => 0.0470, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.21% (0.0470 => 0.0471, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.23% (0.0431 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.23% (0.0432 => 0.0433) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.23% (0.0432 => 0.0433) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.23% (0.0433 => 0.0434) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.23% (0.0440 => 0.0441) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.23% (0.0441 => 0.0442, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/BenchmarkGame/puzzle MultiSource/Applications/oggenc/oggenc: -2.16% (0.1438 => 0.1407, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0649 => 0.0649, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.63% (0.3825 => 0.3849, std.dev.: 0.0676) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/puzzle: -44.71% (0.6962 => 0.3849, std.dev.: 0.0676) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 202.43% (0.5229 => 1.5814, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 15.90% (14.9895 => 17.3734, std.dev.: 0.0186) MultiSource/Applications/kimwitu++/kc: 37.65% (14.1553 => 19.4852, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/gs/gs: 13.61% (4.1105 => 4.6700, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 35.88% (1.1048 => 1.5012, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 319.03% (7.1582 => 29.9947, std.dev.: 0.0156) SingleSource/Benchmarks/Misc-C++-EH/spirit: 69.14% (3.4629 => 5.8570, std.dev.: 0.4665) SingleSource/Benchmarks/Misc-C++/stepanov_container: 67.52% (0.6222 => 1.0423, std.dev.: 0.0689) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 11834.31% (0.0720 => 8.5927, std.dev.: 0.0038) MultiSource/Applications/SIBsim4/SIBsim4: 4016800.00% (0.0001 => 4.0169, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 11183600.00% (0.0001 => 11.1837, std.dev.: 0.0089) MultiSource/Applications/kimwitu++/kc: 50400.00% (0.0001 => 0.0505, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 63200.00% (0.0001 => 0.0633, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 793300.00% (0.0001 => 0.7934, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050800.00% (0.0001 => 10.0509, std.dev.: 0.0222) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5487700.00% (0.0001 => 5.4878, std.dev.: 0.8919) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 69.14% (0.0256 => 0.0433, std.dev.: 0.0024) SingleSource/Regression/C/sumarraymalloc: 56.38% (0.0243 => 0.0380, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 54.24% (0.0271 => 0.0418, std.dev.: 0.0021) SingleSource/Regression/C/sumarray: 44.59% (0.0231 => 0.0334, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 42.10% (1.5859 => 2.2535, std.dev.: 0.0558) MultiSource/Benchmarks/FreeBench/distray/distray: 41.00% (0.1056 => 0.1489, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 36.86% (10.3673 => 14.1889, std.dev.: 0.0032) SingleSource/UnitTests/vla: 33.80% (0.0355 => 0.0475, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 31.36% (2.2024 => 2.8930, std.dev.: 0.2149) SingleSource/Benchmarks/Misc/flops: 28.91% (0.1432 => 0.1846, std.dev.: 0.0088) MultiSource/Benchmarks/FreeBench/neural/neural: 28.50% (0.1463 => 0.1880, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 24.71% (0.1655 => 0.2064, std.dev.: 0.0121) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 23.38% (0.0834 => 0.1029, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.97% (0.1566 => 0.1910, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 21.28% (0.2049 => 0.2485, std.dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.09% (0.0871 => 0.1046, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 19.20% (0.4879 => 0.5816, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 19.16% (0.1555 => 0.1853, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 19.02% (0.5105 => 0.6076, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 18.29% (0.3177 => 0.3758, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 17.96% (0.0746 => 0.0880, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/tsp/tsp: 17.96% (0.1175 => 0.1386, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.89% (0.6675 => 0.7869, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 17.82% (0.2554 => 0.3009, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 17.81% (0.0730 => 0.0860, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.53% (0.0793 => 0.0932, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.49% (0.1029 => 0.1209, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.33% (1.3050 => 1.5311, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: 17.25% (0.0626 => 0.0734, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/em3d/em3d: 17.05% (0.1695 => 0.1984, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 16.83% (3.3354 => 3.8967, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.83% (0.8172 => 0.9547, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/mst/mst: 16.77% (0.1163 => 0.1358, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.56% (0.2271 => 0.2647, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.38% (0.1032 => 0.1201, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 16.26% (0.7115 => 0.8272, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.25% (0.0886 => 0.1030, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.24% (0.3121 => 0.3628, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.21% (1.5415 => 1.7914, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 16.16% (0.1510 => 0.1754, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 16.09% (0.1125 => 0.1306, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.08% (0.4615 => 0.5357, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 16.01% (0.1337 => 0.1551, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 15.99% (1.1840 => 1.3733, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.91% (0.0842 => 0.0976, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.88% (0.1940 => 0.2248, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.85% (0.0675 => 0.0782, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.63% (0.0838 => 0.0969, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 15.44% (0.3109 => 0.3589, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 15.22% (1.1642 => 1.3414, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.22% (0.1117 => 0.1287, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 15.03% (0.1584 => 0.1822, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.99% (0.9765 => 1.1229, std.dev.: 0.0044) MultiSource/Applications/aha/aha: 14.94% (0.1151 => 0.1323, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.87% (0.2758 => 0.3168, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.85% (0.2700 => 0.3101, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 14.85% (0.1906 => 0.2189, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 14.81% (0.3423 => 0.3930, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.81% (0.0770 => 0.0884, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.80% (4.2646 => 4.8956, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.79% (0.0730 => 0.0838, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 14.75% (0.7835 => 0.8991, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.71% (0.2107 => 0.2417, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.67% (0.2065 => 0.2368, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/rem: 14.60% (0.1144 => 0.1311, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.58% (0.5981 => 0.6853, std.dev.: 0.0036) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.52% (0.1143 => 0.1309, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.25% (0.6450 => 0.7369, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.12% (0.1062 => 0.1212, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.10% (0.5860 => 0.6686, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 14.09% (0.7433 => 0.8480, std.dev.: 0.0068) MultiSource/Applications/treecc/treecc: 14.07% (2.0273 => 2.3125, std.dev.: 0.0052) MultiSource/Benchmarks/NPB-serial/is/is: 14.05% (0.0719 => 0.0820) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.04% (0.0798 => 0.0910, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.93% (0.0933 => 0.1063, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.90% (0.0770 => 0.0877, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 13.82% (9.4845 => 10.7952, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.66% (1.4186 => 1.6124, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.60% (8.1363 => 9.2428, std.dev.: 0.0093) MultiSource/Benchmarks/McCat/09-vor/vor: 13.55% (0.3180 => 0.3611, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 13.48% (1.0722 => 1.2167, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.42% (0.1625 => 0.1843, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.39% (0.8067 => 0.9147, std.dev.: 0.0044) MultiSource/Applications/lua/lua: 13.32% (3.8723 => 4.3882, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.20% (0.5569 => 0.6304, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.10% (0.2603 => 0.2944, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 13.09% (0.1268 => 0.1434, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 12.98% (0.4299 => 0.4857, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.90% (0.3441 => 0.3885, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 12.63% (0.8921 => 1.0048, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.62% (4.9449 => 5.5689, std.dev.: 0.0080) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.56% (0.1330 => 0.1497, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.54% (5.0018 => 5.6292, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.39% (1.1861 => 1.3330, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 12.23% (0.3092 => 0.3470, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 12.13% (0.3387 => 0.3798, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.64% (0.8101 => 0.9044, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 11.42% (2.2969 => 2.5591, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/trivial-interface: 11.37% (0.3473 => 0.3868, std.dev.: 0.0129) SingleSource/UnitTests/ObjC/exceptions-2: 11.27% (0.3497 => 0.3891, std.dev.: 0.0133) SingleSource/UnitTests/ObjC/exceptions-4: 11.26% (0.3543 => 0.3942, std.dev.: 0.0150) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 11.23% (0.0953 => 0.1060, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions: 11.21% (0.3828 => 0.4257, std.dev.: 0.0166) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.18% (0.3543 => 0.3939, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.82% (0.1044 => 0.1157, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 10.80% (5.7591 => 6.3809, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.48% (0.4103 => 0.4533, std.dev.: 0.0097) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.47% (0.1892 => 0.2090, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.40% (2.2022 => 2.4312, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 9.65% (21.9371 => 24.0549, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.59% (0.3826 => 0.4193, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 9.48% (1.5603 => 1.7082, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.38% (0.2430 => 0.2658, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.90% (0.3427 => 0.3732, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 8.87% (17.1811 => 18.7048, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.36% (14.3668 => 15.5682, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.08% (0.3650 => 0.3945, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.78% (0.3162 => 0.3408, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.60% (2.0665 => 2.2235, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 7.04% (10.4361 => 11.1708, std.dev.: 0.0074) MultiSource/Applications/hexxagon/hexxagon: 7.00% (1.2842 => 1.3741, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.06% (0.3136 => 0.3326, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.78% (7.9617 => 8.4221, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.60% (7.0540 => 7.3079, std.dev.: 0.0098) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0666) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std.dev.: 0.0310) SingleSource/Benchmarks/Misc/salsa20: 31.41% (10.2830 => 13.5130, std.dev.: 0.0495) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1725, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 14.08% (2.6778 => 3.0549, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.38% (0.9957 => 1.1289, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.99% (1.1396 => 1.2535, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.64% (2.8904 => 3.0823, std.dev.: 0.0065) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 3.79% (1.9405 => 2.0140, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.24% (0.3987 => 0.4116) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.61% (4.2280 => 4.3384, std.dev.: 0.0101) MultiSource/Benchmarks/Olden/bisort/bisort: 1.93% (0.8333 => 0.8494, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2079, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.49% (11.6436 => 11.8175, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.34% (2.6546 => 2.6903, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 1.27% (4.4649 => 4.5218, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 1.15% (2.2771 => 2.3034, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 1.08% (9.1159 => 9.2141, std.dev.: 0.0343) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.94% (6.6874 => 0.1378, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -82.49% (0.8651 => 0.1515, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -52.52% (5.2763 => 2.5050, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -45.31% (0.1622 => 0.0887, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -41.15% (5.3855 => 3.1692, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.58% (5.3526 => 3.1803, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.32% (1.7609 => 1.6144, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -8.21% (63.2438 => 58.0487, std.dev.: 0.0175) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.88% (2.9384 => 2.7950, std.dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: -4.80% (22.1758 => 21.1117, std.dev.: 0.0098) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.62% (1.1194 => 1.0677, std.dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -52.88% (8.0499 => 3.7930, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7637, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -28.80% (10.7105 => 7.6262, std.dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.64% (2.9695 => 2.4754, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4242, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.66% (1.2258 => 1.0706, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -10.62% (1.5373 => 1.3740, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.69% (19.9488 => 18.2156, std.dev.: 0.3537) MultiSource/Benchmarks/FreeBench/mason/mason: -8.01% (0.2161 => 0.1988) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.04% (1.8329 => 1.7038, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5757, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -5.45% (6.6465 => 6.2841, std.dev.: 0.0206) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.93% (1.6805 => 1.5976, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.64% (1.5835 => 1.5100, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.23% (8.1563 => 7.8112, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout/lists: -4.20% (6.2999 => 6.0355, std.dev.: 0.0952) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169, std.dev.: 0.0021) MultiSource/Applications/siod/siod: -3.67% (3.2827 => 3.1623, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -3.33% (5.0483 => 4.8803, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5041, std.dev.: 0.0043) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4206, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: -1.38% (4.6441 => 4.5802, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -5.25% (0.1485 => 0.1407, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0014) Report Time: 2.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 20:31:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 22:31:01 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121026033101.9FC512A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5230?compare_to=5224&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5230, Order: 166735, Start Time: 2012-10-26 00:15:57, End Time: 2012-10-26 03:30:56 To: 5224, Order: 166710, Start Time: 2012-10-25 20:11:15, End Time: 2012-10-25 23:27:51 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 1 (1 on baseline) Performance Regressions: 13 (171 on baseline) Performance Improvements: 1 (19 on baseline) Removed Tests: 2 (2 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1025 (715 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/ClamAV/clamscan: -4.81% (0.3053 => 0.2906, std.dev.: 0.0007) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/instance-method-metadata: 3.10% (0.3940 => 0.4062, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 3.02% (0.3908 => 0.4026, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.70% (0.3933 => 0.4039, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 2.70% (0.3896 => 0.4001, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 2.68% (0.3917 => 0.4022, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 2.66% (0.3916 => 0.4020, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 2.65% (0.4187 => 0.4298, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.64% (4.8435 => 4.9715, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/trivial-interface: 2.60% (0.3890 => 0.3991, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 2.53% (0.3954 => 0.4054, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 2.50% (0.4113 => 0.4216, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.11% (4.1546 => 4.2009, std.dev.: 0.0055) MultiSource/Applications/JM/lencod/lencod: 1.02% (5.1938 => 5.2469, std.dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.10% (2.3158 => 2.2904, std.dev.: 0.0078) Removed Tests - Compile Time ---------------------------- MultiSource/Benchmarks/VersaBench/8b10b/8b10b Removed Tests - Execution Time ------------------------------ MultiSource/Benchmarks/VersaBench/8b10b/8b10b ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/ClamAV/clamscan: 3.71% (0.2802 => 0.2906, std.dev.: 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.76% (0.0625 => 0.0886, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.64% (0.1063 => 0.1410, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.37% (0.2969 => 0.3752, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.59% (0.1106 => 0.1389, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.20% (0.4139 => 0.5182, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 25.06% (1.5932 => 1.9925, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.73% (0.4994 => 0.6229, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 24.31% (0.0547 => 0.0680, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.10% (0.5900 => 0.7322, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.95% (0.0714 => 0.0885, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.62% (0.5000 => 0.6181, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.28% (0.4253 => 0.5243, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.21% (0.1620 => 0.1996, std.dev.: 0.0025) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.12% (0.0584 => 0.0719, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.62% (0.1021 => 0.1252, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.40% (0.1107 => 0.1355, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 22.20% (0.0599 => 0.0732, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.19% (0.0897 => 0.1096, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.64% (0.0633 => 0.0770, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 21.52% (0.0948 => 0.1152, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.40% (0.0584 => 0.0709, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 21.36% (0.0604 => 0.0733, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.34% (0.0642 => 0.0779, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.21% (0.1103 => 0.1337, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.07% (0.0541 => 0.0655, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 21.07% (0.0821 => 0.0994, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.01% (0.0495 => 0.0599, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 20.82% (0.1619 => 0.1956, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.80% (0.0822 => 0.0993, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.64% (0.1003 => 0.1210, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.59% (0.1549 => 0.1868, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.57% (0.3903 => 0.4706, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.51% (0.1604 => 0.1933, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 19.43% (0.0947 => 0.1131, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.29% (0.1462 => 0.1744, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.22% (0.2014 => 0.2401, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: 19.21% (0.1218 => 0.1452, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 19.16% (0.4029 => 0.4801, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 18.81% (0.5826 => 0.6922, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.74% (0.3890 => 0.4619, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.69% (1.3152 => 1.5610, std.dev.: 0.0051) MultiSource/Applications/sgefa/sgefa: 18.69% (0.0808 => 0.0959, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 18.61% (0.5889 => 0.6985, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 18.48% (0.0698 => 0.0827, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 18.47% (0.1505 => 0.1783, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 18.06% (4.2109 => 4.9715, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.01% (0.1088 => 0.1284, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.01% (0.0572 => 0.0675, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.97% (0.2866 => 0.3381, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.95% (0.2736 => 0.3227, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.91% (3.5627 => 4.2009, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.45% (0.0573 => 0.0673, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 17.45% (1.8794 => 2.2073, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: 17.44% (0.5546 => 0.6513, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.41% (0.1160 => 0.1362, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.07% (0.1968 => 0.2304, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.02% (0.4658 => 0.5451, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.00% (1.6211 => 1.8967, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.90% (2.7292 => 3.1904, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.87% (0.2875 => 0.3360, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 16.75% (0.1421 => 0.1659, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.72% (0.4361 => 0.5090, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 16.71% (0.9697 => 1.1317, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.69% (0.3271 => 0.3817, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.53% (0.5026 => 0.5857, std.dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference: 16.47% (0.7171 => 0.8352, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/instance-method-metadata: 16.46% (0.3488 => 0.4062, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 16.40% (0.2725 => 0.3172, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 16.40% (0.2750 => 0.3201, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 16.36% (0.3460 => 0.4026, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 16.21% (0.2714 => 0.3154, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.18% (0.2738 => 0.3181, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 16.11% (0.3004 => 0.3488, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 16.11% (0.3446 => 0.4001, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 16.04% (0.2780 => 0.3226) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.03% (0.3930 => 0.4560, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 16.02% (0.3465 => 0.4020, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 16.01% (1.0781 => 1.2507, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.98% (0.2729 => 0.3165, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 15.97% (0.1284 => 0.1489, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.96% (1.9694 => 2.2838, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/for-in: 15.96% (0.3496 => 0.4054, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 15.95% (0.3442 => 0.3991, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 15.95% (0.2803 => 0.3250, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/synchronized: 15.94% (0.3469 => 0.4022, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 15.91% (0.9909 => 1.1486, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.89% (1.9966 => 2.3139, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/wc: 15.86% (0.3096 => 0.3587, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.86% (4.4195 => 5.1203, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/except: 15.83% (0.2811 => 0.3256, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.80% (0.2792 => 0.3233, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 15.75% (0.2813 => 0.3256, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 15.73% (0.2823 => 0.3267, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.71% (0.3195 => 0.3697, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 15.71% (23.5202 => 27.2142, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.63% (0.2911 => 0.3366, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.62% (2.0673 => 2.3902, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/property: 15.51% (0.3650 => 0.4216, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 15.46% (0.3267 => 0.3772, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 15.41% (0.3724 => 0.4298, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 15.32% (0.3643 => 0.4201, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 15.29% (0.3258 => 0.3756, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 15.01% (0.3317 => 0.3815, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.90% (0.3362 => 0.3863, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.87% (0.3060 => 0.3515, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.86% (0.1090 => 0.1252, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.79% (0.3124 => 0.3586, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 14.63% (0.3678 => 0.4216, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 14.61% (0.3348 => 0.3837, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 14.42% (0.4146 => 0.4744, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 14.41% (1.4269 => 1.6325, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.23% (0.3282 => 0.3749, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 14.22% (0.2566 => 0.2931, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: 14.12% (0.3726 => 0.4252, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 14.07% (0.2075 => 0.2367, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.07% (0.3845 => 0.4386, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 14.06% (0.3477 => 0.3966, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.04% (0.3625 => 0.4134, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 13.87% (2.1653 => 2.4657, std.dev.: 0.0089) MultiSource/Applications/treecc/treecc: 13.84% (0.7875 => 0.8965, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.84% (0.3981 => 0.4532, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 13.83% (0.4251 => 0.4839, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.77% (0.3690 => 0.4198, std.dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 13.63% (4.6177 => 5.2469, std.dev.: 0.0061) MultiSource/Benchmarks/mafft/pairlocalalign: 13.35% (2.1013 => 2.3818, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/bigfib: 12.95% (0.5012 => 0.5661, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.30% (0.2040 => 0.2291, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 12.13% (5.5417 => 6.2141, std.dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: 12.11% (0.2691 => 0.3017, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.79% (0.1383 => 0.1546, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.69% (0.6435 => 0.7187, std.dev.: 0.0051) MultiSource/Applications/siod/siod: 11.26% (0.6634 => 0.7381, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.19% (0.1028 => 0.1143, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.98% (0.2068 => 0.2295, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.96% (0.2737 => 0.3037, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 10.83% (0.3498 => 0.3877, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 10.34% (0.4847 => 0.5348, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.25% (0.3084 => 0.3400, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 10.16% (0.3336 => 0.3675, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.46% (0.2103 => 0.2302, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 9.23% (2.0346 => 2.2223, std.dev.: 0.0031) MultiSource/Applications/lemon/lemon: 8.87% (0.2391 => 0.2603, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.80% (4.6926 => 5.1056, std.dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.36% (11.6398 => 12.6129, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.32% (0.5361 => 0.5807, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.72% (0.5584 => 0.6015, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.45% (0.7426 => 0.7979, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 6.68% (11.9555 => 12.7536, std.dev.: 0.0132) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.51% (0.3792 => 0.4039, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.37% (0.2162 => 0.3532, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6537, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6113, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.42% (0.2122 => 0.2237, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 5.01% (12.0509 => 12.6550, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.77% (0.3693 => 0.3869, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 4.67% (15.4430 => 16.1639, std.dev.: 0.0265) SingleSource/Benchmarks/Misc/flops-2: 4.03% (1.8057 => 1.8784, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: 2.75% (14.0481 => 14.4346, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1914, std.dev.: 0.0073) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.57% (3.1722 => 3.2220, std.dev.: 0.0015) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3121, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2880, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.26% (1.0142 => 1.0270, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1063, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5148, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.08% (1.2451 => 1.2585, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.08% (50.0626 => 50.6009, std.dev.: 0.0300) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.54% (25.4195 => 16.3847, std.dev.: 0.0259) SingleSource/Benchmarks/Shootout-C++/ary2: -9.03% (0.2402 => 0.2185, std.dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9778, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7748, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/tsp/tsp: -7.22% (2.1113 => 1.9588, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.37% (11.2080 => 10.8303, std.dev.: 0.0464) MultiSource/Applications/siod/siod: -2.98% (6.9842 => 6.7761, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.96% (0.6293 => 0.6107, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/mandel-2: -2.90% (3.6262 => 3.5211, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -2.34% (17.2379 => 16.8350, std.dev.: 0.0329) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.20% (41.7953 => 40.8753, std.dev.: 0.0119) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5713, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/bh/bh: -1.55% (5.5810 => 5.4944, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.11% (105.3826 => 104.2120, std.dev.: 0.0653) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.05% (3.3991 => 3.3633, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.05% (21.9346 => 21.7044, std.dev.: 0.0846) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.03% (16.2163 => 16.0491, std.dev.: 0.0020) Removed Tests - Compile Time ---------------------------- MultiSource/Benchmarks/VersaBench/8b10b/8b10b Removed Tests - Execution Time ------------------------------ MultiSource/Benchmarks/VersaBench/8b10b/8b10b Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 20:49:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 22:49:23 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121026034923.747422A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5231?compare_to=5227&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5231, Order: 166747, Start Time: 2012-10-26 02:24:27, End Time: 2012-10-26 03:49:19 To: 5227, Order: 166742, Start Time: 2012-10-26 00:43:43, End Time: 2012-10-26 02:07:43 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 22 (67 on baseline) Performance Improvements: 2 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 951 (903 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 16.70% (0.4508 => 0.5261, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.30% (0.5955 => 0.6509, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.23% (0.3286 => 0.3425, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.98% (0.6364 => 0.6617, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.84% (0.7640 => 0.7933, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.72% (0.3013 => 0.3125, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.35% (0.5968 => 0.6168, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.23% (1.2552 => 1.2958, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.07% (0.9433 => 0.9723, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.97% (1.3217 => 1.3609, std.dev.: 0.0105) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.40% (4.5178 => 4.6262, std.dev.: 0.0179) MultiSource/Benchmarks/Prolangs-C/football/football: 2.30% (0.8702 => 0.8902, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.11% (8.7482 => 8.9331, std.dev.: 0.0238) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.01% (1.1968 => 1.2209, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.98% (0.8855 => 0.9030, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/gs/gs: 1.94% (4.2066 => 4.2884, std.dev.: 0.0217) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.94% (4.5851 => 4.6739, std.dev.: 0.0230) MultiSource/Applications/treecc/treecc: 1.50% (2.0296 => 2.0600, std.dev.: 0.0113) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.31% (1.1238 => 1.1385, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 2.85% (2.4351 => 2.5046, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-5: 1.39% (2.8603 => 2.9002, std.dev.: 0.0048) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.15% (1.2236 => 1.2377, std.dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: -5.72% (0.8042 => 0.7582, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.86% (3.9086 => 3.7188, std.dev.: 0.0731) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.26% (16.6309 => 16.5870, std.dev.: 0.2519) MultiSource/Applications/obsequi/Obsequi: -1.68% (1.0589 => 1.0411, std.dev.: 0.0206) MultiSource/Applications/sqlite3/sqlite3: 0.03% (0.6430 => 0.6432, std.dev.: 0.0066) MultiSource/Benchmarks/McCat/08-main/main: -4.20% (0.1978 => 0.1895, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.80% (0.1569 => 0.1660, std.dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.61% (0.3253 => 0.3273, std.dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.31% (0.2512 => 0.2479, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.24% (0.3369 => 0.3361, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.78% (0.2337 => 0.2402, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: -0.28% (0.6060 => 0.6043, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel: -1.51% (0.0463 => 0.0456, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.03% (0.3343 => 0.3344, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: -0.69% (0.2016 => 0.2002, std.dev.: 0.0017) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -20.40% (0.0250 => 0.0199, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0217 => 0.0217, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0425 => 0.0425, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.60% (0.0331 => 0.0329, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.32% (0.0311 => 0.0312, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.24% (0.0422 => 0.0421, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 1.51% (0.0199 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -0.92% (0.0218 => 0.0216, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: 0.88% (0.0340 => 0.0343, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.54% (0.1481 => 0.1473, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.47% (1.1379 => 1.1546, std.dev.: 0.0144) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: - (0.1521 => 0.1521, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.66% (0.4016 => 0.4163, std.dev.: 0.0171) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.38% (0.1373 => 0.1354, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.19% (0.0638 => 0.0624, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -28.88% (0.0277 => 0.0197, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.36% (0.0554 => 0.0552, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.04% (1.1444 => 1.1439, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 63.16% (0.0019 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.16% (0.0628 => 0.0629, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 15.09% (0.0232 => 0.0267, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.08% (0.8041 => 0.7954, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -51.22% (0.0082 => 0.0040, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.90% (2.1832 => 1.6614, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.30% (0.0810 => 0.0942, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 10.25% (0.1112 => 0.1226, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.54% (0.4847 => 0.5261, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.30% (0.6010 => 0.6509, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.43% (0.2180 => 0.2342, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.20% (0.2279 => 0.2443, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.31% (0.8148 => 0.8662, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.16% (0.7473 => 0.7933, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.98% (0.1905 => 0.2019, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.25% (0.6287 => 0.6617, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.20% (1.1606 => 1.2209, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.77% (0.2998 => 0.3141, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.06% (0.3003 => 0.3125, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.01% (0.2519 => 0.2620, std.dev.: 0.0034) MultiSource/Applications/Burg/burg: 3.99% (1.2222 => 1.2710, std.dev.: 0.0130) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.87% (0.3717 => 0.3861, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.83% (0.8697 => 0.9030, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/gs/gs: 3.82% (4.1305 => 4.2884, std.dev.: 0.0217) MultiSource/Applications/spiff/spiff: 3.52% (0.7950 => 0.8230, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.50% (0.8317 => 0.8608, std.dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.49% (0.4783 => 0.4950, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.47% (0.5961 => 0.6168, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.30% (8.6476 => 8.9331, std.dev.: 0.0238) MultiSource/Applications/treecc/treecc: 3.27% (1.9948 => 2.0600, std.dev.: 0.0113) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.08% (4.4880 => 4.6262, std.dev.: 0.0179) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.05% (0.9435 => 0.9723, std.dev.: 0.0104) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.83% (6.6074 => 6.7942, std.dev.: 0.0411) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.82% (1.2602 => 1.2958, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.62% (4.1763 => 4.2857, std.dev.: 0.0290) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.59% (0.9069 => 0.9304, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.55% (0.9908 => 1.0161, std.dev.: 0.0044) MultiSource/Benchmarks/nbench/nbench: 2.53% (1.1271 => 1.1556, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.49% (1.3279 => 1.3609, std.dev.: 0.0105) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.27% (4.5702 => 4.6739, std.dev.: 0.0230) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.27% (4.4873 => 4.5891, std.dev.: 0.0369) MultiSource/Applications/minisat/minisat: 2.19% (0.6834 => 0.6984, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.16% (0.9074 => 0.9270, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.08% (0.8457 => 0.8633, std.dev.: 0.0030) MultiSource/Applications/JM/ldecod/ldecod: 2.07% (6.7320 => 6.8714, std.dev.: 0.0362) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.04% (0.8331 => 0.8501, std.dev.: 0.0039) MultiSource/Applications/SPASS/SPASS: 1.94% (14.2605 => 14.5375, std.dev.: 0.0549) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.92% (1.1170 => 1.1385, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.87% (0.6586 => 0.6709, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.84% (0.7932 => 0.8078, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.81% (0.8656 => 0.8813, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.77% (13.1811 => 13.4147, std.dev.: 0.0641) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.64% (0.8359 => 0.8496, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.54% (0.8611 => 0.8744, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/football/football: 1.53% (0.8768 => 0.8902, std.dev.: 0.0021) MultiSource/Applications/d/make_dparser: 1.51% (3.2366 => 3.2854, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.35% (0.8048 => 0.8157, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.34% (0.8716 => 0.8833, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.25% (0.8885 => 0.8996, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.22% (0.8995 => 0.9105, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.18% (1.2423 => 1.2570, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.57% (1.5795 => 2.5046, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.67% (0.3186 => 0.3494, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.56% (1.1857 => 1.2872, std.dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 5.94% (63.1822 => 66.9340, std.dev.: 0.2490) MultiSource/Benchmarks/FreeBench/distray/distray: 4.18% (0.2390 => 0.2490, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.91% (2.2485 => 2.3364, std.dev.: 0.0292) SingleSource/Benchmarks/Misc/ReedSolomon: 3.45% (8.5322 => 8.8269, std.dev.: 0.0342) SingleSource/Benchmarks/Dhrystone/dry: 3.21% (0.5081 => 0.5244, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 3.18% (44.5605 => 45.9781, std.dev.: 0.0320) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.73% (59.2638 => 60.8804, std.dev.: 0.0742) MultiSource/Applications/siod/siod: 2.72% (3.6643 => 3.7639, std.dev.: 0.0190) MultiSource/Benchmarks/Olden/bh/bh: 1.69% (2.3560 => 2.3957, std.dev.: 0.0129) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: -5.10% (3.9188 => 3.7188, std.dev.: 0.0731) MultiSource/Applications/lua/lua: -5.08% (29.8330 => 28.3185, std.dev.: 0.2495) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.14% (1.0388 => 1.0166, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.47% (3.3479 => 3.2988, std.dev.: 0.0097) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.86% (16.4461 => 16.5870, std.dev.: 0.2519) MultiSource/Applications/obsequi/Obsequi: 1.45% (1.0262 => 1.0411, std.dev.: 0.0206) MultiSource/Applications/sqlite3/sqlite3: 1.58% (0.6332 => 0.6432, std.dev.: 0.0066) MultiSource/Benchmarks/McCat/08-main/main: 3.50% (0.1831 => 0.1895, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 6.48% (0.1559 => 0.1660, std.dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.80% (0.3123 => 0.3273, std.dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.65% (0.2463 => 0.2479, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.51% (0.3344 => 0.3361, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.61% (0.2364 => 0.2402, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 0.55% (0.6010 => 0.6043, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel: 6.29% (0.0429 => 0.0456, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.39% (0.3266 => 0.3344, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: 1.68% (0.1969 => 0.2002, std.dev.: 0.0017) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -11.16% (0.0224 => 0.0199, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 76.42% (0.0123 => 0.0217, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.17% (0.0408 => 0.0425, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.53% (0.0254 => 0.0329, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.64% (0.0384 => 0.0421, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 20.00% (0.0180 => 0.0216, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: 49.13% (0.0230 => 0.0343, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.43% (0.1438 => 0.1473, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.92% (1.1329 => 1.1546, std.dev.: 0.0144) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 4.04% (0.1462 => 0.1521, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.02% (0.4164 => 0.4163, std.dev.: 0.0171) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.10% (0.1369 => 0.1354, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.65% (0.0641 => 0.0624, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.03% (0.0195 => 0.0197, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.50% (0.0578 => 0.0552, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.02% (1.1437 => 1.1439, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.32% (0.0627 => 0.0629, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.33% (0.0180 => 0.0267, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.79% (0.8017 => 0.7954, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -35.48% (0.0062 => 0.0040, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 21:17:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 25 Oct 2012 23:17:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121026041744.0C1772A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5232?compare_to=5228&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5232, Order: 166748, Start Time: 2012-10-26 02:52:37, End Time: 2012-10-26 04:17:38 To: 5228, Order: 166745, Start Time: 2012-10-26 01:04:25, End Time: 2012-10-26 02:29:30 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (184 on baseline) Unchanged Tests: 1042 (854 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1015, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: 2.46% (7.4937 => 7.6777, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/hash2: 2.14% (3.1932 => 3.2616, std.dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.94% (0.1431 => 0.1303) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.90% (0.3821 => 0.3519, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: -7.34% (2.4924 => 2.3094, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -7.18% (0.3357 => 0.3116, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -7.02% (0.3831 => 0.3562, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -7.00% (0.3812 => 0.3545, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -6.98% (0.3880 => 0.3609, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -6.96% (0.3848 => 0.3580, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.95% (0.3884 => 0.3614, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.94% (0.3142 => 0.2924, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -6.92% (0.4033 => 0.3754, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -6.88% (0.3896 => 0.3628, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.86% (0.3891 => 0.3624, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.85% (0.4176 => 0.3890, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: -6.84% (0.9179 => 0.8551, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.83% (22.4056 => 20.8742, std.dev.: 0.0148) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.79% (3.5339 => 3.2941, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.76% (0.9542 => 0.8897, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -6.70% (0.1761 => 0.1643, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/property: -6.69% (0.4199 => 0.3918, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -6.69% (4.3330 => 4.0433, std.dev.: 0.0159) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.67% (0.2428 => 0.2266, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -6.67% (0.2160 => 0.2016, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -6.64% (0.4280 => 0.3996, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.63% (0.1796 => 0.1677, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -6.62% (16.1920 => 15.1197, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.62% (0.3658 => 0.3416, std.dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: -6.61% (9.2283 => 8.6187, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.57% (1.0544 => 0.9851, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.57% (0.1584 => 0.1480, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: -6.54% (1.1530 => 1.0776, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.53% (0.2695 => 0.2519, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.52% (0.9852 => 0.9210, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: -6.51% (1.2515 => 1.1700, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.51% (1.6474 => 1.5402, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.49% (0.6484 => 0.6063, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.47% (0.6736 => 0.6300, std.dev.: 0.0017) MultiSource/Applications/siod/siod: -6.43% (2.4021 => 2.2477, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.42% (1.3722 => 1.2841, std.dev.: 0.0033) MultiSource/Applications/JM/ldecod/ldecod: -6.41% (7.0961 => 6.6413, std.dev.: 0.0069) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.40% (6.7716 => 6.3384, std.dev.: 0.0036) MultiSource/Applications/lemon/lemon: -6.39% (1.1450 => 1.0718, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.38% (2.2587 => 2.1147, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.37% (0.2355 => 0.2205, std.dev.: 0.0010) MultiSource/Applications/lua/lua: -6.35% (4.0594 => 3.8015, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.35% (1.2300 => 1.1519, std.dev.: 0.0058) MultiSource/Applications/minisat/minisat: -6.32% (0.7447 => 0.6976, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.32% (0.2548 => 0.2387, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -6.32% (0.2659 => 0.2491, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.30% (0.7919 => 0.7420, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.29% (0.1716 => 0.1608, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.29% (1.2784 => 1.1980, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.26% (1.6364 => 1.5339, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.23% (4.5069 => 4.2259, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.23% (5.4682 => 5.1277, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.22% (1.4642 => 1.3731) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.18% (4.8161 => 4.5186, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.15% (4.8802 => 4.5803, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/05-eks/eks: -6.14% (0.4515 => 0.4238, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: -6.12% (0.3581 => 0.3362, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.11% (4.0323 => 3.7859, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -6.10% (0.2985 => 0.2803, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -6.08% (0.3406 => 0.3199, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.07% (0.4151 => 0.3899, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.05% (0.3931 => 0.3693, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.05% (0.6681 => 0.6277, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -6.05% (1.3148 => 1.2353, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.04% (0.5478 => 0.5147, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: -6.03% (1.3864 => 1.3028, std.dev.: 0.0035) MultiSource/Benchmarks/Bullet/bullet: -6.02% (34.0927 => 32.0390, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/functionobjects: -6.02% (0.5168 => 0.4857, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.01% (0.6052 => 0.5688, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: -6.00% (0.2999 => 0.2819, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.00% (0.6304 => 0.5926, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.99% (0.5925 => 0.5570, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.98% (14.2083 => 13.3590, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.98% (0.3849 => 0.3619, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -5.97% (15.5079 => 14.5828, std.dev.: 0.0041) MultiSource/Applications/treecc/treecc: -5.95% (2.1401 => 2.0127, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.94% (0.5805 => 0.5460, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.92% (0.6297 => 0.5924, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.91% (0.5705 => 0.5368, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -5.90% (0.4861 => 0.4574, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.90% (0.5591 => 0.5261, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.90% (0.3491 => 0.3285, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.90% (0.4916 => 0.4626, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -5.89% (15.2527 => 14.3541, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.88% (0.6293 => 0.5923, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.86% (0.3837 => 0.3612, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -5.86% (17.1032 => 16.1004, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.86% (0.7339 => 0.6909, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.86% (0.4321 => 0.4068, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.85% (0.5863 => 0.5520, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.85% (0.6667 => 0.6277, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.84% (0.6194 => 0.5832, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.84% (0.6230 => 0.5866, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: -5.83% (18.2933 => 17.2268, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.82% (1.2221 => 1.1510, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/except: -5.82% (0.3026 => 0.2850, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.81% (0.5802 => 0.5465, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.81% (0.3323 => 0.3130, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: -5.80% (0.3481 => 0.3279, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.80% (0.6395 => 0.6024, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.80% (0.3483 => 0.3281, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.79% (0.2903 => 0.2735, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.78% (0.5999 => 0.5652, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.78% (0.3252 => 0.3064, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.78% (0.7198 => 0.6782, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.77% (0.5857 => 0.5519, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.76% (0.3057 => 0.2881, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.76% (0.4083 => 0.3848, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: -5.75% (0.2989 => 0.2817, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.75% (0.5859 => 0.5522, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.75% (0.6260 => 0.5900, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.75% (0.6660 => 0.6277, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.75% (0.2278 => 0.2147, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: -5.75% (0.2871 => 0.2706, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -5.75% (0.3255 => 0.3068, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -5.72% (0.3621 => 0.3414, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.72% (0.7524 => 0.7094, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.71% (0.6446 => 0.6078, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.71% (0.6395 => 0.6030, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.70% (0.5575 => 0.5257, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.70% (0.6440 => 0.6073, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.70% (0.2106 => 0.1986, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.69% (0.8521 => 0.8036, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.69% (0.5941 => 0.5603, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.69% (0.6189 => 0.5837, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: -5.69% (0.3394 => 0.3201, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.68% (1.2210 => 1.1516, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: -5.68% (3.5154 => 3.3159, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.67% (0.5569 => 0.5253, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/bigfib: -5.67% (0.6750 => 0.6367, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.67% (0.4427 => 0.4176, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.66% (0.3319 => 0.3131, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.66% (0.2933 => 0.2767, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.66% (2.1713 => 2.0485, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: -5.65% (0.2939 => 0.2773, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.63% (0.5581 => 0.5267, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -5.62% (0.3025 => 0.2855, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -5.62% (0.2849 => 0.2689, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.60% (8.0126 => 7.5635, std.dev.: 0.0037) SingleSource/Regression/C++/ofstream_ctor: -5.59% (0.3059 => 0.2888, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.59% (0.6676 => 0.6303, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.59% (0.6033 => 0.5696, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.58% (0.7021 => 0.6629, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.57% (0.5688 => 0.5371, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -5.57% (0.3446 => 0.3254, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -5.56% (0.3867 => 0.3652, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -5.56% (0.4248 => 0.4012, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.55% (0.5329 => 0.5033, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.54% (0.5849 => 0.5525, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -5.52% (0.3205 => 0.3028, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.51% (0.9557 => 0.9030, std.dev.: 0.0121) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.51% (0.4813 => 0.4548, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.50% (0.5456 => 0.5156, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: -5.50% (0.6441 => 0.6087, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -5.49% (0.3788 => 0.3580, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/ReedSolomon: -5.48% (0.1879 => 0.1776, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.48% (0.5570 => 0.5265, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.47% (0.3016 => 0.2851, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.46% (0.5567 => 0.5263, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -5.44% (0.7779 => 0.7356, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: -5.42% (0.6347 => 0.6003, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: -5.42% (0.3194 => 0.3021, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -5.38% (0.3271 => 0.3095, std.dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: -5.22% (0.7982 => 0.7565, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: -5.17% (0.4524 => 0.4290, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: -5.00% (0.8418 => 0.7997, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -4.75% (5.0226 => 4.7838, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.74% (0.2385 => 0.2272, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.48% (0.9077 => 0.8670, std.dev.: 0.0026) MultiSource/Applications/hbd/hbd: -4.32% (1.5610 => 1.4936, std.dev.: 0.0020) SingleSource/UnitTests/Vector/constpool: -3.60% (20.7746 => 20.0257, std.dev.: 0.0087) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7551, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1728, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7061, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.79% (2.2633 => 2.1775, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.70% (1.3096 => 1.2873, std.dev.: 0.0072) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4704, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.20% (1.6086 => 1.5893, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0004) Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 22:12:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 00:12:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121026051209.B432C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5233?compare_to=5229&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5233, Order: 166749, Start Time: 2012-10-26 03:49:02, End Time: 2012-10-26 05:12:01 To: 5229, Order: 166745, Start Time: 2012-10-26 01:55:46, End Time: 2012-10-26 03:19:26 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (73 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 5 (198 on baseline) Performance Improvements: 0 (51 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 75 (2 on baseline) Unchanged Tests: 962 (639 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 7.10% (0.3970 => 0.4252, std.dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/flops: 28.56% (6.7546 => 8.6835, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.94% (54.4942 => 56.6421, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout/lists: 3.31% (6.0355 => 6.2350, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.12% (1.0450 => 1.0567, std.dev.: 0.0006) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0488 => 0.0488, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0490 => 0.0490, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.22% (0.0457 => 0.0458, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0459 => 0.0459, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0447 => 0.0447, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.22% (0.0450 => 0.0449) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0441 => 0.0441) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0443 => 0.0443) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0459 => 0.0459, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0460 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0453 => 0.0453, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0455 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0443 => 0.0443, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0445 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.22% (0.0450 => 0.0451) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0452 => 0.0452, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0462 => 0.0462, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.22% (0.0464 => 0.0463, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0439 => 0.0439) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.23% (0.0439 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0451 => 0.0451) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0452 => 0.0452) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0442 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0443 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0435 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0435 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.23% (0.0432 => 0.0433) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.23% (0.0434 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0470 => 0.0470, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0471 => 0.0471, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0432 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0433 => 0.0433, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0433 => 0.0433) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0434 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0441 => 0.0441) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0442 => 0.0442, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/BenchmarkGame/puzzle MultiSource/Applications/oggenc/oggenc: 0.07% (0.1407 => 0.1408, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0649 => 0.0648, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.57% (0.3849 => 0.3827, std.dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.03% (0.6962 => 0.3827, std.dev.: 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 202.56% (0.5229 => 1.5821, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 15.96% (14.9895 => 17.3824, std.dev.: 0.0107) MultiSource/Applications/kimwitu++/kc: 37.57% (14.1553 => 19.4732, std.dev.: 0.0216) MultiSource/Benchmarks/MallocBench/gs/gs: 13.60% (4.1105 => 4.6697, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 35.80% (1.1048 => 1.5003, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 319.10% (7.1582 => 29.9997, std.dev.: 0.0114) SingleSource/Benchmarks/Misc-C++-EH/spirit: 69.14% (3.4629 => 5.8572, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_container: 67.47% (0.6222 => 1.0420, std.dev.: 0.0012) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 11826.67% (0.0720 => 8.5872, std.dev.: 0.0144) MultiSource/Applications/SIBsim4/SIBsim4: 4015100.00% (0.0001 => 4.0152, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 11138500.00% (0.0001 => 11.1386, std.dev.: 0.0701) MultiSource/Applications/kimwitu++/kc: 50700.00% (0.0001 => 0.0508, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 792800.00% (0.0001 => 0.7929, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050100.00% (0.0001 => 10.0502, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5490800.00% (0.0001 => 5.4909, std.dev.: 0.0019) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 69.53% (0.0256 => 0.0434) SingleSource/Regression/C/sumarraymalloc: 56.38% (0.0243 => 0.0380, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 54.24% (0.0271 => 0.0418) SingleSource/Regression/C/sumarray: 44.59% (0.0231 => 0.0334) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 42.07% (1.5859 => 2.2531, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/distray/distray: 40.53% (0.1056 => 0.1484, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 36.96% (10.3673 => 14.1989, std.dev.: 0.0048) SingleSource/UnitTests/vla: 33.80% (0.0355 => 0.0475, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 31.27% (2.2024 => 2.8912, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 28.98% (0.1432 => 0.1847, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/neural/neural: 28.64% (0.1463 => 0.1882, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 24.89% (0.1655 => 0.2067, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 23.38% (0.0834 => 0.1029, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: 22.27% (0.0485 => 0.0593, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.09% (0.1566 => 0.1912, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 20.94% (0.2049 => 0.2478, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.40% (0.0871 => 0.1040, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 19.23% (0.4879 => 0.5817, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 19.04% (0.5105 => 0.6077, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 19.04% (0.1555 => 0.1851, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 18.22% (0.3177 => 0.3756, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.17% (0.6675 => 0.7888, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/n-body: 18.10% (0.0746 => 0.0881) MultiSource/Benchmarks/Olden/tsp/tsp: 17.96% (0.1175 => 0.1386, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.91% (0.0793 => 0.0935, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 17.89% (0.2554 => 0.3011, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 17.81% (0.0730 => 0.0860, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 17.46% (0.1695 => 0.1991, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: 17.41% (0.0626 => 0.0735, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.41% (1.3050 => 1.5322, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.40% (0.1029 => 0.1208) MultiSource/Applications/d/make_dparser: 16.84% (3.3354 => 3.8970, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/mst/mst: 16.77% (0.1163 => 0.1358, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.75% (0.8172 => 0.9541, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.69% (0.2271 => 0.2650, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.47% (0.1032 => 0.1202, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 16.37% (0.7115 => 0.8280, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.21% (1.5415 => 1.7914, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.14% (0.0886 => 0.1029, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.10% (0.5020 => 0.5828, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.03% (0.4615 => 0.5355, std.dev.: 0.0057) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.02% (0.3121 => 0.3621, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 16.01% (0.1337 => 0.1551, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 16.01% (1.1840 => 1.3735, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.96% (0.1510 => 0.1751, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.93% (0.1940 => 0.2249, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.91% (0.0842 => 0.0976, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.85% (0.0675 => 0.0782, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.63% (0.0838 => 0.0969, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 15.60% (0.3109 => 0.3594, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.43% (0.0648 => 0.0748, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/exptree: 15.23% (0.0814 => 0.0938, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 15.16% (1.1642 => 1.3407, std.dev.: 0.0082) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 15.15% (0.1584 => 0.1824, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.13% (0.1117 => 0.1286, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 15.13% (0.1236 => 0.1423, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 15.03% (0.1151 => 0.1324, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.93% (0.0730 => 0.0839, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 14.88% (0.0672 => 0.0772) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.81% (0.0770 => 0.0884, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.80% (4.2646 => 4.8958, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.79% (0.2758 => 0.3166, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.76% (0.9765 => 1.1206, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.72% (0.2065 => 0.2369, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.70% (0.2700 => 0.3097, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 14.69% (0.1906 => 0.2186, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.67% (0.2107 => 0.2416, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 14.61% (0.3423 => 0.3923, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/rem: 14.60% (0.1144 => 0.1311) MultiSource/Applications/spiff/spiff: 14.55% (0.7835 => 0.8975, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.53% (0.5981 => 0.6850, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.44% (0.1143 => 0.1308, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.31% (0.1125 => 0.1286, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.26% (0.6450 => 0.7370, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.16% (0.0798 => 0.0911, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.12% (0.1062 => 0.1212, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.10% (0.1695 => 0.1934, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 14.10% (0.7433 => 0.8481, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.03% (0.0770 => 0.0878, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 14.02% (2.0273 => 2.3116, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.98% (0.5860 => 0.6679, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.72% (0.0933 => 0.1061, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 13.70% (9.4845 => 10.7842, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.70% (8.1363 => 9.2510, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.58% (1.4186 => 1.6112, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 13.52% (0.3180 => 0.3610, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 13.51% (1.0722 => 1.2171, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.42% (0.1625 => 0.1843, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 13.40% (3.8723 => 4.3910, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.37% (0.3307 => 0.3749, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.34% (0.8067 => 0.9143, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 13.25% (0.1268 => 0.1436, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.18% (0.5569 => 0.6303, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.13% (0.0929 => 0.1051, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.10% (0.2603 => 0.2944, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 13.00% (0.4299 => 0.4858, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.85% (0.3441 => 0.3883, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 12.73% (0.8921 => 1.0057, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.64% (4.9449 => 5.5697, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.59% (5.0018 => 5.6315, std.dev.: 0.0100) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.48% (0.1330 => 0.1496, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.28% (1.1861 => 1.3318, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 12.19% (0.3387 => 0.3800, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 12.16% (0.3092 => 0.3468, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.62% (0.8101 => 0.9042, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: 11.48% (0.3927 => 0.4378, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.34% (0.3473 => 0.3867, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 11.33% (2.2969 => 2.5572, std.dev.: 0.0145) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 11.33% (0.0953 => 0.1061, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.32% (0.3543 => 0.3944, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 11.31% (0.6456 => 0.7186, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.21% (0.3828 => 0.4257, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.21% (0.3543 => 0.3940, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.20% (0.3561 => 0.3960, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.15% (0.3497 => 0.3887, std.dev.: 0.0063) SingleSource/UnitTests/ObjC/for-in: 11.10% (0.3694 => 0.4104, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.06% (0.3516 => 0.3905, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 11.05% (0.4289 => 0.4763, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 10.89% (0.4620 => 0.5123, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.82% (0.1044 => 0.1157, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 10.78% (5.7591 => 6.3802, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/property: 10.78% (0.3886 => 0.4305, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.52% (0.1892 => 0.2091, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.44% (2.2022 => 2.4320, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.40% (0.3865 => 0.4267, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists: 10.29% (0.3422 => 0.3774, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.23% (0.4203 => 0.4633, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.92% (0.4103 => 0.4510, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 9.85% (0.3684 => 0.4047, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.72% (0.3427 => 0.3760, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.71% (0.4636 => 0.5086, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 9.64% (21.9371 => 24.0529, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.64% (0.3826 => 0.4195, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 9.62% (1.5603 => 1.7104, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/moments: 9.51% (0.4048 => 0.4433, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.47% (0.2430 => 0.2660, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 9.19% (0.3603 => 0.3934, std.dev.: 0.0092) MultiSource/Applications/sqlite3/sqlite3: 8.92% (17.1811 => 18.7139, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference-object: 8.86% (0.6030 => 0.6564, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.81% (0.5925 => 0.6447, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 8.59% (0.3098 => 0.3364, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.44% (0.4064 => 0.4407, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.33% (3.8922 => 4.2166, std.dev.: 0.0150) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.32% (14.3668 => 15.5628, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.16% (0.3650 => 0.3948, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.11% (0.7326 => 0.7920, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/strcat: 7.98% (0.2831 => 0.3057, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.87% (0.2872 => 0.3098, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.81% (0.3162 => 0.3409, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 7.80% (0.2871 => 0.3095, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.78% (0.2891 => 0.3116, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.77% (0.3232 => 0.3483, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.74% (0.3283 => 0.3537, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.64% (0.2905 => 0.3127, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.53% (2.0665 => 2.2222, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.44% (0.2756 => 0.2961, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.34% (0.2793 => 0.2998, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 7.30% (0.2877 => 0.3087, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/fibo: 7.27% (0.2725 => 0.2923, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 7.21% (10.4361 => 11.1889, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/hello: 7.11% (0.2714 => 0.2907, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 7.11% (0.3052 => 0.3269, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 7.07% (0.3282 => 0.3514, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 7.04% (1.2842 => 1.3746, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/random: 6.96% (0.2802 => 0.2997, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary2: 6.75% (0.3379 => 0.3607, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.71% (0.2266 => 0.2418, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.22% (0.3136 => 0.3331, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.82% (7.9617 => 8.4254, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: 5.37% (0.3131 => 0.3299, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.86% (0.3935 => 0.4087, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.67% (7.0540 => 7.3131, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.56% (0.3817 => 0.3953, std.dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0153) SingleSource/Benchmarks/Misc/salsa20: 31.43% (10.2830 => 13.5153, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1725, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 14.08% (2.6778 => 3.0548, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.57% (0.9957 => 1.1308, std.dev.: 0.0155) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.79% (1.1396 => 1.2512, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.64% (2.8904 => 3.0824, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.62% (3.1578 => 3.3668, std.dev.: 0.0013) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 3.80% (1.9405 => 2.0143, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.21% (0.3987 => 0.4115, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.66% (4.2280 => 4.3405, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0313 => 1.0567, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bisort/bisort: 1.76% (0.8333 => 0.8480, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2076, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.49% (11.6436 => 11.8176, std.dev.: 0.0213) MultiSource/Applications/viterbi/viterbi: 1.23% (4.4649 => 4.5196, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.22% (2.6546 => 2.6869, std.dev.: 0.0022) MultiSource/Applications/minisat/minisat: 1.12% (9.1159 => 9.2184, std.dev.: 0.0235) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.07% (6.5088 => 6.5786, std.dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.94% (6.6874 => 0.1379, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -82.51% (0.8651 => 0.1513, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -52.54% (5.2763 => 2.5041, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/richards_benchmark: -45.44% (0.1622 => 0.0885, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -41.13% (5.3855 => 3.1707, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.58% (5.3526 => 3.1804, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -8.94% (54.1659 => 49.3211, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.29% (1.7609 => 1.6149, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -8.24% (63.2438 => 58.0302, std.dev.: 0.0152) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.88% (2.9384 => 2.7950, std.dev.: 0.0030) MultiSource/Applications/ClamAV/clamscan: -4.76% (22.1758 => 21.1210, std.dev.: 0.0216) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.71% (1.1194 => 1.0667, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -52.86% (8.0499 => 3.7950, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.42% (1.1492 => 0.7651, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -28.74% (10.7105 => 7.6325, std.dev.: 0.0193) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4752, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4246, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.53% (0.0998 => 0.0853, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.71% (1.2258 => 1.0700, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -11.77% (1.2373 => 1.0917, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: -11.03% (1.5373 => 1.3678, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.40% (19.9488 => 18.2735, std.dev.: 0.0094) MultiSource/Benchmarks/FreeBench/mason/mason: -8.01% (0.2161 => 0.1988, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.97% (1.8329 => 1.7051, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5758, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0152) SingleSource/Benchmarks/Misc/oourafft: -5.46% (6.6465 => 6.2839, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.94% (1.6805 => 1.5975, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5072, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.18% (8.1563 => 7.8151, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.63% (3.2827 => 3.1634, std.dev.: 0.0021) MultiSource/Benchmarks/sim/sim: -3.33% (5.0483 => 4.8804, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4970, std.dev.: 0.0055) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.75% (0.4808 => 0.4676, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5093, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6835, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.64% (1.1277 => 1.1092) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4205, std.dev.: 0.0086) MultiSource/Applications/sqlite3/sqlite3: -1.38% (4.6441 => 4.5799, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8561, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2350, std.dev.: 0.0054) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -5.19% (0.1485 => 0.1408, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0007) Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 22:30:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 00:30:14 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121026053014.824E62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5234?compare_to=5231&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5234, Order: 166749, Start Time: 2012-10-26 04:05:57, End Time: 2012-10-26 05:30:11 To: 5231, Order: 166747, Start Time: 2012-10-26 02:24:27, End Time: 2012-10-26 03:49:19 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 8 (69 on baseline) Performance Improvements: 5 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 962 (901 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.77% (0.8678 => 0.9005, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.84% (0.9124 => 0.9292, std.dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 1.32% (4.9973 => 5.0635, std.dev.: 0.0177) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.10% (1.2653 => 1.2792, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.51% (0.7582 => 0.7924, std.dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.91% (1.0166 => 1.0462, std.dev.: 0.0105) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.07% (22.2072 => 22.6678, std.dev.: 0.0662) SingleSource/Benchmarks/Shootout-C++/methcall: 1.23% (8.9327 => 9.0428, std.dev.: 0.0074) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -1.96% (1.2958 => 1.2704, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.61% (0.8608 => 0.8469, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/gs/gs: -1.04% (4.2884 => 4.2437, std.dev.: 0.0156) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.89% (60.8804 => 59.7296, std.dev.: 0.2389) MultiSource/Benchmarks/llubenchmark/llu: -1.09% (2.0218 => 1.9997, std.dev.: 0.0070) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.18% (16.5870 => 16.6165, std.dev.: 0.1794) MultiSource/Applications/obsequi/Obsequi: 1.98% (1.0411 => 1.0617, std.dev.: 0.0090) MultiSource/Applications/sqlite3/sqlite3: 0.76% (0.6432 => 0.6481, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/08-main/main: -1.11% (0.1895 => 0.1874, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.24% (0.1660 => 0.1664, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.86% (0.3273 => 0.3245, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.48% (0.2479 => 0.2491, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.03% (0.3361 => 0.3362, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.17% (0.2402 => 0.2406, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: -0.48% (0.6043 => 0.6014, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/mandel: 5.04% (0.0456 => 0.0479, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.45% (0.3344 => 0.3359, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 1.70% (0.2002 => 0.2036, std.dev.: 0.0012) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 28.14% (0.0199 => 0.0255, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0217 => 0.0217, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0425 => 0.0425, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.30% (0.0329 => 0.0328, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0312 => 0.0312, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.71% (0.0421 => 0.0424, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0202 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0216 => 0.0216, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -1.46% (0.0343 => 0.0338, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.41% (0.1473 => 0.1479, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.33% (1.1546 => 1.1393, std.dev.: 0.0394) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -0.20% (0.1521 => 0.1518, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.67% (0.4163 => 0.4052, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.55% (0.1354 => 0.1306, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.76% (0.0624 => 0.0613, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 40.61% (0.0197 => 0.0277, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.99% (0.0552 => 0.0541, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.12% (1.1439 => 1.1453, std.dev.: 0.0188) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.32% (0.0629 => 0.0631, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0267 => 0.0267, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.78% (0.7954 => 0.8016, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 50.00% (0.0040 => 0.0060, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.09% (2.1832 => 1.6573, std.dev.: 0.0041) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.17% (0.0810 => 0.0941, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 12.14% (0.1112 => 0.1247, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.22% (0.8321 => 0.9005, std.dev.: 0.0085) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.07% (0.2180 => 0.2356, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.59% (0.4847 => 0.5215, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.98% (0.2279 => 0.2438, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.92% (0.6010 => 0.6426, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.38% (0.2240 => 0.2383, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.01% (0.7473 => 0.7922, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.46% (0.1905 => 0.2009, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.39% (0.8148 => 0.8587, std.dev.: 0.0076) MultiSource/Applications/spiff/spiff: 5.35% (0.7950 => 0.8375, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.63% (0.3003 => 0.3142, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.61% (0.9435 => 0.9870, std.dev.: 0.0098) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.36% (1.1606 => 1.2112, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.36% (0.6287 => 0.6561, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.85% (0.3717 => 0.3860, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.83% (1.1685 => 1.2132, std.dev.: 0.0086) MultiSource/Applications/hbd/hbd: 3.77% (1.4269 => 1.4807, std.dev.: 0.0123) MultiSource/Applications/Burg/burg: 3.55% (1.2222 => 1.2656, std.dev.: 0.0130) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.39% (0.4783 => 0.4945, std.dev.: 0.0044) MultiSource/Applications/treecc/treecc: 3.34% (1.9948 => 2.0615, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.80% (0.9039 => 0.9292, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 2.74% (4.1305 => 4.2437, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.69% (0.7966 => 0.8180, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.63% (0.5817 => 0.5970, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.60% (13.1811 => 13.5235, std.dev.: 0.0496) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.55% (6.6074 => 6.7762, std.dev.: 0.0348) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.54% (0.4127 => 0.4232, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.52% (4.1763 => 4.2814, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.51% (0.8007 => 0.8208, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.45% (0.9069 => 0.9291, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.39% (0.8457 => 0.8659, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.28% (4.4873 => 4.5897, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.24% (8.6476 => 8.8411, std.dev.: 0.0547) MultiSource/Applications/ClamAV/clamscan: 2.23% (14.7684 => 15.0984, std.dev.: 0.1119) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.21% (0.5961 => 0.6093, std.dev.: 0.0047) MultiSource/Applications/siod/siod: 2.17% (2.2184 => 2.2666, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.13% (4.4880 => 4.5837, std.dev.: 0.0175) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.12% (1.2526 => 1.2792, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.04% (0.8855 => 0.9036, std.dev.: 0.0069) MultiSource/Applications/oggenc/oggenc: 2.03% (4.9628 => 5.0635, std.dev.: 0.0177) MultiSource/Applications/d/make_dparser: 1.99% (3.2366 => 3.3009, std.dev.: 0.0236) MultiSource/Applications/SIBsim4/SIBsim4: 1.98% (1.2568 => 1.2817, std.dev.: 0.0053) MultiSource/Benchmarks/Bullet/bullet: 1.88% (31.8598 => 32.4591, std.dev.: 0.1487) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.85% (0.8261 => 0.8414, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.83% (0.8317 => 0.8469, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.77% (4.5702 => 4.6513, std.dev.: 0.0255) MultiSource/Applications/SPASS/SPASS: 1.74% (14.2605 => 14.5093, std.dev.: 0.0869) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.71% (0.9074 => 0.9229, std.dev.: 0.0052) MultiSource/Benchmarks/nbench/nbench: 1.67% (1.1271 => 1.1459, std.dev.: 0.0069) MultiSource/Applications/JM/lencod/lencod: 1.61% (15.3280 => 15.5751, std.dev.: 0.0861) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.59% (0.8177 => 0.8307, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.58% (0.6943 => 0.7053, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 1.50% (8.6247 => 8.7538, std.dev.: 0.0337) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.37% (1.1170 => 1.1323, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.37% (0.8338 => 0.8452, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.04% (14.6451 => 16.1160, std.dev.: 0.4359) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.49% (1.1857 => 1.2864, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.38% (0.3186 => 0.3453, std.dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: 5.93% (63.1822 => 66.9316, std.dev.: 0.2440) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.30% (0.7597 => 0.7924, std.dev.: 0.0078) SingleSource/Benchmarks/Dhrystone/dry: 3.76% (0.5081 => 0.5272, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/ReedSolomon: 3.45% (8.5322 => 8.8268, std.dev.: 0.0142) MultiSource/Applications/siod/siod: 2.78% (3.6643 => 3.7661, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.65% (22.2997 => 22.6678, std.dev.: 0.0662) MultiSource/Benchmarks/Olden/bh/bh: 1.65% (2.3560 => 2.3948, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/richards_benchmark: 1.11% (1.3037 => 1.3182, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.09% (9.9065 => 10.0142, std.dev.: 0.0124) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -5.29% (29.8330 => 28.2541, std.dev.: 0.2252) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -1.59% (7.2130 => 7.0983, std.dev.: 0.0276) SingleSource/Benchmarks/Shootout-C++/hash2: -1.41% (3.4237 => 3.3755, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.33% (3.3479 => 3.3033, std.dev.: 0.0037) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 1.04% (16.4461 => 16.6165, std.dev.: 0.1794) MultiSource/Applications/obsequi/Obsequi: 3.46% (1.0262 => 1.0617, std.dev.: 0.0090) MultiSource/Applications/sqlite3/sqlite3: 2.35% (0.6332 => 0.6481, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/08-main/main: 2.35% (0.1831 => 0.1874, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 6.74% (0.1559 => 0.1664, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.91% (0.3123 => 0.3245, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.14% (0.2463 => 0.2491, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.54% (0.3344 => 0.3362, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.78% (0.2364 => 0.2406, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: 0.07% (0.6010 => 0.6014, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/mandel: 11.66% (0.0429 => 0.0479, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.85% (0.3266 => 0.3359, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 3.40% (0.1969 => 0.2036, std.dev.: 0.0012) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 13.84% (0.0224 => 0.0255, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 76.42% (0.0123 => 0.0217, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.17% (0.0408 => 0.0425, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.13% (0.0254 => 0.0328, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0384 => 0.0424, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 20.00% (0.0180 => 0.0216, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: 46.96% (0.0230 => 0.0338, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.85% (0.1438 => 0.1479, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.56% (1.1329 => 1.1393, std.dev.: 0.0394) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.83% (0.1462 => 0.1518, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.69% (0.4164 => 0.4052, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.60% (0.1369 => 0.1306, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.37% (0.0641 => 0.0613, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.40% (0.0578 => 0.0541, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.14% (1.1437 => 1.1453, std.dev.: 0.0188) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.64% (0.0627 => 0.0631, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.33% (0.0180 => 0.0267, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.01% (0.8017 => 0.8016, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -3.23% (0.0062 => 0.0060, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Oct 25 23:06:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 01:06:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121026060604.0DDE02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5235?compare_to=5232&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5235, Order: 166749, Start Time: 2012-10-26 04:40:42, End Time: 2012-10-26 06:05:58 To: 5232, Order: 166748, Start Time: 2012-10-26 02:52:37, End Time: 2012-10-26 04:17:38 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (179 on baseline) Unchanged Tests: 1041 (858 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.89% (79.3926 => 80.8893, std.dev.: 0.4216) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1014, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/salsa20: 2.40% (7.4937 => 7.6738, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/hash2: 2.34% (3.1932 => 3.2680, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.47% (79.7170 => 80.8893, std.dev.: 0.4216) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.94% (0.1431 => 0.1303, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.96% (0.3821 => 0.3517, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -7.33% (2.4924 => 2.3098, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -7.18% (0.3357 => 0.3116, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -7.04% (0.3880 => 0.3607, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -7.00% (0.3831 => 0.3563, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.96% (0.3848 => 0.3580, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -6.95% (0.3812 => 0.3547, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.95% (0.3884 => 0.3614, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -6.93% (0.3896 => 0.3626, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.92% (0.2428 => 0.2260, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -6.92% (0.4033 => 0.3754, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.86% (0.3891 => 0.3624, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.84% (0.3142 => 0.2927) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.84% (22.4056 => 20.8730, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.79% (0.9542 => 0.8894, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: -6.78% (1.2515 => 1.1666, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.76% (3.5339 => 3.2951, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: -6.75% (0.9179 => 0.8559, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.75% (0.3658 => 0.3411, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: -6.73% (0.4176 => 0.3895, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -6.70% (0.1761 => 0.1643, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: -6.69% (0.4199 => 0.3918, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.63% (0.1796 => 0.1677, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -6.62% (0.2160 => 0.2017, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -6.61% (16.1920 => 15.1212, std.dev.: 0.0205) SingleSource/UnitTests/ObjC/parameter-passing: -6.61% (0.4280 => 0.3997, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -6.60% (9.2283 => 8.6188, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/ReedSolomon: -6.60% (0.1879 => 0.1755, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: -6.58% (7.0961 => 6.6291, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.55% (0.6484 => 0.6059, std.dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: -6.55% (1.1530 => 1.0775, std.dev.: 0.0074) MultiSource/Benchmarks/MallocBench/gs/gs: -6.55% (4.3330 => 4.0494, std.dev.: 0.0068) MultiSource/Applications/siod/siod: -6.52% (2.4021 => 2.2455, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.49% (1.6474 => 1.5405, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.49% (1.0544 => 0.9860, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.48% (0.9852 => 0.9214, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.46% (1.4642 => 1.3696, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.46% (0.2695 => 0.2521, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.43% (1.3722 => 1.2839, std.dev.: 0.0099) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.41% (1.2784 => 1.1964, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.41% (1.2300 => 1.1512, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -6.40% (0.2985 => 0.2794, std.dev.: 0.0040) MultiSource/Applications/lemon/lemon: -6.39% (1.1450 => 1.0718, std.dev.: 0.0062) MultiSource/Applications/lua/lua: -6.37% (4.0594 => 3.8008, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.36% (6.7716 => 6.3410, std.dev.: 0.0066) MultiSource/Applications/minisat/minisat: -6.35% (0.7447 => 0.6974, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.33% (0.2355 => 0.2206, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.32% (0.2548 => 0.2387, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: -6.32% (0.2659 => 0.2491, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.30% (4.5069 => 4.2228, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.28% (2.2587 => 2.1169, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.28% (1.6364 => 1.5337, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (4.0323 => 3.7803, std.dev.: 0.0130) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.22% (0.6736 => 0.6317, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.20% (5.4682 => 5.1293, std.dev.: 0.0196) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.17% (0.4151 => 0.3895, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.16% (4.8802 => 4.5796, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.14% (0.7198 => 0.6756, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: -6.14% (0.3406 => 0.3197, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -6.14% (0.4515 => 0.4238, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: -6.13% (1.3148 => 1.2342, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.10% (4.8161 => 4.5222, std.dev.: 0.0028) MultiSource/Applications/SIBsim4/SIBsim4: -6.07% (1.3864 => 1.3022, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -6.07% (34.0927 => 32.0222, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/hash2: -6.07% (0.4861 => 0.4566, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.06% (0.5478 => 0.5146, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -6.06% (0.3581 => 0.3364, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: -6.06% (15.5079 => 14.5683, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/functionobjects: -6.06% (0.5168 => 0.4855, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.05% (0.3931 => 0.3693, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.04% (0.7919 => 0.7441, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: -6.04% (0.2999 => 0.2818, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.03% (14.2083 => 13.3510, std.dev.: 0.0114) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.98% (0.3849 => 0.3619, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.97% (0.5591 => 0.5257, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.96% (0.5925 => 0.5572, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.96% (0.6681 => 0.6283, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.94% (0.5705 => 0.5366, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.93% (0.3252 => 0.3059, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.92% (0.4321 => 0.4065, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.92% (0.5999 => 0.5644, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.92% (0.3837 => 0.3610, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.91% (0.6297 => 0.5925, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.90% (0.4083 => 0.3842, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.90% (0.5863 => 0.5517, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.90% (0.6304 => 0.5932, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: -5.90% (15.2527 => 14.3528, std.dev.: 0.0104) MultiSource/Applications/sqlite3/sqlite3: -5.90% (17.1032 => 16.0947, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.89% (0.5802 => 0.5460, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.89% (0.7339 => 0.6907, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: -5.88% (3.5154 => 3.3086, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/except: -5.88% (0.3026 => 0.2848, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.87% (0.3323 => 0.3128, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: -5.86% (18.2933 => 17.2216, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.84% (0.6194 => 0.5832, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.84% (0.4916 => 0.4629, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: -5.83% (0.3446 => 0.3245, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -5.83% (0.3481 => 0.3278, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.83% (0.1716 => 0.1616, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: -5.83% (2.1401 => 2.0154, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.82% (0.5805 => 0.5467, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/matrix: -5.81% (0.3255 => 0.3066, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.80% (0.6395 => 0.6024, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.80% (0.6395 => 0.6024, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.80% (0.6293 => 0.5928, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.79% (0.2106 => 0.1984, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.79% (0.5581 => 0.5258, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.79% (0.5859 => 0.5520, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.78% (0.6052 => 0.5702) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.78% (0.6660 => 0.6275, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/bigfib: -5.76% (0.6750 => 0.6361, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.76% (0.6667 => 0.6283, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/strcat: -5.75% (0.2989 => 0.2817, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.75% (0.8521 => 0.8031, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.75% (0.6230 => 0.5872, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: -5.74% (0.3621 => 0.3413, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.74% (2.1713 => 2.0467, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.74% (0.5857 => 0.5521, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.73% (0.6260 => 0.5901, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.73% (0.3491 => 0.3291, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.72% (0.5329 => 0.5024, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.72% (0.2903 => 0.2737, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.71% (0.4427 => 0.4174, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.71% (0.5569 => 0.5251, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.71% (1.2210 => 1.1513, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.70% (0.5575 => 0.5257, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -5.70% (0.4524 => 0.4266, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.69% (0.2933 => 0.2766, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.69% (0.3057 => 0.2883, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.68% (0.3483 => 0.3285, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/fibo: -5.68% (0.2871 => 0.2708, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.66% (0.7524 => 0.7098, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: -5.66% (0.3059 => 0.2886, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -5.65% (0.3025 => 0.2854, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.64% (0.6440 => 0.6077, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.63% (0.6676 => 0.6300, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -5.62% (0.3788 => 0.3575, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.62% (0.5941 => 0.5607, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -5.62% (0.2849 => 0.2689, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: -5.61% (0.2939 => 0.2774, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.61% (8.0126 => 7.5629, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.61% (0.6189 => 0.5842, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -5.60% (0.4248 => 0.4010, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.60% (0.9557 => 0.9022, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -5.59% (0.3205 => 0.3026, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.58% (0.2385 => 0.2252, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.57% (0.5688 => 0.5371, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/lists1: -5.56% (0.3867 => 0.3652, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.55% (0.6446 => 0.6088, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.55% (0.5456 => 0.5153, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.55% (0.4813 => 0.4546, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.54% (0.5849 => 0.5525, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: -5.53% (0.3271 => 0.3090, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.51% (0.7021 => 0.6634, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.50% (0.6033 => 0.5701, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -5.50% (0.7779 => 0.7351, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -5.45% (0.6347 => 0.6001, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -5.45% (0.3194 => 0.3020, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -5.42% (0.6441 => 0.6092, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: -5.41% (0.7982 => 0.7550, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.41% (1.2221 => 1.1560, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.39% (0.5567 => 0.5267, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.37% (0.5570 => 0.5271, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.30% (0.3319 => 0.3143, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -5.29% (0.8418 => 0.7973, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.83% (0.2278 => 0.2168, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -4.66% (5.0226 => 4.7887, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.54% (0.9077 => 0.8665, std.dev.: 0.0047) MultiSource/Applications/hbd/hbd: -4.46% (1.5610 => 1.4914, std.dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -3.48% (20.7746 => 20.0507, std.dev.: 0.0123) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7539, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/richards_benchmark: -8.65% (1.2842 => 1.1731, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7067, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -3.78% (2.2633 => 2.1778, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0245, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.74% (1.3096 => 1.2737, std.dev.: 0.0080) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4689, std.dev.: 0.0043) Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 00:05:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 02:05:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121026070554.4B7D42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5236?compare_to=5233&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5236, Order: 166755, Start Time: 2012-10-26 05:41:44, End Time: 2012-10-26 07:05:48 To: 5233, Order: 166749, Start Time: 2012-10-26 03:49:02, End Time: 2012-10-26 05:12:01 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (73 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (193 on baseline) Performance Improvements: 0 (50 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 75 (2 on baseline) Unchanged Tests: 966 (645 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/nbench/nbench: 1.03% (1.3735 => 1.3877, std.dev.: 0.0036) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.41% (0.0488 => 0.0486, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0490 => 0.0490, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.44% (0.0458 => 0.0456, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.44% (0.0459 => 0.0457, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.45% (0.0447 => 0.0445, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.22% (0.0449 => 0.0448, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.23% (0.0441 => 0.0440, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.45% (0.0443 => 0.0441, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.44% (0.0459 => 0.0457, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.43% (0.0460 => 0.0458, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.44% (0.0453 => 0.0451, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.44% (0.0455 => 0.0453, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.45% (0.0443 => 0.0441, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.45% (0.0445 => 0.0443, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.44% (0.0451 => 0.0449, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.44% (0.0452 => 0.0450, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.43% (0.0462 => 0.0460, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.22% (0.0463 => 0.0462, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.46% (0.0439 => 0.0437, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.45% (0.0440 => 0.0438, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.44% (0.0451 => 0.0449, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.44% (0.0452 => 0.0450, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.45% (0.0442 => 0.0440, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.23% (0.0443 => 0.0442, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.46% (0.0435 => 0.0433, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.46% (0.0435 => 0.0433, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.46% (0.0433 => 0.0431, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.46% (0.0435 => 0.0433, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.43% (0.0470 => 0.0468, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.42% (0.0471 => 0.0469, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.46% (0.0432 => 0.0430, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.46% (0.0433 => 0.0431, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.46% (0.0433 => 0.0431, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.23% (0.0434 => 0.0433, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.45% (0.0441 => 0.0439, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.45% (0.0442 => 0.0440, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/BenchmarkGame/puzzle MultiSource/Applications/oggenc/oggenc: -0.07% (0.1408 => 0.1407, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.62% (0.0648 => 0.0665, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.05% (0.3827 => 0.3825, std.dev.: 0.0011) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.06% (0.6962 => 0.3825, std.dev.: 0.0011) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 203.40% (0.5229 => 1.5865, std.dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: 15.98% (14.9895 => 17.3844, std.dev.: 0.0118) MultiSource/Applications/kimwitu++/kc: 37.49% (14.1553 => 19.4627, std.dev.: 0.0069) MultiSource/Benchmarks/MallocBench/gs/gs: 13.70% (4.1105 => 4.6735, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 35.85% (1.1048 => 1.5009, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 319.21% (7.1582 => 30.0077, std.dev.: 0.5298) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.77% (3.4629 => 5.8445, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 67.66% (0.6222 => 1.0432, std.dev.: 0.0013) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 11829.58% (0.0720 => 8.5893, std.dev.: 0.0119) MultiSource/Applications/SIBsim4/SIBsim4: 4015500.00% (0.0001 => 4.0156, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 11148100.00% (0.0001 => 11.1482, std.dev.: 0.0584) MultiSource/Applications/kimwitu++/kc: 50800.00% (0.0001 => 0.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 793000.00% (0.0001 => 0.7931, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050000.00% (0.0001 => 10.0501, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5492800.00% (0.0001 => 5.4929, std.dev.: 0.0021) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 69.53% (0.0256 => 0.0434, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 57.20% (0.0243 => 0.0382) SingleSource/Regression/C/sumarray2d: 54.98% (0.0271 => 0.0420, std.dev.: 0.0002) SingleSource/Regression/C/sumarray: 45.02% (0.0231 => 0.0335, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 42.27% (1.5859 => 2.2562, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/distray/distray: 40.62% (0.1056 => 0.1485, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 36.74% (10.3673 => 14.1765, std.dev.: 0.1323) SingleSource/UnitTests/vla: 34.08% (0.0355 => 0.0476, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 31.37% (2.2024 => 2.8932, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 29.33% (0.1432 => 0.1852, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/neural/neural: 28.78% (0.1463 => 0.1884, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 25.14% (0.1655 => 0.2071, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 24.70% (0.0834 => 0.1040, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.16% (0.1566 => 0.1913, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 21.28% (0.2049 => 0.2485, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: 21.24% (0.0485 => 0.0588, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.52% (0.0871 => 0.1041, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 19.49% (0.5105 => 0.6100, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 19.43% (0.4879 => 0.5827, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 19.16% (0.1555 => 0.1853, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 18.54% (0.3177 => 0.3766, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 18.50% (0.0746 => 0.0884, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.19% (0.6675 => 0.7889, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 18.13% (0.2554 => 0.3017, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 18.13% (0.1175 => 0.1388, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 17.95% (0.0730 => 0.0861, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.78% (0.0793 => 0.0934, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.62% (0.3121 => 0.3671, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.53% (1.3050 => 1.5338, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.49% (0.1029 => 0.1209, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 17.35% (0.1695 => 0.1989, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: 17.25% (0.0626 => 0.0734, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 17.20% (1.1840 => 1.3877, std.dev.: 0.0036) MultiSource/Applications/d/make_dparser: 17.00% (3.3354 => 3.9023, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/mst/mst: 16.94% (0.1163 => 0.1360, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.73% (0.2271 => 0.2651, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.69% (0.8172 => 0.9536, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 16.53% (0.1337 => 0.1558, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.47% (0.1032 => 0.1202, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 16.46% (0.7115 => 0.8286, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.38% (1.5415 => 1.7940, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.29% (0.4615 => 0.5367, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.25% (0.0886 => 0.1030, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.20% (0.5020 => 0.5833, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 16.09% (0.1510 => 0.1753, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 16.03% (0.0842 => 0.0977, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 16.03% (0.1940 => 0.2251, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 16.02% (0.3109 => 0.3607, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.00% (0.0675 => 0.0783, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.75% (0.0838 => 0.0970, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/exptree: 15.36% (0.0814 => 0.0939, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 15.29% (0.1236 => 0.1425, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 15.29% (0.1151 => 0.1327, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 15.28% (0.1584 => 0.1826, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.19% (0.2107 => 0.2427, std.dev.: 0.0033) MultiSource/Applications/Burg/burg: 15.19% (1.1642 => 1.3410, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.13% (0.1117 => 0.1286, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 15.06% (0.1906 => 0.2193, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.01% (0.2065 => 0.2375, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.94% (4.2646 => 4.9018, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.93% (0.0730 => 0.0839, std.dev.: 0.0029) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.87% (0.1143 => 0.1313, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.87% (0.2758 => 0.3168, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.81% (0.2700 => 0.3100, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.81% (0.0770 => 0.0884, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.76% (0.9765 => 1.1206, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/18-imp/imp: 14.69% (0.3423 => 0.3926, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/rem: 14.60% (0.1144 => 0.1311, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 14.56% (0.7835 => 0.8976, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.50% (0.6450 => 0.7385, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 14.33% (0.7433 => 0.8498, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.30% (0.5981 => 0.6836, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.29% (0.0798 => 0.0912, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.22% (0.1125 => 0.1285, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.22% (0.1062 => 0.1213, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.22% (0.1695 => 0.1936, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 14.14% (2.0273 => 2.3139, std.dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: 14.13% (9.4845 => 10.8247, std.dev.: 0.2241) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.94% (0.5860 => 0.6677, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.93% (0.0933 => 0.1063, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.90% (0.0770 => 0.0877) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.81% (0.8067 => 0.9181, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.71% (8.1363 => 9.2518, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.70% (1.4186 => 1.6129, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/09-vor/vor: 13.68% (0.3180 => 0.3615, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.54% (0.1625 => 0.1845, std.dev.: 0.0058) MultiSource/Applications/lua/lua: 13.52% (3.8723 => 4.3959, std.dev.: 0.0105) MultiSource/Applications/lemon/lemon: 13.50% (1.0722 => 1.2169, std.dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.46% (0.0929 => 0.1054, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.34% (0.3307 => 0.3748, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/05-eks/eks: 13.28% (0.4299 => 0.4870, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.23% (0.5569 => 0.6306, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/health/health: 13.17% (0.1268 => 0.1435, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.14% (0.2603 => 0.2945, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.82% (0.3441 => 0.3882, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 12.81% (0.8921 => 1.0064, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.77% (5.0018 => 5.6405, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.73% (4.9449 => 5.5744, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: 12.65% (0.3092 => 0.3483, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.63% (0.1330 => 0.1498, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.53% (1.1861 => 1.3347, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 12.40% (0.3387 => 0.3807, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.90% (0.8101 => 0.9065, std.dev.: 0.0030) MultiSource/Applications/oggenc/oggenc: 11.86% (5.7591 => 6.4420, std.dev.: 0.0065) SingleSource/UnitTests/ObjC/parameter-passing: 11.79% (0.3927 => 0.4390, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.69% (0.3516 => 0.3927, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/synchronized: 11.68% (0.3561 => 0.3977, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.66% (0.3473 => 0.3878, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-4: 11.66% (0.3543 => 0.3956, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.63% (0.3543 => 0.3955, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 11.58% (0.3497 => 0.3902, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 11.56% (0.3694 => 0.4121, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions: 11.55% (0.3828 => 0.4270, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 11.47% (2.2969 => 2.5603, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/property: 11.37% (0.3886 => 0.4328, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 11.32% (0.6456 => 0.7187, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 11.23% (0.0953 => 0.1060) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.21% (0.1892 => 0.2104, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 11.11% (0.1044 => 0.1160, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash: 11.05% (0.4289 => 0.4763, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 11.04% (0.4620 => 0.5130, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 10.70% (0.3422 => 0.3788, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.61% (2.2022 => 2.4359, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.37% (0.4203 => 0.4639, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.32% (0.3865 => 0.4264, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 10.29% (0.3684 => 0.4063, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 10.29% (1.5603 => 1.7208, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.99% (0.4103 => 0.4513, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.96% (0.3826 => 0.4207, std.dev.: 0.0124) MultiSource/Applications/JM/lencod/lencod: 9.83% (21.9371 => 24.0933, std.dev.: 0.0117) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.71% (0.4636 => 0.5086, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/moments: 9.54% (0.4048 => 0.4434, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 9.44% (0.3603 => 0.3943, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.40% (0.6030 => 0.6597) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.34% (0.2430 => 0.2657, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.27% (0.5925 => 0.6474, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.22% (0.3427 => 0.3743, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 9.15% (17.1811 => 18.7524, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/matrix: 8.68% (0.3098 => 0.3367, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.66% (0.4064 => 0.4416, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.59% (3.8922 => 4.2265, std.dev.: 0.0136) SingleSource/UnitTests/ObjC++/property-reference: 8.59% (0.7326 => 0.7955, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.48% (14.3668 => 15.5851, std.dev.: 0.0187) SingleSource/Benchmarks/Shootout-C++/strcat: 8.27% (0.2831 => 0.3065, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 8.22% (0.3283 => 0.3553, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.22% (0.2872 => 0.3108, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 8.14% (0.3232 => 0.3495, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 8.08% (0.2871 => 0.3103, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 8.06% (0.2905 => 0.3139, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.02% (0.2891 => 0.3123, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.00% (0.3162 => 0.3415, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.73% (0.2793 => 0.3009, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.73% (0.2756 => 0.2969, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.67% (0.2725 => 0.2934, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.61% (0.2877 => 0.3096, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 7.60% (0.3052 => 0.3284, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/oourafft: 7.56% (0.3282 => 0.3530, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 7.33% (0.2714 => 0.2913, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 7.28% (0.2802 => 0.3006, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 7.18% (1.2842 => 1.3764, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 7.14% (10.4361 => 11.1816, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/ary2: 7.07% (0.3379 => 0.3618, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.84% (0.2266 => 0.2421, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.25% (7.9617 => 8.4593, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.12% (0.3136 => 0.3328, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/objinst: 5.69% (0.3131 => 0.3309, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.07% (0.3935 => 0.4095, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.96% (0.3817 => 0.3968, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.65% (7.0540 => 7.3112, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3123, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: 31.62% (10.2830 => 13.5349, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1725, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 14.08% (2.6778 => 3.0548, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.81% (0.9957 => 1.1332, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.78% (1.1396 => 1.2510, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3680, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.64% (2.8904 => 3.0824, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 3.81% (1.9405 => 2.0145, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.21% (0.3987 => 0.4115, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.99% (4.2280 => 4.3543, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0313 => 1.0567, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.76% (0.8333 => 0.8480, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2078, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.49% (11.6436 => 11.8170, std.dev.: 0.0180) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.20% (2.6546 => 2.6865, std.dev.: 0.0023) MultiSource/Applications/viterbi/viterbi: 1.18% (4.4649 => 4.5177, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5754, std.dev.: 0.0073) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.93% (6.6874 => 0.1381, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -82.51% (0.8651 => 0.1513, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -52.43% (5.2763 => 2.5101, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -45.19% (0.1622 => 0.0889, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -41.04% (5.3855 => 3.1755, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.51% (5.3526 => 3.1845, std.dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -8.86% (54.1659 => 49.3655, std.dev.: 0.0068) MultiSource/Benchmarks/Bullet/bullet: -8.21% (63.2438 => 58.0546, std.dev.: 1.2743) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.04% (1.7609 => 1.6193, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.73% (1.1194 => 1.0664, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -4.70% (22.1758 => 21.1325, std.dev.: 0.0131) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.69% (2.9384 => 2.8007, std.dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -52.86% (8.0499 => 3.7947, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.40% (1.1492 => 0.7654, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -28.61% (10.7105 => 7.6463, std.dev.: 0.1998) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4752, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.76% (1.6925 => 1.4258, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.69% (1.2258 => 1.0702, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -11.70% (1.2373 => 1.0925, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: -10.50% (1.5373 => 1.3759, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.42% (19.9488 => 18.2700, std.dev.: 0.0175) MultiSource/Benchmarks/FreeBench/mason/mason: -7.77% (0.2161 => 0.1993, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.06% (1.8329 => 1.7035, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/oourafft: -5.45% (6.6465 => 6.2841, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.93% (1.6805 => 1.5976, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.88% (1.5835 => 1.5062, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.27% (8.1563 => 7.8077, std.dev.: 0.0120) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.73% (1.3677 => 1.3167, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1624, std.dev.: 0.0024) MultiSource/Benchmarks/sim/sim: -3.33% (5.0483 => 4.8801, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5055, std.dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.75% (0.4808 => 0.4676, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6832, std.dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -1.67% (2.5528 => 2.5101, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.64% (1.1277 => 1.1092) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4221, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -1.46% (4.6441 => 4.5763, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/whetstone: -1.08% (1.0554 => 1.0440, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2358, std.dev.: 0.0040) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -5.25% (0.1485 => 0.1407, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.57% (0.2116 => 0.0665, std.dev.: 0.0016) Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 00:10:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 02:10:22 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121026071022.0A5752A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5237?compare_to=5234&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5237, Order: 166755, Start Time: 2012-10-26 05:46:59, End Time: 2012-10-26 07:10:18 To: 5234, Order: 166749, Start Time: 2012-10-26 04:05:57, End Time: 2012-10-26 05:30:11 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 3 (71 on baseline) Performance Improvements: 7 (3 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 965 (900 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 29.75% (1.9167 => 2.4870, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.39% (1.5088 => 1.8919, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.34% (16.1160 => 16.9767, std.dev.: 0.1972) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.70% (0.9292 => 0.9134, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.39% (0.9291 => 0.9162, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.15% (0.9036 => 0.8932, std.dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/lpbench: -6.00% (4.1424 => 3.8939, std.dev.: 0.0205) SingleSource/Benchmarks/Shootout/heapsort: -5.85% (3.2019 => 3.0147, std.dev.: 0.0229) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.11% (4.7229 => 4.5761, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -2.02% (22.6678 => 22.2091, std.dev.: 0.1416) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.52% (16.6165 => 16.5307, std.dev.: 0.1087) MultiSource/Applications/obsequi/Obsequi: -0.03% (1.0617 => 1.0614, std.dev.: 0.0149) MultiSource/Applications/sqlite3/sqlite3: -1.11% (0.6481 => 0.6409, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/08-main/main: 2.67% (0.1874 => 0.1924, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.16% (0.1664 => 0.1700, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.08% (0.3245 => 0.3210, std.dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.92% (0.2491 => 0.2468, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.06% (0.3362 => 0.3360, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.58% (0.2406 => 0.2420, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: -0.62% (0.6014 => 0.5977, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: -5.64% (0.0479 => 0.0452, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.27% (0.3359 => 0.3249, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/strcat: -2.50% (0.2036 => 0.1985, std.dev.: 0.0011) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -8.24% (0.0255 => 0.0234, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -11.98% (0.0217 => 0.0191, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -8.71% (0.0425 => 0.0388, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -5.49% (0.0328 => 0.0310, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -18.59% (0.0312 => 0.0254, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -18.40% (0.0424 => 0.0346, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/casts: -37.13% (0.0202 => 0.0127, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/test1: -16.20% (0.0216 => 0.0181, std.dev.: 0.0018) SingleSource/UnitTests/byval-alignment: -3.25% (0.0338 => 0.0327, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.20% (0.1479 => 0.1482, std.dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -2.42% (1.1393 => 1.1117, std.dev.: 0.0455) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -5.73% (0.1518 => 0.1431, std.dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.44% (0.4052 => 0.4034, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.75% (0.1306 => 0.1355, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.08% (0.0613 => 0.0638, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -10.11% (0.0277 => 0.0249, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.55% (0.0541 => 0.0538, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.34% (1.1453 => 1.1414, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.77% (0.0031 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -15.21% (0.0631 => 0.0535, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -15.36% (0.0267 => 0.0226, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.74% (0.8016 => 0.7957, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -38.33% (0.0060 => 0.0037, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.81% (2.1832 => 1.6634, std.dev.: 0.0044) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.67% (0.4847 => 0.5219, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.43% (0.2180 => 0.2342, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.02% (0.2279 => 0.2439, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.17% (0.7473 => 0.7859, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.14% (0.6010 => 0.6319, std.dev.: 0.0109) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.00% (0.2240 => 0.2352, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.17% (0.3717 => 0.3872, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.91% (0.6287 => 0.6533, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.91% (1.1606 => 1.2060, std.dev.: 0.0156) MultiSource/Applications/spiff/spiff: 3.41% (0.7950 => 0.8221, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.07% (1.1685 => 1.2044, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.70% (1.4479 => 1.4870, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.69% (0.4127 => 0.4238, std.dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.57% (6.6074 => 6.7775, std.dev.: 0.0616) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.57% (0.4783 => 0.4906, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.44% (1.3279 => 1.3603, std.dev.: 0.0076) MultiSource/Applications/SIBsim4/SIBsim4: 2.36% (1.2568 => 1.2864, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.35% (0.5961 => 0.6101, std.dev.: 0.0043) MultiSource/Applications/d/make_dparser: 2.05% (3.2366 => 3.3029, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.97% (0.7966 => 0.8123, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.96% (8.6476 => 8.8172, std.dev.: 0.0306) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.96% (13.1811 => 13.4395, std.dev.: 0.0221) SingleSource/UnitTests/Vector/constpool: 1.94% (8.4179 => 8.5810, std.dev.: 0.0459) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.89% (0.8697 => 0.8861, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.86% (0.8007 => 0.8156, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.85% (0.8331 => 0.8485, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.83% (4.1763 => 4.2526, std.dev.: 0.0150) MultiSource/Benchmarks/MallocBench/gs/gs: 1.81% (4.1305 => 4.2051, std.dev.: 0.0219) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.78% (0.8420 => 0.8570, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.70% (0.8611 => 0.8757, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 1.69% (3.8189 => 3.8835, std.dev.: 0.0225) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.66% (4.4880 => 4.5627, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.60% (0.8204 => 0.8335, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.59% (0.8286 => 0.8418, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.57% (0.8050 => 0.8176, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.56% (1.6386 => 1.6642, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.54% (0.8317 => 0.8445, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.53% (0.6586 => 0.6687, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.50% (0.8359 => 0.8484, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.49% (0.8805 => 0.8936, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.44% (0.8069 => 0.8185, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.41% (0.8518 => 0.8638, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.40% (0.8048 => 0.8161, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.39% (0.8316 => 0.8432, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.39% (0.9074 => 0.9200, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.39% (0.8716 => 0.8837, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.36% (0.7932 => 0.8040, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.34% (0.9056 => 0.9177, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.32% (0.8261 => 0.8370, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.31% (0.8597 => 0.8710, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.31% (0.8086 => 0.8192, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.30% (1.2423 => 1.2584, std.dev.: 0.0044) MultiSource/Applications/siod/siod: 1.26% (2.2184 => 2.2464, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.23% (0.9908 => 1.0030, std.dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 1.18% (0.9810 => 0.9926, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.17% (1.1170 => 1.1301, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.17% (0.9688 => 0.9801, std.dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: 1.16% (2.3764 => 2.4039, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 1.11% (4.9628 => 5.0179, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.03% (2.1401 => 2.1622, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 57.45% (1.5795 => 2.4870, std.dev.: 0.0134) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.92% (14.6451 => 16.9767, std.dev.: 0.1972) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.51% (0.3186 => 0.3489, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.44% (1.1857 => 1.2858, std.dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: 5.94% (63.1822 => 66.9324, std.dev.: 0.0265) SingleSource/Benchmarks/Misc/ReedSolomon: 2.98% (8.5322 => 8.7868, std.dev.: 0.0730) MultiSource/Applications/siod/siod: 2.96% (3.6643 => 3.7727, std.dev.: 0.0126) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.05% (2.4490 => 2.4993, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/hash: 1.80% (0.6205 => 0.6317, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: 1.72% (2.3560 => 2.3965, std.dev.: 0.0066) MultiSource/Applications/minisat/minisat: 1.35% (6.1525 => 6.2353, std.dev.: 0.0197) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -8.44% (3.2926 => 3.0147, std.dev.: 0.0229) MultiSource/Applications/lua/lua: -5.19% (29.8330 => 28.2856, std.dev.: 0.1238) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.39% (3.3479 => 3.3013, std.dev.: 0.0159) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.51% (16.4461 => 16.5307, std.dev.: 0.1087) MultiSource/Applications/obsequi/Obsequi: 3.43% (1.0262 => 1.0614, std.dev.: 0.0149) MultiSource/Applications/sqlite3/sqlite3: 1.22% (0.6332 => 0.6409, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/08-main/main: 5.08% (0.1831 => 0.1924, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.04% (0.1559 => 0.1700, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.79% (0.3123 => 0.3210, std.dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.20% (0.2463 => 0.2468, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.48% (0.3344 => 0.3360, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.37% (0.2364 => 0.2420, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: -0.55% (0.6010 => 0.5977, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: 5.36% (0.0429 => 0.0452, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.52% (0.3266 => 0.3249, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/strcat: 0.81% (0.1969 => 0.1985, std.dev.: 0.0011) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.46% (0.0224 => 0.0234, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 55.28% (0.0123 => 0.0191, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.90% (0.0408 => 0.0388, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 22.05% (0.0254 => 0.0310, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -15.89% (0.0302 => 0.0254, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -9.90% (0.0384 => 0.0346, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/casts: -33.16% (0.0190 => 0.0127, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/test1: 0.56% (0.0180 => 0.0181, std.dev.: 0.0018) SingleSource/UnitTests/byval-alignment: 42.17% (0.0230 => 0.0327, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 3.06% (0.1438 => 0.1482, std.dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.87% (1.1329 => 1.1117, std.dev.: 0.0455) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -2.12% (0.1462 => 0.1431, std.dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.12% (0.4164 => 0.4034, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.02% (0.1369 => 0.1355, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.47% (0.0641 => 0.0638, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 27.69% (0.0195 => 0.0249, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.92% (0.0578 => 0.0538, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.20% (1.1437 => 1.1414, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.67% (0.0627 => 0.0535, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.56% (0.0180 => 0.0226, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.75% (0.8017 => 0.7957, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -40.32% (0.0062 => 0.0037, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 00:38:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 02:38:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121026073834.1DBF52A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/5238?compare_to=5230&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5238, Order: 166749, Start Time: 2012-10-26 04:18:59, End Time: 2012-10-26 07:38:29 To: 5230, Order: 166735, Start Time: 2012-10-26 00:15:57, End Time: 2012-10-26 03:30:56 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Passes: 1 (0 on baseline) Performance Regressions: 1 (166 on baseline) Performance Improvements: 6 (18 on baseline) Added Tests: 2 (134 on baseline) Unchanged Tests: 1032 (724 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/ClamAV/clamscan: 5.30% (0.2906 => 0.3060, std.dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.27% (122.6646 => 129.1253, std.dev.: 1.3113) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: -2.61% (0.4026 => 0.3921, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.58% (0.4062 => 0.3957, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.46% (3.1904 => 3.1439, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.29% (1.5610 => 1.5408, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: -1.15% (2.3818 => 2.3545, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.07% (4.2009 => 4.1561, std.dev.: 0.0052) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/VersaBench/8b10b/8b10b Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/VersaBench/8b10b/8b10b ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.64% (0.0625 => 0.0879, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.42% (0.1063 => 0.1397, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.27% (0.2969 => 0.3749, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 24.68% (0.1106 => 0.1379, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.02% (0.4139 => 0.5133, std.dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 23.76% (1.5932 => 1.9718, std.dev.: 0.0438) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.33% (0.4994 => 0.6159, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.32% (0.4253 => 0.5245, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.20% (0.5900 => 0.7269, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.16% (0.0475 => 0.0585) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.11% (0.0714 => 0.0879, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.84% (0.5000 => 0.6142, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.49% (0.0547 => 0.0670, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.43% (0.0584 => 0.0715, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.19% (0.0897 => 0.1096, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.60% (0.1620 => 0.1970, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.45% (0.1021 => 0.1240, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/tsp/tsp: 21.37% (0.0599 => 0.0727, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.05% (0.1107 => 0.1340, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.54% (0.0633 => 0.0763, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 20.46% (0.0948 => 0.1142, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.21% (0.0584 => 0.0702, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 20.20% (0.0604 => 0.0726, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.08% (0.1549 => 0.1860, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.96% (0.0541 => 0.0649, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.95% (0.1103 => 0.1323, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.94% (0.1003 => 0.1203, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.94% (0.0642 => 0.0770, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.86% (0.3903 => 0.4678, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: 19.73% (0.0821 => 0.0983, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 19.52% (0.1619 => 0.1935, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.46% (0.0822 => 0.0982, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.33% (0.1604 => 0.1914, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 18.59% (0.0947 => 0.1123, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.06% (0.1462 => 0.1726, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 17.95% (0.5826 => 0.6872, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.94% (0.3890 => 0.4588, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/08-main/main: 17.82% (0.1218 => 0.1435, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.78% (0.2014 => 0.2372, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 17.70% (0.0808 => 0.0951, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/09-vor/vor: 17.67% (0.1505 => 0.1771, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/mst/mst: 17.62% (0.0698 => 0.0821, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 17.46% (0.5889 => 0.6917, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 17.45% (0.4029 => 0.4732, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.20% (0.2866 => 0.3359, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.19% (0.1088 => 0.1275, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.15% (1.3152 => 1.5408, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.07% (0.2736 => 0.3203, std.dev.: 0.0016) MultiSource/Applications/Burg/burg: 16.93% (0.5546 => 0.6485, std.dev.: 0.0213) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.82% (0.1968 => 0.2299, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 16.81% (1.8794 => 2.1953, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.80% (0.2875 => 0.3358, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.66% (3.5627 => 4.1561, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.62% (0.4658 => 0.5432, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 16.52% (0.2803 => 0.3266, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.47% (0.5026 => 0.5854, std.dev.: 0.0037) MultiSource/Applications/hbd/hbd: 16.47% (0.9697 => 1.1294, std.dev.: 0.0353) SingleSource/Benchmarks/Shootout-C++/fibo: 16.44% (0.2725 => 0.3173, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.38% (0.1160 => 0.1350, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.37% (1.6211 => 1.8865, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.22% (0.2738 => 0.3182, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hello: 16.21% (0.2714 => 0.3154, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.09% (0.2729 => 0.3168, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.05% (0.3271 => 0.3796, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.99% (0.3195 => 0.3706, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 15.97% (0.1421 => 0.1648, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 15.96% (0.2750 => 0.3189, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 15.94% (0.2780 => 0.3223, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 15.88% (0.3004 => 0.3481, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 15.83% (0.2811 => 0.3256, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/wc: 15.83% (0.3096 => 0.3586, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 15.78% (0.2813 => 0.3257, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 15.74% (0.9909 => 1.1469, std.dev.: 0.0339) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.71% (0.4361 => 0.5046, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 15.69% (0.2823 => 0.3266, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.68% (2.0673 => 2.3914, std.dev.: 0.0057) SingleSource/UnitTests/ObjC++/property-reference: 15.67% (0.7171 => 0.8295, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.65% (0.2792 => 0.3229, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.53% (0.2911 => 0.3363, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 15.34% (0.3267 => 0.3768, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 15.30% (1.0781 => 1.2431, std.dev.: 0.0439) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.22% (1.9694 => 2.2691, std.dev.: 0.0047) MultiSource/Benchmarks/Bullet/bullet: 15.21% (23.5202 => 27.0975, std.dev.: 0.0130) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.19% (2.7292 => 3.1439, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/bh/bh: 15.19% (0.1284 => 0.1479, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: 15.13% (0.3317 => 0.3819, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.09% (0.3930 => 0.4523, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary: 15.07% (0.3258 => 0.3749, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.00% (1.9966 => 2.2961, std.dev.: 0.0114) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 14.99% (4.4195 => 5.0822, std.dev.: 0.0143) MultiSource/Applications/ClamAV/clamscan: 14.96% (4.2109 => 4.8409, std.dev.: 0.1886) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.93% (0.3060 => 0.3517, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.90% (0.3362 => 0.3863, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.60% (0.3124 => 0.3580, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 14.57% (0.4146 => 0.4750, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.55% (0.3690 => 0.4227, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists1: 14.47% (0.3477 => 0.3980, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 14.40% (0.3348 => 0.3830, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 14.33% (0.3678 => 0.4205, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.23% (0.3282 => 0.3749, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.22% (0.1090 => 0.1245, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 14.17% (0.3726 => 0.4254, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.04% (0.3625 => 0.4134, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 14.00% (0.4251 => 0.4846, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.77% (0.3981 => 0.4529, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 13.76% (0.2566 => 0.2919, std.dev.: 0.0017) MultiSource/Applications/lua/lua: 13.73% (1.4269 => 1.6228, std.dev.: 0.0066) MultiSource/Applications/treecc/treecc: 13.61% (0.7875 => 0.8947, std.dev.: 0.0223) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.60% (0.3845 => 0.4368, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-4: 13.48% (0.3465 => 0.3932, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 13.46% (0.3446 => 0.3910, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.45% (0.3488 => 0.3957, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.42% (0.3442 => 0.3904, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 13.42% (0.3496 => 0.3965, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 13.35% (0.3469 => 0.3932, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 13.32% (0.3460 => 0.3921, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 13.20% (0.2075 => 0.2349, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 13.17% (0.5012 => 0.5672, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 13.12% (0.3650 => 0.4129, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 12.96% (0.3643 => 0.4115, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 12.95% (2.1653 => 2.4458, std.dev.: 0.0808) SingleSource/UnitTests/ObjC/parameter-passing: 12.84% (0.3724 => 0.4202, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 12.79% (4.6177 => 5.2081, std.dev.: 0.1505) MultiSource/Benchmarks/mafft/pairlocalalign: 12.05% (2.1013 => 2.3545, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.70% (0.6435 => 0.7188, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 11.52% (5.5417 => 6.1801, std.dev.: 0.1694) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.48% (0.1028 => 0.1146, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.32% (0.2040 => 0.2271, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.96% (0.2737 => 0.3037, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.64% (0.2068 => 0.2288, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.38% (0.3084 => 0.3404, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 10.31% (0.3336 => 0.3680, std.dev.: 0.0099) MultiSource/Benchmarks/PAQ8p/paq8p: 10.30% (0.4847 => 0.5346, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.84% (0.2103 => 0.2310, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.54% (0.1383 => 0.1515, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.30% (4.6926 => 5.1288, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: 9.16% (2.0346 => 2.2210, std.dev.: 0.0351) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.74% (11.6398 => 12.6571, std.dev.: 0.0140) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.54% (0.5361 => 0.5819, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.99% (0.7426 => 0.8019, std.dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.68% (0.5584 => 0.6013, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 6.76% (11.9555 => 12.7638, std.dev.: 0.0278) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.14% (0.3792 => 0.3949, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6534, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 9.21% (0.2802 => 0.3060, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 7.73% (0.2122 => 0.2286, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6102, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.44% (0.3693 => 0.3894, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/objinst: 5.09% (12.0509 => 12.6644, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1684, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-2: 3.93% (1.8057 => 1.8766, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/dry: 2.74% (14.0481 => 14.4334, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/ary3: 2.00% (15.8721 => 16.1889, std.dev.: 0.0054) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.81% (3.1722 => 3.2296, std.dev.: 0.0014) MultiSource/Applications/viterbi/viterbi: 1.44% (46.6247 => 47.2982, std.dev.: 0.0100) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.42% (1.0142 => 1.0286, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2852, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5129, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.08% (1.2451 => 1.2585, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 1.08% (50.0626 => 50.6013, std.dev.: 0.0227) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.45% (25.4195 => 16.4095, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/ary2: -9.08% (0.2402 => 0.2184, std.dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: -7.70% (28.1477 => 25.9792, std.dev.: 0.0279) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7763, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/tsp/tsp: -7.19% (2.1113 => 1.9596, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.34% (11.2080 => 10.8331, std.dev.: 0.0119) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7755, std.dev.: 0.0263) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5219, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.45% (17.2379 => 16.8164, std.dev.: 0.0539) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.21% (41.7953 => 40.8735, std.dev.: 0.0100) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.11% (0.6293 => 0.6160, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5733, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: -1.55% (5.5810 => 5.4947, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.33% (5.7935 => 5.7162, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.09% (105.3826 => 104.2301, std.dev.: 0.0590) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0463, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.04% (3.3991 => 3.3638, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 00:56:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 02:56:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121026075621.46D772A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/5239?compare_to=5235&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5239, Order: 166755, Start Time: 2012-10-26 06:29:00, End Time: 2012-10-26 07:56:14 To: 5235, Order: 166749, Start Time: 2012-10-26 04:40:42, End Time: 2012-10-26 06:05:58 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (166 on baseline) Unchanged Tests: 1042 (872 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.31% (1.2783 => 1.3717, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.75% (2.0478 => 2.1041, std.dev.: 0.0206) SingleSource/Benchmarks/Misc/salsa20: 2.53% (7.4937 => 7.6832, std.dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/hash2: 2.48% (3.1932 => 3.2723, std.dev.: 0.0277) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.15% (0.1431 => 0.1300, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.09% (0.3821 => 0.3512, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -7.47% (2.4924 => 2.3061, std.dev.: 0.0139) SingleSource/UnitTests/ObjC/exceptions-4: -7.09% (0.3880 => 0.3605, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -7.07% (0.3831 => 0.3560, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -7.04% (0.3848 => 0.3577, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -7.01% (0.3896 => 0.3623, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -7.00% (0.3812 => 0.3545) SingleSource/UnitTests/ObjC/for-in: -6.99% (0.4033 => 0.3751, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.97% (0.3142 => 0.2923, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.96% (0.3891 => 0.3620, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -6.94% (0.4176 => 0.3886, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.84% (0.2428 => 0.2262, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: -6.79% (0.3357 => 0.3129, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/property: -6.79% (0.4199 => 0.3914, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.78% (0.3658 => 0.3410, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.77% (22.4056 => 20.8887, std.dev.: 0.0231) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.67% (0.3884 => 0.3625, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.65% (3.5339 => 3.2989, std.dev.: 0.0845) SingleSource/UnitTests/ObjC/parameter-passing: -6.64% (0.4280 => 0.3996, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -6.63% (7.0961 => 6.6256, std.dev.: 0.0081) MultiSource/Applications/JM/lencod/lencod: -6.59% (16.1920 => 15.1252, std.dev.: 0.0196) SingleSource/Benchmarks/McGill/chomp: -6.59% (0.1761 => 0.1645, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.57% (0.6484 => 0.6058, std.dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: -6.53% (9.2283 => 8.6255, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/football/football: -6.53% (0.9179 => 0.8580, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: -6.51% (0.2659 => 0.2486, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -6.47% (4.3330 => 4.0526, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.46% (0.9542 => 0.8926, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.45% (0.2355 => 0.2203, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.44% (0.3931 => 0.3678, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.41% (1.0544 => 0.9868, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.41% (0.1716 => 0.1606, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.38% (0.2695 => 0.2523, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -6.38% (1.2515 => 1.1717, std.dev.: 0.0025) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.38% (0.1584 => 0.1483, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.36% (1.3722 => 1.2849, std.dev.: 0.0085) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.35% (6.7716 => 6.3417, std.dev.: 0.0136) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.34% (1.2300 => 1.1520, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: -6.34% (0.7447 => 0.6975, std.dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: -6.32% (1.1530 => 1.0801, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: -6.31% (1.3148 => 1.2319, std.dev.: 0.0107) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.30% (0.9852 => 0.9231, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.30% (4.5069 => 4.2230, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: -6.30% (0.4861 => 0.4555, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.28% (5.4682 => 5.1250, std.dev.: 0.1143) MultiSource/Applications/lemon/lemon: -6.27% (1.1450 => 1.0732, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -6.27% (4.0594 => 3.8050, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/bh/bh: -6.26% (0.2985 => 0.2798, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.26% (0.3849 => 0.3608, std.dev.: 0.0079) MultiSource/Applications/siod/siod: -6.26% (2.4021 => 2.2518, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/except: -6.25% (0.3026 => 0.2837, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.23% (0.3837 => 0.3598, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.23% (1.4642 => 1.3730, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary3: -6.21% (0.3446 => 0.3232, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -6.20% (0.3323 => 0.3117, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -6.18% (0.4321 => 0.4054, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: -6.18% (0.3255 => 0.3054, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.16% (1.2784 => 1.1996, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: -6.16% (0.3491 => 0.3276, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/strcat: -6.16% (0.2989 => 0.2805, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.15% (4.0323 => 3.7842, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.14% (0.7919 => 0.7433, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.12% (0.2548 => 0.2392, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.12% (2.1713 => 2.0384, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: -6.12% (0.3025 => 0.2840, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/18-imp/imp: -6.12% (0.3581 => 0.3362, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.10% (4.8161 => 4.5221, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary: -6.10% (0.3394 => 0.3187, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.10% (0.4083 => 0.3834, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/fibo: -6.10% (0.2871 => 0.2696, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.09% (4.8802 => 4.5829, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/objinst: -6.04% (0.3194 => 0.3001, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/lists: -6.02% (0.3621 => 0.3403, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.02% (0.3057 => 0.2873, std.dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: -6.00% (34.0927 => 32.0459, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/05-eks/eks: -6.00% (0.4515 => 0.4244, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.99% (0.4427 => 0.4162, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.98% (14.2083 => 13.3582, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.94% (0.6736 => 0.6336, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.93% (0.3252 => 0.3059, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.91% (0.6293 => 0.5921, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: -5.91% (15.5079 => 14.5921, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.90% (1.6364 => 1.5398, std.dev.: 0.0059) MultiSource/Benchmarks/sim/sim: -5.90% (0.3406 => 0.3205, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.90% (0.2933 => 0.2760, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/wc: -5.90% (0.3205 => 0.3016, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/sieve: -5.89% (0.3788 => 0.3565, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/random: -5.89% (0.2939 => 0.2766, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.88% (0.4813 => 0.4530, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: -5.83% (0.2849 => 0.2683, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.82% (0.4916 => 0.4630, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -5.81% (2.1401 => 2.0158, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: -5.81% (17.1032 => 16.1099, std.dev.: 0.0169) MultiSource/Applications/kimwitu++/kc: -5.81% (18.2933 => 17.2309, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.77% (0.5478 => 0.5162, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.77% (0.6052 => 0.5703, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.76% (0.8521 => 0.8030, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.75% (0.2106 => 0.1985, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -5.75% (0.3481 => 0.3281, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.71% (0.5705 => 0.5379, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.71% (0.5863 => 0.5528, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.71% (0.6304 => 0.5944, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.71% (0.5591 => 0.5272, std.dev.: 0.0068) MultiSource/Applications/ClamAV/clamscan: -5.69% (15.2527 => 14.3844, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.68% (8.0126 => 7.5572, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.68% (0.7198 => 0.6789, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.67% (0.5925 => 0.5589, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: -5.67% (1.3864 => 1.3078, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.67% (0.6230 => 0.5877, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.66% (0.2278 => 0.2149, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.66% (0.2385 => 0.2250, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.65% (0.5859 => 0.5528, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.64% (0.6297 => 0.5942, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.63% (0.7339 => 0.6926, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.62% (0.5805 => 0.5479, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.60% (0.5999 => 0.5663, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.60% (0.6395 => 0.6037, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.60% (1.2221 => 1.1537, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.60% (0.7524 => 0.7103, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.59% (0.6676 => 0.6303, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.58% (0.5802 => 0.5478, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.58% (0.6395 => 0.6038, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: -5.58% (3.5154 => 3.3194, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.57% (0.6660 => 0.6289, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -5.57% (0.7779 => 0.7346, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: -5.56% (0.3271 => 0.3089, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.56% (1.2210 => 1.1531, std.dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: -5.56% (0.3059 => 0.2889, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.54% (0.6194 => 0.5851, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -5.54% (0.7982 => 0.7540, std.dev.: 0.0033) SingleSource/UnitTests/ObjC++/Hello: -5.51% (0.6347 => 0.5997, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.50% (0.6667 => 0.6300, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.50% (0.6260 => 0.5916, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.47% (0.2999 => 0.2835, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.47% (0.6440 => 0.6088, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.46% (0.5581 => 0.5276, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.46% (0.3483 => 0.3293, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.45% (0.5941 => 0.5617, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.45% (0.3319 => 0.3138, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.45% (0.6033 => 0.5704, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: -5.45% (0.6441 => 0.6090, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.45% (0.6446 => 0.6095, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.45% (0.6189 => 0.5852, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.43% (0.6681 => 0.6318, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.43% (0.5857 => 0.5539, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/hash: -5.42% (0.4524 => 0.4279, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.39% (0.5569 => 0.5269, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.39% (0.5570 => 0.5270, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.38% (0.5575 => 0.5275, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -5.38% (0.1879 => 0.1778, std.dev.: 0.0020) MultiSource/Applications/spiff/spiff: -5.29% (0.8418 => 0.7973, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.28% (0.5567 => 0.5273, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.26% (0.5688 => 0.5389, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.25% (0.5849 => 0.5542, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.19% (0.5456 => 0.5173, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.59% (0.9077 => 0.8660, std.dev.: 0.0034) MultiSource/Applications/oggenc/oggenc: -4.51% (5.0226 => 4.7962, std.dev.: 0.0043) MultiSource/Applications/hbd/hbd: -4.38% (1.5610 => 1.4926, std.dev.: 0.0060) SingleSource/UnitTests/Vector/constpool: -3.67% (20.7746 => 20.0120, std.dev.: 0.0420) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7563, std.dev.: 0.0138) SingleSource/Benchmarks/Misc/richards_benchmark: -8.57% (1.2842 => 1.1741, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/fbench: -4.07% (2.2633 => 2.1712, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.85% (1.7753 => 1.7069, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4671, std.dev.: 0.0045) Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 01:51:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 03:51:05 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121026085105.F266C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5240?compare_to=5237&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5240, Order: 166759, Start Time: 2012-10-26 07:27:32, End Time: 2012-10-26 08:51:02 To: 5237, Order: 166755, Start Time: 2012-10-26 05:46:59, End Time: 2012-10-26 07:10:18 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 9 (67 on baseline) Performance Improvements: 3 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 963 (903 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.36% (0.8325 => 0.8771, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.08% (0.8158 => 0.8409, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.02% (0.4500 => 0.4636, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 1.62% (0.6899 => 0.7011, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 9.21% (3.6480 => 3.9840, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/matrix: 1.49% (1.5612 => 1.5845, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/five11/five11: 1.45% (5.5799 => 5.6607, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.11% (1.4088 => 1.4245, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 1.11% (3.1932 => 3.2287, std.dev.: 0.0062) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.15% (0.6319 => 0.6183, std.dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.44% (16.9767 => 16.2236, std.dev.: 0.1772) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.20% (1.5942 => 1.5751, std.dev.: 0.0056) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.06% (16.5307 => 16.5409, std.dev.: 0.0254) MultiSource/Applications/obsequi/Obsequi: -0.96% (1.0614 => 1.0512, std.dev.: 0.0110) MultiSource/Applications/sqlite3/sqlite3: -0.87% (0.6409 => 0.6353, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/08-main/main: 0.94% (0.1924 => 0.1942, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.53% (0.1700 => 0.1726, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.06% (0.3210 => 0.3244, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.85% (0.2468 => 0.2447, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.54% (0.3360 => 0.3342, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.58% (0.2420 => 0.2434, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 0.55% (0.5977 => 0.6010, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: 4.65% (0.0452 => 0.0473, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.45% (0.3249 => 0.3296, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 0.60% (0.1985 => 0.1997, std.dev.: 0.0012) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.43% (0.0234 => 0.0233, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -6.81% (0.0191 => 0.0178, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -10.57% (0.0388 => 0.0347, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 2.58% (0.0310 => 0.0318, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 22.44% (0.0254 => 0.0311, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.29% (0.0346 => 0.0347, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/casts: 47.24% (0.0127 => 0.0187, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/test1: -12.15% (0.0181 => 0.0159, std.dev.: 0.0023) SingleSource/UnitTests/byval-alignment: 3.36% (0.0327 => 0.0338, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -1.08% (0.1482 => 0.1466, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 2.19% (1.1117 => 1.1360, std.dev.: 0.0060) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.77% (0.1431 => 0.1442, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.39% (0.4034 => 0.4090, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.07% (0.1355 => 0.1327, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.78% (0.0638 => 0.0633, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -9.24% (0.0249 => 0.0226, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.12% (0.0538 => 0.0544, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.28% (1.1414 => 1.1382, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.75% (0.0535 => 0.0539, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.39% (0.0226 => 0.0198, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.13% (0.7957 => 0.7967, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -2.70% (0.0037 => 0.0036, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.72% (2.1832 => 1.6654, std.dev.: 0.0040) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.68% (0.0810 => 0.0937, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/tsp/tsp: 9.53% (0.1112 => 0.1218, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.57% (0.3137 => 0.3343, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.45% (0.2279 => 0.2426, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.01% (0.2180 => 0.2311, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.50% (0.1983 => 0.2092, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.41% (0.8321 => 0.8771, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.25% (0.1905 => 0.2005, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.78% (0.7473 => 0.7830, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.64% (0.4847 => 0.5072, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.45% (0.2519 => 0.2631, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.08% (0.5961 => 0.6204, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.02% (1.1685 => 1.2155, std.dev.: 0.0063) MultiSource/Applications/spiff/spiff: 3.62% (0.7950 => 0.8238, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.57% (0.2998 => 0.3105, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.50% (1.1606 => 1.2012, std.dev.: 0.0095) MultiSource/Applications/Burg/burg: 3.39% (1.2222 => 1.2636, std.dev.: 0.0131) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.20% (0.8148 => 0.8409, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.17% (0.9435 => 0.9734, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.88% (0.3717 => 0.3824, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.88% (0.6010 => 0.6183, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.87% (0.8611 => 0.8858, std.dev.: 0.0041) MultiSource/Applications/minisat/minisat: 2.59% (0.6834 => 0.7011, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.49% (1.6386 => 1.6794, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.47% (0.4127 => 0.4229, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.40% (0.4783 => 0.4898, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.34% (0.8420 => 0.8617, std.dev.: 0.0056) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.32% (6.6074 => 6.7604, std.dev.: 0.0156) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.28% (13.1811 => 13.4822, std.dev.: 0.0405) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.05% (4.1763 => 4.2620, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.02% (0.8261 => 0.8428, std.dev.: 0.0033) MultiSource/Applications/ClamAV/clamscan: 2.00% (14.7684 => 15.0643, std.dev.: 0.0586) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.00% (0.9688 => 0.9882, std.dev.: 0.0072) MultiSource/Benchmarks/Bullet/bullet: 1.88% (31.8598 => 32.4573, std.dev.: 0.1363) MultiSource/Applications/lua/lua: 1.87% (3.8189 => 3.8902, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.79% (1.2526 => 1.2750, std.dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 1.77% (0.9810 => 0.9984, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.76% (4.4873 => 4.5662, std.dev.: 0.0181) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.73% (0.6586 => 0.6700, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 1.67% (4.1305 => 4.1995, std.dev.: 0.0219) MultiSource/Benchmarks/mafft/pairlocalalign: 1.63% (8.6247 => 8.7655, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.53% (0.8317 => 0.8444, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.42% (8.6476 => 8.7701, std.dev.: 0.0402) MultiSource/Applications/SIBsim4/SIBsim4: 1.42% (1.2568 => 1.2746, std.dev.: 0.0053) MultiSource/Applications/SPASS/SPASS: 1.36% (14.2605 => 14.4543, std.dev.: 0.0645) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.31% (0.8086 => 0.8192, std.dev.: 0.0041) MultiSource/Applications/siod/siod: 1.25% (2.2184 => 2.2462, std.dev.: 0.0075) MultiSource/Applications/JM/lencod/lencod: 1.24% (15.3280 => 15.5182, std.dev.: 0.0507) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.23% (3.1832 => 3.2225, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.22% (2.1401 => 2.1662, std.dev.: 0.0066) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.21% (4.4880 => 4.5422, std.dev.: 0.0145) MultiSource/Applications/oggenc/oggenc: 1.06% (4.9628 => 5.0152, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.04% (1.5315 => 1.5475, std.dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.68% (1.5795 => 2.5064, std.dev.: 0.0071) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.78% (14.6451 => 16.2236, std.dev.: 0.1772) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.76% (0.3186 => 0.3465, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.67% (1.1857 => 1.2766, std.dev.: 0.0050) MultiSource/Benchmarks/mafft/pairlocalalign: 5.93% (63.1822 => 66.9278, std.dev.: 0.1423) SingleSource/Benchmarks/Dhrystone/dry: 3.64% (0.5081 => 0.5266, std.dev.: 0.0015) MultiSource/Applications/siod/siod: 2.70% (3.6643 => 3.7633, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.35% (2.4490 => 2.5066, std.dev.: 0.0149) SingleSource/Benchmarks/Misc/ReedSolomon: 2.25% (8.5322 => 8.7239, std.dev.: 0.0418) SingleSource/Benchmarks/Shootout-C++/hash: 1.76% (0.6205 => 0.6314, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 1.66% (3.9188 => 3.9840, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.25% (4.8362 => 4.8966, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout/matrix: 1.11% (1.5671 => 1.5845, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/five11/five11: 1.03% (5.6030 => 5.6607, std.dev.: 0.0053) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -8.14% (3.2926 => 3.0245, std.dev.: 0.0202) MultiSource/Applications/lua/lua: -5.19% (29.8330 => 28.2843, std.dev.: 0.0214) SingleSource/Benchmarks/Shootout-C++/hash2: -1.73% (3.4237 => 3.3644, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.24% (3.3479 => 3.3063, std.dev.: 0.0011) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.58% (16.4461 => 16.5409, std.dev.: 0.0254) MultiSource/Applications/obsequi/Obsequi: 2.44% (1.0262 => 1.0512, std.dev.: 0.0110) MultiSource/Applications/sqlite3/sqlite3: 0.33% (0.6332 => 0.6353, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/08-main/main: 6.06% (0.1831 => 0.1942, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.71% (0.1559 => 0.1726, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.87% (0.3123 => 0.3244, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.65% (0.2463 => 0.2447, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.06% (0.3344 => 0.3342, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.96% (0.2364 => 0.2434, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.6010 => 0.6010, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: 10.26% (0.0429 => 0.0473, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.92% (0.3266 => 0.3296, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 1.42% (0.1969 => 0.1997, std.dev.: 0.0012) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.02% (0.0224 => 0.0233, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 44.72% (0.0123 => 0.0178, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -14.95% (0.0408 => 0.0347, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 25.20% (0.0254 => 0.0318, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.98% (0.0302 => 0.0311, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -9.64% (0.0384 => 0.0347, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/casts: -1.58% (0.0190 => 0.0187, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/test1: -11.67% (0.0180 => 0.0159, std.dev.: 0.0023) SingleSource/UnitTests/byval-alignment: 46.96% (0.0230 => 0.0338, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.95% (0.1438 => 0.1466, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.27% (1.1329 => 1.1360, std.dev.: 0.0060) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.37% (0.1462 => 0.1442, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.78% (0.4164 => 0.4090, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.07% (0.1369 => 0.1327, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.25% (0.0641 => 0.0633, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 15.90% (0.0195 => 0.0226, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.88% (0.0578 => 0.0544, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.48% (1.1437 => 1.1382, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.04% (0.0627 => 0.0539, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 10.00% (0.0180 => 0.0198, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.62% (0.8017 => 0.7967, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -41.94% (0.0062 => 0.0036, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 02:02:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 04:02:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121026090209.D86D32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5241?compare_to=5236&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5241, Order: 166759, Start Time: 2012-10-26 07:38:39, End Time: 2012-10-26 09:02:05 To: 5236, Order: 166755, Start Time: 2012-10-26 05:41:44, End Time: 2012-10-26 07:05:48 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (73 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 3 (196 on baseline) Performance Improvements: 0 (51 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 75 (2 on baseline) Unchanged Tests: 964 (641 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.37% (78.1965 => 80.8315, std.dev.: 0.0856) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.08% (54.2691 => 55.9430, std.dev.: 0.2802) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.05% (42.1061 => 42.9677, std.dev.: 0.0683) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0486 => 0.0486, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.41% (0.0490 => 0.0488) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0456 => 0.0456) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0457 => 0.0457, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0445 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.22% (0.0448 => 0.0447, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.23% (0.0440 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0441 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0457 => 0.0457, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0458 => 0.0458, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0451 => 0.0451, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0453 => 0.0453, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0441 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0443 => 0.0443, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0449 => 0.0449, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0450 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0460 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.38% (0.0462 => 0.0473, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.23% (0.0437 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0438 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0449 => 0.0449, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0450 => 0.0450, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0440 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0442 => 0.0442, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.23% (0.0433 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0433 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0431 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0433 => 0.0433) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0468 => 0.0468) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0469 => 0.0469, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.23% (0.0430 => 0.0431) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0431 => 0.0431) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0431 => 0.0431) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.23% (0.0433 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0439 => 0.0439) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0440 => 0.0440, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/BenchmarkGame/puzzle MultiSource/Applications/oggenc/oggenc: - (0.1407 => 0.1407, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.41% (0.0665 => 0.0649, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.03% (0.3825 => 0.3826, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.04% (0.6962 => 0.3826, std.dev.: 0.0000) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 203.58% (0.5229 => 1.5874, std.dev.: 0.0037) MultiSource/Applications/SPASS/SPASS: 16.20% (14.9895 => 17.4172, std.dev.: 0.0097) MultiSource/Applications/kimwitu++/kc: 37.47% (14.1553 => 19.4599, std.dev.: 0.0290) MultiSource/Benchmarks/MallocBench/gs/gs: 14.07% (4.1105 => 4.6888, std.dev.: 0.0161) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 35.85% (1.1048 => 1.5009, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 318.94% (7.1582 => 29.9888, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.81% (3.4629 => 5.8458, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++/stepanov_container: 67.61% (0.6222 => 1.0429, std.dev.: 0.0008) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 11826.25% (0.0720 => 8.5869, std.dev.: 0.0066) MultiSource/Applications/SIBsim4/SIBsim4: 4015400.00% (0.0001 => 4.0155, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 11144700.00% (0.0001 => 11.1448, std.dev.: 0.0123) MultiSource/Applications/kimwitu++/kc: 50700.00% (0.0001 => 0.0508, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 63200.00% (0.0001 => 0.0633, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 792400.00% (0.0001 => 0.7925, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050500.00% (0.0001 => 10.0506, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5489100.00% (0.0001 => 5.4892, std.dev.: 0.0187) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 69.53% (0.0256 => 0.0434) SingleSource/Regression/C/sumarraymalloc: 57.20% (0.0243 => 0.0382) SingleSource/Regression/C/sumarray2d: 54.98% (0.0271 => 0.0420, std.dev.: 0.0009) SingleSource/Regression/C/sumarray: 45.45% (0.0231 => 0.0336, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 42.25% (1.5859 => 2.2560, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: 40.62% (0.1056 => 0.1485, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 36.70% (10.3673 => 14.1723, std.dev.: 0.0095) SingleSource/UnitTests/vla: 34.08% (0.0355 => 0.0476, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 31.34% (2.2024 => 2.8926, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 29.33% (0.1432 => 0.1852, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 29.12% (0.1463 => 0.1889, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 25.02% (0.1655 => 0.2069, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 24.34% (0.0834 => 0.1037, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.90% (0.1566 => 0.1909, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/hash: 21.65% (0.0485 => 0.0590, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 21.33% (0.2049 => 0.2486, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 20.14% (0.5105 => 0.6133, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.52% (0.0871 => 0.1041, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 19.41% (0.4879 => 0.5826, std.dev.: 0.0068) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 19.23% (0.3177 => 0.3788, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 19.23% (0.1555 => 0.1854, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 18.49% (0.0730 => 0.0865, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 18.36% (0.0746 => 0.0883, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 18.17% (0.2554 => 0.3018, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/tsp/tsp: 18.13% (0.1175 => 0.1388, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.13% (0.6675 => 0.7885, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 18.08% (0.0730 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 17.88% (0.2271 => 0.2677, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.78% (0.0793 => 0.0934, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.75% (0.3121 => 0.3675, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout/lists: 17.57% (0.0626 => 0.0736) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.48% (1.3050 => 1.5331, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.40% (0.1029 => 0.1208, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/em3d/em3d: 17.29% (0.1695 => 0.1988, std.dev.: 0.0021) MultiSource/Applications/d/make_dparser: 17.12% (3.3354 => 3.9063, std.dev.: 0.0095) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.78% (0.8172 => 0.9543, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/mst/mst: 16.77% (0.1163 => 0.1358, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.67% (0.1032 => 0.1204) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 16.53% (0.1337 => 0.1558, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 16.50% (0.7115 => 0.8289, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.49% (1.5415 => 1.7957, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/ft/ft: 16.39% (0.1940 => 0.2258, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.36% (0.4615 => 0.5370, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.28% (0.2107 => 0.2450, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 16.24% (1.1840 => 1.3763, std.dev.: 0.0066) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 16.15% (0.0842 => 0.0978, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.14% (0.0886 => 0.1029, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.14% (0.5020 => 0.5830, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/ks/ks: 16.09% (0.1510 => 0.1753, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 16.07% (0.1151 => 0.1336, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.00% (0.0675 => 0.0783, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.94% (0.1625 => 0.1884, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.84% (0.2065 => 0.2392, std.dev.: 0.0021) MultiSource/Applications/sgefa/sgefa: 15.79% (0.3109 => 0.3600, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.63% (0.0838 => 0.0969, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.59% (0.2758 => 0.3188, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/exptree: 15.36% (0.0814 => 0.0939, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 15.29% (0.1236 => 0.1425, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 15.28% (0.1584 => 0.1826, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 15.09% (1.1642 => 1.3399, std.dev.: 0.0108) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 15.06% (0.1906 => 0.2193, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.97% (4.2646 => 4.9028, std.dev.: 0.0085) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.96% (0.1143 => 0.1314, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.95% (0.1117 => 0.1284, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.94% (0.0770 => 0.0885, std.dev.: 0.0017) MultiSource/Applications/spiff/spiff: 14.92% (0.7835 => 0.9004, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 14.88% (0.0672 => 0.0772, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.84% (0.9765 => 1.1214, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.81% (0.2700 => 0.3100, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 14.69% (0.3423 => 0.3926, std.dev.: 0.0032) SingleSource/UnitTests/SignlessTypes/rem: 14.51% (0.1144 => 0.1310, std.dev.: 0.0029) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.49% (0.1125 => 0.1288, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.40% (0.5981 => 0.6842, std.dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: 14.40% (0.7433 => 0.8503, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.39% (0.6450 => 0.7378, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 14.31% (9.4845 => 10.8417, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.29% (0.0798 => 0.0912, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.22% (0.1062 => 0.1213, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.22% (0.1695 => 0.1936, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 14.06% (2.0273 => 2.3124, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.92% (0.5860 => 0.6676, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.89% (1.4186 => 1.6156, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.88% (0.8067 => 0.9187, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.83% (0.0933 => 0.1062, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.77% (0.0770 => 0.0876, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.76% (8.1363 => 9.2560, std.dev.: 0.0117) MultiSource/Benchmarks/McCat/09-vor/vor: 13.68% (0.3180 => 0.3615, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.63% (0.5569 => 0.6328, std.dev.: 0.0032) MultiSource/Applications/lemon/lemon: 13.59% (1.0722 => 1.2179, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.56% (0.0929 => 0.1055, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 13.42% (0.4299 => 0.4876, std.dev.: 0.0021) MultiSource/Applications/lua/lua: 13.40% (3.8723 => 4.3912, std.dev.: 0.0154) MultiSource/Benchmarks/Olden/health/health: 13.33% (0.1268 => 0.1437, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.31% (0.3307 => 0.3747, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.14% (0.2603 => 0.2945, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.12% (0.1044 => 0.1181, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.93% (0.3441 => 0.3886, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/football/football: 12.83% (0.8921 => 1.0066, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.81% (4.9449 => 5.5784, std.dev.: 0.0140) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.70% (5.0018 => 5.6371, std.dev.: 0.0102) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.63% (0.1330 => 0.1498, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.48% (1.1861 => 1.3341, std.dev.: 0.0025) MultiSource/Benchmarks/sim/sim: 12.46% (0.3387 => 0.3809, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 12.45% (0.3092 => 0.3477, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.20% (0.8101 => 0.9089, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 11.87% (0.3927 => 0.4393, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 11.86% (5.7591 => 6.4421, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/trivial-interface: 11.78% (0.3473 => 0.3882, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.74% (0.3543 => 0.3959, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.74% (0.3543 => 0.3959, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 11.60% (0.3828 => 0.4272, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.57% (0.3561 => 0.3973, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.52% (0.3497 => 0.3900, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.52% (0.3516 => 0.3921, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 11.51% (2.2969 => 2.5613, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/for-in: 11.48% (0.3694 => 0.4118, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 11.45% (0.6456 => 0.7195, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.30% (0.3886 => 0.4325, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.21% (0.1892 => 0.2104, std.dev.: 0.0045) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 11.12% (0.0953 => 0.1059, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 11.07% (0.4289 => 0.4764, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 10.93% (0.4620 => 0.5125, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.85% (0.4103 => 0.4548, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.74% (0.3826 => 0.4237, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.61% (2.2022 => 2.4358, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 10.52% (0.3422 => 0.3782, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.38% (0.3865 => 0.4266, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.33% (0.4203 => 0.4637, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 10.26% (1.5603 => 1.7204, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/lists1: 10.26% (0.3684 => 0.4062, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 9.86% (21.9371 => 24.1002, std.dev.: 0.0339) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.77% (0.4636 => 0.5089, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/moments: 9.66% (0.4048 => 0.4439, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 9.44% (0.3603 => 0.3943, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.38% (0.5925 => 0.6481, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.38% (0.2430 => 0.2658, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference-object: 9.30% (0.6030 => 0.6591, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.19% (0.3427 => 0.3742, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 9.03% (17.1811 => 18.7329, std.dev.: 0.0225) SingleSource/Benchmarks/Shootout-C++/matrix: 8.75% (0.3098 => 0.3369, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.69% (0.4064 => 0.4417, std.dev.: 0.0046) SingleSource/UnitTests/ObjC++/property-reference: 8.59% (0.7326 => 0.7955, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.58% (0.3650 => 0.3963, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.55% (3.8922 => 4.2249, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.44% (0.3162 => 0.3429, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.41% (14.3668 => 15.5751, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/strcat: 8.34% (0.2831 => 0.3067, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 8.22% (0.3283 => 0.3553, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.22% (0.2872 => 0.3108, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 8.12% (0.2871 => 0.3104, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 8.11% (0.3232 => 0.3494, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 8.09% (0.2905 => 0.3140, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.06% (0.2891 => 0.3124, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.93% (2.0665 => 2.2303, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.88% (0.2793 => 0.3013, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.80% (0.2756 => 0.2971, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 7.78% (0.2725 => 0.2937, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 7.65% (0.2877 => 0.3097, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 7.63% (0.3052 => 0.3285, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 7.53% (0.3282 => 0.3529, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 7.46% (0.2802 => 0.3011, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hello: 7.37% (0.2714 => 0.2914, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 7.21% (1.2842 => 1.3768, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary2: 7.16% (0.3379 => 0.3621, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 7.15% (10.4361 => 11.1825, std.dev.: 0.0262) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.88% (0.2266 => 0.2422, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.31% (0.3136 => 0.3334, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.22% (7.9617 => 8.4572, std.dev.: 0.0213) SingleSource/Benchmarks/Shootout-C++/objinst: 5.75% (0.3131 => 0.3311, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.12% (0.3935 => 0.4097, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.01% (0.3817 => 0.3970, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.82% (7.0540 => 7.3234, std.dev.: 0.0100) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 31.36% (10.2830 => 13.5080, std.dev.: 0.0132) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1726, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 14.09% (2.6778 => 3.0550, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.37% (0.9957 => 1.1288, std.dev.: 0.0219) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 10.03% (1.1396 => 1.2539, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3685, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.65% (2.8904 => 3.0825, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.23% (0.3463 => 0.3644, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 3.79% (1.9405 => 2.0140, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.21% (0.3987 => 0.4115, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.58% (4.2280 => 4.3370, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.81% (0.8333 => 0.8484, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2077, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.50% (11.6436 => 11.8178, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.18% (2.6546 => 2.6859, std.dev.: 0.0020) MultiSource/Applications/viterbi/viterbi: 1.10% (4.4649 => 4.5140, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.09% (6.5088 => 6.5796, std.dev.: 0.0080) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.93% (6.6874 => 0.1381, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -82.52% (0.8651 => 0.1512, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -52.42% (5.2763 => 2.5105, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -45.07% (0.1622 => 0.0891, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -41.00% (5.3855 => 3.1772, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.52% (5.3526 => 3.1838, std.dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -8.85% (54.1659 => 49.3741, std.dev.: 0.0109) MultiSource/Benchmarks/Bullet/bullet: -8.21% (63.2438 => 58.0498, std.dev.: 0.0695) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.05% (1.7609 => 1.6192, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.75% (2.9384 => 2.7988, std.dev.: 0.0038) MultiSource/Applications/ClamAV/clamscan: -4.73% (22.1758 => 21.1260, std.dev.: 0.0590) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.71% (1.1194 => 1.0667, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -52.86% (8.0499 => 3.7950, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -43.00% (0.0400 => 0.0228, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7653, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -28.77% (10.7105 => 7.6292, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4750, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -16.22% (1.6925 => 1.4180, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.73% (1.2258 => 1.0697, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -12.16% (1.2373 => 1.0869, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/mandel-2: -10.77% (1.5373 => 1.3717, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.29% (19.9488 => 18.2944, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.99% (1.8329 => 1.7047, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -6.52% (0.2161 => 0.2020, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5758, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8479, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -5.46% (6.6465 => 6.2838, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: -4.96% (1.5835 => 1.5050, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.92% (1.6805 => 1.5978, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.39% (8.1563 => 7.7983, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.73% (1.3677 => 1.3167, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1627, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -3.33% (5.0483 => 4.8804, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.14% (32.5116 => 31.4913, std.dev.: 0.0063) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.89% (0.4808 => 0.4669, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6821, std.dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -1.68% (2.5528 => 2.5100, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -1.46% (9.5636 => 9.4239, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: -1.40% (4.6441 => 4.5790, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.09% (6.2999 => 6.2315, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8577, std.dev.: 0.0103) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -5.25% (0.1485 => 0.1407, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0044) Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 02:44:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 04:44:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121026094447.6463C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5242?compare_to=5239&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5242, Order: 166760, Start Time: 2012-10-26 08:19:49, End Time: 2012-10-26 09:44:42 To: 5239, Order: 166755, Start Time: 2012-10-26 06:29:00, End Time: 2012-10-26 07:56:14 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 1 (181 on baseline) Unchanged Tests: 1040 (856 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.30% (54.7252 => 56.5335, std.dev.: 0.0365) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.48% (81.2241 => 78.4014, std.dev.: 1.0906) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.59% (54.5751 => 56.5335, std.dev.: 0.0365) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.66% (2.0478 => 2.1023, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/salsa20: 2.56% (7.4937 => 7.6856, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash2: 2.15% (3.1932 => 3.2620, std.dev.: 0.0117) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.08% (0.1431 => 0.1301, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.03% (0.3821 => 0.3514, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -7.47% (2.4924 => 2.3063, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: -7.04% (0.3880 => 0.3607, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.03% (0.3884 => 0.3611, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -7.02% (0.3831 => 0.3562, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -7.02% (0.3848 => 0.3578, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -6.98% (0.3812 => 0.3546, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -6.97% (0.3357 => 0.3123, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.94% (0.4033 => 0.3753, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -6.90% (0.3896 => 0.3627, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.89% (0.3891 => 0.3623, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.87% (0.3142 => 0.2926, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: -6.80% (0.4176 => 0.3892, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.80% (0.2428 => 0.2263, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.75% (0.3658 => 0.3411, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.69% (22.4056 => 20.9064, std.dev.: 0.0089) MultiSource/Benchmarks/MallocBench/gs/gs: -6.63% (4.3330 => 4.0456, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/property: -6.62% (0.4199 => 0.3921, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: -6.59% (0.4280 => 0.3998, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -6.58% (7.0961 => 6.6295, std.dev.: 0.0206) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.57% (3.5339 => 3.3017, std.dev.: 0.0122) MultiSource/Benchmarks/McCat/08-main/main: -6.54% (0.2659 => 0.2485, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: -6.54% (1.2515 => 1.1697, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.53% (0.9542 => 0.8919, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.53% (0.4151 => 0.3880, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -6.51% (9.2283 => 8.6272, std.dev.: 0.0083) MultiSource/Applications/JM/lencod/lencod: -6.51% (16.1920 => 15.1374, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/ReedSolomon: -6.44% (0.1879 => 0.1758, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: -6.44% (0.9179 => 0.8588, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/oourafft: -6.44% (0.2160 => 0.2021, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -6.42% (1.3148 => 1.2304, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.41% (0.2355 => 0.2204, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.41% (0.1716 => 0.1606, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.40% (0.1796 => 0.1681, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.38% (0.1584 => 0.1483, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.35% (0.6484 => 0.6072, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.35% (1.6474 => 1.5428, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.35% (0.2695 => 0.2524, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.34% (0.7919 => 0.7417, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.33% (0.3931 => 0.3682, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.32% (6.7716 => 6.3438, std.dev.: 0.0037) MultiSource/Applications/lemon/lemon: -6.31% (1.1450 => 1.0727, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -6.31% (4.0594 => 3.8031, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.29% (5.4682 => 5.1240, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.29% (1.4642 => 1.3721, std.dev.: 0.0012) MultiSource/Applications/siod/siod: -6.29% (2.4021 => 2.2511, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.28% (1.3722 => 1.2860, std.dev.: 0.0104) MultiSource/Benchmarks/nbench/nbench: -6.28% (1.1530 => 1.0806, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/except: -6.28% (0.3026 => 0.2836, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.28% (1.2300 => 1.1528, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.25% (4.5069 => 4.2250, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.22% (4.0323 => 3.7814, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.20% (0.9852 => 0.9241, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.19% (1.2784 => 1.1993, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.18% (0.3849 => 0.3611, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.18% (0.6293 => 0.5904, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: -6.18% (0.3446 => 0.3233, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.17% (1.6364 => 1.5354, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -6.14% (0.3323 => 0.3119, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.13% (4.8161 => 4.5211, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.12% (0.3837 => 0.3602, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/matrix: -6.11% (0.3255 => 0.3056, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: -6.11% (0.4861 => 0.4564, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -6.11% (0.4321 => 0.4057, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: -6.10% (0.3394 => 0.3187, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.10% (0.4083 => 0.3834, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -6.10% (0.7447 => 0.6993, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.09% (4.8802 => 4.5828, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: -6.09% (0.2989 => 0.2807, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.08% (0.3025 => 0.2841, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -6.08% (0.4524 => 0.4249, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.07% (2.2587 => 2.1216, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.07% (0.4813 => 0.4521, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -6.06% (0.3481 => 0.3270, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -6.06% (0.3581 => 0.3364, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -6.05% (34.0927 => 32.0292, std.dev.: 0.0221) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.04% (0.2548 => 0.2394, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.03% (1.0544 => 0.9908, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: -6.03% (0.2985 => 0.2805, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.03% (2.1713 => 2.0404, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: -6.03% (0.2871 => 0.2698, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.02% (0.5999 => 0.5638, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wordfreq: -6.02% (0.3491 => 0.3281, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -6.01% (0.3194 => 0.3002, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: -6.01% (0.4427 => 0.4161, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.00% (0.6736 => 0.6332, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: -5.99% (0.3788 => 0.3561, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.99% (14.2083 => 13.3576, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.99% (0.3057 => 0.2874, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -5.97% (15.5079 => 14.5823, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/lists: -5.97% (0.3621 => 0.3405, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.96% (0.2903 => 0.2730, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -5.94% (0.6750 => 0.6349, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -5.93% (0.3406 => 0.3204, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.92% (0.7198 => 0.6772, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: -5.89% (1.3864 => 1.3047, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/05-eks/eks: -5.89% (0.4515 => 0.4249, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: -5.89% (0.2939 => 0.2766, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.87% (0.3252 => 0.3061, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: -5.87% (0.3867 => 0.3640, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.86% (0.2933 => 0.2761, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -5.85% (18.2933 => 17.2224, std.dev.: 0.0106) SingleSource/UnitTests/ObjC++/property-reference: -5.84% (0.7779 => 0.7325, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/moments: -5.81% (0.4248 => 0.4001, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.81% (1.2221 => 1.1511, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.80% (1.2210 => 1.1502, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hello: -5.79% (0.2849 => 0.2684, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.77% (0.3016 => 0.2842, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -5.76% (17.1032 => 16.1173, std.dev.: 0.0093) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.74% (0.4916 => 0.4634, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.74% (0.2999 => 0.2827, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.72% (0.5591 => 0.5271, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -5.72% (2.1401 => 2.0177, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.72% (0.5805 => 0.5473, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.70% (0.5925 => 0.5587, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -5.70% (15.2527 => 14.3834, std.dev.: 0.0193) SingleSource/Benchmarks/Shootout-C++/wc: -5.68% (0.3205 => 0.3023, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: -5.68% (3.5154 => 3.3159, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.67% (0.5168 => 0.4875, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.66% (0.6304 => 0.5947, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.64% (0.5705 => 0.5383, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.64% (0.7339 => 0.6925, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.64% (8.0126 => 7.5609, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.62% (0.5478 => 0.5170, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.62% (0.2385 => 0.2251, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.62% (0.6230 => 0.5880, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.61% (0.6395 => 0.6036, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.60% (0.5859 => 0.5531, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.60% (0.9557 => 0.9022, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.60% (0.6681 => 0.6307, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.59% (0.6297 => 0.5945, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.58% (0.7524 => 0.7104, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.58% (0.2278 => 0.2151, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.57% (0.8521 => 0.8046, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.55% (0.5857 => 0.5532, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.53% (0.5802 => 0.5481, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.52% (0.6667 => 0.6299, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.51% (0.3483 => 0.3291, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.51% (0.6260 => 0.5915, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.51% (0.6189 => 0.5848, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.51% (0.2106 => 0.1990, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.51% (0.6194 => 0.5853, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -5.50% (0.3271 => 0.3091, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.50% (0.6052 => 0.5719, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.49% (0.6446 => 0.6092, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.48% (0.6660 => 0.6295, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.45% (0.3319 => 0.3138, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.45% (0.6440 => 0.6089, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -5.45% (0.6441 => 0.6090, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.44% (0.5329 => 0.5039, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.44% (0.6395 => 0.6047, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.44% (0.5863 => 0.5544, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.44% (0.5569 => 0.5266, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -5.44% (0.7982 => 0.7548, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.44% (0.5941 => 0.5618, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.43% (0.5581 => 0.5278, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: -5.43% (0.8418 => 0.7961, std.dev.: 0.0028) SingleSource/Regression/C++/ofstream_ctor: -5.43% (0.3059 => 0.2893, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.43% (0.7021 => 0.6640, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.42% (0.6676 => 0.6314, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -5.42% (0.6347 => 0.6003, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.42% (0.5575 => 0.5273, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.39% (0.6033 => 0.5708, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.36% (0.5688 => 0.5383, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.32% (0.5567 => 0.5271, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.31% (0.5570 => 0.5274, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.24% (0.5456 => 0.5170, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.18% (0.5849 => 0.5546, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.77% (0.9077 => 0.8644, std.dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: -4.53% (5.0226 => 4.7952, std.dev.: 0.0049) MultiSource/Applications/hbd/hbd: -4.47% (1.5610 => 1.4913, std.dev.: 0.0063) SingleSource/UnitTests/Vector/constpool: -3.56% (20.7746 => 20.0350, std.dev.: 0.0249) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7548, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: -8.62% (1.2842 => 1.1735, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7067, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.81% (2.2633 => 2.1770, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.54% (1.3096 => 1.2764, std.dev.: 0.0110) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4723, std.dev.: 0.0051) Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 03:32:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 05:32:35 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121026103235.7386F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5243?compare_to=5240&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5243, Order: 166760, Start Time: 2012-10-26 09:07:59, End Time: 2012-10-26 10:32:32 To: 5240, Order: 166759, Start Time: 2012-10-26 07:27:32, End Time: 2012-10-26 08:51:02 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 5 (71 on baseline) Performance Improvements: 3 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 967 (899 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 2.61% (1.4547 => 1.4927, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.78% (1.3458 => 1.3697, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.40% (4.5899 => 4.6540, std.dev.: 0.0148) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 1.99% (8.8345 => 9.0106, std.dev.: 0.0358) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.21% (1.5751 => 1.5941, std.dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.88% (16.2236 => 14.7824, std.dev.: 0.3396) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.34% (7.3053 => 7.1340, std.dev.: 0.0198) SingleSource/Benchmarks/Shootout/matrix: -1.56% (1.5845 => 1.5598, std.dev.: 0.0054) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.01% (16.5409 => 16.5385, std.dev.: 0.2190) MultiSource/Applications/obsequi/Obsequi: 0.32% (1.0512 => 1.0546, std.dev.: 0.0117) MultiSource/Applications/sqlite3/sqlite3: 1.01% (0.6353 => 0.6417, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/08-main/main: -0.77% (0.1942 => 0.1927, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.27% (0.1726 => 0.1704, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.55% (0.3244 => 0.3262, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.33% (0.2447 => 0.2504, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.05% (0.3342 => 0.3377, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.60% (0.2434 => 0.2395, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: -0.03% (0.6010 => 0.6008, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel: 1.27% (0.0473 => 0.0479, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.21% (0.3296 => 0.3303, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/strcat: 0.50% (0.1997 => 0.2007, std.dev.: 0.0042) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.87% (0.0233 => 0.0249, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 21.91% (0.0178 => 0.0217, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.03% (0.0347 => 0.0333, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 3.46% (0.0318 => 0.0329, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.29% (0.0311 => 0.0315, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 21.90% (0.0347 => 0.0423, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: 8.56% (0.0187 => 0.0203, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -18.87% (0.0159 => 0.0129, std.dev.: 0.0042) SingleSource/UnitTests/byval-alignment: -0.30% (0.0338 => 0.0337, std.dev.: 0.0022) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.82% (0.1466 => 0.1478, std.dev.: 0.0040) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -2.07% (1.1360 => 1.1125, std.dev.: 0.0350) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 5.34% (0.1442 => 0.1519, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.22% (0.4090 => 0.3999, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.11% (0.1327 => 0.1299, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.05% (0.0633 => 0.0646, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 22.57% (0.0226 => 0.0277, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.78% (0.0544 => 0.0570, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.66% (1.1382 => 1.1457, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 16.88% (0.0539 => 0.0630, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 34.85% (0.0198 => 0.0267) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.54% (0.7967 => 0.8010, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 186.11% (0.0036 => 0.0103, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.82% (2.1832 => 1.6632, std.dev.: 0.0056) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.16% (0.0810 => 0.0949, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 12.41% (0.1112 => 0.1250, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/04-bisect/bisect: 8.80% (0.1137 => 0.1237, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.47% (0.2279 => 0.2472, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.26% (0.2180 => 0.2360, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.91% (0.8321 => 0.8979, std.dev.: 0.0082) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.53% (0.3137 => 0.3342, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.36% (0.7473 => 0.7948, std.dev.: 0.0088) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.00% (0.1983 => 0.2102, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.99% (0.1885 => 0.1998, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.94% (0.4847 => 0.5135, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.46% (0.6010 => 0.6338, std.dev.: 0.0079) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.20% (0.8148 => 0.8572, std.dev.: 0.0139) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.13% (0.2240 => 0.2355, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.89% (1.1606 => 1.2173, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.87% (0.2998 => 0.3144, std.dev.: 0.0031) MultiSource/Applications/hbd/hbd: 4.61% (1.4269 => 1.4927, std.dev.: 0.0067) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.42% (0.2378 => 0.2483, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.33% (0.7950 => 0.8294, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.12% (0.6287 => 0.6546, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.09% (1.1685 => 1.2163, std.dev.: 0.0076) MultiSource/Applications/Burg/burg: 3.95% (1.2222 => 1.2705, std.dev.: 0.0185) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.79% (0.3295 => 0.3420, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.74% (0.3717 => 0.3856, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.72% (0.4783 => 0.4961, std.dev.: 0.0028) MultiSource/Applications/sgefa/sgefa: 3.57% (0.2999 => 0.3106, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.52% (0.9435 => 0.9767, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.42% (0.4127 => 0.4268, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.15% (1.3279 => 1.3697, std.dev.: 0.0049) MultiSource/Applications/treecc/treecc: 2.99% (1.9948 => 2.0544, std.dev.: 0.0167) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.80% (6.6074 => 6.7927, std.dev.: 0.0259) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.80% (1.4479 => 1.4885, std.dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 2.56% (1.1271 => 1.1559, std.dev.: 0.0098) MultiSource/Applications/lua/lua: 2.47% (3.8189 => 3.9134, std.dev.: 0.0134) MultiSource/Benchmarks/MallocBench/gs/gs: 2.47% (4.1305 => 4.2326, std.dev.: 0.0215) MultiSource/Applications/minisat/minisat: 2.41% (0.6834 => 0.6999, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.41% (0.5817 => 0.5957, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.39% (0.9908 => 1.0145, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.23% (4.1763 => 4.2695, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.15% (0.8457 => 0.8639, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.11% (0.7966 => 0.8134, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.09% (8.6476 => 8.8283, std.dev.: 0.0641) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.07% (4.4873 => 4.5804, std.dev.: 0.0225) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.05% (0.9688 => 0.9887, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.05% (1.2423 => 1.2678, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.03% (0.9069 => 0.9253, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.99% (0.8697 => 0.8870, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.94% (0.6227 => 0.6348, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.93% (4.4880 => 4.5747, std.dev.: 0.0238) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.92% (0.8656 => 0.8822, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.91% (13.1811 => 13.4324, std.dev.: 0.0757) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.89% (0.8286 => 0.8443, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.84% (1.2526 => 1.2757, std.dev.: 0.0079) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.83% (4.5702 => 4.6540, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.82% (0.8069 => 0.8216, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.82% (0.8086 => 0.8233, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.80% (0.8204 => 0.8352, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.75% (1.1170 => 1.1366, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.61% (0.8177 => 0.8309, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.61% (1.6386 => 1.6649, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.52% (0.8331 => 0.8458, std.dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 1.20% (8.6247 => 8.7284, std.dev.: 0.0370) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.48% (1.5795 => 2.5032, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.14% (0.3186 => 0.3509, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.73% (1.1857 => 1.2773, std.dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: 5.93% (63.1822 => 66.9297, std.dev.: 0.0464) SingleSource/Benchmarks/Dhrystone/dry: 3.35% (0.5081 => 0.5251, std.dev.: 0.0045) MultiSource/Applications/siod/siod: 2.80% (3.6643 => 3.7668, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/ReedSolomon: 2.12% (8.5322 => 8.7130, std.dev.: 0.0494) SingleSource/Benchmarks/Shootout-C++/hash: 1.64% (0.6205 => 0.6307, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: 1.52% (2.3560 => 2.3919, std.dev.: 0.0096) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -5.28% (29.8330 => 28.2576, std.dev.: 0.2259) SingleSource/Benchmarks/Shootout-C++/hash2: -1.45% (3.4237 => 3.3741, std.dev.: 0.0159) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.25% (3.3479 => 3.3060, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -1.10% (7.2130 => 7.1340, std.dev.: 0.0198) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.56% (16.4461 => 16.5385, std.dev.: 0.2190) MultiSource/Applications/obsequi/Obsequi: 2.77% (1.0262 => 1.0546, std.dev.: 0.0117) MultiSource/Applications/sqlite3/sqlite3: 1.34% (0.6332 => 0.6417, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/08-main/main: 5.24% (0.1831 => 0.1927, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.30% (0.1559 => 0.1704, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.45% (0.3123 => 0.3262, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.66% (0.2463 => 0.2504, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.99% (0.3344 => 0.3377, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.31% (0.2364 => 0.2395, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: -0.03% (0.6010 => 0.6008, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel: 11.66% (0.0429 => 0.0479, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.13% (0.3266 => 0.3303, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/strcat: 1.93% (0.1969 => 0.2007, std.dev.: 0.0042) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 11.16% (0.0224 => 0.0249, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 76.42% (0.0123 => 0.0217, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -18.38% (0.0408 => 0.0333, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.53% (0.0254 => 0.0329, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -28.33% (0.0180 => 0.0129, std.dev.: 0.0042) SingleSource/UnitTests/byval-alignment: 46.52% (0.0230 => 0.0337, std.dev.: 0.0022) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.78% (0.1438 => 0.1478, std.dev.: 0.0040) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -1.80% (1.1329 => 1.1125, std.dev.: 0.0350) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.90% (0.1462 => 0.1519, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.96% (0.4164 => 0.3999, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.11% (0.1369 => 0.1299, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.78% (0.0641 => 0.0646, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.38% (0.0578 => 0.0570, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.17% (1.1437 => 1.1457, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.48% (0.0627 => 0.0630, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.33% (0.0180 => 0.0267) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.09% (0.8017 => 0.8010, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 66.13% (0.0062 => 0.0103, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 03:55:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 05:55:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121026105509.552DC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5244?compare_to=5241&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5244, Order: 166760, Start Time: 2012-10-26 09:31:54, End Time: 2012-10-26 10:55:04 To: 5241, Order: 166759, Start Time: 2012-10-26 07:38:39, End Time: 2012-10-26 09:02:05 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (73 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (196 on baseline) Performance Improvements: 0 (51 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 75 (2 on baseline) Unchanged Tests: 967 (641 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0486 => 0.0486, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0488 => 0.0488, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.22% (0.0456 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0457 => 0.0457, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0445 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0447 => 0.0447) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0439 => 0.0439) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0441 => 0.0441) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0457 => 0.0457) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.22% (0.0458 => 0.0457, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0451 => 0.0451) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.22% (0.0453 => 0.0452, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0441 => 0.0441) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0443 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.22% (0.0449 => 0.0448, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0450 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0460 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.33% (0.0473 => 0.0462, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.46% (0.0436 => 0.0438, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0438 => 0.0438, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.22% (0.0449 => 0.0448, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0450 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0440 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.23% (0.0442 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0432 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0433 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0431 => 0.0431) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.46% (0.0433 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.21% (0.0468 => 0.0467, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0469 => 0.0469) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.23% (0.0431 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0431 => 0.0431, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0431 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0432 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0439 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0440 => 0.0440, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/BenchmarkGame/puzzle MultiSource/Applications/oggenc/oggenc: - (0.1407 => 0.1407, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0649 => 0.0648, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.03% (0.3826 => 0.3825, std.dev.: 0.0011) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.06% (0.6962 => 0.3825, std.dev.: 0.0011) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 203.69% (0.5229 => 1.5880, std.dev.: 0.0106) MultiSource/Applications/SPASS/SPASS: 16.09% (14.9895 => 17.4009, std.dev.: 0.0081) MultiSource/Applications/kimwitu++/kc: 37.37% (14.1553 => 19.4450, std.dev.: 0.0297) MultiSource/Benchmarks/MallocBench/gs/gs: 13.89% (4.1105 => 4.6814, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 35.75% (1.1048 => 1.4998, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 318.26% (7.1582 => 29.9398, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.88% (3.4629 => 5.8480, std.dev.: 0.0162) SingleSource/Benchmarks/Misc-C++/stepanov_container: 67.52% (0.6222 => 1.0423, std.dev.: 0.0027) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 11833.19% (0.0720 => 8.5919, std.dev.: 0.0082) MultiSource/Applications/SIBsim4/SIBsim4: 4015700.00% (0.0001 => 4.0158, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 11139300.00% (0.0001 => 11.1394, std.dev.: 0.0164) MultiSource/Applications/kimwitu++/kc: 50700.00% (0.0001 => 0.0508, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63200.00% (0.0001 => 0.0633, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 792600.00% (0.0001 => 0.7927, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050200.00% (0.0001 => 10.0503, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5490400.00% (0.0001 => 5.4905, std.dev.: 0.0099) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 69.53% (0.0256 => 0.0434, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 57.20% (0.0243 => 0.0382) SingleSource/Regression/C/sumarray2d: 54.98% (0.0271 => 0.0420) SingleSource/Regression/C/sumarray: 45.02% (0.0231 => 0.0335, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 42.37% (1.5859 => 2.2578, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/distray/distray: 40.53% (0.1056 => 0.1484, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 36.71% (10.3673 => 14.1734, std.dev.: 0.0113) SingleSource/UnitTests/vla: 34.08% (0.0355 => 0.0476) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 31.39% (2.2024 => 2.8938, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 29.19% (0.1432 => 0.1850, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 28.71% (0.1463 => 0.1883, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 24.83% (0.1655 => 0.2066, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 24.46% (0.0834 => 0.1038, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.90% (0.1566 => 0.1909, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: 21.86% (0.0485 => 0.0591, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 21.23% (0.2049 => 0.2484, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 19.51% (0.4879 => 0.5831, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.40% (0.0871 => 0.1040, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 19.31% (0.5105 => 0.6091, std.dev.: 0.0018) MultiSource/Applications/viterbi/viterbi: 19.16% (0.1555 => 0.1853, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 18.63% (0.3177 => 0.3769, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: 18.36% (0.0746 => 0.0883, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 18.36% (0.0730 => 0.0864, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.19% (0.6675 => 0.7889, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 18.05% (0.2554 => 0.3015, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 18.04% (0.1175 => 0.1387, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 17.95% (0.0730 => 0.0861, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.45% (1.3050 => 1.5327, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: 17.41% (0.0626 => 0.0735, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.28% (0.0793 => 0.0930, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 17.23% (0.1695 => 0.1987, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.20% (0.1029 => 0.1206, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/mst/mst: 16.94% (0.1163 => 0.1360, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 16.91% (3.3354 => 3.8993, std.dev.: 0.0195) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.70% (0.8172 => 0.9537, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.69% (0.2271 => 0.2650, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 16.53% (0.1337 => 0.1558, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.47% (0.1032 => 0.1202, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 16.39% (0.7115 => 0.8281, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.34% (0.4615 => 0.5369, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.31% (1.5415 => 1.7929, std.dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: 16.21% (1.1840 => 1.3759, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.16% (0.5020 => 0.5831, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.15% (0.3121 => 0.3625, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 16.09% (0.1510 => 0.1753, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.03% (0.0886 => 0.1028, std.dev.: 0.0019) MultiSource/Applications/aha/aha: 15.99% (0.1151 => 0.1335, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.94% (0.1625 => 0.1884, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.91% (0.0842 => 0.0976, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.88% (0.1940 => 0.2248, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.85% (0.0675 => 0.0782, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.75% (0.0838 => 0.0970, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 15.66% (0.3109 => 0.3596, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 15.40% (0.1584 => 0.1828, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/exptree: 15.23% (0.0814 => 0.0938, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 15.14% (1.1642 => 1.3405, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 15.13% (0.1236 => 0.1423, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 14.95% (0.1906 => 0.2191, std.dev.: 0.0008) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.87% (0.1143 => 0.1313, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.86% (0.1117 => 0.1283, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.81% (0.2107 => 0.2419, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.81% (0.0770 => 0.0884, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.79% (4.2646 => 4.8953, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.78% (0.2700 => 0.3099, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.71% (0.9765 => 1.1201) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.70% (0.5981 => 0.6860, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 14.64% (0.3423 => 0.3924, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.58% (0.2065 => 0.2366, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.58% (0.2758 => 0.3160, std.dev.: 0.0016) MultiSource/Applications/spiff/spiff: 14.47% (0.7835 => 0.8969, std.dev.: 0.0046) SingleSource/UnitTests/SignlessTypes/rem: 14.42% (0.1144 => 0.1309, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 14.34% (0.7433 => 0.8499, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.31% (0.1125 => 0.1286, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.31% (0.6450 => 0.7373, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.22% (0.1062 => 0.1213, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.16% (0.0798 => 0.0911, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 14.07% (9.4845 => 10.8191, std.dev.: 0.0045) MultiSource/Benchmarks/NPB-serial/is/is: 14.05% (0.0719 => 0.0820, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 14.04% (2.0273 => 2.3120, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.04% (0.1695 => 0.1933, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.90% (0.0770 => 0.0877) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.89% (0.5860 => 0.6674, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.72% (0.0933 => 0.1061, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.66% (8.1363 => 9.2481, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.63% (1.4186 => 1.6120, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: 13.62% (0.3180 => 0.3613, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 13.60% (1.0722 => 1.2180, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.56% (0.0929 => 0.1055, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 13.31% (0.4299 => 0.4871, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 13.29% (3.8723 => 4.3869, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.28% (0.8067 => 0.9138, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.27% (0.3307 => 0.3746, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: 13.25% (0.1268 => 0.1436, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.06% (0.2603 => 0.2943, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.05% (0.5569 => 0.6296, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 12.83% (0.8921 => 1.0066, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.82% (0.3441 => 0.3882, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.81% (4.9449 => 5.5782, std.dev.: 0.0104) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.66% (5.0018 => 5.6349, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.63% (0.1330 => 0.1498, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.47% (1.1861 => 1.3340, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 12.40% (0.3387 => 0.3807, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/bh/bh: 12.39% (0.3092 => 0.3475, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.94% (0.8101 => 0.9068, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 11.94% (5.7591 => 6.4465, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/parameter-passing: 11.76% (0.3927 => 0.4389, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.66% (0.3516 => 0.3926, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.62% (0.3828 => 0.4273, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 11.61% (0.4289 => 0.4787, std.dev.: 0.0087) SingleSource/UnitTests/ObjC/trivial-interface: 11.60% (0.3473 => 0.3876, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.57% (0.3543 => 0.3953, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.57% (0.3543 => 0.3953, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/synchronized: 11.54% (0.3561 => 0.3972, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.52% (0.3497 => 0.3900, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/for-in: 11.45% (0.3694 => 0.4117, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 11.42% (2.2969 => 2.5591, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 11.40% (0.6456 => 0.7192, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.35% (0.3886 => 0.4327, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.10% (0.1892 => 0.2102, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 11.02% (0.0953 => 0.1058, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 10.97% (0.4620 => 0.5127, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.92% (0.1044 => 0.1158, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 10.70% (0.3422 => 0.3788, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.58% (2.2022 => 2.4353, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.58% (0.4103 => 0.4537, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.50% (0.3865 => 0.4271, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.48% (0.3826 => 0.4227, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.40% (0.4203 => 0.4640, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 10.34% (0.3684 => 0.4065, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 10.25% (1.5603 => 1.7202, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.92% (0.4636 => 0.5096, std.dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 9.77% (21.9371 => 24.0798, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/moments: 9.54% (0.4048 => 0.4434, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.42% (0.5925 => 0.6483, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.38% (0.2430 => 0.2658, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 9.38% (0.3603 => 0.3941, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 9.37% (0.6030 => 0.6595, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.13% (0.3427 => 0.3740, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 9.10% (0.7326 => 0.7993, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 9.04% (17.1811 => 18.7346, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.81% (0.4064 => 0.4422, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 8.62% (0.3098 => 0.3365, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.59% (3.8922 => 4.2265, std.dev.: 0.0157) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.48% (14.3668 => 15.5856, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.30% (0.3650 => 0.3953, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.29% (0.2872 => 0.3110, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 8.29% (0.3283 => 0.3555, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 8.23% (0.2831 => 0.3064, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.16% (0.3162 => 0.3420, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 8.14% (0.3232 => 0.3495, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.06% (0.2891 => 0.3124, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.02% (2.0665 => 2.2322, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 8.01% (0.2871 => 0.3101, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.95% (0.2905 => 0.3136, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.69% (0.2756 => 0.2968, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.66% (0.2793 => 0.3007, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.60% (0.2725 => 0.2932, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.54% (0.2877 => 0.3094, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 7.44% (0.3052 => 0.3279, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 7.43% (0.3282 => 0.3526, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 7.32% (0.2802 => 0.3007, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.30% (0.2714 => 0.2912, std.dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: 7.19% (1.2842 => 1.3765, std.dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 7.14% (10.4361 => 11.1815, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/ary2: 7.04% (0.3379 => 0.3617, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.95% (0.3136 => 0.3354, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.88% (0.2266 => 0.2422, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.17% (7.9617 => 8.4529, std.dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/objinst: 5.65% (0.3131 => 0.3308, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.09% (0.3935 => 0.4096, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.01% (0.3817 => 0.3970, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.83% (7.0540 => 7.3243, std.dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: 31.47% (10.2830 => 13.5188, std.dev.: 0.0124) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1725, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 14.22% (0.9957 => 1.1373, std.dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 14.08% (2.6778 => 3.0549, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 9.85% (1.1396 => 1.2518, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3685, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.64% (2.8904 => 3.0824, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 3.82% (1.9405 => 2.0146, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.21% (0.3987 => 0.4115, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.58% (4.2280 => 4.3370, std.dev.: 0.0117) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.24% (1.0313 => 1.0544, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bisort/bisort: 2.02% (0.8333 => 0.8501, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2078, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.50% (11.6436 => 11.8181, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.31% (9.1159 => 9.2349, std.dev.: 0.0461) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.25% (2.6546 => 2.6879, std.dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: 1.17% (4.4649 => 4.5173, std.dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.93% (6.6874 => 0.1381, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -82.53% (0.8651 => 0.1511) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -52.40% (5.2763 => 2.5113, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/richards_benchmark: -45.19% (0.1622 => 0.0889, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -41.08% (5.3855 => 3.1730, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.43% (5.3526 => 3.1885, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -8.88% (54.1659 => 49.3564, std.dev.: 0.0255) MultiSource/Benchmarks/Bullet/bullet: -8.26% (63.2438 => 58.0205, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.02% (1.7609 => 1.6196, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -4.77% (22.1758 => 21.1172, std.dev.: 0.0221) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.73% (2.9384 => 2.7995, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.66% (1.1194 => 1.0672, std.dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -52.86% (8.0499 => 3.7946, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.43% (1.1492 => 0.7650, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -28.74% (10.7105 => 7.6325, std.dev.: 0.0181) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4751, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -16.08% (1.6925 => 1.4204, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.53% (0.0998 => 0.0853) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.71% (1.2258 => 1.0700, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -12.19% (1.2373 => 1.0865, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/mandel-2: -10.88% (1.5373 => 1.3700, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.50% (19.9488 => 18.2538, std.dev.: 0.0270) MultiSource/Benchmarks/FreeBench/mason/mason: -8.01% (0.2161 => 0.1988, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.96% (1.8329 => 1.7053, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/oourafft: -5.46% (6.6465 => 6.2838, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.90% (1.6805 => 1.5981, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5084, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.21% (8.1563 => 7.8131, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.73% (1.3677 => 1.3167, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1627, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: -3.33% (5.0483 => 4.8802, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.11% (32.5116 => 31.4995, std.dev.: 0.0035) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.97% (0.4808 => 0.4665, std.dev.: 0.0012) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6829, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.66% (2.5528 => 2.5103, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4205, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: -1.44% (4.6441 => 4.5772, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/lists: -1.08% (6.2999 => 6.2320, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8593, std.dev.: 0.0048) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -5.25% (0.1485 => 0.1407, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0026) Report Time: 1.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 04:32:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 06:32:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121026113226.760F12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5245?compare_to=5242&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5245, Order: 166763, Start Time: 2012-10-26 10:07:30, End Time: 2012-10-26 11:32:21 To: 5242, Order: 166760, Start Time: 2012-10-26 08:19:49, End Time: 2012-10-26 09:44:42 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 1 (180 on baseline) Unchanged Tests: 1040 (858 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.89% (78.4014 => 79.8859, std.dev.: 0.5008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.47% (56.5335 => 54.5708, std.dev.: 0.2998) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.63% (2.0478 => 2.1017, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/salsa20: 2.62% (7.4937 => 7.6902, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash2: 2.22% (3.1932 => 3.2641, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.15% (0.1431 => 0.1300, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.11% (0.3821 => 0.3511, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -7.82% (2.4924 => 2.2976, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.04% (0.2428 => 0.2257, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.89% (0.3658 => 0.3406, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.85% (22.4056 => 20.8701, std.dev.: 0.0090) SingleSource/UnitTests/ObjC/exceptions-4: -6.78% (0.3880 => 0.3617, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.77% (0.3884 => 0.3621, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: -6.76% (0.3357 => 0.3130, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -6.75% (0.4176 => 0.3894, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.75% (0.3142 => 0.2930, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -6.73% (4.3330 => 4.0413, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/trivial-interface: -6.72% (0.3812 => 0.3556, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.71% (3.5339 => 3.2967, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-2: -6.71% (0.3831 => 0.3574, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.70% (0.3896 => 0.3635, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.68% (0.3848 => 0.3591, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -6.66% (16.1920 => 15.1140, std.dev.: 0.0215) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.66% (0.3891 => 0.3632, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -6.60% (7.0961 => 6.6278, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/chomp: -6.59% (0.1761 => 0.1645, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -6.57% (0.4033 => 0.3768, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.57% (0.1796 => 0.1678, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: -6.56% (1.2515 => 1.1694, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.55% (0.7919 => 0.7400, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.55% (1.6474 => 1.5395, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/property: -6.55% (0.4199 => 0.3924, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -6.55% (9.2283 => 8.6240, std.dev.: 0.0181) MultiSource/Benchmarks/McCat/08-main/main: -6.54% (0.2659 => 0.2485, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: -6.53% (1.1530 => 1.0777, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: -6.53% (0.2160 => 0.2019, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: -6.51% (0.9179 => 0.8581, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.47% (0.9542 => 0.8925, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.46% (0.6484 => 0.6065, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.46% (0.2695 => 0.2521, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -6.45% (0.4280 => 0.4004, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -6.44% (0.1879 => 0.1758, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.41% (1.3722 => 1.2842, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.41% (0.1716 => 0.1606, std.dev.: 0.0009) MultiSource/Applications/siod/siod: -6.40% (2.4021 => 2.2483, std.dev.: 0.0223) MultiSource/Benchmarks/Olden/bh/bh: -6.40% (0.2985 => 0.2794, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: -6.39% (1.1450 => 1.0718, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.39% (6.7716 => 6.3390, std.dev.: 0.0051) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.38% (0.1584 => 0.1483, std.dev.: 0.0010) MultiSource/Applications/lua/lua: -6.37% (4.0594 => 3.8008, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.37% (0.2355 => 0.2205, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.36% (0.9852 => 0.9225, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.36% (5.4682 => 5.1204, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.34% (1.2300 => 1.1520, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.34% (4.5069 => 4.2213, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.34% (0.4151 => 0.3888, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.32% (1.0544 => 0.9878, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.31% (0.6736 => 0.6311, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.30% (1.4642 => 1.3720, std.dev.: 0.0019) MultiSource/Applications/minisat/minisat: -6.24% (0.7447 => 0.6982, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.23% (1.6364 => 1.5344, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.22% (0.7198 => 0.6750, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.20% (0.2548 => 0.2390, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -6.20% (1.3148 => 1.2333, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.19% (4.8161 => 4.5178, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.19% (1.2784 => 1.1993, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -6.16% (0.4321 => 0.4055, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.13% (0.6293 => 0.5907, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -6.13% (0.4861 => 0.4563, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.12% (4.8802 => 4.5814, std.dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.11% (0.4813 => 0.4519, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.08% (4.0323 => 3.7870, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.08% (2.2587 => 2.1213, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: -6.06% (0.3581 => 0.3364, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.05% (0.3931 => 0.3693, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.05% (0.3837 => 0.3605, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.03% (14.2083 => 13.3520, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/matrix: -5.99% (0.3255 => 0.3060, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -5.98% (0.3026 => 0.2845, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -5.97% (18.2933 => 17.2014, std.dev.: 0.0047) MultiSource/Applications/SPASS/SPASS: -5.97% (15.5079 => 14.5824, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.97% (0.3252 => 0.3058, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.96% (0.3323 => 0.3125, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -5.93% (34.0927 => 32.0704, std.dev.: 0.0099) MultiSource/Benchmarks/sim/sim: -5.93% (0.3406 => 0.3204, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.92% (0.6304 => 0.5931, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: -5.89% (0.4515 => 0.4249, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -5.88% (0.4524 => 0.4258, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.88% (0.5478 => 0.5156, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.87% (0.5999 => 0.5647, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: -5.85% (0.2989 => 0.2814, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.85% (0.4083 => 0.3844, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.84% (0.5168 => 0.4866, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -5.83% (0.3446 => 0.3245, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -5.83% (0.3481 => 0.3278, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.83% (0.4427 => 0.4169, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.82% (0.5805 => 0.5467, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: -5.81% (2.1401 => 2.0157, std.dev.: 0.0021) MultiSource/Applications/SIBsim4/SIBsim4: -5.81% (1.3864 => 1.3059, std.dev.: 0.0212) SingleSource/Benchmarks/Shootout-C++/ary: -5.80% (0.3394 => 0.3197, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.80% (0.5705 => 0.5374, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: -5.80% (0.3621 => 0.3411, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.79% (0.2278 => 0.2146, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.79% (0.2106 => 0.1984, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.79% (0.5859 => 0.5520, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -5.78% (17.1032 => 16.1138, std.dev.: 0.0875) SingleSource/Benchmarks/Misc-C++/bigfib: -5.78% (0.6750 => 0.6360, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.78% (0.5591 => 0.5268, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.78% (1.2221 => 1.1515, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.77% (0.3483 => 0.3282, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.77% (0.2999 => 0.2826, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.76% (0.6681 => 0.6296, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.76% (2.1713 => 2.0462, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.76% (0.3491 => 0.3290, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.76% (1.2210 => 1.1507, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.76% (0.5925 => 0.5584, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.74% (0.8521 => 0.8032, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.74% (0.4916 => 0.4634, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.73% (0.5863 => 0.5527, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.72% (0.2903 => 0.2737, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -5.71% (0.2871 => 0.2707, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.71% (0.6395 => 0.6030, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.70% (0.6297 => 0.5938, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.70% (0.6052 => 0.5707, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.70% (0.6230 => 0.5875, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: -5.70% (3.5154 => 3.3151, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: -5.68% (0.3788 => 0.3573, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -5.68% (0.7982 => 0.7529, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.67% (0.6260 => 0.5905, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.67% (0.3016 => 0.2845, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -5.67% (15.2527 => 14.3886, std.dev.: 0.2382) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.66% (0.6660 => 0.6283, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.65% (0.6395 => 0.6034, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: -5.64% (0.3194 => 0.3014, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.63% (0.3319 => 0.3132, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.63% (0.6676 => 0.6300, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.63% (0.3057 => 0.2885, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -5.62% (0.3025 => 0.2855, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.62% (0.5802 => 0.5476, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.61% (0.7339 => 0.6927, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.59% (0.5941 => 0.5609, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -5.58% (0.2939 => 0.2775, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.58% (0.2385 => 0.2252, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.57% (0.7524 => 0.7105, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.57% (0.9557 => 0.9025, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.57% (0.5857 => 0.5531, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.56% (0.6189 => 0.5845, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.55% (0.5581 => 0.5271, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.55% (0.6446 => 0.6088, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -5.55% (0.2849 => 0.2691, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.54% (8.0126 => 7.5685, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/wc: -5.52% (0.3205 => 0.3028, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -5.51% (0.4248 => 0.4014, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.50% (0.5688 => 0.5375, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.50% (0.5567 => 0.5261, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.49% (0.2933 => 0.2772, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.49% (0.5575 => 0.5269, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.47% (0.6194 => 0.5855, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.47% (0.6440 => 0.6088, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.46% (0.5569 => 0.5265) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.44% (0.5329 => 0.5039, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.44% (0.7021 => 0.6639, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.42% (0.5849 => 0.5532, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -5.41% (0.7779 => 0.7358, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/09-vor/vor: -5.41% (0.3271 => 0.3094, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.40% (0.6033 => 0.5707, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.39% (0.5570 => 0.5270, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.35% (0.5456 => 0.5164, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -5.31% (0.8418 => 0.7971, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: -5.10% (0.3059 => 0.2903, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -5.08% (0.6441 => 0.6114, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -5.06% (0.6347 => 0.6026, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -4.46% (1.5610 => 1.4914, std.dev.: 0.0063) MultiSource/Applications/oggenc/oggenc: -4.37% (5.0226 => 4.8030, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.21% (0.9077 => 0.8695, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -3.40% (20.7746 => 20.0675, std.dev.: 0.0400) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7531, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/richards_benchmark: -8.66% (1.2842 => 1.1730, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7068, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -3.81% (2.2633 => 2.1770, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.12% (1.3096 => 1.2687, std.dev.: 0.0115) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4727, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Report Time: 1.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 04:42:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 06:42:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121026114231.EB2282A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5246?compare_to=5238&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5246, Order: 166760, Start Time: 2012-10-26 08:26:46, End Time: 2012-10-26 11:42:27 To: 5238, Order: 166749, Start Time: 2012-10-26 04:18:59, End Time: 2012-10-26 07:38:29 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (169 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1041 (721 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -1.75% (55.1077 => 54.1453, std.dev.: 0.0554) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.80% (0.0625 => 0.0880, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.98% (0.1063 => 0.1403, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.83% (0.2969 => 0.3736, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.59% (0.1106 => 0.1389, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 24.76% (1.5932 => 1.9876, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.43% (0.4139 => 0.5150, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.69% (0.4994 => 0.6177, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.58% (0.0547 => 0.0676, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.53% (0.0714 => 0.0882, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.42% (0.5900 => 0.7282, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.21% (0.4253 => 0.5240, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.16% (0.0475 => 0.0585, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.76% (0.5000 => 0.6138, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.60% (0.0584 => 0.0716, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 21.70% (0.0599 => 0.0729, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.67% (0.1620 => 0.1971, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.65% (0.1021 => 0.1242, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.63% (0.0897 => 0.1091, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.05% (0.1107 => 0.1340, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.52% (0.0541 => 0.0652) MultiSource/Benchmarks/Olden/em3d/em3d: 20.46% (0.0948 => 0.1142, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 20.36% (0.0604 => 0.0727, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.22% (0.0633 => 0.0761, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.09% (0.3903 => 0.4687, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.03% (0.0584 => 0.0701, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.95% (0.1103 => 0.1323, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.94% (0.0642 => 0.0770, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 19.85% (0.0821 => 0.0984, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 19.70% (0.1619 => 0.1938, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.58% (0.1604 => 0.1918, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.44% (0.1003 => 0.1198, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.43% (0.1549 => 0.1850, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.34% (0.0822 => 0.0981, std.dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: 18.69% (0.0947 => 0.1124, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.47% (0.1462 => 0.1732, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.38% (0.3890 => 0.4605, std.dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: 18.19% (0.0808 => 0.0955, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 18.02% (0.5826 => 0.6876, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.92% (0.2014 => 0.2375, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 17.73% (0.1218 => 0.1434, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 17.69% (0.5889 => 0.6931, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 17.67% (0.1505 => 0.1771, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 17.45% (0.4029 => 0.4732, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.40% (1.3152 => 1.5440, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.34% (0.2866 => 0.3363, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.29% (0.2736 => 0.3209, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/mst/mst: 17.19% (0.0698 => 0.0818, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.19% (0.1088 => 0.1275, std.dev.: 0.0046) SingleSource/Regression/C++/ofstream_ctor: 16.84% (0.3004 => 0.3510, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 16.84% (0.5546 => 0.6480, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.80% (0.2875 => 0.3358, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.80% (3.5627 => 4.1611, std.dev.: 0.0077) MultiSource/Benchmarks/MallocBench/gs/gs: 16.76% (1.8794 => 2.1944, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.51% (0.1968 => 0.2293, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 16.47% (0.9697 => 1.1294, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.47% (0.4658 => 0.5425, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.44% (1.6211 => 1.8876, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/fibo: 16.22% (0.2725 => 0.3167, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.22% (0.2738 => 0.3182, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.21% (0.1160 => 0.1348, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.20% (0.3271 => 0.3801, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.20% (0.5026 => 0.5840, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/18-imp/imp: 16.19% (0.1421 => 0.1651, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hello: 16.18% (0.2714 => 0.3153, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.12% (0.3195 => 0.3710, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.98% (0.2729 => 0.3165, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.91% (0.4361 => 0.5055, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 15.86% (0.2780 => 0.3221, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 15.85% (0.2750 => 0.3186, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 15.83% (0.7171 => 0.8306, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/wc: 15.76% (0.3096 => 0.3584, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.72% (0.2792 => 0.3231, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 15.70% (0.2803 => 0.3243, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 15.67% (1.0781 => 1.2470, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.66% (4.4195 => 5.1114, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.65% (2.0673 => 2.3909, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 15.64% (0.2813 => 0.3253, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 15.62% (0.2823 => 0.3264, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 15.55% (0.2811 => 0.3248, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.53% (0.2911 => 0.3363, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 15.51% (0.9909 => 1.1446, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 15.47% (23.5202 => 27.1584, std.dev.: 0.0633) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.46% (0.3060 => 0.3533, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.32% (0.3930 => 0.4532, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.32% (2.7292 => 3.1472, std.dev.: 0.0116) MultiSource/Benchmarks/Olden/bh/bh: 15.26% (0.1284 => 0.1480, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.25% (1.9694 => 2.2697, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.23% (1.9966 => 2.3006, std.dev.: 0.0043) MultiSource/Applications/ClamAV/clamscan: 15.14% (4.2109 => 4.8484, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/ary: 15.13% (0.3258 => 0.3751, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 15.12% (0.3267 => 0.3761, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 15.01% (0.3317 => 0.3815, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.78% (0.3362 => 0.3859, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.76% (0.3124 => 0.3585, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash: 14.57% (0.4146 => 0.4750, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.50% (0.1090 => 0.1248, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 14.27% (0.2075 => 0.2371, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 14.22% (0.3678 => 0.4201, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 14.19% (0.3348 => 0.3823, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.14% (0.3282 => 0.3746, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 14.09% (0.3726 => 0.4251, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 13.95% (0.4251 => 0.4844, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 13.83% (0.3477 => 0.3958, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.77% (0.3625 => 0.4124, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 13.76% (0.2566 => 0.2919, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 13.71% (1.4269 => 1.6225, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 13.62% (0.3465 => 0.3937, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.61% (0.3446 => 0.3915, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.60% (0.3690 => 0.4192, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.59% (0.3981 => 0.4522, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.55% (0.3460 => 0.3929, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.53% (0.3488 => 0.3960, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.52% (0.3845 => 0.4365, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/for-in: 13.47% (0.3496 => 0.3967, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.46% (0.3469 => 0.3936, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.45% (0.3442 => 0.3905, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 13.40% (0.7875 => 0.8930, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 13.40% (0.3643 => 0.4131, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 13.23% (0.3650 => 0.4133, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 13.22% (2.1653 => 2.4515, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: 13.15% (0.5012 => 0.5671, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 13.04% (4.6177 => 5.2200, std.dev.: 0.0143) SingleSource/UnitTests/ObjC/parameter-passing: 13.00% (0.3724 => 0.4208, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.40% (0.2040 => 0.2293, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 12.25% (2.1013 => 2.3588, std.dev.: 0.0041) MultiSource/Applications/SIBsim4/SIBsim4: 11.89% (0.2691 => 0.3011, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 11.57% (5.5417 => 6.1829, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.48% (0.6435 => 0.7174, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.89% (0.1028 => 0.1140, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 10.83% (0.3498 => 0.3877, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.71% (0.2737 => 0.3030, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.59% (0.2068 => 0.2287, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.48% (0.1383 => 0.1528, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 10.21% (0.4847 => 0.5342, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.18% (0.3084 => 0.3398, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 10.10% (0.3336 => 0.3673, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 9.87% (0.6634 => 0.7289, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: 9.47% (2.0346 => 2.2273, std.dev.: 0.0180) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.42% (0.2103 => 0.2301, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 9.08% (0.2391 => 0.2608, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.75% (4.6926 => 5.1034, std.dev.: 0.0234) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.29% (11.6398 => 12.6050, std.dev.: 0.0231) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.15% (0.5361 => 0.5798, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.63% (0.5584 => 0.6010, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.34% (0.7426 => 0.7971, std.dev.: 0.0038) MultiSource/Applications/kimwitu++/kc: 6.65% (11.9555 => 12.7509, std.dev.: 0.0138) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.22% (0.3792 => 0.3952, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.32% (0.2162 => 0.3531, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6535, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 8.78% (0.2802 => 0.3048, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6105, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 5.01% (12.0509 => 12.6551, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1721, std.dev.: 0.0832) SingleSource/Benchmarks/Misc/flops-2: 3.93% (1.8057 => 1.8766, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.87% (0.3693 => 0.3799, std.dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/dry: 2.79% (14.0481 => 14.4397, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2009, std.dev.: 0.0032) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.63% (3.1722 => 3.2240, std.dev.: 0.0022) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3023, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.35% (7.1849 => 7.2822, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5150, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5872, std.dev.: 0.0092) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.36% (25.4195 => 16.4301, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary2: -7.99% (0.2402 => 0.2210, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9774, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7749, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/tsp/tsp: -7.22% (2.1113 => 1.9588, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.45% (11.2080 => 10.8213, std.dev.: 0.0578) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.00% (0.6293 => 0.6104, std.dev.: 0.0058) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7745, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5218, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -2.60% (17.2379 => 16.7895, std.dev.: 0.0386) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8680, std.dev.: 0.0110) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5791, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4960, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.15% (105.3826 => 104.1713, std.dev.: 0.0545) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0434, std.dev.: 0.0039) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.04% (3.3991 => 3.3639, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 05:13:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 07:13:01 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121026121301.73F1E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5247?compare_to=5243&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5247, Order: 166766, Start Time: 2012-10-26 10:49:26, End Time: 2012-10-26 12:12:58 To: 5243, Order: 166760, Start Time: 2012-10-26 09:07:59, End Time: 2012-10-26 10:32:32 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 10 (57 on baseline) Performance Improvements: 4 (3 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 961 (914 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout-C++/moments: 3.74% (0.3659 => 0.3796, std.dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 12.19% (20.2363 => 22.7035, std.dev.: 0.4533) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.49% (21.5196 => 22.4852, std.dev.: 0.0897) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.28% (2.4316 => 2.5114, std.dev.: 0.0190) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.27% (59.2023 => 61.1372, std.dev.: 0.1130) SingleSource/Benchmarks/Shootout-C++/except: 2.09% (0.4879 => 0.4981, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.63% (6.3801 => 6.4839, std.dev.: 0.0199) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.41% (3.8939 => 3.9487, std.dev.: 0.0189) SingleSource/Benchmarks/Shootout/methcall: 1.33% (8.1568 => 8.2653, std.dev.: 0.0120) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.30% (1.1254 => 1.1400, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.52% (1.2173 => 1.1988, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: -1.36% (4.2326 => 4.1751, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.15% (1.0145 => 1.0028, std.dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/BitBench/uudecode/uudecode: -10.83% (0.1006 => 0.0897, std.dev.: 0.0042) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.11% (16.5385 => 16.5205, std.dev.: 0.0533) MultiSource/Applications/obsequi/Obsequi: -0.43% (1.0546 => 1.0501, std.dev.: 0.0105) MultiSource/Applications/sqlite3/sqlite3: 0.19% (0.6417 => 0.6429, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/08-main/main: -2.70% (0.1927 => 0.1875, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.06% (0.1704 => 0.1722, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.64% (0.3262 => 0.3241, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.60% (0.2504 => 0.2439, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.18% (0.3377 => 0.3371, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.29% (0.2395 => 0.2364, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/bigfib: -0.28% (0.6008 => 0.5991, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: 1.88% (0.0479 => 0.0488, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.09% (0.3303 => 0.3306, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: -0.80% (0.2007 => 0.1991, std.dev.: 0.0007) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -16.87% (0.0249 => 0.0207, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -14.75% (0.0217 => 0.0185, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 28.23% (0.0333 => 0.0427, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.59% (0.0329 => 0.0281, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0315 => 0.0315, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.65% (0.0423 => 0.0416, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 0.49% (0.0203 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 57.36% (0.0129 => 0.0203, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: 8.31% (0.0337 => 0.0365, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.74% (0.1478 => 0.1489, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.74% (1.1125 => 1.1319, std.dev.: 0.0503) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.49% (0.1519 => 0.1466, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.30% (0.3999 => 0.4091, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.08% (0.1299 => 0.1404, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.01% (0.0646 => 0.0659, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -6.86% (0.0277 => 0.0258, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.70% (0.0570 => 0.0566, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.10% (1.1457 => 1.1446, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -77.42% (0.0031 => 0.0007, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.90% (0.0630 => 0.0555, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -34.08% (0.0267 => 0.0176, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.02% (0.8010 => 0.8012, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -38.83% (0.0103 => 0.0063, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.13% (2.1832 => 1.6563, std.dev.: 0.0030) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 12.84% (0.0810 => 0.0914, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.56% (0.1425 => 0.1547, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.68% (0.2279 => 0.2454, std.dev.: 0.0014) MultiSource/Applications/viterbi/viterbi: 6.40% (0.1577 => 0.1678, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.38% (0.2180 => 0.2319, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.99% (0.6010 => 0.6370, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.38% (0.7473 => 0.7875, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/moments: 4.14% (0.3645 => 0.3796, std.dev.: 0.0028) MultiSource/Applications/hbd/hbd: 3.90% (1.4269 => 1.4825, std.dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.64% (0.9435 => 0.9778, std.dev.: 0.0103) MultiSource/Applications/spiff/spiff: 3.45% (0.7950 => 0.8224, std.dev.: 0.0094) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.29% (1.1606 => 1.1988, std.dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.85% (6.6074 => 6.7956, std.dev.: 0.0357) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.54% (1.1685 => 1.1982, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.46% (0.8716 => 0.8930, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.31% (1.6386 => 1.6765, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.25% (0.8656 => 0.8851, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.19% (0.8007 => 0.8182, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.15% (0.5817 => 0.5942, std.dev.: 0.0028) MultiSource/Applications/treecc/treecc: 2.13% (1.9948 => 2.0372, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.09% (0.8457 => 0.8634, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.98% (0.9074 => 0.9254, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.96% (0.8712 => 0.8883, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.86% (0.8611 => 0.8771, std.dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: 1.85% (31.8598 => 32.4479, std.dev.: 0.0423) MultiSource/Applications/JM/lencod/lencod: 1.79% (15.3280 => 15.6022, std.dev.: 0.1057) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.77% (4.5702 => 4.6509, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.66% (0.8697 => 0.8841, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.62% (1.4479 => 1.4714, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.61% (0.8204 => 0.8336, std.dev.: 0.0050) MultiSource/Benchmarks/nbench/nbench: 1.61% (1.1271 => 1.1452, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.60% (0.9688 => 0.9843, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.59% (13.1811 => 13.3905, std.dev.: 0.0686) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.58% (0.8338 => 0.8470, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.58% (0.9056 => 0.9199, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.56% (0.8261 => 0.8390, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.47% (0.8317 => 0.8439, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.46% (0.8286 => 0.8407, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.44% (0.7932 => 0.8046, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.43% (0.8066 => 0.8181, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.39% (0.8420 => 0.8537, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.38% (0.8069 => 0.8180, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.36% (0.8331 => 0.8444, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.24% (0.8086 => 0.8186, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.21% (0.9908 => 1.0028, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 1.20% (8.6247 => 8.7280, std.dev.: 0.0097) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.70% (1.5795 => 2.5067, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.85% (0.3186 => 0.3468, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.47% (1.1857 => 1.2861, std.dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 5.97% (63.1822 => 66.9528, std.dev.: 0.0737) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.16% (59.2638 => 61.1372, std.dev.: 0.1130) SingleSource/Benchmarks/Shootout-C++/hash: 3.08% (0.6205 => 0.6396, std.dev.: 0.0071) SingleSource/Benchmarks/Dhrystone/dry: 2.97% (0.5081 => 0.5232, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.55% (2.4490 => 2.5114, std.dev.: 0.0190) SingleSource/Benchmarks/Misc/ReedSolomon: 2.29% (8.5322 => 8.7274, std.dev.: 0.0305) MultiSource/Benchmarks/Olden/bh/bh: 1.74% (2.3560 => 2.3969, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.67% (6.3772 => 6.4839, std.dev.: 0.0199) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -5.07% (29.8330 => 28.3217, std.dev.: 0.2515) SingleSource/Benchmarks/Shootout-C++/hash2: -1.36% (3.4237 => 3.3771, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.10% (3.3479 => 3.3112, std.dev.: 0.0065) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.45% (16.4461 => 16.5205, std.dev.: 0.0533) MultiSource/Applications/obsequi/Obsequi: 2.33% (1.0262 => 1.0501, std.dev.: 0.0105) MultiSource/Applications/sqlite3/sqlite3: 1.53% (0.6332 => 0.6429, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/08-main/main: 2.40% (0.1831 => 0.1875, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.46% (0.1559 => 0.1722, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.78% (0.3123 => 0.3241, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.97% (0.2463 => 0.2439, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.81% (0.3344 => 0.3371, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.2364 => 0.2364, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/bigfib: -0.32% (0.6010 => 0.5991, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: 13.75% (0.0429 => 0.0488, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.22% (0.3266 => 0.3306, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 1.12% (0.1969 => 0.1991, std.dev.: 0.0007) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -7.59% (0.0224 => 0.0207, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 50.41% (0.0123 => 0.0185, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 10.63% (0.0254 => 0.0281, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 8.33% (0.0384 => 0.0416, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 12.78% (0.0180 => 0.0203, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: 58.70% (0.0230 => 0.0365, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 3.55% (0.1438 => 0.1489, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.09% (1.1329 => 1.1319, std.dev.: 0.0503) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.27% (0.1462 => 0.1466, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.75% (0.4164 => 0.4091, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.56% (0.1369 => 0.1404, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.81% (0.0641 => 0.0659, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 32.31% (0.0195 => 0.0258, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.08% (0.0578 => 0.0566, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.08% (1.1437 => 1.1446, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 600.00% (0.0001 => 0.0007, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.48% (0.0627 => 0.0555, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.22% (0.0180 => 0.0176, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.06% (0.8017 => 0.8012, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 1.61% (0.0062 => 0.0063, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 05:47:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 07:47:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121026124758.EFD862A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5248?compare_to=5244&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5248, Order: 166767, Start Time: 2012-10-26 11:24:51, End Time: 2012-10-26 12:47:54 To: 5244, Order: 166760, Start Time: 2012-10-26 09:31:54, End Time: 2012-10-26 10:55:04 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (73 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (196 on baseline) Performance Improvements: 1 (50 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 75 (2 on baseline) Unchanged Tests: 966 (642 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -2.64% (0.4589 => 0.4468, std.dev.: 0.0016) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0486 => 0.0486) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.20% (0.0488 => 0.0487, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.22% (0.0455 => 0.0456) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0457 => 0.0457, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0445 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0447 => 0.0447) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0439 => 0.0439, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.23% (0.0441 => 0.0440, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.22% (0.0457 => 0.0458) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.22% (0.0457 => 0.0458, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0451 => 0.0451, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0452 => 0.0452, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0441 => 0.0441) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0443 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.22% (0.0448 => 0.0449) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0450 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0460 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.22% (0.0462 => 0.0461, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.46% (0.0438 => 0.0436, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0438 => 0.0438) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0448 => 0.0448, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0450 => 0.0450, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0440 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.23% (0.0441 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0432 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0433 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.23% (0.0431 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.23% (0.0431 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.21% (0.0467 => 0.0468, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0469 => 0.0469) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0430 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0431 => 0.0431) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0431 => 0.0431) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.23% (0.0432 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0439 => 0.0439) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0440 => 0.0440, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/BenchmarkGame/puzzle MultiSource/Applications/oggenc/oggenc: 0.07% (0.1407 => 0.1408, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0648 => 0.0649) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: - (0.3825 => 0.3825, std.dev.: 0.0009) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.06% (0.6962 => 0.3825, std.dev.: 0.0009) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 203.35% (0.5229 => 1.5862, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 16.04% (14.9895 => 17.3945, std.dev.: 0.0070) MultiSource/Applications/kimwitu++/kc: 37.43% (14.1553 => 19.4541, std.dev.: 0.0241) MultiSource/Benchmarks/MallocBench/gs/gs: 13.87% (4.1105 => 4.6807, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 35.89% (1.1048 => 1.5013, std.dev.: 0.0080) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 318.43% (7.1582 => 29.9517, std.dev.: 0.0140) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.81% (3.4629 => 5.8458, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: 67.15% (0.6222 => 1.0400, std.dev.: 0.0075) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 11833.47% (0.0720 => 8.5921, std.dev.: 0.0021) MultiSource/Applications/SIBsim4/SIBsim4: 4016900.00% (0.0001 => 4.0170, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 11154400.00% (0.0001 => 11.1545, std.dev.: 0.0491) MultiSource/Applications/kimwitu++/kc: 50500.00% (0.0001 => 0.0506, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 792600.00% (0.0001 => 0.7927, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050300.00% (0.0001 => 10.0504, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5487600.00% (0.0001 => 5.4877, std.dev.: 0.0145) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 69.53% (0.0256 => 0.0434, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 56.38% (0.0243 => 0.0380, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 54.61% (0.0271 => 0.0419, std.dev.: 0.0000) SingleSource/Regression/C/sumarray: 44.59% (0.0231 => 0.0334, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 42.33% (1.5859 => 2.2572, std.dev.: 0.0141) MultiSource/Benchmarks/FreeBench/distray/distray: 40.25% (0.1056 => 0.1481, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 36.11% (10.3673 => 14.1109, std.dev.: 0.0122) SingleSource/UnitTests/vla: 33.80% (0.0355 => 0.0475, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 31.49% (2.2024 => 2.8959, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 29.19% (0.1432 => 0.1850, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: 28.64% (0.1463 => 0.1882, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 24.77% (0.1655 => 0.2065, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 24.22% (0.0834 => 0.1036, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.90% (0.1566 => 0.1909, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/hash: 21.44% (0.0485 => 0.0589, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 21.23% (0.2049 => 0.2484, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 19.51% (0.4879 => 0.5831, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.40% (0.0871 => 0.1040) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 19.37% (0.5105 => 0.6094, std.dev.: 0.0060) MultiSource/Applications/viterbi/viterbi: 19.16% (0.1555 => 0.1853, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 18.98% (0.3177 => 0.3780, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.52% (0.0648 => 0.0768, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 18.10% (0.0746 => 0.0881, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: 18.05% (0.2554 => 0.3015, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.04% (0.6675 => 0.7879, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 18.02% (0.0838 => 0.0989) MultiSource/Benchmarks/Olden/tsp/tsp: 17.96% (0.1175 => 0.1386, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 17.95% (0.0730 => 0.0861, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.53% (0.0793 => 0.0932, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.39% (1.3050 => 1.5320, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: 17.25% (0.0626 => 0.0734, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 17.17% (0.1695 => 0.1986, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.10% (0.1029 => 0.1205, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 16.83% (3.3354 => 3.8968, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/mst/mst: 16.68% (0.1163 => 0.1357, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.64% (0.2271 => 0.2649, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.47% (0.1032 => 0.1202, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 16.45% (0.1337 => 0.1557, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.40% (0.8172 => 0.9512, std.dev.: 0.0023) MultiSource/Applications/minisat/minisat: 16.35% (0.7115 => 0.8278, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.26% (1.5415 => 1.7922, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 16.18% (1.1840 => 1.3756, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.16% (0.4615 => 0.5361, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.14% (0.0886 => 0.1029, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.12% (0.3121 => 0.3624, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.08% (0.5020 => 0.5827, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 16.07% (0.1151 => 0.1336, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 16.03% (0.1510 => 0.1752, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.00% (0.0675 => 0.0783, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.88% (0.1940 => 0.2248, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.68% (0.0842 => 0.0974, std.dev.: 0.0025) MultiSource/Applications/Burg/burg: 15.68% (1.1642 => 1.3467, std.dev.: 0.0030) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.66% (0.1143 => 0.1322, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 15.54% (0.3109 => 0.3592, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 15.34% (0.3423 => 0.3948, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 15.28% (0.1584 => 0.1826, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/exptree: 15.11% (0.0814 => 0.0937, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 15.05% (0.1236 => 0.1422, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.05% (0.2758 => 0.3173, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.93% (0.0730 => 0.0839, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.86% (0.1117 => 0.1283) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.78% (0.2700 => 0.3099, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.78% (0.9765 => 1.1208, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.72% (0.2065 => 0.2369, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 14.69% (0.1906 => 0.2186, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.68% (0.0770 => 0.0883, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.67% (0.2107 => 0.2416, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.64% (4.2646 => 4.8889, std.dev.: 0.0025) SingleSource/UnitTests/SignlessTypes/rem: 14.51% (0.1144 => 0.1310, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 14.46% (0.7835 => 0.8968, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.40% (0.6450 => 0.7379, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.40% (0.5860 => 0.6704, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.30% (0.5981 => 0.6836, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.22% (0.1125 => 0.1285, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 14.06% (2.0273 => 2.3123, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.04% (0.1695 => 0.1933, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 14.03% (0.7433 => 0.8476, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.03% (0.1062 => 0.1211, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 13.99% (9.4845 => 10.8110, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.91% (0.0798 => 0.0909, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 13.68% (0.3180 => 0.3615, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 13.65% (0.4299 => 0.4886, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.64% (0.0770 => 0.0875, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.61% (0.0933 => 0.1060, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 13.61% (3.8723 => 4.3993, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.60% (0.1625 => 0.1846, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.56% (8.1363 => 9.2398, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 13.56% (1.0722 => 1.2176, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.51% (1.4186 => 1.6103, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.24% (0.3307 => 0.3745, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.23% (0.8067 => 0.9134, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.16% (0.5569 => 0.6302, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.13% (0.0929 => 0.1051, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 13.09% (0.1268 => 0.1434, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.95% (0.2603 => 0.2940, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.90% (0.3441 => 0.3885, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 12.76% (0.8921 => 1.0059, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.62% (4.9449 => 5.5687, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.57% (5.0018 => 5.6304, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.56% (0.1330 => 0.1497, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.46% (1.1861 => 1.3339, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 12.37% (0.3387 => 0.3806, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 12.29% (0.3092 => 0.3472, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 12.00% (5.7591 => 6.4501, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.97% (0.8101 => 0.9071, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 11.51% (2.2969 => 2.5613, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/parameter-passing: 11.41% (0.3927 => 0.4375, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.35% (0.3543 => 0.3945, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 11.29% (0.3561 => 0.3963, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 11.26% (0.4289 => 0.4772, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 11.23% (0.3473 => 0.3863, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.21% (0.3543 => 0.3940, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.13% (0.3828 => 0.4254, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 11.12% (0.0953 => 0.1059) SingleSource/UnitTests/ObjC/exceptions-3: 11.12% (0.3516 => 0.3907, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.10% (0.3497 => 0.3885, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.07% (0.3694 => 0.4103, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 11.02% (0.1044 => 0.1159, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 11.00% (0.6456 => 0.7166, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.99% (0.1892 => 0.2100, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.97% (2.2022 => 2.4437, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/property: 10.81% (0.3886 => 0.4306, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 10.43% (0.4620 => 0.5102, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.90% (0.4203 => 0.4619, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.86% (0.3865 => 0.4246, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 9.85% (0.3422 => 0.3759, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 9.78% (21.9371 => 24.0817, std.dev.: 0.0158) MultiSource/Applications/hbd/hbd: 9.68% (1.5603 => 1.7114, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.68% (0.4103 => 0.4500, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.57% (0.3826 => 0.4192, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.42% (0.2430 => 0.2659, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.32% (0.4636 => 0.5068, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 9.23% (0.3684 => 0.4024, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.22% (0.3427 => 0.3743, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 9.12% (0.4048 => 0.4417, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 8.99% (17.1811 => 18.7254, std.dev.: 0.0226) SingleSource/Benchmarks/Shootout-C++/sieve: 8.88% (0.3603 => 0.3923, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.81% (0.6030 => 0.6561, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.78% (0.5925 => 0.6445, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.51% (3.8922 => 4.2233, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.34% (14.3668 => 15.5652, std.dev.: 0.0091) SingleSource/UnitTests/ObjC++/property-reference: 8.29% (0.7326 => 0.7933, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.22% (0.4064 => 0.4398, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 7.91% (0.3098 => 0.3343, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.81% (0.3650 => 0.3935, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 7.81% (0.2831 => 0.3052, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.68% (0.3283 => 0.3535, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.61% (0.3232 => 0.3478, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 7.59% (0.3282 => 0.3531, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.45% (0.2872 => 0.3086, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 7.42% (0.2871 => 0.3084, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.37% (0.3162 => 0.3395, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.33% (0.2891 => 0.3103, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.31% (2.0665 => 2.2175, std.dev.: 0.0027) SingleSource/Regression/C++/ofstream_ctor: 7.26% (0.2905 => 0.3116, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 6.97% (10.4361 => 11.1636, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.97% (0.2756 => 0.2948, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.95% (0.2793 => 0.2987, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.92% (0.2877 => 0.3076, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 6.82% (0.3052 => 0.3260, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 6.81% (1.2842 => 1.3716, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.80% (0.2266 => 0.2420, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.75% (0.2725 => 0.2909, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 6.67% (0.2802 => 0.2989, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hello: 6.56% (0.2714 => 0.2892, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 6.33% (0.3379 => 0.3593, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.04% (7.9617 => 8.4429, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.55% (0.3136 => 0.3310, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.01% (0.3131 => 0.3288, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.82% (7.0540 => 7.3237, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.56% (0.3817 => 0.3953, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.51% (0.3935 => 0.4073, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: 31.50% (10.2830 => 13.5226, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1725, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.92% (1.1145 => 1.2919, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 14.09% (2.6778 => 3.0550, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.52% (0.9957 => 1.1303, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.80% (1.1396 => 1.2513, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.64% (2.8904 => 3.0824, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.64% (3.1578 => 3.3674, std.dev.: 0.0057) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 3.84% (1.9405 => 2.0151, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.21% (0.3987 => 0.4115, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.72% (4.2280 => 4.3431, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bisort/bisort: 1.97% (0.8333 => 0.8497, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 1.54% (3.1595 => 3.2080, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.50% (11.6436 => 11.8178, std.dev.: 0.0069) MultiSource/Applications/viterbi/viterbi: 1.23% (4.4649 => 4.5200, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.14% (2.6546 => 2.6849, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.04% (9.1159 => 9.2107, std.dev.: 0.0156) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.93% (6.6874 => 0.1382, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -82.52% (0.8651 => 0.1512, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -52.37% (5.2763 => 2.5131, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -45.25% (0.1622 => 0.0888, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.88% (5.3855 => 3.1839, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -40.30% (5.3526 => 3.1956, std.dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -8.96% (54.1659 => 49.3126, std.dev.: 0.0284) MultiSource/Benchmarks/Bullet/bullet: -8.23% (63.2438 => 58.0396, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.08% (1.7609 => 1.6187, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -4.76% (22.1758 => 21.1204, std.dev.: 0.0383) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.54% (1.1194 => 1.0686, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.48% (2.9384 => 2.8067, std.dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -52.84% (8.0499 => 3.7967, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -38.00% (0.0400 => 0.0248, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -33.34% (1.1492 => 0.7660, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -29.01% (10.7105 => 7.6031, std.dev.: 0.0170) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4751, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4236, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.73% (1.2258 => 1.0697, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -11.87% (1.2373 => 1.0904, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel-2: -10.87% (1.5373 => 1.3702, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.45% (19.9488 => 18.2631, std.dev.: 0.0223) MultiSource/Benchmarks/FreeBench/mason/mason: -8.01% (0.2161 => 0.1988, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.01% (1.8329 => 1.7045, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -5.46% (6.6465 => 6.2837, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: -5.06% (1.5835 => 1.5033, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.92% (1.6805 => 1.5979, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.33% (8.1563 => 7.8031, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1624, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -3.33% (5.0483 => 4.8803, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4965, std.dev.: 0.0032) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.70% (0.4808 => 0.4678, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6812, std.dev.: 0.0026) SingleSource/UnitTests/Vector/multiplies: -1.70% (2.5528 => 2.5094, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4221, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: -1.42% (4.6441 => 4.5780, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -1.10% (6.2999 => 6.2303, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -5.19% (0.1485 => 0.1408, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649) Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 06:20:06 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 08:20:06 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121026132006.D34AC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5249?compare_to=5245&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5249, Order: 166767, Start Time: 2012-10-26 11:55:10, End Time: 2012-10-26 13:20:01 To: 5245, Order: 166763, Start Time: 2012-10-26 10:07:30, End Time: 2012-10-26 11:32:21 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (182 on baseline) Unchanged Tests: 1042 (856 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1009, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: 2.34% (7.4937 => 7.6689, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/hash2: 2.17% (3.1932 => 3.2624, std.dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.15% (0.1431 => 0.1300, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.06% (0.3821 => 0.3513, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -7.79% (2.4924 => 2.2982, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: -7.06% (0.3357 => 0.3120, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.97% (0.3142 => 0.2923, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.96% (0.2428 => 0.2259, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.87% (22.4056 => 20.8672, std.dev.: 0.0138) SingleSource/UnitTests/ObjC/exceptions-2: -6.81% (0.3831 => 0.3570, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.80% (0.3884 => 0.3620, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.78% (0.3880 => 0.3617, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -6.77% (0.4033 => 0.3760, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -6.77% (0.3812 => 0.3554, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -6.73% (0.4176 => 0.3895, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.72% (0.3658 => 0.3412, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -6.70% (0.3848 => 0.3590, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -6.70% (0.3896 => 0.3635, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.68% (0.3891 => 0.3631, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.67% (3.5339 => 3.2981, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -6.66% (4.3330 => 4.0444, std.dev.: 0.0082) MultiSource/Applications/Burg/burg: -6.65% (1.2515 => 1.1683, std.dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: -6.63% (16.1920 => 15.1177, std.dev.: 0.0138) SingleSource/Benchmarks/Misc/ReedSolomon: -6.60% (0.1879 => 0.1755, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -6.59% (7.0961 => 6.6284, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/property: -6.57% (0.4199 => 0.3923, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.57% (0.1796 => 0.1678, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.57% (0.7919 => 0.7399, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: -6.54% (0.9179 => 0.8579, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -6.53% (0.1761 => 0.1646, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: -6.51% (1.1530 => 1.0779, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.51% (0.6484 => 0.6062, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: -6.51% (0.2659 => 0.2486, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.50% (1.6474 => 1.5403, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -6.48% (9.2283 => 8.6300, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/oourafft: -6.44% (0.2160 => 0.2021, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.43% (6.7716 => 6.3359, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.43% (0.4151 => 0.3884, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -6.43% (4.0594 => 3.7983, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.43% (5.4682 => 5.1167, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.42% (0.2695 => 0.2522, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.41% (0.2355 => 0.2204, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.41% (0.1716 => 0.1606, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.41% (1.2300 => 1.1512, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -6.40% (2.4021 => 2.2483, std.dev.: 0.0120) MultiSource/Benchmarks/Olden/bh/bh: -6.40% (0.2985 => 0.2794, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.38% (1.3722 => 1.2846, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.37% (0.9542 => 0.8934, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.35% (0.6736 => 0.6308, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.34% (1.0544 => 0.9875, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -6.33% (1.1450 => 1.0725, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.32% (0.9852 => 0.9229, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.31% (0.1584 => 0.1484, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: -6.31% (0.4280 => 0.4010, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.30% (4.5069 => 4.2228, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.22% (4.8161 => 4.5163, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.21% (1.6364 => 1.5348, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.21% (1.4642 => 1.3733, std.dev.: 0.0046) MultiSource/Applications/minisat/minisat: -6.20% (0.7447 => 0.6985, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: -6.17% (0.4861 => 0.4561, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.17% (0.7198 => 0.6754, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -6.17% (1.3148 => 1.2337, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.16% (0.2548 => 0.2391, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.16% (0.3931 => 0.3689, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.14% (14.2083 => 13.3359, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -6.13% (0.4321 => 0.4056, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.13% (2.2587 => 2.1202, std.dev.: 0.0171) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.12% (4.0323 => 3.7854, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.12% (0.6293 => 0.5908, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.09% (4.8802 => 4.5829, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/18-imp/imp: -6.09% (0.3581 => 0.3363, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -6.00% (18.2933 => 17.1956, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.99% (1.2784 => 1.2018, std.dev.: 0.0073) MultiSource/Benchmarks/sim/sim: -5.99% (0.3406 => 0.3202, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.99% (0.3491 => 0.3282, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -5.98% (0.3026 => 0.2845, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.97% (0.3837 => 0.3608, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.97% (0.3252 => 0.3058, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -5.96% (0.3255 => 0.3061, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -5.94% (34.0927 => 32.0673, std.dev.: 0.0132) MultiSource/Applications/SPASS/SPASS: -5.94% (15.5079 => 14.5871, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.93% (0.5999 => 0.5643, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.92% (0.3849 => 0.3621, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.92% (0.5168 => 0.4862, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: -5.89% (0.4515 => 0.4249, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: -5.87% (2.1401 => 2.0144, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.87% (0.4427 => 0.4167, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -5.87% (1.3864 => 1.3050, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.87% (0.3323 => 0.3128, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.87% (0.6681 => 0.6289, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -5.86% (0.3446 => 0.3244, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -5.86% (0.3481 => 0.3277, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -5.85% (0.2989 => 0.2814, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.85% (0.5591 => 0.5264, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: -5.84% (0.4524 => 0.4260, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.82% (0.6052 => 0.5700, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.80% (0.4083 => 0.3846, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.80% (1.2221 => 1.1512, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.80% (0.6395 => 0.6024, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: -5.80% (0.3621 => 0.3411, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.79% (0.2106 => 0.1984, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: -5.79% (0.3025 => 0.2850, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -5.78% (0.2871 => 0.2705, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -5.77% (17.1032 => 16.1172, std.dev.: 0.0222) SingleSource/Benchmarks/Misc-C++/bigfib: -5.76% (0.6750 => 0.6361, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.76% (0.6230 => 0.5871, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.76% (0.6304 => 0.5941, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.75% (0.5805 => 0.5471, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.75% (0.2903 => 0.2736, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.75% (0.2278 => 0.2147, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.75% (0.7339 => 0.6917, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -5.75% (0.3394 => 0.3199, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.74% (0.3483 => 0.3283, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.74% (0.4916 => 0.4634, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.73% (0.6260 => 0.5901, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.73% (0.5478 => 0.5164, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.73% (0.5705 => 0.5378, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -5.73% (0.7982 => 0.7525, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.72% (1.2210 => 1.1511, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.72% (2.1713 => 2.0470, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.72% (0.5859 => 0.5524, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: -5.71% (3.5154 => 3.3145, std.dev.: 0.0064) MultiSource/Applications/ClamAV/clamscan: -5.71% (15.2527 => 14.3812, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.71% (0.6676 => 0.6295, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.70% (0.3016 => 0.2844, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -5.70% (0.3788 => 0.3572, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.70% (0.5581 => 0.5263, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.67% (0.2999 => 0.2829, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.67% (0.8521 => 0.8038, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.66% (0.2933 => 0.2767, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.66% (0.3057 => 0.2884, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.65% (0.6297 => 0.5941, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.65% (0.6194 => 0.5844, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.64% (0.5941 => 0.5606, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: -5.63% (0.4248 => 0.4009, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.62% (0.6667 => 0.6292, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -5.61% (0.3867 => 0.3650) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.60% (0.6446 => 0.6085, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.60% (0.5575 => 0.5263, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.59% (0.6189 => 0.5843, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.59% (0.9557 => 0.9023, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.58% (0.5863 => 0.5536, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.57% (0.5925 => 0.5595, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.57% (0.6033 => 0.5697, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.57% (0.7524 => 0.7105, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.57% (8.0126 => 7.5664, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.57% (0.5857 => 0.5531, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -5.55% (0.2849 => 0.2691, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.53% (0.2385 => 0.2253, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.53% (0.6440 => 0.6084) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.53% (0.6660 => 0.6292, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: -5.51% (0.3194 => 0.3018, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.50% (0.5329 => 0.5036, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: -5.49% (0.3205 => 0.3029, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.49% (0.4813 => 0.4549, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -5.48% (0.2939 => 0.2778, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.47% (0.6395 => 0.6045, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.46% (0.5569 => 0.5265, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.45% (0.5802 => 0.5486, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: -5.44% (0.3271 => 0.3093, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.43% (0.5456 => 0.5160) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.42% (0.3319 => 0.3139, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.40% (0.7021 => 0.6642, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -5.39% (0.8418 => 0.7964, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: -5.37% (0.7779 => 0.7361, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.37% (0.5567 => 0.5268, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.35% (0.5570 => 0.5272, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -5.30% (0.3059 => 0.2897, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.27% (0.5688 => 0.5388, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.25% (0.5849 => 0.5542, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -5.05% (0.6441 => 0.6116, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -5.03% (0.6347 => 0.6028, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.43% (0.9077 => 0.8675, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: -4.39% (5.0226 => 4.8021, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: -4.35% (1.5610 => 1.4931, std.dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -3.48% (20.7746 => 20.0508, std.dev.: 0.0248) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7501, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1728, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.95% (2.2633 => 2.1738, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.84% (1.7753 => 1.7071, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.21% (1.3096 => 1.2676, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4718, std.dev.: 0.0028) Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 06:54:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 08:54:28 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121026135428.E17242A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5250?compare_to=5247&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5250, Order: 166767, Start Time: 2012-10-26 12:30:28, End Time: 2012-10-26 13:54:26 To: 5247, Order: 166766, Start Time: 2012-10-26 10:49:26, End Time: 2012-10-26 12:12:58 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 2 (41 on baseline) Performance Improvements: 1 (3 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 972 (930 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.95% (0.3041 => 0.3161, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.93% (1.5792 => 1.6096, std.dev.: 0.0066) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.40% (0.8930 => 0.8805, std.dev.: 0.0040) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.16% (16.5205 => 16.4939, std.dev.: 0.2899) MultiSource/Applications/obsequi/Obsequi: -0.09% (1.0501 => 1.0492, std.dev.: 0.0159) MultiSource/Applications/sqlite3/sqlite3: 0.16% (0.6429 => 0.6439, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/08-main/main: 1.33% (0.1875 => 0.1900, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.47% (0.1722 => 0.1645, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.03% (0.3241 => 0.3240, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.17% (0.2439 => 0.2492, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.46% (0.3371 => 0.3288, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.86% (0.2364 => 0.2408, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 0.45% (0.5991 => 0.6018, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/mandel: -3.48% (0.0488 => 0.0471, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.33% (0.3306 => 0.3317, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/strcat: -0.05% (0.1991 => 0.1990, std.dev.: 0.0019) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 19.32% (0.0207 => 0.0247, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 18.38% (0.0185 => 0.0219, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.17% (0.0427 => 0.0422, std.dev.: 0.0053) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 16.37% (0.0281 => 0.0327, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0315 => 0.0315, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -12.98% (0.0416 => 0.0362, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/casts: -1.47% (0.0204 => 0.0201, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/test1: 6.90% (0.0203 => 0.0217, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -6.58% (0.0365 => 0.0341, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.74% (0.1489 => 0.1478, std.dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -0.77% (1.1319 => 1.1232, std.dev.: 0.0242) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.41% (0.1466 => 0.1516, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.23% (0.4091 => 0.4264, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -7.05% (0.1404 => 0.1305, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.04% (0.0659 => 0.0606, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -23.26% (0.0258 => 0.0198, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.89% (0.0566 => 0.0544, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.14% (1.1446 => 1.1430, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -85.71% (0.0007 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.90% (0.0555 => 0.0560, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 13.07% (0.0176 => 0.0199, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.06% (0.8012 => 0.8017, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -85.71% (0.0007 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 11.11% (0.0063 => 0.0070, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.26% (2.1832 => 1.6536, std.dev.: 0.0041) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.19% (0.0810 => 0.0933, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 11.15% (0.1112 => 0.1236, std.dev.: 0.0022) MultiSource/Applications/hbd/hbd: 3.81% (1.4269 => 1.4812, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.79% (0.3717 => 0.3858, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.64% (0.2998 => 0.3107, std.dev.: 0.0025) MultiSource/Applications/spiff/spiff: 3.64% (0.7950 => 0.8239, std.dev.: 0.0055) MultiSource/Applications/treecc/treecc: 2.46% (1.9948 => 2.0438, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.12% (0.8597 => 0.8779, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.11% (1.4479 => 1.4784, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.02% (0.7966 => 0.8127, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.97% (0.8007 => 0.8165, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.96% (0.9069 => 0.9247, std.dev.: 0.0028) MultiSource/Applications/SIBsim4/SIBsim4: 1.93% (1.2568 => 1.2811, std.dev.: 0.0057) MultiSource/Applications/lemon/lemon: 1.92% (1.0945 => 1.1155, std.dev.: 0.0065) MultiSource/Applications/ClamAV/clamscan: 1.91% (14.7684 => 15.0509, std.dev.: 0.0453) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.85% (0.8359 => 0.8514, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.82% (13.1811 => 13.4206, std.dev.: 0.0876) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.79% (6.6074 => 6.7254, std.dev.: 0.0454) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.75% (1.2423 => 1.2640, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.65% (0.8050 => 0.8183, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.60% (0.8518 => 0.8654, std.dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 1.53% (1.1271 => 1.1443, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.51% (0.8317 => 0.8443, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.49% (0.8457 => 0.8583, std.dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: 1.47% (31.8598 => 32.3270, std.dev.: 0.0602) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.36% (0.9074 => 0.9197, std.dev.: 0.0041) MultiSource/Applications/SPASS/SPASS: 1.33% (14.2605 => 14.4508, std.dev.: 0.0704) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.26% (0.8204 => 0.8307, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.22% (0.9688 => 0.9806, std.dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 1.06% (8.6247 => 8.7157, std.dev.: 0.0297) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 56.44% (1.5795 => 2.4709, std.dev.: 0.0208) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.82% (0.3186 => 0.3499, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.55% (1.1857 => 1.2871, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 5.97% (63.1822 => 66.9536, std.dev.: 0.0149) SingleSource/Benchmarks/Dhrystone/dry: 3.78% (0.5081 => 0.5273, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.41% (2.4490 => 2.5325, std.dev.: 0.0062) MultiSource/Applications/siod/siod: 2.85% (3.6643 => 3.7689, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/ReedSolomon: 2.09% (8.5322 => 8.7109, std.dev.: 0.0600) MultiSource/Benchmarks/Olden/bh/bh: 1.65% (2.3560 => 2.3948, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.45% (1.5866 => 1.6096, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.11% (4.8362 => 4.8899, std.dev.: 0.0099) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -5.05% (29.8330 => 28.3264, std.dev.: 0.1404) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.45% (3.3479 => 3.2994, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash2: -1.43% (3.4237 => 3.3746, std.dev.: 0.0016) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.29% (16.4461 => 16.4939, std.dev.: 0.2899) MultiSource/Applications/obsequi/Obsequi: 2.24% (1.0262 => 1.0492, std.dev.: 0.0159) MultiSource/Applications/sqlite3/sqlite3: 1.69% (0.6332 => 0.6439, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/08-main/main: 3.77% (0.1831 => 0.1900, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.52% (0.1559 => 0.1645, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.75% (0.3123 => 0.3240, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.18% (0.2463 => 0.2492, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.67% (0.3344 => 0.3288, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.86% (0.2364 => 0.2408, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 0.13% (0.6010 => 0.6018, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/mandel: 9.79% (0.0429 => 0.0471, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.56% (0.3266 => 0.3317, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/strcat: 1.07% (0.1969 => 0.1990, std.dev.: 0.0019) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 10.27% (0.0224 => 0.0247, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.43% (0.0408 => 0.0422, std.dev.: 0.0053) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 28.74% (0.0254 => 0.0327, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -5.73% (0.0384 => 0.0362, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/casts: 5.79% (0.0190 => 0.0201, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: 48.26% (0.0230 => 0.0341, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.78% (0.1438 => 0.1478, std.dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -0.86% (1.1329 => 1.1232, std.dev.: 0.0242) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.69% (0.1462 => 0.1516, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.40% (0.4164 => 0.4264, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.67% (0.1369 => 0.1305, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.46% (0.0641 => 0.0606, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.54% (0.0195 => 0.0198, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.88% (0.0578 => 0.0544, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.06% (1.1437 => 1.1430, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.69% (0.0627 => 0.0560, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 10.56% (0.0180 => 0.0199, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: - (0.8017 => 0.8017, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 12.90% (0.0062 => 0.0070, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 07:40:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 09:40:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121026144045.95B342A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5251?compare_to=5248&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5251, Order: 166773, Start Time: 2012-10-26 13:17:43, End Time: 2012-10-26 14:40:40 To: 5248, Order: 166767, Start Time: 2012-10-26 11:24:51, End Time: 2012-10-26 12:47:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (73 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (196 on baseline) Performance Improvements: 3 (50 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 75 (2 on baseline) Unchanged Tests: 963 (642 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 2.12% (21.1204 => 21.5675, std.dev.: 0.0188) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.87% (3.1956 => 3.1040, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -2.22% (14.1109 => 13.7974, std.dev.: 0.0167) MultiSource/Applications/Burg/burg: -1.07% (1.3467 => 1.3323, std.dev.: 0.0023) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.41% (0.0486 => 0.0488) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.41% (0.0487 => 0.0489, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.22% (0.0456 => 0.0457, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.44% (0.0457 => 0.0459, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.45% (0.0445 => 0.0447, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.45% (0.0447 => 0.0449, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.46% (0.0439 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.45% (0.0440 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.22% (0.0458 => 0.0459) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.22% (0.0458 => 0.0459, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.44% (0.0451 => 0.0453, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.44% (0.0452 => 0.0454, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.45% (0.0441 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.45% (0.0443 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.45% (0.0449 => 0.0451, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.22% (0.0450 => 0.0451, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.22% (0.0460 => 0.0461, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.43% (0.0461 => 0.0463, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.46% (0.0436 => 0.0438) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.23% (0.0438 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.67% (0.0448 => 0.0451) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.44% (0.0450 => 0.0452, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.23% (0.0440 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.23% (0.0442 => 0.0443) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.23% (0.0432 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.23% (0.0433 => 0.0434, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.47% (0.0430 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.46% (0.0432 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.21% (0.0468 => 0.0469, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.21% (0.0469 => 0.0470, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.23% (0.0430 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.23% (0.0431 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.46% (0.0431 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.46% (0.0431 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.23% (0.0439 => 0.0440, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.23% (0.0440 => 0.0441, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/BenchmarkGame/puzzle MultiSource/Applications/oggenc/oggenc: - (0.1408 => 0.1408, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.24% (0.0649 => 0.0683, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: - (0.3825 => 0.3825, std.dev.: 0.0011) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.06% (0.6962 => 0.3825, std.dev.: 0.0011) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 202.37% (0.5229 => 1.5811, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 15.63% (14.9895 => 17.3319, std.dev.: 0.0074) MultiSource/Applications/kimwitu++/kc: 36.96% (14.1553 => 19.3878, std.dev.: 0.0175) MultiSource/Benchmarks/MallocBench/gs/gs: 13.23% (4.1105 => 4.6544, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 35.40% (1.1048 => 1.4959, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 317.44% (7.1582 => 29.8810, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.28% (3.4629 => 5.8274, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 66.88% (0.6222 => 1.0383, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 11823.61% (0.0720 => 8.5850, std.dev.: 0.0122) MultiSource/Applications/SIBsim4/SIBsim4: 4014900.00% (0.0001 => 4.0150, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 11146400.00% (0.0001 => 11.1465, std.dev.: 0.0374) MultiSource/Applications/kimwitu++/kc: 50600.00% (0.0001 => 0.0507, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 793800.00% (0.0001 => 0.7939, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049400.00% (0.0001 => 10.0495, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5491700.00% (0.0001 => 5.4918, std.dev.: 0.0095) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 68.75% (0.0256 => 0.0432, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 56.38% (0.0243 => 0.0380) SingleSource/Regression/C/sumarray2d: 54.24% (0.0271 => 0.0418) SingleSource/Regression/C/sumarray: 44.59% (0.0231 => 0.0334) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.72% (1.5859 => 2.2475, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/distray/distray: 40.15% (0.1056 => 0.1480, std.dev.: 0.0001) SingleSource/UnitTests/vla: 33.52% (0.0355 => 0.0474, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 33.09% (10.3673 => 13.7974, std.dev.: 0.0167) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.84% (2.2024 => 2.8816, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 28.63% (0.1432 => 0.1842, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 28.30% (0.1463 => 0.1877, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 24.65% (0.1655 => 0.2063, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 24.34% (0.0834 => 0.1037, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.52% (0.1566 => 0.1903, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 21.03% (0.2049 => 0.2480, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/hash: 20.62% (0.0485 => 0.0585, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.29% (0.0871 => 0.1039, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 19.27% (0.4879 => 0.5819, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 18.84% (0.1555 => 0.1848, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 18.70% (0.3177 => 0.3771, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 18.69% (0.5105 => 0.6059, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.52% (0.0648 => 0.0768, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 17.83% (0.0746 => 0.0879, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 17.81% (0.0730 => 0.0860, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.72% (0.6675 => 0.7858, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 17.62% (0.1175 => 0.1382, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 17.58% (0.2554 => 0.3003, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.18% (1.3050 => 1.5292, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: 16.93% (0.0626 => 0.0732, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.72% (0.1029 => 0.1201, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 16.66% (3.3354 => 3.8912, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 16.52% (0.1695 => 0.1975, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.39% (0.0793 => 0.0923, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.29% (0.2271 => 0.2641, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 16.25% (0.1163 => 0.1352, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 16.23% (0.1337 => 0.1554, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.16% (0.8172 => 0.9493, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.04% (1.5415 => 1.7888, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.89% (0.1032 => 0.1196, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 15.87% (0.7115 => 0.8244, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 15.86% (1.1840 => 1.3718, std.dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.86% (0.4615 => 0.5347, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.80% (0.5020 => 0.5813, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.76% (0.3121 => 0.3613, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.58% (0.0886 => 0.1024, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.56% (0.0842 => 0.0973, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.36% (0.1510 => 0.1742, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 15.34% (0.3109 => 0.3586, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.31% (0.1940 => 0.2237, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.27% (0.0838 => 0.0966, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.26% (0.0675 => 0.0778, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 15.01% (0.1906 => 0.2192, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/exptree: 14.74% (0.0814 => 0.0934, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.59% (0.1117 => 0.1280, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.56% (0.1236 => 0.1416, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.46% (0.1584 => 0.1813, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 14.44% (1.1642 => 1.3323, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.42% (0.9765 => 1.1173, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.38% (0.2065 => 0.2362, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.38% (0.2107 => 0.2410, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 14.34% (0.1151 => 0.1316, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.32% (4.2646 => 4.8751, std.dev.: 0.0180) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.30% (0.2700 => 0.3086, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 14.26% (0.3423 => 0.3911, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.25% (0.2758 => 0.3151, std.dev.: 0.0019) SingleSource/UnitTests/SignlessTypes/rem: 14.16% (0.1144 => 0.1306, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.16% (0.0770 => 0.0879, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.13% (0.1125 => 0.1284, std.dev.: 0.0027) MultiSource/Applications/spiff/spiff: 13.96% (0.7835 => 0.8929, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 13.94% (0.6450 => 0.7349, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.91% (0.0798 => 0.0909, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.78% (0.5981 => 0.6805, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 13.73% (9.4845 => 10.7870, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 13.67% (0.7433 => 0.8449, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.65% (0.1062 => 0.1207, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.63% (0.5860 => 0.6659, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.61% (0.0933 => 0.1060) MultiSource/Applications/treecc/treecc: 13.57% (2.0273 => 2.3025, std.dev.: 0.0129) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.57% (0.1695 => 0.1925) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.49% (8.1363 => 9.2336, std.dev.: 0.0082) MultiSource/Applications/lemon/lemon: 13.29% (1.0722 => 1.2147, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.29% (1.4186 => 1.6071, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.13% (0.0929 => 0.1051, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.12% (0.0770 => 0.0871, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 13.05% (3.8723 => 4.3777, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/09-vor/vor: 13.05% (0.3180 => 0.3595, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.03% (0.3307 => 0.3738, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.92% (0.1625 => 0.1835, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 12.84% (0.4299 => 0.4851, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.75% (0.2603 => 0.2935, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/health/health: 12.70% (0.1268 => 0.1429, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.70% (0.5569 => 0.6276, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.64% (0.8067 => 0.9087, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/football/football: 12.55% (0.8921 => 1.0041, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.43% (5.0018 => 5.6234, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.41% (4.9449 => 5.5588, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.26% (0.1330 => 0.1493, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.21% (0.3441 => 0.3861, std.dev.: 0.0028) MultiSource/Benchmarks/sim/sim: 12.19% (0.3387 => 0.3800, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.19% (1.1861 => 1.3307, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/bh/bh: 12.00% (0.3092 => 0.3463, std.dev.: 0.0047) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.90% (0.1143 => 0.1279, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.38% (0.8101 => 0.9023, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 11.27% (5.7591 => 6.4083, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hash: 11.17% (0.4289 => 0.4768, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.00% (0.3927 => 0.4359, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 10.99% (2.2969 => 2.5494, std.dev.: 0.0160) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 10.91% (0.0953 => 0.1057, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.90% (0.3561 => 0.3949, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 10.89% (0.3516 => 0.3899, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.86% (0.3473 => 0.3850, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.78% (0.1892 => 0.2096, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 10.78% (0.3543 => 0.3925, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.78% (0.3543 => 0.3925, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 10.78% (0.6456 => 0.7152, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 10.76% (0.3828 => 0.4240, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.69% (0.3497 => 0.3871, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.67% (0.3694 => 0.4088, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 10.65% (0.4620 => 0.5112, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.37% (0.3886 => 0.4289, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.34% (0.1044 => 0.1152, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.11% (2.2022 => 2.4249, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 9.91% (0.3422 => 0.3761, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.81% (0.3865 => 0.4244, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.73% (0.4203 => 0.4612, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.66% (0.4636 => 0.5084, std.dev.: 0.0057) MultiSource/Applications/JM/lencod/lencod: 9.54% (21.9371 => 24.0304, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/lists1: 9.47% (0.3684 => 0.4033, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 9.47% (1.5603 => 1.7081, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/moments: 9.36% (0.4048 => 0.4427, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.36% (0.3826 => 0.4184, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.24% (0.4103 => 0.4482, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 9.14% (0.6030 => 0.6581, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/Hello: 9.13% (0.5925 => 0.6466, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.89% (0.2430 => 0.2646, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.84% (0.3427 => 0.3730, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 8.74% (0.3603 => 0.3918, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 8.67% (17.1811 => 18.6701, std.dev.: 0.0259) SingleSource/UnitTests/ObjC++/property-reference: 8.49% (0.7326 => 0.7948, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.29% (14.3668 => 15.5585, std.dev.: 0.0125) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.27% (0.4064 => 0.4400, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.22% (3.8922 => 4.2120, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.00% (0.3650 => 0.3942, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 7.88% (0.3098 => 0.3342, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 7.77% (0.2831 => 0.3051, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.71% (0.2891 => 0.3114, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.63% (0.2872 => 0.3091, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 7.61% (0.3232 => 0.3478, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.58% (0.3283 => 0.3532, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.46% (0.3162 => 0.3398, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/except: 7.42% (0.2871 => 0.3084, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.38% (2.0665 => 2.2190, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 7.37% (0.2905 => 0.3119, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.30% (0.2877 => 0.3087, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.27% (0.2793 => 0.2996, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.22% (0.2756 => 0.2955, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wc: 7.14% (0.3052 => 0.3270, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.12% (0.2725 => 0.2919, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.89% (0.2802 => 0.2995, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 6.83% (0.3282 => 0.3506, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.82% (0.2714 => 0.2899, std.dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: 6.80% (1.2842 => 1.3715, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.62% (0.2266 => 0.2416, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.57% (0.3379 => 0.3601, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 6.29% (10.4361 => 11.0930, std.dev.: 0.0137) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.88% (7.9617 => 8.4301, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.71% (0.3136 => 0.3315, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (0.3131 => 0.3294, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.79% (0.3935 => 0.4084, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.59% (7.0540 => 7.3069, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.14% (0.3817 => 0.3937, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: 31.40% (10.2830 => 13.5116, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1726, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 14.08% (2.6778 => 3.0549, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.36% (0.9957 => 1.1287, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.87% (1.1396 => 1.2521, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 6.69% (0.1629 => 0.1738, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.64% (2.8904 => 3.0824, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.61% (3.1578 => 3.3665, std.dev.: 0.0016) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626) MultiSource/Benchmarks/Olden/bh/bh: 3.80% (1.9405 => 2.0142, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.19% (0.3987 => 0.4114, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.62% (4.2280 => 4.3387, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.78% (0.8333 => 0.8481, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2077, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.49% (11.6436 => 11.8174, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.42% (2.6546 => 2.6923, std.dev.: 0.0008) MultiSource/Benchmarks/llubenchmark/llu: 1.38% (3.7781 => 3.8304, std.dev.: 0.0179) MultiSource/Applications/viterbi/viterbi: 1.33% (4.4649 => 4.5242, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.94% (6.6874 => 0.1377, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -82.49% (0.8651 => 0.1515, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -52.39% (5.2763 => 2.5119, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -45.56% (0.1622 => 0.0883, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -42.01% (5.3526 => 3.1040, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -41.06% (5.3855 => 3.1743, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -8.96% (63.2438 => 57.5750, std.dev.: 0.0087) SingleSource/UnitTests/Vector/constpool: -8.84% (54.1659 => 49.3760, std.dev.: 0.0315) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.27% (1.7609 => 1.6152, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.82% (2.9384 => 2.7969, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.65% (1.1194 => 1.0674, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -2.74% (22.1758 => 21.5675, std.dev.: 0.0188) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -52.87% (8.0499 => 3.7939, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.47% (1.1492 => 0.7646, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -28.99% (10.7105 => 7.6059, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4750, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.75% (1.6925 => 1.4260, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.73% (0.0998 => 0.0851, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.67% (1.2258 => 1.0705, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.29% (1.2373 => 1.0976, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -10.80% (1.5373 => 1.3713, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.42% (19.9488 => 18.2685, std.dev.: 0.0223) MultiSource/Benchmarks/FreeBench/mason/mason: -8.01% (0.2161 => 0.1988, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.98% (1.8329 => 1.7049, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/oourafft: -5.45% (6.6465 => 6.2841, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.95% (1.6805 => 1.5973, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7614) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.80% (1.5835 => 1.5075, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.28% (8.1563 => 7.8076, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Applications/siod/siod: -3.63% (3.2827 => 3.1635, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -3.33% (5.0483 => 4.8803, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4974, std.dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.58% (0.4808 => 0.4684, std.dev.: 0.0037) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6804, std.dev.: 0.0019) SingleSource/UnitTests/Vector/multiplies: -1.69% (2.5528 => 2.5096, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4212, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: -1.35% (4.6441 => 4.5812, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8583, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout/lists: -1.00% (6.2999 => 6.2368, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -5.19% (0.1485 => 0.1408, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.72% (0.2116 => 0.0683, std.dev.: 0.0004) Report Time: 2.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 08:07:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 10:07:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121026150753.23FFF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5252?compare_to=5249&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5252, Order: 166773, Start Time: 2012-10-26 13:42:49, End Time: 2012-10-26 15:07:48 To: 5249, Order: 166767, Start Time: 2012-10-26 11:55:10, End Time: 2012-10-26 13:20:01 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 1 (187 on baseline) Unchanged Tests: 1041 (851 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.13% (0.8934 => 0.8833, std.dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.64% (2.0478 => 2.1018, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/salsa20: 2.43% (7.4937 => 7.6760, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/hash2: 2.32% (3.1932 => 3.2673, std.dev.: 0.0083) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.36% (0.1431 => 0.1297) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.45% (0.3821 => 0.3498, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -8.10% (2.4924 => 2.2904, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.67% (0.3142 => 0.2901, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.43% (0.9542 => 0.8833, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -7.31% (0.2160 => 0.2002, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -7.30% (0.3357 => 0.3112, std.dev.: 0.0069) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.29% (22.4056 => 20.7733, std.dev.: 0.0147) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -7.27% (3.5339 => 3.2769, std.dev.: 0.0174) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.21% (0.2428 => 0.2253, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: -7.19% (16.1920 => 15.0278, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/ReedSolomon: -7.18% (0.1879 => 0.1744, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: -7.07% (0.1796 => 0.1669, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -7.06% (7.0961 => 6.5954, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/football/football: -7.04% (0.9179 => 0.8533, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: -7.03% (1.1530 => 1.0719, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -7.01% (0.3880 => 0.3608, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -7.00% (0.3658 => 0.3402, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -6.97% (0.3831 => 0.3564, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -6.96% (9.2283 => 8.5863, std.dev.: 0.0160) SingleSource/UnitTests/ObjC/trivial-interface: -6.95% (0.3812 => 0.3547, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -6.93% (0.1761 => 0.1639, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.91% (0.3848 => 0.3582, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -6.90% (0.3896 => 0.3627, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.89% (0.4033 => 0.3755, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.89% (0.9852 => 0.9173, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.87% (0.4176 => 0.3889, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -6.87% (4.3330 => 4.0354, std.dev.: 0.0062) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.84% (0.3891 => 0.3625, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -6.81% (1.1450 => 1.0670, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: -6.81% (1.2515 => 1.1663, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.79% (5.4682 => 5.0969, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.77% (1.6474 => 1.5358, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.77% (1.2784 => 1.1919, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.76% (0.1584 => 0.1477, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.75% (1.3722 => 1.2796, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.75% (0.3884 => 0.3622, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.74% (0.6484 => 0.6047, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/neural/neural: -6.73% (0.1500 => 0.1399, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.72% (0.2695 => 0.2514, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.71% (1.0544 => 0.9837, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.68% (1.4642 => 1.3664, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.68% (14.2083 => 13.2596, std.dev.: 0.0118) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.67% (1.2300 => 1.1480, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.67% (0.6736 => 0.6287, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: -6.64% (0.4199 => 0.3920, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.64% (0.1716 => 0.1602, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.64% (0.7919 => 0.7393, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.62% (0.2355 => 0.2199, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: -6.62% (0.2659 => 0.2483, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.61% (6.7716 => 6.3237, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.60% (4.5069 => 4.2094, std.dev.: 0.0089) MultiSource/Benchmarks/Olden/bh/bh: -6.60% (0.2985 => 0.2788, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -6.59% (4.0594 => 3.7918, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.57% (4.8161 => 4.4999, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.55% (0.5805 => 0.5425, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: -6.54% (0.1621 => 0.1515, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.54% (1.6364 => 1.5294, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.54% (0.6304 => 0.5892, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -6.52% (0.4280 => 0.4001, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.52% (4.8802 => 4.5621, std.dev.: 0.0136) MultiSource/Applications/minisat/minisat: -6.51% (0.7447 => 0.6962, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: -6.51% (1.3148 => 1.2292, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.50% (0.4151 => 0.3881, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -6.49% (0.3406 => 0.3185, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.49% (4.0323 => 3.7708, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.47% (0.3849 => 0.3600, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.45% (0.6293 => 0.5887, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: -6.44% (0.5168 => 0.4835, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.42% (0.6297 => 0.5893, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -6.42% (2.4021 => 2.2480, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.42% (2.2587 => 2.1138, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.41% (0.5863 => 0.5487, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.41% (0.5478 => 0.5127, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -6.40% (0.4515 => 0.4226, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -6.40% (0.5705 => 0.5340, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.38% (0.5859 => 0.5485, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -6.37% (0.3581 => 0.3353, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.36% (0.6395 => 0.5988, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.36% (0.6052 => 0.5667, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -6.36% (17.1032 => 16.0155, std.dev.: 0.0260) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.35% (0.5925 => 0.5549, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: -6.34% (0.4861 => 0.4553, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.33% (0.3931 => 0.3682, std.dev.: 0.0050) MultiSource/Applications/SIBsim4/SIBsim4: -6.33% (1.3864 => 1.2986, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.33% (0.6681 => 0.6258, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: -6.33% (0.3491 => 0.3270, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.32% (0.2548 => 0.2387, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.32% (1.2221 => 1.1449, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.31% (0.5802 => 0.5436, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.30% (0.3252 => 0.3047, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.30% (0.5857 => 0.5488, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.30% (0.5591 => 0.5239, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: -6.28% (15.5079 => 14.5338, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -6.28% (0.6660 => 0.6242, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -6.27% (0.7524 => 0.7052, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -6.27% (0.6395 => 0.5994, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -6.25% (0.6750 => 0.6328, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.24% (0.6440 => 0.6038, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -6.24% (0.5575 => 0.5227, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -6.24% (0.3255 => 0.3052, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -6.23% (0.2871 => 0.2692, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -6.23% (0.4524 => 0.4242, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.23% (0.3837 => 0.3598, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.22% (0.5999 => 0.5626, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -6.21% (0.3026 => 0.2838, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.20% (0.3483 => 0.3267, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.20% (0.7339 => 0.6884, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -6.20% (0.6230 => 0.5844, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -6.20% (0.5569 => 0.5224, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -6.19% (0.2989 => 0.2804, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.19% (0.5688 => 0.5336, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: -6.18% (3.5154 => 3.2980, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.18% (1.2210 => 1.1455, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -6.18% (0.6033 => 0.5660, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.18% (0.3057 => 0.2868, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -6.18% (15.2527 => 14.3104, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.17% (0.4083 => 0.3831, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.17% (0.7198 => 0.6754, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.17% (0.2903 => 0.2724, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -6.16% (0.6676 => 0.6265, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.15% (0.6194 => 0.5813, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -6.15% (0.3481 => 0.3267, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.15% (0.5581 => 0.5238, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -6.15% (0.2278 => 0.2138, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: -6.14% (0.4427 => 0.4155, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.14% (0.6446 => 0.6050, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/lists: -6.13% (0.3621 => 0.3399, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -6.13% (34.0927 => 32.0027, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -6.12% (0.5849 => 0.5491, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.12% (2.1713 => 2.0385, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -6.11% (0.3323 => 0.3120, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -6.10% (0.5570 => 0.5230, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -6.10% (0.2933 => 0.2754, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -6.09% (0.5567 => 0.5228, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.09% (0.6260 => 0.5879, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.08% (0.8521 => 0.8003, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.08% (0.6189 => 0.5813, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -6.07% (0.3394 => 0.3188, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: -6.07% (0.3446 => 0.3237, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -6.06% (0.9557 => 0.8978, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -6.05% (0.3205 => 0.3011, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -6.05% (8.0126 => 7.5280, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -6.04% (0.4321 => 0.4060, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -6.03% (0.3016 => 0.2834, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -6.03% (0.7779 => 0.7310, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -6.01% (0.6667 => 0.6266, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -6.01% (0.5941 => 0.5584, std.dev.: 0.0065) MultiSource/Applications/treecc/treecc: -6.01% (2.1401 => 2.0115, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: -6.00% (0.2849 => 0.2678, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.00% (0.2385 => 0.2242, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.99% (0.5456 => 0.5129, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: -5.99% (0.3788 => 0.3561, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -5.99% (0.2939 => 0.2763, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.98% (0.4916 => 0.4622, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.97% (0.2999 => 0.2820, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.95% (0.7021 => 0.6603, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: -5.95% (0.3867 => 0.3637, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.94% (0.4813 => 0.4527, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/objinst: -5.92% (0.3194 => 0.3005, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -5.91% (0.4248 => 0.3997, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: -5.90% (18.2933 => 17.2142, std.dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/methcall: -5.88% (0.3025 => 0.2847, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.87% (0.5329 => 0.5016, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.78% (0.3319 => 0.3127, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: -5.75% (0.3059 => 0.2883, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.75% (0.2106 => 0.1985, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -5.67% (0.6441 => 0.6076, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -5.65% (0.7982 => 0.7531, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -5.62% (0.6347 => 0.5990, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -5.56% (0.3271 => 0.3089, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: -5.45% (0.8418 => 0.7959, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.30% (0.2001 => 0.1895, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -5.23% (5.0226 => 4.7599, std.dev.: 0.0054) MultiSource/Applications/hbd/hbd: -4.88% (1.5610 => 1.4849, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.54% (0.9077 => 0.8665, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.48% (0.2277 => 0.2175, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -3.47% (20.7746 => 20.0534, std.dev.: 0.0290) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7502, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/richards_benchmark: -8.64% (1.2842 => 1.1733, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.85% (1.7753 => 1.7070, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.65% (2.2633 => 2.1808, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.13% (1.3096 => 1.2686, std.dev.: 0.0125) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4718, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 08:35:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 10:35:02 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121026153502.6ABDB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5253?compare_to=5250&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5253, Order: 166773, Start Time: 2012-10-26 14:11:16, End Time: 2012-10-26 15:35:00 To: 5250, Order: 166767, Start Time: 2012-10-26 12:30:28, End Time: 2012-10-26 13:54:26 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 17 (60 on baseline) Performance Improvements: 0 (2 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 958 (912 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.51% (0.2182 => 0.2324, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.34% (0.2099 => 0.2211, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.41% (0.6103 => 0.6311, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.41% (0.8416 => 0.8619, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.08% (0.8805 => 0.8988, std.dev.: 0.0068) MultiSource/Benchmarks/MallocBench/gs/gs: 1.83% (4.1693 => 4.2454, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.74% (0.7749 => 0.7884, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.58% (0.8458 => 0.8592, std.dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: 1.50% (0.9842 => 0.9990, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.37% (4.5276 => 4.5896, std.dev.: 0.0163) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.10% (13.9775 => 16.5076, std.dev.: 0.5851) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.04% (3.7664 => 4.0317, std.dev.: 0.0254) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 5.53% (2.2523 => 2.3769, std.dev.: 0.0242) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.67% (22.0255 => 22.6126, std.dev.: 0.1947) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.59% (44.6466 => 45.8011, std.dev.: 0.1166) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.88% (7.0834 => 7.2163, std.dev.: 0.0504) SingleSource/Benchmarks/Misc/pi: 1.56% (2.4709 => 2.5095, std.dev.: 0.0030) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.26% (16.4939 => 16.5363, std.dev.: 0.1341) MultiSource/Applications/obsequi/Obsequi: 1.60% (1.0492 => 1.0660, std.dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: -1.03% (0.6439 => 0.6373, std.dev.: 0.0120) MultiSource/Benchmarks/McCat/08-main/main: 2.63% (0.1900 => 0.1950, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.47% (0.1645 => 0.1735, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.30% (0.3240 => 0.3282, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.28% (0.2492 => 0.2460, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.13% (0.3288 => 0.3358, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.12% (0.2408 => 0.2405, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: -0.23% (0.6018 => 0.6004, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: -3.82% (0.0471 => 0.0453, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.24% (0.3317 => 0.3325, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 1.26% (0.1990 => 0.2015, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 10.53% (0.0247 => 0.0273, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -23.29% (0.0219 => 0.0168, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.24% (0.0422 => 0.0423, std.dev.: 0.0053) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.22% (0.0327 => 0.0331, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.95% (0.0315 => 0.0312, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 5.80% (0.0362 => 0.0383, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/casts: -1.00% (0.0201 => 0.0199, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -31.80% (0.0217 => 0.0148, std.dev.: 0.0032) SingleSource/UnitTests/byval-alignment: -12.90% (0.0341 => 0.0297, std.dev.: 0.0027) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1478 => 0.1479, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.52% (1.1232 => 1.1174, std.dev.: 0.0837) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.72% (0.1516 => 0.1490, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.56% (0.4264 => 0.4027, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.76% (0.1305 => 0.1269, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.11% (0.0606 => 0.0569, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.02% (0.0198 => 0.0202, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.55% (0.0544 => 0.0547, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.40% (1.1430 => 1.1476, std.dev.: 0.0501) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0560 => 0.0560, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.52% (0.0199 => 0.0190, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.01% (0.8017 => 0.8016, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 500.00% (0.0001 => 0.0006, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -20.00% (0.0070 => 0.0056, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.84% (2.1832 => 1.6627, std.dev.: 0.0101) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.93% (0.0810 => 0.0939, std.dev.: 0.0015) MultiSource/Applications/viterbi/viterbi: 6.85% (0.1577 => 0.1685, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.53% (0.8321 => 0.8864, std.dev.: 0.0164) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.17% (0.2998 => 0.3183, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.60% (0.2519 => 0.2660, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.50% (0.7473 => 0.7884, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.45% (0.8148 => 0.8592, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.35% (0.1983 => 0.2089, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.01% (0.6010 => 0.6311, std.dev.: 0.0079) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.01% (1.1606 => 1.2187, std.dev.: 0.0083) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.78% (0.3137 => 0.3287, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.37% (0.2378 => 0.2482, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.26% (0.6287 => 0.6555, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: 3.63% (1.4269 => 1.4787, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.51% (0.9435 => 0.9766, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.47% (0.3717 => 0.3846, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.47% (1.4479 => 1.4981, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.37% (0.8338 => 0.8619, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.34% (0.3295 => 0.3405, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.12% (0.8716 => 0.8988, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.81% (0.8597 => 0.8839, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/gs/gs: 2.78% (4.1305 => 4.2454, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.62% (0.8007 => 0.8217, std.dev.: 0.0036) MultiSource/Applications/treecc/treecc: 2.62% (1.9948 => 2.0470, std.dev.: 0.0174) MultiSource/Applications/lua/lua: 2.53% (3.8189 => 3.9157, std.dev.: 0.0359) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.49% (6.6074 => 6.7721, std.dev.: 0.0622) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.49% (0.4783 => 0.4902, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.26% (4.4880 => 4.5896, std.dev.: 0.0163) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.22% (0.6227 => 0.6365, std.dev.: 0.0041) MultiSource/Applications/ClamAV/clamscan: 2.06% (14.7684 => 15.0721, std.dev.: 0.1069) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.98% (0.5191 => 0.5294, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.89% (0.8697 => 0.8861, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 1.83% (0.9810 => 0.9990, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.69% (0.8261 => 0.8401, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.69% (1.1170 => 1.1359, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.63% (0.8457 => 0.8595, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.63% (0.7932 => 0.8061, std.dev.: 0.0029) MultiSource/Applications/d/make_dparser: 1.58% (3.2366 => 3.2876, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.52% (0.8331 => 0.8458, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.51% (0.8420 => 0.8547, std.dev.: 0.0041) MultiSource/Benchmarks/Bullet/bullet: 1.43% (31.8598 => 32.3154, std.dev.: 0.1404) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.33% (0.8855 => 0.8973, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.33% (0.8518 => 0.8631, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.31% (0.8340 => 0.8449, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.23% (0.8359 => 0.8462, std.dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: 1.10% (2.3764 => 2.4025, std.dev.: 0.0099) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.88% (1.5795 => 2.5095, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.72% (14.6451 => 16.5076, std.dev.: 0.5851) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.79% (0.3186 => 0.3466, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.40% (1.1857 => 1.2853, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 5.94% (63.1822 => 66.9380, std.dev.: 0.1245) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 5.71% (2.2485 => 2.3769, std.dev.: 0.0242) MultiSource/Applications/siod/siod: 2.89% (3.6643 => 3.7702, std.dev.: 0.0236) SingleSource/Benchmarks/Shootout-C++/ackermann: 2.88% (3.9188 => 4.0317, std.dev.: 0.0254) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.78% (44.5605 => 45.8011, std.dev.: 0.1166) SingleSource/Benchmarks/Misc/ReedSolomon: 2.17% (8.5322 => 8.7171, std.dev.: 0.0527) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.94% (3.9006 => 3.9764, std.dev.: 0.0191) MultiSource/Benchmarks/Bullet/bullet: 1.87% (7.1181 => 7.2509, std.dev.: 0.0407) MultiSource/Benchmarks/Olden/bh/bh: 1.71% (2.3560 => 2.3962, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.00% (2.9096 => 2.9388, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -5.01% (29.8330 => 28.3398, std.dev.: 0.0637) SingleSource/Benchmarks/Shootout-C++/hash2: -1.52% (3.4237 => 3.3718, std.dev.: 0.0072) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.55% (16.4461 => 16.5363, std.dev.: 0.1341) MultiSource/Applications/obsequi/Obsequi: 3.88% (1.0262 => 1.0660, std.dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: 0.65% (0.6332 => 0.6373, std.dev.: 0.0120) MultiSource/Benchmarks/McCat/08-main/main: 6.50% (0.1831 => 0.1950, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 11.29% (0.1559 => 0.1735, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.09% (0.3123 => 0.3282, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.12% (0.2463 => 0.2460, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.42% (0.3344 => 0.3358, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.73% (0.2364 => 0.2405, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: -0.10% (0.6010 => 0.6004, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: 5.59% (0.0429 => 0.0453, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.81% (0.3266 => 0.3325, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 2.34% (0.1969 => 0.2015, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 21.88% (0.0224 => 0.0273, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 36.59% (0.0123 => 0.0168, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.68% (0.0408 => 0.0423, std.dev.: 0.0053) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.31% (0.0254 => 0.0331, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.26% (0.0384 => 0.0383, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/casts: 4.74% (0.0190 => 0.0199, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -17.78% (0.0180 => 0.0148, std.dev.: 0.0032) SingleSource/UnitTests/byval-alignment: 29.13% (0.0230 => 0.0297, std.dev.: 0.0027) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.85% (0.1438 => 0.1479, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.37% (1.1329 => 1.1174, std.dev.: 0.0837) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.92% (0.1462 => 0.1490, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.29% (0.4164 => 0.4027, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -7.30% (0.1369 => 0.1269, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -11.23% (0.0641 => 0.0569, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 3.59% (0.0195 => 0.0202, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.36% (0.0578 => 0.0547, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.34% (1.1437 => 1.1476, std.dev.: 0.0501) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.69% (0.0627 => 0.0560, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.56% (0.0180 => 0.0190, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.01% (0.8017 => 0.8016, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 500.00% (0.0001 => 0.0006, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -9.68% (0.0062 => 0.0056, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 08:46:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 10:46:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121026154636.1B59F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5254?compare_to=5246&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5254, Order: 166767, Start Time: 2012-10-26 12:30:31, End Time: 2012-10-26 15:46:31 To: 5246, Order: 166760, Start Time: 2012-10-26 08:26:46, End Time: 2012-10-26 11:42:27 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (169 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1040 (722 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.35% (0.2096 => 0.2229, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.23% (54.1453 => 54.8113, std.dev.: 0.0889) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.32% (0.0625 => 0.0877, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.42% (0.1063 => 0.1397, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.40% (0.2969 => 0.3723, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 24.86% (0.1106 => 0.1381, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 23.87% (0.4139 => 0.5127, std.dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 23.63% (1.5932 => 1.9696, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.59% (0.4994 => 0.6172, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.49% (0.4253 => 0.5252, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.31% (0.5900 => 0.7275, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.95% (0.0475 => 0.0584) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.88% (0.5000 => 0.6144, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.83% (0.0714 => 0.0877, std.dev.: 0.0031) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.43% (0.0584 => 0.0715, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.30% (0.0547 => 0.0669, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.54% (0.1620 => 0.1969, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.52% (0.0897 => 0.1090, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.35% (0.1021 => 0.1239, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 21.20% (0.0599 => 0.0726, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 21.10% (0.0948 => 0.1148, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 20.96% (0.1107 => 0.1339, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.03% (0.0584 => 0.0701, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.96% (0.0541 => 0.0649, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 19.91% (0.0633 => 0.0759, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 19.87% (0.0604 => 0.0724, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.78% (0.0642 => 0.0769, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: 19.61% (0.0821 => 0.0982, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.58% (0.1103 => 0.1319, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.57% (0.3903 => 0.4667, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.45% (0.1604 => 0.1916, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/05-eks/eks: 19.33% (0.1619 => 0.1932, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.30% (0.1549 => 0.1848, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.24% (0.1003 => 0.1196, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.22% (0.0822 => 0.0980, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 18.61% (0.5826 => 0.6910, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 18.27% (0.0947 => 0.1120, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference-object: 18.05% (0.5889 => 0.6952, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 17.78% (0.1462 => 0.1722, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.74% (0.3890 => 0.4580, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 17.70% (0.0808 => 0.0951, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 17.49% (0.1218 => 0.1431, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.48% (0.2014 => 0.2366, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.34% (1.3152 => 1.5433, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 17.21% (0.1505 => 0.1764, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.11% (0.2736 => 0.3204, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 17.05% (0.0698 => 0.0817, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 17.00% (0.4029 => 0.4714, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.80% (0.2875 => 0.3358, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.78% (0.2866 => 0.3347, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.76% (0.2738 => 0.3197, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 16.73% (0.1088 => 0.1270, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 16.59% (0.9697 => 1.1306, std.dev.: 0.0030) MultiSource/Applications/Burg/burg: 16.43% (0.5546 => 0.6457, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 16.40% (1.8794 => 2.1877, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.39% (3.5627 => 4.1468, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.34% (0.5026 => 0.5847, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.09% (1.6211 => 1.8819, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 16.08% (0.7171 => 0.8324, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/hello: 16.06% (0.2714 => 0.3150, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 16.00% (0.2725 => 0.3161, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 15.95% (0.3004 => 0.3483, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.90% (0.1968 => 0.2281, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.90% (0.2729 => 0.3163, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 15.90% (0.2780 => 0.3222, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 15.89% (0.4658 => 0.5398, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.87% (0.3195 => 0.3702, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 15.85% (0.2750 => 0.3186, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.85% (2.0673 => 2.3950, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.78% (0.1160 => 0.1343, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 15.75% (0.9909 => 1.1470, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/random: 15.73% (0.2803 => 0.3244) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.71% (0.3271 => 0.3785, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/except: 15.65% (0.2811 => 0.3251, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/objinst: 15.62% (0.2823 => 0.3264, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.62% (0.2792 => 0.3228, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 15.60% (0.3096 => 0.3579, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.60% (0.2911 => 0.3365, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 15.50% (0.2813 => 0.3249, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 15.41% (0.1421 => 0.1640, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 15.37% (0.3267 => 0.3769, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/bh/bh: 15.19% (0.1284 => 0.1479, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.09% (2.7292 => 3.1411, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.07% (4.4195 => 5.0857, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/ary2: 15.07% (0.3317 => 0.3817, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 14.95% (0.4361 => 0.5013, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.93% (0.3060 => 0.3517, std.dev.: 0.0059) MultiSource/Applications/d/make_dparser: 14.92% (1.0781 => 1.2389, std.dev.: 0.0041) MultiSource/Benchmarks/Bullet/bullet: 14.90% (23.5202 => 27.0253, std.dev.: 0.0179) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.89% (0.3930 => 0.4515, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary: 14.86% (0.3258 => 0.3742, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.83% (1.9694 => 2.2614, std.dev.: 0.0052) MultiSource/Applications/ClamAV/clamscan: 14.82% (4.2109 => 4.8348, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.69% (0.3362 => 0.3856, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.68% (1.9966 => 2.2898, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.63% (0.3282 => 0.3762, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.53% (0.3124 => 0.3578, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 14.40% (0.3348 => 0.3830, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/moments: 14.08% (0.3678 => 0.4196, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 14.04% (0.3477 => 0.3965, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 13.99% (0.4146 => 0.4726, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/sieve: 13.98% (0.3726 => 0.4247, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.94% (0.1090 => 0.1242, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.71% (0.3625 => 0.4122, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 13.65% (0.3465 => 0.3938, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash2: 13.64% (0.4251 => 0.4831, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.63% (0.3690 => 0.4193, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 13.59% (0.3496 => 0.3971, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.58% (0.3446 => 0.3914, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 13.55% (0.3460 => 0.3929, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.54% (0.3981 => 0.4520, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 13.46% (0.3469 => 0.3936, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 13.45% (0.3442 => 0.3905, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.45% (0.3488 => 0.3957, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 13.45% (0.2566 => 0.2911, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.39% (0.3845 => 0.4360, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 13.34% (1.4269 => 1.6173, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 13.20% (0.2075 => 0.2349, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 13.15% (0.3650 => 0.4130, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 13.15% (0.3643 => 0.4122, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 13.07% (0.5012 => 0.5667, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 13.00% (0.3724 => 0.4208, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 12.70% (0.7875 => 0.8875, std.dev.: 0.0083) MultiSource/Applications/JM/ldecod/ldecod: 12.50% (2.1653 => 2.4360, std.dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 12.46% (2.1013 => 2.3632, std.dev.: 0.0109) MultiSource/Applications/JM/lencod/lencod: 12.43% (4.6177 => 5.1915, std.dev.: 0.0047) MultiSource/Applications/lambda-0_1_3/lambda: 11.52% (0.3498 => 0.3901, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.27% (0.2040 => 0.2270, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.25% (0.6435 => 0.7159, std.dev.: 0.0050) MultiSource/Applications/SIBsim4/SIBsim4: 11.07% (0.2691 => 0.2989, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 11.01% (5.5417 => 6.1520, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.52% (0.2737 => 0.3025, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.49% (0.2068 => 0.2285, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.31% (0.1028 => 0.1134, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 9.98% (0.6634 => 0.7296, std.dev.: 0.0017) MultiSource/Applications/minisat/minisat: 9.77% (0.3336 => 0.3662, std.dev.: 0.0042) MultiSource/Benchmarks/PAQ8p/paq8p: 9.68% (0.4847 => 0.5316, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.60% (0.3084 => 0.3380, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.40% (0.1383 => 0.1513, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 8.61% (2.0346 => 2.2097, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.49% (4.6926 => 5.0908, std.dev.: 0.0082) MultiSource/Applications/lemon/lemon: 8.20% (0.2391 => 0.2587, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.97% (11.6398 => 12.5680, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.67% (0.5361 => 0.5772, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.89% (0.5584 => 0.5969, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.88% (0.7426 => 0.7937, std.dev.: 0.0029) MultiSource/Applications/kimwitu++/kc: 6.39% (11.9555 => 12.7199, std.dev.: 0.0082) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.61% (0.3792 => 0.3967, std.dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.37% (0.2162 => 0.3532, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6537, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.22% (0.5917 => 0.6699, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 8.24% (0.2802 => 0.3033, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6111, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.44% (0.3693 => 0.3894, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 5.04% (0.2122 => 0.2229, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 5.02% (12.0509 => 12.6559, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: 4.80% (15.4430 => 16.1835, std.dev.: 0.0150) SingleSource/Benchmarks/Misc/flops-2: 4.07% (1.8057 => 1.8792, std.dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/dry: 2.74% (14.0481 => 14.4330, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2067, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.58% (3.1722 => 3.2223, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.47% (7.1849 => 7.2902, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3073, std.dev.: 0.0145) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.26% (1.0927 => 1.1065, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.23% (1.0142 => 1.0267, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5142, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5406, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5989, std.dev.: 0.0197) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.50% (25.4195 => 16.3961, std.dev.: 0.0125) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9763, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7758, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9585, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -6.99% (0.2402 => 0.2234, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.29% (11.2080 => 10.8398, std.dev.: 0.0409) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7747, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5219, std.dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/fldry: -2.74% (17.2379 => 16.7662, std.dev.: 0.0402) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.19% (41.7953 => 40.8797, std.dev.: 0.0132) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5737, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4955, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.13% (105.3826 => 104.1870, std.dev.: 0.0736) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0437, std.dev.: 0.0037) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.04% (3.3991 => 3.3637, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 10:19:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 12:19:21 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121026171921.A482B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5255?compare_to=5253&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5255, Order: 166776, Start Time: 2012-10-26 15:55:30, End Time: 2012-10-26 17:19:18 To: 5253, Order: 166773, Start Time: 2012-10-26 14:11:16, End Time: 2012-10-26 15:35:00 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 9 (60 on baseline) Performance Improvements: 4 (6 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 962 (908 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 6.69% (0.1884 => 0.2010, std.dev.: 0.0030) MultiSource/Applications/Burg/burg: 2.45% (1.2449 => 1.2754, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.91% (1.6481 => 1.6796, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.84% (0.8107 => 0.8256, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.66% (0.6074 => 0.6175, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.56% (0.9015 => 0.9156, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.21% (0.8458 => 0.8560, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 4.63% (8.6365 => 9.0368, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.18% (5.2099 => 5.3237, std.dev.: 0.0404) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.61% (0.3183 => 0.3068, std.dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.64% (16.5076 => 15.7419, std.dev.: 0.2676) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.08% (7.2163 => 6.9943, std.dev.: 0.0664) SingleSource/Benchmarks/CoyoteBench/lpbench: -1.43% (3.9764 => 3.9194, std.dev.: 0.0029) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.40% (16.5363 => 16.6019, std.dev.: 0.1104) MultiSource/Applications/obsequi/Obsequi: -1.34% (1.0660 => 1.0517, std.dev.: 0.0117) MultiSource/Applications/sqlite3/sqlite3: 0.28% (0.6373 => 0.6391, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/08-main/main: -2.46% (0.1950 => 0.1902, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.69% (0.1735 => 0.1671, std.dev.: 0.0058) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.58% (0.3282 => 0.3230, std.dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (0.2460 => 0.2492, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.63% (0.3358 => 0.3337, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.83% (0.2405 => 0.2361, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/bigfib: 0.20% (0.6004 => 0.6016, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel: 1.10% (0.0453 => 0.0458, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.57% (0.3325 => 0.3344, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/strcat: -0.15% (0.2015 => 0.2012, std.dev.: 0.0013) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -12.82% (0.0273 => 0.0238, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.60% (0.0168 => 0.0167, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.36% (0.0423 => 0.0413, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -9.37% (0.0331 => 0.0300, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.64% (0.0312 => 0.0314, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.44% (0.0383 => 0.0423, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 1.51% (0.0199 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 45.95% (0.0148 => 0.0216, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 11.78% (0.0297 => 0.0332, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 700.00% (0.0001 => 0.0008, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.20% (0.1479 => 0.1482, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 1.62% (1.1174 => 1.1355, std.dev.: 0.0417) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.07% (0.1490 => 0.1474, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.28% (0.4027 => 0.4159, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.80% (0.1269 => 0.1368, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.72% (0.0569 => 0.0630, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 37.13% (0.0202 => 0.0277) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.10% (0.0547 => 0.0541, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.58% (1.1476 => 1.1410, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1600.00% (0.0001 => 0.0017, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 100.00% (0.0001 => 0.0002, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.57% (0.0560 => 0.0608, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 20.53% (0.0190 => 0.0229, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.48% (0.8016 => 0.7897, std.dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -83.33% (0.0006 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 25.00% (0.0056 => 0.0070, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.03% (2.1832 => 1.6585, std.dev.: 0.0045) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.15% (0.0810 => 0.0957, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 11.24% (0.1112 => 0.1237, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.32% (0.1137 => 0.1243, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.46% (0.8321 => 0.8942, std.dev.: 0.0210) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.53% (0.3137 => 0.3342, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.33% (0.2180 => 0.2318, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.23% (0.2519 => 0.2676, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.14% (0.2279 => 0.2419, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.86% (0.7473 => 0.7911, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.51% (0.1905 => 0.2010, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.31% (0.8148 => 0.8581, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.17% (0.6010 => 0.6321, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.79% (0.4847 => 0.5079, std.dev.: 0.0052) MultiSource/Applications/Burg/burg: 4.35% (1.2222 => 1.2754, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.74% (0.6287 => 0.6522, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.64% (0.3295 => 0.3415, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.59% (0.5961 => 0.6175, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.47% (0.9435 => 0.9762, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.43% (0.3003 => 0.3106, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/18-imp/imp: 2.91% (0.3503 => 0.3605, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.90% (1.1685 => 1.2024, std.dev.: 0.0093) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.87% (6.6074 => 6.7970, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.86% (0.8697 => 0.8946, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.75% (0.8331 => 0.8560, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.68% (0.5817 => 0.5973, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.66% (0.4783 => 0.4910, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.62% (4.1763 => 4.2857, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.57% (0.8927 => 0.9156, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.56% (0.8050 => 0.8256, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.50% (1.6386 => 1.6796, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.36% (8.6476 => 8.8519, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.31% (1.4479 => 1.4813, std.dev.: 0.0100) MultiSource/Benchmarks/MallocBench/gs/gs: 2.10% (4.1305 => 4.2172, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.08% (13.1811 => 13.4552, std.dev.: 0.0639) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.04% (1.1170 => 1.1398, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.00% (0.8007 => 0.8167, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.85% (0.8712 => 0.8873, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.80% (4.4880 => 4.5688, std.dev.: 0.0100) MultiSource/Applications/d/make_dparser: 1.73% (3.2366 => 3.2925, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.71% (0.8286 => 0.8428, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.68% (0.8048 => 0.8183, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.67% (0.8340 => 0.8479, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.66% (0.7966 => 0.8098, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.52% (1.3279 => 1.3481, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/football/football: 1.48% (0.8768 => 0.8898, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 1.47% (2.2184 => 2.2511, std.dev.: 0.0125) MultiSource/Applications/JM/lencod/lencod: 1.35% (15.3280 => 15.5347, std.dev.: 0.0391) MultiSource/Applications/SPASS/SPASS: 1.33% (14.2605 => 14.4501, std.dev.: 0.0602) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.30% (0.7932 => 0.8035, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.15% (1.2602 => 1.2747, std.dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 1.09% (4.9628 => 5.0169, std.dev.: 0.0135) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 59.02% (1.5795 => 2.5117, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.44% (1.1857 => 1.2858, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.49% (14.6451 => 15.7419, std.dev.: 0.2676) MultiSource/Benchmarks/mafft/pairlocalalign: 6.03% (63.1822 => 66.9944, std.dev.: 0.0452) SingleSource/Benchmarks/Dhrystone/dry: 3.62% (0.5081 => 0.5265, std.dev.: 0.0025) MultiSource/Applications/siod/siod: 2.69% (3.6643 => 3.7630, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: 2.19% (8.5322 => 8.7187, std.dev.: 0.0473) MultiSource/Benchmarks/FreeBench/mason/mason: 1.85% (0.5415 => 0.5515, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 1.80% (2.3560 => 2.3983, std.dev.: 0.0094) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -5.04% (29.8330 => 28.3309, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -3.15% (0.3269 => 0.3166, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.03% (7.2130 => 6.9943, std.dev.: 0.0664) MultiSource/Benchmarks/Ptrdist/ft/ft: -1.62% (0.8789 => 0.8647, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: -1.43% (3.4237 => 3.3749, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.22% (3.3479 => 3.3072, std.dev.: 0.0040) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.95% (16.4461 => 16.6019, std.dev.: 0.1104) MultiSource/Applications/obsequi/Obsequi: 2.48% (1.0262 => 1.0517, std.dev.: 0.0117) MultiSource/Applications/sqlite3/sqlite3: 0.93% (0.6332 => 0.6391, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/08-main/main: 3.88% (0.1831 => 0.1902, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.18% (0.1559 => 0.1671, std.dev.: 0.0058) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.43% (0.3123 => 0.3230, std.dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.18% (0.2463 => 0.2492, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.21% (0.3344 => 0.3337, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.13% (0.2364 => 0.2361, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/bigfib: 0.10% (0.6010 => 0.6016, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel: 6.76% (0.0429 => 0.0458, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.39% (0.3266 => 0.3344, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/strcat: 2.18% (0.1969 => 0.2012, std.dev.: 0.0013) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.25% (0.0224 => 0.0238, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 35.77% (0.0123 => 0.0167, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.23% (0.0408 => 0.0413, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 18.11% (0.0254 => 0.0300, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 20.00% (0.0180 => 0.0216, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 44.35% (0.0230 => 0.0332, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 14.29% (0.0007 => 0.0008, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 3.06% (0.1438 => 0.1482, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.23% (1.1329 => 1.1355, std.dev.: 0.0417) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.82% (0.1462 => 0.1474, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.12% (0.4164 => 0.4159, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.07% (0.1369 => 0.1368, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.72% (0.0641 => 0.0630, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.40% (0.0578 => 0.0541, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.24% (1.1437 => 1.1410, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1600.00% (0.0001 => 0.0017, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -85.71% (0.0014 => 0.0002, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.03% (0.0627 => 0.0608, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 27.22% (0.0180 => 0.0229, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.50% (0.8017 => 0.7897, std.dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 12.90% (0.0062 => 0.0070, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 10:26:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 12:26:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121026172632.7CBDF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5256?compare_to=5252&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5256, Order: 166776, Start Time: 2012-10-26 16:01:39, End Time: 2012-10-26 17:26:27 To: 5252, Order: 166773, Start Time: 2012-10-26 13:42:49, End Time: 2012-10-26 15:07:48 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (4 on baseline) Performance Improvements: 0 (183 on baseline) Unchanged Tests: 1041 (855 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.33% (1.2686 => 1.2981, std.dev.: 0.0112) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.80% (2.0478 => 2.1051, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/salsa20: 2.30% (7.4937 => 7.6664, std.dev.: 0.0205) SingleSource/Benchmarks/Shootout-C++/hash2: 2.29% (3.1932 => 3.2664, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.29% (0.1431 => 0.1298, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.45% (0.3821 => 0.3498, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -8.12% (2.4924 => 2.2899, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.61% (0.3142 => 0.2903, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.42% (0.9542 => 0.8834, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -7.42% (0.3357 => 0.3108, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -7.36% (3.5339 => 3.2737, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.25% (22.4056 => 20.7807, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/ReedSolomon: -7.24% (0.1879 => 0.1743, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -7.19% (0.3880 => 0.3601, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.17% (0.2428 => 0.2254, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -7.14% (16.1920 => 15.0357, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/oourafft: -7.13% (0.2160 => 0.2006, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -7.13% (0.3831 => 0.3558, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -7.11% (0.3896 => 0.3619, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -7.11% (0.3812 => 0.3541, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: -7.09% (0.9179 => 0.8528, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -7.08% (0.3658 => 0.3399, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: -7.07% (0.3848 => 0.3576, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.05% (0.3884 => 0.3610, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: -7.02% (0.4033 => 0.3750, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: -7.02% (0.1796 => 0.1670, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: -7.00% (1.1530 => 1.0723, std.dev.: 0.0063) SingleSource/UnitTests/ObjC/exceptions: -6.97% (0.4176 => 0.3885, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -6.95% (9.2283 => 8.5869, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.94% (0.3891 => 0.3621, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -6.90% (7.0961 => 6.6067, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: -6.87% (1.2515 => 1.1655, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -6.87% (0.1761 => 0.1640, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.86% (0.9852 => 0.9176, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.85% (0.6484 => 0.6040, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.82% (0.1716 => 0.1599, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.82% (1.6474 => 1.5351, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.81% (1.2784 => 1.1914, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.80% (5.4682 => 5.0961, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/neural/neural: -6.80% (0.1500 => 0.1398, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: -6.80% (4.3330 => 4.0384, std.dev.: 0.0120) MultiSource/Applications/lemon/lemon: -6.79% (1.1450 => 1.0672, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -6.79% (0.4199 => 0.3914, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.75% (0.6736 => 0.6281, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.73% (1.0544 => 0.9834, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.73% (1.2300 => 1.1472, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.69% (0.1584 => 0.1478, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.68% (1.3722 => 1.2805, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.68% (0.7919 => 0.7390, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.2695 => 0.2515, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.66% (1.6364 => 1.5274, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.65% (2.2587 => 2.1085, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: -6.65% (0.7447 => 0.6952, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -6.64% (4.0594 => 3.7898, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.63% (0.6304 => 0.5886, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.62% (0.2355 => 0.2199, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.60% (1.4642 => 1.3675, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -6.60% (0.2985 => 0.2788, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.60% (6.7716 => 6.3247, std.dev.: 0.0121) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.60% (4.5069 => 4.2096, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -6.59% (0.4280 => 0.3998, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: -6.58% (0.2659 => 0.2484, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.58% (4.8161 => 4.4992, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.55% (0.5478 => 0.5119, std.dev.: 0.0009) MultiSource/Applications/siod/siod: -6.53% (2.4021 => 2.2452, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.51% (0.5591 => 0.5227, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.50% (0.6297 => 0.5888, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.49% (0.5805 => 0.5428, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.47% (4.0323 => 3.7713, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.47% (0.6293 => 0.5886, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.46% (0.5925 => 0.5542, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.46% (4.8802 => 4.5648, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.46% (14.2083 => 13.2903, std.dev.: 0.0141) MultiSource/Benchmarks/sim/sim: -6.46% (0.3406 => 0.3186, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.46% (0.4151 => 0.3883, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.44% (0.6681 => 0.6251, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: -6.42% (0.1621 => 0.1517, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.41% (0.6052 => 0.5664, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.40% (0.5859 => 0.5484, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -6.40% (0.5705 => 0.5340, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -6.38% (0.6395 => 0.5987, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: -6.38% (0.4515 => 0.4227, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.36% (0.5863 => 0.5490, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.36% (0.5802 => 0.5433, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -6.35% (0.6660 => 0.6237, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -6.34% (0.6230 => 0.5835, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: -6.34% (1.3864 => 1.2985, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: -6.34% (0.4861 => 0.4553, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -6.31% (0.5941 => 0.5566, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -6.30% (0.5575 => 0.5224, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -6.29% (17.1032 => 16.0268, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -6.29% (0.6676 => 0.6256, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.29% (0.5581 => 0.5230, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: -6.28% (0.3581 => 0.3356, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -6.28% (1.3148 => 1.2322, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.28% (0.6260 => 0.5867, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.27% (0.6395 => 0.5994, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -6.27% (0.5168 => 0.4844, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.25% (0.7339 => 0.6880, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -6.25% (0.7524 => 0.7054, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.24% (0.2548 => 0.2389, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.24% (0.6446 => 0.6044, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.24% (0.3849 => 0.3609, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -6.23% (0.6033 => 0.5657, std.dev.: 0.0082) MultiSource/Applications/SPASS/SPASS: -6.23% (15.5079 => 14.5414, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.23% (0.5857 => 0.5492, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.22% (0.5688 => 0.5334, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.22% (1.2221 => 1.1461, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.20% (0.6440 => 0.6041, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -6.20% (0.5569 => 0.5224, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.19% (1.2210 => 1.1454, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: -6.19% (0.3491 => 0.3275, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.18% (0.5999 => 0.5628, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.18% (0.6194 => 0.5811, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.18% (0.3252 => 0.3051, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -6.18% (0.6750 => 0.6333, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -6.17% (0.5849 => 0.5488, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.14% (0.3483 => 0.3269, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -6.14% (15.2527 => 14.3164, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.13% (0.3931 => 0.3690, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.12% (0.4083 => 0.3833, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: -6.12% (0.4524 => 0.4247, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: -6.12% (34.0927 => 32.0063, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -6.10% (0.6667 => 0.6260, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: -6.10% (3.5154 => 3.3008, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -6.08% (0.3026 => 0.2842, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -6.07% (0.5570 => 0.5232, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -6.07% (0.3446 => 0.3237, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -6.06% (0.2989 => 0.2808, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -6.05% (0.5567 => 0.5230, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -6.05% (0.3323 => 0.3122, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -6.05% (0.3621 => 0.3402, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.04% (0.4916 => 0.4619, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -6.02% (0.3255 => 0.3059, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.01% (0.8521 => 0.8009, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.99% (0.3837 => 0.3607, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -5.99% (0.2939 => 0.2763, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.99% (0.3057 => 0.2874, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.98% (2.1713 => 2.0414, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -5.98% (0.3394 => 0.3191, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -5.98% (0.3481 => 0.3273, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.97% (0.4321 => 0.4063, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.97% (0.2278 => 0.2142, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.97% (0.2999 => 0.2820, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.96% (0.4427 => 0.4163, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.96% (0.2903 => 0.2730, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.96% (0.5456 => 0.5131, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.95% (0.2385 => 0.2243, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: -5.95% (0.3025 => 0.2845, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.94% (8.0126 => 7.5363, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.93% (0.9557 => 0.8990, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/wc: -5.93% (0.3205 => 0.3015, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -5.92% (2.1401 => 2.0133, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/fibo: -5.92% (0.2871 => 0.2701, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.90% (0.4813 => 0.4529, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: -5.89% (0.3788 => 0.3565, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.87% (0.5329 => 0.5016, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.87% (0.7021 => 0.6609, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -5.86% (0.2849 => 0.2682, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.83% (0.2933 => 0.2762, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -5.80% (0.7982 => 0.7519, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.79% (0.2106 => 0.1984, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -5.79% (0.4248 => 0.4002, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -5.77% (0.3867 => 0.3644, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: -5.77% (18.2933 => 17.2385, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/objinst: -5.76% (0.3194 => 0.3010, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.75% (0.3319 => 0.3128, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.74% (0.3016 => 0.2843, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.63% (0.7198 => 0.6793, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -5.60% (0.7779 => 0.7343, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/09-vor/vor: -5.59% (0.3271 => 0.3088, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -5.52% (0.3059 => 0.2890, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -5.36% (0.6441 => 0.6096, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -5.32% (0.8418 => 0.7970, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: -5.31% (0.6347 => 0.6010, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.15% (0.2001 => 0.1898, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -5.10% (5.0226 => 4.7663, std.dev.: 0.0166) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.76% (0.9077 => 0.8645, std.dev.: 0.0029) MultiSource/Applications/hbd/hbd: -4.75% (1.5610 => 1.4868, std.dev.: 0.0028) SingleSource/UnitTests/Vector/constpool: -3.32% (20.7746 => 20.0857, std.dev.: 0.0308) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7501, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/richards_benchmark: -8.70% (1.2842 => 1.1725, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.91% (2.2633 => 2.1748, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7068, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.04% (1.0557 => 1.0236, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.67% (6.5735 => 6.4634, std.dev.: 0.0053) Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 10:31:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 12:31:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121026173113.C44E62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5257?compare_to=5251&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5257, Order: 166776, Start Time: 2012-10-26 16:08:15, End Time: 2012-10-26 17:31:09 To: 5251, Order: 166773, Start Time: 2012-10-26 13:17:43, End Time: 2012-10-26 14:40:40 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (73 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 3 (193 on baseline) Performance Improvements: 1 (49 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 75 (2 on baseline) Unchanged Tests: 963 (646 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.00% (2.4249 => 2.4492, std.dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.23% (54.6652 => 56.4325, std.dev.: 0.1545) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.26% (1.2973 => 1.3136, std.dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.66% (13.7974 => 13.5685, std.dev.: 0.0094) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0488 => 0.0488, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0489 => 0.0489, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0457 => 0.0457, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0459 => 0.0459, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.22% (0.0447 => 0.0448, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.22% (0.0449 => 0.0448, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.23% (0.0441 => 0.0440, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0442 => 0.0442, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0459 => 0.0459, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.22% (0.0459 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0453 => 0.0453, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0454 => 0.0454, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0443 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0445 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0451 => 0.0451) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.44% (0.0451 => 0.0453) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0461 => 0.0461, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.22% (0.0463 => 0.0464, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0438 => 0.0438, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0439 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0451 => 0.0451, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0452 => 0.0452, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.23% (0.0441 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0443 => 0.0443) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.46% (0.0433 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.23% (0.0434 => 0.0435, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0432 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0434 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.21% (0.0469 => 0.0470, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.21% (0.0470 => 0.0471) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0431 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0432 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.23% (0.0433 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0433 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0440 => 0.0440, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0441 => 0.0441, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/BenchmarkGame/puzzle MultiSource/Applications/oggenc/oggenc: -0.07% (0.1408 => 0.1407, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.12% (0.0683 => 0.0648, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: - (0.3825 => 0.3825, std.dev.: 0.0011) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.06% (0.6962 => 0.3825, std.dev.: 0.0011) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 202.51% (0.5229 => 1.5818, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 15.52% (14.9895 => 17.3164, std.dev.: 0.0168) MultiSource/Applications/kimwitu++/kc: 36.89% (14.1553 => 19.3775, std.dev.: 0.0230) MultiSource/Benchmarks/MallocBench/gs/gs: 13.30% (4.1105 => 4.6573, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 35.73% (1.1048 => 1.4996, std.dev.: 0.0100) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 317.98% (7.1582 => 29.9201, std.dev.: 0.0246) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.04% (3.4629 => 5.8190, std.dev.: 0.0133) SingleSource/Benchmarks/Misc-C++/stepanov_container: 67.12% (0.6222 => 1.0398, std.dev.: 0.0052) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 11829.72% (0.0720 => 8.5894, std.dev.: 0.0040) MultiSource/Applications/SIBsim4/SIBsim4: 4015600.00% (0.0001 => 4.0157, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 11158900.00% (0.0001 => 11.1590, std.dev.: 0.0489) MultiSource/Applications/kimwitu++/kc: 50200.00% (0.0001 => 0.0503, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 792500.00% (0.0001 => 0.7926, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050000.00% (0.0001 => 10.0501, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5488600.00% (0.0001 => 5.4887, std.dev.: 0.0047) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 68.75% (0.0256 => 0.0432, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 56.38% (0.0243 => 0.0380, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 54.24% (0.0271 => 0.0418, std.dev.: 0.0000) SingleSource/Regression/C/sumarray: 44.59% (0.0231 => 0.0334) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 42.13% (1.5859 => 2.2541, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/distray/distray: 40.53% (0.1056 => 0.1484, std.dev.: 0.0000) SingleSource/UnitTests/vla: 33.52% (0.0355 => 0.0474) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 31.15% (2.2024 => 2.8884, std.dev.: 0.0096) MultiSource/Benchmarks/PAQ8p/paq8p: 30.88% (10.3673 => 13.5685, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/flops: 29.05% (0.1432 => 0.1848, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: 28.30% (0.1463 => 0.1877, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 24.65% (0.1655 => 0.2063, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 23.98% (0.0834 => 0.1034, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.71% (0.1566 => 0.1906, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: 21.24% (0.0485 => 0.0588, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 21.23% (0.2049 => 0.2484, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 19.41% (0.4879 => 0.5826, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.17% (0.0871 => 0.1038, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 18.78% (0.1555 => 0.1847) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 18.65% (0.5105 => 0.6057, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 18.22% (0.3177 => 0.3756, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 18.10% (0.0746 => 0.0881, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 17.95% (0.0730 => 0.0861, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.75% (0.6675 => 0.7860, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 17.62% (0.1175 => 0.1382, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 17.50% (0.2554 => 0.3001, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.32% (1.3050 => 1.5310, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.27% (0.3121 => 0.3660, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.91% (0.1029 => 0.1203, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 16.77% (0.0626 => 0.0731) MultiSource/Benchmarks/Olden/em3d/em3d: 16.58% (0.1695 => 0.1976, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.52% (0.0793 => 0.0924, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 16.50% (3.3354 => 3.8856, std.dev.: 0.0115) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.42% (0.2271 => 0.2644, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 16.25% (0.1163 => 0.1352, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 16.16% (0.1337 => 0.1553, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 16.13% (0.7115 => 0.8263, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.12% (0.8172 => 0.9489, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.09% (0.1032 => 0.1198, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.01% (1.5415 => 1.7883, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 16.00% (1.1840 => 1.3734, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.94% (0.5020 => 0.5820, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.80% (0.4615 => 0.5344, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.75% (0.0838 => 0.0970, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.58% (0.0886 => 0.1024, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.56% (0.1510 => 0.1745, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 15.47% (0.3109 => 0.3590, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.35% (0.2065 => 0.2382, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.26% (0.1940 => 0.2236, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.20% (0.0842 => 0.0970, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 14.96% (0.0675 => 0.0776, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/exptree: 14.74% (0.0814 => 0.0934, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.71% (0.1584 => 0.1817, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 14.64% (0.1906 => 0.2185, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 14.60% (0.1151 => 0.1319, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.59% (0.1117 => 0.1280, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.48% (0.1236 => 0.1415, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: 14.46% (1.1642 => 1.3325, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.39% (4.2646 => 4.8783, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.39% (0.9765 => 1.1170, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.38% (0.2107 => 0.2410, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 14.37% (0.3423 => 0.3915, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.37% (0.2700 => 0.3088, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.34% (0.1625 => 0.1858, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.31% (0.1125 => 0.1286, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.29% (0.2758 => 0.3152, std.dev.: 0.0021) SingleSource/UnitTests/SignlessTypes/rem: 14.16% (0.1144 => 0.1306, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.16% (0.0770 => 0.0879, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 14.03% (0.7835 => 0.8934, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 13.97% (0.6450 => 0.7351, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.93% (0.5981 => 0.6814, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 13.83% (9.4845 => 10.7960, std.dev.: 0.0174) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.75% (0.1062 => 0.1208, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.72% (0.5860 => 0.6664, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.66% (0.0798 => 0.0907, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: 13.62% (2.0273 => 2.3034, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.61% (0.0933 => 0.1060, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 13.56% (0.7433 => 0.8441, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 13.50% (1.0722 => 1.2169, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.45% (8.1363 => 9.2308, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.39% (0.1695 => 0.1922, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.30% (1.4186 => 1.6073, std.dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.13% (0.0929 => 0.1051, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.12% (0.0770 => 0.0871, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.10% (0.2603 => 0.2944, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 13.07% (0.4299 => 0.4861, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.00% (0.3307 => 0.3737, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 12.96% (0.3180 => 0.3592, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 12.91% (3.8723 => 4.3724, std.dev.: 0.0189) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.84% (0.5569 => 0.6284, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.83% (0.8067 => 0.9102, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 12.70% (0.8921 => 1.0054, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.64% (4.9449 => 5.5698, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.48% (5.0018 => 5.6262, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 12.46% (0.1268 => 0.1426, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.33% (0.1330 => 0.1494, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.29% (0.3441 => 0.3864, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 12.19% (0.3387 => 0.3800, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 12.13% (0.3092 => 0.3467, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.01% (1.1861 => 1.3286, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash: 11.70% (0.4289 => 0.4791, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.64% (0.1143 => 0.1276, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.33% (0.8101 => 0.9019, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 11.25% (5.7591 => 6.4068, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.22% (2.2022 => 2.4492, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.18% (0.3543 => 0.3939, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 11.17% (0.4620 => 0.5136, std.dev.: 0.0053) MultiSource/Applications/siod/siod: 11.04% (2.2969 => 2.5505, std.dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 11.02% (0.0953 => 0.1058, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 10.92% (0.6456 => 0.7161, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.89% (0.1892 => 0.2098, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: 10.72% (0.3927 => 0.4348, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.55% (0.3828 => 0.4232, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.54% (0.3473 => 0.3839, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.53% (0.3543 => 0.3916, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 10.50% (0.3561 => 0.3935, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.47% (0.3516 => 0.3884, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.45% (0.3694 => 0.4080, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.38% (0.3497 => 0.3860, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.24% (0.3886 => 0.4284, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.22% (0.3865 => 0.4260, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 10.18% (21.9371 => 24.1702, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.06% (0.1044 => 0.1149, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.02% (0.4203 => 0.4624, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 9.94% (0.3422 => 0.3762, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 9.86% (1.5603 => 1.7141, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.83% (0.3826 => 0.4202, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.58% (0.4636 => 0.5080, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/moments: 9.54% (0.4048 => 0.4434, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 9.53% (0.3684 => 0.4035, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.24% (0.4103 => 0.4482, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 9.20% (0.5925 => 0.6470, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.09% (0.2430 => 0.2651, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 9.08% (0.3603 => 0.3930, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.02% (0.6030 => 0.6574, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: 8.76% (17.1811 => 18.6870, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.61% (0.3427 => 0.3722, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.57% (0.7326 => 0.7954, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.44% (0.4064 => 0.4407, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.35% (3.8922 => 4.2173, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.35% (14.3668 => 15.5664, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/matrix: 8.20% (0.3098 => 0.3352, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.14% (0.3650 => 0.3947, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.99% (0.2891 => 0.3122, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 7.95% (0.3282 => 0.3543, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.94% (0.2872 => 0.3100, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 7.88% (0.2831 => 0.3054, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 7.83% (0.3283 => 0.3540, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.75% (0.2905 => 0.3130, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.74% (0.3232 => 0.3482, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.72% (0.3162 => 0.3406, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.69% (0.2756 => 0.2968, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.68% (2.0665 => 2.2253, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/except: 7.63% (0.2871 => 0.3090, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.59% (0.2793 => 0.3005, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 7.58% (0.2877 => 0.3095, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 7.47% (0.3052 => 0.3280, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.45% (0.2725 => 0.2928, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 7.18% (0.2714 => 0.2909, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/random: 7.17% (0.2802 => 0.3003, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 6.84% (1.2842 => 1.3721, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.78% (0.3379 => 0.3608, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.71% (0.2266 => 0.2418, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 6.49% (10.4361 => 11.1133, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.93% (0.3136 => 0.3322, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.85% (7.9617 => 8.4274, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/objinst: 5.43% (0.3131 => 0.3301, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.96% (0.3935 => 0.4091, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.69% (7.0540 => 7.3144, std.dev.: 0.0081) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.91% (0.3817 => 0.3928, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 31.27% (10.2830 => 13.4986, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1725, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 14.08% (2.6778 => 3.0549, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.64% (0.9957 => 1.1315, std.dev.: 0.0109) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 10.06% (1.1396 => 1.2543, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.1578 => 3.3686, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.63% (2.8904 => 3.0819, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 3.82% (1.9405 => 2.0147, std.dev.: 0.0097) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.19% (0.3987 => 0.4114) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.58% (4.2280 => 4.3371, std.dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.79% (0.8333 => 0.8482, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 1.54% (3.1595 => 3.2081) MultiSource/Benchmarks/nbench/nbench: 1.49% (11.6436 => 11.8166, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 1.32% (4.4649 => 4.5238, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.27% (2.6546 => 2.6883, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.93% (6.6874 => 0.1381, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -82.46% (0.8651 => 0.1517, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -52.32% (5.2763 => 2.5157, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -45.38% (0.1622 => 0.0886, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -41.67% (5.3526 => 3.1222, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.75% (5.3855 => 3.1907, std.dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: -8.88% (63.2438 => 57.6286, std.dev.: 0.0062) SingleSource/UnitTests/Vector/constpool: -8.80% (54.1659 => 49.4007, std.dev.: 0.0309) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.86% (1.7609 => 1.6225, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.52% (2.9384 => 2.8056, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.41% (1.1194 => 1.0700, std.dev.: 0.0028) MultiSource/Applications/ClamAV/clamscan: -2.71% (22.1758 => 21.5742, std.dev.: 0.0091) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -52.87% (8.0499 => 3.7942, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.40% (1.1492 => 0.7654, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -28.90% (10.7105 => 7.6153, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4750, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.73% (1.6925 => 1.4263, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.68% (1.2258 => 1.0704, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -12.18% (1.2373 => 1.0866, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel-2: -11.11% (1.5373 => 1.3665, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.22% (19.9488 => 18.3098, std.dev.: 0.0127) MultiSource/Benchmarks/FreeBench/mason/mason: -7.96% (0.2161 => 0.1989, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.01% (1.8329 => 1.7044, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: -5.46% (6.6465 => 6.2839, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: -5.18% (1.5835 => 1.5015, std.dev.: 0.0040) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.93% (1.6805 => 1.5977, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.44% (8.1563 => 7.7939, std.dev.: 0.0103) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Applications/siod/siod: -3.68% (3.2827 => 3.1619, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -3.33% (5.0483 => 4.8804, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5064, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.68% (0.4808 => 0.4679, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: -1.69% (8.8334 => 8.6838, std.dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.67% (2.5528 => 2.5101, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4209, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: -1.39% (4.6441 => 4.5796, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2349, std.dev.: 0.0039) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -5.25% (0.1485 => 0.1407, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0016) Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 12:03:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 14:03:46 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121026190346.52BD82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5258?compare_to=5255&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5258, Order: 166784, Start Time: 2012-10-26 17:38:49, End Time: 2012-10-26 19:03:43 To: 5255, Order: 166776, Start Time: 2012-10-26 15:55:30, End Time: 2012-10-26 17:19:18 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 11 (30 on baseline) Performance Improvements: 1 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 963 (940 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.74% (3.2064 => 3.3263, std.dev.: 0.0254) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.18% (1.5432 => 1.5923, std.dev.: 0.0128) MultiSource/Applications/lua/lua: 2.40% (3.8642 => 3.9569, std.dev.: 0.0287) MultiSource/Applications/hbd/hbd: 1.41% (1.4719 => 1.4926, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.12% (1.4813 => 1.4979, std.dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.79% (0.3314 => 0.3539, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/ffbench: 2.68% (1.3810 => 1.4180, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.35% (6.9943 => 7.1590, std.dev.: 0.0402) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.21% (2.4747 => 2.5295, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/ReedSolomon: 1.21% (8.7187 => 8.8238, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/ary3: 1.19% (2.0918 => 2.1167, std.dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.45% (3.6271 => 3.5745, std.dev.: 0.0113) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.16% (16.6019 => 16.5750, std.dev.: 0.2486) MultiSource/Applications/obsequi/Obsequi: -0.81% (1.0517 => 1.0432, std.dev.: 0.0207) MultiSource/Applications/sqlite3/sqlite3: 2.07% (0.6391 => 0.6523, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/08-main/main: -1.05% (0.1902 => 0.1882, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.06% (0.1671 => 0.1670, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.65% (0.3230 => 0.3251, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.40% (0.2492 => 0.2457, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.90% (0.3337 => 0.3367, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.33% (0.2361 => 0.2416, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/bigfib: -0.08% (0.6016 => 0.6011, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/mandel: -3.28% (0.0458 => 0.0443, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.15% (0.3344 => 0.3339, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/strcat: 0.70% (0.2012 => 0.2026, std.dev.: 0.0012) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.26% (0.0238 => 0.0241, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 30.54% (0.0167 => 0.0218, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.15% (0.0413 => 0.0426, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 10.00% (0.0300 => 0.0330, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.96% (0.0314 => 0.0311, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0423 => 0.0423, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 0.50% (0.0202 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -0.46% (0.0216 => 0.0215, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -2.11% (0.0332 => 0.0325, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 62.50% (0.0008 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 0.61% (0.1482 => 0.1491, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.56% (1.1355 => 1.1419, std.dev.: 0.0258) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.53% (0.1474 => 0.1526, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.85% (0.4159 => 0.4236, std.dev.: 0.0248) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.24% (0.1368 => 0.1310, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.32% (0.0630 => 0.0632, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0277 => 0.0277, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.03% (0.0541 => 0.0552, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.07% (1.1410 => 1.1418, std.dev.: 0.0085) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 82.35% (0.0017 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 1200.00% (0.0002 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.12% (0.0608 => 0.0589, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 16.59% (0.0229 => 0.0267, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.86% (0.7897 => 0.7965, std.dev.: 0.0079) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -8.57% (0.0070 => 0.0064, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.67% (2.1832 => 1.6664, std.dev.: 0.0030) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.85% (0.8321 => 0.9057, std.dev.: 0.0273) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.96% (0.1885 => 0.2035, std.dev.: 0.0049) MultiSource/Applications/hbd/hbd: 4.60% (1.4269 => 1.4926, std.dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.52% (0.3717 => 0.3885, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.50% (3.1832 => 3.3263, std.dev.: 0.0254) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.97% (1.5315 => 1.5923, std.dev.: 0.0128) MultiSource/Applications/lua/lua: 3.61% (3.8189 => 3.9569, std.dev.: 0.0287) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.56% (0.3003 => 0.3110, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.45% (1.4479 => 1.4979, std.dev.: 0.0032) MultiSource/Applications/ClamAV/clamscan: 3.33% (14.7684 => 15.2603, std.dev.: 0.1468) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.81% (0.5191 => 0.5337, std.dev.: 0.0041) MultiSource/Benchmarks/Bullet/bullet: 2.30% (31.8598 => 32.5922, std.dev.: 0.0688) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.86% (0.8805 => 0.8969, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 1.80% (8.6247 => 8.7802, std.dev.: 0.0463) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.66% (0.7932 => 0.8064, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.81% (1.5795 => 2.5084, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.08% (0.3186 => 0.3539, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 6.82% (1.1857 => 1.2666, std.dev.: 0.0097) MultiSource/Benchmarks/mafft/pairlocalalign: 5.93% (63.1822 => 66.9298, std.dev.: 0.0543) SingleSource/Benchmarks/Dhrystone/dry: 4.70% (0.5081 => 0.5320, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/ReedSolomon: 3.42% (8.5322 => 8.8238, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.29% (2.4490 => 2.5295, std.dev.: 0.0060) MultiSource/Applications/siod/siod: 2.95% (3.6643 => 3.7723, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.88% (59.2638 => 60.3776, std.dev.: 0.1154) MultiSource/Benchmarks/Olden/bh/bh: 1.80% (2.3560 => 2.3985, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.66% (4.8362 => 4.9166, std.dev.: 0.0145) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.65% (41.4238 => 42.1073, std.dev.: 0.1286) SingleSource/Benchmarks/Misc/richards_benchmark: 1.58% (1.3037 => 1.3243, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.16% (2.9096 => 2.9434, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout/ary3: 1.04% (2.0949 => 2.1167, std.dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -8.22% (3.2926 => 3.0220, std.dev.: 0.0666) MultiSource/Applications/lua/lua: -4.93% (29.8330 => 28.3628, std.dev.: 0.2040) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.61% (1.0388 => 1.0221, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/hash2: -1.44% (3.4237 => 3.3743, std.dev.: 0.0031) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.78% (16.4461 => 16.5750, std.dev.: 0.2486) MultiSource/Applications/obsequi/Obsequi: 1.66% (1.0262 => 1.0432, std.dev.: 0.0207) MultiSource/Applications/sqlite3/sqlite3: 3.02% (0.6332 => 0.6523, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/08-main/main: 2.79% (0.1831 => 0.1882, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.12% (0.1559 => 0.1670, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.10% (0.3123 => 0.3251, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.24% (0.2463 => 0.2457, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.69% (0.3344 => 0.3367, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.20% (0.2364 => 0.2416, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/bigfib: 0.02% (0.6010 => 0.6011, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/mandel: 3.26% (0.0429 => 0.0443, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.24% (0.3266 => 0.3339, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/strcat: 2.89% (0.1969 => 0.2026, std.dev.: 0.0012) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.59% (0.0224 => 0.0241, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.98% (0.0302 => 0.0311, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 19.44% (0.0180 => 0.0215, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: 41.30% (0.0230 => 0.0325, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 3.69% (0.1438 => 0.1491, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.79% (1.1329 => 1.1419, std.dev.: 0.0258) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 4.38% (0.1462 => 0.1526, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.73% (0.4164 => 0.4236, std.dev.: 0.0248) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.31% (0.1369 => 0.1310, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.40% (0.0641 => 0.0632, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.50% (0.0578 => 0.0552, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.17% (1.1437 => 1.1418, std.dev.: 0.0085) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.06% (0.0627 => 0.0589, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.33% (0.0180 => 0.0267, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.65% (0.8017 => 0.7965, std.dev.: 0.0079) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 3.23% (0.0062 => 0.0064, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 12:14:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 14:14:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121026191405.66A0D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5259?compare_to=5256&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5259, Order: 166785, Start Time: 2012-10-26 17:49:17, End Time: 2012-10-26 19:13:59 To: 5256, Order: 166776, Start Time: 2012-10-26 16:01:39, End Time: 2012-10-26 17:26:27 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (4 on baseline) Performance Improvements: 0 (188 on baseline) Unchanged Tests: 1042 (850 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.29% (1.2783 => 1.3715, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1009, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/salsa20: 2.40% (7.4937 => 7.6739, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash2: 2.10% (3.1932 => 3.2601, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.36% (0.1431 => 0.1297, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.45% (0.3821 => 0.3498, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -8.12% (2.4924 => 2.2899, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -7.54% (0.3831 => 0.3542, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -7.53% (0.3880 => 0.3588, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.51% (0.3142 => 0.2906, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -7.48% (0.3357 => 0.3106, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/synchronized: -7.44% (0.3896 => 0.3606, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.38% (0.9542 => 0.8838, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -7.35% (0.3848 => 0.3565, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: -7.31% (0.2160 => 0.2002, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -7.30% (0.4176 => 0.3871, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: -7.29% (0.3812 => 0.3534, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/for-in: -7.29% (0.4033 => 0.3739, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -7.29% (3.5339 => 3.2763, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.29% (0.3884 => 0.3601, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.25% (0.2428 => 0.2252, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -7.24% (0.1879 => 0.1743, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -7.22% (16.1920 => 15.0226, std.dev.: 0.0107) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.22% (22.4056 => 20.7888, std.dev.: 0.0172) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.17% (0.3891 => 0.3612, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: -7.11% (0.9179 => 0.8526, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -7.10% (0.1761 => 0.1636, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -7.10% (0.9852 => 0.9153, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: -7.07% (7.0961 => 6.5946, std.dev.: 0.0078) SingleSource/UnitTests/ObjC/property: -7.05% (0.4199 => 0.3903, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -7.03% (9.2283 => 8.5795, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/himenobmtxpa: -7.02% (0.1796 => 0.1670, std.dev.: 0.0044) MultiSource/Benchmarks/nbench/nbench: -6.98% (1.1530 => 1.0725, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: -6.95% (1.2515 => 1.1645, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.94% (0.2695 => 0.2508, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: -6.93% (0.1500 => 0.1396, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.92% (0.3658 => 0.3405, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -6.87% (1.1450 => 1.0663, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.87% (0.4151 => 0.3866, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.86% (0.6484 => 0.6039, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.85% (1.0544 => 0.9822, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.84% (0.2355 => 0.2194, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.80% (1.6474 => 1.5353, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -6.80% (4.3330 => 4.0384, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.78% (4.0323 => 3.7591, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: -6.77% (1.2300 => 1.1467, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.77% (4.5069 => 4.2018, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.77% (0.6736 => 0.6280, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -6.77% (0.2985 => 0.2783, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -6.75% (0.4280 => 0.3991, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.75% (1.3722 => 1.2796, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.75% (1.6364 => 1.5260, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.74% (6.7716 => 6.3152, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.71% (1.2784 => 1.1926, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: -6.71% (0.4861 => 0.4535, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -6.69% (0.2659 => 0.2481, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.69% (0.1584 => 0.1478, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.69% (0.3931 => 0.3668, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.68% (4.8161 => 4.4945, std.dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: -6.65% (1.3148 => 1.2274, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.65% (1.4642 => 1.3669, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.64% (0.4083 => 0.3812, std.dev.: 0.0013) MultiSource/Applications/lua/lua: -6.64% (4.0594 => 3.7900, std.dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.63% (2.2587 => 2.1089, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.61% (0.5805 => 0.5421, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.59% (0.7919 => 0.7397, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.59% (4.8802 => 4.5586, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/except: -6.58% (0.3026 => 0.2827, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.58% (0.3057 => 0.2856, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.56% (0.6293 => 0.5880, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/strcat: -6.56% (0.2989 => 0.2793, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.55% (0.3252 => 0.3039, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -6.55% (0.2871 => 0.2683, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -6.55% (0.3406 => 0.3183, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.55% (0.3849 => 0.3597, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/matrix: -6.54% (0.3255 => 0.3042, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.54% (5.4682 => 5.1104, std.dev.: 0.0085) MultiSource/Applications/minisat/minisat: -6.54% (0.7447 => 0.6960, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: -6.54% (0.1621 => 0.1515, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -6.53% (0.4515 => 0.4220, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.52% (0.5478 => 0.5121, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.52% (0.3837 => 0.3587, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.51% (0.5591 => 0.5227, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.49% (2.1713 => 2.0304, std.dev.: 0.0093) MultiSource/Applications/siod/siod: -6.49% (2.4021 => 2.2463, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.48% (0.2903 => 0.2715, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.47% (0.6304 => 0.5896, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -6.47% (0.3323 => 0.3108, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: -6.46% (0.3205 => 0.2998, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -6.46% (0.6395 => 0.5982, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: -6.45% (0.3581 => 0.3350, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.45% (0.5925 => 0.5543, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.45% (0.7198 => 0.6734) SingleSource/Benchmarks/Shootout-C++/ary3: -6.44% (0.3446 => 0.3224, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -6.44% (0.6230 => 0.5829, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -6.43% (0.3481 => 0.3257, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: -6.43% (0.4524 => 0.4233, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/random: -6.43% (0.2939 => 0.2750, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.42% (0.6681 => 0.6252, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: -6.42% (15.5079 => 14.5124, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.41% (0.5863 => 0.5487, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.41% (14.2083 => 13.2974, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/functionobjects: -6.40% (0.5168 => 0.4837, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: -6.40% (1.3864 => 1.2977, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.39% (0.6052 => 0.5665, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -6.39% (0.4427 => 0.4144, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -6.39% (0.2849 => 0.2667, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.38% (0.5859 => 0.5485, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -6.38% (0.6676 => 0.6250, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/lists: -6.38% (0.3621 => 0.3390, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -6.38% (0.2933 => 0.2746, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.37% (1.2210 => 1.1432, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: -6.37% (0.6750 => 0.6320, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -6.37% (0.6660 => 0.6236, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: -6.36% (0.3394 => 0.3178, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.35% (0.6297 => 0.5897, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.35% (0.3025 => 0.2833, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: -6.33% (0.3491 => 0.3270, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: -6.33% (17.1032 => 16.0206, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.33% (0.6260 => 0.5864, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.33% (0.5581 => 0.5228, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -6.32% (0.2278 => 0.2134, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.32% (0.5857 => 0.5487, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: -6.31% (0.3788 => 0.3549, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -6.30% (0.3016 => 0.2826, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.30% (0.6194 => 0.5804, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -6.30% (0.5575 => 0.5224, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.30% (0.7339 => 0.6877, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.28% (0.2548 => 0.2388, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -6.28% (0.5705 => 0.5347, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -6.26% (0.4248 => 0.3982, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.26% (0.8521 => 0.7988, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.24% (0.5688 => 0.5333, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.24% (0.5802 => 0.5440, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.24% (0.6189 => 0.5803, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/objinst: -6.23% (0.3194 => 0.2995, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: -6.22% (3.5154 => 3.2966, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -6.22% (0.7524 => 0.7056, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.21% (0.4813 => 0.4514, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.21% (0.6440 => 0.6040, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.21% (0.6395 => 0.5998, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -6.20% (0.4321 => 0.4053, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -6.19% (0.9557 => 0.8965, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -6.19% (0.5849 => 0.5487, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.18% (0.5999 => 0.5628, std.dev.: 0.0019) SingleSource/Regression/C++/ofstream_ctor: -6.18% (0.3059 => 0.2870, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -6.18% (0.5941 => 0.5574, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -6.18% (0.5569 => 0.5225, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -6.17% (0.3483 => 0.3268, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: -6.17% (0.2999 => 0.2814, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -6.17% (8.0126 => 7.5184, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -6.17% (0.6033 => 0.5661, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.16% (0.4916 => 0.4613, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.16% (0.2385 => 0.2238, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.16% (0.6446 => 0.6049, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -6.16% (0.5456 => 0.5120, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -6.15% (0.6667 => 0.6257, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -6.14% (15.2527 => 14.3160, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.13% (1.2221 => 1.1472, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: -6.08% (0.3867 => 0.3632, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -6.05% (0.5570 => 0.5233, std.dev.: 0.0054) SingleSource/UnitTests/ObjC++/property-reference: -6.03% (0.7779 => 0.7310, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -5.99% (34.0927 => 32.0495, std.dev.: 0.0119) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.97% (0.3319 => 0.3121, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -5.96% (2.1401 => 2.0125, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.95% (0.7021 => 0.6603, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.95% (0.5567 => 0.5236, std.dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: -5.94% (18.2933 => 17.2073, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.93% (0.5329 => 0.5013, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.83% (0.1716 => 0.1616, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -5.81% (0.7982 => 0.7518, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: -5.71% (0.8418 => 0.7937, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/09-vor/vor: -5.69% (0.3271 => 0.3085, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -5.67% (0.6347 => 0.5987, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -5.65% (0.6441 => 0.6077, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.65% (0.2106 => 0.1987, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/em3d/em3d: -5.42% (0.1862 => 0.1761, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.40% (0.2001 => 0.1893, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: -5.09% (0.9077 => 0.8615, std.dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: -5.06% (5.0226 => 4.7686, std.dev.: 0.0077) MultiSource/Applications/hbd/hbd: -4.84% (1.5610 => 1.4855, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.70% (0.2277 => 0.2170, std.dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -3.46% (20.7746 => 20.0555, std.dev.: 0.0302) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7522, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/richards_benchmark: -8.64% (1.2842 => 1.1733, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.85% (1.7753 => 1.7069, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.84% (2.2633 => 2.1765, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.03% (1.3096 => 1.2830, std.dev.: 0.0093) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4697, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0003) Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 12:23:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 14:23:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121026192347.B2B802A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5260?compare_to=5257&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5260, Order: 166785, Start Time: 2012-10-26 18:00:53, End Time: 2012-10-26 19:23:43 To: 5257, Order: 166776, Start Time: 2012-10-26 16:08:15, End Time: 2012-10-26 17:31:09 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (73 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (194 on baseline) Performance Improvements: 0 (48 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 75 (2 on baseline) Unchanged Tests: 966 (646 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.22% (13.5685 => 13.8701, std.dev.: 0.0060) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.20% (0.0488 => 0.0487, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.20% (0.0489 => 0.0488, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.22% (0.0457 => 0.0456, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.22% (0.0459 => 0.0458, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.45% (0.0448 => 0.0446, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0448 => 0.0448, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0440 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.23% (0.0442 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.22% (0.0459 => 0.0458, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.22% (0.0460 => 0.0459) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.22% (0.0453 => 0.0452, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0454 => 0.0454) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.23% (0.0443 => 0.0442, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.22% (0.0445 => 0.0444, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.22% (0.0451 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.22% (0.0453 => 0.0452) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0461 => 0.0461, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.22% (0.0464 => 0.0463, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.23% (0.0438 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0439 => 0.0439) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.22% (0.0451 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0452 => 0.0452) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.23% (0.0442 => 0.0441, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.23% (0.0443 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.46% (0.0435 => 0.0433) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.23% (0.0435 => 0.0434, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.23% (0.0432 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.23% (0.0434 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.21% (0.0470 => 0.0469) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.21% (0.0471 => 0.0470, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0431 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.23% (0.0432 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0432 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0433 => 0.0433) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0440 => 0.0440, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.23% (0.0441 => 0.0440, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/BenchmarkGame/puzzle MultiSource/Applications/oggenc/oggenc: - (0.1407 => 0.1407, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0648 => 0.0648, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.03% (0.3825 => 0.3824, std.dev.: 0.0011) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.07% (0.6962 => 0.3824, std.dev.: 0.0011) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 202.72% (0.5229 => 1.5829, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 15.86% (14.9895 => 17.3669, std.dev.: 0.0057) MultiSource/Applications/kimwitu++/kc: 37.09% (14.1553 => 19.4053, std.dev.: 0.0177) MultiSource/Benchmarks/MallocBench/gs/gs: 13.44% (4.1105 => 4.6628, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 35.47% (1.1048 => 1.4967, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 318.15% (7.1582 => 29.9323, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.66% (3.4629 => 5.8405, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_container: 67.28% (0.6222 => 1.0408, std.dev.: 0.0005) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 11826.67% (0.0720 => 8.5872, std.dev.: 0.0030) MultiSource/Applications/SIBsim4/SIBsim4: 4015100.00% (0.0001 => 4.0152, std.dev.: 0.0055) MultiSource/Applications/SPASS/SPASS: 11145900.00% (0.0001 => 11.1460, std.dev.: 0.0114) MultiSource/Applications/kimwitu++/kc: 50900.00% (0.0001 => 0.0510, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63200.00% (0.0001 => 0.0633, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 792800.00% (0.0001 => 0.7929, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049800.00% (0.0001 => 10.0499, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5488600.00% (0.0001 => 5.4887, std.dev.: 0.0296) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 69.14% (0.0256 => 0.0433, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 56.38% (0.0243 => 0.0380) SingleSource/Regression/C/sumarray2d: 54.61% (0.0271 => 0.0419, std.dev.: 0.0000) SingleSource/Regression/C/sumarray: 44.59% (0.0231 => 0.0334, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.72% (1.5859 => 2.2475, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/distray/distray: 40.44% (0.1056 => 0.1483, std.dev.: 0.0002) SingleSource/UnitTests/vla: 33.80% (0.0355 => 0.0475, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 33.79% (10.3673 => 13.8701, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.90% (2.2024 => 2.8830, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 28.91% (0.1432 => 0.1846, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/neural/neural: 28.30% (0.1463 => 0.1877, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 24.59% (0.1655 => 0.2062, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 23.14% (0.0834 => 0.1027, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.84% (0.1566 => 0.1908, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: 21.28% (0.2049 => 0.2485, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 19.45% (0.4879 => 0.5828, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.29% (0.0871 => 0.1039, std.dev.: 0.0029) MultiSource/Applications/viterbi/viterbi: 18.91% (0.1555 => 0.1849, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 18.75% (0.5105 => 0.6062, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 18.38% (0.3177 => 0.3761, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 18.36% (0.0746 => 0.0883, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 17.95% (0.0730 => 0.0861) MultiSource/Benchmarks/McCat/08-main/main: 17.93% (0.2554 => 0.3012, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.83% (0.6675 => 0.7865, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 17.70% (0.1175 => 0.1383, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.32% (1.3050 => 1.5310, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.20% (0.1029 => 0.1206, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: 17.09% (0.0626 => 0.0733) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.90% (0.0793 => 0.0927, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 16.76% (0.1695 => 0.1979, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 16.75% (0.1337 => 0.1561) MultiSource/Applications/d/make_dparser: 16.67% (3.3354 => 3.8915, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.64% (0.2271 => 0.2649, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 16.51% (0.1163 => 0.1355, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.47% (0.8172 => 0.9518, std.dev.: 0.0059) MultiSource/Applications/minisat/minisat: 16.30% (0.7115 => 0.8275, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 16.09% (0.1510 => 0.1753, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.09% (0.1032 => 0.1198, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 16.08% (1.1840 => 1.3744, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.96% (1.5415 => 1.7876, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.90% (0.4615 => 0.5349, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.84% (0.5020 => 0.5815, std.dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.83% (0.3121 => 0.3615, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.68% (0.0842 => 0.0974, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 15.60% (0.3109 => 0.3594, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.58% (0.0886 => 0.1024, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.56% (0.0675 => 0.0780, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.41% (0.1940 => 0.2239, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.39% (0.0838 => 0.0967, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.95% (0.1117 => 0.1284, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 14.80% (0.1906 => 0.2188, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.77% (0.1584 => 0.1818) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.77% (0.2065 => 0.2370, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/exptree: 14.74% (0.0814 => 0.0934, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.67% (0.2107 => 0.2416, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.66% (0.9765 => 1.1197, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.64% (0.1236 => 0.1417, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 14.60% (0.1151 => 0.1319, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.59% (4.2646 => 4.8866, std.dev.: 0.0016) MultiSource/Applications/Burg/burg: 14.58% (1.1642 => 1.3339, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.56% (0.2700 => 0.3093, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.55% (0.0770 => 0.0882, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 14.49% (0.3423 => 0.3919, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.34% (0.1625 => 0.1858, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.32% (0.2758 => 0.3153, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.31% (0.1125 => 0.1286, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.22% (0.5860 => 0.6693, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 14.15% (0.7835 => 0.8944, std.dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.11% (0.6450 => 0.7360, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 14.05% (0.7433 => 0.8477, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/rem: 13.99% (0.1144 => 0.1304, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.94% (0.1062 => 0.1210, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.93% (0.5981 => 0.6814, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.91% (0.0798 => 0.0909, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 13.88% (9.4845 => 10.8007, std.dev.: 0.0121) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.81% (0.1695 => 0.1929, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 13.80% (2.0273 => 2.3070, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.66% (8.1363 => 9.2479, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.50% (0.0933 => 0.1059, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 13.40% (1.0722 => 1.2159, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 13.40% (0.4299 => 0.4875, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.38% (0.0770 => 0.0873, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 13.30% (0.3180 => 0.3603, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.29% (1.4186 => 1.6072, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.13% (0.0929 => 0.1051, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 13.13% (3.8723 => 4.3807, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.12% (0.3307 => 0.3741, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 12.93% (0.1268 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.93% (0.5569 => 0.6289, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.92% (0.8067 => 0.9109, std.dev.: 0.0084) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.91% (0.2603 => 0.2939, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 12.72% (0.8921 => 1.0056, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.54% (4.9449 => 5.5652, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.51% (5.0018 => 5.6274, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.41% (0.3441 => 0.3868, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.41% (0.1330 => 0.1495, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 12.23% (0.3092 => 0.3470, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.16% (1.1861 => 1.3303, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 11.96% (0.3387 => 0.3792, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.74% (0.3543 => 0.3959, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.64% (0.1143 => 0.1276, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.53% (0.8101 => 0.9035, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 11.38% (0.6456 => 0.7191, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 11.31% (0.4289 => 0.4774, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/parameter-passing: 11.31% (0.3927 => 0.4371, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 11.29% (0.3473 => 0.3865, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.15% (0.3543 => 0.3938, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.15% (0.3561 => 0.3958, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 11.13% (2.2969 => 2.5526, std.dev.: 0.0091) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 11.12% (0.0953 => 0.1059, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.12% (0.3516 => 0.3907, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.10% (0.3828 => 0.4253, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 11.08% (0.4620 => 0.5132, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/for-in: 11.07% (0.3694 => 0.4103, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.07% (0.3497 => 0.3884, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.68% (0.3886 => 0.4301, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 10.65% (1.5603 => 1.7264, std.dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 10.61% (5.7591 => 6.3702, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/lists: 10.61% (0.3422 => 0.3785, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.54% (0.1044 => 0.1154, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.52% (2.2022 => 2.4338, std.dev.: 0.0105) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.36% (0.1892 => 0.2088, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.35% (0.3865 => 0.4265, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.22% (0.3826 => 0.4217, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.14% (0.4203 => 0.4629, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.97% (0.4636 => 0.5098, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 9.91% (0.3684 => 0.4049, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/moments: 9.86% (0.4048 => 0.4447, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 9.60% (21.9371 => 24.0420, std.dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.53% (0.4103 => 0.4494, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 9.16% (0.3603 => 0.3933, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 9.06% (0.5925 => 0.6462, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.98% (0.4064 => 0.4429, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.96% (0.3650 => 0.3977, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.93% (0.2430 => 0.2647, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.87% (0.6030 => 0.6565, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 8.81% (17.1811 => 18.6945, std.dev.: 0.0196) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.72% (0.3427 => 0.3726, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 8.62% (0.2831 => 0.3075, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.52% (0.7326 => 0.7950, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: 8.46% (0.3098 => 0.3360, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 8.45% (0.3232 => 0.3505, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 8.44% (0.3283 => 0.3560, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.32% (3.8922 => 4.2159, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.30% (0.2891 => 0.3131, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.28% (14.3668 => 15.5558, std.dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.10% (2.0665 => 2.2339, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.06% (0.3162 => 0.3417, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 8.06% (0.2905 => 0.3139, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.02% (0.2756 => 0.2977, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.01% (0.2872 => 0.3102, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 7.98% (0.2871 => 0.3100, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.96% (0.2877 => 0.3106, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.85% (0.2714 => 0.2927, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.81% (0.2793 => 0.3011, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 7.74% (0.2725 => 0.2936, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 7.60% (0.2802 => 0.3015, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 7.60% (0.3052 => 0.3284, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 7.46% (0.3379 => 0.3631, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 7.19% (1.2842 => 1.3765, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 6.98% (0.3282 => 0.3511, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.75% (0.2266 => 0.2419, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.73% (0.3136 => 0.3347, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 6.07% (0.3131 => 0.3321, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.02% (7.9617 => 8.4406, std.dev.: 0.0098) MultiSource/Applications/JM/ldecod/ldecod: 5.94% (10.4361 => 11.0556, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.22% (0.3935 => 0.4101, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.59% (0.3817 => 0.3954, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.25% (7.0540 => 7.2830, std.dev.: 0.0102) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 31.44% (10.2830 => 13.5158, std.dev.: 0.0249) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1726, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 14.07% (2.6778 => 3.0545, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.26% (0.9957 => 1.1277, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.85% (1.1396 => 1.2519, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3681, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.64% (2.8904 => 3.0822, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625) MultiSource/Benchmarks/Olden/bh/bh: 3.82% (1.9405 => 2.0146, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.16% (0.3987 => 0.4113, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.76% (4.2280 => 4.3445, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.96% (0.8333 => 0.8496, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2077, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.51% (2.6546 => 2.6947, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 1.50% (11.6436 => 11.8180, std.dev.: 0.0158) MultiSource/Applications/viterbi/viterbi: 1.26% (4.4649 => 4.5213, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.07% (6.5088 => 6.5787, std.dev.: 0.0059) MultiSource/Applications/minisat/minisat: 1.01% (9.1159 => 9.2081, std.dev.: 0.0068) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.91% (6.6874 => 0.1395, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -82.66% (0.8651 => 0.1500) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -52.42% (5.2763 => 2.5102, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/richards_benchmark: -45.07% (0.1622 => 0.0891, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -41.93% (5.3526 => 3.1081, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -41.01% (5.3855 => 3.1768, std.dev.: 0.0031) SingleSource/UnitTests/Vector/constpool: -9.04% (54.1659 => 49.2669, std.dev.: 0.0147) MultiSource/Benchmarks/Bullet/bullet: -8.97% (63.2438 => 57.5694, std.dev.: 0.0194) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.91% (1.7609 => 1.6216, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.35% (2.9384 => 2.7812, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.47% (1.1194 => 1.0694, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -2.61% (22.1758 => 21.5971, std.dev.: 0.0132) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -52.89% (8.0499 => 3.7923, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.38% (1.1492 => 0.7656, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -28.92% (10.7105 => 7.6135, std.dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4750, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -16.08% (1.6925 => 1.4204, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.70% (1.2258 => 1.0701, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -12.13% (1.2373 => 1.0872, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/mandel-2: -10.98% (1.5373 => 1.3685, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.50% (19.9488 => 18.2522, std.dev.: 0.0308) MultiSource/Benchmarks/FreeBench/mason/mason: -8.01% (0.2161 => 0.1988, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.01% (1.8329 => 1.7044, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -5.45% (6.6465 => 6.2842, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-5: -4.97% (1.5835 => 1.5048, std.dev.: 0.0048) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.93% (1.6805 => 1.5977, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.37% (8.1563 => 7.7995, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.63% (3.2827 => 3.1634, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -3.33% (5.0483 => 4.8802, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5028, std.dev.: 0.0051) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.31% (0.4808 => 0.4697, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6829, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -1.66% (2.5528 => 2.5104, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4211, std.dev.: 0.0084) MultiSource/Applications/sqlite3/sqlite3: -1.36% (4.6441 => 4.5810, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -5.25% (0.1485 => 0.1407, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0033) Report Time: 2.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 12:50:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 14:50:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121026195017.1CC5A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5261?compare_to=5254&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5261, Order: 166777, Start Time: 2012-10-26 16:34:28, End Time: 2012-10-26 19:50:13 To: 5254, Order: 166767, Start Time: 2012-10-26 12:30:31, End Time: 2012-10-26 15:46:31 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (169 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1042 (720 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.64% (0.0625 => 0.0879, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.89% (0.1063 => 0.1402, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.86% (0.1106 => 0.1392, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.40% (0.2969 => 0.3723, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 24.86% (0.0547 => 0.0683, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 24.69% (1.5932 => 1.9866, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.29% (0.4253 => 0.5286, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.09% (0.4139 => 0.5136, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.95% (0.0714 => 0.0885, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.77% (0.4994 => 0.6181, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.08% (0.5000 => 0.6154, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.75% (0.5900 => 0.7242, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.53% (0.0475 => 0.0582, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.43% (0.0584 => 0.0715, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.40% (0.0897 => 0.1089, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.05% (0.1620 => 0.1961, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 21.04% (0.0599 => 0.0725, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 20.86% (0.1021 => 0.1234, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 20.78% (0.1107 => 0.1337, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 20.36% (0.0604 => 0.0727, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 20.04% (0.0948 => 0.1138, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.03% (0.0584 => 0.0701, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.94% (0.1003 => 0.1203, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.78% (0.3903 => 0.4675, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.78% (0.0541 => 0.0648, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 19.75% (0.0633 => 0.0758, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.63% (0.1549 => 0.1853, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.58% (0.1103 => 0.1319, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.47% (0.0642 => 0.0767, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 19.27% (0.1619 => 0.1931, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 19.24% (0.0821 => 0.0979, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.86% (0.0822 => 0.0977, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 18.77% (0.1604 => 0.1905, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.33% (0.1462 => 0.1730, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 18.16% (0.0947 => 0.1119, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.10% (0.3890 => 0.4594, std.dev.: 0.0036) MultiSource/Applications/sgefa/sgefa: 18.07% (0.0808 => 0.0954, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/Hello: 17.83% (0.5826 => 0.6865, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 17.73% (0.1218 => 0.1434, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.60% (1.3152 => 1.5467, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/09-vor/vor: 17.48% (0.1505 => 0.1768, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.43% (0.2014 => 0.2365, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 17.41% (0.5889 => 0.6914, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.32% (0.2736 => 0.3210, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 17.30% (0.4029 => 0.4726, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.10% (0.1088 => 0.1274, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 17.05% (0.0698 => 0.0817, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.03% (0.2866 => 0.3354, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 16.94% (1.8794 => 2.1977, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.78% (0.3271 => 0.3820, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 16.71% (0.5546 => 0.6473, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.43% (0.5026 => 0.5852, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.42% (0.2875 => 0.3347, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.36% (0.2738 => 0.3186, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.35% (3.5627 => 4.1451, std.dev.: 0.0099) MultiSource/Benchmarks/McCat/18-imp/imp: 16.33% (0.1421 => 0.1653, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 16.29% (0.9697 => 1.1277, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.29% (0.1160 => 0.1349, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.28% (0.3195 => 0.3715, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.10% (0.4658 => 0.5408, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 16.06% (0.7171 => 0.8323, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.06% (0.1968 => 0.2284, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.05% (1.6211 => 1.8813, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: 16.04% (0.2725 => 0.3162, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 15.85% (1.0781 => 1.2490, std.dev.: 0.0034) MultiSource/Benchmarks/Bullet/bullet: 15.83% (23.5202 => 27.2430, std.dev.: 0.0155) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.71% (4.4195 => 5.1140, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hello: 15.62% (0.2714 => 0.3138, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 15.54% (0.2780 => 0.3212, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.50% (0.2729 => 0.3152, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 15.48% (0.3004 => 0.3469, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.47% (0.3930 => 0.4538, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.46% (0.4361 => 0.5035, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/wc: 15.44% (0.3096 => 0.3574, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 15.43% (0.2813 => 0.3247, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 15.42% (0.2750 => 0.3174, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 15.41% (0.9909 => 1.1436, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/except: 15.40% (0.2811 => 0.3244, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 15.37% (0.2823 => 0.3257, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.37% (0.2792 => 0.3221, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.32% (0.2911 => 0.3357, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 15.31% (0.2803 => 0.3232, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 15.26% (4.2109 => 4.8533, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.18% (2.0673 => 2.3811, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.14% (0.1090 => 0.1255, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.07% (2.7292 => 3.1406, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 15.03% (0.1284 => 0.1477, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.01% (0.3690 => 0.4244, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/ary3: 15.00% (0.3267 => 0.3757, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.91% (1.9694 => 2.2631, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.66% (0.3362 => 0.3855, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 14.58% (0.3258 => 0.3733, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.55% (1.9966 => 2.2871, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.48% (0.3060 => 0.3503, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 14.44% (0.3317 => 0.3796, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.37% (0.3124 => 0.3573, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.25% (0.3845 => 0.4393, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 14.16% (0.4146 => 0.4733, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 14.11% (0.3678 => 0.4197, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 14.10% (0.3348 => 0.3820, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 14.07% (0.2075 => 0.2367, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.02% (0.3282 => 0.3742, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.01% (0.3625 => 0.4133, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 13.87% (0.2566 => 0.2922, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/sieve: 13.82% (0.3726 => 0.4241, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 13.81% (0.3477 => 0.3957, std.dev.: 0.0043) MultiSource/Applications/lua/lua: 13.69% (1.4269 => 1.6223, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash2: 13.67% (0.4251 => 0.4832, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.39% (0.3981 => 0.4514, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 13.27% (0.7875 => 0.8920, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 13.23% (0.5012 => 0.5675, std.dev.: 0.0128) MultiSource/Applications/JM/ldecod/ldecod: 13.18% (2.1653 => 2.4507, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-4: 13.10% (0.3465 => 0.3919, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 13.10% (0.3496 => 0.3954, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 13.09% (0.3446 => 0.3897, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.07% (0.3488 => 0.3944, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 13.02% (0.3442 => 0.3890, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.00% (0.3469 => 0.3920, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 12.98% (0.3460 => 0.3909, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 12.88% (4.6177 => 5.2124, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/property: 12.77% (0.3650 => 0.4116, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 12.60% (0.3643 => 0.4102, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 12.57% (0.3724 => 0.4192, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.35% (0.2040 => 0.2292, std.dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: 12.35% (2.1013 => 2.3608, std.dev.: 0.0086) MultiSource/Applications/SIBsim4/SIBsim4: 11.89% (0.2691 => 0.3011, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.73% (0.6435 => 0.7190, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.70% (0.2068 => 0.2310, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.67% (0.1028 => 0.1148, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 11.59% (5.5417 => 6.1840, std.dev.: 0.0190) MultiSource/Applications/lambda-0_1_3/lambda: 11.12% (0.3498 => 0.3887, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.00% (0.2737 => 0.3038, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 10.96% (0.6634 => 0.7361, std.dev.: 0.0021) MultiSource/Applications/minisat/minisat: 10.73% (0.3336 => 0.3694, std.dev.: 0.0025) MultiSource/Benchmarks/PAQ8p/paq8p: 10.69% (0.4847 => 0.5365, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.41% (0.1383 => 0.1527, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.38% (0.3084 => 0.3404, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.84% (0.2103 => 0.2310, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 9.53% (2.0346 => 2.2284, std.dev.: 0.0027) MultiSource/Applications/lemon/lemon: 9.41% (0.2391 => 0.2616, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.38% (4.6926 => 5.1326, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.71% (11.6398 => 12.6535, std.dev.: 0.0148) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.60% (0.5361 => 0.5822, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.17% (0.7426 => 0.8033, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.92% (0.5584 => 0.6026, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 7.11% (11.9555 => 12.8059, std.dev.: 0.0133) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.74% (0.3792 => 0.3934, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6535, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0300, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.25% (0.5917 => 0.6701, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 9.14% (0.2802 => 0.3058, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6110, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.04% (12.0509 => 12.6585, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.96% (0.3693 => 0.3876, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1655, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/flops-2: 3.87% (1.8057 => 1.8756, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/dry: 2.69% (14.0481 => 14.4253, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2030, std.dev.: 0.0034) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.72% (3.1722 => 3.2268, std.dev.: 0.0025) MultiSource/Applications/viterbi/viterbi: 1.48% (46.6247 => 47.3141, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.47% (7.1849 => 7.2905, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5150, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5399, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.6000, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.51% (2.4764 => 2.4391, std.dev.: 0.0065) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.46% (25.4195 => 16.4061, std.dev.: 0.0095) MultiSource/Applications/hexxagon/hexxagon: -7.70% (28.1477 => 25.9802, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7760, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9583, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: -6.41% (0.2402 => 0.2248, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: -3.69% (3.3665 => 3.2423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.34% (11.2080 => 10.8337, std.dev.: 0.0629) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.15% (0.6293 => 0.6095, std.dev.: 0.0060) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7740, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5218, std.dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/fldry: -2.46% (17.2379 => 16.8130, std.dev.: 0.0230) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8665, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5712, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4956, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7160, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.2004, std.dev.: 0.0331) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.10% (21.9346 => 21.6927, std.dev.: 0.0864) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0429, std.dev.: 0.0034) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 13:47:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 15:47:00 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121026204700.06CE32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5262?compare_to=5258&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5262, Order: 166796, Start Time: 2012-10-26 19:21:19, End Time: 2012-10-26 20:46:56 To: 5258, Order: 166784, Start Time: 2012-10-26 17:38:49, End Time: 2012-10-26 19:03:43 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 18 (65 on baseline) Performance Improvements: 4 (3 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 953 (906 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 30.39% (15.2603 => 19.8977, std.dev.: 0.1176) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.07% (1.1246 => 1.1704, std.dev.: 0.0057) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.78% (0.3202 => 0.3323, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.75% (0.4983 => 0.5170, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.58% (13.3631 => 13.8411, std.dev.: 0.1229) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.22% (0.9423 => 0.9726, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.03% (0.5813 => 0.5989, std.dev.: 0.0056) MultiSource/Applications/SIBsim4/SIBsim4: 2.78% (1.2938 => 1.3298, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/football/football: 2.67% (0.8808 => 0.9043, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.61% (6.7238 => 6.8994, std.dev.: 0.0578) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.23% (0.6230 => 0.6369, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.20% (4.5675 => 4.6681, std.dev.: 0.0341) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.14% (8.6395 => 8.8242, std.dev.: 0.0529) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.14% (0.7819 => 0.7986, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.43% (4.5124 => 4.5769, std.dev.: 0.0171) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 21.68% (19.7515 => 24.0340, std.dev.: 0.7551) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.49% (1.2666 => 1.2855, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 1.09% (8.8923 => 8.9891, std.dev.: 0.0298) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.31% (3.3263 => 3.2161, std.dev.: 0.0258) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -3.12% (1.5923 => 1.5426, std.dev.: 0.0098) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -2.32% (1.3243 => 1.2936, std.dev.: 0.0065) SingleSource/Benchmarks/Dhrystone/dry: -1.92% (0.5320 => 0.5218, std.dev.: 0.0026) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.05% (16.5750 => 16.5834, std.dev.: 0.3594) MultiSource/Applications/obsequi/Obsequi: 1.21% (1.0432 => 1.0558, std.dev.: 0.0103) MultiSource/Applications/sqlite3/sqlite3: -0.58% (0.6523 => 0.6485, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/08-main/main: 1.01% (0.1882 => 0.1901, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.20% (0.1670 => 0.1650, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.34% (0.3251 => 0.3262, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.08% (0.2457 => 0.2459, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.21% (0.3367 => 0.3374, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.24% (0.2416 => 0.2386, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: -0.20% (0.6011 => 0.5999, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/mandel: 10.84% (0.0443 => 0.0491, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.63% (0.3339 => 0.3318, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/strcat: -0.44% (0.2026 => 0.2017, std.dev.: 0.0012) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.22% (0.0241 => 0.0256, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.92% (0.0218 => 0.0220, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0426 => 0.0426, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.91% (0.0330 => 0.0333, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.96% (0.0311 => 0.0314, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.47% (0.0423 => 0.0425, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 0.49% (0.0203 => 0.0204, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/test1: 1.86% (0.0215 => 0.0219, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -0.92% (0.0325 => 0.0322, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.54% (0.1491 => 0.1483, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 3.21% (1.1419 => 1.1786, std.dev.: 0.0267) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.39% (0.1526 => 0.1520, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.34% (0.4236 => 0.4052, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.02% (0.1310 => 0.1402, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.69% (0.0632 => 0.0615, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0277 => 0.0277, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.09% (0.0552 => 0.0558, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.34% (1.1418 => 1.1457, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.96% (0.0589 => 0.0630, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.25% (0.0267 => 0.0261, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.85% (0.7965 => 0.8033, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 17.19% (0.0064 => 0.0075, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.84% (2.1832 => 1.6627, std.dev.: 0.0131) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 34.73% (14.7684 => 19.8977, std.dev.: 0.1176) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.56% (0.0810 => 0.0936, std.dev.: 0.0012) SingleSource/UnitTests/SignlessTypes/rem: 12.46% (0.1035 => 0.1164, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/tsp/tsp: 11.33% (0.1112 => 0.1238, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.97% (0.8321 => 0.9067, std.dev.: 0.0078) MultiSource/Applications/viterbi/viterbi: 8.69% (0.1577 => 0.1714, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/health/health: 8.09% (0.1347 => 0.1456, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.43% (0.2180 => 0.2342, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.02% (0.2279 => 0.2439, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.86% (0.7473 => 0.7986, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.66% (0.4847 => 0.5170, std.dev.: 0.0049) MultiSource/Applications/spiff/spiff: 6.63% (0.7950 => 0.8477, std.dev.: 0.0118) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.93% (0.3137 => 0.3323, std.dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: 5.81% (1.2568 => 1.3298, std.dev.: 0.0129) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.78% (0.1885 => 0.1994, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 5.47% (1.4269 => 1.5049, std.dev.: 0.0098) MultiSource/Applications/Burg/burg: 5.39% (1.2222 => 1.2881, std.dev.: 0.0112) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.27% (0.2240 => 0.2358, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.24% (0.2519 => 0.2651, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.01% (13.1811 => 13.8411, std.dev.: 0.1229) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.78% (1.1170 => 1.1704, std.dev.: 0.0057) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.42% (6.6074 => 6.8994, std.dev.: 0.0578) MultiSource/Applications/sgefa/sgefa: 4.10% (0.2999 => 0.3122, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.97% (0.3124 => 0.3248, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.75% (1.4479 => 1.5022, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/football/football: 3.14% (0.8768 => 0.9043, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.08% (0.9435 => 0.9726, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.96% (0.5817 => 0.5989, std.dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: 2.96% (0.9810 => 1.0100, std.dev.: 0.0097) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.80% (0.3717 => 0.3821, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.68% (4.1763 => 4.2882, std.dev.: 0.0152) MultiSource/Applications/d/make_dparser: 2.64% (3.2366 => 3.3219, std.dev.: 0.0296) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.63% (0.4559 => 0.4679, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 2.51% (3.8189 => 3.9149, std.dev.: 0.0267) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.42% (1.1685 => 1.1968, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.31% (0.9074 => 0.9284, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.28% (0.6227 => 0.6369, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.25% (0.8697 => 0.8893, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.15% (0.8050 => 0.8223, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.14% (4.5702 => 4.6681, std.dev.: 0.0341) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.10% (0.8007 => 0.8175, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.04% (8.6476 => 8.8242, std.dev.: 0.0529) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.03% (0.8805 => 0.8984, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.03% (0.7932 => 0.8093, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.02% (0.8597 => 0.8771, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.00% (4.4873 => 4.5769, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.94% (0.8317 => 0.8478, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.86% (0.9069 => 0.9238, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.74% (0.8086 => 0.8227, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.68% (0.8457 => 0.8599, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.67% (0.8048 => 0.8182, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.60% (0.9039 => 0.9184, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.50% (1.2423 => 1.2609, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.39% (0.8518 => 0.8636, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.26% (0.8177 => 0.8280, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.94% (1.5795 => 2.5105, std.dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 9.42% (21.9654 => 24.0340, std.dev.: 0.7551) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.79% (0.3186 => 0.3466, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.42% (1.1857 => 1.2855, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 5.92% (63.1822 => 66.9221, std.dev.: 0.1383) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.40% (2.2485 => 2.3474, std.dev.: 0.0241) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.00% (2.4490 => 2.5225, std.dev.: 0.0163) SingleSource/Benchmarks/Misc/ReedSolomon: 2.84% (8.5322 => 8.7744, std.dev.: 0.0233) MultiSource/Applications/siod/siod: 2.73% (3.6643 => 3.7644, std.dev.: 0.0095) SingleSource/Benchmarks/Dhrystone/dry: 2.70% (0.5081 => 0.5218, std.dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -5.35% (29.8330 => 28.2356, std.dev.: 0.3038) SingleSource/Benchmarks/Shootout-C++/hash2: -1.53% (3.4237 => 3.3713, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.31% (3.3479 => 3.3040, std.dev.: 0.0052) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.83% (16.4461 => 16.5834, std.dev.: 0.3594) MultiSource/Applications/obsequi/Obsequi: 2.88% (1.0262 => 1.0558, std.dev.: 0.0103) MultiSource/Applications/sqlite3/sqlite3: 2.42% (0.6332 => 0.6485, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/08-main/main: 3.82% (0.1831 => 0.1901, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.84% (0.1559 => 0.1650, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.45% (0.3123 => 0.3262, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.16% (0.2463 => 0.2459, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.90% (0.3344 => 0.3374, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.93% (0.2364 => 0.2386, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: -0.18% (0.6010 => 0.5999, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/mandel: 14.45% (0.0429 => 0.0491, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.59% (0.3266 => 0.3318, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/strcat: 2.44% (0.1969 => 0.2017, std.dev.: 0.0012) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 14.29% (0.0224 => 0.0256, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.86% (0.0123 => 0.0220, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: 40.00% (0.0230 => 0.0322, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 3.13% (0.1438 => 0.1483, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 4.03% (1.1329 => 1.1786, std.dev.: 0.0267) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.97% (0.1462 => 0.1520, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.69% (0.4164 => 0.4052, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.41% (0.1369 => 0.1402, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.06% (0.0641 => 0.0615, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.46% (0.0578 => 0.0558, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.17% (1.1437 => 1.1457, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.48% (0.0627 => 0.0630, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 45.00% (0.0180 => 0.0261, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.20% (0.8017 => 0.8033, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 20.97% (0.0062 => 0.0075, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 14:01:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 16:01:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121026210158.9A7FB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5263?compare_to=5259&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5263, Order: 166796, Start Time: 2012-10-26 19:36:50, End Time: 2012-10-26 21:01:54 To: 5259, Order: 166785, Start Time: 2012-10-26 17:49:17, End Time: 2012-10-26 19:13:59 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 10 (5 on baseline) Performance Improvements: 0 (181 on baseline) Unchanged Tests: 1032 (856 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 26.14% (14.3160 => 18.0587, std.dev.: 0.0063) MultiSource/Applications/SIBsim4/SIBsim4: 2.93% (1.2977 => 1.3357, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.43% (13.2974 => 13.6211, std.dev.: 0.0092) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.14% (1.1467 => 1.1712, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 1.44% (0.8526 => 0.8649, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.42% (16.0206 => 16.2477, std.dev.: 0.0067) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.40% (6.3152 => 6.4035, std.dev.: 0.0024) MultiSource/Applications/lemon/lemon: 1.22% (1.0663 => 1.0793, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.05% (2.0304 => 2.0518, std.dev.: 0.0055) MultiSource/Benchmarks/nbench/nbench: 1.04% (1.0725 => 1.0837, std.dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 18.40% (15.2527 => 18.0587, std.dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1011, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/salsa20: 2.55% (7.4937 => 7.6846, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hash2: 2.20% (3.1932 => 3.2633, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.29% (0.1431 => 0.1298, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.88% (0.3821 => 0.3520, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -7.55% (2.4924 => 2.3042, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.22% (0.3142 => 0.2915, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.21% (0.2428 => 0.2253, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.15% (22.4056 => 20.8034, std.dev.: 0.0130) MultiSource/Applications/sgefa/sgefa: -6.94% (0.3357 => 0.3124) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.92% (0.3658 => 0.3405, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -6.85% (0.2160 => 0.2012, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.74% (0.6484 => 0.6047, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: -6.69% (0.2659 => 0.2481, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.69% (0.9542 => 0.8904, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.65% (3.5339 => 3.2990, std.dev.: 0.0074) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.64% (0.1716 => 0.1602, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.62% (0.2355 => 0.2199, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -6.62% (1.2515 => 1.1686, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: -6.62% (4.3330 => 4.0460, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.62% (1.2784 => 1.1938, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: -6.58% (16.1920 => 15.1273, std.dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: -6.56% (7.0961 => 6.6307, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.53% (1.0544 => 0.9855, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -6.53% (0.1761 => 0.1646, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.51% (5.4682 => 5.1123, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.48% (0.9852 => 0.9214, std.dev.: 0.0117) MultiSource/Benchmarks/Olden/bh/bh: -6.47% (0.2985 => 0.2792, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -6.44% (9.2283 => 8.6342, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.42% (1.6474 => 1.5416, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.42% (4.5069 => 4.2176, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.41% (4.8161 => 4.5075, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.41% (1.3722 => 1.2843, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.39% (1.4642 => 1.3706, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.39% (1.6364 => 1.5319, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.38% (0.1584 => 0.1483, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -6.37% (0.3831 => 0.3587, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -6.37% (0.3880 => 0.3633, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.35% (0.1796 => 0.1682, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.34% (4.8802 => 4.5710, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.33% (0.3884 => 0.3638, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -6.33% (0.1879 => 0.1760, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -6.32% (2.4021 => 2.2503, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.32% (0.2548 => 0.2387, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.30% (0.7919 => 0.7420, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.30% (0.3891 => 0.3646, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -6.30% (0.3812 => 0.3572, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.29% (0.3848 => 0.3606, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -6.29% (0.3896 => 0.3651, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -6.27% (0.4176 => 0.3914, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -6.26% (4.0594 => 3.8051, std.dev.: 0.0096) SingleSource/UnitTests/ObjC/for-in: -6.25% (0.4033 => 0.3781, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.25% (0.6293 => 0.5900, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.20% (0.5999 => 0.5627, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.19% (4.0323 => 3.7829, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.15% (2.2587 => 2.1198, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.14% (0.8521 => 0.7998, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.12% (0.5805 => 0.5450, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.09% (1.2210 => 1.1466, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.07% (0.4151 => 0.3899, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -6.07% (0.6230 => 0.5852, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.06% (1.2221 => 1.1481, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: -6.01% (1.1530 => 1.0837, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.01% (0.5857 => 0.5505, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.01% (0.5591 => 0.5255, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.01% (0.7339 => 0.6898, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -6.00% (0.4280 => 0.4023, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.00% (0.5863 => 0.5511, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: -6.00% (0.4199 => 0.3947, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.99% (0.6395 => 0.6012, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.99% (0.6681 => 0.6281, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.99% (0.6297 => 0.5920, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.97% (0.6194 => 0.5824, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.97% (0.2278 => 0.2142, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -5.97% (0.4861 => 0.4571, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.96% (0.7198 => 0.6769, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -5.96% (1.3148 => 1.2365, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.95% (0.6736 => 0.6335, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.95% (0.5478 => 0.5152, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.94% (0.5925 => 0.5573, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.93% (0.5802 => 0.5458, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.92% (0.4916 => 0.4625, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.92% (0.6052 => 0.5694, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.90% (0.5575 => 0.5246, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.90% (0.5581 => 0.5252, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.89% (0.5859 => 0.5514, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: -5.86% (15.5079 => 14.5994, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.85% (0.4083 => 0.3844, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.85% (0.6304 => 0.5935, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.85% (0.6189 => 0.5827, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: -5.84% (0.6750 => 0.6356, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: -5.84% (0.3581 => 0.3372, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.83% (0.4321 => 0.4069, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.83% (0.6676 => 0.6287, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/strcat: -5.79% (0.2989 => 0.2816, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.79% (0.2385 => 0.2247, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.78% (0.7524 => 0.7089, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.78% (0.5849 => 0.5511, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: -5.77% (0.9179 => 0.8649, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: -5.77% (0.3621 => 0.3412, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.76% (0.3837 => 0.3616, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -5.76% (0.4515 => 0.4255, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.75% (0.6033 => 0.5686, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -5.75% (0.3446 => 0.3248, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -5.75% (0.3481 => 0.3281, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -5.74% (1.1450 => 1.0793, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.73% (0.5567 => 0.5248, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.73% (0.6440 => 0.6071, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.72% (0.6395 => 0.6029, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.70% (0.6260 => 0.5903, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.70% (0.3491 => 0.3292, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.69% (0.6660 => 0.6281, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.69% (0.5168 => 0.4874, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -5.68% (0.3026 => 0.2854, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: -5.68% (0.7447 => 0.7024, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.65% (0.9557 => 0.9017, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.64% (0.5569 => 0.5255, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.64% (0.2999 => 0.2830, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.63% (0.3323 => 0.3136, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.62% (0.3931 => 0.3710, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.61% (0.4813 => 0.4543, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.60% (0.2106 => 0.1988, std.dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: -5.60% (18.2933 => 17.2687, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.60% (0.6446 => 0.6085, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -5.60% (0.3394 => 0.3204, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -5.59% (0.3255 => 0.3073, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.59% (0.5688 => 0.5370, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: -5.59% (3.5154 => 3.3189, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.58% (0.6667 => 0.6295, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -5.58% (0.3406 => 0.3216, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.57% (0.3319 => 0.3134, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.57% (0.5941 => 0.5610, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -5.56% (0.7982 => 0.7538, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.55% (0.5456 => 0.5153, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -5.54% (0.2871 => 0.2712, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.54% (0.5329 => 0.5034, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.54% (0.3252 => 0.3072, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.53% (0.4427 => 0.4182, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.53% (0.5570 => 0.5262, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: -5.53% (0.4524 => 0.4274, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.50% (2.1713 => 2.0518, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.50% (0.3057 => 0.2889, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.48% (0.7021 => 0.6636, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -5.48% (0.3867 => 0.3655, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -5.48% (0.2939 => 0.2778, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.46% (8.0126 => 7.5752, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.46% (0.3849 => 0.3639, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.44% (0.2903 => 0.2745) SingleSource/Benchmarks/Shootout-C++/sieve: -5.44% (0.3788 => 0.3582, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -5.44% (34.0927 => 32.2394, std.dev.: 0.0057) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.44% (6.7716 => 6.4035, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hello: -5.41% (0.2849 => 0.2695, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.40% (0.3016 => 0.2853, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -5.39% (0.4248 => 0.4019, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.39% (0.2933 => 0.2775, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -5.33% (0.3059 => 0.2896, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -5.32% (0.3025 => 0.2864, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -5.30% (0.3205 => 0.3035, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -5.26% (0.3194 => 0.3026, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -5.24% (0.8418 => 0.7977, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: -5.19% (2.1401 => 2.0291, std.dev.: 0.0074) SingleSource/UnitTests/ObjC++/property-reference: -5.15% (0.7779 => 0.7378, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.15% (0.2001 => 0.1898, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -5.11% (0.9077 => 0.8613, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.05% (0.3483 => 0.3307, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -5.00% (17.1032 => 16.2477, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/09-vor/vor: -4.98% (0.3271 => 0.3108, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/bc/bc: -4.78% (1.2300 => 1.1712, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.74% (0.2277 => 0.2169, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: -4.69% (5.0226 => 4.7870, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.68% (0.2695 => 0.2569, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -4.66% (0.6441 => 0.6141, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -4.65% (0.6347 => 0.6052, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -4.45% (1.5610 => 1.4916, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.13% (14.2083 => 13.6211, std.dev.: 0.0092) MultiSource/Applications/SIBsim4/SIBsim4: -3.66% (1.3864 => 1.3357, std.dev.: 0.0060) SingleSource/UnitTests/Vector/constpool: -2.96% (20.7746 => 20.1589, std.dev.: 0.0094) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.50% (7.5137 => 5.7483, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/richards_benchmark: -8.74% (1.2842 => 1.1720, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.69% (2.2633 => 2.1797, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.51% (6.5735 => 6.4744, std.dev.: 0.0011) Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 14:16:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 16:16:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121026211656.A9C542A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5264?compare_to=5260&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5264, Order: 166798, Start Time: 2012-10-26 19:53:23, End Time: 2012-10-26 21:16:44 To: 5260, Order: 166785, Start Time: 2012-10-26 18:00:53, End Time: 2012-10-26 19:23:43 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (73 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 10 (197 on baseline) Performance Improvements: 4 (48 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 75 (2 on baseline) Unchanged Tests: 953 (643 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.05% (21.5971 => 25.9278, std.dev.: 0.0132) MultiSource/Applications/SIBsim4/SIBsim4: 2.58% (1.5829 => 1.6237, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.19% (15.5558 => 15.8960, std.dev.: 0.0148) MultiSource/Benchmarks/PAQ8p/paq8p: 2.08% (13.8701 => 14.1590, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.94% (1.3303 => 1.3561, std.dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 1.52% (1.3744 => 1.3953, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/football/football: 1.26% (1.0056 => 1.0183, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.20% (18.6945 => 18.9188, std.dev.: 0.0210) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.01% (7.2830 => 7.3569, std.dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.03% (54.9107 => 56.5744, std.dev.: 0.0701) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -1.16% (11.0556 => 10.9270, std.dev.: 0.0096) MultiSource/Applications/hbd/hbd: -1.12% (1.7264 => 1.7070, std.dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Bullet/bullet: -1.77% (7.6135 => 7.4785, std.dev.: 0.0094) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.50% (1.3100 => 1.2904, std.dev.: 0.0055) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -0.41% (0.0487 => 0.0485, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.20% (0.0488 => 0.0487, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.22% (0.0456 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.44% (0.0458 => 0.0456, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -0.22% (0.0446 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.22% (0.0448 => 0.0447) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.23% (0.0440 => 0.0439, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.23% (0.0441 => 0.0440, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -0.22% (0.0458 => 0.0457, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.22% (0.0459 => 0.0458) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.22% (0.0452 => 0.0451, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.44% (0.0454 => 0.0452, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.45% (0.0442 => 0.0440, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -0.23% (0.0444 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.22% (0.0450 => 0.0449, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -0.66% (0.0452 => 0.0449, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.43% (0.0461 => 0.0459, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.43% (0.0463 => 0.0461, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.23% (0.0437 => 0.0436, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.23% (0.0439 => 0.0438) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.44% (0.0450 => 0.0448, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.66% (0.0452 => 0.0449, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.45% (0.0441 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.45% (0.0442 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.23% (0.0433 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.23% (0.0434 => 0.0433, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.23% (0.0431 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.23% (0.0433 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.43% (0.0469 => 0.0467, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.21% (0.0470 => 0.0469) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.23% (0.0431 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0431 => 0.0431) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.46% (0.0432 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.23% (0.0433 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.23% (0.0440 => 0.0439) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.23% (0.0440 => 0.0439, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/BenchmarkGame/puzzle MultiSource/Applications/oggenc/oggenc: - (0.1407 => 0.1407, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.93% (0.0648 => 0.0667, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.05% (0.3824 => 0.3826, std.dev.: 0.0011) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.04% (0.6962 => 0.3826, std.dev.: 0.0011) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 210.52% (0.5229 => 1.6237, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 16.27% (14.9895 => 17.4285, std.dev.: 0.0235) MultiSource/Applications/kimwitu++/kc: 37.32% (14.1553 => 19.4377, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/gs/gs: 13.68% (4.1105 => 4.6728, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 35.62% (1.1048 => 1.4983, std.dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 317.15% (7.1582 => 29.8607, std.dev.: 0.0187) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.36% (3.4629 => 5.8301, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 67.23% (0.6222 => 1.0405, std.dev.: 0.0009) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 11820.83% (0.0720 => 8.5830, std.dev.: 0.0102) MultiSource/Applications/SIBsim4/SIBsim4: 4016300.00% (0.0001 => 4.0164, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 11134900.00% (0.0001 => 11.1350, std.dev.: 0.0397) MultiSource/Applications/kimwitu++/kc: 50500.00% (0.0001 => 0.0506, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63200.00% (0.0001 => 0.0633, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 794500.00% (0.0001 => 0.7946, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050400.00% (0.0001 => 10.0505, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5486400.00% (0.0001 => 5.4865, std.dev.: 0.0078) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 69.14% (0.0256 => 0.0433, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 56.38% (0.0243 => 0.0380) SingleSource/Regression/C/sumarray2d: 54.61% (0.0271 => 0.0419) SingleSource/Regression/C/sumarray: 45.02% (0.0231 => 0.0335, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 42.22% (1.5859 => 2.2554, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/distray/distray: 40.81% (0.1056 => 0.1487, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 36.57% (10.3673 => 14.1590, std.dev.: 0.0038) SingleSource/UnitTests/vla: 34.08% (0.0355 => 0.0476, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.97% (2.2024 => 2.8844, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/flops: 29.19% (0.1432 => 0.1850, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 29.19% (0.1463 => 0.1890, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 25.62% (0.1655 => 0.2079, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 23.38% (0.0834 => 0.1029, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 22.06% (0.2049 => 0.2501, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.03% (0.1566 => 0.1911, std.dev.: 0.0001) MultiSource/Benchmarks/llubenchmark/llu: 21.86% (0.0462 => 0.0563, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/hash: 21.24% (0.0485 => 0.0588, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 20.72% (0.1144 => 0.1381, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 19.65% (0.5105 => 0.6108, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 19.45% (0.4879 => 0.5828, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.40% (0.0871 => 0.1040, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 18.65% (0.1555 => 0.1845, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 18.45% (0.3177 => 0.3763, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 18.23% (0.0746 => 0.0882, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.05% (0.6675 => 0.7880, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 17.95% (0.0730 => 0.0861, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 17.85% (1.1840 => 1.3953, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/08-main/main: 17.74% (0.2554 => 0.3007, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 17.70% (0.1175 => 0.1383, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.65% (1.3050 => 1.5353, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout/lists: 17.41% (0.0626 => 0.0735) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.28% (0.0793 => 0.0930, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 17.14% (3.3354 => 3.9071, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.01% (0.1029 => 0.1204, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 16.94% (0.7115 => 0.8320, std.dev.: 0.0042) MultiSource/Applications/ClamAV/clamscan: 16.92% (22.1758 => 25.9278, std.dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.85% (0.5020 => 0.5866, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 16.81% (0.1695 => 0.1980, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.78% (0.2271 => 0.2652, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 16.60% (0.1163 => 0.1356, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 16.49% (0.1510 => 0.1759, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.47% (0.1032 => 0.1202, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.47% (0.8172 => 0.9518, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.23% (0.4615 => 0.5364, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.15% (1.5415 => 1.7905, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.12% (0.3121 => 0.3624, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 16.01% (0.1337 => 0.1551, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.91% (0.0886 => 0.1027, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 15.89% (0.3109 => 0.3603, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.88% (0.1940 => 0.2248, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.56% (0.0842 => 0.0973, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.56% (0.0675 => 0.0780, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.39% (0.0838 => 0.0967, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 15.38% (0.1151 => 0.1328, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 15.29% (0.1236 => 0.1425, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 15.29% (0.2603 => 0.3001, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 15.15% (0.1584 => 0.1824, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/exptree: 15.11% (0.0814 => 0.0937, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.95% (0.6450 => 0.7414, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 14.90% (0.3423 => 0.3933, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 14.87% (2.0273 => 2.3287, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 14.85% (0.1906 => 0.2189, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.80% (0.9765 => 1.1210, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.78% (4.2646 => 4.8950, std.dev.: 0.0047) MultiSource/Applications/Burg/burg: 14.77% (1.1642 => 1.3362, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.77% (0.1117 => 0.1282, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 14.74% (0.0719 => 0.0825) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.68% (0.0770 => 0.0883, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.67% (0.2700 => 0.3096, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.62% (0.2107 => 0.2415, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.61% (0.2758 => 0.3161, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.53% (0.2065 => 0.2365, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 14.51% (1.0722 => 1.2278, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.41% (0.1062 => 0.1215, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 14.36% (0.7835 => 0.8960, std.dev.: 0.0061) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.35% (0.1143 => 0.1307, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.33% (1.1861 => 1.3561, std.dev.: 0.0029) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.31% (0.1125 => 0.1286, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 14.18% (8.1363 => 9.2903, std.dev.: 0.0071) MultiSource/Benchmarks/mafft/pairlocalalign: 14.18% (9.4845 => 10.8293, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 14.15% (0.8921 => 1.0183, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 14.11% (0.7433 => 0.8482, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.04% (0.5981 => 0.6821, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.94% (0.5860 => 0.6677, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.86% (0.1695 => 0.1930, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 13.84% (0.0730 => 0.0831, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.83% (0.0933 => 0.1062, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 13.79% (0.4299 => 0.4892, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.79% (1.4186 => 1.6142, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.78% (0.0798 => 0.0908, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 13.74% (0.3180 => 0.3617, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.42% (0.1625 => 0.1843, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.35% (0.0929 => 0.1053, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.33% (0.8067 => 0.9142, std.dev.: 0.0078) MultiSource/Applications/lua/lua: 13.25% (3.8723 => 4.3855, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.12% (0.3307 => 0.3741, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.12% (0.0770 => 0.0871, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 13.01% (0.1268 => 0.1433, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.01% (0.1330 => 0.1503, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.96% (0.5569 => 0.6291, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 12.81% (0.3387 => 0.3821, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.58% (4.9449 => 5.5668, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.53% (0.3441 => 0.3872, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.49% (5.0018 => 5.6267, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: 12.32% (0.3092 => 0.3473, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.57% (0.8101 => 0.9038, std.dev.: 0.0015) MultiSource/Applications/siod/siod: 11.46% (2.2969 => 2.5601, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.45% (2.2022 => 2.4544, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 11.13% (5.7591 => 6.4003, std.dev.: 0.0119) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 11.02% (0.0953 => 0.1058, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 10.91% (0.4289 => 0.4757, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.85% (0.3927 => 0.4353, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.68% (0.1892 => 0.2094, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.65% (0.3473 => 0.3843, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.64% (14.3668 => 15.8960, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.63% (0.1044 => 0.1155, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 10.63% (0.4620 => 0.5111, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 10.61% (0.6456 => 0.7141, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.56% (0.3543 => 0.3917, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 10.53% (0.3543 => 0.3916, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.53% (0.3828 => 0.4231, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.49% (0.3497 => 0.3864, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.45% (0.3561 => 0.3933, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.44% (0.3516 => 0.3883, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/for-in: 10.42% (0.3694 => 0.4079, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.16% (0.3886 => 0.4281, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 10.11% (17.1811 => 18.9188, std.dev.: 0.0210) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.92% (0.3427 => 0.3767, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 9.85% (21.9371 => 24.0971, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.82% (0.4103 => 0.4506, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.70% (0.3865 => 0.4240, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 9.61% (0.3422 => 0.3751, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.59% (0.4203 => 0.4606, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 9.40% (1.5603 => 1.7070, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.25% (0.3826 => 0.4180, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.17% (0.4636 => 0.5061, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 9.12% (0.3684 => 0.4020, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.09% (0.2430 => 0.2651, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 8.97% (0.4048 => 0.4411, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 8.52% (0.6030 => 0.6544, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.49% (0.5925 => 0.6428, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.48% (3.8922 => 4.2223, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sieve: 8.33% (0.3603 => 0.3903, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.05% (0.4064 => 0.4391, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 7.77% (0.7326 => 0.7895, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.73% (0.3650 => 0.3932, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 7.49% (0.3098 => 0.3330, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 7.43% (0.3282 => 0.3526, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 7.38% (0.2831 => 0.3040, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 7.33% (0.2905 => 0.3118, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.28% (0.2872 => 0.3081, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.27% (0.3162 => 0.3392, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.23% (0.2891 => 0.3100, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 7.22% (0.3283 => 0.3520, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.21% (0.3232 => 0.3465, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.15% (0.2266 => 0.2428, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.05% (2.0665 => 2.2122, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/methcall: 7.02% (0.2877 => 0.3079, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.02% (7.9617 => 8.5207, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.97% (0.2756 => 0.2948, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 6.93% (0.2871 => 0.3070, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 6.75% (1.2842 => 1.3709, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/fibo: 6.72% (0.2725 => 0.2908, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 6.52% (0.3052 => 0.3251, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 6.50% (0.2802 => 0.2984, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.37% (0.2714 => 0.2887, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 6.21% (0.3379 => 0.3589, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.29% (0.3136 => 0.3302, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.01% (0.3131 => 0.3288, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.70% (10.4361 => 10.9270, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.29% (7.0540 => 7.3569, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.41% (0.3935 => 0.4069, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.93% (0.3817 => 0.3929, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: 31.47% (10.2830 => 13.5194, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1726, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 14.09% (2.6778 => 3.0551, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.37% (0.9957 => 1.1288, std.dev.: 0.0169) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.82% (1.1396 => 1.2515, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 6.70% (3.1578 => 3.3695, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.63% (2.8904 => 3.0820, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 3.80% (1.9405 => 2.0143, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.16% (0.3987 => 0.4113, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.95% (4.2280 => 4.3527, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 1.75% (0.8333 => 0.8479, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2078, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.49% (11.6436 => 11.8176, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.43% (2.6546 => 2.6926, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 1.19% (4.4649 => 4.5180, std.dev.: 0.0019) MultiSource/Applications/minisat/minisat: 1.05% (9.1159 => 9.2112, std.dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.94% (6.6874 => 0.1379, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -82.44% (0.8651 => 0.1519, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -52.52% (5.2763 => 2.5052, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: -45.25% (0.1622 => 0.0888, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -41.45% (5.3526 => 3.1341, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.45% (5.3855 => 3.2073, std.dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -8.90% (54.1659 => 49.3452, std.dev.: 0.0199) MultiSource/Benchmarks/Bullet/bullet: -8.56% (63.2438 => 57.8274, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.66% (1.7609 => 1.6260, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.78% (2.9384 => 2.7979, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.59% (1.1194 => 1.0680, std.dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -52.88% (8.0499 => 3.7931, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7645, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -30.18% (10.7105 => 7.4785, std.dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.63% (2.9695 => 2.4757, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.78% (1.6925 => 1.4254, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.70% (1.2258 => 1.0701, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -12.38% (1.2373 => 1.0841, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/mandel-2: -10.82% (1.5373 => 1.3710, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.46% (19.9488 => 18.2603, std.dev.: 0.0260) MultiSource/Benchmarks/FreeBench/mason/mason: -7.73% (0.2161 => 0.1994, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.07% (1.8329 => 1.7034, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -5.45% (6.6465 => 6.2841, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.94% (1.6805 => 1.5974, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-5: -4.56% (1.5835 => 1.5113, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.27% (8.1563 => 7.8084, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1625, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -3.33% (5.0483 => 4.8803, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4943, std.dev.: 0.0059) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.79% (0.4808 => 0.4674, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6818, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091) SingleSource/UnitTests/Vector/multiplies: -1.65% (2.5528 => 2.5108, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4223, std.dev.: 0.0071) MultiSource/Applications/sqlite3/sqlite3: -1.38% (4.6441 => 4.5801, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -5.25% (0.1485 => 0.1407, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.48% (0.2116 => 0.0667, std.dev.: 0.0016) Report Time: 2.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 15:29:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 17:29:41 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121026222941.7B0092A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5265?compare_to=5262&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5265, Order: 166813, Start Time: 2012-10-26 21:04:58, End Time: 2012-10-26 22:29:38 To: 5262, Order: 166796, Start Time: 2012-10-26 19:21:19, End Time: 2012-10-26 20:46:56 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 14 (85 on baseline) Performance Improvements: 4 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 957 (885 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.72% (0.6447 => 0.6687, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.10% (0.6255 => 0.6449, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.79% (0.9172 => 0.9336, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.64% (8.8242 => 8.9688, std.dev.: 0.0420) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.50% (0.8280 => 0.8404, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.49% (0.8339 => 0.8463, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.46% (0.8374 => 0.8496, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.44% (0.8599 => 0.8723, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.38% (0.9184 => 0.9311, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.31% (0.8984 => 0.9102, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.30% (0.8847 => 0.8962, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.21% (0.8508 => 0.8611, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fp-convert: 1.35% (15.6482 => 15.8598, std.dev.: 0.0302) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.28% (1.6046 => 1.6251, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.32% (0.8644 => 0.8530, std.dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: -1.07% (1.0100 => 0.9992, std.dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -11.95% (24.0340 => 21.1629, std.dev.: 0.9585) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.29% (2.4937 => 2.4366, std.dev.: 0.0209) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.21% (16.5834 => 16.5487, std.dev.: 0.2353) MultiSource/Applications/obsequi/Obsequi: -0.27% (1.0558 => 1.0530, std.dev.: 0.0111) MultiSource/Applications/sqlite3/sqlite3: -0.74% (0.6485 => 0.6437, std.dev.: 0.0134) MultiSource/Benchmarks/McCat/08-main/main: 0.79% (0.1901 => 0.1916, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.18% (0.1650 => 0.1719, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.06% (0.3262 => 0.3264, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.26% (0.2459 => 0.2490, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.74% (0.3374 => 0.3399, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.96% (0.2386 => 0.2363, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: 0.43% (0.5999 => 0.6025, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel: 0.41% (0.0491 => 0.0493, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.63% (0.3318 => 0.3297, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/strcat: -0.69% (0.2017 => 0.2003, std.dev.: 0.0006) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -8.20% (0.0256 => 0.0235, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.91% (0.0220 => 0.0218, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.70% (0.0426 => 0.0423, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.90% (0.0333 => 0.0330, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.64% (0.0314 => 0.0312, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.47% (0.0425 => 0.0423, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -0.98% (0.0204 => 0.0202, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -0.91% (0.0219 => 0.0217, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: - (0.0322 => 0.0322, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1483 => 0.1482, std.dev.: 0.0105) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -3.44% (1.1786 => 1.1380, std.dev.: 0.0768) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.13% (0.1520 => 0.1518, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.06% (0.4052 => 0.4095, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.50% (0.1402 => 0.1353, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.20% (0.0615 => 0.0647, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.08% (0.0277 => 0.0274, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.84% (0.0558 => 0.0585, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.16% (1.1457 => 1.1475, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.16% (0.0630 => 0.0629, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.30% (0.0261 => 0.0267, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.42% (0.8033 => 0.7999, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -1.33% (0.0075 => 0.0074, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.19% (2.1832 => 1.6551, std.dev.: 0.0083) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 34.02% (14.7684 => 19.7931, std.dev.: 0.2805) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.91% (0.0810 => 0.0947, std.dev.: 0.0021) SingleSource/UnitTests/SignlessTypes/rem: 10.72% (0.1035 => 0.1146, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.91% (0.2279 => 0.2482, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.49% (0.2180 => 0.2365, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.30% (0.6010 => 0.6449, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.81% (0.8321 => 0.8888, std.dev.: 0.0178) MultiSource/Applications/spiff/spiff: 6.48% (0.7950 => 0.8465, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.44% (0.3137 => 0.3339, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.36% (0.6287 => 0.6687, std.dev.: 0.0076) MultiSource/Applications/SIBsim4/SIBsim4: 6.12% (1.2568 => 1.3337, std.dev.: 0.0147) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.98% (0.1905 => 0.2019, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.68% (0.2519 => 0.2662, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.44% (0.2998 => 0.3161, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.36% (0.2240 => 0.2360, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.05% (0.4847 => 0.5092, std.dev.: 0.0073) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.94% (6.6074 => 6.9340, std.dev.: 0.0320) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.94% (0.7473 => 0.7842, std.dev.: 0.0104) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.89% (0.2741 => 0.2875, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.74% (1.1606 => 1.2156, std.dev.: 0.0213) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.72% (1.1170 => 1.1697, std.dev.: 0.0150) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.72% (13.1811 => 13.8029, std.dev.: 0.1261) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.71% (8.6476 => 8.9688, std.dev.: 0.0420) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 3.37% (0.8805 => 0.9102, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.34% (0.3717 => 0.3841, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.32% (0.4127 => 0.4264, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.30% (0.8050 => 0.8316, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.20% (0.3124 => 0.3224, std.dev.: 0.0016) MultiSource/Applications/treecc/treecc: 3.17% (1.9948 => 2.0581, std.dev.: 0.0223) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 3.16% (0.8204 => 0.8463, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.15% (0.8317 => 0.8579, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.15% (0.8457 => 0.8723, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.09% (0.9056 => 0.9336, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.09% (0.7966 => 0.8212, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.08% (0.9908 => 1.0213, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.05% (0.8007 => 0.8251, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 3.01% (0.9039 => 0.9311, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/05-eks/eks: 2.91% (0.4397 => 0.4525, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.88% (0.8656 => 0.8905, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.87% (0.8712 => 0.8962, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.84% (0.8261 => 0.8496, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.84% (0.7932 => 0.8157, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.79% (0.8086 => 0.8312, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.78% (0.8177 => 0.8404, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.78% (0.8286 => 0.8516, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.73% (0.8855 => 0.9097, std.dev.: 0.0088) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.68% (0.4783 => 0.4911, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.63% (4.1763 => 4.2860, std.dev.: 0.0393) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.57% (0.8066 => 0.8273, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.56% (0.8597 => 0.8817, std.dev.: 0.0027) MultiSource/Applications/lua/lua: 2.56% (3.8189 => 3.9166, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.44% (0.8316 => 0.8519, std.dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 2.38% (1.1271 => 1.1539, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.37% (1.6386 => 1.6775, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.35% (0.8716 => 0.8921, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.35% (0.4559 => 0.4666, std.dev.: 0.0037) MultiSource/Applications/JM/lencod/lencod: 2.31% (15.3280 => 15.6817, std.dev.: 0.0838) MultiSource/Applications/d/make_dparser: 2.30% (3.2366 => 3.3111, std.dev.: 0.0249) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.27% (0.8420 => 0.8611, std.dev.: 0.0037) MultiSource/Applications/JM/ldecod/ldecod: 2.25% (6.7320 => 6.8837, std.dev.: 0.0289) MultiSource/Benchmarks/Bullet/bullet: 2.25% (31.8598 => 32.5774, std.dev.: 0.1656) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.09% (0.9688 => 0.9890, std.dev.: 0.0077) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.08% (4.4880 => 4.5812, std.dev.: 0.0304) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.05% (4.4873 => 4.5792, std.dev.: 0.0312) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.05% (0.8359 => 0.8530, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.99% (0.8338 => 0.8504, std.dev.: 0.0058) MultiSource/Applications/SPASS/SPASS: 1.97% (14.2605 => 14.5409, std.dev.: 0.1025) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.93% (0.8331 => 0.8492, std.dev.: 0.0055) MultiSource/Applications/hexxagon/hexxagon: 1.86% (0.9810 => 0.9992, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.80% (0.8340 => 0.8490, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.65% (4.5702 => 4.6456, std.dev.: 0.0236) MultiSource/Benchmarks/PAQ8p/paq8p: 1.64% (2.3764 => 2.4154, std.dev.: 0.0124) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.60% (1.2526 => 1.2727, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.26% (1.2423 => 1.2580, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.09% (1.5315 => 1.5482, std.dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.84% (1.5795 => 2.5088, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.33% (1.1857 => 1.2845, std.dev.: 0.0094) MultiSource/Benchmarks/mafft/pairlocalalign: 5.92% (63.1822 => 66.9238, std.dev.: 0.0636) SingleSource/Benchmarks/Misc/ReedSolomon: 3.37% (8.5322 => 8.8194, std.dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/dry: 3.11% (0.5081 => 0.5239, std.dev.: 0.0039) MultiSource/Applications/siod/siod: 2.83% (3.6643 => 3.7680, std.dev.: 0.0178) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.80% (44.5605 => 45.8072, std.dev.: 0.2979) SingleSource/Benchmarks/Shootout-C++/hash: 2.35% (0.6205 => 0.6351, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.94% (1.5941 => 1.6251, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.24% (4.8362 => 4.8960, std.dev.: 0.0193) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -5.04% (29.8330 => 28.3306, std.dev.: 0.1810) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.12% (7.2130 => 7.0598, std.dev.: 0.0273) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.46% (3.3479 => 3.2991, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash2: -1.45% (3.4237 => 3.3742, std.dev.: 0.0007) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.62% (16.4461 => 16.5487, std.dev.: 0.2353) MultiSource/Applications/obsequi/Obsequi: 2.61% (1.0262 => 1.0530, std.dev.: 0.0111) MultiSource/Applications/sqlite3/sqlite3: 1.66% (0.6332 => 0.6437, std.dev.: 0.0134) MultiSource/Benchmarks/McCat/08-main/main: 4.64% (0.1831 => 0.1916, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.26% (0.1559 => 0.1719, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.51% (0.3123 => 0.3264, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.10% (0.2463 => 0.2490, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.64% (0.3344 => 0.3399, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.04% (0.2364 => 0.2363, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: 0.25% (0.6010 => 0.6025, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel: 14.92% (0.0429 => 0.0493, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.95% (0.3266 => 0.3297, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/strcat: 1.73% (0.1969 => 0.2003, std.dev.: 0.0006) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.91% (0.0224 => 0.0235, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.68% (0.0408 => 0.0423, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: 40.00% (0.0230 => 0.0322, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 3.06% (0.1438 => 0.1482, std.dev.: 0.0105) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.45% (1.1329 => 1.1380, std.dev.: 0.0768) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.83% (0.1462 => 0.1518, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.66% (0.4164 => 0.4095, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.17% (0.1369 => 0.1353, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.94% (0.0641 => 0.0647, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 40.51% (0.0195 => 0.0274, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.21% (0.0578 => 0.0585, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.33% (1.1437 => 1.1475, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.32% (0.0627 => 0.0629, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.33% (0.0180 => 0.0267, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.22% (0.8017 => 0.7999, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 19.35% (0.0062 => 0.0074, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 15:49:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 17:49:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121026224953.CA3C72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5266?compare_to=5263&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5266, Order: 166813, Start Time: 2012-10-26 21:24:45, End Time: 2012-10-26 22:49:49 To: 5263, Order: 166796, Start Time: 2012-10-26 19:36:50, End Time: 2012-10-26 21:01:54 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 0 (187 on baseline) Unchanged Tests: 1041 (849 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.89% (3.7891 => 3.8608, std.dev.: 0.0203) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 18.30% (15.2527 => 18.0442, std.dev.: 0.0127) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0001) MultiSource/Benchmarks/llubenchmark/llu: 3.13% (3.7435 => 3.8608, std.dev.: 0.0203) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.65% (2.0478 => 2.1020, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: 2.39% (7.4937 => 7.6727, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/hash2: 2.16% (3.1932 => 3.2623, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.50% (0.1431 => 0.1295, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: -9.27% (0.1230 => 0.1116, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.22% (0.3821 => 0.3507, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -7.48% (0.3357 => 0.3106, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.45% (0.2428 => 0.2247, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -7.31% (0.2160 => 0.2002, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -7.30% (0.3658 => 0.3391, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.27% (22.4056 => 20.7766, std.dev.: 0.0079) MultiSource/Benchmarks/McCat/08-main/main: -7.26% (0.2659 => 0.2466, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.26% (0.3142 => 0.2914, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -7.22% (2.4924 => 2.3124, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -7.21% (3.5339 => 3.2791, std.dev.: 0.0131) MultiSource/Applications/Burg/burg: -7.18% (1.2515 => 1.1616, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -7.16% (2.4021 => 2.2302, std.dev.: 0.0161) SingleSource/UnitTests/ObjC/exceptions-4: -7.14% (0.3880 => 0.3603, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -7.10% (0.3831 => 0.3559, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -7.08% (0.3812 => 0.3542, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -7.06% (0.4176 => 0.3881, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.05% (0.3884 => 0.3610, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -7.05% (1.6474 => 1.5313, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -7.04% (0.3848 => 0.3577, std.dev.: 0.0068) MultiSource/Benchmarks/MallocBench/gs/gs: -7.03% (4.3330 => 4.0286, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/for-in: -7.02% (0.4033 => 0.3750, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -7.01% (0.9852 => 0.9161, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -7.01% (0.3896 => 0.3623, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/property: -7.00% (0.4199 => 0.3905, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.99% (0.1716 => 0.1596, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.99% (0.6484 => 0.6031, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -6.98% (0.1761 => 0.1638, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -6.96% (0.4280 => 0.3982, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.96% (0.9542 => 0.8878, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.96% (0.7919 => 0.7368, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.95% (0.2548 => 0.2371, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.94% (0.1584 => 0.1474, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.94% (0.3891 => 0.3621, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.90% (1.0544 => 0.9816, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.85% (5.4682 => 5.0937, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.85% (0.1796 => 0.1673, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -6.79% (7.0961 => 6.6144, std.dev.: 0.0110) MultiSource/Benchmarks/mafft/pairlocalalign: -6.77% (9.2283 => 8.6038, std.dev.: 0.0127) MultiSource/Benchmarks/Olden/bh/bh: -6.73% (0.2985 => 0.2784, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.71% (1.4642 => 1.3659, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.71% (0.2355 => 0.2197, std.dev.: 0.0014) MultiSource/Applications/lua/lua: -6.71% (4.0594 => 3.7871, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -6.69% (0.1509 => 0.1408, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -6.67% (16.1920 => 15.1114, std.dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.66% (2.2587 => 2.1082, std.dev.: 0.0085) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.65% (1.2784 => 1.1934, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.58% (4.5069 => 4.2105, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.53% (4.8161 => 4.5014, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.51% (4.8802 => 4.5626, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.50% (1.3722 => 1.2830, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.50% (0.6293 => 0.5884, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.47% (0.6395 => 0.5981, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.46% (0.4151 => 0.3883, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.44% (1.6364 => 1.5310, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.43% (0.6297 => 0.5892, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.42% (0.5999 => 0.5614, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.41% (0.5805 => 0.5433, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.39% (0.6304 => 0.5901, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -6.39% (0.6230 => 0.5832, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -6.39% (0.1879 => 0.1759, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: -6.36% (0.2106 => 0.1972, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.36% (0.5581 => 0.5226, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.35% (0.5478 => 0.5130, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.34% (0.7339 => 0.6874, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.32% (0.5857 => 0.5487, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.31% (0.8521 => 0.7983, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.31% (0.5925 => 0.5551, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: -6.30% (0.2999 => 0.2810, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.30% (4.0323 => 3.7782, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: -6.30% (18.2933 => 17.1408, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -6.29% (0.4321 => 0.4049, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -6.29% (0.7982 => 0.7480, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: -6.28% (0.3581 => 0.3356, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -6.28% (0.5575 => 0.5225, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -6.28% (0.5591 => 0.5240, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.27% (0.5802 => 0.5438, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.26% (0.6052 => 0.5673, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.25% (0.6446 => 0.6043, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.24% (0.5863 => 0.5497, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.23% (0.6194 => 0.5808, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -6.23% (34.0927 => 31.9696, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.23% (0.6681 => 0.6265, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.22% (0.4916 => 0.4610, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.21% (0.5859 => 0.5495, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: -6.21% (1.1530 => 1.0814, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -6.19% (0.7524 => 0.7058, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -6.19% (0.5705 => 0.5352, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.18% (1.2221 => 1.1466, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -6.15% (0.3319 => 0.3115, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.15% (0.6736 => 0.6322, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -6.15% (0.2278 => 0.2138, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -6.14% (0.6676 => 0.6266, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -6.14% (0.4515 => 0.4238, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.13% (1.2210 => 1.1461, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: -6.13% (0.3491 => 0.3277, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -6.12% (0.5849 => 0.5491, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.11% (0.6189 => 0.5811, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -6.09% (0.5567 => 0.5228, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.08% (0.3931 => 0.3692, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: -6.08% (15.5079 => 14.5654, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/football/football: -6.07% (0.9179 => 0.8622, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -6.07% (0.6395 => 0.6007, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -6.05% (0.6660 => 0.6257, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.04% (0.6440 => 0.6051, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -6.03% (1.1450 => 1.0760, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -6.01% (0.6667 => 0.6266, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -6.01% (0.4861 => 0.4569, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.01% (0.6260 => 0.5884, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -6.00% (0.5569 => 0.5235, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.98% (0.5570 => 0.5237, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -5.97% (1.3148 => 1.2363, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.97% (0.6033 => 0.5673, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -5.96% (0.7447 => 0.7003, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.96% (0.5688 => 0.5349, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.96% (0.5941 => 0.5587, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.95% (0.2385 => 0.2243, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: -5.93% (0.6750 => 0.6350, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.88% (0.5168 => 0.4864, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.84% (0.3837 => 0.3613, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.83% (0.5456 => 0.5138, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.82% (0.7198 => 0.6779, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.81% (0.3252 => 0.3063, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.81% (0.9557 => 0.9002, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -5.80% (0.3446 => 0.3246, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.78% (0.4083 => 0.3847, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.77% (0.7021 => 0.6616, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -5.75% (0.2989 => 0.2817, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: -5.75% (0.3255 => 0.3068, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.72% (0.5329 => 0.5024, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.72% (0.3323 => 0.3133, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: -5.72% (0.3271 => 0.3084, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash: -5.70% (0.4524 => 0.4266, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/em3d/em3d: -5.69% (0.1862 => 0.1756, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.69% (0.3849 => 0.3630, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -5.68% (2.1401 => 2.0185, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: -5.67% (3.5154 => 3.3161, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.66% (2.1713 => 2.0483, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: -5.65% (0.3026 => 0.2855, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -5.64% (0.2871 => 0.2709, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: -5.63% (0.3621 => 0.3417, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -5.60% (0.3481 => 0.3286, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.60% (6.7716 => 6.3927, std.dev.: 0.0105) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.59% (0.4813 => 0.4544, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.56% (0.4427 => 0.4181, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.55% (0.2903 => 0.2742, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/sieve: -5.49% (0.3788 => 0.3580, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -5.49% (0.3406 => 0.3219, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -5.49% (0.3025 => 0.2859, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: -5.48% (0.4248 => 0.4015, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: -5.48% (0.3867 => 0.3655, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.46% (0.3057 => 0.2890, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary: -5.45% (0.3394 => 0.3209, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: -5.44% (0.2939 => 0.2779, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.41% (8.0126 => 7.5794, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hello: -5.41% (0.2849 => 0.2695, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: -5.41% (0.8418 => 0.7963, std.dev.: 0.0017) SingleSource/Regression/C++/ofstream_ctor: -5.39% (0.3059 => 0.2894, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -5.39% (0.3194 => 0.3022, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -5.37% (0.3205 => 0.3033, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.35% (0.2933 => 0.2776, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.28% (0.3483 => 0.3299, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.27% (0.3016 => 0.2857, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.25% (0.2001 => 0.1896, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -5.17% (0.6441 => 0.6108, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -5.13% (0.7779 => 0.7380, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: -5.09% (0.6347 => 0.6024, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.03% (1.2300 => 1.1681, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -5.03% (17.1032 => 16.2437, std.dev.: 0.0233) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.90% (0.2695 => 0.2563, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.83% (0.2277 => 0.2167, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.79% (0.9077 => 0.8642, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: -4.77% (5.0226 => 4.7832, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: -4.35% (1.5610 => 1.4931, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.96% (14.2083 => 13.6463, std.dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: -3.80% (1.3864 => 1.3337, std.dev.: 0.0030) SingleSource/UnitTests/Vector/constpool: -2.56% (20.7746 => 20.2420, std.dev.: 0.0150) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7527, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -8.68% (1.2842 => 1.1727, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.95% (2.2633 => 2.1739, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7060, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.91% (1.3096 => 1.2715, std.dev.: 0.0093) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4705, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0011) Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 16:09:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 18:09:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121026230951.7EBC92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5267?compare_to=5264&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5267, Order: 166813, Start Time: 2012-10-26 21:46:28, End Time: 2012-10-26 23:09:47 To: 5264, Order: 166798, Start Time: 2012-10-26 19:53:23, End Time: 2012-10-26 21:16:44 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (73 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (198 on baseline) Performance Improvements: 1 (49 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 75 (2 on baseline) Unchanged Tests: 966 (641 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.02% (3.2073 => 3.1745, std.dev.: 0.0013) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.62% (0.0485 => 0.0488) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.41% (0.0487 => 0.0489, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.44% (0.0455 => 0.0457, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.66% (0.0456 => 0.0459, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 0.45% (0.0445 => 0.0447) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.45% (0.0447 => 0.0449, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.46% (0.0439 => 0.0441) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.45% (0.0440 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.22% (0.0457 => 0.0458, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.44% (0.0458 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.44% (0.0451 => 0.0453, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.44% (0.0452 => 0.0454, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.45% (0.0440 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.45% (0.0443 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.22% (0.0449 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.45% (0.0449 => 0.0451, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.65% (0.0459 => 0.0462, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.43% (0.0461 => 0.0463, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.69% (0.0436 => 0.0439, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.23% (0.0438 => 0.0439, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.45% (0.0448 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.45% (0.0449 => 0.0451) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.46% (0.0439 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.45% (0.0440 => 0.0442, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.46% (0.0432 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.23% (0.0433 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.47% (0.0430 => 0.0432, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.46% (0.0432 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.43% (0.0467 => 0.0469, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.43% (0.0469 => 0.0471, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.23% (0.0430 => 0.0431, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.23% (0.0431 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.47% (0.0430 => 0.0432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.23% (0.0432 => 0.0433, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.46% (0.0439 => 0.0441) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.46% (0.0439 => 0.0441) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/BenchmarkGame/puzzle MultiSource/Applications/oggenc/oggenc: - (0.1407 => 0.1407, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.85% (0.0667 => 0.0648, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.39% (0.3826 => 0.3841, std.dev.: 0.0004) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/puzzle: -44.83% (0.6962 => 0.3841, std.dev.: 0.0004) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 210.15% (0.5229 => 1.6218, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 16.15% (14.9895 => 17.4097, std.dev.: 0.0146) MultiSource/Applications/kimwitu++/kc: 37.13% (14.1553 => 19.4113, std.dev.: 0.0083) MultiSource/Benchmarks/MallocBench/gs/gs: 13.80% (4.1105 => 4.6779, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 35.42% (1.1048 => 1.4961, std.dev.: 0.0083) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 316.92% (7.1582 => 29.8440, std.dev.: 0.0136) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.98% (3.4629 => 5.8169, std.dev.: 0.0189) SingleSource/Benchmarks/Misc-C++/stepanov_container: 67.79% (0.6222 => 1.0440, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 11834.58% (0.0720 => 8.5929, std.dev.: 0.0106) MultiSource/Applications/SIBsim4/SIBsim4: 4015100.00% (0.0001 => 4.0152, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 11133700.00% (0.0001 => 11.1338, std.dev.: 0.0304) MultiSource/Applications/kimwitu++/kc: 50400.00% (0.0001 => 0.0505, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63200.00% (0.0001 => 0.0633, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 793700.00% (0.0001 => 0.7938, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050300.00% (0.0001 => 10.0504, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5494700.00% (0.0001 => 5.4948, std.dev.: 0.0023) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 69.14% (0.0256 => 0.0433, std.dev.: 0.0014) SingleSource/Regression/C/sumarraymalloc: 56.38% (0.0243 => 0.0380) SingleSource/Regression/C/sumarray2d: 54.61% (0.0271 => 0.0419, std.dev.: 0.0001) SingleSource/Regression/C/sumarray: 44.59% (0.0231 => 0.0334) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.96% (1.5859 => 2.2514, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/distray/distray: 40.72% (0.1056 => 0.1486, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 35.26% (10.3673 => 14.0230, std.dev.: 0.0053) SingleSource/UnitTests/vla: 33.80% (0.0355 => 0.0475, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.88% (2.2024 => 2.8826, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 29.19% (0.1463 => 0.1890, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: 28.91% (0.1432 => 0.1846, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 25.20% (0.1655 => 0.2072, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 23.02% (0.0834 => 0.1026, std.dev.: 0.0001) MultiSource/Benchmarks/llubenchmark/llu: 22.08% (0.0462 => 0.0564, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 22.01% (0.2049 => 0.2500, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.97% (0.1566 => 0.1910, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/hash: 21.44% (0.0485 => 0.0589, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/rem: 20.98% (0.1144 => 0.1384, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 19.33% (0.5105 => 0.6092, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.29% (0.0871 => 0.1039, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 19.29% (0.4879 => 0.5820, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 18.91% (0.1555 => 0.1849, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 18.45% (0.3177 => 0.3763, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 18.13% (0.1175 => 0.1388, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 18.10% (0.0746 => 0.0881, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.08% (0.6675 => 0.7882, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 18.08% (0.0730 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.72% (1.3050 => 1.5362, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 17.50% (0.2554 => 0.3001, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 17.17% (3.3354 => 3.9082, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.02% (0.0793 => 0.0928, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.01% (0.1029 => 0.1204, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 16.93% (0.0626 => 0.0732, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 16.93% (0.1695 => 0.1982, std.dev.: 0.0035) MultiSource/Applications/ClamAV/clamscan: 16.89% (22.1758 => 25.9210, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.78% (0.2271 => 0.2652, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 16.71% (1.1840 => 1.3819, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: 16.70% (0.7115 => 0.8303, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.69% (0.5020 => 0.5858, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/mst/mst: 16.68% (0.1163 => 0.1357, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.64% (0.4615 => 0.5383, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.41% (0.8172 => 0.9513, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ks/ks: 16.36% (0.1510 => 0.1757, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.28% (0.1032 => 0.1200) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.19% (1.5415 => 1.7910, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 16.08% (0.1337 => 0.1552, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 16.03% (0.1940 => 0.2251, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.96% (0.3121 => 0.3619, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.80% (0.0886 => 0.1026, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 15.66% (0.3109 => 0.3596, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 15.64% (0.1151 => 0.1331, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.44% (0.0842 => 0.0972, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.27% (0.0838 => 0.0966, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.26% (0.0675 => 0.0778, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 15.10% (0.2603 => 0.2996, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 15.03% (0.1584 => 0.1822, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 15.02% (0.1125 => 0.1294, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 15.02% (0.0719 => 0.0827, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.87% (0.6450 => 0.7409, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 14.85% (0.1906 => 0.2189, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/18-imp/imp: 14.84% (0.3423 => 0.3931, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.81% (0.2700 => 0.3100, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.80% (0.9765 => 1.1210, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.77% (0.2065 => 0.2370, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/exptree: 14.74% (0.0814 => 0.0934, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.71% (0.2107 => 0.2417, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.68% (0.1117 => 0.1281, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.66% (0.0730 => 0.0837, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.64% (0.1236 => 0.1417, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 14.64% (0.7835 => 0.8982, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.58% (4.2646 => 4.8863, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.55% (0.0770 => 0.0882, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 14.51% (1.1642 => 1.3331, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.47% (0.2758 => 0.3157, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 14.34% (2.0273 => 2.3181, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.31% (0.1062 => 0.1214, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 14.28% (1.0722 => 1.2253, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 14.22% (9.4845 => 10.8328, std.dev.: 0.0051) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.17% (0.1143 => 0.1305, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.16% (1.1861 => 1.3541, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 14.09% (8.1363 => 9.2823, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.04% (0.5981 => 0.6821, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.98% (0.1695 => 0.1932, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.92% (0.5860 => 0.6676, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.91% (0.0798 => 0.0909, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 13.87% (0.8921 => 1.0158, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 13.77% (0.3180 => 0.3618, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 13.68% (0.7433 => 0.8450, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.64% (0.0770 => 0.0875, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 13.63% (0.4299 => 0.4885, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.53% (1.4186 => 1.6106, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.40% (0.0933 => 0.1058, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.34% (0.3307 => 0.3748, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.30% (0.8067 => 0.9140, std.dev.: 0.0025) MultiSource/Applications/lua/lua: 13.21% (3.8723 => 4.3838, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.11% (0.1625 => 0.1838, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.02% (0.0929 => 0.1050, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.86% (0.5569 => 0.6285, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 12.85% (0.1268 => 0.1431, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 12.81% (0.3387 => 0.3821, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.78% (0.1330 => 0.1500, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.77% (4.9449 => 5.5762, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.57% (5.0018 => 5.6305, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.29% (0.3441 => 0.3864, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 12.23% (0.3092 => 0.3470, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.68% (0.8101 => 0.9047, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 11.61% (0.4289 => 0.4787, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 11.34% (0.4620 => 0.5144, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 11.32% (0.6456 => 0.7187, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 11.26% (0.3927 => 0.4369, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.09% (0.3473 => 0.3858, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 11.08% (2.2969 => 2.5513, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 11.02% (0.0953 => 0.1058, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.95% (0.3497 => 0.3880, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.95% (0.3543 => 0.3931, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.95% (0.3543 => 0.3931, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.95% (0.3828 => 0.4247, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.92% (0.3516 => 0.3900, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.90% (0.3561 => 0.3949, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 10.87% (5.7591 => 6.3854, std.dev.: 0.0153) SingleSource/UnitTests/ObjC/for-in: 10.86% (0.3694 => 0.4095) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.82% (14.3668 => 15.9216, std.dev.: 0.0108) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.75% (2.2022 => 2.4389, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 10.64% (0.3422 => 0.3786, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.60% (0.3886 => 0.4298, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.52% (0.1892 => 0.2091, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 10.49% (1.5603 => 1.7239, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.44% (0.1044 => 0.1153, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.35% (0.3865 => 0.4265, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 10.15% (0.3684 => 0.4058, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.12% (0.3826 => 0.4213, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.09% (0.4203 => 0.4627, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 10.05% (17.1811 => 18.9081, std.dev.: 0.0206) SingleSource/Benchmarks/Shootout-C++/moments: 9.91% (0.4048 => 0.4449, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.71% (0.4636 => 0.5086, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 9.69% (21.9371 => 24.0624, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.66% (0.3427 => 0.3758, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.65% (0.4103 => 0.4499, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/sieve: 9.10% (0.3603 => 0.3931, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.09% (0.2430 => 0.2651, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.00% (0.5925 => 0.6458, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.99% (0.6030 => 0.6572, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.61% (0.4064 => 0.4414, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 8.48% (0.2831 => 0.3071, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.41% (0.3162 => 0.3428, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 8.29% (0.7326 => 0.7933, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.27% (0.3650 => 0.3952, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 8.26% (0.3232 => 0.3499, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 8.23% (0.3098 => 0.3353, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 8.22% (0.3283 => 0.3553, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.20% (3.8922 => 4.2115, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.09% (0.2891 => 0.3125, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.01% (2.0665 => 2.2321, std.dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 7.92% (0.2905 => 0.3135, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.90% (0.2872 => 0.3099, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 7.80% (0.2871 => 0.3095, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.80% (0.2756 => 0.2971, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.77% (0.2793 => 0.3010, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.72% (0.2877 => 0.3099, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.67% (0.3052 => 0.3286, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.63% (0.2725 => 0.2933, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 7.62% (0.3282 => 0.3532, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 7.48% (0.2714 => 0.2917, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 7.46% (0.3379 => 0.3631, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 7.39% (0.2802 => 0.3009, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 7.18% (1.2842 => 1.3764, std.dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.07% (7.9617 => 8.5246, std.dev.: 0.0137) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.88% (0.2266 => 0.2422, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.57% (0.3136 => 0.3342, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/objinst: 5.65% (0.3131 => 0.3308, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 4.97% (10.4361 => 10.9547, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.29% (0.3935 => 0.4104, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.77% (7.0540 => 7.3202, std.dev.: 0.0137) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.33% (0.3817 => 0.3944, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: 31.58% (10.2830 => 13.5306, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1725, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 14.08% (2.6778 => 3.0548, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.45% (0.9957 => 1.1296, std.dev.: 0.0175) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 9.81% (1.1396 => 1.2514, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.1578 => 3.3686, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.64% (2.8904 => 3.0822, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626) MultiSource/Benchmarks/Olden/bh/bh: 3.82% (1.9405 => 2.0147, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.19% (0.3987 => 0.4114) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.73% (4.2280 => 4.3435, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.86% (0.8333 => 0.8488, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2077, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.50% (11.6436 => 11.8180, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.35% (2.6546 => 2.6905, std.dev.: 0.0021) MultiSource/Applications/viterbi/viterbi: 1.24% (4.4649 => 4.5203, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.06% (9.1159 => 9.2123, std.dev.: 0.0053) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.93% (6.6874 => 0.1384, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -82.63% (0.8651 => 0.1503, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -52.40% (5.2763 => 2.5117, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: -45.44% (0.1622 => 0.0885, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -42.03% (5.3526 => 3.1029, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -41.05% (5.3855 => 3.1745, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -8.84% (54.1659 => 49.3783, std.dev.: 0.0385) MultiSource/Benchmarks/Bullet/bullet: -8.44% (63.2438 => 57.9056, std.dev.: 0.0174) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.15% (1.7609 => 1.6174, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.01% (2.9384 => 2.7911, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.80% (1.1194 => 1.0657, std.dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -52.86% (8.0499 => 3.7945, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) SingleSource/Benchmarks/Misc/mandel: -33.39% (1.1492 => 0.7655, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -30.21% (10.7105 => 7.4753, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4751, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -15.94% (1.6925 => 1.4228, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.73% (1.2258 => 1.0697, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -12.13% (1.2373 => 1.0872, std.dev.: 0.0314) SingleSource/Benchmarks/Misc/mandel-2: -11.00% (1.5373 => 1.3682, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.36% (19.9488 => 18.2814, std.dev.: 0.0625) MultiSource/Benchmarks/FreeBench/mason/mason: -7.73% (0.2161 => 0.1994, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.02% (1.8329 => 1.7043, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -5.45% (6.6465 => 6.2841, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.95% (1.6805 => 1.5973, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909) SingleSource/Benchmarks/Misc/flops-5: -4.55% (1.5835 => 1.5115, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.12% (8.1563 => 7.8199, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1627, std.dev.: 0.0015) MultiSource/Benchmarks/sim/sim: -3.33% (5.0483 => 4.8802, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.09% (32.5116 => 31.5054, std.dev.: 0.0041) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.56% (0.4808 => 0.4685, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6819, std.dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: -1.66% (2.5528 => 2.5105, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (9.5636 => 9.4197, std.dev.: 0.0088) MultiSource/Applications/sqlite3/sqlite3: -1.40% (4.6441 => 4.5791, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.06% (6.2999 => 6.2331, std.dev.: 0.0080) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -5.25% (0.1485 => 0.1407, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0004) Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 16:54:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 18:54:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121026235445.559622A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5268?compare_to=5261&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5268, Order: 166802, Start Time: 2012-10-26 20:38:31, End Time: 2012-10-26 23:54:41 To: 5261, Order: 166777, Start Time: 2012-10-26 16:34:28, End Time: 2012-10-26 19:50:13 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (167 on baseline) Performance Improvements: 15 (19 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1027 (722 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/reversefile: -2.38% (0.4244 => 0.4143, std.dev.: 0.0033) SingleSource/UnitTests/ObjC++/Hello: -2.18% (0.6865 => 0.6715, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -2.02% (0.6914 => 0.6774, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: -1.95% (0.8323 => 0.8161, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -1.53% (27.2430 => 26.8265, std.dev.: 0.0034) MultiSource/Applications/oggenc/oggenc: -1.39% (1.9866 => 1.9590, std.dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: -1.39% (12.8059 => 12.6281, std.dev.: 0.0179) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.23% (5.1140 => 5.0509, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.18% (1.5467 => 1.5284, std.dev.: 0.0047) MultiSource/Applications/d/make_dparser: -1.17% (1.2490 => 1.2344, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: -1.16% (6.1840 => 6.1123, std.dev.: 0.0148) MultiSource/Applications/hbd/hbd: -1.08% (1.1277 => 1.1155, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.03% (2.2631 => 2.2397, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.03% (2.3811 => 2.3566, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: -1.01% (2.4507 => 2.4260, std.dev.: 0.0010) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 38.24% (0.0625 => 0.0864, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 29.92% (0.1063 => 0.1381, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 24.68% (0.1106 => 0.1379, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 24.55% (0.2969 => 0.3698, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.94% (0.4253 => 0.5271, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 22.96% (1.5932 => 1.9590, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 22.90% (0.4139 => 0.5087, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 22.19% (0.4994 => 0.6102, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 21.81% (0.5900 => 0.7187, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 21.71% (0.0714 => 0.0869, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 21.62% (0.5000 => 0.6081, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.58% (0.0584 => 0.0710, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 21.39% (0.0547 => 0.0664, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 21.26% (0.0475 => 0.0576, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 20.74% (0.0897 => 0.1083, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 20.20% (0.0599 => 0.0720, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 20.12% (0.1620 => 0.1946, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 20.08% (0.1021 => 0.1226, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 19.60% (0.1107 => 0.1324, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.04% (0.0541 => 0.0644, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 18.99% (0.0948 => 0.1128, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.86% (0.3903 => 0.4639, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 18.84% (0.0584 => 0.0694, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 18.64% (0.0633 => 0.0751, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.54% (0.0642 => 0.0761, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 18.50% (0.1103 => 0.1307, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.40% (0.1549 => 0.1834, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 18.27% (0.1604 => 0.1897, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 18.21% (0.0604 => 0.0714, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 18.16% (0.1619 => 0.1913, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 18.15% (0.0821 => 0.0970, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.15% (0.1003 => 0.1185, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 17.92% (0.1462 => 0.1724, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.88% (0.0822 => 0.0969, std.dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 17.82% (0.0808 => 0.0952, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 17.11% (0.0947 => 0.1109, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.02% (0.3890 => 0.4552, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 16.94% (0.1505 => 0.1760, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 16.52% (0.2736 => 0.3188, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 16.50% (0.1218 => 0.1419, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.48% (0.2014 => 0.2346, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/mst/mst: 16.33% (0.0698 => 0.0812, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 16.21% (1.3152 => 1.5284, std.dev.: 0.0047) MultiSource/Applications/spiff/spiff: 16.16% (0.4029 => 0.4680, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 15.99% (0.1088 => 0.1262, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 15.98% (1.8794 => 2.1798, std.dev.: 0.0026) MultiSource/Applications/Burg/burg: 15.76% (0.5546 => 0.6420, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 15.74% (0.2866 => 0.3317, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.45% (0.1968 => 0.2272, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.43% (0.1160 => 0.1339, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 15.33% (0.4658 => 0.5372, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 15.32% (3.5627 => 4.1086, std.dev.: 0.0042) SingleSource/UnitTests/ObjC++/Hello: 15.26% (0.5826 => 0.6715, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.19% (0.3271 => 0.3768, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.06% (0.2875 => 0.3308, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 15.04% (0.9697 => 1.1155, std.dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference-object: 15.03% (0.5889 => 0.6774, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.99% (1.6211 => 1.8641, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 14.97% (0.4361 => 0.5014, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 14.71% (0.1421 => 0.1630, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 14.55% (0.9909 => 1.1351, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/fibo: 14.53% (0.2725 => 0.3121, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 14.50% (1.0781 => 1.2344, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.46% (0.5026 => 0.5753, std.dev.: 0.0048) SingleSource/Regression/C++/ofstream_ctor: 14.45% (0.3004 => 0.3438, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: 14.41% (0.1284 => 0.1469, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 14.35% (0.2738 => 0.3131, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 14.33% (0.2714 => 0.3103, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 14.29% (4.4195 => 5.0509, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/strcat: 14.22% (0.2750 => 0.3141, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 14.21% (0.2780 => 0.3175, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 14.20% (4.2109 => 4.8088, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/methcall: 14.18% (0.2813 => 0.3212, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 14.14% (0.2729 => 0.3115, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 14.13% (0.2823 => 0.3222, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.10% (0.3930 => 0.4484, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.08% (2.7292 => 3.1134, std.dev.: 0.0024) MultiSource/Benchmarks/Bullet/bullet: 14.06% (23.5202 => 26.8265, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/city/city: 13.99% (2.0673 => 2.3566, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13.99% (0.3195 => 0.3642, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 13.98% (0.2811 => 0.3204, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 13.93% (0.2792 => 0.3181, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 13.91% (0.2803 => 0.3193, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 13.91% (0.2911 => 0.3316, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: 13.87% (0.3317 => 0.3777, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 13.82% (0.3096 => 0.3524, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 13.81% (0.7171 => 0.8161, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 13.72% (1.9694 => 2.2397, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.67% (0.1090 => 0.1239, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.60% (1.9966 => 2.2681, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary3: 13.53% (0.3267 => 0.3709, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 13.49% (0.2075 => 0.2355, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 13.35% (0.3258 => 0.3693, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.30% (0.3362 => 0.3809, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 13.20% (0.3060 => 0.3464, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: 13.20% (0.3348 => 0.3790, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.06% (0.3845 => 0.4347, std.dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 13.02% (0.2566 => 0.2900, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 12.89% (0.3282 => 0.3705, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 12.86% (1.4269 => 1.6104, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.84% (0.3124 => 0.3525, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 12.81% (0.3678 => 0.4149, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 12.57% (0.4146 => 0.4667, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 12.52% (0.3625 => 0.4079, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 12.49% (0.4251 => 0.4782, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 12.48% (0.3726 => 0.4191, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists1: 12.45% (0.3477 => 0.3910, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: 12.28% (0.7875 => 0.8842, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.28% (0.3690 => 0.4143, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.18% (0.3981 => 0.4466, std.dev.: 0.0038) MultiSource/Applications/JM/ldecod/ldecod: 12.04% (2.1653 => 2.4260, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 11.98% (4.6177 => 5.1707, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.86% (0.1383 => 0.1547, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.72% (0.2040 => 0.2279, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 11.65% (0.5012 => 0.5596, std.dev.: 0.0056) MultiSource/Benchmarks/mafft/pairlocalalign: 11.35% (2.1013 => 2.3397, std.dev.: 0.0079) SingleSource/UnitTests/ObjC/exceptions-2: 11.26% (0.3446 => 0.3834, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 11.26% (0.3465 => 0.3855, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 11.21% (0.3496 => 0.3888, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.18% (0.3488 => 0.3878, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 11.13% (0.3442 => 0.3825, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.13% (0.3460 => 0.3845, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 11.10% (0.3469 => 0.3854, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 11.00% (0.2691 => 0.2987, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/property: 10.96% (0.3650 => 0.4050, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 10.79% (0.3643 => 0.4036, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.74% (0.3724 => 0.4124, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.54% (0.6435 => 0.7113, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.31% (0.1028 => 0.1134, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 10.30% (5.5417 => 6.1123, std.dev.: 0.0148) MultiSource/Applications/lambda-0_1_3/lambda: 10.18% (0.3498 => 0.3854, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 9.88% (0.4847 => 0.5326, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.76% (0.2737 => 0.3004, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 9.72% (0.6634 => 0.7279, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.72% (0.2068 => 0.2269, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.37% (0.3084 => 0.3373, std.dev.: 0.0025) MultiSource/Applications/minisat/minisat: 9.32% (0.3336 => 0.3647, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.75% (0.2103 => 0.2287, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 8.66% (0.2391 => 0.2598, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.55% (4.6926 => 5.0940, std.dev.: 0.0055) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.81% (11.6398 => 12.5490, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.59% (0.5361 => 0.5768, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.15% (0.5584 => 0.5983, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.99% (0.7426 => 0.7945, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 5.63% (11.9555 => 12.6281, std.dev.: 0.0179) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6535, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6096, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 5.89% (0.2122 => 0.2247, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.47% (0.3693 => 0.3895, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/objinst: 5.01% (12.0509 => 12.6552, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1676, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-2: 4.08% (1.8057 => 1.8794, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/dry: 2.74% (14.0481 => 14.4327, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1942, std.dev.: 0.0052) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.78% (3.1722 => 3.2287, std.dev.: 0.0014) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3095, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2885, std.dev.: 0.0018) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.25% (1.0142 => 1.0269, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.15% (1.0927 => 1.1053, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 1.08% (50.0626 => 50.6020, std.dev.: 0.0619) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.45% (2.4764 => 2.4406, std.dev.: 0.0080) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.52% (25.4195 => 16.3902, std.dev.: 0.0077) MultiSource/Applications/hexxagon/hexxagon: -7.70% (28.1477 => 25.9793, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -7.70% (0.2402 => 0.2217, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7732, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.13% (11.2080 => 10.8570, std.dev.: 0.0401) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7726, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -2.89% (3.6262 => 3.5215, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.72% (0.6293 => 0.6122, std.dev.: 0.0046) SingleSource/Benchmarks/Dhrystone/fldry: -2.40% (17.2379 => 16.8241, std.dev.: 0.0237) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.19% (41.7953 => 40.8801, std.dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5734, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4958, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.33% (5.7935 => 5.7162, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.10% (105.3826 => 104.2272, std.dev.: 0.0577) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0461, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.04% (3.3991 => 3.3638, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 17:12:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 19:12:08 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121027001208.1E3342A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5269?compare_to=5265&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5269, Order: 166823, Start Time: 2012-10-26 22:46:16, End Time: 2012-10-27 00:12:04 To: 5265, Order: 166813, Start Time: 2012-10-26 21:04:58, End Time: 2012-10-26 22:29:38 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 11 (88 on baseline) Performance Improvements: 1 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 963 (882 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.67% (0.8888 => 0.9036, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.66% (0.7842 => 0.7972, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.49% (1.1990 => 1.2169, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.48% (0.8492 => 0.8618, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.48% (0.9890 => 1.0036, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.35% (4.5792 => 4.6410, std.dev.: 0.0153) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.22% (1.2727 => 1.2882, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.53% (0.3191 => 0.3495, std.dev.: 0.0035) MultiSource/Benchmarks/Bullet/bullet: 2.15% (7.1398 => 7.2931, std.dev.: 0.0342) MultiSource/Benchmarks/llubenchmark/llu: 1.74% (1.9935 => 2.0281, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/methcall: 1.17% (8.9389 => 9.0434, std.dev.: 0.0126) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -2.34% (0.8465 => 0.8267, std.dev.: 0.0075) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.28% (16.5487 => 16.5947, std.dev.: 0.3348) MultiSource/Applications/obsequi/Obsequi: 0.31% (1.0530 => 1.0563, std.dev.: 0.0604) MultiSource/Applications/sqlite3/sqlite3: -0.40% (0.6437 => 0.6411, std.dev.: 0.0093) MultiSource/Benchmarks/McCat/08-main/main: 0.89% (0.1916 => 0.1933, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.11% (0.1719 => 0.1738, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.70% (0.3264 => 0.3287, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.48% (0.2490 => 0.2478, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.09% (0.3399 => 0.3362, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.89% (0.2363 => 0.2384, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/bigfib: -0.83% (0.6025 => 0.5975, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/mandel: -9.33% (0.0493 => 0.0447, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.45% (0.3297 => 0.3312, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: -0.50% (0.2003 => 0.1993, std.dev.: 0.0029) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.68% (0.0235 => 0.0246, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0218 => 0.0218, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.24% (0.0423 => 0.0424, std.dev.: 0.0062) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.21% (0.0330 => 0.0326, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.32% (0.0312 => 0.0313, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.71% (0.0423 => 0.0426, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0202 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -0.46% (0.0217 => 0.0216, std.dev.: 0.0021) SingleSource/UnitTests/byval-alignment: -1.24% (0.0322 => 0.0318, std.dev.: 0.0027) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.88% (0.1482 => 0.1469, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.40% (1.1380 => 1.1426, std.dev.: 0.0158) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 0.20% (0.1518 => 0.1521, std.dev.: 0.0079) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.10% (0.4095 => 0.4099, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.70% (0.1353 => 0.1330, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.15% (0.0647 => 0.0648, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.09% (0.0274 => 0.0277) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.67% (0.0585 => 0.0546, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.50% (1.1475 => 1.1418, std.dev.: 0.0142) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 3.85% (0.0026 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.38% (0.0629 => 0.0614, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.37% (0.0267 => 0.0268, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.58% (0.7999 => 0.8045, std.dev.: 0.0142) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -6.76% (0.0074 => 0.0069, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.98% (2.1832 => 1.6597, std.dev.: 0.0051) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 34.20% (14.7684 => 19.8185, std.dev.: 0.2621) SingleSource/UnitTests/SignlessTypes/rem: 12.08% (0.1035 => 0.1160, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 11.69% (0.1112 => 0.1242, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.04% (0.1425 => 0.1568, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.13% (0.2279 => 0.2487, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.59% (0.8321 => 0.9036, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.27% (0.6010 => 0.6507, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.98% (0.2180 => 0.2354, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.68% (0.7473 => 0.7972, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.38% (0.4847 => 0.5156, std.dev.: 0.0044) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.09% (0.3137 => 0.3328, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.54% (0.6287 => 0.6635, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.52% (0.8148 => 0.8598, std.dev.: 0.0135) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.26% (6.6074 => 6.9550, std.dev.: 0.0441) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.17% (1.1170 => 1.1748, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.73% (13.1811 => 13.8044, std.dev.: 0.2352) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.71% (0.2378 => 0.2490, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.67% (0.2998 => 0.3138, std.dev.: 0.0032) MultiSource/Applications/SIBsim4/SIBsim4: 4.58% (1.2568 => 1.3143, std.dev.: 0.0215) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.26% (1.6386 => 1.7084, std.dev.: 0.0154) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.20% (0.2741 => 0.2856, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.14% (1.1685 => 1.2169, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.02% (0.8050 => 0.8374, std.dev.: 0.0108) MultiSource/Applications/spiff/spiff: 3.99% (0.7950 => 0.8267, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.91% (0.8007 => 0.8320, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.85% (0.9435 => 0.9798, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 3.77% (0.8204 => 0.8513, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.74% (0.4783 => 0.4962, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 3.73% (0.9039 => 0.9376, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.71% (4.1763 => 4.3311, std.dev.: 0.0392) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.69% (0.8457 => 0.8769, std.dev.: 0.0088) MultiSource/Applications/hbd/hbd: 3.62% (1.4269 => 1.4785, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 3.59% (0.9688 => 1.0036, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.58% (0.3717 => 0.3850, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.52% (0.8697 => 0.9003, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.49% (0.4127 => 0.4271, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.46% (0.9908 => 1.0251, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.45% (0.8177 => 0.8459, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 3.44% (0.8331 => 0.8618, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.44% (0.8716 => 0.9016, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.44% (0.9074 => 0.9386, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.43% (4.4873 => 4.6410, std.dev.: 0.0153) MultiSource/Benchmarks/Bullet/bullet: 3.36% (31.8598 => 32.9307, std.dev.: 0.3488) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.36% (0.8611 => 0.8900, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.32% (0.8261 => 0.8535, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/football/football: 3.26% (0.8768 => 0.9054, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.24% (1.4479 => 1.4948, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 3.17% (0.8805 => 0.9084, std.dev.: 0.0038) MultiSource/Applications/Burg/burg: 3.16% (1.2222 => 1.2608, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.11% (0.8316 => 0.8575, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.07% (0.5961 => 0.6144, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.98% (0.9069 => 0.9339, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.94% (0.8855 => 0.9115, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.93% (0.8518 => 0.8768, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.85% (0.7966 => 0.8193, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.85% (0.8317 => 0.8554, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.85% (0.8048 => 0.8277, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.84% (1.2526 => 1.2882, std.dev.: 0.0025) MultiSource/Benchmarks/PAQ8p/paq8p: 2.78% (2.3764 => 2.4424, std.dev.: 0.0242) MultiSource/Benchmarks/mafft/pairlocalalign: 2.74% (8.6247 => 8.8613, std.dev.: 0.0835) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.74% (0.4559 => 0.4684, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.69% (0.8286 => 0.8509, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.68% (0.8927 => 0.9166, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.67% (0.8086 => 0.8302, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.63% (0.8712 => 0.8941, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.61% (0.8656 => 0.8882, std.dev.: 0.0042) MultiSource/Benchmarks/nbench/nbench: 2.56% (1.1271 => 1.1559, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.41% (0.5191 => 0.5316, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.40% (0.8420 => 0.8622, std.dev.: 0.0051) MultiSource/Applications/treecc/treecc: 2.32% (1.9948 => 2.0410, std.dev.: 0.0116) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.31% (4.5702 => 4.6757, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.25% (0.9056 => 0.9260, std.dev.: 0.0054) MultiSource/Applications/d/make_dparser: 2.02% (3.2366 => 3.3020, std.dev.: 0.0216) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.89% (1.2602 => 1.2840, std.dev.: 0.0059) MultiSource/Applications/lua/lua: 1.84% (3.8189 => 3.8893, std.dev.: 0.0255) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.67% (0.6586 => 0.6696, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.14% (1.5795 => 2.4978, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.70% (0.3186 => 0.3495, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.48% (1.1857 => 1.2863, std.dev.: 0.0074) MultiSource/Benchmarks/mafft/pairlocalalign: 6.05% (63.1822 => 67.0021, std.dev.: 0.0370) SingleSource/Benchmarks/Misc/ReedSolomon: 3.36% (8.5322 => 8.8186, std.dev.: 0.0277) MultiSource/Applications/siod/siod: 2.77% (3.6643 => 3.7658, std.dev.: 0.0169) MultiSource/Benchmarks/Bullet/bullet: 2.46% (7.1181 => 7.2931, std.dev.: 0.0342) MultiSource/Benchmarks/FreeBench/mason/mason: 1.96% (0.5415 => 0.5521, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash: 1.77% (0.6205 => 0.6315, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/bh/bh: 1.74% (2.3560 => 2.3971, std.dev.: 0.0129) MultiSource/Benchmarks/llubenchmark/llu: 1.57% (1.9967 => 2.0281, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.42% (4.8362 => 4.9051, std.dev.: 0.0185) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -5.03% (29.8330 => 28.3330, std.dev.: 0.2263) SingleSource/Benchmarks/Dhrystone/fldry: -2.17% (0.6910 => 0.6760, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: -1.31% (3.4237 => 3.3788, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.26% (3.3479 => 3.3058, std.dev.: 0.0053) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.90% (16.4461 => 16.5947, std.dev.: 0.3348) MultiSource/Applications/obsequi/Obsequi: 2.93% (1.0262 => 1.0563, std.dev.: 0.0604) MultiSource/Applications/sqlite3/sqlite3: 1.25% (0.6332 => 0.6411, std.dev.: 0.0093) MultiSource/Benchmarks/McCat/08-main/main: 5.57% (0.1831 => 0.1933, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 11.48% (0.1559 => 0.1738, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.25% (0.3123 => 0.3287, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.61% (0.2463 => 0.2478, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.54% (0.3344 => 0.3362, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.85% (0.2364 => 0.2384, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/bigfib: -0.58% (0.6010 => 0.5975, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/mandel: 4.20% (0.0429 => 0.0447, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.41% (0.3266 => 0.3312, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 1.22% (0.1969 => 0.1993, std.dev.: 0.0029) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 9.82% (0.0224 => 0.0246, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.92% (0.0408 => 0.0424, std.dev.: 0.0062) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 28.35% (0.0254 => 0.0326, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.94% (0.0384 => 0.0426, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 20.00% (0.0180 => 0.0216, std.dev.: 0.0021) SingleSource/UnitTests/byval-alignment: 38.26% (0.0230 => 0.0318, std.dev.: 0.0027) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.16% (0.1438 => 0.1469, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.86% (1.1329 => 1.1426, std.dev.: 0.0158) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 4.04% (0.1462 => 0.1521, std.dev.: 0.0079) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.56% (0.4164 => 0.4099, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.85% (0.1369 => 0.1330, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.09% (0.0641 => 0.0648, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.54% (0.0578 => 0.0546, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.17% (1.1437 => 1.1418, std.dev.: 0.0142) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.07% (0.0627 => 0.0614, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.89% (0.0180 => 0.0268, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.35% (0.8017 => 0.8045, std.dev.: 0.0142) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 11.29% (0.0062 => 0.0069, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 17:37:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 19:37:48 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121027003748.5EFF22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5270?compare_to=5266&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5270, Order: 166825, Start Time: 2012-10-26 23:12:42, End Time: 2012-10-27 00:37:43 To: 5266, Order: 166813, Start Time: 2012-10-26 21:24:45, End Time: 2012-10-26 22:49:49 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (179 on baseline) Unchanged Tests: 1041 (858 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/siod/siod: 1.19% (2.2302 => 2.2568, std.dev.: 0.0012) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 18.68% (15.2527 => 18.1019, std.dev.: 0.0113) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.81% (2.0478 => 2.1053, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: 2.38% (7.4937 => 7.6720, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hash2: 2.16% (3.1932 => 3.2621, std.dev.: 0.0058) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.22% (0.1431 => 0.1299, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.14% (0.3821 => 0.3510, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.26% (0.3142 => 0.2914, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.01% (22.4056 => 20.8343, std.dev.: 0.0205) SingleSource/Benchmarks/Misc/oourafft: -6.90% (0.2160 => 0.2011, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -6.88% (0.3357 => 0.3126) SingleSource/UnitTests/ObjC/exceptions-2: -6.87% (0.3831 => 0.3568, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -6.86% (0.3880 => 0.3614, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.84% (0.2428 => 0.2262, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -6.82% (0.3812 => 0.3552, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.78% (0.3848 => 0.3587, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.78% (3.5339 => 3.2944, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: -6.77% (0.4033 => 0.3760, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -6.75% (0.3896 => 0.3633, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.75% (0.9542 => 0.8898, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.72% (0.3884 => 0.3623, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.68% (0.3891 => 0.3631, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.66% (0.4176 => 0.3898, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -6.50% (0.4199 => 0.3926, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.47% (0.9852 => 0.9215, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.46% (1.6474 => 1.5409, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.46% (0.4151 => 0.3883, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -6.44% (2.4924 => 2.3320, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.42% (5.4682 => 5.1171, std.dev.: 0.0694) MultiSource/Applications/Burg/burg: -6.41% (1.2515 => 1.1713, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.40% (0.6484 => 0.6069, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: -6.39% (0.2659 => 0.2489, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -6.36% (0.4280 => 0.4008, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -6.35% (7.0961 => 6.6452, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: -6.31% (9.2283 => 8.6458, std.dev.: 0.0102) SingleSource/Benchmarks/McGill/chomp: -6.30% (0.1761 => 0.1650, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -6.30% (16.1920 => 15.1714, std.dev.: 0.0178) MultiSource/Benchmarks/Olden/bh/bh: -6.30% (0.2985 => 0.2797, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.29% (0.1716 => 0.1608, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.29% (0.3658 => 0.3428, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.25% (0.7198 => 0.6748, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.24% (1.0544 => 0.9886, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -6.22% (4.3330 => 4.0633, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.20% (0.2355 => 0.2209, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.20% (4.8161 => 4.5177, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.17% (0.4083 => 0.3831, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.16% (1.2784 => 1.1996, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.16% (2.2587 => 2.1195, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.13% (0.3849 => 0.3613, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.12% (1.3722 => 1.2882, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.11% (4.8802 => 4.5818, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.11% (0.7919 => 0.7435, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.09% (0.3252 => 0.3054, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -6.08% (1.3148 => 1.2348, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.07% (0.3837 => 0.3604, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -6.07% (34.0927 => 32.0231, std.dev.: 0.0213) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.07% (0.1796 => 0.1687, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -6.07% (0.4861 => 0.4566, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -6.06% (0.2871 => 0.2697, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -6.05% (2.4021 => 2.2568, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.03% (0.2903 => 0.2728, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.02% (2.1713 => 2.0405, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/except: -6.01% (0.3026 => 0.2844, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.01% (1.6364 => 1.5380, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.99% (1.4642 => 1.3765, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.99% (0.3057 => 0.2874, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.98% (1.2221 => 1.1490, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.98% (1.2210 => 1.1480, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.98% (0.3931 => 0.3696, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.97% (0.2548 => 0.2396, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.96% (4.5069 => 4.2382, std.dev.: 0.0080) MultiSource/Applications/lua/lua: -5.96% (4.0594 => 3.8174, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.96% (0.3491 => 0.3283, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -5.94% (0.6750 => 0.6349, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.93% (0.5999 => 0.5643, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: -5.93% (0.3255 => 0.3062, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.92% (0.4321 => 0.4065, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: -5.92% (0.4524 => 0.4256, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.91% (0.6293 => 0.5921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -5.91% (0.1879 => 0.1768, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: -5.89% (0.3194 => 0.3006, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.87% (0.5925 => 0.5577, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -5.87% (0.3205 => 0.3017, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.86% (0.5857 => 0.5514, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.84% (0.3323 => 0.3129, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: -5.84% (0.7779 => 0.7325, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: -5.83% (0.3481 => 0.3278, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: -5.82% (0.2989 => 0.2815, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.81% (4.0323 => 3.7981, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.81% (0.6681 => 0.6293, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.81% (0.5805 => 0.5468, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: -5.80% (0.3446 => 0.3246, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.80% (0.6052 => 0.5701, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.80% (0.8521 => 0.8027, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.80% (0.5591 => 0.5267, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -5.79% (0.2849 => 0.2684, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.78% (0.4427 => 0.4171, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.77% (0.9557 => 0.9006, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.76% (0.5863 => 0.5525, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.76% (0.2933 => 0.2764, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.75% (0.5478 => 0.5163, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.74% (0.6304 => 0.5942, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.74% (0.3016 => 0.2843, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: -5.73% (1.1530 => 1.0869, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.72% (0.4916 => 0.4635, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: -5.71% (0.7447 => 0.7022, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.69% (0.5802 => 0.5472, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -5.69% (0.3394 => 0.3201, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.69% (0.6297 => 0.5939, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.68% (0.6230 => 0.5876, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.68% (0.7339 => 0.6922, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -5.67% (0.4248 => 0.4007, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -5.67% (0.3581 => 0.3378, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.67% (0.6194 => 0.5843, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: -5.66% (0.3867 => 0.3648, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -5.66% (0.3621 => 0.3416, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.65% (0.5859 => 0.5528, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/sieve: -5.65% (0.3788 => 0.3574, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.64% (0.5581 => 0.5266, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.63% (0.6736 => 0.6357, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.62% (0.5849 => 0.5520, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.62% (0.6260 => 0.5908, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: -5.61% (0.2939 => 0.2774, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.59% (0.5705 => 0.5386, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.58% (0.6395 => 0.6038, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.58% (0.5575 => 0.5264, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.58% (0.2278 => 0.2151, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.57% (0.6189 => 0.5844, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.57% (0.6446 => 0.6087, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.57% (0.2999 => 0.2832, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.55% (0.5941 => 0.5611, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -5.54% (0.4515 => 0.4265, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: -5.53% (0.9179 => 0.8671, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -5.53% (0.6441 => 0.6085, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.53% (0.6660 => 0.6292, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.52% (0.6033 => 0.5700, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.51% (0.3319 => 0.3136, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.51% (0.5570 => 0.5263, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -5.51% (1.1450 => 1.0819, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.50% (0.6395 => 0.6043, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.50% (0.7524 => 0.7110, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.50% (0.6676 => 0.6309, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.49% (0.2385 => 0.2254, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: -5.48% (0.6347 => 0.5999, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.48% (0.6440 => 0.6087, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.46% (0.5569 => 0.5265, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.44% (0.5456 => 0.5159, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: -5.44% (18.2933 => 17.2978, std.dev.: 0.0098) MultiSource/Applications/SPASS/SPASS: -5.42% (15.5079 => 14.6681, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.40% (0.6667 => 0.6307, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -5.39% (0.3059 => 0.2894, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.38% (0.5168 => 0.4890, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.37% (0.7021 => 0.6644, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -5.31% (0.3406 => 0.3225, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.30% (0.4813 => 0.4558, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.28% (0.5567 => 0.5273, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -5.22% (0.7982 => 0.7565, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.22% (0.2106 => 0.1996, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -5.21% (3.5154 => 3.3323, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.20% (0.5688 => 0.5392, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.14% (6.7716 => 6.4234, std.dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.14% (0.5329 => 0.5055, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -5.12% (2.1401 => 2.0305, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.06% (8.0126 => 7.6068, std.dev.: 0.0102) MultiSource/Applications/spiff/spiff: -4.97% (0.8418 => 0.8000, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: -4.86% (0.3271 => 0.3112, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -4.78% (5.0226 => 4.7823, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.68% (0.3483 => 0.3320, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: -4.67% (17.1032 => 16.3048, std.dev.: 0.0181) MultiSource/Benchmarks/Ptrdist/bc/bc: -4.53% (1.2300 => 1.1743, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.27% (0.2695 => 0.2580, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.03% (0.9077 => 0.8711, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: -3.98% (1.5610 => 1.4989, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.86% (14.2083 => 13.6594, std.dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: -3.29% (1.3864 => 1.3408, std.dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -3.10% (20.7746 => 20.1300, std.dev.: 0.0457) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.50% (7.5137 => 5.7478, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1728, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.82% (2.2633 => 2.1768, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.92% (1.3096 => 1.2714, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.63% (6.5735 => 6.4664, std.dev.: 0.0075) Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 18:02:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 20:02:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121027010234.66FDE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5271?compare_to=5267&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5271, Order: 166827, Start Time: 2012-10-26 23:39:21, End Time: 2012-10-27 01:02:29 To: 5267, Order: 166813, Start Time: 2012-10-26 21:46:28, End Time: 2012-10-26 23:09:47 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (73 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 3 (199 on baseline) Performance Improvements: 0 (49 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 75 (2 on baseline) Unchanged Tests: 964 (640 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 20.55% (0.4131 => 0.4980, std.dev.: 0.0089) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.65% (1.1296 => 1.1482, std.dev.: 0.0057) MultiSource/Benchmarks/Bullet/bullet: 1.48% (7.4753 => 7.5856, std.dev.: 0.0053) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 0.41% (0.0488 => 0.0490, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 0.61% (0.0489 => 0.0492, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 0.44% (0.0457 => 0.0459) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 0.44% (0.0459 => 0.0461, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0447 => 0.0447, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 0.22% (0.0449 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 0.23% (0.0441 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 0.45% (0.0442 => 0.0444) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 0.44% (0.0458 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 0.22% (0.0460 => 0.0461, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 0.44% (0.0453 => 0.0455, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 0.44% (0.0454 => 0.0456, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 0.45% (0.0442 => 0.0444) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 0.22% (0.0445 => 0.0446, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 0.44% (0.0450 => 0.0452) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 0.44% (0.0451 => 0.0453, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 0.22% (0.0462 => 0.0463, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 0.43% (0.0463 => 0.0465, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 0.23% (0.0439 => 0.0440, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 0.46% (0.0439 => 0.0441, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 0.44% (0.0450 => 0.0452) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 0.44% (0.0451 => 0.0453, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 0.45% (0.0441 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 0.45% (0.0442 => 0.0444) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 0.23% (0.0434 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 0.46% (0.0434 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 0.46% (0.0432 => 0.0434, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 0.46% (0.0434 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 0.43% (0.0469 => 0.0471, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 0.21% (0.0471 => 0.0472, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 0.46% (0.0431 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 0.46% (0.0432 => 0.0434, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 0.46% (0.0432 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 0.46% (0.0433 => 0.0435, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 0.23% (0.0441 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 0.45% (0.0441 => 0.0443) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/BenchmarkGame/puzzle MultiSource/Applications/oggenc/oggenc: - (0.1407 => 0.1407) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0648 => 0.0649, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.36% (0.3841 => 0.3827, std.dev.: 0.0010) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.03% (0.6962 => 0.3827, std.dev.: 0.0010) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 209.79% (0.5229 => 1.6199, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 15.98% (14.9895 => 17.3848, std.dev.: 0.0079) MultiSource/Applications/kimwitu++/kc: 37.03% (14.1553 => 19.3976, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/gs/gs: 13.48% (4.1105 => 4.6644, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 35.30% (1.1048 => 1.4948, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 316.68% (7.1582 => 29.8267, std.dev.: 0.0152) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.97% (3.4629 => 5.8168, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 67.74% (0.6222 => 1.0437, std.dev.: 0.0013) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 11825.28% (0.0720 => 8.5862, std.dev.: 0.0133) MultiSource/Applications/SIBsim4/SIBsim4: 4015200.00% (0.0001 => 4.0153, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 11144400.00% (0.0001 => 11.1445, std.dev.: 0.0646) MultiSource/Applications/kimwitu++/kc: 50700.00% (0.0001 => 0.0508, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 794200.00% (0.0001 => 0.7943, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049700.00% (0.0001 => 10.0498, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5491900.00% (0.0001 => 5.4920, std.dev.: 0.0007) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 69.14% (0.0256 => 0.0433, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 55.97% (0.0243 => 0.0379) SingleSource/Regression/C/sumarray2d: 53.87% (0.0271 => 0.0417, std.dev.: 0.0000) SingleSource/Regression/C/sumarray: 44.16% (0.0231 => 0.0333) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.65% (1.5859 => 2.2465, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/distray/distray: 40.91% (0.1056 => 0.1488, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 33.94% (10.3673 => 13.8856, std.dev.: 0.0097) SingleSource/UnitTests/vla: 33.52% (0.0355 => 0.0474, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.80% (2.2024 => 2.8808, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 29.12% (0.1432 => 0.1849, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: 29.05% (0.1463 => 0.1888, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 24.95% (0.1655 => 0.2068, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 23.98% (0.0834 => 0.1034, std.dev.: 0.0001) MultiSource/Benchmarks/llubenchmark/llu: 21.86% (0.0462 => 0.0563, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: 21.86% (0.0485 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.78% (0.1566 => 0.1907, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 21.28% (0.2049 => 0.2485, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/rem: 20.72% (0.1144 => 0.1381, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.40% (0.0871 => 0.1040, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 19.08% (0.5105 => 0.6079, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 19.06% (0.4879 => 0.5809, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 18.84% (0.1555 => 0.1848, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 18.73% (0.3177 => 0.3772, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 18.08% (0.0730 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 17.96% (0.1175 => 0.1386, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.80% (0.6675 => 0.7863, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: 17.56% (0.0746 => 0.0877, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.54% (1.3050 => 1.5339, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 17.46% (0.2554 => 0.3000, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 17.28% (3.3354 => 3.9119, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.12% (0.0730 => 0.0855, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.90% (0.0793 => 0.0927, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.87% (0.5020 => 0.5867, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.81% (0.1029 => 0.1202, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: 16.77% (0.0626 => 0.0731, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 16.70% (0.1695 => 0.1978, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.68% (0.8172 => 0.9535, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 16.60% (0.1337 => 0.1559, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.60% (0.2271 => 0.2648, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 16.60% (0.7115 => 0.8296, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 16.60% (22.1758 => 25.8567, std.dev.: 0.0117) MultiSource/Benchmarks/Olden/mst/mst: 16.51% (0.1163 => 0.1355, std.dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 16.49% (1.1840 => 1.3793, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 16.23% (0.1510 => 0.1755, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.02% (1.5415 => 1.7884, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.99% (0.1032 => 0.1197, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.86% (0.4615 => 0.5347, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.76% (0.3121 => 0.3613, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.69% (0.0886 => 0.1025, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.57% (0.1940 => 0.2242, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 15.50% (0.3109 => 0.3591, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.44% (0.0842 => 0.0972, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.26% (0.0675 => 0.0778, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 15.20% (0.1151 => 0.1326, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.20% (0.1625 => 0.1872, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.04% (0.0838 => 0.0964) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.98% (0.2603 => 0.2993, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.96% (0.1584 => 0.1821, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.68% (0.1117 => 0.1281, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.67% (0.2700 => 0.3096, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 14.64% (0.1906 => 0.2185, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 14.64% (0.3423 => 0.3924, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.64% (0.6450 => 0.7394, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 14.62% (0.0814 => 0.0933, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.62% (0.2107 => 0.2415, std.dev.: 0.0038) MultiSource/Applications/Burg/burg: 14.59% (1.1642 => 1.3341, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.58% (0.9765 => 1.1189, std.dev.: 0.0016) MultiSource/Applications/spiff/spiff: 14.54% (0.7835 => 0.8974, std.dev.: 0.0018) MultiSource/Benchmarks/NPB-serial/is/is: 14.46% (0.0719 => 0.0823, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.43% (0.2758 => 0.3156, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.40% (0.1236 => 0.1414, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 14.34% (2.0273 => 2.3180, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.31% (0.1125 => 0.1286, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.29% (0.2065 => 0.2360, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.29% (0.0770 => 0.0880, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.28% (4.2646 => 4.8734, std.dev.: 0.0030) MultiSource/Applications/lemon/lemon: 14.24% (1.0722 => 1.2249, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 14.09% (8.1363 => 9.2823, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.08% (0.5981 => 0.6823, std.dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 14.01% (9.4845 => 10.8131, std.dev.: 0.0128) MultiSource/Benchmarks/Ptrdist/bc/bc: 13.97% (1.1861 => 1.3518, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.91% (0.0798 => 0.0909, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.89% (0.5860 => 0.6674, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.84% (0.1062 => 0.1209, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 13.74% (0.7433 => 0.8454, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 13.70% (0.8921 => 1.0143, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/09-vor/vor: 13.65% (0.3180 => 0.3614, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.51% (0.1695 => 0.1924, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.51% (0.0770 => 0.0874, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.45% (1.4186 => 1.6094, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.43% (0.3307 => 0.3751, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 13.17% (0.4299 => 0.4865, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.08% (0.0933 => 0.1055, std.dev.: 0.0024) MultiSource/Applications/lua/lua: 13.04% (3.8723 => 4.3771, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.95% (0.8067 => 0.9112, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.93% (0.1330 => 0.1502, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.93% (0.5569 => 0.6289, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.92% (0.0929 => 0.1049, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.86% (0.1143 => 0.1290, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 12.81% (0.3387 => 0.3821, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 12.78% (0.1268 => 0.1430, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.52% (4.9449 => 5.5639, std.dev.: 0.0091) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.49% (5.0018 => 5.6263, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.41% (0.3441 => 0.3868, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 12.23% (0.3092 => 0.3470, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.63% (0.8101 => 0.9043, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash: 11.52% (0.4289 => 0.4783, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 11.49% (0.4620 => 0.5151, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 11.43% (0.6456 => 0.7194, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.35% (0.3543 => 0.3945, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.17% (2.2022 => 2.4481, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 11.02% (0.0953 => 0.1058, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 11.01% (5.7591 => 6.3933, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 10.91% (2.2969 => 2.5474, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.90% (0.3826 => 0.4243, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.89% (0.1892 => 0.2098, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 10.86% (0.3473 => 0.3850, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.84% (14.3668 => 15.9242, std.dev.: 0.0132) SingleSource/UnitTests/ObjC/parameter-passing: 10.82% (0.3927 => 0.4352, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 10.81% (0.3543 => 0.3926, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.81% (0.3497 => 0.3875, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.76% (0.3865 => 0.4281, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.72% (0.4636 => 0.5133, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: 10.70% (0.3422 => 0.3788, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 10.69% (0.3516 => 0.3892, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.68% (0.3828 => 0.4237, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.67% (0.3561 => 0.3941, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.61% (0.3694 => 0.4086, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.37% (0.4203 => 0.4639, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 10.27% (0.3886 => 0.4285, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 10.26% (0.3684 => 0.4062, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 10.25% (0.4048 => 0.4463, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.15% (0.1044 => 0.1150, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 10.13% (1.5603 => 1.7184, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 10.08% (17.1811 => 18.9130, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.82% (0.4103 => 0.4506, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.75% (0.3427 => 0.3761, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 9.72% (21.9371 => 24.0688, std.dev.: 0.0332) SingleSource/Benchmarks/Shootout-C++/sieve: 9.55% (0.3603 => 0.3947, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.98% (0.4064 => 0.4429, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.93% (0.2430 => 0.2647, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 8.88% (0.3098 => 0.3373, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.86% (0.5925 => 0.6450, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 8.80% (0.2831 => 0.3080, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.79% (0.3650 => 0.3971, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.75% (0.2891 => 0.3144, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.72% (0.6030 => 0.6556, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 8.59% (0.3283 => 0.3565, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 8.54% (0.3232 => 0.3508, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 8.47% (0.2905 => 0.3151, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 8.43% (0.2871 => 0.3113, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.42% (0.2756 => 0.2988, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 8.41% (0.7326 => 0.7942, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.40% (2.0665 => 2.2400, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.36% (0.2872 => 0.3112, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.35% (0.3162 => 0.3426, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.34% (0.2793 => 0.3026, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 8.26% (0.3052 => 0.3304, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 8.22% (0.2725 => 0.2949, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 8.20% (0.2877 => 0.3113, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 8.03% (0.2714 => 0.2932, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.02% (3.8922 => 4.2045, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/random: 7.92% (0.2802 => 0.3024, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 7.58% (0.3379 => 0.3635, std.dev.: 0.0088) MultiSource/Applications/hexxagon/hexxagon: 7.38% (1.2842 => 1.3790, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.37% (0.3136 => 0.3367, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 7.28% (0.3282 => 0.3521, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.88% (7.9617 => 8.5096, std.dev.: 0.0127) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.66% (0.2266 => 0.2417, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 6.04% (0.3131 => 0.3320, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 4.87% (10.4361 => 10.9448, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.58% (7.0540 => 7.3774, std.dev.: 0.0185) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.52% (0.3935 => 0.4113, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.12% (0.3817 => 0.3936, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: 31.45% (10.2830 => 13.5175, std.dev.: 0.0160) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1726) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 15.32% (0.9957 => 1.1482, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 14.09% (2.6778 => 3.0552, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 9.83% (1.1396 => 1.2516, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3692, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.64% (2.8904 => 3.0823, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 5.10% (0.5413 => 0.5689, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 3.80% (1.9405 => 2.0143, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.19% (0.3987 => 0.4114) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.89% (4.2280 => 4.3500, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.80% (0.8333 => 0.8483, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2075, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.49% (11.6436 => 11.8176, std.dev.: 0.0207) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.24% (2.6546 => 2.6876, std.dev.: 0.0029) MultiSource/Applications/viterbi/viterbi: 1.20% (4.4649 => 4.5185, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 1.04% (9.1159 => 9.2108, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.03% (6.5088 => 6.5761, std.dev.: 0.0062) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.94% (6.6874 => 0.1379, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -82.59% (0.8651 => 0.1506, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -52.46% (5.2763 => 2.5086, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: -45.68% (0.1622 => 0.0881, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -41.81% (5.3526 => 3.1145, std.dev.: 0.0071) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -40.89% (5.3855 => 3.1835, std.dev.: 0.0090) SingleSource/UnitTests/Vector/constpool: -8.91% (54.1659 => 49.3381, std.dev.: 0.0251) MultiSource/Benchmarks/Bullet/bullet: -8.77% (63.2438 => 57.6996, std.dev.: 0.0184) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.51% (1.7609 => 1.6110, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.98% (2.9384 => 2.7922, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.65% (1.1194 => 1.0674, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -52.88% (8.0499 => 3.7933, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.42% (1.1492 => 0.7651, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -29.18% (10.7105 => 7.5856, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -16.65% (2.9695 => 2.4751, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.02% (1.6925 => 1.4214, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -12.73% (1.2258 => 1.0697, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -12.37% (1.2373 => 1.0843, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/mandel-2: -10.88% (1.5373 => 1.3700, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.39% (19.9488 => 18.2758, std.dev.: 0.0288) MultiSource/Benchmarks/FreeBench/mason/mason: -7.77% (0.2161 => 0.1993, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.09% (1.8329 => 1.7030, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8483, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -5.45% (6.6465 => 6.2841, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.94% (1.6805 => 1.5975, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.72% (1.5835 => 1.5088, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.37% (8.1563 => 7.8001, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.63% (3.2827 => 3.1635, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -3.33% (5.0483 => 4.8802, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.12% (32.5116 => 31.4972, std.dev.: 0.0064) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.70% (0.4808 => 0.4678, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6789, std.dev.: 0.0015) SingleSource/UnitTests/Vector/multiplies: -1.66% (2.5528 => 2.5103, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -1.48% (9.5636 => 9.4216, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: -1.40% (4.6441 => 4.5789, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8572, std.dev.: 0.0069) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -5.25% (0.1485 => 0.1407) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0009) Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 18:56:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 20:56:22 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121027015622.67D332A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5272?compare_to=5269&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5272, Order: 166840, Start Time: 2012-10-27 00:29:46, End Time: 2012-10-27 01:56:19 To: 5269, Order: 166823, Start Time: 2012-10-26 22:46:16, End Time: 2012-10-27 00:12:04 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 12 (59 on baseline) Performance Improvements: 1 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 962 (911 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 2.43% (6.8115 => 6.9767, std.dev.: 0.0367) MultiSource/Applications/minisat/minisat: 2.41% (0.6935 => 0.7102, std.dev.: 0.0045) MultiSource/Applications/SPASS/SPASS: 2.05% (14.5414 => 14.8391, std.dev.: 0.1112) MultiSource/Applications/d/make_dparser: 2.01% (3.3020 => 3.3685, std.dev.: 0.0147) MultiSource/Applications/ClamAV/clamscan: 1.55% (19.8185 => 20.1258, std.dev.: 0.0663) MultiSource/Applications/JM/lencod/lencod: 1.53% (15.5895 => 15.8281, std.dev.: 0.0650) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.42% (57.8937 => 60.4518, std.dev.: 0.4686) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.92% (40.2385 => 41.8154, std.dev.: 0.4650) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.68% (4.3194 => 4.4351, std.dev.: 0.0367) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.25% (45.3783 => 46.4008, std.dev.: 0.1199) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.45% (11.5539 => 11.7220, std.dev.: 0.0643) SingleSource/Benchmarks/Misc/fp-convert: 1.31% (15.6759 => 15.8809, std.dev.: 0.0444) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.18% (0.8900 => 0.8795, std.dev.: 0.0009) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.48% (16.5947 => 16.6744, std.dev.: 0.1333) MultiSource/Applications/obsequi/Obsequi: 0.91% (1.0563 => 1.0659, std.dev.: 0.0286) MultiSource/Applications/sqlite3/sqlite3: 0.22% (0.6411 => 0.6425, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/08-main/main: 0.72% (0.1933 => 0.1947, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.83% (0.1738 => 0.1654, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.76% (0.3287 => 0.3262, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.81% (0.2478 => 0.2498, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.33% (0.3362 => 0.3351, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.50% (0.2384 => 0.2372, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/bigfib: 0.12% (0.5975 => 0.5982, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/mandel: 4.03% (0.0447 => 0.0465, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.18% (0.3312 => 0.3318, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/strcat: -0.20% (0.1993 => 0.1989, std.dev.: 0.0011) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.63% (0.0246 => 0.0242, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.83% (0.0218 => 0.0222, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.42% (0.0424 => 0.0430, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 3.37% (0.0326 => 0.0337, std.dev.: 0.0047) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.32% (0.0313 => 0.0314, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 2.82% (0.0426 => 0.0438, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/casts: 2.97% (0.0202 => 0.0208, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/test1: 1.39% (0.0216 => 0.0219, std.dev.: 0.0026) SingleSource/UnitTests/byval-alignment: 6.92% (0.0318 => 0.0340, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.36% (0.1469 => 0.1489, std.dev.: 0.0049) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.42% (1.1426 => 1.1588, std.dev.: 0.0118) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -1.45% (0.1521 => 0.1499, std.dev.: 0.0075) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.90% (0.4099 => 0.4021, std.dev.: 0.0154) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.63% (0.1330 => 0.1365, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.08% (0.0648 => 0.0655, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0277 => 0.0277, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.95% (0.0546 => 0.0573, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.18% (1.1418 => 1.1439, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.77% (0.0614 => 0.0631, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.87% (0.0268 => 0.0263, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.60% (0.8045 => 0.7916, std.dev.: 0.0127) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -21.74% (0.0069 => 0.0054, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.86% (2.1832 => 1.6622, std.dev.: 0.0153) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 36.28% (14.7684 => 20.1258, std.dev.: 0.0663) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.67% (0.0810 => 0.0945, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.89% (0.0830 => 0.0937, std.dev.: 0.0006) SingleSource/UnitTests/SignlessTypes/rem: 12.17% (0.1035 => 0.1161, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 11.87% (0.1112 => 0.1244, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/04-bisect/bisect: 8.97% (0.1137 => 0.1239, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.12% (0.2180 => 0.2357, std.dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 7.57% (1.2568 => 1.3519, std.dev.: 0.0183) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.34% (0.4847 => 0.5203, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.27% (0.6010 => 0.6387, std.dev.: 0.0111) MultiSource/Applications/spiff/spiff: 5.90% (0.7950 => 0.8419, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.87% (0.8148 => 0.8626, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.70% (0.7473 => 0.7899, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.03% (0.2741 => 0.2879, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.73% (13.1811 => 13.8045, std.dev.: 0.1788) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.53% (6.6074 => 6.9064, std.dev.: 0.0814) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.36% (1.1685 => 1.2194, std.dev.: 0.0108) MultiSource/Applications/lemon/lemon: 4.29% (1.0945 => 1.1414, std.dev.: 0.0154) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.18% (1.1170 => 1.1637, std.dev.: 0.0055) MultiSource/Applications/d/make_dparser: 4.08% (3.2366 => 3.3685, std.dev.: 0.0147) MultiSource/Applications/SPASS/SPASS: 4.06% (14.2605 => 14.8391, std.dev.: 0.1112) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.98% (0.6287 => 0.6537, std.dev.: 0.0052) MultiSource/Applications/minisat/minisat: 3.92% (0.6834 => 0.7102, std.dev.: 0.0045) MultiSource/Applications/hbd/hbd: 3.64% (1.4269 => 1.4789, std.dev.: 0.0161) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.64% (0.9435 => 0.9778, std.dev.: 0.0129) MultiSource/Applications/JM/ldecod/ldecod: 3.63% (6.7320 => 6.9767, std.dev.: 0.0367) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.60% (0.3003 => 0.3111, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.46% (0.8359 => 0.8648, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.33% (0.8086 => 0.8355, std.dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: 3.26% (15.3280 => 15.8281, std.dev.: 0.0650) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.22% (0.8261 => 0.8527, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.15% (0.4127 => 0.4257, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.15% (0.3717 => 0.3834, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.98% (0.9908 => 1.0203, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.97% (0.5961 => 0.6138, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.73% (1.4479 => 1.4874, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.70% (0.8331 => 0.8556, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.67% (8.6476 => 8.8789, std.dev.: 0.0649) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.55% (0.8457 => 0.8673, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.52% (0.6227 => 0.6384, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/football/football: 2.46% (0.8768 => 0.8984, std.dev.: 0.0074) MultiSource/Benchmarks/nbench/nbench: 2.38% (1.1271 => 1.1539, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.14% (0.8611 => 0.8795, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.72% (1.5315 => 1.5578, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.71% (0.8340 => 0.8483, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.47% (0.8995 => 0.9127, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.44% (0.9056 => 0.9186, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 56.57% (1.5795 => 2.4731, std.dev.: 0.0187) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.82% (0.3186 => 0.3499, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.33% (1.1857 => 1.2845, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 5.93% (63.1822 => 66.9305, std.dev.: 0.2341) MultiSource/Benchmarks/FreeBench/distray/distray: 4.23% (0.2390 => 0.2491, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 4.13% (44.5605 => 46.4008, std.dev.: 0.1199) SingleSource/Benchmarks/Misc/ReedSolomon: 3.41% (8.5322 => 8.8233, std.dev.: 0.0292) MultiSource/Applications/siod/siod: 2.75% (3.6643 => 3.7651, std.dev.: 0.0120) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.38% (4.8362 => 4.9515, std.dev.: 0.0335) MultiSource/Benchmarks/Olden/bh/bh: 1.51% (2.3560 => 2.3915, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/richards_benchmark: 1.27% (1.3037 => 1.3203, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.06% (1.5941 => 1.6110, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -4.85% (29.8330 => 28.3873, std.dev.: 0.1675) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.36% (1.2822 => 1.2648, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.35% (1.0388 => 1.0248, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.19% (3.3479 => 3.3080, std.dev.: 0.0008) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 1.39% (16.4461 => 16.6744, std.dev.: 0.1333) MultiSource/Applications/obsequi/Obsequi: 3.87% (1.0262 => 1.0659, std.dev.: 0.0286) MultiSource/Applications/sqlite3/sqlite3: 1.47% (0.6332 => 0.6425, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/08-main/main: 6.34% (0.1831 => 0.1947, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 6.09% (0.1559 => 0.1654, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.45% (0.3123 => 0.3262, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.42% (0.2463 => 0.2498, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.21% (0.3344 => 0.3351, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.34% (0.2364 => 0.2372, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/bigfib: -0.47% (0.6010 => 0.5982, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/mandel: 8.39% (0.0429 => 0.0465, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.59% (0.3266 => 0.3318, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/strcat: 1.02% (0.1969 => 0.1989, std.dev.: 0.0011) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.04% (0.0224 => 0.0242, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 80.49% (0.0123 => 0.0222, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.39% (0.0408 => 0.0430, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 32.68% (0.0254 => 0.0337, std.dev.: 0.0047) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 14.06% (0.0384 => 0.0438, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/casts: 9.47% (0.0190 => 0.0208, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0026) SingleSource/UnitTests/byval-alignment: 47.83% (0.0230 => 0.0340, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 3.55% (0.1438 => 0.1489, std.dev.: 0.0049) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.29% (1.1329 => 1.1588, std.dev.: 0.0118) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 2.53% (0.1462 => 0.1499, std.dev.: 0.0075) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.43% (0.4164 => 0.4021, std.dev.: 0.0154) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.29% (0.1369 => 0.1365, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.18% (0.0641 => 0.0655, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.87% (0.0578 => 0.0573, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.02% (1.1437 => 1.1439, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.64% (0.0627 => 0.0631, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 46.11% (0.0180 => 0.0263, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.26% (0.8017 => 0.7916, std.dev.: 0.0127) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -12.90% (0.0062 => 0.0054, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 19:25:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 21:25:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121027022553.0EF0F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5273?compare_to=5270&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5273, Order: 166844, Start Time: 2012-10-27 01:00:39, End Time: 2012-10-27 02:25:48 To: 5270, Order: 166825, Start Time: 2012-10-26 23:12:42, End Time: 2012-10-27 00:37:43 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 3 (5 on baseline) Performance Improvements: 0 (182 on baseline) Unchanged Tests: 1039 (855 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 2.83% (0.3675 => 0.3779, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.78% (0.6748 => 0.6868, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.14% (2.0405 => 2.0638, std.dev.: 0.0041) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 18.51% (15.2527 => 18.0766, std.dev.: 0.0156) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.00% (2.0478 => 2.1093, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/salsa20: 2.42% (7.4937 => 7.6749, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash2: 2.21% (3.1932 => 3.2638, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.01% (0.1431 => 0.1302, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -7.39% (0.3831 => 0.3548, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -7.35% (0.3880 => 0.3595, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.34% (0.3884 => 0.3599, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -7.32% (0.3812 => 0.3533, std.dev.: 0.0085) SingleSource/UnitTests/ObjC/exceptions-3: -7.28% (0.3848 => 0.3568, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.17% (0.3891 => 0.3612, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -7.16% (0.4176 => 0.3877) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.12% (0.3821 => 0.3549, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -7.11% (0.3896 => 0.3619, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -7.04% (0.4033 => 0.3749, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -7.00% (0.4199 => 0.3905, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.96% (0.2428 => 0.2259, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.94% (0.3357 => 0.3124, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -6.92% (2.4924 => 2.3200, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.91% (22.4056 => 20.8580, std.dev.: 0.0145) SingleSource/UnitTests/ObjC/parameter-passing: -6.87% (0.4280 => 0.3986, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.81% (0.3142 => 0.2928, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.75% (0.3658 => 0.3411, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/oourafft: -6.71% (0.2160 => 0.2015, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.70% (3.5339 => 3.2972, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.66% (0.6484 => 0.6052, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.58% (0.9542 => 0.8914, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -6.55% (1.2515 => 1.1695, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.55% (0.9852 => 0.9207, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: -6.53% (4.3330 => 4.0501, std.dev.: 0.0082) MultiSource/Benchmarks/McCat/08-main/main: -6.51% (0.2659 => 0.2486, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.47% (0.1716 => 0.1605, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.45% (0.7919 => 0.7408, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.45% (1.6474 => 1.5411, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.45% (1.0544 => 0.9864, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: -6.38% (7.0961 => 6.6434, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.33% (1.2784 => 1.1975, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.26% (4.8161 => 4.5146, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: -6.25% (9.2283 => 8.6513, std.dev.: 0.0110) SingleSource/Benchmarks/McGill/chomp: -6.25% (0.1761 => 0.1651, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.24% (0.2548 => 0.2389, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -6.22% (16.1920 => 15.1854, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.19% (4.8802 => 4.5779, std.dev.: 0.0088) MultiSource/Applications/siod/siod: -6.15% (2.4021 => 2.2544, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.14% (1.3722 => 1.2880, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.13% (1.4642 => 1.3744, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.13% (4.5069 => 4.2308, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.12% (0.1796 => 0.1686, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.12% (5.4682 => 5.1336, std.dev.: 0.0047) MultiSource/Applications/lua/lua: -6.09% (4.0594 => 3.8121, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.07% (0.6293 => 0.5911, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -6.06% (0.2985 => 0.2804, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.06% (0.8521 => 0.8005, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.04% (2.2587 => 2.1222, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.00% (1.6364 => 1.5382, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.97% (0.2999 => 0.2820, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.97% (0.5999 => 0.5641, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: -5.96% (0.1879 => 0.1767, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.94% (0.5857 => 0.5509, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (4.0323 => 3.7948, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.87% (0.5925 => 0.5577, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.85% (1.2221 => 1.1506, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.85% (1.2210 => 1.1496, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: -5.84% (0.3581 => 0.3372, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.81% (0.5591 => 0.5266, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.81% (0.6304 => 0.5938, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.81% (0.4151 => 0.3910, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.81% (0.5805 => 0.5468, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.79% (0.2278 => 0.2146, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.78% (0.6297 => 0.5933, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.78% (0.4916 => 0.4632, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.76% (0.6736 => 0.6348, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: -5.73% (1.1530 => 1.0869, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.72% (0.6681 => 0.6299, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.71% (0.5478 => 0.5165, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.71% (0.7339 => 0.6920, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.70% (0.6230 => 0.5875, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.69% (0.6395 => 0.6031, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.68% (0.6194 => 0.5842, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.68% (0.5863 => 0.5530, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.66% (0.3319 => 0.3131, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.66% (0.2385 => 0.2250) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.66% (0.5849 => 0.5518, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.65% (0.6052 => 0.5710, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.65% (0.2106 => 0.1987, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.64% (0.5581 => 0.5266, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.64% (0.6260 => 0.5907, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.63% (0.6660 => 0.6285, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.62% (0.5802 => 0.5476, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.60% (0.6676 => 0.6302, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.59% (0.5705 => 0.5386, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.59% (0.6189 => 0.5843, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.59% (0.5941 => 0.5609, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: -5.58% (0.4515 => 0.4263, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.58% (0.5859 => 0.5532, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: -5.58% (0.9179 => 0.8667, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: -5.57% (0.4861 => 0.4590, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.55% (0.5456 => 0.5153, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.54% (0.6446 => 0.6089, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.54% (0.6395 => 0.6041, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -5.52% (1.1450 => 1.0818, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: -5.52% (0.7447 => 0.7036, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.49% (0.6667 => 0.6301, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -5.48% (1.3148 => 1.2427, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.48% (0.5569 => 0.5264, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.46% (0.3849 => 0.3639, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.45% (0.5575 => 0.5271, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.45% (0.6440 => 0.6089, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.44% (0.3491 => 0.3301, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: -5.44% (18.2933 => 17.2987, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.44% (0.6033 => 0.5705, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.42% (0.5570 => 0.5268, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.41% (0.7524 => 0.7117, std.dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: -5.40% (15.5079 => 14.6700, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.38% (0.5168 => 0.4890, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -5.35% (34.0927 => 32.2698, std.dev.: 0.0190) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.34% (0.3837 => 0.3632, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -5.31% (0.3406 => 0.3225, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.26% (0.5688 => 0.5389, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.25% (0.4321 => 0.4094, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: -5.24% (3.5154 => 3.3311, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -5.23% (0.6750 => 0.6397, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.22% (6.7716 => 6.4180, std.dev.: 0.0125) MultiSource/Applications/lambda-0_1_3/lambda: -5.21% (0.7982 => 0.7566, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.21% (0.9557 => 0.9059, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.19% (0.3931 => 0.3727, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -5.18% (0.8418 => 0.7982, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.17% (0.5567 => 0.5279, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.17% (8.0126 => 7.5985, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.16% (0.7021 => 0.6659, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.12% (0.5329 => 0.5056, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: -5.12% (2.1401 => 2.0305, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: -5.12% (0.2989 => 0.2836, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -5.11% (0.3446 => 0.3270, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: -5.11% (0.3271 => 0.3104, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.07% (0.3252 => 0.3087, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.07% (0.4083 => 0.3876, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.05% (0.2355 => 0.2236, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: -5.04% (0.4524 => 0.4296, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary: -5.04% (0.3394 => 0.3223, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -5.03% (0.3059 => 0.2905, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.95% (2.1713 => 2.0638, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/lists: -4.86% (0.3621 => 0.3445, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.84% (0.4813 => 0.4580, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -4.82% (0.3026 => 0.2880, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -4.79% (0.3025 => 0.2880, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.75% (0.3323 => 0.3165, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -4.74% (0.3481 => 0.3316, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/fibo: -4.74% (0.2871 => 0.2735, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -4.73% (0.3255 => 0.3101, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.69% (0.9077 => 0.8651, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.68% (0.3483 => 0.3320, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.68% (0.3057 => 0.2914, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -4.66% (0.2939 => 0.2802, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.65% (0.2903 => 0.2768, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -4.61% (0.4248 => 0.4052, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -4.60% (0.3867 => 0.3689, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -4.59% (1.2300 => 1.1735, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -4.59% (0.7779 => 0.7422, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.58% (0.7198 => 0.6868, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: -4.57% (0.3194 => 0.3048, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.57% (0.2933 => 0.2799, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.56% (0.4427 => 0.4225, std.dev.: 0.0072) MultiSource/Applications/sqlite3/sqlite3: -4.55% (17.1032 => 16.3256, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/hello: -4.53% (0.2849 => 0.2720, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.52% (0.2277 => 0.2174, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: -4.52% (0.6347 => 0.6060, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: -4.52% (0.6441 => 0.6150, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -4.49% (0.3205 => 0.3061, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -4.49% (0.3788 => 0.3618, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.44% (0.3016 => 0.2882, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.38% (0.2695 => 0.2577, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -4.33% (5.0226 => 4.8049, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.80% (14.2083 => 13.6682, std.dev.: 0.0142) MultiSource/Applications/hbd/hbd: -3.60% (1.5610 => 1.5048, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: -3.40% (1.3864 => 1.3392, std.dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -3.33% (20.7746 => 20.0835, std.dev.: 0.0241) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7529, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/richards_benchmark: -8.74% (1.2842 => 1.1719, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7063, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.72% (2.2633 => 2.1790, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.29% (1.3096 => 1.2796, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4731, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0003) Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 19:57:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 21:57:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121027025717.DB1F12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5274?compare_to=5271&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5274, Order: 166852, Start Time: 2012-10-27 01:34:23, End Time: 2012-10-27 02:57:13 To: 5271, Order: 166827, Start Time: 2012-10-26 23:39:21, End Time: 2012-10-27 01:02:29 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 2 (75 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 15 (196 on baseline) Performance Improvements: 8 (50 on baseline) Added Tests: 0 (62 on baseline) Existing Failures: 75 (2 on baseline) Unchanged Tests: 942 (640 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.10% (57.6996 => 57.6400, std.dev.: 0.0348) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -100.00% (7.5856 => 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/salsa20: 33.93% (0.1506 => 0.2017, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 31.70% (2.5086 => 3.3038, std.dev.: 0.0045) MultiSource/Applications/JM/ldecod/ldecod: 13.00% (10.9448 => 12.3677, std.dev.: 0.0167) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.00% (3.1145 => 3.4571, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.41% (3.1835 => 3.4512, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.55% (0.2417 => 0.2527, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.59% (1.6110 => 1.6689, std.dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: 2.73% (13.8856 => 14.2645, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.64% (7.3774 => 7.4985, std.dev.: 0.0082) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/dt: 3.99% (1.0510 => 1.0929, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.77% (7.8001 => 8.0160, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.75% (2.4751 => 2.5431, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.36% (1.0697 => 1.0949, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.57% (3.6546 => 3.7119, std.dev.: 0.0039) SingleSource/Benchmarks/McGill/chomp: 1.19% (1.0843 => 1.0972, std.dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/ReedSolomon: -9.98% (0.2485 => 0.2237, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -2.93% (2.2465 => 2.1806, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: -2.68% (1.3793 => 1.3424, std.dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -25.35% (13.5175 => 10.0909, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/bh/bh: -2.58% (2.0143 => 1.9623, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: -1.88% (4.5185 => 4.4337, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.71% (1.1482 => 1.1286, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.47% (1.7311 => 1.7056, std.dev.: 0.0004) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0490 => 0.0490, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -0.41% (0.0492 => 0.0490, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -0.22% (0.0459 => 0.0458, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -0.22% (0.0461 => 0.0460, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0447 => 0.0447, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -0.22% (0.0450 => 0.0449, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -0.45% (0.0442 => 0.0440, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -0.45% (0.0444 => 0.0442, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0460 => 0.0460, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -0.22% (0.0461 => 0.0460, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -0.44% (0.0455 => 0.0453, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -0.44% (0.0456 => 0.0454, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -0.45% (0.0444 => 0.0442, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0446 => 0.0446) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -0.22% (0.0452 => 0.0451) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0453 => 0.0453, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -0.22% (0.0463 => 0.0462, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -0.22% (0.0465 => 0.0464, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -0.23% (0.0440 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -0.23% (0.0441 => 0.0440, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -0.44% (0.0452 => 0.0450, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -0.22% (0.0453 => 0.0452, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -0.23% (0.0443 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -0.23% (0.0444 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -0.23% (0.0435 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -0.46% (0.0436 => 0.0434, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -0.46% (0.0434 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -0.23% (0.0436 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -0.21% (0.0471 => 0.0470, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -0.21% (0.0472 => 0.0471, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -0.46% (0.0433 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -0.46% (0.0434 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -0.46% (0.0434 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -0.23% (0.0435 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -0.23% (0.0442 => 0.0441) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -0.45% (0.0443 => 0.0441, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/BenchmarkGame/puzzle MultiSource/Applications/oggenc/oggenc: -0.14% (0.1407 => 0.1405, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0649 => 0.0648, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: - (0.0001 => 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -12.46% (0.3827 => 0.3350, std.dev.: 0.0010) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Bullet/bullet: -8.86% (63.2438 => 57.6400, std.dev.: 0.0348) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/BenchmarkGame/puzzle MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.88% (0.6962 => 0.3350, std.dev.: 0.0010) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 208.05% (0.5229 => 1.6108, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 15.96% (14.9895 => 17.3820, std.dev.: 0.0106) MultiSource/Applications/kimwitu++/kc: 36.78% (14.1553 => 19.3612, std.dev.: 0.0121) MultiSource/Benchmarks/MallocBench/gs/gs: 13.52% (4.1105 => 4.6664, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 35.21% (1.1048 => 1.4938, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 316.42% (7.1582 => 29.8082, std.dev.: 0.0150) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.32% (3.4629 => 5.7940, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 67.50% (0.6222 => 1.0422, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 11798.33% (0.0720 => 8.5668, std.dev.: 0.0110) MultiSource/Applications/SIBsim4/SIBsim4: 4011100.00% (0.0001 => 4.0112, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 11158300.00% (0.0001 => 11.1584, std.dev.: 0.0566) MultiSource/Applications/kimwitu++/kc: 50500.00% (0.0001 => 0.0506, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 792000.00% (0.0001 => 0.7921) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049600.00% (0.0001 => 10.0497, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5492500.00% (0.0001 => 5.4926, std.dev.: 0.0076) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 68.75% (0.0256 => 0.0432, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 55.97% (0.0243 => 0.0379, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 53.87% (0.0271 => 0.0417, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 47.30% (0.0296 => 0.0436, std.dev.: 0.0000) SingleSource/Regression/C/sumarray: 43.72% (0.0231 => 0.0332, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 40.53% (0.1056 => 0.1484, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 37.59% (10.3673 => 14.2645, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 37.50% (1.5859 => 2.1806, std.dev.: 0.0016) SingleSource/UnitTests/vla: 33.52% (0.0355 => 0.0474, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.27% (2.2024 => 2.8691, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/neural/neural: 30.08% (0.1463 => 0.1903, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 28.21% (0.1432 => 0.1836, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 25.32% (0.1655 => 0.2074, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.71% (0.1566 => 0.1906, std.dev.: 0.0012) MultiSource/Benchmarks/llubenchmark/llu: 21.65% (0.0462 => 0.0562, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: 21.24% (0.0485 => 0.0588, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/rem: 20.63% (0.1144 => 0.1380, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.40% (0.0871 => 0.1040, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 18.98% (0.4879 => 0.5805, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 18.94% (0.5105 => 0.6072, std.dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 18.51% (10.4361 => 12.3677, std.dev.: 0.0167) SingleSource/Benchmarks/BenchmarkGame/n-body: 18.10% (0.0746 => 0.0881, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 17.88% (0.3177 => 0.3745, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/almabench: 17.67% (0.0730 => 0.0859, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 17.54% (0.2554 => 0.3002, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 17.53% (0.1175 => 0.1381, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.51% (0.6675 => 0.7844, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.32% (1.3050 => 1.5310, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 16.92% (3.3354 => 3.8998, std.dev.: 0.0049) MultiSource/Applications/minisat/minisat: 16.78% (0.7115 => 0.8309, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: 16.61% (0.0626 => 0.0730, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 16.58% (0.1695 => 0.1976, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.58% (0.0730 => 0.0851, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.57% (0.5020 => 0.5852, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.39% (0.0793 => 0.0923, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 16.34% (0.1163 => 0.1353, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ks/ks: 16.09% (0.1510 => 0.1753, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.04% (1.5415 => 1.7887, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.02% (0.8172 => 0.9481, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 16.01% (0.1337 => 0.1551, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.99% (0.1032 => 0.1197, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.95% (0.0834 => 0.0967, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 15.94% (0.2271 => 0.2633, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.88% (0.4615 => 0.5348, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 15.76% (22.1758 => 25.6702, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.62% (0.1940 => 0.2243, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.60% (0.3121 => 0.3608, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.58% (0.0886 => 0.1024, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 15.57% (0.3109 => 0.3593, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 15.33% (0.2603 => 0.3002, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 15.29% (0.1151 => 0.1327, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.26% (0.0675 => 0.0778, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.20% (0.0842 => 0.0970, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.08% (0.1625 => 0.1870, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.04% (0.0838 => 0.0964, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.90% (0.1584 => 0.1820, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/exptree: 14.74% (0.0814 => 0.0934, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.68% (0.6450 => 0.7397, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.59% (0.9765 => 1.1190, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/18-imp/imp: 14.52% (0.3423 => 0.3920, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.50% (0.1117 => 0.1279, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 14.47% (0.1555 => 0.1780, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.38% (0.2107 => 0.2410, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.36% (0.2758 => 0.3154, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: 14.34% (1.1642 => 1.3312, std.dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 14.33% (0.0719 => 0.0822, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.29% (0.0770 => 0.0880, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.24% (4.2646 => 4.8717, std.dev.: 0.0143) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.22% (0.1125 => 0.1285, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 14.16% (1.0722 => 1.2240, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 14.12% (0.7835 => 0.8941, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.11% (0.2700 => 0.3081, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 14.10% (2.0273 => 2.3132, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.04% (0.2065 => 0.2355, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.04% (1.1861 => 1.3526, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.01% (0.5981 => 0.6819, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.94% (0.1062 => 0.1210, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 13.89% (9.4845 => 10.8019, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.83% (8.1363 => 9.2617, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/football/football: 13.77% (0.8921 => 1.0149, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.75% (0.5860 => 0.6666, std.dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: 13.67% (0.7433 => 0.8449, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.61% (0.1029 => 0.1169, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.53% (0.0798 => 0.0906, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/09-vor/vor: 13.40% (0.3180 => 0.3606, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.39% (0.1695 => 0.1922, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 13.38% (1.1840 => 1.3424, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.30% (1.4186 => 1.6073, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.29% (0.0933 => 0.1057, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 13.21% (0.4299 => 0.4867, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.12% (0.0770 => 0.0871, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.11% (0.1236 => 0.1398, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.02% (0.0929 => 0.1050, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 13.01% (3.8723 => 4.3760, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.00% (0.3307 => 0.3737, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.78% (0.1330 => 0.1500, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 12.70% (0.1268 => 0.1429, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.66% (0.5569 => 0.6274, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 12.49% (0.3387 => 0.3810, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.44% (4.9449 => 5.5598, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.43% (0.8067 => 0.9070, std.dev.: 0.0032) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.34% (0.1143 => 0.1284, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.32% (5.0018 => 5.6179, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.26% (0.3441 => 0.3863, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.80% (0.1906 => 0.2131, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.54% (0.8101 => 0.9036, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.52% (0.2266 => 0.2527, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.49% (0.3543 => 0.3950, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 11.47% (0.4289 => 0.4781, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 11.34% (0.4620 => 0.5144, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.21% (0.1892 => 0.2104, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 11.12% (0.0953 => 0.1059, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 11.03% (0.6456 => 0.7168, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 11.00% (5.7591 => 6.3927, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 10.97% (0.3473 => 0.3854, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.95% (0.3927 => 0.4357, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 10.91% (2.2969 => 2.5475, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 10.90% (0.3092 => 0.3429, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/for-in: 10.86% (0.3694 => 0.4095, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.84% (0.3543 => 0.3927, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 10.78% (0.3561 => 0.3945, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.76% (0.3828 => 0.4240, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.75% (0.3516 => 0.3894, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.67% (0.3497 => 0.3870, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.61% (0.3826 => 0.4232, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.60% (2.2022 => 2.4357, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.60% (14.3668 => 15.8893, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/property: 10.40% (0.3886 => 0.4290, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.35% (0.4203 => 0.4638, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 10.32% (0.3422 => 0.3775, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.25% (0.3865 => 0.4261, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 10.23% (1.5603 => 1.7199, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.19% (0.4103 => 0.4521, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.15% (0.1044 => 0.1150, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 10.02% (17.1811 => 18.9018, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/lists1: 9.88% (0.3684 => 0.4048, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.84% (0.4636 => 0.5092, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/moments: 9.81% (0.4048 => 0.4445, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 9.73% (21.9371 => 24.0725, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.60% (0.3427 => 0.3756, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sieve: 9.49% (0.3603 => 0.3945, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 9.18% (0.2049 => 0.2237, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.72% (0.2430 => 0.2642, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 8.66% (0.5925 => 0.6438, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.66% (0.6030 => 0.6552, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.59% (0.4064 => 0.4413, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 8.46% (0.3098 => 0.3360, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.43% (0.2872 => 0.3114, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 8.37% (0.2831 => 0.3068, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.37% (0.2891 => 0.3133, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.36% (0.3650 => 0.3955, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 8.32% (0.3283 => 0.3556, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 8.29% (0.3232 => 0.3500, std.dev.: 0.0054) SingleSource/UnitTests/ObjC++/property-reference: 8.23% (0.7326 => 0.7929, std.dev.: 0.0018) SingleSource/Benchmarks/Stanford/Puzzle: 8.20% (0.1268 => 0.1372, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 8.16% (0.2905 => 0.3142, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.09% (0.2756 => 0.2979, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.07% (2.0665 => 2.2333, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.06% (0.3162 => 0.3417, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.06% (3.8922 => 4.2059, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.02% (0.2793 => 0.3017, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 7.94% (0.2871 => 0.3099, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.92% (0.2877 => 0.3105, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.89% (0.2725 => 0.2940, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 7.86% (0.3052 => 0.3292, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.73% (7.9617 => 8.5775, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/random: 7.71% (0.2802 => 0.3018, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.66% (0.2714 => 0.2922, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 7.49% (0.3379 => 0.3632, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.13% (1.2842 => 1.3757, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.11% (0.3136 => 0.3359, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 6.89% (0.3282 => 0.3508, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.30% (7.0540 => 7.4985, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/objinst: 5.81% (0.3131 => 0.3313, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.12% (0.3935 => 0.4097, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.51% (5.3999 => 13.3115, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1725, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 14.07% (2.6778 => 3.0547, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 13.35% (0.9957 => 1.1286, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.85% (1.1396 => 1.2519, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.64% (2.8904 => 3.0824, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (3.1578 => 3.3672, std.dev.: 0.0009) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.88% (4.2280 => 4.3497, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.41% (1.0313 => 1.0562, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 2.17% (11.6436 => 11.8968, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.99% (3.6395 => 3.7119, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/bisort/bisort: 1.81% (0.8333 => 0.8484, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2078, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.52% (2.6546 => 2.6950, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 1.12% (1.9405 => 1.9623, std.dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.95% (6.6874 => 0.1374, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -76.68% (0.8651 => 0.2017, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -45.44% (0.1622 => 0.0885, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.38% (5.2763 => 3.3038, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -35.92% (5.3855 => 3.4512, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -35.41% (5.3526 => 3.4571, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -8.69% (54.1659 => 49.4605, std.dev.: 0.0298) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.22% (1.7609 => 1.6689, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.65% (2.9384 => 2.8018, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.56% (1.1194 => 1.0683, std.dev.: 0.0077) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -52.89% (8.0499 => 3.7923, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -46.58% (2.0460 => 1.0929, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7645, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4245, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -14.36% (2.9695 => 2.5431, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -11.32% (1.2373 => 1.0972, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -10.68% (1.2258 => 1.0949, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -10.64% (1.5373 => 1.3737, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.27% (19.9488 => 18.2981, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/mason/mason: -7.73% (0.2161 => 0.1994, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.95% (1.8329 => 1.7055, std.dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -5.45% (6.6465 => 6.2843, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.91% (1.6805 => 1.5980, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.55% (1.5835 => 1.5115, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.73% (1.3677 => 1.3167, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.65% (3.2827 => 3.1628, std.dev.: 0.0108) MultiSource/Benchmarks/sim/sim: -3.33% (5.0483 => 4.8804, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.13% (32.5116 => 31.4924, std.dev.: 0.0028) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.62% (0.4808 => 0.4682, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -2.17% (4.6441 => 4.5431, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.87% (10.2830 => 10.0909, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.72% (8.1563 => 8.0160, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6820, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.53% (2.5528 => 2.5138, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4208, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout/lists: -1.18% (6.2999 => 6.2258, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7056, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: -1.11% (4.9088 => 4.8543, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -5.39% (0.1485 => 0.1405, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0021) Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 20:36:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 22:36:56 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121027033656.CE9AE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5275?compare_to=5272&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5275, Order: 166855, Start Time: 2012-10-27 02:12:58, End Time: 2012-10-27 03:36:54 To: 5272, Order: 166840, Start Time: 2012-10-27 00:29:46, End Time: 2012-10-27 01:56:19 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 7 (82 on baseline) Performance Improvements: 19 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 949 (888 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.35% (0.2597 => 0.2736, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.91% (1.2563 => 1.2929, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.20% (1.2698 => 1.2850, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/life/life: 2.42% (2.5670 => 2.6290, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.93% (2.4606 => 2.5080, std.dev.: 0.0143) SingleSource/Benchmarks/Misc/pi: 1.41% (2.4731 => 2.5080, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/five11/five11: 1.03% (5.6192 => 5.6770, std.dev.: 0.0109) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -3.46% (5.1726 => 4.9936, std.dev.: 0.0549) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -2.09% (0.8355 => 0.8180, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.82% (0.8527 => 0.8372, std.dev.: 0.0054) MultiSource/Applications/minisat/minisat: -1.70% (0.7102 => 0.6981, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.68% (3.2630 => 3.2082, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.48% (2.1847 => 2.1523, std.dev.: 0.0044) MultiSource/Applications/d/make_dparser: -1.36% (3.3685 => 3.3227, std.dev.: 0.0045) MultiSource/Applications/SPASS/SPASS: -1.30% (14.8391 => 14.6466, std.dev.: 0.0171) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.12% (1.5578 => 1.5403, std.dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: -1.00% (6.9767 => 6.9067, std.dev.: 0.0148) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.22% (46.4008 => 45.3725, std.dev.: 0.2104) MultiSource/Applications/SIBsim4/SIBsim4: -1.64% (3.2347 => 3.1815, std.dev.: 0.0182) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.54% (4.9515 => 4.8754, std.dev.: 0.0127) MultiSource/Benchmarks/Bullet/bullet: -1.40% (7.2635 => 7.1621, std.dev.: 0.0155) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.33% (1.8998 => 1.8745, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/ReedSolomon: -1.22% (8.8233 => 8.7154, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.15% (11.7220 => 11.5870, std.dev.: 0.0253) SingleSource/Benchmarks/Shootout/hash: -1.13% (4.3319 => 4.2829, std.dev.: 0.0186) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.04% (2.9380 => 2.9075, std.dev.: 0.0062) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.34% (16.6744 => 16.6183, std.dev.: 0.1609) MultiSource/Applications/obsequi/Obsequi: 0.17% (1.0659 => 1.0677, std.dev.: 0.0082) MultiSource/Applications/sqlite3/sqlite3: 0.40% (0.6425 => 0.6451, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/08-main/main: 1.54% (0.1947 => 0.1977, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.15% (0.1654 => 0.1673, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.21% (0.3262 => 0.3255, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.24% (0.2498 => 0.2504, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.75% (0.3351 => 0.3326, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.17% (0.2372 => 0.2376, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 0.92% (0.5982 => 0.6037, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: -1.29% (0.0465 => 0.0459, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.09% (0.3318 => 0.3321, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 1.06% (0.1989 => 0.2010, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 11.57% (0.0242 => 0.0270, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.35% (0.0222 => 0.0219, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.70% (0.0430 => 0.0427, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -3.56% (0.0337 => 0.0325, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.32% (0.0314 => 0.0315, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -7.99% (0.0438 => 0.0403, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/casts: -1.92% (0.0208 => 0.0204, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -26.03% (0.0219 => 0.0162, std.dev.: 0.0028) SingleSource/UnitTests/byval-alignment: 6.47% (0.0340 => 0.0362, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.40% (0.1489 => 0.1483, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -2.44% (1.1588 => 1.1305, std.dev.: 0.0554) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 0.27% (0.1499 => 0.1503, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.46% (0.4021 => 0.4120, std.dev.: 0.0266) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.10% (0.1365 => 0.1350, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.40% (0.0655 => 0.0600, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -7.58% (0.0277 => 0.0256, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.09% (0.0573 => 0.0585, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.01% (1.1439 => 1.1438, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.32% (0.0631 => 0.0629, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.52% (0.0263 => 0.0267) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.29% (0.7916 => 0.8018, std.dev.: 0.0227) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 29.63% (0.0054 => 0.0070, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.08% (2.1832 => 1.6575, std.dev.: 0.0045) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 34.62% (14.7684 => 19.8816, std.dev.: 0.0964) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.70% (0.0810 => 0.0921, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: 13.22% (0.1112 => 0.1259, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 12.08% (0.1035 => 0.1160, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.67% (0.2180 => 0.2369, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.64% (0.2279 => 0.2476, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.61% (0.2519 => 0.2736, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.00% (0.3137 => 0.3388, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.54% (0.6010 => 0.6463, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.09% (0.1905 => 0.2040, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.02% (0.1425 => 0.1525, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.56% (0.4847 => 0.5165, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.42% (0.8321 => 0.8855, std.dev.: 0.0169) MultiSource/Applications/SIBsim4/SIBsim4: 6.10% (1.2568 => 1.3335, std.dev.: 0.0155) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.98% (0.8148 => 0.8635, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.82% (0.7473 => 0.7908, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.21% (1.1170 => 1.1752, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.90% (13.1811 => 13.8272, std.dev.: 0.0291) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.90% (6.6074 => 6.9312, std.dev.: 0.0215) MultiSource/Applications/hbd/hbd: 4.84% (1.4269 => 1.4959, std.dev.: 0.0112) MultiSource/Applications/Burg/burg: 4.64% (1.2222 => 1.2789, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.56% (0.6287 => 0.6574, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.12% (0.2741 => 0.2854, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.04% (0.3717 => 0.3867, std.dev.: 0.0032) MultiSource/Applications/spiff/spiff: 3.96% (0.7950 => 0.8265, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.85% (0.4127 => 0.4286, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.78% (1.1606 => 1.2045, std.dev.: 0.0069) MultiSource/Applications/treecc/treecc: 3.72% (1.9948 => 2.0691, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.70% (0.3003 => 0.3114, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.69% (1.6386 => 1.6991, std.dev.: 0.0151) MultiSource/Applications/sgefa/sgefa: 3.40% (0.2999 => 0.3101, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.40% (1.1685 => 1.2082, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.32% (0.5961 => 0.6159, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.31% (0.9435 => 0.9747, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.22% (1.2526 => 1.2929, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.20% (0.6227 => 0.6426, std.dev.: 0.0059) MultiSource/Applications/lua/lua: 3.18% (3.8189 => 3.9403, std.dev.: 0.0245) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.13% (4.1763 => 4.3072, std.dev.: 0.0194) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.10% (8.6476 => 8.9154, std.dev.: 0.0334) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.07% (0.3295 => 0.3396, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.91% (1.4479 => 1.4901, std.dev.: 0.0068) MultiSource/Applications/SPASS/SPASS: 2.71% (14.2605 => 14.6466, std.dev.: 0.0171) MultiSource/Applications/d/make_dparser: 2.66% (3.2366 => 3.3227, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.61% (0.4559 => 0.4678, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 2.60% (6.7320 => 6.9067, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.56% (0.5817 => 0.5966, std.dev.: 0.0048) MultiSource/Applications/hexxagon/hexxagon: 2.55% (0.9810 => 1.0060, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.54% (4.5702 => 4.6864, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.51% (1.3279 => 1.3612, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.49% (4.4873 => 4.5990, std.dev.: 0.0205) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.30% (0.8995 => 0.9202, std.dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 2.30% (1.1271 => 1.1530, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/football/football: 2.18% (0.8768 => 0.8959, std.dev.: 0.0069) MultiSource/Applications/minisat/minisat: 2.15% (0.6834 => 0.6981, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.13% (4.4880 => 4.5835, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.12% (0.8697 => 0.8881, std.dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: 2.00% (15.3280 => 15.6345, std.dev.: 0.1065) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.97% (1.2602 => 1.2850, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.93% (0.5191 => 0.5291, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.81% (0.8611 => 0.8767, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.78% (1.2423 => 1.2644, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.72% (0.6586 => 0.6699, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.58% (0.8597 => 0.8733, std.dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: 1.54% (2.3764 => 2.4130, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.45% (0.8204 => 0.8323, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.43% (0.8420 => 0.8540, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.42% (0.8177 => 0.8293, std.dev.: 0.0033) MultiSource/Applications/siod/siod: 1.35% (2.2184 => 2.2484, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.28% (0.8716 => 0.8828, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.28% (0.9688 => 0.9812, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.24% (0.8066 => 0.8166, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.78% (1.5795 => 2.5080, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.32% (0.3186 => 0.3483, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.31% (1.1857 => 1.2842, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 5.99% (63.1822 => 66.9685, std.dev.: 0.0494) MultiSource/Applications/siod/siod: 2.45% (3.6643 => 3.7542, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.41% (2.4490 => 2.5080, std.dev.: 0.0143) SingleSource/Benchmarks/Misc/ReedSolomon: 2.15% (8.5322 => 8.7154, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.82% (44.5605 => 45.3725, std.dev.: 0.2104) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.71% (4.3552 => 4.4297, std.dev.: 0.0278) MultiSource/Benchmarks/Olden/bh/bh: 1.53% (2.3560 => 2.3920, std.dev.: 0.0122) MultiSource/Benchmarks/BitBench/five11/five11: 1.32% (5.6030 => 5.6770, std.dev.: 0.0109) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -9.18% (3.2926 => 2.9903, std.dev.: 0.0925) MultiSource/Applications/lua/lua: -5.16% (29.8330 => 28.2923, std.dev.: 0.1120) SingleSource/Benchmarks/Shootout-C++/hash2: -1.52% (3.4237 => 3.3718, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.27% (3.3479 => 3.3053, std.dev.: 0.0003) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 1.05% (16.4461 => 16.6183, std.dev.: 0.1609) MultiSource/Applications/obsequi/Obsequi: 4.04% (1.0262 => 1.0677, std.dev.: 0.0082) MultiSource/Applications/sqlite3/sqlite3: 1.88% (0.6332 => 0.6451, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/08-main/main: 7.97% (0.1831 => 0.1977, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.31% (0.1559 => 0.1673, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.23% (0.3123 => 0.3255, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.66% (0.2463 => 0.2504, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.54% (0.3344 => 0.3326, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.51% (0.2364 => 0.2376, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 0.45% (0.6010 => 0.6037, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: 6.99% (0.0429 => 0.0459, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.68% (0.3266 => 0.3321, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 2.08% (0.1969 => 0.2010, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 20.54% (0.0224 => 0.0270, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 27.95% (0.0254 => 0.0325, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 4.95% (0.0384 => 0.0403, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -10.00% (0.0180 => 0.0162, std.dev.: 0.0028) SingleSource/UnitTests/byval-alignment: 57.39% (0.0230 => 0.0362, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 3.13% (0.1438 => 0.1483, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -0.21% (1.1329 => 1.1305, std.dev.: 0.0554) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 2.80% (0.1462 => 0.1503, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.06% (0.4164 => 0.4120, std.dev.: 0.0266) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.39% (0.1369 => 0.1350, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.40% (0.0641 => 0.0600, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 31.28% (0.0195 => 0.0256, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.21% (0.0578 => 0.0585, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.01% (1.1437 => 1.1438, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.32% (0.0627 => 0.0629, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.33% (0.0180 => 0.0267) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.01% (0.8017 => 0.8018, std.dev.: 0.0227) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 12.90% (0.0062 => 0.0070, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 21:00:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 23:00:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121027040002.0B0FF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5276?compare_to=5268&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5276, Order: 166836, Start Time: 2012-10-27 00:43:22, End Time: 2012-10-27 03:59:57 To: 5268, Order: 166802, Start Time: 2012-10-26 20:38:31, End Time: 2012-10-26 23:54:41 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 9 (170 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1033 (719 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/Hello: 1.82% (0.6715 => 0.6837, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 1.73% (0.6774 => 0.6891, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.49% (0.7113 => 0.7219, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 1.28% (6.1123 => 6.1908, std.dev.: 0.0158) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.04% (1.8641 => 1.8835, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 7.21% (110.6580 => 118.6395, std.dev.: 0.0448) MultiSource/Applications/ClamAV/clamscan: 4.10% (0.2930 => 0.3050, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 1.93% (0.6122 => 0.6240, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.27% (54.2156 => 54.9058, std.dev.: 0.0665) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 39.84% (0.0625 => 0.0874, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.80% (0.1063 => 0.1401, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.06% (0.2969 => 0.3713, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 24.68% (0.1106 => 0.1379, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.47% (0.4139 => 0.5152, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 23.66% (1.5932 => 1.9702, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.44% (0.4253 => 0.5250, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.29% (0.4994 => 0.6157, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.22% (0.0547 => 0.0674, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.80% (0.5900 => 0.7245, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.74% (0.5000 => 0.6137, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.55% (0.0714 => 0.0875, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.53% (0.0475 => 0.0582, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.43% (0.0584 => 0.0715, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.96% (0.0897 => 0.1094, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 21.20% (0.0599 => 0.0726, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 20.99% (0.1620 => 0.1960, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 20.86% (0.1021 => 0.1234, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 20.42% (0.1107 => 0.1333, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 20.20% (0.0604 => 0.0726, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 20.15% (0.0948 => 0.1139, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/04-bisect/bisect: 19.91% (0.0633 => 0.0759, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.78% (0.0541 => 0.0648, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.76% (0.1103 => 0.1321, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.55% (0.3903 => 0.4666, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.52% (0.0584 => 0.0698, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.47% (0.0642 => 0.0767, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.34% (0.1003 => 0.1197, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 19.33% (0.1619 => 0.1932, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.26% (0.1604 => 0.1913, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 19.24% (0.0821 => 0.0979, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.11% (0.1549 => 0.1845, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.86% (0.0822 => 0.0977, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.19% (0.1462 => 0.1728, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 18.19% (0.0808 => 0.0955, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 18.16% (0.0947 => 0.1119, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.02% (0.2014 => 0.2377, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 17.80% (0.4029 => 0.4746, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.76% (0.3890 => 0.4581, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.69% (0.2736 => 0.3220, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/08-main/main: 17.57% (0.1218 => 0.1432, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.37% (1.3152 => 1.5436, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/Hello: 17.35% (0.5826 => 0.6837, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 17.28% (0.1505 => 0.1765, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.19% (0.1088 => 0.1275, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 17.05% (0.0698 => 0.0817, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 17.01% (0.5889 => 0.6891, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.82% (0.2866 => 0.3348, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 16.78% (1.8794 => 2.1947, std.dev.: 0.0045) MultiSource/Applications/Burg/burg: 16.55% (0.5546 => 0.6464, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.31% (0.1968 => 0.2289, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.29% (0.1160 => 0.1349, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.28% (3.5627 => 4.1427, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.19% (1.6211 => 1.8835, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.14% (0.4658 => 0.5410, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.96% (0.5026 => 0.5828, std.dev.: 0.0022) MultiSource/Applications/hbd/hbd: 15.91% (0.9697 => 1.1240, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: 15.90% (0.1421 => 0.1647, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.90% (0.2875 => 0.3332, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.84% (0.3271 => 0.3789, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 15.60% (0.0673 => 0.0778, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 15.56% (0.2725 => 0.3149, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.46% (0.4361 => 0.5035, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 15.35% (0.3004 => 0.3465, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 15.33% (0.2714 => 0.3130, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.30% (0.2738 => 0.3157, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 15.27% (0.2750 => 0.3170, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 15.25% (0.2780 => 0.3204, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 15.19% (0.1284 => 0.1479, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 15.17% (1.0781 => 1.2416, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 15.16% (0.7171 => 0.8258, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.13% (0.2729 => 0.3142, std.dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 15.09% (0.9909 => 1.1404, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/except: 15.05% (0.2811 => 0.3234, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.01% (0.2911 => 0.3348, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.99% (0.3195 => 0.3674, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 14.97% (4.4195 => 5.0809, std.dev.: 0.0083) MultiSource/Applications/ClamAV/clamscan: 14.94% (4.2109 => 4.8402, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.94% (0.3930 => 0.4517, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 14.92% (23.5202 => 27.0299, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/objinst: 14.91% (0.2823 => 0.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.90% (0.2792 => 0.3208, std.dev.: 0.0084) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.88% (2.7292 => 3.1353, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.88% (2.0673 => 2.3749, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/random: 14.88% (0.2803 => 0.3220, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 14.83% (0.3096 => 0.3555, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 14.82% (0.2813 => 0.3230, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.78% (1.9694 => 2.2604, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.65% (1.9966 => 2.2891, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary3: 14.57% (0.3267 => 0.3743, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.54% (0.3362 => 0.3851, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.40% (0.1090 => 0.1247, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 14.40% (0.3258 => 0.3727, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 14.37% (0.3348 => 0.3829, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: 14.28% (0.3726 => 0.4258, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.25% (0.3060 => 0.3496, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 14.20% (0.3317 => 0.3788, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.96% (0.3124 => 0.3560, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 13.83% (0.2566 => 0.2921, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 13.73% (0.2075 => 0.2360, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 13.73% (0.3678 => 0.4183, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 13.71% (1.4269 => 1.6225, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists1: 13.52% (0.3477 => 0.3947, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.50% (0.3282 => 0.3725, std.dev.: 0.0014) MultiSource/Applications/treecc/treecc: 13.46% (0.7875 => 0.8935, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.45% (0.3845 => 0.4362, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.43% (0.3625 => 0.4112, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.36% (0.3981 => 0.4513, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 13.29% (0.4251 => 0.4816, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.17% (0.3690 => 0.4176, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash: 13.17% (0.4146 => 0.4692, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 13.15% (2.1653 => 2.4501, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/exceptions-2: 12.94% (0.3446 => 0.3892, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 12.90% (0.3496 => 0.3947, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 12.84% (0.3465 => 0.3910, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 12.78% (0.3442 => 0.3882, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 12.77% (0.3460 => 0.3902, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.76% (0.3488 => 0.3933, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 12.76% (4.6177 => 5.2067, std.dev.: 0.0107) SingleSource/UnitTests/ObjC/synchronized: 12.74% (0.3469 => 0.3911, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 12.68% (0.3650 => 0.4113, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 12.65% (0.5012 => 0.5646, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.55% (0.2040 => 0.2296, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 12.43% (2.1013 => 2.3625, std.dev.: 0.0096) SingleSource/UnitTests/ObjC/parameter-passing: 12.41% (0.3724 => 0.4186, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 12.33% (0.3643 => 0.4092, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.18% (0.6435 => 0.7219, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.77% (0.1028 => 0.1149, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 11.71% (5.5417 => 6.1908, std.dev.: 0.0158) MultiSource/Applications/SIBsim4/SIBsim4: 11.71% (0.2691 => 0.3006, std.dev.: 0.0019) MultiSource/Applications/siod/siod: 10.94% (0.6634 => 0.7360, std.dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 10.92% (0.3498 => 0.3880, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.63% (0.1383 => 0.1530, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.60% (0.2737 => 0.3027, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.59% (0.2068 => 0.2287, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 10.49% (0.3336 => 0.3686, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 10.40% (0.4847 => 0.5351, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.25% (0.3084 => 0.3400, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.94% (0.2103 => 0.2312, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 9.65% (2.0346 => 2.2310, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.64% (4.6926 => 5.1449, std.dev.: 0.0241) MultiSource/Applications/lemon/lemon: 9.28% (0.2391 => 0.2613, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.80% (0.5361 => 0.5833, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.72% (11.6398 => 12.6549, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.27% (0.5584 => 0.6046, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.16% (0.7426 => 0.8032, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 6.60% (11.9555 => 12.7450, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.61% (0.3792 => 0.3929, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.32% (0.2162 => 0.3531, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6533, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.22% (0.5917 => 0.6699, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 8.85% (0.2802 => 0.3050, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.54% (3.3903 => 3.6119, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 6.41% (0.2122 => 0.2258, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 5.02% (12.0509 => 12.6563, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1699, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-2: 4.14% (1.8057 => 1.8804, std.dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/dry: 2.75% (14.0481 => 14.4344, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1939, std.dev.: 0.0208) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.63% (3.1722 => 3.2240, std.dev.: 0.0037) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3053, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2895, std.dev.: 0.0018) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 1.08% (50.0626 => 50.6043, std.dev.: 0.0097) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.07% (1.2451 => 1.2584, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.55% (2.4764 => 2.4380, std.dev.: 0.0085) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.51% (25.4195 => 16.3928, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/ary2: -8.99% (0.2402 => 0.2186, std.dev.: 0.0046) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9787, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7736, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: -7.30% (2.1113 => 1.9572, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2420, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.16% (11.2080 => 10.8536, std.dev.: 0.0420) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7735, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/mandel-2: -2.89% (3.6262 => 3.5215, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -2.79% (17.2379 => 16.7575, std.dev.: 0.0312) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.17% (41.7953 => 40.8870, std.dev.: 0.0127) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5703, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4971, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.33% (5.7935 => 5.7162, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.24% (105.3826 => 104.0798, std.dev.: 0.1387) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.09% (21.9346 => 21.6963, std.dev.: 0.0503) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0419, std.dev.: 0.0039) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.02% (3.3991 => 3.3644, std.dev.: 0.0006) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 21:13:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 26 Oct 2012 23:13:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121027041350.AF8232A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5277?compare_to=5273&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5277, Order: 166858, Start Time: 2012-10-27 02:48:43, End Time: 2012-10-27 04:13:45 To: 5273, Order: 166844, Start Time: 2012-10-27 01:00:39, End Time: 2012-10-27 02:25:48 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 2 (183 on baseline) Unchanged Tests: 1039 (853 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.46% (3.7637 => 3.8185, std.dev.: 0.0108) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.17% (2.0638 => 2.0396, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.54% (80.3700 => 78.3261, std.dev.: 0.4036) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 18.76% (15.2527 => 18.1136, std.dev.: 0.0125) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1013, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/salsa20: 2.39% (7.4937 => 7.6730, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash2: 2.21% (3.1932 => 3.2639, std.dev.: 0.0115) MultiSource/Benchmarks/llubenchmark/llu: 2.00% (3.7435 => 3.8185, std.dev.: 0.0108) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.01% (0.1431 => 0.1302, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.80% (0.3821 => 0.3523, std.dev.: 0.0033) MultiSource/Benchmarks/PAQ8p/paq8p: -7.57% (2.4924 => 2.3037, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.07% (0.3142 => 0.2920, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.04% (0.2428 => 0.2257, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.01% (22.4056 => 20.8346, std.dev.: 0.0062) MultiSource/Applications/sgefa/sgefa: -6.88% (0.3357 => 0.3126, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.85% (3.5339 => 3.2918, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.81% (0.3658 => 0.3409, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -6.81% (0.2160 => 0.2013, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: -6.62% (0.2659 => 0.2483, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.62% (0.6484 => 0.6055, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -6.57% (4.3330 => 4.0483, std.dev.: 0.0026) MultiSource/Applications/Burg/burg: -6.56% (1.2515 => 1.1694, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.55% (0.9852 => 0.9207, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.54% (1.6474 => 1.5396, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.54% (0.9542 => 0.8918, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.53% (0.1716 => 0.1604, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-4: -6.49% (0.3880 => 0.3628, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.45% (0.3831 => 0.3584, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -6.41% (2.4021 => 2.2481, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: -6.40% (0.3812 => 0.3568, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -6.39% (7.0961 => 6.6430, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.39% (0.3884 => 0.3636, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.38% (0.1584 => 0.1483, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -6.37% (0.3896 => 0.3648, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.36% (0.2548 => 0.2386, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -6.32% (16.1920 => 15.1683, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -6.32% (0.4321 => 0.4048, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.31% (0.7919 => 0.7419, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.31% (1.0544 => 0.9879, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.30% (0.1761 => 0.1650, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.30% (0.3891 => 0.3646, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.29% (0.1796 => 0.1683, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: -6.29% (0.3848 => 0.3606, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.27% (1.2784 => 1.1982, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.26% (5.4682 => 5.1257, std.dev.: 0.0033) MultiSource/Applications/lua/lua: -6.26% (4.0594 => 3.8053, std.dev.: 0.0089) MultiSource/Applications/hexxagon/hexxagon: -6.25% (1.3148 => 1.2326, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: -6.25% (0.4033 => 0.3781, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -6.24% (9.2283 => 8.6529, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.23% (0.3931 => 0.3686, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -6.23% (0.2985 => 0.2799, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.23% (2.2587 => 2.1180, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.22% (0.4151 => 0.3893, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.21% (1.4642 => 1.3732, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.20% (0.4176 => 0.3917, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.18% (0.3252 => 0.3051, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.17% (1.3722 => 1.2875, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.16% (0.3849 => 0.3612, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.15% (0.3837 => 0.3601, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -6.14% (0.4280 => 0.4017, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -6.14% (0.4199 => 0.3941, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -6.14% (0.3323 => 0.3119, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.13% (4.8161 => 4.5207, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/ReedSolomon: -6.12% (0.1879 => 0.1764, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.12% (4.8802 => 4.5817, std.dev.: 0.0077) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.11% (0.2355 => 0.2211, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: -6.11% (0.4861 => 0.4564, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/except: -6.08% (0.3026 => 0.2842, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.07% (0.4083 => 0.3835, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.07% (0.6293 => 0.5911, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.07% (2.1713 => 2.0396, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.06% (0.2903 => 0.2727, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -6.06% (0.2871 => 0.2697, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.02% (4.5069 => 4.2355, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/matrix: -6.02% (0.3255 => 0.3059, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/random: -5.99% (0.2939 => 0.2763, std.dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: -5.99% (18.2933 => 17.1982, std.dev.: 0.0203) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.99% (0.3057 => 0.2874, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -5.98% (0.3446 => 0.3240, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.96% (0.5857 => 0.5508, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.95% (0.5999 => 0.5642, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -5.95% (0.3481 => 0.3274, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.93% (0.6304 => 0.5930, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.93% (0.2933 => 0.2759, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.93% (0.3491 => 0.3284, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -5.92% (0.4524 => 0.4256, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: -5.92% (0.3394 => 0.3193, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -5.91% (0.6750 => 0.6351, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -5.90% (0.3205 => 0.3016, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -5.90% (0.2849 => 0.2681, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: -5.89% (0.3581 => 0.3370, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.89% (1.6364 => 1.5400, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -5.89% (34.0927 => 32.0847, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/methcall: -5.88% (0.3025 => 0.2847, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.87% (0.5925 => 0.5577, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.87% (1.2221 => 1.1504, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: -5.85% (0.2989 => 0.2814, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.84% (4.0323 => 3.7968, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.84% (0.2999 => 0.2824, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.83% (0.7198 => 0.6778, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.82% (0.5805 => 0.5467, std.dev.: 0.0054) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.82% (0.3319 => 0.3126, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.81% (0.8521 => 0.8026, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -5.81% (0.3788 => 0.3568, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.80% (0.5859 => 0.5519, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: -5.80% (0.3621 => 0.3411, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.80% (0.6297 => 0.5932, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.80% (0.5591 => 0.5267, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: -5.79% (1.1530 => 1.0862, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -5.79% (0.3867 => 0.3643, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.77% (0.3016 => 0.2842, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.76% (0.4427 => 0.4172, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.76% (1.2210 => 1.1507, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.73% (0.6736 => 0.6350, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: -5.72% (0.3059 => 0.2884, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.71% (0.2278 => 0.2148, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.70% (0.6230 => 0.5875, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.70% (0.2106 => 0.1986, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.70% (0.4916 => 0.4636, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.69% (0.6395 => 0.6031, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.69% (0.6681 => 0.6301, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -5.67% (0.3194 => 0.3013, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.67% (0.6194 => 0.5843, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.66% (0.5863 => 0.5531, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.66% (0.5705 => 0.5382, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: -5.65% (0.9179 => 0.8660, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.65% (0.6446 => 0.6082, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.64% (0.7339 => 0.6925, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.64% (0.6260 => 0.5907, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.63% (0.6395 => 0.6035, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.62% (0.6189 => 0.5841, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.62% (0.5478 => 0.5170, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.62% (0.6052 => 0.5712, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.61% (0.5581 => 0.5268, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.60% (0.6660 => 0.6287, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.60% (0.9557 => 0.9022, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.59% (0.5849 => 0.5522, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.59% (0.6440 => 0.6080, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: -5.59% (0.7447 => 0.7031, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.58% (0.5575 => 0.5264, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.57% (0.5802 => 0.5479, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -5.56% (0.7982 => 0.7538, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: -5.56% (0.4515 => 0.4264, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.55% (0.5569 => 0.5260, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -5.55% (1.1450 => 1.0815, std.dev.: 0.0131) MultiSource/Applications/SPASS/SPASS: -5.54% (15.5079 => 14.6481, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.53% (0.6667 => 0.6298, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.52% (0.6033 => 0.5700, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: -5.51% (0.4248 => 0.4014, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.50% (0.5168 => 0.4884, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.49% (0.2385 => 0.2254, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.49% (0.5941 => 0.5615, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.48% (0.5456 => 0.5157, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.48% (0.7524 => 0.7112, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.48% (0.5570 => 0.5265, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.45% (0.6676 => 0.6312, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.44% (0.7021 => 0.6639, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.39% (0.5567 => 0.5267, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.34% (0.4813 => 0.4556, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.33% (0.5329 => 0.5045, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -5.28% (0.3406 => 0.3226, std.dev.: 0.0039) MultiSource/Applications/d/make_dparser: -5.26% (3.5154 => 3.3305, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: -5.25% (0.6347 => 0.6014, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -5.14% (0.8418 => 0.7985, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: -5.14% (0.7779 => 0.7379, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/09-vor/vor: -5.14% (0.3271 => 0.3103, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.13% (0.5688 => 0.5396, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -5.13% (2.1401 => 2.0303, std.dev.: 0.0041) SingleSource/UnitTests/ObjC++/property-reference-object: -5.11% (0.6441 => 0.6112, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.06% (8.0126 => 7.6068, std.dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.05% (6.7716 => 6.4293, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.65% (0.3483 => 0.3321, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -4.62% (17.1032 => 16.3122, std.dev.: 0.0256) MultiSource/Benchmarks/Ptrdist/bc/bc: -4.61% (1.2300 => 1.1733, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.58% (0.9077 => 0.8661, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.39% (0.2277 => 0.2177, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.38% (0.2695 => 0.2577, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -4.31% (5.0226 => 4.8062, std.dev.: 0.0054) MultiSource/Applications/hbd/hbd: -4.12% (1.5610 => 1.4967, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.78% (14.2083 => 13.6716, std.dev.: 0.0047) MultiSource/Applications/SIBsim4/SIBsim4: -3.33% (1.3864 => 1.3402, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -3.28% (20.7746 => 20.0940, std.dev.: 0.0321) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7555, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: -8.66% (1.2842 => 1.1730, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7063, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.86% (2.2633 => 2.1760, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.38% (1.0557 => 1.0200, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.89% (1.3096 => 1.2718, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.74% (79.7170 => 78.3261, std.dev.: 0.4036) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4702, std.dev.: 0.0027) Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 22:00:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 00:00:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121027050024.556472A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5278?compare_to=5274&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5278, Order: 166858, Start Time: 2012-10-27 03:26:58, End Time: 2012-10-27 05:00:20 To: 5274, Order: 166852, Start Time: 2012-10-27 01:34:23, End Time: 2012-10-27 02:57:13 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (3 on baseline) New Passes: 72 (17 on baseline) Performance Regressions: 0 (197 on baseline) Performance Improvements: 0 (49 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 5 (2 on baseline) Unchanged Tests: 965 (640 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1618.57% (0.0490 => 0.8421, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1687.96% (0.0490 => 0.8761, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1559.39% (0.0458 => 0.7600, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1674.57% (0.0460 => 0.8163, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1442.73% (0.0447 => 0.6896, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1562.36% (0.0449 => 0.7464, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1366.82% (0.0440 => 0.6454, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1485.75% (0.0442 => 0.7009, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1493.26% (0.0460 => 0.7329, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1618.04% (0.0460 => 0.7903, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1505.96% (0.0453 => 0.7275, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1611.01% (0.0454 => 0.7768, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1451.81% (0.0442 => 0.6859, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1556.05% (0.0446 => 0.7386, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1433.04% (0.0451 => 0.6914, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1548.34% (0.0453 => 0.7467, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1558.23% (0.0462 => 0.7661, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1648.06% (0.0464 => 0.8111, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1375.85% (0.0439 => 0.6479, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1501.59% (0.0440 => 0.7047, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1458.22% (0.0450 => 0.7012, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1576.55% (0.0452 => 0.7578, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1378.05% (0.0442 => 0.6533, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1502.93% (0.0443 => 0.7101, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1333.41% (0.0434 => 0.6221, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1465.67% (0.0434 => 0.6795, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1338.43% (0.0432 => 0.6214, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1456.32% (0.0435 => 0.6770, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1492.34% (0.0470 => 0.7484, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1611.68% (0.0471 => 0.8062, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1309.98% (0.0431 => 0.6077, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1438.43% (0.0432 => 0.6646, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1341.20% (0.0432 => 0.6226, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1463.13% (0.0434 => 0.6784, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1399.32% (0.0441 => 0.6612, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1530.84% (0.0441 => 0.7192, std.dev.: 0.0005) New Passes - Execution Time --------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 5951200.00% (0.0001 => 5.9513, std.dev.: 0.0189) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4030000.00% (0.0001 => 4.0301, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 4198400.00% (0.0001 => 4.1985, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 3475100.00% (0.0001 => 3.4752, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 4106200.00% (0.0001 => 4.1063, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3236600.00% (0.0001 => 3.2367, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2753400.00% (0.0001 => 2.7535, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2114800.00% (0.0001 => 2.1149) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6636000.00% (0.0001 => 6.6361, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 3397700.00% (0.0001 => 3.3978, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 4441800.00% (0.0001 => 4.4419, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3052100.00% (0.0001 => 3.0522, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5129700.00% (0.0001 => 5.1298, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 4489700.00% (0.0001 => 4.4898, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5189500.00% (0.0001 => 5.1896, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 4163300.00% (0.0001 => 4.1634, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 5741400.00% (0.0001 => 5.7415, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4339500.00% (0.0001 => 4.3396, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5395900.00% (0.0001 => 5.3960, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 5428300.00% (0.0001 => 5.4284, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8308900.00% (0.0001 => 8.3090, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 4212200.00% (0.0001 => 4.2123, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8550000.00% (0.0001 => 8.5501, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 5531300.00% (0.0001 => 5.5314, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4194100.00% (0.0001 => 4.1942, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 4128500.00% (0.0001 => 4.1286, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 6661600.00% (0.0001 => 6.6617, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 6124700.00% (0.0001 => 6.1248, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 5415900.00% (0.0001 => 5.4160, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8695200.00% (0.0001 => 8.6953, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4890400.00% (0.0001 => 4.8905, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 4719300.00% (0.0001 => 4.7194, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 8739200.00% (0.0001 => 8.7393, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7650900.00% (0.0001 => 7.6510, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 4906300.00% (0.0001 => 4.9064, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3566400.00% (0.0001 => 3.5665, std.dev.: 0.0000) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: 0.14% (57.6400 => 57.7206, std.dev.: 0.0152) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset SingleSource/Benchmarks/BenchmarkGame/puzzle MultiSource/Applications/oggenc/oggenc: -0.07% (0.1405 => 0.1404, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0648 => 0.0648, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.15% (0.3350 => 0.3355, std.dev.: 0.0009) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -8.73% (63.2438 => 57.7206, std.dev.: 0.0152) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet SingleSource/Benchmarks/BenchmarkGame/puzzle MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.81% (0.6962 => 0.3355, std.dev.: 0.0009) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 208.17% (0.5229 => 1.6114, std.dev.: 0.0033) MultiSource/Applications/SPASS/SPASS: 15.95% (14.9895 => 17.3807, std.dev.: 0.0037) MultiSource/Applications/kimwitu++/kc: 36.78% (14.1553 => 19.3617, std.dev.: 0.0088) MultiSource/Benchmarks/MallocBench/gs/gs: 13.52% (4.1105 => 4.6664, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 35.35% (1.1048 => 1.4954, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 316.39% (7.1582 => 29.8058, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.48% (3.4629 => 5.7997, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: 67.12% (0.6222 => 1.0398, std.dev.: 0.0009) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 11792.92% (0.0720 => 8.5629, std.dev.: 0.0048) MultiSource/Applications/SIBsim4/SIBsim4: 4011500.00% (0.0001 => 4.0116, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 11143800.00% (0.0001 => 11.1439, std.dev.: 0.0293) MultiSource/Applications/kimwitu++/kc: 50600.00% (0.0001 => 0.0507, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 792500.00% (0.0001 => 0.7926, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049900.00% (0.0001 => 10.0500, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5491800.00% (0.0001 => 5.4919, std.dev.: 0.0233) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 69.14% (0.0256 => 0.0433, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 55.97% (0.0243 => 0.0379) SingleSource/Regression/C/sumarray2d: 53.87% (0.0271 => 0.0417, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 46.96% (0.0296 => 0.0435, std.dev.: 0.0003) SingleSource/Regression/C/sumarray: 43.72% (0.0231 => 0.0332, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 40.62% (0.1056 => 0.1485, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 37.67% (1.5859 => 2.1833, std.dev.: 0.0032) MultiSource/Benchmarks/PAQ8p/paq8p: 37.06% (10.3673 => 14.2099, std.dev.: 0.0068) SingleSource/UnitTests/vla: 33.52% (0.0355 => 0.0474) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.26% (2.2024 => 2.8688, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: 29.94% (0.1463 => 0.1901, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 28.56% (0.1432 => 0.1841, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 25.20% (0.1655 => 0.2072, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.71% (0.1566 => 0.1906, std.dev.: 0.0002) MultiSource/Benchmarks/llubenchmark/llu: 21.65% (0.0462 => 0.0562, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: 21.24% (0.0485 => 0.0588, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 20.54% (0.1144 => 0.1379, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 20.14% (0.0834 => 0.1002, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.40% (0.0871 => 0.1040, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 19.02% (0.4879 => 0.5807, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 18.90% (0.5105 => 0.6070, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 18.54% (10.4361 => 12.3712, std.dev.: 0.0127) SingleSource/Benchmarks/BenchmarkGame/n-body: 18.36% (0.0746 => 0.0883) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 17.85% (0.3177 => 0.3744, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 17.67% (0.0730 => 0.0859, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.62% (0.6675 => 0.7851, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: 17.62% (0.1175 => 0.1382, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.52% (1.3050 => 1.5336, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 17.31% (0.2554 => 0.2996, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 16.97% (3.3354 => 3.9014, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 16.77% (0.7115 => 0.8308, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 16.68% (0.1337 => 0.1560, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 16.61% (0.0626 => 0.0730, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 16.53% (0.1125 => 0.1311, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.52% (0.0793 => 0.0924, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 16.52% (0.1695 => 0.1975, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.51% (0.5020 => 0.5849, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/mst/mst: 16.34% (0.1163 => 0.1353, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.28% (0.8172 => 0.9502, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ks/ks: 16.16% (0.1510 => 0.1754, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.09% (0.1032 => 0.1198, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.87% (1.5415 => 1.7862, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 15.85% (0.2271 => 0.2631, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.84% (0.4615 => 0.5346, std.dev.: 0.0145) MultiSource/Applications/ClamAV/clamscan: 15.64% (22.1758 => 25.6446, std.dev.: 0.0278) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.58% (0.0886 => 0.1024, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.57% (0.3121 => 0.3607, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 15.47% (0.3109 => 0.3590, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.31% (0.1940 => 0.2237, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.27% (0.0838 => 0.0966) MultiSource/Applications/aha/aha: 15.20% (0.1151 => 0.1326, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.20% (0.0842 => 0.0970, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 15.10% (0.2603 => 0.2996, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/17-bintr/bintr: 14.96% (0.0675 => 0.0776) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.96% (0.1584 => 0.1821, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.70% (0.6450 => 0.7398, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 14.62% (0.0814 => 0.0933, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 14.60% (0.1555 => 0.1782, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.52% (0.9765 => 1.1183, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.50% (0.1117 => 0.1279, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 14.49% (0.3423 => 0.3919, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 14.37% (1.1642 => 1.3315, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.36% (0.2758 => 0.3154, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.33% (0.2107 => 0.2409, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.30% (0.2700 => 0.3086, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.26% (4.2646 => 4.8729, std.dev.: 0.0025) MultiSource/Benchmarks/NPB-serial/is/is: 14.19% (0.0719 => 0.0821, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 14.16% (1.0722 => 1.2240, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.16% (0.0770 => 0.0879, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 14.04% (0.7835 => 0.8935, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 14.03% (9.4845 => 10.8152, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.00% (0.2065 => 0.2354, std.dev.: 0.0016) MultiSource/Applications/treecc/treecc: 13.97% (2.0273 => 2.3105, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.94% (0.1062 => 0.1210, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 13.92% (1.1861 => 1.3512, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.88% (0.5981 => 0.6811, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.87% (8.1363 => 9.2646, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/football/football: 13.79% (0.8921 => 1.0151, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 13.70% (0.0730 => 0.0830, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.69% (0.5860 => 0.6662, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 13.59% (0.7433 => 0.8443, std.dev.: 0.0155) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.57% (0.1695 => 0.1925, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.53% (0.0798 => 0.0906, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 13.46% (0.3180 => 0.3608, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 13.41% (1.1840 => 1.3428, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.41% (0.1029 => 0.1167, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.40% (0.0933 => 0.1058) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.39% (1.4186 => 1.6085, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.25% (0.0770 => 0.0872, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 13.00% (0.4299 => 0.4858, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.95% (0.1892 => 0.2137, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.92% (0.0929 => 0.1049) MultiSource/Applications/lua/lua: 12.91% (3.8723 => 4.3721, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.86% (0.1236 => 0.1395, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.85% (0.3307 => 0.3732, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.78% (0.1330 => 0.1500, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.68% (0.1625 => 0.1831, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 12.67% (0.3387 => 0.3816, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.66% (0.5569 => 0.6274, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/health/health: 12.62% (0.1268 => 0.1428, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.60% (0.1143 => 0.1287, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.47% (0.8067 => 0.9073, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 12.45% (4.9449 => 5.5607, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.43% (5.0018 => 5.6235, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.23% (0.3441 => 0.3862, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.86% (0.1906 => 0.2132, std.dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 11.70% (5.7591 => 6.4331, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/hash: 11.59% (0.4289 => 0.4786, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.57% (0.8101 => 0.9038, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.52% (0.2266 => 0.2527, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash2: 11.30% (0.4620 => 0.5142, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.09% (0.3543 => 0.3936, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 10.86% (0.6456 => 0.7157, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 10.81% (0.0953 => 0.1056, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 10.79% (2.2969 => 2.5447, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.74% (2.2022 => 2.4388, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/bh/bh: 10.74% (0.3092 => 0.3424, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.60% (14.3668 => 15.8894, std.dev.: 0.0090) SingleSource/UnitTests/ObjC/parameter-passing: 10.52% (0.3927 => 0.4340, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.42% (0.3473 => 0.3835, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.34% (0.3828 => 0.4224, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.32% (0.3497 => 0.3858, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.30% (0.3543 => 0.3908, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.22% (0.4636 => 0.5110, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 10.22% (0.3561 => 0.3925, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.21% (0.3516 => 0.3875, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.15% (0.3694 => 0.4069, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.14% (0.3865 => 0.4257, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/lists: 10.11% (0.3422 => 0.3768, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.09% (0.4103 => 0.4517, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.06% (0.4203 => 0.4626, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 9.99% (21.9371 => 24.1285, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 9.96% (0.1044 => 0.1148, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.93% (0.3886 => 0.4272, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 9.86% (17.1811 => 18.8747, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.80% (0.3826 => 0.4201, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 9.76% (0.4048 => 0.4443, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 9.64% (0.3684 => 0.4039, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.63% (0.3427 => 0.3757, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 9.63% (1.5603 => 1.7105, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: 9.24% (0.3603 => 0.3936, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 9.18% (0.2049 => 0.2237, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 9.15% (0.5925 => 0.6467, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.09% (0.6030 => 0.6578, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.01% (0.2430 => 0.2649, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.70% (0.3162 => 0.3437, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 8.52% (0.1268 => 0.1376, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.37% (0.7326 => 0.7939, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.37% (0.4064 => 0.4404, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.22% (0.3650 => 0.3950, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 8.17% (0.3098 => 0.3351, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.15% (0.2872 => 0.3106, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 8.09% (0.2831 => 0.3060, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.02% (0.2891 => 0.3123, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.98% (0.3283 => 0.3545, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.96% (3.8922 => 4.2021, std.dev.: 0.0017) SingleSource/Regression/C++/ofstream_ctor: 7.95% (0.2905 => 0.3136, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.94% (0.2871 => 0.3099, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.83% (0.3232 => 0.3485, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.76% (2.0665 => 2.2268, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.73% (0.2756 => 0.2969, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.70% (0.2793 => 0.3008, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 7.61% (0.2877 => 0.3096, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 7.60% (0.3052 => 0.3284, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.53% (7.9617 => 8.5611, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/fibo: 7.52% (0.2725 => 0.2930, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 7.48% (0.2714 => 0.2917, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 7.24% (0.2802 => 0.3005, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 7.04% (0.3379 => 0.3617, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 7.04% (0.3282 => 0.3513, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 6.88% (1.2842 => 1.3726, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.27% (7.0540 => 7.4966, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.03% (0.3136 => 0.3325, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.53% (0.3131 => 0.3304, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.07% (0.3935 => 0.4095, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.80% (0.3817 => 0.3924, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: 24.73% (3.3453 => 4.1727, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 14.15% (0.9957 => 1.1366, std.dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 14.09% (2.6778 => 3.0552, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.99% (1.1396 => 1.2535, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.1578 => 3.3688, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.63% (2.8904 => 3.0819, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.53% (4.2280 => 4.3349, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0313 => 1.0563, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 2.18% (11.6436 => 11.8978, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.12% (3.6395 => 3.7167, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bisort/bisort: 1.79% (0.8333 => 0.8482, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2075, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.33% (2.6546 => 2.6898, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/bh/bh: 1.09% (1.9405 => 1.9617, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.94% (6.6874 => 0.1376, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -76.70% (0.8651 => 0.2016, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -45.38% (0.1622 => 0.0886, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.52% (5.2763 => 3.2964, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -35.76% (5.3855 => 3.4597, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -35.36% (5.3526 => 3.4599, std.dev.: 0.0064) SingleSource/UnitTests/Vector/constpool: -8.71% (54.1659 => 49.4499, std.dev.: 0.0226) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.26% (1.7609 => 1.6682, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.65% (2.9384 => 2.8019, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -4.43% (1.1194 => 1.0698, std.dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -52.85% (8.0499 => 3.7953, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) SingleSource/Benchmarks/Misc/dt: -46.59% (2.0460 => 1.0927, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7652, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: -15.86% (1.6925 => 1.4240, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -14.36% (2.9695 => 2.5432, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -11.66% (1.2373 => 1.0930, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -11.09% (1.5373 => 1.3668, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -10.68% (1.2258 => 1.0949, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.26% (19.9488 => 18.3006, std.dev.: 0.0845) MultiSource/Benchmarks/FreeBench/mason/mason: -7.77% (0.2161 => 0.1993, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.00% (1.8329 => 1.7046, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8478, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -5.46% (6.6465 => 6.2838, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -4.92% (1.6805 => 1.5979, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.88% (1.5835 => 1.5062, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Applications/siod/siod: -3.64% (3.2827 => 3.1631, std.dev.: 0.0080) MultiSource/Benchmarks/sim/sim: -3.33% (5.0483 => 4.8802, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.10% (32.5116 => 31.5024, std.dev.: 0.0059) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.89% (0.4808 => 0.4669, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.18% (8.1563 => 7.9783, std.dev.: 0.0163) MultiSource/Applications/sqlite3/sqlite3: -2.15% (4.6441 => 4.5442, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.90% (10.2830 => 10.0881, std.dev.: 0.0166) SingleSource/UnitTests/Vector/multiplies: -1.75% (2.5528 => 2.5081, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6804, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: -1.65% (1.1277 => 1.1091, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -1.49% (9.5636 => 9.4215, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.18% (1.7254 => 1.7051, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.10% (6.2999 => 6.2306, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -5.45% (0.1485 => 0.1404, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0000) Report Time: 2.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 22:18:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 00:18:28 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121027051828.375022A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5279?compare_to=5275&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5279, Order: 166863, Start Time: 2012-10-27 03:53:49, End Time: 2012-10-27 05:18:25 To: 5275, Order: 166855, Start Time: 2012-10-27 02:12:58, End Time: 2012-10-27 03:36:54 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 4 (50 on baseline) Performance Improvements: 9 (5 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 962 (919 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.80% (0.2938 => 0.3079, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 2.02% (1.2477 => 1.2729, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.97% (45.3725 => 46.2642, std.dev.: 0.3378) SingleSource/Benchmarks/Misc/richards_benchmark: 1.02% (1.3142 => 1.3276, std.dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.91% (0.2736 => 0.2629, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.75% (0.3388 => 0.3261, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -2.63% (1.2929 => 1.2589, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.87% (4.6864 => 4.5987, std.dev.: 0.0319) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.87% (0.9202 => 0.9030, std.dev.: 0.0038) MultiSource/Applications/lua/lua: -1.63% (3.9403 => 3.8762, std.dev.: 0.0238) MultiSource/Applications/hbd/hbd: -1.22% (1.4959 => 1.4777, std.dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.56% (7.0946 => 6.9128, std.dev.: 0.0579) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -1.17% (6.4993 => 6.4233, std.dev.: 0.0232) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.11% (16.6183 => 16.5993, std.dev.: 0.0831) MultiSource/Applications/obsequi/Obsequi: -1.11% (1.0677 => 1.0559, std.dev.: 0.0074) MultiSource/Applications/sqlite3/sqlite3: -0.28% (0.6451 => 0.6433, std.dev.: 0.0066) MultiSource/Benchmarks/McCat/08-main/main: -3.44% (0.1977 => 0.1909, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.36% (0.1673 => 0.1679, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.22% (0.3255 => 0.3262, std.dev.: 0.0097) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.72% (0.2504 => 0.2461, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.95% (0.3326 => 0.3424, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.72% (0.2376 => 0.2393, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 0.51% (0.6037 => 0.6068, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel: -5.88% (0.0459 => 0.0432, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.57% (0.3321 => 0.3340, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: -0.10% (0.2010 => 0.2008, std.dev.: 0.0008) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -14.44% (0.0270 => 0.0231, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -9.59% (0.0219 => 0.0198, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.70% (0.0427 => 0.0424, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 2.46% (0.0325 => 0.0333, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -11.75% (0.0315 => 0.0278, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.24% (0.0403 => 0.0398, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0204 => 0.0203, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0162 => 0.0162, std.dev.: 0.0027) SingleSource/UnitTests/byval-alignment: -20.44% (0.0362 => 0.0288, std.dev.: 0.0034) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.13% (0.1483 => 0.1485, std.dev.: 0.0045) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.49% (1.1305 => 1.1360, std.dev.: 0.0216) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.53% (0.1503 => 0.1480, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.92% (0.4120 => 0.4041, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.78% (0.1350 => 0.1326, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.00% (0.0600 => 0.0588, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -15.23% (0.0256 => 0.0217, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.67% (0.0585 => 0.0546, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.10% (1.1438 => 1.1427, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -54.84% (0.0031 => 0.0014, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -15.10% (0.0629 => 0.0534, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -21.72% (0.0267 => 0.0209, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.10% (0.8018 => 0.8010, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 100.00% (0.0001 => 0.0002, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -12.86% (0.0070 => 0.0061, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.33% (2.1832 => 1.6738, std.dev.: 0.0076) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 34.47% (14.7684 => 19.8592, std.dev.: 0.1610) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 12.96% (0.0810 => 0.0915, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/tsp/tsp: 11.24% (0.1112 => 0.1237, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.39% (0.2180 => 0.2341, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 6.34% (1.2568 => 1.3365, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.18% (0.2279 => 0.2397, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.04% (0.6010 => 0.6313, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.86% (0.7473 => 0.7836, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.69% (0.2133 => 0.2233, std.dev.: 0.0033) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.61% (6.6074 => 6.9119, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.57% (1.1170 => 1.1681, std.dev.: 0.0093) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.37% (0.2519 => 0.2629, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.28% (13.1811 => 13.7453, std.dev.: 0.0292) MultiSource/Applications/spiff/spiff: 4.04% (0.7950 => 0.8271, std.dev.: 0.0084) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.95% (0.3137 => 0.3261, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.77% (0.3717 => 0.3857, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.72% (0.2741 => 0.2843, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 3.56% (1.4269 => 1.4777, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.18% (1.4479 => 1.4940, std.dev.: 0.0109) MultiSource/Applications/Burg/burg: 3.17% (1.2222 => 1.2609, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.13% (0.4127 => 0.4256, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: 3.08% (0.9810 => 1.0112, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.07% (0.3295 => 0.3396, std.dev.: 0.0027) MultiSource/Applications/treecc/treecc: 3.06% (1.9948 => 2.0558, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/gs/gs: 2.83% (4.1305 => 4.2473, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.77% (1.1685 => 1.2009, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.67% (1.6386 => 1.6824, std.dev.: 0.0053) MultiSource/Applications/SPASS/SPASS: 2.26% (14.2605 => 14.5829, std.dev.: 0.1241) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.17% (4.1763 => 4.2670, std.dev.: 0.0154) MultiSource/Applications/d/make_dparser: 2.13% (3.2366 => 3.3054, std.dev.: 0.0210) MultiSource/Applications/minisat/minisat: 2.12% (0.6834 => 0.6979, std.dev.: 0.0025) MultiSource/Applications/lemon/lemon: 2.11% (1.0945 => 1.1176, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.93% (0.5191 => 0.5291, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.71% (0.8069 => 0.8207, std.dev.: 0.0047) MultiSource/Applications/JM/lencod/lencod: 1.62% (15.3280 => 15.5769, std.dev.: 0.0685) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.60% (4.4873 => 4.5593, std.dev.: 0.0154) MultiSource/Benchmarks/nbench/nbench: 1.38% (1.1271 => 1.1427, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.31% (0.8420 => 0.8530, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 57.04% (1.5795 => 2.4804, std.dev.: 0.0143) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.45% (0.3186 => 0.3487, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.50% (1.1857 => 1.2865, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 5.93% (63.1822 => 66.9261, std.dev.: 0.0577) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 5.16% (2.2485 => 2.3645, std.dev.: 0.0413) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 3.82% (44.5605 => 46.2642, std.dev.: 0.3378) MultiSource/Applications/siod/siod: 2.62% (3.6643 => 3.7602, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/ReedSolomon: 2.57% (8.5322 => 8.7513, std.dev.: 0.0374) MultiSource/Benchmarks/Olden/bh/bh: 1.89% (2.3560 => 2.4006, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/richards_benchmark: 1.83% (1.3037 => 1.3276, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.64% (4.8362 => 4.9157, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.35% (1.5941 => 1.6156, std.dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -5.12% (29.8330 => 28.3069, std.dev.: 0.0392) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.16% (7.2130 => 6.9128, std.dev.: 0.0579) MultiSource/Benchmarks/Ptrdist/ft/ft: -1.88% (0.8789 => 0.8624, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash2: -1.44% (3.4237 => 3.3744, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.26% (3.3479 => 3.3057, std.dev.: 0.0015) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.93% (16.4461 => 16.5993, std.dev.: 0.0831) MultiSource/Applications/obsequi/Obsequi: 2.89% (1.0262 => 1.0559, std.dev.: 0.0074) MultiSource/Applications/sqlite3/sqlite3: 1.60% (0.6332 => 0.6433, std.dev.: 0.0066) MultiSource/Benchmarks/McCat/08-main/main: 4.26% (0.1831 => 0.1909, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.70% (0.1559 => 0.1679, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.45% (0.3123 => 0.3262, std.dev.: 0.0097) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.08% (0.2463 => 0.2461, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.39% (0.3344 => 0.3424, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.23% (0.2364 => 0.2393, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 0.97% (0.6010 => 0.6068, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel: 0.70% (0.0429 => 0.0432, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.27% (0.3266 => 0.3340, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 1.98% (0.1969 => 0.2008, std.dev.: 0.0008) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 3.12% (0.0224 => 0.0231, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 60.98% (0.0123 => 0.0198, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.92% (0.0408 => 0.0424, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -7.95% (0.0302 => 0.0278, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 3.65% (0.0384 => 0.0398, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -10.00% (0.0180 => 0.0162, std.dev.: 0.0027) SingleSource/UnitTests/byval-alignment: 25.22% (0.0230 => 0.0288, std.dev.: 0.0034) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 3.27% (0.1438 => 0.1485, std.dev.: 0.0045) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.27% (1.1329 => 1.1360, std.dev.: 0.0216) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.23% (0.1462 => 0.1480, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.95% (0.4164 => 0.4041, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.14% (0.1369 => 0.1326, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.27% (0.0641 => 0.0588, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 11.28% (0.0195 => 0.0217, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.54% (0.0578 => 0.0546, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.09% (1.1437 => 1.1427, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1300.00% (0.0001 => 0.0014, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.83% (0.0627 => 0.0534, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 16.11% (0.0180 => 0.0209, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.09% (0.8017 => 0.8010, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 100.00% (0.0001 => 0.0002, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -1.61% (0.0062 => 0.0061, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 23:01:42 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 01:01:42 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121027060142.631CA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5280?compare_to=5277&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5280, Order: 166863, Start Time: 2012-10-27 04:36:41, End Time: 2012-10-27 06:01:38 To: 5277, Order: 166858, Start Time: 2012-10-27 02:48:43, End Time: 2012-10-27 04:13:45 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (182 on baseline) Unchanged Tests: 1042 (855 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 18.75% (15.2527 => 18.1133, std.dev.: 0.0218) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.67% (2.0478 => 2.1025, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/salsa20: 2.44% (7.4937 => 7.6763, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/hash2: 2.14% (3.1932 => 3.2615, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.08% (0.1431 => 0.1301, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.75% (0.3821 => 0.3525, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -7.57% (2.4924 => 2.3038, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -7.29% (0.3880 => 0.3597, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -7.26% (0.3831 => 0.3553, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -7.24% (0.3812 => 0.3536, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.21% (22.4056 => 20.7900, std.dev.: 0.0171) SingleSource/UnitTests/ObjC/exceptions-3: -7.20% (0.3848 => 0.3571, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -7.19% (0.3896 => 0.3616, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.17% (0.2428 => 0.2254, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -7.12% (0.4033 => 0.3746, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.10% (0.3142 => 0.2919, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -7.09% (0.4176 => 0.3880, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.04% (0.3891 => 0.3617, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -7.00% (0.4199 => 0.3905, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.98% (0.3884 => 0.3613, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.92% (0.3658 => 0.3405, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.90% (3.5339 => 3.2899, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: -6.88% (0.2659 => 0.2476, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -6.88% (0.3357 => 0.3126, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -6.87% (0.4280 => 0.3986, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -6.82% (1.2515 => 1.1661, std.dev.: 0.0024) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.76% (0.1716 => 0.1600, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.75% (0.4151 => 0.3871, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -6.71% (4.3330 => 4.0421, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/oourafft: -6.71% (0.2160 => 0.2015, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.68% (0.6484 => 0.6051, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.65% (1.6474 => 1.5378, std.dev.: 0.0082) SingleSource/Benchmarks/McGill/chomp: -6.64% (0.1761 => 0.1644, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -6.63% (0.2985 => 0.2787, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.58% (0.7919 => 0.7398, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -6.57% (0.4321 => 0.4037, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.56% (0.9542 => 0.8916, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.56% (0.9852 => 0.9206, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.55% (1.0544 => 0.9853, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -6.52% (2.4021 => 2.2456, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.50% (0.1584 => 0.1481, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.49% (0.3252 => 0.3041, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -6.48% (1.3148 => 1.2296, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.46% (0.3931 => 0.3677, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.44% (5.4682 => 5.1158, std.dev.: 0.0151) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.44% (0.2548 => 0.2384, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -6.42% (7.0961 => 6.6405, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.42% (0.3849 => 0.3602, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.41% (0.3057 => 0.2861, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -6.41% (0.2871 => 0.2687, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.40% (0.1796 => 0.1681, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -6.40% (16.1920 => 15.1556, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/hash2: -6.40% (0.4861 => 0.4550, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.39% (0.4083 => 0.3822, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.39% (0.3837 => 0.3592, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.37% (0.2355 => 0.2205, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.36% (2.1713 => 2.0332, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.35% (4.8161 => 4.5104, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.34% (0.2903 => 0.2719, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.34% (1.2784 => 1.1974, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -6.33% (4.0594 => 3.8026, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: -6.30% (9.2283 => 8.6465, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.28% (4.8802 => 4.5735, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.28% (1.4642 => 1.3723, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.26% (0.6293 => 0.5899, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.26% (1.3722 => 1.2863, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.24% (2.2587 => 2.1177, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -6.24% (0.2933 => 0.2750, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -6.23% (0.3481 => 0.3264, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -6.23% (0.3323 => 0.3116, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -6.23% (0.2939 => 0.2756, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.22% (4.5069 => 4.2267, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/except: -6.21% (0.3026 => 0.2838, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -6.21% (0.3255 => 0.3053, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -6.19% (0.2989 => 0.2804, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.18% (0.3025 => 0.2838, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -6.18% (34.0927 => 31.9858, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/hello: -6.18% (0.2849 => 0.2673, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -6.17% (0.1879 => 0.1763, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -6.16% (0.3394 => 0.3185, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/wc: -6.15% (0.3205 => 0.3008, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -6.13% (0.3621 => 0.3399, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -6.12% (0.6750 => 0.6337, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.11% (1.6364 => 1.5364, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -6.08% (0.4524 => 0.4249, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: -6.07% (0.3194 => 0.3000, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -6.07% (0.3446 => 0.3237, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.05% (0.5999 => 0.5636, std.dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: -6.05% (0.3059 => 0.2874, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.04% (4.0323 => 3.7889, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/heapsort: -6.03% (0.3016 => 0.2834, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: -6.00% (0.4248 => 0.3993, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: -6.00% (0.3867 => 0.3635, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -5.99% (0.3788 => 0.3561, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -5.99% (18.2933 => 17.1984, std.dev.: 0.0139) MultiSource/Benchmarks/McCat/18-imp/imp: -5.98% (0.3581 => 0.3367, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.97% (0.2999 => 0.2820, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.96% (0.4427 => 0.4163, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.94% (0.8521 => 0.8015, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.93% (1.2221 => 1.1496, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.93% (0.3491 => 0.3284, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.92% (0.5925 => 0.5574, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.92% (1.2210 => 1.1487, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.91% (0.5857 => 0.5511, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.90% (0.6304 => 0.5932, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: -5.90% (0.7779 => 0.7320, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.88% (0.2278 => 0.2144, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.88% (0.6297 => 0.5927, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.86% (0.6736 => 0.6341, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.85% (0.6395 => 0.6021, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.84% (0.2106 => 0.1983, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.83% (0.9557 => 0.9000, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.83% (0.5802 => 0.5464, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: -5.82% (1.1530 => 1.0859, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.81% (0.5805 => 0.5468, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.80% (0.6052 => 0.5701, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.80% (0.4916 => 0.4631, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.77% (0.5478 => 0.5162, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.76% (0.6681 => 0.6296, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.76% (0.5591 => 0.5269, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.75% (0.5859 => 0.5522, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.73% (0.5705 => 0.5378, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.72% (0.3319 => 0.3129, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: -5.71% (0.4515 => 0.4257, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.71% (0.5863 => 0.5528, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.71% (0.6446 => 0.6078, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: -5.69% (0.7447 => 0.7023, std.dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.69% (0.4813 => 0.4539, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.68% (0.7339 => 0.6922, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -5.68% (0.7982 => 0.7529, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.66% (0.2385 => 0.2250, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -5.66% (0.6347 => 0.5988, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.65% (0.5575 => 0.5260, std.dev.: 0.0070) MultiSource/Applications/SPASS/SPASS: -5.65% (15.5079 => 14.6319, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.65% (0.6660 => 0.6284, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/football/football: -5.64% (0.9179 => 0.8661, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.62% (0.5849 => 0.5520, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.62% (0.7524 => 0.7101, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.61% (0.5168 => 0.4878, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.61% (0.5581 => 0.5268, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.59% (0.5941 => 0.5609, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.59% (0.6230 => 0.5882, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -5.57% (0.6441 => 0.6082, std.dev.: 0.0028) MultiSource/Applications/lemon/lemon: -5.57% (1.1450 => 1.0812, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.57% (0.7021 => 0.6630, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.54% (0.7198 => 0.6799, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.53% (0.5569 => 0.5261, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.52% (0.6194 => 0.5852, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.52% (0.6395 => 0.6042, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.52% (0.6033 => 0.5700, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.49% (0.5570 => 0.5264, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.49% (0.6189 => 0.5849, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.48% (0.6676 => 0.6310, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.46% (0.5456 => 0.5158, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.39% (0.6440 => 0.6093, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.37% (0.6667 => 0.6309, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.35% (0.5567 => 0.5269, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.33% (0.5329 => 0.5045, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: -5.32% (0.3271 => 0.3097, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -5.31% (0.3406 => 0.3225, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: -5.28% (3.5154 => 3.3299, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.26% (0.5688 => 0.5389, std.dev.: 0.0033) MultiSource/Applications/spiff/spiff: -5.25% (0.8418 => 0.7976, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.25% (6.7716 => 6.4161, std.dev.: 0.0088) MultiSource/Applications/treecc/treecc: -5.24% (2.1401 => 2.0280, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.18% (8.0126 => 7.5976, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.10% (0.2001 => 0.1899, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.92% (0.9077 => 0.8630, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.82% (0.3483 => 0.3315, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -4.72% (1.2300 => 1.1720, std.dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: -4.65% (17.1032 => 16.3083, std.dev.: 0.0263) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.61% (0.2277 => 0.2172, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -4.42% (1.5610 => 1.4920, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -4.42% (5.0226 => 4.8006, std.dev.: 0.0196) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.38% (0.2695 => 0.2577, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.85% (14.2083 => 13.6606, std.dev.: 0.0057) MultiSource/Applications/SIBsim4/SIBsim4: -3.42% (1.3864 => 1.3390, std.dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -3.24% (20.7746 => 20.1005, std.dev.: 0.0484) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7537, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/richards_benchmark: -8.69% (1.2842 => 1.1726, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7062, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.78% (2.2633 => 2.1778, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.52% (6.5735 => 6.4738, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Oct 26 23:58:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 01:58:45 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121027065845.226EA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5281?compare_to=5279&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5281, Order: 166866, Start Time: 2012-10-27 05:35:04, End Time: 2012-10-27 06:58:42 To: 5279, Order: 166863, Start Time: 2012-10-27 03:53:49, End Time: 2012-10-27 05:18:25 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 10 (82 on baseline) Performance Improvements: 1 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 964 (888 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.73% (0.8150 => 0.8291, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.57% (1.2654 => 1.2853, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.55% (1.3464 => 1.3673, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 6.28% (3.0462 => 3.2376, std.dev.: 0.0510) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.97% (2.3645 => 2.4820, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.39% (6.9128 => 7.0782, std.dev.: 0.0353) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.87% (41.0026 => 41.7702, std.dev.: 0.1103) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.79% (60.0974 => 61.1761, std.dev.: 0.1438) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.46% (0.8624 => 0.8750, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.04% (5.8186 => 5.8794, std.dev.: 0.0152) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -1.37% (1.0112 => 0.9973, std.dev.: 0.0042) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.05% (16.5993 => 16.6073, std.dev.: 0.0382) MultiSource/Applications/obsequi/Obsequi: -0.10% (1.0559 => 1.0548, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: -1.20% (0.6433 => 0.6356, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/08-main/main: 1.52% (0.1909 => 0.1938, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.08% (0.1679 => 0.1644, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.39% (0.3262 => 0.3184, std.dev.: 0.0071) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.98% (0.2461 => 0.2437, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.28% (0.3424 => 0.3346, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.88% (0.2393 => 0.2372, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/bigfib: -0.97% (0.6068 => 0.6009, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/mandel: 15.05% (0.0432 => 0.0497, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.03% (0.3340 => 0.3339, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: -0.35% (0.2008 => 0.2001, std.dev.: 0.0011) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.87% (0.0231 => 0.0229, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -27.27% (0.0198 => 0.0144, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0424 => 0.0424, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -27.03% (0.0333 => 0.0243, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 12.23% (0.0278 => 0.0312, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -14.57% (0.0398 => 0.0340, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/casts: -32.51% (0.0203 => 0.0137, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/test1: 29.01% (0.0162 => 0.0209, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: 17.36% (0.0288 => 0.0338, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.94% (0.1485 => 0.1471, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.14% (1.1360 => 1.1230, std.dev.: 0.0325) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: -1.01% (0.1480 => 0.1465, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.08% (0.4041 => 0.4125, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.83% (0.1326 => 0.1315, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.70% (0.0588 => 0.0598, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 27.19% (0.0217 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.30% (0.0546 => 0.0528, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.14% (1.1427 => 1.1411, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.15% (0.0026 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.75% (0.0534 => 0.0538, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.75% (0.0209 => 0.0174, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.17% (0.8010 => 0.8024, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: -50.00% (0.0002 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -22.95% (0.0061 => 0.0047, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.83% (2.1832 => 1.6630, std.dev.: 0.0056) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 35.20% (14.7684 => 19.9666, std.dev.: 0.0691) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.32% (0.0810 => 0.0926, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: 10.34% (0.1112 => 0.1227, std.dev.: 0.0032) SingleSource/UnitTests/SignlessTypes/rem: 10.14% (0.1035 => 0.1140, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.60% (0.2180 => 0.2302, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.57% (0.2279 => 0.2406, std.dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: 5.49% (1.2568 => 1.3258, std.dev.: 0.0164) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.35% (0.1983 => 0.2089, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.25% (0.2741 => 0.2885, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.05% (13.1811 => 13.8468, std.dev.: 0.0938) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.94% (0.8321 => 0.8732, std.dev.: 0.0097) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.59% (0.3137 => 0.3281, std.dev.: 0.0034) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.52% (6.6074 => 6.9059, std.dev.: 0.0388) MultiSource/Applications/spiff/spiff: 4.35% (0.7950 => 0.8296, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.25% (0.8148 => 0.8494, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.22% (0.7473 => 0.7788, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.17% (0.4127 => 0.4299, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.88% (1.4479 => 1.5041, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.84% (1.1170 => 1.1599, std.dev.: 0.0110) MultiSource/Applications/Burg/burg: 3.26% (1.2222 => 1.2621, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.26% (0.3717 => 0.3838, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 3.05% (1.4269 => 1.4704, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.99% (0.8050 => 0.8291, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.97% (1.3279 => 1.3673, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.94% (0.6287 => 0.6472, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.77% (4.1763 => 4.2918, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.64% (8.6476 => 8.8755, std.dev.: 0.0643) MultiSource/Applications/lua/lua: 2.63% (3.8189 => 3.9194, std.dev.: 0.0216) MultiSource/Applications/lemon/lemon: 2.50% (1.0945 => 1.1219, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.50% (0.5961 => 0.6110, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.49% (0.8069 => 0.8270, std.dev.: 0.0050) MultiSource/Applications/SPASS/SPASS: 2.42% (14.2605 => 14.6052, std.dev.: 0.0491) MultiSource/Applications/JM/ldecod/ldecod: 2.41% (6.7320 => 6.8942, std.dev.: 0.0182) MultiSource/Applications/minisat/minisat: 2.31% (0.6834 => 0.6992, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 2.27% (0.8768 => 0.8967, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.16% (0.9435 => 0.9639, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.11% (0.8007 => 0.8176, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.11% (1.6386 => 1.6731, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.04% (0.5191 => 0.5297, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.03% (0.8340 => 0.8509, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.99% (1.2602 => 1.2853, std.dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 1.99% (1.1271 => 1.1495, std.dev.: 0.0060) MultiSource/Applications/JM/lencod/lencod: 1.95% (15.3280 => 15.6276, std.dev.: 0.0793) MultiSource/Applications/d/make_dparser: 1.95% (3.2366 => 3.2997, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.91% (0.9074 => 0.9247, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.89% (0.8611 => 0.8774, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.77% (0.8805 => 0.8961, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.77% (0.6227 => 0.6337, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.69% (0.8656 => 0.8802, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.68% (0.8697 => 0.8843, std.dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: 1.66% (0.9810 => 0.9973, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.64% (0.6586 => 0.6694, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.63% (0.8597 => 0.8737, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.63% (0.8359 => 0.8495, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.55% (4.5702 => 4.6410, std.dev.: 0.0263) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.49% (0.8716 => 0.8846, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.45% (4.4880 => 4.5533, std.dev.: 0.0250) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.45% (0.8331 => 0.8452, std.dev.: 0.0033) MultiSource/Benchmarks/Bullet/bullet: 1.45% (31.8598 => 32.3212, std.dev.: 0.1007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.44% (0.8261 => 0.8380, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.39% (0.8317 => 0.8433, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.37% (0.8927 => 0.9049, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.37% (0.8420 => 0.8535, std.dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: 1.32% (0.7557 => 0.7657, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.31% (1.2423 => 1.2586, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.28% (0.8177 => 0.8282, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.28% (3.1832 => 3.2239, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.15% (0.8885 => 0.8987, std.dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 1.08% (4.9628 => 5.0163, std.dev.: 0.0137) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.25% (1.5795 => 2.4996, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 10.38% (2.2485 => 2.4820, std.dev.: 0.0186) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.73% (0.3186 => 0.3496, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.48% (1.1857 => 1.2862, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 5.96% (63.1822 => 66.9455, std.dev.: 0.2609) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.23% (59.2638 => 61.1761, std.dev.: 0.1438) SingleSource/Benchmarks/Misc/ReedSolomon: 2.96% (8.5322 => 8.7846, std.dev.: 0.0199) MultiSource/Applications/siod/siod: 2.48% (3.6643 => 3.7553, std.dev.: 0.0063) SingleSource/Benchmarks/Dhrystone/dry: 2.24% (0.5081 => 0.5195, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: 1.61% (2.3560 => 2.3940, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.57% (1.5941 => 1.6192, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.37% (4.8362 => 4.9025, std.dev.: 0.0082) MultiSource/Applications/minisat/minisat: 1.25% (6.1525 => 6.2292, std.dev.: 0.0226) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -5.28% (29.8330 => 28.2584, std.dev.: 0.0358) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -1.87% (7.2130 => 7.0782, std.dev.: 0.0353) SingleSource/Benchmarks/Shootout-C++/hash2: -1.62% (3.4237 => 3.3684, std.dev.: 0.0058) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.12% (1.2822 => 1.2679, std.dev.: 0.0035) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.98% (16.4461 => 16.6073, std.dev.: 0.0382) MultiSource/Applications/obsequi/Obsequi: 2.79% (1.0262 => 1.0548, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: 0.38% (0.6332 => 0.6356, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/08-main/main: 5.84% (0.1831 => 0.1938, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.45% (0.1559 => 0.1644, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.95% (0.3123 => 0.3184, std.dev.: 0.0071) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.06% (0.2463 => 0.2437, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.06% (0.3344 => 0.3346, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.34% (0.2364 => 0.2372, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/bigfib: -0.02% (0.6010 => 0.6009, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/mandel: 15.85% (0.0429 => 0.0497, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.24% (0.3266 => 0.3339, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 1.63% (0.1969 => 0.2001, std.dev.: 0.0011) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.23% (0.0224 => 0.0229, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 17.07% (0.0123 => 0.0144, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.92% (0.0408 => 0.0424, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -4.33% (0.0254 => 0.0243, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -11.46% (0.0384 => 0.0340, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/casts: -27.89% (0.0190 => 0.0137, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/test1: 16.11% (0.0180 => 0.0209, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: 46.96% (0.0230 => 0.0338, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 2.29% (0.1438 => 0.1471, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.87% (1.1329 => 1.1230, std.dev.: 0.0325) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.21% (0.1462 => 0.1465, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.94% (0.4164 => 0.4125, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.94% (0.1369 => 0.1315, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.71% (0.0641 => 0.0598, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.54% (0.0195 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.65% (0.0578 => 0.0528, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.23% (1.1437 => 1.1411, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.19% (0.0627 => 0.0538, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.33% (0.0180 => 0.0174, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.09% (0.8017 => 0.8024, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -24.19% (0.0062 => 0.0047, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 00:02:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 02:02:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121027070203.4EFB52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5282?compare_to=5278&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5282, Order: 166865, Start Time: 2012-10-27 05:30:03, End Time: 2012-10-27 07:01:59 To: 5278, Order: 166858, Start Time: 2012-10-27 03:26:58, End Time: 2012-10-27 05:00:20 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 10 (10 on baseline) New Passes: 0 (14 on baseline) Performance Regressions: 48 (187 on baseline) Performance Improvements: 33 (54 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 5 (5 on baseline) Unchanged Tests: 946 (638 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -68.00% (6.4331 => 2.0583, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -42.01% (0.1376 => 0.0798, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -0.89% (9.2646 => 9.1819, std.dev.: 0.0526) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -73.86% (29.8058 => 7.7921, std.dev.: 0.0166) SingleSource/UnitTests/Vector/SSE/sse_shift: 18.62% (0.0435 => 0.0516, std.dev.: 0.0000) New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/JM/lencod/lencod: -9.73% (8.5629 => 7.7300, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.51% (0.0203 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -50.00% (0.0002 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -99.99% (0.7926 => 0.0001) SingleSource/UnitTests/Vector/SSE/sse_shift: -50.00% (0.0002 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 34.33% (0.6077 => 0.8163, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 34.04% (0.6214 => 0.8329, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 33.71% (0.6226 => 0.8325, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 33.66% (0.6221 => 0.8315, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.66% (0.6479 => 0.8595, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 32.58% (0.7600 => 1.0076, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.48% (0.6454 => 0.8550, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 32.33% (0.6533 => 0.8645, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.99% (0.6612 => 0.8727, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 30.53% (0.6914 => 0.9025, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.49% (0.6859 => 0.8950, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 30.11% (0.7012 => 0.9123, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.89% (0.6896 => 0.8957, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 29.50% (0.7275 => 0.9421, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.10% (0.7329 => 0.9462, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 28.26% (0.7484 => 0.9599, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 26.69% (0.7661 => 0.9706, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 25.02% (0.8421 => 1.0528, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.56% (0.1002 => 0.1188, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.01% (0.8163 => 0.8735, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 6.84% (0.6770 => 0.7233, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.80% (0.6646 => 0.7098, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.80% (0.6784 => 0.7245, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.73% (0.6795 => 0.7252, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.59% (0.7009 => 0.7471, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.47% (0.7047 => 0.7503, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.35% (0.7192 => 0.7649, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.34% (0.7101 => 0.7551, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.27% (0.7467 => 0.7935, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.24% (0.7768 => 0.8253, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.13% (0.8111 => 0.8608, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 5.98% (0.7578 => 0.8031, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 5.85% (0.7903 => 0.8365, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.68% (0.8062 => 0.8520, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 5.60% (0.7464 => 0.7882, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 5.59% (0.7386 => 0.7799, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 5.39% (0.8761 => 0.9233, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/BoolLiteralTest: 4.27% (0.4146 => 0.4323, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.21% (2.1833 => 2.2753, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.09% (0.4201 => 0.4331, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.06% (2.8688 => 2.9567, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.44% (1.3428 => 1.3621, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: 1.02% (1.3315 => 1.3451, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.97% (4.4898 => 5.0273, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.17% (1.2921 => 1.3718, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 3.92% (4.1985 => 4.3632, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 3.36% (4.4259 => 4.5747, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/bh/bh: 1.85% (1.9617 => 1.9980, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -36.23% (1.0698 => 0.6822, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -30.24% (14.2099 => 9.9128, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.18% (3.4597 => 2.4157, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -30.08% (3.4599 => 2.4192, std.dev.: 0.0072) MultiSource/Applications/JM/ldecod/ldecod: -22.74% (12.3712 => 9.5578, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -19.30% (1.6682 => 1.3463, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.34% (2.8019 => 2.4281, std.dev.: 0.0073) MultiSource/Applications/JM/lencod/lencod: -9.12% (24.1285 => 21.9287, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.54% (0.9073 => 0.8661, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -2.91% (7.4966 => 7.2787, std.dev.: 0.0034) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.33% (8.5611 => 8.3620, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -2.25% (1.4954 => 1.4617, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.18% (3.2964 => 3.2244, std.dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.59% (0.0512 => 0.0340) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -33.28% (0.4029 => 0.2688, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -16.22% (4.1727 => 3.4959, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -12.82% (3.0552 => 2.6635, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -9.63% (9.4215 => 8.5142, std.dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: -9.52% (0.1324 => 0.1198, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -9.32% (1.0949 => 0.9929, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -7.27% (1.0927 => 1.0133, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -7.19% (2.5432 => 2.3604, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: -4.37% (4.0116 => 3.8362, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.45% (1.1366 => 1.0974, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -3.11% (4.4419 => 4.3036, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -2.49% (3.7953 => 3.7008, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.00% (4.4635 => 4.3742, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -1.90% (85.6882 => 84.0563, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/fbench: -1.86% (2.3287 => 2.2855, std.dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.84% (7.9783 => 7.8312, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/himenobmtxpa: -1.65% (3.7167 => 3.6555, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.45% (4.3396 => 4.2765, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.36% (5.7415 => 5.6637, std.dev.: 0.0014) Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Bullet/bullet: -0.23% (57.7206 => 57.5862, std.dev.: 0.8433) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset SingleSource/Benchmarks/BenchmarkGame/puzzle MultiSource/Applications/oggenc/oggenc: -99.93% (0.1404 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.93% (0.0648 => 0.0667, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: -10.76% (0.3355 => 0.2994, std.dev.: 0.0012) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -64.26% (5.7591 => 2.0583, std.dev.: 0.0039) MultiSource/Benchmarks/Bullet/bullet: -8.95% (63.2438 => 57.5862, std.dev.: 0.8433) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.81% (6.6874 => 0.0798, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 12.85% (8.1363 => 9.1819, std.dev.: 0.0526) SingleSource/UnitTests/Vector/SSE/sse_shift: 36.51% (0.0378 => 0.0516, std.dev.: 0.0000) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -50.00% (0.0002 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -57.00% (0.6962 => 0.2994, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_shift: -50.00% (0.0002 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 207.94% (0.5229 => 1.6102, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 16.40% (14.9895 => 17.4479, std.dev.: 0.0068) MultiSource/Applications/kimwitu++/kc: 37.28% (14.1553 => 19.4330, std.dev.: 0.0102) MultiSource/Benchmarks/MallocBench/gs/gs: 13.33% (4.1105 => 4.6584, std.dev.: 0.0098) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 32.30% (1.1048 => 1.4617, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.19% (3.4629 => 5.8242, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 67.55% (0.6222 => 1.0425, std.dev.: 0.0068) New Passes - Execution Time --------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 3836100.00% (0.0001 => 3.8362, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 11147500.00% (0.0001 => 11.1476, std.dev.: 0.0081) MultiSource/Applications/kimwitu++/kc: 50700.00% (0.0001 => 0.0508, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050300.00% (0.0001 => 10.0504, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5485800.00% (0.0001 => 5.4859, std.dev.: 0.0028) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 78.04% (0.0296 => 0.0527) SingleSource/Benchmarks/Misc/lowercase: 67.19% (0.0256 => 0.0428, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 59.78% (0.0271 => 0.0433, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 51.85% (0.0243 => 0.0369) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 43.47% (1.5859 => 2.2753, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.45% (0.0834 => 0.1188, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/distray/distray: 40.25% (0.1056 => 0.1481, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 34.25% (2.2024 => 2.9567, std.dev.: 0.0006) SingleSource/UnitTests/vla: 34.08% (0.0355 => 0.0476, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 31.31% (0.1463 => 0.1921, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 29.12% (0.1432 => 0.1849, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 27.25% (0.1655 => 0.2106, std.dev.: 0.0001) MultiSource/Benchmarks/llubenchmark/llu: 22.29% (0.0462 => 0.0565) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.58% (0.1566 => 0.1904, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/hash: 21.44% (0.0485 => 0.0589, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 20.26% (0.1555 => 0.1870, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 20.02% (0.5105 => 0.6127, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.86% (0.0871 => 0.1044, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/rem: 19.76% (0.1144 => 0.1370, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 18.90% (0.0746 => 0.0887, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 18.36% (0.0730 => 0.0864, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 18.29% (1.3050 => 1.5437, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 18.05% (0.0842 => 0.0994, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 18.01% (0.2271 => 0.2680, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.01% (0.6675 => 0.7877, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 17.93% (0.2554 => 0.3012, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 17.87% (0.1175 => 0.1385, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 17.78% (0.0675 => 0.0795, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 17.48% (3.3354 => 3.9183, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.43% (0.1337 => 0.1570, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 17.26% (0.7115 => 0.8343, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 17.15% (0.1236 => 0.1448, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.14% (0.0770 => 0.0902, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.09% (0.5020 => 0.5878, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 17.03% (0.4879 => 0.5710, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: 16.93% (0.0626 => 0.0732, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 16.92% (0.1584 => 0.1852, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.90% (0.0793 => 0.0927, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 16.87% (0.1695 => 0.1981, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.86% (0.1032 => 0.1206, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 16.84% (0.3177 => 0.3712, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.80% (0.8172 => 0.9545, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/mst/mst: 16.68% (0.1163 => 0.1357, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.60% (0.4615 => 0.5381, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.54% (1.5415 => 1.7965, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 16.42% (0.1510 => 0.1758, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 16.34% (0.3109 => 0.3617, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.24% (0.3121 => 0.3628, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.80% (0.0886 => 0.1026, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 15.74% (0.1906 => 0.2206, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 15.69% (22.1758 => 25.6548, std.dev.: 0.0165) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.67% (0.1940 => 0.2244, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 15.54% (1.1642 => 1.3451, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 15.48% (0.2603 => 0.3006, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 15.46% (0.1151 => 0.1329, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.45% (0.2758 => 0.3184, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.23% (0.2107 => 0.2428, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.15% (0.6450 => 0.7427, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 15.04% (1.1840 => 1.3621, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/exptree: 14.99% (0.0814 => 0.0936, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.87% (0.9765 => 1.1217, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.86% (0.1117 => 0.1283, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.61% (4.2646 => 4.8875, std.dev.: 0.0028) MultiSource/Applications/lemon/lemon: 14.56% (1.0722 => 1.2283, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.56% (0.2700 => 0.3093, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.49% (0.1125 => 0.1288, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 14.46% (0.3423 => 0.3918, std.dev.: 0.0016) MultiSource/Applications/treecc/treecc: 14.44% (2.0273 => 2.3201, std.dev.: 0.0029) MultiSource/Applications/spiff/spiff: 14.38% (0.7835 => 0.8962, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/football/football: 14.36% (0.8921 => 1.0202, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.19% (0.5981 => 0.6830, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.19% (0.2065 => 0.2358, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.12% (0.1062 => 0.1212, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.11% (1.1861 => 1.3534, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.96% (1.4186 => 1.6166, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.94% (0.5860 => 0.6677, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.91% (0.0798 => 0.0909, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.90% (0.1029 => 0.1172, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 13.89% (0.4299 => 0.4896, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.83% (0.0933 => 0.1062, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.75% (0.1695 => 0.1928, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 13.71% (0.7433 => 0.8452, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.66% (0.1625 => 0.1847, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.56% (0.0929 => 0.1055, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.38% (0.1330 => 0.1508, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 13.37% (3.8723 => 4.3899, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.36% (0.5569 => 0.6313, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.25% (0.0770 => 0.0872, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.20% (0.3826 => 0.4331, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.15% (0.3307 => 0.3742, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: 12.93% (0.1268 => 0.1432, std.dev.: 0.0031) MultiSource/Benchmarks/sim/sim: 12.90% (0.3387 => 0.3824, std.dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.77% (0.1143 => 0.1289, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 12.77% (0.0838 => 0.0945, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 12.62% (9.4845 => 10.6814, std.dev.: 0.1482) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.58% (0.3441 => 0.3874, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 12.39% (0.3092 => 0.3475, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.10% (0.1892 => 0.2121, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 12.01% (0.4289 => 0.4804, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 11.79% (0.3180 => 0.3555, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.69% (0.8101 => 0.9048, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.50% (5.0018 => 5.5770, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.47% (4.9449 => 5.5119, std.dev.: 0.0046) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 11.23% (0.0953 => 0.1060, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 11.21% (0.4620 => 0.5138, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 11.05% (2.2969 => 2.5507, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.00% (2.2022 => 2.4444, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/bigfib: 10.92% (0.6456 => 0.7161, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.68% (14.3668 => 15.9018, std.dev.: 0.0140) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.53% (0.3543 => 0.3916, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 10.49% (0.3422 => 0.3781, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.44% (0.1044 => 0.1153, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 10.21% (0.3927 => 0.4328, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.12% (0.4636 => 0.5105, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.09% (0.4203 => 0.4627, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 10.01% (17.1811 => 18.9015, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.01% (0.3865 => 0.4252, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 9.95% (0.3828 => 0.4209, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.89% (0.3427 => 0.3766, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 9.88% (0.3473 => 0.3816, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.85% (0.3543 => 0.3892, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 9.81% (0.2049 => 0.2250) SingleSource/UnitTests/ObjC/synchronized: 9.80% (0.3561 => 0.3910, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.77% (0.3694 => 0.4055, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 9.75% (0.3497 => 0.3838, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.73% (0.3516 => 0.3858, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.57% (0.3886 => 0.4258, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists1: 9.55% (0.3684 => 0.4036, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 9.54% (0.4048 => 0.4434, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 9.43% (1.5603 => 1.7075, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.36% (0.4103 => 0.4487, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.30% (0.2430 => 0.2656, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sieve: 8.96% (0.3603 => 0.3926, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.86% (0.5925 => 0.6450, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.79% (0.6030 => 0.6560, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.62% (3.8922 => 4.2278, std.dev.: 0.0200) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.42% (0.4064 => 0.4406, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.33% (0.3650 => 0.3954, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.30% (0.7326 => 0.7934, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 8.13% (0.3098 => 0.3350, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.09% (0.2756 => 0.2979, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.87% (0.2872 => 0.3098, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.82% (0.2891 => 0.3117, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 7.80% (0.3282 => 0.3538, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 7.77% (0.2831 => 0.3051, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 7.68% (0.3283 => 0.3535, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.67% (2.0665 => 2.2251, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 7.64% (0.2905 => 0.3127, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.62% (0.3162 => 0.3403, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 7.61% (0.3232 => 0.3478, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.52% (0.2871 => 0.3087, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.41% (0.2793 => 0.3000, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.37% (0.2877 => 0.3089, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.36% (0.8067 => 0.8661, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/fibo: 7.34% (0.2725 => 0.2925, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.18% (0.2714 => 0.2909, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.18% (0.3052 => 0.3271, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.11% (0.2266 => 0.2427, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 7.10% (0.2802 => 0.3001, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 6.82% (1.2842 => 1.3718, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary2: 6.57% (0.3379 => 0.3601, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.90% (0.3136 => 0.3321, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.33% (0.3131 => 0.3298, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.03% (7.9617 => 8.3620, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.96% (0.3935 => 0.4091, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.19% (7.0540 => 7.2787, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.09% (1.1145 => 1.3718, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 10.21% (0.9957 => 1.0974, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/richards_benchmark: 9.79% (1.1396 => 1.2512, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.95% (2.8904 => 3.0914, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3689, std.dev.: 0.0005) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626) SingleSource/Benchmarks/Misc/fp-convert: 4.50% (3.3453 => 3.4959, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 2.96% (1.9405 => 1.9980, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.50% (4.2280 => 4.3337, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 2.46% (4.4649 => 4.5747, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/bisort/bisort: 1.73% (0.8333 => 0.8477, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2078, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.44% (11.6436 => 11.8114, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.42% (9.1159 => 9.2453, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.16% (6.5088 => 6.5842, std.dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -76.64% (0.8651 => 0.2021, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.14% (5.3855 => 2.4157, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -54.80% (5.3526 => 2.4192, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/richards_benchmark: -45.25% (0.1622 => 0.0888, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.06% (1.1194 => 0.6822, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.89% (5.2763 => 3.2244, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -23.54% (1.7609 => 1.3463, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -17.37% (2.9384 => 2.4281, std.dev.: 0.0073) SingleSource/UnitTests/Vector/constpool: -8.98% (54.1659 => 49.2995, std.dev.: 0.0262) MultiSource/Applications/JM/ldecod/ldecod: -8.42% (10.4361 => 9.5578, std.dev.: 0.0056) MultiSource/Benchmarks/PAQ8p/paq8p: -4.38% (10.3673 => 9.9128, std.dev.: 0.0070) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -54.03% (8.0499 => 3.7008, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0133, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7652, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.81% (0.0506 => 0.0340) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.58% (0.3987 => 0.2688, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.51% (2.9695 => 2.3604, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -19.00% (1.2258 => 0.9929, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.76% (1.6925 => 1.4258, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: -10.97% (9.5636 => 8.5142, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/chomp: -10.94% (1.2373 => 1.1020, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: -10.87% (1.5373 => 1.3702, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.31% (19.9488 => 18.2901, std.dev.: 0.0994) MultiSource/Benchmarks/FreeBench/mason/mason: -7.96% (0.2161 => 0.1989, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.09% (1.8329 => 1.7030, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4780, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -5.47% (6.6465 => 6.2831, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.08% (1.6805 => 1.5951, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.77% (0.2497 => 0.2378, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.58% (1.5835 => 1.5110, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.99% (8.1563 => 7.8312, std.dev.: 0.0076) MultiSource/Applications/siod/siod: -3.80% (3.2827 => 3.1581, std.dev.: 0.0106) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.50% (32.5116 => 31.3750, std.dev.: 0.0025) MultiSource/Benchmarks/sim/sim: -3.33% (5.0483 => 4.8801, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.81% (4.5009 => 4.3742, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: -2.79% (4.6441 => 4.5145, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.66% (0.4808 => 0.4680, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/multiplies: -1.99% (2.5528 => 2.5020, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -1.82% (10.2830 => 10.0955, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6801, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1095, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -1.19% (85.0658 => 84.0563, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.18% (1.7254 => 1.7051, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2359, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.86% (7.1582 => 7.7921, std.dev.: 0.0166) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: 10636.11% (0.0720 => 7.7300, std.dev.: 0.0029) MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.48% (0.2116 => 0.0667, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 1.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 00:53:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 02:53:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121027075309.D13602A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/5283?compare_to=5280&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5283, Order: 166866, Start Time: 2012-10-27 06:24:25, End Time: 2012-10-27 07:53:05 To: 5280, Order: 166863, Start Time: 2012-10-27 04:36:41, End Time: 2012-10-27 06:01:38 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (177 on baseline) Unchanged Tests: 1042 (860 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 18.48% (15.2527 => 18.0708, std.dev.: 0.0152) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.25% (1.2783 => 1.3710, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.65% (2.0478 => 2.1020, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/salsa20: 2.46% (7.4937 => 7.6782, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash2: 2.28% (3.1932 => 3.2660, std.dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.22% (0.1431 => 0.1299) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.22% (0.3821 => 0.3507, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: -7.77% (2.4924 => 2.2988, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: -7.36% (0.3831 => 0.3549, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -7.29% (0.3880 => 0.3597, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -7.29% (0.3896 => 0.3612, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions-3: -7.28% (0.3848 => 0.3568, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.25% (0.3891 => 0.3609, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -7.24% (0.3812 => 0.3536, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.23% (0.3884 => 0.3603, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: -7.19% (0.4033 => 0.3743, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -7.16% (0.4176 => 0.3877, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.13% (0.3142 => 0.2918, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.08% (0.2428 => 0.2256, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.05% (22.4056 => 20.8257, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.04% (0.9542 => 0.8870, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.97% (3.5339 => 3.2875, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: -6.95% (0.4199 => 0.3907, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/oourafft: -6.94% (0.2160 => 0.2010, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -6.82% (0.4280 => 0.3988, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.79% (0.6484 => 0.6044, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.78% (0.9852 => 0.9184, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.72% (0.3658 => 0.3412, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.64% (0.1716 => 0.1602, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -6.53% (16.1920 => 15.1341, std.dev.: 0.1435) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.52% (1.0544 => 0.9857, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: -6.51% (0.2659 => 0.2486, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.50% (0.2355 => 0.2202, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: -6.49% (4.3330 => 4.0516, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.49% (0.7919 => 0.7405, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.49% (1.6474 => 1.5405, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: -6.48% (9.2283 => 8.6301, std.dev.: 0.0231) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.46% (0.4151 => 0.3883, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.45% (4.8161 => 4.5054, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -6.43% (0.2985 => 0.2793, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: -6.41% (7.0961 => 6.6409, std.dev.: 0.1483) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.41% (1.2784 => 1.1964, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.40% (0.1796 => 0.1681, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.38% (1.3722 => 1.2846, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.38% (4.8802 => 4.5687, std.dev.: 0.0077) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.38% (0.1584 => 0.1483, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.36% (5.4682 => 5.1206, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: -6.35% (1.3148 => 1.2313, std.dev.: 0.0140) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.30% (4.5069 => 4.2229, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.30% (1.4642 => 1.3720, std.dev.: 0.0018) MultiSource/Applications/lua/lua: -6.29% (4.0594 => 3.8042, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/ReedSolomon: -6.23% (0.1879 => 0.1762, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.21% (0.3849 => 0.3610, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -6.21% (0.3481 => 0.3265, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.20% (0.3837 => 0.3599, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.20% (0.2548 => 0.2390, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.20% (1.6364 => 1.5350, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.19% (4.0323 => 3.7829, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/except: -6.18% (0.3026 => 0.2839, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -6.17% (0.4861 => 0.4561, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.17% (0.6293 => 0.5905, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.15% (0.5999 => 0.5630, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: -6.14% (0.3255 => 0.3055, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -6.11% (0.4321 => 0.4057, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.11% (0.3931 => 0.3691, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.08% (2.2587 => 2.1213, std.dev.: 0.0260) SingleSource/Benchmarks/McGill/chomp: -6.08% (0.1761 => 0.1654, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.06% (1.2221 => 1.1480, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.06% (0.3252 => 0.3055, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -6.06% (0.2939 => 0.2761, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.04% (0.8521 => 0.8006, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.04% (0.6736 => 0.6329, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.03% (2.1713 => 2.0403, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -6.03% (0.2871 => 0.2698, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/strcat: -6.02% (0.2989 => 0.2809, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -6.02% (0.3621 => 0.3403, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.02% (0.3057 => 0.2873, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -6.02% (0.3323 => 0.3123, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: -6.00% (0.2849 => 0.2678, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.99% (0.2903 => 0.2729, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: -5.98% (0.3394 => 0.3191, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -5.98% (0.3446 => 0.3240, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -5.97% (0.3788 => 0.3562, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.96% (0.5925 => 0.5572, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -5.96% (0.6750 => 0.6348, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: -5.95% (0.3581 => 0.3368, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.94% (0.6297 => 0.5923, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.93% (0.2933 => 0.2759, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: -5.93% (1.1530 => 1.0846, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.93% (0.4083 => 0.3841, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: -5.92% (0.3025 => 0.2846, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.91% (0.5857 => 0.5511, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.90% (0.2999 => 0.2822, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: -5.90% (0.3205 => 0.3016, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.89% (0.5805 => 0.5463, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.87% (0.6304 => 0.5934, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -5.86% (34.0927 => 32.0933, std.dev.: 0.0227) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.85% (0.3319 => 0.3125, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.83% (0.6052 => 0.5699, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/football/football: -5.83% (0.9179 => 0.8644, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.83% (0.2385 => 0.2246, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.82% (0.4916 => 0.4630, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.81% (0.3491 => 0.3288, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: -5.80% (18.2933 => 17.2317, std.dev.: 0.0276) SingleSource/Benchmarks/Shootout-C++/objinst: -5.79% (0.3194 => 0.3009, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.79% (0.6395 => 0.6025, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: -5.78% (0.4515 => 0.4254, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.77% (0.3016 => 0.2842, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.77% (0.5478 => 0.5162, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.77% (0.6260 => 0.5899, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.76% (0.5802 => 0.5468, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -5.75% (0.3059 => 0.2883, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.75% (1.2210 => 1.1508, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.75% (0.2106 => 0.1985, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: -5.74% (0.3867 => 0.3645, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.74% (0.6446 => 0.6076, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.71% (0.2278 => 0.2148, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: -5.70% (0.4524 => 0.4266, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.70% (0.5859 => 0.5525, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -5.70% (0.4248 => 0.4006, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.69% (0.5591 => 0.5273, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.68% (0.5863 => 0.5530, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.68% (0.5705 => 0.5381, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.68% (0.5849 => 0.5517, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.67% (0.6189 => 0.5838, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.65% (0.7198 => 0.6791, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.65% (0.6660 => 0.6284, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: -5.63% (1.1450 => 1.0805, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.63% (0.5168 => 0.4877, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.63% (0.6395 => 0.6035, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.63% (0.9557 => 0.9019, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.63% (0.7339 => 0.6926, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.61% (0.4813 => 0.4543, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.60% (0.6676 => 0.6302, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: -5.60% (0.7447 => 0.7030, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.60% (0.5575 => 0.5263, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.59% (0.6230 => 0.5882, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.58% (0.7524 => 0.7104, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -5.58% (0.3406 => 0.3216, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.57% (0.5581 => 0.5270, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.57% (0.6194 => 0.5849, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.57% (0.6681 => 0.6309, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.55% (0.5941 => 0.5611, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.55% (0.5569 => 0.5260, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.54% (0.6033 => 0.5699, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.53% (0.6440 => 0.6084, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.51% (0.5570 => 0.5263, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.50% (0.7021 => 0.6635, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -5.49% (15.5079 => 14.6567, std.dev.: 0.3093) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.40% (6.7716 => 6.4058, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.37% (0.6667 => 0.6309, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: -5.36% (0.7982 => 0.7554, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.35% (0.5456 => 0.5164, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.35% (0.5329 => 0.5044, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.34% (0.5688 => 0.5384, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.32% (8.0126 => 7.5861, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.25% (0.5567 => 0.5275, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: -5.20% (3.5154 => 3.3325, std.dev.: 0.0670) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.15% (0.2001 => 0.1898, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -5.11% (0.3271 => 0.3104, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -5.09% (0.7779 => 0.7383, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: -5.01% (0.6441 => 0.6118, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -5.01% (0.6347 => 0.6029, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.91% (0.3483 => 0.3312, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -4.86% (17.1032 => 16.2724, std.dev.: 0.0246) MultiSource/Benchmarks/Ptrdist/bc/bc: -4.81% (1.2300 => 1.1708, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.70% (0.2277 => 0.2170, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.67% (0.9077 => 0.8653, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: -4.56% (5.0226 => 4.7936, std.dev.: 0.0884) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.53% (0.2695 => 0.2573, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: -4.23% (1.5610 => 1.4950, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.83% (14.2083 => 13.6648, std.dev.: 0.0107) MultiSource/Applications/SIBsim4/SIBsim4: -3.69% (1.3864 => 1.3352, std.dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -2.60% (20.7746 => 20.2343, std.dev.: 0.0250) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7536, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: -8.77% (1.2842 => 1.1716, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: -3.85% (2.2633 => 2.1762, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.85% (1.7753 => 1.7070, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.18% (1.3096 => 1.2680, std.dev.: 0.0110) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4689, std.dev.: 0.0018) Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 01:06:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 03:06:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121027080603.B952A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5284?compare_to=5276&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5284, Order: 166863, Start Time: 2012-10-27 04:48:05, End Time: 2012-10-27 08:06:00 To: 5276, Order: 166836, Start Time: 2012-10-27 00:43:22, End Time: 2012-10-27 03:59:57 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (164 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1040 (725 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/UnitTests/ObjC/synchronized: 15.57% (0.1053 => 0.1217, std.dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.29% (0.6240 => 0.6097, std.dev.: 0.0052) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.80% (0.0625 => 0.0880, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.08% (0.1063 => 0.1404, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.46% (0.2969 => 0.3725, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 24.95% (0.1106 => 0.1382, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.08% (0.4253 => 0.5277, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.97% (0.0897 => 0.1112, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 23.92% (0.4139 => 0.5129, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.73% (0.4994 => 0.6179, std.dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 23.59% (1.5932 => 1.9691, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.25% (0.5900 => 0.7272, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.22% (0.0547 => 0.0674, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.00% (0.5000 => 0.6150, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.97% (0.0714 => 0.0878, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.74% (0.0475 => 0.0583, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.43% (0.0584 => 0.0715, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.30% (0.1620 => 0.1965, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.25% (0.1021 => 0.1238, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 21.04% (0.0599 => 0.0725, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 20.78% (0.1107 => 0.1337, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 20.20% (0.0604 => 0.0726, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.16% (0.3903 => 0.4690, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 20.04% (0.0948 => 0.1138, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.03% (0.0584 => 0.0701, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/04-bisect/bisect: 19.91% (0.0633 => 0.0759, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.85% (0.1103 => 0.1322, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.84% (0.1003 => 0.1202, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.78% (0.0642 => 0.0769, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.78% (0.0541 => 0.0648, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.45% (0.1604 => 0.1916, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.37% (0.1549 => 0.1849, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/health/health: 19.37% (0.0821 => 0.0980, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 19.15% (0.1619 => 0.1929, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.10% (0.0822 => 0.0979, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 18.37% (0.0947 => 0.1121, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/Hello: 18.26% (0.5826 => 0.6890, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.19% (0.1462 => 0.1728, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.15% (0.3890 => 0.4596, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.97% (0.2014 => 0.2376, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 17.95% (0.5889 => 0.6946, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 17.82% (0.0808 => 0.0952, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.78% (1.3152 => 1.5490, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: 17.65% (0.1218 => 0.1433, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 17.62% (0.4029 => 0.4739, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 17.41% (0.1505 => 0.1767, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.37% (0.1088 => 0.1277, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 17.19% (0.0698 => 0.0818, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.14% (0.2736 => 0.3205, std.dev.: 0.0024) MultiSource/Applications/Burg/burg: 17.02% (0.5546 => 0.6490, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.98% (0.1160 => 0.1357, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.97% (0.2875 => 0.3363, std.dev.: 0.0019) MultiSource/Applications/hbd/hbd: 16.92% (0.9697 => 1.1338, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.64% (0.2866 => 0.3343, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 16.56% (1.8794 => 2.1906, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.51% (0.5026 => 0.5856, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/fibo: 16.33% (0.2725 => 0.3170, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/random: 16.30% (0.2803 => 0.3260, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.29% (3.5627 => 4.1430, std.dev.: 0.0043) SingleSource/UnitTests/ObjC++/property-reference: 16.26% (0.7171 => 0.8337, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.21% (0.1968 => 0.2287, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.17% (1.6211 => 1.8833, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.12% (0.4658 => 0.5409, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 16.12% (0.1421 => 0.1650, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 16.04% (1.0781 => 1.2510, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/strcat: 15.96% (0.2750 => 0.3189, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.93% (0.3271 => 0.3792, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hello: 15.92% (0.2714 => 0.3146, std.dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: 15.85% (0.9909 => 1.1480, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.83% (0.3930 => 0.4552, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.79% (0.2729 => 0.3160, std.dev.: 0.0039) SingleSource/Regression/C++/ofstream_ctor: 15.75% (0.3004 => 0.3477, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/matrix: 15.72% (0.2780 => 0.3217, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.61% (2.0673 => 2.3901, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/methcall: 15.61% (0.2813 => 0.3252, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.56% (0.2911 => 0.3364, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.56% (0.3195 => 0.3692, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: 15.50% (0.1284 => 0.1483, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.48% (0.4361 => 0.5036, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/wc: 15.47% (0.3096 => 0.3575, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/ary2: 15.32% (0.3317 => 0.3825, std.dev.: 0.0071) MultiSource/Applications/ClamAV/clamscan: 15.30% (4.2109 => 4.8553, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/ary3: 15.27% (0.3267 => 0.3766, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/ary: 15.22% (0.3258 => 0.3754, std.dev.: 0.0091) MultiSource/Benchmarks/Bullet/bullet: 15.16% (23.5202 => 27.0865, std.dev.: 0.0277) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.13% (4.4195 => 5.0881, std.dev.: 0.0081) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.08% (2.7292 => 3.1408, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.93% (0.3060 => 0.3517, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.90% (1.9694 => 2.2628, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.78% (0.3362 => 0.3859, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 14.77% (0.2566 => 0.2945, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 14.73% (0.3348 => 0.3841, std.dev.: 0.0131) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.71% (1.9966 => 2.2903, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.60% (0.3124 => 0.3580, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 14.42% (0.4251 => 0.4864, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.40% (0.1090 => 0.1247, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 14.35% (0.4146 => 0.4741, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.25% (0.3690 => 0.4216, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/sieve: 14.17% (0.3726 => 0.4254, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.11% (0.3282 => 0.3745, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.04% (0.3625 => 0.4134, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/football/football: 13.83% (0.2075 => 0.2362, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 13.83% (1.4269 => 1.6242, std.dev.: 0.0020) MultiSource/Applications/treecc/treecc: 13.33% (0.7875 => 0.8925, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-4: 13.25% (0.3465 => 0.3924, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.22% (0.3488 => 0.3949, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 13.16% (0.3496 => 0.3956, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 13.15% (0.5012 => 0.5671, std.dev.: 0.0077) SingleSource/UnitTests/ObjC/exceptions-3: 13.12% (0.3460 => 0.3914, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 13.12% (0.3446 => 0.3898, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 13.12% (0.3469 => 0.3924, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 13.10% (0.3442 => 0.3893, std.dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: 12.98% (2.1653 => 2.4463, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/property: 12.90% (0.3650 => 0.4121, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: 12.76% (0.3724 => 0.4199, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 12.68% (0.3643 => 0.4105, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 12.66% (4.6177 => 5.2022, std.dev.: 0.0120) MultiSource/Benchmarks/mafft/pairlocalalign: 12.40% (2.1013 => 2.3619, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.29% (0.6435 => 0.7226, std.dev.: 0.0176) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.06% (0.1028 => 0.1152, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.06% (0.2040 => 0.2286, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 11.77% (5.5417 => 6.1937, std.dev.: 0.0106) MultiSource/Applications/SIBsim4/SIBsim4: 11.59% (0.2691 => 0.3003, std.dev.: 0.0037) MultiSource/Applications/minisat/minisat: 11.54% (0.3336 => 0.3721, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 11.35% (0.3498 => 0.3895, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.11% (0.2737 => 0.3041, std.dev.: 0.0055) MultiSource/Applications/siod/siod: 11.08% (0.6634 => 0.7369, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.83% (0.2068 => 0.2292, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.51% (0.3084 => 0.3408, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 10.34% (0.4847 => 0.5348, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.27% (0.1383 => 0.1525, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.13% (0.2103 => 0.2316, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.63% (4.6926 => 5.1447, std.dev.: 0.0067) MultiSource/Applications/sqlite3/sqlite3: 9.41% (2.0346 => 2.2260, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 9.12% (0.2391 => 0.2609, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.04% (11.6398 => 12.6919, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.56% (0.5361 => 0.5820, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.08% (0.7426 => 0.8026, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.01% (0.5584 => 0.6031, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 6.83% (11.9555 => 12.7717, std.dev.: 0.0161) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.88% (0.3792 => 0.3939, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6532, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 15.46% (0.1054 => 0.1217, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 9.74% (0.2802 => 0.3075, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.54% (3.3903 => 3.6121, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.50% (0.3693 => 0.3896, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary: 5.23% (0.2122 => 0.2233, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/objinst: 4.97% (12.0509 => 12.6493, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/flops: 4.75% (15.4430 => 16.1773, std.dev.: 0.0303) SingleSource/Benchmarks/Misc/flops-2: 3.92% (1.8057 => 1.8764, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary3: 1.77% (15.8721 => 16.1533, std.dev.: 0.0217) SingleSource/Benchmarks/Dhrystone/dry: 1.66% (14.0481 => 14.2807, std.dev.: 0.0717) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.65% (3.1722 => 3.2245, std.dev.: 0.0019) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3065, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2897, std.dev.: 0.0024) MultiSource/Benchmarks/llubenchmark/llu: 1.43% (4.9754 => 5.0465, std.dev.: 0.0174) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.27% (1.0927 => 1.1066, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5141, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5405, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5836, std.dev.: 0.0163) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.78% (2.4764 => 2.4323, std.dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -36.24% (25.4195 => 16.2066, std.dev.: 0.0879) MultiSource/Applications/hexxagon/hexxagon: -7.70% (28.1477 => 25.9792, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -7.67% (35.5013 => 32.7801, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9585, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -6.33% (0.2402 => 0.2250, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std.dev.: 0.0052) MultiSource/Applications/siod/siod: -2.98% (6.9842 => 6.7761, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.92% (11.2080 => 10.8802, std.dev.: 0.0296) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5217, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (17.2379 => 16.7847, std.dev.: 0.1089) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8682, std.dev.: 0.0094) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5744, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: -1.45% (5.5810 => 5.5003, std.dev.: 0.0069) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.33% (5.7935 => 5.7164, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.31% (105.3826 => 104.0014, std.dev.: 0.1618) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0457, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.04% (3.3991 => 3.3637, std.dev.: 0.0005) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 02:07:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 04:07:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121027090731.E682F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5285?compare_to=5282&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5285, Order: 166866, Start Time: 2012-10-27 07:35:31, End Time: 2012-10-27 09:07:29 To: 5282, Order: 166865, Start Time: 2012-10-27 05:30:03, End Time: 2012-10-27 07:01:59 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (10 on baseline) New Passes: 0 (14 on baseline) Performance Regressions: 3 (187 on baseline) Performance Improvements: 0 (53 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 15 (5 on baseline) Unchanged Tests: 1024 (639 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.06% (0.9545 => 0.9646, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.28% (54.6322 => 56.4256, std.dev.: 0.0978) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.20% (42.3787 => 42.8853, std.dev.: 0.0753) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -0.01% (2.0583 => 2.0580, std.dev.: 0.0034) MultiSource/Benchmarks/Bullet/bullet: 0.09% (57.5862 => 57.6376, std.dev.: 0.0561) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.25% (0.0798 => 0.0796, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 0.13% (9.1819 => 9.1942, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.06% (7.7921 => 7.7876, std.dev.: 0.0137) SingleSource/UnitTests/Vector/SSE/sse_shift: - (0.0516 => 0.0516, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/JM/lencod/lencod: 0.02% (7.7300 => 7.7316, std.dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: - (0.0001 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.85% (0.0667 => 0.0648, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.03% (0.2994 => 0.2993, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_shift: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -64.27% (5.7591 => 2.0580, std.dev.: 0.0034) MultiSource/Benchmarks/Bullet/bullet: -8.86% (63.2438 => 57.6376, std.dev.: 0.0561) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.81% (6.6874 => 0.0796, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.00% (8.1363 => 9.1942, std.dev.: 0.0036) SingleSource/UnitTests/Vector/SSE/sse_shift: 36.51% (0.0378 => 0.0516, std.dev.: 0.0012) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -50.00% (0.0002 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -57.01% (0.6962 => 0.2993, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_shift: -50.00% (0.0002 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 208.49% (0.5229 => 1.6131, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 16.29% (14.9895 => 17.4313, std.dev.: 0.0296) MultiSource/Applications/kimwitu++/kc: 37.35% (14.1553 => 19.4420, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/gs/gs: 13.49% (4.1105 => 4.6649, std.dev.: 0.0189) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 32.28% (1.1048 => 1.4614, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.12% (3.4629 => 5.8218, std.dev.: 0.0207) SingleSource/Benchmarks/Misc-C++/stepanov_container: 67.53% (0.6222 => 1.0424, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 3836400.00% (0.0001 => 3.8365, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 11147300.00% (0.0001 => 11.1474, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 50900.00% (0.0001 => 0.0510, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14400.00% (0.0001 => 0.0145, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049900.00% (0.0001 => 10.0500, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5486600.00% (0.0001 => 5.4867, std.dev.: 0.0145) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 78.38% (0.0296 => 0.0528, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 66.80% (0.0256 => 0.0427, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 59.78% (0.0271 => 0.0433, std.dev.: 0.0012) SingleSource/Regression/C/sumarraymalloc: 51.85% (0.0243 => 0.0369, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 43.38% (1.5859 => 2.2739, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 43.29% (0.0834 => 0.1195, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/distray/distray: 40.15% (0.1056 => 0.1480, std.dev.: 0.0010) SingleSource/UnitTests/vla: 34.37% (0.0355 => 0.0477, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 34.16% (2.2024 => 2.9547, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: 31.31% (0.1463 => 0.1921, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 29.19% (0.1432 => 0.1850, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 26.10% (0.1655 => 0.2087, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.67% (0.1566 => 0.1921, std.dev.: 0.0032) MultiSource/Benchmarks/llubenchmark/llu: 22.08% (0.0462 => 0.0564, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/hash: 21.65% (0.0485 => 0.0590, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 20.26% (0.1555 => 0.1870, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.75% (0.0871 => 0.1043, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/rem: 19.67% (0.1144 => 0.1369, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 19.35% (0.5105 => 0.6093, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: 18.77% (0.0746 => 0.0886) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.51% (0.0886 => 0.1050, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/mst/mst: 18.49% (0.1163 => 0.1378, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 18.44% (1.3050 => 1.5457, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 18.36% (0.0730 => 0.0864, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 18.22% (0.0675 => 0.0798, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.05% (0.6675 => 0.7880, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.04% (0.8172 => 0.9646, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 17.97% (0.2271 => 0.2679, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/08-main/main: 17.89% (0.2554 => 0.3011, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/tsp/tsp: 17.87% (0.1175 => 0.1385, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.73% (0.1337 => 0.1574, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 17.67% (0.0798 => 0.0939, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 17.59% (0.4879 => 0.5737, std.dev.: 0.0036) MultiSource/Applications/minisat/minisat: 17.54% (0.7115 => 0.8363, std.dev.: 0.0021) MultiSource/Applications/d/make_dparser: 17.28% (3.3354 => 3.9119, std.dev.: 0.0179) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.27% (0.0770 => 0.0903, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.18% (0.4615 => 0.5408, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 17.15% (0.1236 => 0.1448, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 17.00% (0.1906 => 0.2230, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.99% (0.5020 => 0.5873, std.dev.: 0.0077) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 16.98% (0.1584 => 0.1853, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 16.94% (0.1151 => 0.1346, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/lists: 16.93% (0.0626 => 0.0732, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 16.87% (0.3177 => 0.3713, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 16.86% (0.0842 => 0.0984, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.83% (1.5415 => 1.8009, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/em3d/em3d: 16.70% (0.1695 => 0.1978, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.67% (0.1032 => 0.1204, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.65% (0.0793 => 0.0925, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 16.36% (0.1510 => 0.1757, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.31% (0.3121 => 0.3630, std.dev.: 0.0044) MultiSource/Applications/sgefa/sgefa: 16.21% (0.3109 => 0.3613, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.05% (0.0648 => 0.0752, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.76% (0.2107 => 0.2439, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.74% (0.1029 => 0.1191, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 15.69% (22.1758 => 25.6547, std.dev.: 0.0393) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.63% (0.2758 => 0.3189, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 15.56% (0.2603 => 0.3008, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.52% (0.1940 => 0.2241, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.50% (0.9765 => 1.1279, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 15.48% (0.2700 => 0.3118, std.dev.: 0.0058) MultiSource/Benchmarks/nbench/nbench: 15.08% (1.1840 => 1.3625, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.02% (0.6450 => 0.7419, std.dev.: 0.0059) SingleSource/Benchmarks/McGill/exptree: 14.99% (0.0814 => 0.0936, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 14.88% (1.1642 => 1.3374, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.77% (0.1117 => 0.1282, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.64% (4.2646 => 4.8890, std.dev.: 0.0086) MultiSource/Applications/spiff/spiff: 14.60% (0.7835 => 0.8979, std.dev.: 0.0069) MultiSource/Applications/treecc/treecc: 14.51% (2.0273 => 2.3215, std.dev.: 0.0050) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.49% (0.1125 => 0.1288, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: 14.47% (1.0722 => 1.2274, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 14.40% (0.8921 => 1.0206, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.33% (0.2065 => 0.2361, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.30% (0.5860 => 0.6698, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.22% (0.1062 => 0.1213, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.21% (1.1861 => 1.3547, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.21% (0.5981 => 0.6831, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.16% (0.1695 => 0.1935, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 14.08% (1.4186 => 1.6184, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/18-imp/imp: 14.08% (0.3423 => 0.3905, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 13.96% (0.7433 => 0.8471, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/05-eks/eks: 13.75% (0.4299 => 0.4890, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.56% (0.0929 => 0.1055, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.54% (0.1625 => 0.1845, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.50% (0.0933 => 0.1059, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.38% (0.5569 => 0.6314, std.dev.: 0.0038) MultiSource/Applications/lua/lua: 13.31% (3.8723 => 4.3877, std.dev.: 0.0143) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.31% (0.1330 => 0.1507, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.30% (0.3826 => 0.4335, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.25% (0.0770 => 0.0872, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.12% (0.3307 => 0.3741, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 12.96% (0.3387 => 0.3826, std.dev.: 0.0009) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.95% (0.1143 => 0.1291, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 12.77% (0.0838 => 0.0945, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 12.71% (0.3092 => 0.3485, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: 12.70% (0.1268 => 0.1429, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.61% (0.3441 => 0.3875, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 12.54% (9.4845 => 10.6743, std.dev.: 0.0089) MultiSource/Benchmarks/McCat/09-vor/vor: 11.70% (0.3180 => 0.3552, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.61% (5.0018 => 5.5824, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.53% (4.9449 => 5.5148, std.dev.: 0.0102) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.52% (0.1892 => 0.2110, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.36% (0.8101 => 0.9021, std.dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 11.33% (0.0953 => 0.1061, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 11.26% (0.4620 => 0.5140, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 11.14% (0.4289 => 0.4767, std.dev.: 0.0017) MultiSource/Applications/siod/siod: 11.07% (2.2969 => 2.5512, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.96% (2.2022 => 2.4436, std.dev.: 0.0115) SingleSource/Benchmarks/Misc-C++/bigfib: 10.92% (0.6456 => 0.7161, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.65% (14.3668 => 15.8963, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.34% (0.1044 => 0.1152, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 10.29% (0.3927 => 0.4331, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.27% (0.4636 => 0.5112, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.19% (0.3543 => 0.3904, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.14% (0.4203 => 0.4629, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 10.11% (0.3422 => 0.3768, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 10.11% (0.3828 => 0.4215, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.04% (0.3865 => 0.4253, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 9.99% (0.3473 => 0.3820, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.89% (0.3427 => 0.3766, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 9.89% (17.1811 => 18.8798, std.dev.: 0.0090) SingleSource/UnitTests/ObjC/synchronized: 9.88% (0.3561 => 0.3913, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.88% (0.3694 => 0.4059, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.88% (0.3543 => 0.3893, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 9.87% (0.3497 => 0.3842, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.84% (0.3516 => 0.3862, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.83% (0.3886 => 0.4268, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/ReedSolomon: 9.71% (0.2049 => 0.2248, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 9.71% (0.4048 => 0.4441, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 9.58% (0.3684 => 0.4037, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.48% (0.4103 => 0.4492, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 9.46% (1.5603 => 1.7079, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.38% (0.2430 => 0.2658, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: 9.24% (0.3603 => 0.3936, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 9.10% (0.5925 => 0.6464, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 8.87% (0.6030 => 0.6565, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.67% (3.8922 => 4.2298, std.dev.: 0.0146) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.61% (0.4064 => 0.4414, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 8.42% (0.7326 => 0.7943, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/matrix: 8.17% (0.3098 => 0.3351, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.11% (0.3650 => 0.3946, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 7.88% (0.2831 => 0.3054, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.87% (0.2872 => 0.3098, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.85% (0.2891 => 0.3118, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.82% (2.0665 => 2.2280, std.dev.: 0.0016) SingleSource/Regression/C++/ofstream_ctor: 7.81% (0.2905 => 0.3132, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.78% (0.3162 => 0.3408, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 7.77% (0.3283 => 0.3538, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 7.67% (0.3232 => 0.3480, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.62% (0.2756 => 0.2966, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.59% (0.2793 => 0.3005, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 7.54% (1.2842 => 1.3810, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 7.52% (0.2871 => 0.3087, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.52% (0.2714 => 0.2918, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 7.44% (0.3052 => 0.3279, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 7.40% (0.2877 => 0.3090, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.38% (0.2725 => 0.2926, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 7.37% (0.3282 => 0.3524, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.24% (0.8067 => 0.8651, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/random: 7.21% (0.2802 => 0.3004, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.19% (0.2266 => 0.2429) SingleSource/Benchmarks/Shootout-C++/ary2: 6.72% (0.3379 => 0.3606, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.77% (0.3136 => 0.3317, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.40% (0.3131 => 0.3300, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.88% (7.9617 => 8.3504, std.dev.: 0.0196) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.12% (0.3935 => 0.4097, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.26% (7.0540 => 7.2838, std.dev.: 0.0079) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.15% (1.1145 => 1.3725, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 10.21% (0.9957 => 1.0974, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/richards_benchmark: 9.98% (1.1396 => 1.2533, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.95% (2.8904 => 3.0912, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.1578 => 3.3687, std.dev.: 0.0009) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: 4.50% (3.3453 => 3.4959, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.70% (0.4162 => 0.4316, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 2.96% (1.9405 => 1.9979, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.86% (4.2280 => 4.3491, std.dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: 2.52% (4.4649 => 4.5775, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.39% (1.0313 => 1.0559, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bisort/bisort: 1.82% (0.8333 => 0.8485, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 1.54% (3.1595 => 3.2081, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.44% (9.1159 => 9.2469, std.dev.: 0.0325) MultiSource/Benchmarks/nbench/nbench: 1.43% (11.6436 => 11.8101, std.dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -76.63% (0.8651 => 0.2022, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.13% (5.3855 => 2.4164, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -54.85% (5.3526 => 2.4166, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/richards_benchmark: -45.38% (0.1622 => 0.0886, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.03% (1.1194 => 0.6825, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.85% (5.2763 => 3.2264, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -23.53% (1.7609 => 1.3465, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -17.38% (2.9384 => 2.4278, std.dev.: 0.0198) SingleSource/UnitTests/Vector/constpool: -8.97% (54.1659 => 49.3098, std.dev.: 0.0377) MultiSource/Applications/JM/ldecod/ldecod: -8.10% (10.4361 => 9.5905, std.dev.: 0.0070) MultiSource/Benchmarks/PAQ8p/paq8p: -4.40% (10.3673 => 9.9107, std.dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -54.05% (8.0499 => 3.6993, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0134) SingleSource/Benchmarks/Misc/mandel: -33.46% (1.1492 => 0.7647, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.58% (0.3987 => 0.2688, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.51% (2.9695 => 2.3606, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -19.00% (1.2258 => 0.9929, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.07% (1.6925 => 1.4205, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.40% (1.2373 => 1.0963, std.dev.: 0.0030) MultiSource/Benchmarks/NPB-serial/is/is: -11.00% (9.5636 => 8.5117, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -10.82% (1.5373 => 1.3709, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.42% (19.9488 => 18.2694, std.dev.: 0.0120) MultiSource/Benchmarks/FreeBench/mason/mason: -7.77% (0.2161 => 0.1993, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.97% (1.8329 => 1.7051, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5753, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -5.48% (6.6465 => 6.2822, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.09% (1.6805 => 1.5949, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5079, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.77% (0.2497 => 0.2378, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.04% (8.1563 => 7.8270, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) MultiSource/Applications/siod/siod: -3.73% (3.2827 => 3.1604, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.51% (32.5116 => 31.3708, std.dev.: 0.0085) MultiSource/Benchmarks/sim/sim: -3.33% (5.0483 => 4.8802, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: -2.84% (4.6441 => 4.5123, std.dev.: 0.0137) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.80% (4.5009 => 4.3749, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.52% (0.4808 => 0.4687, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/multiplies: -1.95% (2.5528 => 2.5031, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -1.73% (10.2830 => 10.1049, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6830, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -1.62% (1.1277 => 1.1094, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.25% (6.2999 => 6.2214, std.dev.: 0.0081) MultiSource/Benchmarks/PAQ8p/paq8p: -1.19% (85.0658 => 84.0564, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.18% (1.7254 => 1.7051, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.79% (7.1582 => 7.7876, std.dev.: 0.0137) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: 10638.33% (0.0720 => 7.7316, std.dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 02:09:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 04:09:09 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121027090909.990C92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5286?compare_to=5281&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5286, Order: 166867, Start Time: 2012-10-27 07:45:13, End Time: 2012-10-27 09:09:07 To: 5281, Order: 166866, Start Time: 2012-10-27 05:35:04, End Time: 2012-10-27 06:58:42 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 16 (70 on baseline) Performance Improvements: 2 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 957 (900 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/shr: 58.72% (0.0172 => 0.0273, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 9.11% (0.1218 => 0.1329, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.08% (0.6122 => 0.6372, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.04% (0.3019 => 0.3141, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.90% (0.3281 => 0.3409, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.49% (0.3010 => 0.3115, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.45% (0.8732 => 0.9033, std.dev.: 0.0071) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.25% (1.1759 => 1.2141, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 3.21% (0.3176 => 0.3278, std.dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: 2.71% (8.4065 => 8.6346, std.dev.: 0.0792) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.85% (0.9639 => 0.9817, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.81% (0.6472 => 0.6589, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.51% (1.6731 => 1.6983, std.dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/life/life: 1.88% (2.5997 => 2.6485, std.dev.: 0.0096) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.66% (2.4647 => 2.5056, std.dev.: 0.0147) SingleSource/Benchmarks/Misc/fp-convert: 1.39% (15.6881 => 15.9064, std.dev.: 0.0088) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/except: -2.63% (0.5010 => 0.4878, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.15% (61.1761 => 59.8592, std.dev.: 0.1254) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.06% (16.6073 => 16.5969, std.dev.: 0.2076) MultiSource/Applications/obsequi/Obsequi: -0.27% (1.0548 => 1.0519, std.dev.: 0.0246) MultiSource/Applications/sqlite3/sqlite3: 1.12% (0.6356 => 0.6427, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/08-main/main: -1.81% (0.1938 => 0.1903, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.04% (0.1644 => 0.1594, std.dev.: 0.0062) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.03% (0.3184 => 0.3183, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.50% (0.2437 => 0.2498, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.75% (0.3346 => 0.3321, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.70% (0.2372 => 0.2436, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -0.05% (0.6009 => 0.6006, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel: -0.60% (0.0497 => 0.0494, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.69% (0.3339 => 0.3316, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 0.10% (0.2001 => 0.2003, std.dev.: 0.0041) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 16.59% (0.0229 => 0.0267, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 50.69% (0.0144 => 0.0217, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0424 => 0.0424, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 24.28% (0.0243 => 0.0302, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0312 => 0.0312, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 23.53% (0.0340 => 0.0420, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 46.72% (0.0137 => 0.0201, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -31.10% (0.0209 => 0.0144, std.dev.: 0.0037) SingleSource/UnitTests/byval-alignment: 1.78% (0.0338 => 0.0344, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 0.61% (0.1471 => 0.1480, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.71% (1.1230 => 1.1310, std.dev.: 0.0293) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.69% (0.1465 => 0.1519, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.56% (0.4125 => 0.4102, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.08% (0.1315 => 0.1316, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 400.00% (0.0001 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.51% (0.0598 => 0.0583, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -30.07% (0.0276 => 0.0193, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.46% (0.0528 => 0.0541, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.67% (1.1411 => 1.1334, std.dev.: 0.0537) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1500.00% (0.0001 => 0.0016, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.22% (0.0538 => 0.0593, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 41.95% (0.0174 => 0.0247, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.15% (0.8024 => 0.8012, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 29.79% (0.0047 => 0.0061, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.91% (2.1832 => 1.6611, std.dev.: 0.0033) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 34.80% (14.7684 => 19.9084, std.dev.: 0.2499) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.05% (0.0810 => 0.0940, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.13% (0.0830 => 0.0939, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/rem: 12.17% (0.1035 => 0.1161, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.67% (0.3137 => 0.3409, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.56% (0.8321 => 0.9033, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.37% (0.1425 => 0.1530, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.93% (0.2279 => 0.2437, std.dev.: 0.0032) MultiSource/Applications/viterbi/viterbi: 6.85% (0.1577 => 0.1685, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.02% (0.6010 => 0.6372, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.66% (0.7473 => 0.7896, std.dev.: 0.0058) MultiSource/Applications/SIBsim4/SIBsim4: 5.63% (1.2568 => 1.3275, std.dev.: 0.0180) MultiSource/Applications/spiff/spiff: 5.55% (0.7950 => 0.8391, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.45% (0.1983 => 0.2091, std.dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.97% (6.6074 => 6.9355, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.80% (0.6287 => 0.6589, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.79% (13.1811 => 13.8123, std.dev.: 0.0231) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.77% (0.2998 => 0.3141, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.73% (0.8148 => 0.8533, std.dev.: 0.0136) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.61% (1.1606 => 1.2141, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.05% (0.9435 => 0.9817, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.00% (1.1170 => 1.1617, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.73% (0.3003 => 0.3115, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.64% (1.6386 => 1.6983, std.dev.: 0.0035) MultiSource/Applications/sgefa/sgefa: 3.50% (0.2999 => 0.3104, std.dev.: 0.0026) MultiSource/Applications/treecc/treecc: 3.41% (1.9948 => 2.0628, std.dev.: 0.0195) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.15% (0.3717 => 0.3834, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.12% (8.6476 => 8.9174, std.dev.: 0.0242) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.06% (1.1685 => 1.2042, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.03% (0.4127 => 0.4252, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.97% (0.4783 => 0.4925, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/football/football: 2.93% (0.8768 => 0.9025, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.85% (1.4479 => 1.4892, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.84% (0.5961 => 0.6130, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.78% (0.8069 => 0.8293, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/05-eks/eks: 2.73% (0.4397 => 0.4517, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 2.72% (3.8189 => 3.9228, std.dev.: 0.0355) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.61% (1.3279 => 1.3626, std.dev.: 0.0059) SingleSource/UnitTests/Vector/constpool: 2.57% (8.4179 => 8.6346, std.dev.: 0.0792) MultiSource/Applications/SPASS/SPASS: 2.56% (14.2605 => 14.6259, std.dev.: 0.0640) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.53% (4.1763 => 4.2821, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.43% (0.4559 => 0.4670, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.41% (0.6227 => 0.6377, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 2.31% (4.1305 => 4.2259, std.dev.: 0.0327) MultiSource/Benchmarks/nbench/nbench: 2.25% (1.1271 => 1.1525, std.dev.: 0.0050) MultiSource/Applications/d/make_dparser: 2.25% (3.2366 => 3.3093, std.dev.: 0.0240) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.06% (0.8340 => 0.8512, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.93% (4.4873 => 4.5737, std.dev.: 0.0209) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.88% (4.4880 => 4.5725, std.dev.: 0.0323) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.87% (1.2526 => 1.2760, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.76% (0.7966 => 0.8106, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.72% (0.8007 => 0.8145, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.64% (0.6586 => 0.6694, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.56% (0.8697 => 0.8833, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.40% (0.8805 => 0.8928, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.39% (0.8317 => 0.8433, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.29% (0.8359 => 0.8467, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.27% (0.7932 => 0.8033, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 59.21% (1.5795 => 2.5147, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.36% (0.3186 => 0.3516, std.dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.48% (1.1857 => 1.2862, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 5.92% (63.1822 => 66.9230, std.dev.: 0.0714) MultiSource/Applications/siod/siod: 2.72% (3.6643 => 3.7640, std.dev.: 0.0083) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.31% (2.4490 => 2.5056, std.dev.: 0.0147) SingleSource/Benchmarks/Misc/ReedSolomon: 2.18% (8.5322 => 8.7185, std.dev.: 0.0517) MultiSource/Benchmarks/Olden/bh/bh: 1.66% (2.3560 => 2.3952, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.66% (41.4238 => 42.1124, std.dev.: 0.1961) SingleSource/Benchmarks/Misc/richards_benchmark: 1.23% (1.3037 => 1.3197, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.07% (4.8362 => 4.8879, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.00% (59.2638 => 59.8592, std.dev.: 0.1254) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -5.31% (29.8330 => 28.2483, std.dev.: 0.1952) SingleSource/Benchmarks/Shootout-C++/hash2: -1.56% (3.4237 => 3.3703, std.dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/fldry: -1.52% (0.6910 => 0.6805, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.31% (3.3479 => 3.3041, std.dev.: 0.0015) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.92% (16.4461 => 16.5969, std.dev.: 0.2076) MultiSource/Applications/obsequi/Obsequi: 2.50% (1.0262 => 1.0519, std.dev.: 0.0246) MultiSource/Applications/sqlite3/sqlite3: 1.50% (0.6332 => 0.6427, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/08-main/main: 3.93% (0.1831 => 0.1903, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.25% (0.1559 => 0.1594, std.dev.: 0.0062) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.92% (0.3123 => 0.3183, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.42% (0.2463 => 0.2498, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.69% (0.3344 => 0.3321, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.05% (0.2364 => 0.2436, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -0.07% (0.6010 => 0.6006, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel: 15.15% (0.0429 => 0.0494, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.53% (0.3266 => 0.3316, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 1.73% (0.1969 => 0.2003, std.dev.: 0.0041) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 19.20% (0.0224 => 0.0267, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 76.42% (0.0123 => 0.0217, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.92% (0.0408 => 0.0424, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 18.90% (0.0254 => 0.0302, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.38% (0.0384 => 0.0420, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 5.79% (0.0190 => 0.0201, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -20.00% (0.0180 => 0.0144, std.dev.: 0.0037) SingleSource/UnitTests/byval-alignment: 49.57% (0.0230 => 0.0344, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.92% (0.1438 => 0.1480, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -0.17% (1.1329 => 1.1310, std.dev.: 0.0293) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.90% (0.1462 => 0.1519, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.49% (0.4164 => 0.4102, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.87% (0.1369 => 0.1316, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -37.50% (0.0008 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.05% (0.0641 => 0.0583, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.03% (0.0195 => 0.0193, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.40% (0.0578 => 0.0541, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.90% (1.1437 => 1.1334, std.dev.: 0.0537) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1500.00% (0.0001 => 0.0016, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.42% (0.0627 => 0.0593, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 37.22% (0.0180 => 0.0247, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.06% (0.8017 => 0.8012, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -1.61% (0.0062 => 0.0061, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 02:41:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 04:41:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121027094146.E235E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5287?compare_to=5283&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5287, Order: 166868, Start Time: 2012-10-27 08:16:28, End Time: 2012-10-27 09:41:42 To: 5283, Order: 166866, Start Time: 2012-10-27 06:24:25, End Time: 2012-10-27 07:53:05 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 1 (182 on baseline) Unchanged Tests: 1040 (854 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.29% (5.5162 => 5.5875, std.dev.: 0.0082) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -1.55% (1.1650 => 1.1470, std.dev.: 0.0053) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 18.43% (15.2527 => 18.0645, std.dev.: 0.0155) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.91% (2.0478 => 2.1074, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/salsa20: 2.49% (7.4937 => 7.6804, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hash2: 1.84% (3.1932 => 3.2521, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.41% (5.5097 => 5.5875, std.dev.: 0.0082) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.29% (0.1431 => 0.1298, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -7.76% (2.4924 => 2.2990, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.67% (0.3821 => 0.3528, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.13% (22.4056 => 20.8088, std.dev.: 0.0130) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.08% (0.2428 => 0.2256, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: -7.06% (0.3357 => 0.3120, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: -7.04% (0.2160 => 0.2008, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.03% (0.3142 => 0.2921, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -7.03% (3.5339 => 3.2855, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-4: -6.96% (0.3880 => 0.3610, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -6.94% (0.3831 => 0.3565, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.89% (0.3658 => 0.3406, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: -6.87% (0.3812 => 0.3550, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -6.86% (0.3848 => 0.3584, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -6.85% (0.3896 => 0.3629, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.81% (0.3891 => 0.3626, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.79% (0.4033 => 0.3759, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.78% (0.4176 => 0.3893, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.77% (0.3884 => 0.3621, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.73% (0.9852 => 0.9189, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: -6.70% (1.2515 => 1.1676, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/08-main/main: -6.69% (0.2659 => 0.2481, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.65% (0.6484 => 0.6053, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/property: -6.64% (0.4199 => 0.3920, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.64% (0.9542 => 0.8908, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -6.64% (0.1761 => 0.1644, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.64% (0.1716 => 0.1602, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.60% (1.0544 => 0.9848, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.58% (0.2355 => 0.2200, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: -6.57% (7.0961 => 6.6296, std.dev.: 0.0124) SingleSource/UnitTests/ObjC/parameter-passing: -6.54% (0.4280 => 0.4000, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -6.54% (16.1920 => 15.1328, std.dev.: 0.0112) MultiSource/Benchmarks/MallocBench/gs/gs: -6.54% (4.3330 => 4.0497, std.dev.: 0.0184) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.51% (0.1796 => 0.1679, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -6.51% (9.2283 => 8.6273, std.dev.: 0.0153) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.48% (1.2784 => 1.1955, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/bh/bh: -6.47% (0.2985 => 0.2792, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.44% (0.1584 => 0.1482, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.44% (0.2548 => 0.2384, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.43% (5.4682 => 5.1164, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.43% (0.4151 => 0.3884, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.43% (4.5069 => 4.2171, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.43% (1.6474 => 1.5415, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.42% (4.8161 => 4.5071, std.dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: -6.39% (1.3148 => 1.2308, std.dev.: 0.0041) MultiSource/Applications/siod/siod: -6.38% (2.4021 => 2.2488, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.36% (4.8802 => 4.5699, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.30% (1.3722 => 1.2857, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/ReedSolomon: -6.28% (0.1879 => 0.1761, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.24% (0.3849 => 0.3609, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.23% (1.4642 => 1.3730, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash2: -6.21% (0.4861 => 0.4559, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.20% (0.3837 => 0.3599, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: -6.18% (0.3026 => 0.2839, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -6.18% (0.3255 => 0.3054, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.17% (0.4083 => 0.3831, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: -6.17% (0.2871 => 0.2694, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -6.16% (0.2989 => 0.2805, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.15% (2.2587 => 2.1197, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -6.15% (0.3481 => 0.3267, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.14% (0.8521 => 0.7998, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.13% (0.2903 => 0.2725, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.13% (0.3931 => 0.3690, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: -6.12% (0.3446 => 0.3235, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -6.11% (0.3323 => 0.3120, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.10% (4.0323 => 3.7862, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: -6.07% (0.3394 => 0.3188, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.06% (1.2221 => 1.1480, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.05% (0.3057 => 0.2872, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -6.04% (0.4321 => 0.4060, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: -6.03% (0.3581 => 0.3365, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.03% (0.3252 => 0.3056, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -6.01% (34.0927 => 32.0448, std.dev.: 0.0197) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.00% (2.1713 => 2.0410, std.dev.: 0.0007) MultiSource/Applications/lua/lua: -6.00% (4.0594 => 3.8158, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/nestedloop: -6.00% (0.2933 => 0.2757, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -5.99% (0.3205 => 0.3013, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.99% (1.6364 => 1.5384, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/random: -5.99% (0.2939 => 0.2763, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.99% (0.3491 => 0.3282, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.99% (0.7919 => 0.7445, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -5.98% (0.3025 => 0.2844, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.97% (0.6297 => 0.5921, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.97% (0.2278 => 0.2142, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: -5.97% (0.2849 => 0.2679, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.96% (0.6293 => 0.5918, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.96% (0.5857 => 0.5508, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.96% (0.5925 => 0.5572, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.95% (1.2210 => 1.1484, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.94% (0.4916 => 0.4624, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.92% (0.6304 => 0.5931, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: -5.91% (0.6750 => 0.6351, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.91% (0.6395 => 0.6017, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: -5.91% (0.3621 => 0.3407, std.dev.: 0.0079) MultiSource/Benchmarks/nbench/nbench: -5.91% (1.1530 => 1.0849, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.90% (0.5591 => 0.5261, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.87% (0.2385 => 0.2245, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.87% (0.2999 => 0.2823, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.87% (0.5999 => 0.5647, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.86% (0.6736 => 0.6341, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.85% (0.5705 => 0.5371, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.85% (0.5859 => 0.5516, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.85% (0.4427 => 0.4168, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -5.84% (0.3867 => 0.3641, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.84% (0.5802 => 0.5463, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.84% (0.6230 => 0.5866, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: -5.83% (0.3788 => 0.3567, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.82% (0.6052 => 0.5700, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.81% (0.5478 => 0.5160, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.80% (0.5863 => 0.5523, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: -5.80% (18.2933 => 17.2329, std.dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/football/football: -5.80% (0.9179 => 0.8647, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.79% (0.5805 => 0.5469, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -5.79% (0.3059 => 0.2882, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.78% (0.7339 => 0.6915, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: -5.77% (0.4248 => 0.4003, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.77% (0.7198 => 0.6783, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: -5.76% (0.3194 => 0.3010, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.76% (0.5575 => 0.5254, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.74% (0.5849 => 0.5513, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.74% (0.6446 => 0.6076, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.74% (0.3016 => 0.2843, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.73% (0.5570 => 0.5251, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.72% (0.9557 => 0.9010, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -5.72% (1.1450 => 1.0795, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.71% (0.6395 => 0.6030, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.70% (0.6194 => 0.5841, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.69% (0.6260 => 0.5904, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.66% (0.5581 => 0.5265, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.66% (0.5941 => 0.5605, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -5.65% (0.7447 => 0.7026, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.65% (0.2106 => 0.1987, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.64% (0.6189 => 0.5840, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.64% (0.7524 => 0.7100, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/05-eks/eks: -5.63% (0.4515 => 0.4261, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.62% (0.6667 => 0.6292, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.62% (0.6676 => 0.6301, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.60% (0.6660 => 0.6287, std.dev.: 0.0109) MultiSource/Applications/SPASS/SPASS: -5.59% (15.5079 => 14.6410, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.57% (0.5569 => 0.5259, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.55% (0.5168 => 0.4881, std.dev.: 0.0019) MultiSource/Benchmarks/sim/sim: -5.52% (0.3406 => 0.3218, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.50% (0.6033 => 0.5701, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -5.50% (0.7982 => 0.7543, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.48% (0.6440 => 0.6087, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -5.47% (2.1401 => 2.0230, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.44% (0.4813 => 0.4551, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.43% (0.7021 => 0.6640, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.43% (0.5456 => 0.5160, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.42% (0.5567 => 0.5265, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.39% (0.6681 => 0.6321, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: -5.38% (3.5154 => 3.3262, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.38% (0.5688 => 0.5382, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.36% (6.7716 => 6.4087, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.34% (8.0126 => 7.5845, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.33% (0.5329 => 0.5045, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -5.28% (0.4524 => 0.4285, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -5.22% (0.7779 => 0.7373, std.dev.: 0.0042) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.21% (0.3319 => 0.3146, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.20% (0.2001 => 0.1897, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: -5.16% (0.8418 => 0.7984, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: -5.14% (0.3271 => 0.3103, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.02% (0.3483 => 0.3308, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -4.90% (1.2300 => 1.1697, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -4.86% (17.1032 => 16.2713, std.dev.: 0.0227) SingleSource/UnitTests/ObjC++/Hello: -4.81% (0.6347 => 0.6042, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -4.72% (0.6441 => 0.6137, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.70% (0.2277 => 0.2170, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.60% (0.2695 => 0.2571, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.58% (0.9077 => 0.8661, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: -4.45% (5.0226 => 4.7991, std.dev.: 0.0028) MultiSource/Applications/hbd/hbd: -4.22% (1.5610 => 1.4952, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.97% (14.2083 => 13.6438, std.dev.: 0.0131) MultiSource/Applications/SIBsim4/SIBsim4: -3.46% (1.3864 => 1.3384, std.dev.: 0.0137) SingleSource/UnitTests/Vector/constpool: -2.76% (20.7746 => 20.2007, std.dev.: 0.0263) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7523, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/richards_benchmark: -8.75% (1.2842 => 1.1718, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.71% (2.2633 => 2.1794, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.04% (1.0557 => 1.0236, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.50% (6.5735 => 6.4751, std.dev.: 0.0010) Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 03:50:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 05:50:11 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121027105011.BA7D82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5288?compare_to=5286&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5288, Order: 166868, Start Time: 2012-10-27 09:25:59, End Time: 2012-10-27 10:50:09 To: 5286, Order: 166867, Start Time: 2012-10-27 07:45:13, End Time: 2012-10-27 09:09:07 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 8 (66 on baseline) Performance Improvements: 1 (2 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 966 (906 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.18% (0.4993 => 0.5152, std.dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: 1.52% (32.0991 => 32.5861, std.dev.: 0.0668) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.83% (14.7231 => 16.4646, std.dev.: 0.3953) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.12% (3.7220 => 3.9499, std.dev.: 0.0880) SingleSource/Benchmarks/Shootout/methcall: 3.17% (7.9805 => 8.2336, std.dev.: 0.0213) SingleSource/Benchmarks/Misc/ffbench: 1.73% (1.3952 => 1.4194, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.33% (1.4163 => 1.4352, std.dev.: 0.0031) SingleSource/Benchmarks/Stanford/FloatMM: 1.14% (0.8795 => 0.8895, std.dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -2.73% (0.6035 => 0.5870, std.dev.: 0.0051) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.12% (16.5969 => 16.6160, std.dev.: 0.1158) MultiSource/Applications/obsequi/Obsequi: 0.65% (1.0519 => 1.0587, std.dev.: 0.0100) MultiSource/Applications/sqlite3/sqlite3: -0.54% (0.6427 => 0.6392, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/08-main/main: 1.00% (0.1903 => 0.1922, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.78% (0.1594 => 0.1718, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.48% (0.3183 => 0.3230, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.96% (0.2498 => 0.2474, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.29% (0.3321 => 0.3397, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.77% (0.2436 => 0.2393, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/bigfib: 0.77% (0.6006 => 0.6052, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel: -8.91% (0.0494 => 0.0450, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.09% (0.3316 => 0.3313, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/strcat: 0.40% (0.2003 => 0.2011, std.dev.: 0.0015) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -10.86% (0.0267 => 0.0238, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.38% (0.0217 => 0.0220, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.94% (0.0424 => 0.0428, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -11.26% (0.0302 => 0.0268, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.96% (0.0312 => 0.0315, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.71% (0.0420 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 1.99% (0.0201 => 0.0205, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 9.03% (0.0144 => 0.0157, std.dev.: 0.0030) SingleSource/UnitTests/byval-alignment: -0.87% (0.0344 => 0.0341, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.34% (0.1480 => 0.1475, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: - (1.1310 => 1.1310, std.dev.: 0.0179) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.82% (0.1519 => 0.1461, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.73% (0.4102 => 0.4173, std.dev.: 0.0150) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.30% (0.1316 => 0.1312, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -80.00% (0.0005 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.57% (0.0583 => 0.0568, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 13.99% (0.0193 => 0.0220, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.11% (0.0541 => 0.0547, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.74% (1.1334 => 1.1418, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 62.50% (0.0016 => 0.0026, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.07% (0.0593 => 0.0629, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.24% (0.0247 => 0.0255, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.05% (0.8012 => 0.8016, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 59.02% (0.0061 => 0.0097, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.17% (2.1832 => 1.6555, std.dev.: 0.0062) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 34.11% (14.7684 => 19.8064, std.dev.: 0.1194) SingleSource/UnitTests/SignlessTypes/rem: 12.17% (0.1035 => 0.1161, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 11.96% (0.1112 => 0.1245, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.98% (0.2279 => 0.2438, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.79% (0.2180 => 0.2328, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.29% (0.4847 => 0.5152, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.71% (0.8321 => 0.8796, std.dev.: 0.0182) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.62% (0.1885 => 0.1991, std.dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 5.47% (1.2568 => 1.3256, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.88% (13.1811 => 13.8249, std.dev.: 0.0346) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.80% (0.7473 => 0.7832, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.60% (0.2998 => 0.3136, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.49% (0.2519 => 0.2632, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.47% (0.8148 => 0.8512, std.dev.: 0.0100) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.43% (6.6074 => 6.9003, std.dev.: 0.0259) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.38% (1.1170 => 1.1659, std.dev.: 0.0151) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.42% (0.3717 => 0.3844, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.37% (0.4127 => 0.4266, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 3.32% (1.2222 => 1.2628, std.dev.: 0.0142) MultiSource/Applications/spiff/spiff: 3.19% (0.7950 => 0.8204, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.98% (4.1763 => 4.3006, std.dev.: 0.0171) MultiSource/Benchmarks/MallocBench/gs/gs: 2.71% (4.1305 => 4.2423, std.dev.: 0.0275) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.65% (1.6386 => 1.6821, std.dev.: 0.0158) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.60% (0.5961 => 0.6116, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.51% (0.8420 => 0.8631, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.42% (0.8050 => 0.8245, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.36% (1.4479 => 1.4820, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.34% (0.9069 => 0.9281, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.29% (0.8007 => 0.8190, std.dev.: 0.0061) MultiSource/Benchmarks/Bullet/bullet: 2.28% (31.8598 => 32.5861, std.dev.: 0.0668) MultiSource/Applications/d/make_dparser: 2.22% (3.2366 => 3.3086, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.19% (0.8359 => 0.8542, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.12% (0.5191 => 0.5301, std.dev.: 0.0023) MultiSource/Applications/lemon/lemon: 2.05% (1.0945 => 1.1169, std.dev.: 0.0058) MultiSource/Applications/SPASS/SPASS: 2.05% (14.2605 => 14.5522, std.dev.: 0.0234) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.97% (0.8340 => 0.8504, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.87% (0.8457 => 0.8615, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.85% (0.8611 => 0.8770, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 1.80% (3.8189 => 3.8878, std.dev.: 0.0199) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.76% (0.6586 => 0.6702, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.76% (0.8597 => 0.8748, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.75% (0.8697 => 0.8849, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.56% (0.9056 => 0.9197, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 1.56% (8.6247 => 8.7589, std.dev.: 0.0309) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.54% (0.8805 => 0.8941, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.54% (0.8331 => 0.8459, std.dev.: 0.0039) MultiSource/Applications/JM/lencod/lencod: 1.42% (15.3280 => 15.5451, std.dev.: 0.0482) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.36% (1.2423 => 1.2592, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 1.35% (2.2184 => 2.2483, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.35% (0.8317 => 0.8429, std.dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 1.33% (6.7320 => 6.8216, std.dev.: 0.0277) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.32% (0.8086 => 0.8193, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.31% (0.9039 => 0.9157, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 1.24% (0.9810 => 0.9932, std.dev.: 0.0039) MultiSource/Benchmarks/PAQ8p/paq8p: 1.17% (2.3764 => 2.4042, std.dev.: 0.0106) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 40.67% (1.5795 => 2.2219, std.dev.: 0.1284) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.42% (14.6451 => 16.4646, std.dev.: 0.3953) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.30% (0.3186 => 0.3514, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.48% (1.1857 => 1.2862, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 5.91% (63.1822 => 66.9178, std.dev.: 0.0532) SingleSource/Benchmarks/Misc/ReedSolomon: 2.94% (8.5322 => 8.7832, std.dev.: 0.0343) SingleSource/Benchmarks/Dhrystone/dry: 2.78% (0.5081 => 0.5222, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 2.66% (3.6643 => 3.7619, std.dev.: 0.0063) MultiSource/Applications/minisat/minisat: 2.02% (6.1525 => 6.2766, std.dev.: 0.0233) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.13% (4.8362 => 4.8907, std.dev.: 0.0155) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.03% (1.4205 => 1.4352, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -5.33% (29.8330 => 28.2415, std.dev.: 0.2190) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.23% (3.3479 => 3.3068, std.dev.: 0.0018) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 1.03% (16.4461 => 16.6160, std.dev.: 0.1158) MultiSource/Applications/obsequi/Obsequi: 3.17% (1.0262 => 1.0587, std.dev.: 0.0100) MultiSource/Applications/sqlite3/sqlite3: 0.95% (0.6332 => 0.6392, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/08-main/main: 4.97% (0.1831 => 0.1922, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.20% (0.1559 => 0.1718, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.43% (0.3123 => 0.3230, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.45% (0.2463 => 0.2474, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.58% (0.3344 => 0.3397, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.23% (0.2364 => 0.2393, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/bigfib: 0.70% (0.6010 => 0.6052, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel: 4.90% (0.0429 => 0.0450, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.44% (0.3266 => 0.3313, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/strcat: 2.13% (0.1969 => 0.2011, std.dev.: 0.0015) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.25% (0.0224 => 0.0238, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.86% (0.0123 => 0.0220, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 5.51% (0.0254 => 0.0268, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -12.78% (0.0180 => 0.0157, std.dev.: 0.0030) SingleSource/UnitTests/byval-alignment: 48.26% (0.0230 => 0.0341, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.57% (0.1438 => 0.1475, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.17% (1.1329 => 1.1310, std.dev.: 0.0179) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1462 => 0.1461, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.22% (0.4164 => 0.4173, std.dev.: 0.0150) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.16% (0.1369 => 0.1312, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -11.39% (0.0641 => 0.0568, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 12.82% (0.0195 => 0.0220, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.36% (0.0578 => 0.0547, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.17% (1.1437 => 1.1418, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2500.00% (0.0001 => 0.0026, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.32% (0.0627 => 0.0629, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 41.67% (0.0180 => 0.0255, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.01% (0.8017 => 0.8016, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 56.45% (0.0062 => 0.0097, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 04:09:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 06:09:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121027110912.D37642A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5289?compare_to=5285&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5289, Order: 166868, Start Time: 2012-10-27 09:37:21, End Time: 2012-10-27 11:09:10 To: 5285, Order: 166866, Start Time: 2012-10-27 07:35:31, End Time: 2012-10-27 09:07:29 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (10 on baseline) New Passes: 0 (14 on baseline) Performance Regressions: 0 (187 on baseline) Performance Improvements: 2 (54 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 15 (5 on baseline) Unchanged Tests: 1025 (638 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.26% (9.9107 => 9.6867, std.dev.: 0.0105) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.72% (0.9646 => 0.9480, std.dev.: 0.0057) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -0.42% (2.0580 => 2.0493, std.dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: -0.46% (57.6376 => 57.3697, std.dev.: 0.0254) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.13% (0.0796 => 0.0795, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -0.61% (9.1942 => 9.1381, std.dev.: 0.0086) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.45% (7.7876 => 7.7525, std.dev.: 0.0045) SingleSource/UnitTests/Vector/SSE/sse_shift: -0.39% (0.0516 => 0.0514) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/JM/lencod/lencod: -0.04% (7.7316 => 7.7285, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: - (0.0001 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0648 => 0.0647, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.77% (0.2993 => 0.3016, std.dev.: 0.0051) SingleSource/UnitTests/Vector/SSE/sse_shift: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -64.42% (5.7591 => 2.0493, std.dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: -9.29% (63.2438 => 57.3697, std.dev.: 0.0254) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.81% (6.6874 => 0.0795, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 12.31% (8.1363 => 9.1381, std.dev.: 0.0086) SingleSource/UnitTests/Vector/SSE/sse_shift: 35.98% (0.0378 => 0.0514) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -50.00% (0.0002 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -56.68% (0.6962 => 0.3016, std.dev.: 0.0051) SingleSource/UnitTests/Vector/SSE/sse_shift: -50.00% (0.0002 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 206.62% (0.5229 => 1.6033, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 15.79% (14.9895 => 17.3562, std.dev.: 0.0180) MultiSource/Applications/kimwitu++/kc: 36.64% (14.1553 => 19.3417, std.dev.: 0.0293) MultiSource/Benchmarks/MallocBench/gs/gs: 13.26% (4.1105 => 4.6554, std.dev.: 0.0094) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 31.57% (1.1048 => 1.4536, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.71% (3.4629 => 5.8076, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/stepanov_container: 66.99% (0.6222 => 1.0390, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 3836400.00% (0.0001 => 3.8365, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 11185100.00% (0.0001 => 11.1852, std.dev.: 0.0160) MultiSource/Applications/kimwitu++/kc: 51100.00% (0.0001 => 0.0512, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050000.00% (0.0001 => 10.0501, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5487600.00% (0.0001 => 5.4877, std.dev.: 0.0030) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 77.70% (0.0296 => 0.0526, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: 66.80% (0.0256 => 0.0427, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 59.41% (0.0271 => 0.0432, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 51.44% (0.0243 => 0.0368, std.dev.: 0.0000) SingleSource/Regression/C/sumarray: 51.08% (0.0231 => 0.0349, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 42.81% (1.5859 => 2.2649, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.61% (0.0834 => 0.1181, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 39.49% (0.1056 => 0.1473, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 33.75% (2.2024 => 2.9457, std.dev.: 0.0021) SingleSource/UnitTests/vla: 33.52% (0.0355 => 0.0474, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 30.69% (0.1463 => 0.1912, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 28.07% (0.1432 => 0.1834, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 27.07% (0.1655 => 0.2103, std.dev.: 0.0001) MultiSource/Benchmarks/llubenchmark/llu: 21.65% (0.0462 => 0.0562, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: 21.03% (0.0485 => 0.0587, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.01% (0.1566 => 0.1895, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 19.74% (0.1555 => 0.1862, std.dev.: 0.0034) SingleSource/UnitTests/SignlessTypes/rem: 19.49% (0.1144 => 0.1367, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.29% (0.0871 => 0.1039, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 18.88% (0.5105 => 0.6069, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 18.08% (0.0730 => 0.0862) SingleSource/Benchmarks/BenchmarkGame/n-body: 17.83% (0.0746 => 0.0879, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.71% (1.3050 => 1.5361, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 17.61% (0.2271 => 0.2671, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.51% (0.6675 => 0.7844, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 17.50% (0.2554 => 0.3001, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/tsp/tsp: 17.36% (0.1175 => 0.1379, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.13% (0.1337 => 0.1566, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 17.02% (3.3354 => 3.9031, std.dev.: 0.0059) MultiSource/Applications/minisat/minisat: 16.81% (0.7115 => 0.8311, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 16.68% (0.3177 => 0.3707, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.67% (0.0798 => 0.0931, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 16.67% (0.1236 => 0.1442, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: 16.61% (0.0626 => 0.0730, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 16.60% (0.1584 => 0.1847, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.52% (0.0793 => 0.0924, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.47% (0.5020 => 0.5847, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.47% (0.1032 => 0.1202, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 16.46% (0.4879 => 0.5682, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 16.34% (0.3109 => 0.3617, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 16.28% (0.1695 => 0.1971, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/mst/mst: 16.25% (0.1163 => 0.1352, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.23% (1.5415 => 1.7917, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.16% (0.4615 => 0.5361, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ks/ks: 16.03% (0.1510 => 0.1752, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.01% (0.8172 => 0.9480, std.dev.: 0.0057) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 15.64% (0.1125 => 0.1301, std.dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: 15.51% (22.1758 => 25.6162, std.dev.: 0.0166) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.46% (0.0886 => 0.1023, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.36% (0.1940 => 0.2238, std.dev.: 0.0016) MultiSource/Applications/aha/aha: 15.20% (0.1151 => 0.1326, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 15.10% (0.2603 => 0.2996, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.08% (0.0842 => 0.0969, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.06% (0.3121 => 0.3591, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 15.06% (0.1906 => 0.2193, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/17-bintr/bintr: 14.96% (0.0675 => 0.0776, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 14.76% (1.1642 => 1.3360, std.dev.: 0.0064) SingleSource/Benchmarks/McGill/exptree: 14.74% (0.0814 => 0.0934, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.64% (0.6450 => 0.7394, std.dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: 14.56% (1.1840 => 1.3564, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.48% (0.9765 => 1.1179, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 14.45% (0.7433 => 0.8507, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 14.45% (0.7835 => 0.8967, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.38% (0.2107 => 0.2410, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.29% (0.2758 => 0.3152, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.23% (0.1117 => 0.1276, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.19% (0.2700 => 0.3083, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.16% (4.2646 => 4.8685, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.16% (0.0770 => 0.0879, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 14.15% (2.0273 => 2.3141, std.dev.: 0.0058) MultiSource/Applications/lemon/lemon: 14.14% (1.0722 => 1.2238, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.00% (0.2065 => 0.2354, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.98% (0.1695 => 0.1932, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 13.94% (0.8921 => 1.0165, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.79% (0.5981 => 0.6806, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.75% (0.1062 => 0.1208, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 13.69% (1.1861 => 1.3485, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.66% (1.4186 => 1.6124, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/18-imp/imp: 13.58% (0.3423 => 0.3888, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.58% (0.5860 => 0.6656, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.23% (0.1625 => 0.1840, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.22% (0.1029 => 0.1165, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 13.17% (3.8723 => 4.3823, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.08% (0.0933 => 0.1055, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 13.07% (0.4299 => 0.4861, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.96% (0.5569 => 0.6291, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.81% (0.0929 => 0.1048, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.78% (0.1330 => 0.1500, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.77% (0.1143 => 0.1289, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 12.65% (0.0838 => 0.0944, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.55% (0.3307 => 0.3722, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 12.46% (0.1268 => 0.1426, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.44% (0.3441 => 0.3869, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 12.43% (0.3387 => 0.3808, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.28% (0.3826 => 0.4296, std.dev.: 0.0117) MultiSource/Benchmarks/mafft/pairlocalalign: 12.04% (9.4845 => 10.6267, std.dev.: 0.0188) MultiSource/Benchmarks/Olden/bh/bh: 11.74% (0.3092 => 0.3455, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 11.64% (0.3180 => 0.3550, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.05% (0.1892 => 0.2101, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 11.04% (2.2969 => 2.5504, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/hash: 10.98% (0.4289 => 0.4760, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 10.92% (5.0018 => 5.5478, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 10.89% (4.9449 => 5.4833, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.83% (0.8101 => 0.8978, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.81% (0.3543 => 0.3926, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 10.70% (0.0953 => 0.1055, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 10.44% (0.6456 => 0.7130, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 10.39% (0.3927 => 0.4335, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 10.39% (0.4620 => 0.5100, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.39% (14.3668 => 15.8593, std.dev.: 0.0166) SingleSource/UnitTests/ObjC/trivial-interface: 10.34% (0.3473 => 0.3832, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.19% (0.3561 => 0.3924, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.19% (0.3543 => 0.3904, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.16% (0.3828 => 0.4217, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 10.15% (0.3516 => 0.3873, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.15% (0.1044 => 0.1150, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: 10.15% (0.2049 => 0.2257, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.14% (2.2022 => 2.4254, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.07% (0.3694 => 0.4066, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.07% (0.3497 => 0.3849, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.86% (0.4636 => 0.5093, std.dev.: 0.0103) SingleSource/UnitTests/ObjC/property: 9.80% (0.3886 => 0.4267, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.63% (0.3427 => 0.3757, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 9.63% (17.1811 => 18.8352, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.44% (0.3865 => 0.4230, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.42% (0.2430 => 0.2659, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 9.34% (1.5603 => 1.7061, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/lists: 9.26% (0.3422 => 0.3739, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.26% (0.4203 => 0.4592, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 8.99% (0.4048 => 0.4412, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 8.93% (0.3684 => 0.4013, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.69% (0.6030 => 0.6554, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.68% (0.4103 => 0.4459, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 8.67% (0.7326 => 0.7961, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.66% (0.5925 => 0.6438, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.48% (3.8922 => 4.2221, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/sieve: 8.22% (0.3603 => 0.3899, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.78% (0.4064 => 0.4380, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.55% (0.2793 => 0.3004, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.51% (0.2756 => 0.2963, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.47% (0.2905 => 0.3122, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.37% (0.3650 => 0.3919, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.34% (0.2725 => 0.2925, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 7.23% (0.3098 => 0.3322, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 7.22% (0.2714 => 0.2910, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.16% (0.2891 => 0.3098, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 7.14% (0.2831 => 0.3033, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.03% (0.2872 => 0.3074, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.91% (0.3283 => 0.3510, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.87% (0.3232 => 0.3454, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.83% (0.3162 => 0.3378, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.82% (0.3052 => 0.3260, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.80% (2.0665 => 2.2070, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/oourafft: 6.79% (0.3282 => 0.3505, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/except: 6.79% (0.2871 => 0.3066, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/random: 6.71% (0.2802 => 0.2990, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.71% (0.2266 => 0.2418, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.67% (0.2877 => 0.3069, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.48% (0.8067 => 0.8590, std.dev.: 0.0059) MultiSource/Applications/hexxagon/hexxagon: 6.47% (1.2842 => 1.3673, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary2: 6.33% (0.3379 => 0.3593, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.29% (0.3136 => 0.3302, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.60% (0.3131 => 0.3275, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.45% (7.9617 => 8.3159, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.46% (0.3935 => 0.4071, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.45% (7.0540 => 7.2267, std.dev.: 0.0088) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.10% (1.1145 => 1.3719, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 10.91% (0.9957 => 1.1043, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: 9.89% (1.1396 => 1.2523, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.94% (2.8904 => 3.0909, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.61% (3.1578 => 3.3665, std.dev.: 0.0011) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: 4.50% (3.3453 => 3.4960, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 2.98% (1.9405 => 1.9984, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.69% (4.2280 => 4.3416, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 2.43% (4.4649 => 4.5735, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/bisort/bisort: 1.74% (0.8333 => 0.8478, std.dev.: 0.0012) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2079, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.48% (9.1159 => 9.2510, std.dev.: 0.0134) MultiSource/Benchmarks/nbench/nbench: 1.44% (11.6436 => 11.8107, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.01% (6.5088 => 6.5746, std.dev.: 0.0071) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -76.43% (0.8651 => 0.2039, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.35% (5.3855 => 2.4045, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -55.02% (5.3526 => 2.4075, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/richards_benchmark: -45.50% (0.1622 => 0.0884, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.12% (1.1194 => 0.6815, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.06% (5.2763 => 3.2156, std.dev.: 0.0146) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -23.91% (1.7609 => 1.3398, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -17.44% (2.9384 => 2.4259, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -8.83% (54.1659 => 49.3839, std.dev.: 0.0054) MultiSource/Applications/JM/ldecod/ldecod: -8.67% (10.4361 => 9.5317, std.dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: -6.56% (10.3673 => 9.6867, std.dev.: 0.0105) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -54.02% (8.0499 => 3.7010, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0133, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.42% (1.1492 => 0.7651, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.81% (0.0506 => 0.0340, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.58% (0.3987 => 0.2688, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.51% (2.9695 => 2.3605, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -19.00% (1.2258 => 0.9929, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -16.02% (1.6925 => 1.4214, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -10.99% (9.5636 => 8.5127, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: -10.94% (1.5373 => 1.3691, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/chomp: -10.76% (1.2373 => 1.1042, std.dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.36% (19.9488 => 18.2815, std.dev.: 0.0133) MultiSource/Benchmarks/FreeBench/mason/mason: -8.01% (0.2161 => 0.1988, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.03% (1.8329 => 1.7040, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.62% (2.7294 => 2.5760, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -5.46% (6.6465 => 6.2833, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.11% (1.6805 => 1.5946, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: -5.01% (1.5835 => 1.5042, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.73% (0.2497 => 0.2379) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.93% (8.1563 => 7.8359, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.69% (3.2827 => 3.1616, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.49% (32.5116 => 31.3763, std.dev.: 0.0018) MultiSource/Benchmarks/sim/sim: -3.33% (5.0483 => 4.8803, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.82% (4.5009 => 4.3739, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -2.78% (4.6441 => 4.5148, std.dev.: 0.0071) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.68% (0.4808 => 0.4679, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/multiplies: -1.95% (2.5528 => 2.5029, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6815, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -1.64% (10.2830 => 10.1142, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: -1.62% (1.1277 => 1.1094, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -1.19% (85.0658 => 84.0507, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7055, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8590, std.dev.: 0.0101) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.30% (7.1582 => 7.7525, std.dev.: 0.0045) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: 10634.03% (0.0720 => 7.7285, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.42% (0.2116 => 0.0647, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 04:33:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 06:33:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121027113303.DE2AD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5290?compare_to=5287&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5290, Order: 166869, Start Time: 2012-10-27 10:04:58, End Time: 2012-10-27 11:32:59 To: 5287, Order: 166868, Start Time: 2012-10-27 08:16:28, End Time: 2012-10-27 09:41:42 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 3 (6 on baseline) Performance Improvements: 1 (178 on baseline) Unchanged Tests: 1038 (858 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.14% (2.0410 => 2.0643, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.94% (54.3460 => 56.4874, std.dev.: 0.0500) SingleSource/Benchmarks/McGill/chomp: 1.25% (1.1470 => 1.1613, std.dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.76% (1.2980 => 1.2622, std.dev.: 0.0087) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 18.85% (15.2527 => 18.1276, std.dev.: 0.0132) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.29% (1.2783 => 1.3715, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.50% (54.5751 => 56.4874, std.dev.: 0.0500) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.67% (2.0478 => 2.1024, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/salsa20: 2.32% (7.4937 => 7.6672, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/hash2: 2.28% (3.1932 => 3.2660, std.dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.01% (0.1431 => 0.1302, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.67% (0.3821 => 0.3528, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -7.14% (2.4924 => 2.3145, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.96% (0.2428 => 0.2259, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.84% (22.4056 => 20.8724, std.dev.: 0.0145) MultiSource/Applications/sgefa/sgefa: -6.73% (0.3357 => 0.3131, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.73% (3.5339 => 3.2960, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.65% (0.3142 => 0.2933, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.55% (0.9542 => 0.8917, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.53% (0.3658 => 0.3419, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.49% (0.6484 => 0.6063, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/oourafft: -6.44% (0.2160 => 0.2021, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.41% (0.9852 => 0.9220, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.41% (0.1716 => 0.1606, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.29% (1.0544 => 0.9881, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: -6.27% (4.3330 => 4.0612, std.dev.: 0.0106) SingleSource/Benchmarks/McGill/chomp: -6.25% (0.1761 => 0.1651, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.17% (1.6474 => 1.5457, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -6.17% (0.2659 => 0.2495, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -6.14% (0.3812 => 0.3578, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -6.13% (0.3831 => 0.3596, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -6.13% (0.3880 => 0.3642, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: -6.13% (0.2985 => 0.2802, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: -6.13% (9.2283 => 8.6626, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.12% (0.1796 => 0.1686, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.11% (0.2355 => 0.2211, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.10% (0.3884 => 0.3647, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: -6.07% (1.2515 => 1.1755, std.dev.: 0.0088) SingleSource/UnitTests/ObjC/exceptions: -6.06% (0.4176 => 0.3923, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.04% (4.8161 => 4.5251, std.dev.: 0.0037) MultiSource/Applications/JM/ldecod/ldecod: -6.04% (7.0961 => 6.6675, std.dev.: 0.0651) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.04% (1.2784 => 1.2012, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.01% (0.3891 => 0.3657, std.dev.: 0.0012) MultiSource/Applications/siod/siod: -6.00% (2.4021 => 2.2579, std.dev.: 0.0526) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.99% (5.4682 => 5.1408, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.97% (0.2548 => 0.2396, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.96% (1.3722 => 1.2904, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.95% (4.8802 => 4.5897, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/for-in: -5.95% (0.4033 => 0.3793, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -5.93% (0.3848 => 0.3620, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.91% (4.5069 => 4.2407, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.88% (0.4151 => 0.3907, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: -5.88% (16.1920 => 15.2407, std.dev.: 0.2102) SingleSource/UnitTests/ObjC/synchronized: -5.85% (0.3896 => 0.3668, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.85% (0.7919 => 0.7456, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/parameter-passing: -5.84% (0.4280 => 0.4030, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -5.83% (0.4199 => 0.3954, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -5.80% (4.0594 => 3.8240, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.79% (1.4642 => 1.3794, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.76% (2.2587 => 2.1285, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.73% (0.4813 => 0.4537, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.64% (0.5478 => 0.5169, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.62% (0.8521 => 0.8042, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.62% (0.5999 => 0.5662, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.60% (0.2999 => 0.2831, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.59% (1.6364 => 1.5449, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.59% (0.5925 => 0.5594, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.57% (4.0323 => 3.8079, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/05-eks/eks: -5.56% (0.4515 => 0.4264, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: -5.56% (0.3581 => 0.3382, std.dev.: 0.0051) MultiSource/Benchmarks/nbench/nbench: -5.55% (1.1530 => 1.0890, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: -5.54% (1.3148 => 1.2419, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.53% (0.4321 => 0.4082, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.53% (0.6293 => 0.5945, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.52% (0.3931 => 0.3714, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: -5.51% (0.4861 => 0.4593, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.51% (0.4916 => 0.4645, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.50% (0.5581 => 0.5274, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.50% (1.2221 => 1.1549, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.49% (0.6681 => 0.6314, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.49% (0.2385 => 0.2254, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.49% (0.2278 => 0.2153, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.48% (0.5863 => 0.5542, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.47% (0.5591 => 0.5285, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.47% (0.6194 => 0.5855, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.47% (1.2210 => 1.1542, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.46% (0.4083 => 0.3860, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.46% (0.6395 => 0.6046, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: -5.46% (0.3446 => 0.3258, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.45% (0.3319 => 0.3138, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.45% (0.6297 => 0.5954, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.45% (0.3837 => 0.3628, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: -5.44% (0.9179 => 0.8680, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: -5.42% (0.3394 => 0.3210, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -5.42% (34.0927 => 32.2449, std.dev.: 0.0243) SingleSource/Benchmarks/Shootout-C++/except: -5.42% (0.3026 => 0.2862, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.41% (0.5805 => 0.5491, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.40% (0.6052 => 0.5725, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -5.39% (0.6750 => 0.6386, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.39% (0.6676 => 0.6316, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/strcat: -5.39% (0.2989 => 0.2828, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: -5.38% (18.2933 => 17.3089, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.38% (0.6230 => 0.5895, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.37% (0.6260 => 0.5924, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.36% (0.5857 => 0.5543, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.35% (0.6667 => 0.6310, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.33% (0.6304 => 0.5968, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.33% (0.3491 => 0.3305, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.32% (0.2106 => 0.1994, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.31% (0.5705 => 0.5402, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -5.30% (0.3621 => 0.3429, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -5.29% (1.1450 => 1.0844, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -5.29% (0.7447 => 0.7053, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -5.28% (0.3255 => 0.3083, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.28% (0.6189 => 0.5862, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.28% (0.5168 => 0.4895, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.27% (0.6446 => 0.6106, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.27% (0.5802 => 0.5496, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.27% (0.5941 => 0.5628, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.27% (0.7198 => 0.6819, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.26% (0.6440 => 0.6101, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -5.26% (0.2871 => 0.2720, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.25% (0.7524 => 0.7129, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.24% (0.6395 => 0.6060, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.24% (0.5329 => 0.5050, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.23% (0.3252 => 0.3082, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -5.23% (0.3406 => 0.3228, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.22% (0.9557 => 0.9058, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.20% (0.6033 => 0.5719, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -5.20% (0.3481 => 0.3300, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.18% (0.5849 => 0.5546, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.16% (0.7021 => 0.6659, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.15% (0.5570 => 0.5283, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.14% (0.3849 => 0.3651, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.14% (0.5859 => 0.5558, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -5.14% (0.7982 => 0.7572, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.14% (0.5569 => 0.5283, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.13% (0.5456 => 0.5176, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: -5.12% (15.5079 => 14.7132, std.dev.: 0.2128) SingleSource/Benchmarks/Shootout-C++/sieve: -5.12% (0.3788 => 0.3594, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -5.12% (0.3867 => 0.3669, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.10% (0.2903 => 0.2755, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.09% (0.5575 => 0.5291, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -5.09% (0.3205 => 0.3042, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.08% (0.5567 => 0.5284, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.04% (0.3057 => 0.2903, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.03% (0.6736 => 0.6397, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.03% (0.6660 => 0.6325, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.03% (0.3323 => 0.3156, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.01% (0.4427 => 0.4205, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -5.00% (0.7779 => 0.7390, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.94% (0.3016 => 0.2867, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.93% (6.7716 => 6.4377, std.dev.: 0.0050) MultiSource/Applications/spiff/spiff: -4.93% (0.8418 => 0.8003, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.93% (2.1713 => 2.0643, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: -4.91% (0.2849 => 0.2709, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/moments: -4.90% (0.4248 => 0.4040, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.87% (8.0126 => 7.6222, std.dev.: 0.0062) MultiSource/Applications/d/make_dparser: -4.85% (3.5154 => 3.3450, std.dev.: 0.0537) MultiSource/Benchmarks/McCat/09-vor/vor: -4.83% (0.3271 => 0.3113, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.82% (0.5688 => 0.5414, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.81% (0.2933 => 0.2792, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -4.79% (0.3025 => 0.2880, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -4.79% (0.3194 => 0.3041, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: -4.74% (2.1401 => 2.0386, std.dev.: 0.0109) SingleSource/Regression/C++/ofstream_ctor: -4.74% (0.3059 => 0.2914, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -4.73% (0.6347 => 0.6047, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: -4.71% (0.4524 => 0.4311, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -4.64% (0.6441 => 0.6142, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.54% (0.3483 => 0.3325, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -4.41% (1.2300 => 1.1757, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -4.40% (17.1032 => 16.3510, std.dev.: 0.0136) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.19% (0.2695 => 0.2582, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.02% (0.9077 => 0.8712, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: -3.98% (5.0226 => 4.8225, std.dev.: 0.0600) MultiSource/Applications/hbd/hbd: -3.80% (1.5610 => 1.5017, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.53% (14.2083 => 13.7071, std.dev.: 0.0132) MultiSource/Applications/SIBsim4/SIBsim4: -2.97% (1.3864 => 1.3452, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -2.48% (20.7746 => 20.2597, std.dev.: 0.0139) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7559, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -8.78% (1.2842 => 1.1715, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: -3.94% (2.2633 => 2.1741, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.62% (1.3096 => 1.2622, std.dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.07% (1.0557 => 1.0233, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.56% (6.5735 => 6.4712, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0005) Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 05:11:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 07:11:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121027121105.515882A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5291?compare_to=5284&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5291, Order: 166868, Start Time: 2012-10-27 08:54:16, End Time: 2012-10-27 12:11:02 To: 5284, Order: 166863, Start Time: 2012-10-27 04:48:05, End Time: 2012-10-27 08:06:00 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (168 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1037 (722 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 2.24% (2.4323 => 2.4869, std.dev.: 0.0050) MultiSource/Applications/oggenc/oggenc: 1.54% (1.9691 => 1.9994, std.dev.: 0.0087) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/dry: 1.06% (14.2807 => 14.4322, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/methcall: 1.05% (16.2066 => 16.3763, std.dev.: 0.0127) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/ObjC/synchronized: -13.48% (0.1217 => 0.1053, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.44% (0.0625 => 0.0884, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.17% (0.1063 => 0.1405, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.91% (0.0714 => 0.0899, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.63% (0.2969 => 0.3730, std.dev.: 0.0039) MultiSource/Applications/oggenc/oggenc: 25.50% (1.5932 => 1.9994, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.42% (0.4253 => 0.5334, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 25.22% (0.0452 => 0.0566, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.14% (0.1106 => 0.1384, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.01% (0.4139 => 0.5174, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.67% (0.4994 => 0.6226, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.19% (0.0897 => 0.1114, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.73% (0.5900 => 0.7300, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.95% (0.0475 => 0.0584, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.85% (0.0547 => 0.0672, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.77% (0.0584 => 0.0717, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.74% (0.5000 => 0.6137, std.dev.: 0.0025) MultiSource/Applications/viterbi/viterbi: 21.96% (0.0947 => 0.1155, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/tsp/tsp: 21.70% (0.0599 => 0.0729, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.65% (0.1021 => 0.1242, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.60% (0.1620 => 0.1970, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.50% (0.1107 => 0.1345, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 20.70% (0.0604 => 0.0729, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.67% (0.1103 => 0.1331, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 20.46% (0.0948 => 0.1142, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.38% (0.0633 => 0.0762, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.32% (0.3903 => 0.4696, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.21% (0.0584 => 0.0702, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.15% (0.0541 => 0.0650, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.09% (0.0642 => 0.0771, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.08% (0.1549 => 0.1860, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 19.89% (0.1619 => 0.1941, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.84% (0.1003 => 0.1202, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 19.73% (0.0821 => 0.0983, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.64% (0.1604 => 0.1919, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.34% (0.0822 => 0.0981, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.81% (0.1462 => 0.1737, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.46% (0.2736 => 0.3241, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.41% (0.3890 => 0.4606, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 18.25% (0.5826 => 0.6889, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 18.19% (0.0808 => 0.0955, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.04% (1.3152 => 1.5525, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.97% (0.2014 => 0.2376, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 17.90% (0.1218 => 0.1436, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 17.87% (0.1505 => 0.1774, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 17.81% (0.5889 => 0.6938, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.81% (0.5026 => 0.5921, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 17.57% (0.4029 => 0.4737, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/mst/mst: 17.48% (0.0698 => 0.0820, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 17.45% (0.5546 => 0.6514, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 17.38% (0.0581 => 0.0682, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.38% (0.2866 => 0.3364, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.37% (0.1088 => 0.1277, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 17.27% (1.8794 => 2.2040, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.07% (0.1968 => 0.2304, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.90% (0.2875 => 0.3361, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.82% (3.5627 => 4.1619, std.dev.: 0.0035) MultiSource/Applications/hbd/hbd: 16.65% (0.9697 => 1.1312, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.64% (0.4658 => 0.5433, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 16.61% (0.1421 => 0.1657, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/fibo: 16.55% (0.2725 => 0.3176, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.42% (1.6211 => 1.8873, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 16.36% (0.2714 => 0.3158, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.33% (0.4361 => 0.5073, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 16.30% (0.7171 => 0.8340, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.29% (0.1160 => 0.1349, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.29% (0.2738 => 0.3184, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 16.21% (0.3004 => 0.3491, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 16.19% (1.0781 => 1.2526, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.17% (0.3271 => 0.3800, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.12% (0.2729 => 0.3169, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 16.07% (0.2750 => 0.3192, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 16.04% (0.2780 => 0.3226, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.96% (0.3195 => 0.3705, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 15.95% (0.2803 => 0.3250, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 15.94% (0.9909 => 1.1488, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: 15.89% (0.2813 => 0.3260, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 15.83% (0.2811 => 0.3256, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 15.83% (0.3096 => 0.3586, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.80% (0.2911 => 0.3371, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 15.80% (0.2823 => 0.3269, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.78% (2.0673 => 2.3935, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.76% (0.2792 => 0.3232, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists: 15.74% (0.3348 => 0.3875, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: 15.73% (0.1284 => 0.1486, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 15.70% (4.2109 => 4.8720, std.dev.: 0.0224) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.58% (4.4195 => 5.1082, std.dev.: 0.0128) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.50% (0.3930 => 0.4539, std.dev.: 0.0033) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.44% (2.7292 => 3.1507, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 15.28% (0.3317 => 0.3824, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 15.27% (0.3267 => 0.3766, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.19% (1.9966 => 2.2998, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.16% (1.9694 => 2.2679, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary: 15.13% (0.3258 => 0.3751, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.07% (0.3060 => 0.3521, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.05% (0.3362 => 0.3868, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.05% (0.1090 => 0.1254, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 15.00% (0.2566 => 0.2951, std.dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: 14.87% (23.5202 => 27.0176, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.56% (0.3124 => 0.3579, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 14.52% (0.3477 => 0.3982, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 14.41% (0.3678 => 0.4208, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 14.36% (0.2075 => 0.2373, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 14.30% (0.3726 => 0.4259, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.23% (0.3282 => 0.3749, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/hash: 14.11% (0.4146 => 0.4731, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.04% (0.3625 => 0.4134, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.01% (0.3690 => 0.4207, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 13.99% (0.3496 => 0.3985, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 13.93% (0.4251 => 0.4843, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 13.92% (1.4269 => 1.6255, std.dev.: 0.0069) MultiSource/Applications/SIBsim4/SIBsim4: 13.86% (0.2691 => 0.3064, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.79% (0.3981 => 0.4530, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.60% (0.3845 => 0.4368, std.dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 13.60% (2.1653 => 2.4597, std.dev.: 0.0018) MultiSource/Applications/treecc/treecc: 13.57% (0.7875 => 0.8944, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions-2: 13.55% (0.3446 => 0.3913, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 13.54% (0.3465 => 0.3934, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.50% (0.3488 => 0.3959, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 13.50% (0.3460 => 0.3927, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 13.49% (0.3469 => 0.3937, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 13.48% (0.3442 => 0.3906, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 13.37% (0.5012 => 0.5682, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 13.27% (4.6177 => 5.2305, std.dev.: 0.0101) SingleSource/UnitTests/ObjC/property: 13.23% (0.3650 => 0.4133, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 13.12% (0.3643 => 0.4121, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 13.02% (0.3724 => 0.4209, std.dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 12.64% (2.1013 => 2.3670, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.60% (0.2040 => 0.2297, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 12.30% (5.5417 => 6.2235, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 12.21% (0.3498 => 0.3925, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.15% (0.6435 => 0.7217, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 11.68% (0.6634 => 0.7409, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.57% (0.1383 => 0.1543, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.48% (0.1028 => 0.1146, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 11.39% (0.3336 => 0.3716, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.92% (0.2737 => 0.3036) MultiSource/Benchmarks/PAQ8p/paq8p: 10.56% (0.4847 => 0.5359, std.dev.: 0.0023) MultiSource/Applications/lemon/lemon: 10.33% (0.2391 => 0.2638, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.28% (0.3084 => 0.3401, std.dev.: 0.0046) MultiSource/Applications/sqlite3/sqlite3: 9.91% (2.0346 => 2.2362, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.89% (0.2103 => 0.2311, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.46% (4.6926 => 5.1367, std.dev.: 0.0733) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.08% (11.6398 => 12.6963, std.dev.: 0.0170) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.86% (0.5584 => 0.6023, std.dev.: 0.0089) MultiSource/Applications/kimwitu++/kc: 6.80% (11.9555 => 12.7682, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.14% (0.3792 => 0.3949, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 64.38% (0.2162 => 0.3554, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6532, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.66% (0.0734 => 0.0871, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0300, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.22% (0.5917 => 0.6699, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 10.67% (0.2802 => 0.3101, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6101, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 5.09% (12.0509 => 12.6640, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.82% (0.3693 => 0.3871, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: 4.72% (15.4430 => 16.1713, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-2: 3.96% (1.8057 => 1.8772, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/dry: 2.73% (14.0481 => 14.4322, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1927, std.dev.: 0.0066) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.71% (3.1722 => 3.2266, std.dev.: 0.0019) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3063, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.46% (1.0927 => 1.1086, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2869, std.dev.: 0.0038) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.40% (1.0142 => 1.0284, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5137, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5399, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5987, std.dev.: 0.0174) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.58% (25.4195 => 16.3763, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/ary2: -10.41% (0.2402 => 0.2152, std.dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9763, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -7.67% (35.5013 => 32.7798, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/tsp/tsp: -7.19% (2.1113 => 1.9595, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.45% (11.2080 => 10.8210, std.dev.: 0.0389) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7728, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.00% (0.6293 => 0.6104, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/mandel-2: -2.90% (3.6262 => 3.5212, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -2.53% (17.2379 => 16.8010, std.dev.: 0.0321) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.21% (41.7953 => 40.8714, std.dev.: 0.0085) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.81% (10.7630 => 10.5686, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4955, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7160, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.05% (3.3991 => 3.3633, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0457, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.01% (105.3826 => 104.3163, std.dev.: 0.0366) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 05:32:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 07:32:12 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121027123212.1965B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5292?compare_to=5288&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5292, Order: 166870, Start Time: 2012-10-27 11:07:22, End Time: 2012-10-27 12:32:10 To: 5288, Order: 166868, Start Time: 2012-10-27 09:25:59, End Time: 2012-10-27 10:50:09 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 14 (83 on baseline) Performance Improvements: 3 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 958 (887 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 5.49% (0.3208 => 0.3384, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.20% (1.2454 => 1.2977, std.dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.90% (0.6223 => 0.6466, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.69% (0.4850 => 0.5029, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.42% (0.7832 => 0.8100, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.66% (0.8512 => 0.8738, std.dev.: 0.0081) MultiSource/Applications/spiff/spiff: 2.52% (0.8204 => 0.8411, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.46% (1.4820 => 1.5036, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.37% (0.8156 => 0.8268, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.32% (0.9806 => 0.9935, std.dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: 1.12% (15.5451 => 15.7196, std.dev.: 0.0524) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.09% (0.9157 => 0.9257, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 3.03% (3.9499 => 4.0695, std.dev.: 0.0439) SingleSource/Benchmarks/Shootout-C++/methcall: 1.55% (8.9126 => 9.0505, std.dev.: 0.0104) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.03% (16.4646 => 15.4721, std.dev.: 0.2689) SingleSource/Benchmarks/Dhrystone/dry: -2.26% (0.5222 => 0.5104, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -2.24% (1.4352 => 1.4031, std.dev.: 0.0112) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.10% (16.6160 => 16.6318, std.dev.: 0.3221) MultiSource/Applications/obsequi/Obsequi: 1.45% (1.0587 => 1.0741, std.dev.: 0.0072) MultiSource/Applications/sqlite3/sqlite3: 3.27% (0.6392 => 0.6601, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 1.30% (0.1922 => 0.1947, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.47% (0.1718 => 0.1726, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.86% (0.3230 => 0.3290, std.dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.26% (0.2474 => 0.2530, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.68% (0.3397 => 0.3420, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.42% (0.2393 => 0.2359, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: 0.15% (0.6052 => 0.6061, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/mandel: - (0.0450 => 0.0450, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.78% (0.3313 => 0.3339, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 0.15% (0.2011 => 0.2014, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.42% (0.0238 => 0.0239, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.82% (0.0220 => 0.0224, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -7.01% (0.0428 => 0.0398, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 27.61% (0.0268 => 0.0342, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.54% (0.0315 => 0.0323, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 2.60% (0.0423 => 0.0434, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/casts: 1.95% (0.0205 => 0.0209, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 42.68% (0.0157 => 0.0224, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: -3.52% (0.0341 => 0.0329, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.27% (0.1475 => 0.1471, std.dev.: 0.0029) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.39% (1.1310 => 1.1580, std.dev.: 0.0403) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 4.04% (0.1461 => 0.1520, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.80% (0.4173 => 0.4056, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.53% (0.1312 => 0.1319, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.62% (0.0568 => 0.0634, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 18.64% (0.0220 => 0.0261, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: - (0.0547 => 0.0547, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.57% (1.1418 => 1.1483, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 19.23% (0.0026 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0629 => 0.0629, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.06% (0.0255 => 0.0237, std.dev.: 0.0048) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.04% (0.8016 => 0.8013, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -25.77% (0.0097 => 0.0072, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.31% (2.1832 => 1.6524, std.dev.: 0.0075) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 34.82% (14.7684 => 19.9111, std.dev.: 0.1651) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.05% (0.0810 => 0.0940, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.77% (0.0830 => 0.0936, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 12.77% (0.1112 => 0.1254, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/rem: 11.11% (0.1035 => 0.1150, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.25% (0.1157 => 0.1264, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.06% (0.1137 => 0.1240, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.69% (0.4847 => 0.5268, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.39% (0.7473 => 0.8100, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.21% (0.2180 => 0.2359, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.94% (0.2519 => 0.2719, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.87% (0.3137 => 0.3384, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/health/health: 7.80% (0.1347 => 0.1452, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.79% (0.1425 => 0.1536, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.59% (0.6010 => 0.6466, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.37% (0.1885 => 0.2024, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.24% (0.8148 => 0.8738, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.20% (0.2279 => 0.2443, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.15% (0.1983 => 0.2105, std.dev.: 0.0033) MultiSource/Applications/spiff/spiff: 5.80% (0.7950 => 0.8411, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.79% (0.3003 => 0.3177, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.77% (0.2998 => 0.3171, std.dev.: 0.0035) MultiSource/Applications/SIBsim4/SIBsim4: 5.70% (1.2568 => 1.3284, std.dev.: 0.0089) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.66% (1.1170 => 1.1802, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.51% (13.1811 => 13.9077, std.dev.: 0.1067) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.14% (0.4783 => 0.5029, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.08% (1.1606 => 1.2196, std.dev.: 0.0152) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.00% (0.2741 => 0.2878, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.76% (8.6476 => 9.0594, std.dev.: 0.1178) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.64% (0.2240 => 0.2344, std.dev.: 0.0021) MultiSource/Applications/Burg/burg: 4.51% (1.2222 => 1.2773, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.33% (1.6386 => 1.7096, std.dev.: 0.0180) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.26% (0.2794 => 0.2913, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.13% (0.3124 => 0.3253, std.dev.: 0.0024) MultiSource/Applications/hbd/hbd: 4.04% (1.4269 => 1.4845, std.dev.: 0.0121) MultiSource/Benchmarks/MallocBench/gs/gs: 4.01% (4.1305 => 4.2961, std.dev.: 0.0572) MultiSource/Benchmarks/McCat/05-eks/eks: 3.89% (0.4397 => 0.4568, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.85% (1.4479 => 1.5036, std.dev.: 0.0075) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.66% (0.3717 => 0.3853, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.55% (4.1763 => 4.3247, std.dev.: 0.0429) MultiSource/Benchmarks/nbench/nbench: 3.55% (1.1271 => 1.1671, std.dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.16% (0.4559 => 0.4703, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.14% (4.4880 => 4.6288, std.dev.: 0.0494) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.96% (0.8611 => 0.8866, std.dev.: 0.0021) MultiSource/Applications/lua/lua: 2.95% (3.8189 => 3.9314, std.dev.: 0.0285) MultiSource/Applications/SPASS/SPASS: 2.87% (14.2605 => 14.6696, std.dev.: 0.0606) MultiSource/Applications/lemon/lemon: 2.83% (1.0945 => 1.1255, std.dev.: 0.0072) MultiSource/Applications/d/make_dparser: 2.77% (3.2366 => 3.3263, std.dev.: 0.0226) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.77% (0.8712 => 0.8953, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.58% (0.8457 => 0.8675, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 2.57% (0.4125 => 0.4231, std.dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 2.55% (15.3280 => 15.7196, std.dev.: 0.0524) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.55% (0.9688 => 0.9935, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.50% (0.8066 => 0.8268, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.41% (0.9039 => 0.9257, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.37% (0.8050 => 0.8241, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.34% (0.8597 => 0.8798, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.31% (0.8656 => 0.8856, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.30% (0.8340 => 0.8532, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.25% (0.7966 => 0.8145, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.17% (0.8338 => 0.8519, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.17% (0.8716 => 0.8905, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.15% (0.8855 => 0.9045, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.13% (0.8359 => 0.8537, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.08% (0.9069 => 0.9258, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.05% (1.2423 => 1.2678, std.dev.: 0.0037) MultiSource/Benchmarks/Bullet/bullet: 1.97% (31.8598 => 32.4859, std.dev.: 0.1881) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.90% (0.8885 => 0.9054, std.dev.: 0.0035) MultiSource/Applications/JM/ldecod/ldecod: 1.89% (6.7320 => 6.8593, std.dev.: 0.0318) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.82% (0.8316 => 0.8467, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.74% (0.8927 => 0.9082, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.65% (3.1832 => 3.2356, std.dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.35% (1.5315 => 1.5522, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.89% (0.3186 => 0.3501, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.49% (1.1857 => 1.2864, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/18-imp/imp: 7.52% (0.1370 => 0.1473, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 5.95% (63.1822 => 66.9438, std.dev.: 0.0965) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.65% (14.6451 => 15.4721, std.dev.: 0.2689) MultiSource/Benchmarks/FreeBench/distray/distray: 4.73% (0.2390 => 0.2503, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 3.85% (3.9188 => 4.0695, std.dev.: 0.0439) SingleSource/Benchmarks/Misc/ReedSolomon: 2.72% (8.5322 => 8.7639, std.dev.: 0.0435) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.79% (0.6150 => 0.6260, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.50% (59.2638 => 60.1535, std.dev.: 0.2462) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -5.09% (29.8330 => 28.3134, std.dev.: 0.2469) SingleSource/Benchmarks/Shootout-C++/hash2: -1.46% (3.4237 => 3.3737, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/ffbench: -1.40% (1.4296 => 1.4096, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.20% (3.3479 => 3.3076, std.dev.: 0.0141) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 1.13% (16.4461 => 16.6318, std.dev.: 0.3221) MultiSource/Applications/obsequi/Obsequi: 4.67% (1.0262 => 1.0741, std.dev.: 0.0072) MultiSource/Applications/sqlite3/sqlite3: 4.25% (0.6332 => 0.6601, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 6.34% (0.1831 => 0.1947, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.71% (0.1559 => 0.1726, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.35% (0.3123 => 0.3290, std.dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.72% (0.2463 => 0.2530, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.27% (0.3344 => 0.3420, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.21% (0.2364 => 0.2359, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: 0.85% (0.6010 => 0.6061, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/mandel: 4.90% (0.0429 => 0.0450, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.24% (0.3266 => 0.3339, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 2.29% (0.1969 => 0.2014, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.70% (0.0224 => 0.0239, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 82.11% (0.0123 => 0.0224, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.45% (0.0408 => 0.0398, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 34.65% (0.0254 => 0.0342, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 6.95% (0.0302 => 0.0323, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 13.02% (0.0384 => 0.0434, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/casts: 10.00% (0.0190 => 0.0209, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 24.44% (0.0180 => 0.0224, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: 43.04% (0.0230 => 0.0329, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.29% (0.1438 => 0.1471, std.dev.: 0.0029) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.22% (1.1329 => 1.1580, std.dev.: 0.0403) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.97% (0.1462 => 0.1520, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.59% (0.4164 => 0.4056, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.65% (0.1369 => 0.1319, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.09% (0.0641 => 0.0634, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 33.85% (0.0195 => 0.0261, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.36% (0.0578 => 0.0547, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.40% (1.1437 => 1.1483, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.32% (0.0627 => 0.0629, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 31.67% (0.0180 => 0.0237, std.dev.: 0.0048) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.05% (0.8017 => 0.8013, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 16.13% (0.0062 => 0.0072, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 06:10:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 08:10:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121027131030.D82902A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5293?compare_to=5289&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5293, Order: 166872, Start Time: 2012-10-27 11:38:47, End Time: 2012-10-27 13:10:27 To: 5289, Order: 166868, Start Time: 2012-10-27 09:37:21, End Time: 2012-10-27 11:09:10 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (10 on baseline) New Passes: 0 (14 on baseline) Performance Regressions: 1 (185 on baseline) Performance Improvements: 0 (55 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 15 (5 on baseline) Unchanged Tests: 1026 (639 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.14% (9.6867 => 9.7972, std.dev.: 0.0054) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: 0.05% (2.0493 => 2.0504, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 0.10% (57.3697 => 57.4292, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.25% (0.0795 => 0.0793, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 0.16% (9.1381 => 9.1530, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.19% (7.7525 => 7.7671, std.dev.: 0.0152) SingleSource/UnitTests/Vector/SSE/sse_shift: 0.39% (0.0514 => 0.0516, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/JM/lencod/lencod: 0.04% (7.7285 => 7.7316, std.dev.: 0.0113) MultiSource/Applications/oggenc/oggenc: - (0.0001 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.64% (0.0647 => 0.0677, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.86% (0.3016 => 0.2990, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_shift: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -64.40% (5.7591 => 2.0504, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -9.19% (63.2438 => 57.4292, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.81% (6.6874 => 0.0793, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 12.50% (8.1363 => 9.1530, std.dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_shift: 36.51% (0.0378 => 0.0516, std.dev.: 0.0014) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -50.00% (0.0002 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -57.05% (0.6962 => 0.2990, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_shift: -50.00% (0.0002 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 207.99% (0.5229 => 1.6105, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 15.99% (14.9895 => 17.3856, std.dev.: 0.0133) MultiSource/Applications/kimwitu++/kc: 36.95% (14.1553 => 19.3862, std.dev.: 0.0117) MultiSource/Benchmarks/MallocBench/gs/gs: 13.12% (4.1105 => 4.6497, std.dev.: 0.0093) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 31.66% (1.1048 => 1.4546, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.85% (3.4629 => 5.8125, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/stepanov_container: 66.84% (0.6222 => 1.0381, std.dev.: 0.0008) New Passes - Execution Time --------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 3836100.00% (0.0001 => 3.8362, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 11167500.00% (0.0001 => 11.1676, std.dev.: 0.0078) MultiSource/Applications/kimwitu++/kc: 50600.00% (0.0001 => 0.0507, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050500.00% (0.0001 => 10.0506, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5491100.00% (0.0001 => 5.4912, std.dev.: 0.0027) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 77.70% (0.0296 => 0.0526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 66.41% (0.0256 => 0.0426, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 59.41% (0.0271 => 0.0432, std.dev.: 0.0008) SingleSource/Regression/C/sumarraymalloc: 51.85% (0.0243 => 0.0369) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 42.76% (1.5859 => 2.2641, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.09% (0.0834 => 0.1185, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: 39.77% (0.1056 => 0.1476) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 33.59% (2.2024 => 2.9422, std.dev.: 0.0026) SingleSource/UnitTests/vla: 33.52% (0.0355 => 0.0474, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 30.69% (0.1463 => 0.1912, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 28.49% (0.1432 => 0.1840, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 26.47% (0.1655 => 0.2093, std.dev.: 0.0002) MultiSource/Benchmarks/llubenchmark/llu: 21.86% (0.0462 => 0.0563, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.26% (0.1566 => 0.1899, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/hash: 21.03% (0.0485 => 0.0587, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 20.26% (0.1555 => 0.1870, std.dev.: 0.0041) SingleSource/UnitTests/SignlessTypes/rem: 19.49% (0.1144 => 0.1367, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.40% (0.0871 => 0.1040, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 19.05% (0.0798 => 0.0950, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 18.88% (0.5105 => 0.6069, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 17.95% (0.0730 => 0.0861, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 17.70% (0.2271 => 0.2673, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.59% (1.3050 => 1.5346, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/08-main/main: 17.54% (0.2554 => 0.3002, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 17.53% (0.1175 => 0.1381, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 17.43% (0.0746 => 0.0876, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.36% (0.6675 => 0.7834, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 17.36% (0.1584 => 0.1859, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.95% (0.8172 => 0.9557, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 16.94% (3.3354 => 3.9005, std.dev.: 0.0074) MultiSource/Applications/minisat/minisat: 16.85% (0.7115 => 0.8314, std.dev.: 0.0071) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.84% (0.4615 => 0.5392, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 16.83% (0.1236 => 0.1444, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: 16.77% (0.0626 => 0.0731, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 16.68% (0.1337 => 0.1560, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.65% (0.0793 => 0.0925, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.59% (0.5020 => 0.5853, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.57% (0.1032 => 0.1203, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 16.52% (0.1695 => 0.1975, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.43% (1.5415 => 1.7947, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 16.42% (0.4879 => 0.5680, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 16.40% (0.3177 => 0.3698, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/mst/mst: 16.34% (0.1163 => 0.1353, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 16.03% (0.1510 => 0.1752, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.58% (0.0886 => 0.1024, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 15.56% (22.1758 => 25.6268, std.dev.: 0.0371) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 15.56% (0.1125 => 0.1300, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.45% (0.2065 => 0.2384, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.44% (0.0842 => 0.0972, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.36% (0.1940 => 0.2238, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.35% (0.1029 => 0.1187, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 15.32% (0.1906 => 0.2198, std.dev.: 0.0033) MultiSource/Applications/sgefa/sgefa: 15.31% (0.3109 => 0.3585, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3121 => 0.3596, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.11% (0.0675 => 0.0777, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 15.10% (0.2603 => 0.2996, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 15.03% (0.1151 => 0.1324, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: 14.98% (1.1642 => 1.3386, std.dev.: 0.0057) MultiSource/Applications/spiff/spiff: 14.75% (0.7835 => 0.8991, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.59% (0.1117 => 0.1280, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 14.58% (1.1840 => 1.3566, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.54% (0.6450 => 0.7388, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.54% (0.2758 => 0.3159, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.51% (0.9765 => 1.1182, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/exptree: 14.50% (0.0814 => 0.0932, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.35% (4.2646 => 4.8767, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.33% (0.2700 => 0.3087, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.33% (0.2107 => 0.2409, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.29% (0.0770 => 0.0880, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 14.17% (2.0273 => 2.3146, std.dev.: 0.0038) MultiSource/Applications/lemon/lemon: 13.97% (1.0722 => 1.2220, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.84% (0.1062 => 0.1209, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.79% (0.5981 => 0.6806, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 13.76% (1.1861 => 1.3493, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/football/football: 13.75% (0.8921 => 1.0148, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.72% (0.5860 => 0.6664, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.53% (1.4186 => 1.6105, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/18-imp/imp: 13.53% (0.3423 => 0.3886, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 13.47% (0.7433 => 0.8434, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.42% (0.1625 => 0.1843, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.18% (0.0933 => 0.1056, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.16% (0.1695 => 0.1918, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 12.98% (3.8723 => 4.3748, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.88% (0.3307 => 0.3733, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.82% (0.5569 => 0.6283, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.78% (0.3826 => 0.4315, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/05-eks/eks: 12.75% (0.4299 => 0.4847, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.71% (0.1330 => 0.1499, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 12.70% (0.1268 => 0.1429, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 12.65% (0.0838 => 0.0944, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 12.64% (0.3387 => 0.3815, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.59% (0.0929 => 0.1046, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.42% (0.1143 => 0.1285, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.32% (0.3441 => 0.3865, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 12.10% (0.3092 => 0.3466, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 11.84% (9.4845 => 10.6076, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/09-vor/vor: 11.48% (0.3180 => 0.3545, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 11.26% (0.4289 => 0.4772, std.dev.: 0.0084) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.26% (0.1892 => 0.2105, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.23% (0.3543 => 0.3941, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 11.12% (0.0953 => 0.1059, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-4: 11.09% (0.3543 => 0.3936, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.99% (0.8101 => 0.8991, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 10.97% (0.4620 => 0.5127, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 10.86% (4.9449 => 5.4819, std.dev.: 0.0023) MultiSource/Applications/siod/siod: 10.86% (2.2969 => 2.5463, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 10.71% (5.0018 => 5.5375, std.dev.: 0.0085) SingleSource/UnitTests/ObjC/parameter-passing: 10.70% (0.3927 => 0.4347, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.63% (0.3828 => 0.4235, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.60% (0.3473 => 0.3841, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 10.53% (0.6456 => 0.7136, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 10.52% (0.3516 => 0.3886, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.50% (0.3694 => 0.4082, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.50% (0.3561 => 0.3935, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.44% (0.3497 => 0.3862, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.30% (14.3668 => 15.8472, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.25% (0.1044 => 0.1151, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.24% (2.2022 => 2.4278, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.14% (0.4636 => 0.5106, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.11% (0.3886 => 0.4279, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.91% (0.3865 => 0.4248, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 9.76% (0.2049 => 0.2249, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.68% (0.4203 => 0.4610, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 9.68% (17.1811 => 18.8446, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/lists: 9.64% (0.3422 => 0.3752, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.60% (0.3427 => 0.3756, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists1: 9.39% (0.3684 => 0.4030, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 9.13% (0.5925 => 0.6466, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 9.12% (0.4048 => 0.4417, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 9.06% (1.5603 => 1.7017, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference: 9.04% (0.7326 => 0.7988, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 9.02% (0.6030 => 0.6574) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.02% (0.4103 => 0.4473, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.93% (0.2430 => 0.2647, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 8.66% (0.3603 => 0.3915, std.dev.: 0.0037) SingleSource/Regression/C++/ofstream_ctor: 8.19% (0.2905 => 0.3143, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.05% (0.4064 => 0.4391, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.88% (0.2793 => 0.3013, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.84% (0.3650 => 0.3936, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.81% (3.8922 => 4.1962, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.80% (0.2756 => 0.2971, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 7.75% (0.3098 => 0.3338, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.67% (0.2725 => 0.2934, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.58% (0.2891 => 0.3110, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.52% (0.2831 => 0.3044, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.52% (0.2872 => 0.3088, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.43% (2.0665 => 2.2200, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hello: 7.41% (0.2714 => 0.2915, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 7.37% (0.3283 => 0.3525, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.34% (0.3162 => 0.3394, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 7.24% (0.2871 => 0.3079) SingleSource/Benchmarks/Shootout-C++/ary: 7.24% (0.3232 => 0.3466, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 7.06% (0.2877 => 0.3080, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 6.98% (0.3052 => 0.3265, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 6.78% (0.3379 => 0.3608, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.75% (0.2802 => 0.2991, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 6.61% (0.3282 => 0.3499, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 6.61% (1.2842 => 1.3691, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.37% (0.8067 => 0.8581, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.35% (0.2266 => 0.2410, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.55% (0.3136 => 0.3310, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.05% (0.3131 => 0.3289, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.23% (7.9617 => 8.2985, std.dev.: 0.0139) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.58% (0.3935 => 0.4076, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.99% (0.3817 => 0.3931, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.57% (7.0540 => 7.2350, std.dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.12% (1.1145 => 1.3722, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 10.64% (0.9957 => 1.1016, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/richards_benchmark: 9.85% (1.1396 => 1.2518, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.95% (2.8904 => 3.0913, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 6.64% (3.1578 => 3.3676, std.dev.: 0.0013) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: 4.50% (3.3453 => 3.4960, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 2.93% (1.9405 => 1.9973, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.88% (4.2280 => 4.3498, std.dev.: 0.0051) MultiSource/Applications/viterbi/viterbi: 2.48% (4.4649 => 4.5758, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2076, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.44% (11.6436 => 11.8114, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.38% (9.1159 => 9.2419, std.dev.: 0.0095) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -76.44% (0.8651 => 0.2038, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.28% (5.3855 => 2.4084, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -54.88% (5.3526 => 2.4150, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/richards_benchmark: -44.27% (0.1622 => 0.0904, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.32% (1.1194 => 0.6792, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.15% (5.2763 => 3.2108, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -24.21% (1.7609 => 1.3345, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -17.45% (2.9384 => 2.4256, std.dev.: 0.0171) SingleSource/UnitTests/Vector/constpool: -9.03% (54.1659 => 49.2731, std.dev.: 0.0406) MultiSource/Applications/JM/ldecod/ldecod: -8.74% (10.4361 => 9.5241, std.dev.: 0.0103) MultiSource/Benchmarks/PAQ8p/paq8p: -5.50% (10.3673 => 9.7972, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -54.02% (8.0499 => 3.7015, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0133, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.46% (1.1492 => 0.7647, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.81% (0.0506 => 0.0340, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.58% (0.3987 => 0.2688, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.51% (2.9695 => 2.3604, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.99% (1.2258 => 0.9930, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.14% (1.6925 => 1.4193, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -10.99% (1.2373 => 1.1013, std.dev.: 0.0018) MultiSource/Benchmarks/NPB-serial/is/is: -10.99% (9.5636 => 8.5127, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3735, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.27% (19.9488 => 18.2999, std.dev.: 0.1083) MultiSource/Benchmarks/FreeBench/mason/mason: -7.96% (0.2161 => 0.1989, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.03% (1.8329 => 1.7041, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: -5.46% (6.6465 => 6.2836, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.14% (1.6805 => 1.5941, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5073, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.73% (0.2497 => 0.2379) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.04% (8.1563 => 7.8270, std.dev.: 0.0065) MultiSource/Applications/siod/siod: -3.74% (3.2827 => 3.1600, std.dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.73% (1.3677 => 1.3167, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.50% (32.5116 => 31.3748, std.dev.: 0.0033) MultiSource/Benchmarks/sim/sim: -3.33% (5.0483 => 4.8803, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: -2.84% (4.6441 => 4.5123, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.80% (4.5009 => 4.3747, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.56% (0.4808 => 0.4685, std.dev.: 0.0023) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/multiplies: -2.01% (2.5528 => 2.5016, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -1.81% (10.2830 => 10.0965, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6793, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1095) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.19% (1.7254 => 1.7048, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -1.19% (85.0658 => 84.0514, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.00% (6.2999 => 6.2368, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8597, std.dev.: 0.0076) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.51% (7.1582 => 7.7671, std.dev.: 0.0152) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: 10638.33% (0.0720 => 7.7316, std.dev.: 0.0113) MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.01% (0.2116 => 0.0677, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 06:21:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 08:21:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121027132132.1F7312A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5294?compare_to=5290&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5294, Order: 166872, Start Time: 2012-10-27 11:56:15, End Time: 2012-10-27 13:21:27 To: 5290, Order: 166869, Start Time: 2012-10-27 10:04:58, End Time: 2012-10-27 11:32:59 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 1 (182 on baseline) Unchanged Tests: 1040 (855 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.39% (27.8459 => 29.6251, std.dev.: 0.0729) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.25% (2.0643 => 2.0385, std.dev.: 0.0012) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 18.40% (15.2527 => 18.0586, std.dev.: 0.0109) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.75% (2.0478 => 2.1042, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: 2.45% (7.4937 => 7.6771, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/hash2: 2.23% (3.1932 => 3.2643, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.81% (0.1431 => 0.1305, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.93% (0.3821 => 0.3518, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -7.53% (2.4924 => 2.3046, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: -7.50% (0.3812 => 0.3526, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -7.50% (0.3880 => 0.3589, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -7.49% (0.3896 => 0.3604, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -7.47% (0.3831 => 0.3545, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.44% (0.3884 => 0.3595, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -7.43% (0.3848 => 0.3562, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.40% (0.3891 => 0.3603, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -7.38% (0.4176 => 0.3868, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -7.31% (0.4033 => 0.3738, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -7.17% (0.4199 => 0.3898, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.16% (22.4056 => 20.8006, std.dev.: 0.0199) MultiSource/Applications/sgefa/sgefa: -7.09% (0.3357 => 0.3119, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -7.05% (3.5339 => 3.2847, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.00% (0.2428 => 0.2258, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.97% (0.3142 => 0.2923, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: -6.92% (0.4280 => 0.3984, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/oourafft: -6.90% (0.2160 => 0.2011, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.85% (0.6484 => 0.6040, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.72% (0.3658 => 0.3412, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.67% (0.9542 => 0.8906, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: -6.66% (0.2659 => 0.2482, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.65% (1.0544 => 0.9843, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.64% (1.6474 => 1.5380, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: -6.63% (1.2515 => 1.1685, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.60% (5.4682 => 5.1075, std.dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.59% (0.1716 => 0.1603, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.58% (0.9852 => 0.9204, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -6.56% (7.0961 => 6.6307, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.56% (1.2784 => 1.1946, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: -6.51% (16.1920 => 15.1375, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.51% (4.8161 => 4.5027, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.48% (0.4151 => 0.3882, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.48% (4.8802 => 4.5641, std.dev.: 0.0060) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.45% (0.2355 => 0.2203, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -6.45% (2.4021 => 2.2472, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: -6.42% (4.3330 => 4.0548, std.dev.: 0.0123) SingleSource/Benchmarks/McGill/chomp: -6.42% (0.1761 => 0.1648, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.41% (1.4642 => 1.3704, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: -6.40% (9.2283 => 8.6373, std.dev.: 0.0132) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.40% (0.1796 => 0.1681, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -6.40% (0.2985 => 0.2794, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.36% (0.2548 => 0.2386, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -6.35% (1.3148 => 1.2313, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.32% (4.5069 => 4.2219, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.31% (1.3722 => 1.2856, std.dev.: 0.0077) MultiSource/Applications/lua/lua: -6.29% (4.0594 => 3.8041, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.26% (0.3849 => 0.3608, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.23% (2.2587 => 2.1179, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/ReedSolomon: -6.23% (0.1879 => 0.1762, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: -6.21% (0.3026 => 0.2838, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -6.21% (0.3255 => 0.3053, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -6.17% (0.2871 => 0.2694, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -6.15% (0.4861 => 0.4562, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.15% (0.3837 => 0.3601, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.15% (0.4083 => 0.3832, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.14% (4.0323 => 3.7846, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.14% (1.6364 => 1.5360, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.12% (0.7919 => 0.7434, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.12% (0.6736 => 0.6324, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.12% (2.1713 => 2.0385, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.10% (0.2903 => 0.2726, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.09% (0.8521 => 0.8002, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.09% (0.3252 => 0.3054, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -6.08% (0.3323 => 0.3121, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: -6.08% (0.3621 => 0.3401, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: -6.07% (0.3491 => 0.3279, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -6.06% (0.3481 => 0.3270, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -6.06% (0.2989 => 0.2808, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -6.04% (0.3394 => 0.3189, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -6.02% (0.2939 => 0.2762, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -6.01% (0.3446 => 0.3239, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -5.99% (0.3788 => 0.3561, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.99% (0.3057 => 0.2874, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.98% (0.3931 => 0.3696, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.97% (1.2221 => 1.1492, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: -5.96% (1.1530 => 1.0843, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.96% (0.5925 => 0.5572, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.94% (0.4427 => 0.4164, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/bigfib: -5.94% (0.6750 => 0.6349, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/wc: -5.93% (0.3205 => 0.3015, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -5.92% (34.0927 => 32.0756, std.dev.: 0.0154) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.90% (0.7198 => 0.6773, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.90% (0.5999 => 0.5645, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.90% (0.2933 => 0.2760, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.89% (0.5857 => 0.5512, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: -5.89% (0.3194 => 0.3006, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -5.88% (0.3025 => 0.2847, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.87% (0.2999 => 0.2823, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.85% (0.5591 => 0.5264, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.83% (0.6293 => 0.5926, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.83% (0.6297 => 0.5930, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.82% (0.6304 => 0.5937, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: -5.82% (18.2933 => 17.2287, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/lists1: -5.82% (0.3867 => 0.3642, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: -5.81% (0.4524 => 0.4261, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.81% (0.5805 => 0.5468, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.79% (0.2278 => 0.2146, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.79% (0.2106 => 0.1984, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: -5.79% (0.2849 => 0.2684, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: -5.79% (0.4248 => 0.4002, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -5.79% (0.3059 => 0.2882, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.79% (0.2385 => 0.2247, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: -5.78% (0.4515 => 0.4254, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: -5.76% (15.5079 => 14.6140, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.75% (0.9557 => 0.9007, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.75% (0.3319 => 0.3128, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.74% (0.6395 => 0.6028, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.73% (1.2210 => 1.1510, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.71% (0.5863 => 0.5528, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.71% (0.4813 => 0.4538, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.70% (0.7524 => 0.7095, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: -5.70% (0.9179 => 0.8656, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.69% (0.6681 => 0.6301, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.68% (0.5849 => 0.5517, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: -5.67% (0.7447 => 0.7025, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.67% (0.5859 => 0.5527, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.66% (0.6446 => 0.6081, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.65% (0.5802 => 0.5474, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.64% (0.5705 => 0.5383, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: -5.64% (1.1450 => 1.0804, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.64% (0.7339 => 0.6925, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.64% (0.5478 => 0.5169, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (0.7021 => 0.6625, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -5.64% (0.7982 => 0.7532, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.62% (0.6260 => 0.5908, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.60% (0.6194 => 0.5847, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.59% (0.5581 => 0.5269, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.58% (0.6395 => 0.6038, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.58% (0.5575 => 0.5264, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -5.58% (0.3406 => 0.3216, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.58% (0.4321 => 0.4080, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.57% (0.6052 => 0.5715, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.56% (0.6660 => 0.6290, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.55% (0.6230 => 0.5884, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.54% (0.6676 => 0.6306, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.53% (0.6440 => 0.6084, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.51% (0.5570 => 0.5263, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.50% (0.5941 => 0.5614, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.50% (0.5329 => 0.5036, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.49% (0.4916 => 0.4646, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.48% (0.5456 => 0.5157, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.48% (0.6189 => 0.5850, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.44% (0.5168 => 0.4887, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.43% (0.6667 => 0.6305, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.42% (0.5569 => 0.5267, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.42% (6.7716 => 6.4044, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.42% (8.0126 => 7.5786, std.dev.: 0.0030) MultiSource/Applications/d/make_dparser: -5.42% (3.5154 => 3.3250, std.dev.: 0.0054) MultiSource/Applications/treecc/treecc: -5.32% (2.1401 => 2.0263, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.32% (0.5567 => 0.5271, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.31% (0.5688 => 0.5386, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: -5.31% (0.3581 => 0.3391, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.30% (0.6033 => 0.5713, std.dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.25% (0.2001 => 0.1896, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: -5.17% (0.3271 => 0.3102, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: -5.16% (0.8418 => 0.7984, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: -5.14% (0.7779 => 0.7379, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/Hello: -5.06% (0.6347 => 0.6026, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -4.97% (0.6441 => 0.6121, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -4.96% (17.1032 => 16.2546, std.dev.: 0.0238) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.95% (0.9077 => 0.8628, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: -4.88% (1.2300 => 1.1700, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.87% (0.2277 => 0.2166, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.74% (0.3483 => 0.3318, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -4.52% (1.5610 => 1.4905, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: -4.50% (5.0226 => 4.7966, std.dev.: 0.0183) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.45% (0.2695 => 0.2575, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.12% (14.2083 => 13.6230, std.dev.: 0.0183) MultiSource/Applications/SIBsim4/SIBsim4: -3.59% (1.3864 => 1.3366, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -2.54% (20.7746 => 20.2479, std.dev.: 0.0302) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7509, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1729, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7068, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.80% (2.2633 => 2.1773, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.04% (1.3096 => 1.2829, std.dev.: 0.0089) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4669, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0003) Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 07:13:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 09:13:14 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121027141314.243602A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5295?compare_to=5292&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5295, Order: 166873, Start Time: 2012-10-27 12:49:09, End Time: 2012-10-27 14:13:11 To: 5292, Order: 166870, Start Time: 2012-10-27 11:07:22, End Time: 2012-10-27 12:32:10 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 7 (74 on baseline) Performance Improvements: 15 (3 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 953 (897 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.58% (0.8944 => 0.9085, std.dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 31.03% (1.9132 => 2.5068, std.dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 12.63% (21.4390 => 24.1464, std.dev.: 0.5119) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.01% (15.4721 => 16.8667, std.dev.: 0.4039) MultiSource/Applications/SPASS/SPASS: 1.89% (8.2593 => 8.4152, std.dev.: 0.0509) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.52% (4.3859 => 4.4525, std.dev.: 0.0172) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.52% (1.4031 => 1.4244, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.19% (0.2719 => 0.2578, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/bh/bh: -3.60% (0.3084 => 0.2973, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -2.55% (0.5029 => 0.4901, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -2.53% (0.6685 => 0.6516, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.17% (0.6223 => 0.6088, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -1.87% (1.2977 => 1.2734, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.69% (9.0594 => 8.9060, std.dev.: 0.0388) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.53% (0.8743 => 0.8609, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.51% (0.7069 => 0.6962, std.dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.46% (6.9768 => 6.8752, std.dev.: 0.0280) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -1.15% (1.7096 => 1.6899, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.15% (0.9935 => 0.9821, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.01% (4.3247 => 4.2811, std.dev.: 0.0089) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: -6.51% (4.0695 => 3.8047, std.dev.: 0.0543) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.96% (3.0724 => 3.0121, std.dev.: 0.0103) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.34% (16.6318 => 16.5751, std.dev.: 0.1069) MultiSource/Applications/obsequi/Obsequi: -1.60% (1.0741 => 1.0569, std.dev.: 0.0154) MultiSource/Applications/sqlite3/sqlite3: -2.42% (0.6601 => 0.6441, std.dev.: 0.0073) MultiSource/Benchmarks/McCat/08-main/main: -1.13% (0.1947 => 0.1925, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.56% (0.1726 => 0.1630, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.55% (0.3290 => 0.3206, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.15% (0.2530 => 0.2501, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.67% (0.3420 => 0.3397, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.38% (0.2359 => 0.2368, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/bigfib: -0.69% (0.6061 => 0.6019, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/mandel: -2.89% (0.0450 => 0.0437, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.51% (0.3339 => 0.3322, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: -0.20% (0.2014 => 0.2010, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -8.79% (0.0239 => 0.0218, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.12% (0.0224 => 0.0217, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 7.04% (0.0398 => 0.0426, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -3.22% (0.0342 => 0.0331, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -4.95% (0.0323 => 0.0307, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.46% (0.0434 => 0.0419, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -21.53% (0.0209 => 0.0164, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/test1: -17.86% (0.0224 => 0.0184, std.dev.: 0.0014) SingleSource/UnitTests/byval-alignment: -21.88% (0.0329 => 0.0257, std.dev.: 0.0048) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 0.82% (0.1471 => 0.1483, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -3.02% (1.1580 => 1.1230, std.dev.: 0.0558) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -1.18% (0.1520 => 0.1502, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.12% (0.4056 => 0.4051, std.dev.: 0.0204) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.28% (0.1319 => 0.1415, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.57% (0.0634 => 0.0605, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -12.64% (0.0261 => 0.0228, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.39% (0.0547 => 0.0571, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.40% (1.1483 => 1.1437, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -41.94% (0.0031 => 0.0018, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.81% (0.0629 => 0.0561, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.83% (0.0237 => 0.0190, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.06% (0.8013 => 0.8008, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007) SingleSource/UnitTests/2006-01-23-UnionInit: -12.50% (0.0008 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -41.67% (0.0072 => 0.0042, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.20% (2.1832 => 1.6548, std.dev.: 0.0040) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 34.64% (14.7684 => 19.8841, std.dev.: 0.0675) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.05% (0.0810 => 0.0940, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 13.04% (0.1112 => 0.1257, std.dev.: 0.0006) SingleSource/UnitTests/SignlessTypes/rem: 11.79% (0.1035 => 0.1157, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.18% (0.8321 => 0.9085, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.07% (0.2180 => 0.2356, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.77% (0.2279 => 0.2456, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.86% (0.6010 => 0.6422, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.60% (0.4847 => 0.5167, std.dev.: 0.0068) MultiSource/Applications/SIBsim4/SIBsim4: 5.40% (1.2568 => 1.3247, std.dev.: 0.0089) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.31% (0.8148 => 0.8581, std.dev.: 0.0095) MultiSource/Applications/Burg/burg: 5.25% (1.2222 => 1.2864, std.dev.: 0.0205) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.21% (1.1170 => 1.1752, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.11% (13.1811 => 13.8548, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.92% (0.7473 => 0.7841, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.57% (0.2998 => 0.3135, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.49% (0.2741 => 0.2864, std.dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.05% (6.6074 => 6.8752, std.dev.: 0.0280) MultiSource/Applications/sgefa/sgefa: 3.97% (0.2999 => 0.3118, std.dev.: 0.0032) MultiSource/Applications/hbd/hbd: 3.76% (1.4269 => 1.4806, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.76% (1.1685 => 1.2124, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.64% (0.6287 => 0.6516, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.58% (0.3717 => 0.3850, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.53% (0.6227 => 0.6447, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.26% (1.1606 => 1.1984, std.dev.: 0.0087) MultiSource/Benchmarks/MallocBench/gs/gs: 3.20% (4.1305 => 4.2628, std.dev.: 0.0156) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.13% (1.6386 => 1.6899, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.06% (1.4479 => 1.4922, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.99% (8.6476 => 8.9060, std.dev.: 0.0388) MultiSource/Applications/lemon/lemon: 2.89% (1.0945 => 1.1261, std.dev.: 0.0114) MultiSource/Benchmarks/nbench/nbench: 2.62% (1.1271 => 1.1566, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.61% (0.8697 => 0.8924, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.51% (4.1763 => 4.2811, std.dev.: 0.0089) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.47% (0.4783 => 0.4901, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.46% (0.4559 => 0.4671, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.16% (4.4880 => 4.5848, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.13% (0.5961 => 0.6088, std.dev.: 0.0036) MultiSource/Applications/JM/ldecod/ldecod: 2.01% (6.7320 => 6.8674, std.dev.: 0.0232) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.92% (0.8007 => 0.8161, std.dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: 1.92% (0.9810 => 0.9998, std.dev.: 0.0065) MultiSource/Applications/JM/lencod/lencod: 1.90% (15.3280 => 15.6198, std.dev.: 0.0680) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.88% (4.4873 => 4.5717, std.dev.: 0.0154) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.86% (0.8340 => 0.8495, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.80% (4.5702 => 4.6526, std.dev.: 0.0099) MultiSource/Applications/lambda-0_1_3/lambda: 1.76% (0.7557 => 0.7690, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.73% (0.6586 => 0.6700, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 1.73% (31.8598 => 32.4103, std.dev.: 0.0824) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.71% (0.8050 => 0.8188, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.66% (0.8457 => 0.8597, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.62% (0.8331 => 0.8466, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.60% (0.7932 => 0.8059, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.59% (0.8317 => 0.8449, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.54% (0.8069 => 0.8193, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.50% (0.9074 => 0.9210, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.43% (0.7966 => 0.8080, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 1.43% (8.6247 => 8.7477, std.dev.: 0.0260) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.40% (0.8716 => 0.8838, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.37% (0.9688 => 0.9821, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.28% (0.8656 => 0.8767, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.25% (0.8177 => 0.8279, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.24% (0.8086 => 0.8186, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.23% (0.8359 => 0.8462, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.16% (0.9069 => 0.9174, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.71% (1.5795 => 2.5068, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.17% (14.6451 => 16.8667, std.dev.: 0.4039) MultiSource/Benchmarks/nbench/nbench: 9.93% (21.9654 => 24.1464, std.dev.: 0.5119) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.60% (0.3186 => 0.3460, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.53% (1.1857 => 1.2750, std.dev.: 0.0056) MultiSource/Benchmarks/mafft/pairlocalalign: 5.94% (63.1822 => 66.9333, std.dev.: 0.0417) MultiSource/Applications/siod/siod: 2.82% (3.6643 => 3.7677, std.dev.: 0.0377) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.23% (4.3552 => 4.4525, std.dev.: 0.0172) SingleSource/Benchmarks/Misc/ReedSolomon: 2.12% (8.5322 => 8.7135, std.dev.: 0.0239) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.73% (2.4490 => 2.4913, std.dev.: 0.0130) MultiSource/Benchmarks/Olden/bh/bh: 1.64% (2.3560 => 2.3946, std.dev.: 0.0087) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -5.11% (29.8330 => 28.3078, std.dev.: 0.0829) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.30% (3.3479 => 3.3045, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.29% (3.0515 => 3.0121, std.dev.: 0.0103) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.78% (16.4461 => 16.5751, std.dev.: 0.1069) MultiSource/Applications/obsequi/Obsequi: 2.99% (1.0262 => 1.0569, std.dev.: 0.0154) MultiSource/Applications/sqlite3/sqlite3: 1.72% (0.6332 => 0.6441, std.dev.: 0.0073) MultiSource/Benchmarks/McCat/08-main/main: 5.13% (0.1831 => 0.1925, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.55% (0.1559 => 0.1630, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.66% (0.3123 => 0.3206, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.54% (0.2463 => 0.2501, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.58% (0.3344 => 0.3397, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.17% (0.2364 => 0.2368, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/bigfib: 0.15% (0.6010 => 0.6019, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/mandel: 1.86% (0.0429 => 0.0437, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.71% (0.3266 => 0.3322, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 2.08% (0.1969 => 0.2010, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -2.68% (0.0224 => 0.0218, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 76.42% (0.0123 => 0.0217, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.31% (0.0254 => 0.0331, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.66% (0.0302 => 0.0307, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.11% (0.0384 => 0.0419, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -13.68% (0.0190 => 0.0164, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/test1: 2.22% (0.0180 => 0.0184, std.dev.: 0.0014) SingleSource/UnitTests/byval-alignment: 11.74% (0.0230 => 0.0257, std.dev.: 0.0048) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 3.13% (0.1438 => 0.1483, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -0.87% (1.1329 => 1.1230, std.dev.: 0.0558) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 2.74% (0.1462 => 0.1502, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.71% (0.4164 => 0.4051, std.dev.: 0.0204) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.36% (0.1369 => 0.1415, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.62% (0.0641 => 0.0605, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 16.92% (0.0195 => 0.0228, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.21% (0.0578 => 0.0571, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: - (1.1437 => 1.1437, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1700.00% (0.0001 => 0.0018, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.53% (0.0627 => 0.0561, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.56% (0.0180 => 0.0190, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.11% (0.8017 => 0.8008, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007) SingleSource/UnitTests/2006-01-23-UnionInit: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -32.26% (0.0062 => 0.0042, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 08:09:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 10:09:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121027150932.7658F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5296?compare_to=5294&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5296, Order: 166873, Start Time: 2012-10-27 13:44:18, End Time: 2012-10-27 15:09:29 To: 5294, Order: 166872, Start Time: 2012-10-27 11:56:15, End Time: 2012-10-27 13:21:27 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (179 on baseline) Unchanged Tests: 1042 (858 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 18.55% (15.2527 => 18.0818, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1008, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/salsa20: 2.50% (7.4937 => 7.6811, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hash2: 2.20% (3.1932 => 3.2633, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.94% (0.1431 => 0.1303, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.93% (0.3821 => 0.3518, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -7.62% (2.4924 => 2.3026, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: -7.39% (0.3831 => 0.3548, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.36% (0.3884 => 0.3598, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -7.35% (0.3880 => 0.3595, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -7.35% (0.3812 => 0.3532, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -7.33% (0.3848 => 0.3566, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: -7.26% (0.3896 => 0.3613, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.22% (0.3891 => 0.3610, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -7.19% (0.4033 => 0.3743, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -7.11% (0.4176 => 0.3879, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -7.11% (22.4056 => 20.8129, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.03% (0.3142 => 0.2921, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -7.03% (0.4199 => 0.3904, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -6.94% (0.4280 => 0.3983, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.92% (0.2428 => 0.2260, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.88% (3.5339 => 3.2909, std.dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: -6.82% (0.3357 => 0.3128, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.76% (0.6484 => 0.6046, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.75% (0.3658 => 0.3411, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: -6.71% (0.2160 => 0.2015, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: -6.66% (0.2659 => 0.2482, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.60% (0.9542 => 0.8912, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -6.58% (1.2515 => 1.1692, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.50% (0.4151 => 0.3881, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.50% (0.9852 => 0.9212, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.49% (1.0544 => 0.9860, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: -6.49% (4.3330 => 4.0520, std.dev.: 0.0093) MultiSource/Applications/siod/siod: -6.48% (2.4021 => 2.2465, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: -6.46% (7.0961 => 6.6376, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.46% (1.6474 => 1.5410, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.41% (5.4682 => 5.1176, std.dev.: 0.0132) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.41% (0.1716 => 0.1606, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: -6.38% (16.1920 => 15.1588, std.dev.: 0.0187) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.37% (0.2355 => 0.2205, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -6.33% (0.2985 => 0.2796, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.32% (0.2548 => 0.2387, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.30% (4.8161 => 4.5128, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.29% (0.1796 => 0.1683, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.29% (1.2784 => 1.1980, std.dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: -6.24% (1.3148 => 1.2327, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -6.23% (9.2283 => 8.6531, std.dev.: 0.0094) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.22% (4.5069 => 4.2267, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.21% (4.8802 => 4.5770, std.dev.: 0.0054) MultiSource/Applications/lua/lua: -6.21% (4.0594 => 3.8074, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.19% (1.6364 => 1.5351, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.17% (1.4642 => 1.3739, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: -6.16% (0.2989 => 0.2805, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -6.15% (0.3026 => 0.2840, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -6.13% (0.5999 => 0.5631, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -6.13% (2.2587 => 2.1202, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash2: -6.13% (0.4861 => 0.4563, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/fibo: -6.13% (0.2871 => 0.2695, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.11% (0.7919 => 0.7435, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.11% (0.3849 => 0.3614, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.07% (0.3837 => 0.3604, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -6.06% (0.4321 => 0.4059, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.05% (0.4083 => 0.3836, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.00% (0.7198 => 0.6766, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.99% (0.3057 => 0.2874, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.98% (4.0323 => 3.7912, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.98% (1.3722 => 1.2902, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ary2: -5.98% (0.3481 => 0.3273, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -5.97% (0.3621 => 0.3405, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: -5.95% (0.3025 => 0.2845, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -5.95% (0.3446 => 0.3241) MultiSource/Benchmarks/McCat/18-imp/imp: -5.95% (0.3581 => 0.3368, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -5.93% (0.3255 => 0.3062, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.92% (0.2903 => 0.2731, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -5.92% (0.3394 => 0.3193, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.91% (2.1713 => 2.0430, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -5.90% (0.3205 => 0.3016, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -5.89% (0.2939 => 0.2766, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -5.88% (0.6750 => 0.6353, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.86% (0.2933 => 0.2761, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -5.85% (34.0927 => 32.0983, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.84% (0.2278 => 0.2145, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.83% (0.8521 => 0.8024, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: -5.83% (0.2849 => 0.2683, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.82% (1.2221 => 1.1510, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.81% (0.3252 => 0.3063, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.81% (0.4427 => 0.4170, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.80% (0.2999 => 0.2825, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: -5.79% (0.3194 => 0.3009, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.79% (0.3491 => 0.3289, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.79% (0.2385 => 0.2247, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: -5.78% (1.1530 => 1.0863, std.dev.: 0.0086) MultiSource/Applications/kimwitu++/kc: -5.77% (18.2933 => 17.2372, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.77% (0.5857 => 0.5519, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.74% (0.6293 => 0.5932, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: -5.72% (15.5079 => 14.6207, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.70% (0.5925 => 0.5587, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.70% (0.3016 => 0.2844, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -5.70% (0.3788 => 0.3572, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -5.69% (0.4515 => 0.4258, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -5.69% (0.3059 => 0.2885, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -5.66% (0.3867 => 0.3648, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.66% (0.6304 => 0.5947, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.66% (0.4916 => 0.4638, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.65% (0.6297 => 0.5941, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.65% (0.5591 => 0.5275, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.65% (0.5805 => 0.5477, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.61% (1.2210 => 1.1525, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.61% (0.4813 => 0.4543, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: -5.60% (0.7447 => 0.7030, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.59% (0.7339 => 0.6929, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.58% (0.6052 => 0.5714, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.58% (0.6395 => 0.6038, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.54% (0.6230 => 0.5885, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -5.53% (0.4248 => 0.4013, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.53% (0.5478 => 0.5175, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.51% (0.6189 => 0.5848, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.50% (0.6260 => 0.5916, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.49% (0.3931 => 0.3715, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.48% (0.5859 => 0.5538, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.46% (0.6736 => 0.6368, std.dev.: 0.0048) MultiSource/Applications/lambda-0_1_3/lambda: -5.46% (0.7982 => 0.7546, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: -5.46% (0.3406 => 0.3220, std.dev.: 0.0056) MultiSource/Applications/lemon/lemon: -5.45% (1.1450 => 1.0826, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.45% (0.7524 => 0.7114, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.45% (0.5802 => 0.5486, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.44% (0.5863 => 0.5544, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.42% (0.9557 => 0.9039, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.42% (0.5849 => 0.5532, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.42% (0.5575 => 0.5273, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.41% (0.5581 => 0.5279, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.41% (0.6660 => 0.6300, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -5.40% (0.6667 => 0.6307, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.39% (0.6194 => 0.5860, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.37% (0.6033 => 0.5709, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: -5.36% (0.9179 => 0.8687, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.36% (0.3323 => 0.3145, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.35% (0.5705 => 0.5400, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.34% (0.5168 => 0.4892, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.34% (0.5941 => 0.5624, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.33% (0.6395 => 0.6054, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.33% (0.5570 => 0.5273, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.33% (0.6681 => 0.6325, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.33% (0.7021 => 0.6647, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.32% (0.6446 => 0.6103, std.dev.: 0.0053) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.32% (6.7716 => 6.4114, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.31% (0.6440 => 0.6098, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: -5.31% (0.4524 => 0.4284, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.30% (8.0126 => 7.5877, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.30% (0.5456 => 0.5167, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -5.26% (0.8418 => 0.7975, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.24% (0.5569 => 0.5277, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.24% (0.6676 => 0.6326, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.20% (0.5329 => 0.5052, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -5.19% (2.1401 => 2.0291, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: -5.16% (3.5154 => 3.3340, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.14% (0.5567 => 0.5281, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.10% (0.5688 => 0.5398, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.09% (0.3319 => 0.3150, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -5.07% (0.3271 => 0.3105, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.03% (0.2106 => 0.2000, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: -4.97% (0.7779 => 0.7392, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: -4.92% (0.6441 => 0.6124, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -4.88% (0.6347 => 0.6037, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -4.80% (17.1032 => 16.2815, std.dev.: 0.0151) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.79% (0.9077 => 0.8642, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.77% (0.3483 => 0.3317, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.66% (0.2277 => 0.2171, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: -4.62% (1.2300 => 1.1732, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: -4.45% (5.0226 => 4.7992, std.dev.: 0.0046) MultiSource/Applications/hbd/hbd: -4.42% (1.5610 => 1.4920, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.34% (0.2695 => 0.2578, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.95% (14.2083 => 13.6469, std.dev.: 0.0052) MultiSource/Applications/SIBsim4/SIBsim4: -3.48% (1.3864 => 1.3382, std.dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -2.61% (20.7746 => 20.2334, std.dev.: 0.0189) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7539, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1724, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.87% (1.7753 => 1.7066, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.87% (2.2633 => 2.1758, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.28% (1.0557 => 1.0211, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.60% (1.3096 => 1.2755, std.dev.: 0.0102) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.63% (6.5735 => 6.4661, std.dev.: 0.0031) Report Time: 1.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 08:11:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 10:11:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121027151134.D33672A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5297?compare_to=5293&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5297, Order: 166873, Start Time: 2012-10-27 13:40:05, End Time: 2012-10-27 15:11:31 To: 5293, Order: 166872, Start Time: 2012-10-27 11:38:47, End Time: 2012-10-27 13:10:27 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (10 on baseline) New Passes: 0 (14 on baseline) Performance Regressions: 1 (184 on baseline) Performance Improvements: 1 (54 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 15 (5 on baseline) Unchanged Tests: 1025 (641 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.14% (54.7520 => 56.4724, std.dev.: 0.1331) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.03% (9.7972 => 9.6961, std.dev.: 0.0050) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: 0.06% (2.0504 => 2.0516, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 0.13% (57.4292 => 57.5020, std.dev.: 0.0300) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.25% (0.0793 => 0.0795, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 0.02% (9.1530 => 9.1545, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.11% (7.7671 => 7.7757, std.dev.: 0.0054) SingleSource/UnitTests/Vector/SSE/sse_shift: 0.39% (0.0516 => 0.0518, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/JM/lencod/lencod: -0.05% (7.7316 => 7.7278, std.dev.: 0.0048) MultiSource/Applications/oggenc/oggenc: - (0.0001 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0677 => 0.0678, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.10% (0.2990 => 0.2993, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_shift: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -64.38% (5.7591 => 2.0516, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -9.08% (63.2438 => 57.5020, std.dev.: 0.0300) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.81% (6.6874 => 0.0795, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 12.51% (8.1363 => 9.1545, std.dev.: 0.0023) SingleSource/UnitTests/Vector/SSE/sse_shift: 37.04% (0.0378 => 0.0518, std.dev.: 0.0007) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -50.00% (0.0002 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -57.01% (0.6962 => 0.2993, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_shift: -50.00% (0.0002 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 206.83% (0.5229 => 1.6044, std.dev.: 0.0054) MultiSource/Applications/SPASS/SPASS: 15.95% (14.9895 => 17.3798, std.dev.: 0.0214) MultiSource/Applications/kimwitu++/kc: 37.03% (14.1553 => 19.3964, std.dev.: 0.0064) MultiSource/Benchmarks/MallocBench/gs/gs: 13.14% (4.1105 => 4.6508, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 31.71% (1.1048 => 1.4551, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.20% (3.4629 => 5.8246, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 67.04% (0.6222 => 1.0393, std.dev.: 0.0012) New Passes - Execution Time --------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 3836000.00% (0.0001 => 3.8361, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 11158200.00% (0.0001 => 11.1583, std.dev.: 0.0149) MultiSource/Applications/kimwitu++/kc: 50500.00% (0.0001 => 0.0506, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049600.00% (0.0001 => 10.0497, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5495200.00% (0.0001 => 5.4953, std.dev.: 0.0147) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 77.70% (0.0296 => 0.0526, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: 66.41% (0.0256 => 0.0426, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 59.41% (0.0271 => 0.0432, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 51.44% (0.0243 => 0.0368) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 42.81% (1.5859 => 2.2648, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.73% (0.0834 => 0.1182, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 40.06% (0.1056 => 0.1479, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 33.76% (2.2024 => 2.9459, std.dev.: 0.0005) SingleSource/UnitTests/vla: 33.52% (0.0355 => 0.0474, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 30.55% (0.1463 => 0.1910, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 28.84% (0.1432 => 0.1845, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 26.40% (0.1655 => 0.2092, std.dev.: 0.0004) MultiSource/Benchmarks/llubenchmark/llu: 21.65% (0.0462 => 0.0562, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.95% (0.1566 => 0.1894, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 19.74% (0.1555 => 0.1862, std.dev.: 0.0039) SingleSource/UnitTests/SignlessTypes/rem: 19.41% (0.1144 => 0.1366, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.29% (0.0871 => 0.1039, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 19.24% (0.5105 => 0.6087, std.dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/almabench: 17.95% (0.0730 => 0.0861, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 17.83% (0.0746 => 0.0879, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 17.74% (0.2554 => 0.3007, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 17.66% (0.2271 => 0.2672, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.56% (1.3050 => 1.5342, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.47% (0.6675 => 0.7841, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 17.45% (0.1175 => 0.1380, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.43% (0.1337 => 0.1570, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/mst/mst: 17.28% (0.1163 => 0.1364, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 17.09% (0.3177 => 0.3720, std.dev.: 0.0023) MultiSource/Applications/d/make_dparser: 17.01% (3.3354 => 3.9029, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 16.91% (0.4879 => 0.5704, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 16.88% (0.7115 => 0.8316, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 16.75% (0.1236 => 0.1443, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.53% (0.5020 => 0.5850, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: 16.45% (0.0626 => 0.0729, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.39% (0.0793 => 0.0923, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.38% (0.1032 => 0.1201, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 16.35% (0.1584 => 0.1843, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.32% (1.5415 => 1.7931, std.dev.: 0.0114) MultiSource/Benchmarks/Olden/em3d/em3d: 16.28% (0.1695 => 0.1971, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.23% (0.8172 => 0.9498, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ks/ks: 16.16% (0.1510 => 0.1754, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.12% (0.4615 => 0.5359, std.dev.: 0.0018) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 15.64% (0.1125 => 0.1301, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.62% (0.1940 => 0.2243, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 15.59% (22.1758 => 25.6331, std.dev.: 0.0158) MultiSource/Applications/sgefa/sgefa: 15.50% (0.3109 => 0.3591, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.35% (0.0886 => 0.1022, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 15.22% (0.1906 => 0.2196, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.20% (0.0842 => 0.0970, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.06% (0.3121 => 0.3591, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 15.02% (0.2603 => 0.2994, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/17-bintr/bintr: 14.96% (0.0675 => 0.0776, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 14.94% (0.1151 => 0.1323, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 14.73% (1.1840 => 1.3584, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.57% (0.2107 => 0.2414, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 14.51% (0.7835 => 0.8972, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.50% (0.1117 => 0.1279, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 14.48% (1.1642 => 1.3328, std.dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.48% (0.6450 => 0.7384, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.42% (0.9765 => 1.1173, std.dev.: 0.0070) SingleSource/Benchmarks/McGill/exptree: 14.37% (0.0814 => 0.0931, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.26% (0.2700 => 0.3085, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.25% (0.2758 => 0.3151, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 14.21% (2.0273 => 2.3153, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.16% (0.0770 => 0.0879, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.15% (4.2646 => 4.8682, std.dev.: 0.0114) MultiSource/Applications/lemon/lemon: 14.06% (1.0722 => 1.2229, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.85% (0.2065 => 0.2351, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.79% (0.5860 => 0.6668, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.75% (0.1062 => 0.1208, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.69% (1.4186 => 1.6128, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.68% (0.5981 => 0.6799, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.66% (0.1625 => 0.1847, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 13.64% (1.1861 => 1.3479, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 13.59% (0.8921 => 1.0133, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 13.56% (0.7433 => 0.8441, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.53% (0.0798 => 0.0906, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: 13.47% (0.3423 => 0.3884, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.41% (0.1029 => 0.1167, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.33% (0.1695 => 0.1921, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.18% (0.0933 => 0.1056, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 13.12% (0.4299 => 0.4863, std.dev.: 0.0014) MultiSource/Applications/lua/lua: 13.11% (3.8723 => 4.3798, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.85% (0.3307 => 0.3732, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.73% (0.3826 => 0.4313, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.70% (0.0929 => 0.1047, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 12.65% (0.0838 => 0.0944, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.64% (0.5569 => 0.6273, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.56% (0.1330 => 0.1497, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 12.52% (0.3387 => 0.3811, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.51% (0.1143 => 0.1286, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 12.46% (0.1268 => 0.1426, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.12% (0.3441 => 0.3858, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 11.97% (9.4845 => 10.6202, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/bh/bh: 11.84% (0.3092 => 0.3458, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 11.42% (0.3180 => 0.3543, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 11.24% (0.4289 => 0.4771, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.21% (0.1892 => 0.2104, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 11.12% (0.0953 => 0.1059, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.12% (0.3543 => 0.3937, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 10.88% (5.0018 => 5.5460, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 10.86% (4.9449 => 5.4817, std.dev.: 0.0029) MultiSource/Applications/siod/siod: 10.78% (2.2969 => 2.5445, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 10.73% (0.6456 => 0.7149, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.71% (0.8101 => 0.8969, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: 10.65% (0.4620 => 0.5112, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 10.62% (0.3927 => 0.4344, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.57% (0.3473 => 0.3840, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.48% (0.3694 => 0.4081, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.45% (2.2022 => 2.4323, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.43% (14.3668 => 15.8657, std.dev.: 0.0065) SingleSource/UnitTests/ObjC/synchronized: 10.42% (0.3561 => 0.3932, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.41% (0.3543 => 0.3912, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.40% (0.3828 => 0.4226, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.35% (0.3516 => 0.3880, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 10.32% (0.3497 => 0.3858, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.29% (0.4636 => 0.5113, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/ReedSolomon: 10.15% (0.2049 => 0.2257, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.06% (0.3865 => 0.4254, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 10.04% (0.3886 => 0.4276, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 9.94% (0.3422 => 0.3762, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.69% (0.3427 => 0.3759, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.64% (0.4203 => 0.4608, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 9.63% (17.1811 => 18.8353, std.dev.: 0.0286) MultiSource/Applications/hbd/hbd: 9.45% (1.5603 => 1.7077, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/lists1: 9.36% (0.3684 => 0.4029, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/moments: 9.14% (0.4048 => 0.4418, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.14% (0.4103 => 0.4478, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.93% (0.2430 => 0.2647, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 8.90% (0.7326 => 0.7978, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 8.84% (0.6030 => 0.6563, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.81% (0.5925 => 0.6447, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 8.58% (0.3603 => 0.3912, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.22% (0.4064 => 0.4398, std.dev.: 0.0034) SingleSource/Regression/C++/ofstream_ctor: 8.19% (0.2905 => 0.3143, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.09% (3.8922 => 4.2072, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.98% (0.2793 => 0.3016, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.95% (0.2756 => 0.2975, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.84% (0.3650 => 0.3936, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 7.74% (0.2725 => 0.2936, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.69% (0.3162 => 0.3405, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 7.68% (0.3098 => 0.3336, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.61% (0.2891 => 0.3111, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 7.52% (0.3283 => 0.3530, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 7.52% (0.2714 => 0.2918, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 7.50% (0.3282 => 0.3528, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 7.45% (0.2831 => 0.3042, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.42% (0.2872 => 0.3085, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.32% (2.0665 => 2.2177, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary: 7.27% (0.3232 => 0.3467, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.11% (0.2871 => 0.3075, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.06% (0.2877 => 0.3080, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 7.04% (0.3052 => 0.3267, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 7.03% (0.2802 => 0.2999, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.02% (0.2266 => 0.2425, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary2: 6.72% (0.3379 => 0.3606, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 6.49% (1.2842 => 1.3676, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.32% (0.8067 => 0.8577, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.74% (0.3136 => 0.3316, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 5.08% (0.3131 => 0.3290, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.47% (7.9617 => 8.3178, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (0.3935 => 0.4080, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.86% (0.3817 => 0.3926, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.71% (7.0540 => 7.2450, std.dev.: 0.0091) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.11% (1.1145 => 1.3721, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 10.55% (0.9957 => 1.1007, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 9.84% (1.1396 => 1.2517, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.95% (2.8904 => 3.0913, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (3.1578 => 3.3679, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: 4.50% (3.3453 => 3.4960, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 2.98% (1.9405 => 1.9984, std.dev.: 0.0085) MultiSource/Applications/viterbi/viterbi: 2.50% (4.4649 => 4.5765, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.46% (4.2280 => 4.3321, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/bisort/bisort: 1.96% (0.8333 => 0.8496, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 1.54% (3.1595 => 3.2082, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.43% (11.6436 => 11.8096, std.dev.: 0.0019) MultiSource/Applications/minisat/minisat: 1.42% (9.1159 => 9.2449, std.dev.: 0.0133) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -76.45% (0.8651 => 0.2037, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.29% (5.3855 => 2.4081, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -54.93% (5.3526 => 2.4123, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: -45.38% (0.1622 => 0.0886, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.00% (1.1194 => 0.6828, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.91% (5.2763 => 3.2234, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -23.81% (1.7609 => 1.3417, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -17.46% (2.9384 => 2.4254, std.dev.: 0.0019) SingleSource/UnitTests/Vector/constpool: -8.78% (54.1659 => 49.4121, std.dev.: 0.0045) MultiSource/Applications/JM/ldecod/ldecod: -8.38% (10.4361 => 9.5616, std.dev.: 0.0095) MultiSource/Benchmarks/PAQ8p/paq8p: -6.47% (10.3673 => 9.6961, std.dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -54.03% (8.0499 => 3.7006, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0134, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.38% (1.1492 => 0.7656, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.81% (0.0506 => 0.0340) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.56% (0.3987 => 0.2689) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.51% (2.9695 => 2.3604, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.99% (1.2258 => 0.9930, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -16.05% (1.6925 => 1.4208, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -10.99% (9.5636 => 8.5127, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -10.68% (1.2373 => 1.1051, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel-2: -10.43% (1.5373 => 1.3769, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.29% (19.9488 => 18.2946, std.dev.: 0.1171) MultiSource/Benchmarks/FreeBench/mason/mason: -7.96% (0.2161 => 0.1989, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.05% (1.8329 => 1.7037, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4781, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -5.45% (6.6465 => 6.2842, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.08% (1.6805 => 1.5952, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.73% (0.2497 => 0.2379) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5091, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.82% (8.1563 => 7.8444, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Applications/siod/siod: -3.71% (3.2827 => 3.1610, std.dev.: 0.0232) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.53% (32.5116 => 31.3629, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: -3.29% (5.0483 => 4.8820, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.90% (4.5009 => 4.3703, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: -2.75% (4.6441 => 4.5163, std.dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.68% (0.4808 => 0.4679, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/multiplies: -1.97% (2.5528 => 2.5024, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -1.90% (10.2830 => 10.0878, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6804, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: -1.62% (1.1277 => 1.1094, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -1.19% (85.0658 => 84.0536, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.19% (1.7254 => 1.7049, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8588, std.dev.: 0.0042) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.63% (7.1582 => 7.7757, std.dev.: 0.0054) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: 10633.06% (0.0720 => 7.7278, std.dev.: 0.0048) MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.96% (0.2116 => 0.0678, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 2.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 09:14:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 11:14:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121027161459.7D89F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5298?compare_to=5291&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5298, Order: 166873, Start Time: 2012-10-27 12:59:09, End Time: 2012-10-27 16:14:57 To: 5291, Order: 166868, Start Time: 2012-10-27 08:54:16, End Time: 2012-10-27 12:11:02 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (168 on baseline) Performance Improvements: 5 (19 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1034 (721 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 18.32% (0.3914 => 0.4631, std.dev.: 0.0153) Performance Regressions - Execution Time ---------------------------------------- SingleSource/UnitTests/Vector/build2: 1.14% (10.8210 => 10.9444, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.04% (54.3922 => 54.9591, std.dev.: 0.0274) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -1.81% (0.5921 => 0.5814, std.dev.: 0.0022) SingleSource/UnitTests/Vector/constpool: -1.70% (2.4869 => 2.4445, std.dev.: 0.0116) MultiSource/Applications/SPASS/SPASS: -1.31% (6.2235 => 6.1422, std.dev.: 0.0082) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.23% (3.1507 => 3.1120, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: -1.12% (1.2526 => 1.2386, std.dev.: 0.0032) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.12% (0.0625 => 0.0882, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.36% (0.1063 => 0.1407, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.40% (0.2969 => 0.3723, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.14% (0.1106 => 0.1384, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.90% (0.4253 => 0.5312, std.dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 24.31% (1.5932 => 1.9805, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 23.53% (0.4139 => 0.5113, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.29% (0.5900 => 0.7274, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.11% (0.0714 => 0.0879, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 22.97% (0.4994 => 0.6141, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.28% (0.5000 => 0.6114, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.26% (0.0584 => 0.0714, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.12% (0.0547 => 0.0668, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.11% (0.0475 => 0.0580, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.85% (0.0897 => 0.1093, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 20.87% (0.0599 => 0.0724, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 20.57% (0.1021 => 0.1231, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 20.43% (0.1620 => 0.1951, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.40% (0.1103 => 0.1328, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 20.33% (0.1107 => 0.1332, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 19.54% (0.0604 => 0.0722, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.52% (0.0584 => 0.0698, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.42% (0.3903 => 0.4661, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 19.41% (0.0948 => 0.1132, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.41% (0.0541 => 0.0646, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.17% (0.1549 => 0.1846, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/04-bisect/bisect: 19.12% (0.0633 => 0.0754, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.01% (0.1604 => 0.1909, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.00% (0.0642 => 0.0764, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: 18.76% (0.0821 => 0.0975, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.74% (0.1003 => 0.1191, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: 18.72% (0.1619 => 0.1922, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.49% (0.0822 => 0.0974, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.40% (0.1462 => 0.1731, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 17.95% (0.0808 => 0.0953, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.58% (0.2736 => 0.3217, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 17.53% (0.0947 => 0.1113, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.51% (0.3890 => 0.4571, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/Hello: 17.35% (0.5826 => 0.6837, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.33% (1.3152 => 1.5431, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: 17.07% (0.5889 => 0.6894, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.03% (0.2014 => 0.2357, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/mst/mst: 16.91% (0.0698 => 0.0816, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 16.88% (0.1505 => 0.1759, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 16.83% (0.4029 => 0.4707, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 16.75% (0.1218 => 0.1422, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 16.64% (0.1088 => 0.1269, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 16.53% (0.5546 => 0.6463, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 16.52% (1.8794 => 2.1898, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.47% (0.2866 => 0.3338, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.35% (0.2875 => 0.3345, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 16.32% (0.9697 => 1.1280, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.96% (0.1968 => 0.2282, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 15.93% (0.4658 => 0.5400, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 15.82% (3.5627 => 4.1263, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/hello: 15.77% (0.2714 => 0.3142, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 15.75% (0.3004 => 0.3477, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/fibo: 15.74% (0.2725 => 0.3154, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 15.73% (0.7171 => 0.8299, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.68% (0.3195 => 0.3696, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.68% (0.5026 => 0.5814, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.67% (0.2738 => 0.3167, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.60% (0.1160 => 0.1341, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.53% (0.3271 => 0.3779, std.dev.: 0.0085) MultiSource/Benchmarks/MallocBench/espresso/espresso: 15.53% (1.6211 => 1.8728, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.49% (2.0673 => 2.3876, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: 15.47% (0.9909 => 1.1442, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.43% (0.2729 => 0.3150, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 15.36% (0.2780 => 0.3207, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 15.35% (0.2750 => 0.3172, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 15.34% (0.3096 => 0.3571, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 15.34% (0.1421 => 0.1639, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 15.20% (0.2803 => 0.3229, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 15.19% (0.2811 => 0.3238, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.15% (0.2911 => 0.3352, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.08% (0.2792 => 0.3213, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 15.04% (0.2813 => 0.3236, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 15.03% (0.1284 => 0.1477, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.02% (0.4361 => 0.5016, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 15.02% (0.2823 => 0.3247, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 14.89% (1.0781 => 1.2386, std.dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: 14.81% (23.5202 => 27.0041, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 14.80% (4.4195 => 5.0734, std.dev.: 0.0082) MultiSource/Applications/ClamAV/clamscan: 14.79% (4.2109 => 4.8336, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.71% (0.3930 => 0.4508, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary3: 14.60% (0.3267 => 0.3744, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 14.55% (0.3258 => 0.3732, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 14.44% (0.3317 => 0.3796, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.41% (0.3060 => 0.3501, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.40% (0.3362 => 0.3846, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.37% (1.9694 => 2.2525, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 14.23% (0.4146 => 0.4736, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.17% (0.3845 => 0.4390, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.13% (0.1090 => 0.1244, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.10% (1.9966 => 2.2782, std.dev.: 0.0052) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.03% (2.7292 => 3.1120, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.92% (0.3124 => 0.3559, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 13.80% (0.3348 => 0.3810, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.74% (0.3282 => 0.3733, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 13.72% (0.3477 => 0.3954, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 13.69% (0.4251 => 0.4833, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/football/football: 13.69% (0.2075 => 0.2359, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: 13.62% (0.3678 => 0.4179, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 13.50% (0.3726 => 0.4229, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 13.45% (0.2566 => 0.2911, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.38% (0.3625 => 0.4110, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.33% (0.3690 => 0.4182, std.dev.: 0.0022) MultiSource/Applications/lua/lua: 13.20% (1.4269 => 1.6153, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.19% (0.3981 => 0.4506, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 13.03% (0.5012 => 0.5665, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 12.93% (0.7875 => 0.8893, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 12.72% (2.1653 => 2.4408, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.53% (0.3488 => 0.3925, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 12.49% (4.6177 => 5.1946, std.dev.: 0.0101) MultiSource/Benchmarks/mafft/pairlocalalign: 12.44% (2.1013 => 2.3626, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.01% (0.2040 => 0.2285, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions-4: 11.89% (0.3465 => 0.3877, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 11.84% (0.3496 => 0.3910, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.81% (0.3446 => 0.3853, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.76% (0.3460 => 0.3867, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 11.74% (0.3442 => 0.3846, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.73% (0.3469 => 0.3876, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 11.53% (0.3650 => 0.4071) SingleSource/UnitTests/ObjC/parameter-passing: 11.44% (0.3724 => 0.4150, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 11.42% (0.3643 => 0.4059, std.dev.: 0.0059) MultiSource/Applications/SIBsim4/SIBsim4: 11.22% (0.2691 => 0.2993, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.20% (0.6435 => 0.7156, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 10.86% (0.3498 => 0.3878, std.dev.: 0.0086) MultiSource/Applications/SPASS/SPASS: 10.84% (5.5417 => 6.1422, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.80% (0.1028 => 0.1139, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.41% (0.2737 => 0.3022, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.35% (0.2068 => 0.2282, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 10.27% (0.4847 => 0.5345, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 10.24% (0.6634 => 0.7313, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.20% (0.1383 => 0.1524, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 9.95% (0.3336 => 0.3668, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.82% (0.3084 => 0.3387, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.08% (0.2103 => 0.2294, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 9.05% (2.0346 => 2.2188, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.85% (4.6926 => 5.1079, std.dev.: 0.0073) MultiSource/Applications/lemon/lemon: 8.70% (0.2391 => 0.2599, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.20% (11.6398 => 12.5938, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.78% (0.5361 => 0.5778, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.29% (0.5584 => 0.5991, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.03% (0.7426 => 0.7948, std.dev.: 0.0070) MultiSource/Applications/kimwitu++/kc: 6.18% (11.9555 => 12.6942, std.dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6537, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0300, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.25% (0.5917 => 0.6701, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 8.82% (0.2802 => 0.3049, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6112, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.04% (0.3693 => 0.3916, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.01% (12.0509 => 12.6551, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1674, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-2: 3.69% (1.8057 => 1.8724, std.dev.: 0.0050) SingleSource/Benchmarks/Dhrystone/dry: 2.67% (14.0481 => 14.4229, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1937, std.dev.: 0.0042) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.68% (3.1722 => 3.2254, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.48% (7.1849 => 7.2912, std.dev.: 0.0020) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3088, std.dev.: 0.0022) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.33% (1.0142 => 1.0277, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.25% (1.0927 => 1.1064, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5138, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5933, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.29% (2.4764 => 2.4445, std.dev.: 0.0116) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.52% (25.4195 => 16.3906, std.dev.: 0.0305) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9781, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7756, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/tsp/tsp: -7.21% (2.1113 => 1.9591, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -6.54% (0.2402 => 0.2245, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std.dev.: 0.0053) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7740, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5217, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.35% (11.2080 => 10.9444, std.dev.: 0.0086) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.21% (41.7953 => 40.8736, std.dev.: 0.0082) SingleSource/Benchmarks/Dhrystone/fldry: -2.05% (17.2379 => 16.8838, std.dev.: 0.0224) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5718, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: -1.55% (5.5810 => 5.4946, std.dev.: 0.0072) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.33% (5.7935 => 5.7167, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.2039, std.dev.: 0.0860) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.06% (3.3991 => 3.3630, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0441, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 09:16:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 11:16:52 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121027161652.039CE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5299?compare_to=5295&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5299, Order: 166875, Start Time: 2012-10-27 14:51:55, End Time: 2012-10-27 16:16:49 To: 5295, Order: 166873, Start Time: 2012-10-27 12:49:09, End Time: 2012-10-27 14:13:11 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 36 (96 on baseline) Performance Improvements: 3 (5 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 936 (873 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 8.90% (0.1876 => 0.2043, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.77% (0.1942 => 0.2054, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.96% (0.9528 => 0.9810, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.81% (0.6088 => 0.6259, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.33% (0.6516 => 0.6668, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.33% (0.5284 => 0.5407, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.20% (0.8925 => 0.9121, std.dev.: 0.0049) MultiSource/Applications/SIBsim4/SIBsim4: 2.19% (1.3247 => 1.3537, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.11% (1.2734 => 1.3003, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.11% (1.1984 => 1.2237, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.94% (1.6899 => 1.7226, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 1.92% (14.5756 => 14.8557, std.dev.: 0.0903) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.68% (1.1752 => 1.1950, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.61% (0.6700 => 0.6808, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.56% (0.8525 => 0.8658, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.53% (0.8305 => 0.8432, std.dev.: 0.0042) MultiSource/Benchmarks/PAQ8p/paq8p: 1.52% (2.4045 => 2.4410, std.dev.: 0.0032) MultiSource/Applications/Burg/burg: 1.51% (1.2864 => 1.3058, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.48% (0.8394 => 0.8518, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.47% (0.8462 => 0.8586, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.43% (0.9174 => 0.9305, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.42% (0.8186 => 0.8302, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.36% (0.8279 => 0.8392, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.19% (4.6526 => 4.7081, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.18% (0.9821 => 0.9937, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.17% (0.8597 => 0.8698, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: 1.17% (32.4103 => 32.7901, std.dev.: 0.1051) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.17% (0.8974 => 0.9079, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.12% (0.9161 => 0.9264, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 12.51% (0.7671 => 0.8631, std.dev.: 0.0218) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.69% (21.1278 => 22.1197, std.dev.: 0.1981) SingleSource/Benchmarks/CoyoteBench/lpbench: 2.86% (3.8866 => 3.9976, std.dev.: 0.0099) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.65% (0.3997 => 0.4103, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/hash: 1.20% (4.2707 => 4.3220, std.dev.: 0.0168) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.12% (1.1260 => 1.1386, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.02% (1.5943 => 1.6105, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.79% (0.9085 => 0.8741, std.dev.: 0.0133) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -11.96% (24.1464 => 21.2591, std.dev.: 1.0988) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.51% (0.3214 => 0.3037, std.dev.: 0.0014) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.78% (16.5751 => 16.7041, std.dev.: 0.0503) MultiSource/Applications/obsequi/Obsequi: 1.14% (1.0569 => 1.0689, std.dev.: 0.0081) MultiSource/Applications/sqlite3/sqlite3: 0.67% (0.6441 => 0.6484, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/08-main/main: -1.61% (0.1925 => 0.1894, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.19% (0.1630 => 0.1682, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.43% (0.3206 => 0.3252, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.52% (0.2501 => 0.2514, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.12% (0.3397 => 0.3359, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.34% (0.2368 => 0.2447, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 0.98% (0.6019 => 0.6078, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel: -2.75% (0.0437 => 0.0425, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.11% (0.3322 => 0.3359, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 0.60% (0.2010 => 0.2022, std.dev.: 0.0031) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 10.55% (0.0218 => 0.0241, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -34.56% (0.0217 => 0.0142, std.dev.: 0.0054) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.23% (0.0426 => 0.0427, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.30% (0.0331 => 0.0332, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.28% (0.0307 => 0.0314, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.95% (0.0419 => 0.0423, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 24.39% (0.0164 => 0.0204, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/test1: 17.93% (0.0184 => 0.0217, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: 25.68% (0.0257 => 0.0323, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -3.03% (0.1483 => 0.1438, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.91% (1.1230 => 1.1015, std.dev.: 0.0239) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 1.13% (0.1502 => 0.1519, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.15% (0.4051 => 0.4045, std.dev.: 0.0308) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -8.06% (0.1415 => 0.1301, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.16% (0.0605 => 0.0612, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 20.61% (0.0228 => 0.0275, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.50% (0.0571 => 0.0591, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.03% (1.1437 => 1.1433, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 72.22% (0.0018 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 16.58% (0.0561 => 0.0654, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 38.95% (0.0190 => 0.0264, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.44% (0.8008 => 0.7973, std.dev.: 0.0093) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 61.90% (0.0042 => 0.0068, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.90% (2.1832 => 1.6614, std.dev.: 0.0280) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 36.03% (14.7684 => 20.0899, std.dev.: 0.1571) MultiSource/Benchmarks/Olden/tsp/tsp: 15.02% (0.1112 => 0.1279, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.81% (0.0810 => 0.0930, std.dev.: 0.0044) SingleSource/UnitTests/SignlessTypes/rem: 12.27% (0.1035 => 0.1162, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.38% (0.1885 => 0.2043, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.90% (0.6010 => 0.6485, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.84% (0.2180 => 0.2351, std.dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 7.71% (1.2568 => 1.3537, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.24% (0.1905 => 0.2043, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.09% (0.1466 => 0.1570, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.98% (1.1170 => 1.1950, std.dev.: 0.0016) MultiSource/Applications/viterbi/viterbi: 6.98% (0.1577 => 0.1687, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/em3d/em3d: 6.97% (0.1721 => 0.1841, std.dev.: 0.0041) MultiSource/Applications/Burg/burg: 6.84% (1.2222 => 1.3058, std.dev.: 0.0027) MultiSource/Applications/spiff/spiff: 6.70% (0.7950 => 0.8483, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.14% (0.7473 => 0.7932, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.06% (0.6287 => 0.6668, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.99% (0.2519 => 0.2670, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.67% (6.6074 => 6.9819, std.dev.: 0.0566) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.66% (0.2279 => 0.2408, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.53% (13.1811 => 13.9094, std.dev.: 0.0790) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.44% (1.1606 => 1.2237, std.dev.: 0.0087) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.28% (0.6227 => 0.6556, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.22% (0.2741 => 0.2884, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.18% (0.8148 => 0.8570, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.13% (1.6386 => 1.7226, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.05% (0.8321 => 0.8741, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.00% (0.5961 => 0.6259, std.dev.: 0.0048) MultiSource/Applications/sgefa/sgefa: 4.83% (0.2999 => 0.3144, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.75% (0.4127 => 0.4323, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 4.74% (1.4269 => 1.4946, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.58% (0.2794 => 0.2922, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 4.17% (14.2605 => 14.8557, std.dev.: 0.0903) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.16% (0.5191 => 0.5407, std.dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 4.13% (1.1271 => 1.1737, std.dev.: 0.0108) MultiSource/Applications/treecc/treecc: 4.10% (1.9948 => 2.0766, std.dev.: 0.0243) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.06% (0.4783 => 0.4977, std.dev.: 0.0048) MultiSource/Applications/d/make_dparser: 4.04% (3.2366 => 3.3675, std.dev.: 0.0289) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.98% (1.3279 => 1.3807, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.97% (0.9435 => 0.9810, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.93% (0.3003 => 0.3121, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.74% (8.6476 => 8.9706, std.dev.: 0.0690) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.60% (0.2998 => 0.3106, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 3.59% (0.8805 => 0.9121, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/football/football: 3.57% (0.8768 => 0.9081, std.dev.: 0.0041) MultiSource/Applications/lemon/lemon: 3.42% (1.0945 => 1.1319, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.37% (0.6586 => 0.6808, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.28% (0.3657 => 0.3777, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 3.26% (0.3800 => 0.3924, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 3.26% (4.1305 => 4.2651, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.19% (0.8697 => 0.8974, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.18% (1.2602 => 1.3003, std.dev.: 0.0055) MultiSource/Applications/minisat/minisat: 3.16% (0.6834 => 0.7050, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash2: 3.10% (0.4125 => 0.4253, std.dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 3.02% (8.6247 => 8.8854, std.dev.: 0.0667) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.02% (4.5702 => 4.7081, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.96% (0.8712 => 0.8970, std.dev.: 0.0099) MultiSource/Benchmarks/Bullet/bullet: 2.92% (31.8598 => 32.7901, std.dev.: 0.1051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.90% (0.8611 => 0.8861, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.86% (0.8007 => 0.8236, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.85% (0.8457 => 0.8698, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.83% (0.8420 => 0.8658, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.82% (0.8340 => 0.8575, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.80% (0.8286 => 0.8518, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.78% (0.8204 => 0.8432, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.77% (0.8331 => 0.8562, std.dev.: 0.0076) MultiSource/Applications/JM/ldecod/ldecod: 2.75% (6.7320 => 6.9174, std.dev.: 0.0350) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.75% (0.8317 => 0.8546, std.dev.: 0.0077) MultiSource/Benchmarks/PAQ8p/paq8p: 2.72% (2.3764 => 2.4410, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.72% (0.8359 => 0.8586, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.67% (0.9908 => 1.0173, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.67% (0.8086 => 0.8302, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.63% (0.8177 => 0.8392, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.60% (0.9069 => 0.9305, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.57% (0.9688 => 0.9937, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.52% (4.4880 => 4.6010, std.dev.: 0.0191) MultiSource/Applications/JM/lencod/lencod: 2.50% (15.3280 => 15.7108, std.dev.: 0.0917) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.42% (0.7932 => 0.8124, std.dev.: 0.0069) MultiSource/Applications/siod/siod: 2.39% (2.2184 => 2.2714, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.34% (0.8716 => 0.8920, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.30% (0.9056 => 0.9264, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.25% (0.8048 => 0.8229, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.24% (0.8316 => 0.8502, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.24% (0.8855 => 0.9053, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.18% (0.8885 => 0.9079, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.16% (0.9039 => 0.9234, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.94% (1.5795 => 2.5105, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.32% (0.3186 => 0.3483, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.27% (1.1857 => 1.2838, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 5.94% (63.1822 => 66.9338, std.dev.: 0.0459) MultiSource/Applications/siod/siod: 3.02% (3.6643 => 3.7749, std.dev.: 0.0102) SingleSource/Benchmarks/CoyoteBench/lpbench: 2.49% (3.9006 => 3.9976, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/hash: 2.37% (0.6205 => 0.6352, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: 1.73% (2.3560 => 2.3967, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.68% (2.9096 => 2.9586, std.dev.: 0.0144) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.03% (1.5941 => 1.6105, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.10% (0.3269 => 0.3037, std.dev.: 0.0014) MultiSource/Applications/lua/lua: -5.11% (29.8330 => 28.3095, std.dev.: 0.0185) SingleSource/Benchmarks/Shootout-C++/hash2: -1.45% (3.4237 => 3.3741, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.36% (1.2822 => 1.2648, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.25% (3.3479 => 3.3060, std.dev.: 0.0023) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 1.57% (16.4461 => 16.7041, std.dev.: 0.0503) MultiSource/Applications/obsequi/Obsequi: 4.16% (1.0262 => 1.0689, std.dev.: 0.0081) MultiSource/Applications/sqlite3/sqlite3: 2.40% (0.6332 => 0.6484, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/08-main/main: 3.44% (0.1831 => 0.1894, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.89% (0.1559 => 0.1682, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.13% (0.3123 => 0.3252, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.07% (0.2463 => 0.2514, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.45% (0.3344 => 0.3359, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.51% (0.2364 => 0.2447, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 1.13% (0.6010 => 0.6078, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel: -0.93% (0.0429 => 0.0425, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.85% (0.3266 => 0.3359, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 2.69% (0.1969 => 0.2022, std.dev.: 0.0031) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.59% (0.0224 => 0.0241, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 15.45% (0.0123 => 0.0142, std.dev.: 0.0054) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.71% (0.0254 => 0.0332, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: 40.43% (0.0230 => 0.0323, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: - (0.1438 => 0.1438, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -2.77% (1.1329 => 1.1015, std.dev.: 0.0239) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.90% (0.1462 => 0.1519, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.86% (0.4164 => 0.4045, std.dev.: 0.0308) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.97% (0.1369 => 0.1301, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.52% (0.0641 => 0.0612, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.03% (0.0195 => 0.0275, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.25% (0.0578 => 0.0591, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.03% (1.1437 => 1.1433, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.31% (0.0627 => 0.0654, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 46.67% (0.0180 => 0.0264, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.55% (0.8017 => 0.7973, std.dev.: 0.0093) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 9.68% (0.0062 => 0.0068, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 09:57:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 11:57:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121027165747.29FA92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5300?compare_to=5296&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5300, Order: 166876, Start Time: 2012-10-27 15:32:27, End Time: 2012-10-27 16:57:43 To: 5296, Order: 166873, Start Time: 2012-10-27 13:44:18, End Time: 2012-10-27 15:09:29 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 14 (6 on baseline) Performance Improvements: 1 (176 on baseline) Unchanged Tests: 1027 (860 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/nbench/nbench: 2.77% (1.0863 => 1.1164, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 1.44% (1.3382 => 1.3575, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.41% (0.7114 => 0.7214, std.dev.: 0.0031) MultiSource/Applications/d/make_dparser: 1.32% (3.3340 => 3.3781, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 1.27% (14.6207 => 14.8067, std.dev.: 0.0063) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.27% (6.4114 => 6.4928, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 1.21% (18.0818 => 18.3013, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 1.18% (8.6531 => 8.7551, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.08% (7.5877 => 7.6697, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.08% (1.3739 => 1.3887, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 1.02% (4.7992 => 4.8482, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.71% (54.4465 => 56.4674, std.dev.: 0.1328) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.20% (1.2755 => 1.3035, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.16% (79.1783 => 80.0979, std.dev.: 0.2722) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.23% (20.2334 => 19.9849, std.dev.: 0.0212) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 19.99% (15.2527 => 18.3013, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.47% (54.5751 => 56.4674, std.dev.: 0.1328) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.55% (2.0478 => 2.1000, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/salsa20: 2.24% (7.4937 => 7.6617, std.dev.: 0.0190) SingleSource/Benchmarks/Shootout-C++/hash2: 2.23% (3.1932 => 3.2644, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.78% (0.1584 => 0.1445, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.46% (0.1431 => 0.1310, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -7.20% (2.4924 => 2.3129, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.20% (0.3821 => 0.3546, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -7.01% (0.3880 => 0.3608, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -7.00% (0.3831 => 0.3563, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -6.90% (0.3896 => 0.3627, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -6.90% (0.3812 => 0.3549, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.86% (0.3848 => 0.3584, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -6.79% (0.4033 => 0.3759, std.dev.: 0.0078) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.77% (0.3884 => 0.3621, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.77% (22.4056 => 20.8889, std.dev.: 0.0175) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.76% (0.3891 => 0.3628, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.71% (0.2428 => 0.2265, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -6.70% (0.4176 => 0.3896, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.67% (0.3658 => 0.3414, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -6.62% (0.4199 => 0.3921, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.62% (0.3142 => 0.2934, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -6.52% (0.4280 => 0.4001, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.43% (5.4682 => 5.1166, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.31% (4.5069 => 4.2225, std.dev.: 0.0050) MultiSource/Applications/siod/siod: -6.17% (2.4021 => 2.2539, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.15% (0.9542 => 0.8955, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: -6.15% (7.0961 => 6.6600, std.dev.: 0.0031) MultiSource/Applications/Burg/burg: -6.13% (1.2515 => 1.1748, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: -6.12% (0.1879 => 0.1764, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: -6.11% (0.2160 => 0.2028, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -6.11% (0.3357 => 0.3152, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -6.09% (0.2659 => 0.2497, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.09% (3.5339 => 3.3188, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.07% (0.4151 => 0.3899, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: -6.04% (1.3148 => 1.2354, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/fibo: -6.03% (0.2871 => 0.2698, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -5.99% (16.1920 => 15.2220, std.dev.: 0.0147) MultiSource/Benchmarks/MallocBench/gs/gs: -5.99% (4.3330 => 4.0735, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: -5.99% (0.2989 => 0.2810, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.99% (0.3057 => 0.2874, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.97% (0.3252 => 0.3058, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.96% (0.9852 => 0.9265, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -5.95% (0.3026 => 0.2846, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.93% (2.1713 => 2.0426, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.92% (0.6484 => 0.6100, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.90% (0.4083 => 0.3842, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/random: -5.89% (0.2939 => 0.2766, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.87% (1.6474 => 1.5507, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.86% (0.4321 => 0.4068, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.85% (0.3849 => 0.3624, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.83% (4.8161 => 4.5351, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: -5.83% (0.3394 => 0.3196, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -5.83% (0.3446 => 0.3245, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -5.83% (0.3481 => 0.3278, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -5.83% (0.2849 => 0.2683, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.82% (0.2903 => 0.2734, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: -5.80% (0.3205 => 0.3019, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -5.80% (0.4861 => 0.4579, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.79% (4.8802 => 4.5975, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: -5.75% (0.3025 => 0.2851, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.75% (0.8521 => 0.8031, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/matrix: -5.71% (0.3255 => 0.3069, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.69% (0.2548 => 0.2403, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -5.69% (0.6750 => 0.6366, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -5.66% (4.0594 => 3.8295, std.dev.: 0.0164) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.66% (1.2784 => 1.2061, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: -5.65% (18.2933 => 17.2604, std.dev.: 0.0158) MultiSource/Benchmarks/Bullet/bullet: -5.64% (34.0927 => 32.1686, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.61% (1.0544 => 0.9952, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.61% (0.7198 => 0.6794, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: -5.60% (0.3194 => 0.3015, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: -5.59% (0.2985 => 0.2818, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.59% (0.7919 => 0.7476, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.53% (0.4427 => 0.4182, std.dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: -5.52% (0.3059 => 0.2890, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.52% (0.2355 => 0.2225, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -5.50% (0.3621 => 0.3422, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: -5.49% (0.3788 => 0.3580, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.48% (4.0323 => 3.8112, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.47% (0.3016 => 0.2851, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.44% (1.2221 => 1.1556, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.44% (1.6364 => 1.5474, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.42% (0.4813 => 0.4552, std.dev.: 0.0042) MultiSource/Applications/lambda-0_1_3/lambda: -5.41% (0.7982 => 0.7550, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists1: -5.38% (0.3867 => 0.3659, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.36% (2.2587 => 2.1377, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.36% (0.2278 => 0.2156, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.35% (0.5999 => 0.5678, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/moments: -5.32% (0.4248 => 0.4022, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.29% (0.3837 => 0.3634, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.27% (1.2210 => 1.1566, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.27% (0.3323 => 0.3148, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.20% (0.6293 => 0.5966, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.16% (1.4642 => 1.3887, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.16% (0.3491 => 0.3311, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.15% (0.2933 => 0.2782, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -5.13% (9.2283 => 8.7551, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.12% (1.3722 => 1.3019, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -5.04% (0.4524 => 0.4296, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: -5.03% (0.3581 => 0.3401, std.dev.: 0.0042) SingleSource/UnitTests/ObjC++/property-reference: -5.03% (0.7779 => 0.7388, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference-object: -4.98% (0.6441 => 0.6120, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -4.96% (0.6347 => 0.6032, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.96% (0.3931 => 0.3736, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.93% (0.6230 => 0.5923, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.89% (0.2106 => 0.2003, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.86% (0.4916 => 0.4677, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.81% (0.5591 => 0.5322, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.80% (0.9557 => 0.9098, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.77% (0.6667 => 0.6349, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.77% (0.7339 => 0.6989, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -4.74% (0.4515 => 0.4301, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.73% (0.6297 => 0.5999, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.73% (0.5478 => 0.5219, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.70% (0.2999 => 0.2858, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.70% (0.5857 => 0.5582, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.69% (0.6052 => 0.5768, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.67% (0.6676 => 0.6364, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.67% (0.5805 => 0.5534, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.67% (0.6194 => 0.5905, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -4.66% (1.1450 => 1.0916, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.66% (0.5859 => 0.5586, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.66% (0.5863 => 0.5590, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.64% (0.5925 => 0.5650, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.62% (0.5802 => 0.5534, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.61% (0.2385 => 0.2275, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/09-vor/vor: -4.59% (0.3271 => 0.3121, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: -4.55% (0.9179 => 0.8761, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: -4.55% (0.8418 => 0.8035, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.54% (0.5570 => 0.5317, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: -4.54% (0.7447 => 0.7109, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.53% (0.5456 => 0.5209, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.52% (0.5705 => 0.5447, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: -4.52% (15.5079 => 14.8067, std.dev.: 0.0063) MultiSource/Benchmarks/sim/sim: -4.52% (0.3406 => 0.3252) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.52% (0.5581 => 0.5329, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.51% (0.5569 => 0.5318, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.49% (0.6681 => 0.6381, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.49% (0.6395 => 0.6108, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.48% (0.5575 => 0.5325, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.47% (0.6440 => 0.6152, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.46% (0.6660 => 0.6363, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.44% (0.6260 => 0.5982, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.44% (0.6446 => 0.6160, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.43% (0.6304 => 0.6025, std.dev.: 0.0073) MultiSource/Applications/treecc/treecc: -4.41% (2.1401 => 2.0458, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.39% (0.6189 => 0.5917, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.34% (0.5688 => 0.5441, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.31% (0.6033 => 0.5773, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.29% (0.5941 => 0.5686, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.28% (0.6395 => 0.6121, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.28% (8.0126 => 7.6697, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.27% (0.5849 => 0.5599, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.26% (0.6736 => 0.6449, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.25% (0.3483 => 0.3335, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -4.21% (17.1032 => 16.3829, std.dev.: 0.0229) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.14% (0.7021 => 0.6730, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.13% (0.5567 => 0.5337, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.12% (0.7524 => 0.7214, std.dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.12% (6.7716 => 6.4928, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.07% (0.3319 => 0.3184, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: -3.95% (1.5610 => 1.4993, std.dev.: 0.0033) MultiSource/Applications/d/make_dparser: -3.91% (3.5154 => 3.3781, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.86% (1.2300 => 1.1825, std.dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -3.80% (20.7746 => 19.9849, std.dev.: 0.0212) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.75% (0.5168 => 0.4974, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.71% (0.9077 => 0.8740, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.62% (0.5329 => 0.5136, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.47% (5.0226 => 4.8482, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.44% (14.2083 => 13.7200, std.dev.: 0.0185) MultiSource/Benchmarks/nbench/nbench: -3.17% (1.1530 => 1.1164, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: -2.08% (1.3864 => 1.3575, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7579, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1728, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.78% (2.2633 => 2.1778, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.00% (1.0557 => 1.0240, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4694, std.dev.: 0.0025) Report Time: 1.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 10:12:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 12:12:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121027171237.1947A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5301?compare_to=5297&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5301, Order: 166876, Start Time: 2012-10-27 15:41:16, End Time: 2012-10-27 17:12:34 To: 5297, Order: 166873, Start Time: 2012-10-27 13:40:05, End Time: 2012-10-27 15:11:31 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (10 on baseline) New Passes: 0 (14 on baseline) Performance Regressions: 49 (187 on baseline) Performance Improvements: 1 (54 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 15 (5 on baseline) Unchanged Tests: 977 (638 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/nbench/nbench: 2.53% (1.3584 => 1.3927, std.dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.17% (0.5850 => 0.5977, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.94% (0.9180 => 0.9358, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.94% (0.6087 => 0.6205, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.89% (0.7841 => 0.7989, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.79% (0.7384 => 0.7516, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.78% (0.7211 => 0.7339, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 1.69% (3.9029 => 3.9690, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.69% (0.7518 => 0.7645, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.67% (0.7468 => 0.7593, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 1.66% (17.3798 => 17.6683, std.dev.: 0.0093) MultiSource/Applications/SIBsim4/SIBsim4: 1.66% (1.6044 => 1.6310, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.64% (0.8494 => 0.8633, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.62% (0.8696 => 0.8837, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.59% (1.0494 => 1.0661, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.58% (0.7768 => 0.7891, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.57% (0.8556 => 0.8690, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.56% (0.8001 => 0.8126, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.56% (0.7448 => 0.7564, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.54% (0.9381 => 0.9525, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.53% (0.7211 => 0.7321, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 1.52% (1.2229 => 1.2415, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 1.51% (1.0133 => 1.0286, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.48% (0.7617 => 0.7730, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.48% (0.8912 => 0.9044, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.48% (0.9413 => 0.9552, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.47% (0.8925 => 0.9056, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.47% (0.7909 => 0.8025, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.46% (0.8316 => 0.8437, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.45% (0.9563 => 0.9702, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.45% (0.8295 => 0.8415, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.45% (0.8994 => 0.9124, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.42% (0.8294 => 0.8412, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.42% (0.8530 => 0.8651, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.40% (0.8149 => 0.8263, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.40% (0.9664 => 0.9799, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.38% (0.7227 => 0.7327, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 1.34% (10.6202 => 10.7628, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.28% (1.5342 => 1.5538, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.26% (0.8702 => 0.8812, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 1.24% (2.3153 => 2.3439, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.23% (1.0044 => 1.0168, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.23% (18.8353 => 19.0678, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.18% (1.7931 => 1.8143, std.dev.: 0.0017) MultiSource/Applications/lua/lua: 1.15% (4.3798 => 4.4302, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.15% (1.1173 => 1.1301, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.15% (1.0393 => 1.0512, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.08% (1.3479 => 1.3624, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.02% (4.2072 => 4.2500, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -5.92% (0.4423 => 0.4161, std.dev.: 0.0097) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: 1.09% (2.0516 => 2.0739, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 1.14% (57.5020 => 58.1554, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.25% (0.0795 => 0.0797, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 0.84% (9.1545 => 9.2317, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.54% (7.7757 => 7.8174, std.dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_shift: -0.19% (0.0518 => 0.0517, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/JM/lencod/lencod: 0.05% (7.7278 => 7.7317, std.dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: - (0.0001 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.42% (0.0678 => 0.0648, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.13% (0.2993 => 0.2989, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_shift: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -63.99% (5.7591 => 2.0739, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -8.05% (63.2438 => 58.1554, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.81% (6.6874 => 0.0797, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.46% (8.1363 => 9.2317, std.dev.: 0.0030) SingleSource/UnitTests/Vector/SSE/sse_shift: 36.77% (0.0378 => 0.0517, std.dev.: 0.0009) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -50.00% (0.0002 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -57.07% (0.6962 => 0.2989, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_shift: -50.00% (0.0002 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 211.91% (0.5229 => 1.6310, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 17.87% (14.9895 => 17.6683, std.dev.: 0.0093) MultiSource/Applications/kimwitu++/kc: 37.82% (14.1553 => 19.5085, std.dev.: 0.0133) MultiSource/Benchmarks/MallocBench/gs/gs: 13.73% (4.1105 => 4.6750, std.dev.: 0.0092) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 32.95% (1.1048 => 1.4688, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 69.73% (3.4629 => 5.8775, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 68.95% (0.6222 => 1.0512, std.dev.: 0.0014) New Passes - Execution Time --------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 3837500.00% (0.0001 => 3.8376, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 11144900.00% (0.0001 => 11.1450, std.dev.: 0.0514) MultiSource/Applications/kimwitu++/kc: 50400.00% (0.0001 => 0.0505, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049700.00% (0.0001 => 10.0498, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5493300.00% (0.0001 => 5.4934, std.dev.: 0.0100) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 77.70% (0.0296 => 0.0526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 69.92% (0.0256 => 0.0435, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 60.15% (0.0271 => 0.0434, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 52.26% (0.0243 => 0.0370, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 44.16% (1.5859 => 2.2862, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.45% (0.0834 => 0.1188, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/distray/distray: 40.91% (0.1056 => 0.1488, std.dev.: 0.0003) SingleSource/UnitTests/vla: 35.77% (0.0355 => 0.0482) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 35.44% (2.2024 => 2.9830, std.dev.: 0.0175) MultiSource/Benchmarks/FreeBench/neural/neural: 33.83% (0.1463 => 0.1958, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 29.26% (0.1432 => 0.1851, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 27.85% (0.1655 => 0.2116, std.dev.: 0.0015) MultiSource/Benchmarks/llubenchmark/llu: 24.03% (0.0462 => 0.0573, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: 22.47% (0.0485 => 0.0594, std.dev.: 0.0010) SingleSource/UnitTests/SignlessTypes/rem: 22.29% (0.1144 => 0.1399, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.55% (0.5105 => 0.6205, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.52% (0.1566 => 0.1903, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 20.84% (0.1555 => 0.1879, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.67% (0.0871 => 0.1051, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 19.69% (0.6675 => 0.7989, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 19.07% (1.3050 => 1.5538, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 19.06% (0.5020 => 0.5977, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 19.00% (3.3354 => 3.9690, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 18.98% (0.2271 => 0.2702, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 18.58% (0.7115 => 0.8437, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/almabench: 18.49% (0.0730 => 0.0865, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 18.38% (0.1175 => 0.1391, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 18.36% (0.0746 => 0.0883, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 18.25% (0.2554 => 0.3020, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 17.96% (0.1236 => 0.1458, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.70% (1.5415 => 1.8143, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.68% (0.1510 => 0.1777, std.dev.: 0.0027) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 17.68% (0.1584 => 0.1864, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.65% (0.1337 => 0.1573, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.64% (0.1032 => 0.1214, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 17.63% (1.1840 => 1.3927, std.dev.: 0.0094) MultiSource/Benchmarks/Olden/em3d/em3d: 17.58% (0.1695 => 0.1993, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: 17.41% (0.0626 => 0.0735, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/mst/mst: 17.37% (0.1163 => 0.1365) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.25% (0.4615 => 0.5411, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.02% (0.0793 => 0.0928, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 17.00% (0.3177 => 0.3717, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 16.98% (0.2603 => 0.3045, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 16.97% (0.4879 => 0.5707, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 16.79% (0.3109 => 0.3631, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.76% (0.8172 => 0.9542, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.53% (0.6450 => 0.7516, std.dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: 16.45% (22.1758 => 25.8235, std.dev.: 0.0085) MultiSource/Benchmarks/Ptrdist/ft/ft: 16.39% (0.1940 => 0.2258, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 16.25% (0.1151 => 0.1338, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.14% (0.0886 => 0.1029, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 16.03% (0.0842 => 0.0977, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 16.00% (0.1906 => 0.2211) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.00% (0.0675 => 0.0783, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.96% (0.3121 => 0.3619, std.dev.: 0.0031) MultiSource/Applications/lemon/lemon: 15.79% (1.0722 => 1.2415, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.73% (0.9765 => 1.1301, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/exptree: 15.72% (0.0814 => 0.0942, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 15.62% (2.0273 => 2.3439, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 15.53% (1.1642 => 1.3450, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 15.46% (0.1695 => 0.1957, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 15.30% (0.8921 => 1.0286, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.19% (0.2107 => 0.2427, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.13% (0.1117 => 0.1286, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 15.07% (0.7835 => 0.9016, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.05% (0.2758 => 0.3173, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 15.04% (0.2700 => 0.3106, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 15.03% (0.0672 => 0.0773, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.93% (0.1125 => 0.1293, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.86% (1.1861 => 1.3624, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 14.86% (1.4186 => 1.6294, std.dev.: 0.0066) MultiSource/Benchmarks/McCat/18-imp/imp: 14.81% (0.3423 => 0.3930, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.74% (0.5860 => 0.6724, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.60% (0.1062 => 0.1217, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.58% (0.0933 => 0.1069, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.55% (0.0770 => 0.0882, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.52% (0.1143 => 0.1309, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.49% (0.0759 => 0.0869, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.46% (0.1625 => 0.1860, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.45% (0.5981 => 0.6845, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: 14.42% (0.0929 => 0.1063, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 14.41% (3.8723 => 4.4302, std.dev.: 0.0064) MultiSource/Applications/lambda-0_1_3/lambda: 14.40% (0.7433 => 0.8503, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.36% (0.1330 => 0.1521, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 14.31% (0.4299 => 0.4914, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.28% (4.2646 => 4.8735, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.19% (0.2065 => 0.2358, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.09% (0.1029 => 0.1174, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.06% (0.3307 => 0.3772, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 13.99% (0.3387 => 0.3861, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.91% (0.0798 => 0.0909, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 13.48% (9.4845 => 10.7628, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.25% (0.5569 => 0.6307, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.25% (0.0770 => 0.0872, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 13.09% (0.1268 => 0.1434, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.02% (0.3441 => 0.3889, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 13.00% (0.3092 => 0.3494, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.65% (0.3826 => 0.4310, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 12.65% (0.0838 => 0.0944, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 12.23% (0.3180 => 0.3569, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.21% (0.1892 => 0.2123, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 12.07% (0.0953 => 0.1068, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 11.91% (0.4289 => 0.4800, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 11.82% (2.2969 => 2.5685, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 11.62% (0.4620 => 0.5157, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.48% (0.8101 => 0.9031, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.47% (14.3668 => 16.0146, std.dev.: 0.0166) SingleSource/Benchmarks/Misc-C++/bigfib: 11.46% (0.6456 => 0.7196, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.12% (4.9449 => 5.4950, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.02% (5.0018 => 5.5530, std.dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: 10.98% (17.1811 => 19.0678, std.dev.: 0.0107) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.88% (2.2022 => 2.4419, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.87% (0.3543 => 0.3928, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.83% (0.3427 => 0.3798, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/parameter-passing: 10.47% (0.3927 => 0.4338, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.32% (0.3865 => 0.4264, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.31% (0.4636 => 0.5114, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 10.27% (0.3828 => 0.4221, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.19% (0.3473 => 0.3827, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-4: 10.19% (0.3543 => 0.3904, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.10% (0.3694 => 0.4067, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.08% (0.3561 => 0.3920, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.04% (0.4203 => 0.4625, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.04% (0.3516 => 0.3869, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.04% (0.3497 => 0.3848, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 10.02% (0.3422 => 0.3765, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/property: 9.86% (0.3886 => 0.4269, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 9.83% (0.3684 => 0.4046, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 9.51% (0.4048 => 0.4433, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 9.46% (1.5603 => 1.7079, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.22% (0.2266 => 0.2475, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.19% (3.8922 => 4.2500, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.19% (0.4103 => 0.4480, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.14% (0.2430 => 0.2652, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 8.85% (0.3603 => 0.3922, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.70% (0.7326 => 0.7963, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 8.64% (0.6030 => 0.6551, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.49% (0.4064 => 0.4409, std.dev.: 0.0039) SingleSource/UnitTests/ObjC++/Hello: 8.46% (0.5925 => 0.6426, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 7.94% (0.3098 => 0.3344, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.78% (0.3650 => 0.3934, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/strcat: 7.59% (0.2831 => 0.3046, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.56% (0.2872 => 0.3089, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.55% (0.2793 => 0.3004, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 7.34% (0.3283 => 0.3524, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 7.31% (0.3282 => 0.3522, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.27% (0.3162 => 0.3392, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 7.27% (0.3232 => 0.3467, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.23% (0.2891 => 0.3100, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/fibo: 7.12% (0.2725 => 0.2919, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.10% (2.0665 => 2.2133, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.07% (0.8067 => 0.8637, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.06% (0.2905 => 0.3110, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 6.90% (0.2871 => 0.3069, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.86% (0.2756 => 0.2945, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 6.78% (0.2877 => 0.3072, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 6.66% (1.2842 => 1.3697, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/wc: 6.65% (0.3052 => 0.3255, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.45% (0.2714 => 0.2889, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 6.42% (0.2802 => 0.2982, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.07% (0.3379 => 0.3584, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: 5.76% (0.2049 => 0.2167, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.52% (0.3136 => 0.3309, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.27% (7.9617 => 8.3809, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/objinst: 4.92% (0.3131 => 0.3285, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.89% (0.3935 => 0.4088, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.76% (7.0540 => 7.2488, std.dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.12% (1.1145 => 1.3722, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.58% (0.2944 => 0.3285, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 11.17% (0.9957 => 1.1069, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/richards_benchmark: 9.92% (1.1396 => 1.2526, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.94% (2.8904 => 3.0910, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3682, std.dev.: 0.0055) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: 4.50% (3.3453 => 3.4959, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 2.98% (1.9405 => 1.9983, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.53% (4.2280 => 4.3351, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 2.34% (4.4649 => 4.5695, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/bisort/bisort: 1.84% (0.8333 => 0.8486, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 1.54% (3.1595 => 3.2081, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.44% (9.1159 => 9.2476, std.dev.: 0.0083) MultiSource/Benchmarks/nbench/nbench: 1.30% (11.6436 => 11.7953, std.dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -76.92% (0.8651 => 0.1997, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.03% (5.3855 => 2.4217, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -54.71% (5.3526 => 2.4244, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/richards_benchmark: -45.13% (0.1622 => 0.0890, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.39% (1.1194 => 0.6785, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.27% (5.2763 => 3.2041, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -23.67% (1.7609 => 1.3441, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -17.46% (2.9384 => 2.4255, std.dev.: 0.0022) SingleSource/UnitTests/Vector/constpool: -9.03% (54.1659 => 49.2736, std.dev.: 0.0102) MultiSource/Applications/JM/ldecod/ldecod: -8.24% (10.4361 => 9.5758, std.dev.: 0.0114) MultiSource/Benchmarks/PAQ8p/paq8p: -6.74% (10.3673 => 9.6683, std.dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -54.04% (8.0499 => 3.6996, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0133, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7652, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.61% (0.0506 => 0.0341) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.38% (0.3987 => 0.2696, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.50% (2.9695 => 2.3607, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -19.00% (1.2258 => 0.9929, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.77% (1.6925 => 1.4256, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -10.98% (9.5636 => 8.5139, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel-2: -10.96% (1.5373 => 1.3688, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: -10.86% (1.2373 => 1.1029, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.34% (19.9488 => 18.2860, std.dev.: 0.0138) MultiSource/Benchmarks/FreeBench/mason/mason: -7.68% (0.2161 => 0.1995, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.98% (1.8329 => 1.7050, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -5.46% (6.6465 => 6.2837, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.09% (1.6805 => 1.5950, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.85% (0.2497 => 0.2376) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.67% (1.5835 => 1.5096, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.94% (8.1563 => 7.8347, std.dev.: 0.0082) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.68% (3.2827 => 3.1618, std.dev.: 0.0184) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.50% (32.5116 => 31.3728, std.dev.: 0.0031) MultiSource/Benchmarks/sim/sim: -3.33% (5.0483 => 4.8804, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -2.97% (4.6441 => 4.5063, std.dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.89% (0.4808 => 0.4669, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.76% (4.5009 => 4.3768, std.dev.: 0.0014) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/multiplies: -1.97% (2.5528 => 2.5024, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -1.95% (10.2830 => 10.0827, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/flops: -1.69% (8.8334 => 8.6839, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -1.28% (85.0658 => 83.9731, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.17% (1.7254 => 1.7052, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.14% (6.2999 => 6.2283, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: -1.01% (1.1277 => 1.1163, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.21% (7.1582 => 7.8174, std.dev.: 0.0033) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: 10638.47% (0.0720 => 7.7317, std.dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 10:57:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 12:57:39 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121027175739.9D0222A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5302?compare_to=5299&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5302, Order: 166877, Start Time: 2012-10-27 16:33:36, End Time: 2012-10-27 17:57:37 To: 5299, Order: 166875, Start Time: 2012-10-27 14:51:55, End Time: 2012-10-27 16:16:49 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 3 (92 on baseline) Performance Improvements: 5 (7 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 967 (875 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.22% (0.8302 => 0.8403, std.dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 12.96% (21.2591 => 24.0147, std.dev.: 0.7392) SingleSource/Benchmarks/Misc/richards_benchmark: 1.79% (1.3055 => 1.3289, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/Burg/burg: -3.39% (1.3058 => 1.2615, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.78% (1.1950 => 1.1618, std.dev.: 0.0107) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.47% (4.6010 => 4.5334, std.dev.: 0.0219) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -1.30% (1.3003 => 1.2834, std.dev.: 0.0052) MultiSource/Applications/spiff/spiff: -1.20% (0.8483 => 0.8381, std.dev.: 0.0022) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.03% (16.7041 => 16.6990, std.dev.: 0.0221) MultiSource/Applications/obsequi/Obsequi: -0.39% (1.0689 => 1.0647, std.dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: -1.02% (0.6484 => 0.6418, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/08-main/main: -4.75% (0.1894 => 0.1804, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.80% (0.1682 => 0.1618, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.25% (0.3252 => 0.3260, std.dev.: 0.0094) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.27% (0.2514 => 0.2457, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.30% (0.3359 => 0.3369, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.25% (0.2447 => 0.2343, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/bigfib: -0.41% (0.6078 => 0.6053, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/mandel: -1.41% (0.0425 => 0.0419, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.03% (0.3359 => 0.3358, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/strcat: -0.40% (0.2022 => 0.2014, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -15.77% (0.0241 => 0.0203, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 53.52% (0.0142 => 0.0218, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.70% (0.0427 => 0.0424, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.16% (0.0332 => 0.0285, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.64% (0.0314 => 0.0312, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -11.35% (0.0423 => 0.0375, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/casts: -0.98% (0.0204 => 0.0202, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -38.71% (0.0217 => 0.0133, std.dev.: 0.0035) SingleSource/UnitTests/byval-alignment: -2.79% (0.0323 => 0.0314, std.dev.: 0.0022) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: - (0.1438 => 0.1438, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 1.04% (1.1015 => 1.1130, std.dev.: 0.0170) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.55% (0.1519 => 0.1465, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.33% (0.4045 => 0.3991, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.15% (0.1301 => 0.1316, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.94% (0.0612 => 0.0630, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -27.64% (0.0275 => 0.0199, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.43% (0.0591 => 0.0553, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.36% (1.1433 => 1.1474, std.dev.: 0.0283) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.77% (0.0031 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.61% (0.0654 => 0.0565, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.06% (0.0264 => 0.0182, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.50% (0.7973 => 0.8013, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 44.12% (0.0068 => 0.0098, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.87% (2.1832 => 1.6621, std.dev.: 0.0025) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 35.73% (14.7684 => 20.0445, std.dev.: 0.0578) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.91% (0.0810 => 0.0947, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.61% (0.0830 => 0.0943, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/rem: 12.27% (0.1035 => 0.1162, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/tsp/tsp: 11.51% (0.1112 => 0.1240, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.16% (0.8321 => 0.9000, std.dev.: 0.0159) MultiSource/Applications/SIBsim4/SIBsim4: 7.30% (1.2568 => 1.3486, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.70% (0.2180 => 0.2326, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.47% (0.1885 => 0.2007, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.86% (6.6074 => 6.9947, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.67% (13.1811 => 13.9285, std.dev.: 0.0596) MultiSource/Applications/spiff/spiff: 5.42% (0.7950 => 0.8381, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.29% (0.2741 => 0.2886, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.12% (0.2519 => 0.2648, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.04% (0.2998 => 0.3149, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.97% (1.6386 => 1.7201, std.dev.: 0.0051) MultiSource/Benchmarks/nbench/nbench: 4.94% (1.1271 => 1.1828, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.91% (0.4559 => 0.4783, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.49% (1.1606 => 1.2127, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.48% (0.4127 => 0.4312, std.dev.: 0.0019) MultiSource/Applications/treecc/treecc: 4.23% (1.9948 => 2.0791, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 4.22% (0.8697 => 0.9064, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.01% (1.1170 => 1.1618, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.92% (0.8086 => 0.8403, std.dev.: 0.0030) MultiSource/Applications/d/make_dparser: 3.74% (3.2366 => 3.3577, std.dev.: 0.0112) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.74% (0.3717 => 0.3856, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 3.73% (0.4397 => 0.4561, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.70% (0.5191 => 0.5383, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.60% (0.6227 => 0.6451, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.55% (0.9435 => 0.9770, std.dev.: 0.0114) MultiSource/Applications/SPASS/SPASS: 3.55% (14.2605 => 14.7661, std.dev.: 0.0335) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.29% (0.8317 => 0.8591, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.27% (0.8007 => 0.8269, std.dev.: 0.0075) MultiSource/Applications/minisat/minisat: 3.26% (0.6834 => 0.7057, std.dev.: 0.0073) MultiSource/Applications/lemon/lemon: 3.23% (1.0945 => 1.1298, std.dev.: 0.0079) MultiSource/Applications/Burg/burg: 3.22% (1.2222 => 1.2615, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.07% (0.5961 => 0.6144, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.06% (0.8597 => 0.8860, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.98% (0.8656 => 0.8914, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.89% (0.8066 => 0.8299, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.86% (0.7932 => 0.8159, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/football/football: 2.78% (0.8768 => 0.9012, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.78% (4.1763 => 4.2922, std.dev.: 0.0189) SingleSource/Benchmarks/Shootout-C++/hash2: 2.67% (0.4125 => 0.4235, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.66% (0.8457 => 0.8682, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.65% (0.8316 => 0.8536, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.61% (0.8927 => 0.9160, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.55% (0.8611 => 0.8831, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.55% (1.2526 => 1.2846, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.55% (0.8048 => 0.8253, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.54% (0.8338 => 0.8550, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.53% (8.6476 => 8.8666, std.dev.: 0.0433) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.51% (0.9074 => 0.9302, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.51% (4.4873 => 4.6000, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.51% (0.8050 => 0.8252, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.45% (0.8261 => 0.8463, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.43% (0.8177 => 0.8376, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.42% (0.8420 => 0.8624, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.42% (0.9688 => 0.9922, std.dev.: 0.0073) MultiSource/Applications/lua/lua: 2.38% (3.8189 => 3.9099, std.dev.: 0.0288) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.37% (1.4479 => 1.4822, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.34% (0.9069 => 0.9281, std.dev.: 0.0081) MultiSource/Applications/JM/lencod/lencod: 2.34% (15.3280 => 15.6860, std.dev.: 0.0311) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.32% (0.7966 => 0.8151, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.32% (0.8805 => 0.9009, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.23% (4.5702 => 4.6723, std.dev.: 0.0275) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.18% (0.8340 => 0.8522, std.dev.: 0.0057) MultiSource/Applications/JM/ldecod/ldecod: 2.13% (6.7320 => 6.8753, std.dev.: 0.0306) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.12% (0.8885 => 0.9073, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.04% (2.1401 => 2.1837, std.dev.: 0.0078) MultiSource/Applications/lambda-0_1_3/lambda: 2.01% (0.7557 => 0.7709, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/gs/gs: 1.97% (4.1305 => 4.2120, std.dev.: 0.0228) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.97% (3.1832 => 3.2459, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.91% (1.2423 => 1.2660, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.87% (0.6586 => 0.6709, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.84% (1.2602 => 1.2834, std.dev.: 0.0052) MultiSource/Applications/oggenc/oggenc: 1.81% (4.9628 => 5.0524, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.68% (1.5315 => 1.5572, std.dev.: 0.0024) MultiSource/Applications/siod/siod: 1.62% (2.2184 => 2.2543, std.dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 59.30% (1.5795 => 2.5161, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.36% (14.6451 => 16.3095, std.dev.: 0.5667) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.35% (2.4333 => 2.6607, std.dev.: 0.0288) MultiSource/Benchmarks/nbench/nbench: 9.33% (21.9654 => 24.0147, std.dev.: 0.7392) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.47% (1.1857 => 1.2861, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.00% (0.3186 => 0.3441, std.dev.: 0.0044) MultiSource/Benchmarks/mafft/pairlocalalign: 6.02% (63.1822 => 66.9867, std.dev.: 0.1029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.78% (44.5605 => 45.8011, std.dev.: 0.3893) MultiSource/Applications/siod/siod: 2.74% (3.6643 => 3.7648, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/ReedSolomon: 2.02% (8.5322 => 8.7049, std.dev.: 0.0503) SingleSource/Benchmarks/Misc/richards_benchmark: 1.93% (1.3037 => 1.3289, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: 1.70% (2.3560 => 2.3960, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.58% (4.8362 => 4.9128, std.dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -36.98% (0.0338 => 0.0213, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.21% (0.3269 => 0.2968, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/heapsort: -8.96% (3.2926 => 2.9976, std.dev.: 0.1111) MultiSource/Applications/lua/lua: -5.33% (29.8330 => 28.2415, std.dev.: 0.0423) SingleSource/Benchmarks/Shootout-C++/hash2: -1.46% (3.4237 => 3.3738, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.29% (1.2822 => 1.2656, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.24% (3.3479 => 3.3063, std.dev.: 0.0101) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 1.54% (16.4461 => 16.6990, std.dev.: 0.0221) MultiSource/Applications/obsequi/Obsequi: 3.75% (1.0262 => 1.0647, std.dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: 1.36% (0.6332 => 0.6418, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/08-main/main: -1.47% (0.1831 => 0.1804, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.78% (0.1559 => 0.1618, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.39% (0.3123 => 0.3260, std.dev.: 0.0094) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.24% (0.2463 => 0.2457, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.75% (0.3344 => 0.3369, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.89% (0.2364 => 0.2343, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/bigfib: 0.72% (0.6010 => 0.6053, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/mandel: -2.33% (0.0429 => 0.0419, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.82% (0.3266 => 0.3358, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/strcat: 2.29% (0.1969 => 0.2014, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -9.38% (0.0224 => 0.0203, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.92% (0.0408 => 0.0424, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 12.20% (0.0254 => 0.0285, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.34% (0.0384 => 0.0375, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -26.11% (0.0180 => 0.0133, std.dev.: 0.0035) SingleSource/UnitTests/byval-alignment: 36.52% (0.0230 => 0.0314, std.dev.: 0.0022) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: - (0.1438 => 0.1438, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -1.76% (1.1329 => 1.1130, std.dev.: 0.0170) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.21% (0.1462 => 0.1465, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.15% (0.4164 => 0.3991, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.87% (0.1369 => 0.1316, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.72% (0.0641 => 0.0630, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.05% (0.0195 => 0.0199, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.33% (0.0578 => 0.0553, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.32% (1.1437 => 1.1474, std.dev.: 0.0283) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.89% (0.0627 => 0.0565, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.11% (0.0180 => 0.0182, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.05% (0.8017 => 0.8013, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 58.06% (0.0062 => 0.0098, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 11:46:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 13:46:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121027184605.044F42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5303?compare_to=5300&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5303, Order: 166877, Start Time: 2012-10-27 17:20:44, End Time: 2012-10-27 18:46:01 To: 5300, Order: 166876, Start Time: 2012-10-27 15:32:27, End Time: 2012-10-27 16:57:43 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (6 on baseline) Performance Improvements: 0 (177 on baseline) Unchanged Tests: 1042 (859 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.13% (15.2527 => 18.3235, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1010, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/salsa20: 2.44% (7.4937 => 7.6767, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash2: 2.02% (3.1932 => 3.2577, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.05% (0.9531 => 0.9631, std.dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.78% (0.1584 => 0.1445, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.53% (0.1431 => 0.1309, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -7.42% (2.4924 => 2.3074, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.41% (0.3821 => 0.3538, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-2: -7.36% (0.3831 => 0.3549, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -7.32% (0.3880 => 0.3596, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.31% (0.3884 => 0.3600, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -7.30% (0.3848 => 0.3567, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -7.29% (0.3812 => 0.3534, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -7.29% (0.3896 => 0.3612, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.22% (0.3891 => 0.3610, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -7.19% (0.4033 => 0.3743, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -7.16% (0.4176 => 0.3877, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -6.91% (0.4199 => 0.3909, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: -6.85% (0.4280 => 0.3987, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.84% (0.2428 => 0.2262, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.73% (22.4056 => 20.8985, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.53% (0.3658 => 0.3419, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.49% (0.3142 => 0.2938, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.45% (5.4682 => 5.1154, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/oourafft: -6.39% (0.2160 => 0.2022, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.37% (4.5069 => 4.2197, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/08-main/main: -6.36% (0.2659 => 0.2490, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: -6.28% (0.1879 => 0.1761, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.27% (0.9852 => 0.9234, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -6.25% (2.4021 => 2.2520, std.dev.: 0.0073) MultiSource/Applications/JM/ldecod/ldecod: -6.20% (7.0961 => 6.6558, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.20% (3.5339 => 3.3147, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: -6.17% (4.3330 => 4.0656, std.dev.: 0.0101) MultiSource/Applications/sgefa/sgefa: -6.17% (0.3357 => 0.3150, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.11% (0.9542 => 0.8959, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.08% (0.6484 => 0.6090, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -6.08% (16.1920 => 15.2081, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.03% (4.8161 => 4.5258, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: -5.99% (1.2515 => 1.1765, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.99% (0.2355 => 0.2214, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.97% (0.4151 => 0.3903, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.97% (4.8802 => 4.5887, std.dev.: 0.0057) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.94% (0.1716 => 0.1614, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.92% (0.7919 => 0.7450, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.89% (0.3837 => 0.3611, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.86% (1.6474 => 1.5509, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.83% (0.4321 => 0.4069, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.83% (0.4083 => 0.3845, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -5.82% (0.3026 => 0.2850, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.81% (0.2548 => 0.2400, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.80% (2.1713 => 2.0453, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.79% (0.3849 => 0.3626, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -5.79% (1.3148 => 1.2387, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: -5.79% (0.3025 => 0.2850, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.78% (0.2871 => 0.2705, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.77% (1.0544 => 0.9936, std.dev.: 0.0035) MultiSource/Benchmarks/Bullet/bullet: -5.74% (34.0927 => 32.1352, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.72% (0.3057 => 0.2882, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: -5.72% (0.2989 => 0.2818, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.71% (0.7198 => 0.6787, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -5.70% (18.2933 => 17.2505, std.dev.: 0.0210) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.69% (0.3252 => 0.3067, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.68% (1.2784 => 1.2058, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: -5.66% (0.6750 => 0.6368, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -5.66% (0.4861 => 0.4586, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.65% (4.0323 => 3.8046, std.dev.: 0.0087) MultiSource/Benchmarks/Olden/bh/bh: -5.63% (0.2985 => 0.2817, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: -5.63% (0.3394 => 0.3203, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/wc: -5.62% (0.3205 => 0.3025, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.61% (0.2903 => 0.2740, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -5.61% (0.2939 => 0.2774, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: -5.60% (0.3194 => 0.3015, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -5.60% (0.3481 => 0.3286, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -5.60% (0.3446 => 0.3253, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.56% (1.2221 => 1.1541, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hello: -5.55% (0.2849 => 0.2691, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -5.54% (4.0594 => 3.8344, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.51% (1.2210 => 1.1537, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.50% (0.8521 => 0.8052, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -5.46% (0.7982 => 0.7546, std.dev.: 0.0024) SingleSource/Regression/C++/ofstream_ctor: -5.46% (0.3059 => 0.2892, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.45% (0.5999 => 0.5672, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -5.44% (0.3621 => 0.3424, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sieve: -5.41% (0.3788 => 0.3583, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.40% (0.3016 => 0.2853, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.38% (0.4813 => 0.4554, std.dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: -5.37% (9.2283 => 8.7328, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.36% (0.2278 => 0.2156, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.34% (2.2587 => 2.1380, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.34% (0.2999 => 0.2839, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -5.33% (0.3867 => 0.3661, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.32% (1.6364 => 1.5494, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.29% (0.4427 => 0.4193, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -5.28% (0.6347 => 0.6012, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -5.27% (0.7779 => 0.7369, std.dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference-object: -5.25% (0.6441 => 0.6103, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.21% (1.4642 => 1.3879, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.21% (1.3722 => 1.3007, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: -5.20% (0.4248 => 0.4027, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.18% (0.3491 => 0.3310, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.16% (0.6293 => 0.5968, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.09% (0.3323 => 0.3154, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.01% (0.5591 => 0.5311, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.00% (0.3319 => 0.3153, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.99% (0.6676 => 0.6343, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: -4.97% (0.4524 => 0.4299, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -4.97% (0.3581 => 0.3403, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -4.96% (0.4515 => 0.4291, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.96% (0.3931 => 0.3736, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.94% (0.2933 => 0.2788, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.91% (0.5478 => 0.5209, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.91% (0.6660 => 0.6333, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.89% (0.5805 => 0.5521, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.89% (0.2106 => 0.2003, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.87% (0.5857 => 0.5572, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.85% (0.6230 => 0.5928, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.85% (0.5859 => 0.5575, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.84% (0.6297 => 0.5992, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.83% (0.5802 => 0.5522, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.82% (0.6052 => 0.5760, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.82% (0.4916 => 0.4679, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.82% (0.6681 => 0.6359, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.82% (0.6395 => 0.6087, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.80% (0.5705 => 0.5431, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.80% (0.6667 => 0.6347, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.76% (0.5863 => 0.5584, std.dev.: 0.0085) MultiSource/Applications/lemon/lemon: -4.74% (1.1450 => 1.0907, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.74% (0.7339 => 0.6991, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.74% (0.9557 => 0.9104, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.73% (0.5456 => 0.5198, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.73% (0.5925 => 0.5645, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.72% (0.6440 => 0.6136, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.71% (0.6194 => 0.5902, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.70% (0.5569 => 0.5307, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.70% (0.5575 => 0.5313, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.70% (0.6304 => 0.6008, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.64% (0.6189 => 0.5902, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: -4.63% (0.7447 => 0.7102, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.63% (0.6260 => 0.5970, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.63% (0.5570 => 0.5312, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: -4.63% (0.9179 => 0.8754, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.63% (0.7524 => 0.7176, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.61% (0.2385 => 0.2275, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.61% (0.5688 => 0.5426, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.60% (0.5849 => 0.5580, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.60% (0.5567 => 0.5311, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.60% (0.6395 => 0.6101, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.60% (0.5941 => 0.5668, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.59% (0.6033 => 0.5756, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: -4.59% (0.3271 => 0.3121, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: -4.56% (0.8418 => 0.8034, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: -4.54% (15.5079 => 14.8046, std.dev.: 0.0064) MultiSource/Benchmarks/sim/sim: -4.52% (0.3406 => 0.3252, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -4.47% (2.1401 => 2.0444, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.47% (0.6446 => 0.6158, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.36% (0.3483 => 0.3331, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.35% (0.6736 => 0.6443, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.32% (6.7716 => 6.4789, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.32% (8.0126 => 7.6668, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.19% (0.7021 => 0.6727, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -4.18% (17.1032 => 16.3881, std.dev.: 0.0096) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.07% (0.9077 => 0.8708, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: -4.07% (1.2300 => 1.1800, std.dev.: 0.0041) MultiSource/Applications/oggenc/oggenc: -3.92% (5.0226 => 4.8256, std.dev.: 0.0163) MultiSource/Applications/d/make_dparser: -3.89% (3.5154 => 3.3786, std.dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: -3.82% (1.1530 => 1.1090, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.81% (0.5168 => 0.4971, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.75% (0.2695 => 0.2594, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.72% (0.5329 => 0.5131, std.dev.: 0.0000) SingleSource/UnitTests/Vector/constpool: -3.67% (20.7746 => 20.0127, std.dev.: 0.0231) MultiSource/Applications/hbd/hbd: -3.66% (1.5610 => 1.5039, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.48% (14.2083 => 13.7132, std.dev.: 0.0055) MultiSource/Applications/SIBsim4/SIBsim4: -2.11% (1.3864 => 1.3571, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7564, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: -8.65% (1.2842 => 1.1731, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -4.02% (2.2633 => 2.1723, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.56% (6.5735 => 6.4712, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0003) Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 12:13:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 14:13:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121027191335.A5C172A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5304?compare_to=5301&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5304, Order: 166878, Start Time: 2012-10-27 17:42:10, End Time: 2012-10-27 19:13:32 To: 5301, Order: 166876, Start Time: 2012-10-27 15:41:16, End Time: 2012-10-27 17:12:34 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (10 on baseline) New Passes: 0 (14 on baseline) Performance Regressions: 2 (189 on baseline) Performance Improvements: 0 (54 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 15 (5 on baseline) Unchanged Tests: 1025 (636 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.89% (54.4373 => 56.0120, std.dev.: 0.3398) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.13% (1.2952 => 1.3099, std.dev.: 0.0030) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -0.29% (2.0739 => 2.0678, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -0.31% (58.1554 => 57.9747, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0797 => 0.0797, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 0.01% (9.2317 => 9.2329, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.14% (7.8174 => 7.8062, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_shift: 0.19% (0.0517 => 0.0518, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/JM/lencod/lencod: -0.02% (7.7317 => 7.7299, std.dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: - (0.0001 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.24% (0.0648 => 0.0669, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: - (0.2989 => 0.2989, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_shift: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -64.10% (5.7591 => 2.0678, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -8.33% (63.2438 => 57.9747, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.81% (6.6874 => 0.0797, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.48% (8.1363 => 9.2329, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_shift: 37.04% (0.0378 => 0.0518, std.dev.: 0.0015) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -50.00% (0.0002 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -57.07% (0.6962 => 0.2989, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_shift: -50.00% (0.0002 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 211.49% (0.5229 => 1.6288, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 17.66% (14.9895 => 17.6362, std.dev.: 0.0071) MultiSource/Applications/kimwitu++/kc: 37.61% (14.1553 => 19.4798, std.dev.: 0.0275) MultiSource/Benchmarks/MallocBench/gs/gs: 13.58% (4.1105 => 4.6689, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 32.78% (1.1048 => 1.4669, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 69.52% (3.4629 => 5.8704, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_container: 68.68% (0.6222 => 1.0495, std.dev.: 0.0013) New Passes - Execution Time --------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 3836600.00% (0.0001 => 3.8367, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 11135400.00% (0.0001 => 11.1355, std.dev.: 0.0340) MultiSource/Applications/kimwitu++/kc: 50800.00% (0.0001 => 0.0509, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049700.00% (0.0001 => 10.0498, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5488600.00% (0.0001 => 5.4887, std.dev.: 0.0331) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 77.70% (0.0296 => 0.0526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 69.53% (0.0256 => 0.0434, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 60.15% (0.0271 => 0.0434, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 52.26% (0.0243 => 0.0370, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 43.92% (1.5859 => 2.2825, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.45% (0.0834 => 0.1188, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 40.62% (0.1056 => 0.1485, std.dev.: 0.0016) SingleSource/UnitTests/vla: 35.21% (0.0355 => 0.0480, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 35.02% (2.2024 => 2.9736, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: 33.83% (0.1463 => 0.1958, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 28.70% (0.1432 => 0.1843, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 27.85% (0.1655 => 0.2116, std.dev.: 0.0012) MultiSource/Benchmarks/llubenchmark/llu: 24.03% (0.0462 => 0.0573) SingleSource/Benchmarks/Shootout/hash: 22.27% (0.0485 => 0.0593, std.dev.: 0.0006) SingleSource/UnitTests/SignlessTypes/rem: 22.12% (0.1144 => 0.1397, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.46% (0.1566 => 0.1902, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.37% (0.5105 => 0.6196, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 20.71% (0.1555 => 0.1877, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.55% (0.0871 => 0.1050) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 19.42% (0.6675 => 0.7971, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 18.91% (1.3050 => 1.5518, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 18.89% (0.2271 => 0.2700, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 18.83% (3.3354 => 3.9635, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.71% (0.5020 => 0.5959, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 18.23% (0.7115 => 0.8412, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/almabench: 18.22% (0.0730 => 0.0863, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: 18.17% (0.2554 => 0.3018, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 18.13% (0.1175 => 0.1388, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 17.96% (0.0746 => 0.0880, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 17.80% (0.1236 => 0.1456, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.73% (0.1337 => 0.1574, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.70% (1.5415 => 1.8144, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.60% (0.8172 => 0.9610, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 17.55% (0.1584 => 0.1862, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.48% (0.1510 => 0.1774, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.44% (0.1032 => 0.1212, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.44% (0.0648 => 0.0761, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 17.43% (1.1840 => 1.3904, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/em3d/em3d: 17.35% (0.1695 => 0.1989, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.29% (0.4615 => 0.5413, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: 17.25% (0.0626 => 0.0734, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 17.11% (0.1163 => 0.1362, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.90% (0.0793 => 0.0927, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 16.79% (0.2603 => 0.3040, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 16.78% (0.3177 => 0.3710, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 16.75% (0.4879 => 0.5696, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.62% (0.6450 => 0.7522, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 16.60% (0.3109 => 0.3625, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ft/ft: 16.34% (0.1940 => 0.2257, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 16.33% (0.1151 => 0.1339, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 16.30% (22.1758 => 25.7897, std.dev.: 0.0193) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.25% (0.0886 => 0.1030, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.00% (0.0675 => 0.0783, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 15.90% (0.1906 => 0.2209, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.80% (0.3121 => 0.3614, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.68% (0.0842 => 0.0974, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 15.64% (1.0722 => 1.2399, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/exptree: 15.60% (0.0814 => 0.0941, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 15.46% (1.1642 => 1.3442, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.45% (0.9765 => 1.1274, std.dev.: 0.0038) MultiSource/Applications/treecc/treecc: 15.42% (2.0273 => 2.3399, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 15.40% (0.1695 => 0.1956, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 15.34% (0.7835 => 0.9037, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.13% (0.1117 => 0.1286, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.09% (0.2107 => 0.2425, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 15.05% (0.8921 => 1.0264, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 15.04% (0.2700 => 0.3106, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.97% (0.2758 => 0.3171, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 14.96% (0.3423 => 0.3935, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 14.88% (0.0672 => 0.0772, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.85% (1.1861 => 1.3622, std.dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.76% (0.1125 => 0.1291, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 14.70% (1.4186 => 1.6272, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.68% (0.0770 => 0.0883, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.60% (0.1062 => 0.1217, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.59% (0.5860 => 0.6715, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.46% (0.1625 => 0.1860, std.dev.: 0.0019) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.44% (0.1143 => 0.1308, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.36% (0.0933 => 0.1067, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.36% (0.5981 => 0.6840, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.36% (0.0759 => 0.0868, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.29% (0.1330 => 0.1520, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 14.27% (0.7433 => 0.8494, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.24% (0.2065 => 0.2359, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 14.20% (3.8723 => 4.4222, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.18% (4.2646 => 4.8695, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/05-eks/eks: 14.14% (0.4299 => 0.4907, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: 14.10% (0.0929 => 0.1060, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.00% (0.3307 => 0.3770, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.91% (0.0798 => 0.0909, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: 13.91% (0.3387 => 0.3858, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.80% (0.1029 => 0.1171, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 13.30% (9.4845 => 10.7459, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.25% (0.0770 => 0.0872, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.09% (0.5569 => 0.6298, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/health/health: 13.01% (0.1268 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.93% (0.3441 => 0.3886, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 12.77% (0.3092 => 0.3487, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.57% (0.3826 => 0.4307, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 12.41% (0.0838 => 0.0942) MultiSource/Benchmarks/McCat/09-vor/vor: 12.26% (0.3180 => 0.3570, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.21% (0.1892 => 0.2123, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 11.96% (0.0953 => 0.1067, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 11.75% (0.4289 => 0.4793, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 11.62% (2.2969 => 2.5639, std.dev.: 0.0169) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.49% (0.8101 => 0.9032, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 11.47% (0.4620 => 0.5150, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 11.25% (0.6456 => 0.7182, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.22% (14.3668 => 15.9792, std.dev.: 0.0113) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 10.95% (5.0018 => 5.5495, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 10.91% (4.9449 => 5.4844, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.84% (0.3543 => 0.3927, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 10.82% (17.1811 => 19.0396, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.71% (0.3427 => 0.3794, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.63% (0.1044 => 0.1155, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.60% (2.2022 => 2.4356, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.54% (0.3927 => 0.4341, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.19% (0.3828 => 0.4218, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.05% (0.3473 => 0.3822, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.02% (0.3543 => 0.3898) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.02% (0.4203 => 0.4624, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.98% (0.3516 => 0.3867, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.97% (0.3561 => 0.3916, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.97% (0.4636 => 0.5098, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/for-in: 9.94% (0.3694 => 0.4061, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.88% (0.3865 => 0.4247, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 9.88% (0.3886 => 0.4270, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 9.87% (0.3497 => 0.3842, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 9.82% (0.3422 => 0.3758, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/moments: 9.73% (0.4048 => 0.4442, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/lists1: 9.66% (0.3684 => 0.4040, std.dev.: 0.0052) MultiSource/Applications/hbd/hbd: 9.58% (1.5603 => 1.7098, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.08% (3.8922 => 4.2457, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.02% (0.4103 => 0.4473, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.89% (0.2430 => 0.2646, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sieve: 8.80% (0.3603 => 0.3920, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.78% (0.2266 => 0.2465, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.54% (0.7326 => 0.7952, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: 8.47% (0.6030 => 0.6541, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 8.39% (0.5925 => 0.6422, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.32% (0.4064 => 0.4402, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.27% (0.3650 => 0.3952, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/matrix: 7.55% (0.3098 => 0.3332, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.45% (0.2793 => 0.3001, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 7.25% (0.3283 => 0.3521, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.24% (0.2872 => 0.3080, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.24% (0.2831 => 0.3036, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.19% (0.2891 => 0.3099, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 7.13% (0.3282 => 0.3516, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.08% (0.3162 => 0.3386, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 7.02% (0.3232 => 0.3459, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.99% (0.8067 => 0.8631, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.93% (2.0665 => 2.2097, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 6.92% (0.2905 => 0.3106, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 6.92% (0.2877 => 0.3076, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.78% (0.3052 => 0.3259, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.72% (0.2871 => 0.3064, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 6.67% (1.2842 => 1.3698, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 6.61% (0.2725 => 0.2905, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hello: 6.41% (0.2714 => 0.2888, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 6.39% (0.2802 => 0.2981, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.01% (0.3379 => 0.3582, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: 5.56% (0.2049 => 0.2163, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.26% (0.3136 => 0.3301, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.12% (7.9617 => 8.3695, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/objinst: 5.08% (0.3131 => 0.3290, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.71% (0.3935 => 0.4081, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.66% (7.0540 => 7.2414, std.dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.11% (1.1145 => 1.3721, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 10.21% (0.9957 => 1.0974, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/richards_benchmark: 9.80% (1.1396 => 1.2513, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.96% (2.8904 => 3.0915, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 6.64% (3.1578 => 3.3675, std.dev.: 0.0005) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: 4.50% (3.3453 => 3.4960, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 2.97% (1.9405 => 1.9981, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.63% (4.2280 => 4.3393, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 2.41% (4.4649 => 4.5727, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bisort/bisort: 1.80% (0.8333 => 0.8483, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2077, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.31% (11.6436 => 11.7959, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 1.27% (9.1159 => 9.2319, std.dev.: 0.0138) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.16% (6.5088 => 6.5846, std.dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -76.96% (0.8651 => 0.1993, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.14% (5.3855 => 2.4161, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -54.86% (5.3526 => 2.4161, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -45.31% (0.1622 => 0.0887, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.50% (1.1194 => 0.6772, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.22% (5.2763 => 3.2069, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -23.81% (1.7609 => 1.3416, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -17.52% (2.9384 => 2.4237, std.dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -9.09% (54.1659 => 49.2396, std.dev.: 0.0262) MultiSource/Applications/JM/ldecod/ldecod: -8.49% (10.4361 => 9.5505, std.dev.: 0.0221) MultiSource/Benchmarks/PAQ8p/paq8p: -6.43% (10.3673 => 9.7004, std.dev.: 0.0099) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -54.03% (8.0499 => 3.7008, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0133, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.47% (1.1492 => 0.7646, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.61% (0.0506 => 0.0341) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.38% (0.3987 => 0.2696, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.52% (2.9695 => 2.3602, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -19.00% (1.2258 => 0.9929, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.06% (1.6925 => 1.4206, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -11.12% (1.5373 => 1.3664, std.dev.: 0.0051) MultiSource/Benchmarks/NPB-serial/is/is: -10.98% (9.5636 => 8.5134, std.dev.: 0.0087) SingleSource/Benchmarks/McGill/chomp: -10.76% (1.2373 => 1.1042, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.38% (19.9488 => 18.2778, std.dev.: 0.0272) MultiSource/Benchmarks/FreeBench/mason/mason: -7.73% (0.2161 => 0.1994, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.10% (1.8329 => 1.7027, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -5.46% (6.6465 => 6.2835, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.10% (1.6805 => 1.5948, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: -4.69% (1.5835 => 1.5092, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.01% (8.1563 => 7.8293, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Applications/siod/siod: -3.70% (3.2827 => 3.1612, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.54% (32.5116 => 31.3622, std.dev.: 0.0066) MultiSource/Benchmarks/sim/sim: -3.33% (5.0483 => 4.8804, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -2.88% (4.6441 => 4.5103, std.dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.83% (0.4808 => 0.4672, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.79% (4.5009 => 4.3753, std.dev.: 0.0017) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/multiplies: -2.00% (2.5528 => 2.5018, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -1.85% (10.2830 => 10.0926, std.dev.: 0.0132) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6810, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: -1.28% (85.0658 => 83.9788, std.dev.: 0.0130) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.13% (1.7254 => 1.7059, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2348, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8584, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -1.01% (1.1277 => 1.1163, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.05% (7.1582 => 7.8062, std.dev.: 0.0044) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: 10635.97% (0.0720 => 7.7299, std.dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.38% (0.2116 => 0.0669, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 1.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 12:38:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 14:38:46 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121027193846.5FE1F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5305?compare_to=5302&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5305, Order: 166880, Start Time: 2012-10-27 18:14:45, End Time: 2012-10-27 19:38:44 To: 5302, Order: 166877, Start Time: 2012-10-27 16:33:36, End Time: 2012-10-27 17:57:37 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 16 (113 on baseline) Performance Improvements: 4 (5 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 955 (856 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 28.78% (0.0417 => 0.0537, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 12.32% (0.2192 => 0.2462, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.10% (0.8128 => 0.8624, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.81% (0.6160 => 0.6518, std.dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.27% (0.3253 => 0.3392, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.73% (1.1877 => 1.2320, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.08% (0.5803 => 0.5982, std.dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.50% (0.4880 => 0.5002, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.95% (1.1618 => 1.1844, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.68% (0.9770 => 0.9934, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.54% (0.8792 => 0.8927, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.19% (4.5334 => 4.5873, std.dev.: 0.0174) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: 6.18% (0.6597 => 0.7005, std.dev.: 0.0134) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.78% (0.4033 => 0.4145, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.62% (2.8773 => 2.9528, std.dev.: 0.0215) SingleSource/Benchmarks/Misc/ffbench: 1.35% (1.4011 => 1.4200, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -9.62% (24.0147 => 21.7043, std.dev.: 0.3787) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.79% (45.8011 => 44.5254, std.dev.: 0.4855) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.61% (1.8895 => 1.8590, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.18% (4.5725 => 4.5187, std.dev.: 0.0190) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.11% (16.6990 => 16.7172, std.dev.: 0.1380) MultiSource/Applications/obsequi/Obsequi: 1.42% (1.0647 => 1.0798, std.dev.: 0.0074) MultiSource/Applications/sqlite3/sqlite3: 0.39% (0.6418 => 0.6443, std.dev.: 0.0092) MultiSource/Benchmarks/McCat/08-main/main: 4.99% (0.1804 => 0.1894, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.90% (0.1618 => 0.1665, std.dev.: 0.0048) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.12% (0.3260 => 0.3256, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.90% (0.2457 => 0.2479, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.29% (0.3369 => 0.3446, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.46% (0.2343 => 0.2424, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 0.20% (0.6053 => 0.6065, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/mandel: 6.21% (0.0419 => 0.0445, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.66% (0.3358 => 0.3380, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 0.15% (0.2014 => 0.2017, std.dev.: 0.0034) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 33.00% (0.0203 => 0.0270, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.46% (0.0218 => 0.0219, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.18% (0.0424 => 0.0429, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 16.84% (0.0285 => 0.0333, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.64% (0.0312 => 0.0314, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 12.00% (0.0375 => 0.0420, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 0.99% (0.0202 => 0.0204, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/test1: 31.58% (0.0133 => 0.0175, std.dev.: 0.0020) SingleSource/UnitTests/byval-alignment: 10.19% (0.0314 => 0.0346, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.76% (0.1438 => 0.1449, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 1.12% (1.1130 => 1.1255, std.dev.: 0.0715) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -1.84% (0.1465 => 0.1438, std.dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 6.97% (0.3991 => 0.4269, std.dev.: 0.0388) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.81% (0.1316 => 0.1353, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.33% (0.0630 => 0.0609, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 23.12% (0.0199 => 0.0245, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.18% (0.0553 => 0.0554, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.39% (1.1474 => 1.1429, std.dev.: 0.0231) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2000.00% (0.0001 => 0.0021, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 1500.00% (0.0001 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.85% (0.0565 => 0.0615, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.84% (0.0182 => 0.0209, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.80% (0.8013 => 0.7949, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -54.08% (0.0098 => 0.0045, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.80% (2.1832 => 1.6636, std.dev.: 0.0246) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 36.05% (14.7684 => 20.0930, std.dev.: 0.0903) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.86% (0.0810 => 0.0979, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.18% (0.0830 => 0.0956, std.dev.: 0.0010) SingleSource/UnitTests/SignlessTypes/rem: 13.53% (0.1035 => 0.1175, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 10.52% (0.1112 => 0.1229, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.28% (0.8321 => 0.9093, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.25% (0.1157 => 0.1264, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.45% (0.6010 => 0.6518, std.dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.13% (0.3137 => 0.3392, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.03% (0.2279 => 0.2462, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 7.80% (0.1577 => 0.1700, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 7.32% (1.2568 => 1.3488, std.dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.23% (0.1466 => 0.1572, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.16% (0.2180 => 0.2336, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.03% (0.1905 => 0.2039, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.26% (0.1885 => 0.2003, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.03% (1.1170 => 1.1844, std.dev.: 0.0063) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.84% (0.8148 => 0.8624, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.76% (13.1811 => 13.9402, std.dev.: 0.0933) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.60% (6.6074 => 6.9774, std.dev.: 0.0147) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.52% (0.2519 => 0.2658, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.43% (1.1685 => 1.2320, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.40% (0.2741 => 0.2889, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 5.32% (1.2222 => 1.2872, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.29% (0.9435 => 0.9934, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.19% (0.1983 => 0.2086, std.dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 5.09% (1.1271 => 1.1845, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.03% (1.6386 => 1.7211, std.dev.: 0.0028) MultiSource/Applications/spiff/spiff: 4.91% (0.7950 => 0.8340, std.dev.: 0.0044) MultiSource/Applications/treecc/treecc: 4.87% (1.9948 => 2.0920, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.58% (0.4783 => 0.5002, std.dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: 4.53% (0.2999 => 0.3135, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.52% (0.7473 => 0.7811, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.41% (0.4559 => 0.4760, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.37% (0.2998 => 0.3129, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.36% (0.4127 => 0.4307, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/05-eks/eks: 4.34% (0.4397 => 0.4588, std.dev.: 0.0047) MultiSource/Applications/hbd/hbd: 4.00% (1.4269 => 1.4840, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.93% (0.6287 => 0.6534, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.83% (0.5191 => 0.5390, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.82% (0.3717 => 0.3859, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 3.60% (0.6834 => 0.7080, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 3.57% (14.2605 => 14.7696, std.dev.: 0.0675) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.57% (0.6227 => 0.6449, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash: 3.47% (0.3800 => 0.3932, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists1: 3.40% (0.2969 => 0.3070, std.dev.: 0.0018) MultiSource/Applications/d/make_dparser: 3.36% (3.2366 => 3.3453, std.dev.: 0.0179) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.29% (1.4479 => 1.4956, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/moments: 3.29% (0.3645 => 0.3765, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.24% (1.1606 => 1.1982, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.24% (1.3279 => 1.3709, std.dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.17% (0.6586 => 0.6795, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.12% (0.8340 => 0.8600, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.09% (8.6476 => 8.9146, std.dev.: 0.0515) MultiSource/Benchmarks/Prolangs-C/football/football: 3.07% (0.8768 => 0.9037, std.dev.: 0.0031) MultiSource/Applications/lua/lua: 3.00% (3.8189 => 3.9335, std.dev.: 0.0196) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.91% (4.1763 => 4.2978, std.dev.: 0.0155) MultiSource/Applications/hexxagon/hexxagon: 2.86% (0.9810 => 1.0091, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.84% (0.5817 => 0.5982, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.83% (0.8597 => 0.8840, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 2.79% (4.1305 => 4.2458, std.dev.: 0.0257) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.79% (4.4873 => 4.6123, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.79% (0.8007 => 0.8230, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.76% (0.3657 => 0.3758, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.71% (0.8611 => 0.8844, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.67% (0.9069 => 0.9311, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.65% (0.8050 => 0.8263, std.dev.: 0.0044) MultiSource/Applications/JM/ldecod/ldecod: 2.65% (6.7320 => 6.9101, std.dev.: 0.0465) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.61% (0.9908 => 1.0167, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.60% (0.8457 => 0.8677, std.dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 2.57% (15.3280 => 15.7214, std.dev.: 0.1443) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.56% (0.8204 => 0.8414, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.56% (0.8331 => 0.8544, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.55% (0.8286 => 0.8497, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.50% (0.8855 => 0.9076, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.48% (0.8069 => 0.8269, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.46% (0.7932 => 0.8127, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.45% (0.8805 => 0.9021, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.45% (0.7966 => 0.8161, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.44% (0.8518 => 0.8726, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.42% (0.8716 => 0.8927, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.36% (0.9688 => 0.9917, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.35% (0.8086 => 0.8276, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.30% (0.9056 => 0.9264, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.29% (0.8177 => 0.8364, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.27% (0.8420 => 0.8611, std.dev.: 0.0066) MultiSource/Benchmarks/Bullet/bullet: 2.25% (31.8598 => 32.5755, std.dev.: 0.0951) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.21% (4.4880 => 4.5873, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.18% (0.8066 => 0.8242, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.10% (0.8338 => 0.8513, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.09% (0.8316 => 0.8490, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.09% (0.8048 => 0.8216, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.07% (0.8885 => 0.9069, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.06% (0.9039 => 0.9225, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.05% (3.1832 => 3.2486, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.99% (0.8927 => 0.9105, std.dev.: 0.0026) MultiSource/Applications/siod/siod: 1.98% (2.2184 => 2.2624, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.87% (2.1401 => 2.1801, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.67% (4.5702 => 4.6467, std.dev.: 0.0189) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.66% (0.8995 => 0.9144, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.64% (1.5315 => 1.5566, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.59% (1.2423 => 1.2620, std.dev.: 0.0067) MultiSource/Benchmarks/PAQ8p/paq8p: 1.57% (2.3764 => 2.4136, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 56.98% (1.5795 => 2.4795, std.dev.: 0.0157) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.94% (2.4333 => 2.6751, std.dev.: 0.0165) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.13% (0.3186 => 0.3477, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.68% (1.1857 => 1.2768, std.dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: 5.93% (63.1822 => 66.9269, std.dev.: 0.1149) MultiSource/Benchmarks/Olden/bisort/bisort: 5.56% (0.6636 => 0.7005, std.dev.: 0.0134) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.83% (0.4031 => 0.4145, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.62% (2.8773 => 2.9528, std.dev.: 0.0215) MultiSource/Applications/siod/siod: 2.50% (3.6643 => 3.7560, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/ReedSolomon: 1.80% (8.5322 => 8.6860, std.dev.: 0.0460) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -32.54% (0.0338 => 0.0228, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.94% (0.3269 => 0.3042, std.dev.: 0.0027) MultiSource/Applications/lua/lua: -5.37% (29.8330 => 28.2308, std.dev.: 0.2136) SingleSource/Benchmarks/Shootout-C++/hash2: -1.65% (3.4237 => 3.3671, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.38% (3.3479 => 3.3017, std.dev.: 0.0047) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 1.65% (16.4461 => 16.7172, std.dev.: 0.1380) MultiSource/Applications/obsequi/Obsequi: 5.22% (1.0262 => 1.0798, std.dev.: 0.0074) MultiSource/Applications/sqlite3/sqlite3: 1.75% (0.6332 => 0.6443, std.dev.: 0.0092) MultiSource/Benchmarks/McCat/08-main/main: 3.44% (0.1831 => 0.1894, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 6.80% (0.1559 => 0.1665, std.dev.: 0.0048) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.26% (0.3123 => 0.3256, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.65% (0.2463 => 0.2479, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.05% (0.3344 => 0.3446, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.54% (0.2364 => 0.2424, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 0.92% (0.6010 => 0.6065, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/mandel: 3.73% (0.0429 => 0.0445, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.49% (0.3266 => 0.3380, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 2.44% (0.1969 => 0.2017, std.dev.: 0.0034) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 20.54% (0.0224 => 0.0270, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.15% (0.0408 => 0.0429, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.38% (0.0384 => 0.0420, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/test1: -2.78% (0.0180 => 0.0175, std.dev.: 0.0020) SingleSource/UnitTests/byval-alignment: 50.43% (0.0230 => 0.0346, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.76% (0.1438 => 0.1449, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -0.65% (1.1329 => 1.1255, std.dev.: 0.0715) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -1.64% (0.1462 => 0.1438, std.dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.52% (0.4164 => 0.4269, std.dev.: 0.0388) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.17% (0.1369 => 0.1353, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -12.50% (0.0008 => 0.0007, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.99% (0.0641 => 0.0609, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 25.64% (0.0195 => 0.0245, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.15% (0.0578 => 0.0554, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.07% (1.1437 => 1.1429, std.dev.: 0.0231) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2000.00% (0.0001 => 0.0021, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 14.29% (0.0014 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.91% (0.0627 => 0.0615, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 16.11% (0.0180 => 0.0209, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.85% (0.8017 => 0.7949, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -27.42% (0.0062 => 0.0045, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 13:19:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 15:19:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121027201918.5A3502A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5306?compare_to=5298&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5306, Order: 166877, Start Time: 2012-10-27 17:03:10, End Time: 2012-10-27 20:19:15 To: 5298, Order: 166873, Start Time: 2012-10-27 12:59:09, End Time: 2012-10-27 16:14:57 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (170 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1040 (720 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 18.39% (100.1474 => 118.5649, std.dev.: 0.0645) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.62% (2.0808 => 2.1146, std.dev.: 0.0060) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.60% (0.0625 => 0.0885, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.36% (0.1063 => 0.1407, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.59% (0.1106 => 0.1389) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.46% (0.2969 => 0.3725, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 25.23% (1.5932 => 1.9952, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.09% (0.4253 => 0.5320, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.14% (0.0584 => 0.0725, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.11% (0.4139 => 0.5137, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 24.03% (0.0541 => 0.0671, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.53% (0.4994 => 0.6169, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.31% (0.5900 => 0.7275, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.95% (0.0475 => 0.0584, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.66% (0.5000 => 0.6133, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.41% (0.0714 => 0.0874, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.30% (0.0547 => 0.0669, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.74% (0.0897 => 0.1092, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.60% (0.1620 => 0.1970, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.25% (0.1021 => 0.1238, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 21.20% (0.0599 => 0.0726, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.05% (0.1107 => 0.1340, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 20.36% (0.0604 => 0.0727, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 20.15% (0.0948 => 0.1139, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.14% (0.3903 => 0.4689, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.06% (0.0633 => 0.0760, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.04% (0.1103 => 0.1324, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.03% (0.0584 => 0.0701, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.94% (0.0642 => 0.0770, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 19.91% (0.0698 => 0.0837, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.76% (0.1604 => 0.1921, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.74% (0.1003 => 0.1201, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/health/health: 19.61% (0.0821 => 0.0982, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 19.52% (0.1619 => 0.1935, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.50% (0.1549 => 0.1851, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.34% (0.0822 => 0.0981, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 18.48% (0.0947 => 0.1122, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.42% (0.2736 => 0.3240, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.33% (0.1462 => 0.1730, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.33% (0.3890 => 0.4603, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 18.07% (0.0808 => 0.0954, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 17.87% (0.4029 => 0.4749, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.80% (1.3152 => 1.5493, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.78% (0.2014 => 0.2372, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 17.74% (0.1505 => 0.1772, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 17.57% (0.1218 => 0.1432, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.37% (0.1088 => 0.1277, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 17.27% (0.5826 => 0.6832, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 17.08% (0.5889 => 0.6895, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.06% (0.2866 => 0.3355, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.86% (3.5627 => 4.1632, std.dev.: 0.0045) MultiSource/Applications/Burg/burg: 16.77% (0.5546 => 0.6476, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/gs/gs: 16.59% (1.8794 => 2.1912, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.51% (0.1968 => 0.2293, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.49% (0.2875 => 0.3349, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.29% (0.4658 => 0.5417, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.29% (1.6211 => 1.8852, std.dev.: 0.0017) MultiSource/Applications/hbd/hbd: 16.28% (0.9697 => 1.1276, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.12% (0.1160 => 0.1347, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 16.07% (0.2725 => 0.3163, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.00% (0.2738 => 0.3176, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.99% (0.3271 => 0.3794, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 15.83% (0.1421 => 0.1646, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 15.81% (0.2714 => 0.3143, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.75% (0.4361 => 0.5048, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 15.75% (0.3004 => 0.3477, std.dev.: 0.0048) MultiSource/Applications/d/make_dparser: 15.70% (1.0781 => 1.2474, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.68% (0.2729 => 0.3157, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.62% (0.3195 => 0.3694, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.60% (0.3930 => 0.4543, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.59% (2.0673 => 2.3895, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 15.54% (0.2780 => 0.3212, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.54% (0.5026 => 0.5807, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: 15.50% (0.1284 => 0.1483, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/random: 15.48% (0.2803 => 0.3237, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 15.45% (0.2750 => 0.3175, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 15.44% (0.3096 => 0.3574, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.40% (0.2792 => 0.3222, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 15.38% (0.7171 => 0.8274, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.34% (1.9694 => 2.2716, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/except: 15.30% (0.2811 => 0.3241, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 15.29% (4.2109 => 4.8549, std.dev.: 0.0071) MultiSource/Applications/hexxagon/hexxagon: 15.28% (0.9909 => 1.1423, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/methcall: 15.25% (0.2813 => 0.3242, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.21% (4.4195 => 5.0916, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/objinst: 15.20% (0.2823 => 0.3252, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.15% (0.2911 => 0.3352, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.13% (1.9966 => 2.2987, std.dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.07% (2.7292 => 3.1404, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 14.96% (0.2566 => 0.2950, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 14.72% (0.3267 => 0.3748, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.68% (0.1090 => 0.1250, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 14.67% (0.3258 => 0.3736, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.60% (0.3362 => 0.3853, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 14.56% (0.3317 => 0.3800, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 14.35% (0.4146 => 0.4741, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.31% (0.3124 => 0.3571, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.28% (0.3060 => 0.3497, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 14.28% (23.5202 => 26.8791, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/football/football: 14.22% (0.2075 => 0.2370, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 14.08% (0.3465 => 0.3953, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.04% (0.3845 => 0.4385, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 13.86% (0.3348 => 0.3812, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 13.83% (0.4251 => 0.4839, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 13.81% (0.3678 => 0.4186, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.80% (0.3282 => 0.3735, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 13.74% (0.3726 => 0.4238, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 13.73% (0.3446 => 0.3919, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 13.72% (1.4269 => 1.6226, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/for-in: 13.67% (0.3496 => 0.3974, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 13.66% (0.3477 => 0.3952, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.65% (0.3488 => 0.3964, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 13.61% (0.3460 => 0.3931, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 13.61% (0.3469 => 0.3941, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 13.57% (0.3442 => 0.3909, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.54% (0.3625 => 0.4116, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 13.51% (0.7875 => 0.8939, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.47% (0.3690 => 0.4187, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.26% (0.3981 => 0.4509, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 13.26% (0.3650 => 0.4134, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 13.20% (2.1653 => 2.4511, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/exceptions: 13.18% (0.3643 => 0.4123, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 13.09% (0.5012 => 0.5668, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 13.08% (0.3724 => 0.4211, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 13.05% (2.1013 => 2.3756, std.dev.: 0.0043) MultiSource/Applications/JM/lencod/lencod: 12.94% (4.6177 => 5.2151, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.55% (0.2040 => 0.2296, std.dev.: 0.0058) MultiSource/Applications/SPASS/SPASS: 11.87% (5.5417 => 6.1996, std.dev.: 0.0066) MultiSource/Applications/SIBsim4/SIBsim4: 11.78% (0.2691 => 0.3008, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.39% (0.6435 => 0.7168, std.dev.: 0.0061) MultiSource/Applications/lambda-0_1_3/lambda: 10.92% (0.3498 => 0.3880, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.92% (0.1383 => 0.1534, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.70% (0.1028 => 0.1138, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.67% (0.2737 => 0.3029, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 10.60% (0.6634 => 0.7337, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.54% (0.2068 => 0.2286, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 10.40% (0.3336 => 0.3683, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 10.05% (0.4847 => 0.5334, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.76% (0.3084 => 0.3385, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 9.54% (2.0346 => 2.2287, std.dev.: 0.0086) MultiSource/Applications/lemon/lemon: 9.20% (0.2391 => 0.2611, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.13% (0.2103 => 0.2295, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.95% (11.6398 => 12.6818, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.92% (4.6926 => 5.1110, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.87% (0.5361 => 0.5783, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.29% (0.5584 => 0.5991, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.22% (0.7426 => 0.7962, std.dev.: 0.0025) MultiSource/Applications/kimwitu++/kc: 6.34% (11.9555 => 12.7133, std.dev.: 0.0087) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.25% (0.3792 => 0.3953, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6535, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.22% (0.5917 => 0.6699, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 9.10% (0.2802 => 0.3057, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6105, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 4.96% (12.0509 => 12.6491, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1710, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-2: 4.03% (1.8057 => 1.8785, std.dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/dry: 2.70% (14.0481 => 14.4269, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/ary3: 2.10% (15.8721 => 16.2056, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.65% (3.1722 => 3.2245, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.57% (2.0820 => 2.1146, std.dev.: 0.0060) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3092, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2871, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.27% (1.0927 => 1.1066, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.26% (1.0142 => 1.0270, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5134, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.08% (50.0626 => 50.6013, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: 1.00% (1.5594 => 1.5750, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.59% (25.4195 => 16.3720, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/ary2: -8.33% (0.2402 => 0.2202, std.dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: -7.70% (28.1477 => 25.9800, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7754, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2420, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -3.24% (11.2080 => 10.8447, std.dev.: 0.0465) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7742, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.94% (0.6293 => 0.6108, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel-2: -2.87% (3.6262 => 3.5220, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -2.50% (17.2379 => 16.8062, std.dev.: 0.0249) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.19% (41.7953 => 40.8787, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5719, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4957, std.dev.: 0.0060) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.33% (5.7935 => 5.7163, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0424, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.07% (105.3826 => 104.2579, std.dev.: 0.0491) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.03% (3.3991 => 3.3640, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 13:34:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 15:34:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121027203412.9193F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5307?compare_to=5303&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5307, Order: 166880, Start Time: 2012-10-27 19:08:57, End Time: 2012-10-27 20:34:09 To: 5303, Order: 166877, Start Time: 2012-10-27 17:20:44, End Time: 2012-10-27 18:46:01 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (181 on baseline) Unchanged Tests: 1041 (856 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.47% (20.0127 => 20.3066, std.dev.: 0.0200) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 19.94% (15.2527 => 18.2940, std.dev.: 0.0133) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.37% (2.0478 => 2.1169, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/salsa20: 2.65% (7.4937 => 7.6923, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/hash2: 2.34% (3.1932 => 3.2680, std.dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.90% (0.1584 => 0.1443, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.60% (0.1431 => 0.1308, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -8.02% (0.3880 => 0.3569, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -7.99% (0.3831 => 0.3525, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.96% (0.3884 => 0.3575, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -7.95% (0.3848 => 0.3542, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -7.95% (0.3812 => 0.3509, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/synchronized: -7.85% (0.3896 => 0.3590, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.79% (0.3891 => 0.3588, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -7.78% (0.4176 => 0.3851, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -7.69% (0.4033 => 0.3723, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -7.67% (0.4199 => 0.3877, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.67% (0.3821 => 0.3528, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -7.50% (0.4280 => 0.3959, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -7.21% (2.4924 => 2.3127, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.00% (0.2428 => 0.2258, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.97% (0.3658 => 0.3403, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.75% (0.3142 => 0.2930, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.70% (22.4056 => 20.9043, std.dev.: 0.0102) MultiSource/Benchmarks/McCat/08-main/main: -6.62% (0.2659 => 0.2483, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.61% (4.5069 => 4.2092, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.46% (5.4682 => 5.1150, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.41% (0.2355 => 0.2204, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.40% (0.6484 => 0.6069, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: -6.37% (4.3330 => 4.0569, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.36% (0.4151 => 0.3887, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.35% (4.8161 => 4.5102, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/fibo: -6.34% (0.2871 => 0.2689, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -6.33% (0.1879 => 0.1760, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -6.33% (7.0961 => 6.6467, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.32% (0.9852 => 0.9229, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: -6.32% (1.2515 => 1.1724, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.32% (0.2548 => 0.2387, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -6.31% (0.3026 => 0.2835, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.31% (0.3837 => 0.3595, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.30% (0.3252 => 0.3047, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.29% (0.1716 => 0.1608, std.dev.: 0.0010) MultiSource/Applications/siod/siod: -6.24% (2.4021 => 2.2521, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.23% (0.2903 => 0.2722, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -6.23% (0.3357 => 0.3148, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.22% (2.1713 => 2.0363, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -6.21% (1.3148 => 1.2331, std.dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: -6.21% (16.1920 => 15.1872, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/oourafft: -6.20% (0.2160 => 0.2026, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.20% (0.7919 => 0.7428, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.20% (0.4083 => 0.3830, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -6.19% (0.2989 => 0.2804, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hello: -6.18% (0.2849 => 0.2673, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -6.16% (0.2939 => 0.2758, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.15% (0.3025 => 0.2839, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.11% (0.3849 => 0.3614, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.10% (0.9542 => 0.8960, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -6.09% (0.3446 => 0.3236, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.09% (4.8802 => 4.5829, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.08% (0.3057 => 0.2871, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -6.07% (0.3394 => 0.3188, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.06% (1.0544 => 0.9905, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.03% (3.5339 => 3.3207, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: -6.01% (0.3194 => 0.3002, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -5.99% (0.3621 => 0.3404, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: -5.99% (0.3255 => 0.3060, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -5.99% (0.3205 => 0.3013, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: -5.97% (0.4861 => 0.4571, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -5.96% (0.2985 => 0.2807, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.95% (1.2784 => 1.2023, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -5.95% (0.3481 => 0.3274, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: -5.92% (18.2933 => 17.2103, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.90% (0.7198 => 0.6773, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.88% (0.4321 => 0.4067, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.88% (1.6474 => 1.5506, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.87% (0.3016 => 0.2839, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -5.86% (34.0927 => 32.0937, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.84% (4.0323 => 3.7969, std.dev.: 0.0028) SingleSource/Regression/C++/ofstream_ctor: -5.82% (0.3059 => 0.2881, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.79% (1.2221 => 1.1513, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: -5.79% (0.6750 => 0.6359, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.77% (0.2999 => 0.2826, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.77% (1.2210 => 1.1506, std.dev.: 0.0014) MultiSource/Applications/lua/lua: -5.76% (4.0594 => 3.8254, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.76% (0.8521 => 0.8030, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sieve: -5.73% (0.3788 => 0.3571, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -5.69% (0.7779 => 0.7336, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.69% (0.4813 => 0.4539, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -5.68% (0.7982 => 0.7529, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: -5.66% (0.6347 => 0.5988, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists1: -5.64% (0.3867 => 0.3649, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.63% (0.5999 => 0.5661, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.63% (0.3323 => 0.3136, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.62% (0.2278 => 0.2150, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.58% (0.4427 => 0.4180, std.dev.: 0.0038) SingleSource/UnitTests/ObjC++/property-reference-object: -5.57% (0.6441 => 0.6082, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.56% (0.3491 => 0.3297, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.55% (0.3931 => 0.3713, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.54% (1.4642 => 1.3831, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.50% (0.6293 => 0.5947, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.49% (1.6364 => 1.5465, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -5.48% (0.4248 => 0.4015, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.42% (0.2933 => 0.2774, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -5.35% (9.2283 => 8.7346, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.33% (1.3722 => 1.2990, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/18-imp/imp: -5.28% (0.3581 => 0.3392, std.dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.27% (0.3319 => 0.3144, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.25% (2.2587 => 2.1401, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.25% (0.4916 => 0.4658, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: -5.24% (0.4524 => 0.4287, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.14% (0.2277 => 0.2160, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.13% (0.2106 => 0.1998, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: -5.07% (0.4515 => 0.4286, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: -5.01% (0.3271 => 0.3107, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.00% (0.6676 => 0.6342, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.00% (0.2001 => 0.1901, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.96% (0.9557 => 0.9083, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.95% (0.5591 => 0.5314, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.95% (0.2385 => 0.2267, std.dev.: 0.0019) MultiSource/Applications/spiff/spiff: -4.94% (0.8418 => 0.8002, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.93% (0.5478 => 0.5208, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.93% (0.6230 => 0.5923, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.93% (0.5805 => 0.5519, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.89% (0.6660 => 0.6334, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.88% (0.5859 => 0.5573, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.88% (0.6681 => 0.6355, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.83% (0.5857 => 0.5574, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.79% (0.6052 => 0.5762, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.79% (0.5575 => 0.5308, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.78% (0.6667 => 0.6348, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -4.77% (1.1450 => 1.0904, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.77% (0.5581 => 0.5315, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.77% (0.5456 => 0.5196, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.76% (0.6297 => 0.5997, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.76% (0.5863 => 0.5584, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -4.76% (0.3406 => 0.3244, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: -4.75% (0.9179 => 0.8743, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.74% (0.7339 => 0.6991, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.74% (0.5569 => 0.5305, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: -4.73% (15.5079 => 14.7743, std.dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.71% (8.0126 => 7.6352, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.71% (0.5802 => 0.5529, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.70% (0.9077 => 0.8650, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.68% (0.5705 => 0.5438, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.68% (0.6304 => 0.6009, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.66% (0.6395 => 0.6097, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.65% (0.5570 => 0.5311, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -4.65% (2.1401 => 2.0406, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.64% (0.6440 => 0.6141, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -4.63% (0.7447 => 0.7102, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.63% (0.6260 => 0.5970, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.63% (0.5941 => 0.5666, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.62% (0.5925 => 0.5651, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.61% (0.6395 => 0.6100, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.61% (0.5688 => 0.5426, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.60% (0.6189 => 0.5904, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.60% (0.6736 => 0.6426, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.60% (0.5567 => 0.5311, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.59% (6.7716 => 6.4609, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.58% (0.5849 => 0.5581, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.55% (0.6194 => 0.5912, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.55% (0.7524 => 0.7182, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.49% (0.6033 => 0.5762, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.48% (0.3483 => 0.3327, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.41% (0.6446 => 0.6162, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -4.23% (17.1032 => 16.3790, std.dev.: 0.0182) MultiSource/Benchmarks/Ptrdist/bc/bc: -4.21% (1.2300 => 1.1782, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.19% (0.7021 => 0.6727, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -4.09% (3.5154 => 3.3716, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: -4.03% (1.5610 => 1.4981, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.01% (0.5168 => 0.4961, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: -3.99% (5.0226 => 4.8220, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.97% (0.2695 => 0.2588, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.77% (0.5329 => 0.5128, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.65% (14.2083 => 13.6890, std.dev.: 0.0175) MultiSource/Benchmarks/nbench/nbench: -3.61% (1.1530 => 1.1114, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -2.25% (20.7746 => 20.3066, std.dev.: 0.0200) MultiSource/Applications/SIBsim4/SIBsim4: -2.08% (1.3864 => 1.3575, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7537, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: -8.64% (1.2842 => 1.1732, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.91% (1.7753 => 1.7058, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fbench: -3.89% (2.2633 => 2.1753, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.07% (1.3096 => 1.2694, std.dev.: 0.0128) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.52% (6.5735 => 6.4735, std.dev.: 0.0017) Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 14:14:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 16:14:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121027211422.41EF72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5308?compare_to=5304&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5308, Order: 166880, Start Time: 2012-10-27 19:43:07, End Time: 2012-10-27 21:14:19 To: 5304, Order: 166878, Start Time: 2012-10-27 17:42:10, End Time: 2012-10-27 19:13:32 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (10 on baseline) New Passes: 0 (14 on baseline) Performance Regressions: 0 (188 on baseline) Performance Improvements: 1 (55 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 15 (5 on baseline) Unchanged Tests: 1026 (636 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.01% (9.7004 => 9.6027, std.dev.: 0.0158) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: 0.59% (2.0678 => 2.0801, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 0.18% (57.9747 => 58.0792, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.13% (0.0797 => 0.0798, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 0.07% (9.2329 => 9.2390, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.36% (7.8062 => 7.8346, std.dev.: 0.0035) SingleSource/UnitTests/Vector/SSE/sse_shift: -0.58% (0.0518 => 0.0515, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/JM/lencod/lencod: -0.06% (7.7299 => 7.7250, std.dev.: 0.0103) MultiSource/Applications/oggenc/oggenc: - (0.0001 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.14% (0.0669 => 0.0648, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.13% (0.2989 => 0.2993, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_shift: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -63.88% (5.7591 => 2.0801, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -8.17% (63.2438 => 58.0792, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.81% (6.6874 => 0.0798, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.55% (8.1363 => 9.2390, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_shift: 36.24% (0.0378 => 0.0515, std.dev.: 0.0009) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -50.00% (0.0002 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -57.01% (0.6962 => 0.2993, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_shift: -50.00% (0.0002 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 212.60% (0.5229 => 1.6346, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 17.99% (14.9895 => 17.6857, std.dev.: 0.0030) MultiSource/Applications/kimwitu++/kc: 37.85% (14.1553 => 19.5126, std.dev.: 0.0092) MultiSource/Benchmarks/MallocBench/gs/gs: 13.77% (4.1105 => 4.6766, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 33.02% (1.1048 => 1.4696, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 69.77% (3.4629 => 5.8790, std.dev.: 0.0132) SingleSource/Benchmarks/Misc-C++/stepanov_container: 69.03% (0.6222 => 1.0517, std.dev.: 0.0013) New Passes - Execution Time --------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 3836300.00% (0.0001 => 3.8364, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 11144600.00% (0.0001 => 11.1447, std.dev.: 0.0142) MultiSource/Applications/kimwitu++/kc: 50800.00% (0.0001 => 0.0509, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049800.00% (0.0001 => 10.0499, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5493600.00% (0.0001 => 5.4937, std.dev.: 0.0006) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 77.70% (0.0296 => 0.0526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 69.53% (0.0256 => 0.0434, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 60.52% (0.0271 => 0.0435, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 52.67% (0.0243 => 0.0371) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 44.17% (1.5859 => 2.2864, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.57% (0.0834 => 0.1189, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/distray/distray: 40.81% (0.1056 => 0.1487, std.dev.: 0.0001) SingleSource/UnitTests/vla: 35.77% (0.0355 => 0.0482, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 35.34% (2.2024 => 2.9807, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/neural/neural: 34.11% (0.1463 => 0.1962, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 29.12% (0.1432 => 0.1849, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 28.28% (0.1655 => 0.2123, std.dev.: 0.0008) MultiSource/Benchmarks/llubenchmark/llu: 24.24% (0.0462 => 0.0574) SingleSource/UnitTests/SignlessTypes/rem: 22.38% (0.1144 => 0.1400) SingleSource/Benchmarks/Shootout/hash: 22.27% (0.0485 => 0.0593, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.71% (0.1566 => 0.1906, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.51% (0.5105 => 0.6203, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 20.90% (0.1555 => 0.1880, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.90% (0.0871 => 0.1053, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 19.57% (0.6675 => 0.7981, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.29% (0.2271 => 0.2709, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 19.16% (1.3050 => 1.5551, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 19.15% (3.3354 => 3.9741, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/functionobjects: 19.10% (0.5020 => 0.5979, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 18.63% (0.0746 => 0.0885, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 18.57% (0.7115 => 0.8436, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/almabench: 18.49% (0.0730 => 0.0865, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 18.48% (0.2554 => 0.3026, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/tsp/tsp: 18.38% (0.1175 => 0.1391, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 18.12% (0.1236 => 0.1460, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 18.03% (0.1337 => 0.1578, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 17.80% (0.1584 => 0.1866, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.75% (0.1510 => 0.1778, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.73% (0.1032 => 0.1215, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: 17.73% (0.0626 => 0.0737, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 17.65% (1.1840 => 1.3930, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/em3d/em3d: 17.64% (0.1695 => 0.1994, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.56% (1.5415 => 1.8122, std.dev.: 0.0187) MultiSource/Benchmarks/Olden/mst/mst: 17.37% (0.1163 => 0.1365, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.33% (0.4615 => 0.5415, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.28% (0.0793 => 0.0930, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 17.12% (0.3177 => 0.3721, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 16.99% (0.4879 => 0.5708, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 16.95% (0.3109 => 0.3636, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.81% (0.6450 => 0.7534, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 16.79% (0.2603 => 0.3040, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.69% (0.8172 => 0.9536, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.48% (0.0886 => 0.1032, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 16.45% (22.1758 => 25.8244, std.dev.: 0.0102) MultiSource/Benchmarks/Ptrdist/ft/ft: 16.44% (0.1940 => 0.2259, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 16.42% (0.1151 => 0.1340, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.31% (0.3121 => 0.3630, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.15% (0.0675 => 0.0784, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 16.11% (0.1906 => 0.2213, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/exptree: 15.85% (0.0814 => 0.0943, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 15.78% (1.0722 => 1.2414, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.68% (0.0842 => 0.0974, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.64% (0.9765 => 1.1292, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 15.61% (2.0273 => 2.3437, std.dev.: 0.0017) MultiSource/Applications/Burg/burg: 15.59% (1.1642 => 1.3457, std.dev.: 0.0032) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 15.47% (0.1125 => 0.1299, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 15.46% (0.8921 => 1.0300, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 15.46% (0.1695 => 0.1957, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.31% (0.1117 => 0.1288, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.26% (0.2758 => 0.3179, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 15.24% (0.7835 => 0.9029, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.23% (0.2107 => 0.2428, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: 15.22% (0.2700 => 0.3111, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 15.03% (0.0672 => 0.0773, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.94% (1.1861 => 1.3633, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 14.89% (1.4186 => 1.6298, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.85% (0.5860 => 0.6730, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/18-imp/imp: 14.84% (0.3423 => 0.3931, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.76% (0.0759 => 0.0871, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.68% (0.0933 => 0.1070, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.68% (0.0770 => 0.0883, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.60% (0.1062 => 0.1217, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.58% (0.1625 => 0.1862, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.56% (0.5981 => 0.6852, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 14.47% (0.4299 => 0.4921, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.44% (0.1330 => 0.1522, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.35% (4.2646 => 4.8767, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.33% (0.2065 => 0.2361, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/lpbench: 14.32% (0.0929 => 0.1062, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 14.29% (0.7433 => 0.8495, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.29% (0.1029 => 0.1176, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 14.21% (3.8723 => 4.4225, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.15% (0.3307 => 0.3775, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 14.05% (0.3387 => 0.3863, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.04% (0.0798 => 0.0910, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 13.64% (9.4845 => 10.7781, std.dev.: 0.0024) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.39% (0.1143 => 0.1296, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.38% (0.0770 => 0.0873, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.36% (0.5569 => 0.6313, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/health/health: 13.33% (0.1268 => 0.1437, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.14% (0.3441 => 0.3893, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.89% (0.3826 => 0.4319, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 12.71% (0.3092 => 0.3485, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 12.65% (0.0838 => 0.0944, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 12.30% (0.3180 => 0.3571, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.26% (0.1892 => 0.2124, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 11.96% (0.0953 => 0.1067, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 11.96% (0.4289 => 0.4802, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 11.73% (2.2969 => 2.5664, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 11.65% (0.4620 => 0.5158, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.57% (0.8101 => 0.9038, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 11.51% (0.6456 => 0.7199, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.47% (14.3668 => 16.0150, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.15% (4.9449 => 5.4962, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.14% (5.0018 => 5.5588, std.dev.: 0.0074) MultiSource/Applications/sqlite3/sqlite3: 11.01% (17.1811 => 19.0732, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.73% (0.1044 => 0.1156, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.62% (0.3427 => 0.3791, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.58% (2.2022 => 2.4353, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.37% (0.4203 => 0.4639, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.35% (0.3865 => 0.4265, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.33% (0.4636 => 0.5115, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 10.31% (0.3927 => 0.4332, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 10.23% (0.3422 => 0.3772, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.14% (0.3828 => 0.4216, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.11% (0.3473 => 0.3824, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 10.07% (0.3684 => 0.4055, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.05% (0.3543 => 0.3899, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.03% (0.3561 => 0.3918, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.02% (0.3543 => 0.3898, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: 9.93% (0.3516 => 0.3865, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 9.89% (0.3497 => 0.3843, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.88% (0.3694 => 0.4059, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 9.86% (1.5603 => 1.7142, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/property: 9.70% (0.3886 => 0.4263, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 9.66% (0.4048 => 0.4439, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.46% (0.4103 => 0.4491, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.38% (3.8922 => 4.2572, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.36% (0.2266 => 0.2478, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 9.08% (0.3603 => 0.3930, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.01% (0.2430 => 0.2649) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.66% (0.4064 => 0.4416, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.65% (0.7326 => 0.7960, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 8.54% (0.5925 => 0.6431, std.dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference-object: 8.42% (0.6030 => 0.6538, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.95% (0.3650 => 0.3940, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 7.92% (0.3282 => 0.3542, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.91% (0.2793 => 0.3014, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 7.91% (0.3098 => 0.3343, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.69% (0.2872 => 0.3093, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 7.63% (0.2831 => 0.3047, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.53% (0.3162 => 0.3400, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary3: 7.52% (0.3283 => 0.3530, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.46% (0.3232 => 0.3473, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.37% (0.2891 => 0.3104, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 7.26% (0.2905 => 0.3116, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.18% (2.0665 => 2.2149, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.11% (0.2871 => 0.3075, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.07% (0.8067 => 0.8637, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.04% (0.2756 => 0.2950, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: 6.99% (0.2877 => 0.3078, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.91% (0.3052 => 0.3263, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 6.88% (1.2842 => 1.3725, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: 6.83% (0.2725 => 0.2911, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 6.75% (0.2802 => 0.2991, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.67% (0.2714 => 0.2895, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 6.30% (0.3379 => 0.3592, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: 5.95% (0.2049 => 0.2171, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.58% (0.3136 => 0.3311, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.43% (7.9617 => 8.3940, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (0.3131 => 0.3292, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.04% (0.3935 => 0.4094, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.74% (7.0540 => 7.2472, std.dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.10% (1.1145 => 1.3720, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 10.70% (0.9957 => 1.1022, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/richards_benchmark: 9.85% (1.1396 => 1.2518, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.95% (2.8904 => 3.0913, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (3.1578 => 3.3671, std.dev.: 0.0007) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: 4.50% (3.3453 => 3.4960, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 2.99% (1.9405 => 1.9985, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.79% (4.2280 => 4.3458, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.52% (1.0313 => 1.0573, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 2.48% (4.4649 => 4.5755, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/bisort/bisort: 1.96% (0.8333 => 0.8496, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2078, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.48% (9.1159 => 9.2504, std.dev.: 0.0148) MultiSource/Benchmarks/nbench/nbench: 1.30% (11.6436 => 11.7955, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -76.94% (0.8651 => 0.1995, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.14% (5.3855 => 2.4162, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -54.82% (5.3526 => 2.4185, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -45.01% (0.1622 => 0.0892) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.38% (1.1194 => 0.6786, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.15% (5.2763 => 3.2105, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -23.41% (1.7609 => 1.3487, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -17.43% (2.9384 => 2.4261, std.dev.: 0.0056) SingleSource/UnitTests/Vector/constpool: -9.20% (54.1659 => 49.1816, std.dev.: 0.0532) MultiSource/Applications/JM/ldecod/ldecod: -8.18% (10.4361 => 9.5829, std.dev.: 0.0184) MultiSource/Benchmarks/PAQ8p/paq8p: -7.38% (10.3673 => 9.6027, std.dev.: 0.0158) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -54.04% (8.0499 => 3.6998, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0134) SingleSource/Benchmarks/Misc/mandel: -33.44% (1.1492 => 0.7649, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.61% (0.0506 => 0.0341) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.36% (0.3987 => 0.2697) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.51% (2.9695 => 2.3605, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.99% (1.2258 => 0.9930) SingleSource/Benchmarks/Misc/flops-6: -15.74% (1.6925 => 1.4261, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -10.99% (9.5636 => 8.5122, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -10.93% (1.5373 => 1.3692, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/chomp: -10.72% (1.2373 => 1.1047, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.40% (19.9488 => 18.2736, std.dev.: 0.0413) MultiSource/Benchmarks/FreeBench/mason/mason: -8.01% (0.2161 => 0.1988, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.00% (1.8329 => 1.7046, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -5.46% (6.6465 => 6.2838, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.08% (1.6805 => 1.5952, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.89% (0.2497 => 0.2375, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.84% (1.5835 => 1.5068, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.88% (8.1563 => 7.8399, std.dev.: 0.0019) MultiSource/Applications/siod/siod: -3.73% (3.2827 => 3.1602, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.49% (32.5116 => 31.3780, std.dev.: 0.0039) MultiSource/Benchmarks/sim/sim: -3.33% (5.0483 => 4.8803, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: -2.93% (4.6441 => 4.5082, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.87% (4.5009 => 4.3715, std.dev.: 0.0027) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.58% (0.4808 => 0.4684, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/multiplies: -2.06% (2.5528 => 2.5002, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -1.86% (10.2830 => 10.0915, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6817, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/lists: -1.37% (6.2999 => 6.2137, std.dev.: 0.0103) MultiSource/Benchmarks/PAQ8p/paq8p: -1.29% (85.0658 => 83.9712, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7056, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8566, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -1.01% (1.1277 => 1.1163, std.dev.: 0.0008) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.45% (7.1582 => 7.8346, std.dev.: 0.0035) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: 10629.17% (0.0720 => 7.7250, std.dev.: 0.0103) MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 14:33:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 16:33:16 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121027213316.294CF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5309?compare_to=5305&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5309, Order: 166891, Start Time: 2012-10-27 20:09:17, End Time: 2012-10-27 21:33:14 To: 5305, Order: 166880, Start Time: 2012-10-27 18:14:45, End Time: 2012-10-27 19:38:44 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 7 (103 on baseline) Performance Improvements: 8 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 960 (867 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.32% (1.5566 => 1.5771, std.dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.34% (6.9213 => 7.0835, std.dev.: 0.0481) MultiSource/Benchmarks/Olden/bh/bh: 1.41% (2.3685 => 2.4019, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.33% (4.8548 => 4.9196, std.dev.: 0.0153) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.19% (4.5187 => 4.5723, std.dev.: 0.0121) SingleSource/Benchmarks/Misc/pi: 1.15% (2.4795 => 2.5079, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/ReedSolomon: 1.12% (8.6860 => 8.7832, std.dev.: 0.0209) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/viterbi/viterbi: -7.06% (0.1700 => 0.1580, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -4.06% (0.9934 => 0.9531, std.dev.: 0.0154) MultiSource/Benchmarks/McCat/09-vor/vor: -3.12% (0.3332 => 0.3228, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/05-eks/eks: -2.92% (0.4588 => 0.4454, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.90% (0.6518 => 0.6329, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.22% (1.2320 => 1.2046, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.57% (0.9093 => 0.8950, std.dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -4.07% (0.7005 => 0.6720, std.dev.: 0.0011) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.03% (16.7172 => 16.7220, std.dev.: 0.0500) MultiSource/Applications/obsequi/Obsequi: -0.81% (1.0798 => 1.0711, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: 1.15% (0.6443 => 0.6517, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/08-main/main: 0.26% (0.1894 => 0.1899, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.58% (0.1665 => 0.1622, std.dev.: 0.0056) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.83% (0.3256 => 0.3164, std.dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.37% (0.2479 => 0.2513, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.79% (0.3446 => 0.3350, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.20% (0.2424 => 0.2453, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -0.08% (0.6065 => 0.6060, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel: -2.25% (0.0445 => 0.0435, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.59% (0.3380 => 0.3360, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/strcat: 0.35% (0.2017 => 0.2024, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -25.19% (0.0270 => 0.0202, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0219 => 0.0219, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -16.55% (0.0429 => 0.0358, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -8.71% (0.0333 => 0.0304, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0314 => 0.0314, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.71% (0.0420 => 0.0423, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/casts: -7.35% (0.0204 => 0.0189, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/test1: -12.57% (0.0175 => 0.0153, std.dev.: 0.0031) SingleSource/UnitTests/byval-alignment: -5.49% (0.0346 => 0.0327, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -0.90% (0.1449 => 0.1436, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.38% (1.1255 => 1.1410, std.dev.: 0.0098) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 1.88% (0.1438 => 0.1465, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.29% (0.4269 => 0.4086, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.10% (0.1353 => 0.1311, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.94% (0.0609 => 0.0585, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -22.45% (0.0245 => 0.0190, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.53% (0.0554 => 0.0540, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.38% (1.1429 => 1.1386, std.dev.: 0.0188) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -95.24% (0.0021 => 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -93.75% (0.0016 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.07% (0.0615 => 0.0590, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 12.44% (0.0209 => 0.0235, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.57% (0.7949 => 0.7994, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 4.44% (0.0045 => 0.0047, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.84% (2.1832 => 1.6628, std.dev.: 0.0044) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 35.21% (14.7684 => 19.9686, std.dev.: 0.0370) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.80% (0.0810 => 0.0938, std.dev.: 0.0008) SingleSource/UnitTests/SignlessTypes/rem: 14.49% (0.1035 => 0.1185, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.15% (0.0848 => 0.0951, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 12.05% (0.1112 => 0.1246, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.31% (0.2180 => 0.2383, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: 8.98% (0.1347 => 0.1468, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.56% (0.8321 => 0.8950, std.dev.: 0.0028) MultiSource/Applications/SIBsim4/SIBsim4: 7.36% (1.2568 => 1.3493, std.dev.: 0.0050) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.08% (0.3137 => 0.3359, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.77% (0.1905 => 0.2034, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.46% (13.1811 => 14.0325, std.dev.: 0.0621) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.15% (0.1983 => 0.2105, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.55% (0.4847 => 0.5116, std.dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.55% (6.6074 => 6.9740, std.dev.: 0.0190) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.44% (1.1170 => 1.1778, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.31% (0.6010 => 0.6329, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.30% (0.7473 => 0.7869, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.22% (0.2741 => 0.2884, std.dev.: 0.0017) MultiSource/Applications/spiff/spiff: 5.17% (0.7950 => 0.8361, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.15% (0.6227 => 0.6548, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.83% (0.4783 => 0.5014, std.dev.: 0.0019) MultiSource/Applications/Burg/burg: 4.79% (1.2222 => 1.2807, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.78% (0.2240 => 0.2347, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.43% (1.1271 => 1.1770, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.36% (1.6386 => 1.7100, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.26% (0.4127 => 0.4303, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.26% (1.4479 => 1.5096, std.dev.: 0.0061) MultiSource/Applications/treecc/treecc: 4.00% (1.9948 => 2.0745, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.79% (0.3295 => 0.3420, std.dev.: 0.0047) MultiSource/Applications/SPASS/SPASS: 3.77% (14.2605 => 14.7982, std.dev.: 0.0676) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.77% (0.3717 => 0.3857, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 3.76% (0.8768 => 0.9098, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.76% (0.5191 => 0.5386, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 3.67% (1.0945 => 1.1347, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.59% (1.3279 => 1.3756, std.dev.: 0.0079) MultiSource/Benchmarks/Olden/bh/bh: 3.58% (0.2985 => 0.3092, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: 3.57% (0.6834 => 0.7078, std.dev.: 0.0026) MultiSource/Applications/d/make_dparser: 3.56% (3.2366 => 3.3517, std.dev.: 0.0213) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.55% (0.4559 => 0.4721, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.42% (8.6476 => 8.9433, std.dev.: 0.0178) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.40% (1.1606 => 1.2001, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.30% (0.8697 => 0.8984, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash: 3.18% (0.3800 => 0.3921, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.13% (0.8340 => 0.8601, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.09% (1.1685 => 1.2046, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.05% (0.8261 => 0.8513, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.98% (1.5315 => 1.5771, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.95% (0.8007 => 0.8243, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.94% (1.2602 => 1.2972, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.91% (0.9074 => 0.9338, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.79% (0.8457 => 0.8693, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.79% (0.7932 => 0.8153, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 2.76% (0.4125 => 0.4239, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.73% (0.8597 => 0.8832, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.72% (4.1763 => 4.2901, std.dev.: 0.0191) MultiSource/Applications/lua/lua: 2.66% (3.8189 => 3.9206, std.dev.: 0.0196) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.66% (0.8611 => 0.8840, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.64% (3.1832 => 3.2671, std.dev.: 0.0249) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.63% (0.8331 => 0.8550, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.63% (0.9056 => 0.9294, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.62% (2.1401 => 2.1962, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.58% (0.8286 => 0.8500, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.57% (0.8050 => 0.8257, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.50% (0.8069 => 0.8271, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.47% (0.8518 => 0.8728, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.44% (0.6586 => 0.6747, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.43% (0.8805 => 0.9019, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.43% (0.9688 => 0.9923, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.42% (0.8359 => 0.8561, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.41% (0.8086 => 0.8281, std.dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 2.38% (8.6247 => 8.8300, std.dev.: 0.0362) MultiSource/Benchmarks/Bullet/bullet: 2.35% (31.8598 => 32.6071, std.dev.: 0.0583) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.32% (0.8177 => 0.8367, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.31% (4.4873 => 4.5910, std.dev.: 0.0261) MultiSource/Applications/JM/ldecod/ldecod: 2.30% (6.7320 => 6.8866, std.dev.: 0.0379) MultiSource/Applications/JM/lencod/lencod: 2.27% (15.3280 => 15.6755, std.dev.: 0.0747) MultiSource/Applications/hexxagon/hexxagon: 2.23% (0.9810 => 1.0029, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.19% (0.8885 => 0.9080, std.dev.: 0.0031) MultiSource/Applications/oggenc/oggenc: 2.17% (4.9628 => 5.0706, std.dev.: 0.0291) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.16% (0.8716 => 0.8904, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.11% (0.8066 => 0.8236, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.08% (0.8204 => 0.8375, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.07% (0.8927 => 0.9112, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.04% (0.8317 => 0.8487, std.dev.: 0.0032) MultiSource/Applications/siod/siod: 1.99% (2.2184 => 2.2626, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.87% (0.8855 => 0.9021, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.87% (0.9908 => 1.0093, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.81% (0.5817 => 0.5922, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.77% (1.2423 => 1.2643, std.dev.: 0.0033) MultiSource/Benchmarks/PAQ8p/paq8p: 1.77% (2.3764 => 2.4184, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.60% (0.8995 => 0.9139, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.78% (1.5795 => 2.5079, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.79% (0.3186 => 0.3498, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.55% (2.4333 => 2.6657, std.dev.: 0.0277) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.49% (1.1857 => 1.2864, std.dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 5.99% (63.1822 => 66.9644, std.dev.: 0.0382) SingleSource/Benchmarks/Misc/ReedSolomon: 2.94% (8.5322 => 8.7832, std.dev.: 0.0209) MultiSource/Applications/siod/siod: 2.66% (3.6643 => 3.7617, std.dev.: 0.0132) MultiSource/Benchmarks/Olden/bh/bh: 1.95% (2.3560 => 2.4019, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.72% (4.8362 => 4.9196, std.dev.: 0.0153) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.71% (2.4490 => 2.4909, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/richards_benchmark: 1.04% (1.3037 => 1.3173, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.15% (0.3269 => 0.2970, std.dev.: 0.0057) MultiSource/Applications/lua/lua: -5.14% (29.8330 => 28.2986, std.dev.: 0.0667) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -1.80% (7.2130 => 7.0835, std.dev.: 0.0481) SingleSource/Benchmarks/Shootout-C++/hash2: -1.44% (3.4237 => 3.3744, std.dev.: 0.0092) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 1.68% (16.4461 => 16.7220, std.dev.: 0.0500) MultiSource/Applications/obsequi/Obsequi: 4.38% (1.0262 => 1.0711, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: 2.92% (0.6332 => 0.6517, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/08-main/main: 3.71% (0.1831 => 0.1899, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.04% (0.1559 => 0.1622, std.dev.: 0.0056) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.31% (0.3123 => 0.3164, std.dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.03% (0.2463 => 0.2513, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.18% (0.3344 => 0.3350, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.76% (0.2364 => 0.2453, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 0.83% (0.6010 => 0.6060, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel: 1.40% (0.0429 => 0.0435, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.88% (0.3266 => 0.3360, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/strcat: 2.79% (0.1969 => 0.2024, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -9.82% (0.0224 => 0.0202, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -12.25% (0.0408 => 0.0358, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 19.69% (0.0254 => 0.0304, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/casts: -0.53% (0.0190 => 0.0189, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/test1: -15.00% (0.0180 => 0.0153, std.dev.: 0.0031) SingleSource/UnitTests/byval-alignment: 42.17% (0.0230 => 0.0327, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -0.14% (0.1438 => 0.1436, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.71% (1.1329 => 1.1410, std.dev.: 0.0098) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 0.21% (0.1462 => 0.1465, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.87% (0.4164 => 0.4086, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.24% (0.1369 => 0.1311, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.74% (0.0641 => 0.0585, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.56% (0.0195 => 0.0190, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.57% (0.0578 => 0.0540, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.45% (1.1437 => 1.1386, std.dev.: 0.0188) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.90% (0.0627 => 0.0590, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 30.56% (0.0180 => 0.0235, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.29% (0.8017 => 0.7994, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -24.19% (0.0062 => 0.0047, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 15:22:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 17:22:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121027222224.7FF552A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5310?compare_to=5307&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5310, Order: 166891, Start Time: 2012-10-27 20:57:10, End Time: 2012-10-27 22:22:21 To: 5307, Order: 166880, Start Time: 2012-10-27 19:08:57, End Time: 2012-10-27 20:34:09 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 0 (179 on baseline) Unchanged Tests: 1041 (857 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 3.03% (3.7513 => 3.8651, std.dev.: 0.0375) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.06% (15.2527 => 18.3122, std.dev.: 0.0094) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0012) MultiSource/Benchmarks/llubenchmark/llu: 3.25% (3.7435 => 3.8651, std.dev.: 0.0375) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.06% (2.0478 => 2.1104, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: 2.69% (7.4937 => 7.6956, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hash2: 1.89% (3.1932 => 3.2536, std.dev.: 0.0064) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.78% (0.1584 => 0.1445, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.53% (0.1431 => 0.1309, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.59% (0.3821 => 0.3531, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -7.14% (2.4924 => 2.3144, std.dev.: 0.0152) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.13% (0.2428 => 0.2255, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -7.11% (0.3880 => 0.3604, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -7.10% (0.3831 => 0.3559, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -7.08% (0.3812 => 0.3542, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -7.07% (0.3848 => 0.3576, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.03% (0.3884 => 0.3611, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: -6.99% (0.4176 => 0.3884, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.96% (0.3891 => 0.3620, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -6.88% (0.3896 => 0.3628, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -6.75% (0.4280 => 0.3991, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.74% (0.4033 => 0.3761, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -6.74% (0.4199 => 0.3916, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.65% (0.3142 => 0.2933, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.62% (0.3658 => 0.3416, std.dev.: 0.0085) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.57% (22.4056 => 20.9330, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.45% (4.5069 => 4.2162, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/08-main/main: -6.43% (0.2659 => 0.2488, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.32% (0.6484 => 0.6074, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -6.28% (0.1879 => 0.1761, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -6.28% (2.4021 => 2.2513, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.27% (5.4682 => 5.1252, std.dev.: 0.0048) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.24% (0.1716 => 0.1609, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.14% (0.9852 => 0.9247, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -6.14% (0.3357 => 0.3151, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -6.12% (4.3330 => 4.0678, std.dev.: 0.0066) MultiSource/Applications/JM/ldecod/ldecod: -6.12% (7.0961 => 6.6619, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.11% (0.2355 => 0.2211, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.11% (0.7919 => 0.7435, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/oourafft: -6.11% (0.2160 => 0.2028, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: -6.10% (16.1920 => 15.2043, std.dev.: 0.0085) MultiSource/Applications/Burg/burg: -6.10% (1.2515 => 1.1752, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -6.08% (4.8161 => 4.5233, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.07% (0.4151 => 0.3899, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.05% (0.9542 => 0.8965, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.02% (3.5339 => 3.3212, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: -5.96% (0.2871 => 0.2700, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -5.96% (1.3148 => 1.2365, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.95% (4.8802 => 4.5900, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.93% (0.2548 => 0.2397, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.92% (0.2903 => 0.2731, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.92% (0.7198 => 0.6772, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.92% (1.0544 => 0.9920, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.92% (0.3837 => 0.3610, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.90% (0.5999 => 0.5645, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.90% (2.1713 => 2.0433, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: -5.89% (0.2989 => 0.2813, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.89% (0.3057 => 0.2877, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -5.88% (0.3026 => 0.2848, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.88% (0.8521 => 0.8020, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.87% (0.3849 => 0.3623, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.87% (0.3323 => 0.3128, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.83% (0.4321 => 0.4069, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.83% (0.4083 => 0.3845, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.82% (1.6474 => 1.5515, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/random: -5.82% (0.2939 => 0.2768, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -5.80% (0.3481 => 0.3279, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -5.79% (0.3025 => 0.2850, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -5.78% (0.3255 => 0.3067, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -5.77% (0.3446 => 0.3247, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.77% (1.2784 => 1.2046, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.75% (0.3252 => 0.3065, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.74% (4.0323 => 3.8007, std.dev.: 0.0050) MultiSource/Applications/kimwitu++/kc: -5.74% (18.2933 => 17.2430, std.dev.: 0.0038) MultiSource/Applications/lua/lua: -5.73% (4.0594 => 3.8267, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/bh/bh: -5.73% (0.2985 => 0.2814, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: -5.69% (0.3394 => 0.3201, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: -5.69% (0.2849 => 0.2687, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -5.68% (0.3205 => 0.3023, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: -5.66% (0.4861 => 0.4586, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -5.64% (0.3194 => 0.3014, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.63% (1.2210 => 1.1522, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.60% (1.2221 => 1.1537, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.58% (0.2278 => 0.2151, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.57% (0.3016 => 0.2848, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -5.55% (34.0927 => 32.1994, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/lists: -5.55% (0.3621 => 0.3420, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: -5.53% (0.6750 => 0.6377, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -5.49% (0.7982 => 0.7544, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: -5.48% (0.3867 => 0.3655, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -5.46% (0.3059 => 0.2892, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -5.44% (0.3788 => 0.3582, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.44% (0.2999 => 0.2836, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.40% (0.4813 => 0.4553, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.38% (1.6364 => 1.5483, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.38% (0.4427 => 0.4189, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.36% (1.3722 => 1.2987, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.36% (0.6293 => 0.5956, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.34% (1.4642 => 1.3860, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.33% (2.2587 => 2.1382, std.dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: -5.31% (9.2283 => 8.7386, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/moments: -5.30% (0.4248 => 0.4023, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.21% (0.3491 => 0.3309, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.18% (0.3319 => 0.3147, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.16% (0.3931 => 0.3728, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.15% (0.2933 => 0.2782, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: -5.05% (0.7779 => 0.7386, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.03% (0.2106 => 0.2000, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -4.99% (0.6347 => 0.6030, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.98% (0.6230 => 0.5920, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: -4.97% (0.4524 => 0.4299, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -4.97% (0.3581 => 0.3403, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: -4.97% (0.6441 => 0.6121, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.94% (0.4916 => 0.4673, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.91% (0.6676 => 0.6348, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: -4.86% (0.3271 => 0.3112, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.84% (0.5478 => 0.5213, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (0.6681 => 0.6358, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.83% (0.9557 => 0.9095, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.83% (0.5591 => 0.5321, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.78% (0.6297 => 0.5996, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.78% (0.5859 => 0.5579, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -4.76% (0.4515 => 0.4300, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.76% (0.5863 => 0.5584, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.75% (0.5805 => 0.5529, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.74% (0.6660 => 0.6344, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -4.73% (1.1450 => 1.0908, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.73% (0.5456 => 0.5198, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.71% (0.5857 => 0.5581, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.71% (0.5802 => 0.5529, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.70% (0.2385 => 0.2273, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.69% (0.6052 => 0.5768, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.68% (0.6667 => 0.6355, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.66% (0.5581 => 0.5321, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -4.64% (15.5079 => 14.7882, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.63% (0.5570 => 0.5312, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: -4.63% (0.9179 => 0.8754, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.63% (0.5705 => 0.5441, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.62% (0.6189 => 0.5903, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.62% (0.6194 => 0.5908, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.62% (0.6260 => 0.5971, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.62% (0.6304 => 0.6013, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.61% (0.5941 => 0.5667, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.61% (0.6440 => 0.6143, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.61% (0.5925 => 0.5652, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: -4.61% (0.7447 => 0.7104, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.60% (0.6395 => 0.6101, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.59% (0.5575 => 0.5319, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.58% (0.3406 => 0.3250, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.58% (0.7339 => 0.7003, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.55% (0.9077 => 0.8664, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.54% (0.5569 => 0.5316, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: -4.54% (0.8418 => 0.8036, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.51% (0.6033 => 0.5761, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.51% (0.7524 => 0.7185, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.50% (0.6395 => 0.6107, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.47% (0.5567 => 0.5318, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.47% (0.6736 => 0.6435, std.dev.: 0.0014) MultiSource/Applications/treecc/treecc: -4.47% (2.1401 => 2.0445, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.44% (0.2277 => 0.2176, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.43% (0.5688 => 0.5436, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.42% (6.7716 => 6.4725, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.41% (8.0126 => 7.6592, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.37% (0.6446 => 0.6164, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.36% (0.3483 => 0.3331, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.36% (0.5849 => 0.5594, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -4.20% (17.1032 => 16.3854, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.17% (0.7021 => 0.6728, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -4.15% (1.2300 => 1.1789, std.dev.: 0.0143) MultiSource/Applications/oggenc/oggenc: -3.99% (5.0226 => 4.8224, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: -3.96% (3.5154 => 3.3763, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.86% (0.2695 => 0.2591, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: -3.80% (1.1530 => 1.1092, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: -3.75% (1.5610 => 1.5024, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.75% (0.5329 => 0.5129, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.73% (0.5168 => 0.4975, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.51% (14.2083 => 13.7100, std.dev.: 0.0129) SingleSource/UnitTests/Vector/constpool: -2.23% (20.7746 => 20.3112, std.dev.: 0.0368) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7506, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/richards_benchmark: -8.72% (1.2842 => 1.1722, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.87% (1.7753 => 1.7066, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.80% (2.2633 => 2.1772, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.52% (6.5735 => 6.4736, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0002) Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 16:13:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 18:13:47 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121027231347.AA6B02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5311?compare_to=5309&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5311, Order: 166892, Start Time: 2012-10-27 21:49:59, End Time: 2012-10-27 23:13:46 To: 5309, Order: 166891, Start Time: 2012-10-27 20:09:17, End Time: 2012-10-27 21:33:14 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 11 (108 on baseline) Performance Improvements: 3 (6 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 961 (860 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/12-IOtest/iotest: 18.28% (0.0755 => 0.0893, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.32% (0.2988 => 0.3117, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.84% (0.5955 => 0.6124, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.56% (0.9531 => 0.9775, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.60% (1.2649 => 1.2852, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.35% (1.7100 => 1.7331, std.dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 1.05% (1.1770 => 1.1893, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.32% (1.2265 => 1.2550, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.74% (2.5836 => 2.6286, std.dev.: 0.0104) SingleSource/Benchmarks/Misc/whetstone: 1.39% (2.1100 => 2.1393, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/hash: 1.08% (4.2746 => 4.3208, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.80% (0.8995 => 0.8833, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.17% (1.5771 => 1.5586, std.dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/SPASS/SPASS: -3.47% (8.6431 => 8.3432, std.dev.: 0.0915) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.89% (16.7220 => 16.8706, std.dev.: 0.0536) MultiSource/Applications/obsequi/Obsequi: -0.45% (1.0711 => 1.0663, std.dev.: 0.0073) MultiSource/Applications/sqlite3/sqlite3: -0.63% (0.6517 => 0.6476, std.dev.: 0.0093) MultiSource/Benchmarks/McCat/08-main/main: 3.26% (0.1899 => 0.1961, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.14% (0.1622 => 0.1673, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.75% (0.3164 => 0.3251, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.83% (0.2513 => 0.2442, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.81% (0.3350 => 0.3323, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.45% (0.2453 => 0.2393, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/bigfib: -0.18% (0.6060 => 0.6049, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel: 2.30% (0.0435 => 0.0445, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.06% (0.3360 => 0.3362, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/strcat: 0.15% (0.2024 => 0.2027, std.dev.: 0.0017) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 22.28% (0.0202 => 0.0247, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -31.51% (0.0219 => 0.0150, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.31% (0.0358 => 0.0377, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -17.11% (0.0304 => 0.0252, std.dev.: 0.0062) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.87% (0.0314 => 0.0305, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -8.98% (0.0423 => 0.0385, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/casts: -36.51% (0.0189 => 0.0120, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/test1: 23.53% (0.0153 => 0.0189, std.dev.: 0.0015) SingleSource/UnitTests/byval-alignment: 4.28% (0.0327 => 0.0341, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 100.00% (0.0001 => 0.0002, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 0.63% (0.1436 => 0.1445, std.dev.: 0.0039) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.03% (1.1410 => 1.1413, std.dev.: 0.0089) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 2.18% (0.1465 => 0.1497, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.15% (0.4086 => 0.4080, std.dev.: 0.0351) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.14% (0.1311 => 0.1339, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.10% (0.0585 => 0.0609, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 23.68% (0.0190 => 0.0235, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.59% (0.0540 => 0.0608, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.85% (1.1386 => 1.1483, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1800.00% (0.0001 => 0.0019, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.19% (0.0590 => 0.0583, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.98% (0.0235 => 0.0228, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.18% (0.7994 => 0.8008, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 12.77% (0.0047 => 0.0053, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.72% (2.1832 => 1.6654, std.dev.: 0.0039) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 36.06% (14.7684 => 20.0933, std.dev.: 0.0225) SingleSource/UnitTests/SignlessTypes/rem: 14.69% (0.1035 => 0.1187, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 13.22% (0.1112 => 0.1259, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.72% (0.8321 => 0.9130, std.dev.: 0.0196) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.42% (0.2279 => 0.2448, std.dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 7.26% (1.2568 => 1.3480, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.23% (0.1466 => 0.1572, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.03% (1.1170 => 1.1844, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.77% (1.6386 => 1.7331, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.69% (13.1811 => 13.9317, std.dev.: 0.1195) MultiSource/Applications/spiff/spiff: 5.65% (0.7950 => 0.8399, std.dev.: 0.0166) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.58% (6.6074 => 6.9762, std.dev.: 0.0242) MultiSource/Benchmarks/nbench/nbench: 5.52% (1.1271 => 1.1893, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.34% (0.7473 => 0.7872, std.dev.: 0.0050) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.16% (0.3137 => 0.3299, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.82% (0.4127 => 0.4326, std.dev.: 0.0025) MultiSource/Applications/Burg/burg: 4.64% (1.2222 => 1.2789, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.58% (0.4847 => 0.5069, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.41% (0.4559 => 0.4760, std.dev.: 0.0048) MultiSource/Applications/hbd/hbd: 4.29% (1.4269 => 1.4881, std.dev.: 0.0179) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.27% (0.4783 => 0.4987, std.dev.: 0.0023) MultiSource/Applications/sgefa/sgefa: 4.13% (0.2999 => 0.3123, std.dev.: 0.0018) MultiSource/Applications/treecc/treecc: 4.12% (1.9948 => 2.0770, std.dev.: 0.0143) MultiSource/Applications/d/make_dparser: 3.84% (3.2366 => 3.3608, std.dev.: 0.0362) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.80% (0.3003 => 0.3117, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.68% (0.5191 => 0.5382, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.64% (0.6586 => 0.6826, std.dev.: 0.0028) MultiSource/Applications/lemon/lemon: 3.64% (1.0945 => 1.1343, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.60% (0.9435 => 0.9775, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.43% (1.1606 => 1.2004, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.40% (0.6287 => 0.6501, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/lists1: 3.40% (0.2969 => 0.3070, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.37% (8.6476 => 8.9391, std.dev.: 0.0445) MultiSource/Benchmarks/Prolangs-C/football/football: 3.34% (0.8768 => 0.9061, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.32% (1.2602 => 1.3020, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.28% (1.3279 => 1.3715, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash: 3.26% (0.3800 => 0.3924, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.25% (0.9074 => 0.9369, std.dev.: 0.0025) MultiSource/Applications/minisat/minisat: 3.25% (0.6834 => 0.7056, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.23% (0.3717 => 0.3837, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.21% (0.3115 => 0.3215, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.20% (14.2605 => 14.7173, std.dev.: 0.1268) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.14% (1.4479 => 1.4934, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/hash2: 3.13% (0.4125 => 0.4254, std.dev.: 0.0025) MultiSource/Applications/lua/lua: 3.10% (3.8189 => 3.9372, std.dev.: 0.0262) MultiSource/Benchmarks/MallocBench/gs/gs: 2.98% (4.1305 => 4.2536, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.93% (0.8317 => 0.8561, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.89% (4.1763 => 4.2971, std.dev.: 0.0309) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.87% (0.8611 => 0.8858, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.84% (0.8007 => 0.8234, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.83% (0.8457 => 0.8696, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.82% (0.8261 => 0.8494, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.82% (0.8050 => 0.8277, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.75% (0.9688 => 0.9954, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.73% (0.5961 => 0.6124, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.73% (0.8805 => 0.9045, std.dev.: 0.0052) MultiSource/Applications/JM/lencod/lencod: 2.72% (15.3280 => 15.7445, std.dev.: 0.0502) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.71% (0.8697 => 0.8933, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.68% (0.8286 => 0.8508, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 2.64% (4.9628 => 5.0940, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.63% (0.8359 => 0.8579, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.63% (0.8340 => 0.8559, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.60% (1.2526 => 1.2852, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.59% (0.9908 => 1.0165, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.57% (0.8069 => 0.8276, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.56% (0.8086 => 0.8293, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.53% (0.8331 => 0.8542, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.48% (0.8712 => 0.8928, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.42% (0.7966 => 0.8159, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.39% (0.8716 => 0.8924, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.35% (0.8597 => 0.8799, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.35% (0.8048 => 0.8237, std.dev.: 0.0069) MultiSource/Applications/JM/ldecod/ldecod: 2.34% (6.7320 => 6.8897, std.dev.: 0.0422) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.34% (0.5817 => 0.5953, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.33% (0.8885 => 0.9092, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.31% (0.9039 => 0.9248, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.31% (0.8927 => 0.9133, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.28% (0.8518 => 0.8712, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.24% (0.7932 => 0.8110, std.dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 2.20% (8.6247 => 8.8145, std.dev.: 0.0240) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.17% (0.8420 => 0.8603, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.16% (0.9069 => 0.9265, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.11% (0.8338 => 0.8514, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.10% (0.8177 => 0.8349, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.08% (0.8204 => 0.8375, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.08% (3.1832 => 3.2495, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.04% (0.8656 => 0.8833, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.01% (0.8855 => 0.9033, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.98% (0.8316 => 0.8481, std.dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 1.95% (0.9810 => 1.0001, std.dev.: 0.0035) MultiSource/Applications/siod/siod: 1.87% (2.2184 => 2.2598, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.77% (1.5315 => 1.5586, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.62% (1.2423 => 1.2624, std.dev.: 0.0046) MultiSource/Applications/lambda-0_1_3/lambda: 1.59% (0.7557 => 0.7677, std.dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: 1.54% (31.8598 => 32.3520, std.dev.: 0.1174) MultiSource/Benchmarks/PAQ8p/paq8p: 1.35% (2.3764 => 2.4086, std.dev.: 0.0085) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.88% (1.5795 => 2.5095, std.dev.: 0.0052) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.12% (2.4333 => 2.6552, std.dev.: 0.0271) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.47% (0.3186 => 0.3456, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.09% (1.1857 => 1.2816, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.07% (14.6451 => 15.8274, std.dev.: 0.2653) MultiSource/Benchmarks/mafft/pairlocalalign: 5.91% (63.1822 => 66.9192, std.dev.: 0.0816) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.57% (0.2887 => 0.2990, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 2.80% (3.6643 => 3.7668, std.dev.: 0.0140) MultiSource/Benchmarks/Olden/bh/bh: 2.05% (2.3560 => 2.4043, std.dev.: 0.0149) MultiSource/Applications/minisat/minisat: 2.04% (6.1525 => 6.2779, std.dev.: 0.0453) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.73% (1.2337 => 1.2550, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.62% (4.8362 => 4.9145, std.dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -30.18% (0.0338 => 0.0236, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.49% (0.3269 => 0.3024, std.dev.: 0.0027) MultiSource/Applications/lua/lua: -4.72% (29.8330 => 28.4257, std.dev.: 0.1217) SingleSource/Benchmarks/Shootout-C++/hash2: -1.51% (3.4237 => 3.3721, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -1.41% (7.2130 => 7.1115, std.dev.: 0.0269) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.40% (3.3479 => 3.3009, std.dev.: 0.0031) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 2.58% (16.4461 => 16.8706, std.dev.: 0.0536) MultiSource/Applications/obsequi/Obsequi: 3.91% (1.0262 => 1.0663, std.dev.: 0.0073) MultiSource/Applications/sqlite3/sqlite3: 2.27% (0.6332 => 0.6476, std.dev.: 0.0093) MultiSource/Benchmarks/McCat/08-main/main: 7.10% (0.1831 => 0.1961, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.31% (0.1559 => 0.1673, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.10% (0.3123 => 0.3251, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.85% (0.2463 => 0.2442, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.63% (0.3344 => 0.3323, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.23% (0.2364 => 0.2393, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/bigfib: 0.65% (0.6010 => 0.6049, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel: 3.73% (0.0429 => 0.0445, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.94% (0.3266 => 0.3362, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/strcat: 2.95% (0.1969 => 0.2027, std.dev.: 0.0017) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 10.27% (0.0224 => 0.0247, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 21.95% (0.0123 => 0.0150, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -7.60% (0.0408 => 0.0377, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.79% (0.0254 => 0.0252, std.dev.: 0.0062) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.99% (0.0302 => 0.0305, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.26% (0.0384 => 0.0385, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/casts: -36.84% (0.0190 => 0.0120, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/test1: 5.00% (0.0180 => 0.0189, std.dev.: 0.0015) SingleSource/UnitTests/byval-alignment: 48.26% (0.0230 => 0.0341, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -71.43% (0.0007 => 0.0002, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 0.49% (0.1438 => 0.1445, std.dev.: 0.0039) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.74% (1.1329 => 1.1413, std.dev.: 0.0089) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 2.39% (0.1462 => 0.1497, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.02% (0.4164 => 0.4080, std.dev.: 0.0351) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.19% (0.1369 => 0.1339, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.99% (0.0641 => 0.0609, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 20.51% (0.0195 => 0.0235, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.19% (0.0578 => 0.0608, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.40% (1.1437 => 1.1483, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1800.00% (0.0001 => 0.0019, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.02% (0.0627 => 0.0583, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 26.67% (0.0180 => 0.0228, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.11% (0.8017 => 0.8008, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -14.52% (0.0062 => 0.0053, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 16:15:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 18:15:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121027231512.9F8152A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5312?compare_to=5308&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5312, Order: 166891, Start Time: 2012-10-27 21:43:52, End Time: 2012-10-27 23:15:10 To: 5308, Order: 166880, Start Time: 2012-10-27 19:43:07, End Time: 2012-10-27 21:14:19 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (10 on baseline) New Passes: 0 (14 on baseline) Performance Regressions: 3 (190 on baseline) Performance Improvements: 0 (54 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 15 (5 on baseline) Unchanged Tests: 1024 (635 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 4.72% (0.4068 => 0.4260, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.51% (54.5712 => 56.4877, std.dev.: 0.1254) SingleSource/Benchmarks/Shootout/ary3: 1.17% (3.6881 => 3.7313, std.dev.: 0.0136) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: 0.21% (2.0801 => 2.0845, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 0.17% (58.0792 => 58.1806, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.13% (0.0798 => 0.0799, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 0.15% (9.2390 => 9.2533, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.00% (7.8346 => 7.8347, std.dev.: 0.0020) SingleSource/UnitTests/Vector/SSE/sse_shift: 4.08% (0.0515 => 0.0536, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/JM/lencod/lencod: 0.03% (7.7250 => 7.7271, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: - (0.0001 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0648 => 0.0648, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.10% (0.2993 => 0.2990, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_shift: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -63.81% (5.7591 => 2.0845, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -8.01% (63.2438 => 58.1806, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.81% (6.6874 => 0.0799, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.73% (8.1363 => 9.2533, std.dev.: 0.0032) SingleSource/UnitTests/Vector/SSE/sse_shift: 41.80% (0.0378 => 0.0536, std.dev.: 0.0008) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -50.00% (0.0002 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -57.05% (0.6962 => 0.2990, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_shift: -50.00% (0.0002 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 212.49% (0.5229 => 1.6340, std.dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 17.93% (14.9895 => 17.6769, std.dev.: 0.0123) MultiSource/Applications/kimwitu++/kc: 37.93% (14.1553 => 19.5239, std.dev.: 0.0221) MultiSource/Benchmarks/MallocBench/gs/gs: 13.79% (4.1105 => 4.6774, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 33.17% (1.1048 => 1.4713, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 69.69% (3.4629 => 5.8763, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/stepanov_container: 69.35% (0.6222 => 1.0537, std.dev.: 0.0015) New Passes - Execution Time --------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 3836000.00% (0.0001 => 3.8361, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 11145300.00% (0.0001 => 11.1454, std.dev.: 0.0455) MultiSource/Applications/kimwitu++/kc: 50900.00% (0.0001 => 0.0510, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049700.00% (0.0001 => 10.0498, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5493300.00% (0.0001 => 5.4934, std.dev.: 0.0010) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 78.04% (0.0296 => 0.0527, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 69.92% (0.0256 => 0.0435, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 60.89% (0.0271 => 0.0436) SingleSource/Regression/C/sumarraymalloc: 52.67% (0.0243 => 0.0371, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 44.31% (1.5859 => 2.2886, std.dev.: 0.0073) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.09% (0.0834 => 0.1185, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/distray/distray: 40.81% (0.1056 => 0.1487, std.dev.: 0.0000) SingleSource/UnitTests/vla: 36.06% (0.0355 => 0.0483) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 35.29% (2.2024 => 2.9796, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/neural/neural: 34.11% (0.1463 => 0.1962, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 29.26% (0.1432 => 0.1851, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 27.98% (0.1655 => 0.2118, std.dev.: 0.0002) MultiSource/Benchmarks/llubenchmark/llu: 24.24% (0.0462 => 0.0574) SingleSource/Benchmarks/Shootout/hash: 22.89% (0.0485 => 0.0596, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 22.29% (0.1144 => 0.1399, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.90% (0.1566 => 0.1909, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.53% (0.5105 => 0.6204, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 21.09% (0.1555 => 0.1883, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.90% (0.0871 => 0.1053, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 19.82% (0.6675 => 0.7998, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 19.20% (1.3050 => 1.5556, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.20% (0.2271 => 0.2707, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 19.13% (3.3354 => 3.9734, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.94% (0.5020 => 0.5971, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 18.55% (0.7115 => 0.8435, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/n-body: 18.50% (0.0746 => 0.0884, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 18.49% (0.0730 => 0.0865, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 18.36% (0.2554 => 0.3023, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 18.30% (0.1175 => 0.1390, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 18.10% (0.1337 => 0.1579, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 18.04% (0.1236 => 0.1459, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 17.87% (0.1584 => 0.1867, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 17.83% (1.1840 => 1.3951, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.81% (0.1510 => 0.1779, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.73% (0.1032 => 0.1215, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: 17.73% (0.0626 => 0.0737, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 17.70% (0.1695 => 0.1995, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.65% (1.5415 => 1.8136, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/mst/mst: 17.54% (0.1163 => 0.1367, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.53% (0.4615 => 0.5424, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.40% (0.0793 => 0.0931, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 17.24% (0.4879 => 0.5720, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 17.00% (0.3177 => 0.3717, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 16.89% (0.3109 => 0.3634, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 16.87% (0.2603 => 0.3042, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.81% (0.8172 => 0.9546, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.76% (0.6450 => 0.7531, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.59% (0.0886 => 0.1033, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 16.54% (22.1758 => 25.8439, std.dev.: 0.0062) MultiSource/Applications/aha/aha: 16.51% (0.1151 => 0.1341, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 16.49% (0.1940 => 0.2260, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.30% (0.0675 => 0.0785, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 16.26% (0.1906 => 0.2216) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.24% (0.3121 => 0.3628, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 16.03% (0.0842 => 0.0977, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 15.86% (1.1642 => 1.3488, std.dev.: 0.0048) MultiSource/Applications/lemon/lemon: 15.86% (1.0722 => 1.2422, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/exptree: 15.85% (0.0814 => 0.0943, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.70% (0.9765 => 1.1298, std.dev.: 0.0033) MultiSource/Applications/treecc/treecc: 15.65% (2.0273 => 2.3446, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 15.63% (0.1695 => 0.1960, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.49% (0.1117 => 0.1290, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.47% (0.2107 => 0.2433, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 15.44% (0.7835 => 0.9045, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.41% (0.2758 => 0.3183, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: 15.40% (0.8921 => 1.0295, std.dev.: 0.0108) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 15.20% (0.1125 => 0.1296, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 15.18% (0.0672 => 0.0774, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 15.07% (0.2700 => 0.3107, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.02% (1.1861 => 1.3642, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 15.01% (1.4186 => 1.6315, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.94% (0.0770 => 0.0885, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 14.90% (0.3423 => 0.3933, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.90% (0.0933 => 0.1072, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.90% (0.5860 => 0.6733, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.78% (0.1062 => 0.1219, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.76% (0.0759 => 0.0871, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 14.65% (0.4299 => 0.4929, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.62% (0.2065 => 0.2367, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.60% (0.5981 => 0.6854, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.58% (0.1625 => 0.1862, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.51% (0.1330 => 0.1523, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.48% (0.1029 => 0.1178, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.47% (4.2646 => 4.8815, std.dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/lpbench: 14.42% (0.0929 => 0.1063, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.39% (0.3307 => 0.3783, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 14.34% (0.7433 => 0.8499, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 14.30% (3.8723 => 4.4261, std.dev.: 0.0114) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.16% (0.0798 => 0.0911, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 14.05% (0.3387 => 0.3863, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.64% (0.0770 => 0.0875, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 13.59% (9.4845 => 10.7735, std.dev.: 0.0163) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.39% (0.1143 => 0.1296, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.38% (0.5569 => 0.6314, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/health/health: 13.33% (0.1268 => 0.1437, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.09% (0.3826 => 0.4327, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: 12.97% (0.3092 => 0.3493, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.93% (0.3441 => 0.3886, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 12.77% (0.0838 => 0.0945, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 12.42% (0.3180 => 0.3575, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.26% (0.1892 => 0.2124, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 12.19% (0.4289 => 0.4812, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 11.86% (0.0953 => 0.1066, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 11.73% (0.4620 => 0.5162, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 11.66% (2.2969 => 2.5647, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: 11.65% (0.6456 => 0.7208, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.60% (14.3668 => 16.0338, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.54% (0.8101 => 0.9036, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.38% (5.0018 => 5.5711, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.30% (4.9449 => 5.5039, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 11.11% (0.1044 => 0.1160, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 10.98% (17.1811 => 19.0677, std.dev.: 0.0136) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.75% (2.2022 => 2.4390, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.74% (0.3427 => 0.3795, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.61% (0.4636 => 0.5128, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/parameter-passing: 10.54% (0.3927 => 0.4341, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.52% (0.4203 => 0.4645, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.43% (0.3865 => 0.4268, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.37% (0.3828 => 0.4225, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.37% (0.3473 => 0.3833, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/synchronized: 10.33% (0.3561 => 0.3929, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.33% (0.3543 => 0.3909, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 10.32% (0.3422 => 0.3775, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.31% (0.3694 => 0.4075, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.25% (0.3543 => 0.3906, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 10.24% (0.3516 => 0.3876, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.21% (0.3497 => 0.3854, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 10.13% (1.5603 => 1.7183, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists1: 10.10% (0.3684 => 0.4056, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.98% (0.3886 => 0.4274, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/moments: 9.81% (0.4048 => 0.4445, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.51% (0.4103 => 0.4493, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.36% (0.2266 => 0.2478, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.34% (0.2430 => 0.2657, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 9.27% (0.3603 => 0.3937, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 9.25% (0.7326 => 0.8004, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.25% (3.8922 => 4.2521, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference-object: 9.22% (0.6030 => 0.6586, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.13% (0.5925 => 0.6466, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.78% (0.4064 => 0.4421, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 8.13% (0.3098 => 0.3350, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.08% (0.3650 => 0.3945, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.02% (0.2793 => 0.3017, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.87% (0.2872 => 0.3098, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 7.80% (0.3283 => 0.3539, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 7.74% (0.3282 => 0.3536, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 7.74% (0.2831 => 0.3050, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.68% (0.2891 => 0.3113, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 7.67% (0.3232 => 0.3480, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.59% (0.3162 => 0.3402, std.dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 7.54% (0.2905 => 0.3124, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.40% (2.0665 => 2.2194, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 7.38% (0.2871 => 0.3083, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.29% (0.2756 => 0.2957, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.23% (0.2877 => 0.3085, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.19% (0.2725 => 0.2921, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/wc: 7.14% (0.3052 => 0.3270, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.01% (1.2842 => 1.3742, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.99% (0.8067 => 0.8631, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/random: 6.92% (0.2802 => 0.2996, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.85% (0.2714 => 0.2900, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 6.45% (0.3379 => 0.3597, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 5.91% (0.2049 => 0.2170, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.74% (0.3136 => 0.3316, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.54% (7.9617 => 8.4025, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.46% (0.3131 => 0.3302, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.22% (0.3935 => 0.4101, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.88% (7.0540 => 7.2571, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.67% (0.3817 => 0.3919, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.11% (1.1145 => 1.3721, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 11.09% (0.9957 => 1.1061, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/richards_benchmark: 9.95% (1.1396 => 1.2530, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.95% (2.8904 => 3.0912, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3682, std.dev.: 0.0013) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: 4.51% (3.3453 => 3.4961) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 2.98% (1.9405 => 1.9983, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.66% (4.2280 => 4.3406, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 2.45% (4.4649 => 4.5742, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/bisort/bisort: 1.82% (0.8333 => 0.8485, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.53% (9.1159 => 9.2556, std.dev.: 0.0227) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2076, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.30% (11.6436 => 11.7955, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5750, std.dev.: 0.0071) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -76.66% (0.8651 => 0.2019, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.10% (5.3855 => 2.4183, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -54.84% (5.3526 => 2.4170, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/richards_benchmark: -45.01% (0.1622 => 0.0892, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.31% (1.1194 => 0.6794, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.98% (5.2763 => 3.2195, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -23.47% (1.7609 => 1.3477, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -17.27% (2.9384 => 2.4308, std.dev.: 0.0064) SingleSource/UnitTests/Vector/constpool: -9.03% (54.1659 => 49.2747, std.dev.: 0.0310) MultiSource/Applications/JM/ldecod/ldecod: -8.09% (10.4361 => 9.5916, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -7.22% (10.3673 => 9.6188, std.dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -54.02% (8.0499 => 3.7010, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0133, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.59% (1.1492 => 0.7632, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.61% (0.0506 => 0.0341) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.38% (0.3987 => 0.2696, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.50% (2.9695 => 2.3607, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -19.01% (1.2258 => 0.9928, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.98% (1.6925 => 1.4220, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852) SingleSource/Benchmarks/McGill/chomp: -11.48% (1.2373 => 1.0952, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel-2: -10.99% (1.5373 => 1.3683, std.dev.: 0.0026) MultiSource/Benchmarks/NPB-serial/is/is: -10.97% (9.5636 => 8.5143, std.dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.23% (19.9488 => 18.3071, std.dev.: 0.0524) MultiSource/Benchmarks/FreeBench/mason/mason: -8.01% (0.2161 => 0.1988, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4781, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.98% (1.8329 => 1.7050, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: -5.46% (6.6465 => 6.2837, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.07% (1.6805 => 1.5953, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.89% (0.2497 => 0.2375, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.71% (1.5835 => 1.5089, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.90% (8.1563 => 7.8384, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.65% (3.2827 => 3.1629, std.dev.: 0.0178) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.46% (32.5116 => 31.3864, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: -3.33% (5.0483 => 4.8802, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -2.88% (4.6441 => 4.5102, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.78% (4.5009 => 4.3756, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.43% (0.4808 => 0.4691, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/multiplies: -2.00% (2.5528 => 2.5017, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -1.84% (10.2830 => 10.0942, std.dev.: 0.0230) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6823, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -1.28% (85.0658 => 83.9768, std.dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.18% (1.7254 => 1.7051, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2352, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/power/power: -1.01% (1.1277 => 1.1163) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.45% (7.1582 => 7.8347, std.dev.: 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: 10632.08% (0.0720 => 7.7271, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 1.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 17:10:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 19:10:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121028001041.B488E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5313?compare_to=5310&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5313, Order: 166892, Start Time: 2012-10-27 22:45:14, End Time: 2012-10-28 00:10:38 To: 5310, Order: 166891, Start Time: 2012-10-27 20:57:10, End Time: 2012-10-27 22:22:21 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (178 on baseline) Unchanged Tests: 1042 (859 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.18% (15.2527 => 18.3301, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.63% (2.0478 => 2.1016, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/salsa20: 2.45% (7.4937 => 7.6776, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash2: 2.29% (3.1932 => 3.2664, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.53% (0.1431 => 0.1309, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.08% (0.1584 => 0.1456, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.43% (0.3821 => 0.3537, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -6.75% (2.4924 => 2.3241, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/exceptions-2: -6.73% (0.3831 => 0.3573, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -6.73% (0.3880 => 0.3619, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.67% (0.2428 => 0.2266, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.65% (0.3896 => 0.3637, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.64% (0.3884 => 0.3626, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -6.63% (0.3848 => 0.3593, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.62% (0.3142 => 0.2934, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.60% (0.3891 => 0.3634, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -6.58% (0.3812 => 0.3561, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.56% (0.3658 => 0.3418, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/for-in: -6.55% (0.4033 => 0.3769, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -6.54% (0.4176 => 0.3903, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.46% (22.4056 => 20.9588, std.dev.: 0.0196) SingleSource/UnitTests/ObjC/property: -6.38% (0.4199 => 0.3931, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: -6.21% (0.4280 => 0.4014, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: -6.17% (0.2659 => 0.2495, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.14% (4.5069 => 4.2303, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.12% (5.4682 => 5.1338, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.03% (0.6484 => 0.6093, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: -5.97% (4.3330 => 4.0745, std.dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: -5.96% (0.3357 => 0.3157, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.94% (0.1716 => 0.1614, std.dev.: 0.0009) MultiSource/Applications/siod/siod: -5.94% (2.4021 => 2.2594, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.94% (0.9852 => 0.9267, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -5.93% (1.2515 => 1.1773, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: -5.92% (7.0961 => 6.6759, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/ReedSolomon: -5.91% (0.1879 => 0.1768, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.86% (3.5339 => 3.3267, std.dev.: 0.0130) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.86% (0.2355 => 0.2217, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: -5.79% (0.2160 => 0.2035, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.76% (4.8161 => 4.5388, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.76% (0.4151 => 0.3912, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.75% (0.9542 => 0.8993, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: -5.75% (16.1920 => 15.2610, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.73% (0.3837 => 0.3617, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.71% (4.8802 => 4.6016, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.71% (0.7919 => 0.7467, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: -5.69% (1.3148 => 1.2400, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.69% (1.6474 => 1.5537, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: -5.65% (0.3026 => 0.2855, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.64% (1.0544 => 0.9949, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: -5.61% (0.2871 => 0.2710, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.58% (0.4083 => 0.3855, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.56% (0.8521 => 0.8047, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.56% (0.3057 => 0.2887, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.55% (0.5999 => 0.5666, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.54% (1.2210 => 1.1534, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.53% (0.2548 => 0.2407, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -5.53% (0.2985 => 0.2820, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: -5.51% (18.2933 => 17.2861, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/strcat: -5.49% (0.2989 => 0.2825, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.48% (0.3849 => 0.3638, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -5.48% (0.2939 => 0.2778, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.48% (0.2903 => 0.2744, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.47% (1.2784 => 1.2085, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary2: -5.46% (0.3481 => 0.3291, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.46% (4.0323 => 3.8123, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary3: -5.46% (0.3446 => 0.3258, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -5.45% (4.0594 => 3.8381, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/hello: -5.44% (0.2849 => 0.2694, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -5.43% (34.0927 => 32.2422, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.42% (0.7198 => 0.6808, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.41% (0.3252 => 0.3076, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: -5.40% (0.7982 => 0.7551, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wc: -5.40% (0.3205 => 0.3032, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -5.39% (0.6750 => 0.6386, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.39% (0.4321 => 0.4088, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -5.39% (0.3025 => 0.2862, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -5.38% (0.3255 => 0.3080, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -5.36% (0.3394 => 0.3212, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash2: -5.35% (0.4861 => 0.4601, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.33% (2.1713 => 2.0555, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.31% (0.2278 => 0.2157, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: -5.30% (0.3059 => 0.2897, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.27% (1.6364 => 1.5502, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -5.25% (0.3621 => 0.3431, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.24% (0.3016 => 0.2858, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.24% (0.2999 => 0.2842, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -5.23% (0.3194 => 0.3027, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -5.23% (0.3788 => 0.3590, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.21% (1.2221 => 1.1584, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.20% (0.4427 => 0.4197, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.18% (2.2587 => 2.1416, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.15% (0.4813 => 0.4565, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: -5.15% (0.4524 => 0.4291, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.12% (0.6293 => 0.5971, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.11% (1.4642 => 1.3894, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.10% (0.3491 => 0.3313, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -5.07% (0.3867 => 0.3671, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -5.02% (9.2283 => 8.7649, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.01% (1.3722 => 1.3035, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: -4.94% (0.4248 => 0.4038, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.94% (0.2106 => 0.2002, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.88% (0.3323 => 0.3161, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: -4.86% (0.3581 => 0.3407, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.86% (0.3931 => 0.3740, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.82% (0.4916 => 0.4679, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.74% (0.2933 => 0.2794, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.67% (0.5805 => 0.5534, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: -4.66% (0.6347 => 0.6051, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -4.66% (0.6441 => 0.6141, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.63% (0.5859 => 0.5588, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.61% (0.3319 => 0.3166, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.61% (0.6660 => 0.6353, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.58% (0.6676 => 0.6370, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.58% (0.9557 => 0.9119, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.58% (0.5478 => 0.5227, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.58% (0.5591 => 0.5335, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: -4.54% (0.4515 => 0.4310, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -4.53% (1.1450 => 1.0931, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.51% (0.6304 => 0.6020, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: -4.50% (0.8418 => 0.8039, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.50% (0.5802 => 0.5541, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.49% (0.6230 => 0.5950, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.49% (0.5857 => 0.5594, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.49% (0.6681 => 0.6381, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.49% (0.2385 => 0.2278, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.47% (0.5863 => 0.5601, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: -4.46% (0.3271 => 0.3125, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.46% (0.5581 => 0.5332, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.45% (0.6667 => 0.6370, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.44% (0.6052 => 0.5783, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.43% (0.5575 => 0.5328, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.42% (0.5705 => 0.5453, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.42% (0.5456 => 0.5215, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: -4.41% (0.9179 => 0.8774, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.40% (0.6297 => 0.6020, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.39% (0.7524 => 0.7194, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: -4.38% (15.5079 => 14.8284, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.38% (0.5570 => 0.5326, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.38% (0.6189 => 0.5918, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -4.38% (0.7447 => 0.7121, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.38% (0.6260 => 0.5986, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.36% (0.6440 => 0.6159, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.36% (0.6194 => 0.5924, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.35% (0.5569 => 0.5327, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: -4.35% (0.3406 => 0.3258, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.34% (0.5941 => 0.5683, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.34% (0.5925 => 0.5668, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.32% (0.7339 => 0.7022, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.32% (0.6395 => 0.6119, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.28% (0.6395 => 0.6121, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.28% (0.6736 => 0.6448, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.27% (0.5688 => 0.5445, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -4.27% (0.7779 => 0.7447, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.26% (0.5567 => 0.5330, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.19% (8.0126 => 7.6765, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.18% (0.6033 => 0.5781, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.17% (0.5849 => 0.5605, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.16% (6.7716 => 6.4898, std.dev.: 0.0059) MultiSource/Applications/treecc/treecc: -4.16% (2.1401 => 2.0511, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.13% (0.6446 => 0.6180, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.08% (0.3483 => 0.3341, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.99% (0.9077 => 0.8715, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.92% (0.7021 => 0.6746, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -3.89% (17.1032 => 16.4387, std.dev.: 0.0112) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.82% (1.2300 => 1.1830, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: -3.81% (5.0226 => 4.8311, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: -3.64% (3.5154 => 3.3875, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.64% (0.5168 => 0.4980, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: -3.61% (1.5610 => 1.5046, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.58% (0.5329 => 0.5138, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: -3.33% (1.1530 => 1.1146, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.23% (14.2083 => 13.7492, std.dev.: 0.0132) SingleSource/UnitTests/Vector/constpool: -2.26% (20.7746 => 20.3055, std.dev.: 0.0406) MultiSource/Applications/SIBsim4/SIBsim4: -1.66% (1.3864 => 1.3634, std.dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7509, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/richards_benchmark: -8.74% (1.2842 => 1.1719, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.82% (2.2633 => 2.1768, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.01% (1.0557 => 1.0239, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.57% (1.3096 => 1.2760, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.63% (6.5735 => 6.4663, std.dev.: 0.0039) Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 17:24:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 19:24:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121028002456.E51FA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5314?compare_to=5306&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5314, Order: 166891, Start Time: 2012-10-27 21:07:41, End Time: 2012-10-28 00:24:54 To: 5306, Order: 166877, Start Time: 2012-10-27 17:03:10, End Time: 2012-10-27 20:19:15 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (173 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1039 (716 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 7.23% (0.2088 => 0.2239, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.35% (126.0965 => 131.5813, std.dev.: 0.1520) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.09% (0.3788 => 0.3905, std.dev.: 0.0016) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.28% (0.0625 => 0.0883, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.46% (0.1063 => 0.1408, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.73% (0.2969 => 0.3733, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.50% (0.1106 => 0.1388, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.37% (0.4253 => 0.5332, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 24.97% (1.5932 => 1.9911, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 24.68% (0.0547 => 0.0682, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.23% (0.4139 => 0.5142, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.69% (0.4994 => 0.6177, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.67% (0.0714 => 0.0883, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.58% (0.5900 => 0.7291, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.95% (0.0475 => 0.0584, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.84% (0.5000 => 0.6142, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.65% (0.1620 => 0.1987, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.60% (0.0584 => 0.0716, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.85% (0.0897 => 0.1093, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.74% (0.1021 => 0.1243, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.50% (0.1107 => 0.1345, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/tsp/tsp: 21.37% (0.0599 => 0.0727, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.57% (0.3903 => 0.4706, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 20.57% (0.0948 => 0.1143, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.40% (0.1103 => 0.1328, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.38% (0.0633 => 0.0762, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.38% (0.0584 => 0.0703, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.15% (0.0541 => 0.0650, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.09% (0.0642 => 0.0771, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 19.87% (0.0604 => 0.0724, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 19.83% (0.1619 => 0.1940, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.82% (0.1549 => 0.1856, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.76% (0.1604 => 0.1921, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.74% (0.1003 => 0.1201, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: 19.61% (0.0821 => 0.0982, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.46% (0.0822 => 0.0982, std.dev.: 0.0027) MultiSource/Applications/viterbi/viterbi: 19.43% (0.0947 => 0.1131, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.68% (0.2736 => 0.3247, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.67% (0.2014 => 0.2390, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.60% (0.1462 => 0.1734, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 18.44% (0.0808 => 0.0957) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.10% (0.3890 => 0.4594, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 18.04% (0.5826 => 0.6877, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 17.90% (0.1218 => 0.1436, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.78% (1.3152 => 1.5490, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/mst/mst: 17.77% (0.0698 => 0.0822, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 17.74% (0.1505 => 0.1772, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.56% (0.1088 => 0.1279, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 17.47% (0.4029 => 0.4733, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: 17.41% (0.5889 => 0.6914, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 17.35% (0.9697 => 1.1379, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: 17.08% (0.5546 => 0.6493, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.06% (0.2866 => 0.3355, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 16.98% (1.8794 => 2.1986, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.88% (3.5627 => 4.1640, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 16.86% (0.0605 => 0.0707, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.72% (0.1160 => 0.1354, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.54% (1.6211 => 1.8892, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.51% (0.1968 => 0.2293, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 16.46% (0.7171 => 0.8351, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.42% (0.4658 => 0.5423, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: 16.20% (0.1284 => 0.1492, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.20% (0.5026 => 0.5840, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/18-imp/imp: 16.12% (0.1421 => 0.1650, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.10% (0.2875 => 0.3338, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.05% (0.3271 => 0.3796, std.dev.: 0.0023) MultiSource/Applications/d/make_dparser: 16.04% (1.0781 => 1.2510, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.71% (0.4361 => 0.5046, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 15.67% (4.2109 => 4.8709, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/fibo: 15.67% (0.2725 => 0.3152, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.52% (0.3930 => 0.4540, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.44% (4.4195 => 5.1020, std.dev.: 0.0084) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.44% (2.7292 => 3.1506, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 15.42% (0.2075 => 0.2395, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.41% (0.2738 => 0.3160, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 15.40% (0.2714 => 0.3132, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 15.35% (0.3004 => 0.3465, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.32% (0.2729 => 0.3147, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 15.24% (0.2750 => 0.3169, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 15.22% (0.2780 => 0.3203, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/methcall: 15.22% (0.2813 => 0.3241, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.15% (0.3195 => 0.3679, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.14% (0.1090 => 0.1255, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 15.09% (0.2803 => 0.3226, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 15.09% (0.2823 => 0.3249, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 15.08% (0.3096 => 0.3563, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 15.08% (0.2811 => 0.3235, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 15.08% (0.9909 => 1.1403, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.06% (1.9694 => 2.2659, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.01% (0.2911 => 0.3348, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.01% (0.2792 => 0.3211, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.99% (1.9966 => 2.2958, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.97% (2.0673 => 2.3767, std.dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 14.93% (0.2566 => 0.2949, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 14.50% (0.3317 => 0.3798, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 14.48% (0.3267 => 0.3740, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 14.40% (0.3258 => 0.3727, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.28% (0.3060 => 0.3497, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.19% (0.3362 => 0.3839, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 14.13% (23.5202 => 26.8443, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.11% (0.3282 => 0.3745, std.dev.: 0.0014) MultiSource/Applications/lua/lua: 14.03% (1.4269 => 1.6271, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.92% (0.3124 => 0.3559, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 13.89% (0.3348 => 0.3813, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 13.76% (0.3678 => 0.4184, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/lists1: 13.75% (0.3477 => 0.3955, std.dev.: 0.0059) MultiSource/Applications/treecc/treecc: 13.49% (0.7875 => 0.8937, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sieve: 13.47% (0.3726 => 0.4228, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: 13.39% (0.4146 => 0.4701, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 13.38% (0.3460 => 0.3923, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 13.31% (0.4251 => 0.4817, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 13.30% (2.1653 => 2.4533, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.30% (0.3625 => 0.4107, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.28% (0.3690 => 0.4180, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 13.22% (0.3496 => 0.3958, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.21% (0.3981 => 0.4507, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 13.09% (0.3446 => 0.3897, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.07% (0.3465 => 0.3918, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.04% (0.3488 => 0.3943, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 12.96% (2.1013 => 2.3736, std.dev.: 0.0136) SingleSource/UnitTests/ObjC/trivial-interface: 12.96% (0.3442 => 0.3888, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 12.95% (4.6177 => 5.2158, std.dev.: 0.0099) SingleSource/UnitTests/ObjC/synchronized: 12.94% (0.3469 => 0.3918, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.94% (0.2040 => 0.2304, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.90% (0.3845 => 0.4341, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 12.77% (0.3650 => 0.4116, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 12.73% (0.5012 => 0.5650, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions: 12.57% (0.3643 => 0.4101, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 12.51% (0.3724 => 0.4190, std.dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: 12.08% (0.2691 => 0.3016, std.dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 11.82% (5.5417 => 6.1970, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.27% (0.6435 => 0.7160, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.19% (0.1028 => 0.1143, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.06% (0.1383 => 0.1536, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 10.90% (0.6634 => 0.7357, std.dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: 10.83% (0.3498 => 0.3877, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.56% (0.2737 => 0.3026, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.49% (0.2068 => 0.2285, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 10.30% (0.4847 => 0.5346, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 10.16% (0.3336 => 0.3675, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.95% (0.3084 => 0.3391, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 9.71% (2.0346 => 2.2321, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.51% (0.2103 => 0.2303, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 9.49% (0.2391 => 0.2618, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.88% (11.6398 => 12.6732, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.82% (4.6926 => 5.1063, std.dev.: 0.0163) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.24% (0.5361 => 0.5803, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.04% (0.5584 => 0.6033, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.47% (0.7426 => 0.7981, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 6.37% (11.9555 => 12.7176, std.dev.: 0.0192) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.72% (0.3792 => 0.3933, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6535, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0300, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 10.46% (0.2802 => 0.3095, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6113, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.74% (0.3693 => 0.3905, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 5.51% (0.2122 => 0.2239, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/objinst: 5.03% (12.0509 => 12.6575, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 4.73% (15.4430 => 16.1740, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-2: 4.00% (1.8057 => 1.8779, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/dry: 2.78% (14.0481 => 14.4391, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1979, std.dev.: 0.0039) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.85% (3.1722 => 3.2310, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.69% (2.0820 => 2.1172, std.dev.: 0.0071) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3003, std.dev.: 0.0131) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2882, std.dev.: 0.0055) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.25% (1.0142 => 1.0269, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1062, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5134, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5402, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5985, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 1.03% (28.0362 => 28.3260, std.dev.: 0.0604) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.29% (2.4764 => 2.4198, std.dev.: 0.0145) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.52% (25.4195 => 16.3904, std.dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9780, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: -7.67% (35.5013 => 32.7782, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: -5.91% (0.2402 => 0.2260, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.42% (11.2080 => 10.8247, std.dev.: 0.0511) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7754, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5217, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.48% (17.2379 => 16.8111, std.dev.: 0.0125) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.20% (41.7953 => 40.8742, std.dev.: 0.0089) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5748, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.64% (0.6293 => 0.6190, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: -1.55% (5.5810 => 5.4944, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0418, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.05% (21.9346 => 21.7037, std.dev.: 0.0621) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.05% (3.3991 => 3.3634, std.dev.: 0.0005) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 18:16:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 20:16:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121028011616.1CA402A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5315?compare_to=5312&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5315, Order: 166892, Start Time: 2012-10-27 23:44:43, End Time: 2012-10-28 01:16:13 To: 5312, Order: 166891, Start Time: 2012-10-27 21:43:52, End Time: 2012-10-27 23:15:10 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (10 on baseline) New Passes: 0 (14 on baseline) Performance Regressions: 1 (188 on baseline) Performance Improvements: 1 (53 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 15 (5 on baseline) Unchanged Tests: 1025 (638 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.23% (9.6188 => 9.7375, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -3.94% (0.4260 => 0.4092, std.dev.: 0.0062) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -0.91% (2.0845 => 2.0656, std.dev.: 0.0038) MultiSource/Benchmarks/Bullet/bullet: -0.23% (58.1806 => 58.0493, std.dev.: 0.0356) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.38% (0.0799 => 0.0796, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -0.28% (9.2533 => 9.2274, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.26% (7.8347 => 7.8140, std.dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_shift: -0.37% (0.0536 => 0.0534, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/JM/lencod/lencod: -0.05% (7.7271 => 7.7234, std.dev.: 0.0036) MultiSource/Applications/oggenc/oggenc: - (0.0001 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0648 => 0.0648, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.07% (0.2990 => 0.2992, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_shift: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -64.13% (5.7591 => 2.0656, std.dev.: 0.0038) MultiSource/Benchmarks/Bullet/bullet: -8.21% (63.2438 => 58.0493, std.dev.: 0.0356) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.81% (6.6874 => 0.0796, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.41% (8.1363 => 9.2274, std.dev.: 0.0024) SingleSource/UnitTests/Vector/SSE/sse_shift: 41.27% (0.0378 => 0.0534, std.dev.: 0.0001) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -50.00% (0.0002 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -57.02% (0.6962 => 0.2992, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_shift: -50.00% (0.0002 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 211.72% (0.5229 => 1.6300, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 17.70% (14.9895 => 17.6425, std.dev.: 0.0108) MultiSource/Applications/kimwitu++/kc: 37.48% (14.1553 => 19.4609, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 13.60% (4.1105 => 4.6697, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 32.87% (1.1048 => 1.4679, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 69.37% (3.4629 => 5.8651, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/stepanov_container: 68.79% (0.6222 => 1.0502, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 3836100.00% (0.0001 => 3.8362, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 11142500.00% (0.0001 => 11.1426, std.dev.: 0.0334) MultiSource/Applications/kimwitu++/kc: 50300.00% (0.0001 => 0.0504, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049600.00% (0.0001 => 10.0497, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5494100.00% (0.0001 => 5.4942, std.dev.: 0.0033) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 77.70% (0.0296 => 0.0526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 69.14% (0.0256 => 0.0433, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 60.52% (0.0271 => 0.0435, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 52.67% (0.0243 => 0.0371) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 44.03% (1.5859 => 2.2841, std.dev.: 0.0188) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.97% (0.0834 => 0.1184, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 40.72% (0.1056 => 0.1486, std.dev.: 0.0000) SingleSource/UnitTests/vla: 35.21% (0.0355 => 0.0480, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 35.06% (2.2024 => 2.9745, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/neural/neural: 33.70% (0.1463 => 0.1956, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 29.33% (0.1432 => 0.1852, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 27.55% (0.1655 => 0.2111, std.dev.: 0.0002) MultiSource/Benchmarks/llubenchmark/llu: 23.81% (0.0462 => 0.0572, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/rem: 22.12% (0.1144 => 0.1397) SingleSource/Benchmarks/Shootout/hash: 21.86% (0.0485 => 0.0591, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.52% (0.1566 => 0.1903, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.33% (0.5105 => 0.6194, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.67% (0.0871 => 0.1051, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 20.58% (0.1555 => 0.1875, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 19.48% (0.6675 => 0.7975, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 18.90% (1.3050 => 1.5517, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 18.80% (3.3354 => 3.9626, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 18.80% (0.2271 => 0.2698, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.78% (0.5020 => 0.5963, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 18.36% (0.0746 => 0.0883, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 18.36% (0.0730 => 0.0864, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 18.36% (0.7115 => 0.8421, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 18.13% (0.1175 => 0.1388, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 17.97% (0.2554 => 0.3013, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.65% (0.1337 => 0.1573, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 17.56% (0.1236 => 0.1453, std.dev.: 0.0048) MultiSource/Benchmarks/nbench/nbench: 17.49% (1.1840 => 1.3911, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.49% (1.5415 => 1.8111, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 17.49% (0.1584 => 0.1861, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.44% (0.1032 => 0.1212, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.42% (0.1510 => 0.1773, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 17.25% (0.0626 => 0.0734) MultiSource/Benchmarks/Olden/em3d/em3d: 17.23% (0.1695 => 0.1987, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 17.11% (0.1163 => 0.1362, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.10% (0.4615 => 0.5404, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 16.83% (0.4879 => 0.5700, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 16.78% (0.3177 => 0.3710, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.65% (0.0793 => 0.0925, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.57% (0.6450 => 0.7519, std.dev.: 0.0087) MultiSource/Applications/sgefa/sgefa: 16.56% (0.3109 => 0.3624, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 16.56% (0.2603 => 0.3034, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.48% (0.8172 => 0.9519, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/ft/ft: 16.39% (0.1940 => 0.2258, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 16.30% (22.1758 => 25.7895, std.dev.: 0.0165) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.14% (0.0886 => 0.1029) MultiSource/Applications/aha/aha: 15.99% (0.1151 => 0.1335, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.85% (0.0675 => 0.0782, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.80% (0.3121 => 0.3614, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 15.79% (0.1906 => 0.2207, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.68% (0.0842 => 0.0974, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/exptree: 15.48% (0.0814 => 0.0940, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 15.46% (1.0722 => 1.2380, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.38% (0.9765 => 1.1267, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 15.34% (0.1695 => 0.1955, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 15.25% (2.0273 => 2.3364, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.22% (0.1117 => 0.1287, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 15.20% (1.1642 => 1.3412, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 15.17% (0.8921 => 1.0274, std.dev.: 0.0106) MultiSource/Applications/spiff/spiff: 14.88% (0.7835 => 0.9001, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 14.88% (0.0672 => 0.0772, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.87% (0.2758 => 0.3168, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.81% (0.2107 => 0.2419, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.78% (0.2700 => 0.3099, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.76% (0.1125 => 0.1291, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.75% (1.1861 => 1.3610, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 14.59% (1.4186 => 1.6256, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.59% (0.5860 => 0.6715, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 14.58% (0.3423 => 0.3922, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.55% (0.0770 => 0.0882, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.50% (0.1062 => 0.1216, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.49% (0.0759 => 0.0869, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.26% (0.5981 => 0.6834, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.26% (0.0933 => 0.1066, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.22% (0.1625 => 0.1856, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.21% (0.1330 => 0.1519, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 14.12% (0.4299 => 0.4906, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.12% (4.2646 => 4.8666, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.09% (0.2065 => 0.2356, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 14.08% (3.8723 => 4.4175, std.dev.: 0.0083) SingleSource/Benchmarks/CoyoteBench/lpbench: 13.99% (0.0929 => 0.1059, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 13.97% (0.3387 => 0.3860, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 13.95% (0.7433 => 0.8470, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.91% (0.3307 => 0.3767, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.80% (0.1029 => 0.1171, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.66% (0.0798 => 0.0907, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 13.47% (9.4845 => 10.7621, std.dev.: 0.0087) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.30% (0.1143 => 0.1295, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.22% (0.5569 => 0.6305, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/health/health: 12.93% (0.1268 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.76% (0.3441 => 0.3880, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.70% (0.3826 => 0.4312, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 12.65% (0.0838 => 0.0944, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 12.61% (0.3092 => 0.3482, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.10% (0.1892 => 0.2121, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 11.95% (0.3180 => 0.3560, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 11.94% (0.4289 => 0.4801, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 11.47% (2.2969 => 2.5603, std.dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 11.44% (0.0953 => 0.1062, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 11.36% (0.4620 => 0.5145, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.28% (0.8101 => 0.9015, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.27% (14.3668 => 15.9859, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/bigfib: 11.20% (0.6456 => 0.7179, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.09% (4.9449 => 5.4935, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 10.93% (5.0018 => 5.5486, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: 10.77% (17.1811 => 19.0309, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.57% (2.2022 => 2.4350, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.50% (0.3427 => 0.3787, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.44% (0.1044 => 0.1153, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.18% (0.4203 => 0.4631, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.14% (0.4636 => 0.5106, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/lists: 10.11% (0.3422 => 0.3768, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.01% (0.3865 => 0.4252, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 9.93% (0.3927 => 0.4317, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.88% (0.3543 => 0.3893, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 9.80% (0.3828 => 0.4203, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.76% (0.3473 => 0.3812, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 9.72% (0.3684 => 0.4042, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 9.71% (0.3543 => 0.3887, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.66% (0.3694 => 0.4051, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.64% (0.3516 => 0.3855, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.64% (0.3497 => 0.3834, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.63% (0.3561 => 0.3904, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 9.51% (0.4048 => 0.4433, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 9.44% (0.3886 => 0.4253, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 9.40% (1.5603 => 1.7070, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.26% (0.4103 => 0.4483, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.18% (3.8922 => 4.2496, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.18% (0.2266 => 0.2474, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 8.99% (0.3603 => 0.3927, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.89% (0.2430 => 0.2646, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.57% (0.6030 => 0.6547, std.dev.: 0.0078) SingleSource/UnitTests/ObjC++/Hello: 8.56% (0.5925 => 0.6432, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.49% (0.7326 => 0.7948, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.39% (0.4064 => 0.4405, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 7.81% (0.3098 => 0.3340, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.73% (0.3650 => 0.3932, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.63% (0.2793 => 0.3006, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.49% (0.2831 => 0.3043, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.49% (0.2872 => 0.3087, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 7.46% (0.3283 => 0.3528, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.33% (0.2891 => 0.3103, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.27% (0.3232 => 0.3467, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.24% (0.3162 => 0.3391, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 7.19% (0.3282 => 0.3518, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.14% (0.8067 => 0.8643, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.11% (0.2756 => 0.2952, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.09% (2.0665 => 2.2131, std.dev.: 0.0099) SingleSource/Regression/C++/ofstream_ctor: 7.09% (0.2905 => 0.3111, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.97% (0.2871 => 0.3071, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 6.92% (0.2877 => 0.3076, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 6.78% (0.3052 => 0.3259, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.75% (0.2725 => 0.2909, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 6.74% (1.2842 => 1.3708, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 6.56% (0.2714 => 0.2892, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 6.53% (0.2802 => 0.2985, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 6.24% (0.3379 => 0.3590, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 5.66% (0.2049 => 0.2165, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.42% (0.3136 => 0.3306, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.16% (7.9617 => 8.3729, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/objinst: 5.05% (0.3131 => 0.3289, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.94% (0.3935 => 0.4090, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.72% (7.0540 => 7.2459, std.dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.10% (1.1145 => 1.3719, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 10.24% (0.9957 => 1.0977, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/richards_benchmark: 9.75% (1.1396 => 1.2507, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.94% (2.8904 => 3.0911, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.1578 => 3.3687, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626) SingleSource/Benchmarks/Misc/fp-convert: 4.50% (3.3453 => 3.4960, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 2.98% (1.9405 => 1.9983, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.56% (4.2280 => 4.3362, std.dev.: 0.0075) MultiSource/Applications/viterbi/viterbi: 2.46% (4.4649 => 4.5747, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.32% (1.0313 => 1.0552, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bisort/bisort: 1.80% (0.8333 => 0.8483, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2076, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 1.45% (3.8532 => 3.9092, std.dev.: 0.0042) MultiSource/Applications/minisat/minisat: 1.40% (9.1159 => 9.2439, std.dev.: 0.0424) MultiSource/Benchmarks/nbench/nbench: 1.30% (11.6436 => 11.7950, std.dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -76.94% (0.8651 => 0.1995, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.12% (5.3855 => 2.4168, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -54.80% (5.3526 => 2.4194, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: -45.25% (0.1622 => 0.0888, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.32% (1.1194 => 0.6793, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.21% (5.2763 => 3.2076, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -23.48% (1.7609 => 1.3475, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -17.43% (2.9384 => 2.4263, std.dev.: 0.0057) SingleSource/UnitTests/Vector/constpool: -9.22% (54.1659 => 49.1712, std.dev.: 0.0533) MultiSource/Applications/JM/ldecod/ldecod: -8.25% (10.4361 => 9.5746, std.dev.: 0.0050) MultiSource/Benchmarks/PAQ8p/paq8p: -6.07% (10.3673 => 9.7375, std.dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -54.03% (8.0499 => 3.7002, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0134) SingleSource/Benchmarks/Misc/mandel: -33.46% (1.1492 => 0.7647, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.61% (0.0506 => 0.0341) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.38% (0.3987 => 0.2696, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.51% (2.9695 => 2.3604, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -19.00% (1.2258 => 0.9929, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.98% (1.6925 => 1.4220, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -11.67% (1.2373 => 1.0929, std.dev.: 0.0089) MultiSource/Benchmarks/NPB-serial/is/is: -10.97% (9.5636 => 8.5142, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/mandel-2: -10.89% (1.5373 => 1.3699, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.35% (19.9488 => 18.2830, std.dev.: 0.0156) MultiSource/Benchmarks/FreeBench/mason/mason: -7.73% (0.2161 => 0.1994, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.16% (1.8329 => 1.7016, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4781, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -5.45% (6.6465 => 6.2841, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.14% (1.6805 => 1.5942, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.89% (0.2497 => 0.2375, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5085, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.93% (8.1563 => 7.8359, std.dev.: 0.0053) MultiSource/Applications/siod/siod: -3.74% (3.2827 => 3.1599, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.50% (32.5116 => 31.3728, std.dev.: 0.0049) MultiSource/Benchmarks/sim/sim: -3.33% (5.0483 => 4.8802, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: -2.93% (4.6441 => 4.5080, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.87% (4.5009 => 4.3718, std.dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.70% (0.4808 => 0.4678, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/multiplies: -2.00% (2.5528 => 2.5018, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0868, std.dev.: 0.0175) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6830, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: -1.28% (85.0658 => 83.9739, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.18% (1.7254 => 1.7051, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: -1.01% (1.1277 => 1.1163, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.16% (7.1582 => 7.8140, std.dev.: 0.0033) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: 10626.94% (0.0720 => 7.7234, std.dev.: 0.0036) MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 2.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 18:34:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 20:34:12 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121028013412.A3F2D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5316?compare_to=5311&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5316, Order: 166893, Start Time: 2012-10-28 00:05:21, End Time: 2012-10-28 01:34:10 To: 5311, Order: 166892, Start Time: 2012-10-27 21:49:59, End Time: 2012-10-27 23:13:46 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 6 (108 on baseline) Performance Improvements: 1 (5 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 968 (861 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/McGill/chomp: 7.74% (0.1524 => 0.1642, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.51% (0.2285 => 0.2388, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.04% (0.6165 => 0.6414, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.12% (0.5953 => 0.6139, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 8.70% (3.8326 => 4.1659, std.dev.: 0.0808) SingleSource/Benchmarks/Misc/ReedSolomon: 1.04% (8.7006 => 8.7913, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.45% (1.2550 => 1.2242, std.dev.: 0.0046) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -1.46% (16.8706 => 16.6244, std.dev.: 0.2614) MultiSource/Applications/obsequi/Obsequi: 0.68% (1.0663 => 1.0735, std.dev.: 0.0207) MultiSource/Applications/sqlite3/sqlite3: 0.60% (0.6476 => 0.6515, std.dev.: 0.0060) MultiSource/Benchmarks/McCat/08-main/main: 0.15% (0.1961 => 0.1964, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.71% (0.1673 => 0.1611, std.dev.: 0.0062) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.25% (0.3251 => 0.3243, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.97% (0.2442 => 0.2490, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.23% (0.3323 => 0.3397, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.50% (0.2393 => 0.2429, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 0.18% (0.6049 => 0.6060, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel: 11.69% (0.0445 => 0.0497, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.18% (0.3362 => 0.3368, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: -1.18% (0.2027 => 0.2003, std.dev.: 0.0021) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -2.02% (0.0247 => 0.0242, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 46.67% (0.0150 => 0.0220, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 13.79% (0.0377 => 0.0429, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.59% (0.0252 => 0.0248, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.62% (0.0305 => 0.0313, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.91% (0.0385 => 0.0427, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 69.17% (0.0120 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -18.52% (0.0189 => 0.0154, std.dev.: 0.0031) SingleSource/UnitTests/byval-alignment: -1.76% (0.0341 => 0.0335, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 550.00% (0.0002 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.69% (0.1445 => 0.1435, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -4.22% (1.1413 => 1.0931, std.dev.: 0.0144) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 0.20% (0.1497 => 0.1500, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.29% (0.4080 => 0.4092, std.dev.: 0.0159) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.49% (0.1339 => 0.1319, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.02% (0.0609 => 0.0670, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 17.87% (0.0235 => 0.0277) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.62% (0.0608 => 0.0586, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.30% (1.1483 => 1.1448, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0019 => 0.0019, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.74% (0.0583 => 0.0567, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 16.23% (0.0228 => 0.0265, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.79% (0.8008 => 0.7945, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 500.00% (0.0001 => 0.0006, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -100.00% (0.0001 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -28.30% (0.0053 => 0.0038, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.57% (2.1832 => 1.6686, std.dev.: 0.0158) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 36.59% (14.7684 => 20.1720, std.dev.: 0.2110) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.02% (0.0810 => 0.0956, std.dev.: 0.0017) SingleSource/UnitTests/SignlessTypes/rem: 14.11% (0.1035 => 0.1181, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/tsp/tsp: 13.04% (0.1112 => 0.1257, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.65% (0.0830 => 0.0935, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.91% (0.0848 => 0.0949, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.54% (0.2180 => 0.2388, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.26% (0.1425 => 0.1557, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 7.80% (0.1577 => 0.1700, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.78% (0.3137 => 0.3381, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.68% (0.8321 => 0.8960, std.dev.: 0.0153) MultiSource/Applications/SIBsim4/SIBsim4: 7.65% (1.2568 => 1.3529, std.dev.: 0.0107) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.31% (0.1983 => 0.2128, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.72% (0.6010 => 0.6414, std.dev.: 0.0081) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.53% (0.1885 => 0.2008, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.36% (0.2279 => 0.2424, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.19% (0.1905 => 0.2023, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.08% (6.6074 => 7.0091, std.dev.: 0.0341) MultiSource/Benchmarks/Olden/em3d/em3d: 5.98% (0.1721 => 0.1824, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.98% (0.8148 => 0.8635, std.dev.: 0.0186) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.92% (0.4847 => 0.5134, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.90% (13.1811 => 13.9591, std.dev.: 0.0406) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.74% (0.3295 => 0.3484, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.63% (1.1170 => 1.1799, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.54% (0.5817 => 0.6139, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.33% (0.2741 => 0.2887, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.19% (0.4783 => 0.5031, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.11% (1.6386 => 1.7224, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.04% (0.7473 => 0.7850, std.dev.: 0.0071) MultiSource/Applications/spiff/spiff: 4.84% (0.7950 => 0.8335, std.dev.: 0.0112) MultiSource/Applications/treecc/treecc: 4.48% (1.9948 => 2.0841, std.dev.: 0.0270) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.37% (0.6287 => 0.6562, std.dev.: 0.0089) MultiSource/Applications/Burg/burg: 4.21% (1.2222 => 1.2737, std.dev.: 0.0127) MultiSource/Applications/sgefa/sgefa: 4.20% (0.2999 => 0.3125, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.16% (0.6227 => 0.6486, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.14% (1.3279 => 1.3829, std.dev.: 0.0167) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.12% (0.4559 => 0.4747, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists1: 4.11% (0.2969 => 0.3091, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.09% (0.4127 => 0.4296, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.05% (0.9435 => 0.9817, std.dev.: 0.0107) MultiSource/Applications/d/make_dparser: 4.02% (3.2366 => 3.3666, std.dev.: 0.0394) MultiSource/Benchmarks/Prolangs-C/football/football: 3.95% (0.8768 => 0.9114, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.90% (0.2998 => 0.3115, std.dev.: 0.0044) MultiSource/Applications/hbd/hbd: 3.88% (1.4269 => 1.4823, std.dev.: 0.0157) MultiSource/Applications/SPASS/SPASS: 3.82% (14.2605 => 14.8047, std.dev.: 0.1312) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.73% (1.1685 => 1.2121, std.dev.: 0.0105) MultiSource/Benchmarks/McCat/18-imp/imp: 3.65% (0.3503 => 0.3631, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.50% (0.3717 => 0.3847, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.45% (0.5191 => 0.5370, std.dev.: 0.0019) MultiSource/Applications/lua/lua: 3.40% (3.8189 => 3.9487, std.dev.: 0.0219) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.32% (8.6476 => 8.9348, std.dev.: 0.0852) SingleSource/Benchmarks/Shootout-C++/hash2: 3.30% (0.4125 => 0.4261, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.29% (1.4479 => 1.4956, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.26% (4.4880 => 4.6344, std.dev.: 0.0509) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.25% (0.6586 => 0.6800, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.19% (1.2602 => 1.3004, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.14% (4.1763 => 4.3074, std.dev.: 0.0281) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.12% (0.8050 => 0.8301, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.05% (0.8316 => 0.8570, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.05% (0.5961 => 0.6143, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/05-eks/eks: 2.98% (0.4397 => 0.4528, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.96% (1.2526 => 1.2897, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.96% (0.8716 => 0.8974, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: 2.95% (0.3800 => 0.3912, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.94% (0.8611 => 0.8864, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.94% (0.7966 => 0.8200, std.dev.: 0.0053) MultiSource/Benchmarks/mafft/pairlocalalign: 2.85% (8.6247 => 8.8709, std.dev.: 0.0143) MultiSource/Applications/JM/ldecod/ldecod: 2.83% (6.7320 => 6.9223, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.82% (0.8086 => 0.8314, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.81% (0.7932 => 0.8155, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.76% (4.5702 => 4.6965, std.dev.: 0.0262) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.73% (0.8855 => 0.9097, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.72% (0.9074 => 0.9321, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.72% (0.8048 => 0.8267, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.69% (0.8261 => 0.8483, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.69% (0.8340 => 0.8564, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.68% (0.8331 => 0.8554, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.67% (0.8066 => 0.8281, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.57% (0.8457 => 0.8674, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.57% (4.4873 => 4.6024, std.dev.: 0.0363) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.45% (0.9056 => 0.9278, std.dev.: 0.0055) MultiSource/Applications/JM/lencod/lencod: 2.44% (15.3280 => 15.7017, std.dev.: 0.1069) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.41% (0.8007 => 0.8200, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.37% (0.8885 => 0.9096, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.36% (0.8712 => 0.8918, std.dev.: 0.0073) MultiSource/Benchmarks/Bullet/bullet: 2.32% (31.8598 => 32.5980, std.dev.: 0.2033) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.31% (0.8317 => 0.8509, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.23% (3.1832 => 3.2542, std.dev.: 0.0236) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.21% (0.8927 => 0.9124, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.18% (0.8656 => 0.8845, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.18% (0.9039 => 0.9236, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.17% (0.8805 => 0.8996, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.97% (0.8359 => 0.8524, std.dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: 1.89% (2.3764 => 2.4212, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.78% (2.1401 => 2.1783, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.71% (1.2423 => 1.2636, std.dev.: 0.0070) MultiSource/Applications/siod/siod: 1.67% (2.2184 => 2.2555, std.dev.: 0.0135) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 59.00% (1.5795 => 2.5114, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.82% (0.3186 => 0.3499, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.13% (2.4333 => 2.6554, std.dev.: 0.0131) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.37% (1.1857 => 1.2849, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.31% (3.9188 => 4.1659, std.dev.: 0.0808) MultiSource/Benchmarks/mafft/pairlocalalign: 6.00% (63.1822 => 66.9708, std.dev.: 0.0116) SingleSource/Benchmarks/Misc/ReedSolomon: 3.04% (8.5322 => 8.7913, std.dev.: 0.0057) MultiSource/Applications/siod/siod: 2.78% (3.6643 => 3.7663, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/bh/bh: 1.69% (2.3560 => 2.3957, std.dev.: 0.0110) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.60% (2.4490 => 2.4881, std.dev.: 0.0142) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.49% (4.8362 => 4.9083, std.dev.: 0.0141) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.10% (0.3269 => 0.3037, std.dev.: 0.0032) MultiSource/Applications/lua/lua: -5.11% (29.8330 => 28.3089, std.dev.: 0.2575) MultiSource/Benchmarks/Ptrdist/ft/ft: -1.66% (0.8789 => 0.8643, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash2: -1.36% (3.4237 => 3.3770, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.27% (3.3479 => 3.3054, std.dev.: 0.0043) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 1.08% (16.4461 => 16.6244, std.dev.: 0.2614) MultiSource/Applications/obsequi/Obsequi: 4.61% (1.0262 => 1.0735, std.dev.: 0.0207) MultiSource/Applications/sqlite3/sqlite3: 2.89% (0.6332 => 0.6515, std.dev.: 0.0060) MultiSource/Benchmarks/McCat/08-main/main: 7.26% (0.1831 => 0.1964, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.34% (0.1559 => 0.1611, std.dev.: 0.0062) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.84% (0.3123 => 0.3243, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.10% (0.2463 => 0.2490, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.58% (0.3344 => 0.3397, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.75% (0.2364 => 0.2429, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 0.83% (0.6010 => 0.6060, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel: 15.85% (0.0429 => 0.0497, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.12% (0.3266 => 0.3368, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 1.73% (0.1969 => 0.2003, std.dev.: 0.0021) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.04% (0.0224 => 0.0242, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.86% (0.0123 => 0.0220, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.15% (0.0408 => 0.0429, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.36% (0.0254 => 0.0248, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.20% (0.0384 => 0.0427, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -14.44% (0.0180 => 0.0154, std.dev.: 0.0031) SingleSource/UnitTests/byval-alignment: 45.65% (0.0230 => 0.0335, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.21% (0.1438 => 0.1435, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -3.51% (1.1329 => 1.0931, std.dev.: 0.0144) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 2.60% (0.1462 => 0.1500, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.73% (0.4164 => 0.4092, std.dev.: 0.0159) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.65% (0.1369 => 0.1319, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.52% (0.0641 => 0.0670, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.38% (0.0578 => 0.0586, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.10% (1.1437 => 1.1448, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1800.00% (0.0001 => 0.0019, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.57% (0.0627 => 0.0567, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.22% (0.0180 => 0.0265, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.90% (0.8017 => 0.7945, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 500.00% (0.0001 => 0.0006, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -38.71% (0.0062 => 0.0038, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 18:58:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 20:58:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121028015858.620D62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5317?compare_to=5313&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5317, Order: 166893, Start Time: 2012-10-28 00:33:39, End Time: 2012-10-28 01:58:55 To: 5313, Order: 166892, Start Time: 2012-10-27 22:45:14, End Time: 2012-10-28 00:10:38 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 1 (177 on baseline) Unchanged Tests: 1041 (860 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.61% (3.8428 => 3.7809, std.dev.: 0.0150) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.21% (15.2527 => 18.3346, std.dev.: 0.0206) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.90% (2.0478 => 2.1071, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/salsa20: 2.50% (7.4937 => 7.6809, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/hash2: 2.14% (3.1932 => 3.2615, std.dev.: 0.0058) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.59% (0.1584 => 0.1448, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.46% (0.1431 => 0.1310, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.41% (0.3821 => 0.3538, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: -7.07% (0.3831 => 0.3560, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -7.04% (0.3880 => 0.3607, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.00% (0.3884 => 0.3612, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.98% (0.3896 => 0.3624, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -6.98% (0.3812 => 0.3546, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.96% (0.3848 => 0.3580, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.94% (0.4033 => 0.3753, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -6.85% (0.4176 => 0.3890, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.76% (0.3891 => 0.3628, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.71% (0.2428 => 0.2265, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.70% (2.4924 => 2.3254, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: -6.64% (0.4280 => 0.3996, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -6.55% (0.4199 => 0.3924, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.45% (0.3658 => 0.3422, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.38% (22.4056 => 20.9754, std.dev.: 0.0101) MultiSource/Benchmarks/McCat/08-main/main: -6.36% (0.2659 => 0.2490, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.17% (4.5069 => 4.2288, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.11% (0.6484 => 0.6088, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.00% (5.4682 => 5.1400, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.99% (0.2355 => 0.2214, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: -5.98% (4.3330 => 4.0739, std.dev.: 0.0033) MultiSource/Applications/siod/siod: -5.98% (2.4021 => 2.2585, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: -5.98% (1.2515 => 1.1767, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.97% (0.2548 => 0.2396, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -5.95% (0.3142 => 0.2955, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.94% (0.1716 => 0.1614, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -5.91% (0.1879 => 0.1768, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.85% (4.8161 => 4.5342, std.dev.: 0.0055) MultiSource/Applications/JM/ldecod/ldecod: -5.85% (7.0961 => 6.6809, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.85% (0.9852 => 0.9276, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.84% (3.5339 => 3.3276, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: -5.79% (0.2160 => 0.2035, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.78% (0.7919 => 0.7461, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: -5.73% (16.1920 => 15.2640, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.73% (1.6474 => 1.5530, std.dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.72% (1.0544 => 0.9941, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.68% (4.8802 => 4.6032, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.59% (0.4151 => 0.3919, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -5.55% (0.3026 => 0.2858, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -5.53% (0.2985 => 0.2820, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.53% (0.3837 => 0.3625, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: -5.52% (1.3148 => 1.2422, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -5.52% (18.2933 => 17.2842, std.dev.: 0.0136) MultiSource/Applications/lua/lua: -5.50% (4.0594 => 3.8362, std.dev.: 0.0217) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.44% (0.9542 => 0.9023, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -5.44% (0.7779 => 0.7356, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.43% (1.2221 => 1.1557, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.43% (0.3057 => 0.2891, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.43% (4.0323 => 3.8134, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: -5.42% (0.6441 => 0.6092, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.40% (0.3849 => 0.3641, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.39% (1.2784 => 1.2095, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: -5.39% (0.3025 => 0.2862, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: -5.39% (0.6347 => 0.6005, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.38% (0.3252 => 0.3077, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.37% (0.2999 => 0.2838, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: -5.35% (0.2989 => 0.2829, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.34% (1.2210 => 1.1558, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.34% (0.2903 => 0.2748, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.34% (0.4083 => 0.3865, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -5.34% (34.0927 => 32.2732, std.dev.: 0.0276) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.33% (2.1713 => 2.0555, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: -5.31% (0.2939 => 0.2783, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -5.30% (0.7982 => 0.7559, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.28% (0.5999 => 0.5682, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: -5.28% (0.3255 => 0.3083, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.28% (0.8521 => 0.8071, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wc: -5.27% (0.3205 => 0.3036, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -5.27% (0.4861 => 0.4605, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.26% (0.2871 => 0.2720, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -5.23% (0.2849 => 0.2700, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: -5.23% (0.3194 => 0.3027, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.22% (0.2278 => 0.2159, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -5.21% (0.6750 => 0.6398, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.21% (0.4321 => 0.4096, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.17% (0.3016 => 0.2860, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -5.17% (0.3481 => 0.3301, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.17% (0.7198 => 0.6826, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: -5.13% (0.3394 => 0.3220, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.12% (2.2587 => 2.1430, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -5.11% (0.3621 => 0.3436, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: -5.10% (0.3788 => 0.3595, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -5.06% (9.2283 => 8.7614, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: -5.05% (0.3446 => 0.3272, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.04% (1.4642 => 1.3904, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.04% (0.6293 => 0.5976, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.98% (0.3491 => 0.3317, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.98% (1.3722 => 1.3039, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -4.95% (1.6364 => 1.5554, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.94% (0.2106 => 0.2002, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.92% (0.4427 => 0.4209, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.92% (0.4916 => 0.4674, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -4.91% (0.3867 => 0.3677, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.91% (0.3319 => 0.3156, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.90% (0.4813 => 0.4577, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -4.87% (0.4248 => 0.4041, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: -4.84% (0.3059 => 0.2911, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.81% (0.3323 => 0.3163, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.78% (0.3931 => 0.3743, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.70% (0.5805 => 0.5532, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.67% (0.6676 => 0.6364, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: -4.67% (0.4515 => 0.4304, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.67% (0.5591 => 0.5330, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -4.64% (0.3581 => 0.3415, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.61% (0.6230 => 0.5943, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.60% (0.5478 => 0.5226, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.59% (0.6660 => 0.6354, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.57% (0.2933 => 0.2799, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.54% (0.5859 => 0.5593, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.53% (0.2385 => 0.2277, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: -4.51% (0.8418 => 0.8038, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.49% (0.6297 => 0.6014, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.49% (0.5705 => 0.5449, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.49% (0.5863 => 0.5600, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.48% (0.6667 => 0.6368, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.47% (0.6194 => 0.5917, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.46% (0.5802 => 0.5543, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.46% (0.6304 => 0.6023, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: -4.45% (1.1450 => 1.0940, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.43% (0.5575 => 0.5328, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.43% (0.9557 => 0.9134, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: -4.42% (0.4524 => 0.4324, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.42% (0.5456 => 0.5215, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.41% (0.6440 => 0.6156, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.41% (0.5581 => 0.5335, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: -4.40% (0.3271 => 0.3127, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.35% (0.6189 => 0.5920, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.35% (0.5569 => 0.5327, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.35% (0.6260 => 0.5988, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.34% (0.5688 => 0.5441, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.34% (0.5925 => 0.5668, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.33% (0.6395 => 0.6118, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.32% (0.5857 => 0.5604, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.32% (0.7339 => 0.7022, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.32% (0.6395 => 0.6119, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.31% (0.5941 => 0.5685, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: -4.29% (0.9179 => 0.8785, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.28% (0.6052 => 0.5793, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.27% (0.5849 => 0.5599, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -4.27% (15.5079 => 14.8452, std.dev.: 0.0072) MultiSource/Applications/treecc/treecc: -4.27% (2.1401 => 2.0487, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: -4.27% (0.7447 => 0.7129, std.dev.: 0.0071) MultiSource/Benchmarks/sim/sim: -4.26% (0.3406 => 0.3261, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.25% (0.6681 => 0.6397, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.24% (8.0126 => 7.6726, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.21% (0.6033 => 0.5779, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.21% (0.9077 => 0.8695, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.19% (0.6736 => 0.6454, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.18% (0.5570 => 0.5337, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.17% (0.5567 => 0.5335, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.13% (0.7524 => 0.7213, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.08% (6.7716 => 6.4955, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.02% (0.6446 => 0.6187, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.96% (0.3483 => 0.3345, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -3.87% (17.1032 => 16.4413, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.85% (0.7021 => 0.6751, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.75% (0.5168 => 0.4974, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.72% (1.2300 => 1.1843, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: -3.64% (3.5154 => 3.3875, std.dev.: 0.0059) MultiSource/Applications/hbd/hbd: -3.57% (1.5610 => 1.5052, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: -3.56% (5.0226 => 4.8440, std.dev.: 0.0136) MultiSource/Benchmarks/nbench/nbench: -3.50% (1.1530 => 1.1126, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.40% (0.5329 => 0.5148, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.16% (14.2083 => 13.7588, std.dev.: 0.0192) SingleSource/UnitTests/Vector/constpool: -2.45% (20.7746 => 20.2657, std.dev.: 0.0314) MultiSource/Applications/SIBsim4/SIBsim4: -1.80% (1.3864 => 1.3614, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7527, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/richards_benchmark: -8.72% (1.2842 => 1.1722, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7062, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.55% (2.2633 => 2.1830, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.14% (1.3096 => 1.2816, std.dev.: 0.0079) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4724, std.dev.: 0.0038) Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 20:17:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 22:17:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121028031702.A1E852A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5318?compare_to=5315&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5318, Order: 166893, Start Time: 2012-10-28 01:45:48, End Time: 2012-10-28 03:17:00 To: 5315, Order: 166892, Start Time: 2012-10-27 23:44:43, End Time: 2012-10-28 01:16:13 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (10 on baseline) New Passes: 0 (14 on baseline) Performance Regressions: 1 (187 on baseline) Performance Improvements: 1 (54 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 15 (5 on baseline) Unchanged Tests: 1025 (638 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 4.67% (0.4092 => 0.4283, std.dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -2.85% (55.9468 => 54.3551, std.dev.: 0.3943) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: 0.39% (2.0656 => 2.0736, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 0.01% (58.0493 => 58.0526, std.dev.: 0.0180) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0796 => 0.0796, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -0.06% (9.2274 => 9.2218, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.06% (7.8140 => 7.8094, std.dev.: 0.0052) SingleSource/UnitTests/Vector/SSE/sse_shift: 0.37% (0.0534 => 0.0536, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/JM/lencod/lencod: 0.09% (7.7234 => 7.7304, std.dev.: 0.0096) MultiSource/Applications/oggenc/oggenc: - (0.0001 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0648 => 0.0648, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.84% (0.2992 => 0.3017, std.dev.: 0.0038) SingleSource/UnitTests/Vector/SSE/sse_shift: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -63.99% (5.7591 => 2.0736, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -8.21% (63.2438 => 58.0526, std.dev.: 0.0180) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.81% (6.6874 => 0.0796, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.34% (8.1363 => 9.2218, std.dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_shift: 41.80% (0.0378 => 0.0536, std.dev.: 0.0002) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -50.00% (0.0002 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -56.66% (0.6962 => 0.3017, std.dev.: 0.0038) SingleSource/UnitTests/Vector/SSE/sse_shift: -50.00% (0.0002 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 211.68% (0.5229 => 1.6298, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 17.67% (14.9895 => 17.6383, std.dev.: 0.0130) MultiSource/Applications/kimwitu++/kc: 37.55% (14.1553 => 19.4705, std.dev.: 0.0221) MultiSource/Benchmarks/MallocBench/gs/gs: 13.63% (4.1105 => 4.6709, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 32.80% (1.1048 => 1.4672, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 69.31% (3.4629 => 5.8630, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 68.68% (0.6222 => 1.0495, std.dev.: 0.0014) New Passes - Execution Time --------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 3836200.00% (0.0001 => 3.8363, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 11150800.00% (0.0001 => 11.1509, std.dev.: 0.0198) MultiSource/Applications/kimwitu++/kc: 50800.00% (0.0001 => 0.0509, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050200.00% (0.0001 => 10.0503, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5494500.00% (0.0001 => 5.4946, std.dev.: 0.0429) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 77.36% (0.0296 => 0.0525, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 69.53% (0.0256 => 0.0434) SingleSource/Regression/C/sumarray2d: 60.15% (0.0271 => 0.0434, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 52.26% (0.0243 => 0.0370) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 43.78% (1.5859 => 2.2802, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.85% (0.0834 => 0.1183, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 40.62% (0.1056 => 0.1485, std.dev.: 0.0004) SingleSource/UnitTests/vla: 35.49% (0.0355 => 0.0481, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 35.02% (2.2024 => 2.9736, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: 33.63% (0.1463 => 0.1955, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 29.12% (0.1432 => 0.1849, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 27.79% (0.1655 => 0.2115, std.dev.: 0.0065) MultiSource/Benchmarks/llubenchmark/llu: 23.81% (0.0462 => 0.0572) SingleSource/UnitTests/SignlessTypes/rem: 22.03% (0.1144 => 0.1396, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.52% (0.1566 => 0.1903, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.23% (0.5105 => 0.6189, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.67% (0.0871 => 0.1051, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 20.64% (0.1555 => 0.1876, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 19.37% (0.6675 => 0.7968, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 18.93% (1.3050 => 1.5521, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.90% (0.5020 => 0.5969, std.dev.: 0.0020) MultiSource/Applications/d/make_dparser: 18.81% (3.3354 => 3.9628, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 18.71% (0.2271 => 0.2696, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 18.26% (0.7115 => 0.8414, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 18.22% (0.0730 => 0.0863, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 18.10% (0.0746 => 0.0881, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 18.05% (0.2554 => 0.3015, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/tsp/tsp: 18.04% (0.1175 => 0.1387, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.95% (0.1337 => 0.1577, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 17.72% (0.1236 => 0.1455, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.55% (0.1510 => 0.1775, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 17.49% (0.1584 => 0.1861, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.44% (0.1032 => 0.1212, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: 17.41% (0.0626 => 0.0735, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.41% (1.5415 => 1.8099, std.dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 17.39% (1.1840 => 1.3899, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/em3d/em3d: 17.35% (0.1695 => 0.1989, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 17.20% (0.1163 => 0.1363, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 16.95% (0.4879 => 0.5706, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.92% (0.4615 => 0.5396, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.90% (0.0793 => 0.0927, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.83% (0.8172 => 0.9547, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 16.78% (0.3177 => 0.3710, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 16.63% (0.2603 => 0.3036, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 16.60% (0.3109 => 0.3625, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.43% (0.6450 => 0.7510, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 16.34% (0.1940 => 0.2257, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 16.29% (22.1758 => 25.7883, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.03% (0.0886 => 0.1028, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 15.99% (0.1151 => 0.1335, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.85% (0.0675 => 0.0782) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 15.79% (0.1906 => 0.2207, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.76% (0.3121 => 0.3613, std.dev.: 0.0029) SingleSource/Benchmarks/McGill/exptree: 15.60% (0.0814 => 0.0941) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.56% (0.0842 => 0.0973, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.52% (0.9765 => 1.1281, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 15.47% (1.0722 => 1.2381, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 15.32% (1.1642 => 1.3426, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 15.31% (2.0273 => 2.3377, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 15.28% (0.1695 => 0.1954) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.19% (0.2758 => 0.3177, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 15.17% (0.8921 => 1.0274, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.04% (0.1117 => 0.1285, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 15.03% (0.0672 => 0.0773, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.95% (0.2107 => 0.2422, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 14.95% (0.7835 => 0.9006, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.85% (0.2700 => 0.3101, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.84% (0.1125 => 0.1292, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.75% (1.1861 => 1.3610, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 14.70% (1.4186 => 1.6272, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 14.64% (0.3423 => 0.3924, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.62% (0.5860 => 0.6717, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.55% (0.0770 => 0.0882, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.49% (0.0759 => 0.0869, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.48% (0.5981 => 0.6847, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.36% (0.0933 => 0.1067, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.28% (0.1625 => 0.1857, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.22% (0.1062 => 0.1213, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.21% (0.1330 => 0.1519, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.19% (4.2646 => 4.8697, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.19% (0.2065 => 0.2358, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.18% (0.3307 => 0.3776, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 14.17% (0.7433 => 0.8486, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/lpbench: 14.10% (0.0929 => 0.1060) MultiSource/Benchmarks/McCat/05-eks/eks: 14.05% (0.4299 => 0.4903, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 14.02% (3.8723 => 4.4152, std.dev.: 0.0197) MultiSource/Benchmarks/sim/sim: 13.82% (0.3387 => 0.3855, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.80% (0.1029 => 0.1171, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.78% (0.0798 => 0.0908, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 13.37% (9.4845 => 10.7525, std.dev.: 0.0117) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.21% (0.1143 => 0.1294, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.18% (0.5569 => 0.6303, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.12% (0.0770 => 0.0871, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.11% (0.3441 => 0.3892, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 12.93% (0.1268 => 0.1432, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.81% (0.3826 => 0.4316, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 12.65% (0.0838 => 0.0944, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 12.61% (0.3092 => 0.3482, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 12.15% (0.4289 => 0.4810, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 12.01% (0.3180 => 0.3562, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.89% (0.1892 => 0.2117, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 11.65% (0.0953 => 0.1064, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 11.54% (0.4620 => 0.5153, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 11.46% (2.2969 => 2.5602, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.41% (0.8101 => 0.9025, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 11.40% (0.6456 => 0.7192, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.28% (14.3668 => 15.9868, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.07% (4.9449 => 5.4921, std.dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: 10.89% (17.1811 => 19.0515, std.dev.: 0.0097) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 10.88% (5.0018 => 5.5458, std.dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.79% (0.4636 => 0.5136, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.65% (0.3427 => 0.3792, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.54% (0.1044 => 0.1154, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.49% (0.3927 => 0.4339, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.34% (2.2022 => 2.4298, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 10.25% (0.3473 => 0.3829, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.25% (0.3543 => 0.3906, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.24% (0.3828 => 0.4220, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.19% (0.3543 => 0.3904, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.16% (0.4203 => 0.4630, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 10.12% (0.3694 => 0.4068, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 10.11% (0.3422 => 0.3768, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.08% (0.3561 => 0.3920, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.06% (0.3865 => 0.4254, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 10.04% (0.3516 => 0.3869, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 10.04% (0.3497 => 0.3848, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.73% (0.3886 => 0.4264, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 9.69% (0.3684 => 0.4041, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 9.66% (1.5603 => 1.7111, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/moments: 9.61% (0.4048 => 0.4437, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.14% (0.2266 => 0.2473, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 9.13% (0.3603 => 0.3932, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.07% (0.4103 => 0.4475, std.dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.06% (3.8922 => 4.2448, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.01% (0.2430 => 0.2649, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/property-reference: 8.90% (0.7326 => 0.7978, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 8.71% (0.5925 => 0.6441, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.69% (0.4064 => 0.4417, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.64% (0.6030 => 0.6551, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/matrix: 7.81% (0.3098 => 0.3340, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.73% (0.3650 => 0.3932, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.63% (0.2793 => 0.3006, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.55% (0.3283 => 0.3531, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.51% (0.2891 => 0.3108, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.45% (0.2831 => 0.3042, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.43% (0.3232 => 0.3472, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.42% (0.2872 => 0.3085, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 7.28% (0.3282 => 0.3521, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 7.23% (0.2905 => 0.3115, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.21% (2.0665 => 2.2155, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.18% (0.3162 => 0.3389, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.94% (0.2725 => 0.2914, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.90% (0.2871 => 0.3069, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.86% (0.2756 => 0.2945, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 6.84% (1.2842 => 1.3720, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.82% (0.8067 => 0.8617, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hello: 6.82% (0.2714 => 0.2899, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/wc: 6.82% (0.3052 => 0.3260, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.81% (0.2877 => 0.3073, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.53% (0.2802 => 0.2985, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.36% (0.3379 => 0.3594, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.74% (0.3136 => 0.3316, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: 5.56% (0.2049 => 0.2163, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (0.3131 => 0.3292, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.13% (7.9617 => 8.3703, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.86% (0.3935 => 0.4087, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.67% (7.0540 => 7.2426, std.dev.: 0.0079) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8953, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.13% (1.1145 => 1.3723, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 10.63% (0.9957 => 1.1015, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/richards_benchmark: 9.90% (1.1396 => 1.2524, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.95% (2.8904 => 3.0913, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (3.1578 => 3.3679, std.dev.: 0.0064) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: 4.50% (3.3453 => 3.4960, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 2.99% (1.9405 => 1.9986, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.59% (4.2280 => 4.3373, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 2.47% (4.4649 => 4.5753, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bisort/bisort: 1.85% (0.8333 => 0.8487, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 1.54% (3.1595 => 3.2080, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.38% (9.1159 => 9.2419, std.dev.: 0.0154) MultiSource/Benchmarks/nbench/nbench: 1.30% (11.6436 => 11.7950, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -76.96% (0.8651 => 0.1993, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.19% (5.3855 => 2.4134, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -54.90% (5.3526 => 2.4140, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: -45.13% (0.1622 => 0.0890, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.32% (1.1194 => 0.6792, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.14% (5.2763 => 3.2114, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -23.50% (1.7609 => 1.3471, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -17.57% (2.9384 => 2.4220, std.dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -9.11% (54.1659 => 49.2289, std.dev.: 0.0140) MultiSource/Applications/JM/ldecod/ldecod: -8.01% (10.4361 => 9.5997, std.dev.: 0.0087) MultiSource/Benchmarks/PAQ8p/paq8p: -6.42% (10.3673 => 9.7017, std.dev.: 0.0063) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -54.03% (8.0499 => 3.7004, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0134) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7652, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.61% (0.0506 => 0.0341) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.38% (0.3987 => 0.2696, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.50% (2.9695 => 2.3607, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -19.00% (1.2258 => 0.9929, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.88% (1.6925 => 1.4237, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.03% (1.2373 => 1.1008, std.dev.: 0.0051) MultiSource/Benchmarks/NPB-serial/is/is: -10.99% (9.5636 => 8.5125, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: -10.73% (1.5373 => 1.3723, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.40% (19.9488 => 18.2739, std.dev.: 0.0238) MultiSource/Benchmarks/FreeBench/mason/mason: -7.91% (0.2161 => 0.1990, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.01% (1.8329 => 1.7045, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5757, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -5.45% (6.6465 => 6.2841, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.11% (1.6805 => 1.5946, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.85% (0.2497 => 0.2376, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.84% (1.5835 => 1.5068, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.91% (8.1563 => 7.8371, std.dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.73% (1.3677 => 1.3167, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1626, std.dev.: 0.0061) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.53% (32.5116 => 31.3626, std.dev.: 0.0058) MultiSource/Benchmarks/sim/sim: -3.33% (5.0483 => 4.8803, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.00% (0.4808 => 0.4664, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: -2.94% (4.6441 => 4.5077, std.dev.: 0.0068) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.74% (4.5009 => 4.3774, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/multiplies: -1.96% (2.5528 => 2.5027, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -1.78% (10.2830 => 10.1001, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6815, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -1.29% (85.0658 => 83.9688, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.18% (1.7254 => 1.7051, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.10% (6.2999 => 6.2309, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: -1.01% (1.1277 => 1.1163) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.10% (7.1582 => 7.8094, std.dev.: 0.0052) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: 10636.67% (0.0720 => 7.7304, std.dev.: 0.0096) MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 2.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 21:13:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 23:13:24 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121028041324.121182A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5319?compare_to=5316&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5319, Order: 166894, Start Time: 2012-10-28 02:49:34, End Time: 2012-10-28 04:13:22 To: 5316, Order: 166893, Start Time: 2012-10-28 00:05:21, End Time: 2012-10-28 01:34:10 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 9 (84 on baseline) Performance Improvements: 0 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 966 (886 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/ks/ks: 8.18% (0.1454 => 0.1573, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.55% (0.8384 => 0.8514, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.44% (0.8595 => 0.8719, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: 8.83% (0.1381 => 0.1503, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.06% (4.3467 => 4.4796, std.dev.: 0.0161) SingleSource/Benchmarks/Misc/ffbench: 2.77% (1.4025 => 1.4413, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/life/life: 2.36% (2.5702 => 2.6309, std.dev.: 0.0141) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 1.88% (0.5838 => 0.5948, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.24% (2.4881 => 2.5189, std.dev.: 0.0023) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.60% (16.6244 => 16.7249, std.dev.: 0.0900) MultiSource/Applications/obsequi/Obsequi: -0.11% (1.0735 => 1.0723, std.dev.: 0.0148) MultiSource/Applications/sqlite3/sqlite3: -0.06% (0.6515 => 0.6511, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/08-main/main: -2.14% (0.1964 => 0.1922, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.99% (0.1611 => 0.1627, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.42% (0.3243 => 0.3197, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.90% (0.2490 => 0.2393, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.24% (0.3397 => 0.3389, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.45% (0.2429 => 0.2440, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 0.05% (0.6060 => 0.6063, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: -7.65% (0.0497 => 0.0459, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.48% (0.3368 => 0.3352, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/strcat: 1.05% (0.2003 => 0.2024, std.dev.: 0.0016) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -16.12% (0.0242 => 0.0203, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.45% (0.0220 => 0.0219, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -16.78% (0.0429 => 0.0357, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 34.68% (0.0248 => 0.0334, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.32% (0.0313 => 0.0314, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -4.68% (0.0427 => 0.0407, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: 1.97% (0.0203 => 0.0207) SingleSource/UnitTests/Vector/Altivec/test1: -13.64% (0.0154 => 0.0133, std.dev.: 0.0036) SingleSource/UnitTests/byval-alignment: -6.27% (0.0335 => 0.0314, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 0.35% (0.1435 => 0.1440, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.35% (1.0931 => 1.1188, std.dev.: 0.0246) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.47% (0.1500 => 0.1478, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.47% (0.4092 => 0.4032, std.dev.: 0.0753) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.83% (0.1319 => 0.1308, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.90% (0.0670 => 0.0597, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -21.66% (0.0277 => 0.0217, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.83% (0.0586 => 0.0546, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.11% (1.1448 => 1.1435, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -94.74% (0.0019 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 600.00% (0.0001 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.00% (0.0567 => 0.0601, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -29.06% (0.0265 => 0.0188, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.91% (0.7945 => 0.8017, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -83.33% (0.0006 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 44.74% (0.0038 => 0.0055, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.29% (2.1832 => 1.6748, std.dev.: 0.0006) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 35.90% (14.7684 => 20.0705, std.dev.: 0.1440) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.42% (0.0810 => 0.0943, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 13.40% (0.1112 => 0.1261, std.dev.: 0.0053) SingleSource/UnitTests/SignlessTypes/rem: 12.46% (0.1035 => 0.1164, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.03% (0.2180 => 0.2355, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.79% (0.1425 => 0.1536, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.30% (0.1466 => 0.1573, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.78% (0.8321 => 0.8885, std.dev.: 0.0064) MultiSource/Applications/SIBsim4/SIBsim4: 6.64% (1.2568 => 1.3403, std.dev.: 0.0117) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.56% (0.1905 => 0.2030, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.08% (13.1811 => 13.9824, std.dev.: 0.1172) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.31% (6.6074 => 6.9580, std.dev.: 0.0522) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.21% (0.4783 => 0.5032, std.dev.: 0.0016) MultiSource/Applications/spiff/spiff: 5.16% (0.7950 => 0.8360, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.08% (0.2519 => 0.2647, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.77% (1.1170 => 1.1703, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.44% (1.6386 => 1.7114, std.dev.: 0.0144) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.38% (0.2741 => 0.2861, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.29% (1.4479 => 1.5100, std.dev.: 0.0051) MultiSource/Applications/d/make_dparser: 4.07% (3.2366 => 3.3684, std.dev.: 0.0180) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.05% (0.6227 => 0.6479, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.04% (0.4559 => 0.4743, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.00% (0.2998 => 0.3118, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 4.00% (0.8597 => 0.8941, std.dev.: 0.0084) MultiSource/Applications/SPASS/SPASS: 3.84% (14.2605 => 14.8078, std.dev.: 0.0136) MultiSource/Applications/treecc/treecc: 3.78% (1.9948 => 2.0703, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 3.78% (0.8204 => 0.8514, std.dev.: 0.0033) MultiSource/Applications/hbd/hbd: 3.78% (1.4269 => 1.4808, std.dev.: 0.0197) MultiSource/Benchmarks/Prolangs-C/football/football: 3.72% (0.8768 => 0.9094, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.69% (0.2794 => 0.2897, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.59% (0.9908 => 1.0264, std.dev.: 0.0042) MultiSource/Applications/minisat/minisat: 3.56% (0.6834 => 0.7077, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.55% (0.8420 => 0.8719, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 3.44% (0.4125 => 0.4267, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 3.43% (0.2999 => 0.3102, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.35% (0.5191 => 0.5365, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 3.29% (1.0945 => 1.1305, std.dev.: 0.0026) MultiSource/Applications/lua/lua: 3.23% (3.8189 => 3.9423, std.dev.: 0.0459) SingleSource/Benchmarks/Shootout-C++/hash: 3.21% (0.3800 => 0.3922, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 3.15% (0.8805 => 0.9082, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.11% (0.8712 => 0.8983, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.09% (0.8697 => 0.8966, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.07% (0.8611 => 0.8875, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.97% (0.9069 => 0.9338, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.91% (4.1763 => 4.2978, std.dev.: 0.0398) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.91% (0.8086 => 0.8321, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.90% (0.8457 => 0.8702, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.88% (0.8656 => 0.8905, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.82% (0.7932 => 0.8156, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.78% (0.8050 => 0.8274, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.78% (0.8340 => 0.8572, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.74% (0.8855 => 0.9098, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.63% (0.8316 => 0.8535, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.55% (0.8069 => 0.8275, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.52% (0.8286 => 0.8495, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.50% (0.8066 => 0.8268, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.49% (0.8716 => 0.8933, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.42% (0.8927 => 0.9143, std.dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 2.42% (8.6247 => 8.8333, std.dev.: 0.0189) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.34% (0.8518 => 0.8717, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.19% (0.8177 => 0.8356, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.01% (3.1832 => 3.2473, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.98% (2.1401 => 2.1825, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 1.95% (15.3280 => 15.6274, std.dev.: 0.0519) MultiSource/Applications/JM/ldecod/ldecod: 1.95% (6.7320 => 6.8633, std.dev.: 0.0249) MultiSource/Applications/oggenc/oggenc: 1.78% (4.9628 => 5.0509, std.dev.: 0.0182) MultiSource/Applications/siod/siod: 1.70% (2.2184 => 2.2562, std.dev.: 0.0083) MultiSource/Benchmarks/PAQ8p/paq8p: 1.67% (2.3764 => 2.4162, std.dev.: 0.0153) MultiSource/Benchmarks/Bullet/bullet: 1.64% (31.8598 => 32.3820, std.dev.: 0.1307) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.53% (1.5315 => 1.5550, std.dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.35% (1.5795 => 2.5012, std.dev.: 0.0088) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.24% (2.4333 => 2.6581, std.dev.: 0.0210) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.04% (0.3186 => 0.3474, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.54% (1.1857 => 1.2870, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 8.44% (0.1386 => 0.1503, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 5.92% (63.1822 => 66.9232, std.dev.: 0.0399) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.37% (2.2485 => 2.3467, std.dev.: 0.0343) SingleSource/Benchmarks/Misc/ReedSolomon: 3.03% (8.5322 => 8.7910, std.dev.: 0.0162) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.86% (4.3552 => 4.4796, std.dev.: 0.0161) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.85% (2.4490 => 2.5189, std.dev.: 0.0023) MultiSource/Applications/siod/siod: 2.71% (3.6643 => 3.7636, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 1.82% (2.3560 => 2.3989, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.29% (4.8362 => 4.8985, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/whetstone: 1.24% (2.1224 => 2.1488, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.78% (0.3269 => 0.2982, std.dev.: 0.0037) MultiSource/Applications/lua/lua: -4.95% (29.8330 => 28.3575, std.dev.: 0.1940) SingleSource/Benchmarks/Shootout-C++/hash2: -1.55% (3.4237 => 3.3705, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.45% (3.3479 => 3.2994, std.dev.: 0.0028) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 1.70% (16.4461 => 16.7249, std.dev.: 0.0900) MultiSource/Applications/obsequi/Obsequi: 4.49% (1.0262 => 1.0723, std.dev.: 0.0148) MultiSource/Applications/sqlite3/sqlite3: 2.83% (0.6332 => 0.6511, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/08-main/main: 4.97% (0.1831 => 0.1922, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.36% (0.1559 => 0.1627, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.37% (0.3123 => 0.3197, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.84% (0.2463 => 0.2393, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.35% (0.3344 => 0.3389, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.21% (0.2364 => 0.2440, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 0.88% (0.6010 => 0.6063, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: 6.99% (0.0429 => 0.0459, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.63% (0.3266 => 0.3352, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/strcat: 2.79% (0.1969 => 0.2024, std.dev.: 0.0016) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -9.38% (0.0224 => 0.0203, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -12.50% (0.0408 => 0.0357, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.50% (0.0254 => 0.0334, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 5.99% (0.0384 => 0.0407, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: 8.95% (0.0190 => 0.0207) SingleSource/UnitTests/Vector/Altivec/test1: -26.11% (0.0180 => 0.0133, std.dev.: 0.0036) SingleSource/UnitTests/byval-alignment: 36.52% (0.0230 => 0.0314, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 0.14% (0.1438 => 0.1440, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.24% (1.1329 => 1.1188, std.dev.: 0.0246) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.09% (0.1462 => 0.1478, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.17% (0.4164 => 0.4032, std.dev.: 0.0753) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.46% (0.1369 => 0.1308, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.86% (0.0641 => 0.0597, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 11.28% (0.0195 => 0.0217, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.54% (0.0578 => 0.0546, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.02% (1.1437 => 1.1435, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -50.00% (0.0014 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.15% (0.0627 => 0.0601, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.44% (0.0180 => 0.0188, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: - (0.8017 => 0.8017, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -11.29% (0.0062 => 0.0055, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 21:21:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 23:21:13 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121028042113.77CA22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5320?compare_to=5317&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5320, Order: 166894, Start Time: 2012-10-28 02:55:57, End Time: 2012-10-28 04:21:09 To: 5317, Order: 166893, Start Time: 2012-10-28 00:33:39, End Time: 2012-10-28 01:58:55 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (176 on baseline) Unchanged Tests: 1042 (861 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.19% (15.2527 => 18.3324, std.dev.: 0.0144) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.25% (1.2783 => 1.3710, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.68% (2.0478 => 2.1027, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/salsa20: 2.42% (7.4937 => 7.6753, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/hash2: 2.25% (3.1932 => 3.2651, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.65% (0.1584 => 0.1447, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.46% (0.1431 => 0.1310, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.35% (0.3821 => 0.3540, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -7.15% (0.3831 => 0.3557, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -7.09% (0.3880 => 0.3605, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -7.08% (0.3812 => 0.3542, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -7.07% (0.3848 => 0.3576, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -7.01% (0.3896 => 0.3623, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.00% (0.3884 => 0.3612, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.96% (0.3891 => 0.3620, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -6.94% (0.4176 => 0.3886, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -6.92% (0.4033 => 0.3754, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/property: -6.79% (0.4199 => 0.3914, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.71% (0.2428 => 0.2265, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: -6.68% (0.4280 => 0.3994, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -6.62% (2.4924 => 2.3274, std.dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.53% (0.3658 => 0.3419, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.38% (22.4056 => 20.9755, std.dev.: 0.0131) MultiSource/Benchmarks/McCat/08-main/main: -6.36% (0.2659 => 0.2490, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.10% (4.5069 => 4.2320, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/gs/gs: -6.08% (4.3330 => 4.0696, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.08% (0.6484 => 0.6090, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.07% (0.2355 => 0.2212, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.05% (0.3142 => 0.2952, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.01% (5.4682 => 5.1395, std.dev.: 0.0160) MultiSource/Applications/Burg/burg: -6.01% (1.2515 => 1.1763, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.00% (0.2548 => 0.2395, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -5.97% (2.4021 => 2.2587, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/ReedSolomon: -5.96% (0.1879 => 0.1767, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.95% (0.7919 => 0.7448, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: -5.90% (0.3357 => 0.3159, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.89% (0.1716 => 0.1615, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: -5.88% (0.2160 => 0.2033, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -5.85% (7.0961 => 6.6807, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.81% (0.9852 => 0.9280, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.80% (4.8161 => 4.5368, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.80% (4.8802 => 4.5972, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.77% (3.5339 => 3.3299, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.76% (1.0544 => 0.9937, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.73% (0.5999 => 0.5655, std.dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: -5.73% (16.1920 => 15.2648, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.68% (0.3837 => 0.3619, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.68% (0.8521 => 0.8037, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.66% (1.6474 => 1.5542, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: -5.65% (0.3026 => 0.2855, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.64% (0.9542 => 0.9004, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.61% (0.4151 => 0.3918, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -5.57% (1.3148 => 1.2416, std.dev.: 0.0031) MultiSource/Applications/lua/lua: -5.56% (4.0594 => 3.8339, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.55% (0.4321 => 0.4081, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: -5.55% (0.3025 => 0.2857, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -5.55% (0.2989 => 0.2823, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.55% (0.2903 => 0.2742, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -5.53% (0.2985 => 0.2820, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.51% (1.2784 => 1.2079, std.dev.: 0.0104) MultiSource/Applications/kimwitu++/kc: -5.50% (18.2933 => 17.2870, std.dev.: 0.0098) SingleSource/UnitTests/ObjC++/Hello: -5.50% (0.6347 => 0.5998, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.50% (0.3057 => 0.2889, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.46% (1.2221 => 1.1554, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.46% (0.3849 => 0.3639, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.45% (2.1713 => 2.0529, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.45% (0.6293 => 0.5950, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.44% (0.3252 => 0.3075, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.44% (4.0323 => 3.8129, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.44% (0.4083 => 0.3861, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: -5.42% (0.7779 => 0.7357, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.42% (1.2210 => 1.1548, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/objinst: -5.42% (0.3194 => 0.3021, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: -5.41% (0.2939 => 0.2780, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -5.37% (0.7982 => 0.7553, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.37% (0.3016 => 0.2854, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -5.37% (34.0927 => 32.2624, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.37% (0.2999 => 0.2838, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/matrix: -5.35% (0.3255 => 0.3081, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -5.34% (0.2849 => 0.2697, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -5.33% (0.2871 => 0.2718, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -5.31% (0.6441 => 0.6099, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash2: -5.31% (0.4861 => 0.4603, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -5.27% (0.3205 => 0.3036, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.27% (0.2278 => 0.2158, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -5.25% (0.3446 => 0.3265, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.24% (2.2587 => 2.1404, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists: -5.22% (0.3621 => 0.3432, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: -5.20% (0.3481 => 0.3300, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.19% (1.4642 => 1.3882, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: -5.17% (0.6750 => 0.6401, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.17% (0.7198 => 0.6826, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -5.16% (0.3394 => 0.3219, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -5.13% (0.3059 => 0.2902, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.13% (0.4427 => 0.4200, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -5.12% (0.3788 => 0.3594, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.11% (1.6364 => 1.5527, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.03% (0.2106 => 0.2000, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -5.03% (9.2283 => 8.7643, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/moments: -5.01% (0.4248 => 0.4035, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: -4.99% (0.3867 => 0.3674, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.98% (1.3722 => 1.3039, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.94% (0.4916 => 0.4673, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.88% (0.3319 => 0.3157, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.86% (0.3931 => 0.3740, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.78% (0.3323 => 0.3164, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -4.78% (0.4515 => 0.4299, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/18-imp/imp: -4.78% (0.3581 => 0.3410, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.70% (0.4813 => 0.4587, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.69% (0.6230 => 0.5938, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.65% (0.5805 => 0.5535, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.65% (0.5591 => 0.5331, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.64% (0.5478 => 0.5224, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.61% (0.6676 => 0.6368, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.61% (0.6660 => 0.6353, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.60% (0.2933 => 0.2798, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.59% (0.6297 => 0.6008, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/09-vor/vor: -4.59% (0.3271 => 0.3121, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.57% (0.2385 => 0.2276, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -4.53% (0.8418 => 0.8037, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.51% (0.9557 => 0.9126, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.49% (0.5863 => 0.5600, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.45% (0.5802 => 0.5544, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: -4.44% (1.1450 => 1.0942, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.43% (0.6052 => 0.5784, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.42% (0.6194 => 0.5920, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/hash: -4.42% (0.4524 => 0.4324, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.41% (0.6189 => 0.5916, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.41% (0.6395 => 0.6113, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.41% (0.5581 => 0.5335, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.40% (0.5456 => 0.5216, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.39% (0.6260 => 0.5985, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: -4.39% (15.5079 => 14.8268, std.dev.: 0.0217) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.39% (0.2277 => 0.2177, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.39% (0.7339 => 0.7017, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.38% (0.5575 => 0.5331, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.38% (0.5941 => 0.5681, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.37% (0.5859 => 0.5603, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -4.35% (0.7447 => 0.7123, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.35% (0.7524 => 0.7197, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.35% (0.5569 => 0.5327, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.33% (0.6440 => 0.6161, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.32% (0.5688 => 0.5442, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.32% (0.5857 => 0.5604, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.32% (0.3406 => 0.3259, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: -4.30% (0.9179 => 0.8784, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.29% (0.6736 => 0.6447, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.28% (0.5705 => 0.5461, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.27% (0.6304 => 0.6035, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.27% (0.6681 => 0.6396, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.26% (0.5567 => 0.5330, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: -4.24% (2.1401 => 2.0493, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.24% (0.5849 => 0.5601, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.23% (0.6033 => 0.5778, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.23% (8.0126 => 7.6740, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.21% (0.6395 => 0.6126, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.17% (0.5570 => 0.5338) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.10% (0.6446 => 0.6182, std.dev.: 0.0049) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.09% (6.7716 => 6.4948, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.02% (0.3483 => 0.3343, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.92% (0.7021 => 0.6746, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -3.90% (17.1032 => 16.4369, std.dev.: 0.0297) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.87% (0.9077 => 0.8726, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.79% (1.2300 => 1.1834, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.75% (0.5168 => 0.4974, std.dev.: 0.0021) MultiSource/Applications/d/make_dparser: -3.68% (3.5154 => 3.3860, std.dev.: 0.0104) MultiSource/Applications/oggenc/oggenc: -3.62% (5.0226 => 4.8410, std.dev.: 0.0057) MultiSource/Applications/hbd/hbd: -3.61% (1.5610 => 1.5047, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: -3.56% (1.1530 => 1.1120, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.43% (0.5329 => 0.5146, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.16% (14.2083 => 13.7596, std.dev.: 0.0081) SingleSource/UnitTests/Vector/constpool: -2.30% (20.7746 => 20.2973, std.dev.: 0.0206) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7521, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/richards_benchmark: -8.75% (1.2842 => 1.1718, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.91% (1.7753 => 1.7059, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.77% (2.2633 => 2.1779, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4688, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.31% (1.3096 => 1.2924, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Report Time: 2.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 21:28:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 27 Oct 2012 23:28:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121028042838.ECE102A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5321?compare_to=5314&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5321, Order: 166893, Start Time: 2012-10-28 01:12:52, End Time: 2012-10-28 04:28:36 To: 5314, Order: 166891, Start Time: 2012-10-27 21:07:41, End Time: 2012-10-28 00:24:54 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (171 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1039 (718 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.02% (2.3767 => 2.4009, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.02% (2.7871 => 2.8156, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -6.07% (131.5813 => 123.5881, std.dev.: 2.6336) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.92% (0.0625 => 0.0887, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.55% (0.1063 => 0.1409, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.83% (0.2969 => 0.3736, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.32% (0.4253 => 0.5330, std.dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 25.14% (1.5932 => 1.9937, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.14% (0.1106 => 0.1384, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.45% (0.4139 => 0.5151, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.81% (0.0714 => 0.0884, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.59% (0.4994 => 0.6172, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.54% (0.5900 => 0.7289, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.20% (0.5000 => 0.6160, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.16% (0.0475 => 0.0585, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.60% (0.0584 => 0.0716) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.49% (0.0547 => 0.0670, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.94% (0.1021 => 0.1245, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.60% (0.1620 => 0.1970, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.41% (0.1107 => 0.1344, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 21.37% (0.0599 => 0.0727, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.29% (0.0897 => 0.1088, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.94% (0.1103 => 0.1334, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 20.70% (0.0604 => 0.0729, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.33% (0.0541 => 0.0651, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 20.33% (0.0605 => 0.0728, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.27% (0.1549 => 0.1863, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 20.15% (0.0948 => 0.1139, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.14% (0.3903 => 0.4689, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.06% (0.0633 => 0.0760, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.03% (0.0584 => 0.0701, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.94% (0.0642 => 0.0770, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 19.77% (0.1619 => 0.1939, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 19.73% (0.0821 => 0.0983, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.64% (0.1003 => 0.1200, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.46% (0.0822 => 0.0982, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.39% (0.1604 => 0.1915, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 19.00% (0.5826 => 0.6933, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.88% (0.1462 => 0.1738, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 18.69% (0.0947 => 0.1124, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 18.41% (0.5889 => 0.6973, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.38% (0.2736 => 0.3239, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.20% (0.3890 => 0.4598, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 18.19% (0.0808 => 0.0955, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.89% (1.3152 => 1.5505, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.87% (0.2014 => 0.2374, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 17.82% (0.1218 => 0.1435, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 17.52% (0.4029 => 0.4735, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/mst/mst: 17.48% (0.0698 => 0.0820, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 17.41% (0.1505 => 0.1767, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.37% (0.1088 => 0.1277, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.29% (0.2875 => 0.3372, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.24% (0.2866 => 0.3360, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 16.97% (0.5546 => 0.6487, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 16.95% (1.8794 => 2.1980, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.93% (3.5627 => 4.1659, std.dev.: 0.0107) SingleSource/UnitTests/ObjC++/property-reference: 16.82% (0.7171 => 0.8377, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/methcall: 16.74% (0.2813 => 0.3284, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 16.73% (0.9697 => 1.1319, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.60% (0.4658 => 0.5431, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.55% (0.1160 => 0.1352, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.48% (1.6211 => 1.8883, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.47% (0.2738 => 0.3189, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 16.47% (0.2714 => 0.3161, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.46% (0.1968 => 0.2292, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 16.44% (0.2725 => 0.3173, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.42% (0.2911 => 0.3389, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 16.40% (0.2780 => 0.3236, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.38% (0.2729 => 0.3176, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 16.36% (0.2750 => 0.3200, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 16.34% (0.3004 => 0.3495, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.17% (0.3271 => 0.3800, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.14% (2.0673 => 2.4009, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.14% (0.5026 => 0.5837, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 16.08% (0.2823 => 0.3277, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.08% (0.2792 => 0.3241, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 16.05% (0.2803 => 0.3253, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 16.05% (0.3096 => 0.3593, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 16.04% (0.2811 => 0.3262, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 16.04% (0.9909 => 1.1498, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.03% (0.4361 => 0.5060, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.98% (0.3930 => 0.4558, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 15.97% (0.1421 => 0.1648, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.96% (0.3195 => 0.3705, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 15.94% (1.0781 => 1.2500, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.76% (4.4195 => 5.1160, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.65% (0.3060 => 0.3539, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 15.64% (0.3267 => 0.3778, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: 15.58% (0.1284 => 0.1484, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 15.53% (0.3258 => 0.3764) MultiSource/Applications/ClamAV/clamscan: 15.44% (4.2109 => 4.8611, std.dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.41% (2.7292 => 3.1498, std.dev.: 0.0298) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.33% (1.9694 => 2.2713, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.32% (0.3362 => 0.3877, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 15.28% (0.2075 => 0.2392, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 15.25% (0.3317 => 0.3823, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.15% (1.9966 => 2.2990, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.14% (0.1090 => 0.1255, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 14.89% (23.5202 => 27.0230, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/lists: 14.78% (0.3348 => 0.3843, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.76% (0.3124 => 0.3585, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 14.69% (0.4146 => 0.4755, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.56% (0.3282 => 0.3760, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 14.55% (0.3678 => 0.4213, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.37% (0.3625 => 0.4146) SingleSource/Benchmarks/Shootout-C++/sieve: 14.36% (0.3726 => 0.4261, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 14.35% (0.3477 => 0.3976, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.30% (0.3845 => 0.4395, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.15% (0.3690 => 0.4212, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash2: 14.14% (0.4251 => 0.4852, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.12% (0.3981 => 0.4543, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 13.99% (0.2566 => 0.2925, std.dev.: 0.0022) MultiSource/Applications/lua/lua: 13.96% (1.4269 => 1.6261, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/for-in: 13.84% (0.3496 => 0.3980, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 13.76% (2.1653 => 2.4632, std.dev.: 0.0039) MultiSource/Applications/treecc/treecc: 13.55% (0.7875 => 0.8942, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-4: 13.54% (0.3465 => 0.3934, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 13.53% (0.3460 => 0.3928, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 13.51% (0.3442 => 0.3907, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.49% (0.3446 => 0.3911, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 13.48% (0.3724 => 0.4226, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.47% (0.3488 => 0.3958, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 13.43% (0.3469 => 0.3935, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 13.33% (4.6177 => 5.2331, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 13.25% (0.5012 => 0.5676, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 13.23% (0.3650 => 0.4133, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 12.96% (2.1013 => 2.3736, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 12.96% (0.3643 => 0.4115, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.84% (0.2040 => 0.2302, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 12.15% (0.2691 => 0.3018, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 12.02% (5.5417 => 6.2076, std.dev.: 0.0123) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.92% (0.6435 => 0.7202, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.86% (0.1383 => 0.1547, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.28% (0.1028 => 0.1144, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.11% (0.2737 => 0.3041, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 11.03% (0.3498 => 0.3884, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.03% (0.2068 => 0.2296, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 10.67% (0.6634 => 0.7342, std.dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: 10.50% (0.4847 => 0.5356, std.dev.: 0.0017) MultiSource/Applications/minisat/minisat: 10.46% (0.3336 => 0.3685, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.34% (0.3084 => 0.3403, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 9.85% (2.0346 => 2.2350, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.65% (0.2103 => 0.2306, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: 9.49% (0.2391 => 0.2618, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.45% (11.6398 => 12.7403, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.41% (4.6926 => 5.1342, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.28% (0.5361 => 0.5805, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.75% (0.5584 => 0.6017, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.53% (0.7426 => 0.7985, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 6.98% (11.9555 => 12.7901, std.dev.: 0.0091) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.22% (0.3792 => 0.3952, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6533, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.33% (0.5917 => 0.6706, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 8.92% (0.2802 => 0.3052, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6101, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.61% (0.3693 => 0.3900, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 5.51% (0.2122 => 0.2239, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/objinst: 5.08% (12.0509 => 12.6636, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 4.66% (15.4430 => 16.1634, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-2: 4.25% (1.8057 => 1.8824, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: 2.75% (14.0481 => 14.4345, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1963, std.dev.: 0.0089) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.76% (3.1722 => 3.2279, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.2995, std.dev.: 0.0159) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2862, std.dev.: 0.0032) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.26% (1.0142 => 1.0270) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5135, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5404, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5977, std.dev.: 0.0142) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.51% (2.4764 => 2.4391, std.dev.: 0.0143) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.43% (25.4195 => 16.4130, std.dev.: 0.0139) MultiSource/Applications/hexxagon/hexxagon: -7.70% (28.1477 => 25.9791, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7761, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9576, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/ary2: -7.16% (0.2402 => 0.2230, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2421, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.47% (11.2080 => 10.8193, std.dev.: 0.0581) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.07% (0.6293 => 0.6100, std.dev.: 0.0058) MultiSource/Applications/siod/siod: -2.98% (6.9842 => 6.7761, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -2.87% (3.6262 => 3.5220, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.42% (17.2379 => 16.8199, std.dev.: 0.0237) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.20% (41.7953 => 40.8768, std.dev.: 0.0123) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.80% (10.7630 => 10.5692, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4963, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.33% (5.7935 => 5.7164, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.13% (105.3826 => 104.1944, std.dev.: 0.0195) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0425, std.dev.: 0.0036) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.00% (3.3991 => 3.3650, std.dev.: 0.0007) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 22:18:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 28 Oct 2012 00:18:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121028051812.681F12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5322?compare_to=5318&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5322, Order: 166895, Start Time: 2012-10-28 03:46:39, End Time: 2012-10-28 05:18:08 To: 5318, Order: 166893, Start Time: 2012-10-28 01:45:48, End Time: 2012-10-28 03:17:00 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (10 on baseline) New Passes: 0 (14 on baseline) Performance Regressions: 5 (187 on baseline) Performance Improvements: 1 (55 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 15 (5 on baseline) Unchanged Tests: 1021 (637 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.02% (7.2426 => 7.3886, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.58% (2.4140 => 2.4521, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.49% (2.4134 => 2.4494, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.06% (2.4298 => 2.4555, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.24% (78.1453 => 79.8942, std.dev.: 0.2223) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -3.60% (0.4283 => 0.4129, std.dev.: 0.0022) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -0.27% (2.0736 => 2.0680, std.dev.: 0.0130) MultiSource/Benchmarks/Bullet/bullet: 0.38% (58.0526 => 58.2713, std.dev.: 0.0225) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.13% (0.0796 => 0.0797, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -0.06% (9.2218 => 9.2161, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.00% (7.8094 => 7.8096, std.dev.: 0.0024) SingleSource/UnitTests/Vector/SSE/sse_shift: -0.19% (0.0536 => 0.0535) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/JM/lencod/lencod: -0.07% (7.7304 => 7.7253, std.dev.: 0.0026) MultiSource/Applications/oggenc/oggenc: - (0.0001 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.33% (0.0648 => 0.0702, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.89% (0.3017 => 0.2990, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_shift: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -64.09% (5.7591 => 2.0680, std.dev.: 0.0130) MultiSource/Benchmarks/Bullet/bullet: -7.86% (63.2438 => 58.2713, std.dev.: 0.0225) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.81% (6.6874 => 0.0797, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.27% (8.1363 => 9.2161, std.dev.: 0.0032) SingleSource/UnitTests/Vector/SSE/sse_shift: 41.53% (0.0378 => 0.0535) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -50.00% (0.0002 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -57.05% (0.6962 => 0.2990, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_shift: -50.00% (0.0002 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 211.65% (0.5229 => 1.6296, std.dev.: 0.0052) MultiSource/Applications/SPASS/SPASS: 17.61% (14.9895 => 17.6294, std.dev.: 0.0115) MultiSource/Applications/kimwitu++/kc: 37.55% (14.1553 => 19.4702, std.dev.: 0.0064) MultiSource/Benchmarks/MallocBench/gs/gs: 13.80% (4.1105 => 4.6779, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 32.98% (1.1048 => 1.4692, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 69.49% (3.4629 => 5.8694, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_container: 68.85% (0.6222 => 1.0506, std.dev.: 0.0007) New Passes - Execution Time --------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 3836200.00% (0.0001 => 3.8363, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 11166600.00% (0.0001 => 11.1667, std.dev.: 0.0172) MultiSource/Applications/kimwitu++/kc: 50400.00% (0.0001 => 0.0505, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049300.00% (0.0001 => 10.0494, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5491100.00% (0.0001 => 5.4912, std.dev.: 0.0290) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 77.70% (0.0296 => 0.0526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 69.53% (0.0256 => 0.0434, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 60.52% (0.0271 => 0.0435, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 52.26% (0.0243 => 0.0370, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 43.76% (1.5859 => 2.2799, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.21% (0.0834 => 0.1186, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/distray/distray: 40.91% (0.1056 => 0.1488, std.dev.: 0.0002) SingleSource/UnitTests/vla: 35.77% (0.0355 => 0.0482) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 34.86% (2.2024 => 2.9701, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: 33.56% (0.1463 => 0.1954, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 28.98% (0.1432 => 0.1847) SingleSource/Benchmarks/McGill/chomp: 28.10% (0.1655 => 0.2120, std.dev.: 0.0010) MultiSource/Benchmarks/llubenchmark/llu: 24.03% (0.0462 => 0.0573) SingleSource/Benchmarks/Shootout/hash: 22.27% (0.0485 => 0.0593, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/rem: 22.03% (0.1144 => 0.1396, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.71% (0.1566 => 0.1906, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.23% (0.5105 => 0.6189, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 20.64% (0.1555 => 0.1876, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.55% (0.0871 => 0.1050, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 19.51% (0.6675 => 0.7977, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.92% (0.5020 => 0.5970, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 18.91% (1.3050 => 1.5518, std.dev.: 0.0072) MultiSource/Applications/d/make_dparser: 18.76% (3.3354 => 3.9611, std.dev.: 0.0088) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 18.76% (0.2271 => 0.2697, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 18.50% (0.0746 => 0.0884, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 18.49% (0.0730 => 0.0865, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 18.21% (0.1175 => 0.1389, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 18.19% (0.7115 => 0.8409, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/08-main/main: 18.01% (0.2554 => 0.3014, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.88% (0.1337 => 0.1576, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 17.80% (0.1236 => 0.1456, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 17.55% (0.1584 => 0.1862, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 17.51% (1.1840 => 1.3913, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.50% (1.5415 => 1.8113, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/em3d/em3d: 17.46% (0.1695 => 0.1991, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: 17.41% (0.0626 => 0.0735, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.40% (0.0793 => 0.0931, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.27% (0.4615 => 0.5412, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.22% (0.1510 => 0.1770, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 17.18% (0.4879 => 0.5717, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.15% (0.1032 => 0.1209, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 17.11% (0.1163 => 0.1362, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.03% (0.8172 => 0.9564, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 16.97% (0.3177 => 0.3716, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 16.82% (0.3109 => 0.3632, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 16.56% (0.2603 => 0.3034, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.51% (0.6450 => 0.7515, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ft/ft: 16.49% (0.1940 => 0.2260, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 16.26% (22.1758 => 25.7817, std.dev.: 0.0166) MultiSource/Applications/aha/aha: 16.16% (0.1151 => 0.1337, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.15% (0.0675 => 0.0784, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.14% (0.0886 => 0.1029, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 16.00% (0.1906 => 0.2211, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.96% (0.3121 => 0.3619, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 15.60% (0.0814 => 0.0941, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.59% (0.0648 => 0.0749, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.56% (0.0842 => 0.0973, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 15.56% (0.1125 => 0.1300, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 15.48% (1.0722 => 1.2382, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.43% (0.9765 => 1.1272, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: 15.40% (1.1642 => 1.3435, std.dev.: 0.0127) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 15.34% (0.1695 => 0.1955, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 15.30% (2.0273 => 2.3375, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.08% (0.2758 => 0.3174, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/football/football: 15.05% (0.8921 => 1.0264, std.dev.: 0.0013) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.05% (0.1143 => 0.1315, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 15.00% (0.7835 => 0.9010, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/18-imp/imp: 14.96% (0.3423 => 0.3935, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.95% (0.2107 => 0.2422, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.89% (0.2700 => 0.3102, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 14.88% (0.0672 => 0.0772, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.86% (0.1117 => 0.1283, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 14.66% (1.4186 => 1.6266, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.65% (1.1861 => 1.3599, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.62% (0.5860 => 0.6717, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.60% (0.1062 => 0.1217, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.55% (0.0770 => 0.0882, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 14.54% (0.4299 => 0.4924, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.49% (0.0759 => 0.0869, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.47% (0.0933 => 0.1068, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.46% (0.1625 => 0.1860, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.43% (0.2065 => 0.2363, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/lpbench: 14.42% (0.0929 => 0.1063, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.36% (0.1330 => 0.1521, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 14.35% (0.7433 => 0.8500, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.26% (0.5981 => 0.6834, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.02% (4.2646 => 4.8623, std.dev.: 0.0058) MultiSource/Applications/lua/lua: 13.99% (3.8723 => 4.4141, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.97% (0.3307 => 0.3769, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.90% (0.1029 => 0.1172, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 13.70% (0.3387 => 0.3851, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.66% (0.0798 => 0.0907, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 13.46% (9.4845 => 10.7613, std.dev.: 0.0200) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.38% (0.3826 => 0.4338, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.38% (0.0770 => 0.0873, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.22% (0.5569 => 0.6305, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/health/health: 13.09% (0.1268 => 0.1434, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.70% (0.3441 => 0.3878, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 12.65% (0.3092 => 0.3483, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 12.53% (0.0838 => 0.0943, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 12.07% (0.0953 => 0.1068, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.05% (0.1892 => 0.2120, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 12.01% (0.3180 => 0.3562, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.68% (0.8101 => 0.9047, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 11.53% (2.2969 => 2.5618, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.50% (2.2022 => 2.4555, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 11.42% (0.4289 => 0.4779, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/bigfib: 11.42% (0.6456 => 0.7193, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 11.36% (0.4620 => 0.5145, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.25% (14.3668 => 15.9825, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.01% (5.0018 => 5.5525, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.00% (4.9449 => 5.4886, std.dev.: 0.0128) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.87% (0.4636 => 0.5140, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 10.75% (17.1811 => 19.0279, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/lists: 10.58% (0.3422 => 0.3784, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.48% (0.3427 => 0.3786, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.16% (0.3927 => 0.4326, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.09% (0.3865 => 0.4255, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.99% (0.4203 => 0.4623, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 9.98% (1.5603 => 1.7160, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/lists1: 9.88% (0.3684 => 0.4048, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 9.87% (0.3828 => 0.4206, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.85% (0.3473 => 0.3815, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.77% (0.3543 => 0.3889, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.75% (0.3497 => 0.3838, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 9.74% (0.3561 => 0.3908) SingleSource/Benchmarks/Shootout-C++/moments: 9.73% (0.4048 => 0.4442, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.69% (0.3694 => 0.4052, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 9.68% (0.3543 => 0.3886, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 9.67% (0.3516 => 0.3856, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.58% (0.2266 => 0.2483, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.55% (0.4103 => 0.4495, std.dev.: 0.0108) SingleSource/UnitTests/ObjC/property: 9.52% (0.3886 => 0.4256, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.15% (0.7326 => 0.7996, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.11% (3.8922 => 4.2468, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/sieve: 8.94% (0.3603 => 0.3925, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 8.84% (0.5925 => 0.6449, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.78% (0.4064 => 0.4421, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.77% (0.2430 => 0.2643, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.61% (0.6030 => 0.6549, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.20% (0.2793 => 0.3022, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 8.04% (0.3098 => 0.3347, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.95% (0.3650 => 0.3940, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 7.92% (0.3282 => 0.3542, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 7.89% (0.3283 => 0.3542, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.88% (0.2831 => 0.3054, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.78% (0.2905 => 0.3131, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.70% (0.3232 => 0.3481, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.59% (0.2714 => 0.2920, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.53% (0.3162 => 0.3400, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.47% (0.2891 => 0.3107, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.38% (2.0665 => 2.2191, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 7.30% (0.2725 => 0.2924, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.22% (0.2756 => 0.2955, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 7.18% (0.2871 => 0.3077, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 7.09% (1.2842 => 1.3753, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 7.04% (0.3052 => 0.3267, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.02% (0.2877 => 0.3079, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.87% (0.8067 => 0.8621, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 6.87% (0.3379 => 0.3611, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 6.71% (0.2802 => 0.2990, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.90% (0.3136 => 0.3321, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 5.76% (0.2049 => 0.2167, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.28% (7.9617 => 8.3823, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 5.24% (0.3131 => 0.3295, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.74% (7.0540 => 7.3886, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.24% (0.3935 => 0.4102, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.08% (1.1145 => 1.3717, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 10.21% (0.9957 => 1.0974, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: 10.04% (1.1396 => 1.2540, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.95% (2.8904 => 3.0913, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 6.71% (3.1578 => 3.3697, std.dev.: 0.0174) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: 4.50% (3.3453 => 3.4960, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 3.00% (1.9405 => 1.9987, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.65% (4.2280 => 4.3402, std.dev.: 0.0082) MultiSource/Applications/viterbi/viterbi: 2.49% (4.4649 => 4.5760, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bisort/bisort: 1.79% (0.8333 => 0.8482, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2078, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.39% (9.1159 => 9.2426, std.dev.: 0.0110) MultiSource/Benchmarks/nbench/nbench: 1.30% (11.6436 => 11.7945, std.dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -76.94% (0.8651 => 0.1995, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -54.52% (5.3855 => 2.4494, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -54.19% (5.3526 => 2.4521, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: -45.07% (0.1622 => 0.0891, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.24% (1.1194 => 0.6802, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.07% (5.2763 => 3.2148, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -23.25% (1.7609 => 1.3515, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -17.22% (2.9384 => 2.4325, std.dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -9.12% (54.1659 => 49.2274, std.dev.: 0.0248) MultiSource/Applications/JM/ldecod/ldecod: -7.96% (10.4361 => 9.6058, std.dev.: 0.0063) MultiSource/Benchmarks/PAQ8p/paq8p: -7.27% (10.3673 => 9.6133, std.dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -54.04% (8.0499 => 3.6995, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0134, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -33.30% (1.1492 => 0.7665, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.61% (0.0506 => 0.0341) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.38% (0.3987 => 0.2696, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.51% (2.9695 => 2.3605, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -19.00% (1.2258 => 0.9929, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4233, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.44% (1.2373 => 1.0958, std.dev.: 0.0032) MultiSource/Benchmarks/NPB-serial/is/is: -10.98% (9.5636 => 8.5131, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/mandel-2: -10.80% (1.5373 => 1.3712, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.33% (19.9488 => 18.2865, std.dev.: 0.0245) MultiSource/Benchmarks/FreeBench/mason/mason: -7.82% (0.2161 => 0.1992, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.15% (1.8329 => 1.7018, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -5.46% (6.6465 => 6.2833, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.08% (1.6805 => 1.5951, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.89% (0.2497 => 0.2375, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5071, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.83% (3.2827 => 3.1571, std.dev.: 0.0089) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.72% (8.1563 => 7.8527, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.51% (32.5116 => 31.3699, std.dev.: 0.0115) MultiSource/Benchmarks/sim/sim: -3.33% (5.0483 => 4.8804, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -2.87% (4.6441 => 4.5109, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.82% (4.5009 => 4.3741, std.dev.: 0.0018) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.70% (0.4808 => 0.4678, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/multiplies: -1.97% (2.5528 => 2.5026, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -1.94% (10.2830 => 10.0837, std.dev.: 0.0140) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6801, std.dev.: 0.0030) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (85.0658 => 83.9862, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.18% (1.7254 => 1.7051, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8570, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/power/power: -1.01% (1.1277 => 1.1163, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.01% (6.2999 => 6.2364, std.dev.: 0.0029) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.10% (7.1582 => 7.8096, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: 10629.58% (0.0720 => 7.7253, std.dev.: 0.0026) MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -66.82% (0.2116 => 0.0702, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 2.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 22:54:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 28 Oct 2012 00:54:26 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121028055426.471D12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5323?compare_to=5319&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5323, Order: 166895, Start Time: 2012-10-28 04:30:08, End Time: 2012-10-28 05:54:25 To: 5319, Order: 166894, Start Time: 2012-10-28 02:49:34, End Time: 2012-10-28 04:13:22 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 1 (84 on baseline) Performance Improvements: 4 (5 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 970 (885 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/Burg/burg: 1.99% (1.2495 => 1.2744, std.dev.: 0.0091) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -1.49% (0.8719 => 0.8589, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.29% (0.8941 => 0.8826, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.06% (1.5100 => 1.4940, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: -5.81% (0.8009 => 0.7544, std.dev.: 0.0123) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.40% (16.7249 => 16.6584, std.dev.: 0.1222) MultiSource/Applications/obsequi/Obsequi: 0.48% (1.0723 => 1.0774, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: -0.32% (0.6511 => 0.6490, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/08-main/main: -1.20% (0.1922 => 0.1899, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.81% (0.1627 => 0.1689, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.60% (0.3197 => 0.3248, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.06% (0.2393 => 0.2514, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.54% (0.3389 => 0.3303, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.16% (0.2440 => 0.2436, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: -0.41% (0.6063 => 0.6038, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/mandel: -2.83% (0.0459 => 0.0446, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.03% (0.3352 => 0.3351, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/strcat: -0.10% (0.2024 => 0.2022, std.dev.: 0.0026) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -4.43% (0.0203 => 0.0194, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.46% (0.0219 => 0.0218, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 19.89% (0.0357 => 0.0428, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.30% (0.0334 => 0.0333, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0314 => 0.0314, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 4.18% (0.0407 => 0.0424, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -1.93% (0.0207 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 2.26% (0.0133 => 0.0136, std.dev.: 0.0039) SingleSource/UnitTests/byval-alignment: 5.41% (0.0314 => 0.0331, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 0.35% (0.1440 => 0.1445, std.dev.: 0.0030) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -0.67% (1.1188 => 1.1113, std.dev.: 0.0249) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.81% (0.1478 => 0.1490, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.42% (0.4032 => 0.4015, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.67% (0.1308 => 0.1356, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.17% (0.0597 => 0.0596, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 5.53% (0.0217 => 0.0229, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.20% (0.0546 => 0.0558, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.54% (1.1435 => 1.1373, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 157.14% (0.0007 => 0.0018, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.67% (0.0601 => 0.0597, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.13% (0.0188 => 0.0192, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.92% (0.8017 => 0.7943, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -32.73% (0.0055 => 0.0037, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.91% (2.1832 => 1.6612, std.dev.: 0.0039) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 35.91% (14.7684 => 20.0711, std.dev.: 0.0734) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.06% (0.0810 => 0.0932, std.dev.: 0.0021) SingleSource/UnitTests/SignlessTypes/rem: 14.40% (0.1035 => 0.1184, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 7.53% (1.2568 => 1.3514, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.28% (0.2180 => 0.2317, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.67% (0.7473 => 0.7897, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.40% (0.1983 => 0.2090, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.28% (13.1811 => 13.8766, std.dev.: 0.0455) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.23% (1.1170 => 1.1754, std.dev.: 0.0119) MultiSource/Applications/spiff/spiff: 5.21% (0.7950 => 0.8364, std.dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.20% (0.3137 => 0.3300, std.dev.: 0.0049) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.99% (6.6074 => 6.9369, std.dev.: 0.0598) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.82% (0.2741 => 0.2873, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.80% (0.2519 => 0.2640, std.dev.: 0.0024) MultiSource/Applications/hbd/hbd: 4.50% (1.4269 => 1.4911, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.34% (0.4127 => 0.4306, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 4.27% (1.2222 => 1.2744, std.dev.: 0.0091) MultiSource/Benchmarks/nbench/nbench: 4.17% (1.1271 => 1.1741, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.12% (0.4559 => 0.4747, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.01% (0.3717 => 0.3866, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 3.91% (14.2605 => 14.8179, std.dev.: 0.1219) MultiSource/Applications/d/make_dparser: 3.89% (3.2366 => 3.3625, std.dev.: 0.0363) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.81% (0.4783 => 0.4965, std.dev.: 0.0046) MultiSource/Applications/treecc/treecc: 3.80% (1.9948 => 2.0706, std.dev.: 0.0251) MultiSource/Benchmarks/Prolangs-C/football/football: 3.78% (0.8768 => 0.9099, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.68% (1.6386 => 1.6989, std.dev.: 0.0122) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.54% (0.5191 => 0.5375, std.dev.: 0.0034) MultiSource/Applications/minisat/minisat: 3.42% (0.6834 => 0.7068, std.dev.: 0.0019) MultiSource/Applications/lua/lua: 3.39% (3.8189 => 3.9484, std.dev.: 0.0327) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.21% (1.1685 => 1.2060, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 3.20% (0.9688 => 0.9998, std.dev.: 0.0028) MultiSource/Applications/lemon/lemon: 3.19% (1.0945 => 1.1294, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.18% (1.4479 => 1.4940, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.13% (0.8697 => 0.8969, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.04% (0.6586 => 0.6786, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.85% (1.3279 => 1.3658, std.dev.: 0.0127) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.83% (0.8340 => 0.8576, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.81% (0.8007 => 0.8232, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/hash2: 2.79% (0.4125 => 0.4240, std.dev.: 0.0042) MultiSource/Benchmarks/mafft/pairlocalalign: 2.72% (8.6247 => 8.8593, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout-C++/hash: 2.71% (0.3800 => 0.3903, std.dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 2.70% (0.9810 => 1.0075, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.68% (0.8204 => 0.8424, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.66% (0.8597 => 0.8826, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.62% (0.8611 => 0.8837, std.dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: 2.57% (6.7320 => 6.9048, std.dev.: 0.0213) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.54% (0.8457 => 0.8672, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.45% (0.8855 => 0.9072, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.45% (0.8050 => 0.8247, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.44% (0.8518 => 0.8726, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.44% (0.8317 => 0.8520, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.44% (0.8331 => 0.8534, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.39% (0.8069 => 0.8262, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.28% (0.7966 => 0.8148, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.28% (0.8805 => 0.9006, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.28% (0.8086 => 0.8270, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.27% (0.9908 => 1.0133, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.16% (0.8716 => 0.8904, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.13% (0.8177 => 0.8351, std.dev.: 0.0062) MultiSource/Applications/JM/lencod/lencod: 2.08% (15.3280 => 15.6474, std.dev.: 0.0458) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.08% (0.8286 => 0.8458, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.04% (0.8316 => 0.8486, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.04% (3.1832 => 3.2481, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.01% (0.8420 => 0.8589, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.96% (0.8066 => 0.8224, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.94% (2.1401 => 2.1817, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.93% (0.8927 => 0.9099, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 1.92% (4.9628 => 5.0580, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.84% (1.2423 => 1.2652, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.83% (4.1763 => 4.2527, std.dev.: 0.0237) MultiSource/Benchmarks/Bullet/bullet: 1.75% (31.8598 => 32.4162, std.dev.: 0.0834) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.74% (1.5315 => 1.5581, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.64% (4.4873 => 4.5611, std.dev.: 0.0270) MultiSource/Benchmarks/PAQ8p/paq8p: 1.63% (2.3764 => 2.4151, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.50% (0.8048 => 0.8169, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.63% (1.5795 => 2.5056, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.08% (1.1857 => 1.2815, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.94% (0.3186 => 0.3439, std.dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 5.95% (63.1822 => 66.9392, std.dev.: 0.0141) MultiSource/Applications/siod/siod: 2.69% (3.6643 => 3.7630, std.dev.: 0.0125) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.43% (2.4490 => 2.5086, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/bh/bh: 1.74% (2.3560 => 2.3970, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.28% (59.2638 => 60.0222, std.dev.: 0.2090) SingleSource/Benchmarks/Misc/richards_benchmark: 1.09% (1.3037 => 1.3179, std.dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -30.47% (0.0338 => 0.0235, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.23% (0.3269 => 0.3000, std.dev.: 0.0020) MultiSource/Applications/lua/lua: -5.19% (29.8330 => 28.2834, std.dev.: 0.0697) SingleSource/Benchmarks/Shootout-C++/hash2: -1.51% (3.4237 => 3.3720, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.29% (3.3479 => 3.3047, std.dev.: 0.0067) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 1.29% (16.4461 => 16.6584, std.dev.: 0.1222) MultiSource/Applications/obsequi/Obsequi: 4.99% (1.0262 => 1.0774, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 2.50% (0.6332 => 0.6490, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/08-main/main: 3.71% (0.1831 => 0.1899, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 8.34% (0.1559 => 0.1689, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.00% (0.3123 => 0.3248, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.07% (0.2463 => 0.2514, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.23% (0.3344 => 0.3303, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.05% (0.2364 => 0.2436, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 0.47% (0.6010 => 0.6038, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/mandel: 3.96% (0.0429 => 0.0446, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.60% (0.3266 => 0.3351, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/strcat: 2.69% (0.1969 => 0.2022, std.dev.: 0.0026) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -13.39% (0.0224 => 0.0194, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0384 => 0.0424, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -24.44% (0.0180 => 0.0136, std.dev.: 0.0039) SingleSource/UnitTests/byval-alignment: 43.91% (0.0230 => 0.0331, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 0.49% (0.1438 => 0.1445, std.dev.: 0.0030) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -1.91% (1.1329 => 1.1113, std.dev.: 0.0249) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.92% (0.1462 => 0.1490, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.58% (0.4164 => 0.4015, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.95% (0.1369 => 0.1356, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.02% (0.0641 => 0.0596, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 17.44% (0.0195 => 0.0229, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.46% (0.0578 => 0.0558, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.56% (1.1437 => 1.1373, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 28.57% (0.0014 => 0.0018, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.78% (0.0627 => 0.0597, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.67% (0.0180 => 0.0192, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.92% (0.8017 => 0.7943, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -40.32% (0.0062 => 0.0037, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Oct 27 23:09:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 28 Oct 2012 01:09:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121028060932.AF33D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5324?compare_to=5320&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5324, Order: 166895, Start Time: 2012-10-28 04:44:02, End Time: 2012-10-28 06:09:29 To: 5320, Order: 166894, Start Time: 2012-10-28 02:55:57, End Time: 2012-10-28 04:21:09 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (7 on baseline) Performance Improvements: 1 (178 on baseline) Unchanged Tests: 1040 (857 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.68% (54.4710 => 56.4748, std.dev.: 0.1588) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.10% (1.2924 => 1.2653, std.dev.: 0.0103) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.14% (15.2527 => 18.3246, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.48% (54.5751 => 56.4748, std.dev.: 0.1588) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.78% (2.0478 => 2.1048, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/salsa20: 2.35% (7.4937 => 7.6695, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/hash2: 1.90% (3.1932 => 3.2540, std.dev.: 0.0131) MultiSource/Benchmarks/llubenchmark/llu: 1.25% (3.7435 => 3.7904, std.dev.: 0.0126) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.71% (0.1584 => 0.1446, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.53% (0.1431 => 0.1309, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.56% (0.3821 => 0.3532, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -7.27% (0.3880 => 0.3598, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -7.26% (0.3831 => 0.3553, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -7.19% (0.3812 => 0.3538, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.16% (0.3884 => 0.3606, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -7.14% (0.3896 => 0.3618, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -7.12% (0.3848 => 0.3574, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.12% (0.3891 => 0.3614, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -7.07% (0.4033 => 0.3748, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -6.94% (0.4176 => 0.3886, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -6.88% (0.4199 => 0.3910, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.88% (0.2428 => 0.2261, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -6.75% (0.4280 => 0.3991, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.75% (0.3142 => 0.2930, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -6.74% (2.4924 => 2.3244, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.59% (0.3658 => 0.3417, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.44% (22.4056 => 20.9625, std.dev.: 0.0129) MultiSource/Benchmarks/McCat/08-main/main: -6.32% (0.2659 => 0.2491, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.21% (4.5069 => 4.2268, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.10% (5.4682 => 5.1349, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: -6.10% (4.3330 => 4.0689, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.08% (0.6484 => 0.6090, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.07% (0.2355 => 0.2212, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -6.06% (2.4021 => 2.2566, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: -6.01% (0.1879 => 0.1766, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.00% (0.2548 => 0.2395, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.00% (0.1716 => 0.1613, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -5.99% (7.0961 => 6.6712, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.97% (0.3837 => 0.3608, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -5.94% (1.2515 => 1.1771, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.93% (0.5999 => 0.5643, std.dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: -5.93% (0.3357 => 0.3158, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.92% (0.7919 => 0.7450, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -5.92% (0.3025 => 0.2846) SingleSource/Benchmarks/Shootout-C++/except: -5.92% (0.3026 => 0.2847, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.90% (4.8161 => 4.5318, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.90% (0.9852 => 0.9271, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.88% (3.5339 => 3.3260, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: -5.85% (0.2989 => 0.2814, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.84% (4.8802 => 4.5951, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.83% (0.4151 => 0.3909, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.83% (1.6474 => 1.5514, std.dev.: 0.0194) MultiSource/Applications/JM/lencod/lencod: -5.83% (16.1920 => 15.2487, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.81% (0.4321 => 0.4070, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -5.79% (0.2160 => 0.2035, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.78% (0.3252 => 0.3064) MultiSource/Applications/hexxagon/hexxagon: -5.78% (1.3148 => 1.2388, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.78% (0.4083 => 0.3847, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.77% (2.1713 => 2.0460, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.76% (1.0544 => 0.9937, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/random: -5.75% (0.2939 => 0.2770, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -5.75% (0.2871 => 0.2706, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.74% (0.3849 => 0.3628, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -5.73% (0.3194 => 0.3011, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -5.72% (0.2849 => 0.2686, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -5.70% (0.2985 => 0.2815, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -5.68% (0.3255 => 0.3070, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.67% (0.3016 => 0.2845, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.66% (0.3057 => 0.2884, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.65% (0.2903 => 0.2739, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -5.65% (0.3205 => 0.3024, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.63% (0.9542 => 0.9005, std.dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: -5.61% (34.0927 => 32.1816, std.dev.: 0.0079) MultiSource/Applications/lua/lua: -5.60% (4.0594 => 3.8320, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: -5.60% (0.4861 => 0.4589, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.58% (4.0323 => 3.8071, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/ary3: -5.57% (0.3446 => 0.3254, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.55% (1.2210 => 1.1532, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.55% (0.8521 => 0.8048, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.55% (1.2221 => 1.1543, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.55% (1.2784 => 1.2075, std.dev.: 0.0041) MultiSource/Applications/kimwitu++/kc: -5.52% (18.2933 => 17.2835, std.dev.: 0.0189) SingleSource/Benchmarks/Misc-C++/bigfib: -5.50% (0.6750 => 0.6379, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -5.48% (0.3394 => 0.3208, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.48% (0.3323 => 0.3141, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: -5.47% (0.3621 => 0.3423, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -5.46% (0.3059 => 0.2892, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.44% (0.2999 => 0.2836, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -5.40% (0.3481 => 0.3293, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -5.36% (0.7982 => 0.7554, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.34% (1.6364 => 1.5490, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.32% (2.2587 => 2.1386, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.31% (0.2278 => 0.2157, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.31% (0.7198 => 0.6816, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.30% (0.4813 => 0.4558, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.29% (1.4642 => 1.3868, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.23% (0.6293 => 0.5964, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/sieve: -5.23% (0.3788 => 0.3590, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -5.20% (0.4248 => 0.4027, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -5.17% (0.3867 => 0.3667, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.14% (1.3722 => 1.3017, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.13% (0.2106 => 0.1998, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.13% (0.4427 => 0.4200, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -5.12% (9.2283 => 8.7555, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.11% (0.3931 => 0.3730, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.07% (0.3491 => 0.3314, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: -5.05% (0.3581 => 0.3400, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.01% (0.2933 => 0.2786, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.00% (0.3319 => 0.3153, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -4.96% (0.7779 => 0.7393, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.92% (0.4916 => 0.4674, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -4.88% (0.6347 => 0.6037, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -4.72% (0.6441 => 0.6137, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: -4.67% (0.4515 => 0.4304, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.65% (0.9557 => 0.9113, std.dev.: 0.0038) MultiSource/Applications/spiff/spiff: -4.64% (0.8418 => 0.8027, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.63% (0.5805 => 0.5536, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.61% (0.2385 => 0.2275, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.60% (0.5478 => 0.5226, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.60% (0.6676 => 0.6369, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: -4.60% (0.4524 => 0.4316, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.56% (0.6660 => 0.6356, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.56% (0.5859 => 0.5592, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.55% (0.5581 => 0.5327, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.53% (0.6297 => 0.6012, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: -4.52% (0.3271 => 0.3123, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: -4.52% (1.1450 => 1.0932, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.51% (0.6230 => 0.5949, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.51% (0.5857 => 0.5593, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.51% (0.5591 => 0.5339, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.50% (0.5705 => 0.5448, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.50% (0.5863 => 0.5599, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.49% (0.5456 => 0.5211, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.48% (0.2277 => 0.2175, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.46% (0.5925 => 0.5661, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.45% (0.5575 => 0.5327, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.45% (0.5802 => 0.5544, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.42% (0.9077 => 0.8676, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.42% (0.5570 => 0.5324, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.41% (0.6260 => 0.5984, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.40% (0.3406 => 0.3256, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: -4.40% (0.9179 => 0.8775, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.40% (0.5569 => 0.5324, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.39% (0.6189 => 0.5917, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.39% (0.6667 => 0.6374, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.39% (0.6304 => 0.6027, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.39% (0.5941 => 0.5680, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: -4.39% (0.7447 => 0.7120, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -4.38% (15.5079 => 14.8290, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.37% (0.7339 => 0.7018, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.36% (0.6440 => 0.6159, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.36% (0.6194 => 0.5924, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.33% (8.0126 => 7.6654, std.dev.: 0.0016) MultiSource/Applications/treecc/treecc: -4.33% (2.1401 => 2.0475, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.31% (0.6052 => 0.5791, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.31% (0.5849 => 0.5597, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.31% (0.5688 => 0.5443, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.28% (0.6395 => 0.6121, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.28% (0.5567 => 0.5329, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.24% (0.6033 => 0.5777, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.23% (0.6736 => 0.6451, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.17% (0.7524 => 0.7210, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.15% (0.6681 => 0.6404, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.12% (6.7716 => 6.4927, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.09% (0.7021 => 0.6734, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.02% (0.3483 => 0.3343, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -3.99% (17.1032 => 16.4206, std.dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.89% (1.2300 => 1.1821, std.dev.: 0.0109) MultiSource/Applications/hbd/hbd: -3.88% (1.5610 => 1.5004, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.87% (0.5168 => 0.4968, std.dev.: 0.0054) MultiSource/Applications/oggenc/oggenc: -3.77% (5.0226 => 4.8333, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: -3.75% (3.5154 => 3.3837, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.60% (0.5329 => 0.5137, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: -3.53% (1.1530 => 1.1123, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.32% (14.2083 => 13.7368, std.dev.: 0.0050) SingleSource/UnitTests/Vector/constpool: -2.45% (20.7746 => 20.2647, std.dev.: 0.0872) MultiSource/Applications/SIBsim4/SIBsim4: -1.77% (1.3864 => 1.3618, std.dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7530, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/richards_benchmark: -8.74% (1.2842 => 1.1719, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7060, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.80% (2.2633 => 2.1773, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.38% (1.3096 => 1.2653, std.dev.: 0.0103) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0245, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.50% (6.5735 => 6.4746, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.02% (3.2107 => 3.1781, std.dev.: 0.0004) Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 28 00:22:12 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 28 Oct 2012 02:22:12 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121028072212.DF5E92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5325?compare_to=5322&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5325, Order: 166896, Start Time: 2012-10-28 05:47:45, End Time: 2012-10-28 07:22:09 To: 5322, Order: 166895, Start Time: 2012-10-28 03:46:39, End Time: 2012-10-28 05:18:08 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (10 on baseline) New Passes: 0 (14 on baseline) Performance Regressions: 0 (189 on baseline) Performance Improvements: 0 (52 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 15 (5 on baseline) Unchanged Tests: 1027 (638 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -0.25% (2.0680 => 2.0629, std.dev.: 0.0462) MultiSource/Benchmarks/Bullet/bullet: 0.06% (58.2713 => 58.3051, std.dev.: 0.1073) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.13% (0.0797 => 0.0798, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 0.15% (9.2161 => 9.2303, std.dev.: 0.0451) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.08% (7.8096 => 7.8155, std.dev.: 0.0124) SingleSource/UnitTests/Vector/SSE/sse_shift: 0.37% (0.0535 => 0.0537, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/JM/lencod/lencod: 0.03% (7.7253 => 7.7278, std.dev.: 0.1070) MultiSource/Applications/oggenc/oggenc: - (0.0001 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -7.55% (0.0702 => 0.0649, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.03% (0.2990 => 0.2991, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_shift: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -64.18% (5.7591 => 2.0629, std.dev.: 0.0462) MultiSource/Benchmarks/Bullet/bullet: -7.81% (63.2438 => 58.3051, std.dev.: 0.1073) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.81% (6.6874 => 0.0798, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.45% (8.1363 => 9.2303, std.dev.: 0.0451) SingleSource/UnitTests/Vector/SSE/sse_shift: 42.06% (0.0378 => 0.0537, std.dev.: 0.0000) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -50.00% (0.0002 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -57.04% (0.6962 => 0.2991, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_shift: -50.00% (0.0002 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 211.70% (0.5229 => 1.6299, std.dev.: 0.0374) MultiSource/Applications/SPASS/SPASS: 17.74% (14.9895 => 17.6488, std.dev.: 0.4046) MultiSource/Applications/kimwitu++/kc: 37.71% (14.1553 => 19.4928, std.dev.: 0.0353) MultiSource/Benchmarks/MallocBench/gs/gs: 13.97% (4.1105 => 4.6848, std.dev.: 0.0205) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 32.85% (1.1048 => 1.4677, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 69.64% (3.4629 => 5.8746, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 69.22% (0.6222 => 1.0529, std.dev.: 0.0018) New Passes - Execution Time --------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 3836300.00% (0.0001 => 3.8364, std.dev.: 0.0165) MultiSource/Applications/SPASS/SPASS: 11134100.00% (0.0001 => 11.1342, std.dev.: 1.2257) MultiSource/Applications/kimwitu++/kc: 50400.00% (0.0001 => 0.0505, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050100.00% (0.0001 => 10.0502, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5495200.00% (0.0001 => 5.4953, std.dev.: 0.0315) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 77.70% (0.0296 => 0.0526, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: 69.92% (0.0256 => 0.0435, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 60.52% (0.0271 => 0.0435, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 52.67% (0.0243 => 0.0371, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 43.82% (1.5859 => 2.2809, std.dev.: 0.0033) SingleSource/Regression/C/sumarray: 43.72% (0.0231 => 0.0332, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.49% (0.0834 => 0.1180, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: 40.62% (0.1056 => 0.1485, std.dev.: 0.0011) SingleSource/UnitTests/vla: 35.49% (0.0355 => 0.0481, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 34.78% (2.2024 => 2.9685, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: 33.70% (0.1463 => 0.1956, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 28.98% (0.1432 => 0.1847, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 28.10% (0.1655 => 0.2120, std.dev.: 0.0007) MultiSource/Benchmarks/llubenchmark/llu: 24.03% (0.0462 => 0.0573, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: 22.47% (0.0485 => 0.0594, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/rem: 22.03% (0.1144 => 0.1396, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.46% (0.1566 => 0.1902, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.41% (0.5105 => 0.6198, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 20.96% (0.1555 => 0.1881, std.dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.67% (0.0871 => 0.1051, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 19.57% (0.6675 => 0.7981, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 19.07% (1.3050 => 1.5539, std.dev.: 0.0017) MultiSource/Applications/d/make_dparser: 18.88% (3.3354 => 3.9651, std.dev.: 0.0780) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.86% (0.5020 => 0.5967, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 18.85% (0.2271 => 0.2699, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/almabench: 18.77% (0.0730 => 0.0867) MultiSource/Benchmarks/Olden/tsp/tsp: 18.55% (0.1175 => 0.1393, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 18.50% (0.0746 => 0.0884, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 18.34% (0.7115 => 0.8420, std.dev.: 0.0295) MultiSource/Benchmarks/McCat/08-main/main: 18.29% (0.2554 => 0.3021, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 18.03% (0.1337 => 0.1578, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 17.96% (0.1236 => 0.1458, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.81% (1.5415 => 1.8161, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/em3d/em3d: 17.70% (0.1695 => 0.1995, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 17.68% (0.1584 => 0.1864, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.65% (0.0793 => 0.0933, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.54% (0.1032 => 0.1213, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.49% (0.4615 => 0.5422, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.48% (0.1510 => 0.1774, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 17.47% (1.1840 => 1.3909, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/mst/mst: 17.45% (0.1163 => 0.1366, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: 17.41% (0.0626 => 0.0735, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.27% (0.0886 => 0.1039, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 17.20% (0.4879 => 0.5718, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.03% (0.8172 => 0.9564, std.dev.: 0.0095) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 17.00% (0.3177 => 0.3717, std.dev.: 0.0026) MultiSource/Applications/sgefa/sgefa: 16.95% (0.3109 => 0.3636, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/ft/ft: 16.65% (0.1940 => 0.2263, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 16.63% (0.2603 => 0.3036, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.62% (0.6450 => 0.7522, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 16.26% (0.1906 => 0.2216, std.dev.: 0.0037) MultiSource/Applications/aha/aha: 16.25% (0.1151 => 0.1338, std.dev.: 0.0050) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.15% (0.3121 => 0.3625, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.15% (0.0675 => 0.0784, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 16.03% (0.0842 => 0.0977, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.90% (0.0648 => 0.0751, std.dev.: 0.0023) MultiSource/Applications/Burg/burg: 15.76% (1.1642 => 1.3477, std.dev.: 0.0478) MultiSource/Applications/lemon/lemon: 15.62% (1.0722 => 1.2397, std.dev.: 0.0209) SingleSource/Benchmarks/McGill/exptree: 15.60% (0.0814 => 0.0941, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.50% (0.9765 => 1.1279, std.dev.: 0.0050) MultiSource/Applications/spiff/spiff: 15.47% (0.7835 => 0.9047, std.dev.: 0.0299) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.40% (0.1117 => 0.1289, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 15.34% (0.1695 => 0.1955, std.dev.: 0.0052) MultiSource/Applications/treecc/treecc: 15.32% (2.0273 => 2.3379, std.dev.: 0.0720) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 15.29% (0.1125 => 0.1297, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.19% (0.2758 => 0.3177, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.19% (0.2107 => 0.2427, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: 15.04% (0.8921 => 1.0263, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 15.03% (0.0672 => 0.0773, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.93% (0.2700 => 0.3103, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.86% (0.5860 => 0.6731, std.dev.: 0.0066) MultiSource/Benchmarks/McCat/18-imp/imp: 14.84% (0.3423 => 0.3931, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.78% (0.1062 => 0.1219, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.74% (1.1861 => 1.3609, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.72% (0.2065 => 0.2369, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 14.72% (1.4186 => 1.6274, std.dev.: 0.0108) SingleSource/Benchmarks/CoyoteBench/lpbench: 14.64% (0.0929 => 0.1065, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 14.58% (0.4299 => 0.4926, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.55% (0.0770 => 0.0882, std.dev.: 0.0018) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.52% (0.1143 => 0.1309, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 14.48% (22.1758 => 25.3860, std.dev.: 0.5475) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.46% (0.5981 => 0.6846, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.46% (0.1625 => 0.1860, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.36% (0.0933 => 0.1067, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.36% (0.0759 => 0.0868, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 14.31% (0.7433 => 0.8497, std.dev.: 0.0255) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.29% (0.1029 => 0.1176, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.29% (0.1330 => 0.1520, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.18% (0.3307 => 0.3776, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.17% (4.2646 => 4.8690, std.dev.: 0.0050) MultiSource/Applications/lua/lua: 14.16% (3.8723 => 4.4205, std.dev.: 0.1347) MultiSource/Benchmarks/sim/sim: 13.79% (0.3387 => 0.3854, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.72% (0.3826 => 0.4351, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 13.57% (9.4845 => 10.7714, std.dev.: 0.0197) MultiSource/Benchmarks/Olden/health/health: 13.41% (0.1268 => 0.1438, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.40% (0.5569 => 0.6315, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.38% (0.0770 => 0.0873, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 13.00% (0.3092 => 0.3494, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.85% (0.3441 => 0.3883, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 12.53% (0.0838 => 0.0943, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 12.38% (0.0953 => 0.1071, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 12.26% (0.3180 => 0.3570, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 11.95% (0.4620 => 0.5172, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.79% (0.1892 => 0.2115, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 11.59% (0.6456 => 0.7204, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 11.57% (2.2969 => 2.5627, std.dev.: 0.0927) SingleSource/Benchmarks/Shootout-C++/hash: 11.54% (0.4289 => 0.4784, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.45% (2.2022 => 2.4544, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/parameter-passing: 11.33% (0.3927 => 0.4372, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.29% (0.8101 => 0.9016, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.28% (4.9449 => 5.5028, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.28% (14.3668 => 15.9871, std.dev.: 0.0065) SingleSource/UnitTests/ObjC/exceptions-4: 11.18% (0.3543 => 0.3939, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/trivial-interface: 11.17% (0.3473 => 0.3861, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.13% (5.0018 => 5.5585, std.dev.: 0.0125) SingleSource/UnitTests/ObjC/synchronized: 11.04% (0.3561 => 0.3954, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 11.02% (0.3422 => 0.3799, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.01% (0.3543 => 0.3933, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.00% (0.3828 => 0.4249, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.95% (0.3497 => 0.3880, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.95% (0.3516 => 0.3901, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.94% (0.3694 => 0.4098, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.91% (0.4636 => 0.5142, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.82% (0.1044 => 0.1157, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 10.67% (17.1811 => 19.0147, std.dev.: 0.4340) SingleSource/UnitTests/ObjC/property: 10.63% (0.3886 => 0.4299, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.59% (0.3427 => 0.3790, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.56% (0.3865 => 0.4273, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.37% (0.4203 => 0.4639, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 10.15% (0.3684 => 0.4058, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 10.11% (1.5603 => 1.7180, std.dev.: 0.0471) SingleSource/UnitTests/ObjC++/property-reference: 10.02% (0.7326 => 0.8060, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 10.00% (0.4048 => 0.4453, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.82% (0.4103 => 0.4506, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.75% (0.2266 => 0.2487, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 9.74% (0.5925 => 0.6502, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.45% (0.6030 => 0.6600, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 9.33% (0.3603 => 0.3939, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.15% (0.4064 => 0.4436, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.00% (3.8922 => 4.2424, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.85% (0.2430 => 0.2645, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.77% (0.2793 => 0.3038, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 8.55% (0.3098 => 0.3363, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.44% (0.3650 => 0.3958, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 8.35% (0.3283 => 0.3557, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 8.34% (0.2831 => 0.3067, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 8.20% (0.3232 => 0.3497, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.97% (0.3162 => 0.3414, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.96% (0.2891 => 0.3121, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.87% (0.2872 => 0.3098, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 7.85% (0.2905 => 0.3133, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: 7.84% (0.2871 => 0.3096, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.79% (2.0665 => 2.2274, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/fibo: 7.71% (0.2725 => 0.2935, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 7.70% (0.3052 => 0.3287, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.69% (0.2756 => 0.2968, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 7.63% (0.2714 => 0.2921, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 7.59% (0.3282 => 0.3531, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 7.58% (0.2877 => 0.3095) SingleSource/Benchmarks/Shootout-C++/ary2: 7.34% (0.3379 => 0.3627, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 7.32% (0.2802 => 0.3007, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.08% (0.8067 => 0.8638, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.31% (0.3136 => 0.3334, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/ReedSolomon: 5.71% (0.2049 => 0.2166, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.65% (0.3131 => 0.3308, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.43% (7.9617 => 8.3942, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.64% (7.0540 => 7.3811, std.dev.: 0.0243) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.50% (0.3935 => 0.4112, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.38% (0.3817 => 0.3946, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.12% (1.1145 => 1.3722, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 10.22% (0.9957 => 1.0975, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/richards_benchmark: 9.93% (1.1396 => 1.2528, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.94% (2.8904 => 3.0911, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.1578 => 3.3686, std.dev.: 0.0031) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: 4.50% (3.3453 => 3.4960, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 2.98% (1.9405 => 1.9984, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.67% (4.2280 => 4.3408, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 2.47% (4.4649 => 4.5753, std.dev.: 0.0084) MultiSource/Benchmarks/Olden/bisort/bisort: 1.81% (0.8333 => 0.8484, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 1.54% (3.1595 => 3.2080, std.dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: 1.31% (11.6436 => 11.7957, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.05% (6.5088 => 6.5771, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -77.03% (0.8651 => 0.1987, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -54.54% (5.3855 => 2.4485, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -54.24% (5.3526 => 2.4495, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/richards_benchmark: -45.01% (0.1622 => 0.0892, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.31% (1.1194 => 0.6794, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.11% (5.2763 => 3.2127, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -23.28% (1.7609 => 1.3509, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -17.27% (2.9384 => 2.4310, std.dev.: 0.0025) SingleSource/UnitTests/Vector/constpool: -9.15% (54.1659 => 49.2104, std.dev.: 0.0350) MultiSource/Applications/JM/ldecod/ldecod: -7.88% (10.4361 => 9.6141, std.dev.: 0.1472) MultiSource/Benchmarks/PAQ8p/paq8p: -7.55% (10.3673 => 9.5849, std.dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -54.03% (8.0499 => 3.7007, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0134) SingleSource/Benchmarks/Misc/mandel: -33.46% (1.1492 => 0.7647, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.38% (0.3987 => 0.2696, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.51% (2.9695 => 2.3605, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -19.00% (1.2258 => 0.9929, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.74% (1.6925 => 1.4261, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: -11.00% (9.5636 => 8.5119, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -10.94% (1.2373 => 1.1019, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -10.79% (1.5373 => 1.3715, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.46% (19.9488 => 18.2621, std.dev.: 0.0242) MultiSource/Benchmarks/FreeBench/mason/mason: -7.82% (0.2161 => 0.1992, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.00% (1.8329 => 1.7046, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8479, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/oourafft: -5.45% (6.6465 => 6.2841, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.13% (1.6805 => 1.5943, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.89% (0.2497 => 0.2375, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.83% (1.5835 => 1.5070, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.06% (8.1563 => 7.8253, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -3.72% (3.2827 => 3.1607, std.dev.: 0.0430) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.51% (32.5116 => 31.3697, std.dev.: 0.0070) MultiSource/Benchmarks/sim/sim: -3.33% (5.0483 => 4.8803, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.81% (4.5009 => 4.3745, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.64% (0.4808 => 0.4681, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/multiplies: -1.99% (2.5528 => 2.5019, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -1.85% (10.2830 => 10.0931, std.dev.: 0.0184) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6829, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -1.28% (85.0658 => 83.9749, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.18% (1.7254 => 1.7050, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.09% (6.2999 => 6.2311, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: -1.01% (1.1277 => 1.1163, std.dev.: 0.0008) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.18% (7.1582 => 7.8155, std.dev.: 0.0124) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: 10633.06% (0.0720 => 7.7278, std.dev.: 0.1070) MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 2.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 28 00:35:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 28 Oct 2012 02:35:23 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121028073523.17BD22A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/5326?compare_to=5323&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5326, Order: 166896, Start Time: 2012-10-28 06:11:17, End Time: 2012-10-28 07:35:21 To: 5323, Order: 166895, Start Time: 2012-10-28 04:30:08, End Time: 2012-10-28 05:54:25 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 5 (106 on baseline) Performance Improvements: 2 (6 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 968 (862 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.29% (0.9633 => 0.9950, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.17% (0.5865 => 0.6051, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 2.98% (0.3358 => 0.3458, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.32% (8.8483 => 8.9647, std.dev.: 0.0278) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/BitBench/five11/five11: 1.46% (5.5792 => 5.6607, std.dev.: 0.0135) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.12% (2.7186 => 2.6611, std.dev.: 0.0153) MultiSource/Benchmarks/sim/sim: -1.14% (3.8641 => 3.8202, std.dev.: 0.0087) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.40% (16.6584 => 16.5919, std.dev.: 0.1776) MultiSource/Applications/obsequi/Obsequi: -0.18% (1.0774 => 1.0755, std.dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: -0.63% (0.6490 => 0.6449, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/08-main/main: 1.47% (0.1899 => 0.1927, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.06% (0.1689 => 0.1690, std.dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.23% (0.3248 => 0.3208, std.dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.20% (0.2514 => 0.2509, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.00% (0.3303 => 0.3402, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.94% (0.2436 => 0.2413, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/bigfib: 0.43% (0.6038 => 0.6064, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/mandel: -4.93% (0.0446 => 0.0424, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.57% (0.3351 => 0.3370, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/strcat: -0.79% (0.2022 => 0.2006, std.dev.: 0.0043) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 11.86% (0.0194 => 0.0217, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.92% (0.0218 => 0.0220, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.23% (0.0428 => 0.0429, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.60% (0.0333 => 0.0335, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.32% (0.0314 => 0.0315, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.65% (0.0424 => 0.0431, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: 1.48% (0.0203 => 0.0206, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 61.03% (0.0136 => 0.0219, std.dev.: 0.0027) SingleSource/UnitTests/byval-alignment: 8.76% (0.0331 => 0.0360, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.62% (0.1445 => 0.1454, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.94% (1.1113 => 1.1217, std.dev.: 0.0090) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -2.15% (0.1490 => 0.1458, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.06% (0.4015 => 0.4218, std.dev.: 0.0467) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.24% (0.1356 => 0.1285, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.88% (0.0596 => 0.0555, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 20.96% (0.0229 => 0.0277) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.25% (0.0558 => 0.0551, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.08% (1.1373 => 1.1382, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -77.78% (0.0018 => 0.0004, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.19% (0.0597 => 0.0566, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.25% (0.0192 => 0.0180, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.03% (0.7943 => 0.7945, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 18.92% (0.0037 => 0.0044, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.95% (2.1832 => 1.6604, std.dev.: 0.0025) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 36.50% (14.7684 => 20.1585, std.dev.: 0.1108) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.67% (0.0810 => 0.0945, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 12.77% (0.1112 => 0.1254, std.dev.: 0.0014) SingleSource/UnitTests/SignlessTypes/rem: 12.17% (0.1035 => 0.1161, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.72% (0.2180 => 0.2392, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.10% (0.3137 => 0.3391, std.dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.44% (0.1466 => 0.1575, std.dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: 7.26% (1.2568 => 1.3480, std.dev.: 0.0106) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.42% (0.8321 => 0.8855, std.dev.: 0.0119) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.40% (0.1983 => 0.2110, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.26% (0.1885 => 0.2003, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.14% (0.1905 => 0.2022, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.03% (1.1170 => 1.1844, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.92% (0.2279 => 0.2414, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.59% (6.6074 => 6.9768, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.51% (0.2741 => 0.2892, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.46% (0.9435 => 0.9950, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.41% (0.6010 => 0.6335, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.34% (13.1811 => 13.8845, std.dev.: 0.0331) MultiSource/Benchmarks/nbench/nbench: 5.19% (1.1271 => 1.1856, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.95% (0.3295 => 0.3458, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: 4.82% (0.7950 => 0.8333, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.60% (0.6287 => 0.6576, std.dev.: 0.0062) MultiSource/Applications/sgefa/sgefa: 4.50% (0.2999 => 0.3134, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.48% (0.4127 => 0.4312, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 4.38% (1.2222 => 1.2757, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/05-eks/eks: 4.37% (0.4397 => 0.4589, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.34% (0.8148 => 0.8502, std.dev.: 0.0128) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.32% (0.6227 => 0.6496, std.dev.: 0.0041) MultiSource/Applications/d/make_dparser: 4.25% (3.2366 => 3.3740, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.21% (0.4559 => 0.4751, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.02% (0.5817 => 0.6051, std.dev.: 0.0063) MultiSource/Applications/treecc/treecc: 3.97% (1.9948 => 2.0740, std.dev.: 0.0087) MultiSource/Applications/hbd/hbd: 3.92% (1.4269 => 1.4828, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.77% (1.4479 => 1.5025, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.76% (0.2794 => 0.2899, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 3.74% (0.8768 => 0.9096, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.67% (8.6476 => 8.9647, std.dev.: 0.0278) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.59% (1.6386 => 1.6975, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.58% (1.1685 => 1.2103, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.51% (0.5191 => 0.5373, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 3.50% (14.2605 => 14.7594, std.dev.: 0.0505) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.28% (0.3717 => 0.3839, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.10% (0.6586 => 0.6790, std.dev.: 0.0031) MultiSource/Applications/lemon/lemon: 3.08% (1.0945 => 1.1282, std.dev.: 0.0049) MultiSource/Applications/lua/lua: 3.00% (3.8189 => 3.9335, std.dev.: 0.0180) MultiSource/Applications/minisat/minisat: 3.00% (0.6834 => 0.7039, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.87% (0.5961 => 0.6132, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.68% (0.8457 => 0.8684, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.68% (0.8069 => 0.8285, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.62% (0.8597 => 0.8822, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.61% (0.8611 => 0.8836, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.61% (0.8697 => 0.8924, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.57% (0.8086 => 0.8294, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.56% (1.3279 => 1.3619, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.54% (1.2602 => 1.2922, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.53% (0.9074 => 0.9304, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.53% (0.9908 => 1.0159, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.52% (0.8805 => 0.9027, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.47% (0.8331 => 0.8537, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.44% (0.9056 => 0.9277, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.44% (0.8855 => 0.9071, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.43% (0.8317 => 0.8519, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.39% (0.8286 => 0.8484, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.37% (0.8716 => 0.8923, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.37% (0.9688 => 0.9918, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.36% (0.8712 => 0.8918, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.32% (0.8656 => 0.8857, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.31% (0.8359 => 0.8552, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/gs/gs: 2.28% (4.1305 => 4.2245, std.dev.: 0.0292) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.27% (0.8885 => 0.9087, std.dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 2.27% (15.3280 => 15.6756, std.dev.: 0.1060) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.26% (0.8050 => 0.8232, std.dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: 2.26% (6.7320 => 6.8839, std.dev.: 0.0326) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.25% (0.9069 => 0.9273, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 2.25% (8.6247 => 8.8187, std.dev.: 0.0503) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.24% (0.7932 => 0.8110, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.23% (4.1763 => 4.2695, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.22% (0.8204 => 0.8386, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.20% (0.9039 => 0.9238, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.20% (0.8420 => 0.8605, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.18% (0.8518 => 0.8704, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.16% (0.8177 => 0.8354, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.14% (0.8316 => 0.8494, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.06% (0.8338 => 0.8510, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.03% (3.1832 => 3.2478, std.dev.: 0.0220) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.01% (0.8995 => 0.9176, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.01% (4.4880 => 4.5782, std.dev.: 0.0283) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.93% (0.8048 => 0.8203, std.dev.: 0.0052) MultiSource/Applications/oggenc/oggenc: 1.79% (4.9628 => 5.0516, std.dev.: 0.0230) MultiSource/Benchmarks/PAQ8p/paq8p: 1.62% (2.3764 => 2.4149, std.dev.: 0.0102) MultiSource/Benchmarks/Bullet/bullet: 1.53% (31.8598 => 32.3477, std.dev.: 0.1315) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.51% (4.5702 => 4.6393, std.dev.: 0.0242) MultiSource/Applications/siod/siod: 1.44% (2.2184 => 2.2504, std.dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 57.59% (1.5795 => 2.4892, std.dev.: 0.0129) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.36% (2.4333 => 2.6611, std.dev.: 0.0153) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.42% (1.1857 => 1.2855, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.88% (0.3186 => 0.3437, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 5.91% (63.1822 => 66.9186, std.dev.: 0.0212) MultiSource/Benchmarks/FreeBench/distray/distray: 4.73% (0.2390 => 0.2503, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 2.73% (3.6643 => 3.7643, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/ReedSolomon: 1.68% (8.5322 => 8.6753, std.dev.: 0.0204) MultiSource/Benchmarks/Olden/bh/bh: 1.64% (2.3560 => 2.3946, std.dev.: 0.0119) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.39% (2.4490 => 2.4831, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.34% (44.5605 => 45.1589, std.dev.: 0.2250) MultiSource/Benchmarks/BitBench/five11/five11: 1.03% (5.6030 => 5.6607, std.dev.: 0.0135) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.49% (0.3269 => 0.3024, std.dev.: 0.0009) MultiSource/Applications/lua/lua: -5.34% (29.8330 => 28.2403, std.dev.: 0.3008) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.84% (7.2130 => 7.0079, std.dev.: 0.0584) SingleSource/Benchmarks/Shootout-C++/hash2: -1.40% (3.4237 => 3.3759, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.27% (3.3479 => 3.3053, std.dev.: 0.0165) SingleSource/Benchmarks/McGill/chomp: -1.19% (1.1216 => 1.1083, std.dev.: 0.0047) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.89% (16.4461 => 16.5919, std.dev.: 0.1776) MultiSource/Applications/obsequi/Obsequi: 4.80% (1.0262 => 1.0755, std.dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: 1.85% (0.6332 => 0.6449, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/08-main/main: 5.24% (0.1831 => 0.1927, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 8.40% (0.1559 => 0.1690, std.dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.72% (0.3123 => 0.3208, std.dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.87% (0.2463 => 0.2509, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.73% (0.3344 => 0.3402, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.07% (0.2364 => 0.2413, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/bigfib: 0.90% (0.6010 => 0.6064, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/mandel: -1.17% (0.0429 => 0.0424, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.18% (0.3266 => 0.3370, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/strcat: 1.88% (0.1969 => 0.2006, std.dev.: 0.0043) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -3.12% (0.0224 => 0.0217, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.86% (0.0123 => 0.0220, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.15% (0.0408 => 0.0429, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.89% (0.0254 => 0.0335, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 12.24% (0.0384 => 0.0431, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: 8.42% (0.0190 => 0.0206, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0027) SingleSource/UnitTests/byval-alignment: 56.52% (0.0230 => 0.0360, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 1.11% (0.1438 => 0.1454, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -0.99% (1.1329 => 1.1217, std.dev.: 0.0090) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -0.27% (0.1462 => 0.1458, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.30% (0.4164 => 0.4218, std.dev.: 0.0467) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.14% (0.1369 => 0.1285, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -13.42% (0.0641 => 0.0555, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.67% (0.0578 => 0.0551, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.48% (1.1437 => 1.1382, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -71.43% (0.0014 => 0.0004, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.73% (0.0627 => 0.0566, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0180 => 0.0180, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.90% (0.8017 => 0.7945, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -29.03% (0.0062 => 0.0044, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 28 01:02:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 28 Oct 2012 03:02:34 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121028080234.63E282A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/5327?compare_to=5324&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5327, Order: 166897, Start Time: 2012-10-28 06:33:31, End Time: 2012-10-28 08:02:31 To: 5324, Order: 166895, Start Time: 2012-10-28 04:44:02, End Time: 2012-10-28 06:09:29 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 1 (154 on baseline) Unchanged Tests: 1041 (883 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.00% (79.9029 => 79.1023, std.dev.: 0.1801) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.33% (15.2527 => 18.3540, std.dev.: 0.0098) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.58% (2.0478 => 2.1007, std.dev.: 0.0143) SingleSource/Benchmarks/Misc/salsa20: 2.29% (7.4937 => 7.6651, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/hash2: 2.27% (3.1932 => 3.2657, std.dev.: 0.0078) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.46% (0.1431 => 0.1310, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.21% (0.1584 => 0.1454, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.41% (0.3821 => 0.3538, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.65% (0.3142 => 0.2933, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -6.62% (2.4924 => 2.3275, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.59% (0.2428 => 0.2268, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: -6.47% (0.3831 => 0.3583, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/exceptions-4: -6.47% (0.3880 => 0.3629, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/trivial-interface: -6.43% (0.3812 => 0.3567, std.dev.: 0.0070) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.35% (0.3891 => 0.3644, std.dev.: 0.0060) SingleSource/UnitTests/ObjC/synchronized: -6.34% (0.3896 => 0.3649, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.31% (0.3658 => 0.3427, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.29% (0.3848 => 0.3606, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/for-in: -6.27% (0.4033 => 0.3780, std.dev.: 0.0063) SingleSource/UnitTests/ObjC/exceptions: -6.23% (0.4176 => 0.3916, std.dev.: 0.0067) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.20% (22.4056 => 21.0164, std.dev.: 0.3487) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.15% (0.3884 => 0.3645, std.dev.: 0.0067) SingleSource/UnitTests/ObjC/property: -6.10% (0.4199 => 0.3943, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.06% (0.6484 => 0.6091, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.03% (4.5069 => 4.2351, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/parameter-passing: -6.03% (0.4280 => 0.4022, std.dev.: 0.0080) MultiSource/Benchmarks/McCat/08-main/main: -5.98% (0.2659 => 0.2500, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.84% (0.3837 => 0.3613, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.82% (0.2355 => 0.2218, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -5.73% (7.0961 => 6.6896, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/oourafft: -5.69% (0.2160 => 0.2037, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.69% (5.4682 => 5.1571, std.dev.: 0.0085) MultiSource/Applications/hexxagon/hexxagon: -5.69% (1.3148 => 1.2400, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: -5.69% (0.2989 => 0.2819, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.67% (0.9852 => 0.9293, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.65% (0.7198 => 0.6791, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: -5.63% (0.3357 => 0.3168, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -5.63% (2.4021 => 2.2669, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.61% (0.2548 => 0.2405, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: -5.61% (16.1920 => 15.2835, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.60% (0.3323 => 0.3137, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.60% (0.3252 => 0.3070, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.59% (0.3057 => 0.2886, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/fibo: -5.57% (0.2871 => 0.2711, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.57% (1.0544 => 0.9957, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/gs/gs: -5.55% (4.3330 => 4.0925, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.55% (4.8161 => 4.5489, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.54% (3.5339 => 3.3382, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.53% (0.9542 => 0.9014, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.51% (0.4321 => 0.4083, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.49% (0.8521 => 0.8053, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.47% (1.2784 => 1.2085, std.dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: -5.46% (34.0927 => 32.2303, std.dev.: 0.5553) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.44% (1.6474 => 1.5577, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.44% (0.3931 => 0.3717, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: -5.44% (0.2849 => 0.2694, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.43% (4.8802 => 4.6151, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wc: -5.43% (0.3205 => 0.3031, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.39% (0.7919 => 0.7492, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.37% (2.1713 => 2.0546, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.34% (0.4083 => 0.3865, std.dev.: 0.0075) MultiSource/Applications/Burg/burg: -5.34% (1.2515 => 1.1847, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.33% (4.0323 => 3.8175, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.33% (0.3849 => 0.3644, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.32% (0.6293 => 0.5958, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: -5.31% (0.3255 => 0.3082, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.28% (1.2221 => 1.1576, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.23% (0.5999 => 0.5685, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.20% (0.2999 => 0.2843, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: -5.13% (0.3194 => 0.3030, std.dev.: 0.0057) MultiSource/Applications/lua/lua: -5.11% (4.0594 => 3.8520, std.dev.: 0.0163) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.09% (1.2210 => 1.1588, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: -5.08% (0.6750 => 0.6407, std.dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: -5.02% (0.7982 => 0.7581, std.dev.: 0.0136) MultiSource/Applications/kimwitu++/kc: -5.02% (18.2933 => 17.3748, std.dev.: 0.0184) SingleSource/Benchmarks/Shootout-C++/lists1: -4.99% (0.3867 => 0.3674, std.dev.: 0.0072) MultiSource/Benchmarks/mafft/pairlocalalign: -4.97% (9.2283 => 8.7700, std.dev.: 0.1636) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -4.92% (1.6364 => 1.5559, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.89% (1.4642 => 1.3926, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.89% (1.3722 => 1.3051, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.89% (2.2587 => 2.1483, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.74% (0.2933 => 0.2794, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.70% (0.4916 => 0.4685, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.69% (0.9557 => 0.9109, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/Hello: -4.66% (0.6347 => 0.6051, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.64% (0.3491 => 0.3329, std.dev.: 0.0060) MultiSource/Benchmarks/McCat/18-imp/imp: -4.64% (0.3581 => 0.3415, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.61% (0.3319 => 0.3166, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -4.60% (0.6441 => 0.6145, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.51% (0.6230 => 0.5949, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.48% (0.6676 => 0.6377, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.46% (0.5805 => 0.5546, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.45% (0.5478 => 0.5234, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.42% (0.5591 => 0.5344, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.40% (0.2385 => 0.2280, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.39% (0.5859 => 0.5602, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.37% (0.6297 => 0.6022, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -4.36% (0.7447 => 0.7122, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.35% (0.6660 => 0.6370, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: -4.34% (0.3271 => 0.3129, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.32% (0.6667 => 0.6379, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.31% (0.6189 => 0.5922, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: -4.29% (1.1450 => 1.0959, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.29% (0.5575 => 0.5336, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.29% (0.5857 => 0.5606, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.28% (0.5863 => 0.5612, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.28% (0.6194 => 0.5929, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: -4.28% (0.8418 => 0.8058, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.27% (0.6681 => 0.6396, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: -4.25% (0.4515 => 0.4323, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.24% (0.5925 => 0.5674, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.23% (0.5456 => 0.5225, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.23% (0.6260 => 0.5995, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.23% (0.5581 => 0.5345, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.22% (0.5705 => 0.5464, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.22% (0.5802 => 0.5557, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.21% (0.9077 => 0.8695, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.19% (0.6440 => 0.6170, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.19% (0.6304 => 0.6040, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: -4.18% (0.9179 => 0.8795, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.17% (0.7339 => 0.7033, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.16% (0.5941 => 0.5694, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.14% (0.5849 => 0.5607, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.13% (8.0126 => 7.6813, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.13% (0.6052 => 0.5802, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -4.13% (15.5079 => 14.8679, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.11% (0.6395 => 0.6132, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.11% (0.6395 => 0.6132, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.11% (0.5569 => 0.5340, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.11% (0.3406 => 0.3266, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.08% (0.5688 => 0.5456, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.08% (0.6033 => 0.5787, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.04% (0.5567 => 0.5342, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.03% (0.7524 => 0.7221, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.02% (0.5570 => 0.5346, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.99% (0.3483 => 0.3344, std.dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.94% (6.7716 => 6.5048, std.dev.: 0.0096) MultiSource/Applications/oggenc/oggenc: -3.90% (5.0226 => 4.8265, std.dev.: 0.0014) MultiSource/Applications/treecc/treecc: -3.90% (2.1401 => 2.0566, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: -3.85% (17.1032 => 16.4447, std.dev.: 0.0224) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.82% (0.7021 => 0.6753, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.82% (0.6446 => 0.6200, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.77% (0.6736 => 0.6482, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.64% (1.2300 => 1.1852, std.dev.: 0.0031) MultiSource/Applications/d/make_dparser: -3.61% (3.5154 => 3.3886, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.48% (0.5168 => 0.4988, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.43% (0.5329 => 0.5146, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: -3.37% (1.1530 => 1.1141, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: -3.37% (1.5610 => 1.5084, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.18% (14.2083 => 13.7569, std.dev.: 0.0169) MultiSource/Applications/SIBsim4/SIBsim4: -1.57% (1.3864 => 1.3646, std.dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.36% (7.5137 => 5.7583, std.dev.: 0.0319) SingleSource/Benchmarks/Misc/richards_benchmark: -8.89% (1.2842 => 1.1700, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fbench: -3.86% (2.2633 => 2.1760, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.82% (1.7753 => 1.7074, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.95% (1.3096 => 1.2710, std.dev.: 0.0144) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4688, std.dev.: 0.0034) Report Time: 1.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 28 01:37:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 28 Oct 2012 03:37:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121028083719.DFEBB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5328?compare_to=5321&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5328, Order: 166895, Start Time: 2012-10-28 05:16:35, End Time: 2012-10-28 08:37:17 To: 5321, Order: 166893, Start Time: 2012-10-28 01:12:52, End Time: 2012-10-28 04:28:36 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (166 on baseline) Performance Improvements: 2 (15 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1040 (727 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/Hello: -1.72% (0.6933 => 0.6814, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: -1.42% (0.8377 => 0.8258, std.dev.: 0.0027) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.40% (0.0625 => 0.0890, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.83% (0.1063 => 0.1412, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.75% (0.0714 => 0.0905, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.73% (0.2969 => 0.3733, std.dev.: 0.0125) MultiSource/Applications/oggenc/oggenc: 25.65% (1.5932 => 2.0019, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.59% (0.1106 => 0.1389, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.99% (0.4253 => 0.5316, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.96% (0.4139 => 0.5172, std.dev.: 0.0164) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.94% (0.1620 => 0.2024, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.85% (0.4994 => 0.6185, std.dev.: 0.0248) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.73% (0.5900 => 0.7300, std.dev.: 0.0338) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.52% (0.0897 => 0.1108, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.46% (0.0584 => 0.0721, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.42% (0.5000 => 0.6171, std.dev.: 0.0233) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.22% (0.0547 => 0.0674, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.21% (0.0642 => 0.0791, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.95% (0.0475 => 0.0584, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.77% (0.0584 => 0.0717, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.59% (0.1107 => 0.1346, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.45% (0.1021 => 0.1240, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.40% (0.1103 => 0.1339, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/tsp/tsp: 21.37% (0.0599 => 0.0727, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.01% (0.0633 => 0.0766, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/power/power: 20.53% (0.0604 => 0.0728, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.33% (0.0541 => 0.0651, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.24% (0.3903 => 0.4693, std.dev.: 0.0173) MultiSource/Benchmarks/Olden/em3d/em3d: 20.15% (0.0948 => 0.1139, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.08% (0.1549 => 0.1860, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/health/health: 19.85% (0.0821 => 0.0984, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.84% (0.1003 => 0.1202, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/05-eks/eks: 19.77% (0.1619 => 0.1939, std.dev.: 0.0060) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.70% (0.1604 => 0.1920, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.46% (0.0822 => 0.0982, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.67% (0.1462 => 0.1735, std.dev.: 0.0047) MultiSource/Applications/viterbi/viterbi: 18.59% (0.0947 => 0.1123, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.48% (0.3890 => 0.4609, std.dev.: 0.0153) MultiSource/Applications/sgefa/sgefa: 18.44% (0.0808 => 0.0957, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 18.38% (0.1284 => 0.1520, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.13% (1.3152 => 1.5537, std.dev.: 0.0514) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.92% (0.2014 => 0.2375, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.81% (0.5026 => 0.5921, std.dev.: 0.0188) MultiSource/Benchmarks/McCat/08-main/main: 17.73% (0.1218 => 0.1434, std.dev.: 0.0082) MultiSource/Benchmarks/McCat/09-vor/vor: 17.67% (0.1505 => 0.1771, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.46% (0.1088 => 0.1278, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.43% (0.2736 => 0.3213, std.dev.: 0.0182) MultiSource/Applications/spiff/spiff: 17.42% (0.4029 => 0.4731, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 17.28% (1.8794 => 2.2042, std.dev.: 0.0857) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.24% (0.2866 => 0.3360, std.dev.: 0.0104) MultiSource/Applications/Burg/burg: 17.08% (0.5546 => 0.6493, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.02% (0.0605 => 0.0708, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/Hello: 16.96% (0.5826 => 0.6814, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.93% (3.5627 => 4.1660, std.dev.: 0.1068) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.90% (0.1160 => 0.1356, std.dev.: 0.0051) SingleSource/UnitTests/ObjC++/property-reference-object: 16.79% (0.5889 => 0.6878, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.77% (0.3930 => 0.4589, std.dev.: 0.0206) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.72% (0.1968 => 0.2297, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.55% (0.4658 => 0.5429, std.dev.: 0.0203) MultiSource/Applications/hbd/hbd: 16.54% (0.9697 => 1.1301, std.dev.: 0.0271) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.51% (1.6211 => 1.8887, std.dev.: 0.0621) MultiSource/Benchmarks/McCat/18-imp/imp: 16.26% (0.1421 => 0.1652, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.17% (0.3271 => 0.3800, std.dev.: 0.0112) MultiSource/Applications/d/make_dparser: 16.08% (1.0781 => 1.2515, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.05% (0.4361 => 0.5061, std.dev.: 0.0213) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.00% (0.2875 => 0.3335, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.78% (4.4195 => 5.1169, std.dev.: 0.1400) MultiSource/Applications/hexxagon/hexxagon: 15.58% (0.9909 => 1.1453, std.dev.: 0.0379) SingleSource/Benchmarks/Shootout-C++/fibo: 15.52% (0.2725 => 0.3148, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.52% (1.9966 => 2.3065, std.dev.: 0.0648) MultiSource/Applications/ClamAV/clamscan: 15.33% (4.2109 => 4.8566, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/hello: 15.33% (0.2714 => 0.3130, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.30% (0.2738 => 0.3157, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.29% (1.9694 => 2.2706, std.dev.: 0.0618) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.28% (2.7292 => 3.1463, std.dev.: 0.0758) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.24% (0.2729 => 0.3145, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 15.24% (0.2750 => 0.3169, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.23% (0.1090 => 0.1256, std.dev.: 0.0062) SingleSource/Regression/C++/ofstream_ctor: 15.21% (0.3004 => 0.3461, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 15.16% (0.7171 => 0.8258, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.13% (2.0673 => 2.3801, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/matrix: 15.11% (0.2780 => 0.3200, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 15.02% (0.2803 => 0.3224, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/objinst: 14.98% (0.2823 => 0.3246, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.97% (0.2792 => 0.3210, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 14.94% (0.2811 => 0.3231, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.90% (0.3195 => 0.3671, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 14.90% (0.2813 => 0.3232, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.87% (0.2911 => 0.3344, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 14.79% (0.3096 => 0.3554, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 14.69% (0.2566 => 0.2943, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.57% (0.3362 => 0.3852, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: 14.57% (0.3267 => 0.3743, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 14.51% (0.2075 => 0.2376, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/ary: 14.46% (0.3258 => 0.3729, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 14.38% (0.3317 => 0.3794, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.15% (0.3060 => 0.3493, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 14.07% (1.4269 => 1.6277, std.dev.: 0.0695) MultiSource/Benchmarks/Bullet/bullet: 13.98% (23.5202 => 26.8072, std.dev.: 0.0226) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.96% (0.3124 => 0.3560, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 13.74% (0.3348 => 0.3808, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 13.72% (0.4146 => 0.4715, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 13.65% (0.3678 => 0.4180, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 13.64% (2.1653 => 2.4606, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.60% (0.3845 => 0.4368, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.59% (0.3282 => 0.3728, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sieve: 13.53% (0.3726 => 0.4230, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 13.48% (0.3465 => 0.3932, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 13.47% (0.3496 => 0.3967, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 13.44% (0.3446 => 0.3909, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 13.43% (0.3469 => 0.3935, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.42% (0.3488 => 0.3956, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: 13.37% (0.7875 => 0.8928, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 13.34% (0.3442 => 0.3901, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 13.32% (0.3460 => 0.3921, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 13.32% (0.3477 => 0.3940, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.30% (0.3625 => 0.4107, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 13.17% (4.6177 => 5.2259, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.16% (0.3981 => 0.4505, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 13.15% (0.4251 => 0.4810, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.14% (0.3690 => 0.4175, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/property: 13.10% (0.3650 => 0.4128, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 13.04% (0.2691 => 0.3042, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions: 12.98% (0.3643 => 0.4116, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.92% (0.3724 => 0.4205, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.89% (0.2040 => 0.2303, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.87% (0.1383 => 0.1561, std.dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 12.78% (2.1013 => 2.3699, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/bigfib: 12.49% (0.5012 => 0.5638, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 12.05% (5.5417 => 6.2094, std.dev.: 0.0106) MultiSource/Applications/lambda-0_1_3/lambda: 11.55% (0.3498 => 0.3902, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.31% (0.6435 => 0.7163, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 10.96% (0.6634 => 0.7361, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.80% (0.1028 => 0.1139, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 10.79% (0.4847 => 0.5370, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.64% (0.2068 => 0.2288, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.49% (0.2737 => 0.3024, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.95% (0.3084 => 0.3391, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 9.85% (2.0346 => 2.2351, std.dev.: 0.0182) MultiSource/Applications/lemon/lemon: 9.58% (0.2391 => 0.2620, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.27% (0.2103 => 0.2298, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.17% (4.6926 => 5.1227, std.dev.: 0.0070) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.09% (11.6398 => 12.6982, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.38% (0.5361 => 0.5810, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.08% (0.5584 => 0.6035, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.54% (0.7426 => 0.7986, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 6.44% (11.9555 => 12.7260, std.dev.: 0.2849) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.09% (0.3792 => 0.3947, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6535, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.80% (0.0734 => 0.0872, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.25% (0.5917 => 0.6701, std.dev.: 0.0092) MultiSource/Applications/ClamAV/clamscan: 8.78% (0.2802 => 0.3048, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.93% (0.2122 => 0.2269, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6098, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.02% (12.0509 => 12.6562, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.87% (0.3693 => 0.3873, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1680, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/flops-2: 3.76% (1.8057 => 1.8736, std.dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/dry: 2.78% (14.0481 => 14.4390, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2063, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.61% (3.1722 => 3.2234, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.48% (7.1849 => 7.2914, std.dev.: 0.0232) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3085, std.dev.: 0.0116) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.41% (1.0927 => 1.1081, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.23% (1.0142 => 1.0267, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.55% (25.4195 => 16.3832, std.dev.: 0.0176) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9782, std.dev.: 0.0271) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7759, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary2: -7.29% (0.2402 => 0.2227, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/tsp/tsp: -7.19% (2.1113 => 1.9595, std.dev.: 0.0173) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2420, std.dev.: 0.0031) SingleSource/UnitTests/Vector/build2: -3.10% (11.2080 => 10.8600, std.dev.: 0.0246) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7741, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel-2: -2.87% (3.6262 => 3.5220, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -2.48% (17.2379 => 16.8110, std.dev.: 0.0324) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.18% (41.7953 => 40.8845, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5743, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.15% (21.9346 => 21.6817, std.dev.: 0.0598) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.07% (105.3826 => 104.2536, std.dev.: 0.0726) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0430, std.dev.: 0.0051) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 28 02:16:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 28 Oct 2012 04:16:08 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121028091608.037652A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5329?compare_to=5326&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5329, Order: 166898, Start Time: 2012-10-28 07:52:23, End Time: 2012-10-28 09:16:06 To: 5326, Order: 166896, Start Time: 2012-10-28 06:11:17, End Time: 2012-10-28 07:35:21 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 9 (103 on baseline) Performance Improvements: 3 (7 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 963 (864 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.49% (0.2249 => 0.2350, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.48% (0.4914 => 0.5036, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 24.22% (1.4974 => 1.8600, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout/heapsort: 11.37% (3.0289 => 3.3733, std.dev.: 0.0837) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.99% (14.6674 => 16.2800, std.dev.: 0.1781) SingleSource/Benchmarks/Shootout-C++/methcall: 10.38% (8.1681 => 9.0158, std.dev.: 0.0245) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.82% (4.4140 => 4.4944, std.dev.: 0.0188) SingleSource/Benchmarks/Misc/ReedSolomon: 1.10% (8.6753 => 8.7711, std.dev.: 0.0105) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.04% (1.1295 => 1.1412, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.26% (8.6790 => 8.3961, std.dev.: 0.0378) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.65% (1.1844 => 1.1649, std.dev.: 0.0072) MultiSource/Applications/hbd/hbd: -1.50% (1.4828 => 1.4605, std.dev.: 0.0083) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.90% (16.5919 => 16.7418, std.dev.: 0.0772) MultiSource/Applications/obsequi/Obsequi: -1.05% (1.0755 => 1.0642, std.dev.: 0.0131) MultiSource/Applications/sqlite3/sqlite3: 0.87% (0.6449 => 0.6505, std.dev.: 0.0096) MultiSource/Benchmarks/McCat/08-main/main: -0.47% (0.1927 => 0.1918, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.38% (0.1690 => 0.1616, std.dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.56% (0.3208 => 0.3258, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.00% (0.2509 => 0.2484, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.06% (0.3402 => 0.3332, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.62% (0.2413 => 0.2374, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/bigfib: -0.02% (0.6064 => 0.6063, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel: -1.89% (0.0424 => 0.0416, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: -1.60% (0.3370 => 0.3316, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/strcat: -0.10% (0.2006 => 0.2004, std.dev.: 0.0024) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -19.35% (0.0217 => 0.0175, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -16.36% (0.0220 => 0.0184, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.93% (0.0429 => 0.0425, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.90% (0.0335 => 0.0332, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0315 => 0.0314, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.86% (0.0431 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -9.22% (0.0206 => 0.0187, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/test1: -4.11% (0.0219 => 0.0210, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -19.17% (0.0360 => 0.0291, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.62% (0.1454 => 0.1445, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.40% (1.1217 => 1.1374, std.dev.: 0.0073) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -1.03% (0.1458 => 0.1443, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.67% (0.4218 => 0.4063, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.79% (0.1285 => 0.1308, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.41% (0.0555 => 0.0585, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -30.32% (0.0277 => 0.0193, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.91% (0.0551 => 0.0546, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.40% (1.1382 => 1.1427, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.77% (0.0031 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -75.00% (0.0004 => 0.0001, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.47% (0.0566 => 0.0580, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.67% (0.0180 => 0.0183, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.15% (0.7945 => 0.7957, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 100.00% (0.0001 => 0.0002, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 93.18% (0.0044 => 0.0085, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.42% (2.1832 => 1.6501, std.dev.: 0.0092) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 36.11% (14.7684 => 20.1013, std.dev.: 0.0109) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.06% (0.0810 => 0.0932, std.dev.: 0.0011) SingleSource/UnitTests/SignlessTypes/rem: 14.40% (0.1035 => 0.1184, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.26% (0.0848 => 0.0952, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 11.51% (0.1112 => 0.1240, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.84% (0.2180 => 0.2351, std.dev.: 0.0028) MultiSource/Applications/SIBsim4/SIBsim4: 7.32% (1.2568 => 1.3488, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.11% (0.2279 => 0.2441, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.00% (0.6010 => 0.6431, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.13% (13.1811 => 13.9893, std.dev.: 0.1134) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.89% (6.6074 => 6.9963, std.dev.: 0.0305) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.38% (0.2378 => 0.2506, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.35% (0.6227 => 0.6560, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.29% (0.4783 => 0.5036, std.dev.: 0.0044) MultiSource/Benchmarks/nbench/nbench: 5.22% (1.1271 => 1.1859, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.17% (0.7473 => 0.7859, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.14% (0.2741 => 0.2882, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.11% (0.4127 => 0.4338, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.91% (0.2240 => 0.2350, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.53% (1.1685 => 1.2214, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.29% (1.1170 => 1.1649, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.27% (1.6386 => 1.7085, std.dev.: 0.0107) MultiSource/Applications/d/make_dparser: 4.24% (3.2366 => 3.3738, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.18% (0.9435 => 0.9829, std.dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.01% (0.3717 => 0.3866, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.91% (0.5191 => 0.5394, std.dev.: 0.0043) MultiSource/Applications/lemon/lemon: 3.82% (1.0945 => 1.1363, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/football/football: 3.64% (0.8768 => 0.9087, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.63% (0.6287 => 0.6515, std.dev.: 0.0088) MultiSource/Applications/SPASS/SPASS: 3.62% (14.2605 => 14.7764, std.dev.: 0.0558) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.50% (0.2998 => 0.3103, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.46% (8.6476 => 8.9471, std.dev.: 0.0976) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 3.33% (0.8855 => 0.9150, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: 3.31% (1.9948 => 2.0608, std.dev.: 0.0113) MultiSource/Applications/minisat/minisat: 3.28% (0.6834 => 0.7058, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/05-eks/eks: 3.16% (0.4397 => 0.4536, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.14% (0.6586 => 0.6793, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.14% (0.8697 => 0.8970, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.14% (0.5961 => 0.6148, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.08% (0.8007 => 0.8254, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.99% (4.1763 => 4.3013, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/hash2: 2.96% (0.4125 => 0.4247, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.96% (0.9069 => 0.9337, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.94% (0.5817 => 0.5988, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.91% (0.8927 => 0.9187, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.91% (0.7932 => 0.8163, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.90% (3.1832 => 3.2755, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.87% (0.8340 => 0.8579, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.81% (0.8597 => 0.8839, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.81% (0.8518 => 0.8757, std.dev.: 0.0029) MultiSource/Applications/JM/ldecod/ldecod: 2.78% (6.7320 => 6.9191, std.dev.: 0.0302) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.78% (0.8317 => 0.8548, std.dev.: 0.0035) MultiSource/Applications/JM/lencod/lencod: 2.77% (15.3280 => 15.7522, std.dev.: 0.0549) SingleSource/Benchmarks/Shootout-C++/hash: 2.71% (0.3800 => 0.3903, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.67% (2.1401 => 2.1972, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.64% (1.2602 => 1.2935, std.dev.: 0.0071) MultiSource/Benchmarks/mafft/pairlocalalign: 2.64% (8.6247 => 8.8520, std.dev.: 0.0493) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.62% (0.8331 => 0.8549, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.59% (4.4873 => 4.6037, std.dev.: 0.0261) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.59% (1.4479 => 1.4854, std.dev.: 0.0073) MultiSource/Applications/lua/lua: 2.58% (3.8189 => 3.9176, std.dev.: 0.0289) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.58% (0.9056 => 0.9290, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.55% (0.8261 => 0.8472, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.54% (0.8611 => 0.8830, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.50% (1.3279 => 1.3611, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.41% (0.8286 => 0.8486, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.41% (0.8066 => 0.8260, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.40% (0.9074 => 0.9292, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.39% (0.9688 => 0.9920, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.39% (0.8069 => 0.8262, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.39% (0.8656 => 0.8863, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.38% (0.8359 => 0.8558, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.36% (0.9039 => 0.9252, std.dev.: 0.0058) MultiSource/Applications/hbd/hbd: 2.35% (1.4269 => 1.4605, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.35% (0.8204 => 0.8397, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.30% (0.7966 => 0.8149, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.29% (0.8716 => 0.8916, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.25% (0.8885 => 0.9085, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.24% (0.8338 => 0.8525, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.23% (1.5315 => 1.5656, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.20% (0.8048 => 0.8225, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.16% (0.8086 => 0.8261, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.16% (0.8050 => 0.8224, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.13% (1.2526 => 1.2793, std.dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: 2.12% (31.8598 => 32.5348, std.dev.: 0.0659) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.01% (0.8457 => 0.8627, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.00% (1.2423 => 1.2672, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.96% (0.8420 => 0.8585, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.93% (4.5702 => 4.6582, std.dev.: 0.0100) MultiSource/Benchmarks/PAQ8p/paq8p: 1.67% (2.3764 => 2.4162, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.80% (1.5795 => 2.5083, std.dev.: 0.0048) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.54% (2.4333 => 2.7140, std.dev.: 0.0252) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.16% (14.6451 => 16.2800, std.dev.: 0.1781) MultiSource/Benchmarks/nbench/nbench: 9.96% (21.9654 => 24.1536, std.dev.: 0.7981) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.20% (0.3186 => 0.3479, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 6.70% (1.1857 => 1.2652, std.dev.: 0.0103) MultiSource/Benchmarks/mafft/pairlocalalign: 5.96% (63.1822 => 66.9460, std.dev.: 0.0971) SingleSource/Benchmarks/Misc/ReedSolomon: 2.80% (8.5322 => 8.7711, std.dev.: 0.0105) MultiSource/Applications/siod/siod: 2.56% (3.6643 => 3.7582, std.dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/hash: 2.19% (0.6205 => 0.6341, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.90% (2.4490 => 2.4956, std.dev.: 0.0116) MultiSource/Benchmarks/Olden/bh/bh: 1.83% (2.3560 => 2.3991, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.36% (4.4340 => 4.4944, std.dev.: 0.0188) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -31.95% (0.0338 => 0.0230, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.61% (0.3269 => 0.2955, std.dev.: 0.0078) MultiSource/Applications/lua/lua: -4.94% (29.8330 => 28.3599, std.dev.: 0.0842) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.08% (7.2130 => 6.9186, std.dev.: 0.0561) MultiSource/Applications/SPASS/SPASS: -2.52% (8.4326 => 8.2198, std.dev.: 0.0588) SingleSource/Benchmarks/Shootout-C++/hash2: -1.52% (3.4237 => 3.3715, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.23% (3.3479 => 3.3066, std.dev.: 0.0099) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 1.80% (16.4461 => 16.7418, std.dev.: 0.0772) MultiSource/Applications/obsequi/Obsequi: 3.70% (1.0262 => 1.0642, std.dev.: 0.0131) MultiSource/Applications/sqlite3/sqlite3: 2.73% (0.6332 => 0.6505, std.dev.: 0.0096) MultiSource/Benchmarks/McCat/08-main/main: 4.75% (0.1831 => 0.1918, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.66% (0.1559 => 0.1616, std.dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.32% (0.3123 => 0.3258, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.85% (0.2463 => 0.2484, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.36% (0.3344 => 0.3332, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.42% (0.2364 => 0.2374, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/bigfib: 0.88% (0.6010 => 0.6063, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel: -3.03% (0.0429 => 0.0416, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.53% (0.3266 => 0.3316, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/strcat: 1.78% (0.1969 => 0.2004, std.dev.: 0.0024) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -21.87% (0.0224 => 0.0175, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 49.59% (0.0123 => 0.0184, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.17% (0.0408 => 0.0425, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.71% (0.0254 => 0.0332, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -1.58% (0.0190 => 0.0187, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/test1: 16.67% (0.0180 => 0.0210, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: 26.52% (0.0230 => 0.0291, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.49% (0.1438 => 0.1445, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.40% (1.1329 => 1.1374, std.dev.: 0.0073) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -1.30% (0.1462 => 0.1443, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.43% (0.4164 => 0.4063, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.46% (0.1369 => 0.1308, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.74% (0.0641 => 0.0585, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.03% (0.0195 => 0.0193, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.54% (0.0578 => 0.0546, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.09% (1.1437 => 1.1427, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.50% (0.0627 => 0.0580, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.67% (0.0180 => 0.0183, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.75% (0.8017 => 0.7957, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 100.00% (0.0001 => 0.0002, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 37.10% (0.0062 => 0.0085, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 28 02:24:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 28 Oct 2012 04:24:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121028092428.5F72B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5330?compare_to=5325&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5330, Order: 166898, Start Time: 2012-10-28 07:52:23, End Time: 2012-10-28 09:24:26 To: 5325, Order: 166896, Start Time: 2012-10-28 05:47:45, End Time: 2012-10-28 07:22:09 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (10 on baseline) New Passes: 0 (14 on baseline) Performance Regressions: 4 (190 on baseline) Performance Improvements: 3 (54 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 15 (5 on baseline) Unchanged Tests: 1020 (635 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.56% (9.5849 => 9.9260, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.59% (0.9564 => 0.9716, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.19% (1.6274 => 1.6468, std.dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.49% (54.5566 => 56.4579, std.dev.: 0.0456) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.62% (7.3811 => 7.2617, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.32% (2.4495 => 2.4171, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.22% (2.4485 => 2.4187, std.dev.: 0.0017) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -0.09% (2.0629 => 2.0611, std.dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: -0.32% (58.3051 => 58.1194, std.dev.: 0.0613) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.25% (0.0798 => 0.0800, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 0.38% (9.2303 => 9.2652, std.dev.: 0.0060) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.03% (7.8155 => 7.8132, std.dev.: 0.0145) SingleSource/UnitTests/Vector/SSE/sse_shift: -3.54% (0.0537 => 0.0518, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/JM/lencod/lencod: 0.02% (7.7278 => 7.7295, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: - (0.0001 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0649 => 0.0649, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.03% (0.2991 => 0.2990, std.dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_shift: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -64.21% (5.7591 => 2.0611, std.dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: -8.10% (63.2438 => 58.1194, std.dev.: 0.0613) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.80% (6.6874 => 0.0800, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.87% (8.1363 => 9.2652, std.dev.: 0.0060) SingleSource/UnitTests/Vector/SSE/sse_shift: 37.04% (0.0378 => 0.0518, std.dev.: 0.0000) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -50.00% (0.0002 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -57.05% (0.6962 => 0.2990, std.dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_shift: -50.00% (0.0002 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 212.49% (0.5229 => 1.6340, std.dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 18.00% (14.9895 => 17.6872, std.dev.: 0.0286) MultiSource/Applications/kimwitu++/kc: 38.15% (14.1553 => 19.5554, std.dev.: 0.0176) MultiSource/Benchmarks/MallocBench/gs/gs: 14.02% (4.1105 => 4.6867, std.dev.: 0.0290) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 33.53% (1.1048 => 1.4752, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 69.40% (3.4629 => 5.8660, std.dev.: 0.0234) SingleSource/Benchmarks/Misc-C++/stepanov_container: 68.76% (0.6222 => 1.0500, std.dev.: 0.0012) New Passes - Execution Time --------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 3836200.00% (0.0001 => 3.8363, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 11140100.00% (0.0001 => 11.1402, std.dev.: 0.0517) MultiSource/Applications/kimwitu++/kc: 50600.00% (0.0001 => 0.0507, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049700.00% (0.0001 => 10.0498, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5488500.00% (0.0001 => 5.4886, std.dev.: 0.0103) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 78.38% (0.0296 => 0.0528, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 69.92% (0.0256 => 0.0435, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 60.89% (0.0271 => 0.0436, std.dev.: 0.0009) SingleSource/Regression/C/sumarraymalloc: 53.09% (0.0243 => 0.0372, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 44.17% (1.5859 => 2.2864, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.57% (0.0834 => 0.1189, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/distray/distray: 41.86% (0.1056 => 0.1498, std.dev.: 0.0006) SingleSource/UnitTests/vla: 36.06% (0.0355 => 0.0483, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 35.38% (2.2024 => 2.9817, std.dev.: 0.0147) MultiSource/Benchmarks/FreeBench/neural/neural: 33.97% (0.1463 => 0.1960, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 29.61% (0.1432 => 0.1856, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 28.16% (0.1655 => 0.2121, std.dev.: 0.0062) MultiSource/Benchmarks/llubenchmark/llu: 24.46% (0.0462 => 0.0575, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.12% (0.1566 => 0.1928, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/rem: 22.38% (0.1144 => 0.1400, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.45% (0.5105 => 0.6200, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 21.16% (0.1555 => 0.1884, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.01% (0.0871 => 0.1054, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 19.92% (0.0798 => 0.0957, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 19.58% (0.6675 => 0.7982, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/17-bintr/bintr: 19.56% (0.0675 => 0.0807, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.55% (0.2271 => 0.2715, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 19.45% (1.3050 => 1.5588, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 19.43% (0.1163 => 0.1389, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 19.27% (3.3354 => 3.9780, std.dev.: 0.0123) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.07% (0.0886 => 0.1055, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 19.00% (0.5020 => 0.5974, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.89% (0.8172 => 0.9716, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/almabench: 18.77% (0.0730 => 0.0867, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 18.77% (0.0746 => 0.0886, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 18.76% (0.0842 => 0.1000, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 18.75% (0.7115 => 0.8449, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: 18.68% (0.2554 => 0.3031, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/tsp/tsp: 18.55% (0.1175 => 0.1393, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 18.28% (0.1236 => 0.1462) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 18.25% (0.1337 => 0.1581, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 18.11% (0.1695 => 0.2002, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.10% (1.5415 => 1.8205, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.08% (0.1510 => 0.1783, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 18.03% (0.0793 => 0.0936, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 18.02% (1.1840 => 1.3974, std.dev.: 0.0089) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 17.93% (0.1584 => 0.1868, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: 17.89% (0.0626 => 0.0738, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.83% (0.1032 => 0.1216, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.66% (0.4615 => 0.5430, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.53% (0.0770 => 0.0905, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 17.34% (0.4879 => 0.5725, std.dev.: 0.0025) MultiSource/Applications/sgefa/sgefa: 17.02% (0.3109 => 0.3638, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 17.01% (0.1940 => 0.2270, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 17.00% (0.3177 => 0.3717, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.95% (0.6450 => 0.7543, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 16.83% (0.2603 => 0.3041, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 16.64% (0.2758 => 0.3217, std.dev.: 0.0024) MultiSource/Applications/aha/aha: 16.59% (0.1151 => 0.1342, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 16.53% (0.1906 => 0.2221, std.dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.34% (0.3121 => 0.3631, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/exptree: 16.22% (0.0814 => 0.0946, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.09% (1.4186 => 1.6468, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 16.06% (0.9765 => 1.1333, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/18-imp/imp: 16.04% (0.3423 => 0.3972, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.90% (0.0648 => 0.0751, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 15.89% (1.0722 => 1.2426, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: 15.89% (1.1642 => 1.3492, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/voronoi/voronoi: 15.89% (0.2700 => 0.3129, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.80% (0.2107 => 0.2440, std.dev.: 0.0028) MultiSource/Applications/treecc/treecc: 15.78% (2.0273 => 2.3473, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/football/football: 15.66% (0.8921 => 1.0318, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 15.63% (0.0672 => 0.0777, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 15.52% (0.1695 => 0.1958, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 15.49% (0.7835 => 0.9049, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.49% (0.1117 => 0.1290, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 15.32% (0.5981 => 0.6897, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.21% (1.1861 => 1.3665, std.dev.: 0.0018) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 15.20% (0.1125 => 0.1296, std.dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 15.04% (0.7433 => 0.8551, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 15.03% (0.5860 => 0.6741, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.97% (0.1062 => 0.1221, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.77% (0.1625 => 0.1865, std.dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 14.74% (22.1758 => 25.4452, std.dev.: 0.0391) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.72% (4.2646 => 4.8922, std.dev.: 0.0057) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.70% (0.1143 => 0.1311, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.68% (0.0933 => 0.1070, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.67% (0.2065 => 0.2368, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.62% (0.0759 => 0.0870, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 14.61% (0.4299 => 0.4927, std.dev.: 0.0075) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.59% (0.1330 => 0.1524, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 14.53% (0.0929 => 0.1064, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 14.39% (3.8723 => 4.4296, std.dev.: 0.0260) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.38% (0.1029 => 0.1177, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.33% (0.3307 => 0.3781, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.25% (0.0730 => 0.0834, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 14.08% (0.5569 => 0.6353, std.dev.: 0.0041) MultiSource/Benchmarks/sim/sim: 14.05% (0.3387 => 0.3863, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.77% (0.0770 => 0.0876, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 13.75% (0.3092 => 0.3517, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.58% (0.1892 => 0.2149, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 13.51% (9.4845 => 10.7657, std.dev.: 0.0116) MultiSource/Benchmarks/Olden/health/health: 13.49% (0.1268 => 0.1439, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.37% (0.3441 => 0.3901, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.01% (0.0838 => 0.0947, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.94% (0.3826 => 0.4321, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 12.92% (0.3180 => 0.3591, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 12.17% (0.0953 => 0.1069, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 11.88% (2.2969 => 2.5698, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.81% (14.3668 => 16.0632, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.78% (0.8101 => 0.9055, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.52% (5.0018 => 5.5778, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 11.49% (0.1044 => 0.1164) SingleSource/Benchmarks/Misc-C++/bigfib: 11.43% (0.6456 => 0.7194, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.36% (4.9449 => 5.5066, std.dev.: 0.0078) SingleSource/UnitTests/ObjC/parameter-passing: 11.23% (0.3927 => 0.4368, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 11.14% (0.3473 => 0.3860, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 11.12% (0.4289 => 0.4766, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-4: 11.12% (0.3543 => 0.3937, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 11.10% (0.4620 => 0.5133, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 11.07% (17.1811 => 19.0838, std.dev.: 0.0139) SingleSource/UnitTests/ObjC/exceptions: 11.00% (0.3828 => 0.4249, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.97% (0.3427 => 0.3803, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.95% (0.3543 => 0.3931, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.94% (2.2022 => 2.4431, std.dev.: 0.0118) SingleSource/UnitTests/ObjC/for-in: 10.94% (0.3694 => 0.4098, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/exceptions-2: 10.92% (0.3497 => 0.3879, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 10.90% (0.3561 => 0.3949, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.86% (0.3516 => 0.3898, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.71% (0.3886 => 0.4302, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 10.26% (0.3422 => 0.3773, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.16% (0.4203 => 0.4630, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.96% (0.3865 => 0.4250, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.79% (0.4636 => 0.5090, std.dev.: 0.0029) MultiSource/Applications/hbd/hbd: 9.77% (1.5603 => 1.7128, std.dev.: 0.0112) SingleSource/UnitTests/ObjC++/property-reference-object: 9.73% (0.6030 => 0.6617, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.72% (0.5925 => 0.6501, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.68% (0.4103 => 0.4500, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 9.61% (0.7326 => 0.8030, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists1: 9.61% (0.3684 => 0.4038, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 9.51% (0.4048 => 0.4433, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.44% (0.2266 => 0.2480, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.31% (3.8922 => 4.2546, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.30% (0.2430 => 0.2656, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.86% (0.4064 => 0.4424, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 8.71% (0.3603 => 0.3917, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.11% (0.8067 => 0.8721, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.03% (0.3650 => 0.3943, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 7.88% (0.3098 => 0.3342, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 7.71% (0.3283 => 0.3536, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.70% (0.2793 => 0.3008, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 7.65% (0.3282 => 0.3533, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 7.63% (0.2831 => 0.3047, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.56% (0.3162 => 0.3401, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.47% (0.2891 => 0.3107, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 7.46% (0.3232 => 0.3473, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.23% (0.2905 => 0.3115, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.17% (0.2872 => 0.3078, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.17% (2.0665 => 2.2146, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 7.09% (1.2842 => 1.3752, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/except: 7.07% (0.2871 => 0.3074, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.04% (0.2756 => 0.2950, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 6.99% (0.2877 => 0.3078, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.97% (0.2725 => 0.2915, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 6.85% (0.2714 => 0.2900, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 6.78% (0.3052 => 0.3259, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 6.75% (0.3379 => 0.3607, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 6.57% (0.2802 => 0.2986, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: 6.25% (0.2049 => 0.2177, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.56% (7.9617 => 8.4047, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/objinst: 5.56% (0.3131 => 0.3305, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.48% (0.3136 => 0.3308, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.04% (0.3935 => 0.4094, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.35% (0.3817 => 0.3945, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.94% (7.0540 => 7.2617, std.dev.: 0.0120) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.13% (1.1145 => 1.3723, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 10.91% (0.9957 => 1.1043, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/richards_benchmark: 9.79% (1.1396 => 1.2512, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.95% (2.8904 => 3.0912, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3680, std.dev.: 0.0009) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: 4.50% (3.3453 => 3.4960) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 2.96% (1.9405 => 1.9980, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.69% (4.2280 => 4.3418, std.dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 2.44% (4.4649 => 4.5740, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bisort/bisort: 1.79% (0.8333 => 0.8482, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2077, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.35% (9.1159 => 9.2387, std.dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: 1.30% (11.6436 => 11.7952, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -76.60% (0.8651 => 0.2024, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.09% (5.3855 => 2.4187, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -54.84% (5.3526 => 2.4171, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/richards_benchmark: -44.88% (0.1622 => 0.0894, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.22% (1.1194 => 0.6804, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.02% (5.2763 => 3.2175, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -23.41% (1.7609 => 1.3486, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -17.19% (2.9384 => 2.4333, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -9.01% (54.1659 => 49.2878, std.dev.: 0.0370) MultiSource/Applications/JM/ldecod/ldecod: -7.80% (10.4361 => 9.6225, std.dev.: 0.0260) MultiSource/Benchmarks/PAQ8p/paq8p: -4.26% (10.3673 => 9.9260, std.dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -54.03% (8.0499 => 3.7008, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0134) SingleSource/Benchmarks/Misc/mandel: -33.49% (1.1492 => 0.7643, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.36% (0.3987 => 0.2697, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.51% (2.9695 => 2.3605, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.99% (1.2258 => 0.9930, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4236, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -11.40% (1.2373 => 1.0963, std.dev.: 0.0053) MultiSource/Benchmarks/NPB-serial/is/is: -11.01% (9.5636 => 8.5108, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -10.82% (1.5373 => 1.3710, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.31% (19.9488 => 18.2909, std.dev.: 0.0148) MultiSource/Benchmarks/FreeBench/mason/mason: -7.87% (0.2161 => 0.1991, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.07% (1.8329 => 1.7033, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4781) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -5.45% (6.6465 => 6.2842, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.10% (1.6805 => 1.5948, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.85% (0.2497 => 0.2376, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5074, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.91% (8.1563 => 7.8372, std.dev.: 0.0034) MultiSource/Applications/siod/siod: -3.81% (3.2827 => 3.1575, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.52% (32.5116 => 31.3681, std.dev.: 0.0066) MultiSource/Benchmarks/sim/sim: -3.33% (5.0483 => 4.8804, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: -2.92% (4.6441 => 4.5085, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.79% (4.5009 => 4.3754, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.68% (0.4808 => 0.4679, std.dev.: 0.0027) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/multiplies: -2.00% (2.5528 => 2.5018, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -1.88% (10.2830 => 10.0896, std.dev.: 0.0155) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6814, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: -1.28% (85.0658 => 83.9786, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.20% (1.7254 => 1.7047, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.11% (6.2999 => 6.2300, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8569, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: -1.01% (1.1277 => 1.1163, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.15% (7.1582 => 7.8132, std.dev.: 0.0145) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: 10635.42% (0.0720 => 7.7295, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 28 02:51:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 28 Oct 2012 04:51:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121028095118.D62102A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5331?compare_to=5327&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5331, Order: 166899, Start Time: 2012-10-28 08:25:52, End Time: 2012-10-28 09:51:16 To: 5327, Order: 166897, Start Time: 2012-10-28 06:33:31, End Time: 2012-10-28 08:02:31 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 3 (5 on baseline) Performance Improvements: 0 (175 on baseline) Unchanged Tests: 1039 (862 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/flops: 26.52% (7.2615 => 9.1875, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.01% (1.2710 => 1.2966, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/lists: 1.62% (6.1326 => 6.2321, std.dev.: 0.0049) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.28% (15.2527 => 18.3454, std.dev.: 0.0169) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.88% (2.0478 => 2.1068, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: 2.44% (7.4937 => 7.6767, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/hash2: 2.34% (3.1932 => 3.2680, std.dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.46% (0.1584 => 0.1450, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.32% (0.1431 => 0.1312, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.38% (0.3821 => 0.3539, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: -6.61% (2.4924 => 2.3277, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.56% (0.3142 => 0.2936, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.55% (0.2428 => 0.2269, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.42% (0.3658 => 0.3423, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -6.40% (0.3812 => 0.3568, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -6.34% (0.3848 => 0.3604, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -6.34% (0.3896 => 0.3649, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -6.29% (0.3831 => 0.3590, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -6.29% (0.3880 => 0.3636, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -6.25% (0.4176 => 0.3915, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.25% (22.4056 => 21.0055, std.dev.: 0.0133) SingleSource/UnitTests/ObjC/for-in: -6.20% (0.4033 => 0.3783, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.17% (0.3891 => 0.3651, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.14% (0.6484 => 0.6086, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/property: -6.10% (0.4199 => 0.3943, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: -6.02% (0.2659 => 0.2499, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.98% (4.5069 => 4.2373, std.dev.: 0.0070) SingleSource/UnitTests/ObjC/parameter-passing: -5.96% (0.4280 => 0.4025, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -5.84% (4.3330 => 4.0801, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/ReedSolomon: -5.80% (0.1879 => 0.1770, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: -5.78% (1.2515 => 1.1792, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.77% (0.3884 => 0.3660, std.dev.: 0.0059) MultiSource/Applications/sgefa/sgefa: -5.72% (0.3357 => 0.3165, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.70% (5.4682 => 5.1567, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.68% (0.3837 => 0.3619, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -5.67% (7.0961 => 6.6934, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/strcat: -5.65% (0.2989 => 0.2820, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -5.62% (1.3148 => 1.2409, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.61% (0.9852 => 0.9299, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.61% (0.2355 => 0.2223, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: -5.60% (0.2160 => 0.2039, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.60% (1.0544 => 0.9954, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -5.59% (2.4021 => 2.2678, std.dev.: 0.0068) MultiSource/Applications/JM/lencod/lencod: -5.58% (16.1920 => 15.2877, std.dev.: 0.0121) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.57% (0.2548 => 0.2406, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.56% (0.4151 => 0.3920, std.dev.: 0.0086) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.55% (0.4813 => 0.4546, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.54% (0.3252 => 0.3072, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.53% (4.8161 => 4.5498, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.53% (3.5339 => 3.3386, std.dev.: 0.0085) MultiSource/Benchmarks/Bullet/bullet: -5.47% (34.0927 => 32.2267, std.dev.: 0.0259) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.46% (0.8521 => 0.8056, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.45% (4.8802 => 4.6144, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.44% (0.2903 => 0.2745, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.44% (0.7919 => 0.7488, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.44% (1.2784 => 1.2089, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.43% (1.6474 => 1.5579, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.43% (0.3057 => 0.2891, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -5.43% (0.3446 => 0.3259, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.40% (0.5999 => 0.5675, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.39% (0.3323 => 0.3144, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.36% (1.2221 => 1.1566, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.33% (1.2210 => 1.1559, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/fibo: -5.33% (0.2871 => 0.2718, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -5.32% (0.6750 => 0.6391, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.31% (0.4083 => 0.3866, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -5.31% (0.3481 => 0.3296, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -5.30% (0.3394 => 0.3214, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -5.30% (0.3621 => 0.3429, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -5.30% (0.2849 => 0.2698, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -5.29% (0.2985 => 0.2827, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.29% (0.9542 => 0.9037, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: -5.29% (0.3026 => 0.2866, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -5.27% (0.4861 => 0.4605, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: -5.23% (0.3194 => 0.3027, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.20% (2.1713 => 2.0583, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.20% (4.0323 => 3.8227, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/wc: -5.18% (0.3205 => 0.3039, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -5.17% (0.3867 => 0.3667, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: -5.16% (18.2933 => 17.3488, std.dev.: 0.0231) SingleSource/Benchmarks/Shootout-C++/random: -5.14% (0.2939 => 0.2788, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -5.13% (0.3059 => 0.2902, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -5.13% (0.3255 => 0.3088, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -5.12% (0.3025 => 0.2870, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.11% (0.4321 => 0.4100, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.09% (0.2278 => 0.2162, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -5.08% (0.7779 => 0.7384, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.07% (0.3016 => 0.2863, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.07% (0.3849 => 0.3654, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.06% (0.7198 => 0.6834, std.dev.: 0.0014) MultiSource/Applications/lua/lua: -5.05% (4.0594 => 3.8545, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sieve: -5.02% (0.3788 => 0.3598, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.98% (1.4642 => 1.3913, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -4.96% (1.6364 => 1.5553, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.94% (2.2587 => 2.1472, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.91% (1.3722 => 1.3048, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.90% (0.4427 => 0.4210, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.90% (0.2999 => 0.2852, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.90% (0.3491 => 0.3320, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -4.89% (9.2283 => 8.7769, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.88% (0.6293 => 0.5986, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -4.86% (0.7982 => 0.7594, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: -4.85% (0.6347 => 0.6039, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -4.83% (0.4248 => 0.4043, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -4.80% (0.4524 => 0.4307, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference-object: -4.78% (0.6441 => 0.6133, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.73% (0.3931 => 0.3745, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.64% (0.9557 => 0.9114, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.62% (0.4916 => 0.4689, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/18-imp/imp: -4.61% (0.3581 => 0.3416, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.58% (0.3319 => 0.3167, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.49% (0.5478 => 0.5232, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.45% (0.6676 => 0.6379, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.44% (0.5591 => 0.5343, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.40% (0.2385 => 0.2280, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: -4.39% (1.1450 => 1.0947, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.38% (0.6297 => 0.6021, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -4.36% (0.8418 => 0.8051, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.32% (0.5863 => 0.5610, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: -4.30% (0.4515 => 0.4321, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.30% (0.2933 => 0.2807, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.28% (0.5581 => 0.5342, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.27% (0.6230 => 0.5964, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.27% (0.6681 => 0.6396, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.26% (0.3406 => 0.3261, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.25% (0.6440 => 0.6166, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: -4.25% (0.3271 => 0.3132, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: -4.24% (0.9179 => 0.8790, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.24% (0.5805 => 0.5559, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.24% (0.7339 => 0.7028, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.23% (0.6660 => 0.6378, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.23% (0.5456 => 0.5225, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.23% (0.5859 => 0.5611, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.22% (0.6189 => 0.5928, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.21% (0.5705 => 0.5465, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.20% (0.5925 => 0.5676, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.19% (0.6260 => 0.5998, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.18% (0.5857 => 0.5612, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.18% (0.6052 => 0.5799, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.17% (0.6667 => 0.6389, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -4.15% (15.5079 => 14.8639, std.dev.: 0.0202) MultiSource/Applications/minisat/minisat: -4.15% (0.7447 => 0.7138, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.14% (0.6395 => 0.6130, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.14% (0.5575 => 0.5344, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.12% (0.5941 => 0.5696, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: -4.12% (2.1401 => 2.0519, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.10% (0.5849 => 0.5609, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.10% (0.6194 => 0.5940, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.08% (0.6304 => 0.6047, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.07% (8.0126 => 7.6865, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.07% (0.6395 => 0.6135, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.06% (0.5569 => 0.5343, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.05% (0.5802 => 0.5567, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.04% (0.6033 => 0.5789, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.02% (0.6736 => 0.6465, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -3.99% (0.5570 => 0.5348, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -3.96% (0.5688 => 0.5463, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.95% (0.7524 => 0.7227, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.93% (0.3483 => 0.3346, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -3.92% (0.5567 => 0.5349, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.88% (0.6446 => 0.6196, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -3.87% (17.1032 => 16.4421, std.dev.: 0.0212) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.77% (0.7021 => 0.6756, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.77% (5.0226 => 4.8333, std.dev.: 0.0076) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.74% (6.7716 => 6.5183, std.dev.: 0.0161) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.72% (1.2300 => 1.1843, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.70% (0.9077 => 0.8741, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: -3.69% (3.5154 => 3.3857, std.dev.: 0.0029) MultiSource/Applications/hbd/hbd: -3.53% (1.5610 => 1.5059, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.44% (0.5168 => 0.4990, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.32% (0.5329 => 0.5152, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.14% (14.2083 => 13.7618, std.dev.: 0.0111) MultiSource/Benchmarks/nbench/nbench: -3.11% (1.1530 => 1.1171, std.dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -2.41% (20.7746 => 20.2740, std.dev.: 0.0453) MultiSource/Applications/SIBsim4/SIBsim4: -1.29% (1.3864 => 1.3685, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7539, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/richards_benchmark: -8.68% (1.2842 => 1.1727, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.92% (2.2633 => 2.1745, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7063, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.52% (6.5735 => 6.4739, std.dev.: 0.0032) Report Time: 1.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 28 03:57:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 28 Oct 2012 05:57:04 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121028105704.532D82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5332?compare_to=5329&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5332, Order: 166899, Start Time: 2012-10-28 09:32:46, End Time: 2012-10-28 10:57:03 To: 5329, Order: 166898, Start Time: 2012-10-28 07:52:23, End Time: 2012-10-28 09:16:06 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 10 (108 on baseline) Performance Improvements: 1 (6 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 964 (860 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 13.00% (0.1023 => 0.1156, std.dev.: 0.0028) MultiSource/Applications/Burg/burg: 4.11% (1.2322 => 1.2828, std.dev.: 0.0107) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.78% (0.3205 => 0.3326, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.04% (0.8694 => 0.8958, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.85% (0.9292 => 0.9464, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.76% (0.8916 => 0.9073, std.dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: 1.22% (0.9898 => 1.0019, std.dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.37% (40.5495 => 41.9166, std.dev.: 0.1159) SingleSource/Benchmarks/Shootout-C++/except: 2.74% (0.4898 => 0.5032, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.64% (1.2652 => 1.2860, std.dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.47% (2.7140 => 2.6740, std.dev.: 0.0121) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.31% (16.7418 => 16.6898, std.dev.: 0.0450) MultiSource/Applications/obsequi/Obsequi: 0.70% (1.0642 => 1.0717, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: 0.14% (0.6505 => 0.6514, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: -0.94% (0.1918 => 0.1900, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.48% (0.1616 => 0.1656, std.dev.: 0.0087) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.03% (0.3258 => 0.3259, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.24% (0.2484 => 0.2478, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.87% (0.3332 => 0.3361, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.10% (0.2374 => 0.2400, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/bigfib: -0.49% (0.6063 => 0.6033, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/mandel: 19.71% (0.0416 => 0.0498, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.27% (0.3316 => 0.3307, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/strcat: -0.20% (0.2004 => 0.2000, std.dev.: 0.0020) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 35.43% (0.0175 => 0.0237, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.09% (0.0184 => 0.0182, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.88% (0.0425 => 0.0433, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -3.01% (0.0332 => 0.0322, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -7.32% (0.0314 => 0.0291, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -17.73% (0.0423 => 0.0348, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/casts: -9.09% (0.0187 => 0.0170, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/test1: -30.00% (0.0210 => 0.0147, std.dev.: 0.0028) SingleSource/UnitTests/byval-alignment: 15.12% (0.0291 => 0.0335, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 0.35% (0.1445 => 0.1450, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 1.39% (1.1374 => 1.1532, std.dev.: 0.0056) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 0.42% (0.1443 => 0.1449, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.21% (0.4063 => 0.4234, std.dev.: 0.0212) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.20% (0.1308 => 0.1376, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.03% (0.0585 => 0.0579, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 13.99% (0.0193 => 0.0220, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.68% (0.0546 => 0.0577, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.04% (1.1427 => 1.1431, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.10% (0.0580 => 0.0562, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.28% (0.0183 => 0.0177, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.70% (0.7957 => 0.8013, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (0.0001 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -50.00% (0.0002 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 24.71% (0.0085 => 0.0106, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.24% (2.1832 => 1.6539, std.dev.: 0.0052) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 36.09% (14.7684 => 20.0982, std.dev.: 0.0299) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.54% (0.0810 => 0.0944, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 12.94% (0.0773 => 0.0873, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 12.77% (0.1112 => 0.1254, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.03% (0.0848 => 0.0950, std.dev.: 0.0007) SingleSource/UnitTests/SignlessTypes/rem: 11.50% (0.1035 => 0.1154, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.80% (0.2180 => 0.2350, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.66% (0.8321 => 0.8958, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.33% (0.2279 => 0.2446, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.23% (0.2519 => 0.2701, std.dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: 7.03% (1.2568 => 1.3451, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.89% (0.1466 => 0.1567, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.37% (0.1885 => 0.2005, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 6.33% (0.1721 => 0.1830, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.10% (0.7473 => 0.7929, std.dev.: 0.0113) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.02% (0.3137 => 0.3326, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.88% (13.1811 => 13.9560, std.dev.: 0.1257) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.74% (6.6074 => 6.9869, std.dev.: 0.1008) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.50% (0.6287 => 0.6633, std.dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: 5.39% (1.1271 => 1.1879, std.dev.: 0.0136) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.31% (0.2240 => 0.2359, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.17% (0.6227 => 0.6549, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.01% (1.1606 => 1.2187, std.dev.: 0.0112) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.96% (0.2741 => 0.2877, std.dev.: 0.0036) MultiSource/Applications/Burg/burg: 4.96% (1.2222 => 1.2828, std.dev.: 0.0107) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.85% (1.1170 => 1.1712, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.78% (1.6386 => 1.7170, std.dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.58% (0.4127 => 0.4316, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.45% (0.4783 => 0.4996, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.30% (0.9074 => 0.9464, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.27% (0.9435 => 0.9838, std.dev.: 0.0084) MultiSource/Applications/sgefa/sgefa: 4.23% (0.2999 => 0.3126, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 4.22% (0.8359 => 0.8712, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.12% (8.6476 => 9.0037, std.dev.: 0.0348) SingleSource/Benchmarks/Shootout-C++/lists1: 4.11% (0.2969 => 0.3091, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 4.10% (0.8716 => 0.9073, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.03% (0.5191 => 0.5400, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.93% (0.3003 => 0.3121, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: 3.92% (0.2985 => 0.3102, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.88% (0.5961 => 0.6192, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 3.72% (14.2605 => 14.7910, std.dev.: 0.1489) MultiSource/Applications/hbd/hbd: 3.71% (1.4269 => 1.4799, std.dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.63% (0.3717 => 0.3852, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 3.58% (0.8331 => 0.8629, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.54% (0.5817 => 0.6023, std.dev.: 0.0048) MultiSource/Applications/minisat/minisat: 3.51% (0.6834 => 0.7074, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 3.49% (0.8805 => 0.9112, std.dev.: 0.0067) MultiSource/Applications/treecc/treecc: 3.44% (1.9948 => 2.0635, std.dev.: 0.0203) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.44% (0.8611 => 0.8907, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 3.40% (0.9069 => 0.9377, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 3.38% (0.7932 => 0.8200, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.38% (0.8317 => 0.8598, std.dev.: 0.0106) MultiSource/Applications/lemon/lemon: 3.37% (1.0945 => 1.1314, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.36% (0.8697 => 0.8989, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/football/football: 3.30% (0.8768 => 0.9057, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 3.29% (0.8066 => 0.8331, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.27% (0.8340 => 0.8613, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.25% (0.8007 => 0.8267, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.22% (0.8457 => 0.8729, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 3.09% (0.9039 => 0.9318, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.08% (1.2602 => 1.2990, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.08% (0.8316 => 0.8572, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.07% (0.8656 => 0.8922, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.04% (0.8048 => 0.8293, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.01% (0.8086 => 0.8329, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.95% (1.4479 => 1.4906, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/hash: 2.95% (0.3800 => 0.3912, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.90% (0.9908 => 1.0195, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.88% (0.9688 => 0.9967, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.87% (0.9056 => 0.9316, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.84% (4.1763 => 4.2949, std.dev.: 0.0454) SingleSource/Benchmarks/Shootout-C++/hash2: 2.76% (0.4125 => 0.4239, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.75% (0.8069 => 0.8291, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 2.65% (4.1305 => 4.2399, std.dev.: 0.0239) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.64% (0.8518 => 0.8743, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.62% (0.8927 => 0.9161, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.61% (0.8286 => 0.8502, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.61% (0.8597 => 0.8821, std.dev.: 0.0041) MultiSource/Applications/lua/lua: 2.59% (3.8189 => 3.9179, std.dev.: 0.0306) MultiSource/Applications/JM/ldecod/ldecod: 2.56% (6.7320 => 6.9041, std.dev.: 0.0508) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.55% (0.8261 => 0.8472, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.55% (0.8204 => 0.8413, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.47% (0.8855 => 0.9074, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.40% (0.8177 => 0.8373, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.39% (0.8420 => 0.8621, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.37% (0.8885 => 0.9096, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.36% (0.8338 => 0.8535, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.33% (1.3279 => 1.3588, std.dev.: 0.0074) MultiSource/Applications/JM/lencod/lencod: 2.27% (15.3280 => 15.6755, std.dev.: 0.1277) MultiSource/Applications/hexxagon/hexxagon: 2.13% (0.9810 => 1.0019, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.96% (1.5315 => 1.5615, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.93% (0.8712 => 0.8880, std.dev.: 0.0049) MultiSource/Benchmarks/PAQ8p/paq8p: 1.75% (2.3764 => 2.4180, std.dev.: 0.0105) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.71% (0.8995 => 0.9149, std.dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.78% (1.5795 => 2.5080, std.dev.: 0.0034) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.89% (2.4333 => 2.6740, std.dev.: 0.0121) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.46% (14.6451 => 16.0302, std.dev.: 0.3042) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.91% (0.3186 => 0.3470, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.46% (1.1857 => 1.2860, std.dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 5.99% (63.1822 => 66.9686, std.dev.: 0.1109) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.71% (0.2887 => 0.2994, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/ReedSolomon: 3.06% (8.5322 => 8.7929, std.dev.: 0.0039) MultiSource/Applications/siod/siod: 2.69% (3.6643 => 3.7628, std.dev.: 0.0203) SingleSource/Benchmarks/Shootout-C++/except: 2.26% (0.4921 => 0.5032, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.81% (4.3552 => 4.4340, std.dev.: 0.0213) MultiSource/Benchmarks/Olden/bh/bh: 1.66% (2.3560 => 2.3951, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.19% (41.4238 => 41.9166, std.dev.: 0.1159) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.03% (4.8362 => 4.8861, std.dev.: 0.0148) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -32.84% (0.0338 => 0.0227, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.76% (0.3269 => 0.2950, std.dev.: 0.0025) MultiSource/Applications/lua/lua: -4.93% (29.8330 => 28.3609, std.dev.: 0.0460) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.22% (0.2605 => 0.2495, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: -1.57% (3.4237 => 3.3700, std.dev.: 0.0170) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.20% (3.3479 => 3.3078, std.dev.: 0.0006) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 1.48% (16.4461 => 16.6898, std.dev.: 0.0450) MultiSource/Applications/obsequi/Obsequi: 4.43% (1.0262 => 1.0717, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: 2.87% (0.6332 => 0.6514, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 3.77% (0.1831 => 0.1900, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 6.22% (0.1559 => 0.1656, std.dev.: 0.0087) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.35% (0.3123 => 0.3259, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.61% (0.2463 => 0.2478, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.51% (0.3344 => 0.3361, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.52% (0.2364 => 0.2400, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/bigfib: 0.38% (0.6010 => 0.6033, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/mandel: 16.08% (0.0429 => 0.0498, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.26% (0.3266 => 0.3307, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/strcat: 1.57% (0.1969 => 0.2000, std.dev.: 0.0020) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.80% (0.0224 => 0.0237, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 47.97% (0.0123 => 0.0182, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 6.13% (0.0408 => 0.0433, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 26.77% (0.0254 => 0.0322, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.64% (0.0302 => 0.0291, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -9.37% (0.0384 => 0.0348, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/casts: -10.53% (0.0190 => 0.0170, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/test1: -18.33% (0.0180 => 0.0147, std.dev.: 0.0028) SingleSource/UnitTests/byval-alignment: 45.65% (0.0230 => 0.0335, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 0.83% (0.1438 => 0.1450, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 1.79% (1.1329 => 1.1532, std.dev.: 0.0056) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -0.89% (0.1462 => 0.1449, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.68% (0.4164 => 0.4234, std.dev.: 0.0212) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.51% (0.1369 => 0.1376, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.67% (0.0641 => 0.0579, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 12.82% (0.0195 => 0.0220, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.17% (0.0578 => 0.0577, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.05% (1.1437 => 1.1431, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.37% (0.0627 => 0.0562, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.67% (0.0180 => 0.0177, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.05% (0.8017 => 0.8013, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 70.97% (0.0062 => 0.0106, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 28 04:25:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 28 Oct 2012 06:25:31 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121028112531.71F162A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5333?compare_to=5330&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5333, Order: 166899, Start Time: 2012-10-28 09:54:09, End Time: 2012-10-28 11:25:29 To: 5330, Order: 166898, Start Time: 2012-10-28 07:52:23, End Time: 2012-10-28 09:24:26 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (10 on baseline) New Passes: 0 (14 on baseline) Performance Regressions: 1 (189 on baseline) Performance Improvements: 1 (54 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 15 (5 on baseline) Unchanged Tests: 1025 (636 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 1.59% (25.4452 => 25.8494, std.dev.: 0.0228) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.40% (0.9716 => 0.9580, std.dev.: 0.0050) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -0.26% (2.0611 => 2.0557, std.dev.: 0.0130) MultiSource/Benchmarks/Bullet/bullet: -0.13% (58.1194 => 58.0449, std.dev.: 0.0170) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.13% (0.0800 => 0.0799, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -0.26% (9.2652 => 9.2409, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.07% (7.8132 => 7.8080, std.dev.: 0.0065) SingleSource/UnitTests/Vector/SSE/sse_shift: -0.39% (0.0518 => 0.0516, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/JM/lencod/lencod: -0.01% (7.7295 => 7.7289, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: - (0.0001 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0649 => 0.0648) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.07% (0.2990 => 0.2992, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_shift: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -64.31% (5.7591 => 2.0557, std.dev.: 0.0130) MultiSource/Benchmarks/Bullet/bullet: -8.22% (63.2438 => 58.0449, std.dev.: 0.0170) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.81% (6.6874 => 0.0799, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.58% (8.1363 => 9.2409, std.dev.: 0.0039) SingleSource/UnitTests/Vector/SSE/sse_shift: 36.51% (0.0378 => 0.0516, std.dev.: 0.0001) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -50.00% (0.0002 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -57.02% (0.6962 => 0.2992, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_shift: -50.00% (0.0002 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 213.39% (0.5229 => 1.6387, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 18.06% (14.9895 => 17.6966, std.dev.: 0.0052) MultiSource/Applications/kimwitu++/kc: 37.94% (14.1553 => 19.5259, std.dev.: 0.0333) MultiSource/Benchmarks/MallocBench/gs/gs: 13.85% (4.1105 => 4.6798, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 33.33% (1.1048 => 1.4730, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: 69.40% (3.4629 => 5.8663, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 68.80% (0.6222 => 1.0503, std.dev.: 0.0008) New Passes - Execution Time --------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 3838000.00% (0.0001 => 3.8381, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 11162600.00% (0.0001 => 11.1627, std.dev.: 0.0090) MultiSource/Applications/kimwitu++/kc: 50700.00% (0.0001 => 0.0508, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049900.00% (0.0001 => 10.0500, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5490300.00% (0.0001 => 5.4904, std.dev.: 0.0295) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 78.38% (0.0296 => 0.0528, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 69.53% (0.0256 => 0.0434, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 60.52% (0.0271 => 0.0435, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 52.67% (0.0243 => 0.0371, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 44.06% (1.5859 => 2.2846, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.85% (0.0834 => 0.1183, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/distray/distray: 41.00% (0.1056 => 0.1489, std.dev.: 0.0002) SingleSource/UnitTests/vla: 35.77% (0.0355 => 0.0482, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 35.25% (2.2024 => 2.9788, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 33.97% (0.1463 => 0.1960, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 29.54% (0.1432 => 0.1855, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 28.28% (0.1655 => 0.2123, std.dev.: 0.0007) MultiSource/Benchmarks/llubenchmark/llu: 24.24% (0.0462 => 0.0574, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/rem: 22.20% (0.1144 => 0.1398, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.78% (0.1566 => 0.1907, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.27% (0.5105 => 0.6191, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 20.90% (0.1555 => 0.1880, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.78% (0.0871 => 0.1052, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 19.48% (0.6675 => 0.7975, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 19.21% (1.3050 => 1.5557, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 19.17% (3.3354 => 3.9749, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.11% (0.2271 => 0.2705, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 18.90% (0.0730 => 0.0868, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/n-body: 18.77% (0.0746 => 0.0886, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.76% (0.5020 => 0.5962, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 18.55% (0.1175 => 0.1393, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 18.41% (0.0793 => 0.0939, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 18.36% (0.2554 => 0.3023, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 18.27% (0.7115 => 0.8415, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.08% (0.1510 => 0.1783, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 17.96% (0.1236 => 0.1458, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.83% (1.5415 => 1.8163, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 17.80% (0.1584 => 0.1866, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 17.73% (0.0626 => 0.0737, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 17.69% (1.1840 => 1.3935, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 17.64% (0.1695 => 0.1994, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.64% (0.1032 => 0.1214, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.58% (0.1337 => 0.1572, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 17.37% (0.1163 => 0.1365, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.33% (0.4615 => 0.5415, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.23% (0.8172 => 0.9580, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 17.18% (0.4879 => 0.5717, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 16.92% (0.3109 => 0.3635, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 16.90% (0.3177 => 0.3714, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 16.83% (0.2603 => 0.3041, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.78% (0.6450 => 0.7532, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 16.65% (0.1940 => 0.2263, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 16.57% (22.1758 => 25.8494, std.dev.: 0.0228) MultiSource/Applications/aha/aha: 16.51% (0.1151 => 0.1341, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.40% (0.3121 => 0.3633, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.37% (0.0886 => 0.1031, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.15% (0.0675 => 0.0784, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 16.05% (0.1906 => 0.2212, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/exptree: 15.97% (0.0814 => 0.0944, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.91% (0.0842 => 0.0976, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 15.80% (2.0273 => 2.3476, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 15.79% (1.0722 => 1.2415, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.75% (0.9765 => 1.1303, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 15.61% (1.1642 => 1.3459, std.dev.: 0.0066) MultiSource/Applications/spiff/spiff: 15.58% (0.7835 => 0.9056, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.40% (0.1117 => 0.1289, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 15.35% (0.8921 => 1.0290, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.33% (0.2107 => 0.2430, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 15.33% (0.0672 => 0.0775, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.30% (0.2758 => 0.3180, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 15.28% (0.1695 => 0.1954, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 15.26% (0.2700 => 0.3112, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.19% (1.1861 => 1.3663, std.dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 15.11% (0.1125 => 0.1295, std.dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 15.11% (0.7433 => 0.8556, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/18-imp/imp: 15.02% (0.3423 => 0.3937, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 14.97% (1.4186 => 1.6309, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.94% (0.0770 => 0.0885, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.86% (0.5860 => 0.6731, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.79% (0.0933 => 0.1071, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.73% (0.5981 => 0.6862, std.dev.: 0.0033) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.70% (0.1143 => 0.1311, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.69% (0.1062 => 0.1218, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.58% (0.2065 => 0.2366, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.52% (0.1625 => 0.1861, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.50% (4.2646 => 4.8829, std.dev.: 0.0040) MultiSource/Applications/lua/lua: 14.48% (3.8723 => 4.4330, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.44% (0.1330 => 0.1522, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 14.38% (0.4299 => 0.4917, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.36% (0.0759 => 0.0868, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 14.21% (0.0929 => 0.1061, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.09% (0.1029 => 0.1174, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.04% (0.0798 => 0.0910, std.dev.: 0.0018) MultiSource/Benchmarks/sim/sim: 13.99% (0.3387 => 0.3861, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.94% (0.3307 => 0.3768, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 13.84% (0.0730 => 0.0831, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.64% (0.0770 => 0.0875, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.56% (0.5569 => 0.6324, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 13.46% (9.4845 => 10.7610, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.34% (0.3441 => 0.3900, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: 13.25% (0.1268 => 0.1436, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.13% (0.0838 => 0.0948, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 12.97% (0.3092 => 0.3493, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.75% (0.3826 => 0.4314, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 12.45% (0.3180 => 0.3576, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.00% (0.1892 => 0.2119, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 11.96% (0.0953 => 0.1067, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 11.92% (2.2969 => 2.5707, std.dev.: 0.0211) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.62% (0.8101 => 0.9042, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.60% (14.3668 => 16.0330, std.dev.: 0.0145) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.22% (4.9449 => 5.4996, std.dev.: 0.0109) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.21% (5.0018 => 5.5625, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 11.21% (0.1044 => 0.1161, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 11.17% (0.4620 => 0.5136, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 11.17% (0.6456 => 0.7177, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 11.12% (17.1811 => 19.0922, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.88% (0.3427 => 0.3800, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 10.84% (0.4289 => 0.4754, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.80% (2.2022 => 2.4401, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.67% (0.3927 => 0.4346, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.53% (0.3828 => 0.4231, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.39% (0.3473 => 0.3834, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.36% (0.3561 => 0.3930, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.36% (0.3543 => 0.3910, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.33% (0.3543 => 0.3909, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.30% (0.3516 => 0.3878, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.26% (0.3694 => 0.4073, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.25% (0.4636 => 0.5111, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 10.21% (0.3497 => 0.3854, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.14% (0.3886 => 0.4280, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 10.05% (0.3422 => 0.3766, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.97% (0.4203 => 0.4622, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.83% (0.3865 => 0.4245, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 9.68% (1.5603 => 1.7114, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists1: 9.50% (0.3684 => 0.4034, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 9.44% (0.4048 => 0.4430, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.43% (0.4103 => 0.4490, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.31% (0.2266 => 0.2477, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.30% (3.8922 => 4.2542, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.22% (0.2430 => 0.2654, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 8.69% (0.3603 => 0.3916, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 8.64% (0.7326 => 0.7959, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.61% (0.4064 => 0.4414, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 8.56% (0.6030 => 0.6546, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.51% (0.5925 => 0.6429, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.92% (0.3650 => 0.3939, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 7.71% (0.3098 => 0.3337, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.68% (0.3283 => 0.3535, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 7.65% (0.3282 => 0.3533, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.59% (0.2793 => 0.3005, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 7.45% (0.2831 => 0.3042, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.43% (0.3232 => 0.3472, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.23% (0.2891 => 0.3100, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.23% (0.8067 => 0.8650, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.21% (0.3162 => 0.3390, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 7.10% (1.2842 => 1.3754, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/except: 7.04% (0.2871 => 0.3073, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.99% (0.2905 => 0.3108, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.96% (0.2872 => 0.3072, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.96% (2.0665 => 2.2104, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/methcall: 6.78% (0.2877 => 0.3072, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 6.72% (0.3052 => 0.3257, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 6.72% (0.2725 => 0.2908, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.71% (0.2756 => 0.2941, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 6.63% (0.2714 => 0.2894, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 6.63% (0.3379 => 0.3603, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/random: 6.35% (0.2802 => 0.2980, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: 6.00% (0.2049 => 0.2172, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.34% (7.9617 => 8.3872, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.33% (0.3136 => 0.3303, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (0.3131 => 0.3294, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.81% (0.3935 => 0.4085, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.88% (0.3817 => 0.3927, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.87% (7.0540 => 7.2564, std.dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.10% (1.1145 => 1.3720, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 10.27% (0.9957 => 1.0980, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/richards_benchmark: 9.83% (1.1396 => 1.2516, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.95% (2.8904 => 3.0912, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3690, std.dev.: 0.0025) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: 4.50% (3.3453 => 3.4960, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 2.98% (1.9405 => 1.9983, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.68% (4.2280 => 4.3415, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0313 => 1.0567, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 2.33% (4.4649 => 4.5688, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bisort/bisort: 1.84% (0.8333 => 0.8486, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 1.54% (3.1595 => 3.2080, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.40% (9.1159 => 9.2434, std.dev.: 0.0103) MultiSource/Benchmarks/nbench/nbench: 1.30% (11.6436 => 11.7950, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -76.68% (0.8651 => 0.2017, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.12% (5.3855 => 2.4169, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -54.89% (5.3526 => 2.4148, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -44.88% (0.1622 => 0.0894, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.27% (5.2763 => 3.2043, std.dev.: 0.0123) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.24% (1.1194 => 0.6802, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -23.35% (1.7609 => 1.3497, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -17.42% (2.9384 => 2.4266, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -9.11% (54.1659 => 49.2333, std.dev.: 0.0328) MultiSource/Applications/JM/ldecod/ldecod: -7.81% (10.4361 => 9.6212, std.dev.: 0.0182) MultiSource/Benchmarks/PAQ8p/paq8p: -4.41% (10.3673 => 9.9105, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -54.03% (8.0499 => 3.7003, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0134) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7645, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.61% (0.0506 => 0.0341, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.36% (0.3987 => 0.2697) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.51% (2.9695 => 2.3605, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.99% (1.2258 => 0.9930, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.70% (1.6925 => 1.4268, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.88% (1.2373 => 1.0903, std.dev.: 0.0077) MultiSource/Benchmarks/NPB-serial/is/is: -10.97% (9.5636 => 8.5140, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/mandel-2: -10.79% (1.5373 => 1.3714, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.17% (19.9488 => 18.3181, std.dev.: 0.0077) MultiSource/Benchmarks/FreeBench/mason/mason: -7.91% (0.2161 => 0.1990, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.01% (1.8329 => 1.7044, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -5.47% (6.6465 => 6.2829, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.11% (1.6805 => 1.5947, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.89% (0.2497 => 0.2375, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-5: -4.64% (1.5835 => 1.5101, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.97% (8.1563 => 7.8323, std.dev.: 0.0060) MultiSource/Applications/siod/siod: -3.76% (3.2827 => 3.1592, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.55% (32.5116 => 31.3579, std.dev.: 0.0101) MultiSource/Benchmarks/sim/sim: -3.33% (5.0483 => 4.8803, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: -2.94% (4.6441 => 4.5074, std.dev.: 0.0038) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.91% (0.4808 => 0.4668, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.76% (4.5009 => 4.3768, std.dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/multiplies: -2.06% (2.5528 => 2.5003, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0842, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6828, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -1.28% (85.0658 => 83.9806, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.14% (1.7254 => 1.7058, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.10% (6.2999 => 6.2307, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: -1.01% (1.1277 => 1.1163) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.08% (7.1582 => 7.8080, std.dev.: 0.0065) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: 10634.58% (0.0720 => 7.7289, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 28 05:41:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 28 Oct 2012 07:41:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121028124114.A4F2C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5334?compare_to=5328&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5334, Order: 166899, Start Time: 2012-10-28 09:25:31, End Time: 2012-10-28 12:41:13 To: 5328, Order: 166895, Start Time: 2012-10-28 05:16:35, End Time: 2012-10-28 08:37:17 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (172 on baseline) Performance Improvements: 1 (20 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1037 (716 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.20% (3.1463 => 3.1840, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 1.17% (1.1453 => 1.1587, std.dev.: 0.0037) MultiSource/Benchmarks/Bullet/bullet: 1.11% (26.8072 => 27.1048, std.dev.: 0.0175) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 7.58% (110.3505 => 118.7099, std.dev.: 0.0265) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.34% (2.0019 => 1.9750, std.dev.: 0.0021) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.16% (0.0625 => 0.0876, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.70% (0.1063 => 0.1400, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.00% (0.2969 => 0.3741, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.59% (0.1106 => 0.1389, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.18% (0.4139 => 0.5140, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.08% (0.4253 => 0.5277, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 23.96% (1.5932 => 1.9750, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.88% (0.5900 => 0.7309, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.62% (0.5000 => 0.6181, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.58% (0.0475 => 0.0587) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.57% (0.4994 => 0.6171, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.53% (0.0714 => 0.0882, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.12% (0.0584 => 0.0719, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.03% (0.0547 => 0.0673, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.10% (0.1620 => 0.1978, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.94% (0.1021 => 0.1245, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.85% (0.0897 => 0.1093, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 21.70% (0.0599 => 0.0729, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.59% (0.1107 => 0.1346, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.07% (0.0541 => 0.0655, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 21.03% (0.0604 => 0.0731, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.01% (0.0633 => 0.0766, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 20.99% (0.0948 => 0.1147, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.58% (0.1103 => 0.1330, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.56% (0.0642 => 0.0774, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.55% (0.0584 => 0.0704, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.34% (0.3903 => 0.4697, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/health/health: 20.22% (0.0821 => 0.0987, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 20.20% (0.1619 => 0.1946, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.01% (0.1549 => 0.1859, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.95% (0.0822 => 0.0986, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.94% (0.1003 => 0.1203, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.89% (0.1604 => 0.1923, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.36% (0.1462 => 0.1745, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 19.11% (0.0947 => 0.1128, std.dev.: 0.0028) MultiSource/Applications/sgefa/sgefa: 18.69% (0.0808 => 0.0959, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.62% (0.2014 => 0.2389, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.56% (0.3890 => 0.4612, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 18.56% (0.1218 => 0.1444, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.42% (0.2736 => 0.3240, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 18.11% (0.5826 => 0.6881, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.03% (1.3152 => 1.5523, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/09-vor/vor: 18.01% (0.1505 => 0.1776, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 17.98% (0.5889 => 0.6948, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 17.90% (0.4029 => 0.4750, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/mst/mst: 17.77% (0.0698 => 0.0822, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.74% (0.1088 => 0.1281, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 17.73% (0.0581 => 0.0684, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.68% (0.1968 => 0.2316, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 17.63% (0.5546 => 0.6524, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.49% (3.5627 => 4.1857, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.41% (0.2866 => 0.3365, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.41% (0.5026 => 0.5901, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.36% (0.2875 => 0.3374, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 17.15% (1.8794 => 2.2017, std.dev.: 0.0075) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.06% (1.6211 => 1.8976, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.94% (0.4658 => 0.5447, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 16.93% (0.9909 => 1.1587, std.dev.: 0.0037) MultiSource/Applications/hbd/hbd: 16.89% (0.9697 => 1.1335, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.81% (0.1160 => 0.1355, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 16.77% (0.2725 => 0.3182, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 16.69% (0.0605 => 0.0706, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.66% (2.7292 => 3.1840, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.65% (0.2738 => 0.3194, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 16.65% (0.2714 => 0.3166, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.60% (0.2729 => 0.3182, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.54% (0.3271 => 0.3812, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 16.47% (0.2780 => 0.3238, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 16.47% (0.1421 => 0.1655, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 16.44% (0.3004 => 0.3498, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 16.40% (0.2750 => 0.3201, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 16.28% (0.2813 => 0.3271, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.28% (0.4361 => 0.5071, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 16.27% (0.2803 => 0.3259, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.26% (0.2792 => 0.3246, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 16.26% (0.2823 => 0.3282, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 16.22% (1.0781 => 1.2530, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 16.22% (0.2811 => 0.3267, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 16.18% (0.3096 => 0.3597, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.16% (2.0673 => 2.4014, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 16.08% (0.7171 => 0.8324, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.06% (0.3195 => 0.3708, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.97% (0.2911 => 0.3376, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.93% (0.3930 => 0.4556, std.dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: 15.83% (4.2109 => 4.8775, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.81% (4.4195 => 5.1182, std.dev.: 0.0084) MultiSource/Benchmarks/Olden/bh/bh: 15.73% (0.1284 => 0.1486, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 15.67% (0.3267 => 0.3779, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 15.55% (0.3446 => 0.3982, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.55% (1.9694 => 2.2757, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/exceptions-4: 15.53% (0.3465 => 0.4003, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 15.50% (0.3496 => 0.4038, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 15.49% (0.3460 => 0.3996, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.48% (0.3488 => 0.4028, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.48% (1.9966 => 2.3056, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/trivial-interface: 15.46% (0.3442 => 0.3974, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 15.44% (0.3317 => 0.3829, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 15.38% (0.3258 => 0.3759, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 15.34% (0.3469 => 0.4001, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.33% (0.3060 => 0.3529, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 15.32% (0.3643 => 0.4201, std.dev.: 0.0053) MultiSource/Benchmarks/Bullet/bullet: 15.24% (23.5202 => 27.1048, std.dev.: 0.0175) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.23% (0.1090 => 0.1256, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.20% (0.3362 => 0.3873, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/property: 15.12% (0.3650 => 0.4202, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.08% (0.3124 => 0.3595, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 14.90% (0.3724 => 0.4279, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.75% (0.3845 => 0.4412, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 14.73% (0.3348 => 0.3841, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/moments: 14.63% (0.3678 => 0.4216, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 14.58% (0.3477 => 0.3984, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.56% (0.3282 => 0.3760, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 14.47% (0.3726 => 0.4265, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 14.46% (0.2075 => 0.2375, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 14.42% (0.2566 => 0.2936, std.dev.: 0.0015) MultiSource/Applications/lua/lua: 14.31% (1.4269 => 1.6311, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.29% (0.3625 => 0.4143, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 14.28% (0.4146 => 0.4738, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.20% (0.3690 => 0.4214, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.19% (0.3981 => 0.4546, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 14.18% (0.4251 => 0.4854, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 13.97% (0.7875 => 0.8975, std.dev.: 0.0063) MultiSource/Applications/JM/ldecod/ldecod: 13.57% (2.1653 => 2.4591, std.dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 13.46% (2.1013 => 2.3841, std.dev.: 0.0063) MultiSource/Applications/JM/lencod/lencod: 13.39% (4.6177 => 5.2361, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/bigfib: 13.37% (0.5012 => 0.5682, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.04% (0.2040 => 0.2306, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 12.62% (5.5417 => 6.2412, std.dev.: 0.0069) MultiSource/Applications/SIBsim4/SIBsim4: 12.52% (0.2691 => 0.3028, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.09% (0.6435 => 0.7213, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 12.01% (0.3498 => 0.3918, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.38% (0.1028 => 0.1145, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.28% (0.1383 => 0.1539, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.27% (0.2068 => 0.2301, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 11.10% (0.4847 => 0.5385, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 11.03% (0.6634 => 0.7366, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.96% (0.2737 => 0.3037, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 10.52% (0.3336 => 0.3687, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.51% (0.3084 => 0.3408, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 10.07% (2.0346 => 2.2395, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.94% (0.2103 => 0.2312, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 9.87% (0.2391 => 0.2627, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.96% (4.6926 => 5.1130, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.84% (0.5361 => 0.5835, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.67% (11.6398 => 12.6484, std.dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.22% (0.5584 => 0.6043, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.90% (0.7426 => 0.8013, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 6.87% (11.9555 => 12.7763, std.dev.: 0.0121) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.01% (0.3792 => 0.4020, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-1: 22.66% (6.2401 => 7.6538, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 8.78% (0.2802 => 0.3048, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6106, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.05% (12.0509 => 12.6595, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary: 4.95% (0.2122 => 0.2227, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1663, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-2: 3.80% (1.8057 => 1.8743, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.49% (0.3693 => 0.3822, std.dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/dry: 2.70% (14.0481 => 14.4273, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1915, std.dev.: 0.0598) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.62% (3.1722 => 3.2235, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.49% (7.1849 => 7.2916, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3054, std.dev.: 0.0055) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.26% (1.0142 => 1.0270, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/five11/five11: 1.14% (8.4155 => 8.5116, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5886, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.18% (2.4764 => 2.4473, std.dev.: 0.0080) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.55% (25.4195 => 16.3820, std.dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/ary2: -8.20% (0.2402 => 0.2205, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9769, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7746, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/tsp/tsp: -7.18% (2.1113 => 1.9598, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.43% (11.2080 => 10.8237, std.dev.: 0.0464) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.23% (0.6293 => 0.6090, std.dev.: 0.0064) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7738, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5218, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.59% (17.2379 => 16.7919, std.dev.: 0.0391) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.24% (41.7953 => 40.8601, std.dev.: 0.0074) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5760, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4961, std.dev.: 0.0057) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.33% (5.7935 => 5.7162, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.22% (21.9346 => 21.6676, std.dev.: 0.0784) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.2065, std.dev.: 0.0874) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0429, std.dev.: 0.0033) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.05% (3.3991 => 3.3634, std.dev.: 0.0005) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 28 13:13:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 28 Oct 2012 15:13:36 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121028201336.DD4C02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5335?compare_to=5332&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5335, Order: 166900, Start Time: 2012-10-28 18:49:22, End Time: 2012-10-28 20:13:35 To: 5332, Order: 166899, Start Time: 2012-10-28 09:32:46, End Time: 2012-10-28 10:57:03 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 4 (114 on baseline) Performance Improvements: 4 (6 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 967 (854 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.44% (0.6128 => 0.6339, std.dev.: 0.0056) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.19% (0.8238 => 0.8501, std.dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.40% (6.4074 => 6.4972, std.dev.: 0.0161) MultiSource/Benchmarks/BitBench/five11/five11: 1.29% (5.5474 => 5.6191, std.dev.: 0.0278) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.58% (0.9073 => 0.8930, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.48% (0.9464 => 0.9324, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.46% (0.8712 => 0.8585, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/himenobmtxpa: -1.94% (4.4340 => 4.3478, std.dev.: 0.0167) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.64% (16.6898 => 16.5834, std.dev.: 0.0453) MultiSource/Applications/obsequi/Obsequi: 0.12% (1.0717 => 1.0730, std.dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: -0.03% (0.6514 => 0.6512, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/08-main/main: 1.11% (0.1900 => 0.1921, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.09% (0.1656 => 0.1638, std.dev.: 0.0046) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.03% (0.3259 => 0.3258, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.40% (0.2478 => 0.2468, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.74% (0.3361 => 0.3336, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.79% (0.2400 => 0.2357, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: 0.20% (0.6033 => 0.6045, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/mandel: -11.45% (0.0498 => 0.0441, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.75% (0.3307 => 0.3365, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/strcat: 1.45% (0.2000 => 0.2029, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -17.30% (0.0237 => 0.0196, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 14.29% (0.0182 => 0.0208, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.31% (0.0433 => 0.0410, std.dev.: 0.0059) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.93% (0.0322 => 0.0319, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 7.90% (0.0291 => 0.0314, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 21.55% (0.0348 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 20.00% (0.0170 => 0.0204, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/test1: 39.46% (0.0147 => 0.0205, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -21.19% (0.0335 => 0.0264, std.dev.: 0.0045) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -69.23% (0.0013 => 0.0004, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -0.28% (0.1450 => 0.1446, std.dev.: 0.0057) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.19% (1.1532 => 1.1554, std.dev.: 0.0014) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.62% (0.1449 => 0.1440, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.58% (0.4234 => 0.4040, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.67% (0.1376 => 0.1298, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.46% (0.0579 => 0.0628, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 13.64% (0.0220 => 0.0250, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.91% (0.0577 => 0.0566, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.46% (1.1431 => 1.1378, std.dev.: 0.0200) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.25% (0.0562 => 0.0569, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 46.33% (0.0177 => 0.0259, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.20% (0.8013 => 0.7997, std.dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -50.00% (0.0106 => 0.0053, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.20% (2.1832 => 1.6548, std.dev.: 0.0014) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 36.39% (14.7684 => 20.1420, std.dev.: 0.1106) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.16% (0.0810 => 0.0949, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/rem: 14.40% (0.1035 => 0.1184, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 13.40% (0.1112 => 0.1261, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.39% (0.8321 => 0.9019, std.dev.: 0.0057) MultiSource/Applications/SIBsim4/SIBsim4: 7.40% (1.2568 => 1.3498, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.33% (0.2279 => 0.2446, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.10% (0.1983 => 0.2104, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.06% (0.2180 => 0.2312, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.94% (0.1885 => 0.1997, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.92% (13.1811 => 13.9618, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.47% (0.6010 => 0.6339, std.dev.: 0.0056) MultiSource/Applications/hbd/hbd: 5.24% (1.4269 => 1.5017, std.dev.: 0.0102) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.14% (6.6074 => 6.9470, std.dev.: 0.0688) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.03% (0.2741 => 0.2879, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.87% (0.2998 => 0.3144, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.87% (0.6227 => 0.6530, std.dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 4.84% (1.1271 => 1.1817, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.70% (0.4847 => 0.5075, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.60% (0.7473 => 0.7817, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.39% (0.4559 => 0.4759, std.dev.: 0.0019) MultiSource/Applications/sgefa/sgefa: 4.33% (0.2999 => 0.3129, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.33% (0.8148 => 0.8501, std.dev.: 0.0071) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.32% (1.1606 => 1.2107, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.19% (1.6386 => 1.7073, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.15% (1.1170 => 1.1634, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.14% (0.8331 => 0.8676, std.dev.: 0.0069) MultiSource/Applications/spiff/spiff: 4.14% (0.7950 => 0.8279, std.dev.: 0.0051) MultiSource/Applications/d/make_dparser: 3.99% (3.2366 => 3.3656, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 3.95% (0.8069 => 0.8388, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.71% (0.8697 => 0.9020, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.71% (0.8518 => 0.8834, std.dev.: 0.0089) MultiSource/Applications/SPASS/SPASS: 3.67% (14.2605 => 14.7837, std.dev.: 0.0777) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.58% (0.8317 => 0.8615, std.dev.: 0.0031) MultiSource/Applications/minisat/minisat: 3.57% (0.6834 => 0.7078, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.56% (0.5191 => 0.5376, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 3.53% (0.8855 => 0.9168, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.43% (0.8007 => 0.8282, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.43% (0.8261 => 0.8544, std.dev.: 0.0040) MultiSource/Applications/Burg/burg: 3.41% (1.2222 => 1.2639, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 3.32% (0.9069 => 0.9370, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/18-imp/imp: 3.28% (0.3503 => 0.3618, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 3.23% (1.0945 => 1.1299, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.22% (0.8611 => 0.8888, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.16% (0.7966 => 0.8218, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.13% (0.8050 => 0.8302, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.13% (0.8597 => 0.8866, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.13% (0.4127 => 0.4256, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.01% (0.4783 => 0.4927, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.99% (0.8340 => 0.8589, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.96% (0.3717 => 0.3827, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.94% (1.4479 => 1.4905, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.92% (0.9688 => 0.9971, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 2.92% (6.7320 => 6.9284, std.dev.: 0.0280) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.90% (0.8204 => 0.8442, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.89% (1.1685 => 1.2023, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.84% (0.8066 => 0.8295, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.82% (0.8286 => 0.8520, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 2.82% (0.3800 => 0.3907, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.81% (0.7932 => 0.8155, std.dev.: 0.0062) MultiSource/Applications/treecc/treecc: 2.77% (1.9948 => 2.0501, std.dev.: 0.0196) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.77% (0.9039 => 0.9289, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.76% (0.9074 => 0.9324, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.75% (0.8316 => 0.8545, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.75% (0.8656 => 0.8894, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.75% (4.1763 => 4.2911, std.dev.: 0.0164) MultiSource/Applications/lua/lua: 2.74% (3.8189 => 3.9237, std.dev.: 0.0189) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.72% (8.6476 => 8.8829, std.dev.: 0.0563) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.71% (0.8805 => 0.9044, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.70% (0.8359 => 0.8585, std.dev.: 0.0039) MultiSource/Applications/JM/lencod/lencod: 2.70% (15.3280 => 15.7412, std.dev.: 0.0635) MultiSource/Benchmarks/Prolangs-C/football/football: 2.62% (0.8768 => 0.8998, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.62% (0.8177 => 0.8391, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 2.60% (8.6247 => 8.8491, std.dev.: 0.0363) SingleSource/Benchmarks/Shootout-C++/hash2: 2.59% (0.4125 => 0.4232, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 2.47% (0.9810 => 1.0052, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.46% (0.8716 => 0.8930, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.43% (0.8712 => 0.8924, std.dev.: 0.0027) SingleSource/UnitTests/Vector/constpool: 2.43% (8.4179 => 8.6224, std.dev.: 0.0381) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.42% (0.8885 => 0.9100, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.38% (0.9908 => 1.0144, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.35% (0.8048 => 0.8237, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.33% (1.2423 => 1.2713, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.31% (0.9056 => 0.9265, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.27% (1.3279 => 1.3581, std.dev.: 0.0045) MultiSource/Applications/siod/siod: 2.24% (2.2184 => 2.2681, std.dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: 2.21% (31.8598 => 32.5651, std.dev.: 0.0762) MultiSource/Applications/oggenc/oggenc: 2.19% (4.9628 => 5.0717, std.dev.: 0.0340) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.18% (0.8338 => 0.8520, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.18% (0.8086 => 0.8262, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.13% (0.6586 => 0.6726, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.12% (0.8457 => 0.8636, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.04% (0.8927 => 0.9109, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.02% (3.1832 => 3.2474, std.dev.: 0.0209) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.92% (0.6943 => 0.7076, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/gs/gs: 1.88% (4.1305 => 4.2081, std.dev.: 0.0249) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.82% (4.4880 => 4.5696, std.dev.: 0.0146) MultiSource/Applications/lambda-0_1_3/lambda: 1.76% (0.7557 => 0.7690, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.69% (4.5702 => 4.6475, std.dev.: 0.0256) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.68% (1.2526 => 1.2737, std.dev.: 0.0076) MultiSource/Benchmarks/PAQ8p/paq8p: 1.51% (2.3764 => 2.4122, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 59.20% (1.5795 => 2.5145, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.08% (0.3186 => 0.3507, std.dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.46% (2.4333 => 2.6636, std.dev.: 0.0128) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.79% (14.6451 => 15.9324, std.dev.: 0.3178) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.44% (1.1857 => 1.2858, std.dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 5.96% (63.1822 => 66.9493, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/distray/distray: 4.44% (0.2390 => 0.2496, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 2.61% (3.6643 => 3.7601, std.dev.: 0.0138) SingleSource/Benchmarks/Misc/ReedSolomon: 2.10% (8.5322 => 8.7110, std.dev.: 0.0431) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.88% (6.3772 => 6.4972, std.dev.: 0.0161) MultiSource/Benchmarks/Olden/bh/bh: 1.75% (2.3560 => 2.3972, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.32% (4.8362 => 4.9000, std.dev.: 0.0185) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.18% (1.4536 => 1.4708, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.97% (0.3269 => 0.3041, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -5.19% (29.8330 => 28.2856, std.dev.: 0.0247) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.12% (7.2130 => 6.9160, std.dev.: 0.0787) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.86% (1.2822 => 1.2583, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/hash2: -1.79% (3.4237 => 3.3625, std.dev.: 0.0236) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.28% (3.3479 => 3.3050, std.dev.: 0.0116) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.83% (16.4461 => 16.5834, std.dev.: 0.0453) MultiSource/Applications/obsequi/Obsequi: 4.56% (1.0262 => 1.0730, std.dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: 2.84% (0.6332 => 0.6512, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/08-main/main: 4.92% (0.1831 => 0.1921, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.07% (0.1559 => 0.1638, std.dev.: 0.0046) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.32% (0.3123 => 0.3258, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.20% (0.2463 => 0.2468, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.24% (0.3344 => 0.3336, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.30% (0.2364 => 0.2357, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: 0.58% (0.6010 => 0.6045, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/mandel: 2.80% (0.0429 => 0.0441, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.03% (0.3266 => 0.3365, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/strcat: 3.05% (0.1969 => 0.2029, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -12.50% (0.0224 => 0.0196, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 69.11% (0.0123 => 0.0208, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.49% (0.0408 => 0.0410, std.dev.: 0.0059) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 25.59% (0.0254 => 0.0319, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/test1: 13.89% (0.0180 => 0.0205, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: 14.78% (0.0230 => 0.0264, std.dev.: 0.0045) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -42.86% (0.0007 => 0.0004, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 0.56% (0.1438 => 0.1446, std.dev.: 0.0057) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.99% (1.1329 => 1.1554, std.dev.: 0.0014) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.50% (0.1462 => 0.1440, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.98% (0.4164 => 0.4040, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.19% (0.1369 => 0.1298, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.03% (0.0641 => 0.0628, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 28.21% (0.0195 => 0.0250, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.08% (0.0578 => 0.0566, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.52% (1.1437 => 1.1378, std.dev.: 0.0200) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.25% (0.0627 => 0.0569, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 43.89% (0.0180 => 0.0259, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.25% (0.8017 => 0.7997, std.dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -14.52% (0.0062 => 0.0053, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 28 13:21:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 28 Oct 2012 15:21:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121028202119.9C7072A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5336?compare_to=5331&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5336, Order: 166900, Start Time: 2012-10-28 18:55:51, End Time: 2012-10-28 20:21:14 To: 5331, Order: 166899, Start Time: 2012-10-28 08:25:52, End Time: 2012-10-28 09:51:16 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (177 on baseline) Unchanged Tests: 1041 (860 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.89% (78.0179 => 80.2719, std.dev.: 0.4169) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.44% (15.2527 => 18.3703, std.dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.29% (1.2783 => 1.3715, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.19% (2.0478 => 2.1132, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/salsa20: 2.50% (7.4937 => 7.6814, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/hash2: 2.16% (3.1932 => 3.2621, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.33% (0.1584 => 0.1452, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.32% (0.1431 => 0.1312, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.30% (0.3821 => 0.3542, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: -6.79% (0.3831 => 0.3571, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.73% (0.3880 => 0.3619, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.64% (0.3884 => 0.3626, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -6.63% (0.3848 => 0.3593, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -6.61% (0.3812 => 0.3560, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/synchronized: -6.60% (0.3896 => 0.3639, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.59% (0.2428 => 0.2268, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.58% (0.3891 => 0.3635, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.54% (0.4176 => 0.3903, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -6.54% (2.4924 => 2.3295, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.46% (0.3142 => 0.2939, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: -6.45% (0.4033 => 0.3773, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -6.36% (0.4199 => 0.3932, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.29% (0.3658 => 0.3428, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -6.21% (0.4280 => 0.4014, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.17% (22.4056 => 21.0224, std.dev.: 0.0139) MultiSource/Benchmarks/McCat/08-main/main: -6.09% (0.2659 => 0.2497, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.97% (4.5069 => 4.2380, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.92% (0.6484 => 0.6100, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.83% (0.1716 => 0.1616, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -5.75% (0.1879 => 0.1771, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.73% (0.2355 => 0.2220, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.71% (0.7919 => 0.7467, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: -5.70% (4.3330 => 4.0861, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: -5.68% (1.2515 => 1.1804, std.dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: -5.68% (7.0961 => 6.6931, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.65% (0.2548 => 0.2404, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.60% (0.9852 => 0.9300, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -5.60% (0.3357 => 0.3169, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.57% (5.4682 => 5.1634, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.56% (4.8161 => 4.5484, std.dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: -5.56% (16.1920 => 15.2923, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/oourafft: -5.56% (0.2160 => 0.2040, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.53% (3.5339 => 3.3383, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.48% (0.5999 => 0.5670, std.dev.: 0.0015) MultiSource/Applications/siod/siod: -5.48% (2.4021 => 2.2705, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.45% (0.3837 => 0.3628, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.40% (1.2221 => 1.1561, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.40% (0.4151 => 0.3927, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.38% (1.6474 => 1.5587, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.38% (1.0544 => 0.9977, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.37% (4.8802 => 4.6182, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.36% (1.2784 => 1.2099, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/strcat: -5.32% (0.2989 => 0.2830, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.31% (1.2210 => 1.1562, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: -5.29% (0.2985 => 0.2827, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.29% (0.6293 => 0.5960, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -5.29% (0.3025 => 0.2865, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -5.29% (34.0927 => 32.2898, std.dev.: 0.0217) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.27% (0.9542 => 0.9039, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.26% (0.3252 => 0.3081, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.26% (0.8521 => 0.8073, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.25% (4.0323 => 3.8208, std.dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: -5.24% (1.3148 => 1.2459, std.dev.: 0.0007) MultiSource/Applications/lua/lua: -5.20% (4.0594 => 3.8483, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.18% (0.3323 => 0.3151, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.14% (0.4083 => 0.3873, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: -5.14% (18.2933 => 17.3528, std.dev.: 0.0304) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.13% (2.1713 => 2.0600, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: -5.11% (0.3481 => 0.3303, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: -5.11% (0.6750 => 0.6405, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -5.11% (0.3621 => 0.3436, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.10% (0.2999 => 0.2846, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -5.07% (0.3394 => 0.3222, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.05% (0.2278 => 0.2163, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.04% (0.3057 => 0.2903, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -5.02% (0.3026 => 0.2874, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -5.02% (0.4861 => 0.4617, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.99% (0.2903 => 0.2758, std.dev.: 0.0030) SingleSource/Regression/C++/ofstream_ctor: -4.97% (0.3059 => 0.2907, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -4.97% (0.2939 => 0.2793, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -4.96% (0.7982 => 0.7586, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: -4.95% (0.3194 => 0.3036, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -4.95% (0.2871 => 0.2729, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -4.93% (0.3446 => 0.3276, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.91% (0.3016 => 0.2868, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.89% (0.7198 => 0.6846, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -4.88% (0.3255 => 0.3096, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -4.88% (0.2849 => 0.2710, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.87% (2.2587 => 2.1486, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -4.87% (1.6364 => 1.5567, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.87% (1.4642 => 1.3929, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: -4.87% (0.3205 => 0.3049, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.86% (0.4813 => 0.4579, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.86% (1.3722 => 1.3055, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: -4.85% (9.2283 => 8.7806, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists1: -4.84% (0.3867 => 0.3680, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: -4.80% (0.3788 => 0.3606, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.78% (0.3849 => 0.3665, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.77% (0.4321 => 0.4115, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.76% (0.3491 => 0.3325, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -4.69% (0.3581 => 0.3413, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -4.66% (0.4248 => 0.4050, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.66% (0.4916 => 0.4687, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.65% (0.4427 => 0.4221, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.58% (0.3319 => 0.3167, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.55% (0.3931 => 0.3752, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -4.55% (0.7779 => 0.7425, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: -4.53% (0.6441 => 0.6149, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -4.51% (0.6347 => 0.6061, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.49% (0.2385 => 0.2278, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.47% (0.9557 => 0.9130, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: -4.45% (0.4515 => 0.4314, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.40% (0.5591 => 0.5345, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.38% (0.5478 => 0.5238, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.36% (0.6676 => 0.6385, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.36% (0.6681 => 0.6390, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.29% (0.6230 => 0.5963, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.28% (0.5863 => 0.5612, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: -4.28% (0.3271 => 0.3131, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.27% (0.6297 => 0.6028, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.27% (0.5857 => 0.5607, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.24% (0.5802 => 0.5556, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: -4.24% (0.9179 => 0.8790, std.dev.: 0.0015) MultiSource/Benchmarks/sim/sim: -4.23% (0.3406 => 0.3262, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.22% (0.5805 => 0.5560, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.22% (0.6660 => 0.6379, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.21% (0.6667 => 0.6386, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.21% (0.5705 => 0.5465, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: -4.20% (0.7447 => 0.7134, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.19% (0.5581 => 0.5347, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.18% (0.6189 => 0.5930, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.18% (0.5456 => 0.5228, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.17% (0.5925 => 0.5678, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.16% (0.6440 => 0.6172, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.16% (0.2933 => 0.2811, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.16% (0.6395 => 0.6129, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.16% (0.7339 => 0.7034, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.15% (0.6194 => 0.5937, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -4.14% (1.1450 => 1.0976, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.13% (0.5859 => 0.5617, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.11% (0.5570 => 0.5341, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: -4.09% (15.5079 => 14.8732, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.09% (0.5941 => 0.5698, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.09% (0.5575 => 0.5347, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.09% (0.5849 => 0.5610, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.07% (0.6260 => 0.6005, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.06% (0.5569 => 0.5343, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.05% (0.6052 => 0.5807, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.04% (8.0126 => 7.6888, std.dev.: 0.0070) MultiSource/Applications/spiff/spiff: -4.03% (0.8418 => 0.8079, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.02% (0.6395 => 0.6138, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.01% (0.6033 => 0.5791, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.97% (0.7524 => 0.7225, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -3.97% (0.6304 => 0.6054, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: -3.96% (2.1401 => 2.0554, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -3.96% (0.4524 => 0.4345, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.92% (0.6446 => 0.6193, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -3.89% (0.5688 => 0.5467, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.89% (6.7716 => 6.5085, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -3.86% (0.5567 => 0.5352, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.79% (0.6736 => 0.6481, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.76% (0.7021 => 0.6757, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -3.74% (17.1032 => 16.4639, std.dev.: 0.0094) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.72% (0.9077 => 0.8739, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.67% (0.3483 => 0.3355, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.58% (1.2300 => 1.1860, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: -3.57% (3.5154 => 3.3900, std.dev.: 0.0068) MultiSource/Applications/oggenc/oggenc: -3.55% (5.0226 => 4.8442, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.50% (0.5168 => 0.4987, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: -3.41% (1.5610 => 1.5077, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.34% (0.5329 => 0.5151, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: -3.17% (1.1530 => 1.1164, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.11% (14.2083 => 13.7662, std.dev.: 0.0101) SingleSource/UnitTests/Vector/constpool: -2.18% (20.7746 => 20.3217, std.dev.: 0.0188) MultiSource/Applications/SIBsim4/SIBsim4: -1.62% (1.3864 => 1.3639, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7538, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1729, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.53% (2.2633 => 2.1835, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.52% (6.5735 => 6.4734, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0002) Report Time: 3.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 28 13:33:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 28 Oct 2012 15:33:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121028203335.9B2102A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5337?compare_to=5333&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5337, Order: 166900, Start Time: 2012-10-28 19:02:13, End Time: 2012-10-28 20:33:33 To: 5333, Order: 166899, Start Time: 2012-10-28 09:54:09, End Time: 2012-10-28 11:25:29 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (10 on baseline) New Passes: 0 (14 on baseline) Performance Regressions: 1 (189 on baseline) Performance Improvements: 0 (54 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 15 (5 on baseline) Unchanged Tests: 1026 (636 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.13% (1.0903 => 1.1026, std.dev.: 0.0008) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -0.70% (2.0557 => 2.0413, std.dev.: 0.0133) MultiSource/Benchmarks/Bullet/bullet: 0.02% (58.0449 => 58.0558, std.dev.: 0.0312) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0799 => 0.0799, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 0.07% (9.2409 => 9.2470, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.23% (7.8080 => 7.8263, std.dev.: 0.0059) SingleSource/UnitTests/Vector/SSE/sse_shift: -0.19% (0.0516 => 0.0515, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/JM/lencod/lencod: 0.02% (7.7289 => 7.7301, std.dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: - (0.0001 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0648 => 0.0649, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.07% (0.2992 => 0.2990, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_shift: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -64.56% (5.7591 => 2.0413, std.dev.: 0.0133) MultiSource/Benchmarks/Bullet/bullet: -8.20% (63.2438 => 58.0558, std.dev.: 0.0312) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.81% (6.6874 => 0.0799, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.65% (8.1363 => 9.2470, std.dev.: 0.0018) SingleSource/UnitTests/Vector/SSE/sse_shift: 36.24% (0.0378 => 0.0515, std.dev.: 0.0001) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -50.00% (0.0002 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -57.05% (0.6962 => 0.2990, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_shift: -50.00% (0.0002 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 213.20% (0.5229 => 1.6377, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 18.22% (14.9895 => 17.7204, std.dev.: 0.0060) MultiSource/Applications/kimwitu++/kc: 38.16% (14.1553 => 19.5572, std.dev.: 0.0190) MultiSource/Benchmarks/MallocBench/gs/gs: 14.40% (4.1105 => 4.7024, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 33.29% (1.1048 => 1.4726, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 69.54% (3.4629 => 5.8710, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 68.98% (0.6222 => 1.0514, std.dev.: 0.0150) New Passes - Execution Time --------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 3835900.00% (0.0001 => 3.8360, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 11129600.00% (0.0001 => 11.1297, std.dev.: 0.0478) MultiSource/Applications/kimwitu++/kc: 50700.00% (0.0001 => 0.0508, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050100.00% (0.0001 => 10.0502, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5488700.00% (0.0001 => 5.4888, std.dev.: 0.0168) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 78.04% (0.0296 => 0.0527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 69.92% (0.0256 => 0.0435, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 61.25% (0.0271 => 0.0437, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 53.09% (0.0243 => 0.0372) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 44.43% (1.5859 => 2.2905, std.dev.: 0.0138) SingleSource/Regression/C/sumarray: 43.72% (0.0231 => 0.0332, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.49% (0.0834 => 0.1180, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: 40.91% (0.1056 => 0.1488, std.dev.: 0.0002) SingleSource/UnitTests/vla: 36.34% (0.0355 => 0.0484, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 35.56% (2.2024 => 2.9856, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: 34.24% (0.1463 => 0.1964, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 29.54% (0.1432 => 0.1855, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 28.76% (0.1655 => 0.2131, std.dev.: 0.0009) MultiSource/Benchmarks/llubenchmark/llu: 24.46% (0.0462 => 0.0575) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.22% (0.1566 => 0.1914, std.dev.: 0.0024) SingleSource/UnitTests/SignlessTypes/rem: 22.20% (0.1144 => 0.1398) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.63% (0.5105 => 0.6209, std.dev.: 0.0014) MultiSource/Applications/viterbi/viterbi: 21.54% (0.1555 => 0.1890, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.01% (0.0871 => 0.1054, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 19.78% (0.6675 => 0.7995, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 19.37% (1.3050 => 1.5578, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 19.25% (3.3354 => 3.9776, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.11% (0.2271 => 0.2705, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 18.90% (0.0746 => 0.0887, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.88% (0.5020 => 0.5968, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/almabench: 18.77% (0.0730 => 0.0867, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 18.60% (0.2554 => 0.3029, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 18.55% (0.7115 => 0.8435, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 18.47% (0.1175 => 0.1392, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: 18.21% (0.0626 => 0.0740, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 18.20% (0.1236 => 0.1461, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.15% (0.1510 => 0.1784, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 18.13% (1.1840 => 1.3986, std.dev.: 0.0033) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 18.12% (0.1584 => 0.1871, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.05% (1.5415 => 1.8198, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.93% (0.1032 => 0.1217, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 17.88% (0.1695 => 0.1998, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.65% (0.0793 => 0.0933, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.62% (0.4615 => 0.5428, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 17.45% (0.1163 => 0.1366, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.43% (0.1337 => 0.1570, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 17.40% (0.4879 => 0.5728) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.40% (0.8172 => 0.9594, std.dev.: 0.0036) MultiSource/Applications/sgefa/sgefa: 17.18% (0.3109 => 0.3643, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 17.15% (0.3177 => 0.3722, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.13% (0.6450 => 0.7555, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.99% (0.2107 => 0.2465, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 16.94% (0.1151 => 0.1346, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 16.90% (0.2603 => 0.3043, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 16.86% (0.1940 => 0.2267, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.74% (0.0675 => 0.0788, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 16.59% (22.1758 => 25.8547, std.dev.: 0.0299) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.48% (0.0886 => 0.1032, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.34% (0.3121 => 0.3631, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/exptree: 16.34% (0.0814 => 0.0947, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 16.19% (1.0722 => 1.2458, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 16.05% (0.1906 => 0.2212, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 16.02% (1.1642 => 1.3507, std.dev.: 0.0084) MultiSource/Applications/treecc/treecc: 15.96% (2.0273 => 2.3509, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 15.92% (0.0672 => 0.0779) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.91% (0.0842 => 0.0976, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.86% (0.9765 => 1.1314, std.dev.: 0.0024) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.84% (0.1143 => 0.1324, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 15.75% (0.1695 => 0.1962, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 15.69% (0.8921 => 1.0321, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: 15.69% (0.7835 => 0.9064, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.48% (0.2758 => 0.3185, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/voronoi/voronoi: 15.44% (0.2700 => 0.3117, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.40% (0.1117 => 0.1289, std.dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 15.20% (0.1125 => 0.1296, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.19% (1.1861 => 1.3663, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 15.17% (1.4186 => 1.6338, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 15.07% (0.5860 => 0.6743, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.06% (0.0770 => 0.0886, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 15.02% (0.3423 => 0.3937, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.95% (0.1625 => 0.1868, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.90% (0.0933 => 0.1072, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.89% (0.0759 => 0.0872, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 14.77% (0.7433 => 0.8531, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.74% (4.2646 => 4.8934, std.dev.: 0.0039) MultiSource/Applications/lua/lua: 14.70% (3.8723 => 4.4415, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.66% (0.5981 => 0.6858, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.66% (0.0730 => 0.0837, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 14.61% (0.4299 => 0.4927, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.60% (0.1062 => 0.1217, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.59% (0.1330 => 0.1524, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/lpbench: 14.53% (0.0929 => 0.1064, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.29% (0.0798 => 0.0912, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.29% (0.2065 => 0.2360, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.19% (0.1029 => 0.1175, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 14.14% (0.3387 => 0.3866, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.00% (0.3307 => 0.3770, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.65% (0.5569 => 0.6329, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.64% (0.0770 => 0.0875, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 13.59% (9.4845 => 10.7733, std.dev.: 0.0178) MultiSource/Benchmarks/Olden/health/health: 13.33% (0.1268 => 0.1437, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.25% (0.3441 => 0.3897, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 13.16% (0.3092 => 0.3499, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.01% (0.0838 => 0.0947, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.94% (0.3826 => 0.4321, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 12.80% (0.3180 => 0.3587, std.dev.: 0.0036) MultiSource/Applications/siod/siod: 12.30% (2.2969 => 2.5794, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 12.07% (0.0953 => 0.1068, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.89% (0.1892 => 0.2117, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.88% (0.8101 => 0.9063, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.69% (14.3668 => 16.0463, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.48% (4.9449 => 5.5127, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.46% (5.0018 => 5.5748, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/bigfib: 11.40% (0.6456 => 0.7192, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 11.40% (0.1044 => 0.1163, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 11.29% (17.1811 => 19.1204, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/hash2: 11.06% (0.4620 => 0.5131, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.03% (0.3427 => 0.3805, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 11.00% (0.4289 => 0.4761, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.69% (2.2022 => 2.4376, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.47% (0.3927 => 0.4338, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.31% (0.4636 => 0.5114, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 10.14% (0.3828 => 0.4216, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.05% (0.3473 => 0.3822, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 10.02% (0.3422 => 0.3765, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions-4: 9.94% (0.3543 => 0.3895, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.94% (0.3543 => 0.3895, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.88% (0.3694 => 0.4059, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.87% (0.3497 => 0.3842, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.86% (0.3561 => 0.3912, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.81% (0.3865 => 0.4244, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.80% (0.4203 => 0.4615, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 9.76% (0.3516 => 0.3859, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 9.73% (0.3886 => 0.4264, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 9.71% (1.5603 => 1.7118, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.62% (0.2266 => 0.2484, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.51% (3.8922 => 4.2623, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/lists1: 9.50% (0.3684 => 0.4034, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 9.41% (0.4048 => 0.4429, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.41% (0.4103 => 0.4489, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.26% (0.2430 => 0.2655, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 8.52% (0.3603 => 0.3910, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.44% (0.4064 => 0.4407, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: 7.86% (0.6030 => 0.6504, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.84% (0.3650 => 0.3936, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.83% (0.5925 => 0.6389, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.73% (0.7326 => 0.7892, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 7.71% (0.3282 => 0.3535, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 7.68% (0.3098 => 0.3336, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 7.52% (0.3232 => 0.3475, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.46% (0.3283 => 0.3528, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.43% (0.8067 => 0.8666, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.41% (0.2793 => 0.3000, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 7.38% (0.2831 => 0.3040, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.18% (0.3162 => 0.3389, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.09% (0.2905 => 0.3111, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.09% (0.2891 => 0.3096, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 6.88% (1.2842 => 1.3725, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/except: 6.83% (0.2871 => 0.3067, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.82% (2.0665 => 2.2075, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.75% (0.2872 => 0.3066, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.74% (0.2714 => 0.2897, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.72% (0.2725 => 0.2908, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 6.67% (0.2877 => 0.3069, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 6.60% (0.3379 => 0.3602, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.59% (0.3052 => 0.3253, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.53% (0.2756 => 0.2936, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/random: 6.32% (0.2802 => 0.2979, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 6.05% (0.2049 => 0.2173, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.39% (7.9617 => 8.3912, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.39% (0.3136 => 0.3305, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.08% (0.3131 => 0.3290, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.74% (0.3935 => 0.4082, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.82% (7.0540 => 7.2531, std.dev.: 0.0086) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.11% (1.1145 => 1.3721, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 10.66% (0.9957 => 1.1018, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/richards_benchmark: 10.00% (1.1396 => 1.2536, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.95% (2.8904 => 3.0914, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.1578 => 3.3686, std.dev.: 0.0005) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: 4.50% (3.3453 => 3.4960, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 2.97% (1.9405 => 1.9981, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.70% (4.2280 => 4.3421, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 2.41% (4.4649 => 4.5723, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/bisort/bisort: 1.82% (0.8333 => 0.8485, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2075, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.34% (9.1159 => 9.2378, std.dev.: 0.0134) MultiSource/Benchmarks/nbench/nbench: 1.31% (11.6436 => 11.7956, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -76.70% (0.8651 => 0.2016, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.15% (5.3855 => 2.4152, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -54.88% (5.3526 => 2.4153, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/richards_benchmark: -44.76% (0.1622 => 0.0896, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.29% (1.1194 => 0.6796, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.04% (5.2763 => 3.2163, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -23.27% (1.7609 => 1.3511, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -17.27% (2.9384 => 2.4309, std.dev.: 0.0027) SingleSource/UnitTests/Vector/constpool: -8.99% (54.1659 => 49.2983, std.dev.: 0.0285) MultiSource/Applications/JM/ldecod/ldecod: -7.70% (10.4361 => 9.6321, std.dev.: 0.0110) MultiSource/Benchmarks/PAQ8p/paq8p: -5.03% (10.3673 => 9.8455, std.dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -54.02% (8.0499 => 3.7010, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0133, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.51% (1.1492 => 0.7641, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.61% (0.0506 => 0.0341) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.38% (0.3987 => 0.2696, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.51% (2.9695 => 2.3604, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.99% (1.2258 => 0.9930, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.88% (1.6925 => 1.4237, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -11.00% (9.5636 => 8.5119, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/mandel-2: -10.89% (1.5373 => 1.3699, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/chomp: -10.89% (1.2373 => 1.1026, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.34% (19.9488 => 18.2850, std.dev.: 0.0145) MultiSource/Benchmarks/FreeBench/mason/mason: -8.01% (0.2161 => 0.1988, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.94% (1.8329 => 1.7057, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -5.45% (6.6465 => 6.2844, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.06% (1.6805 => 1.5954, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.89% (0.2497 => 0.2375, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5091, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.87% (8.1563 => 7.8403, std.dev.: 0.0075) MultiSource/Applications/siod/siod: -3.80% (3.2827 => 3.1578, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.57% (32.5116 => 31.3522, std.dev.: 0.0104) MultiSource/Benchmarks/sim/sim: -3.33% (5.0483 => 4.8802, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: -2.92% (4.6441 => 4.5083, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.79% (4.5009 => 4.3751, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.66% (0.4808 => 0.4680, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/multiplies: -1.99% (2.5528 => 2.5020, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -1.84% (10.2830 => 10.0940, std.dev.: 0.0184) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6807, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -1.28% (85.0658 => 83.9803, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.17% (1.7254 => 1.7052, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.04% (6.2999 => 6.2341, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/power/power: -1.01% (1.1277 => 1.1163, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.33% (7.1582 => 7.8263, std.dev.: 0.0059) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: 10636.25% (0.0720 => 7.7301, std.dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 1.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 28 15:37:15 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 28 Oct 2012 17:37:15 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121028223715.463902A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5338?compare_to=5334&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5338, Order: 166900, Start Time: 2012-10-28 19:20:49, End Time: 2012-10-28 22:37:13 To: 5334, Order: 166899, Start Time: 2012-10-28 09:25:31, End Time: 2012-10-28 12:41:13 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (171 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1039 (718 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.07% (1.9750 => 1.9962, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/perimeter/perimeter: 1.95% (0.6090 => 0.6209, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.01% (54.2809 => 54.8301, std.dev.: 0.0271) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 44.16% (0.0625 => 0.0901, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.46% (0.1063 => 0.1408, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.70% (0.2969 => 0.3732, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.41% (0.1106 => 0.1387, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 25.30% (1.5932 => 1.9962, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.14% (0.4139 => 0.5138, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.72% (0.4253 => 0.5262, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.43% (0.4994 => 0.6164, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.40% (0.0547 => 0.0675, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.00% (0.5900 => 0.7257, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.95% (0.0475 => 0.0584) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.90% (0.5000 => 0.6145, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.60% (0.0584 => 0.0716, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.13% (0.0714 => 0.0872) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.67% (0.1620 => 0.1971, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.63% (0.0897 => 0.1091, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 21.54% (0.0599 => 0.0728, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.45% (0.1021 => 0.1240, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.32% (0.1107 => 0.1343, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 20.68% (0.0948 => 0.1144, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.54% (0.0633 => 0.0763, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.38% (0.0584 => 0.0703, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.33% (0.0541 => 0.0651, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.09% (0.0642 => 0.0771, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.04% (0.1103 => 0.1324, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.96% (0.3903 => 0.4682, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 19.87% (0.0604 => 0.0724, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 19.85% (0.0821 => 0.0984, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.84% (0.1003 => 0.1202, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 19.83% (0.1619 => 0.1940, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.76% (0.1604 => 0.1921, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.69% (0.1549 => 0.1854, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.46% (0.0822 => 0.0982, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.77% (0.3890 => 0.4620, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.74% (0.1462 => 0.1736, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 18.69% (0.0947 => 0.1124, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 18.44% (0.0808 => 0.0957, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.35% (0.2736 => 0.3238, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 18.31% (0.1218 => 0.1441) SingleSource/UnitTests/ObjC++/Hello: 18.23% (0.5826 => 0.6888, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.12% (0.2014 => 0.2379, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.97% (1.3152 => 1.5515, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference-object: 17.97% (0.5889 => 0.6947, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 17.70% (0.4029 => 0.4742, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.65% (0.1088 => 0.1280, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 17.54% (0.1505 => 0.1769, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 17.48% (0.0698 => 0.0820, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 17.15% (0.5546 => 0.6497, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.13% (0.2866 => 0.3357, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.11% (3.5627 => 4.1721, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/gs/gs: 17.02% (1.8794 => 2.1993, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 16.86% (0.0605 => 0.0707, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.83% (0.4658 => 0.5442, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.82% (1.6211 => 1.8938, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.82% (0.1968 => 0.2299, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.77% (0.2875 => 0.3357, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.49% (0.5026 => 0.5855, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.47% (0.1160 => 0.1351, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 16.44% (0.2725 => 0.3173, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 16.43% (0.9697 => 1.1290, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference: 16.36% (0.7171 => 0.8344, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.36% (0.3271 => 0.3806, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 16.26% (0.1421 => 0.1652, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.14% (0.2738 => 0.3180, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 16.10% (1.0781 => 1.2517, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: 16.03% (0.2714 => 0.3149, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.94% (0.2729 => 0.3164, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.94% (0.4361 => 0.5056, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 15.89% (0.2750 => 0.3187, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 15.87% (0.9909 => 1.1482, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 15.85% (0.3004 => 0.3480, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.83% (4.4195 => 5.1191, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/matrix: 15.76% (0.2780 => 0.3218, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 15.75% (0.2813 => 0.3256, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 15.73% (0.1284 => 0.1486, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.69% (0.2792 => 0.3230, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.69% (2.7292 => 3.1573, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wc: 15.67% (0.3096 => 0.3581, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 15.66% (0.2823 => 0.3265, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 15.63% (0.2803 => 0.3241, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.62% (0.3930 => 0.4544, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 15.62% (0.2811 => 0.3250, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.60% (0.2911 => 0.3365, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 15.58% (4.2109 => 4.8670, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.52% (0.3195 => 0.3691, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.51% (2.0673 => 2.3880, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-3: 15.38% (0.3460 => 0.3992, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.30% (1.9694 => 2.2708, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.16% (1.9966 => 2.2992, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions-2: 15.15% (0.3446 => 0.3968, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 15.13% (0.3496 => 0.4025, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 15.12% (0.3465 => 0.3989, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 15.12% (0.3267 => 0.3761, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: 15.08% (23.5202 => 27.0680, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/trivial-interface: 15.08% (0.3442 => 0.3961, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 15.05% (0.3469 => 0.3991, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.99% (0.3488 => 0.4011, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.95% (0.1090 => 0.1253, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 14.95% (0.3258 => 0.3745, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.87% (0.3362 => 0.3862, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.77% (0.3060 => 0.3512, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 14.74% (0.3317 => 0.3806, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 14.71% (0.3650 => 0.4187, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 14.55% (0.2075 => 0.2377, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 14.55% (0.3643 => 0.4173, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.50% (0.3124 => 0.3577, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 14.47% (0.3724 => 0.4263, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 14.38% (0.2566 => 0.2935, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.33% (0.3845 => 0.4396, std.dev.: 0.0040) MultiSource/Applications/lua/lua: 14.21% (1.4269 => 1.6296, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/lists: 14.19% (0.3348 => 0.3823, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 14.17% (0.3678 => 0.4199, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.11% (0.3282 => 0.3745, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 14.09% (0.3726 => 0.4251, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 14.06% (0.3477 => 0.3966, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.93% (0.3625 => 0.4130, std.dev.: 0.0018) MultiSource/Applications/treecc/treecc: 13.89% (0.7875 => 0.8969, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.88% (0.3690 => 0.4202, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: 13.74% (0.4251 => 0.4835, std.dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 13.68% (2.1653 => 2.4616, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.66% (0.3981 => 0.4525, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 13.65% (0.4146 => 0.4712, std.dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: 13.53% (4.6177 => 5.2423, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 13.07% (0.5012 => 0.5667, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 13.03% (2.1013 => 2.3751, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.89% (0.2040 => 0.2303, std.dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 12.45% (0.2691 => 0.3026, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 12.19% (5.5417 => 6.2173, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.78% (0.6435 => 0.7193, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 11.38% (0.3498 => 0.3896, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.35% (0.1383 => 0.1540, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.28% (0.1028 => 0.1144, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 11.02% (0.6634 => 0.7365, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.98% (0.2068 => 0.2295, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.71% (0.2737 => 0.3030, std.dev.: 0.0038) MultiSource/Benchmarks/PAQ8p/paq8p: 10.69% (0.4847 => 0.5365, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.34% (0.3084 => 0.3403, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 10.22% (0.3336 => 0.3677, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 10.00% (2.0346 => 2.2380, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.75% (0.2103 => 0.2308, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 9.70% (0.2391 => 0.2623, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.76% (4.6926 => 5.1037, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.56% (0.5361 => 0.5820, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.52% (11.6398 => 12.6315, std.dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.97% (0.5584 => 0.6029, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.76% (0.7426 => 0.8002, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 6.59% (11.9555 => 12.7436, std.dev.: 0.0124) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.59% (0.3792 => 0.4004, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.32% (0.2162 => 0.3531, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6534, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.59% (2.5769 => 3.0301, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 8.60% (0.2802 => 0.3043, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6102, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.02% (12.0509 => 12.6563, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary: 4.85% (0.2122 => 0.2225, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 4.75% (15.4430 => 16.1766, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-2: 4.16% (1.8057 => 1.8808, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.87% (0.3693 => 0.3836, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/dry: 2.68% (14.0481 => 14.4243, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1944, std.dev.: 0.0519) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.85% (3.1722 => 3.2308, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2896, std.dev.: 0.0016) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3029, std.dev.: 0.0035) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.25% (1.0142 => 1.0269, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5137, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.08% (1.2451 => 1.2585, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5926, std.dev.: 0.0314) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.32% (2.4764 => 2.4438, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.49% (25.4195 => 16.3972, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ary2: -8.62% (0.2402 => 0.2195, std.dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9780, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: -7.67% (35.5013 => 32.7766, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/tsp/tsp: -7.19% (2.1113 => 1.9595, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2421) SingleSource/UnitTests/Vector/build2: -3.48% (11.2080 => 10.8177, std.dev.: 0.0331) MultiSource/Applications/siod/siod: -2.98% (6.9842 => 6.7758, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5218, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.64% (17.2379 => 16.7824, std.dev.: 0.0413) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.20% (41.7953 => 40.8772, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5744, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/bh/bh: -1.51% (5.5810 => 5.4968, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.33% (5.7935 => 5.7167, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.18% (21.9346 => 21.6755, std.dev.: 0.0984) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.2020, std.dev.: 0.0465) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.08% (3.3991 => 3.3625, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0435, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 28 16:26:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 28 Oct 2012 18:26:54 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121028232654.6851C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5339?compare_to=5335&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5339, Order: 166902, Start Time: 2012-10-28 22:01:56, End Time: 2012-10-28 23:26:53 To: 5335, Order: 166900, Start Time: 2012-10-28 18:49:22, End Time: 2012-10-28 20:13:35 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 11 (92 on baseline) Performance Improvements: 1 (6 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 963 (876 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: 10.37% (0.1022 => 0.1128, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.06% (0.2093 => 0.2199, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.41% (0.3336 => 0.3483, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.84% (0.6034 => 0.6266, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.46% (0.5075 => 0.5200, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.03% (1.2809 => 1.3069, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.76% (1.2023 => 1.2235, std.dev.: 0.0061) SingleSource/UnitTests/Vector/constpool: 1.70% (8.6224 => 8.7693, std.dev.: 0.0550) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.51% (1.1634 => 1.1810, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.27% (4.5617 => 4.6197, std.dev.: 0.0126) MultiSource/Benchmarks/MallocBench/gs/gs: 1.23% (4.2081 => 4.2599, std.dev.: 0.0088) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/SPASS/SPASS: -3.68% (8.4038 => 8.0947, std.dev.: 0.1060) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.01% (16.5834 => 16.5819, std.dev.: 0.0086) MultiSource/Applications/obsequi/Obsequi: 0.12% (1.0730 => 1.0743, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: -0.38% (0.6512 => 0.6487, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: 0.99% (0.1921 => 0.1940, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.79% (0.1638 => 0.1651, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.01% (0.3258 => 0.3225, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.2468 => 0.2468, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.84% (0.3336 => 0.3364, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.33% (0.2357 => 0.2412, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: -0.69% (0.6045 => 0.6003, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/mandel: 11.79% (0.0441 => 0.0493, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: -1.63% (0.3365 => 0.3310, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/strcat: -1.08% (0.2029 => 0.2007, std.dev.: 0.0026) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 36.73% (0.0196 => 0.0268, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -2.88% (0.0208 => 0.0202, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.17% (0.0410 => 0.0423, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -8.78% (0.0319 => 0.0291, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.96% (0.0314 => 0.0311, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -18.44% (0.0423 => 0.0345, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0204 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -8.29% (0.0205 => 0.0188, std.dev.: 0.0015) SingleSource/UnitTests/byval-alignment: 35.23% (0.0264 => 0.0357, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 225.00% (0.0004 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 0.35% (0.1446 => 0.1451, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -4.73% (1.1554 => 1.1008, std.dev.: 0.0155) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.54% (0.1440 => 0.1491, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.17% (0.4040 => 0.4047, std.dev.: 0.0287) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.39% (0.1298 => 0.1303, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.55% (0.0628 => 0.0612, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.40% (0.0250 => 0.0239, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.30% (0.0566 => 0.0553, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.50% (1.1378 => 1.1435, std.dev.: 0.0281) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 600.00% (0.0001 => 0.0007, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2500.00% (0.0001 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.56% (0.0569 => 0.0612, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.04% (0.0259 => 0.0233, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.14% (0.7997 => 0.7986, std.dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: -100.00% (0.0001 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0008 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 132.08% (0.0053 => 0.0123, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.21% (2.1832 => 1.6546, std.dev.: 0.0048) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 36.20% (14.7684 => 20.1144, std.dev.: 0.0185) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.79% (0.0810 => 0.0946, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.49% (0.0773 => 0.0885, std.dev.: 0.0005) SingleSource/UnitTests/SignlessTypes/rem: 14.11% (0.1035 => 0.1181, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.10% (0.0830 => 0.0947, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 13.40% (0.1112 => 0.1261, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.11% (0.1137 => 0.1252, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.58% (0.2180 => 0.2367, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.33% (0.8321 => 0.9014, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.25% (0.2279 => 0.2467, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.00% (0.1425 => 0.1539, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.62% (0.6010 => 0.6468, std.dev.: 0.0056) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.62% (0.3137 => 0.3376, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.28% (0.4847 => 0.5200, std.dev.: 0.0045) MultiSource/Applications/SIBsim4/SIBsim4: 7.27% (1.2568 => 1.3482, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 6.66% (0.1577 => 0.1682, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.33% (13.1811 => 14.0159, std.dev.: 0.0338) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.99% (0.7473 => 0.7921, std.dev.: 0.0107) MultiSource/Applications/spiff/spiff: 5.82% (0.7950 => 0.8413, std.dev.: 0.0119) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.73% (1.1170 => 1.1810, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.71% (0.3295 => 0.3483, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.65% (0.1983 => 0.2095, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.62% (0.2240 => 0.2366, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.47% (0.2741 => 0.2891, std.dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 5.38% (1.1271 => 1.1877, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.24% (0.2998 => 0.3155, std.dev.: 0.0017) MultiSource/Applications/Burg/burg: 5.15% (1.2222 => 1.2851, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.12% (0.5961 => 0.6266, std.dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.07% (6.6074 => 6.9426, std.dev.: 0.0305) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.72% (1.6386 => 1.7160, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.71% (1.1685 => 1.2235, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.53% (0.8148 => 0.8517, std.dev.: 0.0128) MultiSource/Applications/hbd/hbd: 4.49% (1.4269 => 1.4910, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 4.48% (0.8007 => 0.8366, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.44% (0.9435 => 0.9854, std.dev.: 0.0071) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.37% (1.1606 => 1.2113, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.36% (1.3279 => 1.3858, std.dev.: 0.0120) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.35% (0.4783 => 0.4991, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.34% (0.6227 => 0.6497, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.28% (0.4559 => 0.4754, std.dev.: 0.0067) SingleSource/UnitTests/Vector/constpool: 4.17% (8.4179 => 8.7693, std.dev.: 0.0550) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.09% (0.4127 => 0.4296, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.95% (0.8261 => 0.8587, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 3.94% (0.8855 => 0.9204, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.94% (0.5817 => 0.6046, std.dev.: 0.0078) MultiSource/Applications/d/make_dparser: 3.91% (3.2366 => 3.3633, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.87% (8.6476 => 8.9825, std.dev.: 0.0461) MultiSource/Applications/treecc/treecc: 3.86% (1.9948 => 2.0717, std.dev.: 0.0252) MultiSource/Applications/sgefa/sgefa: 3.83% (0.2999 => 0.3114, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 3.73% (14.2605 => 14.7919, std.dev.: 0.0786) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.71% (1.2602 => 1.3069, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/football/football: 3.66% (0.8768 => 0.9089, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.64% (4.1763 => 4.3282, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.52% (0.3717 => 0.3848, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.41% (0.5191 => 0.5368, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.26% (0.8048 => 0.8310, std.dev.: 0.0065) MultiSource/Benchmarks/McCat/18-imp/imp: 3.25% (0.3503 => 0.3617, std.dev.: 0.0023) MultiSource/Applications/minisat/minisat: 3.20% (0.6834 => 0.7053, std.dev.: 0.0023) MultiSource/Applications/lua/lua: 3.20% (3.8189 => 3.9412, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/gs/gs: 3.13% (4.1305 => 4.2599, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/hash2: 3.10% (0.4125 => 0.4253, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 2.97% (1.0945 => 1.1270, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.95% (4.4873 => 4.6197, std.dev.: 0.0126) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.66% (1.2526 => 1.2859, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.43% (0.8597 => 0.8806, std.dev.: 0.0078) MultiSource/Applications/JM/ldecod/ldecod: 2.40% (6.7320 => 6.8937, std.dev.: 0.0397) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.37% (0.8340 => 0.8538, std.dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: 2.34% (15.3280 => 15.6865, std.dev.: 0.0248) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.29% (0.8086 => 0.8271, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.20% (3.1832 => 3.2532, std.dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 2.18% (8.6247 => 8.8126, std.dev.: 0.0593) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.18% (0.9056 => 0.9253, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.16% (4.5702 => 4.6690, std.dev.: 0.0282) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.05% (0.8927 => 0.9110, std.dev.: 0.0070) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.80% (4.4880 => 4.5686, std.dev.: 0.0166) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.77% (1.2423 => 1.2643, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.73% (2.1401 => 2.1771, std.dev.: 0.0053) MultiSource/Applications/oggenc/oggenc: 1.68% (4.9628 => 5.0462, std.dev.: 0.0310) MultiSource/Applications/hexxagon/hexxagon: 1.51% (0.9810 => 0.9958, std.dev.: 0.0057) MultiSource/Benchmarks/Bullet/bullet: 1.48% (31.8598 => 32.3325, std.dev.: 0.0469) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.43% (0.8995 => 0.9124, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.72% (1.5795 => 2.5070, std.dev.: 0.0042) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.02% (2.4333 => 2.6770, std.dev.: 0.0168) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.39% (1.1857 => 1.2852, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.43% (0.3186 => 0.3391, std.dev.: 0.0066) MultiSource/Benchmarks/mafft/pairlocalalign: 5.91% (63.1822 => 66.9159, std.dev.: 0.1026) SingleSource/Benchmarks/Misc/ReedSolomon: 3.02% (8.5322 => 8.7899, std.dev.: 0.0058) MultiSource/Applications/siod/siod: 2.88% (3.6643 => 3.7697, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash: 1.82% (0.6205 => 0.6318, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.72% (6.3772 => 6.4870, std.dev.: 0.0387) MultiSource/Benchmarks/Olden/bh/bh: 1.64% (2.3560 => 2.3946, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.08% (4.8362 => 4.8883, std.dev.: 0.0146) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -9.01% (3.2926 => 2.9959, std.dev.: 0.0156) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.94% (0.3269 => 0.3042, std.dev.: 0.0034) MultiSource/Applications/lua/lua: -5.33% (29.8330 => 28.2438, std.dev.: 0.0284) MultiSource/Applications/SPASS/SPASS: -4.01% (8.4326 => 8.0947, std.dev.: 0.1060) SingleSource/Benchmarks/Shootout-C++/hash2: -1.45% (3.4237 => 3.3742, std.dev.: 0.0140) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.29% (3.3479 => 3.3047, std.dev.: 0.0016) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.83% (16.4461 => 16.5819, std.dev.: 0.0086) MultiSource/Applications/obsequi/Obsequi: 4.69% (1.0262 => 1.0743, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: 2.45% (0.6332 => 0.6487, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: 5.95% (0.1831 => 0.1940, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.90% (0.1559 => 0.1651, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.27% (0.3123 => 0.3225, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.20% (0.2463 => 0.2468, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.60% (0.3344 => 0.3364, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (0.2364 => 0.2412, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: -0.12% (0.6010 => 0.6003, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/mandel: 14.92% (0.0429 => 0.0493, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.35% (0.3266 => 0.3310, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/strcat: 1.93% (0.1969 => 0.2007, std.dev.: 0.0026) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 19.64% (0.0224 => 0.0268, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 64.23% (0.0123 => 0.0202, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.68% (0.0408 => 0.0423, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 14.57% (0.0254 => 0.0291, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.98% (0.0302 => 0.0311, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -10.16% (0.0384 => 0.0345, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 4.44% (0.0180 => 0.0188, std.dev.: 0.0015) SingleSource/UnitTests/byval-alignment: 55.22% (0.0230 => 0.0357, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 0.90% (0.1438 => 0.1451, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -2.83% (1.1329 => 1.1008, std.dev.: 0.0155) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 1.98% (0.1462 => 0.1491, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.81% (0.4164 => 0.4047, std.dev.: 0.0287) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.82% (0.1369 => 0.1303, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.52% (0.0641 => 0.0612, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 22.56% (0.0195 => 0.0239, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.33% (0.0578 => 0.0553, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.02% (1.1437 => 1.1435, std.dev.: 0.0281) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 600.00% (0.0001 => 0.0007, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.39% (0.0627 => 0.0612, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 29.44% (0.0180 => 0.0233, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.39% (0.8017 => 0.7986, std.dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 98.39% (0.0062 => 0.0123, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 28 16:33:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 28 Oct 2012 18:33:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121028233328.EFBF42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5340?compare_to=5336&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5340, Order: 166902, Start Time: 2012-10-28 22:07:46, End Time: 2012-10-28 23:33:26 To: 5336, Order: 166900, Start Time: 2012-10-28 18:55:51, End Time: 2012-10-28 20:21:14 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 1 (171 on baseline) Unchanged Tests: 1040 (865 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.28% (1.2659 => 1.2948, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.28% (20.3217 => 20.0608, std.dev.: 0.0272) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.36% (15.2527 => 18.3580, std.dev.: 0.0099) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.59% (2.0478 => 2.1214, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: 2.47% (7.4937 => 7.6790, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash2: 2.19% (3.1932 => 3.2631, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.15% (79.7170 => 80.6299, std.dev.: 0.2495) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.67% (0.1431 => 0.1307, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.21% (0.1584 => 0.1454, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.35% (0.3821 => 0.3540, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: -6.73% (0.3831 => 0.3573, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-4: -6.73% (0.3880 => 0.3619, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -6.72% (0.3812 => 0.3556, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -6.65% (0.3848 => 0.3592, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.62% (0.3142 => 0.2934, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: -6.60% (0.3896 => 0.3639, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.55% (0.3891 => 0.3636, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.54% (0.3884 => 0.3630, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: -6.52% (0.4033 => 0.3770, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -6.48% (2.4924 => 2.3309, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.43% (0.2428 => 0.2272, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -6.42% (0.4176 => 0.3908, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.25% (22.4056 => 21.0052, std.dev.: 0.0176) SingleSource/UnitTests/ObjC/property: -6.22% (0.4199 => 0.3938, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -6.11% (0.3026 => 0.2841, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: -6.10% (0.4280 => 0.4019, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: -6.06% (0.2989 => 0.2808, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.02% (0.3057 => 0.2873, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.99% (0.2903 => 0.2729, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: -5.98% (0.3025 => 0.2844, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -5.95% (0.2939 => 0.2764, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.94% (0.3016 => 0.2837, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.93% (0.3658 => 0.3441, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.87% (0.3252 => 0.3061, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.86% (0.3837 => 0.3612, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -5.86% (0.2849 => 0.2682, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.86% (2.1713 => 2.0441, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.84% (5.4682 => 5.1487, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary3: -5.83% (0.3446 => 0.3245, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -5.82% (0.2871 => 0.2704, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -5.81% (0.3255 => 0.3066, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.80% (4.5069 => 4.2457, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/objinst: -5.79% (0.3194 => 0.3009, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.78% (0.4151 => 0.3911, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: -5.76% (1.3148 => 1.2391, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/lists: -5.74% (0.3621 => 0.3413, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.73% (0.2355 => 0.2220, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: -5.73% (0.3788 => 0.3571, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.72% (0.6484 => 0.6113, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -5.72% (0.3059 => 0.2884, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -5.72% (0.4861 => 0.4583, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -5.72% (0.3481 => 0.3282, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary: -5.72% (0.3394 => 0.3200, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.66% (0.3323 => 0.3135, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -5.64% (0.2659 => 0.2509, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: -5.60% (7.0961 => 6.6986, std.dev.: 0.0899) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.59% (0.3849 => 0.3634, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.58% (0.4083 => 0.3855, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.56% (3.5339 => 3.3374, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: -5.51% (0.2160 => 0.2041, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -5.50% (0.6441 => 0.6087, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.47% (4.8161 => 4.5528, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.47% (0.4427 => 0.4185, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: -5.46% (4.3330 => 4.0964, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/Hello: -5.45% (0.6347 => 0.6001, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.45% (0.9542 => 0.9022, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -5.44% (16.1920 => 15.3106, std.dev.: 0.0625) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.42% (0.2548 => 0.2410, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.41% (1.2784 => 1.2092, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists1: -5.40% (0.3867 => 0.3658, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.40% (1.0544 => 0.9975, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: -5.38% (0.6750 => 0.6387, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.36% (0.9852 => 0.9324, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.35% (0.4321 => 0.4090, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -5.34% (34.0927 => 32.2706, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.34% (1.6474 => 1.5595, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.32% (4.8802 => 4.6206, std.dev.: 0.0046) MultiSource/Applications/siod/siod: -5.25% (2.4021 => 2.2760, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.24% (0.3491 => 0.3308, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.22% (0.2933 => 0.2780, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -5.15% (0.3357 => 0.3184, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.14% (0.3931 => 0.3729, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -5.13% (0.4248 => 0.4030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.13% (1.2210 => 1.1584, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -5.13% (0.2985 => 0.2832, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: -5.10% (1.2515 => 1.1877, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.07% (0.8521 => 0.8089, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference: -5.06% (0.7779 => 0.7385, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.06% (1.2221 => 1.1603, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.05% (0.2278 => 0.2163, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.04% (0.7919 => 0.7520, std.dev.: 0.0013) MultiSource/Applications/lua/lua: -5.03% (4.0594 => 3.8552, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.98% (4.0323 => 3.8316, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.94% (0.4813 => 0.4575, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.94% (0.6293 => 0.5982, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.93% (0.5999 => 0.5703, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.89% (2.2587 => 2.1483, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.88% (1.4642 => 1.3928, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash: -4.86% (0.4524 => 0.4304, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.80% (0.2999 => 0.2855, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: -4.78% (9.2283 => 8.7870, std.dev.: 0.0076) MultiSource/Applications/kimwitu++/kc: -4.77% (18.2933 => 17.4204, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.74% (0.7198 => 0.6857, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -4.69% (1.6364 => 1.5597, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.68% (0.9557 => 0.9110, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.67% (1.3722 => 1.3081, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.64% (0.3319 => 0.3165, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: -4.62% (0.7982 => 0.7613, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.57% (0.6230 => 0.5945, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.56% (0.5591 => 0.5336, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.53% (0.5478 => 0.5230, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.50% (0.5863 => 0.5599, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.48% (0.6297 => 0.6015, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -4.47% (0.3581 => 0.3421, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.42% (0.5857 => 0.5598, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.38% (0.6052 => 0.5787, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.38% (0.5802 => 0.5548, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.37% (0.7339 => 0.7018, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.37% (0.4916 => 0.4701, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.36% (0.5705 => 0.5456, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.36% (0.2385 => 0.2281, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.36% (0.5805 => 0.5552, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.33% (0.6194 => 0.5926, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.32% (0.5859 => 0.5606, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.29% (0.5925 => 0.5671, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -4.27% (0.4515 => 0.4322, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.27% (0.5575 => 0.5337, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.25% (0.5570 => 0.5333, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.25% (0.6395 => 0.6123, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.23% (0.6660 => 0.6378, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.22% (0.6681 => 0.6399, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.22% (0.5569 => 0.5334, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -4.19% (0.7447 => 0.7135, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.18% (0.6676 => 0.6397, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.17% (0.5581 => 0.5348, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -4.12% (1.1450 => 1.0978, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -4.11% (0.3406 => 0.3266, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.08% (0.5567 => 0.5340, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.06% (0.5688 => 0.5457, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: -4.04% (0.9179 => 0.8808, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.02% (0.5849 => 0.5614, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.01% (0.5456 => 0.5237, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.01% (0.7524 => 0.7222, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.99% (0.6440 => 0.6183, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -3.99% (0.6395 => 0.6140, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.99% (0.6446 => 0.6189, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -3.98% (8.0126 => 7.6934, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -3.96% (0.6189 => 0.5944, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.96% (0.5941 => 0.5706, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.95% (0.7021 => 0.6744, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.93% (0.6736 => 0.6471, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.93% (0.6033 => 0.5796, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -3.91% (0.6260 => 0.6015, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: -3.90% (0.8418 => 0.8090, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/09-vor/vor: -3.88% (0.3271 => 0.3144, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: -3.87% (2.1401 => 2.0573, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: -3.85% (15.5079 => 14.9110, std.dev.: 0.0299) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.75% (0.5168 => 0.4974, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -3.74% (17.1032 => 16.4629, std.dev.: 0.0286) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.70% (0.9077 => 0.8741, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: -3.67% (1.5610 => 1.5037, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.67% (6.7716 => 6.5231, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.59% (0.3483 => 0.3358, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.51% (1.2300 => 1.1868, std.dev.: 0.0021) MultiSource/Applications/d/make_dparser: -3.49% (3.5154 => 3.3928, std.dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -3.44% (20.7746 => 20.0608, std.dev.: 0.0272) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.38% (0.5329 => 0.5149, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: -3.00% (1.1530 => 1.1184, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.96% (14.2083 => 13.7871, std.dev.: 0.0116) MultiSource/Applications/SIBsim4/SIBsim4: -1.64% (1.3864 => 1.3636, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7572, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -8.65% (1.2842 => 1.1731, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -4.00% (2.2633 => 2.1727, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.85% (1.7753 => 1.7069, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.48% (6.5735 => 6.4763, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.13% (1.3096 => 1.2948, std.dev.: 0.0028) Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 28 16:45:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 28 Oct 2012 18:45:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121028234552.6129F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5341?compare_to=5337&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5341, Order: 166902, Start Time: 2012-10-28 22:14:21, End Time: 2012-10-28 23:45:51 To: 5337, Order: 166900, Start Time: 2012-10-28 19:02:13, End Time: 2012-10-28 20:33:33 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (10 on baseline) New Passes: 0 (14 on baseline) Performance Regressions: 1 (188 on baseline) Performance Improvements: 0 (54 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 15 (5 on baseline) Unchanged Tests: 1026 (637 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.65% (9.8455 => 10.0084, std.dev.: 0.0122) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: 0.39% (2.0413 => 2.0492, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: 0.07% (58.0558 => 58.0973, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.75% (0.0799 => 0.0805, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 0.22% (9.2470 => 9.2670, std.dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.00% (7.8263 => 7.8265, std.dev.: 0.0163) SingleSource/UnitTests/Vector/SSE/sse_shift: 4.47% (0.0515 => 0.0538, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/JM/lencod/lencod: -0.01% (7.7301 => 7.7293, std.dev.: 0.0033) MultiSource/Applications/oggenc/oggenc: - (0.0001 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0649 => 0.0649, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.03% (0.2990 => 0.2991, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_shift: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -64.42% (5.7591 => 2.0492, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: -8.14% (63.2438 => 58.0973, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.80% (6.6874 => 0.0805, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.90% (8.1363 => 9.2670, std.dev.: 0.0051) SingleSource/UnitTests/Vector/SSE/sse_shift: 42.33% (0.0378 => 0.0538, std.dev.: 0.0000) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -50.00% (0.0002 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -57.04% (0.6962 => 0.2991, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_shift: -50.00% (0.0002 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 213.23% (0.5229 => 1.6379, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 18.03% (14.9895 => 17.6925, std.dev.: 0.0200) MultiSource/Applications/kimwitu++/kc: 37.91% (14.1553 => 19.5217, std.dev.: 0.0193) MultiSource/Benchmarks/MallocBench/gs/gs: 13.85% (4.1105 => 4.6799, std.dev.: 0.0116) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 33.16% (1.1048 => 1.4712, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 69.46% (3.4629 => 5.8682, std.dev.: 0.0171) SingleSource/Benchmarks/Misc-C++/stepanov_container: 69.40% (0.6222 => 1.0540, std.dev.: 0.0054) New Passes - Execution Time --------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 3836000.00% (0.0001 => 3.8361, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 11173900.00% (0.0001 => 11.1740, std.dev.: 0.0165) MultiSource/Applications/kimwitu++/kc: 50900.00% (0.0001 => 0.0510, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050300.00% (0.0001 => 10.0504, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5490500.00% (0.0001 => 5.4906, std.dev.: 0.0022) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 78.04% (0.0296 => 0.0527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 69.92% (0.0256 => 0.0435, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 61.25% (0.0271 => 0.0437, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 53.09% (0.0243 => 0.0372, std.dev.: 0.0000) SingleSource/Regression/C/sumarray: 52.38% (0.0231 => 0.0352, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 44.16% (1.5859 => 2.2863, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.85% (0.0834 => 0.1183, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 40.81% (0.1056 => 0.1487, std.dev.: 0.0002) SingleSource/UnitTests/vla: 36.90% (0.0355 => 0.0486, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 35.34% (2.2024 => 2.9808, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 34.11% (0.1463 => 0.1962, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/chomp: 29.37% (0.1655 => 0.2141, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 28.91% (0.1432 => 0.1846, std.dev.: 0.0003) MultiSource/Benchmarks/llubenchmark/llu: 24.46% (0.0462 => 0.0575) SingleSource/UnitTests/SignlessTypes/rem: 22.29% (0.1144 => 0.1399, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.16% (0.1566 => 0.1913, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.84% (0.5105 => 0.6220, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 21.29% (0.1555 => 0.1886, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.90% (0.0871 => 0.1053, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 19.64% (0.6675 => 0.7986, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 19.30% (1.3050 => 1.5568, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.20% (0.2271 => 0.2707, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 19.18% (3.3354 => 3.9752, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: 19.03% (0.0746 => 0.0888, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.75% (0.5020 => 0.5961, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/tsp/tsp: 18.64% (0.1175 => 0.1394, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 18.61% (0.7115 => 0.8439, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 18.49% (0.0730 => 0.0865, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 18.40% (0.2554 => 0.3024, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 18.20% (0.1236 => 0.1461, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.20% (0.4615 => 0.5455, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 18.16% (0.3177 => 0.3754, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 18.12% (0.1584 => 0.1871, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 18.05% (0.0626 => 0.0739, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.01% (0.1510 => 0.1782, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 17.83% (0.4879 => 0.5749, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.81% (1.5415 => 1.8161, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 17.78% (1.1840 => 1.3945, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.73% (0.1032 => 0.1215, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 17.64% (0.1695 => 0.1994, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 17.45% (0.1163 => 0.1366, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.43% (0.1337 => 0.1570, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.40% (0.0793 => 0.0931, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 17.05% (0.3109 => 0.3639, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.03% (0.8172 => 0.9564, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 16.90% (0.2603 => 0.3043, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.85% (0.6450 => 0.7537, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 16.81% (22.1758 => 25.9029, std.dev.: 0.0246) MultiSource/Benchmarks/Ptrdist/ft/ft: 16.75% (0.1940 => 0.2265, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 16.51% (0.1151 => 0.1341, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.48% (0.0886 => 0.1032, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 16.47% (0.1906 => 0.2220, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.30% (0.0675 => 0.0785, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.18% (0.3121 => 0.3626, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 16.03% (0.0842 => 0.0977, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/exptree: 15.97% (0.0814 => 0.0944, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 15.88% (1.0722 => 1.2425, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.87% (0.9765 => 1.1315, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 15.80% (1.1642 => 1.3481, std.dev.: 0.0022) MultiSource/Applications/treecc/treecc: 15.71% (2.0273 => 2.3457, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 15.58% (0.1695 => 0.1959, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/football/football: 15.53% (0.8921 => 1.0306, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.52% (0.2758 => 0.3186, std.dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 15.47% (0.1125 => 0.1299, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 15.42% (0.7835 => 0.9043, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.40% (0.1117 => 0.1289, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.38% (0.2107 => 0.2431, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/voronoi/voronoi: 15.22% (0.2700 => 0.3111, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 15.21% (0.4299 => 0.4953, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 15.18% (0.0672 => 0.0774, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.17% (1.1861 => 1.3660, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 15.07% (1.4186 => 1.6324, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.06% (0.0770 => 0.0886, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 15.05% (0.3423 => 0.3938, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 15.02% (0.5860 => 0.6740, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.83% (0.5981 => 0.6868, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.79% (0.0933 => 0.1071, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.78% (0.1062 => 0.1219, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.77% (0.2065 => 0.2370, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.76% (0.0759 => 0.0871, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.66% (0.1330 => 0.1525, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.59% (4.2646 => 4.8868, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.46% (0.1625 => 0.1860, std.dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 14.44% (0.7433 => 0.8506, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/lpbench: 14.42% (0.0929 => 0.1063, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 14.33% (3.8723 => 4.4272, std.dev.: 0.0182) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.29% (0.0798 => 0.0912, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.19% (0.1029 => 0.1175, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 14.14% (0.3387 => 0.3866, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.09% (0.3307 => 0.3773, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.09% (0.1143 => 0.1304, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.77% (0.0770 => 0.0876, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 13.65% (9.4845 => 10.7788, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.58% (0.5569 => 0.6325, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/health/health: 13.41% (0.1268 => 0.1438, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.22% (0.3441 => 0.3896, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.01% (0.0838 => 0.0947, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.91% (0.3826 => 0.4320, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 12.87% (0.3092 => 0.3490, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 12.58% (0.3180 => 0.3580, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 12.17% (0.0953 => 0.1069, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 12.09% (2.2969 => 2.5747, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.05% (0.1892 => 0.2120, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.80% (14.3668 => 16.0625, std.dev.: 0.0159) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.69% (0.8101 => 0.9048, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.56% (4.9449 => 5.5163, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/bigfib: 11.54% (0.6456 => 0.7201, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.47% (5.0018 => 5.5754, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/hash2: 11.41% (0.4620 => 0.5147, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 11.24% (17.1811 => 19.1114, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/hash: 11.14% (0.4289 => 0.4767, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 11.02% (0.1044 => 0.1159, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.80% (0.3427 => 0.3797, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.76% (0.4636 => 0.5135, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.48% (2.2022 => 2.4330, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 10.43% (0.3422 => 0.3779, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/parameter-passing: 10.24% (0.3927 => 0.4329, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.23% (0.4203 => 0.4633, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.17% (0.3865 => 0.4258, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.16% (0.3828 => 0.4217, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.11% (0.3473 => 0.3824, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.10% (0.3694 => 0.4067, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.02% (0.3543 => 0.3898, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.01% (0.3516 => 0.3868, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.00% (0.3561 => 0.3917, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-4: 9.99% (0.3543 => 0.3897, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 9.89% (0.3497 => 0.3843, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.75% (0.3886 => 0.4265, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 9.68% (1.5603 => 1.7114, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/moments: 9.68% (0.4048 => 0.4440, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 9.66% (0.3684 => 0.4040, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.65% (3.8922 => 4.2678, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.55% (0.4103 => 0.4495, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.53% (0.2266 => 0.2482, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.26% (0.2430 => 0.2655, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 8.99% (0.3603 => 0.3927, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.93% (0.4064 => 0.4427, std.dev.: 0.0076) SingleSource/UnitTests/ObjC++/property-reference-object: 8.81% (0.6030 => 0.6561, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.79% (0.5925 => 0.6446, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.30% (0.3650 => 0.3953, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.26% (0.7326 => 0.7931, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/oourafft: 8.20% (0.3282 => 0.3551, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.06% (0.2891 => 0.3124, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.99% (0.2905 => 0.3137, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 7.97% (0.3098 => 0.3345, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.81% (0.2793 => 0.3011, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.74% (0.3283 => 0.3537, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.72% (0.3162 => 0.3406, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 7.67% (0.2725 => 0.2934, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.66% (0.2756 => 0.2967, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 7.50% (0.3052 => 0.3281, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 7.49% (0.2831 => 0.3043, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/ary2: 7.49% (0.3379 => 0.3632, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.48% (0.2714 => 0.2917, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 7.46% (0.3232 => 0.3473, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.43% (0.8067 => 0.8666, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.42% (0.2872 => 0.3085, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.24% (0.2871 => 0.3079, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.24% (2.0665 => 2.2161, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.16% (0.2877 => 0.3083, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/ReedSolomon: 6.98% (0.2049 => 0.2192, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 6.96% (1.2842 => 1.3736, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: 6.75% (0.2802 => 0.2991, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.61% (0.3136 => 0.3312, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.49% (7.9617 => 8.3988, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/objinst: 5.33% (0.3131 => 0.3298) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.94% (0.3935 => 0.4090, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.09% (7.0540 => 7.2719, std.dev.: 0.0090) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.12% (1.1145 => 1.3722, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 10.38% (0.9957 => 1.0991, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/richards_benchmark: 10.05% (1.1396 => 1.2541, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.95% (2.8904 => 3.0914) SingleSource/Benchmarks/Shootout-C++/hash2: 6.62% (3.1578 => 3.3669, std.dev.: 0.0008) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626) SingleSource/Benchmarks/Misc/fp-convert: 4.50% (3.3453 => 3.4960, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 2.91% (1.9405 => 1.9969, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.67% (4.2280 => 4.3409, std.dev.: 0.0049) MultiSource/Applications/viterbi/viterbi: 2.51% (4.4649 => 4.5769, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0313 => 1.0567, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.98% (0.8333 => 0.8498, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2078, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.35% (9.1159 => 9.2389, std.dev.: 0.0152) MultiSource/Benchmarks/nbench/nbench: 1.30% (11.6436 => 11.7945, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -76.43% (0.8651 => 0.2039, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.24% (5.3855 => 2.4108, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -54.94% (5.3526 => 2.4120, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: -45.01% (0.1622 => 0.0892, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.02% (1.1194 => 0.6826, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.82% (5.2763 => 3.2280, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -23.03% (1.7609 => 1.3554, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -17.03% (2.9384 => 2.4380, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -8.97% (54.1659 => 49.3058, std.dev.: 0.0169) MultiSource/Applications/JM/ldecod/ldecod: -7.61% (10.4361 => 9.6415, std.dev.: 0.0098) MultiSource/Benchmarks/PAQ8p/paq8p: -3.46% (10.3673 => 10.0084, std.dev.: 0.0122) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -54.03% (8.0499 => 3.7007, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0134) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7653, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.61% (0.0506 => 0.0341) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.38% (0.3987 => 0.2696, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.51% (2.9695 => 2.3606, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -19.01% (1.2258 => 0.9928, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -16.00% (1.6925 => 1.4217, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.72% (1.2373 => 1.0923, std.dev.: 0.0057) MultiSource/Benchmarks/NPB-serial/is/is: -10.98% (9.5636 => 8.5138, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: -10.88% (1.5373 => 1.3700, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.32% (19.9488 => 18.2899, std.dev.: 0.0085) MultiSource/Benchmarks/FreeBench/mason/mason: -7.68% (0.2161 => 0.1995, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.00% (1.8329 => 1.7046, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -5.45% (6.6465 => 6.2841, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.09% (1.6805 => 1.5950, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.89% (0.2497 => 0.2375, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.80% (1.5835 => 1.5075, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.98% (8.1563 => 7.8314, std.dev.: 0.0075) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0016) MultiSource/Applications/siod/siod: -3.73% (3.2827 => 3.1603, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.53% (32.5116 => 31.3637, std.dev.: 0.0041) MultiSource/Benchmarks/sim/sim: -3.33% (5.0483 => 4.8803, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -2.92% (4.6441 => 4.5085, std.dev.: 0.0072) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.79% (4.5009 => 4.3752, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.62% (0.4808 => 0.4682, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -1.97% (2.5528 => 2.5025, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/salsa20: -1.85% (10.2830 => 10.0927, std.dev.: 0.0228) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6834, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: -1.28% (85.0658 => 83.9763, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.19% (1.7254 => 1.7048, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2356, std.dev.: 0.0074) MultiSource/Benchmarks/Olden/power/power: -1.01% (1.1277 => 1.1163, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.34% (7.1582 => 7.8265, std.dev.: 0.0163) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: 10635.14% (0.0720 => 7.7293, std.dev.: 0.0033) MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 28 18:07:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 28 Oct 2012 20:07:52 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121029010752.C97A62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5342?compare_to=5339&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5342, Order: 166903, Start Time: 2012-10-28 23:43:33, End Time: 2012-10-29 01:07:51 To: 5339, Order: 166902, Start Time: 2012-10-28 22:01:56, End Time: 2012-10-28 23:26:53 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 7 (89 on baseline) Performance Improvements: 7 (5 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 961 (880 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.62% (0.8475 => 0.8612, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 13.49% (0.7709 => 0.8749, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/methcall: 9.04% (8.2229 => 8.9665, std.dev.: 0.0191) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.95% (0.3391 => 0.3491, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 2.01% (8.0947 => 8.2577, std.dev.: 0.0524) MultiSource/Benchmarks/Olden/em3d/em3d: 2.01% (5.3534 => 5.4609, std.dev.: 0.0276) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.38% (1.4074 => 1.4268, std.dev.: 0.0064) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.68% (8.7693 => 8.4469, std.dev.: 0.1042) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.42% (0.3483 => 0.3364, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -2.81% (0.6046 => 0.5876, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -2.58% (0.5200 => 0.5066, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.63% (0.9014 => 0.8867, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: -1.21% (1.4910 => 1.4729, std.dev.: 0.0060) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.43% (2.6138 => 2.5765, std.dev.: 0.0138) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.55% (16.5819 => 16.6736, std.dev.: 0.1474) MultiSource/Applications/obsequi/Obsequi: -0.53% (1.0743 => 1.0686, std.dev.: 0.0077) MultiSource/Applications/sqlite3/sqlite3: 0.02% (0.6487 => 0.6488, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/08-main/main: - (0.1940 => 0.1940, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.91% (0.1651 => 0.1699, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.90% (0.3225 => 0.3196, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.09% (0.2468 => 0.2495, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.42% (0.3364 => 0.3350, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.53% (0.2412 => 0.2351, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/bigfib: 0.30% (0.6003 => 0.6021, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/mandel: -10.14% (0.0493 => 0.0443, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.36% (0.3310 => 0.3322, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/strcat: -3.24% (0.2007 => 0.1942, std.dev.: 0.0030) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -10.07% (0.0268 => 0.0241, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 8.42% (0.0202 => 0.0219, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -18.68% (0.0423 => 0.0344, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.31% (0.0291 => 0.0261, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.64% (0.0311 => 0.0313, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 17.10% (0.0345 => 0.0404, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/casts: 1.48% (0.0203 => 0.0206, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 13.83% (0.0188 => 0.0214, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -6.16% (0.0357 => 0.0335, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -7.69% (0.0013 => 0.0012, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.41% (0.1451 => 0.1445, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.91% (1.1008 => 1.1328, std.dev.: 0.0207) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.89% (0.1491 => 0.1433, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.42% (0.4047 => 0.4064, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.68% (0.1303 => 0.1364, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.21% (0.0612 => 0.0650, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 15.06% (0.0239 => 0.0275, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.16% (0.0553 => 0.0530, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.16% (1.1435 => 1.1453, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0007 => 0.0014, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 3.85% (0.0026 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.82% (0.0612 => 0.0607, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.73% (0.0233 => 0.0208, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.39% (0.7986 => 0.8017, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 300.00% (0.0001 => 0.0004, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -31.71% (0.0123 => 0.0084, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.86% (2.1832 => 1.6623, std.dev.: 0.0023) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 36.07% (14.7684 => 20.0956, std.dev.: 0.4603) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.94% (0.0810 => 0.0931, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/tsp/tsp: 13.76% (0.1112 => 0.1265, std.dev.: 0.0008) SingleSource/UnitTests/SignlessTypes/rem: 12.66% (0.1035 => 0.1166, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.77% (0.2180 => 0.2393, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.89% (0.2279 => 0.2436, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 6.87% (1.2568 => 1.3431, std.dev.: 0.0065) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.81% (0.1983 => 0.2118, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.56% (0.8321 => 0.8867, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.44% (13.1811 => 13.8987, std.dev.: 0.1140) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.28% (6.6074 => 6.9563, std.dev.: 0.0072) MultiSource/Applications/spiff/spiff: 5.23% (0.7950 => 0.8366, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.07% (0.2741 => 0.2880, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.66% (1.1170 => 1.1690, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.65% (0.4127 => 0.4319, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.52% (0.4847 => 0.5066, std.dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 4.45% (1.1271 => 1.1773, std.dev.: 0.0084) MultiSource/Applications/treecc/treecc: 4.25% (1.9948 => 2.0795, std.dev.: 0.0022) MultiSource/Applications/Burg/burg: 4.17% (1.2222 => 1.2732, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.17% (0.8331 => 0.8678, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.07% (1.1685 => 1.2161, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.05% (0.2519 => 0.2621, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.01% (0.8050 => 0.8373, std.dev.: 0.0120) MultiSource/Applications/sgefa/sgefa: 4.00% (0.2999 => 0.3119, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 3.97% (3.8189 => 3.9705, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.93% (0.8286 => 0.8612, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.79% (0.4559 => 0.4732, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.74% (0.8148 => 0.8453, std.dev.: 0.0077) MultiSource/Applications/d/make_dparser: 3.74% (3.2366 => 3.3577, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.70% (1.6386 => 1.6993, std.dev.: 0.0107) MultiSource/Applications/SPASS/SPASS: 3.68% (14.2605 => 14.7849, std.dev.: 0.1305) MultiSource/Applications/lemon/lemon: 3.57% (1.0945 => 1.1336, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.55% (1.1606 => 1.2018, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.43% (0.8457 => 0.8747, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.42% (0.3717 => 0.3844, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 3.41% (0.9069 => 0.9378, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/football/football: 3.26% (0.8768 => 0.9054, std.dev.: 0.0086) MultiSource/Applications/hbd/hbd: 3.22% (1.4269 => 1.4729, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.16% (0.7966 => 0.8218, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 3.07% (0.8069 => 0.8317, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 3.00% (0.8204 => 0.8450, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.93% (0.8597 => 0.8849, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.88% (0.8611 => 0.8859, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.81% (0.8855 => 0.9104, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.80% (0.8420 => 0.8656, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.80% (0.8716 => 0.8960, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 2.79% (0.3800 => 0.3906, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.79% (0.9074 => 0.9327, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.75% (0.8712 => 0.8952, std.dev.: 0.0090) MultiSource/Benchmarks/mafft/pairlocalalign: 2.66% (8.6247 => 8.8542, std.dev.: 0.0289) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.61% (4.1763 => 4.2854, std.dev.: 0.0329) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.57% (0.6227 => 0.6387, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.55% (0.8317 => 0.8529, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.55% (0.8086 => 0.8292, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.55% (1.2602 => 1.2923, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.53% (0.9056 => 0.9285, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.52% (3.1832 => 3.2635, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.50% (0.9908 => 1.0156, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.48% (0.8261 => 0.8466, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.46% (0.9039 => 0.9261, std.dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: 2.42% (0.9810 => 1.0047, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.38% (0.9688 => 0.9919, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.28% (0.7932 => 0.8113, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.27% (0.8066 => 0.8249, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.26% (0.8177 => 0.8362, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.22% (0.8048 => 0.8227, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.19% (2.1401 => 2.1870, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.18% (1.4479 => 1.4795, std.dev.: 0.0042) MultiSource/Applications/JM/ldecod/ldecod: 2.12% (6.7320 => 6.8744, std.dev.: 0.0284) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.98% (0.8316 => 0.8481, std.dev.: 0.0056) MultiSource/Applications/oggenc/oggenc: 1.94% (4.9628 => 5.0591, std.dev.: 0.0239) MultiSource/Benchmarks/PAQ8p/paq8p: 1.94% (2.3764 => 2.4225, std.dev.: 0.0139) MultiSource/Applications/siod/siod: 1.92% (2.2184 => 2.2611, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.75% (0.8995 => 0.9152, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.70% (1.5315 => 1.5576, std.dev.: 0.0046) MultiSource/Benchmarks/Bullet/bullet: 1.67% (31.8598 => 32.3915, std.dev.: 0.1365) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.54% (1.2423 => 1.2614, std.dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.68% (1.5795 => 2.5063, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.57% (0.3186 => 0.3491, std.dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.39% (2.4333 => 2.6617, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.51% (1.1857 => 1.2866, std.dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 5.92% (63.1822 => 66.9244, std.dev.: 0.0608) SingleSource/Benchmarks/Shootout-C++/hash: 3.87% (0.6205 => 0.6445, std.dev.: 0.0062) MultiSource/Applications/siod/siod: 2.45% (3.6643 => 3.7542, std.dev.: 0.0125) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.01% (2.4490 => 2.4983, std.dev.: 0.0116) SingleSource/Benchmarks/Misc/ReedSolomon: 1.67% (8.5322 => 8.6743, std.dev.: 0.0505) MultiSource/Benchmarks/Olden/bh/bh: 1.63% (2.3560 => 2.3945, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.26% (4.8362 => 4.8973, std.dev.: 0.0182) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.07% (1.5866 => 1.6036, std.dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.01% (0.3269 => 0.3040, std.dev.: 0.0008) MultiSource/Applications/lua/lua: -5.02% (29.8330 => 28.3357, std.dev.: 0.0899) MultiSource/Applications/SPASS/SPASS: -2.07% (8.4326 => 8.2577, std.dev.: 0.0524) SingleSource/Benchmarks/Shootout-C++/hash2: -1.38% (3.4237 => 3.3764, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.26% (3.3479 => 3.3056, std.dev.: 0.0110) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 1.38% (16.4461 => 16.6736, std.dev.: 0.1474) MultiSource/Applications/obsequi/Obsequi: 4.13% (1.0262 => 1.0686, std.dev.: 0.0077) MultiSource/Applications/sqlite3/sqlite3: 2.46% (0.6332 => 0.6488, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/08-main/main: 5.95% (0.1831 => 0.1940, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 8.98% (0.1559 => 0.1699, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.34% (0.3123 => 0.3196, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (0.2463 => 0.2495, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.18% (0.3344 => 0.3350, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.55% (0.2364 => 0.2351, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/bigfib: 0.18% (0.6010 => 0.6021, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/mandel: 3.26% (0.0429 => 0.0443, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.71% (0.3266 => 0.3322, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/strcat: -1.37% (0.1969 => 0.1942, std.dev.: 0.0030) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.59% (0.0224 => 0.0241, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -15.69% (0.0408 => 0.0344, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 2.76% (0.0254 => 0.0261, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 5.21% (0.0384 => 0.0404, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/casts: 8.42% (0.0190 => 0.0206, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 18.89% (0.0180 => 0.0214, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 45.65% (0.0230 => 0.0335, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 71.43% (0.0007 => 0.0012, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.49% (0.1438 => 0.1445, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.01% (1.1329 => 1.1328, std.dev.: 0.0207) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.98% (0.1462 => 0.1433, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.40% (0.4164 => 0.4064, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.37% (0.1369 => 0.1364, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.40% (0.0641 => 0.0650, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.03% (0.0195 => 0.0275, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.30% (0.0578 => 0.0530, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.14% (1.1437 => 1.1453, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1300.00% (0.0001 => 0.0014, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.19% (0.0627 => 0.0607, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 15.56% (0.0180 => 0.0208, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: - (0.8017 => 0.8017, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 300.00% (0.0001 => 0.0004, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 35.48% (0.0062 => 0.0084, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 28 18:21:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 28 Oct 2012 20:21:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121029012153.CC7E12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5343?compare_to=5340&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5343, Order: 166903, Start Time: 2012-10-28 23:56:29, End Time: 2012-10-29 01:21:51 To: 5340, Order: 166902, Start Time: 2012-10-28 22:07:46, End Time: 2012-10-28 23:33:26 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 1 (175 on baseline) Unchanged Tests: 1040 (861 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.59% (54.4354 => 56.3889, std.dev.: 0.1477) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.17% (1.2948 => 1.2796, std.dev.: 0.0036) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.38% (15.2527 => 18.3618, std.dev.: 0.0119) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.32% (54.5751 => 56.3889, std.dev.: 0.1477) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1010, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: 2.57% (7.4937 => 7.6860, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/hash2: 2.21% (3.1932 => 3.2637, std.dev.: 0.0112) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.60% (0.1431 => 0.1308, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.21% (0.1584 => 0.1454, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.33% (0.3821 => 0.3541, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.78% (0.3880 => 0.3617, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -6.76% (0.3831 => 0.3572, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/trivial-interface: -6.74% (0.3812 => 0.3555, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.67% (0.3884 => 0.3625, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -6.65% (0.3848 => 0.3592, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.63% (0.3891 => 0.3633, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -6.62% (0.4033 => 0.3766, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -6.60% (0.3896 => 0.3639, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.59% (0.3142 => 0.2935, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: -6.56% (0.4176 => 0.3902, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.43% (0.2428 => 0.2272, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.42% (2.4924 => 2.3323, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.37% (22.4056 => 20.9775, std.dev.: 0.0228) SingleSource/UnitTests/ObjC/property: -6.36% (0.4199 => 0.3932, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/parameter-passing: -6.26% (0.4280 => 0.4012, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -6.22% (0.2989 => 0.2803, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.21% (0.3658 => 0.3431, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.17% (0.2903 => 0.2724, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.15% (0.3252 => 0.3052, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.15% (0.3057 => 0.2869, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.09% (2.1713 => 2.0390, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -6.07% (0.3016 => 0.2833, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -6.05% (0.3026 => 0.2843, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.05% (0.3837 => 0.3605, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.02% (0.3025 => 0.2843, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.00% (0.4083 => 0.3838, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: -5.99% (0.3255 => 0.3060, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -5.99% (0.3205 => 0.3013, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.99% (5.4682 => 5.1409, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/objinst: -5.95% (0.3194 => 0.3004, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -5.92% (0.2871 => 0.2701, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -5.92% (0.2939 => 0.2765, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -5.91% (0.1879 => 0.1768, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.90% (0.4151 => 0.3906, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -5.90% (1.3148 => 1.2372, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary3: -5.89% (0.3446 => 0.3243, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.89% (4.5069 => 4.2416, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.86% (0.6484 => 0.6104, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -5.86% (0.3481 => 0.3277, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.86% (0.2355 => 0.2217, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -5.83% (0.3621 => 0.3410, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: -5.81% (0.7779 => 0.7327, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.81% (0.3323 => 0.3130, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: -5.80% (0.3394 => 0.3197, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -5.79% (0.3059 => 0.2882, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sieve: -5.78% (0.3788 => 0.3569, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -5.78% (0.4861 => 0.4580, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -5.76% (0.2849 => 0.2685, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: -5.75% (0.2659 => 0.2506, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.74% (0.3849 => 0.3628, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.72% (0.4321 => 0.4074, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: -5.68% (1.2515 => 1.1804, std.dev.: 0.0108) MultiSource/Applications/JM/ldecod/ldecod: -5.67% (7.0961 => 6.6936, std.dev.: 0.0130) MultiSource/Applications/sgefa/sgefa: -5.66% (0.3357 => 0.3167, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -5.62% (16.1920 => 15.2821, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.60% (0.4427 => 0.4179, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -5.60% (0.6750 => 0.6372, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: -5.59% (0.6347 => 0.5992, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -5.59% (0.3867 => 0.3651, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: -5.57% (4.3330 => 4.0916, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.57% (3.5339 => 3.3372, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -5.55% (2.4021 => 2.2689, std.dev.: 0.0163) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.52% (4.8161 => 4.5501, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: -5.51% (0.2160 => 0.2041, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -5.51% (34.0927 => 32.2157, std.dev.: 0.0131) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.50% (0.9852 => 0.9310, std.dev.: 0.0052) SingleSource/UnitTests/ObjC++/property-reference-object: -5.48% (0.6441 => 0.6088, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.46% (0.9542 => 0.9021, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.44% (1.0544 => 0.9970, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.42% (1.2221 => 1.1559, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.42% (0.2548 => 0.2410, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.39% (4.8802 => 4.6172, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.33% (1.2784 => 1.2102, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.33% (0.3491 => 0.3305, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.32% (1.2210 => 1.1560, std.dev.: 0.0077) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.32% (0.8521 => 0.8068, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: -5.30% (0.4248 => 0.4023, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.29% (0.3931 => 0.3723, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.27% (0.7919 => 0.7502, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.18% (1.6474 => 1.5620, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -5.11% (4.0594 => 3.8518, std.dev.: 0.0093) MultiSource/Applications/kimwitu++/kc: -5.11% (18.2933 => 17.3593, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.09% (0.2278 => 0.2162, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.06% (0.7198 => 0.6834, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.05% (1.6364 => 1.5537, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.03% (0.4813 => 0.4571, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.02% (0.5999 => 0.5698, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.00% (4.0323 => 3.8307, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/hash: -4.93% (0.4524 => 0.4301, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.86% (0.6293 => 0.5987, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: -4.85% (0.7982 => 0.7595, std.dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.83% (0.2999 => 0.2854, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.83% (1.4642 => 1.3935, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: -4.79% (9.2283 => 8.7865, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.77% (1.3722 => 1.3068, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.76% (0.9557 => 0.9102, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.67% (0.3319 => 0.3164, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.64% (2.2587 => 2.1539, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/18-imp/imp: -4.64% (0.3581 => 0.3415, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: -4.56% (0.2985 => 0.2849, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.54% (0.6297 => 0.6011, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.52% (0.5863 => 0.5598, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.52% (0.5802 => 0.5540, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.51% (0.5478 => 0.5231, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.51% (0.5857 => 0.5593, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.49% (0.5591 => 0.5340, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.48% (0.4916 => 0.4696, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.44% (0.5805 => 0.5547, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.43% (0.6230 => 0.5954, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.43% (0.6395 => 0.6112, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.42% (0.5705 => 0.5453, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.42% (0.6681 => 0.6386, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.41% (0.5925 => 0.5664, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.40% (0.5569 => 0.5324, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -4.39% (0.7447 => 0.7120, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.36% (0.6667 => 0.6376, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.36% (0.2385 => 0.2281, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.34% (0.6660 => 0.6371, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.33% (0.6194 => 0.5926, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.31% (0.6052 => 0.5791, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.31% (0.5456 => 0.5221, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.31% (0.7339 => 0.7023, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.26% (0.5581 => 0.5343) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.25% (0.6676 => 0.6392, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.25% (0.5859 => 0.5610, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -4.24% (1.1450 => 1.0964, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.24% (0.5570 => 0.5334, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.22% (0.6304 => 0.6038, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -4.20% (0.3406 => 0.3263, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: -4.19% (0.9179 => 0.8794, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.19% (0.5941 => 0.5692, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -4.19% (0.4515 => 0.4326, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: -4.16% (0.3271 => 0.3135, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: -4.15% (0.8418 => 0.8069, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.14% (0.5849 => 0.5607, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: -4.13% (2.1401 => 2.0517, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.13% (0.6395 => 0.6131, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.11% (0.5567 => 0.5338, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.11% (0.6446 => 0.6181, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.11% (0.9077 => 0.8704, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.10% (0.5688 => 0.5455, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.07% (0.6189 => 0.5937, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.06% (0.6260 => 0.6006, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.04% (0.5575 => 0.5350, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.02% (0.6440 => 0.6181, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.02% (8.0126 => 7.6905, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.00% (0.7524 => 0.7223, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.97% (0.7021 => 0.6742, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: -3.96% (15.5079 => 14.8940, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.94% (0.6033 => 0.5795, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.83% (0.5168 => 0.4970, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.82% (0.3483 => 0.3350, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -3.78% (17.1032 => 16.4565, std.dev.: 0.0134) MultiSource/Applications/hbd/hbd: -3.77% (1.5610 => 1.5021, std.dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.73% (6.7716 => 6.5187, std.dev.: 0.0079) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.71% (0.6736 => 0.6486, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: -3.60% (3.5154 => 3.3888, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.54% (1.2300 => 1.1864, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.49% (0.5329 => 0.5143, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.43% (5.0226 => 4.8505, std.dev.: 0.0080) SingleSource/UnitTests/Vector/constpool: -3.41% (20.7746 => 20.0667, std.dev.: 0.0102) MultiSource/Benchmarks/nbench/nbench: -3.30% (1.1530 => 1.1149, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.04% (14.2083 => 13.7766, std.dev.: 0.0056) MultiSource/Applications/SIBsim4/SIBsim4: -1.70% (1.3864 => 1.3628, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7576, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1728, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.98% (2.2633 => 2.1733, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7062, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.29% (1.3096 => 1.2796, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4669, std.dev.: 0.0035) Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 28 18:46:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 28 Oct 2012 20:46:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121029014659.13A042A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5344?compare_to=5341&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5344, Order: 166903, Start Time: 2012-10-29 00:15:26, End Time: 2012-10-29 01:46:57 To: 5341, Order: 166902, Start Time: 2012-10-28 22:14:21, End Time: 2012-10-28 23:45:51 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (10 on baseline) New Passes: 0 (14 on baseline) Performance Regressions: 1 (189 on baseline) Performance Improvements: 0 (54 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 15 (5 on baseline) Unchanged Tests: 1026 (636 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.76% (55.0058 => 55.9755, std.dev.: 0.3576) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: 0.05% (2.0492 => 2.0503, std.dev.: 0.0049) MultiSource/Benchmarks/Bullet/bullet: 0.06% (58.0973 => 58.1315, std.dev.: 0.0187) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.75% (0.0805 => 0.0799, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -0.08% (9.2670 => 9.2595, std.dev.: 0.0114) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.14% (7.8265 => 7.8376, std.dev.: 0.0084) SingleSource/UnitTests/Vector/SSE/sse_shift: -0.19% (0.0538 => 0.0537, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/JM/lencod/lencod: 0.01% (7.7293 => 7.7300, std.dev.: 0.0116) MultiSource/Applications/oggenc/oggenc: - (0.0001 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0649 => 0.0648, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: - (0.2991 => 0.2991, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_shift: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -64.40% (5.7591 => 2.0503, std.dev.: 0.0049) MultiSource/Benchmarks/Bullet/bullet: -8.08% (63.2438 => 58.1315, std.dev.: 0.0187) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.81% (6.6874 => 0.0799, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.80% (8.1363 => 9.2595, std.dev.: 0.0114) SingleSource/UnitTests/Vector/SSE/sse_shift: 42.06% (0.0378 => 0.0537, std.dev.: 0.0002) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -50.00% (0.0002 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -57.04% (0.6962 => 0.2991, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_shift: -50.00% (0.0002 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 213.65% (0.5229 => 1.6401, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 18.12% (14.9895 => 17.7049, std.dev.: 0.0190) MultiSource/Applications/kimwitu++/kc: 38.28% (14.1553 => 19.5745, std.dev.: 0.0083) MultiSource/Benchmarks/MallocBench/gs/gs: 14.06% (4.1105 => 4.6886, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 33.16% (1.1048 => 1.4711, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 69.78% (3.4629 => 5.8794, std.dev.: 0.0229) SingleSource/Benchmarks/Misc-C++/stepanov_container: 69.24% (0.6222 => 1.0530, std.dev.: 0.0009) New Passes - Execution Time --------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 3836100.00% (0.0001 => 3.8362, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 11131800.00% (0.0001 => 11.1319, std.dev.: 0.0267) MultiSource/Applications/kimwitu++/kc: 50700.00% (0.0001 => 0.0508, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049700.00% (0.0001 => 10.0498, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5490900.00% (0.0001 => 5.4910, std.dev.: 0.0015) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 78.04% (0.0296 => 0.0527, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: 69.92% (0.0256 => 0.0435, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 61.25% (0.0271 => 0.0437, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 53.09% (0.0243 => 0.0372, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 44.29% (1.5859 => 2.2883, std.dev.: 0.0007) SingleSource/Regression/C/sumarray: 43.72% (0.0231 => 0.0332, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.97% (0.0834 => 0.1184) MultiSource/Benchmarks/FreeBench/distray/distray: 41.00% (0.1056 => 0.1489, std.dev.: 0.0009) SingleSource/UnitTests/vla: 36.06% (0.0355 => 0.0483, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 35.34% (2.2024 => 2.9808, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/neural/neural: 34.04% (0.1463 => 0.1961, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 28.91% (0.1432 => 0.1846, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 28.46% (0.1655 => 0.2126, std.dev.: 0.0012) MultiSource/Benchmarks/llubenchmark/llu: 24.24% (0.0462 => 0.0574, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/rem: 22.38% (0.1144 => 0.1400) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 22.25% (0.5105 => 0.6241, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 22.12% (0.1555 => 0.1899, std.dev.: 0.0030) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.97% (0.1566 => 0.1910, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.01% (0.0871 => 0.1054, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 19.76% (0.6675 => 0.7994, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 19.33% (1.3050 => 1.5572, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 19.20% (3.3354 => 3.9758, std.dev.: 0.0106) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.15% (0.2271 => 0.2706, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/n-body: 19.03% (0.0746 => 0.0888, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 19.03% (0.7115 => 0.8469, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.94% (0.5020 => 0.5971, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/almabench: 18.63% (0.0730 => 0.0866, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 18.55% (0.1175 => 0.1393, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: 18.48% (0.2554 => 0.3026, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.29% (0.4615 => 0.5459, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 18.24% (0.1584 => 0.1873, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 18.20% (0.1236 => 0.1461, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.95% (0.1510 => 0.1781, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.93% (0.1032 => 0.1217, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: 17.89% (0.0626 => 0.0738, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 17.83% (0.4879 => 0.5749, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 17.83% (1.1840 => 1.3951, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.79% (1.5415 => 1.8158, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/em3d/em3d: 17.76% (0.1695 => 0.1996, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.65% (0.0793 => 0.0933, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.50% (0.1337 => 0.1571, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 17.41% (0.3177 => 0.3730, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/mst/mst: 17.37% (0.1163 => 0.1365, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.19% (0.8172 => 0.9577, std.dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.17% (0.3121 => 0.3657, std.dev.: 0.0038) MultiSource/Applications/sgefa/sgefa: 17.14% (0.3109 => 0.3642, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 16.98% (0.2603 => 0.3045, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.95% (0.6450 => 0.7543, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 16.86% (22.1758 => 25.9150, std.dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/ft/ft: 16.75% (0.1940 => 0.2265, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.59% (0.0886 => 0.1033, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 16.51% (0.1151 => 0.1341, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 16.37% (0.1906 => 0.2218, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 16.28% (0.2758 => 0.3207, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.15% (0.0675 => 0.0784, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 16.03% (1.0722 => 1.2441, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 15.99% (1.1642 => 1.3503, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/exptree: 15.97% (0.0814 => 0.0944, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.91% (0.0842 => 0.0976, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.87% (0.9765 => 1.1315, std.dev.: 0.0032) MultiSource/Applications/treecc/treecc: 15.82% (2.0273 => 2.3480, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 15.69% (0.1695 => 0.1961, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 15.67% (0.8921 => 1.0319, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 15.48% (0.7835 => 0.9048, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 15.48% (0.0672 => 0.0776) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.45% (0.0770 => 0.0889, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.33% (0.2107 => 0.2430, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.31% (0.1117 => 0.1288, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 15.26% (0.2700 => 0.3112, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.20% (1.1861 => 1.3664, std.dev.: 0.0020) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 15.20% (0.1125 => 0.1296, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 15.17% (1.4186 => 1.6338, std.dev.: 0.0017) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.14% (0.1143 => 0.1316, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 15.03% (0.5860 => 0.6741, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 14.93% (0.3423 => 0.3934, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 14.91% (0.4299 => 0.4940, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.90% (0.0933 => 0.1072, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.83% (0.5981 => 0.6868, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.81% (0.1330 => 0.1527, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.76% (0.0759 => 0.0871, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.71% (0.1625 => 0.1864, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.69% (0.1062 => 0.1218, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 14.64% (0.0929 => 0.1065, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 14.62% (0.7433 => 0.8520, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.60% (4.2646 => 4.8872, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.58% (0.2065 => 0.2366, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 14.42% (3.8723 => 4.4308, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.38% (0.1029 => 0.1177, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 14.29% (0.3387 => 0.3871, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.27% (0.3307 => 0.3779, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.16% (0.0798 => 0.0911) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 13.84% (0.0730 => 0.0831, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.77% (0.0770 => 0.0876, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 13.70% (9.4845 => 10.7835, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.49% (0.5569 => 0.6320, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/health/health: 13.41% (0.1268 => 0.1438, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.25% (0.3826 => 0.4333, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.14% (0.3441 => 0.3893, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.01% (0.0838 => 0.0947, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 12.90% (0.3092 => 0.3491, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 12.58% (0.3180 => 0.3580, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 12.07% (0.0953 => 0.1068, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.00% (0.1892 => 0.2119, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 11.97% (2.2969 => 2.5718, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.86% (14.3668 => 16.0708, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: 11.65% (0.6456 => 0.7208, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.60% (0.8101 => 0.9041, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.45% (4.9449 => 5.5112, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.41% (5.0018 => 5.5727, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: 11.35% (17.1811 => 19.1305, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/hash2: 11.32% (0.4620 => 0.5143, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 11.21% (0.1044 => 0.1161, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 11.17% (0.4289 => 0.4768, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.97% (0.3427 => 0.3803, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.53% (2.2022 => 2.4340, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/parameter-passing: 10.52% (0.3927 => 0.4340, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 10.49% (0.3422 => 0.3781, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.40% (0.4636 => 0.5118, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.30% (0.4203 => 0.4636, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.22% (0.3473 => 0.3828, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.17% (0.3865 => 0.4258, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.14% (0.3828 => 0.4216, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.05% (0.3543 => 0.3899, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.01% (0.3497 => 0.3847, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 9.96% (0.3543 => 0.3896, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.96% (0.3694 => 0.4062, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.93% (0.3516 => 0.3865, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.91% (0.3561 => 0.3914, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.83% (0.3886 => 0.4268, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/moments: 9.73% (0.4048 => 0.4442, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 9.70% (1.5603 => 1.7116, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 9.69% (0.3684 => 0.4041, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.55% (3.8922 => 4.2640, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.53% (0.2266 => 0.2482, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.48% (0.4103 => 0.4492, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.30% (0.2430 => 0.2656, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 9.05% (0.3603 => 0.3929, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.93% (0.4064 => 0.4427, std.dev.: 0.0045) SingleSource/UnitTests/ObjC++/Hello: 8.84% (0.5925 => 0.6449, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.76% (0.6030 => 0.6558, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 8.56% (0.3282 => 0.3563, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.47% (0.3650 => 0.3959, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.31% (0.7326 => 0.7935, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.16% (0.8067 => 0.8725, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/matrix: 8.01% (0.3098 => 0.3346, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.82% (0.2891 => 0.3117, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.77% (0.2793 => 0.3010, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.68% (0.3283 => 0.3535, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.58% (0.3232 => 0.3477, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 7.56% (0.2831 => 0.3045, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.56% (0.3162 => 0.3401, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.38% (0.2872 => 0.3084, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.26% (0.2905 => 0.3116, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 7.21% (0.2871 => 0.3078, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.21% (2.0665 => 2.2154, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: 7.16% (0.2877 => 0.3083, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.08% (0.2756 => 0.2951, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 7.07% (0.3379 => 0.3618, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 7.05% (0.2725 => 0.2917, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/hello: 7.04% (0.2714 => 0.2905, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 6.95% (1.2842 => 1.3735, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wc: 6.95% (0.3052 => 0.3264, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 6.64% (0.2802 => 0.2988, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 6.64% (0.2049 => 0.2185, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.58% (0.3136 => 0.3311, std.dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.50% (7.9617 => 8.3996, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/objinst: 5.40% (0.3131 => 0.3300, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.96% (0.3935 => 0.4091, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.05% (7.0540 => 7.2692, std.dev.: 0.0111) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.04% (1.1145 => 1.3713, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 10.22% (0.9957 => 1.0975, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/richards_benchmark: 9.83% (1.1396 => 1.2516, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.95% (2.8904 => 3.0912, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.64% (3.1578 => 3.3676, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: 5.10% (0.5413 => 0.5689, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: 4.50% (3.3453 => 3.4960, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 2.99% (1.9405 => 1.9985, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.76% (4.2280 => 4.3447, std.dev.: 0.0028) MultiSource/Applications/viterbi/viterbi: 2.53% (4.4649 => 4.5777, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.76% (0.8333 => 0.8480, std.dev.: 0.0013) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2078, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.31% (9.1159 => 9.2353, std.dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 1.30% (11.6436 => 11.7951, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -76.65% (0.8651 => 0.2020, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.24% (5.3855 => 2.4107, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -54.89% (5.3526 => 2.4145, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/richards_benchmark: -45.01% (0.1622 => 0.0892, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.02% (1.1194 => 0.6826, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.79% (5.2763 => 3.2296, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -22.89% (1.7609 => 1.3578, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -16.99% (2.9384 => 2.4393, std.dev.: 0.0046) SingleSource/UnitTests/Vector/constpool: -8.98% (54.1659 => 49.3010, std.dev.: 0.0429) MultiSource/Applications/JM/ldecod/ldecod: -7.73% (10.4361 => 9.6298, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: -3.53% (10.3673 => 10.0011, std.dev.: 0.0122) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -54.01% (8.0499 => 3.7018, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0133, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7652, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.61% (0.0506 => 0.0341) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.38% (0.3987 => 0.2696, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.50% (2.9695 => 2.3607, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.99% (1.2258 => 0.9930, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -16.06% (1.6925 => 1.4207, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852) SingleSource/Benchmarks/McGill/chomp: -11.02% (1.2373 => 1.1009, std.dev.: 0.0042) MultiSource/Benchmarks/NPB-serial/is/is: -10.98% (9.5636 => 8.5134, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -10.98% (1.5373 => 1.3685, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.39% (19.9488 => 18.2752, std.dev.: 0.0536) MultiSource/Benchmarks/FreeBench/mason/mason: -7.96% (0.2161 => 0.1989, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.10% (1.8329 => 1.7027, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482) SingleSource/Benchmarks/Misc/oourafft: -5.47% (6.6465 => 6.2831, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.09% (1.6805 => 1.5949, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -4.98% (1.5835 => 1.5047, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.89% (0.2497 => 0.2375, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.84% (8.1563 => 7.8429, std.dev.: 0.0043) MultiSource/Applications/siod/siod: -3.79% (3.2827 => 3.1584, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.52% (32.5116 => 31.3662, std.dev.: 0.0129) MultiSource/Benchmarks/sim/sim: -3.33% (5.0483 => 4.8802, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -2.93% (4.6441 => 4.5080, std.dev.: 0.0057) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.80% (4.5009 => 4.3748, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.70% (0.4808 => 0.4678, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/multiplies: -1.94% (2.5528 => 2.5032, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/salsa20: -1.80% (10.2830 => 10.0981, std.dev.: 0.0127) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6796, std.dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: -1.28% (85.0658 => 83.9800, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.17% (1.7254 => 1.7052, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/lists: -1.05% (6.2999 => 6.2337, std.dev.: 0.0083) MultiSource/Benchmarks/Olden/power/power: -1.01% (1.1277 => 1.1163, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.49% (7.1582 => 7.8376, std.dev.: 0.0084) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: 10636.11% (0.0720 => 7.7300, std.dev.: 0.0116) MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 2.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 28 19:41:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 28 Oct 2012 21:41:14 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121029024114.66D8F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5345?compare_to=5338&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5345, Order: 166902, Start Time: 2012-10-28 23:25:20, End Time: 2012-10-29 02:41:13 To: 5338, Order: 166900, Start Time: 2012-10-28 19:20:49, End Time: 2012-10-28 22:37:13 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (171 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1040 (719 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/UnitTests/ObjC/synchronized: 9.97% (0.1053 => 0.1158, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.14% (124.1648 => 131.7858, std.dev.: 0.1970) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.96% (0.0625 => 0.0881, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.98% (0.1063 => 0.1403, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.73% (0.2969 => 0.3733, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.47% (0.0475 => 0.0596, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.32% (0.1106 => 0.1386, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 24.52% (1.5932 => 1.9839, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.29% (0.4253 => 0.5286, std.dev.: 0.0075) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.09% (0.4139 => 0.5136, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.85% (0.5900 => 0.7307, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.11% (0.0714 => 0.0879, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.11% (0.4994 => 0.6148, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.86% (0.5000 => 0.6143, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.67% (0.0547 => 0.0671, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.60% (0.0584 => 0.0716, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.96% (0.0897 => 0.1094, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.91% (0.1620 => 0.1975, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.65% (0.1021 => 0.1242, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 21.37% (0.0599 => 0.0727) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.32% (0.1107 => 0.1343, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.26% (0.0541 => 0.0656, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.54% (0.0633 => 0.0763, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 20.36% (0.0604 => 0.0727, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 20.36% (0.0948 => 0.1141, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.25% (0.0642 => 0.0772, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 20.10% (0.0821 => 0.0986, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.04% (0.1103 => 0.1324, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.03% (0.0584 => 0.0701, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/05-eks/eks: 19.89% (0.1619 => 0.1941, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.83% (0.0822 => 0.0985, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.78% (0.3903 => 0.4675, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.64% (0.1003 => 0.1200, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.56% (0.1549 => 0.1852, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.45% (0.1604 => 0.1916, std.dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: 18.69% (0.0947 => 0.1124, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.47% (0.1462 => 0.1732, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 18.32% (0.0808 => 0.0956, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 18.18% (0.0605 => 0.0715, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.12% (0.3890 => 0.4595, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.12% (0.2014 => 0.2379, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.98% (1.3152 => 1.5517, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/08-main/main: 17.98% (0.1218 => 0.1437, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 17.92% (0.5826 => 0.6870, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 17.74% (0.5889 => 0.6934, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/09-vor/vor: 17.74% (0.1505 => 0.1772, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 17.52% (0.4029 => 0.4735, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/mst/mst: 17.48% (0.0698 => 0.0820, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.46% (0.1088 => 0.1278, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.36% (0.2736 => 0.3211, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.08% (0.2875 => 0.3366, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.03% (0.2866 => 0.3354, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.00% (3.5627 => 4.1683, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 16.82% (1.8794 => 2.1956, std.dev.: 0.0065) MultiSource/Applications/Burg/burg: 16.80% (0.5546 => 0.6478, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.67% (1.6211 => 1.8913, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 16.62% (0.2725 => 0.3178, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 16.62% (0.2750 => 0.3207, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 16.57% (0.9697 => 1.1304, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 16.54% (0.3004 => 0.3501, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.47% (0.1160 => 0.1351, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hello: 16.43% (0.2714 => 0.3160, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.41% (0.1968 => 0.2291, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.40% (0.4658 => 0.5422, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.36% (0.2738 => 0.3186, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 16.26% (0.1421 => 0.1652, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.20% (0.2729 => 0.3171, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 16.12% (0.2780 => 0.3228, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 16.11% (0.9909 => 1.1505, std.dev.: 0.0033) MultiSource/Applications/d/make_dparser: 16.08% (1.0781 => 1.2515, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.03% (0.3195 => 0.3707, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 16.01% (0.2823 => 0.3275, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/except: 15.97% (0.2811 => 0.3260, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 15.97% (0.1284 => 0.1489, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 15.96% (0.2813 => 0.3262, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.95% (2.7292 => 3.1644, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.94% (0.2792 => 0.3237, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.92% (2.0673 => 2.3964, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.90% (0.3271 => 0.3791, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/random: 15.84% (0.2803 => 0.3247, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.84% (0.5026 => 0.5822, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.80% (0.2911 => 0.3371, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 15.76% (0.3096 => 0.3584, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 15.70% (0.7171 => 0.8297, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.68% (0.4361 => 0.5045, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary3: 15.67% (0.3267 => 0.3779, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.51% (1.9694 => 2.2749, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.51% (4.4195 => 5.1049, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary: 15.50% (0.3258 => 0.3763, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.49% (0.3060 => 0.3534, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 15.47% (0.3317 => 0.3830, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.45% (0.3488 => 0.4027, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.42% (0.3930 => 0.4536, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 15.35% (0.3465 => 0.3997, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.33% (1.9966 => 2.3027, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-2: 15.26% (0.3446 => 0.3972, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 15.22% (4.2109 => 4.8517, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.20% (0.3362 => 0.3873, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 15.17% (0.3442 => 0.3964, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 15.16% (0.3496 => 0.4026) SingleSource/UnitTests/ObjC/exceptions-3: 15.14% (0.3460 => 0.3984, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 15.11% (0.3469 => 0.3993, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 14.81% (0.3348 => 0.3844, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.77% (0.1090 => 0.1251, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.72% (0.3124 => 0.3584, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.67% (0.3845 => 0.4409, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/property: 14.66% (0.3650 => 0.4185, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 14.58% (0.3724 => 0.4267, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 14.57% (0.3678 => 0.4214, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 14.55% (0.3643 => 0.4173, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.53% (0.3282 => 0.3759, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 14.52% (23.5202 => 26.9353, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/hash: 14.45% (0.4146 => 0.4745, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.43% (0.3625 => 0.4148, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 14.22% (0.2075 => 0.2370, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists1: 14.01% (0.3477 => 0.3964, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 13.98% (0.3726 => 0.4247, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 13.94% (1.4269 => 1.6258, std.dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 13.83% (0.2566 => 0.2921, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.79% (0.3690 => 0.4199, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash2: 13.76% (0.4251 => 0.4836, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.69% (0.3981 => 0.4526, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 13.42% (2.1653 => 2.4558, std.dev.: 0.0065) MultiSource/Applications/treecc/treecc: 13.38% (0.7875 => 0.8929, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/bigfib: 13.37% (0.5012 => 0.5682, std.dev.: 0.0034) MultiSource/Applications/JM/lencod/lencod: 13.22% (4.6177 => 5.2282, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 13.03% (2.1013 => 2.3751, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.30% (0.2040 => 0.2291, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 11.89% (0.2691 => 0.3011, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.86% (0.6435 => 0.7198, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 11.72% (5.5417 => 6.1912, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.50% (0.1383 => 0.1542, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 11.01% (0.3498 => 0.3883, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.56% (0.2737 => 0.3026, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.51% (0.1028 => 0.1136, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.44% (0.2068 => 0.2284, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 10.40% (0.6634 => 0.7324, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.38% (0.3084 => 0.3404, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 9.88% (0.4847 => 0.5326, std.dev.: 0.0052) MultiSource/Applications/minisat/minisat: 9.50% (0.3336 => 0.3653, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 9.43% (2.0346 => 2.2265, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: 9.24% (0.2391 => 0.2612, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.84% (0.2103 => 0.2289, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.42% (4.6926 => 5.0876, std.dev.: 0.0141) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.82% (11.6398 => 12.5499, std.dev.: 0.0140) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.42% (0.5361 => 0.5759, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.93% (0.5584 => 0.5971, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.85% (0.7426 => 0.7935, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 6.18% (11.9555 => 12.6949, std.dev.: 0.0192) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.93% (0.3792 => 0.4017, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6533, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.87% (0.1054 => 0.1158, std.dev.: 0.0024) MultiSource/Applications/ClamAV/clamscan: 7.60% (0.2802 => 0.3015, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6111, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: 5.70% (0.2122 => 0.2243, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/objinst: 5.04% (12.0509 => 12.6579, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1672, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-2: 3.90% (1.8057 => 1.8761, std.dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/dry: 2.75% (14.0481 => 14.4347, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1905, std.dev.: 0.0086) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.60% (3.1722 => 3.2229, std.dev.: 0.0045) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3086, std.dev.: 0.0156) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2862, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1062, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5134, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5997, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.34% (2.4764 => 2.4431, std.dev.: 0.0081) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.45% (25.4195 => 16.4088, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary2: -10.62% (0.2402 => 0.2147, std.dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9748, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7760, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/tsp/tsp: -7.18% (2.1113 => 1.9598, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.21% (11.2080 => 10.8480, std.dev.: 0.0266) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7732, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5219, std.dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/fldry: -2.60% (17.2379 => 16.7901, std.dev.: 0.0229) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.20% (41.7953 => 40.8771, std.dev.: 0.0096) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5739, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/bh/bh: -1.55% (5.5810 => 5.4945, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.33% (5.7935 => 5.7164, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.13% (105.3826 => 104.1908, std.dev.: 0.0244) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0428, std.dev.: 0.0021) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.03% (3.3991 => 3.3641, std.dev.: 0.0007) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 28 19:49:14 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 28 Oct 2012 21:49:14 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121029024914.E77C32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5346?compare_to=5342&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5346, Order: 166907, Start Time: 2012-10-29 01:24:45, End Time: 2012-10-29 02:49:14 To: 5342, Order: 166903, Start Time: 2012-10-28 23:43:33, End Time: 2012-10-29 01:07:51 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 14 (98 on baseline) Performance Improvements: 6 (6 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 955 (870 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.24% (0.1126 => 0.1230, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 3.77% (0.2994 => 0.3107, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 3.53% (0.3176 => 0.3288, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.98% (0.6280 => 0.6467, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/gs/gs: 2.92% (4.1748 => 4.2969, std.dev.: 0.0277) MultiSource/Applications/minisat/minisat: 2.88% (0.7025 => 0.7227, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.15% (1.3624 => 1.3917, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.11% (0.8453 => 0.8631, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.89% (0.6387 => 0.6508, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.37% (0.9067 => 0.9191, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.11% (0.9152 => 0.9254, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.03% (1.2614 => 1.2744, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.67% (0.6103 => 0.6205, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 1.27% (1.1110 => 1.1251, std.dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.67% (0.8612 => 0.8468, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.57% (0.8678 => 0.8542, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -1.41% (0.8373 => 0.8255, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.16% (0.8691 => 0.8590, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.11% (0.9378 => 0.9274, std.dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.34% (1.6036 => 1.5821, std.dev.: 0.0069) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.46% (16.6736 => 16.7503, std.dev.: 0.1439) MultiSource/Applications/obsequi/Obsequi: -0.02% (1.0686 => 1.0684, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: -0.79% (0.6488 => 0.6437, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/08-main/main: -3.20% (0.1940 => 0.1878, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.06% (0.1699 => 0.1681, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.97% (0.3196 => 0.3227, std.dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.24% (0.2495 => 0.2464, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.45% (0.3350 => 0.3268, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.98% (0.2351 => 0.2328, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/bigfib: -0.08% (0.6021 => 0.6016, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel: -2.26% (0.0443 => 0.0433, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.12% (0.3322 => 0.3318, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 2.27% (0.1942 => 0.1986, std.dev.: 0.0023) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.83% (0.0241 => 0.0243, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -11.87% (0.0219 => 0.0193, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 22.38% (0.0344 => 0.0421, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 26.44% (0.0261 => 0.0330, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.64% (0.0313 => 0.0311, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 3.47% (0.0404 => 0.0418, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: -1.46% (0.0206 => 0.0203, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -30.84% (0.0214 => 0.0148, std.dev.: 0.0033) SingleSource/UnitTests/byval-alignment: 1.19% (0.0335 => 0.0339, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -91.67% (0.0012 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.48% (0.1445 => 0.1452, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 8.14% (1.1328 => 1.2250, std.dev.: 0.0101) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 2.02% (0.1433 => 0.1462, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.89% (0.4064 => 0.4141, std.dev.: 0.0394) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.73% (0.1364 => 0.1374, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.15% (0.0650 => 0.0651, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0275 => 0.0276, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.77% (0.0530 => 0.0550, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.24% (1.1453 => 1.1425, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 121.43% (0.0014 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.75% (0.0607 => 0.0648, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 27.88% (0.0208 => 0.0266, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.36% (0.8017 => 0.7988, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -75.00% (0.0004 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -41.67% (0.0084 => 0.0049, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.35% (2.1832 => 1.6734, std.dev.: 0.0024) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 36.63% (14.7684 => 20.1777, std.dev.: 0.0905) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.28% (0.0810 => 0.0950, std.dev.: 0.0021) SingleSource/UnitTests/SignlessTypes/rem: 13.82% (0.1035 => 0.1178, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 12.23% (0.1112 => 0.1248, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.72% (0.1157 => 0.1281, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.21% (0.2279 => 0.2466, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.88% (0.8321 => 0.8977, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.60% (0.6010 => 0.6467, std.dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 7.46% (1.2568 => 1.3506, std.dev.: 0.0175) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.75% (0.4847 => 0.5174, std.dev.: 0.0112) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.56% (0.2180 => 0.2323, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.20% (13.1811 => 13.9985, std.dev.: 0.1192) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.15% (0.3137 => 0.3330, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.09% (0.7473 => 0.7928, std.dev.: 0.0139) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.93% (0.8148 => 0.8631, std.dev.: 0.0053) MultiSource/Applications/minisat/minisat: 5.75% (0.6834 => 0.7227, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.74% (0.6287 => 0.6648, std.dev.: 0.0120) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.67% (0.1905 => 0.2013, std.dev.: 0.0034) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.61% (6.6074 => 6.9784, std.dev.: 0.0556) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.40% (0.2240 => 0.2361, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.30% (1.1170 => 1.1762, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.20% (0.2519 => 0.2650, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.14% (0.2741 => 0.2882, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.89% (0.4127 => 0.4329, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.84% (0.2998 => 0.3143, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.80% (1.3279 => 1.3917, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.76% (0.3295 => 0.3452, std.dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 4.74% (1.1271 => 1.1805, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 4.56% (0.8611 => 0.9004, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.51% (0.6227 => 0.6508, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 4.31% (0.8768 => 0.9146, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/bh/bh: 4.09% (0.2985 => 0.3107, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 4.03% (4.1305 => 4.2969, std.dev.: 0.0277) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.98% (1.1606 => 1.2068, std.dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.95% (0.4559 => 0.4739, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.79% (4.4873 => 4.6572, std.dev.: 0.0289) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.69% (0.8316 => 0.8623, std.dev.: 0.0072) MultiSource/Applications/lemon/lemon: 3.63% (1.0945 => 1.1342, std.dev.: 0.0106) MultiSource/Applications/d/make_dparser: 3.50% (3.2366 => 3.3500, std.dev.: 0.0330) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 3.44% (0.8885 => 0.9191, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.39% (0.3800 => 0.3929, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.39% (0.5191 => 0.5367, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 3.34% (14.2605 => 14.7374, std.dev.: 0.1388) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.27% (4.1763 => 4.3128, std.dev.: 0.0275) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.20% (0.8177 => 0.8439, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.20% (0.8697 => 0.8975, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 3.00% (0.9688 => 0.9979, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.97% (8.6476 => 8.9044, std.dev.: 0.0529) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.88% (0.8995 => 0.9254, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.88% (0.9908 => 1.0193, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.87% (0.8007 => 0.8237, std.dev.: 0.0083) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.77% (4.4880 => 4.6125, std.dev.: 0.0355) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.77% (0.9056 => 0.9307, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.76% (0.8359 => 0.8590, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.75% (0.9039 => 0.9288, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.71% (0.7932 => 0.8147, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.61% (0.6586 => 0.6758, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.58% (1.2423 => 1.2744, std.dev.: 0.0036) MultiSource/Applications/JM/ldecod/ldecod: 2.58% (6.7320 => 6.9057, std.dev.: 0.0483) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.57% (0.8317 => 0.8531, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.56% (1.2526 => 1.2847, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.55% (0.8050 => 0.8255, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.54% (0.8805 => 0.9029, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.53% (0.8331 => 0.8542, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.46% (0.8457 => 0.8665, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.45% (0.8066 => 0.8264, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.44% (0.8518 => 0.8726, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.44% (0.8855 => 0.9071, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.41% (0.8204 => 0.8402, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.39% (0.8656 => 0.8863, std.dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: 2.34% (8.6247 => 8.8263, std.dev.: 0.0251) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.34% (0.8086 => 0.8275, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.28% (0.8069 => 0.8253, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.28% (0.8340 => 0.8530, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.28% (3.1832 => 3.2557, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.27% (0.8048 => 0.8231, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.27% (0.8712 => 0.8910, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.27% (0.7966 => 0.8147, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.26% (0.9069 => 0.9274, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.20% (0.8286 => 0.8468, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.17% (0.8927 => 0.9121, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.09% (0.8420 => 0.8596, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.00% (4.5702 => 4.6618, std.dev.: 0.0313) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.91% (2.1401 => 2.1809, std.dev.: 0.0073) MultiSource/Applications/lambda-0_1_3/lambda: 1.81% (0.7557 => 0.7694, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.62% (0.8261 => 0.8395, std.dev.: 0.0041) MultiSource/Benchmarks/PAQ8p/paq8p: 1.60% (2.3764 => 2.4144, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.46% (1.5315 => 1.5538, std.dev.: 0.0067) MultiSource/Benchmarks/Bullet/bullet: 1.10% (31.8598 => 32.2108, std.dev.: 0.0913) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.97% (1.5795 => 2.5109, std.dev.: 0.0043) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.62% (2.4333 => 2.6918, std.dev.: 0.0193) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.67% (0.3186 => 0.3494, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.48% (1.1857 => 1.2862, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 5.94% (63.1822 => 66.9352, std.dev.: 0.0446) MultiSource/Benchmarks/Olden/bh/bh: 2.30% (2.3560 => 2.4103, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/ReedSolomon: 1.75% (8.5322 => 8.6811, std.dev.: 0.0538) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.30% (4.8362 => 4.8990, std.dev.: 0.0209) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.15% (6.3772 => 6.4504, std.dev.: 0.0191) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.16% (0.3269 => 0.3035, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout/heapsort: -4.42% (3.2926 => 3.1471, std.dev.: 0.0427) MultiSource/Applications/lua/lua: -4.23% (29.8330 => 28.5713, std.dev.: 0.1209) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.38% (7.2130 => 7.0413, std.dev.: 0.0561) SingleSource/Benchmarks/Shootout-C++/hash2: -1.49% (3.4237 => 3.3728, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.25% (3.3479 => 3.3061, std.dev.: 0.0043) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 1.85% (16.4461 => 16.7503, std.dev.: 0.1439) MultiSource/Applications/obsequi/Obsequi: 4.11% (1.0262 => 1.0684, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 1.66% (0.6332 => 0.6437, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/08-main/main: 2.57% (0.1831 => 0.1878, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.83% (0.1559 => 0.1681, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.33% (0.3123 => 0.3227, std.dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.04% (0.2463 => 0.2464, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.27% (0.3344 => 0.3268, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.52% (0.2364 => 0.2328, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/bigfib: 0.10% (0.6010 => 0.6016, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel: 0.93% (0.0429 => 0.0433, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.59% (0.3266 => 0.3318, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 0.86% (0.1969 => 0.1986, std.dev.: 0.0023) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.48% (0.0224 => 0.0243, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 56.91% (0.0123 => 0.0193, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.19% (0.0408 => 0.0421, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.98% (0.0302 => 0.0311, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 8.85% (0.0384 => 0.0418, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -17.78% (0.0180 => 0.0148, std.dev.: 0.0033) SingleSource/UnitTests/byval-alignment: 47.39% (0.0230 => 0.0339, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.97% (0.1438 => 0.1452, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 8.13% (1.1329 => 1.2250, std.dev.: 0.0101) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: - (0.1462 => 0.1462, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.55% (0.4164 => 0.4141, std.dev.: 0.0394) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.37% (0.1369 => 0.1374, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.56% (0.0641 => 0.0651, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.54% (0.0195 => 0.0276, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.84% (0.0578 => 0.0550, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.10% (1.1437 => 1.1425, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.35% (0.0627 => 0.0648, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.78% (0.0180 => 0.0266, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.36% (0.8017 => 0.7988, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -20.97% (0.0062 => 0.0049, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 28 20:10:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 28 Oct 2012 22:10:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121029031026.E20C72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5347?compare_to=5343&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5347, Order: 166907, Start Time: 2012-10-29 01:44:54, End Time: 2012-10-29 03:10:24 To: 5343, Order: 166903, Start Time: 2012-10-28 23:56:29, End Time: 2012-10-29 01:21:51 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (7 on baseline) Performance Improvements: 0 (173 on baseline) Unchanged Tests: 1041 (862 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 16.74% (0.3692 => 0.4310, std.dev.: 0.0092) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.36% (15.2527 => 18.3589, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/BoolLiteralTest: 12.42% (0.3834 => 0.4310, std.dev.: 0.0092) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.38% (54.5751 => 56.4220, std.dev.: 0.0527) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.78% (2.0478 => 2.1048, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: 2.50% (7.4937 => 7.6808, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/hash2: 2.29% (3.1932 => 3.2664, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.67% (0.1431 => 0.1307, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.21% (0.1584 => 0.1454, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.30% (0.3821 => 0.3542, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -6.80% (0.3880 => 0.3616, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.78% (0.3142 => 0.2929, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.73% (0.3831 => 0.3573, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/exceptions-3: -6.73% (0.3848 => 0.3589, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -6.72% (0.3812 => 0.3556, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.67% (0.3896 => 0.3636, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.63% (0.3891 => 0.3633, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -6.62% (0.4033 => 0.3766, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -6.59% (2.4924 => 2.3281, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: -6.54% (0.4176 => 0.3903, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.51% (0.3884 => 0.3631, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.36% (22.4056 => 20.9800, std.dev.: 0.0109) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.34% (0.2428 => 0.2274, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: -6.31% (0.4199 => 0.3934, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.29% (0.3658 => 0.3428, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -6.24% (0.4280 => 0.4013, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -6.21% (0.3026 => 0.2838, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -6.16% (0.2989 => 0.2805, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.05% (0.3057 => 0.2872, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.05% (0.3025 => 0.2842, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.03% (0.2903 => 0.2728, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.02% (2.1713 => 2.0406, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -6.00% (0.3016 => 0.2835, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.00% (0.4083 => 0.3838, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.00% (0.3252 => 0.3057, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.99% (5.4682 => 5.1404, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.99% (0.3837 => 0.3607, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: -5.99% (0.2939 => 0.2763, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -5.93% (0.3255 => 0.3062, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -5.93% (0.3205 => 0.3015, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.93% (0.4151 => 0.3905, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.92% (4.5069 => 4.2400, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/fibo: -5.92% (0.2871 => 0.2701, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -5.91% (0.1879 => 0.1768, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: -5.90% (0.2849 => 0.2681, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -5.89% (0.3194 => 0.3006, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -5.86% (1.3148 => 1.2377, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: -5.86% (0.3481 => 0.3277, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: -5.82% (0.4861 => 0.4578, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.81% (0.6484 => 0.6107, std.dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: -5.79% (0.3059 => 0.2882, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -5.78% (0.7779 => 0.7329, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -5.78% (1.2515 => 1.1792, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary3: -5.77% (0.3446 => 0.3247, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: -5.77% (0.3621 => 0.3412, std.dev.: 0.0081) MultiSource/Applications/sgefa/sgefa: -5.75% (0.3357 => 0.3164, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -5.73% (0.3788 => 0.3571, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -5.72% (0.3394 => 0.3200, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: -5.71% (4.3330 => 4.0857, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.69% (0.3323 => 0.3134, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: -5.68% (0.2659 => 0.2508, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.67% (3.5339 => 3.3337, std.dev.: 0.0042) MultiSource/Applications/JM/ldecod/ldecod: -5.64% (7.0961 => 6.6957, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.61% (4.8161 => 4.5457, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: -5.61% (16.1920 => 15.2831, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.61% (0.3849 => 0.3633, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -5.60% (0.2160 => 0.2039, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -5.59% (0.6750 => 0.6373, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.56% (0.4427 => 0.4181, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.56% (0.7919 => 0.7479, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/Hello: -5.55% (0.6347 => 0.5995, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -5.55% (2.4021 => 2.2689, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists1: -5.53% (0.3867 => 0.3653, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.52% (0.5999 => 0.5668, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.51% (0.9852 => 0.9309, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -5.51% (0.6441 => 0.6086, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -5.51% (34.0927 => 32.2155, std.dev.: 0.0166) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.47% (4.8802 => 4.6133, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.46% (0.2548 => 0.2409, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.42% (1.2784 => 1.2091, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.42% (0.9542 => 0.9025, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.40% (1.6474 => 1.5584, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.38% (1.0544 => 0.9977, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.37% (0.4321 => 0.4089, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.33% (1.2221 => 1.1570, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.30% (0.3491 => 0.3306, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.22% (0.2933 => 0.2780, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.21% (0.3931 => 0.3726, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.20% (0.8521 => 0.8078, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -5.19% (0.2985 => 0.2830, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: -5.18% (0.4248 => 0.4028, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.17% (0.4813 => 0.4564, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: -5.16% (18.2933 => 17.3495, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.15% (4.0323 => 3.8247, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.14% (0.2278 => 0.2161, std.dev.: 0.0011) MultiSource/Applications/lua/lua: -5.13% (4.0594 => 3.8510, std.dev.: 0.0109) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.11% (1.2210 => 1.1586, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.06% (2.2587 => 2.1444, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.06% (0.7198 => 0.6834, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.05% (0.2355 => 0.2236, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -4.96% (1.6364 => 1.5552, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: -4.95% (0.4524 => 0.4300, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.88% (1.4642 => 1.3928, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.87% (0.2999 => 0.2853, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -4.85% (9.2283 => 8.7807, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.85% (0.6293 => 0.5988, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.81% (1.3722 => 1.3062, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.79% (0.9557 => 0.9099, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.73% (0.3319 => 0.3162, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: -4.71% (0.7982 => 0.7606, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.57% (0.6230 => 0.5945, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.56% (0.4916 => 0.4692, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: -4.55% (0.3581 => 0.3418, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.53% (0.2385 => 0.2277, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.52% (0.5857 => 0.5592, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.52% (0.6681 => 0.6379, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.50% (0.5802 => 0.5541, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.48% (0.5805 => 0.5545, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.47% (0.5478 => 0.5233, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.46% (0.6297 => 0.6016, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.45% (0.5591 => 0.5342, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.44% (0.6395 => 0.6111, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.44% (0.5925 => 0.5662, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.42% (0.5859 => 0.5600, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.40% (0.7339 => 0.7016, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.40% (0.5570 => 0.5325, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.38% (0.6052 => 0.5787, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.37% (0.5863 => 0.5607, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: -4.36% (0.4515 => 0.4318, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.35% (0.5569 => 0.5327, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -4.34% (0.7447 => 0.7124, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.32% (0.6667 => 0.6379, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.31% (0.6660 => 0.6373, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.30% (0.6676 => 0.6389, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.29% (0.3406 => 0.3260, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.28% (0.6446 => 0.6170, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: -4.28% (0.9179 => 0.8786, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -4.24% (1.1450 => 1.0964, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.23% (0.5575 => 0.5339, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.23% (0.6194 => 0.5932, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.20% (0.6304 => 0.6039, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.16% (0.5581 => 0.5349, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.13% (0.5567 => 0.5337, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.12% (0.5456 => 0.5231, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.11% (0.5688 => 0.5454, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.09% (0.5849 => 0.5610, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: -4.04% (2.1401 => 2.0537, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: -4.04% (0.3271 => 0.3139, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.03% (0.6395 => 0.6137, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -4.03% (0.8418 => 0.8079, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.02% (0.6440 => 0.6181, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.02% (0.7021 => 0.6739, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.01% (0.5941 => 0.5703, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -3.99% (0.6260 => 0.6010, std.dev.: 0.0042) MultiSource/Applications/SPASS/SPASS: -3.99% (15.5079 => 14.8896, std.dev.: 0.0212) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -3.96% (0.6189 => 0.5944, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.95% (0.5168 => 0.4964, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -3.94% (8.0126 => 7.6973, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.92% (0.7524 => 0.7229, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.90% (0.3483 => 0.3347, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.87% (0.9077 => 0.8726, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: -3.82% (17.1032 => 16.4493, std.dev.: 0.0063) MultiSource/Applications/hbd/hbd: -3.82% (1.5610 => 1.5014, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.82% (0.6736 => 0.6479, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: -3.68% (3.5154 => 3.3861, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.67% (6.7716 => 6.5229, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.67% (1.2300 => 1.1849, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.60% (0.5329 => 0.5137, std.dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -3.57% (20.7746 => 20.0324, std.dev.: 0.0298) MultiSource/Applications/oggenc/oggenc: -3.42% (5.0226 => 4.8506, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: -3.12% (1.1530 => 1.1170, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.98% (14.2083 => 13.7850, std.dev.: 0.0062) MultiSource/Applications/SIBsim4/SIBsim4: -1.73% (1.3864 => 1.3624, std.dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7545, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/richards_benchmark: -8.68% (1.2842 => 1.1727, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -4.04% (2.2633 => 2.1718, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7063, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4682, std.dev.: 0.0047) Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 28 20:47:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 28 Oct 2012 22:47:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121029034741.D18A82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5348?compare_to=5344&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5348, Order: 166907, Start Time: 2012-10-29 02:16:35, End Time: 2012-10-29 03:47:40 To: 5344, Order: 166903, Start Time: 2012-10-29 00:15:26, End Time: 2012-10-29 01:46:57 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (10 on baseline) New Passes: 0 (14 on baseline) Performance Regressions: 0 (190 on baseline) Performance Improvements: 1 (55 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 15 (5 on baseline) Unchanged Tests: 1026 (634 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -2.75% (55.9755 => 54.4340, std.dev.: 0.2082) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -0.01% (2.0503 => 2.0501, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -0.02% (58.1315 => 58.1190, std.dev.: 0.0168) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.13% (0.0799 => 0.0800, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -0.04% (9.2595 => 9.2554, std.dev.: 0.0106) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.06% (7.8376 => 7.8328, std.dev.: 0.0043) SingleSource/UnitTests/Vector/SSE/sse_shift: - (0.0537 => 0.0537, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/JM/lencod/lencod: -0.01% (7.7300 => 7.7289, std.dev.: 0.0114) MultiSource/Applications/oggenc/oggenc: - (0.0001 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.01% (0.0648 => 0.0661, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.03% (0.2991 => 0.2992, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_shift: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -64.40% (5.7591 => 2.0501, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -8.10% (63.2438 => 58.1190, std.dev.: 0.0168) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.80% (6.6874 => 0.0800, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.75% (8.1363 => 9.2554, std.dev.: 0.0106) SingleSource/UnitTests/Vector/SSE/sse_shift: 42.06% (0.0378 => 0.0537, std.dev.: 0.0008) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -50.00% (0.0002 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -57.02% (0.6962 => 0.2992, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_shift: -50.00% (0.0002 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 213.35% (0.5229 => 1.6385, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 18.18% (14.9895 => 17.7149, std.dev.: 0.0203) MultiSource/Applications/kimwitu++/kc: 38.30% (14.1553 => 19.5772, std.dev.: 0.0115) MultiSource/Benchmarks/MallocBench/gs/gs: 14.23% (4.1105 => 4.6956, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 33.28% (1.1048 => 1.4725, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 69.77% (3.4629 => 5.8789, std.dev.: 0.0188) SingleSource/Benchmarks/Misc-C++/stepanov_container: 69.27% (0.6222 => 1.0532, std.dev.: 0.0010) New Passes - Execution Time --------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 3836000.00% (0.0001 => 3.8361, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 11144400.00% (0.0001 => 11.1445, std.dev.: 0.0660) MultiSource/Applications/kimwitu++/kc: 50700.00% (0.0001 => 0.0508, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049600.00% (0.0001 => 10.0497, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5484500.00% (0.0001 => 5.4846, std.dev.: 0.0159) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 78.04% (0.0296 => 0.0527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 69.92% (0.0256 => 0.0435, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 61.25% (0.0271 => 0.0437, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 53.09% (0.0243 => 0.0372) SingleSource/Regression/C/sumarray: 44.59% (0.0231 => 0.0334, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 44.43% (1.5859 => 2.2905, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.09% (0.0834 => 0.1185, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/distray/distray: 41.19% (0.1056 => 0.1491, std.dev.: 0.0002) SingleSource/UnitTests/vla: 36.34% (0.0355 => 0.0484, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 35.42% (2.2024 => 2.9825, std.dev.: 0.0143) MultiSource/Benchmarks/FreeBench/neural/neural: 34.04% (0.1463 => 0.1961, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 29.12% (0.1655 => 0.2137, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 28.91% (0.1432 => 0.1846, std.dev.: 0.0002) MultiSource/Benchmarks/llubenchmark/llu: 24.24% (0.0462 => 0.0574, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: 22.47% (0.0485 => 0.0594, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 22.33% (0.5105 => 0.6245, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/rem: 22.29% (0.1144 => 0.1399, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.22% (0.1566 => 0.1914, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 21.09% (0.1555 => 0.1883, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.01% (0.0871 => 0.1054, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 19.84% (0.6675 => 0.7999, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 19.35% (1.3050 => 1.5575, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: 19.27% (3.3354 => 3.9781, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/n-body: 19.17% (0.0746 => 0.0889, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.15% (0.2271 => 0.2706, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.84% (0.5020 => 0.5966, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 18.69% (0.7115 => 0.8445, std.dev.: 0.0137) SingleSource/Benchmarks/CoyoteBench/almabench: 18.63% (0.0730 => 0.0866, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 18.55% (0.1175 => 0.1393, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 18.53% (0.1236 => 0.1465, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 18.52% (0.2554 => 0.3027, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 18.50% (0.1584 => 0.1877, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.27% (0.4615 => 0.5458, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/em3d/em3d: 18.23% (0.1695 => 0.2004, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.21% (0.1510 => 0.1785, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: 18.21% (0.0626 => 0.0740, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.01% (1.5415 => 1.8192, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.93% (0.1032 => 0.1217, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 17.81% (0.4879 => 0.5748, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 17.80% (1.1840 => 1.3947, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.78% (0.0793 => 0.0934, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.58% (0.1337 => 0.1572, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 17.54% (0.0798 => 0.0938, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 17.54% (0.1163 => 0.1367, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 17.44% (0.3177 => 0.3731, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.38% (0.8172 => 0.9592, std.dev.: 0.0041) MultiSource/Applications/sgefa/sgefa: 17.08% (0.3109 => 0.3640, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 17.02% (0.2603 => 0.3046, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.01% (0.6450 => 0.7547, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 16.96% (0.1940 => 0.2269, std.dev.: 0.0013) MultiSource/Applications/aha/aha: 16.94% (0.1151 => 0.1346, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.82% (0.0886 => 0.1035, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 16.81% (22.1758 => 25.9030, std.dev.: 0.0144) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.59% (0.0675 => 0.0787, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.40% (0.3121 => 0.3633, std.dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 16.26% (0.1906 => 0.2216, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 16.11% (1.1642 => 1.3518, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/exptree: 16.09% (0.0814 => 0.0945, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 16.01% (1.0722 => 1.2439, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 15.95% (0.7835 => 0.9085, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.93% (0.9765 => 1.1321, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.91% (0.0842 => 0.0976, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 15.90% (2.0273 => 2.3496, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: 15.65% (0.8921 => 1.0317, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 15.63% (0.1695 => 0.1960, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 15.44% (0.2700 => 0.3117, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 15.43% (0.3423 => 0.3951, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.42% (0.2107 => 0.2432, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.41% (0.2758 => 0.3183, std.dev.: 0.0027) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 15.38% (0.1125 => 0.1298, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 15.33% (0.0672 => 0.0775, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.29% (1.1861 => 1.3675, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 15.24% (1.4186 => 1.6348, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.22% (0.1117 => 0.1287, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.14% (0.1143 => 0.1316) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 15.10% (0.5981 => 0.6884, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 15.03% (0.5860 => 0.6741, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.95% (0.1625 => 0.1868, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 14.93% (0.4299 => 0.4941, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.90% (0.0933 => 0.1072, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.81% (0.0770 => 0.0884, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.78% (0.1062 => 0.1219, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.77% (4.2646 => 4.8946, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.76% (0.0759 => 0.0871, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.74% (0.1330 => 0.1526, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 14.72% (0.7433 => 0.8527, std.dev.: 0.0158) SingleSource/Benchmarks/CoyoteBench/lpbench: 14.53% (0.0929 => 0.1064, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.53% (0.2065 => 0.2365, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 14.48% (3.8723 => 4.4332, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.38% (0.1029 => 0.1177, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 14.26% (0.3387 => 0.3870, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 14.21% (0.3441 => 0.3930, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.18% (0.3307 => 0.3776, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.11% (0.0730 => 0.0833, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.77% (0.0770 => 0.0876, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.74% (0.5569 => 0.6334, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 13.70% (9.4845 => 10.7840, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/health/health: 13.49% (0.1268 => 0.1439, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.25% (0.0838 => 0.0949, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.09% (0.3826 => 0.4327, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 13.03% (0.3092 => 0.3495, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 12.77% (0.3180 => 0.3586, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 12.17% (0.0953 => 0.1069, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.16% (0.1892 => 0.2122, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 12.16% (2.2969 => 2.5761, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.82% (14.3668 => 16.0649, std.dev.: 0.0146) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.70% (0.8101 => 0.9049, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 11.54% (0.4620 => 0.5153) SingleSource/Benchmarks/Misc-C++/bigfib: 11.51% (0.6456 => 0.7199, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.50% (4.9449 => 5.5138, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 11.49% (0.1044 => 0.1164, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.49% (5.0018 => 5.5765, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 11.30% (17.1811 => 19.1226, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/hash: 11.10% (0.4289 => 0.4765, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.03% (0.3427 => 0.3805, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists: 10.78% (0.3422 => 0.3791, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.49% (2.2022 => 2.4332, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.48% (0.4636 => 0.5122, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 10.47% (0.3927 => 0.4338, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.23% (0.4203 => 0.4633, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.22% (0.3473 => 0.3828, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.19% (0.3828 => 0.4218, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.14% (0.3865 => 0.4257, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.08% (0.3543 => 0.3900, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.07% (0.3497 => 0.3849, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 10.05% (0.3543 => 0.3899, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.99% (0.3694 => 0.4063, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.97% (0.3561 => 0.3916, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.87% (0.3516 => 0.3863, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 9.83% (0.3886 => 0.4268, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 9.79% (1.5603 => 1.7131, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/moments: 9.76% (0.4048 => 0.4443, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/lists1: 9.74% (0.3684 => 0.4043, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.62% (0.2266 => 0.2484, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.53% (3.8922 => 4.2630, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.51% (0.4103 => 0.4493, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.42% (0.2430 => 0.2659, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 9.10% (0.3603 => 0.3931, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 9.00% (0.7326 => 0.7985, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 8.81% (0.5925 => 0.6447, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.76% (0.6030 => 0.6558, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.66% (0.4064 => 0.4416, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 8.32% (0.3282 => 0.3555, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.25% (0.3650 => 0.3951, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 8.20% (0.3098 => 0.3352, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.13% (0.2793 => 0.3020, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 7.89% (0.3283 => 0.3542, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 7.81% (0.2831 => 0.3052, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.75% (0.3162 => 0.3407, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 7.75% (0.2905 => 0.3130, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.59% (0.2872 => 0.3090, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 7.49% (0.3232 => 0.3474, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.49% (0.8067 => 0.8671, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.40% (0.2891 => 0.3105, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.19% (2.0665 => 2.2151, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 7.14% (0.3052 => 0.3270, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 7.00% (0.2871 => 0.3072, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.99% (0.2877 => 0.3078, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 6.98% (1.2842 => 1.3738, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/fibo: 6.97% (0.2725 => 0.2915, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.86% (0.2756 => 0.2945, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 6.82% (0.2714 => 0.2899, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 6.72% (0.3379 => 0.3606, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 6.57% (0.2802 => 0.2986, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 6.05% (0.2049 => 0.2173, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.55% (0.3136 => 0.3310, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.51% (7.9617 => 8.4004, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/objinst: 5.24% (0.3131 => 0.3295, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.99% (0.3935 => 0.4092, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.11% (7.0540 => 7.2737, std.dev.: 0.0080) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3124, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.10% (1.1145 => 1.3719, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 10.35% (0.9957 => 1.0988, std.dev.: 0.0171) SingleSource/Benchmarks/Misc/richards_benchmark: 9.82% (1.1396 => 1.2515, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.95% (2.8904 => 3.0913) SingleSource/Benchmarks/Shootout-C++/hash2: 6.62% (3.1578 => 3.3667, std.dev.: 0.0032) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: 4.50% (3.3453 => 3.4960) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 2.97% (1.9405 => 1.9981, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.73% (4.2280 => 4.3436, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 2.35% (4.4649 => 4.5699, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/bisort/bisort: 1.78% (0.8333 => 0.8481, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2077, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.43% (9.1159 => 9.2466, std.dev.: 0.0114) MultiSource/Benchmarks/nbench/nbench: 1.30% (11.6436 => 11.7950, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -76.65% (0.8651 => 0.2020, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.24% (5.3855 => 2.4107, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -54.89% (5.3526 => 2.4143, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: -44.82% (0.1622 => 0.0895, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -38.99% (1.1194 => 0.6830, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.72% (5.2763 => 3.2333, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -22.90% (1.7609 => 1.3577, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -16.97% (2.9384 => 2.4398, std.dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -8.90% (54.1659 => 49.3475, std.dev.: 0.0072) MultiSource/Applications/JM/ldecod/ldecod: -7.70% (10.4361 => 9.6327, std.dev.: 0.0069) MultiSource/Benchmarks/PAQ8p/paq8p: -3.49% (10.3673 => 10.0057, std.dev.: 0.0122) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -54.03% (8.0499 => 3.7007, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0133, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.46% (1.1492 => 0.7647, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.61% (0.0506 => 0.0341) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.36% (0.3987 => 0.2697) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.51% (2.9695 => 2.3605, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -19.00% (1.2258 => 0.9929) SingleSource/Benchmarks/Misc/flops-6: -15.73% (1.6925 => 1.4263, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.53% (0.0998 => 0.0853, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -11.28% (1.2373 => 1.0977, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -10.99% (1.5373 => 1.3683, std.dev.: 0.0038) MultiSource/Benchmarks/NPB-serial/is/is: -10.99% (9.5636 => 8.5128, std.dev.: 0.0094) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.26% (19.9488 => 18.3001, std.dev.: 0.0184) MultiSource/Benchmarks/FreeBench/mason/mason: -7.77% (0.2161 => 0.1993, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.02% (1.8329 => 1.7043, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -5.46% (6.6465 => 6.2838, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.08% (1.6805 => 1.5951, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.89% (0.2497 => 0.2375, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.88% (1.5835 => 1.5063, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.79% (1.5660 => 1.4910, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.88% (8.1563 => 7.8400, std.dev.: 0.0063) MultiSource/Applications/siod/siod: -3.76% (3.2827 => 3.1593, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.52% (32.5116 => 31.3673, std.dev.: 0.0053) MultiSource/Benchmarks/sim/sim: -3.33% (5.0483 => 4.8803, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: -2.92% (4.6441 => 4.5086, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.83% (4.5009 => 4.3736, std.dev.: 0.0020) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.81% (0.4808 => 0.4673, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.98% (2.5528 => 2.5023, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6836, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -1.69% (10.2830 => 10.1094, std.dev.: 0.0052) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (85.0658 => 83.9825, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.17% (1.7254 => 1.7052, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.15% (6.2999 => 6.2275, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8567, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/power/power: -1.01% (1.1277 => 1.1163, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.42% (7.1582 => 7.8328, std.dev.: 0.0043) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: 10634.58% (0.0720 => 7.7289, std.dev.: 0.0114) MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.76% (0.2116 => 0.0661, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 2.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 28 21:30:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 28 Oct 2012 23:30:40 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121029043040.0CAC92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5349?compare_to=5346&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5349, Order: 166909, Start Time: 2012-10-29 03:06:11, End Time: 2012-10-29 04:30:39 To: 5346, Order: 166907, Start Time: 2012-10-29 01:24:45, End Time: 2012-10-29 02:49:14 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 4 (100 on baseline) Performance Improvements: 5 (5 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 966 (869 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/spiff/spiff: 4.02% (0.8183 => 0.8512, std.dev.: 0.0044) MultiSource/Applications/Burg/burg: 3.10% (1.2659 => 1.3051, std.dev.: 0.0023) MultiSource/Applications/treecc/treecc: 1.24% (2.0693 => 2.0949, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.21% (1.5821 => 1.6013, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.94% (4.6572 => 4.5668, std.dev.: 0.0292) MultiSource/Applications/minisat/minisat: -1.94% (0.7227 => 0.7087, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.37% (0.9191 => 0.9065, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -2.07% (0.6756 => 0.6616, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -1.15% (22.4118 => 22.1545, std.dev.: 0.0422) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.50% (16.7503 => 16.6661, std.dev.: 0.0917) MultiSource/Applications/obsequi/Obsequi: 0.91% (1.0684 => 1.0781, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: 0.99% (0.6437 => 0.6501, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/08-main/main: 0.27% (0.1878 => 0.1883, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.48% (0.1681 => 0.1689, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.56% (0.3227 => 0.3245, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.41% (0.2464 => 0.2454, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.71% (0.3268 => 0.3324, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.47% (0.2328 => 0.2317, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/bigfib: -0.02% (0.6016 => 0.6015, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel: -1.39% (0.0433 => 0.0427, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.33% (0.3318 => 0.3329, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/strcat: 1.06% (0.1986 => 0.2007, std.dev.: 0.0025) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.41% (0.0243 => 0.0244, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.55% (0.0193 => 0.0196, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -16.39% (0.0421 => 0.0352, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -5.45% (0.0330 => 0.0312, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.96% (0.0311 => 0.0314, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -16.75% (0.0418 => 0.0348, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/casts: 0.49% (0.0203 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 5.41% (0.0148 => 0.0156, std.dev.: 0.0029) SingleSource/UnitTests/byval-alignment: -2.36% (0.0339 => 0.0331, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 0.28% (0.1452 => 0.1456, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -8.11% (1.2250 => 1.1256, std.dev.: 0.0407) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 2.87% (0.1462 => 0.1504, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.54% (0.4141 => 0.4036, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.69% (0.1374 => 0.1337, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -12.50% (0.0008 => 0.0007, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.60% (0.0651 => 0.0595, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -31.88% (0.0276 => 0.0188, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.64% (0.0550 => 0.0570, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.26% (1.1425 => 1.1455, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -19.35% (0.0031 => 0.0025, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -88.89% (0.0027 => 0.0003, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.31% (0.0648 => 0.0633, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -35.71% (0.0266 => 0.0171, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.39% (0.7988 => 0.8019, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 2.04% (0.0049 => 0.0050, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.87% (2.1832 => 1.6620, std.dev.: 0.0052) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 36.41% (14.7684 => 20.1463, std.dev.: 0.1029) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.91% (0.0810 => 0.0947, std.dev.: 0.0039) SingleSource/UnitTests/SignlessTypes/rem: 15.17% (0.1035 => 0.1192, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.22% (0.0830 => 0.0948, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 12.68% (0.1112 => 0.1253, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.15% (0.0848 => 0.0951, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.18% (0.3137 => 0.3425, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.05% (0.1425 => 0.1554, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.65% (0.6010 => 0.6530, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.80% (0.2180 => 0.2350, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.67% (0.4847 => 0.5219, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/em3d/em3d: 7.50% (0.1721 => 0.1850, std.dev.: 0.0028) MultiSource/Applications/SIBsim4/SIBsim4: 7.22% (1.2568 => 1.3475, std.dev.: 0.0108) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.16% (0.8321 => 0.8917, std.dev.: 0.0150) MultiSource/Applications/spiff/spiff: 7.07% (0.7950 => 0.8512, std.dev.: 0.0044) MultiSource/Applications/Burg/burg: 6.78% (1.2222 => 1.3051, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.50% (0.7473 => 0.7959, std.dev.: 0.0142) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.47% (0.8148 => 0.8675, std.dev.: 0.0095) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.33% (1.1170 => 1.1877, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.88% (13.1811 => 13.9560, std.dev.: 0.0122) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.58% (6.6074 => 6.9764, std.dev.: 0.0198) MultiSource/Benchmarks/nbench/nbench: 5.44% (1.1271 => 1.1884, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.38% (0.9435 => 0.9943, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.31% (0.2279 => 0.2400, std.dev.: 0.0041) MultiSource/Applications/treecc/treecc: 5.02% (1.9948 => 2.0949, std.dev.: 0.0060) MultiSource/Applications/hbd/hbd: 5.00% (1.4269 => 1.4983, std.dev.: 0.0227) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.00% (0.3003 => 0.3153, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.80% (0.5961 => 0.6247, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.78% (1.1685 => 1.2243, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.74% (0.2998 => 0.3140, std.dev.: 0.0041) MultiSource/Applications/d/make_dparser: 4.66% (3.2366 => 3.3875, std.dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.56% (0.4127 => 0.4315, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.55% (0.3295 => 0.3445, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.45% (1.6386 => 1.7115, std.dev.: 0.0077) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.33% (0.2519 => 0.2628, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.28% (0.4559 => 0.4754, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 4.08% (14.2605 => 14.8426, std.dev.: 0.1692) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.90% (0.2741 => 0.2848, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.75% (0.6287 => 0.6523, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.75% (1.1606 => 1.2041, std.dev.: 0.0146) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.74% (0.6227 => 0.6460, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.72% (0.3115 => 0.3231, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.71% (0.3717 => 0.3855, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 3.70% (0.6834 => 0.7087, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/football/football: 3.60% (0.8768 => 0.9084, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.60% (0.5191 => 0.5378, std.dev.: 0.0030) MultiSource/Applications/lua/lua: 3.54% (3.8189 => 3.9541, std.dev.: 0.0336) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.41% (8.6476 => 8.9429, std.dev.: 0.0670) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.39% (0.5817 => 0.6014, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.35% (1.3279 => 1.3724, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.30% (0.8420 => 0.8698, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.30% (0.8697 => 0.8984, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.17% (0.8611 => 0.8884, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 3.15% (0.8927 => 0.9208, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.14% (1.5315 => 1.5796, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.13% (0.8316 => 0.8576, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/gs/gs: 2.92% (4.1305 => 4.2511, std.dev.: 0.0385) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.92% (0.9056 => 0.9320, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.87% (0.8007 => 0.8237, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.87% (4.1763 => 4.2960, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.81% (0.8457 => 0.8695, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 2.74% (0.4125 => 0.4238, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.73% (0.8317 => 0.8544, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.72% (0.6586 => 0.6765, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.69% (0.8261 => 0.8483, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 2.68% (8.6247 => 8.8555, std.dev.: 0.0865) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.68% (0.8597 => 0.8827, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.66% (0.9688 => 0.9946, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.66% (0.8716 => 0.8948, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.62% (0.8331 => 0.8549, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.55% (0.8712 => 0.8934, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.54% (0.8359 => 0.8571, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.53% (0.9074 => 0.9304, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.52% (0.8066 => 0.8269, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.49% (0.7966 => 0.8164, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.44% (0.8286 => 0.8488, std.dev.: 0.0077) MultiSource/Applications/siod/siod: 2.41% (2.2184 => 2.2719, std.dev.: 0.0166) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.37% (0.8340 => 0.8538, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.36% (0.7932 => 0.8119, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.32% (0.8656 => 0.8857, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.32% (0.8069 => 0.8256, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.30% (0.8338 => 0.8530, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.30% (0.9039 => 0.9247, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.27% (0.8204 => 0.8390, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.26% (0.8177 => 0.8362, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.24% (0.8518 => 0.8709, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.13% (4.4880 => 4.5836, std.dev.: 0.0250) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.10% (0.8048 => 0.8217, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.07% (0.8995 => 0.9181, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.03% (0.8885 => 0.9065, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.77% (4.4873 => 4.5668, std.dev.: 0.0292) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.60% (1.2423 => 1.2622, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.48% (1.1857 => 1.2862, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 6.00% (63.1822 => 66.9717, std.dev.: 0.0580) SingleSource/Benchmarks/Misc/ReedSolomon: 2.86% (8.5322 => 8.7763, std.dev.: 0.0407) MultiSource/Applications/siod/siod: 2.70% (3.6643 => 3.7633, std.dev.: 0.0088) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.24% (2.4490 => 2.5039, std.dev.: 0.0101) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.18% (44.5605 => 45.5325, std.dev.: 0.3525) MultiSource/Benchmarks/Olden/bh/bh: 1.51% (2.3560 => 2.3916, std.dev.: 0.0138) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.21% (4.8362 => 4.8949, std.dev.: 0.0114) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.15% (0.3269 => 0.2970, std.dev.: 0.0039) MultiSource/Applications/lua/lua: -5.05% (29.8330 => 28.3265, std.dev.: 0.0648) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.44% (7.2130 => 6.8930, std.dev.: 0.1056) SingleSource/Benchmarks/Shootout-C++/hash2: -1.55% (3.4237 => 3.3708, std.dev.: 0.0138) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.25% (3.3479 => 3.3059, std.dev.: 0.0018) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 1.34% (16.4461 => 16.6661, std.dev.: 0.0917) MultiSource/Applications/obsequi/Obsequi: 5.06% (1.0262 => 1.0781, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: 2.67% (0.6332 => 0.6501, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/08-main/main: 2.84% (0.1831 => 0.1883, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 8.34% (0.1559 => 0.1689, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.91% (0.3123 => 0.3245, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.37% (0.2463 => 0.2454, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.60% (0.3344 => 0.3324, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.99% (0.2364 => 0.2317, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/bigfib: 0.08% (0.6010 => 0.6015, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel: -0.47% (0.0429 => 0.0427, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.93% (0.3266 => 0.3329, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/strcat: 1.93% (0.1969 => 0.2007, std.dev.: 0.0025) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.93% (0.0224 => 0.0244, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 59.35% (0.0123 => 0.0196, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -13.73% (0.0408 => 0.0352, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 22.83% (0.0254 => 0.0312, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -9.37% (0.0384 => 0.0348, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -13.33% (0.0180 => 0.0156, std.dev.: 0.0029) SingleSource/UnitTests/byval-alignment: 43.91% (0.0230 => 0.0331, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 1.25% (0.1438 => 0.1456, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.64% (1.1329 => 1.1256, std.dev.: 0.0407) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 2.87% (0.1462 => 0.1504, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.07% (0.4164 => 0.4036, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.34% (0.1369 => 0.1337, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -12.50% (0.0008 => 0.0007, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.18% (0.0641 => 0.0595, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.59% (0.0195 => 0.0188, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.38% (0.0578 => 0.0570, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.16% (1.1437 => 1.1455, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2400.00% (0.0001 => 0.0025, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -78.57% (0.0014 => 0.0003, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.96% (0.0627 => 0.0633, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.00% (0.0180 => 0.0171, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.02% (0.8017 => 0.8019, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -19.35% (0.0062 => 0.0050, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 28 21:58:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 28 Oct 2012 23:58:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121029045855.E91D42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5350?compare_to=5347&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5350, Order: 166909, Start Time: 2012-10-29 03:33:31, End Time: 2012-10-29 04:58:54 To: 5347, Order: 166907, Start Time: 2012-10-29 01:44:54, End Time: 2012-10-29 03:10:24 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 0 (175 on baseline) Unchanged Tests: 1041 (861 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.14% (1.1461 => 1.1592, std.dev.: 0.0011) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.28% (15.2527 => 18.3456, std.dev.: 0.0136) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.76% (54.5751 => 56.6292, std.dev.: 0.1006) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.95% (2.0478 => 2.1082, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: 2.45% (7.4937 => 7.6774, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/hash2: 2.34% (3.1932 => 3.2679, std.dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.67% (0.1431 => 0.1307, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.33% (0.1584 => 0.1452, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.22% (0.3821 => 0.3545, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -6.76% (0.3831 => 0.3572, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: -6.75% (0.3880 => 0.3618, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.75% (0.3142 => 0.2930, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -6.72% (0.3812 => 0.3556, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -6.67% (0.3896 => 0.3636, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.67% (0.3884 => 0.3625, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -6.65% (0.3848 => 0.3592, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.63% (0.3891 => 0.3633, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -6.60% (0.4033 => 0.3767, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.59% (0.2428 => 0.2268, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -6.58% (2.4924 => 2.3283, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: -6.56% (0.4176 => 0.3902, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -6.36% (0.4199 => 0.3932, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.34% (22.4056 => 20.9862, std.dev.: 0.0072) SingleSource/UnitTests/ObjC/parameter-passing: -6.31% (0.4280 => 0.4010, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -6.22% (0.2989 => 0.2803, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -6.21% (0.3026 => 0.2838, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -6.15% (0.3025 => 0.2839, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.04% (2.1713 => 2.0402, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.03% (0.2903 => 0.2728, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.02% (5.4682 => 5.1391, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.99% (0.3658 => 0.3439, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.97% (4.5069 => 4.2379, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/hello: -5.97% (0.2849 => 0.2679, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.95% (0.4151 => 0.3904, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: -5.95% (0.3194 => 0.3004, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.92% (0.3057 => 0.2876, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -5.92% (0.2939 => 0.2765, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: -5.91% (1.3148 => 1.2371, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.90% (0.3252 => 0.3060, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.90% (0.4083 => 0.3842, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: -5.90% (0.3357 => 0.3159, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: -5.89% (0.2871 => 0.2702, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -5.87% (0.3205 => 0.3017, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.84% (0.3016 => 0.2840, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -5.83% (0.3481 => 0.3278, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -5.82% (0.4861 => 0.4578, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -5.81% (0.7779 => 0.7327, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -5.81% (0.3255 => 0.3066, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -5.80% (0.3446 => 0.3246, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -5.80% (0.1879 => 0.1770, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -5.79% (0.3059 => 0.2882, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.73% (0.2355 => 0.2220, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.72% (0.6484 => 0.6113, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: -5.72% (0.3394 => 0.3200, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -5.70% (0.3788 => 0.3572, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -5.68% (7.0961 => 6.6930, std.dev.: 0.0142) MultiSource/Benchmarks/MallocBench/gs/gs: -5.68% (4.3330 => 4.0871, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.67% (0.9542 => 0.9001, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.66% (0.3849 => 0.3631, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: -5.60% (1.2515 => 1.1814, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.59% (4.8161 => 4.5468, std.dev.: 0.0071) MultiSource/Applications/JM/lencod/lencod: -5.59% (16.1920 => 15.2874, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.58% (3.5339 => 3.3366, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.57% (0.2548 => 0.2406, std.dev.: 0.0011) MultiSource/Applications/siod/siod: -5.57% (2.4021 => 2.2684, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -5.56% (0.2160 => 0.2040, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -5.53% (0.3867 => 0.3653, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -5.53% (0.6347 => 0.5996, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -5.53% (0.6441 => 0.6085, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -5.53% (0.6750 => 0.6377, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: -5.52% (0.3621 => 0.3421, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.52% (4.8802 => 4.6109, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.48% (0.9852 => 0.9312, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.47% (1.0544 => 0.9967, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.45% (1.2784 => 1.2087, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.44% (0.4427 => 0.4186, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -5.42% (34.0927 => 32.2436, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.42% (0.4321 => 0.4087, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.32% (1.6474 => 1.5598, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.28% (0.7919 => 0.7501, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.27% (0.3491 => 0.3307, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.26% (0.4813 => 0.4560, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -5.25% (0.4248 => 0.4025, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.22% (0.2933 => 0.2780, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.20% (1.2221 => 1.1585, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.19% (0.8521 => 0.8079, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.19% (0.3837 => 0.3638, std.dev.: 0.0075) MultiSource/Applications/lua/lua: -5.18% (4.0594 => 3.8492, std.dev.: 0.0063) MultiSource/Applications/kimwitu++/kc: -5.17% (18.2933 => 17.3471, std.dev.: 0.0219) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.16% (1.2210 => 1.1580, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.15% (0.3323 => 0.3152, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.08% (1.6364 => 1.5533, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.05% (4.0323 => 3.8288, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.04% (0.3931 => 0.3733, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.00% (0.7198 => 0.6838, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: -5.00% (0.4524 => 0.4298, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.94% (0.6293 => 0.5982, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.93% (0.5999 => 0.5703, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.93% (2.2587 => 2.1474, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/bh/bh: -4.86% (0.2985 => 0.2840, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -4.85% (0.7982 => 0.7595, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.84% (1.4642 => 1.3933, std.dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: -4.79% (9.2283 => 8.7861, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.77% (0.9557 => 0.9101, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.74% (0.6230 => 0.5935, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.67% (0.5591 => 0.5330, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.65% (0.2278 => 0.2172, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.64% (0.5478 => 0.5224, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.61% (1.3722 => 1.3089, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.60% (0.4916 => 0.4690, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.53% (0.2385 => 0.2277, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.51% (0.7339 => 0.7008, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.49% (0.6297 => 0.6014, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.49% (0.5863 => 0.5600, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.45% (0.6681 => 0.6384, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.44% (0.6052 => 0.5783, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: -4.44% (0.3581 => 0.3422, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.44% (0.6667 => 0.6371, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.44% (0.5857 => 0.5597, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -4.43% (0.4515 => 0.4315, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.42% (0.6676 => 0.6381, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.38% (0.5805 => 0.5551, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.36% (0.6194 => 0.5924, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.35% (0.6304 => 0.6030, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.33% (0.5802 => 0.5551, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.31% (0.5705 => 0.5459, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.31% (0.5570 => 0.5330, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.31% (0.5456 => 0.5221, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.30% (0.5859 => 0.5607, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.29% (0.5569 => 0.5330, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.29% (0.5925 => 0.5671, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.27% (0.6395 => 0.6122, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.27% (0.2999 => 0.2871, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.27% (0.6189 => 0.5925, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.26% (0.5581 => 0.5343, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -4.26% (1.1450 => 1.0962, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -4.26% (0.7447 => 0.7130, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.25% (0.6260 => 0.5994, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: -4.20% (2.1401 => 2.0503, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.18% (0.6440 => 0.6171, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -4.17% (0.3406 => 0.3264, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.16% (0.5575 => 0.5343, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.16% (0.6660 => 0.6383, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.13% (0.5567 => 0.5337, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.13% (0.3319 => 0.3182, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.13% (0.6446 => 0.6180, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.11% (0.5941 => 0.5697, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.11% (0.7524 => 0.7215, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: -4.10% (0.3271 => 0.3137, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.03% (0.6395 => 0.6137, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.03% (0.6033 => 0.5790, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.02% (8.0126 => 7.6908, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.00% (0.7021 => 0.6740, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.00% (0.9077 => 0.8714, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: -3.97% (0.8418 => 0.8084, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: -3.95% (0.9179 => 0.8816, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -3.95% (15.5079 => 14.8952, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -3.95% (0.5849 => 0.5618, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: -3.89% (1.5610 => 1.5002, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.88% (0.3483 => 0.3348, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.87% (0.5168 => 0.4968, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -3.86% (17.1032 => 16.4433, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.76% (6.7716 => 6.5168, std.dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -3.66% (20.7746 => 20.0143, std.dev.: 0.0207) MultiSource/Applications/d/make_dparser: -3.62% (3.5154 => 3.3883, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.57% (1.2300 => 1.1861, std.dev.: 0.0079) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.56% (0.6736 => 0.6496, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.55% (0.5329 => 0.5140, std.dev.: 0.0032) MultiSource/Applications/oggenc/oggenc: -3.36% (5.0226 => 4.8538, std.dev.: 0.0110) MultiSource/Benchmarks/nbench/nbench: -3.23% (1.1530 => 1.1158, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.09% (14.2083 => 13.7698, std.dev.: 0.0136) MultiSource/Applications/SIBsim4/SIBsim4: -1.72% (1.3864 => 1.3625, std.dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7511, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/richards_benchmark: -8.73% (1.2842 => 1.1721, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.87% (2.2633 => 2.1758, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.12% (1.3096 => 1.2688, std.dev.: 0.0090) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.00% (1.0557 => 1.0240, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4684, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Report Time: 1.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 28 22:48:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 00:48:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121029054841.464992A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5351?compare_to=5348&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5351, Order: 166909, Start Time: 2012-10-29 04:17:10, End Time: 2012-10-29 05:48:40 To: 5348, Order: 166907, Start Time: 2012-10-29 02:16:35, End Time: 2012-10-29 03:47:40 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (10 on baseline) New Passes: 0 (14 on baseline) Performance Regressions: 2 (191 on baseline) Performance Improvements: 0 (54 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 15 (5 on baseline) Unchanged Tests: 1025 (634 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 4.85% (0.4126 => 0.4326, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.65% (54.4340 => 56.4233, std.dev.: 0.1563) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: 0.01% (2.0501 => 2.0504, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: 0.04% (58.1190 => 58.1441, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0800 => 0.0800, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 0.02% (9.2554 => 9.2577, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.01% (7.8328 => 7.8324, std.dev.: 0.0025) SingleSource/UnitTests/Vector/SSE/sse_shift: -3.72% (0.0537 => 0.0517, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/JM/lencod/lencod: 0.01% (7.7289 => 7.7297, std.dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: - (0.0001 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.12% (0.0661 => 0.0647, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.07% (0.2992 => 0.2990, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_shift: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -64.40% (5.7591 => 2.0504, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: -8.06% (63.2438 => 58.1441, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.80% (6.6874 => 0.0800, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.78% (8.1363 => 9.2577, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_shift: 36.77% (0.0378 => 0.0517, std.dev.: 0.0012) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -50.00% (0.0002 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -57.05% (0.6962 => 0.2990, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_shift: -50.00% (0.0002 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 213.48% (0.5229 => 1.6392, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 18.22% (14.9895 => 17.7212, std.dev.: 0.0062) MultiSource/Applications/kimwitu++/kc: 38.29% (14.1553 => 19.5760, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/gs/gs: 14.36% (4.1105 => 4.7008, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 33.37% (1.1048 => 1.4735, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 69.85% (3.4629 => 5.8819, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_container: 69.27% (0.6222 => 1.0532, std.dev.: 0.0011) New Passes - Execution Time --------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 3838200.00% (0.0001 => 3.8383, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 11157400.00% (0.0001 => 11.1575, std.dev.: 0.0581) MultiSource/Applications/kimwitu++/kc: 50400.00% (0.0001 => 0.0505, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049800.00% (0.0001 => 10.0499, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5489200.00% (0.0001 => 5.4893, std.dev.: 0.0039) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 78.04% (0.0296 => 0.0527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 69.92% (0.0256 => 0.0435, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 61.25% (0.0271 => 0.0437, std.dev.: 0.0009) SingleSource/Regression/C/sumarraymalloc: 53.09% (0.0243 => 0.0372, std.dev.: 0.0000) SingleSource/Regression/C/sumarray: 51.95% (0.0231 => 0.0351, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 44.62% (1.5859 => 2.2935, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.97% (0.0834 => 0.1184, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 41.00% (0.1056 => 0.1489, std.dev.: 0.0005) SingleSource/UnitTests/vla: 36.06% (0.0355 => 0.0483, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 35.74% (2.2024 => 2.9896, std.dev.: 0.0143) MultiSource/Benchmarks/FreeBench/neural/neural: 34.31% (0.1463 => 0.1965, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 29.79% (0.1655 => 0.2148, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 28.98% (0.1432 => 0.1847, std.dev.: 0.0004) MultiSource/Benchmarks/llubenchmark/llu: 24.24% (0.0462 => 0.0574, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: 22.89% (0.0485 => 0.0596, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 22.43% (0.5105 => 0.6250, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 22.38% (0.1144 => 0.1400, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.22% (0.1566 => 0.1914, std.dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.13% (0.0871 => 0.1055, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 21.09% (0.1555 => 0.1883, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 19.87% (0.6675 => 0.8001, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 19.56% (1.3050 => 1.5603, std.dev.: 0.0013) MultiSource/Applications/d/make_dparser: 19.35% (3.3354 => 3.9807, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/mst/mst: 19.26% (0.1163 => 0.1387, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 19.17% (0.0746 => 0.0889, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.07% (0.2271 => 0.2704, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 19.06% (0.5020 => 0.5977, std.dev.: 0.0032) MultiSource/Applications/minisat/minisat: 18.82% (0.7115 => 0.8454, std.dev.: 0.0049) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 18.69% (0.1584 => 0.1880, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 18.64% (0.2554 => 0.3030, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 18.63% (0.0730 => 0.0866, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 18.47% (0.1175 => 0.1392, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 18.45% (0.1236 => 0.1464, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 18.37% (0.0626 => 0.0741, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.27% (0.4615 => 0.5458, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.15% (0.1510 => 0.1784, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 18.12% (0.1032 => 0.1219, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 17.99% (0.1695 => 0.2000, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.97% (1.5415 => 1.8185, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 17.89% (0.4879 => 0.5752, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 17.89% (1.1840 => 1.3958, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.80% (0.1337 => 0.1575, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 17.47% (0.3177 => 0.3732, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.40% (0.0793 => 0.0931, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 17.18% (0.3109 => 0.3643, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.09% (0.8172 => 0.9569, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 16.98% (0.2603 => 0.3045, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.93% (0.6450 => 0.7542, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 16.86% (0.1940 => 0.2267, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 16.84% (22.1758 => 25.9105, std.dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 16.68% (0.1906 => 0.2224, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 16.68% (0.1151 => 0.1343, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.59% (0.0886 => 0.1033, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.50% (0.3121 => 0.3636, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.44% (0.0675 => 0.0786, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/exptree: 16.34% (0.0814 => 0.0947, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 16.27% (0.0842 => 0.0979, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 16.19% (1.0722 => 1.2458, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.98% (0.9765 => 1.1325, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 15.90% (1.1642 => 1.3493, std.dev.: 0.0027) MultiSource/Applications/treecc/treecc: 15.88% (2.0273 => 2.3493, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/18-imp/imp: 15.86% (0.3423 => 0.3966, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 15.79% (0.7835 => 0.9072, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 15.63% (0.1695 => 0.1960, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 15.55% (0.8921 => 1.0308, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 15.48% (0.0672 => 0.0776, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.47% (0.2107 => 0.2433, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.45% (0.2758 => 0.3184, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.43% (0.0648 => 0.0748, std.dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 15.38% (0.1125 => 0.1298, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/05-eks/eks: 15.38% (0.4299 => 0.4960, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.28% (1.1861 => 1.3673, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 15.22% (0.2700 => 0.3111, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 15.20% (1.4186 => 1.6342, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.13% (0.1117 => 0.1286, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 15.07% (0.5860 => 0.6743, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.06% (0.0770 => 0.0886, std.dev.: 0.0011) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.05% (0.1143 => 0.1315, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.01% (0.0933 => 0.1073, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.93% (4.2646 => 4.9013, std.dev.: 0.0128) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.89% (0.0759 => 0.0872, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 14.88% (0.7433 => 0.8539, std.dev.: 0.0168) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.88% (0.1062 => 0.1220, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.86% (0.5981 => 0.6870, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.83% (0.1625 => 0.1866, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.81% (0.1330 => 0.1527, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/lpbench: 14.75% (0.0929 => 0.1066, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 14.66% (3.8723 => 4.4399, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.33% (0.2065 => 0.2361, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 14.32% (0.3387 => 0.3872, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.29% (0.1029 => 0.1176, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.24% (0.3307 => 0.3778, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.16% (0.0798 => 0.0911, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 13.97% (0.0730 => 0.0832, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.93% (0.5569 => 0.6345, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 13.81% (0.3092 => 0.3519, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.77% (0.0770 => 0.0876, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 13.75% (9.4845 => 10.7888, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/health/health: 13.41% (0.1268 => 0.1438, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.31% (0.3441 => 0.3899, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.13% (0.0838 => 0.0948, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.02% (0.3826 => 0.4324, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 12.86% (0.3180 => 0.3589, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 12.38% (0.0953 => 0.1071, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 12.23% (2.2969 => 2.5779, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.05% (0.1892 => 0.2120, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: 11.87% (0.4289 => 0.4798, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.86% (14.3668 => 16.0706, std.dev.: 0.0209) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.55% (0.8101 => 0.9037, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 11.54% (0.6456 => 0.7201, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.49% (4.9449 => 5.5131, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/hash2: 11.47% (0.4620 => 0.5150, std.dev.: 0.0147) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.43% (5.0018 => 5.5737, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 11.40% (0.1044 => 0.1163, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 11.30% (17.1811 => 19.1229, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.03% (0.3427 => 0.3805, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.81% (0.4636 => 0.5137, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.70% (0.3543 => 0.3922, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.54% (2.2022 => 2.4343, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 10.49% (0.3422 => 0.3781, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/parameter-passing: 10.36% (0.3927 => 0.4334, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.30% (0.4203 => 0.4636, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions: 10.19% (0.3828 => 0.4218, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.09% (0.3865 => 0.4255, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.08% (0.3473 => 0.3823, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.04% (0.3694 => 0.4065, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.00% (0.3561 => 0.3917, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-2: 9.95% (0.3497 => 0.3845, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.94% (0.3543 => 0.3895, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.90% (0.3516 => 0.3864, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.88% (0.3886 => 0.4270, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/moments: 9.76% (0.4048 => 0.4443, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 9.72% (1.5603 => 1.7120, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 9.69% (0.3684 => 0.4041, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.62% (0.2266 => 0.2484, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.60% (3.8922 => 4.2658, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.43% (0.4103 => 0.4490, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.38% (0.2430 => 0.2658, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 9.13% (0.3603 => 0.3932, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.89% (0.5925 => 0.6452, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 8.89% (0.7326 => 0.7977, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference-object: 8.86% (0.6030 => 0.6564, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.69% (0.4064 => 0.4417, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.38% (0.2793 => 0.3027, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.30% (0.3650 => 0.3953, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 8.23% (0.3282 => 0.3552, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 7.97% (0.3098 => 0.3345, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 7.85% (0.2905 => 0.3133, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.80% (0.8067 => 0.8696, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ary3: 7.68% (0.3283 => 0.3535, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: 7.67% (0.2725 => 0.2934, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 7.63% (0.2714 => 0.2921, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.62% (0.2756 => 0.2966, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 7.52% (0.2831 => 0.3044, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.50% (0.3162 => 0.3399, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 7.49% (0.3232 => 0.3474, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.43% (2.0665 => 2.2201, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.38% (0.2872 => 0.3084, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary2: 7.34% (0.3379 => 0.3627, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.33% (0.2891 => 0.3103, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/ReedSolomon: 7.08% (0.2049 => 0.2194, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/except: 7.07% (0.2871 => 0.3074, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 7.02% (0.2877 => 0.3079, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 7.01% (0.3052 => 0.3266, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 6.98% (1.2842 => 1.3739, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 6.57% (0.2802 => 0.2986, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.84% (0.3136 => 0.3319, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.51% (7.9617 => 8.4006, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/objinst: 5.30% (0.3131 => 0.3297, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.07% (0.3935 => 0.4095) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.11% (7.0540 => 7.2731, std.dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3124, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.09% (1.1145 => 1.3718, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 10.21% (0.9957 => 1.0974, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/richards_benchmark: 9.77% (1.1396 => 1.2509, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.95% (2.8904 => 3.0914) SingleSource/Benchmarks/Shootout-C++/hash2: 6.70% (3.1578 => 3.3694, std.dev.: 0.0335) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: 4.50% (3.3453 => 3.4959, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 3.04% (1.9405 => 1.9994, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.76% (4.2280 => 4.3448, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 2.40% (4.4649 => 4.5719, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bisort/bisort: 1.96% (0.8333 => 0.8496, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2077, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.43% (9.1159 => 9.2464, std.dev.: 0.0258) MultiSource/Benchmarks/nbench/nbench: 1.30% (11.6436 => 11.7950, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -76.41% (0.8651 => 0.2041, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.24% (5.3855 => 2.4103, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -54.91% (5.3526 => 2.4135, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: -44.82% (0.1622 => 0.0895, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.03% (1.1194 => 0.6825, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.71% (5.2763 => 3.2336, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -22.88% (1.7609 => 1.3580, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -17.04% (2.9384 => 2.4377, std.dev.: 0.0026) SingleSource/UnitTests/Vector/constpool: -8.94% (54.1659 => 49.3251, std.dev.: 0.0477) MultiSource/Applications/JM/ldecod/ldecod: -7.61% (10.4361 => 9.6416, std.dev.: 0.0108) MultiSource/Benchmarks/PAQ8p/paq8p: -3.48% (10.3673 => 10.0070, std.dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -54.03% (8.0499 => 3.7007, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0133, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.45% (1.1492 => 0.7648, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.61% (0.0506 => 0.0341, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.38% (0.3987 => 0.2696, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.51% (2.9695 => 2.3604, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.99% (1.2258 => 0.9930, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.96% (1.6925 => 1.4223, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -10.98% (9.5636 => 8.5136, std.dev.: 0.0071) SingleSource/Benchmarks/McGill/chomp: -10.89% (1.2373 => 1.1026, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -10.64% (1.5373 => 1.3737, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.30% (19.9488 => 18.2923, std.dev.: 0.0240) MultiSource/Benchmarks/FreeBench/mason/mason: -7.87% (0.2161 => 0.1991, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.03% (1.8329 => 1.7041, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.64% (1.9577 => 1.8472, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -5.46% (6.6465 => 6.2834, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.12% (1.6805 => 1.5945, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.89% (0.2497 => 0.2375, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.75% (1.5835 => 1.5083, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.97% (8.1563 => 7.8321, std.dev.: 0.0036) MultiSource/Applications/siod/siod: -3.77% (3.2827 => 3.1590, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.52% (32.5116 => 31.3677, std.dev.: 0.0084) MultiSource/Benchmarks/sim/sim: -3.33% (5.0483 => 4.8802, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -2.91% (4.6441 => 4.5090, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.88% (4.5009 => 4.3712, std.dev.: 0.0020) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.66% (0.4808 => 0.4680, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/multiplies: -1.99% (2.5528 => 2.5021, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0870, std.dev.: 0.0104) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6834, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (85.0658 => 83.9827, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.19% (1.7254 => 1.7048, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8576, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/power/power: -1.01% (1.1277 => 1.1163, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.42% (7.1582 => 7.8324, std.dev.: 0.0025) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: 10635.69% (0.0720 => 7.7297, std.dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.42% (0.2116 => 0.0647, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 28 23:44:58 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 01:44:58 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121029064458.90E802A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5352?compare_to=5345&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5352, Order: 166909, Start Time: 2012-10-29 03:29:24, End Time: 2012-10-29 06:44:57 To: 5345, Order: 166902, Start Time: 2012-10-28 23:25:20, End Time: 2012-10-29 02:41:13 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (171 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1041 (720 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.38% (2.4431 => 2.4767, std.dev.: 0.0043) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.96% (0.0625 => 0.0881, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.08% (0.1063 => 0.1404, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.86% (0.1106 => 0.1392, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.60% (0.2969 => 0.3729, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 24.65% (1.5932 => 1.9859, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.64% (0.4139 => 0.5159, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.75% (0.4253 => 0.5263, std.dev.: 0.0091) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.73% (0.5900 => 0.7300, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.58% (0.0547 => 0.0676, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.57% (0.4994 => 0.6171, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.40% (0.5000 => 0.6170, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.11% (0.0714 => 0.0879, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.95% (0.0475 => 0.0584, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.60% (0.0584 => 0.0716) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.53% (0.1021 => 0.1251, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.07% (0.0897 => 0.1095, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.04% (0.1620 => 0.1977, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 21.54% (0.0599 => 0.0728, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.32% (0.1107 => 0.1343, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 20.68% (0.0948 => 0.1144, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.54% (0.0633 => 0.0763, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.40% (0.0642 => 0.0773) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.33% (0.0541 => 0.0651, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.26% (0.1604 => 0.1929, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.22% (0.1103 => 0.1326, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.21% (0.0584 => 0.0702, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.04% (0.3903 => 0.4685, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/power/power: 20.03% (0.0604 => 0.0725, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 19.85% (0.0821 => 0.0984, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.84% (0.1003 => 0.1202, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.82% (0.1549 => 0.1856, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 19.77% (0.1619 => 0.1939, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.71% (0.0822 => 0.0984, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 18.69% (0.0947 => 0.1124, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.54% (0.1462 => 0.1733, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 18.44% (0.0808 => 0.0957, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.17% (0.2014 => 0.2380, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 18.14% (0.1218 => 0.1439, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.10% (0.3890 => 0.4594, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 18.07% (0.4029 => 0.4757, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 18.04% (0.5826 => 0.6877, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.00% (1.3152 => 1.5520, std.dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference-object: 17.81% (0.5889 => 0.6938, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 17.74% (0.1505 => 0.1772, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.69% (0.2736 => 0.3220, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 17.56% (0.2750 => 0.3233, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 17.56% (0.0581 => 0.0683, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.56% (0.1088 => 0.1279, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 17.48% (0.0698 => 0.0820, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 17.27% (0.5546 => 0.6504, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.27% (0.2866 => 0.3361, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.25% (0.2875 => 0.3371, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.19% (0.0605 => 0.0709, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.12% (3.5627 => 4.1727, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.89% (1.6211 => 1.8949, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/gs/gs: 16.88% (1.8794 => 2.1966, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.81% (0.4658 => 0.5441, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 16.68% (0.3004 => 0.3505, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 16.67% (0.1284 => 0.1498, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.57% (0.1968 => 0.2294, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.55% (0.1160 => 0.1352, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 16.55% (0.2725 => 0.3176, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.54% (0.2738 => 0.3191, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 16.47% (0.2714 => 0.3161, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.41% (0.5026 => 0.5851, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 16.40% (0.1421 => 0.1654, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.38% (0.2729 => 0.3176, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 16.37% (0.2780 => 0.3235, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.35% (0.4361 => 0.5074, std.dev.: 0.0026) MultiSource/Applications/hbd/hbd: 16.31% (0.9697 => 1.1279, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/methcall: 16.28% (0.2813 => 0.3271, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.23% (0.3271 => 0.3802, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/except: 16.19% (0.2811 => 0.3266, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/objinst: 16.15% (0.2823 => 0.3279, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.15% (0.2911 => 0.3381, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.09% (0.3195 => 0.3709, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wc: 16.09% (0.3096 => 0.3594, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.08% (0.2792 => 0.3241, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/random: 16.05% (0.2803 => 0.3253, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.99% (2.0673 => 2.3978, std.dev.: 0.0055) MultiSource/Applications/d/make_dparser: 15.98% (1.0781 => 1.2504, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 15.96% (0.9909 => 1.1490, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary3: 15.89% (0.3267 => 0.3786, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.82% (2.7292 => 3.1610, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/property-reference: 15.81% (0.7171 => 0.8305, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary: 15.75% (0.3258 => 0.3771, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.65% (1.9694 => 2.2777, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary2: 15.65% (0.3317 => 0.3836, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.62% (4.4195 => 5.1098, std.dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.57% (0.3930 => 0.4542, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.47% (0.3362 => 0.3882, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.44% (1.9966 => 2.3049, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-3: 15.43% (0.3460 => 0.3994, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 15.36% (4.2109 => 4.8578, std.dev.: 0.0073) SingleSource/UnitTests/ObjC/exceptions-4: 15.35% (0.3465 => 0.3997, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 15.29% (0.3446 => 0.3973, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.26% (0.3060 => 0.3527, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 15.22% (0.3496 => 0.4028, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 15.19% (0.3442 => 0.3965, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 15.16% (0.3469 => 0.3995, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.14% (0.3488 => 0.4016, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 15.05% (0.3348 => 0.3852, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 15.00% (23.5202 => 27.0477, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.88% (0.3124 => 0.3589, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 14.79% (0.3650 => 0.4190, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 14.79% (0.3678 => 0.4222, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.78% (0.3282 => 0.3767, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 14.69% (0.3643 => 0.4178, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.68% (0.1090 => 0.1250, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.57% (0.3625 => 0.4153, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 14.53% (0.3724 => 0.4265, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 14.44% (0.3726 => 0.4264, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/lists1: 14.38% (0.3477 => 0.3977, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 14.21% (0.4146 => 0.4735, std.dev.: 0.0015) MultiSource/Applications/lua/lua: 14.18% (1.4269 => 1.6292, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 14.17% (0.2075 => 0.2369, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 14.11% (0.2566 => 0.2928, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.07% (0.3845 => 0.4386, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.04% (0.3690 => 0.4208, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash2: 14.02% (0.4251 => 0.4847, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.99% (0.3981 => 0.4538, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 13.92% (0.7875 => 0.8971, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 13.53% (2.1653 => 2.4583, std.dev.: 0.0073) MultiSource/Applications/JM/lencod/lencod: 13.50% (4.6177 => 5.2413, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/bigfib: 13.23% (0.5012 => 0.5675, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 13.06% (2.1013 => 2.3757, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.80% (0.1383 => 0.1560, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.55% (0.2040 => 0.2296, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 12.10% (5.5417 => 6.2122, std.dev.: 0.0091) MultiSource/Applications/SIBsim4/SIBsim4: 12.08% (0.2691 => 0.3016, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.90% (0.6435 => 0.7201, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.28% (0.1028 => 0.1144, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 11.18% (0.3498 => 0.3889, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.07% (0.2737 => 0.3040, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.83% (0.2068 => 0.2292, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 10.81% (0.6634 => 0.7351, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.41% (0.3084 => 0.3405, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 10.27% (0.4847 => 0.5345, std.dev.: 0.0019) MultiSource/Applications/minisat/minisat: 10.16% (0.3336 => 0.3675, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 9.82% (2.0346 => 2.2343, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.65% (0.2103 => 0.2306, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 9.54% (0.2391 => 0.2619, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.15% (4.6926 => 5.1218, std.dev.: 0.0113) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.56% (11.6398 => 12.6367, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.11% (0.5361 => 0.5796, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.64% (0.7426 => 0.7993, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.63% (0.5584 => 0.6010, std.dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: 6.64% (11.9555 => 12.7488, std.dev.: 0.0065) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.78% (0.3792 => 0.4011, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6534, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 8.92% (0.2802 => 0.3052, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6109, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 6.41% (0.2122 => 0.2258, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/objinst: 4.99% (12.0509 => 12.6522, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1686, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-2: 4.02% (1.8057 => 1.8782, std.dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/dry: 2.76% (14.0481 => 14.4353, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2029, std.dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.74% (3.1722 => 3.2275, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3097, std.dev.: 0.0106) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2868, std.dev.: 0.0038) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5130, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5956, std.dev.: 0.0213) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.49% (25.4195 => 16.3982, std.dev.: 0.0177) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9767, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7745, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: -7.20% (0.2402 => 0.2229, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2420, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7756, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5218, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.85% (11.2080 => 10.8881, std.dev.: 0.0096) SingleSource/Benchmarks/Dhrystone/fldry: -2.32% (17.2379 => 16.8385, std.dev.: 0.0357) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.17% (41.7953 => 40.8898, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5700, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/bh/bh: -1.50% (5.5810 => 5.4971, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.33% (5.7935 => 5.7164, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.14% (105.3826 => 104.1817, std.dev.: 0.0984) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0431, std.dev.: 0.0036) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.06% (3.3991 => 3.3630, std.dev.: 0.0034) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 28 23:46:31 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 01:46:31 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121029064631.6447B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5353?compare_to=5349&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5353, Order: 166910, Start Time: 2012-10-29 05:21:55, End Time: 2012-10-29 06:46:30 To: 5349, Order: 166909, Start Time: 2012-10-29 03:06:11, End Time: 2012-10-29 04:30:39 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 8 (95 on baseline) Performance Improvements: 4 (7 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 963 (872 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.36% (1.4954 => 1.8896, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/pi: 21.18% (2.0672 => 2.5051, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.83% (0.3325 => 0.3519, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 2.97% (0.3498 => 0.3602, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.51% (0.4020 => 0.4121, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.88% (4.5339 => 4.6192, std.dev.: 0.0327) SingleSource/Benchmarks/McGill/chomp: 1.64% (1.1083 => 1.1265, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.34% (2.8735 => 2.9120, std.dev.: 0.0092) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.18% (0.6530 => 0.6192, std.dev.: 0.0111) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.24% (0.3425 => 0.3314, std.dev.: 0.0032) MultiSource/Applications/spiff/spiff: -2.43% (0.8512 => 0.8305, std.dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.23% (1.0384 => 1.0256, std.dev.: 0.0043) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.09% (16.6661 => 16.6806, std.dev.: 0.2246) MultiSource/Applications/obsequi/Obsequi: -1.01% (1.0781 => 1.0672, std.dev.: 0.0049) MultiSource/Applications/sqlite3/sqlite3: -0.74% (0.6501 => 0.6453, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/08-main/main: 1.81% (0.1883 => 0.1917, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.57% (0.1689 => 0.1578, std.dev.: 0.0068) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.29% (0.3245 => 0.3203, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.10% (0.2454 => 0.2481, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.44% (0.3324 => 0.3276, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.10% (0.2317 => 0.2412, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/bigfib: 0.20% (0.6015 => 0.6027, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/mandel: 6.56% (0.0427 => 0.0455, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.66% (0.3329 => 0.3307, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: -1.79% (0.2007 => 0.1971, std.dev.: 0.0012) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -4.51% (0.0244 => 0.0233, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 11.73% (0.0196 => 0.0219, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 15.91% (0.0352 => 0.0408, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -17.31% (0.0312 => 0.0258, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.96% (0.0314 => 0.0311, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 20.98% (0.0348 => 0.0421, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/casts: -0.98% (0.0204 => 0.0202, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -15.38% (0.0156 => 0.0132, std.dev.: 0.0042) SingleSource/UnitTests/byval-alignment: 0.60% (0.0331 => 0.0333, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -38.46% (0.0013 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.89% (0.1456 => 0.1469, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.74% (1.1256 => 1.1339, std.dev.: 0.0205) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 1.13% (0.1504 => 0.1521, std.dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.44% (0.4036 => 0.4094, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.22% (0.1337 => 0.1380, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.29% (0.0007 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.23% (0.0595 => 0.0638, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 45.21% (0.0188 => 0.0273, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.44% (0.0570 => 0.0601, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.43% (1.1455 => 1.1504, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -24.00% (0.0025 => 0.0019, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 800.00% (0.0003 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.21% (0.0633 => 0.0647, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 55.56% (0.0171 => 0.0266, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.66% (0.8019 => 0.7966, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -8.00% (0.0050 => 0.0046, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.03% (2.1832 => 1.6586, std.dev.: 0.0042) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 36.02% (14.7684 => 20.0877, std.dev.: 0.0776) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.04% (0.0810 => 0.0948, std.dev.: 0.0051) SingleSource/UnitTests/SignlessTypes/rem: 14.59% (0.1035 => 0.1186, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/tsp/tsp: 12.95% (0.1112 => 0.1256, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.29% (0.0830 => 0.0932, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.04% (0.2180 => 0.2377, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.74% (0.8321 => 0.8965, std.dev.: 0.0062) MultiSource/Applications/SIBsim4/SIBsim4: 7.22% (1.2568 => 1.3476, std.dev.: 0.0096) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.26% (0.1885 => 0.2003, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.18% (13.1811 => 13.9955, std.dev.: 0.0686) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.10% (0.2279 => 0.2418, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.80% (0.2998 => 0.3172, std.dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.69% (6.6074 => 6.9832, std.dev.: 0.0284) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.64% (0.3137 => 0.3314, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.62% (0.7473 => 0.7893, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.40% (0.2519 => 0.2655, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.19% (1.1170 => 1.1750, std.dev.: 0.0133) MultiSource/Benchmarks/nbench/nbench: 4.86% (1.1271 => 1.1819, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.84% (1.1685 => 1.2250, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.82% (0.2240 => 0.2348, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.78% (1.6386 => 1.7170, std.dev.: 0.0156) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.77% (0.4783 => 0.5011, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.66% (0.6287 => 0.6580, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.48% (0.4847 => 0.5064, std.dev.: 0.0067) MultiSource/Applications/spiff/spiff: 4.47% (0.7950 => 0.8305, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.41% (0.8148 => 0.8507, std.dev.: 0.0073) MultiSource/Applications/Burg/burg: 4.38% (1.2222 => 1.2757, std.dev.: 0.0186) MultiSource/Applications/sgefa/sgefa: 4.33% (0.2999 => 0.3129, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 4.32% (0.4397 => 0.4587, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.30% (0.3717 => 0.3877, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.19% (0.4559 => 0.4750, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.14% (1.1606 => 1.2087, std.dev.: 0.0047) MultiSource/Applications/treecc/treecc: 4.14% (1.9948 => 2.0774, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.01% (0.3295 => 0.3427, std.dev.: 0.0017) MultiSource/Applications/d/make_dparser: 3.93% (3.2366 => 3.3637, std.dev.: 0.0145) MultiSource/Applications/hbd/hbd: 3.81% (1.4269 => 1.4812, std.dev.: 0.0137) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.79% (0.6227 => 0.6463, std.dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 3.75% (14.2605 => 14.7946, std.dev.: 0.0284) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.71% (0.9435 => 0.9785, std.dev.: 0.0097) MultiSource/Applications/minisat/minisat: 3.51% (0.6834 => 0.7074, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.26% (4.1763 => 4.3123, std.dev.: 0.0300) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.12% (4.4873 => 4.6275, std.dev.: 0.0299) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.06% (1.3279 => 1.3686, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.00% (0.8340 => 0.8590, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.97% (0.8286 => 0.8532, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.92% (0.8331 => 0.8574, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.87% (0.8050 => 0.8281, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.87% (8.6476 => 8.8955, std.dev.: 0.0675) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.86% (0.8927 => 0.9182, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 2.83% (8.6247 => 8.8687, std.dev.: 0.0701) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.82% (0.8007 => 0.8233, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.73% (0.6586 => 0.6766, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.62% (0.9074 => 0.9312, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.61% (0.8457 => 0.8678, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.58% (0.8656 => 0.8879, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.55% (0.9908 => 1.0161, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.51% (0.8317 => 0.8526, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.48% (3.1832 => 3.2621, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.45% (0.8805 => 0.9021, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.44% (0.9069 => 0.9290, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.43% (2.1401 => 2.1921, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.42% (1.5315 => 1.5685, std.dev.: 0.0105) MultiSource/Applications/JM/lencod/lencod: 2.41% (15.3280 => 15.6976, std.dev.: 0.0542) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.40% (0.8069 => 0.8263, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.37% (0.9039 => 0.9253, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.36% (0.8359 => 0.8556, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.30% (0.8086 => 0.8272, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.29% (0.8518 => 0.8713, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: 2.27% (4.1305 => 4.2242, std.dev.: 0.0359) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.23% (0.7932 => 0.8109, std.dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 2.21% (6.7320 => 6.8811, std.dev.: 0.0281) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.21% (0.8716 => 0.8909, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.18% (1.4479 => 1.4795, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.18% (0.8261 => 0.8441, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.17% (0.8048 => 0.8223, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.12% (0.8177 => 0.8350, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.10% (4.4880 => 4.5821, std.dev.: 0.0241) MultiSource/Applications/siod/siod: 2.08% (2.2184 => 2.2646, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.05% (0.8885 => 0.9067, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.04% (0.8712 => 0.8890, std.dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: 1.97% (31.8598 => 32.4881, std.dev.: 0.1577) MultiSource/Benchmarks/PAQ8p/paq8p: 1.70% (2.3764 => 2.4169, std.dev.: 0.0147) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.62% (1.2423 => 1.2624, std.dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.60% (1.5795 => 2.5051, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.45% (0.3186 => 0.3519, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.75% (2.4333 => 2.6706, std.dev.: 0.0090) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.44% (1.1857 => 1.2858, std.dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 5.92% (63.1822 => 66.9257, std.dev.: 0.1327) MultiSource/Benchmarks/BitBench/drop3/drop3: 4.23% (0.2887 => 0.3009, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/ReedSolomon: 3.27% (8.5322 => 8.8112, std.dev.: 0.0063) MultiSource/Applications/siod/siod: 2.61% (3.6643 => 3.7601, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/bh/bh: 1.99% (2.3560 => 2.4029, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/hash: 1.64% (0.6205 => 0.6307, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: 1.30% (1.3037 => 1.3206, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.21% (2.8773 => 2.9120, std.dev.: 0.0092) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -7.48% (3.2926 => 3.0463, std.dev.: 0.0953) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.97% (0.3269 => 0.3041, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -4.92% (29.8330 => 28.3654, std.dev.: 0.1708) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.49% (7.2130 => 7.0333, std.dev.: 0.0581) SingleSource/Benchmarks/Shootout-C++/hash2: -1.45% (3.4237 => 3.3741, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.27% (1.0388 => 1.0256, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.21% (3.3479 => 3.3075, std.dev.: 0.0068) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 1.43% (16.4461 => 16.6806, std.dev.: 0.2246) MultiSource/Applications/obsequi/Obsequi: 4.00% (1.0262 => 1.0672, std.dev.: 0.0049) MultiSource/Applications/sqlite3/sqlite3: 1.91% (0.6332 => 0.6453, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/08-main/main: 4.70% (0.1831 => 0.1917, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.22% (0.1559 => 0.1578, std.dev.: 0.0068) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.56% (0.3123 => 0.3203, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.73% (0.2463 => 0.2481, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.03% (0.3344 => 0.3276, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.03% (0.2364 => 0.2412, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/bigfib: 0.28% (0.6010 => 0.6027, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/mandel: 6.06% (0.0429 => 0.0455, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.26% (0.3266 => 0.3307, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 0.10% (0.1969 => 0.1971, std.dev.: 0.0012) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.02% (0.0224 => 0.0233, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0408 => 0.0408, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.57% (0.0254 => 0.0258, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.98% (0.0302 => 0.0311, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.64% (0.0384 => 0.0421, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -26.67% (0.0180 => 0.0132, std.dev.: 0.0042) SingleSource/UnitTests/byval-alignment: 44.78% (0.0230 => 0.0333, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 14.29% (0.0007 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 2.16% (0.1438 => 0.1469, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.09% (1.1329 => 1.1339, std.dev.: 0.0205) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 4.04% (0.1462 => 0.1521, std.dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.68% (0.4164 => 0.4094, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.80% (0.1369 => 0.1380, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.47% (0.0641 => 0.0638, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 40.00% (0.0195 => 0.0273, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.98% (0.0578 => 0.0601, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.59% (1.1437 => 1.1504, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1800.00% (0.0001 => 0.0019, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.19% (0.0627 => 0.0647, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.78% (0.0180 => 0.0266, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.64% (0.8017 => 0.7966, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -25.81% (0.0062 => 0.0046, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Oct 28 23:53:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 01:53:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121029065317.5A1382A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5354?compare_to=5350&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5354, Order: 166910, Start Time: 2012-10-29 05:27:40, End Time: 2012-10-29 06:53:16 To: 5350, Order: 166909, Start Time: 2012-10-29 03:33:31, End Time: 2012-10-29 04:58:54 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 1 (175 on baseline) Unchanged Tests: 1041 (862 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.51% (79.5003 => 78.2987, std.dev.: 0.4112) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.40% (15.2527 => 18.3642, std.dev.: 0.0085) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.90% (2.0478 => 2.1072, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: 2.24% (7.4937 => 7.6614, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/hash2: 2.20% (3.1932 => 3.2635, std.dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.67% (0.1431 => 0.1307, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.27% (0.1584 => 0.1453, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.38% (0.3821 => 0.3539, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-2: -6.73% (0.3831 => 0.3573, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.70% (0.3880 => 0.3620, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -6.69% (0.3812 => 0.3557, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -6.65% (0.3848 => 0.3592, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.64% (0.3884 => 0.3626, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.62% (0.3896 => 0.3638, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -6.62% (0.4033 => 0.3766, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -6.56% (2.4924 => 2.3289, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.55% (0.3891 => 0.3636, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions: -6.51% (0.4176 => 0.3904, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.49% (0.3142 => 0.2938, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.47% (0.2428 => 0.2271, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.32% (22.4056 => 20.9886, std.dev.: 0.0124) SingleSource/UnitTests/ObjC/property: -6.31% (0.4199 => 0.3934, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.29% (0.3658 => 0.3428, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -6.24% (0.4280 => 0.4013, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -6.09% (0.2989 => 0.2807, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.08% (0.3025 => 0.2841, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.04% (5.4682 => 5.1380, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.02% (0.3057 => 0.2873, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.00% (0.3252 => 0.3057, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.99% (0.2903 => 0.2729, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.97% (2.1713 => 2.0416, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.97% (0.3837 => 0.3608, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.97% (0.3016 => 0.2836, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -5.96% (0.2871 => 0.2700, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -5.95% (0.2939 => 0.2764, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -5.93% (0.3255 => 0.3062, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.93% (0.3323 => 0.3126, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.92% (4.5069 => 4.2402, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/ReedSolomon: -5.91% (0.1879 => 0.1768, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: -5.90% (0.2849 => 0.2681, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.88% (0.4151 => 0.3907, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.86% (0.2355 => 0.2217, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: -5.85% (0.3194 => 0.3007, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -5.83% (0.3788 => 0.3567, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: -5.83% (1.2515 => 1.1785, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.83% (0.6484 => 0.6106, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: -5.83% (0.2659 => 0.2504, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.83% (0.4083 => 0.3845, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -5.82% (0.7779 => 0.7326, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -5.82% (0.3059 => 0.2881, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: -5.80% (0.3205 => 0.3019, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -5.80% (0.3481 => 0.3279, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -5.78% (0.4861 => 0.4580, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: -5.77% (0.3394 => 0.3198, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.77% (0.3931 => 0.3704, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists: -5.77% (0.3621 => 0.3412, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: -5.69% (1.3148 => 1.2400, std.dev.: 0.0061) MultiSource/Applications/JM/ldecod/ldecod: -5.69% (7.0961 => 6.6926, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/gs/gs: -5.67% (4.3330 => 4.0874, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary3: -5.66% (0.3446 => 0.3251, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.65% (0.9542 => 0.9003, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -5.63% (2.4021 => 2.2668, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.62% (0.4427 => 0.4178, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.62% (3.5339 => 3.3354, std.dev.: 0.0090) MultiSource/Applications/sgefa/sgefa: -5.60% (0.3357 => 0.3169, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -5.58% (16.1920 => 15.2884, std.dev.: 0.0109) SingleSource/Benchmarks/Misc/oourafft: -5.56% (0.2160 => 0.2040, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.54% (4.8161 => 4.5495, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/lists1: -5.51% (0.3867 => 0.3654, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -5.50% (0.6347 => 0.5998, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.50% (4.8802 => 4.6119, std.dev.: 0.0051) MultiSource/Benchmarks/Bullet/bullet: -5.47% (34.0927 => 32.2267, std.dev.: 0.0180) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.46% (0.9852 => 0.9314, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.46% (0.2548 => 0.2409, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -5.45% (0.6750 => 0.6382, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: -5.42% (0.4524 => 0.4279, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.42% (1.0544 => 0.9973, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.41% (1.2784 => 1.2092, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference-object: -5.40% (0.6441 => 0.6093, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.36% (0.4813 => 0.4555, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.32% (0.4321 => 0.4091, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -5.32% (0.4248 => 0.4022, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.28% (1.2210 => 1.1565, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.27% (0.3491 => 0.3307, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.26% (1.6474 => 1.5607, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -5.22% (4.0594 => 3.8473, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.22% (0.2933 => 0.2780, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.16% (0.8521 => 0.8081, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.14% (0.2278 => 0.2161, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.13% (0.6293 => 0.5970, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.09% (4.0323 => 3.8272, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.08% (0.5999 => 0.5694, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.08% (0.7919 => 0.7517, std.dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: -5.02% (18.2933 => 17.3741, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.02% (1.2221 => 1.1608, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.00% (0.2999 => 0.2849, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -4.99% (0.2985 => 0.2836, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.99% (0.7198 => 0.6839, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.87% (2.2587 => 2.1486, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.83% (1.3722 => 1.3059, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: -4.82% (0.7982 => 0.7597, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -4.81% (1.6364 => 1.5577, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.80% (0.9557 => 0.9098, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: -4.76% (9.2283 => 8.7891, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.65% (0.6230 => 0.5940, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.64% (0.5478 => 0.5224, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.58% (1.4642 => 1.3972, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.56% (0.5591 => 0.5336, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.56% (0.4916 => 0.4692, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.49% (0.2385 => 0.2278, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.45% (0.6676 => 0.6379, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.41% (0.5805 => 0.5549, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.39% (0.6194 => 0.5922, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.36% (0.6667 => 0.6376, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.35% (0.6660 => 0.6370, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.35% (0.5857 => 0.5602, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.33% (0.5802 => 0.5551, std.dev.: 0.0053) MultiSource/Applications/minisat/minisat: -4.32% (0.7447 => 0.7125, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.32% (0.6297 => 0.6025, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.32% (0.7339 => 0.7022, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.31% (0.6052 => 0.5791, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.30% (0.5581 => 0.5341, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.30% (0.5863 => 0.5611, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.26% (0.5705 => 0.5462, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.25% (0.5570 => 0.5333, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.25% (0.6395 => 0.6123, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.25% (0.6189 => 0.5926, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.24% (0.6681 => 0.6398, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.24% (0.6304 => 0.6037, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.23% (0.5456 => 0.5225, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.21% (0.6440 => 0.6169, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -4.20% (0.3406 => 0.3263, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.20% (0.5575 => 0.5341, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.18% (0.5569 => 0.5336, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.18% (0.5859 => 0.5614, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.16% (0.3319 => 0.3181, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: -4.15% (2.1401 => 2.0513, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.15% (0.7524 => 0.7212, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.14% (0.6395 => 0.6130, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.14% (0.5941 => 0.5695, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: -4.13% (0.3271 => 0.3136, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: -4.12% (1.1450 => 1.0978, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -4.10% (0.4515 => 0.4330, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.09% (0.6033 => 0.5786, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: -4.08% (0.3581 => 0.3435, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.07% (0.5925 => 0.5684, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.03% (8.0126 => 7.6895, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.02% (0.5567 => 0.5343, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.00% (0.5849 => 0.5615, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: -3.97% (0.8418 => 0.8084, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.96% (0.7021 => 0.6743, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -3.96% (0.5688 => 0.5463, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: -3.95% (0.9179 => 0.8816, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.94% (0.6446 => 0.6192, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: -3.93% (15.5079 => 14.8992, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.85% (0.5168 => 0.4969, std.dev.: 0.0056) MultiSource/Applications/sqlite3/sqlite3: -3.84% (17.1032 => 16.4461, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -3.83% (0.6260 => 0.6020, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.83% (0.9077 => 0.8729, std.dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.81% (6.7716 => 6.5139, std.dev.: 0.0036) MultiSource/Applications/hbd/hbd: -3.79% (1.5610 => 1.5018, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.70% (0.3483 => 0.3354, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.66% (1.2300 => 1.1850, std.dev.: 0.0040) MultiSource/Applications/d/make_dparser: -3.62% (3.5154 => 3.3880, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.58% (0.6736 => 0.6495, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.57% (0.5329 => 0.5139, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -3.40% (20.7746 => 20.0676, std.dev.: 0.0303) MultiSource/Applications/oggenc/oggenc: -3.39% (5.0226 => 4.8522, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: -3.31% (1.1530 => 1.1148, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.02% (14.2083 => 13.7790, std.dev.: 0.0051) MultiSource/Applications/SIBsim4/SIBsim4: -1.63% (1.3864 => 1.3638, std.dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7535, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1728, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7061, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: -3.87% (2.2633 => 2.1757, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.00% (1.0557 => 1.0240, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.18% (1.3096 => 1.2811, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.78% (79.7170 => 78.2987, std.dev.: 0.4112) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.52% (6.5735 => 6.4739, std.dev.: 0.0006) Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 29 00:52:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 02:52:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121029075254.AA32D2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/5355?compare_to=5351&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5355, Order: 166911, Start Time: 2012-10-29 06:18:13, End Time: 2012-10-29 07:52:49 To: 5351, Order: 166909, Start Time: 2012-10-29 04:17:10, End Time: 2012-10-29 05:48:40 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (10 on baseline) New Passes: 0 (14 on baseline) Performance Regressions: 0 (187 on baseline) Performance Improvements: 1 (53 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 15 (5 on baseline) Unchanged Tests: 1026 (639 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.15% (10.0070 => 9.7919, std.dev.: 0.0012) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: 0.18% (2.0504 => 2.0541, std.dev.: 0.0413) MultiSource/Benchmarks/Bullet/bullet: -0.55% (58.1441 => 57.8222, std.dev.: 0.0775) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 3.13% (0.0800 => 0.0825, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -0.21% (9.2577 => 9.2381, std.dev.: 0.0333) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.32% (7.8324 => 7.8075, std.dev.: 0.0052) SingleSource/UnitTests/Vector/SSE/sse_shift: 1.74% (0.0517 => 0.0526, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/JM/lencod/lencod: -0.07% (7.7297 => 7.7240, std.dev.: 0.1163) MultiSource/Applications/oggenc/oggenc: - (0.0001 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0647 => 0.0648, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: - (0.2990 => 0.2990, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_shift: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -64.33% (5.7591 => 2.0541, std.dev.: 0.0413) MultiSource/Benchmarks/Bullet/bullet: -8.57% (63.2438 => 57.8222, std.dev.: 0.0775) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.77% (6.6874 => 0.0825, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.54% (8.1363 => 9.2381, std.dev.: 0.0333) SingleSource/UnitTests/Vector/SSE/sse_shift: 39.15% (0.0378 => 0.0526, std.dev.: 0.0005) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -50.00% (0.0002 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -57.05% (0.6962 => 0.2990, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_shift: -50.00% (0.0002 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 213.64% (0.5229 => 1.6400, std.dev.: 0.0500) MultiSource/Applications/SPASS/SPASS: 17.85% (14.9895 => 17.6644, std.dev.: 0.3940) MultiSource/Applications/kimwitu++/kc: 37.71% (14.1553 => 19.4927, std.dev.: 0.1245) MultiSource/Benchmarks/MallocBench/gs/gs: 14.11% (4.1105 => 4.6903, std.dev.: 0.0202) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 33.25% (1.1048 => 1.4721, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: 69.24% (3.4629 => 5.8606, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_container: 68.51% (0.6222 => 1.0485, std.dev.: 0.0120) New Passes - Execution Time --------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 3837900.00% (0.0001 => 3.8380, std.dev.: 0.0119) MultiSource/Applications/SPASS/SPASS: 11188100.00% (0.0001 => 11.1882, std.dev.: 1.0052) MultiSource/Applications/kimwitu++/kc: 50800.00% (0.0001 => 0.0509, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049700.00% (0.0001 => 10.0498, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5495900.00% (0.0001 => 5.4960, std.dev.: 0.0078) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 78.04% (0.0296 => 0.0527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 69.53% (0.0256 => 0.0434, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 60.89% (0.0271 => 0.0436, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 52.67% (0.0243 => 0.0371) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 44.34% (1.5859 => 2.2891, std.dev.: 0.0139) SingleSource/Regression/C/sumarray: 44.16% (0.0231 => 0.0333, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.73% (0.0834 => 0.1182, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/distray/distray: 40.44% (0.1056 => 0.1483, std.dev.: 0.0008) SingleSource/UnitTests/vla: 36.34% (0.0355 => 0.0484, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 35.33% (2.2024 => 2.9805, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/neural/neural: 33.90% (0.1463 => 0.1959, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 28.46% (0.1655 => 0.2126, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 28.42% (0.1432 => 0.1839, std.dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 24.24% (0.0462 => 0.0574, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.12% (0.1566 => 0.1928, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 22.06% (0.5105 => 0.6231, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/rem: 21.85% (0.1144 => 0.1394, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 20.93% (0.0626 => 0.0757, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.90% (0.0871 => 0.1053, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 20.77% (0.1555 => 0.1878, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 19.52% (1.3050 => 1.5597, std.dev.: 0.0035) MultiSource/Applications/minisat/minisat: 19.49% (0.7115 => 0.8502, std.dev.: 0.0199) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 19.37% (0.6675 => 0.7968, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 19.32% (0.1584 => 0.1890, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/17-bintr/bintr: 19.26% (0.0675 => 0.0805, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 19.23% (0.1695 => 0.2021, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.11% (0.2271 => 0.2705, std.dev.: 0.0029) MultiSource/Applications/d/make_dparser: 18.86% (3.3354 => 3.9645, std.dev.: 0.0556) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.78% (0.5020 => 0.5963, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/n-body: 18.63% (0.0746 => 0.0885, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 18.38% (0.1175 => 0.1391, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 18.36% (0.0730 => 0.0864, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 18.29% (0.0842 => 0.0996, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.28% (0.0886 => 0.1048, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 18.25% (0.2554 => 0.3020, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 18.12% (0.1236 => 0.1460, std.dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.96% (0.4615 => 0.5444, std.dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.88% (0.3121 => 0.3679, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.81% (0.1510 => 0.1779, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.78% (0.0793 => 0.0934, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.73% (0.1032 => 0.1215, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 17.72% (0.3109 => 0.3660, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 17.67% (0.4879 => 0.5741, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.66% (0.0770 => 0.0906, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 17.63% (0.1906 => 0.2242, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/mst/mst: 17.54% (0.1163 => 0.1367, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.50% (1.5415 => 1.8113, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.50% (0.1337 => 0.1571, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 17.50% (1.1840 => 1.3912, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.29% (0.6450 => 0.7565, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 17.15% (0.3177 => 0.3722, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.12% (0.8172 => 0.9571, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 16.75% (0.2603 => 0.3039, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.72% (0.1029 => 0.1201, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 16.71% (0.7835 => 0.9144, std.dev.: 0.0207) MultiSource/Applications/ClamAV/clamscan: 16.68% (22.1758 => 25.8738, std.dev.: 0.5364) MultiSource/Applications/Burg/burg: 16.62% (1.1642 => 1.3577, std.dev.: 0.0385) MultiSource/Benchmarks/Ptrdist/ft/ft: 16.60% (0.1940 => 0.2262, std.dev.: 0.0015) MultiSource/Applications/aha/aha: 16.51% (0.1151 => 0.1341, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/loader/loader: 16.17% (0.2758 => 0.3204, std.dev.: 0.0040) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.10% (0.1143 => 0.1327) SingleSource/Benchmarks/McGill/exptree: 16.09% (0.0814 => 0.0945, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.84% (0.9765 => 1.1312, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/football/football: 15.83% (0.8921 => 1.0333, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 15.82% (0.5981 => 0.6927, std.dev.: 0.0031) MultiSource/Applications/lemon/lemon: 15.75% (1.0722 => 1.2411, std.dev.: 0.0323) MultiSource/Benchmarks/McCat/18-imp/imp: 15.57% (0.3423 => 0.3956, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.47% (0.2107 => 0.2433, std.dev.: 0.0023) MultiSource/Applications/treecc/treecc: 15.45% (2.0273 => 2.3405, std.dev.: 0.0661) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 15.33% (0.0672 => 0.0775, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 15.22% (0.1695 => 0.1953, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 15.21% (1.4186 => 1.6343, std.dev.: 0.0083) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 15.20% (0.1125 => 0.1296, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/voronoi/voronoi: 15.15% (0.2700 => 0.3109, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.13% (0.1117 => 0.1286, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.11% (0.0933 => 0.1074, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.08% (1.1861 => 1.3650, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/05-eks/eks: 15.03% (0.4299 => 0.4945, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.89% (0.1330 => 0.1528, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.88% (0.5860 => 0.6732, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.76% (0.0759 => 0.0871, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.69% (0.1062 => 0.1218, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.62% (0.2065 => 0.2367, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.58% (0.1625 => 0.1862, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/lpbench: 14.53% (0.0929 => 0.1064, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.51% (4.2646 => 4.8835, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.38% (0.0730 => 0.0835, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 14.35% (3.8723 => 4.4281, std.dev.: 0.1109) MultiSource/Applications/lambda-0_1_3/lambda: 14.27% (0.7433 => 0.8494, std.dev.: 0.0283) MultiSource/Benchmarks/sim/sim: 14.05% (0.3387 => 0.3863, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.88% (0.5569 => 0.6342, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.73% (0.3307 => 0.3761, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 13.70% (9.4845 => 10.7842, std.dev.: 0.0143) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.64% (0.0770 => 0.0875, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 13.55% (0.3092 => 0.3511, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.14% (0.3441 => 0.3893, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/health/health: 13.09% (0.1268 => 0.1434, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 12.53% (0.0838 => 0.0943, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.36% (0.3826 => 0.4299, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/09-vor/vor: 12.36% (0.3180 => 0.3573, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 12.17% (0.0953 => 0.1069, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 12.16% (0.1044 => 0.1171, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.10% (0.1892 => 0.2121, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 12.02% (2.2969 => 2.5729, std.dev.: 0.0331) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.58% (0.8101 => 0.9039, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 11.52% (0.4289 => 0.4783, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.28% (14.3668 => 15.9876, std.dev.: 0.0158) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.14% (5.0018 => 5.5592, std.dev.: 0.0114) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.13% (4.9449 => 5.4951, std.dev.: 0.0149) SingleSource/Benchmarks/Misc-C++/bigfib: 11.01% (0.6456 => 0.7167, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 10.97% (0.4620 => 0.5127, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 10.86% (17.1811 => 19.0464, std.dev.: 0.4084) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.74% (0.3427 => 0.3795, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.38% (2.2022 => 2.4307, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.33% (0.3543 => 0.3909, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.06% (0.3927 => 0.4322, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 9.94% (0.3422 => 0.3762, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.81% (0.4636 => 0.5091, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 9.80% (0.3694 => 0.4056, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.77% (0.3828 => 0.4202, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.70% (0.3473 => 0.3810, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.68% (0.3543 => 0.3886, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 9.60% (0.3561 => 0.3903, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.58% (0.3516 => 0.3853, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 9.55% (0.3497 => 0.3831, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.52% (0.3886 => 0.4256, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.44% (0.3865 => 0.4230, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.42% (3.8922 => 4.2589, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.40% (0.2266 => 0.2479, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 9.38% (1.5603 => 1.7066, std.dev.: 0.0470) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.35% (0.4203 => 0.4596, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.31% (0.4103 => 0.4485, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 9.12% (0.4048 => 0.4417, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.01% (0.2430 => 0.2649, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/lists1: 9.01% (0.3684 => 0.4016, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 8.22% (0.3603 => 0.3899, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.14% (0.7326 => 0.7922, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.13% (0.8067 => 0.8723, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.05% (0.4064 => 0.4391, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.84% (0.2793 => 0.3012, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference-object: 7.73% (0.6030 => 0.6496, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.63% (0.5925 => 0.6377, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/oourafft: 7.59% (0.3282 => 0.3531, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.51% (0.3650 => 0.3924, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 7.33% (0.3098 => 0.3325, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 7.07% (0.3283 => 0.3515, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 6.96% (0.3232 => 0.3457, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.89% (0.2831 => 0.3026, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.77% (0.3162 => 0.3376, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 6.75% (0.2905 => 0.3101, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.68% (2.0665 => 2.2045, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.68% (0.2891 => 0.3084, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.60% (0.2756 => 0.2938, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.48% (0.2872 => 0.3058, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 6.47% (0.2877 => 0.3063, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 6.44% (0.2871 => 0.3056, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.42% (0.2725 => 0.2900, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 6.32% (0.3052 => 0.3245, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 6.16% (0.3379 => 0.3587, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 6.04% (0.2714 => 0.2878, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 5.89% (0.2802 => 0.2967, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 5.81% (0.2049 => 0.2168, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.39% (7.9617 => 8.3909, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.01% (0.3136 => 0.3293, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/objinst: 4.79% (0.3131 => 0.3281, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.41% (0.3935 => 0.4069, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.86% (7.0540 => 7.2560, std.dev.: 0.0246) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.15% (1.1145 => 1.3725, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 10.25% (0.9957 => 1.0978, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/richards_benchmark: 9.96% (1.1396 => 1.2531, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 8.23% (0.1629 => 0.1763, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.95% (2.8904 => 3.0914, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.71% (3.1578 => 3.3696, std.dev.: 0.0008) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: 4.50% (3.3453 => 3.4959, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: 2.99% (1.9405 => 1.9985, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.83% (4.2280 => 4.3478, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 2.56% (4.4649 => 4.5791, std.dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.80% (0.8333 => 0.8483, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 1.54% (3.1595 => 3.2081, std.dev.: 0.0039) MultiSource/Benchmarks/nbench/nbench: 1.30% (11.6436 => 11.7954, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -76.67% (0.8651 => 0.2018, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.16% (5.3855 => 2.4146, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -54.83% (5.3526 => 2.4176, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: -45.13% (0.1622 => 0.0890, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.33% (1.1194 => 0.6791, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.97% (5.2763 => 3.2202, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -23.56% (1.7609 => 1.3461, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -17.16% (2.9384 => 2.4342, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -8.86% (54.1659 => 49.3686, std.dev.: 0.0067) MultiSource/Applications/JM/ldecod/ldecod: -8.09% (10.4361 => 9.5918, std.dev.: 0.2222) MultiSource/Benchmarks/PAQ8p/paq8p: -5.55% (10.3673 => 9.7919, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -54.03% (8.0499 => 3.7006, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0133, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.56% (1.1492 => 0.7635, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.38% (0.3987 => 0.2696, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.51% (2.9695 => 2.3606, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -19.00% (1.2258 => 0.9929, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.95% (1.6925 => 1.4225, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -11.98% (1.2373 => 1.0891, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/mandel-2: -11.01% (1.5373 => 1.3680, std.dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: -10.99% (9.5636 => 8.5129, std.dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.39% (19.9488 => 18.2755, std.dev.: 0.0129) MultiSource/Benchmarks/FreeBench/mason/mason: -7.68% (0.2161 => 0.1995, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.03% (1.8329 => 1.7041, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -5.44% (6.6465 => 6.2846, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.03% (1.6805 => 1.5959, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.89% (1.5835 => 1.5060, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.89% (0.2497 => 0.2375, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.06% (8.1563 => 7.8255, std.dev.: 0.0107) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -3.65% (3.2827 => 3.1630, std.dev.: 0.0083) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.53% (32.5116 => 31.3649, std.dev.: 0.0062) MultiSource/Benchmarks/sim/sim: -3.33% (5.0483 => 4.8803, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.85% (4.5009 => 4.3725, std.dev.: 0.0018) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.62% (0.4808 => 0.4682, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/multiplies: -2.03% (2.5528 => 2.5011, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -1.93% (10.2830 => 10.0846, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6813, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: -1.28% (85.0658 => 83.9797, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.19% (1.7254 => 1.7048, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.10% (6.2999 => 6.2304, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8578, std.dev.: 0.0090) MultiSource/Benchmarks/Olden/power/power: -1.01% (1.1277 => 1.1163, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.07% (7.1582 => 7.8075, std.dev.: 0.0052) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: 10627.78% (0.0720 => 7.7240, std.dev.: 0.1163) MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 4.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 29 01:26:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 03:26:59 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121029082659.B5E7C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5356?compare_to=5353&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5356, Order: 166915, Start Time: 2012-10-29 07:03:22, End Time: 2012-10-29 08:26:59 To: 5353, Order: 166910, Start Time: 2012-10-29 05:21:55, End Time: 2012-10-29 06:46:30 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 7 (96 on baseline) Performance Improvements: 4 (6 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 964 (872 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.78% (0.6192 => 0.6426, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/football/football: 1.16% (0.8991 => 0.9095, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.15% (1.3686 => 1.3843, std.dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.00% (13.9229 => 16.7077, std.dev.: 0.2770) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.19% (0.7536 => 0.7852, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/except: 3.03% (0.4845 => 0.4992, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.78% (2.4908 => 2.5352, std.dev.: 0.0099) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.16% (4.6275 => 4.5737, std.dev.: 0.0176) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -7.09% (22.6189 => 21.0143, std.dev.: 0.6129) SingleSource/Benchmarks/Misc/richards_benchmark: -2.20% (1.3206 => 1.2916, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/ReedSolomon: -1.44% (8.8112 => 8.6847, std.dev.: 0.0483) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.61% (16.6806 => 16.7831, std.dev.: 0.0317) MultiSource/Applications/obsequi/Obsequi: 0.22% (1.0672 => 1.0695, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: 0.56% (0.6453 => 0.6489, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/08-main/main: 0.42% (0.1917 => 0.1925, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.63% (0.1578 => 0.1651, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.28% (0.3203 => 0.3162, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.49% (0.2481 => 0.2444, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.03% (0.3276 => 0.3275, std.dev.: 0.0132) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.40% (0.2412 => 0.2354, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/bigfib: 0.22% (0.6027 => 0.6040, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: -10.55% (0.0455 => 0.0407, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.39% (0.3307 => 0.3320, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 1.52% (0.1971 => 0.2001, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 3.00% (0.0233 => 0.0240, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -15.53% (0.0219 => 0.0185, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.98% (0.0408 => 0.0412, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 25.97% (0.0258 => 0.0325, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.64% (0.0311 => 0.0313, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -14.01% (0.0421 => 0.0362, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/casts: -3.96% (0.0202 => 0.0194, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/test1: 29.55% (0.0132 => 0.0171, std.dev.: 0.0022) SingleSource/UnitTests/byval-alignment: -0.30% (0.0333 => 0.0332, std.dev.: 0.0019) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -87.50% (0.0008 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -1.91% (0.1469 => 0.1441, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.63% (1.1339 => 1.1410, std.dev.: 0.0040) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -5.59% (0.1521 => 0.1436, std.dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.71% (0.4094 => 0.4246, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.35% (0.1380 => 0.1320, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.19% (0.0638 => 0.0624, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -29.67% (0.0273 => 0.0192, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.15% (0.0601 => 0.0540, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.71% (1.1504 => 1.1422, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -42.11% (0.0019 => 0.0011, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.91% (0.0647 => 0.0557, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.54% (0.0266 => 0.0222, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.88% (0.7966 => 0.8036, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 17.39% (0.0046 => 0.0054, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.98% (2.1832 => 1.6596, std.dev.: 0.0018) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 35.76% (14.7684 => 20.0497, std.dev.: 0.0890) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.17% (0.0810 => 0.0941, std.dev.: 0.0016) SingleSource/UnitTests/SignlessTypes/rem: 12.17% (0.1035 => 0.1161, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/tsp/tsp: 11.06% (0.1112 => 0.1235, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.28% (0.1425 => 0.1543, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.07% (0.3137 => 0.3390, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.66% (0.2180 => 0.2347, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.98% (0.1905 => 0.2038, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.92% (0.6010 => 0.6426, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.85% (0.8321 => 0.8891, std.dev.: 0.0185) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.77% (0.2998 => 0.3201, std.dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 6.73% (1.2568 => 1.3414, std.dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.04% (0.4847 => 0.5140, std.dev.: 0.0030) MultiSource/Applications/spiff/spiff: 5.97% (0.7950 => 0.8425, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.87% (13.1811 => 13.9548, std.dev.: 0.0369) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.52% (0.1885 => 0.1989, std.dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.43% (6.6074 => 6.9664, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.41% (0.7473 => 0.7877, std.dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 5.19% (1.1271 => 1.1856, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.11% (0.2741 => 0.2881, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 4.77% (1.9948 => 2.0899, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.55% (0.6287 => 0.6573, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.43% (0.3003 => 0.3136, std.dev.: 0.0028) MultiSource/Applications/d/make_dparser: 4.41% (3.2366 => 3.3793, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.37% (0.9435 => 0.9847, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.32% (1.6386 => 1.7094, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.29% (0.4127 => 0.4304, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.28% (0.3295 => 0.3436, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.25% (1.3279 => 1.3843, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: 4.17% (1.2222 => 1.2732, std.dev.: 0.0115) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.16% (1.1170 => 1.1635, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.94% (0.5961 => 0.6196, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.90% (0.6227 => 0.6470, std.dev.: 0.0043) MultiSource/Applications/SPASS/SPASS: 3.84% (14.2605 => 14.8084, std.dev.: 0.0457) MultiSource/Benchmarks/Prolangs-C/football/football: 3.73% (0.8768 => 0.9095, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.72% (0.9074 => 0.9412, std.dev.: 0.0091) MultiSource/Applications/lemon/lemon: 3.69% (1.0945 => 1.1349, std.dev.: 0.0037) MultiSource/Applications/lua/lua: 3.47% (3.8189 => 3.9513, std.dev.: 0.0297) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.32% (0.8656 => 0.8943, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.30% (0.9908 => 1.0235, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.29% (1.1606 => 1.1988, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.19% (8.6476 => 8.9236, std.dev.: 0.0325) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.02% (0.6586 => 0.6785, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.01% (0.5191 => 0.5347, std.dev.: 0.0025) MultiSource/Applications/hbd/hbd: 2.99% (1.4269 => 1.4695, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.98% (1.2602 => 1.2977, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.90% (0.8007 => 0.8239, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.89% (0.9056 => 0.9318, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.85% (0.8611 => 0.8856, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.84% (0.8317 => 0.8553, std.dev.: 0.0042) MultiSource/Applications/JM/ldecod/ldecod: 2.80% (6.7320 => 6.9205, std.dev.: 0.0633) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.78% (0.8712 => 0.8954, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.70% (3.1832 => 3.2690, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.66% (0.7932 => 0.8143, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 2.62% (0.4125 => 0.4233, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.61% (0.8286 => 0.8502, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.59% (0.8697 => 0.8922, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.57% (2.1401 => 2.1951, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.57% (0.8885 => 0.9113, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.49% (0.9039 => 0.9264, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.48% (0.8261 => 0.8466, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.43% (0.8518 => 0.8725, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.41% (0.8340 => 0.8541, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.40% (0.8716 => 0.8925, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.31% (0.8927 => 0.9133, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.29% (0.8066 => 0.8251, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.29% (0.8086 => 0.8271, std.dev.: 0.0069) MultiSource/Applications/JM/lencod/lencod: 2.25% (15.3280 => 15.6726, std.dev.: 0.0942) MultiSource/Applications/siod/siod: 2.24% (2.2184 => 2.2681, std.dev.: 0.0177) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.23% (4.4880 => 4.5881, std.dev.: 0.0050) MultiSource/Applications/oggenc/oggenc: 2.21% (4.9628 => 5.0726, std.dev.: 0.0286) MultiSource/Benchmarks/MallocBench/gs/gs: 2.19% (4.1305 => 4.2211, std.dev.: 0.0253) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.16% (4.5702 => 4.6687, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 2.12% (0.6834 => 0.6979, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.10% (0.8316 => 0.8491, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.07% (4.1763 => 4.2626, std.dev.: 0.0204) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.06% (1.2423 => 1.2679, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.93% (4.4873 => 4.5737, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.86% (0.9688 => 0.9868, std.dev.: 0.0049) MultiSource/Benchmarks/PAQ8p/paq8p: 1.83% (2.3764 => 2.4200, std.dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.63% (1.5315 => 1.5564, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.32% (0.8995 => 0.9114, std.dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 59.09% (1.5795 => 2.5128, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.08% (14.6451 => 16.7077, std.dev.: 0.2770) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.51% (2.4333 => 2.6890, std.dev.: 0.0176) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.91% (0.3186 => 0.3470, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.38% (1.1857 => 1.2851, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 5.97% (63.1822 => 66.9547, std.dev.: 0.2183) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.52% (2.4490 => 2.5352, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.36% (0.7597 => 0.7852, std.dev.: 0.0087) MultiSource/Applications/siod/siod: 2.85% (3.6643 => 3.7686, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/ReedSolomon: 1.79% (8.5322 => 8.6847, std.dev.: 0.0483) SingleSource/Benchmarks/Shootout-C++/heapsort: 1.74% (3.0515 => 3.1046, std.dev.: 0.0169) MultiSource/Benchmarks/Olden/bh/bh: 1.73% (2.3560 => 2.3967, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.05% (4.8362 => 4.8869, std.dev.: 0.0137) MultiSource/Benchmarks/BitBench/five11/five11: 1.02% (5.6030 => 5.6600, std.dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.29% (0.3269 => 0.2998, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -7.13% (0.1430 => 0.1328, std.dev.: 0.0039) MultiSource/Applications/lua/lua: -5.25% (29.8330 => 28.2664, std.dev.: 0.0803) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.18% (0.2605 => 0.2496, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash2: -1.39% (3.4237 => 3.3760, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.30% (3.3479 => 3.3044, std.dev.: 0.0040) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 2.05% (16.4461 => 16.7831, std.dev.: 0.0317) MultiSource/Applications/obsequi/Obsequi: 4.22% (1.0262 => 1.0695, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: 2.48% (0.6332 => 0.6489, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/08-main/main: 5.13% (0.1831 => 0.1925, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 5.90% (0.1559 => 0.1651, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.25% (0.3123 => 0.3162, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.77% (0.2463 => 0.2444, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.06% (0.3344 => 0.3275, std.dev.: 0.0132) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.42% (0.2364 => 0.2354, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/bigfib: 0.50% (0.6010 => 0.6040, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: -5.13% (0.0429 => 0.0407, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.65% (0.3266 => 0.3320, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 1.63% (0.1969 => 0.2001, std.dev.: 0.0004) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.14% (0.0224 => 0.0240, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 50.41% (0.0123 => 0.0185, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.98% (0.0408 => 0.0412, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 27.95% (0.0254 => 0.0325, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -5.73% (0.0384 => 0.0362, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/casts: 2.11% (0.0190 => 0.0194, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/test1: -5.00% (0.0180 => 0.0171, std.dev.: 0.0022) SingleSource/UnitTests/byval-alignment: 44.35% (0.0230 => 0.0332, std.dev.: 0.0019) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.21% (0.1438 => 0.1441, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.71% (1.1329 => 1.1410, std.dev.: 0.0040) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -1.78% (0.1462 => 0.1436, std.dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.97% (0.4164 => 0.4246, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.58% (0.1369 => 0.1320, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.65% (0.0641 => 0.0624, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.54% (0.0195 => 0.0192, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.57% (0.0578 => 0.0540, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.13% (1.1437 => 1.1422, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1000.00% (0.0001 => 0.0011, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.16% (0.0627 => 0.0557, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.33% (0.0180 => 0.0222, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.24% (0.8017 => 0.8036, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -12.90% (0.0062 => 0.0054, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 29 01:46:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 03:46:09 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121029084609.8FBB02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5357?compare_to=5354&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5357, Order: 166915, Start Time: 2012-10-29 07:20:53, End Time: 2012-10-29 08:46:07 To: 5354, Order: 166910, Start Time: 2012-10-29 05:27:40, End Time: 2012-10-29 06:53:16 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (174 on baseline) Unchanged Tests: 1042 (863 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.29% (15.2527 => 18.3478, std.dev.: 0.0106) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.29% (1.2783 => 1.3715, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.89% (2.0478 => 2.1069, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: 2.46% (7.4937 => 7.6777, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/hash2: 2.21% (3.1932 => 3.2637, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.52% (0.1584 => 0.1449, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.32% (0.1431 => 0.1312, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: -6.84% (0.3831 => 0.3569, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -6.80% (0.3880 => 0.3616, std.dev.: 0.0045) MultiSource/Benchmarks/PAQ8p/paq8p: -6.80% (2.4924 => 2.3229, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: -6.77% (0.3812 => 0.3554, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.75% (0.3884 => 0.3622, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.73% (0.3821 => 0.3564, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: -6.72% (0.3896 => 0.3634, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.71% (0.3891 => 0.3630, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.65% (0.3142 => 0.2933, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.62% (0.4033 => 0.3766, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.60% (0.3848 => 0.3594, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions: -6.51% (0.4176 => 0.3904, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.51% (0.2428 => 0.2270, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.39% (22.4056 => 20.9731, std.dev.: 0.0143) SingleSource/UnitTests/ObjC/property: -6.36% (0.4199 => 0.3932, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.34% (0.3658 => 0.3426, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -6.28% (0.1879 => 0.1761, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: -6.19% (0.4280 => 0.4015, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -6.06% (0.2160 => 0.2029, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.05% (0.3025 => 0.2842, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.04% (4.5069 => 4.2347, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/strcat: -6.02% (0.2989 => 0.2809, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -6.02% (0.3357 => 0.3155, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: -6.01% (0.3026 => 0.2844) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.00% (0.9852 => 0.9261, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.95% (0.3057 => 0.2875, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.93% (0.3252 => 0.3059, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: -5.93% (0.3255 => 0.3062, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -5.92% (0.2939 => 0.2765, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.91% (0.9542 => 0.8978, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.90% (2.1713 => 2.0433, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.89% (0.3837 => 0.3611, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -5.89% (1.3148 => 1.2374, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.88% (3.5339 => 3.3262, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.86% (5.4682 => 5.1478, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.86% (0.4813 => 0.4531, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.86% (0.2903 => 0.2733, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -5.85% (0.3194 => 0.3007, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.85% (0.3849 => 0.3624, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.85% (0.6484 => 0.6105, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.83% (0.4151 => 0.3909, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.83% (0.4083 => 0.3845, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.82% (0.2355 => 0.2218, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: -5.79% (0.2659 => 0.2505, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -5.79% (0.2849 => 0.2684, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -5.78% (0.7779 => 0.7329, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary2: -5.77% (0.3481 => 0.3280, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: -5.76% (0.3788 => 0.3570, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: -5.74% (7.0961 => 6.6888, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.74% (0.3016 => 0.2843, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.72% (0.3323 => 0.3133, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: -5.72% (0.3446 => 0.3249, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -5.72% (0.3621 => 0.3414, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: -5.71% (0.2871 => 0.2707, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -5.70% (0.4861 => 0.4584, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: -5.70% (1.2515 => 1.1802, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/wc: -5.68% (0.3205 => 0.3023, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.67% (4.8161 => 4.5432, std.dev.: 0.0151) MultiSource/Applications/JM/lencod/lencod: -5.65% (16.1920 => 15.2772, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/ary: -5.60% (0.3394 => 0.3204, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -5.60% (34.0927 => 32.1852, std.dev.: 0.0364) MultiSource/Applications/siod/siod: -5.58% (2.4021 => 2.2681, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.54% (4.8802 => 4.6097, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/gs/gs: -5.54% (4.3330 => 4.0929, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: -5.54% (0.6750 => 0.6376, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.52% (1.6474 => 1.5565, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: -5.51% (0.3867 => 0.3654, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.50% (1.0544 => 0.9964, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.50% (1.2210 => 1.1539, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.49% (0.3931 => 0.3715, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.48% (0.5999 => 0.5670, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/Hello: -5.48% (0.6347 => 0.5999, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.48% (1.2784 => 1.2084, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: -5.46% (0.6441 => 0.6089, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -5.46% (0.3059 => 0.2892, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.46% (1.2221 => 1.1554, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.44% (0.4427 => 0.4186, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -5.42% (0.4524 => 0.4279, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.38% (0.7919 => 0.7493, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.35% (4.0323 => 3.8165, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.34% (0.6293 => 0.5957, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.34% (0.2548 => 0.2412, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.28% (0.8521 => 0.8071, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: -5.23% (0.2985 => 0.2829, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -5.23% (0.4248 => 0.4026, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.18% (0.3491 => 0.3310, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.16% (0.4321 => 0.4098, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.14% (0.2278 => 0.2161, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: -5.13% (18.2933 => 17.3545, std.dev.: 0.0166) MultiSource/Applications/lua/lua: -5.13% (4.0594 => 3.8512, std.dev.: 0.0061) MultiSource/Benchmarks/mafft/pairlocalalign: -5.13% (9.2283 => 8.7551, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.11% (1.6364 => 1.5527, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.11% (0.2933 => 0.2783, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.07% (2.2587 => 2.1442, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.06% (0.7198 => 0.6834, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.04% (0.2999 => 0.2848, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.99% (0.6230 => 0.5919, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.95% (0.5478 => 0.5207, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.94% (0.6676 => 0.6346, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.93% (0.5802 => 0.5516, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.93% (0.5805 => 0.5519, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.93% (1.3722 => 1.3046, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.92% (0.5857 => 0.5569, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.90% (0.9557 => 0.9089, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.88% (0.5591 => 0.5318, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.87% (0.5705 => 0.5427, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.86% (0.6660 => 0.6336, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.86% (0.5859 => 0.5574, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.86% (1.4642 => 1.3930, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.86% (0.6297 => 0.5991, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: -4.85% (0.7982 => 0.7595, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.83% (0.5863 => 0.5580, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.79% (0.6194 => 0.5897, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.78% (0.6052 => 0.5763, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/18-imp/imp: -4.78% (0.3581 => 0.3410, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.77% (0.6304 => 0.6003, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.77% (0.6681 => 0.6362, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.76% (0.5925 => 0.5643, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.76% (0.5570 => 0.5305, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.74% (0.6395 => 0.6092, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.74% (0.5575 => 0.5311, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.73% (0.5456 => 0.5198, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.71% (0.6667 => 0.6353, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.69% (0.7339 => 0.6995, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.68% (0.4916 => 0.4686, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.65% (0.6189 => 0.5901, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.62% (0.6260 => 0.5971, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.61% (0.5569 => 0.5312, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.61% (0.5941 => 0.5667, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.60% (0.5849 => 0.5580, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.60% (0.7524 => 0.7178, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.58% (0.6440 => 0.6145, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.58% (0.5567 => 0.5312, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.55% (0.5688 => 0.5429, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.54% (0.6033 => 0.5759, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.53% (0.5581 => 0.5328, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -4.47% (0.4515 => 0.4313, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: -4.46% (0.7447 => 0.7115, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.44% (0.6395 => 0.6111, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: -4.39% (0.9179 => 0.8776, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.36% (0.2385 => 0.2281, std.dev.: 0.0019) MultiSource/Applications/spiff/spiff: -4.35% (0.8418 => 0.8052, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: -4.32% (1.1450 => 1.0955, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.20% (0.3406 => 0.3263, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: -4.14% (15.5079 => 14.8653, std.dev.: 0.0222) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.13% (8.0126 => 7.6815, std.dev.: 0.0073) MultiSource/Applications/treecc/treecc: -4.11% (2.1401 => 2.0521, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.06% (0.7021 => 0.6736, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.04% (0.3319 => 0.3185, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: -4.04% (0.3271 => 0.3139, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.93% (0.5168 => 0.4965, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: -3.93% (1.5610 => 1.4997, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.88% (0.9077 => 0.8725, std.dev.: 0.0032) MultiSource/Applications/oggenc/oggenc: -3.86% (5.0226 => 4.8286, std.dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.85% (6.7716 => 6.5107, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.82% (0.3483 => 0.3350, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: -3.74% (17.1032 => 16.4634, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.69% (1.2300 => 1.1846, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.64% (0.5329 => 0.5135, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: -3.63% (3.5154 => 3.3877, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.62% (0.6736 => 0.6492, std.dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: -3.42% (1.1530 => 1.1136, std.dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -3.36% (20.7746 => 20.0771, std.dev.: 0.0239) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.18% (14.2083 => 13.7563, std.dev.: 0.0102) MultiSource/Applications/SIBsim4/SIBsim4: -1.72% (1.3864 => 1.3626, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7543, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: -8.73% (1.2842 => 1.1721, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: -3.92% (2.2633 => 2.1745, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4730, std.dev.: 0.0033) Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 29 02:53:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 04:53:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121029095355.971392A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5358?compare_to=5355&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5358, Order: 166915, Start Time: 2012-10-29 08:22:41, End Time: 2012-10-29 09:53:55 To: 5355, Order: 166911, Start Time: 2012-10-29 06:18:13, End Time: 2012-10-29 07:52:49 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (10 on baseline) New Passes: 0 (14 on baseline) Performance Regressions: 0 (188 on baseline) Performance Improvements: 0 (55 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 15 (5 on baseline) Unchanged Tests: 1027 (636 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -0.25% (2.0541 => 2.0490, std.dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: -0.08% (57.8222 => 57.7769, std.dev.: 0.0705) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.79% (0.0825 => 0.0802, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -0.09% (9.2381 => 9.2302, std.dev.: 0.0122) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.02% (7.8075 => 7.8058, std.dev.: 0.0034) SingleSource/UnitTests/Vector/SSE/sse_shift: -1.90% (0.0526 => 0.0516, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/JM/lencod/lencod: -0.02% (7.7240 => 7.7224, std.dev.: 0.0143) MultiSource/Applications/oggenc/oggenc: - (0.0001 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0648 => 0.0647, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.07% (0.2990 => 0.2992, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_shift: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -64.42% (5.7591 => 2.0490, std.dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: -8.64% (63.2438 => 57.7769, std.dev.: 0.0705) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.80% (6.6874 => 0.0802, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.44% (8.1363 => 9.2302, std.dev.: 0.0122) SingleSource/UnitTests/Vector/SSE/sse_shift: 36.51% (0.0378 => 0.0516, std.dev.: 0.0009) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -50.00% (0.0002 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -57.02% (0.6962 => 0.2992, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_shift: -50.00% (0.0002 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 212.32% (0.5229 => 1.6331, std.dev.: 0.0040) MultiSource/Applications/SPASS/SPASS: 17.66% (14.9895 => 17.6366, std.dev.: 0.0286) MultiSource/Applications/kimwitu++/kc: 37.69% (14.1553 => 19.4901, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/gs/gs: 13.86% (4.1105 => 4.6802, std.dev.: 0.0198) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 33.13% (1.1048 => 1.4708, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 69.18% (3.4629 => 5.8585, std.dev.: 0.0205) SingleSource/Benchmarks/Misc-C++/stepanov_container: 68.42% (0.6222 => 1.0479, std.dev.: 0.0014) New Passes - Execution Time --------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 3836300.00% (0.0001 => 3.8364, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 11146800.00% (0.0001 => 11.1469, std.dev.: 0.0603) MultiSource/Applications/kimwitu++/kc: 50500.00% (0.0001 => 0.0506, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14400.00% (0.0001 => 0.0145, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050100.00% (0.0001 => 10.0502, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5485500.00% (0.0001 => 5.4856, std.dev.: 0.0182) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 78.04% (0.0296 => 0.0527) SingleSource/Benchmarks/Misc/lowercase: 69.53% (0.0256 => 0.0434, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 61.25% (0.0271 => 0.0437, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 52.67% (0.0243 => 0.0371, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 44.35% (1.5859 => 2.2893, std.dev.: 0.0073) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.73% (0.0834 => 0.1182, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 41.00% (0.1056 => 0.1489, std.dev.: 0.0002) SingleSource/UnitTests/vla: 36.06% (0.0355 => 0.0483, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 35.54% (2.2024 => 2.9852, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 33.83% (0.1463 => 0.1958) SingleSource/Benchmarks/McGill/chomp: 28.52% (0.1655 => 0.2127, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 28.42% (0.1432 => 0.1839, std.dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 24.03% (0.0462 => 0.0573, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.97% (0.1566 => 0.1910, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/rem: 21.94% (0.1144 => 0.1395, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.23% (0.5105 => 0.6189, std.dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.78% (0.0871 => 0.1052, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 20.77% (0.1555 => 0.1878, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 19.48% (0.6675 => 0.7975, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.24% (0.2271 => 0.2708, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 19.21% (1.3050 => 1.5557, std.dev.: 0.0023) MultiSource/Applications/d/make_dparser: 18.83% (3.3354 => 3.9636, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/n-body: 18.63% (0.0746 => 0.0885, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.57% (0.5020 => 0.5952, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/almabench: 18.49% (0.0730 => 0.0865, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 18.30% (0.1175 => 0.1390, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 18.29% (0.7115 => 0.8416, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/08-main/main: 18.17% (0.2554 => 0.3018, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 18.12% (0.1584 => 0.1871, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 17.96% (0.1236 => 0.1458, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.83% (0.1032 => 0.1216, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 17.82% (0.1695 => 0.1997, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.78% (0.0793 => 0.0934, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: 17.73% (0.0626 => 0.0737, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.72% (1.5415 => 1.8146, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.62% (0.1510 => 0.1776, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.57% (0.4615 => 0.5426, std.dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 17.54% (1.1840 => 1.3917, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.43% (0.1337 => 0.1570, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 17.37% (0.3109 => 0.3649, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 17.34% (0.4879 => 0.5725, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/mst/mst: 17.28% (0.1163 => 0.1364, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.08% (0.8172 => 0.9568, std.dev.: 0.0053) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 17.06% (0.3177 => 0.3719, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.95% (0.6450 => 0.7543, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 16.79% (0.2603 => 0.3040, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.59% (0.0886 => 0.1033, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 16.55% (0.1940 => 0.2261, std.dev.: 0.0016) MultiSource/Applications/aha/aha: 16.51% (0.1151 => 0.1341, std.dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: 16.46% (22.1758 => 25.8253, std.dev.: 0.0393) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.30% (0.0675 => 0.0785, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.21% (0.3121 => 0.3627, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 16.16% (0.1906 => 0.2214, std.dev.: 0.0034) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.10% (0.1143 => 0.1327, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/exptree: 16.09% (0.0814 => 0.0945, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 16.03% (0.0842 => 0.0977, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.74% (0.9765 => 1.1302, std.dev.: 0.0045) MultiSource/Applications/lemon/lemon: 15.71% (1.0722 => 1.2406, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 15.64% (1.1642 => 1.3463, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 15.63% (0.0672 => 0.0777, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 15.48% (0.0730 => 0.0843, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: 15.44% (2.0273 => 2.3403, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/football/football: 15.38% (0.8921 => 1.0293, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.35% (1.1861 => 1.3682, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 15.34% (0.1695 => 0.1955, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.34% (0.2758 => 0.3181, std.dev.: 0.0026) MultiSource/Applications/spiff/spiff: 15.33% (0.7835 => 0.9036, std.dev.: 0.0078) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 15.29% (0.1125 => 0.1297, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.23% (0.2107 => 0.2428, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/voronoi/voronoi: 15.15% (0.2700 => 0.3109, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.14% (0.1625 => 0.1871, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.13% (0.1117 => 0.1286, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/18-imp/imp: 15.07% (0.3423 => 0.3939, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.01% (0.0933 => 0.1073, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 14.93% (1.4186 => 1.6304, std.dev.: 0.0070) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.89% (0.0759 => 0.0872, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 14.84% (0.4299 => 0.4937, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.81% (0.5981 => 0.6867, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.81% (0.0770 => 0.0884, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.74% (0.5860 => 0.6724, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.60% (0.1062 => 0.1217, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.59% (0.1330 => 0.1524, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/lpbench: 14.53% (0.0929 => 0.1064, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.33% (0.2065 => 0.2361, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.31% (4.2646 => 4.8748, std.dev.: 0.0116) MultiSource/Applications/lambda-0_1_3/lambda: 14.29% (0.7433 => 0.8495, std.dev.: 0.0042) MultiSource/Applications/lua/lua: 14.21% (3.8723 => 4.4226, std.dev.: 0.0201) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.19% (0.1029 => 0.1175, std.dev.: 0.0019) MultiSource/Benchmarks/sim/sim: 13.94% (0.3387 => 0.3859, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.81% (0.5569 => 0.6338, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.78% (0.0798 => 0.0908, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.73% (0.3307 => 0.3761, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.64% (0.0770 => 0.0875, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 13.55% (9.4845 => 10.7698, std.dev.: 0.0103) MultiSource/Benchmarks/Olden/health/health: 13.17% (0.1268 => 0.1435, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.08% (0.3441 => 0.3891, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/bh/bh: 12.90% (0.3092 => 0.3491, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 12.65% (0.0838 => 0.0944, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.44% (0.3826 => 0.4302, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: 12.42% (0.3180 => 0.3575, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.00% (0.1892 => 0.2119, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 11.86% (0.0953 => 0.1066, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 11.80% (2.2969 => 2.5679, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.47% (0.8101 => 0.9030, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 11.30% (0.1044 => 0.1162, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.27% (14.3668 => 15.9858, std.dev.: 0.0161) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.18% (5.0018 => 5.5610, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.18% (4.9449 => 5.4976, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++/bigfib: 11.07% (0.6456 => 0.7171, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 10.91% (0.4620 => 0.5124, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 10.87% (0.4289 => 0.4755, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.85% (0.3427 => 0.3799, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 10.85% (17.1811 => 19.0461, std.dev.: 0.0237) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.36% (2.2022 => 2.4304, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/parameter-passing: 10.13% (0.3927 => 0.4325, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 9.91% (0.3422 => 0.3761, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions: 9.85% (0.3828 => 0.4205, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.79% (0.3543 => 0.3890, std.dev.: 0.0062) SingleSource/UnitTests/ObjC/trivial-interface: 9.73% (0.3473 => 0.3811, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.72% (0.3694 => 0.4053, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.71% (0.3543 => 0.3887, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.66% (0.3561 => 0.3905, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.58% (0.3516 => 0.3853, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.58% (0.3497 => 0.3832, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.52% (0.3865 => 0.4233, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 9.47% (0.3886 => 0.4254, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.45% (0.4636 => 0.5074, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.40% (0.2266 => 0.2479, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.37% (3.8922 => 4.2570, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.35% (0.4203 => 0.4596, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 9.31% (1.5603 => 1.7056, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/moments: 9.24% (0.4048 => 0.4422, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.18% (0.2430 => 0.2653, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 9.09% (0.3684 => 0.4019, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.09% (0.4103 => 0.4476, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: 8.27% (0.3603 => 0.3901, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.10% (0.4064 => 0.4393, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 7.79% (0.6030 => 0.6500, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/oourafft: 7.71% (0.3282 => 0.3535, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.56% (0.3650 => 0.3926, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.56% (0.5925 => 0.6373, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 7.26% (0.3098 => 0.3323, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.20% (0.8067 => 0.8648, std.dev.: 0.0084) SingleSource/UnitTests/ObjC++/property-reference: 7.19% (0.7326 => 0.7853, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.12% (0.2793 => 0.2992, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.3283 => 0.3514, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.02% (0.3162 => 0.3384, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 6.95% (0.2905 => 0.3107, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.90% (0.3232 => 0.3455, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: 6.85% (0.2831 => 0.3025, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.71% (0.2891 => 0.3085, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.53% (2.0665 => 2.2014, std.dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: 6.52% (1.2842 => 1.3679, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/methcall: 6.50% (0.2877 => 0.3064, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.48% (0.2872 => 0.3058, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.44% (0.2871 => 0.3056, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 6.28% (0.2725 => 0.2896, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.23% (0.3052 => 0.3242, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.20% (0.2756 => 0.2927, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.19% (0.2714 => 0.2882, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.16% (0.3379 => 0.3587, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 5.85% (0.2802 => 0.2966, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 5.81% (0.2049 => 0.2168, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.35% (7.9617 => 8.3874, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.97% (0.3136 => 0.3292, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 4.73% (0.3131 => 0.3279, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.43% (0.3935 => 0.4070, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.79% (7.0540 => 7.2507, std.dev.: 0.0115) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8953, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.11% (1.1145 => 1.3721, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 10.50% (0.9957 => 1.1002, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/richards_benchmark: 9.81% (1.1396 => 1.2514, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.95% (2.8904 => 3.0913, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (3.1578 => 3.3673, std.dev.: 0.0016) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: 4.50% (3.3453 => 3.4959, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 3.00% (1.9405 => 1.9987, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.79% (4.2280 => 4.3458, std.dev.: 0.0046) MultiSource/Applications/viterbi/viterbi: 2.50% (4.4649 => 4.5763, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 1.79% (0.8333 => 0.8482, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 1.51% (3.1595 => 3.2073, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.49% (9.1159 => 9.2519, std.dev.: 0.0297) MultiSource/Benchmarks/nbench/nbench: 1.31% (11.6436 => 11.7960, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -76.68% (0.8651 => 0.2017, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.20% (5.3855 => 2.4128, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -54.91% (5.3526 => 2.4136, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/richards_benchmark: -45.07% (0.1622 => 0.0891, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.23% (1.1194 => 0.6803, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.96% (5.2763 => 3.2208, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -23.56% (1.7609 => 1.3461, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -17.16% (2.9384 => 2.4342, std.dev.: 0.0063) SingleSource/UnitTests/Vector/constpool: -8.92% (54.1659 => 49.3324, std.dev.: 0.0104) MultiSource/Applications/JM/ldecod/ldecod: -8.12% (10.4361 => 9.5892, std.dev.: 0.0275) MultiSource/Benchmarks/PAQ8p/paq8p: -5.56% (10.3673 => 9.7912, std.dev.: 0.0101) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -54.06% (8.0499 => 3.6981, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0133, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.33% (1.1492 => 0.7662, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.61% (0.0506 => 0.0341, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.38% (0.3987 => 0.2696, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.51% (2.9695 => 2.3605, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -19.00% (1.2258 => 0.9929, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.96% (1.6925 => 1.4224, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -11.75% (1.2373 => 1.0919, std.dev.: 0.0050) MultiSource/Benchmarks/NPB-serial/is/is: -10.99% (9.5636 => 8.5130, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/mandel-2: -10.80% (1.5373 => 1.3712, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.32% (19.9488 => 18.2899, std.dev.: 0.0968) MultiSource/Benchmarks/FreeBench/mason/mason: -8.01% (0.2161 => 0.1988, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.02% (1.8329 => 1.7042, std.dev.: 0.0176) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8479, std.dev.: 0.0154) SingleSource/Benchmarks/Misc/oourafft: -5.45% (6.6465 => 6.2840, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.09% (1.6805 => 1.5950, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.97% (1.5835 => 1.5048, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.89% (0.2497 => 0.2375, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.95% (8.1563 => 7.8345, std.dev.: 0.0049) MultiSource/Applications/siod/siod: -3.77% (3.2827 => 3.1590, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.73% (1.3677 => 1.3167, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.52% (32.5116 => 31.3679, std.dev.: 0.0061) MultiSource/Benchmarks/sim/sim: -3.33% (5.0483 => 4.8802, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: -2.92% (4.6441 => 4.5086, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.79% (4.5009 => 4.3752, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.77% (0.4808 => 0.4675, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/multiplies: -1.97% (2.5528 => 2.5026, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -1.84% (10.2830 => 10.0933, std.dev.: 0.0136) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6804, std.dev.: 0.0024) MultiSource/Benchmarks/PAQ8p/paq8p: -1.28% (85.0658 => 83.9734, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/lists: -1.28% (6.2999 => 6.2190, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7055, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8588, std.dev.: 0.0161) MultiSource/Benchmarks/Olden/power/power: -1.01% (1.1277 => 1.1163) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.05% (7.1582 => 7.8058, std.dev.: 0.0034) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: 10625.56% (0.0720 => 7.7224, std.dev.: 0.0143) MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.42% (0.2116 => 0.0647, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 29 03:56:08 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 05:56:08 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121029105608.3010B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5359?compare_to=5352&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5359, Order: 166915, Start Time: 2012-10-29 07:40:25, End Time: 2012-10-29 10:56:07 To: 5352, Order: 166909, Start Time: 2012-10-29 03:29:24, End Time: 2012-10-29 06:44:57 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (169 on baseline) Performance Improvements: 1 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1040 (721 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.91% (123.9142 => 128.7633, std.dev.: 1.4965) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.69% (0.6206 => 0.6101, std.dev.: 0.0006) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.12% (0.0625 => 0.0882, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.70% (0.1063 => 0.1400, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.67% (0.2969 => 0.3731, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 24.95% (0.1106 => 0.1382, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 24.52% (1.5932 => 1.9839, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 23.89% (0.4139 => 0.5128, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.35% (0.4253 => 0.5246, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.25% (0.0714 => 0.0880, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.03% (0.0547 => 0.0673, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 22.85% (0.4994 => 0.6135, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.78% (0.5000 => 0.6139, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.74% (0.0475 => 0.0583, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.71% (0.5900 => 0.7240, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.26% (0.0584 => 0.0714, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.67% (0.1620 => 0.1971, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.45% (0.1021 => 0.1240, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 21.37% (0.0599 => 0.0727, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.18% (0.0897 => 0.1087, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.14% (0.1107 => 0.1341, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.54% (0.0633 => 0.0763, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 20.04% (0.0948 => 0.1138, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.04% (0.1103 => 0.1324, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.03% (0.0584 => 0.0701, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 20.03% (0.0604 => 0.0725, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.96% (0.0541 => 0.0649, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.94% (0.0642 => 0.0770, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: 19.85% (0.0821 => 0.0984) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.71% (0.0822 => 0.0984, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 19.58% (0.1619 => 0.1936, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.57% (0.3903 => 0.4667, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.54% (0.1003 => 0.1199, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.50% (0.1549 => 0.1851, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.45% (0.1604 => 0.1916, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.40% (0.1462 => 0.1731, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 18.37% (0.0947 => 0.1121, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.83% (0.2014 => 0.2373, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 17.82% (0.0808 => 0.0952, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.81% (0.3890 => 0.4583, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 17.65% (0.1218 => 0.1433, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 17.54% (0.5826 => 0.6848, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.38% (1.3152 => 1.5438, std.dev.: 0.0054) MultiSource/Applications/spiff/spiff: 17.27% (0.4029 => 0.4725, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference-object: 17.27% (0.5889 => 0.6906, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.14% (0.2736 => 0.3205, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.10% (0.1088 => 0.1274, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 17.08% (0.1505 => 0.1762, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 17.05% (0.0698 => 0.0817, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.01% (0.2875 => 0.3364, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.88% (3.5627 => 4.1640, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.78% (0.2866 => 0.3347, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 16.59% (0.5546 => 0.6466, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 16.55% (0.2725 => 0.3176, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 16.49% (1.8794 => 2.1893, std.dev.: 0.0087) SingleSource/Regression/C++/ofstream_ctor: 16.44% (0.3004 => 0.3498, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hello: 16.43% (0.2714 => 0.3160, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.38% (0.2729 => 0.3176, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.38% (0.1160 => 0.1350, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.38% (1.6211 => 1.8866, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.36% (0.2738 => 0.3186, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 16.15% (0.2750 => 0.3194, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.11% (0.1968 => 0.2285, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.06% (0.4658 => 0.5406, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 16.04% (0.9697 => 1.1252, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 16.02% (0.2803 => 0.3252, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.93% (0.3271 => 0.3792, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 15.89% (0.3096 => 0.3588, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.87% (0.2792 => 0.3235, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 15.85% (0.2813 => 0.3259, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 15.83% (0.2823 => 0.3270, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 15.83% (0.1421 => 0.1646, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 15.79% (0.2780 => 0.3219, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 15.77% (0.9909 => 1.1472, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/except: 15.72% (0.2811 => 0.3253, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.70% (2.0673 => 2.3919, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.65% (0.3195 => 0.3695, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 15.53% (0.7171 => 0.8285, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.49% (0.2911 => 0.3362, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary2: 15.44% (0.3317 => 0.3829, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.43% (0.4361 => 0.5034, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 15.43% (0.3267 => 0.3771, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.42% (0.5026 => 0.5801, std.dev.: 0.0033) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.42% (2.7292 => 3.1500, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.34% (0.3930 => 0.4533, std.dev.: 0.0052) MultiSource/Applications/d/make_dparser: 15.31% (1.0781 => 1.2432, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary: 15.25% (0.3258 => 0.3755, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.08% (0.3362 => 0.3869, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 15.05% (0.3469 => 0.3991, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/bh/bh: 15.03% (0.1284 => 0.1477, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.03% (1.9694 => 2.2654, std.dev.: 0.0042) MultiSource/Applications/ClamAV/clamscan: 14.96% (4.2109 => 4.8410, std.dev.: 0.0092) MultiSource/Benchmarks/Bullet/bullet: 14.80% (23.5202 => 27.0019, std.dev.: 0.0420) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.77% (0.3060 => 0.3512, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 14.76% (4.4195 => 5.0719, std.dev.: 0.0128) SingleSource/UnitTests/ObjC/for-in: 14.73% (0.3496 => 0.4011, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 14.72% (0.3465 => 0.3975, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 14.71% (0.3446 => 0.3953, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 14.70% (0.3348 => 0.3840, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.65% (0.3488 => 0.3999, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 14.61% (0.3442 => 0.3945, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.59% (1.9966 => 2.2880, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-3: 14.57% (0.3460 => 0.3964, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.56% (0.3124 => 0.3579, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 14.55% (0.3678 => 0.4213, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.37% (0.3625 => 0.4146, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.31% (0.1090 => 0.1246, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 14.27% (0.3650 => 0.4171, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.23% (0.3282 => 0.3749, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/parameter-passing: 14.12% (0.3724 => 0.4250, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 14.11% (0.3643 => 0.4157, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 13.98% (0.3477 => 0.3963, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 13.96% (0.3726 => 0.4246, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 13.84% (0.4146 => 0.4720, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.81% (0.3845 => 0.4376, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.74% (0.3690 => 0.4197, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 13.67% (0.4251 => 0.4832, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.59% (0.3981 => 0.4522, std.dev.: 0.0051) MultiSource/Benchmarks/nbench/nbench: 13.56% (0.2566 => 0.2914, std.dev.: 0.0017) MultiSource/Applications/lua/lua: 13.55% (1.4269 => 1.6202, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 13.54% (0.2075 => 0.2356, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 13.43% (0.5012 => 0.5685, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 13.02% (0.7875 => 0.8900, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 12.79% (2.1653 => 2.4422, std.dev.: 0.0040) MultiSource/Applications/JM/lencod/lencod: 12.56% (4.6177 => 5.1976, std.dev.: 0.0217) MultiSource/Benchmarks/mafft/pairlocalalign: 12.22% (2.1013 => 2.3580, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.72% (0.2040 => 0.2279, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 11.51% (5.5417 => 6.1793, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.45% (0.6435 => 0.7172, std.dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: 11.33% (0.2691 => 0.2996, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.89% (0.1028 => 0.1140, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 10.66% (0.3498 => 0.3871, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.63% (0.2737 => 0.3028, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.27% (0.1383 => 0.1525, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.25% (0.2068 => 0.2280, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 9.90% (0.6634 => 0.7291, std.dev.: 0.0031) MultiSource/Benchmarks/PAQ8p/paq8p: 9.90% (0.4847 => 0.5327, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.76% (0.3084 => 0.3385, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 9.71% (0.3336 => 0.3660, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.13% (0.2103 => 0.2295, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 8.92% (2.0346 => 2.2160, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.76% (4.6926 => 5.1036, std.dev.: 0.0074) MultiSource/Applications/lemon/lemon: 8.62% (0.2391 => 0.2597, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.30% (11.6398 => 12.6059, std.dev.: 0.0233) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.82% (0.5361 => 0.5780, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.19% (0.7426 => 0.7960, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.13% (0.5584 => 0.5982, std.dev.: 0.0042) MultiSource/Applications/kimwitu++/kc: 6.46% (11.9555 => 12.7276, std.dev.: 0.0116) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.14% (0.3792 => 0.3987, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.32% (0.2162 => 0.3531, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6537, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.22% (0.5917 => 0.6699, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 9.99% (0.2802 => 0.3082, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 6.55% (0.2122 => 0.2261, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.55% (3.3903 => 3.6123, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 5.05% (12.0509 => 12.6591, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1659, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-2: 3.88% (1.8057 => 1.8758, std.dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/dry: 2.68% (14.0481 => 14.4247, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/ary3: 2.00% (15.8721 => 16.1895, std.dev.: 0.0067) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.81% (3.1722 => 3.2295, std.dev.: 0.0024) MultiSource/Applications/viterbi/viterbi: 1.48% (46.6247 => 47.3131, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2864, std.dev.: 0.0019) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.26% (1.0142 => 1.0270, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5132, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5886, std.dev.: 0.0071) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.55% (25.4195 => 16.3826, std.dev.: 0.0173) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9778, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7746, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary2: -7.29% (0.2402 => 0.2227, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9585, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.19% (11.2080 => 10.8509, std.dev.: 0.0213) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.05% (0.6293 => 0.6101, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7744, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -2.87% (3.6262 => 3.5220, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -2.50% (17.2379 => 16.8070, std.dev.: 0.0401) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.21% (41.7953 => 40.8714, std.dev.: 0.0103) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5710, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4955, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.10% (105.3826 => 104.2197, std.dev.: 0.0438) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0455, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.05% (3.3991 => 3.3634, std.dev.: 0.0006) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 29 04:28:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 06:28:30 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121029112830.B1AEB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5360?compare_to=5356&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5360, Order: 166916, Start Time: 2012-10-29 10:04:28, End Time: 2012-10-29 11:28:30 To: 5356, Order: 166915, Start Time: 2012-10-29 07:03:22, End Time: 2012-10-29 08:26:59 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 13 (96 on baseline) Performance Improvements: 0 (5 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 962 (873 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.88% (0.2195 => 0.2346, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.79% (1.1854 => 1.2185, std.dev.: 0.0064) MultiSource/Benchmarks/McCat/05-eks/eks: 2.46% (0.4471 => 0.4581, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.29% (0.8585 => 0.8782, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.89% (1.1635 => 1.1855, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.73% (0.8502 => 0.8649, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: 1.66% (1.2732 => 1.2943, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.48% (0.9114 => 0.9249, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.38% (0.9868 => 1.0004, std.dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 1.09% (1.3414 => 1.3560, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 13.16% (21.0143 => 23.7797, std.dev.: 0.1332) MultiSource/Benchmarks/Prolangs-C++/life/life: 2.94% (2.5657 => 2.6412, std.dev.: 0.0268) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.02% (1.6029 => 1.6193, std.dev.: 0.0025) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.44% (16.7831 => 16.7086, std.dev.: 0.1115) MultiSource/Applications/obsequi/Obsequi: 1.12% (1.0695 => 1.0815, std.dev.: 0.0078) MultiSource/Applications/sqlite3/sqlite3: -0.14% (0.6489 => 0.6480, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/08-main/main: -1.14% (0.1925 => 0.1903, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.45% (0.1651 => 0.1627, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.21% (0.3162 => 0.3232, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.86% (0.2444 => 0.2465, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.76% (0.3275 => 0.3300, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.91% (0.2354 => 0.2399, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: -0.58% (0.6040 => 0.6005, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: 9.34% (0.0407 => 0.0445, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.24% (0.3320 => 0.3312, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/strcat: -0.70% (0.2001 => 0.1987, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -3.33% (0.0240 => 0.0232, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 17.30% (0.0185 => 0.0217, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.91% (0.0412 => 0.0424, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.92% (0.0325 => 0.0328, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.64% (0.0313 => 0.0311, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 16.57% (0.0362 => 0.0422, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/casts: 4.12% (0.0194 => 0.0202, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/test1: 26.90% (0.0171 => 0.0217, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 8.13% (0.0332 => 0.0359, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.53% (0.1441 => 0.1463, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.30% (1.1410 => 1.1558, std.dev.: 0.0394) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 5.57% (0.1436 => 0.1516, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.12% (0.4246 => 0.3986, std.dev.: 0.0558) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.76% (0.1320 => 0.1330, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.72% (0.0624 => 0.0641, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.04% (0.0192 => 0.0194, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 7.96% (0.0540 => 0.0583, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.54% (1.1422 => 1.1484, std.dev.: 0.0109) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 118.18% (0.0011 => 0.0024, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 13.64% (0.0557 => 0.0633, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -21.17% (0.0222 => 0.0175, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.26% (0.8036 => 0.7935, std.dev.: 0.0077) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -12.96% (0.0054 => 0.0047, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.00% (2.1832 => 1.6593, std.dev.: 0.0012) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 36.40% (14.7684 => 20.1439, std.dev.: 0.1080) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.52% (0.0810 => 0.0960, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/rem: 14.20% (0.1035 => 0.1182, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.10% (0.0773 => 0.0882, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/tsp/tsp: 12.77% (0.1112 => 0.1254, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.09% (0.2180 => 0.2400, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.75% (0.3137 => 0.3443, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.49% (0.1425 => 0.1546, std.dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: 7.89% (1.2568 => 1.3560, std.dev.: 0.0021) MultiSource/Applications/viterbi/viterbi: 7.67% (0.1577 => 0.1698, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 7.15% (0.1721 => 0.1844, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.51% (0.1905 => 0.2029, std.dev.: 0.0019) MultiSource/Applications/spiff/spiff: 6.35% (0.7950 => 0.8455, std.dev.: 0.0158) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.22% (0.8148 => 0.8655, std.dev.: 0.0161) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.13% (1.1170 => 1.1855, std.dev.: 0.0046) MultiSource/Applications/Burg/burg: 5.90% (1.2222 => 1.2943, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.80% (0.2519 => 0.2665, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.78% (6.6074 => 6.9892, std.dev.: 0.0179) MultiSource/Benchmarks/nbench/nbench: 5.77% (1.1271 => 1.1921, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.56% (13.1811 => 13.9142, std.dev.: 0.1082) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.31% (0.3295 => 0.3470, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.14% (0.2741 => 0.2882, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.11% (0.6227 => 0.6545, std.dev.: 0.0033) MultiSource/Applications/treecc/treecc: 5.10% (1.9948 => 2.0965, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.73% (0.2240 => 0.2346, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.56% (1.6386 => 1.7134, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.53% (0.4127 => 0.4314, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.38% (0.8286 => 0.8649, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.30% (0.8420 => 0.8782, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.28% (1.1685 => 1.2185, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.19% (0.4559 => 0.4750, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/05-eks/eks: 4.18% (0.4397 => 0.4581, std.dev.: 0.0029) MultiSource/Applications/hbd/hbd: 4.18% (1.4269 => 1.4866, std.dev.: 0.0068) MultiSource/Applications/d/make_dparser: 4.16% (3.2366 => 3.3711, std.dev.: 0.0195) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.01% (0.3717 => 0.3866, std.dev.: 0.0049) MultiSource/Applications/SPASS/SPASS: 3.92% (14.2605 => 14.8189, std.dev.: 0.0627) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.87% (0.8712 => 0.9049, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.82% (0.8518 => 0.8843, std.dev.: 0.0060) MultiSource/Applications/lua/lua: 3.72% (3.8189 => 3.9611, std.dev.: 0.0175) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.72% (8.6476 => 8.9691, std.dev.: 0.0553) MultiSource/Applications/minisat/minisat: 3.69% (0.6834 => 0.7086, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 3.67% (0.8069 => 0.8365, std.dev.: 0.0087) MultiSource/Applications/sgefa/sgefa: 3.60% (0.2999 => 0.3107, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/18-imp/imp: 3.54% (0.3503 => 0.3627, std.dev.: 0.0026) MultiSource/Applications/lemon/lemon: 3.53% (1.0945 => 1.1331, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.50% (1.3279 => 1.3744, std.dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C/football/football: 3.47% (0.8768 => 0.9072, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 3.41% (0.8331 => 0.8615, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.29% (0.8697 => 0.8983, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 3.26% (0.9688 => 1.0004, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.21% (0.7966 => 0.8222, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.16% (0.8317 => 0.8580, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.15% (1.2423 => 1.2814, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.04% (0.6586 => 0.6786, std.dev.: 0.0037) MultiSource/Applications/JM/lencod/lencod: 3.00% (15.3280 => 15.7879, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.98% (0.9074 => 0.9344, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.87% (0.8086 => 0.8318, std.dev.: 0.0058) MultiSource/Benchmarks/mafft/pairlocalalign: 2.84% (8.6247 => 8.8695, std.dev.: 0.0641) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.82% (0.8995 => 0.9249, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.79% (4.1763 => 4.2928, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.79% (0.8716 => 0.8959, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.78% (0.8855 => 0.9101, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.72% (0.7932 => 0.8148, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.72% (0.8611 => 0.8845, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.72% (0.5191 => 0.5332, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.61% (0.9039 => 0.9275, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.58% (3.1832 => 3.2654, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.58% (0.8597 => 0.8819, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.52% (2.1401 => 2.1941, std.dev.: 0.0208) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.52% (0.9056 => 0.9284, std.dev.: 0.0042) MultiSource/Applications/JM/ldecod/ldecod: 2.50% (6.7320 => 6.9001, std.dev.: 0.0230) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.49% (0.8316 => 0.8523, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.46% (0.8340 => 0.8545, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 2.43% (0.7557 => 0.7741, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.39% (0.8805 => 0.9015, std.dev.: 0.0041) MultiSource/Benchmarks/Bullet/bullet: 2.37% (31.8598 => 32.6157, std.dev.: 0.1098) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.26% (0.8457 => 0.8648, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.25% (0.8007 => 0.8187, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.24% (0.8177 => 0.8360, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.09% (1.5315 => 1.5635, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.05% (0.8338 => 0.8509, std.dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: 2.05% (0.9810 => 1.0011, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 2.01% (2.2184 => 2.2630, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.00% (0.8261 => 0.8426, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.89% (0.8359 => 0.8517, std.dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.71% (1.5795 => 2.5068, std.dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.85% (2.4333 => 2.6730, std.dev.: 0.0306) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.38% (0.3186 => 0.3485, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 8.26% (21.9654 => 23.7797, std.dev.: 0.1332) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.16% (1.1857 => 1.2824, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 5.93% (63.1822 => 66.9276, std.dev.: 0.0805) SingleSource/Benchmarks/BenchmarkGame/recursive: 4.18% (2.4490 => 2.5513, std.dev.: 0.0205) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.13% (0.7597 => 0.7911, std.dev.: 0.0071) MultiSource/Applications/siod/siod: 2.83% (3.6643 => 3.7679, std.dev.: 0.0183) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.58% (1.5941 => 1.6193, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.01% (1.5866 => 1.6026, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -37.28% (0.0338 => 0.0212, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.30% (0.3269 => 0.2965, std.dev.: 0.0033) MultiSource/Applications/lua/lua: -5.21% (29.8330 => 28.2782, std.dev.: 0.2478) SingleSource/Benchmarks/Shootout-C++/hash2: -1.40% (3.4237 => 3.3758, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.24% (3.3479 => 3.3063, std.dev.: 0.0007) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 1.60% (16.4461 => 16.7086, std.dev.: 0.1115) MultiSource/Applications/obsequi/Obsequi: 5.39% (1.0262 => 1.0815, std.dev.: 0.0078) MultiSource/Applications/sqlite3/sqlite3: 2.34% (0.6332 => 0.6480, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/08-main/main: 3.93% (0.1831 => 0.1903, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.36% (0.1559 => 0.1627, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.49% (0.3123 => 0.3232, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.08% (0.2463 => 0.2465, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.32% (0.3344 => 0.3300, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.48% (0.2364 => 0.2399, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: -0.08% (0.6010 => 0.6005, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: 3.73% (0.0429 => 0.0445, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.41% (0.3266 => 0.3312, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/strcat: 0.91% (0.1969 => 0.1987, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 3.57% (0.0224 => 0.0232, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 76.42% (0.0123 => 0.0217, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.92% (0.0408 => 0.0424, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.13% (0.0254 => 0.0328, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.98% (0.0302 => 0.0311, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.90% (0.0384 => 0.0422, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: 56.09% (0.0230 => 0.0359, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.74% (0.1438 => 0.1463, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.02% (1.1329 => 1.1558, std.dev.: 0.0394) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.69% (0.1462 => 0.1516, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.27% (0.4164 => 0.3986, std.dev.: 0.0558) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.85% (0.1369 => 0.1330, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: - (0.0641 => 0.0641, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.51% (0.0195 => 0.0194, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.87% (0.0578 => 0.0583, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.41% (1.1437 => 1.1484, std.dev.: 0.0109) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2300.00% (0.0001 => 0.0024, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.96% (0.0627 => 0.0633, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.78% (0.0180 => 0.0175, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.02% (0.8017 => 0.7935, std.dev.: 0.0077) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -24.19% (0.0062 => 0.0047, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 1.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 29 04:33:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 06:33:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121029113337.950332A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5361?compare_to=5357&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5361, Order: 166916, Start Time: 2012-10-29 10:07:57, End Time: 2012-10-29 11:33:35 To: 5357, Order: 166915, Start Time: 2012-10-29 07:20:53, End Time: 2012-10-29 08:46:07 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 3 (6 on baseline) Performance Improvements: 0 (173 on baseline) Unchanged Tests: 1039 (863 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.17% (20.0771 => 20.3119, std.dev.: 0.0228) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.46% (78.4916 => 80.4238, std.dev.: 0.2873) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.20% (54.7080 => 55.9140, std.dev.: 0.4036) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.45% (15.2527 => 18.3720, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.86% (2.0478 => 2.1064, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/salsa20: 2.49% (7.4937 => 7.6802, std.dev.: 0.0198) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.45% (54.5751 => 55.9140, std.dev.: 0.4036) SingleSource/Benchmarks/Shootout-C++/hash2: 2.31% (3.1932 => 3.2669, std.dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.33% (0.1584 => 0.1452, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.18% (0.1431 => 0.1314, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.89% (0.3831 => 0.3567, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.88% (0.3821 => 0.3558, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: -6.83% (0.3880 => 0.3615, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -6.78% (0.3896 => 0.3632, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: -6.74% (0.3812 => 0.3555, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.67% (0.3884 => 0.3625, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: -6.65% (0.4033 => 0.3765, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.63% (0.3891 => 0.3633, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.57% (0.3848 => 0.3595, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.56% (0.4176 => 0.3902, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.47% (0.2428 => 0.2271, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.46% (0.3142 => 0.2939, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: -6.45% (0.4199 => 0.3928, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -6.38% (2.4924 => 2.3334, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.32% (22.4056 => 20.9903, std.dev.: 0.0129) SingleSource/UnitTests/ObjC/parameter-passing: -6.26% (0.4280 => 0.4012, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.18% (0.3658 => 0.3432, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -6.01% (0.3026 => 0.2844, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -5.92% (0.3025 => 0.2846, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.90% (0.2355 => 0.2216, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -5.89% (0.2989 => 0.2813, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.86% (2.1713 => 2.0441, std.dev.: 0.0114) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.84% (5.4682 => 5.1487, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: -5.84% (0.3357 => 0.3161, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.84% (0.3323 => 0.3129, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.83% (0.6484 => 0.6106, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.81% (0.3837 => 0.3614, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.81% (0.3252 => 0.3063, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.79% (0.2903 => 0.2735, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: -5.79% (0.2160 => 0.2035, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.76% (4.5069 => 4.2472, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/hello: -5.76% (0.2849 => 0.2685, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.76% (0.4083 => 0.3848, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/random: -5.75% (0.2939 => 0.2770, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.72% (0.3057 => 0.2882, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -5.72% (1.3148 => 1.2396, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash2: -5.72% (0.4861 => 0.4583, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -5.72% (0.2659 => 0.2507, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.71% (0.4151 => 0.3914, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.68% (0.2871 => 0.2708, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.68% (3.5339 => 3.3333, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.67% (0.4321 => 0.4076, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: -5.65% (0.3205 => 0.3024, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.64% (0.9542 => 0.9004, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.63% (0.9852 => 0.9297, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -5.63% (0.3394 => 0.3203, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -5.62% (0.3788 => 0.3575, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -5.62% (0.3059 => 0.2887, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: -5.62% (0.3255 => 0.3072, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.61% (0.3849 => 0.3633, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -5.60% (0.3194 => 0.3015, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -5.60% (0.3481 => 0.3286, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: -5.60% (1.2515 => 1.1814, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary3: -5.60% (0.3446 => 0.3253, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -5.55% (0.3621 => 0.3420, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -5.55% (7.0961 => 6.7023, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.55% (0.3931 => 0.3713, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.53% (4.8802 => 4.6104, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/gs/gs: -5.50% (4.3330 => 4.0949, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.49% (4.8161 => 4.5517, std.dev.: 0.0088) MultiSource/Applications/JM/lencod/lencod: -5.46% (16.1920 => 15.3074, std.dev.: 0.0090) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.44% (1.2210 => 1.1546, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.41% (1.2784 => 1.2093, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: -5.39% (0.6750 => 0.6386, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: -5.38% (0.3867 => 0.3659, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.38% (0.4427 => 0.4189, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.37% (1.0544 => 0.9978, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -5.32% (34.0927 => 32.2778, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.31% (1.6474 => 1.5600, std.dev.: 0.0015) MultiSource/Applications/siod/siod: -5.27% (2.4021 => 2.2756, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.26% (0.2548 => 0.2414, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.24% (0.3491 => 0.3308, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -5.23% (0.4248 => 0.4026, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.19% (1.2221 => 1.1587, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.18% (4.0323 => 3.8233, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.16% (0.7919 => 0.7510, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/bh/bh: -5.16% (0.2985 => 0.2831, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.11% (0.4813 => 0.4567, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.08% (0.2933 => 0.2784, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -5.08% (0.7779 => 0.7384, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.03% (0.5999 => 0.5697, std.dev.: 0.0038) SingleSource/UnitTests/ObjC++/Hello: -5.03% (0.6347 => 0.6028, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.99% (0.8521 => 0.8096, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: -4.94% (0.6441 => 0.6123, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.93% (2.2587 => 2.1474, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: -4.92% (18.2933 => 17.3926, std.dev.: 0.0152) MultiSource/Applications/lua/lua: -4.90% (4.0594 => 3.8606, std.dev.: 0.0069) MultiSource/Benchmarks/mafft/pairlocalalign: -4.89% (9.2283 => 8.7769, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.87% (0.9557 => 0.9092, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.85% (0.7198 => 0.6849, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hash: -4.84% (0.4524 => 0.4305, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.83% (0.6293 => 0.5989, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.83% (0.2278 => 0.2168, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.80% (0.2999 => 0.2855, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.74% (1.3722 => 1.3071, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -4.69% (0.7982 => 0.7608, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -4.64% (1.6364 => 1.5605, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.63% (0.5591 => 0.5332, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.62% (0.5478 => 0.5225, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.58% (0.6681 => 0.6375, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: -4.58% (0.3581 => 0.3417, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.56% (0.4916 => 0.4692, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.55% (0.6676 => 0.6372, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.50% (0.5805 => 0.5544, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.49% (1.4642 => 1.3985, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.48% (0.6667 => 0.6368, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.48% (0.6297 => 0.6015, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.46% (0.5802 => 0.5543, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.44% (0.6660 => 0.6364, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.44% (0.5859 => 0.5599, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.40% (0.3319 => 0.3173, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.39% (0.5925 => 0.5665, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.38% (0.5705 => 0.5455, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.38% (0.6230 => 0.5957, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.37% (0.5863 => 0.5607, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: -4.36% (0.4515 => 0.4318, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.36% (0.6194 => 0.5924, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.36% (0.5575 => 0.5332, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.35% (0.5857 => 0.5602, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.32% (0.5581 => 0.5340, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.31% (0.6189 => 0.5922, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.31% (0.6260 => 0.5990, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.31% (0.6052 => 0.5791, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.31% (0.5569 => 0.5329, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.31% (0.5456 => 0.5221, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.26% (0.7339 => 0.7026, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.25% (0.6395 => 0.6123, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.24% (0.6395 => 0.6124, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.24% (0.5570 => 0.5334, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.24% (0.6304 => 0.6037, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.23% (0.2385 => 0.2284, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.20% (0.5567 => 0.5333, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.17% (0.5849 => 0.5605, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: -4.15% (0.9179 => 0.8798, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: -4.15% (0.8418 => 0.8069, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: -4.14% (0.7447 => 0.7139, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.13% (0.7524 => 0.7213, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.11% (0.6033 => 0.5785, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.11% (0.5941 => 0.5697, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.08% (0.6446 => 0.6183, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.08% (0.5688 => 0.5456, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.05% (0.3406 => 0.3268, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: -4.04% (1.1450 => 1.0987, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/09-vor/vor: -4.00% (0.3271 => 0.3140, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.93% (0.7021 => 0.6745, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -3.90% (8.0126 => 7.7001, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: -3.86% (2.1401 => 2.0575, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.86% (6.7716 => 6.5104, std.dev.: 0.0037) MultiSource/Applications/SPASS/SPASS: -3.81% (15.5079 => 14.9173, std.dev.: 0.2274) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.76% (0.3483 => 0.3352, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: -3.73% (5.0226 => 4.8351, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: -3.70% (1.5610 => 1.5032, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.70% (0.5168 => 0.4977, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -3.65% (17.1032 => 16.4782, std.dev.: 0.0137) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.56% (0.6736 => 0.6496, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: -3.55% (3.5154 => 3.3907, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.51% (0.5329 => 0.5142, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.47% (0.9077 => 0.8762, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.41% (1.2300 => 1.1881, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: -3.25% (1.1530 => 1.1155, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.05% (14.2083 => 13.7748, std.dev.: 0.0083) SingleSource/UnitTests/Vector/constpool: -2.23% (20.7746 => 20.3119, std.dev.: 0.0228) MultiSource/Applications/SIBsim4/SIBsim4: -1.50% (1.3864 => 1.3656, std.dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7575, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -8.70% (1.2842 => 1.1725, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: -3.76% (2.2633 => 2.1782, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.65% (6.5735 => 6.4652, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 29 04:54:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 06:54:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121029115424.306DD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5362?compare_to=5358&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5362, Order: 166916, Start Time: 2012-10-29 10:23:26, End Time: 2012-10-29 11:54:23 To: 5358, Order: 166915, Start Time: 2012-10-29 08:22:41, End Time: 2012-10-29 09:53:55 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (10 on baseline) New Passes: 0 (14 on baseline) Performance Regressions: 1 (187 on baseline) Performance Improvements: 1 (54 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 15 (5 on baseline) Unchanged Tests: 1025 (638 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.01% (1.0919 => 1.1029, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.26% (9.7912 => 9.5700, std.dev.: 0.0085) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: 0.13% (2.0490 => 2.0516, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -0.06% (57.7769 => 57.7426, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.37% (0.0802 => 0.0799, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 0.03% (9.2302 => 9.2327, std.dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.29% (7.8058 => 7.7833, std.dev.: 0.0188) SingleSource/UnitTests/Vector/SSE/sse_shift: 0.19% (0.0516 => 0.0517, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/JM/lencod/lencod: 0.14% (7.7224 => 7.7335, std.dev.: 0.0079) MultiSource/Applications/oggenc/oggenc: - (0.0001 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0647 => 0.0648, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.07% (0.2992 => 0.2990, std.dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_shift: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -64.38% (5.7591 => 2.0516, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -8.70% (63.2438 => 57.7426, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.81% (6.6874 => 0.0799, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.48% (8.1363 => 9.2327, std.dev.: 0.0051) SingleSource/UnitTests/Vector/SSE/sse_shift: 36.77% (0.0378 => 0.0517, std.dev.: 0.0002) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -50.00% (0.0002 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -57.05% (0.6962 => 0.2990, std.dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_shift: -50.00% (0.0002 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 211.46% (0.5229 => 1.6286, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 17.42% (14.9895 => 17.6003, std.dev.: 0.0092) MultiSource/Applications/kimwitu++/kc: 37.21% (14.1553 => 19.4227, std.dev.: 0.0166) MultiSource/Benchmarks/MallocBench/gs/gs: 13.59% (4.1105 => 4.6692, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 32.64% (1.1048 => 1.4654, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.52% (3.4629 => 5.8357, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 68.27% (0.6222 => 1.0470, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 3836200.00% (0.0001 => 3.8363, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 11143600.00% (0.0001 => 11.1437, std.dev.: 0.0038) MultiSource/Applications/kimwitu++/kc: 50600.00% (0.0001 => 0.0507, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049600.00% (0.0001 => 10.0497, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5490200.00% (0.0001 => 5.4903, std.dev.: 0.0174) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 78.04% (0.0296 => 0.0527) SingleSource/Benchmarks/Misc/lowercase: 69.14% (0.0256 => 0.0433, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 60.52% (0.0271 => 0.0435, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 52.67% (0.0243 => 0.0371, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 43.69% (1.5859 => 2.2788, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.85% (0.0834 => 0.1183, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/distray/distray: 40.25% (0.1056 => 0.1481, std.dev.: 0.0004) SingleSource/UnitTests/vla: 35.21% (0.0355 => 0.0480, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 34.79% (2.2024 => 2.9686, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/neural/neural: 33.49% (0.1463 => 0.1953, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: 28.00% (0.1432 => 0.1833, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 27.79% (0.1655 => 0.2115, std.dev.: 0.0004) MultiSource/Benchmarks/llubenchmark/llu: 23.81% (0.0462 => 0.0572, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/rem: 21.77% (0.1144 => 0.1393, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.39% (0.1566 => 0.1901, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 20.74% (0.5105 => 0.6164, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 20.71% (0.1555 => 0.1877, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.32% (0.0871 => 0.1048, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 19.13% (0.6675 => 0.7952, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 18.86% (1.3050 => 1.5511, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 18.82% (3.3354 => 3.9632, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 18.63% (0.2271 => 0.2694, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 18.22% (0.0730 => 0.0863, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.15% (0.5020 => 0.5931, std.dev.: 0.0023) MultiSource/Applications/minisat/minisat: 18.09% (0.7115 => 0.8402, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 18.05% (0.2554 => 0.3015, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 18.04% (0.1175 => 0.1387, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/n-body: 17.96% (0.0746 => 0.0880, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: 17.73% (0.0626 => 0.0737, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 17.61% (0.1584 => 0.1863, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.58% (0.1337 => 0.1572, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 17.48% (0.1236 => 0.1452, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 17.40% (0.1695 => 0.1990, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.35% (0.1510 => 0.1772, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.34% (0.1032 => 0.1211, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.28% (0.0793 => 0.0930, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.28% (1.5415 => 1.8078, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/mst/mst: 17.20% (0.1163 => 0.1363, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.18% (0.4615 => 0.5408, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 17.08% (1.1840 => 1.3862, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.85% (0.8172 => 0.9549, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 16.85% (0.4879 => 0.5701, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 16.71% (0.3177 => 0.3708, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 16.53% (22.1758 => 25.8416, std.dev.: 0.0057) MultiSource/Applications/sgefa/sgefa: 16.50% (0.3109 => 0.3622, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.40% (0.6450 => 0.7508, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 16.37% (0.2603 => 0.3029, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.37% (0.0886 => 0.1031, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 16.34% (0.1940 => 0.2257, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.00% (0.0675 => 0.0783, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.99% (0.3121 => 0.3620, std.dev.: 0.0026) MultiSource/Applications/aha/aha: 15.99% (0.1151 => 0.1335, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.91% (0.0842 => 0.0976, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 15.90% (0.1906 => 0.2209, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/exptree: 15.60% (0.0814 => 0.0941, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.41% (0.9765 => 1.1270, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 15.39% (1.0722 => 1.2372, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 15.32% (1.1642 => 1.3426, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.31% (0.1117 => 0.1288) MultiSource/Applications/treecc/treecc: 15.30% (2.0273 => 2.3375, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 15.15% (0.2700 => 0.3109, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 15.10% (0.1695 => 0.1951, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.05% (0.2758 => 0.3173, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.05% (0.2107 => 0.2424, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 15.00% (0.8921 => 1.0259, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 14.97% (0.7835 => 0.9008, std.dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.84% (0.1125 => 0.1292, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.82% (1.1861 => 1.3619, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 14.78% (0.3423 => 0.3929, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.69% (0.1062 => 0.1218, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.68% (0.5860 => 0.6720, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.68% (0.0770 => 0.0883, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 14.62% (1.4186 => 1.6260, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.61% (0.5981 => 0.6855, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.53% (0.2065 => 0.2365, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.36% (0.0759 => 0.0868, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 14.28% (0.4299 => 0.4913, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.26% (0.1143 => 0.1306, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.16% (0.0798 => 0.0911, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.15% (0.1625 => 0.1855, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.14% (0.1330 => 0.1518, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.13% (4.2646 => 4.8672, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/lpbench: 14.10% (0.0929 => 0.1060, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.09% (0.1029 => 0.1174, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 14.06% (0.7433 => 0.8478, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.04% (0.0933 => 0.1064, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 14.00% (3.8723 => 4.4146, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 13.73% (0.3387 => 0.3852, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.58% (0.3307 => 0.3756, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.51% (0.0770 => 0.0874, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.29% (0.5569 => 0.6309, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 13.25% (0.1268 => 0.1436, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 13.16% (9.4845 => 10.7328, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.89% (0.3826 => 0.4319, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.82% (0.3441 => 0.3882, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 12.52% (0.3092 => 0.3479, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 12.30% (0.3180 => 0.3571, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 12.29% (0.0838 => 0.0941, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.84% (0.1892 => 0.2116, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 11.65% (0.0953 => 0.1064, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 11.55% (2.2969 => 2.5623, std.dev.: 0.0206) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.42% (0.8101 => 0.9026, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/trivial-interface: 11.34% (0.3473 => 0.3867, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.33% (14.3668 => 15.9946, std.dev.: 0.0086) SingleSource/UnitTests/ObjC/exceptions-4: 11.32% (0.3543 => 0.3944, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.31% (0.3927 => 0.4371, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.23% (0.3828 => 0.4258, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 11.18% (0.6456 => 0.7178, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.15% (0.3543 => 0.3938, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.15% (0.3561 => 0.3958, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions-2: 11.12% (0.3497 => 0.3886, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.12% (0.3516 => 0.3907) SingleSource/Benchmarks/Shootout-C++/hash2: 11.10% (0.4620 => 0.5133, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.04% (0.3694 => 0.4102, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 10.97% (5.0018 => 5.5507, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 10.97% (4.9449 => 5.4872, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash: 10.75% (0.4289 => 0.4750, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 10.73% (0.3886 => 0.4303, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 10.70% (17.1811 => 19.0187, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.65% (0.3427 => 0.3792, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.54% (0.1044 => 0.1154, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.46% (2.2022 => 2.4325, std.dev.: 0.0029) MultiSource/Applications/hbd/hbd: 9.85% (1.5603 => 1.7140, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 9.82% (0.3422 => 0.3758, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.73% (0.3865 => 0.4241, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.66% (0.4203 => 0.4609, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 9.49% (0.4048 => 0.4432, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.47% (0.4636 => 0.5075, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists1: 9.39% (0.3684 => 0.4030, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.16% (0.4103 => 0.4479, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.05% (0.2266 => 0.2471, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.88% (3.8922 => 4.2379, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.72% (0.2430 => 0.2642, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 8.58% (0.3603 => 0.3912, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.51% (0.5925 => 0.6429, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.47% (0.6030 => 0.6541, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.46% (0.4064 => 0.4408, std.dev.: 0.0117) SingleSource/UnitTests/ObjC++/property-reference: 7.79% (0.7326 => 0.7897, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary3: 7.74% (0.3283 => 0.3537, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 7.74% (0.2831 => 0.3050, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 7.71% (0.3098 => 0.3337, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.64% (0.3650 => 0.3929, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 7.64% (0.3232 => 0.3479, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.55% (0.2793 => 0.3004, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.50% (0.3162 => 0.3399, std.dev.: 0.0023) SingleSource/Regression/C++/ofstream_ctor: 7.33% (0.2905 => 0.3118, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 7.19% (0.3282 => 0.3518, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.13% (2.0665 => 2.2138, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/except: 7.11% (0.2871 => 0.3075, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.09% (0.2891 => 0.3096, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.03% (0.2872 => 0.3074, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.97% (0.8067 => 0.8629, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.85% (0.3052 => 0.3261, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.83% (0.2725 => 0.2911, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.79% (0.2756 => 0.2943, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 6.78% (1.2842 => 1.3713, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 6.78% (0.2877 => 0.3072, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.60% (0.2714 => 0.2893, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 6.53% (0.2802 => 0.2985, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 6.24% (0.3379 => 0.3590, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.80% (0.3136 => 0.3318, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 5.42% (0.2049 => 0.2160, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.27% (7.9617 => 8.3811, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.86% (0.3935 => 0.4087, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.56% (0.3817 => 0.3953, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.83% (7.0540 => 7.2539, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.12% (1.1145 => 1.3722, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 10.23% (0.9957 => 1.0976, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/richards_benchmark: 9.78% (1.1396 => 1.2510, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.95% (2.8904 => 3.0913, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3683, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.65% (0.3463 => 0.3624, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: 4.50% (3.3453 => 3.4960, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 2.96% (1.9405 => 1.9979, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.96% (4.2280 => 4.3530, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 2.50% (4.4649 => 4.5764, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.78% (0.8333 => 0.8481, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2078, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.39% (9.1159 => 9.2425, std.dev.: 0.0309) MultiSource/Benchmarks/nbench/nbench: 1.30% (11.6436 => 11.7955, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5752, std.dev.: 0.0090) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -76.70% (0.8651 => 0.2016, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.19% (5.3855 => 2.4135, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -54.93% (5.3526 => 2.4126, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: -45.25% (0.1622 => 0.0888, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.34% (1.1194 => 0.6790, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.04% (5.2763 => 3.2165, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -24.10% (1.7609 => 1.3365, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -17.16% (2.9384 => 2.4342, std.dev.: 0.0038) SingleSource/UnitTests/Vector/constpool: -8.89% (54.1659 => 49.3514, std.dev.: 0.0107) MultiSource/Applications/JM/ldecod/ldecod: -8.34% (10.4361 => 9.5660, std.dev.: 0.0123) MultiSource/Benchmarks/PAQ8p/paq8p: -7.69% (10.3673 => 9.5700, std.dev.: 0.0085) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -54.04% (8.0499 => 3.7001, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0134) SingleSource/Benchmarks/Misc/mandel: -33.38% (1.1492 => 0.7656, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.61% (0.0506 => 0.0341) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.38% (0.3987 => 0.2696) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.51% (2.9695 => 2.3605, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -19.00% (1.2258 => 0.9929, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -16.12% (1.6925 => 1.4197, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852) MultiSource/Benchmarks/NPB-serial/is/is: -10.99% (9.5636 => 8.5123, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -10.86% (1.2373 => 1.1029, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3735, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.41% (19.9488 => 18.2714, std.dev.: 0.0226) MultiSource/Benchmarks/FreeBench/mason/mason: -7.68% (0.2161 => 0.1995, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.03% (1.8329 => 1.7040, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: -5.47% (6.6465 => 6.2832, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.09% (1.6805 => 1.5950, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.89% (0.2497 => 0.2375, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909) SingleSource/Benchmarks/Misc/flops-5: -4.79% (1.5835 => 1.5077, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.95% (8.1563 => 7.8345, std.dev.: 0.0089) MultiSource/Applications/siod/siod: -3.79% (3.2827 => 3.1584, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.50% (32.5116 => 31.3751, std.dev.: 0.0058) MultiSource/Benchmarks/sim/sim: -3.33% (5.0483 => 4.8802, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.31% (0.4808 => 0.4649, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: -2.93% (4.6441 => 4.5078, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.81% (4.5009 => 4.3746, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/multiplies: -2.11% (2.5528 => 2.4990, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/salsa20: -1.84% (10.2830 => 10.0938, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6821, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -1.28% (85.0658 => 83.9756, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.15% (1.7254 => 1.7055, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8586, std.dev.: 0.0141) MultiSource/Benchmarks/Olden/power/power: -1.01% (1.1277 => 1.1163, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.73% (7.1582 => 7.7833, std.dev.: 0.0188) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: 10640.97% (0.0720 => 7.7335, std.dev.: 0.0079) MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 29 06:10:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 08:10:10 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121029131010.9471E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5363?compare_to=5360&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5363, Order: 166921, Start Time: 2012-10-29 11:45:40, End Time: 2012-10-29 13:10:10 To: 5360, Order: 166916, Start Time: 2012-10-29 10:04:28, End Time: 2012-10-29 11:28:30 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 6 (101 on baseline) Performance Improvements: 5 (5 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 964 (868 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/loader/loader: 7.05% (0.2908 => 0.3113, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.98% (0.8612 => 0.9127, std.dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.67% (0.5012 => 0.5196, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 8.22% (0.7967 => 0.8622, std.dev.: 0.0059) MultiSource/Applications/SPASS/SPASS: 2.41% (8.2861 => 8.4862, std.dev.: 0.0147) SingleSource/Benchmarks/Misc/ffbench: 2.12% (1.4071 => 1.4369, std.dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -3.80% (0.3443 => 0.3312, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -2.09% (0.8649 => 0.8468, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -1.69% (0.8782 => 0.8634, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.40% (0.9049 => 0.8922, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.13% (0.8843 => 0.8743, std.dev.: 0.0022) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.12% (16.7086 => 16.7280, std.dev.: 0.2392) MultiSource/Applications/obsequi/Obsequi: -1.10% (1.0815 => 1.0696, std.dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: 0.22% (0.6480 => 0.6494, std.dev.: 0.0091) MultiSource/Benchmarks/McCat/08-main/main: 1.94% (0.1903 => 0.1940, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 3.13% (0.1627 => 0.1678, std.dev.: 0.0066) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.36% (0.3232 => 0.3188, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.32% (0.2465 => 0.2473, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.97% (0.3300 => 0.3332, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.00% (0.2399 => 0.2375, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: -0.07% (0.6005 => 0.6001, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/mandel: 0.90% (0.0445 => 0.0449, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.27% (0.3312 => 0.3354, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/strcat: 1.01% (0.1987 => 0.2007, std.dev.: 0.0050) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -5.17% (0.0232 => 0.0220, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.92% (0.0217 => 0.0219, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.71% (0.0424 => 0.0427, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.91% (0.0328 => 0.0331, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.64% (0.0311 => 0.0313, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.90% (0.0422 => 0.0430, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: 0.50% (0.0202 => 0.0203, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 1.38% (0.0217 => 0.0220, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -20.89% (0.0359 => 0.0284, std.dev.: 0.0050) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -1.09% (0.1463 => 0.1447, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.25% (1.1558 => 1.1414, std.dev.: 0.0139) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: - (0.1516 => 0.1516, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.56% (0.3986 => 0.4088, std.dev.: 0.0236) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.38% (0.1330 => 0.1285, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.25% (0.0641 => 0.0633, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 38.14% (0.0194 => 0.0268, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.72% (0.0583 => 0.0573, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.10% (1.1484 => 1.1495, std.dev.: 0.2353) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 29.17% (0.0024 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 600.00% (0.0001 => 0.0007, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.21% (0.0633 => 0.0647, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 51.43% (0.0175 => 0.0265, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.03% (0.7935 => 0.8017, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -17.02% (0.0047 => 0.0039, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -24.09% (2.1832 => 1.6572, std.dev.: 0.0038) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 35.86% (14.7684 => 20.0646, std.dev.: 0.1328) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.94% (0.0810 => 0.0931, std.dev.: 0.0023) SingleSource/UnitTests/SignlessTypes/rem: 14.40% (0.1035 => 0.1184, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 12.32% (0.1112 => 0.1249, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.69% (0.8321 => 0.9127, std.dev.: 0.0171) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.90% (0.1885 => 0.2034, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.75% (0.2180 => 0.2349, std.dev.: 0.0027) MultiSource/Applications/SIBsim4/SIBsim4: 7.61% (1.2568 => 1.3524, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.23% (0.1425 => 0.1528, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.20% (0.4847 => 0.5196, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.05% (0.7473 => 0.7925, std.dev.: 0.0057) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.84% (6.6074 => 6.9933, std.dev.: 0.1079) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.77% (0.1905 => 0.2015, std.dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.58% (0.3137 => 0.3312, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.56% (13.1811 => 13.9146, std.dev.: 0.2181) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.39% (1.1170 => 1.1772, std.dev.: 0.0108) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.36% (0.2240 => 0.2360, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.25% (0.2741 => 0.2885, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 5.25% (1.1271 => 1.1863, std.dev.: 0.0158) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.22% (0.6287 => 0.6615, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.06% (0.4783 => 0.5025, std.dev.: 0.0088) MultiSource/Applications/spiff/spiff: 4.81% (0.7950 => 0.8332, std.dev.: 0.0120) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.50% (0.6227 => 0.6507, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.39% (0.9435 => 0.9849, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.37% (0.2519 => 0.2629, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.36% (0.8148 => 0.8503, std.dev.: 0.0119) MultiSource/Benchmarks/McCat/05-eks/eks: 4.25% (0.4397 => 0.4584, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.23% (1.1606 => 1.2097, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.22% (0.4127 => 0.4301, std.dev.: 0.0034) MultiSource/Applications/d/make_dparser: 4.08% (3.2366 => 3.3687, std.dev.: 0.0311) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.07% (0.3295 => 0.3429, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.90% (1.1685 => 1.2141, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.79% (0.3115 => 0.3233, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.74% (0.2998 => 0.3110, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.66% (0.3003 => 0.3113, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 3.59% (1.0945 => 1.1338, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.55% (8.6476 => 8.9550, std.dev.: 0.0348) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.55% (0.3717 => 0.3849, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.43% (0.5191 => 0.5369, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 3.39% (14.2605 => 14.7433, std.dev.: 0.1865) MultiSource/Applications/lua/lua: 3.38% (3.8189 => 3.9479, std.dev.: 0.0164) MultiSource/Applications/minisat/minisat: 3.32% (0.6834 => 0.7061, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.27% (0.4559 => 0.4708, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.27% (0.8697 => 0.8981, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.23% (0.5817 => 0.6005, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/football/football: 3.08% (0.8768 => 0.9038, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.04% (0.5961 => 0.6142, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.01% (0.8261 => 0.8510, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/gs/gs: 3.00% (4.1305 => 4.2545, std.dev.: 0.0153) MultiSource/Benchmarks/McCat/18-imp/imp: 2.88% (0.3503 => 0.3604, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.86% (3.1832 => 3.2741, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.82% (1.3279 => 1.3653, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.75% (0.8007 => 0.8227, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 2.75% (6.7320 => 6.9168, std.dev.: 0.0400) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.74% (0.8317 => 0.8545, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.72% (0.8611 => 0.8845, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.68% (1.2602 => 1.2940, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.65% (0.9069 => 0.9309, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.64% (0.8518 => 0.8743, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.64% (0.8069 => 0.8282, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.63% (0.8457 => 0.8679, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.59% (0.8177 => 0.8389, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.58% (0.8331 => 0.8546, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.56% (0.8086 => 0.8293, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.55% (0.9908 => 1.0161, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.54% (0.8420 => 0.8634, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.51% (0.8597 => 0.8813, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.49% (0.8716 => 0.8933, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.47% (0.9688 => 0.9927, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.45% (0.8338 => 0.8542, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.41% (0.8712 => 0.8922, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: 2.41% (8.6247 => 8.8323, std.dev.: 0.0362) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.38% (0.9039 => 0.9254, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.37% (0.7932 => 0.8120, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.36% (0.9056 => 0.9270, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.34% (0.8340 => 0.8535, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.27% (0.8204 => 0.8390, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.20% (0.8286 => 0.8468, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.17% (1.2526 => 1.2798, std.dev.: 0.0084) MultiSource/Applications/JM/lencod/lencod: 2.16% (15.3280 => 15.6595, std.dev.: 0.0849) MultiSource/Benchmarks/PAQ8p/paq8p: 2.13% (2.3764 => 2.4269, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.12% (0.8048 => 0.8219, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.11% (0.8927 => 0.9115, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.11% (0.8359 => 0.8535, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.08% (0.8885 => 0.9070, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.95% (0.8656 => 0.8825, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.91% (0.8066 => 0.8220, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.91% (1.5315 => 1.5607, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.78% (2.1401 => 2.1783, std.dev.: 0.0062) MultiSource/Benchmarks/Bullet/bullet: 1.68% (31.8598 => 32.3966, std.dev.: 0.1600) MultiSource/Applications/hexxagon/hexxagon: 1.18% (0.9810 => 0.9926, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.59% (1.5795 => 2.5049, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.21% (0.3186 => 0.3543, std.dev.: 0.0118) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.88% (2.4333 => 2.6737, std.dev.: 0.0751) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.48% (1.1857 => 1.2862, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 5.93% (63.1822 => 66.9304, std.dev.: 0.0602) SingleSource/Benchmarks/Misc/ReedSolomon: 2.82% (8.5322 => 8.7730, std.dev.: 0.0179) MultiSource/Applications/siod/siod: 2.67% (3.6643 => 3.7621, std.dev.: 0.0170) MultiSource/Benchmarks/Olden/bh/bh: 1.97% (2.3560 => 2.4025, std.dev.: 0.0173) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.47% (59.2638 => 60.1350, std.dev.: 0.2880) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.39% (1.5941 => 1.6162, std.dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -5.02% (29.8330 => 28.3340, std.dev.: 0.1696) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.38% (7.2130 => 6.8970, std.dev.: 0.1066) MultiSource/Benchmarks/Ptrdist/ft/ft: -1.90% (0.8789 => 0.8622, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash2: -1.40% (3.4237 => 3.3756, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.18% (3.3479 => 3.3084, std.dev.: 0.0010) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 1.71% (16.4461 => 16.7280, std.dev.: 0.2392) MultiSource/Applications/obsequi/Obsequi: 4.23% (1.0262 => 1.0696, std.dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: 2.56% (0.6332 => 0.6494, std.dev.: 0.0091) MultiSource/Benchmarks/McCat/08-main/main: 5.95% (0.1831 => 0.1940, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.63% (0.1559 => 0.1678, std.dev.: 0.0066) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.08% (0.3123 => 0.3188, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.41% (0.2463 => 0.2473, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.36% (0.3344 => 0.3332, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: 0.47% (0.2364 => 0.2375, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: -0.15% (0.6010 => 0.6001, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/mandel: 4.66% (0.0429 => 0.0449, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.69% (0.3266 => 0.3354, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/strcat: 1.93% (0.1969 => 0.2007, std.dev.: 0.0050) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.79% (0.0224 => 0.0220, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.31% (0.0254 => 0.0331, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.98% (0.0384 => 0.0430, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 22.22% (0.0180 => 0.0220, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: 23.48% (0.0230 => 0.0284, std.dev.: 0.0050) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.63% (0.1438 => 0.1447, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.75% (1.1329 => 1.1414, std.dev.: 0.0139) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.69% (0.1462 => 0.1516, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.83% (0.4164 => 0.4088, std.dev.: 0.0236) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.14% (0.1369 => 0.1285, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.25% (0.0641 => 0.0633, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 37.44% (0.0195 => 0.0268, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.87% (0.0578 => 0.0573, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.51% (1.1437 => 1.1495, std.dev.: 0.2353) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -50.00% (0.0014 => 0.0007, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.19% (0.0627 => 0.0647, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.22% (0.0180 => 0.0265, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: - (0.8017 => 0.8017, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -37.10% (0.0062 => 0.0039, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 29 06:22:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 08:22:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121029132200.5EE242A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5364?compare_to=5361&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5364, Order: 166921, Start Time: 2012-10-29 11:56:41, End Time: 2012-10-29 13:21:58 To: 5361, Order: 166916, Start Time: 2012-10-29 10:07:57, End Time: 2012-10-29 11:33:35 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (176 on baseline) Unchanged Tests: 1042 (861 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.46% (15.2527 => 18.3738, std.dev.: 0.0145) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.29% (1.2783 => 1.3715, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.84% (2.0478 => 2.1060, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/salsa20: 2.34% (7.4937 => 7.6694, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/hash2: 2.09% (3.1932 => 3.2599, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.33% (0.1584 => 0.1452, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.25% (0.1431 => 0.1313, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.04% (0.3821 => 0.3552, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -6.87% (0.3831 => 0.3568, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -6.86% (0.3880 => 0.3614, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -6.77% (0.3812 => 0.3554, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.76% (0.3848 => 0.3588, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -6.72% (0.3896 => 0.3634, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.69% (0.3884 => 0.3624, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.63% (0.3891 => 0.3633, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -6.61% (0.4176 => 0.3900, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -6.57% (0.4033 => 0.3768, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -6.43% (0.4199 => 0.3929, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.40% (0.3142 => 0.2941, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -6.40% (2.4924 => 2.3330, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: -6.33% (0.4280 => 0.4009, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.31% (22.4056 => 20.9929, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.30% (0.2428 => 0.2275, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.18% (0.3658 => 0.3432, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.02% (0.3025 => 0.2843, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.98% (0.9542 => 0.8971, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -5.98% (0.3026 => 0.2845, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.94% (0.2355 => 0.2215, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.94% (0.3837 => 0.3609, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.93% (0.3252 => 0.3059, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.92% (0.3057 => 0.2876, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.90% (4.5069 => 4.2411, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.87% (5.4682 => 5.1471, std.dev.: 0.0082) MultiSource/Applications/sgefa/sgefa: -5.87% (0.3357 => 0.3160, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.87% (0.3323 => 0.3128, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.86% (0.2903 => 0.2733, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -5.85% (0.1879 => 0.1769, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: -5.83% (0.2160 => 0.2034, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -5.83% (0.2659 => 0.2504, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -5.82% (0.2989 => 0.2815, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/random: -5.78% (0.2939 => 0.2769, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -5.76% (1.3148 => 1.2391, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.75% (2.1713 => 2.0465, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.74% (0.4321 => 0.4073, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.74% (0.6484 => 0.6112, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.74% (0.3016 => 0.2843, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.73% (0.9852 => 0.9287, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: -5.73% (0.3194 => 0.3011, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -5.72% (0.2849 => 0.2686, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -5.71% (0.3255 => 0.3069, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.71% (0.4083 => 0.3850, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.69% (0.4151 => 0.3915, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: -5.67% (1.2515 => 1.1805, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/hash2: -5.66% (0.4861 => 0.4586, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -5.66% (0.3394 => 0.3202, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: -5.64% (0.2871 => 0.2709, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -5.64% (4.3330 => 4.0888, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary3: -5.63% (0.3446 => 0.3252, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.63% (4.8161 => 4.5451, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.63% (3.5339 => 3.3351, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/sieve: -5.62% (0.3788 => 0.3575, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -5.62% (0.3205 => 0.3025, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -5.61% (7.0961 => 6.6978, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/ary2: -5.60% (0.3481 => 0.3286, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.60% (0.3931 => 0.3711, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.56% (0.3849 => 0.3635, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.56% (4.8802 => 4.6089, std.dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: -5.54% (16.1920 => 15.2942, std.dev.: 0.0071) SingleSource/Regression/C++/ofstream_ctor: -5.52% (0.3059 => 0.2890, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -5.52% (0.3621 => 0.3421, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -5.47% (0.6750 => 0.6381, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.46% (0.2548 => 0.2409, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.44% (1.2210 => 1.1546, std.dev.: 0.0016) MultiSource/Applications/siod/siod: -5.42% (2.4021 => 2.2719, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.39% (0.7919 => 0.7492, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.39% (1.6474 => 1.5586, std.dev.: 0.0064) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.39% (0.8521 => 0.8062, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.38% (1.2221 => 1.1563, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/lists1: -5.38% (0.3867 => 0.3659, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.37% (1.0544 => 0.9978, std.dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: -5.37% (34.0927 => 32.2631, std.dev.: 0.0145) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.36% (4.0323 => 3.8162, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.31% (0.4427 => 0.4192, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.30% (0.3491 => 0.3306, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.26% (0.4813 => 0.4560, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.25% (0.7198 => 0.6820, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.14% (1.2784 => 1.2127, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -5.13% (0.4248 => 0.4030, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -5.09% (0.6347 => 0.6024, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: -5.05% (18.2933 => 17.3692, std.dev.: 0.0271) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.05% (0.2933 => 0.2785, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -5.03% (4.0594 => 3.8554, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.00% (0.5999 => 0.5699, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.98% (2.2587 => 2.1463, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -4.96% (0.2985 => 0.2837, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -4.92% (9.2283 => 8.7743, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.92% (0.2278 => 0.2166, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.90% (0.2999 => 0.2852, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -4.89% (0.6441 => 0.6126, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.88% (1.4642 => 1.3927, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: -4.86% (0.7779 => 0.7401, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -4.85% (1.6364 => 1.5570, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.85% (0.6293 => 0.5988, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: -4.84% (0.4524 => 0.4305, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.82% (0.9557 => 0.9096, std.dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.80% (1.3722 => 1.3064, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: -4.74% (0.7982 => 0.7604, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.65% (0.6230 => 0.5940, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: -4.64% (0.3581 => 0.3415, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.60% (0.4916 => 0.4690, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.60% (0.5591 => 0.5334, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.55% (0.6681 => 0.6377, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.55% (0.3319 => 0.3168, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.53% (0.5805 => 0.5542, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.51% (0.6676 => 0.6375, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.50% (0.5802 => 0.5541, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.49% (0.5478 => 0.5232, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.48% (0.6667 => 0.6368, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.47% (0.5857 => 0.5595, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.47% (0.5705 => 0.5450, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.47% (0.7339 => 0.7011, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.45% (0.5859 => 0.5598, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.45% (0.5575 => 0.5327, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.44% (0.6052 => 0.5783, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.44% (0.2385 => 0.2279, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.42% (0.5863 => 0.5604, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.40% (0.5456 => 0.5216, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.39% (0.6304 => 0.6027, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: -4.39% (0.4515 => 0.4317, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.37% (0.6660 => 0.6369, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.37% (0.6297 => 0.6022, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.35% (0.6395 => 0.6117, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.33% (0.6189 => 0.5921, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.33% (0.5570 => 0.5329, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.31% (0.5569 => 0.5329, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.29% (0.6194 => 0.5928, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.28% (0.6260 => 0.5992, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.28% (0.5941 => 0.5687, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.25% (0.5925 => 0.5673, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.24% (0.5567 => 0.5331, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.24% (0.5688 => 0.5447, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.22% (0.6440 => 0.6168, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.19% (0.5581 => 0.5347, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: -4.17% (0.8418 => 0.8067, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.16% (0.6033 => 0.5782, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.16% (0.6446 => 0.6178, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.15% (0.7524 => 0.7212, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -4.12% (1.1450 => 1.0978, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.12% (0.5849 => 0.5608, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: -4.07% (0.3271 => 0.3138, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.07% (0.6395 => 0.6135, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: -4.07% (2.1401 => 2.0531, std.dev.: 0.0082) MultiSource/Applications/minisat/minisat: -4.03% (0.7447 => 0.7147, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.02% (8.0126 => 7.6906, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.00% (0.7021 => 0.6740, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: -4.00% (0.9179 => 0.8812, std.dev.: 0.0028) MultiSource/Benchmarks/sim/sim: -3.96% (0.3406 => 0.3271, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: -3.91% (15.5079 => 14.9012, std.dev.: 0.0029) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.85% (6.7716 => 6.5112, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.79% (0.3483 => 0.3351, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.78% (0.9077 => 0.8734, std.dev.: 0.0036) MultiSource/Applications/oggenc/oggenc: -3.76% (5.0226 => 4.8338, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.75% (0.5168 => 0.4974, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: -3.71% (1.5610 => 1.5031, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: -3.66% (17.1032 => 16.4776, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.56% (0.6736 => 0.6496, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: -3.54% (3.5154 => 3.3908, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.53% (0.5329 => 0.5141, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.49% (1.2300 => 1.1871, std.dev.: 0.0083) MultiSource/Benchmarks/nbench/nbench: -3.43% (1.1530 => 1.1135, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.01% (14.2083 => 13.7802, std.dev.: 0.0135) SingleSource/UnitTests/Vector/constpool: -1.98% (20.7746 => 20.3639, std.dev.: 0.0380) MultiSource/Applications/SIBsim4/SIBsim4: -1.49% (1.3864 => 1.3658, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.36% (7.5137 => 5.7587, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -8.62% (1.2842 => 1.1735, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.93% (1.7753 => 1.7055, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: -3.79% (2.2633 => 2.1776, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.28% (1.3096 => 1.2667, std.dev.: 0.0148) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4671, std.dev.: 0.0013) Report Time: 2.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 29 06:54:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 08:54:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121029135453.4D0702A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5365?compare_to=5362&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5365, Order: 166922, Start Time: 2012-10-29 12:23:54, End Time: 2012-10-29 13:54:52 To: 5362, Order: 166916, Start Time: 2012-10-29 10:23:26, End Time: 2012-10-29 11:54:23 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (10 on baseline) New Passes: 0 (14 on baseline) Performance Regressions: 0 (188 on baseline) Performance Improvements: 0 (54 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 15 (5 on baseline) Unchanged Tests: 1027 (637 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: 0.06% (2.0516 => 2.0529, std.dev.: 0.0095) MultiSource/Benchmarks/Bullet/bullet: 0.01% (57.7426 => 57.7505, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0799 => 0.0799, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 0.03% (9.2327 => 9.2354, std.dev.: 0.0047) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.03% (7.7833 => 7.7859, std.dev.: 0.0052) SingleSource/UnitTests/Vector/SSE/sse_shift: 0.19% (0.0517 => 0.0518, std.dev.: 0.0017) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/JM/lencod/lencod: -0.14% (7.7335 => 7.7230, std.dev.: 0.0149) MultiSource/Applications/oggenc/oggenc: - (0.0001 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0648 => 0.0648, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.10% (0.2990 => 0.2993, std.dev.: 0.0031) SingleSource/UnitTests/Vector/SSE/sse_shift: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -64.35% (5.7591 => 2.0529, std.dev.: 0.0095) MultiSource/Benchmarks/Bullet/bullet: -8.69% (63.2438 => 57.7505, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.81% (6.6874 => 0.0799, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.51% (8.1363 => 9.2354, std.dev.: 0.0047) SingleSource/UnitTests/Vector/SSE/sse_shift: 37.04% (0.0378 => 0.0518, std.dev.: 0.0017) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -50.00% (0.0002 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -57.01% (0.6962 => 0.2993, std.dev.: 0.0031) SingleSource/UnitTests/Vector/SSE/sse_shift: -50.00% (0.0002 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 211.68% (0.5229 => 1.6298, std.dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 17.46% (14.9895 => 17.6061, std.dev.: 0.0134) MultiSource/Applications/kimwitu++/kc: 37.24% (14.1553 => 19.4262, std.dev.: 0.0155) MultiSource/Benchmarks/MallocBench/gs/gs: 13.69% (4.1105 => 4.6733, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 32.57% (1.1048 => 1.4646, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.52% (3.4629 => 5.8357, std.dev.: 0.0260) SingleSource/Benchmarks/Misc-C++/stepanov_container: 68.13% (0.6222 => 1.0461, std.dev.: 0.0149) New Passes - Execution Time --------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 3836100.00% (0.0001 => 3.8362, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 11147800.00% (0.0001 => 11.1479, std.dev.: 0.0266) MultiSource/Applications/kimwitu++/kc: 50400.00% (0.0001 => 0.0505, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050200.00% (0.0001 => 10.0503, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5493700.00% (0.0001 => 5.4938, std.dev.: 0.0163) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 78.04% (0.0296 => 0.0527) SingleSource/Benchmarks/Misc/lowercase: 69.14% (0.0256 => 0.0433) SingleSource/Regression/C/sumarray2d: 60.52% (0.0271 => 0.0435, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 52.67% (0.0243 => 0.0371) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 43.72% (1.5859 => 2.2793, std.dev.: 0.0138) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.09% (0.0834 => 0.1185) MultiSource/Benchmarks/FreeBench/distray/distray: 40.25% (0.1056 => 0.1481, std.dev.: 0.0002) SingleSource/UnitTests/vla: 35.21% (0.0355 => 0.0480, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 34.73% (2.2024 => 2.9672, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/neural/neural: 33.56% (0.1463 => 0.1954, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 28.00% (0.1432 => 0.1833, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 27.85% (0.1655 => 0.2116, std.dev.: 0.0004) MultiSource/Benchmarks/llubenchmark/llu: 24.03% (0.0462 => 0.0573, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/rem: 21.85% (0.1144 => 0.1394) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.46% (0.1566 => 0.1902, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 20.82% (0.5105 => 0.6168, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 20.77% (0.1555 => 0.1878, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.32% (0.0871 => 0.1048, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 19.16% (0.6675 => 0.7954, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.07% (0.2271 => 0.2704, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 18.87% (1.3050 => 1.5512, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 18.82% (3.3354 => 3.9632, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 18.22% (0.0730 => 0.0863, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.17% (0.5020 => 0.5932, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 18.13% (0.1175 => 0.1388, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 18.02% (0.7115 => 0.8397, std.dev.: 0.0075) MultiSource/Benchmarks/McCat/08-main/main: 17.89% (0.2554 => 0.3011, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 17.83% (0.0746 => 0.0879, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 17.61% (0.1584 => 0.1863, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.58% (0.1337 => 0.1572, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: 17.57% (0.0626 => 0.0736, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 17.52% (0.1695 => 0.1992, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.48% (0.1510 => 0.1774, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 17.39% (0.1236 => 0.1451, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 17.34% (0.1032 => 0.1211, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.34% (1.5415 => 1.8088, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.31% (0.4615 => 0.5414, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.28% (0.0793 => 0.0930, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 17.15% (1.1840 => 1.3870, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/mst/mst: 17.11% (0.1163 => 0.1362, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.95% (0.8172 => 0.9557, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 16.77% (0.4879 => 0.5697, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 16.71% (0.3177 => 0.3708, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 16.60% (22.1758 => 25.8569, std.dev.: 0.0058) MultiSource/Applications/sgefa/sgefa: 16.60% (0.3109 => 0.3625, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 16.56% (0.2603 => 0.3034, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.48% (0.0886 => 0.1032, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.45% (0.6450 => 0.7511, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ft/ft: 16.39% (0.1940 => 0.2258, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 16.03% (0.0842 => 0.0977, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.02% (0.3121 => 0.3621, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 16.00% (0.1906 => 0.2211, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.00% (0.0675 => 0.0783, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.95% (0.2758 => 0.3198, std.dev.: 0.0043) MultiSource/Applications/aha/aha: 15.90% (0.1151 => 0.1334, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/exptree: 15.72% (0.0814 => 0.0942, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.52% (0.9765 => 1.1281, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 15.50% (1.1642 => 1.3446, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 15.44% (1.0722 => 1.2378, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 15.34% (2.0273 => 2.3383, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.22% (0.1117 => 0.1287, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 15.15% (0.2700 => 0.3109, std.dev.: 0.0017) MultiSource/Applications/spiff/spiff: 15.11% (0.7835 => 0.9019, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 15.05% (0.5860 => 0.6742, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.05% (0.2107 => 0.2424, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 15.00% (0.8921 => 1.0259, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.93% (0.1125 => 0.1293, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.87% (0.1695 => 0.1947, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.70% (1.1861 => 1.3605, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.69% (0.1062 => 0.1218, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.68% (0.0770 => 0.0883, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 14.67% (0.3423 => 0.3925, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 14.64% (1.4186 => 1.6263, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.60% (0.5981 => 0.6854, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.58% (0.2065 => 0.2366, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.36% (0.0759 => 0.0868, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 14.35% (0.4299 => 0.4916, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.34% (0.1625 => 0.1858, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.30% (4.2646 => 4.8744, std.dev.: 0.0110) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.21% (0.1330 => 0.1519, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 14.19% (0.7433 => 0.8488, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.17% (0.1143 => 0.1305, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.16% (0.0798 => 0.0911, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.15% (0.0933 => 0.1065, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 14.10% (0.0929 => 0.1060) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.09% (0.1029 => 0.1174, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 14.02% (3.8723 => 4.4151, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 13.73% (0.3387 => 0.3852, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.64% (0.0770 => 0.0875, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.61% (0.3307 => 0.3757, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.41% (0.5569 => 0.6316, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/health/health: 13.17% (0.1268 => 0.1435, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 13.06% (9.4845 => 10.7236, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.76% (0.3441 => 0.3880, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.65% (0.3826 => 0.4310, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: 12.52% (0.3092 => 0.3479, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 12.29% (0.0838 => 0.0941, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 12.23% (0.3180 => 0.3569, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.10% (0.1892 => 0.2121, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 12.07% (0.0953 => 0.1068, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 11.43% (2.2969 => 2.5595, std.dev.: 0.0082) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.43% (0.8101 => 0.9027, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 11.42% (0.4289 => 0.4779, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.42% (14.3668 => 16.0077, std.dev.: 0.0135) SingleSource/UnitTests/ObjC/parameter-passing: 11.28% (0.3927 => 0.4370, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.26% (0.3473 => 0.3864, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.18% (0.3543 => 0.3939, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.15% (0.3543 => 0.3938, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 11.14% (0.6456 => 0.7175, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.10% (0.3828 => 0.4253, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 11.06% (0.3561 => 0.3955, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/exceptions-3: 11.06% (0.3516 => 0.3905, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 11.06% (0.4620 => 0.5131, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.04% (0.3497 => 0.3883, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.99% (0.3694 => 0.4100, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 10.99% (4.9449 => 5.4882, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 10.97% (5.0018 => 5.5505, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.92% (0.1044 => 0.1158, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.71% (0.3427 => 0.3794, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.68% (0.3886 => 0.4301, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 10.66% (17.1811 => 19.0122, std.dev.: 0.0270) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.45% (2.2022 => 2.4323, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.25% (0.4636 => 0.5111, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 9.91% (0.3422 => 0.3761, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 9.90% (1.5603 => 1.7147, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.73% (0.3865 => 0.4241, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.68% (0.4203 => 0.4610, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 9.44% (0.4048 => 0.4430, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 9.36% (0.3684 => 0.4029, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.16% (0.4103 => 0.4479, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.05% (0.2266 => 0.2471, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.90% (3.8922 => 4.2388, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.89% (0.2430 => 0.2646, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 8.86% (0.7326 => 0.7975, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 8.60% (0.3603 => 0.3913, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.44% (0.6030 => 0.6539, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.44% (0.5925 => 0.6425, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.34% (0.4064 => 0.4403, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 7.80% (0.3283 => 0.3539, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.70% (0.2831 => 0.3049, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 7.68% (0.3098 => 0.3336, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.61% (0.3232 => 0.3478, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.59% (0.2793 => 0.3005, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.59% (0.3650 => 0.3927, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 7.37% (0.3282 => 0.3524, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.31% (0.3162 => 0.3393, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.23% (0.2891 => 0.3100, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 7.23% (0.2905 => 0.3115, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.09% (2.0665 => 2.2131, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.96% (0.2872 => 0.3072, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.88% (0.2877 => 0.3075, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.87% (0.8067 => 0.8621, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.86% (0.2871 => 0.3068, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 6.85% (1.2842 => 1.3722, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.71% (0.2756 => 0.2941, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.68% (0.3052 => 0.3256, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.68% (0.2725 => 0.2907, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.52% (0.2714 => 0.2891, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/random: 6.42% (0.2802 => 0.2982, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 6.19% (0.3379 => 0.3588, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.61% (0.3136 => 0.3312, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: 5.42% (0.2049 => 0.2160, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.24% (7.9617 => 8.3790, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/objinst: 5.08% (0.3131 => 0.3290, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.76% (0.3935 => 0.4083, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.46% (0.3817 => 0.3949, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.86% (7.0540 => 7.2558, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.01% (1.1145 => 1.3709, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 10.92% (0.9957 => 1.1044, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/richards_benchmark: 9.93% (1.1396 => 1.2528, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.95% (2.8904 => 3.0913, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (3.1578 => 3.3678, std.dev.: 0.0013) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: 4.50% (3.3453 => 3.4959, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 2.97% (1.9405 => 1.9981, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.97% (4.2280 => 4.3535, std.dev.: 0.0032) MultiSource/Applications/viterbi/viterbi: 2.46% (4.4649 => 4.5748, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0313 => 1.0563, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bisort/bisort: 1.81% (0.8333 => 0.8484, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2077, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.39% (9.1159 => 9.2430, std.dev.: 0.0150) MultiSource/Benchmarks/nbench/nbench: 1.30% (11.6436 => 11.7945, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.11% (6.5088 => 6.5810, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -76.68% (0.8651 => 0.2017, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.20% (5.3855 => 2.4128, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -54.91% (5.3526 => 2.4137, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/richards_benchmark: -45.38% (0.1622 => 0.0886, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.33% (1.1194 => 0.6791, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.06% (5.2763 => 3.2153, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -24.11% (1.7609 => 1.3363, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -17.19% (2.9384 => 2.4333, std.dev.: 0.0091) SingleSource/UnitTests/Vector/constpool: -8.84% (54.1659 => 49.3780, std.dev.: 0.0179) MultiSource/Applications/JM/ldecod/ldecod: -8.35% (10.4361 => 9.5652, std.dev.: 0.0049) MultiSource/Benchmarks/PAQ8p/paq8p: -7.72% (10.3673 => 9.5672, std.dev.: 0.0150) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -54.04% (8.0499 => 3.6995, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0133, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.33% (1.1492 => 0.7662, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.61% (0.0506 => 0.0341) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.38% (0.3987 => 0.2696, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.51% (2.9695 => 2.3605, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -19.00% (1.2258 => 0.9929, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4242, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: -11.00% (9.5636 => 8.5119, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel-2: -10.89% (1.5373 => 1.3699, std.dev.: 0.0029) SingleSource/Benchmarks/McGill/chomp: -10.87% (1.2373 => 1.1028, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.33% (19.9488 => 18.2872, std.dev.: 0.0239) MultiSource/Benchmarks/FreeBench/mason/mason: -8.01% (0.2161 => 0.1988, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.03% (1.8329 => 1.7041, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/oourafft: -5.47% (6.6465 => 6.2829, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.11% (1.6805 => 1.5947, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.89% (0.2497 => 0.2375, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5074, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.85% (8.1563 => 7.8420, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.74% (0.9540 => 0.9183, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.73% (1.3677 => 1.3167, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.64% (3.2827 => 3.1633, std.dev.: 0.0077) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.54% (32.5116 => 31.3600, std.dev.: 0.0140) MultiSource/Benchmarks/sim/sim: -3.33% (5.0483 => 4.8802, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -2.91% (4.6441 => 4.5089, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.76% (4.5009 => 4.3767, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.64% (0.4808 => 0.4681, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/multiplies: -1.95% (2.5528 => 2.5029, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -1.90% (10.2830 => 10.0874, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6831, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -1.29% (85.0658 => 83.9727, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.18% (1.7254 => 1.7050, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.10% (6.2999 => 6.2306, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -1.01% (1.1277 => 1.1163, std.dev.: 0.0007) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.77% (7.1582 => 7.7859, std.dev.: 0.0052) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: 10626.39% (0.0720 => 7.7230, std.dev.: 0.0149) MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 1.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 29 07:51:13 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 09:51:13 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121029145113.2B9162A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/5366?compare_to=5363&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5366, Order: 166924, Start Time: 2012-10-29 13:26:53, End Time: 2012-10-29 14:51:12 To: 5363, Order: 166921, Start Time: 2012-10-29 11:45:40, End Time: 2012-10-29 13:10:10 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 3 (90 on baseline) Performance Improvements: 1 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 971 (880 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.52% (1.2141 => 1.2325, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.08% (13.9146 => 14.0652, std.dev.: 0.0580) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/himenobmtxpa: 3.23% (4.3491 => 4.4897, std.dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash2: -2.59% (0.4289 => 0.4178, std.dev.: 0.0035) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: -0.73% (16.7280 => 16.6059, std.dev.: 0.1987) MultiSource/Applications/obsequi/Obsequi: -0.60% (1.0696 => 1.0632, std.dev.: 0.0154) MultiSource/Applications/sqlite3/sqlite3: -0.02% (0.6494 => 0.6493, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/08-main/main: -5.26% (0.1940 => 0.1838, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.66% (0.1678 => 0.1689, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.14% (0.3188 => 0.3288, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.57% (0.2473 => 0.2459, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.69% (0.3332 => 0.3355, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.60% (0.2375 => 0.2413, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 0.35% (0.6001 => 0.6022, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/mandel: 0.22% (0.0449 => 0.0450, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.63% (0.3354 => 0.3333, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -0.60% (0.2007 => 0.1995, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 17.27% (0.0220 => 0.0258, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.91% (0.0219 => 0.0217, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.47% (0.0427 => 0.0425, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -12.08% (0.0331 => 0.0291, std.dev.: 0.0052) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.28% (0.0313 => 0.0309, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.86% (0.0430 => 0.0422, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: -16.26% (0.0203 => 0.0170, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/test1: -0.45% (0.0220 => 0.0219, std.dev.: 0.0008) SingleSource/UnitTests/byval-alignment: 21.13% (0.0284 => 0.0344, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -84.62% (0.0013 => 0.0002, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 0.48% (0.1447 => 0.1454, std.dev.: 0.0049) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.75% (1.1414 => 1.1728, std.dev.: 0.0247) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -5.34% (0.1516 => 0.1435, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.51% (0.4088 => 0.4067, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.23% (0.1285 => 0.1288, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: - (0.0633 => 0.0633, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.37% (0.0268 => 0.0269, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.44% (0.0573 => 0.0587, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: - (1.1495 => 1.1495, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -35.48% (0.0031 => 0.0020, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 285.71% (0.0007 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.43% (0.0647 => 0.0586, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.68% (0.0265 => 0.0242, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.10% (0.8017 => 0.8009, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: 200.00% (0.0001 => 0.0003, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 51.28% (0.0039 => 0.0059, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.99% (2.1832 => 1.6594, std.dev.: 0.0046) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 36.07% (14.7684 => 20.0957, std.dev.: 0.1585) MultiSource/Benchmarks/Olden/tsp/tsp: 12.05% (0.1112 => 0.1246, std.dev.: 0.0049) SingleSource/UnitTests/SignlessTypes/rem: 11.40% (0.1035 => 0.1153, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.16% (0.8321 => 0.9250, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.12% (0.2279 => 0.2464, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.98% (0.2180 => 0.2354, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.59% (0.6010 => 0.6466, std.dev.: 0.0126) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.08% (0.3137 => 0.3359, std.dev.: 0.0039) MultiSource/Applications/SIBsim4/SIBsim4: 7.00% (1.2568 => 1.3448, std.dev.: 0.0232) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.71% (13.1811 => 14.0652, std.dev.: 0.0580) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.38% (0.7473 => 0.7950, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.16% (0.3003 => 0.3188, std.dev.: 0.0067) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.70% (6.6074 => 6.9843, std.dev.: 0.1016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.68% (0.1885 => 0.1992, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.48% (1.1685 => 1.2325, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.46% (0.1905 => 0.2009, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.41% (1.6386 => 1.7272, std.dev.: 0.0156) MultiSource/Applications/spiff/spiff: 5.35% (0.7950 => 0.8375, std.dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.31% (1.1170 => 1.1763, std.dev.: 0.0114) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.14% (0.2741 => 0.2882, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.07% (1.1606 => 1.2194, std.dev.: 0.0063) MultiSource/Benchmarks/nbench/nbench: 5.00% (1.1271 => 1.1834, std.dev.: 0.0128) MultiSource/Benchmarks/sim/sim: 4.99% (0.3226 => 0.3387, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.88% (0.2519 => 0.2642, std.dev.: 0.0034) MultiSource/Applications/Burg/burg: 4.64% (1.2222 => 1.2789, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.30% (0.9435 => 0.9841, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.26% (0.4127 => 0.4303, std.dev.: 0.0024) MultiSource/Applications/treecc/treecc: 4.06% (1.9948 => 2.0757, std.dev.: 0.0083) MultiSource/Applications/d/make_dparser: 3.92% (3.2366 => 3.3636, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.82% (0.5961 => 0.6189, std.dev.: 0.0078) MultiSource/Applications/SPASS/SPASS: 3.78% (14.2605 => 14.8002, std.dev.: 0.0108) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.74% (0.6227 => 0.6460, std.dev.: 0.0055) MultiSource/Applications/lua/lua: 3.69% (3.8189 => 3.9597, std.dev.: 0.0483) MultiSource/Benchmarks/McCat/05-eks/eks: 3.62% (0.4397 => 0.4556, std.dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: 3.60% (0.2999 => 0.3107, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.54% (0.8340 => 0.8635, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.47% (0.5817 => 0.6019, std.dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.47% (0.3717 => 0.3846, std.dev.: 0.0019) MultiSource/Applications/hbd/hbd: 3.38% (1.4269 => 1.4752, std.dev.: 0.0157) MultiSource/Applications/minisat/minisat: 3.35% (0.6834 => 0.7063, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.35% (0.8007 => 0.8275, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/football/football: 3.28% (0.8768 => 0.9056, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.17% (4.4873 => 4.6295, std.dev.: 0.0502) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 3.10% (0.9039 => 0.9319, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.04% (0.6586 => 0.6786, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.99% (0.8261 => 0.8508, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.88% (0.8069 => 0.8301, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.87% (4.1763 => 4.2963, std.dev.: 0.0321) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.83% (0.8457 => 0.8696, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.78% (0.8611 => 0.8850, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.76% (0.8855 => 0.9099, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.72% (0.9069 => 0.9316, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.72% (0.9074 => 0.9321, std.dev.: 0.0078) MultiSource/Applications/JM/lencod/lencod: 2.71% (15.3280 => 15.7436, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.68% (0.8805 => 0.9041, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.67% (0.7966 => 0.8179, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.62% (0.9688 => 0.9942, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.61% (0.8204 => 0.8418, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.58% (0.8359 => 0.8575, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.54% (0.9056 => 0.9286, std.dev.: 0.0065) MultiSource/Benchmarks/mafft/pairlocalalign: 2.54% (8.6247 => 8.8435, std.dev.: 0.0572) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.54% (1.2423 => 1.2738, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.52% (0.8048 => 0.8251, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.46% (0.8331 => 0.8536, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.43% (0.8420 => 0.8625, std.dev.: 0.0037) MultiSource/Benchmarks/Bullet/bullet: 2.30% (31.8598 => 32.5914, std.dev.: 0.2404) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.29% (0.8177 => 0.8364, std.dev.: 0.0068) MultiSource/Applications/JM/ldecod/ldecod: 2.28% (6.7320 => 6.8857, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.26% (0.8086 => 0.8269, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.26% (0.8597 => 0.8791, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.25% (0.8316 => 0.8503, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.24% (0.8885 => 0.9084, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.21% (0.8338 => 0.8522, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.09% (0.8716 => 0.8898, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.95% (4.5702 => 4.6591, std.dev.: 0.0324) MultiSource/Applications/oggenc/oggenc: 1.73% (4.9628 => 5.0486, std.dev.: 0.0222) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.57% (0.8995 => 0.9136, std.dev.: 0.0033) MultiSource/Benchmarks/PAQ8p/paq8p: 1.33% (2.3764 => 2.4080, std.dev.: 0.0096) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.47% (1.5795 => 2.5030, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.67% (0.3186 => 0.3526, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.27% (2.4333 => 2.6589, std.dev.: 0.0771) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.00% (1.1857 => 1.2806, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 5.95% (63.1822 => 66.9394, std.dev.: 0.0234) SingleSource/Benchmarks/Misc/ReedSolomon: 3.14% (8.5322 => 8.8005, std.dev.: 0.0378) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.09% (4.3552 => 4.4897, std.dev.: 0.0034) MultiSource/Applications/siod/siod: 2.68% (3.6643 => 3.7626, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.56% (0.4031 => 0.4134, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: 1.64% (2.3560 => 2.3946, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.49% (1.5941 => 1.6178, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.46% (59.2638 => 60.1278, std.dev.: 0.2560) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.88% (0.3269 => 0.3044, std.dev.: 0.0014) MultiSource/Applications/lua/lua: -5.19% (29.8330 => 28.2859, std.dev.: 0.2223) SingleSource/Benchmarks/Shootout-C++/hash2: -1.48% (3.4237 => 3.3730, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.27% (3.3479 => 3.3054, std.dev.: 0.0108) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.97% (16.4461 => 16.6059, std.dev.: 0.1987) MultiSource/Applications/obsequi/Obsequi: 3.61% (1.0262 => 1.0632, std.dev.: 0.0154) MultiSource/Applications/sqlite3/sqlite3: 2.54% (0.6332 => 0.6493, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/08-main/main: 0.38% (0.1831 => 0.1838, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 8.34% (0.1559 => 0.1689, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.28% (0.3123 => 0.3288, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.16% (0.2463 => 0.2459, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: 0.33% (0.3344 => 0.3355, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.07% (0.2364 => 0.2413, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 0.20% (0.6010 => 0.6022, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/mandel: 4.90% (0.0429 => 0.0450, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.05% (0.3266 => 0.3333, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 1.32% (0.1969 => 0.1995, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 15.18% (0.0224 => 0.0258, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 76.42% (0.0123 => 0.0217, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.17% (0.0408 => 0.0425, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 14.57% (0.0254 => 0.0291, std.dev.: 0.0052) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.32% (0.0302 => 0.0309, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.90% (0.0384 => 0.0422, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: -10.53% (0.0190 => 0.0170, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0008) SingleSource/UnitTests/byval-alignment: 49.57% (0.0230 => 0.0344, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: -71.43% (0.0007 => 0.0002, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 1.11% (0.1438 => 0.1454, std.dev.: 0.0049) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 3.52% (1.1329 => 1.1728, std.dev.: 0.0247) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.85% (0.1462 => 0.1435, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.33% (0.4164 => 0.4067, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.92% (0.1369 => 0.1288, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.25% (0.0641 => 0.0633, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 37.95% (0.0195 => 0.0269, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.56% (0.0578 => 0.0587, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.51% (1.1437 => 1.1495, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1900.00% (0.0001 => 0.0020, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.54% (0.0627 => 0.0586, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 34.44% (0.0180 => 0.0242, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.10% (0.8017 => 0.8009, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: 200.00% (0.0001 => 0.0003, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -4.84% (0.0062 => 0.0059, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 29 07:59:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 09:59:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121029145936.D5A372A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/5367?compare_to=5359&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5367, Order: 166921, Start Time: 2012-10-29 11:44:12, End Time: 2012-10-29 14:59:36 To: 5359, Order: 166915, Start Time: 2012-10-29 07:40:25, End Time: 2012-10-29 10:56:07 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (169 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1040 (720 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 4.06% (2.0120 => 2.0937, std.dev.: 0.0234) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.12% (2.4785 => 2.4508, std.dev.: 0.0064) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.16% (0.0625 => 0.0876, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.51% (0.1063 => 0.1398, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.53% (0.2969 => 0.3727, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 24.95% (0.1106 => 0.1382, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 24.67% (1.5932 => 1.9862, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 23.89% (0.4139 => 0.5128, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.80% (0.5900 => 0.7304, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.27% (0.4994 => 0.6156, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.22% (0.0547 => 0.0674) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.16% (0.0475 => 0.0585, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.00% (0.5000 => 0.6150, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.55% (0.0714 => 0.0875, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.43% (0.0584 => 0.0715, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 22.41% (0.4253 => 0.5206, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.04% (0.1620 => 0.1977, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.94% (0.1021 => 0.1245, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 21.87% (0.0599 => 0.0730, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.41% (0.1107 => 0.1344, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 20.74% (0.0897 => 0.1083, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.70% (0.0633 => 0.0764, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/em3d/em3d: 20.57% (0.0948 => 0.1143, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.56% (0.0642 => 0.0774, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.31% (0.1103 => 0.1327, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: 20.20% (0.0604 => 0.0726, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.03% (0.0584 => 0.0701, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: 19.98% (0.0821 => 0.0985, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.96% (0.0541 => 0.0649, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.95% (0.0822 => 0.0986, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/05-eks/eks: 19.95% (0.1619 => 0.1942, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.84% (0.1003 => 0.1202, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.73% (0.3903 => 0.4673, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.50% (0.1549 => 0.1851, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.39% (0.1604 => 0.1915, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 18.69% (0.0947 => 0.1124, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.26% (0.1462 => 0.1729, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.17% (0.2014 => 0.2380, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: 18.12% (0.4029 => 0.4759, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 18.04% (0.5826 => 0.6877, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 17.98% (0.1218 => 0.1437, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.97% (0.3890 => 0.4589, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 17.95% (0.0808 => 0.0953, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 17.76% (0.5889 => 0.6935, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.59% (1.3152 => 1.5466, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/mst/mst: 17.48% (0.0698 => 0.0820, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 17.48% (0.1505 => 0.1768, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.46% (0.1088 => 0.1278, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.32% (0.2736 => 0.3210, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.10% (0.2866 => 0.3356, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.05% (0.4658 => 0.5452, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.98% (3.5627 => 4.1678, std.dev.: 0.0036) MultiSource/Applications/Burg/burg: 16.73% (0.5546 => 0.6474, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 16.69% (1.8794 => 2.1930, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.67% (1.6211 => 1.8914, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.60% (0.3271 => 0.3814, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.55% (0.1160 => 0.1352, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.31% (0.1968 => 0.2289, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.24% (0.2875 => 0.3342, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.02% (2.7292 => 3.1665, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.00% (0.5026 => 0.5830, std.dev.: 0.0019) MultiSource/Applications/hbd/hbd: 15.94% (0.9697 => 1.1243, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions-3: 15.92% (0.3460 => 0.4011, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 15.90% (0.1421 => 0.1647, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 15.88% (0.7171 => 0.8310, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-4: 15.87% (0.3465 => 0.4015, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 15.84% (0.3446 => 0.3992, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.78% (0.2738 => 0.3170, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/for-in: 15.76% (0.3496 => 0.4047, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 15.75% (0.3442 => 0.3984, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 15.74% (0.2725 => 0.3154, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 15.72% (1.0781 => 1.2476, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.71% (0.3488 => 0.4036, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 15.71% (0.3469 => 0.4014, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 15.59% (0.2714 => 0.3137, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.57% (0.4361 => 0.5040, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.45% (0.3930 => 0.4537, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.43% (0.2729 => 0.3150, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 15.41% (0.3004 => 0.3467, std.dev.: 0.0089) SingleSource/UnitTests/ObjC/property: 15.40% (0.3650 => 0.4212, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 15.34% (0.1284 => 0.1481, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 15.29% (0.2780 => 0.3205, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/strcat: 15.27% (0.2750 => 0.3170, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.23% (4.4195 => 5.0927, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.19% (0.2792 => 0.3216, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 15.18% (0.3643 => 0.4196, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 15.16% (0.2803 => 0.3228, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 15.15% (4.2109 => 4.8490, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.13% (1.9694 => 2.2674, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/except: 15.12% (0.2811 => 0.3236, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 15.09% (0.2823 => 0.3249, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.09% (0.3195 => 0.3677, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 15.08% (0.3096 => 0.3563, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: 15.04% (0.3724 => 0.4284, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 15.04% (0.2813 => 0.3236, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.01% (1.9966 => 2.2963, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.95% (2.0673 => 2.3764, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.84% (0.2911 => 0.3343, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 14.80% (0.9909 => 1.1376, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 14.66% (0.3267 => 0.3746, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.50% (0.1090 => 0.1248, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 14.40% (0.3258 => 0.3727, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 14.35% (0.3317 => 0.3793, std.dev.: 0.0098) MultiSource/Benchmarks/Bullet/bullet: 14.25% (23.5202 => 26.8716, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.22% (0.3060 => 0.3495, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.17% (0.3282 => 0.3747, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.13% (0.3362 => 0.3837, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.96% (0.3124 => 0.3560, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 13.74% (1.4269 => 1.6229, std.dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 13.72% (0.2566 => 0.2918, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 13.62% (0.3678 => 0.4179, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 13.62% (0.3348 => 0.3804, std.dev.: 0.0051) MultiSource/Applications/treecc/treecc: 13.59% (0.7875 => 0.8945, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 13.58% (0.3726 => 0.4232, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/football/football: 13.54% (0.2075 => 0.2356, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 13.37% (0.3477 => 0.3942, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.29% (0.3981 => 0.4510, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.27% (0.3625 => 0.4106, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.25% (0.3690 => 0.4179, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 13.22% (0.4251 => 0.4813, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 13.07% (0.4146 => 0.4688, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 12.95% (2.1653 => 2.4458, std.dev.: 0.0033) MultiSource/Applications/JM/lencod/lencod: 12.83% (4.6177 => 5.2100, std.dev.: 0.0072) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.80% (0.3845 => 0.4337, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 12.62% (2.1013 => 2.3665, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: 12.41% (0.5012 => 0.5634, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 11.85% (5.5417 => 6.1983, std.dev.: 0.0093) MultiSource/Applications/SIBsim4/SIBsim4: 11.74% (0.2691 => 0.3007, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.62% (0.2040 => 0.2277, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.14% (0.6435 => 0.7152, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.70% (0.1028 => 0.1138, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 10.49% (0.3498 => 0.3865, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.27% (0.2737 => 0.3018, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 10.22% (0.6634 => 0.7312, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.20% (0.2068 => 0.2279, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.83% (0.1383 => 0.1519, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 9.82% (0.4847 => 0.5323, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 9.71% (0.3336 => 0.3660, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.57% (0.3084 => 0.3379, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.08% (0.2103 => 0.2294, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 9.03% (2.0346 => 2.2184, std.dev.: 0.0032) MultiSource/Applications/lemon/lemon: 8.74% (0.2391 => 0.2600, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.68% (4.6926 => 5.0999, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.05% (11.6398 => 12.5770, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.74% (0.5361 => 0.5776, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.24% (0.7426 => 0.7964, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.98% (0.5584 => 0.5974, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 6.31% (11.9555 => 12.7104, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.25% (0.3792 => 0.4029, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6534, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0300, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698) MultiSource/Applications/ClamAV/clamscan: 8.74% (0.2802 => 0.3047, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6102, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.03% (12.0509 => 12.6568, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops: 4.66% (15.4430 => 16.1629, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-2: 3.81% (1.8057 => 1.8745, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.49% (0.3693 => 0.3822, std.dev.: 0.0029) SingleSource/Benchmarks/Dhrystone/dry: 2.77% (14.0481 => 14.4366, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary3: 1.99% (15.8721 => 16.1883, std.dev.: 0.0041) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.71% (3.1722 => 3.2266, std.dev.: 0.0025) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3044, std.dev.: 0.0095) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2871, std.dev.: 0.0018) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5140, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5401, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5904, std.dev.: 0.0106) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.03% (2.4764 => 2.4508, std.dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.52% (25.4195 => 16.3917, std.dev.: 0.0077) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9784, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7737, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/tsp/tsp: -7.17% (2.1113 => 1.9599, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: -6.58% (0.2402 => 0.2244, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.43% (11.2080 => 10.8238, std.dev.: 0.0656) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.13% (0.6293 => 0.6096, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7745, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5218, std.dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/fldry: -2.70% (17.2379 => 16.7727, std.dev.: 0.0443) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.13% (41.7953 => 40.9066, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5764, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4950, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.11% (105.3826 => 104.2164, std.dev.: 0.0573) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0424, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.05% (3.3991 => 3.3634, std.dev.: 0.0007) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 29 08:10:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 10:10:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121029151044.23E142A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5368?compare_to=5364&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5368, Order: 166924, Start Time: 2012-10-29 13:45:02, End Time: 2012-10-29 15:10:43 To: 5364, Order: 166921, Start Time: 2012-10-29 11:56:41, End Time: 2012-10-29 13:21:58 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 0 (176 on baseline) Unchanged Tests: 1041 (860 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.14% (54.8212 => 56.5414, std.dev.: 0.0356) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.46% (15.2527 => 18.3727, std.dev.: 0.0199) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.60% (54.5751 => 56.5414, std.dev.: 0.0356) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1009, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/hash2: 2.20% (3.1932 => 3.2634, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/salsa20: 2.19% (7.4937 => 7.6581, std.dev.: 0.0283) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.33% (0.1584 => 0.1452, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.25% (0.1431 => 0.1313, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.01% (0.3821 => 0.3553, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-2: -6.76% (0.3831 => 0.3572, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: -6.63% (0.3848 => 0.3593, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.59% (0.3884 => 0.3628, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: -6.58% (0.3812 => 0.3561, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -6.57% (0.3880 => 0.3625, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.56% (0.3142 => 0.2936, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.50% (0.3891 => 0.3638, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.50% (0.4033 => 0.3771, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -6.47% (0.3896 => 0.3644, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.43% (0.2428 => 0.2272, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.42% (0.4176 => 0.3908, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -6.36% (2.4924 => 2.3338, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: -6.29% (0.4199 => 0.3935, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.25% (22.4056 => 21.0054, std.dev.: 0.0245) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.18% (0.3658 => 0.3432, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -6.17% (0.4280 => 0.4016, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.94% (0.2355 => 0.2215, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: -5.94% (0.2659 => 0.2501, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.89% (0.6484 => 0.6102, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -5.85% (0.1879 => 0.1769, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -5.83% (0.2160 => 0.2034, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -5.81% (0.3357 => 0.3162, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.80% (5.4682 => 5.1511, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.80% (4.5069 => 4.2456, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/except: -5.78% (0.3026 => 0.2851, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.71% (0.3837 => 0.3618, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.69% (0.3057 => 0.2883, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -5.69% (1.3148 => 1.2400, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.68% (0.2903 => 0.2738, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.68% (0.9542 => 0.9000, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.66% (0.9852 => 0.9294, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.62% (3.5339 => 3.3353, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.61% (2.1713 => 2.0494, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.60% (0.3016 => 0.2847, std.dev.: 0.0039) MultiSource/Applications/Burg/burg: -5.60% (1.2515 => 1.1814, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.57% (0.3252 => 0.3071, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: -5.55% (0.2989 => 0.2823, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -5.55% (4.3330 => 4.0924, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -5.54% (7.0961 => 6.7031, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: -5.53% (0.4861 => 0.4592, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/matrix: -5.53% (0.3255 => 0.3075, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -5.52% (0.3025 => 0.2858, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: -5.51% (0.2939 => 0.2777, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.51% (0.3849 => 0.3637, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -5.50% (0.3621 => 0.3422, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: -5.48% (0.3194 => 0.3019, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/fibo: -5.47% (0.2871 => 0.2714, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -5.46% (0.3788 => 0.3581, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.46% (1.6474 => 1.5574, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.46% (0.4083 => 0.3860, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -5.46% (0.3446 => 0.3258, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.45% (4.8161 => 4.5534, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hello: -5.44% (0.2849 => 0.2694, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: -5.43% (16.1920 => 15.3123, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -5.42% (0.3394 => 0.3210, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -5.42% (2.4021 => 2.2720, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.41% (1.2221 => 1.1560, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary2: -5.40% (0.3481 => 0.3293, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.40% (1.0544 => 0.9975, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.39% (0.3931 => 0.3719, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.38% (0.2548 => 0.2411, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.37% (0.4151 => 0.3928, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.37% (4.8802 => 4.6181, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/wc: -5.34% (0.3205 => 0.3034, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -5.33% (0.6750 => 0.6390, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: -5.30% (0.3059 => 0.2897, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.28% (1.2784 => 1.2109, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.26% (0.4427 => 0.4194, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.25% (0.7919 => 0.7503, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: -5.22% (0.3867 => 0.3665, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.21% (1.2210 => 1.1574, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.21% (0.4321 => 0.4096, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: -5.19% (0.2985 => 0.2830, std.dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: -5.17% (34.0927 => 32.3288, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.17% (4.0323 => 3.8237, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.09% (0.3323 => 0.3154, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: -5.06% (0.4248 => 0.4033, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.06% (0.8521 => 0.8090, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.05% (0.4813 => 0.4570, std.dev.: 0.0009) MultiSource/Applications/lua/lua: -5.04% (4.0594 => 3.8550, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.03% (0.5999 => 0.5697, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.01% (0.3491 => 0.3316, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.00% (0.2278 => 0.2164, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.91% (2.2587 => 2.1479, std.dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: -4.87% (18.2933 => 17.4018, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.87% (0.2999 => 0.2853, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -4.84% (9.2283 => 8.7813, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.80% (0.6293 => 0.5991, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -4.80% (0.7982 => 0.7599, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -4.77% (1.6364 => 1.5584, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.74% (1.3722 => 1.3072, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.73% (0.3319 => 0.3162, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference: -4.70% (0.7779 => 0.7413, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.67% (0.2933 => 0.2796, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -4.66% (0.4524 => 0.4313, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -4.66% (0.6347 => 0.6051, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.65% (1.4642 => 1.3961, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.64% (0.9557 => 0.9114, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: -4.61% (0.6441 => 0.6144, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: -4.61% (0.3581 => 0.3416, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.61% (0.6230 => 0.5943, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.60% (0.7198 => 0.6867, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.56% (0.5591 => 0.5336, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.56% (0.5857 => 0.5590, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.54% (0.4916 => 0.4693, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/05-eks/eks: -4.50% (0.4515 => 0.4312, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.45% (0.6667 => 0.6370, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.45% (0.5859 => 0.5598, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.40% (0.2385 => 0.2280, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.40% (0.6681 => 0.6387, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.40% (0.6052 => 0.5786, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.39% (0.6395 => 0.6114, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.39% (0.5805 => 0.5550, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.38% (0.5802 => 0.5548, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.36% (0.5478 => 0.5239, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.36% (0.5456 => 0.5218, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.36% (0.7339 => 0.7019, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.31% (0.5705 => 0.5459, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.31% (0.6660 => 0.6373, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.30% (0.5575 => 0.5335, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.30% (0.6297 => 0.6026, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.28% (0.6304 => 0.6034, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.28% (0.6194 => 0.5929, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.24% (0.5569 => 0.5333, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.24% (0.5570 => 0.5334, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.23% (0.6260 => 0.5995, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.23% (0.7524 => 0.7206, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.22% (0.6676 => 0.6394, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.22% (0.6440 => 0.6168, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.17% (0.5581 => 0.5348, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/09-vor/vor: -4.16% (0.3271 => 0.3135, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.16% (0.5941 => 0.5694, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.15% (0.6189 => 0.5932, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: -4.14% (0.7447 => 0.7139, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.13% (0.5688 => 0.5453, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: -4.12% (0.8418 => 0.8071, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.11% (0.6033 => 0.5785, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.10% (0.5925 => 0.5682, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -4.09% (1.1450 => 1.0982, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.06% (0.6446 => 0.6184, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.06% (0.5567 => 0.5341, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.03% (0.5849 => 0.5613, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -4.02% (0.3406 => 0.3269, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.02% (0.6395 => 0.6138, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -4.00% (2.1401 => 2.0545, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.95% (0.7021 => 0.6744, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.87% (0.6736 => 0.6475, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -3.86% (8.0126 => 7.7032, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: -3.85% (15.5079 => 14.9111, std.dev.: 0.0190) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.81% (6.7716 => 6.5135, std.dev.: 0.0036) MultiSource/Applications/oggenc/oggenc: -3.76% (5.0226 => 4.8336, std.dev.: 0.0160) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.73% (0.5168 => 0.4975, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.70% (0.3483 => 0.3354, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -3.66% (17.1032 => 16.4770, std.dev.: 0.0127) MultiSource/Applications/d/make_dparser: -3.60% (3.5154 => 3.3890, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.51% (0.5329 => 0.5142, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: -3.41% (1.5610 => 1.5078, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.33% (0.9077 => 0.8775, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/football/football: -3.20% (0.9179 => 0.8885, std.dev.: 0.0068) MultiSource/Benchmarks/nbench/nbench: -3.11% (1.1530 => 1.1171, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.04% (14.2083 => 13.7757, std.dev.: 0.0234) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.72% (1.2300 => 1.1965, std.dev.: 0.0030) SingleSource/UnitTests/Vector/constpool: -2.21% (20.7746 => 20.3164, std.dev.: 0.0420) MultiSource/Applications/SIBsim4/SIBsim4: -1.65% (1.3864 => 1.3635, std.dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.50% (7.5137 => 5.7480, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/richards_benchmark: -8.65% (1.2842 => 1.1731, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -4.03% (2.2633 => 2.1722, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.87% (1.7753 => 1.7066, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.29% (1.0557 => 1.0210, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.15% (1.3096 => 1.2684, std.dev.: 0.0159) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4688, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.06% (79.7170 => 78.8723, std.dev.: 0.2469) Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 29 08:55:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 10:55:45 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121029155545.ED3F42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5369?compare_to=5365&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5369, Order: 166924, Start Time: 2012-10-29 14:24:23, End Time: 2012-10-29 15:55:44 To: 5365, Order: 166922, Start Time: 2012-10-29 12:23:54, End Time: 2012-10-29 13:54:52 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (10 on baseline) New Passes: 0 (14 on baseline) Performance Regressions: 6 (191 on baseline) Performance Improvements: 0 (54 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 15 (5 on baseline) Unchanged Tests: 1021 (634 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 5.33% (9.5672 => 10.0768, std.dev.: 0.0160) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.41% (1.3363 => 1.3552, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.04% (2.4323 => 2.4576, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.78% (54.4855 => 56.5432, std.dev.: 0.0515) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.18% (77.8676 => 80.3425, std.dev.: 0.3709) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.39% (1.2856 => 1.3035, std.dev.: 0.0052) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -0.42% (2.0529 => 2.0443, std.dev.: 0.0062) MultiSource/Benchmarks/Bullet/bullet: 0.60% (57.7505 => 58.0959, std.dev.: 0.0174) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.25% (0.0799 => 0.0801, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 0.29% (9.2354 => 9.2624, std.dev.: 0.0055) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.69% (7.7859 => 7.8395, std.dev.: 0.0083) SingleSource/UnitTests/Vector/SSE/sse_shift: - (0.0518 => 0.0518, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/JM/lencod/lencod: -0.00% (7.7230 => 7.7227, std.dev.: 0.0160) MultiSource/Applications/oggenc/oggenc: - (0.0001 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0648 => 0.0648, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.10% (0.2993 => 0.2990, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_shift: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -64.50% (5.7591 => 2.0443, std.dev.: 0.0062) MultiSource/Benchmarks/Bullet/bullet: -8.14% (63.2438 => 58.0959, std.dev.: 0.0174) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.80% (6.6874 => 0.0801, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.84% (8.1363 => 9.2624, std.dev.: 0.0055) SingleSource/UnitTests/Vector/SSE/sse_shift: 37.04% (0.0378 => 0.0518, std.dev.: 0.0002) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -50.00% (0.0002 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -57.05% (0.6962 => 0.2990, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_shift: -50.00% (0.0002 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 213.48% (0.5229 => 1.6392, std.dev.: 0.0084) MultiSource/Applications/SPASS/SPASS: 18.09% (14.9895 => 17.7006, std.dev.: 0.0153) MultiSource/Applications/kimwitu++/kc: 38.20% (14.1553 => 19.5630, std.dev.: 0.0545) MultiSource/Benchmarks/MallocBench/gs/gs: 14.05% (4.1105 => 4.6879, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 33.22% (1.1048 => 1.4718, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 69.54% (3.4629 => 5.8711, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 69.08% (0.6222 => 1.0520, std.dev.: 0.0011) New Passes - Execution Time --------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 3836000.00% (0.0001 => 3.8361, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 11141900.00% (0.0001 => 11.1420, std.dev.: 0.0504) MultiSource/Applications/kimwitu++/kc: 50600.00% (0.0001 => 0.0507, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049900.00% (0.0001 => 10.0500, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5489900.00% (0.0001 => 5.4900, std.dev.: 0.0026) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 77.70% (0.0296 => 0.0526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 69.53% (0.0256 => 0.0434, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 61.25% (0.0271 => 0.0437, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 53.09% (0.0243 => 0.0372) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 44.22% (1.5859 => 2.2872, std.dev.: 0.0078) SingleSource/Regression/C/sumarray: 43.72% (0.0231 => 0.0332, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.73% (0.0834 => 0.1182, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 41.19% (0.1056 => 0.1491, std.dev.: 0.0004) SingleSource/UnitTests/vla: 36.06% (0.0355 => 0.0483, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 35.31% (2.2024 => 2.9801, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: 34.04% (0.1463 => 0.1961, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 29.89% (0.1432 => 0.1860, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 28.40% (0.1655 => 0.2125, std.dev.: 0.0006) MultiSource/Benchmarks/llubenchmark/llu: 24.24% (0.0462 => 0.0574, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: 23.30% (0.0485 => 0.0598, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/rem: 22.12% (0.1144 => 0.1397, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.90% (0.1566 => 0.1909, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.63% (0.5105 => 0.6209, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 21.09% (0.1555 => 0.1883, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.01% (0.0871 => 0.1054, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 19.63% (0.6675 => 0.7985, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 19.34% (1.3050 => 1.5574, std.dev.: 0.0093) MultiSource/Applications/d/make_dparser: 19.19% (3.3354 => 3.9753, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/n-body: 19.17% (0.0746 => 0.0889, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.11% (0.2271 => 0.2705, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.98% (0.5020 => 0.5973, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/almabench: 18.77% (0.0730 => 0.0867, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 18.60% (0.2554 => 0.3029, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 18.57% (0.7115 => 0.8436, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 18.47% (0.1175 => 0.1392, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 18.37% (0.1584 => 0.1875, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 18.12% (0.1236 => 0.1460, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: 18.05% (0.0626 => 0.0739, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 18.02% (0.1032 => 0.1218, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.95% (0.1510 => 0.1781, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 17.93% (0.4879 => 0.5754, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.91% (0.0793 => 0.0935, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 17.84% (1.1840 => 1.3952, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 17.82% (0.1695 => 0.1997, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.68% (1.5415 => 1.8140, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.64% (0.4615 => 0.5429, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 17.50% (0.1337 => 0.1571, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 17.50% (0.3177 => 0.3733, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/mst/mst: 17.45% (0.1163 => 0.1366, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 17.24% (0.3109 => 0.3645, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.04% (0.6450 => 0.7549, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 16.96% (0.1940 => 0.2269, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 16.94% (0.2603 => 0.3044, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.92% (0.8172 => 0.9555, std.dev.: 0.0059) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.92% (0.3121 => 0.3649, std.dev.: 0.0023) MultiSource/Applications/aha/aha: 16.68% (0.1151 => 0.1343, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 16.63% (22.1758 => 25.8640, std.dev.: 0.0098) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.59% (0.0886 => 0.1033, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.44% (0.0675 => 0.0786, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/exptree: 16.22% (0.0814 => 0.0946, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 16.21% (0.1906 => 0.2215, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 16.04% (0.7835 => 0.9092, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 16.03% (0.0842 => 0.0977, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 16.01% (1.0722 => 1.2439, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 15.83% (1.1642 => 1.3485, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.82% (0.9765 => 1.1310, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 15.75% (2.0273 => 2.3466, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.66% (0.2758 => 0.3190, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 15.58% (0.1695 => 0.1959, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 15.54% (0.8921 => 1.0307, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.49% (0.1117 => 0.1290, std.dev.: 0.0017) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.49% (0.1143 => 0.1320, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 15.44% (0.2700 => 0.3117, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 15.33% (0.0672 => 0.0775, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 15.29% (0.1125 => 0.1297, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.28% (0.2107 => 0.2429, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 15.14% (0.4299 => 0.4950, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 15.13% (1.4186 => 1.6332, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.07% (1.1861 => 1.3648, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.06% (0.0770 => 0.0886, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.02% (0.0759 => 0.0873, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 15.02% (0.3423 => 0.3937, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.01% (0.0933 => 0.1073, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.97% (0.1062 => 0.1221, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.95% (0.1625 => 0.1868, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.95% (0.5860 => 0.6736, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.93% (0.5981 => 0.6874, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.84% (4.2646 => 4.8976, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.81% (0.1330 => 0.1527, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: 14.64% (0.0929 => 0.1065) MultiSource/Applications/lambda-0_1_3/lambda: 14.62% (0.7433 => 0.8520, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.58% (0.1029 => 0.1179, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.53% (0.2065 => 0.2365, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 14.50% (3.8723 => 4.4339, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.38% (0.0730 => 0.0835, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 14.32% (0.3387 => 0.3872, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.29% (0.0798 => 0.0912, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.97% (0.3307 => 0.3769, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 13.64% (9.4845 => 10.7783, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.64% (0.0770 => 0.0875, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 13.56% (0.1268 => 0.1440, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.45% (0.5569 => 0.6318, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: 13.20% (0.3092 => 0.3500, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.16% (0.3441 => 0.3894, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.13% (0.0838 => 0.0948, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.99% (0.3826 => 0.4323, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: 12.61% (0.3180 => 0.3581, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 12.18% (2.2969 => 2.5766, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.10% (0.1892 => 0.2121, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 12.07% (0.0953 => 0.1068, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 11.80% (0.4289 => 0.4795, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.68% (0.8101 => 0.9047, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.67% (14.3668 => 16.0434, std.dev.: 0.0179) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.60% (2.2022 => 2.4576, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.54% (4.9449 => 5.5155, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.52% (5.0018 => 5.5779, std.dev.: 0.0155) SingleSource/Benchmarks/Misc-C++/bigfib: 11.48% (0.6456 => 0.7197, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 11.40% (0.1044 => 0.1163, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 11.30% (0.4620 => 0.5142, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 11.20% (17.1811 => 19.1047, std.dev.: 0.0218) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.03% (0.3427 => 0.3805, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.01% (0.3543 => 0.3933, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.77% (0.3927 => 0.4350, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.55% (0.3497 => 0.3866, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-4: 10.53% (0.3543 => 0.3916, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.50% (0.3828 => 0.4230, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/trivial-interface: 10.48% (0.3473 => 0.3837, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.48% (0.3694 => 0.4081, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.42% (0.3561 => 0.3932, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.32% (0.3516 => 0.3879, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.31% (0.4636 => 0.5114, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 10.20% (0.3422 => 0.3771, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.19% (0.3886 => 0.4282, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.04% (0.3865 => 0.4253, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: 10.01% (1.5603 => 1.7165, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.90% (0.4203 => 0.4619, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.66% (0.2266 => 0.2485, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 9.66% (0.3684 => 0.4040, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 9.58% (0.4048 => 0.4436, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.53% (3.8922 => 4.2632, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.51% (0.2430 => 0.2661, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.48% (0.4103 => 0.4492, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.78% (0.7326 => 0.7969, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 8.74% (0.3603 => 0.3918, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.61% (0.4064 => 0.4414, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 8.35% (0.3282 => 0.3556, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.25% (0.3650 => 0.3951, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.24% (0.5925 => 0.6413, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.14% (0.6030 => 0.6521, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 7.84% (0.3098 => 0.3341, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.70% (0.2793 => 0.3008, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 7.68% (0.3283 => 0.3535, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.63% (0.2831 => 0.3047, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 7.55% (0.3232 => 0.3476, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.37% (0.3162 => 0.3395, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.28% (0.8067 => 0.8654, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.23% (0.2891 => 0.3100, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.10% (0.2872 => 0.3076, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.09% (0.2905 => 0.3111, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 7.09% (1.2842 => 1.3752, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.04% (2.0665 => 2.2119, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: 7.00% (0.2871 => 0.3072, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.92% (0.2877 => 0.3076, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.89% (0.2756 => 0.2946, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.82% (0.3052 => 0.3260, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 6.79% (0.2725 => 0.2910, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.64% (0.2802 => 0.2988, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.63% (0.2714 => 0.2894, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.45% (0.3379 => 0.3597, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: 6.15% (0.2049 => 0.2175, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.55% (7.9617 => 8.4037, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.55% (0.3136 => 0.3310, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 5.30% (0.3131 => 0.3297, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.94% (0.3935 => 0.4090, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.64% (7.0540 => 7.3105, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.88% (0.3817 => 0.3927, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.12% (1.1145 => 1.3722, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 11.07% (0.9957 => 1.1059, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/richards_benchmark: 10.04% (1.1396 => 1.2540, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.94% (2.8904 => 3.0910, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3681, std.dev.: 0.0024) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: 4.50% (3.3453 => 3.4960, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 2.94% (1.9405 => 1.9976, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.44% (4.2280 => 4.3313, std.dev.: 0.0100) MultiSource/Applications/viterbi/viterbi: 2.42% (4.4649 => 4.5730, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/bisort/bisort: 1.73% (0.8333 => 0.8477, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2078, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.42% (9.1159 => 9.2454, std.dev.: 0.0048) MultiSource/Benchmarks/nbench/nbench: 1.30% (11.6436 => 11.7955, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -76.65% (0.8651 => 0.2020, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.04% (5.3855 => 2.4211, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -54.74% (5.3526 => 2.4224, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/richards_benchmark: -44.88% (0.1622 => 0.0894, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.08% (1.1194 => 0.6819, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.67% (5.2763 => 3.2359, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -23.04% (1.7609 => 1.3552, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -16.69% (2.9384 => 2.4481, std.dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -8.85% (54.1659 => 49.3712, std.dev.: 0.0167) MultiSource/Applications/JM/ldecod/ldecod: -7.65% (10.4361 => 9.6374, std.dev.: 0.0046) MultiSource/Benchmarks/PAQ8p/paq8p: -2.80% (10.3673 => 10.0768, std.dev.: 0.0160) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -54.04% (8.0499 => 3.7000, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0134) SingleSource/Benchmarks/Misc/mandel: -33.40% (1.1492 => 0.7654, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.61% (0.0506 => 0.0341) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.38% (0.3987 => 0.2696, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.51% (2.9695 => 2.3605, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.99% (1.2258 => 0.9930) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4248, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -10.98% (9.5636 => 8.5133, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -10.90% (1.2373 => 1.1024, std.dev.: 0.0264) SingleSource/Benchmarks/Misc/mandel-2: -10.63% (1.5373 => 1.3739, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.30% (19.9488 => 18.2924, std.dev.: 0.0103) MultiSource/Benchmarks/FreeBench/mason/mason: -8.01% (0.2161 => 0.1988, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.02% (1.8329 => 1.7042, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4781, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -5.45% (6.6465 => 6.2844, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.13% (1.6805 => 1.5943, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.89% (0.2497 => 0.2375, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.57% (1.5835 => 1.5111, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.97% (8.1563 => 7.8322, std.dev.: 0.0077) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.57% (3.2827 => 3.1656, std.dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.51% (32.5116 => 31.3705, std.dev.: 0.0121) MultiSource/Benchmarks/sim/sim: -3.33% (5.0483 => 4.8802, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -2.90% (4.6441 => 4.5095, std.dev.: 0.0057) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.82% (4.5009 => 4.3740, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.64% (0.4808 => 0.4681, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/multiplies: -1.97% (2.5528 => 2.5025, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0860, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6823, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (85.0658 => 83.9815, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.22% (1.7254 => 1.7044, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/hash: -1.08% (4.9088 => 4.8557, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0554 => 1.0445, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: -1.01% (1.1277 => 1.1163, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.52% (7.1582 => 7.8395, std.dev.: 0.0083) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: 10625.97% (0.0720 => 7.7227, std.dev.: 0.0160) MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 29 09:33:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 11:33:23 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121029163323.EDF782A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5370?compare_to=5366&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5370, Order: 166926, Start Time: 2012-10-29 15:08:13, End Time: 2012-10-29 16:33:23 To: 5366, Order: 166924, Start Time: 2012-10-29 13:26:53, End Time: 2012-10-29 14:51:12 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (1 on baseline) Performance Regressions: 11 (76 on baseline) Performance Improvements: 4 (4 on baseline) Existing Failures: 67 (67 on baseline) Unchanged Tests: 960 (894 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.73% (0.2233 => 0.2361, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.24% (0.8357 => 0.8795, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.79% (0.8056 => 0.8200, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MallocBench/gs/gs: 13.60% (0.0750 => 0.0852, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.87% (3.6280 => 3.9862, std.dev.: 0.0313) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.06% (14.8644 => 16.2107, std.dev.: 0.3923) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.94% (40.9318 => 42.1340, std.dev.: 0.2309) SingleSource/Benchmarks/Shootout-C++/methcall: 1.92% (8.8595 => 9.0292, std.dev.: 0.0213) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 1.41% (3.3649 => 3.4125, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: 1.08% (1.3051 => 1.3192, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.04% (4.8641 => 4.9146, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -5.21% (0.9250 => 0.8768, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.34% (1.2325 => 1.2037, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.16% (4.6295 => 4.5760, std.dev.: 0.0195) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -8.08% (2.6273 => 2.4151, std.dev.: 0.0776) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 0.07% (16.6059 => 16.6174, std.dev.: 0.4296) MultiSource/Applications/obsequi/Obsequi: 1.34% (1.0632 => 1.0775, std.dev.: 0.0125) MultiSource/Applications/sqlite3/sqlite3: -0.62% (0.6493 => 0.6453, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/08-main/main: 7.56% (0.1838 => 0.1977, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.65% (0.1689 => 0.1700, std.dev.: 0.0059) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.10% (0.3288 => 0.3219, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.85% (0.2459 => 0.2480, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.01% (0.3355 => 0.3389, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -0.79% (0.2413 => 0.2394, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/bigfib: -0.17% (0.6022 => 0.6012, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel: 0.44% (0.0450 => 0.0452, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: -1.05% (0.3333 => 0.3298, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/strcat: -0.60% (0.1995 => 0.1983, std.dev.: 0.0028) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -3.49% (0.0258 => 0.0249, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 3.23% (0.0217 => 0.0224, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.24% (0.0425 => 0.0424, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 13.40% (0.0291 => 0.0330, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.97% (0.0309 => 0.0312, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.24% (0.0422 => 0.0421, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 19.41% (0.0170 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -0.91% (0.0219 => 0.0217, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -4.07% (0.0344 => 0.0330, std.dev.: 0.0056) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 550.00% (0.0002 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.21% (0.1454 => 0.1457, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -5.33% (1.1728 => 1.1103, std.dev.: 0.0420) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 5.71% (0.1435 => 0.1517, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.12% (0.4067 => 0.4072, std.dev.: 0.0296) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.68% (0.1288 => 0.1374, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.74% (0.0633 => 0.0584, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.23% (0.0269 => 0.0275, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.04% (0.0587 => 0.0599, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.51% (1.1495 => 1.1436, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 35.00% (0.0020 => 0.0027, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.61% (0.0586 => 0.0559, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.58% (0.0242 => 0.0168, std.dev.: 0.0046) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.14% (0.8009 => 0.8020, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: -66.67% (0.0003 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 16.95% (0.0059 => 0.0069, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Execution Time --------------------------- SingleSource/Regression/C/uint64_to_float SingleSource/Regression/C/uint64_to_float: -23.70% (2.1832 => 1.6658, std.dev.: 0.0031) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 36.16% (14.7684 => 20.1080, std.dev.: 0.2321) SingleSource/UnitTests/SignlessTypes/rem: 14.40% (0.1035 => 0.1184, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.22% (0.0830 => 0.0948, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/tsp/tsp: 12.86% (0.1112 => 0.1255, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.91% (0.0848 => 0.0949, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.60% (0.2180 => 0.2411, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.33% (0.1157 => 0.1265, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.15% (0.1137 => 0.1241, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.12% (0.6010 => 0.6558, std.dev.: 0.0203) MultiSource/Applications/viterbi/viterbi: 8.37% (0.1577 => 0.1709, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.94% (0.8148 => 0.8795, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.59% (0.2279 => 0.2452, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 7.34% (1.2568 => 1.3491, std.dev.: 0.0197) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.71% (0.6287 => 0.6709, std.dev.: 0.0117) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.88% (0.1905 => 0.2017, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.68% (0.2519 => 0.2662, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.64% (13.1811 => 13.9246, std.dev.: 0.0801) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.57% (1.1170 => 1.1792, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.40% (0.2240 => 0.2361, std.dev.: 0.0023) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.40% (6.6074 => 6.9639, std.dev.: 0.0510) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.37% (0.8321 => 0.8768, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.34% (0.2998 => 0.3158, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.29% (0.2741 => 0.2886, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.11% (0.7473 => 0.7855, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.11% (0.4559 => 0.4792, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.83% (0.6227 => 0.6528, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.72% (1.6386 => 1.7160, std.dev.: 0.0212) MultiSource/Benchmarks/nbench/nbench: 4.52% (1.1271 => 1.1781, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.52% (0.3295 => 0.3444, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.29% (0.5961 => 0.6217, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.92% (8.6476 => 8.9862, std.dev.: 0.0507) MultiSource/Applications/SPASS/SPASS: 3.68% (14.2605 => 14.7854, std.dev.: 0.1560) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.51% (1.3279 => 1.3745, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 3.38% (0.7932 => 0.8200, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.37% (0.5191 => 0.5366, std.dev.: 0.0029) MultiSource/Applications/lua/lua: 3.33% (3.8189 => 3.9462, std.dev.: 0.0367) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.14% (4.1763 => 4.3074, std.dev.: 0.0271) MultiSource/Applications/lemon/lemon: 3.10% (1.0945 => 1.1284, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.01% (1.1685 => 1.2037, std.dev.: 0.0092) MultiSource/Benchmarks/mafft/pairlocalalign: 2.96% (8.6247 => 8.8797, std.dev.: 0.0205) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.92% (0.8697 => 0.8951, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.83% (0.9056 => 0.9312, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.80% (0.8050 => 0.8275, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.76% (0.9069 => 0.9319, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.75% (0.8805 => 0.9047, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.72% (0.6586 => 0.6765, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.53% (1.2526 => 1.2843, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.52% (1.2602 => 1.2919, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.48% (0.9908 => 1.0154, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.43% (0.8069 => 0.8265, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.38% (0.8597 => 0.8802, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.34% (0.8340 => 0.8535, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.32% (0.8331 => 0.8524, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.30% (0.8317 => 0.8508, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.25% (0.8712 => 0.8908, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.23% (0.7966 => 0.8144, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.20% (0.8656 => 0.8846, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.16% (4.5702 => 4.6691, std.dev.: 0.0334) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.13% (0.8885 => 0.9074, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.10% (4.4880 => 4.5821, std.dev.: 0.0210) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.08% (0.8927 => 0.9113, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.03% (0.8518 => 0.8691, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.98% (4.4873 => 4.5760, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.96% (0.8420 => 0.8585, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.66% (1.4479 => 1.4719, std.dev.: 0.0053) MultiSource/Benchmarks/Bullet/bullet: 1.59% (31.8598 => 32.3675, std.dev.: 0.1890) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 56.84% (1.5795 => 2.4773, std.dev.: 0.0209) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.69% (14.6451 => 16.2107, std.dev.: 0.3923) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.72% (1.1857 => 1.2772, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.28% (0.3186 => 0.3386, std.dev.: 0.0066) MultiSource/Benchmarks/mafft/pairlocalalign: 5.93% (63.1822 => 66.9320, std.dev.: 0.0835) SingleSource/Benchmarks/Misc/ReedSolomon: 3.22% (8.5322 => 8.8073, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.71% (41.4238 => 42.1340, std.dev.: 0.2309) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.62% (4.8362 => 4.9146, std.dev.: 0.0033) MultiSource/Benchmarks/llubenchmark/llu: 1.56% (1.9967 => 2.0278, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/richards_benchmark: 1.19% (1.3037 => 1.3192, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.72% (0.3269 => 0.2984, std.dev.: 0.0031) MultiSource/Applications/lua/lua: -5.27% (29.8330 => 28.2621, std.dev.: 0.1829) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.76% (1.0388 => 1.0205, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/hash2: -1.52% (3.4237 => 3.3715, std.dev.: 0.0043) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 1.04% (16.4461 => 16.6174, std.dev.: 0.4296) MultiSource/Applications/obsequi/Obsequi: 5.00% (1.0262 => 1.0775, std.dev.: 0.0125) MultiSource/Applications/sqlite3/sqlite3: 1.91% (0.6332 => 0.6453, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/08-main/main: 7.97% (0.1831 => 0.1977, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 9.04% (0.1559 => 0.1700, std.dev.: 0.0059) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.07% (0.3123 => 0.3219, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.69% (0.2463 => 0.2480, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.35% (0.3344 => 0.3389, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 1.27% (0.2364 => 0.2394, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/bigfib: 0.03% (0.6010 => 0.6012, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel: 5.36% (0.0429 => 0.0452, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.98% (0.3266 => 0.3298, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/strcat: 0.71% (0.1969 => 0.1983, std.dev.: 0.0028) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 11.16% (0.0224 => 0.0249, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 82.11% (0.0123 => 0.0224, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.92% (0.0408 => 0.0424, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.64% (0.0384 => 0.0421, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: 43.48% (0.0230 => 0.0330, std.dev.: 0.0056) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/byval-alignment MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.32% (0.1438 => 0.1457, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.99% (1.1329 => 1.1103, std.dev.: 0.0420) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.76% (0.1462 => 0.1517, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.21% (0.4164 => 0.4072, std.dev.: 0.0296) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.37% (0.1369 => 0.1374, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.89% (0.0641 => 0.0584, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.03% (0.0195 => 0.0275, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.63% (0.0578 => 0.0599, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.01% (1.1437 => 1.1436, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.85% (0.0627 => 0.0559, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.67% (0.0180 => 0.0168, std.dev.: 0.0046) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.04% (0.8017 => 0.8020, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 11.29% (0.0062 => 0.0069, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000) Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 29 09:59:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 11:59:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121029165903.54BC12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5371?compare_to=5368&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5371, Order: 166929, Start Time: 2012-10-29 15:33:46, End Time: 2012-10-29 16:59:01 To: 5368, Order: 166924, Start Time: 2012-10-29 13:45:02, End Time: 2012-10-29 15:10:43 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (173 on baseline) Unchanged Tests: 1042 (864 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.63% (15.2527 => 18.3990, std.dev.: 0.0155) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1009, std.dev.: 0.0155) SingleSource/Benchmarks/Misc/salsa20: 2.49% (7.4937 => 7.6806, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/hash2: 2.20% (3.1932 => 3.2636, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.87% (0.1431 => 0.1304) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.21% (0.1584 => 0.1454, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.96% (0.3821 => 0.3555, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -6.65% (0.3880 => 0.3622, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -6.60% (0.3848 => 0.3594, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -6.60% (0.3896 => 0.3639, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.59% (0.3142 => 0.2935, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -6.58% (0.3812 => 0.3561, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -6.58% (0.3831 => 0.3579, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.51% (0.3884 => 0.3631, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.45% (0.3891 => 0.3640, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.45% (0.4033 => 0.3773, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.43% (0.2428 => 0.2272, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: -6.37% (0.4176 => 0.3910, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.13% (22.4056 => 21.0324, std.dev.: 0.0188) SingleSource/UnitTests/ObjC/parameter-passing: -6.12% (0.4280 => 0.4018, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -6.12% (0.4199 => 0.3942, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.07% (0.2355 => 0.2212, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -5.99% (2.4924 => 2.3431, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: -5.90% (0.2659 => 0.2502, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.86% (0.9542 => 0.8983, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.82% (0.3658 => 0.3445, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -5.82% (0.3026 => 0.2850, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -5.75% (0.3025 => 0.2851) SingleSource/Benchmarks/Misc/ReedSolomon: -5.75% (0.1879 => 0.1771, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -5.72% (0.2989 => 0.2818, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -5.66% (0.3357 => 0.3167, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.66% (0.3057 => 0.2884, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -5.65% (0.2160 => 0.2038, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.61% (0.6484 => 0.6120, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.58% (0.3837 => 0.3623, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.56% (0.9852 => 0.9304, std.dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: -5.56% (1.3148 => 1.2417, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.56% (0.4083 => 0.3856, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -5.55% (0.2939 => 0.2776, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.54% (0.3016 => 0.2849, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.53% (2.1713 => 2.0513, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.49% (4.5069 => 4.2594, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/ary2: -5.49% (0.3481 => 0.3290, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.49% (5.4682 => 5.1682, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/hello: -5.48% (0.2849 => 0.2693, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.47% (0.4151 => 0.3924, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -5.47% (0.2871 => 0.2714, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: -5.45% (0.4861 => 0.4596, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -5.45% (0.3394 => 0.3209, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/objinst: -5.45% (0.3194 => 0.3020, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.44% (0.3252 => 0.3075, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.44% (0.2903 => 0.2745, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -5.43% (0.3205 => 0.3031, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -5.41% (0.3255 => 0.3079, std.dev.: 0.0045) MultiSource/Applications/Burg/burg: -5.39% (1.2515 => 1.1841, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.37% (4.8161 => 4.5573, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.34% (0.4813 => 0.4556, std.dev.: 0.0042) MultiSource/Applications/JM/ldecod/ldecod: -5.30% (7.0961 => 6.7203, std.dev.: 0.0024) SingleSource/Regression/C++/ofstream_ctor: -5.30% (0.3059 => 0.2897, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: -5.29% (4.3330 => 4.1036, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.29% (4.8802 => 4.6221, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: -5.27% (0.3621 => 0.3430, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.27% (3.5339 => 3.3475, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/bigfib: -5.26% (0.6750 => 0.6395, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: -5.23% (0.3788 => 0.3590, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.22% (0.2548 => 0.2415, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -5.22% (16.1920 => 15.3474, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.20% (1.2221 => 1.1585, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.18% (1.2784 => 1.2122, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.17% (1.2210 => 1.1579, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.14% (0.3849 => 0.3651, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.14% (1.6474 => 1.5627, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.14% (0.3931 => 0.3729, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.11% (0.4321 => 0.4100, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: -5.06% (0.4524 => 0.4295, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.06% (4.0323 => 3.8283, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.06% (0.3323 => 0.3155, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.06% (1.0544 => 1.0011, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: -5.05% (0.7779 => 0.7386, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.01% (0.4427 => 0.4205, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -5.01% (34.0927 => 32.3848, std.dev.: 0.0216) MultiSource/Applications/siod/siod: -5.01% (2.4021 => 2.2818, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: -4.99% (0.2985 => 0.2836, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.97% (0.7198 => 0.6840, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: -4.97% (0.3867 => 0.3675, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.92% (0.7919 => 0.7529, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.91% (0.8521 => 0.8103, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.90% (0.5999 => 0.5705, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: -4.87% (0.4248 => 0.4041, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.80% (0.2999 => 0.2855, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.74% (0.2933 => 0.2794, std.dev.: 0.0000) MultiSource/Applications/lua/lua: -4.68% (4.0594 => 3.8695, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: -4.66% (18.2933 => 17.4412, std.dev.: 0.0244) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.64% (0.6293 => 0.6001, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -4.64% (9.2283 => 8.8004, std.dev.: 0.0128) SingleSource/UnitTests/ObjC++/Hello: -4.62% (0.6347 => 0.6054, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -4.61% (1.6364 => 1.5610, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: -4.58% (0.6441 => 0.6146, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.57% (2.2587 => 2.1554, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.56% (1.3722 => 1.3096, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.55% (0.3491 => 0.3332, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.49% (0.9557 => 0.9128, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.46% (0.3319 => 0.3171, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.43% (0.4916 => 0.4698, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: -4.41% (0.4515 => 0.4316, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.31% (0.5478 => 0.5242, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.29% (0.5591 => 0.5351, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.29% (0.6230 => 0.5963, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: -4.27% (0.3581 => 0.3428, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.27% (0.6681 => 0.6396, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.24% (0.5805 => 0.5559, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -4.22% (0.7982 => 0.7645, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.19% (1.4642 => 1.4028, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.19% (0.6297 => 0.6033, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.16% (0.5863 => 0.5619, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.15% (0.6667 => 0.6390, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.15% (0.6676 => 0.6399, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.14% (0.5802 => 0.5562, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.12% (0.5705 => 0.5470, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.11% (0.6660 => 0.6386, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.07% (0.7339 => 0.7040, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.07% (0.5456 => 0.5234, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.07% (0.5581 => 0.5354, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.05% (0.5575 => 0.5349, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.05% (0.6395 => 0.6136, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.03% (0.5925 => 0.5686, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.03% (0.5857 => 0.5621, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.03% (0.6304 => 0.6050, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.03% (0.5859 => 0.5623, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.02% (0.5570 => 0.5346, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.00% (0.6194 => 0.5946, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -3.99% (0.6189 => 0.5942, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.98% (0.6440 => 0.6184, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -3.97% (0.5569 => 0.5348, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -3.95% (0.6260 => 0.6013, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -3.92% (0.5849 => 0.5620, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -3.90% (0.6052 => 0.5816, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.88% (0.6446 => 0.6196, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -3.88% (0.6395 => 0.6147, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: -3.87% (0.8418 => 0.8092, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.85% (0.5941 => 0.5712, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: -3.85% (0.7447 => 0.7160, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: -3.82% (0.3271 => 0.3146, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: -3.82% (0.3406 => 0.3276, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -3.81% (0.5567 => 0.5355, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.80% (0.6033 => 0.5804, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -3.77% (1.1450 => 1.1018, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -3.74% (0.5688 => 0.5475, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: -3.74% (0.9179 => 0.8836, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.72% (0.7021 => 0.6760, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.71% (0.7524 => 0.7245, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.70% (0.9077 => 0.8741, std.dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.68% (6.7716 => 6.5222, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: -3.66% (15.5079 => 14.9407, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -3.63% (8.0126 => 7.7216, std.dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.52% (0.5168 => 0.4986, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.50% (5.0226 => 4.8467, std.dev.: 0.0068) MultiSource/Applications/treecc/treecc: -3.48% (2.1401 => 2.0657, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: -3.31% (17.1032 => 16.5372, std.dev.: 0.0079) MultiSource/Applications/d/make_dparser: -3.29% (3.5154 => 3.3998, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.28% (0.5329 => 0.5154, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.25% (0.6736 => 0.6517, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.24% (0.3483 => 0.3370, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: -3.11% (1.5610 => 1.5125, std.dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: -3.10% (1.1530 => 1.1172, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.08% (1.2300 => 1.1921, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -3.06% (20.7746 => 20.1399, std.dev.: 0.0318) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.63% (14.2083 => 13.8348, std.dev.: 0.0055) MultiSource/Applications/SIBsim4/SIBsim4: -1.52% (1.3864 => 1.3653, std.dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7579, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: -8.64% (1.2842 => 1.1732, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.87% (1.7753 => 1.7066, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.75% (2.2633 => 2.1785, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4671, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0003) Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 29 10:56:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 12:56:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121029175639.8881D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5372?compare_to=5369&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5372, Order: 166929, Start Time: 2012-10-29 16:25:23, End Time: 2012-10-29 17:56:39 To: 5369, Order: 166924, Start Time: 2012-10-29 14:24:23, End Time: 2012-10-29 15:55:44 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (10 on baseline) New Passes: 0 (14 on baseline) Performance Regressions: 0 (191 on baseline) Performance Improvements: 0 (54 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 15 (5 on baseline) Unchanged Tests: 1027 (634 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Compile Time -------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: 0.15% (2.0443 => 2.0473, std.dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: 0.28% (58.0959 => 58.2563, std.dev.: 0.0178) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.25% (0.0801 => 0.0803, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 0.09% (9.2624 => 9.2710, std.dev.: 0.0069) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.10% (7.8395 => 7.8470, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_shift: 0.19% (0.0518 => 0.0519) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/JM/lencod/lencod: -0.01% (7.7227 => 7.7220, std.dev.: 0.0147) MultiSource/Applications/oggenc/oggenc: - (0.0001 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0648 => 0.0648, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.03% (0.2990 => 0.2989, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_shift: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -64.45% (5.7591 => 2.0473, std.dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: -7.89% (63.2438 => 58.2563, std.dev.: 0.0178) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.80% (6.6874 => 0.0803, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.95% (8.1363 => 9.2710, std.dev.: 0.0069) SingleSource/UnitTests/Vector/SSE/sse_shift: 37.30% (0.0378 => 0.0519) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -50.00% (0.0002 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -57.07% (0.6962 => 0.2989, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_shift: -50.00% (0.0002 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 213.41% (0.5229 => 1.6388, std.dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 18.29% (14.9895 => 17.7310, std.dev.: 0.0275) MultiSource/Applications/kimwitu++/kc: 38.35% (14.1553 => 19.5832, std.dev.: 0.0092) MultiSource/Benchmarks/MallocBench/gs/gs: 14.22% (4.1105 => 4.6951, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 33.56% (1.1048 => 1.4756, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: 69.72% (3.4629 => 5.8772, std.dev.: 0.0151) SingleSource/Benchmarks/Misc-C++/stepanov_container: 69.45% (0.6222 => 1.0543, std.dev.: 0.0016) New Passes - Execution Time --------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 3837100.00% (0.0001 => 3.8372, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 11182200.00% (0.0001 => 11.1823, std.dev.: 0.0283) MultiSource/Applications/kimwitu++/kc: 50100.00% (0.0001 => 0.0502, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050400.00% (0.0001 => 10.0505, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5488000.00% (0.0001 => 5.4881, std.dev.: 0.0086) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 78.38% (0.0296 => 0.0528, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 69.92% (0.0256 => 0.0435, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 61.62% (0.0271 => 0.0438, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 53.09% (0.0243 => 0.0372, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 44.53% (1.5859 => 2.2921, std.dev.: 0.0102) SingleSource/Regression/C/sumarray: 44.16% (0.0231 => 0.0333) MultiSource/Benchmarks/FreeBench/distray/distray: 41.67% (0.1056 => 0.1496, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.61% (0.0834 => 0.1181, std.dev.: 0.0012) SingleSource/UnitTests/vla: 36.62% (0.0355 => 0.0485, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 35.68% (2.2024 => 2.9882, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: 34.31% (0.1463 => 0.1965, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 30.59% (0.1432 => 0.1870, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 29.31% (0.1655 => 0.2140, std.dev.: 0.0011) MultiSource/Benchmarks/llubenchmark/llu: 24.46% (0.0462 => 0.0575) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.29% (0.1566 => 0.1915, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 22.20% (0.1144 => 0.1398, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.82% (0.5105 => 0.6219, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 21.61% (0.1555 => 0.1891, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.13% (0.0871 => 0.1055, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 20.04% (0.6675 => 0.8013, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 19.84% (0.0746 => 0.0894, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 19.49% (1.3050 => 1.5593, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 19.46% (0.5020 => 0.5997, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.42% (0.2271 => 0.2712, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 19.41% (3.3354 => 3.9827, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/almabench: 18.90% (0.0730 => 0.0868, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 18.86% (0.7115 => 0.8457, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 18.79% (0.2554 => 0.3034, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 18.69% (0.1584 => 0.1880, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 18.64% (0.1175 => 0.1394, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 18.45% (0.1236 => 0.1464, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 18.21% (0.0626 => 0.0740, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.15% (1.5415 => 1.8213, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.15% (0.1510 => 0.1784, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 18.11% (0.1695 => 0.2002, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 18.10% (0.4879 => 0.5762, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 18.04% (1.1840 => 1.3976, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 18.03% (0.1337 => 0.1578, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 18.02% (0.1032 => 0.1218, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.83% (0.4615 => 0.5438, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.78% (0.0793 => 0.0934, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 17.69% (0.3177 => 0.3739, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/mst/mst: 17.63% (0.1163 => 0.1368, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.52% (0.8172 => 0.9604, std.dev.: 0.0030) MultiSource/Applications/sgefa/sgefa: 17.24% (0.3109 => 0.3645, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 17.10% (0.2603 => 0.3048, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.05% (0.6450 => 0.7550, std.dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/ft/ft: 16.96% (0.1940 => 0.2269, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 16.85% (0.1151 => 0.1345, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 16.76% (0.7835 => 0.9148, std.dev.: 0.0034) MultiSource/Applications/ClamAV/clamscan: 16.75% (22.1758 => 25.8899, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.74% (0.0675 => 0.0788, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.70% (0.0886 => 0.1034, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 16.68% (0.1906 => 0.2224, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.60% (0.3121 => 0.3639, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/exptree: 16.34% (0.0814 => 0.0947, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 16.18% (1.0722 => 1.2457, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 16.15% (0.0842 => 0.0978, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 16.01% (0.9765 => 1.1328, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 16.00% (2.0273 => 2.3517, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/whetstone: 15.91% (0.0660 => 0.0765, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 15.87% (0.1695 => 0.1964, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 15.80% (1.1642 => 1.3482, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/football/football: 15.75% (0.8921 => 1.0326, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/voronoi/voronoi: 15.74% (0.2700 => 0.3125, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 15.73% (0.1125 => 0.1302, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.67% (0.1117 => 0.1292, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 15.63% (0.0672 => 0.0777, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.61% (0.2107 => 0.2436, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.59% (0.2758 => 0.3188, std.dev.: 0.0006) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.57% (0.1143 => 0.1321, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 15.43% (0.0648 => 0.0748, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.36% (1.1861 => 1.3683, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 15.29% (1.4186 => 1.6355, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 15.13% (0.3423 => 0.3941, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 15.10% (0.4299 => 0.4948, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.06% (0.0770 => 0.0886, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 15.05% (0.5860 => 0.6742, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 15.02% (4.2646 => 4.9053, std.dev.: 0.0066) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.02% (0.0759 => 0.0873, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 15.01% (0.5981 => 0.6879, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.01% (0.0933 => 0.1073, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.96% (0.1330 => 0.1529, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 14.96% (0.0929 => 0.1068, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.89% (0.1625 => 0.1867, std.dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 14.88% (0.7433 => 0.8539, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.78% (0.1062 => 0.1219, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.72% (0.2065 => 0.2369, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 14.66% (3.8723 => 4.4400, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.58% (0.1029 => 0.1179, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.41% (0.0798 => 0.0913, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.39% (0.3307 => 0.3783, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 14.35% (0.3387 => 0.3873, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.25% (0.0730 => 0.0834, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 14.02% (9.4845 => 10.8144, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.90% (0.0770 => 0.0877, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.80% (0.3826 => 0.4354, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.66% (0.5569 => 0.6330, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/health/health: 13.64% (0.1268 => 0.1441, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.48% (0.0838 => 0.0951, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.40% (0.3441 => 0.3902, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 13.23% (0.3092 => 0.3501, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 12.70% (0.3180 => 0.3584, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.32% (0.1892 => 0.2125, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 12.28% (0.0953 => 0.1070, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 12.17% (2.2969 => 2.5765, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash: 12.12% (0.4289 => 0.4809, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.92% (14.3668 => 16.0796, std.dev.: 0.0172) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.90% (2.2022 => 2.4643, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.90% (0.8101 => 0.9065, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 11.76% (0.6456 => 0.7215, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 11.73% (4.9449 => 5.5247, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.72% (5.0018 => 5.5879, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: 11.65% (0.4620 => 0.5158, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.54% (0.3543 => 0.3952, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.35% (0.3427 => 0.3816, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 11.32% (17.1811 => 19.1257, std.dev.: 0.0270) SingleSource/UnitTests/ObjC/parameter-passing: 11.31% (0.3927 => 0.4371, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 11.30% (0.1044 => 0.1162, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 11.11% (0.3473 => 0.3859, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.09% (0.3561 => 0.3956, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.07% (0.3694 => 0.4103, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.04% (0.4636 => 0.5148, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 11.02% (0.3828 => 0.4250, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 11.01% (0.3543 => 0.3933, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.92% (0.3497 => 0.3879, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.92% (0.3516 => 0.3900, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.78% (0.3886 => 0.4305, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 10.72% (0.3422 => 0.3789, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.50% (0.3865 => 0.4271, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.40% (0.4203 => 0.4640, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 10.30% (1.5603 => 1.7210, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/moments: 10.10% (0.4048 => 0.4457, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 10.07% (0.3684 => 0.4055, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.97% (0.2266 => 0.2492) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.75% (0.2430 => 0.2667, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.75% (0.4103 => 0.4503, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.62% (3.8922 => 4.2667, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/sieve: 9.27% (0.3603 => 0.3937, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.02% (0.7326 => 0.7987, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.96% (0.4064 => 0.4428, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.73% (0.5925 => 0.6442, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.71% (0.6030 => 0.6555, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 8.62% (0.3282 => 0.3565, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/matrix: 8.52% (0.3098 => 0.3362, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.41% (0.3650 => 0.3957, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.34% (0.2793 => 0.3026, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 8.19% (0.2831 => 0.3063, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 8.16% (0.3283 => 0.3551, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.96% (0.2891 => 0.3121, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.96% (2.0665 => 2.2309, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 7.95% (0.3232 => 0.3489, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 7.81% (0.2905 => 0.3132, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.81% (0.3162 => 0.3409, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 7.67% (0.3052 => 0.3286, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.66% (0.2871 => 0.3091, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.63% (0.2872 => 0.3091, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 7.61% (0.2877 => 0.3096, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.49% (0.8067 => 0.8671, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.47% (0.2756 => 0.2962) SingleSource/Benchmarks/Shootout-C++/fibo: 7.41% (0.2725 => 0.2927, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 7.28% (1.2842 => 1.3777, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 7.22% (0.2714 => 0.2910, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 7.14% (0.2802 => 0.3002, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.98% (0.3379 => 0.3615, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 6.39% (0.2049 => 0.2180, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.25% (0.3136 => 0.3332, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.98% (7.9617 => 8.4375, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: 5.84% (0.3131 => 0.3314, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.40% (0.3935 => 0.4108, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.21% (7.0540 => 7.3507, std.dev.: 0.0187) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.33% (0.3817 => 0.3944, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.12% (1.1145 => 1.3722, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 10.21% (0.9957 => 1.0974, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/richards_benchmark: 9.79% (1.1396 => 1.2512, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 6.94% (2.8904 => 3.0909, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.63% (3.1578 => 3.3673, std.dev.: 0.0006) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: 4.50% (3.3453 => 3.4960, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.4162 => 0.4322, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 2.95% (1.9405 => 1.9977, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.45% (4.2280 => 4.3317, std.dev.: 0.0098) MultiSource/Applications/viterbi/viterbi: 2.41% (4.4649 => 4.5723, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/bisort/bisort: 1.79% (0.8333 => 0.8482, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2077, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.30% (11.6436 => 11.7955, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -76.90% (0.8651 => 0.1998) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -54.61% (5.3855 => 2.4447, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -54.42% (5.3526 => 2.4398, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: -44.70% (0.1622 => 0.0897, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -38.97% (1.1194 => 0.6832, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.71% (5.2763 => 3.2339, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -22.71% (1.7609 => 1.3610, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -16.83% (2.9384 => 2.4438, std.dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -9.02% (54.1659 => 49.2819, std.dev.: 0.0174) MultiSource/Applications/JM/ldecod/ldecod: -7.36% (10.4361 => 9.6675, std.dev.: 0.0132) MultiSource/Benchmarks/PAQ8p/paq8p: -3.62% (10.3673 => 9.9923, std.dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Misc/lowercase: -54.04% (8.0499 => 3.7001, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0133, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.47% (1.1492 => 0.7646, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.61% (0.0506 => 0.0341) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -32.38% (0.3987 => 0.2696, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.50% (2.9695 => 2.3608, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.99% (1.2258 => 0.9930, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: -15.95% (1.6925 => 1.4225, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.63% (0.0998 => 0.0852, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -10.97% (9.5636 => 8.5140, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel-2: -10.90% (1.5373 => 1.3698, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: -10.83% (1.2373 => 1.1033, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.21% (19.9488 => 18.3108, std.dev.: 0.0200) MultiSource/Benchmarks/FreeBench/mason/mason: -7.82% (0.2161 => 0.1992, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.06% (1.8329 => 1.7035, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -5.45% (6.6465 => 6.2842, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -5.10% (1.5835 => 1.5027, std.dev.: 0.0033) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.08% (1.6805 => 1.5951, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.89% (0.2497 => 0.2375, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.84% (8.1563 => 7.8432, std.dev.: 0.0019) MultiSource/Applications/siod/siod: -3.75% (3.2827 => 3.1597, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.73% (0.9540 => 0.9184) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.52% (32.5116 => 31.3658, std.dev.: 0.0083) MultiSource/Benchmarks/sim/sim: -3.33% (5.0483 => 4.8803, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -2.90% (4.6441 => 4.5092, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.82% (4.5009 => 4.3739, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.54% (0.4808 => 0.4686, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/UnitTests/Vector/multiplies: -1.92% (2.5528 => 2.5038, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -1.85% (10.2830 => 10.0931, std.dev.: 0.0178) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6834, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -1.28% (85.0658 => 83.9774, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.17% (1.7254 => 1.7052, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: -1.01% (1.1277 => 1.1163, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8596, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.62% (7.1582 => 7.8470, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: 10625.00% (0.0720 => 7.7220, std.dev.: 0.0147) MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 1.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 29 11:48:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 13:48:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121029184811.CFFA12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5373?compare_to=5371&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5373, Order: 166937, Start Time: 2012-10-29 17:22:01, End Time: 2012-10-29 18:48:09 To: 5371, Order: 166929, Start Time: 2012-10-29 15:33:46, End Time: 2012-10-29 16:59:01 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (5 on baseline) Performance Improvements: 0 (171 on baseline) Unchanged Tests: 1040 (866 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.76% (78.2513 => 80.4072, std.dev.: 0.2189) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.79% (1.2753 => 1.2981, std.dev.: 0.0030) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.56% (15.2527 => 18.3894, std.dev.: 0.0094) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.56% (2.0478 => 2.1002, std.dev.: 0.0119) SingleSource/Benchmarks/Misc/salsa20: 2.52% (7.4937 => 7.6829, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: 2.16% (3.1932 => 3.2622, std.dev.: 0.0082) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.87% (0.1431 => 0.1304, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.89% (0.1584 => 0.1459, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.04% (0.3821 => 0.3552, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: -6.90% (0.3812 => 0.3549, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.87% (0.3831 => 0.3568, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -6.81% (0.3848 => 0.3586, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.80% (0.3884 => 0.3620, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.73% (0.3891 => 0.3629, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -6.73% (0.3880 => 0.3619, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -6.61% (0.4176 => 0.3900, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -6.60% (0.3896 => 0.3639, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.60% (0.4033 => 0.3767, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.40% (0.3142 => 0.2941, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -6.33% (0.4199 => 0.3933, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -6.19% (0.4280 => 0.4015, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.10% (0.2428 => 0.2280, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: -5.95% (0.3026 => 0.2846, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.92% (22.4056 => 21.0797, std.dev.: 0.0178) MultiSource/Benchmarks/PAQ8p/paq8p: -5.91% (2.4924 => 2.3450, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/methcall: -5.88% (0.3025 => 0.2847, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.83% (0.9542 => 0.8986, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/strcat: -5.82% (0.2989 => 0.2815, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.82% (0.2355 => 0.2218, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -5.75% (0.2939 => 0.2770, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.72% (0.2903 => 0.2737, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -5.68% (0.3255 => 0.3070, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.67% (0.4813 => 0.4540, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hello: -5.65% (0.2849 => 0.2688, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -5.62% (0.3205 => 0.3025, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -5.61% (1.3148 => 1.2410, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -5.61% (0.2871 => 0.2710, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.60% (2.1713 => 2.0496, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.60% (0.3658 => 0.3453, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.58% (0.4083 => 0.3855, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -5.57% (0.3446 => 0.3254, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.57% (0.3016 => 0.2848, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.56% (0.4151 => 0.3920, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -5.56% (0.2160 => 0.2040, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.54% (0.3252 => 0.3072, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.53% (0.3057 => 0.2888, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -5.51% (0.3194 => 0.3018, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -5.49% (0.3481 => 0.3290, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -5.48% (0.1879 => 0.1776, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: -5.47% (0.4861 => 0.4595, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -5.46% (0.3059 => 0.2892, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -5.45% (0.2659 => 0.2514, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -5.45% (0.3394 => 0.3209, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.45% (0.3837 => 0.3628, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -5.44% (0.3788 => 0.3582, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.37% (4.5069 => 4.2647, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.34% (0.6484 => 0.6138, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -5.33% (0.3357 => 0.3178, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -5.33% (0.3621 => 0.3428, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.33% (0.9852 => 0.9327, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.32% (5.4682 => 5.1775, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.30% (0.3849 => 0.3645, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: -5.24% (7.0961 => 6.7240, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/lists1: -5.22% (0.3867 => 0.3665, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.18% (1.2221 => 1.1588, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.16% (1.2210 => 1.1580, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/gs/gs: -5.15% (4.3330 => 4.1100, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/bigfib: -5.14% (0.6750 => 0.6403, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: -5.12% (16.1920 => 15.3624, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/moments: -5.11% (0.4248 => 0.4031, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -5.10% (0.6347 => 0.6023, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -5.10% (34.0927 => 32.3548, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.08% (0.4427 => 0.4202, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.07% (4.8161 => 4.5717, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.07% (3.5339 => 3.3547, std.dev.: 0.0128) SingleSource/UnitTests/ObjC++/property-reference: -5.04% (0.7779 => 0.7387, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: -5.03% (0.6441 => 0.6117, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.02% (0.2548 => 0.2420, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.01% (0.3931 => 0.3734, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.00% (4.8802 => 4.6360, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.98% (0.2933 => 0.2787, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.97% (0.7198 => 0.6840, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -4.97% (1.0544 => 1.0020, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.96% (0.8521 => 0.8098, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -4.96% (1.2784 => 1.2150, std.dev.: 0.0021) MultiSource/Applications/Burg/burg: -4.93% (1.2515 => 1.1898, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.88% (0.3323 => 0.3161, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.86% (4.0323 => 3.8362, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.77% (1.6474 => 1.5688, std.dev.: 0.0110) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.74% (0.2278 => 0.2170, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -4.62% (0.2985 => 0.2847, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.61% (0.3491 => 0.3330, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.61% (0.6293 => 0.6003, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.54% (0.4321 => 0.4125, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: -4.53% (0.4524 => 0.4319, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.51% (0.7919 => 0.7562, std.dev.: 0.0052) MultiSource/Applications/siod/siod: -4.50% (2.4021 => 2.2940, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.48% (0.5999 => 0.5730, std.dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: -4.47% (9.2283 => 8.8155, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.45% (1.3722 => 1.3112, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.43% (0.2999 => 0.2866, std.dev.: 0.0012) MultiSource/Applications/lua/lua: -4.37% (4.0594 => 3.8819, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -4.34% (1.6364 => 1.5654, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.25% (0.4916 => 0.4707, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.24% (0.9557 => 0.9152, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.22% (1.4642 => 1.4024, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: -4.20% (18.2933 => 17.5250, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.14% (2.2587 => 2.1652, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/18-imp/imp: -4.10% (0.3581 => 0.3434, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.08% (0.6230 => 0.5976, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.05% (0.6297 => 0.6042, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.01% (0.5857 => 0.5622, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.01% (0.6681 => 0.6413, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: -4.01% (0.4515 => 0.4334, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -3.99% (0.5591 => 0.5368, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.98% (0.5859 => 0.5626, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -3.96% (0.5805 => 0.5575, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -3.96% (0.5478 => 0.5261, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -3.96% (0.6667 => 0.6403, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -3.95% (0.7982 => 0.7667, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -3.94% (0.5705 => 0.5480, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.93% (0.5802 => 0.5574, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -3.92% (0.6194 => 0.5951, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -3.88% (0.6052 => 0.5817, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -3.88% (0.6676 => 0.6417, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -3.88% (0.5570 => 0.5354, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.87% (0.5863 => 0.5636, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.87% (0.5581 => 0.5365, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -3.84% (0.6304 => 0.6062, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -3.83% (0.7339 => 0.7058, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.80% (0.5575 => 0.5363, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.80% (0.6395 => 0.6152, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -3.79% (0.5569 => 0.5358, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.76% (0.5456 => 0.5251, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -3.73% (0.5688 => 0.5476, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: -3.72% (0.7447 => 0.7170, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -3.71% (0.6660 => 0.6413, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -3.70% (0.6189 => 0.5960, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.70% (6.7716 => 6.5211, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.70% (0.6440 => 0.6202, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.69% (0.9077 => 0.8742, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -3.68% (0.5849 => 0.5634, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -3.67% (0.3406 => 0.3281, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: -3.65% (0.9179 => 0.8844, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.65% (0.6446 => 0.6211, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -3.64% (0.6395 => 0.6162, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.64% (0.5941 => 0.5725, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -3.61% (8.0126 => 7.7233, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -3.61% (0.5567 => 0.5366, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -3.59% (0.6260 => 0.6035, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.59% (0.7021 => 0.6769, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: -3.55% (15.5079 => 14.9573, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.55% (0.7524 => 0.7257, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: -3.52% (0.3271 => 0.3156, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.48% (0.6033 => 0.5823, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.41% (0.6736 => 0.6506, std.dev.: 0.0024) MultiSource/Applications/spiff/spiff: -3.39% (0.8418 => 0.8133, std.dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: -3.33% (5.0226 => 4.8553, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: -3.33% (17.1032 => 16.5337, std.dev.: 0.0233) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.31% (0.5168 => 0.4997, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: -3.25% (1.5610 => 1.5103, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.13% (0.3483 => 0.3374, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -3.09% (2.1401 => 2.0740, std.dev.: 0.0024) SingleSource/UnitTests/Vector/constpool: -3.06% (20.7746 => 20.1391, std.dev.: 0.0252) MultiSource/Applications/d/make_dparser: -3.05% (3.5154 => 3.4083, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.00% (1.2300 => 1.1931, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.98% (0.5329 => 0.5170, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: -2.90% (1.1530 => 1.1196, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.44% (14.2083 => 13.8623, std.dev.: 0.0031) MultiSource/Applications/SIBsim4/SIBsim4: -1.36% (1.3864 => 1.3675, std.dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.49% (7.5137 => 5.7487, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/richards_benchmark: -8.70% (1.2842 => 1.1725, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.87% (1.7753 => 1.7066, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -3.85% (2.2633 => 2.1762, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.23% (1.0557 => 1.0216, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4698, std.dev.: 0.0036) Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 29 12:03:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 14:03:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121029190311.B38D82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5374?compare_to=5367&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5374, Order: 166926, Start Time: 2012-10-29 15:47:52, End Time: 2012-10-29 19:03:10 To: 5367, Order: 166921, Start Time: 2012-10-29 11:44:12, End Time: 2012-10-29 14:59:36 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (171 on baseline) Performance Improvements: 0 (17 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1038 (720 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hexxagon/hexxagon: 1.02% (1.1376 => 1.1492, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/UnitTests/ObjC/synchronized: 13.82% (0.1049 => 0.1194, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 5.17% (0.2128 => 0.2238, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/perimeter/perimeter: 1.80% (0.6096 => 0.6206, std.dev.: 0.0003) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 43.52% (0.0625 => 0.0897, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.17% (0.1063 => 0.1405, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.23% (0.2969 => 0.3718, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.05% (0.0475 => 0.0594, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 24.59% (0.1106 => 0.1378, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.41% (0.4253 => 0.5291, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 23.75% (0.4139 => 0.5122, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 23.46% (1.5932 => 1.9669, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.37% (0.5900 => 0.7279, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 22.95% (0.4994 => 0.6140, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.70% (0.5000 => 0.6135, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.69% (0.0714 => 0.0876, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.30% (0.0547 => 0.0669, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.26% (0.0584 => 0.0714, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.67% (0.1620 => 0.1971, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.40% (0.0897 => 0.1089, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.25% (0.1021 => 0.1238, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.14% (0.1107 => 0.1341, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 20.87% (0.0599 => 0.0724, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.06% (0.0633 => 0.0760, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.94% (0.0642 => 0.0770, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 19.94% (0.0948 => 0.1137, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.86% (0.0584 => 0.0700, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.67% (0.1103 => 0.1320, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 19.64% (0.1619 => 0.1937, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.60% (0.3903 => 0.4668, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.59% (0.0541 => 0.0647, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.59% (0.0822 => 0.0983, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.39% (0.1604 => 0.1915, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/health/health: 19.37% (0.0821 => 0.0980, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.30% (0.1549 => 0.1848, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.24% (0.1003 => 0.1196, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: 19.04% (0.0604 => 0.0719, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 18.27% (0.0947 => 0.1120) SingleSource/UnitTests/ObjC++/property-reference-object: 18.02% (0.5889 => 0.6950, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 17.99% (0.1462 => 0.1725, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 17.95% (0.0808 => 0.0953) SingleSource/UnitTests/ObjC++/Hello: 17.83% (0.5826 => 0.6865, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.83% (0.2014 => 0.2373, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.63% (0.3890 => 0.4576, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 17.57% (0.1218 => 0.1432, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.53% (1.3152 => 1.5457, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 17.47% (0.4029 => 0.4733, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.24% (0.1160 => 0.1360, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.18% (0.2736 => 0.3206, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.15% (0.2875 => 0.3368, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 17.14% (0.1505 => 0.1763, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.10% (0.1088 => 0.1274, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 17.05% (0.0698 => 0.0817, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 16.65% (0.2750 => 0.3208, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.64% (3.5627 => 4.1557, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.61% (0.2866 => 0.3342, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/fibo: 16.59% (0.2725 => 0.3177, std.dev.: 0.0054) MultiSource/Applications/Burg/burg: 16.53% (0.5546 => 0.6463, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.51% (0.2738 => 0.3190, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 16.47% (0.2714 => 0.3161, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 16.39% (0.9697 => 1.1286, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 16.34% (0.3004 => 0.3495, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.23% (0.2729 => 0.3172, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 16.17% (1.8794 => 2.1833, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/random: 16.16% (0.2803 => 0.3256, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 16.14% (0.2813 => 0.3267, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.12% (1.6211 => 1.8825, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/matrix: 16.12% (0.2780 => 0.3228, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.06% (0.1968 => 0.2284, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 16.05% (0.2823 => 0.3276, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 16.02% (0.3096 => 0.3592, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 15.98% (0.9909 => 1.1492, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 15.97% (0.4658 => 0.5402, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.96% (0.5026 => 0.5828, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.94% (0.2792 => 0.3237, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.93% (0.3271 => 0.3792, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 15.90% (0.1421 => 0.1647, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 15.87% (0.2811 => 0.3257, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.85% (2.0673 => 2.3950, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.84% (0.3195 => 0.3701, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 15.82% (0.3267 => 0.3784, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.82% (0.4361 => 0.5051, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 15.77% (0.3317 => 0.3840, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.73% (0.2911 => 0.3369, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 15.65% (0.3258 => 0.3768, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.61% (2.7292 => 3.1553, std.dev.: 0.0042) SingleSource/UnitTests/ObjC++/property-reference: 15.58% (0.7171 => 0.8288, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 15.35% (0.3446 => 0.3975, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 15.30% (1.0781 => 1.2431, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-4: 15.30% (0.3465 => 0.3995, std.dev.: 0.0077) SingleSource/UnitTests/ObjC/trivial-interface: 15.25% (0.3442 => 0.3967, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.25% (0.3488 => 0.4020, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 15.22% (0.3496 => 0.4028, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.14% (0.3362 => 0.3871, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 15.12% (0.3460 => 0.3983, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.11% (0.3930 => 0.4524, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 15.11% (0.1284 => 0.1478, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 15.11% (0.3469 => 0.3993, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.05% (1.9694 => 2.2657, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.03% (0.3625 => 0.4170, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.03% (4.4195 => 5.0836, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 14.99% (4.2109 => 4.8423, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.97% (0.3060 => 0.3518, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 14.94% (23.5202 => 27.0346, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/lists: 14.93% (0.3348 => 0.3848, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.88% (1.9966 => 2.2937, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/exceptions: 14.77% (0.3643 => 0.4181, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 14.77% (0.3650 => 0.4189, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 14.65% (0.3678 => 0.4217, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: 14.53% (0.3724 => 0.4265, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.50% (0.3124 => 0.3577, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.44% (0.3282 => 0.3756, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 14.29% (0.3477 => 0.3974, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 14.25% (0.3726 => 0.4257, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.22% (0.1090 => 0.1245, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 13.94% (0.4146 => 0.4724, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.88% (0.3690 => 0.4202, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.82% (0.3981 => 0.4531, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 13.81% (0.4251 => 0.4838, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 13.74% (1.4269 => 1.6230, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/football/football: 13.73% (0.2075 => 0.2360, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.73% (0.3845 => 0.4373, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 13.64% (0.2566 => 0.2916, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 13.24% (0.7875 => 0.8918, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 13.13% (0.5012 => 0.5670, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 12.83% (2.1653 => 2.4431, std.dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: 12.59% (2.1013 => 2.3658, std.dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 12.56% (4.6177 => 5.1977, std.dev.: 0.0110) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.81% (0.2040 => 0.2281, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.79% (0.6435 => 0.7194, std.dev.: 0.0026) MultiSource/Applications/SIBsim4/SIBsim4: 11.59% (0.2691 => 0.3003, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 11.58% (5.5417 => 6.1832, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.80% (0.1028 => 0.1139) MultiSource/Applications/lambda-0_1_3/lambda: 10.72% (0.3498 => 0.3873, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.52% (0.2737 => 0.3025, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.48% (0.1383 => 0.1528, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.44% (0.2068 => 0.2284, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.95% (0.3084 => 0.3391, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 9.84% (0.4847 => 0.5324, std.dev.: 0.0024) MultiSource/Applications/siod/siod: 9.78% (0.6634 => 0.7283, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 9.68% (0.3336 => 0.3659, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.27% (0.2103 => 0.2298, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 9.22% (2.0346 => 2.2222, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.68% (4.6926 => 5.0999, std.dev.: 0.0048) MultiSource/Applications/lemon/lemon: 8.62% (0.2391 => 0.2597, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.06% (11.6398 => 12.5783, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.70% (0.5361 => 0.5774, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.06% (0.5584 => 0.5978, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.99% (0.7426 => 0.7945, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 6.73% (11.9555 => 12.7606, std.dev.: 0.0099) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.09% (0.3792 => 0.4023, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.32% (0.2162 => 0.3531, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6536, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) SingleSource/UnitTests/ObjC/synchronized: 13.28% (0.1054 => 0.1194, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 7.78% (0.2802 => 0.3020, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6102, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 5.47% (0.2122 => 0.2238, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/objinst: 5.09% (12.0509 => 12.6642, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 4.75% (15.4430 => 16.1767, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.41% (0.3693 => 0.3856, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-2: 3.97% (1.8057 => 1.8774, std.dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/dry: 2.75% (14.0481 => 14.4343, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary3: 1.99% (15.8721 => 16.1884, std.dev.: 0.0080) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.73% (3.1722 => 3.2270, std.dev.: 0.0027) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3102, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2864, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.20% (8.4155 => 8.5166, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5402, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5944, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.49% (25.4195 => 16.3970, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/ary2: -7.87% (0.2402 => 0.2213, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: -7.70% (28.1477 => 25.9795, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7760, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9586, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2420, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.26% (11.2080 => 10.8424, std.dev.: 0.0561) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7751, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5218, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.46% (17.2379 => 16.8137, std.dev.: 0.0061) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8647, std.dev.: 0.0102) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5699, std.dev.: 0.0084) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4955, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.11% (105.3826 => 104.2090, std.dev.: 0.0755) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0445, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.05% (3.3991 => 3.3634, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 29 12:57:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 14:57:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121029195718.23B882A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5375?compare_to=5372&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5375, Order: 166943, Start Time: 2012-10-29 18:26:12, End Time: 2012-10-29 19:57:16 To: 5372, Order: 166929, Start Time: 2012-10-29 16:25:23, End Time: 2012-10-29 17:56:39 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (9 on baseline) New Passes: 2 (15 on baseline) Performance Regressions: 22 (172 on baseline) Performance Improvements: 112 (50 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 13 (4 on baseline) Unchanged Tests: 893 (658 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod SingleSource/Benchmarks/BenchmarkGame/puzzle MultiSource/Applications/JM/lencod/lencod: -0.79% (7.7220 => 7.6612, std.dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/puzzle: 132.92% (0.2989 => 0.6962, std.dev.: 0.0006) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.31% (3.2339 => 3.2764, std.dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 117.72% (3.7001 => 8.0559, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/dt: 101.90% (1.0133 => 2.0459, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 99.18% (3.4803 => 6.9321, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 35.06% (3.0368 => 4.1015, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 33.73% (3.2518 => 4.3486, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.97% (3.3946 => 4.3780, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 25.82% (2.3608 => 2.9704, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 25.17% (4.3623 => 5.4603, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 23.26% (0.9930 => 1.2240, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.67% (0.0852 => 0.0994, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 14.95% (4.1252 => 4.7419, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.09% (4.3035 => 4.8667, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 11.25% (0.9184 => 1.0217, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.88% (6.6601 => 7.1846, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 5.27% (1.1033 => 1.1614, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.96% (5.1295 => 5.3840, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.35% (4.2764 => 4.4625, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.11% (3.0909 => 3.2178, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.52% (1.7052 => 1.7652, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 2.09% (7.8432 => 8.0069, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.86% (78.9165 => 80.3824, std.dev.: 0.3911) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: -37.88% (0.0528 => 0.0328) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -32.48% (1.0194 => 0.6883, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/lowercase: -32.18% (0.0435 => 0.0295, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: -30.82% (0.0438 => 0.0303, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -30.70% (0.9556 => 0.6622, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -30.64% (0.9070 => 0.6291, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -30.36% (0.8280 => 0.5766, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -30.23% (0.8433 => 0.5884, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -30.04% (0.8836 => 0.6182, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -29.93% (0.8434 => 0.5910, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -29.89% (0.8411 => 0.5897, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -29.49% (0.9079 => 0.6402, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -29.41% (0.8670 => 0.6120, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -29.24% (0.8755 => 0.6195, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -29.14% (0.8682 => 0.6152, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -28.57% (0.9583 => 0.6845, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -28.15% (0.9130 => 0.6560, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -28.02% (0.9243 => 0.6653, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -27.23% (0.9825 => 0.7150, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -26.78% (0.9727 => 0.7122, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -25.00% (1.0693 => 0.8020, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -23.63% (2.2921 => 1.7504, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -22.28% (0.8856 => 0.6883, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.22% (0.8364 => 0.6589, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -20.91% (0.7914 => 0.6259, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -20.41% (0.1181 => 0.0940, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -20.31% (0.7751 => 0.6177, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -20.07% (0.7201 => 0.5756, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -19.99% (0.7355 => 0.5885, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -19.88% (0.7343 => 0.5883, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -19.85% (0.7986 => 0.6401, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -19.68% (0.7347 => 0.5901, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -19.25% (0.8483 => 0.6850, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -19.19% (0.7669 => 0.6197, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -19.14% (0.7585 => 0.6133, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -19.07% (0.7607 => 0.6156, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -19.03% (2.9882 => 2.4194, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -18.33% (0.8156 => 0.6661, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -18.30% (0.8033 => 0.6563, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -17.97% (0.8719 => 0.7152, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -17.62% (0.8659 => 0.7133, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/neural/neural: -17.61% (0.1965 => 0.1619, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -16.69% (0.9372 => 0.7808, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -11.31% (0.2140 => 0.1898, std.dev.: 0.0015) MultiSource/Applications/viterbi/viterbi: -6.82% (0.1891 => 0.1762, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.64% (0.6219 => 0.5806, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: -6.63% (1.3976 => 1.3049, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -6.51% (0.3501 => 0.3273, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -6.40% (1.5593 => 1.4595, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.87% (0.5997 => 0.5645, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.83% (0.8013 => 0.7546, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.60% (0.2712 => 0.2560, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: -5.51% (3.9827 => 3.7633, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.35% (0.2224 => 0.2105, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.18% (1.6355 => 1.5507, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: -5.12% (1.6388 => 1.5549, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.99% (0.7550 => 0.7173, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.98% (0.4354 => 0.4137, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -4.90% (1.8213 => 1.7320, std.dev.: 0.0101) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.41% (0.5438 => 0.5198, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: -4.37% (0.2492 => 0.2383, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -4.30% (17.7310 => 16.9688, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/football/football: -4.21% (1.0326 => 0.9891, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -4.17% (0.8457 => 0.8104, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.04% (0.3048 => 0.2925, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -3.86% (25.8899 => 24.8900, std.dev.: 0.0154) MultiSource/Applications/lemon/lemon: -3.85% (1.2457 => 1.1978, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.75% (0.3816 => 0.3673, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: -3.72% (0.3873 => 0.3729, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -3.71% (19.1257 => 18.4152, std.dev.: 0.0109) MultiSource/Benchmarks/MallocBench/espresso/espresso: -3.68% (4.9053 => 4.7247, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.67% (8.4375 => 8.1278, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -3.59% (1.4756 => 1.4226, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.58% (4.2667 => 4.1138, std.dev.: 0.0029) MultiSource/Applications/treecc/treecc: -3.51% (2.3517 => 2.2691, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/05-eks/eks: -3.48% (0.4948 => 0.4776, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.47% (1.3683 => 1.3208, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: -3.43% (0.3645 => 0.3520, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: -3.40% (0.9148 => 0.8837, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/18-imp/imp: -3.27% (0.3941 => 0.3812, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.27% (1.0543 => 1.0198, std.dev.: 0.0048) MultiSource/Applications/JM/ldecod/ldecod: -3.14% (9.6675 => 9.3641, std.dev.: 0.0061) MultiSource/Benchmarks/mafft/pairlocalalign: -3.06% (10.8144 => 10.4838, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.91% (1.1328 => 1.0998, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -2.84% (5.5247 => 5.3680, std.dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: -2.82% (22.0772 => 21.4538, std.dev.: 0.0188) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -2.77% (5.5879 => 5.4330, std.dev.: 0.0120) MultiSource/Applications/lua/lua: -2.75% (4.4400 => 4.3180, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: -2.74% (1.3482 => 1.3112, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.59% (16.0796 => 15.6638, std.dev.: 0.0166) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -2.20% (0.6742 => 0.6594, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -2.14% (7.3507 => 7.1933, std.dev.: 0.0064) MultiSource/Applications/siod/siod: -2.13% (2.5765 => 2.5217, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.99% (0.9065 => 0.8885, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -1.90% (0.6879 => 0.6748, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: -1.76% (4.6951 => 4.6123, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.76% (1.3610 => 1.3371, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.67% (0.8539 => 0.8396, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.59% (2.4447 => 2.4058, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: -1.55% (19.5832 => 19.2793, std.dev.: 0.0125) SingleSource/Benchmarks/Misc-C++/bigfib: -1.44% (0.7215 => 0.7111, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.36% (2.4398 => 2.4065, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.29% (5.8772 => 5.8013, std.dev.: 0.0158) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.24% (0.9604 => 0.9485, std.dev.: 0.0025) MultiSource/Applications/hbd/hbd: -1.02% (1.7210 => 1.7034, std.dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -12.93% (1.0974 => 0.9555, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -12.46% (5.0270 => 4.4004, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -5.31% (1.3722 => 1.2994, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -4.31% (3.4960 => 3.3454, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -3.58% (1.9977 => 1.9262, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: -3.04% (4.5723 => 4.4335, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.04% (5.6640 => 5.6049, std.dev.: 0.0014) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -3.46% (2.0473 => 1.9764, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.53% (58.2563 => 57.3658, std.dev.: 0.0191) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.74% (0.0803 => 0.0789, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -3.35% (9.2710 => 8.9605, std.dev.: 0.0123) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.53% (7.8470 => 7.6482, std.dev.: 0.0121) SingleSource/UnitTests/Vector/SSE/sse_shift: - (0.0519 => 0.0519, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: - (0.0001 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.46% (0.0648 => 0.0651, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/SSE/sse_shift: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -65.68% (5.7591 => 1.9764, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -9.29% (63.2438 => 57.3658, std.dev.: 0.0191) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.82% (6.6874 => 0.0789, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.13% (8.1363 => 8.9605, std.dev.: 0.0123) SingleSource/UnitTests/Vector/SSE/sse_shift: 37.30% (0.0378 => 0.0519, std.dev.: 0.0001) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -50.00% (0.0002 => 0.0001) SingleSource/UnitTests/Vector/SSE/sse_shift: -50.00% (0.0002 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 197.36% (0.5229 => 1.5549, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 13.20% (14.9895 => 16.9688, std.dev.: 0.0074) MultiSource/Applications/kimwitu++/kc: 36.20% (14.1553 => 19.2793, std.dev.: 0.0125) MultiSource/Benchmarks/MallocBench/gs/gs: 12.21% (4.1105 => 4.6123, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 28.77% (1.1048 => 1.4226, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.53% (3.4629 => 5.8013, std.dev.: 0.0158) SingleSource/Benchmarks/Misc-C++/stepanov_container: 63.90% (0.6222 => 1.0198, std.dev.: 0.0048) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10540.56% (0.0720 => 7.6612, std.dev.: 0.0098) MultiSource/Applications/SIBsim4/SIBsim4: 3836000.00% (0.0001 => 3.8361, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 11174900.00% (0.0001 => 11.1750, std.dev.: 0.0684) MultiSource/Applications/kimwitu++/kc: 50900.00% (0.0001 => 0.0510, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050400.00% (0.0001 => 10.0505, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5491300.00% (0.0001 => 5.4914, std.dev.: 0.0039) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 38.54% (0.1056 => 0.1463, std.dev.: 0.0002) SingleSource/UnitTests/vla: 29.01% (0.0355 => 0.0458, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 28.98% (0.1432 => 0.1847, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.24% (0.1566 => 0.1883) SingleSource/Benchmarks/CoyoteBench/almabench: 17.67% (0.0730 => 0.0859, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 17.48% (0.1144 => 0.1344, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.02% (0.0793 => 0.0928, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 16.89% (0.0746 => 0.0872, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.76% (0.0871 => 0.1017, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 16.62% (0.3177 => 0.3705, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 16.51% (0.1175 => 0.1369, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 16.31% (0.4879 => 0.5675, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.07% (0.8172 => 0.9485, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/08-main/main: 15.94% (0.2554 => 0.2961, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 15.47% (0.1584 => 0.1829, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.85% (0.0842 => 0.0967, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 14.68% (0.1655 => 0.1898, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/em3d/em3d: 14.63% (0.1695 => 0.1943, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 14.53% (0.1163 => 0.1332, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.44% (0.1143 => 0.1308, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.11% (0.2700 => 0.3081, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.00% (0.0886 => 0.1010, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 13.90% (0.7115 => 0.8104, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.90% (0.2065 => 0.2352, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 13.73% (0.5105 => 0.5806, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 13.64% (0.1151 => 0.1308, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.52% (0.1117 => 0.1268, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ft/ft: 13.51% (0.1940 => 0.2202, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 13.31% (0.1555 => 0.1762, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.23% (0.2758 => 0.3123, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 13.22% (0.3109 => 0.3520, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.18% (0.1510 => 0.1709, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 13.16% (0.1125 => 0.1273, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.12% (0.0770 => 0.0871, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.05% (0.6675 => 0.7546, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.03% (0.0798 => 0.0902, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.01% (0.1337 => 0.1511, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 12.96% (0.7433 => 0.8396, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 12.83% (3.3354 => 3.7633, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.82% (0.5981 => 0.6748, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.81% (0.1062 => 0.1198, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 12.79% (0.7835 => 0.8837, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.77% (0.2107 => 0.2376, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.73% (0.2271 => 0.2560, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.71% (0.0834 => 0.0940, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.66% (0.3121 => 0.3516, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.63% (0.1029 => 0.1159, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.63% (0.4615 => 0.5198, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.63% (0.9765 => 1.0998, std.dev.: 0.0040) MultiSource/Applications/Burg/burg: 12.63% (1.1642 => 1.3112, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.53% (0.5860 => 0.6594, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.45% (0.5020 => 0.5645, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/exptree: 12.41% (0.0814 => 0.0915, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.37% (0.2603 => 0.2925, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.36% (1.5415 => 1.7320, std.dev.: 0.0101) MultiSource/Applications/ClamAV/clamscan: 12.24% (22.1758 => 24.8900, std.dev.: 0.0154) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.02% (0.1032 => 0.1156, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 11.93% (2.0273 => 2.2691, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.92% (0.5569 => 0.6233, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.88% (0.1625 => 0.1818, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.84% (1.3050 => 1.4595, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.81% (0.1236 => 0.1382, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 11.75% (0.1268 => 0.1417, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 11.71% (1.0722 => 1.1978, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.61% (0.3307 => 0.3691, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.52% (0.3543 => 0.3951, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 11.51% (3.8723 => 4.3180, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.42% (2.2022 => 2.4537, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.39% (0.3441 => 0.3833, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 11.36% (0.3423 => 0.3812, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.36% (1.1861 => 1.3208, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.21% (0.6450 => 0.7173, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.17% (0.3473 => 0.3861, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.10% (0.3927 => 0.4363, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 11.10% (0.4299 => 0.4776, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/for-in: 10.99% (0.3694 => 0.4100, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.98% (0.3543 => 0.3932, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.95% (0.3497 => 0.3880, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 10.95% (0.3516 => 0.3901, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 10.92% (0.3561 => 0.3950, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.89% (0.3828 => 0.4245, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 10.87% (0.8921 => 0.9891, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.87% (0.0929 => 0.1030, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.79% (4.2646 => 4.7247, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 10.68% (0.3886 => 0.4301, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 10.66% (0.1463 => 0.1619, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 10.63% (0.3180 => 0.3518, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 10.61% (0.4289 => 0.4744, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.56% (0.1695 => 0.1874, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 10.54% (9.4845 => 10.4838, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.44% (0.1906 => 0.2105, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.44% (0.1044 => 0.1153, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.37% (1.5859 => 1.7504, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 10.21% (1.1840 => 1.3049, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 10.15% (0.6456 => 0.7111, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 10.10% (0.3387 => 0.3729, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 10.02% (0.1268 => 0.1395, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.94% (0.3865 => 0.4249, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.85% (2.2024 => 2.4194, std.dev.: 0.0186) MultiSource/Applications/siod/siod: 9.79% (2.2969 => 2.5217, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 9.78% (0.4620 => 0.5072, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 9.73% (0.3422 => 0.3755, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.71% (0.4636 => 0.5086, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.68% (0.8101 => 0.8885, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.64% (0.4203 => 0.4608, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 9.60% (0.7326 => 0.8029, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.51% (0.4103 => 0.4493, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.31% (1.4186 => 1.5507, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 9.23% (0.5925 => 0.6472, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference-object: 9.20% (0.6030 => 0.6585, std.dev.: 0.0033) MultiSource/Applications/hbd/hbd: 9.17% (1.5603 => 1.7034, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.03% (14.3668 => 15.6638, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout-C++/moments: 9.02% (0.4048 => 0.4413, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 9.01% (0.3684 => 0.4016, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 8.96% (0.3603 => 0.3926, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.95% (0.1330 => 0.1449, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 8.69% (0.2831 => 0.3077, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.62% (5.0018 => 5.4330, std.dev.: 0.0120) SingleSource/Regression/C++/ofstream_ctor: 8.61% (0.2905 => 0.3155, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.56% (0.1892 => 0.2054, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.56% (0.2793 => 0.3032, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.56% (4.9449 => 5.3680, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.38% (0.3650 => 0.3956, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 8.35% (0.3283 => 0.3557, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.25% (0.3162 => 0.3423, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.23% (0.2891 => 0.3129, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.21% (2.0665 => 2.2362, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 8.17% (0.3232 => 0.3496, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.13% (0.3826 => 0.4137, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 8.10% (0.3098 => 0.3349, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.02% (0.2430 => 0.2625, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 7.93% (0.2725 => 0.2941, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 7.87% (0.2871 => 0.3097, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.82% (0.4064 => 0.4382, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.76% (0.2756 => 0.2970, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 7.73% (0.3052 => 0.3288, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.73% (0.2872 => 0.3094, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 7.68% (0.2877 => 0.3098, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 7.66% (0.2714 => 0.2922, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 7.46% (0.2802 => 0.3011, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 7.18% (17.1811 => 18.4152, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.18% (0.3427 => 0.3673, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: 6.90% (0.3379 => 0.3612, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 6.66% (1.2842 => 1.3697, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.44% (0.3136 => 0.3338, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 6.28% (0.3282 => 0.3488, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 5.85% (0.3092 => 0.3273, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.69% (3.8922 => 4.1138, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/objinst: 5.65% (0.3131 => 0.3308, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.58% (0.8067 => 0.8517, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.16% (0.2266 => 0.2383, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.66% (0.3935 => 0.4079, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.41% (0.3817 => 0.3947, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.09% (7.9617 => 8.1278, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.97% (7.0540 => 7.1933, std.dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.59% (1.1145 => 1.2994, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 10.04% (1.1396 => 1.2540, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3683, std.dev.: 0.0011) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.87% (0.4162 => 0.4323, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.49% (4.2280 => 4.3334, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7652, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.81% (0.8333 => 0.8484, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2079, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.32% (11.6436 => 11.7972, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -76.53% (0.8651 => 0.2030, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.33% (5.3855 => 2.4058, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -55.04% (5.3526 => 2.4065, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -45.31% (0.1622 => 0.0887, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.21% (1.1194 => 0.6805, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.90% (5.2763 => 3.2764, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -24.07% (1.7609 => 1.3371, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -16.94% (2.9384 => 2.4407, std.dev.: 0.0037) MultiSource/Applications/JM/ldecod/ldecod: -10.27% (10.4361 => 9.3641, std.dev.: 0.0061) SingleSource/UnitTests/Vector/constpool: -9.04% (54.1659 => 49.2669, std.dev.: 0.0153) MultiSource/Benchmarks/PAQ8p/paq8p: -4.29% (10.3673 => 9.9226, std.dev.: 0.0082) MultiSource/Applications/JM/lencod/lencod: -2.20% (21.9371 => 21.4538, std.dev.: 0.0188) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.99% (0.0506 => 0.0334) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -33.68% (0.3987 => 0.2644, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel: -33.34% (1.1492 => 0.7660, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4230, std.dev.: 0.0027) MultiSource/Benchmarks/NPB-serial/is/is: -11.00% (9.5636 => 8.5120, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: -10.90% (1.5373 => 1.3698, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.23% (19.9488 => 18.3062, std.dev.: 0.0097) MultiSource/Benchmarks/FreeBench/mason/mason: -7.96% (0.2161 => 0.1989, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.09% (1.8329 => 1.7029, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4785, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -6.13% (1.2373 => 1.1614, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: -5.46% (6.6465 => 6.2837, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.11% (1.6805 => 1.5947, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.78% (1.5835 => 1.5078, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.08% (0.2497 => 0.2395, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.04% (0.9957 => 0.9555, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.56% (3.2827 => 3.1658, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.51% (32.5116 => 31.3700, std.dev.: 0.0039) MultiSource/Benchmarks/sim/sim: -3.24% (5.0483 => 4.8849, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.81% (0.4808 => 0.4673, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.79% (4.5009 => 4.3754, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -2.72% (4.6441 => 4.5177, std.dev.: 0.0019) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.89% (10.2830 => 10.0884, std.dev.: 0.0166) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.83% (8.1563 => 8.0069, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6825, std.dev.: 0.0014) SingleSource/UnitTests/Vector/multiplies: -1.59% (2.5528 => 2.5123, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -1.20% (85.0658 => 84.0423, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout/lists: -1.08% (6.2999 => 6.2320, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -1.01% (1.1277 => 1.1163, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8592, std.dev.: 0.0043) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.85% (7.1582 => 7.6482, std.dev.: 0.0121) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 2.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 29 13:01:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 15:01:46 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121029200146.9FF732A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5376?compare_to=5370&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5376, Order: 166951, Start Time: 2012-10-29 18:32:59, End Time: 2012-10-29 20:01:46 To: 5370, Order: 166926, Start Time: 2012-10-29 15:08:13, End Time: 2012-10-29 16:33:23 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 16 (17 on baseline) Performance Regressions: 17 (112 on baseline) Performance Improvements: 0 (4 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 958 (858 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2353.87% (0.6453 => 15.8348, std.dev.: 0.1694) MultiSource/Benchmarks/McCat/08-main/main: 39.25% (0.1977 => 0.2753, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -13.18% (0.1700 => 0.1476, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1461.35% (0.3389 => 5.2914, std.dev.: 0.0539) SingleSource/Benchmarks/Misc-C++/Large/ray: 35.88% (0.2394 => 0.3253, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -5.53% (0.0452 => 0.0427, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -8.84% (0.0249 => 0.0227, std.dev.: 0.0022) SingleSource/UnitTests/byval-alignment: -47.88% (0.0330 => 0.0172, std.dev.: 0.0011) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4519, std.dev.: 0.0349) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0693, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4973, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3452, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0252, std.dev.: 0.0570) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4087, std.dev.: 0.0014) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.84% (0.8768 => 0.9192, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.70% (0.7855 => 0.8067, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.30% (1.1973 => 1.2248, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.03% (0.9074 => 0.9258, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.80% (0.6947 => 0.7072, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.67% (0.8188 => 0.8325, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.23% (0.8846 => 0.8955, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.09% (4.5760 => 4.6257, std.dev.: 0.0158) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.1792 => 1.1915, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: 10.71% (3.0229 => 3.3468, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.58% (6.9647 => 7.2139, std.dev.: 0.0650) MultiSource/Applications/SPASS/SPASS: 2.83% (8.2329 => 8.4662, std.dev.: 0.0826) SingleSource/Benchmarks/Shootout/methcall: 2.05% (8.0665 => 8.2318, std.dev.: 0.0270) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.84% (2.4731 => 2.5187, std.dev.: 0.0038) MultiSource/Benchmarks/BitBench/five11/five11: 1.63% (5.5411 => 5.6313, std.dev.: 0.0305) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.37% (2.6646 => 2.7012, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.28% (1.8676 => 1.8915, std.dev.: 0.0011) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.61% (16.6174 => 16.7192, std.dev.: 0.2538) MultiSource/Applications/obsequi/Obsequi: 0.28% (1.0775 => 1.0805, std.dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6616.84% (0.3219 => 21.6215, std.dev.: 0.1288) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.34% (0.2480 => 0.3654, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 2.05% (0.6012 => 0.6135, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.94% (0.3298 => 0.3329, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/strcat: 0.61% (0.1983 => 0.1995, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.89% (0.0224 => 0.0226, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.12% (0.0424 => 0.0433, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.91% (0.0330 => 0.0333, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.92% (0.0312 => 0.0318, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 2.38% (0.0421 => 0.0431, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/casts: 3.45% (0.0203 => 0.0210, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/test1: 3.23% (0.0217 => 0.0224, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -38.46% (0.0013 => 0.0008, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.62% (0.1457 => 0.1448, std.dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 5.93% (1.1103 => 1.1761, std.dev.: 0.0104) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.49% (0.1517 => 0.1464, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.03% (0.4072 => 0.4114, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.40% (0.1374 => 0.1341, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -12.50% (0.0008 => 0.0007, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 14.55% (0.0584 => 0.0669, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.45% (0.0275 => 0.0271, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.18% (0.0599 => 0.0556, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.03% (1.1436 => 1.1440, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 14.81% (0.0027 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 16.46% (0.0559 => 0.0651, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 58.33% (0.0168 => 0.0266, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.04% (0.8020 => 0.8023, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -21.74% (0.0069 => 0.0054, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2400.76% (0.6332 => 15.8348, std.dev.: 0.1694) MultiSource/Benchmarks/McCat/08-main/main: 50.35% (0.1831 => 0.2753, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.32% (0.1559 => 0.1476, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1482.36% (0.3344 => 5.2914, std.dev.: 0.0539) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.61% (0.2364 => 0.3253, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -0.47% (0.0429 => 0.0427, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.34% (0.0224 => 0.0227, std.dev.: 0.0022) SingleSource/UnitTests/byval-alignment: -25.22% (0.0230 => 0.0172, std.dev.: 0.0011) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4519, std.dev.: 0.0349) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0693, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4973, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3452, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0252, std.dev.: 0.0570) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4087, std.dev.: 0.0014) SingleSource/Regression/C/uint64_to_float: -23.92% (2.1832 => 1.6610, std.dev.: 0.0232) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 37.27% (14.7684 => 20.2731, std.dev.: 0.1083) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.78% (0.0810 => 0.0954, std.dev.: 0.0025) SingleSource/UnitTests/SignlessTypes/rem: 14.78% (0.1035 => 0.1188, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 12.68% (0.1112 => 0.1253, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.65% (0.0830 => 0.0935, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.47% (0.8321 => 0.9192, std.dev.: 0.0082) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.67% (0.1137 => 0.1247, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.27% (0.2180 => 0.2382, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.23% (0.1983 => 0.2166, std.dev.: 0.0025) MultiSource/Applications/SIBsim4/SIBsim4: 7.99% (1.2568 => 1.3572, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.99% (0.2279 => 0.2461, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.95% (0.7473 => 0.8067, std.dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.33% (0.3137 => 0.3367, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.24% (0.1905 => 0.2043, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.09% (0.1425 => 0.1526, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.05% (0.6010 => 0.6434, std.dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.89% (0.1466 => 0.1567, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.67% (1.1170 => 1.1915, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.56% (13.1811 => 14.0455, std.dev.: 0.1380) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.47% (0.2998 => 0.3192, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.44% (0.4847 => 0.5159, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.30% (0.6287 => 0.6683, std.dev.: 0.0086) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.04% (0.8148 => 0.8640, std.dev.: 0.0097) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.78% (0.1885 => 0.1994, std.dev.: 0.0039) MultiSource/Benchmarks/nbench/nbench: 5.74% (1.1271 => 1.1918, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.53% (1.1606 => 1.2248, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.27% (1.6386 => 1.7249, std.dev.: 0.0079) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.22% (0.2240 => 0.2357, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.22% (6.6074 => 6.9524, std.dev.: 0.0740) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.14% (0.2741 => 0.2882, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.94% (0.4127 => 0.4331, std.dev.: 0.0047) MultiSource/Applications/lemon/lemon: 4.93% (1.0945 => 1.1485, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.83% (0.9435 => 0.9891, std.dev.: 0.0034) MultiSource/Applications/minisat/minisat: 4.81% (0.6834 => 0.7163, std.dev.: 0.0062) MultiSource/Applications/SPASS/SPASS: 4.71% (14.2605 => 14.9327, std.dev.: 0.0318) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.70% (0.3295 => 0.3450, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.61% (0.5961 => 0.6236, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.22% (1.3279 => 1.3839, std.dev.: 0.0189) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.21% (0.4559 => 0.4751, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/05-eks/eks: 4.21% (0.4397 => 0.4582, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 4.20% (0.8885 => 0.9258, std.dev.: 0.0062) MultiSource/Applications/sgefa/sgefa: 4.07% (0.2999 => 0.3121, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.01% (1.1685 => 1.2154, std.dev.: 0.0132) MultiSource/Applications/d/make_dparser: 4.00% (3.2366 => 3.3660, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.98% (0.8007 => 0.8326, std.dev.: 0.0121) MultiSource/Applications/lua/lua: 3.96% (3.8189 => 3.9702, std.dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.92% (0.6227 => 0.6471, std.dev.: 0.0062) MultiSource/Applications/spiff/spiff: 3.89% (0.7950 => 0.8259, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.75% (8.6476 => 8.9720, std.dev.: 0.0575) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.74% (0.5191 => 0.5385, std.dev.: 0.0033) MultiSource/Applications/JM/lencod/lencod: 3.73% (15.3280 => 15.8995, std.dev.: 0.0782) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.66% (0.3003 => 0.3113, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/gs/gs: 3.66% (4.1305 => 4.2817, std.dev.: 0.0158) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.61% (0.5817 => 0.6027, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.45% (0.8656 => 0.8955, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.45% (0.8697 => 0.8997, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.41% (1.2526 => 1.2953, std.dev.: 0.0151) MultiSource/Applications/JM/ldecod/ldecod: 3.40% (6.7320 => 6.9608, std.dev.: 0.0514) MultiSource/Applications/treecc/treecc: 3.36% (1.9948 => 2.0618, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.34% (0.8359 => 0.8638, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/football/football: 3.32% (0.8768 => 0.9059, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.30% (0.8457 => 0.8736, std.dev.: 0.0075) MultiSource/Benchmarks/mafft/pairlocalalign: 3.29% (8.6247 => 8.9088, std.dev.: 0.0912) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.26% (0.9074 => 0.9370, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.24% (4.1763 => 4.3115, std.dev.: 0.0320) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 3.22% (0.8331 => 0.8599, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 3.20% (0.7932 => 0.8186, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 3.14% (4.9628 => 5.1186, std.dev.: 0.0382) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 3.12% (0.9039 => 0.9321, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.08% (4.4873 => 4.6257, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 3.05% (0.9069 => 0.9346, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.04% (0.8317 => 0.8570, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.02% (1.2602 => 1.2982, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.01% (4.4880 => 4.6231, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.01% (0.8177 => 0.8423, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.97% (0.8286 => 0.8532, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.96% (0.8086 => 0.8325, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.95% (0.8261 => 0.8505, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.95% (0.8712 => 0.8969, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.93% (0.6586 => 0.6779, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.90% (0.9908 => 1.0195, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.86% (0.8420 => 0.8661, std.dev.: 0.0038) MultiSource/Applications/Burg/burg: 2.82% (1.2222 => 1.2567, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.82% (0.9688 => 0.9961, std.dev.: 0.0092) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.80% (4.5702 => 4.6980, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.77% (0.8050 => 0.8273, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.71% (0.8855 => 0.9095, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.67% (0.7966 => 0.8179, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.67% (1.4479 => 1.4866, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.65% (0.8518 => 0.8744, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.65% (0.8048 => 0.8261, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: 2.64% (0.4125 => 0.4234, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.54% (0.8069 => 0.8274, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.52% (0.8338 => 0.8548, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.51% (0.8204 => 0.8410, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.43% (0.8805 => 0.9019, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.32% (0.8066 => 0.8253, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.27% (0.8927 => 0.9130, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.22% (2.1401 => 2.1877, std.dev.: 0.0105) MultiSource/Applications/siod/siod: 2.02% (2.2184 => 2.2632, std.dev.: 0.0078) MultiSource/Benchmarks/Bullet/bullet: 1.99% (31.8598 => 32.4925, std.dev.: 0.1874) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.98% (3.1832 => 3.2461, std.dev.: 0.0197) MultiSource/Applications/lambda-0_1_3/lambda: 1.96% (0.7557 => 0.7705, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.86% (0.6943 => 0.7072, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.84% (1.2423 => 1.2651, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.01% (2.4333 => 2.7012, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.68% (3.0515 => 3.3468, std.dev.: 0.0200) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.32% (1.1857 => 1.2843, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 5.91% (63.1822 => 66.9189, std.dev.: 0.2700) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.85% (2.4490 => 2.5187, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/richards_benchmark: 1.58% (1.3037 => 1.3243, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/bh/bh: 1.44% (2.3560 => 2.3899, std.dev.: 0.0110) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.97% (0.3269 => 0.3041, std.dev.: 0.0037) MultiSource/Applications/lua/lua: -5.03% (29.8330 => 28.3336, std.dev.: 0.1948) SingleSource/Benchmarks/Shootout-C++/hash2: -1.64% (3.4237 => 3.3676, std.dev.: 0.0186) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.30% (3.3479 => 3.3043, std.dev.: 0.0111) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.66% (16.4461 => 16.7192, std.dev.: 0.2538) MultiSource/Applications/obsequi/Obsequi: 5.29% (1.0262 => 1.0805, std.dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6823.31% (0.3123 => 21.6215, std.dev.: 0.1288) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.36% (0.2463 => 0.3654, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 2.08% (0.6010 => 0.6135, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.93% (0.3266 => 0.3329, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/strcat: 1.32% (0.1969 => 0.1995, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 83.74% (0.0123 => 0.0226, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 6.13% (0.0408 => 0.0433, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 5.30% (0.0302 => 0.0318, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 12.24% (0.0384 => 0.0431, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/casts: 10.53% (0.0190 => 0.0210, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/test1: 24.44% (0.0180 => 0.0224, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 14.29% (0.0007 => 0.0008, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.70% (0.1438 => 0.1448, std.dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 3.81% (1.1329 => 1.1761, std.dev.: 0.0104) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.14% (0.1462 => 0.1464, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.20% (0.4164 => 0.4114, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.05% (0.1369 => 0.1341, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -12.50% (0.0008 => 0.0007, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.37% (0.0641 => 0.0669, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 38.97% (0.0195 => 0.0271, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.81% (0.0578 => 0.0556, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.03% (1.1437 => 1.1440, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.83% (0.0627 => 0.0651, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.78% (0.0180 => 0.0266, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.07% (0.8017 => 0.8023, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -12.90% (0.0062 => 0.0054, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 29 13:36:44 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 15:36:44 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121029203644.7139D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5377?compare_to=5373&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5377, Order: 166958, Start Time: 2012-10-29 19:11:21, End Time: 2012-10-29 20:36:42 To: 5373, Order: 166937, Start Time: 2012-10-29 17:22:01, End Time: 2012-10-29 18:48:09 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 1 (177 on baseline) Unchanged Tests: 1040 (860 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.10% (20.1391 => 20.3603, std.dev.: 0.0391) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.63% (1.2981 => 1.2769, std.dev.: 0.0015) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 19.96% (15.2527 => 18.2964, std.dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.69% (2.0478 => 2.1029, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/salsa20: 2.42% (7.4937 => 7.6753, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/hash2: 2.29% (3.1932 => 3.2664, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.08% (0.1431 => 0.1301, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.33% (0.1584 => 0.1452, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -7.96% (0.3831 => 0.3526, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -7.92% (0.3812 => 0.3510, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/exceptions-3: -7.90% (0.3848 => 0.3544, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -7.86% (0.3880 => 0.3575, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.85% (0.3884 => 0.3579, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: -7.83% (0.3896 => 0.3591, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.74% (0.3891 => 0.3590, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -7.64% (0.4176 => 0.3857, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -7.64% (0.4033 => 0.3725, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.48% (0.3821 => 0.3535, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -7.26% (0.4199 => 0.3894, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/parameter-passing: -7.15% (0.4280 => 0.3974, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.78% (0.3142 => 0.2929, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: -6.58% (2.4924 => 2.3285, std.dev.: 0.0123) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.47% (0.2428 => 0.2271, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: -6.42% (0.2989 => 0.2797, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.38% (0.3025 => 0.2832, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -6.38% (0.3026 => 0.2833, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -6.33% (0.3016 => 0.2825, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.31% (0.3057 => 0.2864, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.30% (0.2903 => 0.2720, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.28% (0.2355 => 0.2207, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hello: -6.28% (0.2849 => 0.2670, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -6.23% (0.1879 => 0.1762) SingleSource/Benchmarks/Shootout-C++/random: -6.23% (0.2939 => 0.2756, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -6.20% (0.2871 => 0.2693, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.18% (0.3849 => 0.3611, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.17% (2.1713 => 2.0374, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: -6.14% (0.3255 => 0.3055, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -6.12% (0.3481 => 0.3268, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.12% (22.4056 => 21.0349, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/objinst: -6.11% (0.3194 => 0.2999, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.10% (4.5069 => 4.2318, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: -6.10% (1.3148 => 1.2346, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: -6.10% (0.3394 => 0.3187, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.09% (0.6484 => 0.6089, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.09% (0.3252 => 0.3054, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.09% (0.4813 => 0.4520, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -6.08% (0.3205 => 0.3010, std.dev.: 0.0024) SingleSource/Regression/C++/ofstream_ctor: -6.05% (0.3059 => 0.2874, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -6.04% (0.3446 => 0.3238, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.02% (0.4083 => 0.3837, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -6.02% (0.3621 => 0.3403, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.00% (0.4151 => 0.3902, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.99% (0.3837 => 0.3607, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -5.99% (0.3788 => 0.3561, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -5.97% (0.2160 => 0.2031, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -5.90% (0.3357 => 0.3159, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: -5.86% (7.0961 => 6.6805, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.85% (0.3658 => 0.3444, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -5.77% (0.4248 => 0.4003, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.77% (0.9852 => 0.9284, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.76% (4.8161 => 4.5386, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/08-main/main: -5.75% (0.2659 => 0.2506, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.75% (5.4682 => 5.1536, std.dev.: 0.0055) SingleSource/UnitTests/ObjC++/Hello: -5.75% (0.6347 => 0.5982, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -5.74% (0.3867 => 0.3645, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.74% (0.7198 => 0.6785, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.74% (0.4427 => 0.4173, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: -5.74% (16.1920 => 15.2633, std.dev.: 0.0222) SingleSource/UnitTests/ObjC++/property-reference-object: -5.73% (0.6441 => 0.6072, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: -5.72% (0.4861 => 0.4583, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.70% (4.8802 => 4.6019, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.66% (0.3323 => 0.3135, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.65% (0.9542 => 0.9003, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: -5.63% (0.7779 => 0.7341, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: -5.61% (0.6750 => 0.6371, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.61% (1.2221 => 1.1535, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.60% (3.5339 => 3.3360, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.59% (1.2210 => 1.1527, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash: -5.59% (0.4524 => 0.4271, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.59% (0.8521 => 0.8045, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: -5.58% (1.2515 => 1.1817, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.49% (0.2933 => 0.2772, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: -5.48% (4.3330 => 4.0954, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.47% (1.0544 => 0.9967, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.46% (1.2784 => 1.2086, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.45% (4.0323 => 3.8126, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.43% (1.6474 => 1.5579, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.42% (0.2548 => 0.2410, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.39% (0.3931 => 0.3719, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.39% (0.4321 => 0.4088, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.39% (0.7919 => 0.7492, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.32% (0.5999 => 0.5680, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.27% (0.3491 => 0.3307, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -5.17% (2.4021 => 2.2778, std.dev.: 0.0139) MultiSource/Benchmarks/Bullet/bullet: -5.16% (34.0927 => 32.3347, std.dev.: 0.0083) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.14% (0.2278 => 0.2161, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: -5.11% (9.2283 => 8.7567, std.dev.: 0.0109) MultiSource/Applications/lua/lua: -5.05% (4.0594 => 3.8543, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.05% (1.6364 => 1.5538, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.04% (0.6293 => 0.5976, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.99% (1.3722 => 1.3037, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.92% (2.2587 => 2.1476, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: -4.87% (18.2933 => 17.4023, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.87% (0.2999 => 0.2853, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.86% (0.5805 => 0.5523, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.86% (0.9557 => 0.9093, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.85% (0.5859 => 0.5575, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.81% (0.5863 => 0.5581, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/18-imp/imp: -4.80% (0.3581 => 0.3409, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.79% (0.5591 => 0.5323, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.78% (0.4916 => 0.4681, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.78% (0.2385 => 0.2271, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.78% (0.5925 => 0.5642, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.77% (0.6304 => 0.6003, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.76% (0.5478 => 0.5217, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.75% (0.6230 => 0.5934, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.74% (0.5575 => 0.5311, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.73% (1.4642 => 1.3949, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.73% (0.6052 => 0.5766, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.69% (0.6676 => 0.6363, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.69% (0.7339 => 0.6995, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: -4.66% (0.7982 => 0.7610, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.65% (0.6260 => 0.5969, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.65% (0.5941 => 0.5665, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.62% (0.5581 => 0.5323, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.59% (0.6660 => 0.6354, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.59% (0.5857 => 0.5588, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.59% (0.5705 => 0.5443, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.59% (0.6194 => 0.5910, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.58% (0.5569 => 0.5314, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.57% (0.6395 => 0.6103, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/05-eks/eks: -4.56% (0.4515 => 0.4309, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.55% (0.5456 => 0.5208, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.54% (0.6667 => 0.6364, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.53% (0.6440 => 0.6148, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.53% (0.5802 => 0.5539, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.52% (0.6681 => 0.6379, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.52% (0.7524 => 0.7184, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.51% (0.6446 => 0.6155, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.49% (0.6297 => 0.6014, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.49% (0.6033 => 0.5762, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.49% (0.5570 => 0.5320, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.48% (0.5849 => 0.5587, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.48% (0.6189 => 0.5912, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.45% (0.5567 => 0.5319, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.45% (0.5688 => 0.5435, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: -4.44% (0.9179 => 0.8771, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.44% (0.2277 => 0.2176, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.43% (0.9077 => 0.8675, std.dev.: 0.0059) MultiSource/Applications/minisat/minisat: -4.36% (0.7447 => 0.7122, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.35% (8.0126 => 7.6638, std.dev.: 0.0093) MultiSource/Applications/spiff/spiff: -4.30% (0.8418 => 0.8056, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.25% (0.3319 => 0.3178, std.dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.22% (6.7716 => 6.4861, std.dev.: 0.0123) MultiSource/Benchmarks/McCat/09-vor/vor: -4.19% (0.3271 => 0.3134, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.18% (0.6395 => 0.6128, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: -4.16% (15.5079 => 14.8631, std.dev.: 0.0142) MultiSource/Benchmarks/sim/sim: -4.14% (0.3406 => 0.3265, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: -4.03% (1.1450 => 1.0988, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.00% (0.7021 => 0.6740, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.95% (0.6736 => 0.6470, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: -3.95% (1.5610 => 1.4994, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.93% (0.3483 => 0.3346, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: -3.90% (2.1401 => 2.0566, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.83% (0.5168 => 0.4970, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -3.82% (5.0226 => 4.8308, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: -3.74% (17.1032 => 16.4641, std.dev.: 0.0246) MultiSource/Applications/d/make_dparser: -3.64% (3.5154 => 3.3873, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.61% (1.2300 => 1.1856, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.45% (0.5329 => 0.5145, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: -3.36% (1.1530 => 1.1143, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.23% (14.2083 => 13.7490, std.dev.: 0.0146) SingleSource/UnitTests/Vector/constpool: -1.99% (20.7746 => 20.3603, std.dev.: 0.0391) MultiSource/Applications/SIBsim4/SIBsim4: -1.78% (1.3864 => 1.3617, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7553, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/richards_benchmark: -8.66% (1.2842 => 1.1730, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -4.09% (2.2633 => 2.1708, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.85% (1.7753 => 1.7070, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.50% (1.3096 => 1.2769, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.70% (6.5735 => 6.4620, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0003) Report Time: 2.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 29 14:46:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 16:46:34 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121029214634.814BA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5378?compare_to=5376&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5378, Order: 166961, Start Time: 2012-10-29 20:18:57, End Time: 2012-10-29 21:46:33 To: 5376, Order: 166951, Start Time: 2012-10-29 18:32:59, End Time: 2012-10-29 20:01:46 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 13 (111 on baseline) Performance Improvements: 2 (5 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 976 (858 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/Burg/burg: 2.39% (1.2567 => 1.2867, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.30% (1.7249 => 1.7473, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.04% (8.9720 => 9.0655, std.dev.: 0.0158) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 28.07% (1.9333 => 2.4759, std.dev.: 0.0163) SingleSource/Benchmarks/Misc/flops: 7.47% (8.7232 => 9.3744, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.29% (0.3289 => 0.3463, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.99% (0.7562 => 0.7864, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.78% (0.3040 => 0.3155, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 2.40% (7.1599 => 7.3315, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.39% (1.2406 => 1.2578, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.09% (1.5998 => 1.6173, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/tsp/tsp: 1.08% (1.4769 => 1.4928, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-3: 1.05% (2.0375 => 2.0589, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -4.94% (3.2806 => 3.1186, std.dev.: 0.0581) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -1.74% (42.4562 => 41.7159, std.dev.: 0.2293) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.17% (16.7192 => 16.7471, std.dev.: 0.2105) MultiSource/Applications/obsequi/Obsequi: -0.73% (1.0805 => 1.0726, std.dev.: 0.0053) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.37% (21.6215 => 21.7018, std.dev.: 0.3086) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.30% (0.3654 => 0.3665, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: -1.60% (0.6135 => 0.6037, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.24% (0.3329 => 0.3337, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 0.85% (0.1995 => 0.2012, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.31% (0.0226 => 0.0214, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -18.94% (0.0433 => 0.0351, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0333 => 0.0333, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.26% (0.0318 => 0.0314, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.86% (0.0431 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -3.81% (0.0210 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -2.68% (0.0224 => 0.0218, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 62.50% (0.0008 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.04% (0.1448 => 0.1463, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -5.32% (1.1761 => 1.1135, std.dev.: 0.0372) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.55% (0.1464 => 0.1516, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.30% (0.4114 => 0.3937, std.dev.: 0.0184) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.31% (0.1341 => 0.1310, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.29% (0.0007 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.37% (0.0669 => 0.0613, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.21% (0.0271 => 0.0277, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 6.12% (0.0556 => 0.0590, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.31% (1.1440 => 1.1475, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.31% (0.0651 => 0.0653, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0266 => 0.0266, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.45% (0.8023 => 0.7907, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 74.07% (0.0054 => 0.0094, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2345.74% (0.6332 => 15.4864, std.dev.: 0.2921) MultiSource/Benchmarks/McCat/08-main/main: 49.54% (0.1831 => 0.2738, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.30% (0.1559 => 0.1492, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1481.94% (0.3344 => 5.2900, std.dev.: 0.0340) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.20% (0.2364 => 0.3267, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel: 0.23% (0.0429 => 0.0430, std.dev.: 0.0006) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.79% (0.0224 => 0.0228, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4365, std.dev.: 0.0274) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0678, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4949, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3315, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0264, std.dev.: 0.0573) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3982, std.dev.: 0.0050) SingleSource/Regression/C/uint64_to_float: -23.79% (2.1832 => 1.6639, std.dev.: 0.0026) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 36.62% (14.7684 => 20.1762, std.dev.: 0.0839) SingleSource/UnitTests/SignlessTypes/rem: 14.98% (0.1035 => 0.1190, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.46% (0.0810 => 0.0919, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.37% (0.0830 => 0.0941, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 12.23% (0.1112 => 0.1248, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.01% (0.2180 => 0.2420, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.92% (0.2279 => 0.2505, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.63% (0.8321 => 0.9122, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.26% (0.1425 => 0.1557, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.21% (0.1466 => 0.1601, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.24% (0.1905 => 0.2062, std.dev.: 0.0043) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.03% (0.3137 => 0.3389, std.dev.: 0.0042) MultiSource/Applications/SIBsim4/SIBsim4: 7.73% (1.2568 => 1.3540, std.dev.: 0.0106) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.36% (0.1983 => 0.2129, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/em3d/em3d: 7.21% (0.1721 => 0.1845, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.92% (0.2240 => 0.2395, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.74% (0.1885 => 0.2012, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.63% (1.6386 => 1.7473, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.47% (0.6010 => 0.6399, std.dev.: 0.0110) MultiSource/Applications/viterbi/viterbi: 6.47% (0.1577 => 0.1679, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.35% (13.1811 => 14.0177, std.dev.: 0.1678) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.05% (0.8148 => 0.8641, std.dev.: 0.0120) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.01% (6.6074 => 7.0047, std.dev.: 0.0468) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.90% (0.7473 => 0.7914, std.dev.: 0.0134) MultiSource/Applications/spiff/spiff: 5.84% (0.7950 => 0.8414, std.dev.: 0.0125) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.77% (1.1170 => 1.1814, std.dev.: 0.0224) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.65% (0.6287 => 0.6642, std.dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 5.40% (0.2999 => 0.3161, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: 5.28% (1.2222 => 1.2867, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.27% (0.6227 => 0.6555, std.dev.: 0.0044) MultiSource/Applications/lemon/lemon: 5.24% (1.0945 => 1.1519, std.dev.: 0.0060) MultiSource/Applications/treecc/treecc: 5.15% (1.9948 => 2.0975, std.dev.: 0.0191) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.12% (0.4847 => 0.5095, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.07% (0.3295 => 0.3462, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/18-imp/imp: 5.05% (0.3503 => 0.3680, std.dev.: 0.0021) MultiSource/Applications/hbd/hbd: 5.03% (1.4269 => 1.4987, std.dev.: 0.0136) MultiSource/Benchmarks/McCat/05-eks/eks: 5.00% (0.4397 => 0.4617, std.dev.: 0.0043) MultiSource/Benchmarks/nbench/nbench: 4.89% (1.1271 => 1.1822, std.dev.: 0.0153) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.88% (0.2133 => 0.2237, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.83% (8.6476 => 9.0655, std.dev.: 0.0158) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.78% (0.2741 => 0.2872, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.75% (0.4127 => 0.4323, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.70% (0.2998 => 0.3139, std.dev.: 0.0027) MultiSource/Applications/d/make_dparser: 4.66% (3.2366 => 3.3875, std.dev.: 0.0286) MultiSource/Benchmarks/Olden/bh/bh: 4.59% (0.2985 => 0.3122, std.dev.: 0.0029) MultiSource/Applications/lua/lua: 4.48% (3.8189 => 3.9898, std.dev.: 0.0400) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.46% (1.1606 => 1.2124, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.36% (0.4559 => 0.4758, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 4.35% (14.2605 => 14.8805, std.dev.: 0.1443) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.28% (0.9435 => 0.9839, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.15% (0.8316 => 0.8661, std.dev.: 0.0057) MultiSource/Applications/minisat/minisat: 4.08% (0.6834 => 0.7113, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.98% (0.5961 => 0.6198, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.85% (0.4783 => 0.4967, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/gs/gs: 3.79% (4.1305 => 4.2870, std.dev.: 0.0212) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.71% (0.8007 => 0.8304, std.dev.: 0.0070) MultiSource/Benchmarks/mafft/pairlocalalign: 3.69% (8.6247 => 8.9429, std.dev.: 0.0421) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.66% (0.3003 => 0.3113, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.51% (0.5191 => 0.5373, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.50% (4.1763 => 4.3226, std.dev.: 0.0268) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.49% (1.3279 => 1.3743, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.47% (4.4873 => 4.6428, std.dev.: 0.0454) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.39% (0.5817 => 0.6014, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 3.35% (0.9688 => 1.0013, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/football/football: 3.35% (0.8768 => 0.9062, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.30% (0.8697 => 0.8984, std.dev.: 0.0068) MultiSource/Applications/JM/ldecod/ldecod: 3.12% (6.7320 => 6.9422, std.dev.: 0.0385) MultiSource/Applications/JM/lencod/lencod: 3.05% (15.3280 => 15.7952, std.dev.: 0.0949) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.04% (0.6586 => 0.6786, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 3.03% (0.4125 => 0.4250, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.00% (0.8457 => 0.8711, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.92% (0.9074 => 0.9339, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.92% (1.2602 => 1.2970, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.86% (0.8611 => 0.8857, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.75% (0.8317 => 0.8546, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.75% (0.8331 => 0.8560, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.71% (0.9908 => 1.0177, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.70% (4.5702 => 4.6934, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.69% (0.8177 => 0.8397, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.67% (1.4479 => 1.4866, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.67% (0.8286 => 0.8507, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.66% (0.8597 => 0.8826, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.65% (0.7966 => 0.8177, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.61% (0.8518 => 0.8740, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.60% (0.8340 => 0.8557, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.60% (0.8204 => 0.8417, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.57% (0.8855 => 0.9083, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.57% (0.9056 => 0.9289, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.55% (0.8338 => 0.8551, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.53% (0.8050 => 0.8254, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.51% (1.2526 => 1.2841, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.49% (0.8086 => 0.8287, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.43% (0.8420 => 0.8625, std.dev.: 0.0068) MultiSource/Applications/lambda-0_1_3/lambda: 2.42% (0.7557 => 0.7740, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 2.38% (31.8598 => 32.6190, std.dev.: 0.1487) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.29% (2.1401 => 2.1892, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.12% (3.1832 => 3.2507, std.dev.: 0.0132) MultiSource/Benchmarks/PAQ8p/paq8p: 2.06% (2.3764 => 2.4253, std.dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 56.75% (1.5795 => 2.4759, std.dev.: 0.0163) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.21% (2.4333 => 2.6575, std.dev.: 0.0459) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.69% (0.3186 => 0.3463, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.57% (1.1857 => 1.2873, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 5.98% (63.1822 => 66.9613, std.dev.: 0.0663) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.67% (0.2887 => 0.2993, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.51% (0.7597 => 0.7864, std.dev.: 0.0047) MultiSource/Applications/siod/siod: 3.08% (3.6643 => 3.7773, std.dev.: 0.0115) MultiSource/Benchmarks/Bullet/bullet: 3.00% (7.1181 => 7.3315, std.dev.: 0.0112) MultiSource/Benchmarks/Olden/bh/bh: 2.10% (2.3560 => 2.4055, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/ReedSolomon: 1.84% (8.5322 => 8.6894, std.dev.: 0.0553) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.46% (1.5941 => 1.6173, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.02% (4.8362 => 4.8853, std.dev.: 0.0081) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.47% (0.3269 => 0.2992, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/heapsort: -5.28% (3.2926 => 3.1186, std.dev.: 0.0581) MultiSource/Applications/lua/lua: -5.03% (29.8330 => 28.3335, std.dev.: 0.1844) SingleSource/Benchmarks/Shootout-C++/hash2: -1.52% (3.4237 => 3.3717, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.27% (3.3479 => 3.3054, std.dev.: 0.0012) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.83% (16.4461 => 16.7471, std.dev.: 0.2105) MultiSource/Applications/obsequi/Obsequi: 4.52% (1.0262 => 1.0726, std.dev.: 0.0053) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6849.02% (0.3123 => 21.7018, std.dev.: 0.3086) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.80% (0.2463 => 0.3665, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 0.45% (0.6010 => 0.6037, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.17% (0.3266 => 0.3337, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 2.18% (0.1969 => 0.2012, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 73.98% (0.0123 => 0.0214, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -13.97% (0.0408 => 0.0351, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.74% (0.1438 => 0.1463, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.71% (1.1329 => 1.1135, std.dev.: 0.0372) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.69% (0.1462 => 0.1516, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.45% (0.4164 => 0.3937, std.dev.: 0.0184) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.31% (0.1369 => 0.1310, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.37% (0.0641 => 0.0613, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.08% (0.0578 => 0.0590, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.33% (1.1437 => 1.1475, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.15% (0.0627 => 0.0653, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.78% (0.0180 => 0.0266, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.37% (0.8017 => 0.7907, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 51.61% (0.0062 => 0.0094, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 29 14:57:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 16:57:59 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121029215759.8C3622A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5379?compare_to=5375&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5379, Order: 166960, Start Time: 2012-10-29 20:26:55, End Time: 2012-10-29 21:57:58 To: 5375, Order: 166943, Start Time: 2012-10-29 18:26:12, End Time: 2012-10-29 19:57:16 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (9 on baseline) New Passes: 0 (15 on baseline) Performance Regressions: 1 (172 on baseline) Performance Improvements: 0 (48 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 13 (4 on baseline) Unchanged Tests: 1028 (660 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.42% (9.9226 => 10.0639, std.dev.: 0.0025) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -0.03% (1.9764 => 1.9759, std.dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: -0.52% (57.3658 => 57.0689, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.13% (0.0789 => 0.0790) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -0.01% (8.9605 => 8.9597, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.44% (7.6482 => 7.6144, std.dev.: 0.0112) SingleSource/UnitTests/Vector/SSE/sse_shift: -0.19% (0.0519 => 0.0518, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: - (0.0001 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.31% (0.0651 => 0.0649, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/SSE/sse_shift: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -65.69% (5.7591 => 1.9759, std.dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: -9.76% (63.2438 => 57.0689, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.82% (6.6874 => 0.0790) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.12% (8.1363 => 8.9597, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_shift: 37.04% (0.0378 => 0.0518, std.dev.: 0.0002) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -50.00% (0.0002 => 0.0001) SingleSource/UnitTests/Vector/SSE/sse_shift: -50.00% (0.0002 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 197.80% (0.5229 => 1.5572, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 12.92% (14.9895 => 16.9266, std.dev.: 0.0142) MultiSource/Applications/kimwitu++/kc: 35.72% (14.1553 => 19.2116, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/gs/gs: 12.24% (4.1105 => 4.6137, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 28.83% (1.1048 => 1.4233, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.64% (3.4629 => 5.7706, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_container: 63.02% (0.6222 => 1.0143, std.dev.: 0.0051) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10540.56% (0.0720 => 7.6612, std.dev.: 0.0079) MultiSource/Applications/SIBsim4/SIBsim4: 3837300.00% (0.0001 => 3.8374, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 11175700.00% (0.0001 => 11.1758, std.dev.: 0.0231) MultiSource/Applications/kimwitu++/kc: 50600.00% (0.0001 => 0.0507, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049500.00% (0.0001 => 10.0496, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5489700.00% (0.0001 => 5.4898, std.dev.: 0.0022) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 38.64% (0.1056 => 0.1464, std.dev.: 0.0009) SingleSource/UnitTests/vla: 29.01% (0.0355 => 0.0458, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 28.84% (0.1432 => 0.1845, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 19.86% (0.1566 => 0.1877, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: 17.16% (0.0746 => 0.0874, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 17.12% (0.0730 => 0.0855, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/rem: 17.05% (0.1144 => 0.1339, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 16.78% (0.3177 => 0.3710, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.65% (0.0871 => 0.1016, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 16.51% (0.1175 => 0.1369, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.39% (0.0793 => 0.0923, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 16.25% (0.4879 => 0.5672, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.05% (0.8172 => 0.9484, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/08-main/main: 15.86% (0.2554 => 0.2959, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 15.28% (0.1584 => 0.1826, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.73% (0.0842 => 0.0966, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 14.63% (0.1695 => 0.1943, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/mst/mst: 14.45% (0.1163 => 0.1331, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 14.14% (0.1655 => 0.1889, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.09% (0.2065 => 0.2356, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.03% (0.0834 => 0.0951, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.88% (0.0886 => 0.1009, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.81% (0.2700 => 0.3073, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 13.77% (0.7115 => 0.8095, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.61% (0.1117 => 0.1269, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.56% (0.2758 => 0.3132, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.51% (0.0770 => 0.0874, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 13.51% (0.1940 => 0.2202, std.dev.: 0.0016) MultiSource/Applications/aha/aha: 13.47% (0.1151 => 0.1306, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 13.44% (0.5105 => 0.5791, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 13.38% (0.1555 => 0.1763, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.25% (0.1510 => 0.1710, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.24% (0.1337 => 0.1514, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 13.03% (0.3109 => 0.3514, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.99% (0.5981 => 0.6758, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.90% (0.6675 => 0.7536, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 12.89% (0.1125 => 0.1270, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.85% (0.3121 => 0.3522, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.83% (0.1029 => 0.1161, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 12.81% (3.3354 => 3.7627, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.81% (0.1062 => 0.1198, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.78% (0.0798 => 0.0900, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.77% (0.2271 => 0.2561, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.77% (0.2107 => 0.2376, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 12.70% (1.1642 => 1.3121, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.68% (0.4615 => 0.5200, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 12.66% (0.7835 => 0.8827, std.dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 12.63% (0.7433 => 0.8372, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.61% (0.5860 => 0.6599, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.47% (0.9765 => 1.0983, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/exptree: 12.41% (0.0814 => 0.0915, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.17% (0.5020 => 0.5631, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.16% (1.5415 => 1.7290, std.dev.: 0.0021) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.07% (0.1143 => 0.1281, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 12.04% (22.1758 => 24.8447, std.dev.: 0.0148) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.02% (0.2603 => 0.2916, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.99% (0.5569 => 0.6237, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.94% (1.3050 => 1.4608, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.92% (0.1032 => 0.1155, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.91% (0.3543 => 0.3965, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 11.75% (0.1268 => 0.1417, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 11.72% (2.0273 => 2.2649, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.65% (0.1236 => 0.1380, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 11.56% (1.0722 => 1.1961, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.52% (0.6450 => 0.7193, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 11.51% (0.3423 => 0.3817, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.37% (1.1861 => 1.3210, std.dev.: 0.0072) MultiSource/Applications/lua/lua: 11.32% (3.8723 => 4.3106, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.30% (0.3441 => 0.3830, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.28% (0.3927 => 0.4370, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.26% (0.3473 => 0.3864, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 11.21% (0.4299 => 0.4781, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.20% (0.1625 => 0.1807, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.13% (0.3307 => 0.3675, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.07% (0.3497 => 0.3884, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.04% (0.3543 => 0.3934, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.01% (0.3516 => 0.3903, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.98% (0.3561 => 0.3952, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.89% (0.3828 => 0.4245, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 10.87% (0.8921 => 0.9891, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.87% (0.0929 => 0.1030, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.81% (4.2646 => 4.7254, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/for-in: 10.80% (0.3694 => 0.4093, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.65% (0.1906 => 0.2109, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.63% (2.2022 => 2.4362, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/neural/neural: 10.53% (0.1463 => 0.1617, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.52% (0.3886 => 0.4295, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 10.50% (9.4845 => 10.4801, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 10.44% (0.3180 => 0.3512, std.dev.: 0.0015) MultiSource/Benchmarks/sim/sim: 10.19% (0.3387 => 0.3732, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 10.17% (1.1840 => 1.3044, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.15% (0.1695 => 0.1867, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 10.05% (0.4289 => 0.4720, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.99% (1.5859 => 1.7444, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 9.96% (0.1044 => 0.1148, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.79% (0.8101 => 0.8894, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.49% (2.2024 => 2.4113, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 9.48% (0.6456 => 0.7068, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 9.47% (0.3422 => 0.3746, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 9.43% (2.2969 => 2.5136, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 9.39% (0.4620 => 0.5054, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.23% (1.4186 => 1.5495, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.20% (14.3668 => 15.6889, std.dev.: 0.0195) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.18% (0.3865 => 0.4220, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.15% (0.4636 => 0.5060, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.09% (0.1892 => 0.2064, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.09% (0.4203 => 0.4585, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 9.01% (0.7326 => 0.7986, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 8.98% (0.5925 => 0.6457, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.84% (0.6030 => 0.6563, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 8.83% (0.1268 => 0.1380, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.82% (0.4103 => 0.4465, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.80% (0.1330 => 0.1447, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.58% (5.0018 => 5.4308, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.53% (4.9449 => 5.3666, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/moments: 8.50% (0.4048 => 0.4392, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 8.47% (0.3684 => 0.3996, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 8.35% (0.3603 => 0.3904, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 8.30% (1.5603 => 1.6898, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.05% (0.3650 => 0.3944, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.88% (0.2793 => 0.3013, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.78% (0.2891 => 0.3116, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 7.78% (0.2905 => 0.3131, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.74% (0.2430 => 0.2618, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 7.67% (0.2831 => 0.3048, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.55% (2.0665 => 2.2225, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.50% (0.3826 => 0.4113, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/except: 7.49% (0.2871 => 0.3086, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 7.46% (0.3098 => 0.3329, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.40% (0.3162 => 0.3396, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 7.39% (0.3232 => 0.3471, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 7.38% (0.2725 => 0.2926, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 7.37% (0.3283 => 0.3525, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/wc: 7.31% (0.3052 => 0.3275, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.27% (0.3427 => 0.3676, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.26% (0.4064 => 0.4359, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.26% (0.2756 => 0.2956, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 7.24% (17.1811 => 18.4254, std.dev.: 0.0194) SingleSource/Benchmarks/Shootout-C++/random: 7.21% (0.2802 => 0.3004, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.21% (0.2872 => 0.3079, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 7.15% (0.2714 => 0.2908, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 6.60% (0.3379 => 0.3602, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 6.33% (1.2842 => 1.3655, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 5.94% (0.3282 => 0.3477, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.80% (0.3136 => 0.3318, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 5.72% (0.3092 => 0.3269, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.45% (0.8067 => 0.8507, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.41% (3.8922 => 4.1028, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/objinst: 5.11% (0.3131 => 0.3291, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.03% (0.2266 => 0.2380, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.51% (0.3817 => 0.3951, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.13% (0.3935 => 0.4058, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.21% (7.9617 => 8.1378, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.66% (7.0540 => 7.1714, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.50% (1.1145 => 1.2984, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.38% (0.2944 => 0.3279, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2172, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.75% (1.1396 => 1.2507, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3681, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.69% (4.2280 => 4.3417, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.34% (1.7254 => 1.7658, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.78% (0.8333 => 0.8481, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2075, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.31% (11.6436 => 11.7956, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.10% (6.5088 => 6.5801, std.dev.: 0.0052) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -77.09% (0.8651 => 0.1982, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.60% (5.3855 => 2.3911, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -55.30% (5.3526 => 2.3928, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -45.81% (0.1622 => 0.0879, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.32% (1.1194 => 0.6793, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.98% (5.2763 => 3.2721, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -23.70% (1.7609 => 1.3436, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -17.17% (2.9384 => 2.4340, std.dev.: 0.0163) MultiSource/Applications/JM/ldecod/ldecod: -10.50% (10.4361 => 9.3404, std.dev.: 0.0073) SingleSource/UnitTests/Vector/constpool: -9.12% (54.1659 => 49.2250, std.dev.: 0.0404) MultiSource/Benchmarks/PAQ8p/paq8p: -2.93% (10.3673 => 10.0639, std.dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: -2.17% (21.9371 => 21.4608, std.dev.: 0.0166) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.99% (0.0506 => 0.0334) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -33.68% (0.3987 => 0.2644, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel: -33.47% (1.1492 => 0.7646, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4243, std.dev.: 0.0038) MultiSource/Benchmarks/NPB-serial/is/is: -10.97% (9.5636 => 8.5144, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: -10.94% (1.5373 => 1.3691, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.28% (19.9488 => 18.2965, std.dev.: 0.0276) MultiSource/Benchmarks/FreeBench/mason/mason: -7.77% (0.2161 => 0.1993, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.09% (1.8329 => 1.7030, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -6.72% (1.2373 => 1.1541, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5753, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0148) SingleSource/Benchmarks/Misc/oourafft: -5.45% (6.6465 => 6.2840, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.09% (1.6805 => 1.5949, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7614) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5072, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.47% (0.9957 => 0.9512, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.08% (0.2497 => 0.2395, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.72% (3.2827 => 3.1605, std.dev.: 0.0139) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.47% (32.5116 => 31.3836, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: -3.23% (5.0483 => 4.8850, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.87% (4.5009 => 4.3719, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: -2.73% (4.6441 => 4.5173, std.dev.: 0.0087) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.68% (0.4808 => 0.4679, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.89% (8.1563 => 8.0020, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6826, std.dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.66% (2.5528 => 2.5105, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -1.58% (10.2830 => 10.1207, std.dev.: 0.0079) MultiSource/Benchmarks/PAQ8p/paq8p: -1.21% (85.0658 => 84.0385, std.dev.: 0.0114) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -1.01% (1.1277 => 1.1163, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.37% (7.1582 => 7.6144, std.dev.: 0.0112) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 2.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 29 15:24:57 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 17:24:57 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121029222457.252552A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5380?compare_to=5377&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5380, Order: 166961, Start Time: 2012-10-29 20:59:37, End Time: 2012-10-29 22:24:54 To: 5377, Order: 166958, Start Time: 2012-10-29 19:11:21, End Time: 2012-10-29 20:36:42 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 0 (175 on baseline) Unchanged Tests: 1041 (861 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.78% (55.0399 => 56.5694, std.dev.: 0.0440) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 19.91% (15.2527 => 18.2895, std.dev.: 0.0173) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.65% (54.5751 => 56.5694, std.dev.: 0.0440) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.57% (2.0478 => 2.1005, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/salsa20: 2.31% (7.4937 => 7.6669, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/hash2: 2.25% (3.1932 => 3.2652, std.dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.01% (0.1431 => 0.1302, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.33% (0.1584 => 0.1452, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -7.95% (0.3848 => 0.3542, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.88% (0.3884 => 0.3578, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -7.87% (0.3812 => 0.3512, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -7.86% (0.3880 => 0.3575, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -7.86% (0.3831 => 0.3530, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -7.80% (0.3896 => 0.3592, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.74% (0.3891 => 0.3590, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -7.71% (0.4033 => 0.3722, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -7.61% (0.4176 => 0.3858, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -7.38% (0.4199 => 0.3889, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -7.20% (0.4280 => 0.3972, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.04% (0.3821 => 0.3552, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.81% (0.3142 => 0.2928, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.61% (2.4924 => 2.3277, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: -6.54% (0.3026 => 0.2828, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -6.49% (0.2989 => 0.2795, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.47% (0.2428 => 0.2271, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: -6.36% (0.2939 => 0.2752, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.35% (0.3025 => 0.2833, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -6.33% (0.3016 => 0.2825, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.30% (0.2903 => 0.2720, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -6.28% (0.2849 => 0.2670, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.28% (0.3057 => 0.2865, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -6.28% (0.1879 => 0.1761, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.26% (0.3658 => 0.3429, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wc: -6.24% (0.3205 => 0.3005, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -6.23% (0.2871 => 0.2692, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -6.21% (0.3255 => 0.3053, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -6.21% (0.3481 => 0.3265, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.17% (0.4083 => 0.3831, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.15% (2.1713 => 2.0378, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/objinst: -6.14% (0.3194 => 0.2998, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.12% (22.4056 => 21.0338, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.12% (4.5069 => 4.2313, std.dev.: 0.0119) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.11% (0.2355 => 0.2211, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.11% (0.4813 => 0.4519, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.08% (0.3849 => 0.3615, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.08% (0.6484 => 0.6090, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists: -6.08% (0.3621 => 0.3401, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: -6.05% (1.3148 => 1.2352, std.dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: -6.05% (0.3059 => 0.2874, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -6.05% (0.3788 => 0.3559, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -6.04% (0.3394 => 0.3189, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: -6.04% (0.3446 => 0.3238, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.03% (0.3252 => 0.3056, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.02% (0.4151 => 0.3901, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -6.02% (0.2160 => 0.2030, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.99% (0.3837 => 0.3607, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -5.90% (0.3357 => 0.3159, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.87% (0.9542 => 0.8982, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -5.84% (0.3867 => 0.3641, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.83% (0.1716 => 0.1616, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.82% (4.8802 => 4.5963, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.82% (0.9852 => 0.9279, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -5.81% (0.4248 => 0.4001, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -5.80% (0.6347 => 0.5979, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.79% (0.8521 => 0.8028, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: -5.78% (7.0961 => 6.6862, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.76% (4.8161 => 4.5386, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.76% (0.4427 => 0.4172, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.76% (5.4682 => 5.1533, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.75% (1.2221 => 1.1518, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.73% (0.5999 => 0.5655, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: -5.72% (0.4861 => 0.4583, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: -5.72% (0.2659 => 0.2507, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: -5.70% (1.2515 => 1.1802, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.70% (0.7198 => 0.6788, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: -5.69% (16.1920 => 15.2703, std.dev.: 0.0064) SingleSource/UnitTests/ObjC++/property-reference: -5.67% (0.7779 => 0.7338, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: -5.67% (0.6441 => 0.6076, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.66% (3.5339 => 3.3338, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/bigfib: -5.59% (0.6750 => 0.6373, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.58% (4.0323 => 3.8073, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.57% (1.2210 => 1.1530, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: -5.56% (4.3330 => 4.0919, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.54% (1.0544 => 0.9960, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.53% (1.6474 => 1.5563, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.52% (0.2933 => 0.2771, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.42% (1.2784 => 1.2091, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.42% (0.2548 => 0.2410, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.39% (0.4321 => 0.4088, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.36% (0.2278 => 0.2156, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.30% (0.7919 => 0.7499, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.24% (0.3491 => 0.3308, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -5.23% (0.2985 => 0.2829, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.17% (0.2999 => 0.2844, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -5.15% (2.4021 => 2.2784, std.dev.: 0.0068) MultiSource/Benchmarks/mafft/pairlocalalign: -5.13% (9.2283 => 8.7550, std.dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: -5.13% (34.0927 => 32.3450, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.07% (0.6293 => 0.5974, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.06% (0.3931 => 0.3732, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.04% (1.4642 => 1.3904, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.04% (1.3722 => 1.3031, std.dev.: 0.0014) MultiSource/Applications/lua/lua: -5.02% (4.0594 => 3.8556, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash: -5.02% (0.4524 => 0.4297, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -4.99% (1.6364 => 1.5548, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.93% (0.6304 => 0.5993, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.91% (0.3319 => 0.3156, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.90% (2.2587 => 2.1481, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.89% (0.5805 => 0.5521, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.86% (0.5859 => 0.5574, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.86% (0.2385 => 0.2269, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -4.86% (18.2933 => 17.4051, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.84% (0.5478 => 0.5213, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.83% (0.5863 => 0.5580, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.80% (0.9557 => 0.9098, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.79% (0.5925 => 0.5641, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.77% (0.5705 => 0.5433, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.76% (0.6052 => 0.5764, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.74% (0.5575 => 0.5311, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.71% (0.5581 => 0.5318, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.70% (0.4916 => 0.4685, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -4.70% (0.4515 => 0.4303, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.69% (0.5569 => 0.5308, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.68% (0.7524 => 0.7172, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.67% (0.6676 => 0.6364, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.65% (0.5591 => 0.5331, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.65% (0.5570 => 0.5311, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.64% (0.6660 => 0.6351, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.64% (0.5802 => 0.5533, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.63% (0.6395 => 0.6099, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.61% (0.6681 => 0.6373, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -4.60% (0.7982 => 0.7615, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.59% (0.5857 => 0.5588, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: -4.58% (0.3581 => 0.3417, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.55% (0.6446 => 0.6153, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.53% (0.6230 => 0.5948, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.53% (0.6297 => 0.6012, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.52% (0.5688 => 0.5431, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.49% (0.5567 => 0.5317, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.46% (0.6194 => 0.5918, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.44% (0.5941 => 0.5677, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.44% (0.6189 => 0.5914, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.44% (0.6260 => 0.5982, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.42% (0.6667 => 0.6372, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: -4.42% (0.7447 => 0.7118, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.42% (0.5456 => 0.5215, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: -4.39% (0.9179 => 0.8776, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: -4.35% (0.3406 => 0.3258, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.34% (8.0126 => 7.6651, std.dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.31% (6.7716 => 6.4795, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.30% (0.6440 => 0.6163, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.27% (0.9077 => 0.8689, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.26% (0.6033 => 0.5776, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.25% (0.6395 => 0.6123, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: -4.13% (0.3271 => 0.3136, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: -4.12% (0.8418 => 0.8071, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: -4.12% (15.5079 => 14.8693, std.dev.: 0.0037) MultiSource/Applications/lemon/lemon: -4.08% (1.1450 => 1.0983, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.00% (0.7021 => 0.6740, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.99% (0.6736 => 0.6467, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: -3.93% (2.1401 => 2.0559, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.90% (0.3483 => 0.3347, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -3.83% (1.5610 => 1.5012, std.dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: -3.76% (5.0226 => 4.8339, std.dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: -3.74% (17.1032 => 16.4630, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.68% (0.5168 => 0.4978, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: -3.65% (3.5154 => 3.3870, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.62% (1.2300 => 1.1855, std.dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: -3.48% (1.1530 => 1.1129, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.47% (0.5329 => 0.5144, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.20% (14.2083 => 13.7538, std.dev.: 0.0099) SingleSource/UnitTests/Vector/constpool: -1.98% (20.7746 => 20.3626, std.dev.: 0.0513) MultiSource/Applications/SIBsim4/SIBsim4: -1.64% (1.3864 => 1.3637, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7537, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/richards_benchmark: -8.62% (1.2842 => 1.1735, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: -3.96% (2.2633 => 2.1736, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7067, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.77% (1.3096 => 1.2864, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4717, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0004) Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 29 16:08:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 18:08:02 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121029230802.EFB082A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5381?compare_to=5374&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5381, Order: 166958, Start Time: 2012-10-29 19:51:33, End Time: 2012-10-29 23:08:01 To: 5374, Order: 166926, Start Time: 2012-10-29 15:47:52, End Time: 2012-10-29 19:03:10 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (171 on baseline) Performance Improvements: 2 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1038 (719 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.87% (124.3615 => 131.6596, std.dev.: 0.3302) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.24% (54.2106 => 54.8814, std.dev.: 0.0493) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.18% (2.3950 => 2.3667, std.dev.: 0.0060) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/ObjC/synchronized: -12.06% (0.1194 => 0.1050, std.dev.: 0.0002) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 39.52% (0.0625 => 0.0872, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.95% (0.1063 => 0.1392, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.09% (0.2969 => 0.3714, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 24.23% (0.1106 => 0.1374, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 23.70% (0.4139 => 0.5120, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 23.69% (1.5932 => 1.9707, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.67% (0.0714 => 0.0883, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.40% (0.0547 => 0.0675, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.01% (0.4994 => 0.6143, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 22.95% (0.4253 => 0.5229, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.85% (0.5900 => 0.7248, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.62% (0.5000 => 0.6131, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.32% (0.0475 => 0.0581, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.26% (0.0584 => 0.0714, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.29% (0.0897 => 0.1088, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.11% (0.1620 => 0.1962, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 20.76% (0.1021 => 0.1233, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 20.70% (0.0599 => 0.0723, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 20.42% (0.1107 => 0.1333, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.27% (0.1549 => 0.1863, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 20.04% (0.0948 => 0.1138, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/04-bisect/bisect: 19.75% (0.0633 => 0.0758, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.67% (0.1103 => 0.1320, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.52% (0.0584 => 0.0698, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.41% (0.0541 => 0.0646, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 19.37% (0.0604 => 0.0721, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.34% (0.1003 => 0.1197, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.32% (0.3903 => 0.4657, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.31% (0.0642 => 0.0766, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: 19.24% (0.0821 => 0.0979, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 19.21% (0.1619 => 0.1930, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.08% (0.1604 => 0.1910, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 19.07% (0.0582 => 0.0693, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.86% (0.0822 => 0.0977, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 18.06% (0.0947 => 0.1118, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 17.99% (0.1462 => 0.1725, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.76% (0.3890 => 0.4581, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 17.70% (0.0808 => 0.0951, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.68% (0.2014 => 0.2370, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 17.37% (0.4029 => 0.4729, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 17.32% (0.1218 => 0.1429, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.10% (0.2866 => 0.3356, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.10% (0.1088 => 0.1274, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 17.08% (0.1505 => 0.1762, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 17.05% (0.0698 => 0.0817, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.01% (1.3152 => 1.5389, std.dev.: 0.0025) MultiSource/Applications/Burg/burg: 16.79% (0.5546 => 0.6477, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 16.74% (0.2736 => 0.3194, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 16.60% (1.8794 => 2.1913, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: 16.58% (0.5826 => 0.6792, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 16.39% (0.5889 => 0.6854, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 16.24% (0.9697 => 1.1272, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.16% (0.1968 => 0.2286, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.14% (0.3271 => 0.3799, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.10% (3.5627 => 4.1362, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 15.84% (0.4658 => 0.5396, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.78% (0.1160 => 0.1343, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 15.72% (1.6211 => 1.8760, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.69% (0.2875 => 0.3326, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.60% (0.5026 => 0.5810, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 15.48% (0.1421 => 0.1641, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 15.37% (1.0781 => 1.2438, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.32% (0.3930 => 0.4532, std.dev.: 0.0043) SingleSource/Regression/C++/ofstream_ctor: 15.31% (0.3004 => 0.3464, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.27% (0.2738 => 0.3156, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/fibo: 15.01% (0.2725 => 0.3134, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 15.00% (0.2714 => 0.3121, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 14.95% (0.4361 => 0.5013, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 14.92% (0.9909 => 1.1387, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: 14.88% (0.1284 => 0.1475, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/nestedloop: 14.84% (0.2729 => 0.3134, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.84% (0.2911 => 0.3343, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 14.82% (0.2780 => 0.3192, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 14.81% (23.5202 => 27.0039, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/random: 14.81% (0.2803 => 0.3218, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 14.80% (0.2750 => 0.3157, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 14.77% (4.2109 => 4.8327, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/except: 14.76% (0.2811 => 0.3226, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.69% (1.9694 => 2.2588, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/objinst: 14.67% (0.2823 => 0.3237, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/methcall: 14.65% (0.2813 => 0.3225, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 14.63% (4.4195 => 5.0659, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.62% (0.3195 => 0.3662, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.61% (2.7292 => 3.1280, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.58% (0.2792 => 0.3199, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 14.53% (0.3096 => 0.3546, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.48% (2.0673 => 2.3667, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.43% (1.9966 => 2.2848, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/property-reference: 14.43% (0.7171 => 0.8206, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary3: 14.14% (0.3267 => 0.3729, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.13% (0.1090 => 0.1244, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.08% (0.3060 => 0.3491, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 13.99% (0.3317 => 0.3781, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.92% (0.3362 => 0.3830, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 13.90% (0.3258 => 0.3711, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.54% (0.3124 => 0.3547, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/moments: 13.46% (0.3678 => 0.4173, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 13.45% (0.2566 => 0.2911, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/football/football: 13.40% (0.2075 => 0.2353, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 13.39% (0.3465 => 0.3929, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 13.38% (0.3348 => 0.3796, std.dev.: 0.0019) MultiSource/Applications/lua/lua: 13.37% (1.4269 => 1.6177, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/sieve: 13.34% (0.3726 => 0.4223, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 13.29% (0.3446 => 0.3904, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.28% (0.3282 => 0.3718, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.27% (0.3488 => 0.3951, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/for-in: 13.27% (0.3496 => 0.3960, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 13.26% (0.3469 => 0.3929, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 13.25% (0.3442 => 0.3898, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 13.24% (0.3460 => 0.3918, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 13.23% (0.3477 => 0.3937, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.19% (0.3625 => 0.4103, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash2: 13.10% (0.4251 => 0.4808, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.06% (0.3690 => 0.4172, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/property: 13.01% (0.3650 => 0.4125, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 12.95% (0.4146 => 0.4683, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.91% (0.3981 => 0.4495, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 12.82% (0.3643 => 0.4110, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.78% (0.3724 => 0.4200, std.dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.67% (0.3845 => 0.4332, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 12.65% (0.7875 => 0.8871, std.dev.: 0.0039) MultiSource/Applications/JM/ldecod/ldecod: 12.59% (2.1653 => 2.4380, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/bigfib: 12.39% (0.5012 => 0.5633, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 12.29% (4.6177 => 5.1850, std.dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 11.86% (2.1013 => 2.3506, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.48% (0.1028 => 0.1146, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.47% (0.2040 => 0.2274, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 11.26% (0.2691 => 0.2994, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.25% (0.6435 => 0.7159, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.22% (0.2068 => 0.2300) MultiSource/Applications/SPASS/SPASS: 11.08% (5.5417 => 6.1559, std.dev.: 0.0067) MultiSource/Applications/minisat/minisat: 10.88% (0.3336 => 0.3699, std.dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: 10.78% (0.3498 => 0.3875, std.dev.: 0.0021) MultiSource/Applications/siod/siod: 10.54% (0.6634 => 0.7333, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.34% (0.2737 => 0.3020, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.05% (0.3084 => 0.3394, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.98% (0.1383 => 0.1521, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 9.94% (0.4847 => 0.5329, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.61% (0.2103 => 0.2305, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.36% (4.6926 => 5.1316, std.dev.: 0.0408) MultiSource/Applications/sqlite3/sqlite3: 8.90% (2.0346 => 2.2157, std.dev.: 0.0077) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.78% (11.6398 => 12.6621, std.dev.: 0.0128) MultiSource/Applications/lemon/lemon: 8.49% (0.2391 => 0.2594, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.23% (0.5361 => 0.5802, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.85% (0.7426 => 0.8009, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.79% (0.5584 => 0.6019, std.dev.: 0.0059) MultiSource/Applications/kimwitu++/kc: 6.41% (11.9555 => 12.7214, std.dev.: 0.0126) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.90% (0.3792 => 0.3940, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6533, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0300, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6111, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.56% (0.2122 => 0.2240, std.dev.: 0.0031) MultiSource/Applications/ClamAV/clamscan: 5.50% (0.2802 => 0.2956, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.23% (0.3693 => 0.3886, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 5.08% (12.0509 => 12.6628, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops: 4.76% (15.4430 => 16.1788, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-2: 4.08% (1.8057 => 1.8793, std.dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/dry: 2.73% (14.0481 => 14.4310, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/ary3: 2.09% (15.8721 => 16.2040, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.70% (3.1722 => 3.2262, std.dev.: 0.0043) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3059, std.dev.: 0.0183) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2838, std.dev.: 0.0048) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/five11/five11: 1.20% (8.4155 => 8.5167, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5977, std.dev.: 0.0217) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.75% (2.4764 => 2.4330, std.dev.: 0.0137) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.49% (25.4195 => 16.3988, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary2: -11.07% (0.2402 => 0.2136, std.dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9767, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7734, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/tsp/tsp: -7.19% (2.1113 => 1.9595, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.43% (11.2080 => 10.8234, std.dev.: 0.0485) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std.dev.: 0.0051) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7747, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5218, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -2.45% (17.2379 => 16.8158, std.dev.: 0.0282) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.22% (41.7953 => 40.8683, std.dev.: 0.0127) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5701, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4955, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.33% (5.7935 => 5.7164, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0432, std.dev.: 0.0030) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.03% (3.3991 => 3.3640, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 29 16:31:59 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 18:31:59 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121029233159.D38EC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5382?compare_to=5378&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5382, Order: 166968, Start Time: 2012-10-29 22:03:37, End Time: 2012-10-29 23:32:00 To: 5378, Order: 166961, Start Time: 2012-10-29 20:18:57, End Time: 2012-10-29 21:46:33 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 2 (99 on baseline) Performance Improvements: 3 (5 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 986 (870 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.13% (60.0095 => 61.2873, std.dev.: 0.1957) SingleSource/Benchmarks/Shootout/ary3: 1.63% (2.0939 => 2.1281, std.dev.: 0.0094) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/18-imp/imp: -3.29% (0.3680 => 0.3559, std.dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Bullet/bullet: -1.93% (7.3315 => 7.1899, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -1.38% (6.4933 => 6.4038, std.dev.: 0.0218) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.33% (16.7471 => 16.6919, std.dev.: 0.2195) MultiSource/Applications/obsequi/Obsequi: 0.21% (1.0726 => 1.0749, std.dev.: 0.0060) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.93% (21.7018 => 22.1208, std.dev.: 0.1541) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.30% (0.3665 => 0.3676, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/bigfib: 0.10% (0.6037 => 0.6043, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.06% (0.3337 => 0.3335, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: -0.20% (0.2012 => 0.2008, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 4.67% (0.0214 => 0.0224, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 21.08% (0.0351 => 0.0425, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.60% (0.0333 => 0.0331, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.27% (0.0314 => 0.0318, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.24% (0.0423 => 0.0424, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 1.49% (0.0202 => 0.0205, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0218 => 0.0218, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -1.23% (0.1463 => 0.1445, std.dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 5.61% (1.1135 => 1.1760, std.dev.: 0.0052) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.26% (0.1516 => 0.1520, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 10.21% (0.3937 => 0.4339, std.dev.: 0.1682) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.53% (0.1310 => 0.1317, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.65% (0.0613 => 0.0617, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0277 => 0.0277, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.41% (0.0590 => 0.0564, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.41% (1.1475 => 1.1428, std.dev.: 0.0137) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -32.26% (0.0031 => 0.0021, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.83% (0.0653 => 0.0628, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.50% (0.0266 => 0.0262, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.34% (0.7907 => 0.7934, std.dev.: 0.0086) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -40.43% (0.0094 => 0.0056, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2340.33% (0.6332 => 15.4522, std.dev.: 0.1470) MultiSource/Benchmarks/McCat/08-main/main: 48.77% (0.1831 => 0.2724, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.54% (0.1559 => 0.1457, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1479.67% (0.3344 => 5.2824, std.dev.: 0.1938) SingleSource/Benchmarks/Misc-C++/Large/ray: 35.28% (0.2364 => 0.3198, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/mandel: 1.17% (0.0429 => 0.0434, std.dev.: 0.0026) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.25% (0.0224 => 0.0238, std.dev.: 0.0032) SingleSource/UnitTests/byval-alignment: -29.13% (0.0230 => 0.0163, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4369, std.dev.: 0.0318) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0731, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4903, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3448, std.dev.: 0.0173) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0302, std.dev.: 0.0121) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4093, std.dev.: 0.0173) SingleSource/Regression/C/uint64_to_float: -24.07% (2.1832 => 1.6578, std.dev.: 0.0044) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 36.54% (14.7684 => 20.1644, std.dev.: 0.0742) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.32% (0.0810 => 0.0926, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: 10.52% (0.1112 => 0.1229, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.81% (0.2180 => 0.2372, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/04-bisect/bisect: 8.80% (0.1137 => 0.1237, std.dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: 8.27% (1.2568 => 1.3607, std.dev.: 0.0102) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.43% (0.3137 => 0.3370, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.09% (0.1425 => 0.1526, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.26% (0.1885 => 0.2003, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.12% (13.1811 => 13.9881, std.dev.: 0.0699) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.10% (0.2279 => 0.2418, std.dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.02% (6.6074 => 7.0053, std.dev.: 0.0318) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.90% (0.1983 => 0.2100, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: 5.84% (0.7950 => 0.8414, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.72% (0.1905 => 0.2014, std.dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 5.68% (1.1271 => 1.1911, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.65% (0.4847 => 0.5121, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.61% (0.6010 => 0.6347, std.dev.: 0.0041) MultiSource/Applications/Burg/burg: 5.49% (1.2222 => 1.2893, std.dev.: 0.0130) MultiSource/Applications/hbd/hbd: 5.47% (1.4269 => 1.5049, std.dev.: 0.0086) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.46% (0.8148 => 0.8593, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.35% (0.7473 => 0.7873, std.dev.: 0.0031) MultiSource/Applications/d/make_dparser: 5.25% (3.2366 => 3.4064, std.dev.: 0.0203) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.08% (0.2519 => 0.2647, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.96% (1.1170 => 1.1724, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.92% (1.6386 => 1.7192, std.dev.: 0.0126) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.82% (0.2741 => 0.2873, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.65% (1.1606 => 1.2146, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.50% (0.6287 => 0.6570, std.dev.: 0.0025) MultiSource/Applications/treecc/treecc: 4.34% (1.9948 => 2.0813, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.31% (0.9435 => 0.9842, std.dev.: 0.0043) MultiSource/Applications/SPASS/SPASS: 4.26% (14.2605 => 14.8677, std.dev.: 0.0197) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.26% (0.4559 => 0.4753, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.89% (0.6227 => 0.6469, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.86% (1.3279 => 1.3792, std.dev.: 0.0158) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.78% (0.5191 => 0.5387, std.dev.: 0.0025) MultiSource/Applications/minisat/minisat: 3.72% (0.6834 => 0.7088, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 3.61% (0.8855 => 0.9175, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 3.57% (0.9069 => 0.9393, std.dev.: 0.0079) MultiSource/Applications/lemon/lemon: 3.53% (1.0945 => 1.1331, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.51% (0.8697 => 0.9002, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.48% (0.8457 => 0.8751, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.47% (0.5817 => 0.6019, std.dev.: 0.0025) MultiSource/Benchmarks/sim/sim: 3.47% (0.3226 => 0.3338, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 3.47% (0.8768 => 0.9072, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.37% (0.2998 => 0.3099, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.37% (0.8286 => 0.8565, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.36% (1.4479 => 1.4965, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.33% (0.3003 => 0.3103, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.23% (0.8007 => 0.8266, std.dev.: 0.0042) MultiSource/Applications/JM/ldecod/ldecod: 3.09% (6.7320 => 6.9399, std.dev.: 0.0247) SingleSource/Benchmarks/Shootout-C++/hash2: 3.08% (0.4125 => 0.4252, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.06% (4.1763 => 4.3040, std.dev.: 0.0194) MultiSource/Applications/lua/lua: 3.03% (3.8189 => 3.9345, std.dev.: 0.0291) MultiSource/Applications/JM/lencod/lencod: 2.98% (15.3280 => 15.7852, std.dev.: 0.0561) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.97% (0.8177 => 0.8420, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.96% (0.8317 => 0.8563, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.92% (0.8050 => 0.8285, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.90% (0.8420 => 0.8664, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/hash: 2.89% (0.3800 => 0.3910, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.88% (0.8805 => 0.9059, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.87% (8.6476 => 8.8959, std.dev.: 0.0880) MultiSource/Benchmarks/MallocBench/gs/gs: 2.86% (4.1305 => 4.2486, std.dev.: 0.0222) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.85% (4.4873 => 4.6154, std.dev.: 0.0232) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.84% (0.8518 => 0.8760, std.dev.: 0.0079) MultiSource/Benchmarks/mafft/pairlocalalign: 2.76% (8.6247 => 8.8625, std.dev.: 0.0731) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.73% (0.8204 => 0.8428, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.71% (0.8069 => 0.8288, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.69% (0.8927 => 0.9167, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.67% (0.4127 => 0.4237, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.65% (0.8716 => 0.8947, std.dev.: 0.0071) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.63% (4.4880 => 4.6062, std.dev.: 0.0203) MultiSource/Benchmarks/PAQ8p/paq8p: 2.62% (2.3764 => 2.4386, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.62% (0.8066 => 0.8277, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 2.55% (2.2184 => 2.2750, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.48% (0.9056 => 0.9281, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.48% (0.8338 => 0.8545, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.43% (3.1832 => 3.2604, std.dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: 2.22% (0.9810 => 1.0028, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.06% (1.2602 => 1.2862, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.92% (1.5315 => 1.5609, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.81% (1.2423 => 1.2648, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.68% (4.5702 => 4.6472, std.dev.: 0.0103) SingleSource/UnitTests/Vector/constpool: 1.65% (8.4179 => 8.5565, std.dev.: 0.0508) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 33.36% (1.5795 => 2.1065, std.dev.: 0.1843) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.00% (2.4333 => 2.6767, std.dev.: 0.0158) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.54% (0.3186 => 0.3490, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.10% (1.1857 => 1.2817, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 6.02% (63.1822 => 66.9829, std.dev.: 0.1006) MultiSource/Benchmarks/FreeBench/distray/distray: 4.18% (0.2390 => 0.2490, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.41% (59.2638 => 61.2873, std.dev.: 0.1957) SingleSource/Benchmarks/Shootout-C++/hash: 2.79% (0.6205 => 0.6378, std.dev.: 0.0018) MultiSource/Applications/siod/siod: 2.72% (3.6643 => 3.7639, std.dev.: 0.0102) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.56% (0.4031 => 0.4134, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/ReedSolomon: 2.39% (8.5322 => 8.7359, std.dev.: 0.0316) MultiSource/Benchmarks/Olden/bh/bh: 1.77% (2.3560 => 2.3978, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout/ary3: 1.58% (2.0949 => 2.1281, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.39% (4.8362 => 4.9035, std.dev.: 0.0055) MultiSource/Benchmarks/Bullet/bullet: 1.01% (7.1181 => 7.1899, std.dev.: 0.0148) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.82% (0.3269 => 0.3046, std.dev.: 0.0023) MultiSource/Applications/lua/lua: -5.20% (29.8330 => 28.2818, std.dev.: 0.2418) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.71% (7.2130 => 7.0172, std.dev.: 0.0305) SingleSource/Benchmarks/Shootout-C++/hash2: -1.46% (3.4237 => 3.3736, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.17% (3.3479 => 3.3087, std.dev.: 0.0060) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.49% (16.4461 => 16.6919, std.dev.: 0.2195) MultiSource/Applications/obsequi/Obsequi: 4.75% (1.0262 => 1.0749, std.dev.: 0.0060) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6983.19% (0.3123 => 22.1208, std.dev.: 0.1541) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.25% (0.2463 => 0.3676, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/bigfib: 0.55% (0.6010 => 0.6043, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.11% (0.3266 => 0.3335, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 1.98% (0.1969 => 0.2008, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 82.11% (0.0123 => 0.0224, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.17% (0.0408 => 0.0425, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.31% (0.0254 => 0.0331, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 5.30% (0.0302 => 0.0318, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0384 => 0.0424, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.49% (0.1438 => 0.1445, std.dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 3.80% (1.1329 => 1.1760, std.dev.: 0.0052) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.97% (0.1462 => 0.1520, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.20% (0.4164 => 0.4339, std.dev.: 0.1682) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.80% (0.1369 => 0.1317, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.74% (0.0641 => 0.0617, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.42% (0.0578 => 0.0564, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.08% (1.1437 => 1.1428, std.dev.: 0.0137) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2000.00% (0.0001 => 0.0021, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.16% (0.0627 => 0.0628, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 45.56% (0.0180 => 0.0262, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.04% (0.8017 => 0.7934, std.dev.: 0.0086) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -9.68% (0.0062 => 0.0056, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 29 17:01:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 19:01:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121030000150.5AC282A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5383?compare_to=5379&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5383, Order: 166970, Start Time: 2012-10-29 22:30:32, End Time: 2012-10-30 00:01:43 To: 5379, Order: 166960, Start Time: 2012-10-29 20:26:55, End Time: 2012-10-29 21:57:58 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (9 on baseline) New Passes: 0 (15 on baseline) Performance Regressions: 1 (175 on baseline) Performance Improvements: 0 (49 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 13 (4 on baseline) Unchanged Tests: 1028 (656 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.24% (78.6159 => 80.3794, std.dev.: 0.3025) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: 0.83% (1.9759 => 1.9923, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 0.27% (57.0689 => 57.2235, std.dev.: 0.0179) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0790 => 0.0790, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 0.24% (8.9597 => 8.9813, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.24% (7.6144 => 7.6330, std.dev.: 0.0040) SingleSource/UnitTests/Vector/SSE/sse_shift: 4.25% (0.0518 => 0.0540, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: - (0.0001 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.31% (0.0649 => 0.0651, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/SSE/sse_shift: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -65.41% (5.7591 => 1.9923, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -9.52% (63.2438 => 57.2235, std.dev.: 0.0179) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.82% (6.6874 => 0.0790, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.39% (8.1363 => 8.9813, std.dev.: 0.0029) SingleSource/UnitTests/Vector/SSE/sse_shift: 42.86% (0.0378 => 0.0540, std.dev.: 0.0002) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -50.00% (0.0002 => 0.0001) SingleSource/UnitTests/Vector/SSE/sse_shift: -50.00% (0.0002 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 197.80% (0.5229 => 1.5572, std.dev.: 0.0041) MultiSource/Applications/SPASS/SPASS: 13.44% (14.9895 => 17.0045, std.dev.: 0.0106) MultiSource/Applications/kimwitu++/kc: 36.22% (14.1553 => 19.2819, std.dev.: 0.0157) MultiSource/Benchmarks/MallocBench/gs/gs: 12.48% (4.1105 => 4.6233, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 29.49% (1.1048 => 1.4306, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.97% (3.4629 => 5.8168, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 63.36% (0.6222 => 1.0164, std.dev.: 0.0009) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10540.97% (0.0720 => 7.6615, std.dev.: 0.0075) MultiSource/Applications/SIBsim4/SIBsim4: 3836200.00% (0.0001 => 3.8363, std.dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 11167500.00% (0.0001 => 11.1676, std.dev.: 0.0606) MultiSource/Applications/kimwitu++/kc: 50500.00% (0.0001 => 0.0506, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050200.00% (0.0001 => 10.0503, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5491800.00% (0.0001 => 5.4919, std.dev.: 0.0094) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 38.16% (0.1056 => 0.1459, std.dev.: 0.0001) SingleSource/UnitTests/vla: 29.01% (0.0355 => 0.0458, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 28.70% (0.1432 => 0.1843, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.31% (0.1566 => 0.1884, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/rem: 17.57% (0.1144 => 0.1345, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 17.26% (0.0730 => 0.0856, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 17.02% (0.0746 => 0.0873, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.02% (0.0793 => 0.0928, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.99% (0.0871 => 0.1019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 16.68% (0.3177 => 0.3707, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 16.60% (0.1175 => 0.1370, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 16.40% (0.4879 => 0.5679, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 16.33% (0.2554 => 0.2971, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.88% (0.8172 => 0.9470, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 15.66% (0.1584 => 0.1832, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.58% (0.1117 => 0.1291, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 15.17% (0.1655 => 0.1906, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.08% (0.0842 => 0.0969, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 14.63% (0.1695 => 0.1943, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 14.62% (0.1163 => 0.1333, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.33% (0.0886 => 0.1013, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 14.30% (0.5105 => 0.5835, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 14.24% (0.7115 => 0.8128, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.22% (0.2700 => 0.3084, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.09% (0.2065 => 0.2356, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.03% (0.0834 => 0.0951, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 13.83% (0.1555 => 0.1770, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 13.77% (0.7835 => 0.8914, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 13.71% (0.1940 => 0.2206, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.65% (0.1143 => 0.1299, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 13.64% (0.1151 => 0.1308, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.64% (0.0770 => 0.0875, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.56% (0.2758 => 0.3132, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.51% (0.1510 => 0.1714, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.44% (0.5981 => 0.6785, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.34% (0.2107 => 0.2388, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 13.32% (0.3109 => 0.3523, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 13.17% (3.3354 => 3.7747, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.16% (0.1337 => 0.1513, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 13.16% (0.1125 => 0.1273, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.03% (0.0798 => 0.0902, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 13.02% (0.7433 => 0.8401, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 13.02% (1.1642 => 1.3158, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.99% (0.6675 => 0.7542, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.95% (0.2271 => 0.2565, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.93% (0.5569 => 0.6289, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.93% (0.1029 => 0.1162, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.91% (0.9765 => 1.1026, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.85% (0.5860 => 0.6613, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.84% (1.5415 => 1.7394, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.83% (0.4615 => 0.5207, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.78% (0.3121 => 0.3520, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.71% (0.1062 => 0.1197, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 12.66% (2.0273 => 2.2839, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/exptree: 12.65% (0.0814 => 0.0917, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.40% (0.1032 => 0.1160, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.35% (0.5020 => 0.5640, std.dev.: 0.0028) MultiSource/Applications/ClamAV/clamscan: 12.34% (22.1758 => 24.9114, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.16% (1.3050 => 1.4637, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/health/health: 12.07% (0.1268 => 0.1421, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.06% (0.2603 => 0.2917, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.97% (0.1236 => 0.1384, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.92% (0.3441 => 0.3851, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 11.91% (1.0722 => 1.1999, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 11.81% (3.8723 => 4.3295, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.71% (1.1861 => 1.3250, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.63% (0.1625 => 0.1814, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 11.54% (0.3423 => 0.3818, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.49% (0.3307 => 0.3687, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.47% (0.6450 => 0.7190, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.32% (0.3543 => 0.3944, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.22% (2.2022 => 2.4492, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/football/football: 11.18% (0.8921 => 0.9918, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/05-eks/eks: 11.12% (0.4299 => 0.4777, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.09% (4.2646 => 4.7375, std.dev.: 0.0115) MultiSource/Benchmarks/FreeBench/neural/neural: 10.94% (0.1463 => 0.1623, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 10.92% (0.3927 => 0.4356, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/09-vor/vor: 10.91% (0.3180 => 0.3527, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.87% (0.0929 => 0.1030, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.77% (0.3473 => 0.3847, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: 10.72% (0.0933 => 0.1033, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 10.71% (9.4845 => 10.4999, std.dev.: 0.0072) SingleSource/UnitTests/ObjC/exceptions-2: 10.69% (0.3497 => 0.3871, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.66% (0.3828 => 0.4236, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.64% (0.3543 => 0.3920, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.55% (0.3516 => 0.3887, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.54% (0.1044 => 0.1154, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 10.53% (1.1840 => 1.3087, std.dev.: 0.0068) SingleSource/UnitTests/ObjC/synchronized: 10.53% (0.3561 => 0.3936, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.49% (0.1906 => 0.2106, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/for-in: 10.48% (0.3694 => 0.4081, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.40% (1.5859 => 1.7509, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.38% (0.1695 => 0.1871, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.34% (0.8101 => 0.8939, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.29% (0.3886 => 0.4286, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 10.21% (0.4289 => 0.4727, std.dev.: 0.0019) MultiSource/Benchmarks/sim/sim: 10.13% (0.3387 => 0.3730, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.06% (2.2024 => 2.4240, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 10.06% (2.2969 => 2.5279, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: 10.05% (0.6456 => 0.7105, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.83% (1.4186 => 1.5581, std.dev.: 0.0090) SingleSource/Benchmarks/Stanford/Puzzle: 9.62% (0.1268 => 0.1390, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.35% (14.3668 => 15.7104, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/hash2: 9.31% (0.4620 => 0.5050, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.28% (0.4636 => 0.5066, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.26% (0.3865 => 0.4223, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.25% (0.1892 => 0.2067, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.16% (0.4203 => 0.4588, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/lists: 9.15% (0.3422 => 0.3735, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.07% (0.4103 => 0.4475, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 9.05% (0.7326 => 0.7989, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 9.01% (1.5603 => 1.7009, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.95% (0.1330 => 0.1449, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.89% (5.0018 => 5.4463, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.71% (4.9449 => 5.3757, std.dev.: 0.0081) SingleSource/UnitTests/ObjC++/Hello: 8.71% (0.5925 => 0.6441, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.69% (0.6030 => 0.6554, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 8.60% (0.3684 => 0.4001, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 8.57% (0.4048 => 0.4395, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 8.33% (0.3603 => 0.3903, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 8.19% (0.2831 => 0.3063, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.07% (0.2430 => 0.2626, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.81% (0.3826 => 0.4125, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.81% (0.3650 => 0.3935, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.71% (0.2905 => 0.3129, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 7.68% (0.3283 => 0.3535, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.65% (0.3427 => 0.3689, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.64% (0.3232 => 0.3479, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.63% (0.2793 => 0.3006, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.58% (2.0665 => 2.2232, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.51% (0.2891 => 0.3108, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.50% (0.3162 => 0.3399, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 7.39% (0.3098 => 0.3327, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 7.36% (17.1811 => 18.4449, std.dev.: 0.0136) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.31% (0.4064 => 0.4361, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 7.21% (0.2871 => 0.3078, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 7.19% (0.2725 => 0.2921, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.14% (0.2872 => 0.3077, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.08% (0.2756 => 0.2951, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 6.99% (0.2877 => 0.3078, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.98% (0.3052 => 0.3265, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.96% (0.2714 => 0.2903, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 6.78% (0.2802 => 0.2992, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 6.42% (1.2842 => 1.3667, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 6.37% (0.3282 => 0.3491, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 6.30% (0.3379 => 0.3592, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 6.08% (0.3092 => 0.3280, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.01% (0.8067 => 0.8552, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.90% (0.3136 => 0.3321, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.75% (3.8922 => 4.1159, std.dev.: 0.0142) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.16% (0.2266 => 0.2383, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.08% (0.3131 => 0.3290, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.15% (0.3935 => 0.4059, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.12% (0.3817 => 0.3936, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.62% (7.9617 => 8.1706, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.81% (7.0540 => 7.1817, std.dev.: 0.0117) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.56% (1.1145 => 1.2991, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 9.79% (1.1396 => 1.2512, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.11% (0.9540 => 1.0218) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (3.1578 => 3.3677, std.dev.: 0.0038) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.58% (4.2280 => 4.3372, std.dev.: 0.0096) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.84% (0.8333 => 0.8486, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2079, std.dev.: 0.0070) MultiSource/Benchmarks/nbench/nbench: 1.31% (11.6436 => 11.7959, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.14% (1.3045 => 1.3194, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.09% (6.5088 => 6.5800, std.dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -77.09% (0.8651 => 0.1982, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.46% (5.3855 => 2.3985, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -55.11% (5.3526 => 2.4030, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -45.38% (0.1622 => 0.0886, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.32% (1.1194 => 0.6792, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.09% (5.2763 => 3.2663, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -23.72% (1.7609 => 1.3433, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -17.40% (2.9384 => 2.4272, std.dev.: 0.0065) MultiSource/Applications/JM/ldecod/ldecod: -10.19% (10.4361 => 9.3725, std.dev.: 0.0046) SingleSource/UnitTests/Vector/constpool: -9.32% (54.1659 => 49.1188, std.dev.: 0.0222) MultiSource/Benchmarks/PAQ8p/paq8p: -3.72% (10.3673 => 9.9816, std.dev.: 0.0082) MultiSource/Applications/JM/lencod/lencod: -2.11% (21.9371 => 21.4751, std.dev.: 0.0101) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.99% (0.0506 => 0.0334, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -33.68% (0.3987 => 0.2644) SingleSource/Benchmarks/Misc/mandel: -33.50% (1.1492 => 0.7642, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4232, std.dev.: 0.0042) MultiSource/Benchmarks/NPB-serial/is/is: -10.98% (9.5636 => 8.5139, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -10.80% (1.5373 => 1.3713, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.38% (19.9488 => 18.2776, std.dev.: 0.0142) MultiSource/Benchmarks/FreeBench/mason/mason: -7.82% (0.2161 => 0.1992, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.09% (1.8329 => 1.7030, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.12% (1.2373 => 1.1616, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -5.45% (6.6465 => 6.2842, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.12% (1.6805 => 1.5945, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.80% (1.5835 => 1.5075, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.08% (0.2497 => 0.2395, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.75% (3.2827 => 3.1595, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.61% (0.9957 => 0.9598, std.dev.: 0.0075) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.48% (32.5116 => 31.3789, std.dev.: 0.0106) MultiSource/Benchmarks/sim/sim: -3.24% (5.0483 => 4.8848, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.82% (4.5009 => 4.3740, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -2.73% (4.6441 => 4.5175, std.dev.: 0.0081) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.50% (0.4808 => 0.4688, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.00% (8.1563 => 7.9935, std.dev.: 0.0227) SingleSource/Benchmarks/Misc/salsa20: -1.86% (10.2830 => 10.0919, std.dev.: 0.0269) SingleSource/UnitTests/Vector/multiplies: -1.81% (2.5528 => 2.5065, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6793, std.dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: -1.20% (85.0658 => 84.0453, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/lists: -1.11% (6.2999 => 6.2301, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: -1.01% (1.1277 => 1.1163) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.63% (7.1582 => 7.6330, std.dev.: 0.0040) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 29 17:13:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 19:13:03 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121030001303.EB38F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5384?compare_to=5380&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5384, Order: 166973, Start Time: 2012-10-29 22:47:52, End Time: 2012-10-30 00:13:02 To: 5380, Order: 166961, Start Time: 2012-10-29 20:59:37, End Time: 2012-10-29 22:24:54 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (176 on baseline) Unchanged Tests: 1042 (861 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 19.99% (15.2527 => 18.3014, std.dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.66% (2.0478 => 2.1022, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/salsa20: 2.45% (7.4937 => 7.6774, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/hash2: 2.35% (3.1932 => 3.2682, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.08% (0.1431 => 0.1301, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.33% (0.1584 => 0.1452, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -7.99% (0.3831 => 0.3525, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -7.92% (0.3812 => 0.3510, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -7.91% (0.3880 => 0.3573, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -7.87% (0.3848 => 0.3545, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.85% (0.3884 => 0.3579, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -7.78% (0.3896 => 0.3593, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.74% (0.3891 => 0.3590, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.67% (0.3821 => 0.3528, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -7.66% (0.4033 => 0.3724, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -7.61% (0.4176 => 0.3858, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -7.26% (0.4199 => 0.3894, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -7.22% (0.4280 => 0.3971, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.68% (0.3142 => 0.2932, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.59% (0.2428 => 0.2268, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.55% (2.4924 => 2.3291, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/except: -6.48% (0.3026 => 0.2830, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -6.39% (0.2989 => 0.2798, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: -6.35% (0.3025 => 0.2833, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.33% (0.2355 => 0.2206, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: -6.23% (0.3016 => 0.2828, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: -6.23% (0.1879 => 0.1762, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.18% (0.3658 => 0.3432, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.15% (22.4056 => 21.0279, std.dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.09% (0.6484 => 0.6089, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.09% (0.4813 => 0.4520, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -6.07% (0.3446 => 0.3237, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.05% (2.1713 => 2.0400, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -6.03% (0.3481 => 0.3271, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.03% (4.5069 => 4.2352, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.03% (0.2903 => 0.2728, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.02% (0.3837 => 0.3606, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.02% (0.3057 => 0.2873, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -6.01% (0.3194 => 0.3002, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.00% (0.4151 => 0.3902, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: -5.99% (0.2939 => 0.2763, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: -5.98% (0.3059 => 0.2876, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -5.98% (0.3394 => 0.3191, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: -5.98% (1.3148 => 1.2362, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: -5.97% (0.3788 => 0.3562, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.97% (0.3252 => 0.3058, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -5.96% (0.3205 => 0.3014, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -5.93% (0.2160 => 0.2032, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.92% (0.3849 => 0.3621, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.90% (0.4083 => 0.3842, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.90% (0.9542 => 0.8979, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: -5.86% (0.2849 => 0.2682, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -5.85% (0.3621 => 0.3409, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: -5.84% (7.0961 => 6.6814, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/hash2: -5.82% (0.4861 => 0.4578, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: -5.82% (0.2871 => 0.2704, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: -5.81% (0.7779 => 0.7327, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.79% (0.7198 => 0.6781, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -5.78% (0.3357 => 0.3163, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.77% (5.4682 => 5.1526, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/08-main/main: -5.75% (0.2659 => 0.2506, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.72% (0.9852 => 0.9288, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.72% (4.8802 => 4.6012, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists1: -5.72% (0.3867 => 0.3646, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: -5.66% (16.1920 => 15.2757, std.dev.: 0.0154) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.65% (4.8161 => 4.5440, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.64% (3.5339 => 3.3347, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: -5.63% (1.2515 => 1.1810, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.62% (0.4427 => 0.4178, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.62% (1.2221 => 1.1534, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: -5.61% (0.6750 => 0.6371, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.59% (4.0323 => 3.8068, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.59% (1.2210 => 1.1528, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.58% (0.5999 => 0.5664, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/Hello: -5.58% (0.6347 => 0.5993, std.dev.: 0.0081) MultiSource/Benchmarks/MallocBench/gs/gs: -5.58% (4.3330 => 4.0914, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.56% (0.8521 => 0.8047, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/moments: -5.56% (0.4248 => 0.4012, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference-object: -5.54% (0.6441 => 0.6084, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.50% (1.0544 => 0.9964, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.48% (1.6474 => 1.5571, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.42% (0.3323 => 0.3143, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.40% (1.2784 => 1.2094, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.37% (0.7919 => 0.7494, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.34% (0.2548 => 0.2412, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.30% (0.4321 => 0.4092, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -5.28% (34.0927 => 32.2938, std.dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.27% (0.3491 => 0.3307, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -5.26% (2.4021 => 2.2757, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.25% (0.2933 => 0.2779, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.18% (0.2278 => 0.2160, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -5.16% (0.2985 => 0.2831, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.15% (1.6364 => 1.5522, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.14% (0.3931 => 0.3729, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -5.04% (4.0594 => 3.8548, std.dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: -5.00% (9.2283 => 8.7667, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.99% (1.4642 => 1.3912, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: -4.97% (0.4524 => 0.4299, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.90% (1.3722 => 1.3050, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.89% (0.6293 => 0.5985, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.88% (0.5805 => 0.5522, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.86% (2.2587 => 2.1490, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.86% (0.9557 => 0.9093, std.dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: -4.85% (18.2933 => 17.4061, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.84% (0.6304 => 0.5999, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.80% (0.5581 => 0.5313, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.77% (0.5575 => 0.5309, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.72% (0.4916 => 0.4684, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.72% (0.5705 => 0.5436, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.71% (0.5863 => 0.5587, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.69% (0.5859 => 0.5584, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/18-imp/imp: -4.69% (0.3581 => 0.3413, std.dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: -4.66% (0.7982 => 0.7610, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.64% (0.6052 => 0.5771, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.63% (0.5569 => 0.5311, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.62% (0.5925 => 0.5651, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.61% (0.2385 => 0.2275, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.61% (0.5857 => 0.5587, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.61% (0.6230 => 0.5943, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.60% (0.6676 => 0.6369, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.60% (0.5570 => 0.5314, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.58% (0.5802 => 0.5536, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.58% (0.5478 => 0.5227, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.55% (0.7339 => 0.7005, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.53% (0.6395 => 0.6105, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.53% (0.6660 => 0.6358, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.51% (0.5591 => 0.5339, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.51% (0.7524 => 0.7185, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.51% (0.6681 => 0.6380, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.50% (0.2999 => 0.2864, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.50% (0.5688 => 0.5432, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.50% (0.6446 => 0.6156, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.47% (0.5567 => 0.5318, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.46% (0.6297 => 0.6016, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -4.45% (0.4515 => 0.4314, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: -4.43% (0.7447 => 0.7117, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.43% (0.5849 => 0.5590, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.42% (0.6260 => 0.5983, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.39% (0.6667 => 0.6374, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.38% (0.6194 => 0.5923, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: -4.37% (0.9179 => 0.8778, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.36% (0.6189 => 0.5919, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.35% (0.9077 => 0.8682, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.34% (0.5456 => 0.5219, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.33% (0.6440 => 0.6161, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.33% (0.5941 => 0.5684, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: -4.32% (0.8418 => 0.8054, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.32% (0.6395 => 0.6119, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.29% (0.6033 => 0.5774, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.29% (8.0126 => 7.6687, std.dev.: 0.0052) MultiSource/Benchmarks/sim/sim: -4.29% (0.3406 => 0.3260, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -4.19% (15.5079 => 14.8586, std.dev.: 0.0248) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.15% (6.7716 => 6.4907, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/09-vor/vor: -4.13% (0.3271 => 0.3136, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.05% (0.6736 => 0.6463, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: -3.99% (5.0226 => 4.8222, std.dev.: 0.0050) MultiSource/Applications/lemon/lemon: -3.97% (1.1450 => 1.0995, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.93% (0.7021 => 0.6745, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.89% (0.3319 => 0.3190, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: -3.88% (1.5610 => 1.5004, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: -3.84% (2.1401 => 2.0580, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.81% (0.5168 => 0.4971, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.79% (0.3483 => 0.3351, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -3.71% (17.1032 => 16.4684, std.dev.: 0.0238) MultiSource/Applications/d/make_dparser: -3.70% (3.5154 => 3.3855, std.dev.: 0.0174) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.57% (1.2300 => 1.1861, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: -3.37% (1.1530 => 1.1142, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.27% (0.5329 => 0.5155, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.14% (14.2083 => 13.7628, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -2.01% (20.7746 => 20.3570, std.dev.: 0.0228) MultiSource/Applications/SIBsim4/SIBsim4: -1.75% (1.3864 => 1.3622, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.31% (7.5137 => 5.7621, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: -8.72% (1.2842 => 1.1722, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.84% (2.2633 => 2.1765, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.52% (1.3096 => 1.2766, std.dev.: 0.0057) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4730, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.31% (1.6086 => 1.5876, std.dev.: 0.0070) Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 29 18:21:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 20:21:49 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121030012149.ECE802A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5385?compare_to=5382&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5385, Order: 166982, Start Time: 2012-10-29 23:53:41, End Time: 2012-10-30 01:21:49 To: 5382, Order: 166968, Start Time: 2012-10-29 22:03:37, End Time: 2012-10-29 23:32:00 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 13 (83 on baseline) Performance Improvements: 1 (4 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 977 (887 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.81% (1.2038 => 1.2497, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.90% (0.4237 => 0.4360, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.51% (0.8529 => 0.8743, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.36% (0.9943 => 1.0178, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.17% (0.9321 => 0.9523, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.69% (13.9881 => 14.2247, std.dev.: 0.0674) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.61% (0.9059 => 0.9205, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.58% (0.8803 => 0.8942, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.49% (0.8460 => 0.8586, std.dev.: 0.0017) MultiSource/Applications/Burg/burg: 1.10% (1.2893 => 1.3035, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 19.34% (2.1065 => 2.5138, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.94% (2.4459 => 2.5178, std.dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.59% (2.5985 => 2.6399, std.dev.: 0.0094) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: -6.06% (3.9877 => 3.7462, std.dev.: 0.0611) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.03% (16.6919 => 16.6966, std.dev.: 0.2088) MultiSource/Applications/obsequi/Obsequi: -0.66% (1.0749 => 1.0678, std.dev.: 0.0159) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.87% (22.1208 => 21.7073, std.dev.: 0.3763) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.95% (0.3676 => 0.3641, std.dev.: 0.0144) SingleSource/Benchmarks/Misc-C++/bigfib: 0.12% (0.6043 => 0.6050, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/reversefile: -1.14% (0.3335 => 0.3297, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/strcat: -0.45% (0.2008 => 0.1999, std.dev.: 0.0110) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.12% (0.0224 => 0.0217, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.24% (0.0425 => 0.0426, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.60% (0.0331 => 0.0333, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.57% (0.0318 => 0.0313, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.47% (0.0424 => 0.0422, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -1.95% (0.0205 => 0.0201, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -1.38% (0.0218 => 0.0215, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.76% (0.1445 => 0.1456, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -2.30% (1.1760 => 1.1490, std.dev.: 0.0204) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1520 => 0.1519, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -8.25% (0.4339 => 0.3981, std.dev.: 0.0347) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: - (0.1317 => 0.1317, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.05% (0.0617 => 0.0679, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.53% (0.0277 => 0.0270, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.96% (0.0564 => 0.0536, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.17% (1.1428 => 1.1447, std.dev.: 0.0117) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -14.29% (0.0021 => 0.0018, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.82% (0.0628 => 0.0652, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.53% (0.0262 => 0.0266, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.14% (0.7934 => 0.7945, std.dev.: 0.0068) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -3.57% (0.0056 => 0.0054, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2337.63% (0.6332 => 15.4351, std.dev.: 0.2435) MultiSource/Benchmarks/McCat/08-main/main: 47.13% (0.1831 => 0.2694, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.07% (0.1559 => 0.1480, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1480.80% (0.3344 => 5.2862, std.dev.: 0.0586) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.68% (0.2364 => 0.3231, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel: 2.33% (0.0429 => 0.0439, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.68% (0.0224 => 0.0230, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -31.30% (0.0230 => 0.0158, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4449, std.dev.: 0.0247) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0705, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4905, std.dev.: 0.0158) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3416, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0358, std.dev.: 0.0137) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4032, std.dev.: 0.0076) SingleSource/Regression/C/uint64_to_float: -24.14% (2.1832 => 1.6561, std.dev.: 0.0031) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 36.00% (14.7684 => 20.0844, std.dev.: 0.1367) SingleSource/UnitTests/SignlessTypes/rem: 14.78% (0.1035 => 0.1188, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.69% (0.0810 => 0.0929, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/tsp/tsp: 12.41% (0.1112 => 0.1250, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.15% (0.0848 => 0.0951, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.05% (0.1425 => 0.1554, std.dev.: 0.0022) MultiSource/Applications/viterbi/viterbi: 8.75% (0.1577 => 0.1715, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.37% (0.1983 => 0.2149, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.92% (13.1811 => 14.2247, std.dev.: 0.0674) MultiSource/Applications/SIBsim4/SIBsim4: 7.73% (1.2568 => 1.3540, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.71% (0.1466 => 0.1579, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.30% (0.6010 => 0.6449, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.95% (1.1685 => 1.2497, std.dev.: 0.0075) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 6.88% (0.2180 => 0.2330, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.77% (0.4847 => 0.5175, std.dev.: 0.0073) MultiSource/Applications/Burg/burg: 6.65% (1.2222 => 1.3035, std.dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.63% (0.3137 => 0.3345, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.43% (1.6386 => 1.7439, std.dev.: 0.0253) MultiSource/Applications/spiff/spiff: 6.34% (0.7950 => 0.8454, std.dev.: 0.0065) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.76% (6.6074 => 6.9877, std.dev.: 0.0578) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.65% (0.4127 => 0.4360, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.55% (0.6287 => 0.6636, std.dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 5.31% (1.1271 => 1.1869, std.dev.: 0.0191) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.17% (0.7473 => 0.7859, std.dev.: 0.0121) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.14% (0.2741 => 0.2882, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 5.13% (0.8316 => 0.8743, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 5.06% (0.9688 => 1.0178, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.95% (0.9074 => 0.9523, std.dev.: 0.0042) MultiSource/Applications/treecc/treecc: 4.83% (1.9948 => 2.0911, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/football/football: 4.81% (0.8768 => 0.9190, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 4.54% (0.8805 => 0.9205, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.26% (0.4559 => 0.4753, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.14% (0.6227 => 0.6485, std.dev.: 0.0092) MultiSource/Applications/SPASS/SPASS: 4.10% (14.2605 => 14.8454, std.dev.: 0.0582) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.09% (0.8066 => 0.8396, std.dev.: 0.0062) MultiSource/Applications/d/make_dparser: 4.04% (3.2366 => 3.3674, std.dev.: 0.0323) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.02% (0.9056 => 0.9420, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.98% (0.6586 => 0.6848, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.98% (1.3279 => 1.3807, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.93% (0.8261 => 0.8586, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.92% (4.4873 => 4.6630, std.dev.: 0.0397) MultiSource/Applications/lemon/lemon: 3.89% (1.0945 => 1.1371, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.89% (0.5191 => 0.5393, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.84% (0.8611 => 0.8942, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.82% (0.3717 => 0.3859, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.76% (4.1763 => 4.3332, std.dev.: 0.0299) MultiSource/Applications/minisat/minisat: 3.73% (0.6834 => 0.7089, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 3.61% (0.8331 => 0.8632, std.dev.: 0.0083) MultiSource/Benchmarks/McCat/05-eks/eks: 3.59% (0.4397 => 0.4555, std.dev.: 0.0036) MultiSource/Applications/hbd/hbd: 3.50% (1.4269 => 1.4768, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.46% (0.8420 => 0.8711, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.40% (0.8359 => 0.8643, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.32% (2.1401 => 2.2111, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.27% (0.8286 => 0.8557, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.27% (0.8697 => 0.8981, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 3.24% (0.7932 => 0.8189, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.22% (0.8050 => 0.8309, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.21% (0.5817 => 0.6004, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 3.12% (8.6247 => 8.8940, std.dev.: 0.0222) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.11% (0.8457 => 0.8720, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 3.11% (0.9039 => 0.9320, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.03% (0.8338 => 0.8591, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.02% (0.8712 => 0.8975, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.84% (0.8069 => 0.8298, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.75% (0.8007 => 0.8227, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.72% (0.8885 => 0.9127, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.67% (1.2602 => 1.2939, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.67% (4.5702 => 4.6921, std.dev.: 0.0327) MultiSource/Applications/JM/lencod/lencod: 2.67% (15.3280 => 15.7366, std.dev.: 0.1154) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.52% (0.8177 => 0.8383, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.39% (1.4479 => 1.4825, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.39% (0.8048 => 0.8240, std.dev.: 0.0061) MultiSource/Benchmarks/Bullet/bullet: 2.03% (31.8598 => 32.5057, std.dev.: 0.1715) MultiSource/Applications/hexxagon/hexxagon: 1.38% (0.9810 => 0.9945, std.dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 59.15% (1.5795 => 2.5138, std.dev.: 0.0026) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.29% (2.4333 => 2.6837, std.dev.: 0.0337) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.70% (0.3186 => 0.3495, std.dev.: 0.0090) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.37% (1.1857 => 1.2850, std.dev.: 0.0087) MultiSource/Benchmarks/mafft/pairlocalalign: 5.98% (63.1822 => 66.9582, std.dev.: 0.0473) SingleSource/Benchmarks/Misc/ReedSolomon: 2.94% (8.5322 => 8.7827, std.dev.: 0.0226) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.81% (2.4490 => 2.5178, std.dev.: 0.0171) MultiSource/Applications/siod/siod: 2.64% (3.6643 => 3.7612, std.dev.: 0.0095) MultiSource/Benchmarks/Olden/bh/bh: 1.67% (2.3560 => 2.3953, std.dev.: 0.0088) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.04% (0.3269 => 0.3039, std.dev.: 0.0056) MultiSource/Applications/lua/lua: -5.38% (29.8330 => 28.2283, std.dev.: 0.3003) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.40% (3.9188 => 3.7462, std.dev.: 0.0611) SingleSource/Benchmarks/Shootout-C++/hash2: -1.51% (3.4237 => 3.3720, std.dev.: 0.0095) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.52% (16.4461 => 16.6966, std.dev.: 0.2088) MultiSource/Applications/obsequi/Obsequi: 4.05% (1.0262 => 1.0678, std.dev.: 0.0159) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6850.78% (0.3123 => 21.7073, std.dev.: 0.3763) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.83% (0.2463 => 0.3641, std.dev.: 0.0144) SingleSource/Benchmarks/Misc-C++/bigfib: 0.67% (0.6010 => 0.6050, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.95% (0.3266 => 0.3297, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/strcat: 1.52% (0.1969 => 0.1999, std.dev.: 0.0110) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 76.42% (0.0123 => 0.0217, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.90% (0.0384 => 0.0422, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 5.79% (0.0190 => 0.0201, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 19.44% (0.0180 => 0.0215, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.25% (0.1438 => 0.1456, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.42% (1.1329 => 1.1490, std.dev.: 0.0204) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.90% (0.1462 => 0.1519, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.39% (0.4164 => 0.3981, std.dev.: 0.0347) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.80% (0.1369 => 0.1317, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.93% (0.0641 => 0.0679, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 38.46% (0.0195 => 0.0270, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.27% (0.0578 => 0.0536, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.09% (1.1437 => 1.1447, std.dev.: 0.0117) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1700.00% (0.0001 => 0.0018, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.99% (0.0627 => 0.0652, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.78% (0.0180 => 0.0266, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.90% (0.8017 => 0.7945, std.dev.: 0.0068) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -12.90% (0.0062 => 0.0054, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 29 19:01:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 21:01:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121030020136.95FC52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5386?compare_to=5384&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5386, Order: 166985, Start Time: 2012-10-30 00:36:17, End Time: 2012-10-30 02:01:35 To: 5384, Order: 166973, Start Time: 2012-10-29 22:47:52, End Time: 2012-10-30 00:13:02 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (6 on baseline) Performance Improvements: 0 (176 on baseline) Unchanged Tests: 1040 (860 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.25% (54.3526 => 56.1186, std.dev.: 0.1917) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.11% (2.1022 => 2.1255, std.dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.24% (15.2527 => 18.3400, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.29% (1.2783 => 1.3715, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.79% (2.0478 => 2.1255, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.83% (54.5751 => 56.1186, std.dev.: 0.1917) SingleSource/Benchmarks/Misc/salsa20: 2.48% (7.4937 => 7.6797, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/hash2: 2.30% (3.1932 => 3.2666, std.dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.74% (0.1431 => 0.1306, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.65% (0.1584 => 0.1447, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.43% (0.3821 => 0.3537, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.71% (0.2428 => 0.2265, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.56% (0.3142 => 0.2936, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.35% (22.4056 => 20.9820, std.dev.: 0.0108) MultiSource/Benchmarks/PAQ8p/paq8p: -6.26% (2.4924 => 2.3365, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.07% (0.3658 => 0.3436, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -6.02% (0.3357 => 0.3155, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: -5.93% (0.2160 => 0.2032, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.92% (0.9542 => 0.8977, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.91% (5.4682 => 5.1449, std.dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.91% (0.6484 => 0.6101, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.85% (4.5069 => 4.2431, std.dev.: 0.0043) MultiSource/Applications/Burg/burg: -5.84% (1.2515 => 1.1784, std.dev.: 0.0024) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.83% (0.1716 => 0.1616, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.83% (0.9852 => 0.9278, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -5.78% (2.4021 => 2.2633, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: -5.77% (4.3330 => 4.0832, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.76% (0.4151 => 0.3912, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.73% (0.3837 => 0.3617, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.73% (1.6474 => 1.5530, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.73% (3.5339 => 3.3314, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/08-main/main: -5.72% (0.2659 => 0.2507, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -5.69% (7.0961 => 6.6925, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/methcall: -5.69% (0.3025 => 0.2853, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.65% (0.2548 => 0.2404, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -5.62% (0.3026 => 0.2856) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.61% (0.4083 => 0.3854, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.61% (0.2355 => 0.2223, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.59% (0.7919 => 0.7476, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.59% (0.3849 => 0.3634, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: -5.58% (0.2939 => 0.2775, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.56% (0.3057 => 0.2887, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -5.53% (0.4176 => 0.3945, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -5.53% (1.3148 => 1.2421, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: -5.52% (0.3880 => 0.3666, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -5.51% (0.3831 => 0.3620, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.51% (0.3323 => 0.3140, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.49% (2.1713 => 2.0521, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-3: -5.48% (0.3848 => 0.3637, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -5.48% (0.3194 => 0.3019, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.48% (0.2903 => 0.2744, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.47% (1.0544 => 0.9967, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: -5.47% (0.4861 => 0.4595, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -5.47% (0.3255 => 0.3077, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.46% (0.3884 => 0.3672, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: -5.46% (16.1920 => 15.3082, std.dev.: 0.0134) SingleSource/UnitTests/ObjC/trivial-interface: -5.46% (0.3812 => 0.3604, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.44% (0.3252 => 0.3075, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.44% (0.3016 => 0.2852, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -5.43% (0.2871 => 0.2715, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.42% (0.4813 => 0.4552, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.42% (0.3891 => 0.3680, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -5.42% (0.3896 => 0.3685, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.42% (0.4321 => 0.4087, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -5.41% (0.2849 => 0.2695, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.40% (4.8161 => 4.5559, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/ary2: -5.40% (0.3481 => 0.3293, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -5.39% (0.3059 => 0.2894, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.39% (1.2784 => 1.2095, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.39% (4.8802 => 4.6173, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/strcat: -5.39% (0.2989 => 0.2828, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: -5.33% (0.4199 => 0.3975, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.33% (4.0323 => 3.8173, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wc: -5.30% (0.3205 => 0.3035, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -5.29% (0.2985 => 0.2827, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.29% (0.3931 => 0.3723, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.27% (1.2210 => 1.1566, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/sieve: -5.25% (0.3788 => 0.3589, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -5.25% (4.0594 => 3.8463, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists: -5.25% (0.3621 => 0.3431, std.dev.: 0.0043) MultiSource/Benchmarks/Bullet/bullet: -5.24% (34.0927 => 32.3071, std.dev.: 0.0116) SingleSource/UnitTests/ObjC/for-in: -5.23% (0.4033 => 0.3822, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -5.23% (0.6750 => 0.6397, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -5.21% (0.7982 => 0.7566, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/moments: -5.20% (0.4248 => 0.4027, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -5.19% (0.4280 => 0.4058, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.17% (0.4427 => 0.4198, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: -5.17% (18.2933 => 17.3472, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.15% (2.2587 => 2.1424, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.14% (1.2221 => 1.1593, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary3: -5.14% (0.3446 => 0.3269, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -5.13% (0.3394 => 0.3220, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -5.04% (0.3867 => 0.3672, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.02% (0.8521 => 0.8093, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.00% (0.2999 => 0.2849, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -4.97% (1.6364 => 1.5551, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.97% (0.5999 => 0.5701, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.93% (0.3491 => 0.3319, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.89% (0.6293 => 0.5985, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.89% (0.7198 => 0.6846, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.88% (1.3722 => 1.3052, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: -4.86% (9.2283 => 8.7799, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.84% (0.2933 => 0.2791, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.79% (1.4642 => 1.3940, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -4.77% (0.7779 => 0.7408, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.75% (0.9557 => 0.9103, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.69% (0.5863 => 0.5588, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.69% (0.5805 => 0.5533, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.67% (0.3319 => 0.3164, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/18-imp/imp: -4.66% (0.3581 => 0.3414, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.63% (0.6304 => 0.6012, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.62% (0.5925 => 0.5651, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.62% (0.5581 => 0.5323, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.61% (0.2278 => 0.2173, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.60% (0.5478 => 0.5226, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.57% (0.5705 => 0.5444, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.54% (0.5859 => 0.5593, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: -4.53% (0.4524 => 0.4319, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.51% (0.6676 => 0.6375, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.51% (0.5591 => 0.5339, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -4.51% (0.6347 => 0.6061, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.50% (0.5575 => 0.5324, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.49% (0.6052 => 0.5780, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.48% (0.4916 => 0.4696, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: -4.47% (0.6441 => 0.6153, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.45% (0.5570 => 0.5322, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.45% (0.6681 => 0.6384, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.43% (0.6297 => 0.6018, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -4.41% (0.4515 => 0.4316, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.40% (0.6230 => 0.5956, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.38% (0.5569 => 0.5325, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.38% (0.5941 => 0.5681, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: -4.35% (0.7447 => 0.7123, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.35% (0.6260 => 0.5988, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.34% (0.5688 => 0.5441, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.34% (0.6660 => 0.6371, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.34% (0.5857 => 0.5603, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.33% (0.7339 => 0.7021, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.33% (0.6446 => 0.6167, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -4.32% (1.1450 => 1.0955, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.32% (0.2385 => 0.2282, std.dev.: 0.0019) MultiSource/Benchmarks/sim/sim: -4.32% (0.3406 => 0.3259, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.31% (0.6189 => 0.5922, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.31% (0.7524 => 0.7200, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.29% (0.6194 => 0.5928, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: -4.29% (0.9179 => 0.8785, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.29% (0.5456 => 0.5222, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.26% (0.6033 => 0.5776, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.24% (0.6667 => 0.6384, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.24% (0.6395 => 0.6124, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.24% (0.6395 => 0.6124, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.22% (0.5567 => 0.5332, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: -4.19% (0.3271 => 0.3134, std.dev.: 0.0036) MultiSource/Applications/spiff/spiff: -4.18% (0.8418 => 0.8066, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.17% (0.5849 => 0.5605, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.15% (0.6440 => 0.6173, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.05% (0.6736 => 0.6463, std.dev.: 0.0020) MultiSource/Applications/treecc/treecc: -4.05% (2.1401 => 2.0534, std.dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: -4.02% (15.5079 => 14.8840, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.93% (0.7021 => 0.6745, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.89% (0.5168 => 0.4967, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -3.87% (8.0126 => 7.7022, std.dev.: 0.0064) MultiSource/Applications/sqlite3/sqlite3: -3.75% (17.1032 => 16.4619, std.dev.: 0.0292) MultiSource/Applications/oggenc/oggenc: -3.74% (5.0226 => 4.8346, std.dev.: 0.0029) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.70% (6.7716 => 6.5213, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.67% (0.3483 => 0.3355, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -3.65% (3.5154 => 3.3872, std.dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.62% (0.5329 => 0.5136, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.57% (1.2300 => 1.1861, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: -3.51% (1.1530 => 1.1125, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: -3.51% (1.5610 => 1.5062, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.35% (0.9077 => 0.8773, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.88% (14.2083 => 13.7985, std.dev.: 0.0090) SingleSource/UnitTests/Vector/constpool: -2.29% (20.7746 => 20.2995, std.dev.: 0.0043) MultiSource/Applications/SIBsim4/SIBsim4: -1.74% (1.3864 => 1.3623, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.48% (7.5137 => 5.7498, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/richards_benchmark: -8.76% (1.2842 => 1.1717, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: -3.88% (2.2633 => 2.1755, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (1.7753 => 1.7068, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.00% (1.3096 => 1.2703, std.dev.: 0.0103) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.72% (6.5735 => 6.4604, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 29 19:02:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 21:02:33 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121030020233.87CEC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5387?compare_to=5383&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5387, Order: 166984, Start Time: 2012-10-30 00:31:24, End Time: 2012-10-30 02:02:31 To: 5383, Order: 166970, Start Time: 2012-10-29 22:30:32, End Time: 2012-10-30 00:01:43 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (9 on baseline) New Passes: 0 (15 on baseline) Performance Regressions: 1 (170 on baseline) Performance Improvements: 2 (49 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 13 (4 on baseline) Unchanged Tests: 1026 (661 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 12.59% (0.4115 => 0.4633, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/treecc/treecc: -1.10% (2.2839 => 2.2588, std.dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.78% (80.3794 => 78.9476, std.dev.: 0.4520) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: 0.62% (1.9923 => 2.0046, std.dev.: 0.0150) MultiSource/Benchmarks/Bullet/bullet: -0.47% (57.2235 => 56.9532, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.25% (0.0790 => 0.0788, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -0.42% (8.9813 => 8.9438, std.dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.66% (7.6330 => 7.5828, std.dev.: 0.0030) SingleSource/UnitTests/Vector/SSE/sse_shift: -4.07% (0.0540 => 0.0518, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: - (0.0001 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.69% (0.0651 => 0.0675, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/SSE/sse_shift: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -65.19% (5.7591 => 2.0046, std.dev.: 0.0150) MultiSource/Benchmarks/Bullet/bullet: -9.95% (63.2438 => 56.9532, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.82% (6.6874 => 0.0788, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.92% (8.1363 => 8.9438, std.dev.: 0.0049) SingleSource/UnitTests/Vector/SSE/sse_shift: 37.04% (0.0378 => 0.0518, std.dev.: 0.0009) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -50.00% (0.0002 => 0.0001) SingleSource/UnitTests/Vector/SSE/sse_shift: -50.00% (0.0002 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 196.46% (0.5229 => 1.5502, std.dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: 12.73% (14.9895 => 16.8974, std.dev.: 0.0282) MultiSource/Applications/kimwitu++/kc: 35.15% (14.1553 => 19.1313, std.dev.: 0.0068) MultiSource/Benchmarks/MallocBench/gs/gs: 11.84% (4.1105 => 4.5971, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 28.45% (1.1048 => 1.4191, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: 66.57% (3.4629 => 5.7680, std.dev.: 0.0194) SingleSource/Benchmarks/Misc-C++/stepanov_container: 62.66% (0.6222 => 1.0121, std.dev.: 0.0005) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10544.86% (0.0720 => 7.6643, std.dev.: 0.0149) MultiSource/Applications/SIBsim4/SIBsim4: 3836000.00% (0.0001 => 3.8361, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 11183200.00% (0.0001 => 11.1833, std.dev.: 0.0126) MultiSource/Applications/kimwitu++/kc: 50500.00% (0.0001 => 0.0506, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049800.00% (0.0001 => 10.0499, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5500400.00% (0.0001 => 5.5005, std.dev.: 0.0052) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 37.88% (0.1056 => 0.1456, std.dev.: 0.0010) SingleSource/UnitTests/vla: 28.45% (0.0355 => 0.0456) SingleSource/Benchmarks/Misc/flops: 28.28% (0.1432 => 0.1837, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 19.48% (0.1566 => 0.1871, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 17.12% (0.0730 => 0.0855, std.dev.: 0.0007) SingleSource/UnitTests/SignlessTypes/rem: 17.05% (0.1144 => 0.1339, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 16.76% (0.0746 => 0.0871, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 16.58% (0.4879 => 0.5688, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 16.49% (0.3177 => 0.3701, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.42% (0.0871 => 0.1014, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.02% (0.0793 => 0.0920, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 16.00% (0.1175 => 0.1363, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.64% (0.8172 => 0.9450, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/08-main/main: 15.35% (0.2554 => 0.2946, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 15.03% (0.1584 => 0.1822, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.75% (0.0834 => 0.0957, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.25% (0.0842 => 0.0962, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 14.16% (0.1695 => 0.1935, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 14.10% (0.1163 => 0.1327, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 13.96% (0.1655 => 0.1886, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 13.87% (0.5105 => 0.5813, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.85% (0.2065 => 0.2351, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.67% (0.2758 => 0.3135, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.66% (0.0886 => 0.1007, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.52% (0.1117 => 0.1268, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 13.38% (0.7115 => 0.8067, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.37% (0.2700 => 0.3061, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 13.12% (0.1555 => 0.1759, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.12% (0.0770 => 0.0871, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 13.03% (0.1151 => 0.1301, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.99% (0.1940 => 0.2192, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.91% (0.1510 => 0.1705, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 12.87% (0.3109 => 0.3509, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.86% (0.1337 => 0.1509, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.82% (0.5981 => 0.6748, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.70% (0.4615 => 0.5201, std.dev.: 0.0036) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 12.62% (0.1125 => 0.1267, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.60% (0.6675 => 0.7516, std.dev.: 0.0049) MultiSource/Applications/d/make_dparser: 12.54% (3.3354 => 3.7535, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.53% (0.0798 => 0.0898, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.53% (0.2107 => 0.2371, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.51% (0.2271 => 0.2555, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 12.50% (0.7835 => 0.8814, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.44% (0.1029 => 0.1157, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.34% (0.1062 => 0.1193, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.31% (0.9765 => 1.0967, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.21% (0.3121 => 0.3502, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 12.15% (0.7433 => 0.8336, std.dev.: 0.0036) MultiSource/Applications/Burg/burg: 12.12% (1.1642 => 1.3053, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.05% (0.5569 => 0.6240, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.98% (0.5860 => 0.6562, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.95% (1.5415 => 1.7257, std.dev.: 0.0080) MultiSource/Applications/ClamAV/clamscan: 11.91% (22.1758 => 24.8168, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.73% (0.5020 => 0.5609, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.70% (1.3050 => 1.4577, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.68% (0.2603 => 0.2907, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.63% (0.1032 => 0.1152, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.61% (2.2022 => 2.4579, std.dev.: 0.0007) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.46% (0.1143 => 0.1274, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 11.44% (0.1268 => 0.1413, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 11.42% (2.0273 => 2.2588, std.dev.: 0.0028) MultiSource/Applications/lemon/lemon: 11.16% (1.0722 => 1.1919, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.07% (0.3441 => 0.3822, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 11.04% (0.3423 => 0.3801, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.00% (0.1236 => 0.1372, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.98% (0.6450 => 0.7158, std.dev.: 0.0019) MultiSource/Applications/lua/lua: 10.98% (3.8723 => 4.2973, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/trivial-interface: 10.97% (0.3473 => 0.3854) SingleSource/UnitTests/ObjC/parameter-passing: 10.90% (0.3927 => 0.4355, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 10.88% (1.1861 => 1.3151, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.87% (0.3543 => 0.3928, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.84% (0.3543 => 0.3927, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.84% (0.3497 => 0.3876, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 10.84% (0.3516 => 0.3897, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.80% (0.3307 => 0.3664, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.77% (0.1625 => 0.1800, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.76% (0.3561 => 0.3944, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions: 10.74% (0.3828 => 0.4239, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 10.70% (0.4299 => 0.4759, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 10.67% (0.3694 => 0.4088, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.57% (0.1892 => 0.2092, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.52% (0.3886 => 0.4295, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.49% (4.2646 => 4.7118, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/football/football: 10.48% (0.8921 => 0.9856, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.44% (0.1906 => 0.2105, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: 10.39% (0.1463 => 0.1615, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 10.14% (9.4845 => 10.4462, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/09-vor/vor: 10.00% (0.3180 => 0.3498, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.97% (0.1695 => 0.1864, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 9.95% (0.3387 => 0.3724, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.91% (1.5859 => 1.7430, std.dev.: 0.0180) MultiSource/Benchmarks/nbench/nbench: 9.86% (1.1840 => 1.3008, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 9.72% (0.4289 => 0.4706, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 9.67% (0.1044 => 0.1145, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.57% (0.8101 => 0.8876, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.29% (2.2024 => 2.4070, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/bigfib: 9.17% (0.6456 => 0.7048, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 9.06% (2.2969 => 2.5049, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.95% (1.4186 => 1.5455, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.89% (0.4636 => 0.5048, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.80% (14.3668 => 15.6308, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/hash2: 8.77% (0.4620 => 0.5025, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.67% (0.3865 => 0.4200, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 8.65% (0.3422 => 0.3718, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.54% (0.4203 => 0.4562, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 8.52% (0.1268 => 0.1376) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.52% (5.0018 => 5.4278, std.dev.: 0.0058) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.50% (0.1330 => 0.1443, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.40% (4.9449 => 5.3601, std.dev.: 0.0082) SingleSource/UnitTests/ObjC++/Hello: 8.32% (0.5925 => 0.6418, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.24% (0.6030 => 0.6527, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.24% (0.4103 => 0.4441, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 8.19% (0.7326 => 0.7926, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 8.11% (1.5603 => 1.6868, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/moments: 8.05% (0.4048 => 0.4374, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 7.95% (0.3684 => 0.3977, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 7.69% (0.3603 => 0.3880, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.49% (0.2430 => 0.2612, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.12% (0.3650 => 0.3910, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.05% (0.2793 => 0.2990, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.99% (0.2891 => 0.3093, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 6.99% (17.1811 => 18.3813, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.97% (0.3427 => 0.3666, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/strcat: 6.89% (0.2831 => 0.3026, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.89% (2.0665 => 2.2088, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.87% (0.3826 => 0.4089, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.82% (0.4064 => 0.4341, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.80% (0.3162 => 0.3377, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.78% (0.2905 => 0.3102, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 6.78% (0.3098 => 0.3308, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.3283 => 0.3505, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.75% (0.2725 => 0.2909, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 6.65% (0.3232 => 0.3447, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 6.51% (0.2871 => 0.3058, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 6.49% (0.3282 => 0.3495, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.46% (0.2756 => 0.2934, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 6.45% (0.2714 => 0.2889, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.41% (0.2872 => 0.3056, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.40% (0.2877 => 0.3061, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.39% (0.3052 => 0.3247, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 6.21% (0.2802 => 0.2976, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 5.74% (1.2842 => 1.3579, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 5.71% (0.3379 => 0.3572, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.45% (0.8067 => 0.8507, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/bh/bh: 5.40% (0.3092 => 0.3259, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.18% (3.8922 => 4.0940, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.04% (0.3136 => 0.3294, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.68% (0.2266 => 0.2372, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.34% (0.3131 => 0.3267, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.27% (0.3817 => 0.3942, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.62% (0.3935 => 0.4038, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.67% (7.9617 => 8.0945, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.66% (7.0540 => 7.1713, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8953, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.64% (1.1145 => 1.3000, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2178, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.78% (1.1396 => 1.2510, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3684, std.dev.: 0.0006) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.71% (4.2280 => 4.3426, std.dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.41% (1.0313 => 1.0562, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7651, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2079, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 1.31% (11.6436 => 11.7959, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.06% (6.5088 => 6.5778, std.dev.: 0.0086) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -76.77% (0.8651 => 0.2010, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.58% (5.3855 => 2.3921, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -55.25% (5.3526 => 2.3952, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: -45.87% (0.1622 => 0.0878) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.29% (1.1194 => 0.6796, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.08% (5.2763 => 3.2669, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -24.32% (1.7609 => 1.3327, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -17.09% (2.9384 => 2.4362, std.dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: -10.53% (10.4361 => 9.3377, std.dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -9.17% (54.1659 => 49.1970, std.dev.: 0.0364) MultiSource/Benchmarks/PAQ8p/paq8p: -3.40% (10.3673 => 10.0152, std.dev.: 0.0072) MultiSource/Applications/JM/lencod/lencod: -2.34% (21.9371 => 21.4242, std.dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.99% (0.0506 => 0.0334) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -33.68% (0.3987 => 0.2644) SingleSource/Benchmarks/Misc/mandel: -33.42% (1.1492 => 0.7651, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -15.76% (1.6925 => 1.4257, std.dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: -10.98% (9.5636 => 8.5132, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -10.89% (1.5373 => 1.3699, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.41% (19.9488 => 18.2706, std.dev.: 0.0232) MultiSource/Benchmarks/FreeBench/mason/mason: -7.87% (0.2161 => 0.1991, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4780, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.95% (1.8329 => 1.7056, std.dev.: 0.0155) SingleSource/Benchmarks/McGill/chomp: -6.19% (1.2373 => 1.1607, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -5.45% (6.6465 => 6.2841, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.08% (1.6805 => 1.5951, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-5: -5.05% (1.5835 => 1.5035, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.08% (0.2497 => 0.2395, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.90% (0.9957 => 0.9569, std.dev.: 0.0021) MultiSource/Applications/siod/siod: -3.74% (3.2827 => 3.1599, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.56% (32.5116 => 31.3551, std.dev.: 0.0158) MultiSource/Benchmarks/sim/sim: -3.23% (5.0483 => 4.8850, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.87% (0.4808 => 0.4670, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.81% (4.5009 => 4.3746, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: -2.71% (4.6441 => 4.5182, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.17% (8.1563 => 7.9795, std.dev.: 0.0229) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.87% (10.2830 => 10.0902, std.dev.: 0.0181) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6824, std.dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -1.50% (2.5528 => 2.5145, std.dev.: 0.0047) MultiSource/Benchmarks/PAQ8p/paq8p: -1.21% (85.0658 => 84.0353, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8568, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/power/power: -1.01% (1.1277 => 1.1163, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.93% (7.1582 => 7.5828, std.dev.: 0.0030) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.10% (0.2116 => 0.0675, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 3.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 29 20:06:23 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 22:06:23 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121030030623.690462A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5388?compare_to=5385&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5388, Order: 166991, Start Time: 2012-10-30 01:39:06, End Time: 2012-10-30 03:06:22 To: 5385, Order: 166982, Start Time: 2012-10-29 23:53:41, End Time: 2012-10-30 01:21:49 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 6 (93 on baseline) Performance Improvements: 11 (5 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 974 (876 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.67% (0.3075 => 0.3188, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.45% (0.9658 => 0.9895, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/gs/gs: 2.32% (4.2079 => 4.3054, std.dev.: 0.0253) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.47% (8.9066 => 9.0375, std.dev.: 0.0335) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.30% (0.7859 => 0.7961, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: 1.08% (8.9192 => 9.0157, std.dev.: 0.0085) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.05% (0.8743 => 0.8476, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.54% (0.9523 => 0.9281, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -2.27% (0.9205 => 0.8996, std.dev.: 0.0072) MultiSource/Benchmarks/VersaBench/dbms/dbms: -2.13% (0.9189 => 0.8993, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.02% (2.2111 => 2.1664, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.95% (14.2247 => 13.9479, std.dev.: 0.0465) MultiSource/Benchmarks/Prolangs-C/football/football: -1.40% (0.9190 => 0.9061, std.dev.: 0.0033) MultiSource/Applications/siod/siod: -1.29% (2.2761 => 2.2468, std.dev.: 0.0050) MultiSource/Applications/oggenc/oggenc: -1.04% (5.0701 => 5.0173, std.dev.: 0.0060) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/recursive: -1.59% (2.5178 => 2.4778, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/pi: -1.15% (2.5138 => 2.4849, std.dev.: 0.0035) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.71% (16.6966 => 16.5779, std.dev.: 0.2719) MultiSource/Applications/obsequi/Obsequi: 0.77% (1.0678 => 1.0760, std.dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.81% (21.7073 => 21.5324, std.dev.: 0.2599) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.05% (0.3641 => 0.3639, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -0.99% (0.6050 => 0.5990, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.52% (0.3297 => 0.3314, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/strcat: 0.15% (0.1999 => 0.2002, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -35.94% (0.0217 => 0.0139, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -9.15% (0.0426 => 0.0387, std.dev.: 0.0053) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -7.51% (0.0333 => 0.0308, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -8.63% (0.0313 => 0.0286, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.24% (0.0422 => 0.0423, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -31.34% (0.0201 => 0.0138, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/test1: -32.09% (0.0215 => 0.0146, std.dev.: 0.0034) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -30.77% (0.0013 => 0.0009, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.96% (0.1456 => 0.1470, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -2.35% (1.1490 => 1.1220, std.dev.: 0.0401) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1519 => 0.1518, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.40% (0.3981 => 0.3997, std.dev.: 0.0326) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.08% (0.1317 => 0.1318, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.50% (0.0679 => 0.0696, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.59% (0.0270 => 0.0277, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.58% (0.0536 => 0.0582, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.07% (1.1447 => 1.1439, std.dev.: 0.0229) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 72.22% (0.0018 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 3.85% (0.0026 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.07% (0.0652 => 0.0645, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.41% (0.0266 => 0.0233, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.74% (0.7945 => 0.8004, std.dev.: 0.0076) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -12.96% (0.0054 => 0.0047, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2329.26% (0.6332 => 15.3821, std.dev.: 0.1654) MultiSource/Benchmarks/McCat/08-main/main: 50.25% (0.1831 => 0.2751, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.84% (0.1559 => 0.1468, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1472.91% (0.3344 => 5.2598, std.dev.: 0.0825) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.00% (0.2364 => 0.3215, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: -17.48% (0.0429 => 0.0354, std.dev.: 0.0043) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -12.05% (0.0224 => 0.0197, std.dev.: 0.0018) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0000) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4332, std.dev.: 0.0124) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0686, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4935, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3376, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0391, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4017, std.dev.: 0.0045) SingleSource/Regression/C/uint64_to_float: -23.85% (2.1832 => 1.6626, std.dev.: 0.0025) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 36.01% (14.7684 => 20.0869, std.dev.: 0.0131) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.16% (0.0810 => 0.0949, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 14.48% (0.1112 => 0.1273, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.74% (0.0848 => 0.0956, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 11.79% (0.1137 => 0.1271, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.50% (0.2180 => 0.2387, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.08% (0.8321 => 0.8993, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.71% (0.1466 => 0.1579, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/health/health: 7.65% (0.1347 => 0.1450, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.51% (0.1425 => 0.1532, std.dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 7.17% (1.2568 => 1.3469, std.dev.: 0.0038) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.04% (0.3137 => 0.3358, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.00% (0.6010 => 0.6431, std.dev.: 0.0089) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.82% (0.1905 => 0.2035, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.63% (0.8148 => 0.8688, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.53% (0.7473 => 0.7961, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.26% (0.1885 => 0.2003, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.17% (0.4847 => 0.5146, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.16% (0.3003 => 0.3188, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.90% (0.2998 => 0.3175, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.83% (1.1170 => 1.1821, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.82% (13.1811 => 13.9479, std.dev.: 0.0465) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.76% (0.2519 => 0.2664, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.67% (6.6074 => 6.9819, std.dev.: 0.0287) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.34% (0.6287 => 0.6623, std.dev.: 0.0035) MultiSource/Applications/spiff/spiff: 5.21% (0.7950 => 0.8364, std.dev.: 0.0055) MultiSource/Benchmarks/nbench/nbench: 5.18% (1.1271 => 1.1855, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.18% (0.2240 => 0.2356, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.11% (1.6386 => 1.7223, std.dev.: 0.0108) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.04% (0.1983 => 0.2083, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.88% (0.9435 => 0.9895, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.70% (0.3295 => 0.3450, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.67% (0.2741 => 0.2869, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.51% (8.6476 => 9.0375, std.dev.: 0.0335) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.45% (1.1685 => 1.2205, std.dev.: 0.0185) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.40% (1.1606 => 1.2117, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/gs/gs: 4.23% (4.1305 => 4.3054, std.dev.: 0.0253) MultiSource/Applications/treecc/treecc: 4.23% (1.9948 => 2.0791, std.dev.: 0.0094) MultiSource/Benchmarks/McCat/05-eks/eks: 4.14% (0.4397 => 0.4579, std.dev.: 0.0032) MultiSource/Applications/Burg/burg: 4.12% (1.2222 => 1.2726, std.dev.: 0.0146) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.11% (0.6227 => 0.6483, std.dev.: 0.0066) MultiSource/Applications/sgefa/sgefa: 4.00% (0.2999 => 0.3119, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.96% (1.3279 => 1.3805, std.dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.86% (0.4559 => 0.4735, std.dev.: 0.0022) MultiSource/Applications/hbd/hbd: 3.77% (1.4269 => 1.4807, std.dev.: 0.0131) MultiSource/Applications/d/make_dparser: 3.74% (3.2366 => 3.3578, std.dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.47% (0.5817 => 0.6019, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 3.45% (14.2605 => 14.7528, std.dev.: 0.0339) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.41% (0.4783 => 0.4946, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.37% (0.5191 => 0.5366, std.dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.36% (0.3717 => 0.3842, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 3.34% (0.8768 => 0.9061, std.dev.: 0.0033) MultiSource/Applications/lua/lua: 3.28% (3.8189 => 3.9441, std.dev.: 0.0369) SingleSource/Benchmarks/Shootout-C++/hash2: 2.93% (0.4125 => 0.4246, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.92% (4.4873 => 4.6182, std.dev.: 0.0379) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.81% (0.8611 => 0.8853, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.81% (4.1763 => 4.2935, std.dev.: 0.0254) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.63% (0.6586 => 0.6759, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.47% (0.8697 => 0.8912, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.41% (4.4880 => 4.5960, std.dev.: 0.0272) MultiSource/Applications/JM/ldecod/ldecod: 2.37% (6.7320 => 6.8913, std.dev.: 0.0304) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.34% (0.8597 => 0.8798, std.dev.: 0.0074) MultiSource/Applications/JM/lencod/lencod: 2.33% (15.3280 => 15.6856, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.28% (0.9074 => 0.9281, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.21% (0.8286 => 0.8469, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.21% (0.8340 => 0.8524, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.20% (0.8712 => 0.8904, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.17% (1.2423 => 1.2693, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.17% (0.8805 => 0.8996, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.12% (0.7966 => 0.8135, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.11% (0.8050 => 0.8220, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.03% (0.8359 => 0.8529, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.95% (4.5702 => 4.6594, std.dev.: 0.0244) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.87% (0.8927 => 0.9094, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.86% (0.8204 => 0.8357, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.86% (0.8855 => 0.9020, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.68% (1.4479 => 1.4722, std.dev.: 0.0074) MultiSource/Benchmarks/PAQ8p/paq8p: 1.53% (2.3764 => 2.4127, std.dev.: 0.0075) MultiSource/Applications/siod/siod: 1.28% (2.2184 => 2.2468, std.dev.: 0.0050) MultiSource/Applications/oggenc/oggenc: 1.10% (4.9628 => 5.0173, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 57.32% (1.5795 => 2.4849, std.dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.23% (2.4333 => 2.6578, std.dev.: 0.0263) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.11% (1.1857 => 1.2819, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.94% (0.3186 => 0.3439, std.dev.: 0.0078) MultiSource/Benchmarks/mafft/pairlocalalign: 5.95% (63.1822 => 66.9444, std.dev.: 0.0692) SingleSource/Benchmarks/Misc/ReedSolomon: 2.90% (8.5322 => 8.7800, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.73% (0.4031 => 0.4141, std.dev.: 0.0018) MultiSource/Applications/siod/siod: 2.66% (3.6643 => 3.7616, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/mason/mason: 2.33% (0.5415 => 0.5541, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 1.68% (2.3560 => 2.3955, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/richards_benchmark: 1.43% (1.3037 => 1.3223, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.18% (2.4490 => 2.4778, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.10% (4.4340 => 4.4829, std.dev.: 0.0167) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.04% (0.3269 => 0.3039, std.dev.: 0.0015) MultiSource/Applications/lua/lua: -5.39% (29.8330 => 28.2245, std.dev.: 0.2193) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -2.73% (22.2997 => 21.6902, std.dev.: 0.2118) SingleSource/Benchmarks/Shootout-C++/hash2: -1.45% (3.4237 => 3.3741, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.20% (3.3479 => 3.3077, std.dev.: 0.0013) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.80% (16.4461 => 16.5779, std.dev.: 0.2719) MultiSource/Applications/obsequi/Obsequi: 4.85% (1.0262 => 1.0760, std.dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6794.78% (0.3123 => 21.5324, std.dev.: 0.2599) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.75% (0.2463 => 0.3639, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -0.33% (0.6010 => 0.5990, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.47% (0.3266 => 0.3314, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/strcat: 1.68% (0.1969 => 0.2002, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 13.01% (0.0123 => 0.0139, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.15% (0.0408 => 0.0387, std.dev.: 0.0053) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 21.26% (0.0254 => 0.0308, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -5.30% (0.0302 => 0.0286, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -27.37% (0.0190 => 0.0138, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/test1: -18.89% (0.0180 => 0.0146, std.dev.: 0.0034) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 28.57% (0.0007 => 0.0009, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.23% (0.1438 => 0.1470, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.96% (1.1329 => 1.1220, std.dev.: 0.0401) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.83% (0.1462 => 0.1518, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.01% (0.4164 => 0.3997, std.dev.: 0.0326) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.73% (0.1369 => 0.1318, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.58% (0.0641 => 0.0696, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.69% (0.0578 => 0.0582, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.02% (1.1437 => 1.1439, std.dev.: 0.0229) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.87% (0.0627 => 0.0645, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 29.44% (0.0180 => 0.0233, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.16% (0.8017 => 0.8004, std.dev.: 0.0076) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -24.19% (0.0062 => 0.0047, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 29 20:11:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 22:11:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121030031139.451762A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5389?compare_to=5381&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5389, Order: 166977, Start Time: 2012-10-29 23:56:20, End Time: 2012-10-30 03:11:37 To: 5381, Order: 166958, Start Time: 2012-10-29 19:51:33, End Time: 2012-10-29 23:08:01 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (171 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1040 (718 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.42% (1.9707 => 1.9986, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 1.05% (2.4380 => 2.4636, std.dev.: 0.0042) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.12% (0.0625 => 0.0882, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.36% (0.1063 => 0.1407, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.04% (0.2969 => 0.3742, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.50% (0.1106 => 0.1388, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 25.45% (1.5932 => 1.9986, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.21% (0.0714 => 0.0894, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.27% (0.4253 => 0.5285, std.dev.: 0.0087) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.04% (0.4139 => 0.5134, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.58% (0.0547 => 0.0676, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.51% (0.5900 => 0.7287, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.49% (0.4994 => 0.6167, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.30% (0.0897 => 0.1106, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.08% (0.5000 => 0.6154, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.95% (0.0475 => 0.0584, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.60% (0.0584 => 0.0716, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.73% (0.1620 => 0.1972, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.55% (0.1021 => 0.1241, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.50% (0.1107 => 0.1345, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 21.37% (0.0599 => 0.0727, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 20.78% (0.0948 => 0.1145, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.54% (0.0633 => 0.0763) MultiSource/Benchmarks/Olden/power/power: 20.53% (0.0604 => 0.0728, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.40% (0.0495 => 0.0596, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.38% (0.0584 => 0.0703, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.33% (0.0541 => 0.0651, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.25% (0.0642 => 0.0772, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.22% (0.1103 => 0.1326, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.19% (0.3903 => 0.4691, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 19.98% (0.0821 => 0.0985, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.94% (0.1003 => 0.1203, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.63% (0.1549 => 0.1853, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 19.58% (0.1619 => 0.1936, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.51% (0.1604 => 0.1917, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.34% (0.0822 => 0.0981, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.74% (0.1462 => 0.1736, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 18.69% (0.0947 => 0.1124, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.56% (0.0582 => 0.0690, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 18.44% (0.0808 => 0.0957, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.28% (0.3890 => 0.4601, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.07% (0.2014 => 0.2378, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 18.06% (0.1218 => 0.1438, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 17.77% (0.0698 => 0.0822, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 17.72% (0.4029 => 0.4743, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 17.67% (0.1505 => 0.1771, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.61% (1.3152 => 1.5468, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.56% (0.1088 => 0.1279, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 17.49% (0.5826 => 0.6845, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.47% (0.2736 => 0.3214, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 17.03% (1.8794 => 2.1994, std.dev.: 0.0036) MultiSource/Applications/Burg/burg: 17.02% (0.5546 => 0.6490, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 17.00% (0.5889 => 0.6890, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.99% (0.2866 => 0.3353, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.82% (3.5627 => 4.1618, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.67% (0.1968 => 0.2296, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.64% (0.1160 => 0.1353, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.58% (1.6211 => 1.8898, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.51% (0.4658 => 0.5427, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: 16.47% (0.9697 => 1.1294, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 16.40% (0.1421 => 0.1654, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.35% (0.5026 => 0.5848, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: 16.35% (1.0781 => 1.2544, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.20% (0.3271 => 0.3801, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.09% (0.3195 => 0.3709, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.07% (0.2738 => 0.3178, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.03% (0.2875 => 0.3336, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.77% (1.9694 => 2.2799, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.75% (0.4361 => 0.5048, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 15.73% (0.1284 => 0.1486, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.62% (0.3930 => 0.4544, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 15.58% (4.2109 => 4.8669, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/fibo: 15.56% (0.2725 => 0.3149, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.55% (1.9966 => 2.3071, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.54% (2.7292 => 3.1534, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.50% (0.1090 => 0.1259, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 15.48% (0.3004 => 0.3469, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.43% (4.4195 => 5.1016, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: 15.36% (0.2813 => 0.3245, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 15.30% (23.5202 => 27.1185, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/hello: 15.29% (0.2714 => 0.3129, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 15.27% (0.2823 => 0.3254, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.26% (2.0673 => 2.3828, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: 15.24% (0.2750 => 0.3169, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.17% (0.2729 => 0.3143, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 15.17% (0.9909 => 1.1412, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 15.13% (0.7171 => 0.8256, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: 15.11% (0.2780 => 0.3200, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 15.02% (0.2803 => 0.3224, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.97% (0.2792 => 0.3210, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 14.89% (0.3096 => 0.3557, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: 14.87% (0.2811 => 0.3229, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.81% (0.2911 => 0.3342, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 14.72% (0.3267 => 0.3748, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.65% (0.3625 => 0.4156, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 14.58% (0.3258 => 0.3733, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 14.36% (0.2075 => 0.2373, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 14.32% (0.3317 => 0.3792, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.25% (0.3362 => 0.3841, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 14.19% (0.3460 => 0.3951, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 14.17% (0.3465 => 0.3956, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 14.16% (0.3496 => 0.3991, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.15% (0.3060 => 0.3493, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 14.11% (0.2566 => 0.2928, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 14.09% (0.3442 => 0.3927, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.08% (0.3488 => 0.3979, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 14.07% (0.3446 => 0.3931, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 14.06% (1.4269 => 1.6275, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/synchronized: 14.01% (0.3469 => 0.3955, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 13.97% (0.3678 => 0.4192, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.96% (0.3124 => 0.3560, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 13.86% (0.3348 => 0.3812, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 13.80% (0.7875 => 0.8962, std.dev.: 0.0030) MultiSource/Applications/JM/ldecod/ldecod: 13.78% (2.1653 => 2.4636, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/property: 13.70% (0.3650 => 0.4150, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 13.67% (0.3643 => 0.4141, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.65% (0.3282 => 0.3730, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 13.64% (0.3724 => 0.4232, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 13.55% (0.3477 => 0.3948, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 13.50% (0.3726 => 0.4229, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.50% (0.3845 => 0.4364, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 13.38% (4.6177 => 5.2355, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/hash2: 13.36% (0.4251 => 0.4819, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 13.34% (0.4146 => 0.4699, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.28% (0.3690 => 0.4180, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.19% (0.3981 => 0.4506, std.dev.: 0.0084) MultiSource/Benchmarks/mafft/pairlocalalign: 12.76% (2.1013 => 2.3695, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/bigfib: 12.69% (0.5012 => 0.5648, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 12.19% (0.2691 => 0.3019, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.16% (0.2040 => 0.2288, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 11.77% (5.5417 => 6.1940, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.67% (0.1028 => 0.1148, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.56% (0.6435 => 0.7179, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.56% (0.2068 => 0.2307, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 11.23% (0.3498 => 0.3891, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 11.03% (0.6634 => 0.7366, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.81% (0.2737 => 0.3033, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.77% (0.1383 => 0.1532) MultiSource/Benchmarks/PAQ8p/paq8p: 10.65% (0.4847 => 0.5363, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 10.46% (0.3336 => 0.3685, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.34% (0.3084 => 0.3403, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.22% (0.2103 => 0.2318, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 9.82% (2.0346 => 2.2343, std.dev.: 0.0048) MultiSource/Applications/lemon/lemon: 9.49% (0.2391 => 0.2618, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.19% (4.6926 => 5.1237, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.75% (0.5361 => 0.5830, std.dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.64% (11.6398 => 12.6460, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.20% (0.7426 => 0.8035, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.18% (0.5584 => 0.6041, std.dev.: 0.0112) MultiSource/Applications/kimwitu++/kc: 6.71% (11.9555 => 12.7577, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.77% (0.3792 => 0.3973, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6532, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 8.60% (0.2802 => 0.3043, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6097, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 5.28% (0.2122 => 0.2234, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.01% (12.0509 => 12.6551, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1689, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-2: 3.93% (1.8057 => 1.8767, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/dry: 2.78% (14.0481 => 14.4386, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1959, std.dev.: 0.0030) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.83% (3.1722 => 3.2302, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3040, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2894, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5139, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5401, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 1.10% (50.0626 => 50.6141, std.dev.: 0.0102) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.07% (1.2451 => 1.2584, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.30% (2.4764 => 2.4194, std.dev.: 0.0149) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.49% (25.4195 => 16.3983, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ary2: -8.45% (0.2402 => 0.2199, std.dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9771, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.67% (35.5013 => 32.7767, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: -7.18% (2.1113 => 1.9598, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.18% (0.6293 => 0.6093, std.dev.: 0.0061) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7742, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5219, std.dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -2.83% (11.2080 => 10.8913, std.dev.: 0.0227) SingleSource/Benchmarks/Dhrystone/fldry: -2.31% (17.2379 => 16.8405, std.dev.: 0.0133) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.19% (41.7953 => 40.8789, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5715, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: -1.56% (5.5810 => 5.4941, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.18% (105.3826 => 104.1396, std.dev.: 0.0852) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0420, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.03% (3.3991 => 3.3642, std.dev.: 0.0005) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 29 20:50:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 22:50:11 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121030035011.559652A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5390?compare_to=5386&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5390, Order: 166996, Start Time: 2012-10-30 02:24:42, End Time: 2012-10-30 03:50:09 To: 5386, Order: 166985, Start Time: 2012-10-30 00:36:17, End Time: 2012-10-30 02:01:35 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (176 on baseline) Unchanged Tests: 1042 (861 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.40% (15.2527 => 18.3641, std.dev.: 0.0196) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.88% (2.0478 => 2.1068, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/salsa20: 2.38% (7.4937 => 7.6721, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 1.93% (3.1932 => 3.2549, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.60% (0.1431 => 0.1308, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.33% (0.1584 => 0.1452, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.28% (0.3821 => 0.3543, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -6.55% (2.4924 => 2.3292, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/ReedSolomon: -6.33% (0.1879 => 0.1760, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.31% (22.4056 => 20.9926, std.dev.: 0.0127) SingleSource/UnitTests/ObjC/exceptions-2: -6.29% (0.3831 => 0.3590, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.27% (0.3142 => 0.2945, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -6.24% (0.3880 => 0.3638, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.22% (0.2428 => 0.2277, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: -6.21% (0.3848 => 0.3609, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -6.19% (0.3812 => 0.3576, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.18% (0.3884 => 0.3644, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -6.15% (0.4176 => 0.3919, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -6.15% (0.4033 => 0.3785, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -6.13% (0.3896 => 0.3657, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.12% (0.3891 => 0.3653, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -6.03% (0.4199 => 0.3946, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.01% (0.3658 => 0.3438, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.87% (5.4682 => 5.1473, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: -5.84% (0.4280 => 0.4030, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.83% (3.5339 => 3.3278, std.dev.: 0.0185) MultiSource/Applications/sgefa/sgefa: -5.81% (0.3357 => 0.3162, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.79% (4.5069 => 4.2460, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: -5.79% (0.2160 => 0.2035, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.78% (0.9852 => 0.9283, std.dev.: 0.0091) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.77% (0.2355 => 0.2219, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.75% (0.6484 => 0.6111, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.71% (1.6474 => 1.5533, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.67% (0.9542 => 0.9001, std.dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: -5.59% (16.1920 => 15.2870, std.dev.: 0.0102) MultiSource/Applications/JM/ldecod/ldecod: -5.57% (7.0961 => 6.7009, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/08-main/main: -5.57% (0.2659 => 0.2511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.54% (0.4151 => 0.3921, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.53% (0.3837 => 0.3625, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.50% (2.1713 => 2.0518, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: -5.49% (0.3025 => 0.2859, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.47% (0.3252 => 0.3074, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.46% (0.4083 => 0.3860, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.45% (4.8161 => 4.5534, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.45% (4.0323 => 3.8124, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.43% (0.3849 => 0.3640, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.43% (4.8802 => 4.6154, std.dev.: 0.0028) MultiSource/Applications/Burg/burg: -5.43% (1.2515 => 1.1836, std.dev.: 0.0039) SingleSource/UnitTests/ObjC++/property-reference: -5.42% (0.7779 => 0.7357, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.42% (0.3323 => 0.3143, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -5.41% (0.4861 => 0.4598, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.41% (0.2903 => 0.2746, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.40% (0.3057 => 0.2892, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: -5.39% (0.3026 => 0.2863, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -5.39% (0.3194 => 0.3022, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -5.38% (0.2939 => 0.2781, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.37% (0.4321 => 0.4089, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -5.36% (2.4021 => 2.2733, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.31% (1.0544 => 0.9984, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.30% (0.5999 => 0.5681, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hello: -5.30% (0.2849 => 0.2698, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -5.30% (0.3059 => 0.2897, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.30% (1.2784 => 1.2107, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.29% (0.3931 => 0.3723, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -5.26% (4.3330 => 4.1051, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/fibo: -5.26% (0.2871 => 0.2720, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -5.26% (1.3148 => 1.2457, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: -5.25% (0.2989 => 0.2832, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: -5.25% (0.3621 => 0.3431, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.25% (1.2221 => 1.1580, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary2: -5.23% (0.3481 => 0.3299, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -5.22% (0.3255 => 0.3085, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.19% (1.2210 => 1.1576, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.17% (0.3016 => 0.2860, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.13% (0.7919 => 0.7513, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: -5.13% (0.2985 => 0.2832, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists1: -5.12% (0.3867 => 0.3669, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -5.12% (0.3205 => 0.3041, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -5.11% (0.6750 => 0.6405, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -5.11% (0.4248 => 0.4031, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.08% (2.2587 => 2.1439, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: -5.01% (0.6441 => 0.6118, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.01% (0.8521 => 0.8094, std.dev.: 0.0044) MultiSource/Applications/lua/lua: -5.00% (4.0594 => 3.8565, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: -4.98% (9.2283 => 8.7688, std.dev.: 0.0079) SingleSource/UnitTests/ObjC++/Hello: -4.98% (0.6347 => 0.6031, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.97% (0.4427 => 0.4207, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.97% (0.2999 => 0.2850, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.96% (0.2278 => 0.2165, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.96% (0.3491 => 0.3318, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -4.95% (0.3394 => 0.3226, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: -4.94% (18.2933 => 17.3900, std.dev.: 0.0234) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -4.94% (1.6364 => 1.5556, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: -4.94% (0.3788 => 0.3601, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -4.93% (0.3446 => 0.3276, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -4.92% (34.0927 => 32.4149, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.80% (0.5859 => 0.5578, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.79% (0.6052 => 0.5762, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.77% (1.4642 => 1.3944, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.76% (0.6304 => 0.6004, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.75% (0.5575 => 0.5310, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.74% (0.5805 => 0.5530, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -4.72% (0.7982 => 0.7605, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.67% (0.4813 => 0.4588, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.65% (0.9557 => 0.9113, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.64% (0.6446 => 0.6147, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.63% (1.3722 => 1.3086, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.63% (0.6260 => 0.5970, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.63% (0.5591 => 0.5332, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.63% (0.5705 => 0.5441, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.63% (0.5857 => 0.5586, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.62% (0.6230 => 0.5942, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.62% (0.6667 => 0.6359, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.61% (0.6676 => 0.6368, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.61% (0.6660 => 0.6353, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.60% (0.2933 => 0.2798, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.59% (0.5925 => 0.5653, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.57% (0.7524 => 0.7180, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.56% (0.5849 => 0.5582, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.55% (0.5802 => 0.5538, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.54% (0.6293 => 0.6007, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.54% (0.7339 => 0.7006, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.54% (0.5863 => 0.5597, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.53% (0.5581 => 0.5328, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: -4.53% (0.4524 => 0.4319, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: -4.52% (0.3581 => 0.3419, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.52% (0.3319 => 0.3169, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: -4.50% (0.4515 => 0.4312, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.49% (0.5570 => 0.5320, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.48% (0.4916 => 0.4696, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.47% (0.6395 => 0.6109, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.46% (0.5941 => 0.5676, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.46% (0.6189 => 0.5913, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.46% (0.6033 => 0.5764, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.45% (0.5478 => 0.5234, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.43% (0.6297 => 0.6018, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.43% (0.6681 => 0.6385, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.42% (0.6194 => 0.5920, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.42% (0.5569 => 0.5323, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.40% (0.2385 => 0.2280, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.39% (0.6395 => 0.6114, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: -4.36% (0.7447 => 0.7122, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.36% (0.5456 => 0.5218, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.31% (0.5688 => 0.5443, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.27% (0.6440 => 0.6165, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: -4.26% (0.9179 => 0.8788, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.26% (0.5567 => 0.5330, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.24% (0.7198 => 0.6893, std.dev.: 0.0015) MultiSource/Benchmarks/sim/sim: -4.17% (0.3406 => 0.3264, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.13% (0.7021 => 0.6731, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -4.08% (1.1450 => 1.0983, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: -4.00% (15.5079 => 14.8873, std.dev.: 0.0047) MultiSource/Applications/oggenc/oggenc: -3.95% (5.0226 => 4.8241, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.93% (0.3483 => 0.3346, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -3.92% (0.8418 => 0.8088, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -3.90% (8.0126 => 7.7000, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.81% (0.5168 => 0.4971, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: -3.79% (0.3271 => 0.3147, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.78% (6.7716 => 6.5155, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.71% (0.9077 => 0.8740, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: -3.70% (17.1032 => 16.4697, std.dev.: 0.0062) MultiSource/Applications/treecc/treecc: -3.70% (2.1401 => 2.0609, std.dev.: 0.0101) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.70% (0.6736 => 0.6487, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: -3.65% (1.5610 => 1.5041, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.64% (0.5329 => 0.5135, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: -3.57% (3.5154 => 3.3899, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.40% (1.2300 => 1.1882, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: -3.31% (1.1530 => 1.1148, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.84% (14.2083 => 13.8044, std.dev.: 0.0092) SingleSource/UnitTests/Vector/constpool: -2.15% (20.7746 => 20.3281, std.dev.: 0.0411) MultiSource/Applications/SIBsim4/SIBsim4: -1.66% (1.3864 => 1.3634, std.dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7567, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1723, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -3.85% (2.2633 => 2.1761, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.75% (1.3096 => 1.2736, std.dev.: 0.0080) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.56% (6.5735 => 6.4711, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0002) Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 29 21:03:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 23:03:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121030040330.E63BC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5391?compare_to=5387&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5391, Order: 166996, Start Time: 2012-10-30 02:32:12, End Time: 2012-10-30 04:03:30 To: 5387, Order: 166984, Start Time: 2012-10-30 00:31:24, End Time: 2012-10-30 02:02:31 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (9 on baseline) New Passes: 0 (15 on baseline) Performance Regressions: 2 (170 on baseline) Performance Improvements: 0 (48 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 13 (4 on baseline) Unchanged Tests: 1027 (662 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 1.49% (24.8168 => 25.1873, std.dev.: 0.0193) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.78% (55.0213 => 56.5532, std.dev.: 0.0747) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: 0.13% (2.0046 => 2.0072, std.dev.: 0.0079) MultiSource/Benchmarks/Bullet/bullet: -1.02% (56.9532 => 56.3750, std.dev.: 0.0293) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.25% (0.0788 => 0.0790, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 0.25% (8.9438 => 8.9661, std.dev.: 0.0072) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.85% (7.5828 => 7.6470, std.dev.: 0.0038) SingleSource/UnitTests/Vector/SSE/sse_shift: 1.16% (0.0518 => 0.0524, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: - (0.0001 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0675 => 0.0676, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0001 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0001 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/SSE/sse_shift: - (0.0001 => 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: -65.15% (5.7591 => 2.0072, std.dev.: 0.0079) MultiSource/Benchmarks/Bullet/bullet: -10.86% (63.2438 => 56.3750, std.dev.: 0.0293) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -98.82% (6.6874 => 0.0790, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.20% (8.1363 => 8.9661, std.dev.: 0.0072) SingleSource/UnitTests/Vector/SSE/sse_shift: 38.62% (0.0378 => 0.0524, std.dev.: 0.0009) New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -99.75% (0.0400 => 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -50.00% (0.0002 => 0.0001) SingleSource/UnitTests/Vector/SSE/sse_shift: -50.00% (0.0002 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 197.78% (0.5229 => 1.5571, std.dev.: 0.0064) MultiSource/Applications/SPASS/SPASS: 13.24% (14.9895 => 16.9748, std.dev.: 0.0047) MultiSource/Applications/kimwitu++/kc: 35.91% (14.1553 => 19.2389, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/gs/gs: 12.03% (4.1105 => 4.6048, std.dev.: 0.0139) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 29.03% (1.1048 => 1.4255, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.61% (3.4629 => 5.8040, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/stepanov_container: 63.31% (0.6222 => 1.0161, std.dev.: 0.0010) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10542.22% (0.0720 => 7.6624, std.dev.: 0.0049) MultiSource/Applications/SIBsim4/SIBsim4: 3836400.00% (0.0001 => 3.8365, std.dev.: 0.0040) MultiSource/Applications/SPASS/SPASS: 11183600.00% (0.0001 => 11.1837, std.dev.: 0.0450) MultiSource/Applications/kimwitu++/kc: 50800.00% (0.0001 => 0.0509, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050000.00% (0.0001 => 10.0501, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5488100.00% (0.0001 => 5.4882, std.dev.: 0.0019) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 38.16% (0.1056 => 0.1459, std.dev.: 0.0001) SingleSource/UnitTests/vla: 28.73% (0.0355 => 0.0457, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 28.07% (0.1432 => 0.1834, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 19.80% (0.1566 => 0.1876, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/rem: 17.22% (0.1144 => 0.1341, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 17.06% (0.3177 => 0.3719, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 16.99% (0.0730 => 0.0854, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.76% (0.0871 => 0.1017, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 16.62% (0.0746 => 0.0870, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 16.51% (0.1175 => 0.1369, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.27% (0.0793 => 0.0922, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.91% (0.8172 => 0.9472, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 15.80% (0.4879 => 0.5650, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 15.70% (0.2554 => 0.2955, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 15.66% (0.0798 => 0.0923, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 15.09% (0.1584 => 0.1823, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.63% (0.0834 => 0.0956, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.61% (0.0842 => 0.0965, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 14.45% (0.1695 => 0.1940, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 14.38% (0.5105 => 0.5839, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 14.36% (0.1163 => 0.1330, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.22% (0.0886 => 0.1012, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.09% (0.2065 => 0.2356, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 14.05% (0.7115 => 0.8115, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.00% (0.2758 => 0.3144, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 13.90% (0.1655 => 0.1885, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.70% (0.2700 => 0.3070, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.61% (0.1117 => 0.1269, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 13.58% (22.1758 => 25.1873, std.dev.: 0.0193) MultiSource/Applications/aha/aha: 13.38% (0.1151 => 0.1305, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.38% (0.0770 => 0.0873, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 13.38% (0.1555 => 0.1763, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.31% (0.1510 => 0.1711, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 13.30% (0.1940 => 0.2198, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 13.16% (0.1125 => 0.1273, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.13% (0.4615 => 0.5221, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.05% (0.6675 => 0.7546, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 13.03% (3.3354 => 3.7701, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.02% (0.5981 => 0.6760, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 12.93% (0.3109 => 0.3511, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.86% (0.1337 => 0.1509, std.dev.: 0.0032) MultiSource/Applications/Burg/burg: 12.86% (1.1642 => 1.3139, std.dev.: 0.0078) MultiSource/Applications/spiff/spiff: 12.79% (0.7835 => 0.8837, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.77% (0.2107 => 0.2376, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.73% (1.5415 => 1.7378, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.73% (0.1029 => 0.1160, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.71% (0.1062 => 0.1197, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.68% (0.2271 => 0.2559, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.64% (0.9765 => 1.0999, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 12.57% (0.7433 => 0.8367, std.dev.: 0.0035) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.46% (0.3121 => 0.3510, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.43% (0.5569 => 0.6261, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.37% (0.5860 => 0.6585, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.07% (0.5020 => 0.5626, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.02% (1.3050 => 1.4619, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 12.01% (2.0273 => 2.2707, std.dev.: 0.0006) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.99% (0.1143 => 0.1280, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.92% (0.1032 => 0.1155, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.79% (0.2603 => 0.2910, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.73% (0.1236 => 0.1381, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.72% (0.6450 => 0.7206, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: 11.67% (0.1268 => 0.1416, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 11.59% (1.0722 => 1.1965, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.59% (1.1861 => 1.3236, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.58% (0.3307 => 0.3690, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.57% (0.3441 => 0.3839, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.51% (0.1625 => 0.1812, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 11.39% (3.8723 => 4.3132, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/18-imp/imp: 11.31% (0.3423 => 0.3810, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 11.16% (0.8921 => 0.9917, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/05-eks/eks: 11.05% (0.4299 => 0.4774, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.97% (4.2646 => 4.7323, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/neural/neural: 10.80% (0.1463 => 0.1621) SingleSource/Benchmarks/Shootout-C++/hash: 10.66% (0.4289 => 0.4746, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.63% (2.2022 => 2.4362, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 10.59% (0.3927 => 0.4343, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/trivial-interface: 10.54% (0.3473 => 0.3839, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 10.53% (0.3180 => 0.3515, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.50% (0.1695 => 0.1873) MultiSource/Benchmarks/mafft/pairlocalalign: 10.50% (9.4845 => 10.4800, std.dev.: 0.0066) SingleSource/UnitTests/ObjC/exceptions-2: 10.47% (0.3497 => 0.3863, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.44% (0.1906 => 0.2105, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.41% (0.3543 => 0.3912, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.36% (0.3543 => 0.3910, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 10.32% (0.3828 => 0.4223, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.28% (0.3561 => 0.3927, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 10.27% (0.3387 => 0.3735, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 10.27% (0.3516 => 0.3877, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.25% (1.5859 => 1.7485, std.dev.: 0.0139) MultiSource/Benchmarks/nbench/nbench: 10.19% (1.1840 => 1.3046, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.06% (0.1044 => 0.1149, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 10.04% (0.3694 => 0.4065, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 9.91% (0.6456 => 0.7096, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.91% (0.3886 => 0.4271, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.84% (0.8101 => 0.8898, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.75% (2.2024 => 2.4172, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 9.67% (0.3422 => 0.3753, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 9.57% (2.2969 => 2.5167, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 9.57% (0.4620 => 0.5062, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.52% (0.3865 => 0.4233, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.45% (0.4636 => 0.5074, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.40% (14.3668 => 15.7179, std.dev.: 0.0188) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.36% (0.1892 => 0.2069, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.34% (1.4186 => 1.5511, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.26% (0.4203 => 0.4592, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.94% (0.4103 => 0.4470, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.80% (0.1330 => 0.1447, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 8.75% (0.4048 => 0.4402, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/lists1: 8.69% (0.3684 => 0.4004, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.56% (0.7326 => 0.7953, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 8.56% (0.5925 => 0.6432, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.52% (0.6030 => 0.6544, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.50% (5.0018 => 5.4269, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.45% (4.9449 => 5.3629, std.dev.: 0.0083) MultiSource/Applications/hbd/hbd: 8.36% (1.5603 => 1.6907, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sieve: 8.35% (0.3603 => 0.3904, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.95% (0.2905 => 0.3136, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.95% (0.3650 => 0.3940, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 7.88% (0.2831 => 0.3054, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.88% (0.2793 => 0.3013, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.86% (0.2430 => 0.2621, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.79% (0.3826 => 0.4124, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.76% (2.0665 => 2.2268, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.75% (0.4064 => 0.4379, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.71% (0.2891 => 0.3114, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 7.67% (0.2725 => 0.2934, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 7.65% (0.3283 => 0.3534, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.62% (0.3162 => 0.3403, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/ary: 7.58% (0.3232 => 0.3477, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 7.54% (0.2877 => 0.3094, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 7.52% (0.3098 => 0.3331, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.50% (0.3427 => 0.3684, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 7.45% (17.1811 => 18.4615, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/except: 7.42% (0.2871 => 0.3084, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.35% (0.2872 => 0.3083, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.26% (0.2756 => 0.2956, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 7.21% (0.3052 => 0.3272, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.11% (0.2714 => 0.2907, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 6.96% (0.2802 => 0.2997, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.81% (0.3379 => 0.3609, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 6.35% (1.2842 => 1.3657, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.09% (0.3136 => 0.3327, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.84% (0.8067 => 0.8538, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/bh/bh: 5.60% (0.3092 => 0.3265, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 5.58% (0.3282 => 0.3465, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 5.56% (0.3131 => 0.3305, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.35% (3.8922 => 4.1003, std.dev.: 0.0140) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.99% (0.2266 => 0.2379) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.76% (0.3935 => 0.4083, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.83% (0.3817 => 0.3925, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.03% (7.9617 => 8.1232, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.39% (7.0540 => 7.1517, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.52% (1.1145 => 1.2986, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.84% (1.1396 => 1.2517, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3682, std.dev.: 0.0006) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.84% (4.2280 => 4.3481, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7651, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 1.82% (0.8333 => 0.8485, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2077, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.32% (11.6436 => 11.7970, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.11% (9.1159 => 9.2171, std.dev.: 0.0232) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/salsa20: -77.01% (0.8651 => 0.1989, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.62% (5.3855 => 2.3899, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -55.30% (5.3526 => 2.3925, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: -45.93% (0.1622 => 0.0877, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.51% (1.1194 => 0.6771, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.42% (5.2763 => 3.2489, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -24.67% (1.7609 => 1.3264, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -17.58% (2.9384 => 2.4219, std.dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: -10.54% (10.4361 => 9.3359, std.dev.: 0.0056) SingleSource/UnitTests/Vector/constpool: -9.37% (54.1659 => 49.0880, std.dev.: 0.0189) MultiSource/Benchmarks/PAQ8p/paq8p: -3.52% (10.3673 => 10.0019, std.dev.: 0.0038) MultiSource/Applications/JM/lencod/lencod: -2.34% (21.9371 => 21.4228, std.dev.: 0.0085) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -33.68% (0.3987 => 0.2644) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7636, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: -15.88% (1.6925 => 1.4238, std.dev.: 0.0020) MultiSource/Benchmarks/NPB-serial/is/is: -10.98% (9.5636 => 8.5134, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -10.59% (1.5373 => 1.3745, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.41% (19.9488 => 18.2710, std.dev.: 0.0166) MultiSource/Benchmarks/FreeBench/mason/mason: -7.73% (0.2161 => 0.1994, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.07% (1.8329 => 1.7033, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4781, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -6.02% (1.2373 => 1.1628, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5757, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8482, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -5.45% (6.6465 => 6.2841, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.09% (1.6805 => 1.5950, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5091, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.44% (0.9957 => 0.9515, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.08% (0.2497 => 0.2395, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.73% (1.3677 => 1.3167, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.73% (3.2827 => 3.1604, std.dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.53% (32.5116 => 31.3629, std.dev.: 0.0053) MultiSource/Benchmarks/sim/sim: -3.24% (5.0483 => 4.8848, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.83% (4.5009 => 4.3736, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: -2.67% (4.6441 => 4.5202, std.dev.: 0.0035) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.66% (0.4808 => 0.4680, std.dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -2.03% (10.2830 => 10.0740, std.dev.: 0.0145) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.02% (8.1563 => 7.9918, std.dev.: 0.0158) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6833, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -1.62% (1.1277 => 1.1094, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.53% (2.5528 => 2.5137, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -1.20% (85.0658 => 84.0421, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8590, std.dev.: 0.0141) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Compile Time -------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.83% (7.1582 => 7.6470, std.dev.: 0.0038) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/oggenc/oggenc: -99.93% (0.1485 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.05% (0.2116 => 0.0676, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 2.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 29 21:49:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 29 Oct 2012 23:49:51 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121030044951.5AD002A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5392?compare_to=5388&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5392, Order: 166998, Start Time: 2012-10-30 03:23:17, End Time: 2012-10-30 04:49:52 To: 5388, Order: 166991, Start Time: 2012-10-30 01:39:06, End Time: 2012-10-30 03:06:22 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 8 (95 on baseline) Performance Improvements: 9 (5 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 974 (874 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.33% (1.4722 => 1.4918, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 14.36% (0.7686 => 0.8790, std.dev.: 0.0079) MultiSource/Benchmarks/nbench/nbench: 13.45% (19.6482 => 22.2916, std.dev.: 0.8340) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.45% (14.9179 => 16.4765, std.dev.: 0.4100) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.55% (4.3503 => 4.5048, std.dev.: 0.0555) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.92% (40.5874 => 41.7719, std.dev.: 0.3754) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.26% (1.0048 => 1.0275, std.dev.: 0.0072) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.00% (1.2324 => 1.2571, std.dev.: 0.0085) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.49% (0.3188 => 0.3045, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.01% (0.3450 => 0.3346, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.61% (0.6431 => 0.6263, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.57% (1.2205 => 1.1891, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.53% (0.7052 => 0.6944, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.37% (4.6182 => 4.5551, std.dev.: 0.0202) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: -2.76% (1.2961 => 1.2603, std.dev.: 0.0132) MultiSource/Benchmarks/FreeBench/mason/mason: -2.24% (0.5541 => 0.5417, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.60% (4.4829 => 4.4112, std.dev.: 0.0194) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.78% (16.5779 => 16.7069, std.dev.: 0.0873) MultiSource/Applications/obsequi/Obsequi: -0.43% (1.0760 => 1.0714, std.dev.: 0.0071) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.67% (21.5324 => 21.6761, std.dev.: 0.0211) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.52% (0.3639 => 0.3658, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 0.85% (0.5990 => 0.6041, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.63% (0.3314 => 0.3335, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/strcat: 0.85% (0.2002 => 0.2019, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 48.92% (0.0139 => 0.0207, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -11.11% (0.0387 => 0.0344, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -9.42% (0.0308 => 0.0279, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 9.09% (0.0286 => 0.0312, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.71% (0.0423 => 0.0420, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 20.29% (0.0138 => 0.0166, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/test1: 2.05% (0.0146 => 0.0149, std.dev.: 0.0030) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -88.89% (0.0009 => 0.0001, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -1.70% (0.1470 => 0.1445, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: 0.60% (1.1220 => 1.1287, std.dev.: 0.0180) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -3.43% (0.1518 => 0.1466, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.25% (0.3997 => 0.3947, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.83% (0.1318 => 0.1329, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -17.53% (0.0696 => 0.0574, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -20.58% (0.0277 => 0.0220, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.30% (0.0582 => 0.0557, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.93% (1.1439 => 1.1333, std.dev.: 0.0142) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.77% (0.0031 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0645 => 0.0645, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0233 => 0.0233, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.01% (0.8004 => 0.8003, std.dev.: 0.0084) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -85.71% (0.0007 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 63.83% (0.0047 => 0.0077, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2332.31% (0.6332 => 15.4014, std.dev.: 0.0700) MultiSource/Benchmarks/McCat/08-main/main: 44.84% (0.1831 => 0.2652, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.34% (0.1559 => 0.1429, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1479.25% (0.3344 => 5.2810, std.dev.: 0.0450) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.34% (0.2364 => 0.3223, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel: 2.33% (0.0429 => 0.0439, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.34% (0.0224 => 0.0221, std.dev.: 0.0009) SingleSource/UnitTests/byval-alignment: -30.00% (0.0230 => 0.0161, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4542, std.dev.: 0.0317) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0692, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4943, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3397, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0295, std.dev.: 0.0192) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4077, std.dev.: 0.0047) SingleSource/Regression/C/uint64_to_float: -23.78% (2.1832 => 1.6640, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 35.91% (14.7684 => 20.0721, std.dev.: 0.2329) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.30% (0.0810 => 0.0942, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: 11.96% (0.1112 => 0.1245, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.17% (0.2180 => 0.2358, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.42% (0.2279 => 0.2448, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 6.92% (1.2568 => 1.3438, std.dev.: 0.0087) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.89% (0.1466 => 0.1567, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.02% (0.3137 => 0.3326, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.85% (0.1983 => 0.2099, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.72% (0.1905 => 0.2014, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.51% (0.2741 => 0.2892, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.29% (13.1811 => 13.8785, std.dev.: 0.0763) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.86% (6.6074 => 6.9283, std.dev.: 0.0175) MultiSource/Applications/hbd/hbd: 4.73% (1.4269 => 1.4944, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.64% (1.1170 => 1.1688, std.dev.: 0.0174) MultiSource/Benchmarks/nbench/nbench: 4.63% (1.1271 => 1.1793, std.dev.: 0.0172) MultiSource/Applications/Burg/burg: 4.51% (1.2222 => 1.2773, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.42% (0.6227 => 0.6502, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.35% (1.3279 => 1.3856, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.21% (0.6010 => 0.6263, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.12% (0.4127 => 0.4297, std.dev.: 0.0013) MultiSource/Applications/d/make_dparser: 4.11% (3.2366 => 3.3695, std.dev.: 0.0161) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.01% (0.6287 => 0.6539, std.dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 3.88% (14.2605 => 14.8136, std.dev.: 0.0481) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.66% (1.6386 => 1.6986, std.dev.: 0.0109) MultiSource/Applications/lemon/lemon: 3.54% (1.0945 => 1.1333, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.49% (0.4783 => 0.4950, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 3.42% (0.4125 => 0.4266, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 3.22% (0.6834 => 0.7054, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.11% (8.6476 => 8.9166, std.dev.: 0.0584) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.09% (0.3717 => 0.3832, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.05% (0.8697 => 0.8962, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.03% (1.4479 => 1.4918, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 3.02% (0.8331 => 0.8583, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.99% (0.6586 => 0.6783, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.89% (0.9688 => 0.9968, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.84% (0.8338 => 0.8575, std.dev.: 0.0048) MultiSource/Applications/siod/siod: 2.81% (2.2184 => 2.2807, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.80% (0.8597 => 0.8838, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.74% (0.4559 => 0.4684, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.69% (0.9908 => 1.0175, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.66% (0.8317 => 0.8538, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.65% (0.8518 => 0.8744, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.64% (0.8457 => 0.8680, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.63% (0.9056 => 0.9294, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.58% (0.8340 => 0.8555, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.57% (0.7932 => 0.8136, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.50% (0.7966 => 0.8165, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.41% (0.9074 => 0.9293, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.39% (0.8066 => 0.8259, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.39% (0.8050 => 0.8242, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/football/football: 2.38% (0.8768 => 0.8977, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.36% (0.8712 => 0.8918, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.26% (0.8611 => 0.8806, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.24% (0.8086 => 0.8267, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.23% (2.1401 => 2.1878, std.dev.: 0.0065) MultiSource/Applications/lua/lua: 2.22% (3.8189 => 3.9036, std.dev.: 0.0260) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.17% (3.1832 => 3.2522, std.dev.: 0.0185) MultiSource/Applications/JM/lencod/lencod: 2.15% (15.3280 => 15.6578, std.dev.: 0.0622) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.15% (0.8885 => 0.9076, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.13% (0.8656 => 0.8840, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.10% (0.8855 => 0.9041, std.dev.: 0.0030) MultiSource/Applications/oggenc/oggenc: 2.09% (4.9628 => 5.0666, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.09% (0.9039 => 0.9228, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.07% (0.8007 => 0.8173, std.dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: 2.07% (8.6247 => 8.8035, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.02% (0.9069 => 0.9252, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.02% (1.2602 => 1.2856, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.98% (0.8177 => 0.8339, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 1.97% (0.9810 => 1.0003, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.96% (0.8927 => 0.9102, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.91% (0.8420 => 0.8581, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.84% (0.8316 => 0.8469, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.80% (0.8048 => 0.8193, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.79% (4.1763 => 4.2512, std.dev.: 0.0154) MultiSource/Applications/JM/ldecod/ldecod: 1.70% (6.7320 => 6.8467, std.dev.: 0.0261) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.66% (1.5315 => 1.5569, std.dev.: 0.0036) MultiSource/Benchmarks/PAQ8p/paq8p: 1.60% (2.3764 => 2.4145, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.58% (0.8359 => 0.8491, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.51% (0.8069 => 0.8191, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.51% (4.4873 => 4.5551, std.dev.: 0.0202) MultiSource/Benchmarks/Bullet/bullet: 1.50% (31.8598 => 32.3376, std.dev.: 0.0765) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.21% (1.2423 => 1.2573, std.dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.29% (1.5795 => 2.5002, std.dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.51% (14.6451 => 16.4765, std.dev.: 0.4100) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.53% (2.4333 => 2.6653, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.25% (0.3186 => 0.3449, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.84% (1.1857 => 1.2786, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: 5.91% (63.1822 => 66.9168, std.dev.: 0.0144) MultiSource/Benchmarks/FreeBench/distray/distray: 4.39% (0.2390 => 0.2495, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.43% (4.3552 => 4.5048, std.dev.: 0.0555) MultiSource/Applications/siod/siod: 2.51% (3.6643 => 3.7562, std.dev.: 0.0206) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.90% (1.2337 => 1.2571, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/bh/bh: 1.66% (2.3560 => 2.3951, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.23% (4.8362 => 4.8959, std.dev.: 0.0126) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.23% (0.3269 => 0.3000, std.dev.: 0.0017) MultiSource/Applications/lua/lua: -5.18% (29.8330 => 28.2882, std.dev.: 0.0702) SingleSource/Benchmarks/Shootout-C++/hash2: -1.40% (3.4237 => 3.3757, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.28% (3.3479 => 3.3052, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.04% (3.5968 => 3.5593, std.dev.: 0.0077) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.59% (16.4461 => 16.7069, std.dev.: 0.0873) MultiSource/Applications/obsequi/Obsequi: 4.40% (1.0262 => 1.0714, std.dev.: 0.0071) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6840.79% (0.3123 => 21.6761, std.dev.: 0.0211) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.52% (0.2463 => 0.3658, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 0.52% (0.6010 => 0.6041, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.11% (0.3266 => 0.3335, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/strcat: 2.54% (0.1969 => 0.2019, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 68.29% (0.0123 => 0.0207, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -15.69% (0.0408 => 0.0344, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 9.84% (0.0254 => 0.0279, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.38% (0.0384 => 0.0420, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -12.63% (0.0190 => 0.0166, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/test1: -17.22% (0.0180 => 0.0149, std.dev.: 0.0030) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.49% (0.1438 => 0.1445, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: -0.37% (1.1329 => 1.1287, std.dev.: 0.0180) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 0.27% (0.1462 => 0.1466, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.21% (0.4164 => 0.3947, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.92% (0.1369 => 0.1329, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.45% (0.0641 => 0.0574, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 12.82% (0.0195 => 0.0220, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.63% (0.0578 => 0.0557, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.91% (1.1437 => 1.1333, std.dev.: 0.0142) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.87% (0.0627 => 0.0645, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 29.44% (0.0180 => 0.0233, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.17% (0.8017 => 0.8003, std.dev.: 0.0084) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 24.19% (0.0062 => 0.0077, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 29 22:38:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 30 Oct 2012 00:38:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121030053836.01B952A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5393?compare_to=5390&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5393, Order: 166998, Start Time: 2012-10-30 04:13:14, End Time: 2012-10-30 05:38:35 To: 5390, Order: 166996, Start Time: 2012-10-30 02:24:42, End Time: 2012-10-30 03:50:09 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (175 on baseline) Unchanged Tests: 1042 (862 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.33% (15.2527 => 18.3542, std.dev.: 0.0083) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.33% (2.0478 => 2.1159, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: 2.49% (7.4937 => 7.6806, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/hash2: 2.19% (3.1932 => 3.2632, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.65% (0.1584 => 0.1447, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.32% (0.1431 => 0.1312, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.48% (0.3821 => 0.3535, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.51% (0.2428 => 0.2270, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -6.39% (0.1879 => 0.1759, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.37% (0.3142 => 0.2942, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.36% (22.4056 => 20.9814, std.dev.: 0.0182) MultiSource/Benchmarks/PAQ8p/paq8p: -6.35% (2.4924 => 2.3341, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -5.99% (0.3357 => 0.3156, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.93% (3.5339 => 3.3243, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.93% (4.5069 => 4.2396, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/oourafft: -5.93% (0.2160 => 0.2032, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.93% (5.4682 => 5.1442, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.91% (0.9852 => 0.9270, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.87% (0.3884 => 0.3656, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions: -5.87% (0.4176 => 0.3931, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.84% (0.9542 => 0.8985, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -5.83% (0.4033 => 0.3798, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -5.83% (0.3896 => 0.3669, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -5.82% (0.3880 => 0.3654, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -5.82% (0.3812 => 0.3590, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.82% (0.3658 => 0.3445, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: -5.82% (0.3848 => 0.3624, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.80% (1.6474 => 1.5519, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.78% (0.3891 => 0.3666, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.77% (0.2355 => 0.2219, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -5.77% (0.3831 => 0.3610, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: -5.75% (0.2659 => 0.2506, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -5.74% (0.4199 => 0.3958, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.72% (0.6484 => 0.6113, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -5.71% (1.2515 => 1.1800, std.dev.: 0.0031) MultiSource/Applications/JM/ldecod/ldecod: -5.69% (7.0961 => 6.6922, std.dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: -5.61% (16.1920 => 15.2844, std.dev.: 0.0064) SingleSource/UnitTests/ObjC/parameter-passing: -5.54% (0.4280 => 0.4043, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.53% (0.3849 => 0.3636, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.53% (0.3837 => 0.3625, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.51% (2.1713 => 2.0516, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: -5.50% (4.3330 => 4.0949, std.dev.: 0.0081) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.49% (0.2548 => 0.2408, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.49% (4.8161 => 4.5516, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: -5.49% (0.3025 => 0.2859, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.48% (4.0323 => 3.8113, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.48% (4.8802 => 4.6130, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/objinst: -5.45% (0.3194 => 0.3020, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.44% (0.4151 => 0.3925, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.43% (1.0544 => 0.9971, std.dev.: 0.0023) MultiSource/Applications/siod/siod: -5.42% (2.4021 => 2.2718, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: -5.42% (1.3148 => 1.2435, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/except: -5.42% (0.3026 => 0.2862, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.41% (1.2784 => 1.2092, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.40% (0.5999 => 0.5675, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.39% (0.7919 => 0.7492, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: -5.37% (0.4861 => 0.4600, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.35% (1.2210 => 1.1557, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.34% (0.3016 => 0.2855, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -5.31% (0.3255 => 0.3082, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.31% (1.2221 => 1.1572, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.30% (0.2903 => 0.2749, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.30% (0.3057 => 0.2895, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -5.30% (0.3059 => 0.2897, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.29% (0.3252 => 0.3080, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.27% (0.8521 => 0.8072, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: -5.24% (0.6750 => 0.6396, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary2: -5.23% (0.3481 => 0.3299, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/bh/bh: -5.23% (0.2985 => 0.2829, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.22% (0.4083 => 0.3870, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -5.21% (0.2939 => 0.2786, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -5.19% (0.2849 => 0.2701, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -5.17% (0.3788 => 0.3592, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -5.16% (0.3621 => 0.3434, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: -5.15% (0.2871 => 0.2723, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -5.15% (0.2989 => 0.2835, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -5.15% (0.3205 => 0.3040, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.11% (2.2587 => 2.1432, std.dev.: 0.0065) MultiSource/Applications/lua/lua: -5.09% (4.0594 => 3.8526, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/moments: -5.08% (0.4248 => 0.4032, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -5.07% (0.3867 => 0.3671, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.07% (0.4321 => 0.4102, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -5.04% (9.2283 => 8.7629, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.01% (0.3491 => 0.3316, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.00% (1.4642 => 1.3910, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.99% (0.4427 => 0.4206, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -4.99% (0.7779 => 0.7391, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -4.95% (0.3394 => 0.3226, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: -4.94% (18.2933 => 17.3887, std.dev.: 0.0257) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.93% (0.2999 => 0.2851, std.dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: -4.92% (34.0927 => 32.4159, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.90% (0.6667 => 0.6340, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.89% (0.5925 => 0.5635, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: -4.88% (0.3446 => 0.3278, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.86% (0.5591 => 0.5319, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.86% (0.6293 => 0.5987, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.85% (1.3722 => 1.3057, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.84% (0.4813 => 0.4580, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.83% (0.6681 => 0.6358, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.82% (0.6052 => 0.5760, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.82% (0.6304 => 0.6000, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.82% (0.6230 => 0.5930, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.80% (0.9557 => 0.9098, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.78% (0.5581 => 0.5314, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.78% (0.5478 => 0.5216, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.78% (0.5859 => 0.5579, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.76% (0.3931 => 0.3744, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -4.74% (1.6364 => 1.5588, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.74% (0.5805 => 0.5530, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.73% (0.6297 => 0.5999, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.73% (0.7339 => 0.6992, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.72% (0.5575 => 0.5312, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -4.71% (0.7982 => 0.7606, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.70% (0.6676 => 0.6362, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.70% (0.3319 => 0.3163, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.70% (0.5705 => 0.5437, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.70% (0.5857 => 0.5582, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.69% (0.5802 => 0.5530, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.69% (0.5570 => 0.5309, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.67% (0.6194 => 0.5905, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: -4.66% (0.4524 => 0.4313, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.66% (0.5863 => 0.5590, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.65% (0.2278 => 0.2172, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.65% (0.5569 => 0.5310, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.64% (0.6395 => 0.6098, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.64% (0.5456 => 0.5203, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.63% (0.6260 => 0.5970, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: -4.63% (0.6347 => 0.6053, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.62% (0.6660 => 0.6352, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: -4.61% (0.6441 => 0.6144, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.61% (0.6033 => 0.5755, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.60% (0.6189 => 0.5904, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.60% (0.3323 => 0.3170, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.60% (0.5849 => 0.5580, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.59% (0.6446 => 0.6150, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.57% (0.2933 => 0.2799, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.56% (0.5941 => 0.5670, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: -4.55% (0.3581 => 0.3418, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.53% (0.2385 => 0.2277, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/05-eks/eks: -4.52% (0.4515 => 0.4311, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.52% (0.4916 => 0.4694, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.47% (0.6395 => 0.6109, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.46% (0.7198 => 0.6877, std.dev.: 0.0094) MultiSource/Applications/minisat/minisat: -4.43% (0.7447 => 0.7117, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.36% (0.6440 => 0.6159, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: -4.35% (0.9179 => 0.8780, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.29% (0.5688 => 0.5444, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: -4.23% (1.1450 => 1.0966, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.19% (0.7021 => 0.6727, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -4.17% (0.8418 => 0.8067, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.17% (0.5567 => 0.5335, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -4.14% (0.3406 => 0.3265, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -4.03% (5.0226 => 4.8204, std.dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: -4.00% (15.5079 => 14.8874, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -3.97% (8.0126 => 7.6947, std.dev.: 0.0106) MultiSource/Applications/treecc/treecc: -3.97% (2.1401 => 2.0552, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: -3.94% (0.3271 => 0.3142, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.92% (0.6736 => 0.6472, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.90% (0.3483 => 0.3347, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.81% (6.7716 => 6.5133, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.79% (0.5168 => 0.4972, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.77% (0.9077 => 0.8735, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: -3.70% (1.5610 => 1.5033, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.64% (0.5329 => 0.5135, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: -3.63% (1.1530 => 1.1112, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: -3.60% (3.5154 => 3.3887, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: -3.58% (17.1032 => 16.4909, std.dev.: 0.0085) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.56% (1.2300 => 1.1862, std.dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -2.93% (20.7746 => 20.1669, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.83% (14.2083 => 13.8069, std.dev.: 0.0070) MultiSource/Applications/SIBsim4/SIBsim4: -1.70% (1.3864 => 1.3628, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7573, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/richards_benchmark: -8.76% (1.2842 => 1.1717, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: -4.09% (2.2633 => 2.1708, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.56% (6.5735 => 6.4708, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 29 23:06:17 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 30 Oct 2012 01:06:17 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121030060617.BC99B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5394?compare_to=5391&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5394, Order: 166998, Start Time: 2012-10-30 04:33:10, End Time: 2012-10-30 06:06:17 To: 5391, Order: 166996, Start Time: 2012-10-30 02:32:12, End Time: 2012-10-30 04:03:30 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Passes: 11 (17 on baseline) Performance Regressions: 1 (170 on baseline) Performance Improvements: 0 (53 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 2 (2 on baseline) Unchanged Tests: 1028 (666 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Applications/oggenc/oggenc: 211.12% (2.0072 => 6.2448, std.dev.: 0.0061) MultiSource/Benchmarks/Bullet/bullet: 0.38% (56.3750 => 56.5890, std.dev.: 0.0221) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 73.16% (0.0790 => 0.1368, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 0.65% (8.9661 => 9.0243, std.dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 279.65% (7.6470 => 29.0315, std.dev.: 0.0089) SingleSource/UnitTests/Vector/SSE/sse_shift: -16.03% (0.0524 => 0.0440, std.dev.: 0.0010) New Passes - Execution Time --------------------------- MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/UnitTests/Vector/SSE/sse_shift MultiSource/Benchmarks/Bullet/bullet: 7593900.00% (0.0001 => 7.5940, std.dev.: 0.0256) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 20200.00% (0.0001 => 0.0203, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 100.00% (0.0001 => 0.0002, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 779000.00% (0.0001 => 0.7791, std.dev.: 0.0076) SingleSource/UnitTests/Vector/SSE/sse_shift: 100.00% (0.0001 => 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.12% (79.0572 => 80.7333, std.dev.: 0.1779) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: 140500.00% (0.0001 => 0.1406, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.99% (0.0676 => 0.0649, std.dev.: 0.0012) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 197.88% (0.5229 => 1.5576, std.dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: 13.28% (14.9895 => 16.9808, std.dev.: 0.0057) MultiSource/Applications/kimwitu++/kc: 35.57% (14.1553 => 19.1898, std.dev.: 0.0113) MultiSource/Benchmarks/MallocBench/gs/gs: 11.95% (4.1105 => 4.6016, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 28.90% (1.1048 => 1.4241, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 305.57% (7.1582 => 29.0315, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.30% (3.4629 => 5.7935, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: 63.36% (0.6222 => 1.0164, std.dev.: 0.0008) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10542.22% (0.0720 => 7.6624, std.dev.: 0.0145) MultiSource/Applications/SIBsim4/SIBsim4: 3836500.00% (0.0001 => 3.8366, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 11169600.00% (0.0001 => 11.1697, std.dev.: 0.0472) MultiSource/Applications/kimwitu++/kc: 50400.00% (0.0001 => 0.0505, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 779000.00% (0.0001 => 0.7791, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050000.00% (0.0001 => 10.0501, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5491800.00% (0.0001 => 5.4919, std.dev.: 0.0125) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 38.16% (0.1056 => 0.1459, std.dev.: 0.0000) SingleSource/UnitTests/vla: 28.73% (0.0355 => 0.0457) SingleSource/Benchmarks/Misc/flops: 27.58% (0.1432 => 0.1827, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 19.54% (0.1566 => 0.1872, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 17.48% (0.1144 => 0.1344, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 17.22% (0.3177 => 0.3724, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/lists: 16.93% (0.0626 => 0.0732, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 16.85% (0.0730 => 0.0853, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.76% (0.0871 => 0.1017, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 16.60% (0.1175 => 0.1370, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 16.49% (0.0746 => 0.0869, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 15.91% (0.0798 => 0.0925, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 15.89% (0.0793 => 0.0919, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 15.66% (0.2554 => 0.2954, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 15.66% (0.4879 => 0.5643, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.54% (0.8172 => 0.9442, std.dev.: 0.0058) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 15.15% (0.1584 => 0.1824, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.87% (0.0834 => 0.0958, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.85% (0.0842 => 0.0967, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 14.40% (0.1695 => 0.1939, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 14.36% (0.1163 => 0.1330, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.11% (0.0886 => 0.1011, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.04% (0.2065 => 0.2355, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 14.02% (0.1655 => 0.1887, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 13.93% (0.7115 => 0.8106, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 13.65% (0.5105 => 0.5802, std.dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 13.53% (22.1758 => 25.1757, std.dev.: 0.0186) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.52% (0.2700 => 0.3065, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.52% (0.1117 => 0.1268, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.51% (0.0770 => 0.0874, std.dev.: 0.0015) MultiSource/Applications/viterbi/viterbi: 13.44% (0.1555 => 0.1764, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.31% (0.2758 => 0.3125, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 13.25% (0.1940 => 0.2197, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.25% (0.1510 => 0.1710, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 13.20% (0.7835 => 0.8869, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 13.16% (0.1125 => 0.1273, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 13.12% (0.1151 => 0.1302, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.09% (0.6675 => 0.7549, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 13.06% (3.3354 => 3.7710, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.04% (0.5981 => 0.6761, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.01% (0.1337 => 0.1511, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 12.96% (0.3109 => 0.3512, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.94% (0.3121 => 0.3525, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.86% (0.2107 => 0.2378, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.83% (0.1029 => 0.1161, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.81% (0.1062 => 0.1198, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.77% (1.5415 => 1.7384, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.77% (0.2271 => 0.2561, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.69% (0.9765 => 1.1004, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.57% (0.4615 => 0.5195, std.dev.: 0.0024) MultiSource/Applications/Burg/burg: 12.56% (1.1642 => 1.3104, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 12.53% (0.7433 => 0.8364, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.45% (0.5020 => 0.5645, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.41% (0.5860 => 0.6587, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.21% (0.5569 => 0.6249, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.02% (0.1032 => 0.1156, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.98% (1.3050 => 1.4613, std.dev.: 0.0020) MultiSource/Applications/treecc/treecc: 11.93% (2.0273 => 2.2691, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.87% (0.2603 => 0.2912, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: 11.83% (0.1268 => 0.1418, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 11.64% (1.0722 => 1.1970, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.52% (0.3307 => 0.3688, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.49% (0.1236 => 0.1378, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.42% (0.3441 => 0.3834, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 11.35% (0.4299 => 0.4787, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.33% (0.6450 => 0.7181, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.32% (0.1625 => 0.1809, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.31% (1.1861 => 1.3203, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 11.31% (3.8723 => 4.3104, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/18-imp/imp: 11.28% (0.3423 => 0.3809, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.91% (8.1363 => 9.0243, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/football/football: 10.91% (0.8921 => 0.9894, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.89% (4.2646 => 4.7290, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: 10.80% (0.1463 => 0.1621, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.76% (0.0929 => 0.1029, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.76% (0.1143 => 0.1266, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 10.75% (0.4289 => 0.4750, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.65% (0.3473 => 0.3843, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.57% (0.3927 => 0.4342, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.50% (0.1695 => 0.1873, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.49% (0.3516 => 0.3885, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.47% (0.3543 => 0.3914, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 10.47% (0.3497 => 0.3863, std.dev.: 0.0081) SingleSource/UnitTests/ObjC/exceptions-4: 10.44% (0.3543 => 0.3913, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.44% (0.1906 => 0.2105, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: 10.41% (0.3180 => 0.3511, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.40% (0.3828 => 0.4226, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.39% (0.3561 => 0.3931, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.38% (2.2022 => 2.4308, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 10.33% (0.3387 => 0.3737, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.31% (0.3694 => 0.4075, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 10.30% (9.4845 => 10.4615, std.dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: 10.30% (1.1840 => 1.3059, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.20% (1.5859 => 1.7476, std.dev.: 0.0083) SingleSource/UnitTests/ObjC/property: 10.09% (0.3886 => 0.4278, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.91% (0.8101 => 0.8904, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 9.85% (0.6456 => 0.7092, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 9.76% (0.4620 => 0.5071, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.71% (2.2024 => 2.4162, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.55% (14.3668 => 15.7386, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.52% (0.4203 => 0.4603, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.50% (0.3865 => 0.4232, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 9.44% (0.3422 => 0.3745, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.41% (0.1892 => 0.2070, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 9.40% (2.2969 => 2.5129, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.40% (1.4186 => 1.5519, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.33% (0.4103 => 0.4486, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.28% (0.4636 => 0.5066, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 9.07% (0.4048 => 0.4415, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.97% (5.0018 => 5.4504, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.87% (0.1330 => 0.1448, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 8.82% (0.3684 => 0.4009, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/sieve: 8.60% (0.3603 => 0.3913, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.57% (0.5925 => 0.6433, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.53% (4.9449 => 5.3669, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 8.52% (0.7326 => 0.7950, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: 8.46% (0.6030 => 0.6540, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 8.43% (5.7591 => 6.2448, std.dev.: 0.0061) MultiSource/Applications/hbd/hbd: 8.35% (1.5603 => 1.6906, std.dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 8.30% (0.2905 => 0.3146, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.11% (0.3650 => 0.3946, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 8.03% (0.2877 => 0.3108, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.02% (0.2793 => 0.3017, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.95% (0.3826 => 0.4130, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/strcat: 7.91% (0.2831 => 0.3055, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.89% (0.2891 => 0.3119, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.83% (0.3283 => 0.3540, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.82% (2.0665 => 2.2281, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.82% (0.2430 => 0.2620, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.69% (0.3162 => 0.3405, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: 7.63% (0.2725 => 0.2933, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 7.61% (0.3232 => 0.3478, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.58% (0.4064 => 0.4372, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 7.56% (0.2871 => 0.3088, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 7.55% (0.3098 => 0.3332, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 7.54% (0.3052 => 0.3282, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.52% (0.2872 => 0.3088, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 7.49% (17.1811 => 18.4681, std.dev.: 0.0169) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.44% (0.2756 => 0.2961, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.41% (0.3427 => 0.3681, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 7.33% (0.2714 => 0.2913, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 7.28% (0.2802 => 0.3006, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.51% (0.3379 => 0.3599, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 6.43% (1.2842 => 1.3668, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.09% (0.3136 => 0.3327, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 5.91% (0.3282 => 0.3476, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.69% (0.8067 => 0.8526, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 5.69% (0.3131 => 0.3309, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 5.50% (0.3092 => 0.3262, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.42% (3.8922 => 4.1031, std.dev.: 0.0171) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.94% (0.2266 => 0.2378, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.94% (0.3935 => 0.4090, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.96% (0.3817 => 0.3930, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.03% (7.9617 => 8.1235, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.56% (1.1145 => 1.2991, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.38% (0.2944 => 0.3279, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.82% (1.1396 => 1.2515, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3685, std.dev.: 0.0007) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.84% (4.2280 => 4.3479, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2078, std.dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: 1.32% (11.6436 => 11.7971, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.95% (6.6874 => 0.1368, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -76.78% (0.8651 => 0.2009, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.67% (5.3855 => 2.3872, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -55.38% (5.3526 => 2.3883, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -45.99% (0.1622 => 0.0876, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.53% (1.1194 => 0.6769, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.39% (5.2763 => 3.2509, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -24.72% (1.7609 => 1.3256, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -17.65% (2.9384 => 2.4198, std.dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: -10.52% (63.2438 => 56.5890, std.dev.: 0.0221) MultiSource/Applications/JM/ldecod/ldecod: -10.51% (10.4361 => 9.3393, std.dev.: 0.0076) SingleSource/UnitTests/Vector/constpool: -9.32% (54.1659 => 49.1186, std.dev.: 0.0133) MultiSource/Benchmarks/PAQ8p/paq8p: -3.46% (10.3673 => 10.0091, std.dev.: 0.0055) MultiSource/Applications/JM/lencod/lencod: -2.49% (21.9371 => 21.3910, std.dev.: 0.0108) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.99% (0.0506 => 0.0334, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -33.68% (0.3987 => 0.2644) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7645, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -29.10% (10.7105 => 7.5940, std.dev.: 0.0256) SingleSource/Benchmarks/Misc/flops-6: -15.73% (1.6925 => 1.4262, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -10.99% (9.5636 => 8.5129, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3734, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.32% (19.9488 => 18.2886, std.dev.: 0.0179) MultiSource/Benchmarks/FreeBench/mason/mason: -7.96% (0.2161 => 0.1989, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.10% (1.8329 => 1.7027, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4781, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -5.95% (1.2373 => 1.1637, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -5.45% (6.6465 => 6.2841, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.05% (1.6805 => 1.5956, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.93% (1.5835 => 1.5055, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4906, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.23% (0.9957 => 0.9536, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.00% (0.2497 => 0.2397, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.79% (3.2827 => 3.1582, std.dev.: 0.0114) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.50% (32.5116 => 31.3738, std.dev.: 0.0027) MultiSource/Benchmarks/sim/sim: -3.24% (5.0483 => 4.8847, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.78% (4.5009 => 4.3757, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -2.66% (4.6441 => 4.5206, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.58% (0.4808 => 0.4684, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.05% (8.1563 => 7.9891, std.dev.: 0.0210) SingleSource/Benchmarks/Misc/salsa20: -1.78% (10.2830 => 10.1002, std.dev.: 0.0232) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6819, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: -1.62% (1.1277 => 1.1094, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5140, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -1.21% (85.0658 => 84.0403, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.01% (6.2999 => 6.2362, std.dev.: 0.0077) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -5.32% (0.1485 => 0.1406, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0012) Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Oct 29 23:33:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 30 Oct 2012 01:33:38 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121030063338.41F982A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5395?compare_to=5392&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5395, Order: 167003, Start Time: 2012-10-30 05:06:42, End Time: 2012-10-30 06:33:36 To: 5392, Order: 166998, Start Time: 2012-10-30 03:23:17, End Time: 2012-10-30 04:49:52 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 4 (98 on baseline) Performance Improvements: 3 (7 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 984 (869 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.27% (0.3060 => 0.3160, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.49% (13.8785 => 14.0849, std.dev.: 0.0178) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/recursive: 4.91% (2.4053 => 2.5234, std.dev.: 0.0144) SingleSource/Benchmarks/Misc/ReedSolomon: 1.12% (8.6745 => 8.7718, std.dev.: 0.0171) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/siod/siod: -1.77% (2.2807 => 2.2403, std.dev.: 0.0148) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -2.33% (1.2571 => 1.2278, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.08% (7.0550 => 6.9080, std.dev.: 0.0218) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.14% (16.7069 => 16.7308, std.dev.: 0.0750) MultiSource/Applications/obsequi/Obsequi: -0.44% (1.0714 => 1.0667, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.12% (21.6761 => 21.7027, std.dev.: 0.0844) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.12% (0.3658 => 0.3699, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/bigfib: 0.35% (0.6041 => 0.6062, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.18% (0.3335 => 0.3341, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/strcat: 0.79% (0.2019 => 0.2035, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -9.18% (0.0207 => 0.0188, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 23.26% (0.0344 => 0.0424, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.08% (0.0279 => 0.0282, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.28% (0.0312 => 0.0316) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -5.48% (0.0420 => 0.0397, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/casts: 22.29% (0.0166 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 25.50% (0.0149 => 0.0187, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.48% (0.1445 => 0.1452, std.dev.: 0.0056) MultiSource/Applications/kimwitu++/kc: -100.00% (0.0001 => 0.0000) MultiSource/Applications/lemon/lemon: -0.34% (1.1287 => 1.1249, std.dev.: 0.0379) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 0.34% (0.1466 => 0.1471, std.dev.: 0.0084) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 6.66% (0.3947 => 0.4210, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.28% (0.1329 => 0.1346, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.32% (0.0574 => 0.0616, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.18% (0.0220 => 0.0213, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.36% (0.0557 => 0.0559, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.62% (1.1333 => 1.1403, std.dev.: 0.0147) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0001 => 0.0002, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.89% (0.0645 => 0.0607, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -15.02% (0.0233 => 0.0198, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.21% (0.8003 => 0.7986, std.dev.: 0.0204) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -42.86% (0.0077 => 0.0044, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2346.81% (0.6332 => 15.4932, std.dev.: 0.0678) MultiSource/Benchmarks/McCat/08-main/main: 40.63% (0.1831 => 0.2575, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.13% (0.1559 => 0.1479, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1482.42% (0.3344 => 5.2916, std.dev.: 0.0216) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.23% (0.2364 => 0.3244, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/mandel: 3.03% (0.0429 => 0.0442, std.dev.: 0.0012) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0224 => 0.0224, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -32.17% (0.0230 => 0.0156, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4447, std.dev.: 0.0191) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0714, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4953, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3398, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0347, std.dev.: 0.0248) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4063, std.dev.: 0.0023) SingleSource/Regression/C/uint64_to_float: -24.11% (2.1832 => 1.6568, std.dev.: 0.0155) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 35.56% (14.7684 => 20.0206, std.dev.: 0.0908) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.42% (0.0810 => 0.0943, std.dev.: 0.0022) SingleSource/UnitTests/SignlessTypes/rem: 10.14% (0.1035 => 0.1140, std.dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: 7.23% (1.2568 => 1.3477, std.dev.: 0.0187) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.86% (13.1811 => 14.0849, std.dev.: 0.0178) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.65% (0.2240 => 0.2389, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.27% (0.8321 => 0.8843, std.dev.: 0.0194) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.58% (0.2741 => 0.2894, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 5.56% (1.1271 => 1.1898, std.dev.: 0.0061) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.48% (6.6074 => 6.9696, std.dev.: 0.0611) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.40% (0.2998 => 0.3160, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.36% (0.3137 => 0.3305, std.dev.: 0.0060) MultiSource/Applications/sgefa/sgefa: 4.83% (0.2999 => 0.3144, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.78% (1.1170 => 1.1704, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.60% (0.9435 => 0.9869, std.dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.52% (0.4559 => 0.4765, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: 4.50% (0.2509 => 0.2622, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.01% (0.7473 => 0.7773, std.dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.97% (0.5191 => 0.5397, std.dev.: 0.0037) MultiSource/Applications/lemon/lemon: 3.76% (1.0945 => 1.1356, std.dev.: 0.0089) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.71% (0.6227 => 0.6458, std.dev.: 0.0044) MultiSource/Applications/d/make_dparser: 3.69% (3.2366 => 3.3561, std.dev.: 0.0160) MultiSource/Applications/treecc/treecc: 3.61% (1.9948 => 2.0668, std.dev.: 0.0254) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.59% (1.1685 => 1.2105, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.55% (0.6586 => 0.6820, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.52% (14.2605 => 14.7629, std.dev.: 0.0965) MultiSource/Applications/minisat/minisat: 3.42% (0.6834 => 0.7068, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.39% (0.4783 => 0.4945, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.37% (1.6386 => 1.6939, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.36% (0.6287 => 0.6498, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.31% (1.3279 => 1.3719, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/hash: 3.18% (0.3800 => 0.3921, std.dev.: 0.0030) MultiSource/Applications/lua/lua: 3.18% (3.8189 => 3.9403, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.03% (0.8007 => 0.8250, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/football/football: 3.03% (0.8768 => 0.9034, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.00% (0.8457 => 0.8711, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/hash2: 2.98% (0.4125 => 0.4248, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.88% (0.9039 => 0.9299, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.85% (4.1763 => 4.2955, std.dev.: 0.0274) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.83% (8.6476 => 8.8921, std.dev.: 0.0474) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.79% (0.8697 => 0.8940, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.61% (0.8611 => 0.8836, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.60% (0.9688 => 0.9940, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.54% (3.1832 => 3.2641, std.dev.: 0.0241) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.52% (0.8340 => 0.8550, std.dev.: 0.0057) MultiSource/Benchmarks/mafft/pairlocalalign: 2.49% (8.6247 => 8.8394, std.dev.: 0.0488) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.44% (2.1401 => 2.1924, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.44% (0.9074 => 0.9295, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.40% (1.4479 => 1.4827, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.39% (0.8050 => 0.8242, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.37% (0.9056 => 0.9271, std.dev.: 0.0055) MultiSource/Applications/JM/ldecod/ldecod: 2.35% (6.7320 => 6.8900, std.dev.: 0.0345) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.32% (1.5315 => 1.5671, std.dev.: 0.0111) MultiSource/Applications/hexxagon/hexxagon: 2.29% (0.9810 => 1.0035, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.28% (0.5961 => 0.6097, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.28% (0.8331 => 0.8521, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.26% (1.2602 => 1.2887, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.26% (1.2526 => 1.2809, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.24% (0.7932 => 0.8110, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.24% (0.8805 => 0.9002, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.19% (0.8069 => 0.8246, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.18% (0.9908 => 1.0124, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.17% (0.8518 => 0.8703, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.17% (0.8338 => 0.8519, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.16% (0.8656 => 0.8843, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.16% (0.8286 => 0.8465, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.11% (0.8855 => 0.9042, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.03% (0.8316 => 0.8485, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.01% (0.8204 => 0.8369, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.00% (0.8086 => 0.8248, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.96% (0.8420 => 0.8585, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.96% (0.7966 => 0.8122, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 1.91% (4.1305 => 4.2095, std.dev.: 0.0293) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.90% (0.8995 => 0.9166, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.85% (0.8048 => 0.8197, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.84% (0.8317 => 0.8470, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.83% (0.8359 => 0.8512, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.74% (0.9069 => 0.9227, std.dev.: 0.0044) MultiSource/Applications/oggenc/oggenc: 1.74% (4.9628 => 5.0492, std.dev.: 0.0178) MultiSource/Benchmarks/PAQ8p/paq8p: 1.70% (2.3764 => 2.4167, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.69% (0.8261 => 0.8401, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.61% (0.8712 => 0.8852, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.59% (0.8927 => 0.9069, std.dev.: 0.0024) MultiSource/Benchmarks/Bullet/bullet: 1.53% (31.8598 => 32.3466, std.dev.: 0.0762) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 55.73% (1.5795 => 2.4597, std.dev.: 0.0271) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.87% (2.4333 => 2.6979, std.dev.: 0.0255) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.76% (14.6451 => 16.2211, std.dev.: 0.1755) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.23% (0.3186 => 0.3512, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.48% (1.1857 => 1.2863, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 5.93% (63.1822 => 66.9289, std.dev.: 0.0999) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.04% (2.4490 => 2.5234, std.dev.: 0.0144) SingleSource/Benchmarks/Misc/ReedSolomon: 2.81% (8.5322 => 8.7718, std.dev.: 0.0171) MultiSource/Applications/siod/siod: 2.56% (3.6643 => 3.7581, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.02% (4.3552 => 4.4431, std.dev.: 0.0248) SingleSource/Benchmarks/Shootout-C++/hash: 2.01% (0.6205 => 0.6330, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/bh/bh: 1.82% (2.3560 => 2.3989, std.dev.: 0.0145) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.10% (4.8362 => 4.8895, std.dev.: 0.0087) MultiSource/Benchmarks/llubenchmark/llu: 1.10% (1.9967 => 2.0187, std.dev.: 0.0085) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.53% (0.3269 => 0.2990, std.dev.: 0.0075) MultiSource/Applications/lua/lua: -5.24% (29.8330 => 28.2689, std.dev.: 0.0580) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.34% (0.2605 => 0.2492, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.23% (7.2130 => 6.9080, std.dev.: 0.0218) SingleSource/Benchmarks/Shootout-C++/hash2: -1.50% (3.4237 => 3.3725, std.dev.: 0.0125) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.22% (3.3479 => 3.3069, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.08% (1.4205 => 1.4051, std.dev.: 0.0040) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.73% (16.4461 => 16.7308, std.dev.: 0.0750) MultiSource/Applications/obsequi/Obsequi: 3.95% (1.0262 => 1.0667, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6849.31% (0.3123 => 21.7027, std.dev.: 0.0844) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.18% (0.2463 => 0.3699, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/bigfib: 0.87% (0.6010 => 0.6062, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.30% (0.3266 => 0.3341, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/strcat: 3.35% (0.1969 => 0.2035, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 52.85% (0.0123 => 0.0188, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.92% (0.0408 => 0.0424, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 11.02% (0.0254 => 0.0282, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.64% (0.0302 => 0.0316) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 3.39% (0.0384 => 0.0397, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 3.89% (0.0180 => 0.0187, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.97% (0.1438 => 0.1452, std.dev.: 0.0056) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -0.71% (1.1329 => 1.1249, std.dev.: 0.0379) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 0.62% (0.1462 => 0.1471, std.dev.: 0.0084) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.10% (0.4164 => 0.4210, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.68% (0.1369 => 0.1346, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.90% (0.0641 => 0.0616, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 9.23% (0.0195 => 0.0213, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.29% (0.0578 => 0.0559, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.30% (1.1437 => 1.1403, std.dev.: 0.0147) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0001 => 0.0002, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.19% (0.0627 => 0.0607, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 10.00% (0.0180 => 0.0198, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.39% (0.8017 => 0.7986, std.dev.: 0.0204) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -29.03% (0.0062 => 0.0044, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 3.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 30 00:18:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 30 Oct 2012 02:18:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121030071841.7026F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5396?compare_to=5389&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5396, Order: 166998, Start Time: 2012-10-30 04:00:04, End Time: 2012-10-30 07:18:41 To: 5389, Order: 166977, Start Time: 2012-10-29 23:56:20, End Time: 2012-10-30 03:11:37 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (168 on baseline) Performance Improvements: 3 (19 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1038 (721 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.14% (123.1357 => 128.2295, std.dev.: 1.8218) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.49% (1.9986 => 1.9689, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.23% (2.2799 => 2.2518, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: -1.01% (1.2544 => 1.2417, std.dev.: 0.0024) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 39.04% (0.0625 => 0.0869, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.76% (0.1063 => 0.1390, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.40% (0.2969 => 0.3723, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.14% (0.1106 => 0.1384, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.67% (0.4139 => 0.5160, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 23.58% (1.5932 => 1.9689, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.11% (0.4253 => 0.5236, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.97% (0.0714 => 0.0878, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.93% (0.5900 => 0.7253, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.85% (0.0547 => 0.0672, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 22.69% (0.4994 => 0.6127, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.53% (0.0475 => 0.0582, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.43% (0.0584 => 0.0715, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.22% (0.5000 => 0.6111, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 21.73% (0.0948 => 0.1154, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.52% (0.0897 => 0.1090, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.30% (0.1620 => 0.1965, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 21.20% (0.0599 => 0.0726, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 20.86% (0.1021 => 0.1234, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 20.69% (0.1107 => 0.1336, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.40% (0.1549 => 0.1865, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.15% (0.0541 => 0.0650, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/04-bisect/bisect: 19.75% (0.0633 => 0.0758, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.70% (0.1604 => 0.1920, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.69% (0.0584 => 0.0699, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.47% (0.0642 => 0.0767, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.42% (0.3903 => 0.4661, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.40% (0.1103 => 0.1317, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 19.21% (0.0604 => 0.0720, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.14% (0.1003 => 0.1195, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/health/health: 19.12% (0.0821 => 0.0978, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 19.02% (0.1619 => 0.1927, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.86% (0.0822 => 0.0977, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.19% (0.1160 => 0.1371, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 18.07% (0.0808 => 0.0954, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.06% (0.1462 => 0.1726, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 17.95% (0.0947 => 0.1117, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.73% (0.2736 => 0.3221, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.71% (0.3890 => 0.4579, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/mst/mst: 17.48% (0.0698 => 0.0820, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.48% (0.2014 => 0.2366, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.41% (0.2866 => 0.3365, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.36% (0.0605 => 0.0710, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 17.16% (0.5826 => 0.6826, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/08-main/main: 17.08% (0.1218 => 0.1426, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.01% (1.3152 => 1.5389, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference-object: 16.90% (0.5889 => 0.6884, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 16.82% (0.1088 => 0.1271, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 16.78% (0.4029 => 0.4705, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 16.68% (0.1505 => 0.1756, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 16.52% (0.5546 => 0.6462, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 16.42% (1.8794 => 2.1880, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.36% (0.3271 => 0.3806, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.28% (3.5627 => 4.1428, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.22% (0.5026 => 0.5841, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.17% (0.2875 => 0.3340, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 16.02% (0.9697 => 1.1250, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 15.97% (0.4658 => 0.5402, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 15.85% (1.6211 => 1.8781, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.75% (0.1968 => 0.2278, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/18-imp/imp: 15.69% (0.1421 => 0.1644, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 15.41% (0.2725 => 0.3145, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.34% (0.2738 => 0.3158, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: 15.33% (0.2714 => 0.3130, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 15.31% (0.3004 => 0.3464, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 15.29% (0.2780 => 0.3205, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.27% (0.4361 => 0.5027, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 15.24% (0.2750 => 0.3169, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.21% (0.2729 => 0.3144, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 15.17% (1.0781 => 1.2417, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference: 15.17% (0.7171 => 0.8259, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.11% (0.2792 => 0.3214, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 15.11% (0.2813 => 0.3238, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 15.10% (0.9909 => 1.1405, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/random: 15.06% (0.2803 => 0.3225, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/objinst: 15.05% (0.2823 => 0.3248, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 15.01% (0.2811 => 0.3233, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.00% (4.4195 => 5.0826, std.dev.: 0.0105) MultiSource/Benchmarks/Olden/bh/bh: 14.95% (0.1284 => 0.1476, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 14.92% (0.3096 => 0.3558, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.91% (0.3930 => 0.4516, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.91% (0.2911 => 0.3345, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.87% (0.3195 => 0.3670, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.86% (2.0673 => 2.3745, std.dev.: 0.0419) MultiSource/Benchmarks/Bullet/bullet: 14.80% (23.5202 => 27.0004, std.dev.: 0.1082) MultiSource/Applications/ClamAV/clamscan: 14.76% (4.2109 => 4.8326, std.dev.: 0.0050) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.75% (2.7292 => 3.1317, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 14.49% (0.3258 => 0.3730, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 14.48% (0.3267 => 0.3740, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.42% (1.9966 => 2.2845, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.34% (1.9694 => 2.2518, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.31% (0.3060 => 0.3498, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/football/football: 14.22% (0.2075 => 0.2370, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 14.17% (0.3317 => 0.3787, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.07% (0.3362 => 0.3835, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.04% (0.1090 => 0.1243, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.96% (0.3124 => 0.3560, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.71% (0.3625 => 0.4122, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.65% (0.3282 => 0.3730, std.dev.: 0.0115) MultiSource/Benchmarks/nbench/nbench: 13.64% (0.2566 => 0.2916, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 13.62% (1.4269 => 1.6213, std.dev.: 0.0244) SingleSource/Benchmarks/Shootout-C++/hash: 13.58% (0.4146 => 0.4709, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 13.46% (0.3678 => 0.4173, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 13.45% (0.3726 => 0.4227, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: 13.44% (0.3348 => 0.3798, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 13.34% (0.3477 => 0.3941, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.22% (0.3690 => 0.4178, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.14% (0.3981 => 0.4504, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 13.13% (0.4251 => 0.4809, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.77% (0.3845 => 0.4336, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 12.71% (0.7875 => 0.8876, std.dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 12.65% (2.1653 => 2.4392, std.dev.: 0.0048) MultiSource/Applications/JM/lencod/lencod: 12.60% (4.6177 => 5.1994, std.dev.: 0.0096) SingleSource/UnitTests/ObjC/exceptions-2: 12.54% (0.3446 => 0.3878, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 12.53% (0.5012 => 0.5640, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-4: 12.47% (0.3465 => 0.3897, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.41% (0.3496 => 0.3930, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.39% (0.3488 => 0.3920, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 12.38% (0.3442 => 0.3868, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 12.34% (0.3469 => 0.3897, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 12.28% (0.3460 => 0.3885, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.21% (0.2040 => 0.2289, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 12.03% (0.3650 => 0.4089, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 12.02% (0.3643 => 0.4081, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 12.00% (0.3724 => 0.4171, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 11.99% (2.1013 => 2.3532, std.dev.: 0.0151) MultiSource/Applications/SIBsim4/SIBsim4: 11.48% (0.2691 => 0.3000, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.08% (0.6435 => 0.7148, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 11.04% (5.5417 => 6.1534, std.dev.: 0.0146) MultiSource/Applications/lambda-0_1_3/lambda: 10.61% (0.3498 => 0.3869, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.56% (0.1383 => 0.1529, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.51% (0.1028 => 0.1136, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.27% (0.2737 => 0.3018, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.11% (0.2068 => 0.2277, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 9.95% (0.6634 => 0.7294, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 9.83% (0.3336 => 0.3664, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.73% (0.3084 => 0.3384, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.18% (0.2103 => 0.2296, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 9.08% (2.0346 => 2.2193, std.dev.: 0.0042) MultiSource/Applications/lemon/lemon: 8.70% (0.2391 => 0.2599, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.59% (4.6926 => 5.0956, std.dev.: 0.0175) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.36% (11.6398 => 12.6132, std.dev.: 0.0347) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.89% (0.5361 => 0.5784, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.32% (0.5584 => 0.5993, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.26% (0.7426 => 0.7965, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 6.20% (11.9555 => 12.6972, std.dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6533, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 8.92% (0.2802 => 0.3052, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6101, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 5.07% (12.0509 => 12.6624, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary: 5.04% (0.2122 => 0.2229, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1698, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-2: 4.13% (1.8057 => 1.8802, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/dry: 2.75% (14.0481 => 14.4339, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1957, std.dev.: 0.0072) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.77% (3.1722 => 3.2283, std.dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3054, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2869, std.dev.: 0.0016) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.23% (1.0142 => 1.0267, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5145, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5405, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5873, std.dev.: 0.0129) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.88% (2.4764 => 2.4298, std.dev.: 0.0085) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.47% (25.4195 => 16.4020, std.dev.: 0.0251) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9749, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -7.67% (35.5013 => 32.7766, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9586, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: -6.41% (0.2402 => 0.2248, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.40% (11.2080 => 10.8272, std.dev.: 0.0268) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7755, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5217, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.83% (0.6293 => 0.6115, std.dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/fldry: -2.53% (17.2379 => 16.8022, std.dev.: 0.0289) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.17% (41.7953 => 40.8885, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.81% (10.7630 => 10.5683, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4960, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.10% (105.3826 => 104.2262, std.dev.: 0.0529) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0432, std.dev.: 0.0029) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.05% (3.3991 => 3.3634, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 30 00:29:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 30 Oct 2012 02:29:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121030072907.A52972A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5397?compare_to=5393&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5397, Order: 167005, Start Time: 2012-10-30 06:01:48, End Time: 2012-10-30 07:29:06 To: 5393, Order: 166998, Start Time: 2012-10-30 04:13:14, End Time: 2012-10-30 05:38:35 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (153 on baseline) Unchanged Tests: 1042 (884 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.37% (15.2527 => 18.3592, std.dev.: 0.0255) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.69% (2.0478 => 2.1029, std.dev.: 0.0205) SingleSource/Benchmarks/Misc/salsa20: 2.47% (7.4937 => 7.6786, std.dev.: 0.0190) SingleSource/Benchmarks/Shootout-C++/hash2: 2.12% (3.1932 => 3.2608, std.dev.: 0.0237) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.46% (0.1584 => 0.1450, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.32% (0.1431 => 0.1312, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.41% (0.3821 => 0.3538, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.33% (0.3142 => 0.2943, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -6.33% (0.1879 => 0.1760, std.dev.: 0.0038) MultiSource/Benchmarks/PAQ8p/paq8p: -6.22% (2.4924 => 2.3373, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.22% (0.2428 => 0.2277, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.18% (22.4056 => 21.0211, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.10% (0.3658 => 0.3435, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: -6.03% (0.3831 => 0.3600, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.97% (0.3884 => 0.3652, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -5.95% (0.3880 => 0.3649, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: -5.95% (0.4033 => 0.3793, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.90% (0.3896 => 0.3666, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: -5.88% (0.3812 => 0.3588, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.86% (0.3891 => 0.3663, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.82% (0.9852 => 0.9279, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: -5.79% (0.2659 => 0.2505, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-3: -5.77% (0.3848 => 0.3626, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.76% (0.9542 => 0.8992, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.75% (4.5069 => 4.2477, std.dev.: 0.0085) MultiSource/Applications/sgefa/sgefa: -5.75% (0.3357 => 0.3164, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: -5.75% (0.4176 => 0.3936, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.73% (0.2355 => 0.2220, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: -5.66% (7.0961 => 6.6944, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.64% (0.6484 => 0.6118, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.62% (5.4682 => 5.1608, std.dev.: 0.1044) SingleSource/UnitTests/ObjC/property: -5.57% (0.4199 => 0.3965, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -5.57% (16.1920 => 15.2904, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.52% (4.0323 => 3.8098, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.47% (0.3837 => 0.3627, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: -5.46% (4.3330 => 4.0966, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.46% (0.2548 => 0.2409, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -5.42% (0.4280 => 0.4048, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -5.42% (0.3026 => 0.2862, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.42% (4.8161 => 4.5553, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.40% (0.3849 => 0.3641, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/hash2: -5.39% (0.4861 => 0.4599, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.37% (1.0544 => 0.9978, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.37% (2.1713 => 2.0548, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.36% (4.8802 => 4.6185, std.dev.: 0.0045) MultiSource/Applications/siod/siod: -5.36% (2.4021 => 2.2733, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/objinst: -5.35% (0.3194 => 0.3023, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.33% (0.3057 => 0.2894, std.dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: -5.32% (1.3148 => 1.2448, std.dev.: 0.0185) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.30% (0.7919 => 0.7499, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.30% (0.5999 => 0.5681, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.29% (1.2210 => 1.1564, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hello: -5.27% (0.2849 => 0.2699, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.24% (0.3931 => 0.3725, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/random: -5.24% (0.2939 => 0.2785, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: -5.23% (1.2515 => 1.1860, std.dev.: 0.0068) SingleSource/Regression/C++/ofstream_ctor: -5.23% (0.3059 => 0.2899, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.23% (0.3252 => 0.3082, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.20% (1.2221 => 1.1586, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary2: -5.17% (0.3481 => 0.3301, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/matrix: -5.10% (0.3255 => 0.3089, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/wc: -5.09% (0.3205 => 0.3042, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.07% (0.3016 => 0.2863, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.07% (0.4083 => 0.3876, std.dev.: 0.0078) MultiSource/Applications/lua/lua: -5.05% (4.0594 => 3.8542, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.05% (0.2278 => 0.2163, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.03% (0.3323 => 0.3156, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.02% (0.4321 => 0.4104, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.01% (1.2784 => 1.2143, std.dev.: 0.0058) SingleSource/UnitTests/ObjC++/property-reference: -5.00% (0.7779 => 0.7390, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.98% (0.8521 => 0.8097, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.91% (1.4642 => 1.3923, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.87% (0.2999 => 0.2853, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: -4.86% (18.2933 => 17.4046, std.dev.: 0.0246) MultiSource/Benchmarks/mafft/pairlocalalign: -4.85% (9.2283 => 8.7809, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.83% (1.3722 => 1.3059, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.80% (0.5478 => 0.5215, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.78% (0.6052 => 0.5763, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -4.76% (34.0927 => 32.4684, std.dev.: 0.0362) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.76% (0.6304 => 0.6004, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.76% (0.5591 => 0.5325, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/bh/bh: -4.76% (0.2985 => 0.2843, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.76% (0.3491 => 0.3325, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.74% (0.6667 => 0.6351, std.dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.74% (0.4813 => 0.4585, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -4.71% (1.6364 => 1.5593, std.dev.: 0.0229) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.70% (0.3319 => 0.3163, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.69% (0.6676 => 0.6363, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.68% (0.4916 => 0.4686, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.68% (0.5859 => 0.5585, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.68% (0.5925 => 0.5648, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.65% (0.6230 => 0.5940, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -4.65% (0.7982 => 0.7611, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.62% (0.6446 => 0.6148, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.62% (0.5802 => 0.5534, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -4.62% (0.6347 => 0.6054, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.61% (0.6395 => 0.6100, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -4.61% (0.6441 => 0.6144, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.61% (0.6681 => 0.6373, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.61% (0.5705 => 0.5442, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.61% (0.5575 => 0.5318, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.59% (0.5857 => 0.5588, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.56% (0.7339 => 0.7004, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: -4.56% (0.4515 => 0.4309, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.56% (0.5570 => 0.5316, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.56% (0.6297 => 0.6010, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.55% (0.6260 => 0.5975, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.54% (0.6293 => 0.6007, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.53% (0.2933 => 0.2800, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.53% (0.5581 => 0.5328, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.53% (0.5456 => 0.5209, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.53% (0.5569 => 0.5317, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.52% (0.5863 => 0.5598, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.52% (0.6660 => 0.6359, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.51% (0.5941 => 0.5673, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.51% (0.6189 => 0.5910, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.50% (0.5849 => 0.5586, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.50% (0.5805 => 0.5544, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.45% (0.7524 => 0.7189, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: -4.42% (0.4524 => 0.4324, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.41% (0.6033 => 0.5767, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.36% (0.6440 => 0.6159, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.36% (0.2385 => 0.2281, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: -4.30% (0.3581 => 0.3427, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: -4.27% (0.9179 => 0.8787, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.27% (0.6395 => 0.6122, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.25% (0.5688 => 0.5446, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.24% (0.5567 => 0.5331, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -4.19% (0.7447 => 0.7135, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.18% (0.7198 => 0.6897, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: -4.12% (1.1450 => 1.0978, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: -4.11% (0.3406 => 0.3266, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -4.06% (0.8418 => 0.8076, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: -4.01% (5.0226 => 4.8210, std.dev.: 0.0170) MultiSource/Applications/treecc/treecc: -3.90% (2.1401 => 2.0566, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: -3.84% (15.5079 => 14.9123, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -3.83% (8.0126 => 7.7061, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.82% (0.6736 => 0.6479, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.79% (0.3483 => 0.3351, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.78% (0.9077 => 0.8734, std.dev.: 0.0042) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.72% (6.7716 => 6.5199, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/09-vor/vor: -3.70% (0.3271 => 0.3150, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: -3.62% (17.1032 => 16.4843, std.dev.: 0.0177) MultiSource/Applications/hbd/hbd: -3.61% (1.5610 => 1.5047, std.dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.44% (1.2300 => 1.1877, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: -3.39% (3.5154 => 3.3963, std.dev.: 0.0062) MultiSource/Benchmarks/nbench/nbench: -3.17% (1.1530 => 1.1165, std.dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -3.02% (20.7746 => 20.1476, std.dev.: 0.0270) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.83% (14.2083 => 13.8058, std.dev.: 0.0313) MultiSource/Applications/SIBsim4/SIBsim4: -1.72% (1.3864 => 1.3626, std.dev.: 0.0082) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7559, std.dev.: 0.0305) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1724, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7063, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/fbench: -3.71% (2.2633 => 2.1793, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4705, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 30 01:10:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 30 Oct 2012 03:10:50 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121030081050.DB9392A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5398?compare_to=5394&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5398, Order: 167005, Start Time: 2012-10-30 06:36:02, End Time: 2012-10-30 08:10:49 To: 5394, Order: 166998, Start Time: 2012-10-30 04:33:10, End Time: 2012-10-30 06:06:17 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 0 (171 on baseline) Performance Improvements: 1 (52 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 2 (2 on baseline) Unchanged Tests: 1039 (666 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.02% (80.7333 => 79.9099, std.dev.: 0.2629) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: - (0.1406 => 0.1406, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.46% (0.0649 => 0.0646, std.dev.: 0.0033) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 199.31% (0.5229 => 1.5651, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 13.41% (14.9895 => 17.0003, std.dev.: 0.0316) MultiSource/Applications/kimwitu++/kc: 35.56% (14.1553 => 19.1896, std.dev.: 0.0119) MultiSource/Benchmarks/MallocBench/gs/gs: 12.07% (4.1105 => 4.6067, std.dev.: 0.0214) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 28.80% (1.1048 => 1.4230, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 305.59% (7.1582 => 29.0327, std.dev.: 0.4989) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.35% (3.4629 => 5.7953, std.dev.: 0.0227) SingleSource/Benchmarks/Misc-C++/stepanov_container: 63.40% (0.6222 => 1.0167, std.dev.: 0.0061) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10547.92% (0.0720 => 7.6665, std.dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: 3836400.00% (0.0001 => 3.8365, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 11176300.00% (0.0001 => 11.1764, std.dev.: 0.0114) MultiSource/Applications/kimwitu++/kc: 50900.00% (0.0001 => 0.0510, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 779400.00% (0.0001 => 0.7795, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049900.00% (0.0001 => 10.0500, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5491200.00% (0.0001 => 5.4913, std.dev.: 0.0483) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 38.07% (0.1056 => 0.1458, std.dev.: 0.0009) SingleSource/UnitTests/vla: 28.73% (0.0355 => 0.0457, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 27.30% (0.1432 => 0.1823, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.88% (0.1566 => 0.1893, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/rem: 17.57% (0.1144 => 0.1345, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.46% (0.0842 => 0.0989, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 17.12% (0.0730 => 0.0855, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.04% (0.0886 => 0.1037, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.88% (0.0871 => 0.1018, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.82% (0.0648 => 0.0757, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/17-bintr/bintr: 16.74% (0.0675 => 0.0788, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 16.60% (0.1175 => 0.1370, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: 16.49% (0.0746 => 0.0869, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.39% (0.0793 => 0.0923, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 16.27% (0.3177 => 0.3694, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.19% (0.8172 => 0.9495, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 16.07% (0.4879 => 0.5663, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.83% (0.0834 => 0.0966, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 15.75% (0.0730 => 0.0845, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: 15.74% (0.2554 => 0.2956, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 15.15% (0.1584 => 0.1824, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/mst/mst: 15.05% (0.1163 => 0.1338, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 14.79% (0.1555 => 0.1785, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/loader/loader: 14.39% (0.2758 => 0.3155, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/em3d/em3d: 14.34% (0.1695 => 0.1938, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.33% (0.2065 => 0.2361, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 14.14% (0.5105 => 0.5827, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 13.96% (0.1655 => 0.1886, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 13.94% (0.7115 => 0.8107, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.78% (0.2700 => 0.3072, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 13.76% (22.1758 => 25.2272, std.dev.: 0.0269) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.52% (0.1117 => 0.1268, std.dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.49% (0.3121 => 0.3542, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.38% (0.0770 => 0.0873, std.dev.: 0.0017) MultiSource/Applications/d/make_dparser: 13.36% (3.3354 => 3.7811, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.28% (0.0798 => 0.0904, std.dev.: 0.0037) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 13.16% (0.1125 => 0.1273, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.12% (0.5860 => 0.6629, std.dev.: 0.0053) MultiSource/Applications/aha/aha: 13.12% (0.1151 => 0.1302, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.11% (0.1510 => 0.1708, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 13.09% (0.1940 => 0.2194, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 13.06% (0.3109 => 0.3515, std.dev.: 0.0021) MultiSource/Applications/spiff/spiff: 13.06% (0.7835 => 0.8858, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.02% (0.6675 => 0.7544, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 12.97% (0.5981 => 0.6757, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.94% (0.1337 => 0.1510, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.90% (0.2271 => 0.2564, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.77% (0.2107 => 0.2376, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.75% (0.9765 => 1.1010, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.74% (0.4615 => 0.5203, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.71% (0.1062 => 0.1197, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.68% (1.5415 => 1.7370, std.dev.: 0.0030) MultiSource/Applications/Burg/burg: 12.64% (1.1642 => 1.3113, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.63% (0.1029 => 0.1159, std.dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 12.57% (0.7433 => 0.8367, std.dev.: 0.0037) MultiSource/Applications/treecc/treecc: 12.18% (2.0273 => 2.2742, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.13% (0.5020 => 0.5629, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/18-imp/imp: 12.09% (0.3423 => 0.3837, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.03% (1.3050 => 1.4620, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.96% (0.5569 => 0.6235, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.95% (0.2603 => 0.2914, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.92% (0.1032 => 0.1155, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.83% (0.6450 => 0.7213, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/health/health: 11.67% (0.1268 => 0.1416, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.60% (0.3441 => 0.3840, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: 11.52% (1.0722 => 1.1957, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 11.49% (3.8723 => 4.3171, std.dev.: 0.0240) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.41% (0.1236 => 0.1377, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.37% (0.3307 => 0.3683, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.32% (0.1625 => 0.1809, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.31% (1.1861 => 1.3203, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/05-eks/eks: 11.07% (0.4299 => 0.4775, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.98% (0.0929 => 0.1031, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 10.93% (0.8921 => 0.9896, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/neural/neural: 10.87% (0.1463 => 0.1622, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.87% (4.2646 => 4.7280, std.dev.: 0.0048) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.76% (0.1143 => 0.1266, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.71% (8.1363 => 9.0075, std.dev.: 0.0118) SingleSource/UnitTests/ObjC/trivial-interface: 10.57% (0.3473 => 0.3840, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 10.56% (0.4289 => 0.4742, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/09-vor/vor: 10.50% (0.3180 => 0.3514, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.49% (0.1906 => 0.2106, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/parameter-passing: 10.47% (0.3927 => 0.4338, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.44% (0.3543 => 0.3913, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 10.42% (0.3561 => 0.3932, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.41% (0.3516 => 0.3882, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.41% (0.3497 => 0.3861, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.36% (0.3543 => 0.3910, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 10.34% (0.3828 => 0.4224, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 10.30% (0.3387 => 0.3736, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 10.27% (9.4845 => 10.4588, std.dev.: 0.0949) MultiSource/Benchmarks/nbench/nbench: 10.25% (1.1840 => 1.3054, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/for-in: 10.23% (0.3694 => 0.4072, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.23% (1.5859 => 1.7481, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.23% (2.2022 => 2.4274, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.15% (0.1695 => 0.1867, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.13% (0.8101 => 0.8922, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/property: 9.98% (0.3886 => 0.4274, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.94% (0.1892 => 0.2080, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 9.87% (0.1044 => 0.1147, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 9.81% (0.4620 => 0.5073, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 9.65% (0.6456 => 0.7079, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.62% (2.2024 => 2.4143, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.40% (0.1330 => 0.1455, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 9.32% (2.2969 => 2.5110, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.29% (14.3668 => 15.7008, std.dev.: 0.0129) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.28% (0.4636 => 0.5066, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.18% (0.4203 => 0.4589, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.14% (1.4186 => 1.5483, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.11% (0.3865 => 0.4217, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: 9.03% (0.3422 => 0.3731, std.dev.: 0.0024) MultiSource/Applications/oggenc/oggenc: 8.73% (5.7591 => 6.2618, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/moments: 8.70% (0.4048 => 0.4400, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/lists1: 8.52% (0.3684 => 0.3998, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 8.51% (1.5603 => 1.6931, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.48% (5.0018 => 5.4259, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.42% (4.9449 => 5.3612, std.dev.: 0.0201) SingleSource/Benchmarks/Shootout-C++/sieve: 8.41% (0.3603 => 0.3906, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.41% (0.6030 => 0.6537, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 8.30% (0.5925 => 0.6417, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.88% (0.2905 => 0.3134, std.dev.: 0.0058) SingleSource/UnitTests/ObjC++/property-reference: 7.77% (0.7326 => 0.7895, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.74% (0.2430 => 0.2618, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.73% (0.3650 => 0.3932, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.70% (0.2793 => 0.3008, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.55% (0.3826 => 0.4115, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.54% (0.2891 => 0.3109, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.47% (0.3427 => 0.3683, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: 7.45% (0.2831 => 0.3042, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 7.34% (0.3283 => 0.3524, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.33% (0.4064 => 0.4362, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 7.31% (17.1811 => 18.4368, std.dev.: 0.0237) SingleSource/Benchmarks/Shootout-C++/methcall: 7.30% (0.2877 => 0.3087, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 7.26% (0.3098 => 0.3323, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 7.24% (0.3232 => 0.3466, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.21% (0.2872 => 0.3079, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.18% (0.2714 => 0.2909, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 7.18% (0.2871 => 0.3077, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.16% (0.2725 => 0.2920, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.15% (0.2756 => 0.2953, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 7.04% (0.3052 => 0.3267, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.82% (0.2802 => 0.2993, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 6.48% (0.3379 => 0.3598, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 6.39% (1.2842 => 1.3663, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: 6.24% (0.3092 => 0.3285, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.83% (0.8067 => 0.8537, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/oourafft: 5.79% (0.3282 => 0.3472, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.37% (3.8922 => 4.1011, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.37% (0.3131 => 0.3299, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.90% (0.2266 => 0.2377, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.51% (0.3935 => 0.4073, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.88% (0.3817 => 0.3927, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.98% (7.9617 => 8.1190, std.dev.: 0.0127) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8953, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.71% (1.1145 => 1.3007, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.55% (0.2944 => 0.3284, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2176, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 10.04% (1.1396 => 1.2540, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3691, std.dev.: 0.0009) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.74% (4.2280 => 4.3439, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.93% (0.8333 => 0.8494, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2074, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.32% (11.6436 => 11.7970, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.03% (6.5088 => 6.5759, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.96% (6.6874 => 0.1366, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: -77.09% (0.8651 => 0.1982, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.78% (5.3855 => 2.3817, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -55.44% (5.3526 => 2.3852, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/richards_benchmark: -46.05% (0.1622 => 0.0875, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.60% (1.1194 => 0.6761, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.30% (5.2763 => 3.2557, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -24.69% (1.7609 => 1.3262, std.dev.: 0.0099) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -17.59% (2.9384 => 2.4215, std.dev.: 0.0043) MultiSource/Applications/JM/ldecod/ldecod: -10.52% (10.4361 => 9.3383, std.dev.: 0.0222) MultiSource/Benchmarks/Bullet/bullet: -10.37% (63.2438 => 56.6880, std.dev.: 1.1028) SingleSource/UnitTests/Vector/constpool: -9.44% (54.1659 => 49.0538, std.dev.: 0.0280) MultiSource/Benchmarks/PAQ8p/paq8p: -3.85% (10.3673 => 9.9677, std.dev.: 0.1328) MultiSource/Applications/JM/lencod/lencod: -2.45% (21.9371 => 21.3999, std.dev.: 0.0313) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -33.68% (0.3987 => 0.2644, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7645, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -29.08% (10.7105 => 7.5954, std.dev.: 0.1663) SingleSource/Benchmarks/Misc/flops-6: -15.97% (1.6925 => 1.4222, std.dev.: 0.0042) MultiSource/Benchmarks/NPB-serial/is/is: -10.97% (9.5636 => 8.5142, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: -10.67% (1.5373 => 1.3732, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.46% (19.9488 => 18.2611, std.dev.: 0.0185) MultiSource/Benchmarks/FreeBench/mason/mason: -7.73% (0.2161 => 0.1994, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.13% (1.8329 => 1.7023, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4780, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.44% (1.2373 => 1.1576, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5753, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -5.46% (6.6465 => 6.2833, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.12% (1.6805 => 1.5944, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-5: -4.98% (1.5835 => 1.5047, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.19% (0.9957 => 0.9540, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.04% (0.2497 => 0.2396, std.dev.: 0.0012) MultiSource/Applications/siod/siod: -3.85% (3.2827 => 3.1562, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.50% (32.5116 => 31.3744, std.dev.: 0.0028) MultiSource/Benchmarks/sim/sim: -3.24% (5.0483 => 4.8849, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.78% (4.5009 => 4.3760, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: -2.70% (4.6441 => 4.5188, std.dev.: 0.0034) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.45% (0.4808 => 0.4690, std.dev.: 0.0013) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.02% (8.1563 => 7.9914, std.dev.: 0.0124) SingleSource/Benchmarks/Misc/salsa20: -1.90% (10.2830 => 10.0872, std.dev.: 0.0309) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6796, std.dev.: 0.0019) SingleSource/UnitTests/Vector/multiplies: -1.65% (2.5528 => 2.5108, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1095) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8580, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2352, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -5.32% (0.1485 => 0.1406, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.47% (0.2116 => 0.0646, std.dev.: 0.0033) Report Time: 2.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 30 01:18:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 30 Oct 2012 03:18:03 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121030081803.F28DA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5399?compare_to=5395&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5399, Order: 167007, Start Time: 2012-10-30 06:50:38, End Time: 2012-10-30 08:18:05 To: 5395, Order: 167003, Start Time: 2012-10-30 05:06:42, End Time: 2012-10-30 06:33:36 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 15 (96 on baseline) Performance Improvements: 1 (5 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 975 (873 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.69% (0.2288 => 0.2464, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/08-main/main: 6.14% (0.2575 => 0.2733, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.43% (0.8275 => 0.8724, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.94% (0.4916 => 0.5159, std.dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.27% (0.3305 => 0.3446, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.69% (1.1765 => 1.2082, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.61% (0.8242 => 0.8375, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 1.51% (0.8285 => 0.8410, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/gs/gs: 1.36% (4.2095 => 4.2667, std.dev.: 0.0076) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.15% (4.5481 => 4.6004, std.dev.: 0.0142) MultiSource/Applications/siod/siod: 1.02% (2.2403 => 2.2631, std.dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.36% (0.7291 => 0.7536, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/life/life: 3.19% (2.5535 => 2.6349, std.dev.: 0.0126) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.91% (1.2382 => 1.2619, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.42% (4.4148 => 4.4777, std.dev.: 0.0111) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.15% (0.3512 => 0.3331, std.dev.: 0.0061) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.46% (16.7308 => 16.6538, std.dev.: 0.0904) MultiSource/Applications/obsequi/Obsequi: -0.93% (1.0667 => 1.0568, std.dev.: 0.0085) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.35% (21.7027 => 21.6267, std.dev.: 0.2135) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.27% (0.3699 => 0.3652, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: -0.38% (0.6062 => 0.6039, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.15% (0.3341 => 0.3336, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/strcat: -2.21% (0.2035 => 0.1990, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 15.43% (0.0188 => 0.0217, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -9.67% (0.0424 => 0.0383, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 14.18% (0.0282 => 0.0322, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.58% (0.0316 => 0.0311, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 6.05% (0.0397 => 0.0421, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0203 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 16.04% (0.0187 => 0.0217, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 0.28% (0.1452 => 0.1456, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.75% (1.1249 => 1.1052, std.dev.: 0.0262) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.63% (0.1471 => 0.1447, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.63% (0.4210 => 0.4057, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.15% (0.1346 => 0.1348, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.76% (0.0616 => 0.0599, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.47% (0.0213 => 0.0212, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.18% (0.0559 => 0.0560, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.08% (1.1403 => 1.1412, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 950.00% (0.0002 => 0.0021, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 1900.00% (0.0001 => 0.0020, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.61% (0.0607 => 0.0579, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 33.84% (0.0198 => 0.0265, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.08% (0.7986 => 0.7992, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 45.45% (0.0044 => 0.0064, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2327.21% (0.6332 => 15.3691, std.dev.: 0.1890) MultiSource/Benchmarks/McCat/08-main/main: 49.26% (0.1831 => 0.2733, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.22% (0.1559 => 0.1462, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1477.27% (0.3344 => 5.2744, std.dev.: 0.0949) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.58% (0.2364 => 0.3276, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel: 2.56% (0.0429 => 0.0440, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.46% (0.0224 => 0.0234, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0012) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4427, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0699, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4930, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3472, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0404, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4083, std.dev.: 0.0016) SingleSource/Regression/C/uint64_to_float: -23.75% (2.1832 => 1.6647, std.dev.: 0.0010) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 35.89% (14.7684 => 20.0684, std.dev.: 0.0214) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.56% (0.0810 => 0.0936, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/tsp/tsp: 14.21% (0.1112 => 0.1270, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.85% (0.3137 => 0.3446, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.15% (0.1137 => 0.1241, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.82% (0.1157 => 0.1259, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.12% (0.2279 => 0.2464, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.03% (0.2180 => 0.2355, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.72% (0.1983 => 0.2136, std.dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: 7.29% (1.2568 => 1.3484, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.28% (0.8321 => 0.8927, std.dev.: 0.0161) MultiSource/Applications/viterbi/viterbi: 7.23% (0.1577 => 0.1691, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.07% (0.8148 => 0.8724, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.44% (0.4847 => 0.5159, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.40% (0.1905 => 0.2027, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.80% (0.2998 => 0.3172, std.dev.: 0.0023) MultiSource/Applications/spiff/spiff: 5.79% (0.7950 => 0.8410, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.58% (0.2741 => 0.2894, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.53% (0.7473 => 0.7886, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.51% (13.1811 => 13.9080, std.dev.: 0.2501) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.48% (1.1170 => 1.1782, std.dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.46% (0.1885 => 0.1988, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.45% (1.6386 => 1.7279, std.dev.: 0.0271) MultiSource/Benchmarks/nbench/nbench: 5.28% (1.1271 => 1.1866, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.18% (0.9435 => 0.9924, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.17% (0.6287 => 0.6612, std.dev.: 0.0061) MultiSource/Applications/Burg/burg: 4.93% (1.2222 => 1.2825, std.dev.: 0.0150) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.90% (0.6227 => 0.6532, std.dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.88% (6.6074 => 6.9301, std.dev.: 0.0719) MultiSource/Applications/treecc/treecc: 4.42% (1.9948 => 2.0829, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.34% (0.4559 => 0.4757, std.dev.: 0.0068) MultiSource/Applications/sgefa/sgefa: 4.23% (0.2999 => 0.3126, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.22% (1.1685 => 1.2178, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/football/football: 4.21% (0.8768 => 0.9137, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.10% (1.1606 => 1.2082, std.dev.: 0.0069) MultiSource/Applications/hbd/hbd: 4.10% (1.4269 => 1.4854, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.04% (0.8050 => 0.8375, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 3.99% (3.8189 => 3.9712, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.89% (1.3279 => 1.3795, std.dev.: 0.0051) MultiSource/Applications/d/make_dparser: 3.88% (3.2366 => 3.3623, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.81% (0.5191 => 0.5389, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.80% (8.6476 => 8.9765, std.dev.: 0.0283) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.79% (0.3295 => 0.3420, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 3.76% (14.2605 => 14.7969, std.dev.: 0.0425) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.71% (0.5817 => 0.6033, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.66% (0.3003 => 0.3113, std.dev.: 0.0031) MultiSource/Applications/minisat/minisat: 3.56% (0.6834 => 0.7077, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.54% (0.6586 => 0.6819, std.dev.: 0.0039) MultiSource/Applications/lemon/lemon: 3.44% (1.0945 => 1.1321, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/gs/gs: 3.30% (4.1305 => 4.2667, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.16% (0.8697 => 0.8972, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.97% (0.9908 => 1.0202, std.dev.: 0.0059) MultiSource/Benchmarks/mafft/pairlocalalign: 2.91% (8.6247 => 8.8756, std.dev.: 0.0192) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.89% (0.5961 => 0.6133, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.83% (0.8204 => 0.8436, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.80% (0.8457 => 0.8694, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 2.79% (0.4125 => 0.4240, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.73% (0.8716 => 0.8954, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.69% (0.8007 => 0.8222, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.64% (0.8286 => 0.8505, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.63% (0.8518 => 0.8742, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.59% (0.9074 => 0.9309, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.57% (0.8359 => 0.8574, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.57% (0.8261 => 0.8473, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.55% (0.8317 => 0.8529, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.53% (4.5702 => 4.6860, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.53% (0.8340 => 0.8551, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.50% (4.4880 => 4.6004, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.47% (0.8177 => 0.8379, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.46% (0.8805 => 0.9022, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.45% (0.8885 => 0.9103, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.36% (0.8712 => 0.8918, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.33% (0.7932 => 0.8117, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.30% (0.9039 => 0.9247, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 2.30% (15.3280 => 15.6805, std.dev.: 0.0723) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.28% (0.9069 => 0.9276, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.27% (0.8048 => 0.8231, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.27% (0.8338 => 0.8527, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.22% (1.4479 => 1.4801, std.dev.: 0.0096) MultiSource/Applications/JM/ldecod/ldecod: 2.19% (6.7320 => 6.8795, std.dev.: 0.0482) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.12% (0.8331 => 0.8508, std.dev.: 0.0039) MultiSource/Applications/siod/siod: 2.01% (2.2184 => 2.2631, std.dev.: 0.0064) MultiSource/Benchmarks/Bullet/bullet: 1.93% (31.8598 => 32.4752, std.dev.: 0.0278) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.71% (1.2423 => 1.2636, std.dev.: 0.0079) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.69% (0.8995 => 0.9147, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.63% (1.5315 => 1.5565, std.dev.: 0.0090) MultiSource/Applications/hexxagon/hexxagon: 1.59% (0.9810 => 0.9966, std.dev.: 0.0056) MultiSource/Applications/lambda-0_1_3/lambda: 1.44% (0.7557 => 0.7666, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 56.53% (1.5795 => 2.4724, std.dev.: 0.0143) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.87% (1.1857 => 1.2790, std.dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: 6.03% (63.1822 => 66.9892, std.dev.: 0.0489) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.50% (14.6451 => 15.4513, std.dev.: 0.3083) MultiSource/Applications/siod/siod: 2.70% (3.6643 => 3.7634, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 2.27% (0.6205 => 0.6346, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/ReedSolomon: 1.80% (8.5322 => 8.6856, std.dev.: 0.0502) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.16% (1.2474 => 1.2619, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -34.62% (0.0338 => 0.0221, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.25% (0.3269 => 0.3032, std.dev.: 0.0042) MultiSource/Applications/lua/lua: -5.17% (29.8330 => 28.2916, std.dev.: 0.0696) SingleSource/Benchmarks/Shootout-C++/hash2: -1.59% (3.4237 => 3.3693, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.38% (3.3479 => 3.3018, std.dev.: 0.0032) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.26% (16.4461 => 16.6538, std.dev.: 0.0904) MultiSource/Applications/obsequi/Obsequi: 2.98% (1.0262 => 1.0568, std.dev.: 0.0085) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6824.98% (0.3123 => 21.6267, std.dev.: 0.2135) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.27% (0.2463 => 0.3652, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 0.48% (0.6010 => 0.6039, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.14% (0.3266 => 0.3336, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/strcat: 1.07% (0.1969 => 0.1990, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 76.42% (0.0123 => 0.0217, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -6.13% (0.0408 => 0.0383, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 26.77% (0.0254 => 0.0322, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.98% (0.0302 => 0.0311, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.64% (0.0384 => 0.0421, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 1.25% (0.1438 => 0.1456, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -2.45% (1.1329 => 1.1052, std.dev.: 0.0262) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.03% (0.1462 => 0.1447, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.57% (0.4164 => 0.4057, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.53% (0.1369 => 0.1348, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.55% (0.0641 => 0.0599, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.72% (0.0195 => 0.0212, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.11% (0.0578 => 0.0560, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.22% (1.1437 => 1.1412, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2000.00% (0.0001 => 0.0021, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 42.86% (0.0014 => 0.0020, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.66% (0.0627 => 0.0579, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.22% (0.0180 => 0.0265, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.31% (0.8017 => 0.7992, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 3.23% (0.0062 => 0.0064, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 30 02:17:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 30 Oct 2012 04:17:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121030091746.184442A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5400?compare_to=5397&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5400, Order: 167007, Start Time: 2012-10-30 07:52:36, End Time: 2012-10-30 09:17:45 To: 5397, Order: 167005, Start Time: 2012-10-30 06:01:48, End Time: 2012-10-30 07:29:06 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 0 (173 on baseline) Unchanged Tests: 1041 (863 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.62% (78.4116 => 81.2490, std.dev.: 0.2628) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.10% (15.2527 => 18.3183, std.dev.: 0.0233) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.00% (2.0478 => 2.1093, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/salsa20: 2.30% (7.4937 => 7.6664, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/hash2: 2.15% (3.1932 => 3.2620, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.92% (79.7170 => 81.2490, std.dev.: 0.2628) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.46% (0.1431 => 0.1310, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.27% (0.1584 => 0.1453, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.75% (0.3821 => 0.3525, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: -6.50% (0.3831 => 0.3582, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -6.48% (0.3812 => 0.3565, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.44% (0.3884 => 0.3634, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.43% (0.3891 => 0.3641, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.42% (2.4924 => 2.3324, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.40% (0.3142 => 0.2941, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: -6.39% (0.4176 => 0.3909, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -6.39% (0.3880 => 0.3632, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/synchronized: -6.39% (0.3896 => 0.3647, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -6.39% (0.1879 => 0.1759, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.38% (0.2428 => 0.2273, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: -6.37% (0.4033 => 0.3776, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.31% (22.4056 => 20.9923, std.dev.: 0.0226) SingleSource/UnitTests/ObjC/exceptions-3: -6.26% (0.3848 => 0.3607, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -6.07% (0.4199 => 0.3944, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.07% (0.3658 => 0.3436, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -6.05% (0.3357 => 0.3154, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.02% (0.4151 => 0.3901, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -6.02% (0.3025 => 0.2843, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.00% (0.9852 => 0.9261, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.98% (2.1713 => 2.0414, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/except: -5.98% (0.3026 => 0.2845, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -5.98% (0.4280 => 0.4024, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.94% (0.3837 => 0.3609, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.93% (0.3252 => 0.3059, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: -5.93% (0.2160 => 0.2032, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.89% (0.3057 => 0.2877, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.88% (0.9542 => 0.8981, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.87% (4.5069 => 4.2424, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/objinst: -5.85% (0.3194 => 0.3007, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.84% (3.5339 => 3.3274, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: -5.82% (0.2989 => 0.2815, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -5.82% (0.3059 => 0.2881, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.80% (0.4083 => 0.3846, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.80% (0.3016 => 0.2841, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.79% (0.2903 => 0.2735, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: -5.78% (7.0961 => 6.6856, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/matrix: -5.78% (0.3255 => 0.3067, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.77% (0.6484 => 0.6110, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.76% (5.4682 => 5.1534, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/random: -5.75% (0.2939 => 0.2770, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -5.75% (1.3148 => 1.2392, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: -5.74% (0.4861 => 0.4582, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.73% (0.2355 => 0.2220, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: -5.72% (0.2849 => 0.2686, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary2: -5.72% (0.3481 => 0.3282, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.72% (0.4321 => 0.4074, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.72% (0.3849 => 0.3629, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.71% (0.4813 => 0.4538, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: -5.71% (0.2871 => 0.2707, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.70% (0.3931 => 0.3707, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -5.68% (0.2659 => 0.2508, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -5.67% (0.7779 => 0.7338, std.dev.: 0.0038) MultiSource/Applications/JM/lencod/lencod: -5.65% (16.1920 => 15.2771, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: -5.65% (0.3205 => 0.3024, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -5.63% (0.3621 => 0.3417, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.63% (0.3323 => 0.3136, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: -5.59% (1.2515 => 1.1816, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: -5.57% (0.3446 => 0.3254, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -5.57% (0.4524 => 0.4272, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.55% (1.6474 => 1.5559, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -5.53% (0.3867 => 0.3653, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -5.52% (0.3788 => 0.3579, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: -5.51% (0.4248 => 0.4014, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.50% (4.0323 => 3.8105, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary: -5.48% (0.3394 => 0.3208, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -5.47% (4.3330 => 4.0960, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.44% (4.8161 => 4.5542, std.dev.: 0.0084) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.43% (4.8802 => 4.6154, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.38% (0.7919 => 0.7493, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/bigfib: -5.38% (0.6750 => 0.6387, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.38% (0.2548 => 0.2411, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.38% (0.4427 => 0.4189, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -5.37% (0.6347 => 0.6006, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.35% (1.0544 => 0.9980, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.34% (1.2221 => 1.1569, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: -5.33% (0.6441 => 0.6098, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -5.31% (2.4021 => 2.2746, std.dev.: 0.0142) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.30% (1.2784 => 1.2106, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.27% (1.2210 => 1.1566, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.20% (0.5999 => 0.5687, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -5.20% (34.0927 => 32.3202, std.dev.: 0.0236) MultiSource/Benchmarks/mafft/pairlocalalign: -5.14% (9.2283 => 8.7540, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.11% (0.8521 => 0.8086, std.dev.: 0.0036) MultiSource/Applications/lua/lua: -5.08% (4.0594 => 3.8532, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.04% (0.3491 => 0.3315, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.03% (2.2587 => 2.1450, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -5.03% (0.2985 => 0.2835, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.98% (0.2933 => 0.2787, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.93% (0.6293 => 0.5983, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -4.91% (1.6364 => 1.5560, std.dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: -4.88% (18.2933 => 17.4003, std.dev.: 0.0217) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.88% (0.9557 => 0.9091, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.87% (0.2278 => 0.2167, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.87% (1.4642 => 1.3929, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.85% (1.3722 => 1.3057, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.80% (0.2999 => 0.2855, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.76% (0.5925 => 0.5643, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.75% (0.7198 => 0.6856, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.74% (0.6052 => 0.5765, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.73% (0.6304 => 0.6006, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.71% (0.5857 => 0.5581, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.71% (0.5478 => 0.5220, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.69% (0.5859 => 0.5584, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: -4.69% (0.7982 => 0.7608, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.68% (0.6681 => 0.6368, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.68% (0.5575 => 0.5314, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.66% (0.5581 => 0.5321, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.64% (0.6230 => 0.5941, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.63% (0.7339 => 0.6999, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.63% (0.6676 => 0.6367, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.62% (0.4916 => 0.4689, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -4.61% (0.4515 => 0.4307, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: -4.58% (0.3581 => 0.3417, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.58% (0.3319 => 0.3167, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.57% (0.5863 => 0.5595, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.57% (0.6194 => 0.5911, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.56% (0.6667 => 0.6363, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.53% (0.6297 => 0.6012, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.52% (0.5802 => 0.5540, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.51% (0.5805 => 0.5543, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.51% (0.5941 => 0.5673, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.50% (0.6260 => 0.5978, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.49% (0.5570 => 0.5320, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.47% (0.6395 => 0.6109, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.47% (0.5456 => 0.5212, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.44% (0.6189 => 0.5914, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.44% (0.7524 => 0.7190, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.44% (0.5569 => 0.5322, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.42% (0.5705 => 0.5453, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.41% (0.6033 => 0.5767, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.40% (0.2385 => 0.2280, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: -4.39% (0.7447 => 0.7120, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.38% (0.6660 => 0.6368, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.36% (0.6440 => 0.6159, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: -4.34% (0.9179 => 0.8781, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.33% (0.5849 => 0.5596, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.32% (0.3406 => 0.3259, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.27% (0.6395 => 0.6122, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.17% (0.5688 => 0.5451, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -4.15% (1.1450 => 1.0975, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.11% (0.5567 => 0.5338, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -4.04% (0.8418 => 0.8078, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -3.99% (8.0126 => 7.6929, std.dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.95% (0.6736 => 0.6470, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.95% (0.7021 => 0.6744) MultiSource/Applications/treecc/treecc: -3.93% (2.1401 => 2.0561, std.dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: -3.91% (5.0226 => 4.8260, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/09-vor/vor: -3.91% (0.3271 => 0.3143, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: -3.91% (15.5079 => 14.9022, std.dev.: 0.0103) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.83% (6.7716 => 6.5124, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.82% (0.3483 => 0.3350, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.81% (0.9077 => 0.8731, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.79% (0.5168 => 0.4972, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -3.75% (17.1032 => 16.4615, std.dev.: 0.0147) MultiSource/Applications/hbd/hbd: -3.72% (1.5610 => 1.5030, std.dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -3.64% (20.7746 => 20.0184, std.dev.: 0.0633) MultiSource/Applications/d/make_dparser: -3.54% (3.5154 => 3.3910, std.dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: -3.49% (1.1530 => 1.1128, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.47% (0.5329 => 0.5144, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.46% (1.2300 => 1.1874, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.94% (14.2083 => 13.7901, std.dev.: 0.0136) MultiSource/Applications/SIBsim4/SIBsim4: -1.76% (1.3864 => 1.3620, std.dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7539, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/richards_benchmark: -8.65% (1.2842 => 1.1731, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.98% (2.2633 => 2.1733, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7063, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4727, std.dev.: 0.0033) Report Time: 2.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 30 03:14:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 30 Oct 2012 05:14:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121030101407.D29D42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5401?compare_to=5398&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5401, Order: 167007, Start Time: 2012-10-30 08:40:52, End Time: 2012-10-30 10:14:08 To: 5398, Order: 167005, Start Time: 2012-10-30 06:36:02, End Time: 2012-10-30 08:10:49 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 2 (172 on baseline) Performance Improvements: 1 (53 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 2 (2 on baseline) Unchanged Tests: 1037 (664 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.03% (9.9677 => 10.1702, std.dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.20% (79.9099 => 80.8677, std.dev.: 0.2122) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.81% (3.8685 => 3.7598, std.dev.: 0.0076) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -0.07% (0.1406 => 0.1405, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0646 => 0.0646, std.dev.: 0.0033) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 197.71% (0.5229 => 1.5567, std.dev.: 0.0073) MultiSource/Applications/SPASS/SPASS: 13.04% (14.9895 => 16.9447, std.dev.: 0.0205) MultiSource/Applications/kimwitu++/kc: 35.18% (14.1553 => 19.1353, std.dev.: 0.0202) MultiSource/Benchmarks/MallocBench/gs/gs: 11.70% (4.1105 => 4.5914, std.dev.: 0.0178) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 28.88% (1.1048 => 1.4239, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 305.45% (7.1582 => 29.0232, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.20% (3.4629 => 5.7900, std.dev.: 0.0123) SingleSource/Benchmarks/Misc-C++/stepanov_container: 62.70% (0.6222 => 1.0123, std.dev.: 0.0000) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10539.44% (0.0720 => 7.6604, std.dev.: 0.0044) MultiSource/Applications/SIBsim4/SIBsim4: 3836400.00% (0.0001 => 3.8365, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 11229300.00% (0.0001 => 11.2294, std.dev.: 0.0344) MultiSource/Applications/kimwitu++/kc: 50700.00% (0.0001 => 0.0508, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 779700.00% (0.0001 => 0.7798, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050300.00% (0.0001 => 10.0504, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5489400.00% (0.0001 => 5.4895, std.dev.: 0.0024) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 38.16% (0.1056 => 0.1459, std.dev.: 0.0003) SingleSource/UnitTests/vla: 28.73% (0.0355 => 0.0457, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 28.70% (0.1432 => 0.1843, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 19.67% (0.1566 => 0.1874, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/rem: 17.40% (0.1144 => 0.1343, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 16.85% (0.0730 => 0.0853, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.65% (0.0871 => 0.1016, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 16.51% (0.1175 => 0.1369, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 16.46% (0.3177 => 0.3700, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.27% (0.0793 => 0.0922, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: 16.22% (0.0746 => 0.0867, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.19% (0.0834 => 0.0969, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 16.17% (0.4879 => 0.5668, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.55% (0.8172 => 0.9443, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 15.54% (0.0798 => 0.0922, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 15.39% (0.2554 => 0.2947, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.90% (0.1584 => 0.1820, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/mst/mst: 14.62% (0.1163 => 0.1333, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.37% (0.0842 => 0.0963, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/em3d/em3d: 14.28% (0.1695 => 0.1937, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.22% (0.0886 => 0.1012, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 13.79% (0.5105 => 0.5809, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.70% (0.2065 => 0.2348, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 13.69% (0.7115 => 0.8089, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/chomp: 13.66% (0.1655 => 0.1881, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.63% (0.2700 => 0.3068, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 13.53% (22.1758 => 25.1758, std.dev.: 0.0489) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.38% (0.0770 => 0.0873, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.31% (0.1510 => 0.1711, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.31% (0.2758 => 0.3125, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.16% (0.1117 => 0.1264, std.dev.: 0.0024) MultiSource/Applications/viterbi/viterbi: 13.12% (0.1555 => 0.1759, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.11% (0.5981 => 0.6765, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 13.09% (0.1940 => 0.2194, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.06% (0.6675 => 0.7547, std.dev.: 0.0046) MultiSource/Applications/aha/aha: 12.95% (0.1151 => 0.1300, std.dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: 12.90% (0.3109 => 0.3510, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 12.90% (3.3354 => 3.7656, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.86% (0.2107 => 0.2378, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.81% (0.2271 => 0.2562, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.72% (0.1337 => 0.1507, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 12.71% (0.1125 => 0.1268, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 12.58% (0.7835 => 0.8821, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.57% (1.5415 => 1.7352, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.54% (0.9765 => 1.0990, std.dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.53% (0.3121 => 0.3512, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.52% (0.1062 => 0.1195) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.37% (0.4615 => 0.5186, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.34% (0.1029 => 0.1156, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: 12.30% (1.1642 => 1.3074, std.dev.: 0.0101) MultiSource/Applications/lambda-0_1_3/lambda: 12.30% (0.7433 => 0.8347, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.29% (0.5860 => 0.6580, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.09% (0.5020 => 0.5627, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.80% (0.5569 => 0.6226, std.dev.: 0.0035) MultiSource/Applications/treecc/treecc: 11.77% (2.0273 => 2.2660, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.76% (0.2603 => 0.2909, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.66% (1.3050 => 1.4572, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.63% (0.1032 => 0.1152, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 11.45% (1.0722 => 1.1950, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/health/health: 11.36% (0.1268 => 0.1412, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.33% (0.1236 => 0.1376, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.28% (0.3441 => 0.3829, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.25% (1.1861 => 1.3195, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/18-imp/imp: 11.22% (0.3423 => 0.3807, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.16% (0.6450 => 0.7170, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.14% (0.1625 => 0.1806, std.dev.: 0.0019) MultiSource/Applications/lua/lua: 11.13% (3.8723 => 4.3034, std.dev.: 0.0159) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.11% (0.1143 => 0.1270, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.00% (2.2022 => 2.4444, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.92% (0.3307 => 0.3668, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 10.87% (0.8921 => 0.9891, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.85% (4.2646 => 4.7275, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/neural/neural: 10.80% (0.1463 => 0.1621, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 10.70% (0.4299 => 0.4759, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.45% (8.1363 => 8.9864, std.dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.44% (0.1906 => 0.2105, std.dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: 10.40% (9.4845 => 10.4711, std.dev.: 0.0059) MultiSource/Benchmarks/nbench/nbench: 10.32% (1.1840 => 1.3062, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.27% (0.1695 => 0.1869, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 10.25% (0.3180 => 0.3506, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.15% (1.5859 => 1.7468, std.dev.: 0.0121) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.10% (0.1892 => 0.2083, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 10.04% (0.3387 => 0.3727, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/hash: 9.91% (0.4289 => 0.4714, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.90% (0.8101 => 0.8903, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/trivial-interface: 9.85% (0.3473 => 0.3815, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 9.73% (0.3927 => 0.4309, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 9.67% (0.1044 => 0.1145, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 9.62% (0.3543 => 0.3884, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.56% (2.2024 => 2.4130, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.54% (0.3543 => 0.3881, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 9.52% (0.3497 => 0.3830, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.51% (0.3828 => 0.4192, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-3: 9.47% (0.3516 => 0.3849, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.44% (0.3561 => 0.3897, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.37% (1.4186 => 1.5515, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/for-in: 9.34% (0.3694 => 0.4039, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 9.32% (0.6456 => 0.7058, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 9.25% (2.2969 => 2.5094, std.dev.: 0.0169) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.20% (14.3668 => 15.6879, std.dev.: 0.0077) SingleSource/UnitTests/ObjC/property: 9.16% (0.3886 => 0.4242, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 9.01% (5.7591 => 6.2780, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: 9.00% (0.4620 => 0.5036, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.59% (0.3865 => 0.4197, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.57% (0.1330 => 0.1444, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.47% (0.4203 => 0.4559, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.37% (0.4636 => 0.5024, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: 8.36% (0.3422 => 0.3708, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.28% (5.0018 => 5.4159, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.21% (4.9449 => 5.3511, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.16% (0.4103 => 0.4438, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 8.15% (0.4048 => 0.4378, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 8.10% (1.5603 => 1.6867, std.dev.: 0.0092) SingleSource/UnitTests/ObjC++/property-reference: 7.99% (0.7326 => 0.7911, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.94% (0.2430 => 0.2623, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 7.90% (0.3684 => 0.3975, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.73% (0.3427 => 0.3692, std.dev.: 0.0084) SingleSource/UnitTests/ObjC++/property-reference-object: 7.73% (0.6030 => 0.6496, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.66% (0.5925 => 0.6379, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 7.66% (0.3603 => 0.3879, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 7.34% (17.1811 => 18.4424, std.dev.: 0.0117) SingleSource/Regression/C++/ofstream_ctor: 7.13% (0.2905 => 0.3112, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.12% (0.3650 => 0.3910, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.95% (0.3826 => 0.4092, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.93% (0.3162 => 0.3381, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.87% (0.2793 => 0.2985, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 6.85% (0.2831 => 0.3025, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.79% (0.4064 => 0.4340) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.78% (0.2891 => 0.3087, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.67% (0.3283 => 0.3502, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.61% (2.0665 => 2.2030, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary: 6.56% (0.3232 => 0.3444, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 6.55% (0.3098 => 0.3301, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.53% (0.2877 => 0.3065, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.48% (0.2871 => 0.3057, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/fibo: 6.42% (0.2725 => 0.2900, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.35% (0.2756 => 0.2931, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.30% (0.2872 => 0.3053, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.29% (0.3052 => 0.3244, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.23% (0.2714 => 0.2883, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.14% (0.2802 => 0.2974, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 5.94% (0.3282 => 0.3477, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 5.60% (1.2842 => 1.3561, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/ary2: 5.56% (0.3379 => 0.3567, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 5.56% (0.3092 => 0.3264, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.41% (3.8922 => 4.1028, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.40% (0.8067 => 0.8503, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.20% (0.3136 => 0.3299, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.90% (0.2266 => 0.2377, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.66% (0.3131 => 0.3277, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.10% (0.3935 => 0.4057, std.dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.72% (7.9617 => 8.0986, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.04% (7.0540 => 7.1277, std.dev.: 0.0106) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.58% (1.1145 => 1.2993, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2173, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 10.04% (1.1396 => 1.2540, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.71% (3.1578 => 3.3698, std.dev.: 0.0015) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.64% (4.2280 => 4.3398, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.33% (1.7254 => 1.7656, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.96% (0.8333 => 0.8496, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2076, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.32% (11.6436 => 11.7978, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.05% (9.1159 => 9.2119, std.dev.: 0.0086) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5749, std.dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.96% (6.6874 => 0.1366, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -76.77% (0.8651 => 0.2010, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.56% (5.3855 => 2.3935, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -55.26% (5.3526 => 2.3945, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/richards_benchmark: -46.12% (0.1622 => 0.0874, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.15% (1.1194 => 0.6811, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.13% (5.2763 => 3.2645, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -24.70% (1.7609 => 1.3259, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -17.19% (2.9384 => 2.4332, std.dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: -10.62% (10.4361 => 9.3276, std.dev.: 0.0274) MultiSource/Benchmarks/Bullet/bullet: -10.40% (63.2438 => 56.6655, std.dev.: 0.0556) SingleSource/UnitTests/Vector/constpool: -9.17% (54.1659 => 49.1996, std.dev.: 0.0145) MultiSource/Applications/JM/lencod/lencod: -2.44% (21.9371 => 21.4022, std.dev.: 0.0253) MultiSource/Benchmarks/PAQ8p/paq8p: -1.90% (10.3673 => 10.1702, std.dev.: 0.0065) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.79% (0.0506 => 0.0335, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -33.68% (0.3987 => 0.2644, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -33.38% (1.1492 => 0.7656, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -29.13% (10.7105 => 7.5905, std.dev.: 0.0247) SingleSource/Benchmarks/Misc/flops-6: -15.70% (1.6925 => 1.4267, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: -10.94% (9.5636 => 8.5177, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/mandel-2: -10.36% (1.5373 => 1.3780, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.16% (19.9488 => 18.3201, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/mason/mason: -7.77% (0.2161 => 0.1993, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.98% (1.8329 => 1.7049, std.dev.: 0.0333) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783) SingleSource/Benchmarks/McGill/chomp: -6.06% (1.2373 => 1.1623, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -5.46% (6.6465 => 6.2838, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.12% (1.6805 => 1.5944, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5082, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.42% (0.9957 => 0.9517, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.08% (0.2497 => 0.2395, std.dev.: 0.0011) MultiSource/Applications/siod/siod: -3.79% (3.2827 => 3.1582, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.54% (32.5116 => 31.3596, std.dev.: 0.0102) MultiSource/Benchmarks/sim/sim: -3.23% (5.0483 => 4.8851, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.79% (4.5009 => 4.3754, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.72% (0.4808 => 0.4677, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -2.67% (4.6441 => 4.5203, std.dev.: 0.0038) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.95% (10.2830 => 10.0821, std.dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.88% (8.1563 => 8.0027, std.dev.: 0.0164) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6784, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1095) SingleSource/UnitTests/Vector/multiplies: -1.53% (2.5528 => 2.5137, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -1.19% (85.0658 => 84.0568, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.01% (6.2999 => 6.2362, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -5.39% (0.1485 => 0.1405, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.47% (0.2116 => 0.0646, std.dev.: 0.0033) Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 30 04:22:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 30 Oct 2012 06:22:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121030112249.33C7C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5402?compare_to=5396&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5402, Order: 167007, Start Time: 2012-10-30 08:07:06, End Time: 2012-10-30 11:22:49 To: 5396, Order: 166998, Start Time: 2012-10-30 04:00:04, End Time: 2012-10-30 07:18:41 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (169 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1042 (720 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 39.52% (0.0625 => 0.0872, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.86% (0.1063 => 0.1391, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.40% (0.1106 => 0.1398, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.36% (0.2969 => 0.3722, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.14% (0.4139 => 0.5138, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 23.47% (1.5932 => 1.9671, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.23% (0.4253 => 0.5241, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.03% (0.5900 => 0.7259, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.85% (0.0547 => 0.0672, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 22.77% (0.4994 => 0.6131, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.62% (0.5000 => 0.6131, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.32% (0.0475 => 0.0581, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.09% (0.0584 => 0.0713, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 21.85% (0.0714 => 0.0870, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.52% (0.0897 => 0.1090, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.36% (0.1620 => 0.1966, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.35% (0.1021 => 0.1239) MultiSource/Benchmarks/Olden/tsp/tsp: 21.04% (0.0599 => 0.0725, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 20.69% (0.1107 => 0.1336, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 20.04% (0.0948 => 0.1138) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.96% (0.0541 => 0.0649, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 19.87% (0.0604 => 0.0724, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 19.75% (0.0633 => 0.0758, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.69% (0.0584 => 0.0699, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.55% (0.3903 => 0.4666, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.49% (0.1103 => 0.1318, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.47% (0.0642 => 0.0767, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.33% (0.1604 => 0.1914, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.24% (0.1549 => 0.1847, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 19.15% (0.1619 => 0.1929, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 19.12% (0.0821 => 0.0978, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.04% (0.1003 => 0.1194, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.98% (0.0822 => 0.0978, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.13% (0.1462 => 0.1727, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 18.06% (0.0947 => 0.1118, std.dev.: 0.0030) MultiSource/Applications/sgefa/sgefa: 17.70% (0.0808 => 0.0951, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.63% (0.3890 => 0.4576, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 17.52% (0.5826 => 0.6847, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.48% (0.2014 => 0.2366, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 17.32% (0.1218 => 0.1429, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 17.30% (0.5889 => 0.6908, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.11% (0.2736 => 0.3204, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/mst/mst: 17.05% (0.0698 => 0.0817, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.04% (1.3152 => 1.5393, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/09-vor/vor: 17.01% (0.1505 => 0.1761, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.00% (0.1088 => 0.1273, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 16.88% (0.5546 => 0.6482, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 16.80% (0.4029 => 0.4706, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.64% (0.2866 => 0.3343, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 16.35% (1.8794 => 2.1866, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.28% (3.5627 => 4.1428, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.25% (0.4658 => 0.5415, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.16% (0.5026 => 0.5838, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.07% (0.2875 => 0.3337, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 16.05% (0.1421 => 0.1649, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.03% (0.1160 => 0.1346, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.03% (0.2738 => 0.3177, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.01% (0.1968 => 0.2283, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 15.97% (1.6211 => 1.8800, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.90% (0.3271 => 0.3791, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 15.71% (0.9697 => 1.1220, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.52% (0.4361 => 0.5038, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 15.45% (0.3004 => 0.3468, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 15.41% (0.2725 => 0.3145, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 15.36% (0.2714 => 0.3131, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 15.34% (0.7171 => 0.8271, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.32% (0.2729 => 0.3147, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.26% (4.4195 => 5.0937, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: 15.25% (0.2780 => 0.3204, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 15.25% (1.0781 => 1.2425, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/strcat: 15.16% (0.2750 => 0.3167, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.11% (0.2792 => 0.3214, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.11% (2.7292 => 3.1415, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.05% (0.3195 => 0.3676, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 15.05% (0.2811 => 0.3234, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 15.04% (0.2813 => 0.3236) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.03% (2.0673 => 2.3781, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 15.02% (0.2823 => 0.3247, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 15.02% (0.3096 => 0.3561, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/bh/bh: 14.95% (0.1284 => 0.1476, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 14.95% (0.2803 => 0.3222, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 14.92% (0.9909 => 1.1387, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.89% (1.9694 => 2.2626, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.89% (0.3930 => 0.4515, std.dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 14.88% (4.2109 => 4.8374, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.84% (0.2911 => 0.3343, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.67% (1.9966 => 2.2896, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: 14.55% (23.5202 => 26.9429, std.dev.: 0.0237) SingleSource/Benchmarks/Shootout-C++/ary3: 14.42% (0.3267 => 0.3738, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary2: 14.29% (0.3317 => 0.3791, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 14.27% (0.3258 => 0.3723, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.19% (0.3362 => 0.3839, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.15% (0.3060 => 0.3493, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.13% (0.1090 => 0.1244, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 14.07% (0.2075 => 0.2367, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.96% (0.3124 => 0.3560, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.89% (0.3282 => 0.3738, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 13.80% (0.3348 => 0.3810, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: 13.68% (0.3678 => 0.4181, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 13.58% (0.3726 => 0.4232, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 13.57% (1.4269 => 1.6205, std.dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 13.56% (0.2566 => 0.2914, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.50% (0.3488 => 0.3959, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.49% (0.3625 => 0.4114, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 13.37% (0.3477 => 0.3942, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 13.37% (0.7875 => 0.8928, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-2: 13.23% (0.3446 => 0.3902, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 13.22% (0.3465 => 0.3923, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 13.22% (0.4146 => 0.4694, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.17% (0.3690 => 0.4176, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.16% (0.3981 => 0.4505, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.09% (0.3469 => 0.3923, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 13.08% (0.4251 => 0.4807, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 13.07% (0.3442 => 0.3892, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 13.07% (0.3496 => 0.3953, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 13.07% (2.1653 => 2.4482, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/exceptions-3: 13.06% (0.3460 => 0.3912, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.98% (0.3845 => 0.4344, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/property: 12.74% (0.3650 => 0.4115, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.65% (0.3643 => 0.4104, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/parameter-passing: 12.62% (0.3724 => 0.4194, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 12.53% (4.6177 => 5.1962, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/bigfib: 12.49% (0.5012 => 0.5638, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 12.21% (2.1013 => 2.3579, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.16% (0.2040 => 0.2288, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 11.41% (0.2691 => 0.2998, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.22% (0.6435 => 0.7157, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 11.10% (5.5417 => 6.1569, std.dev.: 0.0138) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.89% (0.1028 => 0.1140, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.52% (0.2737 => 0.3025, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 10.52% (0.3498 => 0.3866, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.41% (0.1383 => 0.1527, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.35% (0.2068 => 0.2282, std.dev.: 0.0081) MultiSource/Applications/siod/siod: 10.17% (0.6634 => 0.7309, std.dev.: 0.0024) MultiSource/Benchmarks/PAQ8p/paq8p: 10.17% (0.4847 => 0.5340, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.02% (0.3084 => 0.3393, std.dev.: 0.0043) MultiSource/Applications/minisat/minisat: 10.01% (0.3336 => 0.3670, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.32% (0.2103 => 0.2299, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 9.08% (2.0346 => 2.2193, std.dev.: 0.0056) MultiSource/Applications/lemon/lemon: 9.08% (0.2391 => 0.2608, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.83% (4.6926 => 5.1070, std.dev.: 0.0263) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.48% (11.6398 => 12.6272, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.26% (0.5361 => 0.5804, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.68% (0.5584 => 0.6013, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.61% (0.7426 => 0.7991, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 6.28% (11.9555 => 12.7059, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.80% (0.3792 => 0.3936, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6532, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.25% (0.5917 => 0.6701, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 9.39% (0.2802 => 0.3065, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6112, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.08% (12.0509 => 12.6635, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1702, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.31% (0.3693 => 0.3852, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-2: 3.67% (1.8057 => 1.8719, std.dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/dry: 2.71% (14.0481 => 14.4293, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1904, std.dev.: 0.0078) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.64% (3.1722 => 3.2242, std.dev.: 0.0019) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3061, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.33% (7.1849 => 7.2802, std.dev.: 0.0060) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5147, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5405, std.dev.: 0.0015) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5947, std.dev.: 0.0095) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.75% (2.4764 => 2.4331, std.dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.46% (25.4195 => 16.4049, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/ary2: -8.70% (0.2402 => 0.2193, std.dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9783, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7750, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/tsp/tsp: -7.18% (2.1113 => 1.9598, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.31% (11.2080 => 10.8366, std.dev.: 0.0606) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0009) MultiSource/Applications/siod/siod: -2.96% (6.9842 => 6.7777, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5218, std.dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: -2.30% (17.2379 => 16.8419, std.dev.: 0.0209) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.19% (41.7953 => 40.8798, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5717, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: -1.55% (5.5810 => 5.4944, std.dev.: 0.0080) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7160, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0422, std.dev.: 0.0040) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.04% (3.3991 => 3.3638, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.03% (105.3826 => 104.2985, std.dev.: 0.0472) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 30 06:15:50 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 30 Oct 2012 08:15:50 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121030131550.D0FAF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5403?compare_to=5399&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5403, Order: 167011, Start Time: 2012-10-30 11:48:22, End Time: 2012-10-30 13:15:51 To: 5399, Order: 167007, Start Time: 2012-10-30 06:50:38, End Time: 2012-10-30 08:18:05 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 13 (98 on baseline) Performance Improvements: 2 (4 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 976 (872 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.93% (0.2751 => 0.2859, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.13% (0.8508 => 0.8689, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.66% (0.8248 => 0.8385, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.50% (0.7886 => 0.8004, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 12.32% (0.7600 => 0.8536, std.dev.: 0.0168) MultiSource/Benchmarks/FreeBench/distray/distray: 6.65% (0.2345 => 0.2501, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.48% (4.3532 => 4.4611, std.dev.: 0.0237) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.77% (2.4651 => 2.5088, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/lists: 1.44% (16.7202 => 16.9604, std.dev.: 0.0829) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.40% (4.8318 => 4.8993, std.dev.: 0.0167) SingleSource/Benchmarks/Misc/pi: 1.37% (2.4724 => 2.5062, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/ReedSolomon: 1.22% (8.6856 => 8.7916, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/methcall: 1.22% (8.8732 => 8.9814, std.dev.: 0.0322) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -3.89% (0.3446 => 0.3312, std.dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/except: -2.71% (0.5020 => 0.4884, std.dev.: 0.0017) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.37% (16.6538 => 16.5915, std.dev.: 0.1365) MultiSource/Applications/obsequi/Obsequi: 1.04% (1.0568 => 1.0678, std.dev.: 0.0062) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.72% (21.6267 => 22.2142, std.dev.: 0.0758) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.14% (0.3652 => 0.3657, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/bigfib: -0.23% (0.6039 => 0.6025, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.75% (0.3336 => 0.3361, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/strcat: 0.60% (0.1990 => 0.2002, std.dev.: 0.0097) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.92% (0.0217 => 0.0219, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 10.44% (0.0383 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 3.73% (0.0322 => 0.0334, std.dev.: 0.0050) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.29% (0.0311 => 0.0315, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.24% (0.0421 => 0.0420, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0202 => 0.0202) SingleSource/UnitTests/Vector/Altivec/test1: 0.92% (0.0217 => 0.0219, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.89% (0.1456 => 0.1443, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.50% (1.1052 => 1.1218, std.dev.: 0.0411) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 4.77% (0.1447 => 0.1516, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.79% (0.4057 => 0.4089, std.dev.: 0.0164) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.67% (0.1348 => 0.1285, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.84% (0.0599 => 0.0610, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.60% (0.0212 => 0.0226, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.11% (0.0560 => 0.0537, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.46% (1.1412 => 1.1464, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 47.62% (0.0021 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 30.00% (0.0020 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.26% (0.0579 => 0.0650, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.13% (0.0265 => 0.0262, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.35% (0.7992 => 0.8020, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -14.06% (0.0064 => 0.0055, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2332.85% (0.6332 => 15.4048, std.dev.: 0.0626) MultiSource/Benchmarks/McCat/08-main/main: 49.37% (0.1831 => 0.2735, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.43% (0.1559 => 0.1490, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1474.97% (0.3344 => 5.2667, std.dev.: 0.0178) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.68% (0.2364 => 0.3231, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: 2.56% (0.0429 => 0.0440, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 0.89% (0.0224 => 0.0226, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -27.83% (0.0230 => 0.0166, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4388, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0703, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4871, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3419, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0193, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4035, std.dev.: 0.0026) SingleSource/Regression/C/uint64_to_float: -23.85% (2.1832 => 1.6624, std.dev.: 0.0028) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 35.79% (14.7684 => 20.0544, std.dev.: 0.0400) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.30% (0.0810 => 0.0942, std.dev.: 0.0013) SingleSource/UnitTests/SignlessTypes/rem: 14.69% (0.1035 => 0.1187, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: 14.57% (0.1112 => 0.1274, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.10% (0.0830 => 0.0947, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.67% (0.1137 => 0.1247, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.04% (0.2180 => 0.2377, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 7.44% (1.2568 => 1.3503, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.11% (0.7473 => 0.8004, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.99% (0.4847 => 0.5186, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.95% (0.1885 => 0.2016, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.04% (0.6227 => 0.6603, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.87% (13.1811 => 13.9552, std.dev.: 0.1624) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.87% (0.2998 => 0.3174, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.70% (0.1983 => 0.2096, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.69% (0.2741 => 0.2897, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.62% (1.1170 => 1.1798, std.dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.58% (0.3137 => 0.3312, std.dev.: 0.0047) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.30% (6.6074 => 6.9574, std.dev.: 0.0825) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.18% (0.2240 => 0.2356, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 5.03% (1.1271 => 1.1838, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.96% (0.8148 => 0.8552, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.75% (1.6386 => 1.7164, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.71% (0.9435 => 0.9879, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.68% (0.4127 => 0.4320, std.dev.: 0.0017) MultiSource/Applications/spiff/spiff: 4.49% (0.7950 => 0.8307, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.45% (0.6287 => 0.6567, std.dev.: 0.0043) MultiSource/Applications/hbd/hbd: 4.37% (1.4269 => 1.4892, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.30% (0.8331 => 0.8689, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.26% (0.2794 => 0.2913, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.22% (0.3295 => 0.3434, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.20% (0.4783 => 0.4984, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.17% (1.1685 => 1.2172, std.dev.: 0.0159) MultiSource/Applications/d/make_dparser: 4.04% (3.2366 => 3.3675, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/football/football: 3.93% (0.8768 => 0.9113, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 3.92% (0.8069 => 0.8385, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.86% (0.4559 => 0.4735, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.86% (14.2605 => 14.8109, std.dev.: 0.0386) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.81% (1.1606 => 1.2048, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 3.79% (0.8204 => 0.8515, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.76% (8.6476 => 8.9730, std.dev.: 0.0402) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.73% (0.8697 => 0.9021, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.69% (0.8050 => 0.8347, std.dev.: 0.0052) MultiSource/Applications/Burg/burg: 3.67% (1.2222 => 1.2670, std.dev.: 0.0093) MultiSource/Applications/treecc/treecc: 3.62% (1.9948 => 2.0670, std.dev.: 0.0165) MultiSource/Applications/sgefa/sgefa: 3.53% (0.2999 => 0.3105, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.52% (1.3279 => 1.3746, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.41% (0.5191 => 0.5368, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.36% (0.7966 => 0.8234, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.36% (1.4479 => 1.4966, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.32% (0.8286 => 0.8561, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.21% (0.5817 => 0.6004, std.dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: 3.20% (8.6247 => 8.9006, std.dev.: 0.0624) MultiSource/Applications/lemon/lemon: 3.08% (1.0945 => 1.1282, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.07% (0.8656 => 0.8922, std.dev.: 0.0086) MultiSource/Benchmarks/McCat/18-imp/imp: 3.05% (0.3503 => 0.3610, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.04% (0.9074 => 0.9350, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.01% (0.3717 => 0.3829, std.dev.: 0.0041) MultiSource/Applications/JM/ldecod/ldecod: 2.96% (6.7320 => 6.9314, std.dev.: 0.0161) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.92% (0.6586 => 0.6778, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.91% (0.8007 => 0.8240, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.86% (0.8457 => 0.8699, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.85% (1.2602 => 1.2961, std.dev.: 0.0038) MultiSource/Benchmarks/Bullet/bullet: 2.79% (31.8598 => 32.7481, std.dev.: 0.1831) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.75% (0.8086 => 0.8308, std.dev.: 0.0028) MultiSource/Applications/lua/lua: 2.68% (3.8189 => 3.9214, std.dev.: 0.0356) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.68% (0.8317 => 0.8540, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.58% (4.4880 => 4.6037, std.dev.: 0.0151) MultiSource/Applications/JM/lencod/lencod: 2.53% (15.3280 => 15.7158, std.dev.: 0.0512) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.51% (0.8340 => 0.8549, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.45% (4.4873 => 4.5972, std.dev.: 0.0408) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.45% (0.8177 => 0.8377, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/hash2: 2.42% (0.4125 => 0.4225, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.24% (0.7932 => 0.8110, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.21% (0.8885 => 0.9081, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.17% (0.8338 => 0.8519, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.16% (0.8066 => 0.8240, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.12% (1.2526 => 1.2792, std.dev.: 0.0090) MultiSource/Applications/siod/siod: 1.96% (2.2184 => 2.2618, std.dev.: 0.0158) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.81% (0.8995 => 0.9158, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 1.68% (0.9810 => 0.9975, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.67% (3.1832 => 3.2365, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.62% (2.1401 => 2.1747, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.54% (1.5315 => 1.5551, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.67% (1.5795 => 2.5062, std.dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.48% (2.4333 => 2.6884, std.dev.: 0.0511) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.43% (1.1857 => 1.2857, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.44% (0.3186 => 0.3423, std.dev.: 0.0079) MultiSource/Benchmarks/mafft/pairlocalalign: 6.02% (63.1822 => 66.9829, std.dev.: 0.1231) MultiSource/Benchmarks/FreeBench/distray/distray: 4.64% (0.2390 => 0.2501, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 3.04% (8.5322 => 8.7916, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.73% (0.4031 => 0.4141, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 2.46% (3.6643 => 3.7544, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.44% (2.4490 => 2.5088, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.43% (4.3552 => 4.4611, std.dev.: 0.0237) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.00% (6.3772 => 6.5048, std.dev.: 0.0492) MultiSource/Benchmarks/Olden/bh/bh: 1.72% (2.3560 => 2.3966, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.30% (4.8362 => 4.8993, std.dev.: 0.0167) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.22% (0.3269 => 0.3033, std.dev.: 0.0029) MultiSource/Applications/lua/lua: -5.18% (29.8330 => 28.2865, std.dev.: 0.4068) SingleSource/Benchmarks/Shootout-C++/hash2: -1.41% (3.4237 => 3.3755, std.dev.: 0.0121) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.32% (3.3479 => 3.3037, std.dev.: 0.0005) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.88% (16.4461 => 16.5915, std.dev.: 0.1365) MultiSource/Applications/obsequi/Obsequi: 4.05% (1.0262 => 1.0678, std.dev.: 0.0062) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7013.10% (0.3123 => 22.2142, std.dev.: 0.0758) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.48% (0.2463 => 0.3657, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/bigfib: 0.25% (0.6010 => 0.6025, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.91% (0.3266 => 0.3361, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/strcat: 1.68% (0.1969 => 0.2002, std.dev.: 0.0097) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.68% (0.0408 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.50% (0.0254 => 0.0334, std.dev.: 0.0050) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.38% (0.0384 => 0.0420, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 0.35% (0.1438 => 0.1443, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.98% (1.1329 => 1.1218, std.dev.: 0.0411) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.69% (0.1462 => 0.1516, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.80% (0.4164 => 0.4089, std.dev.: 0.0164) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.14% (0.1369 => 0.1285, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.84% (0.0641 => 0.0610, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 15.90% (0.0195 => 0.0226, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.09% (0.0578 => 0.0537, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.24% (1.1437 => 1.1464, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.67% (0.0627 => 0.0650, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 45.56% (0.0180 => 0.0262, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.04% (0.8017 => 0.8020, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -11.29% (0.0062 => 0.0055, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 30 06:18:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 30 Oct 2012 08:18:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121030131843.78C252A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5404?compare_to=5400&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5404, Order: 167011, Start Time: 2012-10-30 11:53:46, End Time: 2012-10-30 13:18:42 To: 5400, Order: 167007, Start Time: 2012-10-30 07:52:36, End Time: 2012-10-30 09:17:45 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (177 on baseline) Unchanged Tests: 1042 (860 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.06% (15.2527 => 18.3128, std.dev.: 0.0154) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1014, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/salsa20: 2.48% (7.4937 => 7.6793, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/hash2: 2.06% (3.1932 => 3.2589, std.dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.67% (0.1431 => 0.1307, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.65% (0.1584 => 0.1447, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.35% (0.3821 => 0.3540, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -7.28% (0.3831 => 0.3552, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -7.24% (0.3880 => 0.3599, std.dev.: 0.0065) SingleSource/UnitTests/ObjC/trivial-interface: -7.24% (0.3812 => 0.3536, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.21% (0.3884 => 0.3604, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/BoolLiteralTest: -7.20% (0.3834 => 0.3558, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/synchronized: -7.16% (0.3896 => 0.3617, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.12% (0.3891 => 0.3614, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -7.12% (0.4033 => 0.3746, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -7.07% (0.3848 => 0.3576, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -7.06% (0.4176 => 0.3881, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.87% (2.4924 => 2.3211, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/property: -6.76% (0.4199 => 0.3915, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.75% (0.2428 => 0.2264, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.72% (0.3142 => 0.2931, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -6.71% (0.4280 => 0.3993, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.61% (22.4056 => 20.9255, std.dev.: 0.0122) SingleSource/Benchmarks/Misc/ReedSolomon: -6.55% (0.1879 => 0.1756, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.34% (0.3658 => 0.3426, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.26% (4.5069 => 4.2248, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/methcall: -6.15% (0.3025 => 0.2839, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.08% (0.6484 => 0.6090, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -6.06% (0.2160 => 0.2029, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.06% (3.5339 => 3.3196, std.dev.: 0.0197) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.06% (0.9542 => 0.8964, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -6.04% (0.3194 => 0.3001, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.03% (5.4682 => 5.1382, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.03% (0.9852 => 0.9258, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.02% (0.4151 => 0.3901, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -6.02% (0.2989 => 0.2809, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -6.02% (0.3357 => 0.3155, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -6.01% (0.3026 => 0.2844, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.99% (0.2903 => 0.2729, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.98% (2.1713 => 2.0414, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -5.97% (7.0961 => 6.6725, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.95% (0.3057 => 0.2875, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.94% (0.2355 => 0.2215, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.92% (0.4813 => 0.4528, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: -5.92% (1.2515 => 1.1774, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.92% (1.6474 => 1.5499, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: -5.91% (1.3148 => 1.2371, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.89% (0.3837 => 0.3611, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: -5.89% (0.2939 => 0.2766, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.89% (0.1716 => 0.1615, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.87% (0.3252 => 0.3061, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.85% (0.3849 => 0.3624, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/08-main/main: -5.83% (0.2659 => 0.2504, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hello: -5.83% (0.2849 => 0.2683, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -5.82% (16.1920 => 15.2497, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/matrix: -5.81% (0.3255 => 0.3066) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.80% (0.3016 => 0.2841, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.78% (0.2871 => 0.2705, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.78% (0.3323 => 0.3131, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.77% (0.2548 => 0.2401, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: -5.76% (0.3788 => 0.3570, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -5.75% (0.6750 => 0.6362, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -5.75% (0.3481 => 0.3281, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -5.74% (0.3205 => 0.3021, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -5.74% (0.4861 => 0.4582, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -5.72% (2.4021 => 2.2646, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.72% (0.3931 => 0.3706, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: -5.72% (0.3621 => 0.3414, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.72% (0.4321 => 0.4074, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: -5.71% (4.3330 => 4.0858, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.69% (4.8161 => 4.5422, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.69% (1.2221 => 1.1526, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: -5.69% (0.3394 => 0.3201, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -5.66% (0.3867 => 0.3648, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.66% (4.0323 => 3.8040, std.dev.: 0.0033) MultiSource/Benchmarks/Bullet/bullet: -5.66% (34.0927 => 32.1646, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.65% (1.2784 => 1.2062, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: -5.64% (0.7779 => 0.7340, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -5.63% (0.4248 => 0.4009, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -5.60% (0.3446 => 0.3253, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.60% (1.0544 => 0.9954, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: -5.59% (0.3059 => 0.2888, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.59% (4.8802 => 4.6076, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.56% (1.2210 => 1.1531, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.53% (0.4427 => 0.4182, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.45% (0.6293 => 0.5950, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.43% (0.5999 => 0.5673, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.42% (0.8521 => 0.8059, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/bh/bh: -5.36% (0.2985 => 0.2825, std.dev.: 0.0011) MultiSource/Applications/lua/lua: -5.35% (4.0594 => 3.8422, std.dev.: 0.0037) SingleSource/UnitTests/ObjC++/Hello: -5.31% (0.6347 => 0.6010, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.30% (2.2587 => 2.1389, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: -5.29% (18.2933 => 17.3257, std.dev.: 0.0199) SingleSource/UnitTests/ObjC++/property-reference-object: -5.28% (0.6441 => 0.6101, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.27% (0.3491 => 0.3307, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.27% (0.7198 => 0.6819, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.24% (1.6364 => 1.5507, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: -5.20% (9.2283 => 8.7483, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.18% (1.4642 => 1.3884, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.14% (0.2278 => 0.2161, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -5.12% (0.7982 => 0.7573, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.08% (0.2933 => 0.2784, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.07% (1.3722 => 1.3026, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.04% (0.7919 => 0.7520, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.03% (0.9557 => 0.9076, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.03% (0.5925 => 0.5627, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.99% (0.6052 => 0.5750, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.95% (0.5478 => 0.5207, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.94% (0.3319 => 0.3155, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.93% (0.2999 => 0.2851, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.93% (0.5581 => 0.5306, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.90% (0.5857 => 0.5570, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.89% (0.6446 => 0.6131, std.dev.: 0.0120) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.88% (0.4916 => 0.4676, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.88% (0.5859 => 0.5573, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.88% (0.5802 => 0.5519, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.87% (0.6304 => 0.5997, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.86% (0.6667 => 0.6343, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.85% (0.6681 => 0.6357, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.85% (0.5591 => 0.5320, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.84% (0.5575 => 0.5305, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.82% (0.6230 => 0.5930, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.81% (0.5863 => 0.5581, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: -4.80% (0.3581 => 0.3409, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.80% (0.5705 => 0.5431, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.79% (0.6676 => 0.6356, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.77% (0.6660 => 0.6342, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.76% (0.6297 => 0.5997, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.76% (0.6194 => 0.5899, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.76% (0.7339 => 0.6990, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.75% (0.2106 => 0.2006, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.74% (0.7524 => 0.7167, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.74% (0.6260 => 0.5963, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.72% (0.6033 => 0.5748, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.70% (0.5569 => 0.5307, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.70% (0.5805 => 0.5532, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.70% (0.5941 => 0.5662, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/05-eks/eks: -4.70% (0.4515 => 0.4303, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.66% (0.5456 => 0.5202, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.65% (0.2385 => 0.2274, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.64% (0.6189 => 0.5902, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.62% (0.5849 => 0.5579, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.58% (0.6395 => 0.6102, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -4.58% (0.7447 => 0.7106, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.57% (0.6440 => 0.6146, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.56% (0.5570 => 0.5316, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.53% (0.5567 => 0.5315, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.50% (0.6395 => 0.6107, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: -4.46% (0.9179 => 0.8770, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.45% (0.5688 => 0.5435, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -4.44% (1.1450 => 1.0942, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: -4.42% (0.8418 => 0.8046, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.37% (0.7021 => 0.6714, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: -4.29% (15.5079 => 14.8425, std.dev.: 0.0160) MultiSource/Benchmarks/McCat/09-vor/vor: -4.25% (0.3271 => 0.3132, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -4.24% (2.1401 => 2.0494, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -4.23% (0.3406 => 0.3262, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.19% (8.0126 => 7.6767, std.dev.: 0.0111) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.19% (0.6736 => 0.6454, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.12% (0.9077 => 0.8703, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.03% (6.7716 => 6.4988, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: -4.03% (5.0226 => 4.8204, std.dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: -3.93% (17.1032 => 16.4316, std.dev.: 0.0151) MultiSource/Applications/hbd/hbd: -3.91% (1.5610 => 1.4999, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.88% (0.5329 => 0.5122, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.83% (0.5168 => 0.4970, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.79% (0.3483 => 0.3351, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: -3.79% (3.5154 => 3.3822, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.76% (1.2300 => 1.1838, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: -3.70% (1.1530 => 1.1103, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -3.27% (20.7746 => 20.0959, std.dev.: 0.0293) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.12% (14.2083 => 13.7648, std.dev.: 0.0103) MultiSource/Applications/SIBsim4/SIBsim4: -1.98% (1.3864 => 1.3589, std.dev.: 0.0079) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7557, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: -8.64% (1.2842 => 1.1733, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.83% (2.2633 => 2.1767, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.64% (6.5735 => 6.4656, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0003) Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 30 06:33:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 30 Oct 2012 08:33:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121030133339.5A9922A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5405?compare_to=5401&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5405, Order: 167011, Start Time: 2012-10-30 12:00:30, End Time: 2012-10-30 13:33:38 To: 5401, Order: 167007, Start Time: 2012-10-30 08:40:52, End Time: 2012-10-30 10:14:08 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 3 (175 on baseline) Performance Improvements: 1 (54 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 2 (2 on baseline) Unchanged Tests: 1036 (660 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.52% (55.1779 => 56.5657, std.dev.: 0.0244) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.19% (1.2899 => 1.3181, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.08% (1.3172 => 1.3314, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.76% (10.1702 => 9.9911, std.dev.: 0.0017) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: 0.14% (0.1405 => 0.1407, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.88% (0.0646 => 0.0684, std.dev.: 0.0011) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 198.74% (0.5229 => 1.5621, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 13.42% (14.9895 => 17.0016, std.dev.: 0.0280) MultiSource/Applications/kimwitu++/kc: 35.90% (14.1553 => 19.2371, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 12.04% (4.1105 => 4.6054, std.dev.: 0.0121) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 29.21% (1.1048 => 1.4275, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 305.86% (7.1582 => 29.0525, std.dev.: 0.0152) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.42% (3.4629 => 5.7976, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_container: 63.07% (0.6222 => 1.0146, std.dev.: 0.0063) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10549.72% (0.0720 => 7.6678, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 3836600.00% (0.0001 => 3.8367, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 11152300.00% (0.0001 => 11.1524, std.dev.: 0.0406) MultiSource/Applications/kimwitu++/kc: 50400.00% (0.0001 => 0.0505, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 779600.00% (0.0001 => 0.7797, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10052300.00% (0.0001 => 10.0524, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5491200.00% (0.0001 => 5.4913, std.dev.: 0.0013) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 38.07% (0.1056 => 0.1458, std.dev.: 0.0000) SingleSource/UnitTests/vla: 29.01% (0.0355 => 0.0458, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 27.23% (0.1432 => 0.1822, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 19.80% (0.1566 => 0.1876, std.dev.: 0.0023) SingleSource/UnitTests/SignlessTypes/rem: 17.57% (0.1144 => 0.1345) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.88% (0.0871 => 0.1018, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 16.60% (0.1175 => 0.1370, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 16.58% (0.0730 => 0.0851, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.52% (0.0793 => 0.0924, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 16.34% (0.3177 => 0.3696, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: 16.22% (0.0746 => 0.0867, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.19% (0.0834 => 0.0969, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 16.01% (0.4879 => 0.5660, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 15.91% (0.0798 => 0.0925, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.77% (0.8172 => 0.9461, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/08-main/main: 15.58% (0.2554 => 0.2952, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 15.47% (0.1125 => 0.1299, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 15.28% (0.1584 => 0.1826, std.dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: 14.86% (0.1555 => 0.1786, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.73% (0.0842 => 0.0966, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 14.53% (0.1163 => 0.1332, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 14.51% (0.1695 => 0.1941, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 14.36% (0.5105 => 0.5838, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.11% (0.0886 => 0.1011, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 13.96% (0.1655 => 0.1886, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 13.93% (0.7115 => 0.8106, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.90% (0.0770 => 0.0877, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 13.86% (22.1758 => 25.2504, std.dev.: 0.0213) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.80% (0.2065 => 0.2350, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 13.66% (0.1940 => 0.2205, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 13.64% (0.1151 => 0.1308, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 13.63% (0.7835 => 0.8903, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.60% (0.2758 => 0.3133, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.44% (0.2700 => 0.3063, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.36% (0.3121 => 0.3538, std.dev.: 0.0026) MultiSource/Applications/d/make_dparser: 13.36% (3.3354 => 3.7809, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.31% (0.1510 => 0.1711, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.25% (0.1117 => 0.1265, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.16% (0.5981 => 0.6768, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.10% (0.2107 => 0.2383, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.01% (0.1337 => 0.1511, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.97% (0.6675 => 0.7541, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 12.96% (0.3109 => 0.3512, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 12.92% (0.7433 => 0.8393, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.84% (1.5415 => 1.7395, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.84% (0.9765 => 1.1019, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.81% (0.2271 => 0.2562, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 12.77% (1.1642 => 1.3129, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.75% (0.5020 => 0.5660, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.68% (0.4615 => 0.5200, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.66% (0.5860 => 0.6602, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.62% (0.1062 => 0.1196, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.54% (0.1029 => 0.1158, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.42% (0.1143 => 0.1285) MultiSource/Applications/treecc/treecc: 12.35% (2.0273 => 2.2776, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.12% (0.5569 => 0.6244, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.11% (0.1032 => 0.1157, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.99% (0.2603 => 0.2915, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.96% (1.3050 => 1.4611, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 11.81% (1.0722 => 1.1988, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 11.72% (3.8723 => 4.3263, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.67% (0.6450 => 0.7203, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: 11.67% (0.1268 => 0.1416, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.65% (0.1236 => 0.1380, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.63% (0.1625 => 0.1814, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.63% (1.1861 => 1.3240, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.45% (4.2646 => 4.7530, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.44% (0.1906 => 0.2124, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.39% (0.3441 => 0.3833, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 11.31% (0.3423 => 0.3810, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.22% (0.3307 => 0.3678, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 11.05% (0.4299 => 0.4774, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 10.99% (0.8921 => 0.9901, std.dev.: 0.0064) MultiSource/Benchmarks/FreeBench/neural/neural: 10.87% (0.1463 => 0.1622, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.86% (0.1695 => 0.1879, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: 10.83% (0.0933 => 0.1034, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.76% (0.0929 => 0.1029) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.58% (8.1363 => 8.9973, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/09-vor/vor: 10.57% (0.3180 => 0.3516, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.50% (2.2022 => 2.4334, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 10.42% (0.3387 => 0.3740, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.34% (0.1044 => 0.1152, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 10.34% (0.3927 => 0.4333, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 10.34% (1.1840 => 1.3064, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.27% (1.5859 => 1.7488, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/trivial-interface: 10.25% (0.3473 => 0.3829, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 10.16% (9.4845 => 10.4480, std.dev.: 0.0090) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.13% (0.8101 => 0.8922, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/synchronized: 10.11% (0.3561 => 0.3921, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.10% (0.3543 => 0.3901, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.09% (0.3497 => 0.3850, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 10.08% (0.3543 => 0.3900, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 10.06% (0.3828 => 0.4213, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.04% (0.1892 => 0.2082, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 10.04% (0.3516 => 0.3869, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.96% (0.3694 => 0.4062, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.93% (2.2024 => 2.4210, std.dev.: 0.0061) MultiSource/Applications/siod/siod: 9.83% (2.2969 => 2.5228, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/property: 9.83% (0.3886 => 0.4268, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 9.63% (0.4289 => 0.4702, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.52% (1.4186 => 1.5537, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 9.43% (0.6456 => 0.7065, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.30% (14.3668 => 15.7033, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.10% (0.1330 => 0.1451, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.07% (0.4103 => 0.4475, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.99% (0.4636 => 0.5053, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 8.90% (0.4620 => 0.5031, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 8.86% (5.7591 => 6.2691, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.82% (0.3865 => 0.4206, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.63% (5.0018 => 5.4334, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 8.62% (0.3422 => 0.3717, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.61% (0.4203 => 0.4565, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.51% (4.9449 => 5.3659, std.dev.: 0.0131) MultiSource/Applications/hbd/hbd: 8.50% (1.5603 => 1.6930, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.19% (0.2430 => 0.2629, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.12% (0.5925 => 0.6406, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 8.09% (0.3684 => 0.3982, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.06% (0.6030 => 0.6516, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 8.00% (0.4048 => 0.4372, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 7.80% (17.1811 => 18.5220, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.79% (0.3427 => 0.3694, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 7.63% (0.3603 => 0.3878, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 7.59% (0.7326 => 0.7882, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.34% (0.3650 => 0.3918, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.03% (0.3826 => 0.4095, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.96% (0.4064 => 0.4347, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.88% (0.2891 => 0.3090, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.86% (0.3162 => 0.3379, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.80% (0.2793 => 0.2983, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 6.78% (0.2831 => 0.3023, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.78% (0.2905 => 0.3102, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.75% (2.0665 => 2.2059, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/ary3: 6.67% (0.3283 => 0.3502, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 6.65% (0.3098 => 0.3304, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.62% (0.3232 => 0.3446, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 6.44% (0.2871 => 0.3056, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.39% (0.2725 => 0.2899, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.34% (0.2872 => 0.3054, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.24% (0.2756 => 0.2928, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.23% (0.2714 => 0.2883, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.19% (0.2877 => 0.3055, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 6.13% (0.3052 => 0.3239, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.00% (0.2802 => 0.2970, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 5.86% (1.2842 => 1.3594, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.78% (0.8067 => 0.8533, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary2: 5.68% (0.3379 => 0.3571, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 5.63% (0.3092 => 0.3266, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 5.61% (0.3282 => 0.3466, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.53% (3.8922 => 4.1075, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.20% (0.3136 => 0.3299, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.90% (0.2266 => 0.2377, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.50% (0.3131 => 0.3272, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.82% (0.3935 => 0.4046, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.62% (0.3817 => 0.3917, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.68% (7.9617 => 8.0952, std.dev.: 0.0087) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.57% (1.1145 => 1.2992, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2175, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.76% (1.1396 => 1.2508, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3685, std.dev.: 0.0009) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.64% (4.2280 => 4.3395, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.32% (1.0313 => 1.0552, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7650, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.81% (9.1159 => 9.2807, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/bisort/bisort: 1.75% (0.8333 => 0.8479, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 1.54% (3.1595 => 3.2082, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 1.32% (11.6436 => 11.7974, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.04% (1.3045 => 1.3181, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: 1.04% (3.8532 => 3.8933, std.dev.: 0.0089) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.96% (6.6874 => 0.1367, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -76.81% (0.8651 => 0.2006, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.75% (5.3855 => 2.3831, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -55.34% (5.3526 => 2.3907, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -46.05% (0.1622 => 0.0875, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.51% (1.1194 => 0.6771, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.17% (5.2763 => 3.2624, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -24.82% (1.7609 => 1.3239, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -17.35% (2.9384 => 2.4285, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: -10.74% (10.4361 => 9.3149, std.dev.: 0.0047) MultiSource/Benchmarks/Bullet/bullet: -10.51% (63.2438 => 56.5961, std.dev.: 0.0240) SingleSource/UnitTests/Vector/constpool: -9.13% (54.1659 => 49.2219, std.dev.: 0.0095) MultiSource/Benchmarks/PAQ8p/paq8p: -3.63% (10.3673 => 9.9911, std.dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: -2.51% (21.9371 => 21.3861, std.dev.: 0.0187) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.99% (0.0506 => 0.0334, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -33.68% (0.3987 => 0.2644, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -29.13% (10.7105 => 7.5909, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4250, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -10.98% (9.5636 => 8.5134, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: -10.63% (1.5373 => 1.3739, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.28% (19.9488 => 18.2968, std.dev.: 0.0116) MultiSource/Benchmarks/FreeBench/mason/mason: -7.96% (0.2161 => 0.1989, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.10% (1.8329 => 1.7027, std.dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -6.48% (1.2373 => 1.1571, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/oourafft: -5.46% (6.6465 => 6.2836, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.10% (1.6805 => 1.5948, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.66% (1.5835 => 1.5097, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.45% (0.9957 => 0.9514, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.04% (0.2497 => 0.2396, std.dev.: 0.0012) MultiSource/Applications/siod/siod: -3.78% (3.2827 => 3.1585, std.dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.53% (32.5116 => 31.3637, std.dev.: 0.0065) MultiSource/Benchmarks/sim/sim: -3.24% (5.0483 => 4.8847, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.87% (0.4808 => 0.4670, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.79% (4.5009 => 4.3753, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -2.74% (4.6441 => 4.5169, std.dev.: 0.0018) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0855, std.dev.: 0.0306) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.80% (8.1563 => 8.0097, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6825, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1095, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.55% (2.5528 => 2.5132, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -1.20% (85.0658 => 84.0459, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/lists: -1.09% (6.2999 => 6.2314, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8594, std.dev.: 0.0153) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -5.25% (0.1485 => 0.1407, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.67% (0.2116 => 0.0684, std.dev.: 0.0011) Report Time: 3.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 30 08:00:10 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 30 Oct 2012 10:00:10 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121030150010.4AA1D2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/5406?compare_to=5403&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5406, Order: 167013, Start Time: 2012-10-30 13:33:00, End Time: 2012-10-30 15:00:11 To: 5403, Order: 167011, Start Time: 2012-10-30 11:48:22, End Time: 2012-10-30 13:15:51 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 8 (97 on baseline) Performance Improvements: 2 (4 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 981 (873 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.50% (0.2399 => 0.2507, std.dev.: 0.0030) MultiSource/Applications/spiff/spiff: 1.53% (0.8307 => 0.8434, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.28% (0.8719 => 0.8831, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.05% (4.2760 => 4.3207, std.dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.36% (12.7515 => 14.9654, std.dev.: 0.5191) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.58% (0.8536 => 0.8756, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.26% (41.1737 => 41.6933, std.dev.: 0.0958) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.21% (1.2446 => 1.2596, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.78% (0.9077 => 0.8915, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.40% (0.8689 => 0.8567, std.dev.: 0.0028) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.47% (16.5915 => 16.6688, std.dev.: 0.1744) MultiSource/Applications/obsequi/Obsequi: 0.27% (1.0678 => 1.0707, std.dev.: 0.0073) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.54% (22.2142 => 21.6507, std.dev.: 0.1776) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.44% (0.3657 => 0.3641, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/bigfib: 0.10% (0.6025 => 0.6031, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.95% (0.3361 => 0.3329, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 0.35% (0.2002 => 0.2009, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.46% (0.0219 => 0.0218, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.95% (0.0423 => 0.0427, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.30% (0.0334 => 0.0333, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.63% (0.0315 => 0.0313, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.19% (0.0420 => 0.0425, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0202 => 0.0202, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/test1: -0.46% (0.0219 => 0.0218, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 7.69% (0.0013 => 0.0014) MultiSource/Applications/ClamAV/clamscan: -0.14% (0.1443 => 0.1441, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 5.87% (1.1218 => 1.1877, std.dev.: 0.0028) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.20% (0.1516 => 0.1519, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.05% (0.4089 => 0.4046, std.dev.: 0.0208) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.93% (0.1285 => 0.1297, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.56% (0.0610 => 0.0570, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 15.93% (0.0226 => 0.0262, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 7.26% (0.0537 => 0.0576, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.01% (1.1464 => 1.1463, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.46% (0.0650 => 0.0647, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.76% (0.0262 => 0.0260, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.44% (0.8020 => 0.7985, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 21.82% (0.0055 => 0.0067, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2328.38% (0.6332 => 15.3765, std.dev.: 0.2798) MultiSource/Benchmarks/McCat/08-main/main: 47.84% (0.1831 => 0.2707, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.61% (0.1559 => 0.1456, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1477.36% (0.3344 => 5.2747, std.dev.: 0.0711) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.76% (0.2364 => 0.3233, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel: 3.03% (0.0429 => 0.0442, std.dev.: 0.0019) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.36% (0.0224 => 0.0236, std.dev.: 0.0008) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0013) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4381, std.dev.: 0.0318) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0714, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4955, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3441, std.dev.: 0.0196) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0196, std.dev.: 0.0182) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4017, std.dev.: 0.0048) SingleSource/Regression/C/uint64_to_float: -24.49% (2.1832 => 1.6485, std.dev.: 0.0076) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 36.45% (14.7684 => 20.1511, std.dev.: 0.0266) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.54% (0.0810 => 0.0944, std.dev.: 0.0035) SingleSource/UnitTests/SignlessTypes/rem: 14.49% (0.1035 => 0.1185, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 13.22% (0.1112 => 0.1259, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.50% (0.0848 => 0.0954, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.32% (0.1137 => 0.1243, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.04% (0.2180 => 0.2377, std.dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 7.65% (1.2568 => 1.3530, std.dev.: 0.0132) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.14% (0.8321 => 0.8915, std.dev.: 0.0184) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.72% (0.1905 => 0.2033, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.65% (0.2240 => 0.2389, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.61% (0.1983 => 0.2114, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.09% (13.1811 => 13.9840, std.dev.: 0.0761) MultiSource/Applications/spiff/spiff: 6.09% (0.7950 => 0.8434, std.dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.73% (6.6074 => 6.9862, std.dev.: 0.0314) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.42% (0.2378 => 0.2507, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.37% (1.1170 => 1.1770, std.dev.: 0.0120) MultiSource/Benchmarks/nbench/nbench: 5.31% (1.1271 => 1.1869, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.27% (0.2279 => 0.2399, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.26% (0.7473 => 0.7866, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.17% (0.6010 => 0.6321, std.dev.: 0.0063) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.04% (0.8148 => 0.8559, std.dev.: 0.0135) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.00% (0.2519 => 0.2645, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.90% (0.6287 => 0.6595, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.68% (1.1606 => 1.2149, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.63% (0.4559 => 0.4770, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.56% (0.4127 => 0.4315, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.52% (0.4783 => 0.4999, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.32% (1.6386 => 1.7094, std.dev.: 0.0121) MultiSource/Applications/treecc/treecc: 4.25% (1.9948 => 2.0795, std.dev.: 0.0089) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.23% (0.2741 => 0.2857, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/05-eks/eks: 4.00% (0.4397 => 0.4573, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 3.92% (0.8768 => 0.9112, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.89% (0.6227 => 0.6469, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.73% (0.3295 => 0.3418, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 3.67% (3.2366 => 3.3555, std.dev.: 0.0214) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.60% (0.5191 => 0.5378, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 3.56% (14.2605 => 14.7685, std.dev.: 0.0888) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.46% (4.1763 => 4.3207, std.dev.: 0.0075) MultiSource/Applications/lemon/lemon: 3.42% (1.0945 => 1.1319, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.39% (8.6476 => 8.9410, std.dev.: 0.0516) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.29% (0.8359 => 0.8634, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.26% (0.9435 => 0.9743, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.25% (0.5961 => 0.6155, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.16% (0.6586 => 0.6794, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 3.00% (0.9688 => 0.9979, std.dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: 2.91% (15.3280 => 15.7740, std.dev.: 0.0369) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.87% (0.8697 => 0.8947, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.87% (0.8805 => 0.9058, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.87% (0.8086 => 0.8318, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.86% (0.8007 => 0.8236, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.83% (0.8331 => 0.8567, std.dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: 2.82% (6.7320 => 6.9219, std.dev.: 0.0699) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.77% (0.9074 => 0.9325, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.72% (0.8597 => 0.8831, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.71% (0.8457 => 0.8686, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.71% (4.4873 => 4.6088, std.dev.: 0.0203) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.71% (0.8611 => 0.8844, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.70% (1.3279 => 1.3638, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.69% (0.8855 => 0.9093, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.67% (0.8204 => 0.8423, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash2: 2.67% (0.4125 => 0.4235, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.66% (0.8286 => 0.8506, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.65% (0.7932 => 0.8142, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.57% (0.7966 => 0.8171, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.54% (0.8317 => 0.8528, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.52% (0.9056 => 0.9284, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.51% (0.9908 => 1.0157, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.43% (0.8340 => 0.8543, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.43% (0.9039 => 0.9259, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.43% (1.4479 => 1.4831, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.43% (0.9069 => 0.9289, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.40% (0.8048 => 0.8241, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.36% (0.8066 => 0.8256, std.dev.: 0.0069) MultiSource/Applications/minisat/minisat: 2.31% (0.6834 => 0.6992, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.28% (0.8716 => 0.8915, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.27% (0.8316 => 0.8505, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.26% (0.8261 => 0.8448, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.24% (0.8885 => 0.9084, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.21% (1.2423 => 1.2698, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.21% (0.8420 => 0.8606, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.11% (0.8338 => 0.8514, std.dev.: 0.0033) MultiSource/Benchmarks/Bullet/bullet: 2.05% (31.8598 => 32.5115, std.dev.: 0.1063) MultiSource/Applications/siod/siod: 1.95% (2.2184 => 2.2617, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.78% (0.8518 => 0.8670, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.76% (4.5702 => 4.6507, std.dev.: 0.0209) MultiSource/Benchmarks/PAQ8p/paq8p: 1.40% (2.3764 => 2.4097, std.dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 56.68% (1.5795 => 2.4748, std.dev.: 0.0148) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.98% (2.4333 => 2.7004, std.dev.: 0.0405) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.21% (1.1857 => 1.2830, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.94% (0.3186 => 0.3439, std.dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: 5.91% (63.1822 => 66.9150, std.dev.: 0.0861) SingleSource/Benchmarks/Misc/ReedSolomon: 2.88% (8.5322 => 8.7780, std.dev.: 0.0171) MultiSource/Applications/siod/siod: 2.71% (3.6643 => 3.7635, std.dev.: 0.0122) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.70% (0.4031 => 0.4140, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 2.11% (2.3560 => 2.4057, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.02% (4.8362 => 4.8856, std.dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.91% (0.3269 => 0.3043, std.dev.: 0.0070) MultiSource/Applications/lua/lua: -5.25% (29.8330 => 28.2680, std.dev.: 0.1167) SingleSource/Benchmarks/Shootout-C++/hash2: -1.67% (3.4237 => 3.3664, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.27% (3.3479 => 3.3053, std.dev.: 0.0014) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.35% (16.4461 => 16.6688, std.dev.: 0.1744) MultiSource/Applications/obsequi/Obsequi: 4.34% (1.0262 => 1.0707, std.dev.: 0.0073) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6832.66% (0.3123 => 21.6507, std.dev.: 0.1776) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.83% (0.2463 => 0.3641, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/bigfib: 0.35% (0.6010 => 0.6031, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.93% (0.3266 => 0.3329, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 2.03% (0.1969 => 0.2009, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 100.00% (0.0007 => 0.0014) MultiSource/Applications/ClamAV/clamscan: 0.21% (0.1438 => 0.1441, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 4.84% (1.1329 => 1.1877, std.dev.: 0.0028) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.90% (0.1462 => 0.1519, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.83% (0.4164 => 0.4046, std.dev.: 0.0208) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.26% (0.1369 => 0.1297, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -11.08% (0.0641 => 0.0570, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 34.36% (0.0195 => 0.0262, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.35% (0.0578 => 0.0576, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.23% (1.1437 => 1.1463, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.19% (0.0627 => 0.0647, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 44.44% (0.0180 => 0.0260, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.40% (0.8017 => 0.7985, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 8.06% (0.0062 => 0.0067, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 30 08:06:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 30 Oct 2012 10:06:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121030150639.0FA242A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/5407?compare_to=5404&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5407, Order: 167013, Start Time: 2012-10-30 13:41:35, End Time: 2012-10-30 15:06:38 To: 5404, Order: 167011, Start Time: 2012-10-30 11:53:46, End Time: 2012-10-30 13:18:42 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (179 on baseline) Unchanged Tests: 1042 (858 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.02% (15.2527 => 18.3067, std.dev.: 0.0104) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.63% (2.0478 => 2.1016, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/salsa20: 2.59% (7.4937 => 7.6879, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash2: 2.07% (3.1932 => 3.2594, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.01% (0.1431 => 0.1302, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.84% (0.1584 => 0.1444, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.75% (0.3821 => 0.3525, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -7.12% (2.4924 => 2.3149, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.94% (0.3142 => 0.2924, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.93% (0.3880 => 0.3611, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.90% (0.3884 => 0.3616, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: -6.86% (0.3848 => 0.3584, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -6.85% (0.3896 => 0.3629, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -6.85% (0.3812 => 0.3551, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -6.84% (0.3831 => 0.3569, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.82% (0.4176 => 0.3891, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.81% (0.3891 => 0.3626, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.80% (0.2428 => 0.2263, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.79% (0.4033 => 0.3759, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.73% (22.4056 => 20.8981, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/property: -6.64% (0.4199 => 0.3920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -6.49% (0.1879 => 0.1757, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.48% (0.3658 => 0.3421, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -6.45% (0.4280 => 0.4004, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.33% (4.5069 => 4.2216, std.dev.: 0.0081) MultiSource/Benchmarks/McCat/08-main/main: -6.21% (0.2659 => 0.2494, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.19% (0.9542 => 0.8951, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -6.18% (0.3025 => 0.2838, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.17% (0.6484 => 0.6084, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.17% (0.4151 => 0.3895, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.14% (0.9852 => 0.9247, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -6.14% (0.3357 => 0.3151, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -6.12% (0.2989 => 0.2806, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.12% (5.4682 => 5.1337, std.dev.: 0.0039) MultiSource/Applications/JM/ldecod/ldecod: -6.10% (7.0961 => 6.6631, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/except: -6.08% (0.3026 => 0.2842, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.07% (0.2355 => 0.2212, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.07% (3.5339 => 3.3194, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: -6.06% (1.2515 => 1.1757, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.05% (0.3837 => 0.3605, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.03% (0.3849 => 0.3617, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.00% (2.1713 => 2.0410, std.dev.: 0.0043) MultiSource/Applications/JM/lencod/lencod: -5.99% (16.1920 => 15.2216, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/objinst: -5.98% (0.3194 => 0.3003, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -5.98% (1.3148 => 1.2362, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: -5.95% (4.3330 => 4.0750, std.dev.: 0.0047) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.94% (0.1716 => 0.1614, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.92% (0.3057 => 0.2876, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -5.90% (0.4861 => 0.4574, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.90% (0.7919 => 0.7452, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.89% (1.6474 => 1.5503, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.83% (0.4321 => 0.4069, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: -5.83% (0.2849 => 0.2683, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.82% (0.4813 => 0.4533, std.dev.: 0.0018) MultiSource/Applications/siod/siod: -5.81% (2.4021 => 2.2625, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: -5.81% (0.3255 => 0.3066, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.81% (4.8161 => 4.5365, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.80% (0.4083 => 0.3846, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -5.80% (0.3446 => 0.3246, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.79% (1.2784 => 1.2044, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.79% (0.2903 => 0.2735, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -5.79% (0.2160 => 0.2035, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: -5.78% (0.2939 => 0.2769, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary: -5.77% (0.3394 => 0.3198, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -5.77% (0.3205 => 0.3020, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.77% (0.2548 => 0.2401, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.77% (0.3016 => 0.2842, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -5.77% (34.0927 => 32.1262, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.75% (4.0323 => 3.8004, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/fibo: -5.75% (0.2871 => 0.2706, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.74% (4.8802 => 4.6000, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/sieve: -5.73% (0.3788 => 0.3571, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.72% (0.3323 => 0.3133, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.70% (1.0544 => 0.9943, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: -5.69% (0.6750 => 0.6366, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.68% (0.5999 => 0.5658, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.68% (1.2221 => 1.1527, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists1: -5.66% (0.3867 => 0.3648, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -5.66% (0.3621 => 0.3416, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.66% (0.3252 => 0.3068, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.65% (1.2210 => 1.1520, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -5.60% (0.4248 => 0.4010, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -5.60% (0.3481 => 0.3286) SingleSource/UnitTests/ObjC++/property-reference: -5.59% (0.7779 => 0.7344, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.55% (0.8521 => 0.8048, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.54% (0.7198 => 0.6799, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.53% (0.4427 => 0.4182, std.dev.: 0.0077) SingleSource/Regression/C++/ofstream_ctor: -5.52% (0.3059 => 0.2890, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: -5.49% (0.2985 => 0.2821, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.48% (0.6293 => 0.5948, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -5.46% (4.0594 => 3.8379, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/hash: -5.44% (0.4524 => 0.4278, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.36% (1.6364 => 1.5487, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -5.36% (0.6347 => 0.6007, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -5.35% (18.2933 => 17.3155, std.dev.: 0.0140) MultiSource/Benchmarks/mafft/pairlocalalign: -5.33% (9.2283 => 8.7362, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.31% (2.2587 => 2.1387, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -5.30% (0.7982 => 0.7559, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.25% (1.4642 => 1.3873, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: -5.23% (0.6441 => 0.6104, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.22% (0.2278 => 0.2159, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.21% (0.3491 => 0.3309, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.16% (0.3931 => 0.3728, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.15% (0.9557 => 0.9065, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.14% (0.2999 => 0.2845, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.08% (1.3722 => 1.3025, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.05% (0.2933 => 0.2785, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.00% (0.5478 => 0.5204, std.dev.: 0.0082) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.00% (0.3319 => 0.3153, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.00% (0.5925 => 0.5629, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.98% (0.5859 => 0.5567, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.97% (0.6052 => 0.5751, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.97% (0.6304 => 0.5991, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: -4.94% (0.3581 => 0.3404, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.88% (0.6660 => 0.6335, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.87% (0.6446 => 0.6132, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.86% (0.4916 => 0.4677, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.86% (0.5802 => 0.5520, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.86% (0.6667 => 0.6343, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.85% (0.5857 => 0.5573, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.84% (0.5863 => 0.5579, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.84% (0.7339 => 0.6984, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.83% (0.6395 => 0.6086, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.83% (0.5575 => 0.5306, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.82% (0.5805 => 0.5525, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.80% (0.5705 => 0.5431, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.80% (0.2106 => 0.2005, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.78% (0.5591 => 0.5324, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.77% (0.6681 => 0.6362, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.76% (0.6297 => 0.5997, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.75% (0.5849 => 0.5571, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.75% (0.6676 => 0.6359, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.75% (0.5581 => 0.5316, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.74% (0.5569 => 0.5305, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.74% (0.5570 => 0.5306, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: -4.72% (0.4515 => 0.4302, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.71% (0.6194 => 0.5902, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.69% (0.6230 => 0.5938, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.65% (0.2385 => 0.2274, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.65% (0.7524 => 0.7174, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -4.65% (0.7447 => 0.7101, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.63% (0.6260 => 0.5970, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: -4.62% (0.9179 => 0.8755, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -4.59% (1.1450 => 1.0925, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.54% (0.5941 => 0.5671, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.53% (0.5456 => 0.5209, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.52% (0.6189 => 0.5909, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.52% (0.5688 => 0.5431, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.51% (0.6033 => 0.5761, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.49% (0.3406 => 0.3253, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -4.47% (15.5079 => 14.8150, std.dev.: 0.0152) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.44% (0.6736 => 0.6437, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.44% (0.5567 => 0.5320, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: -4.43% (0.3271 => 0.3126, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: -4.42% (0.8418 => 0.8046, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.39% (0.6440 => 0.6157, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -4.39% (2.1401 => 2.0461, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.39% (0.7021 => 0.6713, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.36% (0.6395 => 0.6116, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.19% (8.0126 => 7.6771, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.19% (6.7716 => 6.4881, std.dev.: 0.0187) MultiSource/Applications/oggenc/oggenc: -4.17% (5.0226 => 4.8131, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.16% (0.3483 => 0.3338, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: -4.14% (17.1032 => 16.3957, std.dev.: 0.0226) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.13% (0.9077 => 0.8702, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.10% (0.5168 => 0.4956, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: -4.02% (1.5610 => 1.4983, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.96% (0.5329 => 0.5118, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: -3.95% (3.5154 => 3.3764, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.95% (1.2300 => 1.1814, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.86% (0.2695 => 0.2591, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: -3.82% (1.1530 => 1.1089, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -3.46% (20.7746 => 20.0565, std.dev.: 0.0786) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.28% (14.2083 => 13.7425, std.dev.: 0.0096) MultiSource/Applications/SIBsim4/SIBsim4: -2.17% (1.3864 => 1.3563, std.dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7575, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/richards_benchmark: -8.65% (1.2842 => 1.1731, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.96% (2.2633 => 2.1736, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.67% (6.5735 => 6.4634, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Report Time: 1.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 30 08:35:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 30 Oct 2012 10:35:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121030153521.4D0362A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5408?compare_to=5402&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5408, Order: 167011, Start Time: 2012-10-30 12:19:09, End Time: 2012-10-30 15:35:21 To: 5402, Order: 167007, Start Time: 2012-10-30 08:07:06, End Time: 2012-10-30 11:22:49 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (170 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1039 (719 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 6.82% (0.3930 => 0.4198, std.dev.: 0.0097) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 7.67% (0.2098 => 0.2259, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.01% (54.3338 => 54.8832, std.dev.: 0.0966) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.00% (0.0625 => 0.0875, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.42% (0.1063 => 0.1397, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.93% (0.2969 => 0.3739, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 24.95% (0.1106 => 0.1382, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.26% (0.4139 => 0.5143, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.69% (0.4994 => 0.6177, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.67% (0.0714 => 0.0883, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.64% (0.5900 => 0.7295, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 23.46% (1.5932 => 1.9670, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.16% (0.0475 => 0.0585, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.82% (0.5000 => 0.6141, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.77% (0.0584 => 0.0717, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 22.60% (0.4253 => 0.5214, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.49% (0.0547 => 0.0670, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.07% (0.0897 => 0.1095, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 21.70% (0.0599 => 0.0729, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.65% (0.1021 => 0.1242, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.54% (0.1620 => 0.1969, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 20.78% (0.1107 => 0.1337, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.53% (0.1549 => 0.1867, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 20.46% (0.0948 => 0.1142, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.22% (0.0633 => 0.0761, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.21% (0.0584 => 0.0702, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.15% (0.0541 => 0.0650, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.95% (0.1103 => 0.1323, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.94% (0.0642 => 0.0770, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.91% (0.3903 => 0.4680, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.83% (0.1604 => 0.1922, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/health/health: 19.73% (0.0821 => 0.0983, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 19.64% (0.1619 => 0.1937, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.64% (0.1003 => 0.1200, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 19.54% (0.0604 => 0.0722, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.34% (0.0822 => 0.0981, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 18.48% (0.0947 => 0.1122, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.40% (0.1462 => 0.1731, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 18.36% (0.0561 => 0.0664, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.15% (0.3890 => 0.4596, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 18.14% (0.1218 => 0.1439, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 18.07% (0.0808 => 0.0954, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 18.01% (0.1505 => 0.1776, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.98% (0.2736 => 0.3228, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.92% (0.2014 => 0.2375, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.56% (0.1088 => 0.1279) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.48% (1.3152 => 1.5451, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/mst/mst: 17.48% (0.0698 => 0.0820, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 17.42% (0.4029 => 0.4731, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.17% (0.2866 => 0.3358, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 17.03% (0.5826 => 0.6818, std.dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference-object: 16.86% (0.5889 => 0.6882, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 16.86% (0.5546 => 0.6481, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 16.73% (1.8794 => 2.1939, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.67% (3.5627 => 4.1567, std.dev.: 0.0054) MultiSource/Applications/hbd/hbd: 16.63% (0.9697 => 1.1310, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.47% (0.1160 => 0.1351, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.38% (1.6211 => 1.8866, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.32% (0.4658 => 0.5418, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.31% (0.1968 => 0.2289, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.28% (0.5026 => 0.5844, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.26% (0.3271 => 0.3803, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.97% (0.2875 => 0.3334, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 15.62% (0.1421 => 0.1643, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.62% (0.4361 => 0.5042, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.60% (0.3930 => 0.4543, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 15.56% (0.2725 => 0.3149, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.56% (0.2738 => 0.3164, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 15.50% (0.1284 => 0.1483, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 15.36% (0.2714 => 0.3131, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.32% (0.2729 => 0.3147, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 15.31% (1.0781 => 1.2432, std.dev.: 0.0066) SingleSource/Regression/C++/ofstream_ctor: 15.31% (0.3004 => 0.3464, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 15.27% (4.2109 => 4.8538, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/matrix: 15.22% (0.2780 => 0.3203, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: 15.16% (0.2750 => 0.3167, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.06% (4.4195 => 5.0851, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/methcall: 15.04% (0.2813 => 0.3236, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 15.04% (0.9909 => 1.1399, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/random: 15.02% (0.2803 => 0.3224, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/objinst: 15.02% (0.2823 => 0.3247, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 15.02% (0.3096 => 0.3561, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.97% (0.2792 => 0.3210, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 14.96% (0.2566 => 0.2950, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 14.95% (0.7171 => 0.8243, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.90% (1.9694 => 2.2629, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/except: 14.87% (0.2811 => 0.3229, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.86% (2.7292 => 3.1348, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.86% (2.0673 => 2.3744, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.84% (0.3195 => 0.3669, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.77% (1.9966 => 2.2914, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.70% (0.2911 => 0.3339, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 14.58% (0.3348 => 0.3836, std.dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: 14.39% (23.5202 => 26.9057, std.dev.: 0.0206) SingleSource/Benchmarks/Shootout-C++/ary3: 14.39% (0.3267 => 0.3737, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.38% (0.3060 => 0.3500, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.31% (0.1090 => 0.1246, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 14.20% (0.3317 => 0.3788, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 14.15% (0.3258 => 0.3719, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.07% (0.3362 => 0.3835, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 13.86% (1.4269 => 1.6247, std.dev.: 0.0085) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.86% (0.3845 => 0.4378, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-4: 13.85% (0.3465 => 0.3945, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 13.83% (0.3442 => 0.3918, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 13.82% (0.3496 => 0.3979, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 13.81% (0.3446 => 0.3922, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.80% (0.3124 => 0.3555, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.79% (0.3488 => 0.3969, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 13.78% (0.2075 => 0.2361, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 13.77% (0.4146 => 0.4717, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 13.70% (0.3460 => 0.3934, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 13.69% (0.3469 => 0.3944, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.64% (0.3981 => 0.4524, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 13.59% (0.3678 => 0.4178, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 13.52% (0.3477 => 0.3947, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.50% (0.3282 => 0.3725, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 13.47% (0.3726 => 0.4228, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 13.34% (0.3650 => 0.4137, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 13.34% (0.3643 => 0.4129, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.30% (0.3625 => 0.4107, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 13.27% (0.4251 => 0.4815, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.25% (0.3690 => 0.4179, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: 13.18% (0.3724 => 0.4215, std.dev.: 0.0069) MultiSource/Applications/treecc/treecc: 13.16% (0.7875 => 0.8911, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 12.89% (2.1653 => 2.4445, std.dev.: 0.0108) MultiSource/Applications/JM/lencod/lencod: 12.68% (4.6177 => 5.2030, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/bigfib: 12.47% (0.5012 => 0.5637, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 12.31% (2.1013 => 2.3600, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.00% (0.1383 => 0.1549, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.86% (0.2040 => 0.2282, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 11.56% (0.2691 => 0.3002, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.36% (0.6435 => 0.7166, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 11.32% (5.5417 => 6.1688, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.19% (0.1028 => 0.1143, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 11.03% (0.3498 => 0.3884, std.dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: 10.98% (0.4847 => 0.5379, std.dev.: 0.0041) MultiSource/Applications/siod/siod: 10.52% (0.6634 => 0.7332, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.49% (0.2068 => 0.2285, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.34% (0.2737 => 0.3020, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.21% (0.3084 => 0.3399, std.dev.: 0.0058) MultiSource/Applications/minisat/minisat: 9.95% (0.3336 => 0.3668, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.61% (0.2103 => 0.2305, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.05% (4.6926 => 5.1172, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 9.02% (2.0346 => 2.2182, std.dev.: 0.0024) MultiSource/Applications/lemon/lemon: 8.91% (0.2391 => 0.2604, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.53% (11.6398 => 12.6327, std.dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.21% (0.5361 => 0.5801, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.88% (0.5584 => 0.6024, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.59% (0.7426 => 0.7990, std.dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 6.42% (11.9555 => 12.7227, std.dev.: 0.0287) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.40% (0.3792 => 0.3959, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6534, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.22% (0.5917 => 0.6699, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 9.67% (0.2802 => 0.3073, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 6.46% (0.2122 => 0.2259, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.45% (3.3903 => 3.6089, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 5.09% (12.0509 => 12.6642, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 4.70% (15.4430 => 16.1691, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-2: 4.41% (1.8057 => 1.8853, std.dev.: 0.0065) SingleSource/Benchmarks/Dhrystone/dry: 2.69% (14.0481 => 14.4264, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1984, std.dev.: 0.0041) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.76% (3.1722 => 3.2279, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3043, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2876, std.dev.: 0.0040) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5130, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5991, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.93% (2.4764 => 2.4285, std.dev.: 0.0069) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.51% (25.4195 => 16.3927, std.dev.: 0.0175) SingleSource/Benchmarks/Shootout-C++/ary2: -8.28% (0.2402 => 0.2203, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9784, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7754, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.03% (11.2080 => 10.8681, std.dev.: 0.0486) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.99% (0.6293 => 0.6105, std.dev.: 0.0057) MultiSource/Applications/siod/siod: -2.98% (6.9842 => 6.7762, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: -2.87% (3.6262 => 3.5223, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -2.31% (17.2379 => 16.8394, std.dev.: 0.0196) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.20% (41.7953 => 40.8773, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5754, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4960, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.33% (5.7935 => 5.7167, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.26% (105.3826 => 104.0537, std.dev.: 0.1294) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0416, std.dev.: 0.0028) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.05% (3.3991 => 3.3633, std.dev.: 0.0005) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 30 08:36:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 30 Oct 2012 10:36:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121030153616.7B82E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5409?compare_to=5405&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5409, Order: 167013, Start Time: 2012-10-30 14:03:18, End Time: 2012-10-30 15:36:16 To: 5405, Order: 167011, Start Time: 2012-10-30 12:00:30, End Time: 2012-10-30 13:33:38 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 1 (173 on baseline) Performance Improvements: 1 (54 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 2 (2 on baseline) Unchanged Tests: 1038 (662 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.96% (3.7608 => 3.8344, std.dev.: 0.0241) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -1.15% (13.5480 => 13.3923, std.dev.: 0.0222) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -0.07% (0.1407 => 0.1406, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.34% (0.0684 => 0.0668, std.dev.: 0.0009) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 198.99% (0.5229 => 1.5634, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 13.51% (14.9895 => 17.0153, std.dev.: 0.0136) MultiSource/Applications/kimwitu++/kc: 36.29% (14.1553 => 19.2919, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/gs/gs: 12.34% (4.1105 => 4.6179, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 29.34% (1.1048 => 1.4290, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 305.52% (7.1582 => 29.0282, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.86% (3.4629 => 5.8129, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/stepanov_container: 63.15% (0.6222 => 1.0151, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10542.64% (0.0720 => 7.6627, std.dev.: 0.0129) MultiSource/Applications/SIBsim4/SIBsim4: 3836300.00% (0.0001 => 3.8364, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 11250100.00% (0.0001 => 11.2502, std.dev.: 0.0462) MultiSource/Applications/kimwitu++/kc: 51000.00% (0.0001 => 0.0511, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 779900.00% (0.0001 => 0.7800, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049200.00% (0.0001 => 10.0493, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5494200.00% (0.0001 => 5.4943, std.dev.: 0.0117) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 37.97% (0.1056 => 0.1457, std.dev.: 0.0004) SingleSource/UnitTests/vla: 29.58% (0.0355 => 0.0460, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 28.49% (0.1432 => 0.1840, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: 19.99% (0.1566 => 0.1879, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 17.74% (0.1144 => 0.1347, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.53% (0.0793 => 0.0932, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.11% (0.0871 => 0.1020, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 16.85% (0.0730 => 0.0853, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 16.77% (0.1175 => 0.1372, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.67% (0.0834 => 0.0973, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.40% (0.8172 => 0.9512, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/n-body: 16.22% (0.0746 => 0.0867, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 16.21% (0.3177 => 0.3692, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 15.88% (0.4879 => 0.5654, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 15.82% (0.2554 => 0.2958, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 15.59% (0.1584 => 0.1831, std.dev.: 0.0012) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.40% (0.1143 => 0.1319, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.08% (0.0842 => 0.0969, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 14.88% (0.1163 => 0.1336, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.84% (0.1125 => 0.1292, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 14.81% (0.1695 => 0.1946, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.56% (0.0886 => 0.1015, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 14.50% (0.1655 => 0.1895, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 14.41% (0.7115 => 0.8140, std.dev.: 0.0013) MultiSource/Applications/aha/aha: 14.34% (0.1151 => 0.1316, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 14.24% (0.5105 => 0.5832, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.14% (0.2065 => 0.2357, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 13.96% (22.1758 => 25.2709, std.dev.: 0.0128) MultiSource/Benchmarks/Ptrdist/ft/ft: 13.87% (0.1940 => 0.2209, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.85% (0.2700 => 0.3074, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 13.79% (0.7433 => 0.8458, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.77% (0.0770 => 0.0876, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 13.73% (0.3109 => 0.3536, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: 13.71% (0.7835 => 0.8909, std.dev.: 0.0029) MultiSource/Applications/viterbi/viterbi: 13.70% (0.1555 => 0.1768, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.60% (0.2758 => 0.3133, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.52% (0.1117 => 0.1268, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.51% (0.1510 => 0.1714, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 13.48% (3.3354 => 3.7850, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.43% (0.5981 => 0.6784, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.39% (0.1337 => 0.1516) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.38% (0.0770 => 0.0873, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.28% (0.0798 => 0.0904, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.18% (0.6675 => 0.7555, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.15% (0.2107 => 0.2384, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.10% (0.9765 => 1.1044, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.07% (0.3121 => 0.3529, std.dev.: 0.0030) MultiSource/Applications/Burg/burg: 13.01% (1.1642 => 1.3157, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.99% (0.2271 => 0.2566, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.94% (1.5415 => 1.7410, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.90% (0.1062 => 0.1199, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.75% (0.5860 => 0.6607, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.73% (0.1029 => 0.1160, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.69% (0.1032 => 0.1163, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.68% (0.4615 => 0.5200, std.dev.: 0.0029) SingleSource/Benchmarks/McGill/exptree: 12.65% (0.0814 => 0.0917, std.dev.: 0.0040) MultiSource/Applications/treecc/treecc: 12.57% (2.0273 => 2.2821, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.53% (0.5020 => 0.5649, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.29% (0.2603 => 0.2923, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.28% (0.5569 => 0.6253, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.22% (0.1236 => 0.1387, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.15% (1.3050 => 1.4636, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 12.10% (1.0722 => 1.2019, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 12.00% (3.8723 => 4.3370, std.dev.: 0.0111) MultiSource/Benchmarks/Olden/health/health: 11.91% (0.1268 => 0.1419, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.88% (0.1625 => 0.1818, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.71% (0.3441 => 0.3844, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.67% (0.6450 => 0.7203, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.59% (1.1861 => 1.3236, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 11.57% (0.3423 => 0.3819, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.43% (0.3307 => 0.3685, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.23% (4.2646 => 4.7437, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 11.22% (0.8921 => 0.9922, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/neural/neural: 11.07% (0.1463 => 0.1625, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 11.04% (0.3180 => 0.3531, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.98% (0.0929 => 0.1031, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 10.98% (0.4299 => 0.4771, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: 10.93% (0.0933 => 0.1035, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.92% (0.1044 => 0.1158, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.86% (0.1695 => 0.1879, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.81% (8.1363 => 9.0162, std.dev.: 0.0077) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.76% (0.1906 => 0.2111, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.62% (1.5859 => 1.7543, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 10.58% (1.1840 => 1.3093, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.42% (0.3927 => 0.4336, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.36% (0.1892 => 0.2088, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 10.33% (9.4845 => 10.4646, std.dev.: 0.0045) MultiSource/Applications/siod/siod: 10.33% (2.2969 => 2.5341, std.dev.: 0.0117) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.31% (0.8101 => 0.8936, std.dev.: 0.0015) MultiSource/Benchmarks/sim/sim: 10.27% (0.3387 => 0.3735, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 10.19% (0.3473 => 0.3827, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.18% (2.2024 => 2.4266, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.16% (0.3543 => 0.3903, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.13% (0.3543 => 0.3902, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.12% (2.2022 => 2.4251, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 10.10% (0.3516 => 0.3871, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.08% (0.3561 => 0.3920, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.07% (0.3497 => 0.3849, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.06% (0.3828 => 0.4213, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.02% (0.3694 => 0.4064, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 9.98% (0.3886 => 0.4274, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 9.79% (0.4289 => 0.4709, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.68% (1.4186 => 1.5559, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 9.51% (0.6456 => 0.7070, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.49% (14.3668 => 15.7302, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.45% (0.4636 => 0.5074, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.16% (0.4103 => 0.4479, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.08% (5.0018 => 5.4558, std.dev.: 0.0065) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.02% (0.1330 => 0.1450, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 9.00% (0.4620 => 0.5036, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.98% (0.3865 => 0.4212, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.87% (0.4203 => 0.4576, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 8.85% (5.7591 => 6.2690, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/lists: 8.71% (0.3422 => 0.3720, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.66% (4.9449 => 5.3730, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.35% (0.2430 => 0.2633, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 8.34% (1.5603 => 1.6905, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/moments: 8.10% (0.4048 => 0.4376, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.07% (0.5925 => 0.6403, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 8.03% (0.3684 => 0.3980, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 8.03% (0.6030 => 0.6514, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 7.99% (0.3603 => 0.3891, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.94% (0.3427 => 0.3699, std.dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: 7.89% (17.1811 => 18.5373, std.dev.: 0.0174) SingleSource/UnitTests/ObjC++/property-reference: 7.49% (0.7326 => 0.7875, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.29% (0.3650 => 0.3916, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.11% (0.3826 => 0.4098, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.87% (0.2793 => 0.2985, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.84% (0.4064 => 0.4342, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 6.82% (0.2831 => 0.3024, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.80% (0.3162 => 0.3377, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.78% (0.2891 => 0.3087, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.76% (0.3283 => 0.3505, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 6.75% (0.2905 => 0.3101, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 6.68% (0.3098 => 0.3305, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.66% (2.0665 => 2.2041, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ary: 6.56% (0.3232 => 0.3444, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.55% (0.2872 => 0.3060, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.46% (0.2725 => 0.2901, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.44% (0.2871 => 0.3056, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 6.33% (0.2877 => 0.3059, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/wc: 6.32% (0.3052 => 0.3245, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.24% (0.2756 => 0.2928, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.12% (0.2714 => 0.2880, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.07% (0.2802 => 0.2972, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 5.96% (1.2842 => 1.3608, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.96% (0.8067 => 0.8548, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/bh/bh: 5.85% (0.3092 => 0.3273, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.59% (3.8922 => 4.1099, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/ary2: 5.53% (0.3379 => 0.3566, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 5.33% (0.3282 => 0.3457, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.17% (0.3136 => 0.3298) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.08% (0.2266 => 0.2381, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 4.38% (0.3131 => 0.3268, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.74% (0.3935 => 0.4043, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.85% (7.9617 => 8.1091, std.dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.99% (4.3953 => 10.9001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3123, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.57% (1.1145 => 1.2992, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.68% (0.2944 => 0.3288, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.92% (1.1396 => 1.2526, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3680, std.dev.: 0.0008) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.77% (4.2280 => 4.3451, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.33% (1.7254 => 1.7656, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.79% (0.8333 => 0.8482, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2079, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.31% (11.6436 => 11.7961, std.dev.: 0.0068) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.96% (6.6874 => 0.1366, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -76.75% (0.8651 => 0.2011, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.82% (5.3855 => 2.3791, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -55.43% (5.3526 => 2.3855, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/richards_benchmark: -45.87% (0.1622 => 0.0878, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.48% (1.1194 => 0.6775, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.31% (5.2763 => 3.2551, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -24.86% (1.7609 => 1.3231, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -17.28% (2.9384 => 2.4306, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: -10.73% (10.4361 => 9.3163, std.dev.: 0.0127) MultiSource/Benchmarks/Bullet/bullet: -10.55% (63.2438 => 56.5705, std.dev.: 0.0245) SingleSource/UnitTests/Vector/constpool: -9.16% (54.1659 => 49.2070, std.dev.: 0.0152) MultiSource/Benchmarks/PAQ8p/paq8p: -3.20% (10.3673 => 10.0354, std.dev.: 0.0163) MultiSource/Applications/JM/lencod/lencod: -2.52% (21.9371 => 21.3836, std.dev.: 0.0099) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.99% (0.0506 => 0.0334, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -33.68% (0.3987 => 0.2644, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -33.34% (1.1492 => 0.7661, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -29.00% (10.7105 => 7.6046, std.dev.: 0.0198) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4233, std.dev.: 0.0019) MultiSource/Benchmarks/NPB-serial/is/is: -10.96% (9.5636 => 8.5152, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -10.80% (1.5373 => 1.3713, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.38% (19.9488 => 18.2777, std.dev.: 0.0109) MultiSource/Benchmarks/FreeBench/mason/mason: -7.73% (0.2161 => 0.1994, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.09% (1.8329 => 1.7029, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -6.24% (1.2373 => 1.1601, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8474, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: -5.46% (6.6465 => 6.2837, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.08% (1.6805 => 1.5952, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: -4.53% (1.5835 => 1.5118, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.44% (0.9957 => 0.9515, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.08% (0.2497 => 0.2395, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.77% (3.2827 => 3.1589, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.46% (32.5116 => 31.3860, std.dev.: 0.0037) MultiSource/Benchmarks/sim/sim: -3.24% (5.0483 => 4.8849, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.81% (4.5009 => 4.3743, std.dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: -2.67% (4.6441 => 4.5199, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.66% (0.4808 => 0.4680, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.79% (8.1563 => 8.0099, std.dev.: 0.0167) SingleSource/Benchmarks/Misc/salsa20: -1.79% (10.2830 => 10.0991, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6825, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -1.62% (1.1277 => 1.1094, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -1.58% (2.5528 => 2.5124, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -1.21% (85.0658 => 84.0403, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/lists: -1.12% (6.2999 => 6.2293, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8587, std.dev.: 0.0067) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -5.32% (0.1485 => 0.1406, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.43% (0.2116 => 0.0668, std.dev.: 0.0009) Report Time: 1.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 30 09:44:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 30 Oct 2012 11:44:43 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121030164443.89FEE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5410?compare_to=5406&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5410, Order: 167015, Start Time: 2012-10-30 15:16:54, End Time: 2012-10-30 16:44:44 To: 5406, Order: 167013, Start Time: 2012-10-30 13:33:00, End Time: 2012-10-30 15:00:11 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 8 (86 on baseline) Performance Improvements: 9 (3 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 974 (885 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.18% (0.2701 => 0.2814, std.dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: 1.20% (8.8263 => 8.9319, std.dev.: 0.0386) MultiSource/Applications/hbd/hbd: 1.17% (1.4683 => 1.4855, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.60% (21.9640 => 22.5344, std.dev.: 0.0859) MultiSource/Benchmarks/Bullet/bullet: 2.18% (7.1449 => 7.3009, std.dev.: 0.0411) SingleSource/Benchmarks/Misc/pi: 1.61% (2.4748 => 2.5146, std.dev.: 0.0016) MultiSource/Benchmarks/llubenchmark/llu: 1.28% (2.0024 => 2.0281, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/ffbench: 1.17% (1.4077 => 1.4242, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: -3.04% (0.3288 => 0.3188, std.dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.36% (6.9862 => 6.8910, std.dev.: 0.0213) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -1.35% (0.8241 => 0.8130, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.32% (1.2698 => 1.2530, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.18% (4.3207 => 4.2696, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -1.16% (1.7094 => 1.6895, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.14% (0.9058 => 0.8955, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.10% (0.9979 => 0.9869, std.dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.20% (2.7004 => 2.6679, std.dev.: 0.0064) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.45% (16.6688 => 16.5936, std.dev.: 0.0373) MultiSource/Applications/obsequi/Obsequi: -0.85% (1.0707 => 1.0616, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.81% (21.6507 => 22.0434, std.dev.: 0.2728) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.21% (0.3641 => 0.3685, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/bigfib: -0.02% (0.6031 => 0.6030, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.21% (0.3329 => 0.3336, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/strcat: -1.14% (0.2009 => 0.1986, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0218 => 0.0218, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0427 => 0.0427, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.90% (0.0333 => 0.0330, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0313 => 0.0313, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.24% (0.0425 => 0.0424, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0202 => 0.0202, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/test1: 0.92% (0.0218 => 0.0220, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -7.14% (0.0014 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 0.90% (0.1441 => 0.1454, std.dev.: 0.0028) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -3.04% (1.1877 => 1.1516, std.dev.: 0.0226) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: 0.13% (0.1519 => 0.1521, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.35% (0.4046 => 0.4060, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.09% (0.1297 => 0.1389, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 12.46% (0.0570 => 0.0641, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 5.34% (0.0262 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.87% (0.0576 => 0.0571, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.30% (1.1463 => 1.1429, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.31% (0.0647 => 0.0649, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.46% (0.0260 => 0.0251, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.41% (0.7985 => 0.8018, std.dev.: 0.0184) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -8.96% (0.0067 => 0.0061, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2331.74% (0.6332 => 15.3978, std.dev.: 0.1313) MultiSource/Benchmarks/McCat/08-main/main: 44.29% (0.1831 => 0.2642, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.67% (0.1559 => 0.1455, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1485.08% (0.3344 => 5.3005, std.dev.: 0.0787) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.18% (0.2364 => 0.3243, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel: -1.17% (0.0429 => 0.0424, std.dev.: 0.0010) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 2.23% (0.0224 => 0.0229, std.dev.: 0.0006) SingleSource/UnitTests/byval-alignment: -32.61% (0.0230 => 0.0155, std.dev.: 0.0015) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4495, std.dev.: 0.0079) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0750, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4944, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3352, std.dev.: 0.0192) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0343, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4028, std.dev.: 0.0068) SingleSource/Regression/C/uint64_to_float: -23.83% (2.1832 => 1.6630, std.dev.: 0.0049) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 35.81% (14.7684 => 20.0570, std.dev.: 0.0208) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.32% (0.0810 => 0.0926, std.dev.: 0.0007) SingleSource/UnitTests/SignlessTypes/rem: 14.30% (0.1035 => 0.1183, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/tsp/tsp: 10.52% (0.1112 => 0.1229, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.66% (0.2180 => 0.2347, std.dev.: 0.0026) MultiSource/Applications/SIBsim4/SIBsim4: 7.03% (1.2568 => 1.3451, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.96% (0.8321 => 0.8900, std.dev.: 0.0153) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.31% (0.1885 => 0.2004, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.75% (0.1983 => 0.2097, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.05% (0.2279 => 0.2394, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.03% (13.1811 => 13.8443, std.dev.: 0.0222) MultiSource/Applications/Burg/burg: 4.92% (1.2222 => 1.2823, std.dev.: 0.0129) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.90% (1.1170 => 1.1717, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: 4.87% (0.7950 => 0.8337, std.dev.: 0.0123) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.2741 => 0.2870, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.52% (0.4847 => 0.5066, std.dev.: 0.0034) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.29% (6.6074 => 6.8910, std.dev.: 0.0213) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.18% (0.7473 => 0.7785, std.dev.: 0.0081) MultiSource/Applications/treecc/treecc: 4.15% (1.9948 => 2.0776, std.dev.: 0.0118) MultiSource/Applications/hbd/hbd: 4.11% (1.4269 => 1.4855, std.dev.: 0.0045) MultiSource/Applications/d/make_dparser: 4.05% (3.2366 => 3.3677, std.dev.: 0.0332) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.98% (0.6287 => 0.6537, std.dev.: 0.0083) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.98% (0.8148 => 0.8472, std.dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.93% (0.4783 => 0.4971, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.92% (1.1271 => 1.1713, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.80% (0.2998 => 0.3112, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.72% (0.5191 => 0.5384, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 3.56% (8.6247 => 8.9319, std.dev.: 0.0386) MultiSource/Applications/SPASS/SPASS: 3.51% (14.2605 => 14.7614, std.dev.: 0.1446) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.42% (0.6227 => 0.6440, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.18% (8.6476 => 8.9229, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.11% (1.6386 => 1.6895, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.98% (0.9435 => 0.9716, std.dev.: 0.0108) MultiSource/Applications/minisat/minisat: 2.88% (0.6834 => 0.7031, std.dev.: 0.0047) MultiSource/Applications/lemon/lemon: 2.88% (1.0945 => 1.1260, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.87% (0.5961 => 0.6132, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.81% (0.4559 => 0.4687, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.79% (0.6586 => 0.6770, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.78% (0.8286 => 0.8516, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.77% (1.1685 => 1.2009, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.63% (0.8697 => 0.8926, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.62% (0.8855 => 0.9087, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.40% (1.4479 => 1.4826, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.39% (0.8457 => 0.8659, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.37% (0.8007 => 0.8197, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.31% (0.8611 => 0.8810, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.27% (0.8331 => 0.8520, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.25% (0.9908 => 1.0131, std.dev.: 0.0046) MultiSource/Applications/JM/lencod/lencod: 2.24% (15.3280 => 15.6709, std.dev.: 0.0267) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.23% (4.1763 => 4.2696, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.16% (0.8177 => 0.8354, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.13% (0.8597 => 0.8780, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.07% (0.9074 => 0.9262, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.05% (0.8050 => 0.8215, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.97% (0.8069 => 0.8228, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.96% (0.8261 => 0.8423, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.92% (0.8885 => 0.9056, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.89% (0.8716 => 0.8881, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.87% (0.8927 => 0.9094, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.87% (0.9688 => 0.9869, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.86% (0.8712 => 0.8874, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.80% (0.8204 => 0.8352, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.79% (0.8656 => 0.8811, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.76% (0.8086 => 0.8228, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.75% (0.9069 => 0.9228, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.70% (0.8805 => 0.8955, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.68% (0.8317 => 0.8457, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.66% (0.8316 => 0.8454, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.62% (0.8338 => 0.8473, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.62% (0.9039 => 0.9185, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.56% (0.8066 => 0.8192, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 1.55% (4.1305 => 4.1945, std.dev.: 0.0242) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.40% (4.4880 => 4.5510, std.dev.: 0.0130) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 59.20% (1.5795 => 2.5146, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.68% (14.6451 => 16.3561, std.dev.: 0.5423) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.64% (2.4333 => 2.6679, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.38% (1.1857 => 1.2851, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 6.19% (63.1822 => 67.0916, std.dev.: 0.0310) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.93% (0.3186 => 0.3375, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/ReedSolomon: 2.98% (8.5322 => 8.7863, std.dev.: 0.0107) MultiSource/Applications/siod/siod: 2.82% (3.6643 => 3.7676, std.dev.: 0.0128) MultiSource/Benchmarks/Bullet/bullet: 2.57% (7.1181 => 7.3009, std.dev.: 0.0411) MultiSource/Benchmarks/Olden/bh/bh: 1.81% (2.3560 => 2.3986, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.76% (2.4490 => 2.4922, std.dev.: 0.0123) MultiSource/Benchmarks/llubenchmark/llu: 1.57% (1.9967 => 2.0281, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.05% (22.2997 => 22.5344, std.dev.: 0.0859) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.13% (0.3269 => 0.3036, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -5.28% (29.8330 => 28.2583, std.dev.: 0.0612) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.17% (3.3479 => 3.3087, std.dev.: 0.0006) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.90% (16.4461 => 16.5936, std.dev.: 0.0373) MultiSource/Applications/obsequi/Obsequi: 3.45% (1.0262 => 1.0616, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6958.41% (0.3123 => 22.0434, std.dev.: 0.2728) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.61% (0.2463 => 0.3685, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/bigfib: 0.33% (0.6010 => 0.6030, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.14% (0.3266 => 0.3336, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/strcat: 0.86% (0.1969 => 0.1986, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.66% (0.0408 => 0.0427, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0384 => 0.0424, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/test1: 22.22% (0.0180 => 0.0220, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 1.11% (0.1438 => 0.1454, std.dev.: 0.0028) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.65% (1.1329 => 1.1516, std.dev.: 0.0226) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Applications/oggenc/oggenc: 4.04% (0.1462 => 0.1521, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.50% (0.4164 => 0.4060, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.46% (0.1369 => 0.1389, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: - (0.0641 => 0.0641, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.54% (0.0195 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.21% (0.0578 => 0.0571, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.07% (1.1437 => 1.1429, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.51% (0.0627 => 0.0649, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 39.44% (0.0180 => 0.0251, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.01% (0.8017 => 0.8018, std.dev.: 0.0184) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -1.61% (0.0062 => 0.0061, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 30 09:54:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 30 Oct 2012 11:54:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121030165427.9D2752A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5411?compare_to=5407&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5411, Order: 167015, Start Time: 2012-10-30 15:29:29, End Time: 2012-10-30 16:54:27 To: 5407, Order: 167013, Start Time: 2012-10-30 13:41:35, End Time: 2012-10-30 15:06:38 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 0 (176 on baseline) Unchanged Tests: 1042 (861 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.35% (15.2527 => 18.3562, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.04% (2.0478 => 2.1100, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/salsa20: 2.49% (7.4937 => 7.6804, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: 2.15% (3.1932 => 3.2617, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.94% (0.1431 => 0.1303, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.59% (0.1584 => 0.1448, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.62% (0.3821 => 0.3530, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -6.91% (0.3880 => 0.3612, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.85% (0.3884 => 0.3618, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -6.81% (0.3831 => 0.3570, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -6.80% (2.4924 => 2.3228, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: -6.80% (0.4176 => 0.3892, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.78% (0.3891 => 0.3627, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -6.77% (0.3812 => 0.3554, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.73% (0.3848 => 0.3589, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -6.72% (0.3896 => 0.3634, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.72% (0.4033 => 0.3762, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -6.55% (0.4199 => 0.3924, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.55% (0.2428 => 0.2269, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.49% (0.3142 => 0.2938, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -6.44% (0.1879 => 0.1758, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -6.38% (0.4280 => 0.4007, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.38% (22.4056 => 20.9772, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/except: -6.35% (0.3026 => 0.2834, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -6.31% (0.3025 => 0.2834, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.30% (0.3252 => 0.3047, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.30% (2.1713 => 2.0346, std.dev.: 0.0157) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.29% (0.3849 => 0.3607, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.28% (0.3057 => 0.2865, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.26% (0.3658 => 0.3429, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.24% (0.4151 => 0.3892, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -6.23% (0.3323 => 0.3116, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.20% (0.3837 => 0.3599, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.17% (0.2903 => 0.2724, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.15% (0.9852 => 0.9246, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: -6.14% (0.2849 => 0.2674, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: -6.13% (0.2659 => 0.2496, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.12% (4.5069 => 4.2312, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/oourafft: -6.11% (0.2160 => 0.2028, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: -6.08% (0.3255 => 0.3057, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/objinst: -6.07% (0.3194 => 0.3000, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: -6.07% (0.3016 => 0.2833, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -6.06% (0.2871 => 0.2697, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -6.06% (0.2989 => 0.2808, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -6.05% (0.3205 => 0.3011, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.03% (0.2355 => 0.2213, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.00% (0.4083 => 0.3838, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.99% (3.5339 => 3.3221, std.dev.: 0.0078) MultiSource/Applications/sgefa/sgefa: -5.99% (0.3357 => 0.3156, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -5.98% (0.3059 => 0.2876, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.97% (0.4321 => 0.4063, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.96% (0.9542 => 0.8973, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -5.95% (1.3148 => 1.2366, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: -5.95% (0.4861 => 0.4572, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -5.89% (0.3446 => 0.3243, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.88% (0.6484 => 0.6103, std.dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: -5.87% (7.0961 => 6.6795, std.dev.: 0.0181) SingleSource/Benchmarks/Shootout-C++/sieve: -5.86% (0.3788 => 0.3566, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.86% (0.4813 => 0.4531, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary: -5.83% (0.3394 => 0.3196, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -5.83% (0.3481 => 0.3278, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.83% (0.1716 => 0.1616, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.82% (1.6474 => 1.5515, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.80% (0.3931 => 0.3703, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: -5.80% (0.3621 => 0.3411, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: -5.78% (16.1920 => 15.2563, std.dev.: 0.0178) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.77% (5.4682 => 5.1527, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/moments: -5.77% (0.4248 => 0.4003, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.73% (0.2548 => 0.2402, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -5.69% (0.3867 => 0.3647, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: -5.67% (1.2515 => 1.1806, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.65% (0.5999 => 0.5660, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash: -5.64% (0.4524 => 0.4269, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.63% (4.0323 => 3.8054, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.61% (4.8161 => 4.5460, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.60% (0.4427 => 0.4179, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.60% (4.8802 => 4.6069, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: -5.60% (4.3330 => 4.0904, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -5.60% (34.0927 => 32.1843, std.dev.: 0.0147) SingleSource/UnitTests/ObjC++/property-reference: -5.59% (0.7779 => 0.7344, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: -5.59% (0.6750 => 0.6373, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.57% (0.7919 => 0.7478, std.dev.: 0.0017) MultiSource/Applications/siod/siod: -5.55% (2.4021 => 2.2688, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.49% (1.2221 => 1.1550, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.48% (1.0544 => 0.9966, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.45% (1.2784 => 1.2087, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -5.43% (0.2985 => 0.2823, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.42% (1.2210 => 1.1548, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.42% (0.2933 => 0.2774, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -5.32% (4.0594 => 3.8436, std.dev.: 0.0103) MultiSource/Benchmarks/mafft/pairlocalalign: -5.26% (9.2283 => 8.7431, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.23% (2.2587 => 2.1406, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.22% (0.2278 => 0.2159, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.17% (0.7198 => 0.6826, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.16% (0.6293 => 0.5968, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: -5.14% (0.6347 => 0.6021, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.13% (0.3491 => 0.3312, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.12% (0.8521 => 0.8085, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.11% (1.6364 => 1.5527, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.10% (1.4642 => 1.3895, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: -5.08% (0.6441 => 0.6114, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: -5.06% (18.2933 => 17.3671, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.97% (0.2999 => 0.2850, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.95% (0.9557 => 0.9084, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -4.95% (0.7982 => 0.7587, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.92% (0.6052 => 0.5754, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.92% (0.6304 => 0.5994, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.91% (0.5925 => 0.5634, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.91% (0.3319 => 0.3156, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.90% (1.3722 => 1.3049) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.90% (0.5859 => 0.5572, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.89% (0.5581 => 0.5308, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.88% (0.5591 => 0.5318, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.87% (0.6676 => 0.6351, std.dev.: 0.0111) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.86% (0.4916 => 0.4677, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: -4.86% (0.3581 => 0.3407, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.84% (0.6667 => 0.6344, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.81% (0.7339 => 0.6986, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.80% (0.6681 => 0.6360, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.80% (0.6395 => 0.6088, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.79% (0.6446 => 0.6137, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.78% (0.6230 => 0.5932, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.78% (0.6194 => 0.5898, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.77% (0.5802 => 0.5525, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.77% (0.5575 => 0.5309, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.77% (0.5705 => 0.5433, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.73% (0.5456 => 0.5198, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.73% (0.5478 => 0.5219, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.71% (0.6660 => 0.6346, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.71% (0.6260 => 0.5965, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.70% (0.5569 => 0.5307, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.70% (0.5570 => 0.5308, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.70% (0.5805 => 0.5532, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -4.70% (0.4515 => 0.4303, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.67% (0.5863 => 0.5589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.66% (0.5941 => 0.5664, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.66% (0.5857 => 0.5584, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.65% (0.6297 => 0.6004, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.61% (0.2385 => 0.2275, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.59% (0.6033 => 0.5756, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.55% (0.6440 => 0.6147, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.55% (0.5849 => 0.5583, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.52% (0.6189 => 0.5909, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.48% (0.5688 => 0.5433, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.48% (0.7524 => 0.7187, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.46% (0.6395 => 0.6110, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -4.43% (0.7447 => 0.7117, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: -4.40% (0.9179 => 0.8775, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: -4.37% (0.3271 => 0.3128, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.37% (0.5567 => 0.5324, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: -4.36% (0.8418 => 0.8051, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: -4.32% (0.3406 => 0.3259, std.dev.: 0.0042) MultiSource/Applications/lemon/lemon: -4.31% (1.1450 => 1.0957, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.23% (8.0126 => 7.6738, std.dev.: 0.0146) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.17% (6.7716 => 6.4891, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: -4.17% (15.5079 => 14.8619, std.dev.: 0.0053) MultiSource/Applications/treecc/treecc: -4.14% (2.1401 => 2.0515, std.dev.: 0.0077) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.09% (0.9077 => 0.8706, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.04% (0.6736 => 0.6464, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.00% (0.7021 => 0.6740, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.93% (0.3483 => 0.3346, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: -3.92% (1.5610 => 1.4998, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.85% (0.5168 => 0.4969, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -3.75% (17.1032 => 16.4611, std.dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: -3.71% (20.7746 => 20.0034, std.dev.: 0.0323) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.67% (1.2300 => 1.1848, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: -3.63% (3.5154 => 3.3879, std.dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: -3.62% (1.1530 => 1.1113, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.57% (0.5329 => 0.5139, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: -3.48% (5.0226 => 4.8478, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.15% (14.2083 => 13.7613, std.dev.: 0.0199) MultiSource/Applications/SIBsim4/SIBsim4: -1.93% (1.3864 => 1.3596, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7541, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1723, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7063, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: -3.85% (2.2633 => 2.1762, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.64% (6.5735 => 6.4659, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0001) Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 30 10:38:55 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 30 Oct 2012 12:38:55 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121030173855.6EC562A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5412?compare_to=5409&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5412, Order: 167016, Start Time: 2012-10-30 16:05:55, End Time: 2012-10-30 17:38:55 To: 5409, Order: 167013, Start Time: 2012-10-30 14:03:18, End Time: 2012-10-30 15:36:16 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 5 (177 on baseline) Performance Improvements: 1 (52 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 2 (2 on baseline) Unchanged Tests: 1034 (660 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: 2.04% (0.7875 => 0.8036, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.41% (2.2041 => 2.2351, std.dev.: 0.0045) MultiSource/Applications/JM/ldecod/ldecod: 1.01% (9.3163 => 9.4105, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (3.6980 => 3.7741, std.dev.: 0.0121) SingleSource/Benchmarks/Misc/lowercase: 1.24% (7.9448 => 8.0431, std.dev.: 0.0271) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.89% (10.0354 => 9.8457, std.dev.: 0.0044) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: - (0.1406 => 0.1406, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.14% (0.0668 => 0.0647, std.dev.: 0.0039) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 199.08% (0.5229 => 1.5639, std.dev.: 0.0122) MultiSource/Applications/SPASS/SPASS: 13.52% (14.9895 => 17.0168, std.dev.: 0.0144) MultiSource/Applications/kimwitu++/kc: 36.30% (14.1553 => 19.2941, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/gs/gs: 12.17% (4.1105 => 4.6109, std.dev.: 0.0118) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 29.20% (1.1048 => 1.4274, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 305.09% (7.1582 => 28.9971, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.67% (3.4629 => 5.8061, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/stepanov_container: 64.26% (0.6222 => 1.0220, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10545.00% (0.0720 => 7.6644, std.dev.: 0.0487) MultiSource/Applications/SIBsim4/SIBsim4: 3836900.00% (0.0001 => 3.8370, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 11204200.00% (0.0001 => 11.2043, std.dev.: 0.0147) MultiSource/Applications/kimwitu++/kc: 50700.00% (0.0001 => 0.0508, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 779800.00% (0.0001 => 0.7799, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049500.00% (0.0001 => 10.0496, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5491200.00% (0.0001 => 5.4913, std.dev.: 0.0388) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 38.73% (0.1056 => 0.1465, std.dev.: 0.0037) SingleSource/UnitTests/vla: 29.30% (0.0355 => 0.0459, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 28.49% (0.1432 => 0.1840, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 19.99% (0.1566 => 0.1879, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 19.06% (0.0834 => 0.0993, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/rem: 17.83% (0.1144 => 0.1348, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 17.53% (0.0730 => 0.0858, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.44% (0.0648 => 0.0761, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.11% (0.0871 => 0.1020, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 17.02% (0.1175 => 0.1375, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.90% (0.0793 => 0.0927, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 16.89% (0.0746 => 0.0872, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 16.78% (0.3177 => 0.3710, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.54% (0.0798 => 0.0930, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 16.54% (0.4879 => 0.5686, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.34% (0.8172 => 0.9507, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/08-main/main: 16.17% (0.2554 => 0.2967, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 15.38% (0.1125 => 0.1298, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 15.34% (0.1584 => 0.1827, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.32% (0.0842 => 0.0971, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 15.17% (0.1655 => 0.1906, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/mst/mst: 15.13% (0.1163 => 0.1339, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.06% (0.2065 => 0.2376, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/em3d/em3d: 14.93% (0.1695 => 0.1948, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.90% (0.0886 => 0.1018, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.48% (0.2700 => 0.3091, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.23% (0.1117 => 0.1276, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 14.22% (0.7115 => 0.8127, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.16% (0.0770 => 0.0879, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 14.08% (0.5105 => 0.5824, std.dev.: 0.0050) MultiSource/Applications/viterbi/viterbi: 14.08% (0.1555 => 0.1774, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.06% (0.1337 => 0.1525, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 13.99% (0.1151 => 0.1312, std.dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 13.90% (22.1758 => 25.2575, std.dev.: 0.1120) MultiSource/Applications/sgefa/sgefa: 13.86% (0.3109 => 0.3540, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ft/ft: 13.81% (0.1940 => 0.2208, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 13.78% (0.7835 => 0.8915, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.74% (0.2758 => 0.3137, std.dev.: 0.0017) MultiSource/Applications/d/make_dparser: 13.63% (3.3354 => 3.7899, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.58% (0.5981 => 0.6793, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.51% (0.1510 => 0.1714, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.48% (0.2107 => 0.2391, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.41% (0.1029 => 0.1167, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.38% (0.0770 => 0.0873, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.33% (0.6675 => 0.7565, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.28% (0.1062 => 0.1203, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.21% (0.2271 => 0.2571, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 13.10% (0.7433 => 0.8407, std.dev.: 0.0028) MultiSource/Applications/Burg/burg: 13.04% (1.1642 => 1.3160, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.02% (0.4615 => 0.5216, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.97% (0.9765 => 1.1032, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.94% (0.3121 => 0.3525, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.73% (1.5415 => 1.7378, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.68% (0.5860 => 0.6603, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.55% (0.5020 => 0.5650, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 12.43% (2.0273 => 2.2792, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/exptree: 12.41% (0.0814 => 0.0915, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.37% (0.5569 => 0.6258, std.dev.: 0.0045) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.34% (0.1143 => 0.1284, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.33% (0.2603 => 0.2924, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/health/health: 12.30% (0.1268 => 0.1424, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 12.18% (0.3473 => 0.3896, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.14% (0.3543 => 0.3973, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.11% (0.1032 => 0.1157, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.10% (1.3050 => 1.4629, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 12.10% (0.3497 => 0.3920, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.09% (1.1861 => 1.3295, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/parameter-passing: 12.07% (0.3927 => 0.4401, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.05% (0.3543 => 0.3970, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.99% (0.3561 => 0.3988, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.97% (0.3516 => 0.3937, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.91% (0.3307 => 0.3701, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.88% (0.3694 => 0.4133, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.86% (0.3828 => 0.4282, std.dev.: 0.0028) MultiSource/Applications/lemon/lemon: 11.84% (1.0722 => 1.1992, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.81% (0.1236 => 0.1382, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 11.72% (3.8723 => 4.3260, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.69% (0.1625 => 0.1815, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: 11.63% (0.3423 => 0.3821, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.54% (0.3441 => 0.3838, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.53% (0.3886 => 0.4334, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.52% (0.1892 => 0.2110, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.36% (0.6450 => 0.7183, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/05-eks/eks: 11.28% (0.4299 => 0.4784, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.23% (4.2646 => 4.7435, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.19% (0.0929 => 0.1033, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.18% (2.2022 => 2.4485, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 11.11% (8.1363 => 9.0400, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.07% (0.1906 => 0.2117, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: 11.05% (0.8921 => 0.9907, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 11.01% (0.3180 => 0.3530, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/neural/neural: 10.94% (0.1463 => 0.1623, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.68% (0.1695 => 0.1876, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 10.48% (9.4845 => 10.4786, std.dev.: 0.0083) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.44% (0.8101 => 0.8947, std.dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 10.42% (1.1840 => 1.3074, std.dev.: 0.0056) MultiSource/Benchmarks/sim/sim: 10.39% (0.3387 => 0.3739, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 10.33% (0.4289 => 0.4732, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 10.24% (0.6456 => 0.7117, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.19% (1.5859 => 1.7475, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.06% (0.1044 => 0.1149, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.01% (0.4636 => 0.5100, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: 9.96% (0.3422 => 0.3763, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.83% (0.3865 => 0.4245, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/hash2: 9.83% (0.4620 => 0.5074, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.77% (0.4103 => 0.4504, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.75% (0.4203 => 0.4613, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 9.72% (2.2969 => 2.5202, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.71% (2.2024 => 2.4162, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 9.69% (0.7326 => 0.8036, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 9.67% (0.5925 => 0.6498, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.66% (14.3668 => 15.7540, std.dev.: 0.0051) SingleSource/UnitTests/ObjC++/property-reference-object: 9.57% (0.6030 => 0.6607, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.57% (1.4186 => 1.5543, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 9.47% (5.7591 => 6.3042, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/lists1: 9.31% (0.3684 => 0.4027, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 9.23% (0.2905 => 0.3173, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/moments: 9.12% (0.4048 => 0.4417, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.10% (0.1330 => 0.1451, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 9.05% (0.3603 => 0.3929, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.02% (0.2793 => 0.3045, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.96% (5.0018 => 5.4502, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.92% (4.9449 => 5.3859, std.dev.: 0.0105) MultiSource/Applications/hbd/hbd: 8.91% (1.5603 => 1.6993, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.79% (0.3650 => 0.3971, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 8.59% (0.2725 => 0.2959, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.56% (0.2756 => 0.2992, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 8.51% (0.2714 => 0.2945, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.34% (0.2891 => 0.3132, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.31% (0.2430 => 0.2632, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 8.27% (0.2831 => 0.3065, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.21% (0.3826 => 0.4140, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.19% (0.3162 => 0.3421, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.16% (2.0665 => 2.2351, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Puzzle: 8.12% (0.1268 => 0.1371, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 8.07% (0.3283 => 0.3548, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary: 8.01% (0.3232 => 0.3491, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 8.01% (0.3098 => 0.3346, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.00% (0.4064 => 0.4389, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.90% (0.2872 => 0.3099, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.88% (0.3427 => 0.3697, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.84% (0.2871 => 0.3096, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.75% (0.2877 => 0.3100, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 7.61% (17.1811 => 18.4887, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/wc: 7.60% (0.3052 => 0.3284, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 7.58% (0.3379 => 0.3635, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 7.53% (0.2802 => 0.3013, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 6.98% (1.2842 => 1.3739, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.86% (0.3136 => 0.3351, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 6.31% (0.3282 => 0.3489, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 6.08% (0.3092 => 0.3280, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.85% (0.8067 => 0.8539, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/objinst: 5.72% (0.3131 => 0.3310, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.44% (3.8922 => 4.1040, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.94% (0.2266 => 0.2378, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.38% (0.3817 => 0.3984, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.89% (0.3935 => 0.4088, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.55% (7.9617 => 8.1645, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.16% (7.0540 => 7.1360, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.57% (1.1145 => 1.2992, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.33% (2.8904 => 3.2179, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.92% (1.1396 => 1.2526, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (3.1578 => 3.3679, std.dev.: 0.0030) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.60% (4.2280 => 4.3381, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bisort/bisort: 2.02% (0.8333 => 0.8501, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 1.54% (3.1595 => 3.2081, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 1.40% (3.7221 => 3.7741, std.dev.: 0.0121) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7987, std.dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.94% (6.6874 => 0.1375, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -77.03% (0.8651 => 0.1987, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.50% (5.3855 => 2.3963, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -55.15% (5.3526 => 2.4004, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/richards_benchmark: -45.44% (0.1622 => 0.0885, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.07% (1.1194 => 0.6820, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.73% (5.2763 => 3.2854, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -24.46% (1.7609 => 1.3301, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -16.99% (2.9384 => 2.4393, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -10.29% (63.2438 => 56.7382, std.dev.: 0.0109) MultiSource/Applications/JM/ldecod/ldecod: -9.83% (10.4361 => 9.4105, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -9.15% (54.1659 => 49.2120, std.dev.: 0.0194) MultiSource/Benchmarks/PAQ8p/paq8p: -5.03% (10.3673 => 9.8457, std.dev.: 0.0044) MultiSource/Applications/JM/lencod/lencod: -2.34% (21.9371 => 21.4233, std.dev.: 0.1201) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.99% (0.0506 => 0.0334, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -33.68% (0.3987 => 0.2644, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel: -33.40% (1.1492 => 0.7654, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -29.13% (10.7105 => 7.5905, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4243, std.dev.: 0.0031) MultiSource/Benchmarks/NPB-serial/is/is: -10.97% (9.5636 => 8.5143, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel-2: -10.93% (1.5373 => 1.3692, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.45% (19.9488 => 18.2637, std.dev.: 0.0198) MultiSource/Benchmarks/FreeBench/mason/mason: -7.68% (0.2161 => 0.1995, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.11% (1.8329 => 1.7025, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.97% (4.8142 => 4.4786, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -6.72% (1.2373 => 1.1542, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -5.46% (6.6465 => 6.2836, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.08% (1.6805 => 1.5952, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5074, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.69% (3.2827 => 3.1615, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.58% (0.9957 => 0.9601, std.dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.46% (32.5116 => 31.3859, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: -3.21% (5.0483 => 4.8864, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.87% (0.4808 => 0.4670, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.86% (4.5009 => 4.3720, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: -2.72% (4.6441 => 4.5180, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.15% (8.1563 => 7.9806, std.dev.: 0.0161) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.81% (10.2830 => 10.0972, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6816, std.dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: -1.67% (2.5528 => 2.5102, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -1.62% (1.1277 => 1.1094, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -1.18% (85.0658 => 84.0588, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.05% (6.2999 => 6.2340, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -5.32% (0.1485 => 0.1406, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.42% (0.2116 => 0.0647, std.dev.: 0.0039) Report Time: 1.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 30 11:30:09 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 30 Oct 2012 13:30:09 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121030183009.4796A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5413?compare_to=5410&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5413, Order: 167021, Start Time: 2012-10-30 17:01:59, End Time: 2012-10-30 18:30:10 To: 5410, Order: 167015, Start Time: 2012-10-30 15:16:54, End Time: 2012-10-30 16:44:44 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 10 (62 on baseline) Performance Improvements: 2 (4 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 979 (908 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.31% (0.6196 => 0.6525, std.dev.: 0.0116) MultiSource/Benchmarks/McCat/05-eks/eks: 3.56% (0.4434 => 0.4592, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.46% (0.8881 => 0.9011, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.38% (1.6895 => 1.7128, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.28% (0.8653 => 0.8764, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.04% (0.7572 => 0.7878, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.48% (9.8905 => 10.0365, std.dev.: 0.0234) MultiSource/Applications/lua/lua: 1.44% (28.2583 => 28.6643, std.dev.: 0.0350) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.22% (1.6030 => 1.6225, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.10% (3.6748 => 3.7153, std.dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -13.58% (16.3561 => 14.1348, std.dev.: 0.8155) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -1.21% (22.5344 => 22.2616, std.dev.: 0.0130) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.12% (16.5936 => 16.5737, std.dev.: 0.2519) MultiSource/Applications/obsequi/Obsequi: 1.11% (1.0616 => 1.0734, std.dev.: 0.0155) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.57% (22.0434 => 21.9179, std.dev.: 0.1565) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.57% (0.3685 => 0.3627, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/bigfib: 0.08% (0.6030 => 0.6035, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.90% (0.3336 => 0.3306, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/strcat: 0.55% (0.1986 => 0.1997, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.46% (0.0218 => 0.0217, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.94% (0.0427 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.61% (0.0330 => 0.0332, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0313 => 0.0312, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.94% (0.0424 => 0.0420, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0202 => 0.0202, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -0.45% (0.0220 => 0.0219, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.55% (0.1454 => 0.1446, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: -1.59% (1.1516 => 1.1333, std.dev.: 0.0185) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1521 => 0.1520, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.67% (0.4060 => 0.3992, std.dev.: 0.0186) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.55% (0.1389 => 0.1298, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.18% (0.0641 => 0.0627, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.93% (0.0571 => 0.0560, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.54% (1.1429 => 1.1491, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -41.94% (0.0031 => 0.0018, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.46% (0.0649 => 0.0646, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.40% (0.0251 => 0.0252, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.05% (0.8018 => 0.8014, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -4.92% (0.0061 => 0.0058, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2329.52% (0.6332 => 15.3837, std.dev.: 0.2291) MultiSource/Benchmarks/McCat/08-main/main: 46.26% (0.1831 => 0.2678, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.99% (0.1559 => 0.1450, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1488.22% (0.3344 => 5.3110, std.dev.: 0.0546) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.31% (0.2364 => 0.3246, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: 2.33% (0.0429 => 0.0439, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.91% (0.0224 => 0.0235, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -28.70% (0.0230 => 0.0164, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4420, std.dev.: 0.0254) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0723, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4895, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3488, std.dev.: 0.0159) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0252, std.dev.: 0.0222) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4047, std.dev.: 0.0059) SingleSource/Regression/C/uint64_to_float: -23.77% (2.1832 => 1.6643, std.dev.: 0.0022) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 36.15% (14.7684 => 20.1067, std.dev.: 0.0407) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.17% (0.0810 => 0.0941, std.dev.: 0.0008) SingleSource/UnitTests/SignlessTypes/rem: 12.17% (0.1035 => 0.1161, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/tsp/tsp: 11.60% (0.1112 => 0.1241, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.57% (0.6010 => 0.6525, std.dev.: 0.0116) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.80% (0.1885 => 0.2032, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.52% (0.2180 => 0.2344, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.16% (0.1425 => 0.1527, std.dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: 7.14% (1.2568 => 1.3465, std.dev.: 0.0083) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.09% (0.8321 => 0.8911, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.85% (0.4847 => 0.5179, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.50% (13.1811 => 14.0376, std.dev.: 0.0918) MultiSource/Applications/viterbi/viterbi: 6.40% (0.1577 => 0.1678, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.98% (0.8148 => 0.8554, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.96% (0.2741 => 0.2877, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 4.77% (1.4269 => 1.4950, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.53% (1.6386 => 1.7128, std.dev.: 0.0084) MultiSource/Benchmarks/McCat/05-eks/eks: 4.43% (0.4397 => 0.4592, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.82% (0.4559 => 0.4733, std.dev.: 0.0019) MultiSource/Applications/treecc/treecc: 3.74% (1.9948 => 2.0695, std.dev.: 0.0194) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.52% (8.6476 => 8.9523, std.dev.: 0.0870) MultiSource/Applications/d/make_dparser: 3.42% (3.2366 => 3.3473, std.dev.: 0.0267) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.38% (0.8716 => 0.9011, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.37% (0.4783 => 0.4944, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.27% (0.5191 => 0.5361, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 3.24% (0.9039 => 0.9332, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.17% (1.1685 => 1.2055, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.05% (0.8712 => 0.8978, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.05% (0.6586 => 0.6787, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.02% (0.8338 => 0.8590, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.95% (0.8656 => 0.8911, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.93% (0.8204 => 0.8444, std.dev.: 0.0047) MultiSource/Applications/lua/lua: 2.92% (3.8189 => 3.9304, std.dev.: 0.0361) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.91% (0.9688 => 0.9970, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.89% (0.8518 => 0.8764, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.87% (1.4479 => 1.4894, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.83% (0.8340 => 0.8576, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.82% (0.8261 => 0.8494, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.82% (0.8697 => 0.8942, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.78% (0.8069 => 0.8293, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.65% (0.8086 => 0.8300, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.60% (0.8611 => 0.8835, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.58% (0.8597 => 0.8819, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.52% (0.8007 => 0.8209, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.48% (0.8316 => 0.8522, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.40% (0.9056 => 0.9273, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.25% (0.7966 => 0.8145, std.dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: 2.12% (15.3280 => 15.6523, std.dev.: 0.0828) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.05% (0.8066 => 0.8231, std.dev.: 0.0051) MultiSource/Applications/lambda-0_1_3/lambda: 1.80% (0.7557 => 0.7693, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: 1.73% (2.3764 => 2.4176, std.dev.: 0.0129) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.66% (1.5795 => 2.5061, std.dev.: 0.0044) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.10% (2.4333 => 2.7035, std.dev.: 0.0889) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.95% (0.3186 => 0.3503, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.50% (1.1857 => 1.2865, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 5.93% (63.1822 => 66.9292, std.dev.: 0.1776) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.70% (0.7597 => 0.7878, std.dev.: 0.0064) MultiSource/Applications/siod/siod: 2.82% (3.6643 => 3.7677, std.dev.: 0.0193) SingleSource/Benchmarks/Shootout-C++/hash: 2.64% (0.6205 => 0.6369, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: 1.85% (2.3560 => 2.3995, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.78% (1.5941 => 1.6225, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.31% (9.9065 => 10.0365, std.dev.: 0.0234) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.70% (0.3269 => 0.3050, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -3.92% (29.8330 => 28.6643, std.dev.: 0.0350) SingleSource/Benchmarks/Shootout-C++/hash2: -1.45% (3.4237 => 3.3740, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.22% (3.3479 => 3.3070, std.dev.: 0.0020) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.78% (16.4461 => 16.5737, std.dev.: 0.2519) MultiSource/Applications/obsequi/Obsequi: 4.60% (1.0262 => 1.0734, std.dev.: 0.0155) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6918.22% (0.3123 => 21.9179, std.dev.: 0.1565) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.26% (0.2463 => 0.3627, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/bigfib: 0.42% (0.6010 => 0.6035, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.22% (0.3266 => 0.3306, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/strcat: 1.42% (0.1969 => 0.1997, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 76.42% (0.0123 => 0.0217, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.68% (0.0408 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.71% (0.0254 => 0.0332, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.38% (0.0384 => 0.0420, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.56% (0.1438 => 0.1446, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.04% (1.1329 => 1.1333, std.dev.: 0.0185) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.97% (0.1462 => 0.1520, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.13% (0.4164 => 0.3992, std.dev.: 0.0186) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.19% (0.1369 => 0.1298, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.18% (0.0641 => 0.0627, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.54% (0.0195 => 0.0276, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.11% (0.0578 => 0.0560, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.47% (1.1437 => 1.1491, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1700.00% (0.0001 => 0.0018, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.03% (0.0627 => 0.0646, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 40.00% (0.0180 => 0.0252, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.04% (0.8017 => 0.8014, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -6.45% (0.0062 => 0.0058, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 30 11:42:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 30 Oct 2012 13:42:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121030184237.BA3A82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5414?compare_to=5411&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5414, Order: 167021, Start Time: 2012-10-30 17:17:32, End Time: 2012-10-30 18:42:36 To: 5411, Order: 167015, Start Time: 2012-10-30 15:29:29, End Time: 2012-10-30 16:54:27 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 0 (176 on baseline) Unchanged Tests: 1041 (861 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.31% (20.0034 => 20.2661, std.dev.: 0.0162) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.26% (15.2527 => 18.3425, std.dev.: 0.0178) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.77% (2.0478 => 2.1045, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/salsa20: 2.49% (7.4937 => 7.6806, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: 1.99% (3.1932 => 3.2567, std.dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.87% (0.1431 => 0.1304, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.40% (0.1584 => 0.1451, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.48% (0.3821 => 0.3535, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -6.66% (0.3831 => 0.3576, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -6.57% (0.3880 => 0.3625, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.57% (0.3884 => 0.3629, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -6.56% (0.3812 => 0.3562, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.55% (0.3891 => 0.3636, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -6.54% (0.4176 => 0.3903, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -6.52% (0.3848 => 0.3597, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: -6.50% (2.4924 => 2.3303, std.dev.: 0.0106) SingleSource/UnitTests/ObjC/for-in: -6.50% (0.4033 => 0.3771, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: -6.44% (0.3896 => 0.3645, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.41% (0.3025 => 0.2831, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.33% (0.3142 => 0.2943, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -6.31% (0.3026 => 0.2835, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.30% (0.2428 => 0.2275, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.30% (22.4056 => 20.9938, std.dev.: 0.0216) SingleSource/UnitTests/ObjC/property: -6.29% (0.4199 => 0.3935, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.28% (2.1713 => 2.0349, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: -6.23% (0.1879 => 0.1762, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.19% (0.4151 => 0.3894, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.18% (0.3057 => 0.2868, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.17% (0.2903 => 0.2724, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -6.14% (0.3194 => 0.2998, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -6.13% (0.3016 => 0.2831, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.12% (0.3837 => 0.3602, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/parameter-passing: -6.12% (0.4280 => 0.4018, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -6.11% (0.2849 => 0.2675, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -6.09% (0.2939 => 0.2760, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.05% (0.3849 => 0.3616, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.03% (0.3252 => 0.3056, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -6.02% (0.3059 => 0.2875, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.99% (0.2871 => 0.2699, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -5.99% (0.3255 => 0.3060, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -5.99% (0.3205 => 0.3013, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.99% (0.3658 => 0.3439, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.97% (0.9542 => 0.8972, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.96% (0.4813 => 0.4526, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -5.96% (1.3148 => 1.2364, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -5.96% (0.2989 => 0.2811, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -5.95% (0.3481 => 0.3274, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.92% (4.5069 => 4.2402, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.88% (0.4083 => 0.3843, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -5.87% (0.2659 => 0.2503, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -5.86% (0.3788 => 0.3566, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: -5.84% (0.4861 => 0.4577, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -5.83% (0.2160 => 0.2034, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -5.80% (0.3621 => 0.3411, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.78% (0.9852 => 0.9283, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -5.76% (7.0961 => 6.6873, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.74% (0.4321 => 0.4073, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: -5.72% (0.3357 => 0.3165, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: -5.70% (0.4248 => 0.4006, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.68% (5.4682 => 5.1578, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/lists1: -5.66% (0.3867 => 0.3648, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.66% (0.6484 => 0.6117, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -5.65% (16.1920 => 15.2764, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/ary3: -5.63% (0.3446 => 0.3252, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary: -5.60% (0.3394 => 0.3204, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.58% (3.5339 => 3.3366, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.58% (0.4427 => 0.4180, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -5.51% (4.3330 => 4.0944, std.dev.: 0.0060) MultiSource/Benchmarks/Bullet/bullet: -5.50% (34.0927 => 32.2189, std.dev.: 0.0190) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.48% (4.8161 => 4.5524, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.46% (0.2548 => 0.2409, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -5.45% (0.6750 => 0.6382, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.45% (1.6474 => 1.5576, std.dev.: 0.0065) MultiSource/Applications/Burg/burg: -5.45% (1.2515 => 1.1833, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.39% (4.0323 => 3.8148, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.39% (0.7919 => 0.7492, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.39% (4.8802 => 4.6171, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.39% (0.3323 => 0.3144, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.37% (0.5999 => 0.5677, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.28% (0.2933 => 0.2778, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.28% (1.0544 => 0.9987, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.28% (1.2784 => 1.2109, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.28% (1.2221 => 1.1576, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.27% (0.3931 => 0.3724, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.23% (1.2210 => 1.1572, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -5.22% (0.7779 => 0.7373, std.dev.: 0.0045) SingleSource/UnitTests/ObjC++/Hello: -5.20% (0.6347 => 0.6017, std.dev.: 0.0009) MultiSource/Applications/siod/siod: -5.20% (2.4021 => 2.2773, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/bh/bh: -5.06% (0.2985 => 0.2834, std.dev.: 0.0007) MultiSource/Applications/lua/lua: -5.03% (4.0594 => 3.8553, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.02% (0.6293 => 0.5977, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: -5.01% (0.6441 => 0.6118, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.01% (0.3491 => 0.3316, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.99% (0.7198 => 0.6839, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.98% (0.8521 => 0.8097, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: -4.96% (18.2933 => 17.3855, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash: -4.93% (0.4524 => 0.4301, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -4.93% (0.2355 => 0.2239, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -4.91% (9.2283 => 8.7750, std.dev.: 0.0140) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -4.88% (1.6364 => 1.5565, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.83% (2.2587 => 2.1495, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.83% (0.2278 => 0.2168, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.80% (0.2999 => 0.2855, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.79% (1.4642 => 1.3941, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.78% (0.9557 => 0.9100, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.76% (1.3722 => 1.3069, std.dev.: 0.0095) MultiSource/Applications/lambda-0_1_3/lambda: -4.75% (0.7982 => 0.7603, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.69% (0.5925 => 0.5647, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.64% (0.3319 => 0.3165, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/18-imp/imp: -4.61% (0.3581 => 0.3416, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.58% (0.6052 => 0.5775, std.dev.: 0.0083) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.58% (0.4916 => 0.4691, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.55% (0.6681 => 0.6377, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.55% (0.5478 => 0.5229, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.53% (0.5591 => 0.5338, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.50% (0.5575 => 0.5324, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.50% (0.5802 => 0.5541, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.50% (0.5581 => 0.5330, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.49% (0.5859 => 0.5596, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -4.47% (0.4515 => 0.4313, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.46% (0.5805 => 0.5546, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.45% (0.6667 => 0.6370, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.43% (0.7339 => 0.7014, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.43% (0.6304 => 0.6025, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.42% (0.5863 => 0.5604, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.41% (0.6297 => 0.6019, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.41% (0.6230 => 0.5955, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.40% (0.6660 => 0.6367, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.40% (0.5456 => 0.5216, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.39% (0.6676 => 0.6383, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.38% (0.6194 => 0.5923, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.36% (0.5705 => 0.5456, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.36% (0.5570 => 0.5327, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.36% (0.6260 => 0.5987, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.36% (0.5941 => 0.5682, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.35% (0.5857 => 0.5602, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.35% (0.6395 => 0.6117, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.33% (0.5849 => 0.5596, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: -4.32% (0.7447 => 0.7125, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.32% (0.2385 => 0.2282, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.30% (0.6189 => 0.5923, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.29% (0.5569 => 0.5330, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.28% (0.6446 => 0.6170, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.27% (0.7524 => 0.7203, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.26% (0.6033 => 0.5776, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.18% (0.6395 => 0.6128, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: -4.13% (0.3271 => 0.3136, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: -4.10% (0.8418 => 0.8073, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.08% (0.6440 => 0.6177, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.08% (0.3406 => 0.3267, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: -4.03% (0.9179 => 0.8809, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.02% (0.5567 => 0.5343, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.02% (8.0126 => 7.6903, std.dev.: 0.0014) MultiSource/Applications/treecc/treecc: -4.00% (2.1401 => 2.0544, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.99% (0.7021 => 0.6741, std.dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: -3.99% (15.5079 => 14.8898, std.dev.: 0.0124) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.98% (6.7716 => 6.5020, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -3.97% (0.5688 => 0.5462, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: -3.97% (1.1450 => 1.0996, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.83% (0.6736 => 0.6478, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: -3.73% (1.5610 => 1.5028, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.70% (0.3483 => 0.3354, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -3.68% (17.1032 => 16.4741, std.dev.: 0.0094) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.65% (0.9077 => 0.8746, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.62% (0.5168 => 0.4981, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.48% (1.2300 => 1.1872, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: -3.47% (3.5154 => 3.3935, std.dev.: 0.0106) MultiSource/Benchmarks/nbench/nbench: -3.38% (1.1530 => 1.1140, std.dev.: 0.0130) MultiSource/Applications/oggenc/oggenc: -3.33% (5.0226 => 4.8552, std.dev.: 0.0162) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.21% (0.5329 => 0.5158, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.92% (14.2083 => 13.7931, std.dev.: 0.0039) SingleSource/UnitTests/Vector/constpool: -2.45% (20.7746 => 20.2661, std.dev.: 0.0162) MultiSource/Applications/SIBsim4/SIBsim4: -1.72% (1.3864 => 1.3626, std.dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7555, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -8.61% (1.2842 => 1.1736, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/fbench: -3.95% (2.2633 => 2.1739, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.92% (1.7753 => 1.7057, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4684, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0003) Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 30 12:39:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 30 Oct 2012 14:39:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121030193941.8A8DA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5415?compare_to=5408&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5415, Order: 167016, Start Time: 2012-10-30 16:24:02, End Time: 2012-10-30 19:39:40 To: 5408, Order: 167011, Start Time: 2012-10-30 12:19:09, End Time: 2012-10-30 15:35:21 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (173 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1042 (715 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 39.84% (0.0625 => 0.0874, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.33% (0.1063 => 0.1396, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.87% (0.2969 => 0.3737, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.32% (0.1106 => 0.1386, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.23% (0.0714 => 0.0887, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.09% (0.4139 => 0.5136, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 23.71% (1.5932 => 1.9709, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 23.67% (0.0452 => 0.0559) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.28% (0.4253 => 0.5243, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.21% (0.4994 => 0.6153, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.80% (0.5900 => 0.7245, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.67% (0.0547 => 0.0671, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.53% (0.0475 => 0.0582, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.46% (0.5000 => 0.6123, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.09% (0.0584 => 0.0713, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.52% (0.0897 => 0.1090, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 21.37% (0.0599 => 0.0727, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.23% (0.1620 => 0.1964, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.06% (0.1021 => 0.1236, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 20.60% (0.1107 => 0.1335, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/04-bisect/bisect: 19.91% (0.0633 => 0.0759, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 19.87% (0.0604 => 0.0724, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 19.83% (0.0948 => 0.1136, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.78% (0.0642 => 0.0769, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.78% (0.0541 => 0.0648, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.69% (0.1549 => 0.1854, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.63% (0.3903 => 0.4669, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.58% (0.1103 => 0.1319, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.52% (0.0584 => 0.0698, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.39% (0.1604 => 0.1915, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 19.15% (0.1619 => 0.1929, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.14% (0.1003 => 0.1195, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/health/health: 19.12% (0.0821 => 0.0978, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.98% (0.0822 => 0.0978, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.74% (0.1462 => 0.1736, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 18.36% (0.0561 => 0.0664, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 18.19% (0.0808 => 0.0955, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 18.16% (0.0947 => 0.1119, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.02% (0.2736 => 0.3229, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.84% (0.3890 => 0.4584, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 17.56% (0.0581 => 0.0683, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 17.41% (0.1218 => 0.1430, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.33% (0.2014 => 0.2363, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.27% (1.3152 => 1.5423, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 17.08% (0.1505 => 0.1762, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.00% (0.1088 => 0.1273, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 17.00% (0.4029 => 0.4714, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/mst/mst: 16.91% (0.0698 => 0.0816, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 16.86% (0.5889 => 0.6882, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 16.82% (0.5826 => 0.6806, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.71% (0.2866 => 0.3345, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 16.69% (0.9697 => 1.1315, std.dev.: 0.0045) MultiSource/Applications/Burg/burg: 16.61% (0.5546 => 0.6467, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 16.57% (1.8794 => 2.1908, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.27% (3.5627 => 4.1422, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.22% (0.5026 => 0.5841, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.21% (0.1160 => 0.1348, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.10% (0.4658 => 0.5408, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.06% (0.1968 => 0.2284, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.00% (0.2875 => 0.3335, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 15.98% (1.6211 => 1.8802, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.74% (0.3271 => 0.3786, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/18-imp/imp: 15.55% (0.1421 => 0.1642, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.41% (0.4361 => 0.5033, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 15.30% (0.2725 => 0.3142, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 15.29% (0.2714 => 0.3129, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 15.22% (1.0781 => 1.2422, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.16% (0.2738 => 0.3153, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.10% (0.2729 => 0.3141, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 15.08% (0.3004 => 0.3457, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.00% (0.3060 => 0.3519, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.99% (0.3930 => 0.4519, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/strcat: 14.98% (0.2750 => 0.3162, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.98% (0.2911 => 0.3347, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 14.95% (0.2823 => 0.3245, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 14.95% (4.4195 => 5.0800, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: 14.93% (0.2780 => 0.3195, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.90% (0.3195 => 0.3671, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 14.90% (0.2813 => 0.3232, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 14.88% (0.1284 => 0.1475, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 14.84% (0.2803 => 0.3219, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.84% (2.0673 => 2.3741, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 14.83% (0.9909 => 1.1379, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 14.83% (0.3096 => 0.3555, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.79% (0.2792 => 0.3205, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.77% (1.9694 => 2.2602, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/except: 14.73% (0.2811 => 0.3225, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.71% (2.7292 => 3.1307, std.dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: 14.64% (4.2109 => 4.8272, std.dev.: 0.0068) SingleSource/UnitTests/ObjC++/property-reference: 14.59% (0.7171 => 0.8217, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.40% (0.1090 => 0.1247, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.38% (1.9966 => 2.2838, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.35% (0.3282 => 0.3753, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary3: 14.33% (0.3267 => 0.3735, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 14.32% (23.5202 => 26.8876, std.dev.: 0.0223) SingleSource/Benchmarks/Shootout-C++/ary: 14.24% (0.3258 => 0.3722, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.13% (0.3362 => 0.3837, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 14.05% (0.3317 => 0.3783, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.73% (0.3124 => 0.3553, std.dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 13.72% (0.2566 => 0.2918, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 13.65% (0.4146 => 0.4712, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 13.59% (0.2075 => 0.2357, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 13.51% (0.3678 => 0.4175, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.47% (0.3845 => 0.4363, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: 13.47% (0.3348 => 0.3799, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 13.37% (0.3726 => 0.4224, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 13.34% (0.3477 => 0.3941, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 13.32% (1.4269 => 1.6170, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.30% (0.3625 => 0.4107, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 13.22% (0.3465 => 0.3923, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.06% (0.3690 => 0.4172, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 13.01% (0.4251 => 0.4804, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.99% (0.3981 => 0.4498, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions-2: 12.86% (0.3446 => 0.3889, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 12.84% (0.3442 => 0.3884, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 12.84% (0.7875 => 0.8886, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.76% (0.3488 => 0.3933, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 12.75% (0.3460 => 0.3901, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.74% (0.3469 => 0.3911, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 12.73% (0.3496 => 0.3941, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 12.72% (2.1653 => 2.4408, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/property: 12.44% (0.3650 => 0.4104, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 12.41% (0.3643 => 0.4095, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.41% (0.3724 => 0.4186, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 12.37% (4.6177 => 5.1890, std.dev.: 0.0121) SingleSource/Benchmarks/Misc-C++/bigfib: 12.37% (0.5012 => 0.5632, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 12.04% (2.1013 => 2.3542, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.91% (0.2040 => 0.2283, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.79% (0.1383 => 0.1546, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 11.37% (0.2691 => 0.2997, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.31% (0.6435 => 0.7163, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 10.92% (0.3498 => 0.3880, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 10.82% (5.5417 => 6.1414, std.dev.: 0.0123) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.80% (0.1028 => 0.1139, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 10.13% (0.4847 => 0.5338, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.12% (0.2737 => 0.3014) MultiSource/Applications/siod/siod: 10.10% (0.6634 => 0.7304, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.05% (0.3084 => 0.3394, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.91% (0.2068 => 0.2273, std.dev.: 0.0017) MultiSource/Applications/minisat/minisat: 9.86% (0.3336 => 0.3665, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.37% (0.2103 => 0.2300, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 9.03% (2.0346 => 2.2183, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.88% (4.6926 => 5.1093, std.dev.: 0.0050) MultiSource/Applications/lemon/lemon: 8.57% (0.2391 => 0.2596, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.40% (11.6398 => 12.6172, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.91% (0.5361 => 0.5785, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.40% (0.5584 => 0.5997, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.24% (0.7426 => 0.7964, std.dev.: 0.0041) MultiSource/Applications/kimwitu++/kc: 6.10% (11.9555 => 12.6853, std.dev.: 0.0083) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.48% (0.3792 => 0.3924, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.37% (0.2162 => 0.3532) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6536, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 8.82% (0.2802 => 0.3049, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6113, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.08% (0.2122 => 0.2251, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/objinst: 5.09% (12.0509 => 12.6637, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 4.74% (15.4430 => 16.1753, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-2: 3.78% (1.8057 => 1.8739, std.dev.: 0.0048) SingleSource/Benchmarks/Dhrystone/dry: 2.73% (14.0481 => 14.4319, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1926, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.74% (3.1722 => 3.2275, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3029, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2857, std.dev.: 0.0031) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.26% (1.0142 => 1.0270) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5139, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 1.15% (28.0362 => 28.3585, std.dev.: 0.1076) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5881, std.dev.: 0.0184) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.41% (2.4764 => 2.4167, std.dev.: 0.0188) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.53% (25.4195 => 16.3886, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/ary2: -8.37% (0.2402 => 0.2201, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9765, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: -7.69% (35.5013 => 32.7727, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9586, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2420, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -3.45% (11.2080 => 10.8211, std.dev.: 0.0593) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7746, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -2.87% (3.6262 => 3.5221, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.83% (0.6293 => 0.6115, std.dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/fldry: -2.75% (17.2379 => 16.7641, std.dev.: 0.0375) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.16% (41.7953 => 40.8911, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5739, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.54% (21.9346 => 21.5977, std.dev.: 0.1223) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4962, std.dev.: 0.0087) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (105.3826 => 104.1590, std.dev.: 0.0651) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0429, std.dev.: 0.0024) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.05% (3.3991 => 3.3633, std.dev.: 0.0046) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 30 12:43:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 30 Oct 2012 14:43:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121030194336.E99072A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5416?compare_to=5412&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5416, Order: 167027, Start Time: 2012-10-30 18:10:22, End Time: 2012-10-30 19:43:33 To: 5412, Order: 167016, Start Time: 2012-10-30 16:05:55, End Time: 2012-10-30 17:38:55 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 3 (174 on baseline) Performance Improvements: 1 (54 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 2 (2 on baseline) Unchanged Tests: 1036 (661 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.61% (9.8457 => 10.1026, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.67% (55.0180 => 56.4844, std.dev.: 0.0970) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.20% (78.9383 => 79.8871, std.dev.: 0.2207) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: -1.83% (3.7741 => 3.7049, std.dev.: 0.0194) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: - (0.1406 => 0.1406, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0647 => 0.0647, std.dev.: 0.0011) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 198.28% (0.5229 => 1.5597, std.dev.: 0.0058) MultiSource/Applications/SPASS/SPASS: 13.63% (14.9895 => 17.0329, std.dev.: 0.0066) MultiSource/Applications/kimwitu++/kc: 36.01% (14.1553 => 19.2525, std.dev.: 0.0103) MultiSource/Benchmarks/MallocBench/gs/gs: 12.63% (4.1105 => 4.6297, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 29.52% (1.1048 => 1.4309, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 305.94% (7.1582 => 29.0579, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.53% (3.4629 => 5.8013, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 63.98% (0.6222 => 1.0203, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10538.47% (0.0720 => 7.6597, std.dev.: 0.0059) MultiSource/Applications/SIBsim4/SIBsim4: 3836100.00% (0.0001 => 3.8362, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 11181900.00% (0.0001 => 11.1820, std.dev.: 0.0252) MultiSource/Applications/kimwitu++/kc: 50900.00% (0.0001 => 0.0510, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 779500.00% (0.0001 => 0.7796, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050200.00% (0.0001 => 10.0503, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5490800.00% (0.0001 => 5.4909, std.dev.: 0.0010) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 38.64% (0.1056 => 0.1464, std.dev.: 0.0010) SingleSource/UnitTests/vla: 29.01% (0.0355 => 0.0458, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 28.14% (0.1432 => 0.1835, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 19.99% (0.1566 => 0.1879, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.82% (0.0834 => 0.0991, std.dev.: 0.0019) SingleSource/UnitTests/SignlessTypes/rem: 17.48% (0.1144 => 0.1344, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 17.26% (0.0730 => 0.0856, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 17.02% (0.0746 => 0.0873, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.99% (0.0871 => 0.1019, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 16.87% (0.3177 => 0.3713, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 16.77% (0.1175 => 0.1372, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.65% (0.0793 => 0.0925, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 16.48% (0.4879 => 0.5683, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.46% (0.8172 => 0.9517, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.42% (0.0798 => 0.0929, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 16.16% (0.1584 => 0.1840, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 15.97% (0.2554 => 0.2962, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 15.38% (0.1125 => 0.1298, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 15.11% (0.1655 => 0.1905, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.08% (0.0842 => 0.0969, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/mst/mst: 14.96% (0.1163 => 0.1337, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 14.87% (0.1695 => 0.1947, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.67% (0.2065 => 0.2368, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.67% (0.0886 => 0.1016, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.07% (0.2700 => 0.3080, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 14.04% (0.7115 => 0.8114, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 13.95% (0.1555 => 0.1772, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 13.91% (0.5105 => 0.5815, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.90% (0.0770 => 0.0877, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.89% (0.2758 => 0.3141, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.88% (0.1117 => 0.1272, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 13.66% (0.1940 => 0.2205, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.61% (0.1337 => 0.1519, std.dev.: 0.0018) MultiSource/Applications/aha/aha: 13.55% (0.1151 => 0.1307, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 13.53% (22.1758 => 25.1771, std.dev.: 0.0160) MultiSource/Applications/spiff/spiff: 13.53% (0.7835 => 0.8895, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.51% (0.1510 => 0.1714, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 13.40% (3.3354 => 3.7822, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.36% (0.5981 => 0.6780, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.31% (0.1029 => 0.1166, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.25% (0.0770 => 0.0872, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.23% (0.6675 => 0.7558, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.19% (0.2107 => 0.2385, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.17% (0.2271 => 0.2570, std.dev.: 0.0029) MultiSource/Applications/sgefa/sgefa: 13.16% (0.3109 => 0.3518, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.09% (0.1062 => 0.1201, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.05% (1.5415 => 1.7426, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.94% (0.9765 => 1.1029, std.dev.: 0.0035) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.91% (0.3121 => 0.3524, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.89% (0.4615 => 0.5210, std.dev.: 0.0016) MultiSource/Applications/Burg/burg: 12.82% (1.1642 => 1.3135, std.dev.: 0.0084) MultiSource/Applications/lambda-0_1_3/lambda: 12.78% (0.7433 => 0.8383, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.70% (0.5860 => 0.6604, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/trivial-interface: 12.41% (0.3473 => 0.3904, std.dev.: 0.0034) SingleSource/Benchmarks/McGill/exptree: 12.41% (0.0814 => 0.0915, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.27% (0.5020 => 0.5636, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 12.21% (0.3497 => 0.3924, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.20% (0.3927 => 0.4406, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 12.18% (2.0273 => 2.2743, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 12.17% (0.3516 => 0.3944, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.16% (0.3543 => 0.3974, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 12.15% (3.8723 => 4.3427, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 12.15% (0.1268 => 0.1422, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.14% (0.5569 => 0.6245, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-4: 12.14% (0.3543 => 0.3973, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 12.10% (0.3561 => 0.3992, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.07% (0.1143 => 0.1281, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.06% (0.1236 => 0.1385, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.05% (1.3050 => 1.4622, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.02% (0.2603 => 0.2916, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 12.02% (0.3828 => 0.4288, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.02% (0.1032 => 0.1156, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.88% (0.3694 => 0.4133, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.76% (0.3307 => 0.3696, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 11.75% (1.0722 => 1.1982, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/property: 11.66% (0.3886 => 0.4339, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.58% (0.6450 => 0.7197, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.52% (1.1861 => 1.3227, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 11.48% (0.3423 => 0.3816, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.45% (0.3441 => 0.3835, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.45% (0.1625 => 0.1811, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 11.40% (0.4299 => 0.4789, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.31% (0.1892 => 0.2106, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.19% (0.0929 => 0.1033, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.18% (0.1906 => 0.2119, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.10% (4.2646 => 4.7378, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/football/football: 11.09% (0.8921 => 0.9910, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/neural/neural: 11.07% (0.1463 => 0.1625, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 11.03% (8.1363 => 9.0340, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/hash: 10.84% (0.4289 => 0.4754, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.78% (2.2022 => 2.4397, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 10.69% (0.3180 => 0.3520, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.62% (0.1695 => 0.1875, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 10.44% (9.4845 => 10.4743, std.dev.: 0.0103) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.41% (0.8101 => 0.8944, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 10.37% (1.1840 => 1.3068, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 10.36% (0.3387 => 0.3738, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.31% (0.4636 => 0.5114, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.25% (1.5859 => 1.7484, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 10.10% (0.6456 => 0.7108, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.88% (2.2024 => 2.4201, std.dev.: 0.0056) SingleSource/UnitTests/ObjC++/property-reference-object: 9.87% (0.6030 => 0.6625, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 9.87% (0.1044 => 0.1147, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.80% (0.4203 => 0.4615, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 9.80% (2.2969 => 2.5220, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/Hello: 9.72% (0.5925 => 0.6501, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.70% (0.3865 => 0.4240, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 9.70% (0.4620 => 0.5068, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 9.67% (0.3422 => 0.3753, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.58% (0.7326 => 0.8028, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.57% (14.3668 => 15.7423, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.53% (1.4186 => 1.5538, std.dev.: 0.0068) MultiSource/Applications/oggenc/oggenc: 9.30% (5.7591 => 6.2947, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/lists1: 9.12% (0.3684 => 0.4020, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.12% (0.4103 => 0.4477, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/moments: 9.07% (0.4048 => 0.4415, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.04% (4.9449 => 5.3921, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.00% (5.0018 => 5.4520, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sieve: 8.96% (0.3603 => 0.3926, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.95% (0.1330 => 0.1449, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.92% (0.2793 => 0.3042, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 8.81% (0.2905 => 0.3161, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.64% (0.2756 => 0.2994, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 8.62% (1.5603 => 1.6948, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/fibo: 8.51% (0.2725 => 0.2957, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.44% (0.3650 => 0.3958, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.37% (0.2891 => 0.3133, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.35% (0.2430 => 0.2633, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 8.33% (0.2714 => 0.2940, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 8.19% (0.2831 => 0.3063, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 8.06% (0.2877 => 0.3109, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.06% (2.0665 => 2.2331, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.97% (0.3162 => 0.3414, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 7.97% (0.1268 => 0.1369, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.95% (0.3283 => 0.3544, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.89% (0.3826 => 0.4128, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 7.84% (0.3098 => 0.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 7.80% (0.3232 => 0.3484, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.79% (0.3427 => 0.3694, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 7.73% (17.1811 => 18.5094, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.73% (0.4064 => 0.4378, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 7.70% (0.2871 => 0.3092, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.66% (0.2872 => 0.3092, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 7.54% (0.3052 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 7.42% (0.2802 => 0.3010, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 7.25% (0.3379 => 0.3624, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 6.64% (1.2842 => 1.3695, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/oourafft: 6.52% (0.3282 => 0.3496, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.95% (0.8067 => 0.8547, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: 5.85% (0.3092 => 0.3273, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.69% (0.3131 => 0.3309, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.51% (3.8922 => 4.1067, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.12% (0.2266 => 0.2382, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.51% (0.3817 => 0.3989, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.79% (0.3935 => 0.4084, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.14% (7.9617 => 8.1324, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.23% (7.0540 => 7.1406, std.dev.: 0.0101) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.54% (1.1145 => 1.2988, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.51% (0.2944 => 0.3283, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.32% (2.8904 => 3.2177, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.88% (1.1396 => 1.2522, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.68% (3.1578 => 3.3687, std.dev.: 0.0025) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.69% (4.2280 => 4.3416, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7653, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.30% (1.0313 => 1.0550, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bisort/bisort: 1.90% (0.8333 => 0.8491, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2079, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.32% (11.6436 => 11.7971, std.dev.: 0.0065) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.95% (6.6874 => 0.1373, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: -76.87% (0.8651 => 0.2001, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.47% (5.3855 => 2.3982, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -55.18% (5.3526 => 2.3991, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/richards_benchmark: -45.81% (0.1622 => 0.0879, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.33% (1.1194 => 0.6791, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.10% (5.2763 => 3.2662, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -24.53% (1.7609 => 1.3289, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -16.96% (2.9384 => 2.4400, std.dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: -10.36% (10.4361 => 9.3548, std.dev.: 0.0147) MultiSource/Benchmarks/Bullet/bullet: -10.32% (63.2438 => 56.7198, std.dev.: 0.0178) SingleSource/UnitTests/Vector/constpool: -9.20% (54.1659 => 49.1818, std.dev.: 0.0398) MultiSource/Benchmarks/PAQ8p/paq8p: -2.55% (10.3673 => 10.1026, std.dev.: 0.0054) MultiSource/Applications/JM/lencod/lencod: -2.25% (21.9371 => 21.4442, std.dev.: 0.0248) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -33.99% (0.0506 => 0.0334, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -33.68% (0.3987 => 0.2644) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7652, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -29.12% (10.7105 => 7.5915, std.dev.: 0.0138) SingleSource/Benchmarks/Misc/flops-6: -15.94% (1.6925 => 1.4228, std.dev.: 0.0041) MultiSource/Benchmarks/NPB-serial/is/is: -10.98% (9.5636 => 8.5132, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -10.78% (1.5373 => 1.3716, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.32% (19.9488 => 18.2899, std.dev.: 0.1295) MultiSource/Benchmarks/FreeBench/mason/mason: -7.77% (0.2161 => 0.1993, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.10% (1.8329 => 1.7028, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -6.56% (1.2373 => 1.1561, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -5.45% (6.6465 => 6.2842, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.08% (1.6805 => 1.5951, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5071, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.04% (0.2497 => 0.2396, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.70% (3.2827 => 3.1612, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.50% (32.5116 => 31.3733, std.dev.: 0.0107) MultiSource/Benchmarks/sim/sim: -3.24% (5.0483 => 4.8849, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.23% (0.9957 => 0.9635, std.dev.: 0.0077) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.80% (4.5009 => 4.3750, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.77% (0.4808 => 0.4675, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -2.74% (4.6441 => 4.5167, std.dev.: 0.0020) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.86% (8.1563 => 8.0045, std.dev.: 0.0155) SingleSource/Benchmarks/Misc/salsa20: -1.81% (10.2830 => 10.0968, std.dev.: 0.0391) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6787, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/power/power: -1.61% (1.1277 => 1.1095, std.dev.: 0.0009) SingleSource/UnitTests/Vector/multiplies: -1.56% (2.5528 => 2.5129, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -1.20% (85.0658 => 84.0487, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/lists: -1.20% (6.2999 => 6.2246, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8592, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -5.32% (0.1485 => 0.1406, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.42% (0.2116 => 0.0647, std.dev.: 0.0011) Report Time: 4.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 30 13:17:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 30 Oct 2012 15:17:19 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121030201719.010182A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5417?compare_to=5413&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5417, Order: 167032, Start Time: 2012-10-30 18:47:53, End Time: 2012-10-30 20:17:20 To: 5413, Order: 167021, Start Time: 2012-10-30 17:01:59, End Time: 2012-10-30 18:30:10 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 20 (82 on baseline) Performance Improvements: 4 (4 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 967 (888 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/bh/bh: 3.77% (0.3051 => 0.3166, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.48% (3.2495 => 3.3626, std.dev.: 0.0323) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.19% (0.9701 => 1.0010, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/football/football: 2.97% (0.8999 => 0.9266, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.35% (0.9007 => 0.9219, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.23% (5.3110 => 5.4297, std.dev.: 0.0181) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.00% (0.5361 => 0.5468, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.55% (0.9094 => 0.9235, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.41% (0.8231 => 0.8347, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.29% (0.8835 => 0.8949, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.17% (4.6394 => 4.6938, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.09% (0.9273 => 0.9374, std.dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 15.45% (3.7118 => 4.2854, std.dev.: 0.0381) SingleSource/Benchmarks/Shootout/heapsort: 14.68% (3.1028 => 3.5583, std.dev.: 0.1121) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.06% (3.3656 => 3.8389, std.dev.: 0.0409) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.62% (2.6729 => 2.7697, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.20% (58.7361 => 60.6157, std.dev.: 0.5659) SingleSource/Benchmarks/Shootout-C++/ary3: 2.85% (2.0031 => 2.0601, std.dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: 1.45% (7.1915 => 7.2959, std.dev.: 0.0398) SingleSource/Benchmarks/Misc/flops-3: 1.17% (2.0428 => 2.0668, std.dev.: 0.0091) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -2.04% (0.9199 => 0.9011, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.23% (1.2978 => 1.2818, std.dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.52% (1.4308 => 1.4091, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.36% (1.6225 => 1.6004, std.dev.: 0.0038) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.17% (16.5737 => 16.6024, std.dev.: 0.2587) MultiSource/Applications/obsequi/Obsequi: -0.73% (1.0734 => 1.0656, std.dev.: 0.0308) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.38% (21.9179 => 22.2204, std.dev.: 0.2971) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.16% (0.3627 => 0.3669, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 2.12% (0.6035 => 0.6163, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.03% (0.3306 => 0.3373, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/strcat: 0.45% (0.1997 => 0.2006, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0217 => 0.0217, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.71% (0.0423 => 0.0426, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.60% (0.0332 => 0.0330, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.96% (0.0312 => 0.0315, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.71% (0.0420 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0202 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -0.91% (0.0219 => 0.0217, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 1.94% (0.1446 => 0.1474, std.dev.: 0.0027) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.99% (1.1333 => 1.1559, std.dev.: 0.0194) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.13% (0.1520 => 0.1522, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.91% (0.3992 => 0.4108, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.32% (0.1298 => 0.1393, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.51% (0.0627 => 0.0649, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.90% (0.0276 => 0.0268, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.43% (0.0560 => 0.0552, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.08% (1.1491 => 1.1500, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 27.78% (0.0018 => 0.0023, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 3.85% (0.0026 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.08% (0.0646 => 0.0653, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.14% (0.0252 => 0.0234, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.09% (0.8014 => 0.8007, std.dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -22.41% (0.0058 => 0.0045, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2329.39% (0.6332 => 15.3829, std.dev.: 0.4409) MultiSource/Benchmarks/McCat/08-main/main: 48.12% (0.1831 => 0.2712, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.90% (0.1559 => 0.1467, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1523.71% (0.3344 => 5.4297, std.dev.: 0.0181) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.61% (0.2364 => 0.3253, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/mandel: 3.03% (0.0429 => 0.0442, std.dev.: 0.0010) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.02% (0.0224 => 0.0233, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -26.09% (0.0230 => 0.0170, std.dev.: 0.0025) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4398, std.dev.: 0.0458) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0735, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4952, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3567, std.dev.: 0.0279) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0435, std.dev.: 0.0122) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4034, std.dev.: 0.0082) SingleSource/Regression/C/uint64_to_float: -23.85% (2.1832 => 1.6624, std.dev.: 0.0278) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 36.13% (14.7684 => 20.1043, std.dev.: 0.2303) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.27% (0.0810 => 0.0958, std.dev.: 0.0013) SingleSource/UnitTests/SignlessTypes/rem: 15.56% (0.1035 => 0.1196, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.65% (0.0830 => 0.0935, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.95% (0.2180 => 0.2397, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.18% (0.6010 => 0.6562, std.dev.: 0.0070) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.85% (0.8321 => 0.9057, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.03% (0.4847 => 0.5236, std.dev.: 0.0051) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.65% (0.3137 => 0.3377, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.37% (0.2279 => 0.2447, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.23% (0.1466 => 0.1572, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.68% (0.7473 => 0.7972, std.dev.: 0.0042) MultiSource/Applications/SIBsim4/SIBsim4: 6.63% (1.2568 => 1.3401, std.dev.: 0.0187) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.60% (0.6287 => 0.6702, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.47% (13.1811 => 14.0335, std.dev.: 0.0347) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.09% (0.9435 => 1.0010, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/bh/bh: 6.06% (0.2985 => 0.3166, std.dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 6.02% (1.1271 => 1.1950, std.dev.: 0.0124) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.91% (6.6074 => 6.9976, std.dev.: 0.0397) MultiSource/Benchmarks/Prolangs-C/football/football: 5.68% (0.8768 => 0.9266, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.65% (0.2741 => 0.2896, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.64% (3.1832 => 3.3626, std.dev.: 0.0323) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.45% (0.8148 => 0.8592, std.dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.34% (0.5191 => 0.5468, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.91% (1.6386 => 1.7191, std.dev.: 0.0018) MultiSource/Applications/hbd/hbd: 4.84% (1.4269 => 1.4960, std.dev.: 0.0120) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.83% (1.1606 => 1.2167, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.78% (0.6586 => 0.6901, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.72% (0.4127 => 0.4322, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.65% (1.3279 => 1.3897, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.53% (0.3003 => 0.3139, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.28% (0.4559 => 0.4754, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 4.11% (0.8855 => 0.9219, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 3.94% (0.8885 => 0.9235, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.93% (0.8611 => 0.8949, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.92% (8.6476 => 8.9869, std.dev.: 0.0383) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.92% (1.5315 => 1.5915, std.dev.: 0.0202) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.78% (0.5817 => 0.6037, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.76% (0.3115 => 0.3232, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.70% (0.2998 => 0.3109, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.65% (0.8716 => 0.9034, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.58% (0.8597 => 0.8905, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.51% (0.9056 => 0.9374, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 3.48% (0.8066 => 0.8347, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.39% (0.8338 => 0.8621, std.dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 3.39% (8.6247 => 8.9170, std.dev.: 0.0247) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 3.32% (0.9688 => 1.0010, std.dev.: 0.0091) MultiSource/Benchmarks/MallocBench/gs/gs: 3.28% (4.1305 => 4.2658, std.dev.: 0.0447) SingleSource/Benchmarks/Shootout-C++/hash2: 3.25% (0.4125 => 0.4259, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.15% (0.8316 => 0.8578, std.dev.: 0.0063) MultiSource/Applications/JM/ldecod/ldecod: 3.01% (6.7320 => 6.9349, std.dev.: 0.0422) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.94% (0.8204 => 0.8445, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.90% (4.1763 => 4.2973, std.dev.: 0.0203) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.70% (4.5702 => 4.6938, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.70% (4.4873 => 4.6086, std.dev.: 0.0127) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.57% (0.8340 => 0.8554, std.dev.: 0.0075) MultiSource/Benchmarks/Bullet/bullet: 2.50% (31.8598 => 32.6574, std.dev.: 0.0446) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.34% (0.7932 => 0.8118, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.34% (0.8805 => 0.9011, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.33% (1.2526 => 1.2818, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.28% (0.8656 => 0.8853, std.dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: 2.22% (15.3280 => 15.6686, std.dev.: 0.1075) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.04% (0.8177 => 0.8344, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.74% (1.2423 => 1.2639, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.36% (1.5795 => 2.5013, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/heapsort: 25.80% (3.0515 => 3.8389, std.dev.: 0.0409) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.58% (0.3186 => 0.3523, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.54% (2.4333 => 2.6897, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.35% (3.9188 => 4.2854, std.dev.: 0.0381) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.60% (1.1857 => 1.2877, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 6.00% (63.1822 => 66.9739, std.dev.: 0.0417) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 5.36% (2.2485 => 2.3690, std.dev.: 0.0340) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.39% (4.5547 => 4.7545, std.dev.: 0.0738) SingleSource/Benchmarks/Misc/ReedSolomon: 3.15% (8.5322 => 8.8006, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 3.01% (1.9999 => 2.0601, std.dev.: 0.0026) MultiSource/Applications/siod/siod: 2.93% (3.6643 => 3.7717, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/hash: 2.61% (0.6205 => 0.6367, std.dev.: 0.0030) MultiSource/Benchmarks/Bullet/bullet: 2.50% (7.1181 => 7.2959, std.dev.: 0.0398) SingleSource/Benchmarks/Misc/richards_benchmark: 1.39% (1.3037 => 1.3218, std.dev.: 0.0020) MultiSource/Benchmarks/llubenchmark/llu: 1.28% (1.9967 => 2.0222, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/flops-6: 1.11% (2.4416 => 2.4688, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-4: 1.06% (1.6531 => 1.6707, std.dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.97% (0.3269 => 0.3041, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -5.25% (29.8330 => 28.2654, std.dev.: 0.2621) SingleSource/Benchmarks/Shootout-C++/hash2: -1.42% (3.4237 => 3.3750, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.21% (3.3479 => 3.3074, std.dev.: 0.0058) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.95% (16.4461 => 16.6024, std.dev.: 0.2587) MultiSource/Applications/obsequi/Obsequi: 3.84% (1.0262 => 1.0656, std.dev.: 0.0308) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7015.08% (0.3123 => 22.2204, std.dev.: 0.2971) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.96% (0.2463 => 0.3669, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 2.55% (0.6010 => 0.6163, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.28% (0.3266 => 0.3373, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/strcat: 1.88% (0.1969 => 0.2006, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 76.42% (0.0123 => 0.0217, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 2.50% (0.1438 => 0.1474, std.dev.: 0.0027) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.03% (1.1329 => 1.1559, std.dev.: 0.0194) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 4.10% (0.1462 => 0.1522, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.34% (0.4164 => 0.4108, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.75% (0.1369 => 0.1393, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.25% (0.0641 => 0.0649, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 37.44% (0.0195 => 0.0268, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.50% (0.0578 => 0.0552, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.55% (1.1437 => 1.1500, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2200.00% (0.0001 => 0.0023, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.15% (0.0627 => 0.0653, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 30.00% (0.0180 => 0.0234, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.12% (0.8017 => 0.8007, std.dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -27.42% (0.0062 => 0.0045, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 30 13:33:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 30 Oct 2012 15:33:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121030203328.61EFA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5418?compare_to=5414&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5418, Order: 167036, Start Time: 2012-10-30 19:08:31, End Time: 2012-10-30 20:33:27 To: 5414, Order: 167021, Start Time: 2012-10-30 17:17:32, End Time: 2012-10-30 18:42:36 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (5 on baseline) Performance Improvements: 1 (176 on baseline) Unchanged Tests: 1041 (861 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.14% (20.2661 => 20.0353, std.dev.: 0.0439) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.15% (15.2527 => 18.3258, std.dev.: 0.0131) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1015, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: 2.52% (7.4937 => 7.6823, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/hash2: 2.08% (3.1932 => 3.2597, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.08% (0.1431 => 0.1301, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.52% (0.1584 => 0.1449, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.72% (0.3821 => 0.3526, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: -7.19% (2.4924 => 2.3131, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: -6.60% (0.1879 => 0.1755, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.59% (0.3142 => 0.2935, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.47% (0.2428 => 0.2271, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.42% (0.3880 => 0.3631, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.41% (0.3884 => 0.3635, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -6.40% (0.3831 => 0.3586, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.39% (0.3848 => 0.3602, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -6.35% (0.3812 => 0.3570, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.35% (0.4033 => 0.3777, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -6.31% (0.3896 => 0.3650, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.30% (22.4056 => 20.9948, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions: -6.27% (0.4176 => 0.3914, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.27% (0.3891 => 0.3647, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.13% (0.9542 => 0.8957, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -6.12% (0.4199 => 0.3942, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -6.11% (0.2160 => 0.2028, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: -6.08% (0.3025 => 0.2841, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.04% (0.3658 => 0.3437, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.03% (0.9852 => 0.9258, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.99% (0.2355 => 0.2214, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.96% (4.5069 => 4.2381, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -5.95% (0.3026 => 0.2846, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.95% (2.1713 => 2.0422, std.dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.95% (3.5339 => 3.3238, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.94% (0.3837 => 0.3609, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.93% (0.4151 => 0.3905, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.87% (0.3252 => 0.3061, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -5.86% (0.4280 => 0.4029, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.86% (0.6484 => 0.6104, std.dev.: 0.0029) MultiSource/Applications/JM/ldecod/ldecod: -5.85% (7.0961 => 6.6811, std.dev.: 0.0129) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.85% (0.3849 => 0.3624, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/objinst: -5.82% (0.3194 => 0.3008, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -5.82% (0.2939 => 0.2768, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -5.81% (16.1920 => 15.2518, std.dev.: 0.0098) MultiSource/Applications/sgefa/sgefa: -5.78% (0.3357 => 0.3163, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.78% (0.4813 => 0.4535, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.76% (0.3057 => 0.2881, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.75% (0.2903 => 0.2736, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.74% (0.3016 => 0.2843, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.69% (1.6474 => 1.5536, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: -5.69% (0.3059 => 0.2885, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -5.69% (0.2849 => 0.2687, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -5.68% (0.2659 => 0.2508, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: -5.65% (0.3255 => 0.3071, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.64% (0.2871 => 0.2709, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -5.64% (1.3148 => 1.2407, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.63% (0.4083 => 0.3853, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -5.62% (1.2515 => 1.1812, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: -5.62% (0.4861 => 0.4588, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.61% (0.7919 => 0.7475, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: -5.59% (0.2989 => 0.2822, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.56% (5.4682 => 5.1640, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.56% (4.8161 => 4.5483, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.56% (4.0323 => 3.8081, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.55% (0.3931 => 0.3713, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.54% (0.3323 => 0.3139, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: -5.52% (4.3330 => 4.0937, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/wc: -5.52% (0.3205 => 0.3028, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.51% (4.8802 => 4.6112, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.51% (0.4321 => 0.4083, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.50% (1.2784 => 1.2081, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -5.50% (0.3621 => 0.3422, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.49% (0.2548 => 0.2408, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -5.46% (0.3481 => 0.3291, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -5.42% (2.4021 => 2.2718, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.42% (0.5999 => 0.5674, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.42% (1.0544 => 0.9973, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: -5.40% (0.3867 => 0.3658, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.39% (1.2221 => 1.1562, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sieve: -5.39% (0.3788 => 0.3584, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -5.37% (0.4248 => 0.4020, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.35% (1.2210 => 1.1557, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -5.33% (0.6750 => 0.6390, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -5.31% (0.3446 => 0.3263, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -5.30% (0.3394 => 0.3214, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.29% (0.4427 => 0.4193, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -5.19% (0.7779 => 0.7375, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -5.19% (0.2985 => 0.2830, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: -5.14% (9.2283 => 8.7543, std.dev.: 0.0069) MultiSource/Benchmarks/Bullet/bullet: -5.11% (34.0927 => 32.3517, std.dev.: 0.0056) MultiSource/Applications/lua/lua: -5.07% (4.0594 => 3.8534, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.06% (0.8521 => 0.8090, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.05% (1.6364 => 1.5538, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.02% (2.2587 => 2.1453, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: -5.02% (0.4524 => 0.4297, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.01% (0.2933 => 0.2786, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.00% (0.2999 => 0.2849, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.99% (0.6293 => 0.5979, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.97% (1.4642 => 1.3915, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: -4.95% (18.2933 => 17.3879, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.92% (1.3722 => 1.3047, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.92% (0.2278 => 0.2166, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.90% (0.3491 => 0.3320, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -4.85% (0.6347 => 0.6039, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.83% (0.5925 => 0.5639, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.81% (0.7198 => 0.6852, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: -4.78% (0.6441 => 0.6133, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.78% (0.6052 => 0.5763, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.76% (0.5859 => 0.5580, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.76% (0.6304 => 0.6004, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -4.75% (0.7982 => 0.7603, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.75% (0.5478 => 0.5218, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.74% (0.9557 => 0.9104, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.74% (0.6667 => 0.6351, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.74% (0.5805 => 0.5530, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.74% (0.5575 => 0.5311, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.74% (0.6230 => 0.5935, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.73% (0.5705 => 0.5435, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.72% (0.5591 => 0.5327, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.71% (0.5581 => 0.5318, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.71% (0.5857 => 0.5581, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.71% (0.6395 => 0.6094, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.68% (0.6194 => 0.5904, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.67% (0.6446 => 0.6145, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.65% (0.5802 => 0.5532, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.65% (0.7339 => 0.6998, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.64% (0.3319 => 0.3165, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.64% (0.4916 => 0.4688, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.63% (0.6681 => 0.6372, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.61% (0.6676 => 0.6368, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.61% (0.5863 => 0.5593, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.58% (0.5456 => 0.5206, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: -4.58% (0.3581 => 0.3417, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.56% (0.6660 => 0.6356, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.56% (0.5569 => 0.5315, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.55% (0.5849 => 0.5583, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.54% (0.6297 => 0.6011, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.53% (0.7524 => 0.7183, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.48% (0.5941 => 0.5675, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.47% (0.6260 => 0.5980, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.46% (0.6033 => 0.5764, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: -4.46% (0.9179 => 0.8770, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: -4.43% (0.4515 => 0.4315, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.40% (0.2385 => 0.2280, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.40% (0.5570 => 0.5325, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.38% (0.5688 => 0.5439, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -4.36% (1.1450 => 1.0951, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.31% (0.6189 => 0.5922, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.30% (0.6395 => 0.6120, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -4.29% (0.3406 => 0.3260, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.29% (0.6440 => 0.6164, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.28% (0.5567 => 0.5329, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: -4.27% (0.7447 => 0.7129, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: -4.12% (15.5079 => 14.8693, std.dev.: 0.0115) MultiSource/Benchmarks/McCat/09-vor/vor: -4.10% (0.3271 => 0.3137, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -4.09% (0.8418 => 0.8074, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.06% (0.7021 => 0.6736, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.03% (8.0126 => 7.6896, std.dev.: 0.0019) MultiSource/Applications/treecc/treecc: -4.01% (2.1401 => 2.0542, std.dev.: 0.0064) MultiSource/Applications/sqlite3/sqlite3: -3.97% (17.1032 => 16.4240, std.dev.: 0.0094) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.97% (6.7716 => 6.5031, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.91% (0.5168 => 0.4966, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.86% (0.6736 => 0.6476, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.85% (0.3483 => 0.3349, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: -3.81% (1.5610 => 1.5016, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.79% (0.9077 => 0.8733, std.dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: -3.64% (1.1530 => 1.1110, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: -3.64% (5.0226 => 4.8397, std.dev.: 0.0044) MultiSource/Applications/d/make_dparser: -3.59% (3.5154 => 3.3891, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -3.56% (20.7746 => 20.0353, std.dev.: 0.0439) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.50% (1.2300 => 1.1869, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.04% (14.2083 => 13.7761, std.dev.: 0.0132) MultiSource/Applications/SIBsim4/SIBsim4: -1.93% (1.3864 => 1.3596, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.48% (7.5137 => 5.7495, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1729, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -4.00% (2.2633 => 2.1728, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7062, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.63% (1.3096 => 1.2883, std.dev.: 0.0073) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4688, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.02% (3.2107 => 3.1781, std.dev.: 0.0004) Report Time: 1.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 30 15:03:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 30 Oct 2012 17:03:37 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121030220337.6991C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5419?compare_to=5417&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5419, Order: 167047, Start Time: 2012-10-30 20:34:48, End Time: 2012-10-30 22:03:38 To: 5417, Order: 167032, Start Time: 2012-10-30 18:47:53, End Time: 2012-10-30 20:17:20 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 5 (90 on baseline) Performance Improvements: 15 (5 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 971 (879 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.50% (2.8000 => 3.7380, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 2.74% (8.7150 => 8.9537, std.dev.: 0.0435) SingleSource/Benchmarks/Misc/whetstone: 2.39% (2.0990 => 2.1492, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.91% (1.2515 => 1.2754, std.dev.: 0.0045) MultiSource/Applications/SIBsim4/SIBsim4: 1.14% (3.1831 => 3.2193, std.dev.: 0.0125) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.77% (3.3626 => 3.2358, std.dev.: 0.0465) MultiSource/Benchmarks/Olden/bh/bh: -3.76% (0.3166 => 0.3047, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.32% (0.6901 => 0.6741, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -2.19% (1.5915 => 1.5566, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.10% (0.5468 => 0.5353, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.07% (0.9219 => 0.9028, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.59% (0.9235 => 0.9088, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -1.35% (0.8621 => 0.8505, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -1.26% (0.8347 => 0.8242, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.18% (0.8949 => 0.8843, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.18% (0.9034 => 0.8927, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.09% (0.9374 => 0.9272, std.dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: -16.64% (3.8389 => 3.2001, std.dev.: 0.2186) MultiSource/Benchmarks/nbench/nbench: -12.34% (23.3228 => 20.4448, std.dev.: 0.4170) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.86% (4.7545 => 4.5708, std.dev.: 0.0273) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.01% (16.6024 => 16.7696, std.dev.: 0.1734) MultiSource/Applications/obsequi/Obsequi: -0.29% (1.0656 => 1.0625, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.80% (22.2204 => 21.8213, std.dev.: 0.2856) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.33% (0.3669 => 0.3657, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: -1.85% (0.6163 => 0.6049, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/reversefile: -1.30% (0.3373 => 0.3329, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/strcat: 0.25% (0.2006 => 0.2011, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.46% (0.0217 => 0.0218, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.70% (0.0426 => 0.0423, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.61% (0.0330 => 0.0332, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0315 => 0.0314, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.71% (0.0423 => 0.0420, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -0.50% (0.0202 => 0.0201, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 0.92% (0.0217 => 0.0219, std.dev.: 0.0018) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.20% (0.1474 => 0.1477, std.dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.84% (1.1559 => 1.1772, std.dev.: 0.0344) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1522 => 0.1523, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.78% (0.4108 => 0.4076, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.30% (0.1393 => 0.1361, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.77% (0.0649 => 0.0631, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0268 => 0.0268, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 6.52% (0.0552 => 0.0588, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.37% (1.1500 => 1.1542, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 34.78% (0.0023 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.61% (0.0653 => 0.0657, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.10% (0.0234 => 0.0267, std.dev.: 0.0071) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.49% (0.8007 => 0.8046, std.dev.: 0.0177) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 95.56% (0.0045 => 0.0088, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2381.08% (0.6332 => 15.7102, std.dev.: 0.1307) MultiSource/Benchmarks/McCat/08-main/main: 47.90% (0.1831 => 0.2708, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.16% (0.1559 => 0.1463, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1481.64% (0.3344 => 5.2890, std.dev.: 0.0589) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.07% (0.2364 => 0.3264, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: 2.80% (0.0429 => 0.0441, std.dev.: 0.0008) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.91% (0.0224 => 0.0235, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: -32.17% (0.0230 => 0.0156, std.dev.: 0.0007) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4392, std.dev.: 0.0324) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0709, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4950, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3487, std.dev.: 0.0282) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0262, std.dev.: 0.0139) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4076, std.dev.: 0.0133) SingleSource/Regression/C/uint64_to_float: -24.26% (2.1832 => 1.6536, std.dev.: 0.0111) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 35.52% (14.7684 => 20.0135, std.dev.: 0.1106) MultiSource/Benchmarks/Olden/tsp/tsp: 15.38% (0.1112 => 0.1283, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.31% (0.0810 => 0.0934, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.50% (0.0848 => 0.0971, std.dev.: 0.0040) SingleSource/UnitTests/SignlessTypes/rem: 14.30% (0.1035 => 0.1183, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 7.64% (1.1271 => 1.2132, std.dev.: 0.0110) MultiSource/Applications/SIBsim4/SIBsim4: 7.46% (1.2568 => 1.3506, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.91% (1.1606 => 1.2408, std.dev.: 0.0233) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.65% (0.7473 => 0.7970, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.31% (13.1811 => 14.0127, std.dev.: 0.1050) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.06% (6.6074 => 7.0075, std.dev.: 0.0714) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.01% (0.8148 => 0.8638, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.97% (0.6010 => 0.6369, std.dev.: 0.0109) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.77% (0.1905 => 0.2015, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.48% (0.2279 => 0.2404, std.dev.: 0.0034) MultiSource/Applications/Burg/burg: 5.33% (1.2222 => 1.2874, std.dev.: 0.0228) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.03% (0.2741 => 0.2879, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 4.74% (3.2366 => 3.3900, std.dev.: 0.0311) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.53% (1.3279 => 1.3880, std.dev.: 0.0183) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.50% (0.4559 => 0.4764, std.dev.: 0.0016) MultiSource/Applications/spiff/spiff: 4.42% (0.7950 => 0.8301, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.37% (1.2602 => 1.3153, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.28% (1.6386 => 1.7088, std.dev.: 0.0214) MultiSource/Applications/lemon/lemon: 4.14% (1.0945 => 1.1398, std.dev.: 0.0120) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.13% (4.5702 => 4.7588, std.dev.: 0.0420) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.10% (0.4783 => 0.4979, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.03% (0.3003 => 0.3124, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.73% (0.3295 => 0.3418, std.dev.: 0.0041) MultiSource/Applications/SPASS/SPASS: 3.73% (14.2605 => 14.7921, std.dev.: 0.1528) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.71% (8.6476 => 8.9687, std.dev.: 0.0965) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.27% (0.8420 => 0.8695, std.dev.: 0.0074) MultiSource/Applications/treecc/treecc: 3.20% (1.9948 => 2.0586, std.dev.: 0.0183) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.12% (0.5191 => 0.5353, std.dev.: 0.0040) MultiSource/Applications/siod/siod: 3.02% (2.2184 => 2.2855, std.dev.: 0.0238) MultiSource/Benchmarks/mafft/pairlocalalign: 3.02% (8.6247 => 8.8855, std.dev.: 0.0895) MultiSource/Benchmarks/McCat/05-eks/eks: 3.00% (0.4397 => 0.4529, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.93% (0.8457 => 0.8705, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.83% (0.8050 => 0.8278, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.82% (0.3717 => 0.3822, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.69% (0.8611 => 0.8843, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.67% (0.7966 => 0.8179, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.66% (0.9688 => 0.9946, std.dev.: 0.0077) MultiSource/Applications/JM/ldecod/ldecod: 2.64% (6.7320 => 6.9094, std.dev.: 0.0409) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.57% (0.8597 => 0.8818, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.57% (0.8995 => 0.9226, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.56% (0.8317 => 0.8530, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.56% (0.8286 => 0.8498, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.51% (0.8340 => 0.8549, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.51% (0.8261 => 0.8468, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.50% (0.9908 => 1.0156, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.46% (0.8359 => 0.8565, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.45% (0.8069 => 0.8267, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.42% (0.8716 => 0.8927, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.39% (0.9069 => 0.9286, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.39% (0.9056 => 0.9272, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.35% (0.6586 => 0.6741, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.34% (0.8048 => 0.8236, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.33% (4.4880 => 4.5926, std.dev.: 0.0295) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.32% (0.8331 => 0.8524, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.28% (0.8885 => 0.9088, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.27% (0.9039 => 0.9244, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.24% (0.7932 => 0.8110, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.20% (0.8712 => 0.8904, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.18% (0.8066 => 0.8242, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.14% (0.8316 => 0.8494, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.10% (0.8086 => 0.8256, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.10% (0.8204 => 0.8376, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.08% (0.8518 => 0.8695, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.00% (0.8338 => 0.8505, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.99% (0.8805 => 0.8980, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.95% (0.8855 => 0.9028, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.87% (2.1401 => 2.1801, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.86% (0.8656 => 0.8817, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.80% (0.8927 => 0.9088, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.64% (1.5315 => 1.5566, std.dev.: 0.0064) MultiSource/Benchmarks/PAQ8p/paq8p: 1.54% (2.3764 => 2.4129, std.dev.: 0.0083) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 56.80% (1.5795 => 2.4766, std.dev.: 0.0189) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.60% (2.7978 => 3.7380, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.87% (2.4333 => 2.6735, std.dev.: 0.0329) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.50% (1.1857 => 1.2865, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.10% (0.3186 => 0.3444, std.dev.: 0.0078) MultiSource/Benchmarks/mafft/pairlocalalign: 5.99% (63.1822 => 66.9698, std.dev.: 0.0388) MultiSource/Applications/minisat/minisat: 4.42% (6.1525 => 6.4244, std.dev.: 0.0981) MultiSource/Benchmarks/FreeBench/distray/distray: 4.18% (0.2390 => 0.2490, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.24% (1.2474 => 1.2754, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/ReedSolomon: 2.02% (8.5322 => 8.7049, std.dev.: 0.0566) SingleSource/Benchmarks/Shootout-C++/hash: 1.85% (0.6205 => 0.6320, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.58% (4.8362 => 4.9127, std.dev.: 0.0277) SingleSource/Benchmarks/Misc/richards_benchmark: 1.43% (1.3037 => 1.3224, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/whetstone: 1.26% (2.1224 => 2.1492, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.01% (0.3269 => 0.3040, std.dev.: 0.0062) MultiSource/Benchmarks/nbench/nbench: -6.92% (21.9654 => 20.4448, std.dev.: 0.4170) MultiSource/Applications/lua/lua: -4.40% (29.8330 => 28.5210, std.dev.: 0.1299) SingleSource/Benchmarks/Shootout-C++/hash2: -1.57% (3.4237 => 3.3698, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.25% (3.3479 => 3.3061, std.dev.: 0.0014) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.97% (16.4461 => 16.7696, std.dev.: 0.1734) MultiSource/Applications/obsequi/Obsequi: 3.54% (1.0262 => 1.0625, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6887.29% (0.3123 => 21.8213, std.dev.: 0.2856) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.48% (0.2463 => 0.3657, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 0.65% (0.6010 => 0.6049, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.93% (0.3266 => 0.3329, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/strcat: 2.13% (0.1969 => 0.2011, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.68% (0.0408 => 0.0423, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.71% (0.0254 => 0.0332, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.38% (0.0384 => 0.0420, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 5.79% (0.0190 => 0.0201, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0018) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.71% (0.1438 => 0.1477, std.dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 3.91% (1.1329 => 1.1772, std.dev.: 0.0344) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 4.17% (0.1462 => 0.1523, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.11% (0.4164 => 0.4076, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.58% (0.1369 => 0.1361, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.56% (0.0641 => 0.0631, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 37.44% (0.0195 => 0.0268, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.73% (0.0578 => 0.0588, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.92% (1.1437 => 1.1542, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.78% (0.0627 => 0.0657, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 48.33% (0.0180 => 0.0267, std.dev.: 0.0071) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.36% (0.8017 => 0.8046, std.dev.: 0.0177) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 41.94% (0.0062 => 0.0088, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 30 15:21:41 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 30 Oct 2012 17:21:41 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121030222141.6C07C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5420?compare_to=5418&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5420, Order: 167049, Start Time: 2012-10-30 20:56:25, End Time: 2012-10-30 22:21:40 To: 5418, Order: 167036, Start Time: 2012-10-30 19:08:31, End Time: 2012-10-30 20:33:27 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 4 (7 on baseline) Performance Improvements: 0 (173 on baseline) Unchanged Tests: 1038 (862 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.14% (3.1921 => 3.4200, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.47% (54.5896 => 56.4847, std.dev.: 0.0795) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.33% (78.7797 => 80.6144, std.dev.: 0.4013) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.11% (1.4145 => 1.4302, std.dev.: 0.0026) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.22% (15.2527 => 18.3370, std.dev.: 0.0111) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.15% (3.1919 => 3.4200, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.50% (54.5751 => 56.4847, std.dev.: 0.0795) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.81% (2.0478 => 2.1053, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/salsa20: 2.50% (7.4937 => 7.6814, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/hash2: 2.20% (3.1932 => 3.2633, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.87% (0.1431 => 0.1304) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.46% (0.1584 => 0.1450, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.75% (0.3821 => 0.3525, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -7.07% (2.4924 => 2.3163, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.56% (0.3142 => 0.2936, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: -6.44% (0.1879 => 0.1758, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.34% (0.2428 => 0.2274, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.27% (22.4056 => 21.0004, std.dev.: 0.0159) SingleSource/UnitTests/ObjC/exceptions-4: -6.24% (0.3880 => 0.3638, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -6.19% (0.3831 => 0.3594, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.17% (0.3891 => 0.3651, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.15% (0.3884 => 0.3645, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.12% (0.9542 => 0.8958, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -6.11% (0.4176 => 0.3921, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.10% (0.3658 => 0.3435, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: -6.08% (0.3896 => 0.3659, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -6.08% (0.3848 => 0.3614, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.07% (0.4033 => 0.3788, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -6.06% (0.3812 => 0.3581, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -5.93% (0.2160 => 0.2032, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -5.91% (0.4199 => 0.3951, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.86% (0.9852 => 0.9275, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.85% (0.6484 => 0.6105, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.84% (4.5069 => 4.2438, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.81% (3.5339 => 3.3285, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -5.81% (0.3357 => 0.3162, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -5.79% (0.3025 => 0.2850, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.77% (0.2355 => 0.2219, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -5.74% (7.0961 => 6.6890, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/except: -5.68% (0.3026 => 0.2854, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -5.68% (0.4280 => 0.4037, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.66% (0.4151 => 0.3916, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -5.64% (16.1920 => 15.2793, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.61% (2.1713 => 2.0495, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.56% (0.3057 => 0.2887, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.56% (1.6474 => 1.5558, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.52% (5.4682 => 5.1663, std.dev.: 0.0085) MultiSource/Applications/Burg/burg: -5.51% (1.2515 => 1.1825, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: -5.51% (0.4861 => 0.4593, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -5.51% (0.3194 => 0.3018, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -5.51% (1.3148 => 1.2424, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.50% (0.3252 => 0.3073, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.48% (0.3849 => 0.3638, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -5.48% (0.2939 => 0.2778, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.48% (0.2903 => 0.2744, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -5.46% (2.4021 => 2.2709, std.dev.: 0.0024) SingleSource/Regression/C++/ofstream_ctor: -5.46% (0.3059 => 0.2892, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.45% (0.3837 => 0.3628, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.44% (0.3016 => 0.2852, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -5.42% (4.3330 => 4.0981, std.dev.: 0.0177) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.42% (4.0323 => 3.8138, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.42% (0.7919 => 0.7490, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hello: -5.41% (0.2849 => 0.2695, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: -5.40% (0.2871 => 0.2716, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.39% (4.8802 => 4.6170, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.38% (0.2548 => 0.2411, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.37% (1.2784 => 1.2097, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.36% (0.4083 => 0.3864, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -5.35% (0.2989 => 0.2829, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: -5.35% (0.3255 => 0.3081, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.33% (4.8161 => 4.5592, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.30% (1.2221 => 1.1573, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.28% (1.0544 => 0.9987, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wc: -5.27% (0.3205 => 0.3036, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -5.26% (0.3481 => 0.3298, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: -5.23% (0.4248 => 0.4026, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -5.22% (0.3621 => 0.3432, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.18% (1.2210 => 1.1577, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists1: -5.17% (0.3867 => 0.3667, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.17% (0.5999 => 0.5689, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/bigfib: -5.16% (0.6750 => 0.6402, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: -5.12% (0.3788 => 0.3594, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -5.11% (0.3446 => 0.3270, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.11% (0.4427 => 0.4201, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.07% (0.4321 => 0.4102, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -5.04% (34.0927 => 32.3755, std.dev.: 0.0163) MultiSource/Benchmarks/Olden/bh/bh: -5.03% (0.2985 => 0.2835, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.02% (0.6293 => 0.5977, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -5.00% (0.7779 => 0.7390, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/ary: -4.95% (0.3394 => 0.3226, std.dev.: 0.0054) MultiSource/Applications/lua/lua: -4.95% (4.0594 => 3.8585, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.94% (0.4813 => 0.4575, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.92% (2.2587 => 2.1476, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.90% (0.2999 => 0.2852, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: -4.88% (9.2283 => 8.7782, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -4.88% (1.6364 => 1.5566, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.86% (0.8521 => 0.8107, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.84% (0.5925 => 0.5638, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.82% (0.6052 => 0.5760, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.82% (1.3722 => 1.3061, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.81% (0.3491 => 0.3323, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -4.79% (18.2933 => 17.4172, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.79% (1.4642 => 1.3941, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.74% (0.2278 => 0.2170, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.74% (0.2933 => 0.2794, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.73% (0.5478 => 0.5219, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.73% (0.6304 => 0.6006, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -4.73% (0.6347 => 0.6047, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.72% (0.3323 => 0.3166, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.72% (0.5591 => 0.5327, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.69% (0.5802 => 0.5530, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.68% (0.5575 => 0.5314, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.67% (0.5863 => 0.5589, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -4.67% (0.7982 => 0.7609, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.67% (0.6230 => 0.5939, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.67% (0.6446 => 0.6145, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.64% (0.6297 => 0.6005, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.63% (0.5805 => 0.5536, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.63% (0.6395 => 0.6099, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.63% (0.5705 => 0.5441, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.62% (0.6194 => 0.5908, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.61% (0.5570 => 0.5313, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.61% (0.6676 => 0.6368, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.61% (0.5857 => 0.5587, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.61% (0.6660 => 0.6353, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.60% (0.3931 => 0.3750, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.58% (0.9557 => 0.9119, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.58% (0.6681 => 0.6375, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: -4.58% (0.3581 => 0.3417, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: -4.58% (0.4524 => 0.4317, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.56% (0.7339 => 0.7004, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.53% (0.5581 => 0.5328, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.53% (0.6667 => 0.6365, std.dev.: 0.0052) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.52% (0.3319 => 0.3169, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.50% (0.5849 => 0.5586, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.49% (0.5569 => 0.5319, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.46% (0.6260 => 0.5981, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.44% (0.7524 => 0.7190, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.43% (0.6033 => 0.5766, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.42% (0.5456 => 0.5215, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -4.41% (0.6441 => 0.6157, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.40% (0.7198 => 0.6881, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.39% (0.5941 => 0.5680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.37% (0.5567 => 0.5324, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: -4.34% (0.4515 => 0.4319, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.32% (0.5688 => 0.5442, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.32% (0.6395 => 0.6119, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.30% (0.6440 => 0.6163, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.28% (0.6189 => 0.5924, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -4.27% (0.7447 => 0.7129, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: -4.24% (0.9179 => 0.8790, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.23% (0.2385 => 0.2284, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -4.18% (1.1450 => 1.0971, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/BoolLiteralTest: -4.04% (0.3834 => 0.3679, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.03% (0.4916 => 0.4718, std.dev.: 0.0038) MultiSource/Benchmarks/sim/sim: -4.02% (0.3406 => 0.3269, std.dev.: 0.0040) MultiSource/Applications/spiff/spiff: -4.00% (0.8418 => 0.8081, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.00% (0.7021 => 0.6740, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.93% (0.6736 => 0.6471, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -3.93% (8.0126 => 7.6975, std.dev.: 0.0086) MultiSource/Applications/sqlite3/sqlite3: -3.89% (17.1032 => 16.4375, std.dev.: 0.0318) MultiSource/Benchmarks/McCat/09-vor/vor: -3.88% (0.3271 => 0.3144, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -3.88% (15.5079 => 14.9066, std.dev.: 0.0060) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.81% (6.7716 => 6.5138, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.79% (0.3483 => 0.3351, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: -3.76% (5.0226 => 4.8340, std.dev.: 0.0018) MultiSource/Applications/treecc/treecc: -3.72% (2.1401 => 2.0604, std.dev.: 0.0019) MultiSource/Applications/hbd/hbd: -3.68% (1.5610 => 1.5036, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.58% (0.5168 => 0.4983, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: -3.57% (3.5154 => 3.3900, std.dev.: 0.0131) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.55% (0.9077 => 0.8755, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: -3.49% (1.1530 => 1.1128, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.46% (1.2300 => 1.1874, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.45% (0.5329 => 0.5145, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -3.33% (20.7746 => 20.0829, std.dev.: 0.0459) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.05% (14.2083 => 13.7753, std.dev.: 0.0184) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7536, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/richards_benchmark: -8.74% (1.2842 => 1.1720, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: -3.90% (2.2633 => 2.1750, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.87% (1.7753 => 1.7066, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4715, std.dev.: 0.0023) Report Time: 1.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 30 15:35:20 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 30 Oct 2012 17:35:20 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121030223520.B186E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5421?compare_to=5416&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5421, Order: 167043, Start Time: 2012-10-30 20:14:47, End Time: 2012-10-30 22:35:20 To: 5416, Order: 167027, Start Time: 2012-10-30 18:10:22, End Time: 2012-10-30 19:43:33 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 20 (17 on baseline) New Passes: 0 (14 on baseline) Performance Regressions: 6 (180 on baseline) Performance Improvements: 2 (46 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 2 (5 on baseline) Unchanged Tests: 1012 (646 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/lemon/lemon MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Shootout-C++/ary2 MultiSource/Applications/JM/ldecod/ldecod: -91.38% (0.1206 => 0.0104, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -99.86% (7.6597 => 0.0105, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 242.71% (3.8362 => 13.1469, std.dev.: 0.0035) MultiSource/Applications/lemon/lemon: -0.28% (1.4542 => 1.4502, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: -99.99% (4.5167 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.83% (4.4140 => 0.0076) MultiSource/Benchmarks/Bullet/bullet: -98.46% (7.5915 => 0.1166) MultiSource/Benchmarks/FreeBench/pifft/pifft: 427841.70% (0.1168 => 499.8359, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.52% (0.2644 => 0.2551, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: -99.09% (1.9268 => 0.0176, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 1084.02% (1.1095 => 13.1367, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -99.96% (84.0487 => 0.0341, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -35.36% (0.0888 => 0.0574) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.95% (0.0529 => 0.0524, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.20% (0.0334 => 0.0330, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 41.67% (0.0036 => 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4782.35% (0.7796 => 38.0628, std.dev.: 0.5286) SingleSource/Benchmarks/BenchmarkGame/n-body: -99.98% (1.3168 => 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.84% (3.2678 => 3.0442) SingleSource/Benchmarks/Shootout-C++/ary2: 0.66% (0.0752 => 0.0757, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.23% (0.6604 => 0.6751, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.87% (0.6245 => 0.6362, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.61% (0.9517 => 0.9670, std.dev.: 0.0020) MultiSource/Applications/hbd/hbd: 1.13% (1.6948 => 1.7140, std.dev.: 0.0045) MultiSource/Benchmarks/Bullet/bullet: 1.05% (56.7198 => 57.3167, std.dev.: 0.0110) MultiSource/Benchmarks/nbench/nbench: 1.00% (1.3068 => 1.3199, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.58% (10.1026 => 9.9426, std.dev.: 0.0088) MultiSource/Applications/oggenc/oggenc: -1.40% (6.2947 => 6.2066, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -5.33% (0.1406 => 0.1331, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.44% (0.0647 => 0.0721, std.dev.: 0.0010) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/lemon/lemon MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Shootout-C++/ary2 MultiSource/Applications/JM/ldecod/ldecod: -91.99% (0.1298 => 0.0104, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 0.29% (1.4460 => 1.4502, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: -99.99% (4.6441 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.83% (4.3882 => 0.0076) MultiSource/Benchmarks/Bullet/bullet: -98.91% (10.7105 => 0.1166) MultiSource/Benchmarks/FreeBench/pifft/pifft: 423849.02% (0.1179 => 499.8359, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.02% (0.3987 => 0.2551, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: -99.09% (1.9405 => 0.0176, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 1064.91% (1.1277 => 13.1367, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -99.96% (85.0658 => 0.0341, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -33.56% (0.0864 => 0.0574) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.24% (0.0611 => 0.0524, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -34.78% (0.0506 => 0.0330, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 37.84% (0.0037 => 0.0051) SingleSource/Benchmarks/BenchmarkGame/n-body: -99.99% (1.3677 => 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.09% (3.2416 => 3.0442) SingleSource/Benchmarks/Shootout-C++/ary2: - (0.0757 => 0.0757, std.dev.: 0.0000) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 198.74% (0.5229 => 1.5621, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 13.89% (14.9895 => 17.0722, std.dev.: 0.0132) MultiSource/Applications/kimwitu++/kc: 37.10% (14.1553 => 19.4076, std.dev.: 0.0136) MultiSource/Benchmarks/MallocBench/gs/gs: 13.22% (4.1105 => 4.6541, std.dev.: 0.0133) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 29.68% (1.1048 => 1.4327, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 306.34% (7.1582 => 29.0864, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.32% (3.4629 => 5.8286, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/stepanov_container: 64.37% (0.6222 => 1.0227, std.dev.: 0.0025) New Passes - Execution Time --------------------------- MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SPASS/SPASS: 11191000.00% (0.0001 => 11.1911, std.dev.: 0.0068) MultiSource/Applications/kimwitu++/kc: 51000.00% (0.0001 => 0.0511, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050200.00% (0.0001 => 10.0503, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5493600.00% (0.0001 => 5.4937, std.dev.: 0.0106) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 40.06% (0.1056 => 0.1479, std.dev.: 0.0023) SingleSource/UnitTests/vla: 29.30% (0.0355 => 0.0459, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 28.28% (0.1432 => 0.1837) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 21.22% (0.0834 => 0.1011, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.50% (0.1566 => 0.1887, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.43% (0.0793 => 0.0955, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.60% (0.0842 => 0.1007, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 19.55% (0.0798 => 0.0954, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.30% (0.0886 => 0.1057, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 19.04% (0.1555 => 0.1851, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 18.35% (0.2065 => 0.2444, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.33% (0.8172 => 0.9670, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/17-bintr/bintr: 17.93% (0.0675 => 0.0796, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 17.76% (0.1695 => 0.1996, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/rem: 17.74% (0.1144 => 0.1347, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 17.53% (0.0730 => 0.0858, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 17.53% (0.3177 => 0.3734, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/mst/mst: 17.45% (0.1163 => 0.1366, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.22% (0.0871 => 0.1021, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 17.11% (0.4879 => 0.5714, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 17.11% (0.1175 => 0.1376, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.99% (0.0730 => 0.0854, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 16.98% (0.1584 => 0.1853, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 16.84% (0.2554 => 0.2984, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 16.76% (0.0746 => 0.0871, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 16.42% (0.1151 => 0.1340, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 16.24% (0.2758 => 0.3206, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.20% (0.1117 => 0.1298, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 16.10% (0.0770 => 0.0894, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 16.03% (0.2271 => 0.2635, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.85% (0.2107 => 0.2441, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.74% (0.1029 => 0.1191, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.60% (0.3121 => 0.3608, std.dev.: 0.0035) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.57% (0.1143 => 0.1321, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.54% (0.1062 => 0.1227, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 15.41% (0.1655 => 0.1910, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 15.38% (0.1125 => 0.1298, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 15.20% (0.5860 => 0.6751, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 14.97% (0.7115 => 0.8180, std.dev.: 0.0121) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.89% (0.2700 => 0.3102, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.77% (0.1625 => 0.1865, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.76% (0.5981 => 0.6864, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.69% (0.1940 => 0.2225, std.dev.: 0.0039) MultiSource/Applications/spiff/spiff: 14.66% (0.7835 => 0.8984, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 14.59% (0.1906 => 0.2184, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 14.53% (0.5105 => 0.5847, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.47% (0.4615 => 0.5283, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.36% (0.1337 => 0.1529, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 14.24% (0.5569 => 0.6362, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 14.19% (22.1758 => 25.3233, std.dev.: 0.0316) MultiSource/Applications/lambda-0_1_3/lambda: 14.01% (0.7433 => 0.8474, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.98% (0.9765 => 1.1130, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.90% (0.0770 => 0.0877, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 13.85% (3.3354 => 3.7973, std.dev.: 0.0115) MultiSource/Applications/Burg/burg: 13.65% (1.1642 => 1.3231, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.58% (0.1510 => 0.1715, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 13.41% (0.3109 => 0.3526, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.41% (0.6675 => 0.7570, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.28% (0.3441 => 0.3898, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.24% (1.5415 => 1.7456, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 13.19% (2.0273 => 2.2947, std.dev.: 0.0097) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.93% (0.3543 => 0.4001, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/exptree: 12.78% (0.0814 => 0.0918, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 12.73% (3.8723 => 4.3651, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/05-eks/eks: 12.70% (0.4299 => 0.4845, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.65% (0.5020 => 0.5655, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.54% (0.1236 => 0.1391, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 12.54% (0.1268 => 0.1427, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 12.53% (0.3927 => 0.4419, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/trivial-interface: 12.47% (0.3473 => 0.3906, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 12.43% (0.6450 => 0.7252, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.41% (1.3050 => 1.4670, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/18-imp/imp: 12.39% (0.3423 => 0.3847, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.33% (0.2603 => 0.2924, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.31% (0.1032 => 0.1159, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.21% (0.3497 => 0.3924, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 12.20% (0.3516 => 0.3945, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.19% (0.3543 => 0.3975, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 12.19% (0.3561 => 0.3995, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.04% (0.3828 => 0.4289, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 12.00% (1.0722 => 1.2009, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.99% (0.3694 => 0.4137, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.88% (0.3307 => 0.3700, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.87% (1.1861 => 1.3269, std.dev.: 0.0069) SingleSource/UnitTests/ObjC/property: 11.86% (0.3886 => 0.4347, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.79% (0.1892 => 0.2115, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 11.68% (0.8921 => 0.9963, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.52% (0.0929 => 0.1036, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 11.51% (8.1363 => 9.0730, std.dev.: 0.0056) MultiSource/Benchmarks/nbench/nbench: 11.48% (1.1840 => 1.3199, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.40% (4.2646 => 4.7509, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/09-vor/vor: 11.38% (0.3180 => 0.3542, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: 10.94% (0.1463 => 0.1623, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: 10.93% (0.0933 => 0.1035, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.92% (0.1044 => 0.1158, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.88% (2.2022 => 2.4419, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 10.87% (0.3387 => 0.3755, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.86% (0.1695 => 0.1879, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 10.84% (9.4845 => 10.5127, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 10.82% (0.4289 => 0.4753, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.81% (0.8101 => 0.8977, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.62% (1.4186 => 1.5693, std.dev.: 0.0018) MultiSource/Applications/siod/siod: 10.53% (2.2969 => 2.5388, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.51% (1.5859 => 1.7525, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 10.49% (0.0953 => 0.1053, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 10.36% (0.6456 => 0.7125, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.24% (0.4103 => 0.4523, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: 10.16% (0.7326 => 0.8070, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash2: 10.13% (0.4620 => 0.5088, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.12% (0.4636 => 0.5105, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.12% (2.2024 => 2.4252, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.95% (0.4203 => 0.4621, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 9.86% (0.5925 => 0.6509, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 9.85% (1.5603 => 1.7140, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/lists: 9.85% (0.3422 => 0.3759, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.83% (0.3865 => 0.4245, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.76% (14.3668 => 15.7685, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference-object: 9.64% (0.6030 => 0.6611, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.47% (0.1330 => 0.1456, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.45% (4.9449 => 5.4124, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.42% (0.2430 => 0.2659, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 9.26% (0.4048 => 0.4423, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 9.19% (0.3603 => 0.3934, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.18% (5.0018 => 5.4608, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/lists1: 9.17% (0.3684 => 0.4022, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 8.95% (0.2905 => 0.3165, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.92% (0.2793 => 0.3042, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.81% (0.3826 => 0.4163, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/fibo: 8.59% (0.2725 => 0.2959, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.47% (0.3650 => 0.3959, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.38% (0.2756 => 0.2987, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 8.36% (0.2714 => 0.2941, std.dev.: 0.0064) SingleSource/Benchmarks/Stanford/Puzzle: 8.28% (0.1268 => 0.1373, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.16% (0.2891 => 0.3127, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 8.16% (0.2831 => 0.3062, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.10% (0.3162 => 0.3418, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.05% (0.3427 => 0.3703, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.04% (2.0665 => 2.2326, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/ary3: 8.01% (0.3283 => 0.3546, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 7.98% (0.3232 => 0.3490, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 7.94% (0.2871 => 0.3099, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.94% (0.2872 => 0.3100, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 7.91% (0.3098 => 0.3343, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.85% (0.4064 => 0.4383, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 7.82% (0.2877 => 0.3102, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 7.77% (5.7591 => 6.2066, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 7.50% (0.3052 => 0.3281, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 7.49% (17.1811 => 18.4675, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/random: 7.42% (0.2802 => 0.3010, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 7.40% (0.3379 => 0.3629, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 7.13% (1.2842 => 1.3757, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/bh/bh: 6.76% (0.3092 => 0.3301, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.68% (0.8067 => 0.8606, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.38% (0.3136 => 0.3336, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 5.85% (0.3282 => 0.3474, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 5.75% (0.3131 => 0.3311, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.61% (3.8922 => 4.1105, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.12% (0.2266 => 0.2382, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.64% (0.3817 => 0.3994, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.17% (0.3935 => 0.4099, std.dev.: 0.0036) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.15% (7.9617 => 8.1331, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.73% (7.0540 => 7.1760, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.63% (1.1145 => 1.2998, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.58% (0.2944 => 0.3285, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 11.31% (2.8904 => 3.2174, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 9.80% (1.1396 => 1.2513, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.11% (0.9540 => 1.0218) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3682, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.40% (0.3463 => 0.3650, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.4162 => 0.4322, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.69% (4.2280 => 4.3417, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7651, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 1.85% (0.8333 => 0.8487, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2075, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.31% (11.6436 => 11.7962, std.dev.: 0.0068) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5763, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.89% (6.6874 => 0.1414, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -76.47% (0.8651 => 0.2036, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.31% (5.3855 => 2.4069, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -55.00% (5.3526 => 2.4087, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: -45.50% (0.1622 => 0.0884, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.03% (1.1194 => 0.6825, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.87% (5.2763 => 3.2783, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -24.27% (1.7609 => 1.3336, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -16.77% (2.9384 => 2.4455, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: -10.02% (10.4361 => 9.3902, std.dev.: 0.0112) MultiSource/Benchmarks/Bullet/bullet: -9.37% (63.2438 => 57.3167, std.dev.: 0.0110) SingleSource/UnitTests/Vector/constpool: -9.06% (54.1659 => 49.2569, std.dev.: 0.0269) MultiSource/Benchmarks/PAQ8p/paq8p: -4.10% (10.3673 => 9.9426, std.dev.: 0.0088) MultiSource/Applications/JM/lencod/lencod: -1.99% (21.9371 => 21.5003, std.dev.: 0.0256) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -33.58% (1.1492 => 0.7633, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: -15.68% (1.6925 => 1.4271, std.dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: -10.98% (9.5636 => 8.5132, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -10.88% (1.5373 => 1.3700, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.23% (19.9488 => 18.3076, std.dev.: 0.0891) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.01% (1.8329 => 1.7044, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -6.62% (1.2373 => 1.1554, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/mason/mason: -6.57% (0.2161 => 0.2019, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -5.45% (6.6465 => 6.2844, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.04% (1.6805 => 1.5958, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.95% (1.5835 => 1.5051, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7614) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.45% (0.9957 => 0.9514, std.dev.: 0.0079) MultiSource/Applications/siod/siod: -3.86% (3.2827 => 3.1561, std.dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.52% (32.5116 => 31.3666, std.dev.: 0.0083) MultiSource/Benchmarks/sim/sim: -3.20% (5.0483 => 4.8867, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.84% (4.5009 => 4.3731, std.dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.83% (0.4808 => 0.4672, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/salsa20: -1.89% (10.2830 => 10.0890, std.dev.: 0.0180) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.79% (8.1563 => 8.0099, std.dev.: 0.0178) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6777, std.dev.: 0.0036) SingleSource/UnitTests/Vector/multiplies: -1.58% (2.5528 => 2.5124, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2359, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8594, std.dev.: 0.0034) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: -85.42% (0.0720 => 0.0105, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 13146800.00% (0.0001 => 13.1469, std.dev.: 0.0035) MultiSource/Applications/oggenc/oggenc: -10.37% (0.1485 => 0.1331, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -65.93% (0.2116 => 0.0721, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 38062700.00% (0.0001 => 38.0628, std.dev.: 0.5286) Report Time: 1.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 30 16:43:36 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 30 Oct 2012 18:43:36 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121030234336.58A152A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5422?compare_to=5415&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5422, Order: 167041, Start Time: 2012-10-30 20:28:08, End Time: 2012-10-30 23:43:32 To: 5415, Order: 167016, Start Time: 2012-10-30 16:24:02, End Time: 2012-10-30 19:39:40 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (173 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1039 (716 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.16% (0.3797 => 0.3917, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/whetstone: 1.58% (2.7828 => 2.8268, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.31% (54.1853 => 54.8932, std.dev.: 0.0972) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 39.36% (0.0625 => 0.0871, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.95% (0.1063 => 0.1392, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.36% (0.2969 => 0.3722, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.23% (0.1106 => 0.1385, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.16% (0.4139 => 0.5139, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.67% (0.0714 => 0.0883, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 23.45% (0.0452 => 0.0558, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.23% (0.4253 => 0.5241, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.17% (0.5900 => 0.7267, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 23.05% (1.5932 => 1.9605, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 22.95% (0.4994 => 0.6140, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.85% (0.0547 => 0.0672, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.32% (0.0475 => 0.0581, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.18% (0.5000 => 0.6109, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.09% (0.0584 => 0.0713, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.40% (0.0897 => 0.1089, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 21.20% (0.0599 => 0.0726, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.06% (0.1021 => 0.1236, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 20.99% (0.0948 => 0.1147, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 20.99% (0.1620 => 0.1960, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.70% (0.0541 => 0.0653, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 20.51% (0.1107 => 0.1334, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 20.14% (0.0581 => 0.0698, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 20.03% (0.0604 => 0.0725, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/04-bisect/bisect: 19.59% (0.0633 => 0.0757, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.58% (0.1103 => 0.1319, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.52% (0.0584 => 0.0698, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.51% (0.1604 => 0.1917, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.50% (0.1549 => 0.1851, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.47% (0.0642 => 0.0767, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.42% (0.3903 => 0.4661, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: 19.24% (0.0821 => 0.0979, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.04% (0.1003 => 0.1194, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 19.02% (0.1619 => 0.1927, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.86% (0.0822 => 0.0977, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 18.68% (0.0605 => 0.0718, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.19% (0.1462 => 0.1728, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 17.95% (0.0808 => 0.0953, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 17.85% (0.0947 => 0.1116, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.48% (0.2866 => 0.3367, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.43% (0.3890 => 0.4568, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 17.32% (0.1218 => 0.1429, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.28% (0.2014 => 0.2362, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.07% (1.3152 => 1.5397, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.07% (0.2736 => 0.3203, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/mst/mst: 17.05% (0.0698 => 0.0817, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 16.98% (0.4029 => 0.4713, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 16.88% (0.1505 => 0.1759, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 16.86% (0.9697 => 1.1332, std.dev.: 0.0079) MultiSource/Benchmarks/Olden/voronoi/voronoi: 16.82% (0.1088 => 0.1271, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.64% (0.1160 => 0.1353, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 16.53% (0.5826 => 0.6789, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.39% (0.5026 => 0.5850, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 16.28% (0.5546 => 0.6449, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 16.26% (1.8794 => 2.1850, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.23% (0.4658 => 0.5414, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.22% (3.5627 => 4.1407, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference-object: 16.22% (0.5889 => 0.6844, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.21% (0.1968 => 0.2287, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.10% (0.2875 => 0.3338, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 15.75% (0.3004 => 0.3477, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 15.69% (1.6211 => 1.8755, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.56% (0.3271 => 0.3780, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 15.55% (0.1421 => 0.1642, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 15.55% (0.2714 => 0.3136, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 15.45% (0.2725 => 0.3146, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.41% (0.2738 => 0.3160, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 15.35% (0.2750 => 0.3172, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.32% (0.2729 => 0.3147, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 15.22% (0.2780 => 0.3203, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 15.16% (1.0781 => 1.2415, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 15.15% (0.2811 => 0.3237, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/random: 15.13% (0.2803 => 0.3227, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 15.13% (0.2823 => 0.3250, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.12% (0.3195 => 0.3678, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 15.12% (0.3096 => 0.3564, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.11% (0.2792 => 0.3214, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/methcall: 15.04% (0.2813 => 0.3236, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 14.95% (0.9909 => 1.1390, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.93% (2.0673 => 2.3760, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.87% (0.2911 => 0.3344, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 14.86% (0.4361 => 0.5009, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 14.85% (0.3267 => 0.3752, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.83% (0.3930 => 0.4513, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: 14.80% (0.1284 => 0.1474, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 14.69% (4.4195 => 5.0688, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.67% (0.3060 => 0.3509, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.61% (1.9694 => 2.2571, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 14.56% (4.2109 => 4.8242, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/ary2: 14.56% (0.3317 => 0.3800, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 14.54% (0.7171 => 0.8214, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 14.52% (0.3258 => 0.3731, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.49% (0.3362 => 0.3849, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.41% (2.7292 => 3.1224, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.29% (1.9966 => 2.2820, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: 14.00% (0.3678 => 0.4193, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 13.96% (23.5202 => 26.8030, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.94% (0.1090 => 0.1242, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 13.83% (0.3348 => 0.3811, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash: 13.82% (0.4146 => 0.4719, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.77% (0.3282 => 0.3734, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.73% (0.3124 => 0.3553, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.60% (0.3625 => 0.4118, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 13.45% (0.2075 => 0.2354, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 13.40% (0.3477 => 0.3943, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 13.39% (0.3726 => 0.4225, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.37% (0.3845 => 0.4359, std.dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 13.29% (0.2566 => 0.2907, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 13.20% (0.4251 => 0.4812, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.17% (0.3690 => 0.4176, std.dev.: 0.0074) MultiSource/Applications/lua/lua: 13.09% (1.4269 => 1.6137, std.dev.: 0.0023) MultiSource/Applications/treecc/treecc: 13.07% (0.7875 => 0.8904, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.06% (0.3981 => 0.4501, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 12.80% (2.1653 => 2.4424, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 12.74% (0.3446 => 0.3885, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 12.71% (0.3469 => 0.3910, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 12.70% (0.3496 => 0.3940, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.67% (0.3488 => 0.3930, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 12.67% (0.3465 => 0.3904, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 12.67% (0.3442 => 0.3878, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.63% (0.3460 => 0.3897, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 12.39% (0.5012 => 0.5633, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.33% (0.3643 => 0.4092, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 12.30% (0.3650 => 0.4099, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 12.28% (4.6177 => 5.1846, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/parameter-passing: 12.22% (0.3724 => 0.4179, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 11.85% (2.1013 => 2.3503, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.47% (0.2040 => 0.2274, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 11.15% (0.2691 => 0.2991, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.00% (0.6435 => 0.7143, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 10.74% (5.5417 => 6.1368, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.70% (0.1028 => 0.1138, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 10.58% (0.3498 => 0.3868, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 10.39% (0.6634 => 0.7323, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.97% (0.2737 => 0.3010, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 9.68% (0.4847 => 0.5316, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.67% (0.2068 => 0.2268, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.62% (0.1383 => 0.1516, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.53% (0.3084 => 0.3378, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 9.35% (0.3336 => 0.3648, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.03% (0.2103 => 0.2293, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 8.80% (2.0346 => 2.2137, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 8.49% (0.2391 => 0.2594, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.45% (4.6926 => 5.0893, std.dev.: 0.0116) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.00% (11.6398 => 12.5713, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.57% (0.5361 => 0.5767, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.98% (0.5584 => 0.5974, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.94% (0.7426 => 0.7941, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 5.76% (11.9555 => 12.6441, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.53% (0.3792 => 0.3926, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6537, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0300, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 8.96% (0.2802 => 0.3053, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6097, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.07% (0.3693 => 0.3917, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 5.61% (0.2122 => 0.2241, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/objinst: 4.97% (12.0509 => 12.6493, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1659, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-2: 4.05% (1.8057 => 1.8788, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/dry: 2.75% (14.0481 => 14.4338, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2003, std.dev.: 0.0031) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.62% (3.1722 => 3.2237, std.dev.: 0.0023) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3026, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2887, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0016) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (8.4155 => 8.5144, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5401, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5953, std.dev.: 0.0121) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.81% (2.4764 => 2.4067, std.dev.: 0.0124) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.43% (25.4195 => 16.4134, std.dev.: 0.0063) MultiSource/Applications/hexxagon/hexxagon: -7.70% (28.1477 => 25.9803, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7755, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: -6.58% (0.2402 => 0.2244, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2420, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.37% (11.2080 => 10.8300, std.dev.: 0.0432) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.16% (0.6293 => 0.6094, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7746, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5219, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -2.63% (17.2379 => 16.7844, std.dev.: 0.0357) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.16% (41.7953 => 40.8909, std.dev.: 0.0140) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5710, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4962, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7160, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.22% (105.3826 => 104.1015, std.dev.: 0.0735) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0414, std.dev.: 0.0036) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.04% (3.3991 => 3.3638, std.dev.: 0.0007) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 5.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 30 16:49:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 30 Oct 2012 18:49:22 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121030234922.23CEA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5423?compare_to=5419&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5423, Order: 167054, Start Time: 2012-10-30 22:20:50, End Time: 2012-10-30 23:49:22 To: 5419, Order: 167047, Start Time: 2012-10-30 20:34:48, End Time: 2012-10-30 22:03:38 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 7 (75 on baseline) Performance Improvements: 4 (4 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 980 (895 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 2.83% (1.4515 => 1.4926, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.86% (1.4697 => 1.4970, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.43% (0.9247 => 0.9379, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.43% (0.8549 => 0.8671, std.dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 10.18% (20.4448 => 22.5259, std.dev.: 0.7204) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.79% (2.4570 => 2.5009, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/lists: 1.21% (16.7006 => 16.9030, std.dev.: 0.0558) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/nbench/nbench: -2.80% (1.2132 => 1.1792, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.48% (1.2408 => 1.2100, std.dev.: 0.0117) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.37% (1.0485 => 1.0132, std.dev.: 0.0110) MultiSource/Applications/sgefa/sgefa: -3.15% (0.3617 => 0.3503, std.dev.: 0.0034) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.92% (16.7696 => 16.6146, std.dev.: 0.2105) MultiSource/Applications/obsequi/Obsequi: 0.24% (1.0625 => 1.0651, std.dev.: 0.0195) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.15% (21.8213 => 21.5705, std.dev.: 0.3046) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.08% (0.3657 => 0.3660, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/bigfib: -0.10% (0.6049 => 0.6043, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.15% (0.3329 => 0.3334, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/strcat: -1.29% (0.2011 => 0.1985, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.46% (0.0218 => 0.0219, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.18% (0.0423 => 0.0428) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.30% (0.0332 => 0.0331, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0314 => 0.0313, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.95% (0.0420 => 0.0424, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 1.49% (0.0201 => 0.0204, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0219 => 0.0219, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -1.02% (0.1477 => 0.1462, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -2.41% (1.1772 => 1.1488, std.dev.: 0.0272) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.79% (0.1523 => 0.1511, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.69% (0.4076 => 0.4048, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.59% (0.1361 => 0.1353, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.90% (0.0631 => 0.0643, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -21.64% (0.0268 => 0.0210, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.04% (0.0588 => 0.0576, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.58% (1.1542 => 1.1475, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -41.94% (0.0031 => 0.0018, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.07% (0.0657 => 0.0604, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.00% (0.0267 => 0.0259, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.26% (0.8046 => 0.8025, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -42.05% (0.0088 => 0.0051, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2332.26% (0.6332 => 15.4011, std.dev.: 0.2872) MultiSource/Benchmarks/McCat/08-main/main: 47.30% (0.1831 => 0.2697, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.03% (0.1559 => 0.1465, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1485.35% (0.3344 => 5.3014, std.dev.: 0.0903) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.14% (0.2364 => 0.3242, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: 2.33% (0.0429 => 0.0439, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.91% (0.0224 => 0.0235, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -27.83% (0.0230 => 0.0166, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4464, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0693, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4907, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3453, std.dev.: 0.0170) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0544, std.dev.: 0.0434) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4099, std.dev.: 0.0026) SingleSource/Regression/C/uint64_to_float: -24.16% (2.1832 => 1.6557, std.dev.: 0.0081) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 35.70% (14.7684 => 20.0411, std.dev.: 0.0959) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.19% (0.0810 => 0.0933, std.dev.: 0.0006) SingleSource/UnitTests/SignlessTypes/rem: 12.46% (0.1035 => 0.1164, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.45% (0.2180 => 0.2386, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.59% (0.2279 => 0.2452, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.16% (0.1425 => 0.1527, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 6.51% (1.2568 => 1.3386, std.dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.22% (0.6010 => 0.6384, std.dev.: 0.0102) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.77% (1.1170 => 1.1815, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.67% (13.1811 => 13.9285, std.dev.: 0.1578) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.48% (0.6227 => 0.6568, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.14% (0.2741 => 0.2882, std.dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.14% (6.6074 => 6.9472, std.dev.: 0.0496) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.94% (1.6386 => 1.7195, std.dev.: 0.0275) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.87% (0.6287 => 0.6593, std.dev.: 0.0043) MultiSource/Benchmarks/nbench/nbench: 4.62% (1.1271 => 1.1792, std.dev.: 0.0076) MultiSource/Applications/hbd/hbd: 4.60% (1.4269 => 1.4926, std.dev.: 0.0071) MultiSource/Applications/Burg/burg: 4.54% (1.2222 => 1.2777, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.45% (0.4559 => 0.4762, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.45% (0.5817 => 0.6076, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.26% (1.1606 => 1.2100, std.dev.: 0.0117) MultiSource/Applications/sgefa/sgefa: 4.20% (0.2999 => 0.3125, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.97% (0.8340 => 0.8671, std.dev.: 0.0035) MultiSource/Applications/treecc/treecc: 3.82% (1.9948 => 2.0710, std.dev.: 0.0258) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.70% (0.4783 => 0.4960, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/05-eks/eks: 3.68% (0.4397 => 0.4559, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.43% (0.5191 => 0.5369, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.39% (1.4479 => 1.4970, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.37% (8.6476 => 8.9390, std.dev.: 0.0615) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.36% (0.9074 => 0.9379, std.dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 3.23% (14.2605 => 14.7209, std.dev.: 0.1579) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.16% (0.6586 => 0.6794, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.00% (0.5961 => 0.6140, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/football/football: 2.91% (0.8768 => 0.9023, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/hash2: 2.69% (0.4125 => 0.4236, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.68% (0.8457 => 0.8684, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.59% (0.8611 => 0.8834, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.58% (1.2602 => 1.2927, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.56% (0.8656 => 0.8878, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.46% (0.8712 => 0.8926, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.43% (0.8359 => 0.8562, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.41% (0.8007 => 0.8200, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.32% (0.7932 => 0.8116, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.30% (0.8261 => 0.8451, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.28% (0.9069 => 0.9276, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.26% (0.9908 => 1.0132, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.23% (0.9688 => 0.9904, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.20% (0.8716 => 0.8908, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.20% (0.8420 => 0.8605, std.dev.: 0.0069) MultiSource/Benchmarks/mafft/pairlocalalign: 2.18% (8.6247 => 8.8126, std.dev.: 0.0257) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.18% (0.8316 => 0.8497, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.14% (0.8050 => 0.8222, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.12% (0.8518 => 0.8699, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.10% (0.9039 => 0.9229, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.10% (0.8805 => 0.8990, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.08% (0.8177 => 0.8347, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.02% (0.8066 => 0.8229, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.00% (4.4873 => 4.5770, std.dev.: 0.0286) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.92% (0.8885 => 0.9056, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.71% (0.8048 => 0.8186, std.dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 1.49% (15.3280 => 15.5569, std.dev.: 0.0877) MultiSource/Benchmarks/Bullet/bullet: 1.48% (31.8598 => 32.3303, std.dev.: 0.1272) MultiSource/Benchmarks/PAQ8p/paq8p: 1.09% (2.3764 => 2.4024, std.dev.: 0.0087) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.29% (1.5795 => 2.5002, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.52% (2.7978 => 3.7355, std.dev.: 0.0283) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.91% (2.4333 => 2.6745, std.dev.: 0.0417) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.20% (1.1857 => 1.2829, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.04% (0.3186 => 0.3442, std.dev.: 0.0057) MultiSource/Benchmarks/mafft/pairlocalalign: 5.92% (63.1822 => 66.9226, std.dev.: 0.1199) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.61% (0.7597 => 0.7947, std.dev.: 0.0125) MultiSource/Applications/siod/siod: 2.84% (3.6643 => 3.7685, std.dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.12% (2.4490 => 2.5009, std.dev.: 0.0075) MultiSource/Benchmarks/Olden/bh/bh: 1.48% (2.3560 => 2.3908, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/richards_benchmark: 1.32% (1.3037 => 1.3209, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.25% (4.8362 => 4.8965, std.dev.: 0.0212) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.19% (0.3269 => 0.3034, std.dev.: 0.0013) MultiSource/Applications/lua/lua: -5.05% (29.8330 => 28.3252, std.dev.: 0.2260) SingleSource/Benchmarks/Shootout-C++/hash2: -1.29% (3.4237 => 3.3797, std.dev.: 0.0154) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.23% (3.3479 => 3.3067, std.dev.: 0.0029) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.02% (16.4461 => 16.6146, std.dev.: 0.2105) MultiSource/Applications/obsequi/Obsequi: 3.79% (1.0262 => 1.0651, std.dev.: 0.0195) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6806.98% (0.3123 => 21.5705, std.dev.: 0.3046) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.60% (0.2463 => 0.3660, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/bigfib: 0.55% (0.6010 => 0.6043, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.08% (0.3266 => 0.3334, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/strcat: 0.81% (0.1969 => 0.1985, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.31% (0.0254 => 0.0331, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0384 => 0.0424, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 1.67% (0.1438 => 0.1462, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.40% (1.1329 => 1.1488, std.dev.: 0.0272) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.35% (0.1462 => 0.1511, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.79% (0.4164 => 0.4048, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.17% (0.1369 => 0.1353, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.31% (0.0641 => 0.0643, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 7.69% (0.0195 => 0.0210, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.35% (0.0578 => 0.0576, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.33% (1.1437 => 1.1475, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1700.00% (0.0001 => 0.0018, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.67% (0.0627 => 0.0604, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 43.89% (0.0180 => 0.0259, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.10% (0.8017 => 0.8025, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -17.74% (0.0062 => 0.0051, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 30 17:09:46 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 30 Oct 2012 19:09:46 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121031000946.3EC512A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5424?compare_to=5420&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5424, Order: 167055, Start Time: 2012-10-30 22:44:39, End Time: 2012-10-31 00:09:45 To: 5420, Order: 167049, Start Time: 2012-10-30 20:56:25, End Time: 2012-10-30 22:21:40 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (7 on baseline) Performance Improvements: 0 (175 on baseline) Unchanged Tests: 1042 (860 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.19% (15.2527 => 18.3320, std.dev.: 0.0146) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.15% (3.1919 => 3.4200, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.71% (54.5751 => 56.5992, std.dev.: 0.0281) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.79% (2.0478 => 2.1050, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/salsa20: 2.61% (7.4937 => 7.6890, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/hash2: 2.30% (3.1932 => 3.2667, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -9.08% (0.1431 => 0.1301, std.dev.: 0.0021) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.71% (0.1584 => 0.1446, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.88% (0.3821 => 0.3520, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -7.04% (2.4924 => 2.3170, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-2: -7.02% (0.3831 => 0.3562, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -6.96% (0.3896 => 0.3625, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -6.90% (0.3812 => 0.3549, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.88% (0.3880 => 0.3613, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.87% (0.3884 => 0.3617, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.86% (0.3891 => 0.3624, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.83% (0.3848 => 0.3585, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -6.77% (0.4033 => 0.3760, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -6.75% (0.4176 => 0.3894, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.68% (0.3142 => 0.2932, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -6.64% (0.4199 => 0.3920, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.63% (0.2428 => 0.2267, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.61% (22.4056 => 20.9247, std.dev.: 0.0201) SingleSource/Benchmarks/Misc/ReedSolomon: -6.60% (0.1879 => 0.1755, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: -6.43% (0.4280 => 0.4005, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.34% (0.3658 => 0.3426, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.31% (0.3025 => 0.2834, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.24% (0.4151 => 0.3892, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.24% (0.9542 => 0.8947, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.23% (4.5069 => 4.2262, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.21% (2.1713 => 2.0365, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: -6.18% (0.3026 => 0.2839, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: -6.14% (0.3194 => 0.2998, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.10% (0.3837 => 0.3603, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.07% (0.2355 => 0.2212, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -6.06% (0.2939 => 0.2761, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.03% (0.2903 => 0.2728, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: -6.02% (0.2160 => 0.2030, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: -6.02% (0.3357 => 0.3155, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.99% (3.5339 => 3.3221, std.dev.: 0.0055) MultiSource/Applications/JM/ldecod/ldecod: -5.99% (7.0961 => 6.6710, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.99% (0.3057 => 0.2874, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.98% (0.4083 => 0.3839, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.97% (0.6484 => 0.6097, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.97% (0.3016 => 0.2836, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -5.97% (0.4861 => 0.4571, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -5.96% (1.3148 => 1.2364, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: -5.96% (0.2989 => 0.2811, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.95% (0.3849 => 0.3620, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: -5.90% (1.2515 => 1.1776, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.90% (0.3252 => 0.3060, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: -5.90% (0.3255 => 0.3063, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.90% (0.9852 => 0.9271, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -5.90% (0.2849 => 0.2681, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.89% (5.4682 => 5.1461, std.dev.: 0.0062) SingleSource/Regression/C++/ofstream_ctor: -5.88% (0.3059 => 0.2879, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -5.86% (0.3481 => 0.3277, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -5.86% (16.1920 => 15.2432, std.dev.: 0.0144) MultiSource/Benchmarks/MallocBench/gs/gs: -5.83% (4.3330 => 4.0804, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/fibo: -5.82% (0.2871 => 0.2704, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -5.80% (0.3205 => 0.3019, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -5.79% (0.2659 => 0.2505, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.78% (4.8802 => 4.5979, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.78% (1.6474 => 1.5522, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -5.77% (0.3621 => 0.3412, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -5.77% (2.4021 => 2.2635, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.76% (4.8161 => 4.5386, std.dev.: 0.0091) SingleSource/UnitTests/ObjC++/Hello: -5.75% (0.6347 => 0.5982, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.75% (0.7919 => 0.7464, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -5.72% (0.4248 => 0.4005, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.72% (0.4321 => 0.4074, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: -5.67% (0.7779 => 0.7338, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: -5.66% (0.3867 => 0.3648, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -5.66% (0.6750 => 0.6368, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary3: -5.66% (0.3446 => 0.3251, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.65% (0.2548 => 0.2404, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.65% (0.4427 => 0.4177, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.64% (1.0544 => 0.9949, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -5.62% (0.3788 => 0.3575, std.dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference-object: -5.60% (0.6441 => 0.6080, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.60% (1.2784 => 1.2068, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary: -5.57% (0.3394 => 0.3205, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.57% (0.5999 => 0.5665, std.dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: -5.54% (34.0927 => 32.2030, std.dev.: 0.0181) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.53% (1.2221 => 1.1545, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.48% (4.0323 => 3.8115, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.46% (0.7198 => 0.6805, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.42% (1.2210 => 1.1548, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: -5.42% (0.4524 => 0.4279, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.29% (0.8521 => 0.8070, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -5.28% (4.0594 => 3.8450, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.27% (0.3491 => 0.3307, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.27% (0.2999 => 0.2841, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.27% (0.3931 => 0.3724, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.24% (0.4813 => 0.4561, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.20% (0.6293 => 0.5966, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.18% (0.3323 => 0.3151, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.18% (2.2587 => 2.1418, std.dev.: 0.0201) MultiSource/Applications/kimwitu++/kc: -5.17% (18.2933 => 17.3478, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.16% (1.3722 => 1.3014, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.15% (1.4642 => 1.3888, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.14% (0.2278 => 0.2161, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.11% (0.2933 => 0.2783, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -5.10% (0.7982 => 0.7575, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.06% (1.6364 => 1.5536, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: -5.04% (9.2283 => 8.7628, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.01% (0.6052 => 0.5749, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.97% (0.9557 => 0.9082, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.95% (0.5859 => 0.5569, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.94% (0.5591 => 0.5315, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.93% (0.6667 => 0.6338, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.89% (0.5925 => 0.5635, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.87% (0.6446 => 0.6132, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.87% (0.5857 => 0.5572, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.86% (0.5478 => 0.5212, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.85% (0.6681 => 0.6357, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.84% (0.5581 => 0.5311, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.83% (0.6230 => 0.5929, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.83% (0.5802 => 0.5522, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.82% (0.7339 => 0.6985, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.81% (0.5575 => 0.5307, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.80% (0.4916 => 0.4680, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.80% (0.6395 => 0.6088, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.78% (0.5570 => 0.5304, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.76% (0.6304 => 0.6004, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.75% (0.6194 => 0.5900, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.74% (0.5863 => 0.5585, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.72% (0.5705 => 0.5436, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: -4.70% (0.4515 => 0.4303, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.68% (0.6297 => 0.6002, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.68% (0.6260 => 0.5967, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: -4.67% (0.7447 => 0.7099, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.66% (0.5456 => 0.5202, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.65% (0.2385 => 0.2274, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.65% (0.7524 => 0.7174, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.64% (0.6676 => 0.6366, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.63% (0.5941 => 0.5666, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: -4.62% (0.9179 => 0.8755, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: -4.61% (0.3581 => 0.3416, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.60% (0.5805 => 0.5538, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.59% (0.6033 => 0.5756, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.59% (0.6189 => 0.5905, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.55% (0.3319 => 0.3168, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.55% (0.5849 => 0.5583, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/BoolLiteralTest: -4.54% (0.3834 => 0.3660, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.53% (0.6660 => 0.6358, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -4.52% (1.1450 => 1.0933, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.49% (0.6440 => 0.6151, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.43% (0.5688 => 0.5436, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.43% (0.6395 => 0.6112, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.42% (0.5567 => 0.5321, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: -4.38% (15.5079 => 14.8285, std.dev.: 0.0095) MultiSource/Benchmarks/sim/sim: -4.37% (0.3406 => 0.3257, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: -4.37% (0.3271 => 0.3128, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: -4.37% (0.8418 => 0.8050, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.32% (8.0126 => 7.6666, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.20% (0.7021 => 0.6726, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: -4.19% (1.5610 => 1.4956, std.dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.17% (6.7716 => 6.4891, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.17% (0.6736 => 0.6455, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -4.16% (2.1401 => 2.0510, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -4.09% (17.1032 => 16.4029, std.dev.: 0.0226) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.02% (0.5168 => 0.4960, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -3.97% (5.0226 => 4.8230, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.88% (0.3483 => 0.3348, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: -3.83% (3.5154 => 3.3806, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.82% (1.2300 => 1.1830, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.78% (0.9077 => 0.8734, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.72% (0.5329 => 0.5131, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.71% (0.2695 => 0.2595, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: -3.67% (1.1530 => 1.1107, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -3.34% (20.7746 => 20.0801, std.dev.: 0.0330) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.32% (14.2083 => 13.7361, std.dev.: 0.0150) MultiSource/Applications/SIBsim4/SIBsim4: -2.03% (1.3864 => 1.3583, std.dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7502, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: -8.61% (1.2842 => 1.1736, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.87% (1.7753 => 1.7066, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.86% (2.2633 => 2.1760, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.04% (1.0557 => 1.0236, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.52% (6.5735 => 6.4733, std.dev.: 0.0028) Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 30 18:26:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 30 Oct 2012 20:26:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121031012640.91F4B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5425?compare_to=5421&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5425, Order: 167057, Start Time: 2012-10-30 23:05:37, End Time: 2012-10-31 01:26:40 To: 5421, Order: 167043, Start Time: 2012-10-30 20:14:47, End Time: 2012-10-30 22:35:20 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (17 on baseline) New Passes: 0 (14 on baseline) Performance Regressions: 3 (179 on baseline) Performance Improvements: 0 (46 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 22 (5 on baseline) Unchanged Tests: 1017 (647 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 14.22% (0.5112 => 0.5839, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.86% (0.8606 => 0.8766, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.63% (3.2174 => 3.4628, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/lemon/lemon MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Shootout-C++/ary2 MultiSource/Applications/JM/ldecod/ldecod: 1079.81% (0.0104 => 0.1227, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -2.86% (0.0105 => 0.0102, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 0.02% (13.1469 => 13.1491, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 0.46% (1.4502 => 1.4568, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 0.08% (0.1331 => 0.1332) MultiSource/Applications/sqlite3/sqlite3: 40.00% (0.0005 => 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0076 => 0.0076) MultiSource/Benchmarks/Bullet/bullet: 0.09% (0.1166 => 0.1167, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: -0.01% (499.8359 => 499.7921, std.dev.: 0.0175) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.14% (0.0721 => 0.0720, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 0.04% (0.2551 => 0.2552, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/bh/bh: - (0.0176 => 0.0176) MultiSource/Benchmarks/Olden/power/power: 0.00% (13.1367 => 13.1372, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -0.29% (0.0341 => 0.0340, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: - (0.0574 => 0.0574, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0524 => 0.0524, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.18% (0.0330 => 0.0357, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.96% (0.0051 => 0.0050, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.06% (38.0628 => 36.5165, std.dev.: 1.9075) SingleSource/Benchmarks/BenchmarkGame/n-body: 658300.00% (0.0002 => 1.3168, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -0.02% (3.0442 => 3.0437, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -0.13% (0.0757 => 0.0756, std.dev.: 0.0002) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/lemon/lemon MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Shootout-C++/ary2 MultiSource/Applications/JM/ldecod/ldecod: -5.47% (0.1298 => 0.1227, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 0.75% (1.4460 => 1.4568, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -99.98% (4.6441 => 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.83% (4.3882 => 0.0076) MultiSource/Benchmarks/Bullet/bullet: -98.91% (10.7105 => 0.1167, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 423811.87% (0.1179 => 499.7921, std.dev.: 0.0175) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -35.99% (0.3987 => 0.2552, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/bh/bh: -99.09% (1.9405 => 0.0176) MultiSource/Benchmarks/Olden/power/power: 1064.96% (1.1277 => 13.1372, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -99.96% (85.0658 => 0.0340, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -33.56% (0.0864 => 0.0574, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.24% (0.0611 => 0.0524, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -29.45% (0.0506 => 0.0357, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 35.14% (0.0037 => 0.0050, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.11% (3.2416 => 3.0437, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -0.13% (0.0757 => 0.0756, std.dev.: 0.0002) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 199.62% (0.5229 => 1.5667, std.dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 13.72% (14.9895 => 17.0454, std.dev.: 0.0082) MultiSource/Applications/kimwitu++/kc: 36.08% (14.1553 => 19.2629, std.dev.: 0.0403) MultiSource/Benchmarks/MallocBench/gs/gs: 13.40% (4.1105 => 4.6613, std.dev.: 0.0107) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 29.59% (1.1048 => 1.4317, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 305.74% (7.1582 => 29.0438, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.10% (3.4629 => 5.8212, std.dev.: 0.0146) SingleSource/Benchmarks/Misc-C++/stepanov_container: 63.69% (0.6222 => 1.0185, std.dev.: 0.0014) New Passes - Execution Time --------------------------- MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SPASS/SPASS: 11175200.00% (0.0001 => 11.1753, std.dev.: 0.0256) MultiSource/Applications/kimwitu++/kc: 51400.00% (0.0001 => 0.0515, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 66500.00% (0.0001 => 0.0666) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050100.00% (0.0001 => 10.0502, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5490700.00% (0.0001 => 5.4908, std.dev.: 0.0164) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 39.58% (0.1056 => 0.1474, std.dev.: 0.0006) SingleSource/UnitTests/vla: 29.01% (0.0355 => 0.0458, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 27.86% (0.1432 => 0.1831, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 23.41% (0.0457 => 0.0564, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 23.31% (0.0798 => 0.0984, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.99% (0.0648 => 0.0797, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.07% (0.1566 => 0.1896, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.60% (0.0842 => 0.1007, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 19.55% (0.0793 => 0.0948, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.85% (0.0886 => 0.1053, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 18.71% (0.1555 => 0.1846, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.70% (0.0770 => 0.0914, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.22% (0.8172 => 0.9661, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.73% (0.2758 => 0.3247, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.72% (0.2065 => 0.2431, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/rem: 17.66% (0.1144 => 0.1346, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.39% (0.0834 => 0.0979, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 17.35% (0.2554 => 0.2997, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 17.35% (0.1695 => 0.1989, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 17.33% (0.0675 => 0.0792, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 17.29% (0.1151 => 0.1350, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.10% (0.1117 => 0.1308, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.99% (0.0871 => 0.1019, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 16.99% (0.0730 => 0.0854, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 16.97% (0.3177 => 0.3716, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.95% (0.3121 => 0.3650, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/mst/mst: 16.94% (0.1163 => 0.1360, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 16.85% (0.1175 => 0.1373, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 16.79% (0.4879 => 0.5698, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.62% (0.1029 => 0.1200, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 16.54% (0.1584 => 0.1846, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 15.82% (0.0746 => 0.0864, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 15.68% (0.2271 => 0.2627, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.61% (0.2107 => 0.2436, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 15.15% (0.7115 => 0.8193, std.dev.: 0.0113) MultiSource/Applications/spiff/spiff: 15.12% (0.7835 => 0.9020, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 15.11% (0.1655 => 0.1905, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.97% (0.1062 => 0.1221, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.96% (0.2700 => 0.3104, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.84% (0.1125 => 0.1292, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.60% (0.5981 => 0.6854, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: 14.55% (1.1642 => 1.3336, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.44% (0.1337 => 0.1530, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.38% (0.0730 => 0.0835, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.38% (0.1940 => 0.2219, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 14.28% (0.5569 => 0.6364, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 14.20% (0.5105 => 0.5830, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 14.18% (0.7433 => 0.8487, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.06% (0.5860 => 0.6684, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 14.05% (22.1758 => 25.2913, std.dev.: 0.0085) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.02% (0.4615 => 0.5262, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 13.89% (3.3354 => 3.7988, std.dev.: 0.0098) MultiSource/Applications/sgefa/sgefa: 13.86% (0.3109 => 0.3540, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.75% (0.1906 => 0.2168, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.74% (0.9765 => 1.1107, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.58% (0.1510 => 0.1715, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 13.57% (0.5020 => 0.5701, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.48% (0.1625 => 0.1844, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.46% (0.3441 => 0.3904, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.27% (1.5415 => 1.7460, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.25% (0.0770 => 0.0872, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.21% (0.6675 => 0.7557, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.77% (0.1143 => 0.1289, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 12.71% (2.0273 => 2.2850, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 12.56% (3.8723 => 4.3585, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/exptree: 12.53% (0.0814 => 0.0916, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.32% (1.3050 => 1.4658, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.31% (0.1032 => 0.1159, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 12.08% (0.6450 => 0.7229, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.05% (1.1861 => 1.3290, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.02% (0.2603 => 0.2916, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 11.99% (0.1268 => 0.1420, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 11.98% (1.0722 => 1.2006, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 11.96% (0.4299 => 0.4813, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.82% (0.3307 => 0.3698, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/18-imp/imp: 11.74% (0.3423 => 0.3825, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.74% (0.3543 => 0.3959, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 11.71% (0.8921 => 0.9966, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.57% (0.1236 => 0.1379, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 11.40% (0.3473 => 0.3869, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.31% (0.3927 => 0.4371, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.28% (4.2646 => 4.7456, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-4: 11.26% (0.3543 => 0.3942, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 11.18% (0.3497 => 0.3888, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 11.17% (8.1363 => 9.0448, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/hash: 11.14% (0.4289 => 0.4767, std.dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 11.14% (1.1840 => 1.3159, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 11.06% (0.3561 => 0.3955, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 11.04% (0.3387 => 0.3761, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/exceptions-3: 11.04% (0.3516 => 0.3904, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 10.97% (0.3180 => 0.3529, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 10.94% (0.3694 => 0.4098, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 10.94% (0.1463 => 0.1623, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.92% (0.3828 => 0.4246, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.87% (0.0929 => 0.1030, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.84% (0.1892 => 0.2097, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.78% (0.3886 => 0.4305, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.73% (0.8101 => 0.8970, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.69% (1.4186 => 1.5703, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 10.58% (9.4845 => 10.4876, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.54% (1.5859 => 1.7531, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.50% (0.1695 => 0.1873, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.45% (0.1330 => 0.1469, std.dev.: 0.0017) MultiSource/Applications/siod/siod: 10.43% (2.2969 => 2.5364, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.15% (0.1044 => 0.1150, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.14% (0.4636 => 0.5106, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/bigfib: 10.13% (0.6456 => 0.7110, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.03% (2.2024 => 2.4232, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.99% (2.2022 => 2.4222, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 9.98% (1.5603 => 1.7160, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.67% (14.3668 => 15.7554, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.63% (0.2430 => 0.2664, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 9.61% (0.3422 => 0.3751, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 9.47% (0.7326 => 0.8020, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash2: 9.37% (0.4620 => 0.5053, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.33% (0.4203 => 0.4595, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.29% (0.3865 => 0.4224, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.25% (4.9449 => 5.4025, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.14% (5.0018 => 5.4589, std.dev.: 0.0091) SingleSource/UnitTests/ObjC++/Hello: 8.98% (0.5925 => 0.6457, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 8.96% (0.6030 => 0.6570, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.75% (0.4103 => 0.4462, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.66% (0.8067 => 0.8766, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.61% (0.3427 => 0.3722, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 8.60% (0.4048 => 0.4396, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 8.58% (0.3684 => 0.4000, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.57% (0.3826 => 0.4154, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.27% (0.2793 => 0.3024, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 8.26% (0.2905 => 0.3145, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/sieve: 8.16% (0.3603 => 0.3897, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.78% (0.2725 => 0.2937, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.67% (0.3650 => 0.3930, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.66% (0.2756 => 0.2967, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 7.64% (17.1811 => 18.4942, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/hello: 7.55% (0.2714 => 0.2919, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.51% (0.2891 => 0.3108, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 7.49% (0.3283 => 0.3529, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.49% (2.0665 => 2.2212, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/strcat: 7.38% (0.2831 => 0.3040, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 7.37% (5.7591 => 6.1838, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.37% (0.3162 => 0.3395, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 7.30% (0.3098 => 0.3324, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: 7.26% (0.2877 => 0.3086, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.24% (0.3232 => 0.3466, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.23% (0.4064 => 0.4358, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.21% (0.2871 => 0.3078, std.dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: 7.01% (1.2842 => 1.3742, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.93% (0.2872 => 0.3071, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 6.91% (0.3052 => 0.3263, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 6.87% (0.3379 => 0.3611, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.71% (0.2802 => 0.2990, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 6.66% (0.3092 => 0.3298, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.90% (0.3136 => 0.3321, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/oourafft: 5.42% (0.3282 => 0.3460, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.39% (3.8922 => 4.1021, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 4.92% (0.3131 => 0.3285, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.81% (0.2266 => 0.2375, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (0.3935 => 0.4080, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.54% (0.3817 => 0.3952, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.17% (7.9617 => 8.1345, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.46% (7.0540 => 7.1572, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 19.80% (2.8904 => 3.4628, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.62% (1.1145 => 1.2997, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.45% (0.2944 => 0.3281, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.93% (1.1396 => 1.2528, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 8.96% (0.1629 => 0.1775, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3680, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.43% (0.3463 => 0.3651, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.4162 => 0.4322, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.74% (4.2280 => 4.3440, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7650, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bisort/bisort: 1.80% (0.8333 => 0.8483, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2078, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.32% (11.6436 => 11.7970, std.dev.: 0.0057) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.88% (6.6874 => 0.1415, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -76.93% (0.8651 => 0.1996, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.62% (5.3855 => 2.3902, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -55.17% (5.3526 => 2.3997, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/richards_benchmark: -44.82% (0.1622 => 0.0895, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.36% (1.1194 => 0.6788, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.31% (5.2763 => 3.2548, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -24.67% (1.7609 => 1.3264, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -17.21% (2.9384 => 2.4326, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: -9.97% (10.4361 => 9.3958, std.dev.: 0.0073) MultiSource/Benchmarks/Bullet/bullet: -9.96% (63.2438 => 56.9455, std.dev.: 0.0189) SingleSource/UnitTests/Vector/constpool: -8.98% (54.1659 => 49.3002, std.dev.: 0.0283) MultiSource/Benchmarks/PAQ8p/paq8p: -5.04% (10.3673 => 9.8450, std.dev.: 0.0096) MultiSource/Applications/JM/lencod/lencod: -1.96% (21.9371 => 21.5081, std.dev.: 0.0105) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -43.00% (0.0400 => 0.0228, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.51% (1.1492 => 0.7641, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4247, std.dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: -10.98% (9.5636 => 8.5131, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -10.90% (1.5373 => 1.3697, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.32% (19.9488 => 18.2899, std.dev.: 0.0729) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.97% (1.8329 => 1.7052, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/mason/mason: -6.52% (0.2161 => 0.2020, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -6.35% (1.2373 => 1.1587, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.62% (1.9577 => 1.8476, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -5.45% (6.6465 => 6.2841, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.03% (1.6805 => 1.5959, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -5.00% (1.5835 => 1.5043, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.37% (0.9957 => 0.9522, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.00% (0.2497 => 0.2397, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.70% (3.2827 => 3.1611, std.dev.: 0.0074) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.52% (32.5116 => 31.3688, std.dev.: 0.0131) MultiSource/Benchmarks/sim/sim: -3.23% (5.0483 => 4.8852, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.86% (4.5009 => 4.3720, std.dev.: 0.0026) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.68% (0.4808 => 0.4679, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.02% (8.1563 => 7.9914, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/salsa20: -1.73% (10.2830 => 10.1052, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops: -1.71% (8.8334 => 8.6824, std.dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.53% (2.5528 => 2.5138, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.10% (6.2999 => 6.2304, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: -85.83% (0.0720 => 0.0102, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 13149000.00% (0.0001 => 13.1491, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -65.97% (0.2116 => 0.0720, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 36516400.00% (0.0001 => 36.5165, std.dev.: 1.9075) Report Time: 1.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 30 18:34:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 30 Oct 2012 20:34:16 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121031013416.EC95E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5426?compare_to=5423&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5426, Order: 167059, Start Time: 2012-10-31 00:06:21, End Time: 2012-10-31 01:34:18 To: 5423, Order: 167054, Start Time: 2012-10-30 22:20:50, End Time: 2012-10-30 23:49:22 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 26 (120 on baseline) Performance Improvements: 5 (6 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 960 (848 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 4.69% (8.4639 => 8.8607, std.dev.: 0.0085) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.73% (0.3275 => 0.3397, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.58% (0.3048 => 0.3157, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.64% (0.7775 => 0.7980, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.57% (0.5097 => 0.5228, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.44% (0.8910 => 0.9127, std.dev.: 0.0060) MultiSource/Benchmarks/PAQ8p/paq8p: 2.43% (2.4024 => 2.4608, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.40% (0.9026 => 0.9243, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.23% (0.8525 => 0.8715, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.12% (0.8990 => 0.9181, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.11% (0.9754 => 0.9960, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.02% (0.8254 => 0.8421, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.91% (0.9229 => 0.9405, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.90% (0.8926 => 0.9096, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.81% (0.8451 => 0.8604, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.74% (1.3630 => 1.3867, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.73% (0.8186 => 0.8328, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.68% (0.6593 => 0.6704, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.63% (0.6140 => 0.6240, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.62% (0.8391 => 0.8527, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.57% (0.8431 => 0.8563, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.46% (0.8347 => 0.8469, std.dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 16.09% (3.1849 => 3.6973, std.dev.: 0.0655) SingleSource/Benchmarks/Shootout-C++/heapsort: 13.44% (3.2312 => 3.6654, std.dev.: 0.1138) MultiSource/Applications/sgefa/sgefa: 3.08% (0.3503 => 0.3611, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/ary3: 1.88% (2.1080 => 2.1477, std.dev.: 0.0057) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.38% (0.8671 => 0.8551, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -4.25% (22.5259 => 21.5682, std.dev.: 0.1154) MultiSource/Benchmarks/Prolangs-C++/primes/primes: -3.64% (0.7947 => 0.7658, std.dev.: 0.0085) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.39% (1.1428 => 1.1269, std.dev.: 0.0034) MultiSource/Benchmarks/BitBench/five11/five11: -1.12% (5.6171 => 5.5544, std.dev.: 0.0166) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.11% (16.6146 => 16.5959, std.dev.: 0.0921) MultiSource/Applications/obsequi/Obsequi: 0.72% (1.0651 => 1.0728, std.dev.: 0.0052) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.86% (21.5705 => 22.4036, std.dev.: 0.0939) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.55% (0.3660 => 0.3680, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/bigfib: -0.18% (0.6043 => 0.6032, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.78% (0.3334 => 0.3360, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/strcat: 1.76% (0.1985 => 0.2020, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.46% (0.0219 => 0.0218, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -10.28% (0.0428 => 0.0384, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0331 => 0.0331, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0313 => 0.0312, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.47% (0.0424 => 0.0426, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0204 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -0.46% (0.0219 => 0.0218, std.dev.: 0.0022) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -38.46% (0.0013 => 0.0008, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.55% (0.1462 => 0.1454, std.dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.47% (1.1488 => 1.1542, std.dev.: 0.0148) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 0.33% (0.1511 => 0.1516, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.63% (0.4048 => 0.3982, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.11% (0.1353 => 0.1338, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.62% (0.0643 => 0.0647, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 31.43% (0.0210 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.90% (0.0576 => 0.0542, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.43% (1.1475 => 1.1524, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 72.22% (0.0018 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -74.07% (0.0027 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.12% (0.0604 => 0.0647, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.04% (0.0259 => 0.0233, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.01% (0.8025 => 0.8024, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0051 => 0.0051, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2325.13% (0.6332 => 15.3559, std.dev.: 0.4080) MultiSource/Benchmarks/McCat/08-main/main: 47.19% (0.1831 => 0.2695, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.98% (0.1559 => 0.1497, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1477.51% (0.3344 => 5.2752, std.dev.: 0.0961) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.55% (0.2364 => 0.3228, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/mandel: 2.56% (0.0429 => 0.0440, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.80% (0.0224 => 0.0237, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4382, std.dev.: 0.0261) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0727, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4945, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3429, std.dev.: 0.0157) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0226, std.dev.: 0.0440) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4080, std.dev.: 0.0016) SingleSource/Regression/C/uint64_to_float: -23.84% (2.1832 => 1.6627, std.dev.: 0.0125) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0008) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 35.88% (14.7684 => 20.0674, std.dev.: 0.0986) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.31% (0.0810 => 0.0934, std.dev.: 0.0018) SingleSource/UnitTests/SignlessTypes/rem: 14.20% (0.1035 => 0.1182, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 12.77% (0.1112 => 0.1254, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.68% (0.1425 => 0.1563, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.22% (0.2180 => 0.2381, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.08% (0.1157 => 0.1262, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.34% (0.6010 => 0.6511, std.dev.: 0.0052) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.29% (0.3137 => 0.3397, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.16% (0.2279 => 0.2465, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.86% (0.4847 => 0.5228, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.45% (0.8321 => 0.8941, std.dev.: 0.0216) MultiSource/Applications/SIBsim4/SIBsim4: 6.79% (1.2568 => 1.3421, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.78% (0.7473 => 0.7980, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.63% (0.6287 => 0.6704, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.58% (0.1885 => 0.2009, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 6.47% (0.1577 => 0.1679, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.35% (0.1983 => 0.2109, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.12% (0.8148 => 0.8647, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.74% (0.2998 => 0.3170, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.72% (0.1905 => 0.2014, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.56% (0.9435 => 0.9960, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.52% (13.1811 => 13.9089, std.dev.: 0.0942) MultiSource/Applications/spiff/spiff: 5.51% (0.7950 => 0.8388, std.dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.39% (0.4783 => 0.5041, std.dev.: 0.0071) MultiSource/Benchmarks/nbench/nbench: 5.33% (1.1271 => 1.1872, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.31% (0.3295 => 0.3470, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: 5.26% (8.4179 => 8.8607, std.dev.: 0.0085) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.25% (0.2741 => 0.2885, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.13% (0.3003 => 0.3157, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.07% (1.6386 => 1.7216, std.dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.05% (6.6074 => 6.9413, std.dev.: 0.0500) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.05% (1.1170 => 1.1734, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.04% (1.1606 => 1.2191, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.96% (0.2240 => 0.2351, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 4.94% (0.8697 => 0.9127, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.88% (0.2133 => 0.2237, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.85% (0.5817 => 0.6099, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 4.79% (0.8317 => 0.8715, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.76% (1.1685 => 1.2241, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.75% (0.4127 => 0.4323, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.68% (0.5961 => 0.6240, std.dev.: 0.0021) MultiSource/Applications/Burg/burg: 4.57% (1.2222 => 1.2780, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.43% (1.3279 => 1.3867, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 4.41% (0.8712 => 0.9096, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 4.38% (0.8855 => 0.9243, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 4.27% (0.8805 => 0.9181, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 4.15% (0.8261 => 0.8604, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.14% (0.8086 => 0.8421, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.10% (0.8286 => 0.8626, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.08% (0.3115 => 0.3242, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 4.05% (0.9039 => 0.9405, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 4.04% (0.8359 => 0.8697, std.dev.: 0.0078) MultiSource/Applications/sgefa/sgefa: 4.03% (0.2999 => 0.3120, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.96% (0.8007 => 0.8324, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 3.94% (0.8204 => 0.8527, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.90% (0.9074 => 0.9428, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.90% (8.6476 => 8.9846, std.dev.: 0.0465) SingleSource/Benchmarks/Shootout-C++/sieve: 3.88% (0.2755 => 0.2862, std.dev.: 0.0035) MultiSource/Applications/treecc/treecc: 3.78% (1.9948 => 2.0703, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.75% (0.3657 => 0.3794, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 3.73% (0.4125 => 0.4279, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.71% (0.3124 => 0.3240, std.dev.: 0.0035) MultiSource/Applications/hbd/hbd: 3.71% (1.4269 => 1.4798, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 3.67% (0.8331 => 0.8637, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.64% (0.9908 => 1.0269, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.57% (0.8457 => 0.8759, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.57% (0.8177 => 0.8469, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.56% (0.5191 => 0.5376, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: 3.55% (2.3764 => 2.4608, std.dev.: 0.0161) MultiSource/Benchmarks/Prolangs-C/football/football: 3.54% (0.8768 => 0.9078, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/hash: 3.53% (0.3800 => 0.3934, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.50% (0.6227 => 0.6445, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.48% (0.8048 => 0.8328, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 3.47% (4.1305 => 4.2740, std.dev.: 0.0364) MultiSource/Applications/d/make_dparser: 3.46% (3.2366 => 3.3487, std.dev.: 0.0285) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.41% (1.4479 => 1.4973, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/lists1: 3.37% (0.2969 => 0.3069, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 3.35% (0.8066 => 0.8336, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.33% (0.8597 => 0.8883, std.dev.: 0.0089) MultiSource/Applications/minisat/minisat: 3.28% (0.6834 => 0.7058, std.dev.: 0.0067) MultiSource/Applications/SPASS/SPASS: 3.28% (14.2605 => 14.7278, std.dev.: 0.0818) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.25% (0.8656 => 0.8937, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 3.21% (0.8927 => 0.9214, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.21% (0.8420 => 0.8690, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.14% (4.1763 => 4.3076, std.dev.: 0.0271) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.07% (0.6586 => 0.6788, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.06% (0.7966 => 0.8210, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/moments: 3.05% (0.3645 => 0.3756, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.01% (0.8050 => 0.8292, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.98% (4.5702 => 4.7065, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.97% (0.9688 => 0.9976, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.91% (0.7932 => 0.8163, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.90% (4.4873 => 4.6173, std.dev.: 0.0464) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.87% (0.8316 => 0.8555, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.83% (1.2526 => 1.2881, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.83% (0.9056 => 0.9312, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.70% (0.8338 => 0.8563, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.53% (0.8340 => 0.8551, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.51% (0.8518 => 0.8732, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.44% (0.8716 => 0.8929, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.36% (1.2602 => 1.2900, std.dev.: 0.0051) MultiSource/Applications/JM/ldecod/ldecod: 2.26% (6.7320 => 6.8841, std.dev.: 0.0342) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.13% (4.4880 => 4.5838, std.dev.: 0.0267) MultiSource/Applications/JM/lencod/lencod: 1.99% (15.3280 => 15.6331, std.dev.: 0.0774) MultiSource/Applications/siod/siod: 1.56% (2.2184 => 2.2529, std.dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 59.03% (1.5795 => 2.5118, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.50% (2.7978 => 3.7351, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/heapsort: 20.12% (3.0515 => 3.6654, std.dev.: 0.1138) SingleSource/Benchmarks/Shootout/heapsort: 12.29% (3.2926 => 3.6973, std.dev.: 0.0655) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.88% (2.4333 => 2.6981, std.dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.16% (1.1857 => 1.2824, std.dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 5.98% (63.1822 => 66.9593, std.dev.: 0.0537) SingleSource/Benchmarks/Misc/ReedSolomon: 2.94% (8.5322 => 8.7832, std.dev.: 0.0056) MultiSource/Applications/siod/siod: 2.67% (3.6643 => 3.7623, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout/ary3: 2.52% (2.0949 => 2.1477, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/bh/bh: 1.56% (2.3560 => 2.3928, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/richards_benchmark: 1.42% (1.3037 => 1.3222, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.39% (59.2638 => 60.0895, std.dev.: 0.0627) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.35% (1.5941 => 1.6156, std.dev.: 0.0076) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.07% (0.3269 => 0.3038, std.dev.: 0.0035) MultiSource/Applications/lua/lua: -5.03% (29.8330 => 28.3323, std.dev.: 0.1726) MultiSource/Benchmarks/nbench/nbench: -1.81% (21.9654 => 21.5682, std.dev.: 0.1154) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.52% (3.3479 => 3.2971, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash2: -1.22% (3.4237 => 3.3818, std.dev.: 0.0071) MultiSource/Benchmarks/Fhourstones/fhourstones: -1.07% (1.2822 => 1.2685, std.dev.: 0.0047) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.91% (16.4461 => 16.5959, std.dev.: 0.0921) MultiSource/Applications/obsequi/Obsequi: 4.54% (1.0262 => 1.0728, std.dev.: 0.0052) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7073.74% (0.3123 => 22.4036, std.dev.: 0.0939) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.41% (0.2463 => 0.3680, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/bigfib: 0.37% (0.6010 => 0.6032, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.88% (0.3266 => 0.3360, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/strcat: 2.59% (0.1969 => 0.2020, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.88% (0.0408 => 0.0384, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.31% (0.0254 => 0.0331, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.94% (0.0384 => 0.0426, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0022) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 14.29% (0.0007 => 0.0008, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 1.11% (0.1438 => 0.1454, std.dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.88% (1.1329 => 1.1542, std.dev.: 0.0148) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.69% (0.1462 => 0.1516, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.37% (0.4164 => 0.3982, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.26% (0.1369 => 0.1338, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.94% (0.0641 => 0.0647, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.54% (0.0195 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.23% (0.0578 => 0.0542, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.76% (1.1437 => 1.1524, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -50.00% (0.0014 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.19% (0.0627 => 0.0647, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 29.44% (0.0180 => 0.0233, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.09% (0.8017 => 0.8024, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -17.74% (0.0062 => 0.0051, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 30 18:58:00 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 30 Oct 2012 20:58:00 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121031015800.4AED02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5427?compare_to=5424&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5427, Order: 167064, Start Time: 2012-10-31 00:32:50, End Time: 2012-10-31 01:57:59 To: 5424, Order: 167055, Start Time: 2012-10-30 22:44:39, End Time: 2012-10-31 00:09:45 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (7 on baseline) Performance Improvements: 0 (175 on baseline) Unchanged Tests: 1042 (860 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.26% (15.2527 => 18.3435, std.dev.: 0.0118) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.14% (3.1919 => 3.4199, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.81% (54.5751 => 56.1107, std.dev.: 0.2225) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.64% (2.0478 => 2.1019, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/salsa20: 2.52% (7.4937 => 7.6824, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/hash2: 2.21% (3.1932 => 3.2638, std.dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.94% (0.1431 => 0.1303, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.40% (0.1584 => 0.1451, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.80% (0.3821 => 0.3523, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -6.99% (2.4924 => 2.3183, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.72% (0.3142 => 0.2931, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.62% (22.4056 => 20.9214, std.dev.: 0.0187) SingleSource/Benchmarks/Misc/ReedSolomon: -6.49% (0.1879 => 0.1757, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.43% (0.2428 => 0.2272, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.33% (0.9542 => 0.8938, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -6.26% (0.3831 => 0.3591, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -6.19% (0.3812 => 0.3576, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -6.19% (0.3880 => 0.3640, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.18% (0.3884 => 0.3644, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.14% (0.3891 => 0.3652, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -6.13% (0.3848 => 0.3612) SingleSource/UnitTests/ObjC/exceptions: -6.13% (0.4176 => 0.3920, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.12% (0.4151 => 0.3897, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: -6.12% (0.3025 => 0.2840, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.07% (2.1713 => 2.0394, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -6.05% (0.4033 => 0.3789, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.05% (0.3837 => 0.3605, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.04% (0.3658 => 0.3437, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -6.03% (0.3896 => 0.3661, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -6.01% (0.3026 => 0.2844, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.00% (4.5069 => 4.2364, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.98% (0.3849 => 0.3619, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.97% (3.5339 => 3.3229, std.dev.: 0.0070) MultiSource/Applications/sgefa/sgefa: -5.96% (0.3357 => 0.3157, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.93% (0.3323 => 0.3126, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.92% (0.2903 => 0.2731, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.90% (0.4083 => 0.3842, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.90% (5.4682 => 5.1457, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.89% (0.3057 => 0.2877, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -5.88% (0.4861 => 0.4575, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -5.86% (0.2849 => 0.2682, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/property: -5.86% (0.4199 => 0.3953, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -5.85% (0.3059 => 0.2880, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.85% (0.6484 => 0.6105, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.84% (0.3252 => 0.3062, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -5.82% (0.3194 => 0.3008, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -5.82% (0.2939 => 0.2768, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -5.80% (0.3481 => 0.3279, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -5.80% (7.0961 => 6.6845, std.dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: -5.80% (1.3148 => 1.2386, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: -5.79% (0.2989 => 0.2816, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.77% (0.2355 => 0.2219, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: -5.77% (0.4280 => 0.4033, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -5.76% (1.2515 => 1.1794, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.76% (1.6474 => 1.5525, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/matrix: -5.75% (0.3255 => 0.3068, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -5.74% (0.3205 => 0.3021, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -5.74% (0.2160 => 0.2036, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.69% (0.9852 => 0.9291, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.69% (0.4321 => 0.4075, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: -5.68% (16.1920 => 15.2715, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists: -5.66% (0.3621 => 0.3416, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -5.62% (0.3788 => 0.3575, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -5.60% (0.4248 => 0.4010, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: -5.57% (0.3446 => 0.3254, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.54% (0.3016 => 0.2849, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.53% (0.4427 => 0.4182, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -5.53% (0.3867 => 0.3653, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -5.53% (4.3330 => 4.0936, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.51% (1.2784 => 1.2079, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -5.51% (0.6750 => 0.6378, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.51% (4.8802 => 4.6113, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/fibo: -5.50% (0.2871 => 0.2713, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.50% (4.8161 => 4.5512, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.50% (1.2210 => 1.1539, std.dev.: 0.0037) MultiSource/Applications/siod/siod: -5.49% (2.4021 => 2.2703, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.47% (0.7919 => 0.7486, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.41% (1.0544 => 0.9974, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.39% (1.2221 => 1.1562, std.dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: -5.38% (34.0927 => 32.2590, std.dev.: 0.0169) MultiSource/Benchmarks/McCat/08-main/main: -5.38% (0.2659 => 0.2516, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: -5.35% (0.4524 => 0.4282, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.33% (4.0323 => 3.8175, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.32% (0.8521 => 0.8068, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -5.30% (0.3394 => 0.3214, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.26% (0.2548 => 0.2414, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.18% (0.3491 => 0.3310, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.18% (0.2933 => 0.2781, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.16% (2.2587 => 2.1421, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: -5.16% (0.2985 => 0.2831, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.15% (0.4813 => 0.4565, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.15% (0.5999 => 0.5690, std.dev.: 0.0015) MultiSource/Applications/lua/lua: -5.14% (4.0594 => 3.8509, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.11% (1.6364 => 1.5528, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.06% (0.5925 => 0.5625, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.06% (0.3931 => 0.3732, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.04% (0.9557 => 0.9075, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.01% (0.6052 => 0.5749, std.dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: -4.98% (9.2283 => 8.7684, std.dev.: 0.0167) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.96% (0.2278 => 0.2165, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.94% (1.4642 => 1.3918, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.92% (0.5857 => 0.5569, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.88% (1.3722 => 1.3053, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.87% (0.6446 => 0.6132, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.87% (0.2999 => 0.2853, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.87% (0.6676 => 0.6351, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.86% (0.5591 => 0.5319, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.86% (0.5802 => 0.5520, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: -4.85% (18.2933 => 17.4060, std.dev.: 0.0148) SingleSource/UnitTests/ObjC++/property-reference: -4.85% (0.7779 => 0.7402, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.83% (0.7198 => 0.6850, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.83% (0.6293 => 0.5989, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.83% (0.5859 => 0.5576, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.82% (0.6681 => 0.6359, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.82% (0.6230 => 0.5930, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.81% (0.6194 => 0.5896, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.81% (0.5575 => 0.5307, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -4.80% (0.7982 => 0.7599, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.79% (0.5805 => 0.5527, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.79% (0.5705 => 0.5432, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.78% (0.6395 => 0.6089, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.78% (0.5581 => 0.5314, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.78% (0.5478 => 0.5216, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.78% (0.5570 => 0.5304, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.77% (0.6304 => 0.6003, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.77% (0.7339 => 0.6989, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -4.76% (0.6347 => 0.6045, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: -4.72% (0.3581 => 0.3412, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.68% (0.6260 => 0.5967, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.67% (0.5456 => 0.5201, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.65% (0.5569 => 0.5310, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.65% (0.5849 => 0.5577, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.62% (0.6297 => 0.6006, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.61% (0.5941 => 0.5667, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.59% (0.6189 => 0.5905, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.57% (0.6033 => 0.5757, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.57% (0.5863 => 0.5595, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/BoolLiteralTest: -4.56% (0.3834 => 0.3659, std.dev.: 0.0049) SingleSource/UnitTests/ObjC++/property-reference-object: -4.55% (0.6441 => 0.6148) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.55% (0.7524 => 0.7182, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.54% (0.4916 => 0.4693, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.53% (0.6440 => 0.6148, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.53% (0.2385 => 0.2277, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.50% (0.5688 => 0.5432, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: -4.50% (0.7447 => 0.7112, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.47% (0.6660 => 0.6362, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.40% (0.3319 => 0.3173, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: -4.38% (0.9179 => 0.8777, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: -4.38% (1.1450 => 1.0949, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.37% (0.5567 => 0.5324, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.36% (0.7021 => 0.6715, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: -4.32% (0.4515 => 0.4320, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.32% (0.6395 => 0.6119, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.29% (0.3406 => 0.3260, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: -4.23% (15.5079 => 14.8523, std.dev.: 0.0377) MultiSource/Applications/oggenc/oggenc: -4.03% (5.0226 => 4.8203, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.99% (0.3483 => 0.3344, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.96% (0.6736 => 0.6469, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -3.96% (8.0126 => 7.6950, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: -3.96% (17.1032 => 16.4253, std.dev.: 0.0110) MultiSource/Benchmarks/McCat/09-vor/vor: -3.94% (0.3271 => 0.3142, std.dev.: 0.0016) MultiSource/Applications/spiff/spiff: -3.92% (0.8418 => 0.8088, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -3.91% (2.1401 => 2.0564, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.91% (0.5168 => 0.4966, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: -3.89% (1.5610 => 1.5003, std.dev.: 0.0108) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.89% (6.7716 => 6.5085, std.dev.: 0.0032) MultiSource/Applications/d/make_dparser: -3.79% (3.5154 => 3.3820, std.dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.73% (0.5329 => 0.5130, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.63% (1.2300 => 1.1853, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: -3.51% (1.1530 => 1.1125, std.dev.: 0.0085) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.47% (0.9077 => 0.8762, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.17% (14.2083 => 13.7582, std.dev.: 0.0060) SingleSource/UnitTests/Vector/constpool: -3.10% (20.7746 => 20.1302, std.dev.: 0.0367) MultiSource/Applications/SIBsim4/SIBsim4: -1.98% (1.3864 => 1.3590, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7544, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/richards_benchmark: -8.61% (1.2842 => 1.1736) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7060, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.79% (2.2633 => 2.1775, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0245, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.47% (6.5735 => 6.4770, std.dev.: 0.0025) Report Time: 2.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 30 20:17:48 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 30 Oct 2012 22:17:48 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121031031749.00C112A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5428?compare_to=5426&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5428, Order: 167093, Start Time: 2012-10-31 01:51:10, End Time: 2012-10-31 03:17:50 To: 5426, Order: 167059, Start Time: 2012-10-31 00:06:21, End Time: 2012-10-31 01:34:18 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 4 (90 on baseline) Performance Improvements: 31 (4 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 956 (880 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.88% (0.3197 => 0.3481, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.05% (3.8051 => 3.9974, std.dev.: 0.0603) MultiSource/Benchmarks/Prolangs-C++/life/life: 2.96% (2.5605 => 2.6363, std.dev.: 0.0083) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.63% (2.6887 => 2.7595, std.dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.35% (0.1497 => 0.1387, std.dev.: 0.0038) SingleSource/UnitTests/Vector/constpool: -5.62% (8.8607 => 8.3625, std.dev.: 0.1238) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.67% (0.3794 => 0.3617, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.43% (1.4973 => 1.4609, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -2.20% (0.8421 => 0.8236, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -1.98% (0.6704 => 0.6571, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -1.98% (0.8324 => 0.8159, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.97% (0.9243 => 0.9061, std.dev.: 0.0026) MultiSource/Applications/Burg/burg: -1.96% (1.2780 => 1.2529, std.dev.: 0.0082) MultiSource/Applications/hbd/hbd: -1.80% (1.4798 => 1.4532, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.78% (0.8604 => 0.8451, std.dev.: 0.0038) MultiSource/Benchmarks/PAQ8p/paq8p: -1.78% (2.4608 => 2.4171, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.73% (0.9096 => 0.8939, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.71% (0.9181 => 0.9024, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.69% (0.8759 => 0.8611, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.66% (0.8697 => 0.8553, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.64% (0.8715 => 0.8572, std.dev.: 0.0021) MultiSource/Applications/spiff/spiff: -1.62% (0.8388 => 0.8252, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.55% (0.8626 => 0.8492, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.51% (0.9405 => 0.9263, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -1.32% (0.8690 => 0.8575, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -1.30% (0.8469 => 0.8359, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -1.25% (0.8336 => 0.8232, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.08% (0.9428 => 0.9326, std.dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: -14.80% (3.6654 => 3.1228, std.dev.: 0.0319) SingleSource/Benchmarks/Shootout/heapsort: -13.49% (3.6973 => 3.1986, std.dev.: 0.0600) SingleSource/Benchmarks/CoyoteBench/lpbench: -3.12% (4.0322 => 3.9063, std.dev.: 0.0287) SingleSource/Benchmarks/Shootout/ary3: -2.44% (2.1477 => 2.0952, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -2.06% (2.0432 => 2.0012, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout/hash: -1.15% (4.3440 => 4.2941, std.dev.: 0.0126) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.13% (1.2554 => 1.2412, std.dev.: 0.0025) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.22% (16.5959 => 16.6321, std.dev.: 0.0199) MultiSource/Applications/obsequi/Obsequi: -1.69% (1.0728 => 1.0547, std.dev.: 0.0064) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.27% (22.4036 => 21.6703, std.dev.: 0.0993) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.95% (0.3680 => 0.3645, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/bigfib: -0.07% (0.6032 => 0.6028, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.36% (0.3360 => 0.3348, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -2.52% (0.2020 => 0.1969, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0218 => 0.0218, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 10.42% (0.0384 => 0.0424, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.60% (0.0331 => 0.0333, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -21.15% (0.0312 => 0.0246, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.23% (0.0426 => 0.0425, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -11.33% (0.0203 => 0.0180, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0218 => 0.0218, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -87.50% (0.0008 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -1.03% (0.1454 => 0.1439, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: -4.35% (1.1542 => 1.1040, std.dev.: 0.0279) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -5.41% (0.1516 => 0.1434, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.75% (0.3982 => 0.4171, std.dev.: 0.0165) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.60% (0.1338 => 0.1330, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.63% (0.0647 => 0.0630, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.55% (0.0542 => 0.0539, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.02% (1.1524 => 1.1406, std.dev.: 0.0388) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.77% (0.0031 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 28.57% (0.0007 => 0.0009, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.15% (0.0647 => 0.0646, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.15% (0.0233 => 0.0221, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.05% (0.8024 => 0.8020, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -85.71% (0.0007 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -7.84% (0.0051 => 0.0047, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2345.14% (0.6332 => 15.4826, std.dev.: 0.0346) MultiSource/Benchmarks/McCat/08-main/main: 45.60% (0.1831 => 0.2666, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -11.03% (0.1559 => 0.1387, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1477.99% (0.3344 => 5.2768, std.dev.: 0.0389) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.55% (0.2364 => 0.3228, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: 3.26% (0.0429 => 0.0443, std.dev.: 0.0000) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 3.12% (0.0224 => 0.0231, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -31.30% (0.0230 => 0.0158, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4425, std.dev.: 0.0135) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0753, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4951, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3521, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0234, std.dev.: 0.0153) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4032, std.dev.: 0.0034) SingleSource/Regression/C/uint64_to_float: -24.50% (2.1832 => 1.6483, std.dev.: 0.0069) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 35.67% (14.7684 => 20.0368, std.dev.: 0.0128) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.32% (0.0810 => 0.0926, std.dev.: 0.0023) SingleSource/UnitTests/SignlessTypes/rem: 12.75% (0.1035 => 0.1167, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 12.05% (0.1112 => 0.1246, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.52% (0.2180 => 0.2344, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.20% (0.2279 => 0.2443, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.98% (0.8321 => 0.8902, std.dev.: 0.0073) MultiSource/Applications/SIBsim4/SIBsim4: 6.54% (1.2568 => 1.3390, std.dev.: 0.0201) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.19% (0.4847 => 0.5147, std.dev.: 0.0105) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.18% (0.3137 => 0.3331, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.97% (13.1811 => 13.9686, std.dev.: 0.0218) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.42% (1.1170 => 1.1775, std.dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.31% (6.6074 => 6.9582, std.dev.: 0.0103) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.29% (0.2741 => 0.2886, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.08% (0.2519 => 0.2647, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.07% (0.7473 => 0.7852, std.dev.: 0.0122) MultiSource/Benchmarks/nbench/nbench: 4.60% (1.1271 => 1.1790, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.52% (0.6287 => 0.6571, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.28% (0.4559 => 0.4754, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.86% (1.6386 => 1.7019, std.dev.: 0.0113) MultiSource/Applications/spiff/spiff: 3.80% (0.7950 => 0.8252, std.dev.: 0.0042) MultiSource/Applications/lemon/lemon: 3.79% (1.0945 => 1.1360, std.dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.78% (0.5191 => 0.5387, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.75% (8.6476 => 8.9719, std.dev.: 0.0864) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.74% (0.4783 => 0.4962, std.dev.: 0.0024) MultiSource/Applications/d/make_dparser: 3.73% (3.2366 => 3.3574, std.dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.57% (0.6227 => 0.6449, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/football/football: 3.54% (0.8768 => 0.9078, std.dev.: 0.0049) MultiSource/Applications/treecc/treecc: 3.31% (1.9948 => 2.0609, std.dev.: 0.0131) MultiSource/Applications/minisat/minisat: 3.31% (0.6834 => 0.7060, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.11% (0.6586 => 0.6791, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.07% (0.8317 => 0.8572, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.00% (0.4127 => 0.4251, std.dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 2.97% (14.2605 => 14.6839, std.dev.: 0.0660) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.96% (4.1763 => 4.2998, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 2.87% (0.3800 => 0.3909, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.86% (0.8611 => 0.8857, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.78% (0.9074 => 0.9326, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.68% (0.9908 => 1.0174, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.66% (0.8331 => 0.8553, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.61% (0.8712 => 0.8939, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.60% (0.8656 => 0.8881, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.59% (0.8597 => 0.8820, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/hash2: 2.55% (0.4125 => 0.4230, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.54% (4.4880 => 4.6021, std.dev.: 0.0241) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.54% (1.2602 => 1.2922, std.dev.: 0.0077) MultiSource/Applications/Burg/burg: 2.51% (1.2222 => 1.2529, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.49% (0.8805 => 0.9024, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.49% (0.8286 => 0.8492, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.48% (0.9039 => 0.9263, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.43% (0.9688 => 0.9923, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.39% (0.8927 => 0.9140, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.37% (0.7932 => 0.8120, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.37% (0.8069 => 0.8260, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.34% (0.8518 => 0.8717, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.33% (0.8855 => 0.9061, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.32% (0.8359 => 0.8553, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.30% (0.9069 => 0.9278, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.30% (0.8261 => 0.8451, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.27% (0.8995 => 0.9199, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.23% (0.8177 => 0.8359, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.13% (0.8338 => 0.8516, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.10% (2.1401 => 2.1850, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.08% (4.4873 => 4.5805, std.dev.: 0.0260) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.06% (0.8066 => 0.8232, std.dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 2.05% (15.3280 => 15.6423, std.dev.: 0.0352) MultiSource/Benchmarks/mafft/pairlocalalign: 2.04% (8.6247 => 8.8007, std.dev.: 0.0337) MultiSource/Applications/oggenc/oggenc: 2.04% (4.9628 => 5.0640, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.95% (0.8316 => 0.8478, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.90% (0.8007 => 0.8159, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.88% (0.8885 => 0.9052, std.dev.: 0.0055) MultiSource/Applications/lua/lua: 1.85% (3.8189 => 3.8894, std.dev.: 0.0259) MultiSource/Applications/hbd/hbd: 1.84% (1.4269 => 1.4532, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.84% (0.8420 => 0.8575, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.82% (0.8457 => 0.8611, std.dev.: 0.0041) MultiSource/Benchmarks/PAQ8p/paq8p: 1.71% (2.3764 => 2.4171, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.56% (4.5702 => 4.6413, std.dev.: 0.0256) MultiSource/Applications/hexxagon/hexxagon: 1.18% (0.9810 => 0.9926, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.68% (1.5795 => 2.5064, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.25% (2.7978 => 3.7282, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.33% (2.4333 => 2.6603, std.dev.: 0.0171) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.26% (0.3186 => 0.3481, std.dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.03% (1.1857 => 1.2809, std.dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 5.91% (63.1822 => 66.9164, std.dev.: 0.0353) MultiSource/Applications/siod/siod: 2.68% (3.6643 => 3.7625, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.25% (44.5605 => 45.5633, std.dev.: 0.2694) MultiSource/Applications/minisat/minisat: 2.08% (6.1525 => 6.2802, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/ReedSolomon: 1.97% (8.5322 => 8.7007, std.dev.: 0.0425) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.34% (4.8362 => 4.9010, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/whetstone: 1.05% (2.1224 => 2.1447, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.80% (0.3269 => 0.3014, std.dev.: 0.0044) MultiSource/Applications/lua/lua: -5.11% (29.8330 => 28.3081, std.dev.: 0.0287) MultiSource/Benchmarks/Ptrdist/ft/ft: -1.68% (0.8789 => 0.8641, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: -1.45% (3.4237 => 3.3739, std.dev.: 0.0033) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.13% (16.4461 => 16.6321, std.dev.: 0.0199) MultiSource/Applications/obsequi/Obsequi: 2.78% (1.0262 => 1.0547, std.dev.: 0.0064) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6838.94% (0.3123 => 21.6703, std.dev.: 0.0993) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.99% (0.2463 => 0.3645, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/bigfib: 0.30% (0.6010 => 0.6028, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.51% (0.3266 => 0.3348, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.1969 => 0.1969, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.92% (0.0408 => 0.0424, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -18.54% (0.0302 => 0.0246, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -5.26% (0.0190 => 0.0180, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1438 => 0.1439, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0001) MultiSource/Applications/lemon/lemon: -2.55% (1.1329 => 1.1040, std.dev.: 0.0279) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: -1.92% (0.1462 => 0.1434, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.17% (0.4164 => 0.4171, std.dev.: 0.0165) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.85% (0.1369 => 0.1330, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.72% (0.0641 => 0.0630, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.75% (0.0578 => 0.0539, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.27% (1.1437 => 1.1406, std.dev.: 0.0388) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -35.71% (0.0014 => 0.0009, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.03% (0.0627 => 0.0646, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.78% (0.0180 => 0.0221, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.04% (0.8017 => 0.8020, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -24.19% (0.0062 => 0.0047, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 30 20:46:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 30 Oct 2012 22:46:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121031034627.2BAA32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5429?compare_to=5427&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5429, Order: 167093, Start Time: 2012-10-31 02:20:59, End Time: 2012-10-31 03:46:27 To: 5427, Order: 167064, Start Time: 2012-10-31 00:32:50, End Time: 2012-10-31 01:57:59 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (6 on baseline) Performance Improvements: 0 (173 on baseline) Unchanged Tests: 1042 (863 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.11% (15.2527 => 18.3205, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.15% (3.1919 => 3.4200, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1012, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 2.41% (7.4937 => 7.6742, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/hash2: 2.24% (3.1932 => 3.2647, std.dev.: 0.0109) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.46% (0.1584 => 0.1450, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.46% (0.1431 => 0.1310, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.30% (0.3821 => 0.3542, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -6.74% (2.4924 => 2.3245, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.26% (0.2428 => 0.2276, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.21% (0.3142 => 0.2947, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.15% (0.3658 => 0.3433, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.07% (22.4056 => 21.0462, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/ReedSolomon: -6.07% (0.1879 => 0.1765, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: -5.84% (0.3357 => 0.3161) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.81% (0.9542 => 0.8988, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.75% (3.5339 => 3.3308, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/oourafft: -5.74% (0.2160 => 0.2036, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.65% (0.9852 => 0.9295, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.64% (4.5069 => 4.2526, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.61% (0.6484 => 0.6120, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -5.61% (7.0961 => 6.6981, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.61% (5.4682 => 5.1616, std.dev.: 0.0063) MultiSource/Applications/Burg/burg: -5.59% (1.2515 => 1.1815, std.dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: -5.57% (16.1920 => 15.2905, std.dev.: 0.0075) MultiSource/Applications/siod/siod: -5.55% (2.4021 => 2.2687, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.54% (0.4151 => 0.3921, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -5.53% (0.2659 => 0.2512, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.44% (0.7919 => 0.7488, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.43% (1.6474 => 1.5579, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: -5.42% (4.3330 => 4.0981, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.39% (0.2355 => 0.2228, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: -5.39% (0.3026 => 0.2863, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -5.38% (1.3148 => 1.2440, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: -5.36% (0.3025 => 0.2863, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.34% (2.1713 => 2.0554, std.dev.: 0.0091) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.33% (1.2784 => 1.2102, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: -5.32% (0.2989 => 0.2830, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.32% (0.3837 => 0.3633, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.28% (4.8802 => 4.6223, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.27% (0.3057 => 0.2896, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.25% (0.5999 => 0.5684, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.24% (0.4083 => 0.3869, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.24% (4.8161 => 4.5637, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/random: -5.24% (0.2939 => 0.2785, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -5.23% (0.3194 => 0.3027, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -5.22% (0.3255 => 0.3085, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.21% (0.8521 => 0.8077, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.18% (0.2548 => 0.2416, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.17% (0.2903 => 0.2753, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: -5.16% (0.4861 => 0.4610, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.16% (4.0323 => 3.8243, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary2: -5.14% (0.3481 => 0.3302, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -5.14% (0.6750 => 0.6403, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -5.13% (0.3059 => 0.2902, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.11% (1.0544 => 1.0005, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.10% (1.2221 => 1.1598, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.09% (1.2210 => 1.1588, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: -5.09% (0.2849 => 0.2704, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -5.09% (0.3205 => 0.3042, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.09% (0.2871 => 0.2725, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.07% (0.3252 => 0.3087, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.04% (0.3849 => 0.3655, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -5.04% (0.3394 => 0.3223, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -5.03% (0.3621 => 0.3439, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: -5.02% (0.3788 => 0.3598, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: -5.00% (18.2933 => 17.3782, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.00% (0.4321 => 0.4105, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.99% (0.4427 => 0.4206, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -4.99% (0.2985 => 0.2836, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: -4.97% (0.3880 => 0.3687, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: -4.94% (0.4248 => 0.4038, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: -4.93% (0.4033 => 0.3834, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -4.93% (4.0594 => 3.8591, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-2: -4.93% (0.3831 => 0.3642, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: -4.93% (0.4524 => 0.4301, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: -4.93% (0.3896 => 0.3704, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.92% (0.3884 => 0.3693, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -4.91% (0.7982 => 0.7590, std.dev.: 0.0062) SingleSource/UnitTests/ObjC/trivial-interface: -4.91% (0.3812 => 0.3625, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.90% (0.2999 => 0.2852, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -4.89% (1.6364 => 1.5564, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.86% (2.2587 => 2.1489, std.dev.: 0.0173) MultiSource/Benchmarks/mafft/pairlocalalign: -4.86% (9.2283 => 8.7797, std.dev.: 0.0186) SingleSource/UnitTests/ObjC/exceptions: -4.86% (0.4176 => 0.3973, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.85% (0.5591 => 0.5320, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: -4.84% (0.3867 => 0.3680, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -4.83% (0.4199 => 0.3996, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -4.83% (0.3848 => 0.3662, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -4.82% (0.3446 => 0.3280, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.81% (0.3891 => 0.3704, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -4.79% (34.0927 => 32.4601, std.dev.: 0.0184) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.78% (0.6293 => 0.5992, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.78% (1.4642 => 1.3942, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.76% (0.6052 => 0.5764, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.71% (0.5857 => 0.5581, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.70% (0.4813 => 0.4587, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.69% (1.3722 => 1.3079, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.68% (0.5705 => 0.5438, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.68% (0.6304 => 0.6009, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: -4.67% (0.4280 => 0.4080, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.67% (0.6681 => 0.6369, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.67% (0.5805 => 0.5534, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.66% (0.7339 => 0.6997, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.65% (0.5478 => 0.5223, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.65% (0.7198 => 0.6863, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.65% (0.5802 => 0.5532, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.64% (0.5925 => 0.5650, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.64% (0.3491 => 0.3329, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.63% (0.3323 => 0.3169, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.60% (0.5581 => 0.5324, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.60% (0.3931 => 0.3750, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.59% (0.6667 => 0.6361, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.57% (0.5859 => 0.5591, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.56% (0.7524 => 0.7181, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.54% (0.5941 => 0.5671, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -4.53% (0.7779 => 0.7427, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.52% (0.6660 => 0.6359, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.52% (0.6395 => 0.6106, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.51% (0.6446 => 0.6155, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.51% (0.6297 => 0.6013, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.50% (0.5863 => 0.5599, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.50% (0.5849 => 0.5586, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.48% (0.9557 => 0.9129, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.48% (0.2278 => 0.2176, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.47% (0.5569 => 0.5320, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.47% (0.5570 => 0.5321, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: -4.47% (0.3581 => 0.3421, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.46% (0.6676 => 0.6378, std.dev.: 0.0057) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.46% (0.3319 => 0.3171, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.44% (0.6033 => 0.5765, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.44% (0.6194 => 0.5919, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.42% (0.6260 => 0.5983, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.38% (0.5456 => 0.5217, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.38% (0.6440 => 0.6158, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.38% (0.6189 => 0.5918, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.35% (0.6230 => 0.5959, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.34% (0.5575 => 0.5333, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.33% (0.4916 => 0.4703, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.33% (0.5567 => 0.5326, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.27% (0.5688 => 0.5445, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -4.23% (1.1450 => 1.0966, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.19% (0.2933 => 0.2810, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: -4.16% (0.4515 => 0.4327, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: -4.14% (0.7447 => 0.7139, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: -4.13% (0.9179 => 0.8800, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.10% (0.6395 => 0.6133, std.dev.: 0.0070) MultiSource/Applications/oggenc/oggenc: -4.09% (5.0226 => 4.8174, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/property-reference-object: -4.08% (0.6441 => 0.6178, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -4.08% (0.6347 => 0.6088, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -4.07% (0.3271 => 0.3138, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: -4.05% (15.5079 => 14.8800, std.dev.: 0.0139) MultiSource/Applications/spiff/spiff: -3.98% (0.8418 => 0.8083, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.97% (0.7021 => 0.6742, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: -3.93% (2.1401 => 2.0559, std.dev.: 0.0023) MultiSource/Benchmarks/sim/sim: -3.90% (0.3406 => 0.3273, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.90% (0.3483 => 0.3347, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: -3.76% (17.1032 => 16.4602, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -3.68% (8.0126 => 7.7178, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.55% (0.6736 => 0.6497, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.50% (1.2300 => 1.1870, std.dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -3.49% (20.7746 => 20.0487, std.dev.: 0.0269) MultiSource/Applications/d/make_dparser: -3.48% (3.5154 => 3.3930, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.46% (0.5168 => 0.4989, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: -3.43% (1.1530 => 1.1135, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.42% (0.5329 => 0.5147, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.40% (6.7716 => 6.5411, std.dev.: 0.0059) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.38% (0.9077 => 0.8770, std.dev.: 0.0030) MultiSource/Applications/hbd/hbd: -3.00% (1.5610 => 1.5142, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.93% (14.2083 => 13.7919, std.dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: -1.88% (1.3864 => 1.3603, std.dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7527, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: -8.69% (1.2842 => 1.1726, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7061, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.68% (2.2633 => 2.1800, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.18% (1.0557 => 1.0221, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4672, std.dev.: 0.0056) Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 30 20:47:39 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 30 Oct 2012 22:47:39 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121031034739.727202A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5430?compare_to=5422&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5430, Order: 167059, Start Time: 2012-10-31 00:31:58, End Time: 2012-10-31 03:47:40 To: 5422, Order: 167041, Start Time: 2012-10-30 20:28:08, End Time: 2012-10-30 23:43:32 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (172 on baseline) Performance Improvements: 1 (20 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1038 (716 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/sqlite3/sqlite3: 1.03% (2.2137 => 2.2366, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 8.10% (116.9905 => 126.4702, std.dev.: 2.2816) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 7.50% (69.7032 => 74.9318, std.dev.: 0.0217) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/whetstone: -1.20% (2.8268 => 2.7929, std.dev.: 0.0072) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 39.36% (0.0625 => 0.0871, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.51% (0.1063 => 0.1398, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.83% (0.2969 => 0.3736, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.68% (0.1106 => 0.1390, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.23% (0.4139 => 0.5142, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.85% (0.5900 => 0.7307, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.47% (0.4253 => 0.5251, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.39% (0.0714 => 0.0881, std.dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 23.35% (1.5932 => 1.9652, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.98% (0.5000 => 0.6149, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.95% (0.0475 => 0.0584, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 22.93% (0.4994 => 0.6139, std.dev.: 0.0046) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.77% (0.0584 => 0.0717) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.49% (0.0547 => 0.0670, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.19% (0.0897 => 0.1096, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 21.70% (0.0599 => 0.0729, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.54% (0.1620 => 0.1969, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.45% (0.1021 => 0.1240, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 20.87% (0.1107 => 0.1338, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 20.53% (0.0604 => 0.0728, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.52% (0.3903 => 0.4704, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.52% (0.0541 => 0.0652, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 20.36% (0.0948 => 0.1141, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.21% (0.0584 => 0.0702, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.14% (0.1549 => 0.1861, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.06% (0.0633 => 0.0760, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.04% (0.1103 => 0.1324, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.94% (0.0642 => 0.0770, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: 19.85% (0.0821 => 0.0984, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 19.64% (0.1619 => 0.1937, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.64% (0.1604 => 0.1919, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.54% (0.1003 => 0.1199, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.46% (0.0822 => 0.0982, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.95% (0.1462 => 0.1739, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.56% (0.0582 => 0.0690, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 18.48% (0.0947 => 0.1122, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 18.44% (0.0808 => 0.0957, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.20% (0.3890 => 0.4598, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.02% (0.2014 => 0.2377, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: 17.98% (0.1218 => 0.1437, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: 17.87% (0.4029 => 0.4749, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.80% (0.2736 => 0.3223, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/09-vor/vor: 17.67% (0.1505 => 0.1771, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.59% (0.2866 => 0.3370, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.56% (0.1088 => 0.1279, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.53% (1.3152 => 1.5457, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/mst/mst: 17.48% (0.0698 => 0.0820, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.00% (0.3271 => 0.3827, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 16.95% (0.5546 => 0.6486, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 16.94% (1.8794 => 2.1978, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 16.86% (0.0605 => 0.0707, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.83% (3.5627 => 4.1624, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.75% (0.4658 => 0.5438, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.72% (0.1968 => 0.2297, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.57% (0.5026 => 0.5859, std.dev.: 0.0064) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.41% (1.6211 => 1.8872, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.38% (0.1160 => 0.1350, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 16.33% (0.1421 => 0.1653, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.25% (0.2738 => 0.3183, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.24% (0.2875 => 0.3342, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.17% (0.4361 => 0.5066, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 15.99% (1.0781 => 1.2505, std.dev.: 0.0061) SingleSource/UnitTests/ObjC++/Hello: 15.98% (0.5826 => 0.6757, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 15.85% (0.9697 => 1.1234, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.79% (4.4195 => 5.1175, std.dev.: 0.0185) SingleSource/UnitTests/ObjC++/property-reference-object: 15.76% (0.5889 => 0.6817, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 15.60% (0.2725 => 0.3150, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 15.58% (0.1284 => 0.1484, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.47% (2.7292 => 3.1513, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.45% (0.3930 => 0.4537, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 15.40% (0.2714 => 0.3132, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 15.40% (4.2109 => 4.8594, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.28% (0.2729 => 0.3146, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.08% (1.9694 => 2.2664, std.dev.: 0.0038) SingleSource/Regression/C++/ofstream_ctor: 15.08% (0.3004 => 0.3457, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/random: 15.02% (0.2803 => 0.3224, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 15.02% (0.3096 => 0.3561, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.01% (1.9966 => 2.2963, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: 14.98% (0.2750 => 0.3162, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 14.96% (23.5202 => 27.0388, std.dev.: 0.0139) MultiSource/Applications/hexxagon/hexxagon: 14.95% (0.9909 => 1.1390, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.94% (0.2911 => 0.3346, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 14.89% (0.2780 => 0.3194, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.87% (0.3060 => 0.3515, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.86% (0.2792 => 0.3207) MultiSource/Benchmarks/Prolangs-C/football/football: 14.80% (0.2075 => 0.2382, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.77% (0.3195 => 0.3667, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.77% (0.1090 => 0.1251, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 14.74% (0.2823 => 0.3239, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 14.73% (0.2811 => 0.3225, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 14.68% (0.2813 => 0.3226, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.67% (2.0673 => 2.3706, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 14.57% (0.3267 => 0.3743, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/ary: 14.27% (0.3258 => 0.3723, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 14.26% (0.2566 => 0.2932, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 14.14% (0.3317 => 0.3786, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.13% (0.3362 => 0.3837, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 13.95% (1.4269 => 1.6260, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 13.90% (0.7171 => 0.8168, std.dev.: 0.0036) MultiSource/Applications/treecc/treecc: 13.79% (0.7875 => 0.8961, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 13.72% (0.4146 => 0.4715, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.67% (0.3124 => 0.3551, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 13.59% (0.3348 => 0.3803, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 13.54% (0.3678 => 0.4176, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 13.50% (0.3726 => 0.4229, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.41% (0.3282 => 0.3722, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.39% (0.3690 => 0.4184, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 13.29% (0.3477 => 0.3939, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.24% (0.3845 => 0.4354, std.dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: 13.24% (2.1653 => 2.4519, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.21% (0.3625 => 0.4104, std.dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 13.17% (4.6177 => 5.2257, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/hash2: 13.15% (0.4251 => 0.4810, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.11% (0.3981 => 0.4503, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 12.89% (2.1013 => 2.3721, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/exceptions-4: 12.81% (0.3465 => 0.3909, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.79% (0.2040 => 0.2301, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 12.77% (0.3460 => 0.3902, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-2: 12.77% (0.3446 => 0.3886, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.73% (0.3496 => 0.3941, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 12.67% (0.5012 => 0.5647, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/synchronized: 12.65% (0.3469 => 0.3908, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.64% (0.3488 => 0.3929, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 12.64% (0.3442 => 0.3877, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.51% (0.1383 => 0.1556, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 12.45% (0.2691 => 0.3026, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions: 12.38% (0.3643 => 0.4094, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 12.33% (0.3650 => 0.4100, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 12.30% (0.3724 => 0.4182, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.59% (0.6435 => 0.7181, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 11.39% (5.5417 => 6.1727, std.dev.: 0.0178) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.19% (0.1028 => 0.1143) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.12% (0.2068 => 0.2298, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 11.01% (0.3498 => 0.3883, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 10.72% (0.6634 => 0.7345, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.49% (0.2737 => 0.3024, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 10.46% (0.4847 => 0.5354, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.25% (0.3084 => 0.3400, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 10.22% (0.3336 => 0.3677, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 9.93% (2.0346 => 2.2366, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.75% (0.2103 => 0.2308, std.dev.: 0.0049) MultiSource/Applications/lemon/lemon: 9.62% (0.2391 => 0.2621, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.10% (4.6926 => 5.1196, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.62% (11.6398 => 12.6436, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.38% (0.5361 => 0.5810, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.08% (0.5584 => 0.6035, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.90% (0.7426 => 0.8013, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 6.27% (11.9555 => 12.7053, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.56% (0.3792 => 0.3927, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.27% (0.2162 => 0.3530, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6533, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 9.89% (0.2802 => 0.3079, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6092, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 6.17% (0.2122 => 0.2253, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/objinst: 5.08% (12.0509 => 12.6634, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.77% (0.3693 => 0.3869, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: 4.73% (15.4430 => 16.1729, std.dev.: 0.0290) SingleSource/Benchmarks/Misc/flops-2: 3.75% (1.8057 => 1.8734, std.dev.: 0.0053) SingleSource/Benchmarks/Dhrystone/dry: 2.71% (14.0481 => 14.4293, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary3: 2.00% (15.8721 => 16.1901, std.dev.: 0.0085) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.71% (3.1722 => 3.2264, std.dev.: 0.0031) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3034, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2837, std.dev.: 0.0019) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5138, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5404, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 1.08% (50.0626 => 50.6047, std.dev.: 0.0153) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.07% (1.2451 => 1.2584, std.dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.39% (2.4764 => 2.4171, std.dev.: 0.0100) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.58% (25.4195 => 16.3746, std.dev.: 0.0110) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9783, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: -7.67% (35.5013 => 32.7774, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: -7.37% (0.2402 => 0.2225, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/tsp/tsp: -7.17% (2.1113 => 1.9599, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.25% (11.2080 => 10.8442, std.dev.: 0.0392) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7742, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.89% (0.6293 => 0.6111, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/mandel-2: -2.87% (3.6262 => 3.5222, std.dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/fldry: -2.40% (17.2379 => 16.8243, std.dev.: 0.0161) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.19% (41.7953 => 40.8784, std.dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5784, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4963, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.38% (21.9346 => 21.6313, std.dev.: 0.0724) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7161, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0436, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.06% (3.3991 => 3.3632, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.04% (105.3826 => 104.2910, std.dev.: 0.0354) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 30 21:18:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 30 Oct 2012 23:18:05 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121031041805.7C8ED2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5431?compare_to=5425&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5431, Order: 167092, Start Time: 2012-10-31 01:57:12, End Time: 2012-10-31 04:18:04 To: 5425, Order: 167057, Start Time: 2012-10-30 23:05:37, End Time: 2012-10-31 01:26:40 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (17 on baseline) New Passes: 0 (14 on baseline) Performance Regressions: 2 (181 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 22 (5 on baseline) Unchanged Tests: 1018 (646 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.09% (2.3902 => 2.4163, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.32% (54.7553 => 56.5736, std.dev.: 0.1179) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/lemon/lemon MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Shootout-C++/ary2 MultiSource/Applications/JM/ldecod/ldecod: -0.16% (0.1227 => 0.1225, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 8.82% (0.0102 => 0.0111, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 0.00% (13.1491 => 13.1492, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -0.13% (1.4568 => 1.4549, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: - (0.1332 => 0.1332) MultiSource/Applications/sqlite3/sqlite3: - (0.0007 => 0.0007, std.dev.: 0.3506) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0076 => 0.0076) MultiSource/Benchmarks/Bullet/bullet: 0.09% (0.1167 => 0.1168, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pifft/pifft: 0.01% (499.7921 => 499.8368, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.14% (0.0720 => 0.0719, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: - (0.2552 => 0.2552) MultiSource/Benchmarks/Olden/bh/bh: - (0.0176 => 0.0176) MultiSource/Benchmarks/Olden/power/power: -0.00% (13.1372 => 13.1367, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0340 => 0.0340, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: - (0.0574 => 0.0574, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.95% (0.0524 => 0.0529, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.48% (0.0357 => 0.0341, std.dev.: 0.0093) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.00% (0.0050 => 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.88% (36.5165 => 38.2992, std.dev.: 0.2554) SingleSource/Benchmarks/BenchmarkGame/n-body: - (1.3168 => 1.3168, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 0.01% (3.0437 => 3.0439, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 0.13% (0.0756 => 0.0757, std.dev.: 0.0014) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/lemon/lemon MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Shootout-C++/ary2 MultiSource/Applications/JM/ldecod/ldecod: -5.62% (0.1298 => 0.1225, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 0.62% (1.4460 => 1.4549, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -99.98% (4.6441 => 0.0007, std.dev.: 0.3506) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.83% (4.3882 => 0.0076) MultiSource/Benchmarks/Bullet/bullet: -98.91% (10.7105 => 0.1168, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pifft/pifft: 423849.79% (0.1179 => 499.8368, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -35.99% (0.3987 => 0.2552) MultiSource/Benchmarks/Olden/bh/bh: -99.09% (1.9405 => 0.0176) MultiSource/Benchmarks/Olden/power/power: 1064.91% (1.1277 => 13.1367, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -99.96% (85.0658 => 0.0340, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -33.56% (0.0864 => 0.0574, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.42% (0.0611 => 0.0529, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -32.61% (0.0506 => 0.0341, std.dev.: 0.0093) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 37.84% (0.0037 => 0.0051) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.10% (3.2416 => 3.0439, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: - (0.0757 => 0.0757, std.dev.: 0.0014) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 199.20% (0.5229 => 1.5645, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 13.83% (14.9895 => 17.0631, std.dev.: 0.0067) MultiSource/Applications/kimwitu++/kc: 36.58% (14.1553 => 19.3336, std.dev.: 0.0064) MultiSource/Benchmarks/MallocBench/gs/gs: 13.67% (4.1105 => 4.6725, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 29.53% (1.1048 => 1.4310, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 306.07% (7.1582 => 29.0676, std.dev.: 0.0145) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.94% (3.4629 => 5.8502, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 63.81% (0.6222 => 1.0192, std.dev.: 0.0019) New Passes - Execution Time --------------------------- MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SPASS/SPASS: 11155900.00% (0.0001 => 11.1560, std.dev.: 0.0356) MultiSource/Applications/kimwitu++/kc: 51500.00% (0.0001 => 0.0516, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 66600.00% (0.0001 => 0.0667, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049600.00% (0.0001 => 10.0497, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5489600.00% (0.0001 => 5.4897, std.dev.: 0.0024) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 39.87% (0.1056 => 0.1477, std.dev.: 0.0000) SingleSource/UnitTests/vla: 29.30% (0.0355 => 0.0459, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 28.28% (0.1432 => 0.1837, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 23.85% (0.0457 => 0.0566, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.99% (0.0648 => 0.0797, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.58% (0.1566 => 0.1904, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.30% (0.0793 => 0.0954, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.07% (0.0842 => 0.1011, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 19.67% (0.0798 => 0.0955, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 19.06% (0.0834 => 0.0993, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.96% (0.0770 => 0.0916, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 18.85% (0.1151 => 0.1368, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 18.26% (0.1555 => 0.1839, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 18.26% (0.3177 => 0.3757, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.01% (0.8172 => 0.9644, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: 17.82% (0.2554 => 0.3009, std.dev.: 0.0006) SingleSource/UnitTests/SignlessTypes/rem: 17.74% (0.1144 => 0.1347, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 17.64% (0.1695 => 0.1994, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 17.63% (0.0675 => 0.0794, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.44% (0.2758 => 0.3239, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.38% (0.0886 => 0.1040, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.34% (0.2065 => 0.2423, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 17.28% (0.4879 => 0.5722, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 17.26% (0.0730 => 0.0856, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.20% (0.1029 => 0.1206, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 17.11% (0.1175 => 0.1376, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bisort/bisort: 17.10% (0.0614 => 0.0719, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.99% (0.0871 => 0.1019, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.92% (0.1117 => 0.1306, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 16.86% (0.1584 => 0.1851, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.85% (0.3121 => 0.3647, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/mst/mst: 16.85% (0.1163 => 0.1359, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.45% (0.1143 => 0.1331, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 16.35% (0.0746 => 0.0868, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.30% (0.0730 => 0.0849, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 15.63% (0.2271 => 0.2626, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 15.59% (0.1655 => 0.1913, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.47% (0.2107 => 0.2433, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.21% (0.1940 => 0.2235, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 15.20% (0.7835 => 0.9026, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.16% (0.1062 => 0.1223, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 15.12% (0.7115 => 0.8191, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 15.11% (0.1125 => 0.1295, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.81% (0.5981 => 0.6867, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.73% (0.1337 => 0.1534, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 14.65% (1.1642 => 1.3347, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 14.40% (0.5105 => 0.5840, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 14.33% (0.5569 => 0.6367, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.30% (0.2700 => 0.3086, std.dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 14.24% (22.1758 => 25.3328, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.19% (0.4615 => 0.5270, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 14.18% (0.7433 => 0.8487, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 14.06% (0.1906 => 0.2174, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.03% (0.1625 => 0.1853, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.94% (0.5860 => 0.6677, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.84% (0.9765 => 1.1116, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 13.78% (0.5020 => 0.5712, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 13.70% (0.3109 => 0.3535, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 13.61% (0.3497 => 0.3973, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.43% (0.3441 => 0.3903, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 13.40% (3.3354 => 3.7825, std.dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.38% (0.1510 => 0.1712, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.38% (0.0770 => 0.0873) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.21% (1.5415 => 1.7452, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.08% (0.6675 => 0.7548, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 12.68% (2.0273 => 2.2843, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.64% (0.2603 => 0.2932, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 12.59% (3.8723 => 4.3599, std.dev.: 0.0099) SingleSource/Benchmarks/McGill/exptree: 12.53% (0.0814 => 0.0916, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.50% (0.3543 => 0.3986, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 12.38% (0.1268 => 0.1425, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.31% (0.1032 => 0.1159, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 12.31% (0.3543 => 0.3979, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/05-eks/eks: 12.31% (0.4299 => 0.4828, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 12.25% (0.6450 => 0.7240, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.24% (1.3050 => 1.4647, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.22% (0.1236 => 0.1387, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.09% (1.1861 => 1.3295, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.04% (0.3927 => 0.4400, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.95% (0.3473 => 0.3888, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 11.71% (0.3423 => 0.3824, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.70% (0.3307 => 0.3694, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 11.68% (0.8921 => 0.9963, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.63% (0.3516 => 0.3925, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 11.60% (0.3561 => 0.3974, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.57% (0.3828 => 0.4271, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 11.53% (1.0722 => 1.1958, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 11.42% (0.3694 => 0.4116, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.35% (4.2646 => 4.7487, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 11.33% (8.1363 => 9.0580, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 11.30% (1.1840 => 1.3178, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 11.30% (0.3886 => 0.4325, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/09-vor/vor: 11.19% (0.3180 => 0.3536, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.06% (2.2022 => 2.4458, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 11.05% (9.4845 => 10.5321, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.98% (0.0929 => 0.1031, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: 10.87% (0.1463 => 0.1622, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 10.87% (0.3387 => 0.3755, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.80% (0.1695 => 0.1878, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.73% (0.1044 => 0.1156, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.61% (1.5859 => 1.7542, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.60% (1.4186 => 1.5690, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.58% (0.8101 => 0.8958, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 10.52% (0.4289 => 0.4740, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.46% (0.4636 => 0.5121, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.38% (0.1330 => 0.1468, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.36% (0.1892 => 0.2088, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 10.34% (0.3422 => 0.3776, std.dev.: 0.0026) MultiSource/Applications/siod/siod: 10.34% (2.2969 => 2.5343, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 10.08% (0.6456 => 0.7107, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.00% (0.2430 => 0.2673, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.94% (2.2024 => 2.4214, std.dev.: 0.0019) MultiSource/Applications/hbd/hbd: 9.91% (1.5603 => 1.7149, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 9.72% (0.4620 => 0.5069, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 9.69% (0.7326 => 0.8036, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.52% (0.3865 => 0.4233, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 9.49% (0.5925 => 0.6487, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.43% (0.4103 => 0.4490, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.35% (0.4203 => 0.4596, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.28% (4.9449 => 5.4039, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.16% (14.3668 => 15.6828, std.dev.: 0.0060) SingleSource/UnitTests/ObjC++/property-reference-object: 9.14% (0.6030 => 0.6581, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.06% (5.0018 => 5.4549, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/sieve: 9.02% (0.3603 => 0.3928, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 8.90% (0.3684 => 0.4012, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.88% (0.8067 => 0.8783, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 8.87% (0.4048 => 0.4407, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.81% (0.3427 => 0.3729, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 8.78% (0.2905 => 0.3160, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.49% (0.3826 => 0.4151, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.38% (0.2793 => 0.3027, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.34% (0.2891 => 0.3132, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 8.12% (0.1268 => 0.1371) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.11% (0.3650 => 0.3946, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 8.07% (0.2725 => 0.2945, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.91% (0.2756 => 0.2974, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 7.89% (0.2714 => 0.2928, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.86% (0.3283 => 0.3541, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 7.84% (0.2831 => 0.3053, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 7.79% (0.2877 => 0.3101, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.72% (2.0665 => 2.2260, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.69% (0.3162 => 0.3405, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.58% (0.3232 => 0.3477, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: 7.56% (0.2871 => 0.3088, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 7.55% (0.3098 => 0.3332, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.50% (0.4064 => 0.4369, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 7.48% (17.1811 => 18.4656, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.31% (0.2872 => 0.3082, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 7.31% (0.3052 => 0.3275, std.dev.: 0.0052) MultiSource/Applications/oggenc/oggenc: 7.28% (5.7591 => 6.1782, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 7.16% (1.2842 => 1.3761, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 7.03% (0.2802 => 0.2999, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 6.82% (0.3092 => 0.3303, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary2: 6.69% (0.3379 => 0.3605, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.12% (0.3136 => 0.3328, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.63% (3.8922 => 4.1114, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/oourafft: 5.55% (0.3282 => 0.3464, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.30% (0.2266 => 0.2386, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (0.3131 => 0.3294, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.14% (0.3817 => 0.3975, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.68% (0.3935 => 0.4080, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.36% (7.9617 => 8.1495, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.05% (7.0540 => 7.1985, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 148.01% (4.3953 => 10.9009, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 19.80% (2.8904 => 3.4628, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.61% (1.1145 => 1.2996, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 9.83% (1.1396 => 1.2516, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 9.70% (0.1629 => 0.1787, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.11% (0.9540 => 1.0218) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (3.1578 => 3.3678, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.40% (0.3463 => 0.3650, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.77% (0.4162 => 0.4319, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.80% (4.2280 => 4.3464, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.34% (1.7254 => 1.7657, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.78% (0.8333 => 0.8481, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2077, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.34% (11.6436 => 11.7998, std.dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.87% (6.6874 => 0.1422, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -76.51% (0.8651 => 0.2032, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.13% (5.3855 => 2.4163, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -54.78% (5.3526 => 2.4206, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: -45.75% (0.1622 => 0.0880, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.16% (1.1194 => 0.6810, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.77% (5.2763 => 3.2833, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -24.21% (1.7609 => 1.3345, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -16.73% (2.9384 => 2.4469, std.dev.: 0.0046) MultiSource/Applications/JM/ldecod/ldecod: -9.83% (10.4361 => 9.4100, std.dev.: 0.0047) MultiSource/Benchmarks/Bullet/bullet: -9.64% (63.2438 => 57.1466, std.dev.: 0.0097) SingleSource/UnitTests/Vector/constpool: -9.01% (54.1659 => 49.2840, std.dev.: 0.0178) MultiSource/Benchmarks/PAQ8p/paq8p: -4.86% (10.3673 => 9.8637, std.dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: -2.07% (21.9371 => 21.4839, std.dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -43.25% (0.0400 => 0.0227, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.42% (1.1492 => 0.7651, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4248, std.dev.: 0.0035) MultiSource/Benchmarks/NPB-serial/is/is: -10.83% (9.5636 => 8.5275, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -10.66% (1.5373 => 1.3735, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.25% (19.9488 => 18.3026, std.dev.: 0.1341) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.01% (1.8329 => 1.7045, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4781, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.82% (1.2373 => 1.1529, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/mason/mason: -6.66% (0.2161 => 0.2017, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -5.45% (6.6465 => 6.2845, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.08% (1.6805 => 1.5952, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4909, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5090, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.46% (0.9957 => 0.9513, std.dev.: 0.0062) MultiSource/Applications/siod/siod: -3.64% (3.2827 => 3.1633, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.52% (32.5116 => 31.3667, std.dev.: 0.0080) MultiSource/Benchmarks/sim/sim: -3.23% (5.0483 => 4.8851, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.04% (0.4808 => 0.4662, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.79% (4.5009 => 4.3753, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.99% (8.1563 => 7.9941, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/salsa20: -1.84% (10.2830 => 10.0937, std.dev.: 0.0172) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6834, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -1.67% (2.5528 => 2.5101, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -1.09% (6.2999 => 6.2314, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: -84.58% (0.0720 => 0.0111, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 13149100.00% (0.0001 => 13.1492, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -66.02% (0.2116 => 0.0719, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 38299100.00% (0.0001 => 38.2992, std.dev.: 0.2554) Report Time: 2.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 30 22:03:03 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 00:03:03 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121031050303.A1C272A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5432?compare_to=5428&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5432, Order: 167100, Start Time: 2012-10-31 03:34:46, End Time: 2012-10-31 05:03:05 To: 5428, Order: 167093, Start Time: 2012-10-31 01:51:10, End Time: 2012-10-31 03:17:50 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 12 (70 on baseline) Performance Improvements: 2 (6 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 977 (898 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/aha/aha: 9.85% (0.1056 => 0.1160, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/09-vor/vor: 4.44% (0.3133 => 0.3272, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.23% (0.3260 => 0.3398, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.85% (0.3617 => 0.3720, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 2.59% (1.2529 => 1.2854, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.14% (1.1902 => 1.2157, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.63% (0.8236 => 0.8370, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 1.48% (0.7567 => 0.7679, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.40% (1.7019 => 1.7258, std.dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 24.45% (1.4969 => 1.8629, std.dev.: 0.0148) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.86% (40.7605 => 42.3334, std.dev.: 0.2258) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.32% (4.3671 => 4.4682, std.dev.: 0.0328) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -5.67% (3.1986 => 3.0172, std.dev.: 0.0196) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -3.29% (2.3551 => 2.2775, std.dev.: 0.0207) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.26% (16.6321 => 16.6761, std.dev.: 0.3106) MultiSource/Applications/obsequi/Obsequi: 1.96% (1.0547 => 1.0754, std.dev.: 0.0068) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.35% (21.6703 => 21.5936, std.dev.: 0.3516) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.25% (0.3645 => 0.3636, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/bigfib: -0.38% (0.6028 => 0.6005, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.96% (0.3348 => 0.3316, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 1.42% (0.1969 => 0.1997, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.92% (0.0218 => 0.0220, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0424 => 0.0424, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.30% (0.0333 => 0.0332, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 27.64% (0.0246 => 0.0314, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0425 => 0.0425, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 13.33% (0.0180 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 0.92% (0.0218 => 0.0220, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.39% (0.1439 => 0.1459, std.dev.: 0.0058) MultiSource/Applications/kimwitu++/kc: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -5.64% (1.1040 => 1.0417, std.dev.: 0.0993) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 6.00% (0.1434 => 0.1520, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.91% (0.4171 => 0.4209, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.26% (0.1330 => 0.1360, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.32% (0.0630 => 0.0632, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0277 => 0.0277, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 7.98% (0.0539 => 0.0582, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.11% (1.1406 => 1.1418, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1800.00% (0.0001 => 0.0019, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 200.00% (0.0009 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.77% (0.0646 => 0.0651, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.43% (0.0221 => 0.0233, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.37% (0.8020 => 0.7990, std.dev.: 0.0134) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 53.19% (0.0047 => 0.0072, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2349.75% (0.6332 => 15.5118, std.dev.: 0.2476) MultiSource/Benchmarks/McCat/08-main/main: 48.77% (0.1831 => 0.2724, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.93% (0.1559 => 0.1451, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1491.36% (0.3344 => 5.3215, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: 35.91% (0.2364 => 0.3213, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: 2.80% (0.0429 => 0.0441, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -3.12% (0.0224 => 0.0217, std.dev.: 0.0010) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0026) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4434, std.dev.: 0.0238) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0740, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4909, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3435, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0260, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4054, std.dev.: 0.0029) SingleSource/Regression/C/uint64_to_float: -23.96% (2.1832 => 1.6601, std.dev.: 0.0126) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 35.74% (14.7684 => 20.0465, std.dev.: 0.1771) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.41% (0.0810 => 0.0951, std.dev.: 0.0030) SingleSource/UnitTests/SignlessTypes/rem: 14.78% (0.1035 => 0.1188, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 11.78% (0.1112 => 0.1243, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.66% (0.2180 => 0.2347, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 7.17% (1.2568 => 1.3469, std.dev.: 0.0159) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.02% (0.1425 => 0.1525, std.dev.: 0.0030) MultiSource/Applications/sgefa/sgefa: 6.67% (0.2999 => 0.3199, std.dev.: 0.0057) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.53% (0.3137 => 0.3342, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.98% (0.7473 => 0.7920, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.88% (0.2279 => 0.2413, std.dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 5.72% (1.1271 => 1.1916, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.72% (13.1811 => 13.9351, std.dev.: 0.0867) MultiSource/Applications/spiff/spiff: 5.51% (0.7950 => 0.8388, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.32% (1.6386 => 1.7258, std.dev.: 0.0053) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.31% (6.6074 => 6.9584, std.dev.: 0.0419) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.18% (0.8148 => 0.8570, std.dev.: 0.0114) MultiSource/Applications/Burg/burg: 5.17% (1.2222 => 1.2854, std.dev.: 0.0097) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.89% (0.2741 => 0.2875, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: 4.67% (1.9948 => 2.0880, std.dev.: 0.0241) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.63% (1.1170 => 1.1687, std.dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.39% (0.4559 => 0.4759, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.18% (0.6287 => 0.6550, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.17% (0.4127 => 0.4299, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.05% (0.9908 => 1.0309, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.04% (1.1685 => 1.2157, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 4.02% (0.8261 => 0.8593, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.91% (0.8007 => 0.8320, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.89% (0.5817 => 0.6043, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.85% (0.4783 => 0.4967, std.dev.: 0.0020) MultiSource/Applications/d/make_dparser: 3.82% (3.2366 => 3.3603, std.dev.: 0.0454) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.79% (1.1606 => 1.2046, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.75% (4.1763 => 4.3330, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.71% (0.8518 => 0.8834, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.70% (0.2998 => 0.3109, std.dev.: 0.0036) MultiSource/Applications/lemon/lemon: 3.66% (1.0945 => 1.1346, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.51% (0.8086 => 0.8370, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 3.35% (0.8768 => 0.9062, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.34% (0.9074 => 0.9377, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.27% (0.5191 => 0.5361, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.23% (1.3279 => 1.3708, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.19% (0.8048 => 0.8305, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/hash2: 3.05% (0.4125 => 0.4251, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 2.90% (6.7320 => 6.9269, std.dev.: 0.0501) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.89% (0.8331 => 0.8572, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.79% (0.6586 => 0.6770, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.72% (0.9056 => 0.9302, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.70% (0.8597 => 0.8829, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.64% (0.8927 => 0.9163, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.58% (2.1401 => 2.1954, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.55% (0.8457 => 0.8673, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.46% (0.8340 => 0.8545, std.dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 2.16% (8.6247 => 8.8111, std.dev.: 0.0467) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.98% (1.5315 => 1.5618, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.92% (3.1832 => 3.2444, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.76% (1.2423 => 1.2642, std.dev.: 0.0056) MultiSource/Applications/lambda-0_1_3/lambda: 1.61% (0.7557 => 0.7679, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 43.32% (1.5795 => 2.2638, std.dev.: 0.1176) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.17% (2.7978 => 3.7257, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.02% (0.3186 => 0.3537, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.29% (2.4333 => 2.6836, std.dev.: 0.0200) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.43% (1.1857 => 1.2857, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 5.93% (63.1822 => 66.9277, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 3.81% (44.5605 => 46.2563, std.dev.: 0.5293) MultiSource/Applications/siod/siod: 3.10% (3.6643 => 3.7779, std.dev.: 0.0365) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.59% (4.3552 => 4.4682, std.dev.: 0.0328) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.20% (41.4238 => 42.3334, std.dev.: 0.2258) MultiSource/Benchmarks/Olden/bh/bh: 1.71% (2.3560 => 2.3962, std.dev.: 0.0156) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.68% (4.8362 => 4.9173, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.10% (1.5941 => 1.6117, std.dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -8.36% (3.2926 => 3.0172, std.dev.: 0.0196) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.88% (0.3269 => 0.3044, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -4.36% (29.8330 => 28.5312, std.dev.: 0.1850) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.12% (7.2130 => 6.9879, std.dev.: 0.0633) SingleSource/Benchmarks/Shootout-C++/hash2: -1.34% (3.4237 => 3.3777, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.26% (3.3479 => 3.3057, std.dev.: 0.0093) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.40% (16.4461 => 16.6761, std.dev.: 0.3106) MultiSource/Applications/obsequi/Obsequi: 4.79% (1.0262 => 1.0754, std.dev.: 0.0068) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6814.38% (0.3123 => 21.5936, std.dev.: 0.3516) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.62% (0.2463 => 0.3636, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/bigfib: -0.08% (0.6010 => 0.6005, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.53% (0.3266 => 0.3316, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 1.42% (0.1969 => 0.1997, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.86% (0.0123 => 0.0220, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.92% (0.0408 => 0.0424, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.71% (0.0254 => 0.0332, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 22.22% (0.0180 => 0.0220, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.46% (0.1438 => 0.1459, std.dev.: 0.0058) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -8.05% (1.1329 => 1.0417, std.dev.: 0.0993) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.97% (0.1462 => 0.1520, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.08% (0.4164 => 0.4209, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.66% (0.1369 => 0.1360, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.40% (0.0641 => 0.0632, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.69% (0.0578 => 0.0582, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.17% (1.1437 => 1.1418, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1800.00% (0.0001 => 0.0019, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.83% (0.0627 => 0.0651, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 29.44% (0.0180 => 0.0233, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.34% (0.8017 => 0.7990, std.dev.: 0.0134) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 16.13% (0.0062 => 0.0072, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 30 22:34:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 00:34:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121031053428.1EA702A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5433?compare_to=5429&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5433, Order: 167103, Start Time: 2012-10-31 04:09:25, End Time: 2012-10-31 05:34:28 To: 5429, Order: 167093, Start Time: 2012-10-31 02:20:59, End Time: 2012-10-31 03:46:27 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 0 (172 on baseline) Unchanged Tests: 1041 (864 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.34% (20.0487 => 20.3175, std.dev.: 0.0253) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 20.19% (15.2527 => 18.3321, std.dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.15% (3.1919 => 3.4200, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.79% (2.0478 => 2.1049, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/salsa20: 2.47% (7.4937 => 7.6791, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hash2: 1.95% (3.1932 => 3.2554, std.dev.: 0.0071) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.74% (0.1431 => 0.1306, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.46% (0.1584 => 0.1450, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.30% (0.3821 => 0.3542, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -7.22% (0.3880 => 0.3600, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -7.20% (0.3831 => 0.3555, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -7.11% (0.3896 => 0.3619, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -7.11% (0.3812 => 0.3541, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.11% (0.3884 => 0.3608, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -7.09% (0.3848 => 0.3575, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -7.02% (0.4033 => 0.3750, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.99% (0.4176 => 0.3884, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -6.93% (2.4924 => 2.3196, std.dev.: 0.0082) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.89% (0.3891 => 0.3623, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/property: -6.81% (0.4199 => 0.3913, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -6.57% (0.4280 => 0.3999, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.52% (0.3142 => 0.2937, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.51% (0.2428 => 0.2270, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.40% (0.9542 => 0.8931, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/ReedSolomon: -6.39% (0.1879 => 0.1759, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.23% (22.4056 => 21.0096, std.dev.: 0.0178) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.21% (0.3658 => 0.3431, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.16% (4.5069 => 4.2292, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.05% (0.4151 => 0.3900, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -6.02% (0.3025 => 0.2843, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.00% (2.1713 => 2.0411, std.dev.: 0.0110) MultiSource/Applications/JM/ldecod/ldecod: -5.99% (7.0961 => 6.6713, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/strcat: -5.96% (0.2989 => 0.2811, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -5.95% (0.3026 => 0.2846, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.94% (0.2355 => 0.2215, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: -5.94% (16.1920 => 15.2300, std.dev.: 0.0089) MultiSource/Applications/hexxagon/hexxagon: -5.92% (1.3148 => 1.2370, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.89% (0.9852 => 0.9272, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.86% (0.3837 => 0.3612, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -5.85% (0.3194 => 0.3007, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -5.85% (0.3059 => 0.2880, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.83% (0.6484 => 0.6106, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.80% (0.3016 => 0.2841, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -5.80% (0.4861 => 0.4579, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: -5.79% (0.2659 => 0.2505, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.75% (4.8161 => 4.5394, std.dev.: 0.0068) MultiSource/Applications/Burg/burg: -5.75% (1.2515 => 1.1796, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/matrix: -5.75% (0.3255 => 0.3068, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.74% (1.2221 => 1.1519, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.72% (0.3057 => 0.2882, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.72% (3.5339 => 3.3316, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: -5.71% (4.3330 => 4.0856, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.69% (4.0323 => 3.8027, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary3: -5.69% (0.3446 => 0.3250, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -5.69% (0.3394 => 0.3201, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.69% (4.8802 => 4.6027, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/random: -5.68% (0.2939 => 0.2772, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.67% (5.4682 => 5.1580, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hello: -5.65% (0.2849 => 0.2688, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -5.65% (0.2160 => 0.2038, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.61% (0.2903 => 0.2740, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -5.61% (0.2871 => 0.2710, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -5.60% (0.3481 => 0.3286, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.59% (1.2210 => 1.1528, std.dev.: 0.0050) SingleSource/UnitTests/ObjC++/property-reference: -5.58% (0.7779 => 0.7345, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.57% (0.7919 => 0.7478, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.57% (0.3252 => 0.3071, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.56% (1.2784 => 1.2073, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -5.55% (0.3621 => 0.3420, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.55% (0.5999 => 0.5666, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: -5.51% (0.4248 => 0.4014, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: -5.49% (0.3788 => 0.3580, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.48% (0.4321 => 0.4084, std.dev.: 0.0014) MultiSource/Applications/siod/siod: -5.48% (2.4021 => 2.2704, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.46% (0.4083 => 0.3860, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: -5.46% (0.3205 => 0.3030, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -5.46% (0.3867 => 0.3656, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.45% (1.0544 => 0.9969, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.43% (0.3849 => 0.3640, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.42% (0.8521 => 0.8059, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.40% (0.7198 => 0.6809, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.40% (0.4427 => 0.4188, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.38% (1.6474 => 1.5587, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.38% (0.2548 => 0.2411, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -5.36% (0.6347 => 0.6007, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -5.33% (0.2985 => 0.2826, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: -5.27% (0.6750 => 0.6394, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.26% (0.4813 => 0.4560, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.25% (1.6364 => 1.5505, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: -5.22% (9.2283 => 8.7467, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.18% (0.2278 => 0.2160, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: -5.14% (0.6441 => 0.6110, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.13% (0.3491 => 0.3312, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.12% (0.6681 => 0.6339, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.12% (0.3323 => 0.3153, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -5.07% (34.0927 => 32.3648, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.06% (1.3722 => 1.3028, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.03% (1.4642 => 1.3905, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -5.03% (4.0594 => 3.8554, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/hash: -4.97% (0.4524 => 0.4299, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.97% (0.2999 => 0.2850, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.96% (0.3931 => 0.3736, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -4.95% (18.2933 => 17.3879, std.dev.: 0.0214) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.92% (0.5591 => 0.5316, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.91% (0.2933 => 0.2789, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.89% (0.6293 => 0.5985, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.88% (2.2587 => 2.1484, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.87% (0.9557 => 0.9092, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.86% (0.5925 => 0.5637, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.86% (0.5581 => 0.5310, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.85% (0.5859 => 0.5575, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.84% (0.6676 => 0.6353, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.84% (0.7339 => 0.6984, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.83% (0.5857 => 0.5574, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.83% (0.5802 => 0.5522, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.82% (0.6052 => 0.5760, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.80% (0.6230 => 0.5931, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -4.80% (0.7982 => 0.7599, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.78% (0.5478 => 0.5216, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: -4.78% (0.3581 => 0.3410, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.76% (0.6304 => 0.6004, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.75% (0.5575 => 0.5310, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.75% (0.6297 => 0.5998, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.72% (0.7524 => 0.7169, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.71% (0.6194 => 0.5902, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.70% (0.3319 => 0.3163, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.70% (0.6660 => 0.6347, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.69% (0.5570 => 0.5309, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.69% (0.6189 => 0.5899, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.68% (0.6395 => 0.6096, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.64% (0.6033 => 0.5753, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: -4.63% (0.7447 => 0.7102, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.63% (0.6260 => 0.5970, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.62% (0.6667 => 0.6359, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.62% (0.5805 => 0.5537, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.61% (0.2385 => 0.2275, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.61% (0.6446 => 0.6149, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.61% (0.5863 => 0.5593, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -4.58% (0.4515 => 0.4308, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.58% (0.4916 => 0.4691, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.57% (0.5688 => 0.5428, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.54% (0.5567 => 0.5314, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.53% (0.6395 => 0.6105, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.51% (0.5941 => 0.5673, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.51% (0.5456 => 0.5210, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.48% (0.5849 => 0.5587, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.45% (0.5569 => 0.5321, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -4.45% (1.1450 => 1.0941, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: -4.43% (0.9179 => 0.8772, std.dev.: 0.0046) MultiSource/Applications/SPASS/SPASS: -4.29% (15.5079 => 14.8420, std.dev.: 0.0054) MultiSource/Applications/spiff/spiff: -4.26% (0.8418 => 0.8059, std.dev.: 0.0053) MultiSource/Benchmarks/sim/sim: -4.23% (0.3406 => 0.3262, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.21% (8.0126 => 7.6749, std.dev.: 0.0081) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.19% (6.7716 => 6.4877, std.dev.: 0.0055) MultiSource/Applications/oggenc/oggenc: -4.19% (5.0226 => 4.8121, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.17% (0.7021 => 0.6728, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.16% (0.3483 => 0.3338, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.08% (0.6736 => 0.6461, std.dev.: 0.0021) MultiSource/Applications/treecc/treecc: -4.00% (2.1401 => 2.0546, std.dev.: 0.0068) MultiSource/Applications/sqlite3/sqlite3: -3.99% (17.1032 => 16.4215, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.91% (0.5168 => 0.4966, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -3.81% (3.5154 => 3.3815, std.dev.: 0.0023) MultiSource/Applications/hbd/hbd: -3.73% (1.5610 => 1.5028, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.71% (0.9077 => 0.8740, std.dev.: 0.0045) MultiSource/Benchmarks/nbench/nbench: -3.63% (1.1530 => 1.1112, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.60% (1.2300 => 1.1857, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.51% (0.5329 => 0.5142, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.29% (14.2083 => 13.7410, std.dev.: 0.0073) SingleSource/UnitTests/Vector/constpool: -2.20% (20.7746 => 20.3175, std.dev.: 0.0253) MultiSource/Applications/SIBsim4/SIBsim4: -1.95% (1.3864 => 1.3593, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7570, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/richards_benchmark: -8.70% (1.2842 => 1.1725, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7063, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.74% (2.2633 => 2.1787, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.81% (1.3096 => 1.2859, std.dev.: 0.0086) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4718, std.dev.: 0.0015) Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Oct 30 23:48:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 01:48:02 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121031064802.1F2AE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5434?compare_to=5432&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5434, Order: 167105, Start Time: 2012-10-31 05:20:25, End Time: 2012-10-31 06:48:04 To: 5432, Order: 167100, Start Time: 2012-10-31 03:34:46, End Time: 2012-10-31 05:03:05 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 13 (110 on baseline) Performance Improvements: 4 (6 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 974 (858 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.16% (0.6077 => 0.6269, std.dev.: 0.0050) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.29% (0.8803 => 0.9005, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.18% (0.8572 => 0.8759, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.63% (0.8570 => 0.8710, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.41% (0.8937 => 0.9063, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.35% (8.8662 => 8.9856, std.dev.: 0.0255) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.01% (1.1687 => 1.1805, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 13.20% (21.2763 => 24.0846, std.dev.: 0.9185) SingleSource/Benchmarks/Misc/pi: 9.70% (2.2638 => 2.4835, std.dev.: 0.0158) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.38% (14.7839 => 15.8755, std.dev.: 0.2734) SingleSource/Benchmarks/CoyoteBench/lpbench: 3.73% (3.9351 => 4.0818, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.56% (1.8629 => 1.8920, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.37% (1.2394 => 1.2564, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.14% (0.8593 => 0.8409, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -1.21% (1.7258 => 1.7050, std.dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.85% (39.8347 => 39.0997, std.dev.: 0.2730) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.27% (2.6000 => 2.5669, std.dev.: 0.0121) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.25% (16.6761 => 16.7186, std.dev.: 0.1764) MultiSource/Applications/obsequi/Obsequi: 0.10% (1.0754 => 1.0765, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.24% (21.5936 => 21.6454, std.dev.: 0.4960) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.60% (0.3636 => 0.3694, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/bigfib: 1.23% (0.6005 => 0.6079, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.72% (0.3316 => 0.3373, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 1.10% (0.1997 => 0.2019, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.45% (0.0220 => 0.0219, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.47% (0.0424 => 0.0426, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.30% (0.0332 => 0.0333, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.96% (0.0314 => 0.0317, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0425 => 0.0425, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0204 => 0.0204, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0220 => 0.0220, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.55% (0.1459 => 0.1451, std.dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 8.36% (1.0417 => 1.1288, std.dev.: 0.0564) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -5.07% (0.1520 => 0.1443, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.87% (0.4209 => 0.4004, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.01% (0.1360 => 0.1319, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.80% (0.0632 => 0.0608, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.89% (0.0277 => 0.0269, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.73% (0.0582 => 0.0537, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.51% (1.1418 => 1.1476, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -78.95% (0.0019 => 0.0004, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.07% (0.0651 => 0.0631, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.88% (0.0233 => 0.0189, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.30% (0.7990 => 0.8014, std.dev.: 0.0114) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0072 => 0.0072, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2326.31% (0.6332 => 15.3634, std.dev.: 0.1653) MultiSource/Benchmarks/McCat/08-main/main: 48.17% (0.1831 => 0.2713, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.67% (0.1559 => 0.1455, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1482.30% (0.3344 => 5.2912, std.dev.: 0.0762) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.94% (0.2364 => 0.3261, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel: 2.33% (0.0429 => 0.0439, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.36% (0.0224 => 0.0236, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0011) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4399, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0750, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4928, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3448, std.dev.: 0.0235) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0291, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4045, std.dev.: 0.0061) SingleSource/Regression/C/uint64_to_float: -23.78% (2.1832 => 1.6641, std.dev.: 0.0012) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 35.67% (14.7684 => 20.0370, std.dev.: 0.1695) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.04% (0.0810 => 0.0948, std.dev.: 0.0010) SingleSource/UnitTests/SignlessTypes/rem: 14.78% (0.1035 => 0.1188, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 12.41% (0.1112 => 0.1250, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.91% (0.0848 => 0.0949, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.50% (0.2180 => 0.2387, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.22% (0.8321 => 0.9005, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.86% (0.1425 => 0.1537, std.dev.: 0.0020) MultiSource/Applications/viterbi/viterbi: 7.80% (0.1577 => 0.1700, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.79% (0.6010 => 0.6478, std.dev.: 0.0146) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.43% (0.3137 => 0.3370, std.dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: 7.41% (1.2568 => 1.3499, std.dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.37% (0.1466 => 0.1574, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 7.03% (0.1721 => 0.1842, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.03% (0.7473 => 0.7998, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.90% (0.8148 => 0.8710, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.89% (0.2279 => 0.2436, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.68% (0.4847 => 0.5171, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.55% (0.2519 => 0.2684, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.35% (0.1905 => 0.2026, std.dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.76% (6.6074 => 6.9880, std.dev.: 0.0319) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.68% (1.1170 => 1.1805, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.62% (0.2741 => 0.2895, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.61% (0.9435 => 0.9964, std.dev.: 0.0094) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.58% (0.2240 => 0.2365, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.50% (0.1983 => 0.2092, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.46% (0.1885 => 0.1988, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.39% (0.2133 => 0.2248, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.33% (0.6287 => 0.6622, std.dev.: 0.0046) MultiSource/Applications/spiff/spiff: 5.28% (0.7950 => 0.8370, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.21% (13.1811 => 13.8674, std.dev.: 0.1421) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.17% (0.5961 => 0.6269, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 5.14% (0.8331 => 0.8759, std.dev.: 0.0019) MultiSource/Applications/hbd/hbd: 4.93% (1.4269 => 1.4973, std.dev.: 0.0146) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.74% (0.2998 => 0.3140, std.dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 4.64% (1.1271 => 1.1794, std.dev.: 0.0117) MultiSource/Benchmarks/McCat/05-eks/eks: 4.62% (0.4397 => 0.4600, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.48% (1.1606 => 1.2126, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.40% (0.5817 => 0.6073, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.39% (0.4127 => 0.4308, std.dev.: 0.0023) MultiSource/Applications/treecc/treecc: 4.37% (1.9948 => 2.0820, std.dev.: 0.0274) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.37% (0.3295 => 0.3439, std.dev.: 0.0050) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.29% (0.2378 => 0.2480, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 4.21% (0.8697 => 0.9063, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.13% (0.6227 => 0.6484, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.13% (1.3279 => 1.3827, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.05% (1.6386 => 1.7050, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.91% (8.6476 => 8.9856, std.dev.: 0.0255) MultiSource/Applications/d/make_dparser: 3.88% (3.2366 => 3.3621, std.dev.: 0.0401) MultiSource/Applications/SPASS/SPASS: 3.83% (14.2605 => 14.8069, std.dev.: 0.1660) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.75% (0.8086 => 0.8389, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.64% (0.4559 => 0.4725, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.63% (0.3003 => 0.3112, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.60% (0.5191 => 0.5378, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/18-imp/imp: 3.40% (0.3503 => 0.3622, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 3.34% (3.8189 => 3.9466, std.dev.: 0.0484) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.29% (4.1763 => 4.3137, std.dev.: 0.0260) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.28% (1.4479 => 1.4954, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/hash2: 3.25% (0.4125 => 0.4259, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.24% (1.1685 => 1.2064, std.dev.: 0.0073) MultiSource/Applications/minisat/minisat: 3.22% (0.6834 => 0.7054, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/hash: 3.18% (0.3800 => 0.3921, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: 3.16% (4.1305 => 4.2609, std.dev.: 0.0338) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.11% (0.8007 => 0.8256, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.03% (0.4783 => 0.4928, std.dev.: 0.0041) MultiSource/Applications/lemon/lemon: 3.02% (1.0945 => 1.1275, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.00% (0.8656 => 0.8916, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.00% (0.8177 => 0.8422, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/moments: 2.99% (0.3645 => 0.3754, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.98% (1.2602 => 1.2977, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.90% (0.7932 => 0.8162, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.90% (0.3657 => 0.3763, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.88% (0.3717 => 0.3824, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.88% (0.8340 => 0.8580, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.88% (0.9039 => 0.9299, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.82% (0.7966 => 0.8191, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.71% (0.8316 => 0.8541, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.69% (0.8611 => 0.8843, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.63% (0.8597 => 0.8823, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.63% (0.8457 => 0.8679, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.62% (0.8518 => 0.8741, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.56% (4.4880 => 4.6028, std.dev.: 0.0266) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.53% (0.8066 => 0.8270, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.53% (0.9069 => 0.9298, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.44% (0.8317 => 0.8520, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.39% (0.9056 => 0.9272, std.dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: 2.35% (0.9810 => 1.0041, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.29% (1.2526 => 1.2813, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.29% (0.8927 => 0.9131, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.27% (0.8805 => 0.9005, std.dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: 2.25% (8.6247 => 8.8185, std.dev.: 0.0602) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.19% (0.9688 => 0.9900, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.19% (0.8048 => 0.8224, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.18% (0.9074 => 0.9272, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.04% (0.8338 => 0.8508, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.98% (0.8420 => 0.8587, std.dev.: 0.0064) MultiSource/Benchmarks/Bullet/bullet: 1.95% (31.8598 => 32.4821, std.dev.: 0.2013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.80% (4.5702 => 4.6525, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.79% (0.8261 => 0.8409, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.72% (3.1832 => 3.2379, std.dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 57.23% (1.5795 => 2.4835, std.dev.: 0.0158) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.47% (2.7978 => 3.7341, std.dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.54% (2.4333 => 2.6655, std.dev.: 0.0334) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.40% (14.6451 => 15.8755, std.dev.: 0.2734) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.15% (1.1857 => 1.2823, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 5.92% (63.1822 => 66.9240, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout/nestedloop: 5.04% (0.2023 => 0.2125, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/lpbench: 4.65% (3.9006 => 4.0818, std.dev.: 0.0085) MultiSource/Applications/siod/siod: 2.75% (3.6643 => 3.7651, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/bh/bh: 1.94% (2.3560 => 2.4017, std.dev.: 0.0092) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.22% (0.3269 => 0.3033, std.dev.: 0.0082) MultiSource/Applications/lua/lua: -5.11% (29.8330 => 28.3080, std.dev.: 0.0654) SingleSource/Benchmarks/Shootout-C++/hash2: -1.47% (3.4237 => 3.3735, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.32% (1.0388 => 1.0251, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.27% (3.3479 => 3.3053, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/ffbench: -1.13% (1.4296 => 1.4134, std.dev.: 0.0052) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.66% (16.4461 => 16.7186, std.dev.: 0.1764) MultiSource/Applications/obsequi/Obsequi: 4.90% (1.0262 => 1.0765, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6830.96% (0.3123 => 21.6454, std.dev.: 0.4960) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.98% (0.2463 => 0.3694, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/bigfib: 1.15% (0.6010 => 0.6079, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.28% (0.3266 => 0.3373, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 2.54% (0.1969 => 0.2019, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.97% (0.0302 => 0.0317, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 22.22% (0.0180 => 0.0220, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 0.90% (0.1438 => 0.1451, std.dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.36% (1.1329 => 1.1288, std.dev.: 0.0564) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.30% (0.1462 => 0.1443, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.84% (0.4164 => 0.4004, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.65% (0.1369 => 0.1319, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.15% (0.0641 => 0.0608, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 37.95% (0.0195 => 0.0269, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.09% (0.0578 => 0.0537, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.34% (1.1437 => 1.1476, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 300.00% (0.0001 => 0.0004, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.64% (0.0627 => 0.0631, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.00% (0.0180 => 0.0189, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.04% (0.8017 => 0.8014, std.dev.: 0.0114) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 16.13% (0.0062 => 0.0072, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 00:13:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 02:13:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121031071340.045112A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5435?compare_to=5431&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5435, Order: 167104, Start Time: 2012-10-31 04:51:38, End Time: 2012-10-31 07:13:39 To: 5431, Order: 167092, Start Time: 2012-10-31 01:57:12, End Time: 2012-10-31 04:18:04 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (17 on baseline) New Passes: 0 (14 on baseline) Performance Regressions: 2 (177 on baseline) Performance Improvements: 2 (47 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 22 (5 on baseline) Unchanged Tests: 1016 (648 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.10% (79.2274 => 81.6866, std.dev.: 0.5987) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.33% (1.2930 => 1.3231, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.08% (2.4163 => 2.3902, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.06% (2.4206 => 2.3949, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/lemon/lemon MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Shootout-C++/ary2 MultiSource/Applications/JM/ldecod/ldecod: 0.24% (0.1225 => 0.1228, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: - (0.0111 => 0.0111, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 0.01% (13.1492 => 13.1511, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: -0.15% (1.4549 => 1.4527, std.dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: -0.08% (0.1332 => 0.1331, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: - (0.0007 => 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0076 => 0.0076) MultiSource/Benchmarks/Bullet/bullet: -0.26% (0.1168 => 0.1165, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: -0.02% (499.8368 => 499.7581, std.dev.: 0.0409) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.42% (0.0719 => 0.0722, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: - (0.2552 => 0.2552, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: - (0.0176 => 0.0176) MultiSource/Benchmarks/Olden/power/power: 0.59% (13.1367 => 13.2148, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 0.59% (0.0340 => 0.0342, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: - (0.0574 => 0.0574, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.51% (0.0529 => 0.0521, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.69% (0.0341 => 0.0357, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -9.80% (0.0051 => 0.0046, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -42.89% (38.2992 => 21.8739, std.dev.: 7.9560) SingleSource/Benchmarks/BenchmarkGame/n-body: 0.01% (1.3168 => 1.3169) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: - (3.0439 => 3.0439, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: - (0.0757 => 0.0757) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/lemon/lemon MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Shootout-C++/ary2 MultiSource/Applications/JM/ldecod/ldecod: -5.39% (0.1298 => 0.1228, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 0.46% (1.4460 => 1.4527, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: -99.98% (4.6441 => 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.83% (4.3882 => 0.0076) MultiSource/Benchmarks/Bullet/bullet: -98.91% (10.7105 => 0.1165, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 423783.04% (0.1179 => 499.7581, std.dev.: 0.0409) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -35.99% (0.3987 => 0.2552, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -99.09% (1.9405 => 0.0176) MultiSource/Benchmarks/Olden/power/power: 1071.84% (1.1277 => 13.2148, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -99.96% (85.0658 => 0.0342, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -33.56% (0.0864 => 0.0574, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.73% (0.0611 => 0.0521, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -29.45% (0.0506 => 0.0357, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 24.32% (0.0037 => 0.0046, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.10% (3.2416 => 3.0439, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: - (0.0757 => 0.0757) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 198.99% (0.5229 => 1.5634, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 13.54% (14.9895 => 17.0187, std.dev.: 0.0025) MultiSource/Applications/kimwitu++/kc: 36.01% (14.1553 => 19.2522, std.dev.: 0.0132) MultiSource/Benchmarks/MallocBench/gs/gs: 13.48% (4.1105 => 4.6646, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 29.44% (1.1048 => 1.4300, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 305.19% (7.1582 => 29.0043, std.dev.: 0.5989) SingleSource/Benchmarks/Misc-C++-EH/spirit: 67.94% (3.4629 => 5.8156, std.dev.: 0.0165) SingleSource/Benchmarks/Misc-C++/stepanov_container: 63.84% (0.6222 => 1.0194, std.dev.: 0.0041) New Passes - Execution Time --------------------------- MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SPASS/SPASS: 11174700.00% (0.0001 => 11.1748, std.dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: 51000.00% (0.0001 => 0.0511, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 66500.00% (0.0001 => 0.0666, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050000.00% (0.0001 => 10.0501, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5489200.00% (0.0001 => 5.4893, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 39.68% (0.1056 => 0.1475, std.dev.: 0.0001) SingleSource/UnitTests/vla: 28.73% (0.0355 => 0.0457, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 28.21% (0.1432 => 0.1836, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.53% (0.0648 => 0.0794, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 21.30% (0.0798 => 0.0968, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.14% (0.1566 => 0.1897, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.95% (0.0842 => 0.1010, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 19.55% (0.0793 => 0.0948, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.83% (0.0770 => 0.0915, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 18.59% (0.1555 => 0.1844, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: 17.89% (0.0626 => 0.0738, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.87% (0.8172 => 0.9632, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 17.72% (0.3177 => 0.3740, std.dev.: 0.0018) SingleSource/UnitTests/SignlessTypes/rem: 17.66% (0.1144 => 0.1346, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.34% (0.2065 => 0.2423, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: 17.27% (0.2554 => 0.2995, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 17.26% (0.0730 => 0.0856, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.19% (0.1117 => 0.1309, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/17-bintr/bintr: 17.19% (0.0675 => 0.0791, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 17.17% (0.1695 => 0.1986, std.dev.: 0.0013) MultiSource/Applications/aha/aha: 17.12% (0.1151 => 0.1348, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 16.94% (0.1163 => 0.1360, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.89% (0.3121 => 0.3648, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.88% (0.0871 => 0.1018, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 16.87% (0.4879 => 0.5702, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/loader/loader: 16.79% (0.2758 => 0.3221, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 16.77% (0.1175 => 0.1372, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.62% (0.1029 => 0.1200, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.48% (0.0886 => 0.1032, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.43% (0.0834 => 0.0971, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 16.41% (0.1584 => 0.1844, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 16.22% (0.0746 => 0.0867, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 15.50% (0.2271 => 0.2623, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.47% (0.2107 => 0.2433, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 15.23% (0.1655 => 0.1907, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 15.05% (0.7115 => 0.8186, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 15.01% (0.7835 => 0.9011, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.85% (0.1940 => 0.2228, std.dev.: 0.0040) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.84% (0.1125 => 0.1292, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.81% (0.1337 => 0.1535, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.79% (0.0730 => 0.0838, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.78% (0.1062 => 0.1219, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.65% (0.5981 => 0.6857, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.48% (0.2700 => 0.3091, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 14.32% (0.1906 => 0.2179, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 14.32% (1.1642 => 1.3309, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 14.29% (22.1758 => 25.3446, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 14.24% (0.5105 => 0.5832, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 14.13% (0.5569 => 0.6356, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.95% (0.4615 => 0.5259, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 13.84% (0.7433 => 0.8462, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 13.67% (0.3109 => 0.3534, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.63% (0.5860 => 0.6659, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.61% (0.9765 => 1.1094, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.48% (0.3441 => 0.3905, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 13.29% (0.5020 => 0.5687, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.23% (0.1625 => 0.1840, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.19% (1.5415 => 1.7448, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.18% (0.1510 => 0.1709, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 13.05% (3.3354 => 3.7708, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.00% (0.6675 => 0.7543, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 12.52% (2.0273 => 2.2811, std.dev.: 0.0014) MultiSource/Applications/lua/lua: 12.27% (3.8723 => 4.3474, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.25% (1.3050 => 1.4649, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 12.14% (0.4299 => 0.4821, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.14% (0.2603 => 0.2919, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.11% (0.1032 => 0.1157, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.97% (0.3543 => 0.3967, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 11.91% (0.1268 => 0.1419, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/exceptions-4: 11.88% (0.3543 => 0.3964, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.88% (0.6450 => 0.7216, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.69% (1.1861 => 1.3247, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 11.59% (1.0722 => 1.1965, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 11.55% (0.3473 => 0.3874, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 11.48% (0.8921 => 0.9945, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.43% (0.3307 => 0.3685, std.dev.: 0.0064) MultiSource/Benchmarks/nbench/nbench: 11.41% (1.1840 => 1.3191, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.41% (0.3927 => 0.4375, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 11.34% (0.3423 => 0.3811, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.33% (0.1236 => 0.1376, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.32% (0.3516 => 0.3914, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.30% (0.3497 => 0.3892, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.29% (0.3561 => 0.3963, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.18% (0.3828 => 0.4256, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.12% (4.2646 => 4.7387, std.dev.: 0.0029) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.11% (0.1143 => 0.1270, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 11.09% (8.1363 => 9.0389, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/for-in: 11.07% (0.3694 => 0.4103, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.87% (0.0929 => 0.1030, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 10.87% (0.1463 => 0.1622) SingleSource/UnitTests/ObjC/property: 10.86% (0.3886 => 0.4308, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 10.79% (0.3180 => 0.3523, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 10.78% (0.3387 => 0.3752, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.59% (0.8101 => 0.8959, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.56% (0.1695 => 0.1874, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 10.54% (0.4289 => 0.4741, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 10.50% (9.4845 => 10.4808, std.dev.: 0.1764) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.40% (1.4186 => 1.5661, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.33% (1.5859 => 1.7498, std.dev.: 0.0054) MultiSource/Applications/siod/siod: 10.32% (2.2969 => 2.5339, std.dev.: 0.0183) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.18% (2.2022 => 2.4264, std.dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.16% (0.4636 => 0.5107, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 10.05% (0.6456 => 0.7105, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.00% (0.1330 => 0.1463, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 9.96% (0.1044 => 0.1148, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.83% (2.2024 => 2.4190, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.71% (0.2430 => 0.2666, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 9.69% (1.5603 => 1.7115, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/hash2: 9.68% (0.4620 => 0.5067, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.41% (0.1892 => 0.2070, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.39% (14.3668 => 15.7158, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.30% (4.9449 => 5.4047, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: 9.29% (0.3422 => 0.3740, std.dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference: 9.24% (0.7326 => 0.8003, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.16% (0.4203 => 0.4588, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/Hello: 9.10% (0.5925 => 0.6464, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.03% (0.3865 => 0.4214, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.94% (5.0018 => 5.4490, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 8.91% (0.6030 => 0.6567, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 8.62% (0.4048 => 0.4397, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.58% (0.4103 => 0.4455, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/lists1: 8.55% (0.3684 => 0.3999, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.47% (0.8067 => 0.8750, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sieve: 8.19% (0.3603 => 0.3898, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.17% (0.3427 => 0.3707, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 7.99% (0.2905 => 0.3137, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.95% (0.2793 => 0.3015, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.95% (0.3650 => 0.3940, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.76% (0.3826 => 0.4123, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary3: 7.49% (0.3283 => 0.3529, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.47% (0.2756 => 0.2962, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.41% (0.2725 => 0.2927, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 7.33% (17.1811 => 18.4400, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/strcat: 7.28% (0.2831 => 0.3037, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.26% (0.2891 => 0.3101, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 7.26% (0.2714 => 0.2911, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.23% (2.0665 => 2.2159, std.dev.: 0.0552) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.19% (0.4064 => 0.4356, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 7.04% (0.3098 => 0.3316, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary: 7.02% (0.3232 => 0.3459, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 6.93% (0.2871 => 0.3070, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.75% (0.2872 => 0.3066, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 6.74% (1.2842 => 1.3707, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/ary2: 6.69% (0.3379 => 0.3605, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 6.65% (5.7591 => 6.1421, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 6.64% (0.2877 => 0.3068, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 6.59% (0.3052 => 0.3253, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 6.47% (0.3092 => 0.3292, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 6.46% (0.2802 => 0.2983, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.93% (0.3136 => 0.3322, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/oourafft: 5.82% (0.3282 => 0.3473, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.54% (3.8922 => 4.1080, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/objinst: 4.76% (0.3131 => 0.3280, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.68% (0.2266 => 0.2372, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.75% (0.3817 => 0.3960, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.48% (0.3935 => 0.4072, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.06% (7.9617 => 8.1257, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.25% (7.0540 => 7.1424, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 19.81% (2.8904 => 3.4629, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.65% (1.1145 => 1.3001, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 10.37% (0.1629 => 0.1798, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 10.05% (1.1396 => 1.2541, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3683, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.43% (0.3463 => 0.3651, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.87% (0.4162 => 0.4323, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.63% (4.2280 => 4.3394, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.30% (1.7254 => 1.7650, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bisort/bisort: 1.80% (0.8333 => 0.8483, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 1.54% (3.1595 => 3.2080, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.43% (1.3045 => 1.3231, std.dev.: 0.0045) MultiSource/Benchmarks/nbench/nbench: 1.32% (11.6436 => 11.7978, std.dev.: 0.0062) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.88% (6.6874 => 0.1416, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -76.81% (0.8651 => 0.2006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.62% (5.3855 => 2.3902, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -55.26% (5.3526 => 2.3949, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -45.93% (0.1622 => 0.0877, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.30% (1.1194 => 0.6795, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.09% (5.2763 => 3.2667, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -24.25% (1.7609 => 1.3338, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -17.27% (2.9384 => 2.4310, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -10.38% (63.2438 => 56.6782, std.dev.: 1.0824) MultiSource/Applications/JM/ldecod/ldecod: -9.89% (10.4361 => 9.4039, std.dev.: 0.0102) SingleSource/UnitTests/Vector/constpool: -9.05% (54.1659 => 49.2621, std.dev.: 0.0120) MultiSource/Benchmarks/PAQ8p/paq8p: -3.96% (10.3673 => 9.9571, std.dev.: 0.1129) MultiSource/Applications/JM/lencod/lencod: -2.31% (21.9371 => 21.4300, std.dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -43.25% (0.0400 => 0.0227, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel: -33.39% (1.1492 => 0.7655, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4249, std.dev.: 0.0026) MultiSource/Benchmarks/NPB-serial/is/is: -10.99% (9.5636 => 8.5123, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -10.90% (1.5373 => 1.3697, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.41% (19.9488 => 18.2712, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4781, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.98% (1.8329 => 1.7050, std.dev.: 0.0061) SingleSource/Benchmarks/McGill/chomp: -6.85% (1.2373 => 1.1526, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/mason/mason: -6.57% (0.2161 => 0.2019, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: -5.45% (6.6465 => 6.2840, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.07% (1.6805 => 1.5953, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.68% (1.5835 => 1.5094, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.06% (0.9957 => 0.9553, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.00% (0.2497 => 0.2397, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.72% (3.2827 => 3.1605, std.dev.: 0.0098) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.49% (32.5116 => 31.3761, std.dev.: 0.0059) MultiSource/Benchmarks/sim/sim: -3.24% (5.0483 => 4.8849, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.81% (4.5009 => 4.3743, std.dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.58% (0.4808 => 0.4684, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/flops: -1.75% (8.8334 => 8.6791, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -1.69% (10.2830 => 10.1091, std.dev.: 0.0135) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.60% (8.1563 => 8.0258, std.dev.: 0.0074) SingleSource/UnitTests/Vector/multiplies: -1.55% (2.5528 => 2.5132, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2347, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8592, std.dev.: 0.0029) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: -84.58% (0.0720 => 0.0111, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 13151000.00% (0.0001 => 13.1511, std.dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: -10.37% (0.1485 => 0.1331, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -65.88% (0.2116 => 0.0722, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 21873800.00% (0.0001 => 21.8739, std.dev.: 7.9560) Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 00:25:18 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 02:25:18 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121031072518.610E12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5436?compare_to=5433&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5436, Order: 167107, Start Time: 2012-10-31 05:57:40, End Time: 2012-10-31 07:25:16 To: 5433, Order: 167103, Start Time: 2012-10-31 04:09:25, End Time: 2012-10-31 05:34:28 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 0 (167 on baseline) Unchanged Tests: 1041 (869 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.87% (54.5026 => 56.6103, std.dev.: 0.5954) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 19.86% (15.2527 => 18.2814, std.dev.: 0.0165) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.16% (3.1919 => 3.4203, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.73% (54.5751 => 56.6103, std.dev.: 0.5954) SingleSource/Benchmarks/Misc/salsa20: 2.59% (7.4937 => 7.6880, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 1.91% (3.1932 => 3.2541, std.dev.: 0.0057) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.74% (0.1431 => 0.1306, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.65% (0.1584 => 0.1447, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.56% (0.3821 => 0.3532, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -7.07% (2.4924 => 2.3161, std.dev.: 0.0158) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.59% (0.2428 => 0.2268, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.59% (0.3142 => 0.2935, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -6.49% (0.1879 => 0.1757, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.42% (22.4056 => 20.9665, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.40% (0.3658 => 0.3424, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: -6.25% (0.2160 => 0.2025, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.25% (0.9542 => 0.8946, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.17% (4.5069 => 4.2287, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.14% (0.6484 => 0.6086, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.02% (0.9852 => 0.9259, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: -6.02% (0.3357 => 0.3155, std.dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: -5.95% (7.0961 => 6.6741, std.dev.: 0.0046) MultiSource/Applications/JM/lencod/lencod: -5.86% (16.1920 => 15.2430, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/08-main/main: -5.83% (0.2659 => 0.2504, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -5.79% (1.2515 => 1.1791, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.78% (1.6474 => 1.5521, std.dev.: 0.0276) MultiSource/Applications/siod/siod: -5.72% (2.4021 => 2.2646, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.69% (0.2355 => 0.2221, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.69% (1.2784 => 1.2057, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.64% (4.8161 => 4.5443, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.64% (1.0544 => 0.9949, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.64% (5.4682 => 5.1598, std.dev.: 0.1112) MultiSource/Benchmarks/MallocBench/gs/gs: -5.63% (4.3330 => 4.0889, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.63% (0.7919 => 0.7473, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.63% (4.0323 => 3.8052, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.55% (4.8802 => 4.6095, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.54% (1.2210 => 1.1533, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.52% (0.5999 => 0.5668, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.52% (0.4151 => 0.3922, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: -5.48% (0.3831 => 0.3621, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.47% (1.2221 => 1.1552, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-4: -5.46% (0.3880 => 0.3668, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -5.46% (0.4176 => 0.3948, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.43% (0.3884 => 0.3673, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -5.43% (0.3812 => 0.3605, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -5.39% (0.3896 => 0.3686, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -5.38% (0.4033 => 0.3816, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -5.38% (0.3848 => 0.3641, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -5.36% (0.2985 => 0.2825, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.35% (0.8521 => 0.8065, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: -5.32% (0.3025 => 0.2864, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -5.31% (0.4861 => 0.4603, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.29% (0.3891 => 0.3685, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.29% (0.3837 => 0.3634, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -5.28% (1.3148 => 1.2454, std.dev.: 0.0193) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.27% (0.3057 => 0.2896, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.27% (0.7198 => 0.6819, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/property: -5.26% (0.4199 => 0.3978, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.26% (1.6364 => 1.5503, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.25% (1.4642 => 1.3873, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.23% (2.1713 => 2.0577, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: -5.23% (0.6750 => 0.6397, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -5.22% (9.2283 => 8.7468, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.22% (0.4083 => 0.3870, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -5.20% (0.3194 => 0.3028, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: -5.15% (0.2989 => 0.2835, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -5.15% (34.0927 => 32.3362, std.dev.: 0.0303) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.15% (0.5591 => 0.5303, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.14% (0.6304 => 0.5980, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -5.14% (4.0594 => 3.8508, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/lists: -5.14% (0.3621 => 0.3435, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.14% (0.2278 => 0.2161, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.14% (0.2999 => 0.2845, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.13% (0.2903 => 0.2754, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.13% (0.5925 => 0.5621, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.12% (0.6052 => 0.5742, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -5.12% (0.3205 => 0.3041, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -5.10% (0.2939 => 0.2789, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -5.09% (0.2849 => 0.2704, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -5.09% (0.3026 => 0.2872, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.09% (0.6230 => 0.5913, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: -5.09% (0.2871 => 0.2725, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -5.08% (0.3446 => 0.3271, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.07% (0.5859 => 0.5562, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.07% (0.7339 => 0.6967, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.06% (0.6681 => 0.6343, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.06% (0.5478 => 0.5201, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -5.06% (0.3481 => 0.3305, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: -5.04% (0.4524 => 0.4296, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: -5.04% (0.3255 => 0.3091, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: -5.04% (18.2933 => 17.3717, std.dev.: 0.0256) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.04% (0.3931 => 0.3733, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: -5.03% (0.3059 => 0.2905, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.03% (0.5805 => 0.5513, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.02% (0.6676 => 0.6341, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.02% (0.5581 => 0.5301, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.01% (0.5863 => 0.5569, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.01% (0.6293 => 0.5978, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.00% (0.6660 => 0.6327, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.00% (1.3722 => 1.3036, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.00% (0.5802 => 0.5512, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.99% (0.3849 => 0.3657, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.98% (0.2548 => 0.2421, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.97% (0.6297 => 0.5984, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.97% (0.5857 => 0.5566, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.97% (0.3323 => 0.3158, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.96% (0.5705 => 0.5422, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: -4.95% (0.3394 => 0.3226, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -4.92% (0.4248 => 0.4039, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.92% (0.6667 => 0.6339, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -4.91% (0.4280 => 0.4070, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.90% (0.7524 => 0.7155, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.89% (0.3252 => 0.3093, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.89% (0.6260 => 0.5954, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.87% (0.3016 => 0.2869, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.86% (0.5941 => 0.5652, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.86% (0.6189 => 0.5888, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.86% (0.4427 => 0.4212, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.84% (0.5575 => 0.5305, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.83% (0.6395 => 0.6086, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.81% (0.3491 => 0.3323, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.79% (0.5849 => 0.5569, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.78% (0.6440 => 0.6132, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.78% (0.5567 => 0.5301, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.78% (0.5570 => 0.5304, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.76% (0.6194 => 0.5899, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/sieve: -4.75% (0.3788 => 0.3608, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.75% (0.5688 => 0.5418, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.70% (0.6446 => 0.6143, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: -4.70% (0.9179 => 0.8748, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: -4.69% (0.3581 => 0.3413, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.69% (0.9557 => 0.9109, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -4.69% (0.7982 => 0.7608, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: -4.68% (0.3867 => 0.3686, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.64% (0.5456 => 0.5203, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.62% (0.4916 => 0.4689, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: -4.59% (0.7779 => 0.7422, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.55% (0.4813 => 0.4594, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.55% (0.3319 => 0.3168, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.52% (0.3406 => 0.3252, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.52% (0.6395 => 0.6106, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.49% (0.2385 => 0.2278, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/05-eks/eks: -4.43% (0.4515 => 0.4315, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.38% (0.6736 => 0.6441, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: -4.38% (0.7447 => 0.7121, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.36% (0.2933 => 0.2805, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -4.32% (5.0226 => 4.8057, std.dev.: 0.0040) MultiSource/Applications/SPASS/SPASS: -4.32% (15.5079 => 14.8383, std.dev.: 0.0095) MultiSource/Applications/lemon/lemon: -4.30% (1.1450 => 1.0958, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: -4.26% (0.8418 => 0.8059, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.25% (0.3483 => 0.3335, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: -4.22% (0.3271 => 0.3133, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -4.19% (0.6441 => 0.6171, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -4.18% (0.6347 => 0.6082, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -4.15% (2.1401 => 2.0513, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.03% (8.0126 => 7.6893, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.02% (0.9077 => 0.8712, std.dev.: 0.0061) MultiSource/Applications/sqlite3/sqlite3: -3.95% (17.1032 => 16.4274, std.dev.: 0.0037) MultiSource/Applications/d/make_dparser: -3.89% (3.5154 => 3.3785, std.dev.: 0.0029) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.79% (6.7716 => 6.5147, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.74% (1.2300 => 1.1840, std.dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: -3.69% (1.1530 => 1.1105, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.66% (0.5329 => 0.5134, std.dev.: 0.0067) MultiSource/Applications/hbd/hbd: -3.52% (1.5610 => 1.5061, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.24% (14.2083 => 13.7486, std.dev.: 0.0024) SingleSource/UnitTests/Vector/constpool: -2.64% (20.7746 => 20.2263, std.dev.: 0.0189) MultiSource/Applications/SIBsim4/SIBsim4: -2.08% (1.3864 => 1.3575, std.dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7509, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1729, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.91% (2.2633 => 2.1748, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7062, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.50% (6.5735 => 6.4752, std.dev.: 0.0048) Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 00:54:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 02:54:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121031075424.A17B32A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/5437?compare_to=5430&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5437, Order: 167103, Start Time: 2012-10-31 04:36:06, End Time: 2012-10-31 07:54:24 To: 5430, Order: 167059, Start Time: 2012-10-31 00:31:58, End Time: 2012-10-31 03:47:40 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (164 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1039 (725 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference-object: 1.58% (0.6817 => 0.6925, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 1.54% (0.8168 => 0.8294, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.08% (2.3706 => 2.3961, std.dev.: 0.0044) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 39.84% (0.0625 => 0.0874, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.23% (0.1063 => 0.1395, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.17% (0.0714 => 0.0908, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.29% (0.2969 => 0.3720, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 24.59% (0.1106 => 0.1378, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.47% (0.4139 => 0.5152, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.45% (0.4253 => 0.5293, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 23.81% (1.5932 => 1.9726, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.53% (0.5900 => 0.7288, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.33% (0.4994 => 0.6159, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.86% (0.5000 => 0.6143, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.74% (0.0475 => 0.0583, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.67% (0.0547 => 0.0671, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.60% (0.0584 => 0.0716, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.79% (0.1620 => 0.1973, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.63% (0.0897 => 0.1091, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.35% (0.1021 => 0.1239, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 21.04% (0.0599 => 0.0725, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 20.78% (0.1107 => 0.1337, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 20.46% (0.0948 => 0.1142, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 19.91% (0.0633 => 0.0759, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.86% (0.0584 => 0.0700, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.78% (0.0642 => 0.0769, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.78% (0.0541 => 0.0648, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.76% (0.1103 => 0.1321, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.76% (0.1604 => 0.1921, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.65% (0.3903 => 0.4670, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/health/health: 19.61% (0.0821 => 0.0982, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 19.54% (0.0604 => 0.0722, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.34% (0.1003 => 0.1197, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 19.33% (0.1619 => 0.1932, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.30% (0.1549 => 0.1848, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.98% (0.0822 => 0.0978, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 18.80% (0.0947 => 0.1125, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.19% (0.1462 => 0.1728, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 18.07% (0.0808 => 0.0954, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 17.92% (0.5826 => 0.6870, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.74% (0.3890 => 0.4580, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 17.73% (0.1218 => 0.1434) SingleSource/UnitTests/ObjC++/property-reference-object: 17.59% (0.5889 => 0.6925, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.58% (0.2014 => 0.2368, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.49% (0.5026 => 0.5905, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.42% (1.3152 => 1.5443, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.36% (0.2736 => 0.3211, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/mst/mst: 17.34% (0.0698 => 0.0819, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.31% (0.2866 => 0.3362, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 17.27% (0.4029 => 0.4725, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 17.21% (0.1505 => 0.1764, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.20% (0.2738 => 0.3209, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.19% (0.1088 => 0.1275, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 17.04% (1.8794 => 2.1996, std.dev.: 0.0019) MultiSource/Applications/hbd/hbd: 16.99% (0.9697 => 1.1345, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.97% (0.2875 => 0.3363, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 16.70% (0.5546 => 0.6472, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.48% (3.5627 => 4.1497, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/fibo: 16.33% (0.2725 => 0.3170, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.29% (0.4658 => 0.5417, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 16.21% (0.2714 => 0.3154, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.20% (0.2729 => 0.3171, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.17% (0.3271 => 0.3800, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.16% (0.1968 => 0.2286, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: 16.11% (0.2750 => 0.3193, std.dev.: 0.0092) MultiSource/Applications/hexxagon/hexxagon: 16.09% (0.9909 => 1.1503, std.dev.: 0.0082) SingleSource/Regression/C++/ofstream_ctor: 15.98% (0.3004 => 0.3484, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/espresso/espresso: 15.96% (1.6211 => 1.8798, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.95% (0.1160 => 0.1345, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.94% (0.2792 => 0.3237, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 15.94% (0.2780 => 0.3223, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 15.93% (0.2813 => 0.3261, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 15.91% (0.2823 => 0.3272, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.90% (2.0673 => 2.3961, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/18-imp/imp: 15.90% (0.1421 => 0.1647, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 15.88% (0.2803 => 0.3248, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.84% (0.3195 => 0.3701, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/wc: 15.83% (0.3096 => 0.3586, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 15.76% (0.2811 => 0.3254, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.73% (0.2911 => 0.3369, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 15.66% (0.7171 => 0.8294, std.dev.: 0.0034) MultiSource/Benchmarks/Bullet/bullet: 15.63% (23.5202 => 27.1968, std.dev.: 0.0195) MultiSource/Applications/d/make_dparser: 15.60% (1.0781 => 1.2463, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: 15.55% (0.3267 => 0.3775, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.44% (0.3362 => 0.3881, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.42% (4.4195 => 5.1008, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.34% (0.4361 => 0.5030, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.31% (2.7292 => 3.1470, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary: 15.16% (0.3258 => 0.3752, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: 15.11% (0.1284 => 0.1478, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.11% (1.9694 => 2.2669, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary2: 15.10% (0.3317 => 0.3818, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.09% (1.9966 => 2.2979, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.08% (0.3845 => 0.4425, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.03% (0.3060 => 0.3520, std.dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 15.01% (4.2109 => 4.8431, std.dev.: 0.0108) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.99% (0.3930 => 0.4519, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.76% (0.3124 => 0.3585, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 14.63% (0.3678 => 0.4216, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 14.61% (0.3348 => 0.3837, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.50% (0.1090 => 0.1248, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 14.42% (0.2566 => 0.2936, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.38% (0.3282 => 0.3754, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 14.33% (0.3726 => 0.4260, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.26% (0.3625 => 0.4142, std.dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/lists1: 14.12% (0.3477 => 0.3968, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 14.11% (0.4146 => 0.4731, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 14.07% (0.4251 => 0.4849, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.04% (0.3981 => 0.4540, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.01% (0.3690 => 0.4207, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: 13.73% (0.2075 => 0.2360, std.dev.: 0.0021) MultiSource/Applications/lua/lua: 13.69% (1.4269 => 1.6223, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-2: 13.61% (0.3446 => 0.3915, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 13.57% (0.5012 => 0.5692, std.dev.: 0.0171) SingleSource/UnitTests/ObjC/exceptions-4: 13.54% (0.3465 => 0.3934, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 13.53% (0.3496 => 0.3969, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 13.51% (0.3442 => 0.3907, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.50% (0.3488 => 0.3959, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 13.47% (0.3460 => 0.3926, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 13.46% (0.3469 => 0.3936, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 13.18% (0.3650 => 0.4131, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 13.07% (0.3643 => 0.4119, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 13.05% (2.1653 => 2.4479, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/parameter-passing: 13.05% (0.3724 => 0.4210, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 13.04% (0.7875 => 0.8902, std.dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 12.95% (4.6177 => 5.2159, std.dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 12.22% (2.1013 => 2.3581, std.dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 11.89% (0.2691 => 0.3011, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.79% (0.1383 => 0.1546, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 11.53% (5.5417 => 6.1807, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.47% (0.2040 => 0.2274, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 11.46% (0.3498 => 0.3899, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.38% (0.1028 => 0.1145, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.00% (0.2737 => 0.3038, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 10.51% (0.6634 => 0.7331, std.dev.: 0.0067) MultiSource/Benchmarks/PAQ8p/paq8p: 10.46% (0.4847 => 0.5354, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 10.40% (0.3336 => 0.3683, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.70% (0.2103 => 0.2307, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: 9.25% (2.0346 => 2.2229, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.10% (4.6926 => 5.1198, std.dev.: 0.1344) MultiSource/Applications/lemon/lemon: 8.91% (0.2391 => 0.2604, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.70% (11.6398 => 12.6526, std.dev.: 0.0177) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.72% (0.5584 => 0.6015, std.dev.: 0.0132) MultiSource/Applications/kimwitu++/kc: 6.78% (11.9555 => 12.7660, std.dev.: 0.0104) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.19% (0.3792 => 0.3951, std.dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.60% (0.2162 => 0.3537, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-1: 22.66% (6.2401 => 7.6540, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.28% (0.5917 => 0.6703, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 8.67% (0.2802 => 0.3045, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6108, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/ary: 6.13% (0.2122 => 0.2252, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6682, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1674, std.dev.: 0.0169) SingleSource/Benchmarks/Misc/flops-2: 4.06% (1.8057 => 1.8791, std.dev.: 0.0090) SingleSource/Benchmarks/Dhrystone/dry: 2.78% (14.0481 => 14.4392, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary3: 2.09% (15.8721 => 16.2035, std.dev.: 0.0032) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.82% (3.1722 => 3.2298, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3054, std.dev.: 0.0110) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2886, std.dev.: 0.0018) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5136, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5406, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 1.08% (50.0626 => 50.6028, std.dev.: 0.0101) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.27% (2.4764 => 2.3955, std.dev.: 0.0130) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.56% (25.4195 => 16.3794, std.dev.: 0.0324) SingleSource/Benchmarks/Shootout-C++/ary2: -8.91% (0.2402 => 0.2188, std.dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: -7.70% (28.1477 => 25.9792, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.66% (35.5013 => 32.7824, std.dev.: 0.0984) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9576, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2421, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.18% (11.2080 => 10.8514, std.dev.: 0.0359) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7746, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5217, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.84% (0.6293 => 0.6114, std.dev.: 0.0044) SingleSource/Benchmarks/Dhrystone/fldry: -2.70% (17.2379 => 16.7722, std.dev.: 0.0406) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.19% (41.7953 => 40.8806, std.dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5714, std.dev.: 0.0115) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4957, std.dev.: 0.0072) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.33% (5.7935 => 5.7162, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.11% (105.3826 => 104.2103, std.dev.: 0.0576) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0435, std.dev.: 0.0566) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.05% (3.3991 => 3.3634, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 3.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 01:31:34 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 03:31:34 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121031083134.402082A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5438?compare_to=5434&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5438, Order: 167107, Start Time: 2012-10-31 07:04:51, End Time: 2012-10-31 08:31:36 To: 5434, Order: 167105, Start Time: 2012-10-31 05:20:25, End Time: 2012-10-31 06:48:04 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 5 (66 on baseline) Performance Improvements: 7 (5 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 979 (903 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: 6.59% (0.7448 => 0.7939, std.dev.: 0.0137) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.68% (4.3554 => 4.5591, std.dev.: 0.0541) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.72% (0.3363 => 0.3488, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/life/life: 2.38% (2.5683 => 2.6295, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.35% (7.1344 => 7.2309, std.dev.: 0.0342) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -1.89% (0.8370 => 0.8212, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -11.66% (3.4574 => 3.0542, std.dev.: 0.0978) SingleSource/Benchmarks/Shootout/nestedloop: -5.04% (0.2125 => 0.2018, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/lpbench: -3.97% (4.0818 => 3.9199, std.dev.: 0.0266) MultiSource/Benchmarks/nbench/nbench: -3.27% (24.0846 => 23.2979, std.dev.: 0.2954) MultiSource/Applications/SIBsim4/SIBsim4: -1.13% (3.2154 => 3.1790, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.09% (2.9442 => 2.9122, std.dev.: 0.0069) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.03% (16.7186 => 16.7232, std.dev.: 0.2034) MultiSource/Applications/obsequi/Obsequi: -2.29% (1.0765 => 1.0518, std.dev.: 0.0114) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.34% (21.6454 => 21.7181, std.dev.: 0.0386) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.87% (0.3694 => 0.3662, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: -0.21% (0.6079 => 0.6066, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.11% (0.3373 => 0.3268, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/strcat: -0.25% (0.2019 => 0.2014, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -24.66% (0.0219 => 0.0165, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.87% (0.0426 => 0.0401, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.60% (0.0333 => 0.0331, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.26% (0.0317 => 0.0313, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -19.76% (0.0425 => 0.0341, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0204 => 0.0204, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -32.73% (0.0220 => 0.0148, std.dev.: 0.0035) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -1.10% (0.1451 => 0.1435, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 2.24% (1.1288 => 1.1541, std.dev.: 0.0265) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.76% (0.1443 => 0.1432, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.70% (0.4004 => 0.4032, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.29% (0.1319 => 0.1336, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.16% (0.0608 => 0.0609, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -23.42% (0.0269 => 0.0206, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.17% (0.0537 => 0.0554, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.19% (1.1476 => 1.1339, std.dev.: 0.0568) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -75.00% (0.0004 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.77% (0.0631 => 0.0582, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 32.28% (0.0189 => 0.0250, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.11% (0.8014 => 0.8023, std.dev.: 0.0119) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: -100.00% (0.0001 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -33.33% (0.0072 => 0.0048, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2341.36% (0.6332 => 15.4587, std.dev.: 0.0376) MultiSource/Benchmarks/McCat/08-main/main: 46.26% (0.1831 => 0.2678, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.58% (0.1559 => 0.1472, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1497.64% (0.3344 => 5.3425, std.dev.: 0.0430) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.07% (0.2364 => 0.3264, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel: 3.03% (0.0429 => 0.0442, std.dev.: 0.0009) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.45% (0.0224 => 0.0223, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -45.22% (0.0230 => 0.0126, std.dev.: 0.0014) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4375, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0721, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4951, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3509, std.dev.: 0.0129) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0462, std.dev.: 0.0147) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4031, std.dev.: 0.0023) SingleSource/Regression/C/uint64_to_float: -24.00% (2.1832 => 1.6593, std.dev.: 0.0011) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 35.23% (14.7684 => 19.9708, std.dev.: 0.1481) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.44% (0.0810 => 0.0927, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.41% (0.0830 => 0.0933, std.dev.: 0.0007) SingleSource/UnitTests/SignlessTypes/rem: 11.98% (0.1035 => 0.1159, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 11.87% (0.1112 => 0.1244, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.58% (0.1425 => 0.1533, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.49% (0.2279 => 0.2427, std.dev.: 0.0039) MultiSource/Applications/SIBsim4/SIBsim4: 6.47% (1.2568 => 1.3381, std.dev.: 0.0246) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.06% (0.3137 => 0.3327, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.70% (0.1983 => 0.2096, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.07% (13.1811 => 13.8498, std.dev.: 0.0338) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.98% (6.6074 => 6.9364, std.dev.: 0.0328) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.75% (0.7473 => 0.7828, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.56% (1.6386 => 1.7134, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.54% (0.2998 => 0.3134, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.52% (1.1170 => 1.1675, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.51% (0.4127 => 0.4313, std.dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 4.46% (1.1271 => 1.1774, std.dev.: 0.0147) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.08% (0.4559 => 0.4745, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.00% (0.3003 => 0.3123, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 3.96% (0.9039 => 0.9397, std.dev.: 0.0099) MultiSource/Applications/Burg/burg: 3.66% (1.2222 => 1.2669, std.dev.: 0.0097) MultiSource/Applications/d/make_dparser: 3.47% (3.2366 => 3.3488, std.dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: 3.41% (14.2605 => 14.7467, std.dev.: 0.0227) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.32% (1.1606 => 1.1991, std.dev.: 0.0074) MultiSource/Applications/spiff/spiff: 3.30% (0.7950 => 0.8212, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.27% (0.8420 => 0.8695, std.dev.: 0.0099) MultiSource/Applications/lemon/lemon: 3.13% (1.0945 => 1.1288, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 3.09% (0.9069 => 0.9349, std.dev.: 0.0027) MultiSource/Applications/treecc/treecc: 2.99% (1.9948 => 2.0544, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.94% (0.8457 => 0.8706, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.70% (0.9688 => 0.9950, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/05-eks/eks: 2.68% (0.4397 => 0.4515, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.61% (0.9056 => 0.9292, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.58% (0.8611 => 0.8833, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.55% (0.8359 => 0.8572, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.49% (0.8007 => 0.8206, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.44% (0.8805 => 0.9020, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.38% (4.1763 => 4.2759, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.29% (0.8261 => 0.8450, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.25% (0.8716 => 0.8912, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.25% (0.8050 => 0.8231, std.dev.: 0.0068) MultiSource/Benchmarks/mafft/pairlocalalign: 2.25% (8.6247 => 8.8186, std.dev.: 0.0270) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.21% (0.8316 => 0.8500, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.01% (2.1401 => 2.1831, std.dev.: 0.0103) MultiSource/Applications/lambda-0_1_3/lambda: 1.98% (0.7557 => 0.7707, std.dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: 1.88% (6.7320 => 6.8586, std.dev.: 0.0331) MultiSource/Benchmarks/Bullet/bullet: 1.78% (31.8598 => 32.4256, std.dev.: 0.0667) MultiSource/Applications/siod/siod: 1.77% (2.2184 => 2.2576, std.dev.: 0.0097) MultiSource/Applications/JM/lencod/lencod: 1.72% (15.3280 => 15.5923, std.dev.: 0.0645) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.59% (1.5315 => 1.5559, std.dev.: 0.0069) MultiSource/Benchmarks/PAQ8p/paq8p: 1.54% (2.3764 => 2.4130, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.39% (1.2423 => 1.2596, std.dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 57.08% (1.5795 => 2.4811, std.dev.: 0.0135) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.37% (2.7978 => 3.7313, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.48% (0.3186 => 0.3488, std.dev.: 0.0026) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.40% (2.4333 => 2.6621, std.dev.: 0.0277) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.62% (1.1857 => 1.2761, std.dev.: 0.0074) MultiSource/Benchmarks/nbench/nbench: 6.07% (21.9654 => 23.2979, std.dev.: 0.2954) MultiSource/Benchmarks/mafft/pairlocalalign: 5.92% (63.1822 => 66.9244, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.68% (4.3552 => 4.5591, std.dev.: 0.0541) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.90% (2.4490 => 2.5199, std.dev.: 0.0253) MultiSource/Applications/siod/siod: 2.64% (3.6643 => 3.7611, std.dev.: 0.0148) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.10% (41.4238 => 42.2931, std.dev.: 0.2388) SingleSource/Benchmarks/Shootout-C++/hash: 1.77% (0.6205 => 0.6315, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/bh/bh: 1.66% (2.3560 => 2.3952, std.dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.81% (0.3269 => 0.2981, std.dev.: 0.0031) MultiSource/Applications/lua/lua: -5.07% (29.8330 => 28.3217, std.dev.: 0.0488) SingleSource/Benchmarks/Shootout-C++/hash2: -1.58% (3.4237 => 3.3696, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.49% (3.3479 => 3.2981, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/ffbench: -1.11% (1.4296 => 1.4138, std.dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.68% (16.4461 => 16.7232, std.dev.: 0.2034) MultiSource/Applications/obsequi/Obsequi: 2.49% (1.0262 => 1.0518, std.dev.: 0.0114) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6854.24% (0.3123 => 21.7181, std.dev.: 0.0386) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.68% (0.2463 => 0.3662, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 0.93% (0.6010 => 0.6066, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.06% (0.3266 => 0.3268, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/strcat: 2.29% (0.1969 => 0.2014, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 34.15% (0.0123 => 0.0165, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.72% (0.0408 => 0.0401, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.31% (0.0254 => 0.0331, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -11.20% (0.0384 => 0.0341, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -17.78% (0.0180 => 0.0148, std.dev.: 0.0035) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -0.21% (0.1438 => 0.1435, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.87% (1.1329 => 1.1541, std.dev.: 0.0265) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -2.05% (0.1462 => 0.1432, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.17% (0.4164 => 0.4032, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.41% (0.1369 => 0.1336, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.99% (0.0641 => 0.0609, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 5.64% (0.0195 => 0.0206, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.15% (0.0578 => 0.0554, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.86% (1.1437 => 1.1339, std.dev.: 0.0568) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.18% (0.0627 => 0.0582, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 38.89% (0.0180 => 0.0250, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.07% (0.8017 => 0.8023, std.dev.: 0.0119) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -22.58% (0.0062 => 0.0048, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 03:06:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 05:06:37 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121031100637.294012A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5439?compare_to=5435&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5439, Order: 167107, Start Time: 2012-10-31 07:45:31, End Time: 2012-10-31 10:06:37 To: 5435, Order: 167104, Start Time: 2012-10-31 04:51:38, End Time: 2012-10-31 07:13:39 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (17 on baseline) New Passes: 0 (14 on baseline) Performance Regressions: 1 (181 on baseline) Performance Improvements: 2 (47 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 22 (5 on baseline) Unchanged Tests: 1017 (644 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Bullet/bullet: 1.30% (56.6782 => 57.4133, std.dev.: 0.0213) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.09% (81.6866 => 79.9762, std.dev.: 0.4702) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.01% (1.3231 => 1.2965, std.dev.: 0.0043) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/lemon/lemon MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Shootout-C++/ary2 MultiSource/Applications/JM/ldecod/ldecod: 0.08% (0.1228 => 0.1229, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: - (0.0111 => 0.0111, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: -0.02% (13.1511 => 13.1484, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 0.12% (1.4527 => 1.4545, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 0.08% (0.1331 => 0.1332, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -28.57% (0.0007 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0076 => 0.0076, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -0.09% (0.1165 => 0.1164, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 0.02% (499.7581 => 499.8483, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.14% (0.0722 => 0.0723, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: - (0.2552 => 0.2552, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/bh/bh: - (0.0176 => 0.0176) MultiSource/Benchmarks/Olden/power/power: 0.00% (13.2148 => 13.2149, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -0.29% (0.0342 => 0.0341, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -0.70% (0.0574 => 0.0570, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.34% (0.0521 => 0.0528, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.28% (0.0357 => 0.0358, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.70% (0.0046 => 0.0050, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 82.75% (21.8739 => 39.9743, std.dev.: 1.0143) SingleSource/Benchmarks/BenchmarkGame/n-body: - (1.3169 => 1.3169) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -0.01% (3.0439 => 3.0437, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -0.13% (0.0757 => 0.0756, std.dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/lemon/lemon MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Shootout-C++/ary2 MultiSource/Applications/JM/ldecod/ldecod: -5.32% (0.1298 => 0.1229, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.59% (1.4460 => 1.4545, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: -99.99% (4.6441 => 0.0005, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.83% (4.3882 => 0.0076, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -98.91% (10.7105 => 0.1164, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 423859.54% (0.1179 => 499.8483, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -35.99% (0.3987 => 0.2552, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/bh/bh: -99.09% (1.9405 => 0.0176) MultiSource/Benchmarks/Olden/power/power: 1071.85% (1.1277 => 13.2149, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -99.96% (85.0658 => 0.0341, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -34.03% (0.0864 => 0.0570, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.58% (0.0611 => 0.0528, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -29.25% (0.0506 => 0.0358, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 35.14% (0.0037 => 0.0050, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.71% (1.3677 => 1.3169) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.11% (3.2416 => 3.0437, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -0.13% (0.0757 => 0.0756, std.dev.: 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 199.96% (0.5229 => 1.5685, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 14.00% (14.9895 => 17.0873, std.dev.: 0.0054) MultiSource/Applications/kimwitu++/kc: 36.32% (14.1553 => 19.2968, std.dev.: 0.0192) MultiSource/Benchmarks/MallocBench/gs/gs: 13.48% (4.1105 => 4.6646, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 29.59% (1.1048 => 1.4317, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 306.90% (7.1582 => 29.1270, std.dev.: 0.0120) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.42% (3.4629 => 5.8321, std.dev.: 0.0187) SingleSource/Benchmarks/Misc-C++/stepanov_container: 63.97% (0.6222 => 1.0202, std.dev.: 0.0016) New Passes - Execution Time --------------------------- MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SPASS/SPASS: 11189800.00% (0.0001 => 11.1899, std.dev.: 0.0076) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 66400.00% (0.0001 => 0.0665, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050200.00% (0.0001 => 10.0503, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5488400.00% (0.0001 => 5.4885, std.dev.: 0.0027) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 40.25% (0.1056 => 0.1481, std.dev.: 0.0001) SingleSource/UnitTests/vla: 29.01% (0.0355 => 0.0458, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 28.35% (0.1432 => 0.1838, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 23.41% (0.0457 => 0.0564, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.84% (0.0648 => 0.0796, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 22.06% (0.0798 => 0.0974, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.65% (0.1566 => 0.1905, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.95% (0.0842 => 0.1010, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 19.68% (0.1555 => 0.1861, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 19.55% (0.0793 => 0.0948, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 19.09% (0.0770 => 0.0917, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.37% (0.8172 => 0.9673, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/rem: 17.74% (0.1144 => 0.1347, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 17.50% (0.3177 => 0.3733, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.48% (0.2065 => 0.2426, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/em3d/em3d: 17.46% (0.1695 => 0.1991, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 17.42% (0.2554 => 0.2999, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 17.40% (0.0730 => 0.0857, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.37% (0.1117 => 0.1311, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/17-bintr/bintr: 17.33% (0.0675 => 0.0792, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 17.24% (0.4879 => 0.5720, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 17.20% (0.1151 => 0.1349, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.15% (0.0834 => 0.0977, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 17.11% (0.1175 => 0.1376, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.08% (0.2758 => 0.3229, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.99% (0.0871 => 0.1019, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.89% (0.3121 => 0.3648, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 16.85% (0.1163 => 0.1359, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.82% (0.0886 => 0.1035, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 16.79% (0.1584 => 0.1850, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bisort/bisort: 16.78% (0.0614 => 0.0717, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.62% (0.1029 => 0.1200, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 16.22% (0.0746 => 0.0867, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 15.81% (0.2271 => 0.2630, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.66% (0.2107 => 0.2437, std.dev.: 0.0022) MultiSource/Applications/minisat/minisat: 15.38% (0.7115 => 0.8209, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 15.37% (0.7835 => 0.9039, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 15.11% (0.1655 => 0.1905, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.10% (0.1940 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 15.07% (0.0730 => 0.0840, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.07% (0.1062 => 0.1222, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 15.02% (0.1125 => 0.1294, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 14.77% (0.5105 => 0.5859, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.74% (0.2700 => 0.3098, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.71% (0.5981 => 0.6861, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.66% (0.1337 => 0.1533, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 14.60% (22.1758 => 25.4136, std.dev.: 0.0129) MultiSource/Applications/Burg/burg: 14.49% (1.1642 => 1.3329, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 14.28% (0.5569 => 0.6364, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.20% (0.5860 => 0.6692, std.dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 14.10% (0.7433 => 0.8481, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.06% (0.4615 => 0.5264, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 13.96% (0.3109 => 0.3543, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.96% (0.1906 => 0.2172, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 13.71% (3.3354 => 3.7926, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.60% (0.1625 => 0.1846, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.55% (0.9765 => 1.1088, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.51% (0.1510 => 0.1714, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.46% (0.3441 => 0.3904, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 13.41% (0.5020 => 0.5693, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.25% (1.5415 => 1.7458, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.25% (0.0770 => 0.0872, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.17% (0.6675 => 0.7554, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.79% (0.1032 => 0.1164, std.dev.: 0.0020) MultiSource/Applications/treecc/treecc: 12.79% (2.0273 => 2.2865, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.54% (1.3050 => 1.4687, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 12.54% (3.8723 => 4.3578, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/exptree: 12.41% (0.0814 => 0.0915, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.37% (0.2603 => 0.2925, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 12.30% (0.3423 => 0.3844, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 12.07% (0.4299 => 0.4818, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 12.07% (0.1268 => 0.1421, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.02% (0.3543 => 0.3969, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.98% (0.6450 => 0.7223, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.96% (1.1861 => 1.3280, std.dev.: 0.0074) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.94% (0.3543 => 0.3966, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 11.88% (1.0722 => 1.1996, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.82% (0.3307 => 0.3698, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.73% (0.1236 => 0.1381, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.72% (0.1143 => 0.1277, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 11.71% (0.8921 => 0.9966, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 11.69% (0.3473 => 0.3879, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 11.66% (1.1840 => 1.3220, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.59% (0.3927 => 0.4382, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-2: 11.44% (0.3497 => 0.3897, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.43% (4.2646 => 4.7519, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/synchronized: 11.35% (0.3561 => 0.3965, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 11.33% (8.1363 => 9.0578, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/exceptions-3: 11.29% (0.3516 => 0.3913, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.15% (0.3828 => 0.4255, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/for-in: 11.15% (0.3694 => 0.4106, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 11.14% (0.1463 => 0.1626, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 11.12% (0.4289 => 0.4766, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 11.01% (0.3387 => 0.3760, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.98% (0.0929 => 0.1031, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 10.91% (0.3886 => 0.4310, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 10.88% (0.3180 => 0.3526, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 10.86% (9.4845 => 10.5146, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.86% (0.1695 => 0.1879, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.62% (1.4186 => 1.5692, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.57% (2.2022 => 2.4349, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.48% (0.4636 => 0.5122, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 10.47% (0.6456 => 0.7132, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.46% (0.8101 => 0.8948, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.45% (0.1330 => 0.1469, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.45% (1.5859 => 1.7516, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.38% (2.2024 => 2.4309, std.dev.: 0.0019) MultiSource/Applications/siod/siod: 10.31% (2.2969 => 2.5336, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.12% (0.2430 => 0.2676, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.06% (0.1044 => 0.1149, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.78% (0.3865 => 0.4243, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 9.77% (0.7326 => 0.8042, std.dev.: 0.0040) MultiSource/Applications/hbd/hbd: 9.75% (1.5603 => 1.7124, std.dev.: 0.0058) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.73% (0.1892 => 0.2076, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 9.72% (0.4620 => 0.5069, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.69% (14.3668 => 15.7587, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.57% (4.9449 => 5.4179, std.dev.: 0.0104) SingleSource/UnitTests/ObjC++/property-reference-object: 9.54% (0.6030 => 0.6605, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.43% (0.5925 => 0.6484, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.42% (0.4203 => 0.4599, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 9.38% (0.3422 => 0.3743, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.24% (5.0018 => 5.4642, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.99% (0.4103 => 0.4472, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 8.75% (0.4048 => 0.4402, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 8.71% (0.3684 => 0.4005, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 8.68% (0.1268 => 0.1378, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/sieve: 8.52% (0.3603 => 0.3910, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.52% (0.8067 => 0.8754, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.31% (0.2793 => 0.3025, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.23% (0.3826 => 0.4141, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 8.23% (0.2905 => 0.3144, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.14% (0.3427 => 0.3706, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 8.05% (0.2831 => 0.3059, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 8.00% (0.2725 => 0.2943, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.97% (0.3650 => 0.3941, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.76% (0.2756 => 0.2970, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.68% (0.2891 => 0.3113, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 7.60% (17.1811 => 18.4862, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/hello: 7.59% (0.2714 => 0.2920, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.42% (2.0665 => 2.2199, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/matrix: 7.39% (0.3098 => 0.3327, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 7.37% (0.3283 => 0.3525, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.37% (0.3162 => 0.3395, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 7.33% (0.2877 => 0.3088, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 7.33% (0.3232 => 0.3469, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.31% (0.4064 => 0.4361, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 7.18% (0.2871 => 0.3077, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 7.00% (1.2842 => 1.3741, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 6.94% (5.7591 => 6.1585, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.86% (0.2872 => 0.3069, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 6.85% (0.2802 => 0.2994, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 6.81% (0.3379 => 0.3609, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 6.66% (0.3092 => 0.3298, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 6.09% (0.3282 => 0.3482, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.90% (0.3136 => 0.3321, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.72% (3.8922 => 4.1150, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/objinst: 5.37% (0.3131 => 0.3299, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.99% (0.2266 => 0.2379, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.77% (0.3817 => 0.3961, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.63% (0.3935 => 0.4078, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.12% (7.9617 => 8.1307, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.57% (7.0540 => 7.1649, std.dev.: 0.0115) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 19.81% (2.8904 => 3.4629, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.62% (1.1145 => 1.2997, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 10.25% (0.1629 => 0.1796, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 9.96% (1.1396 => 1.2531, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.11% (0.9540 => 1.0218) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3684, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.43% (0.3463 => 0.3651, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.87% (0.4162 => 0.4323, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.63% (4.2280 => 4.3394, std.dev.: 0.0084) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.41% (1.0313 => 1.0562, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.33% (1.7254 => 1.7656, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.90% (0.8333 => 0.8491, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2075, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 1.32% (11.6436 => 11.7970, std.dev.: 0.0062) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.07% (6.5088 => 6.5786, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.88% (6.6874 => 0.1421, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -76.53% (0.8651 => 0.2030, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.33% (5.3855 => 2.4056, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -54.99% (5.3526 => 2.4090, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: -45.75% (0.1622 => 0.0880, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.15% (1.1194 => 0.6812, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.84% (5.2763 => 3.2799, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -24.24% (1.7609 => 1.3340, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -16.75% (2.9384 => 2.4463, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: -9.71% (10.4361 => 9.4224, std.dev.: 0.0045) MultiSource/Benchmarks/Bullet/bullet: -9.22% (63.2438 => 57.4133, std.dev.: 0.0213) SingleSource/UnitTests/Vector/constpool: -8.95% (54.1659 => 49.3157, std.dev.: 0.0109) MultiSource/Benchmarks/PAQ8p/paq8p: -4.42% (10.3673 => 9.9091, std.dev.: 0.0055) MultiSource/Applications/JM/lencod/lencod: -1.99% (21.9371 => 21.4997, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -43.00% (0.0400 => 0.0228, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.43% (1.1492 => 0.7650, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: -15.96% (1.6925 => 1.4224, std.dev.: 0.0025) MultiSource/Benchmarks/NPB-serial/is/is: -10.99% (9.5636 => 8.5130, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: -10.68% (1.5373 => 1.3731, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.31% (19.9488 => 18.2908, std.dev.: 0.1213) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.96% (1.8329 => 1.7054, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -6.52% (0.2161 => 0.2020, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -6.08% (1.2373 => 1.1621, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5757, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: -5.45% (6.6465 => 6.2844, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.04% (1.6805 => 1.5958, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.84% (1.5835 => 1.5068, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.41% (0.9957 => 0.9518, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.00% (0.2497 => 0.2397, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.67% (3.2827 => 3.1622, std.dev.: 0.0030) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.55% (32.5116 => 31.3573, std.dev.: 0.0083) MultiSource/Benchmarks/sim/sim: -3.23% (5.0483 => 4.8850, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.87% (0.4808 => 0.4670, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.81% (4.5009 => 4.3744, std.dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.07% (8.1563 => 7.9871, std.dev.: 0.0230) SingleSource/Benchmarks/Misc/salsa20: -1.92% (10.2830 => 10.0851, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/flops: -1.68% (8.8334 => 8.6847, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -1.58% (2.5528 => 2.5125, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/hash: -1.08% (4.9088 => 4.8559, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.01% (6.2999 => 6.2363, std.dev.: 0.0050) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: -84.58% (0.0720 => 0.0111, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 13148300.00% (0.0001 => 13.1484, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -65.83% (0.2116 => 0.0723, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 39974200.00% (0.0001 => 39.9743, std.dev.: 1.0143) Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 04:00:45 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 06:00:45 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121031110045.1C0052A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5440?compare_to=5438&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5440, Order: 167108, Start Time: 2012-10-31 09:32:24, End Time: 2012-10-31 11:00:47 To: 5438, Order: 167107, Start Time: 2012-10-31 07:04:51, End Time: 2012-10-31 08:31:36 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 17 (103 on baseline) Performance Improvements: 3 (5 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 971 (866 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/treeadd/treeadd: 34.77% (0.0348 => 0.0469, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: 10.23% (0.2816 => 0.3104, std.dev.: 0.0052) SingleSource/UnitTests/Vector/constpool: 10.20% (8.4635 => 9.3266, std.dev.: 0.0641) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.83% (0.8312 => 0.8963, std.dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.48% (0.4917 => 0.5285, std.dev.: 0.0043) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.61% (0.3327 => 0.3447, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.95% (0.7828 => 0.8059, std.dev.: 0.0087) MultiSource/Applications/Burg/burg: 2.03% (1.2669 => 1.2926, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.84% (1.2507 => 1.2737, std.dev.: 0.0082) MultiSource/Applications/lua/lua: 1.43% (3.9030 => 3.9588, std.dev.: 0.0094) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 13.40% (3.0542 => 3.4636, std.dev.: 0.1385) SingleSource/Benchmarks/CoyoteBench/lpbench: 3.97% (3.9199 => 4.0755, std.dev.: 0.0551) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.70% (21.8597 => 22.6684, std.dev.: 0.1676) SingleSource/Benchmarks/Shootout-C++/ary3: 1.87% (2.0011 => 2.0386, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/ReedSolomon: 1.34% (8.6757 => 8.7922, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/ffbench: 1.15% (1.4138 => 1.4300, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.08% (1.6038 => 1.6211, std.dev.: 0.0062) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.04% (0.9397 => 0.9205, std.dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/himenobmtxpa: -3.88% (4.5591 => 4.3820, std.dev.: 0.0259) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -1.13% (42.2931 => 41.8137, std.dev.: 0.1277) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.06% (16.7232 => 16.7325, std.dev.: 0.1724) MultiSource/Applications/obsequi/Obsequi: 2.33% (1.0518 => 1.0763, std.dev.: 0.0060) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.43% (21.7181 => 21.6239, std.dev.: 0.2573) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.98% (0.3662 => 0.3698, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: 0.68% (0.6066 => 0.6107, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.85% (0.3268 => 0.3361, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 0.55% (0.2014 => 0.2025, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 33.33% (0.0165 => 0.0220, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 6.73% (0.0401 => 0.0428, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.51% (0.0331 => 0.0336, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.19% (0.0313 => 0.0323, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 24.93% (0.0341 => 0.0426, std.dev.: 0.0048) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0204 => 0.0203, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 48.65% (0.0148 => 0.0220, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 1.53% (0.1435 => 0.1457, std.dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.52% (1.1541 => 1.1365, std.dev.: 0.0295) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 5.73% (0.1432 => 0.1514, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.40% (0.4032 => 0.4016, std.dev.: 0.0165) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.90% (0.1336 => 0.1324, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.69% (0.0609 => 0.0668, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 30.58% (0.0206 => 0.0269, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.43% (0.0554 => 0.0535, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.07% (1.1339 => 1.1460, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.62% (0.0582 => 0.0638, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.60% (0.0250 => 0.0259, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.36% (0.8023 => 0.8052, std.dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -8.33% (0.0048 => 0.0044, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2338.58% (0.6332 => 15.4411, std.dev.: 0.1900) MultiSource/Benchmarks/McCat/08-main/main: 50.30% (0.1831 => 0.2752, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.97% (0.1559 => 0.1466, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1489.56% (0.3344 => 5.3155, std.dev.: 0.0900) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.90% (0.2364 => 0.3260, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel: 0.93% (0.0429 => 0.0433, std.dev.: 0.0007) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.89% (0.0224 => 0.0222, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: -31.74% (0.0230 => 0.0157, std.dev.: 0.0009) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4414, std.dev.: 0.0942) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0706, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4941, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3536, std.dev.: 0.0145) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0323, std.dev.: 0.0116) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4012, std.dev.: 0.0056) SingleSource/Regression/C/uint64_to_float: -24.12% (2.1832 => 1.6566, std.dev.: 0.0093) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 36.20% (14.7684 => 20.1144, std.dev.: 0.0764) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 21.60% (0.0810 => 0.0985, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/rem: 14.98% (0.1035 => 0.1190, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 12.86% (0.1112 => 0.1255, std.dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: 10.79% (8.4179 => 9.3266, std.dev.: 0.0641) MultiSource/Benchmarks/SciMark2-C/scimark2: 9.88% (0.3137 => 0.3447, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.33% (0.1425 => 0.1558, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.04% (0.4847 => 0.5285, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.12% (0.2279 => 0.2464, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.08% (0.1905 => 0.2059, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.84% (0.7473 => 0.8059, std.dev.: 0.0087) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.72% (0.8321 => 0.8963, std.dev.: 0.0150) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.43% (0.2180 => 0.2342, std.dev.: 0.0050) MultiSource/Applications/SIBsim4/SIBsim4: 7.03% (1.2568 => 1.3451, std.dev.: 0.0131) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.91% (0.1983 => 0.2120, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.46% (0.3003 => 0.3197, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.00% (0.9435 => 1.0001, std.dev.: 0.0096) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.85% (6.6074 => 6.9942, std.dev.: 0.0346) MultiSource/Applications/Burg/burg: 5.76% (1.2222 => 1.2926, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.52% (0.6010 => 0.6342, std.dev.: 0.0125) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.41% (0.1885 => 0.1987, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.28% (0.2519 => 0.2652, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.20% (0.2998 => 0.3154, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.18% (13.1811 => 13.8641, std.dev.: 0.0648) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.99% (1.6386 => 1.7204, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.96% (0.6287 => 0.6599, std.dev.: 0.0093) MultiSource/Benchmarks/nbench/nbench: 4.77% (1.1271 => 1.1809, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.68% (0.4127 => 0.4320, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.67% (0.4559 => 0.4772, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.58% (0.5191 => 0.5429, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.57% (0.6586 => 0.6887, std.dev.: 0.0080) MultiSource/Applications/sgefa/sgefa: 4.47% (0.2999 => 0.3133, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.45% (0.2741 => 0.2863, std.dev.: 0.0047) MultiSource/Applications/spiff/spiff: 4.31% (0.7950 => 0.8293, std.dev.: 0.0081) MultiSource/Benchmarks/McCat/18-imp/imp: 4.25% (0.3503 => 0.3652, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.07% (0.3295 => 0.3429, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.97% (0.4783 => 0.4973, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: 3.97% (1.9948 => 2.0739, std.dev.: 0.0081) MultiSource/Applications/d/make_dparser: 3.88% (3.2366 => 3.3623, std.dev.: 0.0179) MultiSource/Applications/SPASS/SPASS: 3.86% (14.2605 => 14.8115, std.dev.: 0.0629) MultiSource/Benchmarks/McCat/05-eks/eks: 3.82% (0.4397 => 0.4565, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/hash2: 3.76% (0.4125 => 0.4280, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.68% (1.1606 => 1.2033, std.dev.: 0.0073) MultiSource/Applications/lua/lua: 3.66% (3.8189 => 3.9588, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.65% (0.2794 => 0.2896, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.49% (1.5315 => 1.5850, std.dev.: 0.0178) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.45% (8.6476 => 8.9461, std.dev.: 0.1140) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.40% (4.1763 => 4.3182, std.dev.: 0.0192) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.32% (4.4873 => 4.6363, std.dev.: 0.0266) MultiSource/Applications/minisat/minisat: 3.20% (0.6834 => 0.7053, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.17% (0.8340 => 0.8604, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.93% (0.3657 => 0.3764, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.81% (1.4479 => 1.4886, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.72% (0.7966 => 0.8183, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.70% (0.8518 => 0.8748, std.dev.: 0.0064) MultiSource/Applications/hbd/hbd: 2.61% (1.4269 => 1.4642, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.59% (0.8611 => 0.8834, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.56% (0.8007 => 0.8212, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.52% (0.8359 => 0.8570, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.50% (0.8316 => 0.8524, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.49% (0.8716 => 0.8933, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.48% (0.8331 => 0.8538, std.dev.: 0.0054) MultiSource/Benchmarks/mafft/pairlocalalign: 2.47% (8.6247 => 8.8377, std.dev.: 0.0674) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.46% (0.8286 => 0.8490, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.45% (0.8457 => 0.8664, std.dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 2.42% (6.7320 => 6.8952, std.dev.: 0.0392) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.42% (0.8317 => 0.8518, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.39% (0.8697 => 0.8905, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.38% (0.9069 => 0.9285, std.dev.: 0.0049) MultiSource/Applications/JM/lencod/lencod: 2.37% (15.3280 => 15.6917, std.dev.: 0.0958) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.37% (0.8050 => 0.8241, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.36% (0.8805 => 0.9013, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.32% (0.8204 => 0.8394, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.31% (0.8597 => 0.8796, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.31% (0.9074 => 0.9284, std.dev.: 0.0029) MultiSource/Applications/oggenc/oggenc: 2.28% (4.9628 => 5.0760, std.dev.: 0.0410) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.26% (0.8069 => 0.8251, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.23% (0.9688 => 0.9904, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.18% (0.8656 => 0.8845, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 2.17% (31.8598 => 32.5509, std.dev.: 0.2029) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.15% (0.9056 => 0.9251, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.07% (0.8261 => 0.8432, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.07% (0.7932 => 0.8096, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.04% (0.8712 => 0.8890, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.03% (0.8177 => 0.8343, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.02% (0.8086 => 0.8249, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.00% (0.8885 => 0.9063, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.90% (0.8927 => 0.9097, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.84% (0.9039 => 0.9205, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.72% (0.9908 => 1.0078, std.dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: 1.54% (0.9810 => 0.9961, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.42% (1.5795 => 2.5023, std.dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 32.85% (2.7978 => 3.7169, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.30% (0.3186 => 0.3514, std.dev.: 0.0060) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.15% (2.4333 => 2.6559, std.dev.: 0.0163) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.14% (1.1857 => 1.2822, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 5.95% (63.1822 => 66.9386, std.dev.: 0.0402) SingleSource/Benchmarks/CoyoteBench/lpbench: 4.48% (3.9006 => 4.0755, std.dev.: 0.0551) SingleSource/Benchmarks/Misc/ReedSolomon: 3.05% (8.5322 => 8.7922, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/hash: 2.21% (0.6205 => 0.6342, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary3: 1.94% (1.9999 => 2.0386, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.70% (4.8362 => 4.9182, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.69% (1.5941 => 1.6211, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.97% (0.3269 => 0.3041, std.dev.: 0.0011) MultiSource/Applications/lua/lua: -5.36% (29.8330 => 28.2344, std.dev.: 0.2458) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.21% (1.0388 => 1.0158, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/hash2: -1.36% (3.4237 => 3.3770, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.31% (3.3479 => 3.3040, std.dev.: 0.0012) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.74% (16.4461 => 16.7325, std.dev.: 0.1724) MultiSource/Applications/obsequi/Obsequi: 4.88% (1.0262 => 1.0763, std.dev.: 0.0060) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6824.08% (0.3123 => 21.6239, std.dev.: 0.2573) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.14% (0.2463 => 0.3698, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: 1.61% (0.6010 => 0.6107, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.91% (0.3266 => 0.3361, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 2.84% (0.1969 => 0.2025, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.86% (0.0123 => 0.0220, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 32.28% (0.0254 => 0.0336, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 6.95% (0.0302 => 0.0323, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.94% (0.0384 => 0.0426, std.dev.: 0.0048) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 22.22% (0.0180 => 0.0220, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 1.32% (0.1438 => 0.1457, std.dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.32% (1.1329 => 1.1365, std.dev.: 0.0295) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.56% (0.1462 => 0.1514, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.55% (0.4164 => 0.4016, std.dev.: 0.0165) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.29% (0.1369 => 0.1324, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.21% (0.0641 => 0.0668, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 37.95% (0.0195 => 0.0269, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.44% (0.0578 => 0.0535, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.20% (1.1437 => 1.1460, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.75% (0.0627 => 0.0638, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 43.89% (0.0180 => 0.0259, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.44% (0.8017 => 0.8052, std.dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -29.03% (0.0062 => 0.0044, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 04:03:28 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 06:03:28 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121031110328.AE16C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5441?compare_to=5436&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5441, Order: 167108, Start Time: 2012-10-31 09:38:11, End Time: 2012-10-31 11:03:29 To: 5436, Order: 167107, Start Time: 2012-10-31 05:57:40, End Time: 2012-10-31 07:25:16 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 1 (174 on baseline) Unchanged Tests: 1040 (862 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/recursive: 1.11% (2.1016 => 2.1249, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.24% (56.6103 => 54.7737, std.dev.: 0.1549) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 19.92% (15.2527 => 18.2908, std.dev.: 0.0091) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.15% (3.1919 => 3.4201, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.77% (2.0478 => 2.1249, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/salsa20: 2.45% (7.4937 => 7.6771, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/hash2: 2.07% (3.1932 => 3.2594, std.dev.: 0.0088) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.67% (0.1431 => 0.1307, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.59% (0.1584 => 0.1448, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.43% (0.3821 => 0.3537, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -7.01% (2.4924 => 2.3176, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.59% (0.3142 => 0.2935, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.49% (0.9542 => 0.8923, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/ReedSolomon: -6.44% (0.1879 => 0.1758, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.37% (22.4056 => 20.9793, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.26% (0.3658 => 0.3429, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.18% (0.2428 => 0.2278, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: -6.16% (0.2160 => 0.2027, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.11% (4.5069 => 4.2316, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: -5.99% (0.3357 => 0.3156, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.98% (0.9852 => 0.9263, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.97% (3.5339 => 3.3228, std.dev.: 0.0047) MultiSource/Applications/JM/lencod/lencod: -5.92% (16.1920 => 15.2338, std.dev.: 0.0190) MultiSource/Applications/JM/ldecod/ldecod: -5.89% (7.0961 => 6.6780, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.88% (0.6484 => 0.6103, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -5.79% (0.2659 => 0.2505, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -5.72% (4.3330 => 4.0853, std.dev.: 0.0063) MultiSource/Applications/Burg/burg: -5.71% (1.2515 => 1.1801, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.70% (1.6474 => 1.5535, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.69% (0.2355 => 0.2221, std.dev.: 0.0011) MultiSource/Applications/siod/siod: -5.68% (2.4021 => 2.2657, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.65% (1.2784 => 1.2062, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.65% (5.4682 => 5.1595, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.62% (4.8161 => 4.5456, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.59% (1.0544 => 0.9955, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.56% (4.8802 => 4.6087, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.50% (4.0323 => 3.8106, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.49% (0.4151 => 0.3923, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -5.49% (0.3880 => 0.3667, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -5.48% (0.3831 => 0.3621, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.48% (0.8521 => 0.8054, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.47% (1.2221 => 1.1552, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/exceptions: -5.44% (0.4176 => 0.3949, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.42% (0.5999 => 0.5674, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-3: -5.41% (0.3848 => 0.3640, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.40% (0.7919 => 0.7491, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: -5.40% (0.3812 => 0.3606, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.39% (0.3837 => 0.3630, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.38% (1.2210 => 1.1553, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.38% (0.2548 => 0.2411, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.37% (0.3891 => 0.3682, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -5.36% (0.4033 => 0.3817, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -5.36% (0.3025 => 0.2863, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.36% (0.3884 => 0.3676, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -5.33% (1.3148 => 1.2447, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/bigfib: -5.30% (0.6750 => 0.6392, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -5.29% (4.0594 => 3.8445, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.29% (0.6293 => 0.5960, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: -5.29% (0.3896 => 0.3690, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -5.27% (0.4861 => 0.4605, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.27% (0.4083 => 0.3868, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.26% (1.6364 => 1.5504, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/property: -5.24% (0.4199 => 0.3979, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.24% (0.4813 => 0.4561, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: -5.23% (0.3194 => 0.3027, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -5.23% (0.2985 => 0.2829, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -5.22% (9.2283 => 8.7465, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.20% (0.3057 => 0.2898, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.18% (0.5925 => 0.5618, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -5.18% (34.0927 => 32.3284, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.17% (0.5478 => 0.5195, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.16% (2.2587 => 2.1422, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.15% (0.5591 => 0.5303, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: -5.14% (0.2939 => 0.2788, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -5.13% (0.3059 => 0.2902, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -5.12% (0.4280 => 0.4061, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.11% (0.7198 => 0.6830, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.11% (0.6304 => 0.5982, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.09% (1.4642 => 1.3896, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.09% (0.6681 => 0.6341, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -5.08% (0.3481 => 0.3304, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.07% (0.6052 => 0.5745, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.07% (2.1713 => 2.0612, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.06% (0.3931 => 0.3732, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.05% (0.4321 => 0.4103, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.04% (0.6230 => 0.5916, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.03% (0.5859 => 0.5564, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.03% (0.2903 => 0.2757, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -5.02% (0.3026 => 0.2874, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -5.02% (0.3446 => 0.3273, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -5.02% (0.2849 => 0.2706, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: -5.02% (0.2989 => 0.2839, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -5.02% (0.2871 => 0.2727, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.01% (0.3849 => 0.3656, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.00% (0.7339 => 0.6972, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: -5.00% (18.2933 => 17.3792, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/ary: -4.98% (0.3394 => 0.3225, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.98% (1.3722 => 1.3039, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -4.97% (0.7982 => 0.7585, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: -4.97% (0.3621 => 0.3441, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.96% (0.5805 => 0.5517, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.95% (0.6660 => 0.6330, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.95% (0.6667 => 0.6337, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.95% (0.5581 => 0.5305, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.94% (0.6194 => 0.5888, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: -4.92% (0.4248 => 0.4039, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -4.91% (0.4524 => 0.4302, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.90% (0.6189 => 0.5886, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.89% (0.5802 => 0.5518, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.89% (0.6297 => 0.5989, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.88% (0.5575 => 0.5303, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.87% (0.3016 => 0.2869, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.87% (0.2278 => 0.2167, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: -4.87% (0.3205 => 0.3049, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: -4.85% (0.3255 => 0.3097, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.82% (0.7524 => 0.7161, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.82% (0.6260 => 0.5958, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.82% (0.6676 => 0.6354, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.81% (0.4427 => 0.4214, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -4.80% (0.3788 => 0.3606, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.76% (0.5857 => 0.5578, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.75% (0.6440 => 0.6134, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: -4.75% (0.3581 => 0.3411, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.72% (0.6395 => 0.6093, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.72% (0.5849 => 0.5573, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.71% (0.5941 => 0.5661, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.71% (0.6033 => 0.5749, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.70% (0.3252 => 0.3099, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.70% (0.4916 => 0.4685, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.70% (0.9557 => 0.9108, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.69% (0.5456 => 0.5200, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: -4.67% (0.9179 => 0.8750, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.66% (0.5688 => 0.5423, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -4.65% (0.3867 => 0.3687, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.64% (0.6446 => 0.6147, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.63% (0.6395 => 0.6099, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.60% (0.5567 => 0.5311, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.58% (0.3319 => 0.3167, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.56% (0.5569 => 0.5315, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.54% (0.5570 => 0.5317, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.52% (0.3406 => 0.3252, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -4.50% (0.7779 => 0.7429, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.42% (0.3323 => 0.3176, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -4.42% (1.1450 => 1.0944, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: -4.39% (15.5079 => 14.8276, std.dev.: 0.0160) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.37% (0.7021 => 0.6714, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.36% (0.3483 => 0.3331, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: -4.35% (0.7447 => 0.7123, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -4.34% (0.4515 => 0.4319, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.32% (0.6736 => 0.6445, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.32% (0.2385 => 0.2282, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.30% (0.2933 => 0.2807, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: -4.29% (2.1401 => 2.0482, std.dev.: 0.0044) MultiSource/Applications/oggenc/oggenc: -4.27% (5.0226 => 4.8080, std.dev.: 0.0037) MultiSource/Applications/spiff/spiff: -4.22% (0.8418 => 0.8063, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: -4.18% (0.6441 => 0.6172, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: -4.13% (0.3271 => 0.3136, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -4.11% (0.6347 => 0.6086, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -4.01% (17.1032 => 16.4182, std.dev.: 0.0251) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.00% (8.0126 => 7.6921, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/loader/loader: -3.97% (0.2999 => 0.2880, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: -3.91% (3.5154 => 3.3778, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.79% (0.5329 => 0.5127, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.79% (1.2300 => 1.1834, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.77% (0.5168 => 0.4973, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.77% (0.9077 => 0.8735, std.dev.: 0.0052) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.72% (6.7716 => 6.5194, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.71% (0.2695 => 0.2595) MultiSource/Applications/hbd/hbd: -3.55% (1.5610 => 1.5056, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: -3.43% (1.1530 => 1.1135, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.23% (14.2083 => 13.7489, std.dev.: 0.0199) SingleSource/UnitTests/Vector/constpool: -2.62% (20.7746 => 20.2302, std.dev.: 0.0529) MultiSource/Applications/SIBsim4/SIBsim4: -2.02% (1.3864 => 1.3584, std.dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7551, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: -8.68% (1.2842 => 1.1727, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.90% (2.2633 => 2.1750, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.43% (1.3096 => 1.2647, std.dev.: 0.0111) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.46% (6.5735 => 6.4775, std.dev.: 0.0027) Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 04:58:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 06:58:54 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121031115854.321ED2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5442?compare_to=5437&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5442, Order: 167107, Start Time: 2012-10-31 08:43:05, End Time: 2012-10-31 11:58:55 To: 5437, Order: 167103, Start Time: 2012-10-31 04:36:06, End Time: 2012-10-31 07:54:24 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (169 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1041 (720 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.31% (21.6681 => 21.9524, std.dev.: 0.0393) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.48% (0.0625 => 0.0878, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.42% (0.1063 => 0.1397, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.50% (0.2969 => 0.3726, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.23% (0.1106 => 0.1385, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.09% (0.4139 => 0.5136, std.dev.: 0.0024) MultiSource/Applications/oggenc/oggenc: 24.01% (1.5932 => 1.9758, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.54% (0.4253 => 0.5254, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.36% (0.5900 => 0.7278, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.25% (0.0714 => 0.0880, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.23% (0.4994 => 0.6154, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.21% (0.1620 => 0.1996, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.95% (0.0475 => 0.0584) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.86% (0.5000 => 0.6143, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.49% (0.0547 => 0.0670, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.09% (0.0584 => 0.0713, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.64% (0.0633 => 0.0770, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.63% (0.0897 => 0.1091, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.18% (0.0642 => 0.0778, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.16% (0.1021 => 0.1237, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 21.04% (0.0599 => 0.0725, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 20.78% (0.1107 => 0.1337, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.03% (0.0584 => 0.0701, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 19.94% (0.0948 => 0.1137, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.67% (0.1103 => 0.1320, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/health/health: 19.61% (0.0821 => 0.0982) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.59% (0.0541 => 0.0647, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.47% (0.3903 => 0.4663, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/power/power: 19.37% (0.0604 => 0.0721, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.37% (0.1549 => 0.1849, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.34% (0.0822 => 0.0981, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 19.21% (0.1619 => 0.1930, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.20% (0.1604 => 0.1912, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.14% (0.1003 => 0.1195, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.28% (0.1160 => 0.1372, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 18.27% (0.0947 => 0.1120, std.dev.: 0.0027) MultiSource/Applications/spiff/spiff: 18.09% (0.4029 => 0.4758, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.06% (0.2736 => 0.3230, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 17.92% (0.1462 => 0.1724, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.89% (0.3890 => 0.4586, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.58% (0.2014 => 0.2368, std.dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: 17.57% (0.0808 => 0.0950, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.50% (1.3152 => 1.5454, std.dev.: 0.0093) MultiSource/Benchmarks/McCat/08-main/main: 17.49% (0.1218 => 0.1431, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 17.19% (0.0698 => 0.0818, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 17.14% (0.1505 => 0.1763, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.64% (0.2866 => 0.3343, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 16.64% (0.1088 => 0.1269, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 16.56% (0.5826 => 0.6791, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 16.51% (0.5889 => 0.6861, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 16.46% (0.5546 => 0.6459, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.33% (3.5627 => 4.1445, std.dev.: 0.0085) MultiSource/Applications/hbd/hbd: 16.25% (0.9697 => 1.1273, std.dev.: 0.0069) MultiSource/Benchmarks/MallocBench/gs/gs: 16.23% (1.8794 => 2.1844, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.21% (0.4658 => 0.5413, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.07% (0.2875 => 0.3337, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.96% (0.1968 => 0.2282, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 15.90% (1.6211 => 1.8789, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.80% (0.5026 => 0.5820, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/18-imp/imp: 15.76% (0.1421 => 0.1645, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.68% (0.3271 => 0.3784, std.dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: 15.68% (0.9909 => 1.1463, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/fibo: 15.56% (0.2725 => 0.3149, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.48% (0.4361 => 0.5036, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.42% (0.2911 => 0.3360, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.34% (0.2738 => 0.3158, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: 15.33% (0.2714 => 0.3130, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: 15.30% (1.0781 => 1.2431, std.dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.28% (2.7292 => 3.1463, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/strcat: 15.27% (0.2750 => 0.3170, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.24% (0.2729 => 0.3145, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: 15.19% (0.1284 => 0.1479, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 15.15% (0.3096 => 0.3565, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 15.15% (0.3004 => 0.3459, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 15.09% (0.2823 => 0.3249, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/matrix: 15.07% (0.2780 => 0.3199, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.04% (0.2792 => 0.3212, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.99% (0.3195 => 0.3674, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 14.94% (0.2811 => 0.3231, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 14.93% (0.2813 => 0.3233, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 14.93% (4.4195 => 5.0793, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/random: 14.91% (0.2803 => 0.3221, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.83% (0.3930 => 0.4513, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.81% (2.0673 => 2.3734, std.dev.: 0.0048) MultiSource/Applications/ClamAV/clamscan: 14.72% (4.2109 => 4.8308, std.dev.: 0.0042) MultiSource/Benchmarks/Bullet/bullet: 14.67% (23.5202 => 26.9709, std.dev.: 0.0148) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.59% (1.9694 => 2.2568, std.dev.: 0.0036) SingleSource/UnitTests/ObjC++/property-reference: 14.45% (0.7171 => 0.8207, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary: 14.43% (0.3258 => 0.3728, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 14.42% (0.3267 => 0.3738, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.41% (1.9966 => 2.2843, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary2: 14.23% (0.3317 => 0.3789, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.22% (0.1090 => 0.1245, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.04% (0.3362 => 0.3834, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 14.03% (0.2566 => 0.2926, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.02% (0.3060 => 0.3489, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.80% (0.3124 => 0.3555, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists: 13.62% (0.3348 => 0.3804, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: 13.53% (0.4146 => 0.4707, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.47% (0.3488 => 0.3958, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.47% (0.3282 => 0.3724, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/moments: 13.43% (0.3678 => 0.4172, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 13.39% (0.3726 => 0.4225, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 13.32% (0.3477 => 0.3940, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.27% (0.3625 => 0.4106, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 13.26% (1.4269 => 1.6161, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 13.16% (0.2075 => 0.2348, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 13.10% (0.4251 => 0.4808, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 13.09% (0.7875 => 0.8906, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.09% (0.3690 => 0.4173, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-4: 13.02% (0.3465 => 0.3916, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 12.98% (0.3460 => 0.3909, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 12.97% (2.1653 => 2.4462, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.96% (0.3981 => 0.4497, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 12.94% (0.3446 => 0.3892, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 12.93% (0.3496 => 0.3948, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.90% (0.3845 => 0.4341, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/trivial-interface: 12.84% (0.3442 => 0.3884, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 12.77% (0.3469 => 0.3912, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.57% (0.3643 => 0.4101, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 12.52% (0.3650 => 0.4107, std.dev.: 0.0066) SingleSource/UnitTests/ObjC/parameter-passing: 12.43% (0.3724 => 0.4187, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 12.32% (4.6177 => 5.1864, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/bigfib: 12.29% (0.5012 => 0.5628, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 12.09% (2.1013 => 2.3553, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.66% (0.6435 => 0.7185, std.dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: 11.61% (0.3498 => 0.3904, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.37% (0.2040 => 0.2272, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 11.19% (0.2691 => 0.2992, std.dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 10.91% (5.5417 => 6.1463, std.dev.: 0.0241) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.85% (0.1383 => 0.1533, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.60% (0.1028 => 0.1137, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 10.43% (0.6634 => 0.7326, std.dev.: 0.0136) MultiSource/Applications/minisat/minisat: 10.31% (0.3336 => 0.3680, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.16% (0.2737 => 0.3015, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.06% (0.2068 => 0.2276, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 9.82% (0.4847 => 0.5323, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.76% (0.3084 => 0.3385, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.03% (0.2103 => 0.2293, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 8.67% (2.0346 => 2.2111, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.37% (4.6926 => 5.0856, std.dev.: 0.0064) MultiSource/Applications/lemon/lemon: 8.32% (0.2391 => 0.2590, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.94% (11.6398 => 12.5642, std.dev.: 0.0198) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.82% (0.5361 => 0.5780, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.09% (0.5584 => 0.5980, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.99% (0.7426 => 0.7945, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 5.92% (11.9555 => 12.6637, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.69% (0.3792 => 0.3932, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6535, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.59% (2.5769 => 3.0301, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 9.06% (0.2802 => 0.3056, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6116, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.06% (12.0509 => 12.6610, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.96% (0.3693 => 0.3876, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1708, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/flops-2: 3.90% (1.8057 => 1.8761, std.dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/dry: 2.71% (14.0481 => 14.4295, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1959, std.dev.: 0.0058) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.59% (3.1722 => 3.2227, std.dev.: 0.0031) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3010, std.dev.: 0.0066) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2844, std.dev.: 0.0033) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/five11/five11: 1.20% (8.4155 => 8.5164, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5404, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.08% (1.2451 => 1.2585, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5918, std.dev.: 0.0074) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.87% (2.4764 => 2.4054, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.51% (25.4195 => 16.3926, std.dev.: 0.0090) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9744, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7758, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/tsp/tsp: -7.18% (2.1113 => 1.9597, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -6.91% (0.2402 => 0.2236, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.41% (11.2080 => 10.8262, std.dev.: 0.0421) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7731, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.00% (0.6293 => 0.6104, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5219, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -2.31% (17.2379 => 16.8402, std.dev.: 0.0248) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8644, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.80% (10.7630 => 10.5697, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4951, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.33% (5.7935 => 5.7165, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.23% (105.3826 => 104.0847, std.dev.: 0.0511) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.06% (3.3991 => 3.3630, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0456, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 05:45:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 07:45:07 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121031124507.096012A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5443?compare_to=5440&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5443, Order: 167112, Start Time: 2012-10-31 11:17:38, End Time: 2012-10-31 12:45:09 To: 5440, Order: 167108, Start Time: 2012-10-31 09:32:24, End Time: 2012-10-31 11:00:47 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 13 (97 on baseline) Performance Improvements: 1 (4 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 977 (873 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.11% (0.5867 => 0.6108, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.78% (0.6342 => 0.6582, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 3.25% (20.1144 => 20.7677, std.dev.: 0.1264) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.16% (1.3646 => 1.3941, std.dev.: 0.0023) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.99% (6.9942 => 7.1331, std.dev.: 0.0536) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.82% (0.6599 => 0.6719, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 1.81% (0.8968 => 0.9130, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.68% (0.8217 => 0.8355, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.64% (8.9461 => 9.0926, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.15% (0.9051 => 0.9155, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 5.58% (1.2894 => 1.3613, std.dev.: 0.0263) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.75% (6.9472 => 7.0690, std.dev.: 0.0315) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.22% (2.4920 => 2.5223, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -8.36% (9.3266 => 8.5467, std.dev.: 0.0966) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.44% (16.7325 => 16.6596, std.dev.: 0.1886) MultiSource/Applications/obsequi/Obsequi: -0.64% (1.0763 => 1.0694, std.dev.: 0.0102) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.22% (21.6239 => 21.6716, std.dev.: 0.1978) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.30% (0.3698 => 0.3650, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++/bigfib: -1.26% (0.6107 => 0.6030, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: -1.16% (0.3361 => 0.3322, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/strcat: -1.78% (0.2025 => 0.1989, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.91% (0.0220 => 0.0218, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.93% (0.0428 => 0.0424, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.79% (0.0336 => 0.0330, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.79% (0.0323 => 0.0314, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 2.82% (0.0426 => 0.0438, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0203 => 0.0203, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: -0.91% (0.0220 => 0.0218, std.dev.: 0.0018) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.82% (0.1457 => 0.1445, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.49% (1.1365 => 1.1309, std.dev.: 0.0141) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.92% (0.1514 => 0.1485, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.27% (0.4016 => 0.4107, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.30% (0.1324 => 0.1328, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -62.50% (0.0008 => 0.0003, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -12.87% (0.0668 => 0.0582, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -28.62% (0.0269 => 0.0192, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.97% (0.0535 => 0.0583, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.13% (1.1460 => 1.1445, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -22.58% (0.0031 => 0.0024, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.51% (0.0638 => 0.0654, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.77% (0.0259 => 0.0257, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.32% (0.8052 => 0.8026, std.dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 34.09% (0.0044 => 0.0059, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2335.38% (0.6332 => 15.4208, std.dev.: 0.1035) MultiSource/Benchmarks/McCat/08-main/main: 49.10% (0.1831 => 0.2730, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.81% (0.1559 => 0.1484, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1477.54% (0.3344 => 5.2753, std.dev.: 0.0676) SingleSource/Benchmarks/Misc-C++/Large/ray: 35.91% (0.2364 => 0.3213, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel: 2.33% (0.0429 => 0.0439, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.89% (0.0224 => 0.0222, std.dev.: 0.0010) SingleSource/UnitTests/byval-alignment: -32.61% (0.0230 => 0.0155, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4297, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0724, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4879, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3426, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0286, std.dev.: 0.0400) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4014, std.dev.: 0.0049) SingleSource/Regression/C/uint64_to_float: -23.92% (2.1832 => 1.6609, std.dev.: 0.0019) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 40.62% (14.7684 => 20.7677, std.dev.: 0.1264) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.68% (0.0810 => 0.0937, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.49% (0.0773 => 0.0885, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/rem: 13.91% (0.1035 => 0.1179, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 12.77% (0.1112 => 0.1254, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.29% (0.0830 => 0.0932, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.47% (0.8321 => 0.9192, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.57% (0.2279 => 0.2497, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.52% (0.6010 => 0.6582, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.62% (0.2180 => 0.2368, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.42% (0.1425 => 0.1545, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.32% (0.1466 => 0.1588, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.96% (6.6074 => 7.1331, std.dev.: 0.0536) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.71% (0.7473 => 0.8049, std.dev.: 0.0093) MultiSource/Applications/SIBsim4/SIBsim4: 7.50% (1.2568 => 1.3510, std.dev.: 0.0115) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.49% (0.3137 => 0.3372, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.20% (0.4847 => 0.5196, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.14% (0.2240 => 0.2400, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.87% (0.6287 => 0.6719, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.46% (0.1905 => 0.2028, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.17% (13.1811 => 13.9950, std.dev.: 0.1447) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.13% (0.9435 => 1.0013, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.99% (1.6386 => 1.7368, std.dev.: 0.0203) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.67% (0.2998 => 0.3168, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.65% (0.2741 => 0.2896, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.49% (0.8148 => 0.8595, std.dev.: 0.0139) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.35% (0.1983 => 0.2089, std.dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 5.32% (1.1271 => 1.1871, std.dev.: 0.0113) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.27% (0.6227 => 0.6555, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.15% (8.6476 => 9.0926, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.06% (0.3003 => 0.3155, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.00% (0.5817 => 0.6108, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.99% (1.3279 => 1.3941, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.96% (1.1685 => 1.2265, std.dev.: 0.0192) MultiSource/Applications/Burg/burg: 4.93% (1.2222 => 1.2825, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.92% (1.1170 => 1.1720, std.dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.77% (0.4127 => 0.4324, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.51% (1.1606 => 1.2130, std.dev.: 0.0127) MultiSource/Benchmarks/sim/sim: 4.28% (0.3226 => 0.3364, std.dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: 4.13% (0.2999 => 0.3123, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/football/football: 4.13% (0.8768 => 0.9130, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 4.06% (14.2605 => 14.8391, std.dev.: 0.0750) MultiSource/Benchmarks/Olden/bh/bh: 3.95% (0.2985 => 0.3103, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.95% (0.4783 => 0.4972, std.dev.: 0.0044) MultiSource/Applications/d/make_dparser: 3.91% (3.2366 => 3.3633, std.dev.: 0.0175) MultiSource/Applications/minisat/minisat: 3.83% (0.6834 => 0.7096, std.dev.: 0.0052) MultiSource/Applications/treecc/treecc: 3.76% (1.9948 => 2.0698, std.dev.: 0.0219) MultiSource/Applications/hbd/hbd: 3.67% (1.4269 => 1.4792, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 3.58% (0.8066 => 0.8355, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.56% (4.4873 => 4.6470, std.dev.: 0.0400) MultiSource/Applications/lemon/lemon: 3.53% (1.0945 => 1.1331, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/05-eks/eks: 3.50% (0.4397 => 0.4551, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 3.39% (0.8855 => 0.9155, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.33% (4.1763 => 4.3153, std.dev.: 0.0321) MultiSource/Applications/lua/lua: 3.30% (3.8189 => 3.9448, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.25% (0.5961 => 0.6155, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.17% (0.8317 => 0.8581, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 3.14% (0.8204 => 0.8462, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.07% (0.8457 => 0.8717, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.07% (0.6586 => 0.6788, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.99% (0.7966 => 0.8204, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/18-imp/imp: 2.97% (0.3503 => 0.3607, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.95% (4.5702 => 4.7050, std.dev.: 0.0407) MultiSource/Benchmarks/mafft/pairlocalalign: 2.88% (8.6247 => 8.8728, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.86% (0.8007 => 0.8236, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.85% (0.3717 => 0.3823, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.74% (0.9056 => 0.9304, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.69% (0.8885 => 0.9124, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.64% (0.8340 => 0.8560, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.62% (0.8611 => 0.8837, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.59% (0.9039 => 0.9273, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.58% (0.8359 => 0.8575, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.45% (0.8420 => 0.8626, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.43% (0.7932 => 0.8125, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.43% (0.8805 => 0.9019, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.38% (0.8597 => 0.8802, std.dev.: 0.0058) MultiSource/Applications/JM/lencod/lencod: 2.36% (15.3280 => 15.6894, std.dev.: 0.0889) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.34% (0.8069 => 0.8258, std.dev.: 0.0066) MultiSource/Applications/JM/ldecod/ldecod: 2.19% (6.7320 => 6.8792, std.dev.: 0.0529) MultiSource/Applications/siod/siod: 2.03% (2.2184 => 2.2635, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.03% (0.8927 => 0.9108, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.01% (0.8316 => 0.8483, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.74% (0.8338 => 0.8483, std.dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 1.55% (4.9628 => 5.0396, std.dev.: 0.0296) MultiSource/Benchmarks/Bullet/bullet: 1.46% (31.8598 => 32.3234, std.dev.: 0.1223) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 56.87% (1.5795 => 2.4777, std.dev.: 0.0180) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.36% (2.7978 => 3.7311, std.dev.: 0.0065) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.59% (2.4333 => 2.6909, std.dev.: 0.0307) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.13% (1.1857 => 1.2821, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.25% (0.3186 => 0.3385, std.dev.: 0.0072) MultiSource/Benchmarks/Fhourstones/fhourstones: 6.17% (1.2822 => 1.3613, std.dev.: 0.0263) MultiSource/Benchmarks/mafft/pairlocalalign: 5.97% (63.1822 => 66.9534, std.dev.: 0.0113) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.99% (2.4490 => 2.5223, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: 2.97% (8.5322 => 8.7853, std.dev.: 0.0105) MultiSource/Applications/siod/siod: 2.68% (3.6643 => 3.7626, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.16% (1.5941 => 1.6285, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/bh/bh: 1.67% (2.3560 => 2.3953, std.dev.: 0.0105) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -5.08% (29.8330 => 28.3177, std.dev.: 0.1360) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.00% (7.2130 => 7.0690, std.dev.: 0.0315) SingleSource/Benchmarks/Shootout-C++/hash2: -1.45% (3.4237 => 3.3739, std.dev.: 0.0133) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.28% (3.3479 => 3.3050, std.dev.: 0.0007) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.30% (16.4461 => 16.6596, std.dev.: 0.1886) MultiSource/Applications/obsequi/Obsequi: 4.21% (1.0262 => 1.0694, std.dev.: 0.0102) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6839.35% (0.3123 => 21.6716, std.dev.: 0.1978) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.19% (0.2463 => 0.3650, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++/bigfib: 0.33% (0.6010 => 0.6030, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.71% (0.3266 => 0.3322, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/strcat: 1.02% (0.1969 => 0.1989, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.92% (0.0408 => 0.0424, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 14.06% (0.0384 => 0.0438, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0018) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.49% (0.1438 => 0.1445, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.18% (1.1329 => 1.1309, std.dev.: 0.0141) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.57% (0.1462 => 0.1485, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.37% (0.4164 => 0.4107, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.99% (0.1369 => 0.1328, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -62.50% (0.0008 => 0.0003, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.20% (0.0641 => 0.0582, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.54% (0.0195 => 0.0192, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.87% (0.0578 => 0.0583, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.07% (1.1437 => 1.1445, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2300.00% (0.0001 => 0.0024, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.31% (0.0627 => 0.0654, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 42.78% (0.0180 => 0.0257, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.11% (0.8017 => 0.8026, std.dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -4.84% (0.0062 => 0.0059, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 05:51:51 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 07:51:51 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121031125151.E19322A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5444?compare_to=5441&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5444, Order: 167112, Start Time: 2012-10-31 11:26:35, End Time: 2012-10-31 12:51:52 To: 5441, Order: 167108, Start Time: 2012-10-31 09:38:11, End Time: 2012-10-31 11:03:29 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (6 on baseline) Performance Improvements: 0 (177 on baseline) Unchanged Tests: 1040 (859 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 3.44% (18.2908 => 18.9199, std.dev.: 0.0176) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.76% (1.2647 => 1.2869, std.dev.: 0.0052) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 24.04% (15.2527 => 18.9199, std.dev.: 0.0176) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.15% (3.1919 => 3.4200, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.95% (2.0478 => 2.1082, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/salsa20: 2.58% (7.4937 => 7.6872, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/hash2: 2.24% (3.1932 => 3.2646, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.40% (0.1584 => 0.1451, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.39% (0.1431 => 0.1311, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.09% (0.3821 => 0.3550, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -7.05% (2.4924 => 2.3167, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.56% (0.3142 => 0.2936, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.55% (0.2428 => 0.2269, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.40% (0.3658 => 0.3424, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.24% (22.4056 => 21.0083, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.15% (0.9542 => 0.8955, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: -6.11% (0.2160 => 0.2028, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.99% (4.5069 => 4.2368, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.91% (0.6484 => 0.6101, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: -5.85% (0.1879 => 0.1769, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.83% (3.5339 => 3.3279, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.77% (0.2355 => 0.2219, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: -5.75% (0.2659 => 0.2506, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.71% (0.9852 => 0.9289, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.70% (0.7919 => 0.7468, std.dev.: 0.0022) MultiSource/Applications/sgefa/sgefa: -5.69% (0.3357 => 0.3166, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.68% (1.6474 => 1.5539, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: -5.66% (7.0961 => 6.6945, std.dev.: 0.0067) MultiSource/Applications/JM/lencod/lencod: -5.64% (16.1920 => 15.2787, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.61% (5.4682 => 5.1613, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/gs/gs: -5.61% (4.3330 => 4.0899, std.dev.: 0.0095) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.61% (1.2784 => 1.2067, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -5.60% (2.4021 => 2.2677, std.dev.: 0.0045) MultiSource/Applications/Burg/burg: -5.59% (1.2515 => 1.1815, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.59% (0.4151 => 0.3919, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.55% (4.8161 => 4.5489, std.dev.: 0.0165) SingleSource/UnitTests/ObjC/exceptions: -5.51% (0.4176 => 0.3946, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.48% (0.3884 => 0.3671, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: -5.48% (0.3812 => 0.3603, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.48% (1.0544 => 0.9966, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.46% (0.4813 => 0.4550, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -5.46% (0.3848 => 0.3638, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -5.46% (0.3831 => 0.3622, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -5.45% (0.4033 => 0.3813, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.45% (0.3891 => 0.3679, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -5.45% (1.3148 => 1.2432, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: -5.44% (0.3896 => 0.3684, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -5.44% (0.3880 => 0.3669, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.40% (0.5999 => 0.5675, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/property: -5.38% (0.4199 => 0.3973, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.33% (0.3057 => 0.2894, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.29% (4.8802 => 4.6219, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -5.29% (0.3025 => 0.2865, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.27% (0.2903 => 0.2750, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.26% (0.3837 => 0.3635, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.26% (4.0323 => 3.8204, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/except: -5.25% (0.3026 => 0.2867, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.25% (0.8521 => 0.8074, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.23% (2.1713 => 2.0577, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/objinst: -5.23% (0.3194 => 0.3027, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: -5.23% (0.4861 => 0.4607, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -5.21% (0.2939 => 0.2786, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.17% (0.3252 => 0.3084, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -5.17% (0.3059 => 0.2901, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -5.16% (0.2849 => 0.2702, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -5.15% (0.2871 => 0.2723, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: -5.15% (0.2989 => 0.2835, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -5.14% (0.3481 => 0.3302, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.12% (0.4083 => 0.3874, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -5.12% (0.4280 => 0.4061, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: -5.11% (0.6750 => 0.6405, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.10% (0.2548 => 0.2418, std.dev.: 0.0010) MultiSource/Applications/lua/lua: -5.09% (4.0594 => 3.8528, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists: -5.08% (0.3621 => 0.3437, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -5.07% (0.3255 => 0.3090, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -5.05% (0.3205 => 0.3043) MultiSource/Benchmarks/Bullet/bullet: -5.05% (34.0927 => 32.3712, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.04% (0.3849 => 0.3655, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.04% (1.2210 => 1.1595, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary3: -5.02% (0.3446 => 0.3273, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -5.01% (0.3394 => 0.3224, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.99% (0.7198 => 0.6839, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.98% (0.5581 => 0.5303, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.98% (0.4321 => 0.4106, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.97% (2.2587 => 2.1464, std.dev.: 0.0166) MultiSource/Benchmarks/mafft/pairlocalalign: -4.96% (9.2283 => 8.7707, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.95% (0.5857 => 0.5567, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.94% (1.4642 => 1.3918, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: -4.94% (0.4248 => 0.4038, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.94% (0.6052 => 0.5753, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.94% (0.3016 => 0.2867, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.94% (0.6681 => 0.6351, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: -4.94% (18.2933 => 17.3904, std.dev.: 0.0178) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.93% (1.2221 => 1.1618, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: -4.92% (0.7982 => 0.7589, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.92% (0.7339 => 0.6978, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.92% (0.2278 => 0.2166, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.91% (0.5802 => 0.5517, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.90% (0.6304 => 0.5995, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.90% (0.2999 => 0.2852, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.90% (0.5859 => 0.5572, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.89% (0.6293 => 0.5985, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.88% (0.5863 => 0.5577, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.86% (0.5591 => 0.5319, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.86% (0.5925 => 0.5637, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -4.86% (0.2985 => 0.2840, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.85% (0.6230 => 0.5928, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.84% (0.5805 => 0.5524, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -4.84% (1.6364 => 1.5572, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/lists1: -4.84% (0.3867 => 0.3680, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: -4.83% (0.3788 => 0.3605, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.82% (0.5705 => 0.5430, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.81% (0.4427 => 0.4214, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.80% (1.3722 => 1.3063, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.80% (0.6297 => 0.5995, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.77% (0.6667 => 0.6349, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.77% (0.6395 => 0.6090, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.75% (0.6189 => 0.5895, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.75% (0.5478 => 0.5218, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.74% (0.6260 => 0.5963, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.69% (0.5569 => 0.5308, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.69% (0.5570 => 0.5309, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.67% (0.6446 => 0.6145, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.67% (0.3491 => 0.3328, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.66% (0.5575 => 0.5315, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: -4.66% (0.3581 => 0.3414, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.66% (0.6676 => 0.6365, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.65% (0.5849 => 0.5577, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.65% (0.6194 => 0.5906, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.65% (0.5941 => 0.5665, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.61% (0.7524 => 0.7177, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.61% (0.6033 => 0.5755, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.61% (0.5688 => 0.5426, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.60% (0.5567 => 0.5311, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.58% (0.3319 => 0.3167, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.58% (0.6660 => 0.6355, std.dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.58% (0.4916 => 0.4691, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: -4.58% (0.4524 => 0.4317, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.55% (0.3931 => 0.3752, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.55% (0.6395 => 0.6104, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.53% (0.5456 => 0.5209, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.51% (0.3323 => 0.3173, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.50% (0.6440 => 0.6150, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.49% (0.9557 => 0.9128, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -4.49% (0.7779 => 0.7430, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.47% (0.2933 => 0.2802, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: -4.37% (0.9179 => 0.8778, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: -4.36% (0.4515 => 0.4318, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -4.28% (1.1450 => 1.0960, std.dev.: 0.0140) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.28% (0.2385 => 0.2283, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -4.24% (0.6347 => 0.6078, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -4.19% (0.8418 => 0.8065, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -4.16% (5.0226 => 4.8135, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.16% (0.7021 => 0.6729, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -4.11% (0.6441 => 0.6176, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -4.11% (0.7447 => 0.7141, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: -4.08% (15.5079 => 14.8752, std.dev.: 0.0165) MultiSource/Benchmarks/McCat/09-vor/vor: -4.07% (0.3271 => 0.3138, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.02% (0.3483 => 0.3343, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -3.92% (2.1401 => 2.0562, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.90% (0.6736 => 0.6473, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: -3.73% (0.3406 => 0.3279, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -3.73% (8.0126 => 7.7139, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.66% (0.9077 => 0.8745, std.dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: -3.65% (17.1032 => 16.4787, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: -3.64% (3.5154 => 3.3876, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.58% (0.5168 => 0.4983, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.44% (1.2300 => 1.1877, std.dev.: 0.0022) SingleSource/UnitTests/Vector/constpool: -3.42% (20.7746 => 20.0631, std.dev.: 0.0468) MultiSource/Benchmarks/nbench/nbench: -3.42% (1.1530 => 1.1136, std.dev.: 0.0022) MultiSource/Applications/hbd/hbd: -3.40% (1.5610 => 1.5079, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.36% (0.5329 => 0.5150, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.87% (6.7716 => 6.5773, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.46% (14.2083 => 13.8592, std.dev.: 0.0086) MultiSource/Applications/SIBsim4/SIBsim4: -1.72% (1.3864 => 1.3625, std.dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7532, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/richards_benchmark: -8.66% (1.2842 => 1.1730, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.87% (2.2633 => 2.1756, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.84% (1.7753 => 1.7072, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.04% (1.0557 => 1.0236, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.73% (1.3096 => 1.2869, std.dev.: 0.0052) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.46% (6.5735 => 6.4773, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0001) Report Time: 1.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 05:57:56 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 07:57:56 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121031125756.2567E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5445?compare_to=5439&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5445, Order: 167111, Start Time: 2012-10-31 10:37:00, End Time: 2012-10-31 12:57:56 To: 5439, Order: 167107, Start Time: 2012-10-31 07:45:31, End Time: 2012-10-31 10:06:37 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (17 on baseline) New Passes: 0 (14 on baseline) Performance Regressions: 3 (182 on baseline) Performance Improvements: 0 (45 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 22 (5 on baseline) Unchanged Tests: 1017 (645 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.54% (54.6328 => 56.5649, std.dev.: 0.0634) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.68% (1.2965 => 1.3183, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.34% (79.9762 => 81.0453, std.dev.: 0.1943) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/lemon/lemon MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Shootout-C++/ary2 MultiSource/Applications/JM/ldecod/ldecod: -0.24% (0.1229 => 0.1226, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: - (0.0111 => 0.0111) MultiSource/Applications/SIBsim4/SIBsim4: 0.07% (13.1484 => 13.1580, std.dev.: 0.0032) MultiSource/Applications/lemon/lemon: 0.10% (1.4545 => 1.4560, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: -0.08% (0.1332 => 0.1331, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 40.00% (0.0005 => 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0076 => 0.0076, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: 0.09% (0.1164 => 0.1165, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -0.00% (499.8483 => 499.8323, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.28% (0.0723 => 0.0721, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: - (0.2552 => 0.2552, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: - (0.0176 => 0.0176) MultiSource/Benchmarks/Olden/power/power: 0.01% (13.2149 => 13.2166, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -0.29% (0.0341 => 0.0340, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 0.35% (0.0570 => 0.0572, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.76% (0.0528 => 0.0524, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.28% (0.0358 => 0.0357, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: - (0.0050 => 0.0050, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -8.69% (39.9743 => 36.5000, std.dev.: 0.8433) SingleSource/Benchmarks/BenchmarkGame/n-body: -0.01% (1.3169 => 1.3168, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 0.00% (3.0437 => 3.0438, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary2: 0.13% (0.0756 => 0.0757, std.dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/lemon/lemon MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Shootout-C++/ary2 MultiSource/Applications/JM/ldecod/ldecod: -5.55% (0.1298 => 0.1226, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 0.69% (1.4460 => 1.4560, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -99.98% (4.6441 => 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.83% (4.3882 => 0.0076, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -98.91% (10.7105 => 0.1165, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 423845.97% (0.1179 => 499.8323, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -35.99% (0.3987 => 0.2552, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: -99.09% (1.9405 => 0.0176) MultiSource/Benchmarks/Olden/power/power: 1072.00% (1.1277 => 13.2166, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -99.96% (85.0658 => 0.0340, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -33.80% (0.0864 => 0.0572, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.24% (0.0611 => 0.0524, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -29.45% (0.0506 => 0.0357, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 35.14% (0.0037 => 0.0050, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.10% (3.2416 => 3.0438, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary2: - (0.0757 => 0.0757, std.dev.: 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 199.67% (0.5229 => 1.5670, std.dev.: 0.0048) MultiSource/Applications/SPASS/SPASS: 13.94% (14.9895 => 17.0790, std.dev.: 0.0074) MultiSource/Applications/kimwitu++/kc: 36.24% (14.1553 => 19.2849, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/gs/gs: 13.40% (4.1105 => 4.6615, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 29.57% (1.1048 => 1.4315, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 307.23% (7.1582 => 29.1500, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.41% (3.4629 => 5.8320, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 64.40% (0.6222 => 1.0229, std.dev.: 0.0021) New Passes - Execution Time --------------------------- MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SPASS/SPASS: 11300500.00% (0.0001 => 11.3006, std.dev.: 0.0035) MultiSource/Applications/kimwitu++/kc: 51500.00% (0.0001 => 0.0516, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 66300.00% (0.0001 => 0.0664, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050100.00% (0.0001 => 10.0502, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5488900.00% (0.0001 => 5.4890, std.dev.: 0.0015) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 40.25% (0.1056 => 0.1481, std.dev.: 0.0013) SingleSource/UnitTests/vla: 29.01% (0.0355 => 0.0458, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 28.28% (0.1432 => 0.1837, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.84% (0.0648 => 0.0796, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 21.80% (0.0798 => 0.0972, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.52% (0.1566 => 0.1903, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.19% (0.0842 => 0.1012, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 19.42% (0.0793 => 0.0947) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.96% (0.0770 => 0.0916, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 18.91% (0.1555 => 0.1849, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: 18.37% (0.0626 => 0.0741, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.18% (0.8172 => 0.9658, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 17.94% (0.3177 => 0.3747, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/rem: 17.66% (0.1144 => 0.1346, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 17.53% (0.0730 => 0.0858, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.53% (0.2065 => 0.2427, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.51% (0.0834 => 0.0980, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 17.40% (0.1695 => 0.1990, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 17.36% (0.4879 => 0.5726, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 17.35% (0.2554 => 0.2997, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/17-bintr/bintr: 17.19% (0.0675 => 0.0791, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 17.03% (0.1151 => 0.1347, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.99% (0.0871 => 0.1019) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.95% (0.3121 => 0.3650, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/tsp/tsp: 16.85% (0.1175 => 0.1373, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bisort/bisort: 16.78% (0.0614 => 0.0717, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 16.77% (0.1163 => 0.1358, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.70% (0.0886 => 0.1034, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.62% (0.1029 => 0.1200, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 16.60% (0.1584 => 0.1847, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 16.50% (0.2758 => 0.3213, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: 16.35% (0.0746 => 0.0868, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.20% (0.1117 => 0.1298, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 15.76% (0.2271 => 0.2629, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.52% (0.2107 => 0.2434, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 15.41% (0.1655 => 0.1910, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 15.36% (0.7115 => 0.8208, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 15.29% (0.7835 => 0.9033, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 15.11% (0.1125 => 0.1295, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.95% (0.1940 => 0.2230, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 14.81% (0.1337 => 0.1535, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.79% (0.0730 => 0.0838, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.78% (0.1062 => 0.1219, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.66% (0.5981 => 0.6858, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 14.59% (0.5105 => 0.5850, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 14.57% (22.1758 => 25.4059, std.dev.: 0.0053) MultiSource/Applications/Burg/burg: 14.51% (1.1642 => 1.3331, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 14.19% (0.5569 => 0.6359, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 14.15% (0.7433 => 0.8485, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.07% (0.2700 => 0.3080, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.02% (0.4615 => 0.5262, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.92% (0.5860 => 0.6676, std.dev.: 0.0024) MultiSource/Applications/sgefa/sgefa: 13.90% (0.3109 => 0.3541, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.75% (0.1906 => 0.2168, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.67% (0.9765 => 1.1100, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 13.65% (0.5020 => 0.5705, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.58% (0.1510 => 0.1715, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 13.54% (3.3354 => 3.7871, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.51% (0.3441 => 0.3906, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.42% (0.1625 => 0.1843, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.30% (0.6675 => 0.7563, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.29% (1.5415 => 1.7463, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.25% (0.0770 => 0.0872, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 12.71% (2.0273 => 2.2850, std.dev.: 0.0040) MultiSource/Applications/lua/lua: 12.51% (3.8723 => 4.3569, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.37% (1.3050 => 1.4664, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.29% (0.2603 => 0.2923, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 12.24% (0.3423 => 0.3842, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.11% (0.1032 => 0.1157, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.11% (0.3543 => 0.3972, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 12.07% (0.4299 => 0.4818, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.97% (0.6450 => 0.7222, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.96% (1.1861 => 1.3279, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/health/health: 11.91% (0.1268 => 0.1419, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 11.82% (1.0722 => 1.1989, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.73% (0.3307 => 0.3695, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.73% (0.1236 => 0.1381, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 11.69% (0.8921 => 0.9964, std.dev.: 0.0024) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.64% (0.1143 => 0.1276, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 11.50% (1.1840 => 1.3202, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 11.49% (0.3473 => 0.3872, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.46% (0.3927 => 0.4377, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.33% (4.2646 => 4.7477, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-2: 11.32% (0.3497 => 0.3893, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.32% (0.3543 => 0.3944, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 11.29% (0.3561 => 0.3963, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.26% (0.3828 => 0.4259, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.23% (0.3516 => 0.3911, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 11.23% (8.1363 => 9.0498, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/09-vor/vor: 11.13% (0.3180 => 0.3534, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 11.10% (0.4289 => 0.4765, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/for-in: 11.04% (0.3694 => 0.4102, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 11.00% (0.1463 => 0.1624, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 10.99% (0.3886 => 0.4313, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 10.95% (0.3387 => 0.3758, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.91% (0.1695 => 0.1880, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.87% (0.0929 => 0.1030, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.78% (1.5859 => 1.7569, std.dev.: 0.0065) MultiSource/Benchmarks/mafft/pairlocalalign: 10.77% (9.4845 => 10.5063, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.62% (1.4186 => 1.5692, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.62% (0.8101 => 0.8961, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.58% (2.2022 => 2.4351, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.53% (0.4636 => 0.5124, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 10.42% (0.6456 => 0.7129, std.dev.: 0.0079) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.38% (0.1330 => 0.1468, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.28% (2.2024 => 2.4287, std.dev.: 0.0111) MultiSource/Applications/siod/siod: 10.17% (2.2969 => 2.5306, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.06% (0.1044 => 0.1149, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 9.93% (1.5603 => 1.7153, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.92% (0.2430 => 0.2671, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.90% (0.4203 => 0.4619, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 9.80% (0.7326 => 0.8044, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.73% (14.3668 => 15.7651, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.73% (0.1892 => 0.2076, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.68% (0.3865 => 0.4239, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.49% (4.9449 => 5.4141, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/hash2: 9.48% (0.4620 => 0.5058, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.41% (0.4103 => 0.4489, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 9.35% (0.3422 => 0.3742, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 9.33% (0.5925 => 0.6478, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.29% (5.0018 => 5.4665, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 9.17% (0.6030 => 0.6583, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 9.09% (0.4048 => 0.4416, std.dev.: 0.0027) SingleSource/Regression/C++/ofstream_ctor: 9.02% (0.2905 => 0.3167, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/lists1: 8.88% (0.3684 => 0.4011, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/Puzzle: 8.68% (0.1268 => 0.1378, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 8.55% (0.3603 => 0.3911, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.52% (0.8067 => 0.8754, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.26% (0.3427 => 0.3710, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.23% (0.2891 => 0.3129, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.20% (0.2793 => 0.3022, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.18% (0.3826 => 0.4139, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.93% (0.2725 => 0.2941, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.84% (0.3650 => 0.3936, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.76% (0.2756 => 0.2970, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 7.73% (17.1811 => 18.5099, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/hello: 7.66% (0.2714 => 0.2922, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.59% (0.2831 => 0.3046, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.56% (0.3162 => 0.3401, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 7.55% (0.3098 => 0.3332, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 7.37% (0.3283 => 0.3525, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.37% (2.0665 => 2.2187, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary: 7.33% (0.3232 => 0.3469, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.31% (0.4064 => 0.4361, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.21% (0.2871 => 0.3078, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.19% (0.2877 => 0.3084, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.03% (0.2872 => 0.3074, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 7.00% (1.2842 => 1.3741, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.95% (0.3052 => 0.3264, std.dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 6.94% (5.7591 => 6.1587, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.87% (0.3379 => 0.3611, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 6.79% (0.3092 => 0.3302, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 6.71% (0.2802 => 0.2990, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 6.03% (0.3282 => 0.3480, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.99% (0.3136 => 0.3324, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.70% (3.8922 => 4.1140, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 5.49% (0.3131 => 0.3303, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.03% (0.2266 => 0.2380, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.80% (0.3817 => 0.3962, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.63% (0.3935 => 0.4078, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.29% (7.9617 => 8.1438, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.56% (7.0540 => 7.1639, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 19.81% (2.8904 => 3.4629, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.59% (1.1145 => 1.2994, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 10.06% (1.1396 => 1.2542) MultiSource/Applications/ClamAV/clamscan: 9.15% (0.1629 => 0.1778, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.11% (0.9540 => 1.0218) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3682, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.37% (0.3463 => 0.3649, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.4162 => 0.4322, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.78% (4.2280 => 4.3454, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bisort/bisort: 1.99% (0.8333 => 0.8499, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2077, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.32% (11.6436 => 11.7974, std.dev.: 0.0067) MultiSource/Applications/minisat/minisat: 1.14% (9.1159 => 9.2200, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.06% (1.3045 => 1.3183, std.dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.88% (6.6874 => 0.1418, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -76.51% (0.8651 => 0.2032, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.31% (5.3855 => 2.4066, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -54.81% (5.3526 => 2.4190, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/richards_benchmark: -44.51% (0.1622 => 0.0900, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.13% (1.1194 => 0.6814, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.84% (5.2763 => 3.2797, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -24.24% (1.7609 => 1.3340, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -16.74% (2.9384 => 2.4464, std.dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: -9.82% (10.4361 => 9.4117, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -9.22% (63.2438 => 57.4126, std.dev.: 0.0121) SingleSource/UnitTests/Vector/constpool: -8.95% (54.1659 => 49.3174, std.dev.: 0.0258) MultiSource/Benchmarks/PAQ8p/paq8p: -4.41% (10.3673 => 9.9103, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: -2.00% (21.9371 => 21.4987, std.dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -42.75% (0.0400 => 0.0229) SingleSource/Benchmarks/Misc/mandel: -33.51% (1.1492 => 0.7641, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4236, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel-2: -11.03% (1.5373 => 1.3677, std.dev.: 0.0038) MultiSource/Benchmarks/NPB-serial/is/is: -10.99% (9.5636 => 8.5125, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.55% (19.9488 => 18.2437, std.dev.: 0.0723) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.04% (1.8329 => 1.7039, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -6.64% (1.2373 => 1.1551, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/mason/mason: -6.48% (0.2161 => 0.2021, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/oourafft: -5.46% (6.6465 => 6.2835, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.05% (1.6805 => 1.5956, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.80% (1.5660 => 1.4908, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.79% (1.5835 => 1.5076, std.dev.: 0.0015) MultiSource/Applications/siod/siod: -3.85% (3.2827 => 3.1562, std.dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.46% (32.5116 => 31.3861, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.40% (0.9957 => 0.9618, std.dev.: 0.0043) MultiSource/Benchmarks/sim/sim: -3.19% (5.0483 => 4.8875, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.91% (0.4808 => 0.4668, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.79% (4.5009 => 4.3754, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.01% (8.1563 => 7.9925, std.dev.: 0.0126) SingleSource/Benchmarks/Misc/salsa20: -2.01% (10.2830 => 10.0768, std.dev.: 0.0143) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6834, std.dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5140, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.01% (6.2999 => 6.2362, std.dev.: 0.0042) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: -84.58% (0.0720 => 0.0111) MultiSource/Applications/SIBsim4/SIBsim4: 13157900.00% (0.0001 => 13.1580, std.dev.: 0.0032) MultiSource/Applications/oggenc/oggenc: -10.37% (0.1485 => 0.1331, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -65.93% (0.2116 => 0.0721, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 36499900.00% (0.0001 => 36.5000, std.dev.: 0.8433) Report Time: 2.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 07:29:02 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 09:29:02 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121031142902.D3BDE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5446?compare_to=5443&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5446, Order: 167114, Start Time: 2012-10-31 13:01:53, End Time: 2012-10-31 14:29:03 To: 5443, Order: 167112, Start Time: 2012-10-31 11:17:38, End Time: 2012-10-31 12:45:09 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 12 (82 on baseline) Performance Improvements: 12 (6 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 967 (886 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.21% (0.3645 => 0.3762, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 11.96% (0.7804 => 0.8737, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.46% (0.3385 => 0.3502, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.51% (4.3563 => 4.4658, std.dev.: 0.0202) SingleSource/Benchmarks/Shootout-C++/methcall: 1.90% (8.8606 => 9.0291, std.dev.: 0.0173) SingleSource/Benchmarks/Misc/richards_benchmark: 1.74% (1.2897 => 1.3122, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/ffbench: 1.69% (1.3989 => 1.4226, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.41% (44.7705 => 45.4011, std.dev.: 0.0878) SingleSource/Benchmarks/Misc/pi: 1.26% (2.4777 => 2.5090, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.17% (1.2417 => 1.2562, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 1.16% (8.2372 => 8.3325, std.dev.: 0.0307) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.07% (1.4083 => 1.4233, std.dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.05% (0.6582 => 0.6184, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.85% (0.2497 => 0.2376, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/bh/bh: -4.32% (0.3103 => 0.2969, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.38% (0.8049 => 0.7777, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -2.62% (0.6108 => 0.5948, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: -2.31% (0.9192 => 0.8980, std.dev.: 0.0056) MultiSource/Applications/Burg/burg: -1.97% (1.2825 => 1.2572, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.66% (1.3941 => 1.3710, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/gs/gs: -1.65% (4.3071 => 4.2360, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.04% (9.0926 => 8.9978, std.dev.: 0.0107) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: -7.32% (1.3613 => 1.2616, std.dev.: 0.0221) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.66% (1.6285 => 1.6015, std.dev.: 0.0038) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.34% (16.6596 => 16.7156, std.dev.: 0.1235) MultiSource/Applications/obsequi/Obsequi: 0.69% (1.0694 => 1.0768, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.66% (21.6716 => 21.8137, std.dev.: 0.3863) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.55% (0.3650 => 0.3670, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/bigfib: 0.90% (0.6030 => 0.6084, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.17% (0.3322 => 0.3361, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 1.66% (0.1989 => 0.2022, std.dev.: 0.0054) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.96% (0.0218 => 0.0205, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.47% (0.0424 => 0.0426, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.91% (0.0330 => 0.0333, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.64% (0.0314 => 0.0316, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.97% (0.0438 => 0.0425, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0203 => 0.0203, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/test1: -33.49% (0.0218 => 0.0145, std.dev.: 0.0037) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -1.04% (0.1445 => 0.1430, std.dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.49% (1.1309 => 1.1364, std.dev.: 0.0345) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.94% (0.1485 => 0.1499, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.70% (0.4107 => 0.4037, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.05% (0.1328 => 0.1342, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -66.67% (0.0003 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.62% (0.0582 => 0.0638, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 13.02% (0.0192 => 0.0217, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.06% (0.0583 => 0.0571, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.10% (1.1445 => 1.1434, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -83.33% (0.0024 => 0.0004, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -73.08% (0.0026 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -15.44% (0.0654 => 0.0553, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -23.74% (0.0257 => 0.0196, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.07% (0.8026 => 0.8020, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0001 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -20.34% (0.0059 => 0.0047, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2351.07% (0.6332 => 15.5202, std.dev.: 0.0456) MultiSource/Benchmarks/McCat/08-main/main: 45.66% (0.1831 => 0.2667, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.03% (0.1559 => 0.1465, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1495.39% (0.3344 => 5.3350, std.dev.: 0.0970) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.07% (0.2364 => 0.3264, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel: 2.56% (0.0429 => 0.0440, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.02% (0.0224 => 0.0233, std.dev.: 0.0024) SingleSource/UnitTests/byval-alignment: -29.57% (0.0230 => 0.0162, std.dev.: 0.0032) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4366, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0732, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4958, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3464, std.dev.: 0.0452) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0287, std.dev.: 0.0121) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4036, std.dev.: 0.0037) SingleSource/Regression/C/uint64_to_float: -24.13% (2.1832 => 1.6563, std.dev.: 0.0101) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 40.52% (14.7684 => 20.7529, std.dev.: 0.0449) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.17% (0.0810 => 0.0941, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/rem: 14.69% (0.1035 => 0.1187, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 10.79% (0.1112 => 0.1232, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.67% (0.2180 => 0.2369, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.92% (0.8321 => 0.8980, std.dev.: 0.0056) MultiSource/Applications/SIBsim4/SIBsim4: 7.32% (1.2568 => 1.3488, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ks/ks: 7.30% (0.1466 => 0.1573, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.56% (0.1983 => 0.2113, std.dev.: 0.0048) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.34% (6.6074 => 7.0261, std.dev.: 0.0529) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.62% (13.1811 => 13.9225, std.dev.: 0.1857) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.57% (0.6287 => 0.6637, std.dev.: 0.0049) MultiSource/Benchmarks/nbench/nbench: 5.32% (1.1271 => 1.1871, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.16% (0.4127 => 0.4340, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.16% (1.1170 => 1.1746, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.89% (0.4559 => 0.4782, std.dev.: 0.0032) MultiSource/Applications/sgefa/sgefa: 4.67% (0.2999 => 0.3139, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.54% (0.4847 => 0.5067, std.dev.: 0.0070) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.40% (0.3137 => 0.3275, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.20% (1.6386 => 1.7074, std.dev.: 0.0140) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.12% (0.2741 => 0.2854, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.11% (0.6227 => 0.6483, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.07% (0.7473 => 0.7777, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.05% (8.6476 => 8.9978, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.85% (1.1685 => 1.2135, std.dev.: 0.0140) MultiSource/Benchmarks/sim/sim: 3.78% (0.3226 => 0.3348, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 3.69% (1.0945 => 1.1349, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.68% (0.5191 => 0.5382, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 3.59% (0.6834 => 0.7079, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.52% (0.8148 => 0.8435, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.49% (0.9056 => 0.9372, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/football/football: 3.46% (0.8768 => 0.9071, std.dev.: 0.0045) MultiSource/Applications/d/make_dparser: 3.28% (3.2366 => 3.3429, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/hash2: 3.25% (0.4125 => 0.4259, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.25% (1.3279 => 1.3710, std.dev.: 0.0046) MultiSource/Applications/lua/lua: 3.03% (3.8189 => 3.9347, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 3.02% (14.2605 => 14.6909, std.dev.: 0.0659) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.01% (1.4479 => 1.4915, std.dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/hash: 3.00% (0.3800 => 0.3914, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.95% (0.8261 => 0.8505, std.dev.: 0.0032) MultiSource/Applications/hbd/hbd: 2.95% (1.4269 => 1.4690, std.dev.: 0.0117) MultiSource/Applications/treecc/treecc: 2.89% (1.9948 => 2.0524, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.87% (0.3657 => 0.3762, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 2.86% (1.2222 => 1.2572, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.83% (4.1763 => 4.2945, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.77% (0.8048 => 0.8271, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.70% (0.8457 => 0.8685, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.64% (0.8340 => 0.8560, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.58% (0.9039 => 0.9272, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.57% (0.8597 => 0.8818, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/gs/gs: 2.55% (4.1305 => 4.2360, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.54% (0.8331 => 0.8543, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.52% (4.4873 => 4.6005, std.dev.: 0.0308) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.52% (0.8050 => 0.8253, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.50% (0.8286 => 0.8493, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.31% (0.8518 => 0.8715, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.31% (0.7966 => 0.8150, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.25% (0.5817 => 0.5948, std.dev.: 0.0040) MultiSource/Applications/JM/lencod/lencod: 2.25% (15.3280 => 15.6724, std.dev.: 0.0699) MultiSource/Applications/hexxagon/hexxagon: 2.02% (0.9810 => 1.0008, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.01% (0.8177 => 0.8341, std.dev.: 0.0056) MultiSource/Applications/siod/siod: 1.88% (2.2184 => 2.2601, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.86% (0.8420 => 0.8577, std.dev.: 0.0058) MultiSource/Applications/JM/ldecod/ldecod: 1.83% (6.7320 => 6.8551, std.dev.: 0.0221) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.74% (4.4880 => 4.5659, std.dev.: 0.0221) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.42% (0.8995 => 0.9123, std.dev.: 0.0050) MultiSource/Applications/oggenc/oggenc: 1.33% (4.9628 => 5.0290, std.dev.: 0.0210) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.85% (1.5795 => 2.5090, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.54% (2.7978 => 3.7363, std.dev.: 0.0074) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.08% (2.4333 => 2.6786, std.dev.: 0.0175) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.92% (0.3186 => 0.3502, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.05% (1.1857 => 1.2812, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 5.96% (63.1822 => 66.9502, std.dev.: 0.0984) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.24% (14.6451 => 15.2667, std.dev.: 0.2198) MultiSource/Applications/siod/siod: 2.55% (3.6643 => 3.7576, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.54% (4.3552 => 4.4658, std.dev.: 0.0202) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.30% (2.4490 => 2.5053, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.89% (44.5605 => 45.4011, std.dev.: 0.0878) SingleSource/Benchmarks/Misc/ReedSolomon: 1.73% (8.5322 => 8.6794, std.dev.: 0.0528) MultiSource/Applications/minisat/minisat: 1.65% (6.1525 => 6.2542, std.dev.: 0.0363) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.25% (4.8362 => 4.8966, std.dev.: 0.0083) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.04% (41.4238 => 41.8551, std.dev.: 0.0945) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -34.91% (0.0338 => 0.0220, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.04% (0.3269 => 0.3039, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -5.24% (29.8330 => 28.2702, std.dev.: 0.1119) SingleSource/Benchmarks/Shootout-C++/hash2: -1.46% (3.4237 => 3.3738, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.26% (3.3479 => 3.3057, std.dev.: 0.0057) MultiSource/Applications/SPASS/SPASS: -1.19% (8.4326 => 8.3325, std.dev.: 0.0307) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.64% (16.4461 => 16.7156, std.dev.: 0.1235) MultiSource/Applications/obsequi/Obsequi: 4.93% (1.0262 => 1.0768, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6884.85% (0.3123 => 21.8137, std.dev.: 0.3863) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.01% (0.2463 => 0.3670, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/bigfib: 1.23% (0.6010 => 0.6084, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.91% (0.3266 => 0.3361, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 2.69% (0.1969 => 0.2022, std.dev.: 0.0054) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 66.67% (0.0123 => 0.0205, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.41% (0.0408 => 0.0426, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 31.10% (0.0254 => 0.0333, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.64% (0.0302 => 0.0316, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/test1: -19.44% (0.0180 => 0.0145, std.dev.: 0.0037) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.56% (0.1438 => 0.1430, std.dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 0.31% (1.1329 => 1.1364, std.dev.: 0.0345) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 2.53% (0.1462 => 0.1499, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.05% (0.4164 => 0.4037, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.97% (0.1369 => 0.1342, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.47% (0.0641 => 0.0638, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 11.28% (0.0195 => 0.0217, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.21% (0.0578 => 0.0571, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.03% (1.1437 => 1.1434, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 300.00% (0.0001 => 0.0004, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -50.00% (0.0014 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.80% (0.0627 => 0.0553, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.89% (0.0180 => 0.0196, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.04% (0.8017 => 0.8020, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -24.19% (0.0062 => 0.0047, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 2.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 07:40:16 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 09:40:16 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121031144016.144D82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5447?compare_to=5444&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5447, Order: 167114, Start Time: 2012-10-31 13:14:59, End Time: 2012-10-31 14:40:16 To: 5444, Order: 167112, Start Time: 2012-10-31 11:26:35, End Time: 2012-10-31 12:51:52 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (8 on baseline) Performance Improvements: 0 (173 on baseline) Unchanged Tests: 1040 (861 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.94% (55.4819 => 56.5562, std.dev.: 0.1389) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.11% (79.9505 => 80.8400, std.dev.: 0.2680) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 24.11% (15.2527 => 18.9306, std.dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.15% (3.1919 => 3.4200, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.63% (54.5751 => 56.5562, std.dev.: 0.1389) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.94% (2.0478 => 2.1081, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/salsa20: 2.51% (7.4937 => 7.6820, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/hash2: 2.15% (3.1932 => 3.2619, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.41% (79.7170 => 80.8400, std.dev.: 0.2680) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.46% (0.1431 => 0.1310, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.33% (0.1584 => 0.1452, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.54% (0.3821 => 0.3533, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -7.03% (2.4924 => 2.3172, std.dev.: 0.0115) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.47% (0.2428 => 0.2271, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.40% (0.3142 => 0.2941, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.29% (0.3658 => 0.3428, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.22% (22.4056 => 21.0129, std.dev.: 0.0197) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.10% (0.9542 => 0.8960, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/oourafft: -5.97% (0.2160 => 0.2031, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.90% (4.5069 => 4.2409, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.86% (3.5339 => 3.3268, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.81% (0.9852 => 0.9280, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.77% (0.6484 => 0.6110, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/ReedSolomon: -5.75% (0.1879 => 0.1771, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: -5.72% (0.2659 => 0.2507, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -5.69% (0.3357 => 0.3166, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.69% (1.6474 => 1.5537, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.65% (0.2355 => 0.2222, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -5.64% (16.1920 => 15.2783, std.dev.: 0.0068) MultiSource/Applications/Burg/burg: -5.62% (1.2515 => 1.1812, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-2: -5.61% (0.3831 => 0.3616, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -5.60% (0.4176 => 0.3942, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.59% (1.2784 => 1.2069, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.59% (5.4682 => 5.1624, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: -5.59% (0.3812 => 0.3599, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -5.57% (0.3880 => 0.3664, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -5.56% (7.0961 => 6.7013, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.56% (0.7919 => 0.7479, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/synchronized: -5.54% (0.3896 => 0.3680, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.54% (0.3884 => 0.3669, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -5.54% (0.3848 => 0.3635, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -5.53% (0.4033 => 0.3810, std.dev.: 0.0035) MultiSource/Applications/siod/siod: -5.49% (2.4021 => 2.2702, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.48% (4.8161 => 4.5522, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.47% (0.3891 => 0.3678, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -5.46% (4.3330 => 4.0964, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.43% (0.5999 => 0.5673, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.42% (1.0544 => 0.9973, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.40% (0.4151 => 0.3927, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.39% (4.8802 => 4.6173, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/property: -5.38% (0.4199 => 0.3973, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -5.36% (1.3148 => 1.2443, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.36% (0.4813 => 0.4555, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.29% (0.3837 => 0.3634, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.27% (0.8521 => 0.8072, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.26% (2.1713 => 2.0570, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: -5.22% (0.3025 => 0.2867, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: -5.20% (0.6750 => 0.6399, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: -5.18% (0.4861 => 0.4609, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.17% (4.0323 => 3.8238, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.17% (0.3057 => 0.2899, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -5.17% (0.3194 => 0.3029, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -5.16% (0.3026 => 0.2870, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -5.14% (0.4280 => 0.4060, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -5.14% (0.2939 => 0.2788, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.13% (0.2903 => 0.2754) SingleSource/Benchmarks/Shootout-C++/strcat: -5.12% (0.2989 => 0.2836, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -5.10% (0.3059 => 0.2903, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -5.09% (0.2849 => 0.2704, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.06% (0.2548 => 0.2419, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.06% (2.2587 => 2.1444, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary2: -5.06% (0.3481 => 0.3305, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -5.05% (0.3205 => 0.3043, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.04% (0.3252 => 0.3088, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -5.04% (4.0594 => 3.8550, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: -5.03% (34.0927 => 32.3789, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/lists: -5.03% (0.3621 => 0.3439, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -5.03% (0.2985 => 0.2835, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: -5.02% (0.2871 => 0.2727, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.01% (0.3849 => 0.3656, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.01% (0.3931 => 0.3734, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.01% (0.5591 => 0.5311, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: -5.01% (0.3255 => 0.3092, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.99% (0.7198 => 0.6839, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.98% (0.5581 => 0.5303, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.96% (0.2278 => 0.2165, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -4.96% (1.6364 => 1.5553, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.95% (0.4321 => 0.4107, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -4.95% (9.2283 => 8.7713, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.94% (1.2210 => 1.1607, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: -4.92% (0.3394 => 0.3227, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.91% (0.5805 => 0.5520, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.91% (0.3016 => 0.2868, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.89% (0.6052 => 0.5756, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.88% (0.5925 => 0.5636, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: -4.88% (0.3446 => 0.3278, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -4.87% (0.4248 => 0.4041, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.86% (0.6230 => 0.5927, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.85% (0.6304 => 0.5998, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -4.85% (0.7982 => 0.7595, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: -4.83% (0.3788 => 0.3605, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.83% (0.5859 => 0.5576, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: -4.82% (18.2933 => 17.4109, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.81% (1.4642 => 1.3937, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.81% (0.5857 => 0.5575, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.81% (0.5802 => 0.5523, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.80% (0.2999 => 0.2855) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.80% (1.3722 => 1.3064, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.78% (0.5478 => 0.5216, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.77% (0.6681 => 0.6362, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.77% (0.6293 => 0.5993, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.76% (0.6297 => 0.5997, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.75% (0.6194 => 0.5900, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.74% (0.6260 => 0.5963, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.74% (0.4427 => 0.4217, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.74% (0.6395 => 0.6092, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.73% (0.7339 => 0.6992, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.71% (0.6667 => 0.6353, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -4.71% (0.3867 => 0.3685, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.68% (0.5705 => 0.5438, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.67% (0.6189 => 0.5900, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.65% (0.5575 => 0.5316, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.64% (0.6676 => 0.6366, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.63% (0.5569 => 0.5311, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.62% (0.6446 => 0.6148, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.62% (0.5849 => 0.5579, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.61% (0.5941 => 0.5667, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.61% (0.6660 => 0.6353, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.59% (1.2221 => 1.1660, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.58% (0.3491 => 0.3331, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -4.58% (0.7779 => 0.7423, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.57% (0.6033 => 0.5757, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.56% (0.5570 => 0.5316, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: -4.55% (0.4524 => 0.4318, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.54% (0.5688 => 0.5430, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.53% (0.7524 => 0.7183, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.52% (0.6440 => 0.6149, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.47% (0.6395 => 0.6109, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.45% (0.5456 => 0.5213, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.45% (0.3323 => 0.3175, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.43% (0.4083 => 0.3902, std.dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.40% (0.3319 => 0.3173, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.39% (0.4916 => 0.4700, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.38% (0.5567 => 0.5323, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.36% (0.2933 => 0.2805, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.36% (0.9557 => 0.9140) MultiSource/Benchmarks/Prolangs-C/football/football: -4.33% (0.9179 => 0.8782, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/Hello: -4.25% (0.6347 => 0.6077, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -4.25% (0.4515 => 0.4323, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -4.17% (1.1450 => 1.0973, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -4.15% (0.6441 => 0.6174, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -4.14% (5.0226 => 4.8145, std.dev.: 0.0061) MultiSource/Applications/spiff/spiff: -4.11% (0.8418 => 0.8072, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: -4.10% (0.3581 => 0.3434, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.09% (0.7021 => 0.6734, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -4.06% (0.7447 => 0.7145, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.99% (0.3483 => 0.3344, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.95% (0.6736 => 0.6470, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: -3.93% (15.5079 => 14.8986, std.dev.: 0.0077) MultiSource/Applications/treecc/treecc: -3.88% (2.1401 => 2.0570, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/09-vor/vor: -3.88% (0.3271 => 0.3144, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: -3.76% (0.3406 => 0.3278, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -3.68% (17.1032 => 16.4732, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -3.66% (8.0126 => 7.7190, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.54% (0.5168 => 0.4985, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: -3.52% (3.5154 => 3.3916, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.48% (0.9077 => 0.8761, std.dev.: 0.0020) MultiSource/Applications/hbd/hbd: -3.44% (1.5610 => 1.5073, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -3.43% (20.7746 => 20.0619, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.42% (1.2300 => 1.1879, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.23% (0.5329 => 0.5157, std.dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: -2.97% (1.1530 => 1.1188, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.80% (6.7716 => 6.5820, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.46% (14.2083 => 13.8593, std.dev.: 0.0086) MultiSource/Applications/SIBsim4/SIBsim4: -1.74% (1.3864 => 1.3623, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7542, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/richards_benchmark: -8.65% (1.2842 => 1.1731, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.85% (1.7753 => 1.7069, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.59% (2.2633 => 2.1820, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4690, std.dev.: 0.0052) Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 08:49:07 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 10:49:07 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121031154907.D63D32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5448?compare_to=5445&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5448, Order: 167114, Start Time: 2012-10-31 13:28:06, End Time: 2012-10-31 15:49:08 To: 5445, Order: 167111, Start Time: 2012-10-31 10:37:00, End Time: 2012-10-31 12:57:56 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (17 on baseline) New Passes: 0 (14 on baseline) Performance Regressions: 1 (180 on baseline) Performance Improvements: 1 (45 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 22 (5 on baseline) Unchanged Tests: 1018 (647 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 2.73% (25.4059 => 26.0991, std.dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/SPASS/SPASS: -1.15% (11.3006 => 11.1701, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/lemon/lemon MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Shootout-C++/ary2 MultiSource/Applications/JM/ldecod/ldecod: 0.16% (0.1226 => 0.1228, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: - (0.0111 => 0.0111, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: -0.08% (13.1580 => 13.1477, std.dev.: 0.0067) MultiSource/Applications/lemon/lemon: -0.03% (1.4560 => 1.4556, std.dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 0.08% (0.1331 => 0.1332) MultiSource/Applications/sqlite3/sqlite3: - (0.0007 => 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0076 => 0.0076) MultiSource/Benchmarks/Bullet/bullet: 0.09% (0.1165 => 0.1166, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 0.00% (499.8323 => 499.8406, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.14% (0.0721 => 0.0722, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: - (0.2552 => 0.2552, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/bh/bh: - (0.0176 => 0.0176) MultiSource/Benchmarks/Olden/power/power: -0.60% (13.2166 => 13.1368, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: 0.29% (0.0340 => 0.0341, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 0.35% (0.0572 => 0.0574, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.95% (0.0524 => 0.0529, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.28% (0.0357 => 0.0358, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.00% (0.0050 => 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.95% (36.5000 => 36.1520, std.dev.: 1.4266) SingleSource/Benchmarks/BenchmarkGame/n-body: - (1.3168 => 1.3168, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -0.00% (3.0438 => 3.0437, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -0.13% (0.0757 => 0.0756, std.dev.: 0.0011) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/lemon/lemon MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Shootout-C++/ary2 MultiSource/Applications/JM/ldecod/ldecod: -5.39% (0.1298 => 0.1228, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 0.66% (1.4460 => 1.4556, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: -99.98% (4.6441 => 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.83% (4.3882 => 0.0076) MultiSource/Benchmarks/Bullet/bullet: -98.91% (10.7105 => 0.1166, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 423853.01% (0.1179 => 499.8406, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -35.99% (0.3987 => 0.2552, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/bh/bh: -99.09% (1.9405 => 0.0176) MultiSource/Benchmarks/Olden/power/power: 1064.92% (1.1277 => 13.1368, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: -99.96% (85.0658 => 0.0341, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -33.56% (0.0864 => 0.0574, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.42% (0.0611 => 0.0529, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -29.25% (0.0506 => 0.0358, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 37.84% (0.0037 => 0.0051) SingleSource/Benchmarks/BenchmarkGame/n-body: -3.72% (1.3677 => 1.3168, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.11% (3.2416 => 3.0437, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -0.13% (0.0757 => 0.0756, std.dev.: 0.0011) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 200.63% (0.5229 => 1.5720, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 14.21% (14.9895 => 17.1196, std.dev.: 0.0053) MultiSource/Applications/kimwitu++/kc: 36.13% (14.1553 => 19.2702, std.dev.: 0.0090) MultiSource/Benchmarks/MallocBench/gs/gs: 13.47% (4.1105 => 4.6642, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 29.58% (1.1048 => 1.4316, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 306.66% (7.1582 => 29.1096, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.68% (3.4629 => 5.8412, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 64.00% (0.6222 => 1.0204, std.dev.: 0.0026) New Passes - Execution Time --------------------------- MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SPASS/SPASS: 11170000.00% (0.0001 => 11.1701, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 51100.00% (0.0001 => 0.0512, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 66500.00% (0.0001 => 0.0666, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049700.00% (0.0001 => 10.0498, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5494900.00% (0.0001 => 5.4950, std.dev.: 0.0163) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 39.87% (0.1056 => 0.1477, std.dev.: 0.0000) SingleSource/UnitTests/vla: 29.01% (0.0355 => 0.0458, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 27.79% (0.1432 => 0.1830, std.dev.: 0.0001) MultiSource/Benchmarks/llubenchmark/llu: 22.94% (0.0462 => 0.0568, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.84% (0.0648 => 0.0796, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 21.55% (0.0798 => 0.0970, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 21.39% (0.1566 => 0.1901, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 19.67% (0.0793 => 0.0949, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 19.22% (0.0770 => 0.0918, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 19.16% (0.1555 => 0.1853, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 18.88% (0.0842 => 0.1001, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 18.42% (0.1151 => 0.1363, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.32% (0.8172 => 0.9669, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout/lists: 18.05% (0.0626 => 0.0739, std.dev.: 0.0007) SingleSource/UnitTests/SignlessTypes/rem: 18.01% (0.1144 => 0.1350, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.77% (0.2758 => 0.3248, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 17.69% (22.1758 => 26.0991, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.58% (0.2065 => 0.2428, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 17.42% (0.2554 => 0.2999, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 17.37% (0.1163 => 0.1365, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/17-bintr/bintr: 17.33% (0.0675 => 0.0792, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 17.29% (0.1695 => 0.1988, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.27% (0.0886 => 0.1039, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.22% (0.0871 => 0.1021, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 17.22% (0.3177 => 0.3724, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.15% (0.0834 => 0.0977, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 17.12% (0.0730 => 0.0855, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 17.11% (0.1175 => 0.1376, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.01% (0.1117 => 0.1307, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 16.89% (0.3121 => 0.3648, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 16.87% (0.4879 => 0.5702, std.dev.: 0.0037) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 16.73% (0.1584 => 0.1849, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 16.52% (0.1029 => 0.1199, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 16.22% (0.0746 => 0.0867, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 15.72% (0.2271 => 0.2628, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.52% (0.2107 => 0.2434, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 15.46% (0.7115 => 0.8215, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 15.35% (0.1655 => 0.1909, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 15.16% (0.7835 => 0.9023, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.05% (0.1940 => 0.2232, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 15.04% (0.2700 => 0.3106, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.03% (0.1337 => 0.1538, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.97% (0.1062 => 0.1221, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 14.95% (1.1642 => 1.3382, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 14.93% (0.5105 => 0.5867, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.84% (0.1125 => 0.1292, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.76% (0.5981 => 0.6864, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 14.19% (0.5569 => 0.6359, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 14.09% (0.3109 => 0.3547, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 13.99% (0.7433 => 0.8473, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.91% (0.1510 => 0.1720, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.89% (0.5860 => 0.6674, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/functionobjects: 13.84% (0.5020 => 0.5715, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 13.84% (0.0730 => 0.0831, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.80% (0.1906 => 0.2169, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.70% (0.9765 => 1.1103, std.dev.: 0.0091) MultiSource/Applications/d/make_dparser: 13.69% (3.3354 => 3.7920, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.60% (0.1625 => 0.1846, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.48% (0.4615 => 0.5237, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.44% (0.6675 => 0.7572, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.38% (0.0770 => 0.0873, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.37% (0.3441 => 0.3901, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.28% (1.5415 => 1.7462, std.dev.: 0.0105) MultiSource/Applications/treecc/treecc: 12.92% (2.0273 => 2.2893, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.83% (0.2603 => 0.2937, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 12.78% (3.8723 => 4.3671, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.65% (1.3050 => 1.4701, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.21% (0.1032 => 0.1158, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.18% (1.1861 => 1.3306, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 12.16% (0.6450 => 0.7234, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 12.15% (0.3423 => 0.3839, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 12.03% (1.0722 => 1.2012, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 11.96% (0.4299 => 0.4813, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 11.91% (0.1268 => 0.1419, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 11.83% (0.8921 => 0.9976, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.79% (0.3307 => 0.3697, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.63% (0.3543 => 0.3955, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 11.62% (1.1840 => 1.3216, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.57% (0.1236 => 0.1379, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 11.40% (0.3387 => 0.3773, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.38% (4.2646 => 4.7501, std.dev.: 0.0016) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.37% (0.1143 => 0.1273, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 11.34% (8.1363 => 9.0591, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/neural/neural: 11.28% (0.1463 => 0.1628, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 11.20% (0.3473 => 0.3862, std.dev.: 0.0067) SingleSource/UnitTests/ObjC/parameter-passing: 11.13% (0.3927 => 0.4364, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 11.01% (0.3497 => 0.3882, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.98% (0.3543 => 0.3932, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 10.97% (0.3180 => 0.3529, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-3: 10.95% (0.3516 => 0.3901, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.94% (0.3694 => 0.4098, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.92% (0.3561 => 0.3950, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.91% (0.1695 => 0.1880, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 10.91% (9.4845 => 10.5192, std.dev.: 0.0093) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.89% (0.8101 => 0.8983, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.84% (0.3828 => 0.4243, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/hash: 10.80% (0.4289 => 0.4752, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.73% (0.1892 => 0.2095, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.65% (1.4186 => 1.5697, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/property: 10.55% (0.3886 => 0.4296, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.47% (1.5859 => 1.7519, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.40% (14.3668 => 15.8611, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.31% (0.4636 => 0.5114, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.31% (2.2022 => 2.4292, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 10.27% (0.6456 => 0.7119, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 10.26% (0.4620 => 0.5094, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.23% (0.1330 => 0.1466, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 10.22% (2.2969 => 2.5317, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.10% (2.2024 => 2.4249, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.06% (0.1044 => 0.1149, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 10.01% (1.5603 => 1.7165, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.92% (0.2430 => 0.2671, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.40% (0.4203 => 0.4598, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 9.39% (0.7326 => 0.8014, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.34% (4.9449 => 5.4069, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.24% (0.3865 => 0.4222, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.20% (5.0018 => 5.4619, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists: 9.18% (0.3422 => 0.3736, std.dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference-object: 9.05% (0.6030 => 0.6576, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.05% (0.3427 => 0.3737, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.98% (0.5925 => 0.6457, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.80% (0.4103 => 0.4464, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 8.71% (0.3603 => 0.3917, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 8.63% (0.3684 => 0.4002, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 8.60% (0.4048 => 0.4396, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.36% (0.8067 => 0.8741, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.21% (0.3826 => 0.4140, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.13% (0.2793 => 0.3020, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 8.06% (0.2905 => 0.3139, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ary: 8.04% (0.3232 => 0.3492, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.00% (0.3650 => 0.3942, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 8.00% (17.1811 => 18.5549, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/fibo: 7.67% (0.2725 => 0.2934, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 7.59% (0.2831 => 0.3046, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.58% (0.2756 => 0.2965, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 7.48% (0.2714 => 0.2917, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.40% (0.3162 => 0.3396, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 7.40% (5.7591 => 6.1851, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary3: 7.37% (0.3283 => 0.3525, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.36% (0.4064 => 0.4363, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.30% (0.2891 => 0.3102, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 7.20% (0.3098 => 0.3321, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.18% (2.0665 => 2.2149, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/except: 7.11% (0.2871 => 0.3075, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 7.04% (0.3379 => 0.3617, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 6.99% (0.2877 => 0.3078, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 6.98% (0.3052 => 0.3265, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.96% (0.2872 => 0.3072, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 6.88% (1.2842 => 1.3725, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 6.69% (0.3092 => 0.3299, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 6.60% (0.2802 => 0.2987, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.99% (0.3136 => 0.3324, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: 5.76% (0.3282 => 0.3471, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.58% (3.8922 => 4.1095, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (0.3131 => 0.3294, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: 5.08% (0.2049 => 0.2153, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.90% (0.2266 => 0.2377, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.76% (0.3935 => 0.4083, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.46% (0.3817 => 0.3949, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.68% (7.9617 => 8.1750, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.53% (7.0540 => 7.1622, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 148.00% (4.3953 => 10.9004, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 19.80% (2.8904 => 3.4628, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.67% (1.1145 => 1.3003, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.58% (0.2944 => 0.3285, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 9.94% (1.1396 => 1.2529, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 9.88% (0.1629 => 0.1790, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217) SingleSource/Benchmarks/Shootout-C++/hash2: 6.65% (3.1578 => 3.3679, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.46% (0.3463 => 0.3652) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.4162 => 0.4322, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.72% (4.2280 => 4.3432, std.dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0313 => 1.0567, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.31% (1.7254 => 1.7652, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bisort/bisort: 1.88% (0.8333 => 0.8490, std.dev.: 0.0012) MultiSource/Applications/aha/aha: 1.54% (3.1595 => 3.2081, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7985, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.12% (6.5088 => 6.5820, std.dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.88% (6.6874 => 0.1417, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -76.87% (0.8651 => 0.2001, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.35% (5.3855 => 2.4045, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -55.01% (5.3526 => 2.4082, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/richards_benchmark: -45.87% (0.1622 => 0.0878, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -39.43% (1.1194 => 0.6780, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.24% (5.2763 => 3.2586, std.dev.: 0.0163) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -24.16% (1.7609 => 1.3355, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -17.11% (2.9384 => 2.4355, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: -9.89% (10.4361 => 9.4042, std.dev.: 0.0053) MultiSource/Benchmarks/Bullet/bullet: -9.25% (63.2438 => 57.3947, std.dev.: 0.0230) SingleSource/UnitTests/Vector/constpool: -9.11% (54.1659 => 49.2291, std.dev.: 0.0232) MultiSource/Benchmarks/PAQ8p/paq8p: -3.60% (10.3673 => 9.9938, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: -2.01% (21.9371 => 21.4960, std.dev.: 0.0093) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -43.00% (0.0400 => 0.0228, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel: -33.43% (1.1492 => 0.7650, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: -15.78% (1.6925 => 1.4254, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -11.01% (9.5636 => 8.5110, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/mandel-2: -10.93% (1.5373 => 1.3692, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.36% (19.9488 => 18.2802, std.dev.: 0.0750) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.03% (1.8329 => 1.7041, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -6.52% (0.2161 => 0.2020, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -6.14% (1.2373 => 1.1613, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8480, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -5.46% (6.6465 => 6.2839, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.06% (1.6805 => 1.5955, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.81% (1.5660 => 1.4907, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5085, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.30% (0.9957 => 0.9529, std.dev.: 0.0038) MultiSource/Applications/siod/siod: -3.67% (3.2827 => 3.1621, std.dev.: 0.0403) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.52% (32.5116 => 31.3679, std.dev.: 0.0104) MultiSource/Benchmarks/sim/sim: -3.19% (5.0483 => 4.8875, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -3.04% (0.4808 => 0.4662, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.87% (4.5009 => 4.3719, std.dev.: 0.0025) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.95% (8.1563 => 7.9971, std.dev.: 0.0192) SingleSource/Benchmarks/Misc/salsa20: -1.86% (10.2830 => 10.0916, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6813, std.dev.: 0.0017) SingleSource/UnitTests/Vector/multiplies: -1.51% (2.5528 => 2.5142, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.08% (6.2999 => 6.2317, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/JM/lencod/lencod: -84.58% (0.0720 => 0.0111, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 13147600.00% (0.0001 => 13.1477, std.dev.: 0.0067) MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -65.88% (0.2116 => 0.0722, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 36151900.00% (0.0001 => 36.1520, std.dev.: 1.4266) Report Time: 2.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 09:02:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 11:02:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121031160243.8E8CF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5449?compare_to=5442&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5449, Order: 167113, Start Time: 2012-10-31 12:47:12, End Time: 2012-10-31 16:02:44 To: 5442, Order: 167107, Start Time: 2012-10-31 08:43:05, End Time: 2012-10-31 11:58:55 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (168 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1041 (721 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 8.06% (109.7913 => 118.6370, std.dev.: 0.0711) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.32% (0.0625 => 0.0877, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.51% (0.1063 => 0.1398, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.16% (0.2969 => 0.3716, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 24.86% (0.1106 => 0.1381, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 24.30% (1.5932 => 1.9803, std.dev.: 0.0135) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.02% (0.4139 => 0.5133, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.84% (0.4253 => 0.5267, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.53% (0.0714 => 0.0882, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.39% (0.5900 => 0.7280, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.03% (0.0547 => 0.0673, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 22.95% (0.4994 => 0.6140, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.74% (0.5000 => 0.6137, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.74% (0.0475 => 0.0583, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.09% (0.0584 => 0.0713, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.85% (0.0897 => 0.1093, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.60% (0.1620 => 0.1970, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 20.96% (0.1021 => 0.1235, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 20.87% (0.0599 => 0.0724, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 20.78% (0.1107 => 0.1337, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 20.36% (0.0948 => 0.1141, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.96% (0.0541 => 0.0649, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.88% (0.1549 => 0.1857, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.78% (0.0642 => 0.0769, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 19.75% (0.0633 => 0.0758, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.69% (0.0584 => 0.0699, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.67% (0.1103 => 0.1320, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.63% (0.3903 => 0.4669, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: 19.54% (0.0604 => 0.0722, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: 19.49% (0.0821 => 0.0981, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.26% (0.1604 => 0.1913, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 19.15% (0.1619 => 0.1929, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.14% (0.1003 => 0.1195, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.10% (0.0822 => 0.0979, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 18.27% (0.0947 => 0.1120, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.13% (0.1462 => 0.1727, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 17.70% (0.0808 => 0.0951, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.53% (0.3890 => 0.4572, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.45% (1.3152 => 1.5447, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.41% (0.2866 => 0.3365, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 17.41% (0.1218 => 0.1430, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.38% (0.2014 => 0.2364, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 17.11% (0.5826 => 0.6823, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 17.05% (0.4029 => 0.4716, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/mst/mst: 17.05% (0.0698 => 0.0817, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.00% (0.2736 => 0.3201, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 16.96% (0.1421 => 0.1662, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 16.91% (0.1088 => 0.1272, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 16.88% (0.1505 => 0.1759, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 16.68% (0.5889 => 0.6871, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 16.49% (1.8794 => 2.1894, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.36% (3.5627 => 4.1457, std.dev.: 0.0023) MultiSource/Applications/Burg/burg: 16.23% (0.5546 => 0.6446, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: 16.20% (0.1284 => 0.1492, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.14% (0.2875 => 0.3339, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.03% (0.1160 => 0.1346, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.02% (0.5026 => 0.5831, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.96% (0.1968 => 0.2282, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.90% (0.3271 => 0.3791, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 15.89% (1.6211 => 1.8787, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 15.84% (0.4658 => 0.5396, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/fibo: 15.67% (0.2725 => 0.3152, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.62% (0.4361 => 0.5042, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: 15.55% (1.0781 => 1.2457, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.52% (0.2738 => 0.3163, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hello: 15.51% (0.2714 => 0.3135, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 15.42% (0.7171 => 0.8277, std.dev.: 0.0019) MultiSource/Applications/hbd/hbd: 15.41% (0.9697 => 1.1191, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.35% (0.2729 => 0.3148, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.34% (0.3930 => 0.4533, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 15.31% (0.2750 => 0.3171, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 15.20% (0.9909 => 1.1415, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.19% (0.2792 => 0.3216, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 15.11% (0.3004 => 0.3458, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 15.11% (0.2780 => 0.3200, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 15.09% (0.2803 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 15.05% (0.3096 => 0.3562, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.98% (2.7292 => 3.1380, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 14.97% (4.4195 => 5.0811, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/except: 14.94% (0.2811 => 0.3231, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.93% (0.3060 => 0.3517, std.dev.: 0.0048) MultiSource/Benchmarks/Bullet/bullet: 14.88% (23.5202 => 27.0202, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.87% (0.3195 => 0.3670, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 14.84% (0.2823 => 0.3242, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 14.84% (0.2911 => 0.3343, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 14.82% (4.2109 => 4.8350, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.76% (2.0673 => 2.3725, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 14.75% (0.2813 => 0.3228, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.60% (1.9694 => 2.2570, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 14.48% (0.3267 => 0.3740, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.45% (1.9966 => 2.2851, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary: 14.30% (0.3258 => 0.3724, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.13% (0.3362 => 0.3837, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.13% (0.1090 => 0.1244, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 14.08% (0.3317 => 0.3784, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.80% (0.3124 => 0.3555, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 13.65% (0.3348 => 0.3805, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash: 13.63% (0.4146 => 0.4711, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 13.61% (0.3726 => 0.4233, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 13.53% (0.3496 => 0.3969, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 13.45% (0.2566 => 0.2911, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.41% (0.3282 => 0.3722, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 13.38% (0.3678 => 0.4170, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 13.35% (0.2075 => 0.2352, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.26% (0.3981 => 0.4509, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.24% (0.3845 => 0.4354, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 13.20% (0.3477 => 0.3936, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.19% (0.3625 => 0.4103, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 13.18% (1.4269 => 1.6150, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.17% (0.3690 => 0.4176, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.14% (0.3469 => 0.3925, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-2: 13.12% (0.3446 => 0.3898, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 13.10% (0.3465 => 0.3919, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 13.07% (0.3442 => 0.3892, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.07% (0.3488 => 0.3944, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 13.03% (0.4251 => 0.4805, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.01% (0.3460 => 0.3910, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 13.00% (0.3724 => 0.4208, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 12.93% (2.1653 => 2.4453, std.dev.: 0.0016) MultiSource/Applications/treecc/treecc: 12.79% (0.7875 => 0.8882, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions: 12.65% (0.3643 => 0.4104, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 12.64% (4.6177 => 5.2012, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/property: 12.60% (0.3650 => 0.4110, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 12.41% (0.5012 => 0.5634, std.dev.: 0.0104) MultiSource/Benchmarks/mafft/pairlocalalign: 12.14% (2.1013 => 2.3564, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.76% (0.2040 => 0.2280, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 11.45% (0.2691 => 0.2999, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.28% (0.1383 => 0.1539, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 11.06% (5.5417 => 6.1546, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.02% (0.6435 => 0.7144, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.41% (0.1028 => 0.1135, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 10.34% (0.4847 => 0.5348, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 10.32% (0.3498 => 0.3859, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.30% (0.2737 => 0.3019, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.11% (0.2068 => 0.2277, std.dev.: 0.0057) MultiSource/Applications/siod/siod: 9.90% (0.6634 => 0.7291, std.dev.: 0.0202) MultiSource/Applications/minisat/minisat: 9.74% (0.3336 => 0.3661, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.66% (0.3084 => 0.3382, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 9.00% (2.0346 => 2.2177, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.94% (0.2103 => 0.2291, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 8.87% (0.2391 => 0.2603, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.71% (4.6926 => 5.1014, std.dev.: 0.0134) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.16% (11.6398 => 12.5899, std.dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.98% (0.5361 => 0.5789, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.30% (0.7426 => 0.7968, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.25% (0.5584 => 0.5989, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 6.10% (11.9555 => 12.6843, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.80% (0.3792 => 0.3936, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6537, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 8.82% (0.2802 => 0.3049, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6101, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.00% (12.0509 => 12.6532, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1660, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-2: 4.06% (1.8057 => 1.8790, std.dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/dry: 2.73% (14.0481 => 14.4322, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1945, std.dev.: 0.0043) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.71% (3.1722 => 3.2264, std.dev.: 0.0036) MultiSource/Applications/viterbi/viterbi: 1.44% (46.6247 => 47.2952, std.dev.: 0.0078) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2863, std.dev.: 0.0022) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5133, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.07% (1.2451 => 1.2584, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5884, std.dev.: 0.0148) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.55% (2.4764 => 2.4133, std.dev.: 0.0092) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.61% (25.4195 => 16.3680, std.dev.: 0.0274) SingleSource/Benchmarks/Shootout-C++/ary2: -8.66% (0.2402 => 0.2194, std.dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9776, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7749, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/tsp/tsp: -7.32% (2.1113 => 1.9568, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -3.24% (11.2080 => 10.8451, std.dev.: 0.0467) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.18% (0.6293 => 0.6093, std.dev.: 0.0061) MultiSource/Applications/siod/siod: -2.96% (6.9842 => 6.7773, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -2.87% (3.6262 => 3.5220, std.dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/fldry: -2.65% (17.2379 => 16.7808, std.dev.: 0.0385) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (41.7953 => 40.8622, std.dev.: 0.0173) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5772, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: -1.53% (5.5810 => 5.4955, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.14% (105.3826 => 104.1787, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0423, std.dev.: 0.0025) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.03% (3.3991 => 3.3640, std.dev.: 0.0029) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 09:14:33 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 11:14:33 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121031161433.613142A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5450?compare_to=5446&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5450, Order: 167116, Start Time: 2012-10-31 14:46:04, End Time: 2012-10-31 16:14:35 To: 5446, Order: 167114, Start Time: 2012-10-31 13:01:53, End Time: 2012-10-31 14:29:03 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 20 (90 on baseline) Performance Improvements: 1 (5 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 970 (879 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: 6.91% (0.1722 => 0.1841, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.37% (0.2104 => 0.2238, std.dev.: 0.0050) MultiSource/Applications/spiff/spiff: 6.36% (0.7973 => 0.8480, std.dev.: 0.0102) MultiSource/Benchmarks/McCat/05-eks/eks: 4.12% (0.4544 => 0.4731, std.dev.: 0.0071) MultiSource/Applications/Burg/burg: 3.52% (1.2572 => 1.3015, std.dev.: 0.0171) MultiSource/Applications/hbd/hbd: 2.74% (1.4690 => 1.5093, std.dev.: 0.0013) MultiSource/Applications/d/make_dparser: 2.59% (3.3429 => 3.4296, std.dev.: 0.0147) MultiSource/Applications/JM/lencod/lencod: 1.96% (15.6724 => 15.9798, std.dev.: 0.0891) MultiSource/Applications/lua/lua: 1.78% (3.9347 => 4.0049, std.dev.: 0.0075) MultiSource/Applications/SIBsim4/SIBsim4: 1.68% (1.3488 => 1.3714, std.dev.: 0.0080) MultiSource/Applications/ClamAV/clamscan: 1.63% (20.7529 => 21.0905, std.dev.: 0.0763) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.53% (1.7074 => 1.7335, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.42% (0.8880 => 0.9006, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.37% (0.8560 => 0.8677, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: 2.76% (1.9996 => 2.0547, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout/ary3: 2.20% (2.0911 => 2.1370, std.dev.: 0.0099) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.05% (1.0211 => 1.0420, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.50% (2.9085 => 2.9520, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.37% (1.2562 => 1.2734, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 1.09% (3.1800 => 3.2147, std.dev.: 0.0121) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -5.00% (8.8044 => 8.3645, std.dev.: 0.1493) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.31% (16.7156 => 16.9351, std.dev.: 0.1992) MultiSource/Applications/obsequi/Obsequi: -1.42% (1.0768 => 1.0615, std.dev.: 0.0107) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.45% (21.8137 => 22.3476, std.dev.: 0.0776) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.05% (0.3670 => 0.3668, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/bigfib: 0.03% (0.6084 => 0.6086, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.21% (0.3361 => 0.3368, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/strcat: -0.99% (0.2022 => 0.2002, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 5.37% (0.0205 => 0.0216, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.47% (0.0426 => 0.0428, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.60% (0.0333 => 0.0331, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.95% (0.0316 => 0.0313, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0425 => 0.0425, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0203 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 49.66% (0.0145 => 0.0217, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.77% (0.1430 => 0.1441, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 1.62% (1.1364 => 1.1548, std.dev.: 0.0208) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 1.20% (0.1499 => 0.1517, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.89% (0.4037 => 0.4194, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.49% (0.1342 => 0.1322, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.78% (0.0638 => 0.0643, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 27.65% (0.0217 => 0.0277, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.68% (0.0571 => 0.0550, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.08% (1.1434 => 1.1443, std.dev.: 0.0516) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 675.00% (0.0004 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 271.43% (0.0007 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 17.90% (0.0553 => 0.0652, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 35.71% (0.0196 => 0.0266, std.dev.: 0.0067) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.02% (0.8020 => 0.8022, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: -100.00% (0.0001 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -14.89% (0.0047 => 0.0040, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2390.73% (0.6332 => 15.7713, std.dev.: 0.2138) MultiSource/Benchmarks/McCat/08-main/main: 50.35% (0.1831 => 0.2753, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.41% (0.1559 => 0.1459, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1498.47% (0.3344 => 5.3453, std.dev.: 0.0683) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.31% (0.2364 => 0.3246, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: 4.20% (0.0429 => 0.0447, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.25% (0.0224 => 0.0238, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -31.74% (0.0230 => 0.0157, std.dev.: 0.0012) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4482, std.dev.: 0.0237) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0708, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4945, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3425, std.dev.: 0.0397) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0439, std.dev.: 0.0178) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4052, std.dev.: 0.0038) SingleSource/Regression/C/uint64_to_float: -24.02% (2.1832 => 1.6589, std.dev.: 0.0120) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0008) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 42.81% (14.7684 => 21.0905, std.dev.: 0.0763) SingleSource/UnitTests/SignlessTypes/rem: 14.98% (0.1035 => 0.1190, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 13.58% (0.1112 => 0.1263, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.09% (0.0810 => 0.0916, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.98% (0.1425 => 0.1610, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.03% (0.0848 => 0.0950, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.68% (0.1157 => 0.1269, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 9.12% (1.2568 => 1.3714, std.dev.: 0.0080) MultiSource/Benchmarks/McCat/04-bisect/bisect: 8.97% (0.1137 => 0.1239, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.82% (0.8321 => 0.9055, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.84% (0.1301 => 0.1403, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/05-eks/eks: 7.60% (0.4397 => 0.4731, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/em3d/em3d: 6.97% (0.1721 => 0.1841, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.73% (6.6074 => 7.0521, std.dev.: 0.0782) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.71% (0.2519 => 0.2688, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.69% (0.7473 => 0.7973, std.dev.: 0.0181) MultiSource/Applications/spiff/spiff: 6.67% (0.7950 => 0.8480, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.50% (0.2998 => 0.3193, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.49% (0.4127 => 0.4395, std.dev.: 0.0030) MultiSource/Applications/Burg/burg: 6.49% (1.2222 => 1.3015, std.dev.: 0.0171) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.38% (13.1811 => 14.0223, std.dev.: 0.0573) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.35% (1.1606 => 1.2343, std.dev.: 0.0121) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.25% (0.1983 => 0.2107, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.11% (1.1170 => 1.1853, std.dev.: 0.0170) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.04% (0.6287 => 0.6667, std.dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.99% (0.1885 => 0.1998, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 5.96% (3.2366 => 3.4296, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.94% (0.4847 => 0.5135, std.dev.: 0.0069) MultiSource/Applications/sgefa/sgefa: 5.87% (0.2999 => 0.3175, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.79% (1.6386 => 1.7335, std.dev.: 0.0057) MultiSource/Applications/hbd/hbd: 5.77% (1.4269 => 1.5093, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 5.42% (14.2605 => 15.0335, std.dev.: 0.2137) MultiSource/Applications/treecc/treecc: 5.40% (1.9948 => 2.1025, std.dev.: 0.0225) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.37% (0.4783 => 0.5040, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.13% (0.4559 => 0.4793, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.00% (0.5961 => 0.6259, std.dev.: 0.0099) MultiSource/Applications/lua/lua: 4.87% (3.8189 => 4.0049, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.86% (1.1685 => 1.2253, std.dev.: 0.0111) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.83% (0.6227 => 0.6528, std.dev.: 0.0078) MultiSource/Applications/lemon/lemon: 4.79% (1.0945 => 1.1469, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.61% (0.5817 => 0.6085, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.43% (8.6476 => 9.0310, std.dev.: 0.1105) MultiSource/Applications/JM/lencod/lencod: 4.25% (15.3280 => 15.9798, std.dev.: 0.0891) SingleSource/Benchmarks/Shootout-C++/lists: 4.14% (0.2513 => 0.2617, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.04% (0.8340 => 0.8677, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.83% (0.5191 => 0.5390, std.dev.: 0.0054) MultiSource/Applications/JM/ldecod/ldecod: 3.66% (6.7320 => 6.9787, std.dev.: 0.0610) MultiSource/Applications/minisat/minisat: 3.64% (0.6834 => 0.7083, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.38% (0.9056 => 0.9362, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.37% (0.8712 => 0.9006, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.25% (1.4479 => 1.4949, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.23% (0.8261 => 0.8528, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.21% (4.1763 => 4.3103, std.dev.: 0.0305) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.15% (0.3717 => 0.3834, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.13% (0.6586 => 0.6792, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.09% (0.8611 => 0.8877, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.08% (0.8697 => 0.8965, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.03% (0.8359 => 0.8612, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.00% (0.8457 => 0.8711, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.98% (0.8317 => 0.8565, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.92% (0.9688 => 0.9971, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.79% (0.8805 => 0.9051, std.dev.: 0.0074) MultiSource/Benchmarks/mafft/pairlocalalign: 2.76% (8.6247 => 8.8631, std.dev.: 0.0448) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.75% (0.9908 => 1.0180, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.73% (0.8050 => 0.8270, std.dev.: 0.0060) MultiSource/Applications/oggenc/oggenc: 2.69% (4.9628 => 5.0962, std.dev.: 0.0463) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.62% (0.8331 => 0.8549, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.55% (0.8066 => 0.8272, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.54% (4.4873 => 4.6014, std.dev.: 0.0409) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.45% (0.8995 => 0.9215, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.36% (0.8855 => 0.9064, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.26% (0.7932 => 0.8111, std.dev.: 0.0052) MultiSource/Benchmarks/Bullet/bullet: 2.21% (31.8598 => 32.5635, std.dev.: 0.1693) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 56.47% (1.5795 => 2.4714, std.dev.: 0.0169) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.49% (2.7978 => 3.7349, std.dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.26% (2.4333 => 2.6829, std.dev.: 0.0385) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.41% (0.3186 => 0.3454, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.84% (1.1857 => 1.2786, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 5.92% (63.1822 => 66.9224, std.dev.: 0.0943) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 3.27% (44.5605 => 46.0182, std.dev.: 0.2672) MultiSource/Applications/siod/siod: 3.21% (3.6643 => 3.7821, std.dev.: 0.0356) SingleSource/Benchmarks/Misc/ReedSolomon: 2.87% (8.5322 => 8.7775, std.dev.: 0.0469) SingleSource/Benchmarks/Shootout-C++/ary3: 2.74% (1.9999 => 2.0547, std.dev.: 0.0156) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.23% (2.4490 => 2.5035, std.dev.: 0.0194) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.08% (1.2474 => 1.2734, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/ary3: 2.01% (2.0949 => 2.1370, std.dev.: 0.0099) MultiSource/Benchmarks/Olden/bh/bh: 1.92% (2.3560 => 2.4013, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.46% (2.9096 => 2.9520, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.09% (4.8362 => 4.8889, std.dev.: 0.0126) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.06% (1.5941 => 1.6110, std.dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.19% (0.3269 => 0.3034, std.dev.: 0.0013) MultiSource/Applications/lua/lua: -5.24% (29.8330 => 28.2693, std.dev.: 0.2747) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.59% (7.2130 => 6.8822, std.dev.: 0.0837) SingleSource/Benchmarks/Shootout-C++/hash2: -1.41% (3.4237 => 3.3754, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.36% (3.3479 => 3.3024, std.dev.: 0.0173) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.97% (16.4461 => 16.9351, std.dev.: 0.1992) MultiSource/Applications/obsequi/Obsequi: 3.44% (1.0262 => 1.0615, std.dev.: 0.0107) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7055.81% (0.3123 => 22.3476, std.dev.: 0.0776) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.92% (0.2463 => 0.3668, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/bigfib: 1.26% (0.6010 => 0.6086, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.12% (0.3266 => 0.3368, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/strcat: 1.68% (0.1969 => 0.2002, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 75.61% (0.0123 => 0.0216, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.31% (0.0254 => 0.0331, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.64% (0.0302 => 0.0313, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.68% (0.0384 => 0.0425, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.21% (0.1438 => 0.1441, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000) MultiSource/Applications/lemon/lemon: 1.93% (1.1329 => 1.1548, std.dev.: 0.0208) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Applications/oggenc/oggenc: 3.76% (0.1462 => 0.1517, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.72% (0.4164 => 0.4194, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.43% (0.1369 => 0.1322, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.31% (0.0641 => 0.0643, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.84% (0.0578 => 0.0550, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.05% (1.1437 => 1.1443, std.dev.: 0.0516) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.99% (0.0627 => 0.0652, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.78% (0.0180 => 0.0266, std.dev.: 0.0067) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.06% (0.8017 => 0.8022, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -35.48% (0.0062 => 0.0040, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 09:28:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 11:28:32 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121031162832.B02BD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5451?compare_to=5447&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5451, Order: 167116, Start Time: 2012-10-31 15:03:16, End Time: 2012-10-31 16:28:32 To: 5447, Order: 167114, Start Time: 2012-10-31 13:14:59, End Time: 2012-10-31 14:40:16 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (6 on baseline) Performance Improvements: 0 (173 on baseline) Unchanged Tests: 1042 (863 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 24.17% (15.2527 => 18.9399, std.dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.15% (3.1919 => 3.4201) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.00% (2.0478 => 2.1093, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/salsa20: 2.50% (7.4937 => 7.6807, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash2: 2.18% (3.1932 => 3.2629, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.32% (0.1431 => 0.1312, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.27% (0.1584 => 0.1453, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.35% (0.3821 => 0.3540, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -7.03% (2.4924 => 2.3171, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.56% (0.3142 => 0.2936, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.43% (0.2428 => 0.2272, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.29% (0.9542 => 0.8942, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -6.26% (0.3831 => 0.3591, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -6.26% (0.3880 => 0.3637, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.26% (0.3884 => 0.3641, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -6.22% (0.3812 => 0.3575, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.16% (0.3896 => 0.3656, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.14% (0.3891 => 0.3652, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.13% (0.3848 => 0.3612, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.13% (0.4176 => 0.3920, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -6.12% (0.4033 => 0.3786, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.07% (22.4056 => 21.0453, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/oourafft: -6.06% (0.2160 => 0.2029, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.04% (0.3658 => 0.3437, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.90% (4.5069 => 4.2412, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/property: -5.88% (0.4199 => 0.3952, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.74% (0.6484 => 0.6112, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -5.72% (0.4280 => 0.4035, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.72% (3.5339 => 3.3318, std.dev.: 0.0129) SingleSource/Benchmarks/Misc/ReedSolomon: -5.69% (0.1879 => 0.1772, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.69% (0.2355 => 0.2221, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.67% (5.4682 => 5.1584, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.66% (0.9852 => 0.9294, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -5.60% (16.1920 => 15.2847, std.dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.60% (1.6474 => 1.5552, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: -5.59% (7.0961 => 6.6994, std.dev.: 0.0026) MultiSource/Applications/sgefa/sgefa: -5.57% (0.3357 => 0.3170, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: -5.55% (1.2515 => 1.1821, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.50% (4.8161 => 4.5513, std.dev.: 0.0082) MultiSource/Benchmarks/McCat/08-main/main: -5.45% (0.2659 => 0.2514, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.44% (1.2784 => 1.2089, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.43% (4.8802 => 4.6152, std.dev.: 0.0074) MultiSource/Applications/siod/siod: -5.40% (2.4021 => 2.2723, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.39% (1.0544 => 0.9976, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -5.32% (1.3148 => 1.2448, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.30% (4.0323 => 3.8186, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.29% (0.8521 => 0.8070, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.25% (0.4151 => 0.3933, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.24% (0.3323 => 0.3149, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: -5.22% (0.3026 => 0.2868, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -5.21% (4.3330 => 4.1071, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.20% (0.3057 => 0.2898, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.19% (0.4083 => 0.3871, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.17% (0.7198 => 0.6826, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.13% (0.3837 => 0.3640, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.13% (0.4813 => 0.4566, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: -5.12% (0.3025 => 0.2870, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.10% (1.2210 => 1.1587, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: -5.10% (0.4861 => 0.4613, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -5.10% (0.3059 => 0.2903, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.09% (0.5581 => 0.5297, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -5.08% (34.0927 => 32.3622, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/random: -5.07% (0.2939 => 0.2790, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.06% (2.2587 => 2.1443, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: -5.05% (0.6750 => 0.6409, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -5.04% (0.3194 => 0.3033, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -5.04% (0.3255 => 0.3091, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.04% (0.5857 => 0.5562, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.03% (0.7919 => 0.7521, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.02% (0.4321 => 0.4104, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: -5.02% (0.2849 => 0.2706, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.02% (0.2871 => 0.2727, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.01% (1.6364 => 1.5544, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.01% (0.5591 => 0.5311, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.01% (0.3016 => 0.2865, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -4.97% (0.3621 => 0.3441, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.97% (1.2221 => 1.1614, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.96% (0.5925 => 0.5631, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: -4.96% (0.3205 => 0.3046, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.96% (2.1713 => 2.0636, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.95% (0.3252 => 0.3091, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.95% (0.5802 => 0.5515, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: -4.94% (0.3481 => 0.3309, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -4.92% (4.0594 => 3.8596, std.dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: -4.92% (9.2283 => 8.7745, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.91% (0.6230 => 0.5924, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.91% (0.5478 => 0.5209, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.91% (0.3849 => 0.3660, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -4.90% (0.3446 => 0.3277, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.90% (0.5999 => 0.5705, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.90% (0.5863 => 0.5576, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.88% (0.5805 => 0.5522, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.87% (0.2278 => 0.2167, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.87% (0.6304 => 0.5997, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.86% (0.5859 => 0.5574, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -4.86% (0.2985 => 0.2840, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.84% (0.6052 => 0.5759, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary: -4.83% (0.3394 => 0.3230, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.82% (0.5705 => 0.5430, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.81% (0.6189 => 0.5891, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.81% (0.4427 => 0.4214, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.81% (0.5575 => 0.5307, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: -4.80% (0.4248 => 0.4044, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.80% (0.6667 => 0.6347, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.80% (1.3722 => 1.3064, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.79% (0.6260 => 0.5960, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: -4.78% (0.3788 => 0.3607, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.77% (0.6293 => 0.5993, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.76% (0.6194 => 0.5899, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.74% (0.6033 => 0.5747, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.74% (0.6395 => 0.6092, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.73% (0.6297 => 0.5999, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.72% (0.5570 => 0.5307, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.70% (0.5941 => 0.5662, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.69% (0.7339 => 0.6995, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -4.69% (0.7982 => 0.7608, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.67% (0.5456 => 0.5201, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.66% (0.3931 => 0.3748, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.65% (0.5567 => 0.5308, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.65% (0.5569 => 0.5310, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.65% (0.5849 => 0.5577, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.64% (0.6676 => 0.6366, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.64% (0.6440 => 0.6141, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: -4.64% (18.2933 => 17.4441, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.64% (0.6681 => 0.6371, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.64% (0.6660 => 0.6351, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.64% (1.4642 => 1.3963, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.62% (0.6446 => 0.6148, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.61% (0.3491 => 0.3330, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -4.60% (0.3867 => 0.3689, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -4.60% (0.4524 => 0.4316, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.58% (0.6395 => 0.6102, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.57% (0.5688 => 0.5428, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.56% (0.7524 => 0.7181, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: -4.52% (0.3581 => 0.3419, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: -4.50% (0.7779 => 0.7429, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.43% (0.9557 => 0.9134, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.41% (0.4916 => 0.4699, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.40% (0.2385 => 0.2280, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.37% (0.3319 => 0.3174, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.33% (0.2933 => 0.2806, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: -4.28% (0.9179 => 0.8786, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: -4.22% (0.6347 => 0.6079, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -4.22% (0.7447 => 0.7133, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference-object: -4.21% (0.6441 => 0.6170, std.dev.: 0.0078) MultiSource/Applications/lemon/lemon: -4.06% (1.1450 => 1.0985, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.03% (0.7021 => 0.6738, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.00% (0.2999 => 0.2879, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -3.98% (15.5079 => 14.8912, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/05-eks/eks: -3.88% (0.4515 => 0.4340, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: -3.87% (0.8418 => 0.8092, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.80% (0.6736 => 0.6480, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.79% (0.3483 => 0.3351, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -3.76% (8.0126 => 7.7113, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/09-vor/vor: -3.76% (0.3271 => 0.3148, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: -3.73% (0.3406 => 0.3279, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -3.72% (17.1032 => 16.4670, std.dev.: 0.0198) MultiSource/Applications/oggenc/oggenc: -3.72% (5.0226 => 4.8358, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: -3.69% (2.1401 => 2.0612, std.dev.: 0.0088) SingleSource/UnitTests/Vector/constpool: -3.51% (20.7746 => 20.0445, std.dev.: 0.0405) MultiSource/Applications/hbd/hbd: -3.49% (1.5610 => 1.5065, std.dev.: 0.0031) MultiSource/Applications/d/make_dparser: -3.46% (3.5154 => 3.3937, std.dev.: 0.0054) MultiSource/Benchmarks/nbench/nbench: -3.45% (1.1530 => 1.1132, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.44% (0.9077 => 0.8765, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.42% (0.5168 => 0.4991, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.36% (0.5329 => 0.5150, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.32% (1.2300 => 1.1892, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.09% (6.7716 => 6.5622, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.47% (14.2083 => 13.8578, std.dev.: 0.0106) MultiSource/Applications/SIBsim4/SIBsim4: -1.73% (1.3864 => 1.3624, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7508, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/richards_benchmark: -8.76% (1.2842 => 1.1717, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7063, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.74% (2.2633 => 2.1786, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.54% (1.3096 => 1.2633, std.dev.: 0.0108) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.52% (6.5735 => 6.4738, std.dev.: 0.0023) Report Time: 1.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 10:52:53 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 12:52:53 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121031175253.6A1102A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5452?compare_to=5448&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5452, Order: 167130, Start Time: 2012-10-31 16:19:20, End Time: 2012-10-31 17:52:53 To: 5448, Order: 167114, Start Time: 2012-10-31 13:28:06, End Time: 2012-10-31 15:49:08 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Passes: 20 (17 on baseline) Performance Regressions: 6 (178 on baseline) Performance Improvements: 2 (53 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 2 (2 on baseline) Unchanged Tests: 1012 (658 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/lemon/lemon MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Shootout-C++/ary2 MultiSource/Applications/JM/ldecod/ldecod: -1.71% (0.1228 => 0.1207, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 69294.59% (0.0111 => 7.7028, std.dev.: 0.0062) MultiSource/Applications/SIBsim4/SIBsim4: -70.82% (13.1477 => 3.8364, std.dev.: 0.0037) MultiSource/Applications/lemon/lemon: -0.08% (1.4556 => 1.4544, std.dev.: 0.0051) MultiSource/Applications/sqlite3/sqlite3: 645214.29% (0.0007 => 4.5172, std.dev.: 0.0052) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 57990.79% (0.0076 => 4.4149, std.dev.: 0.0180) MultiSource/Benchmarks/Bullet/bullet: 6445.54% (0.1166 => 7.6321, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pifft/pifft: -99.98% (499.8406 => 0.1170, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.29% (0.2552 => 0.2585, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 10845.45% (0.0176 => 1.9264, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -91.60% (13.1368 => 1.1036, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 246164.52% (0.0341 => 83.9762, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 54.18% (0.0574 => 0.0885, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.19% (0.0529 => 0.0530, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.38% (0.0358 => 0.0328, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -27.45% (0.0051 => 0.0037, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -97.84% (36.1520 => 0.7815, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 3.33% (1.3168 => 1.3607, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.22% (3.0437 => 3.2636, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -0.13% (0.0756 => 0.0755, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.79% (2.4355 => 2.5277, std.dev.: 0.0186) MultiSource/Benchmarks/Bullet/bullet: 2.40% (57.3947 => 58.7749, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.96% (2.4292 => 2.4767, std.dev.: 0.0038) MultiSource/Applications/ClamAV/clamscan: 1.09% (26.0991 => 26.3831, std.dev.: 0.0312) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/himenobmtxpa: 1.73% (3.6523 => 3.7154, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1.31% (2.6639 => 2.6989, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.29% (3.2586 => 3.1189, std.dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.84% (81.0752 => 78.7751, std.dev.: 0.5400) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: 5.41% (0.1332 => 0.1404, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -10.25% (0.0722 => 0.0648, std.dev.: 0.0045) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 199.02% (0.5229 => 1.5636, std.dev.: 0.0048) MultiSource/Applications/SPASS/SPASS: 13.89% (14.9895 => 17.0720, std.dev.: 0.0209) MultiSource/Applications/kimwitu++/kc: 36.74% (14.1553 => 19.3554, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/gs/gs: 12.44% (4.1105 => 4.6219, std.dev.: 0.0242) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 29.45% (1.1048 => 1.4302, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 307.62% (7.1582 => 29.1783, std.dev.: 0.0148) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.96% (3.4629 => 5.8510, std.dev.: 0.0123) SingleSource/Benchmarks/Misc-C++/stepanov_container: 64.05% (0.6222 => 1.0207, std.dev.: 0.0010) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10598.33% (0.0720 => 7.7028, std.dev.: 0.0062) MultiSource/Applications/SIBsim4/SIBsim4: 3836300.00% (0.0001 => 3.8364, std.dev.: 0.0037) MultiSource/Applications/SPASS/SPASS: 11190900.00% (0.0001 => 11.1910, std.dev.: 0.0120) MultiSource/Applications/kimwitu++/kc: 51000.00% (0.0001 => 0.0511, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 63800.00% (0.0001 => 0.0639, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 781400.00% (0.0001 => 0.7815, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050400.00% (0.0001 => 10.0505, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5491200.00% (0.0001 => 5.4913, std.dev.: 0.0022) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 38.64% (0.1056 => 0.1464, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 29.96% (0.1432 => 0.1861, std.dev.: 0.0004) SingleSource/UnitTests/vla: 29.30% (0.0355 => 0.0459, std.dev.: 0.0013) MultiSource/Benchmarks/llubenchmark/llu: 22.94% (0.0462 => 0.0568, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.43% (0.1566 => 0.1886, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 19.45% (0.0730 => 0.0872, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 18.97% (22.1758 => 26.3831, std.dev.: 0.0312) SingleSource/UnitTests/SignlessTypes/rem: 17.92% (0.1144 => 0.1349, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 17.53% (0.1175 => 0.1381, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.34% (0.0871 => 0.1022) SingleSource/Benchmarks/BenchmarkGame/n-body: 17.29% (0.0746 => 0.0875, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.15% (0.0793 => 0.0929, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 16.95% (0.4879 => 0.5706, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 16.68% (0.3177 => 0.3707, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: 16.21% (0.2554 => 0.2968, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.19% (0.8172 => 0.9495, std.dev.: 0.0093) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 15.78% (0.1584 => 0.1834, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.32% (0.0842 => 0.0971, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/mst/mst: 15.13% (0.1163 => 0.1339, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 14.87% (0.1695 => 0.1947, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 14.62% (0.7115 => 0.8155, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.56% (0.0886 => 0.1015, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 14.50% (0.5105 => 0.5845, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.43% (0.2065 => 0.2363, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/chomp: 14.38% (0.1655 => 0.1893, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.30% (0.2700 => 0.3086, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.27% (0.0834 => 0.0953, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 14.22% (0.1125 => 0.1285, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.16% (0.0770 => 0.0879, std.dev.: 0.0020) MultiSource/Applications/viterbi/viterbi: 14.08% (0.1555 => 0.1774, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.06% (0.1117 => 0.1274, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.04% (0.1510 => 0.1722, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 13.90% (0.1151 => 0.1311, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.89% (0.2758 => 0.3141, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/ft/ft: 13.87% (0.1940 => 0.2209, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.76% (0.1337 => 0.1521, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.76% (0.5981 => 0.6804, std.dev.: 0.0034) MultiSource/Applications/sgefa/sgefa: 13.67% (0.3109 => 0.3534, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 13.58% (3.3354 => 3.7883, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.57% (0.2107 => 0.2393, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.47% (0.2271 => 0.2577, std.dev.: 0.0036) MultiSource/Applications/spiff/spiff: 13.40% (0.7835 => 0.8885, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.39% (0.6675 => 0.7569, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.38% (0.0770 => 0.0873, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 13.28% (1.1642 => 1.3188, std.dev.: 0.0097) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.28% (0.1062 => 0.1203, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.22% (0.9765 => 1.1056, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.22% (0.1029 => 0.1165, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.16% (0.0798 => 0.0903, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.14% (0.2603 => 0.2945, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.00% (0.5860 => 0.6622, std.dev.: 0.0040) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.98% (0.3121 => 0.3526, std.dev.: 0.0073) MultiSource/Applications/lambda-0_1_3/lambda: 12.97% (0.7433 => 0.8397, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.96% (0.4615 => 0.5213, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.82% (1.5415 => 1.7391, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.77% (0.5020 => 0.5661, std.dev.: 0.0021) MultiSource/Applications/treecc/treecc: 12.71% (2.0273 => 2.2849, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.59% (0.5569 => 0.6270, std.dev.: 0.0052) SingleSource/Benchmarks/McGill/exptree: 12.53% (0.0814 => 0.0916, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.50% (0.1032 => 0.1161, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.46% (2.2022 => 2.4767, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.42% (0.3543 => 0.3983, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.41% (1.3050 => 1.4669, std.dev.: 0.0020) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.34% (0.1143 => 0.1284, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 12.20% (1.0722 => 1.2030, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/health/health: 12.15% (0.1268 => 0.1422, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.04% (1.1861 => 1.3289, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.04% (0.3307 => 0.3705, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 11.98% (3.8723 => 4.3363, std.dev.: 0.0169) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.97% (0.1236 => 0.1384, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.95% (0.3473 => 0.3888, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.92% (0.3927 => 0.4395, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.92% (0.3441 => 0.3851, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/18-imp/imp: 11.74% (0.3423 => 0.3825, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-4: 11.74% (0.3543 => 0.3959, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 11.74% (0.3561 => 0.3979, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 11.72% (0.3497 => 0.3907, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.72% (0.3516 => 0.3928, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.71% (0.6450 => 0.7205, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/exceptions: 11.65% (0.3828 => 0.4274, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.53% (0.3694 => 0.4120, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 11.49% (8.1363 => 9.0708, std.dev.: 0.0141) MultiSource/Benchmarks/McCat/05-eks/eks: 11.42% (0.4299 => 0.4790, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/neural/neural: 11.41% (0.1463 => 0.1630, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.40% (0.3886 => 0.4329, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 11.32% (0.8921 => 0.9931, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.26% (4.2646 => 4.7450, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.26% (0.1625 => 0.1808, std.dev.: 0.0024) MultiSource/Benchmarks/sim/sim: 11.22% (0.3387 => 0.3767, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.19% (0.0929 => 0.1033) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.09% (0.1695 => 0.1883, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.98% (1.5859 => 1.7600, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 10.94% (0.3180 => 0.3528, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 10.92% (1.1840 => 1.3133, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/life/life: 10.83% (0.0933 => 0.1034, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 10.81% (9.4845 => 10.5099, std.dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.81% (0.1906 => 0.2112, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.68% (0.8101 => 0.8966, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.53% (2.2024 => 2.4344, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 10.52% (0.6456 => 0.7135, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.36% (14.3668 => 15.8545, std.dev.: 0.0025) MultiSource/Applications/siod/siod: 10.31% (2.2969 => 2.5338, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.25% (0.1044 => 0.1151, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 10.17% (0.4289 => 0.4725, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.94% (0.3865 => 0.4249, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 9.94% (0.4620 => 0.5079, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.78% (1.4186 => 1.5574, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.66% (0.4203 => 0.4609, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 9.56% (0.3422 => 0.3749, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.51% (0.1892 => 0.2072, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.47% (0.5925 => 0.6486, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference-object: 9.32% (0.6030 => 0.6592, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.24% (0.4103 => 0.4482, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.17% (0.1330 => 0.1452, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 9.08% (0.3603 => 0.3930, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.06% (5.0018 => 5.4552, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/moments: 9.04% (0.4048 => 0.4414, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.98% (4.9449 => 5.3890, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/lists1: 8.90% (0.3684 => 0.4012, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.71% (0.4636 => 0.5040, std.dev.: 0.0034) MultiSource/Applications/hbd/hbd: 8.71% (1.5603 => 1.6962, std.dev.: 0.0106) SingleSource/UnitTests/ObjC++/property-reference: 8.63% (0.7326 => 0.7958, std.dev.: 0.0049) SingleSource/Benchmarks/Stanford/Puzzle: 8.52% (0.1268 => 0.1376, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.29% (0.3427 => 0.3711, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.23% (0.2430 => 0.2630, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.16% (0.3650 => 0.3948, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.06% (0.2793 => 0.3018, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 8.02% (0.2831 => 0.3058, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.00% (0.3826 => 0.4132, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.99% (0.2891 => 0.3122, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 7.91% (5.7591 => 6.2149, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 7.84% (17.1811 => 18.5280, std.dev.: 0.0180) SingleSource/Regression/C++/ofstream_ctor: 7.81% (0.2905 => 0.3132, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 7.80% (0.3283 => 0.3539, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.72% (0.3162 => 0.3406, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 7.70% (0.3232 => 0.3481, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.63% (0.4064 => 0.4374, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 7.62% (0.3098 => 0.3334, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 7.60% (0.2725 => 0.2932, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.56% (2.0665 => 2.2227, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.55% (0.2756 => 0.2964, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 7.45% (0.2871 => 0.3085, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 7.40% (0.3052 => 0.3278, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 7.37% (0.2714 => 0.2914, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 7.30% (0.2877 => 0.3087, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.28% (0.2872 => 0.3081, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 7.21% (0.2802 => 0.3004, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 6.89% (0.3282 => 0.3508, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 6.81% (1.2842 => 1.3717, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary2: 6.51% (0.3379 => 0.3599, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.47% (0.3136 => 0.3339, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.46% (3.8922 => 4.1435, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.35% (0.2266 => 0.2410, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 6.31% (0.3092 => 0.3287, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.15% (0.8067 => 0.8563, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/objinst: 5.30% (0.3131 => 0.3297, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.17% (0.3817 => 0.3976, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.89% (0.3935 => 0.4088, std.dev.: 0.0059) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.81% (7.9617 => 8.1851, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.86% (7.0540 => 7.1849, std.dev.: 0.0218) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 19.81% (2.8904 => 3.4629, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.55% (1.1145 => 1.2990, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.75% (0.2944 => 0.3290, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: 9.96% (1.1396 => 1.2531, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (3.1578 => 3.3680, std.dev.: 0.0025) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.66% (4.2280 => 4.3404, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7655, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.09% (3.6395 => 3.7154, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bisort/bisort: 1.76% (0.8333 => 0.8480, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2078, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7986, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.93% (6.6874 => 0.1386, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: -76.19% (0.8651 => 0.2060, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.22% (5.3855 => 2.4118, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -55.02% (5.3526 => 2.4077, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/richards_benchmark: -45.68% (0.1622 => 0.0881, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.89% (5.2763 => 3.1189, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -38.50% (1.1194 => 0.6884, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -24.08% (1.7609 => 1.3368, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.98% (2.9384 => 2.5277, std.dev.: 0.0186) MultiSource/Applications/JM/ldecod/ldecod: -9.87% (10.4361 => 9.4058, std.dev.: 0.0124) SingleSource/UnitTests/Vector/constpool: -9.02% (54.1659 => 49.2799, std.dev.: 0.0297) MultiSource/Benchmarks/Bullet/bullet: -7.07% (63.2438 => 58.7749, std.dev.: 0.0061) MultiSource/Benchmarks/PAQ8p/paq8p: -3.38% (10.3673 => 10.0165, std.dev.: 0.0051) MultiSource/Applications/JM/lencod/lencod: -2.18% (21.9371 => 21.4580, std.dev.: 0.0409) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -35.18% (0.0506 => 0.0328, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -35.16% (0.3987 => 0.2585, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -33.52% (1.1492 => 0.7640, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -28.74% (10.7105 => 7.6321, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-6: -16.19% (1.6925 => 1.4184, std.dev.: 0.0064) MultiSource/Benchmarks/NPB-serial/is/is: -10.99% (9.5636 => 8.5122, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -10.91% (1.5373 => 1.3696, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.31% (19.9488 => 18.2913, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/mason/mason: -7.87% (0.2161 => 0.1991, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.13% (1.8329 => 1.7023, std.dev.: 0.0189) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -6.58% (1.2373 => 1.1559, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.59% (1.9577 => 1.8483, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.08% (1.6805 => 1.5951, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: -5.04% (1.5835 => 1.5037, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/oourafft: -5.01% (6.6465 => 6.3132, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.60% (1.5660 => 1.4940, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.41% (0.9957 => 0.9518, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.04% (0.2497 => 0.2396, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -3.78% (4.5009 => 4.3309, std.dev.: 0.0019) MultiSource/Applications/siod/siod: -3.66% (3.2827 => 3.1627, std.dev.: 0.0082) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.54% (32.5116 => 31.3609, std.dev.: 0.0099) MultiSource/Benchmarks/sim/sim: -3.23% (5.0483 => 4.8850, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: -2.73% (4.6441 => 4.5172, std.dev.: 0.0052) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.58% (0.4808 => 0.4684, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/Olden/power/power: -2.14% (1.1277 => 1.1036, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -1.91% (10.2830 => 10.0869, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.89% (8.1563 => 8.0021, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: -1.69% (8.8334 => 8.6840, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5141, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: -1.28% (85.0658 => 83.9762, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0554 => 1.0442, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.04% (6.2999 => 6.2344, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8588, std.dev.: 0.0041) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -5.45% (0.1485 => 0.1404, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0045) Report Time: 2.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 11:00:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 13:00:25 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121031180025.7802A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5453?compare_to=5450&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5453, Order: 167130, Start Time: 2012-10-31 16:31:45, End Time: 2012-10-31 18:00:27 To: 5450, Order: 167116, Start Time: 2012-10-31 14:46:04, End Time: 2012-10-31 16:14:35 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 25 (108 on baseline) Performance Improvements: 2 (4 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 964 (862 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.60% (0.2107 => 0.2246, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.78% (0.3279 => 0.3403, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.23% (0.9277 => 0.9484, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.15% (0.8260 => 0.8438, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.95% (0.8585 => 0.8752, std.dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: 1.88% (8.3645 => 8.5214, std.dev.: 0.0459) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.86% (0.8809 => 0.8973, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.75% (0.8459 => 0.8607, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.73% (0.8374 => 0.8519, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.72% (1.0180 => 1.0355, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.66% (0.8198 => 0.8334, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.54% (0.8965 => 0.9103, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.52% (0.9321 => 0.9463, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.45% (0.8494 => 0.8617, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.44% (0.8907 => 0.9035, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.40% (0.8711 => 0.8833, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.35% (0.8565 => 0.8681, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.35% (0.8523 => 0.8638, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.28% (0.8877 => 0.8991, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.28% (0.8753 => 0.8865, std.dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 8.89% (0.1969 => 0.2144, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.59% (5.1741 => 5.3079, std.dev.: 0.0139) MultiSource/Benchmarks/llubenchmark/llu: 2.30% (1.9952 => 2.0410, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.90% (2.5607 => 2.6094, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/pi: 1.65% (2.4714 => 2.5121, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/05-eks/eks: -2.79% (0.4731 => 0.4599, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/JM/lencod/lencod: -1.08% (6.7495 => 6.6769, std.dev.: 0.0186) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -1.17% (16.9351 => 16.7371, std.dev.: 0.2951) MultiSource/Applications/obsequi/Obsequi: 2.14% (1.0615 => 1.0842, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.83% (22.3476 => 21.7147, std.dev.: 0.4428) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.52% (0.3668 => 0.3649, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 0.76% (0.6086 => 0.6132, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.71% (0.3368 => 0.3344, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 1.15% (0.2002 => 0.2025, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.85% (0.0216 => 0.0220, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.40% (0.0428 => 0.0422, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.30% (0.0331 => 0.0332, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.96% (0.0313 => 0.0310, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.24% (0.0425 => 0.0426, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0202 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 0.46% (0.0217 => 0.0218, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.83% (0.1441 => 0.1453, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.59% (1.1548 => 1.1480, std.dev.: 0.0131) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.07% (0.1517 => 0.1516, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.41% (0.4194 => 0.4009, std.dev.: 0.0306) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.21% (0.1322 => 0.1338, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.04% (0.0643 => 0.0617, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.25% (0.0277 => 0.0268, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.64% (0.0550 => 0.0559, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.25% (1.1443 => 1.1472, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -69.23% (0.0026 => 0.0008, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.15% (0.0652 => 0.0653, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.41% (0.0266 => 0.0233, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.91% (0.8022 => 0.7949, std.dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 100.00% (0.0001 => 0.0002, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 52.50% (0.0040 => 0.0061, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2344.38% (0.6332 => 15.4778, std.dev.: 0.3133) MultiSource/Benchmarks/McCat/08-main/main: 48.44% (0.1831 => 0.2718, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.77% (0.1559 => 0.1469, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1507.39% (0.3344 => 5.3751, std.dev.: 0.0476) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.16% (0.2364 => 0.3266, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel: 3.73% (0.0429 => 0.0445, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.89% (0.0224 => 0.0222, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: -31.74% (0.0230 => 0.0157, std.dev.: 0.0008) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4368, std.dev.: 0.0112) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0727, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4944, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3490, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0343, std.dev.: 0.0307) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4080, std.dev.: 0.0014) SingleSource/Regression/C/uint64_to_float: -24.33% (2.1832 => 1.6520, std.dev.: 0.0044) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0002, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 41.10% (14.7684 => 20.8381, std.dev.: 0.1957) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.78% (0.0810 => 0.0954, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.06% (0.0830 => 0.0955, std.dev.: 0.0008) SingleSource/UnitTests/SignlessTypes/rem: 14.69% (0.1035 => 0.1187, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.26% (0.1983 => 0.2246, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.03% (0.1137 => 0.1251, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.00% (0.2180 => 0.2398, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.87% (0.8321 => 0.9059, std.dev.: 0.0123) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.48% (0.3137 => 0.3403, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.46% (0.1466 => 0.1590, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.21% (0.1425 => 0.1542, std.dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 7.87% (1.2568 => 1.3557, std.dev.: 0.0114) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.64% (6.6074 => 7.1123, std.dev.: 0.0189) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.62% (0.8148 => 0.8769, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.59% (0.2279 => 0.2452, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/health/health: 7.42% (0.1347 => 0.1447, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.27% (0.2998 => 0.3216, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 7.09% (0.1905 => 0.2040, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.93% (0.7473 => 0.7991, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.84% (0.6287 => 0.6717, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.82% (13.1811 => 14.0799, std.dev.: 0.0196) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.81% (0.4847 => 0.5177, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.27% (0.2519 => 0.2677, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.21% (0.1885 => 0.2002, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.12% (0.2240 => 0.2377, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.09% (0.2741 => 0.2908, std.dev.: 0.0027) MultiSource/Applications/treecc/treecc: 6.08% (1.9948 => 2.1160, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/em3d/em3d: 5.98% (0.1721 => 0.1824, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 5.85% (1.1271 => 1.1930, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.83% (1.1685 => 1.2366, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: 5.81% (0.6834 => 0.7231, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.80% (1.6386 => 1.7337, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.78% (0.6227 => 0.6587, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.38% (1.1606 => 1.2230, std.dev.: 0.0062) MultiSource/Applications/spiff/spiff: 5.37% (0.7950 => 0.8377, std.dev.: 0.0091) MultiSource/Applications/sgefa/sgefa: 5.34% (0.2999 => 0.3159, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.02% (0.5961 => 0.6260, std.dev.: 0.0049) MultiSource/Applications/hbd/hbd: 4.93% (1.4269 => 1.4973, std.dev.: 0.0157) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.88% (0.2378 => 0.2494, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.77% (0.4783 => 0.5011, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 4.67% (0.8697 => 0.9103, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.65% (0.9056 => 0.9477, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 4.63% (8.6476 => 9.0484, std.dev.: 0.1359) MultiSource/Benchmarks/McCat/05-eks/eks: 4.59% (0.4397 => 0.4599, std.dev.: 0.0045) MultiSource/Applications/d/make_dparser: 4.58% (3.2366 => 3.3849, std.dev.: 0.0386) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 4.58% (0.9069 => 0.9484, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.51% (0.9908 => 1.0355, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 4.45% (0.8457 => 0.8833, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 4.41% (0.8611 => 0.8991, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.41% (0.4127 => 0.4309, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 4.40% (0.8007 => 0.8359, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 4.38% (0.8317 => 0.8681, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 4.37% (0.8597 => 0.8973, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.35% (0.8086 => 0.8438, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.34% (0.4559 => 0.4757, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.29% (0.9074 => 0.9463, std.dev.: 0.0026) MultiSource/Applications/lua/lua: 4.10% (3.8189 => 3.9753, std.dev.: 0.0416) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 4.07% (0.8518 => 0.8865, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 4.06% (0.3226 => 0.3357, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 4.05% (14.2605 => 14.8379, std.dev.: 0.1306) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.03% (0.9688 => 1.0078, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.99% (0.8286 => 0.8617, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.94% (0.8420 => 0.8752, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 3.91% (0.8885 => 0.9232, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 3.84% (0.8204 => 0.8519, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.79% (0.8712 => 0.9042, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 3.75% (0.9039 => 0.9378, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 3.75% (0.8855 => 0.9187, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.66% (0.8716 => 0.9035, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.64% (4.1763 => 4.3283, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.60% (0.8338 => 0.8638, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.58% (0.5817 => 0.6025, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.55% (0.8048 => 0.8334, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.53% (0.3115 => 0.3225, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.53% (0.8340 => 0.8634, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.50% (0.8316 => 0.8607, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.44% (1.2602 => 1.3036, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 3.43% (0.8069 => 0.8346, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.43% (0.6586 => 0.6812, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 3.43% (0.8805 => 0.9107, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 3.40% (0.8331 => 0.8614, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.35% (4.4880 => 4.6385, std.dev.: 0.0288) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.28% (0.7966 => 0.8227, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.10% (0.8261 => 0.8517, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.06% (0.8177 => 0.8427, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.99% (0.8066 => 0.8307, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.98% (4.4873 => 4.6208, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.88% (0.8656 => 0.8905, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.87% (1.4479 => 1.4895, std.dev.: 0.0116) MultiSource/Benchmarks/mafft/pairlocalalign: 2.80% (8.6247 => 8.8659, std.dev.: 0.0558) MultiSource/Applications/oggenc/oggenc: 2.77% (4.9628 => 5.1002, std.dev.: 0.0496) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.75% (1.2526 => 1.2871, std.dev.: 0.0086) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.70% (0.8995 => 0.9238, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/hash: 2.63% (0.3800 => 0.3900, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.26% (4.5702 => 4.6733, std.dev.: 0.0316) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.67% (1.2423 => 1.2631, std.dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 59.04% (1.5795 => 2.5121, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.39% (2.7978 => 3.7321, std.dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.43% (2.4333 => 2.6870, std.dev.: 0.0137) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.08% (1.1857 => 1.2815, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/nestedloop: 5.98% (0.2023 => 0.2144, std.dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: 5.94% (63.1822 => 66.9340, std.dev.: 0.0452) MultiSource/Benchmarks/FreeBench/distray/distray: 4.23% (0.2390 => 0.2491, std.dev.: 0.0021) MultiSource/Applications/siod/siod: 2.80% (3.6643 => 3.7669, std.dev.: 0.0105) MultiSource/Benchmarks/llubenchmark/llu: 2.22% (1.9967 => 2.0410, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/ReedSolomon: 1.78% (8.5322 => 8.6839, std.dev.: 0.0491) SingleSource/Benchmarks/Shootout-C++/hash: 1.74% (0.6205 => 0.6313, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: 1.64% (2.3560 => 2.3947, std.dev.: 0.0134) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.04% (0.3269 => 0.3039, std.dev.: 0.0001) MultiSource/Applications/lua/lua: -5.26% (29.8330 => 28.2644, std.dev.: 0.2617) SingleSource/Benchmarks/Shootout-C++/hash2: -1.39% (3.4237 => 3.3761, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.26% (3.3479 => 3.3058, std.dev.: 0.0036) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.77% (16.4461 => 16.7371, std.dev.: 0.2951) MultiSource/Applications/obsequi/Obsequi: 5.65% (1.0262 => 1.0842, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6853.15% (0.3123 => 21.7147, std.dev.: 0.4428) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.15% (0.2463 => 0.3649, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 2.03% (0.6010 => 0.6132, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.39% (0.3266 => 0.3344, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 2.84% (0.1969 => 0.2025, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.86% (0.0123 => 0.0220, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.43% (0.0408 => 0.0422, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.71% (0.0254 => 0.0332, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.65% (0.0302 => 0.0310, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.94% (0.0384 => 0.0426, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.04% (0.1438 => 0.1453, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.33% (1.1329 => 1.1480, std.dev.: 0.0131) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.69% (0.1462 => 0.1516, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.72% (0.4164 => 0.4009, std.dev.: 0.0306) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.26% (0.1369 => 0.1338, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.74% (0.0641 => 0.0617, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 37.44% (0.0195 => 0.0268, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.29% (0.0578 => 0.0559, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.31% (1.1437 => 1.1472, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -42.86% (0.0014 => 0.0008, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.15% (0.0627 => 0.0653, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 29.44% (0.0180 => 0.0233, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.85% (0.8017 => 0.7949, std.dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 100.00% (0.0001 => 0.0002, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -1.61% (0.0062 => 0.0061, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 11:19:24 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 13:19:24 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121031181924.B0EB12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5454?compare_to=5451&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5454, Order: 167134, Start Time: 2012-10-31 16:54:04, End Time: 2012-10-31 18:19:25 To: 5451, Order: 167116, Start Time: 2012-10-31 15:03:16, End Time: 2012-10-31 16:28:32 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 4 (6 on baseline) Performance Improvements: 0 (172 on baseline) Unchanged Tests: 1038 (864 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.24% (20.0445 => 20.2939, std.dev.: 0.0573) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.10% (2.1443 => 2.1678, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: 1.04% (2.3171 => 2.3413, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: 1.26% (3.6847 => 3.7310, std.dev.: 0.0100) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 24.70% (15.2527 => 19.0200, std.dev.: 0.0139) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.29% (1.2783 => 1.3715, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.15% (3.1919 => 3.4200, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.73% (2.0478 => 2.1037, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/salsa20: 2.31% (7.4937 => 7.6671, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/hash2: 2.10% (3.1932 => 3.2603, std.dev.: 0.0099) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.67% (0.1431 => 0.1307) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.72% (0.3821 => 0.3526, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.64% (0.1584 => 0.1463, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.46% (0.3142 => 0.2939, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -6.32% (0.3831 => 0.3589, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -6.29% (0.3880 => 0.3636, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.26% (0.3884 => 0.3641, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -6.24% (0.3812 => 0.3574, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.19% (0.3896 => 0.3655, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.17% (0.3891 => 0.3651, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.14% (0.2428 => 0.2279, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: -6.13% (0.3848 => 0.3612, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.12% (0.4033 => 0.3786, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -6.06% (2.4924 => 2.3413, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/exceptions: -6.03% (0.4176 => 0.3924, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -5.83% (0.4199 => 0.3954, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.77% (0.2355 => 0.2219, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.75% (0.6484 => 0.6111, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -5.74% (0.2160 => 0.2036, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.64% (0.7198 => 0.6792, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.60% (22.4056 => 21.1498, std.dev.: 0.0175) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.59% (0.9542 => 0.9009, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: -5.56% (0.4280 => 0.4042, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.53% (0.3057 => 0.2888, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.52% (0.3658 => 0.3456, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: -5.51% (0.2849 => 0.2692, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -5.48% (0.1879 => 0.1776, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -5.48% (0.3194 => 0.3019, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.48% (0.2903 => 0.2744, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.47% (0.3252 => 0.3074, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.47% (0.3016 => 0.2851, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.47% (2.1713 => 2.0526, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: -5.45% (0.2989 => 0.2826, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -5.45% (0.3026 => 0.2861, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.45% (0.3837 => 0.3628, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/random: -5.44% (0.2939 => 0.2779, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -5.44% (0.3255 => 0.3078, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.42% (0.3323 => 0.3143, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -5.37% (0.3205 => 0.3033, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.35% (0.9852 => 0.9325, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.35% (0.4151 => 0.3929, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -5.33% (0.2871 => 0.2718, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -5.33% (16.1920 => 15.3294, std.dev.: 0.0181) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.32% (0.4813 => 0.4557, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: -5.31% (0.3481 => 0.3296, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: -5.30% (0.3394 => 0.3214, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -5.30% (1.3148 => 1.2451, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: -5.29% (7.0961 => 6.7207, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/ary3: -5.28% (0.3446 => 0.3264, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.27% (4.5069 => 4.2696, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.25% (0.3849 => 0.3647, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: -5.25% (0.4861 => 0.4606, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.24% (3.5339 => 3.3486, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.23% (4.8161 => 4.5641, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists: -5.19% (0.3621 => 0.3433, std.dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: -5.18% (0.3357 => 0.3183, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.17% (0.4083 => 0.3872, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.14% (4.8802 => 4.6294, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.12% (1.0544 => 1.0004, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.07% (1.2784 => 1.2136, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.07% (0.5999 => 0.5695, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: -5.04% (0.2659 => 0.2525, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.04% (0.3931 => 0.3733, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.03% (5.4682 => 5.1929, std.dev.: 0.0093) SingleSource/Regression/C++/ofstream_ctor: -5.03% (0.3059 => 0.2905, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -5.03% (1.2515 => 1.1886, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: -4.97% (0.3867 => 0.3675, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -4.96% (0.3788 => 0.3600, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.94% (4.0323 => 3.8330, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.88% (0.4427 => 0.4211, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -4.87% (0.4248 => 0.4041, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.87% (0.8521 => 0.8106, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.86% (0.4321 => 0.4111, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/bigfib: -4.80% (0.6750 => 0.6426, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -4.79% (34.0927 => 32.4592, std.dev.: 0.0138) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.77% (1.2210 => 1.1627, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.77% (1.6474 => 1.5688, std.dev.: 0.0053) MultiSource/Benchmarks/MallocBench/gs/gs: -4.75% (4.3330 => 4.1273, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.74% (0.6293 => 0.5995, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.71% (1.2221 => 1.1645, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.67% (0.2933 => 0.2796, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.61% (0.2278 => 0.2173, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: -4.60% (9.2283 => 8.8034, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.60% (0.7919 => 0.7555, std.dev.: 0.0012) MultiSource/Applications/siod/siod: -4.59% (2.4021 => 2.2918, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.53% (0.5478 => 0.5230, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.47% (0.2548 => 0.2434, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.47% (0.5863 => 0.5601, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.47% (1.3722 => 1.3109, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -4.44% (1.6364 => 1.5637, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.43% (1.4642 => 1.3993, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.40% (0.2999 => 0.2867, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.40% (0.6052 => 0.5786, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.39% (0.5859 => 0.5602, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -4.35% (4.0594 => 3.8828, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.34% (0.5925 => 0.5668, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.33% (0.5705 => 0.5458, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.33% (0.3491 => 0.3340, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: -4.32% (0.2985 => 0.2856, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: -4.32% (0.7779 => 0.7443, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.29% (0.5857 => 0.5606, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.28% (0.6304 => 0.6034, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.27% (0.5591 => 0.5352, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.27% (0.5805 => 0.5557, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.27% (0.6681 => 0.6396, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.25% (0.5570 => 0.5333, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.25% (0.7339 => 0.7027, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.25% (0.6194 => 0.5931, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.24% (0.5802 => 0.5556, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.23% (0.6260 => 0.5995, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.22% (0.6660 => 0.6379, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.20% (0.5575 => 0.5341, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.19% (0.3319 => 0.3180, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.17% (0.5581 => 0.5348, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.17% (0.6189 => 0.5931, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.15% (0.5849 => 0.5606, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.15% (0.5567 => 0.5336, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.15% (0.6676 => 0.6399, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.14% (0.5456 => 0.5230, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -4.13% (0.4524 => 0.4337, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.13% (0.5688 => 0.5453, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.11% (0.6667 => 0.6393, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.10% (0.6440 => 0.6176, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.09% (0.4916 => 0.4715, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.06% (0.6033 => 0.5788, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.05% (0.9557 => 0.9170, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.02% (2.2587 => 2.1678, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: -3.99% (18.2933 => 17.5627, std.dev.: 0.0099) MultiSource/Benchmarks/McCat/18-imp/imp: -3.99% (0.3581 => 0.3438, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.99% (0.6446 => 0.6189, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -3.98% (0.7982 => 0.7664, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.97% (0.7524 => 0.7225, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.97% (0.5941 => 0.5705, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -3.97% (0.6347 => 0.6095, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -3.95% (0.6297 => 0.6048, std.dev.: 0.0044) SingleSource/UnitTests/ObjC++/property-reference-object: -3.94% (0.6441 => 0.6187, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: -3.88% (0.4515 => 0.4340, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: -3.87% (0.9179 => 0.8824, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.85% (0.6395 => 0.6149, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -3.79% (0.5569 => 0.5358, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.68% (0.9077 => 0.8743, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -3.61% (8.0126 => 7.7230, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: -3.59% (1.1450 => 1.1039, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: -3.57% (0.7447 => 0.7181, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.55% (0.7021 => 0.6772, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: -3.49% (1.5610 => 1.5065, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: -3.46% (0.8418 => 0.8127, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: -3.40% (5.0226 => 4.8517, std.dev.: 0.0150) MultiSource/Applications/sqlite3/sqlite3: -3.40% (17.1032 => 16.5216, std.dev.: 0.0197) MultiSource/Benchmarks/sim/sim: -3.38% (0.3406 => 0.3291, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: -3.37% (15.5079 => 14.9854, std.dev.: 0.0080) MultiSource/Applications/d/make_dparser: -3.21% (3.5154 => 3.4026, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/09-vor/vor: -3.15% (0.3271 => 0.3168, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.13% (0.3483 => 0.3374, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.08% (0.5168 => 0.5009, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.01% (0.6736 => 0.6533, std.dev.: 0.0068) MultiSource/Benchmarks/nbench/nbench: -2.98% (1.1530 => 1.1186, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.98% (1.2300 => 1.1934, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: -2.96% (2.1401 => 2.0768, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.78% (6.7716 => 6.5836, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.57% (0.5329 => 0.5192, std.dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -2.31% (20.7746 => 20.2939, std.dev.: 0.0573) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.18% (14.2083 => 13.8984, std.dev.: 0.0063) MultiSource/Applications/SIBsim4/SIBsim4: -1.34% (1.3864 => 1.3678, std.dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7556, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: -8.74% (1.2842 => 1.1719, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: -3.96% (2.2633 => 2.1737, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.67% (6.5735 => 6.4635, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0002) Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 12:45:01 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 14:45:01 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121031194501.A47A12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5455?compare_to=5453&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5455, Order: 167146, Start Time: 2012-10-31 18:17:37, End Time: 2012-10-31 19:45:00 To: 5453, Order: 167130, Start Time: 2012-10-31 16:31:45, End Time: 2012-10-31 18:00:27 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 4 (89 on baseline) Performance Improvements: 23 (4 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 964 (881 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.32% (2.3818 => 2.5800, std.dev.: 0.0335) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 5.31% (1.7983 => 1.8937, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/ReedSolomon: 1.05% (8.6839 => 8.7747, std.dev.: 0.0122) SingleSource/Regression/C/uint64_to_float: 1.02% (1.6520 => 1.6688, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -26.18% (20.8381 => 15.3826, std.dev.: 0.0593) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -4.85% (0.2246 => 0.2137, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.55% (14.0799 => 13.4390, std.dev.: 0.0832) MultiSource/Applications/SIBsim4/SIBsim4: -4.48% (1.3557 => 1.2949, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.85% (1.1934 => 1.1474, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.83% (7.1123 => 6.8399, std.dev.: 0.0332) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -3.05% (1.7337 => 1.6808, std.dev.: 0.0091) MultiSource/Applications/minisat/minisat: -2.67% (0.7231 => 0.7038, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -2.56% (0.8681 => 0.8459, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -2.43% (0.8438 => 0.8233, std.dev.: 0.0052) MultiSource/Applications/treecc/treecc: -2.33% (2.1160 => 2.0668, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -2.17% (1.0355 => 1.0130, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.99% (0.9484 => 0.9295, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.81% (9.0484 => 8.8850, std.dev.: 0.0353) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.61% (0.8865 => 0.8722, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.57% (0.9232 => 0.9087, std.dev.: 0.0045) MultiSource/Applications/d/make_dparser: -1.37% (3.3849 => 3.3386, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.36% (0.9042 => 0.8919, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.20% (0.9974 => 0.9854, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: -7.60% (0.2144 => 0.1981, std.dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: -2.03% (4.4368 => 4.3466, std.dev.: 0.0156) SingleSource/Benchmarks/Misc/himenobmtxpa: -1.42% (4.4054 => 4.3429, std.dev.: 0.0161) MultiSource/Benchmarks/llubenchmark/llu: -1.07% (2.0410 => 2.0192, std.dev.: 0.0058) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -0.60% (16.7371 => 16.6362, std.dev.: 0.2248) MultiSource/Applications/obsequi/Obsequi: -1.40% (1.0842 => 1.0690, std.dev.: 0.0053) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.07% (21.7147 => 21.7293, std.dev.: 0.0912) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.27% (0.3649 => 0.3639, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: -1.81% (0.6132 => 0.6021, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.99% (0.3344 => 0.3311, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: -1.28% (0.2025 => 0.1999, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -18.64% (0.0220 => 0.0179, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.71% (0.0422 => 0.0425, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -21.08% (0.0332 => 0.0262, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -18.39% (0.0310 => 0.0253, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.05% (0.0426 => 0.0413, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: -8.42% (0.0202 => 0.0185, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/test1: -3.21% (0.0218 => 0.0211, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.96% (0.1453 => 0.1439, std.dev.: 0.0033) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.10% (1.1480 => 1.1492, std.dev.: 0.0285) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -0.26% (0.1516 => 0.1512, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.35% (0.4009 => 0.4063, std.dev.: 0.0169) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: - (0.1338 => 0.1338, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.89% (0.0617 => 0.0641, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.61% (0.0268 => 0.0275, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 6.98% (0.0559 => 0.0598, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.06% (1.1472 => 1.1479, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -38.71% (0.0031 => 0.0019, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 237.50% (0.0008 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.92% (0.0653 => 0.0647, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 9.44% (0.0233 => 0.0255, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.50% (0.7949 => 0.8068, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: -50.00% (0.0002 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 6.56% (0.0061 => 0.0065, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2319.14% (0.6332 => 15.3180, std.dev.: 0.1199) MultiSource/Benchmarks/McCat/08-main/main: 46.48% (0.1831 => 0.2682, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.52% (0.1559 => 0.1473, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1477.72% (0.3344 => 5.2759, std.dev.: 0.1372) SingleSource/Benchmarks/Misc-C++/Large/ray: 35.96% (0.2364 => 0.3214, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: 3.03% (0.0429 => 0.0442, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -26.79% (0.0224 => 0.0164, std.dev.: 0.0034) SingleSource/UnitTests/byval-alignment: -32.61% (0.0230 => 0.0155, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3466, std.dev.: 0.0156) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0725, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4951, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3503, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0467, std.dev.: 0.0306) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4083, std.dev.: 0.0019) SingleSource/Regression/C/uint64_to_float: -23.56% (2.1832 => 1.6688, std.dev.: 0.0012) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.15% (0.0848 => 0.0951, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 11.87% (0.1112 => 0.1244, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.54% (0.2180 => 0.2388, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.77% (0.1983 => 0.2137, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.41% (0.7473 => 0.8027, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.56% (0.1905 => 0.2030, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.12% (0.8148 => 0.8647, std.dev.: 0.0108) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.96% (0.8321 => 0.8817, std.dev.: 0.0155) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.89% (0.1885 => 0.1996, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.74% (0.3137 => 0.3317, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.67% (0.6010 => 0.6351, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.47% (1.1606 => 1.2241, std.dev.: 0.0042) MultiSource/Applications/spiff/spiff: 5.31% (0.7950 => 0.8372, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.30% (0.2998 => 0.3157, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.00% (0.2240 => 0.2352, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.74% (0.2133 => 0.2234, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 4.56% (0.6287 => 0.6574, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.49% (1.3279 => 1.3875, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.44% (0.9435 => 0.9854, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.36% (0.3003 => 0.3134, std.dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 4.27% (1.1271 => 1.1752, std.dev.: 0.0129) MultiSource/Applications/ClamAV/clamscan: 4.16% (14.7684 => 15.3826, std.dev.: 0.0593) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.13% (0.3295 => 0.3431, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.82% (0.5961 => 0.6189, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.68% (0.2741 => 0.2842, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 3.61% (1.9948 => 2.0668, std.dev.: 0.0164) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.58% (1.1685 => 1.2103, std.dev.: 0.0121) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.57% (0.6227 => 0.6449, std.dev.: 0.0069) MultiSource/Applications/lua/lua: 3.52% (3.8189 => 3.9534, std.dev.: 0.0068) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.52% (6.6074 => 6.8399, std.dev.: 0.0332) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.51% (0.5191 => 0.5373, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.43% (0.8611 => 0.8906, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.31% (0.4559 => 0.4710, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash2: 3.25% (0.4125 => 0.4259, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.22% (0.4783 => 0.4937, std.dev.: 0.0057) MultiSource/Applications/hbd/hbd: 3.21% (1.4269 => 1.4727, std.dev.: 0.0147) MultiSource/Applications/d/make_dparser: 3.15% (3.2366 => 3.3386, std.dev.: 0.0166) MultiSource/Applications/SPASS/SPASS: 3.12% (14.2605 => 14.7050, std.dev.: 0.0831) MultiSource/Applications/SIBsim4/SIBsim4: 3.03% (1.2568 => 1.2949, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/05-eks/eks: 3.02% (0.4397 => 0.4530, std.dev.: 0.0044) MultiSource/Applications/minisat/minisat: 2.99% (0.6834 => 0.7038, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.92% (0.6586 => 0.6778, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.81% (0.8261 => 0.8493, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.80% (0.9074 => 0.9328, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.79% (4.1763 => 4.2929, std.dev.: 0.0346) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.78% (1.2602 => 1.2952, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.75% (8.6476 => 8.8850, std.dev.: 0.0353) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.73% (0.8069 => 0.8289, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.72% (1.1170 => 1.1474, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.72% (0.8204 => 0.8427, std.dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 2.71% (8.6247 => 8.8586, std.dev.: 0.0310) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.71% (0.8597 => 0.8830, std.dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.70% (1.5315 => 1.5729, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.62% (0.8927 => 0.9161, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.58% (0.8050 => 0.8258, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.58% (0.9039 => 0.9272, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.58% (1.6386 => 1.6808, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.49% (0.5817 => 0.5962, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.49% (0.9069 => 0.9295, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.39% (0.8518 => 0.8722, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 2.39% (4.1305 => 4.2292, std.dev.: 0.0294) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.38% (0.8712 => 0.8919, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.30% (0.7966 => 0.8149, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.27% (0.8885 => 0.9087, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.24% (0.9908 => 1.0130, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.22% (0.8656 => 0.8848, std.dev.: 0.0042) MultiSource/Applications/JM/lencod/lencod: 2.20% (15.3280 => 15.6645, std.dev.: 0.0666) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.08% (0.8855 => 0.9039, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.96% (13.1811 => 13.4390, std.dev.: 0.0832) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.91% (1.2526 => 1.2765, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.84% (4.4880 => 4.5706, std.dev.: 0.0280) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.82% (0.8086 => 0.8233, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.81% (4.5702 => 4.6528, std.dev.: 0.0237) MultiSource/Benchmarks/Bullet/bullet: 1.79% (31.8598 => 32.4295, std.dev.: 0.1768) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.71% (0.8317 => 0.8459, std.dev.: 0.0037) MultiSource/Applications/hexxagon/hexxagon: 1.28% (0.9810 => 0.9936, std.dev.: 0.0045) MultiSource/Benchmarks/PAQ8p/paq8p: 1.17% (2.3764 => 2.4041, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.78% (1.5795 => 2.5079, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.43% (2.7978 => 3.7331, std.dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.96% (2.4333 => 2.6756, std.dev.: 0.0397) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.85% (0.3186 => 0.3468, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.15% (1.1857 => 1.2705, std.dev.: 0.0113) MultiSource/Benchmarks/mafft/pairlocalalign: 5.91% (63.1822 => 66.9136, std.dev.: 0.1617) SingleSource/Benchmarks/Misc/ReedSolomon: 2.84% (8.5322 => 8.7747, std.dev.: 0.0122) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.56% (0.4031 => 0.4134, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 2.53% (3.6643 => 3.7569, std.dev.: 0.0077) MultiSource/Benchmarks/Olden/bh/bh: 1.75% (2.3560 => 2.3973, std.dev.: 0.0107) MultiSource/Benchmarks/llubenchmark/llu: 1.13% (1.9967 => 2.0192, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.07% (6.3772 => 6.4454, std.dev.: 0.0193) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.10% (0.3269 => 0.3037, std.dev.: 0.0008) MultiSource/Applications/lua/lua: -5.13% (29.8330 => 28.3032, std.dev.: 0.1393) SingleSource/Benchmarks/Shootout-C++/hash2: -1.39% (3.4237 => 3.3760, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.32% (3.3479 => 3.3037, std.dev.: 0.0056) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.16% (16.4461 => 16.6362, std.dev.: 0.2248) MultiSource/Applications/obsequi/Obsequi: 4.17% (1.0262 => 1.0690, std.dev.: 0.0053) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6857.83% (0.3123 => 21.7293, std.dev.: 0.0912) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.75% (0.2463 => 0.3639, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: 0.18% (0.6010 => 0.6021, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.38% (0.3266 => 0.3311, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 1.52% (0.1969 => 0.1999, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 45.53% (0.0123 => 0.0179, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.17% (0.0408 => 0.0425, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 3.15% (0.0254 => 0.0262, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -16.23% (0.0302 => 0.0253, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 7.55% (0.0384 => 0.0413, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: -2.63% (0.0190 => 0.0185, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/test1: 17.22% (0.0180 => 0.0211, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1438 => 0.1439, std.dev.: 0.0033) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.44% (1.1329 => 1.1492, std.dev.: 0.0285) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.42% (0.1462 => 0.1512, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.43% (0.4164 => 0.4063, std.dev.: 0.0169) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.26% (0.1369 => 0.1338, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: - (0.0641 => 0.0641, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.03% (0.0195 => 0.0275, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.46% (0.0578 => 0.0598, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.37% (1.1437 => 1.1479, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1800.00% (0.0001 => 0.0019, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.19% (0.0627 => 0.0647, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 41.67% (0.0180 => 0.0255, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.64% (0.8017 => 0.8068, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 4.84% (0.0062 => 0.0065, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 12:55:25 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 14:55:25 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121031195525.44E722A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5456?compare_to=5452&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5456, Order: 167146, Start Time: 2012-10-31 18:22:45, End Time: 2012-10-31 19:55:25 To: 5452, Order: 167130, Start Time: 2012-10-31 16:19:20, End Time: 2012-10-31 17:52:53 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 3 (172 on baseline) Performance Improvements: 19 (54 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 2 (2 on baseline) Unchanged Tests: 1018 (663 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.90% (78.7751 => 80.2738, std.dev.: 0.5514) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.57% (1.2909 => 1.3112, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/lowercase: 1.14% (7.9475 => 8.0379, std.dev.: 0.0093) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -19.08% (26.3831 => 21.3489, std.dev.: 0.0149) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.24% (0.3983 => 0.3854, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.98% (15.8545 => 15.3813, std.dev.: 0.0030) MultiSource/Applications/SIBsim4/SIBsim4: -2.87% (1.5636 => 1.5187, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: -2.75% (0.3888 => 0.3781, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -2.72% (0.3928 => 0.3821, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-4: -2.68% (0.3959 => 0.3853, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -2.64% (0.3976 => 0.3871, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -2.64% (0.3979 => 0.3874, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -2.64% (0.3907 => 0.3804, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -2.57% (0.4120 => 0.4014, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -2.52% (0.4329 => 0.4220, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.46% (8.1851 => 7.9836, std.dev.: 0.0071) SingleSource/UnitTests/ObjC/parameter-passing: -2.30% (0.4395 => 0.4294, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.20% (1.3289 => 1.2996, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: -1.30% (18.5280 => 18.2873, std.dev.: 0.0111) MultiSource/Applications/lemon/lemon: -1.11% (1.2030 => 1.1897, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.10% (9.0708 => 8.9709, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/football/football: -1.07% (0.9931 => 0.9825, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: - (0.1404 => 0.1404) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0648 => 0.0648, std.dev.: 0.0017) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 190.44% (0.5229 => 1.5187, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 13.14% (14.9895 => 16.9590, std.dev.: 0.0135) MultiSource/Applications/kimwitu++/kc: 35.99% (14.1553 => 19.2491, std.dev.: 0.0305) MultiSource/Benchmarks/MallocBench/gs/gs: 11.96% (4.1105 => 4.6023, std.dev.: 0.0129) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 29.12% (1.1048 => 1.4265, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 307.25% (7.1582 => 29.1516, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.50% (3.4629 => 5.8349, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: 63.03% (0.6222 => 1.0144, std.dev.: 0.0005) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10599.86% (0.0720 => 7.7039, std.dev.: 0.0043) MultiSource/Applications/SIBsim4/SIBsim4: 3836200.00% (0.0001 => 3.8363, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 11166500.00% (0.0001 => 11.1666, std.dev.: 0.0194) MultiSource/Applications/kimwitu++/kc: 50800.00% (0.0001 => 0.0509, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 782200.00% (0.0001 => 0.7823, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050300.00% (0.0001 => 10.0504, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5489800.00% (0.0001 => 5.4899, std.dev.: 0.0173) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 37.97% (0.1056 => 0.1457, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 29.68% (0.1432 => 0.1857, std.dev.: 0.0000) SingleSource/UnitTests/vla: 29.30% (0.0355 => 0.0459) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.18% (0.1566 => 0.1882, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 19.04% (0.0730 => 0.0869, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.15% (0.0793 => 0.0929, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 16.89% (0.0746 => 0.0872, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 16.85% (0.1175 => 0.1373, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 16.68% (0.4879 => 0.5693, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.53% (0.0871 => 0.1015, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 16.34% (0.3177 => 0.3696, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 16.01% (0.2554 => 0.2963, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.71% (0.0834 => 0.0965, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.60% (0.8172 => 0.9447, std.dev.: 0.0037) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 15.09% (0.1584 => 0.1823, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.73% (0.0842 => 0.0966, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 14.62% (0.1163 => 0.1333, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.58% (0.1029 => 0.1179, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 14.51% (0.1695 => 0.1941, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 14.38% (0.1655 => 0.1893, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 14.08% (0.5105 => 0.5824, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.00% (0.0886 => 0.1010, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.00% (0.2065 => 0.2354, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.89% (0.2700 => 0.3075, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 13.63% (0.7115 => 0.8085, std.dev.: 0.0016) MultiSource/Applications/aha/aha: 13.55% (0.1151 => 0.1307, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 13.44% (0.1555 => 0.1764, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.41% (0.6675 => 0.7570, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 13.40% (0.1940 => 0.2200, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.38% (0.0770 => 0.0873, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.31% (0.1337 => 0.1515, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.27% (0.2758 => 0.3124, std.dev.: 0.0027) MultiSource/Applications/sgefa/sgefa: 13.25% (0.3109 => 0.3521, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 13.14% (0.7433 => 0.8410, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.12% (0.5981 => 0.6766, std.dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.12% (0.1143 => 0.1293, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.07% (0.1117 => 0.1263, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.96% (0.2107 => 0.2380, std.dev.: 0.0029) MultiSource/Applications/Burg/burg: 12.94% (1.1642 => 1.3149, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.91% (0.1510 => 0.1705, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.88% (0.3121 => 0.3523, std.dev.: 0.0022) MultiSource/Applications/spiff/spiff: 12.80% (0.7835 => 0.8838, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.72% (0.9765 => 1.1007, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 12.71% (0.1125 => 0.1268, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 12.70% (3.3354 => 3.7589, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.64% (0.2271 => 0.2558, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/exptree: 12.53% (0.0814 => 0.0916, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.42% (0.5860 => 0.6588, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.35% (0.4615 => 0.5185, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.34% (0.1062 => 0.1193, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.32% (1.5415 => 1.7314, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.14% (0.1236 => 0.1386, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.11% (0.1032 => 0.1157, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.01% (0.5569 => 0.6238, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.77% (0.5020 => 0.5611, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.74% (0.3441 => 0.3845, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.73% (1.3050 => 1.4581, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 11.71% (2.0273 => 2.2646, std.dev.: 0.0120) MultiSource/Benchmarks/Olden/health/health: 11.59% (0.1268 => 0.1415, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 11.59% (3.8723 => 4.3212, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.49% (0.3307 => 0.3687, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.42% (2.2022 => 2.4536, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.38% (0.1625 => 0.1810, std.dev.: 0.0018) SingleSource/UnitTests/SignlessTypes/rem: 11.28% (0.1144 => 0.1273, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 11.16% (0.3423 => 0.3805, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.09% (0.1695 => 0.1883, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.00% (4.2646 => 4.7336, std.dev.: 0.0070) MultiSource/Applications/lemon/lemon: 10.96% (1.0722 => 1.1897, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.90% (0.6450 => 0.7153, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.87% (0.2603 => 0.2886, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.86% (1.5859 => 1.7581, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: 10.80% (0.1463 => 0.1621, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.76% (0.0929 => 0.1029, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 10.72% (0.4299 => 0.4760, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/life/life: 10.72% (0.0933 => 0.1033, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.46% (2.2024 => 2.4328, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.44% (0.1044 => 0.1153, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 10.35% (9.4845 => 10.4665, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.26% (8.1363 => 8.9709, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.23% (0.1906 => 0.2101, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 10.20% (1.1840 => 1.3048, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/09-vor/vor: 10.16% (0.3180 => 0.3503, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 10.13% (0.8921 => 0.9825, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 10.11% (0.6456 => 0.7109, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 10.09% (2.2969 => 2.5286, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.95% (0.8101 => 0.8907, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.62% (0.1892 => 0.2074, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 9.57% (1.1861 => 1.2996, std.dev.: 0.0019) MultiSource/Benchmarks/sim/sim: 9.57% (0.3387 => 0.3711, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 9.35% (0.4289 => 0.4690, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 9.35% (0.3927 => 0.4294, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.33% (1.4186 => 1.5509, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.24% (0.4103 => 0.4482, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.18% (0.3865 => 0.4220, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 9.13% (0.4620 => 0.5042, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 9.06% (0.3828 => 0.4175, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 8.87% (0.3473 => 0.3781, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 8.86% (1.5603 => 1.6985, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.80% (0.4203 => 0.4573, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 8.79% (0.3561 => 0.3874, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.78% (0.3497 => 0.3804, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.78% (0.3543 => 0.3854, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.75% (0.3543 => 0.3853, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 8.74% (0.3422 => 0.3721, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-3: 8.67% (0.3516 => 0.3821, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/for-in: 8.66% (0.3694 => 0.4014, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 8.59% (0.3886 => 0.4220, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.52% (4.9449 => 5.3664, std.dev.: 0.0158) SingleSource/Benchmarks/Stanford/Puzzle: 8.52% (0.1268 => 0.1376, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.47% (5.0018 => 5.4257, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/moments: 8.25% (0.4048 => 0.4382, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.20% (0.1330 => 0.1439, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.15% (0.5925 => 0.6408, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 8.09% (0.3684 => 0.3982, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.09% (0.4636 => 0.5011, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.07% (0.2430 => 0.2626, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 8.02% (0.3603 => 0.3892, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 7.96% (0.6030 => 0.6510, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 7.78% (5.7591 => 6.2072, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.51% (0.3650 => 0.3924, std.dev.: 0.0046) SingleSource/UnitTests/ObjC++/property-reference: 7.37% (0.7326 => 0.7866, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.16% (0.2793 => 0.2993, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.13% (0.2891 => 0.3097, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.06% (14.3668 => 15.3813, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.05% (0.3162 => 0.3385, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.03% (0.3826 => 0.4095, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 7.01% (0.3283 => 0.3513, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 6.99% (0.2831 => 0.3029, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.85% (0.2905 => 0.3104, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 6.84% (0.4064 => 0.4342, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 6.81% (0.3232 => 0.3452, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.80% (2.0665 => 2.2070, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 6.76% (0.2871 => 0.3065, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/matrix: 6.75% (0.3098 => 0.3307, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.71% (0.3427 => 0.3657, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.64% (0.2725 => 0.2906, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.64% (0.2756 => 0.2939, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.59% (0.3052 => 0.3253, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.48% (0.2714 => 0.2890, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.47% (0.2877 => 0.3063, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 6.44% (17.1811 => 18.2873, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/oourafft: 6.40% (0.3282 => 0.3492, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.35% (0.2802 => 0.2980, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.27% (0.2872 => 0.3052, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 6.14% (1.2842 => 1.3630, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.14% (0.8067 => 0.8562, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.13% (0.2266 => 0.2405, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.12% (3.8922 => 4.1305, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/bh/bh: 5.85% (0.3092 => 0.3273, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: 5.80% (0.3379 => 0.3575, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.48% (0.3136 => 0.3308, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 4.69% (0.3131 => 0.3278, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.27% (7.0540 => 7.1435, std.dev.: 0.0068) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.88% (4.3953 => 10.8952, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 19.80% (2.8904 => 3.4628, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.55% (1.1145 => 1.2990, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.84% (1.1396 => 1.2517, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.11% (0.9540 => 1.0218, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.74% (3.1578 => 3.3707, std.dev.: 0.0026) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.72% (4.2280 => 4.3431, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.40% (1.0313 => 1.0560, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7655, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.20% (3.6395 => 3.7197, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bisort/bisort: 1.79% (0.8333 => 0.8482, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2074, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 1.32% (11.6436 => 11.7972, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.25% (9.1159 => 9.2298, std.dev.: 0.0213) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.94% (6.6874 => 0.1376, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -76.30% (0.8651 => 0.2050, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.39% (5.3855 => 2.4023, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -55.14% (5.3526 => 2.4010, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: -45.62% (0.1622 => 0.0882, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.96% (5.2763 => 3.1152, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -38.48% (1.1194 => 0.6887, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -24.20% (1.7609 => 1.3347, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.93% (2.9384 => 2.5290, std.dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: -10.64% (10.4361 => 9.3256, std.dev.: 0.0072) SingleSource/UnitTests/Vector/constpool: -8.90% (54.1659 => 49.3455, std.dev.: 0.0068) MultiSource/Benchmarks/Bullet/bullet: -7.46% (63.2438 => 58.5241, std.dev.: 0.0233) MultiSource/Applications/ClamAV/clamscan: -3.73% (22.1758 => 21.3489, std.dev.: 0.0149) MultiSource/Benchmarks/PAQ8p/paq8p: -3.64% (10.3673 => 9.9898, std.dev.: 0.0072) MultiSource/Applications/JM/lencod/lencod: -2.58% (21.9371 => 21.3716, std.dev.: 0.0149) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -35.18% (0.0506 => 0.0328) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -35.16% (0.3987 => 0.2585, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7637, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -28.69% (10.7105 => 7.6380, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4236, std.dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: -11.00% (9.5636 => 8.5119, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: -10.92% (1.5373 => 1.3694, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.28% (19.9488 => 18.2961, std.dev.: 0.0182) MultiSource/Benchmarks/FreeBench/mason/mason: -7.73% (0.2161 => 0.1994, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.07% (1.8329 => 1.7034, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4782, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -6.31% (1.2373 => 1.1592, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -5.58% (1.9577 => 1.8484, std.dev.: 0.0145) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.08% (1.6805 => 1.5951, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: -5.00% (6.6465 => 6.3141, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.60% (1.5660 => 1.4939, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: -4.58% (1.5835 => 1.5109, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.04% (0.2497 => 0.2396, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.78% (3.2827 => 3.1587, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -3.70% (4.5009 => 4.3345, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.67% (0.9957 => 0.9592, std.dev.: 0.0039) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.52% (32.5116 => 31.3659, std.dev.: 0.0146) MultiSource/Benchmarks/sim/sim: -3.24% (5.0483 => 4.8848, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -2.78% (4.6441 => 4.5148, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.60% (0.4808 => 0.4683, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: -2.14% (1.1277 => 1.1036, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -2.06% (10.2830 => 10.0715, std.dev.: 0.0174) SingleSource/Benchmarks/Misc/flops: -1.70% (8.8334 => 8.6833, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.62% (8.1563 => 8.0244, std.dev.: 0.0053) SingleSource/UnitTests/Vector/multiplies: -1.54% (2.5528 => 2.5135, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -1.28% (85.0658 => 83.9730, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8578, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2348, std.dev.: 0.0055) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -5.45% (0.1485 => 0.1404) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0017) Report Time: 2.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 13:06:40 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 15:06:40 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121031200640.8F50F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5457?compare_to=5449&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5457, Order: 167130, Start Time: 2012-10-31 16:51:06, End Time: 2012-10-31 20:06:42 To: 5449, Order: 167113, Start Time: 2012-10-31 12:47:12, End Time: 2012-10-31 16:02:44 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (170 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1038 (720 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.36% (1.1191 => 1.1343, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.02% (2.3725 => 2.3968, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.58% (0.2144 => 0.2285, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.86% (0.3739 => 0.3846, std.dev.: 0.0022) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.96% (0.0625 => 0.0881, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.80% (0.1063 => 0.1401, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.46% (0.2969 => 0.3725, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.05% (0.1106 => 0.1383, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.59% (0.4253 => 0.5299, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.18% (0.4139 => 0.5140, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 24.07% (1.5932 => 1.9767, std.dev.: 0.0064) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.61% (0.5900 => 0.7293, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.53% (0.4994 => 0.6169, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.25% (0.0714 => 0.0880, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.95% (0.0475 => 0.0584, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.52% (0.5000 => 0.6126, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.49% (0.0547 => 0.0670, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.43% (0.0584 => 0.0715, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.67% (0.1620 => 0.1971, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.63% (0.0897 => 0.1091, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 21.54% (0.0599 => 0.0728, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.35% (0.1021 => 0.1239, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.23% (0.1107 => 0.1342, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 20.36% (0.0604 => 0.0727, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.15% (0.0541 => 0.0650, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 20.15% (0.0948 => 0.1139, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.06% (0.0633 => 0.0760, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.03% (0.0584 => 0.0701, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/health/health: 19.98% (0.0821 => 0.0985, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.95% (0.1103 => 0.1323, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.94% (0.0642 => 0.0770, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.78% (0.3903 => 0.4675, std.dev.: 0.0030) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.76% (0.1604 => 0.1921, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/05-eks/eks: 19.58% (0.1619 => 0.1936, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.54% (0.1003 => 0.1199, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.46% (0.0822 => 0.0982, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.43% (0.1549 => 0.1850, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 18.48% (0.0947 => 0.1122, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 18.30% (0.5826 => 0.6892, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.26% (0.1462 => 0.1729, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 18.19% (0.0808 => 0.0955, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 18.00% (0.5889 => 0.6949, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.97% (1.3152 => 1.5515, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.92% (0.3890 => 0.4587, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 17.90% (0.1218 => 0.1436, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.87% (0.2014 => 0.2374, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 17.80% (0.4029 => 0.4746, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/mst/mst: 17.48% (0.0698 => 0.0820, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 17.48% (0.1505 => 0.1768, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.47% (0.2736 => 0.3214, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.25% (0.2875 => 0.3371, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.19% (0.1088 => 0.1275, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 17.11% (0.5546 => 0.6495, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 16.97% (0.9697 => 1.1343, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.89% (0.2866 => 0.3350, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.82% (3.5627 => 4.1620, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 16.77% (0.2725 => 0.3182, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 16.74% (1.8794 => 2.1940, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.58% (0.2738 => 0.3192, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 16.58% (0.2714 => 0.3164, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.53% (0.2729 => 0.3180, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.49% (0.5026 => 0.5855, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 16.37% (0.2823 => 0.3285, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.36% (0.4658 => 0.5420, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 16.34% (0.2803 => 0.3261, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.33% (1.6211 => 1.8859, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/strcat: 16.33% (0.2750 => 0.3199, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 16.33% (0.1421 => 0.1653, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 16.32% (0.2813 => 0.3272, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: 16.29% (0.2811 => 0.3269, std.dev.: 0.0048) SingleSource/UnitTests/ObjC++/property-reference: 16.27% (0.7171 => 0.8338, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.26% (0.1968 => 0.2288, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 16.26% (0.2780 => 0.3232, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 16.25% (0.3004 => 0.3492, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.21% (0.1160 => 0.1348, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 16.17% (0.9909 => 1.1511, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.15% (0.2792 => 0.3243, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 16.12% (0.3096 => 0.3595, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.11% (0.3271 => 0.3798, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.99% (0.3195 => 0.3706, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.97% (0.2911 => 0.3376, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.94% (2.0673 => 2.3968, std.dev.: 0.0037) MultiSource/Applications/d/make_dparser: 15.81% (1.0781 => 1.2486, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.62% (0.4361 => 0.5042, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 15.55% (0.3267 => 0.3775, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.54% (4.4195 => 5.1065, std.dev.: 0.0102) MultiSource/Benchmarks/Olden/bh/bh: 15.50% (0.1284 => 0.1483, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.50% (2.7292 => 3.1521, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 15.44% (0.3258 => 0.3761, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 15.37% (23.5202 => 27.1349, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.33% (0.3060 => 0.3529, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.22% (0.3930 => 0.4528, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.20% (0.3362 => 0.3873, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 15.18% (4.2109 => 4.8500, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.17% (1.9694 => 2.2682, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary2: 15.16% (0.3317 => 0.3820, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.98% (0.3124 => 0.3592, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.88% (1.9966 => 2.2937, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.87% (0.3282 => 0.3770, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.86% (0.1090 => 0.1252, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 14.71% (0.4146 => 0.4756, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 14.66% (0.3465 => 0.3973, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 14.65% (0.3446 => 0.3951, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 14.64% (0.3348 => 0.3838, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 14.62% (0.3460 => 0.3966, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.54% (0.3488 => 0.3995, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/synchronized: 14.53% (0.3469 => 0.3973, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 14.53% (0.3442 => 0.3942, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 14.52% (0.3678 => 0.4212, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 14.45% (0.3496 => 0.4001, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.43% (0.3625 => 0.4148, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 14.39% (0.3726 => 0.4262, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 14.35% (0.3477 => 0.3976, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.28% (0.3690 => 0.4217, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.15% (0.3845 => 0.4389, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions: 14.08% (0.3643 => 0.4156, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 14.07% (0.4251 => 0.4849, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 14.05% (0.3650 => 0.4163, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.02% (0.3981 => 0.4539, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/parameter-passing: 13.94% (0.3724 => 0.4243, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 13.80% (0.2566 => 0.2920, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 13.69% (1.4269 => 1.6222, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: 13.64% (0.2075 => 0.2358, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 13.36% (0.7875 => 0.8927, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 13.23% (0.5012 => 0.5675, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 13.21% (4.6177 => 5.2278, std.dev.: 0.0035) MultiSource/Applications/JM/ldecod/ldecod: 13.13% (2.1653 => 2.4496, std.dev.: 0.0099) MultiSource/Benchmarks/mafft/pairlocalalign: 12.74% (2.1013 => 2.3691, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.93% (0.6435 => 0.7203, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.91% (0.2040 => 0.2283, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 11.89% (0.2691 => 0.3011, std.dev.: 0.0037) MultiSource/Applications/SPASS/SPASS: 11.82% (5.5417 => 6.1968, std.dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.06% (0.3084 => 0.3425, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 11.03% (0.3498 => 0.3884, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.99% (0.1028 => 0.1141, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.74% (0.2737 => 0.3031, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.48% (0.1383 => 0.1528, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.44% (0.2068 => 0.2284, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 10.42% (0.4847 => 0.5352, std.dev.: 0.0017) MultiSource/Applications/minisat/minisat: 10.13% (0.3336 => 0.3674, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 10.01% (0.6634 => 0.7298, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 9.37% (2.0346 => 2.2252, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.37% (0.2103 => 0.2300, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 9.12% (0.2391 => 0.2609, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.06% (4.6926 => 5.1179, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.64% (11.6398 => 12.6456, std.dev.: 0.0147) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.11% (0.5361 => 0.5796, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.54% (0.5584 => 0.6005, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.53% (0.7426 => 0.7985, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 6.73% (11.9555 => 12.7599, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.27% (0.3792 => 0.3992, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6534, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.68% (0.2122 => 0.2285, std.dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: 7.14% (0.2802 => 0.3002, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6102, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.03% (12.0509 => 12.6566, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops: 4.68% (15.4430 => 16.1662, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.14% (0.3693 => 0.3846, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-2: 3.87% (1.8057 => 1.8756, std.dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/dry: 2.76% (14.0481 => 14.4364, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary3: 1.98% (15.8721 => 16.1867, std.dev.: 0.0034) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.69% (3.1722 => 3.2258, std.dev.: 0.0025) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3014, std.dev.: 0.0135) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2858, std.dev.: 0.0021) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.23% (1.0142 => 1.0267, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5129, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5402, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5928, std.dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.60% (25.4195 => 16.3695, std.dev.: 0.0217) SingleSource/Benchmarks/Shootout-C++/ary2: -8.28% (0.2402 => 0.2203, std.dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9757, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/salsa20: -7.66% (35.5013 => 32.7807, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/tsp/tsp: -7.20% (2.1113 => 1.9592, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -3.13% (11.2080 => 10.8575, std.dev.: 0.0239) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7734, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5219, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.76% (0.6293 => 0.6119, std.dev.: 0.0049) SingleSource/Benchmarks/Dhrystone/fldry: -2.21% (17.2379 => 16.8572, std.dev.: 0.0148) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.19% (41.7953 => 40.8788, std.dev.: 0.0111) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5703, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: -1.52% (5.5810 => 5.4963, std.dev.: 0.0052) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.33% (5.7935 => 5.7163, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.09% (105.3826 => 104.2329, std.dev.: 0.0724) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0445, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.05% (3.3991 => 3.3633, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 13:07:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 15:07:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121031200722.240192A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5458?compare_to=5454&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5458, Order: 167146, Start Time: 2012-10-31 18:42:24, End Time: 2012-10-31 20:07:21 To: 5454, Order: 167134, Start Time: 2012-10-31 16:54:04, End Time: 2012-10-31 18:19:25 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (6 on baseline) Performance Improvements: 7 (176 on baseline) Unchanged Tests: 1033 (860 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.21% (29.1270 => 29.7702, std.dev.: 0.0361) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.13% (0.9535 => 0.9643, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -22.78% (19.0200 => 14.6864, std.dev.: 0.0097) MultiSource/Applications/SIBsim4/SIBsim4: -2.82% (1.3678 => 1.3292, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.76% (13.8984 => 13.5147, std.dev.: 0.0225) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.38% (6.5836 => 6.4272, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.97% (1.1934 => 1.1699, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -1.26% (16.5216 => 16.3132, std.dev.: 0.0109) MultiSource/Applications/treecc/treecc: -1.19% (2.0768 => 2.0521, std.dev.: 0.0014) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.25% (1.2783 => 1.3710, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.14% (3.1919 => 3.4199, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.66% (2.0478 => 2.1023, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/salsa20: 2.45% (7.4937 => 7.6775, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash2: 2.10% (3.1932 => 3.2604, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.18% (0.9531 => 0.9643, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.52% (0.1584 => 0.1449, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.32% (0.1431 => 0.1312, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.48% (0.3821 => 0.3535, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: -7.41% (0.3831 => 0.3547, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -7.35% (0.3812 => 0.3532, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -7.32% (0.3880 => 0.3596, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -7.28% (0.3848 => 0.3568, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -7.26% (0.3896 => 0.3613, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -7.22% (0.4033 => 0.3742, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.16% (0.3884 => 0.3606, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.14% (0.3891 => 0.3613, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -7.09% (0.4176 => 0.3880, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -6.83% (0.4199 => 0.3912, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -6.57% (0.4280 => 0.3999, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -6.28% (2.4924 => 2.3358, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.27% (0.3142 => 0.2945, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.17% (0.9542 => 0.8953, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.10% (0.2428 => 0.2280, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: -6.01% (0.1879 => 0.1766, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -5.92% (0.3025 => 0.2846, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.88% (0.3658 => 0.3443, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.86% (0.3057 => 0.2878, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -5.85% (0.3026 => 0.2849, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.84% (4.5069 => 4.2438, std.dev.: 0.0086) MultiSource/Applications/JM/lencod/lencod: -5.84% (16.1920 => 15.2469, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.80% (2.1713 => 2.0453, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/strcat: -5.79% (0.2989 => 0.2816, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -5.78% (0.2939 => 0.2769, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.77% (0.2355 => 0.2219, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: -5.73% (0.3194 => 0.3011, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: -5.73% (7.0961 => 6.6898, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.71% (0.6484 => 0.6114, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.70% (0.3016 => 0.2844, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -5.69% (0.2160 => 0.2037, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.69% (0.3323 => 0.3134, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -5.69% (0.2849 => 0.2687, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.68% (0.2903 => 0.2738, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -5.63% (0.3357 => 0.3168, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.63% (0.3837 => 0.3621, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -5.62% (0.3059 => 0.2887, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.62% (22.4056 => 21.1460, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.62% (3.5339 => 3.3354, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/wc: -5.62% (0.3205 => 0.3025, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.61% (0.3849 => 0.3633, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.61% (0.2871 => 0.2710, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.59% (0.4151 => 0.3919, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -5.57% (1.3148 => 1.2416, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.57% (0.3252 => 0.3071, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -5.56% (0.3255 => 0.3074, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.55% (0.9852 => 0.9305, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary3: -5.51% (0.3446 => 0.3256, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.50% (4.8802 => 4.6116, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.49% (0.3931 => 0.3715, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: -5.48% (0.7779 => 0.7353, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/gs/gs: -5.47% (4.3330 => 4.0960, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.45% (4.8161 => 4.5534, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/ary: -5.45% (0.3394 => 0.3209, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -5.43% (0.3481 => 0.3292, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: -5.42% (0.2659 => 0.2515, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.42% (1.0544 => 0.9973, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.38% (0.4813 => 0.4554, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.35% (4.0323 => 3.8164, std.dev.: 0.0042) MultiSource/Applications/Burg/burg: -5.35% (1.2515 => 1.1845, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: -5.35% (0.4861 => 0.4601, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -5.30% (0.3621 => 0.3429, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.30% (0.2548 => 0.2413, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.28% (0.4321 => 0.4093, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -5.25% (0.4248 => 0.4025, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.22% (0.4083 => 0.3870, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: -5.20% (0.6347 => 0.6017, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.20% (0.7198 => 0.6824, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.19% (1.2784 => 1.2121, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: -5.15% (0.3867 => 0.3668, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -5.10% (0.3788 => 0.3595, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: -5.09% (9.2283 => 8.7583, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.09% (5.4682 => 5.1900, std.dev.: 0.0098) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.09% (6.7716 => 6.4272, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.09% (0.6293 => 0.5973, std.dev.: 0.0049) SingleSource/UnitTests/ObjC++/property-reference-object: -5.08% (0.6441 => 0.6114, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.07% (0.5999 => 0.5695, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.06% (0.7919 => 0.7518, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.06% (0.4427 => 0.4203, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -5.03% (34.0927 => 32.3765, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.01% (0.2933 => 0.2786, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.98% (1.6474 => 1.5653, std.dev.: 0.0009) MultiSource/Applications/lua/lua: -4.95% (4.0594 => 3.8585, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.90% (1.3722 => 1.3050, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -4.89% (1.2300 => 1.1699, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.88% (14.2083 => 13.5147, std.dev.: 0.0225) MultiSource/Applications/siod/siod: -4.87% (2.4021 => 2.2850, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.87% (0.2999 => 0.2853, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: -4.86% (0.9179 => 0.8733, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/bigfib: -4.83% (0.6750 => 0.6424, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.83% (0.2278 => 0.2168, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -4.82% (1.6364 => 1.5576, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.73% (0.8521 => 0.8118, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.71% (1.4642 => 1.3953, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.67% (0.5478 => 0.5222, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.67% (1.2210 => 1.1640, std.dev.: 0.0079) MultiSource/Applications/lemon/lemon: -4.65% (1.1450 => 1.0918, std.dev.: 0.0148) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.64% (1.2221 => 1.1654, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/18-imp/imp: -4.64% (0.3581 => 0.3415, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -4.62% (17.1032 => 16.3132, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.61% (0.5575 => 0.5318, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -4.61% (0.4515 => 0.4307, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.59% (0.5925 => 0.5653, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.57% (0.5802 => 0.5537, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.56% (0.5859 => 0.5592, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.56% (0.4916 => 0.4692, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.54% (0.6052 => 0.5777, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -4.52% (0.2985 => 0.2850, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.51% (0.5857 => 0.5593, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.51% (0.5591 => 0.5339, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.51% (0.6681 => 0.6380, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.49% (0.5863 => 0.5600, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.47% (0.6194 => 0.5917, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.47% (0.3491 => 0.3335, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -4.46% (18.2933 => 17.4768, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.46% (0.5581 => 0.5332, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.44% (0.2385 => 0.2279, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.43% (0.5849 => 0.5590, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.43% (0.6304 => 0.6025, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.41% (0.6189 => 0.5916, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.41% (0.5805 => 0.5549, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -4.40% (0.3406 => 0.3256, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: -4.40% (0.4524 => 0.4325, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.38% (0.5567 => 0.5323, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.38% (0.6230 => 0.5957, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.38% (0.6260 => 0.5986, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.37% (8.0126 => 7.6626, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.36% (0.6676 => 0.6385, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.34% (0.6660 => 0.6371, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: -4.34% (0.7447 => 0.7124, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.34% (0.6297 => 0.6024, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.33% (0.6033 => 0.5772, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.29% (0.5570 => 0.5331, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.28% (2.2587 => 2.1621, std.dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: -4.27% (0.7982 => 0.7641, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.27% (0.5456 => 0.5223, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.25% (0.3483 => 0.3335, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.25% (0.3319 => 0.3178, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.25% (0.9557 => 0.9151, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.22% (0.6440 => 0.6168, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.21% (0.5941 => 0.5691, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.20% (0.7339 => 0.7031, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.18% (0.5688 => 0.5450, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.17% (0.7524 => 0.7210, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.17% (0.6736 => 0.6455, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.16% (0.6395 => 0.6129, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.14% (0.6446 => 0.6179, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: -4.13% (1.3864 => 1.3292, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -4.11% (2.1401 => 2.0521, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: -4.10% (15.5079 => 14.8724, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.08% (0.2695 => 0.2585, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.08% (0.6395 => 0.6134, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.08% (0.6667 => 0.6395, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: -4.04% (0.3271 => 0.3139, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: -4.03% (0.8418 => 0.8079, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: -3.77% (1.5610 => 1.5022, std.dev.: 0.0028) MultiSource/Applications/ClamAV/clamscan: -3.71% (15.2527 => 14.6864, std.dev.: 0.0097) MultiSource/Applications/d/make_dparser: -3.68% (3.5154 => 3.3860, std.dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: -3.57% (1.1530 => 1.1118, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.56% (0.7021 => 0.6771, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.56% (0.5168 => 0.4984, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.48% (0.9077 => 0.8761, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: -3.24% (5.0226 => 4.8599, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.00% (0.5329 => 0.5169, std.dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -2.24% (20.7746 => 20.3100, std.dev.: 0.0183) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7535, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/richards_benchmark: -8.67% (1.2842 => 1.1729, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.83% (2.2633 => 2.1766, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.96% (1.3096 => 1.2709, std.dev.: 0.0121) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4691, std.dev.: 0.0052) Report Time: 2.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 14:28:54 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 16:28:54 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121031212854.987E02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5459?compare_to=5455&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5459, Order: 167161, Start Time: 2012-10-31 20:01:52, End Time: 2012-10-31 21:28:56 To: 5455, Order: 167146, Start Time: 2012-10-31 18:17:37, End Time: 2012-10-31 19:45:00 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 8 (72 on baseline) Performance Improvements: 0 (5 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 983 (897 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.72% (0.8817 => 0.9057, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.65% (0.5962 => 0.6120, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 2.05% (0.6574 => 0.6709, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.43% (13.4390 => 13.6317, std.dev.: 0.0481) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.37% (4.2929 => 4.3518, std.dev.: 0.0197) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.20% (1.2514 => 1.2664, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.13% (0.9163 => 0.9267, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.87% (7.0179 => 7.1494, std.dev.: 0.0193) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.64% (16.6362 => 16.7419, std.dev.: 0.1897) MultiSource/Applications/obsequi/Obsequi: 0.34% (1.0690 => 1.0726, std.dev.: 0.0105) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.39% (21.7293 => 21.6453, std.dev.: 0.1594) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.16% (0.3639 => 0.3633, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/bigfib: 0.08% (0.6021 => 0.6026, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.42% (0.3311 => 0.3325, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/strcat: -0.20% (0.1999 => 0.1995, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -24.58% (0.0179 => 0.0135, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -7.53% (0.0425 => 0.0393, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.38% (0.0262 => 0.0261, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 16.21% (0.0253 => 0.0294, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 2.66% (0.0413 => 0.0424, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 9.73% (0.0185 => 0.0203, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -5.69% (0.0211 => 0.0199, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 1.04% (0.1439 => 0.1454, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.50% (1.1492 => 1.1320, std.dev.: 0.0053) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -5.56% (0.1512 => 0.1428, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.10% (0.4063 => 0.4067, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.02% (0.1338 => 0.1365, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.25% (0.0641 => 0.0649, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0275 => 0.0275, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.53% (0.0598 => 0.0553, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.49% (1.1479 => 1.1423, std.dev.: 0.0422) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 63.16% (0.0019 => 0.0031, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.77% (0.0647 => 0.0652, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.31% (0.0255 => 0.0266, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.51% (0.8068 => 0.8027, std.dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0001 => 0.0004, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -44.62% (0.0065 => 0.0036, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2315.07% (0.6332 => 15.2922, std.dev.: 0.1664) MultiSource/Benchmarks/McCat/08-main/main: 47.41% (0.1831 => 0.2699, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.77% (0.1559 => 0.1469, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1491.12% (0.3344 => 5.3207, std.dev.: 0.1427) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.93% (0.2364 => 0.3237, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: 2.10% (0.0429 => 0.0438, std.dev.: 0.0003) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.02% (0.0224 => 0.0233, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0000) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3513, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0696, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4872, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3407, std.dev.: 0.0131) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0276, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4008, std.dev.: 0.0056) SingleSource/Regression/C/uint64_to_float: -23.94% (2.1832 => 1.6605, std.dev.: 0.0064) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.42% (0.0810 => 0.0943, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.68% (0.0848 => 0.0964, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.58% (0.0773 => 0.0878, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.85% (0.8321 => 0.9057, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.63% (0.1425 => 0.1548, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.52% (0.7473 => 0.8110, std.dev.: 0.0135) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.26% (0.2180 => 0.2360, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.19% (0.8148 => 0.8815, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 8.17% (0.4847 => 0.5243, std.dev.: 0.0064) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.82% (0.1983 => 0.2138, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.28% (0.2279 => 0.2445, std.dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: 6.73% (1.1271 => 1.2029, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 6.71% (0.6287 => 0.6709, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.47% (0.2998 => 0.3192, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.19% (0.1905 => 0.2023, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.07% (0.2240 => 0.2376, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.68% (0.1885 => 0.1992, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 5.62% (0.9435 => 0.9965, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.21% (0.5817 => 0.6120, std.dev.: 0.0017) MultiSource/Applications/spiff/spiff: 5.11% (0.7950 => 0.8356, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.90% (1.1685 => 1.2258, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 4.90% (0.5961 => 0.6253, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.71% (1.2602 => 1.3195, std.dev.: 0.0113) MultiSource/Benchmarks/Olden/bh/bh: 4.69% (0.2985 => 0.3125, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.20% (4.1763 => 4.3518, std.dev.: 0.0197) MultiSource/Applications/hbd/hbd: 4.16% (1.4269 => 1.4862, std.dev.: 0.0169) MultiSource/Applications/ClamAV/clamscan: 4.08% (14.7684 => 15.3711, std.dev.: 0.0426) MultiSource/Benchmarks/Prolangs-C/football/football: 4.05% (0.8768 => 0.9123, std.dev.: 0.0105) MultiSource/Benchmarks/MallocBench/gs/gs: 4.04% (4.1305 => 4.2975, std.dev.: 0.0337) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.93% (6.6074 => 6.8673, std.dev.: 0.0564) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.88% (0.4559 => 0.4736, std.dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: 3.84% (1.2568 => 1.3050, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.42% (13.1811 => 13.6317, std.dev.: 0.0481) MultiSource/Applications/treecc/treecc: 3.35% (1.9948 => 2.0616, std.dev.: 0.0240) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.29% (0.5191 => 0.5362, std.dev.: 0.0061) MultiSource/Applications/d/make_dparser: 3.24% (3.2366 => 3.3415, std.dev.: 0.0181) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.22% (1.6386 => 1.6914, std.dev.: 0.0147) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.20% (0.6227 => 0.6426, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.17% (4.4873 => 4.6295, std.dev.: 0.0463) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.09% (1.1170 => 1.1515, std.dev.: 0.0116) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.07% (0.4783 => 0.4930, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.02% (0.8995 => 0.9267, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 3.01% (0.6834 => 0.7040, std.dev.: 0.0042) MultiSource/Applications/lemon/lemon: 2.91% (1.0945 => 1.1263, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.82% (0.3717 => 0.3822, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 2.73% (14.2605 => 14.6496, std.dev.: 0.1021) MultiSource/Applications/siod/siod: 2.47% (2.2184 => 2.2731, std.dev.: 0.0033) MultiSource/Applications/JM/ldecod/ldecod: 2.44% (6.7320 => 6.8963, std.dev.: 0.0346) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.23% (0.9908 => 1.0129, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.20% (0.8855 => 0.9050, std.dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: 2.20% (0.9810 => 1.0026, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.20% (0.8597 => 0.8786, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.18% (0.8069 => 0.8245, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.11% (0.8518 => 0.8698, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.10% (0.8050 => 0.8219, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.94% (1.2423 => 1.2664, std.dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 1.90% (15.3280 => 15.6188, std.dev.: 0.1108) MultiSource/Applications/oggenc/oggenc: 1.76% (4.9628 => 5.0501, std.dev.: 0.0270) MultiSource/Applications/lambda-0_1_3/lambda: 1.43% (0.7557 => 0.7665, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.00% (1.5795 => 2.4956, std.dev.: 0.0106) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.57% (2.7978 => 3.7370, std.dev.: 0.0061) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.93% (2.4333 => 2.6993, std.dev.: 0.0310) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.39% (0.3186 => 0.3517, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.63% (1.1857 => 1.2762, std.dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 5.94% (63.1822 => 66.9325, std.dev.: 0.0486) SingleSource/Benchmarks/Shootout-C++/hash: 2.88% (0.6205 => 0.6384, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 2.82% (3.6643 => 3.7675, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.48% (0.4031 => 0.4131, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.19% (0.5889 => 0.6018, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/bh/bh: 2.12% (2.3560 => 2.4060, std.dev.: 0.0159) SingleSource/Benchmarks/Misc/ReedSolomon: 1.87% (8.5322 => 8.6917, std.dev.: 0.0607) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.08% (1.1365 => 1.1488, std.dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -34.02% (0.0338 => 0.0223, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.04% (0.3269 => 0.3039, std.dev.: 0.0006) MultiSource/Applications/lua/lua: -5.01% (29.8330 => 28.3381, std.dev.: 0.1826) SingleSource/Benchmarks/Shootout-C++/hash2: -1.47% (3.4237 => 3.3734, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.28% (3.3479 => 3.3050, std.dev.: 0.0005) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.80% (16.4461 => 16.7419, std.dev.: 0.1897) MultiSource/Applications/obsequi/Obsequi: 4.52% (1.0262 => 1.0726, std.dev.: 0.0105) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6830.93% (0.3123 => 21.6453, std.dev.: 0.1594) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.50% (0.2463 => 0.3633, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/bigfib: 0.27% (0.6010 => 0.6026, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.81% (0.3266 => 0.3325, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/strcat: 1.32% (0.1969 => 0.1995, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 9.76% (0.0123 => 0.0135, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.68% (0.0408 => 0.0393, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 2.76% (0.0254 => 0.0261, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.65% (0.0302 => 0.0294, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0384 => 0.0424, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 10.56% (0.0180 => 0.0199, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 1.11% (0.1438 => 0.1454, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.08% (1.1329 => 1.1320, std.dev.: 0.0053) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -2.33% (0.1462 => 0.1428, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.33% (0.4164 => 0.4067, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.29% (0.1369 => 0.1365, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.25% (0.0641 => 0.0649, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.03% (0.0195 => 0.0275, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.33% (0.0578 => 0.0553, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.12% (1.1437 => 1.1423, std.dev.: 0.0422) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.99% (0.0627 => 0.0652, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.78% (0.0180 => 0.0266, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.12% (0.8017 => 0.8027, std.dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 300.00% (0.0001 => 0.0004, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -41.94% (0.0062 => 0.0036, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 14:55:30 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 16:55:30 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121031215530.559212A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5460?compare_to=5458&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5460, Order: 167161, Start Time: 2012-10-31 20:30:31, End Time: 2012-10-31 21:55:31 To: 5458, Order: 167146, Start Time: 2012-10-31 18:42:24, End Time: 2012-10-31 20:07:21 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (7 on baseline) Performance Improvements: 0 (174 on baseline) Unchanged Tests: 1040 (861 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.14% (54.7214 => 56.4418, std.dev.: 0.1192) MultiSource/Benchmarks/llubenchmark/llu: 1.16% (3.7704 => 3.8142, std.dev.: 0.0079) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.15% (3.1919 => 3.4201, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.42% (54.5751 => 56.4418, std.dev.: 0.1192) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.58% (2.0478 => 2.1007, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/salsa20: 2.40% (7.4937 => 7.6732, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 2.25% (3.1932 => 3.2650, std.dev.: 0.0019) MultiSource/Benchmarks/llubenchmark/llu: 1.89% (3.7435 => 3.8142, std.dev.: 0.0079) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.39% (0.1431 => 0.1311, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.27% (0.1584 => 0.1453, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.41% (0.3821 => 0.3538, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -6.96% (2.4924 => 2.3189, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/exceptions-2: -6.40% (0.3831 => 0.3586, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.33% (0.3142 => 0.2943, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.31% (0.3880 => 0.3635, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.26% (0.3848 => 0.3607, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/synchronized: -6.24% (0.3896 => 0.3653, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.20% (0.4033 => 0.3783, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -6.19% (0.3812 => 0.3576, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -6.18% (0.4176 => 0.3918, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.15% (0.3884 => 0.3645, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.14% (0.2428 => 0.2279, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.09% (0.3891 => 0.3654, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.08% (0.3025 => 0.2841, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.08% (0.9542 => 0.8962, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -6.07% (0.1879 => 0.1765, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.05% (0.3057 => 0.2872, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -6.05% (0.3026 => 0.2843, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -6.02% (0.2989 => 0.2809, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.01% (2.1713 => 2.0409, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/random: -5.99% (0.2939 => 0.2763, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.96% (0.2903 => 0.2730, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.94% (0.6484 => 0.6099, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.94% (4.5069 => 4.2393, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.93% (0.3658 => 0.3441, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.90% (0.4151 => 0.3906, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.89% (0.3837 => 0.3611, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -5.86% (0.2849 => 0.2682, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -5.85% (0.3059 => 0.2880, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.84% (0.3323 => 0.3129, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.84% (0.3016 => 0.2840, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -5.82% (0.3194 => 0.3008, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -5.82% (0.2871 => 0.2704, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.81% (0.3252 => 0.3063, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: -5.81% (0.4199 => 0.3955, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -5.81% (0.3255 => 0.3066, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -5.80% (0.3205 => 0.3019, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.79% (22.4056 => 21.1079, std.dev.: 0.0178) MultiSource/Applications/JM/lencod/lencod: -5.79% (16.1920 => 15.2549, std.dev.: 0.0143) MultiSource/Applications/JM/ldecod/ldecod: -5.75% (7.0961 => 6.6881, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.74% (3.5339 => 3.3309, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.74% (0.3849 => 0.3628, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -5.72% (0.3481 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -5.72% (0.3394 => 0.3200, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/ary3: -5.69% (0.3446 => 0.3250, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -5.65% (0.2160 => 0.2038, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: -5.63% (0.3621 => 0.3417, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -5.63% (0.4280 => 0.4039, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.59% (0.4813 => 0.4544, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.58% (0.4083 => 0.3855, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.56% (4.0323 => 3.8080, std.dev.: 0.0066) MultiSource/Applications/hexxagon/hexxagon: -5.56% (1.3148 => 1.2417, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.55% (0.3931 => 0.3713, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -5.54% (0.3357 => 0.3171, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -5.53% (0.4248 => 0.4013, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.53% (1.0544 => 0.9961, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.49% (0.9852 => 0.9311, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.48% (4.8802 => 4.6127, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.47% (4.8161 => 4.5529, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/sieve: -5.44% (0.3788 => 0.3582, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/lists1: -5.43% (0.3867 => 0.3657, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.43% (1.2784 => 1.2090, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: -5.41% (0.4861 => 0.4598, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: -5.40% (1.2515 => 1.1839, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.37% (0.7919 => 0.7494, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.35% (0.4427 => 0.4190, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.35% (0.2355 => 0.2229, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/gs/gs: -5.31% (4.3330 => 4.1029, std.dev.: 0.0100) MultiSource/Benchmarks/McCat/08-main/main: -5.30% (0.2659 => 0.2518, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.23% (0.4321 => 0.4095, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -5.23% (0.6750 => 0.6397, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.22% (0.8521 => 0.8076, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.22% (0.2933 => 0.2780, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.18% (14.2083 => 13.4717, std.dev.: 0.0260) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.18% (0.6293 => 0.5967, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.17% (5.4682 => 5.1857, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.17% (1.6474 => 1.5623, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: -5.14% (0.7779 => 0.7379, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/football/football: -5.08% (0.9179 => 0.8713, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.07% (1.2300 => 1.1677, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.03% (0.5999 => 0.5697, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: -5.03% (9.2283 => 8.7643, std.dev.: 0.0013) MultiSource/Applications/siod/siod: -5.02% (2.4021 => 2.2815, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -5.01% (34.0927 => 32.3855, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -4.99% (1.6364 => 1.5547, std.dev.: 0.0017) MultiSource/Applications/lua/lua: -4.94% (4.0594 => 3.8587, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.94% (1.3722 => 1.3044, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.93% (0.2999 => 0.2851, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.89% (6.7716 => 6.4405, std.dev.: 0.0046) MultiSource/Applications/lemon/lemon: -4.86% (1.1450 => 1.0893, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.86% (0.5478 => 0.5212, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.84% (0.3491 => 0.3322, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -4.82% (17.1032 => 16.2796, std.dev.: 0.0251) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.79% (0.5802 => 0.5524, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -4.79% (0.2985 => 0.2842, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.78% (0.5591 => 0.5324, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.77% (1.2210 => 1.1627, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: -4.77% (0.6347 => 0.6044, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.74% (0.6681 => 0.6364, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.74% (0.5863 => 0.5585, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.71% (0.5925 => 0.5646, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.70% (0.6194 => 0.5903, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.69% (1.4642 => 1.3955, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.68% (0.5575 => 0.5314, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.68% (1.2221 => 1.1649, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.68% (0.6052 => 0.5769, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: -4.66% (0.3581 => 0.3414, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.66% (0.5705 => 0.5439, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.66% (0.5857 => 0.5584, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.66% (0.5859 => 0.5586, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.65% (0.2278 => 0.2172, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.65% (0.3483 => 0.3321) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.64% (0.5581 => 0.5322, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: -4.63% (0.7447 => 0.7102, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.62% (0.6230 => 0.5942, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.62% (0.6189 => 0.5903, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: -4.62% (0.4524 => 0.4315, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -4.61% (0.6441 => 0.6144, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.61% (0.7339 => 0.7001, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.60% (0.6304 => 0.6014, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.59% (0.6297 => 0.6008, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.57% (0.6676 => 0.6371, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.57% (0.5805 => 0.5540, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.54% (0.5569 => 0.5316, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.54% (0.7198 => 0.6871, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.54% (0.4916 => 0.4693, std.dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: -4.51% (18.2933 => 17.4676, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.50% (0.6667 => 0.6367, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.49% (0.6033 => 0.5762, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.47% (0.5570 => 0.5321, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.46% (2.2587 => 2.1580, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.45% (0.5456 => 0.5213, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.44% (0.6440 => 0.6154, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.44% (0.9557 => 0.9133, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.43% (0.5941 => 0.5678, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.42% (0.5567 => 0.5321, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: -4.41% (0.4515 => 0.4316, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.40% (0.2385 => 0.2280, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.40% (0.5688 => 0.5438, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.38% (8.0126 => 7.6617, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.37% (0.6446 => 0.6164, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -4.37% (0.3406 => 0.3257, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.36% (0.5849 => 0.5594, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.36% (0.7524 => 0.7196, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.33% (0.6395 => 0.6118, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.31% (0.3319 => 0.3176, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: -4.29% (2.1401 => 2.0483, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.27% (0.2695 => 0.2580, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.25% (0.6395 => 0.6123, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: -4.23% (15.5079 => 14.8514, std.dev.: 0.0071) MultiSource/Applications/SIBsim4/SIBsim4: -4.21% (1.3864 => 1.3281, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: -4.19% (0.3271 => 0.3134, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: -4.06% (0.8418 => 0.8076, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.04% (0.6736 => 0.6464, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.99% (0.7021 => 0.6741, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -3.93% (0.7982 => 0.7668, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: -3.81% (3.5154 => 3.3813, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.81% (0.9077 => 0.8731, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.77% (0.5168 => 0.4973, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -3.74% (15.2527 => 14.6819, std.dev.: 0.0051) MultiSource/Benchmarks/nbench/nbench: -3.73% (1.1530 => 1.1100, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: -3.66% (1.5610 => 1.5039, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: -3.64% (5.0226 => 4.8398, std.dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.13% (0.5329 => 0.5162, std.dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -2.08% (20.7746 => 20.3435, std.dev.: 0.0090) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.49% (7.5137 => 5.7485, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/richards_benchmark: -8.63% (1.2842 => 1.1734, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fbench: -3.92% (2.2633 => 2.1746, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.89% (1.7753 => 1.7063, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.01% (1.0557 => 1.0239, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4713, std.dev.: 0.0048) Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 14:57:52 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 16:57:52 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121031215752.49C5D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5461?compare_to=5456&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5461, Order: 167161, Start Time: 2012-10-31 20:25:04, End Time: 2012-10-31 21:57:54 To: 5456, Order: 167146, Start Time: 2012-10-31 18:22:45, End Time: 2012-10-31 19:55:25 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 2 (172 on baseline) Performance Improvements: 0 (54 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 2 (2 on baseline) Unchanged Tests: 1038 (663 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.14% (9.9898 => 10.2036, std.dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.02% (54.8876 => 56.5470, std.dev.: 0.1084) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: - (0.1404 => 0.1404) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0648 => 0.0648) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 190.74% (0.5229 => 1.5203, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 13.02% (14.9895 => 16.9409, std.dev.: 0.0073) MultiSource/Applications/kimwitu++/kc: 35.80% (14.1553 => 19.2229, std.dev.: 0.0110) MultiSource/Benchmarks/MallocBench/gs/gs: 11.76% (4.1105 => 4.5941, std.dev.: 0.0113) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 29.07% (1.1048 => 1.4260, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 306.26% (7.1582 => 29.0807, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.02% (3.4629 => 5.8184, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 63.29% (0.6222 => 1.0160, std.dev.: 0.0000) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10595.97% (0.0720 => 7.7011, std.dev.: 0.0038) MultiSource/Applications/SIBsim4/SIBsim4: 3836300.00% (0.0001 => 3.8364, std.dev.: 0.0042) MultiSource/Applications/SPASS/SPASS: 11187600.00% (0.0001 => 11.1877, std.dev.: 0.0448) MultiSource/Applications/kimwitu++/kc: 50500.00% (0.0001 => 0.0506, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 782000.00% (0.0001 => 0.7821, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10050100.00% (0.0001 => 10.0502, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5503200.00% (0.0001 => 5.5033, std.dev.: 0.0377) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 37.97% (0.1056 => 0.1457, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 29.33% (0.1432 => 0.1852, std.dev.: 0.0001) SingleSource/UnitTests/vla: 29.01% (0.0355 => 0.0458, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.05% (0.1566 => 0.1880, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 18.90% (0.0730 => 0.0868, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 17.03% (0.4879 => 0.5710, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 16.94% (0.1175 => 0.1374, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 16.68% (0.3177 => 0.3707, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.67% (0.0648 => 0.0756, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.65% (0.0871 => 0.1016, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.65% (0.0793 => 0.0925, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 16.62% (0.0746 => 0.0870, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.91% (0.8172 => 0.9472, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/08-main/main: 15.66% (0.2554 => 0.2954, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.59% (0.0834 => 0.0964, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 15.21% (0.1584 => 0.1825, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.73% (0.0842 => 0.0966, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.67% (0.1029 => 0.1180, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 14.62% (0.1163 => 0.1333, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 14.40% (0.1695 => 0.1939, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.96% (0.2758 => 0.3143, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 13.90% (0.1655 => 0.1885, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.89% (0.2700 => 0.3075, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 13.88% (0.0886 => 0.1009, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 13.80% (0.2065 => 0.2350, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 13.79% (0.5105 => 0.5809, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.76% (0.1337 => 0.1521, std.dev.: 0.0030) MultiSource/Applications/viterbi/viterbi: 13.57% (0.1555 => 0.1766, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 13.48% (0.7115 => 0.8074, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.38% (0.0770 => 0.0873) MultiSource/Applications/sgefa/sgefa: 13.25% (0.3109 => 0.3521, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.25% (0.1117 => 0.1265, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 13.25% (0.1940 => 0.2197, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.24% (0.2107 => 0.2386, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.11% (0.5981 => 0.6765, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 13.07% (0.1125 => 0.1272, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 13.03% (0.1151 => 0.1301, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.00% (0.6675 => 0.7543, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.86% (0.2271 => 0.2563, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.85% (0.1510 => 0.1704, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 12.72% (3.3354 => 3.7595, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 12.71% (1.1642 => 1.3122, std.dev.: 0.0078) MultiSource/Applications/lambda-0_1_3/lambda: 12.66% (0.7433 => 0.8374, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.66% (0.0798 => 0.0899, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.58% (0.9765 => 1.0993, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.50% (0.3121 => 0.3511, std.dev.: 0.0030) MultiSource/Applications/spiff/spiff: 12.48% (0.7835 => 0.8813, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.35% (0.4615 => 0.5185, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.34% (0.5860 => 0.6583, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.25% (1.5415 => 1.7304, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.16% (0.5569 => 0.6246, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.15% (0.1062 => 0.1191, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.02% (0.1032 => 0.1156, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.91% (0.5020 => 0.5618, std.dev.: 0.0016) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.81% (0.1143 => 0.1278) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.79% (1.3050 => 1.4589, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.71% (2.2022 => 2.4600, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.65% (0.3441 => 0.3842, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: 11.59% (0.1268 => 0.1415, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.58% (0.3307 => 0.3690, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 11.48% (2.0273 => 2.2601, std.dev.: 0.0028) MultiSource/Applications/lua/lua: 11.37% (3.8723 => 4.3125, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/18-imp/imp: 11.13% (0.3423 => 0.3804, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.08% (0.1625 => 0.1805, std.dev.: 0.0016) SingleSource/UnitTests/SignlessTypes/rem: 11.01% (0.1144 => 0.1270, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 10.94% (0.1463 => 0.1623, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.93% (0.6450 => 0.7155, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.92% (4.2646 => 4.7303, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.87% (0.2603 => 0.2886, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 10.77% (1.0722 => 1.1877, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.76% (0.0929 => 0.1029, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.62% (0.3927 => 0.4344, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.60% (1.5859 => 1.7540, std.dev.: 0.0186) SingleSource/UnitTests/ObjC/trivial-interface: 10.60% (0.3473 => 0.3841, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 10.59% (0.4289 => 0.4743, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.58% (0.3516 => 0.3888, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.47% (0.3543 => 0.3914, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 10.45% (0.3828 => 0.4228, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.44% (0.3543 => 0.3913, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.44% (0.1695 => 0.1872, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 10.43% (9.4845 => 10.4742, std.dev.: 0.0137) SingleSource/UnitTests/ObjC/exceptions-2: 10.41% (0.3497 => 0.3861, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 10.40% (0.4299 => 0.4746, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.36% (8.1363 => 8.9796, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/synchronized: 10.36% (0.3561 => 0.3930, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.34% (0.1906 => 0.2103, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.31% (0.8101 => 0.8936, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/property: 10.29% (0.3886 => 0.4286, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 10.29% (0.3694 => 0.4074, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 10.24% (1.1840 => 1.3052, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.23% (2.2024 => 2.4276, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.15% (0.1044 => 0.1150, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 10.11% (0.6456 => 0.7109, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 10.09% (0.8921 => 0.9821, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 9.97% (0.3180 => 0.3497, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 9.82% (2.2969 => 2.5225, std.dev.: 0.0059) MultiSource/Benchmarks/sim/sim: 9.80% (0.3387 => 0.3719, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.62% (0.1892 => 0.2074, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.52% (0.3865 => 0.4233, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 9.48% (0.4620 => 0.5058, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 9.42% (1.1861 => 1.2978, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.21% (1.4186 => 1.5493, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.11% (0.4203 => 0.4586, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 8.91% (0.3422 => 0.3727, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.85% (0.4103 => 0.4466, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 8.65% (0.4048 => 0.4398, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.62% (0.5925 => 0.6436, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.62% (0.6030 => 0.6550, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.59% (5.0018 => 5.4315, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: 8.52% (0.4636 => 0.5031, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.46% (4.9449 => 5.3634, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/sieve: 8.44% (0.3603 => 0.3907, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 8.39% (0.3684 => 0.3993, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 8.28% (0.1268 => 0.1373, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 8.22% (1.5603 => 1.6885, std.dev.: 0.0087) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.12% (0.1330 => 0.1438, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.00% (0.7326 => 0.7912, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.97% (0.3650 => 0.3941, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.94% (0.2430 => 0.2623, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 7.89% (5.7591 => 6.2134, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.47% (0.2891 => 0.3107, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.45% (0.2831 => 0.3042, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.45% (0.3826 => 0.4111, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.45% (0.2793 => 0.3001, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.40% (0.2905 => 0.3120, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 7.34% (0.3283 => 0.3524, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.31% (2.0665 => 2.2176, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary: 7.24% (0.3232 => 0.3466, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.21% (0.3162 => 0.3390, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.19% (0.4064 => 0.4356, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 7.17% (0.3098 => 0.3320, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 7.11% (0.2871 => 0.3075, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 7.08% (0.2725 => 0.2918, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.08% (14.3668 => 15.3839, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.04% (0.2756 => 0.2950, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/wc: 6.91% (0.3052 => 0.3263, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.89% (0.2714 => 0.2901, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.81% (0.2877 => 0.3073, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.75% (0.2872 => 0.3066, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 6.73% (0.3282 => 0.3503, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.64% (0.2802 => 0.2988, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.57% (0.3427 => 0.3652, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 6.43% (1.2842 => 1.3668, std.dev.: 0.0105) MultiSource/Applications/sqlite3/sqlite3: 6.34% (17.1811 => 18.2697, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary2: 6.10% (0.3379 => 0.3585, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 6.08% (0.3092 => 0.3280, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.00% (0.2266 => 0.2402, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.86% (0.8067 => 0.8540, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.81% (3.8922 => 4.1184, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.80% (0.3136 => 0.3318, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.89% (0.3131 => 0.3284, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.15% (0.3935 => 0.4059, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.93% (0.3817 => 0.3929, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.58% (7.0540 => 7.1657, std.dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 19.80% (2.8904 => 3.4628, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.57% (1.1145 => 1.2992, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 9.92% (1.1396 => 1.2527, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.11% (0.9540 => 1.0218) SingleSource/Benchmarks/Shootout-C++/hash2: 6.62% (3.1578 => 3.3668, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.71% (0.3463 => 0.3626, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.49% (4.2280 => 4.3334, std.dev.: 0.0101) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.96% (3.6395 => 3.7108, std.dev.: 0.0074) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2078, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7982, std.dev.: 0.0053) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.07% (6.5088 => 6.5783, std.dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.94% (6.6874 => 0.1375, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -76.55% (0.8651 => 0.2029, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.27% (5.3855 => 2.4091, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -55.01% (5.3526 => 2.4084, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -45.81% (0.1622 => 0.0879, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -41.00% (5.2763 => 3.1131, std.dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -38.07% (1.1194 => 0.6932, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -24.08% (1.7609 => 1.3368, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.83% (2.9384 => 2.5321, std.dev.: 0.0030) MultiSource/Applications/JM/ldecod/ldecod: -10.16% (10.4361 => 9.3759, std.dev.: 0.0025) SingleSource/UnitTests/Vector/constpool: -8.97% (54.1659 => 49.3072, std.dev.: 0.0085) MultiSource/Benchmarks/Bullet/bullet: -7.50% (63.2438 => 58.5033, std.dev.: 0.0303) MultiSource/Applications/ClamAV/clamscan: -3.64% (22.1758 => 21.3683, std.dev.: 0.0100) MultiSource/Applications/JM/lencod/lencod: -2.27% (21.9371 => 21.4402, std.dev.: 0.0042) MultiSource/Benchmarks/PAQ8p/paq8p: -1.58% (10.3673 => 10.2036, std.dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -35.18% (0.0506 => 0.0328, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -35.14% (0.3987 => 0.2586) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7652, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -28.80% (10.7105 => 7.6260, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/flops-6: -15.95% (1.6925 => 1.4225, std.dev.: 0.0025) MultiSource/Benchmarks/NPB-serial/is/is: -10.98% (9.5636 => 8.5133, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -10.82% (1.5373 => 1.3710, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.33% (19.9488 => 18.2870, std.dev.: 0.0585) MultiSource/Benchmarks/FreeBench/mason/mason: -8.01% (0.2161 => 0.1988, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.16% (1.8329 => 1.7017, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -6.77% (1.2373 => 1.1535, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5753, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.11% (1.6805 => 1.5947, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: -5.00% (6.6465 => 6.3143, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.60% (1.5660 => 1.4939, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.55% (1.5835 => 1.5115, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.40% (0.9957 => 0.9519, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.04% (0.2497 => 0.2396, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.81% (3.2827 => 3.1577, std.dev.: 0.0100) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -3.78% (4.5009 => 4.3308, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.48% (32.5116 => 31.3789, std.dev.: 0.0098) MultiSource/Benchmarks/sim/sim: -3.23% (5.0483 => 4.8850, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: -2.76% (4.6441 => 4.5161, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.50% (0.4808 => 0.4688, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/Olden/power/power: -2.14% (1.1277 => 1.1036, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.91% (8.1563 => 8.0002, std.dev.: 0.0232) SingleSource/Benchmarks/Misc/salsa20: -1.87% (10.2830 => 10.0905, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops: -1.76% (8.8334 => 8.6781, std.dev.: 0.0025) SingleSource/UnitTests/Vector/multiplies: -1.52% (2.5528 => 2.5139, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -1.28% (85.0658 => 83.9808, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout/lists: -1.12% (6.2999 => 6.2292, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8586, std.dev.: 0.0052) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -5.45% (0.1485 => 0.1404) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648) Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 16:13:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 18:13:27 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121031231327.70A232A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5462?compare_to=5459&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5462, Order: 167173, Start Time: 2012-10-31 21:46:23, End Time: 2012-10-31 23:13:30 To: 5459, Order: 167161, Start Time: 2012-10-31 20:01:52, End Time: 2012-10-31 21:28:56 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 6 (99 on baseline) Performance Improvements: 22 (4 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 963 (871 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.63% (14.2481 => 16.9024, std.dev.: 0.3153) MultiSource/Applications/SPASS/SPASS: 3.25% (8.2709 => 8.5398, std.dev.: 0.0512) SingleSource/Benchmarks/Shootout-C++/except: 3.02% (0.4838 => 0.4984, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 2.22% (0.7605 => 0.7774, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/whetstone: 1.72% (2.1044 => 2.1406, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/ReedSolomon: 1.14% (8.6917 => 8.7906, std.dev.: 0.0187) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -3.68% (1.3195 => 1.2710, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.33% (0.8110 => 0.7840, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.27% (0.3522 => 0.3407, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -3.09% (0.6709 => 0.6502, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -2.80% (1.4020 => 1.3627, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -2.79% (1.3050 => 1.2686, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.67% (0.6253 => 0.6086, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -2.61% (9.0961 => 8.8588, std.dev.: 0.0458) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.58% (1.2413 => 1.2093, std.dev.: 0.0119) MultiSource/Benchmarks/MallocBench/gs/gs: -2.53% (4.2975 => 4.1886, std.dev.: 0.0311) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -2.45% (0.6120 => 0.5970, std.dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: -2.37% (1.2029 => 1.1744, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -2.34% (4.3518 => 4.2500, std.dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -1.89% (0.6556 => 0.6432, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.73% (0.9267 => 0.9107, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.71% (0.8964 => 0.8811, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/football/football: -1.59% (0.9123 => 0.8978, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.58% (13.6317 => 13.4161, std.dev.: 0.0314) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.29% (4.7229 => 4.6621, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.04% (4.6295 => 4.5813, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.03% (1.2664 => 1.2533, std.dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -1.41% (1.3271 => 1.3084, std.dev.: 0.0041) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -1.19% (16.7419 => 16.5427, std.dev.: 0.1585) MultiSource/Applications/obsequi/Obsequi: -0.62% (1.0726 => 1.0659, std.dev.: 0.0057) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.19% (21.6453 => 21.6050, std.dev.: 0.0090) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.40% (0.3633 => 0.3684, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -0.43% (0.6026 => 0.6000, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.42% (0.3325 => 0.3311, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/strcat: 0.55% (0.1995 => 0.2006, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 60.74% (0.0135 => 0.0217, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 8.14% (0.0393 => 0.0425, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 26.05% (0.0261 => 0.0329, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 6.12% (0.0294 => 0.0312, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0424 => 0.0424) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0203 => 0.0202, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 9.05% (0.0199 => 0.0217, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -1.51% (0.1454 => 0.1432, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.56% (1.1320 => 1.1497, std.dev.: 0.0223) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 6.37% (0.1428 => 0.1519, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.39% (0.4067 => 0.4051, std.dev.: 0.0180) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.34% (0.1365 => 0.1333, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.31% (0.0649 => 0.0664, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -28.73% (0.0275 => 0.0196, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.52% (0.0553 => 0.0578, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.53% (1.1423 => 1.1483, std.dev.: 0.0238) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0031 => 0.0031, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 3.85% (0.0026 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.37% (0.0652 => 0.0630, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -27.07% (0.0266 => 0.0194, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.17% (0.8027 => 0.8013, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: -75.00% (0.0004 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 97.22% (0.0036 => 0.0071, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2309.32% (0.6332 => 15.2558, std.dev.: 0.1236) MultiSource/Benchmarks/McCat/08-main/main: 46.86% (0.1831 => 0.2689, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.93% (0.1559 => 0.1451, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1485.05% (0.3344 => 5.3004, std.dev.: 0.0902) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.17% (0.2364 => 0.3219, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/mandel: 3.50% (0.0429 => 0.0444, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.45% (0.0224 => 0.0223, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3518, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0750, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4867, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3573, std.dev.: 0.0249) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0429, std.dev.: 0.0172) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4012, std.dev.: 0.0111) SingleSource/Regression/C/uint64_to_float: -23.99% (2.1832 => 1.6595, std.dev.: 0.0036) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.68% (0.0810 => 0.0937, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 11.78% (0.1112 => 0.1243, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.84% (0.8321 => 0.8973, std.dev.: 0.0095) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.48% (0.2180 => 0.2343, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.37% (0.1425 => 0.1530, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.02% (0.6010 => 0.6432, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.71% (0.4847 => 0.5172, std.dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.09% (0.3137 => 0.3328, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.06% (0.8148 => 0.8642, std.dev.: 0.0144) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.04% (0.1905 => 0.2020, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.97% (0.2279 => 0.2415, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.58% (0.2133 => 0.2252, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.45% (0.1983 => 0.2091, std.dev.: 0.0037) MultiSource/Applications/sgefa/sgefa: 4.93% (0.2999 => 0.3147, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.91% (0.7473 => 0.7840, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.64% (0.2998 => 0.3137, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.35% (0.4783 => 0.4991, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.33% (0.2519 => 0.2628, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.20% (1.1685 => 1.2176, std.dev.: 0.0039) MultiSource/Benchmarks/nbench/nbench: 4.20% (1.1271 => 1.1744, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.20% (1.1606 => 1.2093, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.10% (0.3003 => 0.3126, std.dev.: 0.0024) MultiSource/Applications/hbd/hbd: 4.02% (1.4269 => 1.4842, std.dev.: 0.0105) MultiSource/Applications/Burg/burg: 3.85% (1.2222 => 1.2693, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.57% (0.9435 => 0.9772, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.42% (0.6287 => 0.6502, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.40% (0.3295 => 0.3407, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.35% (0.5191 => 0.5365, std.dev.: 0.0041) MultiSource/Applications/ClamAV/clamscan: 3.32% (14.7684 => 15.2593, std.dev.: 0.0468) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.24% (0.6227 => 0.6429, std.dev.: 0.0060) MultiSource/Applications/SIBsim4/SIBsim4: 3.13% (1.2568 => 1.2961, std.dev.: 0.0078) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.96% (6.6074 => 6.8030, std.dev.: 0.0199) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.93% (0.4127 => 0.4248, std.dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 2.74% (14.2605 => 14.6519, std.dev.: 0.1246) MultiSource/Applications/siod/siod: 2.70% (2.2184 => 2.2782, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.63% (0.5817 => 0.5970, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.62% (1.6386 => 1.6816, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.62% (1.3279 => 1.3627, std.dev.: 0.0014) MultiSource/Applications/lua/lua: 2.54% (3.8189 => 3.9160, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.52% (0.8697 => 0.8916, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.44% (8.6476 => 8.8588, std.dev.: 0.0458) MultiSource/Benchmarks/Prolangs-C/football/football: 2.40% (0.8768 => 0.8978, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.36% (0.8716 => 0.8922, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.36% (0.8611 => 0.8814, std.dev.: 0.0037) MultiSource/Applications/minisat/minisat: 2.36% (0.6834 => 0.6995, std.dev.: 0.0027) MultiSource/Applications/lemon/lemon: 2.34% (1.0945 => 1.1201, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.23% (0.8457 => 0.8646, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.23% (0.9688 => 0.9904, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.22% (0.8597 => 0.8788, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.11% (0.8066 => 0.8236, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.10% (0.8317 => 0.8492, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.09% (4.4873 => 4.5813, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.09% (0.9056 => 0.9245, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.08% (0.8261 => 0.8433, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.08% (0.8316 => 0.8489, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.07% (0.9074 => 0.9262, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.06% (0.8805 => 0.8986, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.04% (2.1401 => 2.1837, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.04% (0.8007 => 0.8170, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.01% (4.5702 => 4.6621, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.99% (0.9908 => 1.0105, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.97% (0.8712 => 0.8884, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.97% (1.1170 => 1.1390, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.94% (0.8331 => 0.8493, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.92% (0.9039 => 0.9213, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.90% (0.9069 => 0.9241, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.81% (0.8050 => 0.8196, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.79% (0.8656 => 0.8811, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.78% (13.1811 => 13.4161, std.dev.: 0.0314) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.78% (0.8048 => 0.8191, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.77% (0.7932 => 0.8072, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.76% (4.1763 => 4.2500, std.dev.: 0.0159) MultiSource/Applications/JM/lencod/lencod: 1.75% (15.3280 => 15.5968, std.dev.: 0.0921) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.71% (0.8359 => 0.8502, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.69% (0.8177 => 0.8315, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.67% (0.8086 => 0.8221, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.67% (0.8286 => 0.8424, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.66% (0.8204 => 0.8340, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.65% (1.4479 => 1.4718, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.64% (0.8518 => 0.8658, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.59% (0.8855 => 0.8996, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.54% (0.8420 => 0.8550, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.54% (0.8885 => 0.9022, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 1.54% (8.6247 => 8.7571, std.dev.: 0.0240) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.25% (0.8069 => 0.8170, std.dev.: 0.0022) MultiSource/Benchmarks/Bullet/bullet: 1.24% (31.8598 => 32.2545, std.dev.: 0.0427) MultiSource/Benchmarks/PAQ8p/paq8p: 1.23% (2.3764 => 2.4056, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 57.16% (1.5795 => 2.4824, std.dev.: 0.0116) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.46% (2.7978 => 3.7340, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.41% (14.6451 => 16.9024, std.dev.: 0.3153) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.93% (1.1857 => 1.2797, std.dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 5.94% (63.1822 => 66.9346, std.dev.: 0.0062) MultiSource/Benchmarks/BitBench/drop3/drop3: 4.02% (0.2887 => 0.3003, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/ReedSolomon: 3.03% (8.5322 => 8.7906, std.dev.: 0.0187) MultiSource/Applications/siod/siod: 2.72% (3.6643 => 3.7638, std.dev.: 0.0377) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 2.33% (0.7597 => 0.7774, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.84% (1.5941 => 1.6234, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: 1.64% (0.6205 => 0.6307, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.21% (4.8362 => 4.8949, std.dev.: 0.0222) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.31% (0.3269 => 0.3030, std.dev.: 0.0007) MultiSource/Applications/lua/lua: -5.37% (29.8330 => 28.2316, std.dev.: 0.1544) SingleSource/Benchmarks/Shootout-C++/hash2: -1.46% (3.4237 => 3.3738, std.dev.: 0.0150) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.35% (3.3479 => 3.3028, std.dev.: 0.0105) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.59% (16.4461 => 16.5427, std.dev.: 0.1585) MultiSource/Applications/obsequi/Obsequi: 3.87% (1.0262 => 1.0659, std.dev.: 0.0057) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6818.03% (0.3123 => 21.6050, std.dev.: 0.0090) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.57% (0.2463 => 0.3684, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: -0.17% (0.6010 => 0.6000, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.38% (0.3266 => 0.3311, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/strcat: 1.88% (0.1969 => 0.2006, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 76.42% (0.0123 => 0.0217, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.17% (0.0408 => 0.0425, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.53% (0.0254 => 0.0329, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0384 => 0.0424) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.42% (0.1438 => 0.1432, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.48% (1.1329 => 1.1497, std.dev.: 0.0223) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.90% (0.1462 => 0.1519, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.71% (0.4164 => 0.4051, std.dev.: 0.0180) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.63% (0.1369 => 0.1333, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.59% (0.0641 => 0.0664, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.51% (0.0195 => 0.0196, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: - (0.0578 => 0.0578, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.40% (1.1437 => 1.1483, std.dev.: 0.0238) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3000.00% (0.0001 => 0.0031, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.48% (0.0627 => 0.0630, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.78% (0.0180 => 0.0194, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.05% (0.8017 => 0.8013, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 14.52% (0.0062 => 0.0071, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 16:43:38 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 18:43:38 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121031234338.A86602A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5463?compare_to=5460&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5463, Order: 167174, Start Time: 2012-10-31 22:18:35, End Time: 2012-10-31 23:43:39 To: 5460, Order: 167161, Start Time: 2012-10-31 20:30:31, End Time: 2012-10-31 21:55:31 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (5 on baseline) Performance Improvements: 3 (176 on baseline) Unchanged Tests: 1038 (861 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.84% (77.8587 => 80.8506, std.dev.: 0.9162) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/lambda-0_1_3/lambda: -1.71% (0.7668 => 0.7537, std.dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: -1.15% (17.4676 => 17.2672, std.dev.: 0.0227) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.77% (56.4418 => 54.3146, std.dev.: 0.1509) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.15% (3.1919 => 3.4200, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.76% (2.0478 => 2.1044, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/salsa20: 2.49% (7.4937 => 7.6800, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash2: 2.28% (3.1932 => 3.2661, std.dev.: 0.0051) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -9.34% (0.1584 => 0.1436, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.46% (0.1431 => 0.1310) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.41% (0.3821 => 0.3538, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -7.26% (2.4924 => 2.3115, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.80% (0.2428 => 0.2263, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.56% (0.3658 => 0.3418, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.49% (0.3142 => 0.2938, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.42% (0.3831 => 0.3585, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -6.39% (0.3848 => 0.3602, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -6.39% (0.3880 => 0.3632, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -6.37% (0.3812 => 0.3569, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.36% (0.3884 => 0.3637, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.32% (3.5339 => 3.3104, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.32% (0.3891 => 0.3645, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.30% (0.4033 => 0.3779, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: -6.29% (0.4199 => 0.3935, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -6.27% (0.4176 => 0.3914, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.27% (0.9542 => 0.8944, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -6.26% (0.3896 => 0.3652, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.21% (4.5069 => 4.2268, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/methcall: -6.15% (0.3025 => 0.2839, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.13% (22.4056 => 21.0330, std.dev.: 0.0156) SingleSource/UnitTests/ObjC/parameter-passing: -6.12% (0.4280 => 0.4018, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/gs/gs: -6.12% (4.3330 => 4.0678, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/ReedSolomon: -6.12% (0.1879 => 0.1764, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.10% (0.3837 => 0.3603, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: -6.05% (0.2659 => 0.2498, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -6.05% (0.3357 => 0.3154, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.03% (2.1713 => 2.0403, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.03% (0.3931 => 0.3694, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: -6.02% (16.1920 => 15.2168, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.02% (0.9852 => 0.9259, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -6.02% (1.2515 => 1.1762, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.01% (0.6484 => 0.6094, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: -6.01% (0.3194 => 0.3002, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: -6.00% (7.0961 => 6.6703, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.99% (0.3323 => 0.3124, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.97% (0.4321 => 0.4063, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -5.97% (2.4021 => 2.2587, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.96% (0.2903 => 0.2730, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.93% (0.4151 => 0.3905, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: -5.90% (0.3255 => 0.3063, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.87% (0.3252 => 0.3061, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -5.86% (0.2849 => 0.2682, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.86% (0.4813 => 0.4531, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.86% (0.3057 => 0.2878, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: -5.85% (0.2989 => 0.2814, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -5.85% (0.2939 => 0.2767, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.84% (0.3016 => 0.2840, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/oourafft: -5.83% (0.2160 => 0.2034, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.83% (0.1716 => 0.1616, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: -5.82% (1.3148 => 1.2383, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.82% (0.2355 => 0.2218, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.80% (4.8161 => 4.5369, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.78% (4.0323 => 3.7993, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.77% (0.7919 => 0.7462, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.77% (1.6474 => 1.5524, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.72% (1.0544 => 0.9941, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary2: -5.72% (0.3481 => 0.3282, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/wc: -5.71% (0.3205 => 0.3022, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -5.69% (0.3446 => 0.3250, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: -5.68% (0.4861 => 0.4585, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.66% (4.8802 => 4.6041, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.65% (0.5999 => 0.5660, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.63% (0.4083 => 0.3853, std.dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: -5.61% (18.2933 => 17.2672, std.dev.: 0.0227) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.60% (1.2784 => 1.2068, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -5.59% (0.3059 => 0.2888, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.58% (5.4682 => 5.1629, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -5.58% (0.7982 => 0.7537, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: -5.57% (0.3394 => 0.3205, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.53% (0.2548 => 0.2407, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -5.52% (0.3621 => 0.3421, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists1: -5.51% (0.3867 => 0.3654, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -5.50% (34.0927 => 32.2185, std.dev.: 0.0221) MultiSource/Benchmarks/Prolangs-C/football/football: -5.48% (0.9179 => 0.8676, std.dev.: 0.0035) MultiSource/Applications/lua/lua: -5.46% (4.0594 => 3.8376, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.42% (0.4427 => 0.4187, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.41% (1.2300 => 1.1634, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: -5.41% (0.3788 => 0.3583, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.38% (0.3849 => 0.3642, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/bigfib: -5.38% (0.6750 => 0.6387, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.37% (0.8521 => 0.8063, std.dev.: 0.0034) MultiSource/Applications/lemon/lemon: -5.34% (1.1450 => 1.0839, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.33% (1.6364 => 1.5491, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.30% (0.2999 => 0.2840, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: -5.27% (0.4248 => 0.4024, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.26% (1.4642 => 1.3872, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: -5.26% (0.7779 => 0.7370, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.23% (1.3722 => 1.3004, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: -5.23% (0.2985 => 0.2829, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.21% (14.2083 => 13.4686, std.dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.20% (0.6293 => 0.5966, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.13% (0.5925 => 0.5621, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: -5.12% (9.2283 => 8.7558, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.11% (0.2933 => 0.2783, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.10% (2.2587 => 2.1436, std.dev.: 0.0158) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.09% (0.2278 => 0.2162, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.08% (0.3483 => 0.3306, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.07% (0.7198 => 0.6833, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.07% (6.7716 => 6.4285, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.05% (0.5859 => 0.5563, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.03% (0.5802 => 0.5510, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.96% (0.5805 => 0.5517, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -4.96% (0.7447 => 0.7078, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.95% (0.5575 => 0.5299, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.94% (0.6052 => 0.5753, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.93% (0.6304 => 0.5993, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.93% (0.5478 => 0.5208, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -4.92% (0.4515 => 0.4293, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -4.91% (17.1032 => 16.2629, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.90% (0.5863 => 0.5576, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.89% (0.6660 => 0.6334, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.89% (1.2221 => 1.1623, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.89% (0.6194 => 0.5891, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: -4.89% (0.4524 => 0.4303, std.dev.: 0.0045) SingleSource/UnitTests/ObjC++/property-reference-object: -4.88% (0.6441 => 0.6127, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.87% (0.5705 => 0.5427, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.87% (0.5857 => 0.5572, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.86% (0.5591 => 0.5319, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: -4.86% (0.3271 => 0.3112, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.86% (1.2210 => 1.1617, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.86% (0.5849 => 0.5565) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.84% (0.2106 => 0.2004, std.dev.: 0.0014) MultiSource/Applications/treecc/treecc: -4.83% (2.1401 => 2.0368, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.82% (0.6260 => 0.5958, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -4.82% (0.6347 => 0.6041, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.81% (0.6297 => 0.5994, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.81% (0.5570 => 0.5302, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.80% (0.9557 => 0.9098, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.80% (0.7524 => 0.7163, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.78% (0.4916 => 0.4681, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.78% (0.6676 => 0.6357, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.77% (0.6681 => 0.6362, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.77% (0.6230 => 0.5933, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.75% (0.6446 => 0.6140, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.73% (0.3319 => 0.3162, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.73% (0.5688 => 0.5419, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.72% (0.5567 => 0.5304, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.72% (0.5569 => 0.5306, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.72% (0.6395 => 0.6093, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: -4.72% (0.3581 => 0.3412, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.71% (0.7339 => 0.6993, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.70% (0.3491 => 0.3327, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.68% (0.6667 => 0.6355, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.66% (0.5581 => 0.5321, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.61% (0.6440 => 0.6143, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: -4.61% (15.5079 => 14.7929, std.dev.: 0.0133) MultiSource/Benchmarks/sim/sim: -4.61% (0.3406 => 0.3249, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.56% (0.2695 => 0.2572, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.55% (0.5456 => 0.5208, std.dev.: 0.0070) MultiSource/Applications/spiff/spiff: -4.54% (0.8418 => 0.8036, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.53% (0.2385 => 0.2277, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.53% (0.6736 => 0.6431, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.51% (0.5941 => 0.5673, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.49% (0.6395 => 0.6108, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: -4.41% (1.3864 => 1.3253, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.32% (8.0126 => 7.6661, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.17% (0.7021 => 0.6728, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: -4.05% (3.5154 => 3.3732, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.02% (0.5168 => 0.4960, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: -4.00% (1.1530 => 1.1069, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -3.93% (15.2527 => 14.6534, std.dev.: 0.0153) MultiSource/Applications/hbd/hbd: -3.91% (1.5610 => 1.4999, std.dev.: 0.0034) MultiSource/Applications/oggenc/oggenc: -3.87% (5.0226 => 4.8282, std.dev.: 0.0050) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.82% (0.9077 => 0.8730, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.60% (0.5329 => 0.5137, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -2.10% (20.7746 => 20.3378, std.dev.: 0.0371) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7534, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1724, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.95% (2.2633 => 2.1740, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7064, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0245, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.50% (6.5735 => 6.4748, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0004) Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 17:00:26 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 19:00:26 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121101000026.072BB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5464?compare_to=5461&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5464, Order: 167174, Start Time: 2012-10-31 22:27:37, End Time: 2012-11-01 00:00:28 To: 5461, Order: 167161, Start Time: 2012-10-31 20:25:04, End Time: 2012-10-31 21:57:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 0 (177 on baseline) Performance Improvements: 0 (53 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 2 (2 on baseline) Unchanged Tests: 1040 (659 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: - (0.1404 => 0.1404) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0648 => 0.0648) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 191.53% (0.5229 => 1.5244, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 13.45% (14.9895 => 17.0060, std.dev.: 0.0188) MultiSource/Applications/kimwitu++/kc: 36.50% (14.1553 => 19.3218, std.dev.: 0.0217) MultiSource/Benchmarks/MallocBench/gs/gs: 12.64% (4.1105 => 4.6300, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 29.39% (1.1048 => 1.4295, std.dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 308.20% (7.1582 => 29.2197, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++-EH/spirit: 69.12% (3.4629 => 5.8566, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 63.85% (0.6222 => 1.0195, std.dev.: 0.0048) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10598.06% (0.0720 => 7.7026, std.dev.: 0.0037) MultiSource/Applications/SIBsim4/SIBsim4: 3835900.00% (0.0001 => 3.8360, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 11198000.00% (0.0001 => 11.1981, std.dev.: 0.0216) MultiSource/Applications/kimwitu++/kc: 50300.00% (0.0001 => 0.0504, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63800.00% (0.0001 => 0.0639, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 781900.00% (0.0001 => 0.7820, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10052100.00% (0.0001 => 10.0522, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5499700.00% (0.0001 => 5.4998, std.dev.: 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 38.07% (0.1056 => 0.1458, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 30.03% (0.1432 => 0.1862, std.dev.: 0.0000) SingleSource/UnitTests/vla: 29.86% (0.0355 => 0.0461, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.56% (0.1566 => 0.1888) SingleSource/Benchmarks/CoyoteBench/almabench: 19.18% (0.0730 => 0.0870, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 17.36% (0.1175 => 0.1379, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.28% (0.0793 => 0.0930, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 17.25% (0.3177 => 0.3725, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 17.16% (0.0746 => 0.0874, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 17.11% (0.0871 => 0.1020) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 16.75% (0.4879 => 0.5696, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 16.41% (0.2554 => 0.2973, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: 16.13% (0.0626 => 0.0727, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.94% (0.8172 => 0.9475, std.dev.: 0.0032) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 15.40% (0.1584 => 0.1828, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.35% (0.0834 => 0.0962, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 15.16% (0.0798 => 0.0919, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.08% (0.0842 => 0.0969, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/mst/mst: 15.05% (0.1163 => 0.1338, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 14.99% (0.1695 => 0.1949, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 14.68% (0.1655 => 0.1898, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.56% (0.0886 => 0.1015, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 14.38% (0.1940 => 0.2219, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 14.28% (0.5105 => 0.5834, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.22% (0.2700 => 0.3084, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.09% (0.2065 => 0.2356, std.dev.: 0.0021) MultiSource/Applications/viterbi/viterbi: 14.08% (0.1555 => 0.1774, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.99% (0.1337 => 0.1524, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 13.91% (0.7115 => 0.8105, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.90% (0.0770 => 0.0877, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.84% (0.1510 => 0.1719, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.81% (0.2758 => 0.3139, std.dev.: 0.0034) MultiSource/Benchmarks/SciMark2-C/scimark2: 13.75% (0.3121 => 0.3550, std.dev.: 0.0018) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.65% (0.1143 => 0.1299, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.61% (0.1117 => 0.1269, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.56% (0.5981 => 0.6792, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 13.51% (0.3109 => 0.3529, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 13.47% (0.1151 => 0.1306, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 13.40% (0.7433 => 0.8429, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.38% (0.2107 => 0.2389, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.36% (0.6675 => 0.7567, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 13.32% (1.1642 => 1.3193, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.25% (0.0770 => 0.0872, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.17% (0.2271 => 0.2570, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 13.16% (0.1125 => 0.1273, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.14% (0.9765 => 1.1048, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 13.01% (3.3354 => 3.7695, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 13.01% (0.7835 => 0.8854, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.83% (0.1029 => 0.1161, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.80% (0.5860 => 0.6610, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/exptree: 12.78% (0.0814 => 0.0918, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.77% (1.5415 => 1.7384, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.70% (0.4615 => 0.5201, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.62% (0.1062 => 0.1196, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.53% (2.2022 => 2.4782, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.50% (0.1032 => 0.1161, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.44% (0.5569 => 0.6262, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.30% (0.1236 => 0.1388, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.29% (0.3441 => 0.3864, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.18% (0.1625 => 0.1823, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.13% (0.5020 => 0.5629, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.08% (1.3050 => 1.4627, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/health/health: 12.07% (0.1268 => 0.1421, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 11.98% (2.0273 => 2.2701, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/18-imp/imp: 11.89% (0.3423 => 0.3830, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.88% (0.3307 => 0.3700, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 11.85% (3.8723 => 4.3311, std.dev.: 0.0099) SingleSource/UnitTests/SignlessTypes/rem: 11.45% (0.1144 => 0.1275, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.32% (0.3543 => 0.3944, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.29% (0.2603 => 0.2897, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.29% (4.2646 => 4.7461, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/neural/neural: 11.28% (0.1463 => 0.1628, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.27% (1.5859 => 1.7646, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 11.24% (1.0722 => 1.1927, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.16% (0.6450 => 0.7170, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/life/life: 11.15% (0.0933 => 0.1037, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.09% (0.1695 => 0.1883, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.09% (0.0929 => 0.1032, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.08% (0.3927 => 0.4362, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 11.07% (0.4299 => 0.4775, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 10.91% (0.3473 => 0.3852, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 10.87% (0.4289 => 0.4755, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 10.86% (9.4845 => 10.5142, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.82% (2.2024 => 2.4406, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 10.79% (0.3828 => 0.4241, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.75% (0.3516 => 0.3894, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.73% (0.1044 => 0.1156, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 10.73% (0.3561 => 0.3943, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.73% (0.3543 => 0.3923, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 10.69% (0.3497 => 0.3871, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.64% (8.1363 => 9.0019, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/09-vor/vor: 10.57% (0.3180 => 0.3516, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/bigfib: 10.56% (0.6456 => 0.7138, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.56% (0.3694 => 0.4084, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.55% (0.1906 => 0.2107, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 10.47% (1.1840 => 1.3080, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/football/football: 10.47% (0.8921 => 0.9855, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.45% (0.3886 => 0.4292, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 10.42% (2.2969 => 2.5363, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.32% (0.8101 => 0.8937, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.09% (0.3865 => 0.4255, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 10.01% (0.3387 => 0.3726, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 9.91% (0.4620 => 0.5078, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 9.84% (1.1861 => 1.3028, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.71% (1.4186 => 1.5564, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 9.67% (0.3422 => 0.3753, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.54% (0.4203 => 0.4604, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.36% (0.4103 => 0.4487, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.36% (0.1892 => 0.2069) MultiSource/Applications/hbd/hbd: 9.25% (1.5603 => 1.7046, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.19% (0.4636 => 0.5062, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 8.96% (0.3684 => 0.4014, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 8.91% (0.1268 => 0.1381, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 8.82% (0.4048 => 0.4405, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/sieve: 8.77% (0.3603 => 0.3919, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.74% (5.0018 => 5.4391, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 8.66% (0.6030 => 0.6552, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.66% (4.9449 => 5.3729, std.dev.: 0.0100) SingleSource/UnitTests/ObjC++/Hello: 8.64% (0.5925 => 0.6437, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.57% (0.7326 => 0.7954, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.57% (0.1330 => 0.1444, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.48% (0.2430 => 0.2636, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.36% (0.3826 => 0.4146, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.16% (0.3650 => 0.3948, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.13% (0.2793 => 0.3020, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.09% (0.2891 => 0.3125, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 8.02% (0.2831 => 0.3058, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.94% (0.3162 => 0.3413, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 7.91% (5.7591 => 6.2149, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary3: 7.89% (0.3283 => 0.3542, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.85% (2.0665 => 2.2287, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 7.78% (0.2725 => 0.2937, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 7.78% (0.2905 => 0.3131, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.75% (0.4064 => 0.4379, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 7.67% (0.3232 => 0.3480, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.58% (0.2756 => 0.2965, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 7.55% (0.3098 => 0.3332, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 7.54% (0.3052 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.44% (0.2714 => 0.2916, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 7.38% (0.2871 => 0.3083, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.37% (14.3668 => 15.4259, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/methcall: 7.37% (0.2877 => 0.3089, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.28% (0.2872 => 0.3081, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.24% (0.2802 => 0.3005, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.03% (0.3427 => 0.3668, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 6.89% (0.3282 => 0.3508, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 6.74% (1.2842 => 1.3707, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary2: 6.63% (0.3379 => 0.3603, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 6.53% (17.1811 => 18.3027, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.41% (0.3136 => 0.3337, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.26% (3.8922 => 4.1359, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: 6.21% (0.3092 => 0.3284, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.17% (0.8067 => 0.8565, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.00% (0.2266 => 0.2402, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.46% (0.3131 => 0.3302, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.04% (0.3935 => 0.4094, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.22% (0.3817 => 0.3940, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.64% (7.0540 => 7.1700, std.dev.: 0.0122) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 19.80% (2.8904 => 3.4627, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.55% (1.1145 => 1.2989, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.81% (1.1396 => 1.2514, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.11% (0.9540 => 1.0218, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.70% (3.1578 => 3.3693, std.dev.: 0.0062) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.77% (4.2280 => 4.3451, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7654, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.82% (3.6395 => 3.7058, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/bisort/bisort: 1.81% (0.8333 => 0.8484, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2074, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7981, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.18% (6.5088 => 6.5859, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.94% (6.6874 => 0.1376, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -76.50% (0.8651 => 0.2033, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.29% (5.3855 => 2.4078, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -55.09% (5.3526 => 2.4038, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/richards_benchmark: -45.44% (0.1622 => 0.0885, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.87% (5.2763 => 3.1199, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -38.34% (1.1194 => 0.6902, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -24.56% (1.7609 => 1.3284, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.68% (2.9384 => 2.5363, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: -10.50% (10.4361 => 9.3406, std.dev.: 0.0046) SingleSource/UnitTests/Vector/constpool: -9.07% (54.1659 => 49.2508, std.dev.: 0.0337) MultiSource/Benchmarks/Bullet/bullet: -7.36% (63.2438 => 58.5888, std.dev.: 0.0151) MultiSource/Applications/ClamAV/clamscan: -3.47% (22.1758 => 21.4068, std.dev.: 0.0105) MultiSource/Applications/JM/lencod/lencod: -2.56% (21.9371 => 21.3763, std.dev.: 0.0085) MultiSource/Benchmarks/PAQ8p/paq8p: -2.34% (10.3673 => 10.1248, std.dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -35.18% (0.0506 => 0.0328, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -35.14% (0.3987 => 0.2586) SingleSource/Benchmarks/Misc/mandel: -33.42% (1.1492 => 0.7651, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -28.71% (10.7105 => 7.6357, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: -16.03% (1.6925 => 1.4212, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/mandel-2: -11.18% (1.5373 => 1.3654, std.dev.: 0.0053) MultiSource/Benchmarks/NPB-serial/is/is: -10.98% (9.5636 => 8.5135, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.33% (19.9488 => 18.2862, std.dev.: 0.0123) MultiSource/Benchmarks/FreeBench/mason/mason: -7.77% (0.2161 => 0.1993, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.11% (1.8329 => 1.7025, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -6.17% (1.2373 => 1.1610, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.63% (2.7294 => 2.5756, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -5.63% (1.9577 => 1.8475, std.dev.: 0.0040) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.11% (1.6805 => 1.5946, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/oourafft: -4.99% (6.6465 => 6.3148, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: -4.93% (1.8525 => 1.7612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.88% (1.5835 => 1.5062, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.61% (1.5660 => 1.4938, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.49% (0.9957 => 0.9510, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.08% (0.2497 => 0.2395, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -3.79% (4.5009 => 4.3302, std.dev.: 0.0013) MultiSource/Applications/siod/siod: -3.79% (3.2827 => 3.1584, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.54% (32.5116 => 31.3591, std.dev.: 0.0106) MultiSource/Benchmarks/sim/sim: -3.24% (5.0483 => 4.8848, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -2.79% (4.6441 => 4.5146, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.68% (0.4808 => 0.4679, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/Olden/power/power: -2.14% (1.1277 => 1.1036) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.06% (8.1563 => 7.9884, std.dev.: 0.0165) SingleSource/Benchmarks/Misc/salsa20: -2.06% (10.2830 => 10.0714, std.dev.: 0.0331) SingleSource/Benchmarks/Misc/flops: -1.73% (8.8334 => 8.6809, std.dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: -1.61% (2.5528 => 2.5117, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -1.29% (85.0658 => 83.9722, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/whetstone: -1.08% (1.0554 => 1.0440, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8593, std.dev.: 0.0129) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -5.45% (0.1485 => 0.1404) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648) Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 17:10:43 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 19:10:43 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121101001043.F23F12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5465?compare_to=5457&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5465, Order: 167161, Start Time: 2012-10-31 20:55:09, End Time: 2012-11-01 00:10:46 To: 5457, Order: 167130, Start Time: 2012-10-31 16:51:06, End Time: 2012-10-31 20:06:42 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (170 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1038 (719 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.79% (1.9767 => 2.0121, std.dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: 1.31% (27.1349 => 27.4893, std.dev.: 0.0033) SingleSource/UnitTests/Vector/constpool: 1.09% (2.4171 => 2.4435, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.43% (54.2538 => 55.0319, std.dev.: 0.0402) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.92% (0.0625 => 0.0887, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.02% (0.1063 => 0.1414, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 26.29% (1.5932 => 2.0121, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.08% (0.4253 => 0.5362, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 26.07% (0.2969 => 0.3743, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.77% (0.1106 => 0.1391, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.65% (0.0714 => 0.0890, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.64% (0.4139 => 0.5159, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.56% (0.5000 => 0.6178, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.43% (0.4994 => 0.6164, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.40% (0.0547 => 0.0675, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.39% (0.5900 => 0.7280, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.97% (0.0897 => 0.1103, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.95% (0.0475 => 0.0584) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.95% (0.0584 => 0.0718, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.86% (0.1107 => 0.1349, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.79% (0.1620 => 0.1973, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.74% (0.1021 => 0.1243, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 21.70% (0.0599 => 0.0729, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.17% (0.1549 => 0.1877, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.70% (0.0541 => 0.0653, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 20.70% (0.0604 => 0.0729, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 20.46% (0.0948 => 0.1142, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.40% (0.0642 => 0.0773, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.37% (0.3903 => 0.4698, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.22% (0.0633 => 0.0761, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.21% (0.0584 => 0.0702, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.13% (0.1103 => 0.1325, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: 19.98% (0.0821 => 0.0985, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.95% (0.1604 => 0.1924, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 19.89% (0.1619 => 0.1941, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.84% (0.1003 => 0.1202, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.46% (0.0822 => 0.0982, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 18.90% (0.0947 => 0.1126, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.88% (0.1462 => 0.1738, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.87% (0.3890 => 0.4624, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 18.69% (0.5826 => 0.6915, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 18.69% (0.0808 => 0.0959, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference-object: 18.46% (0.5889 => 0.6976, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.30% (1.3152 => 1.5559, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/08-main/main: 18.23% (0.1218 => 0.1440, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.17% (0.2014 => 0.2380, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 18.17% (0.4029 => 0.4761, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 17.87% (0.1505 => 0.1774, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.87% (0.2736 => 0.3225, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.74% (0.1088 => 0.1281, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 17.56% (0.0581 => 0.0683, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 17.53% (0.5546 => 0.6518, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.52% (0.2866 => 0.3368, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 17.48% (1.8794 => 2.2080, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/mst/mst: 17.48% (0.0698 => 0.0820, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.38% (3.5627 => 4.1819, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.18% (0.3271 => 0.3833, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.02% (0.0605 => 0.0708, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 16.99% (0.9697 => 1.1345, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.94% (0.2875 => 0.3362, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.89% (0.5026 => 0.5875, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 16.88% (1.0781 => 1.2601, std.dev.: 0.0106) MultiSource/Benchmarks/Bullet/bullet: 16.88% (23.5202 => 27.4893, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.74% (1.6211 => 1.8924, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.72% (0.4658 => 0.5437, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.72% (0.1968 => 0.2297, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.64% (0.1160 => 0.1353, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 16.47% (0.1421 => 0.1655, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.46% (0.4361 => 0.5079, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/fibo: 16.37% (0.2725 => 0.3171, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.35% (4.4195 => 5.1423, std.dev.: 0.0057) SingleSource/UnitTests/ObjC++/property-reference: 16.30% (0.7171 => 0.8340, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.29% (0.2738 => 0.3184, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 16.25% (0.3004 => 0.3492, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 16.22% (0.2823 => 0.3281, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 16.14% (0.2813 => 0.3267, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 16.14% (0.2714 => 0.3152, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.09% (0.2729 => 0.3168, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 16.01% (0.2780 => 0.3225, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 16.00% (0.2750 => 0.3190, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 15.91% (0.9909 => 1.1486, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.90% (0.2792 => 0.3236, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.90% (2.0673 => 2.3960, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/random: 15.88% (0.2803 => 0.3248, std.dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.85% (2.7292 => 3.1619, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 15.83% (0.2811 => 0.3256, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 15.81% (0.1284 => 0.1487, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.81% (0.3195 => 0.3700, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 15.79% (0.3096 => 0.3585, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 15.78% (4.2109 => 4.8754, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.78% (0.1090 => 0.1262, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.78% (0.3930 => 0.4550, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.77% (0.2911 => 0.3370, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 15.65% (0.3317 => 0.3836, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.57% (1.9694 => 2.2761, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary3: 15.49% (0.3267 => 0.3773, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.40% (1.9966 => 2.3041, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.38% (0.3362 => 0.3879, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 15.22% (0.3258 => 0.3754, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.03% (0.3060 => 0.3520, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 14.93% (0.3348 => 0.3848, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.72% (0.3124 => 0.3584, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 14.70% (0.2075 => 0.2380, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 14.66% (0.3465 => 0.3973, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 14.61% (0.2566 => 0.2941, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.56% (0.3282 => 0.3760, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.51% (0.3625 => 0.4151, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 14.46% (0.3678 => 0.4210, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 14.39% (1.4269 => 1.6322, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sieve: 14.33% (0.3726 => 0.4260, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: 14.28% (0.3446 => 0.3938, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 14.24% (0.3477 => 0.3972, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.22% (0.3488 => 0.3984, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 14.16% (0.3460 => 0.3950, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 14.16% (0.3496 => 0.3991, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 14.15% (0.3469 => 0.3960, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 14.15% (0.3442 => 0.3929, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 14.11% (0.4251 => 0.4851, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 14.04% (0.4146 => 0.4728, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.92% (0.3981 => 0.4535, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 13.84% (0.7875 => 0.8965, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.82% (0.3690 => 0.4200, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.81% (0.3845 => 0.4376, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/property: 13.81% (0.3650 => 0.4154, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 13.81% (0.3643 => 0.4146, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 13.74% (2.1653 => 2.4628, std.dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: 13.68% (4.6177 => 5.2496, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/parameter-passing: 13.59% (0.3724 => 0.4230, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 13.41% (0.5012 => 0.5684, std.dev.: 0.0035) MultiSource/Applications/SIBsim4/SIBsim4: 13.38% (0.2691 => 0.3051, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 13.19% (2.1013 => 2.3784, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.94% (0.1383 => 0.1562, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.89% (0.2040 => 0.2303, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 12.44% (5.5417 => 6.2311, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.98% (0.6435 => 0.7206, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.80% (0.2068 => 0.2312, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.58% (0.1028 => 0.1147, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 11.49% (0.3498 => 0.3900, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 11.00% (0.4847 => 0.5380, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.92% (0.2737 => 0.3036, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 10.61% (0.6634 => 0.7338, std.dev.: 0.0019) MultiSource/Applications/minisat/minisat: 10.61% (0.3336 => 0.3690, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.60% (0.3084 => 0.3411, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 10.33% (2.0346 => 2.2447, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.99% (0.2103 => 0.2313, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 9.95% (0.2391 => 0.2629, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.27% (4.6926 => 5.1275, std.dev.: 0.0180) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.99% (11.6398 => 12.6862, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.86% (0.5361 => 0.5836, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.29% (0.5584 => 0.6047, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.07% (0.7426 => 0.8025, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 7.14% (11.9555 => 12.8094, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.83% (0.3792 => 0.3975, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.32% (0.2162 => 0.3531, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6536, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.30% (0.5917 => 0.6704, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 9.03% (0.2802 => 0.3055, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.56% (3.3903 => 3.6128, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/objinst: 5.00% (12.0509 => 12.6537, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops: 4.69% (15.4430 => 16.1667, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-2: 3.65% (1.8057 => 1.8716, std.dev.: 0.0051) SingleSource/Benchmarks/Dhrystone/dry: 2.70% (14.0481 => 14.4279, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary3: 2.10% (15.8721 => 16.2049, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.64% (3.1722 => 3.2241, std.dev.: 0.0031) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3072, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2880, std.dev.: 0.0024) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.22% (1.0142 => 1.0266, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/five11/five11: 1.17% (8.4155 => 8.5142, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5935, std.dev.: 0.0173) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.33% (2.4764 => 2.4435, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.57% (25.4195 => 16.3774, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/ary2: -9.91% (0.2402 => 0.2164, std.dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9758, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7762, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/tsp/tsp: -7.19% (2.1113 => 1.9596, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.01% (11.2080 => 10.8707, std.dev.: 0.0376) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7741, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5219, std.dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/fldry: -2.39% (17.2379 => 16.8252, std.dev.: 0.0125) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.21% (41.7953 => 40.8706, std.dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5720, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4950, std.dev.: 0.0057) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.32% (5.7935 => 5.7168, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.21% (21.9346 => 21.6681, std.dev.: 0.0837) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.1974, std.dev.: 0.0375) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0468, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.04% (3.3991 => 3.3639, std.dev.: 0.0042) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 17:58:05 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 19:58:05 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121101005805.054BB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5466?compare_to=5462&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5466, Order: 167176, Start Time: 2012-10-31 23:30:40, End Time: 2012-11-01 00:58:07 To: 5462, Order: 167173, Start Time: 2012-10-31 21:46:23, End Time: 2012-10-31 23:13:30 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 8 (83 on baseline) Performance Improvements: 1 (6 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 982 (885 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mafft/pairlocalalign: 1.76% (8.7571 => 8.9115, std.dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.01% (1.4718 => 1.4867, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.92% (0.3343 => 0.3541, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.30% (41.4512 => 42.4065, std.dev.: 0.1164) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.68% (1.8550 => 1.8861, std.dev.: 0.0090) MultiSource/Benchmarks/BitBench/five11/five11: 1.62% (5.5417 => 5.6316, std.dev.: 0.0288) SingleSource/Benchmarks/Stanford/FloatMM: 1.25% (0.8803 => 0.8913, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/hash: 1.23% (4.2849 => 4.3374, std.dev.: 0.0088) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.20% (16.9024 => 15.5167, std.dev.: 0.1940) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.24% (16.5427 => 16.5832, std.dev.: 0.2353) MultiSource/Applications/obsequi/Obsequi: -0.58% (1.0659 => 1.0597, std.dev.: 0.0270) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.57% (21.6050 => 21.7271, std.dev.: 0.3471) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.73% (0.3684 => 0.3657, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: 0.32% (0.6000 => 0.6019, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.45% (0.3311 => 0.3326, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: 0.50% (0.2006 => 0.2016, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.46% (0.0217 => 0.0218, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.24% (0.0425 => 0.0424, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.30% (0.0329 => 0.0330, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0312 => 0.0312, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.71% (0.0424 => 0.0421, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 0.50% (0.0202 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -0.92% (0.0217 => 0.0215, std.dev.: 0.0018) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 0.21% (0.1432 => 0.1435, std.dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -2.66% (1.1497 => 1.1191, std.dev.: 0.0881) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -2.30% (0.1519 => 0.1484, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.99% (0.4051 => 0.4091, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.35% (0.1333 => 0.1315, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.96% (0.0664 => 0.0651, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 38.27% (0.0196 => 0.0271, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.25% (0.0578 => 0.0565, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.30% (1.1483 => 1.1448, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -48.39% (0.0031 => 0.0016, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -40.74% (0.0027 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.38% (0.0630 => 0.0615, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.77% (0.0194 => 0.0244, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (0.0001 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.70% (0.8013 => 0.7957, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -15.49% (0.0071 => 0.0060, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2321.62% (0.6332 => 15.3337, std.dev.: 0.3415) MultiSource/Benchmarks/McCat/08-main/main: 46.59% (0.1831 => 0.2684, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.06% (0.1559 => 0.1449, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1481.22% (0.3344 => 5.2876, std.dev.: 0.0902) SingleSource/Benchmarks/Misc-C++/Large/ray: 36.38% (0.2364 => 0.3224, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel: 3.26% (0.0429 => 0.0443, std.dev.: 0.0006) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.91% (0.0224 => 0.0235, std.dev.: 0.0001) SingleSource/UnitTests/byval-alignment: -26.52% (0.0230 => 0.0169, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3441, std.dev.: 0.0268) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0703, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4945, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3362, std.dev.: 0.0358) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0224, std.dev.: 0.0138) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4063, std.dev.: 0.0043) SingleSource/Regression/C/uint64_to_float: -24.38% (2.1832 => 1.6509, std.dev.: 0.0068) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.53% (0.0810 => 0.0952, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 12.41% (0.1112 => 0.1250, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 8.80% (0.1137 => 0.1237, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.57% (0.2180 => 0.2345, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.34% (0.8321 => 0.8932, std.dev.: 0.0154) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.14% (0.3137 => 0.3361, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.02% (0.1425 => 0.1525, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.19% (1.1606 => 1.2208, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.04% (0.1983 => 0.2083, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.84% (0.2378 => 0.2493, std.dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 4.56% (1.1271 => 1.1785, std.dev.: 0.0097) MultiSource/Applications/Burg/burg: 4.52% (1.2222 => 1.2775, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.04% (1.1685 => 1.2157, std.dev.: 0.0122) MultiSource/Applications/spiff/spiff: 4.04% (0.7950 => 0.8271, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.72% (0.2741 => 0.2843, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.63% (0.6227 => 0.6453, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.47% (0.4559 => 0.4717, std.dev.: 0.0037) MultiSource/Applications/ClamAV/clamscan: 3.35% (14.7684 => 15.2626, std.dev.: 0.1667) SingleSource/Benchmarks/Shootout-C++/hash: 3.34% (0.3800 => 0.3927, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 3.33% (8.6247 => 8.9115, std.dev.: 0.0164) MultiSource/Applications/SPASS/SPASS: 3.24% (14.2605 => 14.7223, std.dev.: 0.0670) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.22% (0.5961 => 0.6153, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 3.21% (1.2568 => 1.2972, std.dev.: 0.0074) MultiSource/Applications/d/make_dparser: 3.15% (3.2366 => 3.3384, std.dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.10% (0.5191 => 0.5352, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.08% (4.1763 => 4.3050, std.dev.: 0.0285) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.88% (0.8359 => 0.8600, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.80% (1.6386 => 1.6845, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.74% (4.4873 => 4.6103, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.68% (1.4479 => 1.4867, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.62% (0.8597 => 0.8822, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.60% (0.8855 => 0.9085, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.58% (0.8611 => 0.8833, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.54% (0.8697 => 0.8918, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.52% (0.8286 => 0.8495, std.dev.: 0.0060) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.50% (6.6074 => 6.7725, std.dev.: 0.0480) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.42% (0.8457 => 0.8662, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.41% (0.8518 => 0.8723, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.29% (0.8050 => 0.8234, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.25% (0.8204 => 0.8389, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.25% (0.9039 => 0.9242, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.22% (0.9074 => 0.9275, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: 2.20% (0.8768 => 0.8961, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.17% (0.8340 => 0.8521, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.15% (13.1811 => 13.4645, std.dev.: 0.0846) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.05% (4.5702 => 4.6639, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.03% (0.7966 => 0.8128, std.dev.: 0.0061) MultiSource/Benchmarks/Bullet/bullet: 2.01% (31.8598 => 32.4998, std.dev.: 0.1437) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.00% (1.2526 => 1.2776, std.dev.: 0.0061) MultiSource/Applications/siod/siod: 1.96% (2.2184 => 2.2618, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.94% (0.8805 => 0.8976, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.94% (0.8316 => 0.8477, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.93% (0.8086 => 0.8242, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.93% (0.8712 => 0.8880, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.90% (0.8716 => 0.8882, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.90% (0.8048 => 0.8201, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.88% (0.7932 => 0.8081, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.85% (0.8420 => 0.8576, std.dev.: 0.0041) MultiSource/Benchmarks/PAQ8p/paq8p: 1.85% (2.3764 => 2.4203, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.85% (0.8885 => 0.9049, std.dev.: 0.0035) MultiSource/Applications/oggenc/oggenc: 1.72% (4.9628 => 5.0483, std.dev.: 0.0166) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.67% (1.2602 => 1.2812, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.62% (0.8927 => 0.9072, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.51% (0.8066 => 0.8188, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.48% (0.9908 => 1.0055, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.07% (1.2423 => 1.2556, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 58.45% (1.5795 => 2.5027, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.79% (2.7978 => 3.7433, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.14% (0.3186 => 0.3541, std.dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.90% (2.4333 => 2.6985, std.dev.: 0.0150) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.10% (1.1857 => 1.2817, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 6.03% (63.1822 => 66.9903, std.dev.: 0.0760) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.95% (14.6451 => 15.5167, std.dev.: 0.1940) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.79% (2.2485 => 2.3561, std.dev.: 0.0318) MultiSource/Benchmarks/FreeBench/distray/distray: 4.18% (0.2390 => 0.2490, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: 3.05% (8.5322 => 8.7924, std.dev.: 0.0177) MultiSource/Applications/siod/siod: 2.63% (3.6643 => 3.7606, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.37% (41.4238 => 42.4065, std.dev.: 0.1164) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.59% (4.8362 => 4.9129, std.dev.: 0.0116) MultiSource/Benchmarks/Olden/bh/bh: 1.58% (2.3560 => 2.3933, std.dev.: 0.0112) SingleSource/Benchmarks/Stanford/FloatMM: 1.20% (0.8807 => 0.8913, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.17% (1.5941 => 1.6127, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/whetstone: 1.01% (2.1224 => 2.1439, std.dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -34.62% (0.0338 => 0.0221, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.88% (0.3269 => 0.3044, std.dev.: 0.0043) MultiSource/Applications/lua/lua: -5.29% (29.8330 => 28.2536, std.dev.: 0.2659) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.98% (1.0388 => 1.0182, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/hash2: -1.34% (3.4237 => 3.3779, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.22% (3.3479 => 3.3072, std.dev.: 0.0036) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.83% (16.4461 => 16.5832, std.dev.: 0.2353) MultiSource/Applications/obsequi/Obsequi: 3.26% (1.0262 => 1.0597, std.dev.: 0.0270) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6857.12% (0.3123 => 21.7271, std.dev.: 0.3471) SingleSource/Benchmarks/CoyoteBench/fftbench: 48.48% (0.2463 => 0.3657, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: 0.15% (0.6010 => 0.6019, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.84% (0.3266 => 0.3326, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: 2.39% (0.1969 => 0.2016, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.92% (0.0408 => 0.0424, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.64% (0.0384 => 0.0421, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 19.44% (0.0180 => 0.0215, std.dev.: 0.0018) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.21% (0.1438 => 0.1435, std.dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.22% (1.1329 => 1.1191, std.dev.: 0.0881) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 1.50% (0.1462 => 0.1484, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.75% (0.4164 => 0.4091, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.94% (0.1369 => 0.1315, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.56% (0.0641 => 0.0651, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 38.97% (0.0195 => 0.0271, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.25% (0.0578 => 0.0565, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.10% (1.1437 => 1.1448, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1500.00% (0.0001 => 0.0016, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 14.29% (0.0014 => 0.0016, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.91% (0.0627 => 0.0615, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 35.56% (0.0180 => 0.0244, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.75% (0.8017 => 0.7957, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -3.23% (0.0062 => 0.0060, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 18:32:04 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 20:32:04 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121101013204.B9FB12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5467?compare_to=5463&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5467, Order: 167181, Start Time: 2012-11-01 00:06:57, End Time: 2012-11-01 01:32:05 To: 5463, Order: 167174, Start Time: 2012-10-31 22:18:35, End Time: 2012-10-31 23:43:39 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 1 (178 on baseline) Unchanged Tests: 1040 (858 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.43% (3.7753 => 3.8291, std.dev.: 0.0179) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.07% (1.6077 => 1.5905, std.dev.: 0.0063) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.15% (3.1919 => 3.4202, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.66% (2.0478 => 2.1022, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/salsa20: 2.44% (7.4937 => 7.6765, std.dev.: 0.0163) MultiSource/Benchmarks/llubenchmark/llu: 2.29% (3.7435 => 3.8291, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/hash2: 2.22% (3.1932 => 3.2641, std.dev.: 0.0102) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -9.03% (0.1584 => 0.1441, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.46% (0.1431 => 0.1310, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.43% (0.3821 => 0.3537, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -7.19% (2.4924 => 2.3131, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.62% (0.3142 => 0.2934, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.55% (0.2428 => 0.2269, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.34% (0.3658 => 0.3426, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.25% (3.5339 => 3.3132, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.21% (0.9542 => 0.8949, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: -6.17% (0.1879 => 0.1763, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.06% (4.5069 => 4.2340, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: -5.98% (0.3025 => 0.2844, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.97% (22.4056 => 21.0669, std.dev.: 0.0089) MultiSource/Applications/sgefa/sgefa: -5.96% (0.3357 => 0.3157, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -5.93% (0.2160 => 0.2032, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: -5.91% (7.0961 => 6.6765, std.dev.: 0.0143) MultiSource/Applications/JM/lencod/lencod: -5.91% (16.1920 => 15.2357, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-4: -5.90% (0.3880 => 0.3651, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.89% (0.6484 => 0.6102, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: -5.87% (4.3330 => 4.0788, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.86% (0.4321 => 0.4068, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -5.85% (0.3848 => 0.3623, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.84% (0.3837 => 0.3613, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.84% (0.9852 => 0.9277, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -5.83% (1.2515 => 1.1785, std.dev.: 0.0093) SingleSource/UnitTests/ObjC/for-in: -5.83% (0.4033 => 0.3798, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -5.82% (0.3831 => 0.3608, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -5.82% (0.4176 => 0.3933, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -5.82% (0.3026 => 0.2850, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.80% (0.3931 => 0.3703, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -5.79% (0.2989 => 0.2816, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -5.79% (0.4199 => 0.3956, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: -5.78% (0.3896 => 0.3671, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.76% (0.7919 => 0.7463, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.76% (0.3057 => 0.2881, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.75% (2.1713 => 2.0464, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.75% (0.3252 => 0.3065, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -5.75% (1.3148 => 1.2392, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.73% (0.4151 => 0.3913, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.73% (1.6474 => 1.5530, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: -5.73% (0.3194 => 0.3011, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -5.72% (0.3812 => 0.3594, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.72% (0.3323 => 0.3133, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: -5.72% (0.2659 => 0.2507, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -5.70% (2.4021 => 2.2653, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.69% (0.3884 => 0.3663, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.68% (0.2903 => 0.2738, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -5.68% (0.3255 => 0.3070, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -5.68% (0.2939 => 0.2772, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -5.65% (0.2849 => 0.2688, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.63% (0.3891 => 0.3672, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.61% (0.2548 => 0.2405, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -5.61% (0.2871 => 0.2710, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.60% (0.3016 => 0.2847, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.60% (4.8161 => 4.5464, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.59% (1.0544 => 0.9955, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/ary3: -5.57% (0.3446 => 0.3254, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.57% (4.8802 => 4.6083, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.56% (0.2355 => 0.2224, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: -5.55% (0.3205 => 0.3027, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -5.54% (0.3481 => 0.3288, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.52% (4.0323 => 3.8097, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.51% (1.2784 => 1.2080, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: -5.49% (0.4280 => 0.4045, std.dev.: 0.0022) SingleSource/Regression/C++/ofstream_ctor: -5.46% (0.3059 => 0.2892, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.45% (5.4682 => 5.1700, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: -5.45% (0.4861 => 0.4596, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.40% (0.5999 => 0.5675, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: -5.39% (18.2933 => 17.3066, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/football/football: -5.39% (0.9179 => 0.8684, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: -5.39% (0.3394 => 0.3211, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.39% (0.4083 => 0.3863, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -5.39% (0.7982 => 0.7552, std.dev.: 0.0138) MultiSource/Applications/lua/lua: -5.37% (4.0594 => 3.8416, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/lists: -5.36% (0.3621 => 0.3427, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -5.33% (34.0927 => 32.2760, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/sieve: -5.31% (0.3788 => 0.3587, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: -5.30% (0.3867 => 0.3662, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -5.28% (1.1450 => 1.0846, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: -5.26% (0.6750 => 0.6395, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.24% (0.7198 => 0.6821, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.22% (0.3849 => 0.3648, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.22% (14.2083 => 13.4672, std.dev.: 0.0207) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.21% (1.6364 => 1.5511, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.21% (0.8521 => 0.8077, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.20% (0.4427 => 0.4197, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -5.18% (0.4248 => 0.4028, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.16% (1.2300 => 1.1665, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: -5.10% (9.2283 => 8.7577, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.08% (0.3483 => 0.3306, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.07% (1.4642 => 1.3899, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -5.06% (0.2985 => 0.2834, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -5.04% (0.4524 => 0.4296, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.01% (1.3722 => 1.3034, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: -5.01% (0.7779 => 0.7389, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.97% (0.5478 => 0.5206, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -4.94% (17.1032 => 16.2583, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.94% (2.2587 => 2.1472, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.91% (0.6293 => 0.5984, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.90% (0.5591 => 0.5317, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.89% (0.5925 => 0.5635, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.88% (0.5859 => 0.5573, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.88% (0.5802 => 0.5519, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.88% (0.2933 => 0.2790, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -4.88% (0.6441 => 0.6127, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.87% (0.2278 => 0.2167, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.87% (0.6304 => 0.5997, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.86% (0.5575 => 0.5304, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.85% (0.6660 => 0.6337, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.84% (0.6052 => 0.5759, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.84% (0.3491 => 0.3322, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.83% (0.5863 => 0.5580, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.82% (0.5805 => 0.5525, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.81% (0.7524 => 0.7162, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.81% (6.7716 => 6.4462, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.80% (0.6230 => 0.5931, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -4.77% (0.6347 => 0.6044, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: -4.77% (0.7447 => 0.7092, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.76% (1.2221 => 1.1639, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/05-eks/eks: -4.76% (0.4515 => 0.4300, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.75% (0.6297 => 0.5998, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.75% (0.5857 => 0.5579, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.74% (1.2210 => 1.1631, std.dev.: 0.0081) MultiSource/Benchmarks/McCat/18-imp/imp: -4.72% (0.3581 => 0.3412, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.72% (0.6189 => 0.5897, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.72% (0.5705 => 0.5436, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.70% (0.7339 => 0.6994, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.70% (0.4916 => 0.4685, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.70% (0.6194 => 0.5903, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.70% (0.4813 => 0.4587, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.67% (0.5569 => 0.5309, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.67% (0.5570 => 0.5310, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.66% (0.6260 => 0.5968, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.66% (0.5581 => 0.5321, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.65% (0.5567 => 0.5308, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.65% (0.9557 => 0.9113, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.64% (0.6440 => 0.6141, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.64% (0.3319 => 0.3165, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.63% (0.6676 => 0.6367, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.62% (0.6033 => 0.5754, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.62% (0.5688 => 0.5425, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: -4.62% (2.1401 => 2.0413, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.61% (0.6681 => 0.6373, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.60% (0.5849 => 0.5580, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.60% (0.6395 => 0.6101, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: -4.59% (0.3271 => 0.3121, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.57% (0.2999 => 0.2862, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.54% (0.5941 => 0.5671, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.53% (0.6395 => 0.6105, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.53% (0.5456 => 0.5209, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.51% (0.6667 => 0.6366, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.49% (0.2695 => 0.2574, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.44% (0.6446 => 0.6160, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -4.43% (0.3406 => 0.3255, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.36% (0.6736 => 0.6442, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: -4.36% (15.5079 => 14.8317, std.dev.: 0.0112) MultiSource/Applications/spiff/spiff: -4.25% (0.8418 => 0.8060, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.23% (0.2385 => 0.2284, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.20% (0.7021 => 0.6726, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: -4.20% (1.3864 => 1.3282, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.19% (8.0126 => 7.6768, std.dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.99% (0.5168 => 0.4962, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: -3.89% (3.5154 => 3.3785, std.dev.: 0.0044) MultiSource/Benchmarks/nbench/nbench: -3.86% (1.1530 => 1.1085, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -3.83% (15.2527 => 14.6684, std.dev.: 0.0138) MultiSource/Applications/hbd/hbd: -3.81% (1.5610 => 1.5015, std.dev.: 0.0040) MultiSource/Applications/oggenc/oggenc: -3.75% (5.0226 => 4.8345, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.58% (0.9077 => 0.8752, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.45% (0.5329 => 0.5145, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -1.99% (20.7746 => 20.3607, std.dev.: 0.0095) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.32% (7.5137 => 5.7613, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: -8.64% (1.2842 => 1.1732, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -4.05% (2.2633 => 2.1716, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.88% (1.7753 => 1.7065, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.45% (1.0557 => 1.0193, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.65% (6.5735 => 6.4651, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.13% (1.6086 => 1.5905, std.dev.: 0.0063) Report Time: 2.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 19:02:49 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 21:02:49 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121101020249.8F02D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5468?compare_to=5464&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5468, Order: 167181, Start Time: 2012-11-01 00:30:00, End Time: 2012-11-01 02:02:52 To: 5464, Order: 167174, Start Time: 2012-10-31 22:27:37, End Time: 2012-11-01 00:00:28 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 0 (174 on baseline) Performance Improvements: 1 (53 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 2 (2 on baseline) Unchanged Tests: 1039 (662 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.28% (10.1248 => 9.9947, std.dev.: 0.0027) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: - (0.1404 => 0.1404, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0648 => 0.0648, std.dev.: 0.0038) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 190.86% (0.5229 => 1.5209, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 13.29% (14.9895 => 16.9818, std.dev.: 0.0066) MultiSource/Applications/kimwitu++/kc: 36.42% (14.1553 => 19.3113, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/gs/gs: 12.18% (4.1105 => 4.6113, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 29.28% (1.1048 => 1.4283, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 307.64% (7.1582 => 29.1794, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.90% (3.4629 => 5.8489, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: 63.15% (0.6222 => 1.0151, std.dev.: 0.0041) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10598.89% (0.0720 => 7.7032, std.dev.: 0.0048) MultiSource/Applications/SIBsim4/SIBsim4: 3836500.00% (0.0001 => 3.8366, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 11167800.00% (0.0001 => 11.1679, std.dev.: 0.0201) MultiSource/Applications/kimwitu++/kc: 50400.00% (0.0001 => 0.0505, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63800.00% (0.0001 => 0.0639, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14400.00% (0.0001 => 0.0145, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 781800.00% (0.0001 => 0.7819, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049700.00% (0.0001 => 10.0498, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5548600.00% (0.0001 => 5.5487, std.dev.: 0.0167) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 38.07% (0.1056 => 0.1458, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 29.68% (0.1432 => 0.1857, std.dev.: 0.0003) SingleSource/UnitTests/vla: 29.01% (0.0355 => 0.0458, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.43% (0.1566 => 0.1886, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 19.04% (0.0730 => 0.0869, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 17.44% (0.3177 => 0.3731, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.15% (0.0793 => 0.0929, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 17.11% (0.1175 => 0.1376, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 16.95% (0.4879 => 0.5706, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.88% (0.0871 => 0.1018, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 16.62% (0.0746 => 0.0870, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 16.29% (0.2554 => 0.2970, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.92% (0.8172 => 0.9473, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 15.91% (0.0798 => 0.0925, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.47% (0.0834 => 0.0963, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.20% (0.0842 => 0.0970, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 15.15% (0.1584 => 0.1824, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.06% (0.1029 => 0.1184, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.06% (0.2065 => 0.2376, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 14.88% (0.1163 => 0.1336, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 14.87% (0.1695 => 0.1947, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.33% (0.0886 => 0.1013, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 14.26% (0.1655 => 0.1891, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.11% (0.2700 => 0.3081, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 13.83% (0.1555 => 0.1770, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 13.81% (0.1940 => 0.2208, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.78% (0.2758 => 0.3138, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 13.77% (0.5105 => 0.5808, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.49% (0.5981 => 0.6788, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 13.49% (0.7115 => 0.8075, std.dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.47% (0.1143 => 0.1297) MultiSource/Applications/aha/aha: 13.47% (0.1151 => 0.1306, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.43% (0.1117 => 0.1267, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.38% (0.0770 => 0.0873, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.31% (0.1337 => 0.1515, std.dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: 13.25% (0.3109 => 0.3521, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.25% (0.0770 => 0.0872, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.19% (0.2107 => 0.2385, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 13.09% (0.7433 => 0.8406, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.08% (0.6675 => 0.7548, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.05% (0.1510 => 0.1707, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 13.03% (1.1642 => 1.3159, std.dev.: 0.0114) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 12.98% (0.1125 => 0.1271, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.96% (0.9765 => 1.1031, std.dev.: 0.0049) MultiSource/Applications/spiff/spiff: 12.95% (0.7835 => 0.8850, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.95% (0.2271 => 0.2565, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.85% (0.3121 => 0.3522, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: 12.85% (3.3354 => 3.7639, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.68% (0.5569 => 0.6275, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.66% (1.5415 => 1.7366, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.63% (0.5860 => 0.6600, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/exptree: 12.53% (0.0814 => 0.0916, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.52% (0.1062 => 0.1195, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.46% (0.4615 => 0.5190, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.21% (0.1032 => 0.1158, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.03% (0.3441 => 0.3855, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.03% (1.3050 => 1.4620, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.99% (2.2022 => 2.4662, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/health/health: 11.99% (0.1268 => 0.1420, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.93% (0.5020 => 0.5619, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.91% (0.3307 => 0.3701, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.81% (0.1236 => 0.1382, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 11.77% (2.0273 => 2.2659, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.69% (0.3543 => 0.3957, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 11.60% (3.8723 => 4.3216, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/18-imp/imp: 11.45% (0.3423 => 0.3815, std.dev.: 0.0014) SingleSource/UnitTests/SignlessTypes/rem: 11.45% (0.1144 => 0.1275, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.36% (0.3927 => 0.4373, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.26% (0.1625 => 0.1808, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/trivial-interface: 11.17% (0.3473 => 0.3861, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.10% (0.2603 => 0.2892, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.10% (0.6450 => 0.7166, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 11.07% (1.0722 => 1.1909, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.00% (4.2646 => 4.7335, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/exceptions-2: 10.95% (0.3497 => 0.3880, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.89% (0.3543 => 0.3929, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.89% (0.3828 => 0.4245, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.87% (0.3561 => 0.3948, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 10.84% (0.3516 => 0.3897, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.76% (1.5859 => 1.7565, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.74% (0.1695 => 0.1877, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: 10.73% (0.1463 => 0.1620, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 10.68% (9.4845 => 10.4976, std.dev.: 0.0121) SingleSource/UnitTests/ObjC/for-in: 10.67% (0.3694 => 0.4088, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.60% (0.3886 => 0.4298, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.59% (8.1363 => 8.9979, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/05-eks/eks: 10.58% (0.4299 => 0.4754, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 10.54% (0.4289 => 0.4741, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.54% (0.1044 => 0.1154, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.49% (0.1906 => 0.2106, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 10.44% (0.3180 => 0.3512, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.33% (2.2024 => 2.4300, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 10.28% (2.2969 => 2.5331, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 10.28% (0.8921 => 0.9838, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.27% (0.8101 => 0.8933, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 10.13% (0.3387 => 0.3730, std.dev.: 0.0075) MultiSource/Benchmarks/nbench/nbench: 10.12% (1.1840 => 1.3038, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/bigfib: 10.07% (0.6456 => 0.7106, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1268 => 0.1392, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 9.72% (1.1861 => 1.3014, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.54% (1.4186 => 1.5540, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.51% (0.1892 => 0.2072, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.50% (0.3865 => 0.4232, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 9.48% (0.4620 => 0.5058, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 9.23% (0.3422 => 0.3738, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.09% (0.4203 => 0.4585, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.06% (0.4636 => 0.5056, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.82% (0.4103 => 0.4465, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.77% (4.9449 => 5.3786, std.dev.: 0.0042) MultiSource/Applications/hbd/hbd: 8.67% (1.5603 => 1.6956, std.dev.: 0.0069) MultiSource/Applications/oggenc/oggenc: 8.61% (5.7591 => 6.2548, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 8.61% (0.6030 => 0.6549, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.60% (5.0018 => 5.4321, std.dev.: 0.0046) SingleSource/UnitTests/ObjC++/Hello: 8.56% (0.5925 => 0.6432, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 8.50% (0.3684 => 0.3997, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 8.47% (0.4048 => 0.4391, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 8.47% (0.3603 => 0.3908, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.35% (0.1330 => 0.1441, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.31% (0.2430 => 0.2632, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.95% (0.3650 => 0.3940, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.86% (0.7326 => 0.7902, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.76% (0.3826 => 0.4123, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.73% (0.2793 => 0.3009, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.68% (0.2891 => 0.3113, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.63% (0.2831 => 0.3047, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.62% (0.2756 => 0.2966, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.49% (2.0665 => 2.2212, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 7.40% (0.2905 => 0.3120, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.38% (0.4064 => 0.4364, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.37% (0.3162 => 0.3395, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 7.34% (0.3283 => 0.3524, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.33% (0.3232 => 0.3469, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 7.27% (0.2725 => 0.2923, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.24% (14.3668 => 15.4071, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/matrix: 7.23% (0.3098 => 0.3322, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 7.16% (0.2877 => 0.3083, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.15% (0.2714 => 0.2908, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 7.11% (0.2871 => 0.3075, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.01% (0.3052 => 0.3266, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.93% (0.2872 => 0.3071, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.86% (0.3427 => 0.3662, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/random: 6.85% (0.2802 => 0.2994, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 6.49% (0.3282 => 0.3495, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 6.46% (17.1811 => 18.2911, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.35% (0.3136 => 0.3335, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 6.30% (0.3379 => 0.3592, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 6.30% (1.2842 => 1.3651, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.30% (0.8067 => 0.8575, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.13% (0.2266 => 0.2405, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/bh/bh: 6.05% (0.3092 => 0.3279, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.98% (3.8922 => 4.1248, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 4.98% (0.3131 => 0.3287, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.63% (0.3935 => 0.4078, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.51% (0.3817 => 0.3951, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.82% (7.0540 => 7.1825, std.dev.: 0.0102) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.51% (5.3999 => 13.3115, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 19.80% (2.8904 => 3.4628, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.60% (1.1145 => 1.2995, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.41% (0.2944 => 0.3280, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.93% (1.1396 => 1.2528, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.62% (3.1578 => 3.3667, std.dev.: 0.0011) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.78% (4.2280 => 4.3457, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.34% (3.6395 => 3.7246, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.32% (1.7254 => 1.7655, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.84% (0.8333 => 0.8486, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2077, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 1.42% (11.6436 => 11.8092, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.05% (6.5088 => 6.5774, std.dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.94% (6.6874 => 0.1375, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -76.52% (0.8651 => 0.2031, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.06% (5.3855 => 2.4203, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -54.87% (5.3526 => 2.4154, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/richards_benchmark: -45.38% (0.1622 => 0.0886, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.71% (5.2763 => 3.1285, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -38.21% (1.1194 => 0.6917, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -24.27% (1.7609 => 1.3336, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.54% (2.9384 => 2.5406, std.dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: -10.36% (10.4361 => 9.3554, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -9.11% (54.1659 => 49.2338, std.dev.: 0.0303) MultiSource/Benchmarks/Bullet/bullet: -7.35% (63.2438 => 58.5973, std.dev.: 0.0123) MultiSource/Benchmarks/PAQ8p/paq8p: -3.59% (10.3673 => 9.9947, std.dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: -3.50% (22.1758 => 21.4004, std.dev.: 0.0084) MultiSource/Applications/JM/lencod/lencod: -2.68% (21.9371 => 21.3497, std.dev.: 0.0087) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -35.18% (0.0506 => 0.0328, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -35.14% (0.3987 => 0.2586, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -33.47% (1.1492 => 0.7646, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -28.72% (10.7105 => 7.6348, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-6: -16.08% (1.6925 => 1.4204, std.dev.: 0.0037) MultiSource/Benchmarks/NPB-serial/is/is: -10.98% (9.5636 => 8.5131, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -10.95% (1.5373 => 1.3689, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.29% (19.9488 => 18.2949, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/mason/mason: -8.01% (0.2161 => 0.1988, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.14% (1.8329 => 1.7021, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4784, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -6.21% (1.2373 => 1.1605, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.61% (1.9577 => 1.8479, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.08% (1.6805 => 1.5952, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: -5.00% (6.6465 => 6.3139, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.94% (1.5835 => 1.5053, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7614) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.62% (1.5660 => 1.4937, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.30% (0.9957 => 0.9529, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.04% (0.2497 => 0.2396, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.81% (3.2827 => 3.1577, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -3.73% (4.5009 => 4.3331, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.49% (32.5116 => 31.3769, std.dev.: 0.0084) MultiSource/Benchmarks/sim/sim: -3.23% (5.0483 => 4.8850, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -2.77% (4.6441 => 4.5156, std.dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.70% (0.4808 => 0.4678, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.21% (8.1563 => 7.9759, std.dev.: 0.0251) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/Olden/power/power: -2.14% (1.1277 => 1.1036, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -1.75% (10.2830 => 10.1026, std.dev.: 0.0246) SingleSource/Benchmarks/Misc/flops: -1.74% (8.8334 => 8.6801, std.dev.: 0.0024) SingleSource/UnitTests/Vector/multiplies: -1.57% (2.5528 => 2.5127, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (85.0658 => 83.9828, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8568, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0554 => 1.0443, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -5.45% (0.1485 => 0.1404, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0038) Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 19:43:11 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 21:43:11 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121101024311.0B3A32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5469?compare_to=5466&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5469, Order: 167192, Start Time: 2012-11-01 01:15:37, End Time: 2012-11-01 02:43:13 To: 5466, Order: 167176, Start Time: 2012-10-31 23:30:40, End Time: 2012-11-01 00:58:07 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 7 (81 on baseline) Performance Improvements: 0 (4 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 984 (889 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.03% (0.2954 => 0.3073, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.62% (0.8387 => 0.8691, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.65% (1.1426 => 1.1615, std.dev.: 0.0029) MultiSource/Applications/spiff/spiff: 1.44% (0.8271 => 0.8390, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.19% (0.8727 => 0.8831, std.dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.59% (2.9294 => 2.9761, std.dev.: 0.0153) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.51% (2.7349 => 2.7762, std.dev.: 0.0088) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.99% (16.5832 => 16.9131, std.dev.: 0.3749) MultiSource/Applications/obsequi/Obsequi: 0.35% (1.0597 => 1.0634, std.dev.: 0.0121) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.12% (21.7271 => 21.7530, std.dev.: 0.2895) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.68% (0.3657 => 0.3682, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/bigfib: 3.44% (0.6019 => 0.6226, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.30% (0.3326 => 0.3336, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.2016 => 0.2016, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.46% (0.0218 => 0.0217, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.24% (0.0424 => 0.0423, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0330 => 0.0330, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.64% (0.0312 => 0.0314, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0421 => 0.0421, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0203 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 0.93% (0.0215 => 0.0217, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.25% (0.1435 => 0.1453, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 1.74% (1.1191 => 1.1386, std.dev.: 0.0625) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 2.36% (0.1484 => 0.1519, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.44% (0.4091 => 0.4073, std.dev.: 0.0781) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.73% (0.1315 => 0.1364, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.45% (0.0651 => 0.0596, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.21% (0.0271 => 0.0277, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.83% (0.0565 => 0.0549, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.15% (1.1448 => 1.1465, std.dev.: 0.0518) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 12.50% (0.0016 => 0.0018, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 62.50% (0.0016 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.85% (0.0615 => 0.0651, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.05% (0.0244 => 0.0239, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.97% (0.7957 => 0.8034, std.dev.: 0.0077) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 31.67% (0.0060 => 0.0079, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2361.86% (0.6332 => 15.5885, std.dev.: 0.2025) MultiSource/Benchmarks/McCat/08-main/main: 45.66% (0.1831 => 0.2667, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.09% (0.1559 => 0.1464, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1495.87% (0.3344 => 5.3366, std.dev.: 0.1250) SingleSource/Benchmarks/Misc-C++/Large/ray: 39.55% (0.2364 => 0.3299, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/mandel: 2.33% (0.0429 => 0.0439, std.dev.: 0.0015) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -0.45% (0.0224 => 0.0223, std.dev.: 0.0008) SingleSource/UnitTests/byval-alignment: -26.09% (0.0230 => 0.0170, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3982, std.dev.: 0.0315) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0731, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4944, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3577, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0416, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4011, std.dev.: 0.0119) SingleSource/Regression/C/uint64_to_float: -24.17% (2.1832 => 1.6556, std.dev.: 0.0060) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0008) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.91% (0.0810 => 0.0947, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.38% (0.0848 => 0.0953, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 11.87% (0.1112 => 0.1244, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.62% (0.2180 => 0.2368, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.66% (0.8148 => 0.8691, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.05% (0.1983 => 0.2103, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 5.53% (0.7950 => 0.8390, std.dev.: 0.0030) MultiSource/Applications/sgefa/sgefa: 5.44% (0.2999 => 0.3162, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 5.29% (1.2222 => 1.2869, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.25% (0.1905 => 0.2005, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 5.14% (0.4847 => 0.5096, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.12% (0.2519 => 0.2648, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.11% (0.8321 => 0.8746, std.dev.: 0.0155) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.74% (0.2998 => 0.3140, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.52% (0.4783 => 0.4999, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.45% (0.4559 => 0.4762, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 4.38% (1.2568 => 1.3119, std.dev.: 0.0076) MultiSource/Applications/SPASS/SPASS: 4.36% (14.2605 => 14.8822, std.dev.: 0.1414) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.09% (0.2741 => 0.2853, std.dev.: 0.0039) MultiSource/Benchmarks/nbench/nbench: 4.02% (1.1271 => 1.1724, std.dev.: 0.0109) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.98% (1.1170 => 1.1615, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.93% (0.6227 => 0.6472, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.74% (1.1685 => 1.2122, std.dev.: 0.0070) MultiSource/Applications/ClamAV/clamscan: 3.69% (14.7684 => 15.3128, std.dev.: 0.1670) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 3.63% (0.6287 => 0.6515, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.56% (0.5191 => 0.5376, std.dev.: 0.0047) MultiSource/Applications/d/make_dparser: 3.49% (3.2366 => 3.3494, std.dev.: 0.0253) MultiSource/Applications/oggenc/oggenc: 3.31% (4.9628 => 5.1271, std.dev.: 0.0386) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.23% (0.3717 => 0.3837, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.18% (0.8007 => 0.8262, std.dev.: 0.0060) MultiSource/Applications/treecc/treecc: 3.11% (1.9948 => 2.0569, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.11% (0.8338 => 0.8597, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.10% (0.4127 => 0.4255, std.dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.03% (6.6074 => 6.8076, std.dev.: 0.0415) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.98% (0.8697 => 0.8956, std.dev.: 0.0050) MultiSource/Applications/JM/lencod/lencod: 2.79% (15.3280 => 15.7558, std.dev.: 0.1505) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.74% (0.9039 => 0.9287, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.69% (0.8331 => 0.8555, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.69% (1.4479 => 1.4868, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.58% (8.6476 => 8.8711, std.dev.: 0.0480) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.58% (0.8518 => 0.8738, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.57% (0.8069 => 0.8276, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.56% (0.9074 => 0.9306, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.53% (0.8050 => 0.8254, std.dev.: 0.0073) MultiSource/Applications/lua/lua: 2.52% (3.8189 => 3.9153, std.dev.: 0.0296) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.45% (0.8855 => 0.9072, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.44% (0.9069 => 0.9290, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.42% (0.7966 => 0.8159, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.42% (1.6386 => 1.6782, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.39% (0.8086 => 0.8279, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.35% (4.1763 => 4.2743, std.dev.: 0.0191) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.35% (4.4880 => 4.5933, std.dev.: 0.0308) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.34% (0.7932 => 0.8118, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.28% (0.8805 => 0.9006, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.24% (0.8359 => 0.8546, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.19% (0.9908 => 1.0125, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.17% (0.9688 => 0.9898, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.06% (0.8286 => 0.8457, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.04% (1.2602 => 1.2859, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.02% (0.8204 => 0.8370, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.02% (0.8656 => 0.8831, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.95% (0.8420 => 0.8584, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.95% (13.1811 => 13.4378, std.dev.: 0.0737) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.67% (0.8927 => 0.9076, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: 1.64% (31.8598 => 32.3833, std.dev.: 0.1923) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.64% (4.4873 => 4.5610, std.dev.: 0.0247) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.64% (1.2423 => 1.2627, std.dev.: 0.0044) MultiSource/Benchmarks/PAQ8p/paq8p: 1.62% (2.3764 => 2.4149, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.58% (0.8048 => 0.8175, std.dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 59.27% (1.5795 => 2.5157, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.70% (2.7978 => 3.7407, std.dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.12% (2.4333 => 2.6795, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.41% (0.3186 => 0.3454, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.16% (1.1857 => 1.2825, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 5.94% (63.1822 => 66.9361, std.dev.: 0.0335) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.97% (4.3552 => 4.4845, std.dev.: 0.0264) MultiSource/Applications/siod/siod: 2.88% (3.6643 => 3.7697, std.dev.: 0.0099) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.36% (1.1365 => 1.1519, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: 1.35% (2.3560 => 2.3877, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.10% (1.5941 => 1.6116, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/whetstone: 1.02% (2.1224 => 2.1440, std.dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.19% (0.3269 => 0.3034, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -4.76% (29.8330 => 28.4117, std.dev.: 0.2738) SingleSource/Benchmarks/Shootout-C++/hash2: -1.44% (3.4237 => 3.3743, std.dev.: 0.0124) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.14% (3.3479 => 3.3098, std.dev.: 0.0044) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 2.84% (16.4461 => 16.9131, std.dev.: 0.3749) MultiSource/Applications/obsequi/Obsequi: 3.63% (1.0262 => 1.0634, std.dev.: 0.0121) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6865.42% (0.3123 => 21.7530, std.dev.: 0.2895) SingleSource/Benchmarks/CoyoteBench/fftbench: 49.49% (0.2463 => 0.3682, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/bigfib: 3.59% (0.6010 => 0.6226, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.14% (0.3266 => 0.3336, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/strcat: 2.39% (0.1969 => 0.2016, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 76.42% (0.0123 => 0.0217, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.68% (0.0408 => 0.0423, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.97% (0.0302 => 0.0314, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.64% (0.0384 => 0.0421, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.04% (0.1438 => 0.1453, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.50% (1.1329 => 1.1386, std.dev.: 0.0625) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.90% (0.1462 => 0.1519, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.19% (0.4164 => 0.4073, std.dev.: 0.0781) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.37% (0.1369 => 0.1364, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.02% (0.0641 => 0.0596, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.02% (0.0578 => 0.0549, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.24% (1.1437 => 1.1465, std.dev.: 0.0518) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1700.00% (0.0001 => 0.0018, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.83% (0.0627 => 0.0651, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 32.78% (0.0180 => 0.0239, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.21% (0.8017 => 0.8034, std.dev.: 0.0077) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 27.42% (0.0062 => 0.0079, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 20:20:19 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 22:20:19 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121101032019.75F212A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5470?compare_to=5467&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5470, Order: 167198, Start Time: 2012-11-01 01:55:13, End Time: 2012-11-01 03:20:20 To: 5467, Order: 167181, Start Time: 2012-11-01 00:06:57, End Time: 2012-11-01 01:32:05 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (7 on baseline) Performance Improvements: 0 (177 on baseline) Unchanged Tests: 1040 (858 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.21% (54.6146 => 55.8200, std.dev.: 0.3492) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.37% (1.2731 => 1.2906, std.dev.: 0.0057) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.14% (3.1919 => 3.4199, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.82% (2.0478 => 2.1056, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/salsa20: 2.41% (7.4937 => 7.6746, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.28% (54.5751 => 55.8200, std.dev.: 0.3492) SingleSource/Benchmarks/Shootout-C++/hash2: 2.10% (3.1932 => 3.2601, std.dev.: 0.0026) MultiSource/Benchmarks/llubenchmark/llu: 1.51% (3.7435 => 3.7999, std.dev.: 0.0213) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.78% (0.1584 => 0.1445, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.53% (0.1431 => 0.1309, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -7.37% (0.3812 => 0.3531, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.33% (0.3821 => 0.3541, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.31% (0.3884 => 0.3600, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: -7.30% (0.3848 => 0.3567, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -7.28% (0.3831 => 0.3552, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.27% (0.3891 => 0.3608, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -7.24% (0.3880 => 0.3599, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -7.18% (0.4176 => 0.3876, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -7.17% (0.4033 => 0.3744, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -7.14% (0.3896 => 0.3618, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -6.95% (0.4199 => 0.3907, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -6.75% (0.4280 => 0.3991, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -6.70% (2.4924 => 2.3255, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.40% (0.3142 => 0.2941, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.38% (0.2428 => 0.2273, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/random: -6.33% (0.2939 => 0.2753, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -6.28% (0.3025 => 0.2835, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.28% (0.3057 => 0.2865, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.23% (2.1713 => 2.0361, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.17% (0.2903 => 0.2724, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -6.17% (0.2871 => 0.2694, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -6.16% (0.2989 => 0.2805, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.15% (0.3837 => 0.3601, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.15% (0.3252 => 0.3052, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -6.15% (0.3026 => 0.2840, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -6.15% (0.3059 => 0.2871, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.12% (0.3658 => 0.3434, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -6.11% (0.2849 => 0.2675, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -6.08% (0.3323 => 0.3121, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -6.07% (0.3194 => 0.3000, std.dev.: 0.0050) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.07% (0.2355 => 0.2212, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.07% (0.4151 => 0.3899, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: -6.07% (0.1879 => 0.1765, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -5.99% (0.3205 => 0.3013, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: -5.98% (0.2659 => 0.2500, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -5.96% (16.1920 => 15.2263, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.94% (0.3016 => 0.2837, std.dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: -5.93% (1.3148 => 1.2368, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.93% (0.9542 => 0.8976, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/oourafft: -5.93% (0.2160 => 0.2032, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.91% (4.5069 => 4.2405, std.dev.: 0.0044) MultiSource/Applications/JM/ldecod/ldecod: -5.90% (7.0961 => 6.6777, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary2: -5.89% (0.3481 => 0.3276, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.88% (0.3931 => 0.3700, std.dev.: 0.0024) MultiSource/Applications/sgefa/sgefa: -5.84% (0.3357 => 0.3161, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.83% (0.6484 => 0.6106, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.82% (3.5339 => 3.3281, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/matrix: -5.81% (0.3255 => 0.3066, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -5.77% (0.3394 => 0.3198, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.76% (22.4056 => 21.1150, std.dev.: 0.0130) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.76% (0.9852 => 0.9285, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -5.75% (0.3446 => 0.3248, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.74% (4.8802 => 4.6003, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.73% (4.8161 => 4.5401, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.72% (0.3849 => 0.3629, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/gs/gs: -5.69% (4.3330 => 4.0866, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.68% (0.4083 => 0.3851, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.67% (0.4321 => 0.4076, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -5.63% (0.3621 => 0.3417, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.63% (1.0544 => 0.9950, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/moments: -5.60% (0.4248 => 0.4010, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.53% (0.2548 => 0.2407, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.53% (0.7919 => 0.7481, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.53% (4.0323 => 3.8093, std.dev.: 0.0067) MultiSource/Applications/Burg/burg: -5.46% (1.2515 => 1.1832, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.45% (1.2784 => 1.2087, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: -5.42% (0.4524 => 0.4279, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: -5.41% (0.3788 => 0.3583, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.39% (0.2933 => 0.2775, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -5.38% (0.3867 => 0.3659, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.38% (0.4427 => 0.4189, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.37% (0.5999 => 0.5677, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: -5.33% (0.6347 => 0.6009, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -5.27% (0.7779 => 0.7369, std.dev.: 0.0097) SingleSource/UnitTests/ObjC++/property-reference-object: -5.25% (0.6441 => 0.6103, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -5.22% (2.4021 => 2.2767, std.dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.19% (6.7716 => 6.4201, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.18% (1.6474 => 1.5620, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.18% (0.8521 => 0.8080, std.dev.: 0.0006) MultiSource/Applications/lua/lua: -5.16% (4.0594 => 3.8498, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.16% (14.2083 => 13.4754, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/football/football: -5.13% (0.9179 => 0.8708, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.12% (1.2300 => 1.1670, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -5.12% (9.2283 => 8.7561, std.dev.: 0.0107) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.11% (0.4813 => 0.4567, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.09% (5.4682 => 5.1899, std.dev.: 0.0151) SingleSource/Benchmarks/Misc-C++/bigfib: -5.07% (0.6750 => 0.6408, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -5.05% (34.0927 => 32.3701, std.dev.: 0.0069) MultiSource/Benchmarks/McCat/05-eks/eks: -5.05% (0.4515 => 0.4287, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.05% (0.2278 => 0.2163, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.04% (1.3722 => 1.3030, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.04% (0.5478 => 0.5202, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.03% (1.4642 => 1.3905, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.97% (0.7198 => 0.6840, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.94% (0.6293 => 0.5982, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.94% (1.2210 => 1.1607, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.93% (0.2999 => 0.2851, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: -4.92% (1.1450 => 1.0887) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -4.91% (1.6364 => 1.5561, std.dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.90% (0.4916 => 0.4675, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.88% (1.2221 => 1.1625, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.84% (0.6052 => 0.5759, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: -4.83% (0.3581 => 0.3408, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.83% (0.5925 => 0.5639, std.dev.: 0.0047) MultiSource/Applications/kimwitu++/kc: -4.81% (18.2933 => 17.4131, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.81% (0.5591 => 0.5322, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.79% (0.5570 => 0.5303, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.78% (0.6230 => 0.5932, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.78% (0.5859 => 0.5579, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.78% (0.6194 => 0.5898, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.77% (0.5575 => 0.5309, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.75% (0.5805 => 0.5529, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -4.75% (0.7982 => 0.7603, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.75% (0.5857 => 0.5579, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.74% (0.6260 => 0.5963, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.72% (0.5802 => 0.5528, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -4.72% (17.1032 => 16.2955, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.70% (0.6189 => 0.5898, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.68% (0.3483 => 0.3320, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.67% (0.6676 => 0.6364, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.66% (0.5705 => 0.5439, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.65% (0.2385 => 0.2274, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.65% (0.5849 => 0.5577, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.65% (0.6304 => 0.6011, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.64% (0.5581 => 0.5322, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.64% (0.5863 => 0.5591, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.63% (8.0126 => 7.6420, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.62% (0.9557 => 0.9115, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.62% (0.6446 => 0.6148, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: -4.62% (0.3271 => 0.3120, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.61% (0.3319 => 0.3166, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.61% (0.5688 => 0.5426, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.57% (0.6667 => 0.6362, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.57% (0.7524 => 0.7180, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.56% (0.7339 => 0.7004, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.56% (0.6033 => 0.5758, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.55% (0.6681 => 0.6377, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.55% (0.6660 => 0.6357, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.54% (0.5569 => 0.5316, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.54% (2.2587 => 2.1562, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.53% (0.6395 => 0.6105, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.53% (0.5941 => 0.5672, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.53% (0.5567 => 0.5315, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.52% (0.6440 => 0.6149, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.51% (0.5456 => 0.5210, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: -4.50% (0.7447 => 0.7112, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.49% (0.6297 => 0.6014, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: -4.46% (0.2985 => 0.2852, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.45% (0.2695 => 0.2575, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.44% (0.6395 => 0.6111, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -4.43% (0.8418 => 0.8045, std.dev.: 0.0018) MultiSource/Applications/treecc/treecc: -4.39% (2.1401 => 2.0462, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: -4.37% (0.3406 => 0.3257, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -4.31% (1.3864 => 1.3266, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: -4.21% (15.5079 => 14.8554, std.dev.: 0.0216) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.19% (0.6736 => 0.6454, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: -3.95% (3.5154 => 3.3764, std.dev.: 0.0083) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.92% (0.9077 => 0.8721, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.89% (0.5168 => 0.4967, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -3.87% (15.2527 => 14.6627, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.82% (0.7021 => 0.6753, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: -3.70% (1.1530 => 1.1103, std.dev.: 0.0086) MultiSource/Applications/hbd/hbd: -3.68% (1.5610 => 1.5035, std.dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: -3.55% (5.0226 => 4.8442, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.17% (0.5329 => 0.5160, std.dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -2.24% (20.7746 => 20.3097, std.dev.: 0.0063) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7535, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: -8.71% (1.2842 => 1.1724, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.90% (1.7753 => 1.7061, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.74% (2.2633 => 2.1787, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.56% (6.5735 => 6.4707, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.45% (1.3096 => 1.2906, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0011) Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 21:05:27 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 23:05:27 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121101040527.7F2282A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5471?compare_to=5468&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5471, Order: 167199, Start Time: 2012-11-01 02:32:40, End Time: 2012-11-01 04:05:28 To: 5468, Order: 167181, Start Time: 2012-11-01 00:30:00, End Time: 2012-11-01 02:02:52 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 0 (173 on baseline) Performance Improvements: 2 (53 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 2 (2 on baseline) Unchanged Tests: 1038 (663 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.07% (9.9947 => 9.8878, std.dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.02% (5.5487 => 5.4920, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: - (0.1404 => 0.1404, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0648 => 0.0648, std.dev.: 0.0006) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 189.79% (0.5229 => 1.5153, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 12.74% (14.9895 => 16.8997, std.dev.: 0.0089) MultiSource/Applications/kimwitu++/kc: 35.95% (14.1553 => 19.2442, std.dev.: 0.0239) MultiSource/Benchmarks/MallocBench/gs/gs: 11.89% (4.1105 => 4.5994, std.dev.: 0.0109) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 28.84% (1.1048 => 1.4234, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 305.96% (7.1582 => 29.0592, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.16% (3.4629 => 5.8233, std.dev.: 0.0149) SingleSource/Benchmarks/Misc-C++/stepanov_container: 62.76% (0.6222 => 1.0127, std.dev.: 0.0013) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10597.22% (0.0720 => 7.7020, std.dev.: 0.0073) MultiSource/Applications/SIBsim4/SIBsim4: 3837400.00% (0.0001 => 3.8375, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 11195800.00% (0.0001 => 11.1959, std.dev.: 0.0135) MultiSource/Applications/kimwitu++/kc: 50800.00% (0.0001 => 0.0509, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63800.00% (0.0001 => 0.0639, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 781800.00% (0.0001 => 0.7819, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049800.00% (0.0001 => 10.0499, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5491900.00% (0.0001 => 5.4920, std.dev.: 0.0013) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 37.22% (0.1056 => 0.1449, std.dev.: 0.0000) SingleSource/UnitTests/vla: 29.30% (0.0355 => 0.0459, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 28.28% (0.1432 => 0.1837, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.18% (0.1566 => 0.1882, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 18.90% (0.0730 => 0.0868, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.81% (0.0842 => 0.0992, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.40% (0.0793 => 0.0931, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 17.02% (0.1175 => 0.1375, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.91% (0.0834 => 0.0975, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 16.87% (0.3177 => 0.3713, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.53% (0.0871 => 0.1015, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 16.35% (0.0746 => 0.0868, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 16.15% (0.4879 => 0.5667, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 15.94% (0.2554 => 0.2961, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 15.91% (0.0798 => 0.0925, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.81% (0.8172 => 0.9464, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.96% (0.1584 => 0.1821, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/mst/mst: 14.62% (0.1163 => 0.1333, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 14.57% (0.1695 => 0.1942, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.33% (0.2065 => 0.2361, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.33% (0.0886 => 0.1013, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 13.96% (0.1655 => 0.1886, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 13.76% (0.1940 => 0.2207, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 13.70% (0.1555 => 0.1768, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.56% (0.1143 => 0.1298, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.56% (0.2700 => 0.3066, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 13.56% (0.5105 => 0.5797, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.54% (0.1337 => 0.1518, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.51% (0.0770 => 0.0874, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 13.39% (0.7115 => 0.8068, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.34% (0.2758 => 0.3126, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.34% (0.1117 => 0.1266, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.33% (0.5981 => 0.6778, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 13.21% (0.1151 => 0.1303, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.12% (0.0770 => 0.0871, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.05% (0.2107 => 0.2382, std.dev.: 0.0016) MultiSource/Applications/spiff/spiff: 13.04% (0.7835 => 0.8857, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.97% (0.6675 => 0.7541, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 12.94% (1.1642 => 1.3149, std.dev.: 0.0066) MultiSource/Applications/sgefa/sgefa: 12.80% (0.3109 => 0.3507, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.78% (0.3121 => 0.3520, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.73% (0.1029 => 0.1160, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.73% (0.2271 => 0.2560, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.72% (0.1510 => 0.1702, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 12.62% (0.1125 => 0.1267, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.60% (0.9765 => 1.0995, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 12.58% (0.7433 => 0.8368, std.dev.: 0.0018) MultiSource/Applications/d/make_dparser: 12.47% (3.3354 => 3.7514, std.dev.: 0.0079) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.46% (0.4615 => 0.5190, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.43% (0.1062 => 0.1194, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.30% (0.5860 => 0.6581, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.29% (1.5415 => 1.7310, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.23% (0.5569 => 0.6250, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.05% (2.2022 => 2.4676, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.02% (0.1032 => 0.1156, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 11.83% (0.1268 => 0.1418, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.73% (0.1236 => 0.1381, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.68% (0.3441 => 0.3843, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.68% (1.3050 => 1.4574, std.dev.: 0.0020) MultiSource/Applications/treecc/treecc: 11.67% (2.0273 => 2.2638, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.63% (0.5020 => 0.5604, std.dev.: 0.0021) MultiSource/Applications/lua/lua: 11.45% (3.8723 => 4.3157, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.40% (0.3307 => 0.3684, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.23% (0.3543 => 0.3941, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 11.13% (0.3423 => 0.3804, std.dev.: 0.0012) SingleSource/UnitTests/SignlessTypes/rem: 11.10% (0.1144 => 0.1271) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.95% (0.1625 => 0.1803, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/parameter-passing: 10.85% (0.3927 => 0.4353, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.81% (4.2646 => 4.7257, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.72% (0.2603 => 0.2882, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.68% (0.6450 => 0.7139, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: 10.65% (0.4299 => 0.4757, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: 10.60% (0.3473 => 0.3841, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 10.58% (1.0722 => 1.1856, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 10.53% (0.1463 => 0.1617, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.50% (0.1695 => 0.1873, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.49% (1.5859 => 1.7522, std.dev.: 0.0066) SingleSource/UnitTests/ObjC/exceptions-4: 10.47% (0.3543 => 0.3914, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.44% (0.3516 => 0.3883, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.42% (0.3561 => 0.3932, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.41% (0.3497 => 0.3861, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.40% (0.3828 => 0.4226, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.34% (0.1906 => 0.2103, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.29% (8.1363 => 8.9735, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 10.26% (0.3694 => 0.4073, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.21% (0.8101 => 0.8928, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.21% (2.2024 => 2.4272, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 10.16% (0.3886 => 0.4281, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 10.16% (0.3180 => 0.3503, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.06% (0.1044 => 0.1149, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.04% (0.1892 => 0.2082, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 9.98% (0.4289 => 0.4717, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 9.98% (9.4845 => 10.4306, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/bigfib: 9.94% (0.6456 => 0.7098, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 9.90% (2.2969 => 2.5243, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 9.88% (0.8921 => 0.9802, std.dev.: 0.0051) MultiSource/Benchmarks/nbench/nbench: 9.77% (1.1840 => 1.2997, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 9.48% (0.3387 => 0.3708, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 9.41% (1.1861 => 1.2977, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 9.26% (0.4620 => 0.5048, std.dev.: 0.0093) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.21% (0.4636 => 0.5063, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.16% (1.4186 => 1.5485, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.03% (0.3865 => 0.4214, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 8.88% (0.3422 => 0.3726, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.83% (0.4203 => 0.4574, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 8.54% (0.6030 => 0.6545, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.48% (0.4103 => 0.4451, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.42% (4.9449 => 5.3613, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/lists1: 8.39% (0.3684 => 0.3993, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 8.35% (0.5925 => 0.6420, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.34% (5.0018 => 5.4188, std.dev.: 0.0023) MultiSource/Applications/hbd/hbd: 8.29% (1.5603 => 1.6896, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 8.20% (0.4048 => 0.4380, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 8.18% (5.7591 => 6.2304, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/sieve: 8.13% (0.3603 => 0.3896, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 7.97% (0.1330 => 0.1436, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.94% (0.2430 => 0.2623, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.71% (0.7326 => 0.7891, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.37% (0.3650 => 0.3919, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.25% (0.3283 => 0.3521, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.23% (0.4064 => 0.4358, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/strcat: 7.17% (0.2831 => 0.3034, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.13% (0.2891 => 0.3097, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.09% (0.2793 => 0.2991, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.02% (0.2905 => 0.3109, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.97% (0.3098 => 0.3314, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.95% (0.3826 => 0.4092, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 6.93% (0.3232 => 0.3456, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.89% (0.3162 => 0.3380, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.84% (14.3668 => 15.3491, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/except: 6.79% (0.2871 => 0.3066, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.76% (2.0665 => 2.2061, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.72% (0.2872 => 0.3065, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/fibo: 6.68% (0.2725 => 0.2907, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.64% (0.2756 => 0.2939, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 6.58% (0.3282 => 0.3498, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.57% (0.3427 => 0.3652, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.55% (0.3052 => 0.3252, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 6.53% (0.2877 => 0.3065, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 6.48% (0.2714 => 0.2890, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/random: 6.28% (0.2802 => 0.2978, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 6.10% (1.2842 => 1.3625, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 6.07% (17.1811 => 18.2247, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.93% (0.8067 => 0.8545, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 5.92% (0.3092 => 0.3275, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 5.74% (0.3379 => 0.3573, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.70% (3.8922 => 4.1140, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.60% (0.2266 => 0.2393, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.48% (0.3136 => 0.3308, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/objinst: 4.50% (0.3131 => 0.3272, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.96% (0.3817 => 0.3930, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.90% (0.3935 => 0.4049, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.46% (7.0540 => 7.1567, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 19.80% (2.8904 => 3.4627, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.60% (1.1145 => 1.2995, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 10.05% (1.1396 => 1.2541, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.11% (0.9540 => 1.0218) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (3.1578 => 3.3690, std.dev.: 0.0010) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.68% (0.3463 => 0.3625, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.73% (4.2280 => 4.3434, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.34% (1.7254 => 1.7658, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.97% (3.6395 => 3.7111, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/bisort/bisort: 1.81% (0.8333 => 0.8484, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 1.53% (3.1595 => 3.2077, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 1.32% (11.6436 => 11.7978, std.dev.: 0.0054) MultiSource/Applications/minisat/minisat: 1.16% (9.1159 => 9.2217, std.dev.: 0.0295) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.08% (6.5088 => 6.5791, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.95% (6.6874 => 0.1371, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -76.56% (0.8651 => 0.2028, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.14% (5.3855 => 2.4159, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -55.00% (5.3526 => 2.4089, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/richards_benchmark: -45.93% (0.1622 => 0.0877, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -41.17% (5.2763 => 3.1039, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -38.60% (1.1194 => 0.6873, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -24.58% (1.7609 => 1.3281, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.87% (2.9384 => 2.5308, std.dev.: 0.0034) MultiSource/Applications/JM/ldecod/ldecod: -10.57% (10.4361 => 9.3329, std.dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -9.19% (54.1659 => 49.1888, std.dev.: 0.0226) MultiSource/Benchmarks/Bullet/bullet: -7.77% (63.2438 => 58.3268, std.dev.: 0.0222) MultiSource/Benchmarks/PAQ8p/paq8p: -4.63% (10.3673 => 9.8878, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -3.81% (22.1758 => 21.3303, std.dev.: 0.0268) MultiSource/Applications/JM/lencod/lencod: -2.85% (21.9371 => 21.3127, std.dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -35.18% (0.0506 => 0.0328, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -35.16% (0.3987 => 0.2585, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7652, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -28.73% (10.7105 => 7.6334, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: -16.09% (1.6925 => 1.4202, std.dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: -10.96% (9.5636 => 8.5151, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -10.75% (1.5373 => 1.3721, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.36% (19.9488 => 18.2819, std.dev.: 0.0169) MultiSource/Benchmarks/FreeBench/mason/mason: -7.96% (0.2161 => 0.1989, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.09% (1.8329 => 1.7030, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4783, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -6.05% (1.2373 => 1.1625, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -5.64% (1.9577 => 1.8473, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.10% (1.6805 => 1.5948, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: -5.00% (6.6465 => 6.3141, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.69% (1.5835 => 1.5092, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.61% (1.5660 => 1.4938, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.04% (0.2497 => 0.2396, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -3.75% (4.5009 => 4.3323, std.dev.: 0.0019) MultiSource/Applications/siod/siod: -3.72% (3.2827 => 3.1607, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.58% (0.9957 => 0.9601, std.dev.: 0.0030) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.51% (32.5116 => 31.3719, std.dev.: 0.0093) MultiSource/Benchmarks/sim/sim: -3.24% (5.0483 => 4.8847, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.95% (0.4808 => 0.4666, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: -2.78% (4.6441 => 4.5150, std.dev.: 0.0032) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/Olden/power/power: -2.13% (1.1277 => 1.1037) SingleSource/Benchmarks/Misc/salsa20: -1.82% (10.2830 => 10.0962, std.dev.: 0.0125) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.80% (8.1563 => 8.0092, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6814, std.dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -1.54% (2.5528 => 2.5135, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -1.28% (85.0658 => 83.9737, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0554 => 1.0444, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2358, std.dev.: 0.0042) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -5.45% (0.1485 => 0.1404, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.38% (0.2116 => 0.0648, std.dev.: 0.0006) Report Time: 2.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 21:14:47 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 23:14:47 -0500 (CDT) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20121101041447.886D02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5472?compare_to=5465&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 5472, Order: 167184, Start Time: 2012-11-01 00:59:10, End Time: 2012-11-01 04:14:49 To: 5465, Order: 167161, Start Time: 2012-10-31 20:55:09, End Time: 2012-11-01 00:10:46 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (168 on baseline) Performance Improvements: 2 (19 on baseline) Added Tests: 0 (134 on baseline) Unchanged Tests: 1040 (721 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.78% (2.0121 => 1.9762, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: -1.08% (2.3784 => 2.3526, std.dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.64% (0.0625 => 0.0879, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.61% (0.1063 => 0.1399, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.29% (0.2969 => 0.3720, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.09% (0.4253 => 0.5320, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 24.77% (0.1106 => 0.1380, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 24.04% (1.5932 => 1.9762, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 23.92% (0.4139 => 0.5129, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.67% (0.0714 => 0.0883, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.37% (0.4994 => 0.6161, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.25% (0.5900 => 0.7272, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.85% (0.0547 => 0.0672, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.70% (0.5000 => 0.6135, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.26% (0.0584 => 0.0714, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.11% (0.0475 => 0.0580, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.85% (0.0897 => 0.1093, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/tsp/tsp: 21.37% (0.0599 => 0.0727, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.35% (0.1021 => 0.1239, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.23% (0.1620 => 0.1964, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.79% (0.1549 => 0.1871, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 20.69% (0.1107 => 0.1336, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 20.04% (0.0948 => 0.1138, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 19.96% (0.0541 => 0.0649, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/04-bisect/bisect: 19.91% (0.0633 => 0.0759, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 19.87% (0.0604 => 0.0724, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.86% (0.0584 => 0.0700, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.68% (0.3903 => 0.4671, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.67% (0.1103 => 0.1320, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.47% (0.0642 => 0.0767, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 19.39% (0.1619 => 0.1933, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 19.37% (0.0821 => 0.0980, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.34% (0.1003 => 0.1197, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 19.20% (0.1604 => 0.1912, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.98% (0.0822 => 0.0978, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 18.27% (0.0947 => 0.1120, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.19% (0.1462 => 0.1728, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 18.18% (0.5826 => 0.6885, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.97% (0.3890 => 0.4589, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 17.93% (0.5889 => 0.6945, std.dev.: 0.0041) MultiSource/Applications/sgefa/sgefa: 17.82% (0.0808 => 0.0952, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 17.65% (0.1218 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.48% (0.2014 => 0.2366, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.37% (1.3152 => 1.5437, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/09-vor/vor: 17.34% (0.1505 => 0.1766, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.28% (0.1088 => 0.1276, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 17.15% (0.5546 => 0.6497, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/mst/mst: 17.05% (0.0698 => 0.0817, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.00% (0.2736 => 0.3201, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 16.93% (0.4029 => 0.4711, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.66% (0.2875 => 0.3354, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.65% (0.2738 => 0.3194, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.60% (0.3271 => 0.3814, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.57% (0.2866 => 0.3341, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 16.49% (1.8794 => 2.1894, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.41% (0.5026 => 0.5851, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.35% (3.5627 => 4.1452, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.33% (0.1090 => 0.1268, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 16.29% (23.5202 => 27.3506, std.dev.: 0.0147) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.21% (0.1160 => 0.1348, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/fibo: 16.18% (0.2725 => 0.3166, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 16.12% (0.1284 => 0.1491, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 16.06% (0.7171 => 0.8323, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.06% (0.1968 => 0.2284, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 16.03% (0.2714 => 0.3149, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 15.97% (0.4658 => 0.5402, std.dev.: 0.0032) MultiSource/Applications/hbd/hbd: 15.90% (0.9697 => 1.1239, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 15.87% (1.6211 => 1.8784, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.87% (0.2729 => 0.3162, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 15.85% (0.3004 => 0.3480, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 15.78% (0.2750 => 0.3184, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 15.76% (0.2780 => 0.3218, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 15.70% (1.0781 => 1.2474, std.dev.: 0.0103) MultiSource/Applications/hexxagon/hexxagon: 15.70% (0.9909 => 1.1465, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/18-imp/imp: 15.69% (0.1421 => 0.1644, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 15.66% (0.2823 => 0.3265, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.65% (0.2792 => 0.3229, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 15.64% (0.2813 => 0.3253, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 15.63% (0.3096 => 0.3580, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/random: 15.63% (0.2803 => 0.3241, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.57% (0.4361 => 0.5040, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.55% (2.0673 => 2.3887, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.49% (0.3195 => 0.3690, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.49% (0.2911 => 0.3362, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.49% (0.3060 => 0.3534, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 15.44% (0.2811 => 0.3245, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.28% (4.4195 => 5.0947, std.dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.22% (2.7292 => 3.1445, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary3: 15.15% (0.3267 => 0.3762, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.99% (0.3362 => 0.3866, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 14.89% (0.3258 => 0.3743, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.89% (0.3930 => 0.4515, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 14.87% (4.2109 => 4.8369, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/ary2: 14.80% (0.3317 => 0.3808, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.79% (1.9694 => 2.2607, std.dev.: 0.0095) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.76% (1.9966 => 2.2912, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.50% (0.3124 => 0.3577, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.29% (0.3282 => 0.3751, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 14.26% (0.2566 => 0.2932, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/moments: 14.19% (0.3678 => 0.4200, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.17% (0.3845 => 0.4390, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 14.16% (0.4251 => 0.4853, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 14.14% (0.3726 => 0.4253, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 14.10% (0.3348 => 0.3820, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 14.09% (0.4146 => 0.4730, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.88% (0.3690 => 0.4202, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 13.83% (0.3477 => 0.3958, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.77% (0.3625 => 0.4124, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.77% (0.3981 => 0.4529, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 13.73% (0.2075 => 0.2360, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.71% (0.3465 => 0.3940, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 13.70% (0.3446 => 0.3918, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 13.66% (1.4269 => 1.6218, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 13.64% (0.3496 => 0.3973, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/trivial-interface: 13.63% (0.3442 => 0.3911, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 13.61% (0.3460 => 0.3931, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 13.55% (0.3469 => 0.3939, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.50% (0.3488 => 0.3959, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 13.31% (0.3643 => 0.4128, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 13.31% (0.5012 => 0.5679, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 13.26% (0.3650 => 0.4134, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 13.10% (0.3724 => 0.4212, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 12.97% (2.1653 => 2.4462, std.dev.: 0.0023) MultiSource/Applications/treecc/treecc: 12.89% (0.7875 => 0.8890, std.dev.: 0.0077) MultiSource/Applications/JM/lencod/lencod: 12.68% (4.6177 => 5.2033, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: 11.96% (2.1013 => 2.3526, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.76% (0.2040 => 0.2280, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.69% (0.6435 => 0.7187, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 11.45% (0.2691 => 0.2999, std.dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 11.39% (5.5417 => 6.1728, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.38% (0.1028 => 0.1145, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 10.95% (0.3498 => 0.3881, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.89% (0.2737 => 0.3035, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 10.75% (0.4847 => 0.5368, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.44% (0.2068 => 0.2284, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.41% (0.3084 => 0.3405, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 10.28% (0.3336 => 0.3679, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.27% (0.1383 => 0.1525, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.89% (0.2103 => 0.2311, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 9.72% (0.6634 => 0.7279, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.30% (4.6926 => 5.1289, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 9.24% (2.0346 => 2.2225, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.10% (11.6398 => 12.6994, std.dev.: 0.0114) MultiSource/Applications/lemon/lemon: 8.91% (0.2391 => 0.2604, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.11% (0.5361 => 0.5796, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.64% (0.7426 => 0.7993, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.49% (0.5584 => 0.6002, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 6.80% (11.9555 => 12.7682, std.dev.: 0.0075) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.46% (0.3792 => 0.3961, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.65% (6.2401 => 7.6534, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.22% (0.5917 => 0.6699, std.dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 8.92% (0.2802 => 0.3052, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6097, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 5.01% (12.0509 => 12.6543, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/flops: 4.71% (15.4430 => 16.1698, std.dev.: 0.0849) SingleSource/Benchmarks/Misc/flops-2: 4.11% (1.8057 => 1.8799, std.dev.: 0.0096) SingleSource/Benchmarks/Dhrystone/dry: 2.75% (14.0481 => 14.4339, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1957, std.dev.: 0.0099) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.69% (3.1722 => 3.2258, std.dev.: 0.0019) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3080, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2862, std.dev.: 0.0023) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.24% (1.0142 => 1.0268, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (8.4155 => 8.5128, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5400, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.08% (1.2451 => 1.2585, std.dev.: 0.0026) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5982, std.dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.49% (2.4764 => 2.4148, std.dev.: 0.0148) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.53% (25.4195 => 16.3888, std.dev.: 0.0139) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9764, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.68% (35.5013 => 32.7735, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -6.79% (0.2402 => 0.2239, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -3.38% (11.2080 => 10.8288, std.dev.: 0.0299) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7755, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -2.88% (3.6262 => 3.5218, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.86% (0.6293 => 0.6113, std.dev.: 0.0064) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.20% (41.7953 => 40.8773, std.dev.: 0.0058) SingleSource/Benchmarks/Dhrystone/fldry: -2.05% (17.2379 => 16.8840, std.dev.: 0.0267) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5707, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -1.54% (5.5810 => 5.4950, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.11% (105.3826 => 104.2153, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0462, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -1.04% (3.3991 => 3.3637, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 21:27:37 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 31 Oct 2012 23:27:37 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121101042737.3A5402A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5473?compare_to=5469&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5473, Order: 167208, Start Time: 2012-11-01 03:00:07, End Time: 2012-11-01 04:27:39 To: 5469, Order: 167192, Start Time: 2012-11-01 01:15:37, End Time: 2012-11-01 02:43:13 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 14 (100 on baseline) Performance Improvements: 4 (6 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 973 (868 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MallocBench/gs/gs: 2.42% (4.1920 => 4.2935, std.dev.: 0.0385) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.35% (0.6126 => 0.6270, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.35% (1.3577 => 1.3896, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.14% (0.7769 => 0.7935, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.91% (0.5927 => 0.6040, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.77% (0.6515 => 0.6630, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.30% (1.1983 => 1.2139, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.28% (1.2122 => 1.2277, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.27% (1.2748 => 1.2910, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.21% (8.8711 => 8.9782, std.dev.: 0.0320) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.19% (1.6782 => 1.6982, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 17.14% (2.9995 => 3.5136, std.dev.: 0.1589) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.93% (0.7697 => 0.8692, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/em3d/em3d: 5.20% (5.1908 => 5.4605, std.dev.: 0.0063) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -1.32% (0.8262 => 0.8153, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.97% (0.4246 => 0.4120, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.08% (1.2538 => 1.2403, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.02% (2.4923 => 2.4670, std.dev.: 0.0049) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: -1.36% (16.9131 => 16.6833, std.dev.: 0.0966) MultiSource/Applications/obsequi/Obsequi: 1.41% (1.0634 => 1.0784, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -0.14% (21.7530 => 21.7219, std.dev.: 0.4958) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.38% (0.3682 => 0.3696, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -2.68% (0.6226 => 0.6059, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/reversefile: 0.09% (0.3336 => 0.3339, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/strcat: 0.10% (0.2016 => 0.2018, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0217 => 0.0217, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0423 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.30% (0.0330 => 0.0331, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.64% (0.0314 => 0.0312, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.24% (0.0421 => 0.0420, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0202 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0217 => 0.0217, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: - (0.1453 => 0.1453, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -0.07% (1.1386 => 1.1378, std.dev.: 0.0041) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -3.69% (0.1519 => 0.1463, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/12-IOtest/iotest: - (0.4073 => 0.4073, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.01% (0.1364 => 0.1282, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.89% (0.0596 => 0.0643, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -11.19% (0.0277 => 0.0246, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.46% (0.0549 => 0.0557, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.91% (1.1465 => 1.1361, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -94.44% (0.0018 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.15% (0.0026 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.92% (0.0651 => 0.0645, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -22.18% (0.0239 => 0.0186, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.30% (0.8034 => 0.8010, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -31.65% (0.0079 => 0.0054, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2311.97% (0.6332 => 15.2726, std.dev.: 0.4496) MultiSource/Benchmarks/McCat/08-main/main: 49.70% (0.1831 => 0.2741, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.77% (0.1559 => 0.1469, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1487.62% (0.3344 => 5.3090, std.dev.: 0.0546) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.23% (0.2364 => 0.3244, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/mandel: 3.03% (0.0429 => 0.0442, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -1.34% (0.0224 => 0.0221, std.dev.: 0.0013) SingleSource/UnitTests/byval-alignment: -27.39% (0.0230 => 0.0167, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3506, std.dev.: 0.0828) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0682, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4917, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3439, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0131, std.dev.: 0.0219) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4025, std.dev.: 0.0062) SingleSource/Regression/C/uint64_to_float: -24.13% (2.1832 => 1.6564, std.dev.: 0.0033) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.79% (0.0810 => 0.0946, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 12.59% (0.1112 => 0.1252, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 12.41% (0.0830 => 0.0933, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.41% (0.1137 => 0.1244, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.27% (0.2180 => 0.2382, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.56% (0.1425 => 0.1547, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.77% (0.8148 => 0.8781, std.dev.: 0.0164) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.63% (0.8321 => 0.8956, std.dev.: 0.0128) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.46% (0.3137 => 0.3371, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.31% (0.1983 => 0.2128, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.12% (0.6010 => 0.6438, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.99% (0.4847 => 0.5186, std.dev.: 0.0031) MultiSource/Applications/viterbi/viterbi: 6.72% (0.1577 => 0.1683, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.52% (0.1778 => 0.1894, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.34% (0.2240 => 0.2382, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.18% (0.7473 => 0.7935, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.04% (0.1905 => 0.2020, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.90% (0.2998 => 0.3175, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 5.87% (0.1721 => 0.1822, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.46% (0.6287 => 0.6630, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.31% (0.3295 => 0.3470, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.28% (0.2519 => 0.2652, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.18% (0.5961 => 0.6270, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.17% (0.2378 => 0.2501, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.07% (1.1685 => 1.2277, std.dev.: 0.0030) MultiSource/Applications/spiff/spiff: 4.99% (0.7950 => 0.8347, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 4.65% (1.3279 => 1.3896, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.59% (1.1606 => 1.2139, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.48% (0.9435 => 0.9858, std.dev.: 0.0103) MultiSource/Benchmarks/nbench/nbench: 4.48% (1.1271 => 1.1776, std.dev.: 0.0034) MultiSource/Applications/Burg/burg: 4.46% (1.2222 => 1.2767, std.dev.: 0.0101) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.30% (0.2741 => 0.2859, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 4.30% (14.7684 => 15.4030, std.dev.: 0.1728) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.10% (0.5191 => 0.5404, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 3.95% (4.1305 => 4.2935, std.dev.: 0.0385) SingleSource/Benchmarks/Shootout-C++/hash: 3.92% (0.3800 => 0.3949, std.dev.: 0.0029) MultiSource/Applications/SIBsim4/SIBsim4: 3.89% (1.2568 => 1.3057, std.dev.: 0.0129) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.87% (0.8340 => 0.8663, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.84% (0.4559 => 0.4734, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.83% (0.5817 => 0.6040, std.dev.: 0.0036) MultiSource/Applications/treecc/treecc: 3.82% (1.9948 => 2.0711, std.dev.: 0.0199) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.82% (8.6476 => 8.9782, std.dev.: 0.0320) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.64% (1.6386 => 1.6982, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.63% (1.1170 => 1.1575, std.dev.: 0.0035) MultiSource/Applications/d/make_dparser: 3.57% (3.2366 => 3.3521, std.dev.: 0.0207) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.52% (0.8697 => 0.9003, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.44% (0.8457 => 0.8748, std.dev.: 0.0034) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.26% (6.6074 => 6.8229, std.dev.: 0.0384) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.25% (0.6586 => 0.6800, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.24% (4.4880 => 4.6333, std.dev.: 0.0149) MultiSource/Benchmarks/McCat/05-eks/eks: 3.12% (0.4397 => 0.4534, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.10% (1.2602 => 1.2993, std.dev.: 0.0063) MultiSource/Applications/SPASS/SPASS: 3.08% (14.2605 => 14.6999, std.dev.: 0.1095) MultiSource/Benchmarks/Prolangs-C/football/football: 3.08% (0.8768 => 0.9038, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.07% (1.2526 => 1.2910, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.05% (4.1763 => 4.3035, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.96% (0.8317 => 0.8563, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.90% (1.4479 => 1.4899, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.88% (0.8331 => 0.8571, std.dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.82% (0.3717 => 0.3822, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.76% (0.8050 => 0.8272, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.65% (0.8716 => 0.8947, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.63% (0.7932 => 0.8141, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.61% (0.9039 => 0.9275, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.60% (0.8611 => 0.8835, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.59% (0.7966 => 0.8172, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.53% (0.8069 => 0.8273, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.48% (0.9688 => 0.9928, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.47% (0.8204 => 0.8407, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.47% (0.8066 => 0.8265, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.46% (0.8177 => 0.8378, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.44% (0.8316 => 0.8519, std.dev.: 0.0052) MultiSource/Benchmarks/mafft/pairlocalalign: 2.43% (8.6247 => 8.8347, std.dev.: 0.0450) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.39% (0.8805 => 0.9015, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.36% (0.8597 => 0.8800, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.33% (2.1401 => 2.1900, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.33% (0.8885 => 0.9092, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.31% (0.8261 => 0.8452, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.24% (13.1811 => 13.4764, std.dev.: 0.0432) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.23% (0.9056 => 0.9258, std.dev.: 0.0021) MultiSource/Applications/minisat/minisat: 2.22% (0.6834 => 0.6986, std.dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: 2.17% (31.8598 => 32.5522, std.dev.: 0.1636) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.06% (0.8338 => 0.8510, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.89% (0.8995 => 0.9165, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.82% (0.8007 => 0.8153, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.80% (1.5315 => 1.5590, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.54% (1.2423 => 1.2614, std.dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 57.35% (1.5795 => 2.4853, std.dev.: 0.0130) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.43% (2.7978 => 3.7330, std.dev.: 0.0143) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.49% (2.4333 => 2.6641, std.dev.: 0.0542) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 8.00% (1.1857 => 1.2806, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 5.96% (63.1822 => 66.9490, std.dev.: 0.0570) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.60% (0.2887 => 0.2991, std.dev.: 0.0023) MultiSource/Applications/siod/siod: 2.79% (3.6643 => 3.7664, std.dev.: 0.0206) SingleSource/Benchmarks/Shootout-C++/hash: 2.43% (0.6205 => 0.6356, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.05% (2.4490 => 2.4991, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/ReedSolomon: 1.97% (8.5322 => 8.7005, std.dev.: 0.0586) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.53% (4.8362 => 4.9103, std.dev.: 0.0083) MultiSource/Benchmarks/Olden/bh/bh: 1.44% (2.3560 => 2.3900, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.27% (59.2638 => 60.0157, std.dev.: 0.1964) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -36.69% (0.0338 => 0.0214, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.04% (0.3269 => 0.3039, std.dev.: 0.0010) MultiSource/Applications/lua/lua: -5.27% (29.8330 => 28.2602, std.dev.: 0.0618) MultiSource/Applications/SPASS/SPASS: -3.70% (8.4326 => 8.1209, std.dev.: 0.1021) SingleSource/Benchmarks/Shootout-C++/hash2: -1.46% (3.4237 => 3.3737, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.32% (3.3479 => 3.3036, std.dev.: 0.0089) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.44% (16.4461 => 16.6833, std.dev.: 0.0966) MultiSource/Applications/obsequi/Obsequi: 5.09% (1.0262 => 1.0784, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6855.46% (0.3123 => 21.7219, std.dev.: 0.4958) SingleSource/Benchmarks/CoyoteBench/fftbench: 50.06% (0.2463 => 0.3696, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 0.82% (0.6010 => 0.6059, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.24% (0.3266 => 0.3339, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/strcat: 2.49% (0.1969 => 0.2018, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 76.42% (0.0123 => 0.0217, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.68% (0.0408 => 0.0423, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.31% (0.0254 => 0.0331, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.31% (0.0302 => 0.0312, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.38% (0.0384 => 0.0420, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 1.04% (0.1438 => 0.1453, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 0.43% (1.1329 => 1.1378, std.dev.: 0.0041) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 0.07% (0.1462 => 0.1463, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.19% (0.4164 => 0.4073, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.36% (0.1369 => 0.1282, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.31% (0.0641 => 0.0643, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 26.15% (0.0195 => 0.0246, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.63% (0.0578 => 0.0557, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.66% (1.1437 => 1.1361, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.87% (0.0627 => 0.0645, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.33% (0.0180 => 0.0186, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.09% (0.8017 => 0.8010, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -12.90% (0.0062 => 0.0054, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 2.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 22:08:22 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 00:08:22 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121101050822.CEF4C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5474?compare_to=5470&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5474, Order: 167208, Start Time: 2012-11-01 03:43:24, End Time: 2012-11-01 05:08:24 To: 5470, Order: 167198, Start Time: 2012-11-01 01:55:13, End Time: 2012-11-01 03:20:20 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 1 (174 on baseline) Unchanged Tests: 1040 (862 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/sim/sim: 3.33% (4.8813 => 5.0438, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.76% (1.2906 => 1.2679, std.dev.: 0.0081) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.15% (3.1919 => 3.4200, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 3.33% (4.8812 => 5.0438, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.67% (2.0478 => 2.1024, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: 2.45% (7.4937 => 7.6773, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/hash2: 2.12% (3.1932 => 3.2608, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -9.03% (0.1584 => 0.1441, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.67% (0.1431 => 0.1307, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.38% (0.3821 => 0.3539, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -7.33% (0.3831 => 0.3550, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -7.31% (0.3884 => 0.3600, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -7.29% (0.3880 => 0.3597, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -7.24% (0.3812 => 0.3536, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -7.21% (0.3896 => 0.3615, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -7.20% (0.3848 => 0.3571, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -7.14% (0.3891 => 0.3613, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -7.09% (0.4176 => 0.3880, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -7.07% (0.4033 => 0.3748, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -6.95% (0.4199 => 0.3907, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -6.70% (2.4924 => 2.3254, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -6.66% (0.4280 => 0.3995, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.59% (0.3142 => 0.2935, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.47% (0.2428 => 0.2271, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.34% (0.9542 => 0.8937, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -6.31% (0.3025 => 0.2834, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -6.28% (0.3057 => 0.2865, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -6.23% (0.3658 => 0.3430, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: -6.19% (0.2939 => 0.2757, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -6.17% (0.1879 => 0.1763, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.17% (0.2903 => 0.2724, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.15% (2.1713 => 2.0377, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.14% (4.5069 => 4.2301, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/strcat: -6.09% (0.2989 => 0.2807, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -6.07% (0.2849 => 0.2676, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -6.05% (0.3026 => 0.2843, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.05% (0.3837 => 0.3605, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -6.04% (0.3194 => 0.3001, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -6.03% (0.3016 => 0.2834, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.03% (0.3849 => 0.3617, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.03% (0.3252 => 0.3056, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -6.02% (0.3255 => 0.3059, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -6.02% (0.3357 => 0.3155, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.00% (0.3931 => 0.3695, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -5.99% (1.3148 => 1.2360, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.99% (22.4056 => 21.0629, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.99% (0.2355 => 0.2214, std.dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: -5.97% (7.0961 => 6.6724, std.dev.: 0.0032) SingleSource/Regression/C++/ofstream_ctor: -5.95% (0.3059 => 0.2877, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -5.95% (16.1920 => 15.2287, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.91% (3.5339 => 3.3249, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.90% (0.4151 => 0.3906, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -5.89% (0.3481 => 0.3276, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -5.86% (0.3394 => 0.3195, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -5.86% (0.3446 => 0.3244, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: -5.83% (0.2160 => 0.2034, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.81% (0.4321 => 0.4070, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: -5.79% (0.2659 => 0.2505, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -5.79% (4.3330 => 4.0821, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/wc: -5.77% (0.3205 => 0.3020, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.76% (4.8802 => 4.5993, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.75% (0.6484 => 0.6111, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.75% (4.8161 => 4.5392, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.73% (0.4083 => 0.3849, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -5.69% (0.3621 => 0.3415, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.68% (1.0544 => 0.9945, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.67% (0.9852 => 0.9293, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.63% (4.0323 => 3.8053, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/lists1: -5.61% (0.3867 => 0.3650, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.60% (0.5999 => 0.5663, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: -5.59% (1.2515 => 1.1815, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: -5.58% (0.4248 => 0.4011, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.58% (1.2784 => 1.2071, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.57% (0.2548 => 0.2406, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: -5.52% (0.3788 => 0.3579, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: -5.48% (0.4524 => 0.4276, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: -5.47% (0.4861 => 0.4595, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.44% (0.4427 => 0.4186, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.39% (0.7919 => 0.7492, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.34% (0.8521 => 0.8066, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.32% (5.4682 => 5.1771, std.dev.: 0.0006) MultiSource/Applications/lua/lua: -5.32% (4.0594 => 3.8435, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/football/football: -5.31% (0.9179 => 0.8692, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.30% (1.2300 => 1.1648, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.30% (14.2083 => 13.4556, std.dev.: 0.0208) MultiSource/Benchmarks/Bullet/bullet: -5.29% (34.0927 => 32.2893, std.dev.: 0.0214) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.28% (6.7716 => 6.4138, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.26% (1.6364 => 1.5504, std.dev.: 0.0015) MultiSource/Applications/siod/siod: -5.22% (2.4021 => 2.2766, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.22% (0.2933 => 0.2780, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/bigfib: -5.20% (0.6750 => 0.6399, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.18% (1.6474 => 1.5620, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.18% (1.3722 => 1.3011, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.18% (0.2278 => 0.2160, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.17% (0.4813 => 0.4564, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.16% (0.6293 => 0.5968, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: -5.13% (0.2985 => 0.2832, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.10% (0.5591 => 0.5306, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.09% (1.4642 => 1.3896, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.07% (0.2999 => 0.2847, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: -5.06% (1.1450 => 1.0871, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: -5.05% (9.2283 => 8.7626, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.04% (0.5478 => 0.5202, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.04% (1.2210 => 1.1595, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.03% (0.5925 => 0.5627, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -5.03% (0.7779 => 0.7388, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: -5.03% (0.6347 => 0.6028, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.99% (0.7198 => 0.6839, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: -4.99% (0.7982 => 0.7584, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.98% (0.5802 => 0.5513, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.94% (0.4916 => 0.4673, std.dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: -4.94% (18.2933 => 17.3895, std.dev.: 0.0232) MultiSource/Applications/sqlite3/sqlite3: -4.92% (17.1032 => 16.2619, std.dev.: 0.0077) MultiSource/Benchmarks/McCat/18-imp/imp: -4.89% (0.3581 => 0.3406, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.88% (0.5863 => 0.5577, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/05-eks/eks: -4.87% (0.4515 => 0.4295, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.87% (0.3491 => 0.3321, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.86% (0.6052 => 0.5758, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.85% (1.2221 => 1.1628, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: -4.84% (0.6441 => 0.6129, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.82% (0.2385 => 0.2270, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.82% (0.6230 => 0.5930, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.81% (0.5805 => 0.5526, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -4.79% (0.7447 => 0.7090, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.78% (0.9557 => 0.9100, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.78% (0.5857 => 0.5577, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.78% (0.6297 => 0.5996, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.78% (0.6194 => 0.5898, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.77% (0.3483 => 0.3317, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.75% (2.2587 => 2.1513, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.75% (0.5705 => 0.5434, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.74% (0.5570 => 0.5306, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.74% (0.5575 => 0.5311, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: -4.71% (0.3271 => 0.3117, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.70% (8.0126 => 7.6358, std.dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.70% (0.3319 => 0.3163, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.69% (0.5569 => 0.5308, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.68% (0.5859 => 0.5585, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.66% (0.5581 => 0.5321, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.64% (0.6189 => 0.5902, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.63% (0.6304 => 0.6012, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.61% (0.6660 => 0.6353, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.59% (0.6667 => 0.6361, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -4.58% (2.1401 => 2.0421, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.58% (0.7339 => 0.7003, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.57% (0.5688 => 0.5428, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.55% (0.6395 => 0.6104, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.55% (0.6446 => 0.6153, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.53% (0.5849 => 0.5584, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.53% (0.5567 => 0.5315, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.52% (0.6260 => 0.5977, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.51% (0.5941 => 0.5673, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.51% (0.5456 => 0.5210, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.49% (0.6033 => 0.5762, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: -4.49% (0.8418 => 0.8040, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.44% (0.6440 => 0.6154, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -4.43% (0.3406 => 0.3255, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.43% (0.9077 => 0.8675, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.42% (0.6736 => 0.6438, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.42% (0.6676 => 0.6381, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.39% (0.6395 => 0.6114, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.35% (0.7524 => 0.7197, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -4.33% (1.3864 => 1.3263, std.dev.: 0.0039) MultiSource/Applications/SPASS/SPASS: -4.30% (15.5079 => 14.8404, std.dev.: 0.0062) MultiSource/Applications/d/make_dparser: -3.99% (3.5154 => 3.3751, std.dev.: 0.0056) MultiSource/Applications/ClamAV/clamscan: -3.99% (15.2527 => 14.6447, std.dev.: 0.0218) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.90% (0.7021 => 0.6747, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: -3.88% (1.5610 => 1.5004, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.83% (0.5168 => 0.4970, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: -3.77% (1.1530 => 1.1095, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: -3.53% (5.0226 => 4.8454, std.dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.40% (0.5329 => 0.5148, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -2.46% (20.7746 => 20.2640, std.dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7529, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/richards_benchmark: -8.68% (1.2842 => 1.1727, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.82% (1.7753 => 1.7075, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.61% (2.2633 => 2.1815, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.18% (1.3096 => 1.2679, std.dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4670, std.dev.: 0.0025) Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 23:08:21 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 01:08:21 -0500 (CDT) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20121101060821.3D1002A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5475?compare_to=5471&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 5475, Order: 167210, Start Time: 2012-11-01 04:35:18, End Time: 2012-11-01 06:08:22 To: 5471, Order: 167199, Start Time: 2012-11-01 02:32:40, End Time: 2012-11-01 04:05:28 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 3 (175 on baseline) Performance Improvements: 1 (54 on baseline) Added Tests: 0 (134 on baseline) Existing Failures: 2 (2 on baseline) Unchanged Tests: 1036 (660 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 14.40% (0.4104 => 0.4695, std.dev.: 0.0196) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.05% (1.5485 => 1.5647, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.02% (7.1567 => 7.2296, std.dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.32% (9.8878 => 9.7577, std.dev.: 0.0138) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -0.07% (0.1404 => 0.1403, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.86% (0.0648 => 0.0673, std.dev.: 0.0002) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 190.86% (0.5229 => 1.5209, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 13.34% (14.9895 => 16.9890, std.dev.: 0.0210) MultiSource/Applications/kimwitu++/kc: 36.31% (14.1553 => 19.2945, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 12.60% (4.1105 => 4.6284, std.dev.: 0.0124) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 29.55% (1.1048 => 1.4313, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 307.66% (7.1582 => 29.1810, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++-EH/spirit: 68.87% (3.4629 => 5.8479, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 63.73% (0.6222 => 1.0187, std.dev.: 0.0016) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10602.22% (0.0720 => 7.7056, std.dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: 3836600.00% (0.0001 => 3.8367, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 11177000.00% (0.0001 => 11.1771, std.dev.: 0.0243) MultiSource/Applications/kimwitu++/kc: 50500.00% (0.0001 => 0.0506, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 780600.00% (0.0001 => 0.7807, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10049400.00% (0.0001 => 10.0495, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5494700.00% (0.0001 => 5.4948, std.dev.: 0.0110) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/distray/distray: 37.97% (0.1056 => 0.1457, std.dev.: 0.0024) SingleSource/UnitTests/vla: 29.58% (0.0355 => 0.0460, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 28.07% (0.1432 => 0.1834, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 20.43% (0.1566 => 0.1886, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 19.18% (0.0730 => 0.0870, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 17.45% (0.1175 => 0.1380, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.40% (0.0793 => 0.0931, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 17.31% (0.3177 => 0.3727, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: 16.99% (0.0871 => 0.1019, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 16.76% (0.0746 => 0.0871, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 16.50% (0.4879 => 0.5684, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/08-main/main: 16.21% (0.2554 => 0.2968, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.04% (0.0798 => 0.0926, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.87% (0.8172 => 0.9469, std.dev.: 0.0063) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.59% (0.0834 => 0.0964, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.44% (0.0842 => 0.0972, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/mst/mst: 15.31% (0.1163 => 0.1341, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 15.21% (0.1584 => 0.1825, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 14.93% (0.1695 => 0.1948, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.45% (0.0886 => 0.1014, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/chomp: 14.44% (0.1655 => 0.1894, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 14.29% (0.0770 => 0.0880, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 14.26% (0.5105 => 0.5833, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.19% (0.2065 => 0.2358, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 14.00% (0.2700 => 0.3078, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 13.95% (0.1555 => 0.1772, std.dev.: 0.0036) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.91% (0.1143 => 0.1302, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.88% (0.1117 => 0.1272, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 13.69% (0.7115 => 0.8089, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.69% (0.1337 => 0.1520, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 13.64% (0.0770 => 0.0875, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.63% (0.2758 => 0.3134, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 13.61% (0.1940 => 0.2204, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.58% (0.5981 => 0.6793, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 13.47% (0.1151 => 0.1306, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.45% (0.6675 => 0.7573, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 13.44% (0.3109 => 0.3527, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 13.42% (0.1125 => 0.1276, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.38% (0.2107 => 0.2389, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 13.26% (1.1642 => 1.3186, std.dev.: 0.0102) MultiSource/Applications/lambda-0_1_3/lambda: 13.18% (0.7433 => 0.8413, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.11% (0.1510 => 0.1708, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 13.03% (0.2271 => 0.2567, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.96% (2.2022 => 2.4877, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.93% (0.1029 => 0.1162, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 12.92% (0.7835 => 0.8847, std.dev.: 0.0036) MultiSource/Applications/d/make_dparser: 12.90% (3.3354 => 3.7656, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.89% (0.9765 => 1.1024, std.dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.88% (0.3121 => 0.3523, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.82% (0.5569 => 0.6283, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.81% (1.5415 => 1.7390, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.81% (0.1062 => 0.1198, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 12.70% (0.5860 => 0.6604, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 12.65% (0.0814 => 0.0917, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.61% (0.4615 => 0.5197, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.31% (0.1032 => 0.1159, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.26% (0.3441 => 0.3863, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/health/health: 12.22% (0.1268 => 0.1423, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.19% (0.5020 => 0.5632, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.09% (1.3050 => 1.4628, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.89% (0.1236 => 0.1383, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 11.87% (3.8723 => 4.3320, std.dev.: 0.0196) MultiSource/Applications/treecc/treecc: 11.76% (2.0273 => 2.2658, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.70% (0.3307 => 0.3694, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.49% (0.2603 => 0.2902, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 11.45% (0.3423 => 0.3815, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.40% (0.3543 => 0.3947, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.38% (0.1625 => 0.1810, std.dev.: 0.0006) SingleSource/UnitTests/SignlessTypes/rem: 11.36% (0.1144 => 0.1274, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.33% (0.6450 => 0.7181, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.32% (4.2646 => 4.7475, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/neural/neural: 11.21% (0.1463 => 0.1627, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 11.15% (1.0722 => 1.1918, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 11.15% (0.3927 => 0.4365, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.15% (0.1695 => 0.1884, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.09% (0.0929 => 0.1032, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.97% (0.3473 => 0.3854, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.87% (0.3828 => 0.4244, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.86% (1.5859 => 1.7582, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-2: 10.81% (0.3497 => 0.3875, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.78% (0.3543 => 0.3925, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 10.76% (9.4845 => 10.5054, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.74% (8.1363 => 9.0099, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/synchronized: 10.73% (0.3561 => 0.3943, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.72% (2.2024 => 2.4386, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions-3: 10.72% (0.3516 => 0.3893, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 10.72% (0.0933 => 0.1033, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 10.65% (0.4299 => 0.4757, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/for-in: 10.64% (0.3694 => 0.4087, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.60% (0.1906 => 0.2108, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 10.58% (0.8921 => 0.9865, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 10.56% (0.6456 => 0.7138, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 10.55% (0.3886 => 0.4296, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.54% (0.8101 => 0.8955, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 10.54% (0.1044 => 0.1154, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 10.44% (0.3180 => 0.3512, std.dev.: 0.0024) MultiSource/Applications/siod/siod: 10.37% (2.2969 => 2.5351, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/hash: 10.35% (0.4289 => 0.4733, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.30% (1.4186 => 1.5647, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 10.30% (1.1840 => 1.3059, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 9.98% (0.3387 => 0.3725, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 9.84% (1.1861 => 1.3028, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.75% (0.3865 => 0.4242, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.67% (0.1892 => 0.2075, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 9.57% (0.4620 => 0.5062, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.56% (0.4203 => 0.4605, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.21% (0.4636 => 0.5063, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: 9.09% (1.5603 => 1.7021, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/lists: 9.06% (0.3422 => 0.3732, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.90% (0.4103 => 0.4468, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 8.88% (0.3603 => 0.3923, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.83% (4.9449 => 5.3815, std.dev.: 0.0071) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.82% (5.0018 => 5.4432, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/Puzzle: 8.75% (0.1268 => 0.1379, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 8.60% (0.4048 => 0.4396, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.59% (0.7326 => 0.7955, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 8.58% (0.3684 => 0.4000, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.55% (0.3650 => 0.3962, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.42% (0.1330 => 0.1442, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.39% (0.6030 => 0.6536, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.27% (0.2430 => 0.2631, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 8.23% (5.7591 => 6.2333, std.dev.: 0.0067) SingleSource/UnitTests/ObjC++/Hello: 8.19% (0.5925 => 0.6410, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.56% (0.2831 => 0.3045, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.53% (0.3826 => 0.4114, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.52% (0.2793 => 0.3003, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 7.46% (0.3283 => 0.3528, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.45% (0.2872 => 0.3086, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.44% (0.2905 => 0.3121, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.40% (0.2891 => 0.3105, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.37% (0.3162 => 0.3395, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.33% (0.4064 => 0.4362, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 7.30% (0.3098 => 0.3324, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.27% (0.3232 => 0.3467, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.24% (2.0665 => 2.2161, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 7.21% (0.2871 => 0.3078, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 7.16% (0.2877 => 0.3083, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.10% (14.3668 => 15.3869, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.04% (0.2756 => 0.2950, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.97% (0.2725 => 0.2915, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.95% (0.3052 => 0.3264, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.94% (0.3427 => 0.3665, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 6.82% (0.2714 => 0.2899, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 6.78% (17.1811 => 18.3452, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/random: 6.64% (0.2802 => 0.2988, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 6.54% (1.2842 => 1.3682, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/oourafft: 6.52% (0.3282 => 0.3496, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.26% (3.8922 => 4.1358, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bh/bh: 6.14% (0.3092 => 0.3282, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.13% (0.2266 => 0.2405, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 6.09% (0.8067 => 0.8558, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: 6.04% (0.3379 => 0.3583, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.96% (0.3136 => 0.3323, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.05% (0.3131 => 0.3289, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.33% (0.3817 => 0.3944, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.30% (0.3935 => 0.4065, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.49% (7.0540 => 7.2296, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 19.81% (2.8904 => 3.4629, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.58% (1.1145 => 1.2993, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 11.48% (0.2944 => 0.3282, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 9.83% (1.1396 => 1.2516, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.10% (0.9540 => 1.0217, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.67% (3.1578 => 3.3684, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.74% (0.3463 => 0.3627) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 2.92% (4.2280 => 4.3515, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.29% (1.7254 => 1.7649, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.16% (3.6395 => 3.7180, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bisort/bisort: 1.84% (0.8333 => 0.8486, std.dev.: 0.0013) MultiSource/Applications/aha/aha: 1.52% (3.1595 => 3.2075, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 1.33% (11.6436 => 11.7980, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.93% (6.6874 => 0.1385, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -76.62% (0.8651 => 0.2023, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -55.10% (5.3855 => 2.4179, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -54.69% (5.3526 => 2.4255, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/richards_benchmark: -45.75% (0.1622 => 0.0880, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.99% (5.2763 => 3.1135, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -38.17% (1.1194 => 0.6921, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -23.95% (1.7609 => 1.3391, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -13.66% (2.9384 => 2.5371, std.dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: -10.30% (10.4361 => 9.3608, std.dev.: 0.0099) SingleSource/UnitTests/Vector/constpool: -9.11% (54.1659 => 49.2318, std.dev.: 0.0545) MultiSource/Benchmarks/Bullet/bullet: -7.84% (63.2438 => 58.2884, std.dev.: 0.0061) MultiSource/Benchmarks/PAQ8p/paq8p: -5.88% (10.3673 => 9.7577, std.dev.: 0.0138) MultiSource/Applications/ClamAV/clamscan: -3.50% (22.1758 => 21.4002, std.dev.: 0.0120) MultiSource/Applications/JM/lencod/lencod: -1.97% (21.9371 => 21.5053, std.dev.: 0.0136) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -49.25% (0.0400 => 0.0203) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -35.18% (0.0506 => 0.0328) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -35.14% (0.3987 => 0.2586) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -28.78% (10.7105 => 7.6278, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4232, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -10.99% (9.5636 => 8.5125, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: -10.69% (1.5373 => 1.3730, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.64% (19.9488 => 18.2246, std.dev.: 0.0393) MultiSource/Benchmarks/FreeBench/mason/mason: -8.01% (0.2161 => 0.1988, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.12% (1.8329 => 1.7024, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.98% (4.8142 => 4.4781, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.65% (1.2373 => 1.1550, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.64% (2.7294 => 2.5754, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -5.60% (1.9577 => 1.8481, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.07% (1.6805 => 1.5953, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -5.00% (6.6465 => 6.3145, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.93% (1.5835 => 1.5055, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-8: -4.92% (1.8525 => 1.7613, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -4.60% (1.5660 => 1.4939, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.47% (0.9957 => 0.9512, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.04% (0.2497 => 0.2396) MultiSource/Applications/siod/siod: -3.85% (3.2827 => 3.1562, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -3.80% (4.5009 => 4.3297, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.55% (32.5116 => 31.3584, std.dev.: 0.0052) MultiSource/Benchmarks/sim/sim: -3.24% (5.0483 => 4.8848, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: -2.77% (4.6441 => 4.5155, std.dev.: 0.0025) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -2.41% (0.4808 => 0.4692, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/Olden/power/power: -2.14% (1.1277 => 1.1036, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -1.82% (10.2830 => 10.0962, std.dev.: 0.0211) SingleSource/Benchmarks/Misc/flops: -1.72% (8.8334 => 8.6817, std.dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -1.63% (2.5528 => 2.5112, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.60% (8.1563 => 8.0261, std.dev.: 0.0132) MultiSource/Benchmarks/PAQ8p/paq8p: -1.30% (85.0658 => 83.9641, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/lists: -1.16% (6.2999 => 6.2266, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0554 => 1.0441, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8585, std.dev.: 0.0099) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -5.52% (0.1485 => 0.1403, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.19% (0.2116 => 0.0673, std.dev.: 0.0002) Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 23:10:32 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 01:10:32 -0500 (CDT) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20121101061032.B89132A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/5476?compare_to=5473&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 5476, Order: 167210, Start Time: 2012-11-01 04:44:27, End Time: 2012-11-01 06:10:32 To: 5473, Order: 167208, Start Time: 2012-11-01 03:00:07, End Time: 2012-11-01 04:27:39 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Passes: 0 (17 on baseline) Performance Regressions: 3 (85 on baseline) Performance Improvements: 14 (4 on baseline) Existing Failures: 51 (51 on baseline) Unchanged Tests: 974 (885 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/Burg/burg: 1.51% (1.2767 => 1.2960, std.dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.74% (0.3204 => 0.3484, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/pi: 1.10% (2.4853 => 2.5127, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -5.22% (0.2128 => 0.2017, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.79% (0.8781 => 0.8360, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -3.84% (0.6270 => 0.6029, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -3.08% (0.6630 => 0.6426, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/gs/gs: -2.90% (4.2935 => 4.1690, std.dev.: 0.0344) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -2.28% (0.6040 => 0.5902, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -2.16% (1.3896 => 1.3596, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -2.09% (1.2910 => 1.2640, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.74% (8.9782 => 8.8224, std.dev.: 0.0286) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.72% (4.6333 => 4.5536, std.dev.: 0.0154) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.52% (4.3035 => 4.2382, std.dev.: 0.0222) MultiSource/Applications/hexxagon/hexxagon: -1.16% (0.9996 => 0.9880, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -12.47% (3.5136 => 3.0756, std.dev.: 0.0899) SingleSource/Benchmarks/Shootout-C++/heapsort: -12.19% (3.4413 => 3.0218, std.dev.: 0.0413) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 0.19% (16.6833 => 16.7146, std.dev.: 0.0210) MultiSource/Applications/obsequi/Obsequi: -3.69% (1.0784 => 1.0386, std.dev.: 0.0197) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 0.57% (21.7219 => 21.8456, std.dev.: 0.2162) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.92% (0.3696 => 0.3625, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/bigfib: -0.35% (0.6059 => 0.6038, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: -0.42% (0.3339 => 0.3325, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/strcat: 0.25% (0.2018 => 0.2023, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -2.30% (0.0217 => 0.0212, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -19.15% (0.0423 => 0.0342, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.91% (0.0331 => 0.0328, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0312 => 0.0311, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -9.52% (0.0420 => 0.0380, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/casts: 0.50% (0.0202 => 0.0203, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -30.41% (0.0217 => 0.0151, std.dev.: 0.0027) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -1.31% (0.1453 => 0.1434, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -2.36% (1.1378 => 1.1109, std.dev.: 0.0136) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.50% (0.1463 => 0.1441, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.47% (0.4073 => 0.4054, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.07% (0.1282 => 0.1347, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.98% (0.0643 => 0.0611, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -17.48% (0.0246 => 0.0203, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.57% (0.0557 => 0.0588, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.49% (1.1361 => 1.1417, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2900.00% (0.0001 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 800.00% (0.0001 => 0.0009, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.23% (0.0645 => 0.0579, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 30.11% (0.0186 => 0.0242, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: - (0.8010 => 0.8010, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 27.78% (0.0054 => 0.0069, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Passes - Compile Time ------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: 2325.66% (0.6332 => 15.3593, std.dev.: 0.0360) MultiSource/Benchmarks/McCat/08-main/main: 46.75% (0.1831 => 0.2687, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.06% (0.1559 => 0.1449, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1489.50% (0.3344 => 5.3153, std.dev.: 0.0221) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.14% (0.2364 => 0.3242, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel: 3.50% (0.0429 => 0.0444, std.dev.: 0.0005) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.46% (0.0224 => 0.0234, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0000) New Passes - Execution Time --------------------------- MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc/mandel SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3489, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0710, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4945, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.3396, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0438, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.4058, std.dev.: 0.0022) SingleSource/Regression/C/uint64_to_float: -23.72% (2.1832 => 1.6654, std.dev.: 0.0029) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 16.42% (0.0810 => 0.0943, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 13.40% (0.1112 => 0.1261, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.84% (0.2180 => 0.2351, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.44% (0.1425 => 0.1531, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.36% (0.2279 => 0.2424, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 6.04% (1.2222 => 1.2960, std.dev.: 0.0035) MultiSource/Applications/spiff/spiff: 5.53% (0.7950 => 0.8390, std.dev.: 0.0040) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.07% (0.3137 => 0.3296, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.87% (0.2998 => 0.3144, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.86% (0.7473 => 0.7836, std.dev.: 0.0017) MultiSource/Applications/treecc/treecc: 4.09% (1.9948 => 2.0763, std.dev.: 0.0205) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.93% (1.1685 => 1.2144, std.dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.88% (0.4559 => 0.4736, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.78% (0.4127 => 0.4283, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.76% (0.2741 => 0.2844, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.70% (14.2605 => 14.7878, std.dev.: 0.0550) MultiSource/Applications/ClamAV/clamscan: 3.66% (14.7684 => 15.3094, std.dev.: 0.0352) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.61% (0.6227 => 0.6452, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.60% (0.5191 => 0.5378, std.dev.: 0.0040) MultiSource/Applications/SIBsim4/SIBsim4: 3.53% (1.2568 => 1.3012, std.dev.: 0.0084) MultiSource/Applications/hbd/hbd: 3.32% (1.4269 => 1.4743, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.28% (1.1606 => 1.1987, std.dev.: 0.0078) MultiSource/Benchmarks/nbench/nbench: 3.21% (1.1271 => 1.1633, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.15% (1.6386 => 1.6902, std.dev.: 0.0094) MultiSource/Applications/minisat/minisat: 3.12% (0.6834 => 0.7047, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.04% (0.6586 => 0.6786, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 2.92% (3.8189 => 3.9304, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.89% (0.8331 => 0.8572, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.85% (0.9435 => 0.9704, std.dev.: 0.0099) MultiSource/Applications/lemon/lemon: 2.77% (1.0945 => 1.1248, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.67% (0.9074 => 0.9316, std.dev.: 0.0023) MultiSource/Applications/siod/siod: 2.60% (2.2184 => 2.2761, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.60% (0.8805 => 0.9034, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.60% (0.7966 => 0.8173, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.60% (0.8048 => 0.8257, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 2.55% (0.4125 => 0.4230, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.53% (0.8286 => 0.8496, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.53% (0.8855 => 0.9079, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.49% (2.1401 => 2.1934, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.47% (0.8716 => 0.8931, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.42% (0.8340 => 0.8542, std.dev.: 0.0060) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.42% (6.6074 => 6.7670, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.40% (0.8359 => 0.8560, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.39% (0.8611 => 0.8817, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.39% (1.3279 => 1.3596, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.38% (0.9069 => 0.9285, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.37% (0.8086 => 0.8278, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.36% (0.7932 => 0.8119, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.35% (0.8007 => 0.8195, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.30% (0.8697 => 0.8897, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.30% (0.8656 => 0.8855, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.16% (0.8457 => 0.8640, std.dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: 2.16% (8.6247 => 8.8111, std.dev.: 0.0204) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.15% (0.8204 => 0.8380, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.10% (0.8050 => 0.8219, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.04% (0.8885 => 0.9066, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.02% (8.6476 => 8.8224, std.dev.: 0.0286) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.01% (0.8069 => 0.8231, std.dev.: 0.0057) MultiSource/Applications/oggenc/oggenc: 2.00% (4.9628 => 5.0623, std.dev.: 0.0188) MultiSource/Benchmarks/Prolangs-C/football/football: 1.98% (0.8768 => 0.8942, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.97% (1.5315 => 1.5616, std.dev.: 0.0065) MultiSource/Applications/JM/lencod/lencod: 1.91% (15.3280 => 15.6204, std.dev.: 0.0830) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.87% (0.8712 => 0.8875, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.77% (0.8995 => 0.9154, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 1.73% (6.7320 => 6.8485, std.dev.: 0.0339) MultiSource/Benchmarks/Bullet/bullet: 1.73% (31.8598 => 32.4099, std.dev.: 0.1672) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.67% (13.1811 => 13.4017, std.dev.: 0.0410) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.66% (3.1832 => 3.2362, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.65% (1.2602 => 1.2810, std.dev.: 0.0078) MultiSource/Benchmarks/PAQ8p/paq8p: 1.50% (2.3764 => 2.4121, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.48% (4.1763 => 4.2382, std.dev.: 0.0222) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.47% (0.8927 => 0.9058, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.46% (4.4880 => 4.5536, std.dev.: 0.0154) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.18% (1.2423 => 1.2569, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.10% (4.5702 => 4.6204, std.dev.: 0.0118) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 59.08% (1.5795 => 2.5127, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.52% (2.7978 => 3.7356, std.dev.: 0.0114) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.88% (2.4333 => 2.6736, std.dev.: 0.0154) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.35% (0.3186 => 0.3484, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.60% (1.1857 => 1.2758, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 5.91% (63.1822 => 66.9182, std.dev.: 0.0869) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.99% (2.4490 => 2.5222, std.dev.: 0.0124) MultiSource/Applications/siod/siod: 2.74% (3.6643 => 3.7646, std.dev.: 0.0308) MultiSource/Benchmarks/Olden/bh/bh: 1.75% (2.3560 => 2.3972, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: 1.29% (6.1525 => 6.2320, std.dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.59% (0.3269 => 0.3021, std.dev.: 0.0011) MultiSource/Applications/lua/lua: -5.17% (29.8330 => 28.2917, std.dev.: 0.0155) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.41% (0.2605 => 0.2490, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.27% (3.3479 => 3.3054, std.dev.: 0.0016) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/kimwitu++/kc: 1.63% (16.4461 => 16.7146, std.dev.: 0.0210) MultiSource/Applications/obsequi/Obsequi: 1.21% (1.0262 => 1.0386, std.dev.: 0.0197) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6895.07% (0.3123 => 21.8456, std.dev.: 0.2162) SingleSource/Benchmarks/CoyoteBench/fftbench: 47.18% (0.2463 => 0.3625, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/bigfib: 0.47% (0.6010 => 0.6038, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: 1.81% (0.3266 => 0.3325, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/strcat: 2.74% (0.1969 => 0.2023, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 72.36% (0.0123 => 0.0212, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -16.18% (0.0408 => 0.0342, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.13% (0.0254 => 0.0328, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.98% (0.0302 => 0.0311, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.04% (0.0384 => 0.0380, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -16.11% (0.0180 => 0.0151, std.dev.: 0.0027) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.28% (0.1438 => 0.1434, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.94% (1.1329 => 1.1109, std.dev.: 0.0136) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: -1.44% (0.1462 => 0.1441, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.64% (0.4164 => 0.4054, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.61% (0.1369 => 0.1347, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.68% (0.0641 => 0.0611, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 4.10% (0.0195 => 0.0203, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.73% (0.0578 => 0.0588, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.17% (1.1437 => 1.1417, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2900.00% (0.0001 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -35.71% (0.0014 => 0.0009, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.66% (0.0627 => 0.0579, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 34.44% (0.0180 => 0.0242, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.09% (0.8017 => 0.8010, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 11.29% (0.0062 => 0.0069, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 4.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Oct 31 23:56:35 2012 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 1 Nov 2012 01:56:35 -0500 (CDT) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20121101065635.E5A1F2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/5477?compare_to=5474&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 5477, Order: 167211, Start Time: 2012-11-01 05:31:28, End Time: 2012-11-01 06:56:37 To: 5474, Order: 167208, Start Time: 2012-11-01 03:43:24, End Time: 2012-11-01 05:08:24 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (6 on baseline) Performance Improvements: 1 (173 on baseline) Unchanged Tests: 1040 (863 on baseline) Total Tests: 1042 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.01% (78.1897 => 81.3283, std.dev.: 0.2660) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/sim/sim: -3.21% (5.0438 => 4.8817, std.dev.: 0.0335) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.26% (1.2783 => 1.3711, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.16% (3.1919 => 3.4203, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.89% (2.0478 => 2.1070, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/salsa20: 2.49% (7.4937 => 7.6800, std.dev.: 0.0267) SingleSource/Benchmarks/Shootout-C++/hash2: 2.15% (3.1932 => 3.2619, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.02% (79.7170 => 81.3283, std.dev.: 0.2660) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.39% (0.1431 => 0.1311, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.64% (0.1584 => 0.1463, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.17% (0.3821 => 0.3547, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -6.99% (2.4924 => 2.3183, std.dev.: 0.0148) SingleSource/UnitTests/ObjC/trivial-interface: -6.22% (0.3812 => 0.3575, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.21% (0.3142 => 0.2947, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.17% (0.3891 => 0.3651, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.14% (0.2428 => 0.2279, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -6.13% (0.3848 => 0.3612, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -6.12% (0.4033 => 0.3786, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -6.08% (0.4176 => 0.3922, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -6.08% (0.3831 => 0.3598, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.05% (0.3884 => 0.3649, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: -6.01% (0.1879 => 0.1766, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.01% (0.3880 => 0.3647, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -5.95% (0.3896 => 0.3664, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -5.93% (0.3658 => 0.3441, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.89% (22.4056 => 21.0862, std.dev.: 0.0186) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.87% (0.9542 => 0.8982, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -5.83% (0.4199 => 0.3954, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -5.79% (16.1920 => 15.2538, std.dev.: 0.0078) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.79% (4.5069 => 4.2460, std.dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: -5.75% (7.0961 => 6.6884, std.dev.: 0.0079) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.69% (0.2355 => 0.2221, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.68% (3.5339 => 3.3331, std.dev.: 0.0078) SingleSource/UnitTests/ObjC/parameter-passing: -5.68% (0.4280 => 0.4037, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.58% (0.6484 => 0.6122, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.56% (0.4151 => 0.3920, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.55% (0.3837 => 0.3624, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -5.51% (0.3357 => 0.3172, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: -5.42% (0.3025 => 0.2861, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -5.42% (0.2989 => 0.2827, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: -5.42% (0.2160 => 0.2043, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -5.40% (4.3330 => 4.0990, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.39% (0.3323 => 0.3144, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.38% (4.8161 => 4.5570, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.37% (4.0323 => 3.8157, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/ary: -5.36% (0.3394 => 0.3212, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: -5.31% (0.3446 => 0.3263, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -5.31% (1.3148 => 1.2450, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/random: -5.31% (0.2939 => 0.2783, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.30% (5.4682 => 5.1783, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.30% (0.3057 => 0.2895, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.28% (1.0544 => 0.9987, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.28% (2.1713 => 2.0566, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.27% (0.2903 => 0.2750, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: -5.27% (0.2849 => 0.2699, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -5.26% (0.3059 => 0.2898, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.26% (4.8802 => 4.6234, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/objinst: -5.26% (0.3194 => 0.3026, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -5.26% (0.2871 => 0.2720, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: -5.25% (0.4861 => 0.4606, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: -5.24% (1.2515 => 1.1859, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.24% (0.9852 => 0.9336, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.23% (0.7919 => 0.7505, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: -5.23% (0.2659 => 0.2520, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -5.23% (34.0927 => 32.3109, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/ary2: -5.20% (0.3481 => 0.3300, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.19% (1.2784 => 1.2121, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.17% (0.4083 => 0.3872, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -5.16% (0.3026 => 0.2870, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.14% (0.2548 => 0.2417, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.11% (1.6474 => 1.5633, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/lists1: -5.09% (0.3867 => 0.3670, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.09% (14.2083 => 13.4854, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/lists: -5.08% (0.3621 => 0.3437, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.07% (0.4321 => 0.4102, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -5.07% (0.5999 => 0.5695, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.06% (0.3931 => 0.3732, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.04% (0.3849 => 0.3655, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.03% (0.8521 => 0.8092, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.03% (0.7198 => 0.6836, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: -5.02% (0.9179 => 0.8718, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.00% (1.2300 => 1.1685, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/matrix: -4.98% (0.3255 => 0.3093, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.97% (0.3016 => 0.2866, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -4.97% (0.4248 => 0.4037, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.95% (0.3252 => 0.3091, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -4.92% (1.6364 => 1.5559, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: -4.92% (17.1032 => 16.2619, std.dev.: 0.0212) SingleSource/Benchmarks/Misc-C++/bigfib: -4.92% (0.6750 => 0.6418, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: -4.92% (9.2283 => 8.7746, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.90% (1.3722 => 1.3049, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -4.89% (2.4021 => 2.2846, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash: -4.89% (0.4524 => 0.4303, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.88% (0.4813 => 0.4578, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -4.86% (1.1450 => 1.0894, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.80% (1.4642 => 1.3939, std.dev.: 0.0012) MultiSource/Applications/lua/lua: -4.78% (4.0594 => 3.8655, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.74% (0.2278 => 0.2170, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: -4.72% (0.2985 => 0.2844, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.71% (0.3483 => 0.3319, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.69% (0.5478 => 0.5221, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.69% (0.6293 => 0.5998, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.68% (0.5857 => 0.5583, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.68% (0.4427 => 0.4220, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -4.67% (0.3788 => 0.3611, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.67% (0.6230 => 0.5939, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.66% (1.2221 => 1.1652, std.dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.63% (6.7716 => 6.4578, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.63% (1.2210 => 1.1645, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.62% (0.6194 => 0.5908, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.61% (0.5591 => 0.5333, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.60% (0.2999 => 0.2861, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.58% (0.7339 => 0.7003, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: -4.57% (18.2933 => 17.4579, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.53% (0.2933 => 0.2800, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.53% (0.5802 => 0.5539, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.52% (0.5925 => 0.5657, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.52% (0.5859 => 0.5594, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -4.52% (0.7982 => 0.7621, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.50% (0.4916 => 0.4695, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.49% (0.5570 => 0.5320, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.48% (2.2587 => 2.1575, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.48% (0.6052 => 0.5781, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.47% (0.3491 => 0.3335, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.45% (0.6667 => 0.6370, std.dev.: 0.0055) MultiSource/Applications/minisat/minisat: -4.43% (0.7447 => 0.7117, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.42% (0.6260 => 0.5983, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -4.42% (0.5705 => 0.5453, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.41% (0.5581 => 0.5335, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.38% (0.6189 => 0.5918, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.36% (0.6304 => 0.6029, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.35% (0.9557 => 0.9141, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.35% (0.6395 => 0.6117, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.34% (0.6446 => 0.6166, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.34% (0.5849 => 0.5595, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.34% (0.5805 => 0.5553, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.33% (0.7524 => 0.7198, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: -4.33% (0.6347 => 0.6072, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.32% (0.6660 => 0.6372, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.31% (0.6676 => 0.6388, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.31% (0.5567 => 0.5327, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.31% (0.6681 => 0.6393, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.29% (0.6440 => 0.6164, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.28% (0.2385 => 0.2283, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: -4.27% (0.4515 => 0.4322, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.26% (0.5569 => 0.5332, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.25% (0.5456 => 0.5224, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.25% (0.6736 => 0.6450, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.24% (0.5688 => 0.5447, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.23% (0.6033 => 0.5778, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: -4.22% (15.5079 => 14.8531, std.dev.: 0.0133) SingleSource/UnitTests/ObjC++/property-reference: -4.22% (0.7779 => 0.7451, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.19% (0.2695 => 0.2582, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: -4.19% (0.3581 => 0.3431, std.dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference-object: -4.18% (0.6441 => 0.6172, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.16% (8.0126 => 7.6790, std.dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: -4.13% (0.3319 => 0.3182, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: -4.13% (0.3271 => 0.3136, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: -4.10% (2.1401 => 2.0523, std.dev.: 0.0024) MultiSource/Applications/spiff/spiff: -4.10% (0.8418 => 0.8073, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.04% (0.5941 => 0.5701, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: -3.97% (1.3864 => 1.3313, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -3.94% (0.6395 => 0.6143, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: -3.71% (3.5154 => 3.3849, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.70% (0.9077 => 0.8741, std.dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: -3.66% (15.2527 => 14.6944, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.65% (0.7021 => 0.6765, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: -3.60% (1.1530 => 1.1115, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -3.58% (1.5610 => 1.5051, std.dev.: 0.0041) MultiSource/Applications/oggenc/oggenc: -3.53% (5.0226 => 4.8452, std.dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.39% (0.5168 => 0.4993, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.17% (0.5329 => 0.5160, std.dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -2.59% (20.7746 => 20.2373, std.dev.: 0.0090) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7518, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/richards_benchmark: -8.66% (1.2842 => 1.1730, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.95% (2.2633 => 2.1738, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.85% (1.7753 => 1.7069, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.52% (6.5735 => 6.4734, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0001) Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: